2025-10-02T09:27:59.466418Z :BasicWriteSession INFO: Random seed for debugging is 1759397279466413
2025-10-02T09:27:59.546267Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553774032951647:2153];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.546371Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:27:59.548932Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.549454Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553776757185388:2151];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.549536Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/tmpMIEWf7/pdisk_1.dat
2025-10-02T09:27:59.551305Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.572857Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.578842Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.587692Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 20987, node 1
2025-10-02T09:27:59.599317Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/yandext9nZQS.tmp
2025-10-02T09:27:59.599329Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/yandext9nZQS.tmp
2025-10-02T09:27:59.599369Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/yandext9nZQS.tmp
2025-10-02T09:27:59.599409Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:27:59.603711Z INFO: TTestServer started on Port 9417 GrpcPort 20987
TClient is connected to server localhost:9417
PQClient connected to localhost:20987
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:27:59.647987Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.648024Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.649749Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:27:59.652844Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.652872Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.654199Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-02T09:27:59.654331Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:27:59.654613Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:27:59.757475Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:27:59.831456Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:27:59.869804Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553774032952487:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.869839Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.869927Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553774032952512:2327], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.869960Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.869991Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553774032952516:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.870565Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553774032952547:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.870583Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.870653Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553774032952549:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.870666Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:27:59.870854Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:27:59.875026Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556553774032952518:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-02T09:27:59.921476Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:27:59.948011Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556553774032952704:2763] txid# 281474976715663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:27:59.949209Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:27:59.949350Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553776757185660:2303], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:27:59.949443Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NDFhMGFlYWEtNzFlYjU3NGEtNGI0MmVmOGQtYzhlMzA2OGM=, ActorId: [2:7556553776757185618:2296], ActorState: ExecuteState, TraceId: 01k6j3zy5se1e466v95021aw8p, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:27:59.949916Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:27:59.952741Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553774032952735:2344], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:27:59.952839Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ODhiNWQ1My1mMDM5YjJlZi0zNGMyYTQ3My02MTYxMTYwNQ==, ActorId: [1:7556553774032952483:2322], ActorState: ExecuteState, TraceId: 01k6j3zy3t6wd961kmgxwspjfp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:27:59.952955Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:27:59.973349Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:20987", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:00.020889Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6j3zy7xf8p8emkrthvk1fqz, Database: , SessionId: ydb://session/3?node_id=1&id=ODJhYmYyMTMtNjhiYWI5ODUtYjFjMTUxMC00MDVkZGJlNQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553778327920304:2977] 
2025-10-02T09:28:00.547374Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:00.550956Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:04.546142Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553774032951647:2153];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.546187Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:04.549694Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553776757185388:2151];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.549728Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:05.143823Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:20987
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.164679Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:20987
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:05.171117Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553799802757297:3279] connected; active server actors: 1
2025-10-02T09:28:05.171258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:05.171447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:05.171813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:05.173632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:05.173975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:05.174012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:05.174021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.174032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:05.174084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553799802757316:2455], now have 1 active actors on pipe
2025-10-02T09:28:05.174091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553799802757296:3278], now have 1 active actors on pipe
2025-10-02T09:28:05.174211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:05.174249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.174977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.176239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553799802757351:3323], now have 1 active actors on pipe
2025-10-02T09:28:05.176307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.177070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.177206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:05.177225Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:05.177276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:05.177345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553802526989964:2395]
2025-10-02T09:28:05.177797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:05.177805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:05.177809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553802526989964:2395]
2025-10-02T09:28:05.177813Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:05.178015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:05.178023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.178039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.178044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:05.178046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.178047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.178048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.178049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.178053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:05.178127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.178149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.178914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.178942Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397285219, TxId 281474976715679
2025-10-02T09:28:05.178949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.178951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.178984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.179021Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:05.179509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:05.179551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:05.179561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.179567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.179569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.179573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.179661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:05.179679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.179713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.180536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.180553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.180869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.182702Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6j4039h0j4pj0vfsrr53ppc, Database: , SessionId: ydb://session/3?node_id=1&id=ZGY3MjczMmYtNDI0NjJlMTItNTExZTkzYWMtZTllYTkyM2I=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759397285219
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759397285219
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:20987
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.188347Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.278280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.278303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.278306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.378633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.378652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.378654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.478989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.479006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.479009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.579328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.579343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.579348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.679665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.679680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.679683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:20987
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.689430Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.780042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.780060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.780066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.880406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.880425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.880428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.980750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.980766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.980768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.081104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.081120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.081122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.181450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.181469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.181472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:20987
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:06.191094Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:06.192412Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:06.192627Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:06.192633Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:20987
2025-10-02T09:28:06.193152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.193170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:06.194874Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.195217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.195254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48188
2025-10-02T09:28:06.195259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48188 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:06.195262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.195667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:06.195714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.195723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.195725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.195730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.196237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.218574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.218661Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804097724858:2489] connected; active server actors: 1
2025-10-02T09:28:06.218681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:06.218691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.218749Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804097724858:2489] disconnected; active server actors: 1
2025-10-02T09:28:06.218756Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804097724858:2489] disconnected no session
2025-10-02T09:28:06.233766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.233781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.233785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553804097724826:2489] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.233793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.234075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553804097724881:2489], now have 1 active actors on pipe
2025-10-02T09:28:06.234251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.234341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.234355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.234415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:06.234457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.234461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.234464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.234480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.234499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.234526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.234711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.234719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.234734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.234803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0
2025-10-02T09:28:06.235135Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286235 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.235171Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:06.235259Z :INFO: [] MessageGroupId [src] SessionId [src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:06.235264Z :INFO: [] MessageGroupId [src] SessionId [src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0] Write session will now close
2025-10-02T09:28:06.235273Z :DEBUG: [] MessageGroupId [src] SessionId [src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0] Write session: aborting
2025-10-02T09:28:06.235382Z :INFO: [] MessageGroupId [src] SessionId [src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:06.235387Z :DEBUG: [] MessageGroupId [src] SessionId [src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0] Write session: destroy
2025-10-02T09:28:06.235560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.235569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0 grpc read failed
2025-10-02T09:28:06.235575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0 grpc closed
2025-10-02T09:28:06.235580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|eeafc2bb-5acc303d-32b245fe-d6d3f2a8_0 is DEAD
2025-10-02T09:28:06.235838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.235970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553804097724881:2489] destroyed
2025-10-02T09:28:06.235999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.236008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.236010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.236013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
2025-10-02T09:28:06.281803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.281822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.281825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:06.289566Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:20987" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:20987" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:20987" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T09:28:06.291655Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:06.291860Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:28:06.369474Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:28:06.369722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.369737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:06.371197Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:06.371320Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:28:06.371443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:06.371500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:52264
2025-10-02T09:28:06.371505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:52264 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:28:06.371508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.371903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:06.371936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.371945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.371947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.371953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.372513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.374252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.374322Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804097724910:2502] connected; active server actors: 1
2025-10-02T09:28:06.374343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T09:28:06.374353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.374410Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804097724910:2502] disconnected; active server actors: 1
2025-10-02T09:28:06.374418Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553804097724910:2502] disconnected no session
2025-10-02T09:28:06.377407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.377419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.377422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553804097724889:2502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.377429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.377719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553804097724927:2502], now have 1 active actors on pipe
2025-10-02T09:28:06.377754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.377824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.377836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.377866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:06.377882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.377887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.377889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.377907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.377926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.377951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.378130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.378138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.378152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.378253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0
2025-10-02T09:28:06.378593Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:06.378615Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286378 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.378664Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T09:28:06.378742Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-02T09:28:06.378908Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:06.378923Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-02T09:28:06.379196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.379303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.379471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.379484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.379505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:06.379574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.379674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.379683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.379783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-10-02T09:28:06.379798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.379811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.379816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.379818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.379845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:06.379902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-10-02T09:28:06.379915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.379966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1759397286379
2025-10-02T09:28:06.379992Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.380007Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-10-02T09:28:06.381101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [2:7556553802526989948:2395]
2025-10-02T09:28:06.381126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.381146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.381148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-10-02T09:28:06.381154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.381163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T09:28:06.381207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:06.381217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:06.381221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.381223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.381226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.381233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T09:28:06.381240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 158 bytes (158)
2025-10-02T09:28:06.381244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 158 (8388608)
2025-10-02T09:28:06.381254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:28:06.381292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:06.381312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:06.381318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:06.381328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.381335Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T09:28:06.381351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.381354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-02T09:28:06.381367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-10-02T09:28:06.381361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.381388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286379 queuesize 0 startOffset 0
2025-10-02T09:28:06.381618Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T09:28:06.381780Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T09:28:06.381789Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T09:28:06.381794Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.002000s minimal time in partition queue 0.000000s maximal time in partition queue 0.000000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-10-02T09:28:06.381971Z :INFO: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T09:28:06.381977Z :INFO: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T09:28:06.381990Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:28:06.382137Z :INFO: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:06.382144Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:28:06.382122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.382134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.382136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.382353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.382364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0 grpc read failed
2025-10-02T09:28:06.382370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0 grpc closed
2025-10-02T09:28:06.382375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|954fde1d-30f583b8-1bfff09a-8242ba38_0 is DEAD
2025-10-02T09:28:06.382651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.382973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553804097724927:2502] destroyed
2025-10-02T09:28:06.382996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.383005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.383012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.383014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.482502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.482518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.482524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.876290Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1759397286876283
2025-10-02T09:28:06.949469Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556553804678298233:2173];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:06.949847Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:06.949893Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/tmpVxiYar/pdisk_1.dat
2025-10-02T09:28:06.949987Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:06.950722Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:06.951241Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:06.951963Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:06.976147Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:06.976181Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:06.977003Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:06.979935Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:06.979960Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:06.981922Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:06.981967Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:28:06.982136Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 19776, node 3
2025-10-02T09:28:06.990567Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/yandexDl1kwW.tmp
2025-10-02T09:28:06.990580Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/yandexDl1kwW.tmp
2025-10-02T09:28:06.990629Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001e9/r3tmp/yandexDl1kwW.tmp
2025-10-02T09:28:06.990686Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:06.993652Z INFO: TTestServer started on Port 29864 GrpcPort 19776
TClient is connected to server localhost:29864
PQClient connected to localhost:19776
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
waiting...
waiting...
2025-10-02T09:28:07.012896Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-02T09:28:07.118065Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:07.233362Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:07.369517Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553808973265730:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.369539Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553808973265721:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.369559Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.370788Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:07.373909Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553808973265762:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.373946Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:07.377079Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556553808973265735:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-02T09:28:07.393183Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556553812260221194:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:07.394093Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=NTQwMGVlMjYtZTgwOTQ2MjItMTZkNTZmYTktZjlkYmRjY2E=, ActorId: [3:7556553812260221160:2322], ActorState: ExecuteState, TraceId: 01k6j405et5anxs0k4rt4e47bd, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:07.394259Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:07.400187Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:07.443853Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:07.452673Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556553808973265838:2175] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:07.460063Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556553808973265851:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:07.460149Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=OGM5MTM4NDAtZjY4Y2ZjYmItYzcyMGZhMTktYjY4OWMyNjA=, ActorId: [4:7556553808973265719:2295], ActorState: ExecuteState, TraceId: 01k6j405e99gtk2e609a3cnj0m, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:07.460328Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:07.479820Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:19776", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:07.580919Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k6j405m7br0rp0vcgbgvz1v6, Database: , SessionId: ydb://session/3?node_id=3&id=MTExOTlkYjItMzkyY2E3ZjYtNGIwOTE3NTItMWJlMjYwZDA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556553812260221591:2941] 
2025-10-02T09:28:07.947859Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:07.950713Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:11.949606Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556553804678298233:2173];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:11.949638Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:13.649313Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710679:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:19776
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:19776
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-10-02T09:28:13.671433Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710680
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:13.679273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:13.681238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:13.681310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:13.681324Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.681334Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:13.681457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553838030025976:3294], now have 1 active actors on pipe
2025-10-02T09:28:13.681669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:13.682181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553838030026005:2461], now have 1 active actors on pipe
2025-10-02T09:28:13.683304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:13.681602Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556553838030025977:3295] connected; active server actors: 1
2025-10-02T09:28:13.681649Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:13.682036Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:13.682297Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-02T09:28:13.682446Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:13.685286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553838030026024:3335], now have 1 active actors on pipe
2025-10-02T09:28:13.685469Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:13.686971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:13.687124Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:13.687138Z node 4 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:13.687207Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:13.687239Z node 4 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7556553834743070183:2415]
2025-10-02T09:28:13.687991Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:13.687994Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:13.687998Z node 4 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7556553834743070183:2415]
2025-10-02T09:28:13.688004Z node 4 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:13.688290Z node 4 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:13.688295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.688308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.688310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.688313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:13.688315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.688318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.688319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:13.688325Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.688379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:13.688400Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:13.691525Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710681. Ctx: { TraceId: 01k6j40bkcatp7deedy9s24cjb, Database: , SessionId: ydb://session/3?node_id=3&id=NTVkZDJkZmEtY2ZmMWI5ZGUtNDFlOWUyZjYtODhhZGQxNTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T09:28:13.694566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:13.694611Z node 4 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397293731, TxId 281474976710680
2025-10-02T09:28:13.694616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.694618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.694645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.694688Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:13.695432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:13.695488Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:13.695496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.695498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.695511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.695517Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:13.695620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:13.695639Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.695686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-02T09:28:13.696944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:13.696967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710680
    CreateStep: 1759397293731
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710680
    CreateStep: 1759397293731
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:19776
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:13.697519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
CallPersQueueGRPC response:
2025-10-02T09:28:13.698058Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:13.788736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.788752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.788755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.889091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.889108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.889111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.989429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.989445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.989448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.089787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.089802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.089805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.190126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.190147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.190149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:19776
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.199134Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:14.290475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.290489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.290491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.390839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.390856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.390859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.491190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.491207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.491210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.591556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.591574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.591576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.691901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.691919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.691922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:19776
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.700416Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:14.701347Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:14.701589Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:14.701594Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:19776
2025-10-02T09:28:14.701862Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:14.701924Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.701934Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:14.702072Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:14.702095Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58558
2025-10-02T09:28:14.702101Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58558 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.702104Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.702410Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:14.702435Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.702441Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.702442Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.702446Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.702938Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.722594Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:14.722676Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553842324993525:2495] connected; active server actors: 1
2025-10-02T09:28:14.722703Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:14.722711Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.722762Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553842324993525:2495] disconnected; active server actors: 1
2025-10-02T09:28:14.722768Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553842324993525:2495] disconnected no session
2025-10-02T09:28:14.737336Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.737352Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:14.737355Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553842324993494:2495] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.737362Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.737612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-02T09:28:14.737585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553842324993548:2495], now have 1 active actors on pipe
2025-10-02T09:28:14.737688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.737701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.737734Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:14.737748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.737753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.737755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.737767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.737784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.737808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.738005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.738016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.738030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.738117Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0
2025-10-02T09:28:14.738433Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397294738 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:14.738468Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.738563Z :INFO: [] MessageGroupId [src] SessionId [src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:14.738572Z :INFO: [] MessageGroupId [src] SessionId [src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0] Write session will now close
2025-10-02T09:28:14.738578Z :DEBUG: [] MessageGroupId [src] SessionId [src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0] Write session: aborting
2025-10-02T09:28:14.738697Z :INFO: [] MessageGroupId [src] SessionId [src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:14.738702Z :DEBUG: [] MessageGroupId [src] SessionId [src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0] Write session: destroy
2025-10-02T09:28:14.738881Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0 grpc read done: success: 0 data: 
2025-10-02T09:28:14.738890Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0 grpc read failed
2025-10-02T09:28:14.738896Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0 grpc closed
2025-10-02T09:28:14.738899Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|af67c6f5-17fd4feb-ca801f49-78ddbb5d_0 is DEAD
2025-10-02T09:28:14.739231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553842324993548:2495] destroyed
2025-10-02T09:28:14.739245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:14.739252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.739254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.739255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.739117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
Session was created
2025-10-02T09:28:14.792257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.792278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.792281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.892575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.892592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.892595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.772430Z :FallbackToSingleDb INFO: Random seed for debugging is 1759397288772424
2025-10-02T09:28:08.869328Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553814446008833:2219];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:08.869437Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:08.871804Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553814049617565:2079];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:08.871680Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:08.872117Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/tmpx3CvRa/pdisk_1.dat
2025-10-02T09:28:08.874452Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:08.909146Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:08.923088Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:08.922954Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 14717, node 1
2025-10-02T09:28:08.931790Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/yandexbhrLuB.tmp
2025-10-02T09:28:08.931801Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/yandexbhrLuB.tmp
2025-10-02T09:28:08.931869Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/yandexbhrLuB.tmp
2025-10-02T09:28:08.931913Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:08.935373Z INFO: TTestServer started on Port 25131 GrpcPort 14717
TClient is connected to server localhost:25131
PQClient connected to localhost:14717
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:08.969177Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:08.969216Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:08.970956Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:08.974496Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-02T09:28:08.976603Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:08.976627Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:08.978023Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:28:08.978312Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-02T09:28:09.085198Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:09.175782Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:09.292672Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553818344585169:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.292686Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553818344585143:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.292691Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.291147Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553818740976910:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.291147Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553818740976877:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.291164Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.291244Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556553818740976912:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.291249Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.292352Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:09.293071Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553818344585174:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.293087Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.298941Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553818344585175:2127] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:09.307137Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556553818344585173:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-02T09:28:09.307050Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556553818740976913:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-02T09:28:09.347794Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.367042Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553818344585242:2160] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:09.373243Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556553818740977083:2726] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:09.393202Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.394523Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553818740977103:2341], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:09.394631Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NzM5MmIzNy0zMjM5YTkwZi04ZjdmMTczMC0xZWMxOGY4OA==, ActorId: [1:7556553818740976870:2321], ActorState: ExecuteState, TraceId: 01k6j407a6d1r57xwkmyjey2mf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:09.395128Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:09.396902Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553818344585260:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:09.397053Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=YTg5YjQ3M2ItOTBjYzc4YTEtZWEyYjlmYzUtYmY3NTdhOWQ=, ActorId: [2:7556553818344585140:2294], ActorState: ExecuteState, TraceId: 01k6j407a5encqfqktj13tv1n2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:09.397164Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:09.422372Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14717", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:09.466020Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6j407f4fgjd8gp6g6shz915, Database: , SessionId: ydb://session/3?node_id=1&id=MWZiNWMzOTctYTI0MDY2MGItZGM1MGJmZDgtZjkwZDhhMzU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553818740977423:2978] 
2025-10-02T09:28:09.869588Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:09.874158Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:13.869303Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553814446008833:2219];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:13.869339Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:13.872377Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553814049617565:2079];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:13.872423Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:14.584111Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14717
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.600794Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14717
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:14.606810Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553840215814426:3292] connected; active server actors: 1
2025-10-02T09:28:14.606932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:14.607042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:14.607278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:14.609107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.609603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.609642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:14.609653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.609668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:14.609739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553840215814425:3291], now have 1 active actors on pipe
2025-10-02T09:28:14.609748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553840215814450:2452], now have 1 active actors on pipe
2025-10-02T09:28:14.609793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:14.609898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.610742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.611859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553840215814486:3340], now have 1 active actors on pipe
2025-10-02T09:28:14.611938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.612895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.613048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.613066Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.613105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.613151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839819422250:2401]
2025-10-02T09:28:14.613603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.613609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.613612Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553839819422250:2401]
2025-10-02T09:28:14.613616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.613810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.613817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.613832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.613836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.613838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:14.613839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.613840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.613841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:14.613844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.613916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.613944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.614976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.615002Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397294655, TxId 281474976720679
2025-10-02T09:28:14.615008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.615009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.615031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.615058Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.615492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.615530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.615539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.615540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.615541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.615543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.615615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:14.615629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.615654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.616599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.616619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.616993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.618367Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6j40cgd463t80dkpr6xqzny, Database: , SessionId: ydb://session/3?node_id=1&id=NGQ5ZjA1MTctNDBlNmNjMDMtZDAwNzRmM2EtYmE4N2ZhNzc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759397294655
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759397294655
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14717
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.624384Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:14.714107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.714118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.714120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.814491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.814510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.814513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.914813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.914830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.914832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.015165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.015193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.015196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.115533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.115549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.115552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14717
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:15.125378Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:15.215872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.215886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.215889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.316230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.316244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.316247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.416554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.416566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.416568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.516918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.516930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.516931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.617268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.617281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.617283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14717
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:15.626872Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:15.628193Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:15.628422Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:15.628428Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14717
2025-10-02T09:28:15.628951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.628966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:15.630407Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:15.630613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:15.630651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48530
2025-10-02T09:28:15.630654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48530 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.630657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.630959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:15.631002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.631006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.631007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.631012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.631435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.653177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:15.653250Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553844510781991:2487] connected; active server actors: 1
2025-10-02T09:28:15.653268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:15.653277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.653330Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553844510781991:2487] disconnected; active server actors: 1
2025-10-02T09:28:15.653335Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553844510781991:2487] disconnected no session
2025-10-02T09:28:15.668157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.668172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:15.668176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553844510781959:2487] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.668185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.668471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553844510782014:2487], now have 1 active actors on pipe
2025-10-02T09:28:15.668518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:15.668623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.668640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.668680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|e3623746-dbddecee-2d2cabc7-b4875c11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:15.668693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.668712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.668718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.668731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.668744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.668764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.668950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.668959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.668972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.669064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|e3623746-dbddecee-2d2cabc7-b4875c11_0
2025-10-02T09:28:15.669409Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397295669 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:15.669449Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|e3623746-dbddecee-2d2cabc7-b4875c11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.669575Z :INFO: [] MessageGroupId [src] SessionId [src|e3623746-dbddecee-2d2cabc7-b4875c11_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:15.669585Z :INFO: [] MessageGroupId [src] SessionId [src|e3623746-dbddecee-2d2cabc7-b4875c11_0] Write session will now close
2025-10-02T09:28:15.669592Z :DEBUG: [] MessageGroupId [src] SessionId [src|e3623746-dbddecee-2d2cabc7-b4875c11_0] Write session: aborting
2025-10-02T09:28:15.669847Z :DEBUG: [] MessageGroupId [src] SessionId [src|e3623746-dbddecee-2d2cabc7-b4875c11_0] Write session is aborting and will not restart
2025-10-02T09:28:15.669848Z :INFO: [] MessageGroupId [src] SessionId [src|e3623746-dbddecee-2d2cabc7-b4875c11_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:15.669871Z :DEBUG: [] MessageGroupId [src] SessionId [src|e3623746-dbddecee-2d2cabc7-b4875c11_0] Write session: destroy
2025-10-02T09:28:15.669917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|e3623746-dbddecee-2d2cabc7-b4875c11_0 grpc read done: success: 0 data: 
2025-10-02T09:28:15.669926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|e3623746-dbddecee-2d2cabc7-b4875c11_0 grpc read failed
2025-10-02T09:28:15.669934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|e3623746-dbddecee-2d2cabc7-b4875c11_0 grpc closed
2025-10-02T09:28:15.669939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|e3623746-dbddecee-2d2cabc7-b4875c11_0 is DEAD
2025-10-02T09:28:15.670134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:15.670243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553844510782014:2487] destroyed
2025-10-02T09:28:15.670258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:15.670264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.670267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.670268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T09:28:15.673386Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-02T09:28:15.673404Z :INFO: [/Root] [] [7fc005c0-31c8f089-3a7caeb3-10b5e00c] Open read subsessions to databases: { name: , endpoint: localhost:14717, path: /Root }
2025-10-02T09:28:15.673485Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Starting read session
2025-10-02T09:28:15.673497Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Starting single session
2025-10-02T09:28:15.673715Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:15.673720Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:15.673725Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:15.674651Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] Successfully connected. Initializing session
2025-10-02T09:28:15.674813Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:15.674823Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T09:28:15.676765Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:15.676861Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 read init: from# ipv6:[::1]:48548, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:15.676953Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 auth for : user
2025-10-02T09:28:15.677162Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 Handle describe topics response
2025-10-02T09:28:15.677193Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 auth is DEAD
2025-10-02T09:28:15.677201Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:15.677465Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:15.677539Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] Got InitResponse. ReadSessionId: shared/user_1_1_2462772052499991451_v1
2025-10-02T09:28:15.677549Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:15.677572Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553844510782022:2500] connected; active server actors: 1
2025-10-02T09:28:15.677584Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556553844510782022:2500] session shared/user_1_1_2462772052499991451_v1
2025-10-02T09:28:15.677594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:28:15.677607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:28:15.677616Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_2462772052499991451_v1" (Sender=[1:7556553844510782019:2500], Pipe=[1:7556553844510782022:2500], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:15.677626Z :DEBUG: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:15.677624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:15.677639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:28:15.677647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_2462772052499991451_v1" (Sender=[1:7556553844510782019:2500], Pipe=[1:7556553844510782022:2500], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:15.677657Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_2462772052499991451_v1" sender [1:7556553844510782019:2500] lock partition 0 for ReadingSession "shared/user_1_1_2462772052499991451_v1" (Sender=[1:7556553844510782019:2500], Pipe=[1:7556553844510782022:2500], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T09:28:15.677669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:28:15.677678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-02T09:28:15.677884Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_2462772052499991451_v1" ClientId: "user" PipeClient { RawX1: 7556553844510782022 RawX2: 4503603922340292 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:15.677901Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:15.677911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:28:15.677954Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 got read request: guid# b6caa7ac-40ad25fc-15edbbc0-ba77349d
2025-10-02T09:28:15.678073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553844510782025:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.678149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553844510782025:2503]
2025-10-02T09:28:15.678259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.678273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.678286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_2462772052499991451_v1 on pipe: [1:7556553844510782025:2503]
2025-10-02T09:28:15.678309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.678319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.678321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.678336Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_2462772052499991451_v1:1 with generation 1
2025-10-02T09:28:15.678356Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_2462772052499991451_v1
2025-10-02T09:28:15.678364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.678395Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:15.679477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:15.679507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:15.679518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.679524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.679525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.679531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:15.679541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:15.679650Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397295669 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:15.679667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:15.679695Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:15.679990Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-02T09:28:15.680048Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Closing read session. Close timeout: 0.010000s
2025-10-02T09:28:15.680057Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T09:28:15.680064Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:15.680156Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T09:28:15.680200Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:15.680211Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T09:28:15.680213Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:15.680191Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:15.680218Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:15.680222Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T09:28:15.680204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:15.680224Z :INFO: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:15.680210Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:15.680236Z :NOTICE: [/Root] [/Root] [23d49081-7e791f6-5a59770c-5892ddf0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:15.680291Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 grpc closed
2025-10-02T09:28:15.680306Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_2462772052499991451_v1 is DEAD
2025-10-02T09:28:15.680434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_2462772052499991451_v1
2025-10-02T09:28:15.680451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553844510782025:2503] destroyed
2025-10-02T09:28:15.680465Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_2462772052499991451_v1
2025-10-02T09:28:15.680549Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553844510782022:2500] disconnected; active server actors: 1
2025-10-02T09:28:15.680559Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553844510782022:2500] client user disconnected session shared/user_1_1_2462772052499991451_v1
2025-10-02T09:28:15.717621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.717633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.717636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.817957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.817969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.817971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.171929Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1759397296171923
2025-10-02T09:28:16.235516Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556553850771122876:2153];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:16.235736Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:16.237037Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556553847187690532:2150];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:16.237073Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/tmpZ43y91/pdisk_1.dat
2025-10-02T09:28:16.237835Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:16.238451Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:16.239063Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:16.239328Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:16.253894Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:16.258605Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:16.258639Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:16.259514Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:28:16.259783Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 8279, node 3
2025-10-02T09:28:16.266382Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/yandexS5o95a.tmp
2025-10-02T09:28:16.266402Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/yandexS5o95a.tmp
2025-10-02T09:28:16.266465Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/000185/r3tmp/yandexS5o95a.tmp
2025-10-02T09:28:16.266501Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:16.269724Z INFO: TTestServer started on Port 2645 GrpcPort 8279
TClient is connected to server localhost:2645
PQClient connected to localhost:8279
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:16.285565Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:28:16.337370Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:16.337402Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:16.338870Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:16.435713Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:16.463621Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:16.612414Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553847187690777:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:16.612431Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553847187690769:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:16.612488Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:16.613641Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:16.617485Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556553847187690783:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-02T09:28:16.632424Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556553850771123796:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:16.632707Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=NDM4MjQxNDYtOTEzNGFiNDAtY2QzNTJjN2UtYTA3OWZlMDI=, ActorId: [3:7556553850771123754:2322], ActorState: ExecuteState, TraceId: 01k6j40efkb1924b1r9nm7a8a6, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:16.632865Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:16.634867Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:16.649991Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:16.681897Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:8279", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:16.710126Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556553847187690885:2176] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:16.722214Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k6j40ehy6q7mtyway7jknrcq, Database: , SessionId: ydb://session/3?node_id=3&id=ZDY1MDg1OGYtZjRjZjBhMjctMWIxYmJjYjItMTU4YTgxOGQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556553850771124241:2997] 
2025-10-02T09:28:17.237225Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:17.238771Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:21.235471Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556553850771122876:2153];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:21.235508Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:21.236998Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556553847187690532:2150];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:21.237030Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:21.827565Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:8279
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:21.841163Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:8279
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:21.847107Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:21.847210Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556553872245961299:3334] connected; active server actors: 1
2025-10-02T09:28:21.847479Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:21.847646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:21.847690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:21.847703Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.847712Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:21.847758Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:21.847818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553872245961296:3332], now have 1 active actors on pipe
2025-10-02T09:28:21.848006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:21.848084Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:21.848271Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556553868662527768:2384], now have 1 active actors on pipe
2025-10-02T09:28:21.848359Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T09:28:21.848833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:21.850801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553872245961367:3387], now have 1 active actors on pipe
2025-10-02T09:28:21.850853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:21.851557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:21.851738Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:21.851754Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:21.851816Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:21.851850Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556553872245961379:2463]
2025-10-02T09:28:21.852366Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.852373Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.852377Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556553872245961379:2463]
2025-10-02T09:28:21.852384Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:21.852577Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:21.852587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.852601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.852607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.852610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:21.852613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.852614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.852616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:21.852622Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.852672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:21.852690Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:21.853471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:21.853500Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397301900, TxId 281474976715677
2025-10-02T09:28:21.853507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.853509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.853527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.853574Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:21.853948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:21.853988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:21.853998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.854000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.854001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.854005Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:21.854093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:21.854111Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.854151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:21.854855Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:21.854875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:21.855153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:21.859926Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k6j40kjnbqwepb7dtw09xk2p, Database: , SessionId: ydb://session/3?node_id=3&id=NzY2YTdkMWQtMzcxZjg3YWItOTZiODE4MmMtYjFiZjdlNWM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759397301900
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759397301900
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:8279
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:21.865736Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:21.952776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.952792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.952795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.053132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.053148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.053151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.153483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.153501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.153505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.255675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.255693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.255697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.356962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.356977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.356980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:8279
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.367009Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:22.457098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.457114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.457118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.557458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.557475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.557478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.657804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.657821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.657825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.758158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.758175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.758178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.858499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.858515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.858518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:8279
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.868569Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:22.869955Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:22.870180Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:22.870186Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:8279
2025-10-02T09:28:22.870562Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:22.870668Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:22.870680Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:22.870916Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:22.870942Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:43132
2025-10-02T09:28:22.870948Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43132 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:22.870950Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:22.871275Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:22.871305Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:22.871308Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:22.871309Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:22.871314Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:22.871811Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:22.893470Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:22.893604Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553876540928912:2502] connected; active server actors: 1
2025-10-02T09:28:22.893682Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:22.893689Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:22.893795Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553876540928912:2502] disconnected; active server actors: 1
2025-10-02T09:28:22.893802Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553876540928912:2502] disconnected no session
2025-10-02T09:28:22.908763Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:22.908781Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:22.908785Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553876540928880:2502] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:22.908795Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:22.908988Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553876540928932:2502], now have 1 active actors on pipe
2025-10-02T09:28:22.908992Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:22.909002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.909009Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.909040Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|534dd332-4fd4c90d-20c157a3-8e11978c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:22.909056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.909061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.909063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.909075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.909090Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:22.909116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.909170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.909180Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.909204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.909245Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|534dd332-4fd4c90d-20c157a3-8e11978c_0
2025-10-02T09:28:22.909589Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397302909 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:22.909640Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|534dd332-4fd4c90d-20c157a3-8e11978c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:22.909756Z :INFO: [] MessageGroupId [src] SessionId [src|534dd332-4fd4c90d-20c157a3-8e11978c_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:22.909766Z :INFO: [] MessageGroupId [src] SessionId [src|534dd332-4fd4c90d-20c157a3-8e11978c_0] Write session will now close
2025-10-02T09:28:22.909772Z :DEBUG: [] MessageGroupId [src] SessionId [src|534dd332-4fd4c90d-20c157a3-8e11978c_0] Write session: aborting
2025-10-02T09:28:22.909919Z :INFO: [] MessageGroupId [src] SessionId [src|534dd332-4fd4c90d-20c157a3-8e11978c_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:22.909926Z :DEBUG: [] MessageGroupId [src] SessionId [src|534dd332-4fd4c90d-20c157a3-8e11978c_0] Write session: destroy
2025-10-02T09:28:22.910077Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|534dd332-4fd4c90d-20c157a3-8e11978c_0 grpc read done: success: 0 data: 
2025-10-02T09:28:22.910083Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|534dd332-4fd4c90d-20c157a3-8e11978c_0 grpc read failed
2025-10-02T09:28:22.910090Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|534dd332-4fd4c90d-20c157a3-8e11978c_0 grpc closed
2025-10-02T09:28:22.910096Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|534dd332-4fd4c90d-20c157a3-8e11978c_0 is DEAD
PORTS 8279 12040
2025-10-02T09:28:22.910337Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:22.910383Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553876540928932:2502] destroyed
2025-10-02T09:28:22.910396Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:22.910405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.910407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.910409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T09:28:22.958843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.958857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.958860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.059228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.059242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.059245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.159536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.159550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.159554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.259891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.259907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.259910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.360266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.360283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.360286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.460606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.460621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.460625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.561032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.561059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.561062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.661336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.661354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.661357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.761760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.761777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.761781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.862660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.862683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.862687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:23.915828Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-02T09:28:23.915857Z :INFO: [/Root] [] [dfbb4ea-f30aeb3d-88407a5-8ec8c082] Open read subsessions to databases: { name: , endpoint: localhost:12040, path: /Root }
2025-10-02T09:28:23.915904Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Starting read session
2025-10-02T09:28:23.915909Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Starting single session
2025-10-02T09:28:23.916140Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:23.916144Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:23.916149Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:23.916194Z :ERROR: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:12040 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:12040. 
2025-10-02T09:28:23.916201Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:23.916204Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:23.916231Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:12040" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:12040     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:12040. " }
2025-10-02T09:28:23.916313Z :NOTICE: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:23.916319Z :DEBUG: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:12040" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:12040     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:12040. " }
2025-10-02T09:28:23.916337Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Closing read session. Close timeout: 0.010000s
2025-10-02T09:28:23.916345Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:23.916351Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:23.916355Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:23.916358Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:23.916362Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:23.916366Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:23.916368Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T09:28:23.916370Z :INFO: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:23.916377Z :NOTICE: [/Root] [/Root] [6568c365-7dcfbc40-2beda277-6edfba33] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:23.962398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.962414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.962417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.062747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.062767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.062771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.163068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.163085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.163088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.891004Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1759397288890997
2025-10-02T09:28:08.991499Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553815794285518:2149];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:08.991700Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:08.996158Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553816844535518:2156];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/tmpDx2Fhu/pdisk_1.dat
2025-10-02T09:28:08.997768Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:08.997939Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:08.995323Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:09.037249Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:09.037016Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:09.052573Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 27004, node 1
2025-10-02T09:28:09.061261Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/yandexMu9Mrf.tmp
2025-10-02T09:28:09.061275Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/yandexMu9Mrf.tmp
2025-10-02T09:28:09.061331Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/yandexMu9Mrf.tmp
2025-10-02T09:28:09.061378Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:09.064568Z INFO: TTestServer started on Port 10204 GrpcPort 27004
TClient is connected to server localhost:10204
PQClient connected to localhost:27004
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:09.092935Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:09.092970Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:09.094524Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:09.097525Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-02T09:28:09.099834Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:09.099860Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:09.101101Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:28:09.101447Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-02T09:28:09.317542Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:09.328034Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:09.374324Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553821139503030:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.374344Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553821139503041:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.374351Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:09.375598Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:09.379669Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556553821139503044:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-02T09:28:09.461555Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553821139503083:2136] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:09.462568Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553820089253719:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:09.462637Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ZTAyNWUyZTUtNGQ3NDk1NGQtOWQyZWRhYmQtNmYwMDBlOGE=, ActorId: [1:7556553820089253676:2321], ActorState: ExecuteState, TraceId: 01k6j407dxfbzqpbjbj7t34y4v, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:09.463155Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:09.464289Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.467707Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553821139503089:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:09.468316Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZTdhMWNkYi04MGE0Yjc1Ny0xODdjNTI0NS1jNGFkNWM0ZQ==, ActorId: [2:7556553821139503028:2295], ActorState: ExecuteState, TraceId: 01k6j407cx4k15qkn3rnrcm0kt, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:09.468442Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:09.538732Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:09.575105Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:27004", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:09.620045Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k6j407kz99mz3sbx9w3e1wyq, Database: , SessionId: ydb://session/3?node_id=1&id=NWUzMTBjNTYtZGI0MGNhYjItMmQyM2Q0YzgtOWI5ZWZkYzQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553820089254113:2936] 
2025-10-02T09:28:09.993364Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:09.997378Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:13.991531Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553815794285518:2149];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:13.991577Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:13.996129Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553816844535518:2156];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:13.996159Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:14.660483Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:27004
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.678170Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:27004
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:14.684449Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553841564091111:3244] connected; active server actors: 1
2025-10-02T09:28:14.684590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-10-02T09:28:14.684745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:14.685004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-10-02T09:28:14.687068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.687537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.687582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:14.687590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.687600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:14.687672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553841564091133:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.687679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553841564091109:3243], now have 1 active actors on pipe
2025-10-02T09:28:14.687764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:14.687905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.688770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.690136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553841564091168:3290], now have 1 active actors on pipe
2025-10-02T09:28:14.690214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.691020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.691550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.691568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.691575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.691578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.691585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.691600Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.691607Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.691608Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.691610Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.691611Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:14.691692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.691751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [2:7556553842614340124:2400]
2025-10-02T09:28:14.692358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.692365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-10-02T09:28:14.692370Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [2:7556553842614340124:2400]
2025-10-02T09:28:14.692376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.692651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.692661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.692684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.692690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-02T09:28:14.692694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-02T09:28:14.692696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.692702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.692703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-02T09:28:14.692709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.692740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.692762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [2:7556553842614340125:2400]
2025-10-02T09:28:14.693229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.693235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-10-02T09:28:14.693237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [2:7556553842614340125:2400]
2025-10-02T09:28:14.693242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.693427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.693434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.693443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.693449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-02T09:28:14.693451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-02T09:28:14.693453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.693454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.693455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-02T09:28:14.693458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.693481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.693511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [2:7556553842614340126:2400]
2025-10-02T09:28:14.693948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.693954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-10-02T09:28:14.693957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [2:7556553842614340126:2400]
2025-10-02T09:28:14.693960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.694168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.694176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.694185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.694190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-02T09:28:14.694192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-02T09:28:14.694194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.694195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.694196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-02T09:28:14.694199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.694223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.694252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [2:7556553842614340127:2400]
2025-10-02T09:28:14.694639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.694646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-10-02T09:28:14.694649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [2:7556553842614340127:2400]
2025-10-02T09:28:14.694651Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.694777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.694783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.694790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.694791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-02T09:28:14.694792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-02T09:28:14.694793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.694794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.694794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-02T09:28:14.694796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.694810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.694839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553842614340128:2400]
2025-10-02T09:28:14.695083Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k6j40cjv4mkkyy7w8ep26vdb, Database: , SessionId: ydb://session/3?node_id=1&id=ZTZkYWI5ZTAtYWE2MTJjZTItMjljZjBmLTY1MDc0NTQz, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T09:28:14.695179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.695187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.695189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553842614340128:2400]
2025-10-02T09:28:14.695192Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:14.695374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:14.695381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.695393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.695398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.695400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:14.695402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.695403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.695404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:14.695406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.695498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.695544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.695571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.695595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.695638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.695661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.696511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.696536Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397294739, TxId 281474976715677
2025-10-02T09:28:14.696543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.696584Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397294739, TxId 281474976715677
2025-10-02T09:28:14.696588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:14.696604Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397294739, TxId 281474976715677
2025-10-02T09:28:14.696609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:14.696627Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397294739, TxId 281474976715677
2025-10-02T09:28:14.696631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:14.696646Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397294739, TxId 281474976715677
2025-10-02T09:28:14.696650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.696656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:14.696666Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.696674Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.696677Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.696680Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.696682Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:14.697264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.697307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.697314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.697315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.697315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.697318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.697320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.697335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.697339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.697340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.697341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:14.697342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.697373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.697395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.697400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.697401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.697402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:14.697404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.697406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.697424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.697432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.697433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.697434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:14.697436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.697439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:14.697457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:14.697458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.697460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.697461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:14.697463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-02T09:28:14.697566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:14.697586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.697626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:14.698769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:14.698786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-02T09:28:14.699193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759397294739
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759397294739
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:27004
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:14.700563Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:14.792834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.792850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.792853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:14.793819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.793829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.793831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:14.794314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.794323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.794325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:14.794847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.794857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.794859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:14.795345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.795351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.795353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.893170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.893185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.893186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:14.894143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.894154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.894156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:14.894678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.894685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.894686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:14.895217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.895226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.895228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:14.895704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.895712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.895714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.993508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.993523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.993526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:14.994527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.994537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.994538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:14.995037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.995043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.995045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:14.995528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.995534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.995536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:14.996003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.996009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.996011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.093861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.093873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.093875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.094861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.094868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.094871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.095367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.095374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.095376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.095879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.095886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.095888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.096393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.096400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.096403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.194223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.194237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.194240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.195217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.195225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.195227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.195716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.195721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.195722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.196235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.196240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.196241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.196741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.196746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.196747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27004
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:15.201665Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:15.294581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.294597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.294599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.295585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.295594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.295596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.296078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.296085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.296086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.296588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.296594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.296596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.297110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.297116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.297118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.394945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.394961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.394963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.395961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.395971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.395973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.396440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.396448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.396450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.396949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.396957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.396959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.397458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.397466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.397468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.495283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.495296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.495297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.496262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.496268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.496269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.496778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.496783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.496784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.497289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.497295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.497296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.497819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.497827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.497829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.595631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.595643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.595645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.596619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.596623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.596624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.597130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.597136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.597137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.597637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.597642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.597643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.598151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.598156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.598157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.695972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.695987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.695989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.696983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.696994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.696995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.697500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.697509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.697511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.698006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.698016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.698018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.698512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.698521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.698522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27004
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:15.703223Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:15.704464Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:15.704701Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:15.704707Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:27004
2025-10-02T09:28:15.705233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.705252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:15.706814Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:15.707036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:15.707075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58018
2025-10-02T09:28:15.707086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58018 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.707090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.707586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:15.707636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.707638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.707639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.707645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.708165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.733018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:15.733087Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553845859058677:2481] connected; active server actors: 1
2025-10-02T09:28:15.733110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 3 from PQRB for SourceId=src
2025-10-02T09:28:15.733114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.733163Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553845859058677:2481] disconnected; active server actors: 1
2025-10-02T09:28:15.733172Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553845859058677:2481] disconnected no session
2025-10-02T09:28:15.746396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.746411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=3, SeqNo=(NULL)
2025-10-02T09:28:15.746415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553845859058645:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.746423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 3 expectedGeneration: (NULL)
2025-10-02T09:28:15.746702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=3) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:15.746683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553845859058700:2481], now have 1 active actors on pipe
2025-10-02T09:28:15.746784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.746801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-02T09:28:15.746840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|427e33e7-8716a7b1-3734e473-f0bd084b_0 generated for partition 3 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:15.746854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.746858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.746868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-02T09:28:15.746877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.746889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][3][StateIdle] TPartition::ReplyOwnerOk. Partition: 3
2025-10-02T09:28:15.746909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.747052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.747058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-02T09:28:15.747068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.747127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 3 MaxSeqNo: 0 sessionId: src|427e33e7-8716a7b1-3734e473-f0bd084b_0
2025-10-02T09:28:15.747414Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397295747 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:15.747463Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|427e33e7-8716a7b1-3734e473-f0bd084b_0" topic: "test-topic" cluster: "dc1" partition_id: 3 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.747562Z :INFO: [] MessageGroupId [src] SessionId [src|427e33e7-8716a7b1-3734e473-f0bd084b_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:15.747570Z :INFO: [] MessageGroupId [src] SessionId [src|427e33e7-8716a7b1-3734e473-f0bd084b_0] Write session will now close
2025-10-02T09:28:15.747576Z :DEBUG: [] MessageGroupId [src] SessionId [src|427e33e7-8716a7b1-3734e473-f0bd084b_0] Write session: aborting
2025-10-02T09:28:15.747723Z :INFO: [] MessageGroupId [src] SessionId [src|427e33e7-8716a7b1-3734e473-f0bd084b_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:15.747729Z :DEBUG: [] MessageGroupId [src] SessionId [src|427e33e7-8716a7b1-3734e473-f0bd084b_0] Write session: destroy
2025-10-02T09:28:15.747815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|427e33e7-8716a7b1-3734e473-f0bd084b_0 grpc read done: success: 0 data: 
2025-10-02T09:28:15.747821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|427e33e7-8716a7b1-3734e473-f0bd084b_0 grpc read failed
2025-10-02T09:28:15.747826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|427e33e7-8716a7b1-3734e473-f0bd084b_0 grpc closed
2025-10-02T09:28:15.747830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|427e33e7-8716a7b1-3734e473-f0bd084b_0 is DEAD
2025-10-02T09:28:15.748049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=3) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:15.748151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553845859058700:2481] destroyed
2025-10-02T09:28:15.748171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][3][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:15.748176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.748178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.748179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
Session was created
2025-10-02T09:28:15.796345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.796358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.796361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.797327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.797334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.797336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.797842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.797848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.797850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.798354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.798361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.798362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.798870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.798877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.798879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.896681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.896701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.896703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.897690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.897698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.897700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.898188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.898192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.898193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.898691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.898695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.898696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.899228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.899236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.899238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.997035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.997048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.997050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:15.998041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.998048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.998050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:15.998551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.998560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.998561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:15.999070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.999076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.999078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:15.999582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.999593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.999595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.098057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.098074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.098078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.098391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.098402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.098405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.098899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.098909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.098911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.099404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.099413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.099415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.099928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.099938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.099940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.198264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.198289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.198292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.198731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.198740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.198741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.199253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.199262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.199264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.199764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.199773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.199777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.200290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.200300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.200303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.298612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.298622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.298624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.299099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.299104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.299106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.299610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.299618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.299620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.300128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.300139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.300142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.300622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.300629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.300631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.398969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.398986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.398988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.399455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.399464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.399469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.399984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.399995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.399997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.400487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.400496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.400499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.400996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.401004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.401007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.499303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.499320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.499324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.499805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.499817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.499820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.500317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.500327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.500329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.500853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.500868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.500871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.501344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.501351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.501355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.599662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.599676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.599679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.600145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.600154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.600156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.600606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.600624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.600626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.601167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.601175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.601177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.601678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.601685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.601686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.700011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.700024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.700026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.700796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.700825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.700827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.701012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.701017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.701019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.701485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.701493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.701495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.702042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.702052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.702056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:16.751089Z :INFO: [/Root] [] [633532e2-a5708ff8-bba33328-9df48336] Open read subsessions to databases: { name: dc1, endpoint: localhost:27004, path: /Root }, { name: dc2, endpoint: localhost:27004, path: /Root }
2025-10-02T09:28:16.752908Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Starting read session
2025-10-02T09:28:16.752927Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Starting single session
2025-10-02T09:28:16.753124Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:16.753130Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:16.753134Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:16.753606Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Starting read session
2025-10-02T09:28:16.753611Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Starting single session
2025-10-02T09:28:16.753627Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:16.753629Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:16.753632Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:16.793491Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] Successfully connected. Initializing session
2025-10-02T09:28:16.793501Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] Successfully connected. Initializing session
2025-10-02T09:28:16.793748Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:16.793758Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T09:28:16.793805Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:16.793807Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-02T09:28:16.795881Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:16.795904Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:16.795967Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 read init: from# ipv6:[::1]:60408, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:16.795968Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 read init: from# ipv6:[::1]:60408, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:16.796089Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 auth for : user
2025-10-02T09:28:16.796093Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 auth for : user
2025-10-02T09:28:16.796292Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 Handle describe topics response
2025-10-02T09:28:16.796296Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 Handle describe topics response
2025-10-02T09:28:16.796316Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 auth is DEAD
2025-10-02T09:28:16.796323Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 auth is DEAD
2025-10-02T09:28:16.796333Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:16.796344Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:16.796692Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:16.796722Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:16.796779Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553850154026070:2505] connected; active server actors: 1
2025-10-02T09:28:16.796794Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553850154026069:2506] connected; active server actors: 1
2025-10-02T09:28:16.796812Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556553850154026070:2505] session shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.796823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:28:16.796834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:28:16.796837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-10-02T09:28:16.796841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-02T09:28:16.796846Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] Got InitResponse. ReadSessionId: shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.796845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-10-02T09:28:16.796859Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:16.796856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-10-02T09:28:16.796859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-10-02T09:28:16.796863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-10-02T09:28:16.796866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-10-02T09:28:16.796869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-10-02T09:28:16.796876Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_14482707714807947147_v1" (Sender=[1:7556553850154026063:2505], Pipe=[1:7556553850154026070:2505], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:16.796884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:16.796891Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556553850154026069:2506] session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.796896Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:16.796906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-02T09:28:16.796916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:16.796927Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_2_3398494170092991736_v1" sender [1:7556553850154026064:2506] lock partition 4 for ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T09:28:16.796940Z :DEBUG: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:16.796945Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] Got InitResponse. ReadSessionId: shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.796945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_1_14482707714807947147_v1" (Sender=[1:7556553850154026063:2505], Pipe=[1:7556553850154026070:2505], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:16.796957Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:16.796955Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_1_14482707714807947147_v1" sender [1:7556553850154026063:2505] lock partition 3 for ReadingSession "shared/user_1_1_14482707714807947147_v1" (Sender=[1:7556553850154026063:2505], Pipe=[1:7556553850154026070:2505], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-02T09:28:16.796961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=1)
2025-10-02T09:28:16.796967Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_2_3398494170092991736_v1" sender [1:7556553850154026064:2506] lock partition 2 for ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=2) generation 1 step 3
2025-10-02T09:28:16.796973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_14482707714807947147_v1" (Sender=[1:7556553850154026063:2505], Pipe=[1:7556553850154026070:2505], Partitions=[], ActiveFamilyCount=1)
2025-10-02T09:28:16.796978Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_14482707714807947147_v1" sender [1:7556553850154026063:2505] lock partition 1 for ReadingSession "shared/user_1_1_14482707714807947147_v1" (Sender=[1:7556553850154026063:2505], Pipe=[1:7556553850154026070:2505], Partitions=[], ActiveFamilyCount=2) generation 1 step 4
2025-10-02T09:28:16.796984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=2)
2025-10-02T09:28:16.796989Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_3398494170092991736_v1" sender [1:7556553850154026064:2506] lock partition 0 for ReadingSession "shared/user_1_2_3398494170092991736_v1" (Sender=[1:7556553850154026064:2506], Pipe=[1:7556553850154026069:2506], Partitions=[], ActiveFamilyCount=3) generation 1 step 5
2025-10-02T09:28:16.796995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-02T09:28:16.797004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000095s
2025-10-02T09:28:16.797030Z :DEBUG: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:16.797186Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_2_3398494170092991736_v1" ClientId: "user" PipeClient { RawX1: 7556553850154026069 RawX2: 4503603922340298 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:16.797201Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_1_14482707714807947147_v1" ClientId: "user" PipeClient { RawX1: 7556553850154026070 RawX2: 4503603922340297 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:16.797214Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_2_3398494170092991736_v1" ClientId: "user" PipeClient { RawX1: 7556553850154026069 RawX2: 4503603922340298 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:16.797221Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_1_14482707714807947147_v1" ClientId: "user" PipeClient { RawX1: 7556553850154026070 RawX2: 4503603922340297 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:16.797231Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:16.797232Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_2_3398494170092991736_v1" ClientId: "user" PipeClient { RawX1: 7556553850154026069 RawX2: 4503603922340298 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:16.797240Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:16.797255Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 got read request: guid# a18c36a2-a511a886-7043ac32-9165b4cd
2025-10-02T09:28:16.797277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-10-02T09:28:16.797286Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 got read request: guid# 297a6ef1-80cf672d-435fe338-99babd36
2025-10-02T09:28:16.797299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3)
2025-10-02T09:28:16.797300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2)
2025-10-02T09:28:16.797312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2)
2025-10-02T09:28:16.797313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1)
2025-10-02T09:28:16.797484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553850154026078:2511], now have 1 active actors on pipe
2025-10-02T09:28:16.797503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553850154026079:2513], now have 1 active actors on pipe
2025-10-02T09:28:16.797505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553850154026080:2515], now have 1 active actors on pipe
2025-10-02T09:28:16.797527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553850154026078:2511]
2025-10-02T09:28:16.797507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553850154026082:2514], now have 1 active actors on pipe
2025-10-02T09:28:16.797539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553850154026080:2515]
2025-10-02T09:28:16.797510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553850154026081:2512], now have 1 active actors on pipe
2025-10-02T09:28:16.797547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553850154026082:2514]
2025-10-02T09:28:16.797549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553850154026079:2513]
2025-10-02T09:28:16.797554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553850154026081:2512]
2025-10-02T09:28:16.797580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.797592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-02T09:28:16.797606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_3398494170092991736_v1 on pipe: [1:7556553850154026078:2511]
2025-10-02T09:28:16.797624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.797627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.797630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_3398494170092991736_v1 on pipe: [1:7556553850154026080:2515]
2025-10-02T09:28:16.797637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.797639Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_3398494170092991736_v1:1 with generation 1
2025-10-02T09:28:16.797640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-02T09:28:16.797644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_14482707714807947147_v1 on pipe: [1:7556553850154026082:2514]
2025-10-02T09:28:16.797650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.797651Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_3398494170092991736_v1:3 with generation 1
2025-10-02T09:28:16.797653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-02T09:28:16.797656Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_14482707714807947147_v1:2 with generation 1
2025-10-02T09:28:16.797656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_3398494170092991736_v1 on pipe: [1:7556553850154026079:2513]
2025-10-02T09:28:16.797660Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_3398494170092991736_v1:2 with generation 1
2025-10-02T09:28:16.797662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.797664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-02T09:28:16.797668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_14482707714807947147_v1 on pipe: [1:7556553850154026081:2512]
2025-10-02T09:28:16.797672Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_14482707714807947147_v1:1 with generation 1
2025-10-02T09:28:16.797681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.797686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.797688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-02T09:28:16.797723Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.797725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.797757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.797760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.797762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.797769Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.797770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.797783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.797786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.797788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-02T09:28:16.797795Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.797797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.797810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.797812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.797814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-02T09:28:16.797821Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.797823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.797835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.797838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.797839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-02T09:28:16.797847Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.797849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.797860Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.797871Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.797884Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.797888Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.797891Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:16.798996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.799040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.799052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.799054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.799056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.799062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.799078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.799095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.799105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.799106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.799107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.799111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.799114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.799129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.799131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.799133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.799135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.799137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.799141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.799154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.799156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.799157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.799159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.799161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.799165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:16.799190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:16.799193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.799195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.799196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.799198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-02T09:28:16.799209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:16.799233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:16.799238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:16.799241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:16.799246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:16.799333Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397296701 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:16.799347Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397296702 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:16.799350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:16.799355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:16.799366Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397296699 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:16.799369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:16.799371Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397296700 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:16.799375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:16.799380Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397296701 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:16.799394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:16.799409Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 sending to client partition status
2025-10-02T09:28:16.799410Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 sending to client partition status
2025-10-02T09:28:16.799450Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 sending to client partition status
2025-10-02T09:28:16.799453Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 sending to client partition status
2025-10-02T09:28:16.799460Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 1 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:16.799715Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 4 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:16.799860Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 3 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:16.799903Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:16.799941Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-02T09:28:16.799919Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
Got new read session event: StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 2 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:16.799973Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
2025-10-02T09:28:16.799981Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Closing read session. Close timeout: 0.010000s
2025-10-02T09:28:16.799989Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-10-02T09:28:16.799996Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 47 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.799973Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T09:28:16.799994Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:16.800000Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:16.800002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:16.800008Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:16.800009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:16.800014Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:16.800066Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Closing read session. Close timeout: 0.010000s
2025-10-02T09:28:16.800034Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T09:28:16.800073Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:2:3:0:0 -:test-topic:0:2:0:0 -:test-topic:4:1:0:0
2025-10-02T09:28:16.800079Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Counters: { Errors: 0 CurrentSessionLifetimeMs: 46 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.800039Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 3 } }
2025-10-02T09:28:16.800050Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:16.800055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:16.800057Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:16.800058Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:16.800062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:16.800066Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:16.800129Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:16.800133Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-10-02T09:28:16.800136Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 47 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.800140Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:16.800143Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:2:3:0:0 -:test-topic:0:2:0:0 -:test-topic:4:1:0:0
2025-10-02T09:28:16.800145Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Counters: { Errors: 0 CurrentSessionLifetimeMs: 46 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.800149Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:16.800151Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:2:3:0:0 -:test-topic:0:2:0:0 -:test-topic:4:1:0:0
2025-10-02T09:28:16.800153Z :INFO: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Counters: { Errors: 0 CurrentSessionLifetimeMs: 46 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.800166Z :NOTICE: [/Root] [/Root] [9a2612be-e67b1164-a38b2d5c-11a9bf30] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:16.800183Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Closing read session. Close timeout: 0.000000s
2025-10-02T09:28:16.800186Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-10-02T09:28:16.800188Z :INFO: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 47 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:16.800192Z :NOTICE: [/Root] [/Root] [9fd09fc4-f7dfc894-6c9f0d5f-d7091bd9] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:16.800286Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-02T09:28:16.800288Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 grpc read done: success# 0, data# {  }
2025-10-02T09:28:16.800292Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 grpc read failed
2025-10-02T09:28:16.800297Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 grpc closed
2025-10-02T09:28:16.800305Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_14482707714807947147_v1 is DEAD
2025-10-02T09:28:16.800306Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:16.800367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.800374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.800375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.800408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.800423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553850154026082:2514] destroyed
2025-10-02T09:28:16.800428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.800430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553850154026081:2512] destroyed
2025-10-02T09:28:16.800453Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.800465Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.800589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.800602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553850154026080:2515] destroyed
2025-10-02T09:28:16.800605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.800608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553850154026079:2513] destroyed
2025-10-02T09:28:16.800362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:16.800611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.800613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553850154026078:2511] destroyed
2025-10-02T09:28:16.800618Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.800623Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.800625Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.800370Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:16.800386Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 grpc closed
2025-10-02T09:28:16.800392Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_3398494170092991736_v1 is DEAD
2025-10-02T09:28:16.800556Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553850154026070:2505] disconnected; active server actors: 1
2025-10-02T09:28:16.800565Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553850154026070:2505] client user disconnected session shared/user_1_1_14482707714807947147_v1
2025-10-02T09:28:16.800581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:16.800590Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553850154026069:2506] disconnected; active server actors: 1
2025-10-02T09:28:16.800592Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553850154026069:2506] client user disconnected session shared/user_1_2_3398494170092991736_v1
2025-10-02T09:28:16.801387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.801397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.801400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.801409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.801411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.801414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.801902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.801909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.801911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.802397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.802404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.802406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.900718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.900731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.900734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:16.901725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.901733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.901735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:16.901746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.901748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.901749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:16.902224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.902231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.902233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:16.902758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.902767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.902769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.001571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.001584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.001586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T09:28:17.002066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.002076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.002078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T09:28:17.002090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.002092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.002093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T09:28:17.002597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.002607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.002609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T09:28:17.003101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.003109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.003112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.281935Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1759397297281929
2025-10-02T09:28:17.353715Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556553853408026410:2078];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:17.354035Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:17.355755Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556553852865098781:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:17.355792Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:28:17.356167Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/tmpeVdOQZ/pdisk_1.dat
2025-10-02T09:28:17.356429Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:17.357652Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:28:17.357968Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:28:17.373898Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:17.377672Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:17.377691Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:17.378576Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T09:28:17.378844Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6942, node 3
2025-10-02T09:28:17.384571Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/yandexJQUFoC.tmp
2025-10-02T09:28:17.384580Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/yandexJQUFoC.tmp
2025-10-02T09:28:17.384631Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001d7/r3tmp/yandexJQUFoC.tmp
2025-10-02T09:28:17.384673Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:28:17.387655Z INFO: TTestServer started on Port 11060 GrpcPort 6942
TClient is connected to server localhost:11060
PQClient connected to localhost:6942
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:28:17.402771Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T09:28:17.455931Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:28:17.455961Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:28:17.457571Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:28:17.568661Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:17.599559Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:17.716297Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553852865099007:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.716313Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553852865098987:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.716327Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.717462Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:17.718956Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553852865099042:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.718982Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.719132Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556553852865099044:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.719146Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:17.721785Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556553852865099014:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-02T09:28:17.734870Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556553853408027415:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:17.735141Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=Nzk2ZjRiNjYtZmIwYWE5NTMtMmVkMzY1YTctZWI1MDEyNjE=, ActorId: [3:7556553853408027370:2319], ActorState: ExecuteState, TraceId: 01k6j40fj28gs30kqyg4s289cm, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:17.735308Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:17.735912Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:17.748725Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:17.767386Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6942", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:17.783692Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556553852865099109:2174] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:17.792375Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k6j40fkkag4p1x06gesnt3h4, Database: , SessionId: ydb://session/3?node_id=3&id=NzhkNDAyOWUtODBjMWE1MzQtNjNiMDc1YzAtZTY0NjAyMjA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556553853408027861:2991] 
2025-10-02T09:28:18.355816Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:18.357331Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:22.354731Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556553853408026410:2078];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:22.354767Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:22.356645Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556553852865098781:2154];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:22.356679Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:22.909357Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.925634Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6942
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:22.932547Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556553874882864915:3324] connected; active server actors: 1
2025-10-02T09:28:22.932566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.932817Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:22.932937Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:22.933269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.933316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:22.933325Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.933335Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:22.933328Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:22.933455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553874882864914:3323], now have 1 active actors on pipe
2025-10-02T09:28:22.933477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556553874339935991:2385], now have 1 active actors on pipe
2025-10-02T09:28:22.933615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.933608Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T09:28:22.934609Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.936109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553874882864983:3377], now have 1 active actors on pipe
2025-10-02T09:28:22.936166Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.936868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.937018Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.937030Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:22.937083Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.937129Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556553874882864993:2463]
2025-10-02T09:28:22.937572Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.937579Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.937582Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556553874882864993:2463]
2025-10-02T09:28:22.937586Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:22.937751Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:22.937758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.937770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.937772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.937776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:22.937778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.937780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.937781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:22.937787Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.937843Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.937878Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:22.938820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.938864Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397302985, TxId 281474976710677
2025-10-02T09:28:22.938869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.938873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.938900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.938942Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:22.939352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:22.939407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:22.939417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.939419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.939421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.939425Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:22.939514Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:22.939534Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.939578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.940386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.940403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:22.940845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:22.945235Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710678. Ctx: { TraceId: 01k6j40mmjc4h6bq7ec5ma2t4f, Database: , SessionId: ydb://session/3?node_id=3&id=YjQzZTc2MTgtZGY3NzBhNGYtZTQ0NThjMmEtNjc2ZGE1NzQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1759397302985
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1759397302985
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:22.952113Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:23.038067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.038084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.038094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.138434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.138454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.138457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.238767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.238786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.238789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.339138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.339156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.339159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.441213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.441233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.441237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:23.453383Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:23.541381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.541404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.541407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.641790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.641811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.641814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.742223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.742240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.742242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.843393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.843410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.843413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.943781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.943794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.943797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6942
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:23.955725Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:23.956787Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:23.957011Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:23.957018Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6942
2025-10-02T09:28:23.957300Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:23.957420Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:23.957432Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:23.957579Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:23.957611Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:55334
2025-10-02T09:28:23.957620Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55334 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:23.957623Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:23.957976Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:23.958007Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:23.958013Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:23.958014Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:23.958019Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:23.958598Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:23.980530Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:23.980669Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553879177832528:2502] connected; active server actors: 1
2025-10-02T09:28:23.980737Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:23.980744Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:23.980852Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553879177832528:2502] disconnected; active server actors: 1
2025-10-02T09:28:23.980864Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556553879177832528:2502] disconnected no session
2025-10-02T09:28:23.998385Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:23.998401Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:23.998405Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556553879177832497:2502] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:23.998413Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:23.998624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T09:28:23.998631Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556553879177832548:2502], now have 1 active actors on pipe
2025-10-02T09:28:23.998641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.998648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.998676Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|3af3ee3f-5da690d3-24495559-769ae226_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:23.998692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.998702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.998704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:23.998714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.998742Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:23.998765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.998806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.998814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.998827Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.998858Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|3af3ee3f-5da690d3-24495559-769ae226_0
2025-10-02T09:28:23.999221Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397303999 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:23.999259Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|3af3ee3f-5da690d3-24495559-769ae226_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:23.999358Z :INFO: [] MessageGroupId [src] SessionId [src|3af3ee3f-5da690d3-24495559-769ae226_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:23.999368Z :INFO: [] MessageGroupId [src] SessionId [src|3af3ee3f-5da690d3-24495559-769ae226_0] Write session will now close
2025-10-02T09:28:23.999377Z :DEBUG: [] MessageGroupId [src] SessionId [src|3af3ee3f-5da690d3-24495559-769ae226_0] Write session: aborting
2025-10-02T09:28:23.999607Z :INFO: [] MessageGroupId [src] SessionId [src|3af3ee3f-5da690d3-24495559-769ae226_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:23.999610Z :DEBUG: [] MessageGroupId [src] SessionId [src|3af3ee3f-5da690d3-24495559-769ae226_0] Write session is aborting and will not restart
2025-10-02T09:28:23.999626Z :DEBUG: [] MessageGroupId [src] SessionId [src|3af3ee3f-5da690d3-24495559-769ae226_0] Write session: destroy
2025-10-02T09:28:23.999768Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|3af3ee3f-5da690d3-24495559-769ae226_0 grpc read done: success: 0 data: 
2025-10-02T09:28:23.999778Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|3af3ee3f-5da690d3-24495559-769ae226_0 grpc read failed
2025-10-02T09:28:23.999784Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|3af3ee3f-5da690d3-24495559-769ae226_0 grpc closed
2025-10-02T09:28:23.999788Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|3af3ee3f-5da690d3-24495559-769ae226_0 is DEAD
2025-10-02T09:28:24.000031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:24.000078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556553879177832548:2502] destroyed
2025-10-02T09:28:24.000091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:24.000096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.000098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.000100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
2025-10-02T09:28:24.044134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.044147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.044149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-02T09:28:24.054339Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:24.144504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.144522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.144525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.244897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.244914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.244917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.345213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.345228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.345231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.445587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.445602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.445605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.545857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.545874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.545879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.646270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.646286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.646289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.746581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.746595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.746598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.846974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.846992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.846995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.947324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.947339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.947342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.047660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.047676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.047679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.148016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.148038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.148041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.248375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.248389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.248392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.348762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.348779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.348782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.449082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.449097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.449099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.549429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.549447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.549449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.649771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.649788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.649790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.750129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.750145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.750148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.850492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.850509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.850512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.950900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.950913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.950916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.051200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.051215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.051218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:26.059336Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:26.151565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.151582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.151585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.251899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.251919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.251922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.352237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.352250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.352252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.452609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.452629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.452633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.552911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.552931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.552934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.653298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.653313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.653315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.753653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.753667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.753670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.854007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.854024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.854027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.954346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.954358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.954362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.054705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.054720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.054723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.155216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.155231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.155233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.255432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.255450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.255454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.355772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.355787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.355789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.460881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.460901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.460904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.561074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.561089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.561092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.661430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.661456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.661460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.761790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.761808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.761812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:27.857746583 3238685 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:13213: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:27.862145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.862169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.862173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.937960Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:27.962506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.962528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.962531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
=== In the next federation discovery response dc2 will be available
2025-10-02T09:28:28.060000Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:28.062852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.062867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.062870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.163204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.163224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.163226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.263554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.263571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.263574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.363879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.363898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.363902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.464249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.464271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.464274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.564621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.564638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.564642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.664949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.664969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.664972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.765290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.765306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.765310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.865658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.865680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.865683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.966000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.966014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.966016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.066343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.066358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.066361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.166700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.166715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.166719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.267046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.267064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.267066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.367404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.367419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.367422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.467760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.467774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.467777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.568111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.568125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.568129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.668462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.668480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.668483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.768832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.768850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.768856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.869179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.869196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.869199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.969499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.969514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.969516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:30.060922Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:30.069873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.069887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.069889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.170709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.170726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.170729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.271111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.271128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.271131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.371454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.371473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.371476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.474657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.474676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.474679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.574737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.574755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.574759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.675044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.675062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.675066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.780246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.780265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.780268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.880338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.880359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.880362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.980738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.980756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.980759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.081078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.081096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.081100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.181434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.181448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.181450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.281804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.281826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.281829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.382146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.382165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.382168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.482494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.482513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.482516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.582831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.582847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.582850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.683299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.683321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.683324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.783546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.783566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.783569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.883886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.883907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.883909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.984233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.984251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.984254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:32.062000Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:32.084766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.084784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.084788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.184960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.184980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.184983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.285457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.285472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.285474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.370272Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T09:28:32.370288Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:32.385656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.385670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.385673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.486005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.486021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.486025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.586353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.586371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.586375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.686704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.686719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.686722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.787062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.787077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.787079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.887415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.887430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.887433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.938121Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:32.987768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.987787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.987791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.091518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.091538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.091541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.192073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.192092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.192095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.292389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.292407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.292409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.392775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.392793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.392797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.493124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.493142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.493145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.595061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.595078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.595082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.695449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.695467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.695470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.795712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.795728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.795731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.896022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.896038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.896040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.996410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.996427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.996438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:34.007068302 3238701 chttp2_transport.cc:1143]             ipv4:127.0.0.1:13213: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
Test retry state: get retry delay
2025-10-02T09:28:34.062994Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:34.096754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.096769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.096773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.197217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.197237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.197241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.297990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.298008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.298012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.398320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.398348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.398351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.498686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.498705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.498707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.599054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.599073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.599076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.699405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.699421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.699424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.799732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.799748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.799751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.900075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.900090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.900093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.000488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.000503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.000505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.100826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.100843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.100847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.201141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.201156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.201159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.301503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.301518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.301521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.401982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.401999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.402002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.502202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.502218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.502221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.602564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.602585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.602588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.702911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.702925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.702927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.803262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.803280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.803283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.903610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.903622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.903624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.003977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.003998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.004001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:36.064000Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:36.104310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.104336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.104340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.204907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.204925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.204928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.308098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.308118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.308122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.408399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.408415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.408419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.508795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.508830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.508832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.609299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.609318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.609321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.709482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.709496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.709499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.809893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.809909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.809912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.910284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.910306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.910309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.010549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.010566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.010569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.110893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.110912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.110916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.211273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.211290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.211293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.311608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.311625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.311628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.411963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.411979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.411982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.512320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.512341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.512345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.612657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.612675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.612678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.716871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.716890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.716893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.816967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.816983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.816986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.917304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.917322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.917324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.938321Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:38.017651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.017666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.017670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:38.064921Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:38.117992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.118008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.118011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.218360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.218374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.218377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.318718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.318736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.318740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.419071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.419091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.419094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.519419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.519434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.519436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.619750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.619764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.619767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.720123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.720139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.720141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.820465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.820484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.820487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.920840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.920858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.920861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.024872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.024893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.024898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.125119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.125139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.125142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.225465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.225480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.225483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.325827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.325845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.325848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.426156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.426175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.426178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.526484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.526500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.526502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.626869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.626887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.626890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.727233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.727269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.727271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.828861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.828899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.828904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.928968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.928989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.928991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.029328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.029352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.029356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:40.066049Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:40.129648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.129663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.129665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.230003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.230027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.230030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.330365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.330382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.330385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.430731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.430779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.430783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.531074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.531091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.531094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.631440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.631461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.631468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.732854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.732871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.732874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.833153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.833171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.833175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.933468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.933483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.933486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.033842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.033857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.033859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.134199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.134211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.134213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.234549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.234565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.234567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.334895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.334911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.334913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.435239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.435257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.435260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.535608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.535620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.535623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.635960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.635975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.635978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.736320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.736340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.736343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.836633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.836649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.836652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.937001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.937031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.937034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.037369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.037383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.037386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:42.067017Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:42.137721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.137736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.137739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.238080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.238096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.238099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.338426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.338443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.338447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.440984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.441001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.441005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.544922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.544939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.544951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.645117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.645134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.645137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.745446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.745461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.745463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.845811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.845828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.845832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.938686Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:42.946159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.946176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.946179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.046511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.046530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.046532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.146866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.146885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.146888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.247225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.247243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.247245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.347570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.347587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.347589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.447924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.447943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.447946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.548279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.548308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.548312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.648651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.648673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.648676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.748972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.748987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.748989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.849359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.849393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.849397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.949698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.949722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.949725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.050030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.050049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.050052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:44.067988Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:44.150394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.150411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.150414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.250745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.250765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.250768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.351096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.351114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.351117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.451451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.451469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.451472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.551805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.551820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.551823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.652180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.652211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.652214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.752488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.752503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.752511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.852885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.852902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.852906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.953174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.953189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.953191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.053563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.053584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.053587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.153909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.153926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.153928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.254269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.254287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.254290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.354596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.354610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.354613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.456937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.456955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.456958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.557394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.557413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.557416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.657724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.657741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.657744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.758050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.758066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.758068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.858426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.858445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.858448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.958784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.958807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.958810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.059124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.059151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.059155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:46.068937Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:46.159491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.159511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.159514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.259845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.259865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.259868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.360180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.360202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.360206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.460527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.460543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.460546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.560896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.560915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.560919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.661242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.661258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.661262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.761580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.761598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.761601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.861944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.861963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.861966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.962307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.962326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.962329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.062671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.062692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.062695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.163003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.163019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.163021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.263371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.263391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.263395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.363686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.363699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.363701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.464061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.464076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.464079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.564409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.564429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.564431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.664903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.664924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.664928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.765117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.765136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.765139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.865471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.865489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.865492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.938729Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:47.969055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.969070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.969073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.069235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.069252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.069255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:48.069990Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:48.169598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.169616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.169622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.269956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.269975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.269978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.370379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.370395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.370398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.470645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.470664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.470667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.571013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.571033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.571036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.671362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.671380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.671383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.771704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.771722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.771726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.872048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.872064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.872066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.972396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.972420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.972424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.072720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.072735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.072738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.173232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.173254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.173258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.273464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.273486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.273489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.373815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.373835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.373838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.474167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.474183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.474187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.574494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.574513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.574516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.674871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.674888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.674891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.775218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.775235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.775238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.875539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.875555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.875558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.976863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.976882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.976884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:50.070990Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:50.076817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.076838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.076841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.177149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.177162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.177164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.277507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.277530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.277533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.377841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.377861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.377864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.478214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.478236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.478239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.578569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.578589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.578591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.678914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.678934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.678937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.779237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.779256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.779259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.879574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.879592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.879596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.979945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.979960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.979963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.080304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.080321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.080323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.180788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.180823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.180825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.280995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.281012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.281015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.381373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.381397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.381400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.481713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.481728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.481730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.582086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.582104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.582106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.682427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.682448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.682451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.782759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.782775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.782777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.883146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.883167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.883170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.983491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.983509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.983511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T09:28:52.072019Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:52.083906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.083936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.083938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.184190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.184211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.184213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.284533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.284552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.284555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.384904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.384927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.384930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.485273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.485289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.485292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.586431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.586449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.586463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.686983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.687002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.687006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.787294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.787310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.787313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.889246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.889262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.889265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.934247Z node 3 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:28:52.933237Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:28:52.933278Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T09:28:52.934843Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-02T09:28:52.934979Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:28:52.936424Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-02T09:28:52.939574Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:52.990469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.990485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.990488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.090417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.090447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.090450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.190766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.190782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.190785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.291158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.291176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.291179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.392898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.392916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.392918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.493429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.493448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.493451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.593715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.593733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.593736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.694864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.694882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.694885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.795428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.795446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.795449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.900881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.900897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.900900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.001281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.001298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.001301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 09:28:54.012495161 3238714 chttp2_transport.cc:1143]             ipv4:127.0.0.1:13213: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
Test retry state: get retry delay
2025-10-02T09:28:54.072967Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T09:28:54.101620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.101637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.101640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Waiting for repair
>>> Ready to answer: ok
2025-10-02T09:28:54.201978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.201998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.202000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.302661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.302677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.302680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.403240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.403256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.403260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.503545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.503563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.503566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.603903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.603920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.603923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.704260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.704279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.704282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.804592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.804608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.804611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.904964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.904980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.904983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.007948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.007975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.007978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.108542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.108564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.108567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.208555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.208569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.208571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.308922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.308943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.308946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.409278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.409293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.409297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.509616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.509633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.509636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.609966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.609985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.609987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.710342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.710361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.710364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.810674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.810698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.810701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.911034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.911051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.911054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.011385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.011405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.011407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Closing the session
2025-10-02T09:28:56.074114Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:6942" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:6942" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:6942" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T09:28:56.076396Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T09:28:56.076605Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T09:28:56.077881Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T09:28:56.077956Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.078038Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T09:28:56.078163Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.078177Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:56.078273Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.078300Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:48544
2025-10-02T09:28:56.078307Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:48544 proto=topic  topic=test-topic durationSec=0
2025-10-02T09:28:56.078310Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.078708Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:56.078747Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.078754Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.078755Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.078759Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556554020911755921:2984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.078822Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T09:28:56.078832Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-02T09:28:56.078847Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-02T09:28:56.078978Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:56.079162Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId:  grpc closed
2025-10-02T09:28:56.079169Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId:  is DEAD
2025-10-02T09:28:56.079601Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: CANCELLED, Details: , InternalError: 0
2025-10-02T09:28:56.079614Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397336079 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:56.079618Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session is aborting and will not restart
2025-10-02T09:28:56.079657Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-02T09:28:56.111727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.111740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.111742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.212078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.212093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.212096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:27:59.598273Z :PropagateSessionClosed INFO: Random seed for debugging is 1759397279598266
2025-10-02T09:27:59.684888Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556553775071558060:2175];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.684910Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T09:27:59.688283Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.689095Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556553774996041925:2162];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:27:59.689147Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/m5cl/0001dc/r3tmp/tmp2FXUV3/pdisk_1.dat
2025-10-02T09:27:59.690925Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T09:27:59.726644Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.728698Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T09:27:59.741808Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 28926, node 1
2025-10-02T09:27:59.750546Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/m5cl/0001dc/r3tmp/yandexzGVwLR.tmp
2025-10-02T09:27:59.750563Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/m5cl/0001dc/r3tmp/yandexzGVwLR.tmp
2025-10-02T09:27:59.750626Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/m5cl/0001dc/r3tmp/yandexzGVwLR.tmp
2025-10-02T09:27:59.750684Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T09:27:59.753345Z INFO: TTestServer started on Port 22562 GrpcPort 28926
TClient is connected to server localhost:22562
PQClient connected to localhost:28926
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T09:27:59.786181Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.786211Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T09:27:59.787979Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T09:27:59.791004Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-02T09:27:59.792483Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T09:27:59.792506Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
waiting...
2025-10-02T09:27:59.793483Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T09:27:59.793687Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-02T09:27:59.920997Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:27:59.981180Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T09:28:00.045348Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553779291009405:2294], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.045366Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553779291009437:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.045373Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.046139Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553779291009467:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.046165Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.046194Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556553779291009470:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.046209Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T09:28:00.048058Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T09:28:00.055590Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556553779291009444:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-02T09:28:00.118675Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556553779366526248:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:00.118778Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:00.118795Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NDAyMGY3MDItZDJhNzRkMGItMWI3NWFlMS01Yjk4YjA5OQ==, ActorId: [1:7556553779366526206:2322], ActorState: ExecuteState, TraceId: 01k6j3zya3481jdgwyyrj2n9wn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:00.119372Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:00.122748Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556553779291009476:2135] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T09:28:00.128356Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556553779291009483:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T09:28:00.128445Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=M2Y5NjIyMTItMTBkOGY2M2YtZjM1MmNiMmEtYzM0Y2NlZDY=, ActorId: [2:7556553779291009403:2293], ActorState: ExecuteState, TraceId: 01k6j3zy9c5dzsah1dx81htqsr, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T09:28:00.128594Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T09:28:00.150886Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T09:28:00.178628Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:28926", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T09:28:00.223514Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6j3zye747z4mv0v7eqtfrf7, Database: , SessionId: ydb://session/3?node_id=1&id=MmVlNTdkMWItOWRlMTAxYTAtNjQ4NmRhNTItZjNhNDhkNzk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556553779366526641:2952] 
2025-10-02T09:28:00.686114Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:00.690723Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T09:28:04.684856Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556553775071558060:2175];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.684897Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T09:28:04.689439Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556553774996041925:2162];send_to=[0:7307199536658146131:7762515];
2025-10-02T09:28:04.689464Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T09:28:05.320998Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:28926
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.340361Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:28926
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T09:28:05.350202Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556553800841363637:3260] connected; active server actors: 1
2025-10-02T09:28:05.350367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T09:28:05.350651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T09:28:05.350873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T09:28:05.354212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:05.354782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:05.354842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T09:28:05.354855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.354867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T09:28:05.355023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T09:28:05.355164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800841363673:2446], now have 1 active actors on pipe
2025-10-02T09:28:05.355173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800841363636:3259], now have 1 active actors on pipe
2025-10-02T09:28:05.355292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.356274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.357759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553800841363697:3307], now have 1 active actors on pipe
2025-10-02T09:28:05.357860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.358682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.358853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:05.358881Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T09:28:05.358930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:05.359016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553800765846519:2401]
2025-10-02T09:28:05.359704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:05.359715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:05.359721Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556553800765846519:2401]
2025-10-02T09:28:05.359729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T09:28:05.360043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T09:28:05.360055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.360078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.360085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:05.360088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.360090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.360092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.360094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T09:28:05.360100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:05.360201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.360242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.360917Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6j403f2emtpf6dxjv64nn1d, Database: , SessionId: ydb://session/3?node_id=1&id=MmZmNTdlOTItYjk0OWIwZmItN2Y2YzRiMTUtMWI0NjNmNGI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T09:28:05.361100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.361132Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759397285401, TxId 281474976720677
2025-10-02T09:28:05.361140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.361143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.361163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.361198Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:05.361697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:05.361747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:05.361758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.361760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.361762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.361768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:05.361860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T09:28:05.361881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:05.361920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.363368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T09:28:05.363395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T09:28:05.363818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397285401
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759397285401
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:28926
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.367420Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.460512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.460531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.460534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.560913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.560931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.560934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.661451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.661467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.661469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.761608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.761624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.761626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:05.861893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.861910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.861915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:28926
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:05.868588Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T09:28:05.962300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:05.962319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:05.962322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.062656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.062673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.062675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.163106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.163125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.163127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.263363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.263378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.263381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.363652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.363678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.363681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:28926
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T09:28:06.370100Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T09:28:06.371419Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T09:28:06.371629Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T09:28:06.371635Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:06.372148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.372168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T09:28:06.373469Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.373693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T09:28:06.373750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40730
2025-10-02T09:28:06.373755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40730 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:06.373760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.374187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T09:28:06.374242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.374248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.374249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.374255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.374755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.400458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.400572Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331202:2481] connected; active server actors: 1
2025-10-02T09:28:06.400601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T09:28:06.400610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.400670Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331202:2481] disconnected; active server actors: 1
2025-10-02T09:28:06.400680Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331202:2481] disconnected no session
2025-10-02T09:28:06.416944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.416963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.416967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553805136331171:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.416976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.417323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553805136331225:2481], now have 1 active actors on pipe
2025-10-02T09:28:06.417371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.417494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.417506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.417545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|e213cd8d-99b6862b-e1681375-6e6cbd66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T09:28:06.417562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.417572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.417576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.417588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.417601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.417623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.417835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.417844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.417861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.417954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|e213cd8d-99b6862b-e1681375-6e6cbd66_0
2025-10-02T09:28:06.418262Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286418 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.418302Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|e213cd8d-99b6862b-e1681375-6e6cbd66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:06.418420Z :INFO: [] MessageGroupId [src] SessionId [src|e213cd8d-99b6862b-e1681375-6e6cbd66_0] Write session: close. Timeout = 0 ms
2025-10-02T09:28:06.418430Z :INFO: [] MessageGroupId [src] SessionId [src|e213cd8d-99b6862b-e1681375-6e6cbd66_0] Write session will now close
2025-10-02T09:28:06.418436Z :DEBUG: [] MessageGroupId [src] SessionId [src|e213cd8d-99b6862b-e1681375-6e6cbd66_0] Write session: aborting
2025-10-02T09:28:06.418577Z :INFO: [] MessageGroupId [src] SessionId [src|e213cd8d-99b6862b-e1681375-6e6cbd66_0] Write session: gracefully shut down, all writes complete
2025-10-02T09:28:06.418583Z :DEBUG: [] MessageGroupId [src] SessionId [src|e213cd8d-99b6862b-e1681375-6e6cbd66_0] Write session: destroy
2025-10-02T09:28:06.420436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|e213cd8d-99b6862b-e1681375-6e6cbd66_0 grpc read done: success: 0 data: 
2025-10-02T09:28:06.420448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|e213cd8d-99b6862b-e1681375-6e6cbd66_0 grpc read failed
2025-10-02T09:28:06.420457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|e213cd8d-99b6862b-e1681375-6e6cbd66_0 grpc closed
2025-10-02T09:28:06.420462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|e213cd8d-99b6862b-e1681375-6e6cbd66_0 is DEAD
2025-10-02T09:28:06.420724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T09:28:06.420927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556553805136331225:2481] destroyed
2025-10-02T09:28:06.420949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T09:28:06.420958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.420962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.420965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T09:28:06.464079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.464095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.464098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T09:28:06.472475Z :INFO: [/Root] [] [93b04524-dffeebb7-7a956055-498ebfd7] Open read subsessions to databases: { name: dc1, endpoint: localhost:28926, path: /Root }, { name: dc2, endpoint: localhost:28926, path: /Invalid }
2025-10-02T09:28:06.474625Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Starting read session
2025-10-02T09:28:06.474641Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Starting single session
2025-10-02T09:28:06.474897Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.474904Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.474909Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:06.476279Z :INFO: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Starting read session
2025-10-02T09:28:06.476287Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Starting single session
2025-10-02T09:28:06.476316Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.476319Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.476323Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T09:28:06.476345Z :ERROR: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. 
2025-10-02T09:28:06.476350Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.476352Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.476382Z :INFO: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.525740Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:28:06.526195Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:06.526209Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T09:28:06.526933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-02T09:28:06.527066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-02T09:28:06.527091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:06.528172Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:06.528264Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:06.528373Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 auth for : user
2025-10-02T09:28:06.528575Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Handle describe topics response
2025-10-02T09:28:06.528605Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 auth is DEAD
2025-10-02T09:28:06.528787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:06.528631Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:06.528966Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:06.529063Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331242:2498] connected; active server actors: 1
2025-10-02T09:28:06.529071Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556553805136331242:2498] session shared/user_1_1_15989671363531563255_v1
2025-10-02T09:28:06.529079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:28:06.529089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:28:06.529095Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_15989671363531563255_v1" (Sender=[1:7556553805136331235:2498], Pipe=[1:7556553805136331242:2498], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:06.529099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:06.529108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:28:06.529116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_15989671363531563255_v1" (Sender=[1:7556553805136331235:2498], Pipe=[1:7556553805136331242:2498], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:06.529127Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_15989671363531563255_v1" sender [1:7556553805136331235:2498] lock partition 0 for ReadingSession "shared/user_1_1_15989671363531563255_v1" (Sender=[1:7556553805136331235:2498], Pipe=[1:7556553805136331242:2498], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T09:28:06.529141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:28:06.529145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-02T09:28:06.529377Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_15989671363531563255_v1" ClientId: "user" PipeClient { RawX1: 7556553805136331242 RawX2: 4503603922340290 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:06.529390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:28:06.529803Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_1_15989671363531563255_v1
2025-10-02T09:28:06.529813Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:06.529867Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.530324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553805136331245:2503], now have 1 active actors on pipe
2025-10-02T09:28:06.530551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.530566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.530578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_15989671363531563255_v1 on pipe: [1:7556553805136331245:2503]
2025-10-02T09:28:06.530611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.530623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.530626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.530667Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_15989671363531563255_v1
2025-10-02T09:28:06.530675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.530708Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.530914Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_15989671363531563255_v1:1 with generation 1
2025-10-02T09:28:06.530071Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T09:28:06.530096Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# db698788-8c6c2a87-5180135e-87081771
2025-10-02T09:28:06.530103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:06.530107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T09:28:06.530194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:06.530215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:06.530221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:06.530225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:06.530389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556553805136331245:2503]
2025-10-02T09:28:06.530605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T09:28:06.530629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:06.530631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:06.530632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:06.530637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:06.531193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:06.531904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.531940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.531949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.531952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.531954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.531976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T09:28:06.531988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:06.532089Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759397286464 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:06.532104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T09:28:06.532124Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 sending to client partition status
2025-10-02T09:28:06.533187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T09:28:06.533283Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331270:2504] connected; active server actors: 1
2025-10-02T09:28:06.533304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T09:28:06.533315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:06.533383Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331270:2504] disconnected; active server actors: 1
2025-10-02T09:28:06.533391Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331270:2504] disconnected no session
2025-10-02T09:28:06.536311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:06.536324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T09:28:06.536328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553805136331248:2504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:06.536336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:06.536934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553805136331287:2504], now have 1 active actors on pipe
2025-10-02T09:28:06.536997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T09:28:06.537080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.537093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.537120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:06.537137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.537142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.537145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:06.537158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.537170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:06.537186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.537391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.537414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.537436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.537522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0
2025-10-02T09:28:06.537851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759397286537 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T09:28:06.537886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:06.539755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 1 to 1
2025-10-02T09:28:06.541553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.541574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T09:28:06.544335Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-02T09:28:06.545752Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T09:28:06.545851Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T09:28:06.545878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T09:28:06.545887Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T09:28:06.547704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.549391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 2 to 2
2025-10-02T09:28:06.549785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.550003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.550026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.550061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:06.550152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.551264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.551282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-02T09:28:06.552859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.552885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.553126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:06.554146Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:06.554161Z :DEBUG: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.553546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:06.553978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:06.554417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:06.554582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-02T09:28:06.554588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-02T09:28:06.554613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.554641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.554650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.554654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T09:28:06.554686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:06.554698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-02T09:28:06.554701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-02T09:28:06.554704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-02T09:28:06.554707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-02T09:28:06.556155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-02T09:28:06.556169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.556385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1759397286556
2025-10-02T09:28:06.556571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.558349Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.558369Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-02T09:28:06.558601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.558767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.558782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.558809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-02T09:28:06.558883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.559654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 3 to 3
2025-10-02T09:28:06.561450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.561471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.561522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.561538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-02T09:28:06.561682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-02T09:28:06.561746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-02T09:28:06.561812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-02T09:28:06.561916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-02T09:28:06.561960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-02T09:28:06.561966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-02T09:28:06.561990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.562012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.563017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.563040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.563052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.563058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.563064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.563073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T09:28:06.563081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.563087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-02T09:28:06.563089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.563094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-02T09:28:06.563096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.563100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-02T09:28:06.563105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.563112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-02T09:28:06.563163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:06.563183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:06.563187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.563196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.563202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T09:28:06.563222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T09:28:06.563237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-02T09:28:06.563245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-02T09:28:06.563249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-02T09:28:06.563257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-02T09:28:06.563278Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-02T09:28:06.563298Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-02T09:28:06.563334Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-02T09:28:06.563345Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:06.563363Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# 88478b5f-d8798597-c5cf3544-9931484e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.563404Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 88478b5f-d8798597-c5cf3544-9931484e
2025-10-02T09:28:06.564179Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.564483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-02T09:28:06.564513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.564616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1759397286564
2025-10-02T09:28:06.566401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.568310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.568360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.569310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 4 to 4
2025-10-02T09:28:06.571148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.571162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-02T09:28:06.566548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T09:28:06.566561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2253219 bytes (2253219)
2025-10-02T09:28:06.566565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2253219 (8388608)
2025-10-02T09:28:06.566600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T09:28:06.566648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.566653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.566670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.566674Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.566688Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-02T09:28:06.566765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:06.566779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:06.566782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:06.566812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.566824Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T09:28:06.566835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T09:28:06.566846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-02T09:28:06.566850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-02T09:28:06.566856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.566870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.567034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.567228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.567375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.567531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.567747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.567773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.567790Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-02T09:28:06.567801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:06.567815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.567845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.567998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.568123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.568248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.568369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.568574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.568610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:06.568632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.568637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.571012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-02T09:28:06.572026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.572369Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.572409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.572436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.572452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.572457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.572466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-02T09:28:06.572474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.572479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-02T09:28:06.572486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.572490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-02T09:28:06.572493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.572497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-02T09:28:06.572503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.572511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-02T09:28:06.573187Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286554 CreateTimestampMS: 1759397286538 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-02T09:28:06.573235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.573271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.573275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.573277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.573290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T09:28:06.573292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T09:28:06.573295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 4506438 bytes (4506438)
2025-10-02T09:28:06.573299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 4506438 (8388608)
2025-10-02T09:28:06.573322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-02T09:28:06.573392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 8 }
2025-10-02T09:28:06.573408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 1
2025-10-02T09:28:06.573466Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-02T09:28:06.573488Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 88478b5f-d8798597-c5cf3544-9931484e has messages 1
2025-10-02T09:28:06.573548Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# 88478b5f-d8798597-c5cf3544-9931484e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-02T09:28:06.573559Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# 88478b5f-d8798597-c5cf3544-9931484e
2025-10-02T09:28:06.573827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.573862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.574324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.574703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.574725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.574793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-02T09:28:06.574783Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 0
2025-10-02T09:28:06.574878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-02T09:28:06.574936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-02T09:28:06.574997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-02T09:28:06.575112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-02T09:28:06.575121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-02T09:28:06.575153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.575160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.575170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.575206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.575220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.575226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T09:28:06.575253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T09:28:06.575266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-02T09:28:06.575274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-02T09:28:06.575278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-02T09:28:06.575282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-02T09:28:06.575791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-02T09:28:06.575810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.575857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:06.575868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 2
2025-10-02T09:28:06.575917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1759397286575
2025-10-02T09:28:06.576144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 5 to 5
2025-10-02T09:28:06.576257Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.576277Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-02T09:28:06.576290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-02T09:28:06.576403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.576415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-02T09:28:06.576449Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-02T09:28:06.576549Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-02T09:28:06.576396Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-02T09:28:06.576405Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-02T09:28:06.576417Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1759397286554, sizeLag# 2253219
2025-10-02T09:28:06.576419Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:06.576424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.576565Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252976 to budget
2025-10-02T09:28:06.577929Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-02T09:28:06.577948Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.577957Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-02T09:28:06.578025Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.578034Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.578145Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-02T09:28:06.578214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.578222Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# 7976d2be-df1c5938-18e6e34c-4606645a
2025-10-02T09:28:06.578239Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# ea29572d-f912adf7-cd92b811-763244eb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.578253Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid ea29572d-f912adf7-cd92b811-763244eb
2025-10-02T09:28:06.580182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.580206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.580268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.580327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-02T09:28:06.538000Z WriteTime: 2025-10-02T09:28:06.554000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40444", "_ip": "ipv6:[::1]:40444", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.580748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-02T09:28:06.581180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-02T09:28:06.581247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-02T09:28:06.581367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-02T09:28:06.581379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-02T09:28:06.581418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.581427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.581455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.581462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.581470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.581491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.581666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-02T09:28:06.581684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 2 max time lag 0ms effective offset 1
2025-10-02T09:28:06.581708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 2
2025-10-02T09:28:06.581715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-02T09:28:06.581725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.581735Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-02T09:28:06.581748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.581754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.581922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.582071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.581814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.584248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 6 to 6
2025-10-02T09:28:06.582570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.583063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.583248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.583344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:06.583365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.583428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.584789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.584797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.584933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-02T09:28:06.584995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-02T09:28:06.585049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-02T09:28:06.585825Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286562 CreateTimestampMS: 1759397286547 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-02T09:28:06.586084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.586099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-02T09:28:06.586150Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-02T09:28:06.586173Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid ea29572d-f912adf7-cd92b811-763244eb has messages 1
2025-10-02T09:28:06.586234Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# ea29572d-f912adf7-cd92b811-763244eb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T09:28:06.586248Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# ea29572d-f912adf7-cd92b811-763244eb
2025-10-02T09:28:06.587599Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.585106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-02T09:28:06.585140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-02T09:28:06.585145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-02T09:28:06.585168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.585189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.585196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.585204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-02T09:28:06.585207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.585211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-02T09:28:06.585213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.585218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-02T09:28:06.585219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.585224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-02T09:28:06.585230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.585235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-02T09:28:06.585267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.585276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.585278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T09:28:06.585300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-02T09:28:06.585309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-02T09:28:06.585313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-02T09:28:06.585316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-02T09:28:06.585320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-02T09:28:06.585748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-02T09:28:06.585761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.585869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00004? size 2253219 WTime 1759397286585
2025-10-02T09:28:06.587765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T09:28:06.587770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T09:28:06.587773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T09:28:06.587776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 6759657 bytes (6759657)
2025-10-02T09:28:06.587780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 6759657 (8388608)
2025-10-02T09:28:06.587794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.587814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.587836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-02T09:28:06.587866Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.587879Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 2253219
2025-10-02T09:28:06.588277Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 0
2025-10-02T09:28:06.588322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.588450Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-02T09:28:06.588458Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-02T09:28:06.588468Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1759397286562, sizeLag# 2253219
2025-10-02T09:28:06.588472Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 1
2025-10-02T09:28:06.588554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 9 }
2025-10-02T09:28:06.588567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 3
2025-10-02T09:28:06.589020Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.589109Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-02T09:28:06.589116Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T09:28:06.590059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.590369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.590544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.590558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.590591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-02T09:28:06.590675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.592681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 7 to 7
2025-10-02T09:28:06.592984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.592999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-02T09:28:06.593228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.593249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.593316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-02T09:28:06.593384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-02T09:28:06.593534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-02T09:28:06.593955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-02T09:28:06.593997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-02T09:28:06.594005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-02T09:28:06.594081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.594104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.594115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 2253219 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.594132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.594152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.594155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.594161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.594169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-02T09:28:06.594174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.594178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-02T09:28:06.594179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.594183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-02T09:28:06.594185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.594189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-02T09:28:06.594194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.594197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-02T09:28:06.594249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.594269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.594271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T09:28:06.594291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-02T09:28:06.594300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-02T09:28:06.594305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-02T09:28:06.594314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-02T09:28:06.594318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-02T09:28:06.594561Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-02T09:28:06.594583Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.594593Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.594676Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.594688Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.594805Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T09:28:06.594817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.594900Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# 32840b4-f08bc675-5c8dd504-786938c7
2025-10-02T09:28:06.594920Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# dbbff370-42f25269-a98adfb8-6cea4fe5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.594942Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid dbbff370-42f25269-a98adfb8-6cea4fe5
2025-10-02T09:28:06.595139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-02T09:28:06.595169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-02T09:28:06.595189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-02T09:28:06.595197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-02T09:28:06.595201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-02T09:28:06.595204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-02T09:28:06.595752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-02T09:28:06.595775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.595870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,2 HeadOffset 4 endOffset 4 curOffset 6 d0000000000_00000000000000000004_00000_0000000002_00008? size 4506416 WTime 1759397286595
2025-10-02T09:28:06.596849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-02T09:28:06.547000Z WriteTime: 2025-10-02T09:28:06.562000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40444", "logtype": "unknown", "_ip": "ipv6:[::1]:40444", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.599528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T09:28:06.599542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T09:28:06.599545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T09:28:06.599547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-02T09:28:06.599551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 9012876 bytes (9012876)
2025-10-02T09:28:06.599553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 4 blobs
2025-10-02T09:28:06.599587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-02T09:28:06.599626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.599638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.599654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.599657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.599664Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.599679Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 2 size 4506416
2025-10-02T09:28:06.599688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-02T09:28:06.599693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T09:28:06.599682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.599703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T09:28:06.599723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T09:28:06.599747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-02T09:28:06.599761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-02T09:28:06.599816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.599824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.599827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.599832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.599843Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-02T09:28:06.599866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.599872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-02T09:28:06.599876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.599879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.599882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.599896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:06.599899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T09:28:06.599900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.599942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.600032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 3 }
2025-10-02T09:28:06.600046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 4
2025-10-02T09:28:06.600039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T09:28:06.600202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-02T09:28:06.600348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-02T09:28:06.600485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-02T09:28:06.600557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-02T09:28:06.600624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 8 to 8
2025-10-02T09:28:06.600921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.600935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-02T09:28:06.601437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-02T09:28:06.601461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T09:28:06.601463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.601582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T09:28:06.601720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-02T09:28:06.601862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-02T09:28:06.602366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-02T09:28:06.602450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-02T09:28:06.602887Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.603608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-02T09:28:06.603633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T09:28:06.603637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.603781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T09:28:06.603885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.603942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-02T09:28:06.604105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-02T09:28:06.604194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.604270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-02T09:28:06.604338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-02T09:28:06.605057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-02T09:28:06.605074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-02T09:28:06.605076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.605209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-02T09:28:06.605353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-02T09:28:06.605494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-02T09:28:06.605645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-02T09:28:06.606549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 9 to 9
2025-10-02T09:28:06.608316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.608331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-02T09:28:06.609703Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.613849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-02T09:28:06.613928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-02T09:28:06.613946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1759397286613
2025-10-02T09:28:06.614075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-02T09:28:06.614170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000003_00003_0000000001_00001| size 717134 WTime 1759397286614
2025-10-02T09:28:06.614704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 10 to 10
2025-10-02T09:28:06.614808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 4 max time lag 0ms effective offset 2
2025-10-02T09:28:06.614832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 4
2025-10-02T09:28:06.614837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-02T09:28:06.615498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.615513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-02T09:28:06.616618Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.616978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.616995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.617081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-02T09:28:06.617192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-02T09:28:06.617261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-02T09:28:06.617393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-02T09:28:06.617565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-02T09:28:06.617577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-02T09:28:06.617610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.617618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.617646Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.617667Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-02T09:28:06.617679Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 1 size 717134
2025-10-02T09:28:06.617695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.617713Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-02T09:28:06.617730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.617736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.617757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.617957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.618357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.618514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.618668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.618824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.618904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.618947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-02T09:28:06.619050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-02T09:28:06.619082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 2 size 4506416 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.619125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-02T09:28:06.619053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.620389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 11 to 11
2025-10-02T09:28:06.619885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.619912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.619917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-02T09:28:06.619929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-02T09:28:06.619935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-02T09:28:06.619940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-02T09:28:06.619949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-02T09:28:06.619955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-02T09:28:06.619961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-02T09:28:06.619969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-02T09:28:06.619978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-02T09:28:06.619984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.619988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-02T09:28:06.620025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.620033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.620036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T09:28:06.620057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-02T09:28:06.620067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-02T09:28:06.620070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-02T09:28:06.620073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-02T09:28:06.620076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-02T09:28:06.620584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-02T09:28:06.620607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.620719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00004? size 2253219 WTime 1759397286620
2025-10-02T09:28:06.620948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.621297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.621618Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286575 CreateTimestampMS: 1759397286557 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 2 }
2025-10-02T09:28:06.622490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.622507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-02T09:28:06.622743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.622784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-02T09:28:06.622817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-02T09:28:06.622922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.622960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.623626Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.623564Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-02T09:28:06.623593Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 3 ReadGuid dbbff370-42f25269-a98adfb8-6cea4fe5 has messages 1
2025-10-02T09:28:06.623623Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1759397286575, sizeLag# 2253329
2025-10-02T09:28:06.623628Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.623648Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# dbbff370-42f25269-a98adfb8-6cea4fe5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T09:28:06.623660Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# dbbff370-42f25269-a98adfb8-6cea4fe5
2025-10-02T09:28:06.623769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 7 }
2025-10-02T09:28:06.623781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 5
2025-10-02T09:28:06.623911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 1 }
2025-10-02T09:28:06.623923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 6
2025-10-02T09:28:06.625755Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.624912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.624929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.625007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-02T09:28:06.625435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-02T09:28:06.625498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-02T09:28:06.625554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-02T09:28:06.625591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-02T09:28:06.625596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-02T09:28:06.625645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.625649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.625659Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.625676Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 2253219
2025-10-02T09:28:06.625685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.625705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.625756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-02T09:28:06.625890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.626451Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.626551Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-02T09:28:06.626567Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T09:28:06.627351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 12 to 12
2025-10-02T09:28:06.627667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.627681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-02T09:28:06.628329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.628348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.628418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-02T09:28:06.628477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-02T09:28:06.628590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-02T09:28:06.628722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-02T09:28:06.628764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-02T09:28:06.628772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-02T09:28:06.628821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.628829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.628838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.628860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.628884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-02T09:28:06.629674Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-02T09:28:06.629696Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.629707Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.629794Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.629805Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.630318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.630331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.630370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 524288 endOffset 6 max time lag 0ms effective offset 3
2025-10-02T09:28:06.630399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 2253219 count 1 last offset 3, current partition end offset: 6
2025-10-02T09:28:06.630406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-02T09:28:06.630420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.630435Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-02T09:28:06.630455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.630465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.630686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-02T09:28:06.557000Z WriteTime: 2025-10-02T09:28:06.575000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40444", "logtype": "unknown", "_ip": "ipv6:[::1]:40444", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.630868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.631030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.631222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.631314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.627799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.628144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.628972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.629965Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T09:28:06.629998Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# defb1e5d-916ab1fd-35743189-df9f250b
2025-10-02T09:28:06.630020Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# e812eb77-f31a77c6-386ebe88-645d81bb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.630041Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid e812eb77-f31a77c6-386ebe88-645d81bb
2025-10-02T09:28:06.630644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.630957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.632204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.632220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.632303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-02T09:28:06.632457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-02T09:28:06.632530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-02T09:28:06.632826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-02T09:28:06.632877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-02T09:28:06.632886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-02T09:28:06.632916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.632924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.632964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-02T09:28:06.632992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.633015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.634768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 13 to 13
2025-10-02T09:28:06.635035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.635047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-02T09:28:06.635354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-02T09:28:06.635461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 2253219 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.635482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.635486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 717134 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.635493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.635512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.635518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.635527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-02T09:28:06.635531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.635535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-02T09:28:06.635537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.635541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-02T09:28:06.635543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.635545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.635549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-02T09:28:06.635553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:06.635555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.635557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-02T09:28:06.635560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-02T09:28:06.635595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.635610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.635613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-02T09:28:06.635635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-02T09:28:06.635648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-02T09:28:06.635651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-02T09:28:06.635654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-02T09:28:06.635658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-02T09:28:06.636138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 2253229 count 1 nextOffset 8 batches 5
2025-10-02T09:28:06.636160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-02T09:28:06.636168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-02T09:28:06.636171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-02T09:28:06.636175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-02T09:28:06.636946Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.636180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-02T09:28:06.637311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 4506426 count 2 nextOffset 9 batches 9
2025-10-02T09:28:06.637330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-02T09:28:06.637338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-02T09:28:06.637341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-02T09:28:06.637345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-02T09:28:06.637348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-02T09:28:06.636325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.637376Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286584 CreateTimestampMS: 1759397286567 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 3 }
2025-10-02T09:28:06.637704Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 6
2025-10-02T09:28:06.637718Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 4 ReadGuid e812eb77-f31a77c6-386ebe88-645d81bb has messages 1
2025-10-02T09:28:06.637754Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 6, WTime# 1759397286584, sizeLag# 2253329
2025-10-02T09:28:06.637758Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.637771Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# e812eb77-f31a77c6-386ebe88-645d81bb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T09:28:06.637781Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# e812eb77-f31a77c6-386ebe88-645d81bb
2025-10-02T09:28:06.637980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 6759623 count 3 nextOffset 10 batches 13
2025-10-02T09:28:06.638010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.638122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 7 endOffset 7 curOffset 10 d0000000000_00000000000000000007_00000_0000000003_00012? size 6759613 WTime 1759397286638
2025-10-02T09:28:06.639105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.639457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.639723Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.640695Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.640797Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-02T09:28:06.640838Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T09:28:06.641468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 14 to 14
2025-10-02T09:28:06.643493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.643509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-02T09:28:06.644073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.644135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.644139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T09:28:06.644308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.644325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-02T09:28:06.644329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-02T09:28:06.644333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 6759635 bytes (6759635)
2025-10-02T09:28:06.644338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 6759635 (8388608)
2025-10-02T09:28:06.644376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-02T09:28:06.644589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.644872Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-02T09:28:06.644892Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.644901Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.644937Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.644947Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.645056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 2 }
2025-10-02T09:28:06.645067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 7
2025-10-02T09:28:06.645147Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T09:28:06.645219Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# a8893783-128ceaf1-f4776564-3afad850
2025-10-02T09:28:06.645244Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# 877f2891-321cd5a-e1da6088-9a35645d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.645271Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 877f2891-321cd5a-e1da6088-9a35645d
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-02T09:28:06.567000Z WriteTime: 2025-10-02T09:28:06.584000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40444", "_ip": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.646443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.646467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.646549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-02T09:28:06.646618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-02T09:28:06.646690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-02T09:28:06.647118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-02T09:28:06.647168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-02T09:28:06.647194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-02T09:28:06.647240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.647249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.647260Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.647287Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 3 size 6759613
2025-10-02T09:28:06.647318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.647328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.647341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.647370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.647438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-02T09:28:06.647506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 2 size 524288 endOffset 7 max time lag 0ms effective offset 4
2025-10-02T09:28:06.647530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 4506416 count 2 last offset 4, current partition end offset: 7
2025-10-02T09:28:06.647538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-02T09:28:06.647550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.647560Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-02T09:28:06.647575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.647586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-02T09:28:06.648465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.648641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.648796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.647639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.649365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.649478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.649855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.650071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:06.650135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 15 to 15
2025-10-02T09:28:06.650240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.650402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.650433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.650444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-02T09:28:06.650953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.651051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.652176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.652199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.652282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-02T09:28:06.652549Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.652733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-02T09:28:06.652834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-02T09:28:06.653257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-02T09:28:06.653311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-02T09:28:06.653320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-02T09:28:06.653359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.653368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.653396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-02T09:28:06.653429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.653453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.657793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-02T09:28:06.658829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 16 to 16
2025-10-02T09:28:06.660006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.660505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6759613 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.660534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.660555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.660558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-02T09:28:06.660562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-02T09:28:06.660579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-02T09:28:06.660586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-02T09:28:06.660591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-02T09:28:06.660602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-02T09:28:06.660616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-02T09:28:06.660621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-02T09:28:06.660629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.660633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-02T09:28:06.660635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-02T09:28:06.660640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-02T09:28:06.660645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-02T09:28:06.660650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-02T09:28:06.660656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-02T09:28:06.660661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-02T09:28:06.660667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.660670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-02T09:28:06.660720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.660736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.660743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T09:28:06.660767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-02T09:28:06.660782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-02T09:28:06.660787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-02T09:28:06.660790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-02T09:28:06.660793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-02T09:28:06.660669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-02T09:28:06.660956Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.661417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2253230 count 1 nextOffset 11 batches 5
2025-10-02T09:28:06.661451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-02T09:28:06.661459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-02T09:28:06.661462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-02T09:28:06.661467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-02T09:28:06.661470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-02T09:28:06.661618Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286594 CreateTimestampMS: 1759397286575 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286595 CreateTimestampMS: 1759397286584 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 4506614 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 4 }
2025-10-02T09:28:06.662309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 4506428 count 2 nextOffset 12 batches 9
2025-10-02T09:28:06.662335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.662393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.662444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,2 HeadOffset 10 endOffset 10 curOffset 12 d0000000000_00000000000000000010_00000_0000000002_00008? size 4506418 WTime 1759397286661
2025-10-02T09:28:06.664139Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-10-02T09:28:06.664165Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 6 ReadGuid 877f2891-321cd5a-e1da6088-9a35645d has messages 1
2025-10-02T09:28:06.664205Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1759397286595, sizeLag# 4506614
2025-10-02T09:28:06.664215Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.664229Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# 877f2891-321cd5a-e1da6088-9a35645d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505940
2025-10-02T09:28:06.664239Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# 877f2891-321cd5a-e1da6088-9a35645d
2025-10-02T09:28:06.664393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.665849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 17 to 17
2025-10-02T09:28:06.666115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.666128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-02T09:28:06.666135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528017[B] reached maximum (20971520[B])
2025-10-02T09:28:06.666178Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.666430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-02T09:28:06.666450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-02T09:28:06.666453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-02T09:28:06.666457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 13519248 bytes (13519248)
2025-10-02T09:28:06.666460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:06.666507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-02T09:28:06.666544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-02T09:28:06.666570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-02T09:28:06.666621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.666658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.666659Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.666665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.668569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.668590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.668677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-02T09:28:06.668734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-02T09:28:06.668794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-02T09:28:06.668974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-02T09:28:06.669526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.670209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 10 }
2025-10-02T09:28:06.670224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 8
2025-10-02T09:28:06.670230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275216[B]
2025-10-02T09:28:06.670369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 7 }
2025-10-02T09:28:06.670383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 9
2025-10-02T09:28:06.670706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 18 to 18
2025-10-02T09:28:06.671048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.671062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-02T09:28:06.671112Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-02T09:28:06.671121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.671132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 10
2025-10-02T09:28:06.671338Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 4505940, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981652
2025-10-02T09:28:06.671447Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-02T09:28:06.671464Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 4505940 to budget
2025-10-02T09:28:06.669017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-02T09:28:06.669027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-02T09:28:06.669059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.669063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.669072Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.669093Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 2 size 4506418
2025-10-02T09:28:06.669102Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-02T09:28:06.669105Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-02T09:28:06.669107Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-02T09:28:06.669111Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00004?(+) to d0000000000_00000000000000000003_00000_0000000001_00004?(+)
2025-10-02T09:28:06.672864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.669121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:06.669124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-02T09:28:06.669134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-02T09:28:06.669148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-02T09:28:06.669162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:06.669170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.669174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.669193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.669256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.669259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.669262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.669278Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-02T09:28:06.669306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-02T09:28:06.669337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:06.669342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-02T09:28:06.669344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.669345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-02T09:28:06.669352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.669364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63'
2025-10-02T09:28:06.669568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-02T09:28:06.669716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-02T09:28:06.669853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-02T09:28:06.669995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-02T09:28:06.670199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-02T09:28:06.670616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-02T09:28:06.670628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-02T09:28:06.670773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-02T09:28:06.670920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-02T09:28:06.671068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-02T09:28:06.671139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-02T09:28:06.671687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-02T09:28:06.671699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-02T09:28:06.671704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.671827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-02T09:28:06.671961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-02T09:28:06.672090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-02T09:28:06.672232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-02T09:28:06.672303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-02T09:28:06.673430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6759623 count 3 nextOffset 7 batches 13
2025-10-02T09:28:06.673455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-02T09:28:06.673457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.673586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-02T09:28:06.673738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-02T09:28:06.673232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.674595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 19 to 19
2025-10-02T09:28:06.676494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.676509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-02T09:28:06.677119Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-02T09:28:06.677138Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.677180Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-02T09:28:06.677209Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.677682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-02T09:28:06.677938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-02T09:28:06.678091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-02T09:28:06.678302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-02T09:28:06.678327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1759397286678
2025-10-02T09:28:06.678657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-02T09:28:06.678682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-02T09:28:06.678818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-02T09:28:06.575000Z WriteTime: 2025-10-02T09:28:06.594000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40444", "logtype": "unknown", "_ip": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.678962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-02T09:28:06.679111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-02T09:28:06.679320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-02T09:28:06.680000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-02T09:28:06.680011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-02T09:28:06.680148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-02T09:28:06.680281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-02T09:28:06.680414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-02T09:28:06.680469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-02T09:28:06.680989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-02T09:28:06.681075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 3 endOffset 4 curOffset 10 d0000000000_00000000000000000007_00001_0000000003_00011| size 6247582 WTime 1759397286680
2025-10-02T09:28:06.684706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 20 to 20
2025-10-02T09:28:06.686583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.686600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-02T09:28:06.686610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.686659Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.687067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.685768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.685795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.685876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-02T09:28:06.685934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-02T09:28:06.685991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-02T09:28:06.686046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-02T09:28:06.686083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-02T09:28:06.686088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-02T09:28:06.686124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.686128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.686157Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.686175Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-02T09:28:06.686183Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 6247582
2025-10-02T09:28:06.686193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.686216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.686601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-02T09:28:06.689009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.689028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.689033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.689037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.689044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 2 size 4506418 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.689069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.689090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.689096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-02T09:28:06.689108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-02T09:28:06.689115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-02T09:28:06.689121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-02T09:28:06.689133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-02T09:28:06.689141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-02T09:28:06.689147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-02T09:28:06.689154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-02T09:28:06.689159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-02T09:28:06.689165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.689168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-02T09:28:06.689206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.689217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.689219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T09:28:06.689242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-02T09:28:06.689254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-02T09:28:06.689259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-02T09:28:06.689262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-02T09:28:06.689266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-02T09:28:06.689323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.689335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.689343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.689349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.689356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.689880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 2253230 count 1 nextOffset 13 batches 5
2025-10-02T09:28:06.689899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-02T09:28:06.689907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-02T09:28:06.689910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-02T09:28:06.689913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-02T09:28:06.689916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-02T09:28:06.690443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 4506428 count 2 nextOffset 14 batches 9
2025-10-02T09:28:06.690457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.690551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 12,2 HeadOffset 12 endOffset 12 curOffset 14 d0000000000_00000000000000000012_00000_0000000002_00008? size 4506418 WTime 1759397286689
2025-10-02T09:28:06.692511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.692557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-02T09:28:06.692593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-02T09:28:06.693522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.693544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.693627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-02T09:28:06.693689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-02T09:28:06.693768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-02T09:28:06.693681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.693710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.693732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.694314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.694402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 13 }
2025-10-02T09:28:06.694439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 11
2025-10-02T09:28:06.694443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.694510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 7 }
2025-10-02T09:28:06.694516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 12
2025-10-02T09:28:06.694094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-02T09:28:06.694144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-02T09:28:06.694148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-02T09:28:06.694171Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.694188Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 2 size 4506418
2025-10-02T09:28:06.694197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.694219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.694532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.694536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.694556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-02T09:28:06.694858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 21 to 21
2025-10-02T09:28:06.695136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.695149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-02T09:28:06.695490Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-02T09:28:06.695510Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.695519Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505940, ReadSizeServerDelta = -3981652
2025-10-02T09:28:06.695607Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.695617Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.694721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.695774Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505940 } }
2025-10-02T09:28:06.695818Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# e71c8ef8-e11cc3-d7b3b726-914d7e1a
2025-10-02T09:28:06.695837Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# f1889684-80f81ca7-f199dd1c-f4e4a4d0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.695860Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid f1889684-80f81ca7-f199dd1c-f4e4a4d0
2025-10-02T09:28:06.697337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-02T09:28:06.584000Z WriteTime: 2025-10-02T09:28:06.595000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40444", "server": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.697686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.696129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.696140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.696169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 6 count 1 size 524288 endOffset 12 max time lag 0ms effective offset 6
2025-10-02T09:28:06.696183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 2253219 count 1 last offset 6, current partition end offset: 12
2025-10-02T09:28:06.696186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-02T09:28:06.696196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.696205Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-02T09:28:06.696217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.696226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.696368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.696498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.696632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.696774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.696867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.698672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.698679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.698758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-02T09:28:06.698823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-02T09:28:06.698885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-02T09:28:06.699323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-02T09:28:06.699361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-02T09:28:06.699365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-02T09:28:06.699400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-02T09:28:06.699429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.699431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.699440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.699461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.701062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 22 to 22
2025-10-02T09:28:06.701399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.701413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-02T09:28:06.701420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.701463Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.702981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-02T09:28:06.704072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.706194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.706459Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 12 Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286619 CreateTimestampMS: 1759397286590 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 9012942 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 12 StartOffset: 0 } Cookie: 6 }
2025-10-02T09:28:06.706591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.706771Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 12
2025-10-02T09:28:06.706798Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 12 ReadOffset 7 ReadGuid f1889684-80f81ca7-f199dd1c-f4e4a4d0 has messages 1
2025-10-02T09:28:06.706822Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 12, WTime# 1759397286619, sizeLag# 9012942
2025-10-02T09:28:06.706831Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.706850Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# f1889684-80f81ca7-f199dd1c-f4e4a4d0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T09:28:06.706866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# f1889684-80f81ca7-f199dd1c-f4e4a4d0
2025-10-02T09:28:06.707555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.707575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.707648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-02T09:28:06.707702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-02T09:28:06.707759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-02T09:28:06.708171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-02T09:28:06.708208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-02T09:28:06.708212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-02T09:28:06.708244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.708248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.708259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.708281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.708293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-02T09:28:06.708383Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.709581Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.709700Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-02T09:28:06.709718Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T09:28:06.709302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.711354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.711670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.712233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.712253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.712698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-02T09:28:06.713128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-02T09:28:06.713547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-02T09:28:06.713992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-02T09:28:06.714039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-02T09:28:06.714043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-02T09:28:06.714092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.714097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.714110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.714131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.714297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-02T09:28:06.714415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.716267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.716566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.716888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.716905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.716979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-02T09:28:06.717038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-02T09:28:06.717098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-02T09:28:06.717230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-02T09:28:06.717271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-02T09:28:06.717275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-02T09:28:06.717379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.717384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.717395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.717416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.717430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.717435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6247582 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.717472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.717475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T09:28:06.717475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:06.717481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-02T09:28:06.717485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-02T09:28:06.718432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.718452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-02T09:28:06.718455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 4506418 bytes (4506418)
2025-10-02T09:28:06.718459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 4506418 (8388608)
2025-10-02T09:28:06.718477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-02T09:28:06.718502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 7
2025-10-02T09:28:06.718505Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.718678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.720415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.720743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.720929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.720945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.721018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-02T09:28:06.721076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-02T09:28:06.721139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-02T09:28:06.721198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-02T09:28:06.721238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-02T09:28:06.721245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-02T09:28:06.721342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.721345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.721355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.721377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.721389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 2 size 4506418 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.721418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.721431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-02T09:28:06.721435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.721436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-02T09:28:06.721440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.721447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-02T09:28:06.721451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-02T09:28:06.721458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-02T09:28:06.721464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-02T09:28:06.721475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-02T09:28:06.721481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-02T09:28:06.721487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-02T09:28:06.721494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-02T09:28:06.721502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-02T09:28:06.721508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.721514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-02T09:28:06.721802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.721833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.721835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (30)
2025-10-02T09:28:06.721863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-02T09:28:06.721874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-02T09:28:06.721878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-02T09:28:06.721881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-02T09:28:06.721884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-02T09:28:06.722296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 2253230 count 1 nextOffset 15 batches 5
2025-10-02T09:28:06.722308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-02T09:28:06.722313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-02T09:28:06.722316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-02T09:28:06.722318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-02T09:28:06.722321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-02T09:28:06.722851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 4506428 count 2 nextOffset 16 batches 9
2025-10-02T09:28:06.722871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-02T09:28:06.722878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-02T09:28:06.722882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-02T09:28:06.722885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-02T09:28:06.722889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-02T09:28:06.723562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 6759626 count 3 nextOffset 17 batches 13
2025-10-02T09:28:06.723574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T09:28:06.723579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T09:28:06.723582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T09:28:06.723587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T09:28:06.727491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 18 partNo 3 result is x0000000000_00000000000000000014_00000_0000000003_00015? size 8295638
2025-10-02T09:28:06.727515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T09:28:06.727531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00000_0000000003_00015? new key d0000000000_00000000000000000014_00000_0000000003_00015? size 8295638 WTime 1759397286726
2025-10-02T09:28:06.727651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 1 NewHead: Offset 17 PartNo 3 PackedSize 717145 count 1 nextOffset 18 batches 2
2025-10-02T09:28:06.727666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T09:28:06.727673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T09:28:06.727677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T09:28:06.727681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T09:28:06.727686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T09:28:06.728228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 3 PackedSize 2970343 count 2 nextOffset 19 batches 6
2025-10-02T09:28:06.728253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T09:28:06.728260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T09:28:06.728263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T09:28:06.728270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T09:28:06.728273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T09:28:06.729113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 3 PackedSize 5223541 count 3 nextOffset 20 batches 10
2025-10-02T09:28:06.729135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.730438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.730467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.730477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.731917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 20 }
2025-10-02T09:28:06.731935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 13
2025-10-02T09:28:06.731941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.732035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 3 }
2025-10-02T09:28:06.732040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 14
2025-10-02T09:28:06.732378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 23 to 23
2025-10-02T09:28:06.732663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.732676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-02T09:28:06.729241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,3 HeadOffset 14 endOffset 14 curOffset 20 d0000000000_00000000000000000017_00003_0000000003_00009? size 5223531 WTime 1759397286727
2025-10-02T09:28:06.730173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-02T09:28:06.730177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000002_00008?
2025-10-02T09:28:06.730179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012836 bytes (9012836)
2025-10-02T09:28:06.730181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T09:28:06.730230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-02T09:28:06.730261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 717134 cause it's been evicted from L2. Actual L1 size: 7
2025-10-02T09:28:06.730264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 4 size 4506416 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T09:28:06.730267Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.730285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-02T09:28:06.730305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-02T09:28:06.730310Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.730318Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 3 size 8295638
2025-10-02T09:28:06.730322Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 3 count 3 size 5223531
2025-10-02T09:28:06.730326Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000002_00008?(+) to d0000000000_00000000000000000004_00000_0000000002_00008?(+)
2025-10-02T09:28:06.730328Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00004?(+) to d0000000000_00000000000000000006_00000_0000000001_00004?(+)
2025-10-02T09:28:06.730330Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000003_00012?(+) to d0000000000_00000000000000000007_00000_0000000003_00012?(+)
2025-10-02T09:28:06.730331Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000001_00001|(+) to d0000000000_00000000000000000003_00003_0000000001_00001|(+)
2025-10-02T09:28:06.730335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T09:28:06.730337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-02T09:28:06.730343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000002_00008?
2025-10-02T09:28:06.730350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T09:28:06.730394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.730397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.730406Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-02T09:28:06.730439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:06.730442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-02T09:28:06.730443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.730442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 2 parts 8 suffix '63'
2025-10-02T09:28:06.730447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 2 parts 8 suffix '63'
2025-10-02T09:28:06.730687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-02T09:28:06.730830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-02T09:28:06.730973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-02T09:28:06.731114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-02T09:28:06.731346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-02T09:28:06.733382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295579
2025-10-02T09:28:06.733404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295579 WTime 1759397286733
2025-10-02T09:28:06.733421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-02T09:28:06.733428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-02T09:28:06.733342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.733575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-02T09:28:06.733732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-02T09:28:06.734147Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-10-02T09:28:06.734168Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.734181Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.734272Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.734285Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.733696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.734403Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T09:28:06.734463Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# bfc97116-b0caef8d-46975b1b-fa31bd4e
2025-10-02T09:28:06.734499Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# 77e2181a-d2620373-ce049e11-97eb2944, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.734530Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 12 ClientCommitOffset 0 committedOffset 0 Guid 77e2181a-d2620373-ce049e11-97eb2944
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-02T09:28:06.590000Z WriteTime: 2025-10-02T09:28:06.619000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40444", "logtype": "unknown", "server": "ipv6:[::1]:40444", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.733886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-02T09:28:06.734057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-02T09:28:06.734612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-02T09:28:06.734628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000012_00000_0000000002_00008?
2025-10-02T09:28:06.734630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.734781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-02T09:28:06.734932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-02T09:28:06.735083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-02T09:28:06.735237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-02T09:28:06.735421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-02T09:28:06.735942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-02T09:28:06.735954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-02T09:28:06.736098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-02T09:28:06.736246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-02T09:28:06.736403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-02T09:28:06.736458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-02T09:28:06.739807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 24 to 24
2025-10-02T09:28:06.737097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 6964712 count 4 nextOffset 14 batches 13
2025-10-02T09:28:06.737193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,4 HeadOffset 7 endOffset 10 curOffset 14 d0000000000_00000000000000000010_00004_0000000004_00012| size 6964702 WTime 1759397286736
2025-10-02T09:28:06.741804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.741819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-02T09:28:06.742921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.742968Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.743091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.743115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.743214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-02T09:28:06.743288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-02T09:28:06.743354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-02T09:28:06.743427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-02T09:28:06.743461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-02T09:28:06.743465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-02T09:28:06.743503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.743507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.743539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.743547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.743562Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.743582Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295579
2025-10-02T09:28:06.743589Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 6964702
2025-10-02T09:28:06.743604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.743627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.743682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-02T09:28:06.743728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 6 size 524288 endOffset 14 max time lag 0ms effective offset 7
2025-10-02T09:28:06.743747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 0 count 0 last offset 3, current partition end offset: 14
2025-10-02T09:28:06.744372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-02T09:28:06.744410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.744424Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-02T09:28:06.744448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-02T09:28:06.744454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.743816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.745681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.746009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.751019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.747385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:06.748323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.748332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.748407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-02T09:28:06.748462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-02T09:28:06.748519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-02T09:28:06.748582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-02T09:28:06.748610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-02T09:28:06.748614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-02T09:28:06.748643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.748646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.748668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-02T09:28:06.748694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.748712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.749252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-02T09:28:06.749276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-02T09:28:06.749280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.749312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 1 size 26214400 endOffset 14 max time lag 0ms effective offset 7
2025-10-02T09:28:06.749318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 0 blobs, size 0 count 0 last offset 7, current partition end offset: 14
2025-10-02T09:28:06.749772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. All data is from uncompacted head.
2025-10-02T09:28:06.749779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-02T09:28:06.749814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 7
2025-10-02T09:28:06.752925Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 14 Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286635 CreateTimestampMS: 1759397286600 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 8807751 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 14 StartOffset: 0 } Cookie: 7 }
2025-10-02T09:28:06.753213Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 14
2025-10-02T09:28:06.753225Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 14 ReadOffset 8 ReadGuid 77e2181a-d2620373-ce049e11-97eb2944 has messages 1
2025-10-02T09:28:06.753253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.753889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.753940Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 14, WTime# 1759397286635, sizeLag# 8807751
2025-10-02T09:28:06.753943Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.753961Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# 77e2181a-d2620373-ce049e11-97eb2944, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T09:28:06.753970Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# 77e2181a-d2620373-ce049e11-97eb2944
2025-10-02T09:28:06.756551Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.757868Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.754850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.754872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.755292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-02T09:28:06.755657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-02T09:28:06.755714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-02T09:28:06.755768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-02T09:28:06.755804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-02T09:28:06.755807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-02T09:28:06.755833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.755862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.756133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.756139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.756150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-02T09:28:06.758834Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-02T09:28:06.758851Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T09:28:06.765158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.765176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 3 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.765187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 8295638 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.765191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 3 size 5223531 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.765211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.765233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 13517466 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.765240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-02T09:28:06.765256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-02T09:28:06.765263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-02T09:28:06.765270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-02T09:28:06.765282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-02T09:28:06.765293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-02T09:28:06.765301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-02T09:28:06.765308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-02T09:28:06.765317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-02T09:28:06.765324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-02T09:28:06.765331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-02T09:28:06.765338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-02T09:28:06.765345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-02T09:28:06.765353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-02T09:28:06.765360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-02T09:28:06.765368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-02T09:28:06.765374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-02T09:28:06.765382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-02T09:28:06.765392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-02T09:28:06.765401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-02T09:28:06.765409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-02T09:28:06.765416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-02T09:28:06.765422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-02T09:28:06.765427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-02T09:28:06.765434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-02T09:28:06.765439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-02T09:28:06.765449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-02T09:28:06.765456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-02T09:28:06.765462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-02T09:28:06.765474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.765478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-02T09:28:06.765529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.765545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.765548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-02T09:28:06.765573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T09:28:06.765585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T09:28:06.765589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T09:28:06.765592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T09:28:06.765595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T09:28:06.766089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-02T09:28:06.766109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T09:28:06.766116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T09:28:06.766120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T09:28:06.766124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T09:28:06.766128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T09:28:06.766634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T09:28:06.766654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-02T09:28:06.766664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-02T09:28:06.766680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-02T09:28:06.766683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-02T09:28:06.766740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 4506428 count 2 nextOffset 22 batches 9
2025-10-02T09:28:06.766757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T09:28:06.766762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T09:28:06.766766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T09:28:06.766770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T09:28:06.766775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T09:28:06.767406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 6759626 count 3 nextOffset 23 batches 13
2025-10-02T09:28:06.767435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.767662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,3 HeadOffset 20 endOffset 20 curOffset 23 d0000000000_00000000000000000020_00000_0000000003_00012? size 6759616 WTime 1759397286766
2025-10-02T09:28:06.768617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.768671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-02T09:28:06.768723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-02T09:28:06.768744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-02T09:28:06.768761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-02T09:28:06.768777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-02T09:28:06.768794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-02T09:28:06.768894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6247582 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.768903Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.768913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-02T09:28:06.768920Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.768933Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 3 size 6759616
2025-10-02T09:28:06.770413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.769341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.769384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.769392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.769398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.769405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.769411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.769416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.772266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.772284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.772460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-02T09:28:06.772584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-02T09:28:06.772644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-02T09:28:06.772703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-02T09:28:06.772748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-02T09:28:06.772753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-02T09:28:06.772842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.772864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.773098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 27 }
2025-10-02T09:28:06.773116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 15
2025-10-02T09:28:06.773122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.775197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 25 to 25
2025-10-02T09:28:06.775504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.775522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-02T09:28:06.777216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.777578Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-10-02T09:28:06.777600Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.777611Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T09:28:06.777717Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.777730Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.778088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 23 }
2025-10-02T09:28:06.778102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 16
2025-10-02T09:28:06.778106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.778194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 14 }
2025-10-02T09:28:06.778198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 17
2025-10-02T09:28:06.778222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 9 }
2025-10-02T09:28:06.778225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 18
2025-10-02T09:28:06.778246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 39 queued_in_partition_duration_ms: 9 }
2025-10-02T09:28:06.778251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 19
2025-10-02T09:28:06.778271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 7 }
2025-10-02T09:28:06.778274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 20
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-02T09:28:06.600000Z WriteTime: 2025-10-02T09:28:06.635000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40444", "_ip": "ipv6:[::1]:40444", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.778254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.778426Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T09:28:06.778487Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# 8d97297a-679f1271-690f26fc-42d7ab81
2025-10-02T09:28:06.778504Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# ca549e8a-873b0938-1c9ad52e-ecee3b8c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.778521Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 14 ClientCommitOffset 0 committedOffset 0 Guid ca549e8a-873b0938-1c9ad52e-ecee3b8c
2025-10-02T09:28:06.778624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.779859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.779877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.779902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.779904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.779997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.780006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 6964702 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.780034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-02T09:28:06.780048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.780051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T09:28:06.780907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.780923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.780928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-02T09:28:06.780934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-02T09:28:06.780938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-02T09:28:06.780973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.782427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 26 to 26
2025-10-02T09:28:06.782746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.782762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-02T09:28:06.783461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.783477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00015?
2025-10-02T09:28:06.783485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00003_0000000003_00009?
2025-10-02T09:28:06.783489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 13519169 bytes (13519169)
2025-10-02T09:28:06.783492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T09:28:06.784137Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.783517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 7 size 524288 endOffset 20 max time lag 0ms effective offset 8
2025-10-02T09:28:06.783546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 0 count 2 last offset 7, current partition end offset: 20
2025-10-02T09:28:06.784262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-02T09:28:06.784281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T09:28:06.784284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 12 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.784287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 4
2025-10-02T09:28:06.784291Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.785108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.785118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.785202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-02T09:28:06.785255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-02T09:28:06.785315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-02T09:28:06.785374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-02T09:28:06.785404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-02T09:28:06.785409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-02T09:28:06.785433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T09:28:06.785437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00015?
2025-10-02T09:28:06.785453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00003_0000000003_00009?
2025-10-02T09:28:06.785464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T09:28:06.785473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295579 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.785491Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-02T09:28:06.785508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.785534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.785539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.785544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 3 count 3 parts_count 9 source 1 size 5223531 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.785549Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-02T09:28:06.785576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.785883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-02T09:28:06.785896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 15 suffix '63'
2025-10-02T09:28:06.785900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 3 count 3 parts 9 suffix '63'
2025-10-02T09:28:06.786416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.786851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.788156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 27 to 27
2025-10-02T09:28:06.788496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.788513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-02T09:28:06.790032Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.788702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 1 cbcount 2
2025-10-02T09:28:06.788873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.789018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.789177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.789387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:06.789541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.789699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.789857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.789929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T09:28:06.790606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-02T09:28:06.790705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:06.790710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000014_00000_0000000003_00015?
2025-10-02T09:28:06.790713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.790879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-02T09:28:06.791031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-02T09:28:06.791193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-02T09:28:06.795827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 28 to 28
2025-10-02T09:28:06.796145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.796163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-02T09:28:06.793712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988738
2025-10-02T09:28:06.793854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-02T09:28:06.794042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-02T09:28:06.794057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988738 WTime 1759397286793
2025-10-02T09:28:06.794274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-02T09:28:06.794284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-02T09:28:06.794427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-02T09:28:06.794562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-02T09:28:06.794708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-02T09:28:06.794901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-02T09:28:06.795586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-02T09:28:06.795601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-02T09:28:06.795749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-02T09:28:06.795895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-02T09:28:06.796038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-02T09:28:06.796099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-02T09:28:06.796578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-02T09:28:06.797276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T09:28:06.797292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T09:28:06.797294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T09:28:06.797304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000017_00003_0000000003_00009?
2025-10-02T09:28:06.797306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.797413Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.797843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T09:28:06.798529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T09:28:06.799963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 7988766 count 4 nextOffset 18 batches 15
2025-10-02T09:28:06.799980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T09:28:06.801439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 29 to 29
2025-10-02T09:28:06.801737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.801754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-02T09:28:06.801810Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.803481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988756
2025-10-02T09:28:06.803631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T09:28:06.803793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T09:28:06.804278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T09:28:06.804500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T09:28:06.804515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988756 WTime 1759397286803
2025-10-02T09:28:06.805760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 30 to 30
2025-10-02T09:28:06.806096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.806112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-02T09:28:06.806121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.806171Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.805227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-02T09:28:06.805246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T09:28:06.805428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T09:28:06.805611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T09:28:06.805839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T09:28:06.805927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T09:28:06.806547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-02T09:28:06.806636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,2 HeadOffset 10 endOffset 14 curOffset 20 d0000000000_00000000000000000018_00000_0000000002_00008| size 4506418 WTime 1759397286806
2025-10-02T09:28:06.808888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.808900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.808948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-02T09:28:06.808994Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.809006Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988738
2025-10-02T09:28:06.809017Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988756
2025-10-02T09:28:06.809024Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 2 size 4506418
2025-10-02T09:28:06.810915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-02T09:28:06.812426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.813858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 3 size 6759616 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.813882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.813904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.813913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-02T09:28:06.813928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-02T09:28:06.813935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-02T09:28:06.813945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-02T09:28:06.813968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-02T09:28:06.813976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-02T09:28:06.813984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-02T09:28:06.813989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.813994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-02T09:28:06.813996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-02T09:28:06.814002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-02T09:28:06.814011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-02T09:28:06.814029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-02T09:28:06.814036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-02T09:28:06.814042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-02T09:28:06.814050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.814054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-02T09:28:06.814104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.814118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.814120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T09:28:06.814143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T09:28:06.814160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T09:28:06.814164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T09:28:06.814168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T09:28:06.814171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T09:28:06.814242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-02T09:28:06.814249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T09:28:06.814731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2253230 count 1 nextOffset 24 batches 5
2025-10-02T09:28:06.814750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T09:28:06.814756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T09:28:06.814760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T09:28:06.814763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T09:28:06.814768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T09:28:06.814466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.814475Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 20 Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286635 CreateTimestampMS: 1759397286606 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759397286637 CreateTimestampMS: 1759397286612 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 10037034 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 20 StartOffset: 0 } Cookie: 8 }
2025-10-02T09:28:06.814832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.815359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4506428 count 2 nextOffset 25 batches 9
2025-10-02T09:28:06.815382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.815488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 23,2 HeadOffset 23 endOffset 23 curOffset 25 d0000000000_00000000000000000023_00000_0000000002_00008? size 4506418 WTime 1759397286815
2025-10-02T09:28:06.815207Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 20
2025-10-02T09:28:06.815234Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 20 ReadOffset 10 ReadGuid ca549e8a-873b0938-1c9ad52e-ecee3b8c has messages 1
2025-10-02T09:28:06.815282Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 20, WTime# 1759397286637, sizeLag# 10037034
2025-10-02T09:28:06.815285Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.815296Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# ca549e8a-873b0938-1c9ad52e-ecee3b8c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505940
2025-10-02T09:28:06.815303Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# ca549e8a-873b0938-1c9ad52e-ecee3b8c
2025-10-02T09:28:06.817944Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.819982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.820053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-02T09:28:06.820089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-02T09:28:06.820104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-02T09:28:06.820119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 6964702 cause it's been evicted from L2. Actual L1 size: 4
2025-10-02T09:28:06.820124Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.821002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.821026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.821115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-02T09:28:06.821179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-02T09:28:06.821240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-02T09:28:06.821371Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 4505940, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981652
2025-10-02T09:28:06.821514Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-02T09:28:06.821523Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 4505940 to budget
2025-10-02T09:28:06.821313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-02T09:28:06.821369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-02T09:28:06.821374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-02T09:28:06.821407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.821410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.821422Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.821442Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 2 size 4506418
2025-10-02T09:28:06.821452Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000002_00008?(+) to d0000000000_00000000000000000010_00000_0000000002_00008?(+)
2025-10-02T09:28:06.821455Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000002_00008?(+) to d0000000000_00000000000000000012_00000_0000000002_00008?(+)
2025-10-02T09:28:06.821457Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000003_00011|(+) to d0000000000_00000000000000000007_00001_0000000003_00011|(+)
2025-10-02T09:28:06.821467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.821493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.821566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-02T09:28:06.823967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 48 queued_in_partition_duration_ms: 21 }
2025-10-02T09:28:06.823984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 21
2025-10-02T09:28:06.823989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.822478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.822509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.822516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.822522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.824364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 31 to 31
2025-10-02T09:28:06.824675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.824689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-02T09:28:06.824524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.824924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.825355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.825713Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-10-02T09:28:06.825735Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.826222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 47 queued_in_partition_duration_ms: 17 }
2025-10-02T09:28:06.826234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 22
2025-10-02T09:28:06.826239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.826297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 47 queued_in_partition_duration_ms: 13 }
2025-10-02T09:28:06.826303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 23
2025-10-02T09:28:06.825902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.825921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.825991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-02T09:28:06.826042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-02T09:28:06.826170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-02T09:28:06.826287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-02T09:28:06.826326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-02T09:28:06.826329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-02T09:28:06.826356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.826359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.826368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.826391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.826402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-02T09:28:06.606000Z WriteTime: 2025-10-02T09:28:06.635000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40444", "server": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.826497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.828849Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-02T09:28:06.828867Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.828489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.828831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.829445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.829459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.829519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-02T09:28:06.829567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-02T09:28:06.829615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-02T09:28:06.829663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-02T09:28:06.829696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-02T09:28:06.829699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-02T09:28:06.829718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.829721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.829729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.829747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.829758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-02T09:28:06.830273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.832628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 32 to 32
2025-10-02T09:28:06.832103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.832632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.832884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.832903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.832980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-02T09:28:06.832997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.833011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-02T09:28:06.833069Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T09:28:06.833065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.833118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-02T09:28:06.833455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.833173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-02T09:28:06.833213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-02T09:28:06.833217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-02T09:28:06.833257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.833262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.833284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.833309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.833323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-02T09:28:06.835110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.835453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.835956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.835973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.836054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-02T09:28:06.836118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-02T09:28:06.836189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-02T09:28:06.836261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-02T09:28:06.836314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-02T09:28:06.836321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-02T09:28:06.836348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.836373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.836489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.836495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.836515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-02T09:28:06.836640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.838479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 33 to 33
2025-10-02T09:28:06.838777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.838790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-02T09:28:06.838583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.838911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.839017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.839033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.839197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-02T09:28:06.839265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-02T09:28:06.839474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-02T09:28:06.839538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-02T09:28:06.839578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-02T09:28:06.839586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-02T09:28:06.839606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.839631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.839875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.839882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.840128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.840508Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (9-9)
2025-10-02T09:28:06.840528Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T09:28:06.840539Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505940, ReadSizeServerDelta = -3981652
2025-10-02T09:28:06.840626Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.840638Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
2025-10-02T09:28:06.840068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-02T09:28:06.840789Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505940 } }
2025-10-02T09:28:06.840936Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# d5d4b812-abe2b284-3e1b1d5a-eb3410fc
2025-10-02T09:28:06.840969Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# 8f0a5828-c9e49aa9-2300f614-f6e220d0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.840996Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 20 ClientCommitOffset 0 committedOffset 0 Guid 8f0a5828-c9e49aa9-2300f614-f6e220d0
2025-10-02T09:28:06.841015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-02T09:28:06.612000Z WriteTime: 2025-10-02T09:28:06.637000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40444", "logtype": "unknown", "_ip": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.843112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.843467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.841202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.841215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.841260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 12 size 524288 endOffset 23 max time lag 0ms effective offset 10
2025-10-02T09:28:06.841291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 0 count 0 last offset 7, current partition end offset: 23
2025-10-02T09:28:06.841954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-02T09:28:06.841975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295579 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.841989Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-02T09:28:06.842012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.842352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-02T09:28:06.844936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-02T09:28:06.845967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.845976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.846067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-02T09:28:06.846137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-02T09:28:06.846213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-02T09:28:06.846279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-02T09:28:06.846373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-02T09:28:06.846378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-02T09:28:06.846402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.846405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.846498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-02T09:28:06.846521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.846540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.846556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.846560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.846564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 2 size 4506418 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.847112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-02T09:28:06.847137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.847141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T09:28:06.847235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-02T09:28:06.847244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-02T09:28:06.847250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 17 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-02T09:28:06.847253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-02T09:28:06.847258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T09:28:06.847262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-02T09:28:06.847918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.847926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000003_00012?
2025-10-02T09:28:06.847930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 6759616 bytes (6759616)
2025-10-02T09:28:06.847935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 6759616 (8388608)
2025-10-02T09:28:06.847947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-02T09:28:06.847952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.847971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 17 size 5223531 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T09:28:06.847974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.847976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 20 size 6759616 cause it's been evicted from L2. Actual L1 size: 4
2025-10-02T09:28:06.847980Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.848013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 1 size 26214400 endOffset 23 max time lag 0ms effective offset 10
2025-10-02T09:28:06.848030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 7988738 count 4 last offset 10, current partition end offset: 23
2025-10-02T09:28:06.848034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-02T09:28:06.848043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 4 count 4 parts_count 14 source 1 size 7988738 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.848070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0'
2025-10-02T09:28:06.848101Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-02T09:28:06.848119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:06.848087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.848487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-02T09:28:06.848540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 10
2025-10-02T09:28:06.851134Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 23 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286660 CreateTimestampMS: 1759397286620 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 6554530 RealReadOffset: 10 WaitQuotaTimeMs: 0 EndOffset: 23 StartOffset: 0 } Cookie: 10 }
2025-10-02T09:28:06.851442Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 11 endOffset 23
2025-10-02T09:28:06.851458Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 23 ReadOffset 11 ReadGuid 8f0a5828-c9e49aa9-2300f614-f6e220d0 has messages 1
2025-10-02T09:28:06.851478Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 11, endOffset# 23, WTime# 1759397286660, sizeLag# 6554530
2025-10-02T09:28:06.851481Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.851489Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# 8f0a5828-c9e49aa9-2300f614-f6e220d0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252979
2025-10-02T09:28:06.851496Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# 8f0a5828-c9e49aa9-2300f614-f6e220d0
2025-10-02T09:28:06.852823Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.853632Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 2252979, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728691
2025-10-02T09:28:06.851980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.852004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.852081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-02T09:28:06.852138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-02T09:28:06.852196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-02T09:28:06.852253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-02T09:28:06.853732Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-02T09:28:06.852285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-02T09:28:06.853750Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 2252979 to budget
2025-10-02T09:28:06.852291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-02T09:28:06.852328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.852352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.853450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 2 size 4506418 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.853463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.853482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.853489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-02T09:28:06.853500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.853503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-02T09:28:06.853509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-02T09:28:06.853516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-02T09:28:06.853528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-02T09:28:06.853539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-02T09:28:06.853545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-02T09:28:06.853551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-02T09:28:06.853557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-02T09:28:06.853563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.853566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-02T09:28:06.853612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.853627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.853629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (40)
2025-10-02T09:28:06.853646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T09:28:06.853654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T09:28:06.853656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T09:28:06.853658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T09:28:06.853661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T09:28:06.854054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2253230 count 1 nextOffset 26 batches 5
2025-10-02T09:28:06.854079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T09:28:06.854085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T09:28:06.854088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T09:28:06.854092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T09:28:06.854095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T09:28:06.854601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 4506428 count 2 nextOffset 27 batches 9
2025-10-02T09:28:06.854622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-02T09:28:06.854626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-02T09:28:06.854628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-02T09:28:06.854630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-02T09:28:06.854633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-02T09:28:06.855108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 6759626 count 3 nextOffset 28 batches 13
2025-10-02T09:28:06.855127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-02T09:28:06.855131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-02T09:28:06.855134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-02T09:28:06.855136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-02T09:28:06.856967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 29 partNo 3 result is x0000000000_00000000000000000025_00000_0000000003_00015? size 8295638
2025-10-02T09:28:06.856978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-02T09:28:06.856988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00000_0000000003_00015? new key d0000000000_00000000000000000025_00000_0000000003_00015? size 8295638 WTime 1759397286856
2025-10-02T09:28:06.857088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 3 PackedSize 717145 count 1 nextOffset 29 batches 2
2025-10-02T09:28:06.857094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-02T09:28:06.857097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-02T09:28:06.857099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-02T09:28:06.857102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-02T09:28:06.857104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-02T09:28:06.858110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 3 PackedSize 2970343 count 2 nextOffset 30 batches 6
2025-10-02T09:28:06.858121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-02T09:28:06.858125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-02T09:28:06.858130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-02T09:28:06.858132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-02T09:28:06.858134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-02T09:28:06.858598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 3 PackedSize 5223541 count 3 nextOffset 31 batches 10
2025-10-02T09:28:06.858608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-02T09:28:06.858612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-02T09:28:06.858615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-02T09:28:06.858618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-02T09:28:06.858620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-02T09:28:06.859159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 3 PackedSize 7476739 count 4 nextOffset 32 batches 14
2025-10-02T09:28:06.859171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-02T09:28:06.859190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-02T09:28:06.861640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 33 partNo 1 result is x0000000000_00000000000000000028_00003_0000000004_00014? size 7988760
2025-10-02T09:28:06.861660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-02T09:28:06.861667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-02T09:28:06.861672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-02T09:28:06.861684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00003_0000000004_00014? new key d0000000000_00000000000000000028_00003_0000000004_00014? size 7988760 WTime 1759397286861
2025-10-02T09:28:06.861950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 1 PackedSize 1741199 count 1 nextOffset 33 batches 4
2025-10-02T09:28:06.861972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.862066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,1 HeadOffset 25 endOffset 25 curOffset 33 d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189 WTime 1759397286861
2025-10-02T09:28:06.862316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000003_00012?
2025-10-02T09:28:06.862326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-02T09:28:06.862329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes (11266034)
2025-10-02T09:28:06.862331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T09:28:06.862378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-02T09:28:06.862418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-02T09:28:06.862537Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.862553Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 3 size 8295638
2025-10-02T09:28:06.862563Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 3 count 4 size 7988760
2025-10-02T09:28:06.862572Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 1 count 1 size 1741189
2025-10-02T09:28:06.862580Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000003_00015?(+) to d0000000000_00000000000000000014_00000_0000000003_00015?(+)
2025-10-02T09:28:06.862582Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00003_0000000003_00009?(+) to d0000000000_00000000000000000017_00003_0000000003_00009?(+)
2025-10-02T09:28:06.862584Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000004_00012|(+) to d0000000000_00000000000000000010_00004_0000000004_00012|(+)
2025-10-02T09:28:06.862592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T09:28:06.862596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000003_00012?
2025-10-02T09:28:06.862606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-02T09:28:06.862621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T09:28:06.862680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 20 partno 0 count 3 parts_count 12 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.862689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.862696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-02T09:28:06.862817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 2 parts 8 suffix '63'
2025-10-02T09:28:06.862826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 20 partno 0 count 3 parts_count 12
2025-10-02T09:28:06.863042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.863075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.863614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 39 queued_in_partition_duration_ms: 40 }
2025-10-02T09:28:06.863633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 24
2025-10-02T09:28:06.863639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.863736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 29 }
2025-10-02T09:28:06.863740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 25
2025-10-02T09:28:06.864819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 34 to 34
2025-10-02T09:28:06.865125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.865144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-02T09:28:06.866441Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.870364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.870522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 35 to 35
2025-10-02T09:28:06.870575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.870735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.870869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.870885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-02T09:28:06.870966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.870980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.871019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-02T09:28:06.872174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.871160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.872518Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-02T09:28:06.872538Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-02T09:28:06.872551Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252979, ReadSizeServerDelta = -1728691
2025-10-02T09:28:06.872648Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T09:28:06.872662Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-02T09:28:06.620000Z WriteTime: 2025-10-02T09:28:06.660000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40444", "server": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.873987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.874164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.874190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.874281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.874302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-02T09:28:06.874364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-02T09:28:06.874417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-02T09:28:06.874473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-02T09:28:06.874513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-02T09:28:06.874522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-02T09:28:06.874547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.874550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.874560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.874580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.874591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-02T09:28:06.874692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.875608Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252979 } }
2025-10-02T09:28:06.875692Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 got read request: guid# 244ffbc5-16dbfa8e-9973db59-c686e21c
2025-10-02T09:28:06.875711Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 performing read request: guid# 19b83d7f-d0d3c7d-495de9a5-ee4d130d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 14, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T09:28:06.875727Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 14 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 11 EndOffset 23 ClientCommitOffset 0 committedOffset 0 Guid 19b83d7f-d0d3c7d-495de9a5-ee4d130d
2025-10-02T09:28:06.877038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.877054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.877124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-02T09:28:06.877185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-02T09:28:06.877238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-02T09:28:06.877300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-02T09:28:06.877339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-02T09:28:06.877344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-02T09:28:06.877377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.877381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.877411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.877428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.878349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-02T09:28:06.878352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:06.878363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 20 count 3 size 6759616 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.878410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 14 size 524288 endOffset 25 max time lag 0ms effective offset 11
2025-10-02T09:28:06.878441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 2 blobs, size 7988756 count 7 last offset 14, current partition end offset: 25
2025-10-02T09:28:06.878559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-02T09:28:06.878567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T09:28:06.878854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-02T09:28:06.878862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:06.878866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000020_00000_0000000003_00012?
2025-10-02T09:28:06.878869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.879004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T09:28:06.879145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T09:28:06.879324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T09:28:06.879479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T09:28:06.879686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T09:28:06.880109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-02T09:28:06.880118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T09:28:06.880263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T09:28:06.880424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T09:28:06.880581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T09:28:06.883242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295660
2025-10-02T09:28:06.883469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T09:28:06.883484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295660 WTime 1759397286883
2025-10-02T09:28:06.883603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-02T09:28:06.883609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T09:28:06.883755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T09:28:06.883900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T09:28:06.884049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T09:28:06.884115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T09:28:06.884618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 2970343 count 2 nextOffset 23 batches 6
2025-10-02T09:28:06.884626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-02T09:28:06.884628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.884773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T09:28:06.885104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T09:28:06.885259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T09:28:06.885407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T09:28:06.885604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T09:28:06.886087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 5223541 count 3 nextOffset 24 batches 10
2025-10-02T09:28:06.886095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T09:28:06.886211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T09:28:06.886340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T09:28:06.886474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T09:28:06.886536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T09:28:06.886978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 7476739 count 4 nextOffset 25 batches 14
2025-10-02T09:28:06.887037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,4 HeadOffset 18 endOffset 20 curOffset 25 d0000000000_00000000000000000021_00003_0000000004_00013| size 7476729 WTime 1759397286886
2025-10-02T09:28:06.891543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.891560Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.891585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 4 count 4 parts_count 14 source 1 size 7988738 accessed 1 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.891589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 2 count 4 parts_count 14 source 1 size 7988756 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.891602Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 2 blobs are from cache.
2025-10-02T09:28:06.891645Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.891660Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295660
2025-10-02T09:28:06.891667Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7476729
2025-10-02T09:28:06.891686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-02T09:28:06.891690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0'
2025-10-02T09:28:06.891702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0'
2025-10-02T09:28:06.891922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 1 cbcount 2
2025-10-02T09:28:06.892076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.892221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.892366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.892561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-02T09:28:06.892708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.892870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.893029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.893231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-02T09:28:06.893382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.893522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.893669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.893740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-02T09:28:06.894274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-02T09:28:06.894459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.894599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.894808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-02T09:28:06.894968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.895112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.895268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.895483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-02T09:28:06.895652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.895823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.895992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.896205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-02T09:28:06.896354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.896504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.896651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:06.896739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-02T09:28:06.897142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 11
2025-10-02T09:28:06.910464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295638 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.910485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988760 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.910490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.910537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.910558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18023288 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.910566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-02T09:28:06.910575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-02T09:28:06.910577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.910580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-02T09:28:06.910585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-02T09:28:06.910587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T09:28:06.910591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-02T09:28:06.910591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-02T09:28:06.910594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-02T09:28:06.910600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:06.910600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-02T09:28:06.910606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-02T09:28:06.910613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-02T09:28:06.910618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-02T09:28:06.910624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-02T09:28:06.910629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-02T09:28:06.910635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-02T09:28:06.910643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-02T09:28:06.910651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-02T09:28:06.910656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-02T09:28:06.910663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-02T09:28:06.910668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-02T09:28:06.910676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-02T09:28:06.910688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-02T09:28:06.910694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-02T09:28:06.910700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-02T09:28:06.910707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-02T09:28:06.910715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-02T09:28:06.910729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-02T09:28:06.910735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-02T09:28:06.910740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-02T09:28:06.910746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-02T09:28:06.910751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-02T09:28:06.910756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-02T09:28:06.910762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-02T09:28:06.910768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-02T09:28:06.910774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-02T09:28:06.910779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-02T09:28:06.910785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-02T09:28:06.910793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-02T09:28:06.910798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-02T09:28:06.910803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-02T09:28:06.910810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-02T09:28:06.910815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-02T09:28:06.910821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-02T09:28:06.910826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-02T09:28:06.910831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.910836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-02T09:28:06.911273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.911292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.911294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T09:28:06.911328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-02T09:28:06.911358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-02T09:28:06.911364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-02T09:28:06.911367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-02T09:28:06.911370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-02T09:28:06.911848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 2253230 count 1 nextOffset 34 batches 5
2025-10-02T09:28:06.911870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-02T09:28:06.911876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-02T09:28:06.911879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-02T09:28:06.911882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-02T09:28:06.911885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-02T09:28:06.912432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 4506428 count 2 nextOffset 35 batches 9
2025-10-02T09:28:06.912459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.912564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 33,2 HeadOffset 33 endOffset 33 curOffset 35 d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418 WTime 1759397286912
2025-10-02T09:28:06.914499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.914573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-02T09:28:06.914577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 20 size 6759616 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T09:28:06.914580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.914583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 4506418 cause it's been evicted from L2. Actual L1 size: 4
2025-10-02T09:28:06.914587Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.914610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-02T09:28:06.914643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-02T09:28:06.914664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-02T09:28:06.914680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-02T09:28:06.914694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-02T09:28:06.914712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-02T09:28:06.914726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-02T09:28:06.914742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-02T09:28:06.914897Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.914912Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 2 size 4506418
2025-10-02T09:28:06.915269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.915736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 32 }
2025-10-02T09:28:06.915754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 26
2025-10-02T09:28:06.915759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.916064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 27 }
2025-10-02T09:28:06.916071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 27
2025-10-02T09:28:06.916122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 24 }
2025-10-02T09:28:06.916127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 28
2025-10-02T09:28:06.916153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 55 queued_in_partition_duration_ms: 21 }
2025-10-02T09:28:06.916155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 29
2025-10-02T09:28:06.916172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 20 }
2025-10-02T09:28:06.916175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 30
2025-10-02T09:28:06.916194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 52 queued_in_partition_duration_ms: 18 }
2025-10-02T09:28:06.916197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 31
2025-10-02T09:28:06.916221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 52 queued_in_partition_duration_ms: 13 }
2025-10-02T09:28:06.916224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 32
2025-10-02T09:28:06.916240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 6 }
2025-10-02T09:28:06.916243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 33
2025-10-02T09:28:06.917139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 36 to 36
2025-10-02T09:28:06.917467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.917482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-02T09:28:06.918718Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.919239Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 25 Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286661 CreateTimestampMS: 1759397286627 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286688 CreateTimestampMS: 1759397286634 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286689 CreateTimestampMS: 1759397286641 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 15 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286721 CreateTimestampMS: 1759397286649 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 16 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286722 CreateTimestampMS: 1759397286656 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 17 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286722 CreateTimestampMS: 1759397286665 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 18 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759397286723 CreateTimestampMS: 1759397286670 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 18446744073707299078 RealReadOffset: 17 WaitQuotaTimeMs: 0 EndOffset: 25 StartOffset: 0 } Cookie: 11 }
2025-10-02T09:28:06.921432Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 18 endOffset 25
2025-10-02T09:28:06.921473Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 25 ReadOffset 18 ReadGuid 19b83d7f-d0d3c7d-495de9a5-ee4d130d has messages 1
2025-10-02T09:28:06.921530Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 18, endOffset# 25, WTime# 1759397286723, sizeLag# 18446744073707299078
2025-10-02T09:28:06.921539Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1TEvPartitionReady. Aval parts: 0
2025-10-02T09:28:06.921556Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 read done: guid# 19b83d7f-d0d3c7d-495de9a5-ee4d130d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 15770637
2025-10-02T09:28:06.921571Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 response to read: guid# 19b83d7f-d0d3c7d-495de9a5-ee4d130d
2025-10-02T09:28:06.923078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 37 to 37
2025-10-02T09:28:06.923425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.923438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:06.925632Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.925467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.925844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.926510Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 Process answer. Aval parts: 1
2025-10-02T09:28:06.928676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 38 to 38
2025-10-02T09:28:06.925754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295660 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.925776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7476729 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.925795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.925799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T09:28:06.927134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.927143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-02T09:28:06.927147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000004_00014?
2025-10-02T09:28:06.927152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 16284398 bytes (16284398)
2025-10-02T09:28:06.927155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T09:28:06.927170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T09:28:06.927187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-02T09:28:06.927202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000004_00014?
2025-10-02T09:28:06.927215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T09:28:06.927227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.927231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 28 partno 3 count 4 parts_count 14 source 1 size 7988760 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.927240Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-02T09:28:06.927275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:06.927282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-02T09:28:06.927284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.927474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T09:28:06.927645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T09:28:06.929120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.929134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-02T09:28:06.928990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-02T09:28:06.929002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-02T09:28:06.929008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-02T09:28:06.929012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-02T09:28:06.929024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:203: PQ Cache (L2). Miss in touch. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 3 parts 15 suffix '63'
2025-10-02T09:28:06.929029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 4 parts 14 suffix '63'
2025-10-02T09:28:06.929544Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.930408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988760
2025-10-02T09:28:06.930562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T09:28:06.930719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T09:28:06.931244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T09:28:06.931266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988760 WTime 1759397286930
2025-10-02T09:28:06.931572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-02T09:28:06.931591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T09:28:06.931746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T09:28:06.931899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T09:28:06.932059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T09:28:06.932278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T09:28:06.933131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 39 to 39
2025-10-02T09:28:06.933424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.933436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-02T09:28:06.933488Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.934910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-02T09:28:06.934944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-02T09:28:06.935152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-02T09:28:06.935385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-02T09:28:06.936055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-02T09:28:06.936153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-02T09:28:06.936526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 40 to 40
2025-10-02T09:28:06.936835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.936847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-02T09:28:06.936897Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.937993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 6247595 count 3 nextOffset 28 batches 12
2025-10-02T09:28:06.938647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-02T09:28:06.938674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-02T09:28:06.938678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-02T09:28:06.938693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000004_00014?
2025-10-02T09:28:06.938697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:06.938911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-02T09:28:06.939143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 41 to 41
2025-10-02T09:28:06.939151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-02T09:28:06.939452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.939463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-02T09:28:06.939499Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.940701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295582
2025-10-02T09:28:06.940724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295582 WTime 1759397286940
2025-10-02T09:28:06.940752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-02T09:28:06.940762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-02T09:28:06.941394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-02T09:28:06.941670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-02T09:28:06.941901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-02T09:28:06.941972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 42 to 42
2025-10-02T09:28:06.942301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.942312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-02T09:28:06.942348Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.942779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-02T09:28:06.943366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-02T09:28:06.943388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-02T09:28:06.943543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-02T09:28:06.943714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-02T09:28:06.943888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-02T09:28:06.946521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 43 to 43
2025-10-02T09:28:06.944134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-02T09:28:06.944751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-10-02T09:28:06.944761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-02T09:28:06.944947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-02T09:28:06.945122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-02T09:28:06.945290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-02T09:28:06.945361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-02T09:28:06.945901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
2025-10-02T09:28:06.946057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-02T09:28:06.946149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,4 HeadOffset 21 endOffset 25 curOffset 32 d0000000000_00000000000000000028_00004_0000000004_00012| size 6964702 WTime 1759397286945
2025-10-02T09:28:06.948477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.948492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-02T09:28:06.948502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.948548Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.951478Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got ReadResponse, serverBytesSize = 15770637, now ReadSizeBudget = 0, ReadSizeServerDelta = -15246349
2025-10-02T09:28:06.951862Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-02T09:28:06.951874Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 15770637 to budget
2025-10-02T09:28:06.952348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.952837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 4
2025-10-02T09:28:06.952848Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.952881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.952888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.952917Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.952932Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988760
2025-10-02T09:28:06.952940Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295582
2025-10-02T09:28:06.952949Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 6964702
2025-10-02T09:28:06.953120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-02T09:28:06.953936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.953960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.953981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.953988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.953997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-02T09:28:06.954001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-02T09:28:06.954008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-02T09:28:06.954014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-02T09:28:06.954025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-02T09:28:06.954031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-02T09:28:06.954037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-02T09:28:06.954042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-02T09:28:06.954048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-02T09:28:06.954055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.954059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-02T09:28:06.954099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.954102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.954104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.954125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.954139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-02T09:28:06.954155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-02T09:28:06.954159Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.954164Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000003_00012?(+) to d0000000000_00000000000000000020_00000_0000000003_00012?(+)
2025-10-02T09:28:06.954166Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000002_00008?(+) to d0000000000_00000000000000000023_00000_0000000002_00008?(+)
2025-10-02T09:28:06.954167Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000002_00008|(+) to d0000000000_00000000000000000018_00000_0000000002_00008|(+)
2025-10-02T09:28:06.954235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:06.953313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.954469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.954490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.955245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.955747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.956569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 36 }
2025-10-02T09:28:06.956583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 34
2025-10-02T09:28:06.956588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:06.956656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 34 }
2025-10-02T09:28:06.956661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 35
2025-10-02T09:28:06.957011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 44 to 44
2025-10-02T09:28:06.957330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.957345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-02T09:28:06.957691Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-10-02T09:28:06.957710Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-02T09:28:06.957781Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-02T09:28:06.957805Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-02T09:28:06.627000Z WriteTime: 2025-10-02T09:28:06.661000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40444", "_ip": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:06.962258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.962285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.962369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-02T09:28:06.962437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-02T09:28:06.962498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-02T09:28:06.962559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-02T09:28:06.962604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-02T09:28:06.962609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-02T09:28:06.962642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.962646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.962753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.962776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.962848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-02T09:28:06.962860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.962877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.962887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.962897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.962900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T09:28:06.962926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-02T09:28:06.962936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-02T09:28:06.962940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-02T09:28:06.962944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-02T09:28:06.962947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-02T09:28:06.963477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 2253230 count 1 nextOffset 36 batches 5
2025-10-02T09:28:06.963492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.963607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 35,1 HeadOffset 35 endOffset 35 curOffset 36 d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220 WTime 1759397286963
2025-10-02T09:28:06.963879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:06.963893Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.963903Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 1 size 2253220
2025-10-02T09:28:06.964698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 45 to 45
2025-10-02T09:28:06.964955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.966775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:06.966788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-02T09:28:06.966796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:06.966841Z :NOTICE: [/Invalid] [/Invalid] [991da6ff-2b2499ad-ba6216b6-173233b8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:28926" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:28926. " }
2025-10-02T09:28:06.967793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.967811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.967891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-02T09:28:06.967945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-02T09:28:06.968003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-02T09:28:06.968071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-02T09:28:06.968111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-02T09:28:06.968115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-02T09:28:06.968244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.968266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.969842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.970170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.970417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.970432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.970488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-02T09:28:06.970911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.971542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.973454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.973863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.974760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.974786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.974907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-02T09:28:06.974996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-02T09:28:06.975088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-02T09:28:06.975157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-02T09:28:06.975215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-02T09:28:06.975222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-02T09:28:06.975250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.975254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.975266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.975294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.975308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-02T09:28:06.975431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.977490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.977891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.980565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.980589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.980660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-02T09:28:06.980716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-02T09:28:06.980769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-02T09:28:06.980847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-02T09:28:06.980888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-02T09:28:06.980893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-02T09:28:06.980918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.980921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.980933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.980956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.981077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.980971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-02T09:28:06.983115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.983567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.984737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.984755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.984845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-02T09:28:06.984895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-02T09:28:06.984950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-02T09:28:06.985003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-02T09:28:06.985038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-02T09:28:06.985042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-02T09:28:06.985075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.985081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.985091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.985109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.985219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-02T09:28:06.985460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.986132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988760 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.986139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295582 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.986144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 6964702 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.986156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.986163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.986165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T09:28:06.987170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.987189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:06.987197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:06.987200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-02T09:28:06.987201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:06.987204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 6247607 bytes (6247607)
2025-10-02T09:28:06.987205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-02T09:28:06.987209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 6247607 (8388608)
2025-10-02T09:28:06.987212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-02T09:28:06.987217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295582
2025-10-02T09:28:06.987219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:06.987223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-02T09:28:06.987226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-02T09:28:06.987238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:06.987238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:06.987245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.987253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-02T09:28:06.987258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.987264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-02T09:28:06.987266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.987271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-02T09:28:06.987274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.987279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-02T09:28:06.987284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T09:28:06.987289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-02T09:28:06.987315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:06.987332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:06.987334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-02T09:28:06.987355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-02T09:28:06.987365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-02T09:28:06.987369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-02T09:28:06.987372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-02T09:28:06.987375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-02T09:28:06.987785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-02T09:28:06.987905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:06.987802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-02T09:28:06.987809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-02T09:28:06.987812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-02T09:28:06.987816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-02T09:28:06.987819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-02T09:28:06.988232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:06.988272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-02T09:28:06.988295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-02T09:28:06.988305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-02T09:28:06.988310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-02T09:28:06.988314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-02T09:28:06.988322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-02T09:28:06.988784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 6759626 count 3 nextOffset 39 batches 13
2025-10-02T09:28:06.988827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-02T09:28:06.988833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-02T09:28:06.988836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-02T09:28:06.988840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-02T09:28:06.996577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 40 partNo 3 result is x0000000000_00000000000000000036_00000_0000000003_00015? size 8295638
2025-10-02T09:28:06.996609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-02T09:28:06.996629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000036_00000_0000000003_00015? new key d0000000000_00000000000000000036_00000_0000000003_00015? size 8295638 WTime 1759397286996
2025-10-02T09:28:06.996765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 1 NewHead: Offset 39 PartNo 3 PackedSize 717145 count 1 nextOffset 40 batches 2
2025-10-02T09:28:06.996784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:06.996905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,1 HeadOffset 36 endOffset 36 curOffset 40 d0000000000_00000000000000000039_00003_0000000001_00001? size 717135 WTime 1759397286996
2025-10-02T09:28:06.997033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:06.997045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:06.997048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:06.997051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:06.997056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:06.997094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7476729 cause it's been evicted from L2. Actual L1 size: 8
2025-10-02T09:28:06.997098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 1741189 cause it's been evicted from L2. Actual L1 size: 7
2025-10-02T09:28:06.997101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295660 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T09:28:06.997105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 7988760 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T09:28:06.997109Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T09:28:06.997155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-02T09:28:06.997931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.997941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.998016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-02T09:28:06.998060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-02T09:28:06.998106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-02T09:28:06.998154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-02T09:28:06.998181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-02T09:28:06.998184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-02T09:28:06.998213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:06.998217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:06.998227Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:06.998244Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 8295638
2025-10-02T09:28:06.998252Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 3 count 1 size 717135
2025-10-02T09:28:06.998258Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000003_00015?(+) to d0000000000_00000000000000000025_00000_0000000003_00015?(+)
2025-10-02T09:28:06.998261Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00003_0000000004_00014?(+) to d0000000000_00000000000000000028_00003_0000000004_00014?(+)
2025-10-02T09:28:06.998264Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000004_00013|(+) to d0000000000_00000000000000000021_00003_0000000004_00013|(+)
2025-10-02T09:28:06.998273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:06.998276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:06.998285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:06.998291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:06.998309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:06.998312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:06.998333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:06.998391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:06.998397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 33 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.998400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-02T09:28:06.000000Z
2025-10-02T09:28:06.998412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 3 from KV
2025-10-02T09:28:06.998421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-02T09:28:06.998472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63'
2025-10-02T09:28:06.998477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63'
2025-10-02T09:28:06.998482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:06.998819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:06.998849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:07.001165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:07.001457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:07.001523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 24 }
2025-10-02T09:28:07.001536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: acknoledged message 36
2025-10-02T09:28:07.001542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage got back to normal 20275218[B]
2025-10-02T09:28:07.001932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write 1 messages with Id from 46 to 46
2025-10-02T09:28:07.001993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:07.001403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.001418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.001492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-02T09:28:07.001555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-02T09:28:07.001609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-02T09:28:07.001668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-02T09:28:07.001706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-02T09:28:07.001710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-02T09:28:07.001737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.001740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.001750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:07.001772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:07.001784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-02T09:28:07.002195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: try to update token
2025-10-02T09:28:07.002207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-02T09:28:07.002214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T09:28:07.002568Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (12-12)
2025-10-02T09:28:07.002585Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-02T09:28:07.002637Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-10-02T09:28:07.002650Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-02T09:28:06.634000Z WriteTime: 2025-10-02T09:28:06.688000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:40444", "_ip": "ipv6:[::1]:40444" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T09:28:07.003963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.003984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.004090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-02T09:28:07.004025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:07.004404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:07.004152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-02T09:28:07.004212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-02T09:28:07.004282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-02T09:28:07.004322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-02T09:28:07.004329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-02T09:28:07.004371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T09:28:07.004389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:07.004743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.004753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.004768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-10-02T09:28:07.004771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:07.004780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553800765846503:2401]
2025-10-02T09:28:07.004825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:07.004845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:07.004851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.004853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:07.004981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-02T09:28:07.005132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-02T09:28:07.006212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
2025-10-02T09:28:07.177527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::CreateFormedBlob(unsigned int, bool)+2949 (0x240F8095)
NKikimr::NPQ::TPartitionedBlob::Add(NKikimr::NPQ::TClientBlob&&)+213 (0x240F87F5)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+3079 (0x241E0957)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x241E5D65)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:07.178419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-02T09:28:07.178869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_15989671363531563255_v1
2025-10-02T09:28:07.178893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.178900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.178904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.178908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.178911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.178915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.178918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.179467Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_15989671363531563255_v1
2025-10-02T09:28:07.178684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:07.179333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553805136331245:2503]
2025-10-02T09:28:07.179352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:07.180844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:07.180910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0
2025-10-02T09:28:07.181124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0 is DEAD
2025-10-02T09:28:07.185315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:07.185329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session will restart in 0.006646s
2025-10-02T09:28:07.185356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: Do CDS request
2025-10-02T09:28:07.185362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:07.193505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.194915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:07.194931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-02T09:28:07.195100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.195124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:07.195129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:07.195132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:07.195682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-02T09:28:07.195716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:07.195718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:07.195720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:07.195725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553809431298703:2511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:07.196300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553809431298703:2511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:07.199146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:07.199771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:07.199914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:07.199917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:07.199924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:07.199954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:07.199982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553809355781428:2433]
2025-10-02T09:28:07.200491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:07.200911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:07.200958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:07.201410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553809431298703:2511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:07.201284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:07.201367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.201369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.201374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.201375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.201376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.201377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.201378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00013|
2025-10-02T09:28:07.201379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.201380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.201382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.201383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-02T09:28:07.201384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000028_00003_0000000004_00014?
2025-10-02T09:28:07.201385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.201386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.201388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.201394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.201405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.201409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.201412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.201416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.201419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.201423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00013|
2025-10-02T09:28:07.201428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:579: replace key d0000000000_00000000000000000021_00003_0000000004_00013| to d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.201432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.201435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.201441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:602: ignore key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-02T09:28:07.201445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:592: ignore key d0000000000_00000000000000000028_00003_0000000004_00014?
2025-10-02T09:28:07.201449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.201453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.201456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.201465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.201473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.201478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.201486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.201491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.201497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.201502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.201507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.201511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.201517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.201523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.201528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.201534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00013|
2025-10-02T09:28:07.201540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000021_00003_0000000004_00013| will be deleted
2025-10-02T09:28:07.201543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.201549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.201553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-02T09:28:07.201559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000025_00000_0000000003_00015? will be deleted
2025-10-02T09:28:07.201561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.201566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.201570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000004_00014?
2025-10-02T09:28:07.201574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000028_00003_0000000004_00014? will be deleted
2025-10-02T09:28:07.201576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.201581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.201585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.201590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.201595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.201598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.201602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.201606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.201640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:07.211725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553809431298703:2511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:07.211747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553809431298703:2511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:07.211750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553809431298703:2511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:07.211758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:07.220683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:07.224577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-02T09:28:07.224617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-02T09:28:07.226621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 36 sessionId: src_id|11825c05-5e831cb9-89eddbfd-223349d9_0
2025-10-02T09:28:07.223851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:07.223876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:07.223880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:07.223884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:07.223892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7556553809355781428:2433]
2025-10-02T09:28:07.223912Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:07.223932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:07.223935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.223938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.223940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.223975Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:07.223982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:07.223989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:07.224036Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:07.224043Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00003_0000000004_00014?(+) to d0000000000_00000000000000000028_00003_0000000004_00014?(+)
2025-10-02T09:28:07.224045Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000003_00015?(+) to d0000000000_00000000000000000025_00000_0000000003_00015?(+)
2025-10-02T09:28:07.224048Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000004_00013|(+) to d0000000000_00000000000000000021_00003_0000000004_00013|(+)
2025-10-02T09:28:07.224091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.224093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.224096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.224099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:07.224101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:07.224218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:07.224221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.224232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.224243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.224259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:07.224288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298685:2446], now have 1 active actors on pipe
2025-10-02T09:28:07.224291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298755:2511], now have 1 active actors on pipe
2025-10-02T09:28:07.224296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.224302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.224305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.224315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:07.224327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:07.224331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:07.224335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:07.224338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:07.224341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:07.224344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:07.224499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.224502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:07.224515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:07.225443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.225458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.225483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11825c05-5e831cb9-89eddbfd-223349d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:07.225492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:07.225650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:07.225663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:07.225670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.225674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.225677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:07.225686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.225696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:07.225703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:07.225710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.226480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.226484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.226499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.229110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61943e6b-a1c08fe0-a6c79808-4e2378c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|11825c05-5e831cb9-89eddbfd-223349d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:07.240377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:07.240399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:07.240407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.240453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:07.240655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:07.240829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:07.240976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:07.241121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:07.241318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:07.241357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:07.242062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-02T09:28:07.242074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:07.248244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Write session: try to update token
2025-10-02T09:28:07.248267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:07.256779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:07.256862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:07.256872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:07.256874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:07.256884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.256888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.256893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553809355781423:2433]
2025-10-02T09:28:07.256939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:07.256944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.256949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:07.257104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:07.260870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:07.260891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:07.260895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:07.279672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553809431298766:2503]
2025-10-02T09:28:07.281014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7556553809431298766:2503]
2025-10-02T09:28:07.308340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|11825c05-5e831cb9-89eddbfd-223349d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:07.327973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:07.404286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:07.404754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298766:2503], now have 1 active actors on pipe
2025-10-02T09:28:07.404767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.404771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.405186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.404997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:07.405008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:07.405080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: error at write: Disconnected sessionId: src_id|11825c05-5e831cb9-89eddbfd-223349d9_0
2025-10-02T09:28:07.405270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|11825c05-5e831cb9-89eddbfd-223349d9_0 is DEAD
2025-10-02T09:28:07.405392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:07.405419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553809431298766:2503]
2025-10-02T09:28:07.407146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:07.407160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Write session will restart in 0.005351s
2025-10-02T09:28:07.407199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Write session: Do CDS request
2025-10-02T09:28:07.407205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:07.413658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.413794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:07.414429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:07.414577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:07.414584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:07.414592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:07.414635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:07.414681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553809355781525:2445]
2025-10-02T09:28:07.415197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:07.415651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:07.415695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:07.415958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:07.416005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.416006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.416006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.416007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.416007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.416008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.416008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.416009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.416010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.416010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.416011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.416011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.416015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.416021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.416024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.416026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.416028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.416031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.416032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.416034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.416036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.416039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.416042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.416044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.416048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.416052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.416057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.416060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.416062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.416065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.416068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.416071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.416073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.416075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.416078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.416080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.416082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.416085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.416088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.416091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.416094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.416096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.416098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.416102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.416104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.416106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.416109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.416112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.416135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:07.413711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:07.413727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-02T09:28:07.413882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.413905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:07.413910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:07.413914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:07.414350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-02T09:28:07.414378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:07.414380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:07.414381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:07.414386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553809431298812:2523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:07.414868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553809431298812:2523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:07.417550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553809431298812:2523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:07.427788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553809431298812:2523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:07.427803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553809431298812:2523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:07.427807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553809431298812:2523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:07.427815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:07.434435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:07.436282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:07.436303Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:07.436305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:07.436309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:07.436315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [2:7556553809355781525:2445]
2025-10-02T09:28:07.436329Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:07.436349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:07.436352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.436355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.436358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.436371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:07.436376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:07.436382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:07.436444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.436452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.436454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.436457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:07.436459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:07.436535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:07.436541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.436556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.436569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.436587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:07.436610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298846:2523], now have 1 active actors on pipe
2025-10-02T09:28:07.436617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298793:2446], now have 1 active actors on pipe
2025-10-02T09:28:07.436623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.436625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.436627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.436638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:07.436655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:07.436660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:07.436663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:07.436666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:07.436672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:07.436675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:07.436709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.436721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:07.436733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:07.437180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.437193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.437222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:07.437235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.437240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.437247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:07.437257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.437268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:07.437292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.437705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.437716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.437738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.439021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11825c05-5e831cb9-89eddbfd-223349d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:07.436978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3
2025-10-02T09:28:07.437010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3
2025-10-02T09:28:07.437857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 36 sessionId: src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0
2025-10-02T09:28:07.441976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Write session: try to update token
2025-10-02T09:28:07.441993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:07.456266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:07.456284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:07.456287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:07.456289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:07.456296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.456301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.456304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553809355781519:2445]
2025-10-02T09:28:07.456347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:07.456355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.456355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:07.456357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:07.456362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:07.456366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:07.456558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:07.469494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:07.472133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:07.475005Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:17:0
2025-10-02T09:28:07.475028Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:28:07.504958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553809431298854:2503]
2025-10-02T09:28:07.505644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7556553809431298854:2503]
2025-10-02T09:28:07.623751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:07.624089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.624108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.624132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298854:2503], now have 1 active actors on pipe
2025-10-02T09:28:07.624513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553809431298854:2503]
2025-10-02T09:28:07.624550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:07.624553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:07.624371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.624683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: error at write: Disconnected sessionId: src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0
2025-10-02T09:28:07.624901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0 is DEAD
2025-10-02T09:28:07.624901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:07.625077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:07.625090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Write session will restart in 0.009796s
2025-10-02T09:28:07.625117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Write session: Do CDS request
2025-10-02T09:28:07.625123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:07.636905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.637593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:07.637609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-02T09:28:07.637883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.637922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:07.637927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:07.637932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:07.638425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-02T09:28:07.638467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:07.638468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:07.638471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:07.638478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553809431298875:2527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:07.639050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553809431298875:2527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:07.641097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553809431298875:2527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:07.646304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553809431298875:2527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:07.646330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553809431298875:2527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:07.646334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553809431298875:2527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:07.646344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:07.645707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:07.646198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:07.646371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:07.646374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:07.646384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:07.646431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:07.646465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553809355781600:2451]
2025-10-02T09:28:07.647051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:07.647359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:07.647392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:07.647660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:07.647702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.647703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.647703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.647704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.647705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.647705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.647706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.647707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.647707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.647708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.647709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.647709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.647713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.647721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.647723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.647727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.647730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.647732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.647734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.647738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.647741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.647745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.647748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.647751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.647757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.647764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.647770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.647775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.647778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.647781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.647786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.647788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.647791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.647794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.647796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.647798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.647801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.647804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.647806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.647809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.647811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.647815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.647817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.647820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.647823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.647826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.647829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.647833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.647851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:07.662580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:07.665640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:07.665664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:07.665667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:07.665672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:07.665681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [2:7556553809355781600:2451]
2025-10-02T09:28:07.665698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:07.665720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:07.665724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.665727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.665729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.665749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:07.665755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:07.665763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:07.665842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.665849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.665852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.665855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:07.665858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:07.665943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:07.665952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.665968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.665983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.665997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:07.666021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.666023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.666027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.666035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:07.666051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:07.666054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:07.666057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:07.666059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:07.666071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:07.666073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:07.666086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298857:2446], now have 1 active actors on pipe
2025-10-02T09:28:07.666089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298911:2527], now have 1 active actors on pipe
2025-10-02T09:28:07.666128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.666136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:07.666145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:07.666396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.666410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.666442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f718f93-872fec73-d88651e4-ccee0d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:07.666455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.666459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.666461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:07.666473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.666487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:07.666512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.667635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.667651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.667689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.666160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 4
2025-10-02T09:28:07.666209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 4
2025-10-02T09:28:07.667877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f718f93-872fec73-d88651e4-ccee0d5_0
2025-10-02T09:28:07.669847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da952cb-86c4e95b-8cda0be8-42a414af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f718f93-872fec73-d88651e4-ccee0d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:07.672686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Write session: try to update token
2025-10-02T09:28:07.672705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:07.681754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:07.681776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:07.681779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:07.681781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:07.681794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.681799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.681803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553809355781594:2451]
2025-10-02T09:28:07.681850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:07.681856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.681859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:07.681867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:07.681882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:07.681886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:07.682192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:07.695327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|6f718f93-872fec73-d88651e4-ccee0d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:07.698331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:07.724620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553809431298929:2503]
2025-10-02T09:28:07.724916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7556553809431298929:2503]
2025-10-02T09:28:07.841913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:07.842257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.842276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.842324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298929:2503], now have 1 active actors on pipe
2025-10-02T09:28:07.842538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:07.842605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:07.842606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553809431298929:2503]
2025-10-02T09:28:07.842639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:07.842713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f718f93-872fec73-d88651e4-ccee0d5_0
2025-10-02T09:28:07.842902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|6f718f93-872fec73-d88651e4-ccee0d5_0 is DEAD
2025-10-02T09:28:07.843147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:07.843162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Write session will restart in 0.006745s
2025-10-02T09:28:07.843197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Write session: Do CDS request
2025-10-02T09:28:07.843206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:07.850151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:07.850817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:07.851026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:07.851035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:07.851046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:07.851095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:07.851137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553809355781664:2455]
2025-10-02T09:28:07.851444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.851535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:07.851553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-02T09:28:07.851672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:07.851715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:07.851726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:07.851730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:07.851785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:07.852076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:07.852123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:07.852255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-02T09:28:07.852295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:07.852310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:07.852312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:07.852318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553809431298957:2532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:07.852437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:07.852492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.852497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.852498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.852499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.852500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.852501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.852502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.852503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.852504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.852505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.852506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.852507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.852513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.852532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.852536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.852540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.852544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.852548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.852552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.852558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.852562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.852566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.852574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.852578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.852586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.852594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:07.852611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.852616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:07.852621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.852626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:07.852630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.852635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:07.852640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.852645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:07.852649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.852654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:07.852659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.852665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:07.852669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.852674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:07.852678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.852684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:07.852689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.852693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.852703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.852707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.852712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.852747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:07.852925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553809431298957:2532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:07.855027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553809431298957:2532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:07.861800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553809431298957:2532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:07.861820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553809431298957:2532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:07.861826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553809431298957:2532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:07.861837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:07.863327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:07.865655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:07.865677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:07.865679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:07.865683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:07.865693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [2:7556553809355781664:2455]
2025-10-02T09:28:07.865712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:07.865731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:07.865738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.865741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.865744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.865762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:07.865770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:07.865783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:07.865844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.865852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.865854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.865858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:07.865860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:07.865933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:07.865940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.865956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:07.865982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:07.866005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:07.866033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298934:2446], now have 1 active actors on pipe
2025-10-02T09:28:07.866041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431298993:2532], now have 1 active actors on pipe
2025-10-02T09:28:07.866050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.866052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.866054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.866069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:07.866097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 5
2025-10-02T09:28:07.866088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:07.866110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 5
2025-10-02T09:28:07.866087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:07.866091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:07.866094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:07.866107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:07.866110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:07.866148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.866154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:07.866161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:07.866171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.866175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.866227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85a52d3e-80543d55-ce42a775-8e578598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:07.866240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:07.866244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:07.866245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:07.866255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:07.866264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:07.866288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.866439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:07.866463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:07.866490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:07.866589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 36 sessionId: src_id|85a52d3e-80543d55-ce42a775-8e578598_0
2025-10-02T09:28:07.866976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f718f93-872fec73-d88651e4-ccee0d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85a52d3e-80543d55-ce42a775-8e578598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:07.870253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Write session: try to update token
2025-10-02T09:28:07.870278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:07.878939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:07.878960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:07.878962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:07.878964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:07.878974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.878978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.878984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553809355781659:2455]
2025-10-02T09:28:07.879033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:07.879035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:07.879042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:07.879044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:07.879047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:07.879051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:07.880340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:07.894020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|85a52d3e-80543d55-ce42a775-8e578598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:07.898612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:07.942726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553809431299001:2503]
2025-10-02T09:28:07.943017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7556553809431299001:2503]
2025-10-02T09:28:08.026064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:08.026363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.026378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.026400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553809431299001:2503], now have 1 active actors on pipe
2025-10-02T09:28:08.026638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:08.026694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553809431299001:2503]
2025-10-02T09:28:08.026720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:08.026799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85a52d3e-80543d55-ce42a775-8e578598_0
2025-10-02T09:28:08.026996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|85a52d3e-80543d55-ce42a775-8e578598_0 is DEAD
2025-10-02T09:28:08.027110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:08.026594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:08.027121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Write session will restart in 0.008352s
2025-10-02T09:28:08.027254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Write session: Do CDS request
2025-10-02T09:28:08.027282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:08.033653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:08.034120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:08.034323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:08.034340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:08.034351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:08.034417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:08.034460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553813650749021:2457]
2025-10-02T09:28:08.035081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:08.035370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:08.035413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:08.035718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:08.035774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.035781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.035782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.035783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.035783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.035785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.035786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.035787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.035788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.035789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.035790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.035791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.035797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.035809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.035812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.035815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.035819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.035822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.035825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.035828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.035831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.035835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.035840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.035843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.035849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.035857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.035862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.035867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.035870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.035875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.035878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.035883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.035888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.035894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.035898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.035904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.035909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.035915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.035920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.035925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.035931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.035935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.035940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.035948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.035952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.035956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.035960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.035966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.036001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:08.036321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.036933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:08.036946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-02T09:28:08.037083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.037114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:08.037124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:08.037128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:08.037555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-02T09:28:08.037590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:08.037596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:08.037597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:08.037604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553813726266325:2536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:08.038153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553813726266325:2536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:08.040713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553813726266325:2536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:08.044565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553813726266325:2536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:08.044581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553813726266325:2536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:08.044585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553813726266325:2536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:08.044595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:08.045395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:08.047476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:08.047492Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:08.047494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:08.047502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:08.047509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [2:7556553813650749021:2457]
2025-10-02T09:28:08.047523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:08.047541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:08.047544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.047547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.047549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.047567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:08.047572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:08.047580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:08.047642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.047648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.047650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.047654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:08.047656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:08.047721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:08.047731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.047745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.047756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.047772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:08.047797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266299:2446], now have 1 active actors on pipe
2025-10-02T09:28:08.047804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266360:2536], now have 1 active actors on pipe
2025-10-02T09:28:08.047811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.047813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.047815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.047828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:08.047846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:08.047854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:08.047863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:08.047863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:08.047865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:08.047867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:08.047866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 6
2025-10-02T09:28:08.047902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.047913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:08.047912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 6
2025-10-02T09:28:08.047938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:08.047968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.047976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.047999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:08.048009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.048012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.048014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:08.048024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.048036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:08.048053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.048158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.048164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.048176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.048271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 36 sessionId: src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0
2025-10-02T09:28:08.048582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a52d3e-80543d55-ce42a775-8e578598_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:08.051782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Write session: try to update token
2025-10-02T09:28:08.051799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:08.066125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:08.066147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.066159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.066218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:08.066225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:08.066403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:08.066559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.066718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.066869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.067108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:08.067158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:08.070570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:08.070590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.070593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:08.070595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:08.070604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.070607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.070614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553813650749016:2457]
2025-10-02T09:28:08.070654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:08.070661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.070664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:08.070666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:08.070671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:08.070675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:08.070839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:08.070937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:08.073949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:08.127050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553813726266370:2503]
2025-10-02T09:28:08.127349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7556553813726266370:2503]
2025-10-02T09:28:08.225441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:08.225751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.225769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.225791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266370:2503], now have 1 active actors on pipe
2025-10-02T09:28:08.225959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:08.225971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553813726266370:2503]
2025-10-02T09:28:08.225999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:08.226001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:08.225990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:08.226077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: error at write: Disconnected sessionId: src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0
2025-10-02T09:28:08.226263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0 is DEAD
2025-10-02T09:28:08.226438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:08.226446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Write session will restart in 0.008278s
2025-10-02T09:28:08.226475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Write session: Do CDS request
2025-10-02T09:28:08.226482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:08.233997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:08.234467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:08.234650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:08.234660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:08.234670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:08.234716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:08.234754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553813650749098:2461]
2025-10-02T09:28:08.235392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:08.235704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:08.235758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:08.236089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:08.236158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.236166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.236167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.236168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.236172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.236173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.236173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.236175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.236176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.236177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.236178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.236179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.236184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.236196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.236199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.236203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.236207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.236212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.236215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.236219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.236223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.236227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.236231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.236234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.236241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.236249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.236256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.236261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.236265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.236272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.236276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.236280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.236284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.236290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.236294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.236301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.236305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.236311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.236316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.236321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.236326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.236332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.236336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.236342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.236347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.236353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.236357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.236363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.236368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.236397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:08.236500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:08.236515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-02T09:28:08.236685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.236717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:08.236727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:08.236731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:08.237212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-02T09:28:08.237260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:08.237267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:08.237269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:08.237275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553813726266412:2542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:08.237850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553813726266412:2542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:08.240525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553813726266412:2542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:08.245198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553813726266412:2542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:08.245214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553813726266412:2542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:08.245218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553813726266412:2542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:08.245226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:08.245807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:08.247561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:08.247583Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:08.247587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:08.247592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:08.247599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [2:7556553813650749098:2461]
2025-10-02T09:28:08.247614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:08.247631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:08.247634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.247638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.247641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.247654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:08.247659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:08.247666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:08.247729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.247740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.247742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.247745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:08.247748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:08.247821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:08.247830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.247845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.247863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.247887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:08.247912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266447:2542], now have 1 active actors on pipe
2025-10-02T09:28:08.247923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266385:2446], now have 1 active actors on pipe
2025-10-02T09:28:08.247929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.247932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.247934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.247948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:08.247968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:08.247968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:08.247973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:08.247975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:08.247988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:08.247991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:08.247968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 7
2025-10-02T09:28:08.248023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.248014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 7
2025-10-02T09:28:08.248032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:08.248038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:08.248058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.248062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.248094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e51e863a-11373591-c16dff60-3555eff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:08.248110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.248114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.248116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:08.248126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.248135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:08.248154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.248328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.248341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.248362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.248460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 36 sessionId: src_id|e51e863a-11373591-c16dff60-3555eff_0
2025-10-02T09:28:08.248833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1205e-6dfb6c7e-9edabb65-5cb42511_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e51e863a-11373591-c16dff60-3555eff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:08.252008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Write session: try to update token
2025-10-02T09:28:08.252033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:08.260776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:08.260795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.260798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:08.260816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:08.260825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.260830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.260834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553813650749093:2461]
2025-10-02T09:28:08.260872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:08.260880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.260882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:08.260887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:08.260894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:08.260900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:08.261029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:08.279575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|e51e863a-11373591-c16dff60-3555eff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:08.282614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:08.326252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553813726266454:2503]
2025-10-02T09:28:08.326640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7556553813726266454:2503]
2025-10-02T09:28:08.410307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:08.411489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.411515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.411581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266454:2503], now have 1 active actors on pipe
2025-10-02T09:28:08.411912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:08.411990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:08.411997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:08.412093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: error at write: Disconnected sessionId: src_id|e51e863a-11373591-c16dff60-3555eff_0
2025-10-02T09:28:08.412336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|e51e863a-11373591-c16dff60-3555eff_0 is DEAD
2025-10-02T09:28:08.412381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:08.412619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:08.412643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Write session will restart in 0.009431s
2025-10-02T09:28:08.412687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Write session: Do CDS request
2025-10-02T09:28:08.412693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:08.412833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553813726266454:2503]
2025-10-02T09:28:08.421306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:08.421864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:08.422149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:08.422163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:08.422175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:08.422241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:08.422280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553813650749161:2463]
2025-10-02T09:28:08.422953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:08.423292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:08.423344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:08.423400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.423550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:08.423562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-02T09:28:08.423668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.423693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:08.423704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:08.423708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:08.423830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:08.423911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.423919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.423920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.423921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.423922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.423937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.423938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.423939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.423940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.423941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.423942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.423943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.423949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.423958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.423962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.423966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.423970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.423974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.423978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.423982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.423986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.423991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.423995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.424000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.424007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.424015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.424021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.424027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.424031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.424037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.424041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.424046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.424051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.424056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.424068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.424073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.424083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.424088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.424096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.424101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.424110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.424115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.424119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.424128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.424133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.424141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.424157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.424167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.424213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:08.424324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-02T09:28:08.424362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:08.424367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:08.424369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:08.424375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553813726266497:2552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:08.424960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553813726266497:2552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:08.427614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553813726266497:2552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:08.433359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553813726266497:2552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:08.433373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553813726266497:2552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:08.433376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553813726266497:2552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:08.433383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:08.434026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:08.439512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:08.439536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:08.439539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:08.439543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:08.439549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [2:7556553813650749161:2463]
2025-10-02T09:28:08.439561Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:08.439578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:08.439581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.439584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.439586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.439603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:08.439608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:08.439615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:08.439698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.439707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.439709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.439712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:08.439714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:08.439812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:08.439819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.439833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.439848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.439868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:08.439888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266532:2552], now have 1 active actors on pipe
2025-10-02T09:28:08.439907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266457:2446], now have 1 active actors on pipe
2025-10-02T09:28:08.439913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.439916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.439926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.439940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:08.439957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:08.439972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:08.439943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 8
2025-10-02T09:28:08.439975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:08.439978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:08.439977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 8
2025-10-02T09:28:08.439984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:08.439987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:08.440031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.440039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.440051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.440062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:08.440085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:08.440114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:08.440124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.440129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.440134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:08.440143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.440160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:08.440195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.440360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.440369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.440383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.440463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0
2025-10-02T09:28:08.440885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e51e863a-11373591-c16dff60-3555eff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:08.452719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:08.452741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.452743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:08.452754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:08.452761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.452765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.452768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553813650749156:2463]
2025-10-02T09:28:08.452831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:08.452835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:08.452841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:08.452845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.452845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:08.452847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:08.453547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:08.454011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Write session: try to update token
2025-10-02T09:28:08.454028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:08.491344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:08.494510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:08.513083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553813726266549:2503]
2025-10-02T09:28:08.513353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7556553813726266549:2503]
2025-10-02T09:28:08.616207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:08.616683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.616699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.616716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266549:2503], now have 1 active actors on pipe
2025-10-02T09:28:08.617123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553813726266549:2503]
2025-10-02T09:28:08.617181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:08.617132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:08.617166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:08.617169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:08.617235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: error at write: Disconnected sessionId: src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0
2025-10-02T09:28:08.617462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0 is DEAD
2025-10-02T09:28:08.617713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:08.617729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Write session will restart in 0.008483s
2025-10-02T09:28:08.617759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Write session: Do CDS request
2025-10-02T09:28:08.617765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:08.625723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:08.626157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:08.626334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:08.626344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:08.626354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:08.626400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:08.626455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553813650749261:2477]
2025-10-02T09:28:08.627056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:08.627419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:08.627460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:08.627504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.627595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:08.627607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-02T09:28:08.627779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:08.627805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.627849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.627854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.627855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.627855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.627856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.627857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.627859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.627871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:08.627860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.627861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.627883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:08.627861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.627889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:08.627862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.627862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.627866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.627872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.627875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.627877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.627879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.627881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.627883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.627885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.627887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.627889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.627892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.627894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.627899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.627903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.627918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.627926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.627928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.627936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.627938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.627969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.627971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.627974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.627976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.627979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.627981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.627985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.627987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.627990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.627992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.627995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.627997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.628000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.628002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.628005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.628007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.628010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.628028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:08.628455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-02T09:28:08.628502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:08.628511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:08.628513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:08.628521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553813726266581:2557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:08.629199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553813726266581:2557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:08.631397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553813726266581:2557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:08.638833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553813726266581:2557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:08.638850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553813726266581:2557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:08.638854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553813726266581:2557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:08.638862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:08.640522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:08.642631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:08.642650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:08.642653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:08.642657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:08.642663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [2:7556553813650749261:2477]
2025-10-02T09:28:08.642692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:08.642714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:08.642721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.642724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.642727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.642741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:08.642746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:08.642753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:08.642827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.642832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.642834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.642839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:08.642840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:08.642907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:08.642919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.642941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.642952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.642968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:08.642989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266616:2557], now have 1 active actors on pipe
2025-10-02T09:28:08.642997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266552:2446], now have 1 active actors on pipe
2025-10-02T09:28:08.643004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.643026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.643033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.643044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:08.643058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:08.643069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:08.643072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:08.643075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:08.643075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:08.643078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:08.643070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 9
2025-10-02T09:28:08.643086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 9
2025-10-02T09:28:08.643115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.643125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:08.643132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:08.643294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.643303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.643327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:08.643337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.643341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.643344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:08.643354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.643367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:08.643395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.643582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.643593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.643606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.643697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0
2025-10-02T09:28:08.644077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d23221b-77e4a5b8-fb5c09ee-c8c564b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:08.646844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Write session: try to update token
2025-10-02T09:28:08.646861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:08.658677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:08.658693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.658699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.658732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:08.658754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:08.658896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:08.659062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.659359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.659522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.659739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:08.659773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:08.669433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:08.672381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:08.676297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.676319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.676339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:08.676342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.676344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:08.676349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:08.676356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.676360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.676363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553813650749256:2477]
2025-10-02T09:28:08.676407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:08.676412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:08.676416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.676417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:08.676419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:08.676420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:08.676584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:08.717378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553813726266629:2503]
2025-10-02T09:28:08.717641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7556553813726266629:2503]
2025-10-02T09:28:08.819887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:08.820186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:08.820221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266629:2503], now have 1 active actors on pipe
2025-10-02T09:28:08.820353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:08.820457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553813726266629:2503]
2025-10-02T09:28:08.820487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:08.828097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:08.828571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:08.828705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:08.828713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:08.828722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:08.828757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:08.828825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553813650749330:2481]
2025-10-02T09:28:08.829427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:08.829695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:08.829731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:08.830021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:08.830063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.830064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.830065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.830066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.830067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.830068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.830069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.830070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.830071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.830072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.830073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.830074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.830078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.830087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.830091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.830094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.830097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.830101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.830104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.830107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.830110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.830114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.830117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.830120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.830128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.830134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:08.830138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.830143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:08.830146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.830151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:08.830155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.830159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:08.830163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.830167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:08.830171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.830176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:08.830182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.830186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:08.830189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.830193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:08.830197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.830202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:08.830205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.830210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.830214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.830218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.830222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.830226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.830256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:08.842777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:08.844603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:08.844617Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:08.844620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:08.844624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:08.844631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [2:7556553813650749330:2481]
2025-10-02T09:28:08.844645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:08.844664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:08.844667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.844670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.844672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.844685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:08.844693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:08.844703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:08.844757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.844763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.844765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.844768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:08.844772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:08.844853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:08.844859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.844871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:08.844880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:08.844899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:08.844920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.844926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.844927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.844938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:08.844953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266634:2446], now have 1 active actors on pipe
2025-10-02T09:28:08.844953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:08.844956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:08.844958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:08.844964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:08.844976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:08.844983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:08.845016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.845026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:08.845038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:08.845040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 10
2025-10-02T09:28:08.849849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:08.849860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:08.849883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: error at write: Disconnected sessionId: src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0
2025-10-02T09:28:08.850016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0 is DEAD
2025-10-02T09:28:08.850175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:08.850187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Write session will restart in 0.006994s
2025-10-02T09:28:08.850208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Write session: Do CDS request
2025-10-02T09:28:08.850215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:08.858488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.858590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:08.858605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-10-02T09:28:08.858762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:08.858802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:08.858808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:08.858812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:08.858949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:08.858963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.858968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.859002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:08.859006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:08.859183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:08.859245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-10-02T09:28:08.859282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:08.859287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:08.859288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:08.859293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553813726266671:2562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:08.859464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.859611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.859754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:08.859874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553813726266671:2562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:08.859967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:08.860009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:08.862057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553813726266671:2562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:08.867932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553813726266671:2562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:08.867949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553813726266671:2562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:08.867952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553813726266671:2562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:08.867962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:08.868538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266704:2562], now have 1 active actors on pipe
2025-10-02T09:28:08.868564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 10
2025-10-02T09:28:08.868638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.868650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.868674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:08.868683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:08.868687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:08.868689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:08.868701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:08.868716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:08.868732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.869120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:08.869132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:08.869152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:08.869252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0
2025-10-02T09:28:08.869598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ca64f9-be5a0b13-4812963b-b8848b60_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:08.872525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Write session: try to update token
2025-10-02T09:28:08.872545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:08.873605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:08.873619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:08.873622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:08.873624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:08.873635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.873639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.873643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553813650749325:2481]
2025-10-02T09:28:08.873682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:08.873689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:08.873694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:08.873695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:08.873698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:08.873701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:08.873916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:08.891793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:08.894489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:08.920637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553813726266707:2503]
2025-10-02T09:28:08.920939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7556553813726266707:2503]
2025-10-02T09:28:09.017737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:09.018021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.018033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.018052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553813726266707:2503], now have 1 active actors on pipe
2025-10-02T09:28:09.018287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:09.018333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553813726266707:2503]
2025-10-02T09:28:09.018389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:09.018358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:09.018943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:09.018369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:09.018955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Write session will restart in 0.008106s
2025-10-02T09:28:09.018427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0
2025-10-02T09:28:09.018600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0 is DEAD
2025-10-02T09:28:09.018982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Write session: Do CDS request
2025-10-02T09:28:09.018988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:09.026584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:09.027368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:09.027537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:09.027546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:09.027556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:09.027601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:09.027640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553817945716692:2483]
2025-10-02T09:28:09.028324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.028233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:09.028398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:09.028409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-10-02T09:28:09.028493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:09.028541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:09.028634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.028667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:09.028672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:09.028675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:09.028863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:09.028927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.028933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.028934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.028935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.028936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.028937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.028938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.028939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.028940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.028941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.028942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.028943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.028950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.028959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.028962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.028966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.028969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.028972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.028975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.028978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.028981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.028985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.028988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.028992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.028998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.029004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.029009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.029013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.029018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.029022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.029026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.029031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.029027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-10-02T09:28:09.029035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.029049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.029053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.029057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.029059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:09.029064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:09.029065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:09.029069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553818021234034:2566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:09.029061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.029070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.029074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.029078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.029084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.029088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.029091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.029096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.029100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.029104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.029109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.029113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.029143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:09.029579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553818021234034:2566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:09.031635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553818021234034:2566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:09.038954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553818021234034:2566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:09.038972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553818021234034:2566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:09.038976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553818021234034:2566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:09.038983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:09.043272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:09.044981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:09.045001Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:09.045005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:09.045010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:09.045016Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [2:7556553817945716692:2483]
2025-10-02T09:28:09.045031Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:09.045049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:09.045053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.045056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.045059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.045075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:09.045081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:09.045088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:09.045150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.045153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.045156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.045160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:09.045162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:09.045234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:09.045245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.045260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.045280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.045298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:09.045314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.045320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.045322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.045329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:09.045342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:09.045351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:09.045354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:09.045356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:09.045356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:09.045359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:09.045395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.045397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:09.045401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:09.045407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234004:2446], now have 1 active actors on pipe
2025-10-02T09:28:09.045411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234071:2566], now have 1 active actors on pipe
2025-10-02T09:28:09.045892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 11
2025-10-02T09:28:09.045929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 11
2025-10-02T09:28:09.048643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.048663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.048692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:09.048701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.048706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.048708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:09.048721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.048738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:09.048781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.049523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.049560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.049597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.049880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0
2025-10-02T09:28:09.050331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe32820-427cfcd8-e1239fa5-a9c56aa2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:09.053008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Write session: try to update token
2025-10-02T09:28:09.053022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:09.064025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:09.064045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:09.064048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:09.064050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:09.064058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.064062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.064066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553817945716687:2483]
2025-10-02T09:28:09.064107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:09.064115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.064122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:09.064256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:09.064860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:09.064866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:09.064870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:09.078822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:09.081866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:09.118287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553818021234081:2503]
2025-10-02T09:28:09.118775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7556553818021234081:2503]
2025-10-02T09:28:09.208050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:09.208109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:09.208203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0
2025-10-02T09:28:09.208352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553818021234081:2503]
2025-10-02T09:28:09.208375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0 is DEAD
2025-10-02T09:28:09.206281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:09.206570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.206578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.206614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234081:2503], now have 1 active actors on pipe
2025-10-02T09:28:09.207418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:09.208878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:09.208888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Write session will restart in 0.007981s
2025-10-02T09:28:09.208916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Write session: Do CDS request
2025-10-02T09:28:09.208924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:09.218376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.220572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:09.220586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-10-02T09:28:09.221222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.221260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:09.221266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:09.221270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:09.221707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-10-02T09:28:09.221740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:09.221742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:09.221744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:09.221750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553818021234123:2572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:09.222681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553818021234123:2572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:09.221357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:09.222195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:09.222346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:09.222349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:09.222358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:09.222398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:09.222429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553817945716763:2486]
2025-10-02T09:28:09.222999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:09.223425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:09.223466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:09.223760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:09.223811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.223812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.223813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.223814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.223815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.223816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.223817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.223818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.223819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.223820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.223821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.223822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.223826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.223836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.223839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.223842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.223845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.223848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.223855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.223858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.223861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.223864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.223868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.223871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.223877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.223884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.223889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.223893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.223896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.223900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.223904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.223907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.223911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.223917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.223920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.223924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.223928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.223933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.223936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.223941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.223944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.223948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.223952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.223956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.223959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.223963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.223967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.223971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.224002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:09.226373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553818021234123:2572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:09.235976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553818021234123:2572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:09.235994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553818021234123:2572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:09.235999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553818021234123:2572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:09.236017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:09.243513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:09.247440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 12
2025-10-02T09:28:09.246481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:09.247579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 12
2025-10-02T09:28:09.246498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:09.246501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:09.246506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:09.246513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [2:7556553817945716763:2486]
2025-10-02T09:28:09.246526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:09.246543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:09.246546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.246549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.246550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.246565Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:09.246570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:09.246577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:09.246639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.246643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.246646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.246649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:09.246651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:09.246746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:09.246749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.246763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.246778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.246797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:09.246814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.246816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.246818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.246831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:09.246844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:09.246861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:09.246863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:09.246897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.246899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:09.247282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:09.247284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:09.247286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:09.247292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:09.247922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234162:2572], now have 1 active actors on pipe
2025-10-02T09:28:09.247935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234085:2446], now have 1 active actors on pipe
2025-10-02T09:28:09.247950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.247954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.248000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d10a600d-5e16d182-480f41a9-a2e510_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:09.248007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.248011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.248012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:09.248022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.248031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:09.248045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.248298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.248307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.248322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.248439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 36 sessionId: src_id|d10a600d-5e16d182-480f41a9-a2e510_0
2025-10-02T09:28:09.248962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a2314-c25e8c06-5065ec19-cd9265b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d10a600d-5e16d182-480f41a9-a2e510_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:09.252319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Write session: try to update token
2025-10-02T09:28:09.252343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:09.272031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:09.272052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:09.272058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:09.272060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:09.272068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.272071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.272074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553817945716757:2486]
2025-10-02T09:28:09.272117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:09.272123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.272125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:09.272131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:09.272140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:09.272146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:09.272267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:09.276219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|d10a600d-5e16d182-480f41a9-a2e510_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:09.308754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553818021234169:2503]
2025-10-02T09:28:09.309206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7556553818021234169:2503]
2025-10-02T09:28:09.347926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:09.426145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:09.426486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234169:2503], now have 1 active actors on pipe
2025-10-02T09:28:09.426504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.426510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.430198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:09.430215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Write session will restart in 0.008019s
2025-10-02T09:28:09.430244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Write session: Do CDS request
2025-10-02T09:28:09.430251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:09.429306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553818021234169:2503]
2025-10-02T09:28:09.429350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:09.429399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:09.429402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:09.429527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: error at write: Disconnected sessionId: src_id|d10a600d-5e16d182-480f41a9-a2e510_0
2025-10-02T09:28:09.429732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|d10a600d-5e16d182-480f41a9-a2e510_0 is DEAD
2025-10-02T09:28:09.433017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:09.439450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.443453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:09.443469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-10-02T09:28:09.443665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.443699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:09.443707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:09.443711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:09.444508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-10-02T09:28:09.444545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:09.444551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:09.444554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:09.444561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553818021234201:2576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:09.444852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:09.445405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:09.445454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553818021234201:2576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:09.445610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:09.445622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:09.445632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:09.445683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:09.445741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553817945716843:2489]
2025-10-02T09:28:09.446341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:09.446768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:09.446818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:09.447137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:09.447243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.447250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.447251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.447252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.447254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.447255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.447256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.447257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.447260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.447261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.447262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.447263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.447269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.447278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.447283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.447286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.447290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.447294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.447297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.447301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.447305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.447310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.447313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.447317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.447322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.447329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.447334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.447339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.447343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.447349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.447353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.447359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.447363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.447369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.447373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.447378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.447383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.447388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.447392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.447398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.447403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.447408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.447413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.447418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.447423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.447428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.447433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.447437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.447473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:09.453644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553818021234201:2576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:09.459850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553818021234201:2576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:09.459866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553818021234201:2576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:09.459874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553818021234201:2576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:09.459881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:09.462743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:09.464820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:09.464836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:09.464840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:09.464843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:09.464849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [2:7556553817945716843:2489]
2025-10-02T09:28:09.464864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:09.464880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:09.464883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.464886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.464889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.466042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 13
2025-10-02T09:28:09.466066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 13
2025-10-02T09:28:09.464904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:09.464915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:09.464922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:09.465012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.465014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.465016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.465018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:09.465020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:09.465099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:09.465101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.465115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.465124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.465137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:09.465155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.465157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.465159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.465178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:09.465192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:09.465205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:09.465208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:09.465243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.465245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:09.465369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:09.465372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:09.465375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:09.465380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:09.466439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234240:2576], now have 1 active actors on pipe
2025-10-02T09:28:09.466453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234172:2446], now have 1 active actors on pipe
2025-10-02T09:28:09.466464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.466469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.466493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:09.466504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.466509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.466511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:09.466519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.466537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:09.466567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.466826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.466834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.466846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.467244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 14 partition: 0 MaxSeqNo: 36 sessionId: src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0
2025-10-02T09:28:09.467690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10a600d-5e16d182-480f41a9-a2e510_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:09.483889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:09.483906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:09.483907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:09.483909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:09.483915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.483919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.483921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553817945716836:2489]
2025-10-02T09:28:09.483952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:09.483958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.483960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:09.484263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Write session: try to update token
2025-10-02T09:28:09.484285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:09.484319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:09.487065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:09.487090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:09.487099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:09.502259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId: src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:09.505969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:09.529749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553818021234260:2503]
2025-10-02T09:28:09.530154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7556553818021234260:2503]
2025-10-02T09:28:09.632631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:09.632956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.632971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.632988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234260:2503], now have 1 active actors on pipe
2025-10-02T09:28:09.633233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:09.633328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:09.633342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:09.633347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:09.633407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553818021234260:2503]
2025-10-02T09:28:09.633434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: error at write: Disconnected sessionId: src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0
2025-10-02T09:28:09.633606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId: src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0 is DEAD
2025-10-02T09:28:09.633766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:09.633785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Write session will restart in 0.008776s
2025-10-02T09:28:09.633811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Write session: Do CDS request
2025-10-02T09:28:09.633818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:09.641515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:09.642290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:09.642545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:09.642554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:09.642566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:09.642618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:09.642653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553817945716947:2503]
2025-10-02T09:28:09.643389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:09.643426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.643536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:09.643553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-10-02T09:28:09.643683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.643712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:09.643713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:09.643723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:09.643731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:09.643757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:09.644101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:09.644152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.644157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.644158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.644161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.644161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.644162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.644163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.644163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.644164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.644165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.644165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.644166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.644169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.644176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.644178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.644181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.644183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.644185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.644187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.644190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.644192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.644195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.644197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.644200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.644187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-10-02T09:28:09.644207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.644214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.644227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:09.644219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.644223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.644229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:09.644231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:09.644237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553818021234304:2587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:09.644229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.644234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.644237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.644242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.644246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.644251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.644255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.644260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.644263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.644267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.644271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.644275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.644279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.644284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.644289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.644294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.644299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.644303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.644307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.644311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.644340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:09.644826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553818021234304:2587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:09.646973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553818021234304:2587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:09.652141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553818021234304:2587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:09.652157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553818021234304:2587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:09.652161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553818021234304:2587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:09.652171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:09.653771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:09.655614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:09.655630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:09.655633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:09.655637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:09.655643Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [2:7556553817945716947:2503]
2025-10-02T09:28:09.655657Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:09.655674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:09.655677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.655679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.655682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.655697Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:09.655705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:09.655716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:09.655772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.655778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.655780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.655783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:09.655786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:09.655844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:09.655851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.655863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.655877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.655895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:09.655915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234341:2587], now have 1 active actors on pipe
2025-10-02T09:28:09.655922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234272:2446], now have 1 active actors on pipe
2025-10-02T09:28:09.655928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.655930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.655932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.655943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:09.655956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:09.655956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:09.655959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:09.655962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:09.655974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:09.655977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:09.656007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.656020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:09.656045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:09.656047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 14
2025-10-02T09:28:09.656053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 14
2025-10-02T09:28:09.656122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.656132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.656152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:09.656162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.656165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.656167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:09.656175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.656186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:09.656199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.656364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.656375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.656405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.656605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0
2025-10-02T09:28:09.656906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3664b73-db2dc3fd-66e0b326-1a0c46c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:09.660137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Write session: try to update token
2025-10-02T09:28:09.660157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:09.669364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:09.669383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:09.669385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:09.669387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:09.669395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.669400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.669403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553817945716942:2503]
2025-10-02T09:28:09.669437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:09.669444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.669446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:09.669448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:09.669452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:09.669455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:09.669609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:09.677787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:09.680183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:09.733691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553818021234362:2503]
2025-10-02T09:28:09.733985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7556553818021234362:2503]
2025-10-02T09:28:09.814997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:09.815316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.815330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.815345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234362:2503], now have 1 active actors on pipe
2025-10-02T09:28:09.815551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:09.815557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:09.815575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:09.815630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553818021234362:2503]
2025-10-02T09:28:09.815633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: error at write: Disconnected sessionId: src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0
2025-10-02T09:28:09.815660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:09.815840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0 is DEAD
2025-10-02T09:28:09.816048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:09.816060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Write session will restart in 0.006958s
2025-10-02T09:28:09.816090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Write session: Do CDS request
2025-10-02T09:28:09.816098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:09.822699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:09.823347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:09.823488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:09.823496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:09.823504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:09.823542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:09.823581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553817945717020:2506]
2025-10-02T09:28:09.824163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:09.824427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.824461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:09.824453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:09.824468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-10-02T09:28:09.824499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:09.824646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:09.824679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:09.824687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:09.824691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:09.824793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:09.824854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.824860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.824861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.824862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.824862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.824863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.824864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.824865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.824866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.824867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.824868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.824869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.824874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.824884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.824887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.824891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.824894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.824898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.824901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.824904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.824907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.824911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.824914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.824918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.824923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.824929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:09.824937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.824942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:09.824946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.824951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:09.824955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.824959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:09.824964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.824969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:09.824974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.824978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:09.824982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.824986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:09.824990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.824994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:09.824997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.825001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:09.825005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.825010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.825014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.825018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.825026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.825031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.825061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:09.825162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-10-02T09:28:09.825198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:09.825204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:09.825205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:09.825212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553818021234401:2592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:09.825744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553818021234401:2592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:09.827701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553818021234401:2592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:09.833487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553818021234401:2592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:09.833500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553818021234401:2592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:09.833504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553818021234401:2592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:09.833511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:09.837556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:09.839220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:09.839236Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:09.839240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:09.839244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:09.839250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [2:7556553817945717020:2506]
2025-10-02T09:28:09.839262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:09.839277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:09.839279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.839284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.839285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.839299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:09.839303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:09.839309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:09.839357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.839364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.839366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.839369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:09.839371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:09.839434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:09.839441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.839453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:09.839464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:09.839483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:09.839505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234368:2446], now have 1 active actors on pipe
2025-10-02T09:28:09.839512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234438:2592], now have 1 active actors on pipe
2025-10-02T09:28:09.839517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.839519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.839521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.839533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:09.839549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:09.839553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:09.839559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:09.839561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:09.839568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:09.839570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:09.839599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.839606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:09.839612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:09.839581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 15
2025-10-02T09:28:09.839577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 15
2025-10-02T09:28:09.839648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.839656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.839685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:09.839694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:09.839698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:09.839699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:09.839709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:09.839720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:09.839735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.839892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.839908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.839931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:09.840005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 36 sessionId: src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0
2025-10-02T09:28:09.840359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8bdd18-102c5dd1-7e388f9d-28a778f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:09.843354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Write session: try to update token
2025-10-02T09:28:09.843370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:09.853502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:09.853523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:09.853525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:09.853529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:09.853537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.853541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.853545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553817945717015:2506]
2025-10-02T09:28:09.853585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:09.853591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:09.853591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:09.853594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:09.853597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:09.853612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:09.853740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:09.859596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:09.862717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:09.915985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553818021234446:2503]
2025-10-02T09:28:09.916313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7556553818021234446:2503]
2025-10-02T09:28:09.998137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:09.998366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:09.998378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:09.998406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234446:2503], now have 1 active actors on pipe
2025-10-02T09:28:09.998598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:09.998653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:09.998708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553818021234446:2503]
2025-10-02T09:28:09.998794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:09.998873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0
2025-10-02T09:28:09.999023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0 is DEAD
2025-10-02T09:28:09.999145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:09.999151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Write session will restart in 0.007770s
2025-10-02T09:28:09.999168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Write session: Do CDS request
2025-10-02T09:28:09.999188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:10.005546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:10.005922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:10.006094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:10.006106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:10.006117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:10.006164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:10.006210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553822240684387:2508]
2025-10-02T09:28:10.006840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:10.007109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:10.007150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:10.007414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:10.007451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.007456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.007456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.007457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.007458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.007458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.007459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.007460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.007460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.007461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.007462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.007463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.007467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.007474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.007477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.007479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.007481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.007483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.007485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.007487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.007491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.007494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.007496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.007498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.007503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.007507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.007512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.007515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.007517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.007520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.007523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.007526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.007528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.007531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.007533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.007536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.007540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.007543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.007546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.007549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.007551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.007555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.007557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.007561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.007563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.007566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.007568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.007572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.007590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:10.008268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.008390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:10.008406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-10-02T09:28:10.008561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.008594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:10.008604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:10.008609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:10.009071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-10-02T09:28:10.009108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:10.009110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:10.009112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:10.009117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553822316201782:2596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:10.009702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553822316201782:2596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:10.011542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553822316201782:2596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:10.018112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553822316201782:2596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:10.018127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553822316201782:2596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:10.018131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553822316201782:2596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:10.018139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:10.018688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:10.020422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:10.020440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:10.020446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:10.020450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:10.020458Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [2:7556553822240684387:2508]
2025-10-02T09:28:10.020475Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:10.020493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:10.020501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.020505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.020507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.020525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:10.020530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:10.020538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:10.020608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.020617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.020622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.020625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:10.020628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:10.020688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:10.020695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.020705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.020711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.020720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:10.020734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.020740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.020742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.020751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:10.020761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:10.020763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:10.020765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:10.020766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:10.020772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:10.020775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:10.020785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201814:2596], now have 1 active actors on pipe
2025-10-02T09:28:10.020788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553818021234450:2446], now have 1 active actors on pipe
2025-10-02T09:28:10.020848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.020860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:10.020867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:10.020893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 16
2025-10-02T09:28:10.020956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 16
2025-10-02T09:28:10.021010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.021018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.021039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:10.021050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.021053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.021054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:10.021062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.021076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:10.021089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.021233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.021242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.021256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.021366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 36 sessionId: src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0
2025-10-02T09:28:10.021733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e611d6c6-7a29a127-eed97fc6-b58a1c13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:10.024783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Write session: try to update token
2025-10-02T09:28:10.024817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:10.034271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:10.034296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.034307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.034360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:10.034370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:10.034700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:10.034948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:10.035143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:10.035368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:10.036641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:10.036694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:10.043802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:10.044231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:10.044247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.044249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:10.044250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:10.044259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.044261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.044263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553822240684382:2508]
2025-10-02T09:28:10.044294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:10.044302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:10.044304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.044307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:10.044324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:10.044328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:10.045130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:10.046266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:10.098758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553822316201824:2503]
2025-10-02T09:28:10.099057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7556553822316201824:2503]
2025-10-02T09:28:10.185489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:10.185830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.185847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.185870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201824:2503], now have 1 active actors on pipe
2025-10-02T09:28:10.186135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:10.186146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:10.186162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:10.186185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:10.186238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553822316201824:2503]
2025-10-02T09:28:10.186244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: error at write: Disconnected sessionId: src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0
2025-10-02T09:28:10.186441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0 is DEAD
2025-10-02T09:28:10.186578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:10.186588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Write session will restart in 0.009905s
2025-10-02T09:28:10.186608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Write session: Do CDS request
2025-10-02T09:28:10.186613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:10.194181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:10.194642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:10.194820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:10.194830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:10.194850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:10.194902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:10.194945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553822240684463:2512]
2025-10-02T09:28:10.195610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:10.195858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:10.195906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:10.196254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:10.196313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.196318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.196319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.196320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.196321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.196322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.196323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.196325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.196326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.196326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.196328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.196329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.196334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.196346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.196350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.196355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.196359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.196363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.196367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.196372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.196376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.196381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.196385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.196389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.196397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.196405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.196412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.196419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.196423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.196430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.196435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.196441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.196450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.196457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.196462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.196467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.196473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.196481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.196485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.196491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.196502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.196507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.196513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.196520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.196526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.196533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.196537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.196543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.196582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:10.197211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.197326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:10.197339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-10-02T09:28:10.197503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.197532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:10.197541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:10.197546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:10.197976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-10-02T09:28:10.198022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:10.198023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:10.198025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:10.198031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553822316201865:2601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:10.198574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553822316201865:2601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:10.200516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553822316201865:2601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:10.207753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553822316201865:2601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:10.207767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553822316201865:2601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:10.207772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553822316201865:2601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:10.207782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:10.208395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:10.210472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:10.210491Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:10.210495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:10.210499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:10.210506Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [2:7556553822240684463:2512]
2025-10-02T09:28:10.210522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:10.210543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:10.210551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.210555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.210557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.210580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:10.210590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:10.210598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:10.210667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.210675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.210677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.210681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:10.210684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:10.210758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:10.210766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.210780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.210797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.210820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:10.210846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201900:2601], now have 1 active actors on pipe
2025-10-02T09:28:10.210855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201827:2446], now have 1 active actors on pipe
2025-10-02T09:28:10.210863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.210871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.210873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.210886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:10.210882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 17
2025-10-02T09:28:10.210904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:10.210910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:10.210895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 17
2025-10-02T09:28:10.210913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:10.210916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:10.210923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:10.210927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:10.210964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.210976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:10.210982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:10.210997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.211004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.211055Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61adddff-518c7e29-e3792870-757cc03e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:10.211066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.211071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.211078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:10.211087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.211097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:10.211120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.211278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.211285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.211299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.211395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 36 sessionId: src_id|61adddff-518c7e29-e3792870-757cc03e_0
2025-10-02T09:28:10.211686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b06579-d367ae7c-2c7b3903-9faa6023_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61adddff-518c7e29-e3792870-757cc03e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:10.214966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Write session: try to update token
2025-10-02T09:28:10.214986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:10.225029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:10.225048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.225050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:10.225052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:10.225061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.225066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.225070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553822240684458:2512]
2025-10-02T09:28:10.225113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:10.225115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:10.225119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:10.225123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:10.225126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.225130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:10.225428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
E1002 09:28:10.230905389 3228599 chttp2_transport.cc:1143]             ipv4:127.0.0.1:13253: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:10.231293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|61adddff-518c7e29-e3792870-757cc03e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:10.233846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:10.286655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553822316201920:2503]
2025-10-02T09:28:10.286925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7556553822316201920:2503]
2025-10-02T09:28:10.366608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:10.366874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.366885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.366905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201920:2503], now have 1 active actors on pipe
2025-10-02T09:28:10.367084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:10.367126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:10.367141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:10.367215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: error at write: Disconnected sessionId: src_id|61adddff-518c7e29-e3792870-757cc03e_0
2025-10-02T09:28:10.367378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:10.367406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|61adddff-518c7e29-e3792870-757cc03e_0 is DEAD
2025-10-02T09:28:10.367439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553822316201920:2503]
2025-10-02T09:28:10.367565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:10.367576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Write session will restart in 0.009609s
2025-10-02T09:28:10.367604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Write session: Do CDS request
2025-10-02T09:28:10.367611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:10.374723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:10.375092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:10.375287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:10.375295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:10.375303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:10.375337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:10.375368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553822240684549:2516]
2025-10-02T09:28:10.375813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:10.376078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:10.376115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:10.376395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:10.376436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.376442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.376443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.376443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.376444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.376445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.376445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.376446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.376447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.376447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.376448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.376449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.376452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.376461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.376465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.376469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.376472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.376476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.376481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.376484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.376487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.376491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.376494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.376496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.376501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.376505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.376509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.376512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.376517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.376519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.376522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.376526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.376529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.376532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.376534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.376537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.376540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.376543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.376545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.376548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.376550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.376553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.376556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.376559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.376563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.376566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.376568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.376571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.376595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:10.378210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.378427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:10.378451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-10-02T09:28:10.378591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.378621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:10.378629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:10.378633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:10.379077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-10-02T09:28:10.379111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:10.379117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:10.379119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:10.379125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553822316201961:2606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:10.379673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553822316201961:2606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:10.381554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553822316201961:2606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:10.385993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553822316201961:2606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:10.386007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553822316201961:2606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:10.386012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553822316201961:2606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:10.386021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:10.386634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:10.388335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:10.388352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:10.388355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:10.388362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:10.388369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [2:7556553822240684549:2516]
2025-10-02T09:28:10.388384Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:10.388401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:10.388408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.388412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.388414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.388430Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:10.388442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:10.388449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:10.388510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.388517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.388519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.388523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:10.388526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:10.388592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:10.388599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.388610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.388623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.388638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:10.388663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201997:2606], now have 1 active actors on pipe
2025-10-02T09:28:10.388670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316201923:2446], now have 1 active actors on pipe
2025-10-02T09:28:10.388676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.388679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.388681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.388694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:10.388706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 18
2025-10-02T09:28:10.388711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 18
2025-10-02T09:28:10.388711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:10.388729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:10.388731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:10.388732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:10.388744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:10.388747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:10.388775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.388783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.388816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.388827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:10.388834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:10.388852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41af3b54-2fcf679c-cba17723-34c16168_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:10.388862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.388866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.388867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:10.388877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.388890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:10.388916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.389051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.389059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.389074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.389143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 36 sessionId: src_id|41af3b54-2fcf679c-cba17723-34c16168_0
2025-10-02T09:28:10.389502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61adddff-518c7e29-e3792870-757cc03e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41af3b54-2fcf679c-cba17723-34c16168_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:10.392657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Write session: try to update token
2025-10-02T09:28:10.392675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:10.400567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:10.400586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.400588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:10.400589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:10.400600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.400604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.400608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553822240684544:2516]
2025-10-02T09:28:10.400651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:10.400656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:10.400663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:10.400663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.400666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:10.400667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:10.400868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:10.408603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|41af3b54-2fcf679c-cba17723-34c16168_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:10.411116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:10.467383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553822316202004:2503]
2025-10-02T09:28:10.467661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7556553822316202004:2503]
2025-10-02T09:28:10.542723Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:10.543028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.543036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.543060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202004:2503], now have 1 active actors on pipe
2025-10-02T09:28:10.543405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:10.543365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553822316202004:2503]
2025-10-02T09:28:10.543388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:10.543418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:10.543420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:10.543479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: error at write: Disconnected sessionId: src_id|41af3b54-2fcf679c-cba17723-34c16168_0
2025-10-02T09:28:10.543643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|41af3b54-2fcf679c-cba17723-34c16168_0 is DEAD
2025-10-02T09:28:10.543798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:10.543810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Write session will restart in 0.005051s
2025-10-02T09:28:10.543842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Write session: Do CDS request
2025-10-02T09:28:10.543850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:10.550444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.550539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:10.550551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-10-02T09:28:10.550680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.550723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:10.550733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:10.550737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:10.551088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-10-02T09:28:10.551125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:10.551135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:10.551137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:10.551144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553822316202053:2616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:10.551645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553822316202053:2616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:10.553333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553822316202053:2616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:10.553409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:10.554033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:10.554232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:10.554241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:10.554252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:10.554299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:10.554343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553822240684636:2524]
2025-10-02T09:28:10.555003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:10.555310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:10.555356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:10.555685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:10.555746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.555752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.555754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.555755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.555756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.555757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.555759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.555760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.555761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.555762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.555763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.555765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.555770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.555782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.555786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.555790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.555794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.555799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.555803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.555807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.555811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.555816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.555820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.555824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.555831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.555842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.555854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.555860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.555864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.555873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.555877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.555888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.555893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.555902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.555907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.555912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.555922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.555927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.555938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.555944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.555954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.555959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.555969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.555951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553822316202053:2616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:10.555964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553822316202053:2616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:10.555967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553822316202053:2616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:10.555975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:10.555974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.555985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.555991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.556007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.556013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.556051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:10.566396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:10.568536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:10.568552Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:10.568555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:10.568559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:10.568566Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [2:7556553822240684636:2524]
2025-10-02T09:28:10.568581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:10.568601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:10.568605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.568609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.568611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.568629Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:10.568639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:10.568646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:10.568716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.568723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.568725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.568728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:10.568732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:10.568839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:10.568846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.568860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.568874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.568898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:10.568924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202018:2446], now have 1 active actors on pipe
2025-10-02T09:28:10.568931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202091:2616], now have 1 active actors on pipe
2025-10-02T09:28:10.568938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.568944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.568958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.568974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:10.568962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 19
2025-10-02T09:28:10.568992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:10.569006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:10.569010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:10.569010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:10.569013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:10.569013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:10.569021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 19
2025-10-02T09:28:10.569056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.569071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:10.569077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:10.569110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.569118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.569149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:10.569162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.569166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.569168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:10.569180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.569194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:10.569214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.569366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.569376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.569391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.569480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 36 sessionId: src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0
2025-10-02T09:28:10.569859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41af3b54-2fcf679c-cba17723-34c16168_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:10.573067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Write session: try to update token
2025-10-02T09:28:10.573087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:10.580980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:10.580996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.580998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:10.581000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:10.581008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.581012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.581015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553822240684631:2524]
2025-10-02T09:28:10.581049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:10.581054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.581055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:10.581075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:10.581084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:10.581088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:10.581186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:10.589515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:10.591956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:10.643516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553822316202110:2503]
2025-10-02T09:28:10.643816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7556553822316202110:2503]
2025-10-02T09:28:10.726115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:10.726442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.726455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.726471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202110:2503], now have 1 active actors on pipe
2025-10-02T09:28:10.726859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553822316202110:2503]
2025-10-02T09:28:10.726869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:10.726879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:10.726942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:10.726966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: error at write: Disconnected sessionId: src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0
2025-10-02T09:28:10.727468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0 is DEAD
2025-10-02T09:28:10.727674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:10.727692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Write session will restart in 0.009604s
2025-10-02T09:28:10.727716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Write session: Do CDS request
2025-10-02T09:28:10.727725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:10.730606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:10.736033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:10.736445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:10.736576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:10.736583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:10.736589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:10.736634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:10.736665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553822240684735:2533]
2025-10-02T09:28:10.737087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:10.737426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:10.737478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:10.737821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:10.737867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.737872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.737874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.737875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.737876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.737877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.737878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.737879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.737880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.737881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.737883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.737898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.737902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.737905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.737909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.737912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.737916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.737924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.737928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.737933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.737949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.737957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.737963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.737970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.737975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.737985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.737988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.737993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.738001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.738006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.738010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.738019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.738023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.738027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.738035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.738043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.738047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.738054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.738058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.738063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.738070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.738079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.738087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.738096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.738103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.738108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.738147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:10.738340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.738430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:10.738445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-10-02T09:28:10.738637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.738670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:10.738682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:10.738686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:10.739020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-10-02T09:28:10.739050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:10.739060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:10.739062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:10.739065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553822316202163:2622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:10.739565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553822316202163:2622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:10.741810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553822316202163:2622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:10.746268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553822316202163:2622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:10.746285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553822316202163:2622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:10.746292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553822316202163:2622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:10.746309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:10.747005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:10.748904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:10.748920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:10.748922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:10.748927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:10.748933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [2:7556553822240684735:2533]
2025-10-02T09:28:10.748944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:10.748956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:10.748958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.748960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.748960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.748972Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:10.748975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:10.748980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:10.749024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.749030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.749031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.749034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:10.749035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:10.749079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:10.749087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.749096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.749102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.749111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:10.749125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.749126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.749128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.749133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:10.749143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:10.749152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:10.749155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:10.749159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:10.749163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:10.749163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202197:2622], now have 1 active actors on pipe
2025-10-02T09:28:10.749165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:10.749167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202122:2446], now have 1 active actors on pipe
2025-10-02T09:28:10.749191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.749201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:10.749216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:10.749230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 20
2025-10-02T09:28:10.749251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 20
2025-10-02T09:28:10.749284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.749291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.749311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|327cda49-f0eb887f-111ac01-4549ef31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:10.749315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.749317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.749318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:10.749324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.749330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:10.749340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.749531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.749539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.749555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.749643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 36 sessionId: src_id|327cda49-f0eb887f-111ac01-4549ef31_0
2025-10-02T09:28:10.750065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b53aa61e-12ecab49-c1f477dd-b5dd4ae7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|327cda49-f0eb887f-111ac01-4549ef31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:10.753255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Write session: try to update token
2025-10-02T09:28:10.753275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:10.760735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:10.760754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.760757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:10.760759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:10.760766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.760770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.760773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553822240684730:2533]
2025-10-02T09:28:10.760833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:10.760841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.760843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:10.760843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:10.760849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:10.760853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:10.760993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:10.773223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId: src_id|327cda49-f0eb887f-111ac01-4549ef31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:10.775851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:10.826813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553822316202207:2503]
2025-10-02T09:28:10.829027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7556553822316202207:2503]
2025-10-02T09:28:10.904909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:10.905632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:10.905647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:10.905725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: error at write: Disconnected sessionId: src_id|327cda49-f0eb887f-111ac01-4549ef31_0
2025-10-02T09:28:10.905897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|327cda49-f0eb887f-111ac01-4549ef31_0 is DEAD
2025-10-02T09:28:10.905912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553822316202207:2503]
2025-10-02T09:28:10.905934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:10.905280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.905296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.905314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202207:2503], now have 1 active actors on pipe
2025-10-02T09:28:10.905754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:10.906143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:10.906156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Write session will restart in 0.007233s
2025-10-02T09:28:10.906195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Write session: Do CDS request
2025-10-02T09:28:10.906201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:10.913913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:10.914326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.914482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:10.914497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-10-02T09:28:10.914633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:10.914737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:10.914778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:10.914786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:10.914790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:10.914826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:10.914835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:10.914852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:10.914901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:10.914935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553822240684810:2535]
2025-10-02T09:28:10.915268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-10-02T09:28:10.915306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:10.915313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:10.915315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:10.915321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553822316202247:2626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:10.915608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:10.915850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553822316202247:2626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:10.915903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:10.915942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:10.916259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:10.916307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.916317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.916318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.916319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.916320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.916322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.916333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.916335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.916336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.916337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.916338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.916339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.916344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.916355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.916360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.916365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.916369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.916373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.916378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.916382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.916386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.916391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.916395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.916399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.916406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.916413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:10.916419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.916425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:10.916430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.916436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:10.916440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.916447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:10.916456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.916461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:10.916470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.916475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:10.916484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.916490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:10.916498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.916504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:10.916513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.916519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:10.916523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.916528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.916533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.916540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.916545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.916554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.916594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:10.918103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553822316202247:2626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:10.924089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553822316202247:2626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:10.924107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553822316202247:2626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:10.924112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553822316202247:2626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:10.924126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:10.926510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:10.928551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:10.928570Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:10.928573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:10.928576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:10.928583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [2:7556553822240684810:2535]
2025-10-02T09:28:10.928597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:10.928614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:10.928616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.928619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.928624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.928639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:10.928644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:10.928650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:10.928709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.928716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.928718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.928721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:10.928724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:10.928829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:10.928839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.928852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:10.928863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:10.928877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:10.928922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 21
2025-10-02T09:28:10.928926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 21
2025-10-02T09:28:10.928895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202209:2446], now have 1 active actors on pipe
2025-10-02T09:28:10.928904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553822316202286:2626], now have 1 active actors on pipe
2025-10-02T09:28:10.928910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.928912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.928913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.928927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:10.928945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:10.928944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:10.928947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:10.928949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:10.928961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:10.928963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:10.929009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.929012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.929024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.929035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:10.929052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:10.929064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:10.929070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:10.929074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:10.929076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:10.929085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:10.929094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:10.929113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.929244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:10.929253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:10.929267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:10.929356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 36 sessionId: src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0
2025-10-02T09:28:10.929743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cda49-f0eb887f-111ac01-4549ef31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:10.932885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Write session: try to update token
2025-10-02T09:28:10.932904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:10.942740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:10.942754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:10.942757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:10.942758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:10.942767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.942771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.942774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553822240684805:2535]
2025-10-02T09:28:10.942812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:10.942819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:10.942823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:10.943021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:10.944853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:10.944866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:10.944870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:10.950302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:10.953394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:11.006001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553826611169589:2503]
2025-10-02T09:28:11.006268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7556553826611169589:2503]
2025-10-02T09:28:11.081330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:11.081600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.081611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.081624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169589:2503], now have 1 active actors on pipe
2025-10-02T09:28:11.081890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:11.081920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553826611169589:2503]
2025-10-02T09:28:11.081936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:11.081939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:11.081998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: error at write: Disconnected sessionId: src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0
2025-10-02T09:28:11.082180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0 is DEAD
2025-10-02T09:28:11.082421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:11.082430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Write session will restart in 0.005279s
2025-10-02T09:28:11.082448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Write session: Do CDS request
2025-10-02T09:28:11.082456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:11.082733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:11.089130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:11.089392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.089477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:11.089487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-10-02T09:28:11.089596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.089621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:11.089629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:11.089633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:11.089637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:11.089798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:11.089807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:11.089816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:11.089864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:11.089897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553826535652184:2538]
2025-10-02T09:28:11.090009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-10-02T09:28:11.090039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:11.090045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:11.090047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:11.090052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553826611169632:2631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:11.090449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:11.090572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553826611169632:2631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:11.090701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:11.090742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:11.091004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:11.091060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.091066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.091067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.091068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.091070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.091071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.091072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.091073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.091074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.091075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.091077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.091078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.091083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.091093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.091097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.091102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.091106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.091110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.091114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.091118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.091121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.091125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.091129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.091133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.091139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.091146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.091156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.091161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.091169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.091182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.091185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.091190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.091195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.091201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.091207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.091212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.091216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.091222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.091229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.091234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.091239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.091244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.091251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.091256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.091260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.091266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.091271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.091276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.091311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:11.092120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553826611169632:2631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:11.097272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553826611169632:2631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:11.097286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553826611169632:2631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:11.097290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553826611169632:2631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:11.097349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:11.100174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:11.102205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:11.102222Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:11.102225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:11.102228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:11.102235Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [2:7556553826535652184:2538]
2025-10-02T09:28:11.102248Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:11.102266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:11.102268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.102271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.102273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.102288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:11.102294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:11.102301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:11.102365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.102374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.102377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.102380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:11.102383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:11.102448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:11.102455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.102470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.102486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.102506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:11.102529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169670:2631], now have 1 active actors on pipe
2025-10-02T09:28:11.102536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169593:2446], now have 1 active actors on pipe
2025-10-02T09:28:11.102542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.102544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.102546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.102557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:11.102568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:11.102575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:11.102577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:11.102580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:11.102591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:11.102565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 22
2025-10-02T09:28:11.102573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 22
2025-10-02T09:28:11.102595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:11.102642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.102651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.102665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.102673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:11.102681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:11.102696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:11.102704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.102712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.102715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:11.102722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.102731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:11.102756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.102925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.102938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.102959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.103039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0
2025-10-02T09:28:11.103567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130d47-69aca9bf-984ec5c0-992ea5d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:11.106662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Write session: try to update token
2025-10-02T09:28:11.106679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:11.113887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:11.113908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.113910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:11.113912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:11.113923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.113928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.113932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553826535652179:2538]
2025-10-02T09:28:11.113968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:11.113973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.113975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:11.113979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:11.113985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:11.113989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:11.114128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:11.123964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:11.126919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:11.182140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553826611169678:2503]
2025-10-02T09:28:11.182437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7556553826611169678:2503]
2025-10-02T09:28:11.262593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:11.262896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.262911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.262926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169678:2503], now have 1 active actors on pipe
2025-10-02T09:28:11.263163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:11.263188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:11.263210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553826611169678:2503]
2025-10-02T09:28:11.263235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:11.263245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: error at write: Disconnected sessionId: src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0
2025-10-02T09:28:11.263299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:11.263414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0 is DEAD
2025-10-02T09:28:11.263604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:11.263618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Write session will restart in 0.007822s
2025-10-02T09:28:11.263642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Write session: Do CDS request
2025-10-02T09:28:11.263649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:11.269927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:11.270412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:11.270584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:11.270593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:11.270601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:11.270640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:11.270674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553826535652273:2541]
2025-10-02T09:28:11.271251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:11.271544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:11.271586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:11.271909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:11.271954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.271959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.271960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.271961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.271962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.271964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.271965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.271966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.271967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.271968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.271969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.271970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.271975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.271987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.271991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.271995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.272000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.272004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.272008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.272012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.272016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.272021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.272024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.272028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.272034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.272041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.272047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.272058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.272063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.272069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.272077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.272083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.272089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.272098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.272103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.272113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.272118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.272127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.272132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.272141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.272146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.272155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.272159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.272169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.272174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.272179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.272184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.272189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.272228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:11.272393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.272480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:11.272493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-10-02T09:28:11.272674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.272699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:11.272707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:11.272712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:11.273178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-10-02T09:28:11.273220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:11.273226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:11.273227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:11.273233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553826611169737:2636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:11.273721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553826611169737:2636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:11.275591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553826611169737:2636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:11.280000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553826611169737:2636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:11.280011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553826611169737:2636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:11.280014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553826611169737:2636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:11.280020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:11.280748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:11.282623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:11.282640Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:11.282642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:11.282646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:11.282653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [2:7556553826535652273:2541]
2025-10-02T09:28:11.282665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:11.282678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:11.282681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.282684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.282685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.282699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:11.282703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:11.282711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:11.282764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.282771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.282775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.282778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:11.282780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:11.282876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:11.282883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.282895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.282907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.282926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:11.282945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169694:2446], now have 1 active actors on pipe
2025-10-02T09:28:11.282952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169772:2636], now have 1 active actors on pipe
2025-10-02T09:28:11.282958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.282960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.282962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.282973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:11.282987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:11.282987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:11.282990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:11.282992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:11.283000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:11.283004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:11.282998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 23
2025-10-02T09:28:11.283004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 23
2025-10-02T09:28:11.283029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.283037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:11.283040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:11.283071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.283078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.283108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:11.283117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.283121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.283123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:11.283131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.283142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:11.283160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.283323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.283336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.283354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.283441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0
2025-10-02T09:28:11.283795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8fc849c-9deb96a3-d094e1b1-85d618b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:11.286817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Write session: try to update token
2025-10-02T09:28:11.286835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:11.294199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:11.294217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.294220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:11.294222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:11.294234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.294238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.294241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553826535652268:2541]
2025-10-02T09:28:11.294276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:11.294281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.294283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:11.294285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:11.294288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:11.294292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:11.294414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:11.302986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:11.305315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:11.363381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553826611169779:2503]
2025-10-02T09:28:11.363650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7556553826611169779:2503]
2025-10-02T09:28:11.424168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:11.424463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.424472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.424485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169779:2503], now have 1 active actors on pipe
2025-10-02T09:28:11.424697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:11.424724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:11.424745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:11.424778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553826611169779:2503]
2025-10-02T09:28:11.424845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0
2025-10-02T09:28:11.424942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0 is DEAD
2025-10-02T09:28:11.425075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:11.425085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Write session will restart in 0.006864s
2025-10-02T09:28:11.425104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Write session: Do CDS request
2025-10-02T09:28:11.425109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:11.431844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:11.432178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:11.432302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:11.432309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:11.432315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:11.432347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:11.432378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553826535652352:2543]
2025-10-02T09:28:11.432770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:11.433009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:11.433034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:11.433199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.433222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:11.433255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.433256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.433257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.433257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.433258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.433258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.433259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.433260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.433260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.433261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.433261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.433262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.433265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.433272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.433274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.433278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.433280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.433282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.433284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.433286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.433288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.433290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.433292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.433294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.433298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.433302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.433306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.433309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.433311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.433314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.433316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.433319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.433322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.433325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.433327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.433331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.433335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.433341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.433346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.433351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.433355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.433359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.433363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.433368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.433371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.433373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.433377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.433379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.433398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:11.433479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:11.433492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-10-02T09:28:11.433611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.433633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:11.433639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:11.433647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:11.434017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-10-02T09:28:11.434044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:11.434045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:11.434046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:11.434050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553826611169825:2640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:11.434523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553826611169825:2640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:11.436238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553826611169825:2640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:11.441349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553826611169825:2640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:11.441363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553826611169825:2640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:11.441367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553826611169825:2640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:11.441374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:11.442020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:11.443889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:11.443908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:11.443910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:11.443914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:11.443921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [2:7556553826535652352:2543]
2025-10-02T09:28:11.443935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:11.443950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:11.443953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.443955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.443957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.443971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:11.443976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:11.443983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:11.444033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.444043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.444045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.444048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:11.444050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:11.444108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:11.444115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.444127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.444137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.444160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:11.444181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169860:2640], now have 1 active actors on pipe
2025-10-02T09:28:11.444187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169781:2446], now have 1 active actors on pipe
2025-10-02T09:28:11.444191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.444193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.444194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.444202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:11.444213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:11.444220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:11.444221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:11.444223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:11.444223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:11.444225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:11.444249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.444257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:11.444245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 24
2025-10-02T09:28:11.444261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 24
2025-10-02T09:28:11.444271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:11.444281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.444284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.444302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:11.444311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.444313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.444315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:11.444320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.444326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:11.444338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.444459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.444468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.444478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.444543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 36 sessionId: src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0
2025-10-02T09:28:11.444829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e28327-e77feb4e-63326a99-a4d6a5ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:11.447885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Write session: try to update token
2025-10-02T09:28:11.447902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:11.454455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:11.454474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.454482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.454521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:11.454525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:11.454709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:11.454900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:11.455147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:11.455306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:11.455529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:11.455569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:11.464368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:11.464386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.464388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:11.464389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:11.464397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.464401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.464405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553826535652347:2543]
2025-10-02T09:28:11.464436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:11.464441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.464441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:11.464442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:11.464445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:11.464448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:11.464560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:11.465624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:11.468243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:11.525170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553826611169870:2503]
2025-10-02T09:28:11.525415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7556553826611169870:2503]
2025-10-02T09:28:11.597880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:11.598134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.598146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.598160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169870:2503], now have 1 active actors on pipe
2025-10-02T09:28:11.598366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:11.598413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553826611169870:2503]
2025-10-02T09:28:11.598461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:11.598563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0
2025-10-02T09:28:11.598744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0 is DEAD
2025-10-02T09:28:11.598916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:11.598938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Write session will restart in 0.008573s
2025-10-02T09:28:11.598961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Write session: Do CDS request
2025-10-02T09:28:11.598967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:11.598973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:11.604738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:11.605136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:11.605308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:11.605320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:11.605329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:11.605369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:11.605416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553826535652445:2551]
2025-10-02T09:28:11.605967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:11.606239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:11.606278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:11.606499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:11.606540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.606545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.606546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.606547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.606547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.606548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.606549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.606549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.606550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.606551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.606552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.606552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.606555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.606564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.606568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.606571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.606575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.606578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.606581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.606586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.606591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.606595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.606598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.606601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.606606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.606613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.606618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.606622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.606626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.606630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.606634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.606639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.606643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.606647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.606651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.606655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.606660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.606664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.606668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.606673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.606677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.606682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.606686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.606690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.606694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.606701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.606705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.606709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.606751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:11.608252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.608592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:11.608605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-10-02T09:28:11.608735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.608759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:11.608766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:11.608769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:11.609092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-10-02T09:28:11.609119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:11.609121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:11.609122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:11.609126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553826611169942:2653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:11.609549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553826611169942:2653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:11.610968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553826611169942:2653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:11.614905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553826611169942:2653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:11.614918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553826611169942:2653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:11.614921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553826611169942:2653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:11.615537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:11.615880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:11.617556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:11.617577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:11.617580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:11.617584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:11.617590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [2:7556553826535652445:2551]
2025-10-02T09:28:11.617604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:11.617619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:11.617622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.617625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.617627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.617639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:11.617644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:11.617651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:11.617704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.617716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.617718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.617721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:11.617723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:11.617778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:11.617788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.617801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.617813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.617833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:11.617859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169974:2653], now have 1 active actors on pipe
2025-10-02T09:28:11.617868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169885:2446], now have 1 active actors on pipe
2025-10-02T09:28:11.617874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.617876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.617878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.617889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:11.617891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 25
2025-10-02T09:28:11.617901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:11.617906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:11.617909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:11.617911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:11.617920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:11.617923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:11.617962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.617970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.617980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.617984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 25
2025-10-02T09:28:11.617988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:11.618005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:11.618015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:11.618026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.618030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.618033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:11.618043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.618055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:11.618076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.618227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.618238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.618252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.618317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 36 sessionId: src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0
2025-10-02T09:28:11.618614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22e98e6-c12ca3e6-db880a91-d75bb6e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:11.621214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Write session: try to update token
2025-10-02T09:28:11.621230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:11.628616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:11.628632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.628634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:11.628635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:11.628641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.628644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.628647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553826535652440:2551]
2025-10-02T09:28:11.628676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:11.628680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.628682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:11.628694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:11.628699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:11.628702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:11.628794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:11.637385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:11.640643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:11.698727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553826611169986:2503]
2025-10-02T09:28:11.698921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7556553826611169986:2503]
2025-10-02T09:28:11.753329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:11.753580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.753591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.753603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169986:2503], now have 1 active actors on pipe
2025-10-02T09:28:11.753731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:11.753835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:11.753841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553826611169986:2503]
2025-10-02T09:28:11.753859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:11.753914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0
2025-10-02T09:28:11.754074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0 is DEAD
2025-10-02T09:28:11.754226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:11.754238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Write session will restart in 0.009842s
2025-10-02T09:28:11.754258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Write session: Do CDS request
2025-10-02T09:28:11.754272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:11.760109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:11.760425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:11.760545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:11.760553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:11.760559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:11.760587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:11.760615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553826535652550:2560]
2025-10-02T09:28:11.761028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:11.761279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:11.761309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:11.761547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:11.761582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.761588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.761588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.761589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.761589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.761590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.761590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.761591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.761591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.761592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.761592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.761593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.761596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.761606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.761610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.761613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.761617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.761620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.761623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.761627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.761630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.761633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.761636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.761639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.761646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.761652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.761656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.761659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.761661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.761664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.761666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.761668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.761671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.761674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.761676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.761679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.761681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.761685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.761687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.761690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.761693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.761695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.761697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.761700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.761702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.761705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.761708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.761711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.761730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:11.765257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.765310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:11.765324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-10-02T09:28:11.765538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.765567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:11.765585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:11.765589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:11.765951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-10-02T09:28:11.765981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:11.765985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:11.765987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:11.765990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553826611170038:2658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:11.766404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553826611170038:2658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:11.768061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553826611170038:2658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:11.770016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:11.770511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553826611170038:2658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:11.770525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553826611170038:2658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:11.770529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553826611170038:2658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:11.770539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:11.771684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:11.771701Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:11.771703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:11.771707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:11.771713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [2:7556553826535652550:2560]
2025-10-02T09:28:11.771725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:11.771739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:11.771742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.771745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.771746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.771758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:11.771767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:11.771778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:11.771831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.771837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.771839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.771842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:11.771844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:11.771924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:11.771931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.771943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.771954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.771973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:11.771996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611169988:2446], now have 1 active actors on pipe
2025-10-02T09:28:11.772003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611170072:2658], now have 1 active actors on pipe
2025-10-02T09:28:11.772009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.772015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.772017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.772027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:11.772023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 26
2025-10-02T09:28:11.772031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 26
2025-10-02T09:28:11.772041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:11.772045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:11.772048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:11.772049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:11.772059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:11.772063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:11.772102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.772110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.772120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.772130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:11.772146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:11.772160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:11.772169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.772176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.772178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:11.772186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.772197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:11.772216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.772329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.772334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.772344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.772411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 36 sessionId: src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0
2025-10-02T09:28:11.772726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a004a6fd-f1f0f670-f692cab2-82c1b718_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:11.775369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Write session: try to update token
2025-10-02T09:28:11.775384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:11.782663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:11.782681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.782684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:11.782686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:11.782696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.782701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.782707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553826535652544:2560]
2025-10-02T09:28:11.782744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:11.782751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.782753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:11.782754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:11.782758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:11.782764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:11.782884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:11.790562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:11.793303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:11.853879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553826611170079:2503]
2025-10-02T09:28:11.854136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7556553826611170079:2503]
2025-10-02T09:28:11.907717Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:11.908078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.908090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.908104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611170079:2503], now have 1 active actors on pipe
2025-10-02T09:28:11.908353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:11.908388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:11.908392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:11.908402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553826611170079:2503]
2025-10-02T09:28:11.908427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:11.908451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0
2025-10-02T09:28:11.908615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0 is DEAD
2025-10-02T09:28:11.908762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:11.908772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Write session will restart in 0.008812s
2025-10-02T09:28:11.908795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Write session: Do CDS request
2025-10-02T09:28:11.908816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:11.915135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:11.915529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:11.915687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:11.915698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:11.915708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:11.915749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:11.915779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553826535652632:2562]
2025-10-02T09:28:11.916165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:11.916533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:11.916565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:11.916787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:11.916845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.916850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.916851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.916852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.916853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.916854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.916855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.916856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.916857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.916858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.916859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.916860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.916864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.916874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.916878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.916882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.916885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.916889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.916893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.916896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.916900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.916905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.916909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.916912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.916917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.916923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:11.916929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.916932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:11.916934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.916937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:11.916939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.916942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:11.916944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.916947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:11.916950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.916952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:11.916955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.916958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:11.916967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.916970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:11.916973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.916975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:11.916978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.916980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.916983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.916986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.916991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.916995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.917029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:11.918353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.918465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:11.918477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-10-02T09:28:11.918641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:11.918668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:11.918677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:11.918681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:11.919073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-10-02T09:28:11.919107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:11.919112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:11.919114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:11.919119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553826611170128:2662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:11.919652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553826611170128:2662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:11.921739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553826611170128:2662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:11.924819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553826611170128:2662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:11.924833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553826611170128:2662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:11.924837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553826611170128:2662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:11.924844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:11.925585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:11.927413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:11.927431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:11.927433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:11.927440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:11.927446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [2:7556553826535652632:2562]
2025-10-02T09:28:11.927458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:11.927475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:11.927482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.927485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.927487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.927501Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:11.927509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:11.927514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:11.927573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.927580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.927582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.927585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:11.927587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:11.927675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:11.927688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.927701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:11.927713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:11.927729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:11.927751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611170081:2446], now have 1 active actors on pipe
2025-10-02T09:28:11.927761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553826611170163:2662], now have 1 active actors on pipe
2025-10-02T09:28:11.927767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.927769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.927771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.927782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:11.927793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:11.927797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:11.927800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:11.927802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:11.927811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:11.927817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:11.927796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 27
2025-10-02T09:28:11.927816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 27
2025-10-02T09:28:11.927845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.927856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:11.927862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:11.927872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.927880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.927918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:11.927930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:11.927933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:11.927934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:11.927941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:11.927949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:11.927967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.928119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:11.928128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:11.928141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:11.928209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 36 sessionId: src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0
2025-10-02T09:28:11.928551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b9dc89-50424b6-a2fc1167-4ca79f0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:11.931260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Write session: try to update token
2025-10-02T09:28:11.931276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:11.939253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:11.939277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:11.939279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:11.939281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:11.939289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.939293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.939297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553826535652627:2562]
2025-10-02T09:28:11.939341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:11.939343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:11.939349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:11.939353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:11.939353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:11.939356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:11.939546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:11.946578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:11.948844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:12.008522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553830906137466:2503]
2025-10-02T09:28:12.008823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7556553830906137466:2503]
2025-10-02T09:28:12.075364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:12.075656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.075666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.075680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137466:2503], now have 1 active actors on pipe
2025-10-02T09:28:12.075879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:12.075912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:12.075924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:12.075954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553830906137466:2503]
2025-10-02T09:28:12.076026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0
2025-10-02T09:28:12.076172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0 is DEAD
2025-10-02T09:28:12.076293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:12.076299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Write session will restart in 0.008843s
2025-10-02T09:28:12.076314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Write session: Do CDS request
2025-10-02T09:28:12.076319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:12.082463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.082889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.083029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.083037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:12.083046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.083091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.083123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553830830620013:2565]
2025-10-02T09:28:12.083612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:12.083873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:12.083905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:12.084124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:12.084160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.084164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.084165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.084165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.084166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.084166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.084167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.084167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.084168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.084168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.084169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.084170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.084173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.084180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.084182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.084185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.084187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.084189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.084191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.084193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.084195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.084198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.084200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.084202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.084207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.084211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.084214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.084217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.084219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.084222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.084224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.084227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.084229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.084232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.084234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.084237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.084239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.084241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.084244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.084246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.084250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.084252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.084254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.084257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.084261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.084264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.084265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.084268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.084300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:12.086255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.086356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:12.086367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-10-02T09:28:12.086488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.086514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:12.086519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:12.086523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:12.086865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-10-02T09:28:12.086890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:12.086894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:12.086895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:12.086898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553830906137519:2667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:12.087367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553830906137519:2667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:12.089068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553830906137519:2667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:12.092098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553830906137519:2667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:12.092107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553830906137519:2667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:12.092110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553830906137519:2667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:12.092116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:12.092923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:12.094731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:12.094749Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:12.094751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.094757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.094763Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [2:7556553830830620013:2565]
2025-10-02T09:28:12.094775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:12.094793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:12.094795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.094798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.094800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.094814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:12.094821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.094827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:12.094886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.094892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.094894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.094897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:12.094899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:12.094956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:12.094963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.094977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.094990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.095007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:12.095026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137470:2446], now have 1 active actors on pipe
2025-10-02T09:28:12.095034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137554:2667], now have 1 active actors on pipe
2025-10-02T09:28:12.095040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.095044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.095046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.095058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:12.095071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:12.095074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:12.095076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:12.095077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:12.095089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:12.095092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:12.095097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 28
2025-10-02T09:28:12.095104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 28
2025-10-02T09:28:12.095120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.095127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:12.095130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:12.095152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.095159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.095197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:12.095207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.095210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.095212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.095221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.095233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:12.095253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.095401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.095409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.095420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.095509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0
2025-10-02T09:28:12.095823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81d29a4e-c6a02e5c-d796625c-4a19718d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:12.098527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Write session: try to update token
2025-10-02T09:28:12.098545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:12.106366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:12.106389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.106391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:12.106393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:12.106401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.106406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.106409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553830830620008:2565]
2025-10-02T09:28:12.106450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:12.106456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.106458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:12.106462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:12.106469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:12.106473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:12.106643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:12.114684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:12.117762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:12.175938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553830906137561:2503]
2025-10-02T09:28:12.176186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7556553830906137561:2503]
2025-10-02T09:28:12.250147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:12.250514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.250529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.250545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137561:2503], now have 1 active actors on pipe
2025-10-02T09:28:12.250748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:12.250882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:12.250894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:12.250984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: error at write: Disconnected sessionId: src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0
2025-10-02T09:28:12.251121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553830906137561:2503]
2025-10-02T09:28:12.251160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:12.251168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0 is DEAD
2025-10-02T09:28:12.251583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:12.251594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Write session will restart in 0.009224s
2025-10-02T09:28:12.251617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Write session: Do CDS request
2025-10-02T09:28:12.251624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:12.259131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.260014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.260189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.260200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:12.260211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.260268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.260302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553830830620110:2568]
2025-10-02T09:28:12.261023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:12.261314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:12.261368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:12.261675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:12.261736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.261742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.261743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.261744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.261745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.261746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.261747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.261748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.261749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.261750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.261752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.261752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.261758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.261768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.261772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.261776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.261780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.261784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.261787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.261791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.261796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.261800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.261803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.261806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.261813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.261819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.261824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.261828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.261832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.261836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.261840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.261844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.261849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.261854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.261858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.261862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.261866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.261871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.261874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.261879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.261884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.261891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.261898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.261902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.261907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.261916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.261920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.261925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.261963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:12.262339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.262444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:12.262459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-10-02T09:28:12.262680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.262735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:12.262745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:12.262754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:12.263197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-10-02T09:28:12.263228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:12.263229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:12.263231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:12.263236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553830906137625:2672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:12.263693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553830906137625:2672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:12.266196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553830906137625:2672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:12.270677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553830906137625:2672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:12.270691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553830906137625:2672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:12.270694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553830906137625:2672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:12.270704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:12.271275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:12.273059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:12.273077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:12.273082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.273086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.273092Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [2:7556553830830620110:2568]
2025-10-02T09:28:12.273104Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:12.273120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:12.273128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.273131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.273133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.273148Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:12.273156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.273163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:12.273217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.273226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.273227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.273230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:12.273233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:12.273323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:12.273332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.273344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.273353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.273371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:12.273395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137659:2672], now have 1 active actors on pipe
2025-10-02T09:28:12.273403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137575:2446], now have 1 active actors on pipe
2025-10-02T09:28:12.273409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.273411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.273414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.273427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:12.273441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:12.273443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:12.273448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:12.273432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 29
2025-10-02T09:28:12.273450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:12.273457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:12.273460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:12.273489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.273493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:12.273494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:12.273507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.273512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.273510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 29
2025-10-02T09:28:12.273548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:12.273559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.273563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.273569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.273578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.273591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:12.273616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.273791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.273804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.273825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.273939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 36 sessionId: src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0
2025-10-02T09:28:12.274290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef20aec-847855cc-d86571e2-e4cddc05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:12.276971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Write session: try to update token
2025-10-02T09:28:12.276987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:12.286004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:12.286024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.286026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:12.286028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:12.286036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.286040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.286043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553830830620105:2568]
2025-10-02T09:28:12.286086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:12.286091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.286093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:12.286104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:12.286124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:12.286136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:12.286401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:12.293341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:12.296380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:12.351009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553830906137666:2503]
2025-10-02T09:28:12.351306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7556553830906137666:2503]
2025-10-02T09:28:12.422561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:12.422960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.422975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.422993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137666:2503], now have 1 active actors on pipe
2025-10-02T09:28:12.423193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:12.423217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:12.423231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:12.423231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553830906137666:2503]
2025-10-02T09:28:12.423246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:12.423290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: error at write: Disconnected sessionId: src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0
2025-10-02T09:28:12.423445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0 is DEAD
2025-10-02T09:28:12.423572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:12.423584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Write session will restart in 0.009641s
2025-10-02T09:28:12.423608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Write session: Do CDS request
2025-10-02T09:28:12.423614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:12.430915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.431606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.431752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.431761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:12.431767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.431800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.431833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553830830620194:2570]
2025-10-02T09:28:12.432340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:12.432653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:12.432710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:12.433004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:12.433046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.433050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.433051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.433051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.433052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.433053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.433053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.433054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.433054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.433055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.433055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.433056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.433059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.433066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.433068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.433071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.433073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.433075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.433077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.433079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.433081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.433083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.433085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.433087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.433092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.433099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.433104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.433109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.433112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.433117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.433120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.433125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.433129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.433134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.433138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.433143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.433147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.433152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.433156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.433160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.433164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.433169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.433173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.433179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.433183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.433188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.433192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.433197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.433224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:12.434284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.434401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:12.434414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-10-02T09:28:12.434515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.434541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:12.434551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:12.434555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:12.434893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-10-02T09:28:12.434918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:12.434919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:12.434920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:12.434924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553830906137719:2676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:12.435415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553830906137719:2676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:12.437334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553830906137719:2676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:12.441806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553830906137719:2676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:12.441822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553830906137719:2676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:12.441826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553830906137719:2676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:12.441853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:12.442516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:12.444371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:12.444389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:12.444394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.444397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.444402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [2:7556553830830620194:2570]
2025-10-02T09:28:12.444411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:12.444422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:12.444424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.444427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.444428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.444438Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:12.444442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.444447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:12.444489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.444494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.444496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.444498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:12.444499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:12.444551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:12.444558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.444569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.444583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.444603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:12.444626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137668:2446], now have 1 active actors on pipe
2025-10-02T09:28:12.444631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137753:2676], now have 1 active actors on pipe
2025-10-02T09:28:12.444636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.444639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.444641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.444653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:12.444665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:12.444669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:12.444672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:12.444674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:12.444683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:12.444686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:12.444677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 30
2025-10-02T09:28:12.444702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 30
2025-10-02T09:28:12.444716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.444723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:12.444724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:12.444740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.444746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.444785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:12.444794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.444797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.444816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.444825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.444837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:12.444855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.444992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.445000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.445011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.445069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 36 sessionId: src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0
2025-10-02T09:28:12.445338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72e6c1a-da0d433a-8c5d894-59291d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:12.447780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Write session: try to update token
2025-10-02T09:28:12.447792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:12.455789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:12.455806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.455808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:12.455810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:12.455818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.455821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.455824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553830830620189:2570]
2025-10-02T09:28:12.455868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:12.455880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.455883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:12.455890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:12.455904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:12.455908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:12.456431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:12.463143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:12.466159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:12.523566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553830906137761:2503]
2025-10-02T09:28:12.523841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7556553830906137761:2503]
2025-10-02T09:28:12.593887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:12.594169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.594181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.594198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137761:2503], now have 1 active actors on pipe
2025-10-02T09:28:12.594401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:12.594425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:12.594440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553830906137761:2503]
2025-10-02T09:28:12.594445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:12.594447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:12.594514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: error at write: Disconnected sessionId: src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0
2025-10-02T09:28:12.594695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0 is DEAD
2025-10-02T09:28:12.594847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:12.594859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Write session will restart in 0.005335s
2025-10-02T09:28:12.594879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Write session: Do CDS request
2025-10-02T09:28:12.594885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:12.600628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.601076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.601263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.601272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:12.601281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.601288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.601328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.601365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553830830620280:2572]
2025-10-02T09:28:12.601411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:12.601423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-10-02T09:28:12.601527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.601550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:12.601559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:12.601563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:12.601917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-10-02T09:28:12.601921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:12.601946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:12.601954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:12.601955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:12.601959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553830906137810:2680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:12.602146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:12.602182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:12.602393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:12.602430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.602434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.602435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.602435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.602436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.602437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.602437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.602438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.602439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.602439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.602440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.602440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.602451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553830906137810:2680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:12.602443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.602450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.602452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.602454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.602456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.602458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.602460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.602462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.602464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.602466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.602468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.602470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.602474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.602478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.602482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.602485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.602487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.602491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.602494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.602496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.602500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.602502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.602505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.602507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.602510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.602513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.602515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.602517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.602520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.602522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.602525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.602528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.602530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.602533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.602535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.602537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.602554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:12.604054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553830906137810:2680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:12.609884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553830906137810:2680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:12.609903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553830906137810:2680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:12.609907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553830906137810:2680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:12.609950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:12.611355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:12.613267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:12.613280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:12.613282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.613286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.613290Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [2:7556553830830620280:2572]
2025-10-02T09:28:12.613304Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:12.613319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:12.613322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.613326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.613327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.613343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:12.613347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.613353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:12.613448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.613458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.613459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.613463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:12.613466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:12.613543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:12.613548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.613557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.613564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.613582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:12.613604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137763:2446], now have 1 active actors on pipe
2025-10-02T09:28:12.613612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137850:2680], now have 1 active actors on pipe
2025-10-02T09:28:12.613618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.613620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.613624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.613635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:12.613651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:12.613653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:12.613656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:12.613658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:12.613668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:12.613671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:12.613702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.613709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:12.613716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:12.613691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 31
2025-10-02T09:28:12.613691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 31
2025-10-02T09:28:12.613739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.613745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.613763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:12.613773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.613775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.613777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.613784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.613791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:12.613800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.613931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.613936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.613946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.614018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 36 sessionId: src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0
2025-10-02T09:28:12.614354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda6d0a3-7d863a30-850ce08-e86fd9a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:12.617266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Write session: try to update token
2025-10-02T09:28:12.617283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:12.627902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:12.627918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.627924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.627958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:12.627977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:12.628138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:12.628287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:12.628415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:12.628542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:12.629112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:12.629156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:12.633448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:12.634338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:12.634352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.634354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:12.634355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:12.634365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.634369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.634373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553830830620275:2572]
2025-10-02T09:28:12.634406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:12.634410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.634412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:12.634424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:12.634445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:12.634449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:12.634542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:12.636574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:12.694561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553830906137884:2503]
2025-10-02T09:28:12.694788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7556553830906137884:2503]
2025-10-02T09:28:12.772939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:12.773228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.773243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.773261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137884:2503], now have 1 active actors on pipe
2025-10-02T09:28:12.773485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:12.773507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:12.773490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553830906137884:2503]
2025-10-02T09:28:12.773511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:12.773514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:12.773573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: error at write: Disconnected sessionId: src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0
2025-10-02T09:28:12.773734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0 is DEAD
2025-10-02T09:28:12.773856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:12.773862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Write session will restart in 0.006558s
2025-10-02T09:28:12.773882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Write session: Do CDS request
2025-10-02T09:28:12.773886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:12.781198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.781298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:12.781313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-10-02T09:28:12.781432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.781460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:12.781468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:12.781473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:12.781842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-10-02T09:28:12.781872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:12.781877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:12.781878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:12.781883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553830906137937:2692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:12.781908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.782403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553830906137937:2692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:12.782449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.782611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.782621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:12.782630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.782688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.782733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553830830620406:2587]
2025-10-02T09:28:12.783329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:12.783582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:12.783621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:12.783943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:12.783997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.784004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.784005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.784006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.784007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.784008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.784009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.784010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.784011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.784012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.784013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.784014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.784019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.784030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.784034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.784038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.784042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.784046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.784050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.784054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.784057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.784067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.784070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.784074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.784080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.784088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.784093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.784099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.784103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.784109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.784113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.784124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.784129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.784135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.784144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.784149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.784159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.784165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.784174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.784179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.784183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.784189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.784194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.784199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.784204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.784210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.784214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.784222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.784261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:12.784442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553830906137937:2692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:12.790472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553830906137937:2692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:12.790486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553830906137937:2692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:12.790490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553830906137937:2692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:12.790497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:12.793319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:12.795041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:12.795058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:12.795060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.795063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.795067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [2:7556553830830620406:2587]
2025-10-02T09:28:12.795076Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:12.795088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:12.795090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.795092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.795093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.795103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:12.795107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.795111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:12.795266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.795274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.795276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.795278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:12.795280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:12.795328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:12.795333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.795342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.795348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.795360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:12.795375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.795380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.795382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.795388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:12.795398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:12.795406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:12.795408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:12.795424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:12.795430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.795431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:12.795432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:12.795434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:12.795438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137890:2446], now have 1 active actors on pipe
2025-10-02T09:28:12.795438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:12.795441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137977:2692], now have 1 active actors on pipe
2025-10-02T09:28:12.795530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 32
2025-10-02T09:28:12.795530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 32
2025-10-02T09:28:12.795587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.795599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.795639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:12.795650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.795654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.795656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.795665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.795679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:12.795693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.795835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.795842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.795852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.795934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0
2025-10-02T09:28:12.796262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fddf0f5a-8bffe680-4476c2c1-76e37d69_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:12.799375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Write session: try to update token
2025-10-02T09:28:12.799400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:12.806045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:12.806063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.806070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.806113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:12.806114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:12.806304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:12.806457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:12.806606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:12.806755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:12.806942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:12.806978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:12.815722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId: src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:12.816044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:12.816058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.816060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:12.816062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:12.816070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.816073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.816076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553830830620401:2587]
2025-10-02T09:28:12.816111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:12.816116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.816118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:12.816119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:12.816125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:12.816129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:12.816271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:12.818583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:12.873741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553830906137984:2503]
2025-10-02T09:28:12.873995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7556553830906137984:2503]
2025-10-02T09:28:12.964720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:12.965430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.965448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.965466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137984:2503], now have 1 active actors on pipe
2025-10-02T09:28:12.965707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:12.965781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:12.965798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553830906137984:2503]
2025-10-02T09:28:12.965821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:12.965824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:12.965891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: error at write: Disconnected sessionId: src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0
2025-10-02T09:28:12.966061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0 is DEAD
2025-10-02T09:28:12.966215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:12.966226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Write session will restart in 0.007339s
2025-10-02T09:28:12.966250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Write session: Do CDS request
2025-10-02T09:28:12.966256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:12.974270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.974323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:12.974456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:12.974481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-10-02T09:28:12.974690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:12.974737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:12.974750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:12.974760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:12.974847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:12.975012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:12.975023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:12.975032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:12.975083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:12.975124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553830830620494:2589]
2025-10-02T09:28:12.975391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-10-02T09:28:12.975432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:12.975439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:12.975441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:12.975447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553830906138039:2696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:12.975745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:12.975966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553830906138039:2696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:12.976066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:12.976120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:12.976340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:12.976376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.976377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.976378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.976379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.976380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.976381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.976382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.976383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.976384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.976385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.976386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.976387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.976392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.976402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.976406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.976410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.976413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.976417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.976421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.976423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.976425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.976427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.976430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.976432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.976436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.976441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:12.976445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.976449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:12.976451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.976454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:12.976456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.976459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:12.976462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.976465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:12.976467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.976470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:12.976472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.976475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:12.976477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.976483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:12.976486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.976489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:12.976491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.976494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.976496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.976499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.976501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.976506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.976539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:12.978055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553830906138039:2696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:12.983480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553830906138039:2696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:12.983501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553830906138039:2696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:12.983506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553830906138039:2696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:12.983518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:12.985371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:12.987217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:12.987231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:12.987234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:12.987237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:12.987244Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [2:7556553830830620494:2589]
2025-10-02T09:28:12.987257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:12.987272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:12.987275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.987278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.987280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.987293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:12.987297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:12.987304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:12.987357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.987364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.987367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.987371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:12.987373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:12.987436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:12.987443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.987455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:12.987469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:12.987491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:12.987513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906137990:2446], now have 1 active actors on pipe
2025-10-02T09:28:12.987521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553830906138075:2696], now have 1 active actors on pipe
2025-10-02T09:28:12.987527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.987529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.987531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.987544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:12.987560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:12.987569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:12.987573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:12.987575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:12.987583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:12.987586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:12.987591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 33
2025-10-02T09:28:12.987617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.987590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 33
2025-10-02T09:28:12.987624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:12.987639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:12.987800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.987816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.987843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2605a066-7590f15f-9c5e180a-b812c516_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:12.987857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:12.987876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:12.987878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:12.987888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:12.987898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:12.987912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.988099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:12.988109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:12.988122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:12.988211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 36 sessionId: src_id|2605a066-7590f15f-9c5e180a-b812c516_0
2025-10-02T09:28:12.988536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b8765b4-834ec7bb-cd24ee04-2b29c51f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2605a066-7590f15f-9c5e180a-b812c516_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:12.991452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Write session: try to update token
2025-10-02T09:28:12.991470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:12.999744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:12.999764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:12.999766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:12.999768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:12.999779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.999783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.999786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553830830620489:2589]
2025-10-02T09:28:12.999820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:12.999825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:12.999827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:12.999835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:12.999849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:12.999853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:13.000758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:13.009279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|2605a066-7590f15f-9c5e180a-b812c516_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.012358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:13.065805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553835201105379:2503]
2025-10-02T09:28:13.066107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7556553835201105379:2503]
2025-10-02T09:28:13.152126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:13.152452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.152465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.152482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105379:2503], now have 1 active actors on pipe
2025-10-02T09:28:13.152752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:13.152755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:13.152759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:13.152828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553835201105379:2503]
2025-10-02T09:28:13.152853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: error at write: Disconnected sessionId: src_id|2605a066-7590f15f-9c5e180a-b812c516_0
2025-10-02T09:28:13.153017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|2605a066-7590f15f-9c5e180a-b812c516_0 is DEAD
2025-10-02T09:28:13.153357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:13.153367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Write session will restart in 0.007176s
2025-10-02T09:28:13.153387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Write session: Do CDS request
2025-10-02T09:28:13.153400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:13.154330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:13.162329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:13.162884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:13.163058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.163067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:13.163078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:13.163139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:13.163193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553835125587881:2592]
2025-10-02T09:28:13.163530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.163606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.163621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-10-02T09:28:13.163729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.163755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:13.163764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:13.163769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.163784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:13.164118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:13.164171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:13.164193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-10-02T09:28:13.164247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.164254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.164255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.164261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553835201105435:2701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.164500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:13.164567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.164574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.164575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.164575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.164576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.164577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.164577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.164579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.164579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.164580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.164581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.164582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.164586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.164595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.164599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.164602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.164605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.164609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.164612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.164615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.164619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.164624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.164627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.164631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.164636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.164643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.164649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.164653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.164659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.164664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.164668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.164673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.164677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.164681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.164685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.164704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.164709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.164713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.164717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.164722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.164725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.164730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.164735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.164739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.164744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.164753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.164758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.164763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.164833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:13.165006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553835201105435:2701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.166795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553835201105435:2701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.172293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553835201105435:2701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.172307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553835201105435:2701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:13.172311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553835201105435:2701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.172318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.173799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:13.175512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:13.175527Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:13.175530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:13.175534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:13.175539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [2:7556553835125587881:2592]
2025-10-02T09:28:13.175551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:13.175567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:13.175570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.175573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.175575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.175589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:13.175599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.175608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:13.175660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.175666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.175667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.175670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:13.175673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:13.175732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:13.175738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.175752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.175769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.175791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:13.175813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105383:2446], now have 1 active actors on pipe
2025-10-02T09:28:13.175817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105472:2701], now have 1 active actors on pipe
2025-10-02T09:28:13.175822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.175824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.175826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.175836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:13.175850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:13.175864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:13.175865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:13.175868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:13.175870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:13.175871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:13.175898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.175908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:13.175913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:13.175897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 34
2025-10-02T09:28:13.175897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 34
2025-10-02T09:28:13.176040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.176047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.176067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:13.176076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.176079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.176081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.176088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.176096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.176110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.176258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.176270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.176286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.176371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0
2025-10-02T09:28:13.176692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2605a066-7590f15f-9c5e180a-b812c516_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:13.179529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Write session: try to update token
2025-10-02T09:28:13.179542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:13.186868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:13.186883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.186891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.186930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:13.186936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:13.187122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:13.187277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.187420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.187568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.187780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:13.187827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:13.198687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:13.198703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.198706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:13.198708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:13.198717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.198720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.198724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553835125587876:2592]
2025-10-02T09:28:13.198759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:13.198766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.198768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:13.198767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:13.198772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:13.198775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:13.198920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:13.202209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.204726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:13.253148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553835201105492:2503]
2025-10-02T09:28:13.253406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7556553835201105492:2503]
2025-10-02T09:28:13.342565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:13.342921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.342935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.342951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105492:2503], now have 1 active actors on pipe
2025-10-02T09:28:13.343157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:13.343200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:13.343218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553835201105492:2503]
2025-10-02T09:28:13.343249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:13.343256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:13.343310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: error at write: Disconnected sessionId: src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0
2025-10-02T09:28:13.343488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0 is DEAD
2025-10-02T09:28:13.343659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:13.343670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Write session will restart in 0.008096s
2025-10-02T09:28:13.343694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Write session: Do CDS request
2025-10-02T09:28:13.343701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:13.351880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:13.352437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:13.352605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.352614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:13.352623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:13.352675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:13.352721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553835125587984:2595]
2025-10-02T09:28:13.353250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:13.353351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.353444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.353458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-10-02T09:28:13.353536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:13.353580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:13.353611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.353637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:13.353642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:13.353646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.353871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:13.353925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.353931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.353932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.353933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.353933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.353934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.353935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.353937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.353937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.353938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.353939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.353940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.353944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.353953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.353956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.353960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.353963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.353966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.353969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.353972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.353975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.353979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.353982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.353985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.353991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.353998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.354003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.354008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.354012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.354017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.354022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.354027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.354031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.354036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.354041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.354046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.354050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.354055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.354060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.354066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.354070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.354075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.354079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.354084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.354088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.354093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.354097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.354102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.354138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:13.354151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-10-02T09:28:13.354204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.354213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.354215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.354222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553835201105547:2706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.354805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553835201105547:2706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.357435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553835201105547:2706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.362566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553835201105547:2706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.362594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553835201105547:2706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:13.362598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553835201105547:2706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.362607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.363132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:13.364971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:13.364989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:13.364991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:13.364995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:13.365001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [2:7556553835125587984:2595]
2025-10-02T09:28:13.365016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:13.365033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:13.365036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.365039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.365041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.365056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:13.365061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.365068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:13.365146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.365158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.365161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.365164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:13.365166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:13.365235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:13.365244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.365256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.365267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.365283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:13.365305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105494:2446], now have 1 active actors on pipe
2025-10-02T09:28:13.365308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105583:2706], now have 1 active actors on pipe
2025-10-02T09:28:13.365314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.365375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 35
2025-10-02T09:28:13.365317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.365400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 35
2025-10-02T09:28:13.365319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.365331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:13.365344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:13.365344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:13.365347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:13.365349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:13.365358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:13.365361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:13.365390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.365398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:13.365418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:13.365434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.365438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.365462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|639fcfc2-652f99d-c415d69b-431d822c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:13.365469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.365476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.365479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.365493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.365504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.365519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.365725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.365734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.365748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.365881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 36 sessionId: src_id|639fcfc2-652f99d-c415d69b-431d822c_0
2025-10-02T09:28:13.366314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1f1d39-b1ac4cc3-c99293a0-2eeea09e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|639fcfc2-652f99d-c415d69b-431d822c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:13.369143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Write session: try to update token
2025-10-02T09:28:13.369158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:13.376463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:13.376484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.376495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.376539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:13.376560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:13.376714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:13.376883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.377064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.377209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.377416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:13.377459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:13.387874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:13.387895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.387897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:13.387899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:13.387908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.387911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.387915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553835125587979:2595]
2025-10-02T09:28:13.387953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:13.387959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.387962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:13.387961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:13.387967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:13.387971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:13.388111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:13.395743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|639fcfc2-652f99d-c415d69b-431d822c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.401932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:13.443118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553835201105591:2503]
2025-10-02T09:28:13.443630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7556553835201105591:2503]
2025-10-02T09:28:13.540576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:13.540958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.540972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.540987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105591:2503], now have 1 active actors on pipe
2025-10-02T09:28:13.541168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:13.541311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553835201105591:2503]
2025-10-02T09:28:13.541343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:13.541374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:13.541444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: status is not ok: tablet will be restarted right now sessionId: src_id|639fcfc2-652f99d-c415d69b-431d822c_0
2025-10-02T09:28:13.541617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|639fcfc2-652f99d-c415d69b-431d822c_0 is DEAD
2025-10-02T09:28:13.544971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:13.544987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Write session will restart in 0.009447s
2025-10-02T09:28:13.545020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Write session: Do CDS request
2025-10-02T09:28:13.545027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:13.549959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:13.550427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:13.550583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.550593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:13.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:13.550643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:13.550675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553835125588075:2597]
2025-10-02T09:28:13.551281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:13.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:13.551586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:13.551891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:13.551942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.551947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.551948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.551949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.551950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.551951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.551952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.551953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.551954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.551955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.551956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.551957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.551961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.551970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.551973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.551977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.551980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.551983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.551987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.551990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.551994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.551997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.552001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.552004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.552012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.552018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.552023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.552027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.552031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.552035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.552039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.552044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.552048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.552053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.552057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.552062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.552076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.552082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.552085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.552090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.552094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.552099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.552107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.552113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.552117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.552123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.552130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.552135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.552169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:13.555431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.555513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.555528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-10-02T09:28:13.555750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.555791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:13.555801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:13.555806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.556247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-10-02T09:28:13.556280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.556285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.556286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.556291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553835201105650:2710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.556822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553835201105650:2710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.558526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553835201105650:2710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.561227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553835201105650:2710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.561259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553835201105650:2710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:13.561264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553835201105650:2710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.561279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.562044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:13.563890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:13.563906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:13.563908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:13.563913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:13.563921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [2:7556553835125588075:2597]
2025-10-02T09:28:13.563934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:13.563951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:13.563954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.563957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.563958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.563971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:13.563977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.563983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:13.564071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.564080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.564083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.564086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:13.564088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:13.564170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:13.564178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.564193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.564209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.564230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:13.564251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.564259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.564261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.564275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:13.564288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:13.564293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:13.564295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:13.564298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:13.564302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:13.564304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:13.564336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.564346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:13.564382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:13.564468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105593:2446], now have 1 active actors on pipe
2025-10-02T09:28:13.564473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105685:2710], now have 1 active actors on pipe
2025-10-02T09:28:13.564659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 36
2025-10-02T09:28:13.564703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 36
2025-10-02T09:28:13.564763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.564777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.564815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:13.564829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.564837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.564839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.564848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.564864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.564904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.565105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.565117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.565134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.565247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0
2025-10-02T09:28:13.565673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639fcfc2-652f99d-c415d69b-431d822c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:13.568697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Write session: try to update token
2025-10-02T09:28:13.568716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:13.576223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:13.576242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.576245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:13.576247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:13.576259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.576263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.576267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553835125588070:2597]
2025-10-02T09:28:13.576306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:13.576312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.576311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:13.576314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:13.576317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:13.576321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:13.576660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:13.597194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.599765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:13.643340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553835201105692:2503]
2025-10-02T09:28:13.643726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7556553835201105692:2503]
2025-10-02T09:28:13.726168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:13.726418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.726440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.726457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105692:2503], now have 1 active actors on pipe
2025-10-02T09:28:13.726634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553835201105692:2503]
2025-10-02T09:28:13.726647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:13.726663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:13.726673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:13.726724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: error at write: Disconnected sessionId: src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0
2025-10-02T09:28:13.726778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:13.726905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0 is DEAD
2025-10-02T09:28:13.727105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:13.727121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Write session will restart in 0.007081s
2025-10-02T09:28:13.727148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Write session: Do CDS request
2025-10-02T09:28:13.727155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:13.735382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.735493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.735509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-10-02T09:28:13.735786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.735829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:13.735836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:13.735849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.736104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:13.736356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-10-02T09:28:13.737153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:13.736409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.736416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.736418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.736425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553835201105777:2722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.737026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553835201105777:2722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.737344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.737354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:13.737370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:13.737426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:13.737464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553835125588205:2612]
2025-10-02T09:28:13.738084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:13.738733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:13.738800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:13.739095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:13.739157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.739163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.739164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.739165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.739166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.739177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.739178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.739179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.739180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.739181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.739182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.739184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.739188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.739199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.739203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.739206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.739210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.739213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.739226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.739230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.739234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.739238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.739241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.739245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.739251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.739259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.739264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.739269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.739273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.739277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.739281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.739285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.739290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.739294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.739298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.739311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.739320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.739325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.739329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.739338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.739343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.739348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.739356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.739361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.739365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.739374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.739378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.739383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.739415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:13.742763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553835201105777:2722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.748904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553835201105777:2722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.748923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553835201105777:2722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:13.748927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553835201105777:2722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.748937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.749572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:13.751431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:13.751450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:13.751454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:13.751458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:13.751465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [2:7556553835125588205:2612]
2025-10-02T09:28:13.751480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:13.751498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:13.751504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.751507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.751509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.751525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:13.751531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.751538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:13.751602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.751611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.751613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.751616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:13.751619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:13.751689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:13.751697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.751710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.751722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.751745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:13.751768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.751776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.751779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.751795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:13.751808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:13.751824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:13.751826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:13.751858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.751867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:13.751913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:13.751930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:13.751933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:13.751942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:13.752091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105723:2446], now have 1 active actors on pipe
2025-10-02T09:28:13.752105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105812:2722], now have 1 active actors on pipe
2025-10-02T09:28:13.752164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 37
2025-10-02T09:28:13.752209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 37
2025-10-02T09:28:13.752531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.752555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.752580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:13.752595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.752599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.752601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.752610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.752628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.752641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.755087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.755102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.755126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.755312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 36 sessionId: src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0
2025-10-02T09:28:13.755694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc754df6-6dcd19e5-2137b41b-139cbbe9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:13.759086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Write session: try to update token
2025-10-02T09:28:13.759110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:13.764578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:13.764598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.764601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:13.764603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:13.764610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.764616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.764620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553835125588200:2612]
2025-10-02T09:28:13.764660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:13.764667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.764674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:13.764839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:13.768857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:13.768873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:13.768877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:13.784463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.787710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:13.826598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553835201105823:2503]
2025-10-02T09:28:13.826911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7556553835201105823:2503]
2025-10-02T09:28:13.912200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:13.912697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.912714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.912731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105823:2503], now have 1 active actors on pipe
2025-10-02T09:28:13.912962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:13.913093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:13.913101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553835201105823:2503]
2025-10-02T09:28:13.913124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:13.913127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:13.913180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: error at write: Disconnected sessionId: src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0
2025-10-02T09:28:13.913352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0 is DEAD
2025-10-02T09:28:13.913540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:13.913554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Write session will restart in 0.009786s
2025-10-02T09:28:13.913585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Write session: Do CDS request
2025-10-02T09:28:13.913591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:13.920086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:13.920438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:13.920633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:13.920641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:13.920650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:13.920697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:13.920730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553835125588298:2614]
2025-10-02T09:28:13.921311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:13.921569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:13.921602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:13.921835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:13.921874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.921880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.921881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.921882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.921883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.921884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.921884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.921886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.921887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.921888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.921889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.921889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.921894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.921901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.921904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.921906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.921908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.921910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.921912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.921914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.921916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.921918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.921920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.921921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.921925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.921930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:13.921933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.921937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:13.921939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.921941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:13.921943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.921946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:13.921949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.921952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:13.921962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.921965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:13.921967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.921970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:13.921973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.921976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:13.921979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.921981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:13.921984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.921986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.921988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.921991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.921993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.921995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.922019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:13.924357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.924408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:13.924422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-10-02T09:28:13.924597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:13.924647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:13.924667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:13.924678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:13.925124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-10-02T09:28:13.925160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:13.925168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:13.925170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:13.925176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553835201105885:2726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:13.925712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553835201105885:2726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:13.927846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553835201105885:2726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:13.930281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553835201105885:2726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:13.930295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553835201105885:2726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:13.930299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553835201105885:2726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:13.930308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:13.930804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:13.932493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:13.932508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:13.932509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:13.932512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:13.932517Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [2:7556553835125588298:2614]
2025-10-02T09:28:13.932531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:13.932546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:13.932549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.932552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.932554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.932568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:13.932573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:13.932580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:13.932628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.932637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.932640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.932643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:13.932647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:13.932710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:13.932718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.932730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:13.932742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:13.932761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:13.932783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105826:2446], now have 1 active actors on pipe
2025-10-02T09:28:13.932791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553835201105919:2726], now have 1 active actors on pipe
2025-10-02T09:28:13.932796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.932816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.932818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.932835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:13.932852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:13.932861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:13.932865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:13.932867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:13.932869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:13.932872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:13.932903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.932915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:13.932923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:13.932976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 38
2025-10-02T09:28:13.932980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 38
2025-10-02T09:28:13.933071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.933083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.933110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:13.933122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:13.933126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:13.933128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:13.933136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:13.933152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:13.933163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.936904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:13.936918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:13.936938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:13.937074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0
2025-10-02T09:28:13.937429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee82c31-616bc10d-963b9a62-2bcf8455_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:13.940523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Write session: try to update token
2025-10-02T09:28:13.940542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:13.947864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:13.947881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.947889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.947928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:13.947927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:13.948116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:13.948262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.948399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.948523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:13.948719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:13.948772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:13.953384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:13.953398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:13.953399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:13.953400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:13.953406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.953409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.953412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553835125588293:2614]
2025-10-02T09:28:13.953435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:13.953439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:13.953441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:13.953453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:13.953458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:13.953462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:13.953571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:13.955951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:13.958553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:14.013002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553839496073222:2503]
2025-10-02T09:28:14.013344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7556553839496073222:2503]
2025-10-02T09:28:14.085132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:14.085478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.085488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.085501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073222:2503], now have 1 active actors on pipe
2025-10-02T09:28:14.085653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:14.085714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:14.085727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:14.085783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: error at write: Disconnected sessionId: src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0
2025-10-02T09:28:14.085815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553839496073222:2503]
2025-10-02T09:28:14.085853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:14.085948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0 is DEAD
2025-10-02T09:28:14.086080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:14.086091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Write session will restart in 0.008555s
2025-10-02T09:28:14.086113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Write session: Do CDS request
2025-10-02T09:28:14.086118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:14.092532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.093023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.093188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.093195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:14.093202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.093243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.093269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839420555690:2617]
2025-10-02T09:28:14.093686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:14.093909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:14.093937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:14.094173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:14.094210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.094214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.094214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.094215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.094216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.094216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.094217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.094217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.094218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.094218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.094219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.094219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.094222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.094229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.094231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.094233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.094237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.094241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.094244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.094247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.094250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.094254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.094258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.094261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.094266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.094273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.094278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.094282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.094287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.094292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.094296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.094304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.094312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.094317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.094320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.094325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.094340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.094349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.094353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.094358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.094364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.094369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.094376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.094380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.094384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.094391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.094395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.094401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.094435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:14.096283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.096372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.096385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-10-02T09:28:14.096521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.096545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:14.096552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.096555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.096954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-10-02T09:28:14.096982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.096986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.096987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.096992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553839496073286:2731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.097404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553839496073286:2731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.099002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553839496073286:2731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.101812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553839496073286:2731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.101833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553839496073286:2731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:14.101836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553839496073286:2731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.101842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.102556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:14.104221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:14.104238Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:14.104240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.104244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.104250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [2:7556553839420555690:2617]
2025-10-02T09:28:14.104262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:14.104276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:14.104278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.104280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.104281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.104293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:14.104296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.104304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:14.104353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.104359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.104360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.104362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:14.104363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:14.104410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:14.104415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.104423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.104430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.104441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:14.104454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.104459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.104461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.104466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:14.104475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:14.104478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:14.104481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:14.104483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:14.104485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:14.104487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:14.104494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073226:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.104496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073321:2731], now have 1 active actors on pipe
2025-10-02T09:28:14.104520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.104527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:14.104534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:14.104572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 39
2025-10-02T09:28:14.104576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 39
2025-10-02T09:28:14.104670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.104680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.104699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3adf205-3de71769-4ed81420-b94d68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:14.104709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.104713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.104719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.104727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.104737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.104753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.105018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.105027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.105038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.105127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3adf205-3de71769-4ed81420-b94d68_0
2025-10-02T09:28:14.105454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d33fe3b-ba6dd9c5-e09f2107-d506821d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3adf205-3de71769-4ed81420-b94d68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.108443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Write session: try to update token
2025-10-02T09:28:14.108464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:14.114960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:14.114976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.114978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:14.114979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:14.114986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.114989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.114992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553839420555685:2617]
2025-10-02T09:28:14.115026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:14.115031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.115033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:14.115039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:14.115047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:14.115052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:14.115226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:14.124008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|f3adf205-3de71769-4ed81420-b94d68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:14.126467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:14.186046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553839496073328:2503]
2025-10-02T09:28:14.186310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7556553839496073328:2503]
2025-10-02T09:28:14.240539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:14.240835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.240849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.240862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073328:2503], now have 1 active actors on pipe
2025-10-02T09:28:14.241010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:14.241101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:14.241116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553839496073328:2503]
2025-10-02T09:28:14.241138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:14.241227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3adf205-3de71769-4ed81420-b94d68_0
2025-10-02T09:28:14.241386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|f3adf205-3de71769-4ed81420-b94d68_0 is DEAD
2025-10-02T09:28:14.241542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:14.241551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Write session will restart in 0.009299s
2025-10-02T09:28:14.241566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Write session: Do CDS request
2025-10-02T09:28:14.241570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:14.247858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.248189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.248338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.248349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:14.248361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.248416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.248454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839420555797:2620]
2025-10-02T09:28:14.248989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:14.249291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:14.249329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:14.249525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:14.249555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.249559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.249560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.249560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.249561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.249562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.249562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.249563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.249563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.249564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.249564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.249565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.249567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.249574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.249576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.249578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.249580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.249582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.249584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.249586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.249588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.249590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.249592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.249594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.249598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.249602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.249605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.249608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.249610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.249612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.249614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.249617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.249619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.249622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.249624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.249627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.249629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.249632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.249634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.249636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.249639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.249641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.249644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.249646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.249649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.249651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.249654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.249656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.249676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:14.252308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.252434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.252445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-10-02T09:28:14.252572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.252596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:14.252601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.252610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.252959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-10-02T09:28:14.252988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.252995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.252996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.253002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553839496073403:2736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.253424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553839496073403:2736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.255247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553839496073403:2736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.257350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553839496073403:2736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.257359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553839496073403:2736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:14.257364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553839496073403:2736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.257370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.258089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:14.259687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:14.259700Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:14.259703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.259706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.259711Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [2:7556553839420555797:2620]
2025-10-02T09:28:14.259722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:14.259742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:14.259749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.259752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.259753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.259765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:14.259774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.259784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:14.259856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.259862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.259863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.259865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:14.259867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:14.259929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:14.259934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.259942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.259947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.259959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:14.259975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073437:2736], now have 1 active actors on pipe
2025-10-02T09:28:14.259980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073342:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.259983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.259985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.259986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.259995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:14.260005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:14.260017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:14.260024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 40
2025-10-02T09:28:14.260042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 40
2025-10-02T09:28:14.260017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:14.260020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:14.260022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:14.260024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:14.260041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.260043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:14.260064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:14.260085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.260088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.260107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:14.260118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.260121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.260122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.260129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.260140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.260156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.260338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.260350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.260366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.260450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 36 sessionId: src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0
2025-10-02T09:28:14.260752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3adf205-3de71769-4ed81420-b94d68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.263885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Write session: try to update token
2025-10-02T09:28:14.263905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:14.275903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:14.275923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.275930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.275970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:14.275981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:14.276151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:14.276374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:14.276520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:14.276660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:14.276866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:14.276908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:14.279715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:14.280454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:14.280471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.280474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:14.280476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:14.280486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.280491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.280495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553839420555792:2620]
2025-10-02T09:28:14.280531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:14.280542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.280541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:14.280546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:14.280548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:14.280549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:14.280682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:14.282186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:14.341181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553839496073444:2503]
2025-10-02T09:28:14.341436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7556553839496073444:2503]
2025-10-02T09:28:14.412042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:14.412427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.412437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.412451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073444:2503], now have 1 active actors on pipe
2025-10-02T09:28:14.412632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:14.412698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553839496073444:2503]
2025-10-02T09:28:14.412721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:14.412728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:14.412891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0
2025-10-02T09:28:14.413048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0 is DEAD
2025-10-02T09:28:14.413187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:14.413197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Write session will restart in 0.006137s
2025-10-02T09:28:14.413218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Write session: Do CDS request
2025-10-02T09:28:14.413223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:14.419874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.420252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.420343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.420356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-10-02T09:28:14.420492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.420516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:14.420525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.420529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.420585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.420722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.420730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:14.420737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.420772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.420837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839420555893:2622]
2025-10-02T09:28:14.420925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-10-02T09:28:14.420956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.420960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.420962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.420966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553839496073503:2740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.421315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:14.421360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553839496073503:2740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.421614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:14.421644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:14.421853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:14.421887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.421891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.421892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.421893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.421894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.421895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.421896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.421897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.421898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.421899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.421900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.421901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.421905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.421914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.421918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.421921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.421925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.421929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.421932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.421936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.421939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.421943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.421946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.421950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.421960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.421970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.421979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.421985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.421993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.421997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.422001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.422006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.422009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.422018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.422026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.422031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.422034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.422038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.422040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.422045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.422050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.422053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.422055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.422057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.422060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.422062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.422064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.422067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.422085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:14.423154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553839496073503:2740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.428595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553839496073503:2740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.428608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553839496073503:2740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:14.428611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553839496073503:2740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.428620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.430436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:14.432139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:14.432157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:14.432160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.432163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.432169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [2:7556553839420555893:2622]
2025-10-02T09:28:14.432181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:14.432197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:14.432200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.432203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.432205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.432218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:14.432229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.432239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:14.432300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.432307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.432308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.432311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:14.432313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:14.432376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:14.432384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.432396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.432409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.432427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:14.432449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073446:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.432458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073543:2740], now have 1 active actors on pipe
2025-10-02T09:28:14.432464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.432466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.432468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.432479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:14.432492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:14.432506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:14.432510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:14.432513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:14.432516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:14.432509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 41
2025-10-02T09:28:14.432534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 41
2025-10-02T09:28:14.432518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:14.432539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.432542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:14.432546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:14.432574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.432583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.432606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a32192aa-7c45247e-1f555895-ea02000e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:14.432616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.432625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.432626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.432636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.432649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.432665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.432839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.432847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.432871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.432951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 36 sessionId: src_id|a32192aa-7c45247e-1f555895-ea02000e_0
2025-10-02T09:28:14.433238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4368084b-f1fb94d-42d17c75-e3f01df3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a32192aa-7c45247e-1f555895-ea02000e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.436132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Write session: try to update token
2025-10-02T09:28:14.436147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:14.443404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:14.443422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.443424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:14.443426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:14.443436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.443440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.443443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553839420555888:2622]
2025-10-02T09:28:14.443480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:14.443494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.443495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:14.443495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:14.443503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:14.443507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:14.443647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:14.450811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|a32192aa-7c45247e-1f555895-ea02000e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:14.453128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:14.512715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553839496073550:2503]
2025-10-02T09:28:14.513038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7556553839496073550:2503]
2025-10-02T09:28:14.577025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:14.577326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.577337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.577349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073550:2503], now have 1 active actors on pipe
2025-10-02T09:28:14.577486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:14.577580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:14.577586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553839496073550:2503]
2025-10-02T09:28:14.577612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:14.577692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a32192aa-7c45247e-1f555895-ea02000e_0
2025-10-02T09:28:14.577866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|a32192aa-7c45247e-1f555895-ea02000e_0 is DEAD
2025-10-02T09:28:14.577988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:14.577997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Write session will restart in 0.007928s
2025-10-02T09:28:14.578016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Write session: Do CDS request
2025-10-02T09:28:14.578022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:14.585320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.585838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.585994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.586004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:14.586012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.586056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.586118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839420555990:2624]
2025-10-02T09:28:14.586680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:14.586968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:14.587008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:14.587254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:14.587289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.587293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.587294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.587295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.587295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.587296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.587297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.587297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.587298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.587298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.587299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.587299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.587302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.587309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.587311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.587313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.587315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.587317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.587320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.587322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.587324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.587326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.587328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.587370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.587330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.587336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.587343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.587347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.587352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.587356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.587360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.587364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.587368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.587372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.587376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.587380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.587383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.587388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.587393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.587397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.587401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.587405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.587409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.587413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.587418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.587422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.587427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.587433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.587438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.587470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:14.587544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.587563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-10-02T09:28:14.587661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.587690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:14.587696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.587699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.588049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-10-02T09:28:14.588074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.588075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.588076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.588080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553839496073614:2744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.588484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553839496073614:2744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.589920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553839496073614:2744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.594650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553839496073614:2744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.594664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553839496073614:2744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:14.594668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553839496073614:2744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.594677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.596012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:14.597729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:14.597741Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:14.597742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.597745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.597751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [2:7556553839420555990:2624]
2025-10-02T09:28:14.597762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:14.597776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:14.597779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.597781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.597783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.597795Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:14.597798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.597803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:14.597839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.597845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.597846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.597848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:14.597850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:14.597905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:14.597910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.597917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.597922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.597931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:14.597947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073552:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.597953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073650:2744], now have 1 active actors on pipe
2025-10-02T09:28:14.597956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.597958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.597959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.597968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:14.597976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:14.597988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:14.597992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:14.597994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:14.597996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:14.597998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:14.598014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.598020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:14.598023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:14.598045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 42
2025-10-02T09:28:14.598050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 42
2025-10-02T09:28:14.598154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.598163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.598182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60bf782-790f7179-7d2eb35d-6f6485_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:14.598190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.598192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.598194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.598201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.598211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.598219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.598392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.598399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.598411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.598483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 36 sessionId: src_id|60bf782-790f7179-7d2eb35d-6f6485_0
2025-10-02T09:28:14.598770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32192aa-7c45247e-1f555895-ea02000e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60bf782-790f7179-7d2eb35d-6f6485_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.601808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Write session: try to update token
2025-10-02T09:28:14.601823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:14.608610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:14.608625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.608627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:14.608629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:14.608635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.608639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.608643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553839420555985:2624]
2025-10-02T09:28:14.608676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:14.608682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.608686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:14.608695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:14.608705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:14.608708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:14.608826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:14.616834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|60bf782-790f7179-7d2eb35d-6f6485_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:14.619161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:14.677543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553839496073657:2503]
2025-10-02T09:28:14.677786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7556553839496073657:2503]
2025-10-02T09:28:14.711850Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T09:28:14.711867Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T09:28:14.744022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:14.744263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.744273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.744288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073657:2503], now have 1 active actors on pipe
2025-10-02T09:28:14.744477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:14.744509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:14.744549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:14.744618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60bf782-790f7179-7d2eb35d-6f6485_0
2025-10-02T09:28:14.744748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|60bf782-790f7179-7d2eb35d-6f6485_0 is DEAD
2025-10-02T09:28:14.744878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:14.744888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Write session will restart in 0.007320s
2025-10-02T09:28:14.744911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Write session: Do CDS request
2025-10-02T09:28:14.744918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:14.744914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553839496073657:2503]
2025-10-02T09:28:14.752143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.752725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.752882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.752892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:14.752899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.752943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.752977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839420556103:2633]
2025-10-02T09:28:14.753227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.753335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.753353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-10-02T09:28:14.753470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.753483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:14.753503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:14.753508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.753513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.753750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:14.753778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:14.753899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-10-02T09:28:14.753935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.753941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.753943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.753949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553839496073742:2755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.753986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:14.754025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.754029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.754030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.754031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.754031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.754032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.754033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.754033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.754034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.754034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.754035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.754036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.754040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.754050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.754053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.754056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.754059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.754062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.754065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.754068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.754071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.754074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.754077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.754080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.754086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.754092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.754097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.754101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.754105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.754109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.754113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.754117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.754121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.754124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.754130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.754134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.754138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.754143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.754147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.754150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.754153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.754155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.754158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.754161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.754163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.754166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.754169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.754173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.754207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:14.754576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553839496073742:2755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.756557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553839496073742:2755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.762760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553839496073742:2755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.762775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553839496073742:2755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:14.762780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553839496073742:2755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.762787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.763428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:14.765187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:14.765204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:14.765206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.765209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.765214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [2:7556553839420556103:2633]
2025-10-02T09:28:14.765225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:14.765241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:14.765244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.765247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.765248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.765260Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:14.765265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.765275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:14.765322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.765328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.765330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.765333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:14.765335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:14.765388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:14.765394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.765407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.765421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.765440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:14.765464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073781:2755], now have 1 active actors on pipe
2025-10-02T09:28:14.765466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073679:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.765471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.765473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.765475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.765484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:14.765482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 43
2025-10-02T09:28:14.765506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 43
2025-10-02T09:28:14.765500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:14.765501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:14.765504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:14.765506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:14.765518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:14.765520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:14.765553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.765557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.765570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.765581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:14.765586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:14.765605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:14.765612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.765616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.765622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.765629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.765638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.765659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.765766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.765775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.765785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.765870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 36 sessionId: src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0
2025-10-02T09:28:14.766147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf782-790f7179-7d2eb35d-6f6485_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.769042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Write session: try to update token
2025-10-02T09:28:14.769057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:14.776855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:14.776869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.776871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:14.776874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:14.776880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.776882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.776885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553839420556097:2633]
2025-10-02T09:28:14.776917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:14.776923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.776922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:14.776927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:14.776927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:14.776929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:14.777066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:14.784874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:14.787342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:14.844974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553839496073798:2503]
2025-10-02T09:28:14.845250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7556553839496073798:2503]
2025-10-02T09:28:14.910942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:14.911655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.911670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.911686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073798:2503], now have 1 active actors on pipe
2025-10-02T09:28:14.911895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553839496073798:2503]
2025-10-02T09:28:14.911935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:14.911938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:14.912001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: error at write: Disconnected sessionId: src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0
2025-10-02T09:28:14.912003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:14.912172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0 is DEAD
2025-10-02T09:28:14.912286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:14.912296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Write session will restart in 0.008113s
2025-10-02T09:28:14.912315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Write session: Do CDS request
2025-10-02T09:28:14.912323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:14.913358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:14.920879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:14.921206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.921275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:14.921288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-10-02T09:28:14.921393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:14.921413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:14.921437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:14.921441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:14.921445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:14.921535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:14.921543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:14.921551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:14.921595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:14.921651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553839420556225:2641]
2025-10-02T09:28:14.921835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-10-02T09:28:14.921872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:14.921879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:14.921881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:14.921887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553839496073860:2760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:14.922232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:14.922420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553839496073860:2760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:14.922475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:14.922509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:14.922784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:14.922828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.922829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.922830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.922831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.922832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.922833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.922834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.922835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.922836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.922837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.922838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.922838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.922843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.922852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.922856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.922860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.922863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.922867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.922870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.922874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.922877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.922881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.922884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.922888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.922892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.922899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:14.922903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.922908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:14.922924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.922935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:14.922939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.922944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:14.922948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.922953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:14.922957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.922962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:14.922966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.922971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:14.922975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.922979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:14.922983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.922988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:14.922996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.923001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.923009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.923014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.923022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.923027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.923064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:14.923777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553839496073860:2760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:14.928780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553839496073860:2760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:14.928794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553839496073860:2760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:14.928796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553839496073860:2760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:14.928817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:14.932087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:14.933855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:14.933869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:14.933872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:14.933875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:14.933881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [2:7556553839420556225:2641]
2025-10-02T09:28:14.933893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:14.933908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:14.933910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.933913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.933914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.933927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:14.933934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:14.933939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:14.933991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.933997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.934000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.934002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:14.934004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:14.934067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:14.934073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.934084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:14.934097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:14.934115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:14.934138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073800:2446], now have 1 active actors on pipe
2025-10-02T09:28:14.934147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.934150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.934152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.934162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:14.934175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553839496073900:2760], now have 1 active actors on pipe
2025-10-02T09:28:14.934183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:14.934188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:14.934188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:14.934191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:14.934200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:14.934203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:14.934228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.934239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:14.934247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:14.934245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 44
2025-10-02T09:28:14.934247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 44
2025-10-02T09:28:14.934290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.934297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.934317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6121613e-f883e33d-8850422e-f848ceb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:14.934326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:14.934329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:14.934331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:14.934338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:14.934345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:14.934359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.934480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:14.934486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:14.934497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:14.934566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 36 sessionId: src_id|6121613e-f883e33d-8850422e-f848ceb1_0
2025-10-02T09:28:14.934864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60e4f03-acaae0c3-85a396d7-fe27a5aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6121613e-f883e33d-8850422e-f848ceb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:14.938436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Write session: try to update token
2025-10-02T09:28:14.938451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:14.945702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:14.945717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:14.945719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:14.945720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:14.945728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.945732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.945735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553839420556220:2641]
2025-10-02T09:28:14.945769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:14.945775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:14.945781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:14.945792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:14.945809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:14.945813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:14.945927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:14.955588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId: src_id|6121613e-f883e33d-8850422e-f848ceb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:14.958413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.011903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041203:2503]
2025-10-02T09:28:15.012268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7556553843791041203:2503]
2025-10-02T09:28:15.072102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:15.072490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.072502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.072515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041203:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.072683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:15.072782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:15.072828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041203:2503]
2025-10-02T09:28:15.072849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:15.072948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6121613e-f883e33d-8850422e-f848ceb1_0
2025-10-02T09:28:15.073104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|6121613e-f883e33d-8850422e-f848ceb1_0 is DEAD
2025-10-02T09:28:15.073268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:15.073280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Write session will restart in 0.008290s
2025-10-02T09:28:15.073298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Write session: Do CDS request
2025-10-02T09:28:15.073303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:15.080230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:15.080635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:15.080752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:15.080757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:15.080764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:15.080793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:15.080833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553843715523623:2644]
2025-10-02T09:28:15.081192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:15.081407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:15.081431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:15.081627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:15.081659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.081664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.081664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.081665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.081665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.081666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.081666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.081667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.081667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.081668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.081669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.081669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.081672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.081679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.081681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.081683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.081685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.081687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.081689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.081691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.081693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.081695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.081697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.081700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.081703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.081708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.081711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.081714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.081716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.081719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.081721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.081723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.081726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.081728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.081730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.081733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.081735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.081738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.081740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.081743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.081745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.081748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.081750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.081753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.081756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.081759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.081761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.081764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.081781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:15.082281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.082347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.082357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-10-02T09:28:15.082462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.082484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:15.082492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.082500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.082903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-10-02T09:28:15.082938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.082947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.082948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.082954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553843791041272:2765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.083464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553843791041272:2765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.085312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553843791041272:2765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.089334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553843791041272:2765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.089347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553843791041272:2765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:15.089350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553843791041272:2765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.089358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.090096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:15.091955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:15.091965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:15.091967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:15.091971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:15.091976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [2:7556553843715523623:2644]
2025-10-02T09:28:15.091985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:15.092005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:15.092014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.092017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.092018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.092032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:15.092037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:15.092044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:15.092089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.092095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.092097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.092100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:15.092102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:15.092171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:15.092179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.092188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.092199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.092218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:15.092238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041205:2446], now have 1 active actors on pipe
2025-10-02T09:28:15.092245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041306:2765], now have 1 active actors on pipe
2025-10-02T09:28:15.092249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.092251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.092253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.092262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:15.092277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:15.092279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:15.092282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:15.092286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:15.092295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:15.092301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:15.092326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.092332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:15.092334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:15.092306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 45
2025-10-02T09:28:15.092352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.092360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.092384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:15.092394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.092397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.092399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.092407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.092413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.092429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.092448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 45
2025-10-02T09:28:15.092522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.092528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.092541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.092608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0
2025-10-02T09:28:15.092897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6121613e-f883e33d-8850422e-f848ceb1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.095344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Write session: try to update token
2025-10-02T09:28:15.095355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:15.102992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:15.103006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:15.103009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:15.103010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:15.103017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.103021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.103024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553843715523618:2644]
2025-10-02T09:28:15.103058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:15.103068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.103066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:15.103071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:15.103075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:15.103076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:15.103237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:15.109434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:15.112319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.173163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041320:2503]
2025-10-02T09:28:15.173454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7556553843791041320:2503]
2025-10-02T09:28:15.235657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:15.235895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.235906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.235919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041320:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.236080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:15.236131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:15.236141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041320:2503]
2025-10-02T09:28:15.236164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:15.236233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0
2025-10-02T09:28:15.236398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0 is DEAD
2025-10-02T09:28:15.236522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:15.236528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Write session will restart in 0.007692s
2025-10-02T09:28:15.236543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Write session: Do CDS request
2025-10-02T09:28:15.236549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:15.244784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:15.245188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.245235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:15.245286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.245298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-10-02T09:28:15.245381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:15.245388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:15.245394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:15.245402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.245423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:15.245426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.245426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:15.245430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.245450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553843715523739:2646]
2025-10-02T09:28:15.245830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-10-02T09:28:15.245851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:15.245859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.245864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.245865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.245870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553843791041397:2771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.246124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:15.246176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:15.246311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553843791041397:2771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.246509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:15.246558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.246563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.246564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.246565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.246566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.246567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.246575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.246576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.246577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.246578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.246579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.246581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.246586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.246595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.246599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.246603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.246607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.246610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.246614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.246618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.246622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.246625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.246629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.246633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.246638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.246645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.246650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.246655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.246660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.246664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.246668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.246673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.246677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.246682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.246686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.246695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.246699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.246704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.246711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.246716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.246720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.246725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.246733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.246738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.246742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.246747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.246751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.246753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.246777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:15.247774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553843791041397:2771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.252986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553843791041397:2771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.252996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553843791041397:2771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:15.252998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553843791041397:2771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.253003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.255522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:15.257241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:15.257254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:15.257257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:15.257261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:15.257267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [2:7556553843715523739:2646]
2025-10-02T09:28:15.257279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:15.257298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:15.257305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.257308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.257310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.257322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:15.257332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:15.257341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:15.257394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.257400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.257403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.257406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:15.257409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:15.257469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:15.257478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.257491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.257504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.257523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:15.257544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041323:2446], now have 1 active actors on pipe
2025-10-02T09:28:15.257552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041435:2771], now have 1 active actors on pipe
2025-10-02T09:28:15.257558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.257564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.257566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.257587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 46
2025-10-02T09:28:15.257576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:15.257595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:15.257598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:15.257601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:15.257602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:15.257610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:15.257613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:15.257642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.257645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:15.257647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:15.257666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.257670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.257661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 46
2025-10-02T09:28:15.257697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1051958-79e32f8-445633ec-60b03d43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:15.257708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.257712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.257714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.257721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.257729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.257748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.257898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.257907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.257922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.258016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 36 sessionId: src_id|1051958-79e32f8-445633ec-60b03d43_0
2025-10-02T09:28:15.258343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9e35b3-b42ae94a-6aa86504-44e3e8f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1051958-79e32f8-445633ec-60b03d43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.261559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Write session: try to update token
2025-10-02T09:28:15.261580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:15.269037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:15.269054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:15.269057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:15.269059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:15.269069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.269073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.269077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553843715523733:2646]
2025-10-02T09:28:15.269111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:15.269114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:15.269117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.269120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:15.269120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:15.269123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:15.269251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:15.277695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|1051958-79e32f8-445633ec-60b03d43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:15.280124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.336496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041443:2503]
2025-10-02T09:28:15.336749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7556553843791041443:2503]
2025-10-02T09:28:15.398007Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:15.398304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.398313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.398326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041443:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.398467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:15.398489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:15.398500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:15.398517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041443:2503]
2025-10-02T09:28:15.398535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:15.398568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: error at write: Disconnected sessionId: src_id|1051958-79e32f8-445633ec-60b03d43_0
2025-10-02T09:28:15.398715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|1051958-79e32f8-445633ec-60b03d43_0 is DEAD
2025-10-02T09:28:15.398886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:15.398911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Write session will restart in 0.009214s
2025-10-02T09:28:15.398944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Write session: Do CDS request
2025-10-02T09:28:15.398950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:15.404424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:15.404855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:15.404981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:15.404987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:15.404993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:15.405031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:15.405065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553843715523841:2649]
2025-10-02T09:28:15.405450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:15.405698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:15.405739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:15.405989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:15.406023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.406027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.406028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.406028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.406029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.406029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.406030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.406031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.406031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.406031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.406032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.406032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.406036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.406042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.406045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.406047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.406049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.406052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.406055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.406058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.406062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.406065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.406068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.406072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.406077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.406084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.406089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.406092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.406094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.406097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.406099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.406102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.406105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.406107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.406110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.406112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.406115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.406118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.406120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.406123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.406125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.406128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.406130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.406132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.406135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.406137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.406139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.406142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.406159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:15.409314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.409307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.409317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-10-02T09:28:15.409573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.409595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:15.409603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.409606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.410042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-10-02T09:28:15.410088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.410093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.410095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.410100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553843791041512:2775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.410551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553843791041512:2775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.412339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553843791041512:2775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.414363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553843791041512:2775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.414375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553843791041512:2775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:15.414379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553843791041512:2775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.414385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.414440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:15.416022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:15.416032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:15.416034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:15.416036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:15.416040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [2:7556553843715523841:2649]
2025-10-02T09:28:15.416050Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:15.416063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:15.416064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.416066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.416067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.416077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:15.416083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:15.416087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:15.416124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.416129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.416131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.416133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:15.416134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:15.416222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:15.416228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.416235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.416241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.416251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:15.416268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041445:2446], now have 1 active actors on pipe
2025-10-02T09:28:15.416273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041547:2775], now have 1 active actors on pipe
2025-10-02T09:28:15.416277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.416278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.416280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.416289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:15.416285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 47
2025-10-02T09:28:15.416302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:15.416303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:15.416306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:15.416308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:15.416311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 47
2025-10-02T09:28:15.416319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:15.416326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:15.416354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.416359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.416370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.416379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:15.416396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:15.416401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41b4588a-d102953c-571c5688-3dea6096_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:15.416412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.416417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.416418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.416424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.416433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.416446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.416582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.416587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.416596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.416672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 36 sessionId: src_id|41b4588a-d102953c-571c5688-3dea6096_0
2025-10-02T09:28:15.416990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1051958-79e32f8-445633ec-60b03d43_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41b4588a-d102953c-571c5688-3dea6096_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.419773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Write session: try to update token
2025-10-02T09:28:15.419785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:15.426632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:15.426644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:15.426645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:15.426646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:15.426653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.426657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.426660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553843715523836:2649]
2025-10-02T09:28:15.426694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:15.426695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:15.426701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:15.426704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:15.426704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.426706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:15.426829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:15.433468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId: src_id|41b4588a-d102953c-571c5688-3dea6096_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:15.435982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.498805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041554:2503]
2025-10-02T09:28:15.499063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7556553843791041554:2503]
2025-10-02T09:28:15.551693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:15.551927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.551936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.551950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041554:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.552142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:15.552215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:15.552215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:15.552266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041554:2503]
2025-10-02T09:28:15.552323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41b4588a-d102953c-571c5688-3dea6096_0
2025-10-02T09:28:15.552469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|41b4588a-d102953c-571c5688-3dea6096_0 is DEAD
2025-10-02T09:28:15.552604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:15.552614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Write session will restart in 0.007677s
2025-10-02T09:28:15.552629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Write session: Do CDS request
2025-10-02T09:28:15.552633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:15.558981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:15.559354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:15.559492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:15.559498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:15.559506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:15.559539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:15.559563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553843715523944:2651]
2025-10-02T09:28:15.559955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:15.560166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:15.560191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:15.560396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:15.560438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.560442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.560443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.560443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.560444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.560444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.560445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.560446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.560446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.560447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.560447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.560448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.560451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.560457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.560459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.560461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.560464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.560466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.560468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.560470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.560472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.560474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.560476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.560479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.560483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.560487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.560491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.560494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.560497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.560500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.560502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.560505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.560508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.560511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.560513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.560516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.560518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.560521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.560523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.560526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.560528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.560531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.560533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.560536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.560538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.560541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.560543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.560548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.560567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:15.561191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.561234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.561247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-10-02T09:28:15.561404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.561441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:15.561448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.561452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.561760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-10-02T09:28:15.561787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.561788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.561789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.561792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553843791041624:2779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.562154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553843791041624:2779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.563562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553843791041624:2779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.567775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553843791041624:2779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.567791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553843791041624:2779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:15.567794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553843791041624:2779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.567805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.569317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:15.570849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:15.570860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:15.570861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:15.570864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:15.570867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [2:7556553843715523944:2651]
2025-10-02T09:28:15.570875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:15.570886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:15.570888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.570889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.570890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.570901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:15.570904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:15.570908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:15.570945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.570950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.570951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.570953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:15.570955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:15.571007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:15.571013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.571024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.571036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.571054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:15.571071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.571076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.571078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.571088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:15.571103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041555:2446], now have 1 active actors on pipe
2025-10-02T09:28:15.571105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:15.571107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:15.571108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:15.571110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041659:2779], now have 1 active actors on pipe
2025-10-02T09:28:15.571117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:15.571129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:15.571135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:15.571156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.571164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:15.571184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:15.571174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 48
2025-10-02T09:28:15.571182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 48
2025-10-02T09:28:15.571243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.571253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.571271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83dea90-89bee330-efab2bf2-49afc507_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:15.571280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.571288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.571294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.571302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.571310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.571325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.571444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.571451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.571462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.571520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 36 sessionId: src_id|83dea90-89bee330-efab2bf2-49afc507_0
2025-10-02T09:28:15.571806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b4588a-d102953c-571c5688-3dea6096_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83dea90-89bee330-efab2bf2-49afc507_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.574244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Write session: try to update token
2025-10-02T09:28:15.574258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:15.581631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:15.581643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:15.581645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:15.581646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:15.581653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.581656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.581659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553843715523939:2651]
2025-10-02T09:28:15.581699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:15.581705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.581704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:15.581707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:15.581708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:15.581711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:15.581920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:15.588737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|83dea90-89bee330-efab2bf2-49afc507_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:15.591591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.652394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041666:2503]
2025-10-02T09:28:15.652652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7556553843791041666:2503]
2025-10-02T09:28:15.714660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:15.714966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.714978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.714994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041666:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.715224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:15.715230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:15.715250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041666:2503]
2025-10-02T09:28:15.715274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:15.715359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83dea90-89bee330-efab2bf2-49afc507_0
2025-10-02T09:28:15.715518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|83dea90-89bee330-efab2bf2-49afc507_0 is DEAD
2025-10-02T09:28:15.715632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:15.715641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Write session will restart in 0.007262s
2025-10-02T09:28:15.715662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Write session: Do CDS request
2025-10-02T09:28:15.715668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:15.724267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:15.724313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.724390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.724405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-10-02T09:28:15.724610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.724638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:15.724647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.724652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.724744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:15.724918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:15.724928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:15.724947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:15.724994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:15.725029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553843715524048:2653]
2025-10-02T09:28:15.725064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-10-02T09:28:15.725093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.725099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.725100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.725105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553843791041741:2784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.725613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:15.725652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553843791041741:2784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.725920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:15.725961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:15.726261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:15.726308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.726314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.726315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.726316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.726317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.726318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.726319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.726320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.726321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.726322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.726323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.726324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.726329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.726338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.726341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.726345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.726349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.726356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.726359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.726363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.726366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.726370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.726374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.726378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.726384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.726390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.726395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.726400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.726404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.726409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.726413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.726418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.726422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.726425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.726429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.726431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.726434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.726437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.726439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.726442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.726444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.726447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.726449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.726452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.726455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.726457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.726459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.726474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.726505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:15.727195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553843791041741:2784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.732992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553843791041741:2784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.733005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553843791041741:2784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:15.733008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553843791041741:2784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.733014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.734849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:15.736581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:15.736596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:15.736598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:15.736601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:15.736605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [2:7556553843715524048:2653]
2025-10-02T09:28:15.736614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:15.736625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:15.736627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.736628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.736630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.736638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:15.736641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:15.736646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:15.736684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.736690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.736692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.736693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:15.736695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:15.736743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:15.736746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.736754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.736763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.736773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:15.736789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041781:2784], now have 1 active actors on pipe
2025-10-02T09:28:15.736795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041676:2446], now have 1 active actors on pipe
2025-10-02T09:28:15.736800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.736822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.736824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.736840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:15.736852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:15.736855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:15.736865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:15.736868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:15.736868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:15.736870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:15.736890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.736900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:15.736885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 49
2025-10-02T09:28:15.736908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:15.736896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 49
2025-10-02T09:28:15.736930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.736934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.736958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:15.736968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.736971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.736972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.736980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.736987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.736995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.737140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.737145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.737153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.737209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 36 sessionId: src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0
2025-10-02T09:28:15.737530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dea90-89bee330-efab2bf2-49afc507_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.740169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Write session: try to update token
2025-10-02T09:28:15.740183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:15.747616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:15.747633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:15.747639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:15.747641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:15.747650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.747654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.747658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553843715524043:2653]
2025-10-02T09:28:15.747693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:15.747703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.747705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:15.747710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:15.747716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:15.747719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:15.748002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:15.755493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:15.758333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.815189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041813:2503]
2025-10-02T09:28:15.815445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7556553843791041813:2503]
2025-10-02T09:28:15.876311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:15.876604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.876616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.876633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041813:2503], now have 1 active actors on pipe
2025-10-02T09:28:15.876784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:15.876865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041813:2503]
2025-10-02T09:28:15.876872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:15.876899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:15.876995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: status is not ok: tablet will be restarted right now sessionId: src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0
2025-10-02T09:28:15.877152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0 is DEAD
2025-10-02T09:28:15.877297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:15.877316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Write session will restart in 0.008268s
2025-10-02T09:28:15.877339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Write session: Do CDS request
2025-10-02T09:28:15.877345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:15.883654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:15.884007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:15.884129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:15.884135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:15.884142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:15.884174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:15.884199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553843715524191:2668]
2025-10-02T09:28:15.884593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:15.884845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:15.884895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:15.885138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:15.885175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.885179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.885180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.885180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.885181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.885181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.885182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.885182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.885183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.885183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.885184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.885184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.885188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.885194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.885197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.885199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.885201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.885203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.885205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.885207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.885209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.885211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.885213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.885215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.885219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.885223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:15.885226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.885229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:15.885231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.885234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:15.885236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.885239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:15.885241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.885244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:15.885246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.885249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:15.885251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.885254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:15.885256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.885259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:15.885261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.885264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:15.885266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.885270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.885273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.885275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.885277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.885280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.885297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:15.886258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.886396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:15.886412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-10-02T09:28:15.886521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:15.886570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:15.886584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:15.886589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:15.887055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-10-02T09:28:15.887097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:15.887105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:15.887107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:15.887114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553843791041884:2795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:15.887724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553843791041884:2795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:15.889771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553843791041884:2795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:15.892778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553843791041884:2795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:15.892791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553843791041884:2795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:15.892793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553843791041884:2795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:15.892798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:15.893354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:15.894918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:15.894929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:15.894930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:15.894932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:15.894936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [2:7556553843715524191:2668]
2025-10-02T09:28:15.894944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:15.894956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:15.894964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.894966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.894967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.894977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:15.894980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:15.894984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:15.895019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.895024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.895025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.895027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:15.895028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:15.895079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:15.895085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.895094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:15.895100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:15.895109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:15.895125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041814:2446], now have 1 active actors on pipe
2025-10-02T09:28:15.895135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041919:2795], now have 1 active actors on pipe
2025-10-02T09:28:15.895141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.895143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.895145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.895156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:15.895177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:15.895179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:15.895180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:15.895183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:15.895188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:15.895190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:15.895208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.895215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:15.895218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:15.895226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 50
2025-10-02T09:28:15.895309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.895317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.895328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 50
2025-10-02T09:28:15.895338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14c907bf-2469ce2c-703a8745-548bbfea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:15.895347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:15.895350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:15.895352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:15.895359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:15.895370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:15.895383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.895581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:15.895589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:15.895609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:15.895771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 36 sessionId: src_id|14c907bf-2469ce2c-703a8745-548bbfea_0
2025-10-02T09:28:15.896094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145a45c2-25405b56-3cda62b5-c4c5115b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14c907bf-2469ce2c-703a8745-548bbfea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:15.898719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Write session: try to update token
2025-10-02T09:28:15.898732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:15.906378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:15.906399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:15.906401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:15.906403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:15.906412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.906416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.906419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553843715524186:2668]
2025-10-02T09:28:15.906453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:15.906453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:15.906457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:15.906458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:15.906459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:15.906475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:15.906590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:15.914197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|14c907bf-2469ce2c-703a8745-548bbfea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:15.916508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:15.977071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553843791041927:2503]
2025-10-02T09:28:15.977407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7556553843791041927:2503]
2025-10-02T09:28:16.038934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:16.039391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.039400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.039415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553843791041927:2503], now have 1 active actors on pipe
2025-10-02T09:28:16.039717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553843791041927:2503]
2025-10-02T09:28:16.039752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:16.039791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:16.039799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:16.039877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|14c907bf-2469ce2c-703a8745-548bbfea_0
2025-10-02T09:28:16.039656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:16.040005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|14c907bf-2469ce2c-703a8745-548bbfea_0 is DEAD
2025-10-02T09:28:16.040130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:16.040141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Write session will restart in 0.007340s
2025-10-02T09:28:16.040169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Write session: Do CDS request
2025-10-02T09:28:16.040176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:16.048307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.048399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.048416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-10-02T09:28:16.048600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.048657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:16.048668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:16.048673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.049192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-10-02T09:28:16.049235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.049237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.049239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.049248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553848086009231:2799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.049824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553848086009231:2799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.052174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553848086009231:2799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.058203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553848086009231:2799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.058220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553848086009231:2799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:16.058224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553848086009231:2799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.058234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.061046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.062013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.062241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.062265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:16.062276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.062341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.062382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553848010491597:2670]
2025-10-02T09:28:16.063000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:16.063399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:16.063461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:16.063772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:16.063848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.063854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.063855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.063856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.063858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.063859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.063860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.063861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.063862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.063864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.063865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.063866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.063871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.063881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.063885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.063890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.063894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.063897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.063901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.063904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.063908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.063913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.063917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.063920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.063928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.063934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.063941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.063946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.063950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.063954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.063959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.063965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.063970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.063974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.063978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.063983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.063987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.063992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.063999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.064004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.064020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.064026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.064031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.064036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.064040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.064046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.064051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.064056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.064090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:16.074582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:16.076297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:16.076315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:16.076318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.076322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.076329Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [2:7556553848010491597:2670]
2025-10-02T09:28:16.076342Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:16.076360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:16.076364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.076367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.076369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.076384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:16.076390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.076397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.076455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.076466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.076468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.076471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:16.076474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:16.076544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:16.076551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.076565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.076582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.076606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:16.076629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009298:2799], now have 1 active actors on pipe
2025-10-02T09:28:16.076646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009224:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.076656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.076658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.076661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.076674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:16.076690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:16.076690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:16.076693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:16.076695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:16.076710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:16.076715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.076745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.076757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:16.076773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:16.076748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 51
2025-10-02T09:28:16.076749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 51
2025-10-02T09:28:16.076796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.076824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.076853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.076864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.076872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.076875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.076888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.076901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.076919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.077085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.077093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.077105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.077247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 36 sessionId: src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0
2025-10-02T09:28:16.077644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c907bf-2469ce2c-703a8745-548bbfea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.080877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Write session: try to update token
2025-10-02T09:28:16.080896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:16.088354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:16.088369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.088371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:16.088372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:16.088381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.088385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.088387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553848010491592:2670]
2025-10-02T09:28:16.088413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:16.088417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.088418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:16.088434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:16.088448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:16.088452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:16.088557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:16.097328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.100538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.139803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553848086009340:2503]
2025-10-02T09:28:16.139941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7556553848086009340:2503]
2025-10-02T09:28:16.225530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:16.225956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.225971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.225989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009340:2503], now have 1 active actors on pipe
2025-10-02T09:28:16.226284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:16.226299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:16.226357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0
2025-10-02T09:28:16.226371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553848086009340:2503]
2025-10-02T09:28:16.226410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:16.226542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0 is DEAD
2025-10-02T09:28:16.226254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:16.226917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:16.226925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Write session will restart in 0.009308s
2025-10-02T09:28:16.226948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Write session: Do CDS request
2025-10-02T09:28:16.226954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:16.237486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.237922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.237911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.238071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.238077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:16.238083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.238117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.238091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.238103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-10-02T09:28:16.238143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553848010491702:2673]
2025-10-02T09:28:16.238224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.238252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:16.238257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:16.238262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.238669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:16.238769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-10-02T09:28:16.238831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.238840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.238842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.238849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553848086009412:2804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.238982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:16.239020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:16.239310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:16.239371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.239379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.239380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.239381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.239382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.239383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.239384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.239385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.239386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.239387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.239387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.239388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.239403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553848086009412:2804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.239393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.239402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.239405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.239409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.239412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.239416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.239419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.239423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.239426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.239429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.239433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.239435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.239442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.239448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.239453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.239457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.239461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.239466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.239470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.239475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.239479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.239483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.239488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.239492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.239497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.239501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.239505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.239510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.239514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.239518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.239522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.239531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.239535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.239543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.239550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.239555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.239592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:16.241466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553848086009412:2804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.246980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553848086009412:2804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.246997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553848086009412:2804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:16.247001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553848086009412:2804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.247010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.248494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:16.250271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:16.250284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:16.250285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.250288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.250292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [2:7556553848010491702:2673]
2025-10-02T09:28:16.250301Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:16.250312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:16.250314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.250315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.250316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.250325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:16.250328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.250333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.250370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.250375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.250376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.250378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:16.250380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:16.250421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:16.250425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.250433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.250438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.250446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:16.250463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009342:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.250470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.250472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.250473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.250478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:16.250483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009461:2804], now have 1 active actors on pipe
2025-10-02T09:28:16.250488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:16.250488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:16.250491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:16.250493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:16.250495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:16.250496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.250518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.250523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:16.250529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:16.250546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 52
2025-10-02T09:28:16.250552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 52
2025-10-02T09:28:16.250637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.250644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.250666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.250676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.250679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.250683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.250690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.250699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.250709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.250867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.250871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.250880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.250952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 36 sessionId: src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0
2025-10-02T09:28:16.251363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2490b657-ce9c1e02-9a87d28e-db0cafcc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.254432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Write session: try to update token
2025-10-02T09:28:16.254451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:16.260130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:16.260144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.260149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.260174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:16.260176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:16.260331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:16.260452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:16.260582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:16.260706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:16.260893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:16.260924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:16.269480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:16.269494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.269496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:16.269498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:16.269505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.269508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.269512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553848010491697:2673]
2025-10-02T09:28:16.269543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:16.269548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.269550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:16.269552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:16.269556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:16.269559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:16.269712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:16.270517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.273020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.326748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553848086009469:2503]
2025-10-02T09:28:16.327798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7556553848086009469:2503]
2025-10-02T09:28:16.412629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:16.412949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.412962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.412980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009469:2503], now have 1 active actors on pipe
2025-10-02T09:28:16.413207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:16.413196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553848086009469:2503]
2025-10-02T09:28:16.413229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:16.413231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:16.413282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: error at write: Disconnected sessionId: src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0
2025-10-02T09:28:16.413308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:16.413418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0 is DEAD
2025-10-02T09:28:16.413551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:16.413562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Write session will restart in 0.005833s
2025-10-02T09:28:16.413585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Write session: Do CDS request
2025-10-02T09:28:16.413590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:16.420146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.420226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.420239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-10-02T09:28:16.420382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.420411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:16.420415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:16.420419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.420909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-10-02T09:28:16.420947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.420949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.420950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.420955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553848086009540:2809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.421027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.421399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553848086009540:2809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.421436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.421558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.421566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:16.421574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.421616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.421645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553848010491823:2676]
2025-10-02T09:28:16.422015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:16.422227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:16.422250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:16.422471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:16.422506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.422510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.422511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.422511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.422512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.422513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.422513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.422514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.422514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.422515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.422515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.422516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.422518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.422525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.422527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.422529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.422531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.422533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.422536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.422539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.422542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.422546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.422549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.422553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.422557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.422567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.422572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.422577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.422585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.422589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.422596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.422600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.422605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.422610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.422617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.422622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.422630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.422634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.422642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.422646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.422653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.422656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.422658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.422662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.422667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.422670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.422672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.422675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.422692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:16.423078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553848086009540:2809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
E1002 09:28:16.425514622 3223120 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:13253: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T09:28:16.428047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553848086009540:2809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.428060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553848086009540:2809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:16.428065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553848086009540:2809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.428073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.431053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:16.432743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:16.432759Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:16.432761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.432764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.432770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [2:7556553848010491823:2676]
2025-10-02T09:28:16.432781Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:16.432795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:16.432798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.432816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.432818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.432831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:16.432841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.432848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.432900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.432906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.432908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.432911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:16.432913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:16.432969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:16.432979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.432990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.433001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.433017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:16.433035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.433037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.433039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.433045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:16.433055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:16.433061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009472:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.433064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009580:2809], now have 1 active actors on pipe
2025-10-02T09:28:16.433066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:16.433068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:16.433070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:16.433082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:16.433085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.433105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.433120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:16.433118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 53
2025-10-02T09:28:16.433136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 53
2025-10-02T09:28:16.433147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:16.433214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.433223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.433239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.433243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.433246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.433247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.433252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.433258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.433269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.433414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.433420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.433428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.433502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0
2025-10-02T09:28:16.433755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968de1a1-583e3b8b-a2b135f6-d45a151c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.436504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Write session: try to update token
2025-10-02T09:28:16.436517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:16.444283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:16.444300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.444303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:16.444309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:16.444317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.444322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.444325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553848010491818:2676]
2025-10-02T09:28:16.444358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:16.444360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:16.444362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:16.444365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:16.444365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.444367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:16.444560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:16.451822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.454341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.513624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553848086009590:2503]
2025-10-02T09:28:16.513951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7556553848086009590:2503]
2025-10-02T09:28:16.587956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:16.588361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.588373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.588390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009590:2503], now have 1 active actors on pipe
2025-10-02T09:28:16.588544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:16.588708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553848086009590:2503]
2025-10-02T09:28:16.588741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:16.588750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:16.588843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0
2025-10-02T09:28:16.589017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0 is DEAD
2025-10-02T09:28:16.589176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:16.589188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Write session will restart in 0.006407s
2025-10-02T09:28:16.589208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Write session: Do CDS request
2025-10-02T09:28:16.589214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:16.596246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.596316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.596327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-10-02T09:28:16.596435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.596459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:16.596462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:16.596466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.597024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-10-02T09:28:16.597070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.597076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.597078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.597084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553848086009662:2815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.597147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.597596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.597668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553848086009662:2815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.597746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.597756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:16.597766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.597817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.597853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553848010491932:2678]
2025-10-02T09:28:16.598324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:16.598653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:16.598715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:16.599003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:16.599057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.599062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.599063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.599064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.599065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.599066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.599067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.599068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.599069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.599070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.599071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.599073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.599077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.599088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.599092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.599095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.599098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.599101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.599105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.599108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.599112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.599116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.599120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.599123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.599129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.599136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.599141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.599146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.599150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.599155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.599159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.599164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.599183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.599188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.599196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.599201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.599207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.599189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553848086009662:2815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.599212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.599219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.599224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.599229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.599238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.599242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.599250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.599256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.599261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.599269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.599274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.599306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:16.604940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553848086009662:2815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.604953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553848086009662:2815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:16.604957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553848086009662:2815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.604966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.607874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:16.609638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:16.609652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:16.609655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.609658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.609664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [2:7556553848010491932:2678]
2025-10-02T09:28:16.609678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:16.609693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:16.609696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.609699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.609701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.609714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:16.609719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.609729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.609792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.609801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.609803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.609805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:16.609807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:16.609875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:16.609882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.609894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.609909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.609931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:16.609948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009592:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.609955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009702:2815], now have 1 active actors on pipe
2025-10-02T09:28:16.609960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.609962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.609966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.609978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:16.609995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:16.610000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:16.610004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:16.610007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:16.610011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:16.610014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.610022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 54
2025-10-02T09:28:16.610046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.610053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:16.610023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 54
2025-10-02T09:28:16.610070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:16.610098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.610105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.610133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.610143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.610147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.610149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.610156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.610165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.610176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.610343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.610355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.610376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.610469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0
2025-10-02T09:28:16.610824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5993fb8-1aceb38a-883f08a-8a885c25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.613450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Write session: try to update token
2025-10-02T09:28:16.613465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:16.620798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:16.620981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.620984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:16.620986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:16.620993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.620998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.621002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553848010491927:2678]
2025-10-02T09:28:16.621038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:16.621044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.621047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:16.621046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:16.621051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:16.621057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:16.621243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:16.629078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.631746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.688698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553848086009709:2503]
2025-10-02T09:28:16.689063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7556553848086009709:2503]
2025-10-02T09:28:16.764075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:16.764345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.764355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.764369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009709:2503], now have 1 active actors on pipe
2025-10-02T09:28:16.764540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:16.764594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553848086009709:2503]
2025-10-02T09:28:16.764612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:16.764622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:16.764693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0
2025-10-02T09:28:16.764861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0 is DEAD
2025-10-02T09:28:16.764983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:16.764991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Write session will restart in 0.005199s
2025-10-02T09:28:16.765009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Write session: Do CDS request
2025-10-02T09:28:16.765013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:16.771227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.771361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.771373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-10-02T09:28:16.771478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.771506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:16.771514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:16.771518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.771926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-10-02T09:28:16.771961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.771966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.771968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.771973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553848086009792:2820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.772508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553848086009792:2820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.772498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.772937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.773064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.773071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:16.773078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.773116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.773149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553848010492044:2681]
2025-10-02T09:28:16.773685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:16.773912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:16.773944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:16.774168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553848086009792:2820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.774179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:16.774210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.774214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.774215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.774216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.774216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.774217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.774217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.774218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.774218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.774219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.774220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.774220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.774223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.774229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.774231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.774233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.774235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.774238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.774242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.774245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.774248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.774251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.774255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.774258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.774263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.774268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.774273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.774278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.774282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.774286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.774288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.774292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.774299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.774302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.774304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.774307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.774309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.774314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.774319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.774328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.774344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.774350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.774352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.774355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.774357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.774360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.774364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.774367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.774384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:16.779922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553848086009792:2820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.779934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553848086009792:2820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:16.779938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553848086009792:2820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.779946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.783015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:16.784767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:16.784782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:16.784783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.784786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.784789Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [2:7556553848010492044:2681]
2025-10-02T09:28:16.784819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:16.784834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:16.784836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.784838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.784839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.784850Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:16.784853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.784857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.784921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.784930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.784932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.784935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:16.784937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:16.784997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:16.785006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.785018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.785027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.785042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:16.785058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009833:2820], now have 1 active actors on pipe
2025-10-02T09:28:16.785064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009723:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.785068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.785070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.785071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.785080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:16.785092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:16.785095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:16.785098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:16.785099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:16.785109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:16.785111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.785119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 55
2025-10-02T09:28:16.785148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.785154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:16.785156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:16.785124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 55
2025-10-02T09:28:16.785170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.785178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.785216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1606349-57a3d333-3670ea64-5f30a209_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.785228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.785231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.785233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.785241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.785249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.785267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.785391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.785401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.785413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.785466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1606349-57a3d333-3670ea64-5f30a209_0
2025-10-02T09:28:16.785772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b301c53-6c71a377-15c74f2b-1c8c94a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1606349-57a3d333-3670ea64-5f30a209_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.788294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Write session: try to update token
2025-10-02T09:28:16.788307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:16.796043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:16.796060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.796062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:16.796064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:16.796071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.796075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.796078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553848010492039:2681]
2025-10-02T09:28:16.796096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:16.796100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:16.796102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:16.796107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:16.796113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.796115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:16.796242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:16.803902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|d1606349-57a3d333-3670ea64-5f30a209_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.806951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:16.864830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553848086009863:2503]
2025-10-02T09:28:16.867287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7556553848086009863:2503]
2025-10-02T09:28:16.939958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:16.940526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.940538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.940551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009863:2503], now have 1 active actors on pipe
2025-10-02T09:28:16.940727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:16.940763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:16.940767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:16.940773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553848086009863:2503]
2025-10-02T09:28:16.940841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|d1606349-57a3d333-3670ea64-5f30a209_0
2025-10-02T09:28:16.940998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|d1606349-57a3d333-3670ea64-5f30a209_0 is DEAD
2025-10-02T09:28:16.941129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:16.941138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Write session will restart in 0.007537s
2025-10-02T09:28:16.941153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Write session: Do CDS request
2025-10-02T09:28:16.941160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:16.941505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:16.947665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:16.948051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:16.948196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:16.948207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:16.948213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:16.948249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:16.948275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553848010492190:2695]
2025-10-02T09:28:16.948626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:16.948859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:16.948884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:16.949090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:16.949121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.949125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.949125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.949126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.949126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.949127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.949127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.949128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.949128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.949129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.949129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.949130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.949133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.949140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.949142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.949144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.949146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.949148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.949150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.949152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.949154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.949156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.949158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.949160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.949164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.949168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:16.949171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.949174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:16.949176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.949179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:16.949181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.949184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:16.949186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.949190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:16.949191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.949194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:16.949196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.949199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:16.949201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.949203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:16.949205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.949208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:16.949210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.949213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.949215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.949217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.949219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.949222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.949240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:16.950216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.950484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:16.950497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-10-02T09:28:16.950638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:16.950678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:16.950682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:16.950686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:16.951108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-10-02T09:28:16.951136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:16.951138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:16.951139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:16.951144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553848086009946:2831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:16.951667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553848086009946:2831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:16.953529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553848086009946:2831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:16.956966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553848086009946:2831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:16.956977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553848086009946:2831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:16.956980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553848086009946:2831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:16.956986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:16.957554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:16.959465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:16.959475Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:16.959477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:16.959481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:16.959486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [2:7556553848010492190:2695]
2025-10-02T09:28:16.959498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:16.959513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:16.959520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.959523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.959524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.959537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:16.959541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:16.959546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:16.959596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.959604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.959605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.959608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:16.959610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:16.959669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:16.959676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.959687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:16.959704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:16.959720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:16.959737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009978:2831], now have 1 active actors on pipe
2025-10-02T09:28:16.959744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553848086009867:2446], now have 1 active actors on pipe
2025-10-02T09:28:16.959749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.959751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.959754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.959764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:16.959779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:16.959778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:16.959781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:16.959783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:16.959791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:16.959793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:16.959785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 56
2025-10-02T09:28:16.959786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 56
2025-10-02T09:28:16.959822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.959836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:16.959849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.959854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.959857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:16.959888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8685f485-4b51f649-6e9865e1-32efd211_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:16.959897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:16.959901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:16.959903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:16.959911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:16.959917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:16.959939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.960109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:16.960116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:16.960126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:16.960190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 36 sessionId: src_id|8685f485-4b51f649-6e9865e1-32efd211_0
2025-10-02T09:28:16.960486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1606349-57a3d333-3670ea64-5f30a209_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8685f485-4b51f649-6e9865e1-32efd211_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:16.963123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Write session: try to update token
2025-10-02T09:28:16.963137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:16.971100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:16.971114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:16.971116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:16.971118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:16.971126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.971129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.971132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553848010492185:2695]
2025-10-02T09:28:16.971175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:16.971181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:16.971187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:16.971188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:16.971194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:16.971197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:16.971321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:16.978208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|8685f485-4b51f649-6e9865e1-32efd211_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:16.981252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:17.040964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553852380977281:2503]
2025-10-02T09:28:17.041266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7556553852380977281:2503]
2025-10-02T09:28:17.114975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:17.115312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.115324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.115340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977281:2503], now have 1 active actors on pipe
2025-10-02T09:28:17.115584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553852380977281:2503]
2025-10-02T09:28:17.115598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:17.115630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:17.115633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:17.115701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: error at write: Disconnected sessionId: src_id|8685f485-4b51f649-6e9865e1-32efd211_0
2025-10-02T09:28:17.116011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:17.116024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Write session will restart in 0.008512s
2025-10-02T09:28:17.116048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Write session: Do CDS request
2025-10-02T09:28:17.116054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:17.115869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|8685f485-4b51f649-6e9865e1-32efd211_0 is DEAD
2025-10-02T09:28:17.116254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:17.125296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.125289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:17.125392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:17.125406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-10-02T09:28:17.125546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.125595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:17.125603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:17.125607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:17.125979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-10-02T09:28:17.125983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:17.126012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:17.126014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:17.126015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:17.126020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553852380977359:2836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:17.126141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:17.126150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:17.126159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:17.126206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:17.126242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553852305459599:2698]
2025-10-02T09:28:17.126515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553852380977359:2836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:17.126788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:17.127080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:17.127121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:17.127411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:17.127479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.127484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.127485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.127486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.127487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.127488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.127489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.127490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.127491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.127491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.127492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.127493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.127498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.127507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.127511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.127514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.127518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.127522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.127526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.127529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.127533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.127537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.127540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.127543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.127549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.127556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.127566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.127571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.127575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.127583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.127587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.127592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.127598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.127603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.127612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.127617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.127621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.127625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.127629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.127633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.127637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.127642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.127648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.127653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.127661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.127666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.127669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.127674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.127705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:17.128266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553852380977359:2836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:17.134674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553852380977359:2836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:17.134688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553852380977359:2836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:17.134691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553852380977359:2836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:17.134699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:17.136579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:17.138336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:17.138351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:17.138354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:17.138357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:17.138363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [2:7556553852305459599:2698]
2025-10-02T09:28:17.138376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:17.138391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:17.138393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.138397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.138398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.138414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:17.138419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:17.138425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:17.138571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.138581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.138587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.138590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:17.138593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:17.138654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:17.138662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.138675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.138686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.138703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:17.138723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.138729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.138731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.138746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:17.138763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:17.138766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:17.138770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:17.138773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:17.138782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:17.138785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:17.138812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.138819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:17.138834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:17.138853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977285:2446], now have 1 active actors on pipe
2025-10-02T09:28:17.138861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977397:2836], now have 1 active actors on pipe
2025-10-02T09:28:17.138992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 57
2025-10-02T09:28:17.139026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 57
2025-10-02T09:28:17.139105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.139122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.139155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a95bf591-714cc394-3775368c-5250fa89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:17.139177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.139186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.139188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:17.139200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.139215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:17.139230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.139430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.139437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.139450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.139532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 36 sessionId: src_id|a95bf591-714cc394-3775368c-5250fa89_0
2025-10-02T09:28:17.139880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8685f485-4b51f649-6e9865e1-32efd211_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a95bf591-714cc394-3775368c-5250fa89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:17.142680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Write session: try to update token
2025-10-02T09:28:17.142696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:17.154169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:17.154185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:17.154188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:17.154190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:17.154199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.154204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.154207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553852305459593:2698]
2025-10-02T09:28:17.154243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:17.154249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.154251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:17.154385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:17.154421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:17.154426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:17.154429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:17.163706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|a95bf591-714cc394-3775368c-5250fa89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:17.166814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:17.215548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553852380977405:2503]
2025-10-02T09:28:17.215872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7556553852380977405:2503]
2025-10-02T09:28:17.295020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:17.295426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.295441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.295458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977405:2503], now have 1 active actors on pipe
2025-10-02T09:28:17.295669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:17.295683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:17.295714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553852380977405:2503]
2025-10-02T09:28:17.295737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:17.295744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:17.295802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: error at write: Disconnected sessionId: src_id|a95bf591-714cc394-3775368c-5250fa89_0
2025-10-02T09:28:17.295958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|a95bf591-714cc394-3775368c-5250fa89_0 is DEAD
2025-10-02T09:28:17.296116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:17.296127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Write session will restart in 0.006372s
2025-10-02T09:28:17.296149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Write session: Do CDS request
2025-10-02T09:28:17.296156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:17.303242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.306273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:17.306913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:17.307069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:17.307078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:17.307086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:17.307127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:17.307160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553852305459723:2701]
2025-10-02T09:28:17.307736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:17.308028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:17.308083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:17.308421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:17.308488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.308495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.308497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.308498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.308498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.308499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.308501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.308502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.308502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.308503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.308504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.308505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.308510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.308519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.308522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.308526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.308529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.308533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.308536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.308540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.308544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.308548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.308551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.308554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.308561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.308568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.308573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.308578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.308582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.308587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.308591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.308595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.308600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.308604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.308607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.308611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.308615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.308619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.308622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.308626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.308630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.308633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.308637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.308640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.308646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.308651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.308655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.308659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.308701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:17.308919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:17.308932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-10-02T09:28:17.309054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.309080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:17.309091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:17.309094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:17.309406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-10-02T09:28:17.309428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:17.309429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:17.309431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:17.309434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553852380977499:2841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:17.309918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553852380977499:2841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:17.312120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553852380977499:2841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:17.317285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553852380977499:2841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:17.317300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553852380977499:2841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:17.317303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553852380977499:2841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:17.317311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:17.318760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:17.320643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:17.320660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:17.320663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:17.320666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:17.320673Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [2:7556553852305459723:2701]
2025-10-02T09:28:17.320685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:17.320701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:17.320703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.320706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.320708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.320722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:17.320727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:17.320733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:17.320782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.320790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.320792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.320794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:17.320797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:17.320892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:17.320900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.320913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.320929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.320953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:17.320971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977420:2446], now have 1 active actors on pipe
2025-10-02T09:28:17.320979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977533:2841], now have 1 active actors on pipe
2025-10-02T09:28:17.320984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.320986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.320988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.320998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:17.321011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:17.321014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:17.321020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:17.321022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:17.321027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:17.321030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:17.321048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 58
2025-10-02T09:28:17.321052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 58
2025-10-02T09:28:17.321059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.321069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:17.321071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:17.321095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.321098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.321127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:17.321142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.321145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.321147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:17.321154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.321162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:17.321187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.321397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.321411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.321433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.321534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0
2025-10-02T09:28:17.321982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a95bf591-714cc394-3775368c-5250fa89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:17.324913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Write session: try to update token
2025-10-02T09:28:17.324930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:17.332740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:17.332759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:17.332761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:17.332763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:17.332772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.332779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.332783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553852305459718:2701]
2025-10-02T09:28:17.332845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:17.332851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.332853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:17.332922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:17.332929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:17.332932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:17.333007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:17.344693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:17.347707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:17.395732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553852380977540:2503]
2025-10-02T09:28:17.395957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7556553852380977540:2503]
2025-10-02T09:28:17.474741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:17.475092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.475106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.475124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977540:2503], now have 1 active actors on pipe
2025-10-02T09:28:17.475376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:17.475385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:17.475397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:17.475415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:17.475462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553852380977540:2503]
2025-10-02T09:28:17.475472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: error at write: Disconnected sessionId: src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0
2025-10-02T09:28:17.475630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0 is DEAD
2025-10-02T09:28:17.475921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:17.475931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Write session will restart in 0.009137s
2025-10-02T09:28:17.475958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Write session: Do CDS request
2025-10-02T09:28:17.475963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:17.486250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.486405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:17.486420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-10-02T09:28:17.486539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.486573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:17.486583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:17.486587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:17.486997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-10-02T09:28:17.487036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:17.487041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:17.487044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:17.487049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553852380977617:2845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:17.487366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:17.487653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553852380977617:2845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:17.488117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:17.488305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:17.488314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:17.488324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:17.488379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:17.488450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553852305459837:2703]
2025-10-02T09:28:17.489109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:17.490605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:17.490664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:17.490990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:17.491058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.491065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.491066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.491068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.491068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.491069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.491070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.491072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.491073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.491073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.491075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.491076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.491081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.491090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.491094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.491097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.491101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.491104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.491108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.491111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.491116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.491121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.491124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.491128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.491134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.491154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.491161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.491176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.491180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.491186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.491191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.491196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.491201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.491206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.491209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.491214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.491219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.491223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.491228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.491240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.491245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.491249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.491253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.491257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.491268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.491273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.491277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.491286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.491329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:17.491341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553852380977617:2845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:17.497676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553852380977617:2845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:17.497695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553852380977617:2845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:17.497699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553852380977617:2845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:17.497708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:17.501842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:17.503780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:17.503800Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:17.503803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:17.503806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:17.503813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [2:7556553852305459837:2703]
2025-10-02T09:28:17.503829Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:17.503847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:17.503850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.503854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.503856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.503870Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:17.503876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:17.503883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:17.503948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.503959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.503961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.503965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:17.503968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:17.504042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:17.504045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.504061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.504073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.504090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:17.504108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.504111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.504113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.504131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:17.504146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:17.504161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:17.504164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:17.504184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:17.504188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:17.504190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:17.504202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.504206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:17.504265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:17.504305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977542:2446], now have 1 active actors on pipe
2025-10-02T09:28:17.504310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977656:2845], now have 1 active actors on pipe
2025-10-02T09:28:17.504703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 59
2025-10-02T09:28:17.504737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 59
2025-10-02T09:28:17.505016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.505027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.505053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:17.505065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.505069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.505075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:17.505085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.505094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:17.505118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.505338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.505346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.505359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.505591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 36 sessionId: src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0
2025-10-02T09:28:17.505964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7adfa3f-6265f8f2-f1c0ab11-4d3eade2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:17.508853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Write session: try to update token
2025-10-02T09:28:17.508870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:17.517811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:17.517832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:17.517835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:17.517837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:17.517845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.517850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.517854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553852305459831:2703]
2025-10-02T09:28:17.517888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:17.517895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.517897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:17.517904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:17.517918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:17.517922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:17.518038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:17.529484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:17.532411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:17.575478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553852380977665:2503]
2025-10-02T09:28:17.575723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7556553852380977665:2503]
2025-10-02T09:28:17.657229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:17.657649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.657664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.657681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977665:2503], now have 1 active actors on pipe
2025-10-02T09:28:17.658891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:17.658884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:17.658934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553852380977665:2503]
2025-10-02T09:28:17.658955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:17.659308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:17.659319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Write session will restart in 0.007557s
2025-10-02T09:28:17.659340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Write session: Do CDS request
2025-10-02T09:28:17.659345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:17.659023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: status is not ok: tablet will be restarted right now sessionId: src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0
2025-10-02T09:28:17.659203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0 is DEAD
2025-10-02T09:28:17.668235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.668509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:17.668523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-10-02T09:28:17.668677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.668715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:17.668724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:17.668738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:17.669309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-10-02T09:28:17.669345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:17.669348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:17.669350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:17.669355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553852380977710:2849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:17.669896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553852380977710:2849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:17.672669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:17.673366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:17.673542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:17.673553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:17.673563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:17.673614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:17.673654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553852305459951:2705]
2025-10-02T09:28:17.673931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553852380977710:2849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:17.674218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:17.674582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:17.674639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:17.674968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:17.675043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.675050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.675051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.675052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.675052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.675054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.675055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.675055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.675056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.675057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.675058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.675059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.675064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.675074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.675078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.675082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.675085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.675089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.675093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.675096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.675100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.675104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.675107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.675110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.675116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.675123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.675129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.675134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.675138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.675143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.675147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.675151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.675157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.675161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.675175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.675180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.675183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.675187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.675191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.675195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.675199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.675203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.675206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.675210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.675214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.675219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.675223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.675236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.675268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:17.680198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553852380977710:2849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:17.680212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553852380977710:2849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:17.680215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553852380977710:2849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:17.680222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:17.684231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:17.685888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:17.685903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:17.685905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:17.685907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:17.685912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [2:7556553852305459951:2705]
2025-10-02T09:28:17.685921Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:17.685932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:17.685934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.685936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.685938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.685948Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:17.685952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:17.685957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:17.686000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.686008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.686010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.686012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:17.686013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:17.686068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:17.686076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.686087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.686101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.686120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:17.686141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977782:2849], now have 1 active actors on pipe
2025-10-02T09:28:17.686152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.686154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.686156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.686166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:17.686180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977667:2446], now have 1 active actors on pipe
2025-10-02T09:28:17.686187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:17.686186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:17.686189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:17.686191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:17.686200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:17.686202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:17.686230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.686240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:17.686257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:17.686257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 60
2025-10-02T09:28:17.686284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 60
2025-10-02T09:28:17.686308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.686317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.686341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:17.686350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.686354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.686355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:17.686363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.686372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:17.686390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.686567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.686579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.686595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.686671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 36 sessionId: src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0
2025-10-02T09:28:17.687018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e75a5d-c283c72c-42c855e7-ee80007b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:17.689758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Write session: try to update token
2025-10-02T09:28:17.689774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:17.697793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:17.697810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:17.697812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:17.697814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:17.697823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.697827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.697831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553852305459945:2705]
2025-10-02T09:28:17.697866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:17.697873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.697876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:17.697885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:17.697901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:17.697906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:17.698031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:17.708620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:17.711500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:17.759276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553852380977795:2503]
2025-10-02T09:28:17.759445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7556553852380977795:2503]
2025-10-02T09:28:17.828693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:17.829005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.829015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.829028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977795:2503], now have 1 active actors on pipe
2025-10-02T09:28:17.829171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:17.829236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:17.829253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:17.829285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553852380977795:2503]
2025-10-02T09:28:17.829317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0
2025-10-02T09:28:17.829446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0 is DEAD
2025-10-02T09:28:17.829580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:17.829590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Write session will restart in 0.006936s
2025-10-02T09:28:17.829612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Write session: Do CDS request
2025-10-02T09:28:17.829618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:17.836884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:17.837201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.837272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:17.837328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:17.837341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-10-02T09:28:17.837392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:17.837399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:17.837405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:17.837431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:17.837429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:17.837454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553852305460072:2708]
2025-10-02T09:28:17.837449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:17.837455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:17.837459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:17.837757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-10-02T09:28:17.837778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:17.837782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:17.837783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:17.837786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553852380977875:2854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:17.837827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:17.838038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:17.838079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:17.838160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553852380977875:2854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:17.838309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:17.838346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.838349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.838350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.838351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.838352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.838352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.838353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.838354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.838355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.838355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.838356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.838357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.838360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.838366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.838368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.838372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.838374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.838376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.838378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.838380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.838382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.838384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.838386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.838388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.838396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.838400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:17.838404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.838407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:17.838409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.838412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:17.838414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.838417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:17.838419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.838422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:17.838424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.838426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:17.838429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.838431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:17.838434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.838437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:17.838439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.838442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:17.838444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.838447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.838449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.838452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.838454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.838457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.838475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:17.839534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553852380977875:2854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:17.844029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553852380977875:2854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:17.844038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553852380977875:2854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:17.844041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553852380977875:2854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:17.844046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:17.846504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:17.848261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:17.848273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:17.848274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:17.848277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:17.848282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [2:7556553852305460072:2708]
2025-10-02T09:28:17.848290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:17.848305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:17.848308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.848311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.848312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.848326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:17.848330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:17.848334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:17.848368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.848373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.848374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.848376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:17.848377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:17.848417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:17.848422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.848429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:17.848435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:17.848445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:17.848463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.848470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.848471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.848477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:17.848487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:17.848488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:17.848496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:17.848498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:17.848498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:17.848500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:17.848507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977799:2446], now have 1 active actors on pipe
2025-10-02T09:28:17.848509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977914:2854], now have 1 active actors on pipe
2025-10-02T09:28:17.848527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.848535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:17.848552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:17.848533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 61
2025-10-02T09:28:17.848575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 61
2025-10-02T09:28:17.848687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.848696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.848713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:17.848718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:17.848721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:17.848723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:17.848731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:17.848738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:17.848753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.848867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.848872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.848880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:17.848945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 36 sessionId: src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0
2025-10-02T09:28:17.849245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c373e99e-d4e4596f-1de71f1b-7db03b09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:17.852053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Write session: try to update token
2025-10-02T09:28:17.852066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:17.860323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:17.860336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:17.860343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.860377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:17.860394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:17.860995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:17.861429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:17.861565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:17.862001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:17.862195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:17.862234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:17.867163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:17.867358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:17.867370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:17.867371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:17.867372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:17.867377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.867379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.867381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553852305460066:2708]
2025-10-02T09:28:17.867404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:17.867408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:17.867409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:17.867416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:17.867422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:17.867425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:17.867540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:17.869876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:17.929280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553852380977944:2503]
2025-10-02T09:28:17.929499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7556553852380977944:2503]
2025-10-02T09:28:17.991296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:17.991507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:17.991517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:17.991532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977944:2503], now have 1 active actors on pipe
2025-10-02T09:28:17.991738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:17.991758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553852380977944:2503]
2025-10-02T09:28:17.991766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:17.991786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:17.991839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0
2025-10-02T09:28:17.992000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0 is DEAD
2025-10-02T09:28:17.992186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:17.992201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Write session will restart in 0.008164s
2025-10-02T09:28:17.992229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Write session: Do CDS request
2025-10-02T09:28:17.992249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:17.999482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:17.999847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:17.999964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:17.999970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:17.999977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.000004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.000067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553852305460221:2722]
2025-10-02T09:28:18.000439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.000661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.000686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.000902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.000937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.000941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.000941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.000942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.000943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.000943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.000944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.000944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.000945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.000945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.000946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.000946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.000949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.000956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.000958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.000960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.000962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.000964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.000966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.000968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.000970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.000973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.000975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.000977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.000982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.000986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.000989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.000992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.000995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.000997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.001000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.001003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.001005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.001008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.001010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.001012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.001017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.001019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.001021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.001024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.001026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.001029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.001031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.001033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.001035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.001038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.001040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.001043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.001060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.001246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.001333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.001346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-10-02T09:28:18.001491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.001520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.001525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.001528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.001946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-10-02T09:28:18.001980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.001982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.001983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.001988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675945323:2865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.002429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675945323:2865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.004221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675945323:2865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.008848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675945323:2865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.008860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675945323:2865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.008862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675945323:2865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.008874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.009560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.011049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.011061Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.011063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.011065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.011069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [2:7556553852305460221:2722]
2025-10-02T09:28:18.011078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.011092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.011094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.011096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.011097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.011107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.011111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.011118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.011184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.011192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.011195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.011197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.011199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.011255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.011262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.011273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.011282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.011301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.011321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945358:2865], now have 1 active actors on pipe
2025-10-02T09:28:18.011329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553852380977945:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.011335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.011338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.011340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.011352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.011365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 62
2025-10-02T09:28:18.011367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 62
2025-10-02T09:28:18.011366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.011368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.011375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.011378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.011383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.011385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.011414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.011416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.011419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.011430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.011434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.011478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.011483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.011487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.011489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.011496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.011505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.011524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.011660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.011676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.011698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.011786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0
2025-10-02T09:28:18.012065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aed881f-28efc06c-2fb4e6ab-7c3ffb4b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.014519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Write session: try to update token
2025-10-02T09:28:18.014532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:18.022361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:18.022388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.022390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:18.022392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:18.022399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.022403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.022407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553852305460216:2722]
2025-10-02T09:28:18.022444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:18.022449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:18.022453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.022455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:18.022455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:18.022458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:18.022600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:18.030334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:18.032754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:18.092077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553856675945368:2503]
2025-10-02T09:28:18.092326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7556553856675945368:2503]
2025-10-02T09:28:18.149495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:18.149866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.149875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.149888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945368:2503], now have 1 active actors on pipe
2025-10-02T09:28:18.150034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:18.150158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:18.150168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553856675945368:2503]
2025-10-02T09:28:18.150170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:18.150187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:18.150264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: error at write: Disconnected sessionId: src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0
2025-10-02T09:28:18.150392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0 is DEAD
2025-10-02T09:28:18.150477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:18.150487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Write session will restart in 0.008930s
2025-10-02T09:28:18.150509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Write session: Do CDS request
2025-10-02T09:28:18.150514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:18.158316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:18.158775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:18.158911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:18.158916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:18.158923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.158963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.158989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553856600427637:2725]
2025-10-02T09:28:18.159448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.159716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.159751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.159990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.160028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.160034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.160035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.160036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.160037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.160037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.160038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.160039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.160040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.160041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.160042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.160043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.160047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.160054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.160056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.160058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.160060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.160063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.160065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.160067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.160069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.160071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.160073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.160075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.160078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.160082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.160085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.160088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.160090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.160093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.160095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.160098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.160100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.160103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.160105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.160110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.160114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.160123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.160127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.160136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.160143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.160147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.160152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.160155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.160157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.160161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.160166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.160168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.160185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.160202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.160348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.160369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-10-02T09:28:18.160487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.160516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.160526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.160532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.160971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-10-02T09:28:18.161004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.161012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.161014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.161020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675945452:2870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.161520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675945452:2870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.163463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675945452:2870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.167765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675945452:2870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.167775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675945452:2870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.167779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675945452:2870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.167784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.168394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.170008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.170021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.170023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.170025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.170030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [2:7556553856600427637:2725]
2025-10-02T09:28:18.170039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.170050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.170052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.170053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.170055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.170066Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.170069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.170074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.170130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.170137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.170139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.170141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.170143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.170188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.170194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.170201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.170207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.170216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.170231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945369:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.170239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945487:2870], now have 1 active actors on pipe
2025-10-02T09:28:18.170244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.170246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.170248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.170259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.170272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.170273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.170280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.170283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.170286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.170289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.170317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.170327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.170317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 63
2025-10-02T09:28:18.170339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.170318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 63
2025-10-02T09:28:18.170374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.170385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.170405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.170411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.170417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.170419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.170426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.170433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.170443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.170567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.170574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.170585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.170653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 36 sessionId: src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0
2025-10-02T09:28:18.170945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef05c9c9-3f75fa33-4e31e40b-3fa52514_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.173589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Write session: try to update token
2025-10-02T09:28:18.173604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:18.181393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:18.181411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.181414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:18.181416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:18.181425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.181429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.181434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553856600427632:2725]
2025-10-02T09:28:18.181470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:18.181470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:18.181475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:18.181480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:18.181481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.181484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:18.181658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:18.188729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:18.191409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:18.250260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553856675945507:2503]
2025-10-02T09:28:18.250427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7556553856675945507:2503]
2025-10-02T09:28:18.307155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:18.307433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.307444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.307457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945507:2503], now have 1 active actors on pipe
2025-10-02T09:28:18.307578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:18.307657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:18.307670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553856675945507:2503]
2025-10-02T09:28:18.307687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:18.307751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: status is not ok: tablet will be restarted right now sessionId: src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0
2025-10-02T09:28:18.307912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0 is DEAD
2025-10-02T09:28:18.308014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:18.308022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Write session will restart in 0.007659s
2025-10-02T09:28:18.308036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Write session: Do CDS request
2025-10-02T09:28:18.308041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:18.314905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:18.315229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:18.315360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:18.315367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:18.315376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.315421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.315451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553856600427768:2728]
2025-10-02T09:28:18.315984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.316208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.316238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.316504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.316547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.316552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.316553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.316554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.316555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.316556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.316557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.316558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.316558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.316559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.316560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.316561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.316565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.316575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.316579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.316582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.316586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.316590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.316593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.316597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.316600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.316604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.316607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.316611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.316616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.316623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.316628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.316632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.316636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.316641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.316644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.316649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.316654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.316659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.316666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.316671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.316675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.316679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.316687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.316692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.316696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.316700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.316704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.316708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.316712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.316717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.316720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.316725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.316757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.317146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.317273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.317282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-10-02T09:28:18.317376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.317395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.317401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.317405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.317748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-10-02T09:28:18.317776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.317783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.317785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.317789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675945592:2875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.318293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675945592:2875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.319858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675945592:2875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.324298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675945592:2875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.324309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675945592:2875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.324310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675945592:2875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.324315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.324994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.326708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.326722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.326725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.326728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.326733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [2:7556553856600427768:2728]
2025-10-02T09:28:18.326745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.326758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.326760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.326763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.326765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.326776Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.326781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.326787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.326830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.326839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.326841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.326843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.326845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.326901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.326908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.326919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.326929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.326943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.326956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945508:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.326963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945627:2875], now have 1 active actors on pipe
2025-10-02T09:28:18.326967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.326969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.326971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.326979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.326982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 64
2025-10-02T09:28:18.326989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.326994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.326996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.326997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.326997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.327002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 64
2025-10-02T09:28:18.326999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.327022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.327037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.327039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.327050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.327052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.327082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.327089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.327092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.327093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.327100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.327105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.327116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.327280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.327289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.327301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.327371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 36 sessionId: src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0
2025-10-02T09:28:18.327632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|717964d6-2e8d7e0d-8e3558cf-ca2385e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.330146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Write session: try to update token
2025-10-02T09:28:18.330159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:18.337245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:18.337257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.337258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:18.337259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:18.337265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.337267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.337270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553856600427763:2728]
2025-10-02T09:28:18.337293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:18.337297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.337299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:18.337301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:18.337305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:18.337316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:18.337438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:18.345437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:18.348111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:18.407972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553856675945635:2503]
2025-10-02T09:28:18.408201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7556553856675945635:2503]
2025-10-02T09:28:18.471829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:18.472181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.472193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.472207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945635:2503], now have 1 active actors on pipe
2025-10-02T09:28:18.472352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:18.472433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:18.472443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553856675945635:2503]
2025-10-02T09:28:18.472473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:18.472526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0
2025-10-02T09:28:18.472671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0 is DEAD
2025-10-02T09:28:18.472787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:18.472796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Write session will restart in 0.007206s
2025-10-02T09:28:18.472831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Write session: Do CDS request
2025-10-02T09:28:18.472837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:18.480279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:18.480658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:18.480772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:18.480779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:18.480786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.480838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.480866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553856600427888:2730]
2025-10-02T09:28:18.481183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.481224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.481322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.481331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-10-02T09:28:18.481423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.481430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.481458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.481450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.481461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.481464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.481659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.481694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.481698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.481698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.481699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.481699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.481700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.481700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.481701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.481701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.481702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.481702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.481703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.481706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.481712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.481714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.481716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.481718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.481720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.481722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.481724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.481727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.481731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.481735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.481738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.481744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.481752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.481757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.481762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.481766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.481770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.481774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.481778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.481780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.481782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.481785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.481787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.481790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.481792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.481794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.481797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.481799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.481802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.481804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.481807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.481809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.481813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.481816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.481818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.481835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.481942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-10-02T09:28:18.481986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.481987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.481989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.481994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675945720:2879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.482480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675945720:2879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.484554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675945720:2879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.489188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675945720:2879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.489199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675945720:2879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.489202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675945720:2879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.489227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.489876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.491585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.491603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.491606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.491609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.491615Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [2:7556553856600427888:2730]
2025-10-02T09:28:18.491629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.491645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.491651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.491653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.491655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.491667Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.491676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.491682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.491795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.491801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.491802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.491804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.491805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.491863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.491869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.491877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.491882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.491891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.491908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945756:2879], now have 1 active actors on pipe
2025-10-02T09:28:18.491914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945636:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.491918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.491919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.491921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.491930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.491943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.491949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.491952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.491954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.491954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.491955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.491978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.491983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.491966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 65
2025-10-02T09:28:18.491968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 65
2025-10-02T09:28:18.491991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.492004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.492008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.492027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.492035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.492037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.492039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.492044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.492049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.492058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.492182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.492193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.492208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.492272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 36 sessionId: src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0
2025-10-02T09:28:18.492587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f9f677-5271801e-bbf5f71d-fcd7b451_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.495630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Write session: try to update token
2025-10-02T09:28:18.495647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:18.501418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:18.501434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.501442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.501478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:18.501480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:18.501619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:18.501748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:18.501876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:18.501998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:18.502262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:18.502298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:18.510281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:18.510295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.510298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:18.510291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:18.510300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:18.510307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.510311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.510315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553856600427883:2730]
2025-10-02T09:28:18.510349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:18.510355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.510357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:18.510359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:18.510363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:18.510365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:18.510498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:18.512931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:18.572857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553856675945764:2503]
2025-10-02T09:28:18.573159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7556553856675945764:2503]
2025-10-02T09:28:18.648680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:18.648926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.648937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.648951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945764:2503], now have 1 active actors on pipe
2025-10-02T09:28:18.649135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:18.649193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553856675945764:2503]
2025-10-02T09:28:18.649208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:18.649219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:18.649291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0
2025-10-02T09:28:18.649455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0 is DEAD
2025-10-02T09:28:18.649654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:18.649665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Write session will restart in 0.008889s
2025-10-02T09:28:18.649688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Write session: Do CDS request
2025-10-02T09:28:18.649694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:18.658029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:18.658470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:18.658590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:18.658598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:18.658607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.658643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.658693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553856600428009:2732]
2025-10-02T09:28:18.659127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.659240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.659341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.659352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-10-02T09:28:18.659404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.659434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.659491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.659513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.659520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.659523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.659666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.659712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.659717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.659718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.659719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.659720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.659721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.659722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.659723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.659724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.659725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.659726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.659727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.659731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.659741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.659744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.659748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.659750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.659752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.659754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.659756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.659758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.659760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.659762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.659765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.659769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.659773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.659776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.659779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.659781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.659784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.659786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.659789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.659791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.659794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.659796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.659800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.659803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.659805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.659807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.659810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.659813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.659815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.659818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.659822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.659826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.659830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.659834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.659839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.659873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.659896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-10-02T09:28:18.659921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.659922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.659924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.659927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675945850:2883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.660327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675945850:2883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.662088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675945850:2883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.666471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675945850:2883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.666486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675945850:2883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.666489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675945850:2883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.666495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.667835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.669428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.669442Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.669444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.669447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.669452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [2:7556553856600428009:2732]
2025-10-02T09:28:18.669462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.669475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.669478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.669481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.669482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.669492Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.669497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.669503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.669545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.669552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.669553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.669557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.669559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.669628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.669635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.669645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.669656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.669675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.669694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945887:2883], now have 1 active actors on pipe
2025-10-02T09:28:18.669701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945765:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.669705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.669707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.669708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.669716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.669725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.669733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.669735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.669737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.669738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.669740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.669754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.669761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.669772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.669756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 66
2025-10-02T09:28:18.669799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 66
2025-10-02T09:28:18.669854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.669861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.669880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef28178f-35e1468c-6586fbd3-207f844f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.669890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.669893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.669895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.669902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.669910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.669917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.670067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.670075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.670087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.670188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef28178f-35e1468c-6586fbd3-207f844f_0
2025-10-02T09:28:18.670452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb391c9-17df5b67-af8c9ae5-e75060b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef28178f-35e1468c-6586fbd3-207f844f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.673213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Write session: try to update token
2025-10-02T09:28:18.673224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:18.680325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:18.680341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.680343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:18.680345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:18.680353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.680359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.680364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553856600428004:2732]
2025-10-02T09:28:18.680402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:18.680413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.680415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:18.680417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:18.680422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:18.680425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:18.680585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:18.687911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|ef28178f-35e1468c-6586fbd3-207f844f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:18.690286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:18.749489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553856675945900:2503]
2025-10-02T09:28:18.749746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7556553856675945900:2503]
2025-10-02T09:28:18.809744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:18.810079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.810091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.810108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945900:2503], now have 1 active actors on pipe
2025-10-02T09:28:18.810345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:18.810324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:18.810335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:18.810404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: error at write: Disconnected sessionId: src_id|ef28178f-35e1468c-6586fbd3-207f844f_0
2025-10-02T09:28:18.810475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553856675945900:2503]
2025-10-02T09:28:18.810506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:18.810546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|ef28178f-35e1468c-6586fbd3-207f844f_0 is DEAD
2025-10-02T09:28:18.810695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:18.810706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Write session will restart in 0.006393s
2025-10-02T09:28:18.810725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Write session: Do CDS request
2025-10-02T09:28:18.810732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:18.818160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.818277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.818293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-10-02T09:28:18.818406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.818436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.818443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.818447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.818516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:18.818784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-10-02T09:28:18.818809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.818811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.818812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.818817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675945987:2888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.818973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:18.819131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:18.819139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:18.819147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.819196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.819228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553856600428133:2735]
2025-10-02T09:28:18.819261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675945987:2888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.819773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.819945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.819977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.820267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.820287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675945987:2888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.820314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.820319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.820320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.820321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.820322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.820322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.820323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.820324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.820325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.820326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.820326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.820327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.820331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.820340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.820344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.820348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.820351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.820355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.820358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.820362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.820365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.820369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.820372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.820375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.820381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.820395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.820400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.820405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.820409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.820414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.820418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.820422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.820426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.820431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.820436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.820440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.820444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.820448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.820458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.820463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.820466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.820471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.820475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.820480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.820484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.820489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.820495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.820499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.820531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.824670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675945987:2888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.824682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675945987:2888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.824686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675945987:2888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.824709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.828786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.830517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.830533Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.830536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.830540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.830545Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [2:7556553856600428133:2735]
2025-10-02T09:28:18.830556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.830571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.830574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.830576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.830578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.830591Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.830602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.830608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.830670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.830678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.830680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.830682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.830684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.830744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.830754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.830766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.830775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.830788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.830810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675945904:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.830819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675946026:2888], now have 1 active actors on pipe
2025-10-02T09:28:18.830825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.830827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.830829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.830842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.830858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.830859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.830866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.830868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.830872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.830876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.830854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 67
2025-10-02T09:28:18.830859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 67
2025-10-02T09:28:18.830902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.830912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.830918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.830927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.830931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.830973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb263308-57f6c0cc-baedce1a-2954972f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.830983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.830987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.830989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.830999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.831011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.831030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.831158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.831176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.831191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.831288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb263308-57f6c0cc-baedce1a-2954972f_0
2025-10-02T09:28:18.831585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef28178f-35e1468c-6586fbd3-207f844f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb263308-57f6c0cc-baedce1a-2954972f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.834038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Write session: try to update token
2025-10-02T09:28:18.834051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:18.841513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:18.841530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:18.841533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:18.841535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:18.841543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.841547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.841551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553856600428128:2735]
2025-10-02T09:28:18.841586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:18.841586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:18.841592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:18.841595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:18.841597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.841599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:18.841730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:18.847955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|bb263308-57f6c0cc-baedce1a-2954972f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:18.850828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:18.910754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553856675946055:2503]
2025-10-02T09:28:18.910954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7556553856675946055:2503]
2025-10-02T09:28:18.974555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:18.974892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.974903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.974915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675946055:2503], now have 1 active actors on pipe
2025-10-02T09:28:18.975069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:18.975147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:18.975184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553856675946055:2503]
2025-10-02T09:28:18.975208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:18.975281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb263308-57f6c0cc-baedce1a-2954972f_0
2025-10-02T09:28:18.975435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|bb263308-57f6c0cc-baedce1a-2954972f_0 is DEAD
2025-10-02T09:28:18.975549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:18.975556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Write session will restart in 0.005365s
2025-10-02T09:28:18.975573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Write session: Do CDS request
2025-10-02T09:28:18.975577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:18.982234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.982309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:18.982321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-10-02T09:28:18.982448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:18.982478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:18.982485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:18.982488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:18.982826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-10-02T09:28:18.982853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:18.982858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:18.982859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:18.982864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553856675946141:2899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:18.983339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553856675946141:2899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:18.983614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:18.984135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:18.984267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:18.984275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:18.984283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:18.984318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:18.984347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553856600428292:2749]
2025-10-02T09:28:18.984850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:18.984989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553856675946141:2899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:18.985087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:18.985127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:18.985375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:18.985421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.985426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.985427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.985428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.985429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.985430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.985431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.985432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.985433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.985434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.985435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.985436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.985440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.985449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.985453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.985457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.985460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.985463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.985467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.985471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.985474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.985478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.985481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.985485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.985490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.985497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:18.985502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.985507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:18.985510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.985515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:18.985522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.985527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:18.985531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.985535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:18.985539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.985548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:18.985552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.985557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:18.985564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.985569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:18.985573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.985577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:18.985582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.985587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.985595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.985599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.985603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.985607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.985639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:18.990838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553856675946141:2899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:18.990852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553856675946141:2899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:18.990856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553856675946141:2899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:18.990862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:18.994488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:18.996310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:18.996323Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:18.996325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:18.996328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:18.996333Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [2:7556553856600428292:2749]
2025-10-02T09:28:18.996341Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:18.996354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:18.996356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.996358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.996359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.996371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:18.996375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:18.996380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:18.996431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.996439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.996441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.996444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:18.996446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:18.996499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:18.996505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:18.996512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:18.996518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:18.996529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:18.996550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:18.996555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:18.996557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:18.996564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:18.996571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:18.996573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:18.996574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:18.996577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675946060:2446], now have 1 active actors on pipe
2025-10-02T09:28:18.996584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553856675946180:2899], now have 1 active actors on pipe
2025-10-02T09:28:18.996589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:18.996601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:18.996607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:18.996632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:18.996643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:18.996640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 68
2025-10-02T09:28:18.996667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:18.996680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 68
2025-10-02T09:28:18.996829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.996836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.996854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:18.996861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:18.996863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:18.996865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:18.996870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:18.996880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:18.996888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.997012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:18.997018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:18.997027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:18.997105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 36 sessionId: src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0
2025-10-02T09:28:18.997393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb263308-57f6c0cc-baedce1a-2954972f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:18.999805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Write session: try to update token
2025-10-02T09:28:18.999817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.007445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:19.007458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.007460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:19.007461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:19.007468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:19.007471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:19.007473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553856600428287:2749]
2025-10-02T09:28:19.007502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:19.007505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.007507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:19.007514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:19.007529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:19.007532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:19.007643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:19.015243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:19.017493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:19.075114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553860970913484:2503]
2025-10-02T09:28:19.075404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7556553860970913484:2503]
2025-10-02T09:28:19.130688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:19.130918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.130928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.130942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913484:2503], now have 1 active actors on pipe
2025-10-02T09:28:19.131091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:19.131175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:19.131199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553860970913484:2503]
2025-10-02T09:28:19.131222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:19.131297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0
2025-10-02T09:28:19.131470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0 is DEAD
2025-10-02T09:28:19.131610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:19.131620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Write session will restart in 0.007858s
2025-10-02T09:28:19.131639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Write session: Do CDS request
2025-10-02T09:28:19.131653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:19.138526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:19.138939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:19.139066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:19.139073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:19.139081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:19.139114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:19.139148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553860895395714:2752]
2025-10-02T09:28:19.139733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:19.139934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:19.139965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:19.140152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:19.140191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.140197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.140196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.140196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.140197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.140197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.140198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.140198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.140199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.140199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.140200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.140200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.140201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.140204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.140210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.140212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.140214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.140216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.140218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.140220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.140222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.140224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.140226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.140228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.140230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.140234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.140238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.140241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.140245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.140248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.140253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.140257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.140262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.140266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.140271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.140276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.140282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.140290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.140300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.140308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.140314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.140323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.140328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.140337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.140360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.140369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.140375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.140380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.140385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.140422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:19.140410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:19.140419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-10-02T09:28:19.140526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.140550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:19.140556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:19.140559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:19.140849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-10-02T09:28:19.140874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:19.140879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:19.140881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:19.140885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553860970913577:2904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:19.141277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553860970913577:2904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:19.142611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553860970913577:2904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:19.147429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553860970913577:2904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:19.147441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553860970913577:2904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:19.147444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553860970913577:2904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:19.147448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:19.148873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:19.150545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:19.150559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:19.150562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:19.150565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:19.150571Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [2:7556553860895395714:2752]
2025-10-02T09:28:19.150583Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:19.150595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:19.150602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.150605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.150607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.150617Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:19.150626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:19.150633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:19.150683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.150689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.150691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.150694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:19.150696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:19.150752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:19.150759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.150771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.150788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.150809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:19.150831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913612:2904], now have 1 active actors on pipe
2025-10-02T09:28:19.150839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913488:2446], now have 1 active actors on pipe
2025-10-02T09:28:19.150844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.150846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.150848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.150857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:19.150870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:19.150874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:19.150876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:19.150878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:19.150881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 69
2025-10-02T09:28:19.150888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:19.150894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:19.150919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.150930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:19.150937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:19.150926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 69
2025-10-02T09:28:19.150962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.150970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.150989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|244dca2b-f65a5950-18c3b148-17f768d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:19.150998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.151001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.151003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:19.151010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.151020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:19.151034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.151151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.151158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.151180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.151259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 36 sessionId: src_id|244dca2b-f65a5950-18c3b148-17f768d8_0
2025-10-02T09:28:19.151502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d767384-ac7bba8a-3c7dd8ca-93ffa072_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|244dca2b-f65a5950-18c3b148-17f768d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:19.153890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Write session: try to update token
2025-10-02T09:28:19.153902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.161350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:19.161368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.161370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:19.161372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:19.161380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.161384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.161387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553860895395709:2752]
2025-10-02T09:28:19.161418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:19.161423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.161425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:19.161450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:19.161463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:19.161467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:19.161581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:19.169312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|244dca2b-f65a5950-18c3b148-17f768d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:19.172024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:19.231281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553860970913619:2503]
2025-10-02T09:28:19.231509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7556553860970913619:2503]
2025-10-02T09:28:19.286679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:19.286969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.286980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.286994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913619:2503], now have 1 active actors on pipe
2025-10-02T09:28:19.287147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:19.287256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:19.287265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553860970913619:2503]
2025-10-02T09:28:19.287270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:19.287289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:19.287320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: error at write: Disconnected sessionId: src_id|244dca2b-f65a5950-18c3b148-17f768d8_0
2025-10-02T09:28:19.287476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|244dca2b-f65a5950-18c3b148-17f768d8_0 is DEAD
2025-10-02T09:28:19.287681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:19.287696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Write session will restart in 0.009223s
2025-10-02T09:28:19.287727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Write session: Do CDS request
2025-10-02T09:28:19.287733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:19.294707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:19.295134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:19.295281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:19.295289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:19.295297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:19.295337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:19.295367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553860895395851:2755]
2025-10-02T09:28:19.295944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:19.296207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:19.296241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:19.296528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:19.296568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.296573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.296574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.296575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.296576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.296577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.296578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.296579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.296580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.296581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.296582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.296583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.296587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.296597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.296601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.296605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.296609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.296613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.296617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.296621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.296625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.296629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.296633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.296641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.296646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.296653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.296662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.296671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.296679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.296684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.296692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.296701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.296706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.296711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.296718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.296723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.296732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.296741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.296745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.296754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.296758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.296763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.296767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.296774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.296778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.296785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.296792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.296799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.296851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:19.298309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.298426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:19.298441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-10-02T09:28:19.298595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.298623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:19.298632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:19.298641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:19.298997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-10-02T09:28:19.299023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:19.299024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:19.299025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:19.299028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553860970913724:2909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:19.299426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553860970913724:2909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:19.301006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553860970913724:2909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:19.304393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553860970913724:2909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:19.304405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553860970913724:2909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:19.304409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553860970913724:2909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:19.304479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:19.305161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:19.306823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:19.306842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:19.306845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:19.306849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:19.306854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [2:7556553860895395851:2755]
2025-10-02T09:28:19.306866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:19.306880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:19.306882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.306885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.306886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.306896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:19.306903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:19.306913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:19.307009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.307018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.307020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.307023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:19.307026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:19.307086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:19.307094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.307107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.307119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.307135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:19.307159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913758:2909], now have 1 active actors on pipe
2025-10-02T09:28:19.307180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913633:2446], now have 1 active actors on pipe
2025-10-02T09:28:19.307185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.307192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.307194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.307209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:19.307201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 70
2025-10-02T09:28:19.307226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:19.307234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:19.307237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:19.307239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:19.307245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:19.307248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:19.307284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.307293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.307259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 70
2025-10-02T09:28:19.307303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.307315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:19.307323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:19.307345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:19.307354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.307358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.307360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:19.307368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.307376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:19.307484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.307648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.307661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.307679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.307777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0
2025-10-02T09:28:19.308154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244dca2b-f65a5950-18c3b148-17f768d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:19.311156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Write session: try to update token
2025-10-02T09:28:19.311187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.317665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:19.317682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.317684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:19.317686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:19.317693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.317698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.317700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553860895395846:2755]
2025-10-02T09:28:19.317727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:19.317731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.317732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:19.317761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:19.317767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:19.317771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:19.317920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:19.326002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:19.329034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:19.387552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553860970913765:2503]
2025-10-02T09:28:19.387849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7556553860970913765:2503]
2025-10-02T09:28:19.455408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:19.455912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.455923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.455939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913765:2503], now have 1 active actors on pipe
2025-10-02T09:28:19.456248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:19.456240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553860970913765:2503]
2025-10-02T09:28:19.456268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:19.456287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:19.456293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:19.456423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: error at write: Disconnected sessionId: src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0
2025-10-02T09:28:19.456605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0 is DEAD
2025-10-02T09:28:19.456799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:19.456826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Write session will restart in 0.006020s
2025-10-02T09:28:19.456855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Write session: Do CDS request
2025-10-02T09:28:19.456866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:19.464171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:19.464208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.464392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:19.464411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-10-02T09:28:19.464603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.464634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:19.464641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:19.464649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:19.464672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:19.464812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:19.464819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:19.464825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:19.464855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:19.464891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553860895395977:2757]
2025-10-02T09:28:19.465157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-10-02T09:28:19.465207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:19.465214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:19.465216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:19.465223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553860970913854:2913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:19.465249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:19.465486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:19.465525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:19.465735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:19.465768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.465772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.465773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.465773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.465774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.465775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.465775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.465776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.465776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.465776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.465777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.465778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.465781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.465788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.465790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.465792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.465794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.465796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.465798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.465800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.465803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.465805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.465807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.465812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.465816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.465820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.465823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.465826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.465829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.465832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.465834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.465837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.465841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.465844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.465846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.465848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.465850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.465853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.465855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.465858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.465864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.465866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.465826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553860970913854:2913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:19.465868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.465871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.465873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.465876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.465878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.465881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.465897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:19.468098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553860970913854:2913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:19.473360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553860970913854:2913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:19.473373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553860970913854:2913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:19.473376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553860970913854:2913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:19.473383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:19.473883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:19.478366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:19.478384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:19.478386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:19.478389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:19.478394Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [2:7556553860895395977:2757]
2025-10-02T09:28:19.478404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:19.478419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:19.478420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.478423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.478425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.478437Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:19.478440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:19.478445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:19.478493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.478499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.478500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.478503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:19.478504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:19.478572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:19.478578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.478588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.478598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.478613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:19.478633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913894:2913], now have 1 active actors on pipe
2025-10-02T09:28:19.478639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913767:2446], now have 1 active actors on pipe
2025-10-02T09:28:19.478644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.478645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.478648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.478656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:19.478665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:19.478676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:19.478676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:19.478678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:19.478680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:19.478682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:19.478709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.478717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:19.478723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:19.478750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 71
2025-10-02T09:28:19.478761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 71
2025-10-02T09:28:19.478841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.478848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.478865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d593b96-7bce170-c7ed006e-8a299720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:19.478869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.478872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.478873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:19.478879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.478886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:19.478899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.479048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.479055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.479065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.479147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d593b96-7bce170-c7ed006e-8a299720_0
2025-10-02T09:28:19.479494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5726d6-5a8dacc5-65ac30d9-91b63a6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d593b96-7bce170-c7ed006e-8a299720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:19.491833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:19.491849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.491855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.491885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:19.491899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:19.492189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:19.492767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.492896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.493017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.493190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:19.493220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:19.498856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Write session: try to update token
2025-10-02T09:28:19.498879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.499844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:19.499857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.499859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:19.499860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:19.499865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.499868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.499877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553860895395972:2757]
2025-10-02T09:28:19.499900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:19.499904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.499905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:19.499918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:19.499923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:19.499926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:19.500020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:19.532319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|2d593b96-7bce170-c7ed006e-8a299720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:19.535327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:19.556387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553860970913901:2503]
2025-10-02T09:28:19.556698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7556553860970913901:2503]
2025-10-02T09:28:19.622727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:19.623014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.623025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.623038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913901:2503], now have 1 active actors on pipe
2025-10-02T09:28:19.623248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:19.623333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553860970913901:2503]
2025-10-02T09:28:19.623333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:19.623371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:19.623440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d593b96-7bce170-c7ed006e-8a299720_0
2025-10-02T09:28:19.623623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|2d593b96-7bce170-c7ed006e-8a299720_0 is DEAD
2025-10-02T09:28:19.623789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:19.623801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Write session will restart in 0.008197s
2025-10-02T09:28:19.623841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Write session: Do CDS request
2025-10-02T09:28:19.623847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:19.632711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:19.633277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:19.633369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.633410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:19.633416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:19.633423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:19.633462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:19.633488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553860895396105:2759]
2025-10-02T09:28:19.633491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:19.633505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-10-02T09:28:19.633631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.633665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:19.633677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:19.633682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:19.633895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:19.634063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-10-02T09:28:19.634095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:19.634100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:19.634104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:19.634101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:19.634106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553860970913993:2917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:19.634132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:19.634334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:19.634367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.634372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.634372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.634373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.634373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.634374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.634375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.634375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.634376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.634377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.634377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.634378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.634381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.634388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.634390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.634392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.634394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.634397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.634399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.634401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.634403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.634405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.634407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.634410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.634414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.634418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.634421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.634424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.634429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.634432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.634434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.634436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.634439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.634442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.634444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.634448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.634450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.634453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.634455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.634458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.634461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.634465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.634468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.634470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.634473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.634475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.634478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.634480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.634507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:19.634653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553860970913993:2917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:19.636444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553860970913993:2917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:19.641933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553860970913993:2917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:19.641948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553860970913993:2917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:19.641952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553860970913993:2917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:19.641960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:19.643388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:19.645064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:19.645078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:19.645081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:19.645083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:19.645088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [2:7556553860895396105:2759]
2025-10-02T09:28:19.645098Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:19.645110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:19.645112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.645114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.645116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.645127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:19.645131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:19.645136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:19.645179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.645182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.645183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.645186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:19.645187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:19.645236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:19.645241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.645248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.645254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.645264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:19.645279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.645284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.645285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.645291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:19.645300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:19.645300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:19.645302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:19.645303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:19.645309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:19.645311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:19.645318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914030:2917], now have 1 active actors on pipe
2025-10-02T09:28:19.645321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970913903:2446], now have 1 active actors on pipe
2025-10-02T09:28:19.645343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.645351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:19.645356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:19.645418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 72
2025-10-02T09:28:19.645425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 72
2025-10-02T09:28:19.645502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.645508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.645526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:19.645535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.645538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.645539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:19.645545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.645551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:19.645567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.645723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.645728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.645736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.645821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 36 sessionId: src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0
2025-10-02T09:28:19.646187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d593b96-7bce170-c7ed006e-8a299720_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:19.649086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Write session: try to update token
2025-10-02T09:28:19.649104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.656251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:19.656268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.656270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:19.656272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:19.656280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.656287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.656290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553860895396100:2759]
2025-10-02T09:28:19.656322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:19.656323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:19.656327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.656327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:19.656329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:19.656329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:19.656579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:19.666210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:19.668581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:19.723379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553860970914044:2503]
2025-10-02T09:28:19.723720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7556553860970914044:2503]
2025-10-02T09:28:19.788354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:19.788967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.788980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.788995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914044:2503], now have 1 active actors on pipe
2025-10-02T09:28:19.789235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:19.789249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:19.789284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553860970914044:2503]
2025-10-02T09:28:19.789313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:19.789346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:19.789425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: error at write: Disconnected sessionId: src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0
2025-10-02T09:28:19.789668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0 is DEAD
2025-10-02T09:28:19.789856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:19.789870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Write session will restart in 0.008821s
2025-10-02T09:28:19.789967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Write session: Do CDS request
2025-10-02T09:28:19.789974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:19.797166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:19.797463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:19.797669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:19.797681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:19.797690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:19.797733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:19.797767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553860895396236:2762]
2025-10-02T09:28:19.798316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:19.798532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:19.798580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:19.798829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:19.798866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.798870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.798871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.798871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.798872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.798872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.798873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.798873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.798874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.798874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.798875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.798875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.798878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.798885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.798887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.798889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.798891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.798893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.798895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.798897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.798899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.798901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.798903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.798905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.798908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.798913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.798916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.798919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.798921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.798924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.798926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.798929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.798931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.798934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.798936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.798939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.798941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.798944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.798946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.798949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.798951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.798954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.798956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.798959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.798961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.798965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.798967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.798969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.798990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:19.800432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.800540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:19.800555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-10-02T09:28:19.800716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.800745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:19.800749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:19.800753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:19.801260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-10-02T09:28:19.801291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:19.801295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:19.801297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:19.801304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553860970914146:2922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:19.801805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553860970914146:2922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:19.804414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553860970914146:2922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:19.807319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553860970914146:2922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:19.807328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553860970914146:2922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:19.807331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553860970914146:2922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:19.807338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:19.807909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:19.811633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:19.811644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:19.811645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:19.811648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:19.811651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [2:7556553860895396236:2762]
2025-10-02T09:28:19.811660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:19.811671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:19.811673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.811675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.811676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.811684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:19.811687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:19.811691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:19.811731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.811736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.811737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.811739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:19.811741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:19.811780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:19.811785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.811793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.811799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.811813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:19.811833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914052:2446], now have 1 active actors on pipe
2025-10-02T09:28:19.811836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914181:2922], now have 1 active actors on pipe
2025-10-02T09:28:19.811841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.811844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.811846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.811860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:19.811868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:19.811870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:19.811871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:19.811875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:19.811887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:19.811893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:19.811919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.811929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:19.811932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:19.811929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 73
2025-10-02T09:28:19.811930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 73
2025-10-02T09:28:19.811963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.811970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.811989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:19.811996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.811998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.811999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:19.812006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.812015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:19.812025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.812163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.812170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.812182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.812277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 36 sessionId: src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0
2025-10-02T09:28:19.812707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e47fd9-4f37656e-9b5035e2-cf65b370_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:19.822590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Write session: try to update token
2025-10-02T09:28:19.822609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.828655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:19.828672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.828678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.828709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:19.828718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:19.829029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:19.829183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.829343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.829745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.829985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:19.830016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:19.833906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:19.833921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.833922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:19.833924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:19.833929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.833933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.833935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553860895396231:2762]
2025-10-02T09:28:19.833961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:19.833965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.833966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:19.833979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:19.833983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:19.833985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:19.834097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:19.846876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:19.849644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:19.889239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553860970914188:2503]
2025-10-02T09:28:19.889542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7556553860970914188:2503]
2025-10-02T09:28:19.959595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:19.959801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.959811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.959824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914188:2503], now have 1 active actors on pipe
2025-10-02T09:28:19.959990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:19.960048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553860970914188:2503]
2025-10-02T09:28:19.960081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:19.960081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:19.960180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0
2025-10-02T09:28:19.960351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0 is DEAD
2025-10-02T09:28:19.960501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:19.960513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Write session will restart in 0.005953s
2025-10-02T09:28:19.960553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Write session: Do CDS request
2025-10-02T09:28:19.960558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:19.967224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.967405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:19.967417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-10-02T09:28:19.967554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:19.967580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:19.967584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:19.967587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:19.967985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-10-02T09:28:19.968019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:19.968023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:19.968025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:19.968031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553860970914302:2933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:19.968592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:19.968649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553860970914302:2933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:19.968985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:19.969149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:19.969160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:19.969168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:19.969212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:19.969290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553860895396401:2776]
2025-10-02T09:28:19.969800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:19.970040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:19.970080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:19.970368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:19.970421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.970427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.970428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.970429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.970431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.970432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.970433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.970433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.970434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.970435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.970436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.970437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.970441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.970450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.970453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.970457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.970460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.970463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.970466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.970470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.970473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.970476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.970479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.970483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.970488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.970494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:19.970498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.970502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:19.970505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.970509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:19.970513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.970518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:19.970523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.970528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:19.970533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.970537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:19.970541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.970547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:19.970550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.970557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:19.970565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.970570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:19.970573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.970578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.970581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.970586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.970589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.970593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.970625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:19.970701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553860970914302:2933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:19.975856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553860970914302:2933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:19.975869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553860970914302:2933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:19.975873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553860970914302:2933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:19.975881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:19.978783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:19.980856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:19.980869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:19.980871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:19.980874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:19.980880Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [2:7556553860895396401:2776]
2025-10-02T09:28:19.980892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:19.980906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:19.980909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.980912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.980914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.980928Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:19.980933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:19.980940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:19.980990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.980996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.980998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.981001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:19.981003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:19.981103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:19.981111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:19.981124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:19.981135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:19.981161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:19.981182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914341:2933], now have 1 active actors on pipe
2025-10-02T09:28:19.981187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553860970914215:2446], now have 1 active actors on pipe
2025-10-02T09:28:19.981193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:19.981195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:19.981197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:19.981209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:19.981221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:19.981225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:19.981228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:19.981230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:19.981236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:19.981240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:19.981267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:19.981277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:19.981272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 74
2025-10-02T09:28:19.981301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:19.981273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 74
2025-10-02T09:28:19.981399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.981407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.981430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a131609-24fcafc4-75e88e66-7c66b52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:19.981439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:19.981445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:19.981450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:19.981459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:19.981466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:19.981476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.981663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:19.981677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:19.981695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:19.981784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a131609-24fcafc4-75e88e66-7c66b52_0
2025-10-02T09:28:19.982122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b41050-71818dc8-e5bbceeb-d912a2f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a131609-24fcafc4-75e88e66-7c66b52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:19.985165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Write session: try to update token
2025-10-02T09:28:19.985178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:19.991898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:19.991915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:19.991923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:19.991960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:19.991961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:19.992123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:19.992266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.992401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.992531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:19.992716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:19.992752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:20.001847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:20.001864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:20.001867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:20.001869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:20.001879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:20.001883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:20.001890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553860895396396:2776]
2025-10-02T09:28:20.001922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:20.001928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.001930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:20.001929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:20.001934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:20.001936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:20.002069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:20.002223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|9a131609-24fcafc4-75e88e66-7c66b52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:20.004903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:20.060195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553865265881644:2503]
2025-10-02T09:28:20.060408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7556553865265881644:2503]
2025-10-02T09:28:20.130727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:20.130994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.131006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.131022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881644:2503], now have 1 active actors on pipe
2025-10-02T09:28:20.131250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:20.131234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553865265881644:2503]
2025-10-02T09:28:20.131237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:20.131264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:20.131268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:20.131325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|9a131609-24fcafc4-75e88e66-7c66b52_0
2025-10-02T09:28:20.131466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|9a131609-24fcafc4-75e88e66-7c66b52_0 is DEAD
2025-10-02T09:28:20.131607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:20.131616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Write session will restart in 0.009268s
2025-10-02T09:28:20.131641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Write session: Do CDS request
2025-10-02T09:28:20.131646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:20.139555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:20.139955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:20.140145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:20.140153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:20.140161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:20.140200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:20.140227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553865190363830:2779]
2025-10-02T09:28:20.140618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:20.140832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:20.140868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:20.141062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:20.141094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.141098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.141099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.141099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.141100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.141100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.141101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.141102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.141102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.141103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.141103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.141104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.141107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.141114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.141117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.141119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.141121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.141123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.141125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.141127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.141129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.141132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.141134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.141136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.141140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.141144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.141147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.141151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.141153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.141156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.141158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.141161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.141164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.141167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.141169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.141182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.141187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.141190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.141192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.141195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.141197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.141200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.141202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.141205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.141207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.141210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.141212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.141217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.141236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:20.142336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.142640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:20.142652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-10-02T09:28:20.142749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.142770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:20.142778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:20.142782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:20.143123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-10-02T09:28:20.143159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:20.143161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:20.143174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:20.143179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553865265881743:2938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:20.143697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553865265881743:2938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:20.145376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553865265881743:2938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:20.148970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553865265881743:2938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:20.148984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553865265881743:2938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:20.148987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553865265881743:2938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:20.148995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:20.149562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:20.151461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:20.151476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:20.151477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:20.151481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:20.151486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [2:7556553865190363830:2779]
2025-10-02T09:28:20.151497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:20.151513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:20.151516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.151519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.151520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.151533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:20.151536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:20.151540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:20.151579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.151585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.151586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.151588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:20.151590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:20.151648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:20.151654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.151663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.151671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.151684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:20.151701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881649:2446], now have 1 active actors on pipe
2025-10-02T09:28:20.151708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881778:2938], now have 1 active actors on pipe
2025-10-02T09:28:20.151712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.151714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.151715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.151725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:20.151735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:20.151744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:20.151746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:20.151749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:20.151753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:20.151755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:20.151773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.151779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:20.151781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:20.151807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 75
2025-10-02T09:28:20.151837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 75
2025-10-02T09:28:20.151889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.151896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.151912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7680410-c9e1d946-5a4071f6-505b4230_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:20.151920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.151922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.151923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:20.151929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.151936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:20.151949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.152084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.152091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.152100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.152153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7680410-c9e1d946-5a4071f6-505b4230_0
2025-10-02T09:28:20.152452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a131609-24fcafc4-75e88e66-7c66b52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7680410-c9e1d946-5a4071f6-505b4230_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:20.155512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Write session: try to update token
2025-10-02T09:28:20.155530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:20.163415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:20.163434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:20.163435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:20.163437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:20.163443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.163450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.163453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553865190363825:2779]
2025-10-02T09:28:20.163487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:20.163493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.163494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:20.163503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:20.163509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:20.163513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:20.163637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:20.174575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|f7680410-c9e1d946-5a4071f6-505b4230_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:20.177488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:20.231235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553865265881785:2503]
2025-10-02T09:28:20.231444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7556553865265881785:2503]
2025-10-02T09:28:20.291825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:20.292196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.292211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.292229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881785:2503], now have 1 active actors on pipe
2025-10-02T09:28:20.292395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:20.292454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553865265881785:2503]
2025-10-02T09:28:20.292459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:20.292485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:20.292552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7680410-c9e1d946-5a4071f6-505b4230_0
2025-10-02T09:28:20.292742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|f7680410-c9e1d946-5a4071f6-505b4230_0 is DEAD
2025-10-02T09:28:20.292852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:20.292861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Write session will restart in 0.005904s
2025-10-02T09:28:20.292886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Write session: Do CDS request
2025-10-02T09:28:20.292890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:20.300295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.300483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:20.300498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-10-02T09:28:20.300673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.300705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:20.300714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:20.300719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:20.301256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-10-02T09:28:20.301299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:20.301311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:20.301313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:20.301318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553865265881890:2943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:20.301468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:20.301765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553865265881890:2943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:20.301956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:20.302100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:20.302109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:20.302117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:20.302156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:20.302182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553865190363973:2782]
2025-10-02T09:28:20.302611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:20.302833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:20.302873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:20.303148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:20.303224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.303230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.303231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.303232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.303232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.303233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.303234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.303235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.303236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.303237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.303238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.303239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.303243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.303253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.303257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.303261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.303265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.303273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.303277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.303280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.303284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.303288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.303292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.303300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.303305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.303316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.303325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.303331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.303335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.303340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.303344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.303349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.303358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.303366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.303374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.303383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.303390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.303398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.303402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.303407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.303413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.303416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.303418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.303421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.303424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.303427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.303432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.303435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.303452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:20.303598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553865265881890:2943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:20.309179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553865265881890:2943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:20.309195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553865265881890:2943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:20.309198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553865265881890:2943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:20.309212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:20.312365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:20.314216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:20.314231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:20.314233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:20.314237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:20.314243Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [2:7556553865190363973:2782]
2025-10-02T09:28:20.314255Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:20.314269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:20.314272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.314274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.314276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.314290Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:20.314299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:20.314305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:20.314361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.314368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.314370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.314373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:20.314376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:20.314432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:20.314439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.314450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.314462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.314480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:20.314502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881929:2943], now have 1 active actors on pipe
2025-10-02T09:28:20.314509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881799:2446], now have 1 active actors on pipe
2025-10-02T09:28:20.314515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.314517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.314520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.314532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:20.314533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:20.314536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:20.314524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 76
2025-10-02T09:28:20.314537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 76
2025-10-02T09:28:20.314537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:20.314544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:20.314557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:20.314559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:20.314586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.314596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:20.314607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.314609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:20.314615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.314663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:20.314673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.314676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.314678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:20.314685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.314697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:20.314715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.314841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.314848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.314859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.314931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 36 sessionId: src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0
2025-10-02T09:28:20.315268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7680410-c9e1d946-5a4071f6-505b4230_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:20.318205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Write session: try to update token
2025-10-02T09:28:20.318225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:20.326097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:20.326114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:20.326116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:20.326118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:20.326126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.326130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.326133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553865190363968:2782]
2025-10-02T09:28:20.326168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:20.326174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.326176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:20.326187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:20.326201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:20.326205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:20.326307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:20.332692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:20.335300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:20.392499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553865265881942:2503]
2025-10-02T09:28:20.392746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7556553865265881942:2503]
2025-10-02T09:28:20.459018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:20.459336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.459347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.459360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881942:2503], now have 1 active actors on pipe
2025-10-02T09:28:20.459553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:20.459584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553865265881942:2503]
2025-10-02T09:28:20.459614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:20.459614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:20.459694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: status is not ok: tablet will be restarted right now sessionId: src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0
2025-10-02T09:28:20.459869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0 is DEAD
2025-10-02T09:28:20.460093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:20.460111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Write session will restart in 0.009605s
2025-10-02T09:28:20.460140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Write session: Do CDS request
2025-10-02T09:28:20.460147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:20.468566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:20.469085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:20.469229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:20.469238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:20.469247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:20.469284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:20.469318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553865190364105:2784]
2025-10-02T09:28:20.469870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:20.470145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:20.470185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:20.470453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:20.470513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.470519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.470520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.470520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.470521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.470522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.470523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.470524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.470525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.470526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.470527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.470528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.470532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.470542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.470545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.470549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.470552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.470555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.470558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.470561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.470565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.470568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.470571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.470574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.470580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.470586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.470591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.470595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.470599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.470603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.470606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.470614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.470619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.470623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.470627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.470632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.470639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.470642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.470651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.470655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.470659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.470662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.470671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.470675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.470680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.470687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.470691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.470723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:20.471393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.471515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:20.471530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-10-02T09:28:20.471660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.471694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:20.471703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:20.471709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:20.472076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-10-02T09:28:20.472107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:20.472112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:20.472114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:20.472119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553865265882042:2948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:20.472641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553865265882042:2948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:20.474669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553865265882042:2948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:20.478924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553865265882042:2948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:20.478941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553865265882042:2948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:20.478946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553865265882042:2948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:20.478953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:20.479660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:20.481611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:20.481625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:20.481627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:20.481631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:20.481637Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [2:7556553865190364105:2784]
2025-10-02T09:28:20.481650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:20.481664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:20.481667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.481670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.481672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.481687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:20.481692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:20.481697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:20.481748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.481754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.481756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.481759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:20.481761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:20.481820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:20.481826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.481837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.481847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.481866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:20.481886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882076:2948], now have 1 active actors on pipe
2025-10-02T09:28:20.481895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.481897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.481900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.481911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:20.481924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265881943:2446], now have 1 active actors on pipe
2025-10-02T09:28:20.481930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:20.481933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:20.481935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:20.481936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:20.481947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:20.481950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:20.481977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.481987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:20.481998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:20.481996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 77
2025-10-02T09:28:20.482007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 77
2025-10-02T09:28:20.482043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.482050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.482072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:20.482082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.482085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.482087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:20.482094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.482106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:20.482117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.482277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.482285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.482298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.482387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0
2025-10-02T09:28:20.482748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|269754f7-f2f7be72-e8773ead-5eaf763b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:20.485358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Write session: try to update token
2025-10-02T09:28:20.485374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:20.493281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:20.493299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:20.493301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:20.493303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:20.493311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.493315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.493319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553865190364100:2784]
2025-10-02T09:28:20.493350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:20.493354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.493355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:20.493359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:20.493365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:20.493372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:20.493515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:20.502226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:20.504716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:20.559889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553865265882084:2503]
2025-10-02T09:28:20.560146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7556553865265882084:2503]
2025-10-02T09:28:20.623853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:20.624147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.624157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.624171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882084:2503], now have 1 active actors on pipe
2025-10-02T09:28:20.624351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:20.624407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:20.624424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553865265882084:2503]
2025-10-02T09:28:20.624457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:20.624530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0
2025-10-02T09:28:20.624714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0 is DEAD
2025-10-02T09:28:20.624879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:20.624888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Write session will restart in 0.005199s
2025-10-02T09:28:20.624914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Write session: Do CDS request
2025-10-02T09:28:20.624920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:20.631310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.631428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:20.631440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-10-02T09:28:20.631580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.631603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:20.631618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:20.631622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:20.632003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-10-02T09:28:20.632051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:20.632057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:20.632058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:20.632063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553865265882150:2952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:20.632574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553865265882150:2952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:20.634139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:20.634680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553865265882150:2952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:20.634721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:20.634910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:20.634925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:20.634937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:20.634994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:20.635039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553865190364238:2786]
2025-10-02T09:28:20.635654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:20.635897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:20.635937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:20.636278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:20.636372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.636384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.636385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.636386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.636387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.636388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.636389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.636390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.636391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.636392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.636393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.636394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.636400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.636412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.636416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.636420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.636423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.636427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.636431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.636436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.636440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.636444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.636448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.636452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.636459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.636468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.636474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.636479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.636484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.636489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.636503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.636515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.636526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.636538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.636549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.636561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.636569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.636573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.636577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.636585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.636588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.636593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.636600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.636604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.636609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.636613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.636618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.636627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.636663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:20.637410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553865265882150:2952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:20.637422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553865265882150:2952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:20.637425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553865265882150:2952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:20.637432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:20.645310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:20.647086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:20.647105Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:20.647108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:20.647112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:20.647118Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [2:7556553865190364238:2786]
2025-10-02T09:28:20.647133Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:20.647149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:20.647152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.647156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.647157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.647182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:20.647192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:20.647202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:20.647255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.647261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.647263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.647266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:20.647267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:20.647328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:20.647334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.647342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.647348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.647358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:20.647370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.647372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.647374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.647380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:20.647390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:20.647392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882085:2446], now have 1 active actors on pipe
2025-10-02T09:28:20.647393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:20.647395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882218:2952], now have 1 active actors on pipe
2025-10-02T09:28:20.647395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:20.647401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:20.647411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:20.647417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:20.647440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.647449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:20.647454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:20.647496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 78
2025-10-02T09:28:20.647504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 78
2025-10-02T09:28:20.647594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.647603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.647628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:20.647640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.647645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.647646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:20.647652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.647658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:20.647670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.647887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.647897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.647910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.648019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0
2025-10-02T09:28:20.648368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8d7046-a4b54d08-65ac4566-ed30cff9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:20.651548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Write session: try to update token
2025-10-02T09:28:20.651565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:20.658346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:20.658366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:20.658369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:20.658371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:20.658379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.658383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.658387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553865190364233:2786]
2025-10-02T09:28:20.658423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:20.658428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.658431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:20.658439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:20.658445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:20.658448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:20.658666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:20.668761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:20.671407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:20.724796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553865265882231:2503]
2025-10-02T09:28:20.725212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7556553865265882231:2503]
2025-10-02T09:28:20.807869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:20.808175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.808188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.808201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882231:2503], now have 1 active actors on pipe
2025-10-02T09:28:20.808342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:20.808469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:20.808484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553865265882231:2503]
2025-10-02T09:28:20.808504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:20.808661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0
2025-10-02T09:28:20.808828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0 is DEAD
2025-10-02T09:28:20.808989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:20.808999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Write session will restart in 0.009959s
2025-10-02T09:28:20.809023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Write session: Do CDS request
2025-10-02T09:28:20.809028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:20.817252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:20.817792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:20.817955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:20.817962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:20.817976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:20.818022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:20.818062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553865190364374:2789]
2025-10-02T09:28:20.818613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:20.818815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:20.818847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:20.819130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:20.819190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.819195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.819196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.819197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.819198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.819199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.819200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.819201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.819202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.819203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.819204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.819205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.819210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.819221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.819224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.819228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.819232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.819235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.819239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.819242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.819246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.819250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.819253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.819256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.819262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.819269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.819274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.819279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.819283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.819288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.819292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.819296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.819300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.819305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.819309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.819314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.819318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.819322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.819326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.819331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.819335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.819341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.819349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.819355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.819363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.819368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.819372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.819377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.819411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:20.820291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.820397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:20.820411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-10-02T09:28:20.820518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.820548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:20.820553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:20.820557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:20.820933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-10-02T09:28:20.820963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:20.820969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:20.820972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:20.820976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553865265882336:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:20.821418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553865265882336:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:20.823141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553865265882336:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:20.827229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553865265882336:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:20.827241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553865265882336:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:20.827244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553865265882336:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:20.827252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:20.828075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:20.830017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:20.830033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:20.830035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:20.830038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:20.830043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [2:7556553865190364374:2789]
2025-10-02T09:28:20.830052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:20.830062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:20.830064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.830066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.830067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.830077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:20.830080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:20.830085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:20.830128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.830133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.830135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.830137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:20.830138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:20.830185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:20.830191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.830202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.830218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.830232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:20.830249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882370:2957], now have 1 active actors on pipe
2025-10-02T09:28:20.830256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882236:2446], now have 1 active actors on pipe
2025-10-02T09:28:20.830262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.830268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.830269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.830278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:20.830290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:20.830299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:20.830302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:20.830304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:20.830307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:20.830295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 79
2025-10-02T09:28:20.830310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 79
2025-10-02T09:28:20.830310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:20.830338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.830348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:20.830354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:20.830360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.830364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.830393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:20.830400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:20.830403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:20.830405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:20.830412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:20.830418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:20.830432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.830584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.830592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.830605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:20.830672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 36 sessionId: src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0
2025-10-02T09:28:20.830976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f96ff5-d400d1f4-3e5efac1-e3ec7f39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:20.834015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Write session: try to update token
2025-10-02T09:28:20.834031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:20.841276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:20.841295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:20.841297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:20.841298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:20.841307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.841311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.841315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553865190364369:2789]
2025-10-02T09:28:20.841345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:20.841350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.841355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:20.841379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:20.841385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:20.841388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:20.841487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:20.852154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:20.855120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:20.908609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553865265882378:2503]
2025-10-02T09:28:20.908906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7556553865265882378:2503]
2025-10-02T09:28:20.977621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:20.977884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:20.977898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:20.977913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882378:2503], now have 1 active actors on pipe
2025-10-02T09:28:20.978071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:20.978110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:20.978120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:20.978181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0
2025-10-02T09:28:20.978328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0 is DEAD
2025-10-02T09:28:20.978476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553865265882378:2503]
2025-10-02T09:28:20.978491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:20.978500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:20.978509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Write session will restart in 0.008861s
2025-10-02T09:28:20.978524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Write session: Do CDS request
2025-10-02T09:28:20.978529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:20.987876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:20.988293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.988422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:20.988491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:20.988505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-10-02T09:28:20.988576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:20.988585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:20.988594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:20.988635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:20.988668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553865190364545:2801]
2025-10-02T09:28:20.988711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:20.988736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:20.988740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:20.988743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:20.989162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-10-02T09:28:20.989202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:20.989203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:20.989205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:20.989211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553865265882500:2968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:20.989229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:20.989522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:20.989562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:20.989817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553865265882500:2968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:20.989856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:20.989901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.989906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.989907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.989908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.989909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.989910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.989911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.989912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.989913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.989914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.989915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.989916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.989921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.989930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.989934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.989938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.989941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.989945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.989949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.989953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.989956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.989960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.989963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.989967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.989974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.989980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:20.989985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.989989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:20.989993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.989998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:20.990002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.990006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:20.990010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.990019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:20.990023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.990028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:20.990034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.990039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:20.990047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.990052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:20.990060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.990065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:20.990069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.990077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:20.990082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.990091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:20.990095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.990103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:20.990134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:20.991821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553865265882500:2968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:20.998111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553865265882500:2968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:20.998122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553865265882500:2968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:20.998125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553865265882500:2968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:20.998133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:20.998583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:21.000478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:21.000494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:21.000496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.000499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.000503Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [2:7556553865190364545:2801]
2025-10-02T09:28:21.000513Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:21.000526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:21.000528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.000530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.000532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.000544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:21.000547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.000552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:21.000601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.000609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.000611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.000614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:21.000616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:21.000664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:21.000669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.000677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.000682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.000696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:21.000714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.000717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.000719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.000726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:21.000736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:21.000739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:21.000741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:21.000742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:21.000750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:21.000751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:21.000758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882395:2446], now have 1 active actors on pipe
2025-10-02T09:28:21.000760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553865265882536:2968], now have 1 active actors on pipe
2025-10-02T09:28:21.000781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.000788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:21.000796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:21.000843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 80
2025-10-02T09:28:21.000872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 80
2025-10-02T09:28:21.000923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.000929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.000952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:21.000962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.000973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.000974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.000982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.000994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:21.001010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.001146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.001153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.001165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.001285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 36 sessionId: src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0
2025-10-02T09:28:21.001652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468e4a22-4de4d9d8-38bbfb3d-3a9e2f95_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:21.004549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Write session: try to update token
2025-10-02T09:28:21.004565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:21.012084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:21.012102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.012105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:21.012106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:21.012114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.012122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.012126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553865190364540:2801]
2025-10-02T09:28:21.012163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:21.012167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:21.012169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.012171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:21.012172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:21.012175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:21.012337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:21.020125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:21.022852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:21.078554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553869560849842:2503]
2025-10-02T09:28:21.078786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7556553869560849842:2503]
2025-10-02T09:28:21.148305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:21.148654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.148666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.148679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560849842:2503], now have 1 active actors on pipe
2025-10-02T09:28:21.148905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:21.148919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:21.148931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:21.148949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:21.148987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: error at write: Disconnected sessionId: src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0
2025-10-02T09:28:21.148990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553869560849842:2503]
2025-10-02T09:28:21.149243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0 is DEAD
2025-10-02T09:28:21.149481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:21.149495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Write session will restart in 0.009211s
2025-10-02T09:28:21.149519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Write session: Do CDS request
2025-10-02T09:28:21.149524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:21.158557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:21.159223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:21.159388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.159397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:21.159407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:21.159456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:21.159533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553869485331979:2806]
2025-10-02T09:28:21.160046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:21.160328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:21.160347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.160362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:21.160438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:21.160454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-10-02T09:28:21.160574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:21.160581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.160606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.160610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.160611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.160612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.160613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:21.160626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:21.160612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.160613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.160631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:21.160614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.160614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.160615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.160615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.160616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.160617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.160620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.160627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.160629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.160631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.160634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.160636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.160638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.160640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.160642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.160644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.160646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.160648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.160652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.160656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.160660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.160662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.160665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.160669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.160671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.160674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.160677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.160680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.160682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.160684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.160687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.160689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.160692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.160695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.160697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.160699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.160702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.160704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.160707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.160710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.160712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.160715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.160733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:21.161076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-10-02T09:28:21.161119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:21.161127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:21.161129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:21.161136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553869560849946:2973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:21.161641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553869560849946:2973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:21.163275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553869560849946:2973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:21.168340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553869560849946:2973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:21.168359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553869560849946:2973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:21.168364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553869560849946:2973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:21.168371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:21.169888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:21.171739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:21.171756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:21.171759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.171763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.171769Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [2:7556553869485331979:2806]
2025-10-02T09:28:21.171782Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:21.171798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:21.171800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.171803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.171805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.171820Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:21.171825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.171832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:21.171889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.171899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.171900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.171903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:21.171905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:21.171968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:21.171975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.171989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.172004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.172021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:21.172044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560849844:2446], now have 1 active actors on pipe
2025-10-02T09:28:21.172054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560849981:2973], now have 1 active actors on pipe
2025-10-02T09:28:21.172060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.172062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.172064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.172074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:21.172090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:21.172090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:21.172104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:21.172106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:21.172106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:21.172108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:21.172100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 81
2025-10-02T09:28:21.172139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.172138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 81
2025-10-02T09:28:21.172146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:21.172148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:21.172177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.172185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.172213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:21.172227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.172230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.172232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.172240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.172248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:21.172327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.172508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.172517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.172533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.172622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0
2025-10-02T09:28:21.173020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f98121-111d3809-ac5c11e4-48da5a7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:21.175944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Write session: try to update token
2025-10-02T09:28:21.175968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:21.183394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:21.183416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.183418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:21.183420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:21.183428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.183432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.183437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553869485331974:2806]
2025-10-02T09:28:21.183472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:21.183478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.183481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:21.183482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:21.183489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:21.183492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:21.183646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:21.196177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:21.198858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:21.249145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553869560849988:2503]
2025-10-02T09:28:21.249439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7556553869560849988:2503]
2025-10-02T09:28:21.321988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:21.322336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.322351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.322368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560849988:2503], now have 1 active actors on pipe
2025-10-02T09:28:21.322627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:21.322620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:21.322620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553869560849988:2503]
2025-10-02T09:28:21.322632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:21.322659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:21.322695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: error at write: Disconnected sessionId: src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0
2025-10-02T09:28:21.322877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0 is DEAD
2025-10-02T09:28:21.323055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:21.323070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Write session will restart in 0.009650s
2025-10-02T09:28:21.323110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Write session: Do CDS request
2025-10-02T09:28:21.323116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:21.333276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:21.333760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:21.333925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.333932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:21.333939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:21.333971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:21.333998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553869485332128:2809]
2025-10-02T09:28:21.334353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.334374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:21.334445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:21.334460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-10-02T09:28:21.334647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.334663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:21.334676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:21.334686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:21.334691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:21.334704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:21.335022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:21.335065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-10-02T09:28:21.335074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.335097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:21.335080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.335080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.335098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:21.335081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.335082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.335101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:21.335083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.335106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553869560850104:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:21.335083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.335084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.335085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.335085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.335086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.335086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.335090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.335098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.335100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.335103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.335105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.335107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.335109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.335112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.335114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.335116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.335118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.335120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.335125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.335130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.335134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.335137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.335141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.335144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.335146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.335149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.335151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.335154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.335157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.335160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.335174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.335178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.335180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.335185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.335191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.335195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.335199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.335205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.335209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.335214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.335218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.335223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.335256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:21.335659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553869560850104:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:21.337238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553869560850104:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:21.341698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553869560850104:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:21.341714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553869560850104:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:21.341717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553869560850104:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:21.341725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:21.344281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:21.346218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:21.346236Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:21.346239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.346243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.346249Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [2:7556553869485332128:2809]
2025-10-02T09:28:21.346266Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:21.346282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:21.346289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.346292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.346294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.346312Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:21.346321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.346327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:21.346387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.346394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.346395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.346398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:21.346400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:21.346466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:21.346473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.346486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.346499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.346521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:21.346544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850001:2446], now have 1 active actors on pipe
2025-10-02T09:28:21.346547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850140:2978], now have 1 active actors on pipe
2025-10-02T09:28:21.346553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.346555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.346557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.346569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:21.346583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:21.346594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:21.346598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:21.346600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:21.346602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:21.346605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:21.346610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 82
2025-10-02T09:28:21.346612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 82
2025-10-02T09:28:21.346635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.346642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:21.346648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:21.346677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.346684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.346708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:21.346751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.346759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.346761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.346770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.346781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:21.346796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.346977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.346983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.346995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.347092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 36 sessionId: src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0
2025-10-02T09:28:21.347466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a6e7a4-12bf02dd-12290735-d926b498_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:21.350277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Write session: try to update token
2025-10-02T09:28:21.350296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:21.357584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:21.357605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.357608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:21.357610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:21.357623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.357627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.357631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553869485332123:2809]
2025-10-02T09:28:21.357667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:21.357672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.357676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:21.357681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:21.357686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:21.357689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:21.357805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:21.367046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:21.370096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:21.422650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553869560850147:2503]
2025-10-02T09:28:21.422904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7556553869560850147:2503]
2025-10-02T09:28:21.497449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:21.497710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.497720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.497735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850147:2503], now have 1 active actors on pipe
2025-10-02T09:28:21.497934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:21.497974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:21.497995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553869560850147:2503]
2025-10-02T09:28:21.498015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:21.498093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0
2025-10-02T09:28:21.498321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0 is DEAD
2025-10-02T09:28:21.498384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:21.498394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Write session will restart in 0.005831s
2025-10-02T09:28:21.498414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Write session: Do CDS request
2025-10-02T09:28:21.498428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:21.505244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.505341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:21.505356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-10-02T09:28:21.505509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.505541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:21.505547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:21.505551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:21.505972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-10-02T09:28:21.506008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:21.506014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:21.506016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:21.506021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553869560850209:2984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:21.506476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553869560850209:2984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:21.508003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:21.508589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553869560850209:2984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:21.508853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:21.509029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.509039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:21.509048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:21.509091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:21.509200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553869485332266:2811]
2025-10-02T09:28:21.509832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:21.510092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:21.510130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:21.510446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:21.510490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.510497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.510498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.510499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.510501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.510502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.510503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.510504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.510505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.510507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.510508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.510509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.510514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.510525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.510529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.510534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.510538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.510543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.510547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.510552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.510556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.510561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.510565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.510570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.510576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.510583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.510588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.510594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.510600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.510606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.510610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.510616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.510625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.510631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.510640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.510645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.510651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.510656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.510661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.510667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.510675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.510681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.510686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.510695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.510699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.510709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.510713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.510719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.510763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:21.510832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553869560850209:2984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:21.510844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553869560850209:2984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:21.510846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553869560850209:2984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:21.510853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:21.520145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:21.522064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:21.522085Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:21.522088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.522092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.522099Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [2:7556553869485332266:2811]
2025-10-02T09:28:21.522127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:21.522145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:21.522149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.522151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.522153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.522169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:21.522179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.522186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:21.522262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.522269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.522272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.522275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:21.522278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:21.522352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:21.522360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.522375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.522386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.522399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:21.522423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850152:2446], now have 1 active actors on pipe
2025-10-02T09:28:21.522431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850288:2984], now have 1 active actors on pipe
2025-10-02T09:28:21.522437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.522440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.522442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.522453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:21.522463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:21.522465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:21.522466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:21.522470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:21.522483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:21.522491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:21.522457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 83
2025-10-02T09:28:21.522493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 83
2025-10-02T09:28:21.522524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.522540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:21.522557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.522558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:21.522566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.522612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:21.522623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.522632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.522633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.522642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.522651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:21.522675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.522879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.522893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.522906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.522994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0
2025-10-02T09:28:21.523318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32e374cb-ee5a9c5a-93f21200-664183b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:21.526328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Write session: try to update token
2025-10-02T09:28:21.526344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:21.534225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:21.534249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.534251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:21.534257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:21.534266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.534270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.534273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553869485332261:2811]
2025-10-02T09:28:21.534312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:21.534318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.534320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:21.534384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:21.534398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:21.534402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:21.534520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:21.543365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:21.545961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:21.598263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553869560850298:2503]
2025-10-02T09:28:21.598574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7556553869560850298:2503]
2025-10-02T09:28:21.691838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:21.692168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.692185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.692204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850298:2503], now have 1 active actors on pipe
2025-10-02T09:28:21.692404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:21.692442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553869560850298:2503]
2025-10-02T09:28:21.692444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:21.692474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:21.692540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0
2025-10-02T09:28:21.692720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0 is DEAD
2025-10-02T09:28:21.692841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:21.692850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Write session will restart in 0.007068s
2025-10-02T09:28:21.692874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Write session: Do CDS request
2025-10-02T09:28:21.692880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:21.701347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.701549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:21.701566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-10-02T09:28:21.701732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.701770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:21.701779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:21.701783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:21.702195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-10-02T09:28:21.702230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:21.702237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:21.702239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:21.702244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553869560850407:2989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:21.702796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553869560850407:2989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:21.702869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:21.703470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:21.703643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.703653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:21.703662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:21.703708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:21.703745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553869485332406:2813]
2025-10-02T09:28:21.704131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:21.704429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:21.704430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553869560850407:2989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:21.704464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:21.704726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:21.704765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.704769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.704770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.704771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.704771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.704772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.704773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.704773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.704774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.704774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.704775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.704775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.704779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.704785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.704787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.704790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.704792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.704794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.704796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.704798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.704817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.704821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.704823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.704827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.704832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.704839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.704844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.704849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.704852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.704857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.704862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.704866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.704870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.704875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.704879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.704883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.704887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.704892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.704895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.704900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.704904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.704908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.704912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.704916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.704921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.704926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.704930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.704934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.704966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:21.710067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553869560850407:2989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:21.710083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553869560850407:2989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:21.710087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553869560850407:2989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:21.710094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:21.713848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:21.715998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:21.716019Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:21.716023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.716027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.716035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [2:7556553869485332406:2813]
2025-10-02T09:28:21.716051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:21.716071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:21.716076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.716079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.716082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.716096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:21.716101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.716108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:21.716178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.716190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.716193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.716196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:21.716199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:21.716268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:21.716274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.716288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.716297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.716317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:21.716339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850304:2446], now have 1 active actors on pipe
2025-10-02T09:28:21.716347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850449:2989], now have 1 active actors on pipe
2025-10-02T09:28:21.716353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.716356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.716359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.716373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:21.716388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:21.716406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:21.716406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:21.716410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:21.716412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:21.716414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:21.716412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 84
2025-10-02T09:28:21.716450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.716430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 84
2025-10-02T09:28:21.716458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:21.716477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:21.716495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.716503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.716527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:21.716537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.716541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.716548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.716557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.716571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:21.716589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.716761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.716768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.716780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.716914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0
2025-10-02T09:28:21.717300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5f6e50-a36908f2-94e8d3c-f9bc99f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:21.720329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Write session: try to update token
2025-10-02T09:28:21.720346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:21.727934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:21.727956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.727965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.728004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:21.728013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:21.728503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:21.728646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:21.728781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:21.728949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:21.729151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:21.729192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:21.738018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:21.738037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.738039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:21.738041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:21.738050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.738054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.738058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553869485332401:2813]
2025-10-02T09:28:21.738091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:21.738097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.738100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:21.738101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:21.738107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:21.738110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:21.738246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:21.739330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:21.741821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:21.792823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553869560850459:2503]
2025-10-02T09:28:21.793094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7556553869560850459:2503]
2025-10-02T09:28:21.878485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:21.878835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.878849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.878868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850459:2503], now have 1 active actors on pipe
2025-10-02T09:28:21.879044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:21.879070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553869560850459:2503]
2025-10-02T09:28:21.879094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:21.879099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:21.879179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0
2025-10-02T09:28:21.879347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0 is DEAD
2025-10-02T09:28:21.879457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:21.879464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Write session will restart in 0.007329s
2025-10-02T09:28:21.879480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Write session: Do CDS request
2025-10-02T09:28:21.879483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:21.888366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.888850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:21.888870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-10-02T09:28:21.889005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:21.889030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:21.889040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:21.889044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:21.889350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:21.889477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-10-02T09:28:21.889515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:21.889517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:21.889520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:21.889535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553869560850563:2993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:21.889915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:21.889986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553869560850563:2993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:21.890071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:21.890079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:21.890089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:21.890144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:21.890179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553869485332549:2816]
2025-10-02T09:28:21.890750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:21.891007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:21.891051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:21.891374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:21.891424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.891430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.891431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.891432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.891433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.891434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.891435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.891435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.891436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.891437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.891438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.891439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.891444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.891453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.891456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.891460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.891463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.891466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.891470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.891473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.891477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.891481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.891484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.891487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.891493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.891500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:21.891506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.891513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:21.891518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.891527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:21.891531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.891536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:21.891541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.891546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:21.891550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.891554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:21.891559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.891564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:21.891572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.891577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:21.891581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.891590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:21.891594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.891599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.891607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.891611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.891616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.891625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.891659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:21.891769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553869560850563:2993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:21.897603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553869560850563:2993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:21.897620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553869560850563:2993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:21.897623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553869560850563:2993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:21.897631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:21.900688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:21.902384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:21.902402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:21.902405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:21.902409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:21.902415Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [2:7556553869485332549:2816]
2025-10-02T09:28:21.902433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:21.902448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:21.902451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.902455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.902457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.902472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:21.902482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:21.902488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:21.902547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.902554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.902556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.902559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:21.902562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:21.902634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:21.902644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.902658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:21.902671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:21.902690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:21.902713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850602:2993], now have 1 active actors on pipe
2025-10-02T09:28:21.902722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850462:2446], now have 1 active actors on pipe
2025-10-02T09:28:21.902727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.902729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.902732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.902743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:21.902759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:21.902759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:21.902762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:21.902764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:21.902779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:21.902787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:21.902785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 85
2025-10-02T09:28:21.902816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.902801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 85
2025-10-02T09:28:21.902824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:21.902827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:21.902839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.902844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.903015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:21.903028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:21.903032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:21.903034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:21.903042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:21.903050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:21.903069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.903225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:21.903237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:21.903257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:21.903359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0
2025-10-02T09:28:21.903699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd410f18-9dc84a1d-9e0a2c53-1d4f8008_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:21.906672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Write session: try to update token
2025-10-02T09:28:21.906696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:21.914613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:21.914627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:21.914629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:21.914631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:21.914639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.914644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.914648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553869485332544:2816]
2025-10-02T09:28:21.914687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:21.914698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:21.914700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:21.914701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:21.914707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:21.914711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:21.915066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:21.930758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:21.933411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:21.979225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553869560850610:2503]
2025-10-02T09:28:21.979475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7556553869560850610:2503]
2025-10-02T09:28:22.053991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:22.054383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.054399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.054417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553869560850610:2503], now have 1 active actors on pipe
2025-10-02T09:28:22.054597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:22.054702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:22.054721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:22.054722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:22.054777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553869560850610:2503]
2025-10-02T09:28:22.054778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: error at write: Disconnected sessionId: src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0
2025-10-02T09:28:22.055107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0 is DEAD
2025-10-02T09:28:22.055241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:22.055254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Write session will restart in 0.009219s
2025-10-02T09:28:22.055282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Write session: Do CDS request
2025-10-02T09:28:22.055288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:22.065226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.065384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:22.065401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-10-02T09:28:22.065591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.065631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:22.065638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:22.065642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:22.066140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-10-02T09:28:22.066192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:22.066194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:22.066196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:22.066203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553873855818034:3004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:22.066423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.066788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553873855818034:3004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:22.067226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.067406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.067416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:22.067424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.067471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.067512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553873780300026:2830]
2025-10-02T09:28:22.068107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:22.068428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:22.068478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:22.068774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:22.068850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.068855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.068864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.068866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.068867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.068868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.068869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.068870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.068871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.068872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.068873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.068875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.068879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.068889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.068893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.068897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.068900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.068903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.068906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.068909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.068912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.068916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.068920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.068923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.068929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.068935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.068941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.068946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.068949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.068954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.068957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.068962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.068966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.068971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.068975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.068979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.068985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.068990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.068994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.068999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.069002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.069007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.069010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.069015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.069018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.069023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.069026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.069032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.069066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:22.069249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553873855818034:3004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:22.076293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553873855818034:3004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:22.076314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553873855818034:3004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:22.076319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553873855818034:3004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:22.076327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:22.080239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:22.081930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:22.081946Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:22.081948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.081951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.081958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [2:7556553873780300026:2830]
2025-10-02T09:28:22.081972Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:22.081990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:22.081993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.081996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.082009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.082023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:22.082030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.082036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:22.082091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.082098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.082101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.082104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:22.082106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:22.082175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:22.082183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.082195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.082207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.082234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:22.082259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818071:3004], now have 1 active actors on pipe
2025-10-02T09:28:22.082268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855817933:2446], now have 1 active actors on pipe
2025-10-02T09:28:22.082274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.082276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.082278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.082291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:22.082310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:22.082309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:22.082313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:22.082314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:22.082325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:22.082302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 86
2025-10-02T09:28:22.082329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:22.082360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.082317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 86
2025-10-02T09:28:22.082367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:22.082381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:22.082384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.082388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.082425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:22.082432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.082434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.082436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.082444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.082450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:22.082462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.082706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.082717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.082733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.082811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 36 sessionId: src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0
2025-10-02T09:28:22.083230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa592b78-19e156c8-205119ef-7ac5b8a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:22.085911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Write session: try to update token
2025-10-02T09:28:22.085928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:22.095094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:22.095114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.095122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.095175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:22.095174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:22.095392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:22.095581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.095743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.095909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.096219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:22.096261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:22.101194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:22.103836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:22.104187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.104209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.104236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:22.104337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:22.109044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:22.109063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.109066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:22.109068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:22.109076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.109080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.109083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553873780300020:2830]
2025-10-02T09:28:22.109120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:22.109128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.109130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:22.109131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:22.109137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:22.109154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:22.109275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:22.154812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553873855818080:2503]
2025-10-02T09:28:22.155171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7556553873855818080:2503]
2025-10-02T09:28:22.256523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:22.265624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.265653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.265827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.265905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.265982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.266048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.266096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.266099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.266176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.266239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.266306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.266375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.266419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.266422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.266499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.266561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.266631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.266699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.266751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.266754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.266853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.266939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.267005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.267071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.267119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.267122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.267212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.267276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.267416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.267487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.267542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.267545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.267621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.267702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.267768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.267832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.267959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.267962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.268039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.268103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.268178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.268247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.268293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.268295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.268371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.268436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.268505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.268574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.268639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.268642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.268720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.268787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.269072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.269149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.269248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.269251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.269337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.269402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.269470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.269541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.269606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.269609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.269681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818080:2503], now have 1 active actors on pipe
2025-10-02T09:28:22.270638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:22.270641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553873855818080:2503]
2025-10-02T09:28:22.270651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:22.270658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:22.270678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: error at write: Disconnected sessionId: src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0
2025-10-02T09:28:22.270658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:22.270859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0 is DEAD
2025-10-02T09:28:22.271062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:22.271074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Write session will restart in 0.008840s
2025-10-02T09:28:22.271102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Write session: Do CDS request
2025-10-02T09:28:22.271108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:22.281686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.281801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:22.281815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-10-02T09:28:22.281976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.282005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:22.282010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:22.282014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:22.282411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-10-02T09:28:22.282440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:22.282442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:22.282444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:22.282449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553873855818172:3010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:22.282989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553873855818172:3010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:22.285358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.289571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553873855818172:3010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:22.286623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.286818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.286821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:22.286830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.286877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.286906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553873780300180:2834]
2025-10-02T09:28:22.287561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:22.287873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:22.287911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:22.288257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:22.288307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.288308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.288309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.288310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.288312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.288313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.288314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.288315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.288317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.288318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.288319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.288321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.288326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.288338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.288343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.288348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.288352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.288357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.288361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.288365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.288370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.288375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.288379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.288383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.288390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.288398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.288404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.288410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.288414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.288419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.288424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.288429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.288434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.288440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.288445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.288450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.288455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.288460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.288465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.288471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.288475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.288482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.288487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.288492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.288497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.288502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.288506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.288512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.288548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:22.297030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553873855818172:3010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:22.297053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553873855818172:3010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:22.297058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553873855818172:3010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:22.297075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:22.301119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:22.303323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:22.303348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:22.303351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.303354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.303361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [2:7556553873780300180:2834]
2025-10-02T09:28:22.303376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:22.303395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:22.303399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.303401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.303404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.303420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:22.303425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.303432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:22.303516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.303524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.303525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.303529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:22.303532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:22.303790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 87
2025-10-02T09:28:22.303606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:22.303617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.303633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.303645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.303663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:22.303683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818095:2446], now have 1 active actors on pipe
2025-10-02T09:28:22.303687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818237:3010], now have 1 active actors on pipe
2025-10-02T09:28:22.303693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.303848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 87
2025-10-02T09:28:22.303695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.303697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.303707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:22.303720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:22.303735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:22.303737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:22.303750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:22.303755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:22.303757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:22.303773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.303776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:22.303778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:22.303893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.303901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.303943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:22.303955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.303958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.303961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.303970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.303982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:22.303998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.304393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.304407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.304427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.304563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 36 sessionId: src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0
2025-10-02T09:28:22.304957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425e5c03-f7f9b0c7-14da68b3-b033ccbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:22.307889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Write session: try to update token
2025-10-02T09:28:22.307909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:22.322033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:22.322055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.322058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:22.322060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:22.322070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.322075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.322078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553873780300175:2834]
2025-10-02T09:28:22.322120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:22.322130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.322132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:22.322288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:22.323396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:22.323411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:22.323414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:22.325208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:22.328336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:22.369388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553873855818245:2503]
2025-10-02T09:28:22.370133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7556553873855818245:2503]
2025-10-02T09:28:22.475682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:22.476188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.476197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.476234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818245:2503], now have 1 active actors on pipe
2025-10-02T09:28:22.476451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:22.476632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:22.476639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553873855818245:2503]
2025-10-02T09:28:22.476668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:22.476670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:22.476729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: error at write: Disconnected sessionId: src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0
2025-10-02T09:28:22.476950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0 is DEAD
2025-10-02T09:28:22.477521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:22.477549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Write session will restart in 0.007341s
2025-10-02T09:28:22.477579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Write session: Do CDS request
2025-10-02T09:28:22.477585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:22.486373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.486559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:22.486584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-10-02T09:28:22.489166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.489232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:22.489245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:22.489251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:22.489952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-10-02T09:28:22.489995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:22.489998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:22.490005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:22.490010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553873855818257:3014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:22.490574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553873855818257:3014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:22.495369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553873855818257:3014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:22.500035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553873855818257:3014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:22.500054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553873855818257:3014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:22.500058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553873855818257:3014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:22.500065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:22.503676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.504710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.504921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.504932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:22.504943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.505008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.505067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553873780300324:2836]
2025-10-02T09:28:22.505675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:22.506797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:22.506871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:22.507186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:22.507246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.507251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.507252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.507254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.507254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.507256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.507257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.507258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.507259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.507260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.507260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.507262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.507267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.507278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.507283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.507286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.507290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.507294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.507298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.507302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.507306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.507311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.507315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.507319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.507326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.507333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.507343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.507348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.507352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.507358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.507362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.507368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.507374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.507380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.507388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.507393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.507398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.507403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.507411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.507416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.507421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.507428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.507433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.507438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.507445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.507451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.507456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.507462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.507496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:22.524171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 88
2025-10-02T09:28:22.521915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:22.524172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 88
2025-10-02T09:28:22.523749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:22.523756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:22.523759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.523763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.523770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [2:7556553873780300324:2836]
2025-10-02T09:28:22.523785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:22.523805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:22.523809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.523812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.523814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.523830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:22.523835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.523843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:22.523909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.523911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.523913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.523917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:22.523919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:22.523978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:22.523979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.523989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.524001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.524017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:22.524036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.524038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.524041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.524048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:22.524058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:22.524062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:22.524064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:22.524067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818247:2446], now have 1 active actors on pipe
2025-10-02T09:28:22.524073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:22.524087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:22.524090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:22.524096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818323:3014], now have 1 active actors on pipe
2025-10-02T09:28:22.524129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.524140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:22.524183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:22.524436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.524450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.524474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:22.524486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.524490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.524492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.524504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.524519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:22.524536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.524695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.524703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.524716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.524976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0
2025-10-02T09:28:22.525351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6afc0d7-3718e25-835899b5-5ded3b74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:22.528226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Write session: try to update token
2025-10-02T09:28:22.528248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:22.543678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:22.543700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.543704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:22.543705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:22.543713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.543718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.543721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553873780300319:2836]
2025-10-02T09:28:22.543759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:22.543766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.543766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:22.543768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:22.543772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:22.543776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:22.543961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:22.545954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:22.549022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:22.573151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553873855818398:2503]
2025-10-02T09:28:22.573538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7556553873855818398:2503]
2025-10-02T09:28:22.695033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:22.696072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.696081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.696123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818398:2503], now have 1 active actors on pipe
2025-10-02T09:28:22.696389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:22.696411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:22.696411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553873855818398:2503]
2025-10-02T09:28:22.696434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:22.696517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0
2025-10-02T09:28:22.696697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0 is DEAD
2025-10-02T09:28:22.696915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:22.696994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Write session will restart in 0.008038s
2025-10-02T09:28:22.697026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Write session: Do CDS request
2025-10-02T09:28:22.697032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:22.706325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.706444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:22.706462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-10-02T09:28:22.706632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.706662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:22.706671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:22.706676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:22.707078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-10-02T09:28:22.707112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:22.707120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:22.707121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:22.707127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553873855818424:3019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:22.707851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553873855818424:3019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:22.712167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553873855818424:3019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:22.714122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.715493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.715705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.715714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:22.715724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.715773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.715823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553873780300469:2838]
2025-10-02T09:28:22.716492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:22.717183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553873855818424:3019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:22.717201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553873855818424:3019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:22.717205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553873855818424:3019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:22.717213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:22.716849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:22.716892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:22.717210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:22.717256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.717257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.717258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.717259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.717261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.717262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.717263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.717264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.717266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.717267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.717268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.717269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.717274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.717286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.717291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.717296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.717300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.717305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.717310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.717315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.717319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.717324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.717328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.717333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.717340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.717348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.717354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.717360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.717364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.717370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.717375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.717381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.717386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.717392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.717397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.717404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.717409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.717414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.717419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.717425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.717430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.717436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.717441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.717446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.717451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.717457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.717462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.717469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.717510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:22.737853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:22.739892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:22.739913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:22.739916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.739919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.739926Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [2:7556553873780300469:2838]
2025-10-02T09:28:22.739943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:22.739962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:22.739966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.739969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.739971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.739985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:22.739990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.739997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:22.740099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.740100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.740102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.740105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:22.740108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:22.740173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:22.740175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.740188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.740197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.740211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:22.740226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.740228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.740230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.740242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:22.740259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:22.740272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:22.740275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:22.740312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.740315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:22.740352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:22.740373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:22.740376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:22.740383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:22.741498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818404:2446], now have 1 active actors on pipe
2025-10-02T09:28:22.741513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818552:3019], now have 1 active actors on pipe
2025-10-02T09:28:22.741464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 89
2025-10-02T09:28:22.741524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 89
2025-10-02T09:28:22.741669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.741679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.741704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:22.741712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.741716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.741719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.741730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.741742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:22.741755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.742336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.742347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.742365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.742536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0
2025-10-02T09:28:22.742958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d16aad7-9e458788-3c759766-8dc0d6bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:22.746150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Write session: try to update token
2025-10-02T09:28:22.746168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:22.766498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:22.769792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:22.770270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.770295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.770311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:22.770314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.770321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.770365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:22.770370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:22.770614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:22.770770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.770958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.771101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.771384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:22.771565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:22.771431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:22.771459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:22.795375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553873855818564:2503]
2025-10-02T09:28:22.795763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7556553873855818564:2503]
2025-10-02T09:28:22.796031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818564:2503], now have 1 active actors on pipe
2025-10-02T09:28:22.796058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:22.796060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.796063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:22.796065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:22.796073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.796081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.796085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553873780300464:2838]
2025-10-02T09:28:22.796126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:22.796132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.796134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:22.796270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:22.800900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:22.800915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:22.800920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:22.943354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:22.951843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.951868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.952036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.952118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.952192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.952261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.952315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.952323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.952393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.952454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.952515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.952586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.952633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.952639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.952712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.952780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.952871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.952943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.952997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.953003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.953080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.953153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.953228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.953297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.953342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.953349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.953422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.953491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.953556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.953630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.953685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.953692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.953790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.953856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.953925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.954000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.954055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.954061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.954134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.954199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.954274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.954352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.954410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.954418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.954497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.954571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.954643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.954716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.954789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.954794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.954862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.954920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.954982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.955048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.955094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.955103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.955196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:22.955273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:22.955347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:22.955423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:22.955490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:22.955498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:22.955776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:22.955784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:22.955794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:22.955826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553873855818564:2503]
2025-10-02T09:28:22.955831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0
2025-10-02T09:28:22.955957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0 is DEAD
2025-10-02T09:28:22.956095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:22.956106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Write session will restart in 0.008353s
2025-10-02T09:28:22.956129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Write session: Do CDS request
2025-10-02T09:28:22.956135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:22.956257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:22.965253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.965393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:22.965407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-10-02T09:28:22.965532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:22.965566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:22.965571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:22.965575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:22.965995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-10-02T09:28:22.966032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:22.966039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:22.966041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:22.966046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553873855818673:3023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:22.966553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553873855818673:3023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:22.966981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:22.967649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:22.967867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:22.967875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:22.967885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:22.967929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:22.967964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553873780300616:2841]
2025-10-02T09:28:22.968485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:22.968737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:22.968783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:22.968782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553873855818673:3023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:22.969050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:22.969085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.969089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.969089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.969090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.969091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.969092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.969093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.969093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.969094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.969095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.969096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.969097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.969102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.969111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.969114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.969117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.969133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.969137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.969140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.969144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.969147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.969151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.969154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.969158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.969164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.969171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:22.969176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.969179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:22.969181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.969192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:22.969200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.969204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:22.969208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.969213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:22.969221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.969227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:22.969235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.969240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:22.969243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.969246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:22.969248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.969251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:22.969253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.969256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.969259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.969262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.969264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.969267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.969283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:22.974707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553873855818673:3023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:22.974720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553873855818673:3023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:22.974723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553873855818673:3023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:22.974730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:22.978484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:22.980171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:22.980186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:22.980188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:22.980191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:22.980196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [2:7556553873780300616:2841]
2025-10-02T09:28:22.980205Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:22.980218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:22.980220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.980222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.980224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.980238Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:22.980242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:22.980251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:22.980302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.980308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.980309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.980311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:22.980313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:22.980366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:22.980374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:22.980385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:22.980397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:22.980413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:22.980430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818712:3023], now have 1 active actors on pipe
2025-10-02T09:28:22.980439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553873855818570:2446], now have 1 active actors on pipe
2025-10-02T09:28:22.980445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:22.980451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:22.980453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:22.980468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:22.980482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:22.980485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:22.980487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:22.980488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:22.980502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:22.980504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:22.980531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:22.980538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:22.980515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 90
2025-10-02T09:28:22.980527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 90
2025-10-02T09:28:22.980556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:22.980577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.980585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.980605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49d186e7-fb172121-1a99a793-60d8446_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:22.980615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:22.980619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:22.980621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:22.980629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:22.980636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:22.980647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.980769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:22.980777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:22.980789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:22.980878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 36 sessionId: src_id|49d186e7-fb172121-1a99a793-60d8446_0
2025-10-02T09:28:22.981223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea3ca21-4c03c67b-2a13ebae-d928a73f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49d186e7-fb172121-1a99a793-60d8446_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:22.984443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Write session: try to update token
2025-10-02T09:28:22.984457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:22.992903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:22.992918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:22.992925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:22.992951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:22.992955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:22.993115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:22.993251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.993396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.993531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:22.993740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:22.993788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:23.000071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|49d186e7-fb172121-1a99a793-60d8446_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:23.002687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:23.002703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:23.002705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:23.002708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:23.002715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:23.002719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:23.002722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553873780300610:2841]
2025-10-02T09:28:23.002749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:23.002754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.002754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:23.002755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:23.002763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:23.002766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:23.002888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:23.003152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:23.055933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553878150786029:2503]
2025-10-02T09:28:23.056220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7556553878150786029:2503]
2025-10-02T09:28:23.144267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:23.144663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.144680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.144701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786029:2503], now have 1 active actors on pipe
2025-10-02T09:28:23.144939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:23.145616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:23.145629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Write session will restart in 0.006402s
2025-10-02T09:28:23.145655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Write session: Do CDS request
2025-10-02T09:28:23.145663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:23.145048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553878150786029:2503]
2025-10-02T09:28:23.145073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:23.145079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:23.145081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:23.145179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: error at write: Disconnected sessionId: src_id|49d186e7-fb172121-1a99a793-60d8446_0
2025-10-02T09:28:23.145352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|49d186e7-fb172121-1a99a793-60d8446_0 is DEAD
2025-10-02T09:28:23.153424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.153520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:23.153540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-10-02T09:28:23.153691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.153748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:23.153758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:23.153763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:23.154271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-10-02T09:28:23.154308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:23.154318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:23.154320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:23.154327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553878150786081:3035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:23.154851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553878150786081:3035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:23.157582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553878150786081:3035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:23.157926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:23.158800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:23.158973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:23.158982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:23.158992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:23.159056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:23.159096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553878075268094:2856]
2025-10-02T09:28:23.159705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:23.160110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:23.160166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:23.160473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:23.160531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.160537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.160538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.160539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.160540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.160542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.160543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.160544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.160545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.160546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.160547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.160548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.160554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.160565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.160568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.160573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.160576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.160579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.160584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.160587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.160590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.160596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.160600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.160603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.160609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.160616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.160622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.160627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.160632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.160637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.160641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.160646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.160650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.160654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.160658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.160664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.160669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.160685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.160694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.160698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.160703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.160707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.160711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.160715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.160719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.160723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.160727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.160732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.160767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:23.161755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553878150786081:3035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:23.161770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553878150786081:3035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:23.161774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553878150786081:3035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:23.161783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:23.170955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:23.172794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:23.172829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:23.172832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:23.172835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:23.172842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [2:7556553878075268094:2856]
2025-10-02T09:28:23.172857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:23.172877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:23.172879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.172882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.172884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.172901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:23.172907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:23.172913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:23.172980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.172992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.172994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.172997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:23.172999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:23.173072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:23.173086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.173100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.173111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.173128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:23.173149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.173156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.173158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.173171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:23.173190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:23.173209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:23.173216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:23.173253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.173262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:23.173289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786187:3035], now have 1 active actors on pipe
2025-10-02T09:28:23.173298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786042:2446], now have 1 active actors on pipe
2025-10-02T09:28:23.173339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:23.173348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:23.173352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:23.173357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:23.173407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 91
2025-10-02T09:28:23.173448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 91
2025-10-02T09:28:23.173489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.173503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.173527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73d2f945-742911d0-fc02267c-fde63474_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:23.173538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.173541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.173543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:23.173550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.173562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:23.173577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.173738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.173768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.173791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.173897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 36 sessionId: src_id|73d2f945-742911d0-fc02267c-fde63474_0
2025-10-02T09:28:23.174282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d186e7-fb172121-1a99a793-60d8446_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73d2f945-742911d0-fc02267c-fde63474_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:23.177431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Write session: try to update token
2025-10-02T09:28:23.177453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:23.186105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:23.186122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:23.186130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.186169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:23.186175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:23.186353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:23.186514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:23.186670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:23.186822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:23.187042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:23.187078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:23.195473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|73d2f945-742911d0-fc02267c-fde63474_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:23.197334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:23.197355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:23.197358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:23.197360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:23.197371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.197375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.197379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553878075268089:2856]
2025-10-02T09:28:23.197418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:23.197424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.197423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:23.197427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:23.197430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:23.197434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:23.197572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:23.198319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:23.245397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553878150786195:2503]
2025-10-02T09:28:23.245823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7556553878150786195:2503]
2025-10-02T09:28:23.350402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:23.351022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.351034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.351054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786195:2503], now have 1 active actors on pipe
2025-10-02T09:28:23.351347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:23.351453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553878150786195:2503]
2025-10-02T09:28:23.351488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:23.351490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:23.351547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: error at write: Disconnected sessionId: src_id|73d2f945-742911d0-fc02267c-fde63474_0
2025-10-02T09:28:23.351729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|73d2f945-742911d0-fc02267c-fde63474_0 is DEAD
2025-10-02T09:28:23.351820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:23.353043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:23.353054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Write session will restart in 0.006400s
2025-10-02T09:28:23.353080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Write session: Do CDS request
2025-10-02T09:28:23.353086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:23.361849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.362125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:23.362141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-10-02T09:28:23.362424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.362454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:23.362459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:23.362464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:23.362851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-10-02T09:28:23.362881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:23.362883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:23.362884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:23.362890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553878150786233:3040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:23.363489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553878150786233:3040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:23.369907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553878150786233:3040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:23.373571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553878150786233:3040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:23.373587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553878150786233:3040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:23.373590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553878150786233:3040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:23.373598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:23.374907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:23.375930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:23.376107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:23.376122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:23.376131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:23.376180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:23.376237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553878075268253:2859]
2025-10-02T09:28:23.376889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:23.377201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:23.377252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:23.377551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:23.377591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.377592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.377594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.377595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.377596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.377597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.377598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.377599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.377600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.377602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.377603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.377604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.377608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.377619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.377623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.377627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.377631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.377635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.377639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.377644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.377648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.377652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.377656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.377659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.377667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.377674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.377681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.377685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.377689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.377694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.377698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.377703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.377709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.377714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.377720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.377725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.377730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.377735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.377740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.377745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.377749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.377754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.377758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.377764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.377768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.377773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.377778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.377782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.377818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:23.388542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:23.390961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:23.390984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:23.390987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:23.390992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:23.390999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [2:7556553878075268253:2859]
2025-10-02T09:28:23.391016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:23.391039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:23.391042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.391045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.391047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.391063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:23.391080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:23.391088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:23.391176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.391188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.391190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.391193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:23.391195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:23.391272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:23.391280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.391296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.391307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.391324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:23.391349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.391358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.391360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.391374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:23.391395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786210:2446], now have 1 active actors on pipe
2025-10-02T09:28:23.391406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786349:3040], now have 1 active actors on pipe
2025-10-02T09:28:23.391414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:23.391423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:23.391427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:23.391429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:23.391433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:23.391437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:23.391477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.391491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:23.391516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:23.391941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 92
2025-10-02T09:28:23.391985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 92
2025-10-02T09:28:23.392276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.392291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.392321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:23.392329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.392333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.392336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:23.392346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.392358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:23.392375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.392831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.392846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.392867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.393031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 36 sessionId: src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0
2025-10-02T09:28:23.396949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d2f945-742911d0-fc02267c-fde63474_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:23.400635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Write session: try to update token
2025-10-02T09:28:23.400658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:23.409458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:23.409480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:23.409484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:23.409486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:23.409496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.409501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.409505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553878075268248:2859]
2025-10-02T09:28:23.409551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:23.409559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.409561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:23.410389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:23.412322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:23.412337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:23.412341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:23.432373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:23.435085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:23.452883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553878150786363:2503]
2025-10-02T09:28:23.453365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7556553878150786363:2503]
2025-10-02T09:28:23.586823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:23.587273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.587289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.587306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786363:2503], now have 1 active actors on pipe
2025-10-02T09:28:23.587819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:23.588114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:23.588126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Write session will restart in 0.008097s
2025-10-02T09:28:23.587702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:23.587714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:23.587784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: error at write: Disconnected sessionId: src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0
2025-10-02T09:28:23.587940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0 is DEAD
2025-10-02T09:28:23.588029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:23.588158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Write session: Do CDS request
2025-10-02T09:28:23.588067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553878150786363:2503]
2025-10-02T09:28:23.588165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:23.601170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.601348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:23.601365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-10-02T09:28:23.601532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.601576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:23.601585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:23.601591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:23.602101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-10-02T09:28:23.602137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:23.602138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:23.602140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:23.602145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553878150786381:3044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:23.602955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553878150786381:3044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:23.609204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553878150786381:3044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:23.615320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553878150786381:3044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:23.615337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553878150786381:3044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:23.615341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553878150786381:3044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:23.615350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:23.625580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:23.629697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:23.629941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:23.629953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:23.629964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:23.630034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:23.630094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553878075268400:2861]
2025-10-02T09:28:23.630701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:23.631076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:23.631133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:23.631485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:23.631568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.631577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.631578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.631579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.631580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.631582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.631584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.631585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.631586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.631587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.631588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.631589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.631595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.631606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.631610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.631613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.631616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.631619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.631623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.631627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.631631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.631635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.631638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.631641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.631648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.631655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.631661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.631667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.631671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.631676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.631680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.631686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.631691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.631696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.631701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.631706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.631710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.631716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.631729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.631734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.631738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.631743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.631747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.631752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.631757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.631762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.631766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.631771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.631803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:23.654563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:23.656348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:23.656368Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:23.656371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:23.656376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:23.656383Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [2:7556553878075268400:2861]
2025-10-02T09:28:23.656400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:23.656418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:23.656421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.656424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.656427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.656443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:23.656449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:23.656457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:23.656535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.656547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.656550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.656554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:23.656556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:23.656655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:23.656663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.656678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.656690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.656705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:23.656727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.656730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.656740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.656758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:23.656779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786463:3044], now have 1 active actors on pipe
2025-10-02T09:28:23.656787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786366:2446], now have 1 active actors on pipe
2025-10-02T09:28:23.656797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:23.656918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 93
2025-10-02T09:28:23.656953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 93
2025-10-02T09:28:23.656969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:23.656979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:23.656982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:23.657022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:23.657027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:23.657088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.657103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.657118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.657129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:23.657173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:23.657184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.657189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.657194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:23.657204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.657218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:23.657249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.657608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:23.658985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.659004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.659028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.659754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef8371a-efc1d3a-1a48eaa6-3d138c4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:23.659223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0
2025-10-02T09:28:23.663079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Write session: try to update token
2025-10-02T09:28:23.663096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:23.688199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553878150786519:2503]
2025-10-02T09:28:23.689094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7556553878150786519:2503]
2025-10-02T09:28:23.690553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786519:2503], now have 1 active actors on pipe
2025-10-02T09:28:23.691986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:23.691990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:23.691993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:23.691995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:23.692003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.692007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.692011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553878075268394:2861]
2025-10-02T09:28:23.692049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:23.692049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:23.692054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:23.692054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.692057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:23.692058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:23.692218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:23.699542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:23.702821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:23.856038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:23.856605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.856619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.858328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:23.858340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Write session will restart in 0.009427s
2025-10-02T09:28:23.858361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Write session: Do CDS request
2025-10-02T09:28:23.857957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:23.858368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:23.857963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:23.857969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:23.858021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553878150786519:2503]
2025-10-02T09:28:23.858029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: error at write: Disconnected sessionId: src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0
2025-10-02T09:28:23.858204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0 is DEAD
2025-10-02T09:28:23.858934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:23.869554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:23.869569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-10-02T09:28:23.869718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.870040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:23.870077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:23.870082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:23.870087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:23.870713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-10-02T09:28:23.870747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:23.870752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:23.870756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:23.870760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553878150786640:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:23.871299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553878150786640:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:23.873332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:23.874519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:23.874689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:23.874699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:23.874710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:23.874761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:23.874799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553878075268549:2864]
2025-10-02T09:28:23.875365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:23.874838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553878150786640:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:23.875864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:23.875920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:23.876239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:23.876309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.876310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.876311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.876312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.876313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.876314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.876315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.876317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.876318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.876319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.876320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.876321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.876326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.876345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.876349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.876353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.876357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.876361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.876365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.876369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.876373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.876378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.876382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.876386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.876392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.876399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:23.876405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.876410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:23.876414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.876418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:23.876423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.876427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:23.876432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.876436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:23.876440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.876444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:23.876448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.876453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:23.876457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.876462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:23.876466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.876470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:23.876474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.876479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.876484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.876488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.876492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.876496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.876530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:23.880650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553878150786640:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:23.880667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553878150786640:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:23.880670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553878150786640:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:23.880679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:23.889352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:23.891457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:23.891476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:23.891479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:23.891483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:23.891490Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [2:7556553878075268549:2864]
2025-10-02T09:28:23.891509Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:23.891529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:23.891533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.891536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.891538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.891555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:23.891560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:23.891567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:23.891943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 94
2025-10-02T09:28:23.891976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 94
2025-10-02T09:28:23.892570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 36 sessionId: src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0
2025-10-02T09:28:23.892979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f141584-e10639fe-6ee490c-7e4f1f10_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:23.891656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.891663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.891666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.891669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:23.891672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:23.891731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:23.891732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.891742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:23.891748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:23.891758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:23.891772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.891773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.891775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.891781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:23.891793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:23.891794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:23.891798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:23.891800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:23.891803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:23.891805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:23.891838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786680:3049], now have 1 active actors on pipe
2025-10-02T09:28:23.891841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786532:2446], now have 1 active actors on pipe
2025-10-02T09:28:23.891842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.891848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:23.891855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:23.892135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.892139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.892160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:23.892164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:23.892167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:23.892169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:23.892176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:23.892185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:23.892204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.892403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:23.892411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:23.892435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:23.896015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Write session: try to update token
2025-10-02T09:28:23.896039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:23.906545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:23.906561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:23.906563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:23.906564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:23.906571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.906574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.906577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553878075268543:2864]
2025-10-02T09:28:23.906606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:23.906610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:23.906611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:23.906623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:23.906628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:23.906634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:23.906752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:23.923829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:23.927127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:23.958076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553878150786688:2503]
2025-10-02T09:28:23.958326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7556553878150786688:2503]
2025-10-02T09:28:24.055138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:24.055637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.055655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.055673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553878150786688:2503], now have 1 active actors on pipe
2025-10-02T09:28:24.055957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:24.056084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:24.056087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:24.056110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:24.056161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553878150786688:2503]
2025-10-02T09:28:24.056201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: error at write: Disconnected sessionId: src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0
2025-10-02T09:28:24.056378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0 is DEAD
2025-10-02T09:28:24.056707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:24.056718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Write session will restart in 0.005713s
2025-10-02T09:28:24.056759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Write session: Do CDS request
2025-10-02T09:28:24.056767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:24.063461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.063672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:24.063688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-10-02T09:28:24.063863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.063902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:24.063906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:24.063910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:24.064380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-10-02T09:28:24.064419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:24.064420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:24.064422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:24.064428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553882445754002:3053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:24.065669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553882445754002:3053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:24.068856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:24.069738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:24.069936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:24.069944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:24.069956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:24.070015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:24.070067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553882370236010:2866]
2025-10-02T09:28:24.070809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:24.071089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:24.071132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:24.071128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553882445754002:3053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:24.071463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:24.071523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.071531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.071532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.071533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.071534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.071535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.071536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.071538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.071538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.071540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.071541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.071542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.071547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.071557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.071561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.071564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.071568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.071572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.071576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.071579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.071583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.071587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.071590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.071594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.071599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.071606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.071612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.071617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.071621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.071625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.071628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.071633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.071638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.071642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.071646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.071651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.071655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.071659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.071664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.071668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.071673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.071678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.071688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.071692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.071697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.071701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.071705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.071711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.071742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:24.078456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553882445754002:3053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:24.078475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553882445754002:3053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:24.078478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553882445754002:3053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:24.078489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:24.084731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:24.086546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:24.086564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:24.086567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:24.086572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:24.086579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [2:7556553882370236010:2866]
2025-10-02T09:28:24.086592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:24.086609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:24.086612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.086615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.086617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.086632Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:24.086639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:24.086649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:24.086713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.086719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.086721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.086724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:24.086726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:24.086795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:24.086804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.086817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.086826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.086841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:24.086861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754149:3053], now have 1 active actors on pipe
2025-10-02T09:28:24.086864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445753987:2446], now have 1 active actors on pipe
2025-10-02T09:28:24.086870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.086872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.086874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.086890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:24.086904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:24.086918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:24.086920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:24.086952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.086955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:24.087001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:24.087010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:24.087012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:24.087018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:24.087180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 95
2025-10-02T09:28:24.087211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 95
2025-10-02T09:28:24.087314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.087323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.087348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:24.087357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.087361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.087364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:24.087372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.087382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:24.087395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.087613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.087625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.087644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.087729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0
2025-10-02T09:28:24.088163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e906bfb9-d01d6db4-e86795dc-3607792c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:24.094343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Write session: try to update token
2025-10-02T09:28:24.094370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:24.098084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:24.098099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.098107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.098146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:24.098146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:24.098331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:24.098475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:24.098613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:24.098764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:24.098970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:24.099009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:24.111952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:24.111969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.111971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:24.111972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:24.111980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.111983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.111986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553882370236003:2866]
2025-10-02T09:28:24.112009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:24.112014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:24.112014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:24.112017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:24.112020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.112022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:24.112167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:24.115614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:24.129343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:24.156221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553882445754168:2503]
2025-10-02T09:28:24.156502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7556553882445754168:2503]
2025-10-02T09:28:24.271238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:24.271532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.271547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.271565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754168:2503], now have 1 active actors on pipe
2025-10-02T09:28:24.271815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:24.271915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:24.272165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:24.272210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553882445754168:2503]
2025-10-02T09:28:24.272280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0
2025-10-02T09:28:24.272454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0 is DEAD
2025-10-02T09:28:24.272619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:24.272631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Write session will restart in 0.005635s
2025-10-02T09:28:24.272666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Write session: Do CDS request
2025-10-02T09:28:24.272673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:24.279477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.279791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:24.279815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-10-02T09:28:24.280032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.280065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:24.280071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:24.280076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:24.280624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-10-02T09:28:24.280666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:24.280668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:24.280670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:24.280678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553882445754204:3066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:24.281272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553882445754204:3066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:24.283988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553882445754204:3066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:24.287901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553882445754204:3066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:24.287914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553882445754204:3066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:24.287918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553882445754204:3066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:24.287927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:24.289300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:24.290498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:24.290685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:24.290697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:24.290707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:24.290758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:24.290800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553882370236198:2882]
2025-10-02T09:28:24.291388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:24.291834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:24.291914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:24.292362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:24.292438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.292445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.292446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.292447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.292448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.292449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.292450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.292451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.292452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.292453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.292454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.292454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.292460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.292467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.292470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.292473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.292475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.292478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.292480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.292483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.292485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.292487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.292490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.292492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.292499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.292504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.292509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.292513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.292516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.292520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.292522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.292526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.292529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.292533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.292536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.292540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.292543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.292546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.292549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.292560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.292564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.292568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.292570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.292574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.292577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.292580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.292583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.292587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.292607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:24.305354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:24.307384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:24.307405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:24.307409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:24.307413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:24.307421Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [2:7556553882370236198:2882]
2025-10-02T09:28:24.307441Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:24.307459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:24.307463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.307466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.307469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.307485Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:24.307491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:24.307497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:24.307565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.307576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.307579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.307583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:24.307586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:24.307663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:24.307677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.307693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.307705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.307724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:24.307743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754183:2446], now have 1 active actors on pipe
2025-10-02T09:28:24.307748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754326:3066], now have 1 active actors on pipe
2025-10-02T09:28:24.307753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.307756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.307758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.307774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:24.307787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:24.307803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:24.307812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:24.307852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.307861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:24.307914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:24.307866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 96
2025-10-02T09:28:24.307934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 96
2025-10-02T09:28:24.307926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:24.307929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:24.307936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:24.308120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.308135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.308170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:24.308186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.308196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.308199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:24.308224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.308244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:24.308268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.308480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.308489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.308506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.308634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0
2025-10-02T09:28:24.309032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6dfd5af-fc7e24a2-e0025f7-b1e38676_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:24.312375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Write session: try to update token
2025-10-02T09:28:24.312398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:24.320413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:24.320431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.320433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:24.320435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:24.320443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.320447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.320451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553882370236193:2882]
2025-10-02T09:28:24.320488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:24.320494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.320496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:24.320500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:24.320508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:24.320513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:24.320642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:24.330071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:24.333206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:24.372296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553882445754342:2503]
2025-10-02T09:28:24.372989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7556553882445754342:2503]
2025-10-02T09:28:24.467051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:24.467704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.467719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.467739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754342:2503], now have 1 active actors on pipe
2025-10-02T09:28:24.468018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:24.468156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553882445754342:2503]
2025-10-02T09:28:24.468181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:24.468216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:24.468223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:24.468285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0
2025-10-02T09:28:24.468462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0 is DEAD
2025-10-02T09:28:24.468747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:24.468762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Write session will restart in 0.005695s
2025-10-02T09:28:24.468797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Write session: Do CDS request
2025-10-02T09:28:24.468835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:24.477268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.478270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:24.478285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-10-02T09:28:24.478717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.478752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:24.478758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:24.478763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:24.479586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-10-02T09:28:24.479628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:24.479633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:24.479637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:24.479643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553882445754359:3070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:24.480285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553882445754359:3070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:24.487934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553882445754359:3070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:24.492015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553882445754359:3070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:24.492041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553882445754359:3070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:24.492045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553882445754359:3070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:24.492055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:24.495120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:24.496463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:24.496684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:24.496694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:24.496705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:24.496756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:24.496795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553882370236350:2884]
2025-10-02T09:28:24.497553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:24.497947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:24.498000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:24.498374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:24.498441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.498442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.498444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.498445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.498447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.498448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.498449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.498451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.498453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.498454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.498455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.498457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.498463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.498476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.498481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.498485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.498490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.498494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.498499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.498503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.498508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.498514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.498518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.498522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.498530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.498539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.498546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.498552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.498557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.498563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.498569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.498575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.498580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.498587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.498592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.498599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.498605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.498611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.498616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.498622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.498627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.498633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.498638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.498643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.498649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.498655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.498660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.498666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.498713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:24.508851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:24.510776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:24.510808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:24.510811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:24.510815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:24.510823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [2:7556553882370236350:2884]
2025-10-02T09:28:24.510839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:24.510860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:24.510864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.510867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.510870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.510887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:24.510892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:24.510899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:24.510972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.510985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.510987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.510990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:24.510993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:24.511068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:24.511078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.511095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.511112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.511134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:24.511174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.511177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.511180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.511192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:24.511208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754489:3070], now have 1 active actors on pipe
2025-10-02T09:28:24.511212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754344:2446], now have 1 active actors on pipe
2025-10-02T09:28:24.511221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:24.511236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:24.511239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:24.511278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.511281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:24.511338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:24.511342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:24.511344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:24.511351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:24.511531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 97
2025-10-02T09:28:24.511596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 97
2025-10-02T09:28:24.515952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.515973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.516010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd5af623-f994e742-76cee761-4379b501_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:24.516021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.516026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.516029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:24.516041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.516057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:24.516078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.516909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd5af623-f994e742-76cee761-4379b501_0
2025-10-02T09:28:24.516707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.516728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.516758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.517457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2dfb9e-1c3663ab-278e2320-e49d2d47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd5af623-f994e742-76cee761-4379b501_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:24.520514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Write session: try to update token
2025-10-02T09:28:24.520533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:24.524749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:24.524771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.524775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:24.524777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:24.524788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.524793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.524797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553882370236345:2884]
2025-10-02T09:28:24.524888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:24.524896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.524899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:24.524897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:24.524909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:24.524913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:24.525057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:24.545163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|fd5af623-f994e742-76cee761-4379b501_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:24.548082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:24.565574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553882445754504:2503]
2025-10-02T09:28:24.566056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7556553882445754504:2503]
2025-10-02T09:28:24.684867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:24.685266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.685279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.685296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754504:2503], now have 1 active actors on pipe
2025-10-02T09:28:24.685682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:24.686525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:24.686539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Write session will restart in 0.007441s
2025-10-02T09:28:24.686564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Write session: Do CDS request
2025-10-02T09:28:24.686571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:24.685981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:24.686074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd5af623-f994e742-76cee761-4379b501_0
2025-10-02T09:28:24.686252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|fd5af623-f994e742-76cee761-4379b501_0 is DEAD
2025-10-02T09:28:24.686406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:24.686451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553882445754504:2503]
2025-10-02T09:28:24.695393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.697968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:24.697987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-10-02T09:28:24.698131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.698175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:24.698186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:24.698190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:24.698630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-10-02T09:28:24.698675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:24.698679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:24.698681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:24.698686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553882445754622:3074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:24.699254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553882445754622:3074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:24.699873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:24.700617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:24.700778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:24.700786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:24.700795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:24.700853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:24.700888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553882370236503:2886]
2025-10-02T09:28:24.701403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553882445754622:3074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:24.701444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:24.701731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:24.701778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:24.702117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:24.702172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.702178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.702179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.702180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.702181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.702182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.702183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.702184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.702185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.702186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.702187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.702188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.702193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.702203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.702207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.702211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.702215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.702219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.702222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.702226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.702230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.702234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.702241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.702245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.702254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.702261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.702278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.702286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.702290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.702295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.702299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.702305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.702308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.702315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.702318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.702323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.702327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.702332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.702337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.702341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.702346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.702350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.702354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.702359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.702364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.702373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.702377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.702382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.702416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:24.706951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553882445754622:3074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:24.706968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553882445754622:3074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:24.706972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553882445754622:3074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:24.706978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:24.711016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:24.713043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:24.713059Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:24.713062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:24.713065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:24.713072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [2:7556553882370236503:2886]
2025-10-02T09:28:24.713086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:24.713102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:24.713110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.713113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.713115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.713130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:24.713136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:24.713143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:24.713204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.713211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.713213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.713216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:24.713218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:24.713285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:24.713294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.713306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.713316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.713329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:24.713345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.713347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.713349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.713356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:24.713366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:24.713368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754663:3074], now have 1 active actors on pipe
2025-10-02T09:28:24.713369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:24.713372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754507:2446], now have 1 active actors on pipe
2025-10-02T09:28:24.713372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:24.713381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:24.713395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:24.713398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:24.713427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.713439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:24.713445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:24.713459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 98
2025-10-02T09:28:24.713510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 98
2025-10-02T09:28:24.713570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.713581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.713602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:24.713608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.713612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.713614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:24.713622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.713631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:24.713644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.713869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.713878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.713892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.714005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0
2025-10-02T09:28:24.714447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5af623-f994e742-76cee761-4379b501_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:24.717713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Write session: try to update token
2025-10-02T09:28:24.717731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:24.724829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:24.724847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.724850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:24.724853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:24.724862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.724868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.724874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553882370236497:2886]
2025-10-02T09:28:24.724923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:24.724937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.724947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:24.725151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:24.725162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:24.725165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:24.725189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:24.734305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:24.737081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:24.786506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553882445754674:2503]
2025-10-02T09:28:24.786799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7556553882445754674:2503]
2025-10-02T09:28:24.866336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:24.866756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.866768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.866782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754674:2503], now have 1 active actors on pipe
2025-10-02T09:28:24.866961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:24.867042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:24.867057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:24.867062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553882445754674:2503]
2025-10-02T09:28:24.867082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:24.867117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: error at write: Disconnected sessionId: src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0
2025-10-02T09:28:24.867389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0 is DEAD
2025-10-02T09:28:24.867521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:24.867532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Write session will restart in 0.007370s
2025-10-02T09:28:24.867557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Write session: Do CDS request
2025-10-02T09:28:24.867564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:24.876313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.876422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:24.876440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-10-02T09:28:24.876568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:24.876601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:24.876612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:24.876619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:24.877108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-10-02T09:28:24.877144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:24.877146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:24.877147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:24.877153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553882445754789:3079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:24.877749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553882445754789:3079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:24.878511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:24.879263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:24.879463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:24.879474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:24.879486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:24.879548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:24.879586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553882370236659:2889]
2025-10-02T09:28:24.880155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:24.880304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553882445754789:3079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:24.880444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:24.880499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:24.880843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:24.880902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.880908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.880910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.880911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.880912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.880913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.880914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.880915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.880916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.880917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.880918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.880919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.880925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.880936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.880940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.880944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.880948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.880952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.880956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.880959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.880963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.880967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.880971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.880975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.880981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.880989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:24.880999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.881005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:24.881015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.881020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:24.881028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.881034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:24.881042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.881047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:24.881052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.881061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:24.881066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.881075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:24.881079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.881086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:24.881090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.881099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:24.881103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.881108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.881113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.881122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.881126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.881131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.881168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:24.886892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553882445754789:3079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:24.886908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553882445754789:3079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:24.886912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553882445754789:3079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:24.886920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:24.890448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:24.892201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:24.892215Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:24.892218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:24.892222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:24.892229Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [2:7556553882370236659:2889]
2025-10-02T09:28:24.892242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:24.892257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:24.892264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.892267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.892269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.892283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:24.892291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:24.892297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:24.892360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.892367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.892369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.892372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:24.892374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:24.892421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:24.892426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.892434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:24.892440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:24.892449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:24.892461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.892466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.892468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.892474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:24.892485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:24.892486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754676:2446], now have 1 active actors on pipe
2025-10-02T09:28:24.892492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754830:3079], now have 1 active actors on pipe
2025-10-02T09:28:24.892494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:24.892496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:24.892497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:24.892509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:24.892512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:24.892538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.892548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:24.892555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:24.892615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.892564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 99
2025-10-02T09:28:24.892621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.892568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 99
2025-10-02T09:28:24.892640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:24.892644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:24.892647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:24.892648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:24.892656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:24.892663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:24.892673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.892907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:24.892920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:24.893116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0
2025-10-02T09:28:24.893493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5351d3-db85319b-19f9a6b3-ba4b7eb4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:24.896794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Write session: try to update token
2025-10-02T09:28:24.892942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:24.896834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:24.908476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:24.908491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.908498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.908543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:24.908543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:24.908768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:24.908940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:24.909100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:24.909257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:24.909493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:24.909535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:24.913016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:24.913029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:24.913031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:24.913034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:24.913041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.913045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.913049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553882370236653:2889]
2025-10-02T09:28:24.913086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:24.913092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:24.913091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:24.913094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:24.913096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:24.913103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:24.913236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:24.913528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:24.917254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:24.967232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553882445754838:2503]
2025-10-02T09:28:24.967545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7556553882445754838:2503]
2025-10-02T09:28:25.052708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:25.053227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.053239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.053255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553882445754838:2503], now have 1 active actors on pipe
2025-10-02T09:28:25.053529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553882445754838:2503]
2025-10-02T09:28:25.053563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:25.053445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:25.053661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:25.053804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0
2025-10-02T09:28:25.053997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0 is DEAD
2025-10-02T09:28:25.054430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:25.054442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Write session will restart in 0.005258s
2025-10-02T09:28:25.054471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Write session: Do CDS request
2025-10-02T09:28:25.054478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:25.061334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.061553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:25.061578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-10-02T09:28:25.061769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.061819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:25.061828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:25.061839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:25.062411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-10-02T09:28:25.062458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:25.062465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:25.062467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:25.062474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553886740722170:3083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:25.063094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553886740722170:3083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:25.065536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553886740722170:3083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:25.065620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:25.066365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:25.066538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:25.066546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:25.066555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:25.066599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:25.066642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553886665204113:2891]
2025-10-02T09:28:25.067209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:25.067537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:25.067579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:25.067875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:25.067924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.067929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.067930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.067931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.067932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.067933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.067934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.067935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.067936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.067937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.067938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.067939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.067944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.067953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.067957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.067960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.067963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.067965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.067968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.067971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.067975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.067979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.067982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.067986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.067992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.068000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.068005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.068010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.068013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.068017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.068020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.068025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.068029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.068035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.068039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.068044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.068048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.068052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.068056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.068060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.068065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.068069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.068073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.068078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.068082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.068086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.068096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.068100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.068133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:25.068360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553886740722170:3083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:25.068375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553886740722170:3083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:25.068379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553886740722170:3083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:25.068386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:25.079260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:25.081120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:25.081137Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:25.081140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:25.081144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:25.081149Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [2:7556553886665204113:2891]
2025-10-02T09:28:25.081164Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:25.081183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:25.081186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.081188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.081190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.081204Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:25.081213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:25.081219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:25.081288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.081295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.081297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.081300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:25.081302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:25.081368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:25.081375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.081386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.081393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.081411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:25.081429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.081434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.081436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.081442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:25.081452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722292:3083], now have 1 active actors on pipe
2025-10-02T09:28:25.081460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722137:2446], now have 1 active actors on pipe
2025-10-02T09:28:25.081459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:25.081465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:25.081464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:25.081467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:25.081472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:25.081474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:25.081500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.081514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:25.081534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:25.081554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 100
2025-10-02T09:28:25.081554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 100
2025-10-02T09:28:25.081729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.081736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.081754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|100396a0-7788b5e7-ab605920-59b1c946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:25.081760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.081762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.081763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:25.081769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.081775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:25.081787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.082033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.082048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.082075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.082168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 36 sessionId: src_id|100396a0-7788b5e7-ab605920-59b1c946_0
2025-10-02T09:28:25.082539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33c15e-b61a5264-2b68989f-9f67f4b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|100396a0-7788b5e7-ab605920-59b1c946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:25.085566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Write session: try to update token
2025-10-02T09:28:25.085589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:25.093602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:25.093616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:25.093619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:25.093621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:25.093630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.093634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.093638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553886665204108:2891]
2025-10-02T09:28:25.093673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:25.093678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.093680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:25.093688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:25.093695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:25.093698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:25.093802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:25.101584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|100396a0-7788b5e7-ab605920-59b1c946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:25.104369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:25.153593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 18 EndOffset 25 InitDone 1 WaitForData 0, pipe: [1:7556553886740722314:2503]
2025-10-02T09:28:25.153912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7556553886740722314:2503]
2025-10-02T09:28:25.239612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:25.240168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.240182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.240199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722314:2503], now have 1 active actors on pipe
2025-10-02T09:28:25.240946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:25.240959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553886740722314:2503]
2025-10-02T09:28:25.241000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:25.241003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:25.241005Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:28:25.241081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: error at write: Disconnected sessionId: src_id|100396a0-7788b5e7-ab605920-59b1c946_0
2025-10-02T09:28:25.241150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|100396a0-7788b5e7-ab605920-59b1c946_0 is DEAD
2025-10-02T09:28:25.241175Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_15989671363531563255_v1 is DEAD
2025-10-02T09:28:25.241312Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331242:2498] disconnected; active server actors: 1
2025-10-02T09:28:25.241320Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553805136331242:2498] client user disconnected session shared/user_1_1_15989671363531563255_v1
2025-10-02T09:28:25.241516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:25.247906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:25.247923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Write session will restart in 0.006159s
2025-10-02T09:28:25.247952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Write session: Do CDS request
2025-10-02T09:28:25.247960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:25.248940Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:28:25.249123Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 15770637, ReadSizeServerDelta = -15246349
2025-10-02T09:28:25.249129Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:25.249152Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008924s
2025-10-02T09:28:25.255380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.257228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:25.257243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-10-02T09:28:25.259315Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:28:25.261169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.261190Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:25.261193Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-02T09:28:25.261335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:25.261343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:25.261348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:25.262715Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_2_5089259274686375459_v1
2025-10-02T09:28:25.261499Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:25.261551Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:25.261647Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 auth for : user
2025-10-02T09:28:25.261975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-10-02T09:28:25.262004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:25.262005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:25.262007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:25.262014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553886740722397:3095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:25.262201Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 Handle describe topics response
2025-10-02T09:28:25.262223Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 auth is DEAD
2025-10-02T09:28:25.262238Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:25.262545Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:25.262571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553886740722397:3095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:25.262892Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553886740722400:3096] connected; active server actors: 1
2025-10-02T09:28:25.262917Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556553886740722400:3096] session shared/user_1_2_5089259274686375459_v1
2025-10-02T09:28:25.262929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:28:25.262939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:28:25.262947Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_5089259274686375459_v1" (Sender=[1:7556553886740722385:3096], Pipe=[1:7556553886740722400:3096], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:25.262951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:25.262963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:28:25.262973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_5089259274686375459_v1" (Sender=[1:7556553886740722385:3096], Pipe=[1:7556553886740722400:3096], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:25.262984Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_5089259274686375459_v1" sender [1:7556553886740722385:3096] lock partition 0 for ReadingSession "shared/user_1_2_5089259274686375459_v1" (Sender=[1:7556553886740722385:3096], Pipe=[1:7556553886740722400:3096], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-02T09:28:25.263003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:28:25.263007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-02T09:28:25.263346Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_5089259274686375459_v1" ClientId: "user" PipeClient { RawX1: 7556553886740722400 RawX2: 4503603922340888 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:25.263371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:28:25.267153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553886740722397:3095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:25.269198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:25.270381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:25.270677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:25.270688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:25.270699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:25.270752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:25.270797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553886665204318:2906]
2025-10-02T09:28:25.271530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:25.271887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:25.271933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:25.272269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:25.272321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.272322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.272324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.272325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.272326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.272328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.272329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.272330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.272331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.272333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.272334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.272335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.272341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.272352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.272357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.272361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.272366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.272370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.272374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.272378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.272382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.272387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.272391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.272395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.272402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.272410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.272416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.272422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.272427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.272432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.272437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.272444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.272449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.272454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.272458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.272464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.272469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.272476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.272480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.272486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.272491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.272497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.272502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.272507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.272512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.272518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.272523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.272528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.272569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:25.279488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553886740722397:3095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:25.279505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553886740722397:3095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:25.279510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553886740722397:3095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:25.279520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:25.285313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:25.287359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:25.287376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:25.287379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:25.287384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:25.287391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [2:7556553886665204318:2906]
2025-10-02T09:28:25.287408Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:25.287430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:25.287437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.287441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.287443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.287464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:25.287474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:25.287480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:25.287821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 101
2025-10-02T09:28:25.287874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 101
2025-10-02T09:28:25.287902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7556553886740722414:3101]
2025-10-02T09:28:25.287559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.287570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.287572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.287576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:25.287578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:25.287660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:25.287663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.287679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.287689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.287704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:25.287727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722326:2446], now have 1 active actors on pipe
2025-10-02T09:28:25.287731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722500:3095], now have 1 active actors on pipe
2025-10-02T09:28:25.287733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722414:3101], now have 1 active actors on pipe
2025-10-02T09:28:25.287742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.287744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.287746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.287754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:25.287765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:25.287768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:25.287768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:25.287770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:25.287782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:25.287786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:25.287827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.287830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:25.287855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:25.288039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.288050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.288066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.288068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.288075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_5089259274686375459_v1 on pipe: [1:7556553886740722414:3101]
2025-10-02T09:28:25.288204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:25.288225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.288230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.288233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:25.288246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.288265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:25.288289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.288299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.288302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:25.288320Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_5089259274686375459_v1
2025-10-02T09:28:25.288328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.288368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.288398Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:25.288585Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_5089259274686375459_v1:1 with generation 101
2025-10-02T09:28:25.288902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0
2025-10-02T09:28:25.288775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.288783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.288813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.292952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|100396a0-7788b5e7-ab605920-59b1c946_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:25.296206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Write session: try to update token
2025-10-02T09:28:25.296232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:25.305227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:25.305273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:25.305285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.305289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.305292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.305307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:25.305331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:25.306184Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397305287 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:25.306213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:28:25.306258Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 sending to client partition status
2025-10-02T09:28:25.315547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:25.315566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:25.315569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:25.315579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:25.315589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.315593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.315596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553886665204312:2906]
2025-10-02T09:28:25.315641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:25.315649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.315652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:25.315670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:25.315682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:25.315688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:25.315806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:25.316307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:25.318912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:25.459783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:25.460151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.460164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.460400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:25.460452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:25.460464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553886740722414:3101]
2025-10-02T09:28:25.460466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:25.460555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: error at write: Disconnected sessionId: src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0
2025-10-02T09:28:25.460747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0 is DEAD
2025-10-02T09:28:25.460926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:25.460941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Write session will restart in 0.009093s
2025-10-02T09:28:25.460967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Write session: Do CDS request
2025-10-02T09:28:25.460975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:25.461356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_5089259274686375459_v1
2025-10-02T09:28:25.461377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:25.461402Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_5089259274686375459_v1
2025-10-02T09:28:25.471427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.471513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:25.471527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-10-02T09:28:25.471706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.471748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:25.471766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:25.471771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:25.471881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:25.472272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-10-02T09:28:25.472321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:25.472323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:25.472325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:25.472331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553886740722630:3104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:25.472773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:25.472905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553886740722630:3104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:25.472955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:25.472965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:25.472974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:25.473025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:25.473060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553886665204478:2909]
2025-10-02T09:28:25.473626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:25.474023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:25.474072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:25.474371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:25.474446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.474453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.474454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.474455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.474456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.474457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.474458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.474459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.474460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.474461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.474462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.474463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.474468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.474477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.474480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.474483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.474487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.474490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.474493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.474496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.474500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.474504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.474507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.474510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.474517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.474523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.474527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.474532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.474536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.474540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.474543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.474547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.474551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.474555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.474559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.474563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.474567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.474572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.474575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.474580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.474584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.474588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.474592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.474598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.474610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.474614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.474622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.474626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.474655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:25.474937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553886740722630:3104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:25.480233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553886740722630:3104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:25.480258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553886740722630:3104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:25.480262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553886740722630:3104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:25.480273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:25.483199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:25.485124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:25.485141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:25.485144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:25.485148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:25.485155Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [2:7556553886665204478:2909]
2025-10-02T09:28:25.485170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:25.485187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:25.485189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.485192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.485194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.485208Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:25.485214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:25.485225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:25.485286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.485294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.485297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.485300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:25.485303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:25.485373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:25.485381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.485395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.485405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.485419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:25.485438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722668:3104], now have 1 active actors on pipe
2025-10-02T09:28:25.485442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722511:2446], now have 1 active actors on pipe
2025-10-02T09:28:25.485447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.485450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.485452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.485465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:25.485476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:25.485481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:25.485484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:25.485486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:25.485496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:25.485499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:25.485532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.485544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:25.485564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:25.485608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 102
2025-10-02T09:28:25.485647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 102
2025-10-02T09:28:25.485705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.485719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.485745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a3c6258-166905ab-c4382c11-5cd85745_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:25.485752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.485756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.485758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:25.485770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.485787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:25.485800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.485976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.485986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.486001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.486120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a3c6258-166905ab-c4382c11-5cd85745_0
2025-10-02T09:28:25.486513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7522f-36c6b7d1-f8e40bc9-e7ec7118_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a3c6258-166905ab-c4382c11-5cd85745_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:25.489649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Write session: try to update token
2025-10-02T09:28:25.489672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:25.495935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:25.495953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:25.495960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.495999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:25.496001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:25.496166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:25.496316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:25.496460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:25.496607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:25.496827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:25.496868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:25.505949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:25.505962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:25.505964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:25.505966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:25.505975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.505978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.505984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553886665204472:2909]
2025-10-02T09:28:25.505950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|8a3c6258-166905ab-c4382c11-5cd85745_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:25.506019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:25.506028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.506030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:25.506184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:25.508874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:25.508887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:25.508891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:25.509043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:25.560652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553886740722676:3101]
2025-10-02T09:28:25.560995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7556553886740722676:3101]
2025-10-02T09:28:25.646037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:25.646359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.646374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.646392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722676:3101], now have 1 active actors on pipe
2025-10-02T09:28:25.646636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:25.646626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:25.646648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:25.646691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553886740722676:3101]
2025-10-02T09:28:25.646709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: error at write: Disconnected sessionId: src_id|8a3c6258-166905ab-c4382c11-5cd85745_0
2025-10-02T09:28:25.646730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:25.646872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|8a3c6258-166905ab-c4382c11-5cd85745_0 is DEAD
2025-10-02T09:28:25.647029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:25.647041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Write session will restart in 0.008504s
2025-10-02T09:28:25.647068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Write session: Do CDS request
2025-10-02T09:28:25.647074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:25.656336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.656482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:25.656511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-10-02T09:28:25.656656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.656686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:25.656696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:25.656701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:25.657089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-10-02T09:28:25.657128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:25.657129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:25.657131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:25.657135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553886740722796:3108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:25.657522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:25.657692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553886740722796:3108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:25.658262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:25.658436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:25.658443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:25.658451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:25.658495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:25.658532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553886665204635:2911]
2025-10-02T09:28:25.659054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:25.659318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:25.659365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:25.659605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553886740722796:3108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:25.659666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:25.659725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.659731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.659732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.659733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.659734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.659735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.659736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.659737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.659738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.659739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.659740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.659740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.659745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.659754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.659758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.659761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.659765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.659768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.659772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.659776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.659780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.659783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.659786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.659790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.659795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.659802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.659807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.659811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.659815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.659819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.659822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.659826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.659830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.659834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.659844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.659849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.659853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.659858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.659862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.659866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.659874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.659879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.659883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.659887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.659890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.659894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.659897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.659903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.659941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:25.664839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553886740722796:3108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:25.664851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553886740722796:3108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:25.664855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553886740722796:3108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:25.664862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:25.668351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:25.670304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:25.670321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:25.670323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:25.670326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:25.670332Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [2:7556553886665204635:2911]
2025-10-02T09:28:25.670347Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:25.670362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:25.670365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.670368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.670369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.670381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:25.670390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:25.670396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:25.670451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.670458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.670459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.670462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:25.670464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:25.670535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:25.670542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.670552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.670562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.670581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:25.670607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.670613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.670615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.670626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:25.670642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722678:2446], now have 1 active actors on pipe
2025-10-02T09:28:25.670643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:25.670646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:25.670648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:25.670648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722836:3108], now have 1 active actors on pipe
2025-10-02T09:28:25.670656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:25.670668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:25.670674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:25.670674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 103
2025-10-02T09:28:25.670697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 103
2025-10-02T09:28:25.670708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.670715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:25.670723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:25.670732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.670736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.670773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|787233d6-8b4290c3-f97b76ba-645b1657_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:25.670784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.670792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.670793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:25.670800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.670810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:25.670826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.671009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.671024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.671045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.671119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 36 sessionId: src_id|787233d6-8b4290c3-f97b76ba-645b1657_0
2025-10-02T09:28:25.671453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3c6258-166905ab-c4382c11-5cd85745_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|787233d6-8b4290c3-f97b76ba-645b1657_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:25.674420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Write session: try to update token
2025-10-02T09:28:25.674446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:25.681200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:25.681212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:25.681214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:25.681216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:25.681224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.681228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.681232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553886665204630:2911]
2025-10-02T09:28:25.681267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:25.681279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.681281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:25.681288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:25.681302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:25.681305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:25.681399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:25.689582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|787233d6-8b4290c3-f97b76ba-645b1657_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:25.692448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:25.746981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553886740722849:3101]
2025-10-02T09:28:25.747265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7556553886740722849:3101]
2025-10-02T09:28:25.814412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:25.814791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.814806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.814822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722849:3101], now have 1 active actors on pipe
2025-10-02T09:28:25.815027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:25.815043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553886740722849:3101]
2025-10-02T09:28:25.815052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:25.815078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:25.815081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:25.815146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: error at write: Disconnected sessionId: src_id|787233d6-8b4290c3-f97b76ba-645b1657_0
2025-10-02T09:28:25.815321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|787233d6-8b4290c3-f97b76ba-645b1657_0 is DEAD
2025-10-02T09:28:25.815547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:25.815562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Write session will restart in 0.007189s
2025-10-02T09:28:25.815593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Write session: Do CDS request
2025-10-02T09:28:25.815600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:25.824379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.824501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:25.824518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-10-02T09:28:25.824793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:25.824851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:25.824873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:25.824883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:25.825351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-10-02T09:28:25.825396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:25.825402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:25.825404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:25.825412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553886740722914:3113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:25.825986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553886740722914:3113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:25.827898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:25.828294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553886740722914:3113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:25.828718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:25.828882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:25.828892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:25.828902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:25.828952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:25.828989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553886665204797:2914]
2025-10-02T09:28:25.829498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:25.829824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:25.829862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:25.830159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:25.830199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.830203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.830204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.830204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.830205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.830206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.830206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.830207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.830207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.830208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.830209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.830209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.830212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.830219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.830221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.830223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.830225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.830227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.830229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.830231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.830233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.830235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.830237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.830239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.830243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.830248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:25.830251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.830254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:25.830256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.830260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:25.830263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.830268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:25.830271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.830275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:25.830278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.830282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:25.830286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.830291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:25.830295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.830299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:25.830302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.830304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:25.830306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.830309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.830312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.830315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.830318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.830320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.830338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:25.830724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553886740722914:3113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:25.830736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553886740722914:3113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:25.830740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553886740722914:3113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:25.830749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:25.839790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:25.842284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:25.842301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:25.842304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:25.842307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:25.842315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [2:7556553886665204797:2914]
2025-10-02T09:28:25.842328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:25.842343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:25.842346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.842349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.842351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.842366Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:25.842374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:25.842383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:25.842443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.842448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.842450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.842452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:25.842455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:25.842526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:25.842531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.842544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:25.842558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:25.842577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:25.842595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.842600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.842601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.842611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:25.842626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740722853:2446], now have 1 active actors on pipe
2025-10-02T09:28:25.842630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:25.842635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:25.842635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:25.842638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:25.842648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:25.842652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:25.842661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740723013:3113], now have 1 active actors on pipe
2025-10-02T09:28:25.842689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.842699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:25.842710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:25.842749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 104
2025-10-02T09:28:25.842767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 104
2025-10-02T09:28:25.842828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.842837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.842859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:25.842871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:25.842875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:25.842877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:25.842888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:25.842898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:25.842910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.843180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:25.843196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:25.843218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:25.843365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0
2025-10-02T09:28:25.843723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787233d6-8b4290c3-f97b76ba-645b1657_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:25.846919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Write session: try to update token
2025-10-02T09:28:25.846937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:25.853951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:25.853969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:25.853972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:25.853974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:25.853983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.853987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.853990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553886665204792:2914]
2025-10-02T09:28:25.854030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:25.854037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:25.854041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:25.854043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:25.854048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:25.854051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:25.854190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:25.862400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:25.865358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:25.915798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553886740723021:3101]
2025-10-02T09:28:25.916205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7556553886740723021:3101]
2025-10-02T09:28:26.001952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:26.002428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.002445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.002462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553886740723021:3101], now have 1 active actors on pipe
2025-10-02T09:28:26.002749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:26.002785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:26.002826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553886740723021:3101]
2025-10-02T09:28:26.002839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:26.002845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:26.002923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: error at write: Disconnected sessionId: src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0
2025-10-02T09:28:26.003095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0 is DEAD
2025-10-02T09:28:26.003299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:26.003314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Write session will restart in 0.006749s
2025-10-02T09:28:26.003345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Write session: Do CDS request
2025-10-02T09:28:26.003353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:26.011362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.011496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:26.011510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-10-02T09:28:26.011841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.011891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:26.011896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:26.011901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:26.012959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-10-02T09:28:26.012997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:26.012999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:26.013001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:26.013006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553891035690361:3117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:26.013557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553891035690361:3117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:26.019610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553891035690361:3117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:26.022381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553891035690361:3117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:26.022447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553891035690361:3117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:26.022457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553891035690361:3117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:26.022466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:26.022707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:26.023636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:26.023825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:26.023838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:26.023849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:26.023903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:26.023947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553890960172254:2916]
2025-10-02T09:28:26.024529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:26.025709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:26.025762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:26.026082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:26.026134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.026139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.026140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.026141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.026142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.026143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.026144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.026146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.026147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.026148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.026149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.026150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.026156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.026165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.026169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.026173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.026176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.026180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.026184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.026188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.026191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.026195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.026198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.026202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.026208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.026216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.026222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.026227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.026230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.026235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.026244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.026249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.026253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.026258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.026261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.026270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.026275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.026282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.026290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.026294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.026298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.026303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.026307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.026315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.026319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.026324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.026327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.026334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.026368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:26.036531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:26.038654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:26.038674Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:26.038677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:26.038680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:26.038686Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [2:7556553890960172254:2916]
2025-10-02T09:28:26.038699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:26.038715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:26.038719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.038721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.038723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.038736Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:26.038742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:26.038747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:26.038805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.038814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.038815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.038819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:26.038821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:26.038887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:26.038894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.038908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.038922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.038936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:26.039076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 105
2025-10-02T09:28:26.039091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 105
2025-10-02T09:28:26.038957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690319:2446], now have 1 active actors on pipe
2025-10-02T09:28:26.038967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690475:3117], now have 1 active actors on pipe
2025-10-02T09:28:26.038972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.038973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.038976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.038987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:26.039001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:26.039007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:26.039010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:26.039012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:26.039013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:26.039015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:26.039051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.039058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:26.039080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:26.039374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.039383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.039405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:26.039415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.039418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.039420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:26.039430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.039439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:26.039451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.039797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.039804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.039820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.039953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 36 sessionId: src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0
2025-10-02T09:28:26.041114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f493-bd2bc95-68fd1569-5fd23577_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:26.048848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Write session: try to update token
2025-10-02T09:28:26.048881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:26.050956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:26.050976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.050979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:26.050980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:26.050990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.050993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.050996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553890960172248:2916]
2025-10-02T09:28:26.051032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:26.051038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.051039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:26.051045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:26.051050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:26.051062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:26.051209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:26.079821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:26.082823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:26.102848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553891035690489:3101]
2025-10-02T09:28:26.103092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7556553891035690489:3101]
2025-10-02T09:28:26.195621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:26.196057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.196074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.196090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690489:3101], now have 1 active actors on pipe
2025-10-02T09:28:26.196282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:26.196388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:26.196441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553891035690489:3101]
2025-10-02T09:28:26.196469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:26.196546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0
2025-10-02T09:28:26.196718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0 is DEAD
2025-10-02T09:28:26.196873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:26.196886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Write session will restart in 0.008240s
2025-10-02T09:28:26.196906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Write session: Do CDS request
2025-10-02T09:28:26.196912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:26.206369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.206812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:26.206832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-10-02T09:28:26.207028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.207064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:26.207069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:26.207074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:26.207532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-10-02T09:28:26.207568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:26.207570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:26.207571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:26.207576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553891035690546:3128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:26.208073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553891035690546:3128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:26.211792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553891035690546:3128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:26.213666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:26.214503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:26.215009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553891035690546:3128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:26.215031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553891035690546:3128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:26.215035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553891035690546:3128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:26.215044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:26.214761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:26.214775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:26.214788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:26.214850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:26.214880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553890960172443:2925]
2025-10-02T09:28:26.215440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:26.215780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:26.215821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:26.216132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:26.216184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.216185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.216186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.216187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.216188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.216189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.216190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.216191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.216192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.216193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.216194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.216194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.216198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.216204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.216206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.216209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.216211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.216214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.216216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.216218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.216221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.216223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.216225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.216227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.216231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.216235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.216238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.216241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.216243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.216246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.216249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.216254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.216260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.216264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.216268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.216271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.216276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.216280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.216284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.216288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.216292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.216294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.216297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.216299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.216301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.216304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.216308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.216312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.216344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:26.225464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:26.227324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:26.227346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:26.227348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:26.227351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:26.227359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [2:7556553890960172443:2925]
2025-10-02T09:28:26.227374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:26.227390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:26.227393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.227398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.227400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.227414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:26.227419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:26.227426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:26.227492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.227500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.227502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.227505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:26.227507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:26.227574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:26.227583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.227596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.227607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.227625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:26.227653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690665:3128], now have 1 active actors on pipe
2025-10-02T09:28:26.227657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690505:2446], now have 1 active actors on pipe
2025-10-02T09:28:26.227662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.227665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.227667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.227682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:26.227700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:26.227706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:26.227710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:26.227712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:26.227721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:26.227723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:26.227736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 106
2025-10-02T09:28:26.227765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 106
2025-10-02T09:28:26.227754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.227763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:26.227787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:26.227793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.227797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.227828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2198d646-541846fd-fd645669-6d2817c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:26.227839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.227843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.227844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:26.227855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.227867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:26.227882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.232316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.232339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.232367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.232532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 36 sessionId: src_id|2198d646-541846fd-fd645669-6d2817c7_0
2025-10-02T09:28:26.232976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84de2a3-16e3ad59-d99d21ce-da504c04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2198d646-541846fd-fd645669-6d2817c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:26.235935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Write session: try to update token
2025-10-02T09:28:26.235958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:26.239015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:26.239034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.239038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:26.239040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:26.239048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.239052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.239056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553890960172428:2925]
2025-10-02T09:28:26.239094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:26.239106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.239107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:26.239254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:26.239263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:26.239268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:26.239272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:26.251812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|2198d646-541846fd-fd645669-6d2817c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:26.254735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:26.296468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553891035690694:3101]
2025-10-02T09:28:26.296854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7556553891035690694:3101]
2025-10-02T09:28:26.375274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:26.375602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.375618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.375636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690694:3101], now have 1 active actors on pipe
2025-10-02T09:28:26.375909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:26.375926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:26.375931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:26.375941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:26.375988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553891035690694:3101]
2025-10-02T09:28:26.376006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: error at write: Disconnected sessionId: src_id|2198d646-541846fd-fd645669-6d2817c7_0
2025-10-02T09:28:26.376204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|2198d646-541846fd-fd645669-6d2817c7_0 is DEAD
2025-10-02T09:28:26.376525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:26.376535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Write session will restart in 0.006792s
2025-10-02T09:28:26.376559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Write session: Do CDS request
2025-10-02T09:28:26.376565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:26.384494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.384654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:26.384668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-10-02T09:28:26.384889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.384926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:26.384931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:26.384936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:26.385367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-10-02T09:28:26.385404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:26.385409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:26.385411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:26.385416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553891035690711:3134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:26.385976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553891035690711:3134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:26.388550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553891035690711:3134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:26.391944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553891035690711:3134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:26.391957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553891035690711:3134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:26.391960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553891035690711:3134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:26.391965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:26.394434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:26.395381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:26.395557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:26.395570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:26.395580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:26.395639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:26.395677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553890960172627:2934]
2025-10-02T09:28:26.396235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:26.396545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:26.396603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:26.396926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:26.396998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.397003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.397004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.397005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.397006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.397007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.397008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.397009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.397010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.397011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.397012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.397013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.397019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.397030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.397033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.397036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.397040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.397043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.397047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.397050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.397054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.397058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.397062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.397066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.397073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.397083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.397088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.397093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.397097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.397101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.397105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.397111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.397116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.397127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.397130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.397134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.397138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.397147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.397151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.397155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.397159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.397164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.397169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.397173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.397178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.397182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.397191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.397196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.397231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:26.405836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:26.407729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:26.407748Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:26.407751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:26.407755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:26.407761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [2:7556553890960172627:2934]
2025-10-02T09:28:26.407775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:26.407790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:26.407793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.407796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.407798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.407811Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:26.407821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:26.407828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:26.407887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.407896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.407898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.407901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:26.407904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:26.407970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:26.407977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.407990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.408006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.408025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:26.408047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690806:3134], now have 1 active actors on pipe
2025-10-02T09:28:26.408056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690696:2446], now have 1 active actors on pipe
2025-10-02T09:28:26.408061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.408067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.408069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.408082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:26.408101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:26.408104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:26.408105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:26.408108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:26.408118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:26.408122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:26.408097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 107
2025-10-02T09:28:26.408097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 107
2025-10-02T09:28:26.408150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.408162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:26.408183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:26.408219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.408228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.408244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5c235c5-44550672-681e6f0c-e9fca413_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:26.408252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.408255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.408256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:26.408262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.408269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:26.408285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.408400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.408405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.408414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.408471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5c235c5-44550672-681e6f0c-e9fca413_0
2025-10-02T09:28:26.408849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2198d646-541846fd-fd645669-6d2817c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5c235c5-44550672-681e6f0c-e9fca413_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:26.411615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Write session: try to update token
2025-10-02T09:28:26.411635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:26.418005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:26.418020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.418026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.418057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:26.418063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:26.418205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:26.418336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:26.418511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:26.418645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:26.418817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:26.418857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:26.426480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|f5c235c5-44550672-681e6f0c-e9fca413_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:26.427593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:26.427611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.427613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:26.427615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:26.427622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.427625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.427627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553890960172622:2934]
2025-10-02T09:28:26.427654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:26.427659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.427660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:26.427665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:26.427670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:26.427673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:26.427800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:26.430658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:26.476066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553891035690867:3101]
2025-10-02T09:28:26.476351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7556553891035690867:3101]
2025-10-02T09:28:26.569038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:26.569581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.569593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.569609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690867:3101], now have 1 active actors on pipe
2025-10-02T09:28:26.569910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:26.569923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:26.569941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553891035690867:3101]
2025-10-02T09:28:26.569958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:26.569942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:26.569974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: error at write: Disconnected sessionId: src_id|f5c235c5-44550672-681e6f0c-e9fca413_0
2025-10-02T09:28:26.570130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|f5c235c5-44550672-681e6f0c-e9fca413_0 is DEAD
2025-10-02T09:28:26.570309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:26.570325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Write session will restart in 0.006874s
2025-10-02T09:28:26.570355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Write session: Do CDS request
2025-10-02T09:28:26.570363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:26.578485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.578532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:26.578547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-10-02T09:28:26.578734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.578768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:26.578777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:26.578783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:26.579169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-10-02T09:28:26.579200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:26.579207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:26.579208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:26.579213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553891035690966:3140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:26.579723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553891035690966:3140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:26.581097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:26.581705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:26.581808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553891035690966:3140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:26.581866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:26.581876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:26.581886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:26.581937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:26.581972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553890960172791:2936]
2025-10-02T09:28:26.582547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:26.582775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:26.582813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:26.583099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:26.583172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.583178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.583179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.583180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.583181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.583183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.583184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.583185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.583186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.583188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.583189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.583190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.583195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.583205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.583209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.583213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.583216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.583220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.583224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.583228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.583232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.583236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.583241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.583244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.583251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.583257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.583262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.583267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.583272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.583277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.583281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.583288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.583297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.583303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.583309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.583314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.583323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.583327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.583331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.583338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.583342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.583347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.583355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.583360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.583364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.583369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.583374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.583379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.583418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:26.584163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553891035690966:3140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:26.584174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553891035690966:3140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:26.584176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553891035690966:3140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:26.584180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:26.591993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:26.593850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:26.593869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:26.593872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:26.593876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:26.593883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [2:7556553890960172791:2936]
2025-10-02T09:28:26.593897Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:26.593914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:26.593917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.593921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.593923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.593938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:26.593943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:26.593950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:26.594009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.594018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.594019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.594022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:26.594025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:26.594096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:26.594104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.594117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.594131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.594149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:26.594171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035690873:2446], now have 1 active actors on pipe
2025-10-02T09:28:26.594178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691036:3140], now have 1 active actors on pipe
2025-10-02T09:28:26.594184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.594188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.594190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.594201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:26.594219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:26.594220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:26.594223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:26.594225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:26.594191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 108
2025-10-02T09:28:26.594238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:26.594210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 108
2025-10-02T09:28:26.594241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:26.594287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.594300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.594310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.594319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:26.594333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:26.594345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:26.594355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.594363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.594365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:26.594378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.594390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:26.594416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.594570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.594577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.594589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.594666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 36 sessionId: src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0
2025-10-02T09:28:26.595000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c235c5-44550672-681e6f0c-e9fca413_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:26.598277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Write session: try to update token
2025-10-02T09:28:26.598296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:26.605387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:26.605405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.605408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:26.605410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:26.605418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.605423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.605427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553890960172785:2936]
2025-10-02T09:28:26.605469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:26.605472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:26.605478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:26.605481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.605482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:26.605483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:26.605636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:26.613797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:26.616889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:26.670139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553891035691043:3101]
2025-10-02T09:28:26.670403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7556553891035691043:3101]
2025-10-02T09:28:26.749111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:26.749585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.749598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.749616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691043:3101], now have 1 active actors on pipe
2025-10-02T09:28:26.749796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553891035691043:3101]
2025-10-02T09:28:26.749819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:26.749804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:26.749807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:26.749825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:26.749861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: error at write: Disconnected sessionId: src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0
2025-10-02T09:28:26.750028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0 is DEAD
2025-10-02T09:28:26.750156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:26.750164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Write session will restart in 0.005510s
2025-10-02T09:28:26.750182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Write session: Do CDS request
2025-10-02T09:28:26.750186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:26.757316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.757692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:26.757707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-10-02T09:28:26.759196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.759249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:26.759260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:26.759266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:26.759895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-10-02T09:28:26.759936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:26.759938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:26.759940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:26.759945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553891035691106:3145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:26.760503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553891035691106:3145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:26.762544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553891035691106:3145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:26.763087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:26.764127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:26.764313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:26.764321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:26.764330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:26.764375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:26.764409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553890960172957:2939]
2025-10-02T09:28:26.765017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:26.765001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553891035691106:3145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:26.765016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553891035691106:3145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:26.765020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553891035691106:3145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:26.765028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:26.765393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:26.765447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:26.765778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:26.765848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.765855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.765856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.765857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.765858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.765858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.765860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.765861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.765862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.765862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.765864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.765864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.765870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.765879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.765882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.765886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.765889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.765893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.765896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.765900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.765903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.765907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.765911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.765916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.765922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.765928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.765933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.765937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.765940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.765944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.765948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.765952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.765956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.765960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.765964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.765968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.765972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.765977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.765983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.765988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.765991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.766002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.766006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.766010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.766018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.766023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.766026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.766030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.766068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:26.775246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:26.777388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:26.777407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:26.777410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:26.777413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:26.777418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [2:7556553890960172957:2939]
2025-10-02T09:28:26.777431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:26.777447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:26.777450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.777454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.777455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.777468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:26.777473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:26.777479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:26.777545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.777553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.777556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.777559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:26.777561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:26.777627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:26.777634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.777646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.777658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.777677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:26.777700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.777707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.777709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.777717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:26.777732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691214:3145], now have 1 active actors on pipe
2025-10-02T09:28:26.777734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:26.777738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:26.777739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:26.777744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:26.777757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:26.777760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:26.777766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691051:2446], now have 1 active actors on pipe
2025-10-02T09:28:26.777800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.777807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:26.777840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:26.777806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 109
2025-10-02T09:28:26.777819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 109
2025-10-02T09:28:26.777977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.777987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.778011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:26.778022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.778028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.778030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:26.778038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.778048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:26.778063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.778327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.778335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.778350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.778455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0
2025-10-02T09:28:26.778807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9fd2942-91935a8f-a95766e5-505cb98d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:26.781982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Write session: try to update token
2025-10-02T09:28:26.782001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:26.789027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:26.789045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.789048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:26.789051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:26.789058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.789063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.789067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553890960172951:2939]
2025-10-02T09:28:26.789105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:26.789111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.789113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:26.789114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:26.789123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:26.789127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:26.789252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:26.797719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:26.801104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:26.849867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553891035691226:3101]
2025-10-02T09:28:26.850156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7556553891035691226:3101]
2025-10-02T09:28:26.928917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:26.929296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.929307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.929320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691226:3101], now have 1 active actors on pipe
2025-10-02T09:28:26.929478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:26.929570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:26.929572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553891035691226:3101]
2025-10-02T09:28:26.929592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:26.929655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0
2025-10-02T09:28:26.929824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0 is DEAD
2025-10-02T09:28:26.929965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:26.929976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Write session will restart in 0.007994s
2025-10-02T09:28:26.930000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Write session: Do CDS request
2025-10-02T09:28:26.930006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:26.939275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.939416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:26.939430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-10-02T09:28:26.939557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:26.939587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:26.939597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:26.939602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:26.939986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-10-02T09:28:26.940022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:26.940028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:26.940030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:26.940035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553891035691328:3149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:26.940565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553891035691328:3149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:26.942020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:26.942751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:26.942753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553891035691328:3149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:26.942896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:26.942907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:26.942915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:26.942952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:26.942979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553890960173122:2941]
2025-10-02T09:28:26.943391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:26.943890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:26.943929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:26.944168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:26.944221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.944226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.944227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.944227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.944228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.944229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.944229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.944230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.944231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.944231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.944232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.944232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.944236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.944243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.944245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.944247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.944249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.944251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.944253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.944256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.944258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.944260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.944262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.944264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.944268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.944272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:26.944276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.944279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:26.944282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.944285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:26.944287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.944290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:26.944292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.944295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:26.944298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.944300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:26.944303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.944306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:26.944308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.944311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:26.944314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.944317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:26.944319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.944322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.944325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.944327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.944329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.944332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.944351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:26.947855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553891035691328:3149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:26.947871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553891035691328:3149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:26.947874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553891035691328:3149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:26.947881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:26.953439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:26.955359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:26.955374Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:26.955375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:26.955378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:26.955382Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [2:7556553890960173122:2941]
2025-10-02T09:28:26.955394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:26.955409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:26.955412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.955414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.955416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.955425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:26.955428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:26.955433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:26.955474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.955481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.955483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.955485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:26.955487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:26.955535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:26.955541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.955548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:26.955554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:26.955569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:26.955592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691393:3149], now have 1 active actors on pipe
2025-10-02T09:28:26.955600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553891035691228:2446], now have 1 active actors on pipe
2025-10-02T09:28:26.955607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.955612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.955614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.955626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:26.955642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:26.955652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:26.955654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:26.955656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:26.955656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:26.955658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:26.955633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 110
2025-10-02T09:28:26.955675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 110
2025-10-02T09:28:26.955684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.955689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:26.955699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:26.955705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.955708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.955729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:26.955736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:26.955738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:26.955739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:26.955745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:26.955750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:26.955768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.955934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:26.955946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:26.955965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:26.956061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0
2025-10-02T09:28:26.956387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c741ee-9915466c-b206e40b-d0ce06eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:26.959411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Write session: try to update token
2025-10-02T09:28:26.959426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:26.966744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:26.966767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:26.966769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:26.966771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:26.966780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.966784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.966788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553890960173117:2941]
2025-10-02T09:28:26.966826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:26.966832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:26.966836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:26.966838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:26.966838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:26.966843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:26.966991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:26.974706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:26.977761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:27.029547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553895330658697:3101]
2025-10-02T09:28:27.029769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7556553895330658697:3101]
2025-10-02T09:28:27.104240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:27.104700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.104713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.104730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330658697:3101], now have 1 active actors on pipe
2025-10-02T09:28:27.104940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:27.104960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:27.104975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:27.104991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553895330658697:3101]
2025-10-02T09:28:27.105020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:27.105037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: error at write: Disconnected sessionId: src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0
2025-10-02T09:28:27.105202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0 is DEAD
2025-10-02T09:28:27.105341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:27.105349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Write session will restart in 0.008416s
2025-10-02T09:28:27.105369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Write session: Do CDS request
2025-10-02T09:28:27.105376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:27.115313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.115401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:27.115426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-10-02T09:28:27.115550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.115588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:27.115597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:27.115600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:27.115963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-10-02T09:28:27.115994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:27.116000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:27.116001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:27.116006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553895330658825:3154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:27.116530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553895330658825:3154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:27.116571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:27.117433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:27.117678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:27.117688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:27.117699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:27.117749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:27.117785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553895255140586:2944]
2025-10-02T09:28:27.118369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:27.118672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:27.118723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:27.119029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:27.119017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553895330658825:3154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:27.119078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.119092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.119097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.119098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.119100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.119101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.119102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.119103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.119104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.119105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.119106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.119107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.119112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.119122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.119126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.119130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.119133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.119137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.119140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.119144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.119148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.119167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.119171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.119174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.119180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.119187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.119192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.119197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.119201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.119206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.119214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.119219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.119224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.119229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.119233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.119237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.119242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.119246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.119250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.119255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.119259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.119265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.119268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.119272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.119276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.119280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.119284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.119289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.119323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:27.124756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553895330658825:3154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:27.124771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553895330658825:3154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:27.124775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553895330658825:3154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:27.124782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:27.127791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:27.130100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 111
2025-10-02T09:28:27.130137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 111
2025-10-02T09:28:27.129710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:27.129727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:27.129730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:27.129734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:27.129739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [2:7556553895255140586:2944]
2025-10-02T09:28:27.129753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:27.129769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:27.129772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.129775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.129777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.129791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:27.129796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:27.129803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:27.129865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.129867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.129869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.129872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:27.129874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:27.129942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:27.129945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.129958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.129969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.129985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:27.130005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330658867:3154], now have 1 active actors on pipe
2025-10-02T09:28:27.130008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330658700:2446], now have 1 active actors on pipe
2025-10-02T09:28:27.130013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.130016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.130019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.130026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:27.130038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:27.130040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:27.130041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:27.130044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:27.130054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:27.130057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:27.130086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.130096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:27.130125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:27.130287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.130297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.130325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:27.130333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.130337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.130339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:27.130349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.130360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:27.130373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.130567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.130577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.130590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.130734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0
2025-10-02T09:28:27.131076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9466639-dd4cfbe-8dcccbb5-197b59d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:27.134144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Write session: try to update token
2025-10-02T09:28:27.134161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:27.146721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:27.146744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:27.146747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:27.146749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:27.146757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.146762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.146766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553895255140580:2944]
2025-10-02T09:28:27.146806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:27.146812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.146814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:27.146834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:27.146849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:27.146853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:27.146964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:27.153485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:27.156029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:27.205183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553895330658875:3101]
2025-10-02T09:28:27.205480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7556553895330658875:3101]
2025-10-02T09:28:27.290509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:27.290952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.290967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.290986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330658875:3101], now have 1 active actors on pipe
2025-10-02T09:28:27.291241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:27.291294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:27.291304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553895330658875:3101]
2025-10-02T09:28:27.291308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:27.291329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:27.291375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: error at write: Disconnected sessionId: src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0
2025-10-02T09:28:27.291550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0 is DEAD
2025-10-02T09:28:27.291720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:27.291731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Write session will restart in 0.008419s
2025-10-02T09:28:27.291755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Write session: Do CDS request
2025-10-02T09:28:27.291762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:27.301277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.305198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:27.305213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-10-02T09:28:27.305542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.305570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:27.305574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:27.305578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:27.306437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-10-02T09:28:27.306481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:27.306486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:27.306488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:27.306493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553895330658941:3166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:27.307043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553895330658941:3166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:27.310127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553895330658941:3166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:27.312642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:27.312958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553895330658941:3166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:27.312972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553895330658941:3166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:27.312975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553895330658941:3166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:27.312982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:27.315397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:27.315671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:27.315680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:27.315690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:27.315740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:27.315778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553895255140803:2959]
2025-10-02T09:28:27.316436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:27.316717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:27.316752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:27.317081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:27.317133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.317138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.317139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.317141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.317142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.317143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.317145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.317146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.317148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.317149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.317150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.317151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.317156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.317169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.317173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.317178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.317183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.317187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.317192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.317196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.317201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.317207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.317211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.317216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.317222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.317230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.317236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.317242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.317247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.317253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.317258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.317263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.317269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.317280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.317284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.317289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.317295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.317302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.317306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.317312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.317317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.317323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.317328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.317335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.317342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.317353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.317358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.317363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.317402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:27.326691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:27.328695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:27.328710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:27.328712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:27.328716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:27.328723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [2:7556553895255140803:2959]
2025-10-02T09:28:27.328737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:27.328755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:27.328759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.328762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.328764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.328779Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:27.328790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:27.328796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:27.328896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.328905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.328907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.328910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:27.328913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:27.328990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:27.328998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.329010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.329021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.329040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:27.329063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.329071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.329072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.329080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:27.329091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:27.329093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:27.329095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:27.329098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:27.329107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:27.329110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:27.329119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330658913:2446], now have 1 active actors on pipe
2025-10-02T09:28:27.329123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659072:3166], now have 1 active actors on pipe
2025-10-02T09:28:27.329156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.329170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:27.329234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:27.329694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 112
2025-10-02T09:28:27.329723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 112
2025-10-02T09:28:27.330175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.330188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.330213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:27.330226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.330232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.330235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:27.330245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.330256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:27.330271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.330471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.330485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.330506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.330711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 36 sessionId: src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0
2025-10-02T09:28:27.331107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f14acd-731da17f-88cd1d3a-9e164f76_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:27.334391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Write session: try to update token
2025-10-02T09:28:27.334411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:27.342054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:27.342074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:27.342077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:27.342079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:27.342087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.342096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.342100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553895255140796:2959]
2025-10-02T09:28:27.342143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:27.342150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.342153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:27.342186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:27.342193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:27.342197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:27.342297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:27.353916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:27.356834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:27.390531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553895330659085:3101]
2025-10-02T09:28:27.390852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7556553895330659085:3101]
2025-10-02T09:28:27.491623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:27.492021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.492036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.492054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659085:3101], now have 1 active actors on pipe
2025-10-02T09:28:27.492316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:27.492826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:27.492838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Write session will restart in 0.008626s
2025-10-02T09:28:27.492860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Write session: Do CDS request
2025-10-02T09:28:27.492866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:27.492354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553895330659085:3101]
2025-10-02T09:28:27.492382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:27.492424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:27.492428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:27.492488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0
2025-10-02T09:28:27.492662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0 is DEAD
2025-10-02T09:28:27.505373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.505498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:27.505515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-10-02T09:28:27.505741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.505783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:27.505788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:27.505794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:27.506281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-10-02T09:28:27.506313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:27.506315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:27.506316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:27.506321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553895330659167:3170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:27.506866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553895330659167:3170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:27.509169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:27.509624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553895330659167:3170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:27.510125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:27.510301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:27.510313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:27.510323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:27.510371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:27.510409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553895255140970:2961]
2025-10-02T09:28:27.511003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:27.511349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:27.511409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:27.511736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:27.511805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.511810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.511811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.511812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.511813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.511814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.511815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.511816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.511817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.511818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.511819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.511820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.511825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.511837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.511840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.511844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.511847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.511851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.511855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.511859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.511862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.511867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.511871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.511875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.511881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.511888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.511894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.511899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.511902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.511906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.511910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.511915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.511919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.511924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.511933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.511938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.511949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.511953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.511958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.511967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.511972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.511977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.511983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.511992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.511997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.512002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.512010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.512015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.512048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:27.512384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553895330659167:3170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:27.512398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553895330659167:3170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:27.512402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553895330659167:3170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:27.512409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:27.521543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:27.523848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:27.523873Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:27.523876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:27.523880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:27.523887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [2:7556553895255140970:2961]
2025-10-02T09:28:27.523901Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:27.523922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:27.523925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.523929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.523930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.523946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:27.523951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:27.523958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:27.524040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.524052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.524054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.524057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:27.524059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:27.524370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 113
2025-10-02T09:28:27.524378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 113
2025-10-02T09:28:27.524948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:27.524968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.524989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.525002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.525032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:27.525045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659255:3170], now have 1 active actors on pipe
2025-10-02T09:28:27.525050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659087:2446], now have 1 active actors on pipe
2025-10-02T09:28:27.525081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.525096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.525133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.525145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.525147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.525163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:27.525190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:27.525202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.525206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.525208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:27.525219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.525235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:27.525254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:27.525273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:27.525281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:27.525331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.525354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.525363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:27.525430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:27.525438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:27.525443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:27.525449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:27.525686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.525698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.525719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.525819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 36 sessionId: src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0
2025-10-02T09:28:27.528967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe0bf19-84449475-bdf8b6ed-1c288862_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:27.532211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Write session: try to update token
2025-10-02T09:28:27.532236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:27.540997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:27.541016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:27.541019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:27.541021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:27.541030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.541035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.541039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553895255140965:2961]
2025-10-02T09:28:27.541075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:27.541080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.541083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:27.541097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:27.541112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:27.541117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:27.541229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:27.555334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:27.558224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:27.592232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553895330659263:3101]
2025-10-02T09:28:27.592412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7556553895330659263:3101]
2025-10-02T09:28:27.682866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:27.683131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.683145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.683173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659263:3101], now have 1 active actors on pipe
2025-10-02T09:28:27.683368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:27.683382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:27.683389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:27.683431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553895330659263:3101]
2025-10-02T09:28:27.683432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: error at write: Disconnected sessionId: src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0
2025-10-02T09:28:27.683462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:27.683607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0 is DEAD
2025-10-02T09:28:27.683745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:27.683757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Write session will restart in 0.007303s
2025-10-02T09:28:27.683782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Write session: Do CDS request
2025-10-02T09:28:27.683788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:27.692357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.692421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:27.692435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-10-02T09:28:27.692571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.692625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:27.692634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:27.692639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:27.693099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-10-02T09:28:27.693128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:27.693134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:27.693137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:27.693143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553895330659374:3174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:27.693678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553895330659374:3174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:27.694762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:27.695469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553895330659374:3174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:27.695575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:27.695751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:27.695762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:27.695772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:27.695824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:27.695860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553895255141139:2963]
2025-10-02T09:28:27.696393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:27.696667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:27.696712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:27.697019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:27.697090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.697097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.697098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.697099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.697100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.697101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.697102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.697103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.697104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.697105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.697107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.697108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.697113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.697122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.697125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.697128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.697132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.697135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.697138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.697142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.697145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.697149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.697153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.697156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.697162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.697168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.697173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.697178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.697182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.697186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.697190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.697195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.697199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.697204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.697207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.697212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.697217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.697221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.697225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.697229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.697234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.697238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.697243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.697247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.697251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.697257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.697261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.697265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.697300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:27.697800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553895330659374:3174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:27.697814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553895330659374:3174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:27.697817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553895330659374:3174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:27.697823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:27.705564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:27.707246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:27.707260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:27.707262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:27.707266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:27.707271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [2:7556553895255141139:2963]
2025-10-02T09:28:27.707283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:27.707298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:27.707300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.707303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.707305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.707316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:27.707321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:27.707326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:27.707382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.707389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.707392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.707395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:27.707397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:27.707457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:27.707465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.707477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.707488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.707503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:27.707521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659438:3174], now have 1 active actors on pipe
2025-10-02T09:28:27.707525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659266:2446], now have 1 active actors on pipe
2025-10-02T09:28:27.707531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.707533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.707535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.707546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:27.707558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:27.707558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:27.707561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:27.707563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:27.707570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:27.707573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:27.707575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 114
2025-10-02T09:28:27.707602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.707610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:27.707612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:27.707581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 114
2025-10-02T09:28:27.707635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.707642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.707747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9e59842-f425053f-577ba263-39aa9598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:27.707757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.707761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.707763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:27.707771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.707779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:27.707803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.707968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.707977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.707989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.708061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9e59842-f425053f-577ba263-39aa9598_0
2025-10-02T09:28:27.708363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66fa8d82-3ab2f1a6-53fc914d-f624d44f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9e59842-f425053f-577ba263-39aa9598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:27.711517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Write session: try to update token
2025-10-02T09:28:27.711534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:27.718464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:27.718483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:27.718486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:27.718488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:27.718496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.718501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.718504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553895255141133:2963]
2025-10-02T09:28:27.718539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:27.718545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.718544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:27.718547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:27.718550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:27.718554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:27.718697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:27.729379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId: src_id|d9e59842-f425053f-577ba263-39aa9598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:27.732202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:27.783717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553895330659454:3101]
2025-10-02T09:28:27.784035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7556553895330659454:3101]
2025-10-02T09:28:27.863355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:27.863757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.863767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.863779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659454:3101], now have 1 active actors on pipe
2025-10-02T09:28:27.863949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:27.863965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:27.863977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:27.863978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:27.864029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553895330659454:3101]
2025-10-02T09:28:27.864131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: error at write: Disconnected sessionId: src_id|d9e59842-f425053f-577ba263-39aa9598_0
2025-10-02T09:28:27.864320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|d9e59842-f425053f-577ba263-39aa9598_0 is DEAD
2025-10-02T09:28:27.864440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:27.864447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Write session will restart in 0.005172s
2025-10-02T09:28:27.864466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Write session: Do CDS request
2025-10-02T09:28:27.864472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:27.871252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.871348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:27.871362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-10-02T09:28:27.871491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:27.871521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:27.871526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:27.871537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:27.871889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-10-02T09:28:27.871919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:27.871927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:27.871930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:27.871934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553895330659497:3179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:27.872455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553895330659497:3179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:27.874885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553895330659497:3179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:27.875895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:27.876709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:27.876880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:27.876889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:27.876898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:27.876923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553895330659497:3179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:27.876935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553895330659497:3179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:27.876940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:27.876938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553895330659497:3179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:27.876945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:27.876980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553895255141311:2966]
2025-10-02T09:28:27.877530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:27.877808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:27.877859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:27.878193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:27.878249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.878254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.878255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.878256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.878258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.878259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.878260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.878261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.878262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.878263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.878264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.878265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.878270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.878280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.878283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.878286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.878290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.878294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.878298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.878301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.878305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.878309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.878312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.878316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.878322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.878332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:27.878342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.878351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:27.878358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.878363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:27.878378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.878387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:27.878391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.878400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:27.878407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.878415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:27.878419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.878424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:27.878431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.878436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:27.878443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.878449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:27.878456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.878462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.878469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.878478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.878485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.878490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.878527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:27.887068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:27.888669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:27.888687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:27.888691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:27.888694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:27.888701Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [2:7556553895255141311:2966]
2025-10-02T09:28:27.888715Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:27.888728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:27.888734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.888736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.888738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.888749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:27.888752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:27.888761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:27.888834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.888840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.888841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.888844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:27.888845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:27.888897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:27.888903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.888910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:27.888919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:27.888932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:27.888948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.888953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.888956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.888964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:27.888975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:27.888977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:27.888985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:27.888985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:27.888987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:27.888987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:27.888995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659457:2446], now have 1 active actors on pipe
2025-10-02T09:28:27.888997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659623:3179], now have 1 active actors on pipe
2025-10-02T09:28:27.889021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.889031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:27.889042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:27.889082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 115
2025-10-02T09:28:27.889085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 115
2025-10-02T09:28:27.889191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.889204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.889229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e988599f-31439572-bc101b73-e5a945e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:27.889241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:27.889249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:27.889255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:27.889264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:27.889279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:27.889295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.889473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:27.889487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:27.889508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:27.889607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 36 sessionId: src_id|e988599f-31439572-bc101b73-e5a945e3_0
2025-10-02T09:28:27.889932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e59842-f425053f-577ba263-39aa9598_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e988599f-31439572-bc101b73-e5a945e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:27.892903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Write session: try to update token
2025-10-02T09:28:27.892917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:27.899467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:27.899484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:27.899486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:27.899488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:27.899496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.899500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.899504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553895255141305:2966]
2025-10-02T09:28:27.899538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:27.899541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:27.899546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:27.899548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:27.899549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:27.899550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:27.899674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:27.907066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|e988599f-31439572-bc101b73-e5a945e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:27.910261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:27.964016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553895330659634:3101]
2025-10-02T09:28:27.964348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7556553895330659634:3101]
2025-10-02T09:28:28.052068Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:28.052467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.052479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.052493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553895330659634:3101], now have 1 active actors on pipe
2025-10-02T09:28:28.052675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:28.052745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:28.052781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553895330659634:3101]
2025-10-02T09:28:28.052794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:28.052877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e988599f-31439572-bc101b73-e5a945e3_0
2025-10-02T09:28:28.053068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|e988599f-31439572-bc101b73-e5a945e3_0 is DEAD
2025-10-02T09:28:28.053227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:28.053238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Write session will restart in 0.008363s
2025-10-02T09:28:28.053262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Write session: Do CDS request
2025-10-02T09:28:28.053268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:28.062304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.062416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:28.062435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-10-02T09:28:28.062594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.062647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:28.062657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:28.062662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:28.063068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-10-02T09:28:28.063107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:28.063110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:28.063112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:28.063117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553899625627008:3183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:28.063647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553899625627008:3183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:28.065819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553899625627008:3183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:28.066370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:28.067132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:28.067300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:28.067307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:28.067317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:28.067361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:28.067396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553899550108780:2968]
2025-10-02T09:28:28.067883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:28.068137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553899625627008:3183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:28.068152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553899625627008:3183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:28.068155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553899625627008:3183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:28.068162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:28.068165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:28.068228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:28.068559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:28.068622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.068629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.068630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.068631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.068632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.068634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.068635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.068636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.068637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.068639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.068640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.068641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.068647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.068658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.068662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.068666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.068670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.068674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.068677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.068681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.068685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.068690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.068693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.068697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.068703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.068710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.068716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.068721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.068724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.068727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.068730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.068733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.068735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.068739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.068741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.068744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.068746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.068749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.068752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.068755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.068758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.068762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.068764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.068767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.068770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.068773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.068777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.068782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.068833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:28.078246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:28.080130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:28.080151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:28.080155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:28.080159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:28.080167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [2:7556553899550108780:2968]
2025-10-02T09:28:28.080182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:28.080201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:28.080204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.080207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.080210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.080225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:28.080231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:28.080238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:28.080308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.080317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.080319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.080322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:28.080325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:28.080393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:28.080402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.080415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.080430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.080449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:28.080473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627101:3183], now have 1 active actors on pipe
2025-10-02T09:28:28.080482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625626933:2446], now have 1 active actors on pipe
2025-10-02T09:28:28.080488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.080490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.080492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.080503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:28.080523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:28.080522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:28.080526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:28.080528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:28.080541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:28.080544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:28.080580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.080591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:28.080603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:28.080657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 116
2025-10-02T09:28:28.080660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 116
2025-10-02T09:28:28.080762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.080772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.080795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:28.080817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.080821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.080824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:28.080833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.080847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:28.080864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.081218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.081234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.081255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.081432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 36 sessionId: src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0
2025-10-02T09:28:28.081815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e988599f-31439572-bc101b73-e5a945e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:28.085129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Write session: try to update token
2025-10-02T09:28:28.085145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:28.097651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:28.097672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.097681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.097724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:28.097741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:28.097897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:28.098046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.098189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.098327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.098525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:28.098570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:28.101933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:28.103620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:28.103647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.103650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:28.103653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:28.103662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.103667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.103677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553899550108775:2968]
2025-10-02T09:28:28.103723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:28.103729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:28.103735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:28.103738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.103740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:28.103741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:28.104036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:28.105817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:28.156887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553899625627113:3101]
2025-10-02T09:28:28.157197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7556553899625627113:3101]
2025-10-02T09:28:28.250061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:28.250374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.250389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.250405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627113:3101], now have 1 active actors on pipe
2025-10-02T09:28:28.250666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:28.250655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553899625627113:3101]
2025-10-02T09:28:28.250669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:28.250673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:28.250687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:28.250742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: error at write: Disconnected sessionId: src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0
2025-10-02T09:28:28.250923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0 is DEAD
2025-10-02T09:28:28.251065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:28.251075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Write session will restart in 0.008838s
2025-10-02T09:28:28.251099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Write session: Do CDS request
2025-10-02T09:28:28.251106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:28.261294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.261394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:28.261407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-10-02T09:28:28.261510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.261538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:28.261546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:28.261550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:28.261990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-10-02T09:28:28.262028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:28.262038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:28.262040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:28.262045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553899625627246:3188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:28.262535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553899625627246:3188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:28.262694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:28.263525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:28.263693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:28.263702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:28.263711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:28.263751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:28.263784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553899550108953:2971]
2025-10-02T09:28:28.264234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553899625627246:3188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:28.264256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:28.264505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:28.264538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:28.264915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:28.264969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.264975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.264976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.264977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.264978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.264978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.264979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.264981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.264982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.264983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.264984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.264985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.264990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.265000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.265003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.265007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.265011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.265014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.265018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.265021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.265024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.265028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.265032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.265035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.265040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.265046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.265051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.265056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.265060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.265065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.265070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.265080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.265084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.265088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.265092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.265098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.265107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.265112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.265116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.265120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.265124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.265128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.265136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.265140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.265144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.265148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.265151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.265156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.265185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:28.269730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553899625627246:3188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:28.269746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553899625627246:3188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:28.269749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553899625627246:3188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:28.269756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:28.273759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:28.275727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:28.275745Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:28.275747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:28.275751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:28.275758Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [2:7556553899550108953:2971]
2025-10-02T09:28:28.275770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:28.275784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:28.275786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.275788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.275790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.275804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:28.275808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:28.275814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:28.275866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.275871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.275873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.275875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:28.275877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:28.275934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:28.275941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.275952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.275963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.275981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:28.276002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627116:2446], now have 1 active actors on pipe
2025-10-02T09:28:28.276009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627291:3188], now have 1 active actors on pipe
2025-10-02T09:28:28.276014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.276016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.276018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.276028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:28.276040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:28.276046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:28.276049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:28.276051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:28.276059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:28.276062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:28.276090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.276098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:28.276104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:28.276109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 117
2025-10-02T09:28:28.276151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 117
2025-10-02T09:28:28.276489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.276500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.276518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:28.276529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.276536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.276538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:28.276545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.276554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:28.276568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.276767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.276777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.276788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.277139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 36 sessionId: src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0
2025-10-02T09:28:28.277444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9e472e0-1c7fa87b-4efcdee5-3f232af8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:28.280602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Write session: try to update token
2025-10-02T09:28:28.280616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:28.287601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:28.287622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.287630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.287668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:28.287675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:28.287838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:28.287999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.288140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.288288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.288673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:28.288712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:28.296666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:28.297929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:28.297952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.297954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:28.297956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:28.297965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.297969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.297973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553899550108948:2971]
2025-10-02T09:28:28.298012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:28.298017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:28.298023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.298023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:28.298025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:28.298026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:28.298151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:28.299819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:28.351018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553899625627330:3101]
2025-10-02T09:28:28.351294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7556553899625627330:3101]
2025-10-02T09:28:28.442452Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:28.442932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.442948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.442968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627330:3101], now have 1 active actors on pipe
2025-10-02T09:28:28.443224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:28.444048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553899625627330:3101]
2025-10-02T09:28:28.444475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:28.444507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:28.444570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0
2025-10-02T09:28:28.444759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0 is DEAD
2025-10-02T09:28:28.445140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:28.445151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Write session will restart in 0.005033s
2025-10-02T09:28:28.445172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Write session: Do CDS request
2025-10-02T09:28:28.445179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:28.451351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.451481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:28.451497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-10-02T09:28:28.451733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.451768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:28.451776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:28.451779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:28.452285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-10-02T09:28:28.452321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:28.452323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:28.452324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:28.452330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553899625627346:3200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:28.452916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553899625627346:3200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:28.460215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553899625627346:3200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:28.463851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:28.463926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553899625627346:3200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:28.463944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553899625627346:3200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:28.463947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553899625627346:3200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:28.463957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:28.465614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:28.465824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:28.465836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:28.465848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:28.465917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:28.465961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553899550109174:2986]
2025-10-02T09:28:28.466565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:28.466893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:28.466939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:28.467270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:28.467314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.467321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.467322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.467323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.467323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.467324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.467325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.467326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.467327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.467327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.467328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.467329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.467333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.467341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.467343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.467346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.467348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.467351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.467353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.467355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.467357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.467360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.467363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.467365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.467372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.467377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.467380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.467384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.467386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.467389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.467391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.467395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.467398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.467404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.467408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.467412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.467417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.467422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.467426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.467432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.467436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.467443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.467446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.467449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.467451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.467454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.467457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.467460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.467481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:28.477089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:28.479087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:28.479110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:28.479113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:28.479117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:28.479125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [2:7556553899550109174:2986]
2025-10-02T09:28:28.479141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:28.479172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:28.479175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.479177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.479180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.479197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:28.479208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:28.479214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:28.479279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.479287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.479289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.479292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:28.479295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:28.479373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:28.479381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.479395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.479410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.479431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:28.479456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627498:3200], now have 1 active actors on pipe
2025-10-02T09:28:28.479465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627332:2446], now have 1 active actors on pipe
2025-10-02T09:28:28.479471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.479478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.479480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.479495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:28.479512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:28.479513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:28.479523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:28.479525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:28.479528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:28.479531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:28.479568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.479578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:28.479613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:28.479778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 118
2025-10-02T09:28:28.479809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 118
2025-10-02T09:28:28.480247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.480263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.480289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:28.480301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.480309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.480311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:28.480321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.480330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:28.480347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.480584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.480592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.480605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.480703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0
2025-10-02T09:28:28.481102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be13d9b9-7d12ebf2-fde414d3-a7f4d80b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:28.484398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Write session: try to update token
2025-10-02T09:28:28.484416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:28.491052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:28.491073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.491082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.491138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:28.491168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:28.491331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:28.491482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.491623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.491780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:28.491985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:28.492031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:28.506088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:28.506111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.506113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:28.506115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:28.506125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.506129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.506137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553899550109168:2986]
2025-10-02T09:28:28.506184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:28.506190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.506193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:28.502301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:28.506150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:28.506234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:28.506245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:28.506249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:28.506381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:28.544510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553899625627512:3101]
2025-10-02T09:28:28.544825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7556553899625627512:3101]
2025-10-02T09:28:28.662020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:28.662392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.662406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.662419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627512:3101], now have 1 active actors on pipe
2025-10-02T09:28:28.662613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:28.662827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:28.662907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553899625627512:3101]
2025-10-02T09:28:28.662942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:28.662968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0
2025-10-02T09:28:28.663174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0 is DEAD
2025-10-02T09:28:28.663589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:28.663600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Write session will restart in 0.005567s
2025-10-02T09:28:28.663623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Write session: Do CDS request
2025-10-02T09:28:28.663630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:28.670513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.670626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:28.670645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-10-02T09:28:28.670823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.670863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:28.670876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:28.670881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:28.671411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-10-02T09:28:28.671449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:28.671451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:28.671453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:28.671461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553899625627529:3204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:28.672053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553899625627529:3204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:28.674660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553899625627529:3204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:28.678505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553899625627529:3204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:28.678522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553899625627529:3204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:28.678530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553899625627529:3204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:28.678550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:28.678047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:28.679030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:28.679207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:28.679211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:28.679222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:28.679289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:28.679322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553899550109347:2988]
2025-10-02T09:28:28.679887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:28.680245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:28.680295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:28.680605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:28.680753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.680761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.680762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.680763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.680764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.680765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.680766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.680767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.680768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.680769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.680770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.680771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.680777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.680787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.680790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.680793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.680796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.680799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.680817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.680820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.680823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.680827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.680830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.680834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.680842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.680849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.680855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.680860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.680866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.680870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.680874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.680879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.680883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.680887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.680891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.680897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.680901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.680905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.680908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.680912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.680923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.680927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.680931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.680935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.680939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.680943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.680947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.680951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.680985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:28.689994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:28.692125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:28.692142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:28.692145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:28.692149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:28.692156Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [2:7556553899550109347:2988]
2025-10-02T09:28:28.692171Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:28.692188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:28.692192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.692195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.692200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.692216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:28.692221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:28.692228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:28.692291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.692300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.692302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.692306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:28.692308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:28.692374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:28.692382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.692396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.692408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.692428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:28.692450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.692458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.692460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.692473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:28.692486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:28.692501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:28.692507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:28.692541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.692548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:28.693218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:28.693230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:28.693232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:28.693238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:28.693491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627514:2446], now have 1 active actors on pipe
2025-10-02T09:28:28.693506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627684:3204], now have 1 active actors on pipe
2025-10-02T09:28:28.693586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 119
2025-10-02T09:28:28.693632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 119
2025-10-02T09:28:28.693865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.693878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.693902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:28.693911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.693916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.693918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:28.693929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.693939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:28.693953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.694160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.694171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.694192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.694293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 36 sessionId: src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0
2025-10-02T09:28:28.694729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0697f9-49947d75-a3c1a494-8504ca8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:28.697934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Write session: try to update token
2025-10-02T09:28:28.697957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:28.707883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:28.707904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.707906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:28.707909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:28.707917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.707921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.707924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553899550109340:2988]
2025-10-02T09:28:28.707962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:28.707968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.707970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:28.708113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:28.710148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:28.710163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:28.710166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:28.722926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:28.726209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:28.763364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553899625627705:3101]
2025-10-02T09:28:28.763635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7556553899625627705:3101]
2025-10-02T09:28:28.871064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:28.871460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.871476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.871493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627705:3101], now have 1 active actors on pipe
2025-10-02T09:28:28.871714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:28.871722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553899625627705:3101]
2025-10-02T09:28:28.871748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:28.871754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:28.871756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:28.871801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: error at write: Disconnected sessionId: src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0
2025-10-02T09:28:28.871960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0 is DEAD
2025-10-02T09:28:28.872180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:28.872191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Write session will restart in 0.006427s
2025-10-02T09:28:28.872215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Write session: Do CDS request
2025-10-02T09:28:28.872221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:28.879396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.879519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:28.879537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-10-02T09:28:28.879707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:28.879770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:28.879781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:28.879786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:28.880358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-10-02T09:28:28.880396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:28.880405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:28.880407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:28.880413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553899625627726:3209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:28.880946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553899625627726:3209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:28.883720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553899625627726:3209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:28.885940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:28.886803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:28.886976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:28.886986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:28.886995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:28.887046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:28.887051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553899625627726:3209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:28.887065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553899625627726:3209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:28.887069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553899625627726:3209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:28.887085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:28.887112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553899550109522:2991]
2025-10-02T09:28:28.887707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:28.888012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:28.888056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:28.888360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:28.888418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.888423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.888425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.888425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.888426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.888427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.888429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.888430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.888431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.888432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.888433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.888434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.888439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.888449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.888453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.888457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.888461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.888465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.888469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.888473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.888476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.888481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.888484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.888488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.888493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.888501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:28.888506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.888511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:28.888516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.888521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:28.888525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.888530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:28.888537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.888542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:28.888546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.888551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:28.888556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.888561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:28.888565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.888570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:28.888575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.888585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:28.888589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.888594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.888598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.888604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.888612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.888617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.888653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:28.897125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:28.898972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:28.898988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:28.898990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:28.898993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:28.898998Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [2:7556553899550109522:2991]
2025-10-02T09:28:28.899011Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:28.899025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:28.899032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.899034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.899036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.899048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:28.899052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:28.899059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:28.899099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.899107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.899109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.899112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:28.899114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:28.899185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:28.899192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.899203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:28.899217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:28.899237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:28.899259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627882:3209], now have 1 active actors on pipe
2025-10-02T09:28:28.899266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627711:2446], now have 1 active actors on pipe
2025-10-02T09:28:28.899271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.899273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.899274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.899286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:28.899299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:28.899300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:28.899303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:28.899305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:28.899316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:28.899318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:28.899345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.899356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:28.899363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:28.899337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 120
2025-10-02T09:28:28.899341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 120
2025-10-02T09:28:28.899441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.899450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.899470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:28.899475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:28.899478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:28.899481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:28.899489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:28.899497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:28.899508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.899658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:28.899666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:28.899679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:28.899754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0
2025-10-02T09:28:28.900098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e9a2ac-b60f5918-6c9facb2-5c4367ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:28.903164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Write session: try to update token
2025-10-02T09:28:28.903182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:28.909823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:28.909843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:28.909845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:28.909847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:28.909856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.909860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.909863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553899550109517:2991]
2025-10-02T09:28:28.909903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:28.909909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:28.909914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:28.910058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:28.910610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:28.910624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:28.910628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:28.917331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:28.920076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:28.972129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553899625627893:3101]
2025-10-02T09:28:28.972397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7556553899625627893:3101]
2025-10-02T09:28:29.048770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:29.049136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.049148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.049165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553899625627893:3101], now have 1 active actors on pipe
2025-10-02T09:28:29.049385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:29.049410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:29.049410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:29.049416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:29.049469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553899625627893:3101]
2025-10-02T09:28:29.049479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: error at write: Disconnected sessionId: src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0
2025-10-02T09:28:29.049643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0 is DEAD
2025-10-02T09:28:29.049788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:29.049796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Write session will restart in 0.009766s
2025-10-02T09:28:29.049811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Write session: Do CDS request
2025-10-02T09:28:29.049815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:29.060347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.060484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:29.060500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-10-02T09:28:29.060655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.060684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:29.060693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:29.060698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:29.061264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-10-02T09:28:29.061318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:29.061321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:29.061323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:29.061329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553903920595326:3213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:29.061893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553903920595326:3213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:29.062011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:29.062906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:29.063174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:29.063184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:29.063194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:29.063249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:29.063287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553903845076993:2993]
2025-10-02T09:28:29.063860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:29.064156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553903920595326:3213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:29.064195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:29.064256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:29.064592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:29.064661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.064667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.064668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.064669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.064670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.064671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.064672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.064673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.064674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.064675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.064676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.064677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.064683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.064694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.064698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.064702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.064706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.064710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.064714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.064717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.064721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.064725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.064730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.064733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.064740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.064747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.064753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.064758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.064762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.064766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.064770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.064775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.064785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.064790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.064794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.064799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.064825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.064830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.064840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.064845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.064854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.064859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.064863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.064867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.064875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.064879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.064883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.064888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.064918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:29.070578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553903920595326:3213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:29.070592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553903920595326:3213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:29.070594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553903920595326:3213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:29.070600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:29.073528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:29.075315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:29.075332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:29.075334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:29.075338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:29.075344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [2:7556553903845076993:2993]
2025-10-02T09:28:29.075357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:29.075373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:29.075376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.075379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.075381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.075393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:29.075398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:29.075406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:29.075466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.075474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.075476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.075479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:29.075481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:29.075543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:29.075549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.075564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.075579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.075593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:29.075611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595192:2446], now have 1 active actors on pipe
2025-10-02T09:28:29.075619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595368:3213], now have 1 active actors on pipe
2025-10-02T09:28:29.075625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.075627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.075629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.075646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:29.075662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:29.075670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:29.075674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:29.075677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:29.075681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:29.075684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:29.075674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 121
2025-10-02T09:28:29.075714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.075721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:29.075699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 121
2025-10-02T09:28:29.075733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:29.075753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.075757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.075781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:29.075791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.075795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.075801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:29.075809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.075820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:29.075835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.075952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.075960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.075970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.076058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0
2025-10-02T09:28:29.076415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbd8dfd-df227c3a-f91bbe25-96c38511_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:29.079624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Write session: try to update token
2025-10-02T09:28:29.079642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:29.085801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:29.085817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.085826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.085873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:29.085878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:29.086037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:29.086172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.086305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.086436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.086645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:29.086693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:29.093955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:29.095647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:29.095668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.095670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:29.095671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:29.095682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.095686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.095689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553903845076988:2993]
2025-10-02T09:28:29.095727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:29.095733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.095732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:29.095735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:29.095737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:29.095740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:29.095896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:29.097288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:29.152883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553903920595377:3101]
2025-10-02T09:28:29.153197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7556553903920595377:3101]
2025-10-02T09:28:29.243136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:29.243460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.243475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.243490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595377:3101], now have 1 active actors on pipe
2025-10-02T09:28:29.243699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:29.243708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:29.243720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553903920595377:3101]
2025-10-02T09:28:29.243722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:29.243740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:29.243784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: error at write: Disconnected sessionId: src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0
2025-10-02T09:28:29.243962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0 is DEAD
2025-10-02T09:28:29.244356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:29.244368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Write session will restart in 0.008753s
2025-10-02T09:28:29.244405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Write session: Do CDS request
2025-10-02T09:28:29.244411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:29.255129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.255524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:29.255541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-10-02T09:28:29.255688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.255725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:29.255734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:29.255738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:29.256264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-10-02T09:28:29.256310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:29.256318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:29.256320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:29.256326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553903920595395:3218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:29.256922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553903920595395:3218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:29.259169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553903920595395:3218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:29.263649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553903920595395:3218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:29.263668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553903920595395:3218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:29.263685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553903920595395:3218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:29.263711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:29.266519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:29.267742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:29.267938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:29.267947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:29.267956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:29.268000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:29.268039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553903845077173:2996]
2025-10-02T09:28:29.268618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:29.269002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:29.269062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:29.269433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:29.269515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.269525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.269526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.269527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.269528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.269529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.269530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.269531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.269532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.269533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.269534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.269535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.269541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.269552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.269556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.269560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.269563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.269567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.269570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.269574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.269577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.269582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.269585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.269589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.269595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.269602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.269608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.269612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.269617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.269622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.269626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.269631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.269636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.269641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.269644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.269648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.269653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.269658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.269664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.269669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.269674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.269679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.269683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.269689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.269693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.269698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.269702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.269707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.269747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:29.280366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:29.282512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:29.282535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:29.282537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:29.282540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:29.282546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [2:7556553903845077173:2996]
2025-10-02T09:28:29.282558Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:29.282574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:29.282576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.282591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.282593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.282607Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:29.282612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:29.282618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:29.282679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.282687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.282690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.282693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:29.282695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:29.282760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:29.282768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.282780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.282790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.282804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:29.282821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595380:2446], now have 1 active actors on pipe
2025-10-02T09:28:29.282827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.282828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.282831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.282837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:29.282845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595518:3218], now have 1 active actors on pipe
2025-10-02T09:28:29.282967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 122
2025-10-02T09:28:29.282971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 122
2025-10-02T09:28:29.282850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:29.282851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:29.282853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:29.282855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:29.282864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:29.282867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:29.282895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.282902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:29.282927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:29.283194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.283209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.283234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:29.283246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.283250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.283257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:29.283266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.283277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:29.283296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.283501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.283512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.283529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.283650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0
2025-10-02T09:28:29.284062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a2c2ce9-92fb4518-3414c548-aa1fa7e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:29.287253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Write session: try to update token
2025-10-02T09:28:29.287273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:29.295017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:29.295037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.295040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:29.295042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:29.295050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.295054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.295058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553903845077168:2996]
2025-10-02T09:28:29.295099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:29.295102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:29.295103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:29.295106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:29.295112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.295115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:29.295279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:29.310265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:29.312984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:29.338160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553903920595589:3101]
2025-10-02T09:28:29.338428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7556553903920595589:3101]
2025-10-02T09:28:29.445622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:29.445901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.445913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.445926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595589:3101], now have 1 active actors on pipe
2025-10-02T09:28:29.446129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:29.446168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:29.446180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:29.446208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553903920595589:3101]
2025-10-02T09:28:29.446228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:29.446248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: error at write: Disconnected sessionId: src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0
2025-10-02T09:28:29.446393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0 is DEAD
2025-10-02T09:28:29.446581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:29.446593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Write session will restart in 0.005279s
2025-10-02T09:28:29.446621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Write session: Do CDS request
2025-10-02T09:28:29.446627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:29.453315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.453424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:29.453438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-10-02T09:28:29.453583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.453607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:29.453614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:29.453624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:29.454056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-10-02T09:28:29.454095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:29.454097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:29.454098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:29.454105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553903920595618:3230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:29.454631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553903920595618:3230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:29.457794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553903920595618:3230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:29.460225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:29.460697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553903920595618:3230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:29.460708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553903920595618:3230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:29.460711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553903920595618:3230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:29.460744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:29.461231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:29.461389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:29.461401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:29.461410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:29.461445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:29.461478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553903845077400:3011]
2025-10-02T09:28:29.461941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:29.462213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:29.462248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:29.462487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:29.462533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.462540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.462541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.462541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.462542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.462543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.462544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.462544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.462545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.462545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.462546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.462547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.462552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.462563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.462567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.462572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.462575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.462578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.462581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.462583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.462585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.462588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.462590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.462592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.462597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.462602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.462606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.462609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.462612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.462615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.462619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.462622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.462625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.462628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.462631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.462634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.462636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.462640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.462642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.462645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.462648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.462659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.462662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.462665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.462668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.462672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.462674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.462677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.462698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:29.471594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:29.473702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:29.473722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:29.473725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:29.473728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:29.473735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [2:7556553903845077400:3011]
2025-10-02T09:28:29.473748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:29.473764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:29.473767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.473770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.473777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.473791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:29.473800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:29.473807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:29.473872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.473879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.473881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.473886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:29.473888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:29.473957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:29.473964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.473977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.473993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.474009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:29.474029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.474034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.474036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.474048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:29.474064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595601:2446], now have 1 active actors on pipe
2025-10-02T09:28:29.474065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:29.474069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:29.474072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:29.474073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595775:3230], now have 1 active actors on pipe
2025-10-02T09:28:29.474080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:29.474093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:29.474100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:29.474134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.474142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:29.474117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 123
2025-10-02T09:28:29.474133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 123
2025-10-02T09:28:29.474153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:29.474180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.474188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.474209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b638c88c-ebafdb0e-53671c08-5367ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:29.474218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.474221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.474223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:29.474230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.474237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:29.474249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.474413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.474420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.474431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.474523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 36 sessionId: src_id|b638c88c-ebafdb0e-53671c08-5367ec_0
2025-10-02T09:28:29.474886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4e8964-8f43605b-42e704f3-cd11b2bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b638c88c-ebafdb0e-53671c08-5367ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:29.477748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Write session: try to update token
2025-10-02T09:28:29.477763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:29.484396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:29.484415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.484423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.484463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:29.484481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:29.484626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:29.484765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.484912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.485046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.485244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:29.485285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:29.491763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|b638c88c-ebafdb0e-53671c08-5367ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:29.493861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:29.493881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.493883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:29.493885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:29.493893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.493897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.493900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553903845077394:3011]
2025-10-02T09:28:29.493932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:29.493938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.493940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:29.493949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:29.493956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:29.493960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:29.494073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:29.494508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:29.546543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553903920595787:3101]
2025-10-02T09:28:29.546810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7556553903920595787:3101]
2025-10-02T09:28:29.621323Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:29.621608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.621619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.621634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595787:3101], now have 1 active actors on pipe
2025-10-02T09:28:29.621840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:29.621929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:29.621932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553903920595787:3101]
2025-10-02T09:28:29.621952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:29.622013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b638c88c-ebafdb0e-53671c08-5367ec_0
2025-10-02T09:28:29.622165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|b638c88c-ebafdb0e-53671c08-5367ec_0 is DEAD
2025-10-02T09:28:29.622313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:29.622322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Write session will restart in 0.009577s
2025-10-02T09:28:29.622342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Write session: Do CDS request
2025-10-02T09:28:29.622350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:29.633195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.633334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:29.633347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-10-02T09:28:29.633443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.633467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:29.633470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:29.633474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:29.633870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-10-02T09:28:29.633904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:29.633910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:29.633912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:29.633916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553903920595927:3234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:29.634375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:29.634414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553903920595927:3234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:29.635096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:29.635265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:29.635274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:29.635284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:29.635339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:29.635374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553903845077578:3013]
2025-10-02T09:28:29.635957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:29.636238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:29.636276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:29.636572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:29.636621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.636627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.636628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.636629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.636630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.636631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.636632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.636633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.636634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.636635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.636636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.636637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.636641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.636651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.636654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.636658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.636662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.636666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.636669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.636673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.636677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.636681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.636684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.636688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.636694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.636700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.636706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.636711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.636715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.636719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.636723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.636728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.636732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.636737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.636741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.636746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.636750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.636756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.636764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.636769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.636772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.636777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.636781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.636786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.636789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.636794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.636797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.636822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.636854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:29.636861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553903920595927:3234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:29.642464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553903920595927:3234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:29.642480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553903920595927:3234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:29.642484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553903920595927:3234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:29.642494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:29.645191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:29.647211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:29.647226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:29.647228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:29.647232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:29.647238Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [2:7556553903845077578:3013]
2025-10-02T09:28:29.647252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:29.647267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:29.647270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.647273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.647275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.647288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:29.647298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:29.647304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:29.647356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.647361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.647363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.647366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:29.647368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:29.647428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:29.647441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.647453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.647463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.647478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:29.647499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595968:3234], now have 1 active actors on pipe
2025-10-02T09:28:29.647507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595788:2446], now have 1 active actors on pipe
2025-10-02T09:28:29.647512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.647515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.647517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.647527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:29.647542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:29.647545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:29.647549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:29.647551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:29.647560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:29.647562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:29.647592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.647602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:29.647612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:29.647601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 124
2025-10-02T09:28:29.647605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 124
2025-10-02T09:28:29.647658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.647670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.647692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:29.647697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.647701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.647703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:29.647710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.647723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:29.647734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.647870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.647878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.647892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.648407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 36 sessionId: src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0
2025-10-02T09:28:29.648830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b638c88c-ebafdb0e-53671c08-5367ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:29.651794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Write session: try to update token
2025-10-02T09:28:29.651813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:29.657585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:29.657605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.657613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.657651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:29.657651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:29.657810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:29.657973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.658097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.658233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.658422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:29.658458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:29.667428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:29.667449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.667451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:29.667453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:29.667463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.667467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.667471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553903845077573:3013]
2025-10-02T09:28:29.667509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:29.667509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:29.667514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:29.667514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.667517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:29.667527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:29.667653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:29.667761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:29.670650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:29.724891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553903920595983:3101]
2025-10-02T09:28:29.725961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7556553903920595983:3101]
2025-10-02T09:28:29.817750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:29.818047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.818064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.818082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595983:3101], now have 1 active actors on pipe
2025-10-02T09:28:29.818710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:29.818726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:29.818784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: error at write: Disconnected sessionId: src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0
2025-10-02T09:28:29.818957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0 is DEAD
2025-10-02T09:28:29.819116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:29.819130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Write session will restart in 0.007471s
2025-10-02T09:28:29.819165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Write session: Do CDS request
2025-10-02T09:28:29.819180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:29.818485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:29.819106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553903920595983:3101]
2025-10-02T09:28:29.819125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:29.828312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.828404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:29.828420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-10-02T09:28:29.828602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:29.828663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:29.828675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:29.828681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:29.829201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-10-02T09:28:29.829247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:29.829251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:29.829253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:29.829259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553903920596045:3239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:29.829809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553903920596045:3239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:29.832131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553903920596045:3239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:29.834482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:29.835480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:29.835702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:29.835693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553903920596045:3239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:29.835711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553903920596045:3239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:29.835713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:29.835715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553903920596045:3239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:29.835743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:29.835723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:29.835775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:29.835813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553903845077761:3016]
2025-10-02T09:28:29.836469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:29.836838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:29.836900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:29.837237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:29.837289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.837290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.837291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.837292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.837293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.837294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.837296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.837297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.837298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.837299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.837300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.837301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.837306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.837316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.837320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.837325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.837329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.837333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.837336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.837340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.837344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.837348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.837352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.837355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.837373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.837380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:29.837386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:29.837396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.837401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:29.837404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.837409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:29.837413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.837419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:29.837423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.837429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:29.837434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.837439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:29.837443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.837448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:29.837455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.837460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:29.837464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.837469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.837474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.837479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.837483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.837488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.837530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:29.849682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:29.851785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:29.851802Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:29.851805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:29.851809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:29.851815Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [2:7556553903845077761:3016]
2025-10-02T09:28:29.851830Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:29.851846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:29.851849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.851852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.851854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.851872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:29.851877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:29.851884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:29.851946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.851955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.851957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.851961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:29.851964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:29.852288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 125
2025-10-02T09:28:29.852342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 125
2025-10-02T09:28:29.852030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:29.852040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.852053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:29.852065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:29.852083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:29.852114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920595993:2446], now have 1 active actors on pipe
2025-10-02T09:28:29.852118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920596168:3239], now have 1 active actors on pipe
2025-10-02T09:28:29.852124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.852126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.852129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.852142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:29.852154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:29.852158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:29.852161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:29.852163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:29.852169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:29.852173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:29.852206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.852214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:29.852226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:29.854731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.854749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.854776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e8ea8fe-768dc4a2-76728990-66439936_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:29.854790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:29.854794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:29.854797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:29.854808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:29.854821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:29.854841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.855747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:29.855759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:29.855777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:29.855915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e8ea8fe-768dc4a2-76728990-66439936_0
2025-10-02T09:28:29.856390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf027de-ada96ae5-e6c79ed9-a99abcbe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e8ea8fe-768dc4a2-76728990-66439936_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:29.860406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Write session: try to update token
2025-10-02T09:28:29.860425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:29.867105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:29.867127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.867139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.867193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:29.867286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:29.867377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:29.867614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.867761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.867906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:29.868099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:29.868135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:29.880713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:29.880735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:29.880738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:29.880740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:29.880750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.880754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.880758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553903845077756:3016]
2025-10-02T09:28:29.880817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:29.880819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:29.880823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:29.880826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:29.880828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:29.880829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:29.883473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|1e8ea8fe-768dc4a2-76728990-66439936_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:29.880987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:29.886048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:29.919289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553903920596180:3101]
2025-10-02T09:28:29.921719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7556553903920596180:3101]
2025-10-02T09:28:30.027986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:30.028521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.028535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.028553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553903920596180:3101], now have 1 active actors on pipe
2025-10-02T09:28:30.028707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:30.028723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:30.028758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:30.028784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|1e8ea8fe-768dc4a2-76728990-66439936_0
2025-10-02T09:28:30.028787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553903920596180:3101]
2025-10-02T09:28:30.028831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:30.028960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|1e8ea8fe-768dc4a2-76728990-66439936_0 is DEAD
2025-10-02T09:28:30.029130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:30.029145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Write session will restart in 0.008251s
2025-10-02T09:28:30.029177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Write session: Do CDS request
2025-10-02T09:28:30.029184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:30.038499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.038492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:30.038508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-10-02T09:28:30.038781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.038813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:30.038824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:30.038829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:30.039329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-10-02T09:28:30.039368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:30.039378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:30.039379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:30.039385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553908215563551:3243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:30.039945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553908215563551:3243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:30.042147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553908215563551:3243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:30.042540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:30.043487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:30.043666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:30.043678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:30.043688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:30.043747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:30.043888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553908140045239:3018]
2025-10-02T09:28:30.044409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:30.044615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553908215563551:3243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:30.044636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553908215563551:3243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:30.044640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553908215563551:3243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:30.044650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:30.044712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:30.044766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:30.045065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:30.045123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.045129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.045130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.045131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.045132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.045133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.045134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.045135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.045136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.045137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.045139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.045140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.045146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.045157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.045162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.045166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.045170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.045173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.045177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.045181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.045185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.045190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.045194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.045199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.045205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.045212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.045221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.045231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.045236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.045243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.045249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.045258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.045263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.045272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.045277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.045285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.045296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.045303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.045309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.045318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.045323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.045333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.045341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.045348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.045356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.045360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.045368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.045404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:30.055305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:30.057395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:30.057416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:30.057419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:30.057423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:30.057429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [2:7556553908140045239:3018]
2025-10-02T09:28:30.057445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:30.057462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:30.057466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.057470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.057472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.057487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:30.057498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:30.057505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:30.057570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.057577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.057579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.057582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:30.057585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:30.057738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:30.057750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.057764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.057776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.057781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 126
2025-10-02T09:28:30.057799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:30.057790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 126
2025-10-02T09:28:30.057825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563479:2446], now have 1 active actors on pipe
2025-10-02T09:28:30.057828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563657:3243], now have 1 active actors on pipe
2025-10-02T09:28:30.057834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.057836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.057837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.057851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:30.057864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:30.057866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:30.057869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:30.057875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.057879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.057893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:30.057908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:30.057919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:30.057963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:30.057974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.057978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.057980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:30.057990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.058002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:30.058013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.058024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:30.058030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:30.058047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.058375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.058389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.058410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.058666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0
2025-10-02T09:28:30.059140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8ea8fe-768dc4a2-76728990-66439936_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:30.062369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Write session: try to update token
2025-10-02T09:28:30.062385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:30.068649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:30.068665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.068673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.068709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:30.068712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:30.068887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:30.069028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:30.069166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:30.069292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:30.069483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:30.069526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:30.076962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:30.078380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:30.078398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.078400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:30.078402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:30.078408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.078415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.078418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553908140045234:3018]
2025-10-02T09:28:30.078456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:30.078462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:30.078463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.078465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:30.078467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:30.078471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:30.078688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:30.079995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:30.129232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553908215563669:3101]
2025-10-02T09:28:30.129669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7556553908215563669:3101]
2025-10-02T09:28:30.222174Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:30.222526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.222541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.222559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563669:3101], now have 1 active actors on pipe
2025-10-02T09:28:30.222786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:30.222779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:30.222796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:30.222802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553908215563669:3101]
2025-10-02T09:28:30.222856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: error at write: Disconnected sessionId: src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0
2025-10-02T09:28:30.222913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:30.223031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0 is DEAD
2025-10-02T09:28:30.223180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:30.223189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Write session will restart in 0.008077s
2025-10-02T09:28:30.223214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Write session: Do CDS request
2025-10-02T09:28:30.223221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:30.232381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.232515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:30.232532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-10-02T09:28:30.232701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.232741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:30.232757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:30.232763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:30.233270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-10-02T09:28:30.233317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:30.233319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:30.233320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:30.233326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553908215563776:3248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:30.233995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553908215563776:3248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:30.236014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:30.236452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553908215563776:3248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:30.237029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:30.237304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:30.237315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:30.237325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:30.237386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:30.237441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553908140045426:3021]
2025-10-02T09:28:30.238047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:30.238401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:30.238463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:30.238783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:30.238857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.238863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.238864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.238865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.238866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.238867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.238868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.238868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.238869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.238871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.238872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.238872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.238878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.238888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.238892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.238895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.238899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.238902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.238906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.238910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.238913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.238917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.238920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.238923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.238930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.238938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.238943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.238949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.238953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.238958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.238962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.238968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.238973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.238977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.238981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.238986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.238991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.238996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.239000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.239005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.239014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.239019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.239029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.239034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.239037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.239042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.239048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.239053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.239091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:30.239542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553908215563776:3248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:30.239561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553908215563776:3248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:30.239564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553908215563776:3248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:30.239572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:30.248381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:30.250349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:30.250369Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:30.250372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:30.250375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:30.250383Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [2:7556553908140045426:3021]
2025-10-02T09:28:30.250398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:30.250414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:30.250417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.250419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.250421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.250435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:30.250449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:30.250455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:30.250516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.250526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.250528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.250531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:30.250533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:30.250607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:30.250615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.250628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.250644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.250665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:30.250686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.250693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.250695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.250707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:30.250720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:30.250736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:30.250743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:30.250775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.250782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:30.250862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:30.250873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:30.250875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:30.250880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:30.250880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563859:3248], now have 1 active actors on pipe
2025-10-02T09:28:30.250888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563677:2446], now have 1 active actors on pipe
2025-10-02T09:28:30.250975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 127
2025-10-02T09:28:30.251013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 127
2025-10-02T09:28:30.251150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.251167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.251189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a152bcec-6fc65990-c3af14e2-399752b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:30.251201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.251206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.251209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:30.251218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.251233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:30.251249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.251430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.251438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.251451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.251533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 36 sessionId: src_id|a152bcec-6fc65990-c3af14e2-399752b3_0
2025-10-02T09:28:30.251864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce1662b-83143ef1-64fbfa3a-39e103dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a152bcec-6fc65990-c3af14e2-399752b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:30.255020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Write session: try to update token
2025-10-02T09:28:30.255037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:30.262858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:30.262881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.262883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:30.262886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:30.262897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.262902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.262907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553908140045421:3021]
2025-10-02T09:28:30.262948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:30.262955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.262957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:30.262959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:30.262965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:30.262971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:30.263118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:30.276751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|a152bcec-6fc65990-c3af14e2-399752b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:30.279869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:30.323186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553908215563878:3101]
2025-10-02T09:28:30.323602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7556553908215563878:3101]
2025-10-02T09:28:30.412106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:30.412452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.412465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.412483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563878:3101], now have 1 active actors on pipe
2025-10-02T09:28:30.412929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:30.412996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553908215563878:3101]
2025-10-02T09:28:30.413041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:30.413043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:30.413113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: error at write: Disconnected sessionId: src_id|a152bcec-6fc65990-c3af14e2-399752b3_0
2025-10-02T09:28:30.413305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|a152bcec-6fc65990-c3af14e2-399752b3_0 is DEAD
2025-10-02T09:28:30.413459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:30.416995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:30.417006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Write session will restart in 0.006661s
2025-10-02T09:28:30.417028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Write session: Do CDS request
2025-10-02T09:28:30.417034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:30.429231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.431721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:30.432838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:30.432863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-10-02T09:28:30.433020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:30.433243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:30.433248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:30.433260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:30.433324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:30.433376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553908140045657:3034]
2025-10-02T09:28:30.433946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:30.434276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:30.434320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:30.434667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:30.434718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.434719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.434720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.434721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.434722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.434724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.434724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.434726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.434727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.434728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.434729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.434730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.434735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.434745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.434749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.434753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.434757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.434761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.434764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.434768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.434771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.434775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.434779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.434783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.434789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.434797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.434802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.434807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.434811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.434816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.434821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.434825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.434830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.434835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.434840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.434845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.434850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.434855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.434859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.434865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.434869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.434874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.434879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.434884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.434891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.434896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.434900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.434905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.434939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:30.436942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.436997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:30.437002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:30.437007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:30.440433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-10-02T09:28:30.440484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:30.440492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:30.440493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:30.440501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553908215564054:3260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:30.441101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553908215564054:3260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:30.445318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553908215564054:3260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:30.446532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:30.448729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:30.448752Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:30.448755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:30.448759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:30.448765Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [2:7556553908140045657:3034]
2025-10-02T09:28:30.448780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:30.448799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:30.448887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.448890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.448892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.448909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:30.448915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:30.448921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:30.448994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.448996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.448998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.449001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:30.449004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:30.449077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:30.449080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.449094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.449106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.449122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:30.449139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.449141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.449143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.449151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:30.449165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:30.449168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:30.449171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:30.449173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:30.449178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:30.449180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:30.449190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215563894:2446], now have 1 active actors on pipe
2025-10-02T09:28:30.449235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.449244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:30.449258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:30.449348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 128
2025-10-02T09:28:30.450460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553908215564054:3260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:30.450489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553908215564054:3260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:30.450494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553908215564054:3260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:30.450507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:30.451063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564086:3260], now have 1 active actors on pipe
2025-10-02T09:28:30.452917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 128
2025-10-02T09:28:30.453024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.453041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.453070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:30.453087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.453092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.453096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:30.453109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.453135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:30.453152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.456367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.456393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.456429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.456571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0
2025-10-02T09:28:30.457076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a152bcec-6fc65990-c3af14e2-399752b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:30.460096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Write session: try to update token
2025-10-02T09:28:30.460117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:30.466096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:30.466113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.466123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.466166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:30.466174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:30.466352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:30.466504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:30.466648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:30.466795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:30.467018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:30.467070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:30.478061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:30.478081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.478084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:30.478087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:30.478095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.478099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.478104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553908140045652:3034]
2025-10-02T09:28:30.478139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:30.478146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.478148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:30.478149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:30.478158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:30.478162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:30.478282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:30.481598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:30.484550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:30.513249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553908215564092:3101]
2025-10-02T09:28:30.513562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7556553908215564092:3101]
2025-10-02T09:28:30.638131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:30.638684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.638704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.638722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564092:3101], now have 1 active actors on pipe
2025-10-02T09:28:30.638935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:30.639451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:30.639011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:30.639468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Write session will restart in 0.005182s
2025-10-02T09:28:30.639011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553908215564092:3101]
2025-10-02T09:28:30.639031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:30.639091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0
2025-10-02T09:28:30.639262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0 is DEAD
2025-10-02T09:28:30.639496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Write session: Do CDS request
2025-10-02T09:28:30.639503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:30.646391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.646522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:30.646539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-10-02T09:28:30.646782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.646844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:30.646858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:30.646864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:30.647323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-10-02T09:28:30.647367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:30.647373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:30.647375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:30.647380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553908215564138:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:30.647940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553908215564138:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:30.650910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553908215564138:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:30.651517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:30.652370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:30.652555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:30.652567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:30.652576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:30.652642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:30.652680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553908140045842:3038]
2025-10-02T09:28:30.653265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553908215564138:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:30.653281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553908215564138:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:30.653285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553908215564138:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:30.653296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:30.653304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:30.653590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:30.653638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:30.653944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:30.654019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.654030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.654031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.654032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.654033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.654034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.654034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.654036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.654037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.654038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.654039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.654040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.654046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.654055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.654059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.654063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.654066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.654070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.654074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.654077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.654080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.654085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.654088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.654092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.654099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.654107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.654112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.654118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.654122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.654127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.654132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.654138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.654142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.654147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.654151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.654156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.654165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.654170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.654175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.654185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.654190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.654194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.654198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.654203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.654208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.654213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.654217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.654222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.654263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:30.663272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:30.665040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:30.665058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:30.665061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:30.665065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:30.665072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [2:7556553908140045842:3038]
2025-10-02T09:28:30.665086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:30.665105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:30.665108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.665111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.665113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.665128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:30.665134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:30.665141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:30.665199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.665209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.665211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.665214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:30.665216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:30.665290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:30.665299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.665311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.665325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.665343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:30.665366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564275:3264], now have 1 active actors on pipe
2025-10-02T09:28:30.665374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564095:2446], now have 1 active actors on pipe
2025-10-02T09:28:30.665383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.665385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.665387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.665400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:30.665413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:30.665422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:30.665425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:30.665426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:30.665428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:30.665429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:30.665467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.665473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:30.665455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 129
2025-10-02T09:28:30.665520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 129
2025-10-02T09:28:30.665513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:30.665590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.665605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.665641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:30.665651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.665655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.665658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:30.665671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.665686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:30.665700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.665892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.665911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.665938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.666054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 36 sessionId: src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0
2025-10-02T09:28:30.666453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b468ba4-c370be94-e477eb00-6c49d3fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:30.669366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Write session: try to update token
2025-10-02T09:28:30.669389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:30.676971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:30.676993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.676995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:30.676998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:30.677006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.677012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.677015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553908140045837:3038]
2025-10-02T09:28:30.677052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:30.677056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:30.677062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:30.677065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.677066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:30.677068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:30.677220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:30.692263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:30.695435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:30.739008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553908215564292:3101]
2025-10-02T09:28:30.739478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7556553908215564292:3101]
2025-10-02T09:28:30.829981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:30.830454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.830469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.830486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564292:3101], now have 1 active actors on pipe
2025-10-02T09:28:30.830704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:30.831348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:30.831359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Write session will restart in 0.006498s
2025-10-02T09:28:30.831381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Write session: Do CDS request
2025-10-02T09:28:30.831388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:30.830799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:30.830926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0
2025-10-02T09:28:30.831099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0 is DEAD
2025-10-02T09:28:30.831253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:30.831283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553908215564292:3101]
2025-10-02T09:28:30.839393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.839561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:30.839577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-10-02T09:28:30.839757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:30.839813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:30.839824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:30.839829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:30.840319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-10-02T09:28:30.840353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:30.840355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:30.840356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:30.840362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553908215564346:3269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:30.840919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553908215564346:3269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:30.843444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553908215564346:3269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:30.848259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:30.848547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553908215564346:3269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:30.848566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553908215564346:3269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:30.848571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553908215564346:3269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:30.848587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:30.851485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:30.851717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:30.851726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:30.851736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:30.851791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:30.851833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553908140046031:3041]
2025-10-02T09:28:30.852415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:30.852879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:30.852937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:30.853287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:30.853365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.853373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.853374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.853376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.853377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.853378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.853379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.853380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.853382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.853383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.853384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.853385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.853391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.853401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.853404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.853409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.853413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.853416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.853420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.853425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.853429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.853433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.853437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.853441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.853447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.853455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:30.853461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.853467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:30.853471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.853477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:30.853481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.853486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:30.853492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.853497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:30.853501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.853507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:30.853512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.853518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:30.853522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.853527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:30.853532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.853537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:30.853543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.853548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.853553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.853558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.853562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.853568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.853602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:30.863446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:30.865570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:30.865594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:30.865597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:30.865601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:30.865608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [2:7556553908140046031:3041]
2025-10-02T09:28:30.865623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:30.865642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:30.865645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.865648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.865650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.865666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:30.865671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:30.865677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:30.865744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.865754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.865756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.865759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:30.865761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:30.865840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:30.865850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.865865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:30.865876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:30.865895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:30.865914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.865917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.865919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.865927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:30.865942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564476:3269], now have 1 active actors on pipe
2025-10-02T09:28:30.865942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:30.865945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:30.865947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:30.865948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564299:2446], now have 1 active actors on pipe
2025-10-02T09:28:30.865954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:30.865968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:30.865971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:30.866009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.866025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:30.866031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:30.866071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.866080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.866106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21569605-369dee9a-1c2c131c-b86b9609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:30.866119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:30.866122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:30.866124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:30.866134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:30.866148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:30.866171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.866435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:30.866447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:30.866464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:30.866998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4badc1eb-abdf6c3f-364bb337-dda1f5b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|21569605-369dee9a-1c2c131c-b86b9609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:30.866046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 130
2025-10-02T09:28:30.866080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 130
2025-10-02T09:28:30.866571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 36 sessionId: src_id|21569605-369dee9a-1c2c131c-b86b9609_0
2025-10-02T09:28:30.870611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Write session: try to update token
2025-10-02T09:28:30.870629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:30.881446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:30.881469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:30.881471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:30.881474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:30.881483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.881488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.881492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553908140046024:3041]
2025-10-02T09:28:30.881534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:30.881543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:30.881545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:30.881547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:30.881554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:30.881557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:30.881700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:30.893783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|21569605-369dee9a-1c2c131c-b86b9609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:30.896358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:30.931538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553908215564488:3101]
2025-10-02T09:28:30.931874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7556553908215564488:3101]
2025-10-02T09:28:31.032410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:31.032895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.032906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.032921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553908215564488:3101], now have 1 active actors on pipe
2025-10-02T09:28:31.033097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:31.033176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553908215564488:3101]
2025-10-02T09:28:31.033190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:31.033214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:31.033314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21569605-369dee9a-1c2c131c-b86b9609_0
2025-10-02T09:28:31.033502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|21569605-369dee9a-1c2c131c-b86b9609_0 is DEAD
2025-10-02T09:28:31.033646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:31.033658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Write session will restart in 0.009995s
2025-10-02T09:28:31.033692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Write session: Do CDS request
2025-10-02T09:28:31.033698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:31.045277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.045332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:31.045360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-10-02T09:28:31.045554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.045590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:31.045600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:31.045613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:31.046036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-10-02T09:28:31.046071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:31.046077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:31.046079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:31.046049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:31.046084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553912510531934:3273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:31.046609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553912510531934:3273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:31.046998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:31.047138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:31.047145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:31.047152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:31.047197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:31.047226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553912435013513:3043]
2025-10-02T09:28:31.047584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:31.047808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:31.047836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:31.048043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:31.048089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.048094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.048094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.048095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.048096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.048096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.048097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.048097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.048098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.048099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.048099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.048100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.048103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.048109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.048111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.048113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.048115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.048117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.048119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.048121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.048123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.048126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.048128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.048129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.048134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.048139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.048142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.048146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.048148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.048151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.048154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.048156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.048159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.048162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.048165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.048167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.048169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.048172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.048174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.048177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.048180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.048182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.048185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.048187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.048190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.048193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.048195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.048198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.048217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:31.048393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553912510531934:3273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:31.053778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553912510531934:3273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:31.053795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553912510531934:3273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:31.053799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553912510531934:3273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:31.053807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:31.056883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:31.059068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:31.059086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:31.059089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:31.059092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:31.059098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [2:7556553912435013513:3043]
2025-10-02T09:28:31.059111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:31.059129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:31.059132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.059135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.059137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.059150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:31.059165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:31.059172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:31.059234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.059243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.059245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.059248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:31.059250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:31.059314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:31.059321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.059334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.059350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.059368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:31.059390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.059397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.059399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.059411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:31.059426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:31.059428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510531972:3273], now have 1 active actors on pipe
2025-10-02T09:28:31.059432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510531787:2446], now have 1 active actors on pipe
2025-10-02T09:28:31.059439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:31.059441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:31.059443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:31.059452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:31.059455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:31.059489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.059500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:31.059492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 131
2025-10-02T09:28:31.059519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:31.059512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 131
2025-10-02T09:28:31.059556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.059565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.059590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:31.059601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.059605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.059607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:31.059615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.059624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:31.059641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.059791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.059799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.059809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.059874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 36 sessionId: src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0
2025-10-02T09:28:31.060215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21569605-369dee9a-1c2c131c-b86b9609_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:31.063283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Write session: try to update token
2025-10-02T09:28:31.063307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:31.074465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:31.074485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.074493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.074529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:31.074547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:31.074683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:31.074806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:31.074925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:31.075043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:31.075237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:31.075269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:31.077363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:31.079895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:31.079909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.079912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:31.079914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:31.079922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.079927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.079916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:31.079931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553912435013508:3043]
2025-10-02T09:28:31.079962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:31.079964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:31.079966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:31.079968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:31.079969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.079975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:31.080099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:31.133194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553912510531982:3101]
2025-10-02T09:28:31.133469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7556553912510531982:3101]
2025-10-02T09:28:31.218933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:31.219207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.219219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.219238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510531982:3101], now have 1 active actors on pipe
2025-10-02T09:28:31.219452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:31.219484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553912510531982:3101]
2025-10-02T09:28:31.219493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:31.219496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:31.219513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:31.219555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: error at write: Disconnected sessionId: src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0
2025-10-02T09:28:31.219729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0 is DEAD
2025-10-02T09:28:31.219881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:31.219891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Write session will restart in 0.006215s
2025-10-02T09:28:31.219914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Write session: Do CDS request
2025-10-02T09:28:31.219920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:31.227491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.227583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:31.227602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-10-02T09:28:31.227739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.227772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:31.227784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:31.227788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:31.228249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-10-02T09:28:31.228293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:31.228299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:31.228301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:31.228306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553912510532051:3278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:31.228861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553912510532051:3278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:31.231012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553912510532051:3278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:31.231626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:31.232332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:31.232483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:31.232494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:31.232504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:31.232555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:31.232592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553912435013702:3046]
2025-10-02T09:28:31.233096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553912510532051:3278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:31.233108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553912510532051:3278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:31.233111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553912510532051:3278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:31.233147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:31.233155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:31.233377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:31.233415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:31.233701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:31.233760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.233766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.233767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.233768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.233769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.233770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.233771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.233773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.233774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.233775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.233776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.233777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.233782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.233791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.233795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.233799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.233802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.233805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.233809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.233812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.233816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.233820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.233828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.233832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.233842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.233852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.233861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.233870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.233877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.233882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.233890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.233897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.233905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.233910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.233917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.233922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.233930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.233935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.233943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.233951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.233957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.233965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.233973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.233977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.233986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.233994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.234003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.234011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.234046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:31.242968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:31.244662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:31.244680Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:31.244683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:31.244687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:31.244694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [2:7556553912435013702:3046]
2025-10-02T09:28:31.244705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:31.244719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:31.244722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.244725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.244727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.244742Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:31.244748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:31.244754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:31.244835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.244843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.244845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.244847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:31.244849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:31.244987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:31.244993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.245001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.245007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.245017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:31.245035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532168:3278], now have 1 active actors on pipe
2025-10-02T09:28:31.245041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510531985:2446], now have 1 active actors on pipe
2025-10-02T09:28:31.245046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.245047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.245048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.245057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:31.245068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:31.245080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:31.245082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:31.245085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:31.245085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:31.245086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:31.245079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 132
2025-10-02T09:28:31.245082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 132
2025-10-02T09:28:31.245109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.245117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:31.245119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:31.245151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.245159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.245177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:31.245185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.245188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.245189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:31.245197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.245206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:31.245221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.245358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.245367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.245376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.245448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0
2025-10-02T09:28:31.245813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe8eea4-1595f220-7d5b0661-c8eb7de3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:31.248870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Write session: try to update token
2025-10-02T09:28:31.248886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:31.255761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:31.255784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.255785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:31.255787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:31.255793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.255796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.255799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553912435013697:3046]
2025-10-02T09:28:31.255831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:31.255835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.255837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:31.255839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:31.255844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:31.255846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:31.255965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:31.263790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:31.266638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:31.319613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553912510532191:3101]
2025-10-02T09:28:31.319865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7556553912510532191:3101]
2025-10-02T09:28:31.393551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:31.393770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.393783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.393798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532191:3101], now have 1 active actors on pipe
2025-10-02T09:28:31.393964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:31.394017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553912510532191:3101]
2025-10-02T09:28:31.394024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:31.394027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:31.394043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:31.394083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: error at write: Disconnected sessionId: src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0
2025-10-02T09:28:31.394249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0 is DEAD
2025-10-02T09:28:31.394398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:31.394410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Write session will restart in 0.006470s
2025-10-02T09:28:31.394431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Write session: Do CDS request
2025-10-02T09:28:31.394436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:31.402444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.402533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:31.402559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-10-02T09:28:31.402779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.402814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:31.402822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:31.402826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:31.403220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-10-02T09:28:31.403256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:31.403259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:31.403261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:31.403266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553912510532246:3283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:31.403779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553912510532246:3283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:31.406251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553912510532246:3283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:31.407777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:31.408760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:31.408919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:31.408927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:31.408932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:31.408982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:31.409016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553912435013902:3049]
2025-10-02T09:28:31.409055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553912510532246:3283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:31.409068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553912510532246:3283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:31.409071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553912510532246:3283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:31.409094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:31.409476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:31.409700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:31.409729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:31.409936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:31.409970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.409974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.409975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.409976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.409976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.409977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.409977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.409978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.409978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.409979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.409980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.409980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.409983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.409990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.409992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.409995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.409997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.409999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.410002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.410004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.410006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.410008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.410010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.410012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.410016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.410020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.410023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.410026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.410029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.410032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.410034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.410037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.410040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.410042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.410045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.410048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.410051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.410053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.410056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.410058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.410061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.410064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.410066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.410069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.410071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.410074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.410076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.410079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.410098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:31.418622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:31.420696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:31.420715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:31.420717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:31.420721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:31.420727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [2:7556553912435013902:3049]
2025-10-02T09:28:31.420742Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:31.420757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:31.420760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.420763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.420765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.420778Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:31.420783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:31.420790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:31.420872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.420880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.420882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.420885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:31.420888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:31.420952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:31.420963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.420976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.420987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.421002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:31.421020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.421023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.421024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.421038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:31.421051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:31.421064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:31.421066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:31.421065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:31.421069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:31.421071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:31.421098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.421100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:31.421118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:31.421123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532193:2446], now have 1 active actors on pipe
2025-10-02T09:28:31.421127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532385:3283], now have 1 active actors on pipe
2025-10-02T09:28:31.421260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 133
2025-10-02T09:28:31.421320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 133
2025-10-02T09:28:31.421452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.421468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.421495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:31.421502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.421506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.421509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:31.421522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.421533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:31.421551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.421782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.421795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.421814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.421943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 36 sessionId: src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0
2025-10-02T09:28:31.422324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff616009-3c21d90b-9857be6f-33bfbaaf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:31.425434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Write session: try to update token
2025-10-02T09:28:31.425453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:31.432882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:31.432899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.432900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:31.432901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:31.432907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.432910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.432913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553912435013897:3049]
2025-10-02T09:28:31.432945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:31.432951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.432953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:31.432965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:31.432971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:31.432974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:31.433089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:31.442014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:31.444677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:31.494196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553912510532421:3101]
2025-10-02T09:28:31.494494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7556553912510532421:3101]
2025-10-02T09:28:31.566778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:31.567150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.567177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.567193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532421:3101], now have 1 active actors on pipe
2025-10-02T09:28:31.567361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:31.567430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553912510532421:3101]
2025-10-02T09:28:31.567431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:31.567465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:31.567551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0
2025-10-02T09:28:31.567726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0 is DEAD
2025-10-02T09:28:31.567911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:31.567927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Write session will restart in 0.007910s
2025-10-02T09:28:31.567958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Write session: Do CDS request
2025-10-02T09:28:31.567966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:31.577361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.577492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:31.577508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-10-02T09:28:31.577664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.577695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:31.577704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:31.577708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:31.578119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-10-02T09:28:31.578153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:31.578155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:31.578156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:31.578161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553912510532508:3296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:31.578718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553912510532508:3296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:31.581183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553912510532508:3296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:31.581648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:31.582543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:31.582729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:31.582737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:31.582747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:31.582794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:31.582829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553912435014127:3063]
2025-10-02T09:28:31.583450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:31.583731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:31.583774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:31.583955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553912510532508:3296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:31.583968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553912510532508:3296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:31.583970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553912510532508:3296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:31.583984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:31.584060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:31.584121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.584128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.584129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.584130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.584131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.584132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.584133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.584134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.584135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.584136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.584137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.584138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.584142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.584152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.584156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.584160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.584164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.584167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.584171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.584176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.584179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.584184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.584188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.584193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.584200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.584207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.584213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.584219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.584224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.584229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.584233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.584239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.584243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.584249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.584254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.584259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.584264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.584269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.584279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.584285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.584290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.584295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.584299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.584308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.584312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.584318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.584322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.584330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.584366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:31.593420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:31.595484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:31.595505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:31.595507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:31.595511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:31.595517Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [2:7556553912435014127:3063]
2025-10-02T09:28:31.595533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:31.595549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:31.595552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.595555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.595558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.595573Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:31.595585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:31.595592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:31.595654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.595662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.595664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.595668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:31.595670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:31.595733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:31.595742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.595755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.595765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.595781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:31.595805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532611:3296], now have 1 active actors on pipe
2025-10-02T09:28:31.595813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532423:2446], now have 1 active actors on pipe
2025-10-02T09:28:31.595819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.595822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.595824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.595836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:31.595855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:31.595859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:31.595862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:31.595865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:31.595873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:31.595876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:31.595870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 134
2025-10-02T09:28:31.595871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 134
2025-10-02T09:28:31.595912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.595925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:31.595930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:31.595943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.595946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.595990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:31.596003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.596009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.596013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:31.596023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.596036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:31.596058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.596252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.596261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.596275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.596367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 36 sessionId: src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0
2025-10-02T09:28:31.596753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68feeb8d-9ec2f4b4-9589e8b3-40dccab2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:31.599699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Write session: try to update token
2025-10-02T09:28:31.599723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:31.608378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:31.608403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.608405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:31.608406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:31.608414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.608419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.608423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553912435014122:3063]
2025-10-02T09:28:31.608461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:31.608466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:31.608467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.608470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:31.608473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:31.608477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:31.608616Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:31.617899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:31.621217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:31.667756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553912510532620:3101]
2025-10-02T09:28:31.668140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7556553912510532620:3101]
2025-10-02T09:28:31.769186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:31.769496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.769513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.769529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532620:3101], now have 1 active actors on pipe
2025-10-02T09:28:31.769742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:31.770195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:31.770210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Write session will restart in 0.008342s
2025-10-02T09:28:31.770237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Write session: Do CDS request
2025-10-02T09:28:31.770243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:31.769748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:31.769759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553912510532620:3101]
2025-10-02T09:28:31.769763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:31.769776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:31.769823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: error at write: Disconnected sessionId: src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0
2025-10-02T09:28:31.769998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0 is DEAD
2025-10-02T09:28:31.779472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.779794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:31.779815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-10-02T09:28:31.779992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:31.780022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:31.780028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:31.780033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:31.781003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-10-02T09:28:31.781057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:31.781059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:31.781062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:31.781069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553912510532645:3301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:31.781710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553912510532645:3301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:31.784233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553912510532645:3301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:31.788492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553912510532645:3301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:31.788511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553912510532645:3301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:31.788515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553912510532645:3301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:31.788526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:31.791692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:31.793283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:31.793563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:31.793577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:31.793593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:31.793666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:31.793712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553912435014320:3066]
2025-10-02T09:28:31.794415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:31.794748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:31.794796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:31.795182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:31.795347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.795356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.795357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.795358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.795359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.795360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.795361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.795362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.795363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.795363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.795364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.795365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.795370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.795378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.795381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.795383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.795386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.795388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.795391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.795393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.795396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.795399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.795404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.795408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.795417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.795425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:31.795431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.795436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:31.795442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.795448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:31.795452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.795457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:31.795461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.795466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:31.795470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.795476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:31.795481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.795486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:31.795491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.795497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:31.795505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.795510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:31.795515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.795521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.795525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.795531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.795538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.795543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.795577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:31.805785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:31.808687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:31.808711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:31.808714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:31.808719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:31.808727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [2:7556553912435014320:3066]
2025-10-02T09:28:31.808743Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:31.808765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:31.808777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.808785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.808788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.809293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:31.809310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:31.809317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:31.809402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.809410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.809413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.809417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:31.809419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:31.809499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:31.809508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.809525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:31.809536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:31.809553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:31.809582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532631:2446], now have 1 active actors on pipe
2025-10-02T09:28:31.809590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532781:3301], now have 1 active actors on pipe
2025-10-02T09:28:31.809599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.809605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.809609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.809624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:31.809644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:31.809665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:31.809673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:31.809675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:31.809680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:31.809682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:31.809683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 135
2025-10-02T09:28:31.809720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.809732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:31.809740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:31.809744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 135
2025-10-02T09:28:31.809876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.809891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.809924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:31.809939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:31.809947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:31.809950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:31.809968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:31.809983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:31.810008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.810152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.810164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.810187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:31.810276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 36 sessionId: src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0
2025-10-02T09:28:31.810641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c43b9-12ca1427-9aa3b32b-549d8e5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:31.813601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Write session: try to update token
2025-10-02T09:28:31.813622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:31.821679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:31.821702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.821712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.821763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:31.821952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:31.822041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:31.822184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:31.822332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:31.822497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:31.822700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:31.822763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:31.830096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:31.832462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:31.832487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:31.832489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:31.832491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:31.832502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.832506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.832514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553912435014314:3066]
2025-10-02T09:28:31.832558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:31.832570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:31.832569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:31.832573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:31.832576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:31.832581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:31.832609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:31.832836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:31.870310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553912510532829:3101]
2025-10-02T09:28:31.870677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7556553912510532829:3101]
2025-10-02T09:28:31.988528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:31.988902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:31.988918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:31.988939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532829:3101], now have 1 active actors on pipe
2025-10-02T09:28:31.989434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553912510532829:3101]
2025-10-02T09:28:31.989483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:31.989335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:31.989992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:31.990004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Write session will restart in 0.009022s
2025-10-02T09:28:31.990032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Write session: Do CDS request
2025-10-02T09:28:31.990037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:31.989530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:31.989540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:31.989626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: error at write: Disconnected sessionId: src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0
2025-10-02T09:28:31.989849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0 is DEAD
2025-10-02T09:28:32.000520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.000641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:32.000660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-10-02T09:28:32.000876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.000926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:32.000949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:32.000956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:32.001563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-10-02T09:28:32.001621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:32.001627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:32.001629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:32.001637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553916805500209:3305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:32.002240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553916805500209:3305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:32.004766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553916805500209:3305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:32.005829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:32.007290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:32.007531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:32.007545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:32.007559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:32.007630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:32.007697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553916729981808:3068]
2025-10-02T09:28:32.008101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553916805500209:3305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:32.008124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553916805500209:3305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:32.008127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553916805500209:3305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:32.008136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:32.008433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:32.008780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:32.008855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:32.009179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:32.009240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.009245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.009247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.009248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.009249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.009250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.009251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.009252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.009253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.009255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.009256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.009257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.009262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.009273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.009276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.009280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.009283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.009287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.009290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.009294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.009297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.009302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.009305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.009309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.009315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.009322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.009329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.009334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.009338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.009343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.009348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.009353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.009361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.009366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.009374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.009379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.009384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.009390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.009394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.009403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.009407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.009413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.009420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.009425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.009433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.009437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.009442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.009451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.009483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:32.019049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:32.021316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:32.021337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:32.021339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:32.021344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:32.021351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [2:7556553916729981808:3068]
2025-10-02T09:28:32.021367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:32.021387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:32.021390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.021394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.021396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.021413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:32.021423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:32.021430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:32.021501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.021508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.021510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.021513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:32.021516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:32.021590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:32.021596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.021612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.021629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.021651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:32.021673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.021681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.021683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.021692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:32.021705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:32.021714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:32.021721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:32.021724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:32.021734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553912510532835:2446], now have 1 active actors on pipe
2025-10-02T09:28:32.021735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:32.021737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:32.021771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500314:3305], now have 1 active actors on pipe
2025-10-02T09:28:32.021780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.021789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:32.021795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:32.021836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 136
2025-10-02T09:28:32.021850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 136
2025-10-02T09:28:32.022580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 36 sessionId: src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0
2025-10-02T09:28:32.021990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.022000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.022031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:32.022041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.022048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.022050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:32.022061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.022071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:32.022093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.022425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.022433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.022455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.023044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731b2b05-fceb03b8-9a9b7ad2-e7fe4dec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:32.026449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Write session: try to update token
2025-10-02T09:28:32.026472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:32.034033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:32.034056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.034058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:32.034061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:32.034069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.034072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.034076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553916729981803:3068]
2025-10-02T09:28:32.034113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:32.034119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.034122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:32.034255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:32.037154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:32.037168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:32.037172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:32.047270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:32.050424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:32.089679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553916805500329:3101]
2025-10-02T09:28:32.090098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7556553916805500329:3101]
2025-10-02T09:28:32.185275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:32.185620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.185633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.185651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500329:3101], now have 1 active actors on pipe
2025-10-02T09:28:32.185916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:32.185965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:32.186036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0
2025-10-02T09:28:32.186157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553916805500329:3101]
2025-10-02T09:28:32.186214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0 is DEAD
2025-10-02T09:28:32.185903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:32.186576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:32.186591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Write session will restart in 0.006124s
2025-10-02T09:28:32.186620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Write session: Do CDS request
2025-10-02T09:28:32.186628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:32.194442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.194595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:32.194614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-10-02T09:28:32.194799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.194830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:32.194838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:32.194843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:32.195289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-10-02T09:28:32.195326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:32.195331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:32.195335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:32.195341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553916805500383:3310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:32.195884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553916805500383:3310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:32.198231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553916805500383:3310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:32.200792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:32.201101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553916805500383:3310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:32.201125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553916805500383:3310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:32.201130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553916805500383:3310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:32.201146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:32.201773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:32.201937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:32.201949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:32.201958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:32.202003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:32.202042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553916729982004:3071]
2025-10-02T09:28:32.202562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:32.203112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:32.203151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:32.203453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:32.203502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.203508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.203509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.203509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.203510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.203511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.203512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.203513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.203514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.203515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.203516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.203517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.203522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.203531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.203534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.203537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.203540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.203543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.203546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.203549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.203552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.203557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.203560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.203563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.203568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.203574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.203579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.203583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.203587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.203591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.203595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.203598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.203603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.203607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.203610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.203614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.203618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.203622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.203625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.203629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.203633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.203637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.203641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.203645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.203648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.203652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.203655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.203659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.203687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:32.213002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:32.215241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:32.215265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:32.215267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:32.215271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:32.215278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [2:7556553916729982004:3071]
2025-10-02T09:28:32.215293Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:32.215313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:32.215316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.215321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.215322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.215339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:32.215344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:32.215356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:32.215433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.215441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.215444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.215447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:32.215449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:32.215529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:32.215538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.215551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.215565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.215584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:32.215611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500520:3310], now have 1 active actors on pipe
2025-10-02T09:28:32.215619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500331:2446], now have 1 active actors on pipe
2025-10-02T09:28:32.215628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.215630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.215632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.215651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:32.215669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:32.215674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:32.215677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:32.215679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:32.215692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:32.215697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:32.215671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 137
2025-10-02T09:28:32.215688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 137
2025-10-02T09:28:32.215735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.215747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:32.215753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:32.215769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.215777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.215826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:32.215839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.215843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.215846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:32.215855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.215870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:32.215899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.216097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.216110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.216131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.216216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0
2025-10-02T09:28:32.216636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67ebc03-58e320e-8d30fe32-5c0378bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:32.219661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Write session: try to update token
2025-10-02T09:28:32.219687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:32.231732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:32.231753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.231755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:32.231757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:32.231766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.231772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.231776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553916729981998:3071]
2025-10-02T09:28:32.231822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:32.231824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:32.231831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:32.231834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.231835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:32.231837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:32.231992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:32.240327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:32.243702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:32.286235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553916805500543:3101]
2025-10-02T09:28:32.286407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7556553916805500543:3101]
2025-10-02T09:28:32.383908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:32.384163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.384179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.384197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500543:3101], now have 1 active actors on pipe
2025-10-02T09:28:32.384361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:32.384422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:32.384434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:32.384441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:32.384477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553916805500543:3101]
2025-10-02T09:28:32.384497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: error at write: Disconnected sessionId: src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0
2025-10-02T09:28:32.384667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0 is DEAD
2025-10-02T09:28:32.384876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:32.384884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Write session will restart in 0.009157s
2025-10-02T09:28:32.384908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Write session: Do CDS request
2025-10-02T09:28:32.384924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:32.395308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.395393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:32.395407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-10-02T09:28:32.395580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.395615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:32.395618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:32.395622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:32.395981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-10-02T09:28:32.396009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:32.396014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:32.396015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:32.396019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553916805500675:3315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:32.396463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553916805500675:3315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:32.397672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:32.398075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553916805500675:3315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:32.398584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:32.398757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:32.398764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:32.398773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:32.398821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:32.398854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553916729982208:3074]
2025-10-02T09:28:32.399374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:32.399646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:32.399694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:32.399972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:32.400021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.400026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.400027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.400028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.400028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.400029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.400030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.400031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.400032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.400033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.400034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.400035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.400039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.400048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.400051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.400055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.400058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.400061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.400064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.400067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.400070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.400074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.400077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.400080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.400087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.400094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.400098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.400103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.400106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.400110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.400114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.400118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.400122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.400126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.400130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.400134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.400138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.400142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.400145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.400150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.400153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.400158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.400161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.400165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.400169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.400173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.400177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.400181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.400213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:32.400540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553916805500675:3315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:32.400552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553916805500675:3315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:32.400554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553916805500675:3315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:32.400561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:32.409150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:32.411445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:32.411465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:32.411468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:32.411472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:32.411478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [2:7556553916729982208:3074]
2025-10-02T09:28:32.411494Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:32.411511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:32.411514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.411517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.411519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.411533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:32.411538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:32.411544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:32.411607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.411616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.411618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.411622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:32.411624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:32.411693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:32.411700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.411714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.411731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.411746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:32.411765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500738:3315], now have 1 active actors on pipe
2025-10-02T09:28:32.411773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500546:2446], now have 1 active actors on pipe
2025-10-02T09:28:32.411779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.411781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.411783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.411796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:32.411809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:32.411823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:32.411826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:32.411859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:32.411864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.411867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:32.411870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:32.411872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:32.411878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:32.412300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 138
2025-10-02T09:28:32.412338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 138
2025-10-02T09:28:32.412461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.412474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.412498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:32.412507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.412514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.412517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:32.412526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.412536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:32.412549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.412761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.412771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.412790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.412883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 36 sessionId: src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0
2025-10-02T09:28:32.413243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006666-8e01cde7-e74efb85-ac40e28e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:32.416143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Write session: try to update token
2025-10-02T09:28:32.416163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:32.423773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:32.423797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.423806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.423845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:32.423863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:32.424029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:32.424193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:32.424346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:32.424499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:32.424715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:32.424759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:32.431952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:32.434431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:32.434461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:32.434482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.434484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:32.434486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:32.434496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.434500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.434503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553916729982203:3074]
2025-10-02T09:28:32.434540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:32.434542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:32.434546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.434548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:32.434548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:32.434552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:32.434676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:32.484416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553916805500759:3101]
2025-10-02T09:28:32.484732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7556553916805500759:3101]
2025-10-02T09:28:32.569400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:32.569776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.569787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.569803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500759:3101], now have 1 active actors on pipe
2025-10-02T09:28:32.569963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:32.570004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:32.570019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:32.570080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: error at write: Disconnected sessionId: src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0
2025-10-02T09:28:32.570255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0 is DEAD
2025-10-02T09:28:32.570423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:32.570437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Write session will restart in 0.005597s
2025-10-02T09:28:32.570462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Write session: Do CDS request
2025-10-02T09:28:32.570469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:32.570455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:32.570726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553916805500759:3101]
2025-10-02T09:28:32.577258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.577373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:32.577386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-10-02T09:28:32.577542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.577580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:32.577589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:32.577594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:32.577970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-10-02T09:28:32.577998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:32.578004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:32.578005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:32.578009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553916805500786:3326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:32.578566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553916805500786:3326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:32.580824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553916805500786:3326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:32.583749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553916805500786:3326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:32.583759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553916805500786:3326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:32.583761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553916805500786:3326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:32.583766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:32.584367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:32.585368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:32.585522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:32.585531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:32.585540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:32.585578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:32.585612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553916729982438:3088]
2025-10-02T09:28:32.586214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:32.586513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:32.586547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:32.586854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:32.586900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.586906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.586907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.586908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.586909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.586910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.586911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.586912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.586914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.586915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.586916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.586917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.586922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.586934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.586938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.586943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.586947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.586951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.586955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.586960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.586964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.586969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.586973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.586977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.586984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.586991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.587001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.587007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.587015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.587020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.587025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.587031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.587035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.587041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.587050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.587055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.587064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.587071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.587079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.587084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.587089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.587095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.587103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.587109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.587113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.587122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.587127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.587135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.587182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:32.595521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:32.597642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:32.597664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:32.597667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:32.597670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:32.597677Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [2:7556553916729982438:3088]
2025-10-02T09:28:32.597690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:32.597706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:32.597714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.597716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.597718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.597733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:32.597743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:32.597753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:32.597814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.597821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.597823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.597827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:32.597830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:32.597898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:32.597906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.597920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.597935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.597961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:32.597984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500958:3326], now have 1 active actors on pipe
2025-10-02T09:28:32.597996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500771:2446], now have 1 active actors on pipe
2025-10-02T09:28:32.598002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.598004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.598006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.598027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:32.598040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:32.598060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:32.598068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:32.598066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:32.598072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:32.598075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:32.598066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 139
2025-10-02T09:28:32.598095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.598105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:32.598089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 139
2025-10-02T09:28:32.598116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:32.598136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.598140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.598168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd870865-19b06357-7ce73814-6ae34708_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:32.598182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.598190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.598192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:32.598201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.598214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:32.598239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.598406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.598416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.598427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.598525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd870865-19b06357-7ce73814-6ae34708_0
2025-10-02T09:28:32.598887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36cc4ce4-fb817e10-a1fe82d6-2209e816_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd870865-19b06357-7ce73814-6ae34708_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:32.601776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Write session: try to update token
2025-10-02T09:28:32.601795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:32.608446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:32.608466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.608469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:32.608471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:32.608479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.608483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.608487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553916729982433:3088]
2025-10-02T09:28:32.608529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:32.608535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.608538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:32.608549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:32.608556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:32.608559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:32.608670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:32.616687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|bd870865-19b06357-7ce73814-6ae34708_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:32.619578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:32.670776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553916805500971:3101]
2025-10-02T09:28:32.671001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7556553916805500971:3101]
2025-10-02T09:28:32.749678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:32.749980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.749993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.750009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500971:3101], now have 1 active actors on pipe
2025-10-02T09:28:32.750204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:32.750236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553916805500971:3101]
2025-10-02T09:28:32.750280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:32.750285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:32.750404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd870865-19b06357-7ce73814-6ae34708_0
2025-10-02T09:28:32.750588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|bd870865-19b06357-7ce73814-6ae34708_0 is DEAD
2025-10-02T09:28:32.750746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:32.750760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Write session will restart in 0.009646s
2025-10-02T09:28:32.750789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Write session: Do CDS request
2025-10-02T09:28:32.750797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:32.761347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.761448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:32.761462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-10-02T09:28:32.761572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.761598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:32.761606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:32.761610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:32.762383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-10-02T09:28:32.762449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:32.762457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:32.762459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:32.762465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553916805501137:3331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:32.762872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:32.763069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553916805501137:3331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:32.763770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:32.763933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:32.763942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:32.763950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:32.763987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:32.764021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553916729982633:3091]
2025-10-02T09:28:32.764577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:32.764813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:32.764850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:32.765129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:32.765176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.765181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.765182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.765183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.765184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.765185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.765186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.765187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.765188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.765189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.765190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.765191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.765195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.765205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.765209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.765213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.765216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.765220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.765224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.765227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.765231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.765235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.765238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.765242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.765248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.765255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.765264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.765269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.765276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.765281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.765290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.765294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.765302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.765308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.765316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.765321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.765329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.765326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553916805501137:3331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:32.765335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.765338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.765343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.765348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.765352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.765356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.765361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.765365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.765370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.765374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.765379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.765412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:32.770920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553916805501137:3331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:32.770932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553916805501137:3331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:32.770934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553916805501137:3331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:32.770941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:32.774025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:32.775830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:32.775846Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:32.775849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:32.775852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:32.775859Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [2:7556553916729982633:3091]
2025-10-02T09:28:32.775873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:32.775891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:32.775898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.775901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.775903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.775916Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:32.775926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:32.775932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:32.775987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.775993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.775994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.775997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:32.775999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:32.776062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:32.776068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.776079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.776089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.776107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:32.776128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805501179:3331], now have 1 active actors on pipe
2025-10-02T09:28:32.776135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805500981:2446], now have 1 active actors on pipe
2025-10-02T09:28:32.776140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.776142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.776144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.776156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:32.776170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:32.776172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:32.776178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:32.776180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:32.776187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:32.776190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:32.776219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.776229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:32.776235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:32.776219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 140
2025-10-02T09:28:32.776274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 140
2025-10-02T09:28:32.776314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.776324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.776343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:32.776349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.776354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.776356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:32.776364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.776372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:32.776387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.776511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.776518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.776530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.776610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0
2025-10-02T09:28:32.776959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd870865-19b06357-7ce73814-6ae34708_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:32.779741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Write session: try to update token
2025-10-02T09:28:32.779758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:32.786999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:32.787018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.787019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:32.787021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:32.787027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.787031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.787034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553916729982628:3091]
2025-10-02T09:28:32.787062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:32.787066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.787068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:32.787076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:32.787082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:32.787086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:32.787204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:32.794056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:32.796846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:32.850520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553916805501186:3101]
2025-10-02T09:28:32.850844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7556553916805501186:3101]
2025-10-02T09:28:32.920421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:32.920934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.920947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.920964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805501186:3101], now have 1 active actors on pipe
2025-10-02T09:28:32.921229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:32.921243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:32.921271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553916805501186:3101]
2025-10-02T09:28:32.921304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:32.921332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: error at write: Disconnected sessionId: src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0
2025-10-02T09:28:32.921378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:32.921529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0 is DEAD
2025-10-02T09:28:32.921672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:32.921684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Write session will restart in 0.005415s
2025-10-02T09:28:32.921709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Write session: Do CDS request
2025-10-02T09:28:32.921715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:32.928300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.928407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:32.928420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-10-02T09:28:32.928545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:32.928572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:32.928578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:32.928581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:32.929088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-10-02T09:28:32.929133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:32.929135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:32.929136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:32.929144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553916805501206:3335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:32.929681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553916805501206:3335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:32.932297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553916805501206:3335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:32.934764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:32.935021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553916805501206:3335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:32.935038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553916805501206:3335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:32.935042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553916805501206:3335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:32.935051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:32.935717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:32.935934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:32.935945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:32.935954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:32.936009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:32.936043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553916729982829:3093]
2025-10-02T09:28:32.936596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:32.936910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:32.936952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:32.937250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:32.937297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.937303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.937304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.937305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.937306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.937307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.937308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.937309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.937310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.937311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.937312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.937313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.937317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.937327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.937332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.937336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.937340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.937344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.937347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.937351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.937355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.937359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.937363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.937366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.937373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.937380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:32.937386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.937391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:32.937394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.937401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:32.937405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.937410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:32.937415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.937423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:32.937427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.937432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:32.937440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.937446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:32.937455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.937459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:32.937464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.937469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:32.937475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.937480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.937487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.937491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.937499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.937504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.937541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:32.945878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:32.947545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:32.947560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:32.947562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:32.947565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:32.947570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [2:7556553916729982829:3093]
2025-10-02T09:28:32.947579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:32.947590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:32.947592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.947594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.947595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.947606Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:32.947609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:32.947614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:32.947660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.947668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.947670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.947673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:32.947676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:32.947739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:32.947748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.947759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:32.947770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:32.947786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:32.947803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805501381:3335], now have 1 active actors on pipe
2025-10-02T09:28:32.947811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553916805501188:2446], now have 1 active actors on pipe
2025-10-02T09:28:32.947815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.947816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.947817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.947829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:32.947841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:32.947851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:32.947853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:32.947854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:32.947861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:32.947864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:32.947874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.947880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:32.947882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:32.947909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 141
2025-10-02T09:28:32.947922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 141
2025-10-02T09:28:32.948067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.948074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.948096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb593124-955646d1-dc9a1caf-c7c79846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:32.948106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:32.948109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:32.948111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:32.948119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:32.948127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:32.948141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.948481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:32.948490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:32.948503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:32.948623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb593124-955646d1-dc9a1caf-c7c79846_0
2025-10-02T09:28:32.949008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa10d653-d5dd4d96-d9f3e962-189119db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb593124-955646d1-dc9a1caf-c7c79846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:32.951852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Write session: try to update token
2025-10-02T09:28:32.951873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:32.958154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:32.958170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:32.958171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:32.958173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:32.958178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.958181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.958185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553916729982823:3093]
2025-10-02T09:28:32.958213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:32.958217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:32.958219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:32.958230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:32.958235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:32.958238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:32.958340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:32.966628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|eb593124-955646d1-dc9a1caf-c7c79846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:32.969129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:33.021468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553921100468688:3101]
2025-10-02T09:28:33.021771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7556553921100468688:3101]
2025-10-02T09:28:33.097757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:33.098346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.098358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.098383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100468688:3101], now have 1 active actors on pipe
2025-10-02T09:28:33.098742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:33.098768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553921100468688:3101]
2025-10-02T09:28:33.098783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:33.098787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:33.098800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:33.098860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: error at write: Disconnected sessionId: src_id|eb593124-955646d1-dc9a1caf-c7c79846_0
2025-10-02T09:28:33.099043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|eb593124-955646d1-dc9a1caf-c7c79846_0 is DEAD
2025-10-02T09:28:33.099420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:33.099432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Write session will restart in 0.006465s
2025-10-02T09:28:33.099468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Write session: Do CDS request
2025-10-02T09:28:33.099475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:33.107430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.107531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:33.107549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-10-02T09:28:33.107743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.107784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:33.107791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:33.107796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:33.108357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-10-02T09:28:33.108398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:33.108400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:33.108401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:33.108411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553921100468707:3340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:33.109048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553921100468707:3340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:33.110866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553921100468707:3340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:33.113753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553921100468707:3340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:33.113781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553921100468707:3340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:33.113784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553921100468707:3340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:33.113792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:33.119138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:33.120780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:33.121042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:33.121052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:33.121065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:33.121133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:33.121194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553921024950323:3096]
2025-10-02T09:28:33.121750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:33.122157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:33.122215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:33.122561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:33.122632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.122639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.122640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.122641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.122642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.122643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.122645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.122646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.122647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.122648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.122650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.122651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.122657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.122668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.122672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.122676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.122680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.122684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.122689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.122692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.122696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.122701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.122705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.122709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.122716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.122723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.122726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.122729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.122732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.122735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.122738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.122742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.122745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.122748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.122750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.122753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.122756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.122759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.122762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.122765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.122768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.122772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.122775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.122778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.122780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.122783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.122786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.122789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.122811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:33.132270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:33.134659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:33.134685Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:33.134688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:33.134691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:33.134698Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [2:7556553921024950323:3096]
2025-10-02T09:28:33.134713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:33.134732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:33.134735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.134738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.134740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.134756Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:33.134761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:33.134767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:33.134835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.134845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.134847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.134850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:33.134853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:33.134932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:33.134943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.134957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.134970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.134995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:33.135015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100468793:3340], now have 1 active actors on pipe
2025-10-02T09:28:33.135028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.135030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.135032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.135044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:33.135054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100468693:2446], now have 1 active actors on pipe
2025-10-02T09:28:33.135059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:33.135062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:33.135072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:33.135074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:33.135076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:33.135080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:33.135122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.135137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:33.135134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 142
2025-10-02T09:28:33.135176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:33.135194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 142
2025-10-02T09:28:33.135276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.135291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.135319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46507217-3290db9c-9b43b427-7ac98169_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:33.135330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.135333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.135336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:33.135346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.135360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:33.135375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.135558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.135572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.135589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.135703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 36 sessionId: src_id|46507217-3290db9c-9b43b427-7ac98169_0
2025-10-02T09:28:33.136066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb593124-955646d1-dc9a1caf-c7c79846_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46507217-3290db9c-9b43b427-7ac98169_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:33.139482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Write session: try to update token
2025-10-02T09:28:33.139502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:33.146628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:33.146656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:33.146658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:33.146660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:33.146670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.146675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.146679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553921024950318:3096]
2025-10-02T09:28:33.146722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:33.146728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.146730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:33.146729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:33.146736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:33.146740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:33.146896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:33.154862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|46507217-3290db9c-9b43b427-7ac98169_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:33.157896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:33.199181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553921100468898:3101]
2025-10-02T09:28:33.199436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7556553921100468898:3101]
2025-10-02T09:28:33.295931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:33.296312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.296330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.296349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100468898:3101], now have 1 active actors on pipe
2025-10-02T09:28:33.296527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:33.296660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553921100468898:3101]
2025-10-02T09:28:33.296693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:33.296696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:33.296719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:33.296754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: error at write: Disconnected sessionId: src_id|46507217-3290db9c-9b43b427-7ac98169_0
2025-10-02T09:28:33.296941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|46507217-3290db9c-9b43b427-7ac98169_0 is DEAD
2025-10-02T09:28:33.297246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:33.297257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Write session will restart in 0.007782s
2025-10-02T09:28:33.297280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Write session: Do CDS request
2025-10-02T09:28:33.297287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:33.306336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.309826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:33.309845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-10-02T09:28:33.310016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.310068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:33.310077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:33.310082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:33.310515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-10-02T09:28:33.310547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:33.310548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:33.310550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:33.310555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553921100468927:3345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:33.311058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553921100468927:3345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:33.313202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553921100468927:3345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:33.316790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553921100468927:3345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:33.316819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553921100468927:3345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:33.316825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553921100468927:3345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:33.316835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:33.324184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:33.325314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:33.325509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:33.325513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:33.325523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:33.325571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:33.325605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553921024950532:3099]
2025-10-02T09:28:33.326212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:33.326652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:33.326696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:33.326995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:33.327054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.327060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.327062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.327063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.327064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.327065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.327066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.327067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.327068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.327069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.327070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.327071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.327076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.327086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.327090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.327093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.327097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.327101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.327104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.327107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.327111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.327115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.327118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.327122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.327128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.327135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.327140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.327144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.327148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.327165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.327169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.327174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.327179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.327183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.327187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.327191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.327196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.327200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.327204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.327208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.327212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.327216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.327232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.327236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.327241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.327245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.327249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.327253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.327286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:33.337743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:33.339894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:33.339916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:33.339918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:33.339922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:33.339928Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [2:7556553921024950532:3099]
2025-10-02T09:28:33.339947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:33.339965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:33.339968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.339970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.339972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.339987Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:33.339995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:33.340002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:33.340069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.340078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.340080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.340084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:33.340086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:33.340157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:33.340166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.340180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.340193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.340210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:33.340234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469018:3345], now have 1 active actors on pipe
2025-10-02T09:28:33.340245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.340247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.340249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.340264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:33.340279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100468912:2446], now have 1 active actors on pipe
2025-10-02T09:28:33.340291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:33.340310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:33.340317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:33.340330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 143
2025-10-02T09:28:33.340351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.340359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:33.340363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:33.340366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:33.340369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:33.340374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:33.340388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 143
2025-10-02T09:28:33.340614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.340627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.340649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:33.340660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.340663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.340669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:33.340678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.340687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:33.340701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.340865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.340873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.340886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.340989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0
2025-10-02T09:28:33.341367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46507217-3290db9c-9b43b427-7ac98169_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:33.344514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Write session: try to update token
2025-10-02T09:28:33.344539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:33.352165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:33.352194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:33.352197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:33.352199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:33.352207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.352212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.352217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553921024950527:3099]
2025-10-02T09:28:33.352258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:33.352267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.352275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:33.352274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:33.352280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:33.352284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:33.352420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:33.361726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:33.364747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:33.396831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553921100469118:3101]
2025-10-02T09:28:33.397191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7556553921100469118:3101]
2025-10-02T09:28:33.496919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:33.497346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.497360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.497379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469118:3101], now have 1 active actors on pipe
2025-10-02T09:28:33.497624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:33.497672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:33.497592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:33.498159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:33.498171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Write session will restart in 0.006087s
2025-10-02T09:28:33.498192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Write session: Do CDS request
2025-10-02T09:28:33.498199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:33.497759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0
2025-10-02T09:28:33.497944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0 is DEAD
2025-10-02T09:28:33.498094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553921100469118:3101]
2025-10-02T09:28:33.509208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.509438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:33.509462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-10-02T09:28:33.510070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.510116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:33.510127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:33.510133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:33.510824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-10-02T09:28:33.510864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:33.510871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:33.510873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:33.510880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553921100469164:3351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:33.511467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553921100469164:3351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:33.516352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553921100469164:3351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:33.521781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553921100469164:3351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:33.521801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553921100469164:3351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:33.521806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553921100469164:3351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:33.521815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:33.523751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:33.525086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:33.525360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:33.525376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:33.525393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:33.525494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:33.525545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553921024950743:3101]
2025-10-02T09:28:33.526166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:33.526575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:33.526631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:33.527014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:33.527093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.527094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.527095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.527096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.527098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.527099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.527100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.527101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.527102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.527104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.527105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.527106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.527111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.527122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.527126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.527129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.527133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.527138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.527141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.527144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.527148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.527161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.527168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.527174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.527181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.527186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.527190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.527194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.527199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.527203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.527207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.527213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.527218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.527224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.527229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.527234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.527238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.527241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.527246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.527249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.527254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.527258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.527262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.527267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.527271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.527275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.527279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.527314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:33.537645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:33.539792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:33.539800Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:33.539803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:33.539806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:33.539814Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [2:7556553921024950743:3101]
2025-10-02T09:28:33.539825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:33.539841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:33.539845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.539848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.539850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.539865Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:33.539870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:33.539876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:33.539939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.539941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.539942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.539945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:33.539947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:33.540024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:33.540028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.540042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.540050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.540063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:33.540081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.540083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.540084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.540090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:33.540101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:33.540105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:33.540106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469324:3351], now have 1 active actors on pipe
2025-10-02T09:28:33.540107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:33.540109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469120:2446], now have 1 active actors on pipe
2025-10-02T09:28:33.540114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:33.540126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:33.540129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:33.540167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.540177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:33.540183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:33.540617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 144
2025-10-02T09:28:33.540651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 144
2025-10-02T09:28:33.544485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.544507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.544536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:33.544547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.544552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.544554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:33.544564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.544576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:33.544591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.545014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.545028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.545048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.545167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0
2025-10-02T09:28:33.545564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e26b75-fcb1d996-af553e7-b98f8fbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:33.549016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Write session: try to update token
2025-10-02T09:28:33.549036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:33.553420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:33.553440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:33.553442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:33.553443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:33.553452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.553457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.553460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553921024950738:3101]
2025-10-02T09:28:33.553499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:33.553505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.553507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:33.553647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:33.554081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:33.554092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:33.554097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:33.570716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:33.573866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:33.594967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553921100469349:3101]
2025-10-02T09:28:33.595374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7556553921100469349:3101]
2025-10-02T09:28:33.702423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:33.702820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.702828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.702845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469349:3101], now have 1 active actors on pipe
2025-10-02T09:28:33.704090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:33.704102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Write session will restart in 0.008443s
2025-10-02T09:28:33.704123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Write session: Do CDS request
2025-10-02T09:28:33.704129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:33.703586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553921100469349:3101]
2025-10-02T09:28:33.703615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:33.703617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:33.703672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: error at write: Disconnected sessionId: src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0
2025-10-02T09:28:33.703853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0 is DEAD
2025-10-02T09:28:33.704490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:33.703981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:33.713335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.715756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:33.715772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-10-02T09:28:33.715966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.716000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:33.716005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:33.716009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:33.716462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-10-02T09:28:33.716500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:33.716506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:33.716508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:33.716513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553921100469374:3361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:33.717115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553921100469374:3361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:33.720611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553921100469374:3361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:33.725775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553921100469374:3361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:33.725809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553921100469374:3361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:33.725814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553921100469374:3361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:33.725823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:33.726808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:33.727862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:33.728074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:33.728083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:33.728093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:33.728146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:33.728188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553921024950968:3115]
2025-10-02T09:28:33.728654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:33.728963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:33.729008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:33.729267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:33.729306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.729312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.729313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.729313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.729314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.729315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.729315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.729316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.729317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.729317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.729318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.729318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.729321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.729332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.729336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.729339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.729343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.729347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.729353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.729357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.729360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.729364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.729367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.729371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.729377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.729384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.729389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.729395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.729400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.729404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.729408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.729414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.729418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.729422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.729425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.729427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.729430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.729433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.729435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.729438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.729440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.729443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.729445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.729448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.729451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.729453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.729456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.729461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.729493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:33.738543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:33.740613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:33.740637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:33.740640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:33.740644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:33.740650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [2:7556553921024950968:3115]
2025-10-02T09:28:33.740663Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:33.740680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:33.740684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.740687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.740689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.740705Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:33.740710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:33.740717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:33.740787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.740796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.740798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.740829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:33.740832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:33.740903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:33.740912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.740926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.740937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.740953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:33.740978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469551:3361], now have 1 active actors on pipe
2025-10-02T09:28:33.740986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469355:2446], now have 1 active actors on pipe
2025-10-02T09:28:33.740992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.740995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.740996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.741008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:33.741029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:33.741045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:33.741052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:33.741056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 145
2025-10-02T09:28:33.741086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.741071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 145
2025-10-02T09:28:33.741092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:33.741117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:33.741128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:33.741130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:33.741136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:33.741262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.741272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.741308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:33.741316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.741320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.741322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:33.741333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.741342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:33.741358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.741704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.741721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.741741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.741857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0
2025-10-02T09:28:33.742263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f98ef30-1efca8a0-8e40bce3-7ee08c00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:33.745503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Write session: try to update token
2025-10-02T09:28:33.745520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:33.754459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:33.754483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:33.754491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.754533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:33.754544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:33.754719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:33.754876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:33.755042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:33.755226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:33.755444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:33.755494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:33.766449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:33.769276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:33.769296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:33.769299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:33.769301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:33.769309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.769313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.769316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553921024950963:3115]
2025-10-02T09:28:33.769355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:33.769361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.769361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:33.769364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:33.769366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:33.769370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:33.769507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:33.769597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:33.803807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553921100469568:3101]
2025-10-02T09:28:33.804067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7556553921100469568:3101]
2025-10-02T09:28:33.910143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:33.910480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.910495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.910513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469568:3101], now have 1 active actors on pipe
2025-10-02T09:28:33.910722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:33.910750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:33.910765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:33.910766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:33.910809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553921100469568:3101]
2025-10-02T09:28:33.910824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: error at write: Disconnected sessionId: src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0
2025-10-02T09:28:33.910985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0 is DEAD
2025-10-02T09:28:33.911117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:33.911125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Write session will restart in 0.005246s
2025-10-02T09:28:33.911168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Write session: Do CDS request
2025-10-02T09:28:33.911173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:33.917267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.917339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:33.917353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-10-02T09:28:33.917522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:33.917556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:33.917561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:33.917566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:33.918013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-10-02T09:28:33.918049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:33.918053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:33.918055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:33.918059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553921100469586:3365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:33.918583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553921100469586:3365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:33.921257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553921100469586:3365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:33.924341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553921100469586:3365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:33.924364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553921100469586:3365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:33.924369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553921100469586:3365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:33.924384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:33.925493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:33.926075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:33.926269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:33.926279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:33.926289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:33.926345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:33.926385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553921024951171:3118]
2025-10-02T09:28:33.926980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:33.927358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:33.927406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:33.927737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:33.927804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.927811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.927813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.927814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.927815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.927816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.927817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.927819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.927821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.927822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.927823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.927823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.927829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.927841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.927846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.927850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.927855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.927859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.927863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.927867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.927872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.927877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.927880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.927884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.927891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.927898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:33.927903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.927908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:33.927912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.927917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:33.927921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.927925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:33.927929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.927933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:33.927937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.927942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:33.927946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.927950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:33.927954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.927959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:33.927964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.927969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:33.927973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.927980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.927984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.927989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.927993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.927997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.928033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:33.937465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:33.939713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:33.939735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:33.939738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:33.939741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:33.939749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [2:7556553921024951171:3118]
2025-10-02T09:28:33.939762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:33.939779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:33.939782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.939785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.939787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.939802Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:33.939806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:33.939813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:33.939884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.939895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.939897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.939900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:33.939903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:33.939982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:33.939991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.940005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:33.940021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:33.940036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:33.940054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.940063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.940067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.940081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:33.940095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:33.940109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:33.940112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:33.940130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:33.940141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:33.940143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:33.940149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.940152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:33.940217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:33.940389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469571:2446], now have 1 active actors on pipe
2025-10-02T09:28:33.940401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553921100469765:3365], now have 1 active actors on pipe
2025-10-02T09:28:33.940362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 146
2025-10-02T09:28:33.940368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 146
2025-10-02T09:28:33.940474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.940485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.940509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:33.940515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:33.940518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:33.940520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:33.940530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:33.940542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:33.940560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.940742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:33.940753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:33.940769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:33.940885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0
2025-10-02T09:28:33.941290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1b9761-9a7f144f-918861db-911e3fd4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:33.944452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Write session: try to update token
2025-10-02T09:28:33.944473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:33.952506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:33.952526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:33.952528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:33.952530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:33.952542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.952546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.952550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553921024951166:3118]
2025-10-02T09:28:33.952590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:33.952596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:33.952598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:33.952612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:33.952618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:33.952621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:33.952733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:33.964308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:33.967374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:34.011226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553925395437075:3101]
2025-10-02T09:28:34.011529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7556553925395437075:3101]
2025-10-02T09:28:34.100865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:34.101339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.101354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.101367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437075:3101], now have 1 active actors on pipe
2025-10-02T09:28:34.101626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553925395437075:3101]
2025-10-02T09:28:34.101655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:34.101668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:34.101671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:34.101726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0
2025-10-02T09:28:34.101912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0 is DEAD
2025-10-02T09:28:34.102050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:34.102061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Write session will restart in 0.008704s
2025-10-02T09:28:34.102088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Write session: Do CDS request
2025-10-02T09:28:34.102095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:34.102238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:34.112311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.112416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:34.112432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-10-02T09:28:34.112568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.112599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:34.112604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:34.112611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:34.113249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-10-02T09:28:34.113328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:34.113338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:34.113341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:34.113348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553925395437187:3370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:34.114070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553925395437187:3370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:34.116488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553925395437187:3370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:34.116818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:34.117976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:34.118136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:34.118146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:34.118155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:34.118199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:34.118235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553925319918670:3121]
2025-10-02T09:28:34.118818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553925395437187:3370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:34.118828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:34.118832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553925395437187:3370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:34.118835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553925395437187:3370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:34.118842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:34.119182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:34.119252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:34.119593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:34.119661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.119667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.119668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.119669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.119670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.119671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.119672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.119673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.119674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.119675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.119676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.119677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.119683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.119692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.119696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.119699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.119702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.119706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.119709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.119712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.119716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.119720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.119723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.119727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.119733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.119740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.119746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.119752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.119756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.119761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.119765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.119770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.119775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.119780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.119784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.119789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.119792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.119798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.119802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.119807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.119810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.119816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.119820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.119825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.119829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.119834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.119837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.119849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.119885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:34.128773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:34.130720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:34.130739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:34.130741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:34.130745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:34.130750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [2:7556553925319918670:3121]
2025-10-02T09:28:34.130978Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:34.130998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:34.131004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.131007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.131008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.131019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:34.131028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:34.131034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:34.131079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.131084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.131086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.131088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:34.131090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:34.131176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:34.131187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.131201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.131212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.131229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:34.131256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437278:3370], now have 1 active actors on pipe
2025-10-02T09:28:34.131266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437080:2446], now have 1 active actors on pipe
2025-10-02T09:28:34.131275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.131276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.131278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.131294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:34.131309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:34.131315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:34.131320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:34.131322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:34.131329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:34.131332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:34.131317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 147
2025-10-02T09:28:34.131365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.131378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:34.131383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:34.131408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 147
2025-10-02T09:28:34.131438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.131449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.131470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:34.131481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.131490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.131492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:34.131501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.131515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:34.131532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.131665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.131673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.131685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.131779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 36 sessionId: src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0
2025-10-02T09:28:34.132118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2569ce-52c5e8b9-6a3b1d6a-1384ca9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:34.135273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Write session: try to update token
2025-10-02T09:28:34.135291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:34.142203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:34.142222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.142230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.142272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:34.142278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:34.142439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:34.142587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:34.142742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:34.142886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:34.143067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:34.143111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:34.149557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:34.152265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:34.152286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.152289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:34.152291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:34.152300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.152304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.152308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553925319918665:3121]
2025-10-02T09:28:34.152344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:34.152349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:34.152351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.152354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:34.152354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:34.152357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:34.152394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:34.152489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:34.201658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553925395437290:3101]
2025-10-02T09:28:34.201876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7556553925395437290:3101]
2025-10-02T09:28:34.298330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:34.298755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.298771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.298788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437290:3101], now have 1 active actors on pipe
2025-10-02T09:28:34.298966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:34.299007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:34.299010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:34.299061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0
2025-10-02T09:28:34.299254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0 is DEAD
2025-10-02T09:28:34.299011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:34.299412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553925395437290:3101]
2025-10-02T09:28:34.299564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:34.299574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Write session will restart in 0.005101s
2025-10-02T09:28:34.299602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Write session: Do CDS request
2025-10-02T09:28:34.299608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:34.306299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.306416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:34.306432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-10-02T09:28:34.306567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.306621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:34.306626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:34.306631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:34.307096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-10-02T09:28:34.307131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:34.307136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:34.307139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:34.307143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553925395437316:3375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:34.307680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553925395437316:3375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:34.309632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553925395437316:3375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:34.313265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553925395437316:3375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:34.313279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553925395437316:3375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:34.313282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553925395437316:3375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:34.313289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:34.326045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:34.327311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:34.327516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:34.327527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:34.327536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:34.327583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:34.327634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553925319918885:3124]
2025-10-02T09:28:34.328262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:34.328549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:34.328592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:34.328907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:34.328994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.329000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.329002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.329003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.329003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.329005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.329006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.329007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.329008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.329010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.329011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.329016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.329028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.329032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.329037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.329041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.329045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.329048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.329052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.329056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.329060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.329064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.329068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.329076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.329083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.329089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.329094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.329099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.329104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.329109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.329113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.329117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.329123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.329127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.329132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.329137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.329142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.329147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.329152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.329156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.329162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.329166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.329172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.329176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.329181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.329194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.329199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.329233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:34.340237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:34.342410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:34.342417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:34.342420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:34.342423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:34.342431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [2:7556553925319918885:3124]
2025-10-02T09:28:34.342446Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:34.342465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:34.342468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.342471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.342473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.342491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:34.342496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:34.342504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:34.343072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 148
2025-10-02T09:28:34.343110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 148
2025-10-02T09:28:34.342573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.342575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.342578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.342581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:34.342583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:34.342665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:34.342671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.342685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.342698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.342716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:34.342733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.342735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.342737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.342745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:34.342761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:34.342771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:34.342775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:34.342776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:34.342777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:34.342779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:34.342820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437362:3375], now have 1 active actors on pipe
2025-10-02T09:28:34.342824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437304:2446], now have 1 active actors on pipe
2025-10-02T09:28:34.342827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.342836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:34.343241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:34.344439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.344458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.344489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:34.344497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.344502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.344505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:34.344514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.344528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:34.344545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.344817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.344826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.344841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.344938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 36 sessionId: src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0
2025-10-02T09:28:34.345353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798bed63-aee9dccf-9b8cd1d1-3d2ff8dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:34.348762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Write session: try to update token
2025-10-02T09:28:34.348785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:34.358687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:34.358710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.358712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:34.358714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:34.358723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.358728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.358732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553925319918880:3124]
2025-10-02T09:28:34.358773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:34.358781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.358783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:34.358785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:34.358803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:34.358807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:34.358942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:34.371644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:34.374851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:34.401042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553925395437514:3101]
2025-10-02T09:28:34.401405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7556553925395437514:3101]
2025-10-02T09:28:34.501654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:34.502008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.502019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.502035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437514:3101], now have 1 active actors on pipe
2025-10-02T09:28:34.502189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:34.502247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:34.502248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:34.502260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:34.502281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553925395437514:3101]
2025-10-02T09:28:34.502311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: error at write: Disconnected sessionId: src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0
2025-10-02T09:28:34.502467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0 is DEAD
2025-10-02T09:28:34.502622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:34.502632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Write session will restart in 0.006189s
2025-10-02T09:28:34.502656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Write session: Do CDS request
2025-10-02T09:28:34.502662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:34.510193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.510260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:34.510272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-10-02T09:28:34.510405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.510438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:34.510444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:34.510447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:34.511009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-10-02T09:28:34.511033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:34.511037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:34.511038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:34.511041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553925395437558:3379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:34.511468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553925395437558:3379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:34.513653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553925395437558:3379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:34.515850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:34.515959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553925395437558:3379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:34.515970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553925395437558:3379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:34.515972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553925395437558:3379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:34.515979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:34.516185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:34.516296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:34.516303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:34.516310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:34.516338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:34.516366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553925319919089:3126]
2025-10-02T09:28:34.516771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:34.517085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:34.517112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:34.517326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:34.517364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.517369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.517369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.517370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.517370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.517371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.517372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.517372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.517373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.517373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.517374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.517374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.517377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.517388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.517391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.517395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.517399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.517402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.517406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.517410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.517412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.517414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.517416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.517418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.517422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.517427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.517430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.517433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.517435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.517438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.517440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.517443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.517446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.517449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.517451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.517454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.517457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.517459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.517462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.517466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.517468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.517471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.517473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.517475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.517478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.517480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.517482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.517485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.517503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:34.525859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:34.527651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:34.527669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:34.527672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:34.527676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:34.527683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [2:7556553925319919089:3126]
2025-10-02T09:28:34.527697Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:34.527714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:34.527722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.527725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.527727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.527741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:34.527746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:34.527753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:34.527829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.527837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.527840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.527843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:34.527845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:34.527993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:34.528001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.528014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.528029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.528050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:34.528079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437716:3379], now have 1 active actors on pipe
2025-10-02T09:28:34.528061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 149
2025-10-02T09:28:34.528082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437516:2446], now have 1 active actors on pipe
2025-10-02T09:28:34.528089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.528091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.528064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 149
2025-10-02T09:28:34.528092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.528101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:34.528110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:34.528113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:34.528114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:34.528115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:34.528129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:34.528131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:34.528149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.528157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.528193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.528204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:34.528218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cd83835-1e34095e-1d8c5d87-38946642_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:34.528221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:34.528227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.528231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.528233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:34.528240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.528248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:34.528289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.528421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.528431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.528444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.528513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 36 sessionId: src_id|9cd83835-1e34095e-1d8c5d87-38946642_0
2025-10-02T09:28:34.528858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae920b-7b3e9b7a-c33768e-e8a45550_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9cd83835-1e34095e-1d8c5d87-38946642_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:34.531832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Write session: try to update token
2025-10-02T09:28:34.531845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:34.538258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:34.538279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.538289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.538324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:34.538330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:34.538477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:34.538624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:34.538770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:34.538913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:34.539197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:34.539232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:34.546314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|9cd83835-1e34095e-1d8c5d87-38946642_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:34.548708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:34.548735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.548738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:34.548739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:34.548749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.548754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.548759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553925319919083:3126]
2025-10-02T09:28:34.548821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:34.548821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:34.548826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:34.548829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:34.548836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.548838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:34.549048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:34.549956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:34.602528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553925395437749:3101]
2025-10-02T09:28:34.602842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7556553925395437749:3101]
2025-10-02T09:28:34.688841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:34.689240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.689253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.689267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437749:3101], now have 1 active actors on pipe
2025-10-02T09:28:34.689502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:34.689526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553925395437749:3101]
2025-10-02T09:28:34.689539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:34.689560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:34.689626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cd83835-1e34095e-1d8c5d87-38946642_0
2025-10-02T09:28:34.689793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|9cd83835-1e34095e-1d8c5d87-38946642_0 is DEAD
2025-10-02T09:28:34.689933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:34.689943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Write session will restart in 0.008420s
2025-10-02T09:28:34.689961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Write session: Do CDS request
2025-10-02T09:28:34.689966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:34.699222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.699548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:34.699562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-10-02T09:28:34.699680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.699709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:34.699718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:34.699721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:34.700175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-10-02T09:28:34.700211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:34.700213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:34.700214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:34.700219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553925395437849:3390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:34.700728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553925395437849:3390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:34.702904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:34.702941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553925395437849:3390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:34.703719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:34.703974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:34.703984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:34.703995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:34.704042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:34.704078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553925319919330:3140]
2025-10-02T09:28:34.704529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:34.704777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:34.704816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:34.705038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:34.705029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553925395437849:3390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:34.705042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553925395437849:3390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:34.705046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553925395437849:3390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:34.705075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.705081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.705082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.705083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.705084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.705085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.705086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.705087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.705088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.705089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.705089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.705090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.705094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.705104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.705108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.705111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.705115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.705118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.705122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.705125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.705129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.705133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.705136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.705139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.705144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.705149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.705152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.705155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.705157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.705160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.705162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.705124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:34.705165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.705168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.705171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.705173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.705175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.705177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.705180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.705183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.705186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.705188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.705190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.705193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.705195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.705197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.705200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.705203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.705207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.705238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:34.713284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:34.715187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:34.715203Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:34.715205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:34.715208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:34.715214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [2:7556553925319919330:3140]
2025-10-02T09:28:34.715226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:34.715241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:34.715244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.715247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.715249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.715262Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:34.715267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:34.715273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:34.715326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.715336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.715338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.715341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:34.715343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:34.715402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:34.715409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.715421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.715437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.715454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:34.715475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437752:2446], now have 1 active actors on pipe
2025-10-02T09:28:34.715483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437959:3390], now have 1 active actors on pipe
2025-10-02T09:28:34.715490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.715492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.715495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.715506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:34.715518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:34.715520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:34.715521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:34.715521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:34.715507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 150
2025-10-02T09:28:34.715533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:34.715509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 150
2025-10-02T09:28:34.715540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:34.715579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.715588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.715601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.715613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:34.715641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:34.715643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd3fe759-af382483-ae0c22e7-341424a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:34.715649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.715653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.715655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:34.715662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.715670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:34.715693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.715830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.715837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.715850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.715964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd3fe759-af382483-ae0c22e7-341424a8_0
2025-10-02T09:28:34.716312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd83835-1e34095e-1d8c5d87-38946642_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd3fe759-af382483-ae0c22e7-341424a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:34.719605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Write session: try to update token
2025-10-02T09:28:34.719624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:34.726762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:34.726783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.726785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:34.726788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:34.726796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.726800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.726804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553925319919325:3140]
2025-10-02T09:28:34.726847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:34.726858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.726861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:34.726872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:34.726889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:34.726893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:34.727027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:34.736051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|bd3fe759-af382483-ae0c22e7-341424a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:34.739115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:34.789958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553925395437977:3101]
2025-10-02T09:28:34.790205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7556553925395437977:3101]
2025-10-02T09:28:34.855352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:34.855820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.855837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.855855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437977:3101], now have 1 active actors on pipe
2025-10-02T09:28:34.856107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:34.856148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553925395437977:3101]
2025-10-02T09:28:34.856154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:34.856156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:34.856105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:34.856217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: error at write: Disconnected sessionId: src_id|bd3fe759-af382483-ae0c22e7-341424a8_0
2025-10-02T09:28:34.856387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|bd3fe759-af382483-ae0c22e7-341424a8_0 is DEAD
2025-10-02T09:28:34.856534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:34.856543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Write session will restart in 0.006273s
2025-10-02T09:28:34.856563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Write session: Do CDS request
2025-10-02T09:28:34.856570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:34.864282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.864349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:34.864365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-10-02T09:28:34.864476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:34.864504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:34.864513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:34.864516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:34.864904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-10-02T09:28:34.864940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:34.864947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:34.864949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:34.864953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553925395438024:3395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:34.865492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553925395438024:3395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:34.868171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553925395438024:3395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:34.870581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:34.871192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553925395438024:3395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:34.871213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553925395438024:3395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:34.871219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553925395438024:3395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:34.871233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:34.871586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:34.871772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:34.871780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:34.871789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:34.871832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:34.871866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553925319919539:3143]
2025-10-02T09:28:34.872293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:34.872671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:34.872717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:34.872970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:34.873019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.873026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.873027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.873028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.873029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.873030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.873031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.873033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.873034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.873035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.873036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.873037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.873042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.873053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.873057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.873061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.873064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.873068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.873072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.873075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.873079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.873083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.873087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.873090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.873096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.873103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:34.873108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.873115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:34.873118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.873122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:34.873130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.873135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:34.873139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.873147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:34.873151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.873160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:34.873165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.873174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:34.873177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.873182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:34.873187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.873191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:34.873196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.873201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.873205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.873209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.873213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.873217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.873251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:34.882173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:34.884201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:34.884220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:34.884223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:34.884227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:34.884234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [2:7556553925319919539:3143]
2025-10-02T09:28:34.884250Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:34.884267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:34.884271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.884273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.884275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.884291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:34.884296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:34.884309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:34.884373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.884383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.884385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.884388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:34.884391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:34.884460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:34.884468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.884483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:34.884499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:34.884521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:34.884544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395437978:2446], now have 1 active actors on pipe
2025-10-02T09:28:34.884553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395438181:3395], now have 1 active actors on pipe
2025-10-02T09:28:34.884559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.884561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.884564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.884579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:34.884596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:34.884597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:34.884599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:34.884601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:34.884610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:34.884613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:34.884644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.884658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:34.884635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 151
2025-10-02T09:28:34.884678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:34.884693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 151
2025-10-02T09:28:34.884746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.884755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.884778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:34.884788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:34.884792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:34.884794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:34.884816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:34.884826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:34.884838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.885046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:34.885057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:34.885080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:34.885374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 36 sessionId: src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0
2025-10-02T09:28:34.885710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3fe759-af382483-ae0c22e7-341424a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:34.888795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Write session: try to update token
2025-10-02T09:28:34.888844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:34.898780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:34.898807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:34.898810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:34.898813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:34.898823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.898828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.898832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553925319919533:3143]
2025-10-02T09:28:34.898880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:34.898884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:34.898890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:34.898891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:34.898892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:34.898895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:34.899040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:34.905133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:34.908177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:34.956343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553925395438192:3101]
2025-10-02T09:28:34.956580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7556553925395438192:3101]
2025-10-02T09:28:35.040845Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:35.041135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.041145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.041178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553925395438192:3101], now have 1 active actors on pipe
2025-10-02T09:28:35.041406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:35.041430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:35.041448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553925395438192:3101]
2025-10-02T09:28:35.041454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:35.041457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:35.041513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: error at write: Disconnected sessionId: src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0
2025-10-02T09:28:35.041684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0 is DEAD
2025-10-02T09:28:35.041804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:35.041814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Write session will restart in 0.009081s
2025-10-02T09:28:35.041837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Write session: Do CDS request
2025-10-02T09:28:35.041843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:35.052222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.052316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:35.052331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-10-02T09:28:35.052435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.052464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:35.052469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:35.052477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:35.052878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-10-02T09:28:35.052907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:35.052912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:35.052914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:35.052918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553929690405658:3399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:35.053001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:35.053410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553929690405658:3399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:35.053811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:35.053956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:35.053966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:35.053973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:35.054015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:35.054048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553929614887041:3145]
2025-10-02T09:28:35.054540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:35.054755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:35.054790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:35.055060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:35.055105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.055111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.055112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.055113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.055114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.055115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.055116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.055117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.055118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.055119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.055120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.055122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.055126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.055135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.055138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.055141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.055144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.055147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.055159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.055162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.055166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.055169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.055172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.055176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.055183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.055190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.055195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.055200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.055204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.055209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.055212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.055217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.055221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.055225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.055229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.055233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.055237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.055247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.055250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.055256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.055265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.055270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.055273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.055278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.055282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.055286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.055290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.055294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.055330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:35.055426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553929690405658:3399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:35.060742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553929690405658:3399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:35.060756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553929690405658:3399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:35.060759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553929690405658:3399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:35.060767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:35.063879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:35.065681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:35.065698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:35.065700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:35.065704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:35.065710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [2:7556553929614887041:3145]
2025-10-02T09:28:35.065725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:35.065740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:35.065743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.065745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.065748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.065762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:35.065766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:35.065772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:35.065827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.065836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.065838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.065840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:35.065842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:35.065905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:35.065914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.065927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.065935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.065949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:35.065970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.065972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.065974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.065983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:35.065990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:35.065993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:35.065995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:35.065996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:35.066007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:35.066019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:35.066029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405491:2446], now have 1 active actors on pipe
2025-10-02T09:28:35.066032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405698:3399], now have 1 active actors on pipe
2025-10-02T09:28:35.066059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.066072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:35.066097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:35.066121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 152
2025-10-02T09:28:35.066149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 152
2025-10-02T09:28:35.066266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.066276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.066300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:35.066312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.066315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.066317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:35.066325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.066339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:35.066354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.066533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.066540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.066551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.066615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0
2025-10-02T09:28:35.066919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91273a12-795fc0c0-7c1b96f4-c2b1298c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:35.070008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Write session: try to update token
2025-10-02T09:28:35.070023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:35.080466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:35.080488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.080497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.080538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:35.080543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:35.080687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:35.080839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:35.080971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:35.081084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:35.081306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:35.081339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:35.083548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:35.085325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:35.085342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.085344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:35.085345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:35.085352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.085356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.085359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553929614887035:3145]
2025-10-02T09:28:35.085390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:35.085393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:35.085399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:35.085399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.085401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:35.085402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:35.085536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:35.086298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:35.141674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553929690405707:3101]
2025-10-02T09:28:35.141909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7556553929690405707:3101]
2025-10-02T09:28:35.222529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:35.222927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.222944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.222962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405707:3101], now have 1 active actors on pipe
2025-10-02T09:28:35.223172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:35.223179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:35.223227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:35.223227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553929690405707:3101]
2025-10-02T09:28:35.223231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:35.223621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:35.223631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Write session will restart in 0.008046s
2025-10-02T09:28:35.223653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Write session: Do CDS request
2025-10-02T09:28:35.223658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:35.223295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: error at write: Disconnected sessionId: src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0
2025-10-02T09:28:35.223479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0 is DEAD
2025-10-02T09:28:35.233334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.233468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:35.233487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-10-02T09:28:35.233644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.233683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:35.233694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:35.233698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:35.234219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-10-02T09:28:35.234269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:35.234279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:35.234281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:35.234287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553929690405786:3404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:35.234861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553929690405786:3404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:35.237360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553929690405786:3404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:35.238520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:35.239620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:35.239817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:35.239842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:35.239856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:35.239911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:35.239950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553929614887252:3148]
2025-10-02T09:28:35.240100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553929690405786:3404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:35.240117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553929690405786:3404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:35.240120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553929690405786:3404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:35.240128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:35.240463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:35.240705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:35.240734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:35.241057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:35.241103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.241107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.241109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.241109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.241110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.241111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.241111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.241112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.241112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.241113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.241114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.241114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.241117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.241124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.241126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.241129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.241131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.241133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.241135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.241138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.241140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.241142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.241144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.241147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.241151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.241156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.241159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.241162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.241166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.241169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.241171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.241174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.241177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.241179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.241182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.241187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.241191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.241196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.241199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.241203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.241208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.241213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.241217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.241220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.241222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.241225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.241228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.241231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.241248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:35.250543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:35.252768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:35.252794Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:35.252796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:35.252915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:35.252929Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [2:7556553929614887252:3148]
2025-10-02T09:28:35.252944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:35.252963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:35.252965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.252968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.252970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.252986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:35.252990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:35.252998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:35.253069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.253076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.253078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.253081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:35.253083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:35.253157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:35.253164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.253177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.253185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.253203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:35.253226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405914:3404], now have 1 active actors on pipe
2025-10-02T09:28:35.253232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405710:2446], now have 1 active actors on pipe
2025-10-02T09:28:35.253238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.253240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.253242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.253252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:35.253265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:35.253265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:35.253269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:35.253271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:35.253281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:35.253284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:35.253317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.253328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:35.253324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 153
2025-10-02T09:28:35.253327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 153
2025-10-02T09:28:35.253353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:35.253363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.253367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.253392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:35.253402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.253406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.253407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:35.253416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.253426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:35.253444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.253583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.253591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.253602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.253697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0
2025-10-02T09:28:35.254022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f4750c-cd3aefb9-18deaf55-9726fe9e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:35.257389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Write session: try to update token
2025-10-02T09:28:35.257406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:35.264994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:35.265018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.265026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.265066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:35.265079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:35.265233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:35.265378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:35.265518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:35.265659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:35.265860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:35.265901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:35.273320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:35.274906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:35.274926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.274929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:35.274931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:35.274941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.274945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.274952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553929614887247:3148]
2025-10-02T09:28:35.274988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:35.275000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.275009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:35.275008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:35.275015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:35.275020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:35.275162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:35.276377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:35.323427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553929690405937:3101]
2025-10-02T09:28:35.323664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7556553929690405937:3101]
2025-10-02T09:28:35.350564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:28:35.350589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T09:28:35.420880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:35.421381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.421402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.421423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405937:3101], now have 1 active actors on pipe
2025-10-02T09:28:35.421711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553929690405937:3101]
2025-10-02T09:28:35.421746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:35.421821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0
2025-10-02T09:28:35.421970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:35.421986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T09:28:35.422021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0 is DEAD
2025-10-02T09:28:35.421688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:35.423437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:35.423519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Write session will restart in 0.008935s
2025-10-02T09:28:35.423566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Write session: Do CDS request
2025-10-02T09:28:35.423574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:35.433383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.433623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:35.433639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-10-02T09:28:35.433806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.433840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:35.433849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:35.433853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:35.434318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-10-02T09:28:35.434352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:35.434356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:35.434358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:35.434362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553929690406011:3409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:35.434960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553929690406011:3409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:35.437665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553929690406011:3409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:35.439440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:35.440434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:35.440627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:35.440636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:35.440644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:35.440702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553929690406011:3409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:35.440715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553929690406011:3409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:35.440719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553929690406011:3409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:35.440727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:35.440697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:35.440744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553929614887474:3152]
2025-10-02T09:28:35.441325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:35.441694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:35.441749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:35.442098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:35.442155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.442161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.442163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.442164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.442165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.442166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.442168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.442169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.442170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.442171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.442173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.442174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.442179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.442190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.442203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.442207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.442210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.442214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.442218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.442222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.442226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.442230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.442234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.442237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.442245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.442252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.442258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.442263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.442268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.442273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.442278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.442286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.442291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.442310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.442319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.442324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.442329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.442334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.442338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.442343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.442347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.442352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.442356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.442361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.442366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.442371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.442377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.442382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.442424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:35.451704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:35.453974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:35.454000Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:35.454003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:35.454006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:35.454012Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [2:7556553929614887474:3152]
2025-10-02T09:28:35.454026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:35.454043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:35.454046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.454049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.454050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.454066Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:35.454076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:35.454083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:35.454153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.454160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.454162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.454165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:35.454168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:35.454250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:35.454259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.454273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.454282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.454296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:35.454314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690405942:2446], now have 1 active actors on pipe
2025-10-02T09:28:35.454318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406147:3409], now have 1 active actors on pipe
2025-10-02T09:28:35.454325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.454327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.454329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.454337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:35.454347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:35.454349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:35.454350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:35.454352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:35.454362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:35.454365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:35.454396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.454414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:35.454427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:35.454498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 154
2025-10-02T09:28:35.454555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 154
2025-10-02T09:28:35.454616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.454634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.454739Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:28:35.454770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|201f978e-b3845cb-c14a9a2-2202323e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:35.454782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.454787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.454789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:35.454798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.454808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:35.454830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.454996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.455006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.455019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.455107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 36 sessionId: src_id|201f978e-b3845cb-c14a9a2-2202323e_0
2025-10-02T09:28:35.455194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:28:35.455351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:28:35.455435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-02T09:28:35.455513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ae457e-10df32b4-b8fb7952-e1fc69ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|201f978e-b3845cb-c14a9a2-2202323e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:35.458565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Write session: try to update token
2025-10-02T09:28:35.458586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:35.466052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:35.466073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.466076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:35.466078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:35.466088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.466092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.466096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553929614887469:3152]
2025-10-02T09:28:35.466137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:35.466143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.466154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:35.466154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:35.466160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:35.466163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:35.466301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:35.473613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|201f978e-b3845cb-c14a9a2-2202323e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:35.476438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:35.522114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553929690406164:3101]
2025-10-02T09:28:35.522361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7556553929690406164:3101]
2025-10-02T09:28:35.613956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:35.614317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.614338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.614354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406164:3101], now have 1 active actors on pipe
2025-10-02T09:28:35.614543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553929690406164:3101]
2025-10-02T09:28:35.614584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:35.614615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:35.614621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:35.614639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:35.614670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: error at write: Disconnected sessionId: src_id|201f978e-b3845cb-c14a9a2-2202323e_0
2025-10-02T09:28:35.614844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|201f978e-b3845cb-c14a9a2-2202323e_0 is DEAD
2025-10-02T09:28:35.615005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:35.615014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Write session will restart in 0.005027s
2025-10-02T09:28:35.615037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Write session: Do CDS request
2025-10-02T09:28:35.615043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:35.621344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.621697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:35.621715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-10-02T09:28:35.621810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.621836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:35.621843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:35.621847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:35.622200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-10-02T09:28:35.622229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:35.622231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:35.622233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:35.622238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553929690406197:3419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:35.622671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553929690406197:3419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:35.625660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553929690406197:3419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:35.629039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553929690406197:3419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:35.629061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553929690406197:3419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:35.629064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553929690406197:3419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:35.629072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:35.630018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:35.631449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:35.631635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:35.631649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:35.631659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:35.631713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:35.631766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553929614887699:3161]
2025-10-02T09:28:35.632346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:35.632699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:35.632750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:35.633064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:35.633122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.633127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.633128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.633129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.633130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.633132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.633133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.633134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.633135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.633136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.633137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.633138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.633143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.633153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.633157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.633161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.633164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.633168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.633171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.633175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.633178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.633182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.633185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.633189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.633194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.633201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.633206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.633215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.633219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.633223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.633227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.633236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.633240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.633245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.633248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.633253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.633257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.633267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.633274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.633282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.633286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.633291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.633299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.633303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.633308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.633317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.633321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.633326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.633362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:35.642888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:35.645618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:35.645655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:35.645657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:35.645661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:35.645667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [2:7556553929614887699:3161]
2025-10-02T09:28:35.645681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:35.645699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:35.645701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.645704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.645706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.645720Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:35.645731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:35.645737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:35.645799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.645808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.645810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.645813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:35.645815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:35.645884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:35.645892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.645907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.645924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.645945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:35.645968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406182:2446], now have 1 active actors on pipe
2025-10-02T09:28:35.645976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406384:3419], now have 1 active actors on pipe
2025-10-02T09:28:35.645983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.645987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.645989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.646003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:35.646015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:35.646024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:35.646028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:35.646029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:35.646033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:35.646036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:35.646027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 155
2025-10-02T09:28:35.646073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 155
2025-10-02T09:28:35.646074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.646090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:35.646095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:35.646174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.646185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.646225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:35.646239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.646243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.646244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:35.646253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.646267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:35.646291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.646434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.646443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.646456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.646534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 36 sessionId: src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0
2025-10-02T09:28:35.646897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201f978e-b3845cb-c14a9a2-2202323e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:35.650295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Write session: try to update token
2025-10-02T09:28:35.650314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:35.657599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:35.657618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.657620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:35.657621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:35.657627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.657631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.657634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553929614887694:3161]
2025-10-02T09:28:35.657672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:35.657671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:35.657676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:35.657678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.657678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:35.657680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:35.657817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:35.665318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:35.668366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:35.714586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553929690406414:3101]
2025-10-02T09:28:35.714846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7556553929690406414:3101]
2025-10-02T09:28:35.805305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:35.805964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.805977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.805994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406414:3101], now have 1 active actors on pipe
2025-10-02T09:28:35.806187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:35.806205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:35.806222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:35.806292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: error at write: Disconnected sessionId: src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0
2025-10-02T09:28:35.806309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553929690406414:3101]
2025-10-02T09:28:35.806341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:35.806456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0 is DEAD
2025-10-02T09:28:35.806601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:35.806609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Write session will restart in 0.005367s
2025-10-02T09:28:35.806627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Write session: Do CDS request
2025-10-02T09:28:35.806631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:35.813335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.813451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:35.813464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-10-02T09:28:35.813609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:35.813640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:35.813650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:35.813655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:35.814740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-10-02T09:28:35.814783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:35.814785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:35.814787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:35.814793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553929690406434:3425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:35.815361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553929690406434:3425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:35.818032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553929690406434:3425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:35.821297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553929690406434:3425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:35.821310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553929690406434:3425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:35.821314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553929690406434:3425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:35.821323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:35.822039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:35.822874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:35.823102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:35.823116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:35.823127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:35.823188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:35.823232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553929614887935:3170]
2025-10-02T09:28:35.823915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:35.824161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:35.824201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:35.824538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:35.824590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.824598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.824599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.824600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.824601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.824602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.824603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.824604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.824606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.824607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.824608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.824609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.824615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.824626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.824630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.824634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.824638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.824643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.824647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.824651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.824655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.824659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.824663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.824667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.824674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.824682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:35.824689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.824696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:35.824701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.824706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:35.824711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.824716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:35.824721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.824727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:35.824731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.824737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:35.824742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.824748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:35.824753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.824765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:35.824769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.824775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:35.824780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.824785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.824790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.824796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.824828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.824839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.824876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:35.833792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:35.835687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:35.835708Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:35.835712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:35.835717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:35.835725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [2:7556553929614887935:3170]
2025-10-02T09:28:35.835742Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:35.835763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:35.835767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.835770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.835773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.835791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:35.835797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:35.835804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:35.835870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.835881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.835884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.835888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:35.835891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:35.835970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:35.835980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.835995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:35.836005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:35.836021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:35.836049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406419:2446], now have 1 active actors on pipe
2025-10-02T09:28:35.836058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406623:3425], now have 1 active actors on pipe
2025-10-02T09:28:35.836066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.836068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.836071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.836086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:35.836104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:35.836124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:35.836127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:35.836134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:35.836150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:35.836152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:35.836164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.836168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:35.836156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 156
2025-10-02T09:28:35.836160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 156
2025-10-02T09:28:35.836182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:35.836548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.836563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.836596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:35.836604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:35.836609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:35.836611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:35.836623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:35.836635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:35.836659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.836905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.836916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.836930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:35.837048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 36 sessionId: src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0
2025-10-02T09:28:35.837446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f5bc7e-c3af861e-ecd52d36-9f5feb6a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:35.840535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Write session: try to update token
2025-10-02T09:28:35.840555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:35.847486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:35.847511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:35.847514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:35.847516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:35.847526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.847533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.847538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553929614887930:3170]
2025-10-02T09:28:35.847583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:35.847592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:35.847595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:35.847618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:35.847647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:35.847655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:35.847740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:35.855052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:35.858029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:35.906626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553929690406638:3101]
2025-10-02T09:28:35.906866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7556553929690406638:3101]
2025-10-02T09:28:35.991640Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:35.992200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:35.992219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:35.992243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406638:3101], now have 1 active actors on pipe
2025-10-02T09:28:35.992483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:35.993004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:35.993019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Write session will restart in 0.008337s
2025-10-02T09:28:35.992509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:35.992553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553929690406638:3101]
2025-10-02T09:28:35.992564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:35.992567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:35.993044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Write session: Do CDS request
2025-10-02T09:28:35.993052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:35.992639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: error at write: Disconnected sessionId: src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0
2025-10-02T09:28:35.992816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0 is DEAD
2025-10-02T09:28:36.002318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.002454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:36.002469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-10-02T09:28:36.002637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.002669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:36.002678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:36.002683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:36.003496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-10-02T09:28:36.003546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:36.003548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:36.003549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:36.003555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553933985374066:3429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:36.004101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553933985374066:3429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:36.005743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:36.006253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553933985374066:3429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:36.006720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:36.006908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:36.006920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:36.006931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:36.006984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:36.007022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553933909855442:3172]
2025-10-02T09:28:36.007589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:36.007904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:36.007947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:36.008242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:36.008299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.008305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.008306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.008306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.008307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.008308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.008309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.008310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.008311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.008312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.008313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.008314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.008318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.008329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.008333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.008336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.008341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.008345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.008348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.008355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.008359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.008364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.008368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.008372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.008379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.008387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.008398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.008404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.008408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.008413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.008418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.008423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.008428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.008437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.008441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.008446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.008452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.008458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.008466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.008471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.008477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.008481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.008487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.008492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.008497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.008507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.008511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.008516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.008552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:36.008712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553933985374066:3429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:36.008725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553933985374066:3429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:36.008729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553933985374066:3429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:36.008736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:36.017664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:36.019650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:36.019676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:36.019680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:36.019685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:36.019693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [2:7556553933909855442:3172]
2025-10-02T09:28:36.019996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:36.020025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:36.020036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.020039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.020042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.020062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:36.020068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:36.020082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:36.020160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.020170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.020173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.020176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:36.020179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:36.020257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:36.020269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.020285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.020297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.020313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:36.020337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374148:3429], now have 1 active actors on pipe
2025-10-02T09:28:36.020349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553929690406642:2446], now have 1 active actors on pipe
2025-10-02T09:28:36.020356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.020359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.020362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.020379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:36.020402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:36.020403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:36.020408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:36.020412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:36.020428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:36.020438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:36.020436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 157
2025-10-02T09:28:36.020486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.020438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 157
2025-10-02T09:28:36.020502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:36.020510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:36.020534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.020544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.020599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:36.020612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.020616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.020619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:36.020629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.020639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:36.020673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.020892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.020911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.020936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.021046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 36 sessionId: src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0
2025-10-02T09:28:36.021405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f94086-433b6de6-78f34f8b-3b6f6d8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:36.024688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Write session: try to update token
2025-10-02T09:28:36.024706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:36.032267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:36.032289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.032292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:36.032295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:36.032305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.032311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.032316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553933909855437:3172]
2025-10-02T09:28:36.032369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:36.032372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:36.032376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.032378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:36.032381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:36.032385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:36.032891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:36.041604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:36.044624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:36.092784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553933985374157:3101]
2025-10-02T09:28:36.093242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7556553933985374157:3101]
2025-10-02T09:28:36.181034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:36.181539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.181559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.181582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374157:3101], now have 1 active actors on pipe
2025-10-02T09:28:36.181848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:36.181858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:36.181858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:36.181864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:36.181908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553933985374157:3101]
2025-10-02T09:28:36.181946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: error at write: Disconnected sessionId: src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0
2025-10-02T09:28:36.182117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0 is DEAD
2025-10-02T09:28:36.182325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:36.182336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Write session will restart in 0.008897s
2025-10-02T09:28:36.182356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Write session: Do CDS request
2025-10-02T09:28:36.182362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:36.192373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.192513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:36.192530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-10-02T09:28:36.197079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.197133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:36.197138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:36.197144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:36.197555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-10-02T09:28:36.197588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:36.197590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:36.197591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:36.197597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553933985374343:3434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:36.198036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553933985374343:3434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:36.198900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:36.199867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553933985374343:3434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:36.200288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:36.200601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:36.200618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:36.200650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:36.200841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:36.200899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553933909855658:3175]
2025-10-02T09:28:36.201595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:36.201905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:36.201959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:36.202246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553933985374343:3434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:36.202262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553933985374343:3434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:36.202266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553933985374343:3434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:36.202275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:36.202322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:36.202388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.202395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.202396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.202398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.202399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.202400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.202401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.202403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.202405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.202406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.202408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.202409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.202416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.202427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.202431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.202435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.202439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.202443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.202447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.202450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.202454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.202459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.202462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.202466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.202473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.202481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.202487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.202493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.202498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.202503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.202508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.202513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.202518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.202524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.202529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.202535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.202541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.202546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.202551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.202556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.202560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.202565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.202569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.202575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.202580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.202585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.202590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.202596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.202630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:36.211873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:36.214085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:36.214102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:36.214103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:36.214106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:36.214113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [2:7556553933909855658:3175]
2025-10-02T09:28:36.214124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:36.214138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:36.214140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.214142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.214143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.214155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:36.214158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:36.214162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:36.214215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.214216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.214218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.214220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:36.214222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:36.214290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:36.214296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.214309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.214319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.214333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:36.214353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374382:3434], now have 1 active actors on pipe
2025-10-02T09:28:36.214365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374160:2446], now have 1 active actors on pipe
2025-10-02T09:28:36.214369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.214371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.214372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.214381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:36.214394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:36.214396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:36.214398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:36.214400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:36.214408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:36.214412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:36.214444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.214451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:36.214459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:36.214474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 158
2025-10-02T09:28:36.214483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 158
2025-10-02T09:28:36.214590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.214601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.214626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc737b05-168644db-752105ec-aaf76477_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:36.214638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.214642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.214645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:36.214653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.214662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:36.214680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.214800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.214807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.214818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.214883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc737b05-168644db-752105ec-aaf76477_0
2025-10-02T09:28:36.216959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fe2333-9c1676c5-1f8b5524-a959ac05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc737b05-168644db-752105ec-aaf76477_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:36.220036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Write session: try to update token
2025-10-02T09:28:36.220057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:36.226225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:36.226250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.226253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:36.226255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:36.226264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.226268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.226273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553933909855653:3175]
2025-10-02T09:28:36.226318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:36.226323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:36.226325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.226328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:36.226330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:36.226346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:36.226473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:36.244970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|cc737b05-168644db-752105ec-aaf76477_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:36.248090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:36.281927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553933985374391:3101]
2025-10-02T09:28:36.285040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7556553933985374391:3101]
2025-10-02T09:28:36.375626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553933985374391:3101]
2025-10-02T09:28:36.375640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:36.375672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:36.375675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:36.375759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: error at write: Disconnected sessionId: src_id|cc737b05-168644db-752105ec-aaf76477_0
2025-10-02T09:28:36.375956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|cc737b05-168644db-752105ec-aaf76477_0 is DEAD
2025-10-02T09:28:36.376360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:36.376376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Write session will restart in 0.009537s
2025-10-02T09:28:36.376397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Write session: Do CDS request
2025-10-02T09:28:36.376404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:36.374875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:36.375367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.375375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.375394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374391:3101], now have 1 active actors on pipe
2025-10-02T09:28:36.377095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:36.387306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.387428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:36.387450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-10-02T09:28:36.387684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.387730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:36.387735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:36.387740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:36.388455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-10-02T09:28:36.388491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:36.388492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:36.388494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:36.388499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553933985374462:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:36.389073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553933985374462:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:36.392061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553933985374462:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:36.397363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:36.397209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553933985374462:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:36.397228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553933985374462:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:36.397231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553933985374462:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:36.397239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:36.398634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:36.398838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:36.398848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:36.398875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:36.398925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:36.398966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553933909855887:3178]
2025-10-02T09:28:36.399571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:36.399879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:36.399929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:36.400225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:36.400283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.400289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.400290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.400291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.400292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.400292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.400294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.400295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.400295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.400297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.400298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.400299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.400304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.400314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.400317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.400321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.400324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.400327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.400331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.400334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.400337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.400340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.400344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.400347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.400354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.400360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.400366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.400370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.400374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.400379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.400384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.400388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.400392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.400396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.400400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.400404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.400408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.400413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.400416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.400421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.400425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.400429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.400433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.400437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.400441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.400445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.400449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.400453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.400485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:36.412465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 159
2025-10-02T09:28:36.412495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 159
2025-10-02T09:28:36.409823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:36.412019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:36.412026Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:36.412028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:36.412031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:36.412039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [2:7556553933909855887:3178]
2025-10-02T09:28:36.412053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:36.412071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:36.412074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.412077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.412079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.412094Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:36.412099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:36.412105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:36.412168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.412170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.412172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.412176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:36.412178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:36.412262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:36.412265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.412280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.412292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.412310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:36.412328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374406:2446], now have 1 active actors on pipe
2025-10-02T09:28:36.412332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374614:3439], now have 1 active actors on pipe
2025-10-02T09:28:36.412340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.412342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.412345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.412358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:36.412371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:36.412375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:36.412378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:36.412381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:36.412386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:36.412389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:36.412422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.412431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:36.412510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:36.412698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.412704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.412728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:36.412734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.412737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.412740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:36.412749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.412758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:36.412772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.413006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.413010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.413024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.413120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0
2025-10-02T09:28:36.413496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc737b05-168644db-752105ec-aaf76477_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:36.416791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Write session: try to update token
2025-10-02T09:28:36.416866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:36.432331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:36.432356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.432359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:36.432361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:36.432370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.432374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.432378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553933909855881:3178]
2025-10-02T09:28:36.432418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:36.432425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.432427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:36.432438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:36.432445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:36.432449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:36.432578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:36.432579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:36.435601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:36.475960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553933985374627:3101]
2025-10-02T09:28:36.476476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7556553933985374627:3101]
2025-10-02T09:28:36.595088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:36.595554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.595566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.595626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374627:3101], now have 1 active actors on pipe
2025-10-02T09:28:36.596002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:36.596272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553933985374627:3101]
2025-10-02T09:28:36.596305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:36.596308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:36.596361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: error at write: Disconnected sessionId: src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0
2025-10-02T09:28:36.596536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0 is DEAD
2025-10-02T09:28:36.596674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:36.601097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:36.601109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Write session will restart in 0.009890s
2025-10-02T09:28:36.601134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Write session: Do CDS request
2025-10-02T09:28:36.601141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:36.612457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.613348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:36.613363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-10-02T09:28:36.613490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.613517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:36.613522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:36.613526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:36.614256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-10-02T09:28:36.614289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:36.614290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:36.614292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:36.614297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553933985374703:3445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:36.614863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553933985374703:3445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:36.618778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553933985374703:3445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:36.622330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553933985374703:3445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:36.622344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553933985374703:3445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:36.622348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553933985374703:3445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:36.622356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:36.626105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:36.627545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:36.627748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:36.627761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:36.627772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:36.627833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:36.627890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553933909856102:3180]
2025-10-02T09:28:36.628442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:36.628847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:36.628900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:36.629217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:36.629275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.629276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.629277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.629278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.629279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.629280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.629282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.629283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.629284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.629285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.629286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.629288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.629293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.629304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.629308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.629312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.629315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.629319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.629323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.629327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.629330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.629334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.629338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.629341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.629348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.629355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.629361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.629367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.629371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.629376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.629381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.629386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.629390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.629396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.629400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.629405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.629411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.629416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.629420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.629425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.629431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.629436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.629440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.629445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.629449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.629455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.629459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.629465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.629502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:36.639773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:36.641911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:36.641928Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:36.641931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:36.641935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:36.641941Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [2:7556553933909856102:3180]
2025-10-02T09:28:36.641957Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:36.641977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:36.641980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.641982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.641984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.642001Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:36.642006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:36.642012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:36.642077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.642085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.642088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.642091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:36.642093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:36.642338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 160
2025-10-02T09:28:36.642341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 160
2025-10-02T09:28:36.642411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:36.642420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.642433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.642449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.642472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:36.642495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374633:2446], now have 1 active actors on pipe
2025-10-02T09:28:36.642503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374813:3445], now have 1 active actors on pipe
2025-10-02T09:28:36.642520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.642529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.642544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.642546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.642548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.642561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:36.642577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:36.642581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:36.642587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:36.642589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:36.642595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:36.642598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:36.642612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:36.642623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.642626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.642628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:36.642637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.642647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:36.642684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.642696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:36.642708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.642718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:36.642967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.642978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.642998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.643103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 36 sessionId: src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0
2025-10-02T09:28:36.643486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0278ad-9b7c24ae-a9febf88-3860d89f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:36.647007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Write session: try to update token
2025-10-02T09:28:36.647023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:36.662781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:36.662798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.662806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.662843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:36.662849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:36.663021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:36.663148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:36.663179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:36.663331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:36.663464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:36.663644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:36.663682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:36.666031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:36.666189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.666205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.666231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:36.666308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:36.667590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:36.667604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.667606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:36.667608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:36.667614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.667618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.667621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553933909856096:3180]
2025-10-02T09:28:36.667654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:36.667663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.667664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:36.667664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:36.667671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:36.667675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:36.667803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:36.696630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553933985374878:3101]
2025-10-02T09:28:36.696892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7556553933985374878:3101]
2025-10-02T09:28:36.793044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:36.800221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.800239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.800389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.800449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.800518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.800587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.800784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.800791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.800880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.800943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.801006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.801075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.801125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.801131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.801199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.801256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.801319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.801388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.801435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.801440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.801509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.801575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.801643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.801703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.801746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.801751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.801822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.801880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.801934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.801987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.802032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.802038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.802100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.802156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.802219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.802280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.802324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.802329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.802407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.802466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.802528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.802596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.802645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.802651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.802720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.802776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.802839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.802907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.802953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.802957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.803025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.803088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.803165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.803224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.803266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.803271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.803336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:36.803398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:36.803462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:36.803521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:36.803565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:36.803573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:36.803624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374878:3101], now have 1 active actors on pipe
2025-10-02T09:28:36.803931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:36.803943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553933985374878:3101]
2025-10-02T09:28:36.803986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:36.803989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:36.804005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:36.804021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: error at write: Disconnected sessionId: src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0
2025-10-02T09:28:36.804231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0 is DEAD
2025-10-02T09:28:36.804322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:36.804331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Write session will restart in 0.006600s
2025-10-02T09:28:36.804348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Write session: Do CDS request
2025-10-02T09:28:36.804352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:36.812261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.812377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:36.812394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-10-02T09:28:36.812536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:36.812571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:36.812580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:36.812583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:36.813601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-10-02T09:28:36.813642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:36.813644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:36.813645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:36.813652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553933985374980:3457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:36.814177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553933985374980:3457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:36.816249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:36.816401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553933985374980:3457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:36.816987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:36.817115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:36.817125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:36.817131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:36.817160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:36.817183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553933909856355:3195]
2025-10-02T09:28:36.817578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:36.817821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:36.817848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:36.818046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:36.818081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.818086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.818087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.818087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.818088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.818088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.818089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.818089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.818090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.818090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.818091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.818092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.818095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.818103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.818106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.818110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.818112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.818115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.818119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.818122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.818125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.818129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.818133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.818136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.818141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.818147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:36.818150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.818153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:36.818155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.818158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:36.818161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.818163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:36.818165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.818168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:36.818173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.818176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:36.818178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.818180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:36.818186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.818189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:36.818192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.818195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:36.818200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.818203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.818207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.818213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.818217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.818223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.818258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:36.818474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553933985374980:3457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:36.818489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553933985374980:3457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:36.818492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553933985374980:3457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:36.818501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:36.826315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:36.828474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:36.828488Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:36.828489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:36.828491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:36.828496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [2:7556553933909856355:3195]
2025-10-02T09:28:36.828507Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:36.828519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:36.828522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.828524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.828527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.828554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:36.828561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:36.828566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:36.828621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.828626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.828627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.828629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:36.828631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:36.828693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:36.828700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.828712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:36.828722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:36.828731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:36.828742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.828747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.828748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.828753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:36.828763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:36.828765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:36.828767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:36.828769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:36.828771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:36.828773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:36.828779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985374888:2446], now have 1 active actors on pipe
2025-10-02T09:28:36.828782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985375103:3457], now have 1 active actors on pipe
2025-10-02T09:28:36.828824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.828836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:36.828859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:36.828932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 161
2025-10-02T09:28:36.828984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.828994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.829000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 161
2025-10-02T09:28:36.829013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b2428b-1f150282-a26c0de9-84d9436e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:36.829022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:36.829026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:36.829028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:36.829039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:36.829051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:36.829072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.829226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.829233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.829244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:36.829341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b2428b-1f150282-a26c0de9-84d9436e_0
2025-10-02T09:28:36.829654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7ea66b-cd714dc8-a867dcbb-29356bdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b2428b-1f150282-a26c0de9-84d9436e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:36.832996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Write session: try to update token
2025-10-02T09:28:36.833011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:36.838757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:36.838771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.838778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.838816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:36.838832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:36.839003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:36.839148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:36.839294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:36.839428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:36.839626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:36.839663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:36.847386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|9b2428b-1f150282-a26c0de9-84d9436e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:36.848154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:36.848166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:36.848168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:36.848170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:36.848177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.848182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.848185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553933909856350:3195]
2025-10-02T09:28:36.848218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:36.848218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:36.848222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:36.848225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:36.848229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:36.848231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:36.848377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:36.849917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:36.904008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553933985375112:3101]
2025-10-02T09:28:36.904331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7556553933985375112:3101]
2025-10-02T09:28:36.991215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:36.991451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:36.991462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:36.991476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985375112:3101], now have 1 active actors on pipe
2025-10-02T09:28:36.991734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:36.991741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:36.991816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553933985375112:3101]
2025-10-02T09:28:36.991846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:36.991855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:36.991935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|9b2428b-1f150282-a26c0de9-84d9436e_0
2025-10-02T09:28:36.992119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|9b2428b-1f150282-a26c0de9-84d9436e_0 is DEAD
2025-10-02T09:28:36.992314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:36.992326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Write session will restart in 0.007050s
2025-10-02T09:28:36.992356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Write session: Do CDS request
2025-10-02T09:28:36.992363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:37.000364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.000474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:37.000504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-10-02T09:28:37.000683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.000717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:37.000727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:37.000732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:37.001255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-10-02T09:28:37.001293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:37.001295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:37.001297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:37.001302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553938280342451:3461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:37.001761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553938280342451:3461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:37.004318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553938280342451:3461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:37.007437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553938280342451:3461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:37.007458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553938280342451:3461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:37.007462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553938280342451:3461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:37.007469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:37.008971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:37.010844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:37.011024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:37.011033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:37.011042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:37.011087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:37.011125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553938204823869:3197]
2025-10-02T09:28:37.011736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:37.012050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:37.012109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:37.012430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:37.012491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.012497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.012499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.012500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.012501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.012502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.012503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.012504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.012505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.012506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.012508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.012509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.012514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.012525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.012528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.012532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.012536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.012539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.012542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.012545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.012549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.012553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.012556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.012560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.012567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.012574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.012579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.012584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.012588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.012594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.012598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.012603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.012607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.012612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.012616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.012621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.012626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.012631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.012635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.012640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.012649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.012654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.012661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.012666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.012670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.012676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.012680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.012690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.012726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:37.021203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:37.023203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:37.023215Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:37.023217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:37.023219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:37.023223Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [2:7556553938204823869:3197]
2025-10-02T09:28:37.023232Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:37.023244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:37.023246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.023247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.023248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.023259Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:37.023265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:37.023271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:37.023322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.023328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.023330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.023333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:37.023335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:37.023387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:37.023392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.023399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.023407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.023418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:37.023435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280342619:3461], now have 1 active actors on pipe
2025-10-02T09:28:37.023442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553933985375117:2446], now have 1 active actors on pipe
2025-10-02T09:28:37.023446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.023448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.023450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.023460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:37.023470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:37.023478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:37.023479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:37.023484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:37.023488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:37.023490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:37.023500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.023507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:37.023502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 162
2025-10-02T09:28:37.023513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 162
2025-10-02T09:28:37.023529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:37.023546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.023550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.023571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13ec1796-35aa40cb-d189d610-82420b66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:37.023581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.023584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.023586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:37.023596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.023606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:37.023616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.023721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.023729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.023743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.023809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 36 sessionId: src_id|13ec1796-35aa40cb-d189d610-82420b66_0
2025-10-02T09:28:37.024132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2428b-1f150282-a26c0de9-84d9436e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13ec1796-35aa40cb-d189d610-82420b66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:37.027216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Write session: try to update token
2025-10-02T09:28:37.027228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:37.032984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:37.032997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.033003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.033032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:37.033032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:37.033183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:37.033311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.033430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.033552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.033732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:37.033761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:37.040452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|13ec1796-35aa40cb-d189d610-82420b66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:37.041983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:37.041996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.041998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:37.041999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:37.042005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.042007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.042010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553938204823864:3197]
2025-10-02T09:28:37.042034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:37.042034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:37.042039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.042039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:37.042040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:37.042041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:37.042170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:37.043214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:37.091392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553938280342636:3101]
2025-10-02T09:28:37.091679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7556553938280342636:3101]
2025-10-02T09:28:37.177230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:37.177561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.177570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.177585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280342636:3101], now have 1 active actors on pipe
2025-10-02T09:28:37.177751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:37.177824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:37.177841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:37.177846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:37.177902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: error at write: Disconnected sessionId: src_id|13ec1796-35aa40cb-d189d610-82420b66_0
2025-10-02T09:28:37.177904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553938280342636:3101]
2025-10-02T09:28:37.178067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|13ec1796-35aa40cb-d189d610-82420b66_0 is DEAD
2025-10-02T09:28:37.178258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:37.178272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Write session will restart in 0.006907s
2025-10-02T09:28:37.178296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Write session: Do CDS request
2025-10-02T09:28:37.178303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:37.186292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.186426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:37.186443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-10-02T09:28:37.186618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.186649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:37.186660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:37.186664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:37.187066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-10-02T09:28:37.187096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:37.187102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:37.187103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:37.187109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553938280342716:3466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:37.187609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553938280342716:3466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:37.189897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553938280342716:3466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:37.190892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:37.191786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:37.191933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:37.191940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:37.191947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:37.191982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:37.192009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553938204824088:3200]
2025-10-02T09:28:37.192254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553938280342716:3466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:37.192267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553938280342716:3466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:37.192270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553938280342716:3466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:37.192277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:37.192389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:37.192601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:37.192648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:37.193002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:37.193056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.193062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.193063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.193064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.193065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.193066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.193067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.193068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.193069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.193070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.193071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.193072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.193077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.193088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.193092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.193096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.193100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.193103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.193107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.193110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.193114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.193119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.193123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.193126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.193131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.193138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.193144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.193149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.193153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.193157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.193166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.193170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.193175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.193180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.193184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.193193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.193198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.193203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.193207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.193211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.193215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.193220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.193224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.193229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.193237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.193242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.193246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.193251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.193287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:37.201550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:37.203348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:37.203361Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:37.203364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:37.203368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:37.203374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [2:7556553938204824088:3200]
2025-10-02T09:28:37.203389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:37.203408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:37.203411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.203413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.203415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.203430Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:37.203441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:37.203447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:37.203508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.203517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.203519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.203522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:37.203524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:37.203591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:37.203599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.203612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.203622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.203637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:37.203659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280342853:3466], now have 1 active actors on pipe
2025-10-02T09:28:37.203665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280342639:2446], now have 1 active actors on pipe
2025-10-02T09:28:37.203671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.203673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.203675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.203688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:37.203702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:37.203715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:37.203719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:37.203720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:37.203721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:37.203723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:37.203756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.203762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:37.203765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:37.203777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.203787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.203847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:37.203857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.203861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.203863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:37.203874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.203883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:37.203907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.203719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 163
2025-10-02T09:28:37.203730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 163
2025-10-02T09:28:37.204106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.204119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.204136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.204231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 36 sessionId: src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0
2025-10-02T09:28:37.204657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ec1796-35aa40cb-d189d610-82420b66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:37.207619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Write session: try to update token
2025-10-02T09:28:37.207635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:37.215362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:37.215377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.215379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:37.215382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:37.215389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.215394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.215401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553938204824083:3200]
2025-10-02T09:28:37.215434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:37.215440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.215442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:37.215442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:37.215447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:37.215452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:37.215587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:37.223407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:37.225760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:37.278268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553938280342864:3101]
2025-10-02T09:28:37.278688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7556553938280342864:3101]
2025-10-02T09:28:37.358127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:37.358902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:37.358904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553938280342864:3101]
2025-10-02T09:28:37.358931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:37.358934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:37.358992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0
2025-10-02T09:28:37.359194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0 is DEAD
2025-10-02T09:28:37.359377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:37.359391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Write session will restart in 0.009200s
2025-10-02T09:28:37.359428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Write session: Do CDS request
2025-10-02T09:28:37.359434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:37.358642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.358658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.358674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280342864:3101], now have 1 active actors on pipe
2025-10-02T09:28:37.358920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:37.369294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.369605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:37.369622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-10-02T09:28:37.369816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.369872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:37.369893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:37.369899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:37.370844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-10-02T09:28:37.370895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:37.370901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:37.370903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:37.370909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553938280342955:3471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:37.371480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553938280342955:3471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:37.373723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553938280342955:3471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:37.377185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:37.378669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:37.378856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:37.378866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:37.378876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:37.378929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:37.378967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553938204824320:3203]
2025-10-02T09:28:37.379105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553938280342955:3471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:37.379119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553938280342955:3471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:37.379123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553938280342955:3471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:37.379130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:37.379576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:37.379812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:37.379853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:37.380156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:37.380210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.380214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.380215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.380216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.380217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.380218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.380219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.380220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.380221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.380222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.380223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.380224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.380229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.380238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.380242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.380246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.380250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.380254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.380258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.380262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.380266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.380270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.380274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.380277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.380284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.380291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.380297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.380302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.380312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.380317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.380321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.380326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.380330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.380334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.380339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.380344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.380349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.380354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.380358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.380362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.380367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.380371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.380375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.380379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.380384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.380388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.380392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.380397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.380429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:37.390513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:37.392416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:37.392423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:37.392426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:37.392430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:37.392440Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [2:7556553938204824320:3203]
2025-10-02T09:28:37.392454Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:37.392473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:37.392477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.392480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.392482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.392497Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:37.392502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:37.392510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:37.392580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.392583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.392585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.392588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:37.392591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:37.392670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:37.392673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.392687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.392699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.392716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:37.392735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343093:3471], now have 1 active actors on pipe
2025-10-02T09:28:37.392739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280342879:2446], now have 1 active actors on pipe
2025-10-02T09:28:37.392746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.392748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.392751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.392764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:37.392777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:37.392784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:37.392788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:37.392790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:37.392791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:37.392792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:37.393036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.393049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:37.393058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:37.393265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.393273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.393304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:37.393310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.393314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.393315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:37.393324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.393335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:37.393349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.393555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.393561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.393574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.394106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffa919e-d1185f49-ebda6e6a-40b22a18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:37.393087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 164
2025-10-02T09:28:37.393117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 164
2025-10-02T09:28:37.393690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0
2025-10-02T09:28:37.397641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Write session: try to update token
2025-10-02T09:28:37.397659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:37.406348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:37.406367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.406386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.406424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:37.406589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:37.406735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.406885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.407016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.407210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:37.407242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:37.407814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:37.417598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:37.417615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.417617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:37.417620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:37.417628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.417631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.417636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553938204824315:3203]
2025-10-02T09:28:37.417675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:37.417681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.417683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:37.417828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:37.418444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:37.419768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:37.419782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:37.419798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:37.421194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:37.460587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553938280343104:3101]
2025-10-02T09:28:37.460875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7556553938280343104:3101]
2025-10-02T09:28:37.565034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:37.565580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.565594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.565611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343104:3101], now have 1 active actors on pipe
2025-10-02T09:28:37.565810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:37.565816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553938280343104:3101]
2025-10-02T09:28:37.565825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:37.565829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:37.565849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:37.565898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: error at write: Disconnected sessionId: src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0
2025-10-02T09:28:37.566062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0 is DEAD
2025-10-02T09:28:37.566250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:37.566265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Write session will restart in 0.005945s
2025-10-02T09:28:37.566294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Write session: Do CDS request
2025-10-02T09:28:37.566301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:37.573326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.573419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:37.573438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-10-02T09:28:37.573562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.573600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:37.573607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:37.573612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:37.574067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-10-02T09:28:37.574105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:37.574116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:37.574118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:37.574125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553938280343121:3475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:37.574634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553938280343121:3475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:37.576634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553938280343121:3475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:37.579405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553938280343121:3475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:37.579417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553938280343121:3475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:37.579420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553938280343121:3475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:37.579426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:37.586506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:37.587786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:37.587963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:37.587972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:37.587981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:37.588039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:37.588076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553938204824542:3205]
2025-10-02T09:28:37.588619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:37.589837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:37.589886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:37.590227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:37.590288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.590294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.590295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.590296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.590297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.590298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.590299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.590300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.590301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.590303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.590304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.590304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.590310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.590319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.590323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.590327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.590330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.590334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.590338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.590341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.590344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.590348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.590352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.590355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.590361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.590369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.590374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.590379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.590383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.590388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.590392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.590397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.590401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.590407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.590416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.590421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.590425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.590430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.590434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.590439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.590447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.590451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.590459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.590464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.590468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.590477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.590482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.590487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.590521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:37.599493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:37.601457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:37.601474Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:37.601476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:37.601480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:37.601486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [2:7556553938204824542:3205]
2025-10-02T09:28:37.601500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:37.601516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:37.601519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.601522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.601523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.601537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:37.601543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:37.601549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:37.601614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.601628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.601630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.601633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:37.601635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:37.601698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:37.601705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.601717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.601733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.601754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:37.601776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343107:2446], now have 1 active actors on pipe
2025-10-02T09:28:37.601784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343193:3475], now have 1 active actors on pipe
2025-10-02T09:28:37.601789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.601791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.601794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.601811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:37.601826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:37.601829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:37.601831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:37.601831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:37.601845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:37.601848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:37.601863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 165
2025-10-02T09:28:37.601872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 165
2025-10-02T09:28:37.601877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.601887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:37.601894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:37.601925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.601928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.601952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b199b053-e087f96e-8903fd27-d67b1fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:37.601957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.601960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.601962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:37.601972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.601981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:37.601992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.602155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.602164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.602178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.602260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 36 sessionId: src_id|b199b053-e087f96e-8903fd27-d67b1fe_0
2025-10-02T09:28:37.602649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6972a5-3ae8b4c4-1abbb874-ce55bce3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b199b053-e087f96e-8903fd27-d67b1fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:37.605779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Write session: try to update token
2025-10-02T09:28:37.605801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:37.612956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:37.612971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.612974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:37.612976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:37.612984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.612988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.612992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553938204824537:3205]
2025-10-02T09:28:37.613028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:37.613033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.613035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:37.613046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:37.613058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:37.613062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:37.613184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:37.620357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|b199b053-e087f96e-8903fd27-d67b1fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:37.622883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:37.665860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553938280343334:3101]
2025-10-02T09:28:37.666100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7556553938280343334:3101]
2025-10-02T09:28:37.759656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:37.759881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.759893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.759908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343334:3101], now have 1 active actors on pipe
2025-10-02T09:28:37.760085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:37.760133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553938280343334:3101]
2025-10-02T09:28:37.760146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:37.760174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:37.760221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b199b053-e087f96e-8903fd27-d67b1fe_0
2025-10-02T09:28:37.760352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|b199b053-e087f96e-8903fd27-d67b1fe_0 is DEAD
2025-10-02T09:28:37.760627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:37.760635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Write session will restart in 0.006415s
2025-10-02T09:28:37.760658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Write session: Do CDS request
2025-10-02T09:28:37.760664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:37.768323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.768377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:37.768390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-10-02T09:28:37.768561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.768588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:37.768596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:37.768599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:37.769108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-10-02T09:28:37.769152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:37.769163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:37.769168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:37.769174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553938280343436:3487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:37.769716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553938280343436:3487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:37.771749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553938280343436:3487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:37.773207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:37.773979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:37.774116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:37.774123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:37.774131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:37.774172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:37.774199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553938204824799:3220]
2025-10-02T09:28:37.774276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553938280343436:3487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:37.774285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553938280343436:3487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:37.774288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553938280343436:3487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:37.774294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:37.774575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:37.774790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:37.774817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:37.775031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:37.775077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.775082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.775083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.775084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.775085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.775086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.775087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.775088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.775089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.775091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.775092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.775093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.775097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.775107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.775110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.775114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.775117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.775121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.775124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.775127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.775129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.775131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.775133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.775135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.775139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.775144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.775147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.775163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.775165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.775167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.775170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.775172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.775175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.775177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.775180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.775182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.775184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.775187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.775189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.775192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.775194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.775197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.775199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.775202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.775204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.775207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.775209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.775212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.775230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:37.783629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:37.785507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:37.785521Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:37.785523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:37.785525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:37.785529Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [2:7556553938204824799:3220]
2025-10-02T09:28:37.785539Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:37.785551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:37.785552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.785554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.785555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.785567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:37.785570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:37.785575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:37.785620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.785625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.785626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.785628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:37.785630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:37.785674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:37.785682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.785690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.785696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.785705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:37.785718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343366:2446], now have 1 active actors on pipe
2025-10-02T09:28:37.785724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.785726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.785728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.785736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:37.785745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:37.785748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:37.785748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:37.785750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:37.785761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:37.785763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:37.785773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343583:3487], now have 1 active actors on pipe
2025-10-02T09:28:37.785802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.785812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:37.785780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 166
2025-10-02T09:28:37.785829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:37.785839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 166
2025-10-02T09:28:37.785945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.785956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.785977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:37.785983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.785986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.785987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:37.785995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.786004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:37.786015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.786147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.786154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.786165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.786249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0
2025-10-02T09:28:37.786565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b199b053-e087f96e-8903fd27-d67b1fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:37.789420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Write session: try to update token
2025-10-02T09:28:37.789440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:37.795877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:37.795894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.795896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:37.795898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:37.795905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.795909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.795914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553938204824794:3220]
2025-10-02T09:28:37.795955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:37.795963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.795966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:37.796047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:37.796062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:37.796066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:37.796104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:37.803510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:37.806265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:37.860410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553938280343595:3101]
2025-10-02T09:28:37.860685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7556553938280343595:3101]
2025-10-02T09:28:37.919514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:37.919849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.919864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.919881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343595:3101], now have 1 active actors on pipe
2025-10-02T09:28:37.920073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:37.920120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:37.920136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:37.920159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:37.920193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: error at write: Disconnected sessionId: src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0
2025-10-02T09:28:37.920216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553938280343595:3101]
2025-10-02T09:28:37.920361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0 is DEAD
2025-10-02T09:28:37.920515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:37.920528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Write session will restart in 0.007190s
2025-10-02T09:28:37.920547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Write session: Do CDS request
2025-10-02T09:28:37.920552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:37.929236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.929609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:37.929623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-10-02T09:28:37.929774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:37.929804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:37.929814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:37.929818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:37.930195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-10-02T09:28:37.930240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:37.930246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:37.930247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:37.930252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553938280343720:3491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:37.930789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553938280343720:3491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:37.932356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:37.932625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553938280343720:3491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:37.933163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:37.933291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:37.933299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:37.933306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:37.933337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:37.933361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553938204825020:3222]
2025-10-02T09:28:37.933829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:37.934059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:37.934097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:37.934370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:37.934416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.934421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.934422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.934423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.934424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.934425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.934426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.934427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.934428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.934429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.934431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.934431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.934436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.934445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.934449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.934453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.934456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.934460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.934468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.934471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.934479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.934482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.934486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.934489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.934494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.934501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:37.934510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.934519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:37.934527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.934536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:37.934539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.934544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:37.934552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.934556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:37.934564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.934568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:37.934559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553938280343720:3491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:37.934576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.934571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553938280343720:3491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:37.934574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553938280343720:3491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:37.934580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:37.934585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:37.934593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.934597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:37.934605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.934610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:37.934617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.934622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.934630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.934634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.934641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.934646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.934684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:37.942663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:37.944263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:37.944274Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:37.944275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:37.944278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:37.944282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [2:7556553938204825020:3222]
2025-10-02T09:28:37.944291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:37.944303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:37.944306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.944308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.944310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.944320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:37.944328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:37.944332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:37.944374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.944378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.944380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.944382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:37.944383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:37.944428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:37.944433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.944440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:37.944445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:37.944453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:37.944468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.944473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.944474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.944480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:37.944488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:37.944491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:37.944494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:37.944496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:37.944496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:37.944498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:37.944521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343817:3491], now have 1 active actors on pipe
2025-10-02T09:28:37.944526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553938280343597:2446], now have 1 active actors on pipe
2025-10-02T09:28:37.944528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.944533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:37.944548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:37.944607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 167
2025-10-02T09:28:37.944618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 167
2025-10-02T09:28:37.944675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.944681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.944697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:37.944703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:37.944706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:37.944707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:37.944714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:37.944723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:37.944733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.944905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:37.944912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:37.944924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:37.945005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 36 sessionId: src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0
2025-10-02T09:28:37.945330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0d442c-3b2d118a-226b99f8-67d0fd4b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:37.947928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Write session: try to update token
2025-10-02T09:28:37.947943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:37.954260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:37.954285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.954292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.954327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:37.954334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:37.954493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:37.954635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.954774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.954916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:37.955109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:37.955145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:37.961553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:37.963521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:37.963534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:37.963535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:37.963536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:37.963542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.963545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.963547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553938204825015:3222]
2025-10-02T09:28:37.963573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:37.963577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:37.963578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:37.963582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:37.963590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:37.963592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:37.963698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:37.964213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:38.020154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553942575311123:3101]
2025-10-02T09:28:38.020373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7556553942575311123:3101]
2025-10-02T09:28:38.083991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:38.084509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.084518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.084531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311123:3101], now have 1 active actors on pipe
2025-10-02T09:28:38.084674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:38.084749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:38.084754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553942575311123:3101]
2025-10-02T09:28:38.084769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:38.084842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0
2025-10-02T09:28:38.085007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0 is DEAD
2025-10-02T09:28:38.085183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:38.085191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Write session will restart in 0.007490s
2025-10-02T09:28:38.085212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Write session: Do CDS request
2025-10-02T09:28:38.085218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:38.094284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.094391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:38.094406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-10-02T09:28:38.094502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.094532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:38.094536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:38.094539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:38.094928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-10-02T09:28:38.094959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:38.094965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:38.094967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:38.094971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553942575311247:3496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:38.095468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553942575311247:3496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:38.097066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553942575311247:3496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:38.097204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:38.097906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:38.098018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:38.098025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:38.098031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:38.098058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:38.098082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553942499792540:3225]
2025-10-02T09:28:38.098446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:38.098664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:38.098699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:38.098936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553942575311247:3496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:38.098946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553942575311247:3496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:38.098948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553942575311247:3496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:38.098952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:38.098956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:38.099003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.099008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.099009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.099010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.099011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.099012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.099013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.099013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.099014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.099015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.099016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.099017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.099021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.099030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.099034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.099037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.099040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.099043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.099046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.099053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.099056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.099063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.099066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.099070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.099075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.099086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.099094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.099099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.099103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.099108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.099113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.099118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.099123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.099127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.099129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.099131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.099134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.099136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.099138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.099141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.099143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.099145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.099147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.099161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.099163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.099165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.099167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.099170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.099187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:38.107246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:38.108914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:38.108925Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:38.108928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:38.108931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:38.108937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [2:7556553942499792540:3225]
2025-10-02T09:28:38.108961Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:38.108980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:38.108986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.108989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.108991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.109003Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:38.109011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:38.109018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:38.109070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.109076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.109078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.109081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:38.109083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:38.109138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:38.109144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.109156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.109171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.109191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:38.109211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311347:3496], now have 1 active actors on pipe
2025-10-02T09:28:38.109218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311124:2446], now have 1 active actors on pipe
2025-10-02T09:28:38.109223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.109228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.109230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.109246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:38.109261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:38.109242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 168
2025-10-02T09:28:38.109275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:38.109247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 168
2025-10-02T09:28:38.109277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:38.109280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:38.109284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:38.109286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:38.109311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.109318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.109328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.109338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:38.109348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:38.109364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fc1a4-45631e81-5974838d-6de706d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:38.109373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.109380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.109382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:38.109389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.109399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:38.109420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.109552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.109561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.109574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.109649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 36 sessionId: src_id|9fc1a4-45631e81-5974838d-6de706d3_0
2025-10-02T09:28:38.109987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26f64fb-e2c61ce9-5875ba85-1e9e970e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9fc1a4-45631e81-5974838d-6de706d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:38.112925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Write session: try to update token
2025-10-02T09:28:38.112936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:38.119426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:38.119442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.119444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:38.119446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:38.119453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.119458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.119461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553942499792535:3225]
2025-10-02T09:28:38.119489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:38.119495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:38.119498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:38.119500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:38.119501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.119503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:38.119650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:38.126351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|9fc1a4-45631e81-5974838d-6de706d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:38.129082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:38.184996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553942575311357:3101]
2025-10-02T09:28:38.185213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7556553942575311357:3101]
2025-10-02T09:28:38.247799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:38.248106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.248119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.248137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311357:3101], now have 1 active actors on pipe
2025-10-02T09:28:38.248341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:38.248360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553942575311357:3101]
2025-10-02T09:28:38.248369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:38.248386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:38.248389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:38.248452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|9fc1a4-45631e81-5974838d-6de706d3_0
2025-10-02T09:28:38.248606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|9fc1a4-45631e81-5974838d-6de706d3_0 is DEAD
2025-10-02T09:28:38.248772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:38.248778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Write session will restart in 0.006239s
2025-10-02T09:28:38.248827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Write session: Do CDS request
2025-10-02T09:28:38.248835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:38.256229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.256388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:38.256403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-10-02T09:28:38.256535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.256565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:38.256573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:38.256577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:38.257074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-10-02T09:28:38.257107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:38.257113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:38.257114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:38.257120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553942575311382:3500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:38.257623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553942575311382:3500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:38.260136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553942575311382:3500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:38.263098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553942575311382:3500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:38.263113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553942575311382:3500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:38.263117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553942575311382:3500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:38.263123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:38.263917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:38.264985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:38.265230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:38.265242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:38.265254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:38.265314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:38.265363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553942499792764:3227]
2025-10-02T09:28:38.265884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:38.266179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:38.266226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:38.266512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:38.266579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.266586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.266587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.266589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.266590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.266591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.266591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.266592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.266593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.266594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.266595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.266596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.266602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.266613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.266617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.266620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.266624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.266627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.266631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.266634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.266638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.266642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.266645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.266649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.266657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.266663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.266668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.266673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.266677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.266682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.266691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.266696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.266700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.266704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.266708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.266713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.266716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.266721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.266730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.266734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.266738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.266744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.266748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.266757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.266761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.266767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.266774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.266778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.266810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:38.276437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:38.278515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:38.278539Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:38.278542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:38.278545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:38.278551Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [2:7556553942499792764:3227]
2025-10-02T09:28:38.278568Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:38.278585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:38.278588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.278591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.278592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.278611Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:38.278617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:38.278624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:38.278687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.278698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.278700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.278703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:38.278706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:38.278771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:38.278777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.278791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.278804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.278823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:38.278849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311358:2446], now have 1 active actors on pipe
2025-10-02T09:28:38.278852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311575:3500], now have 1 active actors on pipe
2025-10-02T09:28:38.278858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.278860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.278862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.278874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:38.278893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:38.278892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:38.278896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:38.278898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:38.278911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:38.278914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:38.278947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.278954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:38.278956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:38.278943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 169
2025-10-02T09:28:38.278945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 169
2025-10-02T09:28:38.279000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.279011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.279032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|789fee0-3378952b-42406623-1ed4f5d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:38.279038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.279042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.279044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:38.279052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.279060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:38.279072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.279352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.279365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.279386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.279502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 36 sessionId: src_id|789fee0-3378952b-42406623-1ed4f5d9_0
2025-10-02T09:28:38.279860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc1a4-45631e81-5974838d-6de706d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|789fee0-3378952b-42406623-1ed4f5d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:38.282916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Write session: try to update token
2025-10-02T09:28:38.282935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:38.289481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:38.289500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.289509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.289550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:38.289553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:38.289731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:38.289880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:38.290021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:38.290167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:38.290370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:38.290415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:38.297501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|789fee0-3378952b-42406623-1ed4f5d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:38.299559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:38.299579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.299581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:38.299583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:38.299592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.299595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.299598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553942499792759:3227]
2025-10-02T09:28:38.299639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:38.299644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:38.299649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.299649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:38.299651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:38.299653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:38.299803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:38.300428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:38.350439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553942575311602:3101]
2025-10-02T09:28:38.353055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7556553942575311602:3101]
2025-10-02T09:28:38.441531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:38.442019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.442032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.442052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311602:3101], now have 1 active actors on pipe
2025-10-02T09:28:38.442237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:38.442290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553942575311602:3101]
2025-10-02T09:28:38.442315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:38.442321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:38.442401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|789fee0-3378952b-42406623-1ed4f5d9_0
2025-10-02T09:28:38.442535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|789fee0-3378952b-42406623-1ed4f5d9_0 is DEAD
2025-10-02T09:28:38.442699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:38.442711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Write session will restart in 0.005133s
2025-10-02T09:28:38.442738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Write session: Do CDS request
2025-10-02T09:28:38.442745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:38.449339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.449398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:38.449414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-10-02T09:28:38.449578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.449614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:38.449624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:38.449630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:38.449989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-10-02T09:28:38.450018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:38.450023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:38.450025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:38.450028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553942575311632:3505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:38.450491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553942575311632:3505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:38.452495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553942575311632:3505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:38.454796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553942575311632:3505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:38.454807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553942575311632:3505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:38.454810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553942575311632:3505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:38.454817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:38.455530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:38.456466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:38.456603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:38.456610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:38.456617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:38.456648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:38.456674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553942499793000:3230]
2025-10-02T09:28:38.457069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:38.457356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:38.457386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:38.457595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:38.457632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.457637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.457638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.457638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.457639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.457640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.457640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.457641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.457642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.457643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.457643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.457644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.457647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.457654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.457656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.457658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.457661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.457663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.457665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.457667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.457669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.457672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.457674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.457676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.457680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.457684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.457688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.457691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.457693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.457696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.457700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.457703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.457706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.457708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.457711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.457713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.457716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.457719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.457721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.457724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.457726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.457729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.457731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.457734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.457736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.457739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.457742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.457745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.457776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:38.466276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:38.468131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:38.468145Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:38.468146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:38.468148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:38.468152Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [2:7556553942499793000:3230]
2025-10-02T09:28:38.468161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:38.468173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:38.468174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.468176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.468177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.468190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:38.468194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:38.468198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:38.468246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.468252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.468254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.468257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:38.468259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:38.468305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:38.468311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.468319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.468324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.468333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:38.468350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.468356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.468358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.468363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:38.468372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:38.468380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:38.468382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:38.468386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:38.468386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:38.468388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:38.468413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311822:3505], now have 1 active actors on pipe
2025-10-02T09:28:38.468422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311604:2446], now have 1 active actors on pipe
2025-10-02T09:28:38.468423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.468427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:38.468437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:38.468466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 170
2025-10-02T09:28:38.468507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.468516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.468481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 170
2025-10-02T09:28:38.468540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4539610d-180926a0-cce53d13-797ca334_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:38.468551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.468554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.468556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:38.468565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.468578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:38.468594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.468731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.468738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.468746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.468837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 36 sessionId: src_id|4539610d-180926a0-cce53d13-797ca334_0
2025-10-02T09:28:38.469206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789fee0-3378952b-42406623-1ed4f5d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4539610d-180926a0-cce53d13-797ca334_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:38.472315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Write session: try to update token
2025-10-02T09:28:38.472333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:38.479108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:38.479121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.479123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:38.479125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:38.479130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.479134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.479137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553942499792995:3230]
2025-10-02T09:28:38.479174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:38.479180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.479180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:38.479182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:38.479185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:38.479188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:38.479335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:38.486329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|4539610d-180926a0-cce53d13-797ca334_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:38.488623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:38.542395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553942575311837:3101]
2025-10-02T09:28:38.542633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7556553942575311837:3101]
2025-10-02T09:28:38.605537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:38.605880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.605892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.605906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311837:3101], now have 1 active actors on pipe
2025-10-02T09:28:38.606077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:38.606139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:38.606142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:38.606154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:38.606176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553942575311837:3101]
2025-10-02T09:28:38.606209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: error at write: Disconnected sessionId: src_id|4539610d-180926a0-cce53d13-797ca334_0
2025-10-02T09:28:38.606381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|4539610d-180926a0-cce53d13-797ca334_0 is DEAD
2025-10-02T09:28:38.606528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:38.606539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Write session will restart in 0.009812s
2025-10-02T09:28:38.606559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Write session: Do CDS request
2025-10-02T09:28:38.606564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:38.617247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.617301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:38.617317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-10-02T09:28:38.617416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.617441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:38.617448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:38.617452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:38.617805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-10-02T09:28:38.617833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:38.617837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:38.617838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:38.617843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553942575312025:3509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:38.618071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:38.618314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553942575312025:3509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:38.618801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:38.618990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:38.619000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:38.619009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:38.619057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:38.619093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553942499793224:3232]
2025-10-02T09:28:38.619553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:38.619765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:38.619794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:38.619841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553942575312025:3509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:38.620003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:38.620052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.620058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.620059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.620060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.620061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.620062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.620063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.620064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.620065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.620066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.620067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.620068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.620073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.620083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.620086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.620090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.620093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.620097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.620101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.620104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.620108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.620112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.620116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.620124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.620130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.620135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.620140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.620143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.620148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.620152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.620156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.620160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.620164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.620168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.620172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.620175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.620180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.620183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.620188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.620192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.620196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.620200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.620204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.620208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.620214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.620218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.620223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.620255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:38.625557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553942575312025:3509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:38.625573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553942575312025:3509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:38.625576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553942575312025:3509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:38.625583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:38.628205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:38.629777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:38.629791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:38.629793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:38.629795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:38.629800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [2:7556553942499793224:3232]
2025-10-02T09:28:38.629809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:38.629821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:38.629823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.629824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.629826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.629836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:38.629840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:38.629844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:38.629883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.629884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.629885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.629887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:38.629889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:38.629936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:38.629942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.629950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.629956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.629975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:38.629998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312065:3509], now have 1 active actors on pipe
2025-10-02T09:28:38.630008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575311838:2446], now have 1 active actors on pipe
2025-10-02T09:28:38.630013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.630016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.630018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.630030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:38.630041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:38.630052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:38.630054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:38.630056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:38.630061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:38.630063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:38.630084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.630091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:38.630071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 171
2025-10-02T09:28:38.630098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:38.630102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 171
2025-10-02T09:28:38.630111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.630114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.630143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:38.630154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.630157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.630159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:38.630168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.630176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:38.630192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.630291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.630300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.630310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.630387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 36 sessionId: src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0
2025-10-02T09:28:38.630685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4539610d-180926a0-cce53d13-797ca334_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:38.634002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Write session: try to update token
2025-10-02T09:28:38.634015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:38.640551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:38.640571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.640572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:38.640574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:38.640580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.640584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.640587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553942499793219:3232]
2025-10-02T09:28:38.640613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:38.640618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.640619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:38.640625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:38.640629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:38.640631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:38.640739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:38.647900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:38.650856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:38.706328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553942575312076:3101]
2025-10-02T09:28:38.708268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7556553942575312076:3101]
2025-10-02T09:28:38.781246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:38.781789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.781801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.781816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312076:3101], now have 1 active actors on pipe
2025-10-02T09:28:38.781965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:38.782071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553942575312076:3101]
2025-10-02T09:28:38.782101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:38.782162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0
2025-10-02T09:28:38.782343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0 is DEAD
2025-10-02T09:28:38.782457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:38.782465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Write session will restart in 0.005180s
2025-10-02T09:28:38.782479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Write session: Do CDS request
2025-10-02T09:28:38.782484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:38.782493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:38.788269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.788295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:38.788310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-10-02T09:28:38.788609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.788660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:38.788671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:38.788677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:38.789063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-10-02T09:28:38.789092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:38.789096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:38.789097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:38.789104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553942575312121:3520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:38.789548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553942575312121:3520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:38.791844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553942575312121:3520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:38.794750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553942575312121:3520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:38.794766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553942575312121:3520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:38.794769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553942575312121:3520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:38.794776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:38.795792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:38.796706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:38.797024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:38.797039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:38.797051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:38.797114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:38.797157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553942499793490:3241]
2025-10-02T09:28:38.797655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:38.797897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:38.797931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:38.798138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:38.798173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.798173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.798174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.798175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.798175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.798176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.798177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.798177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.798178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.798179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.798179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.798180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.798183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.798190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.798192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.798194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.798197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.798199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.798201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.798203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.798205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.798208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.798210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.798212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.798217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.798221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.798225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.798227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.798230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.798233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.798235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.798238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.798241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.798244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.798246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.798249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.798251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.798254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.798257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.798260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.798262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.798265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.798268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.798271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.798275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.798279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.798281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.798284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.798301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:38.806898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:38.808697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:38.808718Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:38.808721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:38.808725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:38.808732Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [2:7556553942499793490:3241]
2025-10-02T09:28:38.808747Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:38.808764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:38.808767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.808770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.808773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.808788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:38.808794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:38.808818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:38.808882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.808894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.808896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.808899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:38.808902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:38.808967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:38.808977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.808991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.809001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.809015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:38.809034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312097:2446], now have 1 active actors on pipe
2025-10-02T09:28:38.809044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312325:3520], now have 1 active actors on pipe
2025-10-02T09:28:38.809050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.809052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.809055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.809069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:38.809083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:38.809097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:38.809101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:38.809129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.809129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:38.809133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:38.809135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:38.809136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:38.809141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:38.809107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 172
2025-10-02T09:28:38.809107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 172
2025-10-02T09:28:38.809237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.809250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.809276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9669014-8c7c7df-e660f437-b6fa280c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:38.809288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:38.809291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:38.809293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:38.809300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:38.809313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:38.809336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.809512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.809525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.809545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:38.809628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9669014-8c7c7df-e660f437-b6fa280c_0
2025-10-02T09:28:38.809902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9183b81d-2972ec62-3f0e092f-aeb8e05f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9669014-8c7c7df-e660f437-b6fa280c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:38.812852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Write session: try to update token
2025-10-02T09:28:38.812869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:38.819495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:38.819510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.819518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.819558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:38.819565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:38.819727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:38.819866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:38.819998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:38.820144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:38.820327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:38.820364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:38.827956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|a9669014-8c7c7df-e660f437-b6fa280c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:38.829701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:38.829722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:38.829725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:38.829727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:38.829736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.829741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.829747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553942499793485:3241]
2025-10-02T09:28:38.829790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:38.829802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.829804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:38.829803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:38.829810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:38.829815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:38.830001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:38.831516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:38.882374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553942575312341:3101]
2025-10-02T09:28:38.882669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7556553942575312341:3101]
2025-10-02T09:28:38.971911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:38.972660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:38.972677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:38.972697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312341:3101], now have 1 active actors on pipe
2025-10-02T09:28:38.972978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:38.973283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:38.973377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9669014-8c7c7df-e660f437-b6fa280c_0
2025-10-02T09:28:38.973553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|a9669014-8c7c7df-e660f437-b6fa280c_0 is DEAD
2025-10-02T09:28:38.973706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:38.973716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Write session will restart in 0.006747s
2025-10-02T09:28:38.973745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Write session: Do CDS request
2025-10-02T09:28:38.973752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:38.973750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553942575312341:3101]
2025-10-02T09:28:38.973777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:38.981276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.981350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:38.981364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-10-02T09:28:38.981514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:38.981559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:38.981573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:38.981577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:38.982069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-10-02T09:28:38.982108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:38.982120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:38.982122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:38.982129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553942575312359:3525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:38.982650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553942575312359:3525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:38.985665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553942575312359:3525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:38.993376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553942575312359:3525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:38.993396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553942575312359:3525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:38.993400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553942575312359:3525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:38.993410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:38.995012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:38.997525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:38.997746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:38.997749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:38.997761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:38.997812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:38.997857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553942499793717:3249]
2025-10-02T09:28:38.998566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:38.999018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:38.999078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:38.999454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:38.999533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.999535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.999536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.999537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.999538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.999540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.999541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.999542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.999544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.999545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.999546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.999547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.999553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.999566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.999571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.999575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.999579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.999584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.999588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.999591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.999596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.999601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.999605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.999609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.999617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.999625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:38.999633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.999639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:38.999644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.999650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:38.999654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.999660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:38.999666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.999672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:38.999677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.999683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:38.999688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.999694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:38.999701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.999706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:38.999711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.999717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:38.999723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.999728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:38.999734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.999752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:38.999757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.999762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:38.999802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:39.010088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:39.012271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:39.012294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:39.012297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:39.012300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:39.012308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [2:7556553942499793717:3249]
2025-10-02T09:28:39.012323Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:39.012343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:39.012347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.012349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.012351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.012367Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:39.012373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:39.012379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:39.012455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.012466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.012468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.012472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:39.012475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:39.012558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:39.012567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.012584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.012596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.012618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:39.012641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312561:3525], now have 1 active actors on pipe
2025-10-02T09:28:39.012651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553942575312347:2446], now have 1 active actors on pipe
2025-10-02T09:28:39.012657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.012659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.012661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.012670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:39.012682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:39.012686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:39.012690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:39.012692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:39.012696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:39.012698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:39.012730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.012744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:39.012758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 173
2025-10-02T09:28:39.012755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:39.012758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 173
2025-10-02T09:28:39.012827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.012839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.012870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:39.012880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.012883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.012886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:39.012895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.012903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:39.012920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.013133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.013144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.013157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.013295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0
2025-10-02T09:28:39.013642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9669014-8c7c7df-e660f437-b6fa280c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:39.016622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Write session: try to update token
2025-10-02T09:28:39.016641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:39.026528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:39.026544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.026551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.026585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:39.026746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:39.026875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.027005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.027144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.027356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:39.027389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:39.027636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:39.035623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:39.038229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:39.038418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:39.038433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.038435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:39.038438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:39.038448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.038452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.038457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553942499793712:3249]
2025-10-02T09:28:39.038508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.038519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.038518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:39.038527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:39.038530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:39.038543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:39.038550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.038553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:39.038707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:39.073847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553946870279872:3101]
2025-10-02T09:28:39.074061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7556553946870279872:3101]
2025-10-02T09:28:39.185938Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:39.186444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870279872:3101], now have 1 active actors on pipe
2025-10-02T09:28:39.186666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:39.186705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:39.186707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:39.186721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:39.186751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553946870279872:3101]
2025-10-02T09:28:39.186783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: error at write: Disconnected sessionId: src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0
2025-10-02T09:28:39.186950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0 is DEAD
2025-10-02T09:28:39.187115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:39.187128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Write session will restart in 0.007392s
2025-10-02T09:28:39.187165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Write session: Do CDS request
2025-10-02T09:28:39.187172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:39.195386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.195479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:39.195496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-10-02T09:28:39.196071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.196110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:39.196122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:39.196126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:39.196863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-10-02T09:28:39.196909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:39.196911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:39.196912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:39.196917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553946870279913:3530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:39.197466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553946870279913:3530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:39.202323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553946870279913:3530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:39.206917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553946870279913:3530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:39.206929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553946870279913:3530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:39.206932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553946870279913:3530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:39.206938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:39.207935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:39.209188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:39.209360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:39.209371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:39.209381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:39.209428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:39.209469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553946794761244:3252]
2025-10-02T09:28:39.210036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:39.210455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:39.210499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:39.210790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:39.210855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.210861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.210862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.210863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.210865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.210866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.210867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.210868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.210869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.210870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.210871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.210872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.210877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.210887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.210891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.210895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.210899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.210903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.210907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.210910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.210914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.210917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.210921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.210924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.210930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.210938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.210943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.210948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.210952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.210957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.210961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.210966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.210970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.210975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.210985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.210990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.210994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.210999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.211003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.211008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.211012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.211017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.211021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.211027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.211036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.211040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.211044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.211049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.211085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:39.219903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:39.221996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:39.222014Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:39.222017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:39.222020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:39.222025Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [2:7556553946794761244:3252]
2025-10-02T09:28:39.222041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:39.222057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:39.222059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.222062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.222064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.222078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:39.222082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:39.222094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:39.222159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.222166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.222168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.222171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:39.222173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:39.222240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:39.222249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.222261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.222272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.222286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:39.222305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870279877:2446], now have 1 active actors on pipe
2025-10-02T09:28:39.222313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280098:3530], now have 1 active actors on pipe
2025-10-02T09:28:39.222319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.222326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.222327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.222339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:39.222352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:39.222354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:39.222355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:39.222357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:39.222367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:39.222369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:39.222352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 174
2025-10-02T09:28:39.222388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 174
2025-10-02T09:28:39.222398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.222406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:39.222407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:39.222432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.222441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.222468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:39.222481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.222484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.222486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:39.222494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.222502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:39.222527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.222711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.222719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.222732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.222898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 36 sessionId: src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0
2025-10-02T09:28:39.223236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5d29ae9-afbd861b-3acf295e-516b7df8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:39.226446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Write session: try to update token
2025-10-02T09:28:39.226461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:39.233217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:39.233237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.233239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:39.233242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:39.233249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.233254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.233258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553946794761239:3252]
2025-10-02T09:28:39.233297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:39.233303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.233301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:39.233305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:39.233308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:39.233311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:39.233450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:39.242217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:39.245111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:39.286319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553946870280113:3101]
2025-10-02T09:28:39.286589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7556553946870280113:3101]
2025-10-02T09:28:39.374744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:39.375126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.375139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.375165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280113:3101], now have 1 active actors on pipe
2025-10-02T09:28:39.375326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:39.375401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:39.375436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553946870280113:3101]
2025-10-02T09:28:39.375449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:39.375514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0
2025-10-02T09:28:39.375670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0 is DEAD
2025-10-02T09:28:39.375801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:39.375813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Write session will restart in 0.009652s
2025-10-02T09:28:39.375837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Write session: Do CDS request
2025-10-02T09:28:39.375843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:39.386387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.386446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:39.386460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-10-02T09:28:39.386656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.386685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:39.386695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:39.386700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:39.387178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-10-02T09:28:39.387216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:39.387218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:39.387219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:39.387225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553946870280241:3535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:39.387752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553946870280241:3535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:39.389814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553946870280241:3535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:39.390942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:39.392381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:39.392547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:39.392556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:39.392565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:39.392608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:39.392645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553946794761485:3255]
2025-10-02T09:28:39.392648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553946870280241:3535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:39.392661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553946870280241:3535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:39.392665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553946870280241:3535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:39.392672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:39.393237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:39.393587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:39.393636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:39.393965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:39.394025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.394031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.394032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.394033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.394034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.394035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.394036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.394037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.394038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.394039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.394040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.394042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.394047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.394057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.394060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.394065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.394068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.394072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.394076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.394079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.394083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.394087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.394091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.394095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.394101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.394108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.394114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.394119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.394123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.394128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.394132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.394137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.394142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.394147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.394151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.394155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.394160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.394165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.394169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.394176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.394185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.394190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.394194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.394199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.394203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.394208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.394212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.394217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.394244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:39.403105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:39.404992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:39.405010Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:39.405013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:39.405016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:39.405023Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [2:7556553946794761485:3255]
2025-10-02T09:28:39.405035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:39.405054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:39.405056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.405059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.405061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.405075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:39.405083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:39.405089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:39.405168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.405174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.405176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.405179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:39.405182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:39.405250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:39.405269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.405282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.405292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.405309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:39.405331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280128:2446], now have 1 active actors on pipe
2025-10-02T09:28:39.405339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280354:3535], now have 1 active actors on pipe
2025-10-02T09:28:39.405345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.405347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.405349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.405361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:39.405374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:39.405387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:39.405392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:39.405395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:39.405397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:39.405397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:39.405431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.405434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:39.405436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:39.405402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 175
2025-10-02T09:28:39.405402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 175
2025-10-02T09:28:39.405459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.405467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.405495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:39.405506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.405509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.405511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:39.405520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.405528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:39.405545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.405692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.405699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.405711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.405820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 36 sessionId: src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0
2025-10-02T09:28:39.406166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762a421-4ca2a962-1dec2717-3aac0ab9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:39.409173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Write session: try to update token
2025-10-02T09:28:39.409188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:39.418328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:39.418345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.418348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:39.418350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:39.418361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.418366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.418370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553946794761480:3255]
2025-10-02T09:28:39.418410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:39.418415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.418416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:39.418417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:39.418422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:39.418428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:39.418560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:39.423891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:39.427020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:39.475780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553946870280365:3101]
2025-10-02T09:28:39.476046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7556553946870280365:3101]
2025-10-02T09:28:39.565363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:39.566110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.566127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.566143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280365:3101], now have 1 active actors on pipe
2025-10-02T09:28:39.567425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553946870280365:3101]
2025-10-02T09:28:39.567458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:39.567493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:39.567501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:39.567557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: error at write: Disconnected sessionId: src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0
2025-10-02T09:28:39.567392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:39.567734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0 is DEAD
2025-10-02T09:28:39.567945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:39.567960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Write session will restart in 0.008898s
2025-10-02T09:28:39.567990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Write session: Do CDS request
2025-10-02T09:28:39.567997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:39.578373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.578438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:39.578467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-10-02T09:28:39.578678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.578727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:39.578734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:39.578738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:39.579271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-10-02T09:28:39.579318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:39.579326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:39.579328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:39.579333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553946870280419:3539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:39.579846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553946870280419:3539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:39.583692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553946870280419:3539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:39.588704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:39.590634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:39.590605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553946870280419:3539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:39.590637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553946870280419:3539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:39.590641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553946870280419:3539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:39.590650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:39.590814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:39.590824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:39.590834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:39.590878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:39.590919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553946794761717:3257]
2025-10-02T09:28:39.591593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:39.592108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:39.592152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:39.592426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:39.592473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.592474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.592475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.592476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.592477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.592478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.592479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.592480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.592481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.592482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.592483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.592484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.592488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.592497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.592500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.592503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.592506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.592509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.592512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.592515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.592518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.592521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.592524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.592527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.592533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.592539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.592543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.592548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.592551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.592555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.592557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.592561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.592566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.592570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.592573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.592577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.592581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.592585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.592588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.592592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.592596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.592600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.592604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.592608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.592612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.592616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.592621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.592625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.592652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:39.603337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:39.605555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:39.605579Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:39.605582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:39.605586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:39.605593Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [2:7556553946794761717:3257]
2025-10-02T09:28:39.605610Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:39.605628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:39.605631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.605633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.605635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.605649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:39.605654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:39.605661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:39.605729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.605742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.605743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.605747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:39.605749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:39.605823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:39.605831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.605844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.605854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.605870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:39.605895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280595:3539], now have 1 active actors on pipe
2025-10-02T09:28:39.605903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280368:2446], now have 1 active actors on pipe
2025-10-02T09:28:39.605909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.605911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.605916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.605928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:39.605942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:39.605946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:39.605949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:39.605951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:39.605955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:39.605958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:39.605996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.606009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:39.606025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:39.606046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 176
2025-10-02T09:28:39.606069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 176
2025-10-02T09:28:39.606380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.606393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.606434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:39.606445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.606449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.606452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:39.606461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.606472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:39.606486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.606654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.606661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.606673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.606772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0
2025-10-02T09:28:39.609133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33662820-20fc3ea1-468cffc8-6c0c76c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:39.612035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Write session: try to update token
2025-10-02T09:28:39.612056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:39.618596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:39.618615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.618618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:39.618620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:39.618628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.618633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.618636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553946794761712:3257]
2025-10-02T09:28:39.618670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:39.618676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.618682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:39.618683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:39.618688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:39.618692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:39.618822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:39.632685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:39.635824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:39.667766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553946870280606:3101]
2025-10-02T09:28:39.668066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7556553946870280606:3101]
2025-10-02T09:28:39.760722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:39.761169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.761180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.761195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280606:3101], now have 1 active actors on pipe
2025-10-02T09:28:39.761369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:39.761430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553946870280606:3101]
2025-10-02T09:28:39.761440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:39.761465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:39.761513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0
2025-10-02T09:28:39.761678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0 is DEAD
2025-10-02T09:28:39.761850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:39.761865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Write session will restart in 0.009620s
2025-10-02T09:28:39.761893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Write session: Do CDS request
2025-10-02T09:28:39.761899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:39.772315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.772384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:39.772396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-10-02T09:28:39.772557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.772584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:39.772593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:39.772597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:39.772998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-10-02T09:28:39.773029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:39.773036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:39.773038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:39.773043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553946870280780:3544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:39.773539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553946870280780:3544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:39.775212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:39.775494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553946870280780:3544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:39.776352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:39.776506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:39.776515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:39.776523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:39.776559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:39.776596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553946794761952:3260]
2025-10-02T09:28:39.777138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:39.777412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:39.777473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:39.777793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:39.777842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.777850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.777851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.777852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.777853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.777854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.777856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.777857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.777858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.777859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.777860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.777874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553946870280780:3544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:39.777861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.777884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553946870280780:3544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:39.777888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553946870280780:3544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:39.777866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.777876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.777894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:39.777880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.777884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.777888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.777891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.777895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.777897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.777900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.777904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.777907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.777910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.777915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.777922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.777926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.777931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.777934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.777938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.777942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.777946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.777950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.777954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.777958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.777962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.777965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.777970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.777974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.777979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.777983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.777987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.777991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.777995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.777999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.778004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.778009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.778014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.778047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:39.786589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:39.788651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:39.788669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:39.788671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:39.788674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:39.788680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [2:7556553946794761952:3260]
2025-10-02T09:28:39.788694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:39.788710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:39.788713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.788716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.788717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.788732Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:39.788743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:39.788749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:39.788834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.788842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.788844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.788847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:39.788849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:39.788912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:39.788919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.788931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.788944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.788964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:39.788987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280854:3544], now have 1 active actors on pipe
2025-10-02T09:28:39.788990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280621:2446], now have 1 active actors on pipe
2025-10-02T09:28:39.788996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.788998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.789000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.789010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:39.789021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:39.789026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:39.789029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:39.789032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:39.789034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:39.789036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:39.789069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.789079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:39.789085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:39.789088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 177
2025-10-02T09:28:39.789092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 177
2025-10-02T09:28:39.789132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.789141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.789162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ade5338b-11acaae1-374b28fd-69cd899a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:39.789170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.789174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.789175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:39.789183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.789191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:39.789202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.789333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.789339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.789350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.789444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 36 sessionId: src_id|ade5338b-11acaae1-374b28fd-69cd899a_0
2025-10-02T09:28:39.789764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7122caa-540ee4bf-897ea5dc-82e75bda_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ade5338b-11acaae1-374b28fd-69cd899a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:39.793065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Write session: try to update token
2025-10-02T09:28:39.793083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:39.799646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:39.799669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.799680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.799730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:39.799742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:39.799938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:39.800089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.800247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.800404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.800651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:39.800695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:39.811053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:39.811075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.811078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:39.811080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:39.811090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.811094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.811098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553946794761947:3260]
2025-10-02T09:28:39.811140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:39.811172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:39.811177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.811179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:39.811181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:39.811182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:39.811335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:39.812910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|ade5338b-11acaae1-374b28fd-69cd899a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:39.815828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:39.861787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553946870280886:3101]
2025-10-02T09:28:39.862018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7556553946870280886:3101]
2025-10-02T09:28:39.950816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:39.951404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.951420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.951436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280886:3101], now have 1 active actors on pipe
2025-10-02T09:28:39.951647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:39.951655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553946870280886:3101]
2025-10-02T09:28:39.951663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:39.951672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:39.951719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: error at write: Disconnected sessionId: src_id|ade5338b-11acaae1-374b28fd-69cd899a_0
2025-10-02T09:28:39.951870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|ade5338b-11acaae1-374b28fd-69cd899a_0 is DEAD
2025-10-02T09:28:39.952015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:39.952025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Write session will restart in 0.007754s
2025-10-02T09:28:39.952042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Write session: Do CDS request
2025-10-02T09:28:39.952048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:39.951699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:39.961257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.961372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:39.961385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-10-02T09:28:39.961490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:39.961520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:39.961537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:39.961546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:39.961995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-10-02T09:28:39.962027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:39.962032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:39.962033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:39.962038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553946870280975:3555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:39.962526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553946870280975:3555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:39.964483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553946870280975:3555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:39.965921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:39.966887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:39.967027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:39.967039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:39.967046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:39.967087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:39.967093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553946870280975:3555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:39.967103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553946870280975:3555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:39.967123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553946794762222:3274]
2025-10-02T09:28:39.967105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553946870280975:3555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:39.967115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:39.967685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:39.967923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:39.967960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:39.968241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:39.968284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.968291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.968293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.968296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.968297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.968298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.968298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.968299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.968301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.968302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.968306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.968316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.968320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.968324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.968327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.968331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.968334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.968338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.968342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.968346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.968350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.968353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.968359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.968366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:39.968371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.968376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:39.968381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.968385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:39.968389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.968394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:39.968398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.968403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:39.968407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.968411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:39.968416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.968421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:39.968425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.968429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:39.968436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.968440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:39.968444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.968448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.968453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.968458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.968462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.968466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.968499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:39.976917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:39.978727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:39.978745Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:39.978747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:39.978750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:39.978756Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [2:7556553946794762222:3274]
2025-10-02T09:28:39.978768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:39.978783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:39.978786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.978789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.978790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.978804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:39.978813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:39.978820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:39.978874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.978882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.978884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.978887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:39.978889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:39.978951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:39.978959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:39.978970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:39.978979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:39.978993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:39.979013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:39.979020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:39.979022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:39.979034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:39.979050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:39.979053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870281116:3555], now have 1 active actors on pipe
2025-10-02T09:28:39.979056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553946870280891:2446], now have 1 active actors on pipe
2025-10-02T09:28:39.979060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:39.979062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:39.979063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:39.979075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:39.979077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:39.979104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:39.979118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:39.979111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 178
2025-10-02T09:28:39.979132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:39.979111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 178
2025-10-02T09:28:39.979171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.979174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.979197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:39.979209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:39.979213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:39.979215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:39.979223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:39.979230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:39.979242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.979373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:39.979379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:39.979390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:39.979539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0
2025-10-02T09:28:39.979873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade5338b-11acaae1-374b28fd-69cd899a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:39.983047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Write session: try to update token
2025-10-02T09:28:39.983064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:39.998096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:39.998242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:39.998262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:39.998269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:39.998314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:39.999510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:39.999685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:39.999832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:39.999969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:40.000102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:40.000306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:40.000348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:40.000350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.000353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:40.000355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:40.000362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:40.000365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:40.000369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553946794762217:3274]
2025-10-02T09:28:40.000403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:40.000409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:40.000414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:40.000418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:40.000427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:40.000433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.000440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:40.000574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:40.001133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:40.051764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553951165248425:3101]
2025-10-02T09:28:40.052035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7556553951165248425:3101]
2025-10-02T09:28:40.141736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:40.142271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.142282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.142296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248425:3101], now have 1 active actors on pipe
2025-10-02T09:28:40.142443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:40.142502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:40.142524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:40.142528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:40.142553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553951165248425:3101]
2025-10-02T09:28:40.142578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: error at write: Disconnected sessionId: src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0
2025-10-02T09:28:40.142732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0 is DEAD
2025-10-02T09:28:40.142914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:40.142929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Write session will restart in 0.006008s
2025-10-02T09:28:40.142957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Write session: Do CDS request
2025-10-02T09:28:40.142963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:40.150238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.150338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:40.150349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-10-02T09:28:40.150445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.150471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:40.150479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:40.150493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:40.150927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-10-02T09:28:40.150954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:40.150958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:40.150959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:40.150962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553951165248516:3560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:40.151350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553951165248516:3560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:40.153371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553951165248516:3560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:40.154256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:40.154885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:40.155019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:40.155026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553951165248516:3560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:40.155029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:40.155034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553951165248516:3560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:40.155037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:40.155036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553951165248516:3560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:40.155040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:40.155071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:40.155097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553951089729754:3277]
2025-10-02T09:28:40.155461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:40.155645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:40.155672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:40.155860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:40.155889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.155893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.155894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.155894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.155895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.155896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.155896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.155897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.155897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.155898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.155898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.155899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.155902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.155908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.155910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.155913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.155914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.155917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.155918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.155920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.155922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.155925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.155927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.155928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.155932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.155936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.155939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.155942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.155945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.155947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.155949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.155952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.155955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.155957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.155959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.155962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.155968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.155971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.155973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.155975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.155978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.155981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.155988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.155991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.155993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.155997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.155999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.156005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.156023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:40.163969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:40.165788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:40.165799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:40.165801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:40.165803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:40.165807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [2:7556553951089729754:3277]
2025-10-02T09:28:40.165814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:40.165825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:40.165827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.165829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.165830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.165839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:40.165842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:40.165846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:40.165891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.165898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.165900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.165902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:40.165904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:40.165952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:40.165957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.165964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.165974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.165987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:40.166009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.166015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.166017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.166028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:40.166039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:40.166041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:40.166043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:40.166046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248659:3560], now have 1 active actors on pipe
2025-10-02T09:28:40.166050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248429:2446], now have 1 active actors on pipe
2025-10-02T09:28:40.166057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:40.166065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:40.166066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:40.166083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.166091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:40.166104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:40.166088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 179
2025-10-02T09:28:40.166093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 179
2025-10-02T09:28:40.166254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.166265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.166284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:40.166295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.166301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.166303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:40.166310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.166321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:40.166335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.166492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.166500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.166511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.166598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 36 sessionId: src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0
2025-10-02T09:28:40.166901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c5ea20-41ee97d7-cde07851-715917f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:40.169916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Write session: try to update token
2025-10-02T09:28:40.169933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:40.176321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:40.176340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.176343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:40.176345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:40.176354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.176358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.176362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553951089729749:3277]
2025-10-02T09:28:40.176396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:40.176404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.176406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:40.176414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:40.176419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:40.176423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:40.176539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:40.184758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:40.187270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:40.242733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553951165248671:3101]
2025-10-02T09:28:40.243005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7556553951165248671:3101]
2025-10-02T09:28:40.308927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:40.309242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.309254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.309268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248671:3101], now have 1 active actors on pipe
2025-10-02T09:28:40.309536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:40.309675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:40.309691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:40.309746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553951165248671:3101]
2025-10-02T09:28:40.309772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:40.309782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: error at write: Disconnected sessionId: src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0
2025-10-02T09:28:40.309974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0 is DEAD
2025-10-02T09:28:40.310133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:40.310146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Write session will restart in 0.005665s
2025-10-02T09:28:40.310176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Write session: Do CDS request
2025-10-02T09:28:40.310183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:40.317256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.318104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:40.318122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-10-02T09:28:40.318272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.318304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:40.318309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:40.318313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:40.319071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-10-02T09:28:40.319105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:40.319106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:40.319108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:40.319112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553951165248708:3565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:40.319605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553951165248708:3565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:40.322651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553951165248708:3565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:40.325577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553951165248708:3565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:40.325593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553951165248708:3565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:40.325597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553951165248708:3565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:40.325604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:40.329633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:40.335308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:40.335578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:40.335589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:40.335601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:40.335663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:40.335712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553951089730002:3279]
2025-10-02T09:28:40.336348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:40.336782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:40.336884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:40.337260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:40.337334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.337343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.337345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.337346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.337347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.337349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.337350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.337351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.337352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.337354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.337355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.337356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.337362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.337373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.337378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.337382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.337386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.337390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.337394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.337397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.337401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.337406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.337410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.337415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.337422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.337430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.337436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.337442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.337447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.337453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.337457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.337464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.337468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.337474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.337479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.337485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.337490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.337496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.337500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.337505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.337514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.337519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.337524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.337530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.337535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.337540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.337546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.337551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.337585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:40.346680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:40.349127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:40.349148Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:40.349150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:40.349154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:40.349160Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [2:7556553951089730002:3279]
2025-10-02T09:28:40.349175Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:40.349193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:40.349196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.349199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.349200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.349215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:40.349220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:40.349226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:40.349291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.349301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.349303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.349305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:40.349307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:40.349378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:40.349388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.349404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.349413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.349426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:40.349442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.349444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.349446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.349459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:40.349473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:40.349493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:40.349496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:40.349530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.349529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:40.349532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:40.349533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:40.349544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:40.349551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:40.349771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 180
2025-10-02T09:28:40.349771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 180
2025-10-02T09:28:40.349842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248862:3565], now have 1 active actors on pipe
2025-10-02T09:28:40.349856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248672:2446], now have 1 active actors on pipe
2025-10-02T09:28:40.349988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.350007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.350038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|576b210a-c445a485-53dcf496-1085c641_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:40.350053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.350057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.350059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:40.350069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.350080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:40.350095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.350310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.350325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.350346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.350483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 36 sessionId: src_id|576b210a-c445a485-53dcf496-1085c641_0
2025-10-02T09:28:40.351540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e012f62e-c74bc4ac-1f4e9e47-32f773ad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|576b210a-c445a485-53dcf496-1085c641_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:40.354754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Write session: try to update token
2025-10-02T09:28:40.354771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:40.362489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:40.362514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.362516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:40.362519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:40.362528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.362532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.362536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553951089729997:3279]
2025-10-02T09:28:40.362577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:40.362584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.362584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:40.362587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:40.362592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:40.362596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:40.362740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:40.370561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|576b210a-c445a485-53dcf496-1085c641_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:40.373673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:40.409664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553951165248928:3101]
2025-10-02T09:28:40.409957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7556553951165248928:3101]
2025-10-02T09:28:40.508004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:40.508453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.508482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.508502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248928:3101], now have 1 active actors on pipe
2025-10-02T09:28:40.508707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:40.508721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:40.508731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:40.508776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553951165248928:3101]
2025-10-02T09:28:40.508797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: error at write: Disconnected sessionId: src_id|576b210a-c445a485-53dcf496-1085c641_0
2025-10-02T09:28:40.508981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|576b210a-c445a485-53dcf496-1085c641_0 is DEAD
2025-10-02T09:28:40.508905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:40.509341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:40.509357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Write session will restart in 0.005934s
2025-10-02T09:28:40.509394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Write session: Do CDS request
2025-10-02T09:28:40.509400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:40.516370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.516476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:40.516492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-10-02T09:28:40.516707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.516747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:40.516757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:40.516762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:40.517192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-10-02T09:28:40.517223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:40.517230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:40.517234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:40.517239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553951165248942:3569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:40.517773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553951165248942:3569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:40.519894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553951165248942:3569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:40.524076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553951165248942:3569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:40.524094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553951165248942:3569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:40.524097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553951165248942:3569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:40.524105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:40.531676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:40.532985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:40.533382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:40.533399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:40.533414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:40.533482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:40.533529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553951089730238:3282]
2025-10-02T09:28:40.534231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:40.534533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:40.534584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:40.534826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:40.534869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.534876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.534877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.534890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.534892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.534893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.534894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.534895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.534896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.534898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.534899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.534899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.534904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.534916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.534920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.534923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.534926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.534928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.534930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.534933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.534935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.534938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.534940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.534942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.534946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.534951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.534955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.534958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.534960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.534964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.534966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.534969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.534972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.534975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.534978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.534981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.534984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.534987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.534989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.534993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.534995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.534998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.535001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.535004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.535006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.535009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.535012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.535016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.535037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:40.544041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:40.546093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:40.546110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:40.546112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:40.546116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:40.546122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [2:7556553951089730238:3282]
2025-10-02T09:28:40.546139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:40.546156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:40.546159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.546162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.546164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.546178Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:40.546186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:40.546192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:40.546254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.546264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.546265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.546268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:40.546271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:40.546339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:40.546348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.546360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.546371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.546385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:40.546411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248997:3569], now have 1 active actors on pipe
2025-10-02T09:28:40.546422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165248931:2446], now have 1 active actors on pipe
2025-10-02T09:28:40.546428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.546430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.546432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.546447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:40.546460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:40.546470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:40.546474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:40.546478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:40.546482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:40.546483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:40.546510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.546507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 181
2025-10-02T09:28:40.546508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 181
2025-10-02T09:28:40.546522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:40.546536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:40.546559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.546563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.546594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:40.546604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.546611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.546614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:40.546622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.546631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:40.546645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.547039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.547049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.547068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.547186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0
2025-10-02T09:28:40.547609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576b210a-c445a485-53dcf496-1085c641_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:40.550847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Write session: try to update token
2025-10-02T09:28:40.550872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:40.558345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:40.558363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.558366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:40.558368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:40.558375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.558379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.558383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553951089730233:3282]
2025-10-02T09:28:40.558455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:40.558466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.558468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:40.558474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:40.558480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:40.558484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:40.558624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:40.596899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:40.600220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:40.608840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553951165249174:3101]
2025-10-02T09:28:40.609167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7556553951165249174:3101]
2025-10-02T09:28:40.704443Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:40.705200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.705215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.705229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165249174:3101], now have 1 active actors on pipe
2025-10-02T09:28:40.705628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:40.705643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:40.705647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553951165249174:3101]
2025-10-02T09:28:40.705710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: error at write: Disconnected sessionId: src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0
2025-10-02T09:28:40.705713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:40.705896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0 is DEAD
2025-10-02T09:28:40.706094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:40.706109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Write session will restart in 0.008283s
2025-10-02T09:28:40.706147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Write session: Do CDS request
2025-10-02T09:28:40.706162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:40.706445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:40.715839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.715932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:40.715949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-10-02T09:28:40.716071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.716097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:40.716105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:40.716109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:40.716510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-10-02T09:28:40.716557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:40.716563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:40.716565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:40.716571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553951165249212:3574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:40.717174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553951165249212:3574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:40.721194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553951165249212:3574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:40.725965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:40.727297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:40.727486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:40.727489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:40.727498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:40.727543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:40.727581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553951089730474:3284]
2025-10-02T09:28:40.728130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:40.728409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:40.728442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:40.728698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:40.728743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.728743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.728744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.728745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.728747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.728748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.728749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.728750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.728751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.728752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.728753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.728754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.728758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.728768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.728772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.728776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.728780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.728784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.728788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.728792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.728795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.728815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.728819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.728823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.728828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.728836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.728841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.728847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.728851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.728856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.728859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.728862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.728865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.728868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.728870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.728873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.728876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.728879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.728881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.728884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.728888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.728891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.728894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.728897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.728899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.728902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.728905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.728908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.728926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:40.736084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553951165249212:3574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:40.736116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553951165249212:3574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:40.736122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553951165249212:3574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:40.736143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:40.743599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:40.747144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:40.747183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:40.747186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:40.747189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:40.747199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [2:7556553951089730474:3284]
2025-10-02T09:28:40.747218Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:40.747235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:40.747238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.747241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.747243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.747258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:40.747267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:40.747273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:40.747353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.747360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.747362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.747365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:40.747368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:40.747458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:40.747465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.747479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.747496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.747515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:40.747537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165249180:2446], now have 1 active actors on pipe
2025-10-02T09:28:40.747544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165249423:3574], now have 1 active actors on pipe
2025-10-02T09:28:40.747551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.747553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.747555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.747564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:40.747578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:40.747581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:40.747583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:40.747585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:40.747596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:40.747599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:40.747635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.747645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:40.747651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:40.749027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 182
2025-10-02T09:28:40.749078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 182
2025-10-02T09:28:40.749145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.749164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.749190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:40.749204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.749212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.749215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:40.749226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.749242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:40.749274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.749430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.749437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.749451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.749523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 36 sessionId: src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0
2025-10-02T09:28:40.749900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1394f18-7c1c22fd-d7c97a60-d1e5d2c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:40.761558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:40.761581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.761584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:40.761587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:40.761594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.761599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.761604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553951089730468:3284]
2025-10-02T09:28:40.761646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:40.761653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.761655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:40.761868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:40.763196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Write session: try to update token
2025-10-02T09:28:40.763219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:40.764864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:40.764887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:40.764890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:40.793034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:40.796051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:40.806372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553951165249433:3101]
2025-10-02T09:28:40.806701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7556553951165249433:3101]
2025-10-02T09:28:40.911544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:40.912717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.912736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.912755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165249433:3101], now have 1 active actors on pipe
2025-10-02T09:28:40.913017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:40.913076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:40.913078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:40.913151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553951165249433:3101]
2025-10-02T09:28:40.913173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: error at write: Disconnected sessionId: src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0
2025-10-02T09:28:40.913284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:40.913380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0 is DEAD
2025-10-02T09:28:40.913553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:40.913565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Write session will restart in 0.006186s
2025-10-02T09:28:40.913605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Write session: Do CDS request
2025-10-02T09:28:40.913611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:40.921429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.922148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:40.922176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-10-02T09:28:40.922357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:40.922396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:40.922408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:40.922412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:40.924118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-10-02T09:28:40.924152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:40.924154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:40.924156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:40.924162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553951165249515:3585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:40.924715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553951165249515:3585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:40.927722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553951165249515:3585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:40.929884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:40.930719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:40.930904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:40.930914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:40.930922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:40.930962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:40.931001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553951089730751:3299]
2025-10-02T09:28:40.931652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:40.931655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553951165249515:3585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:40.931667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553951165249515:3585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:40.931670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553951165249515:3585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:40.931677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:40.931879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:40.931917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:40.932270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:40.932319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.932326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.932327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.932328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.932329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.932330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.932332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.932333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.932334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.932335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.932336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.932337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.932342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.932353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.932357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.932361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.932365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.932369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.932373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.932377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.932381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.932385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.932388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.932392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.932397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.932404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:40.932409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.932415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:40.932419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.932424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:40.932428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.932433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:40.932438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.932443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:40.932452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.932459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:40.932467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.932473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:40.932479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.932484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:40.932491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.932496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:40.932501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.932509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.932514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.932535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.932541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.932546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.932580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:40.940891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:40.943885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:40.943906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:40.943908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:40.943912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:40.943918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [2:7556553951089730751:3299]
2025-10-02T09:28:40.943931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:40.943946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:40.943949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.943951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.943953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.943968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:40.943977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:40.943983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:40.944040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.944047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.944049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.944052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:40.944055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:40.944117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:40.944124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.944136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:40.944148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:40.944164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:40.944181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165249460:2446], now have 1 active actors on pipe
2025-10-02T09:28:40.944185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553951165249693:3585], now have 1 active actors on pipe
2025-10-02T09:28:40.944190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.944192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.944195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.944210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:40.944221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:40.944224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:40.944228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:40.944230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:40.944235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:40.944237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:40.944267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.944270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:40.944282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:40.944261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 183
2025-10-02T09:28:40.944290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 183
2025-10-02T09:28:40.944316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.944325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.944346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:40.944352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:40.944356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:40.944358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:40.944365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:40.944373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:40.944385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.944573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:40.944587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:40.944608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:40.944755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0
2025-10-02T09:28:40.945199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91cd2c2-297897ea-7920bdbd-49d57967_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:40.956987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Write session: try to update token
2025-10-02T09:28:40.957010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:40.965763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:40.965778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.965786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.965829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:40.968301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:40.968647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:40.968788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:40.968939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:40.969902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:40.970187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:40.970227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:40.970235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:40.970237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:40.970239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:40.970245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.970249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.970253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553951089730746:3299]
2025-10-02T09:28:40.970287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:40.970300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:40.970306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:40.970309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:40.970418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:40.970428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:40.970430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:40.970553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:40.983179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:40.985847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:41.013303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553955460216999:3101]
2025-10-02T09:28:41.013564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7556553955460216999:3101]
2025-10-02T09:28:41.109481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:41.109721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.109730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.109745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460216999:3101], now have 1 active actors on pipe
2025-10-02T09:28:41.110006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:41.110008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553955460216999:3101]
2025-10-02T09:28:41.110097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:41.110106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:41.110156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: error at write: Disconnected sessionId: src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0
2025-10-02T09:28:41.110306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:41.110319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0 is DEAD
2025-10-02T09:28:41.110443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:41.110459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Write session will restart in 0.006976s
2025-10-02T09:28:41.110557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Write session: Do CDS request
2025-10-02T09:28:41.110574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:41.118345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.118400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:41.118412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-10-02T09:28:41.118592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.118618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:41.118627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:41.118630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:41.118985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-10-02T09:28:41.119019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:41.119025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:41.119027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:41.119032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553955460217037:3590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:41.119645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553955460217037:3590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:41.121724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553955460217037:3590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:41.124099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553955460217037:3590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:41.124112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553955460217037:3590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:41.124115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553955460217037:3590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:41.124121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:41.125308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:41.126274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:41.126491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:41.126502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:41.126511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:41.126563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:41.126597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553955384698289:3302]
2025-10-02T09:28:41.127142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:41.127487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:41.127532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:41.127817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:41.127878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.127884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.127885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.127886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.127887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.127888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.127889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.127890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.127891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.127891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.127892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.127893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.127898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.127908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.127912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.127916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.127920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.127924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.127927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.127931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.127936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.127939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.127945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.127948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.127954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.127966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.127975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.127979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.127987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.127993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.128000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.128005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.128013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.128018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.128026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.128031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.128037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.128042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.128048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.128053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.128061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.128066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.128074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.128079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.128087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.128092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.128100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.128106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.128143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:41.136464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:41.138317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:41.138334Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:41.138336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:41.138339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:41.138344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [2:7556553955384698289:3302]
2025-10-02T09:28:41.138356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:41.138370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:41.138373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.138375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.138376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.138386Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:41.138390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:41.138397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:41.138444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.138452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.138453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.138455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:41.138457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:41.138502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:41.138507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.138515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.138520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.138529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:41.138542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.138547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.138548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.138554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:41.138563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:41.138567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:41.138570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:41.138574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:41.138575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:41.138576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:41.138596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217003:2446], now have 1 active actors on pipe
2025-10-02T09:28:41.138602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217235:3590], now have 1 active actors on pipe
2025-10-02T09:28:41.138603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.138609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:41.138625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:41.138674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 184
2025-10-02T09:28:41.138689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 184
2025-10-02T09:28:41.138739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.138746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.138762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:41.138767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.138769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.138770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:41.138776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.138782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:41.138791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.138968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.138974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.138983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.139067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 36 sessionId: src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0
2025-10-02T09:28:41.139397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb338158-790f6b7b-156881d4-e8fc90e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:41.141764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Write session: try to update token
2025-10-02T09:28:41.141783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:41.150889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:41.150902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.150909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.150939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:41.150973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:41.151125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:41.151267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:41.151392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:41.151511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:41.151786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:41.151822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:41.156929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:41.158288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:41.158301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.158302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:41.158303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:41.158308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.158314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.158317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553955384698284:3302]
2025-10-02T09:28:41.158344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:41.158349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.158351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:41.158379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:41.158384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:41.158387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:41.158475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:41.159527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:41.210397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553955460217250:3101]
2025-10-02T09:28:41.210686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7556553955460217250:3101]
2025-10-02T09:28:41.291254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:41.291677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.291691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.291708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217250:3101], now have 1 active actors on pipe
2025-10-02T09:28:41.291931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553955460217250:3101]
2025-10-02T09:28:41.291936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:41.291980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:41.291982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:41.292046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: error at write: Disconnected sessionId: src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0
2025-10-02T09:28:41.292097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:41.292218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0 is DEAD
2025-10-02T09:28:41.292375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:41.292392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Write session will restart in 0.005412s
2025-10-02T09:28:41.292420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Write session: Do CDS request
2025-10-02T09:28:41.292427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:41.299418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:41.299464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.299432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-10-02T09:28:41.299936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.299959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:41.299969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:41.299972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:41.300475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-10-02T09:28:41.300519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:41.300521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:41.300522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:41.300526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553955460217268:3594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:41.301147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553955460217268:3594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:41.302990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553955460217268:3594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:41.305787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553955460217268:3594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:41.305797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553955460217268:3594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:41.305799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553955460217268:3594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:41.305804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:41.307248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:41.308044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:41.308187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:41.308194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:41.308202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:41.308240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:41.308279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553955384698531:3304]
2025-10-02T09:28:41.308796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:41.309026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:41.309058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:41.309335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:41.309383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.309388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.309389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.309390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.309391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.309392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.309393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.309394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.309395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.309396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.309397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.309397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.309401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.309411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.309415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.309418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.309421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.309429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.309432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.309439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.309443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.309450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.309458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.309461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.309471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.309477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.309482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.309487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.309491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.309496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.309500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.309504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.309508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.309512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.309515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.309519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.309522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.309526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.309534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.309539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.309543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.309547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.309556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.309561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.309564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.309569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.309576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.309581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.309613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:41.319252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:41.321011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:41.321023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:41.321026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:41.321028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:41.321033Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [2:7556553955384698531:3304]
2025-10-02T09:28:41.321043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:41.321056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:41.321058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.321060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.321062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.321073Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:41.321078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:41.321083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:41.321127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.321136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.321137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.321140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:41.321142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:41.321195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:41.321202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.321213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.321228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.321248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:41.321268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217458:3594], now have 1 active actors on pipe
2025-10-02T09:28:41.321275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217252:2446], now have 1 active actors on pipe
2025-10-02T09:28:41.321280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.321282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.321284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.321293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:41.321303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:41.321306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:41.321309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:41.321310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:41.321316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:41.321318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:41.321299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 185
2025-10-02T09:28:41.321312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 185
2025-10-02T09:28:41.321345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.321352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.321361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.321371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:41.321379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:41.321398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:41.321407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.321410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.321412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:41.321419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.321430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:41.321448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.321556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.321565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.321576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.321636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 36 sessionId: src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0
2025-10-02T09:28:41.321917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fef6220e-8a10ef43-51cd69c6-26cf42c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:41.324973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Write session: try to update token
2025-10-02T09:28:41.324986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:41.333743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:41.333761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.333763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:41.333765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:41.333771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.333776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.333779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553955384698526:3304]
2025-10-02T09:28:41.333810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:41.333815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.333819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:41.333822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:41.333826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:41.333829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:41.333952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:41.340688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:41.343057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:41.392163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553955460217512:3101]
2025-10-02T09:28:41.392408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7556553955460217512:3101]
2025-10-02T09:28:41.476155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:41.476711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.476723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.476754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217512:3101], now have 1 active actors on pipe
2025-10-02T09:28:41.476970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:41.477053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553955460217512:3101]
2025-10-02T09:28:41.477071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:41.477086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:41.477142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: status is not ok: tablet will be restarted right now sessionId: src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0
2025-10-02T09:28:41.477292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0 is DEAD
2025-10-02T09:28:41.477436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:41.477447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Write session will restart in 0.006447s
2025-10-02T09:28:41.477477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Write session: Do CDS request
2025-10-02T09:28:41.477484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:41.485290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.485499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:41.485513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-10-02T09:28:41.485603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.485632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:41.485640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:41.485646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:41.485978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-10-02T09:28:41.486003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:41.486007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:41.486009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:41.486012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553955460217545:3599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:41.486415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553955460217545:3599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:41.488696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553955460217545:3599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:41.491520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553955460217545:3599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:41.491539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553955460217545:3599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:41.491541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553955460217545:3599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:41.491549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:41.491808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:41.492761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:41.492944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:41.492953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:41.492963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:41.493007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:41.493045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553955384698784:3307]
2025-10-02T09:28:41.493415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:41.493633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:41.493658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:41.493853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:41.493887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.493891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.493892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.493892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.493893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.493893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.493894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.493894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.493895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.493896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.493896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.493897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.493900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.493907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.493909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.493911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.493913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.493915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.493917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.493919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.493921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.493923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.493925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.493927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.493931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.493934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.493938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.493941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.493943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.493946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.493948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.493951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.493953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.493956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.493958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.493961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.493963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.493966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.493969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.493972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.493974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.493977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.493979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.493982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.493984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.493987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.493990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.493994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.494011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:41.504201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:41.506080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:41.506092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:41.506094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:41.506097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:41.506101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [2:7556553955384698784:3307]
2025-10-02T09:28:41.506111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:41.506123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:41.506125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.506127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.506129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.506139Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:41.506142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:41.506147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:41.506192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.506198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.506199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.506201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:41.506203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:41.506253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:41.506258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.506266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.506275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.506287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:41.506299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.506302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.506303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.506308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:41.506317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:41.506319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217515:2446], now have 1 active actors on pipe
2025-10-02T09:28:41.506321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217754:3599], now have 1 active actors on pipe
2025-10-02T09:28:41.506325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:41.506327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:41.506327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:41.506334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:41.506336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:41.506359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.506364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:41.506390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:41.506439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 186
2025-10-02T09:28:41.506460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 186
2025-10-02T09:28:41.506521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.506528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.506546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:41.506554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.506556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.506558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:41.506564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.506571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:41.506580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.506721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.506727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.506742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.506833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 36 sessionId: src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0
2025-10-02T09:28:41.507191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69cfdcee-4aeb7c90-87acd40d-583861f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:41.509778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Write session: try to update token
2025-10-02T09:28:41.509794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:41.522828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:41.522844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.522850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.522884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:41.522884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:41.523035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:41.523167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:41.523286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:41.523400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:41.523565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:41.523595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:41.526062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:41.528912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:41.529898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.529911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.529926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:41.529927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.529929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:41.529930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:41.529934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.529937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.529939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553955384698779:3307]
2025-10-02T09:28:41.529963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:41.529969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:41.529972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:41.529974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.529975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:41.529975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:41.530123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:41.577013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553955460217767:3101]
2025-10-02T09:28:41.577273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7556553955460217767:3101]
2025-10-02T09:28:41.663702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:41.664425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:41.664464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217767:3101], now have 1 active actors on pipe
2025-10-02T09:28:41.664648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:41.664704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553955460217767:3101]
2025-10-02T09:28:41.664732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:41.664833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:41.664845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:41.664937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: error at write: Disconnected sessionId: src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0
2025-10-02T09:28:41.665123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0 is DEAD
2025-10-02T09:28:41.665289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:41.665305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Write session will restart in 0.005678s
2025-10-02T09:28:41.665333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Write session: Do CDS request
2025-10-02T09:28:41.665343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:41.672357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.672414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:41.672428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-10-02T09:28:41.672647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.672678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:41.672689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:41.672694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:41.673428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-10-02T09:28:41.673459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:41.673467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:41.673469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:41.673475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553955460217797:3605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:41.674204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553955460217797:3605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:41.676360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553955460217797:3605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:41.679357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553955460217797:3605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:41.679378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553955460217797:3605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:41.679382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553955460217797:3605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:41.679392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:41.680403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:41.681412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:41.681633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:41.681646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:41.681656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:41.681706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:41.681740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553955384699026:3309]
2025-10-02T09:28:41.682241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:41.682528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:41.682557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:41.682798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:41.682854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.682859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.682860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.682861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.682863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.682864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.682865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.682866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.682867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.682868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.682869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.682870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.682874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.682883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.682887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.682891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.682894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.682897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.682899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.682901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.682903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.682906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.682908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.682910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.682914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.682918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.682921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.682924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.682926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.682930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.682932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.682935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.682939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.682942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.682944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.682946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.682949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.682958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.682961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.682963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.682966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.682968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.682971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.682973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.682977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.682980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.682982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.682984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.683003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:41.701828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:41.703913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:41.703930Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:41.703932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:41.703934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:41.703939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [2:7556553955384699026:3309]
2025-10-02T09:28:41.703949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:41.703962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:41.703963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.703965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.703967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.703978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:41.703981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:41.703985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:41.704046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.704052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.704053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.704055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:41.704057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:41.704107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:41.704113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.704121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.704127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.704136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:41.704151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.704156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.704158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.704167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:41.704176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:41.704183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:41.704186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:41.704188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:41.704197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:41.704204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:41.704213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460217769:2446], now have 1 active actors on pipe
2025-10-02T09:28:41.704217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460218005:3605], now have 1 active actors on pipe
2025-10-02T09:28:41.704244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.704254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:41.704265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:41.704254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 187
2025-10-02T09:28:41.704324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 187
2025-10-02T09:28:41.704463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.704474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.704497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:41.704508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.704519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.704521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:41.704531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.704540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:41.704553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.704704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.704714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.704733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.704831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 36 sessionId: src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0
2025-10-02T09:28:41.705194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f34fda-c484f73c-10a86cfc-f6c583db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:41.724916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Write session: try to update token
2025-10-02T09:28:41.724939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:41.726861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:41.726883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.726885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:41.726887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:41.726896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.726900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.726904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553955384699021:3309]
2025-10-02T09:28:41.726945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:41.726958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.726961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:41.726970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:41.726975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:41.726982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:41.727111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:41.740133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:41.763023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:41.764869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553955460218024:3101]
2025-10-02T09:28:41.765053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7556553955460218024:3101]
2025-10-02T09:28:41.869343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:41.869826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.869842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.869858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460218024:3101], now have 1 active actors on pipe
2025-10-02T09:28:41.870056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:41.870067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:41.870126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553955460218024:3101]
2025-10-02T09:28:41.870139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:41.870264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0
2025-10-02T09:28:41.870451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0 is DEAD
2025-10-02T09:28:41.870651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:41.870662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Write session will restart in 0.008024s
2025-10-02T09:28:41.870683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Write session: Do CDS request
2025-10-02T09:28:41.870688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:41.880359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.880506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:41.880522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-10-02T09:28:41.880655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:41.880685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:41.880690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:41.880694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:41.881310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-10-02T09:28:41.881361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:41.881363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:41.881365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:41.881372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553955460218120:3610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:41.881960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553955460218120:3610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:41.884600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553955460218120:3610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:41.886093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:41.887475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:41.887758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:41.887771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:41.887783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:41.887837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:41.887878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553955384699274:3312]
2025-10-02T09:28:41.887923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553955460218120:3610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:41.887938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553955460218120:3610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:41.887941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553955460218120:3610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:41.887948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:41.888403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:41.888699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:41.888744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:41.889066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:41.889132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.889140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.889141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.889142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.889143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.889144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.889145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.889146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.889147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.889148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.889149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.889150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.889155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.889165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.889169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.889172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.889177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.889181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.889184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.889190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.889194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.889198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.889201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.889204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.889209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.889216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:41.889220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.889225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:41.889231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.889242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:41.889246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.889251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:41.889255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.889259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:41.889263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.889267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:41.889271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.889275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:41.889279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.889284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:41.889287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.889292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:41.889297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.889302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.889306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.889311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.889314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.889319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.889351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:41.900308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:41.902361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:41.902380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:41.902384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:41.902387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:41.902393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [2:7556553955384699274:3312]
2025-10-02T09:28:41.902406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:41.902423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:41.902426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.902428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.902430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.902445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:41.902459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:41.902465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:41.902530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.902538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.902539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.902542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:41.902544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:41.902661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:41.902670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.902684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:41.902696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:41.902715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:41.902741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460218030:2446], now have 1 active actors on pipe
2025-10-02T09:28:41.902744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460218272:3610], now have 1 active actors on pipe
2025-10-02T09:28:41.902749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.902751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.902753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.902768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:41.902787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:41.902787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:41.902791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:41.902793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:41.902806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:41.902808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:41.902772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 188
2025-10-02T09:28:41.902821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 188
2025-10-02T09:28:41.902848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.902857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:41.902867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:41.902871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.902874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.902937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:41.902950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:41.902953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:41.902954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:41.902963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:41.902971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:41.902997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.903259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:41.903268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:41.903280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:41.903394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0
2025-10-02T09:28:41.903895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecc75971-9ec1578f-ded837a5-aafc66cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:41.907082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Write session: try to update token
2025-10-02T09:28:41.907097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:41.916787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:41.916820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:41.916822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:41.916825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:41.916833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.916836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.916840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553955384699265:3312]
2025-10-02T09:28:41.916884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:41.916887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:41.916892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:41.916893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:41.916894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:41.916895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:41.917038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:41.927364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:41.930062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:41.970229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553955460218302:3101]
2025-10-02T09:28:41.970417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7556553955460218302:3101]
2025-10-02T09:28:42.049988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:42.050301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.050311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.050323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553955460218302:3101], now have 1 active actors on pipe
2025-10-02T09:28:42.050513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:42.050519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:42.050562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:42.050565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:42.050605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553955460218302:3101]
2025-10-02T09:28:42.050619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: error at write: Disconnected sessionId: src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0
2025-10-02T09:28:42.050722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0 is DEAD
2025-10-02T09:28:42.050871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:42.050881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Write session will restart in 0.006888s
2025-10-02T09:28:42.050903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Write session: Do CDS request
2025-10-02T09:28:42.050909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:42.059414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.059569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:42.059589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-10-02T09:28:42.059738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.059767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:42.059778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:42.059782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:42.060370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-10-02T09:28:42.060403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:42.060409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:42.060411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:42.060417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553959755185646:3621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:42.060952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553959755185646:3621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:42.064321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553959755185646:3621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:42.067544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553959755185646:3621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:42.067566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553959755185646:3621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:42.067570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553959755185646:3621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:42.067581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:42.067633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:42.068836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:42.069000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:42.069009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:42.069017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:42.069062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:42.069100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553959679666847:3326]
2025-10-02T09:28:42.069697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:42.069959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:42.070003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:42.070300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:42.070352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.070358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.070359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.070360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.070361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.070362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.070363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.070364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.070365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.070366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.070367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.070368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.070373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.070383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.070387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.070391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.070394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.070398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.070401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.070405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.070413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.070417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.070424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.070428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.070438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.070448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.070457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.070467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.070476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.070481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.070485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.070495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.070503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.070511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.070516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.070520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.070525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.070534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.070542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.070551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.070560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.070568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.070577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.070582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.070590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.070600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.070609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.070618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.070660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:42.081395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:42.083686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:42.083705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:42.083707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:42.083710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:42.083716Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [2:7556553959679666847:3326]
2025-10-02T09:28:42.083728Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:42.083743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:42.083746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.083748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.083750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.083763Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:42.083772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:42.083777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:42.083843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.083849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.083851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.083854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:42.083856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:42.083916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:42.083923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.083935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.083948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.083965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:42.083987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755185840:3621], now have 1 active actors on pipe
2025-10-02T09:28:42.083994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755185601:2446], now have 1 active actors on pipe
2025-10-02T09:28:42.084001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.084003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.084005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.084014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:42.084025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:42.084029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:42.084032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:42.084034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:42.084043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:42.084046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:42.084073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.084079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:42.084084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:42.084067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 189
2025-10-02T09:28:42.084102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.084109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.084134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bd84c40-f67813ac-cc971277-567c9b24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:42.084127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 189
2025-10-02T09:28:42.084144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.084148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.084150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:42.084157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.084164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:42.084183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.084303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.084309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.084320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.084404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bd84c40-f67813ac-cc971277-567c9b24_0
2025-10-02T09:28:42.084747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b649de2-e627ff5d-a597f0e9-285eb627_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bd84c40-f67813ac-cc971277-567c9b24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:42.087916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Write session: try to update token
2025-10-02T09:28:42.087936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:42.095952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:42.095975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.095978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:42.095979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:42.095988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.095992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.095997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553959679666841:3326]
2025-10-02T09:28:42.096033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:42.096039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.096041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:42.096043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:42.096051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:42.096054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:42.096255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:42.102099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|9bd84c40-f67813ac-cc971277-567c9b24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:42.104674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:42.150968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553959755185854:3101]
2025-10-02T09:28:42.151248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7556553959755185854:3101]
2025-10-02T09:28:42.240544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:42.240972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.240982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.240995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755185854:3101], now have 1 active actors on pipe
2025-10-02T09:28:42.241140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:42.241269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553959755185854:3101]
2025-10-02T09:28:42.241292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:42.241292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:42.241364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bd84c40-f67813ac-cc971277-567c9b24_0
2025-10-02T09:28:42.241603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|9bd84c40-f67813ac-cc971277-567c9b24_0 is DEAD
2025-10-02T09:28:42.241759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:42.241778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Write session will restart in 0.007232s
2025-10-02T09:28:42.241810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Write session: Do CDS request
2025-10-02T09:28:42.241818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:42.250434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.250489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:42.250502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-10-02T09:28:42.250673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.250702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:42.250711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:42.250715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:42.251211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-10-02T09:28:42.251251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:42.251259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:42.251261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:42.251268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553959755185908:3626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:42.251686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553959755185908:3626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:42.253936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553959755185908:3626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:42.256621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553959755185908:3626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:42.256637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553959755185908:3626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:42.256641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553959755185908:3626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:42.256649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:42.258760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:42.260155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:42.260300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:42.260308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:42.260314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:42.260346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:42.260373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553959679667095:3329]
2025-10-02T09:28:42.260784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:42.261014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:42.261042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:42.261259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:42.261295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.261300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.261301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.261301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.261302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.261303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.261304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.261304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.261305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.261306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.261306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.261307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.261310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.261317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.261320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.261322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.261324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.261326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.261328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.261331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.261333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.261336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.261338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.261348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.261352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.261357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.261361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.261364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.261367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.261370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.261372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.261377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.261379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.261396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.261398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.261401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.261403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.261406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.261408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.261411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.261414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.261417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.261419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.261422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.261425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.261428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.261430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.261432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.261451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:42.272298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:42.274181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:42.274204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:42.274206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:42.274211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:42.274217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [2:7556553959679667095:3329]
2025-10-02T09:28:42.274231Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:42.274249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:42.274252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.274255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.274256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.274274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:42.274280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:42.274287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:42.274346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.274368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.274379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.274382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:42.274384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:42.274449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:42.274458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.274473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.274484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.274501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:42.274526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186085:3626], now have 1 active actors on pipe
2025-10-02T09:28:42.274535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755185857:2446], now have 1 active actors on pipe
2025-10-02T09:28:42.274542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.274547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.274549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.274563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:42.274579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:42.274581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:42.274588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:42.274590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:42.274596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:42.274599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:42.274608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 190
2025-10-02T09:28:42.274609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 190
2025-10-02T09:28:42.274632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.274642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:42.274650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:42.274677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.274680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.274705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:42.274716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.274720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.274723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:42.274731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.274743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:42.274761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.274893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.274901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.274915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.275026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0
2025-10-02T09:28:42.275414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bd84c40-f67813ac-cc971277-567c9b24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:42.278664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Write session: try to update token
2025-10-02T09:28:42.278691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:42.285609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:42.285630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.285638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.285676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:42.285687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:42.285861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:42.286007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:42.286182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:42.286358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:42.286612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:42.286653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:42.292908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:42.297901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:42.299999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.300022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.300040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:42.300043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.300045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:42.300047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:42.300054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.300058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.300063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553959679667090:3329]
2025-10-02T09:28:42.300104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:42.300114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:42.300120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:42.300120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.300123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:42.300124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:42.300304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:42.341461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553959755186121:3101]
2025-10-02T09:28:42.341766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7556553959755186121:3101]
2025-10-02T09:28:42.451613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:42.452306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:42.452337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186121:3101], now have 1 active actors on pipe
2025-10-02T09:28:42.452439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:42.452482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:42.452524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:42.452531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:42.452535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553959755186121:3101]
2025-10-02T09:28:42.452582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0
2025-10-02T09:28:42.452706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0 is DEAD
2025-10-02T09:28:42.453061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:42.453071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Write session will restart in 0.007498s
2025-10-02T09:28:42.453091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Write session: Do CDS request
2025-10-02T09:28:42.453101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:42.461263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.461518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:42.461533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-10-02T09:28:42.461753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.461814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:42.461821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:42.461826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:42.462405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-10-02T09:28:42.462457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:42.462463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:42.462465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:42.462471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553959755186151:3631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:42.463019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553959755186151:3631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:42.466407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553959755186151:3631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:42.470134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553959755186151:3631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:42.470155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553959755186151:3631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:42.470159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553959755186151:3631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:42.470168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:42.477958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:42.481866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:42.482063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:42.482072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:42.482082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:42.482132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:42.482174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553959679667354:3332]
2025-10-02T09:28:42.482615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:42.482896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:42.482934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:42.483163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:42.483211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.483216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.483218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.483219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.483220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.483221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.483223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.483224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.483226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.483227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.483228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.483229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.483234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.483246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.483251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.483255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.483259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.483262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.483266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.483271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.483275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.483279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.483284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.483288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.483294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.483306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.483315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.483321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.483329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.483334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.483342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.483348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.483355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.483361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.483369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.483375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.483383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.483388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.483396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.483403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.483412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.483421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.483425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.483434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.483440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.483449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.483454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.483462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.483507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:42.498176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:42.500026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:42.500033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:42.500035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:42.500039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:42.500044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [2:7556553959679667354:3332]
2025-10-02T09:28:42.500055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:42.500069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:42.500072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.500073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.500075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.500087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:42.500091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:42.500097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:42.500153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.500154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.500156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.500158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:42.500160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:42.500217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:42.500219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.500229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.500235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.500244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:42.500257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.500259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.500260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.500267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:42.500278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:42.500287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:42.500289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:42.500320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:42.500323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.500323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:42.500325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:42.500326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:42.500333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:42.500353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186331:3631], now have 1 active actors on pipe
2025-10-02T09:28:42.500356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186124:2446], now have 1 active actors on pipe
2025-10-02T09:28:42.504902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 191
2025-10-02T09:28:42.504916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 191
2025-10-02T09:28:42.505020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.505040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.505069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24b66bbb-aa342da5-de87a435-f05a8350_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:42.505080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.505091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.505094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:42.505107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.505127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:42.505159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.505372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.505384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.505410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.505667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 36 sessionId: src_id|24b66bbb-aa342da5-de87a435-f05a8350_0
2025-10-02T09:28:42.507062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a303d-53522d4c-f4736e49-a3c9a1a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24b66bbb-aa342da5-de87a435-f05a8350_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:42.510089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Write session: try to update token
2025-10-02T09:28:42.510112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:42.525080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:42.525102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.525105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:42.525107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:42.525115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.525123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.525127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553959679667348:3332]
2025-10-02T09:28:42.525166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:42.525171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.525173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:42.525174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:42.525181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:42.525185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:42.525312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:42.536705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|24b66bbb-aa342da5-de87a435-f05a8350_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:42.540016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:42.553018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553959755186378:3101]
2025-10-02T09:28:42.553452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7556553959755186378:3101]
2025-10-02T09:28:42.672063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:42.672503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.672516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.672530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186378:3101], now have 1 active actors on pipe
2025-10-02T09:28:42.672759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:42.672777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553959755186378:3101]
2025-10-02T09:28:42.672783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:42.672794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:42.672819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:42.672859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: error at write: Disconnected sessionId: src_id|24b66bbb-aa342da5-de87a435-f05a8350_0
2025-10-02T09:28:42.673022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|24b66bbb-aa342da5-de87a435-f05a8350_0 is DEAD
2025-10-02T09:28:42.673165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:42.673175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Write session will restart in 0.009131s
2025-10-02T09:28:42.673212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Write session: Do CDS request
2025-10-02T09:28:42.673218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:42.683341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.683580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:42.683595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-10-02T09:28:42.683721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.683748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:42.683753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:42.683757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:42.684164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-10-02T09:28:42.684200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:42.684206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:42.684208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:42.684212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553959755186451:3635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:42.684783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553959755186451:3635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:42.687644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553959755186451:3635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:42.690672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553959755186451:3635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:42.690685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553959755186451:3635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:42.690689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553959755186451:3635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:42.690696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:42.691743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:42.692928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:42.693093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:42.693103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:42.693112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:42.693158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:42.693195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553959679667601:3334]
2025-10-02T09:28:42.693791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:42.694081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:42.694126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:42.694427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:42.694487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.694495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.694495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.694496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.694497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.694498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.694499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.694500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.694501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.694503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.694504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.694504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.694510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.694522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.694527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.694531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.694534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.694540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.694544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.694547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.694552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.694556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.694559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.694564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.694570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.694582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.694592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.694597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.694605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.694610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.694615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.694625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.694629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.694638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.694643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.694652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.694657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.694663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.694671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.694676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.694682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.694691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.694695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.694700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.694705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.694712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.694716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.694721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.694759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:42.704536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:42.706295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:42.706314Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:42.706317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:42.706322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:42.706329Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [2:7556553959679667601:3334]
2025-10-02T09:28:42.706344Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:42.706361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:42.706364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.706367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.706369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.706385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:42.706391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:42.706399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:42.706456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.706465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.706467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.706470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:42.706473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:42.706552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:42.706560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.706573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.706592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.706610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:42.706630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186621:3635], now have 1 active actors on pipe
2025-10-02T09:28:42.706639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186380:2446], now have 1 active actors on pipe
2025-10-02T09:28:42.706645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.706647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.706649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.706656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:42.706669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:42.706638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 192
2025-10-02T09:28:42.706653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 192
2025-10-02T09:28:42.706684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:42.706684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:42.706688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:42.706690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:42.706693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:42.706737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.706746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.706762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.706773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:42.706779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:42.706805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b48f0f74-e307aab7-5d8d9-e849735b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:42.706815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.706823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.706826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:42.706835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.706845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:42.706870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.706992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.707000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.707012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.707095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 36 sessionId: src_id|b48f0f74-e307aab7-5d8d9-e849735b_0
2025-10-02T09:28:42.707539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b66bbb-aa342da5-de87a435-f05a8350_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b48f0f74-e307aab7-5d8d9-e849735b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:42.710722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Write session: try to update token
2025-10-02T09:28:42.710746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:42.719053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:42.719073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.719074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:42.719076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:42.719083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.719088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.719091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553959679667596:3334]
2025-10-02T09:28:42.719127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:42.719135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.719137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:42.719139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:42.719157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:42.719161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:42.719325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:42.728172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|b48f0f74-e307aab7-5d8d9-e849735b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:42.730913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:42.773054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553959755186643:3101]
2025-10-02T09:28:42.773287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7556553959755186643:3101]
2025-10-02T09:28:42.866155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:42.866973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.866991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.867009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186643:3101], now have 1 active actors on pipe
2025-10-02T09:28:42.867358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:42.867391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553959755186643:3101]
2025-10-02T09:28:42.867422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:42.867427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:42.867427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:42.867506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: error at write: Disconnected sessionId: src_id|b48f0f74-e307aab7-5d8d9-e849735b_0
2025-10-02T09:28:42.867664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|b48f0f74-e307aab7-5d8d9-e849735b_0 is DEAD
2025-10-02T09:28:42.868171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:42.868185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Write session will restart in 0.006807s
2025-10-02T09:28:42.868222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Write session: Do CDS request
2025-10-02T09:28:42.868229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:42.876381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.876543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:42.876559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-10-02T09:28:42.876726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:42.876755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:42.876763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:42.876767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:42.877183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-10-02T09:28:42.877222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:42.877229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:42.877231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:42.877237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553959755186660:3640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:42.877755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553959755186660:3640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:42.880240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553959755186660:3640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:42.883637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553959755186660:3640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:42.883653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553959755186660:3640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:42.883656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553959755186660:3640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:42.883675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:42.888089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:42.889462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:42.889630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:42.889638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:42.889644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:42.889678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:42.889707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553959679667851:3337]
2025-10-02T09:28:42.890096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:42.890391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:42.890486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:42.890886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:42.890983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.890991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.890992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.890993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.890994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.890995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.890996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.890998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.890999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.891000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.891002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.891003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.891008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.891019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.891023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.891028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.891032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.891035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.891039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.891043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.891046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.891050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.891056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.891060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.891068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.891085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:42.891095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.891101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:42.891106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.891111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:42.891116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.891129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:42.891140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.891160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:42.891170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.891177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:42.891182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.891189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:42.891195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.891200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:42.891206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.891210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:42.891219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.891223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.891232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.891237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.891247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.891252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.891286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:42.900742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:42.902716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:42.902733Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:42.902735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:42.902739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:42.902745Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [2:7556553959679667851:3337]
2025-10-02T09:28:42.902759Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:42.902776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:42.902779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.902783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.902785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.902801Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:42.902811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:42.902816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:42.902879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.902886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.902888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.902892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:42.902894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:42.902959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:42.902966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.902979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:42.902990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:42.903006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:42.903025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186646:2446], now have 1 active actors on pipe
2025-10-02T09:28:42.903031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.903034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.903037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.903047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:42.903057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186799:3640], now have 1 active actors on pipe
2025-10-02T09:28:42.903064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:42.903065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:42.903068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:42.903070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:42.903080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:42.903088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:42.903120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.903131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:42.903139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:42.903156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 193
2025-10-02T09:28:42.903157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 193
2025-10-02T09:28:42.903198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.903207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.903228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:42.903238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:42.903242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:42.903244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:42.903253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:42.903261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:42.903281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.903436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.903454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.903474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:42.903573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 36 sessionId: src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0
2025-10-02T09:28:42.903928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b48f0f74-e307aab7-5d8d9-e849735b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:42.907245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Write session: try to update token
2025-10-02T09:28:42.907265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:42.920264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:42.920286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.920295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.920338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:42.920346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:42.920538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:42.920694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:42.920868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:42.921025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:42.921228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:42.921277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:42.922570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:42.925245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:42.926459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:42.926475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:42.926492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:42.926494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:42.926496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:42.926498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:42.926505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.926508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.926512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553959679667846:3337]
2025-10-02T09:28:42.926556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:42.926561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:42.926567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:42.926567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:42.926569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:42.926570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:42.926740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:42.967735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553959755186914:3101]
2025-10-02T09:28:42.967966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7556553959755186914:3101]
2025-10-02T09:28:43.069635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:43.070055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:43.070091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553959755186914:3101], now have 1 active actors on pipe
2025-10-02T09:28:43.070191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:43.070234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553959755186914:3101]
2025-10-02T09:28:43.070251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:43.070268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:43.070271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:43.070327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0
2025-10-02T09:28:43.070435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0 is DEAD
2025-10-02T09:28:43.070688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:43.070698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Write session will restart in 0.007443s
2025-10-02T09:28:43.070726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Write session: Do CDS request
2025-10-02T09:28:43.070735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:43.079389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.079469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:43.079485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-10-02T09:28:43.079879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.079932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:43.079942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:43.079946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:43.080425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-10-02T09:28:43.080460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:43.080466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:43.080468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:43.080473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553964050154271:3651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:43.080993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553964050154271:3651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:43.084116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553964050154271:3651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:43.086677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553964050154271:3651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:43.086693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553964050154271:3651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:43.086697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553964050154271:3651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:43.086708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:43.086759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:43.088129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:43.088314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:43.088322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:43.088330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:43.088382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:43.088418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553963974635434:3352]
2025-10-02T09:28:43.089029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:43.089282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:43.089319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:43.089627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:43.089675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.089680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.089681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.089682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.089684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.089685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.089686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.089687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.089688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.089689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.089690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.089691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.089696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.089707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.089710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.089714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.089718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.089722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.089726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.089729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.089733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.089737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.089741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.089745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.089750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.089758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.089764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.089769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.089773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.089778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.089782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.089787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.089791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.089800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.089804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.089808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.089813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.089818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.089824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.089828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.089834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.089839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.089848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.089854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.089860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.089865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.089872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.089877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.089911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:43.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:43.100177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:43.100195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:43.100198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:43.100201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:43.100207Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [2:7556553963974635434:3352]
2025-10-02T09:28:43.100221Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:43.100236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:43.100241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.100243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.100246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.100258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:43.100263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:43.100269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:43.100322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.100329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.100332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.100335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:43.100338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:43.100401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:43.100408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.100420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.100430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.100444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:43.100465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154222:2446], now have 1 active actors on pipe
2025-10-02T09:28:43.100473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154466:3651], now have 1 active actors on pipe
2025-10-02T09:28:43.100477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.100480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.100481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.100492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:43.100504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:43.100511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:43.100513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:43.100515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:43.100521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:43.100523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:43.100510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 194
2025-10-02T09:28:43.100555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.100565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:43.100568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:43.100582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 194
2025-10-02T09:28:43.100598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.100606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.100627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:43.100635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.100638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.100640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:43.100650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.100662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:43.100674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.100854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.100863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.100875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.100972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 36 sessionId: src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0
2025-10-02T09:28:43.101316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807dad30-83607ca0-30c8d002-5c22d0cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:43.104430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Write session: try to update token
2025-10-02T09:28:43.104444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:43.110908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:43.110942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.110951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.110983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:43.110990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:43.111234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:43.111385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.111533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.111681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.111880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:43.111921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:43.118774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:43.120465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:43.120485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.120488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:43.120490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:43.120499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.120503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.120507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553963974635428:3352]
2025-10-02T09:28:43.120541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:43.120544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:43.120550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:43.120552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.120553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:43.120554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:43.120737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:43.121432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:43.170358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553964050154480:3101]
2025-10-02T09:28:43.170596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7556553964050154480:3101]
2025-10-02T09:28:43.260203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:43.260975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.260991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.261008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154480:3101], now have 1 active actors on pipe
2025-10-02T09:28:43.261201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:43.261258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:43.261263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553964050154480:3101]
2025-10-02T09:28:43.261286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:43.261350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0
2025-10-02T09:28:43.261520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0 is DEAD
2025-10-02T09:28:43.261699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:43.261710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Write session will restart in 0.006109s
2025-10-02T09:28:43.261735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Write session: Do CDS request
2025-10-02T09:28:43.261741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:43.269304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.269377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:43.269391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-10-02T09:28:43.269496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.269523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:43.269531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:43.269535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:43.270009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-10-02T09:28:43.270042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:43.270043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:43.270046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:43.270050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553964050154515:3656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:43.270557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553964050154515:3656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:43.273675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553964050154515:3656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:43.276561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553964050154515:3656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:43.276583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553964050154515:3656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:43.276587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553964050154515:3656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:43.276595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:43.276650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:43.277909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:43.278080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:43.278093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:43.278103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:43.278158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:43.278222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553963974635683:3354]
2025-10-02T09:28:43.278769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:43.279101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:43.279162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:43.279452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:43.279516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.279525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.279526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.279527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.279528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.279528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.279530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.279531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.279532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.279533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.279533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.279534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.279539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.279549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.279552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.279555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.279559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.279563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.279566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.279569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.279573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.279576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.279580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.279583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.279591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.279598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.279604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.279610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.279613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.279617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.279621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.279631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.279639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.279643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.279651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.279656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.279665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.279669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.279673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.279676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.279680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.279684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.279687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.279691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.279694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.279698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.279701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.279705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.279733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:43.289383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:43.291573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:43.291593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:43.291595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:43.291599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:43.291606Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [2:7556553963974635683:3354]
2025-10-02T09:28:43.291620Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:43.291637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:43.291640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.291643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.291645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.291660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:43.291672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:43.291678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:43.291746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.291753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.291756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.291759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:43.291762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:43.291830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:43.291837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.291853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.291869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.291890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:43.291911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154728:3656], now have 1 active actors on pipe
2025-10-02T09:28:43.291919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154483:2446], now have 1 active actors on pipe
2025-10-02T09:28:43.291925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.291928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.291929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.291940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:43.291955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:43.291959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:43.291964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:43.291965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:43.291971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:43.291974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:43.292006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.292014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:43.292015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:43.291987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 195
2025-10-02T09:28:43.292018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 195
2025-10-02T09:28:43.292043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.292051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.292261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:43.292281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.292284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.292286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:43.292296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.292306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:43.292331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.292631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.292642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.292660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.292757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 36 sessionId: src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0
2025-10-02T09:28:43.293126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a4675a-46b152da-6e80a8cd-56cb10eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:43.296302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Write session: try to update token
2025-10-02T09:28:43.296316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:43.302700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:43.302718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.302720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:43.302721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:43.302732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.302735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.302738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553963974635677:3354]
2025-10-02T09:28:43.302772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:43.302778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.302780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:43.302782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:43.302787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:43.302791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:43.302926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:43.311953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:43.314478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:43.361335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553964050154753:3101]
2025-10-02T09:28:43.361515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7556553964050154753:3101]
2025-10-02T09:28:43.446078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:43.446722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.446738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.446757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154753:3101], now have 1 active actors on pipe
2025-10-02T09:28:43.447204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:43.447374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553964050154753:3101]
2025-10-02T09:28:43.447410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:43.447413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:43.447511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0
2025-10-02T09:28:43.447688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0 is DEAD
2025-10-02T09:28:43.447862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:43.447895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:43.447905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Write session will restart in 0.009846s
2025-10-02T09:28:43.447934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Write session: Do CDS request
2025-10-02T09:28:43.447955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:43.459610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.459870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:43.459909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-10-02T09:28:43.460178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.460222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:43.460227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:43.460232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:43.460701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-10-02T09:28:43.460733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:43.460734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:43.460736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:43.460741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553964050154770:3661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:43.461298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553964050154770:3661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:43.464076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553964050154770:3661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:43.469723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553964050154770:3661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:43.469741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553964050154770:3661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:43.469744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553964050154770:3661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:43.469756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:43.478200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:43.479645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:43.479877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:43.479890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:43.479901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:43.479973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:43.480018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553963974635946:3357]
2025-10-02T09:28:43.480528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:43.480944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:43.480997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:43.481329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:43.481390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.481395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.481396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.481397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.481398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.481398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.481399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.481400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.481402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.481403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.481403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.481404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.481410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.481419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.481423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.481427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.481430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.481434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.481438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.481442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.481446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.481450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.481454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.481457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.481463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.481470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.481476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.481481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.481485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.481490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.481503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.481513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.481518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.481527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.481532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.481541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.481546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.481550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.481559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.481563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.481572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.481577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.481585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.481590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.481595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.481605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.481613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.481618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.481652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:43.493697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:43.498185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:43.498207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:43.498210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:43.498215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:43.498222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [2:7556553963974635946:3357]
2025-10-02T09:28:43.498239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:43.498260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:43.498264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.498266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.498268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.498284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:43.498289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:43.498296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:43.498366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.498374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.498376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.498380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:43.498382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:43.498612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 196
2025-10-02T09:28:43.498646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 196
2025-10-02T09:28:43.498452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:43.498462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.498478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.498488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.498502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:43.498521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154834:3661], now have 1 active actors on pipe
2025-10-02T09:28:43.498524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050154755:2446], now have 1 active actors on pipe
2025-10-02T09:28:43.498530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.498532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.498534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.498541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:43.498548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:43.498550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:43.498552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:43.498554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:43.498567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:43.498570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:43.498608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.498614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:43.498667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:43.499429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.499446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.499474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:43.499487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.499491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.499497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:43.499506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.499517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:43.499537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.499714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.499722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.499735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.499859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 36 sessionId: src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0
2025-10-02T09:28:43.500240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f99101-b49a1b4b-d4ae10a8-775ef619_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:43.508569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Write session: try to update token
2025-10-02T09:28:43.508591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:43.513798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:43.513818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.513821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:43.513823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:43.513832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.513836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.513840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553963974635941:3357]
2025-10-02T09:28:43.513881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:43.513890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.513889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:43.513892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:43.513894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:43.513899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:43.514025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:43.545292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:43.547709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553964050155013:3101]
2025-10-02T09:28:43.547939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:43.548188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7556553964050155013:3101]
2025-10-02T09:28:43.665234Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:43.665817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155013:3101], now have 1 active actors on pipe
2025-10-02T09:28:43.665848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.665853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.666098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:43.666113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553964050155013:3101]
2025-10-02T09:28:43.666136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:43.666140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:43.666147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:43.666193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: error at write: Disconnected sessionId: src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0
2025-10-02T09:28:43.666354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0 is DEAD
2025-10-02T09:28:43.666621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:43.666633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Write session will restart in 0.005139s
2025-10-02T09:28:43.666659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Write session: Do CDS request
2025-10-02T09:28:43.666665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:43.673290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.673427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:43.673441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-10-02T09:28:43.673581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.673609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:43.673617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:43.673621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:43.674117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-10-02T09:28:43.674162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:43.674170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:43.674172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:43.674179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553964050155032:3665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:43.674689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553964050155032:3665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:43.676532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553964050155032:3665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:43.679129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553964050155032:3665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:43.679151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553964050155032:3665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:43.679154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553964050155032:3665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:43.679164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:43.681675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:43.682912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:43.683056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:43.683062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:43.683068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:43.683102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:43.683136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553963974636197:3359]
2025-10-02T09:28:43.683555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:43.683865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:43.683901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:43.684129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:43.684162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.684166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.684167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.684167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.684168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.684168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.684169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.684169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.684170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.684171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.684172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.684173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.684177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.684188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.684192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.684195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.684199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.684202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.684204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.684206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.684208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.684210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.684212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.684214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.684218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.684223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.684228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.684231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.684237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.684240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.684242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.684246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.684248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.684253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.684255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.684257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.684260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.684262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.684264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.684267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.684269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.684272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.684274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.684277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.684279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.684282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.684284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.684287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.684305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:43.692724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:43.695011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:43.695025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:43.695027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:43.695030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:43.695035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [2:7556553963974636197:3359]
2025-10-02T09:28:43.695045Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:43.695059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:43.695060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.695062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.695063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.695074Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:43.695084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:43.695090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:43.695135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.695141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.695142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.695153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:43.695155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:43.695205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:43.695213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.695226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.695235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.695254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:43.695274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.695279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.695281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.695295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:43.695307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155015:2446], now have 1 active actors on pipe
2025-10-02T09:28:43.695309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:43.695312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:43.695313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155199:3665], now have 1 active actors on pipe
2025-10-02T09:28:43.695314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:43.695320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:43.695328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:43.695330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:43.695360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.695371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:43.695377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:43.695380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 197
2025-10-02T09:28:43.695431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 197
2025-10-02T09:28:43.695500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.695509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.695529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:43.695539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.695542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.695544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:43.695553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.695561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:43.695574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.695733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.695740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.695751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.695841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0
2025-10-02T09:28:43.696175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b140aea-54ce15e8-20a3a114-2cc1821d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:43.699614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Write session: try to update token
2025-10-02T09:28:43.699631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:43.709055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:43.709080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.709091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.709144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:43.709147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:43.709666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:43.710021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.710173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.710489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.710697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:43.710743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:43.716395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:43.716415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.716417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:43.716419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:43.716427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.716432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.716435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553963974636192:3359]
2025-10-02T09:28:43.716472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:43.716478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.716481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:43.716483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:43.716489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:43.716494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:43.716619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:43.718689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:43.721127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:43.766610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553964050155280:3101]
2025-10-02T09:28:43.766870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7556553964050155280:3101]
2025-10-02T09:28:43.855917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:43.856664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.856683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.856703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155280:3101], now have 1 active actors on pipe
2025-10-02T09:28:43.856978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:43.857004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553964050155280:3101]
2025-10-02T09:28:43.857038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:43.857102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0
2025-10-02T09:28:43.857249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0 is DEAD
2025-10-02T09:28:43.857407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:43.857418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Write session will restart in 0.009884s
2025-10-02T09:28:43.857439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Write session: Do CDS request
2025-10-02T09:28:43.857422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:43.857447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:43.868400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.868471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:43.868490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-10-02T09:28:43.868650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:43.868686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:43.868691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:43.868696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:43.869246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-10-02T09:28:43.869278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:43.869279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:43.869281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:43.869286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553964050155359:3670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:43.869827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553964050155359:3670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:43.873280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553964050155359:3670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:43.876671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553964050155359:3670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:43.876689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553964050155359:3670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:43.876694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553964050155359:3670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:43.876701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:43.877508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:43.878924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:43.879126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:43.879138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:43.879159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:43.879236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:43.879279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553963974636451:3362]
2025-10-02T09:28:43.879890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:43.880198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:43.880268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:43.880582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:43.880667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.880675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.880676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.880677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.880678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.880679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.880680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.880682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.880683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.880684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.880684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.880685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.880691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.880703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.880707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.880710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.880714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.880718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.880722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.880727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.880731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.880736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.880739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.880744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.880751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.880759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:43.880765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.880771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:43.880775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.880781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:43.880785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.880791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:43.880796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.880834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:43.880843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.880849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:43.880854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.880864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:43.880870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.880880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:43.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.880896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:43.880900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.880910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.880914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.880924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.880928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.880934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.880971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:43.890366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:43.892212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:43.892227Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:43.892229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:43.892232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:43.892237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [2:7556553963974636451:3362]
2025-10-02T09:28:43.892247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:43.892262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:43.892264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.892266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.892268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.892280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:43.892285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:43.892290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:43.892351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.892357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.892359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.892361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:43.892363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:43.892430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:43.892443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.892457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:43.892468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:43.892484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:43.892504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155286:2446], now have 1 active actors on pipe
2025-10-02T09:28:43.892516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.892519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.892521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.892534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:43.892545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155531:3670], now have 1 active actors on pipe
2025-10-02T09:28:43.892553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:43.892557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:43.892557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:43.892559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:43.892572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:43.892582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:43.892616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.892624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:43.892606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 198
2025-10-02T09:28:43.892637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 198
2025-10-02T09:28:43.892639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:43.892661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.892665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.892689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:43.892701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:43.892704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:43.892706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:43.892714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:43.892723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:43.892738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.892919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:43.892927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:43.892937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:43.893029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 36 sessionId: src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0
2025-10-02T09:28:43.893392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e48116f-d6df764e-a4738de5-f72ee2c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:43.896538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Write session: try to update token
2025-10-02T09:28:43.896554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:43.903863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:43.903884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.903894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.903937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:43.903941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:43.904113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:43.904261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.904406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.904550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:43.904888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:43.904937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:43.913046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:43.914528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:43.914549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:43.914552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:43.914554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:43.914564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.914570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.914574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553963974636446:3362]
2025-10-02T09:28:43.914608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:43.914611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:43.914612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:43.914616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:43.914616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:43.914618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:43.914762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:43.915838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:43.957381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553964050155545:3101]
2025-10-02T09:28:43.957728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7556553964050155545:3101]
2025-10-02T09:28:44.067057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:44.067806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.067832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.067850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553964050155545:3101], now have 1 active actors on pipe
2025-10-02T09:28:44.068453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:44.068469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:44.068554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: error at write: Disconnected sessionId: src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0
2025-10-02T09:28:44.068134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:44.068798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0 is DEAD
2025-10-02T09:28:44.068818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:44.068951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553964050155545:3101]
2025-10-02T09:28:44.069071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:44.069117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Write session will restart in 0.005437s
2025-10-02T09:28:44.069171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Write session: Do CDS request
2025-10-02T09:28:44.069178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:44.076393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.076580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:44.076605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-10-02T09:28:44.076763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.076821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:44.076827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:44.076831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:44.077305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-10-02T09:28:44.077340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:44.077342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:44.077344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:44.077349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553968345122882:3681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:44.077943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553968345122882:3681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:44.082568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553968345122882:3681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:44.088294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553968345122882:3681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:44.088314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553968345122882:3681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:44.088318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553968345122882:3681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:44.088328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:44.095618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:44.097014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:44.097250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:44.097260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:44.097269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:44.097319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:44.097370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553968269604040:3376]
2025-10-02T09:28:44.098009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:44.098306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:44.098350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:44.098698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:44.098754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.098760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.098761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.098762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.098763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.098765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.098766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.098767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.098768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.098769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.098770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.098771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.098776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.098786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.098790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.098794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.098798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.098802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.098805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.098809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.098813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.098817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.098820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.098824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.098831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.098838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.098843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.098848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.098854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.098859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.098863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.098873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.098877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.098882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.098886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.098893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.098897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.098902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.098906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.098911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.098917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.098924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.098928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.098933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.098937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.098945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.098949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.098954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.098992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:44.108059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:44.112789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:44.112862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:44.112868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:44.112871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:44.112878Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [2:7556553968269604040:3376]
2025-10-02T09:28:44.112906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:44.112931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:44.112941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.112944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.112946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.112960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:44.112965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:44.112972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:44.113036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.113038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.113040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.113042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:44.113045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:44.113122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:44.113129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.113144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.113158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.113175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:44.113200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345122868:2446], now have 1 active actors on pipe
2025-10-02T09:28:44.113207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345122974:3681], now have 1 active actors on pipe
2025-10-02T09:28:44.113213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.113215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.113217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.113229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:44.113242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:44.113247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:44.113253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:44.113255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:44.113261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:44.113264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:44.113299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.113308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 199
2025-10-02T09:28:44.113315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:44.113314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 199
2025-10-02T09:28:44.113334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:44.113359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.113363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.113391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:44.113403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.113406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.113407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:44.113416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.113426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:44.113445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.113601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.113610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.113625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.113731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0
2025-10-02T09:28:44.114121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc3e674-572f7856-a6706b5-1cccc31f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:44.122722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Write session: try to update token
2025-10-02T09:28:44.122743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:44.139054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:44.139078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.139088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.139136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:44.139153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:44.139333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:44.139485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:44.139821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:44.140145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:44.140427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:44.140476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:44.143329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:44.143344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.143346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:44.143348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:44.143355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.143360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.143365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553968269604035:3376]
2025-10-02T09:28:44.143400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:44.143409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.143412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:44.143416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:44.143430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:44.143434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:44.143547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:44.145291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:44.147915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:44.169280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553968345123127:3101]
2025-10-02T09:28:44.169597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7556553968345123127:3101]
2025-10-02T09:28:44.275487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:44.275982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.275994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.276011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123127:3101], now have 1 active actors on pipe
2025-10-02T09:28:44.276165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:44.276234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:44.276244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553968345123127:3101]
2025-10-02T09:28:44.276270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:44.276325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0
2025-10-02T09:28:44.276500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0 is DEAD
2025-10-02T09:28:44.276666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:44.276693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Write session will restart in 0.007604s
2025-10-02T09:28:44.276843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Write session: Do CDS request
2025-10-02T09:28:44.276858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:44.285300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.285498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:44.285515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-10-02T09:28:44.285662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.285698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:44.285707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:44.285711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:44.286198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-10-02T09:28:44.286230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:44.286237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:44.286239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:44.286243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553968345123169:3686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:44.286769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553968345123169:3686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:44.289419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553968345123169:3686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:44.292169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553968345123169:3686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:44.292202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553968345123169:3686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:44.292205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553968345123169:3686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:44.292217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:44.292763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:44.293848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:44.294019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:44.294027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:44.294035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:44.294082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:44.294115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553968269604295:3379]
2025-10-02T09:28:44.294692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:44.294970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:44.295025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:44.295301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:44.295343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.295349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.295350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.295351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.295351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.295352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.295354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.295355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.295356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.295357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.295357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.295358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.295363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.295373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.295378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.295381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.295384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.295388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.295391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.295394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.295397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.295401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.295405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.295409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.295414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.295422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.295428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.295433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.295437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.295442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.295446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.295450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.295454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.295459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.295465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.295474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.295479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.295484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.295488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.295492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.295496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.295501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.295509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.295514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.295518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.295523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.295527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.295543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.295580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:44.303782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:44.305449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:44.305467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:44.305469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:44.305472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:44.305478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [2:7556553968269604295:3379]
2025-10-02T09:28:44.305491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:44.305506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:44.305509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.305512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.305513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.305528Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:44.305533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:44.305539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:44.305590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.305597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.305599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.305602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:44.305604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:44.305667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:44.305675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.305687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.305698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.305713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:44.305732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123378:3686], now have 1 active actors on pipe
2025-10-02T09:28:44.305737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123130:2446], now have 1 active actors on pipe
2025-10-02T09:28:44.305742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.305743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.305745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.305757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:44.305770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:44.305777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:44.305780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:44.305782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:44.305789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:44.305795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:44.305768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 200
2025-10-02T09:28:44.305773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 200
2025-10-02T09:28:44.305827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.305842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:44.305856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:44.305858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.305862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.305895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:44.305904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.305908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.305910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:44.305919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.305927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:44.305946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.306093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.306100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.306110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.306190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0
2025-10-02T09:28:44.306520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f23082-6912722e-ec13ffde-91d2ea1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:44.309522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Write session: try to update token
2025-10-02T09:28:44.309536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:44.316682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:44.316706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.316709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:44.316711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:44.316718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.316722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.316725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553968269604290:3379]
2025-10-02T09:28:44.316761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:44.316760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:44.316766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:44.316769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:44.316773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.316775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:44.316953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:44.329722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:44.332313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:44.376650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553968345123405:3101]
2025-10-02T09:28:44.377016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7556553968345123405:3101]
2025-10-02T09:28:44.453620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:44.454058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.454072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.454091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123405:3101], now have 1 active actors on pipe
2025-10-02T09:28:44.454280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:44.454348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:44.454362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:44.454361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:44.454416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553968345123405:3101]
2025-10-02T09:28:44.454433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: error at write: Disconnected sessionId: src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0
2025-10-02T09:28:44.454507Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:28:44.454610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0 is DEAD
2025-10-02T09:28:44.454767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:44.454780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Write session will restart in 0.008775s
2025-10-02T09:28:44.454805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Write session: Do CDS request
2025-10-02T09:28:44.454810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:44.454817Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_5089259274686375459_v1 is DEAD
2025-10-02T09:28:44.454910Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:28:44.455032Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:44.455037Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:28:44.455045Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005284s
2025-10-02T09:28:44.455193Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553886740722400:3096] disconnected; active server actors: 1
2025-10-02T09:28:44.455204Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553886740722400:3096] client user disconnected session shared/user_1_2_5089259274686375459_v1
2025-10-02T09:28:44.461154Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:28:44.461411Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:28:44.461422Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-02T09:28:44.461739Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:44.461797Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:28:44.461907Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 auth for : user
2025-10-02T09:28:44.462114Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 Handle describe topics response
2025-10-02T09:28:44.462141Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 auth is DEAD
2025-10-02T09:28:44.462151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:28:44.462449Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:28:44.462558Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_3_16615936339092450329_v1
2025-10-02T09:28:44.462541Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553968345123422:3691] connected; active server actors: 1
2025-10-02T09:28:44.462558Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556553968345123422:3691] session shared/user_1_3_16615936339092450329_v1
2025-10-02T09:28:44.462565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:28:44.462573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:28:44.462579Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_16615936339092450329_v1" (Sender=[1:7556553968345123419:3691], Pipe=[1:7556553968345123422:3691], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:44.462582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:28:44.462593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:28:44.462601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_16615936339092450329_v1" (Sender=[1:7556553968345123419:3691], Pipe=[1:7556553968345123422:3691], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:28:44.462613Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_16615936339092450329_v1" sender [1:7556553968345123419:3691] lock partition 0 for ReadingSession "shared/user_1_3_16615936339092450329_v1" (Sender=[1:7556553968345123419:3691], Pipe=[1:7556553968345123422:3691], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-02T09:28:44.462625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:28:44.462631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-02T09:28:44.462886Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_16615936339092450329_v1" ClientId: "user" PipeClient { RawX1: 7556553968345123422 RawX2: 4503603922341483 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:28:44.462915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:28:44.464308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.464419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:44.464430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-10-02T09:28:44.464552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.464578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:44.464583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:44.464587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:44.464930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-10-02T09:28:44.464960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:44.464962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:44.464963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:44.464968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553968345123449:3695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:44.465552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553968345123449:3695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:44.468122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553968345123449:3695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:44.471529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553968345123449:3695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:44.471545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553968345123449:3695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:44.471550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553968345123449:3695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:44.471557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:44.474087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:44.475413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:44.475585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:44.475594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:44.475603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:44.475647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:44.475686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553968269604564:3382]
2025-10-02T09:28:44.476292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:44.476671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:44.476718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:44.477058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:44.477135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.477143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.477144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.477146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.477147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.477148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.477149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.477150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.477151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.477152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.477153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.477154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.477161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.477172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.477176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.477180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.477185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.477189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.477193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.477197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.477201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.477206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.477210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.477214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.477221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.477229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.477234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.477240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.477244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.477249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.477254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.477260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.477265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.477270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.477275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.477279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.477284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.477297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.477302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.477312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.477317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.477321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.477330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.477337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.477346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.477352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.477360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.477368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.477410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:44.488495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:44.490710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:44.490731Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:44.490734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:44.490739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:44.490746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [2:7556553968269604564:3382]
2025-10-02T09:28:44.490759Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:44.490779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:44.490782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.490785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.490787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.490802Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:44.490808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:44.490814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:44.490887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.490899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.490901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.490904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:44.490907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:44.490974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:44.490984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.491000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.491012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.491029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:44.491056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123426:3694], now have 1 active actors on pipe
2025-10-02T09:28:44.491064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123406:2446], now have 1 active actors on pipe
2025-10-02T09:28:44.491067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123621:3695], now have 1 active actors on pipe
2025-10-02T09:28:44.491075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.491077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.491079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.491090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:44.491111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:44.491119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:44.491122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:44.491124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:44.491094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7556553968345123426:3694]
2025-10-02T09:28:44.491099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 201
2025-10-02T09:28:44.491130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:44.491126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 201
2025-10-02T09:28:44.491138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:44.491203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.491215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.491226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_16615936339092450329_v1 on pipe: [1:7556553968345123426:3694]
2025-10-02T09:28:44.491267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.491281Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_16615936339092450329_v1:1 with generation 201
2025-10-02T09:28:44.491283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:44.491293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.491300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.491303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:44.491322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.491333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.491335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:44.491354Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_16615936339092450329_v1
2025-10-02T09:28:44.491360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.491405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4a24473-150fdbed-13305ce9-60ebc134_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:44.491414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:28:44.491418Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:28:44.494969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:28:44.494998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:28:44.495006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.495011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.495019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:44.495028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.495037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:44.495046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:28:44.495057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:28:44.495075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.495246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.495254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.495265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.495238Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397324490 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:28:44.495268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:28:44.495297Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 sending to client partition status
2025-10-02T09:28:44.495406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4a24473-150fdbed-13305ce9-60ebc134_0
2025-10-02T09:28:44.495703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd725a1f-9b607aee-3a4e321e-bfe1013f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4a24473-150fdbed-13305ce9-60ebc134_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:44.499113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Write session: try to update token
2025-10-02T09:28:44.499128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:44.505792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:44.505814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.505817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:44.505819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:44.505827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.505831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.505835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553968269604559:3382]
2025-10-02T09:28:44.505873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:44.505873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:44.505878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:44.505882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:44.505885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.505887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:44.506094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:44.515671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|c4a24473-150fdbed-13305ce9-60ebc134_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:44.518369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:44.637913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:44.638265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.638275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.638455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_16615936339092450329_v1
2025-10-02T09:28:44.638475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:44.638492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:44.638523Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_16615936339092450329_v1
2025-10-02T09:28:44.638496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:44.638499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:44.638539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553968345123426:3694]
2025-10-02T09:28:44.638553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: error at write: Disconnected sessionId: src_id|c4a24473-150fdbed-13305ce9-60ebc134_0
2025-10-02T09:28:44.638703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|c4a24473-150fdbed-13305ce9-60ebc134_0 is DEAD
2025-10-02T09:28:44.638837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:44.638853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Write session will restart in 0.008819s
2025-10-02T09:28:44.638875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Write session: Do CDS request
2025-10-02T09:28:44.638881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:44.649309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.649412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:44.649429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-10-02T09:28:44.649557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.649585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:44.649593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:44.649597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:44.649943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-10-02T09:28:44.649971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:44.649979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:44.649981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:44.649986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553968345123760:3699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:44.650485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553968345123760:3699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:44.652946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553968345123760:3699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:44.655476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553968345123760:3699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:44.655491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553968345123760:3699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:44.655494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553968345123760:3699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:44.655501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:44.656055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:44.657736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:44.658019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:44.658029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:44.658039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:44.658086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:44.658126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553968269604823:3384]
2025-10-02T09:28:44.658670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:44.658966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:44.659002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:44.659298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:44.659349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.659357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.659357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.659359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.659360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.659361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.659362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.659363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.659364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.659365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.659366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.659367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.659371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.659382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.659385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.659389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.659392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.659396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.659400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.659403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.659407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.659411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.659414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.659418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.659423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.659430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.659435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.659439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.659443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.659448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.659451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.659456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.659460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.659466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.659470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.659475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.659479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.659483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.659487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.659492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.659498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.659503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.659507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.659513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.659518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.659523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.659527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.659532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.659563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:44.671342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:44.673385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:44.673405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:44.673408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:44.673412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:44.673418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [2:7556553968269604823:3384]
2025-10-02T09:28:44.673435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:44.673453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:44.673461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.673464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.673466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.673482Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:44.673491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:44.673499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:44.673569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.673577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.673579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.673582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:44.673584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:44.673652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:44.673661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.673674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.673689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.673707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:44.673731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123680:2446], now have 1 active actors on pipe
2025-10-02T09:28:44.673738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123931:3699], now have 1 active actors on pipe
2025-10-02T09:28:44.673744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.673746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.673748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.673759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:44.673772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:44.673776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:44.673779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:44.673781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:44.673790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:44.673793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:44.673791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 202
2025-10-02T09:28:44.673826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.673838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:44.673844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:44.673877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 202
2025-10-02T09:28:44.673978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.673988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.674010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:44.674021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.674029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.674031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:44.674040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.674054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:44.674076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.674225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.674235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.674248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.674339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 36 sessionId: src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0
2025-10-02T09:28:44.674680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a24473-150fdbed-13305ce9-60ebc134_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:44.677996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Write session: try to update token
2025-10-02T09:28:44.678016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:44.689349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:44.689372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.689374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:44.689376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:44.689385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.689390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.689393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553968269604818:3384]
2025-10-02T09:28:44.689432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:44.689440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.689442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:44.689587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:44.689593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:44.689596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:44.689636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:44.693191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:44.695969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:44.738591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553968345123952:3694]
2025-10-02T09:28:44.738858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7556553968345123952:3694]
2025-10-02T09:28:44.836706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:44.837231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.837244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.837274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123952:3694], now have 1 active actors on pipe
2025-10-02T09:28:44.837500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:44.837614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553968345123952:3694]
2025-10-02T09:28:44.837684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:44.837836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0
2025-10-02T09:28:44.837964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:44.838074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0 is DEAD
2025-10-02T09:28:44.838340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:44.838352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Write session will restart in 0.005347s
2025-10-02T09:28:44.838377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Write session: Do CDS request
2025-10-02T09:28:44.838384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:44.847017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.847496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:44.847511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-10-02T09:28:44.847661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:44.847714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:44.847724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:44.847728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:44.848269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-10-02T09:28:44.848309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:44.848310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:44.848312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:44.848317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553968345123973:3704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:44.849005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553968345123973:3704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:44.853557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553968345123973:3704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:44.857766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553968345123973:3704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:44.857786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553968345123973:3704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:44.857789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553968345123973:3704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:44.857797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:44.871866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:44.873419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:44.873658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:44.873668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:44.873679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:44.873750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:44.873792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553968269605084:3387]
2025-10-02T09:28:44.874398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:44.874829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:44.874884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:44.875271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:44.875361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.875368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.875370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.875371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.875372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.875373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.875374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.875375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.875376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.875378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.875379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.875380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.875386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.875397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.875400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.875404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.875408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.875411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.875415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.875419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.875422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.875426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.875430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.875434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.875441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.875449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:44.875454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.875459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:44.875465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.875471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:44.875475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.875480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:44.875484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.875489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:44.875492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.875497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:44.875502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.875507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:44.875511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.875516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:44.875535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.875540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:44.875544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.875550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.875554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.875559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.875564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.875569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.875605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:44.895424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:44.897417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:44.897435Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:44.897438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:44.897442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:44.897447Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [2:7556553968269605084:3387]
2025-10-02T09:28:44.897461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:44.897479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:44.897482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.897484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.897487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.897506Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:44.897511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:44.897522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:44.897577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.897584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.897586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.897589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:44.897592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:44.897656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:44.897665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.897676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:44.897685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:44.897699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:44.897715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.897718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.897720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.897730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:44.897864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 203
2025-10-02T09:28:44.897900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 203
2025-10-02T09:28:44.897738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:44.897744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:44.897745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:44.897747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:44.897758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:44.897761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:44.897769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345123959:2446], now have 1 active actors on pipe
2025-10-02T09:28:44.897772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345124033:3704], now have 1 active actors on pipe
2025-10-02T09:28:44.897808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.897814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:44.898181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:44.898204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.898221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.898255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a6c575c-864052ef-fae5adb-497732a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:44.898268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:44.898272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:44.898278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:44.898295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:44.898311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:44.898332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.898659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:44.898670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:44.898687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:44.898811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a6c575c-864052ef-fae5adb-497732a1_0
2025-10-02T09:28:44.899184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af5a60ca-cbeedf7a-e67fdcaf-22615f74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a6c575c-864052ef-fae5adb-497732a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:44.910837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Write session: try to update token
2025-10-02T09:28:44.910862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:44.912558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:44.912584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.912597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.912648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:44.912653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:44.912926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:44.913276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:44.913446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:44.913629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:44.914407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:44.914471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:44.929003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:44.929025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:44.929028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:44.929030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:44.929040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.929044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.929049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553968269605078:3387]
2025-10-02T09:28:44.929091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:44.929104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:44.929112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:44.929255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:44.931873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|8a6c575c-864052ef-fae5adb-497732a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:44.932866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:44.932888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:44.932893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:44.937922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553968345124225:3694]
2025-10-02T09:28:44.941035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7556553968345124225:3694]
2025-10-02T09:28:44.946352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:45.079764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:45.080231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553968345124225:3694], now have 1 active actors on pipe
2025-10-02T09:28:45.080262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.080267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.080516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:45.080930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:45.080977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553968345124225:3694]
2025-10-02T09:28:45.080992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:45.081053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a6c575c-864052ef-fae5adb-497732a1_0
2025-10-02T09:28:45.081246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|8a6c575c-864052ef-fae5adb-497732a1_0 is DEAD
2025-10-02T09:28:45.081468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:45.081479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Write session will restart in 0.005097s
2025-10-02T09:28:45.081502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Write session: Do CDS request
2025-10-02T09:28:45.081508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:45.087439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.087543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:45.087557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-10-02T09:28:45.087665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.087694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:45.087703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:45.087707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:45.088409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-10-02T09:28:45.088454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:45.088455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:45.088457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:45.088461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553972640091563:3715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:45.089022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553972640091563:3715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:45.094389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553972640091563:3715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:45.098386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553972640091563:3715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:45.098400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553972640091563:3715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:45.098404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553972640091563:3715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:45.098429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:45.102681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:45.105276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:45.105507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:45.105521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:45.105532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:45.105586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:45.105630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553972564572678:3402]
2025-10-02T09:28:45.106268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:45.106716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:45.106765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:45.107108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:45.107393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.107404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.107406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.107407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.107409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.107410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.107411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.107412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.107414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.107415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.107416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.107417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.107424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.107437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.107441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.107446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.107449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.107453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.107457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.107461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.107465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.107472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.107476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.107481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.107489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.107497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.107510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.107515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.107525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.107531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.107535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.107541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.107550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.107556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.107561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.107572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.107577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.107582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.107585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.107590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.107595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.107600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.107604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.107610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.107615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.107620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.107624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.107629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.107663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:45.126082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:45.128023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:45.128044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:45.128046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:45.128049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:45.128054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [2:7556553972564572678:3402]
2025-10-02T09:28:45.128069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:45.128090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:45.128093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.128097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.128099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.128116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:45.128121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:45.128129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:45.128194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.128199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.128201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.128203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:45.128205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:45.128276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:45.128287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.128302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.128313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.128328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:45.128352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640091731:3715], now have 1 active actors on pipe
2025-10-02T09:28:45.128361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640091540:2446], now have 1 active actors on pipe
2025-10-02T09:28:45.128367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.128369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.128371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.128385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:45.128397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:45.128397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 204
2025-10-02T09:28:45.128412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 204
2025-10-02T09:28:45.128406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:45.128412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:45.128414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:45.128419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:45.128421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:45.128443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.128446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:45.128449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:45.128476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.128481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.128513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:45.128525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.128531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.128534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:45.128542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.128551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:45.128568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.128732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.128743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.128758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.128854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 36 sessionId: src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0
2025-10-02T09:28:45.129222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6c575c-864052ef-fae5adb-497732a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:45.132591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Write session: try to update token
2025-10-02T09:28:45.132608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:45.143208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:45.143233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:45.143235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:45.143237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:45.143245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.143250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.143254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553972564572673:3402]
2025-10-02T09:28:45.143291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:45.143300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:45.143303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.143306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:45.143306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:45.143309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:45.143447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:45.148649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:45.151266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:45.180988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553972640091817:3694]
2025-10-02T09:28:45.181230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7556553972640091817:3694]
2025-10-02T09:28:45.285243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:45.285537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.285550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.285584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640091817:3694], now have 1 active actors on pipe
2025-10-02T09:28:45.285807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:45.285840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:45.285844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553972640091817:3694]
2025-10-02T09:28:45.285855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:45.285922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: error at write: Disconnected sessionId: src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0
2025-10-02T09:28:45.286113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0 is DEAD
2025-10-02T09:28:45.286195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:45.286258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:45.286270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Write session will restart in 0.007980s
2025-10-02T09:28:45.286310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Write session: Do CDS request
2025-10-02T09:28:45.286315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:45.295397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.295488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:45.295506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-10-02T09:28:45.295646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.295676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:45.295682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:45.295685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:45.296079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-10-02T09:28:45.296111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:45.296115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:45.296117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:45.296122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553972640091851:3720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:45.296567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553972640091851:3720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:45.299605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553972640091851:3720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:45.302352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553972640091851:3720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:45.302365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553972640091851:3720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:45.302369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553972640091851:3720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:45.302376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:45.305047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:45.306216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:45.306508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:45.306521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:45.306533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:45.306595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:45.306632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553972564572941:3404]
2025-10-02T09:28:45.307253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:45.307619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:45.307673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:45.307991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:45.308068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.308076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.308078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.308079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.308080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.308081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.308082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.308083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.308084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.308085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.308086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.308087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.308092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.308102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.308106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.308109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.308113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.308116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.308119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.308123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.308127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.308130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.308134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.308137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.308144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.308152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.308157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.308163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.308173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.308183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.308191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.308196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.308199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.308210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.308218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.308223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.308227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.308232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.308236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.308240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.308245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.308255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.308263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.308267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.308271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.308280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.308284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.308289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.308324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:45.318597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:45.320669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:45.320692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:45.320695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:45.320698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:45.320704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [2:7556553972564572941:3404]
2025-10-02T09:28:45.320720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:45.320737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:45.320740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.320744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.320746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.320760Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:45.320765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:45.320772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:45.320871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.320880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.320882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.320885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:45.320888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:45.320955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:45.320964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.320978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.320990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.321010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:45.321038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092021:3720], now have 1 active actors on pipe
2025-10-02T09:28:45.321041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640091821:2446], now have 1 active actors on pipe
2025-10-02T09:28:45.321048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.321050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.321052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.321067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:45.321082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:45.321081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:45.321084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:45.321087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:45.321100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:45.321103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:45.321136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.321110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 205
2025-10-02T09:28:45.321143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:45.321120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 205
2025-10-02T09:28:45.321145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:45.321157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.321160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.321211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:45.321222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.321226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.321227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:45.321235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.321245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:45.321265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.321417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.321426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.321439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.321516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0
2025-10-02T09:28:45.321868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e8df00-65a2c605-bfb7f1b1-71fad20b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:45.325036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Write session: try to update token
2025-10-02T09:28:45.325053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:45.333324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:45.333348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:45.333351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:45.333353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:45.333362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.333367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.333370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553972564572935:3404]
2025-10-02T09:28:45.333406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:45.333414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.333414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:45.333416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:45.333420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:45.333424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:45.333589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:45.342253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:45.344856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:45.386016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553972640092101:3694]
2025-10-02T09:28:45.386383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7556553972640092101:3694]
2025-10-02T09:28:45.494098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:45.494511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.494525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.494543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092101:3694], now have 1 active actors on pipe
2025-10-02T09:28:45.494771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:45.495223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:45.495295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:45.495304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0
2025-10-02T09:28:45.495338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553972640092101:3694]
2025-10-02T09:28:45.495523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0 is DEAD
2025-10-02T09:28:45.495632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:45.495641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Write session will restart in 0.005126s
2025-10-02T09:28:45.495663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Write session: Do CDS request
2025-10-02T09:28:45.495672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:45.502325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.502494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:45.502508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-10-02T09:28:45.502643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.502675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:45.502685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:45.502688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:45.503211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-10-02T09:28:45.503249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:45.503254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:45.503256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:45.503262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553972640092112:3725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:45.503731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553972640092112:3725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:45.506169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553972640092112:3725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:45.509518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553972640092112:3725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:45.509532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553972640092112:3725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:45.509536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553972640092112:3725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:45.509544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:45.520831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:45.522245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:45.522421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:45.522429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:45.522436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:45.522489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:45.522741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553972564573214:3407]
2025-10-02T09:28:45.523255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:45.523565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:45.523606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:45.523840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:45.523879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.523883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.523884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.523885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.523885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.523886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.523887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.523888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.523888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.523889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.523890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.523890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.523893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.523901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.523903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.523906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.523908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.523910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.523912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.523915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.523917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.523919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.523922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.523924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.523929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.523933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.523937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.523941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.523943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.523947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.523950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.523954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.523956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.523959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.523961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.523964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.523966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.523969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.523971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.523974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.523977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.523980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.523983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.523986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.523990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.523996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.524000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.524005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.524040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:45.533972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:45.535640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:45.535670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:45.535673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:45.535677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:45.535684Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [2:7556553972564573214:3407]
2025-10-02T09:28:45.535700Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:45.535717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:45.535720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.535723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.535725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.535741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:45.535746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:45.535753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:45.535822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.535834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.535836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.535840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:45.535843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:45.535919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:45.535930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.535945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.535955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.535971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:45.536000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092163:3725], now have 1 active actors on pipe
2025-10-02T09:28:45.536040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 206
2025-10-02T09:28:45.536050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 206
2025-10-02T09:28:45.536009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092103:2446], now have 1 active actors on pipe
2025-10-02T09:28:45.536016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.536018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.536020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.536034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:45.536047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:45.536058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:45.536061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:45.536062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:45.536062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:45.536065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:45.536099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.536102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:45.536112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:45.536118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.536122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.536171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:45.536184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.536193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.536195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:45.536203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.536217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:45.536245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.536428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.536442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.536463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.536549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 36 sessionId: src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0
2025-10-02T09:28:45.536917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d40cbcb-f08bd7-71c54425-c7c93e7b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:45.540158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Write session: try to update token
2025-10-02T09:28:45.540173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:45.548573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:45.548596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:45.548599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:45.548601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:45.548610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.548614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.548617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553972564573209:3407]
2025-10-02T09:28:45.548656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:45.548664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.548672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:45.548670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:45.548676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:45.548680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:45.548845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:45.556216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:45.558826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:45.595191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553972640092372:3694]
2025-10-02T09:28:45.595557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7556553972640092372:3694]
2025-10-02T09:28:45.695612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:45.696149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.696163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.696180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092372:3694], now have 1 active actors on pipe
2025-10-02T09:28:45.696363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:45.696360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553972640092372:3694]
2025-10-02T09:28:45.696388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:45.696433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:45.696512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0
2025-10-02T09:28:45.696679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0 is DEAD
2025-10-02T09:28:45.696828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:45.696839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Write session will restart in 0.005253s
2025-10-02T09:28:45.696863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Write session: Do CDS request
2025-10-02T09:28:45.696868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:45.703445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.703591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:45.703608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-10-02T09:28:45.703760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.703808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:45.703817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:45.703821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:45.704209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-10-02T09:28:45.704239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:45.704245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:45.704247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:45.704251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553972640092393:3729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:45.704844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553972640092393:3729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:45.707111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553972640092393:3729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:45.712013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553972640092393:3729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:45.712030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553972640092393:3729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:45.712034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553972640092393:3729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:45.712043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:45.716857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:45.718220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:45.718395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:45.718404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:45.718413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:45.718457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:45.718494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553972564573477:3409]
2025-10-02T09:28:45.719063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:45.719377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:45.719413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:45.719638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:45.719673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.719677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.719678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.719679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.719679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.719680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.719681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.719681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.719682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.719682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.719683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.719683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.719686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.719694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.719696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.719698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.719700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.719703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.719705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.719707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.719709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.719711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.719713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.719715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.719719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.719724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.719727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.719731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.719733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.719736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.719738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.719741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.719743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.719746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.719749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.719752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.719754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.719757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.719760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.719763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.719765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.719768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.719771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.719774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.719777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.719779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.719782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.719785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.719803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:45.729972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:45.731639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:45.731654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:45.731655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:45.731658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:45.731661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [2:7556553972564573477:3409]
2025-10-02T09:28:45.731672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:45.731684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:45.731685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.731688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.731689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.731699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:45.731703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:45.731708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:45.731749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.731755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.731756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.731758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:45.731760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:45.731805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:45.731810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.731817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.731827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.731841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:45.731862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.731868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.731870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.731876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:45.731887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092523:3729], now have 1 active actors on pipe
2025-10-02T09:28:45.731889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:45.731892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:45.731894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:45.731895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:45.731902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:45.731904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:45.731908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092375:2446], now have 1 active actors on pipe
2025-10-02T09:28:45.731929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.731937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:45.731945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:45.731980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 207
2025-10-02T09:28:45.731984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 207
2025-10-02T09:28:45.732207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.732215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.732231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:45.732236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.732238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.732239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:45.732245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.732252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:45.732259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.732436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.732441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.732449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.732527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 36 sessionId: src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0
2025-10-02T09:28:45.732858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c4c067-bdc2bdf9-c9b8050b-42a1935b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:45.735891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Write session: try to update token
2025-10-02T09:28:45.735905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:45.742315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:45.742334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:45.742335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:45.742337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:45.742344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.742349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.742352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553972564573471:3409]
2025-10-02T09:28:45.742385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:45.742384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:45.742388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:45.742390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.742390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:45.742392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:45.742542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:45.748918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:45.751418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:45.796411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553972640092654:3694]
2025-10-02T09:28:45.796661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7556553972640092654:3694]
2025-10-02T09:28:45.874673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:45.874950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.874962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.874977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092654:3694], now have 1 active actors on pipe
2025-10-02T09:28:45.875195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:45.875205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:45.875220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:45.875223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:45.875270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0
2025-10-02T09:28:45.875278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553972640092654:3694]
2025-10-02T09:28:45.875414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0 is DEAD
2025-10-02T09:28:45.875560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:45.875567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Write session will restart in 0.005052s
2025-10-02T09:28:45.875584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Write session: Do CDS request
2025-10-02T09:28:45.875587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:45.881200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.881330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:45.881341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-10-02T09:28:45.881423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:45.881444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:45.881451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:45.881454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:45.881839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-10-02T09:28:45.881866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:45.881871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:45.881872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:45.881877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553972640092671:3734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:45.882355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553972640092671:3734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:45.884218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553972640092671:3734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:45.887563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553972640092671:3734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:45.887574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553972640092671:3734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:45.887577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553972640092671:3734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:45.887583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:45.891410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:45.892475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:45.892662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:45.892678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:45.892689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:45.892747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:45.892787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553972564573742:3412]
2025-10-02T09:28:45.893357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:45.893632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:45.893680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:45.893971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:45.894034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.894041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.894042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.894043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.894045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.894046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.894046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.894047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.894048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.894049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.894050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.894051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.894055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.894065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.894069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.894072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.894075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.894078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.894081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.894091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.894094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.894098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.894101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.894105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.894110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.894116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:45.894121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.894126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:45.894130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.894134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:45.894137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.894142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:45.894145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.894149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:45.894157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.894162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:45.894165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.894169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:45.894172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.894176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:45.894180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.894184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:45.894188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.894192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.894201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.894205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.894215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.894221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.894257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:45.904447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:45.906625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:45.906651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:45.906654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:45.906657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:45.906666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [2:7556553972564573742:3412]
2025-10-02T09:28:45.906679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:45.906695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:45.906698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.906701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.906703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.906718Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:45.906730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:45.906737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:45.906802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.906809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.906811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.906814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:45.906816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:45.906879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:45.906889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.906902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:45.906912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:45.906926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:45.906954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092657:2446], now have 1 active actors on pipe
2025-10-02T09:28:45.906957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092810:3734], now have 1 active actors on pipe
2025-10-02T09:28:45.906962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.906964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.906966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.906991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:45.907002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:45.907005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:45.907007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:45.907007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:45.907021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:45.907029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:45.907008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 208
2025-10-02T09:28:45.907010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 208
2025-10-02T09:28:45.907067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.907078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:45.907086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:45.907091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.907094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.907131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|253421b0-c4315ecf-fb96292b-11374b6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:45.907153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:45.907161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:45.907163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:45.907171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:45.907182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:45.907205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.907341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:45.907352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:45.907368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:45.907443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 36 sessionId: src_id|253421b0-c4315ecf-fb96292b-11374b6d_0
2025-10-02T09:28:45.907816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084aa91-e3141d67-8fb85bff-59e9bc51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|253421b0-c4315ecf-fb96292b-11374b6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:45.910799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Write session: try to update token
2025-10-02T09:28:45.910813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:45.917605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:45.917632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:45.917634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:45.917636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:45.917644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.917647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.917651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553972564573737:3412]
2025-10-02T09:28:45.917685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:45.917687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:45.917692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:45.917692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:45.917694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:45.917696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:45.917870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:45.924054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|253421b0-c4315ecf-fb96292b-11374b6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:45.926564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:45.975587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553972640092927:3694]
2025-10-02T09:28:45.975811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7556553972640092927:3694]
2025-10-02T09:28:46.058325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:46.058560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.058570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.058585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553972640092927:3694], now have 1 active actors on pipe
2025-10-02T09:28:46.058749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:46.058807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:46.058821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:46.058823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553972640092927:3694]
2025-10-02T09:28:46.058843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:46.058875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: error at write: Disconnected sessionId: src_id|253421b0-c4315ecf-fb96292b-11374b6d_0
2025-10-02T09:28:46.059042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|253421b0-c4315ecf-fb96292b-11374b6d_0 is DEAD
2025-10-02T09:28:46.059211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:46.059222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Write session will restart in 0.009484s
2025-10-02T09:28:46.059241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Write session: Do CDS request
2025-10-02T09:28:46.059246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:46.070293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.070392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:46.070408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-10-02T09:28:46.070523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.070549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:46.070558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:46.070561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:46.071021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-10-02T09:28:46.071057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:46.071068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:46.071070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:46.071075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553976935060312:3738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:46.071602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553976935060312:3738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:46.074047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553976935060312:3738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:46.076605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553976935060312:3738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:46.076619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553976935060312:3738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:46.076622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553976935060312:3738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:46.076629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:46.077042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:46.078362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:46.078531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:46.078545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:46.078556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:46.078611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:46.078651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553976859541304:3414]
2025-10-02T09:28:46.079247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:46.079565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:46.079617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:46.079963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:46.080007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.080012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.080012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.080013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.080014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.080015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.080015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.080016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.080017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.080018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.080018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.080019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.080023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.080030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.080033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.080035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.080037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.080040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.080042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.080044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.080047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.080050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.080052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.080054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.080059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.080064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.080067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.080071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.080073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.080077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.080079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.080082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.080085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.080089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.080091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.080094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.080097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.080099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.080102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.080105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.080108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.080111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.080113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.080116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.080119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.080122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.080124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.080128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.080152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:46.090558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:46.092335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:46.092360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:46.092363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:46.092366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:46.092372Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [2:7556553976859541304:3414]
2025-10-02T09:28:46.092385Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:46.092400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:46.092402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.092405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.092407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.092418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:46.092423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:46.092430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:46.092473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.092482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.092483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.092485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:46.092486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:46.092550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:46.092559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.092573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.092585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.092594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:46.092609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.092618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.092620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.092627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:46.092638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:46.092640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060226:2446], now have 1 active actors on pipe
2025-10-02T09:28:46.092645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:46.092649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:46.092651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:46.092653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:46.092654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:46.092658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060485:3738], now have 1 active actors on pipe
2025-10-02T09:28:46.092682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.092692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:46.092714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:46.092715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 209
2025-10-02T09:28:46.092759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 209
2025-10-02T09:28:46.092942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.092952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.092973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:46.092984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.092987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.092994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:46.093002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.093016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:46.093033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.093213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.093221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.093232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.093323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0
2025-10-02T09:28:46.093599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|253421b0-c4315ecf-fb96292b-11374b6d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:46.096504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Write session: try to update token
2025-10-02T09:28:46.096517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:46.103242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:46.103263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:46.103265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:46.103266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:46.103273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.103276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.103280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553976859541297:3414]
2025-10-02T09:28:46.103317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:46.103323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.103325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:46.103327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:46.103333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:46.103337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:46.103472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:46.110410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:46.113004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:46.158902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553976935060521:3694]
2025-10-02T09:28:46.159170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7556553976935060521:3694]
2025-10-02T09:28:46.240763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:46.241226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.241238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.241252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060521:3694], now have 1 active actors on pipe
2025-10-02T09:28:46.241486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:46.241516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:46.241494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:46.241497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:46.241543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553976935060521:3694]
2025-10-02T09:28:46.241549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: error at write: Disconnected sessionId: src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0
2025-10-02T09:28:46.241723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0 is DEAD
2025-10-02T09:28:46.241880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:46.241890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Write session will restart in 0.008257s
2025-10-02T09:28:46.241914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Write session: Do CDS request
2025-10-02T09:28:46.241919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:46.251322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.257165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:46.257180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-10-02T09:28:46.257360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.257395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:46.257400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:46.257403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:46.257785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-10-02T09:28:46.257815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:46.257817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:46.257818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:46.257823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553976935060749:3750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:46.258336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553976935060749:3750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:46.258398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:46.260175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:46.260325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553976935060749:3750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:46.260360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:46.260374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:46.260384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:46.260435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:46.260480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553976859541605:3429]
2025-10-02T09:28:46.261078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:46.261414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:46.261474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:46.261829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:46.261905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.261912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.261913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.261914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.261915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.261916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.261917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.261918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.261919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.261920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.261921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.261922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.261927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.261937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.261941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.261945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.261949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.261953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.261956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.261960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.261963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.261967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.261971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.261975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.261981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.261987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.261994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.261999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.262003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.262008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.262013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.262018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.262022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.262027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.262032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.262036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.262041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.262045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.262056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.262060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.262065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.262071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.262074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.262078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.262082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.262086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.262090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.262094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.262125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:46.264705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553976935060749:3750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:46.264719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553976935060749:3750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:46.264722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553976935060749:3750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:46.264730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:46.271645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:46.273848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:46.273869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:46.273873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:46.273876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:46.273884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [2:7556553976859541605:3429]
2025-10-02T09:28:46.273898Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:46.273917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:46.273919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.273923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.273925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.273941Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:46.273947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:46.273955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:46.274032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.274043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.274045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.274049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:46.274051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:46.274122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:46.274132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.274148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.274165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.274185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:46.274209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060789:3750], now have 1 active actors on pipe
2025-10-02T09:28:46.274218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060524:2446], now have 1 active actors on pipe
2025-10-02T09:28:46.274226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.274228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.274230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.274244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:46.274266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:46.274272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:46.274276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:46.274278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:46.274255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 210
2025-10-02T09:28:46.274287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:46.274266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 210
2025-10-02T09:28:46.274297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:46.274361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.274373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.274386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.274397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:46.274407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:46.274432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a42e593b-3010aee1-d07191d4-7c23696e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:46.274443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.274447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.274454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:46.274464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.274479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:46.274509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.274679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.274693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.274718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.274802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 36 sessionId: src_id|a42e593b-3010aee1-d07191d4-7c23696e_0
2025-10-02T09:28:46.275244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e4d-ed6f16d8-95a97522-9b9bbacb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a42e593b-3010aee1-d07191d4-7c23696e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:46.278379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Write session: try to update token
2025-10-02T09:28:46.278398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:46.285791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:46.285811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:46.285813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:46.285814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:46.285821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.285824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.285830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553976859541600:3429]
2025-10-02T09:28:46.285863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:46.285869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.285870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:46.285872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:46.285876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:46.285879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:46.286018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:46.294028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|a42e593b-3010aee1-d07191d4-7c23696e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:46.296600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:46.341684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553976935060808:3694]
2025-10-02T09:28:46.341935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7556553976935060808:3694]
2025-10-02T09:28:46.432833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:46.433436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.433450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.433467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060808:3694], now have 1 active actors on pipe
2025-10-02T09:28:46.433628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:46.433713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553976935060808:3694]
2025-10-02T09:28:46.433715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:46.433757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:46.433829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a42e593b-3010aee1-d07191d4-7c23696e_0
2025-10-02T09:28:46.433963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|a42e593b-3010aee1-d07191d4-7c23696e_0 is DEAD
2025-10-02T09:28:46.434118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:46.434129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Write session will restart in 0.006388s
2025-10-02T09:28:46.434154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Write session: Do CDS request
2025-10-02T09:28:46.434159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:46.441348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.441429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:46.441446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-10-02T09:28:46.441580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.441618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:46.441627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:46.441632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:46.442099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-10-02T09:28:46.442136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:46.442142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:46.442144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:46.442149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553976935060826:3755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:46.442686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553976935060826:3755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:46.444851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553976935060826:3755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:46.448072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553976935060826:3755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:46.448089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553976935060826:3755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:46.448095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553976935060826:3755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:46.448157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:46.451969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:46.453366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:46.453597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:46.453616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:46.453630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:46.453691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:46.453748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553976859541884:3432]
2025-10-02T09:28:46.454341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:46.454618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:46.454663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:46.454912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:46.454952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.454956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.454957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.454958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.454958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.454959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.454959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.454960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.454961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.454961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.454962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.454962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.454966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.454974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.454977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.454979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.454981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.454984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.454986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.454988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.454990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.454992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.454994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.454997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.455003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.455010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.455016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.455022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.455025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.455029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.455031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.455034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.455036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.455039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.455042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.455044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.455047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.455051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.455053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.455056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.455058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.455061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.455064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.455066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.455069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.455072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.455075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.455078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.455097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:46.464217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:46.465942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:46.465967Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:46.465970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:46.465974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:46.465982Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [2:7556553976859541884:3432]
2025-10-02T09:28:46.465997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:46.466013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:46.466014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.466017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.466018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.466030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:46.466033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:46.466041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:46.466090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.466096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.466097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.466100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:46.466101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:46.466153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:46.466158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.466170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.466184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.466201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:46.466226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060812:2446], now have 1 active actors on pipe
2025-10-02T09:28:46.466237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.466239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.466241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.466253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:46.466269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:46.466272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935060974:3755], now have 1 active actors on pipe
2025-10-02T09:28:46.466273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:46.466275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:46.466278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:46.466287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:46.466290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:46.466315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 211
2025-10-02T09:28:46.466317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.466324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:46.466339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:46.466382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 211
2025-10-02T09:28:46.466415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.466424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.466445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:46.466456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.466463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.466465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:46.466477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.466485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:46.466500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.466702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.466716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.466740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.466829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 36 sessionId: src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0
2025-10-02T09:28:46.467201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42e593b-3010aee1-d07191d4-7c23696e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:46.470543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Write session: try to update token
2025-10-02T09:28:46.470566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:46.477865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:46.477894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:46.477905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.477951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:46.478146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:46.478300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:46.478305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:46.478486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:46.478635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:46.478841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:46.478889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:46.489480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:46.489503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:46.489506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:46.489508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:46.489517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.489520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.489523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553976859541879:3432]
2025-10-02T09:28:46.489560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:46.489567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.489568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:46.489570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:46.489590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:46.489594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:46.489729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:46.490290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:46.492972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:46.533710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553976935061089:3694]
2025-10-02T09:28:46.534017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7556553976935061089:3694]
2025-10-02T09:28:46.635118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:46.635772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.635787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.635807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061089:3694], now have 1 active actors on pipe
2025-10-02T09:28:46.636061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:46.636095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:46.636109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:46.636173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553976935061089:3694]
2025-10-02T09:28:46.636180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: error at write: Disconnected sessionId: src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0
2025-10-02T09:28:46.636565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:46.636191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:46.636396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0 is DEAD
2025-10-02T09:28:46.636585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Write session will restart in 0.008976s
2025-10-02T09:28:46.636619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Write session: Do CDS request
2025-10-02T09:28:46.636625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:46.647041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.647113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:46.647129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-10-02T09:28:46.647335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.647362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:46.647367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:46.647371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:46.647860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-10-02T09:28:46.647898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:46.647906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:46.647908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:46.647913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553976935061114:3761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:46.648394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553976935061114:3761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:46.650407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553976935061114:3761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:46.654680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553976935061114:3761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:46.654696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553976935061114:3761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:46.654700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553976935061114:3761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:46.654711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:46.661239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:46.662798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:46.662976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:46.662989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:46.663000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:46.663056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:46.663095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553976859542152:3434]
2025-10-02T09:28:46.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:46.663879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:46.663920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:46.664220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:46.664270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.664275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.664276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.664277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.664278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.664279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.664280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.664281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.664282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.664283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.664284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.664285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.664290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.664300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.664304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.664308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.664312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.664315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.664318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.664322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.664325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.664329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.664332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.664335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.664342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.664348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.664356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.664361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.664364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.664369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.664373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.664378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.664387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.664391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.664396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.664402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.664406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.664410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.664414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.664417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.664421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.664425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.664429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.664433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.664437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.664441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.664445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.664449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.664482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:46.674641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:46.676465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:46.676472Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:46.676476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:46.676480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:46.676487Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [2:7556553976859542152:3434]
2025-10-02T09:28:46.676503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:46.676523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:46.676527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.676529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.676531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.676548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:46.676553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:46.676560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:46.676628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.676631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.676633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.676636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:46.676639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:46.676730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:46.676733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.676748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.676944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 212
2025-10-02T09:28:46.676999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 212
2025-10-02T09:28:46.676760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.676779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:46.676859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061091:2446], now have 1 active actors on pipe
2025-10-02T09:28:46.676865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061201:3761], now have 1 active actors on pipe
2025-10-02T09:28:46.676871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.676874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.676876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.676890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:46.676905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:46.676908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:46.676912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:46.676914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:46.676922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:46.676926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:46.676962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.676966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:46.676972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:46.677181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.677198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.677219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:46.677229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.677233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.677234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:46.677244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.677254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:46.677774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 36 sessionId: src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0
2025-10-02T09:28:46.677271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.677573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.677576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.677588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.678460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fecb68-f4f19e60-f492d12f-54d26bd7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:46.681808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Write session: try to update token
2025-10-02T09:28:46.681826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:46.689208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:46.689234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:46.689237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:46.689239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:46.689248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.689252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.689256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553976859542146:3434]
2025-10-02T09:28:46.689296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:46.689303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.689305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:46.689303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:46.689310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:46.689314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:46.689458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:46.700488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:46.703547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:46.736449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553976935061375:3694]
2025-10-02T09:28:46.736695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7556553976935061375:3694]
2025-10-02T09:28:46.836651Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:46.837376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.837393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.837428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061375:3694], now have 1 active actors on pipe
2025-10-02T09:28:46.837637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:46.837661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553976935061375:3694]
2025-10-02T09:28:46.837676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:46.837680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:46.837691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:46.837753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: error at write: Disconnected sessionId: src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0
2025-10-02T09:28:46.837926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0 is DEAD
2025-10-02T09:28:46.838098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:46.838108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Write session will restart in 0.006474s
2025-10-02T09:28:46.838133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Write session: Do CDS request
2025-10-02T09:28:46.838140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:46.845287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.845373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:46.845387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-10-02T09:28:46.845560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:46.845588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:46.845597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:46.845601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:46.846047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-10-02T09:28:46.846088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:46.846094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:46.846096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:46.846102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553976935061395:3766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:46.846605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553976935061395:3766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:46.849442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553976935061395:3766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:46.852743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553976935061395:3766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:46.852758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553976935061395:3766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:46.852761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553976935061395:3766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:46.852779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:46.856547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:46.858153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:46.858371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:46.858379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:46.858389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:46.858442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:46.858478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553976859542422:3437]
2025-10-02T09:28:46.859073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:46.859424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:46.859477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:46.859807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:46.859864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.859874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.859875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.859876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.859877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.859878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.859879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.859881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.859882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.859883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.859884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.859885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.859890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.859901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.859904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.859908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.859911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.859915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.859919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.859922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.859926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.859930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.859934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.859938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.859945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.859952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:46.859958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.859963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:46.859967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.859972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:46.859976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.859981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:46.859985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.859990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:46.859994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.859998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:46.860003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.860008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:46.860024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.860029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:46.860033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.860038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:46.860043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.860048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.860052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.860058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.860063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.860072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.860106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:46.869344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:46.871444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:46.871461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:46.871464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:46.871467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:46.871473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [2:7556553976859542422:3437]
2025-10-02T09:28:46.871489Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:46.871505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:46.871509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.871516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.871517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.871532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:46.871541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:46.871547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:46.871606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.871613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.871614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.871617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:46.871620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:46.871700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:46.871707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.871718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:46.871733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:46.871748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:46.871770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061380:2446], now have 1 active actors on pipe
2025-10-02T09:28:46.871778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061555:3766], now have 1 active actors on pipe
2025-10-02T09:28:46.871782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.871784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.871786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.871798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:46.871817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:46.871818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:46.871823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:46.871825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:46.871836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:46.871845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:46.871832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 213
2025-10-02T09:28:46.871876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.871854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 213
2025-10-02T09:28:46.871884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:46.871887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:46.871915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.871923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.871963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:46.871976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:46.871979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:46.871981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:46.871988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:46.871996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:46.872016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.872191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:46.872198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:46.872209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:46.872305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0
2025-10-02T09:28:46.872678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecfc31-a331bd67-e78f2f2a-9f8f98df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:46.875735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Write session: try to update token
2025-10-02T09:28:46.875754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:46.883653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:46.883674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:46.883676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:46.883678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:46.883687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.883691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.883695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553976859542417:3437]
2025-10-02T09:28:46.883728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:46.883735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:46.883737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:46.883738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:46.883744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:46.883749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:46.883904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:46.890647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:46.893177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:46.937636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553976935061656:3694]
2025-10-02T09:28:46.937870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7556553976935061656:3694]
2025-10-02T09:28:47.021778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:47.022312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.022329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.022347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553976935061656:3694], now have 1 active actors on pipe
2025-10-02T09:28:47.022576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553976935061656:3694]
2025-10-02T09:28:47.022602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:47.022607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:47.022611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:47.022664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: error at write: Disconnected sessionId: src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0
2025-10-02T09:28:47.022835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:47.022855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0 is DEAD
2025-10-02T09:28:47.023028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:47.023046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Write session will restart in 0.005432s
2025-10-02T09:28:47.023093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Write session: Do CDS request
2025-10-02T09:28:47.023099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:47.029298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.029369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:47.029381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-10-02T09:28:47.029620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.029645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:47.029653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:47.029657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:47.030037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-10-02T09:28:47.030067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:47.030068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:47.030070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:47.030074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553981230028970:3770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:47.030548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553981230028970:3770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:47.032768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553981230028970:3770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:47.035444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553981230028970:3770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:47.035459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553981230028970:3770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:47.035463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553981230028970:3770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:47.035470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:47.039688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:47.041088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:47.041270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.041285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:47.041294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:47.041348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:47.041387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553981154509988:3439]
2025-10-02T09:28:47.042040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:47.042370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:47.042420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:47.042754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:47.042816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.042824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.042825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.042827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.042828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.042829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.042830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.042832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.042833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.042834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.042835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.042836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.042841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.042853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.042857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.042862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.042866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.042871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.042875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.042878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.042882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.042886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.042889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.042893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.042900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.042908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.042918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.042924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.042932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.042939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.042948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.042953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.042958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.042963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.042972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.042984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.042993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.043003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.043012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.043016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.043024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.043030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.043039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.043048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.043057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.043067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.043071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.043080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.043119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:47.052040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:47.054280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:47.054294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:47.054297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:47.054300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:47.054306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [2:7556553981154509988:3439]
2025-10-02T09:28:47.054316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:47.054328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:47.054331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.054333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.054334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.054345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:47.054349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:47.054353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:47.054397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.054402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.054404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.054406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:47.054408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:47.054482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:47.054491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.054504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.054512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.054525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:47.054544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230028955:2446], now have 1 active actors on pipe
2025-10-02T09:28:47.054547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029115:3770], now have 1 active actors on pipe
2025-10-02T09:28:47.054553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.054555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.054557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.054569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:47.054581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:47.054582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:47.054584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:47.054586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:47.054595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:47.054598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:47.054628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.054636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:47.054642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:47.054645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 214
2025-10-02T09:28:47.054675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 214
2025-10-02T09:28:47.054708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.054716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.054740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:47.054753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.054757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.054758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:47.054767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.054775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:47.054787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.054970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.054979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.054993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.055100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 36 sessionId: src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0
2025-10-02T09:28:47.055507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae06455d-f4b80926-3d31ef55-b4cd1b89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:47.058542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Write session: try to update token
2025-10-02T09:28:47.058563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:47.065531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:47.065547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:47.065556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.065598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:47.065605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:47.065779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:47.065954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:47.066087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:47.066245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:47.066526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:47.066565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:47.075289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:47.075305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:47.075307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:47.075308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:47.075315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.075318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.075322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553981154509983:3439]
2025-10-02T09:28:47.075354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:47.075359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.075361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:47.075380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:47.075385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:47.075388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:47.075486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:47.077108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:47.079638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:47.122972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553981230029246:3694]
2025-10-02T09:28:47.123172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7556553981230029246:3694]
2025-10-02T09:28:47.216053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:47.216424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.216437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.216453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029246:3694], now have 1 active actors on pipe
2025-10-02T09:28:47.216637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:47.216710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:47.216763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553981230029246:3694]
2025-10-02T09:28:47.217278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:47.217346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: status is not ok: tablet will be restarted right now sessionId: src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0
2025-10-02T09:28:47.217510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0 is DEAD
2025-10-02T09:28:47.217724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:47.217741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Write session will restart in 0.008263s
2025-10-02T09:28:47.217773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Write session: Do CDS request
2025-10-02T09:28:47.217781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:47.227382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.227585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:47.227600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-10-02T09:28:47.227741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.227772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:47.227780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:47.227784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:47.228172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-10-02T09:28:47.228207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:47.228214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:47.228216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:47.228220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553981230029360:3782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:47.228690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553981230029360:3782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:47.231014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553981230029360:3782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:47.233003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:47.234595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:47.234896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.234909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:47.234921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:47.234985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:47.234602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553981230029360:3782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:47.235023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553981154510295:3454]
2025-10-02T09:28:47.234616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553981230029360:3782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:47.234619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553981230029360:3782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:47.234627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:47.235598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:47.235919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:47.235971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:47.236270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:47.236340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.236345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.236346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.236347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.236348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.236349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.236351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.236352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.236353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.236354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.236355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.236356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.236361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.236371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.236376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.236379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.236382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.236386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.236389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.236392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.236397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.236401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.236404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.236408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.236413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.236420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.236426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.236431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.236434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.236439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.236443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.236448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.236452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.236457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.236461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.236465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.236470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.236474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.236479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.236489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.236493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.236498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.236502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.236512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.236516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.236521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.236527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.236533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.236566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:47.245102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:47.246973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:47.246987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:47.246989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:47.246992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:47.246997Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [2:7556553981154510295:3454]
2025-10-02T09:28:47.247007Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:47.247023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:47.247026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.247029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.247031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.247045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:47.247048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:47.247054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:47.247098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.247106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.247108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.247112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:47.247114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:47.247191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:47.247199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.247212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.247225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.247255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:47.247279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029260:2446], now have 1 active actors on pipe
2025-10-02T09:28:47.247299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 215
2025-10-02T09:28:47.247318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 215
2025-10-02T09:28:47.247289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029522:3782], now have 1 active actors on pipe
2025-10-02T09:28:47.247294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.247296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.247299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.247310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:47.247323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:47.247329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:47.247333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:47.247335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:47.247338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:47.247341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:47.247387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.247391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.247400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.247406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:47.247418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:47.247431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea94859-9d16930-af45fa05-b2f4aa74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:47.247436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.247439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.247441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:47.247447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.247465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:47.247487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.247590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.247598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.247609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.247699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea94859-9d16930-af45fa05-b2f4aa74_0
2025-10-02T09:28:47.248093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483002f8-de89fb6a-8a46cfd3-80e8276a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea94859-9d16930-af45fa05-b2f4aa74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:47.250748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Write session: try to update token
2025-10-02T09:28:47.250769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:47.258340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:47.258355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:47.258357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:47.258359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:47.258367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.258371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.258374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553981154510289:3454]
2025-10-02T09:28:47.258405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:47.258413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.258415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:47.258415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:47.258421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:47.258425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:47.258588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:47.269634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|ea94859-9d16930-af45fa05-b2f4aa74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:47.272278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:47.317059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553981230029534:3694]
2025-10-02T09:28:47.317337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7556553981230029534:3694]
2025-10-02T09:28:47.395178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:47.395517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.395526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.395539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029534:3694], now have 1 active actors on pipe
2025-10-02T09:28:47.395780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:47.395791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:47.395795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:47.395852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|ea94859-9d16930-af45fa05-b2f4aa74_0
2025-10-02T09:28:47.395887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553981230029534:3694]
2025-10-02T09:28:47.396033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|ea94859-9d16930-af45fa05-b2f4aa74_0 is DEAD
2025-10-02T09:28:47.396281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:47.396297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Write session will restart in 0.007122s
2025-10-02T09:28:47.396324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Write session: Do CDS request
2025-10-02T09:28:47.396334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:47.396347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:47.404357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.404462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:47.404474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-10-02T09:28:47.404633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.404663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:47.404675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:47.404678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:47.405267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-10-02T09:28:47.405303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:47.405309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:47.405311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:47.405317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553981230029574:3787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:47.405854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553981230029574:3787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:47.408649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553981230029574:3787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:47.412899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553981230029574:3787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:47.412912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553981230029574:3787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:47.412916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553981230029574:3787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:47.412951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:47.418390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:47.419869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:47.420092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.420104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:47.420114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:47.420163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:47.420206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553981154510577:3457]
2025-10-02T09:28:47.420781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:47.421141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:47.421196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:47.421512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:47.421588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.421596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.421597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.421598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.421599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.421600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.421601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.421602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.421603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.421604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.421605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.421606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.421612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.421623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.421627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.421631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.421634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.421638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.421641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.421645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.421649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.421653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.421657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.421660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.421667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.421675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.421681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.421686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.421690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.421696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.421699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.421704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.421711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.421716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.421719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.421724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.421728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.421733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.421736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.421740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.421744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.421748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.421752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.421758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.421762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.421777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.421781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.421785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.421818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:47.431703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:47.433972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:47.433991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:47.433994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:47.433998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:47.434005Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [2:7556553981154510577:3457]
2025-10-02T09:28:47.434021Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:47.434039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:47.434042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.434046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.434048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.434064Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:47.434069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:47.434076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:47.434142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.434151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.434153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.434156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:47.434159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:47.434232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:47.434242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.434257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.434272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.434289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:47.434314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029549:2446], now have 1 active actors on pipe
2025-10-02T09:28:47.434323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029747:3787], now have 1 active actors on pipe
2025-10-02T09:28:47.434329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.434331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.434333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.434344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:47.434357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:47.434371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:47.434374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:47.434455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 216
2025-10-02T09:28:47.434467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 216
2025-10-02T09:28:47.434411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.434421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:47.434509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:47.434513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:47.434515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:47.434521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:47.434524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.434532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.434561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:47.434570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.434573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.434575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:47.434584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.434594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:47.434620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.435410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.435425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.435446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.435536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0
2025-10-02T09:28:47.435960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94859-9d16930-af45fa05-b2f4aa74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:47.438636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Write session: try to update token
2025-10-02T09:28:47.438657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:47.447426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:47.447448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:47.447451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:47.447453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:47.447465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.447470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.447474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553981154510572:3457]
2025-10-02T09:28:47.447527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:47.447530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:47.447536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:47.447539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:47.447540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.447542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:47.447775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:47.456749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:47.459592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:47.496270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553981230029827:3694]
2025-10-02T09:28:47.496747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7556553981230029827:3694]
2025-10-02T09:28:47.598594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:47.598945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.598954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.598972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029827:3694], now have 1 active actors on pipe
2025-10-02T09:28:47.599328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:47.599838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:47.599886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553981230029827:3694]
2025-10-02T09:28:47.599903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:47.599967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0
2025-10-02T09:28:47.600139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0 is DEAD
2025-10-02T09:28:47.600563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:47.600579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Write session will restart in 0.009470s
2025-10-02T09:28:47.600609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Write session: Do CDS request
2025-10-02T09:28:47.600616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:47.611474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.611522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:47.611537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-10-02T09:28:47.611827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.611881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:47.611896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:47.611901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:47.613277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-10-02T09:28:47.613319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:47.613321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:47.613323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:47.613328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553981230029897:3791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:47.613847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553981230029897:3791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:47.616784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553981230029897:3791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:47.624576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553981230029897:3791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:47.624594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553981230029897:3791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:47.624599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553981230029897:3791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:47.624606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:47.629487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:47.631428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:47.631606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.631616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:47.631625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:47.631669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:47.631709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553981154510848:3459]
2025-10-02T09:28:47.632234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:47.632684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:47.632738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:47.633060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:47.633123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.633131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.633132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.633133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.633134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.633135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.633136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.633138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.633138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.633139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.633140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.633141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.633146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.633156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.633160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.633164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.633167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.633171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.633174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.633177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.633181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.633185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.633188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.633191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.633198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.633205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.633211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.633216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.633219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.633224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.633229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.633234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.633239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.633243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.633247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.633252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.633256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.633261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.633265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.633269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.633274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.633278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.633282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.633287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.633291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.633295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.633300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.633305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.633339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:47.644284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:47.646374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:47.646383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:47.646386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:47.646389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:47.646396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [2:7556553981154510848:3459]
2025-10-02T09:28:47.646410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:47.646429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:47.646433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.646435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.646438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.646454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:47.646459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:47.646467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:47.646544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.646547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.646548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.646552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:47.646555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:47.646632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:47.646635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.646649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.646659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.646675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:47.646693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.646696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.646698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.646711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:47.646725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:47.646740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:47.646743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:47.646778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.646781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:47.646856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:47.646859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:47.646862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:47.646868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:47.647016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230029830:2446], now have 1 active actors on pipe
2025-10-02T09:28:47.647021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230030059:3791], now have 1 active actors on pipe
2025-10-02T09:28:47.647435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 217
2025-10-02T09:28:47.647472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 217
2025-10-02T09:28:47.647676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.647690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.647717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|534baefc-cb03461d-2a7cba47-f66958be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:47.647731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.647735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.647737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:47.647747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.647760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:47.647777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.648192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.648201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.648220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.648486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 36 sessionId: src_id|534baefc-cb03461d-2a7cba47-f66958be_0
2025-10-02T09:28:47.648924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5890fd-1d02d80-c5df0a24-5918e143_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|534baefc-cb03461d-2a7cba47-f66958be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:47.651644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Write session: try to update token
2025-10-02T09:28:47.651666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:47.667116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:47.667136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:47.667154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:47.667156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:47.667165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.667169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.667177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553981154510843:3459]
2025-10-02T09:28:47.667216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:47.667223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.667234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:47.667375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:47.672920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:47.672938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:47.672943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:47.671636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|534baefc-cb03461d-2a7cba47-f66958be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:47.674162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:47.700051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553981230030110:3694]
2025-10-02T09:28:47.700324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7556553981230030110:3694]
2025-10-02T09:28:47.824027Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:47.824450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.824466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.824503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230030110:3694], now have 1 active actors on pipe
2025-10-02T09:28:47.824728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:47.825137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:47.825179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553981230030110:3694]
2025-10-02T09:28:47.825195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:47.825256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: status is not ok: tablet will be restarted right now sessionId: src_id|534baefc-cb03461d-2a7cba47-f66958be_0
2025-10-02T09:28:47.825412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|534baefc-cb03461d-2a7cba47-f66958be_0 is DEAD
2025-10-02T09:28:47.828985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:47.828997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Write session will restart in 0.008373s
2025-10-02T09:28:47.829022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Write session: Do CDS request
2025-10-02T09:28:47.829027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:47.838282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.839024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:47.839040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-10-02T09:28:47.839309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:47.839339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:47.839343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:47.839347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:47.839824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-10-02T09:28:47.839853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:47.839854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:47.839855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:47.839860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553981230030150:3796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:47.840496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553981230030150:3796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:47.845429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553981230030150:3796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:47.851877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553981230030150:3796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:47.851894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553981230030150:3796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:47.851897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553981230030150:3796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:47.851903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:47.870826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:47.873721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:47.874147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:47.874152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:47.874167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:47.874244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:47.874327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553981154511123:3462]
2025-10-02T09:28:47.874764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:47.875041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:47.875080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:47.875379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:47.875451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.875453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.875454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.875456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.875457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.875458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.875459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.875461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.875462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.875463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.875464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.875465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.875471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.875482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.875486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.875489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.875493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.875496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.875500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.875504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.875507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.875511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.875514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.875518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.875527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.875536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:47.875542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.875548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:47.875552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.875558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:47.875563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.875569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:47.875574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.875579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:47.875584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.875589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:47.875594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.875599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:47.875603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.875608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:47.875612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.875617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:47.875621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.875626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.875631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.875636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.875640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.875644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.875681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:47.887347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:47.889632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:47.889639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:47.889641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:47.889644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:47.889650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [2:7556553981154511123:3462]
2025-10-02T09:28:47.889663Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:47.889679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:47.889682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.889684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.889685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.889696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:47.889702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:47.889708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:47.889768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.889770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.889771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.889774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:47.889777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:47.889842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:47.889844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.889857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:47.889866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:47.889880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:47.889896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.890095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 218
2025-10-02T09:28:47.890129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 218
2025-10-02T09:28:47.889898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.889900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.889910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:47.889922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:47.889935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:47.889938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:47.889951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:47.889955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:47.889958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:47.889970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.889973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:47.889982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:47.889992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230030278:3796], now have 1 active actors on pipe
2025-10-02T09:28:47.890003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230030120:2446], now have 1 active actors on pipe
2025-10-02T09:28:47.890399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.890411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.890439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51e934b4-accf7147-50e99f4c-8294365f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:47.890449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:47.890453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:47.890456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:47.890466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:47.890479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:47.890497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.890746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:47.890756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:47.890776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:47.890886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 36 sessionId: src_id|51e934b4-accf7147-50e99f4c-8294365f_0
2025-10-02T09:28:47.891258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534baefc-cb03461d-2a7cba47-f66958be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51e934b4-accf7147-50e99f4c-8294365f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:47.894576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Write session: try to update token
2025-10-02T09:28:47.894595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:47.903961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:47.903981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:47.903983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:47.903985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:47.903994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.903998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.904002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553981154511117:3462]
2025-10-02T09:28:47.904039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:47.904046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:47.904048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:47.904207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:47.909259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:47.909277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:47.909283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:47.922075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|51e934b4-accf7147-50e99f4c-8294365f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:47.924720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:47.925810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553981230030401:3694]
2025-10-02T09:28:47.926098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7556553981230030401:3694]
2025-10-02T09:28:48.059878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:48.060353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.060366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.060382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553981230030401:3694], now have 1 active actors on pipe
2025-10-02T09:28:48.060646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553981230030401:3694]
2025-10-02T09:28:48.060666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:48.060670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:48.060670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:48.060728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: error at write: Disconnected sessionId: src_id|51e934b4-accf7147-50e99f4c-8294365f_0
2025-10-02T09:28:48.060920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|51e934b4-accf7147-50e99f4c-8294365f_0 is DEAD
2025-10-02T09:28:48.061169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:48.061180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Write session will restart in 0.008754s
2025-10-02T09:28:48.061201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Write session: Do CDS request
2025-10-02T09:28:48.061210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:48.061584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:48.071322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.071497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.071516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-10-02T09:28:48.071702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.071738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:48.071744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.071749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.073051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-10-02T09:28:48.073096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.073103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.073108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.073114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553985524997716:3800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.073708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553985524997716:3800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.076452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553985524997716:3800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.081325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553985524997716:3800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.081345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553985524997716:3800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:48.081349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553985524997716:3800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.081359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.086571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:48.088409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:48.088607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:48.088618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:48.088629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:48.088684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:48.088729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553985449478694:3464]
2025-10-02T09:28:48.089348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:48.089717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:48.089766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:48.090102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:48.090154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.090159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.090160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.090161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.090162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.090163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.090164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.090165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.090166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.090167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.090168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.090169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.090175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.090186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.090190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.090194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.090198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.090202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.090207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.090211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.090215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.090220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.090223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.090227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.090233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.090254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.090262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.090268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.090276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.090281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.090289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.090293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.090298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.090304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.090308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.090315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.090321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.090328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.090336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.090341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.090347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.090355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.090362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.090368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.090374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.090379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.090385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.090391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.090430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:48.100269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:48.102625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:48.102659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:48.102665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:48.102669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:48.102677Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [2:7556553985449478694:3464]
2025-10-02T09:28:48.102698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:48.102719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:48.102723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.102727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.102729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.102749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:48.102756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:48.102764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:48.102841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.102843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.102846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.102850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:48.102854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:48.102945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:48.102955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.102970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.102988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.103009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:48.103038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524997874:3800], now have 1 active actors on pipe
2025-10-02T09:28:48.103051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524997700:2446], now have 1 active actors on pipe
2025-10-02T09:28:48.103059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.103061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.103063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.103077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:48.103092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:48.103106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:48.103109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:48.103129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 219
2025-10-02T09:28:48.103129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 219
2025-10-02T09:28:48.103164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.103175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:48.103174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:48.103180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:48.103183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:48.103194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:48.103215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.103220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.103253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:48.103261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.103265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.103267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.103278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.103290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.103312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.103471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.103485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.103502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.103578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 36 sessionId: src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0
2025-10-02T09:28:48.104355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e934b4-accf7147-50e99f4c-8294365f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.107501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Write session: try to update token
2025-10-02T09:28:48.107518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:48.119850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:48.119866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.119873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.119921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.119941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:48.120101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:48.120254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.120473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.120743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.120976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:48.121024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:48.125404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:48.125422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.125424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:48.125425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:48.125434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.125438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.125442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553985449478689:3464]
2025-10-02T09:28:48.125478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:48.125484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.125486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:48.125504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:48.125511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:48.125515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:48.125618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:48.134469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.137506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.160848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553985524997983:3694]
2025-10-02T09:28:48.161920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7556553985524997983:3694]
2025-10-02T09:28:48.275842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:48.275865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553985524997983:3694]
2025-10-02T09:28:48.275887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:48.275889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:48.276244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:48.276254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Write session will restart in 0.006817s
2025-10-02T09:28:48.276274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Write session: Do CDS request
2025-10-02T09:28:48.276281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:48.275944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: error at write: Disconnected sessionId: src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0
2025-10-02T09:28:48.276113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0 is DEAD
2025-10-02T09:28:48.275135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:48.275577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.275584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.275601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524997983:3694], now have 1 active actors on pipe
2025-10-02T09:28:48.275873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:48.284246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.284570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.284585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-10-02T09:28:48.285171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.285207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:48.285213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.285217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.285692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-10-02T09:28:48.285727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.285734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.285736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.285741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553985524998024:3812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.286239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553985524998024:3812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.291022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553985524998024:3812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.297729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553985524998024:3812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.297749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553985524998024:3812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:48.297753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553985524998024:3812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.297761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.318095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:48.322344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:48.322562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:48.322574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:48.322587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:48.322647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:48.322694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553985449479005:3479]
2025-10-02T09:28:48.323354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:48.323704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:48.323750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:48.324069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:48.324147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.324154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.324155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.324156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.324158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.324159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.324160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.324161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.324163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.324164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.324165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.324166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.324171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.324183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.324187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.324192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.324196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.324201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.324205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.324208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.324212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.324216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.324220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.324224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.324231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.324239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.324245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.324250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.324255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.324261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.324265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.324270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.324275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.324282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.324286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.324291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.324301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.324306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.324311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.324316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.324320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.324326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.324330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.324335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.324340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.324349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.324354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.324359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.324395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:48.335950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:48.337990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:48.338005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:48.338007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:48.338011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:48.338017Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [2:7556553985449479005:3479]
2025-10-02T09:28:48.338030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:48.338046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:48.338049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.338052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.338054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.338069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:48.338074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:48.338081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:48.338137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.338148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.338149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.338152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:48.338155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:48.338225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:48.338231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.338245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.338261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.338414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 220
2025-10-02T09:28:48.338444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 220
2025-10-02T09:28:48.338280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:48.338299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.338301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.338306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.338312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:48.338326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:48.338327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998137:3812], now have 1 active actors on pipe
2025-10-02T09:28:48.338329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:48.338332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:48.338332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998010:2446], now have 1 active actors on pipe
2025-10-02T09:28:48.338339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:48.338353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:48.338355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:48.338390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.338401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:48.338429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:48.338581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.338586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.338610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:48.338617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.338625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.338628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.338637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.338646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.338659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.338807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.338819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.338852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.338974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 36 sessionId: src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0
2025-10-02T09:28:48.339347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbec616-59af93cc-f657d1a-fe8a6e10_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.342880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Write session: try to update token
2025-10-02T09:28:48.342905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:48.351115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:48.351154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.351163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.351208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.351388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:48.351536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.351677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.351815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.352002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:48.352033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:48.352101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:48.363946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.366526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.364869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:48.364886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.364888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:48.364890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:48.364901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.364906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.364910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553985449479000:3479]
2025-10-02T09:28:48.364952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:48.364960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.364962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:48.365117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:48.366828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:48.366833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:48.366836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:48.375856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553985524998303:3694]
2025-10-02T09:28:48.376092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7556553985524998303:3694]
2025-10-02T09:28:48.510589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:48.511081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.511095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.511113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998303:3694], now have 1 active actors on pipe
2025-10-02T09:28:48.511369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:48.511347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553985524998303:3694]
2025-10-02T09:28:48.511363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:48.511367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:48.511374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:48.511435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: error at write: Disconnected sessionId: src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0
2025-10-02T09:28:48.511617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0 is DEAD
2025-10-02T09:28:48.511864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:48.511875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Write session will restart in 0.008838s
2025-10-02T09:28:48.511899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Write session: Do CDS request
2025-10-02T09:28:48.511905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:48.522287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.523070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.523086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-10-02T09:28:48.523187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.523213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:48.523218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.523222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.523629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-10-02T09:28:48.523665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.523667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.523671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.523677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553985524998334:3817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.524183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553985524998334:3817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.527576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553985524998334:3817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.531114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553985524998334:3817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.531129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553985524998334:3817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:48.531133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553985524998334:3817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.531152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.534360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:48.535778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:48.535953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:48.535961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:48.535970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:48.536013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:48.536054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553985449479293:3482]
2025-10-02T09:28:48.536645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:48.537044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:48.537304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:48.537636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:48.537710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.537718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.537719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.537720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.537721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.537722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.537724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.537725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.537726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.537728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.537729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.537730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.537735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.537747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.537751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.537755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.537759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.537762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.537766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.537770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.537774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.537778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.537782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.537786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.537792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.537799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.537804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.537810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.537814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.537819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.537835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.537841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.537845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.537850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.537856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.537861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.537865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.537871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.537875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.537881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.537893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.537898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.537902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.537907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.537914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.537920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.537930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.537935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.537970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:48.547460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:48.549480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:48.549492Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:48.549495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:48.549498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:48.549504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [2:7556553985449479293:3482]
2025-10-02T09:28:48.549517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:48.549530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:48.549532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.549533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.549535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.549546Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:48.549549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:48.549554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:48.549598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.549604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.549606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.549608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:48.549609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:48.549656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:48.549663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.549672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.549678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.549687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:48.549701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.549703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.549705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.549712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:48.549723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:48.549726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998500:3817], now have 1 active actors on pipe
2025-10-02T09:28:48.549729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998304:2446], now have 1 active actors on pipe
2025-10-02T09:28:48.549732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:48.549734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:48.549736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:48.549746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:48.549748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:48.549777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.549789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:48.549819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:48.549825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 221
2025-10-02T09:28:48.549830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 221
2025-10-02T09:28:48.549914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.549924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.549950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:48.549963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.549966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.549968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.549978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.549991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.550009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.550222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.550232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.550248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.551041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 36 sessionId: src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0
2025-10-02T09:28:48.551428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270ce69-3b894c92-c1f3d889-a5a130e2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.554608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Write session: try to update token
2025-10-02T09:28:48.554622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:48.562947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:48.562969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.562972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:48.562974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:48.562983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.562987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.562990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553985449479288:3482]
2025-10-02T09:28:48.563026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:48.563033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.563035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:48.563033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:48.563041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:48.563045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:48.563230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:48.568899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.571474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.611382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553985524998588:3694]
2025-10-02T09:28:48.617113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7556553985524998588:3694]
2025-10-02T09:28:48.713552Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:48.713924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.713941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.713977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998588:3694], now have 1 active actors on pipe
2025-10-02T09:28:48.714257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:48.714275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:48.714271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:48.714333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: error at write: Disconnected sessionId: src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0
2025-10-02T09:28:48.714522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0 is DEAD
2025-10-02T09:28:48.714667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:48.714678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Write session will restart in 0.009769s
2025-10-02T09:28:48.714699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Write session: Do CDS request
2025-10-02T09:28:48.714706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:48.714694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:48.714711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553985524998588:3694]
2025-10-02T09:28:48.725475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.725626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.725639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-10-02T09:28:48.725792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.725828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:48.725837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.725841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.726390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-10-02T09:28:48.726427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.726433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.726435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.726442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553985524998655:3822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.726987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553985524998655:3822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.729601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553985524998655:3822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.732478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553985524998655:3822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.732492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553985524998655:3822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:48.732496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553985524998655:3822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.732504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.733893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:48.735236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:48.735418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:48.735427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:48.735436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:48.735495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:48.735531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553985449479572:3484]
2025-10-02T09:28:48.736092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:48.736441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:48.736502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:48.736847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:48.736915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.736922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.736923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.736924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.736925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.736926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.736927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.736928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.736929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.736929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.736930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.736931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.736936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.736947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.736951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.736954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.736957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.736961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.736964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.736968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.736971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.736975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.736978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.736982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.736988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.736995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.737000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.737005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.737009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.737014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.737018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.737022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.737026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.737030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.737034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.737038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.737041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.737045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.737049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.737053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.737057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.737062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.737066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.737070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.737073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.737078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.737088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.737092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.737120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:48.746277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:48.747982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:48.747996Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:48.747999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:48.748003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:48.748014Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [2:7556553985449479572:3484]
2025-10-02T09:28:48.748030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:48.748047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:48.748050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.748053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.748055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.748071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:48.748080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:48.748090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:48.748494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.748506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.748508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.748511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:48.748514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:48.748585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:48.748595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.748608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.748618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.748635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:48.748656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.748662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.748664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.748678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:48.748695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:48.748712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:48.748719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:48.748733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:48.748736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:48.748738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:48.748753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.748757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:48.748798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:48.748868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998858:3822], now have 1 active actors on pipe
2025-10-02T09:28:48.748880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998594:2446], now have 1 active actors on pipe
2025-10-02T09:28:48.748966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 222
2025-10-02T09:28:48.748969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 222
2025-10-02T09:28:48.749065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.749081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.749109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:48.749121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.749129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.749131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.749142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.749163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.749178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.749334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.749342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.749354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.749461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 36 sessionId: src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0
2025-10-02T09:28:48.749770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|996b0532-b8125fea-5af6f1e7-5f30701b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.753009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Write session: try to update token
2025-10-02T09:28:48.753032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:48.761951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:48.761969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.761977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.762023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:48.762026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:48.762229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:48.762392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.762542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.762701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:48.762903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:48.762940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:48.770976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.772230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:48.772246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.772250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:48.772252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:48.772260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.772265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.772269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553985449479567:3484]
2025-10-02T09:28:48.772305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:48.772311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.772310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:48.772313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:48.772316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:48.772320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:48.772444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:48.773571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:48.814123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553985524998883:3694]
2025-10-02T09:28:48.814363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7556553985524998883:3694]
2025-10-02T09:28:48.913137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:48.913624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.913634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.913646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998883:3694], now have 1 active actors on pipe
2025-10-02T09:28:48.913871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:48.913914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:48.913920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553985524998883:3694]
2025-10-02T09:28:48.913940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:48.913995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0
2025-10-02T09:28:48.914114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0 is DEAD
2025-10-02T09:28:48.914219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:48.914227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Write session will restart in 0.008693s
2025-10-02T09:28:48.914248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Write session: Do CDS request
2025-10-02T09:28:48.914253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:48.924201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.924303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:48.924318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-10-02T09:28:48.924425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:48.924455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:48.924459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:48.924462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:48.924897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-10-02T09:28:48.924930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:48.924936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:48.924938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:48.924942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553985524998978:3826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:48.925463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553985524998978:3826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:48.928261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553985524998978:3826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:48.930469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:48.930925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553985524998978:3826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:48.930938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553985524998978:3826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:48.930941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553985524998978:3826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:48.930947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:48.931867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:48.932014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:48.932023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:48.932029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:48.932066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:48.932101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553985449479852:3487]
2025-10-02T09:28:48.932470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:48.932728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:48.932769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:48.933094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:48.933152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.933158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.933159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.933159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.933161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.933161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.933163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.933163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.933164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.933165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.933166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.933167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.933172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.933181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.933185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.933188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.933192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.933196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.933199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.933203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.933208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.933212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.933219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.933222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.933232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.933241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:48.933250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.933258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:48.933267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.933276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:48.933283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.933287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:48.933293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.933296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:48.933298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.933301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:48.933304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.933307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:48.933309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.933312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:48.933314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.933317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:48.933322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.933326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.933328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.933330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.933333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.933338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.933358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:48.941696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:48.943223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:48.943234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:48.943238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:48.943241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:48.943247Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [2:7556553985449479852:3487]
2025-10-02T09:28:48.943262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:48.943279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:48.943286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.943289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.943291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.943305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:48.943313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:48.943319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:48.943377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.943383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.943385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.943388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:48.943390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:48.943585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 223
2025-10-02T09:28:48.943586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 223
2025-10-02T09:28:48.943743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:48.943750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.943763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:48.943775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:48.943796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:48.943817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524998886:2446], now have 1 active actors on pipe
2025-10-02T09:28:48.943824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553985524999160:3826], now have 1 active actors on pipe
2025-10-02T09:28:48.943836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.943843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.943860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.943866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.943868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.943880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:48.943896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:48.943897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:48.943905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:48.943907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:48.943910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:48.943912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:48.943925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:48.943935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:48.943938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:48.943940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:48.943947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:48.943960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:48.943993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.944003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:48.944012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.944013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:48.944201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:48.944208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:48.944221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:48.944308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 36 sessionId: src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0
2025-10-02T09:28:48.944617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b39b5d-d4f629e2-eded6779-e6467f36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:48.947560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Write session: try to update token
2025-10-02T09:28:48.947576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:48.954339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:48.954354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:48.954356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:48.954359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:48.954366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.954371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.954375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553985449479846:3487]
2025-10-02T09:28:48.954408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:48.954415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:48.954420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:48.954430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:48.954436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:48.954440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:48.954545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:48.960462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:48.963280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:49.013831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553989819966467:3694]
2025-10-02T09:28:49.014135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7556553989819966467:3694]
2025-10-02T09:28:49.084183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:49.084594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.084605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.084620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819966467:3694], now have 1 active actors on pipe
2025-10-02T09:28:49.084759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:49.084838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:49.084849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:49.084887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553989819966467:3694]
2025-10-02T09:28:49.084918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0
2025-10-02T09:28:49.085082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0 is DEAD
2025-10-02T09:28:49.085199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:49.085208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Write session will restart in 0.009940s
2025-10-02T09:28:49.085225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Write session: Do CDS request
2025-10-02T09:28:49.085228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:49.096153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.096333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:49.096346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-10-02T09:28:49.096497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.096527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:49.096537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:49.096541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:49.096984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-10-02T09:28:49.097020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:49.097026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:49.097028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:49.097032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553989819966620:3831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:49.097505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553989819966620:3831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:49.099659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553989819966620:3831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:49.100515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:49.101506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:49.101657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:49.101667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:49.101676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:49.101723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:49.101756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553989744447428:3490]
2025-10-02T09:28:49.101759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553989819966620:3831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:49.101772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553989819966620:3831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:49.101779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553989819966620:3831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:49.101784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:49.102289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:49.102544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:49.102584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:49.102861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:49.102924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.102931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.102932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.102932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.102934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.102935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.102936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.102937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.102938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.102938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.102939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.102940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.102945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.102954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.102957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.102960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.102963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.102966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.102970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.102973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.102977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.102981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.102986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.102989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.102995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.103005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.103011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.103015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.103023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.103028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.103035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.103040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.103048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.103052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.103060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.103064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.103070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.103075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.103083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.103087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.103095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.103099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.103106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.103110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.103115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.103119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.103125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.103129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.103176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:49.111705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:49.113422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:49.113441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:49.113443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:49.113447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:49.113453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [2:7556553989744447428:3490]
2025-10-02T09:28:49.113467Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:49.113484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:49.113492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.113495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.113497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.113513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:49.113522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:49.113530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:49.113589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.113598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.113600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.113604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:49.113606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:49.113680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:49.113689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.113701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.113710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.113728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:49.113752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819966747:3831], now have 1 active actors on pipe
2025-10-02T09:28:49.113760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819966469:2446], now have 1 active actors on pipe
2025-10-02T09:28:49.113766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.113768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.113770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.113782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:49.113795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:49.113806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:49.113809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:49.113811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:49.113813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:49.113817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:49.113816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 224
2025-10-02T09:28:49.113847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.113856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:49.113822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 224
2025-10-02T09:28:49.113858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:49.113871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.113875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.113920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aed88d2-82845b03-6526256-76252a31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:49.113939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.113947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.113949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:49.113956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.113965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:49.113985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.114153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.114172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.114195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.114278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 36 sessionId: src_id|6aed88d2-82845b03-6526256-76252a31_0
2025-10-02T09:28:49.114627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381a1d0d-7cef1b2b-135ba3af-30e79bd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6aed88d2-82845b03-6526256-76252a31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:49.117687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Write session: try to update token
2025-10-02T09:28:49.117706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:49.124068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:49.124080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.124083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:49.124084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:49.124092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.124096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.124099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553989744447423:3490]
2025-10-02T09:28:49.124131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:49.124137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.124137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:49.124140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:49.124143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:49.124146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:49.124261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:49.133055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|6aed88d2-82845b03-6526256-76252a31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:49.135394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:49.184962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553989819966758:3694]
2025-10-02T09:28:49.185278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7556553989819966758:3694]
2025-10-02T09:28:49.265228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:49.265786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.265797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.265810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819966758:3694], now have 1 active actors on pipe
2025-10-02T09:28:49.265952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:49.266022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553989819966758:3694]
2025-10-02T09:28:49.266036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:49.266064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:49.266110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6aed88d2-82845b03-6526256-76252a31_0
2025-10-02T09:28:49.266305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|6aed88d2-82845b03-6526256-76252a31_0 is DEAD
2025-10-02T09:28:49.266433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:49.266443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Write session will restart in 0.007879s
2025-10-02T09:28:49.266466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Write session: Do CDS request
2025-10-02T09:28:49.266473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:49.275312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.275416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:49.275431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-10-02T09:28:49.275862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.275898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:49.275904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:49.275908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:49.276394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-10-02T09:28:49.276422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:49.276429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:49.276430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:49.276436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553989819966835:3842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:49.276947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553989819966835:3842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:49.279246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553989819966835:3842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:49.282071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553989819966835:3842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:49.282087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553989819966835:3842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:49.282090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553989819966835:3842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:49.282096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:49.283889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:49.285359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:49.285520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:49.285532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:49.285541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:49.285594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:49.285648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553989744447745:3504]
2025-10-02T09:28:49.286267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:49.286570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:49.286608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:49.286913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:49.286966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.286972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.286972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.286973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.286974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.286976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.286977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.286978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.286979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.286980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.286981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.286982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.286987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.286997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.287001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.287005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.287009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.287012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.287016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.287019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.287023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.287027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.287030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.287034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.287040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.287047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.287052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.287057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.287061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.287066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.287071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.287080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.287084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.287089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.287093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.287097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.287101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.287106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.287111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.287120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.287124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.287129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.287133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.287138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.287151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.287156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.287165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.287170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.287207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:49.296017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:49.298339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:49.298352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:49.298355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:49.298359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:49.298366Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [2:7556553989744447745:3504]
2025-10-02T09:28:49.298380Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:49.298398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:49.298401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.298404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.298405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.298419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:49.298427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:49.298438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:49.298498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.298505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.298507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.298510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:49.298513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:49.298589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:49.298598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.298615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.298626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.298643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:49.298661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819966785:2446], now have 1 active actors on pipe
2025-10-02T09:28:49.298670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967035:3842], now have 1 active actors on pipe
2025-10-02T09:28:49.298676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.298678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.298680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.298692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:49.298706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:49.298721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:49.298727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:49.298764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.298746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 225
2025-10-02T09:28:49.298772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:49.298755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 225
2025-10-02T09:28:49.298788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:49.298792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:49.298794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:49.298800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:49.298909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.298918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.298941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:49.298947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.298950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.298952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:49.298960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.298969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:49.298981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.299155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.299167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.299191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.299295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 36 sessionId: src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0
2025-10-02T09:28:49.299648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aed88d2-82845b03-6526256-76252a31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:49.302823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Write session: try to update token
2025-10-02T09:28:49.302842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:49.315444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:49.315467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.315480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.315533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:49.315556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:49.315725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:49.315881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.316061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.316218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.316417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:49.316467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:49.318978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:49.320124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:49.320143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.320145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:49.320148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:49.320158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.320163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.320168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553989744447740:3504]
2025-10-02T09:28:49.320207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:49.320219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.320221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:49.320367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:49.320740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:49.320752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:49.320756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:49.321517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:49.366060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553989819967082:3694]
2025-10-02T09:28:49.366319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7556553989819967082:3694]
2025-10-02T09:28:49.463257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:49.463629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.463643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.463661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967082:3694], now have 1 active actors on pipe
2025-10-02T09:28:49.463856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:49.463887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553989819967082:3694]
2025-10-02T09:28:49.463899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:49.463920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:49.463996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0
2025-10-02T09:28:49.464171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0 is DEAD
2025-10-02T09:28:49.464322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:49.464331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Write session will restart in 0.006245s
2025-10-02T09:28:49.464354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Write session: Do CDS request
2025-10-02T09:28:49.464360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:49.471431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:49.471485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.471459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-10-02T09:28:49.471820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.471857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:49.471863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:49.471872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:49.472271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-10-02T09:28:49.472304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:49.472306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:49.472308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:49.472313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553989819967099:3847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:49.472781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553989819967099:3847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:49.475104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553989819967099:3847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:49.478299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553989819967099:3847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:49.478314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553989819967099:3847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:49.478317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553989819967099:3847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:49.478324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:49.483178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:49.484589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:49.484745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:49.484754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:49.484762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:49.484820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:49.484858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553989744448038:3507]
2025-10-02T09:28:49.485379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:49.485692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:49.485757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:49.486066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:49.486113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.486118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.486118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.486119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.486120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.486121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.486122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.486123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.486124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.486125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.486127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.486128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.486132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.486143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.486146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.486150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.486154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.486158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.486160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.486162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.486164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.486166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.486168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.486170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.486174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.486179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.486183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.486186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.486189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.486192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.486195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.486198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.486202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.486207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.486211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.486220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.486224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.486229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.486233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.486238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.486242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.486247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.486251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.486255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.486257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.486260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.486263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.486265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.486291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:49.495391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:49.497576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:49.497590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:49.497593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:49.497597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:49.497602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [2:7556553989744448038:3507]
2025-10-02T09:28:49.497615Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:49.497633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:49.497635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.497638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.497639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.497650Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:49.497660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:49.497668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:49.497726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.497732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.497734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.497737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:49.497740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:49.497803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:49.497810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.497823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.497838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.497859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:49.497880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967084:2446], now have 1 active actors on pipe
2025-10-02T09:28:49.497887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967235:3847], now have 1 active actors on pipe
2025-10-02T09:28:49.497893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.497895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.497897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.497910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:49.497922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:49.497925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:49.497932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:49.497934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:49.497938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:49.497941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:49.497966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.497972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:49.497973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:49.497957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 226
2025-10-02T09:28:49.498006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 226
2025-10-02T09:28:49.498071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.498078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.498093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49297363-950149fc-ee3f6801-183bf7f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:49.498100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.498103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.498104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:49.498110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.498120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:49.498136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.498296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.498311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.498332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.498423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 36 sessionId: src_id|49297363-950149fc-ee3f6801-183bf7f8_0
2025-10-02T09:28:49.498843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7816e9c3-f9c26116-c3bb1bc0-78caf3b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49297363-950149fc-ee3f6801-183bf7f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:49.501780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Write session: try to update token
2025-10-02T09:28:49.501803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:49.508761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:49.508780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.508782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:49.508783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:49.508791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.508795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.508799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553989744448033:3507]
2025-10-02T09:28:49.508851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:49.508857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.508859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:49.508865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:49.508872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:49.508876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:49.508994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:49.518722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|49297363-950149fc-ee3f6801-183bf7f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:49.521209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:49.564231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553989819967373:3694]
2025-10-02T09:28:49.564506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7556553989819967373:3694]
2025-10-02T09:28:49.652243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:49.652725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.652740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.652757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967373:3694], now have 1 active actors on pipe
2025-10-02T09:28:49.653013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:49.653408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:49.653439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:49.653470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553989819967373:3694]
2025-10-02T09:28:49.653509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49297363-950149fc-ee3f6801-183bf7f8_0
2025-10-02T09:28:49.653721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|49297363-950149fc-ee3f6801-183bf7f8_0 is DEAD
2025-10-02T09:28:49.657080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:49.657098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Write session will restart in 0.007983s
2025-10-02T09:28:49.657134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Write session: Do CDS request
2025-10-02T09:28:49.657141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:49.666478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.666588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:49.666605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-10-02T09:28:49.666854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.666891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:49.666900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:49.666904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:49.667810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-10-02T09:28:49.667844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:49.667846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:49.667848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:49.667853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553989819967391:3851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:49.668342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553989819967391:3851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:49.670835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553989819967391:3851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:49.675099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553989819967391:3851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:49.675115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553989819967391:3851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:49.675119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553989819967391:3851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:49.675128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:49.680335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:49.681811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:49.682239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:49.682252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:49.682264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:49.682325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:49.682367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553989744448320:3509]
2025-10-02T09:28:49.682975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:49.683293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:49.683341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:49.683709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:49.683765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.683771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.683772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.683773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.683775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.683776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.683777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.683778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.683779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.683781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.683782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.683783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.683789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.683803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.683808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.683814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.683818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.683824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.683829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.683833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.683839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.683848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.683853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.683863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.683870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.683879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.683893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.683901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.683907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.683913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.683919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.683925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.683932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.683939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.683949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.683956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.683961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.683971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.683977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.683983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.683990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.683997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.684002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.684009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.684014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.684021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.684027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.684034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.684079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:49.692920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:49.694827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:49.694841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:49.694843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:49.694846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:49.694852Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [2:7556553989744448320:3509]
2025-10-02T09:28:49.694862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:49.694877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:49.694878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.694881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.694882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.694895Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:49.694898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:49.694904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:49.694948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.694955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.694956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.694958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:49.694960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:49.695009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:49.695015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.695026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.695036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.695045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:49.695057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.695065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.695066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.695071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:49.695081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:49.695083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:49.695084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:49.695086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:49.695091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:49.695093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:49.695100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967375:2446], now have 1 active actors on pipe
2025-10-02T09:28:49.695102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967537:3851], now have 1 active actors on pipe
2025-10-02T09:28:49.695126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.695133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:49.695169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:49.695179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 227
2025-10-02T09:28:49.695181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 227
2025-10-02T09:28:49.695239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.695247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.695271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:49.695281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.695284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.695286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:49.695294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.695302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:49.695319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.695448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.695454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.695465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.695532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 36 sessionId: src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0
2025-10-02T09:28:49.695867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49297363-950149fc-ee3f6801-183bf7f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:49.699325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Write session: try to update token
2025-10-02T09:28:49.699341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:49.705955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:49.705976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.705985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.706030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:49.706041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:49.706226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:49.706381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.706537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.706731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.706950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:49.706990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:49.713851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:49.716181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:49.716206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.716208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:49.716209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:49.716216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.716219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.716222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553989744448315:3509]
2025-10-02T09:28:49.716251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:49.716257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.716258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:49.716277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:49.716282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:49.716286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:49.716386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:49.716987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:49.753653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553989819967675:3694]
2025-10-02T09:28:49.753916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7556553989819967675:3694]
2025-10-02T09:28:49.862154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:49.862508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.862528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.862550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967675:3694], now have 1 active actors on pipe
2025-10-02T09:28:49.862779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:49.862882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:49.862957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553989819967675:3694]
2025-10-02T09:28:49.862979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:49.862983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:49.863043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0
2025-10-02T09:28:49.863249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0 is DEAD
2025-10-02T09:28:49.865034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:49.865046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Write session will restart in 0.006859s
2025-10-02T09:28:49.865070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Write session: Do CDS request
2025-10-02T09:28:49.865076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:49.873342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.873451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:49.873470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-10-02T09:28:49.873589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:49.873644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:49.873650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:49.873659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:49.874165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-10-02T09:28:49.874212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:49.874214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:49.874215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:49.874222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553989819967709:3856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:49.874758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553989819967709:3856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:49.879586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553989819967709:3856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:49.882607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553989819967709:3856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:49.882624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553989819967709:3856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:49.882627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553989819967709:3856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:49.882634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:49.885408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:49.887118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:49.887322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:49.887331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:49.887340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:49.887384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:49.887420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553989744448608:3512]
2025-10-02T09:28:49.888008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:49.888310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:49.888350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:49.888634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:49.888689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.888694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.888695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.888696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.888697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.888698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.888699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.888701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.888701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.888702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.888703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.888704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.888709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.888718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.888722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.888726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.888730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.888733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.888736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.888740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.888743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.888747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.888751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.888755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.888761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.888767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:49.888773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.888777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:49.888781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.888785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:49.888789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.888793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:49.888797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.888820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:49.888824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.888829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:49.888833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.888838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:49.888842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.888846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:49.888851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.888855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:49.888858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.888864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.888873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.888877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.888881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.888886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.888922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:49.898002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:49.899964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:49.899981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:49.899983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:49.899986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:49.899992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [2:7556553989744448608:3512]
2025-10-02T09:28:49.900005Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:49.900023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:49.900026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.900028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.900030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.900042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:49.900048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:49.900054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:49.900112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.900118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.900120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.900123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:49.900125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:49.900188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:49.900196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.900213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:49.900225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:49.900240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:49.900261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967681:2446], now have 1 active actors on pipe
2025-10-02T09:28:49.900272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967908:3856], now have 1 active actors on pipe
2025-10-02T09:28:49.900278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.900280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.900283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.900295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:49.900307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:49.900309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:49.900312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:49.900315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:49.900319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:49.900322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:49.900357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.900365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:49.900341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 228
2025-10-02T09:28:49.900354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 228
2025-10-02T09:28:49.900373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:49.900398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.900416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.900449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa860604-365359a3-d36010c7-4f330710_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:49.900459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:49.900466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:49.900468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:49.900478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:49.900489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:49.900506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.900646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:49.900654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:49.900666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:49.900745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa860604-365359a3-d36010c7-4f330710_0
2025-10-02T09:28:49.901129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d877339c-1c57ff93-25e00127-46a2e1c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa860604-365359a3-d36010c7-4f330710_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:49.904417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Write session: try to update token
2025-10-02T09:28:49.904437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:49.911208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:49.911226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.911234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.911269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:49.911272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:49.911451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:49.911606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.911760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.911912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:49.912107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:49.912149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:49.919970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|aa860604-365359a3-d36010c7-4f330710_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:49.921411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:49.921430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:49.921432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:49.921434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:49.921441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.921445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.921448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553989744448602:3512]
2025-10-02T09:28:49.921487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:49.921492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:49.921495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:49.921496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:49.921497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:49.921499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:49.921669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:49.922733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:49.963062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553989819967971:3694]
2025-10-02T09:28:49.963314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7556553989819967971:3694]
2025-10-02T09:28:50.070729Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:50.071312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.071326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.071341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553989819967971:3694], now have 1 active actors on pipe
2025-10-02T09:28:50.071530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:50.071615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:50.071671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553989819967971:3694]
2025-10-02T09:28:50.071692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:50.071762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa860604-365359a3-d36010c7-4f330710_0
2025-10-02T09:28:50.071934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|aa860604-365359a3-d36010c7-4f330710_0 is DEAD
2025-10-02T09:28:50.072146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:50.072165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Write session will restart in 0.005069s
2025-10-02T09:28:50.072198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Write session: Do CDS request
2025-10-02T09:28:50.072205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:50.078272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.078633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:50.078649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-10-02T09:28:50.078795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.078825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:50.078834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:50.078838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:50.079340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-10-02T09:28:50.079374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:50.079380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:50.079381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:50.079386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553994114935284:3860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:50.079876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553994114935284:3860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:50.082360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553994114935284:3860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:50.086260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553994114935284:3860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:50.086273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553994114935284:3860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:50.086276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553994114935284:3860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:50.086283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:50.090426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:50.091743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:50.091873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:50.091880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:50.091889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:50.092289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:50.092338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553994039416195:3514]
2025-10-02T09:28:50.092820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:50.093055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:50.093099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:50.093402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:50.093459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.093464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.093466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.093467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.093468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.093469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.093470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.093471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.093473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.093474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.093475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.093476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.093481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.093491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.093494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.093498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.093502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.093506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.093510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.093513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.093517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.093520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.093524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.093528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.093534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.093541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.093545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.093550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.093556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.093561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.093566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.093571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.093582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.093587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.093594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.093600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.093606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.093616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.093620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.093625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.093629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.093633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.093638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.093642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.093651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.093656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.093664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.093668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.093700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:50.102062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:50.104171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:50.104191Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:50.104193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:50.104197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:50.104204Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [2:7556553994039416195:3514]
2025-10-02T09:28:50.104220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:50.104238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:50.104242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.104245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.104247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.104262Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:50.104268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:50.104274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:50.104335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.104347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.104350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.104353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:50.104355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:50.104424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:50.104432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.104447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.104459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.104482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:50.104502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.104511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.104513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.104527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:50.104544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:50.104562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:50.104569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:50.104579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:50.104599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:50.104603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.104606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:50.104606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:50.104612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:50.104829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 229
2025-10-02T09:28:50.104839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 229
2025-10-02T09:28:50.105429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0
2025-10-02T09:28:50.105771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa860604-365359a3-d36010c7-4f330710_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:50.104751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935442:3860], now have 1 active actors on pipe
2025-10-02T09:28:50.104763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935270:2446], now have 1 active actors on pipe
2025-10-02T09:28:50.105054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.105064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.105095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:50.105103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.105107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.105109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:50.105119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.105130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:50.105145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.105334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.105337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.105352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.109024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Write session: try to update token
2025-10-02T09:28:50.109042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:50.116182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:50.116196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:50.116198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:50.116199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:50.116208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.116212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.116218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553994039416185:3514]
2025-10-02T09:28:50.116255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:50.116262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.116264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:50.116264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:50.116268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:50.116273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:50.116417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:50.128446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:50.131106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:50.171972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553994114935566:3694]
2025-10-02T09:28:50.172276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7556553994114935566:3694]
2025-10-02T09:28:50.258622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:50.258940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.258957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.258975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935566:3694], now have 1 active actors on pipe
2025-10-02T09:28:50.259164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:50.259198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:50.259215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:50.259273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: error at write: Disconnected sessionId: src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0
2025-10-02T09:28:50.259456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0 is DEAD
2025-10-02T09:28:50.259594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:50.259605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Write session will restart in 0.006062s
2025-10-02T09:28:50.259625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Write session: Do CDS request
2025-10-02T09:28:50.259631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:50.259622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:50.259665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553994114935566:3694]
2025-10-02T09:28:50.267304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.267408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:50.267662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:50.267679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-10-02T09:28:50.267783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.267815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:50.267824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:50.267827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:50.268195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-10-02T09:28:50.268231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:50.268233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:50.268234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:50.268240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553994114935601:3871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:50.268745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553994114935601:3871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:50.269156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:50.269395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:50.269407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:50.269421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:50.269492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:50.269538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553994039416269:3523]
2025-10-02T09:28:50.270118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:50.270597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:50.270656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:50.270978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:50.271058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.271420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553994114935601:3871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:50.271068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.271069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.271070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.271071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.271072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.271073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.271074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.271075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.271076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.271077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.271078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.271084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.271095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.271100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.271103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.271107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.271110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.271114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.271117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.271121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.271125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.271128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.271132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.271149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.271157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.271163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.271168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.271172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.271177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.271181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.271186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.271190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.271195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.271198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.271203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.271207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.271211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.271215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.271219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.271223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.271226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.271230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.271235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.271239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.271247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.271251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.271257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.271292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:50.278436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553994114935601:3871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:50.278454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553994114935601:3871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:50.278461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553994114935601:3871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:50.278469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:50.285778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:50.287612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:50.287633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:50.287636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:50.287639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:50.287645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [2:7556553994039416269:3523]
2025-10-02T09:28:50.287660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:50.287676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:50.287678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.287681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.287683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.287698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:50.287703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:50.287710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:50.287771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.287779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.287782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.287785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:50.287787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:50.287853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:50.287860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.287875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.287885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.287905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:50.287922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.287924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.287926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.287932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:50.287944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:50.287963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:50.287967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:50.288001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:50.288004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.288007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:50.288011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:50.288014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:50.288032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:50.289120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 230
2025-10-02T09:28:50.289154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 230
2025-10-02T09:28:50.292847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935639:3871], now have 1 active actors on pipe
2025-10-02T09:28:50.292867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935582:2446], now have 1 active actors on pipe
2025-10-02T09:28:50.292885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.292892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.292925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:50.292942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.292951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.292955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:50.292967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.292981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:50.293006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.293252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.293273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.293291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.293400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0
2025-10-02T09:28:50.293762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9a74e3-168f81c4-13c603a8-8b43acce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:50.296849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Write session: try to update token
2025-10-02T09:28:50.296868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:50.299773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:50.299794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:50.299796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:50.299797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:50.299804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.299808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.299812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553994039416264:3523]
2025-10-02T09:28:50.299844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:50.299847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:50.299849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:50.299852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:50.299853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.299855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:50.299988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:50.313497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:50.316090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:50.359880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553994114935671:3694]
2025-10-02T09:28:50.360198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7556553994114935671:3694]
2025-10-02T09:28:50.444168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:50.444532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.444545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.444580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935671:3694], now have 1 active actors on pipe
2025-10-02T09:28:50.444750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:50.444790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553994114935671:3694]
2025-10-02T09:28:50.444796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:50.444812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:50.444827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:50.444860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: error at write: Disconnected sessionId: src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0
2025-10-02T09:28:50.445021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0 is DEAD
2025-10-02T09:28:50.445144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:50.445152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Write session will restart in 0.006409s
2025-10-02T09:28:50.445171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Write session: Do CDS request
2025-10-02T09:28:50.445175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:50.451111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:50.452294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.452414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:50.452428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-10-02T09:28:50.452511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:50.452643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.452684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:50.452689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:50.452697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:50.452685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:50.452696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:50.452706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:50.452764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:50.452822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553994039416362:3532]
2025-10-02T09:28:50.453086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-10-02T09:28:50.453115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:50.453119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:50.453120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:50.453124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553994114935692:3877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:50.453363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:50.453555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553994114935692:3877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:50.453669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:50.453720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:50.454078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:50.454147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.454157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.454158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.454161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.454162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.454162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.454164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.454165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.454166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.454167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.454169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.454170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.454175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.454184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.454188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.454190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.454193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.454199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.454203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.454206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.454210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.454213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.454216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.454222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.454228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.454233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.454238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.454241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.454246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.454250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.454254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.454258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.454263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.454266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.454270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.454274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.454277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.454281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.454285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.454289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.454294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.454297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.454301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.454305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.454310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.454314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.454318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.454352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:50.455234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553994114935692:3877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:50.461128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553994114935692:3877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:50.461140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553994114935692:3877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:50.461143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553994114935692:3877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:50.461148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:50.462822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:50.464638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:50.464654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:50.464657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:50.464660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:50.464665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [2:7556553994039416362:3532]
2025-10-02T09:28:50.464678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:50.464693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:50.464695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.464698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.464700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.464716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:50.464724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:50.464733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:50.464789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.464798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.464826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.464828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:50.464830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:50.464893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:50.464901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.464912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.464922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.464939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:50.464960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935673:2446], now have 1 active actors on pipe
2025-10-02T09:28:50.464967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935730:3877], now have 1 active actors on pipe
2025-10-02T09:28:50.464973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.464975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.464980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.464991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:50.465005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:50.465019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:50.465021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:50.465024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:50.465029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:50.465031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:50.465053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.465060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:50.465024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 231
2025-10-02T09:28:50.465028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 231
2025-10-02T09:28:50.465076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:50.465093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.465097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.465121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:50.465130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.465134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.465135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:50.465143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.465152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:50.465163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.465338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.465350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.465361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.465483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 36 sessionId: src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0
2025-10-02T09:28:50.465814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ce64c4-e804855f-64bc58c-d1ef5f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:50.468856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Write session: try to update token
2025-10-02T09:28:50.468879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:50.475603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:50.475622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:50.475625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:50.475626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:50.475635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.475639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.475643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553994039416357:3532]
2025-10-02T09:28:50.475680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:50.475686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.475691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:50.475694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:50.475700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:50.475704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:50.475822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:50.483044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:50.485505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:50.545175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553994114935739:3694]
2025-10-02T09:28:50.545335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7556553994114935739:3694]
2025-10-02T09:28:50.603708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:50.603989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.603998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.604012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935739:3694], now have 1 active actors on pipe
2025-10-02T09:28:50.604164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:50.604226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:50.604256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553994114935739:3694]
2025-10-02T09:28:50.604280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:50.604344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0
2025-10-02T09:28:50.604504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0 is DEAD
2025-10-02T09:28:50.604672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:50.604683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Write session will restart in 0.005039s
2025-10-02T09:28:50.604703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Write session: Do CDS request
2025-10-02T09:28:50.604708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:50.610064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:50.611246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.611329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:50.611345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:50.611341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-10-02T09:28:50.611454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.611479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:50.611488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:50.611491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:50.611493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:50.611501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:50.611509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:50.611546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:50.611580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553994039416421:3534]
2025-10-02T09:28:50.611845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-10-02T09:28:50.611870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:50.611875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:50.611877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:50.611882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553994114935760:3881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:50.612138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:50.612338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553994114935760:3881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:50.612426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:50.612476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:50.612763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:50.612842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.612848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.612849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.612850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.612851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.612852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.612853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.612854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.612855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.612856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.612857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.612858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.612863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.612872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.612876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.612879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.612882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.612886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.612889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.612892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.612895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.612899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.612902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.612905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.612913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.612919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.612926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.612937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.612944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.612948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.612956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.612961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.612965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.612969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.612972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.612978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.612986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.612991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.612997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.613001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.613005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.613012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.613015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.613024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.613032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.613040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.613047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.613056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.613089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:50.613747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553994114935760:3881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:50.618831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553994114935760:3881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:50.618850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553994114935760:3881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:50.618853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553994114935760:3881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:50.618857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:50.621242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:50.622871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:50.622890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:50.622893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:50.622897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:50.622903Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [2:7556553994039416421:3534]
2025-10-02T09:28:50.622916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:50.622930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:50.622938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.622941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.622945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.622959Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:50.622967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:50.622975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:50.623032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.623040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.623041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.623044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:50.623047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:50.623100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:50.623108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.623119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.623134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.623164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:50.623185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935799:3881], now have 1 active actors on pipe
2025-10-02T09:28:50.623192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935740:2446], now have 1 active actors on pipe
2025-10-02T09:28:50.623198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.623203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.623205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.623218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:50.623208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 232
2025-10-02T09:28:50.623208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 232
2025-10-02T09:28:50.623234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:50.623239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:50.623244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:50.623246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:50.623251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:50.623253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:50.623288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.623295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.623309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.623322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:50.623335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:50.623350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:50.623356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.623359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.623360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:50.623367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.623379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:50.623400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.623502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.623509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.623521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.623619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 36 sessionId: src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0
2025-10-02T09:28:50.623931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2c1c4-af6f9dfd-a79560ee-a2904af9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:50.626866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Write session: try to update token
2025-10-02T09:28:50.626880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:50.633889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:50.633906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:50.633911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:50.633913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:50.633920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.633924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.633927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553994039416416:3534]
2025-10-02T09:28:50.633961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:50.633975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:50.633981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.633984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:50.633987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:50.633991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:50.634187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:50.640150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:50.642600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:50.704407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553994114935807:3694]
2025-10-02T09:28:50.704665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7556553994114935807:3694]
2025-10-02T09:28:50.775838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:50.776204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.776223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.776242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935807:3694], now have 1 active actors on pipe
2025-10-02T09:28:50.776476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:50.776490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:50.776520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:50.776556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: error at write: Disconnected sessionId: src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0
2025-10-02T09:28:50.776574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553994114935807:3694]
2025-10-02T09:28:50.776745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0 is DEAD
2025-10-02T09:28:50.776469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:50.777029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:50.777038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Write session will restart in 0.008972s
2025-10-02T09:28:50.777061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Write session: Do CDS request
2025-10-02T09:28:50.777067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:50.784258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:50.785722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:50.785946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:50.785959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:50.785969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:50.786037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:50.786085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553994039416483:3537]
2025-10-02T09:28:50.786675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:50.787013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:50.787061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:50.787337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.787391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:50.787457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.787465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.787466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.787467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.787468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.787469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.787470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.787472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.787473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.787474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.787475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.787476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.787481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.787492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.787496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.787500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.787503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.787406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:50.787422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-10-02T09:28:50.787507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.787510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.787514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.787519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.787523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.787526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.787570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.787530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.787537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.787544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.787550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.787556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.787560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.787565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.787568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.787574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.787579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.787584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.787588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.787594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.787610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:50.787599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.787621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:50.787626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:50.787605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.787608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.787614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.787618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.787622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.787625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.787639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.787642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.787647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.787650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.787654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.787692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:50.788067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-10-02T09:28:50.788100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:50.788102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:50.788104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:50.788109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553994114935844:3886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:50.788613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553994114935844:3886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:50.791248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553994114935844:3886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:50.796149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553994114935844:3886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:50.796164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553994114935844:3886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:50.796168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553994114935844:3886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:50.796177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:50.796749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:50.798449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:50.798470Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:50.798472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:50.798476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:50.798482Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [2:7556553994039416483:3537]
2025-10-02T09:28:50.798494Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:50.798510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:50.798512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.798516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.798518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.798532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:50.798541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:50.798549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:50.798602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.798608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.798610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.798613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:50.798615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:50.798674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:50.798681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.798692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.798707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.798722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:50.798743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935879:3886], now have 1 active actors on pipe
2025-10-02T09:28:50.798751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935818:2446], now have 1 active actors on pipe
2025-10-02T09:28:50.798757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.798760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.798762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.798771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:50.798783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:50.798784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:50.798787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:50.798789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:50.798795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:50.798796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:50.798828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.798840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:50.798848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:50.798787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 233
2025-10-02T09:28:50.798823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 233
2025-10-02T09:28:50.798854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.798862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.798909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:50.798919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.798923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.798924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:50.798931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.798937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:50.798961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.799118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.799126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.799147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.799251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0
2025-10-02T09:28:50.799596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baae3bb-59b3d80e-bd954a5a-4bad5195_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:50.802629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Write session: try to update token
2025-10-02T09:28:50.802644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:50.810745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:50.810764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:50.810767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:50.810769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:50.810780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.810784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.810787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553994039416478:3537]
2025-10-02T09:28:50.810830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:50.810837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:50.810841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:50.810928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:50.810934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.810936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:50.811094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:50.818491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:50.821190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:50.876472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553994114935887:3694]
2025-10-02T09:28:50.876870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7556553994114935887:3694]
2025-10-02T09:28:50.956992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:50.957352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.957367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.957384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935887:3694], now have 1 active actors on pipe
2025-10-02T09:28:50.957597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:50.957600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:50.957616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:50.957620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553994114935887:3694]
2025-10-02T09:28:50.958032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:50.958050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Write session will restart in 0.009053s
2025-10-02T09:28:50.957637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:50.957675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: error at write: Disconnected sessionId: src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0
2025-10-02T09:28:50.957841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0 is DEAD
2025-10-02T09:28:50.958079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Write session: Do CDS request
2025-10-02T09:28:50.958087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:50.964160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:50.965421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:50.965591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:50.965601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:50.965609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:50.965653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:50.965692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553994039416544:3539]
2025-10-02T09:28:50.966263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:50.966525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:50.966565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:50.966870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:50.966917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.966922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.966924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.966925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.966926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.966928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.966929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.966930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.966931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.966932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.966933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.966934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.966938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.966949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.966953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.966956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.966960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.966963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.966967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.966971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.966974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.966979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.966982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.966986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.966993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.967001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:50.967007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.967012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:50.967016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.967021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:50.967025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.967029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:50.967033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.967038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:50.967042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.967047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:50.967052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.967057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:50.967062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.967067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:50.967071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.967075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:50.967093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.967097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.967101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.967106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.967109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.967114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.967157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:50.968314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.968408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:50.968423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-10-02T09:28:50.968537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:50.968574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:50.968581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:50.968585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:50.969032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-10-02T09:28:50.969066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:50.969070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:50.969072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:50.969077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553994114935917:3890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:50.969589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553994114935917:3890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:50.971453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553994114935917:3890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:50.974846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553994114935917:3890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:50.974861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553994114935917:3890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:50.974864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553994114935917:3890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:50.974870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:50.975541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:50.977103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:50.977118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:50.977120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:50.977124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:50.977130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [2:7556553994039416544:3539]
2025-10-02T09:28:50.977147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:50.977165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:50.977172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.977175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.977177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.977190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:50.977195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:50.977200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:50.977252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.977262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.977264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.977267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:50.977269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:50.977382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:50.977389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.977397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:50.977405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:50.977414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:50.977431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935948:3890], now have 1 active actors on pipe
2025-10-02T09:28:50.977436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553994114935891:2446], now have 1 active actors on pipe
2025-10-02T09:28:50.977440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.977441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.977443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.977451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:50.977462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:50.977453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 234
2025-10-02T09:28:50.977454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 234
2025-10-02T09:28:50.977475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:50.977478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:50.977481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:50.977484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:50.977486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:50.977508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.977512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:50.977518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:50.977541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.977549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.977573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:50.977580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:50.977583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:50.977585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:50.977591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:50.977597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:50.977610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.977710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:50.977716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:50.977727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:50.977792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 36 sessionId: src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0
2025-10-02T09:28:50.978119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc397e84-3d0d3a33-fbea4d7e-fcff7d2a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:50.981196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Write session: try to update token
2025-10-02T09:28:50.981212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:50.988644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:50.988662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:50.988664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:50.988666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:50.988674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.988679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.988682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553994039416539:3539]
2025-10-02T09:28:50.988717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:50.988723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:50.988725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:50.988726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:50.988732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:50.988736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:50.988944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:50.994987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:50.997446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:51.057725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553998409903253:3694]
2025-10-02T09:28:51.058030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7556553998409903253:3694]
2025-10-02T09:28:51.130366Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:51.130683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.130695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.130713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903253:3694], now have 1 active actors on pipe
2025-10-02T09:28:51.130923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553998409903253:3694]
2025-10-02T09:28:51.130938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:51.130951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:51.130982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:51.130989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:51.131055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: error at write: Disconnected sessionId: src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0
2025-10-02T09:28:51.131237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0 is DEAD
2025-10-02T09:28:51.131382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:51.131393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Write session will restart in 0.007949s
2025-10-02T09:28:51.131413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Write session: Do CDS request
2025-10-02T09:28:51.131420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:51.138152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:51.139508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:51.139663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:51.139670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:51.139677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:51.139717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:51.139756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553998334383904:3542]
2025-10-02T09:28:51.140295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:51.140432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:51.140449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-10-02T09:28:51.140474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.140579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:51.140615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:51.140742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.140777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:51.140787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:51.140792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:51.140936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:51.140984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.140990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.140992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.140993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.140994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.140995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.140996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.140997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.140997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.140998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.140999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.141001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.141005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.141015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.141018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.141021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.141024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.141027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.141030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.141033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.141036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.141040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.141043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.141045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.141051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.141058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.141063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.141067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.141071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.141074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.141077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.141082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.141085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.141089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.141094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.141098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.141106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.141109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.141113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.141116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.141120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.141130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.141133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.141137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.141140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.141143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.141147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.141150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.141178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:51.141194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-10-02T09:28:51.141235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:51.141241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:51.141243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:51.141247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553998409903282:3895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:51.141739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553998409903282:3895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:51.143593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553998409903282:3895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:51.149188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553998409903282:3895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:51.149205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553998409903282:3895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:51.149209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553998409903282:3895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:51.149217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:51.149725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:51.151484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:51.151500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:51.151502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:51.151506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:51.151512Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [2:7556553998334383904:3542]
2025-10-02T09:28:51.151524Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:51.151541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:51.151544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.151549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.151552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.151567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:51.151572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:51.151577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:51.151645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.151656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.151658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.151661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:51.151662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:51.151725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:51.151732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.151743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.151756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.151772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:51.151796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903318:3895], now have 1 active actors on pipe
2025-10-02T09:28:51.151799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903257:2446], now have 1 active actors on pipe
2025-10-02T09:28:51.151805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.151806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.151808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.151820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:51.151832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:51.151838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:51.151846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:51.151849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:51.151856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:51.151858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:51.151888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.151881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 235
2025-10-02T09:28:51.151897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:51.151901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:51.151885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 235
2025-10-02T09:28:51.151925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.151929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.151956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:51.151961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.151969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.151971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:51.151979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.151986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:51.151998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.152150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.152159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.152176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.152257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0
2025-10-02T09:28:51.152612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18109c41-32490c9d-a7dac7e6-41f126f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:51.156008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Write session: try to update token
2025-10-02T09:28:51.156025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:51.162531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:51.162547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.162558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.162594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:51.162596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:51.162800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:51.162947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:51.163089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:51.163239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:51.163438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:51.163473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:51.172372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:51.172393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.172396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:51.172397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:51.172406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.172414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.172420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553998334383899:3542]
2025-10-02T09:28:51.172462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:51.172470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.172472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:51.172471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:51.172478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:51.172483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:51.172605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:51.173883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:51.176587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:51.231297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553998409903327:3694]
2025-10-02T09:28:51.231566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7556553998409903327:3694]
2025-10-02T09:28:51.314951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:51.315239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.315254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.315270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903327:3694], now have 1 active actors on pipe
2025-10-02T09:28:51.315448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:51.315569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553998409903327:3694]
2025-10-02T09:28:51.315612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:51.315682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0
2025-10-02T09:28:51.315848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0 is DEAD
2025-10-02T09:28:51.315961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:51.315968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Write session will restart in 0.006046s
2025-10-02T09:28:51.315987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Write session: Do CDS request
2025-10-02T09:28:51.315992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:51.316059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:51.322185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:51.323286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.323410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:51.323423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-10-02T09:28:51.323507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:51.323536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.323563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:51.323571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:51.323575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:51.323678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:51.323689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:51.323699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:51.323758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:51.323795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553998334383981:3550]
2025-10-02T09:28:51.323978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-10-02T09:28:51.324003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:51.324009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:51.324011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:51.324016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553998409903366:3905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:51.324372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:51.324493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553998409903366:3905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:51.324629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:51.324670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:51.325005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:51.325067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.325074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.325075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.325077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.325078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.325079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.325082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.325083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.325084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.325085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.325086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.325088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.325093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.325103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.325107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.325110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.325114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.325119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.325122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.325127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.325131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.325135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.325139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.325142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.325148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.325155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.325160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.325165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.325168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.325172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.325175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.325179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.325189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.325193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.325196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.325200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.325204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.325209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.325212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.325217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.325220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.325225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.325234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.325238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.325241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.325246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.325249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.325254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.325288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:51.326165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553998409903366:3905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:51.332129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553998409903366:3905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:51.332150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553998409903366:3905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:51.332153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553998409903366:3905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:51.332160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:51.334189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:51.335818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:51.335836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:51.335838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:51.335842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:51.335847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [2:7556553998334383981:3550]
2025-10-02T09:28:51.335859Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:51.335874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:51.335876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.335880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.335882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.335896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:51.335901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:51.335907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:51.335962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.335972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.335974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.335976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:51.335978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:51.336073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:51.336081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.336093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.336105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.336124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:51.336146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903404:3905], now have 1 active actors on pipe
2025-10-02T09:28:51.336153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903342:2446], now have 1 active actors on pipe
2025-10-02T09:28:51.336158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.336160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.336162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.336173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:51.336187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:51.336188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:51.336196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:51.336199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:51.336201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:51.336204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:51.336232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.336243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:51.336261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:51.336312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 236
2025-10-02T09:28:51.336347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 236
2025-10-02T09:28:51.336680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.336693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.336717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:51.336725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.336731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.336734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:51.336743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.336753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:51.336773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.337023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.337031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.337044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.337593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 36 sessionId: src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0
2025-10-02T09:28:51.337917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b223b84-10ebb1e8-17598fb8-9b8262a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:51.341052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Write session: try to update token
2025-10-02T09:28:51.341068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:51.346803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:51.346822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.346828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.346866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:51.346880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:51.347038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:51.347211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:51.347380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:51.347541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:51.348058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:51.348100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:51.357900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:51.357924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.357927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:51.357929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:51.357939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.357948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.357951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553998334383976:3550]
2025-10-02T09:28:51.357986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:51.357992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.357994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:51.357998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:51.358004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:51.358007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:51.358131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:51.362232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:51.364859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:51.415656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553998409903433:3694]
2025-10-02T09:28:51.415946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7556553998409903433:3694]
2025-10-02T09:28:51.506820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:51.507148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.507163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.507180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903433:3694], now have 1 active actors on pipe
2025-10-02T09:28:51.507349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:51.507355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:51.507363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:51.507394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553998409903433:3694]
2025-10-02T09:28:51.507381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:51.507427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: error at write: Disconnected sessionId: src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0
2025-10-02T09:28:51.507587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0 is DEAD
2025-10-02T09:28:51.507780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:51.507801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Write session will restart in 0.006943s
2025-10-02T09:28:51.507838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Write session: Do CDS request
2025-10-02T09:28:51.507846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:51.513395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:51.514874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:51.515029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:51.515039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:51.515048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:51.515093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:51.515133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553998334384080:3559]
2025-10-02T09:28:51.515671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:51.515969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:51.516014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:51.516304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:51.516330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.516366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.516373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.516374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.516375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.516376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.516362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:51.516379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.516376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-10-02T09:28:51.516381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.516382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.516383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.516384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.516385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.516386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.516390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.516400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.516405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.516408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.516412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.516415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.516419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.516422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.516426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.516429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.516432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.516436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.516443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.516450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.516455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.516460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.516464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.516469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.516473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.516478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.516482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.516486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.516496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.516505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.516510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.516520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.516544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.516538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.516553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.516561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.516565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:51.516574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:51.516566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.516576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.516578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:51.516581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.516586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.516591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.516595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.516599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.516635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:51.516910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-10-02T09:28:51.516938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:51.516944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:51.516946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:51.516950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553998409903469:3913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:51.517439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553998409903469:3913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:51.519149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553998409903469:3913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:51.524488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553998409903469:3913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:51.524504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553998409903469:3913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:51.524508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553998409903469:3913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:51.524515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:51.525016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:51.526731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:51.526751Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:51.526753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:51.526757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:51.526762Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [2:7556553998334384080:3559]
2025-10-02T09:28:51.526777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:51.526797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:51.526804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.526807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.526809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.526822Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:51.526831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:51.526838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:51.526882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.526891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.526893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.526896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:51.526898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:51.526957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:51.526965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.526973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.526979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.526987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:51.527001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903440:2446], now have 1 active actors on pipe
2025-10-02T09:28:51.527006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903504:3913], now have 1 active actors on pipe
2025-10-02T09:28:51.527010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.527013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.527014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.527023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:51.527035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:51.527046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:51.527047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:51.527048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:51.527050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:51.527053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:51.527078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.527085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:51.527048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 237
2025-10-02T09:28:51.527088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:51.527074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 237
2025-10-02T09:28:51.527110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.527118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.527154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:51.527164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.527172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.527174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:51.527184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.527195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:51.527214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.527465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.527475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.527490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.527564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 36 sessionId: src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0
2025-10-02T09:28:51.527863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6f60a-9fd610c1-eddee0f-2c5f0087_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:51.530733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Write session: try to update token
2025-10-02T09:28:51.530753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:51.537840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:51.537859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.537861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:51.537863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:51.537873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.537877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.537881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553998334384075:3559]
2025-10-02T09:28:51.537915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:51.537921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.537923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:51.537923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:51.537929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:51.537932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:51.538144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:51.544929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:51.547247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:51.607601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553998409903511:3694]
2025-10-02T09:28:51.607835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7556553998409903511:3694]
2025-10-02T09:28:51.669092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:51.669337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.669348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.669362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903511:3694], now have 1 active actors on pipe
2025-10-02T09:28:51.669588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:51.669604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:51.669607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553998409903511:3694]
2025-10-02T09:28:51.669623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:51.669663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: error at write: Disconnected sessionId: src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0
2025-10-02T09:28:51.669833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0 is DEAD
2025-10-02T09:28:51.669958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:51.669974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:51.669986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Write session will restart in 0.009532s
2025-10-02T09:28:51.670017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Write session: Do CDS request
2025-10-02T09:28:51.670023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:51.676060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:51.677204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:51.677336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:51.677345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:51.677352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:51.677385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:51.677410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553998334384145:3561]
2025-10-02T09:28:51.677808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:51.678029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:51.678064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:51.678320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:51.678356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.678360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.678361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.678362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.678363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.678363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.678364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.678364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.678365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.678365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.678366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.678366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.678369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.678376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.678380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.678382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.678384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.678386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.678388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.678390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.678392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.678396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.678399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.678403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.678408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.678414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.678425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.678429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.678434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.678437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.678441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.678445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.678448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.678450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.678452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.678455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.678458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.678460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.678463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.678465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.678468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.678470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.678473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.678480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.678483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.678486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.678489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.678511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:51.680313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.680417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:51.680431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-10-02T09:28:51.680556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.680584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:51.680592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:51.680596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:51.680993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-10-02T09:28:51.681026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:51.681032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:51.681033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:51.681038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553998409903543:3917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:51.681506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553998409903543:3917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:51.683545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553998409903543:3917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:51.685985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553998409903543:3917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:51.685999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553998409903543:3917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:51.686004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553998409903543:3917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:51.686011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:51.686704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:51.688315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:51.688332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:51.688334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:51.688338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:51.688344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [2:7556553998334384145:3561]
2025-10-02T09:28:51.688357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:51.688377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:51.688386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.688389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.688392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.688405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:51.688415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:51.688425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:51.688482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.688490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.688491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.688495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:51.688498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:51.688561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:51.688568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.688580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.688597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.688619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:51.688641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903513:2446], now have 1 active actors on pipe
2025-10-02T09:28:51.688645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903578:3917], now have 1 active actors on pipe
2025-10-02T09:28:51.688650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.688653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.688656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.688668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:51.688680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:51.688685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:51.688688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:51.688689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:51.688701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:51.688704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:51.688687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 238
2025-10-02T09:28:51.688723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 238
2025-10-02T09:28:51.688738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.688747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:51.688752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:51.688769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.688776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.688823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f828838e-55fc08b5-191b88a-25aef251_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:51.688834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.688844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.688848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:51.688855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.688867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:51.688884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.689020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.689029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.689043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.689132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 36 sessionId: src_id|f828838e-55fc08b5-191b88a-25aef251_0
2025-10-02T09:28:51.689460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aa5b313-82a7dd35-8db03c1a-1eb14da5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f828838e-55fc08b5-191b88a-25aef251_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:51.692362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Write session: try to update token
2025-10-02T09:28:51.692375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:51.699687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:51.699706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.699708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:51.699710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:51.699721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.699724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.699728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553998334384140:3561]
2025-10-02T09:28:51.699762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:51.699761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:51.699766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.699767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:51.699769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:51.699771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:51.700033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:51.705560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|f828838e-55fc08b5-191b88a-25aef251_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:51.708150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:51.769923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553998409903592:3694]
2025-10-02T09:28:51.770166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7556553998409903592:3694]
2025-10-02T09:28:51.833406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:51.833785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.833796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.833811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903592:3694], now have 1 active actors on pipe
2025-10-02T09:28:51.834014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:51.834044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553998409903592:3694]
2025-10-02T09:28:51.834064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:51.834066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:51.834125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: error at write: Disconnected sessionId: src_id|f828838e-55fc08b5-191b88a-25aef251_0
2025-10-02T09:28:51.834293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|f828838e-55fc08b5-191b88a-25aef251_0 is DEAD
2025-10-02T09:28:51.834456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:51.834465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Write session will restart in 0.006705s
2025-10-02T09:28:51.834484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Write session: Do CDS request
2025-10-02T09:28:51.834490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:51.835080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:51.840363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:51.841727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:51.841860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:51.841871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:51.841879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:51.841919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:51.841945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556553998334384213:3564]
2025-10-02T09:28:51.842253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.842322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:51.842335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-10-02T09:28:51.842394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:51.842485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:51.842512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:51.842520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:51.842524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:51.842671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:51.842709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:51.842886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-10-02T09:28:51.842922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:51.842928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:51.842932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:51.842937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556553998409903626:3922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:51.842980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:51.843040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.843045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.843048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.843049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.843050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.843051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.843052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.843053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.843054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.843055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.843056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.843057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.843062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.843072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.843076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.843079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.843083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.843086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.843090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.843093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.843097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.843101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.843104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.843107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.843113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.843132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:51.843145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.843152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:51.843160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.843165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:51.843169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.843174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:51.843183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.843188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:51.843196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.843200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:51.843203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.843205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:51.843208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.843210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:51.843213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.843215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:51.843218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.843220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.843222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.843225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.843227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.843230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.843247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:51.843424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556553998409903626:3922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:51.845287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556553998409903626:3922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:51.850550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556553998409903626:3922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:51.850566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556553998409903626:3922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:51.850569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556553998409903626:3922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:51.850576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:51.852013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:51.853867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:51.853890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:51.853892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:51.853897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:51.853903Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [2:7556553998334384213:3564]
2025-10-02T09:28:51.853916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:51.853932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:51.853939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.853946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.853948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.853961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:51.853970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:51.853980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:51.854041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.854051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.854052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.854055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:51.854057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:51.854119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:51.854127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.854139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:51.854152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:51.854170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:51.854192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903663:3922], now have 1 active actors on pipe
2025-10-02T09:28:51.854199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903597:2446], now have 1 active actors on pipe
2025-10-02T09:28:51.854205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.854211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.854212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.854223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:51.854242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:51.854245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:51.854248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:51.854250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:51.854259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:51.854262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:51.854247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 239
2025-10-02T09:28:51.854269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 239
2025-10-02T09:28:51.854294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.854306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:51.854312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:51.854327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.854330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.854367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:51.854384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:51.854387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:51.854388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:51.854398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:51.854406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:51.854431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.854584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:51.854593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:51.854606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:51.854670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 36 sessionId: src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0
2025-10-02T09:28:51.854986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f828838e-55fc08b5-191b88a-25aef251_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:51.857863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Write session: try to update token
2025-10-02T09:28:51.857877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:51.865080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:51.865094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:51.865099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:51.865101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:51.865109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.865112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.865116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556553998334384208:3564]
2025-10-02T09:28:51.865153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:51.865159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:51.865161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:51.865162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:51.865169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:51.865172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:51.865309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:51.873297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:51.875462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:51.934242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556553998409903670:3694]
2025-10-02T09:28:51.934479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7556553998409903670:3694]
2025-10-02T09:28:52.004175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:52.004490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.004505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.004521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556553998409903670:3694], now have 1 active actors on pipe
2025-10-02T09:28:52.004751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:52.004754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:52.004794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556553998409903670:3694]
2025-10-02T09:28:52.004798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:52.004812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:52.004866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: error at write: Disconnected sessionId: src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0
2025-10-02T09:28:52.005038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0 is DEAD
2025-10-02T09:28:52.005206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:52.005218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Write session will restart in 0.007840s
2025-10-02T09:28:52.005241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Write session: Do CDS request
2025-10-02T09:28:52.005247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:52.011493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:52.012830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:52.012982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:52.012991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:52.013000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:52.013040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:52.013075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554002629351576:3566]
2025-10-02T09:28:52.013590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:52.013897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:52.013935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:52.014214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:52.014262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.014267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.014268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.014281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.014269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.014271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.014272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.014273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.014274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.014275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.014276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.014277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.014278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.014283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.014292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.014295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.014298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.014301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.014304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.014307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.014310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.014314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.014317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.014320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.014323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.014331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.014337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.014342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.014346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.014350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.014354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.014357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.014361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.014365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.014369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.014373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.014377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.014381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.014384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.014387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.014391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.014363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:52.014395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.014399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.014403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.014378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-10-02T09:28:52.014407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.014410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.014414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.014419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.014423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.014455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:52.014497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.014527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:52.014536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:52.014540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:52.014857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-10-02T09:28:52.014882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:52.014884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:52.014885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:52.014890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554002704871001:3926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:52.015340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554002704871001:3926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:52.016876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554002704871001:3926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:52.022102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554002704871001:3926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:52.022120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554002704871001:3926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:52.022124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554002704871001:3926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:52.022131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:52.022926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:52.024654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:52.024671Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:52.024674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:52.024677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:52.024683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [2:7556554002629351576:3566]
2025-10-02T09:28:52.024696Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:52.024714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:52.024717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.024719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.024722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.024735Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:52.024740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:52.024748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:52.024892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.024902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.024904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.024907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:52.024910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:52.024974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:52.024982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.024997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.025013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.025032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:52.025051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704870968:2446], now have 1 active actors on pipe
2025-10-02T09:28:52.025057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871036:3926], now have 1 active actors on pipe
2025-10-02T09:28:52.025063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.025065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.025067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.025082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:52.025097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:52.025105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:52.025108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:52.025110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:52.025082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 240
2025-10-02T09:28:52.025117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:52.025120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:52.025095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 240
2025-10-02T09:28:52.025167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.025176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.025186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.025195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:52.025211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:52.025226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:52.025233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.025242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.025244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:52.025253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.025264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:52.025283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.025442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.025452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.025466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.025561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0
2025-10-02T09:28:52.025890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32ed6f2-1580fdff-40e424c7-d67c8924_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:52.029001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Write session: try to update token
2025-10-02T09:28:52.029020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:52.035650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:52.035669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.035670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:52.035672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:52.035689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.035692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.035695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554002629351571:3566]
2025-10-02T09:28:52.035728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:52.035733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.035733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:52.035735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:52.035739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:52.035744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:52.035865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:52.042736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:52.045110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:52.104757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554002704871045:3694]
2025-10-02T09:28:52.105037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7556554002704871045:3694]
2025-10-02T09:28:52.179792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:52.180108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.180120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.180136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871045:3694], now have 1 active actors on pipe
2025-10-02T09:28:52.180345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:52.180347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554002704871045:3694]
2025-10-02T09:28:52.180350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:52.180381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:52.180384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:52.180443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: error at write: Disconnected sessionId: src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0
2025-10-02T09:28:52.180611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0 is DEAD
2025-10-02T09:28:52.180742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:52.180754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Write session will restart in 0.008980s
2025-10-02T09:28:52.180777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Write session: Do CDS request
2025-10-02T09:28:52.180783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:52.189459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:52.190824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:52.190997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:52.191008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:52.191018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:52.191072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:52.191109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554002629351646:3569]
2025-10-02T09:28:52.191309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.191379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:52.191396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-10-02T09:28:52.191519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.191554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:52.191560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:52.191564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:52.191750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:52.191980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:52.192012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:52.191989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-10-02T09:28:52.192032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:52.192033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:52.192035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:52.192040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554002704871080:3931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:52.192303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:52.192349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.192353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.192354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.192355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.192355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.192356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.192357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.192357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.192358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.192358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.192359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.192360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.192363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.192370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.192373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.192436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554002704871080:3931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:52.192375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.192378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.192381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.192383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.192385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.192388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.192391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.192397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.192401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.192407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.192414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.192419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.192423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.192427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.192431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.192434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.192439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.192443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.192448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.192451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.192455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.192459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.192464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.192467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.192472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.192476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.192480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.192483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.192488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.192492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.192496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.192499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.192503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.192537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:52.194767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554002704871080:3931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:52.200577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554002704871080:3931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:52.200600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554002704871080:3931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:52.200604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554002704871080:3931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:52.200610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:52.201214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:52.202922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:52.202937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:52.202939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:52.202943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:52.202952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [2:7556554002629351646:3569]
2025-10-02T09:28:52.202965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:52.202981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:52.202983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.202986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.202988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.203002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:52.203012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:52.203018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:52.203071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.203077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.203078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.203080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:52.203082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:52.203130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:52.203131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.203155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.203166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.203176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:52.203188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.203192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.203194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.203202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:52.203208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:52.203211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:52.203212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871116:3931], now have 1 active actors on pipe
2025-10-02T09:28:52.203213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:52.203214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871047:2446], now have 1 active actors on pipe
2025-10-02T09:28:52.203219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:52.203227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:52.203228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:52.203253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.203261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:52.203268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:52.203308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 241
2025-10-02T09:28:52.203308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 241
2025-10-02T09:28:52.203425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.203437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.203458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:52.203466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.203530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.203538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:52.203547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.203556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:52.203569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.203762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.203772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.203788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.203867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 36 sessionId: src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0
2025-10-02T09:28:52.204205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b6a9c3-6d13f39c-a25f4bb5-f307afc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:52.207404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Write session: try to update token
2025-10-02T09:28:52.207424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:52.218560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:52.218577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.218586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.218633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:52.218636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:52.218813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:52.218967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:52.219115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:52.219276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:52.219488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:52.219533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:52.221192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:52.223658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:52.224553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.224574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.224593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:52.224595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.224598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:52.224599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:52.224607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.224611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.224615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554002629351641:3569]
2025-10-02T09:28:52.224658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:52.224662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:52.224667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.224669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:52.224670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:52.224671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:52.224821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:52.280367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554002704871123:3694]
2025-10-02T09:28:52.280630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7556554002704871123:3694]
2025-10-02T09:28:52.360015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:52.360271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:52.360301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871123:3694], now have 1 active actors on pipe
2025-10-02T09:28:52.360400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:52.360481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:52.360488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:52.360545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: error at write: Disconnected sessionId: src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0
2025-10-02T09:28:52.360670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0 is DEAD
2025-10-02T09:28:52.360797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554002704871123:3694]
2025-10-02T09:28:52.360822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:52.360838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:52.360850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Write session will restart in 0.005927s
2025-10-02T09:28:52.360869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Write session: Do CDS request
2025-10-02T09:28:52.360874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:52.366854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:52.368114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:52.368266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.368329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:52.368344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:52.368356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:52.368338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:52.368349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-10-02T09:28:52.368412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:52.368446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554002629351741:3578]
2025-10-02T09:28:52.368478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.368505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:52.368511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:52.368515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:52.368846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-10-02T09:28:52.368870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:52.368886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:52.368891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:52.368894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554002704871181:3942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:52.369019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:52.369284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554002704871181:3942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:52.369315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:52.369376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:52.369664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:52.369738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.369744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.369744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.369745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.369746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.369747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.369748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.369750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.369751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.369752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.369753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.369754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.369760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.369770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.369777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.369780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.369784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.369788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.369795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.369799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.369804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.369808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.369811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.369814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.369820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.369828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.369832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.369842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.369846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.369852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.369859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.369864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.369868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.369877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.369884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.369893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.369900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.369908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.369913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.369921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.369928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.369932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.369940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.369945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.369955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.369963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.369968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.369974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.370005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:52.371070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554002704871181:3942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:52.376450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554002704871181:3942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:52.376465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554002704871181:3942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:52.376468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554002704871181:3942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:52.376490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:52.378264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:52.379970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:52.379988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:52.379989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:52.379991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:52.379995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [2:7556554002629351741:3578]
2025-10-02T09:28:52.380004Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:52.380015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:52.380019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.380021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.380022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.380032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:52.380035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:52.380039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:52.380077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.380083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.380084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.380087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:52.380088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:52.380131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:52.380136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.380144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.380149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.380158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:52.380174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.380178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.380179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.380184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:52.380195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871228:3942], now have 1 active actors on pipe
2025-10-02T09:28:52.380197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871151:2446], now have 1 active actors on pipe
2025-10-02T09:28:52.380203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:52.380204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:52.380210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:52.380213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:52.380218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:52.380221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:52.380249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.380260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:52.380251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 242
2025-10-02T09:28:52.380275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:52.380255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 242
2025-10-02T09:28:52.380342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.380357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.380382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:52.380394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.380398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.380400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:52.380408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.380423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:52.380440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.380592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.380599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.380609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.380690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 36 sessionId: src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0
2025-10-02T09:28:52.381013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59db6742-24ef8dec-25d9d6b4-c36a3bb0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:52.383979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Write session: try to update token
2025-10-02T09:28:52.383995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:52.390503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:52.390521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.390530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.390568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:52.390586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:52.390757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:52.390910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:52.391055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:52.391209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:52.391504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:52.391549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:52.398316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:52.400540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:52.400562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.400564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:52.400570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:52.400581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.400585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.400590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554002629351736:3578]
2025-10-02T09:28:52.400634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:52.400642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.400644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:52.400646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:52.400651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:52.400654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:52.400786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:52.400853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:52.461105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554002704871235:3694]
2025-10-02T09:28:52.461389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7556554002704871235:3694]
2025-10-02T09:28:52.545301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:52.545566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.545577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.545596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871235:3694], now have 1 active actors on pipe
2025-10-02T09:28:52.545793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:52.545819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554002704871235:3694]
2025-10-02T09:28:52.545837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:52.545864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:52.546255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:52.546268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Write session will restart in 0.008565s
2025-10-02T09:28:52.545933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0
2025-10-02T09:28:52.546109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0 is DEAD
2025-10-02T09:28:52.546288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Write session: Do CDS request
2025-10-02T09:28:52.546294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:52.556278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.556352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:52.556369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-10-02T09:28:52.556500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.556547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:52.556552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:52.556557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:52.556967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-10-02T09:28:52.556996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:52.556998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:52.557000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:52.557005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554002704871266:3947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:52.557529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554002704871266:3947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:52.560093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554002704871266:3947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:52.565474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554002704871266:3947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:52.565492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554002704871266:3947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:52.565496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554002704871266:3947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:52.565503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:52.565862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:52.571266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:52.571500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:52.571513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:52.571523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:52.571581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:52.571632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554002629351837:3586]
2025-10-02T09:28:52.572289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:52.572766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:52.572851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:52.573158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:52.573238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.573240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.573241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.573242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.573244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.573245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.573247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.573248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.573249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.573253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.573255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.573256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.573261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.573273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.573277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.573281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.573285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.573291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.573294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.573298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.573301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.573306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.573309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.573312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.573319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.573326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.573331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.573337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.573341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.573346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.573350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.573354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.573359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.573363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.573369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.573373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.573379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.573383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.573387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.573392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.573399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.573404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.573408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.573412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.573418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.573423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.573426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.573431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.573467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:52.585220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:52.587131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:52.587156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:52.587159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:52.587162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:52.587167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [2:7556554002629351837:3586]
2025-10-02T09:28:52.587182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:52.587197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:52.587199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.587202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.587203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.587218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:52.587224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:52.587229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:52.587290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.587296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.587298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.587301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:52.587303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:52.587367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:52.587373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.587386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.587396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.587410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:52.587426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.587429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.587431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.587437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:52.587448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:52.587451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:52.587451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871238:2446], now have 1 active actors on pipe
2025-10-02T09:28:52.587453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:52.587460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:52.587473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:52.587476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:52.587481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871302:3947], now have 1 active actors on pipe
2025-10-02T09:28:52.587513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.587520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:52.587547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:52.587608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.587616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.587643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:52.587656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.587659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.587661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:52.587669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.587678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:52.587702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.587848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.587857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.587868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.587539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 243
2025-10-02T09:28:52.587695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 243
2025-10-02T09:28:52.587945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0
2025-10-02T09:28:52.588300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa707a3-3dfc5fcf-3c64c4bc-9e245cdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:52.591515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Write session: try to update token
2025-10-02T09:28:52.591534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:52.602423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:52.602443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.602445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:52.602447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:52.602455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.602460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.602463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554002629351830:3586]
2025-10-02T09:28:52.602501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:52.602507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.602511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:52.602509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:52.602515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:52.602518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:52.602648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:52.612766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:52.615485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:52.648873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554002704871315:3694]
2025-10-02T09:28:52.650479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7556554002704871315:3694]
2025-10-02T09:28:52.753975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:52.754348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.754365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.754384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871315:3694], now have 1 active actors on pipe
2025-10-02T09:28:52.755059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:52.755070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554002704871315:3694]
2025-10-02T09:28:52.755077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:52.755091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:52.755128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: error at write: Disconnected sessionId: src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0
2025-10-02T09:28:52.755313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0 is DEAD
2025-10-02T09:28:52.755650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:52.755662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Write session will restart in 0.009501s
2025-10-02T09:28:52.755684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Write session: Do CDS request
2025-10-02T09:28:52.755693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:52.755747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:52.768042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.768499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:52.768517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-10-02T09:28:52.768636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.768664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:52.768672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:52.768676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:52.769064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-10-02T09:28:52.769086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:52.769088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:52.769090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:52.769095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554002704871357:3952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:52.769573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554002704871357:3952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:52.770109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:52.771479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554002704871357:3952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:52.773072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:52.773263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:52.773272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:52.773282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:52.773337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:52.773381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554002629351909:3589]
2025-10-02T09:28:52.773974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:52.774308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:52.774366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:52.774711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:52.774794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.774802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.774803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.774804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.774805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.774806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.774807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.774808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.774809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.774810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.774811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.774812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.774818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.774828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.774832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.774835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.774839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.774842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.774846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.774849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.774852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.774856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.774859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.774862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.774870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.774876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.774882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.774888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.774898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.774902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.774908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.774916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.774921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.774926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.774930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.774935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.774939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.774944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.774949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.774954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.774966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.774970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.774973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.774979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.774983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.774987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.774991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.774995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.775037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:52.776030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554002704871357:3952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:52.776048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554002704871357:3952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:52.776051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554002704871357:3952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:52.776058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:52.789186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:52.791009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:52.791031Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:52.791034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:52.791037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:52.791045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [2:7556554002629351909:3589]
2025-10-02T09:28:52.791061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:52.791080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:52.791088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.791091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.791093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.791116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:52.791125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:52.791132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:52.791209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.791222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.791224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.791227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:52.791229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:52.791388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:52.791397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.791410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.791422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.791442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:52.791464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.791470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.791473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.791490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:52.791504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:52.791524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:52.791526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:52.791547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:52.791551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:52.791553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:52.791566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.791569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:52.791631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:52.791718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871325:2446], now have 1 active actors on pipe
2025-10-02T09:28:52.791725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871395:3952], now have 1 active actors on pipe
2025-10-02T09:28:52.791909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.791916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.791851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 244
2025-10-02T09:28:52.791851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 244
2025-10-02T09:28:52.791940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:52.791955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:52.791960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:52.791962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:52.791971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:52.791982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:52.791998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.792183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.792191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.792210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:52.792317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 36 sessionId: src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0
2025-10-02T09:28:52.792677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d63ea98-74cb6bf0-bbc4936b-3ce26ef4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:52.795950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Write session: try to update token
2025-10-02T09:28:52.795969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:52.806873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:52.806893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:52.806895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:52.806897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:52.806906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.806910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.806914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554002629351904:3589]
2025-10-02T09:28:52.806951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:52.806957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.806957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:52.806960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:52.806965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:52.806970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:52.807119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:52.821454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:52.824409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:52.853819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554002704871407:3694]
2025-10-02T09:28:52.861075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7556554002704871407:3694]
2025-10-02T09:28:52.962521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:52.962989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:52.963023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Write session will restart in 0.005324s
2025-10-02T09:28:52.962537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:52.962597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: error at write: Disconnected sessionId: src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0
2025-10-02T09:28:52.962775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0 is DEAD
2025-10-02T09:28:52.962775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:52.962813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554002704871407:3694]
2025-10-02T09:28:52.963051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Write session: Do CDS request
2025-10-02T09:28:52.963058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:52.961568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:52.961926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:52.961934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:52.961952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871407:3694], now have 1 active actors on pipe
2025-10-02T09:28:52.962609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:52.969492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.969905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:52.969927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-10-02T09:28:52.970254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:52.970290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:52.970297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:52.970302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:52.971116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-10-02T09:28:52.971171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:52.971173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:52.971175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:52.971181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554002704871419:3956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:52.971732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554002704871419:3956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:52.975408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554002704871419:3956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:52.978467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554002704871419:3956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:52.978484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554002704871419:3956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:52.978488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554002704871419:3956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:52.978511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:52.980242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:52.981899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:52.982083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:52.982093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:52.982102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:52.982147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:52.982189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554002629351982:3591]
2025-10-02T09:28:52.982795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:52.983517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:52.983585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:52.983943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:52.983994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.983995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.983996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.983998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.984000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.984001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.984003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.984005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.984006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.984007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.984009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.984010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.984016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.984028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.984033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.984038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.984043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.984048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.984053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.984057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.984062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.984067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.984072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.984080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.984087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.984096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:52.984102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.984108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:52.984115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.984121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:52.984126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.984132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:52.984139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.984145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:52.984150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.984155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:52.984161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.984166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:52.984171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.984177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:52.984182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.984188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:52.984193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.984199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:52.984204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.984210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:52.984214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.984219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:52.984259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:52.996097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:53.000066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:53.000098Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:53.000103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:53.000117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:53.000125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [2:7556554002629351982:3591]
2025-10-02T09:28:53.000197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:53.000225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:53.000232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.000235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.000237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.000251Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:53.000257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:53.000264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:53.000399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.000407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.000409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.000413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:53.000415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:53.000497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:53.000688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 245
2025-10-02T09:28:53.000692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 245
2025-10-02T09:28:53.000834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.000853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.000864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.000885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:53.000907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871473:3956], now have 1 active actors on pipe
2025-10-02T09:28:53.000911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554002704871412:2446], now have 1 active actors on pipe
2025-10-02T09:28:53.000934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.000939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.001046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.001049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.001051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.001100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:53.001123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:53.001127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:53.001129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:53.001149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:53.001165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:53.001168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:53.001183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d78b425-d208008e-8cc1fad4-fa911559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.001190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.001195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.001197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.001206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.001215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.001254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.001262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:53.001272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.001301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:53.001792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.001799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.001815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.002280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d78b425-d208008e-8cc1fad4-fa911559_0
2025-10-02T09:28:53.002954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29683a9e-fde4f23c-11a6f98e-fdcc27f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d78b425-d208008e-8cc1fad4-fa911559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:53.016561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:53.016590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.016744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:53.016751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:53.016759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.016764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.016769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554002629351976:3591]
2025-10-02T09:28:53.016832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:53.016842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.016846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:53.017089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:53.017102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:53.017106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:53.017167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:53.039670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Write session: try to update token
2025-10-02T09:28:53.039695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:53.063182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554006999838785:3694]
2025-10-02T09:28:53.063640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7556554006999838785:3694]
2025-10-02T09:28:53.073064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|6d78b425-d208008e-8cc1fad4-fa911559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:53.075706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:53.163008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:53.163330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838785:3694], now have 1 active actors on pipe
2025-10-02T09:28:53.163358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.163363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.164167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:53.164177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Write session will restart in 0.009420s
2025-10-02T09:28:53.164201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Write session: Do CDS request
2025-10-02T09:28:53.164207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:53.164188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:53.163656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:53.163671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:53.163670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554006999838785:3694]
2025-10-02T09:28:53.163695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:53.163729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|6d78b425-d208008e-8cc1fad4-fa911559_0
2025-10-02T09:28:53.163905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|6d78b425-d208008e-8cc1fad4-fa911559_0 is DEAD
2025-10-02T09:28:53.174512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:53.176262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:53.176489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:53.176498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:53.176508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:53.176556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:53.176602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554006924319352:3594]
2025-10-02T09:28:53.177220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:53.177434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.177892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:53.177935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:53.178240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:53.178299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.178303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.178304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.178305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.178306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.178307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.178308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.178310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.178311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.178312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.178313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.178314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.178320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.178329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.178333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.178337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.178341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.178361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.178364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.178367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.178371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.178375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.178378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.178382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.178388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.178396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.178401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.178406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.178411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.178415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.178420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.178425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.178432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.178437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.178442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.178447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.178452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.178457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.178463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.178468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.178473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.178478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.178482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.178487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.178494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.178499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.178504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.178509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.178545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:53.180997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:53.181017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-10-02T09:28:53.181527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.181592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:53.181599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:53.181605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:53.182088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-10-02T09:28:53.182126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:53.182128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:53.182129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:53.182134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554006999838829:3961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:53.182669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554006999838829:3961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:53.185347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554006999838829:3961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:53.187965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554006999838829:3961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:53.187980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554006999838829:3961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:53.187985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554006999838829:3961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:53.187992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:53.188930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:53.190710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:53.190729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:53.190731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:53.190737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:53.190745Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [2:7556554006924319352:3594]
2025-10-02T09:28:53.190759Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:53.190774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:53.190779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.190782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.190784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.190797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:53.190801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:53.190827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:53.190980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.190989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.190991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.190994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:53.190996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:53.191055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:53.191064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.191076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.191092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.191110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:53.191127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838789:2446], now have 1 active actors on pipe
2025-10-02T09:28:53.191134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838863:3961], now have 1 active actors on pipe
2025-10-02T09:28:53.191150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.191153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.191154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.191171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:53.191183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:53.191200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:53.191208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:53.191244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.191250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:53.191232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 246
2025-10-02T09:28:53.191268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:53.191277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:53.191280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:53.191276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 246
2025-10-02T09:28:53.191286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:53.191365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.191376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.191396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c405c453-8af8e05a-2e9074dc-712e6550_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.191401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.191407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.191408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.191415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.191423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.191436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.191648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.191655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.191666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.191750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 36 sessionId: src_id|c405c453-8af8e05a-2e9074dc-712e6550_0
2025-10-02T09:28:53.192175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d78b425-d208008e-8cc1fad4-fa911559_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c405c453-8af8e05a-2e9074dc-712e6550_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:53.195320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Write session: try to update token
2025-10-02T09:28:53.195339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:53.208289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:53.208306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.208308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:53.208313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:53.208321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.208327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.208341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554006924319346:3594]
2025-10-02T09:28:53.208378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:53.208383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.208385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:53.208390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:53.208396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:53.208400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:53.208531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:53.221775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|c405c453-8af8e05a-2e9074dc-712e6550_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:53.224377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:53.263942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554006999838870:3694]
2025-10-02T09:28:53.264300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7556554006999838870:3694]
2025-10-02T09:28:53.359178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:53.359535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.359551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.359569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838870:3694], now have 1 active actors on pipe
2025-10-02T09:28:53.359828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:53.360193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:53.360203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Write session will restart in 0.008465s
2025-10-02T09:28:53.360223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Write session: Do CDS request
2025-10-02T09:28:53.360228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:53.359784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:53.359831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554006999838870:3694]
2025-10-02T09:28:53.359846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:53.359848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:53.359892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: error at write: Disconnected sessionId: src_id|c405c453-8af8e05a-2e9074dc-712e6550_0
2025-10-02T09:28:53.360055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|c405c453-8af8e05a-2e9074dc-712e6550_0 is DEAD
2025-10-02T09:28:53.369221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:53.370389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.371245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:53.371538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:53.371560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:53.371571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:53.371095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:53.371112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-10-02T09:28:53.371324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.371631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:53.371367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:53.371374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:53.371380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:53.371669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554006924319437:3597]
2025-10-02T09:28:53.372191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-10-02T09:28:53.372229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:53.372236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:53.372238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:53.372244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554006999838921:3966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:53.372240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:53.372523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:53.372565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:53.372896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:53.372957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.372961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.372963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.372964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.372965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.372966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.372967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.372968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.372969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.372970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.372971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.372972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.372978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.372987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.372990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.372995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.372999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.373002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.373006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.373010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.373014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.373019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.373023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.373027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.373033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.373039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.373045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.373051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.373054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.373059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.373063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.373069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.373074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.373083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.373088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.372897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554006999838921:3966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:53.373093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.373102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.373108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.373112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.373117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.373121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.373126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.373130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.373136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.373142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.373151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.373155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.373161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.373196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:53.374749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554006999838921:3966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:53.381486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554006999838921:3966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:53.381505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554006999838921:3966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:53.381509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554006999838921:3966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:53.381518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:53.384889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:53.386881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:53.386900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:53.386903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:53.386907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:53.386914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [2:7556554006924319437:3597]
2025-10-02T09:28:53.386935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:53.386952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:53.386955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.386961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.386963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.386977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:53.386982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:53.386988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:53.387047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.387049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.387050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.387053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:53.387055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:53.387121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:53.387124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.387149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.387159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.387174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:53.387191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.387193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.387195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.387202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:53.387212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:53.387215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:53.387217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:53.387217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:53.387231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:53.387240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:53.387249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838885:2446], now have 1 active actors on pipe
2025-10-02T09:28:53.387252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838971:3966], now have 1 active actors on pipe
2025-10-02T09:28:53.387280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.387290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:53.387331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:53.387396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 247
2025-10-02T09:28:53.387441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 247
2025-10-02T09:28:53.387595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.387607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.387633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.387645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.387654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.387656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.387666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.387677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.387699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.387862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.387873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.387896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.387994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0
2025-10-02T09:28:53.388944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c405c453-8af8e05a-2e9074dc-712e6550_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:53.391905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Write session: try to update token
2025-10-02T09:28:53.391925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:53.399639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:53.399661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.399663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:53.399665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:53.399672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.399676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.399679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554006924319432:3597]
2025-10-02T09:28:53.399716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:53.399722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.399725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:53.399754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:53.399767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:53.399770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:53.399940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:53.413220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:53.415708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:53.459997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554006999838988:3694]
2025-10-02T09:28:53.460310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7556554006999838988:3694]
2025-10-02T09:28:53.541495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:53.541920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.541937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.541953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838988:3694], now have 1 active actors on pipe
2025-10-02T09:28:53.542273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:53.542289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:53.542356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: error at write: Disconnected sessionId: src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0
2025-10-02T09:28:53.542542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0 is DEAD
2025-10-02T09:28:53.542263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:53.542726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:53.542742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Write session will restart in 0.008479s
2025-10-02T09:28:53.542733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554006999838988:3694]
2025-10-02T09:28:53.542754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:53.542774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Write session: Do CDS request
2025-10-02T09:28:53.542784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:53.550808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:53.552159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:53.552323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:53.552332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:53.552341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:53.552382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.552384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:53.552399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:53.552430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554006924319548:3611]
2025-10-02T09:28:53.552417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-10-02T09:28:53.552637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.552700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:53.552714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:53.552722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:53.552998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:53.553182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-10-02T09:28:53.553226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:53.553232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:53.553233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:53.553238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554006999839029:3977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:53.553281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:53.553329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:53.553632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:53.553699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.553705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.553706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.553707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.553709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.553710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.553711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.553712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.553713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.553714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.553715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.553716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.553721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.553730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.553734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.553746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554006999839029:3977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:53.553737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.553741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.553744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.553748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.553751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.553754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.553758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.553761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.553765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.553771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.553777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.553782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.553787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.553791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.553795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.553799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.553804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.553808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.553812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.553816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.553821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.553825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.553830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.553835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.553839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.553844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.553848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.553853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.553858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.553862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.553867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.553872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.553876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.553910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:53.555631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554006999839029:3977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:53.560125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554006999839029:3977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:53.560141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554006999839029:3977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:53.560144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554006999839029:3977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:53.560152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:53.562532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:53.564361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:53.564376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:53.564378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:53.564382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:53.564387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [2:7556554006924319548:3611]
2025-10-02T09:28:53.564400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:53.564416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:53.564419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.564422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.564424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.564436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:53.564446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:53.564452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:53.564507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.564513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.564515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.564518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:53.564521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:53.564577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:53.564584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.564596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.564611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.564630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:53.564652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999838991:2446], now have 1 active actors on pipe
2025-10-02T09:28:53.564660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839066:3977], now have 1 active actors on pipe
2025-10-02T09:28:53.564665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.564671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.564673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.564684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:53.564699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:53.564703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:53.564706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:53.564708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:53.564714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:53.564721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:53.564730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 248
2025-10-02T09:28:53.564750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.564758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:53.564756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 248
2025-10-02T09:28:53.564761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:53.564793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.564797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.564837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.564848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.564856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.564858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.564866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.564873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.564884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.565036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.565048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.565069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.565168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 36 sessionId: src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0
2025-10-02T09:28:53.565561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc0f2e9b-8ba9bd78-ede5089d-f5d457b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:53.568633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Write session: try to update token
2025-10-02T09:28:53.568656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:53.576061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:53.576081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.576084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:53.576086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:53.576094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.576098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.576101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554006924319543:3611]
2025-10-02T09:28:53.576138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:53.576147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.576149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:53.576153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:53.576159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:53.576163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:53.576279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:53.589561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:53.592570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:53.642815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554006999839073:3694]
2025-10-02T09:28:53.643081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7556554006999839073:3694]
2025-10-02T09:28:53.725171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:53.725601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.725619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.725635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839073:3694], now have 1 active actors on pipe
2025-10-02T09:28:53.725830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:53.725845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:53.725858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554006999839073:3694]
2025-10-02T09:28:53.725873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:53.725913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: error at write: Disconnected sessionId: src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0
2025-10-02T09:28:53.725851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:53.726112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0 is DEAD
2025-10-02T09:28:53.726354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:53.726368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Write session will restart in 0.009707s
2025-10-02T09:28:53.726408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Write session: Do CDS request
2025-10-02T09:28:53.726415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:53.733391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:53.734826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:53.734999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:53.735007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:53.735016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:53.735061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:53.735096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554006924319623:3613]
2025-10-02T09:28:53.735693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:53.736048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:53.736088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:53.736413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:53.736468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.736474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.736475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.736476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.736477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.736478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.736480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.736480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.736481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.736483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.736484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.736485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.736490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.736500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.736504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.736507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.736511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.736515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.736519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.736522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.736526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.736532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.736535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.736539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.736545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.736552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.736558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.736563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.736567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.736571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.736576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.736582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.736586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.736591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.736595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.736600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.736606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.736614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.736618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.736623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.736632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.736636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.736641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.736646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.736650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.736655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.736660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.736665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.736704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:53.737383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.737493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:53.737520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-10-02T09:28:53.737648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.737683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:53.737692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:53.737697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:53.738161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-10-02T09:28:53.738204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:53.738211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:53.738213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:53.738219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554006999839123:3982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:53.738822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554006999839123:3982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:53.741398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554006999839123:3982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:53.745049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554006999839123:3982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:53.745069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554006999839123:3982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:53.745074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554006999839123:3982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:53.745084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:53.745665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:53.747527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:53.747544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:53.747547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:53.747555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:53.747562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [2:7556554006924319623:3613]
2025-10-02T09:28:53.747578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:53.747595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:53.747599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.747601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.747606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.747622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:53.747634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:53.747640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:53.747698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.747705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.747706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.747709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:53.747711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:53.747779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:53.747787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.747801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.747815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.747834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:53.747858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839081:2446], now have 1 active actors on pipe
2025-10-02T09:28:53.747866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839157:3982], now have 1 active actors on pipe
2025-10-02T09:28:53.747871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.747875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.747877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.747890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:53.747903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:53.747908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:53.747912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:53.747913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:53.747921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:53.747924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:53.747958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.747934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 249
2025-10-02T09:28:53.747970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:53.747978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:53.747942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 249
2025-10-02T09:28:53.748009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.748018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.748039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.748049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.748052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.748054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.748061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.748070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.748082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.748246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.748256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.748269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.748358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0
2025-10-02T09:28:53.748769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3354aa17-7c2ca145-c9fd8249-e2177624_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:53.751619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Write session: try to update token
2025-10-02T09:28:53.751638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:53.758846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:53.758866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.758876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.758917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:53.759103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:53.759263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:53.759407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:53.759554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:53.759762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:53.759813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:53.759942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:53.770447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:53.769816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:53.769836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.769839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:53.769841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:53.769850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.769854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.769857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554006924319618:3613]
2025-10-02T09:28:53.769896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:53.769902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.769905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:53.769908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:53.769913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:53.769917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:53.770053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:53.773403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:53.826143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554006999839167:3694]
2025-10-02T09:28:53.826474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7556554006999839167:3694]
2025-10-02T09:28:53.921872Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:53.922966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.922996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.923026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839167:3694], now have 1 active actors on pipe
2025-10-02T09:28:53.923394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554006999839167:3694]
2025-10-02T09:28:53.923457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:53.923456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:53.923460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:53.923557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0
2025-10-02T09:28:53.923792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0 is DEAD
2025-10-02T09:28:53.923765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:53.924001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:53.924014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Write session will restart in 0.005909s
2025-10-02T09:28:53.924066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Write session: Do CDS request
2025-10-02T09:28:53.924072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:53.931381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.931565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:53.931602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-10-02T09:28:53.931705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:53.931738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:53.931743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:53.931747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:53.932315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-10-02T09:28:53.932357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:53.932366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:53.932370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:53.932376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554006999839205:3986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:53.933017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554006999839205:3986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:53.933726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:53.935165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554006999839205:3986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:53.935255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:53.935473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:53.935493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:53.935503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:53.935558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:53.935606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554006924319702:3616]
2025-10-02T09:28:53.936227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:53.936478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:53.936515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:53.936850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:53.936893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.936897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.936898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.936898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.936899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.936900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.936900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.936901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.936902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.936902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.936903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.936903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.936906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.936913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.936916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.936918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.936920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.936922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.936924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.936926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.936929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.936931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.936935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.936937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.936941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.936945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:53.936949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.936953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:53.936958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.936962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:53.936966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.936971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:53.936975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.936980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:53.936983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.936988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:53.936992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.936994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:53.936996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.936999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:53.937002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.937004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:53.937007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.937011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.937013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.937016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.937018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.937021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.937038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:53.937874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554006999839205:3986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:53.937888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554006999839205:3986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:53.937893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554006999839205:3986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:53.937911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:53.947037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:53.949748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:53.949766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:53.949770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:53.949776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:53.949782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [2:7556554006924319702:3616]
2025-10-02T09:28:53.949795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:53.949815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:53.949818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.949821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.949822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.949837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:53.949842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:53.949848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:53.949924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.949929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.949931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.949934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:53.949936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:53.950004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:53.950011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.950024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:53.950033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:53.950052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:53.950072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839170:2446], now have 1 active actors on pipe
2025-10-02T09:28:53.950079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554006999839247:3986], now have 1 active actors on pipe
2025-10-02T09:28:53.950085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.950087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.950089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.950132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:53.950151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:53.950151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:53.950153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:53.950155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:53.950165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:53.950168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:53.950213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.950223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:53.950164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 250
2025-10-02T09:28:53.950223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 250
2025-10-02T09:28:53.950229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:53.950889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.950903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.950930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:53.950944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:53.950951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:53.950953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:53.950963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:53.950975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:53.950997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.952219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:53.952231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:53.952255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:53.952398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0
2025-10-02T09:28:53.952874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7ad5ea-d4145563-c615a1b7-98819c61_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:53.960229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Write session: try to update token
2025-10-02T09:28:53.960256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:53.963956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:53.963976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:53.963978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:53.963979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:53.963987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.963990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.963992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554006924319696:3616]
2025-10-02T09:28:53.964024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:53.964030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:53.964031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:53.964046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:53.964060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:53.964064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:53.964155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:53.987415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:53.991027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:54.023774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554011294806551:3694]
2025-10-02T09:28:54.024314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7556554011294806551:3694]
2025-10-02T09:28:54.106861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:54.107181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.107195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.107212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806551:3694], now have 1 active actors on pipe
2025-10-02T09:28:54.107442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:54.107460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:54.107468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:54.107466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:54.107515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554011294806551:3694]
2025-10-02T09:28:54.107529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0
2025-10-02T09:28:54.107708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0 is DEAD
2025-10-02T09:28:54.108094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:54.108103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Write session will restart in 0.006748s
2025-10-02T09:28:54.108124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Write session: Do CDS request
2025-10-02T09:28:54.108130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:54.115806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:54.116340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.116452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:54.116468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-10-02T09:28:54.116639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.116668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:54.116677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:54.116681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:54.117127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-10-02T09:28:54.117165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:54.117167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:54.117168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:54.117173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554011294806594:3991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:54.117215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:54.117450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:54.117459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:54.117470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:54.117524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:54.117577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554011219287076:3619]
2025-10-02T09:28:54.117735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554011294806594:3991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:54.118144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:54.118417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:54.118464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:54.118781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:54.118865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.118871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.118872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.118873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.118874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.118875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.118876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.118877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.118880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.118881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.118882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.118883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.118888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.118897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.118901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.118905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.118909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.118913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.118917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.118921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.118925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.118929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.118933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.118937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.118943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.118949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.118958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.118964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.118971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.118976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.118985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.118989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.118993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.119003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.119007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.119011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.119015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.119020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.119028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.119038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.119048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.119054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.119062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.119067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.119072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.119081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.119086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.119094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.119127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:54.119659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554011294806594:3991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:54.125656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554011294806594:3991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:54.125673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554011294806594:3991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:54.125676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554011294806594:3991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:54.125685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:54.128945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:54.130878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:54.130896Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:54.130898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:54.130902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:54.130909Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [2:7556554011219287076:3619]
2025-10-02T09:28:54.130925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:54.130941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:54.130944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.130947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.130949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.130964Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:54.130971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:54.130978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:54.131036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.131044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.131046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.131049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:54.131051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:54.131115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:54.131122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.131145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.131155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.131174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:54.131202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806633:3991], now have 1 active actors on pipe
2025-10-02T09:28:54.131209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.131211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.131212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.131222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:54.131230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806555:2446], now have 1 active actors on pipe
2025-10-02T09:28:54.131237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:54.131253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:54.131255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:54.131246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:54.131259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:54.131261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:54.131290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.131300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:54.131307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:54.131293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 251
2025-10-02T09:28:54.131331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.131309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 251
2025-10-02T09:28:54.131339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.131365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:54.131374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.131377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.131379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:54.131387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.131395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:54.131407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.131563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.131576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.131598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.131685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 36 sessionId: src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0
2025-10-02T09:28:54.132042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c16467-fd623f9-4ef14b74-3bf0de8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:54.135017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Write session: try to update token
2025-10-02T09:28:54.135035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:54.142075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:54.142093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.142101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.142141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:54.142150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:54.142649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:54.142954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:54.143265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:54.143400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:54.143692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:54.143734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:54.152492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:54.152507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.152509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:54.152510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:54.152519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.152522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.152526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554011219287071:3619]
2025-10-02T09:28:54.152561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:54.152567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.152571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:54.152572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:54.152578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:54.152583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:54.152705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:54.154747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:54.157432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:54.207539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554011294806641:3694]
2025-10-02T09:28:54.207916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7556554011294806641:3694]
2025-10-02T09:28:54.301434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:54.301823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.301838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.301857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806641:3694], now have 1 active actors on pipe
2025-10-02T09:28:54.302094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:54.303472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:54.303042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:54.303484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Write session will restart in 0.009972s
2025-10-02T09:28:54.303118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0
2025-10-02T09:28:54.303305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0 is DEAD
2025-10-02T09:28:54.303471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:54.303498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554011294806641:3694]
2025-10-02T09:28:54.303521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Write session: Do CDS request
2025-10-02T09:28:54.303529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:54.314505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:54.314527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-10-02T09:28:54.314944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.317269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.317323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:54.317329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:54.317333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:54.317989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-10-02T09:28:54.318032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:54.318034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:54.318035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:54.318040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554011294806675:3995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:54.318573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554011294806675:3995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:54.320882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554011294806675:3995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:54.322157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:54.325525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:54.325753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:54.325766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:54.325778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:54.325845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:54.325905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554011219287155:3621]
2025-10-02T09:28:54.326532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:54.327021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:54.327083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:54.327436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:54.327506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.327507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.327509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.327510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.327511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.327512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.327514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.327515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.327517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.327518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.327519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.327522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.327528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.327540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.327544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.327548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.327552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.327556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.327561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.327565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.327569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.327573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.327577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.327581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.327587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.327596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.327603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.327609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.327614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.327619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.327624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.327630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.327635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.327640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.327644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.327652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.327656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.327660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.327666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.327671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.327676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.327681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.327688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.327693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.327697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.327703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.327706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.327711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.327752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:54.331895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554011294806675:3995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:54.331915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554011294806675:3995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:54.331923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554011294806675:3995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:54.331932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:54.341943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:54.343872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:54.343878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:54.343881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:54.343884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:54.343890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [2:7556554011219287155:3621]
2025-10-02T09:28:54.343903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:54.343922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:54.343925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.343928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.343932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.343947Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:54.343952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:54.343958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:54.344011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.344013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.344015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.344017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:54.344019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:54.344086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:54.344089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.344102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.344113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.344128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:54.344143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.344145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.344147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.344154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:54.344165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:54.344177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:54.344180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:54.344192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:54.344195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:54.344197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:54.344211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.344213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:54.344216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:54.344222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806643:2446], now have 1 active actors on pipe
2025-10-02T09:28:54.344225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806720:3995], now have 1 active actors on pipe
2025-10-02T09:28:54.344986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 252
2025-10-02T09:28:54.345023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 252
2025-10-02T09:28:54.346137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.346153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.346184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89009b57-9bf0f283-dff5c142-82373770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:54.346192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.346196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.346199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:54.346208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.346220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:54.346234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.346654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.346666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.346686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.347037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 36 sessionId: src_id|89009b57-9bf0f283-dff5c142-82373770_0
2025-10-02T09:28:54.347463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16eb302-66e1ff35-5ec8ab6b-552878db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89009b57-9bf0f283-dff5c142-82373770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:54.350345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Write session: try to update token
2025-10-02T09:28:54.350363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:54.358117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:54.358141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.358144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:54.358146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:54.358154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.358158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.358162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554011219287150:3621]
2025-10-02T09:28:54.358200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:54.358207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.358209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:54.358371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:54.360858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:54.360877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:54.360881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:54.366868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|89009b57-9bf0f283-dff5c142-82373770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:54.369523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:54.408187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554011294806741:3694]
2025-10-02T09:28:54.408476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7556554011294806741:3694]
2025-10-02T09:28:54.501978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:54.502435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.502453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.502473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806741:3694], now have 1 active actors on pipe
2025-10-02T09:28:54.502718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554011294806741:3694]
2025-10-02T09:28:54.502742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:54.502746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:54.502749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:54.502808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: error at write: Disconnected sessionId: src_id|89009b57-9bf0f283-dff5c142-82373770_0
2025-10-02T09:28:54.502698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:54.502987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|89009b57-9bf0f283-dff5c142-82373770_0 is DEAD
2025-10-02T09:28:54.503152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:54.503163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Write session will restart in 0.009786s
2025-10-02T09:28:54.503186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Write session: Do CDS request
2025-10-02T09:28:54.503192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:54.511768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:54.513164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:54.513396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:54.513405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:54.513415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:54.513466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:54.513504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554011219287282:3636]
2025-10-02T09:28:54.514057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:54.514426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:54.514464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:54.514726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.514764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:54.514810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.514817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.514818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.514818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.514820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.514821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.514822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.514823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.514824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.514825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.514827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.514828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.514832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.514842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.514845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.514849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.514852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.514856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.514859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.514862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.514866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.514869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.514872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.514876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.514881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.514888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.514893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.514800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:54.514897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.514901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.514905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.514816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-10-02T09:28:54.514910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.514915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.514935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.514919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.514923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.514927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.514931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.514934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.514939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.514942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.514946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.514950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.514955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.514958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.514962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.514966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.514970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.514973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.514976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.514965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:54.514977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:54.514981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:54.515004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:54.515389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-10-02T09:28:54.515422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:54.515427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:54.515429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:54.515433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554011294806814:4007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:54.515906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554011294806814:4007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:54.518427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554011294806814:4007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:54.522988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554011294806814:4007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:54.523007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554011294806814:4007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:54.523011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554011294806814:4007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:54.523029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:54.523863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:54.525864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:54.525884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:54.525887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:54.525891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:54.525899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [2:7556554011219287282:3636]
2025-10-02T09:28:54.525913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:54.525935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:54.525938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.525942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.525944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.525961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:54.525969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:54.525976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:54.526047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.526054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.526056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.526059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:54.526062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:54.526133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:54.526144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.526161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.526173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.526190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:54.526208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806844:4007], now have 1 active actors on pipe
2025-10-02T09:28:54.526212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806767:2446], now have 1 active actors on pipe
2025-10-02T09:28:54.526219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.526221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.526223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.526358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 253
2025-10-02T09:28:54.526406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 253
2025-10-02T09:28:54.526876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0
2025-10-02T09:28:54.526235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:54.526249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:54.526251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:54.526252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:54.526254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:54.526264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:54.526268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:54.526303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.526311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:54.526316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:54.526521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.526527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.526553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:54.526560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.526566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.526568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:54.526577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.526586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:54.526601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.526785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.526788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.526798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.527263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89009b57-9bf0f283-dff5c142-82373770_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:54.530190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Write session: try to update token
2025-10-02T09:28:54.530204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:54.538451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:54.538473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.538475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:54.538480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:54.538493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.538497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.538500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554011219287277:3636]
2025-10-02T09:28:54.538540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:54.538546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.538548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:54.538554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:54.538561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:54.538566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:54.538842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:54.553017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:54.555572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:54.604335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554011294806852:3694]
2025-10-02T09:28:54.604611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7556554011294806852:3694]
2025-10-02T09:28:54.683579Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:54.683924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.683938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.683956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806852:3694], now have 1 active actors on pipe
2025-10-02T09:28:54.684139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:54.684231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:54.684248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:54.684253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:54.684298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554011294806852:3694]
2025-10-02T09:28:54.684303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0
2025-10-02T09:28:54.684458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0 is DEAD
2025-10-02T09:28:54.684620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:54.684632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Write session will restart in 0.008478s
2025-10-02T09:28:54.684656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Write session: Do CDS request
2025-10-02T09:28:54.684662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:54.692117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:54.693645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:54.693817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:54.693826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:54.693836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:54.693881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:54.693922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554011219287363:3638]
2025-10-02T09:28:54.694514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:54.694664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.694763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:54.694777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-10-02T09:28:54.694784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:54.694824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:54.694911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.694933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:54.694940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:54.694944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:54.695128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:54.695194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.695201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.695202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.695203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.695205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.695206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.695207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.695208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.695209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.695210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.695211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.695213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.695217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.695229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.695232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.695236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.695240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.695244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.695247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.695250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.695254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.695258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.695262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.695266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.695274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.695281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.695286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.695291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.695295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.695301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.695304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.695309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.695313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.695311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-10-02T09:28:54.695318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.695322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.695327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.695332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.695338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.695342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.695342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:54.695347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:54.695347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.695349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:54.695353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.695354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554011294806899:4011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:54.695358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.695363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.695368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.695373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.695378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.695382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.695388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.695424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:54.695835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554011294806899:4011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:54.698104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554011294806899:4011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:54.703554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554011294806899:4011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:54.703569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554011294806899:4011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:54.703573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554011294806899:4011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:54.703580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:54.704196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:54.705983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:54.706000Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:54.706002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:54.706006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:54.706011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [2:7556554011219287363:3638]
2025-10-02T09:28:54.706026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:54.706042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:54.706044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.706047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.706049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.706059Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:54.706070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:54.706076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:54.706117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.706122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.706123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.706125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:54.706128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:54.706169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:54.706174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.706182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.706188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.706203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:54.706222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.706226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.706228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.706237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:54.706249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:54.706252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:54.706255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:54.706257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:54.706262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:54.706265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:54.706273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806936:4011], now have 1 active actors on pipe
2025-10-02T09:28:54.706282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806855:2446], now have 1 active actors on pipe
2025-10-02T09:28:54.706309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.706320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:54.706343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:54.706347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 254
2025-10-02T09:28:54.706362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 254
2025-10-02T09:28:54.706419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.706433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.706459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bb25718-89151e3d-f84159cc-4055b32d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:54.706470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.706478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.706480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:54.706490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.706499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:54.706520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.706744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.706752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.706765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.706867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bb25718-89151e3d-f84159cc-4055b32d_0
2025-10-02T09:28:54.707183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8d1926-81385e6a-d4836653-6d46dcd0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bb25718-89151e3d-f84159cc-4055b32d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:54.710050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Write session: try to update token
2025-10-02T09:28:54.710070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:54.722298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:54.722318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.722331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.722372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:54.722376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:54.722546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:54.722687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:54.722830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:54.722970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:54.723160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:54.723199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:54.723988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|6bb25718-89151e3d-f84159cc-4055b32d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:54.726411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:54.727271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.727291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.727309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:54.727313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.727315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:54.727317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:54.727323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.727326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.727329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554011219287358:3638]
2025-10-02T09:28:54.727367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:54.727368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:54.727374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:54.727378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.727379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:54.727381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:54.727503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:54.784556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554011294806951:3694]
2025-10-02T09:28:54.784829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7556554011294806951:3694]
2025-10-02T09:28:54.874883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:54.875197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:54.875228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806951:3694], now have 1 active actors on pipe
2025-10-02T09:28:54.875331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:54.875383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:54.875413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:54.875422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:54.875424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554011294806951:3694]
2025-10-02T09:28:54.875479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: error at write: Disconnected sessionId: src_id|6bb25718-89151e3d-f84159cc-4055b32d_0
2025-10-02T09:28:54.875619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|6bb25718-89151e3d-f84159cc-4055b32d_0 is DEAD
2025-10-02T09:28:54.875784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:54.875795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Write session will restart in 0.009488s
2025-10-02T09:28:54.875834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Write session: Do CDS request
2025-10-02T09:28:54.875843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:54.882044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:54.883545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:54.883706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:54.883716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:54.883725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:54.883767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:54.883804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554011219287447:3641]
2025-10-02T09:28:54.884385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:54.884637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:54.884675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:54.884988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:54.885032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.885037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.885038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.885039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.885040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.885041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.885042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.885043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.885045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.885046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.885047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.885048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.885053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.885063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.885067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.885074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.885078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.885081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.885088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.885092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.885099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.885103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.885110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.885113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.885123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.885134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:54.885146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.885153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:54.885158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.885162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:54.885165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.885169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:54.885174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.885178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:54.885182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.885187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:54.885196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.885200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:54.885208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.885213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:54.885217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.885222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:54.885225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.885231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.885236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.885241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.885246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.885251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.885290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:54.886245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.886339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:54.886352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-10-02T09:28:54.886461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:54.886486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:54.886493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:54.886496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:54.886823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-10-02T09:28:54.886856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:54.886863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:54.886865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:54.886869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554011294807001:4016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:54.887349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554011294807001:4016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:54.889194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554011294807001:4016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:54.893112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554011294807001:4016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:54.893126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554011294807001:4016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:54.893129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554011294807001:4016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:54.893135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:54.893711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:54.895432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:54.895448Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:54.895450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:54.895453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:54.895461Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [2:7556554011219287447:3641]
2025-10-02T09:28:54.895474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:54.895487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:54.895495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.895498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.895500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.895515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:54.895523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:54.895529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:54.895581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.895587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.895589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.895592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:54.895594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:54.895662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:54.895670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.895682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:54.895692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:54.895709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:54.895729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294807036:4016], now have 1 active actors on pipe
2025-10-02T09:28:54.895737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294806954:2446], now have 1 active actors on pipe
2025-10-02T09:28:54.895743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.895749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.895751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.895763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:54.895772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:54.895778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:54.895780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:54.895781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:54.895790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:54.895797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:54.895810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 255
2025-10-02T09:28:54.895821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.895828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:54.895811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 255
2025-10-02T09:28:54.895830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:54.895851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.895860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.895884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28195323-735f9abb-9dddd568-8df7f200_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:54.895889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:54.895892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:54.895894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:54.895901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:54.895908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:54.895927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.896032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:54.896041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:54.896052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:54.896120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 36 sessionId: src_id|28195323-735f9abb-9dddd568-8df7f200_0
2025-10-02T09:28:54.896437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb25718-89151e3d-f84159cc-4055b32d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28195323-735f9abb-9dddd568-8df7f200_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:54.899029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Write session: try to update token
2025-10-02T09:28:54.899043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:54.905904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:54.905924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:54.905926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:54.905928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:54.905936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.905940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.905944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554011219287442:3641]
2025-10-02T09:28:54.905981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:54.905983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:54.905987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:54.905990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:54.905993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:54.905998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:54.906112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:54.910887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|28195323-735f9abb-9dddd568-8df7f200_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:54.913103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:54.975546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554011294807043:3694]
2025-10-02T09:28:54.975738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7556554011294807043:3694]
2025-10-02T09:28:55.051900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:55.052244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.052265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.052314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554011294807043:3694], now have 1 active actors on pipe
2025-10-02T09:28:55.052574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554011294807043:3694]
2025-10-02T09:28:55.052614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:55.052684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:55.052699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:55.052756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: error at write: Disconnected sessionId: src_id|28195323-735f9abb-9dddd568-8df7f200_0
2025-10-02T09:28:55.052964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|28195323-735f9abb-9dddd568-8df7f200_0 is DEAD
2025-10-02T09:28:55.053119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:55.053127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Write session will restart in 0.006529s
2025-10-02T09:28:55.053149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Write session: Do CDS request
2025-10-02T09:28:55.053159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:55.053157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:55.060728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:55.061310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.061397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:55.061410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-10-02T09:28:55.061531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.061560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:55.061569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:55.061573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:55.061988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-10-02T09:28:55.062025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:55.062027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:55.062028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:55.062033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554015589774386:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:55.062183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:55.062340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:55.062348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:55.062357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:55.062403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:55.062438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554015514254827:3643]
2025-10-02T09:28:55.062560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554015589774386:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:55.063045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:55.063388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:55.063430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:55.063744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:55.063793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.063800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.063801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.063804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.063805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.063806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.063807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.063808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.063809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.063810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.063811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.063812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.063817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.063826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.063830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.063834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.063838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.063842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.063846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.063850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.063854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.063858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.063861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.063865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.063872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.063879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.063884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.063890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.063894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.063899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.063903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.063908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.063913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.063918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.063923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.063928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.063932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.063937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.063941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.063946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.063951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.063967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.063976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.063982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.063986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.063991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.063999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.064004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.064040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:55.064289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554015589774386:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:55.075590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554015589774386:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:55.075614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554015589774386:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:55.075617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554015589774386:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:55.075625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:55.079087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:55.081133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:55.081151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:55.081154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:55.081158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:55.081165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [2:7556554015514254827:3643]
2025-10-02T09:28:55.081181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:55.081199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:55.081202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.081207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.081210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.081225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:55.081235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:55.081242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:55.081314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.081319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.081321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.081324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:55.081327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:55.081394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:55.081405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.081420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.081431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.081449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:55.081471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774341:2446], now have 1 active actors on pipe
2025-10-02T09:28:55.081479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774424:4020], now have 1 active actors on pipe
2025-10-02T09:28:55.081488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.081490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.081494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.081506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:55.081523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:55.081542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:55.081549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:55.081576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:55.081584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.081585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:55.081587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:55.081556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 256
2025-10-02T09:28:55.081588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:55.081593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:55.081577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 256
2025-10-02T09:28:55.081635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.081643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.081665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fe89e26-208019de-51420f18-b2be08dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:55.081676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.081681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.081682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:55.081690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.081701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:55.081720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.081873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.081880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.081891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.081989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fe89e26-208019de-51420f18-b2be08dd_0
2025-10-02T09:28:55.082454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28195323-735f9abb-9dddd568-8df7f200_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fe89e26-208019de-51420f18-b2be08dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:55.085439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Write session: try to update token
2025-10-02T09:28:55.085455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:55.100160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|5fe89e26-208019de-51420f18-b2be08dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:55.102386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:55.102409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.102420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.102467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:55.102473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:55.102650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:55.102955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:55.102991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.103131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.103286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.103468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:55.103534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.103549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.103567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:55.103608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:55.103715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:55.113166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:55.113184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.113187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:55.113190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:55.113203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.113207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.113210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554015514254822:3643]
2025-10-02T09:28:55.113246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:55.113253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.113256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:55.113255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:55.113262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:55.113265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:55.113403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:55.152703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554015589774434:3694]
2025-10-02T09:28:55.152970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7556554015589774434:3694]
2025-10-02T09:28:55.255001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:55.262337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.262366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.262557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.262626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.262689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.262753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.262797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.262810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.262884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.262956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.263031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.263102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.263158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.263174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.263246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.263312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.263382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.263446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.263578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.263590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.263664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.263725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.263787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.263880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.263917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.263920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.263987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.264045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.264098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.264158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.264197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.264200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.264267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.264321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.264382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.264441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.264484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.264487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.264558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.264622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.264691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.264750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.265001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.265014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.265081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.265142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.265208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.265272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.265393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.265405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.265468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.265533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.265599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.265658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.265791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.265801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.265870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.265926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.265993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.266056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.266108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.266117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.266178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774434:3694], now have 1 active actors on pipe
2025-10-02T09:28:55.266425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:55.266499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:55.266503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554015589774434:3694]
2025-10-02T09:28:55.266508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:55.266532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: error at write: Disconnected sessionId: src_id|5fe89e26-208019de-51420f18-b2be08dd_0
2025-10-02T09:28:55.266862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:55.266874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Write session will restart in 0.006556s
2025-10-02T09:28:55.266895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Write session: Do CDS request
2025-10-02T09:28:55.266901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:55.266705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|5fe89e26-208019de-51420f18-b2be08dd_0 is DEAD
2025-10-02T09:28:55.267057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:55.274275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.274586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:55.274602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-10-02T09:28:55.274746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.274771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:55.274776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:55.274779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:55.275348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-10-02T09:28:55.275391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:55.275393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:55.275395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:55.275400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554015589774469:4025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:55.275979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554015589774469:4025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:55.278727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554015589774469:4025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:55.279755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:55.283094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554015589774469:4025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:55.283111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554015589774469:4025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:55.283114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554015589774469:4025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:55.283122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:55.283736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:55.283959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:55.283972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:55.283983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:55.284046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:55.284090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554015514254915:3646]
2025-10-02T09:28:55.284631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:55.285052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:55.285096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:55.285407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:55.285463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.285465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.285466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.285466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.285467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.285468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.285469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.285470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.285471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.285472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.285475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.285476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.285481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.285493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.285496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.285499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.285503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.285506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.285509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.285512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.285515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.285519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.285522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.285525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.285531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.285538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.285543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.285547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.285552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.285556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.285559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.285564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.285568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.285572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.285575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.285579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.285583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.285587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.285590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.285594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.285597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.285603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.285608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.285612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.285616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.285620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.285623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.285628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.285658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:55.296993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:55.298756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:55.298778Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:55.298781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:55.298786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:55.298792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [2:7556554015514254915:3646]
2025-10-02T09:28:55.298811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:55.298830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:55.298837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.298841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.298843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.298859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:55.298868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:55.298875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:55.298941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.298948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.298950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.298953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:55.298956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:55.299021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:55.299028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.299041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.299057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.299077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:55.299099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774437:2446], now have 1 active actors on pipe
2025-10-02T09:28:55.299108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774520:4025], now have 1 active actors on pipe
2025-10-02T09:28:55.299114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.299116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.299118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.299131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:55.299160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:55.299174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:55.299177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:55.299182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:55.299186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:55.299187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:55.299207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.299210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:55.299223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:55.299242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.299246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.299273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a304bead-14b15ee7-62e54294-cda26c3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:55.299278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.299281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.299283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:55.299293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.299308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:55.299322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.299501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.299511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.299527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.299957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe89e26-208019de-51420f18-b2be08dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a304bead-14b15ee7-62e54294-cda26c3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:55.302814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Write session: try to update token
2025-10-02T09:28:55.302832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:55.299169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 257
2025-10-02T09:28:55.299174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 257
2025-10-02T09:28:55.299641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 36 sessionId: src_id|a304bead-14b15ee7-62e54294-cda26c3c_0
2025-10-02T09:28:55.317502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:55.317527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.317535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.317576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:55.317586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:55.317799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:55.317925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.318054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.318192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.318381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:55.318428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:55.321069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|a304bead-14b15ee7-62e54294-cda26c3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:55.323730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:55.324687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.324709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.324725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:55.324728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.324731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:55.324732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:55.324741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.324745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.324751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554015514254908:3646]
2025-10-02T09:28:55.324794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:55.324818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:55.324823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.324824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:55.324825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:55.324828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:55.324964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:55.366696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554015589774545:3694]
2025-10-02T09:28:55.366967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7556554015589774545:3694]
2025-10-02T09:28:55.466739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:55.467361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:55.467399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774545:3694], now have 1 active actors on pipe
2025-10-02T09:28:55.467505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:55.467570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554015589774545:3694]
2025-10-02T09:28:55.467595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:55.467605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:55.467609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:55.467679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: error at write: Disconnected sessionId: src_id|a304bead-14b15ee7-62e54294-cda26c3c_0
2025-10-02T09:28:55.467847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|a304bead-14b15ee7-62e54294-cda26c3c_0 is DEAD
2025-10-02T09:28:55.467974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:55.467986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Write session will restart in 0.006380s
2025-10-02T09:28:55.468010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Write session: Do CDS request
2025-10-02T09:28:55.468020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:55.475356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.475463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:55.475485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-10-02T09:28:55.475597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.475630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:55.475634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:55.475639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:55.476011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:55.476048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-10-02T09:28:55.476079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:55.476086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:55.476088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:55.476093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554015589774592:4030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:55.476600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554015589774592:4030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:55.477407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:55.477575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:55.477583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:55.477592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:55.477636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:55.477670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554015514255011:3649]
2025-10-02T09:28:55.478209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:55.478245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554015589774592:4030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:55.478636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:55.478696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:55.479036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:55.479096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.479101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.479102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.479103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.479105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.479106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.479107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.479108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.479109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.479110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.479111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.479113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.479119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.479129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.479143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.479147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.479150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.479154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.479158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.479162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.479166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.479169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.479173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.479177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.479185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.479193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.479201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.479207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.479215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.479220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.479228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.479236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.479244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.479249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.479256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.479261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.479265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.479271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.479275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.479280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.479294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.479299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.479303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.479307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.479312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.479317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.479322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.479326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.479356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:55.485011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554015589774592:4030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:55.485027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554015589774592:4030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:55.485031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554015589774592:4030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:55.485045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:55.492470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:55.494248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:55.494267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:55.494271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:55.494274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:55.494280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [2:7556554015514255011:3649]
2025-10-02T09:28:55.494295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:55.494310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:55.494313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.494315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.494317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.494333Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:55.494337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:55.494344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:55.494395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.494405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.494407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.494409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:55.494412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:55.494472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:55.494480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.494494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.494506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.494525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:55.494546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774645:4030], now have 1 active actors on pipe
2025-10-02T09:28:55.494554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774547:2446], now have 1 active actors on pipe
2025-10-02T09:28:55.494560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.494562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.494565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.494583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:55.494598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:55.494601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:55.494609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:55.494611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:55.494616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:55.494618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:55.494651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.494663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:55.494649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 258
2025-10-02T09:28:55.494683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 258
2025-10-02T09:28:55.494687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:55.494721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.494729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.494753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:55.494764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.494767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.494768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:55.494776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.494784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:55.494797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.494978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.494985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.494997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.495089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 36 sessionId: src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0
2025-10-02T09:28:55.495430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a304bead-14b15ee7-62e54294-cda26c3c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:55.501317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Write session: try to update token
2025-10-02T09:28:55.501338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:55.508022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:55.508043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.508051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.508089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:55.508104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:55.508283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:55.508440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.508571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.508732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.508932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:55.508970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:55.516814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:55.522233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:55.522252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.522254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:55.522255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:55.522262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.522265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.522268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554015514255005:3649]
2025-10-02T09:28:55.522301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:55.522307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.522309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:55.522339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:55.522350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:55.522352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:55.522450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:55.523710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:55.567932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554015589774663:3694]
2025-10-02T09:28:55.568186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7556554015589774663:3694]
2025-10-02T09:28:55.649946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:55.650259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.650272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.650288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774663:3694], now have 1 active actors on pipe
2025-10-02T09:28:55.650489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554015589774663:3694]
2025-10-02T09:28:55.650503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:55.650507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:55.650520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:55.650566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: error at write: Disconnected sessionId: src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0
2025-10-02T09:28:55.650508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:55.650737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0 is DEAD
2025-10-02T09:28:55.650892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:55.650903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Write session will restart in 0.005496s
2025-10-02T09:28:55.650926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Write session: Do CDS request
2025-10-02T09:28:55.650933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:55.657779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.657845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:55.657862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-10-02T09:28:55.658337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.658384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:55.658394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:55.658400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:55.658833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-10-02T09:28:55.658869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:55.658870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:55.658872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:55.658877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554015589774710:4041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:55.659434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554015589774710:4041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:55.661871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554015589774710:4041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:55.664792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554015589774710:4041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:55.664777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:55.664822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554015589774710:4041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:55.664825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554015589774710:4041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:55.664833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:55.666605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:55.666801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:55.666810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:55.666820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:55.666873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:55.666915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554015514255135:3663]
2025-10-02T09:28:55.667518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:55.667834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:55.667876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:55.668128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:55.668165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.668169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.668170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.668171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.668172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.668172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.668175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.668176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.668176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.668177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.668178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.668179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.668182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.668190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.668193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.668195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.668197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.668199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.668202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.668205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.668209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.668213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.668216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.668220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.668225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.668234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.668239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.668250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.668258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.668261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.668264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.668267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.668270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.668273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.668275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.668279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.668281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.668285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.668288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.668291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.668293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.668296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.668305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.668314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.668322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.668331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.668338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.668341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.668361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:55.679409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:55.681088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:55.681103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:55.681106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:55.681110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:55.681116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [2:7556554015514255135:3663]
2025-10-02T09:28:55.681130Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:55.681147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:55.681150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.681152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.681154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.681169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:55.681174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:55.681179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:55.681241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.681252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.681254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.681256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:55.681259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:55.681319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:55.681331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.681343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.681354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.681369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:55.681389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774746:4041], now have 1 active actors on pipe
2025-10-02T09:28:55.681397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774665:2446], now have 1 active actors on pipe
2025-10-02T09:28:55.681403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.681404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.681406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.681416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:55.681429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:55.681438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:55.681441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:55.681443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:55.681445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:55.681447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:55.681476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.681486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:55.681477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 259
2025-10-02T09:28:55.681479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 259
2025-10-02T09:28:55.681504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:55.681519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.681522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.681553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:55.681564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.681566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.681567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:55.681573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.681581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:55.681594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.681695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.681701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.681709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.681767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 36 sessionId: src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0
2025-10-02T09:28:55.682096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a198dc9-8b491eb8-8e8a53cb-b805132d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:55.684921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Write session: try to update token
2025-10-02T09:28:55.684933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:55.694554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:55.694577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.694584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.694619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:55.694622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:55.694770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:55.694905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.695033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.695170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.695341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:55.695376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:55.697932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:55.700551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:55.700765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.700784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.700827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:55.700895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:55.707466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:55.707482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.707484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:55.707486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:55.707495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.707501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.707504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554015514255129:3663]
2025-10-02T09:28:55.707535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:55.707541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.707543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:55.707547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:55.707561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:55.707565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:55.707673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:55.750703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554015589774764:3694]
2025-10-02T09:28:55.750968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7556554015589774764:3694]
2025-10-02T09:28:55.848794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:55.856419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.856447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.856615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.856684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.856756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.856866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.856916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.856926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.857010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.857080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.857156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.857224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.857274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.857281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.857347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.857409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.857473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.857540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.857583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.857586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.857649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.857713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.857779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.857839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.857883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.857885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.857959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.858021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.858122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.858186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.858229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.858232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.858300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.858356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.858416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.858481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.858537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.858540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.858606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.858664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.858732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.858794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.858853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.858856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.858921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.858982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.859038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.859096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.859207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.859210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.859275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.859331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.859391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.859448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.859486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.859490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.859562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:55.859618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:55.859679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:55.859738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:55.859864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:55.859868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:55.859931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774764:3694], now have 1 active actors on pipe
2025-10-02T09:28:55.860753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:55.862041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:55.862053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Write session will restart in 0.007192s
2025-10-02T09:28:55.862077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Write session: Do CDS request
2025-10-02T09:28:55.862083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:55.861620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:55.861674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554015589774764:3694]
2025-10-02T09:28:55.861687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:55.861731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0
2025-10-02T09:28:55.861930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0 is DEAD
2025-10-02T09:28:55.870622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.870697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:55.870714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-10-02T09:28:55.871031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:55.871070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:55.871079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:55.871084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:55.871524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-10-02T09:28:55.871565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:55.871566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:55.871568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:55.871573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554015589774805:4046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:55.872069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554015589774805:4046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:55.873762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:55.874563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554015589774805:4046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:55.875437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:55.875626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:55.875637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:55.875648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:55.875704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:55.875745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554015514255223:3666]
2025-10-02T09:28:55.876303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:55.877680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:55.877730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:55.877616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554015589774805:4046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:55.877632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554015589774805:4046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:55.877636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554015589774805:4046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:55.877643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:55.878046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:55.878095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.878101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.878101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.878102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.878103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.878103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.878104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.878105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.878105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.878106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.878107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.878107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.878111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.878119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.878121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.878130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.878133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.878135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.878139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.878141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.878143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.878146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.878148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.878150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.878154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.878158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:55.878162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.878165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:55.878167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.878170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:55.878173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.878175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:55.878178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.878181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:55.878184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.878187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:55.878189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.878192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:55.878194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.878197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:55.878200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.878203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:55.878205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.878208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.878211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.878214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.878216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.878219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.878237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:55.890126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:55.891816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:55.891840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:55.891843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:55.891847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:55.891855Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [2:7556554015514255223:3666]
2025-10-02T09:28:55.891870Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:55.891886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:55.891890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.891893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.891896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.891912Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:55.891917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:55.891924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:55.891984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.891994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.891996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.892000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:55.892003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:55.892068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:55.892071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.892083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:55.892096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:55.892113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:55.892128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.892133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.892136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.892143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:55.892155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:55.892160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:55.892163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:55.892166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:55.892169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:55.892171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:55.892179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774855:4046], now have 1 active actors on pipe
2025-10-02T09:28:55.892212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774770:2446], now have 1 active actors on pipe
2025-10-02T09:28:55.892214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.892222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:55.892245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:55.892277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 260
2025-10-02T09:28:55.892282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 260
2025-10-02T09:28:55.892388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.892398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.892421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:55.892432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:55.892436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:55.892443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:55.892451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:55.892464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:55.892478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.892719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.892734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.892759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:55.892864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 36 sessionId: src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0
2025-10-02T09:28:55.893217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da8f71e-ab8ed1ab-d5508149-8f2ace25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:55.896051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Write session: try to update token
2025-10-02T09:28:55.896068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:55.905362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:55.905386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.905397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.905440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:55.905447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:55.905607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:55.905751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.905889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.906031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:55.906218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:55.906259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:55.910369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:55.912842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:55.913034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:55.913067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:55.913096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:55.913190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:55.915932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:55.915949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:55.915951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:55.915954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:55.915963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.915970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.915974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554015514255217:3666]
2025-10-02T09:28:55.916010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:55.916016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:55.916019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:55.916032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:55.916038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:55.916041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:55.916150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:55.961637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554015589774864:3694]
2025-10-02T09:28:55.961910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7556554015589774864:3694]
2025-10-02T09:28:56.044273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:56.050199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.050222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.050357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.050407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.050459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.050512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.050550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.050559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.050613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.050661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.050711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.050767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.050849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.050855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.050908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.050957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.051008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.051060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.051096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.051101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.051164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.051217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.051266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.051317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.051352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.051356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.051411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.051460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.051511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.051563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.051599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.051604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.051655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.051718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.051772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.051824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.051871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.051876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.051935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.051990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.052043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.052094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.052143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.052150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.052203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.052252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.052300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.052347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.052383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.052388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.052437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.052486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.052534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.052584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.052621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.052626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.052680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.052741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.052815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.052864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.052904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.052909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.052940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554015589774864:3694], now have 1 active actors on pipe
2025-10-02T09:28:56.053130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:56.053143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:56.053147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:56.053163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: error at write: Disconnected sessionId: src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0
2025-10-02T09:28:56.053189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554015589774864:3694]
2025-10-02T09:28:56.053307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0 is DEAD
2025-10-02T09:28:56.053438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:56.053447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Write session will restart in 0.006893s
2025-10-02T09:28:56.053433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:56.053469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Write session: Do CDS request
2025-10-02T09:28:56.053474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:56.060131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:56.061170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.061277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.061291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-10-02T09:28:56.061390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.061417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:56.061427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:56.061434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.061532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:56.061657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:56.061664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:56.061670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:56.061706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:56.061738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554019809222607:3668]
2025-10-02T09:28:56.061780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-10-02T09:28:56.061806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.061811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.061812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.061816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554019884742212:4050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.062135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:56.062161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554019884742212:4050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:56.062366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:56.062391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:56.062611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:56.062649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.062656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.062657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.062657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.062658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.062659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.062659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.062660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.062661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.062661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.062662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.062662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.062665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.062672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.062674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.062676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.062678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.062680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.062682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.062684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.062686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.062690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.062692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.062694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.062698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.062701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.062704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.062707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.062710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.062712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.062715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.062717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.062720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.062722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.062724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.062727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.062729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.062732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.062733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.062736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.062738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.062741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.062743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.062746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.062748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.062752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.062754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.062757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.062783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:56.063953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554019884742212:4050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:56.070834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554019884742212:4050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:56.070849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554019884742212:4050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:56.070853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554019884742212:4050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:56.070860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:56.071749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:56.073323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:56.073338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:56.073339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:56.073344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:56.073349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [2:7556554019809222607:3668]
2025-10-02T09:28:56.073359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:56.073370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:56.073372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.073374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.073375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.073385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:56.073388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:56.073393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:56.073431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.073436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.073437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.073439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:56.073441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:56.073493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:56.073499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.073507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.073512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.073520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:56.073533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742163:2446], now have 1 active actors on pipe
2025-10-02T09:28:56.073541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.073542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.073543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.073552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:56.073559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742251:4050], now have 1 active actors on pipe
2025-10-02T09:28:56.073563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:56.073566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:56.073567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:56.073567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:56.073578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:56.073586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:56.073613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.073623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:56.073603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 261
2025-10-02T09:28:56.073627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:56.073605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 261
2025-10-02T09:28:56.073654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.073660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.073674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:56.073681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.073684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.073685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:56.073691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.073697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:56.073712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.073828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.073839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.073856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.073923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 36 sessionId: src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0
2025-10-02T09:28:56.074259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4000c5f9-cc2a7de6-608cde1d-b77f89be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:56.076771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Write session: try to update token
2025-10-02T09:28:56.076795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:56.083409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:56.083427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.083435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.083467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:56.083471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:56.083622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:56.083750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:56.083882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:56.084007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:56.084191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:56.084228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:56.090768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:56.092611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:56.092627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.092628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:56.092632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:56.092638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.092641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.092643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554019809222602:3668]
2025-10-02T09:28:56.092671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:56.092675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.092676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:56.092693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:56.092711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:56.092715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:56.092844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:56.093178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:56.153122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554019884742260:3694]
2025-10-02T09:28:56.153350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7556554019884742260:3694]
2025-10-02T09:28:56.219697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:56.220006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.220020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.220037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742260:3694], now have 1 active actors on pipe
2025-10-02T09:28:56.220259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:56.220247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:56.220282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554019884742260:3694]
2025-10-02T09:28:56.220295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:56.220298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:56.220356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: error at write: Disconnected sessionId: src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0
2025-10-02T09:28:56.220518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0 is DEAD
2025-10-02T09:28:56.220704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:56.220714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Write session will restart in 0.005011s
2025-10-02T09:28:56.220736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Write session: Do CDS request
2025-10-02T09:28:56.220741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:56.227318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.227606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.227630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-10-02T09:28:56.227736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.227763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:56.227771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:56.227775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.228115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:56.228156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-10-02T09:28:56.228185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.228190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.228191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.228196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554019884742311:4055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.228667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554019884742311:4055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:56.229589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:56.229739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:56.229748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:56.229756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:56.229798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:56.229837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554019809222698:3671]
2025-10-02T09:28:56.230349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:56.231228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:56.231269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:56.231538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:56.231590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.231596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.231597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.231598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.231598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.231599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.231600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.231601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.231602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.231607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554019884742311:4055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:56.231603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.231604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.231604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.231609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.231618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.231621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.231624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.231627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.231630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.231634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.231637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.231640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.231643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.231646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.231649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.231657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.231663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.231667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.231672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.231675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.231680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.231683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.231688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.231692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.231695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.231699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.231703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.231707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.231711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.231714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.231718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.231721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.231725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.231729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.231733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.231737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.231741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.231745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.231749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.231778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:56.237678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554019884742311:4055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:56.237697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554019884742311:4055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:56.237702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554019884742311:4055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:56.237709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:56.241108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:56.242737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:56.242754Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:56.242756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:56.242760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:56.242767Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [2:7556554019809222698:3671]
2025-10-02T09:28:56.242781Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:56.242803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:56.242811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.242813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.242815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.242829Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:56.242838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:56.242845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:56.242907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.242913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.242915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.242917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:56.242920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:56.242987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:56.242994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.243006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.243021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.243041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:56.243063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742352:4055], now have 1 active actors on pipe
2025-10-02T09:28:56.243073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742262:2446], now have 1 active actors on pipe
2025-10-02T09:28:56.243079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.243082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.243083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.243095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:56.243106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:56.243117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:56.243118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:56.243120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:56.243121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:56.243122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:56.243161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.243170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:56.243149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 262
2025-10-02T09:28:56.243153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 262
2025-10-02T09:28:56.243178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:56.243203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.243208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.243232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dae156b-d5352940-16116487-72797dbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:56.243242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.243245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.243246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:56.243254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.243265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:56.243279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.243395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.243400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.243410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.243470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dae156b-d5352940-16116487-72797dbb_0
2025-10-02T09:28:56.243784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f5cfbd-f405958-5bb7c906-5ab25028_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dae156b-d5352940-16116487-72797dbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:56.246750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Write session: try to update token
2025-10-02T09:28:56.246771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:56.254631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:56.254653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.254655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:56.254657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:56.254664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.254669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.254672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554019809222693:3671]
2025-10-02T09:28:56.254705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:56.254713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.254716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:56.254717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:56.254723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:56.254727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:56.254854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:56.260975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|8dae156b-d5352940-16116487-72797dbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:56.263344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:56.320581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554019884742359:3694]
2025-10-02T09:28:56.320894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7556554019884742359:3694]
2025-10-02T09:28:56.394281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:56.394587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.394601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.394616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742359:3694], now have 1 active actors on pipe
2025-10-02T09:28:56.394828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:56.394840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554019884742359:3694]
2025-10-02T09:28:56.394844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:56.394908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: error at write: Disconnected sessionId: src_id|8dae156b-d5352940-16116487-72797dbb_0
2025-10-02T09:28:56.394940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:56.394882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:56.395259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:56.395270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Write session will restart in 0.006952s
2025-10-02T09:28:56.395289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Write session: Do CDS request
2025-10-02T09:28:56.395298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:56.395089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|8dae156b-d5352940-16116487-72797dbb_0 is DEAD
2025-10-02T09:28:56.403332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.403452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.403468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-10-02T09:28:56.403469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:56.403609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.403640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:56.403648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:56.403653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.404069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-10-02T09:28:56.404107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.404111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.404113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.404118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554019884742425:4060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.404613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554019884742425:4060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:56.405365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:56.405549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:56.405559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:56.405568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:56.405615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:56.405652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554019809222801:3674]
2025-10-02T09:28:56.406230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:56.406421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554019884742425:4060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:56.406526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:56.406566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:56.406872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:56.406918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.406925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.406926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.406927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.406928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.406929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.406930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.406931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.406932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.406933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.406934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.406934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.406939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.406948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.406951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.406954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.406956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.406958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.406960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.406962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.406964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.406966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.406968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.406970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.406974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.406979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.406982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.406985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.406988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.406991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.406993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.406997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.407002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.407006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.407010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.407014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.407018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.407023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.407026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.407029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.407033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.407036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.407038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.407041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.407043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.407046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.407049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.407051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.407069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:56.411686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554019884742425:4060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:56.411704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554019884742425:4060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:56.411707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554019884742425:4060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:56.411715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:56.416470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:56.418080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:56.418100Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:56.418102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:56.418106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:56.418110Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [2:7556554019809222801:3674]
2025-10-02T09:28:56.418121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:56.418135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:56.418141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.418143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.418145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.418156Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:56.418160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:56.418168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:56.418215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.418219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.418220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.418222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:56.418224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:56.418280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:56.418291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.418302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.418312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.418327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:56.418346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742464:4060], now have 1 active actors on pipe
2025-10-02T09:28:56.418354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742373:2446], now have 1 active actors on pipe
2025-10-02T09:28:56.418360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.418362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.418364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.418374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:56.418387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:56.418389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:56.418398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:56.418400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:56.418402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:56.418404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:56.418430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 263
2025-10-02T09:28:56.418435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 263
2025-10-02T09:28:56.418438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.418449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:56.418468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:56.418482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.418487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.418515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:56.418523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.418526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.418528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:56.418536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.418544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:56.418556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.418850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.418863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.418878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.418973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 36 sessionId: src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0
2025-10-02T09:28:56.419377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dae156b-d5352940-16116487-72797dbb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:56.422329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Write session: try to update token
2025-10-02T09:28:56.422347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:56.430346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:56.430366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.430369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:56.430371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:56.430383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.430387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.430390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554019809222796:3674]
2025-10-02T09:28:56.430425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:56.430430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.430433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:56.430433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:56.430440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:56.430443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:56.430570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:56.436633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:56.439253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:56.495305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554019884742474:3694]
2025-10-02T09:28:56.495722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7556554019884742474:3694]
2025-10-02T09:28:56.568216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:56.568518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.568530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.568543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742474:3694], now have 1 active actors on pipe
2025-10-02T09:28:56.568678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:56.568711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:56.568725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:56.568743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554019884742474:3694]
2025-10-02T09:28:56.568759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:56.568786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: error at write: Disconnected sessionId: src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0
2025-10-02T09:28:56.568961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0 is DEAD
2025-10-02T09:28:56.569089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:56.569100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Write session will restart in 0.006550s
2025-10-02T09:28:56.569125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Write session: Do CDS request
2025-10-02T09:28:56.569131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:56.575979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:56.577344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.577495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:56.577547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.577560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-10-02T09:28:56.577654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.577660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:56.577669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:56.577677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:56.577674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:56.577681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:56.577684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.577727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:56.577759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554019809222928:3688]
2025-10-02T09:28:56.578056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-10-02T09:28:56.578092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.578098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.578099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.578103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554019884742553:4073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.578304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:56.578536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554019884742553:4073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:56.578591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:56.578626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:56.578892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:56.578942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.578947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.578950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.578950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.578951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.578953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.578954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.578955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.578956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.578956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.578958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.578959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.578964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.578973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.578976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.578979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.578983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.578987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.578991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.578994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.578997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.579001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.579005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.579008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.579013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.579019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.579024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.579029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.579034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.579039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.579043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.579047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.579051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.579057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.579060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.579064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.579068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.579072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.579075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.579079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.579087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.579092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.579096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.579101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.579109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.579114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.579121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.579125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.579167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:56.581755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554019884742553:4073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:56.588421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554019884742553:4073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:56.588440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554019884742553:4073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:56.588444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554019884742553:4073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:56.588453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:56.588690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:56.590163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:56.590182Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:56.590185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:56.590189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:56.590193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [2:7556554019809222928:3688]
2025-10-02T09:28:56.590202Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:56.590214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:56.590216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.590218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.590219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.590240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:56.590247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:56.590252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:56.590301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.590306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.590307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.590310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:56.590311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:56.590359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:56.590365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.590374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.590383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.590396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:56.590410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.590414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.590416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.590426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:56.590439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:56.590441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742501:2446], now have 1 active actors on pipe
2025-10-02T09:28:56.590445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742589:4073], now have 1 active actors on pipe
2025-10-02T09:28:56.590450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:56.590450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:56.590453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:56.590459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:56.590461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:56.590483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.590491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:56.590498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:56.590508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 264
2025-10-02T09:28:56.590515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 264
2025-10-02T09:28:56.590608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.590615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.590629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:56.590636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.590639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.590641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:56.590646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.590652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:56.590660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.590776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.590781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.590789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.590845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 36 sessionId: src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0
2025-10-02T09:28:56.591170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a0f6bd-49f41b4f-6ff253f3-8de261d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:56.593905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Write session: try to update token
2025-10-02T09:28:56.593922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:56.606572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:56.606595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.606607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.606648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:56.606655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:56.606839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:56.606983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:56.607163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:56.607247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:56.607296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:56.607496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:56.607542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:56.609795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:56.609975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.609991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.610024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:56.610103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:56.611477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:56.611492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.611495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:56.611496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:56.611505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.611513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.611515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554019809222923:3688]
2025-10-02T09:28:56.611547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:56.611556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.611558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:56.611556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:56.611561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:56.611564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:56.611679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:56.668715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554019884742596:3694]
2025-10-02T09:28:56.668936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7556554019884742596:3694]
2025-10-02T09:28:56.751783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:56.759060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.759092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.759259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.759326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.759391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.759459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.759507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.759517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.759593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.759655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.759718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.759782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.759897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.759907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.759973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.760036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.760102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.760172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.760216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.760226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.760290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.760355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.760417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.760477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.760520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.760527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.760597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.760662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.760722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.760784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.760849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.760856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.760930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.760995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.761060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.761125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.761170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.761177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.761241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.761305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.761375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.761438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.761484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.761493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.761555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.761615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.761736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.761802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.761859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.761866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.761931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.761992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.762056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.762289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.762337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.762344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.762440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:56.762500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:56.762562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:56.762669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:56.762714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:56.762721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:56.762780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742596:3694], now have 1 active actors on pipe
2025-10-02T09:28:56.763034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:56.763081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:56.763086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:56.763108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: error at write: Disconnected sessionId: src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0
2025-10-02T09:28:56.763213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554019884742596:3694]
2025-10-02T09:28:56.763244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0 is DEAD
2025-10-02T09:28:56.763390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:56.763401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Write session will restart in 0.009210s
2025-10-02T09:28:56.763423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Write session: Do CDS request
2025-10-02T09:28:56.763429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:56.763656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:56.772065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:56.773386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.773460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:56.773589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.773600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-10-02T09:28:56.773636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:56.773649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:56.773659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:56.773691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.773715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:56.773718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:56.773726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:56.773729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.773749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554019809223022:3691]
2025-10-02T09:28:56.774047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-10-02T09:28:56.774074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.774078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.774079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.774084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554019884742659:4078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.774271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:56.774434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554019884742659:4078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:56.774551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:56.774594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:56.774885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:56.774953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.774960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.774960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.774961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.774962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.774963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.774964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.774966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.774967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.774968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.774969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.774970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.774974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.774983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.774986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.774989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.774992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.774998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.775002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.775004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.775008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.775011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.775014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.775018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.775024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.775031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.775036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.775041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.775045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.775050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.775060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.775064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.775068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.775074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.775077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.775082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.775087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.775091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.775099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.775103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.775106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.775110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.775116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.775120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.775125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.775144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.775152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.775157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.775193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:56.776653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554019884742659:4078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:56.782310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554019884742659:4078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:56.782326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554019884742659:4078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:56.782329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554019884742659:4078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:56.782337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:56.783768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:56.785763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:56.785781Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:56.785784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:56.785788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:56.785794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [2:7556554019809223022:3691]
2025-10-02T09:28:56.785806Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:56.785823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:56.785826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.785829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.785831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.785846Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:56.785852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:56.785857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:56.785904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.785911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.785913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.785916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:56.785918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:56.785973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:56.785979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.785991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.786007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.786027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:56.786046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.786053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.786054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.786063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:56.786072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:56.786074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:56.786075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:56.786076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:56.786087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:56.786089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:56.786099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742701:4078], now have 1 active actors on pipe
2025-10-02T09:28:56.786103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742606:2446], now have 1 active actors on pipe
2025-10-02T09:28:56.786132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.786142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:56.786168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:56.786190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 265
2025-10-02T09:28:56.786236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 265
2025-10-02T09:28:56.786332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.786347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.786374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:56.786386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.786389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.786396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:56.786403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.786415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:56.786433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.786580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.786589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.786602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.786697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0
2025-10-02T09:28:56.787043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168636b9-dd9d9558-1e77ea0c-91a6091a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:56.789892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Write session: try to update token
2025-10-02T09:28:56.789906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:56.797858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:56.797879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.797880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:56.797882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:56.797889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.797896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.797898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554019809223017:3691]
2025-10-02T09:28:56.797929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:56.797933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.797934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:56.797955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:56.797979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:56.797986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:56.798075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:56.806462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:56.808923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:56.863280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554019884742709:3694]
2025-10-02T09:28:56.863505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7556554019884742709:3694]
2025-10-02T09:28:56.924312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:56.924612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.924621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.924635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742709:3694], now have 1 active actors on pipe
2025-10-02T09:28:56.924826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:56.924888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:56.924938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554019884742709:3694]
2025-10-02T09:28:56.924980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:56.925051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0
2025-10-02T09:28:56.925208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0 is DEAD
2025-10-02T09:28:56.925375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:56.925386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Write session will restart in 0.007662s
2025-10-02T09:28:56.925407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Write session: Do CDS request
2025-10-02T09:28:56.925413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:56.931894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:56.933351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:56.933514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:56.933523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:56.933530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:56.933570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:56.933598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554019809223115:3693]
2025-10-02T09:28:56.934029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:56.934276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.934366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:56.934385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:56.934399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-10-02T09:28:56.934423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:56.934494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:56.934518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:56.934523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:56.934527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:56.934661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:56.934696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.934701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.934702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.934702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.934703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.934703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.934704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.934705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.934705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.934706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.934706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.934707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.934710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.934717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.934721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.934725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.934728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.934731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.934734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.934739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.934742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.934746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.934749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.934752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.934758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.934765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:56.934770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.934775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:56.934779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.934784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:56.934787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.934790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:56.934793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.934795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:56.934797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.934800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:56.934802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.934805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:56.934808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.934810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:56.934814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.934816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:56.934818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.934821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.934835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.934838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.934840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.934843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.934864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:56.934881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-10-02T09:28:56.934913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:56.934919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:56.934921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:56.934925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554019884742767:4082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:56.935421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554019884742767:4082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:56.937193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554019884742767:4082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:56.942659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554019884742767:4082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:56.942675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554019884742767:4082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:56.942679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554019884742767:4082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:56.942687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:56.943283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:56.944843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:56.944857Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:56.944859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:56.944862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:56.944866Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [2:7556554019809223115:3693]
2025-10-02T09:28:56.944875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:56.944887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:56.944889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.944890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.944891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.944902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:56.944906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:56.944911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:56.944952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.944958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.944959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.944961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:56.944962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:56.945008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:56.945014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.945021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:56.945027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:56.945036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:56.945048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.945053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.945056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.945061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:56.945070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742804:4082], now have 1 active actors on pipe
2025-10-02T09:28:56.945071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:56.945074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:56.945076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:56.945079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:56.945087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:56.945092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:56.945096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554019884742711:2446], now have 1 active actors on pipe
2025-10-02T09:28:56.945117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.945124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:56.945141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 266
2025-10-02T09:28:56.945146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 266
2025-10-02T09:28:56.945141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:56.945206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.945214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.945240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:56.945251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:56.945258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:56.945260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:56.945269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:56.945282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:56.945298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.945458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:56.945465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:56.945481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:56.945593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0
2025-10-02T09:28:56.945909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c641335-8e5b56e3-afeeb79c-3a04c04b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:56.948476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Write session: try to update token
2025-10-02T09:28:56.948488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:56.955724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:56.955742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:56.955744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:56.955746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:56.955755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.955762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.955769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554019809223110:3693]
2025-10-02T09:28:56.955805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:56.955812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:56.955815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:56.955818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:56.955818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:56.955821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:56.955978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:56.962934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:56.965495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:57.025080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554024179710108:3694]
2025-10-02T09:28:57.025400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7556554024179710108:3694]
2025-10-02T09:28:57.087925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:57.088318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.088332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.088349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710108:3694], now have 1 active actors on pipe
2025-10-02T09:28:57.088559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:57.088624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554024179710108:3694]
2025-10-02T09:28:57.088628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:57.088659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:57.088726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0
2025-10-02T09:28:57.088917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0 is DEAD
2025-10-02T09:28:57.089084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:57.089091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Write session will restart in 0.006980s
2025-10-02T09:28:57.089108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Write session: Do CDS request
2025-10-02T09:28:57.089112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:57.097274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.097295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:57.097372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:57.097392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-10-02T09:28:57.097523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.097563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:57.097573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:57.097577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:57.097936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-10-02T09:28:57.097971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:57.097976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:57.097977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:57.097982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554024179710166:4087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:57.098464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554024179710166:4087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:57.098998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:57.099182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:57.099190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:57.099199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:57.099243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:57.099281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554024104190507:3696]
2025-10-02T09:28:57.100030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:57.100306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:57.100355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:57.100666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:57.100717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.100722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.100723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.100724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.100725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.100726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.100727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.100728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.100730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.100731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.100732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.100733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.100738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.100747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.100751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.100754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.100758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.100762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.100766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.100769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.100773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554024179710166:4087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:57.100772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.100776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.100780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.100783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.100789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.100795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.100815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.100821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.100825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.100830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.100833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.100838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.100842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.100846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.100850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.100854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.100858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.100863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.100868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.100872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.100876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.100881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.100885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.100890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.100894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.100900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.100903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.100908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.100954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:57.106854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554024179710166:4087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:57.106871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554024179710166:4087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:57.106875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554024179710166:4087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:57.106882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:57.109838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:57.111383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:57.111400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:57.111402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:57.111405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:57.111410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [2:7556554024104190507:3696]
2025-10-02T09:28:57.111419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:57.111431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:57.111433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.111435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.111436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.111448Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:57.111451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:57.111456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:57.111499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.111504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.111506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.111508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:57.111509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:57.111555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:57.111561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.111570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.111579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.111587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:57.111603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.111608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.111610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.111616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:57.111627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:57.111628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710205:4087], now have 1 active actors on pipe
2025-10-02T09:28:57.111632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:57.111638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:57.111639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:57.111640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:57.111642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:57.111646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710109:2446], now have 1 active actors on pipe
2025-10-02T09:28:57.111671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.111680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:57.111695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:57.111704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 267
2025-10-02T09:28:57.111711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 267
2025-10-02T09:28:57.111753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.111759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.111777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:57.111785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.111788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.111789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:57.111794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.111800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:57.111816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.111933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.111938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.111947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.112017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0
2025-10-02T09:28:57.112358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1060c9-683f37f4-7521d415-a12acdf1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:57.115146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Write session: try to update token
2025-10-02T09:28:57.115165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:57.126881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:57.126901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:57.126910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.126945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:57.126962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:57.127095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:57.127246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:57.127366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:57.127499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:57.127668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:57.127702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:57.129233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:57.131637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:57.132412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.132431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.132444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:57.132446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:57.132447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:57.132449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:57.132455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.132459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.132461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554024104190502:3696]
2025-10-02T09:28:57.132491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:57.132495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.132495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:57.132501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:57.132501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:57.132504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:57.132618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:57.188930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554024179710213:3694]
2025-10-02T09:28:57.189209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7556554024179710213:3694]
2025-10-02T09:28:57.258892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:57.259191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:57.259227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710213:3694], now have 1 active actors on pipe
2025-10-02T09:28:57.259312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:57.259349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:57.259390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554024179710213:3694]
2025-10-02T09:28:57.259404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:57.259408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:57.259470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: error at write: Disconnected sessionId: src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0
2025-10-02T09:28:57.259624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0 is DEAD
2025-10-02T09:28:57.259817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:57.259829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Write session will restart in 0.005346s
2025-10-02T09:28:57.259849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Write session: Do CDS request
2025-10-02T09:28:57.259855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:57.266238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.266329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:57.266344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-10-02T09:28:57.266443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.266476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:57.266486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:57.266489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:57.266680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:57.266885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-10-02T09:28:57.266915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:57.266921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:57.266923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:57.266927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554024179710270:4091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:57.267352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554024179710270:4091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:57.268014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:57.268166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:57.268175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:57.268184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:57.268234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:57.268264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554024104190602:3698]
2025-10-02T09:28:57.268656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:57.268770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554024179710270:4091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:57.268928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:57.268977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:57.269277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:57.269319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.269324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.269325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.269326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.269327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.269328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.269329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.269330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.269330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.269331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.269332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.269335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.269339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.269348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.269351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.269354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.269357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.269361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.269364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.269367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.269372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.269377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.269384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.269387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.269394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.269401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.269404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.269407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.269409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.269412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.269414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.269416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.269419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.269422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.269424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.269427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.269429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.269431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.269433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.269436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.269438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.269440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.269443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.269446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.269448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.269451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.269453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.269455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.269473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:57.273921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554024179710270:4091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:57.273935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554024179710270:4091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:57.273938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554024179710270:4091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:57.273944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:57.278013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:57.279549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:57.279563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:57.279565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:57.279568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:57.279572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [2:7556554024104190602:3698]
2025-10-02T09:28:57.279583Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:57.279595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:57.279597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.279599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.279601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.279613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:57.279616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:57.279621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:57.279669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.279675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.279679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.279681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:57.279683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:57.279740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:57.279746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.279753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.279764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.279773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:57.279786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710310:4091], now have 1 active actors on pipe
2025-10-02T09:28:57.279789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710214:2446], now have 1 active actors on pipe
2025-10-02T09:28:57.279793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.279794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.279797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.279805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:57.279814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:57.279825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:57.279827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:57.279830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:57.279831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:57.279832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:57.279857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.279864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:57.279857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 268
2025-10-02T09:28:57.279864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 268
2025-10-02T09:28:57.279886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:57.279958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.279965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.279986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:57.279992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.279995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.280004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:57.280012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.280024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:57.280037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.280196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.280209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.280232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.280311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0
2025-10-02T09:28:57.280602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc9084-ae7ccba3-ad7ccde-c9d5cd27_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:57.283566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Write session: try to update token
2025-10-02T09:28:57.283586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:57.290680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:57.290699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:57.290702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:57.290703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:57.290712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.290716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.290720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554024104190597:3698]
2025-10-02T09:28:57.290759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:57.290764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.290766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:57.290770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:57.290774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:57.290776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:57.290890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:57.297037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:57.299256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:57.359368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554024179710330:3694]
2025-10-02T09:28:57.359580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7556554024179710330:3694]
2025-10-02T09:28:57.417939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:57.418158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.418168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.418196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710330:3694], now have 1 active actors on pipe
2025-10-02T09:28:57.418384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:57.418478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:57.418487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554024179710330:3694]
2025-10-02T09:28:57.418490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:57.418506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:57.418547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: error at write: Disconnected sessionId: src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0
2025-10-02T09:28:57.418720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0 is DEAD
2025-10-02T09:28:57.418865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:57.418877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Write session will restart in 0.008366s
2025-10-02T09:28:57.418900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Write session: Do CDS request
2025-10-02T09:28:57.418906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:57.426292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:57.427465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:57.427612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:57.427622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:57.427630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:57.427668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:57.427700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554024104190710:3701]
2025-10-02T09:28:57.428246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.428266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:57.428354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:57.428375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-10-02T09:28:57.428561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:57.428556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.428581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:57.428584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:57.428587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:57.428599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:57.428907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:57.428964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.428969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.428970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.428971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.428972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.428973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.428973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.428974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.428975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.428976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.428977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.428978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.428982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.428991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.428987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-10-02T09:28:57.428994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.428998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.429001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.429004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.429008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.429011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.429021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:57.429014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.429028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:57.429017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.429020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.429023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.429029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.429035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.429040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.429044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.429047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.429052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.429055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.429064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.429068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.429076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.429069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:57.429083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.429081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554024179710390:4096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:57.429089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.429092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.429097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.429100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.429108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.429112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.429120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.429123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.429131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.429134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.429142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.429149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.429154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.429187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:57.429587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554024179710390:4096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:57.431173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554024179710390:4096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:57.436837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554024179710390:4096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:57.436851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554024179710390:4096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:57.436854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554024179710390:4096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:57.436862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:57.437342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:57.438893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:57.438912Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:57.438915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:57.438918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:57.438924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [2:7556554024104190710:3701]
2025-10-02T09:28:57.438936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:57.438951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:57.438954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.438956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.438958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.438971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:57.438975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:57.438982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:57.439041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.439049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.439051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.439054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:57.439056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:57.439101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:57.439108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.439116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.439122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.439140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:57.439153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.439154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.439156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.439161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:57.439171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:57.439172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:57.439175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:57.439177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:57.439180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:57.439182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:57.439189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710331:2446], now have 1 active actors on pipe
2025-10-02T09:28:57.439192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710427:4096], now have 1 active actors on pipe
2025-10-02T09:28:57.439215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.439228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:57.439266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:57.439266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 269
2025-10-02T09:28:57.439280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 269
2025-10-02T09:28:57.439374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.439382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.439399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:57.439403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.439406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.439407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:57.439415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.439422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:57.439431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.439599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.439608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.439616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.439685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 36 sessionId: src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0
2025-10-02T09:28:57.439988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c15fe58-758d2922-d8bd86c1-1588077c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:57.442761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Write session: try to update token
2025-10-02T09:28:57.442781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:57.449915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:57.449938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:57.449943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:57.449945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:57.449952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.449955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.449959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554024104190705:3701]
2025-10-02T09:28:57.449990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:57.449997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.449999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:57.450003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:57.450008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:57.450012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:57.450191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:57.455700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:57.458171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:57.518624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554024179710435:3694]
2025-10-02T09:28:57.518848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7556554024179710435:3694]
2025-10-02T09:28:57.595407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:57.595708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.595729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.595764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710435:3694], now have 1 active actors on pipe
2025-10-02T09:28:57.596049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:57.596078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:57.596105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:57.596111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:57.596170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: error at write: Disconnected sessionId: src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0
2025-10-02T09:28:57.596493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:57.596502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Write session will restart in 0.005395s
2025-10-02T09:28:57.596524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Write session: Do CDS request
2025-10-02T09:28:57.596529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:57.596350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0 is DEAD
2025-10-02T09:28:57.596598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554024179710435:3694]
2025-10-02T09:28:57.603505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.603615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:57.603631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-10-02T09:28:57.603768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.603809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:57.603813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:57.603818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:57.604185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-10-02T09:28:57.604208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:57.604209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:57.604211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:57.604215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554024179710474:4106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:57.604716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554024179710474:4106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:57.607053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554024179710474:4106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:57.607242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:57.609281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:57.609466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:57.609470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:57.609480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:57.609531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:57.609562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554024104190836:3709]
2025-10-02T09:28:57.610121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:57.610541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:57.610598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:57.610919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:57.610975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.610983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.610984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.610985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.610986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.610987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.610988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.610989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.610990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.610991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.610992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.610993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.610998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.611007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.611011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.611015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.611019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.611023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.611027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.611030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.611034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.611039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.611042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.611046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.611052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.611060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.611065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.611070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.611073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.611078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.611081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.611086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.611090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.611095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.611099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.611103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.611108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.611114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.611118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.611122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.611126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.611141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.611145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.611149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.611153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.611157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.611161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.611165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.611198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:57.619003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554024179710474:4106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:57.619021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554024179710474:4106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:57.619024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554024179710474:4106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:57.619031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:57.622225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:57.624088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:57.624110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:57.624112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:57.624116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:57.624123Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [2:7556554024104190836:3709]
2025-10-02T09:28:57.624135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:57.624152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:57.624155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.624158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.624160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.624174Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:57.624186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:57.624196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:57.624261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.624268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.624270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.624273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:57.624276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:57.624342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:57.624351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.624365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.624380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.624398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:57.624419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.624425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.624427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.624439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:57.624455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:57.624473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:57.624476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:57.624509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.624516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:57.624542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710449:2446], now have 1 active actors on pipe
2025-10-02T09:28:57.624551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710555:4106], now have 1 active actors on pipe
2025-10-02T09:28:57.624570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:57.624580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:57.624582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:57.624588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:57.624633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 270
2025-10-02T09:28:57.624678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 270
2025-10-02T09:28:57.624748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.624760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.624786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:57.624797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.624823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.624829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:57.624837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.624851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:57.624869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.625502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.625516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.625535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.625632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0
2025-10-02T09:28:57.625953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fc30ed1-dff0cbf6-676800f2-d16fa8f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:57.628968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Write session: try to update token
2025-10-02T09:28:57.628985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:57.639609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:57.639630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:57.639632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:57.639634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:57.639643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.639648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.639651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554024104190815:3709]
2025-10-02T09:28:57.639688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:57.639699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.639699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:57.639702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:57.639705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:57.639708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:57.639901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:57.652876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:57.655719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:57.696896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554024179710564:3694]
2025-10-02T09:28:57.697196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7556554024179710564:3694]
2025-10-02T09:28:57.790520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:57.790931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.790952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.790980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710564:3694], now have 1 active actors on pipe
2025-10-02T09:28:57.791211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:57.791254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554024179710564:3694]
2025-10-02T09:28:57.791258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:57.791260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:57.791331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: error at write: Disconnected sessionId: src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0
2025-10-02T09:28:57.791420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:57.791498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0 is DEAD
2025-10-02T09:28:57.791637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:57.791645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Write session will restart in 0.005683s
2025-10-02T09:28:57.791667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Write session: Do CDS request
2025-10-02T09:28:57.791673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:57.798380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.798511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:57.798526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-10-02T09:28:57.798645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.798671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:57.798679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:57.798683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:57.799048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-10-02T09:28:57.799082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:57.799087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:57.799089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:57.799094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554024179710630:4112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:57.799580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554024179710630:4112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:57.800244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:57.801631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554024179710630:4112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:57.801727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:57.801975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:57.801991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:57.802003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:57.802069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:57.802114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554024104190943:3718]
2025-10-02T09:28:57.802674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:57.802947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:57.802999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:57.803317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:57.803389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.803395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.803396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.803397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.803398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.803399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.803400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.803401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.803402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.803403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.803405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.803405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.803410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.803420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.803424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.803427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.803433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.803437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.803441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.803444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.803447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.803451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.803454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.803457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.803463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.803469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.803474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.803479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.803485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.803490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.803494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.803498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.803502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.803507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.803511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.803515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.803525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.803529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.803533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.803538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.803546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.803551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.803554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.803558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.803562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.803566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.803569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.803574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.803606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:57.803852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554024179710630:4112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:57.803867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554024179710630:4112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:57.803870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554024179710630:4112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:57.803877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:57.812177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:57.813712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:57.813729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:57.813730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:57.813733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:57.813738Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [2:7556554024104190943:3718]
2025-10-02T09:28:57.813750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:57.813764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:57.813767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.813769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.813771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.813786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:57.813796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:57.813804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:57.813856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.813861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.813864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.813867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:57.813870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:57.813922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:57.813931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.813945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.813956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.813976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:57.813997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710574:2446], now have 1 active actors on pipe
2025-10-02T09:28:57.814003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710671:4112], now have 1 active actors on pipe
2025-10-02T09:28:57.814007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.814008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.814010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.814018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:57.814028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:57.814032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:57.814034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:57.814037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:57.814036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:57.814038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:57.814061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.814068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:57.814080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:57.814056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 271
2025-10-02T09:28:57.814070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 271
2025-10-02T09:28:57.814099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.814109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.814137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9fad865-694d5680-c363193c-748bd37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:57.814147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.814155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.814157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:57.814173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.814184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:57.814198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.814320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.814326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.814335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.814388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9fad865-694d5680-c363193c-748bd37_0
2025-10-02T09:28:57.814702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2d6417-cd46db56-3da1dca5-3f8cb23c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9fad865-694d5680-c363193c-748bd37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:57.817562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Write session: try to update token
2025-10-02T09:28:57.817577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:57.824955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:57.824973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:57.824975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:57.824976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:57.824982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.824987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.824990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554024104190938:3718]
2025-10-02T09:28:57.825018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:57.825022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.825025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:57.825127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:57.825139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:57.825141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:57.825144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:57.831354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|d9fad865-694d5680-c363193c-748bd37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:57.833839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:57.891381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554024179710680:3694]
2025-10-02T09:28:57.891670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7556554024179710680:3694]
2025-10-02T09:28:57.967368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:57.967734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.967747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.967765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710680:3694], now have 1 active actors on pipe
2025-10-02T09:28:57.968115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:57.968453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:57.969051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:57.969062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Write session will restart in 0.008524s
2025-10-02T09:28:57.968560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9fad865-694d5680-c363193c-748bd37_0
2025-10-02T09:28:57.968646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554024179710680:3694]
2025-10-02T09:28:57.969084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Write session: Do CDS request
2025-10-02T09:28:57.968666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:57.969090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:57.968741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|d9fad865-694d5680-c363193c-748bd37_0 is DEAD
2025-10-02T09:28:57.977531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:57.978303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.978402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:57.978418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-10-02T09:28:57.978538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:57.978567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:57.978573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:57.978582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:57.978967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-10-02T09:28:57.979005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:57.979010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:57.979012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:57.979017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554024179710744:4116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:57.978984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:57.979179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:57.979189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:57.979200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:57.979247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:57.979284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554024104191043:3720]
2025-10-02T09:28:57.979556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554024179710744:4116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:57.979857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:57.980161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:57.980202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:57.980494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:57.980545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.980550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.980551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.980552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.980553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.980554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.980556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.980557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.980558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.980559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.980560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.980561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.980566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.980575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.980578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.980582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.980586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.980590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.980594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.980597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.980601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.980605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.980609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.980613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.980619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.980626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:57.980631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.980635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:57.980639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.980643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:57.980647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.980652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:57.980656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.980660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:57.980664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.980668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:57.980674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.980684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:57.980688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.980693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:57.980698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.980703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:57.980709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.980714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.980719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.980724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.980728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.980732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.980770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:57.981187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554024179710744:4116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:57.986599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554024179710744:4116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:57.986618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554024179710744:4116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:57.986622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554024179710744:4116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:57.986629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:57.989530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:57.991110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:57.991127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:57.991140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:57.991147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:57.991154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [2:7556554024104191043:3720]
2025-10-02T09:28:57.991168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:57.991185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:57.991192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.991196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.991197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.991214Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:57.991223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:57.991229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:57.991287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.991295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.991297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.991300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:57.991302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:57.991369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:57.991376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:57.991388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:57.991402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:57.991422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:57.991444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710779:4116], now have 1 active actors on pipe
2025-10-02T09:28:57.991452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554024179710684:2446], now have 1 active actors on pipe
2025-10-02T09:28:57.991458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:57.991466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:57.991468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:57.991495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:57.991508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:57.991510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:57.991514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:57.991517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:57.991526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:57.991530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:57.991560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:57.991572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:57.991575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:57.991588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.991592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.991632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:57.991642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:57.991645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:57.991647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:57.991656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:57.991666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:57.991690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.991893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:57.991897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:57.991914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:57.992364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fad865-694d5680-c363193c-748bd37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:57.991520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 272
2025-10-02T09:28:57.991527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 272
2025-10-02T09:28:57.992016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0
2025-10-02T09:28:57.995047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Write session: try to update token
2025-10-02T09:28:57.995062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:58.004052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:58.004073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.004076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:58.004077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:58.004085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:58.004090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:58.004094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554024104191038:3720]
2025-10-02T09:28:58.004133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:58.004141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:58.004145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.004147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:58.004147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:58.004151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:58.004273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:58.008123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:58.010921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:58.069048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554028474678083:3694]
2025-10-02T09:28:58.069400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7556554028474678083:3694]
2025-10-02T09:28:58.145928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:58.146297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.146311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.146349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678083:3694], now have 1 active actors on pipe
2025-10-02T09:28:58.150116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:58.150305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:58.150407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0
2025-10-02T09:28:58.150590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0 is DEAD
2025-10-02T09:28:58.150748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:58.150758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Write session will restart in 0.005902s
2025-10-02T09:28:58.150751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:58.150779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Write session: Do CDS request
2025-10-02T09:28:58.150785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:58.150789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554028474678083:3694]
2025-10-02T09:28:58.158348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.158444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:58.158463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-10-02T09:28:58.158617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.158673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:58.158683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:58.158687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:58.159212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-10-02T09:28:58.159248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:58.159256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:58.159258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:58.159263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554028474678107:4121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:58.159816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554028474678107:4121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:58.163715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554028474678107:4121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:58.163832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:58.165896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:58.166091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:58.166101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:58.166111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:58.166167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:58.166209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554028399158442:3723]
2025-10-02T09:28:58.166444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554028474678107:4121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:58.166458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554028474678107:4121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:58.166461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554028474678107:4121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:58.166468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:58.166793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:58.167261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:58.167313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:58.167641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:58.167707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.167716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.167717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.167718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.167719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.167720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.167721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.167723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.167723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.167724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.167725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.167726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.167732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.167742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.167746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.167750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.167753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.167757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.167761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.167764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.167768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.167772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.167776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.167779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.167786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.167793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.167798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.167803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.167807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.167812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.167816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.167821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.167825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.167830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.167833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.167838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.167842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.167847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.167852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.167857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.167861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.167865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.167870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.167874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.167878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.167889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.167893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.167898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.167934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:58.177915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:58.179913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:58.179934Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:58.179936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:58.179941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:58.179947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [2:7556554028399158442:3723]
2025-10-02T09:28:58.179961Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:58.179980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:58.179983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.179986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.179988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.180002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:58.180010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:58.180017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:58.180084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.180086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.180088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.180091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:58.180093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:58.180166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:58.180177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.180191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.180202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.180217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:58.180241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678089:2446], now have 1 active actors on pipe
2025-10-02T09:28:58.180250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678190:4121], now have 1 active actors on pipe
2025-10-02T09:28:58.180256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.180258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.180260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.180271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:58.180286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:58.180290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:58.180293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:58.180294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:58.180301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:58.180304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:58.180344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.180351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:58.180355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:58.180308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 273
2025-10-02T09:28:58.180353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 273
2025-10-02T09:28:58.180569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.180582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.180612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:58.180619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.180622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.180626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:58.180636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.180646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:58.180659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.181275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.181290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.181309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.181422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 36 sessionId: src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0
2025-10-02T09:28:58.185043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c9399-f9dfbf1e-ad53011-d5550775_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:58.187791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Write session: try to update token
2025-10-02T09:28:58.187811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:58.191403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:58.191433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.191444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.191487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:58.191492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:58.191835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:58.192054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.192265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.192422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.192691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:58.192725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:58.201188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:58.201441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:58.201461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.201463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:58.201465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:58.201473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.201477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.201480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554028399158437:3723]
2025-10-02T09:28:58.201509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:58.201513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:58.201514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:58.201517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:58.201519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.201524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:58.201654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:58.203583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:58.251043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554028474678202:3694]
2025-10-02T09:28:58.251326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7556554028474678202:3694]
2025-10-02T09:28:58.336163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:58.336384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.336393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.336407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678202:3694], now have 1 active actors on pipe
2025-10-02T09:28:58.336616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554028474678202:3694]
2025-10-02T09:28:58.336627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:58.336649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:58.336578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:58.336712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0
2025-10-02T09:28:58.336889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0 is DEAD
2025-10-02T09:28:58.337055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:58.337065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Write session will restart in 0.007091s
2025-10-02T09:28:58.337088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Write session: Do CDS request
2025-10-02T09:28:58.337094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:58.344853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:58.345215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.345334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:58.345349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-10-02T09:28:58.345460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.345489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:58.345498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:58.345501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:58.345898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-10-02T09:28:58.345938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:58.345940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:58.345942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:58.345947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554028474678266:4125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:58.346443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554028474678266:4125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:58.346597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:58.346790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:58.346799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:58.346808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:58.346856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:58.346896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554028399158542:3725]
2025-10-02T09:28:58.347447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:58.347663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:58.347702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:58.347979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:58.348031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.348037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.348038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.348039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.348040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.348041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.348042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.348044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.348045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.348045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.348046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.348047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.348051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.348062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.348066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.348069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.348073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.348076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.348080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.348084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.348088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.348091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.348095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.348099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.348105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.348112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.348117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.348122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.348126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.348132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.348136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.348141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.348145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.348149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.348158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.348163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.348167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.348171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.348179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.348184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.348190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.348194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.348197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.348202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.348214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.348219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.348223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.348228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.348260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:58.348297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554028474678266:4125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:58.353786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554028474678266:4125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:58.353801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554028474678266:4125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:58.353804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554028474678266:4125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:58.353812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:58.356840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:58.358537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:58.358560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:58.358563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:58.358566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:58.358572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [2:7556554028399158542:3725]
2025-10-02T09:28:58.358586Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:58.358601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:58.358604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.358607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.358608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.358622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:58.358632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:58.358643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:58.358699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.358707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.358710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.358712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:58.358715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:58.358776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:58.358786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.358800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.358810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.358825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:58.358845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678316:4125], now have 1 active actors on pipe
2025-10-02T09:28:58.358849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678204:2446], now have 1 active actors on pipe
2025-10-02T09:28:58.358854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.358857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.358859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.358873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:58.358884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:58.358888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:58.358892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:58.358893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:58.358898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:58.358900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:58.358931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.358945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:58.358928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 274
2025-10-02T09:28:58.358942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 274
2025-10-02T09:28:58.358966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:58.359003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.359011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.359031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:58.359040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.359043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.359044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:58.359052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.359064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:58.359086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.359269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.359278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.359291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.359377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 36 sessionId: src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0
2025-10-02T09:28:58.359711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99eafe8-be8d843f-5badd022-933c9d7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:58.362555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Write session: try to update token
2025-10-02T09:28:58.362572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:58.370086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:58.370109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.370117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.370158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:58.370165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:58.370441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:58.370621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.370796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.370969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.371278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:58.371326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:58.378622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:58.381193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:58.381498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.381525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.381543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:58.381546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.381548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:58.381550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:58.381558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.381562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.381567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554028399158537:3725]
2025-10-02T09:28:58.381602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:58.381611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:58.381615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:58.381618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:58.381618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.381621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:58.381782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:58.436840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554028474678325:3694]
2025-10-02T09:28:58.437199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7556554028474678325:3694]
2025-10-02T09:28:58.529434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:58.529720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:58.529758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678325:3694], now have 1 active actors on pipe
2025-10-02T09:28:58.529902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:58.529994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:58.530001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:58.530079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: error at write: Disconnected sessionId: src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0
2025-10-02T09:28:58.530208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0 is DEAD
2025-10-02T09:28:58.530269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554028474678325:3694]
2025-10-02T09:28:58.530293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:58.530372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:58.530382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Write session will restart in 0.006742s
2025-10-02T09:28:58.530404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Write session: Do CDS request
2025-10-02T09:28:58.530413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:58.538391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.538493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:58.538512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-10-02T09:28:58.538812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.538856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:58.538861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:58.538866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:58.539446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-10-02T09:28:58.539481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:58.539484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:58.539486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:58.539491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554028474678351:4130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:58.540021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554028474678351:4130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:58.542725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554028474678351:4130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:58.543834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:58.545532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:58.545752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:58.545763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:58.545774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:58.545845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:58.545887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554028399158657:3728]
2025-10-02T09:28:58.546513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:58.546878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:58.546933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:58.547271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:58.547345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.547353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.547354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.547355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.547357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.547358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.547359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.547360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.547361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.547362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.547363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.547364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.547370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.547380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.547384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.547388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.547392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.547396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.547399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.547403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.547407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.547411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.547415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.547419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.547425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.547432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.547437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.547443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.547447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.547454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.547458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.547463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.547467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.547471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.547475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.547479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.547483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.547488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.547492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.547496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.547501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.547506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.547510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.547514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.547519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.547524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.547528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.547533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.547565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:58.550509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554028474678351:4130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:58.550528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554028474678351:4130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:58.550531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554028474678351:4130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:58.550540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:58.561922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:58.563809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:58.563819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:58.563821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:58.563825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:58.563832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [2:7556554028399158657:3728]
2025-10-02T09:28:58.563845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:58.563863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:58.563866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.563869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.563871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.563886Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:58.563890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:58.563897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:58.563958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.563960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.563964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.563967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:58.563969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:58.564344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 275
2025-10-02T09:28:58.564344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 275
2025-10-02T09:28:58.564294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:58.564305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.564317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.564326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.564340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:58.564349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678429:4130], now have 1 active actors on pipe
2025-10-02T09:28:58.564351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678328:2446], now have 1 active actors on pipe
2025-10-02T09:28:58.564367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.564369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.564371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.564381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:58.564394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:58.564407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:58.564409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:58.564443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.564445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:58.564531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:58.564534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:58.564536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:58.564543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:58.564623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.564641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.564669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:58.564676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.564680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.564681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:58.564690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.564701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:58.564719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.565052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.565066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.565084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.565226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0
2025-10-02T09:28:58.565646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ba6d85-ebcf7c51-73ebe51c-132e23c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:58.568644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Write session: try to update token
2025-10-02T09:28:58.568660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:58.577640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:28:58.577662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.577671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.577708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:28:58.577880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:28:58.578031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.578165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.578314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:28:58.578500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:28:58.578533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:28:58.578829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:28:58.586761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:58.589207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:58.589425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.589451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.589491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:28:58.589761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:58.594950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:58.594974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.594976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:58.594978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:58.594987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.594991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.594997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554028399158652:3728]
2025-10-02T09:28:58.595039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:58.595051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.595053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:58.595057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:58.595065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:58.595069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:58.595241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:58.631544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554028474678450:3694]
2025-10-02T09:28:58.631880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7556554028474678450:3694]
2025-10-02T09:28:58.746106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:58.754163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.754388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.754566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.754632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.754702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.754770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.755170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.755187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.755260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.755323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.755393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.755457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.755500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.755510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.755579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.755642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.755701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.755763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.755802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.755805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.755873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.755930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.756036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.756097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.756143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.756146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.756220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.756321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.756384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.756444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.756491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.756494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.756563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.756629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.756691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.756754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.756834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.756837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.756902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.756958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.757067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.757147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.757189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.757192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.757260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.757316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.757375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.757442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.757483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.757486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.757549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.757604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.757665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.757728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.757870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.757873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.757939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:28:58.757999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:28:58.758057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:28:58.758117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:28:58.758176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:28:58.758180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:28:58.758260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678450:3694], now have 1 active actors on pipe
2025-10-02T09:28:58.759705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:58.759717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Write session will restart in 0.006550s
2025-10-02T09:28:58.759738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Write session: Do CDS request
2025-10-02T09:28:58.759744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:58.759828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:58.758602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554028474678450:3694]
2025-10-02T09:28:58.758644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:58.758646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:58.758675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: error at write: Disconnected sessionId: src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0
2025-10-02T09:28:58.758851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:58.759344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0 is DEAD
2025-10-02T09:28:58.768015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.768110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:58.768136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-10-02T09:28:58.768361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.768404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:58.768411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:58.768418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:58.769392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-10-02T09:28:58.769437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:58.769438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:58.769440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:58.769445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554028474678516:4142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:58.769995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554028474678516:4142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:58.772687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554028474678516:4142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:58.773697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:58.776014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:58.776223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:58.776234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:58.776244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:58.776294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:58.776336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554028399158798:3743]
2025-10-02T09:28:58.776011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554028474678516:4142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:58.776028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554028474678516:4142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:58.776032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554028474678516:4142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:58.776041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:58.776973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:58.777431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:58.777490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:58.777797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:58.777857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.777862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.777863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.777864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.777865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.777866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.777868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.777869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.777870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.777871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.777872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.777873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.777877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.777889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.777892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.777896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.777899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.777903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.777906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.777910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.777913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.777917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.777920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.777923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.777930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.777937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.777943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.777947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.777951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.777956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.777960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.777964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.777968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.777973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.777978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.777982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.777986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.777991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.777995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.777999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.778003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.778008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.778012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.778016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.778019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.778024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.778028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.778032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.778065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:58.787603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:58.789639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:58.789665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:58.789668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:58.789673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:58.790107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 276
2025-10-02T09:28:58.789680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [2:7556554028399158798:3743]
2025-10-02T09:28:58.789696Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:58.789714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:58.789718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.789721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.789723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.789740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:58.789746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:58.789754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:58.789827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.789829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.789830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.789833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:58.789836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:58.789912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:58.789914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.789929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.789941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.789955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:58.789975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.789978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.789980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.789987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:58.790001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:58.790009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:58.790012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:58.790014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:58.790015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:58.790018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:58.790028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678473:2446], now have 1 active actors on pipe
2025-10-02T09:28:58.790062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678568:4142], now have 1 active actors on pipe
2025-10-02T09:28:58.790064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.790077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:58.790208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:58.790147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 276
2025-10-02T09:28:58.790529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.790540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.790565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31895da-97778953-98363906-8374077c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:58.790573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.790578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.790580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:58.790591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.790601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:58.790614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.790841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.790857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.790880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.791028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 36 sessionId: src_id|f31895da-97778953-98363906-8374077c_0
2025-10-02T09:28:58.791447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce20063-2d4a2b1a-a1181b96-f5df49ad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f31895da-97778953-98363906-8374077c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:58.794580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Write session: try to update token
2025-10-02T09:28:58.794601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:58.805048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:58.805069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:58.805071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:58.805072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:58.805079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.805082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.805085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554028399158792:3743]
2025-10-02T09:28:58.805116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:58.805120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.805122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:58.805129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:58.805135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:58.805139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:58.805256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:58.817844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|f31895da-97778953-98363906-8374077c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:58.820231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:58.859911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554028474678585:3694]
2025-10-02T09:28:58.860335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7556554028474678585:3694]
2025-10-02T09:28:58.957756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:58.958115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.958124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.958143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678585:3694], now have 1 active actors on pipe
2025-10-02T09:28:58.958382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:58.959233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:58.959286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554028474678585:3694]
2025-10-02T09:28:58.959550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:28:58.959651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f31895da-97778953-98363906-8374077c_0
2025-10-02T09:28:58.959832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|f31895da-97778953-98363906-8374077c_0 is DEAD
2025-10-02T09:28:58.960164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:28:58.960175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Write session will restart in 0.009250s
2025-10-02T09:28:58.960200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Write session: Do CDS request
2025-10-02T09:28:58.960205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:58.970961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.971038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:58.971056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-10-02T09:28:58.971272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:58.971305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:58.971312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:58.971316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:58.971853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-10-02T09:28:58.971893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:58.971895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:58.971897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:58.971904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554028474678621:4146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:58.972431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554028474678621:4146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:58.976252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554028474678621:4146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:58.976364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:58.978461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:58.978647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:58.978660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:58.978671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:58.978732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:58.978772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554028399158901:3745]
2025-10-02T09:28:58.979384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:58.979383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554028474678621:4146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:58.979399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554028474678621:4146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:58.979402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554028474678621:4146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:58.979410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:58.979742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:58.979792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:58.980160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:58.980215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.980221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.980222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.980224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.980225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.980226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.980227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.980228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.980230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.980231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.980232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.980233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.980238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.980250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.980254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.980258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.980263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.980267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.980271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.980276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.980280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.980285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.980289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.980294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.980300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.980308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:58.980314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.980320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:58.980332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.980338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:58.980347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.980353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:58.980363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.980368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:58.980373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.980379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:58.980389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.980395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:58.980405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.980411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:58.980421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.980432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:58.980438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.980448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.980453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.980459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.980468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.980474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.980515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:58.992129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 277
2025-10-02T09:28:58.989849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:58.992134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 277
2025-10-02T09:28:58.991720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:58.991727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:58.991730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:58.991737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:58.991744Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [2:7556554028399158901:3745]
2025-10-02T09:28:58.991757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:58.991773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:58.991776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.991779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.991781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.991796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:58.991801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:58.991807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:58.991868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.991870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.991872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.991876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:58.991878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:58.991945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:58.991948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:58.991963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:58.991974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:58.991991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:58.992010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678686:4146], now have 1 active actors on pipe
2025-10-02T09:28:58.992013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554028474678589:2446], now have 1 active actors on pipe
2025-10-02T09:28:58.992021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:58.992023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:58.992025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:58.992040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:58.992055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:58.992055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:58.992058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:58.992061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:58.992068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:58.992071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:58.992108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:58.992115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:58.992134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:58.992205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.992212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.992238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:58.992247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:58.992251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:58.992253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:58.992264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:58.992273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:58.992287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.992440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:58.992451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:58.992462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:58.992532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0
2025-10-02T09:28:58.992891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31895da-97778953-98363906-8374077c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:58.995911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Write session: try to update token
2025-10-02T09:28:58.995934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:59.003735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:59.003760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:59.003762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:59.003764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:59.003773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:59.003778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:59.003781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554028399158896:3745]
2025-10-02T09:28:59.003828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:59.003837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.003839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:59.003842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:59.003849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:59.003854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:59.004014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:59.018078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:59.020686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:59.059253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554032769645994:3694]
2025-10-02T09:28:59.059554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7556554032769645994:3694]
2025-10-02T09:28:59.153320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:59.153668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.153676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.153693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769645994:3694], now have 1 active actors on pipe
2025-10-02T09:28:59.153963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:59.153973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:59.153991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:59.154009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:59.154047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554032769645994:3694]
2025-10-02T09:28:59.154052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0
2025-10-02T09:28:59.154254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0 is DEAD
2025-10-02T09:28:59.154439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:59.154451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Write session will restart in 0.006279s
2025-10-02T09:28:59.154483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Write session: Do CDS request
2025-10-02T09:28:59.154489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:59.165333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.169382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:59.171062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:59.172978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:59.172995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-10-02T09:28:59.171281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:59.171290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:59.171299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:59.171350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:59.171384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554032694126303:3748]
2025-10-02T09:28:59.171969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:59.172313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:59.172348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:59.172660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:59.172717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.172719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.172720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.172721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.172722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.172723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.172724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.172725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.172726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.172727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.172728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.172729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.172734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.172743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.172747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.172751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.172755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.172758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.172761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.172765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.172769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.172773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.172776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.172779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.172786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.172793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.172821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.172827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.172831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.172837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.172840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.172845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.172849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.172853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.172859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.172863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.172868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.172873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.172877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.172882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.172886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.172891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.172897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.172902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.172906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.172910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.172914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.172918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.172953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:59.173197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.173226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:59.173230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:59.173234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:59.173583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-10-02T09:28:59.173607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:59.173609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:59.173611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:59.173616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554032769646069:4151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:59.174124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554032769646069:4151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:59.176370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554032769646069:4151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:59.184318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554032769646069:4151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:59.184339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554032769646069:4151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:59.184342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554032769646069:4151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:59.184353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:59.185721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:59.187582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:59.187588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:59.187590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:59.187592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:59.187597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [2:7556554032694126303:3748]
2025-10-02T09:28:59.187609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:59.187622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:59.187624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.187626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.187627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.187639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:59.187643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:59.187649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:59.187690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.187691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.187692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.187694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:59.187696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:59.187747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:59.187748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.187757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.187763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.187772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:59.187784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.187785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.187786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.187803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:59.187816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:59.187830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:59.187832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:59.187857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:59.187860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.187861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:59.187862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:59.187864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:59.187873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:59.188030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646102:4151], now have 1 active actors on pipe
2025-10-02T09:28:59.188056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769645998:2446], now have 1 active actors on pipe
2025-10-02T09:28:59.188099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 278
2025-10-02T09:28:59.188100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 278
2025-10-02T09:28:59.188215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.188234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.188264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9191e350-b5ad566e-63e19d3c-2b677152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:59.188276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.188283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.188286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:59.188294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.188305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:59.188321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.188516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.188524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.188551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.188637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 36 sessionId: src_id|9191e350-b5ad566e-63e19d3c-2b677152_0
2025-10-02T09:28:59.192974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf1c7eb-94ae095c-638bf3b8-5425823a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9191e350-b5ad566e-63e19d3c-2b677152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:59.195941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Write session: try to update token
2025-10-02T09:28:59.195968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:59.212306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:59.212328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:59.212331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:59.212334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:59.212342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.212347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.212351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554032694126298:3748]
2025-10-02T09:28:59.212387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:59.212394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.212399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:59.212551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:59.213049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:59.213061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:59.213065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:59.218637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|9191e350-b5ad566e-63e19d3c-2b677152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:59.221451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:59.254324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554032769646111:3694]
2025-10-02T09:28:59.254710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7556554032769646111:3694]
2025-10-02T09:28:59.362112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:59.362411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.362426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.362458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646111:3694], now have 1 active actors on pipe
2025-10-02T09:28:59.362652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:59.362638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:59.362655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:59.362668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:59.362710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554032769646111:3694]
2025-10-02T09:28:59.362710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: error at write: Disconnected sessionId: src_id|9191e350-b5ad566e-63e19d3c-2b677152_0
2025-10-02T09:28:59.362887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|9191e350-b5ad566e-63e19d3c-2b677152_0 is DEAD
2025-10-02T09:28:59.363044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:59.363053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Write session will restart in 0.009909s
2025-10-02T09:28:59.363077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Write session: Do CDS request
2025-10-02T09:28:59.363082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:59.371046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:59.372574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:59.372773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:59.372784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:59.372793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:59.372866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:59.372904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554032694126419:3751]
2025-10-02T09:28:59.373482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:59.373858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:59.373909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:59.374368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.374219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:59.374282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.374283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.374284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.374285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.374440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:59.374456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-10-02T09:28:59.374286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.374287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.374288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.374289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.374290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.374292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.374293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.374294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.374299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.374309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.374313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.374317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.374321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.374324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.374327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.374330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.374333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.374337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.374341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.374344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.374350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.374357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.374363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.374367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.374371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.374376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.374380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.374385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.374389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.374394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.374397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.374401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.374408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.374412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.374416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.374420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.374424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.374429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.374433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.374438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.374442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.374447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.374451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.374456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.374491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:59.374628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.374662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:59.374672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:59.374676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:59.375072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-10-02T09:28:59.375110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:59.375115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:59.375116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:59.375121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554032769646198:4156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:59.375630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554032769646198:4156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:59.377488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554032769646198:4156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:59.382447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554032769646198:4156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:59.382460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554032769646198:4156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:59.382463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554032769646198:4156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:59.382472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:59.383086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:59.384773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:59.384788Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:59.384790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:59.384794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:59.384815Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [2:7556554032694126419:3751]
2025-10-02T09:28:59.384831Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:59.384848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:59.384856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.384859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.384861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.384874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:59.384878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:59.384884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:59.384936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.384943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.384946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.384948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:59.384951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:59.385013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:59.385018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.385032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.385048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.385069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:59.385089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646232:4156], now have 1 active actors on pipe
2025-10-02T09:28:59.385096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646126:2446], now have 1 active actors on pipe
2025-10-02T09:28:59.385102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.385104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.385106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.385117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:59.385132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:59.385140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:59.385143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:59.385145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:59.385149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:59.385152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:59.385162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 279
2025-10-02T09:28:59.385172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 279
2025-10-02T09:28:59.385181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.385187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:59.385189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:59.385211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.385215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.385295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19e06b5b-b56da895-954fe0a6-fe068079_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:59.385306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.385309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.385311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:59.385319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.385326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:59.385353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.385471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.385479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.385490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.385572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 36 sessionId: src_id|19e06b5b-b56da895-954fe0a6-fe068079_0
2025-10-02T09:28:59.385881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9191e350-b5ad566e-63e19d3c-2b677152_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19e06b5b-b56da895-954fe0a6-fe068079_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:59.388743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Write session: try to update token
2025-10-02T09:28:59.388760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:59.396746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:59.396765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:59.396768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:59.396770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:59.396777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.396781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.396784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554032694126414:3751]
2025-10-02T09:28:59.396838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:59.396844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.396846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:59.396846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:59.396852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:59.396856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:59.397008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:59.401715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|19e06b5b-b56da895-954fe0a6-fe068079_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:59.404351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:59.462699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554032769646239:3694]
2025-10-02T09:28:59.462977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7556554032769646239:3694]
2025-10-02T09:28:59.538753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:59.538989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.539000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.539033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646239:3694], now have 1 active actors on pipe
2025-10-02T09:28:59.539271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:59.539279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:59.539287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:59.539323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554032769646239:3694]
2025-10-02T09:28:59.539355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: error at write: Disconnected sessionId: src_id|19e06b5b-b56da895-954fe0a6-fe068079_0
2025-10-02T09:28:59.539226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:59.539518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|19e06b5b-b56da895-954fe0a6-fe068079_0 is DEAD
2025-10-02T09:28:59.539659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:59.539670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Write session will restart in 0.007751s
2025-10-02T09:28:59.539707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Write session: Do CDS request
2025-10-02T09:28:59.539713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:59.548257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.548591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:59.548633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:59.548651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-10-02T09:28:59.548779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.548825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:59.548835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:59.548840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:59.549274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-10-02T09:28:59.549307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:59.549314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:59.549316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:59.549322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554032769646310:4160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:59.549844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554032769646310:4160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:59.550253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:59.550417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:59.550425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:59.550434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:59.550483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:59.550521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554032694126525:3753]
2025-10-02T09:28:59.551096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:59.551387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:59.551434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:59.551505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554032769646310:4160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:59.551739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:59.551809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.551814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.551815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.551816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.551817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.551818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.551819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.551820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.551821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.551822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.551823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.551824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.551829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.551839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.551843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.551846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.551849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.551853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.551856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.551859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.551863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.551867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.551870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.551873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.551880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.551887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.551893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.551899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.551903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.551908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.551913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.551919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.551923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.551929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.551933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.551939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.551944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.551949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.551953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.551959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.551963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.551968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.551973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.551980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.551984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.551989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.551993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.551999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.552031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:59.557870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554032769646310:4160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:59.557892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554032769646310:4160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:59.557896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554032769646310:4160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:59.557911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:59.560790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:59.562708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:59.562729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:59.562732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:59.562736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:59.562741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [2:7556554032694126525:3753]
2025-10-02T09:28:59.562754Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:59.562771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:59.562775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.562778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.562780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.562795Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:59.562807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:59.562818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:59.562874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.562882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.562884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.562887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:59.562889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:59.562951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:59.562957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.562971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.562987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.563002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:59.563025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646349:4160], now have 1 active actors on pipe
2025-10-02T09:28:59.563033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646241:2446], now have 1 active actors on pipe
2025-10-02T09:28:59.563039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.563041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.563043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.563057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:59.563072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:59.563066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 280
2025-10-02T09:28:59.563088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:59.563072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 280
2025-10-02T09:28:59.563089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:59.563092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:59.563098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:59.563102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:59.563125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.563142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:59.563144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:59.563170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.563179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.563208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:59.563217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.563222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.563223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:59.563232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.563244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:59.563262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.563408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.563419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.563433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.563513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 36 sessionId: src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0
2025-10-02T09:28:59.563846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e06b5b-b56da895-954fe0a6-fe068079_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:59.566660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Write session: try to update token
2025-10-02T09:28:59.566676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:59.575064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:59.575083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:59.575085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:59.575087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:59.575095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.575100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.575104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554032694126520:3753]
2025-10-02T09:28:59.575151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:59.575153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:59.575159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:59.575161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.575162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:59.575163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:59.575311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:59.580151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:59.582531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:59.639360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554032769646356:3694]
2025-10-02T09:28:59.639599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7556554032769646356:3694]
2025-10-02T09:28:59.719143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:59.719419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.719433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.719467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646356:3694], now have 1 active actors on pipe
2025-10-02T09:28:59.719623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:59.719690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:59.719701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:59.719706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:59.719750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554032769646356:3694]
2025-10-02T09:28:59.719775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: error at write: Disconnected sessionId: src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0
2025-10-02T09:28:59.719959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0 is DEAD
2025-10-02T09:28:59.720110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:59.720120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Write session will restart in 0.005331s
2025-10-02T09:28:59.720146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Write session: Do CDS request
2025-10-02T09:28:59.720152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:59.726298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.726406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:59.726423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-10-02T09:28:59.726524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.726566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:59.726575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:59.726579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:59.727104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-10-02T09:28:59.727151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:59.727158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:59.727160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:59.727165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554032769646429:4172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:59.727641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554032769646429:4172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:59.729220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:59.729677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554032769646429:4172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:59.730663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:59.730874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:59.730885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:59.730895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:59.730950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:59.730987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554032694126670:3767]
2025-10-02T09:28:59.731571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:59.731784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:59.731828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:59.732119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:59.732179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.732185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.732146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554032769646429:4172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:59.732172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554032769646429:4172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:59.732186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.732187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.732175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554032769646429:4172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:59.732181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:59.732188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.732188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.732190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.732191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.732192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.732193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.732194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.732195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.732200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.732210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.732214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.732218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.732221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.732225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.732229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.732233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.732237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.732241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.732245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.732248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.732254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.732262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.732267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.732273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.732277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.732282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.732287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.732291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.732296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.732301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.732305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.732310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.732315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.732320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.732325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.732329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.732334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.732339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.732343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.732348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.732355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.732360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.732365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.732371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.732410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:59.741284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:59.742937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:59.742950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:59.742952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:59.742956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:59.742961Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [2:7556554032694126670:3767]
2025-10-02T09:28:59.742972Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:59.742986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:59.742988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.742990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.742992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.743004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:59.743007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:59.743012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:59.743055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.743062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.743064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.743067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:59.743068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:59.743115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:59.743121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.743146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.743152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.743161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:59.743178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.743181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.743185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.743190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:59.743200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646495:4172], now have 1 active actors on pipe
2025-10-02T09:28:59.743206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:59.743210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:59.743219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:59.743221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:59.743225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:59.743228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:59.743247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646388:2446], now have 1 active actors on pipe
2025-10-02T09:28:59.743252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.743258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:59.743264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:59.743299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 281
2025-10-02T09:28:59.743356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.743366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.743304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 281
2025-10-02T09:28:59.743389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2db270df-dd86ef44-79496da7-4c048015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:59.743400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.743403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.743405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:59.743412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.743421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:59.743431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.743584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.743589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.743598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.743671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 36 sessionId: src_id|2db270df-dd86ef44-79496da7-4c048015_0
2025-10-02T09:28:59.744042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c174c0-d680c6c5-f98e8ae8-139d7812_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2db270df-dd86ef44-79496da7-4c048015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:59.746855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Write session: try to update token
2025-10-02T09:28:59.746874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:59.754564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:59.754587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:59.754590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:59.754592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:59.754601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.754606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.754612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554032694126665:3767]
2025-10-02T09:28:59.754655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:59.754661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.754664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:59.754669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:59.754676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:59.754700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:59.754804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:59.760820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|2db270df-dd86ef44-79496da7-4c048015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:59.763435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:28:59.820078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554032769646510:3694]
2025-10-02T09:28:59.820336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7556554032769646510:3694]
2025-10-02T09:28:59.900571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:28:59.900903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.900915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.900949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646510:3694], now have 1 active actors on pipe
2025-10-02T09:28:59.901183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:28:59.901182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554032769646510:3694]
2025-10-02T09:28:59.901197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:28:59.901201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:28:59.901216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:28:59.901262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: error at write: Disconnected sessionId: src_id|2db270df-dd86ef44-79496da7-4c048015_0
2025-10-02T09:28:59.901441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|2db270df-dd86ef44-79496da7-4c048015_0 is DEAD
2025-10-02T09:28:59.901590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:28:59.901602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Write session will restart in 0.007735s
2025-10-02T09:28:59.901626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Write session: Do CDS request
2025-10-02T09:28:59.901631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:28:59.910473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.910602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:28:59.910620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-10-02T09:28:59.910898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:28:59.910930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:28:59.910939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:28:59.910943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:28:59.910303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:28:59.912268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:28:59.912423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:28:59.912411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-10-02T09:28:59.912431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:28:59.912442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:28:59.912438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:28:59.912444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:28:59.912446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:28:59.912451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554032769646583:4176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:28:59.912474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:28:59.912502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554032694126782:3770]
2025-10-02T09:28:59.912885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554032769646583:4176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:28:59.912990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:28:59.913286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:28:59.913353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:28:59.913682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:28:59.913751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.913758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.913759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.913760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.913761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.913762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.913763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.913764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.913765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.913766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.913767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.913768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.913772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.913781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.913786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.913789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.913793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.913796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.913800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.913803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.913806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.913810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.913813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.913816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.913823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.913830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:28:59.913835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.913840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:28:59.913845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.913850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:28:59.913854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.913859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:28:59.913865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.913870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:28:59.913874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.913879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:28:59.913883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.913887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:28:59.913892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.913896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:28:59.913900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.913905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:28:59.913909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.913914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.913918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.913923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.913927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.913932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.913966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:28:59.914445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554032769646583:4176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:28:59.919802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554032769646583:4176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:28:59.919823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554032769646583:4176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:28:59.919826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554032769646583:4176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:28:59.919834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:28:59.922923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:28:59.924735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:28:59.924752Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:28:59.924755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:28:59.924759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:28:59.924766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [2:7556554032694126782:3770]
2025-10-02T09:28:59.924785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:28:59.924817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:28:59.924821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.924824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.924826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.924844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:28:59.924854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:28:59.924860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:28:59.924926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.924933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.924935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.924938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:28:59.924940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:28:59.925154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 282
2025-10-02T09:28:59.925156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 282
2025-10-02T09:28:59.925112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:28:59.925122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.925135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:28:59.925146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:28:59.925162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:28:59.925183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646622:4176], now have 1 active actors on pipe
2025-10-02T09:28:59.925188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554032769646513:2446], now have 1 active actors on pipe
2025-10-02T09:28:59.925193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.925195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.925197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.925205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:28:59.925215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:28:59.925217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:28:59.925219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:28:59.925220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:28:59.925234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:28:59.925236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:28:59.925252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.925255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.925298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.925305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:28:59.925315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:28:59.925319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:28:59.925336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:28:59.925339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:28:59.925342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:28:59.925350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:28:59.925359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:28:59.925395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.925573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:28:59.925580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:28:59.925594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:28:59.925674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 36 sessionId: src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0
2025-10-02T09:28:59.926116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db270df-dd86ef44-79496da7-4c048015_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:28:59.929354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Write session: try to update token
2025-10-02T09:28:59.929383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:28:59.936672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:28:59.936692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:28:59.936694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:28:59.936696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:28:59.936705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.936709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.936712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554032694126777:3770]
2025-10-02T09:28:59.936739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:28:59.936745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:28:59.936746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:28:59.936760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:28:59.936767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:28:59.936771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:28:59.936906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:28:59.951284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:28:59.953995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:00.001332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554037064613925:3694]
2025-10-02T09:29:00.001714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7556554037064613925:3694]
2025-10-02T09:29:00.083598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:00.083886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.083898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.083917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064613925:3694], now have 1 active actors on pipe
2025-10-02T09:29:00.084132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:00.084307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554037064613925:3694]
2025-10-02T09:29:00.084347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:00.084416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0
2025-10-02T09:29:00.084623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0 is DEAD
2025-10-02T09:29:00.084843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:00.084882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:00.084899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Write session will restart in 0.007358s
2025-10-02T09:29:00.084931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Write session: Do CDS request
2025-10-02T09:29:00.084939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:00.093498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.093968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:00.093991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-10-02T09:29:00.094130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.094167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:00.094180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:00.094185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:00.094723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-10-02T09:29:00.094765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:00.094767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:00.094769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:00.094774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554037064613996:4180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:00.095307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554037064613996:4180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:00.097160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:00.098121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554037064613996:4180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:00.099248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:00.099556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:00.099569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:00.099581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:00.099646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:00.099682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554036989094191:3773]
2025-10-02T09:29:00.100294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:00.100573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:00.100623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:00.100929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554037064613996:4180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:00.100948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554037064613996:4180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:00.100951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554037064613996:4180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:00.100959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:00.100970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:00.101047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.101052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.101054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.101055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.101056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.101057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.101059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.101060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.101061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.101061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.101064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.101070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.101081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.101086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.101089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.101093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.101097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.101101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.101105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.101109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.101113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.101118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.101122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.101130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.101138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.101144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.101154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.101159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.101164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.101168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.101172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.101177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.101181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.101185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.101191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.101196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.101201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.101205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.101210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.101215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.101221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.101225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.101230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.101238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.101244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.101253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.101259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.101299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:00.116301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:00.118422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:00.118440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:00.118443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:00.118447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:00.118454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [2:7556554036989094191:3773]
2025-10-02T09:29:00.118466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:00.118481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:00.118484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.118487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.118489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.118505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:00.118511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:00.118519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:00.118573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.118579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.118582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.118585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:00.118586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:00.118644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:00.118652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.118666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.118678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.118696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:00.118720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.118723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.118725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.118733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:00.118745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:00.118748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:00.118748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:00.118750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:00.118764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:00.118767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:00.118776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614037:4180], now have 1 active actors on pipe
2025-10-02T09:29:00.118780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064613928:2446], now have 1 active actors on pipe
2025-10-02T09:29:00.118816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.118824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:00.118866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 283
2025-10-02T09:29:00.118876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 283
2025-10-02T09:29:00.118975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:00.119330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.119344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.119371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:00.119389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.119393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.119395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:00.119405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.119420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:00.119439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.119649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.119662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.119685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.120230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f60f0-1e26d007-1f884442-17d5dea8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:00.123283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Write session: try to update token
2025-10-02T09:29:00.123310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:00.119801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0
2025-10-02T09:29:00.130889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:00.130909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.130912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:00.130919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:00.130927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.130931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.130934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554036989094186:3773]
2025-10-02T09:29:00.130972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:00.130971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:00.130977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:00.130978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.130980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:00.130980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:00.131176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:00.141580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:00.144909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:00.184124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554037064614050:3694]
2025-10-02T09:29:00.184401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7556554037064614050:3694]
2025-10-02T09:29:00.278952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:00.279329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.279342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.279360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614050:3694], now have 1 active actors on pipe
2025-10-02T09:29:00.279633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:00.279652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:00.279654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:00.279668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:00.279701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554037064614050:3694]
2025-10-02T09:29:00.279725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: error at write: Disconnected sessionId: src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0
2025-10-02T09:29:00.279908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0 is DEAD
2025-10-02T09:29:00.280017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:00.280027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Write session will restart in 0.008111s
2025-10-02T09:29:00.280053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Write session: Do CDS request
2025-10-02T09:29:00.280058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:00.288446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:00.289360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.289687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:00.289708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-10-02T09:29:00.289870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.289916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:00.289928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:00.289932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:00.290090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:00.290252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:00.290262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:00.290273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:00.290323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:00.290342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-10-02T09:29:00.290361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554036989094303:3775]
2025-10-02T09:29:00.290379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:00.290385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:00.290387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:00.290391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554037064614126:4185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:00.290878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554037064614126:4185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:00.290899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:00.291228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:00.291276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:00.291564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:00.291642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.291648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.291649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.291650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.291651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.291652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.291653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.291654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.291655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.291655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.291657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.291658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.291663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.291672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.291675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.291679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.291682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.291685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.291689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.291692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.291695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.291698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.291702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.291705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.291712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.291719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.291724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.291729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.291734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.291738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.291742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.291746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.291750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.291755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.291758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.291762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.291766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.291771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.291777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.291782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.291786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.291790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.291794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.291799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.291804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.291814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.291818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.291823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.291860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:00.292688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554037064614126:4185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:00.298634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554037064614126:4185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:00.298651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554037064614126:4185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:00.298655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554037064614126:4185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:00.298665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:00.300413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:00.302246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:00.302263Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:00.302265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:00.302269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:00.302274Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [2:7556554036989094303:3775]
2025-10-02T09:29:00.302290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:00.302305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:00.302307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.302310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.302312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.302326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:00.302334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:00.302341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:00.302399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.302405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.302407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.302410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:00.302412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:00.302470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:00.302477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.302489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.302498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.302511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:00.302533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614054:2446], now have 1 active actors on pipe
2025-10-02T09:29:00.302542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614165:4185], now have 1 active actors on pipe
2025-10-02T09:29:00.302548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.302549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.302553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.302565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:00.302578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:00.302590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:00.302594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:00.302599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 284
2025-10-02T09:29:00.302620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:00.302602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 284
2025-10-02T09:29:00.302624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.302626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:00.302631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:00.302634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:00.302641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:00.302659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.302668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.302692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:00.302702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.302705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.302707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:00.302715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.302728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:00.302744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.302906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.302914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.302927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.303019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0
2025-10-02T09:29:00.303342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d85e470-77b81036-fea634c9-b9b0fb66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:00.306205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Write session: try to update token
2025-10-02T09:29:00.306222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:00.314451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:00.314470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.314477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.314517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:00.314531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:00.314674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:00.314812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.314945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.315076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.315269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:00.315310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:00.320145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:00.322581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:00.322772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.322795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.322812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:00.322814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.322817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:00.322822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:00.322832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.322835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.322838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554036989094298:3775]
2025-10-02T09:29:00.322863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:00.322872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:00.322875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:00.322878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:00.322883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.322885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:00.323017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:00.379694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554037064614185:3694]
2025-10-02T09:29:00.379992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7556554037064614185:3694]
2025-10-02T09:29:00.464557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:00.464877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:00.464905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614185:3694], now have 1 active actors on pipe
2025-10-02T09:29:00.465001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:00.465087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554037064614185:3694]
2025-10-02T09:29:00.465130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:00.465155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:00.465162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:00.465177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: error at write: Disconnected sessionId: src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0
2025-10-02T09:29:00.465320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0 is DEAD
2025-10-02T09:29:00.465446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:00.465456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Write session will restart in 0.009670s
2025-10-02T09:29:00.465477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Write session: Do CDS request
2025-10-02T09:29:00.465487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:00.474075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:00.475587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:00.475765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:00.475777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:00.475788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:00.475843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:00.475899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554036989094428:3778]
2025-10-02T09:29:00.476324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.476432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:00.476450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-10-02T09:29:00.476460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:00.476582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.476609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:00.476615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:00.476624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:00.476781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:00.476851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:00.477035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-10-02T09:29:00.477069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:00.477075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:00.477077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:00.477082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554037064614263:4190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:00.477178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:00.477254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.477260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.477261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.477262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.477263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.477265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.477266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.477267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.477268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.477269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.477271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.477272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.477277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.477288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.477292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.477296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.477300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.477304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.477308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.477311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.477315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.477318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.477326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.477330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.477336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.477342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.477350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.477355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.477358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.477363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.477367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.477372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.477377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.477382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.477388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.477392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.477403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.477407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.477411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.477416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.477420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.477424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.477428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.477432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.477436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.477440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.477444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.477451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.477482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:00.477574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554037064614263:4190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:00.479405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554037064614263:4190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:00.484175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554037064614263:4190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:00.484193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554037064614263:4190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:00.484197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554037064614263:4190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:00.484205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:00.486135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:00.487997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:00.488017Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:00.488020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:00.488024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:00.488031Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [2:7556554036989094428:3778]
2025-10-02T09:29:00.488044Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:00.488063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:00.488065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.488069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.488071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.488086Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:00.488091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:00.488100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:00.488160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.488173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.488175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.488178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:00.488181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:00.488249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:00.488252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.488265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.488275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.488289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:00.488307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.488309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.488311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.488318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:00.488327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:00.488330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:00.488331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614299:4190], now have 1 active actors on pipe
2025-10-02T09:29:00.488332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:00.488338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614187:2446], now have 1 active actors on pipe
2025-10-02T09:29:00.488343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:00.488357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:00.488360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:00.488394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.488406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:00.488423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 285
2025-10-02T09:29:00.488426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 285
2025-10-02T09:29:00.488421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:00.488545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.488552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.488586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb534d0b-a4cf4672-fa719d55-81605402_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:00.488600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.488609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.488611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:00.488620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.488634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:00.488650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.488906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.488922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.488952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.492960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb534d0b-a4cf4672-fa719d55-81605402_0
2025-10-02T09:29:00.493443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a998d-7198eca2-4e0c4d06-6e4cc46c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb534d0b-a4cf4672-fa719d55-81605402_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:00.496277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Write session: try to update token
2025-10-02T09:29:00.496294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:00.499585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:00.499603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.499615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.499659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:00.499840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:00.499989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.500134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.500171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:00.500268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.500460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:00.500497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:00.510070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:00.510093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.510096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:00.510099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:00.510108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.510111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.510115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554036989094422:3778]
2025-10-02T09:29:00.510154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:00.510163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.510169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:00.510313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:00.512863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:00.512871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:00.512875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:00.513866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|eb534d0b-a4cf4672-fa719d55-81605402_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:00.516465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:00.565060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554037064614307:3694]
2025-10-02T09:29:00.565319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7556554037064614307:3694]
2025-10-02T09:29:00.662789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:00.663194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.663208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.663225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614307:3694], now have 1 active actors on pipe
2025-10-02T09:29:00.663436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:00.663462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:00.663480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:00.663487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:00.663539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: error at write: Disconnected sessionId: src_id|eb534d0b-a4cf4672-fa719d55-81605402_0
2025-10-02T09:29:00.663541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554037064614307:3694]
2025-10-02T09:29:00.663711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|eb534d0b-a4cf4672-fa719d55-81605402_0 is DEAD
2025-10-02T09:29:00.664103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:00.664120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Write session will restart in 0.006743s
2025-10-02T09:29:00.664154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Write session: Do CDS request
2025-10-02T09:29:00.664162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:00.672406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.672509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:00.672534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-10-02T09:29:00.672667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.672703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:00.672716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:00.672721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:00.673225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-10-02T09:29:00.673272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:00.673274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:00.673276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:00.673284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554037064614381:4194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:00.673944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554037064614381:4194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:00.673890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:00.675679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:00.675860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:00.675867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:00.675875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:00.675922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:00.675964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554036989094541:3780]
2025-10-02T09:29:00.676627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:00.676959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:00.677008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:00.677345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:00.677411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.677420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.677421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.677422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.677423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.677424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.677425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.677426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.677427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.677429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.677430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.677431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.677436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.677446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.677450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.677455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.677458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.677462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.677465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.677469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.677473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.677477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.677480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.677484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.677490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.677498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.677503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.677508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.677512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.677517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.677521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.677526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.677531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.677536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.677540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.677546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.677550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.677555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.677559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.677564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.677568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.677573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.677577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.677582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.677586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.677593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.677598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.677602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.677637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:00.678739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554037064614381:4194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:00.684898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554037064614381:4194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:00.684919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554037064614381:4194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:00.684923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554037064614381:4194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:00.684932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:00.686981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:00.688547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:00.688566Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:00.688570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:00.688575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:00.688582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [2:7556554036989094541:3780]
2025-10-02T09:29:00.688597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:00.688614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:00.688617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.688620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.688623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.688637Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:00.688649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:00.688656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:00.688714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.688721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.688723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.688726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:00.688729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:00.688929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:00.688937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.688952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.688969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.689001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:00.689023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.689030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.689032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.689049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:00.689063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:00.689077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:00.689084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:00.689094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:00.689101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:00.689103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:00.689118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.689124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:00.689176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:00.689267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 286
2025-10-02T09:29:00.689286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 286
2025-10-02T09:29:00.689321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614309:2446], now have 1 active actors on pipe
2025-10-02T09:29:00.689330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614421:4194], now have 1 active actors on pipe
2025-10-02T09:29:00.689344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.689348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.689369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:00.689379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.689382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.689384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:00.689391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.689404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:00.689421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.689641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.689657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.689679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.689762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0
2025-10-02T09:29:00.690093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb534d0b-a4cf4672-fa719d55-81605402_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:00.693060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Write session: try to update token
2025-10-02T09:29:00.693079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:00.708264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:00.708279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.708287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.708332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:00.708384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:00.708524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:00.708683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.708863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.709009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:00.709209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:00.709256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:00.713800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:00.715665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:00.715683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.715686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:00.715688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:00.715696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.715700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.715704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554036989094536:3780]
2025-10-02T09:29:00.715742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:00.715748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.715750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:00.715753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:00.715759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:00.715762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:00.715955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:00.716541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:00.763700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554037064614457:3694]
2025-10-02T09:29:00.763922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7556554037064614457:3694]
2025-10-02T09:29:00.859941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:00.860448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.860465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.860482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614457:3694], now have 1 active actors on pipe
2025-10-02T09:29:00.860701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:00.860873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554037064614457:3694]
2025-10-02T09:29:00.860913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:00.860915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:00.860975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: error at write: Disconnected sessionId: src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0
2025-10-02T09:29:00.861143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0 is DEAD
2025-10-02T09:29:00.861160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:00.861347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:00.861358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Write session will restart in 0.005736s
2025-10-02T09:29:00.861382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Write session: Do CDS request
2025-10-02T09:29:00.861388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:00.868344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.868425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:00.868443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-10-02T09:29:00.868666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:00.868707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:00.868711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:00.868716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:00.869163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-10-02T09:29:00.869196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:00.869198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:00.869200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:00.869205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554037064614528:4206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:00.869687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554037064614528:4206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:00.870861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:00.871470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554037064614528:4206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:00.872437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:00.872651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:00.872662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:00.872671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:00.872719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:00.872755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554036989094695:3795]
2025-10-02T09:29:00.873359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:00.873801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:00.873873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:00.874209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:00.874294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.874305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.874306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.874307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.874308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.874309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.874311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.874312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.874313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.874315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.874316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.874317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.874323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.874333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.874337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.874342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.874346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.874350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.874355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.874358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.874362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.874366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.874370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.874375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.874381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.874390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:00.874396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.874402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:00.874406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.874411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:00.874415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.874421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:00.874426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.874431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:00.874436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.874442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:00.874459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.874464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:00.874467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.874472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:00.874476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.874481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:00.874485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.874489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.874493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.874498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.874503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.874507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.874539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:00.874549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554037064614528:4206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:00.874563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554037064614528:4206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:00.874566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554037064614528:4206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:00.874573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:00.883213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:00.884908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:00.884924Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:00.884926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:00.884929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:00.884934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [2:7556554036989094695:3795]
2025-10-02T09:29:00.884946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:00.884960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:00.884962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.884964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.884965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.884977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:00.884981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:00.884986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:00.885044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.885052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.885054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.885057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:00.885060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:00.885125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:00.885134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.885148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:00.885159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:00.885181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:00.885204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614573:4206], now have 1 active actors on pipe
2025-10-02T09:29:00.885220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.885222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.885225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.885240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:00.885253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614463:2446], now have 1 active actors on pipe
2025-10-02T09:29:00.885259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:00.885260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:00.885262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:00.885264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:00.885276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:00.885279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:00.885312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.885315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:00.885297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 287
2025-10-02T09:29:00.885322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:00.885344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.885302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 287
2025-10-02T09:29:00.885347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.885375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaf7fd91-e0321655-7def1676-ee679a56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:00.885387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:00.885390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:00.885392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:00.885401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:00.885409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:00.885430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.885543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:00.885550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:00.885560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:00.885630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 36 sessionId: src_id|eaf7fd91-e0321655-7def1676-ee679a56_0
2025-10-02T09:29:00.886005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd729c9e-5e77ac19-b6a448b3-ad2855d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eaf7fd91-e0321655-7def1676-ee679a56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:00.888720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Write session: try to update token
2025-10-02T09:29:00.888736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:00.896615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:00.896634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:00.896636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:00.896637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:00.896643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.896646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.896648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554036989094690:3795]
2025-10-02T09:29:00.896677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:00.896681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:00.896683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:00.896695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:00.896701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:00.896704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:00.896830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:00.901792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|eaf7fd91-e0321655-7def1676-ee679a56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:00.904124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:00.961296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554037064614583:3694]
2025-10-02T09:29:00.961701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7556554037064614583:3694]
2025-10-02T09:29:01.037176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:01.037555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.037566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.037593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554037064614583:3694], now have 1 active actors on pipe
2025-10-02T09:29:01.037736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:01.037824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554037064614583:3694]
2025-10-02T09:29:01.037847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:01.037861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:01.037915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eaf7fd91-e0321655-7def1676-ee679a56_0
2025-10-02T09:29:01.038085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|eaf7fd91-e0321655-7def1676-ee679a56_0 is DEAD
2025-10-02T09:29:01.038256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:01.038268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Write session will restart in 0.008338s
2025-10-02T09:29:01.038289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Write session: Do CDS request
2025-10-02T09:29:01.038294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:01.047332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.047422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:01.047442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-10-02T09:29:01.047561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.047590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:01.047599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:01.047605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:01.048034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-10-02T09:29:01.048067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:01.048075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:01.048077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:01.048082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554041359581956:4210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:01.048590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554041359581956:4210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:01.049811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:01.050688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554041359581956:4210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:01.051265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:01.051431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:01.051440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:01.051449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:01.051489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:01.051524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554041284062107:3797]
2025-10-02T09:29:01.052118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:01.052369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:01.052406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:01.052701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:01.052760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.052765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.052766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.052767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.052768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.052769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.052770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.052772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.052773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.052776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.052777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.052778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.052782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.052792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.052795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.052799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.052816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.052819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.052822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.052825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.052828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.052832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.052835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.052838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.052844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.052850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.052854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.052864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.052870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.052878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.052882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.052887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.052891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.052900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.052904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.052909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.052913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.052918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.052926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.052932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.052940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.052945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.052953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.052958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.052962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.052970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.052974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.052983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.053018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:01.053051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554041359581956:4210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:01.053062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554041359581956:4210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:01.053066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554041359581956:4210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:01.053073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:01.061592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:01.063197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:01.063211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:01.063214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:01.063218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:01.063224Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [2:7556554041284062107:3797]
2025-10-02T09:29:01.063240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:01.063255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:01.063257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.063260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.063262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.063275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:01.063280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:01.063286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:01.063336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.063346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.063414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.063421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:01.063423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:01.063481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:01.063487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.063499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.063511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.063532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:01.063555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359581883:2446], now have 1 active actors on pipe
2025-10-02T09:29:01.063558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359581998:4210], now have 1 active actors on pipe
2025-10-02T09:29:01.063564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.063566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.063569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.063581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:01.063597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:01.063615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:01.063614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:01.063617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:01.063618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:01.063620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:01.063621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 288
2025-10-02T09:29:01.063649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.063658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:01.063622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 288
2025-10-02T09:29:01.063662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:01.063689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.063697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.063722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:01.063731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.063734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.063736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:01.063745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.063752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:01.063763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.063906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.063912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.063922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.063997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0
2025-10-02T09:29:01.064295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf7fd91-e0321655-7def1676-ee679a56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:01.067062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Write session: try to update token
2025-10-02T09:29:01.067078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:01.073904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:01.073923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.073933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.073971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:01.073980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:01.074135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:01.074280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.074413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.074552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.074739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:01.074774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:01.080614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:01.083170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:01.083627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.083649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.083665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:01.083667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.083670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:01.083674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:01.083681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.083685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.083688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554041284062102:3797]
2025-10-02T09:29:01.083716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:01.083727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:01.083730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:01.083737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:01.083741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.083746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:01.083867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:01.137988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554041359582007:3694]
2025-10-02T09:29:01.138268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7556554041359582007:3694]
2025-10-02T09:29:01.212393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:01.212612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:01.212637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582007:3694], now have 1 active actors on pipe
2025-10-02T09:29:01.212774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554041359582007:3694]
2025-10-02T09:29:01.212827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:01.212838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:01.212912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:01.212923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:01.212980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: error at write: Disconnected sessionId: src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0
2025-10-02T09:29:01.213095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0 is DEAD
2025-10-02T09:29:01.213307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:01.213321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Write session will restart in 0.009057s
2025-10-02T09:29:01.213343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Write session: Do CDS request
2025-10-02T09:29:01.213351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:01.221287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:01.222727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:01.222906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:01.222919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:01.222930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:01.222992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:01.223034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554041284062224:3800]
2025-10-02T09:29:01.223352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.223518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:01.223535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-10-02T09:29:01.223576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:01.223792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.223831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:01.223839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:01.223843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:01.223870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:01.223922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:01.224217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-10-02T09:29:01.224229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:01.224252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:01.224254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:01.224256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:01.224260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554041359582089:4215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:01.224304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.224313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.224314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.224315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.224316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.224317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.224318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.224319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.224320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.224320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.224322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.224322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.224327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.224338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.224342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.224345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.224348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.224352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.224355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.224359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.224362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.224366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.224370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.224373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.224380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.224386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.224391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.224397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.224400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.224405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.224408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.224411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.224415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.224418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.224422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.224426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.224430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.224435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.224439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.224443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.224447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.224451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.224457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.224461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.224472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.224476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.224480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.224484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.224519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:01.224756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554041359582089:4215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:01.227084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554041359582089:4215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:01.232507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554041359582089:4215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:01.232526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554041359582089:4215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:01.232530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554041359582089:4215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:01.232538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:01.232987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:01.234649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:01.234663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:01.234665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:01.234667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:01.234671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [2:7556554041284062224:3800]
2025-10-02T09:29:01.234684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:01.234700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:01.234703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.234706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.234708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.234722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:01.234730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:01.234735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:01.234780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.234786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.234788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.234790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:01.234792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:01.234836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:01.234843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.234858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.234871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.234889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:01.234910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582009:2446], now have 1 active actors on pipe
2025-10-02T09:29:01.234920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.234922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.234924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.234935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:01.234949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:01.234950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582126:4215], now have 1 active actors on pipe
2025-10-02T09:29:01.234953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:01.234955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:01.234956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 289
2025-10-02T09:29:01.234957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:01.234981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 289
2025-10-02T09:29:01.234970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:01.234973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:01.235002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.235010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:01.235048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:01.235063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.235066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.235081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:01.235090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.235092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.235093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:01.235099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.235106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:01.235119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.235323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.235328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.235339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.235421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 36 sessionId: src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0
2025-10-02T09:29:01.235798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3e4de-4eb1dcc7-cf743771-e163009f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:01.238605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Write session: try to update token
2025-10-02T09:29:01.238628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:01.245319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:01.245349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.245359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.245396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:01.245408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:01.245547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:01.245679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.245810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.245943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.246124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:01.246163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:01.253232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:01.254877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:01.254901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.254903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:01.254905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:01.254915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.254918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.254921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554041284062219:3800]
2025-10-02T09:29:01.254954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:01.254959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:01.254962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.254964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:01.254965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:01.254969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:01.255103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:01.255619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:01.313121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554041359582133:3694]
2025-10-02T09:29:01.313504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7556554041359582133:3694]
2025-10-02T09:29:01.398065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:01.398460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.398475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.398492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582133:3694], now have 1 active actors on pipe
2025-10-02T09:29:01.398708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554041359582133:3694]
2025-10-02T09:29:01.398733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:01.398737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:01.398744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:01.398794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: error at write: Disconnected sessionId: src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0
2025-10-02T09:29:01.398739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:01.398966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0 is DEAD
2025-10-02T09:29:01.399118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:01.399137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Write session will restart in 0.005217s
2025-10-02T09:29:01.399163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Write session: Do CDS request
2025-10-02T09:29:01.399169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:01.405298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.405428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:01.405445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-10-02T09:29:01.405793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.405843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:01.405852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:01.405856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:01.406331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-10-02T09:29:01.406372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:01.406382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:01.406384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:01.406390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554041359582162:4220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:01.406932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554041359582162:4220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:01.409365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554041359582162:4220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:01.413496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554041359582162:4220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:01.413521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554041359582162:4220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:01.413524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554041359582162:4220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:01.413532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:01.413557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:01.415555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:01.415738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:01.415746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:01.415764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:01.415817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:01.415856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554041284062355:3803]
2025-10-02T09:29:01.416412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:01.416726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:01.416789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:01.417154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:01.417217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.417224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.417226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.417227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.417228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.417230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.417232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.417233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.417234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.417235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.417236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.417238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.417243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.417255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.417259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.417263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.417267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.417271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.417275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.417279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.417282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.417286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.417290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.417294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.417300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.417308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.417314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.417319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.417323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.417328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.417333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.417338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.417349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.417354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.417359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.417364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.417369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.417375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.417380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.417385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.417390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.417395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.417399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.417403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.417412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.417417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.417425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.417429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.417462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:01.428668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:01.430567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:01.430590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:01.430593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:01.430597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:01.430605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [2:7556554041284062355:3803]
2025-10-02T09:29:01.430621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:01.430642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:01.430645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.430649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.430652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.430670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:01.430686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:01.430693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:01.430899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.430912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.430915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.430921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:01.430923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:01.430998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:01.431006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.431022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.431040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.431066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:01.431085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.431087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.431090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.431100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:01.431113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:01.431119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582148:2446], now have 1 active actors on pipe
2025-10-02T09:29:01.431136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:01.431138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:01.431139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:01.431153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:01.431163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:01.431170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582263:4220], now have 1 active actors on pipe
2025-10-02T09:29:01.431208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.431221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:01.431231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:01.431438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 290
2025-10-02T09:29:01.431481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 290
2025-10-02T09:29:01.431581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.431595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.431625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:01.431638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.431647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.431649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:01.431660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.431675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:01.431694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.431877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.431890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.431910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.432015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0
2025-10-02T09:29:01.432552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|488b6e40-7ea8dfb2-e396c4d1-8f7f870f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:01.435601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Write session: try to update token
2025-10-02T09:29:01.435618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:01.445006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:01.445024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.445035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.445076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:01.445256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:01.445386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.445524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.445662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.445870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:01.445903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:01.446108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:01.452271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId: src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:01.454927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:01.455165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.455190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.455224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:01.456585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:01.456600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.456602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:01.456603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:01.456610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.456613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.456616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554041284062348:3803]
2025-10-02T09:29:01.456643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:01.456648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.456650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:01.456658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:01.456665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:01.456670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:01.456781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:01.455344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:01.498943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554041359582279:3694]
2025-10-02T09:29:01.499209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7556554041359582279:3694]
2025-10-02T09:29:01.608205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:01.615724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.615751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.615915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.615985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.616050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.616112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.616156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.616165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.616242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.616307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.616372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.616438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.616484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.616491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.616559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.616616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.616675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.616738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.616789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.616796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.616881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.616939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.617001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.617062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.617106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.617113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.617181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.617239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.617300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.617361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.617403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.617414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.617481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.617539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.617604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.617672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.617733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.617740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.617802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.617865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.617948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.618019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.618068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.618077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.618147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.618206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.618265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.618325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.618369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.618376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.618435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.618495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.618555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.618613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.618658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.618665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.618726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:01.618788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:01.618856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:01.618921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:01.618968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:01.618976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:01.619032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582279:3694], now have 1 active actors on pipe
2025-10-02T09:29:01.619309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:01.619370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:01.619373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:01.619377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554041359582279:3694]
2025-10-02T09:29:01.619399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: error at write: Disconnected sessionId: src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0
2025-10-02T09:29:01.619621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0 is DEAD
2025-10-02T09:29:01.619729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:01.619739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Write session will restart in 0.008074s
2025-10-02T09:29:01.619763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Write session: Do CDS request
2025-10-02T09:29:01.619769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:01.620092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:01.627609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:01.629261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.629365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:01.629386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:01.629414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-10-02T09:29:01.629534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.629534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:01.629540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:01.629547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:01.629559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:01.629568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:01.629572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:01.629583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:01.629611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554041284062471:3805]
2025-10-02T09:29:01.629913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-10-02T09:29:01.629951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:01.629956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:01.629958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:01.629962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554041359582361:4226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:01.630131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:01.630364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554041359582361:4226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:01.630372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:01.630407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:01.630647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:01.630700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.630705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.630707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.630708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.630709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.630710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.630711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.630713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.630714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.630715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.630716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.630717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.630722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.630729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.630731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.630734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.630736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.630738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.630740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.630742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.630744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.630747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.630749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.630751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.630756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.630760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.630764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.630767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.630769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.630772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.630775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.630777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.630779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.630782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.630785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.630788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.630790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.630793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.630796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.630800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.630802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.630805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.630807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.630809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.630812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.630815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.630817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.630820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.630836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:01.632372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554041359582361:4226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:01.636846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554041359582361:4226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:01.636864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554041359582361:4226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:01.636867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554041359582361:4226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:01.636875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:01.639252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:01.640798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:01.640826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:01.640828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:01.640831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:01.640836Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [2:7556554041284062471:3805]
2025-10-02T09:29:01.640846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:01.640859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:01.640861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.640863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.640865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.640877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:01.640882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:01.640887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:01.640929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.640932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.640933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.640935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:01.640937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:01.640983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:01.640989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.640998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.641004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.641016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:01.641031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.641036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.641038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.641046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:01.641053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:01.641056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:01.641058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:01.641058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:01.641067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:01.641072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:01.641079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582401:4226], now have 1 active actors on pipe
2025-10-02T09:29:01.641085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582282:2446], now have 1 active actors on pipe
2025-10-02T09:29:01.641110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.641120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:01.641140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:01.641126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 291
2025-10-02T09:29:01.641151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 291
2025-10-02T09:29:01.641188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.641194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.641212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:01.641216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.641218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.641219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:01.641225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.641232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:01.641245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.641371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.641377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.641385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.641450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 36 sessionId: src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0
2025-10-02T09:29:01.641771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae014cb-25773ecf-5fa7dac0-bb39eae5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:01.644444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Write session: try to update token
2025-10-02T09:29:01.644459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:01.655179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:01.655197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.655205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.655246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:01.655257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:01.655410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:01.655546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.655690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.655821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:01.655997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:01.656036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:01.660329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:01.660747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:01.660768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.660772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:01.660774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:01.660782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.660786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.660789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554041284062466:3805]
2025-10-02T09:29:01.660838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:01.660841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:01.660847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.660849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:01.660849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:01.660853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:01.660988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:01.663007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:01.719602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554041359582411:3694]
2025-10-02T09:29:01.719900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7556554041359582411:3694]
2025-10-02T09:29:01.793989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:01.794303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.794316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.794333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582411:3694], now have 1 active actors on pipe
2025-10-02T09:29:01.794509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:01.794555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:01.794572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:01.794626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0
2025-10-02T09:29:01.794686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554041359582411:3694]
2025-10-02T09:29:01.794705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:01.794789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0 is DEAD
2025-10-02T09:29:01.795043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:01.795056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Write session will restart in 0.006618s
2025-10-02T09:29:01.795087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Write session: Do CDS request
2025-10-02T09:29:01.795094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:01.803384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.803557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:01.803572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-10-02T09:29:01.803704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.803733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:01.803748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:01.803754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:01.804120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-10-02T09:29:01.804157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:01.804163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:01.804165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:01.804170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554041359582506:4238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:01.804668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554041359582506:4238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:01.805826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:01.806542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554041359582506:4238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:01.807383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:01.807562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:01.807577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:01.807588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:01.807649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:01.807693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554041284062629:3820]
2025-10-02T09:29:01.808308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:01.808583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:01.808633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:01.808647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554041359582506:4238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:01.808660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554041359582506:4238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:01.808664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554041359582506:4238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:01.808675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:01.808954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:01.809025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.809032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.809033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.809034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.809035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.809036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.809037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.809038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.809039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.809040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.809041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.809042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.809047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.809057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.809060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.809064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.809068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.809071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.809074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.809078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.809081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.809085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.809088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.809091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.809097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.809104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.809114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.809123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.809127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.809132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.809135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.809147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.809151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.809155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.809159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.809163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.809167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.809172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.809176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.809185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.809194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.809198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.809206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.809215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.809219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.809224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.809234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.809238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.809270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:01.817573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:01.819513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:01.819536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:01.819539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:01.819543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:01.819549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [2:7556554041284062629:3820]
2025-10-02T09:29:01.819561Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:01.819581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:01.819588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.819591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.819593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.819606Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:01.819618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:01.819624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:01.819677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.819687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.819689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.819692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:01.819694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:01.819758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:01.819765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.819777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.819795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.819817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:01.819842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582557:4238], now have 1 active actors on pipe
2025-10-02T09:29:01.819853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.819855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.819857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.819869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:01.819876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582443:2446], now have 1 active actors on pipe
2025-10-02T09:29:01.819887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:01.819890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:01.819893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:01.819895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:01.819900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:01.819903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:01.819920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 292
2025-10-02T09:29:01.819923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 292
2025-10-02T09:29:01.819938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.819949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:01.819951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:01.819976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.819981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.820016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:01.820026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.820030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.820036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:01.820045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.820054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:01.820074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.820215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.820223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.820237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.820328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 36 sessionId: src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0
2025-10-02T09:29:01.820664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17fd519-c47f56f7-ab4ca3e9-7dfc50d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:01.823598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Write session: try to update token
2025-10-02T09:29:01.823623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:01.830155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:01.830172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.830174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:01.830176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:01.830184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.830192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.830196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554041284062623:3820]
2025-10-02T09:29:01.830240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:01.830254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.830256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:01.830262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:01.830268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:01.830272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:01.830404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:01.839430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:01.841723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:01.892660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554041359582566:3694]
2025-10-02T09:29:01.892978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7556554041359582566:3694]
2025-10-02T09:29:01.963323Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:01.963804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.963815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.963828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582566:3694], now have 1 active actors on pipe
2025-10-02T09:29:01.964042Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:01.964075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554041359582566:3694]
2025-10-02T09:29:01.964076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:01.964079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:01.964100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:01.964154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0
2025-10-02T09:29:01.964318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0 is DEAD
2025-10-02T09:29:01.964525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:01.964540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Write session will restart in 0.006681s
2025-10-02T09:29:01.964570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Write session: Do CDS request
2025-10-02T09:29:01.964581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:01.972181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:01.972246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.972340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:01.972354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-10-02T09:29:01.972484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:01.972515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:01.972525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:01.972528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:01.972915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-10-02T09:29:01.972953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:01.972959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:01.972961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:01.972967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554041359582652:4242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:01.973503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554041359582652:4242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:01.973777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:01.973979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:01.973987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:01.973994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:01.974033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:01.974061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554041284062748:3822]
2025-10-02T09:29:01.974416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:01.974632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:01.974661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:01.974883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:01.974930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.974936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.974937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.974938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.974938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.974939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.974940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.974941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.974942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.974942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.974943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.974944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.974949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.974957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.974960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.974963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.974966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.974969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.974972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.974975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.974979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.974983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.974986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.974989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.974995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.975001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:01.975005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.975010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:01.975013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.975018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:01.975022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.975026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:01.975030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.975034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:01.975037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.975042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:01.975045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.975049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:01.975052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.975056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:01.975059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.975063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:01.975067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.975071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.975075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.975079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.975082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.975086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.975116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:01.975324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554041359582652:4242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:01.980470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554041359582652:4242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:01.980483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554041359582652:4242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:01.980485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554041359582652:4242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:01.980491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:01.983377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:01.986382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:01.986403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:01.986406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:01.986410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:01.986416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [2:7556554041284062748:3822]
2025-10-02T09:29:01.986430Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:01.986447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:01.986460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.986463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.986465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.986479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:01.986484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:01.986490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:01.986546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.986553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.986555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.986559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:01.986564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:01.986623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:01.986633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.986647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:01.986659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:01.986675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:01.986697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582688:4242], now have 1 active actors on pipe
2025-10-02T09:29:01.986706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554041359582571:2446], now have 1 active actors on pipe
2025-10-02T09:29:01.986711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.986713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.986715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.986727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:01.986738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:01.986752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:01.986760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:01.986789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.986795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:01.986780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 293
2025-10-02T09:29:01.986781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 293
2025-10-02T09:29:01.986821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:01.986832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:01.986834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:01.986841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:01.986878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.986886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.986904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:01.986913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:01.986917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:01.986919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:01.986926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:01.986935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:01.986952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.987070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:01.987075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:01.987083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:01.987153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 36 sessionId: src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0
2025-10-02T09:29:01.987460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb0bc4c-4bbc85a9-3c45c3c1-4b595071_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:01.993642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Write session: try to update token
2025-10-02T09:29:01.993659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:01.999606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:01.999624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:01.999626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:01.999628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:01.999639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.999643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.999647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554041284062743:3822]
2025-10-02T09:29:01.999681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:01.999680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:01.999686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:01.999689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:01.999691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:01.999693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:01.999989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:02.012474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:02.014921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:02.064184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554045654549991:3694]
2025-10-02T09:29:02.064458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7556554045654549991:3694]
2025-10-02T09:29:02.145027Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:02.145267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.145282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.145298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654549991:3694], now have 1 active actors on pipe
2025-10-02T09:29:02.145495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:02.145501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554045654549991:3694]
2025-10-02T09:29:02.145512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:02.145518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:02.145572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: error at write: Disconnected sessionId: src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0
2025-10-02T09:29:02.145754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0 is DEAD
2025-10-02T09:29:02.145912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:02.145923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Write session will restart in 0.006691s
2025-10-02T09:29:02.145944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Write session: Do CDS request
2025-10-02T09:29:02.145953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:02.145976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:02.153244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.153327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:02.153342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-10-02T09:29:02.153483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.153519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:02.153528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:02.153533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:02.153954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-10-02T09:29:02.153990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:02.153991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:02.153995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:02.154000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554045654550075:4247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:02.154475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554045654550075:4247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:02.155256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:02.156621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554045654550075:4247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:02.156759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:02.156961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:02.156972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:02.156982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:02.157036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:02.157079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554045579030168:3825]
2025-10-02T09:29:02.157650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:02.157948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:02.157994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:02.158310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:02.158351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.158356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.158356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.158357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.158358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.158358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.158359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.158360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.158360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.158361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.158362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.158362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.158365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.158371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.158374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.158376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.158378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.158381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.158383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.158385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.158387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.158391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.158393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.158395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.158399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.158403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.158407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.158410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.158412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.158415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.158418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.158421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.158423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.158426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.158429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.158431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.158434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.158437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.158439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.158443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.158445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.158449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.158452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.158455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.158458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.158461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.158464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.158467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.158486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:02.158965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554045654550075:4247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:02.158979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554045654550075:4247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:02.158982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554045654550075:4247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:02.158988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:02.167396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:02.169183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:02.169199Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:02.169202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:02.169207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:02.169212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [2:7556554045579030168:3825]
2025-10-02T09:29:02.169226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:02.169240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:02.169243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.169247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.169249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.169261Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:02.169271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:02.169276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:02.169333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.169340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.169342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.169345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:02.169347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:02.169600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 294
2025-10-02T09:29:02.169415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:02.169425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.169439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.169449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.169464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:02.169481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654549996:2446], now have 1 active actors on pipe
2025-10-02T09:29:02.169485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550117:4247], now have 1 active actors on pipe
2025-10-02T09:29:02.169490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.169492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.169647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 294
2025-10-02T09:29:02.169493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.169508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:02.169522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:02.169535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:02.169536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:02.169538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:02.169540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:02.169542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:02.169569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.169576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:02.169583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:02.169790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.169806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.169832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:02.169842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.169863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.169870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:02.169880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.169895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:02.169916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.170200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.170214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.170233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.170334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 36 sessionId: src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0
2025-10-02T09:29:02.170678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16aa4b0b-98350ff-eaf45830-b24351e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:02.173382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Write session: try to update token
2025-10-02T09:29:02.173396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:02.180312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:02.180338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.180347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.180387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:02.180392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:02.180534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:02.180662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.180788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.180936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.181314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:02.181359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:02.188769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:02.190790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:02.190808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.190810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:02.190811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:02.190818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.190821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.190825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554045579030163:3825]
2025-10-02T09:29:02.190859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:02.190865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.190865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:02.190867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:02.190869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:02.190872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:02.191029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:02.191320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:02.245438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554045654550124:3694]
2025-10-02T09:29:02.245723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7556554045654550124:3694]
2025-10-02T09:29:02.328821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:02.329174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.329187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.329203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550124:3694], now have 1 active actors on pipe
2025-10-02T09:29:02.329412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:02.329439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:02.329449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554045654550124:3694]
2025-10-02T09:29:02.329476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:02.329542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0
2025-10-02T09:29:02.329715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0 is DEAD
2025-10-02T09:29:02.329837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:02.329854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Write session will restart in 0.009797s
2025-10-02T09:29:02.329873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Write session: Do CDS request
2025-10-02T09:29:02.329881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:02.338663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:02.340354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:02.340520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:02.340529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:02.340537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:02.340580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:02.340619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554045579030290:3827]
2025-10-02T09:29:02.341190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:02.341339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.341420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:02.341460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:02.341431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:02.341446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
2025-10-02T09:29:02.341570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.341596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:02.341604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:02.341609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:02.341754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:02.341802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.341808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.341809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.341810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.341811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.341812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.341813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.341814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.341816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.341817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.341818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.341819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.341824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.341836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.341840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.341844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.341847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.341851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.341854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.341858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.341861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.341866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.341869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.341872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.341879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.341886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.341895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.341901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.341907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.341912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.341920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.341925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.341930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.341935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.341943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.341950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.341958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.341963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.341967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.341976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.341980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.341984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.341993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.341998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.342006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.342011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.342015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.342020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.342059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:02.342151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-10-02T09:29:02.342190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:02.342196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:02.342198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:02.342203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554045654550213:4251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:02.342683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554045654550213:4251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:02.344444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554045654550213:4251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:02.350054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554045654550213:4251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:02.350071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554045654550213:4251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:02.350075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554045654550213:4251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:02.350083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:02.350771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:02.352778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:02.352795Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:02.352796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:02.352799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:02.352819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [2:7556554045579030290:3827]
2025-10-02T09:29:02.352831Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:02.352844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:02.352846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.352848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.352849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.352860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:02.352863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:02.352868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:02.352924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.352932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.352934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.352937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:02.352939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:02.353008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:02.353017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.353031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.353041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.353057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:02.353079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550127:2446], now have 1 active actors on pipe
2025-10-02T09:29:02.353086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550249:4251], now have 1 active actors on pipe
2025-10-02T09:29:02.353092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.353094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.353096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.353107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:02.353121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:02.353124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:02.353126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:02.353127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:02.353142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:02.353148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:02.353178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.353188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:02.353166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 295
2025-10-02T09:29:02.353189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 295
2025-10-02T09:29:02.353204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:02.353228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.353236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.353257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:02.353267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.353272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.353274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:02.353283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.353295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:02.353312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.353463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.353476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.353500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.353562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 36 sessionId: src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0
2025-10-02T09:29:02.353908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aff5f4-b3f9f06b-83ebd83f-8682469_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:02.356714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Write session: try to update token
2025-10-02T09:29:02.356731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:02.369639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:02.369657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.369666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.369705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:02.369712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:02.369875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:02.370030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.370165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.370299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.370604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:02.370648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:02.371896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:02.374876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:02.375742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.375761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.375779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:02.375782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.375784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:02.375790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:02.375798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.375802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.375806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554045579030285:3827]
2025-10-02T09:29:02.375848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:02.375851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:02.375857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.375860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:02.375864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:02.375867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:02.375998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:02.429759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554045654550269:3694]
2025-10-02T09:29:02.430063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7556554045654550269:3694]
2025-10-02T09:29:02.520887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:02.521289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:02.521323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550269:3694], now have 1 active actors on pipe
2025-10-02T09:29:02.521457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:02.521499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554045654550269:3694]
2025-10-02T09:29:02.521519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:02.521563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:02.521571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:02.521635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: error at write: Disconnected sessionId: src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0
2025-10-02T09:29:02.521801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0 is DEAD
2025-10-02T09:29:02.521949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:02.521961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Write session will restart in 0.009702s
2025-10-02T09:29:02.521980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Write session: Do CDS request
2025-10-02T09:29:02.521989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:02.532140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:02.534023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:02.534224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:02.534236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:02.534247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:02.534297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.534320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:02.534362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554045579030427:3830]
2025-10-02T09:29:02.534399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:02.534416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-10-02T09:29:02.534545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.534571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:02.534579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:02.534584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:02.534974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:02.535024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-10-02T09:29:02.535076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:02.535083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:02.535085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:02.535090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554045654550356:4256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:02.535341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:02.535397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:02.535641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554045654550356:4256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:02.535726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:02.535782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.535788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.535789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.535790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.535791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.535792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.535794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.535795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.535796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.535797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.535798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.535799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.535804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.535814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.535818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.535821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.535825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.535829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.535832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.535836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.535840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.535844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.535848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.535851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.535857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.535864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.535869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.535874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.535879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.535884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.535888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.535894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.535903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.535908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.535914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.535919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.535928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.535933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.535940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.535945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.535956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.535975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.535980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.535984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.535989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.535993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.535997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.536001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.536035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:02.537610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554045654550356:4256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:02.542531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554045654550356:4256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:02.542555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554045654550356:4256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:02.542558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554045654550356:4256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:02.542572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:02.545094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:02.547059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:02.547083Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:02.547085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:02.547089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:02.547097Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [2:7556554045579030427:3830]
2025-10-02T09:29:02.547114Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:02.547143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:02.547146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.547149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.547152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.547168Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:02.547176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:02.547182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:02.547244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.547254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.547257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.547260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:02.547262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:02.547344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:02.547352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.547366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.547382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.547403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:02.547427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550271:2446], now have 1 active actors on pipe
2025-10-02T09:29:02.547436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550393:4256], now have 1 active actors on pipe
2025-10-02T09:29:02.547443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.547444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.547446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.547459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:02.547474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:02.547483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:02.547488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:02.547491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:02.547497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:02.547500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:02.547525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.547534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:02.547541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:02.547517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 296
2025-10-02T09:29:02.547550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 296
2025-10-02T09:29:02.547572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.547591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.547627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|512868bd-32910bed-7f1bc3d-831ca38c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:02.547634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.547639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.547648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:02.547658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.547672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:02.547691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.547857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.547868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.547884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.547973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 36 sessionId: src_id|512868bd-32910bed-7f1bc3d-831ca38c_0
2025-10-02T09:29:02.548402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e4c4cb-2acec29f-6b8273d8-63f09628_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|512868bd-32910bed-7f1bc3d-831ca38c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:02.551528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Write session: try to update token
2025-10-02T09:29:02.551552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:02.558728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:02.558749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.558758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.558803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:02.558815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:02.559010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:02.559171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.559315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.559511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.559714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:02.559768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:02.567793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|512868bd-32910bed-7f1bc3d-831ca38c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:02.569482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:02.569504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.569506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:02.569508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:02.569516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.569521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.569525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554045579030421:3830]
2025-10-02T09:29:02.569561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:02.569567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.569568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:02.569570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:02.569573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:02.569577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:02.569736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:02.570411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:02.621765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554045654550402:3694]
2025-10-02T09:29:02.622075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7556554045654550402:3694]
2025-10-02T09:29:02.716705Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:02.717228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.717243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.717261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550402:3694], now have 1 active actors on pipe
2025-10-02T09:29:02.717470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:02.717528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554045654550402:3694]
2025-10-02T09:29:02.717566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:02.717635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: status is not ok: tablet will be restarted right now sessionId: src_id|512868bd-32910bed-7f1bc3d-831ca38c_0
2025-10-02T09:29:02.717825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|512868bd-32910bed-7f1bc3d-831ca38c_0 is DEAD
2025-10-02T09:29:02.717887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:02.718028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:02.718038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Write session will restart in 0.009746s
2025-10-02T09:29:02.718062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Write session: Do CDS request
2025-10-02T09:29:02.718068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:02.728640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:02.729355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.729405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:02.729425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-10-02T09:29:02.729582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.729623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:02.729632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:02.729637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:02.730049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-10-02T09:29:02.730096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:02.730106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:02.730108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:02.730113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554045654550495:4261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:02.730626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554045654550495:4261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:02.730861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:02.731047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:02.731056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:02.731065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:02.731113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:02.731175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554045579030552:3832]
2025-10-02T09:29:02.731731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:02.732048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:02.732104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:02.732426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:02.732486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.732492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.732492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.732494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.732495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.732496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.732497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.732498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.732499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.732500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.732501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.732502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.732507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.732516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.732520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.732523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.732527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.732530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.732533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.732536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.732539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.732543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.732547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.732550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.732556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.732563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.732569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.732574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.732578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.732582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.732586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.732590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.732594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.732602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.732606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.732611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.732615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.732624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.732629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.732633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.732642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.732646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.732651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.732655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.732660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.732664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.732648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554045654550495:4261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:02.732674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.732706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:02.738936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554045654550495:4261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:02.738957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554045654550495:4261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:02.738961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554045654550495:4261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:02.738969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:02.742404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:02.744289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:02.744313Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:02.744315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:02.744319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:02.744325Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [2:7556554045579030552:3832]
2025-10-02T09:29:02.744340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:02.744356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:02.744360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.744363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.744365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.744381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:02.744391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:02.744398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:02.744463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.744474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.744476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.744480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:02.744483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:02.744565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:02.744570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.744583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.744598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.744616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:02.744641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550533:4261], now have 1 active actors on pipe
2025-10-02T09:29:02.744649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550407:2446], now have 1 active actors on pipe
2025-10-02T09:29:02.744654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.744658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.744660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.744671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:02.744687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:02.744689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:02.744697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:02.744699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:02.744703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:02.744706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:02.744738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.744745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:02.744755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:02.744726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 297
2025-10-02T09:29:02.744780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.744735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 297
2025-10-02T09:29:02.744789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.745099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acd334f9-5ced6cd8-d01949df-64c36085_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:02.745114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.745118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.745120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:02.745130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.745140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:02.745156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.745432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.745444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.745458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.745608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 36 sessionId: src_id|acd334f9-5ced6cd8-d01949df-64c36085_0
2025-10-02T09:29:02.745956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|512868bd-32910bed-7f1bc3d-831ca38c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|acd334f9-5ced6cd8-d01949df-64c36085_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:02.748908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Write session: try to update token
2025-10-02T09:29:02.748924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:02.756430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:02.756451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.756454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:02.756456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:02.756463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.756467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.756471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554045579030546:3832]
2025-10-02T09:29:02.756507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:02.756514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.756515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:02.756517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:02.756520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:02.756524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:02.756652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:02.770862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|acd334f9-5ced6cd8-d01949df-64c36085_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:02.774153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:02.817840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554045654550557:3694]
2025-10-02T09:29:02.818149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7556554045654550557:3694]
2025-10-02T09:29:02.906215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:02.906608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.906624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.906643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550557:3694], now have 1 active actors on pipe
2025-10-02T09:29:02.906851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:02.906979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554045654550557:3694]
2025-10-02T09:29:02.906997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:02.907000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:02.907012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:02.907063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: error at write: Disconnected sessionId: src_id|acd334f9-5ced6cd8-d01949df-64c36085_0
2025-10-02T09:29:02.907248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|acd334f9-5ced6cd8-d01949df-64c36085_0 is DEAD
2025-10-02T09:29:02.907418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:02.907430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Write session will restart in 0.006749s
2025-10-02T09:29:02.907452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Write session: Do CDS request
2025-10-02T09:29:02.907458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:02.915413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.915541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:02.915560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-10-02T09:29:02.915687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:02.915717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:02.915722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:02.915727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:02.916229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-10-02T09:29:02.916264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:02.916273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:02.916274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:02.916279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554045654550614:4272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:02.916769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554045654550614:4272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:02.918755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:02.919117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554045654550614:4272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:02.920468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:02.920639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:02.920651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:02.920660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:02.920705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:02.920740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554045579030714:3847]
2025-10-02T09:29:02.921361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:02.921636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:02.921681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:02.921997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:02.922001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554045654550614:4272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:02.922018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554045654550614:4272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:02.922021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554045654550614:4272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:02.922027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:02.922063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.922069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.922070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.922071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.922072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.922073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.922074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.922075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.922077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.922078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.922079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.922080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.922085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.922096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.922100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.922104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.922108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.922112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.922116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.922119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.922123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.922127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.922131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.922135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.922141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.922148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:02.922154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.922159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:02.922163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.922169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:02.922173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.922178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:02.922183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.922192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:02.922196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.922205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:02.922209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.922214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:02.922218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.922225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:02.922230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.922235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:02.922243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.922248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.922253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.922258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.922264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.922269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.922304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:02.931836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:02.933827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:02.933850Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:02.933853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:02.933857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:02.933865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [2:7556554045579030714:3847]
2025-10-02T09:29:02.933879Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:02.933897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:02.933901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.933904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.933906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.933921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:02.933934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:02.933940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:02.934002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.934011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.934013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.934017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:02.934019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:02.934084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:02.934087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.934100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:02.934109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:02.934125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:02.934142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.934144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.934146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.934160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:02.934172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:02.934186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:02.934189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:02.934220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:02.934223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:02.934225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:02.934226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.934229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:02.934232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:02.934457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 298
2025-10-02T09:29:02.934461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 298
2025-10-02T09:29:02.934364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550692:4272], now have 1 active actors on pipe
2025-10-02T09:29:02.934380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554045654550568:2446], now have 1 active actors on pipe
2025-10-02T09:29:02.934524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.934530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.934556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:02.934566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:02.934570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:02.934572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:02.934583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:02.934594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:02.934611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.934831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:02.934841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:02.934856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:02.935065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 36 sessionId: src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0
2025-10-02T09:29:02.935446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd334f9-5ced6cd8-d01949df-64c36085_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:02.938784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Write session: try to update token
2025-10-02T09:29:02.938803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:02.948886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:02.948907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.948917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.948964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:02.949144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:02.949293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.949439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.949584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:02.949787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:02.949823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:02.950719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:02.959697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:02.959717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:02.959723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:02.959725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:02.959734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.959738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.959741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554045579030708:3847]
2025-10-02T09:29:02.959785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:02.959787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:02.959791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:02.959793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:02.959794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:02.959797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:02.959933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:02.959248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:02.961963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:03.007482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554049949517997:3694]
2025-10-02T09:29:03.007790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7556554049949517997:3694]
2025-10-02T09:29:03.104120Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:03.104370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.104382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.104400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949517997:3694], now have 1 active actors on pipe
2025-10-02T09:29:03.104575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:03.104641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554049949517997:3694]
2025-10-02T09:29:03.104671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:03.104671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:03.104737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0
2025-10-02T09:29:03.104919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0 is DEAD
2025-10-02T09:29:03.105017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:03.105025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Write session will restart in 0.007476s
2025-10-02T09:29:03.105052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Write session: Do CDS request
2025-10-02T09:29:03.105056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:03.113268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:03.113391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.113601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:03.113614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-10-02T09:29:03.113726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.113752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:03.113759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:03.113763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:03.114135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-10-02T09:29:03.114169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:03.114174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:03.114176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:03.114182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554049949518089:4277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:03.114637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554049949518089:4277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:03.114668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:03.114796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:03.114803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:03.114809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:03.114839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:03.114864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554049873998136:3850]
2025-10-02T09:29:03.115247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:03.115464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:03.115493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:03.115693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:03.115724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.115729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.115729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.115730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.115730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.115731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.115732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.115732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.115733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.115733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.115734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.115734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.115737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.115744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.115746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.115748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.115750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.115752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.115754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.115756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.115758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.115761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.115763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.115765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.115768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.115772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.115776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.115779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.115781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.115784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.115786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.115789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.115792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.115795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.115797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.115800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.115803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.115806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.115808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.115810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.115813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.115815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.115818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.115820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.115822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.115825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.115827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.115830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.115848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:03.116503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554049949518089:4277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:03.121695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554049949518089:4277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:03.121709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554049949518089:4277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:03.121712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554049949518089:4277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:03.121718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:03.124002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:03.125627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:03.125644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:03.125645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:03.125649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:03.125653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [2:7556554049873998136:3850]
2025-10-02T09:29:03.125662Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:03.125674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:03.125677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.125679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.125680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.125695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:03.125698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:03.125703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:03.125742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.125748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.125750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.125752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:03.125754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:03.125795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:03.125801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.125808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.125814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.125827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:03.125842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.125847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.125848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.125853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:03.125861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518128:4277], now have 1 active actors on pipe
2025-10-02T09:29:03.125861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:03.125863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:03.125864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:03.125867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:03.125875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:03.125876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:03.125880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518002:2446], now have 1 active actors on pipe
2025-10-02T09:29:03.125904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.125914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:03.125921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:03.125960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 299
2025-10-02T09:29:03.125964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 299
2025-10-02T09:29:03.126046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.126060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.126087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:03.126100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.126108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.126110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:03.126120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.126147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:03.126164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.126324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.126335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.126354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.126440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 36 sessionId: src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0
2025-10-02T09:29:03.126772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df22a09-c4d10eb8-dd8d1c29-35fbaccb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:03.129361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Write session: try to update token
2025-10-02T09:29:03.129374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:03.136492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:03.136512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:03.136514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:03.136515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:03.136522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.136526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.136529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554049873998131:3850]
2025-10-02T09:29:03.136565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:03.136572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.136572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:03.136574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:03.136576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:03.136580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:03.136699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:03.141900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:03.144299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:03.204903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554049949518135:3694]
2025-10-02T09:29:03.205179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7556554049949518135:3694]
2025-10-02T09:29:03.273262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:03.273506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.273516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.273542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518135:3694], now have 1 active actors on pipe
2025-10-02T09:29:03.273704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:03.273771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:03.273789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:03.273828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554049949518135:3694]
2025-10-02T09:29:03.273853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0
2025-10-02T09:29:03.274018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0 is DEAD
2025-10-02T09:29:03.274160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:03.274169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Write session will restart in 0.007960s
2025-10-02T09:29:03.274184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Write session: Do CDS request
2025-10-02T09:29:03.274188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:03.282043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:03.283348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.283437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:03.283451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-10-02T09:29:03.283581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.283610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:03.283619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:03.283622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:03.283765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:03.283904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:03.283911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:03.283917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:03.283957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:03.283978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-10-02T09:29:03.283983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554049873998263:3852]
2025-10-02T09:29:03.284005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:03.284012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:03.284013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:03.284020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554049949518225:4281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:03.284369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:03.284481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554049949518225:4281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:03.284676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:03.284728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:03.284985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:03.285033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.285039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.285039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.285040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.285041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.285042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.285043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.285044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.285045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.285046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.285047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.285048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.285053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.285062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.285065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.285069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.285072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.285076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.285078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.285080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.285082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.285085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.285087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.285089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.285092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.285097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.285100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.285103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.285106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.285108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.285111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.285114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.285116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.285119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.285121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.285124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.285126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.285129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.285131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.285134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.285136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.285139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.285141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.285144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.285147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.285149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.285151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.285154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.285171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:03.286454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554049949518225:4281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:03.291024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554049949518225:4281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:03.291041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554049949518225:4281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:03.291047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554049949518225:4281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:03.291054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:03.293276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:03.295158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:03.295173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:03.295176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:03.295179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:03.295186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [2:7556554049873998263:3852]
2025-10-02T09:29:03.295200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:03.295216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:03.295224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.295227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.295228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.295243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:03.295252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:03.295259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:03.295320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.295327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.295329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.295332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:03.295334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:03.295394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:03.295402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.295416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.295426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.295446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:03.295470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518264:4281], now have 1 active actors on pipe
2025-10-02T09:29:03.295476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518137:2446], now have 1 active actors on pipe
2025-10-02T09:29:03.295479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.295482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.295484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.295496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:03.295513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:03.295530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:03.295534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:03.295536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:03.295538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:03.295539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:03.295566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.295573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:03.295579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:03.295539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 300
2025-10-02T09:29:03.295541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 300
2025-10-02T09:29:03.295594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.295601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.295623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:03.295627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.295630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.295631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:03.295637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.295646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:03.295657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.295805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.295811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.295821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.295882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 36 sessionId: src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0
2025-10-02T09:29:03.296225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|964819a8-dc9c4aeb-55894469-96c42a1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:03.299057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Write session: try to update token
2025-10-02T09:29:03.299074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:03.305780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:03.305800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:03.305803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:03.305805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:03.305812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.305816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.305824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554049873998257:3852]
2025-10-02T09:29:03.305859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:03.305865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.305866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:03.305870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:03.305876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:03.305882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:03.305985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:03.311476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:03.313913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:03.375414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554049949518283:3694]
2025-10-02T09:29:03.375778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7556554049949518283:3694]
2025-10-02T09:29:03.453093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:03.453806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.453829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.453847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518283:3694], now have 1 active actors on pipe
2025-10-02T09:29:03.454090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554049949518283:3694]
2025-10-02T09:29:03.454141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:03.454153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:03.454156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:03.454186Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:29:03.454269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: error at write: Disconnected sessionId: src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0
2025-10-02T09:29:03.454311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:03.454380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0 is DEAD
2025-10-02T09:29:03.454431Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_16615936339092450329_v1 is DEAD
2025-10-02T09:29:03.454628Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553968345123422:3691] disconnected; active server actors: 1
2025-10-02T09:29:03.454639Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556553968345123422:3691] client user disconnected session shared/user_1_3_16615936339092450329_v1
2025-10-02T09:29:03.454887Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:29:03.455077Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:03.455085Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:03.455097Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005861s
2025-10-02T09:29:03.455307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:03.455323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Write session will restart in 0.007882s
2025-10-02T09:29:03.455374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Write session: Do CDS request
2025-10-02T09:29:03.455382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:03.462236Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:29:03.462467Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:29:03.462483Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-10-02T09:29:03.462663Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:03.462725Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:03.462852Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 auth for : user
2025-10-02T09:29:03.463096Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 Handle describe topics response
2025-10-02T09:29:03.463134Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 auth is DEAD
2025-10-02T09:29:03.463156Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:29:03.463446Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:29:03.463555Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_4_4674416184496851556_v1
2025-10-02T09:29:03.463600Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554049949518373:4286] connected; active server actors: 1
2025-10-02T09:29:03.463617Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554049949518373:4286] session shared/user_1_4_4674416184496851556_v1
2025-10-02T09:29:03.463627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:29:03.463636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:29:03.463642Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_4674416184496851556_v1" (Sender=[1:7556554049949518342:4286], Pipe=[1:7556554049949518373:4286], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:03.463644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:29:03.463655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:29:03.463669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_4674416184496851556_v1" (Sender=[1:7556554049949518342:4286], Pipe=[1:7556554049949518373:4286], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:03.463679Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_4674416184496851556_v1" sender [1:7556554049949518342:4286] lock partition 0 for ReadingSession "shared/user_1_4_4674416184496851556_v1" (Sender=[1:7556554049949518342:4286], Pipe=[1:7556554049949518373:4286], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-10-02T09:29:03.463693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:29:03.463703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-02T09:29:03.463930Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_4674416184496851556_v1" ClientId: "user" PipeClient { RawX1: 7556554049949518373 RawX2: 4503603922342078 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:29:03.463972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:29:03.464177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.464223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:03.464235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-10-02T09:29:03.464335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.464359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:03.464366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:03.464370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:03.464724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-10-02T09:29:03.464755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:03.464761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:03.464763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:03.464767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554049949518382:4290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:03.464881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:03.465317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554049949518382:4290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:03.466667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:03.466843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:03.466851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:03.466860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:03.466901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:03.466977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554049873998404:3855]
2025-10-02T09:29:03.467386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554049949518382:4290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:03.467571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:03.467902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:03.467939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:03.468243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:03.468290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.468296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.468297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.468298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.468299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.468300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.468301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.468302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.468303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.468304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.468305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.468306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.468311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.468320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.468323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.468327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.468330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.468333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.468336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.468339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.468343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.468346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.468350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.468353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.468359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.468366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.468370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.468375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.468379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.468383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.468395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.468401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.468408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.468414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.468421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.468429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.468433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.468442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.468450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.468455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.468461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.468468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.468472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.468476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.468482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.468488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.468492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.468497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.468541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:03.474472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554049949518382:4290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:03.474489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554049949518382:4290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:03.474493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554049949518382:4290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:03.474502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:03.478341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:03.481123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:03.481142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:03.481145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:03.481148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:03.481157Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [2:7556554049873998404:3855]
2025-10-02T09:29:03.481174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:03.481193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:03.481196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.481199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.481201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.481215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:03.481222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:03.481230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:03.481292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.481300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.481302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.481305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:03.481307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:03.481375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:03.481384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.481398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.481409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.481427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:03.481450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518376:4289], now have 1 active actors on pipe
2025-10-02T09:29:03.481459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518420:4290], now have 1 active actors on pipe
2025-10-02T09:29:03.481466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.481468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.481470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.481489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:03.481499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518286:2446], now have 1 active actors on pipe
2025-10-02T09:29:03.481503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:03.481507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:03.481507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:03.481509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:03.481521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:03.481524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:03.481559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.481573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:03.481597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:03.481578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7556554049949518376:4289]
2025-10-02T09:29:03.481611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 301
2025-10-02T09:29:03.481629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 301
2025-10-02T09:29:03.481770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.481779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.481790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_4674416184496851556_v1 on pipe: [1:7556554049949518376:4289]
2025-10-02T09:29:03.481815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.481823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.481837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.481842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.481844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:03.481854Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_4674416184496851556_v1:1 with generation 301
2025-10-02T09:29:03.481860Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_4674416184496851556_v1
2025-10-02T09:29:03.481862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.481895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:03.481906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:29:03.481910Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:29:03.486486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:29:03.486523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:29:03.486538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.486548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.486551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:03.486560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.486576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:03.486588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:29:03.486604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:29:03.486639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.486782Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397343480 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:29:03.486807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:29:03.486853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.486875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.486897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.486843Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 sending to client partition status
2025-10-02T09:29:03.487008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0
2025-10-02T09:29:03.487307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12361fa-14257d87-dac9b6e2-953a9c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:03.493194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:03.493210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:03.493221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.493265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:03.493300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:03.493434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:03.493575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:03.493707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:03.494045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:03.494232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:03.494275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:03.504384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:03.504422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:03.504425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:03.504427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:03.504439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.504444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.504448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554049873998398:3855]
2025-10-02T09:29:03.504486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:03.504502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:03.504505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.504507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:03.504514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:03.504518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:03.504688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:03.506133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Write session: try to update token
2025-10-02T09:29:03.506153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:03.527157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:03.531534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:03.644132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:03.644494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.644505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.644706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_4674416184496851556_v1
2025-10-02T09:29:03.644723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:03.644750Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_4674416184496851556_v1
2025-10-02T09:29:03.644771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554049949518376:4289]
2025-10-02T09:29:03.644798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:03.644830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:03.644909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0
2025-10-02T09:29:03.645094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0 is DEAD
2025-10-02T09:29:03.645231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:03.645241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Write session will restart in 0.008621s
2025-10-02T09:29:03.645265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Write session: Do CDS request
2025-10-02T09:29:03.645271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:03.654436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:03.655295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.655377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:03.655402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-10-02T09:29:03.655507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.655531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:03.655535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:03.655538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:03.655927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-10-02T09:29:03.655962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:03.655964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:03.655965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:03.655970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554049949518521:4294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:03.656070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:03.656242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:03.656250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:03.656258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:03.656308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:03.656341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554049873998533:3857]
2025-10-02T09:29:03.656465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554049949518521:4294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:03.656904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:03.657153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:03.657187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:03.657465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:03.657507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.657513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.657514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.657515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.657516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.657517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.657518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.657518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.657520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.657521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.657522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.657523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.657527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.657536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.657540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.657547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.657550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.657554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.657561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.657565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.657573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.657577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.657581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.657588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.657593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.657599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.657608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.657613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.657620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.657625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.657632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.657637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.657641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.657645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.657649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.657654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.657658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.657663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.657671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.657679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.657686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.657691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.657698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.657702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.657710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.657715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.657718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.657723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.657758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:03.658150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554049949518521:4294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:03.663487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554049949518521:4294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:03.663504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554049949518521:4294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:03.663507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554049949518521:4294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:03.663514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:03.666162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:03.667771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:03.667786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:03.667788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:03.667790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:03.667797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [2:7556554049873998533:3857]
2025-10-02T09:29:03.667807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:03.667819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:03.667821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.667822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.667824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.667835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:03.667839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:03.667843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:03.667881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.667887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.667888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.667890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:03.667892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:03.667939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:03.667946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.667954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.667960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.667969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:03.667981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.667984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.667985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.667994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:03.667998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:03.668000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:03.668001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:03.668016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518431:2446], now have 1 active actors on pipe
2025-10-02T09:29:03.668020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518559:4294], now have 1 active actors on pipe
2025-10-02T09:29:03.668025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:03.668035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:03.668037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:03.668062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.668074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:03.668089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:03.668116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 302
2025-10-02T09:29:03.668117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 302
2025-10-02T09:29:03.668222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.668234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.668262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:03.668274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.668278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.668279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:03.668286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.668293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:03.668307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.668461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.668467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.668476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.668547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0
2025-10-02T09:29:03.668914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5686ae3-42f327bf-b1d75569-c0dd3de1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:03.671460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Write session: try to update token
2025-10-02T09:29:03.671476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:03.679219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:03.679239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:03.679241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:03.679243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:03.679251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.679255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.679259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554049873998528:3857]
2025-10-02T09:29:03.679294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:03.679306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.679307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:03.679311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:03.679313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:03.679315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:03.679430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:03.685177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:03.687334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:03.745062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554049949518574:4289]
2025-10-02T09:29:03.745309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7556554049949518574:4289]
2025-10-02T09:29:03.815472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:03.815771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.815782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.815799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518574:4289], now have 1 active actors on pipe
2025-10-02T09:29:03.815993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:03.816057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:03.816097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554049949518574:4289]
2025-10-02T09:29:03.816115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:03.816185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0
2025-10-02T09:29:03.816307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0 is DEAD
2025-10-02T09:29:03.816461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:03.816471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Write session will restart in 0.009037s
2025-10-02T09:29:03.816496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Write session: Do CDS request
2025-10-02T09:29:03.816502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:03.825775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:03.826275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.826367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:03.826385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-10-02T09:29:03.826570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.826602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:03.826612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:03.826615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:03.827028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-10-02T09:29:03.827063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:03.827069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:03.827070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:03.827075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554049949518671:4299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:03.827415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:03.827571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:03.827580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:03.827558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554049949518671:4299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:03.827591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:03.827638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:03.827670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554049873998664:3860]
2025-10-02T09:29:03.828069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:03.828306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:03.828335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:03.828576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:03.828616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.828620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.828620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.828621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.828622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.828622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.828623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.828624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.828625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.828626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.828628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.828629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.828633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.828643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.828647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.828652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.828655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.828659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.828663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.828666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.828670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.828674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.828678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.828681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.828687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.828693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:03.828698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.828703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:03.828707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.828712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:03.828721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.828726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:03.828730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.828735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:03.828741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.828746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:03.828751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.828756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:03.828761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.828766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:03.828770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.828775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:03.828779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.828784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.828792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.828797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.828813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.828816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.828834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:03.829332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554049949518671:4299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:03.834503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554049949518671:4299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:03.834517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554049949518671:4299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:03.834520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554049949518671:4299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:03.834527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:03.837466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:03.839266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:03.839284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:03.839286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:03.839289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:03.839295Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [2:7556554049873998664:3860]
2025-10-02T09:29:03.839306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:03.839319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:03.839322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.839326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.839327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.839340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:03.839345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:03.839351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:03.839405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.839414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.839415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.839418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:03.839420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:03.839476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:03.839479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.839492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:03.839509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:03.839522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:03.839540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518579:2446], now have 1 active actors on pipe
2025-10-02T09:29:03.839546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518710:4299], now have 1 active actors on pipe
2025-10-02T09:29:03.839552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.839554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.839556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.839569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:03.839572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:03.839574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:03.839576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:03.839582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:03.839596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:03.839598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:03.839637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.839651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:03.839657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:03.839663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.839666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.839709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:03.839720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:03.839724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:03.839726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:03.839734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:03.839746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:03.839764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.840093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.840106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.840127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:03.839549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 303
2025-10-02T09:29:03.839591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 303
2025-10-02T09:29:03.840239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 36 sessionId: src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0
2025-10-02T09:29:03.840655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d795b12-f9ddc378-c4e0b6bd-b03852e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:03.843615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Write session: try to update token
2025-10-02T09:29:03.843633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:03.853123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:03.853145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:03.853147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:03.853149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:03.853156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.853159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.853164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554049873998659:3860]
2025-10-02T09:29:03.853197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:03.853202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:03.853207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:03.853210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:03.853211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:03.853212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:03.853356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:03.858702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:03.861196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:03.916088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554049949518739:4289]
2025-10-02T09:29:03.916364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7556554049949518739:4289]
2025-10-02T09:29:03.988007Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:03.988267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:03.988280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:03.988309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518739:4289], now have 1 active actors on pipe
2025-10-02T09:29:03.988513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:03.988542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:03.988559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:03.988583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554049949518739:4289]
2025-10-02T09:29:03.988604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:03.988614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: error at write: Disconnected sessionId: src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0
2025-10-02T09:29:03.988780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0 is DEAD
2025-10-02T09:29:03.988926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:03.988936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Write session will restart in 0.008889s
2025-10-02T09:29:03.988957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Write session: Do CDS request
2025-10-02T09:29:03.988971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:03.998360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:03.999292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.999670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:03.999689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-10-02T09:29:03.999794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:03.999817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:03.999820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:03.999823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:03.999926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:04.000095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:04.000104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:04.000114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:04.000156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:04.000193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554049873998831:3874]
2025-10-02T09:29:04.000252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-10-02T09:29:04.000284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:04.000290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:04.000293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:04.000298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554049949518837:4310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:04.000765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:04.000819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554049949518837:4310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:04.001048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:04.001085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:04.001382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:04.001431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.001438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.001439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.001440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.001441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.001443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.001444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.001445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.001446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.001447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.001448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.001449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.001453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.001463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.001468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.001472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.001476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.001480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.001484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.001488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.001491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.001495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.001499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.001503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.001509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.001516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.001522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.001527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.001532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.001538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.001542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.001547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.001552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.001560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.001564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.001573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.001577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.001586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.001591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.001601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.001605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.001611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.001616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.001624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.001629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.001634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.001638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.001643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.001683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:04.002809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554049949518837:4310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:04.008905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554049949518837:4310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:04.008926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554049949518837:4310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:04.008929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554049949518837:4310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:04.008936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:04.010357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:04.011959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:04.011976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:04.011978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:04.011981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:04.011986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [2:7556554049873998831:3874]
2025-10-02T09:29:04.011997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:04.012010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:04.012012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.012014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.012015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.012028Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:04.012034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:04.012040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:04.012093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.012102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.012104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.012106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:04.012107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:04.012159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:04.012166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.012324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.012342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.012365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:04.012321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 304
2025-10-02T09:29:04.012333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 304
2025-10-02T09:29:04.012391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486168:4310], now have 1 active actors on pipe
2025-10-02T09:29:04.012400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554049949518744:2446], now have 1 active actors on pipe
2025-10-02T09:29:04.012414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.012422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.012433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.012438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.012440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.012449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:04.012463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:04.012466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:04.012473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:04.012475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:04.012475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:04.012477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:04.012487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22574e44-1785ac16-8109e01c-ad6a5487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:04.012491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.012497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.012499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:04.012506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.012514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:04.012544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.012552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:04.012558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:04.012564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.012716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.012721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.012731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.012858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 36 sessionId: src_id|22574e44-1785ac16-8109e01c-ad6a5487_0
2025-10-02T09:29:04.013200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a385a8-4ec385f4-c3c7df21-71f9dc1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22574e44-1785ac16-8109e01c-ad6a5487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:04.016261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Write session: try to update token
2025-10-02T09:29:04.016275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:04.023658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:04.023678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.023683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:04.023685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:04.023692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.023696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.023699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554049873998826:3874]
2025-10-02T09:29:04.023735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:04.023742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.023744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:04.023753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:04.023761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:04.023780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:04.023892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:04.029341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|22574e44-1785ac16-8109e01c-ad6a5487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:04.031728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:04.088609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554054244486176:4289]
2025-10-02T09:29:04.088874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7556554054244486176:4289]
2025-10-02T09:29:04.154635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:04.154949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.154960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.154989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486176:4289], now have 1 active actors on pipe
2025-10-02T09:29:04.155170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:04.155206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:04.155221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:04.155229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:04.155276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: error at write: Disconnected sessionId: src_id|22574e44-1785ac16-8109e01c-ad6a5487_0
2025-10-02T09:29:04.155276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554054244486176:4289]
2025-10-02T09:29:04.155430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|22574e44-1785ac16-8109e01c-ad6a5487_0 is DEAD
2025-10-02T09:29:04.155561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:04.155569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Write session will restart in 0.009905s
2025-10-02T09:29:04.155586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Write session: Do CDS request
2025-10-02T09:29:04.155590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:04.165258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:04.166278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.166466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:04.166481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-10-02T09:29:04.166595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.166628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:04.166637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:04.166640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:04.166753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:04.166902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:04.166909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:04.166916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:04.166951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:04.166977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554054168966261:3877]
2025-10-02T09:29:04.167037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-10-02T09:29:04.167073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:04.167081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:04.167083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:04.167088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554054244486274:4315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:04.167362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:04.167573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:04.167608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:04.167607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554054244486274:4315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:04.167821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:04.167853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.167857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.167858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.167858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.167859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.167860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.167860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.167861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.167861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.167862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.167862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.167863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.167866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.167873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.167875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.167877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.167879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.167881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.167883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.167885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.167888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.167890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.167892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.167894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.167898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.167902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.167905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.167908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.167910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.167913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.167915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.167917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.167921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.167924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.167926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.167928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.167931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.167934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.167936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.167938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.167941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.167943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.167946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.167948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.167951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.167954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.167965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.167967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.167986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:04.169121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554054244486274:4315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:04.174793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554054244486274:4315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:04.174810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554054244486274:4315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:04.174813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554054244486274:4315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:04.174835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:04.176657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:04.178355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:04.178373Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:04.178374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:04.178377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:04.178381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [2:7556554054168966261:3877]
2025-10-02T09:29:04.178390Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:04.178402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:04.178404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.178406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.178407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.178417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:04.178421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:04.178426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:04.178475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.178484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.178485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.178488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:04.178490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:04.178550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:04.178558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.178570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.178585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.178602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:04.178620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486312:4315], now have 1 active actors on pipe
2025-10-02T09:29:04.178626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486180:2446], now have 1 active actors on pipe
2025-10-02T09:29:04.178631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.178632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.178635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.178647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:04.178668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:04.178681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:04.178683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:04.178685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:04.178689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:04.178692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:04.178712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.178718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:04.178720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:04.178688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 305
2025-10-02T09:29:04.178713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 305
2025-10-02T09:29:04.178747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.178755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.178777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a20892a6-48d1a774-26258e65-b7d7671c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:04.178784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.178786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.178788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:04.178794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.178801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:04.178810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.178965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.178975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.178988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.179067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 36 sessionId: src_id|a20892a6-48d1a774-26258e65-b7d7671c_0
2025-10-02T09:29:04.179421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22574e44-1785ac16-8109e01c-ad6a5487_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a20892a6-48d1a774-26258e65-b7d7671c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:04.181878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Write session: try to update token
2025-10-02T09:29:04.181895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:04.194093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:04.194115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.194123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.194162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:04.194173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:04.194320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:04.194450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:04.194680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:04.194692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|a20892a6-48d1a774-26258e65-b7d7671c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:04.194806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:04.194989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:04.195027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:04.197080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:04.197188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.197200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.198192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:04.198216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:04.198218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.198219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:04.198220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:04.198228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.198230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.198232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554054168966256:3877]
2025-10-02T09:29:04.198251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:04.198255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:04.198256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.198257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:04.198260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:04.198264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:04.198285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:04.198369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:04.255538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554054244486320:4289]
2025-10-02T09:29:04.255818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7556554054244486320:4289]
2025-10-02T09:29:04.340413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:04.348172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.348202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.348368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.348436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.348500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.348564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.348608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.348621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.348686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.348747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.348822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.348886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.348929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.348936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.348997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.349052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.349113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.349177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.349218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.349226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.349292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.349355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.349448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.349509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.349638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.349646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.349726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.349788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.349849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.349911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.349973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.349981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.350046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.350102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.350165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.350225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.350270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.350276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.350337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.350395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.350456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.350518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.350576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.350582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.350642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.350698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.350759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.350822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.350879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.350885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.350946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.351004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.351061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.351117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.351246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.351252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.351310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:04.351366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:04.351421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:04.351478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:04.351595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:04.351601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:04.351655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486320:4289], now have 1 active actors on pipe
2025-10-02T09:29:04.352209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:04.352219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Write session will restart in 0.007681s
2025-10-02T09:29:04.352239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Write session: Do CDS request
2025-10-02T09:29:04.352245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:04.351870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:04.351874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:04.351886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:04.351911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|a20892a6-48d1a774-26258e65-b7d7671c_0
2025-10-02T09:29:04.351916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554054244486320:4289]
2025-10-02T09:29:04.352078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|a20892a6-48d1a774-26258e65-b7d7671c_0 is DEAD
2025-10-02T09:29:04.352563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:04.361708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.361796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:04.361813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-10-02T09:29:04.361979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.362021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:04.362033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:04.362038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:04.362457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-10-02T09:29:04.362491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:04.362498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:04.362500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:04.362505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554054244486415:4319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:04.362513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:04.363012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554054244486415:4319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:04.364650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:04.364829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:04.364838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:04.364848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:04.364899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:04.364934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554054168966395:3879]
2025-10-02T09:29:04.365433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554054244486415:4319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:04.365463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:04.365741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:04.365776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:04.366048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:04.366102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.366107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.366108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.366109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.366110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.366111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.366112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.366113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.366113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.366114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.366115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.366116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.366121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.366130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.366133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.366137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.366140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.366143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.366146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.366149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.366152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.366155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.366158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.366161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.366166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.366172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.366177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.366182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.366185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.366188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.366192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.366196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.366200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.366204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.366208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.366212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.366216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.366220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.366223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.366227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.366230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.366234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.366240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.366243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.366247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.366255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.366259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.366263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.366296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:04.371140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554054244486415:4319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:04.371161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554054244486415:4319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:04.371164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554054244486415:4319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:04.371172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:04.375328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:04.377047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:04.377063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:04.377066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:04.377070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:04.377076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [2:7556554054168966395:3879]
2025-10-02T09:29:04.377088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:04.377104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:04.377108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.377111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.377113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.377126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:04.377131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:04.377137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:04.377189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.377196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.377198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.377201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:04.377204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:04.377268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:04.377276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.377288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.377304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.377320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:04.377343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486467:4319], now have 1 active actors on pipe
2025-10-02T09:29:04.377351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486322:2446], now have 1 active actors on pipe
2025-10-02T09:29:04.377358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.377360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.377362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.377372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:04.377385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:04.377389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:04.377395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:04.377397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:04.377402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:04.377406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:04.377395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 306
2025-10-02T09:29:04.377436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.377416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 306
2025-10-02T09:29:04.377444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:04.377446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:04.377459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.377468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.377513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16865346-35953a53-281afcfd-826a6fc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:04.377528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.377533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.377535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:04.377542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.377550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:04.377571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.377745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.377754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.377765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.377879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 36 sessionId: src_id|16865346-35953a53-281afcfd-826a6fc5_0
2025-10-02T09:29:04.378225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20892a6-48d1a774-26258e65-b7d7671c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16865346-35953a53-281afcfd-826a6fc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:04.380719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Write session: try to update token
2025-10-02T09:29:04.380732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:04.388958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:04.388979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.388981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:04.388983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:04.388990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.388994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.388998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554054168966389:3879]
2025-10-02T09:29:04.389036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:04.389041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.389044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:04.389050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:04.389056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:04.389060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:04.389184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:04.394144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|16865346-35953a53-281afcfd-826a6fc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:04.396738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:04.452161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554054244486475:4289]
2025-10-02T09:29:04.452492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7556554054244486475:4289]
2025-10-02T09:29:04.535669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:04.536098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.536107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.536143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486475:4289], now have 1 active actors on pipe
2025-10-02T09:29:04.537058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:04.537069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Write session will restart in 0.008315s
2025-10-02T09:29:04.537097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Write session: Do CDS request
2025-10-02T09:29:04.537104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:04.536635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554054244486475:4289]
2025-10-02T09:29:04.536665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:04.536668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:04.536715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: error at write: Disconnected sessionId: src_id|16865346-35953a53-281afcfd-826a6fc5_0
2025-10-02T09:29:04.536897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|16865346-35953a53-281afcfd-826a6fc5_0 is DEAD
2025-10-02T09:29:04.537108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:04.536383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:04.546271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.546396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:04.546415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-10-02T09:29:04.546729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.546766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:04.546771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:04.546774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:04.547569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-10-02T09:29:04.547605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:04.547611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:04.547615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:04.547620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554054244486534:4324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:04.550754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:04.548118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554054244486534:4324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:04.551081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554054244486534:4324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:04.552945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:04.553114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:04.553127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:04.553137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:04.553191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:04.553243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554054168966543:3882]
2025-10-02T09:29:04.553791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:04.554380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:04.554439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:04.554752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:04.554822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.554829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.554830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.554831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.554832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.554834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.554835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.554835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.554836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.554837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.554838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.554840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.554846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.554857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.554861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.554865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.554868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.554871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.554874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.554878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.554881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.554885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.554888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.554892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.554899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.554907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.554913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.554918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.554923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.554927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.554933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.554946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.554950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.554955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.554959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.554962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.554967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.554972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.554976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.554980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.554985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.554990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.554994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.554998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.555003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.555007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.555011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.555015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.555048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:04.553760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554054244486534:4324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:04.553773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554054244486534:4324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:04.553778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554054244486534:4324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:04.553794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:04.564277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:04.566311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:04.566318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:04.566321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:04.566324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:04.566331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [2:7556554054168966543:3882]
2025-10-02T09:29:04.566345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:04.566362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:04.566366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.566368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.566370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.566384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:04.566389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:04.566396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:04.566454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.566456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.566458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.566462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:04.566465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:04.566532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:04.566535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.566547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.566556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.566570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:04.566588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.566590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.566592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.566600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:04.566610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:04.566614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:04.566614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486477:2446], now have 1 active actors on pipe
2025-10-02T09:29:04.566616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:04.566619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486605:4324], now have 1 active actors on pipe
2025-10-02T09:29:04.566626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:04.566640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:04.566643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:04.566675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.566687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:04.566769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:04.566962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.566986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.567011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:04.567023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.567032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.567034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:04.567045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.567061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:04.567078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.567342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.567358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.567378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.567919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16865346-35953a53-281afcfd-826a6fc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:04.566750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 307
2025-10-02T09:29:04.566813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 307
2025-10-02T09:29:04.567518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0
2025-10-02T09:29:04.570877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Write session: try to update token
2025-10-02T09:29:04.570898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:04.579265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:04.579291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.579294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:04.579297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:04.579307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.579312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.579317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554054168966538:3882]
2025-10-02T09:29:04.579359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:04.579363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:04.579371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:04.579375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:04.579375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.579378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:04.579565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:04.587734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:04.590285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:04.636997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554054244486618:4289]
2025-10-02T09:29:04.637331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7556554054244486618:4289]
2025-10-02T09:29:04.719737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:04.720036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.720048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.720062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486618:4289], now have 1 active actors on pipe
2025-10-02T09:29:04.720221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:04.720250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554054244486618:4289]
2025-10-02T09:29:04.720273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:04.720294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:04.720350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0
2025-10-02T09:29:04.720516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0 is DEAD
2025-10-02T09:29:04.720652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:04.720662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Write session will restart in 0.007591s
2025-10-02T09:29:04.720685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Write session: Do CDS request
2025-10-02T09:29:04.720690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:04.729265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.729337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:04.729355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-10-02T09:29:04.729445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.729471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:04.729474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:04.729476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:04.729791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-10-02T09:29:04.729814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:04.729818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:04.729820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:04.729825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554054244486722:4329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:04.729900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:04.730213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554054244486722:4329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:04.731441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:04.731598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:04.731608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:04.731616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:04.731657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:04.731693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554054168966677:3884]
2025-10-02T09:29:04.731795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554054244486722:4329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:04.732225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:04.732469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:04.732507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:04.732719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:04.732752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.732756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.732757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.732757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.732758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.732759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.732759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.732760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.732760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.732761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.732762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.732762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.732765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.732772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.732774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.732776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.732778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.732780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.732782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.732784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.732786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.732788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.732790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.732792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.732796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.732814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.732818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.732821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.732823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.732826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.732828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.732831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.732833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.732836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.732838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.732841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.732844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.732846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.732849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.732852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.732855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.732859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.732861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.732864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.732866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.732869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.732871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.732874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.732891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:04.737149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554054244486722:4329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:04.737163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554054244486722:4329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:04.737166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554054244486722:4329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:04.737173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:04.741011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:04.742751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:04.742768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:04.742770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:04.742774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:04.742779Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [2:7556554054168966677:3884]
2025-10-02T09:29:04.742790Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:04.742804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:04.742813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.742816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.742818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.742831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:04.742836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:04.742843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:04.742902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.742910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.742913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.742916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:04.742918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:04.742976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:04.742983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.742995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.743010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.743030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:04.743052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486762:4329], now have 1 active actors on pipe
2025-10-02T09:29:04.743060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486623:2446], now have 1 active actors on pipe
2025-10-02T09:29:04.743066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.743068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.743070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.743081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:04.743100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:04.743105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:04.743109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:04.743110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:04.743116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:04.743132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:04.743103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 308
2025-10-02T09:29:04.743112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 308
2025-10-02T09:29:04.743161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.743170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:04.743171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:04.743184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.743192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.743235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:04.743245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.743253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.743256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:04.743263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.743274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:04.743294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.743427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.743435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.743448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.743512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0
2025-10-02T09:29:04.743854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ef5a1ca-6d368d84-7343647c-39d84d4a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:04.746355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Write session: try to update token
2025-10-02T09:29:04.746372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:04.754168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:04.754190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.754194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:04.754196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:04.754205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.754208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.754212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554054168966672:3884]
2025-10-02T09:29:04.754254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:04.754255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:04.754260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:04.754264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:04.754266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.754268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:04.754458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:04.760726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:04.763131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:04.820269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554054244486773:4289]
2025-10-02T09:29:04.820593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7556554054244486773:4289]
2025-10-02T09:29:04.886397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:04.886651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.886666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.886682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486773:4289], now have 1 active actors on pipe
2025-10-02T09:29:04.886809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:04.886823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:04.886847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:04.886869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: error at write: Disconnected sessionId: src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0
2025-10-02T09:29:04.887054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0 is DEAD
2025-10-02T09:29:04.887212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:04.887226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Write session will restart in 0.006009s
2025-10-02T09:29:04.887245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Write session: Do CDS request
2025-10-02T09:29:04.887222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554054244486773:4289]
2025-10-02T09:29:04.887251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:04.887239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:04.894257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.894376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:04.894391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-10-02T09:29:04.894628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:04.894665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:04.894669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:04.894674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:04.895017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-10-02T09:29:04.895042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:04.895044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:04.895045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:04.895049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554054244486881:4339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:04.895529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554054244486881:4339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:04.895883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:04.897402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554054244486881:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:04.897460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:04.897646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:04.897655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:04.897665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:04.897716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:04.897752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554054168966829:3893]
2025-10-02T09:29:04.898273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:04.898560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:04.898611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:04.898859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:04.898900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.898905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.898906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.898906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.898907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.898908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.898908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.898909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.898909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.898910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.898910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.898911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.898914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.898920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.898922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.898924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.898926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.898929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.898931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.898933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.898935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.898937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.898939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.898941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.898945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.898949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:04.898953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.898955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:04.898958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.898960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:04.898963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.898966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:04.898970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.898973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:04.898975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.898978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:04.898980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.898983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:04.898986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.898988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:04.898991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.898994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:04.898996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.898999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.899002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.899005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.899007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.899010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.899027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:04.899692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554054244486881:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:04.899706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554054244486881:4339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:04.899709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554054244486881:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:04.899715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:04.907984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:04.909823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:04.909843Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:04.909845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:04.909849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:04.909854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [2:7556554054168966829:3893]
2025-10-02T09:29:04.909865Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:04.909880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:04.909883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.909885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.909887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.909901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:04.909912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:04.909922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:04.909984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.909990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.909992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.909995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:04.909997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:04.910057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:04.910066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.910079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:04.910088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:04.910103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:04.910125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486787:2446], now have 1 active actors on pipe
2025-10-02T09:29:04.910134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.910137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.910139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.910150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:04.910158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486921:4339], now have 1 active actors on pipe
2025-10-02T09:29:04.910166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:04.910169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:04.910169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:04.910171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:04.910181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:04.910186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:04.910215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.910223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:04.910224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:04.910206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 309
2025-10-02T09:29:04.910254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 309
2025-10-02T09:29:04.910337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.910347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.910382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:04.910392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:04.910395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:04.910397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:04.910405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:04.910418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:04.910436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.910571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:04.910578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:04.910590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:04.910670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 36 sessionId: src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0
2025-10-02T09:29:04.911002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2ce930b-c42afaae-b2c472db-2949dd97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:04.913720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Write session: try to update token
2025-10-02T09:29:04.913736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:04.921363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:04.921381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:04.921383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:04.921384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:04.921391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.921394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.921397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554054168966824:3893]
2025-10-02T09:29:04.921430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:04.921435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:04.921438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:04.921441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:04.921448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:04.921451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:04.921570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:04.926817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:04.929496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:04.987203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554054244486939:4289]
2025-10-02T09:29:04.987450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7556554054244486939:4289]
2025-10-02T09:29:05.055028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:05.056205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.056220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.056233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554054244486939:4289], now have 1 active actors on pipe
2025-10-02T09:29:05.056381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:05.056441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:05.056460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:05.056463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:05.056489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554054244486939:4289]
2025-10-02T09:29:05.056517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0
2025-10-02T09:29:05.056687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0 is DEAD
2025-10-02T09:29:05.056832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:05.056840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Write session will restart in 0.008757s
2025-10-02T09:29:05.056857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Write session: Do CDS request
2025-10-02T09:29:05.056861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:05.066239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.066284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:05.066300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-10-02T09:29:05.066312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:05.066431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.066454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:05.066457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:05.066460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:05.066776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-10-02T09:29:05.066810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:05.066818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:05.066819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:05.066823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554058539454335:4344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:05.067230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554058539454335:4344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:05.067924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:05.068111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:05.068121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:05.068129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:05.068182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:05.068221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554058463934284:3901]
2025-10-02T09:29:05.068679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:05.068826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554058539454335:4344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:05.068943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:05.068976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:05.069186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:05.069219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.069223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.069224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.069224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.069225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.069225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.069226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.069227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.069227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.069228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.069229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.069229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.069232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.069238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.069241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.069243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.069245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.069247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.069249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.069251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.069253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.069256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.069258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.069260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.069264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.069268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.069271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.069274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.069277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.069280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.069282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.069285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.069288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.069291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.069293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.069296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.069298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.069301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.069303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.069306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.069308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.069311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.069313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.069317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.069320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.069325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.069329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.069333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.069365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:05.074842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554058539454335:4344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:05.074861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554058539454335:4344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:05.074865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554058539454335:4344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:05.074872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:05.077574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:05.079571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:05.079588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:05.079590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:05.079594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:05.079600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [2:7556554058463934284:3901]
2025-10-02T09:29:05.079613Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:05.079628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:05.079631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.079634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.079636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.079649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:05.079654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:05.079659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:05.079714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.079720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.079722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.079725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:05.079727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:05.079781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:05.079789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.079801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.079815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.079832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:05.079855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454374:4344], now have 1 active actors on pipe
2025-10-02T09:29:05.079863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454236:2446], now have 1 active actors on pipe
2025-10-02T09:29:05.079868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.079870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.079872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.079881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:05.079891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:05.079893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:05.079895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:05.079897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:05.079909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:05.079916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:05.079929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 310
2025-10-02T09:29:05.079950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.079939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 310
2025-10-02T09:29:05.079958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:05.079963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:05.079989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.079997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.080022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:05.080034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.080037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.080039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:05.080047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.080059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:05.080077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.080237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.080247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.080259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.080344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0
2025-10-02T09:29:05.080690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f926a5-7e71fd17-b5569827-8210e8a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:05.083199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Write session: try to update token
2025-10-02T09:29:05.083214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:05.090916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:05.090936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:05.090939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:05.090940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:05.090948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.090952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.090956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554058463934279:3901]
2025-10-02T09:29:05.090991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:05.090997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.091000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:05.091003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:05.091009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:05.091013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:05.091158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:05.095968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:05.098445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:05.156666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554058539454384:4289]
2025-10-02T09:29:05.156982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7556554058539454384:4289]
2025-10-02T09:29:05.240078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:05.240437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.240452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.240490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454384:4289], now have 1 active actors on pipe
2025-10-02T09:29:05.240689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:05.240698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:05.240708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:05.240743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554058539454384:4289]
2025-10-02T09:29:05.240769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0
2025-10-02T09:29:05.240906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:05.240962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0 is DEAD
2025-10-02T09:29:05.241123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:05.241146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Write session will restart in 0.007038s
2025-10-02T09:29:05.241169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Write session: Do CDS request
2025-10-02T09:29:05.241175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:05.249286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.249339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:05.249359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-10-02T09:29:05.249549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.249589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:05.249597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:05.249601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:05.250040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-10-02T09:29:05.250075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:05.250077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:05.250078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:05.250083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554058539454420:4349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:05.250668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554058539454420:4349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:05.254633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:05.254614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554058539454420:4349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:05.258113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:05.258334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:05.258344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:05.258355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:05.258407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:05.258407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554058539454420:4349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:05.258423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554058539454420:4349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:05.258427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554058539454420:4349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:05.258433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:05.258449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554058463934432:3904]
2025-10-02T09:29:05.259111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:05.259520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:05.259578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:05.259929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:05.260007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.260014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.260015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.260017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.260018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.260019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.260020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.260021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.260023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.260024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.260025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.260026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.260031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.260042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.260046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.260051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.260055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.260060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.260064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.260068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.260073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.260078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.260082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.260086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.260093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.260102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.260108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.260114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.260119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.260125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.260130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.260138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.260147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.260153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.260162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.260168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.260177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.260184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.260192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.260198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.260203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.260218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.260223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.260228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.260233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.260237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.260242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.260246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.260279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:05.271693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:05.273573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:05.273593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:05.273596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:05.273599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:05.273605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [2:7556554058463934432:3904]
2025-10-02T09:29:05.273619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:05.273635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:05.273637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.273640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.273641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.273657Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:05.273661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:05.273667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:05.273728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.273736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.273738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.273741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:05.273743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:05.273819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:05.273830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.273845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.273858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.273876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:05.273894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454523:4349], now have 1 active actors on pipe
2025-10-02T09:29:05.273903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454388:2446], now have 1 active actors on pipe
2025-10-02T09:29:05.273910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.273917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.273920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.273935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:05.273951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:05.273955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:05.273959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:05.273961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:05.273971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:05.273974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:05.273962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 311
2025-10-02T09:29:05.273983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 311
2025-10-02T09:29:05.274008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.274021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:05.274028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:05.274035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.274039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.274087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:05.274097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.274101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.274103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:05.274112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.274125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:05.274151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.274350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.274358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.274372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.274440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0
2025-10-02T09:29:05.274802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f43cd44-b0710c33-d730a332-e6aaea5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:05.277384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Write session: try to update token
2025-10-02T09:29:05.277401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:05.292459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:05.294104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:05.294132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:05.294134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:05.294136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:05.294144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.294148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.294152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554058463934427:3904]
2025-10-02T09:29:05.294190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:05.294202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.294205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:05.294205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:05.294211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:05.294216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:05.294369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:05.294986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:05.341138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554058539454537:4289]
2025-10-02T09:29:05.341676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7556554058539454537:4289]
2025-10-02T09:29:05.350685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:29:05.350712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-02T09:29:05.440302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:05.440533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.440543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.440571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454537:4289], now have 1 active actors on pipe
2025-10-02T09:29:05.440768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:05.440878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:05.440886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554058539454537:4289]
2025-10-02T09:29:05.440901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:05.440904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:05.440915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-02T09:29:05.440963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0
2025-10-02T09:29:05.441148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0 is DEAD
2025-10-02T09:29:05.441293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:05.441306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Write session will restart in 0.009893s
2025-10-02T09:29:05.441327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Write session: Do CDS request
2025-10-02T09:29:05.441332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:05.450723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:05.452320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.452412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:05.452431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-10-02T09:29:05.452561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.452658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:05.452592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:05.452601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:05.452604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:05.452858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:05.452866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:05.452875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:05.452924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:05.452936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-10-02T09:29:05.452961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:05.452965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:05.452966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:05.452970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554058539454652:4354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:05.452961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554058463934584:3908]
2025-10-02T09:29:05.453366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554058539454652:4354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:05.453377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:05.453686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:05.453759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:05.454092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:05.454176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.454184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.454185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.454186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.454188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.454189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.454190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.454191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.454193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.454194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.454195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.454202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.454213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.454217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.454221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.454225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.454229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.454233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.454237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.454240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.454244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.454247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.454251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.454257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.454265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.454270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.454275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.454281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.454288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.454293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.454299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.454306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.454311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.454315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.454326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.454331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.454336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.454342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.454346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.454350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.454355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.454358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.454366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.454378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.454383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.454390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.454395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.454433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:05.455625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554058539454652:4354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:05.462350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554058539454652:4354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:05.462376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554058539454652:4354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:05.462380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554058539454652:4354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:05.462388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:05.465089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:05.467083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:05.467103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:05.467105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:05.467110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:05.467129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [2:7556554058463934584:3908]
2025-10-02T09:29:05.467145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:05.467160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:05.467163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.467166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.467168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.467184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:05.467195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:05.467201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:05.467257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.467265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.467267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.467270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:05.467273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:05.467341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:05.467351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.467365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.467376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.467390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:05.467407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.467412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.467415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.467423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:05.467435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:05.467440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454689:4354], now have 1 active actors on pipe
2025-10-02T09:29:05.467446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454551:2446], now have 1 active actors on pipe
2025-10-02T09:29:05.467446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:05.467448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:05.467451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:05.467465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:05.467468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:05.467500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.467508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:05.467488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 312
2025-10-02T09:29:05.467503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 312
2025-10-02T09:29:05.467528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:05.467544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.467548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.467590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:05.467602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.467610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.467612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:05.467622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.467635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:05.467685Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:29:05.467716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.467842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.467853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.467866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.467911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:29:05.467954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:29:05.468010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 36 sessionId: src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0
2025-10-02T09:29:05.468326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c9fa6de-7ebb44de-38f8d578-5aae7069_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:05.470903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Write session: try to update token
2025-10-02T09:29:05.470917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:05.481132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:05.481156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:05.481158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:05.481160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:05.481168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.481171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.481175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554058463934578:3908]
2025-10-02T09:29:05.481210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:05.481214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:05.481217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.481220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:05.481221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:05.481224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:05.481346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:05.483761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:05.486290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:05.540655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554058539454701:4289]
2025-10-02T09:29:05.540926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7556554058539454701:4289]
2025-10-02T09:29:05.618632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:05.618891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.618902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.618931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454701:4289], now have 1 active actors on pipe
2025-10-02T09:29:05.619144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:05.619154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:05.619160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:05.619195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554058539454701:4289]
2025-10-02T09:29:05.619208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0
2025-10-02T09:29:05.619342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0 is DEAD
2025-10-02T09:29:05.619369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:05.619506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:05.619516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Write session will restart in 0.006215s
2025-10-02T09:29:05.619535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Write session: Do CDS request
2025-10-02T09:29:05.619541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:05.627269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.627385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:05.627401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-10-02T09:29:05.627493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.627518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:05.627526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:05.627530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:05.627900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-10-02T09:29:05.627933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:05.627935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:05.627937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:05.627942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554058539454804:4358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:05.628418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554058539454804:4358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:05.628790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:05.630489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554058539454804:4358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:05.630494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:05.630649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:05.630657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:05.630666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:05.630710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:05.630743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554058463934724:3911]
2025-10-02T09:29:05.631294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:05.631561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:05.631591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:05.631788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:05.631828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.631834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.631835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.631836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.631837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.631838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.631839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.631841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.631841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.631842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.631843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.631845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.631849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.631857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.631860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.631862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.631864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.631866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.631868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.631870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.631873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.631875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.631877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.631879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.631883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.631887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.631891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.631894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.631896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.631899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.631902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.631905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.631909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.631914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.631918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.631923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.631927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.631932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.631936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.631941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.631945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.631948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.631950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.631953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.631955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.631958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.631960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.631963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.631981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:05.637146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554058539454804:4358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:05.637164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554058539454804:4358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:05.637167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554058539454804:4358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:05.637175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:05.642852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:05.644772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:05.644790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:05.644793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:05.644797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:05.644819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [2:7556554058463934724:3911]
2025-10-02T09:29:05.644833Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:05.644850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:05.644859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.644862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.644864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.644879Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:05.644888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:05.644897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:05.644961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.644968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.644971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.644974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:05.644976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:05.645045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:05.645052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.645066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.645082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.645107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:05.645125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454845:4358], now have 1 active actors on pipe
2025-10-02T09:29:05.645133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454705:2446], now have 1 active actors on pipe
2025-10-02T09:29:05.645139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.645142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.645144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.645157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:05.645170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:05.645174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:05.645180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:05.645182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:05.645188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:05.645192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:05.645185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 313
2025-10-02T09:29:05.645195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 313
2025-10-02T09:29:05.645222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.645232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:05.645234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:05.645259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.645263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.645296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:05.645309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.645312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.645314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:05.645323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.645331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:05.645346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.645605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.645613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.645628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.645726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0
2025-10-02T09:29:05.646060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ae82b8-2cdc9264-26d4f729-3f5108bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:05.648616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Write session: try to update token
2025-10-02T09:29:05.648632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:05.661427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:05.661447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:05.661449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:05.661452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:05.661461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.661465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.661469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554058463934719:3911]
2025-10-02T09:29:05.661503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:05.661510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.661511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:05.661516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:05.661517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:05.661521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:05.661643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:05.662633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:05.665181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:05.719610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554058539454857:4289]
2025-10-02T09:29:05.719967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7556554058539454857:4289]
2025-10-02T09:29:05.815796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:05.816160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.816173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.816207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454857:4289], now have 1 active actors on pipe
2025-10-02T09:29:05.816413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:05.816498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554058539454857:4289]
2025-10-02T09:29:05.816499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:05.816503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:05.816529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:05.816581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0
2025-10-02T09:29:05.816746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0 is DEAD
2025-10-02T09:29:05.816917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:05.816928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Write session will restart in 0.005149s
2025-10-02T09:29:05.816952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Write session: Do CDS request
2025-10-02T09:29:05.816958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:05.823364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.823522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:05.823539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-10-02T09:29:05.823658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:05.823690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:05.823700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:05.823704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:05.824157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-10-02T09:29:05.824194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:05.824195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:05.824196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:05.824199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554058539454878:4363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:05.824728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554058539454878:4363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:05.827472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554058539454878:4363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:05.830150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:05.830226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554058539454878:4363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:05.830241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554058539454878:4363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:05.830245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554058539454878:4363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:05.830251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:05.832060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:05.832325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:05.832335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:05.832346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:05.832402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:05.832439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554058463934870:3914]
2025-10-02T09:29:05.833128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:05.833486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:05.833550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:05.833864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:05.833936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.833943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.833944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.833945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.833946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.833948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.833949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.833950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.833951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.833952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.833953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.833954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.833958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.833969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.833973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.833976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.833980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.833983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.833987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.833990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.833994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.833998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.834002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.834005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.834012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.834018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:05.834024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.834029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:05.834032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.834037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:05.834041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.834048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:05.834052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.834056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:05.834064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.834068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:05.834072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.834077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:05.834081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.834085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:05.834096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.834100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:05.834108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.834113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.834117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.834122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.834131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.834136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.834174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:05.845393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:05.847416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:05.847437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:05.847439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:05.847443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:05.847449Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [2:7556554058463934870:3914]
2025-10-02T09:29:05.847468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:05.847486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:05.847489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.847492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.847494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.847509Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:05.847520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:05.847527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:05.847592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.847602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.847604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.847607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:05.847610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:05.847680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:05.847688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.847703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:05.847720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:05.847737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:05.847763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539455001:4363], now have 1 active actors on pipe
2025-10-02T09:29:05.847773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539454864:2446], now have 1 active actors on pipe
2025-10-02T09:29:05.847779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.847803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.847805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.847819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:05.847837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:05.847852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:05.847861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:05.847863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:05.847868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:05.847870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:05.847897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.847909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:05.847925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.847933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.847985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:05.847988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:05.847996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:05.848000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:05.848002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:05.848009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:05.848019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:05.848043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.848218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:05.848225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:05.848236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:05.848690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a96bc35-b5e379ec-ffa5bc1b-d1d32767_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:05.847830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 314
2025-10-02T09:29:05.847835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 314
2025-10-02T09:29:05.848332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 36 sessionId: src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0
2025-10-02T09:29:05.851295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Write session: try to update token
2025-10-02T09:29:05.851311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:05.866821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:05.864132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:05.864156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:05.864159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:05.864161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:05.864170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.864175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.864180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554058463934864:3914]
2025-10-02T09:29:05.864223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:05.864231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:05.864233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:05.864233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:05.864241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:05.864245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:05.864386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:05.869631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:05.915512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554058539455013:4289]
2025-10-02T09:29:05.917432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7556554058539455013:4289]
2025-10-02T09:29:06.014843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:06.015244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.015260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.015300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554058539455013:4289], now have 1 active actors on pipe
2025-10-02T09:29:06.015510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:06.015817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554058539455013:4289]
2025-10-02T09:29:06.015853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:06.016030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:06.016104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0
2025-10-02T09:29:06.016283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0 is DEAD
2025-10-02T09:29:06.016455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:06.016466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Write session will restart in 0.009751s
2025-10-02T09:29:06.016488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Write session: Do CDS request
2025-10-02T09:29:06.016493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:06.032042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:06.033302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.033404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:06.033422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-10-02T09:29:06.033539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.033579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:06.033588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:06.033591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:06.034040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-10-02T09:29:06.034080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:06.034086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:06.034088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:06.034095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554062834422440:4374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:06.034077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:06.034267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:06.034280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:06.034290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:06.034346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:06.034390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554062758902343:3928]
2025-10-02T09:29:06.034674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554062834422440:4374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:06.034984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:06.035288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:06.035330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:06.035566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:06.035608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.035613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.035614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.035615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.035615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.035616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.035617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.035618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.035618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.035619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.035620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.035620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.035624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.035631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.035633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.035636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.035638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.035641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.035643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.035645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.035647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.035650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.035652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.035654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.035658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.035663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.035668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.035674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.035678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.035684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.035688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.035693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.035695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.035699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.035701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.035704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.035707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.035710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.035713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.035716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.035720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.035723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.035726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.035730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.035732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.035735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.035738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.035740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.035762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:06.036521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554062834422440:4374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:06.043326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554062834422440:4374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:06.043346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554062834422440:4374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:06.043349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554062834422440:4374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:06.043356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:06.047355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:06.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:06.049543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:06.049546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:06.049550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:06.049557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [2:7556554062758902343:3928]
2025-10-02T09:29:06.049575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:06.049594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:06.049602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.049605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.049608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.049623Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:06.049635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:06.049641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:06.049705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.049712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.049714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.049717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:06.049720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:06.049793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:06.049800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.049815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.049830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.049851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:06.049875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422336:2446], now have 1 active actors on pipe
2025-10-02T09:29:06.049883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422475:4374], now have 1 active actors on pipe
2025-10-02T09:29:06.049891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.049893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.049896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.049908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:06.049924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:06.049924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:06.049928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:06.049930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:06.049940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:06.049943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:06.049946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 315
2025-10-02T09:29:06.049978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.049949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 315
2025-10-02T09:29:06.049985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:06.049986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:06.050008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.050017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.050049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:06.050060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.050063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.050065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:06.050073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.050085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:06.050109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.050348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.050364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.050388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.050495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 36 sessionId: src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0
2025-10-02T09:29:06.050860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d42eb52-349b28ad-dae812cc-fe9c987f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:06.053539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Write session: try to update token
2025-10-02T09:29:06.053557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:06.062212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:06.062232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.062235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:06.062237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:06.062245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.062249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.062256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554062758902338:3928]
2025-10-02T09:29:06.062294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:06.062300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.062303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:06.062310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:06.062317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:06.062322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:06.062453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:06.068823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:06.071176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:06.116127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554062834422484:4289]
2025-10-02T09:29:06.116403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7556554062834422484:4289]
2025-10-02T09:29:06.200077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:06.200426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.200442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.200459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422484:4289], now have 1 active actors on pipe
2025-10-02T09:29:06.200672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:06.200711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554062834422484:4289]
2025-10-02T09:29:06.200719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:06.200749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:06.200820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0
2025-10-02T09:29:06.200950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0 is DEAD
2025-10-02T09:29:06.201061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:06.201072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Write session will restart in 0.005119s
2025-10-02T09:29:06.201095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Write session: Do CDS request
2025-10-02T09:29:06.201102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:06.207242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.207405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:06.207422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-10-02T09:29:06.207548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.207585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:06.207595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:06.207599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:06.207977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-10-02T09:29:06.208007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:06.208015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:06.208019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:06.208024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554062834422526:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:06.208460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554062834422526:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:06.210597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554062834422526:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:06.210997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:06.212652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:06.212838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:06.212848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:06.212858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:06.212894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554062834422526:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:06.212907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554062834422526:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:06.212912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554062834422526:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:06.212918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:06.212908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:06.212948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554062758902488:3931]
2025-10-02T09:29:06.213498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:06.213816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:06.213861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:06.214163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:06.214213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.214219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.214220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.214221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.214222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.214223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.214224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.214225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.214227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.214228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.214229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.214230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.214234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.214246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.214250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.214254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.214258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.214262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.214266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.214270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.214273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.214278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.214282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.214286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.214292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.214304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.214311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.214317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.214322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.214327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.214331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.214336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.214341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.214346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.214350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.214355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.214359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.214364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.214368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.214373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.214378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.214383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.214387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.214392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.214396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.214401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.214405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.214412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.214448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:06.224211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:06.226038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:06.226054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:06.226056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:06.226060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:06.226066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [2:7556554062758902488:3931]
2025-10-02T09:29:06.226079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:06.226093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:06.226101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.226104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.226106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.226120Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:06.226125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:06.226131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:06.226190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.226197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.226199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.226202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:06.226204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:06.226265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:06.226272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.226284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.226300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.226319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:06.226340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422487:2446], now have 1 active actors on pipe
2025-10-02T09:29:06.226350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.226352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.226354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.226363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:06.226375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422626:4379], now have 1 active actors on pipe
2025-10-02T09:29:06.226379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:06.226382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:06.226383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:06.226385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:06.226399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:06.226405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:06.226413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 316
2025-10-02T09:29:06.226426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 316
2025-10-02T09:29:06.226436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.226445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:06.226448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:06.226476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.226480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.226502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:06.226512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.226516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.226518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:06.226526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.226537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:06.226553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.226704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.226714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.226727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.226809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 36 sessionId: src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0
2025-10-02T09:29:06.227125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a35e3f-7426e9ce-ef4456bc-2aae225_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:06.229620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Write session: try to update token
2025-10-02T09:29:06.229634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:06.237459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:06.237477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.237486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.237521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:06.237535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:06.237770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:06.237901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:06.238031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:06.238152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:06.238402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:06.238432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:06.241536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:06.243799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:06.243991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.244008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.244035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:06.244136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:06.247166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:06.247181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.247183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:06.247186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:06.247195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.247199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.247208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554062758902482:3931]
2025-10-02T09:29:06.247241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:06.247246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:06.247249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.247252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:06.247260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:06.247263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:06.247375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:06.301212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554062834422637:4289]
2025-10-02T09:29:06.301454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7556554062834422637:4289]
2025-10-02T09:29:06.388141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:06.395982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.396008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.396174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.396243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.396304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.396366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.396742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.396752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.396846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.396906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.396968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.397034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.397081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.397091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.397160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.397239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.397316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.397412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.397464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.397472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.397537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.397609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.397682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.397750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.397818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.397828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.397907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.397972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.398031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.398099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.398152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.398159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.398223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.398283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.398349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.398412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.398523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.398529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.398591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.398655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.398729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.398798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.398860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.398868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.398935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.398995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.399057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.399133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.399203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.399211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.399276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.399344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.399410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.399477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.399599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.399609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.399676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:06.399744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:06.399810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:06.399875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:06.399917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:06.399924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:06.399998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422637:4289], now have 1 active actors on pipe
2025-10-02T09:29:06.400697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:06.400707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Write session will restart in 0.006439s
2025-10-02T09:29:06.400741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Write session: Do CDS request
2025-10-02T09:29:06.400747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:06.400297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:06.400314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:06.400342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: error at write: Disconnected sessionId: src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0
2025-10-02T09:29:06.400521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0 is DEAD
2025-10-02T09:29:06.400700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:06.400733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554062834422637:4289]
2025-10-02T09:29:06.401002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:06.409256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.409537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:06.409553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-10-02T09:29:06.409729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.409755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:06.409760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:06.409764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:06.410227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-10-02T09:29:06.410253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:06.410255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:06.410256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:06.410261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554062834422666:4384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:06.410785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554062834422666:4384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:06.414440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554062834422666:4384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:06.419882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554062834422666:4384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:06.419901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554062834422666:4384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:06.419904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554062834422666:4384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:06.419912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:06.420434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:06.424237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:06.424483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:06.424498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:06.424508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:06.424586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:06.424629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554062758902646:3934]
2025-10-02T09:29:06.425314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:06.430779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:06.430879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:06.431298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:06.431370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.431379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.431380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.431381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.431383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.431385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.431386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.431388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.431389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.431390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.431392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.431393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.431400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.431410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.431414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.431418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.431422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.431425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.431429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.431433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.431436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.431441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.431444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.431448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.431459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.431468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.431474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.431479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.431484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.431489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.431494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.431499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.431505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.431511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.431515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.431520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.431530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.431535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.431540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.431545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.431551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.431566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.431570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.431576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.431580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.431585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.431590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.431594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.431629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:06.446294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:06.448242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:06.448249Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:06.448251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:06.448256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:06.448263Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [2:7556554062758902646:3934]
2025-10-02T09:29:06.448276Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:06.448295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:06.448298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.448301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.448304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.448322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:06.448327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:06.448335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:06.448400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.448402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.448404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.448407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:06.448410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:06.448483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:06.448485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.448508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.448518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.448532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:06.448549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.448551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.448553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.448560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:06.448572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422790:4384], now have 1 active actors on pipe
2025-10-02T09:29:06.448573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:06.448575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422652:2446], now have 1 active actors on pipe
2025-10-02T09:29:06.448577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:06.448579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:06.448582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:06.448595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:06.448598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:06.448631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.448643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:06.448749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:06.448739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 317
2025-10-02T09:29:06.448777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 317
2025-10-02T09:29:06.449237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.449254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.449281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:06.449293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.449297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.449299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:06.449308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.449317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:06.449342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.449565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.449573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.449584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.449679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 36 sessionId: src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0
2025-10-02T09:29:06.450111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39a04ba-7f1410b0-1c9942cb-28637ed5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:06.453121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Write session: try to update token
2025-10-02T09:29:06.453141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:06.464789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:06.464824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.464827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:06.464829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:06.464838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.464845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.464849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554062758902641:3934]
2025-10-02T09:29:06.464885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:06.464892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.464894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:06.464941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:06.464954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:06.464958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:06.465023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:06.476885Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:29:06.481997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:06.484845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:06.500903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554062834422809:4289]
2025-10-02T09:29:06.501326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7556554062834422809:4289]
2025-10-02T09:29:06.617106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:06.617542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.617559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.617577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422809:4289], now have 1 active actors on pipe
2025-10-02T09:29:06.617800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:06.618027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:06.618115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0
2025-10-02T09:29:06.618276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0 is DEAD
2025-10-02T09:29:06.618412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:06.618443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554062834422809:4289]
2025-10-02T09:29:06.618676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 168 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:29:06.618700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:06.618707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Write session will restart in 0.005550s
2025-10-02T09:29:06.618727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Write session: Do CDS request
2025-10-02T09:29:06.618732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:06.625268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.628968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:06.628986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-10-02T09:29:06.632936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.632988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:06.632993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:06.633007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:06.633433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-10-02T09:29:06.633467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:06.633469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:06.633470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:06.633477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554062834422887:4394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:06.633970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554062834422887:4394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:06.638313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:06.638392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554062834422887:4394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:06.640491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:06.640698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:06.640710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:06.640720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:06.640774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:06.640837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554062758902791:3936]
2025-10-02T09:29:06.641472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:06.642412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:06.642480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:06.642826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:06.642902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.642908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.642909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.642910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.642911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.642912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.642913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.642914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.642916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.642917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.642918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.642919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.642925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.642936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.642941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.642945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.642948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.642952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.642955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.642958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.642962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.642966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.642970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.642974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.642981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.642990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.642996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.643002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.643007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.643017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.643021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.643026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.643035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.643041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.643051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.643057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.643066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.643075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.643080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.643084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.643088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.643094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.643102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.643108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.643128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.643133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.643142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.643148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.643193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:06.643013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554062834422887:4394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:06.643034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554062834422887:4394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:06.643038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554062834422887:4394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:06.643046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:06.655850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:06.657776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:06.657794Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:06.657795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:06.657798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:06.657803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [2:7556554062758902791:3936]
2025-10-02T09:29:06.657814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:06.657830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:06.657832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.657834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.657835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.657848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:06.657852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:06.657858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:06.657924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.657932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.657934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.657937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:06.657939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:06.657996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:06.658003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.658015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.658027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.658042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:06.658061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.658064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.658066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.658081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:06.658092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:06.658117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:06.658120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:06.658150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:06.658155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:06.658157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.658157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:06.658159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:06.658163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:06.658415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422815:2446], now have 1 active actors on pipe
2025-10-02T09:29:06.658422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422957:4394], now have 1 active actors on pipe
2025-10-02T09:29:06.658845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 318
2025-10-02T09:29:06.658882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 318
2025-10-02T09:29:06.659036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.659044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.659067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4d59523-752de1f0-8dac1487-2964ee42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:06.659074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.659078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.659080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:06.659090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.659100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:06.659114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.659340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.659343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.659356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.662165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4d59523-752de1f0-8dac1487-2964ee42_0
2025-10-02T09:29:06.662555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1058d2bf-a85350f0-cee1f4d5-1c079632_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4d59523-752de1f0-8dac1487-2964ee42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:06.665281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Write session: try to update token
2025-10-02T09:29:06.665301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:06.670879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:06.670901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.670903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:06.670906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:06.670914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.670918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.670923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554062758902786:3936]
2025-10-02T09:29:06.670960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:06.670967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.670969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:06.671108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:06.672994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:06.673009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:06.673013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:06.687373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|d4d59523-752de1f0-8dac1487-2964ee42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:06.690017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:06.718870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554062834422971:4289]
2025-10-02T09:29:06.719485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7556554062834422971:4289]
2025-10-02T09:29:06.819105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:06.819449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.819456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.819473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422971:4289], now have 1 active actors on pipe
2025-10-02T09:29:06.819782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:06.820378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:06.820387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Write session will restart in 0.009644s
2025-10-02T09:29:06.820408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Write session: Do CDS request
2025-10-02T09:29:06.820415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:06.819968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554062834422971:4289]
2025-10-02T09:29:06.819995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:06.820025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:06.820095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4d59523-752de1f0-8dac1487-2964ee42_0
2025-10-02T09:29:06.820265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|d4d59523-752de1f0-8dac1487-2964ee42_0 is DEAD
2025-10-02T09:29:06.831376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.831682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:06.831705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-10-02T09:29:06.831798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:06.831821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:06.831824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:06.831828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:06.832257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-10-02T09:29:06.832306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:06.832308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:06.832309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:06.832315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554062834423037:4399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:06.832842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554062834423037:4399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:06.836222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554062834423037:4399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:06.837488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:06.839370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:06.839561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:06.839992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554062834423037:4399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:06.840006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554062834423037:4399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:06.840009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554062834423037:4399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:06.839565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:06.839575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:06.840017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:06.839629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:06.839694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554062758902940:3939]
2025-10-02T09:29:06.840275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:06.840730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:06.840778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:06.841110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:06.841170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.841176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.841177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.841178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.841179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.841180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.841181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.841182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.841183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.841185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.841186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.841187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.841192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.841199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.841202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.841204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.841207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.841209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.841211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.841213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.841216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.841218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.841296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.841344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.841377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.841393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:06.841408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.841414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:06.841437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.841449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:06.841454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.841461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:06.841473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.841479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:06.841484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.841496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:06.841502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.841508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:06.841512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.841524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:06.841530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.841535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:06.841541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.841553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.841566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.841572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.841577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.841582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.841618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:06.853609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:06.856374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:06.856408Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:06.856414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:06.856419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:06.856430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [2:7556554062758902940:3939]
2025-10-02T09:29:06.856462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:06.856488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:06.856493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.856498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.856502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.856527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:06.856546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:06.856558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:06.856666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.856683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.856686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.856691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:06.856696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:06.857166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 319
2025-10-02T09:29:06.857200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 319
2025-10-02T09:29:06.857714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:06.857726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.857740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:06.857749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:06.857761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:06.857784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834423118:4399], now have 1 active actors on pipe
2025-10-02T09:29:06.857788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834422978:2446], now have 1 active actors on pipe
2025-10-02T09:29:06.857805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.857809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.857831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.857832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.857834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.857850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:06.857866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:06.857876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:06.857876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:06.857879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:06.857880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:06.857883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:06.857894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:06.857900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:06.857903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:06.857906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:06.857915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:06.857937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:06.857980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.857988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:06.857999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.857999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:06.858241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.858247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.858260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:06.858860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d59523-752de1f0-8dac1487-2964ee42_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:06.861666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Write session: try to update token
2025-10-02T09:29:06.861687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:06.858460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 36 sessionId: src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0
2025-10-02T09:29:06.876358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:06.876384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.876397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.876452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:06.876453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:06.876636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:06.876776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:06.876937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:06.877083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:06.877302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:06.877340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:06.878173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:06.880645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:06.880860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:06.880878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:06.880910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:06.880979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:06.887590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:06.887609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:06.887612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:06.887615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:06.887627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.887631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.887636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554062758902934:3939]
2025-10-02T09:29:06.887683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:06.887689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:06.887691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:06.887717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:06.887724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:06.887728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:06.887857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:06.920151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554062834423131:4289]
2025-10-02T09:29:06.920435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7556554062834423131:4289]
2025-10-02T09:29:07.037851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:07.045607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.045638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.045820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.045895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.045997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.046064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.046242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.046251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.046329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.046394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.046460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.046529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.046572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.046578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.046653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.046718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.046782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.046847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.046894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.046897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.046976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.047040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.047107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.047188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.047233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.047236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.047311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.047395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.047464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.047529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.047574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.047577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.047649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.047707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.047769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.047836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.047878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.047881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.047954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.048016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.048081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.048151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.048662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.048666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.048746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.048844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.048907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.048969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.049044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.049051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.049119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.050045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:07.050053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554062834423131:4289]
2025-10-02T09:29:07.050082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:07.050085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:07.050114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: error at write: Disconnected sessionId: src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0
2025-10-02T09:29:07.050457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:07.050468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Write session will restart in 0.005277s
2025-10-02T09:29:07.050491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Write session: Do CDS request
2025-10-02T09:29:07.050497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:07.050307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0 is DEAD
2025-10-02T09:29:07.049216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.049286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.049355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.049411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.049414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.049478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.049534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.049602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.049664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.049707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.049710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.049771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554062834423131:4289], now have 1 active actors on pipe
2025-10-02T09:29:07.050379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:07.057394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.057588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:07.057604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-10-02T09:29:07.057713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.057742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:07.057751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:07.057755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:07.058186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-10-02T09:29:07.058219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:07.058220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:07.058222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:07.058227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554067129390464:4410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:07.058723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554067129390464:4410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:07.061010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554067129390464:4410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:07.063774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554067129390464:4410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:07.063790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554067129390464:4410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:07.063794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554067129390464:4410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:07.063802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:07.067193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:07.069103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:07.069295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:07.069306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:07.069316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:07.069367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:07.069409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554067053870420:3953]
2025-10-02T09:29:07.069986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:07.070306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:07.070358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:07.070665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:07.070721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.070728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.070729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.070730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.070731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.070732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.070733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.070734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.070735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.070736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.070737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.070738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.070743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.070753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.070757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.070761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.070765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.070768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.070772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.070776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.070779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.070784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.070788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.070792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.070798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.070805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.070810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.070816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.070820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.070825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.070829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.070834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.070838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.070843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.070847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.070857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.070862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.070867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.070875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.070881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.070885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.070890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.070898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.070903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.070908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.070916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.070921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.070926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.070964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:07.080442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:07.082513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:07.082533Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:07.082536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:07.082540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:07.082546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [2:7556554067053870420:3953]
2025-10-02T09:29:07.082562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:07.082582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:07.082586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.082590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.082592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.082609Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:07.082621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:07.082628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:07.082691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.082702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.082705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.082709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:07.082712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:07.082780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:07.082782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.082791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.082797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.082807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:07.082829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.082831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.082832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.082844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:07.082857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:07.082866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:07.082871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:07.082871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:07.082873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:07.082874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:07.082913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.082921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:07.082969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:07.083044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390456:2446], now have 1 active actors on pipe
2025-10-02T09:29:07.083053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390548:4410], now have 1 active actors on pipe
2025-10-02T09:29:07.083139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 320
2025-10-02T09:29:07.083183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 320
2025-10-02T09:29:07.083244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.083259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.083284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b04e18c-83358c08-79f47474-4be3fa34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:07.083296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.083305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.083307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:07.083319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.083334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:07.083352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.083543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.083551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.083563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.083650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b04e18c-83358c08-79f47474-4be3fa34_0
2025-10-02T09:29:07.084016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4c6a7-8ac0761d-aba3759b-9f0d662e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b04e18c-83358c08-79f47474-4be3fa34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:07.086828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Write session: try to update token
2025-10-02T09:29:07.086845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:07.094936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:07.094954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:07.094956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:07.094959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:07.094967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.094971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.094975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554067053870414:3953]
2025-10-02T09:29:07.095018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:07.095024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.095024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:07.095026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:07.095030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:07.095034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:07.095184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:07.100536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|3b04e18c-83358c08-79f47474-4be3fa34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:07.103313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:07.147822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554067129390609:4289]
2025-10-02T09:29:07.148068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7556554067129390609:4289]
2025-10-02T09:29:07.237785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:07.238127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.238140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.238173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390609:4289], now have 1 active actors on pipe
2025-10-02T09:29:07.238344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:07.238358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:07.238363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554067129390609:4289]
2025-10-02T09:29:07.238388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:07.238391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:07.238445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: error at write: Disconnected sessionId: src_id|3b04e18c-83358c08-79f47474-4be3fa34_0
2025-10-02T09:29:07.238604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|3b04e18c-83358c08-79f47474-4be3fa34_0 is DEAD
2025-10-02T09:29:07.238761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:07.238775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Write session will restart in 0.005428s
2025-10-02T09:29:07.238805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Write session: Do CDS request
2025-10-02T09:29:07.238811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:07.245250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.245318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:07.245334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-10-02T09:29:07.245473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.245512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:07.245516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:07.245520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:07.245935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-10-02T09:29:07.245977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:07.245978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:07.245980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:07.245986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554067129390678:4415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:07.246491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554067129390678:4415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:07.248500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:07.248523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554067129390678:4415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:07.250096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:07.250275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:07.250285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:07.250296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:07.250345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:07.250383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554067053870567:3956]
2025-10-02T09:29:07.250829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554067129390678:4415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:07.250842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554067129390678:4415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:07.250845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554067129390678:4415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:07.250852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:07.250929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:07.251190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:07.251232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:07.251519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:07.251563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.251568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.251569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.251570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.251571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.251572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.251573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.251574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.251575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.251576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.251577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.251578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.251582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.251592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.251596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.251600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.251603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.251607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.251611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.251614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.251621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.251626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.251634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.251637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.251643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.251652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.251659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.251662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.251664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.251670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.251672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.251675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.251682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.251686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.251690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.251695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.251699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.251704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.251711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.251714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.251717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.251723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.251725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.251728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.251731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.251737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.251739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.251741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.251767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:07.259873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:07.261401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:07.261422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:07.261425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:07.261429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:07.261436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [2:7556554067053870567:3956]
2025-10-02T09:29:07.261449Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:07.261465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:07.261473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.261476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.261478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.261495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:07.261505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:07.261512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:07.261564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.261571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.261573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.261577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:07.261580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:07.261645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:07.261651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.261660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.261666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.261674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:07.261696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390612:2446], now have 1 active actors on pipe
2025-10-02T09:29:07.261704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390756:4415], now have 1 active actors on pipe
2025-10-02T09:29:07.261711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.261712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.261714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.261726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:07.261744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:07.261744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:07.261747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:07.261748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:07.261764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:07.261771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:07.261780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 321
2025-10-02T09:29:07.261795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 321
2025-10-02T09:29:07.261972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.261987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:07.262008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:07.262024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.262032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.262064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87110884-8c30027d-5004d305-d506b0bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:07.262073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.262076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.262078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:07.262086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.262099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:07.262114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.262247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.262258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.262274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.262372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 36 sessionId: src_id|87110884-8c30027d-5004d305-d506b0bc_0
2025-10-02T09:29:07.262703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b04e18c-83358c08-79f47474-4be3fa34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87110884-8c30027d-5004d305-d506b0bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:07.265102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Write session: try to update token
2025-10-02T09:29:07.265115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:07.272360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:07.272379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:07.272381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:07.272383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:07.272391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.272395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.272399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554067053870562:3956]
2025-10-02T09:29:07.272432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:07.272438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.272436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:07.272440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:07.272441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:07.272443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:07.272564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:07.276689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|87110884-8c30027d-5004d305-d506b0bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:07.279083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:07.338287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554067129390767:4289]
2025-10-02T09:29:07.338577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7556554067129390767:4289]
2025-10-02T09:29:07.416530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:07.416786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.416815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.416848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390767:4289], now have 1 active actors on pipe
2025-10-02T09:29:07.417026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:07.417024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:07.417059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554067129390767:4289]
2025-10-02T09:29:07.417085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:07.417092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:07.417146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: error at write: Disconnected sessionId: src_id|87110884-8c30027d-5004d305-d506b0bc_0
2025-10-02T09:29:07.417307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|87110884-8c30027d-5004d305-d506b0bc_0 is DEAD
2025-10-02T09:29:07.417452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:07.417464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Write session will restart in 0.006311s
2025-10-02T09:29:07.417488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Write session: Do CDS request
2025-10-02T09:29:07.417493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:07.425207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.425324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:07.425350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-10-02T09:29:07.425449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.425479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:07.425488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:07.425493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:07.425879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-10-02T09:29:07.425911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:07.425918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:07.425920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:07.425925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554067129390851:4420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:07.426432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554067129390851:4420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:07.429858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554067129390851:4420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:07.429888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:07.431899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:07.432070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:07.432079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:07.432086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:07.432133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:07.432174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554067053870728:3959]
2025-10-02T09:29:07.432634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554067129390851:4420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:07.432651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554067129390851:4420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:07.432654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554067129390851:4420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:07.432671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:07.432827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:07.433143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:07.433195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:07.433501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:07.433555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.433561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.433562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.433563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.433564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.433565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.433566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.433567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.433568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.433569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.433570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.433571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.433576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.433586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.433590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.433594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.433597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.433601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.433605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.433608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.433611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.433615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.433619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.433622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.433628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.433635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.433640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.433645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.433650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.433654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.433658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.433663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.433667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.433672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.433675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.433680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.433685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.433690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.433695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.433699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.433705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.433713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.433718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.433722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.433727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.433731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.433736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.433770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:07.442866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:07.444430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:07.444447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:07.444450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:07.444454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:07.444460Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [2:7556554067053870728:3959]
2025-10-02T09:29:07.444473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:07.444489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:07.444497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.444500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.444503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.444517Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:07.444524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:07.444530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:07.444590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.444596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.444598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.444601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:07.444604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:07.444666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:07.444673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.444686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.444699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.444725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:07.444743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390927:4420], now have 1 active actors on pipe
2025-10-02T09:29:07.444747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390782:2446], now have 1 active actors on pipe
2025-10-02T09:29:07.444753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.444756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.444757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.444769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:07.444783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:07.444783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:07.444786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:07.444789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:07.444796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:07.444799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:07.444844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.444851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:07.444884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:07.444856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 322
2025-10-02T09:29:07.444892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.444896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.444871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 322
2025-10-02T09:29:07.444915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ef75381-4f76e831-cea6228a-51434272_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:07.444929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.444933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.444935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:07.444944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.444952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:07.444968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.445107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.445116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.445129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.445203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ef75381-4f76e831-cea6228a-51434272_0
2025-10-02T09:29:07.445535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87110884-8c30027d-5004d305-d506b0bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ef75381-4f76e831-cea6228a-51434272_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:07.448136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Write session: try to update token
2025-10-02T09:29:07.448153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:07.455906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:07.455929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:07.455939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.455993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:07.456006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:07.456184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:07.456348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:07.456491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:07.456625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:07.456942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:07.456992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:07.462543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|1ef75381-4f76e831-cea6228a-51434272_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:07.465080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:07.465311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.465334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.465369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:07.465478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:07.468456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:07.468478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:07.468480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:07.468482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:07.468492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.468496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.468500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554067053870723:3959]
2025-10-02T09:29:07.468537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:07.468542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:07.468548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:07.468551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.468552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:07.468555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:07.468685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:07.516979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554067129390939:4289]
2025-10-02T09:29:07.517233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7556554067129390939:4289]
2025-10-02T09:29:07.547973Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 3 CurrentSessionLifetimeMs: 61073 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:29:07.603630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:07.610070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.610092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.610244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.610309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.610369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.610428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.610472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.610480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.610535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.610587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.610646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.610712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.610754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.610760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.610817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.610878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.610930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.611019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.611065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.611075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.611143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.611195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.611245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.611298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.611337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.611339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.611397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.611449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.611502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.611560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.611607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.611615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.611675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.611726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.611779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.611835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.611881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.611892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.611961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.612015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.612072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.612124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.612161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.612166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.612220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.612314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.612394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.612445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.612492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.612497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.612549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.612595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.612642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.612692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.612729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.612733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.612784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:07.612851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:07.612902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:07.612950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:07.612987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:07.612992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:07.613024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390939:4289], now have 1 active actors on pipe
2025-10-02T09:29:07.613234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:07.613234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554067129390939:4289]
2025-10-02T09:29:07.613248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:07.613255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:07.613273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: error at write: Disconnected sessionId: src_id|1ef75381-4f76e831-cea6228a-51434272_0
2025-10-02T09:29:07.613448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|1ef75381-4f76e831-cea6228a-51434272_0 is DEAD
2025-10-02T09:29:07.613561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:07.613579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Write session will restart in 0.005166s
2025-10-02T09:29:07.613597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Write session: Do CDS request
2025-10-02T09:29:07.613602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:07.613794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:07.620283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:07.620299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-10-02T09:29:07.620362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.620779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.620827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:07.620832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:07.620836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:07.621216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-10-02T09:29:07.621254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:07.621258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:07.621259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:07.621266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554067129391025:4424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:07.621734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554067129391025:4424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:07.622858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:07.624166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554067129391025:4424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:07.624659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:07.624795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:07.624815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:07.624823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:07.624860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:07.624893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554067053870876:3961]
2025-10-02T09:29:07.625454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:07.625729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:07.625779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:07.626082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:07.626140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.626145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.626147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.626148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.626149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.626149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.626150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.626151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.626162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.626163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.626164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.626165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.626169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.626179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.626182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.626185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.626188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.626191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.626194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.626196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.626200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.626203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.626206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.626209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.626214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.626222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.626232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.626240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.626247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.626252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.626258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.626262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.626266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.626274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.626277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.626281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.626285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.626291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.626295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.626299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.626302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.626306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.626319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.626323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.626326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.626330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.626333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.626338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.626365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:07.626600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554067129391025:4424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:07.626612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554067129391025:4424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:07.626615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554067129391025:4424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:07.626621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:07.634930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:07.636484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:07.636501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:07.636504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:07.636508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:07.636515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [2:7556554067053870876:3961]
2025-10-02T09:29:07.636527Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:07.636545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:07.636548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.636551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.636553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.636568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:07.636574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:07.636581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:07.636635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.636644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.636646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.636649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:07.636652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:07.636710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:07.636716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.636728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.636743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.636763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:07.636786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129390941:2446], now have 1 active actors on pipe
2025-10-02T09:29:07.636792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129391091:4424], now have 1 active actors on pipe
2025-10-02T09:29:07.636798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.636816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.636819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.636831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:07.636844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:07.636853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:07.636861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:07.636864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:07.636864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:07.636867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:07.636894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.636905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:07.636911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:07.636913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 323
2025-10-02T09:29:07.636935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 323
2025-10-02T09:29:07.637023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.637031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.637052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:07.637062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.637071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.637073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:07.637081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.637089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:07.637105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.637214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.637226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.637242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.637354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 36 sessionId: src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0
2025-10-02T09:29:07.637677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef75381-4f76e831-cea6228a-51434272_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:07.640262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Write session: try to update token
2025-10-02T09:29:07.640275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:07.650108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:07.650133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:07.650136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:07.650139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:07.650148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.650153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.650157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554067053870871:3961]
2025-10-02T09:29:07.650199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:07.650207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.650206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:07.650209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:07.650212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:07.650216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:07.650353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:07.656799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:07.659317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:07.713586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554067129391099:4289]
2025-10-02T09:29:07.713966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7556554067129391099:4289]
2025-10-02T09:29:07.796100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:07.796529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.796545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.796563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129391099:4289], now have 1 active actors on pipe
2025-10-02T09:29:07.796838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:07.796910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554067129391099:4289]
2025-10-02T09:29:07.796917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:07.796947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:07.797079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0
2025-10-02T09:29:07.797231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0 is DEAD
2025-10-02T09:29:07.797407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:07.797427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Write session will restart in 0.009934s
2025-10-02T09:29:07.797471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Write session: Do CDS request
2025-10-02T09:29:07.797479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:07.807224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:07.808313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.808374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:07.808392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-10-02T09:29:07.808567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.808608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:07.808618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:07.808622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:07.809034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-10-02T09:29:07.809068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:07.809072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:07.809074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:07.809080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554067129391230:4429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:07.809123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:07.809325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:07.809335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:07.809346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:07.809404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:07.809446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554067053871029:3964]
2025-10-02T09:29:07.809575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554067129391230:4429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:07.810091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:07.810382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:07.810421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:07.810754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:07.810805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.810811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.810812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.810813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.810814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.810815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.810815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.810816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.810817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.810818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.810819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.810820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.810824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.810832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.810836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.810839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.810841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.810844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.810847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.810851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.810853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.810857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.810859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.810862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.810868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.810874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:07.810879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.810883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:07.810886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.810890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:07.810894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.810898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:07.810902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.810906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:07.810909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.810913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:07.810916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.810920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:07.810924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.810928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:07.810931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.810935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:07.810938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.810943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.810946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.810950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.810955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.810959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.810989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:07.811627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554067129391230:4429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:07.817801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554067129391230:4429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:07.817819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554067129391230:4429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:07.817823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554067129391230:4429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:07.817830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:07.819568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:07.821448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:07.821467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:07.821470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:07.821473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:07.821479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [2:7556554067053871029:3964]
2025-10-02T09:29:07.821491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:07.821507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:07.821510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.821512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.821514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.821529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:07.821536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:07.821542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:07.821596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.821605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.821607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.821610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:07.821613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:07.821680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:07.821687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.821698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:07.821708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:07.821727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:07.821749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129391268:4429], now have 1 active actors on pipe
2025-10-02T09:29:07.821757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129391109:2446], now have 1 active actors on pipe
2025-10-02T09:29:07.821762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.821764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.821767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.821778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:07.821791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:07.821794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:07.821796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:07.821804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 324
2025-10-02T09:29:07.821810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 324
2025-10-02T09:29:07.821798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:07.821810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:07.821813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:07.821842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.821848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:07.821853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:07.821862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.821872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.821913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c670121b-593bbcfc-56966d0-2700bfdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:07.821922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:07.821926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:07.821928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:07.821936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:07.821948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:07.821966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.822085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.822092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.822104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:07.822198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 36 sessionId: src_id|c670121b-593bbcfc-56966d0-2700bfdb_0
2025-10-02T09:29:07.822488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e6dfb3-4b5444c-42f44618-5f1d900c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c670121b-593bbcfc-56966d0-2700bfdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:07.824849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Write session: try to update token
2025-10-02T09:29:07.824862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:07.832907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:07.832926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:07.832928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:07.832930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:07.832938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.832943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.832947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554067053871024:3964]
2025-10-02T09:29:07.832987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:07.832993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:07.833000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:07.833002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:07.833012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:07.833015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:07.833131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:07.838102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|c670121b-593bbcfc-56966d0-2700bfdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:07.840498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:07.897079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554067129391276:4289]
2025-10-02T09:29:07.897379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7556554067129391276:4289]
2025-10-02T09:29:07.979097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:07.979397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:07.979404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:07.979439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129391276:4289], now have 1 active actors on pipe
2025-10-02T09:29:07.979666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:07.979760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:07.979776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:07.979844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|c670121b-593bbcfc-56966d0-2700bfdb_0
2025-10-02T09:29:07.980017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|c670121b-593bbcfc-56966d0-2700bfdb_0 is DEAD
2025-10-02T09:29:07.980136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554067129391276:4289]
2025-10-02T09:29:07.980150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:07.984898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:07.984912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Write session will restart in 0.007826s
2025-10-02T09:29:07.984934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Write session: Do CDS request
2025-10-02T09:29:07.984940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:07.994401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.994735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:07.994750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-10-02T09:29:07.994895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:07.994922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:07.994927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:07.994931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:07.995297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-10-02T09:29:07.995328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:07.995332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:07.995333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:07.995338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554067129391349:4433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:07.995781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554067129391349:4433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:07.999311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554067129391349:4433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:07.999681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:08.001509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:08.001708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:08.001718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:08.001730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:08.001786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:08.001820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554071348838476:3966]
2025-10-02T09:29:08.001872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554067129391349:4433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:08.001884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554067129391349:4433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:08.001888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554067129391349:4433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:08.001896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:08.002392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:08.002671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:08.002719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:08.003048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:08.003097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.003103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.003104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.003105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.003106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.003108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.003109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.003110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.003111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.003112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.003122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.003123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.003128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.003138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.003142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.003146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.003149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.003153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.003156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.003160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.003164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.003168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.003172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.003176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.003182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.003189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.003195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.003200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.003205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.003214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.003218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.003227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.003232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.003246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.003250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.003255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.003261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.003266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.003270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.003275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.003279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.003284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.003289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.003294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.003299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.003303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.003307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.003312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.003345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:08.012940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:08.014673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:08.014694Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:08.014698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:08.014702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:08.014709Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [2:7556554071348838476:3966]
2025-10-02T09:29:08.014723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:08.014741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:08.014744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.014747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.014749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.014766Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:08.014771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:08.014779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:08.014843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.014848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.014850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.014853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:08.014855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:08.014922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:08.014925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.014939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.014948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.014962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:08.014979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.014981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.014983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.014989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:08.015002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:08.015016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:08.015019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:08.015028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:08.015031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:08.015032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:08.015053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.015056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:08.015058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:08.015066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554067129391280:2446], now have 1 active actors on pipe
2025-10-02T09:29:08.015069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424358719:4433], now have 1 active actors on pipe
2025-10-02T09:29:08.015417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 325
2025-10-02T09:29:08.015461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 325
2025-10-02T09:29:08.015778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.015790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.015816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:08.015823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.015827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.015829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:08.015839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.015850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:08.015865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.016120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.016127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.016141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.016222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 36 sessionId: src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0
2025-10-02T09:29:08.016579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c670121b-593bbcfc-56966d0-2700bfdb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:08.019720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Write session: try to update token
2025-10-02T09:29:08.019741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:08.033941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:08.033962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.033964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:08.033966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:08.033974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.033978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.033982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554067053871175:3966]
2025-10-02T09:29:08.034016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:08.034022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.034024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:08.034036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:08.034042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:08.034046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:08.034148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:08.045690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:08.048521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:08.080193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554071424358754:4289]
2025-10-02T09:29:08.080438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7556554071424358754:4289]
2025-10-02T09:29:08.193487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:08.193985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.194000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.194019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424358754:4289], now have 1 active actors on pipe
2025-10-02T09:29:08.194324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:08.194368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:08.194437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:08.194458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:08.194527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: error at write: Disconnected sessionId: src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0
2025-10-02T09:29:08.194688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0 is DEAD
2025-10-02T09:29:08.194807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554071424358754:4289]
2025-10-02T09:29:08.194918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:08.194932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Write session will restart in 0.007679s
2025-10-02T09:29:08.194962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Write session: Do CDS request
2025-10-02T09:29:08.194969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:08.204461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.204799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:08.204830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-10-02T09:29:08.205048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.205097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:08.205102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:08.205106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:08.205658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-10-02T09:29:08.205692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:08.205694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:08.205696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:08.205701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554071424358846:4445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:08.206275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554071424358846:4445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:08.208769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554071424358846:4445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:08.209564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:08.211487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:08.211674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:08.211684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:08.211694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:08.211765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:08.211803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554071348838667:3981]
2025-10-02T09:29:08.212407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:08.212725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:08.212776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:08.213092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:08.213169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.213177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.213178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.213179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.213181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.213182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.213183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.213184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.213185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.213186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.213188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.213189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.213194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.213205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.213208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.213212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.213216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.213220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.213224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.213227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.213231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.213236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.213240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.213244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.213251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.213258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.213264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.213270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.213274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.213280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.213284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.213289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.213295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.213304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.213310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.213315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.213319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.213325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.213329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.213336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.213343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.213349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.213353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.213358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.213365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.213370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.213379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.213384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.213420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:08.213580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554071424358846:4445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:08.213596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554071424358846:4445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:08.213599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554071424358846:4445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:08.213606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:08.223183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:08.224752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:08.224768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:08.224770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:08.224775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:08.224781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [2:7556554071348838667:3981]
2025-10-02T09:29:08.224796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:08.224834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:08.224837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.224840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.224842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.224858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:08.224863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:08.224875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:08.224940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.224947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.224950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.224953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:08.224955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:08.225021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:08.225028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.225041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.225056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.225077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:08.225100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424358911:4445], now have 1 active actors on pipe
2025-10-02T09:29:08.225108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424358759:2446], now have 1 active actors on pipe
2025-10-02T09:29:08.225114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.225116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.225119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.225133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:08.225159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:08.225169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:08.225176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:08.225178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:08.225178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:08.225181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:08.225192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 326
2025-10-02T09:29:08.225217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.225233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 326
2025-10-02T09:29:08.225227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:08.225228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:08.225242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.225247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.225286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:08.225297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.225303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.225305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:08.225312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.225325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:08.225350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.225527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.225534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.225546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.225641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 36 sessionId: src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0
2025-10-02T09:29:08.225974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcd27a-b7298c36-752080e9-dacc5c00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:08.228482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Write session: try to update token
2025-10-02T09:29:08.228495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:08.237700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:08.237720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.237722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:08.237724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:08.237737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.237740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.237744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554071348838662:3981]
2025-10-02T09:29:08.237781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:08.237785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:08.237787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.237789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:08.237790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:08.237796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:08.237923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:08.242028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:08.244680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:08.295213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554071424358919:4289]
2025-10-02T09:29:08.295592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7556554071424358919:4289]
2025-10-02T09:29:08.384738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:08.385225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.385238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.385264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424358919:4289], now have 1 active actors on pipe
2025-10-02T09:29:08.385469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554071424358919:4289]
2025-10-02T09:29:08.385485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:08.385489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:08.385503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:08.385544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: error at write: Disconnected sessionId: src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0
2025-10-02T09:29:08.385670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:08.385921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:08.385940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Write session will restart in 0.007903s
2025-10-02T09:29:08.385721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0 is DEAD
2025-10-02T09:29:08.385968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Write session: Do CDS request
2025-10-02T09:29:08.385977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:08.395322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.395446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:08.395464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-10-02T09:29:08.395649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.395703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:08.395712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:08.395716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:08.396102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-10-02T09:29:08.396136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:08.396138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:08.396139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:08.396144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554071424359048:4450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:08.396201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:08.396617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554071424359048:4450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:08.397955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:08.398131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:08.398139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:08.398147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:08.398190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:08.398222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554071348838833:3984]
2025-10-02T09:29:08.398542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554071424359048:4450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:08.398760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:08.399026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:08.399076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:08.399382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:08.399432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.399437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.399438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.399439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.399440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.399441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.399442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.399442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.399443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.399443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.399444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.399445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.399448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.399454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.399456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.399458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.399461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.399463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.399465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.399467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.399469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.399471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.399473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.399475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.399479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.399484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.399487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.399490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.399492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.399495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.399497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.399500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.399503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.399505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.399508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.399511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.399514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.399517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.399519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.399522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.399524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.399527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.399529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.399532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.399534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.399537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.399541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.399544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.399561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:08.403979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554071424359048:4450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:08.403993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554071424359048:4450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:08.403996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554071424359048:4450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:08.404003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:08.407990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:08.409716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:08.409732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:08.409734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:08.409738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:08.409743Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [2:7556554071348838833:3984]
2025-10-02T09:29:08.409756Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:08.409771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:08.409774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.409776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.409778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.409792Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:08.409797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:08.409804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:08.409859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.409866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.409868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.409871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:08.409873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:08.409939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:08.409947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.409959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.409970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.409986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:08.410008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359087:4450], now have 1 active actors on pipe
2025-10-02T09:29:08.410015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424358934:2446], now have 1 active actors on pipe
2025-10-02T09:29:08.410020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.410022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.410025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.410036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:08.410049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:08.410050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:08.410053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:08.410055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:08.410062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:08.410065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:08.410093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.410106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:08.410093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 327
2025-10-02T09:29:08.410110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 327
2025-10-02T09:29:08.410136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:08.410209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.410218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.410240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:08.410251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.410259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.410261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:08.410269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.410280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:08.410297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.410434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.410441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.410451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.410518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0
2025-10-02T09:29:08.410898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e87f06-1beee859-b8e6e9fe-c13bbd51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:08.414186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Write session: try to update token
2025-10-02T09:29:08.414207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:08.420934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:08.420949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.420959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.421002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:08.421002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:08.421174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:08.421328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:08.421520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:08.421660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:08.421851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:08.421893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:08.429844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:08.430905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:08.430922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.430924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:08.430926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:08.430937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.430941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.430945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554071348838827:3984]
2025-10-02T09:29:08.430982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:08.430988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.430989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:08.430994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:08.430996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:08.430999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:08.431164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:08.432607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:08.485706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554071424359095:4289]
2025-10-02T09:29:08.486012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7556554071424359095:4289]
2025-10-02T09:29:08.574272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:08.574620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.574642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.574662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359095:4289], now have 1 active actors on pipe
2025-10-02T09:29:08.574870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:08.574964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:08.574965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:08.574981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:08.575011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554071424359095:4289]
2025-10-02T09:29:08.575041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: error at write: Disconnected sessionId: src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0
2025-10-02T09:29:08.575234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0 is DEAD
2025-10-02T09:29:08.575371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:08.575392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Write session will restart in 0.006534s
2025-10-02T09:29:08.575417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Write session: Do CDS request
2025-10-02T09:29:08.575422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:08.583369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.583451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:08.583476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-10-02T09:29:08.583750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.583784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:08.583789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:08.583798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:08.584278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-10-02T09:29:08.584314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:08.584318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:08.584320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:08.584324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554071424359169:4454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:08.584868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554071424359169:4454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:08.587154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554071424359169:4454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:08.587450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:08.589412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:08.589751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554071424359169:4454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:08.589767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554071424359169:4454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:08.589771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554071424359169:4454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:08.589779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:08.589587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:08.589597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:08.589606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:08.589654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:08.589688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554071348838990:3986]
2025-10-02T09:29:08.590260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:08.590608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:08.590655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:08.590966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:08.591032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.591038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.591039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.591040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.591041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.591042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.591043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.591044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.591045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.591046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.591047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.591048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.591052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.591063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.591067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.591070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.591073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.591076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.591080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.591083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.591087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.591090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.591093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.591096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.591103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.591110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.591126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.591131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.591135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.591139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.591142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.591147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.591151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.591156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.591160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.591166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.591175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.591180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.591184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.591188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.591193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.591198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.591202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.591206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.591211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.591216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.591219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.591225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.591256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:08.600336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:08.602109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:08.602128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:08.602131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:08.602135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:08.602143Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [2:7556554071348838990:3986]
2025-10-02T09:29:08.602157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:08.602176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:08.602180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.602183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.602186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.602202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:08.602207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:08.602214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:08.602267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.602276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.602278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.602281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:08.602284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:08.602359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:08.602366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.602380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.602395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.602411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:08.602441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359248:4454], now have 1 active actors on pipe
2025-10-02T09:29:08.602445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359098:2446], now have 1 active actors on pipe
2025-10-02T09:29:08.602452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.602454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.602456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.602471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:08.602484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:08.602495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:08.602498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:08.602501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:08.602505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:08.602508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:08.602546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.602560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:08.602569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:08.602596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.602553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 328
2025-10-02T09:29:08.602600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.602632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:08.602564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 328
2025-10-02T09:29:08.602638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.602642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.602644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:08.602654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.602667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:08.602688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.602838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.602847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.602862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.602958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0
2025-10-02T09:29:08.603364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c951e95-3840b83d-239376f0-6fa5d4b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:08.606667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Write session: try to update token
2025-10-02T09:29:08.606690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:08.613689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:08.613705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.613714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.613755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:08.613758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:08.613930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:08.614073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:08.614218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:08.614374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:08.614581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:08.614727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:08.621428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:08.624067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:08.624188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:08.624206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.624209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:08.624210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:08.624219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.624223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.624227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554071348838985:3986]
2025-10-02T09:29:08.624261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:08.624267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.624269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:08.624270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:08.624275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:08.624278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:08.624410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:08.675104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554071424359259:4289]
2025-10-02T09:29:08.675330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7556554071424359259:4289]
2025-10-02T09:29:08.754228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:08.754436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.754446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.754459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359259:4289], now have 1 active actors on pipe
2025-10-02T09:29:08.754653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:08.754663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:08.754665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:08.754669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:08.754706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554071424359259:4289]
2025-10-02T09:29:08.754716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: error at write: Disconnected sessionId: src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0
2025-10-02T09:29:08.754852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0 is DEAD
2025-10-02T09:29:08.755031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:08.755047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Write session will restart in 0.008018s
2025-10-02T09:29:08.755080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Write session: Do CDS request
2025-10-02T09:29:08.755089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:08.763141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:08.764331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.764476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:08.764491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-10-02T09:29:08.764654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.764686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:08.764694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:08.764698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:08.764918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:08.765116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-10-02T09:29:08.765136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:08.765145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:08.765154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:08.765157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:08.765176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:08.765178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:08.765183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554071424359388:4459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:08.765203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:08.765241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554071348839145:3988]
2025-10-02T09:29:08.765577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554071424359388:4459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:08.765705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:08.766024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:08.766061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:08.766300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:08.766355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.766363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.766364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.766365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.766366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.766368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.766369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.766370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.766372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.766374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.766375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.766377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.766382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.766389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.766392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.766395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.766397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.766400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.766402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.766404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.766407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.766412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.766415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.766417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.766422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.766430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.766434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.766438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.766441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.766445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.766447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.766451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.766454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.766457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.766460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.766463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.766466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.766470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.766472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.766476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.766479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.766482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.766485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.766489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.766492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.766496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.766499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.766503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.766526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:08.767417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554071424359388:4459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:08.772920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554071424359388:4459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:08.772939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554071424359388:4459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:08.772943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554071424359388:4459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:08.772949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:08.774689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:08.776102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:08.776113Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:08.776115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:08.776118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:08.776122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [2:7556554071348839145:3988]
2025-10-02T09:29:08.776132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:08.776144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:08.776145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.776147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.776149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.776159Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:08.776165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:08.776169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:08.776208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.776213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.776214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.776216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:08.776218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:08.776263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:08.776270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.776276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.776282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.776291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:08.776303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.776305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.776306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.776310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:08.776319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359427:4459], now have 1 active actors on pipe
2025-10-02T09:29:08.776319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:08.776321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:08.776321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359271:2446], now have 1 active actors on pipe
2025-10-02T09:29:08.776322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:08.776326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:08.776334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:08.776336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:08.776359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.776367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:08.776376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:08.776382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 329
2025-10-02T09:29:08.776384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 329
2025-10-02T09:29:08.776493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.776502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.776522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2759115-f7d49820-ba9e556e-9324c834_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:08.776530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.776533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.776535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:08.776542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.776552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:08.776565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.776703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.776713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.776731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.776847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2759115-f7d49820-ba9e556e-9324c834_0
2025-10-02T09:29:08.777231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffb1e4f-2270f47f-76b0d3e4-14bf4ccd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2759115-f7d49820-ba9e556e-9324c834_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:08.780035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Write session: try to update token
2025-10-02T09:29:08.780051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:08.786486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:08.786496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.786498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:08.786500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:08.786508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.786512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.786516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554071348839140:3988]
2025-10-02T09:29:08.786547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:08.786550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:08.786554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:08.786556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.786556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:08.786557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:08.786683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:08.792949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|d2759115-f7d49820-ba9e556e-9324c834_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:08.795322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:08.854814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554071424359438:4289]
2025-10-02T09:29:08.855060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7556554071424359438:4289]
2025-10-02T09:29:08.915046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:08.915413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.915423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.915436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359438:4289], now have 1 active actors on pipe
2025-10-02T09:29:08.915611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:08.915629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:08.915645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:08.915658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554071424359438:4289]
2025-10-02T09:29:08.915673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:08.915696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|d2759115-f7d49820-ba9e556e-9324c834_0
2025-10-02T09:29:08.915836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|d2759115-f7d49820-ba9e556e-9324c834_0 is DEAD
2025-10-02T09:29:08.916045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:08.916060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Write session will restart in 0.005846s
2025-10-02T09:29:08.916084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Write session: Do CDS request
2025-10-02T09:29:08.916090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:08.923397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.923431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:08.923445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-10-02T09:29:08.923624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:08.923646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:08.923649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:08.923652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:08.923737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:08.923995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-10-02T09:29:08.924027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:08.924032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:08.924033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:08.924039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554071424359557:4463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:08.924483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554071424359557:4463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:08.925321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:08.925445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:08.925451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:08.925456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:08.925484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:08.925508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554071348839304:3991]
2025-10-02T09:29:08.925765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554071424359557:4463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:08.925865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:08.926077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:08.926132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:08.926419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:08.926475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.926480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.926481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.926482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.926483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.926484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.926485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.926486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.926487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.926488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.926489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.926490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.926495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.926504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.926508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.926512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.926516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.926520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.926524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.926527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.926530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.926535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.926538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.926542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.926547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.926554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:08.926560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.926565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:08.926571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.926575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:08.926583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.926588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:08.926595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.926600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:08.926604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.926612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:08.926618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.926626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:08.926631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.926637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:08.926642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.926647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:08.926654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.926659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.926664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.926669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.926676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.926681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.926717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:08.930878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554071424359557:4463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:08.930889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554071424359557:4463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:08.930892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554071424359557:4463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:08.930899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:08.934746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:08.936277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:08.936291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:08.936293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:08.936296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:08.936302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [2:7556554071348839304:3991]
2025-10-02T09:29:08.936316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:08.936330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:08.936333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.936335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.936337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.936351Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:08.936356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:08.936362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:08.936411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.936419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.936420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.936423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:08.936425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:08.936490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:08.936497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.936509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:08.936520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:08.936537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:08.936558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359596:4463], now have 1 active actors on pipe
2025-10-02T09:29:08.936565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554071424359439:2446], now have 1 active actors on pipe
2025-10-02T09:29:08.936570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.936572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.936574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.936584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:08.936596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:08.936606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:08.936612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:08.936613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:08.936614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:08.936615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:08.936596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 330
2025-10-02T09:29:08.936613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 330
2025-10-02T09:29:08.936649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.936656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.936666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.936673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:08.936679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:08.936697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:08.936706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:08.936709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:08.936711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:08.936718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:08.936727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:08.936745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.936867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:08.936873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:08.936882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:08.936947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 36 sessionId: src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0
2025-10-02T09:29:08.937260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2759115-f7d49820-ba9e556e-9324c834_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:08.940062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Write session: try to update token
2025-10-02T09:29:08.940078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:08.946721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:08.946735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:08.946736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:08.946737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:08.946742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.946745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.946747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554071348839299:3991]
2025-10-02T09:29:08.946774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:08.946778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:08.946779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:08.946791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:08.946797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:08.946800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:08.946895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:08.953470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:08.955587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:09.015584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554075719326899:4289]
2025-10-02T09:29:09.015802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7556554075719326899:4289]
2025-10-02T09:29:09.075687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:09.075932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.075942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.075957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719326899:4289], now have 1 active actors on pipe
2025-10-02T09:29:09.076107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:09.076138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554075719326899:4289]
2025-10-02T09:29:09.076189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:09.076226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:09.076290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0
2025-10-02T09:29:09.076471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0 is DEAD
2025-10-02T09:29:09.076695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:09.076709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Write session will restart in 0.007011s
2025-10-02T09:29:09.076747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Write session: Do CDS request
2025-10-02T09:29:09.076755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:09.085488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.085527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:09.085551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-10-02T09:29:09.085853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.085892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:09.085904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:09.085912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:09.086335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-10-02T09:29:09.086376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:09.086383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:09.086385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:09.086392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554075719327030:4473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:09.086861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554075719327030:4473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:09.087088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:09.088527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554075719327030:4473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:09.088711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:09.088872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:09.088880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:09.088889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:09.088935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:09.088965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554075643806775:3999]
2025-10-02T09:29:09.089349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:09.089597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:09.089628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:09.089833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:09.089865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.089869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.089869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.089870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.089870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.089871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.089872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.089872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.089873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.089873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.089874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.089874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.089879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.089887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.089891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.089894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.089897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.089900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.089904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.089907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.089911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.089914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.089917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.089921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.089926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.089933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.089938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.089943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.089945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.089948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.089952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.089955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.089957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.089960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.089962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.089965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.089967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.089970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.089972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.089975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.089977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.089979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.089982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.089985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.089987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.089990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.089992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.089995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.090012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:09.094684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554075719327030:4473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:09.094704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554075719327030:4473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:09.094708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554075719327030:4473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:09.094718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:09.100959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:09.102766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:09.102783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:09.102785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:09.102788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:09.102794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [2:7556554075643806775:3999]
2025-10-02T09:29:09.102807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:09.102822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:09.102825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.102828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.102830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.102844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:09.102849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:09.102855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:09.102914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.102922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.102925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.102928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:09.102930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:09.102996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:09.103002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.103016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.103027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.103044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:09.103064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327071:4473], now have 1 active actors on pipe
2025-10-02T09:29:09.103072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719326905:2446], now have 1 active actors on pipe
2025-10-02T09:29:09.103080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.103084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.103086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.103103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:09.103134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:09.103138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:09.103142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:09.103144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:09.103153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:09.103156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:09.103190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.103201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:09.103207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:09.103225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 331
2025-10-02T09:29:09.103308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 331
2025-10-02T09:29:09.103340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.103350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.103383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52602b3d-cccce649-fd09b319-c883426d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:09.103394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.103398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.103400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:09.103408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.103422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:09.103437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.103585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.103593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.103605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.103709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 36 sessionId: src_id|52602b3d-cccce649-fd09b319-c883426d_0
2025-10-02T09:29:09.104094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70bc3ad-9dd016e1-7aa111-dd21969f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52602b3d-cccce649-fd09b319-c883426d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:09.112101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Write session: try to update token
2025-10-02T09:29:09.112123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:09.116076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:09.116092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:09.116094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:09.116097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:09.116103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.116108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.116111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554075643806767:3999]
2025-10-02T09:29:09.116141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:09.116143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:09.116145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:09.116148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.116149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:09.116151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:09.116275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:09.128468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|52602b3d-cccce649-fd09b319-c883426d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:09.133822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:09.176383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554075719327090:4289]
2025-10-02T09:29:09.176626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7556554075719327090:4289]
2025-10-02T09:29:09.259094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:09.259536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.259549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.259568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327090:4289], now have 1 active actors on pipe
2025-10-02T09:29:09.259805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554075719327090:4289]
2025-10-02T09:29:09.259845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:09.259848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:09.259904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: error at write: Disconnected sessionId: src_id|52602b3d-cccce649-fd09b319-c883426d_0
2025-10-02T09:29:09.259946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:09.259801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:09.260107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|52602b3d-cccce649-fd09b319-c883426d_0 is DEAD
2025-10-02T09:29:09.260356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:09.260367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Write session will restart in 0.009038s
2025-10-02T09:29:09.260394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Write session: Do CDS request
2025-10-02T09:29:09.260401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:09.270326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.270443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:09.270462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-10-02T09:29:09.270587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.270618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:09.270628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:09.270632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:09.271092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-10-02T09:29:09.271143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:09.271152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:09.271157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:09.271163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554075719327211:4479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:09.271671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554075719327211:4479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:09.271742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:09.273386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554075719327211:4479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:09.273577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:09.273739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:09.273749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:09.273758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:09.273801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:09.273833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554075643806957:4008]
2025-10-02T09:29:09.274395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:09.274666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:09.274716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:09.275038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:09.275085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.275090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.275091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.275092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.275093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.275094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.275095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.275096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.275097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.275097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.275098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.275100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.275104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.275123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.275126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.275129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.275133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.275136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.275139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.275142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.275145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.275149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.275152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.275154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.275160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.275167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.275171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.275175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.275179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.275183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.275186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.275191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.275195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.275198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.275202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.275206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.275209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.275213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.275217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.275220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.275224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.275229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.275232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.275236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.275240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.275244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.275254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.275258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.275288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:09.275813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554075719327211:4479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:09.275829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554075719327211:4479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:09.275832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554075719327211:4479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:09.275839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:09.283984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:09.285656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:09.285669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:09.285671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:09.285675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:09.285681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [2:7556554075643806957:4008]
2025-10-02T09:29:09.285694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:09.285709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:09.285712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.285715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.285717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.285731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:09.285735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:09.285743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:09.285801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.285807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.285809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.285813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:09.285815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:09.285882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:09.285890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.285902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.285913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.285929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:09.285949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327093:2446], now have 1 active actors on pipe
2025-10-02T09:29:09.285956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327251:4479], now have 1 active actors on pipe
2025-10-02T09:29:09.285961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.285963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.285965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.285976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:09.285990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:09.285999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:09.286002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:09.286005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:09.286007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:09.286010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:09.286039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.286051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:09.286062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:09.286061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 332
2025-10-02T09:29:09.286065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 332
2025-10-02T09:29:09.286102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.286110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.286130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:09.286140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.286143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.286145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:09.286153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.286165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:09.286180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.286350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.286371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.286394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.286483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 36 sessionId: src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0
2025-10-02T09:29:09.286808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52602b3d-cccce649-fd09b319-c883426d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:09.290124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Write session: try to update token
2025-10-02T09:29:09.290144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:09.300852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:09.300870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:09.300877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.300912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:09.300932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:09.301051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:09.301173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:09.301290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:09.301405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:09.301565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:09.301593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:09.303639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:09.305846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:09.305861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:09.305862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:09.305864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:09.305869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.305872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.305875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554075643806951:4008]
2025-10-02T09:29:09.305900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:09.305905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.305906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:09.305922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:09.305928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:09.305931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:09.306015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:09.306809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:09.360142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554075719327260:4289]
2025-10-02T09:29:09.360533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7556554075719327260:4289]
2025-10-02T09:29:09.443869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:09.444226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.444240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.444257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327260:4289], now have 1 active actors on pipe
2025-10-02T09:29:09.444482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:09.444466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554075719327260:4289]
2025-10-02T09:29:09.444472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:09.444504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:09.444506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:09.444564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: error at write: Disconnected sessionId: src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0
2025-10-02T09:29:09.444739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0 is DEAD
2025-10-02T09:29:09.444918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:09.444928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Write session will restart in 0.009484s
2025-10-02T09:29:09.444953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Write session: Do CDS request
2025-10-02T09:29:09.444958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:09.455473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.455707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:09.455727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-10-02T09:29:09.455819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.455848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:09.455859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:09.455864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:09.456343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-10-02T09:29:09.456378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:09.456379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:09.456381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:09.456385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554075719327393:4484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:09.456874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554075719327393:4484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:09.457834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:09.458735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554075719327393:4484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:09.459878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:09.460092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:09.460104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:09.460115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:09.460181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:09.460222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554075643807129:4011]
2025-10-02T09:29:09.460782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:09.461142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:09.461187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:09.461491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554075719327393:4484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:09.461512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:09.461505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554075719327393:4484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:09.461509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554075719327393:4484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:09.461516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:09.461560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.461566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.461567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.461568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.461570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.461571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.461572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.461573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.461574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.461575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.461577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.461578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.461583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.461594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.461599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.461603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.461607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.461612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.461616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.461620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.461624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.461629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.461632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.461636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.461642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.461653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.461663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.461669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.461677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.461683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.461687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.461692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.461701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.461707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.461716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.461721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.461730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.461734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.461743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.461747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.461751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.461759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.461763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.461768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.461775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.461780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.461784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.461789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.461827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:09.470785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:09.472698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:09.472715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:09.472718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:09.472721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:09.472728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [2:7556554075643807129:4011]
2025-10-02T09:29:09.472746Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:09.472765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:09.472768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.472771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.472773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.472789Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:09.472821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:09.472827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:09.472891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.472897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.472899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.472902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:09.472904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:09.472970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:09.472976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.472989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.473004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.473019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:09.473039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327432:4484], now have 1 active actors on pipe
2025-10-02T09:29:09.473046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327274:2446], now have 1 active actors on pipe
2025-10-02T09:29:09.473051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.473053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.473055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.473065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:09.473078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:09.473095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:09.473095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:09.473098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:09.473101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:09.473101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:09.473134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.473140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:09.473143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:09.473098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 333
2025-10-02T09:29:09.473098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 333
2025-10-02T09:29:09.473158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.473164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.473205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a94c079d-626e880d-514e2092-e4f90466_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:09.473217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.473223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.473225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:09.473233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.473241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:09.473261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.473410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.473429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.473451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.473529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 36 sessionId: src_id|a94c079d-626e880d-514e2092-e4f90466_0
2025-10-02T09:29:09.473881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f098f518-8ba0ca2a-bebfb011-4824d663_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a94c079d-626e880d-514e2092-e4f90466_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:09.476400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Write session: try to update token
2025-10-02T09:29:09.476416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:09.484305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:09.484321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:09.484323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:09.484325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:09.484334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.484337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.484340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554075643807124:4011]
2025-10-02T09:29:09.484367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:09.484371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.484373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:09.484395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:09.484401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:09.484406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:09.484514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:09.489645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|a94c079d-626e880d-514e2092-e4f90466_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:09.492151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:09.544504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554075719327442:4289]
2025-10-02T09:29:09.544765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7556554075719327442:4289]
2025-10-02T09:29:09.631148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:09.631535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.631547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.631583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327442:4289], now have 1 active actors on pipe
2025-10-02T09:29:09.631788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:09.632297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:09.632309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Write session will restart in 0.006824s
2025-10-02T09:29:09.632331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Write session: Do CDS request
2025-10-02T09:29:09.632337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:09.631921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:09.631939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:09.631997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: error at write: Disconnected sessionId: src_id|a94c079d-626e880d-514e2092-e4f90466_0
2025-10-02T09:29:09.632164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|a94c079d-626e880d-514e2092-e4f90466_0 is DEAD
2025-10-02T09:29:09.632325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554075719327442:4289]
2025-10-02T09:29:09.632339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:09.640508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.640603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:09.640621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-10-02T09:29:09.641176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.641211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:09.641216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:09.641220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:09.641636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-10-02T09:29:09.641668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:09.641670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:09.641671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:09.641676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554075719327479:4488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:09.642188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554075719327479:4488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:09.645819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554075719327479:4488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:09.651497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554075719327479:4488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:09.651517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554075719327479:4488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:09.651520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554075719327479:4488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:09.651529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:09.654609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:09.658325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:09.658544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:09.658557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:09.658568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:09.658635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:09.658699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554075643807291:4013]
2025-10-02T09:29:09.659298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:09.659987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:09.660045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:09.660367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:09.660451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.660461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.660462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.660463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.660464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.660466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.660467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.660468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.660469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.660470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.660472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.660473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.660479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.660491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.660495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.660499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.660503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.660506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.660510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.660514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.660518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.660521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.660526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.660529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.660537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.660544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.660549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.660555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.660558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.660564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.660568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.660573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.660578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.660584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.660593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.660598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.660603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.660608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.660613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.660618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.660624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.660630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.660635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.660643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.660649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.660654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.660661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.660665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.660704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:09.672455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:09.674182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:09.674198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:09.674201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:09.674205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:09.674212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [2:7556554075643807291:4013]
2025-10-02T09:29:09.674227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:09.674246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:09.674249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.674252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.674253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.674270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:09.674285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:09.674291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:09.674356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.674363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.674367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.674371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:09.674373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:09.674440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:09.674451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.674465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.674476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.674492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:09.674509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.674512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.674514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.674523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:09.674536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:09.674540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:09.674543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:09.674545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:09.674556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:09.674559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:09.674568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327598:4488], now have 1 active actors on pipe
2025-10-02T09:29:09.674572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327444:2446], now have 1 active actors on pipe
2025-10-02T09:29:09.674604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.674617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:09.674646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:09.674844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 334
2025-10-02T09:29:09.674878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 334
2025-10-02T09:29:09.675059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.675070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.675094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:09.675105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.675109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.675123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:09.675143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.675157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:09.675177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.675512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.675521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.675534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.675611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 36 sessionId: src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0
2025-10-02T09:29:09.676950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94c079d-626e880d-514e2092-e4f90466_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:09.680088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Write session: try to update token
2025-10-02T09:29:09.680109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:09.687483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:09.687502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:09.687505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:09.687507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:09.687517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.687523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.687527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554075643807286:4013]
2025-10-02T09:29:09.687562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:09.687568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.687571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:09.687700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:09.688827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:09.688832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:09.688835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:09.719150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:09.721783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:09.732395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554075719327622:4289]
2025-10-02T09:29:09.732716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7556554075719327622:4289]
2025-10-02T09:29:09.839747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:09.840311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.840321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.840337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327622:4289], now have 1 active actors on pipe
2025-10-02T09:29:09.840589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:09.840589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:09.840606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:09.840611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:09.840657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554075719327622:4289]
2025-10-02T09:29:09.840661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: error at write: Disconnected sessionId: src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0
2025-10-02T09:29:09.840851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0 is DEAD
2025-10-02T09:29:09.845091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:09.845106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Write session will restart in 0.006460s
2025-10-02T09:29:09.845137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Write session: Do CDS request
2025-10-02T09:29:09.845145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:09.853391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.856443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:09.856966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:09.856988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-10-02T09:29:09.857156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:09.857202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:09.857213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:09.857218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:09.857633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-10-02T09:29:09.857665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:09.857666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:09.857668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:09.857674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554075719327753:4493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:09.858175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554075719327753:4493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:09.860981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:09.861198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:09.861209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:09.861218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:09.861269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:09.861303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554075643807455:4016]
2025-10-02T09:29:09.861899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:09.862227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:09.862287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:09.862381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554075719327753:4493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:09.862607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:09.862690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.862697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.862698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.862699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.862700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.862701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.862703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.862704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.862705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.862706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.862707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.862708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.862714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.862724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.862728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.862732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.862735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.862739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.862743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.862747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.862750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.862754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.862758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.862762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.862769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.862776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:09.862781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.862787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:09.862791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.862796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:09.862800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.862807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:09.862812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.862817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:09.862821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.862827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:09.862831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.862837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:09.862841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.862848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:09.862853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.862863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:09.862867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.862872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.862878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.862883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.862889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.862894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.862937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:09.867777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554075719327753:4493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:09.867794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554075719327753:4493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:09.867798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554075719327753:4493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:09.867805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:09.871846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:09.873522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:09.873544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:09.873546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:09.873550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:09.873556Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [2:7556554075643807455:4016]
2025-10-02T09:29:09.873570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:09.873587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:09.873591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.873594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.873596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.873610Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:09.873621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:09.873629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:09.873689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.873700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.873702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.873705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:09.873708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:09.873772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:09.873779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.873793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:09.873808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:09.873827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:09.873850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327791:4493], now have 1 active actors on pipe
2025-10-02T09:29:09.873858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327628:2446], now have 1 active actors on pipe
2025-10-02T09:29:09.873864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.873868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.873871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.873883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:09.873894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:09.873896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:09.873904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:09.873906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:09.873910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:09.873912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:09.873904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 335
2025-10-02T09:29:09.873943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.873912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 335
2025-10-02T09:29:09.873951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:09.873962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:09.873968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.873971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.874181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:09.874194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:09.874198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:09.874200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:09.874207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:09.874219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:09.874246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.874376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:09.874383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:09.874396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:09.874511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 36 sessionId: src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0
2025-10-02T09:29:09.874918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cc8671-43ca12e2-9ea5058b-8fa8868d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:09.877888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Write session: try to update token
2025-10-02T09:29:09.877910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:09.885376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:09.885395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:09.885397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:09.885399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:09.885408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.885412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.885415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554075643807450:4016]
2025-10-02T09:29:09.885455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:09.885462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:09.885461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:09.885464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:09.885468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:09.885472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:09.885583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:09.893206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:09.895636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:09.940796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554075719327798:4289]
2025-10-02T09:29:09.941075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7556554075719327798:4289]
2025-10-02T09:29:10.027227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:10.027681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.027696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.027713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554075719327798:4289], now have 1 active actors on pipe
2025-10-02T09:29:10.027915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:10.028362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:10.028379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:10.028534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: error at write: Disconnected sessionId: src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0
2025-10-02T09:29:10.028708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0 is DEAD
2025-10-02T09:29:10.028730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554075719327798:4289]
2025-10-02T09:29:10.028745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:10.028866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:10.028877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Write session will restart in 0.007199s
2025-10-02T09:29:10.028902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Write session: Do CDS request
2025-10-02T09:29:10.028907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:10.039231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.040953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:10.040984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-10-02T09:29:10.042050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.042114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:10.042128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:10.042133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:10.042730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-10-02T09:29:10.042775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:10.042781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:10.042784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:10.042794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554080014295219:4497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:10.043391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554080014295219:4497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:10.044592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:10.046881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:10.047055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:10.047065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:10.047075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:10.047136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:10.047169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554079938774914:4018]
2025-10-02T09:29:10.047792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:10.048119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:10.048188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:10.048167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554080014295219:4497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:10.048522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:10.048577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.048582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.048583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.048584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.048585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.048586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.048587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.048588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.048589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.048590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.048591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.048592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.048597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.048607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.048611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.048615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.048618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.048622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.048626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.048630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.048633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.048638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.048641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.048645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.048651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.048658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.048663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.048668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.048672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.048677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.048682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.048687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.048691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.048696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.048701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.048705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.048709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.048714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.048719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.048724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.048728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.048733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.048737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.048742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.048752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.048756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.048761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.048767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.048821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:10.058071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554080014295219:4497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:10.058096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554080014295219:4497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:10.058101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554080014295219:4497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:10.058111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:10.058118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:10.059848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:10.059865Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:10.059869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:10.059874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:10.059880Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [2:7556554079938774914:4018]
2025-10-02T09:29:10.059895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:10.059912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:10.059915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.059918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.059920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.059936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:10.059946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:10.059953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:10.060022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.060031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.060033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.060037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:10.060040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:10.060106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:10.060117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.060131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.060144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.060162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:10.060179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.060186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.060188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.060197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:10.060207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:10.060210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:10.060214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:10.060216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:10.060226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:10.060228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:10.060239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295260:4497], now have 1 active actors on pipe
2025-10-02T09:29:10.060243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295097:2446], now have 1 active actors on pipe
2025-10-02T09:29:10.060274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.060289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:10.060388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:10.060381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 336
2025-10-02T09:29:10.060391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 336
2025-10-02T09:29:10.060585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.060598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.060627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|694fb161-f9e26625-ab20be8c-ea59f266_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:10.060634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.060637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.060640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:10.060651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.060661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:10.060674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.060891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.060899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.060913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.061033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 36 sessionId: src_id|694fb161-f9e26625-ab20be8c-ea59f266_0
2025-10-02T09:29:10.064916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cac7e75-dc83204c-baa4756e-4ba0a0b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|694fb161-f9e26625-ab20be8c-ea59f266_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:10.067877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Write session: try to update token
2025-10-02T09:29:10.067898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:10.072054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:10.072074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.072077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:10.072079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:10.072087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.072091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.072094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554079938774909:4018]
2025-10-02T09:29:10.072130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:10.072137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.072140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:10.072259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:10.073210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:10.073229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:10.073233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:10.083443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|694fb161-f9e26625-ab20be8c-ea59f266_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:10.085971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:10.128709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554080014295282:4289]
2025-10-02T09:29:10.129013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7556554080014295282:4289]
2025-10-02T09:29:10.213398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:10.213655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.213665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.213678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295282:4289], now have 1 active actors on pipe
2025-10-02T09:29:10.213887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:10.213899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:10.213906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:10.213958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: error at write: Disconnected sessionId: src_id|694fb161-f9e26625-ab20be8c-ea59f266_0
2025-10-02T09:29:10.213969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:10.214011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554080014295282:4289]
2025-10-02T09:29:10.214128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|694fb161-f9e26625-ab20be8c-ea59f266_0 is DEAD
2025-10-02T09:29:10.214258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:10.214268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Write session will restart in 0.007910s
2025-10-02T09:29:10.214289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Write session: Do CDS request
2025-10-02T09:29:10.214295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:10.222690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:10.223253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.223403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:10.223421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-10-02T09:29:10.223560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.223590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:10.223600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:10.223608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:10.223992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-10-02T09:29:10.224020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:10.224030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:10.224031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:10.224036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554080014295419:4509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:10.224170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:10.224319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:10.224327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:10.224334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:10.224374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:10.224397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554079938775115:4033]
2025-10-02T09:29:10.224527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554080014295419:4509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:10.224769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:10.225017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:10.225063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:10.225290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:10.225330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.225334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.225335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.225336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.225337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.225337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.225338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.225338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.225339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.225339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.225340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.225340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.225344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.225350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.225352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.225354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.225356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.225358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.225360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.225362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.225364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.225366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.225370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.225373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.225379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.225385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.225390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.225395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.225399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.225404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.225408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.225412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.225416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.225421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.225425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.225441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.225450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.225454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.225460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.225465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.225469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.225476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.225478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.225482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.225487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.225492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.225499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.225503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.225536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:10.226235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554080014295419:4509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:10.231812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554080014295419:4509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:10.231826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554080014295419:4509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:10.231830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554080014295419:4509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:10.231836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:10.233636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:10.235596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:10.235613Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:10.235616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:10.235619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:10.235626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [2:7556554079938775115:4033]
2025-10-02T09:29:10.235638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:10.235654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:10.235661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.235663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.235665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.235679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:10.235689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:10.235699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:10.235754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.235760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.235762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.235765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:10.235767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:10.235827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:10.235834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.235846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.235859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.235877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:10.235899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295458:4509], now have 1 active actors on pipe
2025-10-02T09:29:10.235903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295294:2446], now have 1 active actors on pipe
2025-10-02T09:29:10.235909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.235911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.235913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.235925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:10.235940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:10.235940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:10.235942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:10.235943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:10.235956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:10.235959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:10.235948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 337
2025-10-02T09:29:10.235988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.235998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:10.236002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:10.236012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.236016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.236057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:10.236070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 337
2025-10-02T09:29:10.236067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.236073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.236075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:10.236084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.236092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:10.236105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.236231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.236238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.236248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.236330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 36 sessionId: src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0
2025-10-02T09:29:10.236623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694fb161-f9e26625-ab20be8c-ea59f266_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:10.239322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Write session: try to update token
2025-10-02T09:29:10.239338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:10.246097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:10.246114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.246116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:10.246118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:10.246127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.246131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.246134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554079938775110:4033]
2025-10-02T09:29:10.246159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:10.246163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.246164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:10.246169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:10.246174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:10.246177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:10.246275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:10.251844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:10.254215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:10.314026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554080014295465:4289]
2025-10-02T09:29:10.314279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7556554080014295465:4289]
2025-10-02T09:29:10.373143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:10.373456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.373465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.373479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295465:4289], now have 1 active actors on pipe
2025-10-02T09:29:10.373679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:10.373674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:10.373667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:10.373697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:10.373712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554080014295465:4289]
2025-10-02T09:29:10.373760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0
2025-10-02T09:29:10.373941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0 is DEAD
2025-10-02T09:29:10.374081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:10.374091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Write session will restart in 0.006348s
2025-10-02T09:29:10.374114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Write session: Do CDS request
2025-10-02T09:29:10.374120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:10.381284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.381398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:10.381412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-10-02T09:29:10.381523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.381552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:10.381560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:10.381563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:10.381962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-10-02T09:29:10.381997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:10.382006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:10.382008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:10.382014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554080014295575:4513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:10.382443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554080014295575:4513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:10.383836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:10.384097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554080014295575:4513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:10.385332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:10.385478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:10.385486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:10.385493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:10.385527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:10.385551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554079938775293:4035]
2025-10-02T09:29:10.385927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:10.386140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:10.386178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:10.386181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554080014295575:4513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:10.386196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554080014295575:4513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:10.386209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554080014295575:4513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:10.386215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:10.386423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:10.386459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.386463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.386464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.386464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.386465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.386465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.386466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.386466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.386467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.386467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.386468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.386468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.386472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.386478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.386480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.386483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.386485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.386489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.386491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.386493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.386495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.386497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.386499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.386503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.386507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.386511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.386513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.386516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.386519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.386521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.386524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.386526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.386529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.386531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.386534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.386536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.386539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.386541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.386543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.386545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.386548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.386550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.386553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.386555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.386558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.386561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.386564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.386582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:10.394611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:10.396257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:10.396273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:10.396274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:10.396276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:10.396280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [2:7556554079938775293:4035]
2025-10-02T09:29:10.396291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:10.396302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:10.396304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.396306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.396307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.396321Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:10.396328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:10.396334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:10.396382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.396387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.396389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.396391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:10.396393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:10.396446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:10.396453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.396464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.396472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.396484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:10.396502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.396508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.396510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.396515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:10.396522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:10.396527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:10.396530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:10.396531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:10.396540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:10.396548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:10.396557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295644:4513], now have 1 active actors on pipe
2025-10-02T09:29:10.396560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295469:2446], now have 1 active actors on pipe
2025-10-02T09:29:10.396586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.396597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:10.396614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:10.396601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 338
2025-10-02T09:29:10.396608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 338
2025-10-02T09:29:10.396649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.396657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.396681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54eee766-7203d74-9f337149-1e948218_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:10.396690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.396694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.396696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:10.396703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.396712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:10.396726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.396877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.396884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.396895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.396971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 36 sessionId: src_id|54eee766-7203d74-9f337149-1e948218_0
2025-10-02T09:29:10.397296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fc0e49-6449f7e6-1b128b19-8a74cc95_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54eee766-7203d74-9f337149-1e948218_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:10.399689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Write session: try to update token
2025-10-02T09:29:10.399701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:10.406327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:10.406339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.406350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.406384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:10.406384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:10.406527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:10.406648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.406779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.406902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.407056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:10.407095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:10.411298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|54eee766-7203d74-9f337149-1e948218_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:10.413755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:10.413946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.413961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.413984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:10.414048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:10.417260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:10.417275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.417277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:10.417279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:10.417287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.417290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.417293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554079938775287:4035]
2025-10-02T09:29:10.417324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:10.417326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:10.417330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:10.417330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.417331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:10.417332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:10.417447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:10.473783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554080014295653:4289]
2025-10-02T09:29:10.474050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7556554080014295653:4289]
2025-10-02T09:29:10.544064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:10.554183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.554204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.554330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.554389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.554440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.554493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.554579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.554588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.554642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.554690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.554879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.555073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.555189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.555195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.555249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.555299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.555352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.555403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.555440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.555445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.555498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.555587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.555638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.555698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.555785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.555790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.555847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.555908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.555961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.556012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.556050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.556055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.556110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.556162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.556212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.556262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.556300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.556305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.556733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.556923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.556986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.557045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.557084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.557089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.557144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.557191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.557243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.557291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.557327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.557332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.557384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.557432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.557481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.557531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.557581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.557586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.557645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:10.557696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:10.557747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:10.557807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:10.557844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:10.557849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:10.557887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295653:4289], now have 1 active actors on pipe
2025-10-02T09:29:10.558094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554080014295653:4289]
2025-10-02T09:29:10.558124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:10.558195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:10.558208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:10.558230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|54eee766-7203d74-9f337149-1e948218_0
2025-10-02T09:29:10.558379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|54eee766-7203d74-9f337149-1e948218_0 is DEAD
2025-10-02T09:29:10.558534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:10.558542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Write session will restart in 0.008331s
2025-10-02T09:29:10.558557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Write session: Do CDS request
2025-10-02T09:29:10.558561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:10.558732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:10.568318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.568506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:10.568519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-10-02T09:29:10.568552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:10.568655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.568684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:10.568693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:10.568697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:10.569063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-10-02T09:29:10.569092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:10.569099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:10.569100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:10.569105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554080014295783:4518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:10.569562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554080014295783:4518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:10.570014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:10.570149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:10.570157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:10.570165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:10.570203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:10.570237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554079938775459:4038]
2025-10-02T09:29:10.570783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:10.571009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:10.571043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:10.571326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:10.571367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.571373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.571373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.571374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.571375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.571376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.571377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.571378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.571379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.571380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.571381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.571382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.571386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.571394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.571398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.571402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.571405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.571409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.571413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.571416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.571419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.571426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.571431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.571438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.571443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.571453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.571462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.571470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.571476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.571480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.571485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.571490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.571494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.571503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.571507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.571515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.571523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.571530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.571515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554080014295783:4518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:10.571534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.571541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.571550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.571556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.571563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.571571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.571579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.571584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.571591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.571596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.571632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:10.576747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554080014295783:4518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:10.576758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554080014295783:4518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:10.576760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554080014295783:4518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:10.576765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:10.579633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:10.581279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:10.581290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:10.581291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:10.581294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:10.581300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [2:7556554079938775459:4038]
2025-10-02T09:29:10.581309Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:10.581320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:10.581322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.581323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.581325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.581335Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:10.581337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:10.581342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:10.581407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.581414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.581415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.581417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:10.581419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:10.581461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:10.581470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.581477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.581482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.581491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:10.581501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.581503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.581504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.581509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:10.581518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295656:2446], now have 1 active actors on pipe
2025-10-02T09:29:10.581519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:10.581521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:10.581523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:10.581526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295822:4518], now have 1 active actors on pipe
2025-10-02T09:29:10.581529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:10.581537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:10.581538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:10.581561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.581569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:10.581575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:10.581588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 339
2025-10-02T09:29:10.581602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 339
2025-10-02T09:29:10.581689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.581698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.581719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|954eb38d-e6d1282c-24197f14-97ba2776_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:10.581728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.581731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.581733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:10.581744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.581755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:10.581769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.581892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.581900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.581913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.581982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 36 sessionId: src_id|954eb38d-e6d1282c-24197f14-97ba2776_0
2025-10-02T09:29:10.582319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eee766-7203d74-9f337149-1e948218_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|954eb38d-e6d1282c-24197f14-97ba2776_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:10.585087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Write session: try to update token
2025-10-02T09:29:10.585103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:10.593359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:10.593373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.593380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.593409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:10.593421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:10.593854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:10.594249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.594666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.595102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.595630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:10.595663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:10.600284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:10.600297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.600299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:10.600301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:10.600309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.600312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.600316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554079938775453:4038]
2025-10-02T09:29:10.600345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:10.600355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.600357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:10.600357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:10.600363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:10.600366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:10.600478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:10.602748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|954eb38d-e6d1282c-24197f14-97ba2776_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:10.605043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:10.658100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554080014295829:4289]
2025-10-02T09:29:10.658347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7556554080014295829:4289]
2025-10-02T09:29:10.731426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:10.731771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.731782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.731798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295829:4289], now have 1 active actors on pipe
2025-10-02T09:29:10.732002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:10.732021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554080014295829:4289]
2025-10-02T09:29:10.732041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:10.732044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:10.732101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: error at write: Disconnected sessionId: src_id|954eb38d-e6d1282c-24197f14-97ba2776_0
2025-10-02T09:29:10.732182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:10.732415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:10.732426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Write session will restart in 0.008543s
2025-10-02T09:29:10.732445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Write session: Do CDS request
2025-10-02T09:29:10.732453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:10.732291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|954eb38d-e6d1282c-24197f14-97ba2776_0 is DEAD
2025-10-02T09:29:10.742373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.742506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:10.742525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-10-02T09:29:10.742660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.742698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:10.742706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:10.742709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:10.743082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-10-02T09:29:10.743127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:10.743132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:10.743134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:10.743139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554080014295963:4523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:10.743599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554080014295963:4523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:10.743895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:10.745627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554080014295963:4523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:10.745720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:10.745887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:10.745896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:10.745905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:10.745951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:10.745993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554079938775628:4040]
2025-10-02T09:29:10.746589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:10.746952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:10.747014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:10.747368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:10.747417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.747425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.747426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.747427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.747428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.747429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.747430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.747431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.747432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.747433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.747435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.747435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.747440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.747451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.747455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.747459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.747462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.747467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.747470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.747474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.747478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.747482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.747486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.747490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.747495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.747502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.747507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.747512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.747517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.747521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.747526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.747531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.747535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.747541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.747545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.747550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.747555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.747560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.747564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.747568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.747571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.747573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.747576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.747579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.747581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.747584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.747586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.747589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.747618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:10.748358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554080014295963:4523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:10.748372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554080014295963:4523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:10.748375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554080014295963:4523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:10.748382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:10.756415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:10.758106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:10.758120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:10.758123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:10.758127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:10.758132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [2:7556554079938775628:4040]
2025-10-02T09:29:10.758146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:10.758161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:10.758164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.758166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.758168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.758181Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:10.758187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:10.758193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:10.758246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.758254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.758256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.758259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:10.758262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:10.758337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:10.758344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.758355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.758373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.758392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:10.758413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014295836:2446], now have 1 active actors on pipe
2025-10-02T09:29:10.758419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014296004:4523], now have 1 active actors on pipe
2025-10-02T09:29:10.758425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.758426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.758428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.758440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:10.758452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:10.758455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:10.758456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:10.758458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:10.758468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:10.758471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:10.758499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.758509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:10.758525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:10.758501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 340
2025-10-02T09:29:10.758504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 340
2025-10-02T09:29:10.758542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.758550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.758571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:10.758579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.758582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.758585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:10.758593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.758601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:10.758615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.758758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.758763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.758774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.758837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0
2025-10-02T09:29:10.759148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954eb38d-e6d1282c-24197f14-97ba2776_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:10.761864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Write session: try to update token
2025-10-02T09:29:10.761879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:10.773567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:10.773585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.773593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.773635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:10.773650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:10.773804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:10.773939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.774070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.774205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:10.774370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:10.774401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:10.778792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:10.778811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.778813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:10.778815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:10.778824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.778828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.778832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554079938775623:4040]
2025-10-02T09:29:10.778867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:10.778874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.778875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:10.778876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:10.778881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:10.778886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:10.779009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:10.779487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:10.781935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:10.832152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554080014296014:4289]
2025-10-02T09:29:10.832433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7556554080014296014:4289]
2025-10-02T09:29:10.925377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:10.925697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.925705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.925724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014296014:4289], now have 1 active actors on pipe
2025-10-02T09:29:10.926049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:10.926537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:10.926587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:10.926651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0
2025-10-02T09:29:10.926825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0 is DEAD
2025-10-02T09:29:10.926991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:10.927002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Write session will restart in 0.008905s
2025-10-02T09:29:10.927023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Write session: Do CDS request
2025-10-02T09:29:10.927030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:10.926966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554080014296014:4289]
2025-10-02T09:29:10.937494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.938229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:10.938258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-10-02T09:29:10.938447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:10.938479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:10.938483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:10.938487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:10.938912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-10-02T09:29:10.938950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:10.938952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:10.938954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:10.938959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554080014296143:4527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:10.939464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554080014296143:4527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:10.941581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:10.942847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554080014296143:4527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:10.943340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:10.943506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:10.943514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:10.943522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:10.943560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:10.943594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554079938775798:4043]
2025-10-02T09:29:10.944161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:10.944712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:10.944765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:10.945102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:10.945163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.945169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.945170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.945170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.945172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.945172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.945173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.945174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.945175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.945176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.945177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.945178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.945183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.945193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.945197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.945200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.945204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.945207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.945211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.945214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.945218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.945222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.945225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.945228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.945234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.945240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:10.945245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.945250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:10.945254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.945258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:10.945261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.945266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:10.945270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.945274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:10.945278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.945282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:10.945286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.945290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:10.945294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.945298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:10.945302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.945306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:10.945310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.945314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.945318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.945323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.945326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.945330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.945361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:10.945511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554080014296143:4527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:10.945524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554080014296143:4527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:10.945528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554080014296143:4527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:10.945535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:10.954571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:10.956630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:10.956646Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:10.956648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:10.956652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:10.956658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [2:7556554079938775798:4043]
2025-10-02T09:29:10.956673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:10.956689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:10.956692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.956695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.956698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.956713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:10.956719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:10.956727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:10.956836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.956843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.956844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.956847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:10.956849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:10.956915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:10.956922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.956934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:10.956946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:10.956966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:10.956989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014296183:4527], now have 1 active actors on pipe
2025-10-02T09:29:10.956997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554080014296017:2446], now have 1 active actors on pipe
2025-10-02T09:29:10.957003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.957006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.957008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.957020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:10.957033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:10.957038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:10.957044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:10.957046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:10.957055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:10.957058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:10.957099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.957106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:10.957149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:10.957255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 341
2025-10-02T09:29:10.957286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 341
2025-10-02T09:29:10.957334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.957345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.957370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:10.957377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:10.957380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:10.957382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:10.957391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:10.957401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:10.957414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.957773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:10.957786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:10.957808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:10.958108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 36 sessionId: src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0
2025-10-02T09:29:10.958542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9562c-c52a1429-b8a47c23-68ff4c27_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:10.961679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Write session: try to update token
2025-10-02T09:29:10.961698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:10.969964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:10.969983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:10.969985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:10.969987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:10.969995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.969999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.970004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554079938775793:4043]
2025-10-02T09:29:10.970044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:10.970051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:10.970053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:10.970066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:10.970072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:10.970077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:10.970188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:10.983995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:10.986554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:11.027239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554084309263488:4289]
2025-10-02T09:29:11.027532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7556554084309263488:4289]
2025-10-02T09:29:11.110297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:11.110597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.110612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.110629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263488:4289], now have 1 active actors on pipe
2025-10-02T09:29:11.110850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:11.110868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:11.110881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554084309263488:4289]
2025-10-02T09:29:11.110898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:11.110927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: error at write: Disconnected sessionId: src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0
2025-10-02T09:29:11.111092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0 is DEAD
2025-10-02T09:29:11.111401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:11.113054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:11.113069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Write session will restart in 0.005458s
2025-10-02T09:29:11.113100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Write session: Do CDS request
2025-10-02T09:29:11.113107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:11.120170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.120601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:11.120621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-10-02T09:29:11.120768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.120828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:11.120833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:11.120837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:11.121423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-10-02T09:29:11.121464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:11.121466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:11.121467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:11.121472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554084309263507:4532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:11.121980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554084309263507:4532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:11.125756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554084309263507:4532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:11.129378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554084309263507:4532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:11.129393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554084309263507:4532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:11.129396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554084309263507:4532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:11.129402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:11.131428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:11.133411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:11.133588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:11.133592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:11.133601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:11.133650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:11.133683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554084233743266:4046]
2025-10-02T09:29:11.134304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:11.134607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:11.134654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:11.134965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:11.135023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.135024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.135026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.135027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.135028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.135030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.135031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.135032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.135033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.135034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.135035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.135036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.135041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.135051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.135056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.135060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.135064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.135069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.135073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.135077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.135081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.135085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.135089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.135095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.135101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.135120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.135126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.135132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.135136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.135141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.135145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.135150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.135154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.135159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.135164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.135169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.135174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.135179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.135182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.135188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.135192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.135198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.135202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.135209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.135213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.135219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.135223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.135228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.135266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:11.144547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:11.146375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:11.146399Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:11.146402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:11.146407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:11.146413Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [2:7556554084233743266:4046]
2025-10-02T09:29:11.146432Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:11.146450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:11.146453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.146457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.146460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.146479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:11.146492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:11.146499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:11.146558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.146566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.146568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.146571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:11.146574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:11.146639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:11.146648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.146662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.146676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.146699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:11.146724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263654:4532], now have 1 active actors on pipe
2025-10-02T09:29:11.146732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263492:2446], now have 1 active actors on pipe
2025-10-02T09:29:11.146737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.146740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.146741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.146755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:11.146777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 342
2025-10-02T09:29:11.146771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:11.146774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:11.146778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:11.146777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 342
2025-10-02T09:29:11.146780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:11.146790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:11.146793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:11.146827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.146830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:11.146831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:11.146848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.146852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.146895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:11.146906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.146910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.146912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:11.146921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.146931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:11.146952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.147149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.147156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.147170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.147241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0
2025-10-02T09:29:11.147598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31d1f07-66221fa3-731ff4df-70b7f3cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:11.150339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Write session: try to update token
2025-10-02T09:29:11.150352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:11.157518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:11.157537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.157539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:11.157541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:11.157550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.157554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.157557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554084233743261:4046]
2025-10-02T09:29:11.157591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:11.157596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.157601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:11.157611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:11.157625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:11.157628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:11.157736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:11.162774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:11.165025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:11.211042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554084309263691:4289]
2025-10-02T09:29:11.211201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7556554084309263691:4289]
2025-10-02T09:29:11.292695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:11.293174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.293189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.293221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263691:4289], now have 1 active actors on pipe
2025-10-02T09:29:11.293487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:11.293487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554084309263691:4289]
2025-10-02T09:29:11.293503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:11.293512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:11.293567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0
2025-10-02T09:29:11.293663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:11.293740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0 is DEAD
2025-10-02T09:29:11.293890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:11.293900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Write session will restart in 0.005846s
2025-10-02T09:29:11.293934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Write session: Do CDS request
2025-10-02T09:29:11.293941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:11.301276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.301396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:11.301412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-10-02T09:29:11.301766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.301792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:11.301799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:11.301802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:11.302216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-10-02T09:29:11.302249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:11.302255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:11.302257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:11.302262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554084309263773:4543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:11.302736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554084309263773:4543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:11.304432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554084309263773:4543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:11.304537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:11.306071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:11.306309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:11.306316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:11.306325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:11.306375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:11.306407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554084233743471:4060]
2025-10-02T09:29:11.306848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:11.306947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554084309263773:4543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:11.306959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554084309263773:4543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:11.306962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554084309263773:4543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:11.306968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:11.307101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:11.307168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:11.307483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:11.307532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.307537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.307538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.307539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.307539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.307541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.307542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.307543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.307544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.307545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.307546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.307547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.307552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.307562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.307566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.307570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.307574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.307577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.307581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.307584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.307588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.307592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.307596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.307599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.307605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.307612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.307616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.307621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.307625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.307630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.307634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.307639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.307643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.307648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.307652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.307656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.307661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.307666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.307670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.307674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.307681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.307689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.307695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.307700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.307708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.307713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.307717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.307725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.307756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:11.316418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:11.317934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:11.317950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:11.317952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:11.317956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:11.317961Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [2:7556554084233743471:4060]
2025-10-02T09:29:11.317972Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:11.317984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:11.317986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.317988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.317989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.318000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:11.318004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:11.318011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:11.318062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.318069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.318070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.318072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:11.318074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:11.318119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:11.318124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.318132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.318138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.318147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:11.318162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.318167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.318168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.318174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:11.318183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:11.318184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:11.318186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:11.318188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:11.318195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:11.318197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:11.318225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263861:4543], now have 1 active actors on pipe
2025-10-02T09:29:11.318233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263693:2446], now have 1 active actors on pipe
2025-10-02T09:29:11.318235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.318240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:11.318251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:11.318312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 343
2025-10-02T09:29:11.318312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 343
2025-10-02T09:29:11.318361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.318367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.318385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:11.318392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.318394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.318396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:11.318402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.318408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:11.318420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.318581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.318591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.318604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.318679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0
2025-10-02T09:29:11.318975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0bc772-497b3b27-ea962966-ec7c6b32_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:11.321452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Write session: try to update token
2025-10-02T09:29:11.321466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:11.328272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:11.328291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.328299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.328334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:11.328336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:11.328498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:11.328634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.328762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.328915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.329087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:11.329130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:11.334086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:11.336555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:11.336731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.336750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.338903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:11.338935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:11.338938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.338940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:11.338942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:11.338949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.338953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.338957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554084233743465:4060]
2025-10-02T09:29:11.338981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:11.338984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:11.338986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:11.338989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:11.338989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.338992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:11.339004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:11.339147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:11.393905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554084309263883:4289]
2025-10-02T09:29:11.394169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7556554084309263883:4289]
2025-10-02T09:29:11.483385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:11.491379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.491407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.491577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.491631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.491697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.491767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.491808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.491998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.492071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.492128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.492193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.492257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.492296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.492299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.492367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.492422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.492473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.492531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.492570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.492573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.492637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.492696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.492749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.492980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.493037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.493045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.493125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.493196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.493269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.493340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.493397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.493400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.493505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.493566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.493632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.493697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.493740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.493746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.493817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.493879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.493951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.494015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.494076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.494083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.494152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.494213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.494271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.494333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.494450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.494453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.494519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.494578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.494635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.494698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.494738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.494741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.494809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:11.494863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:11.494926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:11.494987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:11.495038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:11.495041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:11.495104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263883:4289], now have 1 active actors on pipe
2025-10-02T09:29:11.496087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:11.496088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:11.496106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:11.496130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0
2025-10-02T09:29:11.496237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0 is DEAD
2025-10-02T09:29:11.496476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:11.496511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554084309263883:4289]
2025-10-02T09:29:11.496951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:11.496962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Write session will restart in 0.008011s
2025-10-02T09:29:11.496981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Write session: Do CDS request
2025-10-02T09:29:11.496988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:11.506331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.506392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:11.506412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-10-02T09:29:11.509039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.509084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:11.509089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:11.509093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:11.513205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-10-02T09:29:11.513251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:11.513255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:11.513257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:11.513262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554084309263899:4552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:11.513775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554084309263899:4552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:11.516280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554084309263899:4552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:11.519412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554084309263899:4552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:11.519426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554084309263899:4552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:11.519430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554084309263899:4552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:11.519437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:11.530791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:11.532764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:11.532963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:11.532974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:11.532984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:11.533040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:11.533079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554084233743655:4063]
2025-10-02T09:29:11.533674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:11.534005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:11.534047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:11.534352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:11.534399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.534405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.534406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.534407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.534408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.534409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.534410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.534411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.534412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.534413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.534414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.534415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.534420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.534431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.534435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.534439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.534442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.534446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.534449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.534453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.534460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.534464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.534473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.534476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.534484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.534492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.534497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.534502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.534511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.534515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.534523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.534528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.534536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.534541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.534549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.534554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.534562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.534566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.534570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.534575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.534580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.534588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.534596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.534604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.534612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.534619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.534623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.534628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.534664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:11.543684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:11.545429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:11.545447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:11.545450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:11.545454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:11.545460Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [2:7556554084233743655:4063]
2025-10-02T09:29:11.545474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:11.545490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:11.545493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.545496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.545498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.545512Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:11.545517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:11.545523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:11.545584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.545592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.545594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.545597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:11.545601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:11.545663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:11.545670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.545682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.545698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.545717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:11.545740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263938:4552], now have 1 active actors on pipe
2025-10-02T09:29:11.545749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309263888:2446], now have 1 active actors on pipe
2025-10-02T09:29:11.545755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.545757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.545759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.545772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:11.545786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:11.545818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 344
2025-10-02T09:29:11.545800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:11.545802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:11.545807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:11.545810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:11.545810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:11.545843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.545846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:11.545848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:11.546008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 344
2025-10-02T09:29:11.546095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.546105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.546126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:11.546137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.546140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.546143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:11.546152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.546165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:11.546180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.546660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.546672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.546691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.546823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 36 sessionId: src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0
2025-10-02T09:29:11.549041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ee5aaa-97d7c485-80481233-741ffb2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:11.551770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Write session: try to update token
2025-10-02T09:29:11.551794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:11.562414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:11.562433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.562443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.562483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:11.562488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:11.562645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:11.562780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.562916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.563047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.563235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:11.563270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:11.573892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:11.576335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:11.577224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.577250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.577268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:11.577270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.577272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:11.577275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:11.577282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.577289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.577293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554084233743650:4063]
2025-10-02T09:29:11.577336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:11.577341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:11.577348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.577349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:11.577350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:11.577353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:11.577487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:11.596127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554084309264069:4289]
2025-10-02T09:29:11.596420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7556554084309264069:4289]
2025-10-02T09:29:11.733233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:11.733735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:11.733778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309264069:4289], now have 1 active actors on pipe
2025-10-02T09:29:11.734194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:11.734300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:11.734303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:11.734371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: error at write: Disconnected sessionId: src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0
2025-10-02T09:29:11.734509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0 is DEAD
2025-10-02T09:29:11.734640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554084309264069:4289]
2025-10-02T09:29:11.734653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:11.734879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:11.734886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Write session will restart in 0.007868s
2025-10-02T09:29:11.734906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Write session: Do CDS request
2025-10-02T09:29:11.734914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:11.744470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.744936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:11.744955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-10-02T09:29:11.745138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.745181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:11.745190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:11.745194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:11.745653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-10-02T09:29:11.745692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:11.745694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:11.745696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:11.745702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554084309264201:4557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:11.746244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554084309264201:4557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:11.747696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:11.748527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554084309264201:4557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:11.749641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:11.749798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:11.749810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:11.749820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:11.749860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:11.749896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554084233743829:4065]
2025-10-02T09:29:11.750460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:11.750697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:11.750734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:11.750807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554084309264201:4557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:11.750820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554084309264201:4557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:11.750823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554084309264201:4557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:11.750830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:11.751005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:11.751052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.751061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.751062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.751063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.751064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.751065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.751066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.751067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.751068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.751069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.751070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.751071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.751074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.751081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.751084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.751088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.751091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.751095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.751099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.751102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.751106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.751119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.751123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.751127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.751134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.751141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.751147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.751152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.751156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.751160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.751164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.751168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.751172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.751178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.751181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.751186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.751190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.751195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.751199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.751204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.751209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.751214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.751218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.751223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.751227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.751232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.751238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.751243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.751277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:11.760592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:11.762531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:11.762551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:11.762555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:11.762558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:11.762565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [2:7556554084233743829:4065]
2025-10-02T09:29:11.762581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:11.762598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:11.762601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.762604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.762606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.762620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:11.762625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:11.762637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:11.762704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.762712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.762714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.762717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:11.762719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:11.762791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:11.762800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.762814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.762824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.762844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:11.762864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309264247:4557], now have 1 active actors on pipe
2025-10-02T09:29:11.762867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309264078:2446], now have 1 active actors on pipe
2025-10-02T09:29:11.762873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.762875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.762878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.762887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:11.762902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:11.762902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:11.762905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:11.762915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:11.762916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:11.762918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:11.762995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 345
2025-10-02T09:29:11.763031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 345
2025-10-02T09:29:11.762951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.762963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:11.762972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:11.763098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.763103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.763139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|351b91fd-e68defe4-725f83d8-793077e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:11.763151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.763156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.763157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:11.763167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.763180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:11.763200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.763328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.763335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.763345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.763446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 36 sessionId: src_id|351b91fd-e68defe4-725f83d8-793077e7_0
2025-10-02T09:29:11.763863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf0d562-75cfc28-c19c095c-ac6c778_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|351b91fd-e68defe4-725f83d8-793077e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:11.767004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Write session: try to update token
2025-10-02T09:29:11.767027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:11.779767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:11.779786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.779788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:11.779790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:11.779798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.779803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.779807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554084233743824:4065]
2025-10-02T09:29:11.779844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:11.779851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.779853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:11.779867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:11.779876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:11.779880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:11.779991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:11.785548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|351b91fd-e68defe4-725f83d8-793077e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:11.788204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:11.837576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554084309264259:4289]
2025-10-02T09:29:11.838005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7556554084309264259:4289]
2025-10-02T09:29:11.926578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:11.926899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.926915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.926954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309264259:4289], now have 1 active actors on pipe
2025-10-02T09:29:11.927195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:11.927227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:11.927259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554084309264259:4289]
2025-10-02T09:29:11.927296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:11.927298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:11.927366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: error at write: Disconnected sessionId: src_id|351b91fd-e68defe4-725f83d8-793077e7_0
2025-10-02T09:29:11.927538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|351b91fd-e68defe4-725f83d8-793077e7_0 is DEAD
2025-10-02T09:29:11.928078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:11.928088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Write session will restart in 0.005567s
2025-10-02T09:29:11.928113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Write session: Do CDS request
2025-10-02T09:29:11.928119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:11.935444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:11.935464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-10-02T09:29:11.935537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.936110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:11.936149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:11.936169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:11.936177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:11.936641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-10-02T09:29:11.936681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:11.936683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:11.936685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:11.936689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554084309264271:4561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:11.937217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554084309264271:4561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:11.939412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554084309264271:4561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:11.943792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554084309264271:4561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:11.943809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554084309264271:4561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:11.943813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554084309264271:4561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:11.943820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:11.946260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:11.948529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:11.948736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:11.948748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:11.948760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:11.948841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:11.948884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554084233744005:4068]
2025-10-02T09:29:11.949456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:11.949941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:11.949996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:11.950296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:11.950366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.950367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.950368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.950369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.950370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.950372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.950373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.950374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.950375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.950376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.950377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.950378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.950383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.950394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.950398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.950401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.950405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.950409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.950412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.950415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.950418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.950422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.950425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.950429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.950437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.950445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:11.950450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.950455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:11.950460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.950465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:11.950470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.950475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:11.950480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.950485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:11.950490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.950495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:11.950500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.950504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:11.950509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.950514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:11.950518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.950523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:11.950527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.950531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.950535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.950539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.950545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.950550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.950584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:11.959498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:11.961380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:11.961397Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:11.961398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:11.961401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:11.961405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [2:7556554084233744005:4068]
2025-10-02T09:29:11.961415Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:11.961429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:11.961431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.961433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.961435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.961447Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:11.961452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:11.961458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:11.961509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.961514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.961516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.961518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:11.961520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:11.961564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:11.961569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.961576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:11.961582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:11.961590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:11.961602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.961604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.961606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.961610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:11.961620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:11.961624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:11.961627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:11.961629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:11.961633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:11.961635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:11.961661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.961667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:11.961670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:11.961674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309264402:4561], now have 1 active actors on pipe
2025-10-02T09:29:11.961676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554084309264262:2446], now have 1 active actors on pipe
2025-10-02T09:29:11.961753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 346
2025-10-02T09:29:11.961765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 346
2025-10-02T09:29:11.961834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.961849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.961886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:11.961897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:11.961905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:11.961907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:11.961930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:11.961945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:11.961961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.962136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.962145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.962177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:11.962276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0
2025-10-02T09:29:11.962605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b91fd-e68defe4-725f83d8-793077e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:11.965443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Write session: try to update token
2025-10-02T09:29:11.965463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:11.977617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:11.977639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.977648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.977693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:11.977714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:11.977867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:11.978014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.978148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.978286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:11.978502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:11.978548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:11.978604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:11.981069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:11.981324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:11.981343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:11.981372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:11.981487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:11.986397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:11.986419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:11.986422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:11.986424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:11.986433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.986440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.986444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554084233744000:4068]
2025-10-02T09:29:11.986476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:11.986477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:11.986481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:11.986482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:11.986484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:11.986484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:11.986608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:12.027190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554088604231739:4289]
2025-10-02T09:29:12.027477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7556554088604231739:4289]
2025-10-02T09:29:12.121329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:12.127642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.127665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.127807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.127857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.127911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.127962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.128015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.128025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.128082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.128134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.128194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.128257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.128298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.128303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.128357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.128411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.128467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.128526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.128565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.128569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.128622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.128676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.128733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.128792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.128845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.128852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.128908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.128959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.129014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.129072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.129111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.129116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.129170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.129227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.129281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.129338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.129380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.129385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.129441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.129488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.129547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.129600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.129640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.129644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.129696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.129752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.129804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.129854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.129929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.129934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.129984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.130029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.130077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.130125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.130160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.130165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.130216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.130267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.130317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.130367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.130405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.130410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.130448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604231739:4289], now have 1 active actors on pipe
2025-10-02T09:29:12.130719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:12.130737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:12.130742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:12.130765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: error at write: Disconnected sessionId: src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0
2025-10-02T09:29:12.130807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554088604231739:4289]
2025-10-02T09:29:12.130927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0 is DEAD
2025-10-02T09:29:12.131076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:12.131085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Write session will restart in 0.008687s
2025-10-02T09:29:12.131117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Write session: Do CDS request
2025-10-02T09:29:12.131123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:12.131274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:12.141284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.141369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:12.141387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-10-02T09:29:12.141515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.141546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:12.141551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:12.141554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:12.141929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-10-02T09:29:12.141961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:12.141962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:12.141963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:12.141967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554088604231876:4566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:12.142322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554088604231876:4566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:12.142346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:12.142790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:12.142926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:12.142935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:12.142944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:12.142989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:12.143030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554088528711476:4071]
2025-10-02T09:29:12.143531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:12.144498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:12.144551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:12.144773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554088604231876:4566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:12.144895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:12.144967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.144973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.144974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.144975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.144976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.144977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.144978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.144979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.144980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.144981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.144982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.144983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.144989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.144998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.145002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.145006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.145010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.145013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.145017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.145020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.145024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.145027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.145031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.145035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.145040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.145047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.145052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.145057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.145068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.145073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.145077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.145082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.145087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.145091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.145094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.145099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.145103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.145107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.145113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.145117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.145121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.145125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.145129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.145134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.145138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.145144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.145148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.145152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.145186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:12.149614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554088604231876:4566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:12.149630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554088604231876:4566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:12.149634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554088604231876:4566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:12.149641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:12.153419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:12.154984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:12.154996Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:12.154998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:12.155001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:12.155006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [2:7556554088528711476:4071]
2025-10-02T09:29:12.155015Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:12.155027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:12.155029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.155031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.155032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.155043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:12.155046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:12.155052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:12.155089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.155095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.155096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.155098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:12.155100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:12.155163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:12.155168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.155176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.155182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.155194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:12.155207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.155212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.155213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.155218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:12.155227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:12.155229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:12.155231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:12.155233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:12.155235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:12.155237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:12.155244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604231917:4566], now have 1 active actors on pipe
2025-10-02T09:29:12.155247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604231743:2446], now have 1 active actors on pipe
2025-10-02T09:29:12.155267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.155275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:12.155300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:12.155308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 347
2025-10-02T09:29:12.155320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 347
2025-10-02T09:29:12.155432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.155439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.155458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4191bf67-f2081d4-d56992dc-70261a13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:12.155466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.155471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.155472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:12.155479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.155485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:12.155494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.155804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.155816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.155833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.155923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 36 sessionId: src_id|4191bf67-f2081d4-d56992dc-70261a13_0
2025-10-02T09:29:12.156261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c67dd57-bdee5f8b-eb4492e-4904fcaa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4191bf67-f2081d4-d56992dc-70261a13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:12.159164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Write session: try to update token
2025-10-02T09:29:12.159182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:12.165262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:12.165277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:12.165279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:12.165280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:12.165285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.165289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.165292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554088528711470:4071]
2025-10-02T09:29:12.165319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:12.165325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.165327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:12.165352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:12.165358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:12.165361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:12.165446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:12.174356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|4191bf67-f2081d4-d56992dc-70261a13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:12.176767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:12.230942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554088604231938:4289]
2025-10-02T09:29:12.231176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7556554088604231938:4289]
2025-10-02T09:29:12.295077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:12.295440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.295453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.295469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604231938:4289], now have 1 active actors on pipe
2025-10-02T09:29:12.295644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:12.295707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:12.295716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:12.295721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:12.295750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554088604231938:4289]
2025-10-02T09:29:12.295784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: error at write: Disconnected sessionId: src_id|4191bf67-f2081d4-d56992dc-70261a13_0
2025-10-02T09:29:12.295951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|4191bf67-f2081d4-d56992dc-70261a13_0 is DEAD
2025-10-02T09:29:12.296233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:12.296243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Write session will restart in 0.007404s
2025-10-02T09:29:12.296267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Write session: Do CDS request
2025-10-02T09:29:12.296273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:12.304212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.304340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:12.304355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-10-02T09:29:12.304452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.304479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:12.304487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:12.304490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:12.304872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-10-02T09:29:12.304904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:12.304905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:12.304906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:12.304909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554088604232067:4577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:12.305269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554088604232067:4577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:12.306237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:12.306829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554088604232067:4577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:12.308226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:12.308377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:12.308385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:12.308394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:12.308442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:12.308472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554088528711686:4085]
2025-10-02T09:29:12.308790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554088604232067:4577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:12.308813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554088604232067:4577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:12.308815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554088604232067:4577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:12.308820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:12.308970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:12.309194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:12.309221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:12.309419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:12.309459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.309463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.309463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.309464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.309465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.309465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.309466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.309466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.309467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.309467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.309468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.309469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.309471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.309478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.309480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.309482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.309484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.309486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.309488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.309490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.309492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.309494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.309496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.309498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.309502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.309506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.309509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.309512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.309516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.309518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.309520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.309532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.309538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.309541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.309544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.309546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.309549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.309551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.309557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.309560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.309562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.309568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.309570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.309573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.309585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.309588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.309593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.309595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.309613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:12.317795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:12.319450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:12.319461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:12.319463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:12.319466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:12.319471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [2:7556554088528711686:4085]
2025-10-02T09:29:12.319482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:12.319496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:12.319498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.319500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.319501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.319510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:12.319514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:12.319519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:12.319558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.319566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.319567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.319569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:12.319571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:12.319616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:12.319621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.319629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.319634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.319643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:12.319658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.319663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.319665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.319670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:12.319678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:12.319681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:12.319684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:12.319686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:12.319686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:12.319688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:12.319714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232119:4577], now have 1 active actors on pipe
2025-10-02T09:29:12.319721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604231948:2446], now have 1 active actors on pipe
2025-10-02T09:29:12.319724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.319733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:12.319744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:12.319779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 348
2025-10-02T09:29:12.320017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 348
2025-10-02T09:29:12.320069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.320077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.320091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:12.320099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.320101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.320102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:12.320109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.320116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:12.320130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.320276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.320282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.320290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.320351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 36 sessionId: src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0
2025-10-02T09:29:12.320665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4191bf67-f2081d4-d56992dc-70261a13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:12.323133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Write session: try to update token
2025-10-02T09:29:12.323145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:12.329952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:12.329967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:12.329969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:12.329971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:12.329978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.329981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.329983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554088528711680:4085]
2025-10-02T09:29:12.330010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:12.330015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.330016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:12.330031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:12.330037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:12.330050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:12.330127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:12.334244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:12.336616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:12.395796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554088604232143:4289]
2025-10-02T09:29:12.396078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7556554088604232143:4289]
2025-10-02T09:29:12.456756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:12.457057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.457071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.457101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232143:4289], now have 1 active actors on pipe
2025-10-02T09:29:12.457317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:12.457312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:12.457325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:12.457326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:12.457357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554088604232143:4289]
2025-10-02T09:29:12.457370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: error at write: Disconnected sessionId: src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0
2025-10-02T09:29:12.457486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0 is DEAD
2025-10-02T09:29:12.457631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:12.457635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Write session will restart in 0.008668s
2025-10-02T09:29:12.457650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Write session: Do CDS request
2025-10-02T09:29:12.457654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:12.467217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:12.467272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.467494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:12.467510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-10-02T09:29:12.467602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.467628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:12.467636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:12.467640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:12.468017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-10-02T09:29:12.468051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:12.468056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:12.468057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:12.468062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554088604232281:4582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:12.468440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554088604232281:4582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:12.468811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:12.468932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:12.468938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:12.468943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:12.468975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:12.469006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554088528711872:4088]
2025-10-02T09:29:12.469482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:12.469749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:12.469787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:12.470051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554088604232281:4582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:12.470117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:12.470173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.470186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.470190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.470190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.470191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.470191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.470192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.470193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.470193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.470194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.470194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.470195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.470199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.470207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.470211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.470214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.470217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.470220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.470223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.470225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.470228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.470232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.470236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.470240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.470246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.470252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.470257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.470261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.470265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.470270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.470274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.470278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.470287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.470292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.470299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.470303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.470311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.470315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.470323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.470327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.470335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.470339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.470346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.470350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.470358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.470363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.470366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.470370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.470400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:12.475761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554088604232281:4582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:12.475771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554088604232281:4582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:12.475773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554088604232281:4582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:12.475779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:12.478417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:12.479863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:12.479875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:12.479877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:12.479880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:12.479884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [2:7556554088528711872:4088]
2025-10-02T09:29:12.479893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:12.479904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:12.479905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.479907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.479908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.479921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:12.479924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:12.479928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:12.479968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.479972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.479974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.479976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:12.479977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:12.480020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:12.480025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.480032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.480038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.480049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:12.480063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.480067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.480068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.480073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:12.480081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:12.480083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232144:2446], now have 1 active actors on pipe
2025-10-02T09:29:12.480085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232320:4582], now have 1 active actors on pipe
2025-10-02T09:29:12.480089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:12.480090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:12.480090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:12.480097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:12.480099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:12.480120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.480131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:12.480136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:12.480153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 349
2025-10-02T09:29:12.480168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 349
2025-10-02T09:29:12.480195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.480204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.480220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:12.480227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.480230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.480231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:12.480238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.480247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:12.480255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.480365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.480375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.480392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.480460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0
2025-10-02T09:29:12.480748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ac2db8-522261fb-8eed42e8-5bd017f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:12.483031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Write session: try to update token
2025-10-02T09:29:12.483045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:12.489660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:12.489679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:12.489686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.489722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:12.489723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:12.489871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:12.490002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:12.490127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:12.490260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:12.490458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:12.490496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:12.494864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:12.497222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:12.497387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.497404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.497436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:12.497519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:12.499035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:12.499054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:12.499056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:12.499058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:12.499065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.499071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.499075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554088528711867:4088]
2025-10-02T09:29:12.499104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:12.499115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:12.499117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.499119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:12.499120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:12.499124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:12.499240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:12.557605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554088604232328:4289]
2025-10-02T09:29:12.558072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7556554088604232328:4289]
2025-10-02T09:29:12.641787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:12.649734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.649766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.649934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.650004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.650067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.650135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.650180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.650185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.650257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.650318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.650382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.650451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.650779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.650784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.650865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.650923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.650986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.651052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.651091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.651097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.651184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.651244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.651304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.651371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.651412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.651415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.651489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.651555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.651624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.651688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.651730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.651735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.651802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.651861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.651930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.651992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.652040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.652043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.652116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.652178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.652246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.652305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.652345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.652348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.652416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.652474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.652537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.652598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.652641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.652644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.652711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.652771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.653064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.653139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.653178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.653181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.653249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:12.653306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:12.653366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:12.653431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:12.653471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:12.653473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:12.653546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232328:4289], now have 1 active actors on pipe
2025-10-02T09:29:12.655239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:12.655250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:12.655313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554088604232328:4289]
2025-10-02T09:29:12.655336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:12.655338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:12.655370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: error at write: Disconnected sessionId: src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0
2025-10-02T09:29:12.655627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0 is DEAD
2025-10-02T09:29:12.656643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:12.656654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Write session will restart in 0.006765s
2025-10-02T09:29:12.656676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Write session: Do CDS request
2025-10-02T09:29:12.656683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:12.664297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.665782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:12.665801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-10-02T09:29:12.665967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.665997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:12.666002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:12.666006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:12.666403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-10-02T09:29:12.666434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:12.666441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:12.666443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:12.666448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554088604232368:4586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:12.666877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554088604232368:4586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:12.670052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554088604232368:4586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:12.674039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554088604232368:4586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:12.674056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554088604232368:4586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:12.674059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554088604232368:4586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:12.674066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:12.681282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:12.684151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:12.684366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:12.684379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:12.684389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:12.684440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:12.684493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554088528712050:4090]
2025-10-02T09:29:12.685118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:12.686229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:12.686296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:12.686637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:12.686717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.686719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.686720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.686721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.686723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.686724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.686725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.686726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.686727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.686729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.686730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.686732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.686738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.686748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.686753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.686757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.686760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.686764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.686768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.686772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.686775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.686780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.686784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.686788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.686795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.686802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.686809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.686814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.686819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.686823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.686827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.686832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.686837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.686842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.686846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.686851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.686856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.686861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.686865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.686869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.686874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.686879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.686883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.686889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.686894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.686899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.686903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.686908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.686944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:12.696547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:12.698526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:12.698543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:12.698545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:12.698550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:12.698557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [2:7556554088528712050:4090]
2025-10-02T09:29:12.698573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:12.698590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:12.698593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.698596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.698598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.698613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:12.698618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:12.698624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:12.698714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.698724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.698727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.698730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:12.698732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:12.698808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:12.698816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.698830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.698847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.698865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:12.698886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.698892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.698895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.698908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:12.698926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:12.698945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:12.698952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:12.698987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.698994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:12.699189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:12.699199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:12.699201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:12.699206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:12.699534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232499:4586], now have 1 active actors on pipe
2025-10-02T09:29:12.699546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232330:2446], now have 1 active actors on pipe
2025-10-02T09:29:12.705241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 350
2025-10-02T09:29:12.705264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 350
2025-10-02T09:29:12.705574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.705595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.705629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:12.705640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.705645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.705648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:12.705661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.705676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:12.705695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.712864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.712884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.712919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.713103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0
2025-10-02T09:29:12.713440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a76cbea-20b5e4c7-bba41f50-f26bea21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:12.716002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Write session: try to update token
2025-10-02T09:29:12.716021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:12.721989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:12.722012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:12.722015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:12.722017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:12.722026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.722030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.722034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554088528712044:4090]
2025-10-02T09:29:12.722074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:12.722081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.722083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:12.722221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:12.722958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:12.722964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:12.722968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:12.738656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:12.741289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:12.754759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554088604232520:4289]
2025-10-02T09:29:12.755327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7556554088604232520:4289]
2025-10-02T09:29:12.868827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:12.869260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.869274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.869290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232520:4289], now have 1 active actors on pipe
2025-10-02T09:29:12.869552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:12.869570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:12.869554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:12.869641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: error at write: Disconnected sessionId: src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0
2025-10-02T09:29:12.869960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:12.869971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Write session will restart in 0.009725s
2025-10-02T09:29:12.869808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0 is DEAD
2025-10-02T09:29:12.869847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:12.869991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Write session: Do CDS request
2025-10-02T09:29:12.869885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554088604232520:4289]
2025-10-02T09:29:12.869998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:12.881331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.881442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:12.881460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-10-02T09:29:12.881638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:12.881673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:12.881679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:12.881683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:12.882104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-10-02T09:29:12.882142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:12.882152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:12.882154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:12.882159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554088604232664:4591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:12.882453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:12.882678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554088604232664:4591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:12.884494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:12.884581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554088604232664:4591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:12.884660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:12.884670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:12.884679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:12.884727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:12.884756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554088528712228:4093]
2025-10-02T09:29:12.885299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:12.885638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:12.885681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:12.886020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:12.886074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.886080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.886081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.886082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.886084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.886085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.886086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.886087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.886088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.886089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.886090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.886091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.886096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.886106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.886110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.886114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.886117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.886121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.886125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.886129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.886133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.886137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.886140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.886144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.886149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.886157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:12.886166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.886171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:12.886181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.886186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:12.886194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.886199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:12.886204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.886213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:12.886217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.886226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:12.886230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.886235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:12.886239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.886243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:12.886247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.886253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:12.886262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.886267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.886275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.886280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.886283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.886292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.886324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:12.887027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554088604232664:4591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:12.887043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554088604232664:4591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:12.887047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554088604232664:4591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:12.887053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:12.894893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:12.896418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:12.896435Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:12.896437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:12.896441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:12.896447Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [2:7556554088528712228:4093]
2025-10-02T09:29:12.896460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:12.896475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:12.896478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.896481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.896483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.896498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:12.896503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:12.896509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:12.896563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.896570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.896572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.896575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:12.896578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:12.896635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:12.896644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.896656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:12.896667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:12.896683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:12.896704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232703:4591], now have 1 active actors on pipe
2025-10-02T09:29:12.896717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232526:2446], now have 1 active actors on pipe
2025-10-02T09:29:12.896723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.896725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.896729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.896739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:12.896750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:12.896757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:12.896760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:12.896761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:12.896762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:12.896765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:12.896772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 351
2025-10-02T09:29:12.896792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.896791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 351
2025-10-02T09:29:12.896813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:12.896817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:12.896840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.896850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.896878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:12.896887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:12.896891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:12.896892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:12.896901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:12.896913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:12.896936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.897110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:12.897119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:12.897137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:12.897211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 36 sessionId: src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0
2025-10-02T09:29:12.897586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fef629-3d9757d8-49c66c78-69fa9304_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:12.900713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Write session: try to update token
2025-10-02T09:29:12.900733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:12.907906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:12.907929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:12.907931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:12.907933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:12.907940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.907944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.907948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554088528712223:4093]
2025-10-02T09:29:12.907985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:12.907988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:12.907991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:12.907993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:12.907995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:12.907999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:12.908126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:12.915341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:12.917993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:12.970303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554088604232710:4289]
2025-10-02T09:29:12.970611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7556554088604232710:4289]
2025-10-02T09:29:13.055885Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:13.056293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.056309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.056325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554088604232710:4289], now have 1 active actors on pipe
2025-10-02T09:29:13.056527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:13.056568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554088604232710:4289]
2025-10-02T09:29:13.056587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:13.056590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:13.056651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: error at write: Disconnected sessionId: src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0
2025-10-02T09:29:13.056673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:13.056845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0 is DEAD
2025-10-02T09:29:13.057069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:13.057086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Write session will restart in 0.008659s
2025-10-02T09:29:13.057117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Write session: Do CDS request
2025-10-02T09:29:13.057124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:13.067394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.067440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:13.067457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-10-02T09:29:13.067641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.067677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:13.067682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:13.067686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:13.068040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-10-02T09:29:13.068073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:13.068080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:13.068081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:13.068086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554092899200149:4595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:13.068509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:13.068569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554092899200149:4595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:13.070173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:13.070260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554092899200149:4595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:13.070404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:13.070412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:13.070420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:13.070471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:13.070507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554092823679702:4095]
2025-10-02T09:29:13.071041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:13.071397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:13.071451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:13.071764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:13.071818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.071824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.071825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.071826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.071827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.071829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.071830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.071831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.071832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.071833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.071834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.071835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.071841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.071852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.071856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.071859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.071863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.071867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.071871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.071874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.071878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.071884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.071888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.071891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.071897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.071906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.071911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.071921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.071927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.071935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.071940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.071945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.071950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.071955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.071959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.071964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.071973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.071978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.071982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.071987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.071991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.072000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.072006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.072010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.072015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.072022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.072026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.072031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.072068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:13.072861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554092899200149:4595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:13.072881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554092899200149:4595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:13.072884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554092899200149:4595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:13.072891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:13.081446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:13.083064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:13.083087Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:13.083090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:13.083094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:13.083101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [2:7556554092823679702:4095]
2025-10-02T09:29:13.083127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:13.083145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:13.083149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.083152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.083154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.083168Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:13.083174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:13.083189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:13.083251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.083253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.083255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.083259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:13.083261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:13.083356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:13.083865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 352
2025-10-02T09:29:13.083360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.083374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.083875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 352
2025-10-02T09:29:13.083385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.083401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:13.083418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.083421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.083423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.083431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:13.083446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:13.083461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:13.083464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:13.083498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.083501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:13.083594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:13.083597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:13.083598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:13.083604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:13.083787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200009:2446], now have 1 active actors on pipe
2025-10-02T09:29:13.083792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200188:4595], now have 1 active actors on pipe
2025-10-02T09:29:13.084051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.084061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.084085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f557b541-705b38fe-86180e76-aff2c7c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:13.084096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.084100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.084102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:13.084112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.084122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:13.084137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.084343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.084351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.084364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.084477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 36 sessionId: src_id|f557b541-705b38fe-86180e76-aff2c7c5_0
2025-10-02T09:29:13.084854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23cb6edb-ec032f9b-f39da0eb-7f40fb4a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f557b541-705b38fe-86180e76-aff2c7c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:13.087901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Write session: try to update token
2025-10-02T09:29:13.087920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:13.094334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:13.094354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.094362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.094395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:13.094403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:13.094560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:13.094693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.094819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.094950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.095139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:13.095178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:13.107216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:13.107240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.107242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:13.107244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:13.107255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.107259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.107262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554092823679697:4095]
2025-10-02T09:29:13.107295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:13.107303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.107305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:13.107306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:13.107312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:13.107316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:13.104795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|f557b541-705b38fe-86180e76-aff2c7c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:13.107284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:13.107434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:13.154591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554092899200197:4289]
2025-10-02T09:29:13.154910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7556554092899200197:4289]
2025-10-02T09:29:13.257897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554092899200197:4289]
2025-10-02T09:29:13.257930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:13.257963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:13.257965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:13.258025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: error at write: Disconnected sessionId: src_id|f557b541-705b38fe-86180e76-aff2c7c5_0
2025-10-02T09:29:13.258209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|f557b541-705b38fe-86180e76-aff2c7c5_0 is DEAD
2025-10-02T09:29:13.257289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:13.257603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.257612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.257629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200197:4289], now have 1 active actors on pipe
2025-10-02T09:29:13.257860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:13.260933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:13.260950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Write session will restart in 0.009760s
2025-10-02T09:29:13.260981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Write session: Do CDS request
2025-10-02T09:29:13.260989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:13.272475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.272649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:13.272675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-10-02T09:29:13.272866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.272901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:13.272908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:13.272912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:13.273845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-10-02T09:29:13.273889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:13.273892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:13.273894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:13.273902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554092899200267:4606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:13.274712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554092899200267:4606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:13.278782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554092899200267:4606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:13.281915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:13.282167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554092899200267:4606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:13.282187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554092899200267:4606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:13.282190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554092899200267:4606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:13.282197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:13.284473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:13.284676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:13.284689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:13.284701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:13.284757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:13.284798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554092823679898:4100]
2025-10-02T09:29:13.285375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:13.285855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:13.285913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:13.286242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:13.286319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.286326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.286328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.286329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.286330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.286331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.286332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.286333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.286334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.286335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.286336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.286338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.286343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.286361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.286365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.286369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.286373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.286377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.286381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.286384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.286387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.286391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.286395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.286399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.286404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.286412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.286417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.286422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.286426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.286431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.286434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.286439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.286443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.286448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.286452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.286463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.286467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.286472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.286477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.286487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.286491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.286496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.286504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.286508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.286513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.286518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.286521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.286530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.286563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:13.295811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:13.297459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:13.297476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:13.297477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:13.297481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:13.297486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [2:7556554092823679898:4100]
2025-10-02T09:29:13.297497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:13.297513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:13.297516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.297519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.297520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.297533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:13.297541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:13.297547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:13.297606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.297613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.297614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.297618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:13.297620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:13.297680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:13.297690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.297704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.297714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.297730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:13.297751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200387:4606], now have 1 active actors on pipe
2025-10-02T09:29:13.297758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200213:2446], now have 1 active actors on pipe
2025-10-02T09:29:13.297764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.297766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.297768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.297779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:13.297792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:13.297792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:13.297795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:13.297806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:13.297810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:13.297812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:13.297842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.297856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:13.297890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:13.297853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 353
2025-10-02T09:29:13.297854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 353
2025-10-02T09:29:13.298023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.298034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.298059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53ea09d6-9efee495-cf025de7-fcc71233_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:13.298073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.298077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.298079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:13.298087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.298095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:13.298107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.298307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.298316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.298329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.298424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 36 sessionId: src_id|53ea09d6-9efee495-cf025de7-fcc71233_0
2025-10-02T09:29:13.298805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f557b541-705b38fe-86180e76-aff2c7c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53ea09d6-9efee495-cf025de7-fcc71233_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:13.302063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Write session: try to update token
2025-10-02T09:29:13.302086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:13.309013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:13.309032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.309033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:13.309034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:13.309040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.309042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.309045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554092823679892:4100]
2025-10-02T09:29:13.309075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:13.309079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.309080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:13.309092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:13.309098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:13.309103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:13.309239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:13.318841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|53ea09d6-9efee495-cf025de7-fcc71233_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:13.321649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:13.357877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554092899200409:4289]
2025-10-02T09:29:13.358213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7556554092899200409:4289]
2025-10-02T09:29:13.439040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:13.439843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.439861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.439880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200409:4289], now have 1 active actors on pipe
2025-10-02T09:29:13.440042Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:13.440125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554092899200409:4289]
2025-10-02T09:29:13.440131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:13.440149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:13.440186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53ea09d6-9efee495-cf025de7-fcc71233_0
2025-10-02T09:29:13.440336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|53ea09d6-9efee495-cf025de7-fcc71233_0 is DEAD
2025-10-02T09:29:13.440521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:13.440545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Write session will restart in 0.006662s
2025-10-02T09:29:13.440575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Write session: Do CDS request
2025-10-02T09:29:13.440582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:13.448323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.448428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:13.448450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-10-02T09:29:13.448588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.448622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:13.448631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:13.448635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:13.449047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-10-02T09:29:13.449087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:13.449094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:13.449095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:13.449100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554092899200529:4612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:13.449601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554092899200529:4612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:13.451008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:13.451677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554092899200529:4612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:13.452825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:13.452990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:13.453002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:13.453011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:13.453061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:13.453098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554092823680113:4113]
2025-10-02T09:29:13.453623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:13.453875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:13.453906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:13.454170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:13.454236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.454244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.454245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.454246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.454247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.454248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.454249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.454249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.454250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.454251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.454253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.454253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.454257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.454264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.454266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.454269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.454270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.454272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.454274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.454276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.454278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.454281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.454283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.454285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.454289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.454293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.454297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.454300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.454302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.454305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.454307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.454310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.454313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.454317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.454321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.454325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.454329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.454334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.454338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.454343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.454347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.454351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.454355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.454360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.454363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.454368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.454372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.454376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.454406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:13.454412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554092899200529:4612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:13.454424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554092899200529:4612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:13.454426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554092899200529:4612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:13.454431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:13.462470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:13.463998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:13.464012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:13.464013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:13.464016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:13.464020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [2:7556554092823680113:4113]
2025-10-02T09:29:13.464028Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:13.464041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:13.464043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.464045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.464046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.464057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:13.464061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:13.464066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:13.464104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.464110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.464111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.464115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:13.464117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:13.464162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:13.464167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.464174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.464180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.464188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:13.464205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200423:2446], now have 1 active actors on pipe
2025-10-02T09:29:13.464211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200602:4612], now have 1 active actors on pipe
2025-10-02T09:29:13.464215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.464216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.464217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.464226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:13.464238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:13.464246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:13.464251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:13.464257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:13.464267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:13.464268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:13.464271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.464273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:13.464279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:13.464306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 354
2025-10-02T09:29:13.464341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 354
2025-10-02T09:29:13.464404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.464413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.464433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f9a303-e81f49e5-92859158-e24a02e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:13.464442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.464449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.464451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:13.464458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.464470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:13.464479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.464659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.464664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.464672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.464763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f9a303-e81f49e5-92859158-e24a02e1_0
2025-10-02T09:29:13.465165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ea09d6-9efee495-cf025de7-fcc71233_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f9a303-e81f49e5-92859158-e24a02e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:13.468125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Write session: try to update token
2025-10-02T09:29:13.468141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:13.474111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:13.474127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.474134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.474161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:13.474168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:13.474309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:13.474430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.474543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.474652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.474811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:13.474838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:13.483113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|5f9a303-e81f49e5-92859158-e24a02e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:13.483732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:13.483752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.483754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:13.483756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:13.483765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.483768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.483772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554092823680107:4113]
2025-10-02T09:29:13.483814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:13.483820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.483821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:13.483823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:13.483826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:13.483831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:13.483938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:13.485769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:13.540180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554092899200613:4289]
2025-10-02T09:29:13.540436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7556554092899200613:4289]
2025-10-02T09:29:13.612850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:13.613352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.613362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.613375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200613:4289], now have 1 active actors on pipe
2025-10-02T09:29:13.613533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:13.613570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:13.613589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:13.613591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:13.613629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554092899200613:4289]
2025-10-02T09:29:13.613646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: error at write: Disconnected sessionId: src_id|5f9a303-e81f49e5-92859158-e24a02e1_0
2025-10-02T09:29:13.613814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|5f9a303-e81f49e5-92859158-e24a02e1_0 is DEAD
2025-10-02T09:29:13.613955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:13.613966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Write session will restart in 0.006971s
2025-10-02T09:29:13.613988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Write session: Do CDS request
2025-10-02T09:29:13.613994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:13.622304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.622374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:13.622391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-10-02T09:29:13.622484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.622507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:13.622516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:13.622520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:13.622889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-10-02T09:29:13.622923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:13.622928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:13.622930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:13.622934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554092899200755:4616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:13.623428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554092899200755:4616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:13.623742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:13.625208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554092899200755:4616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:13.625339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:13.625484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:13.625492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:13.625500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:13.625541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:13.625572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554092823680295:4115]
2025-10-02T09:29:13.626088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:13.626351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:13.626390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:13.626629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:13.626693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.626699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.626700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.626701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.626702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.626703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.626704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.626705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.626706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.626708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.626709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.626710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.626714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.626724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.626728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.626731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.626739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.626743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.626746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.626749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.626751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.626753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.626755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.626757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.626761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.626766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.626769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.626772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.626775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.626778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.626780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.626783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.626786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.626788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.626791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.626793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.626795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.626798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.626800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.626803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.626805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.626808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.626810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.626812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.626815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.626817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.626819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.626822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.626840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:13.627316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554092899200755:4616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:13.627332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554092899200755:4616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:13.627335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554092899200755:4616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:13.627342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:13.635326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:13.636906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:13.636920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:13.636923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:13.636927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:13.636933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [2:7556554092823680295:4115]
2025-10-02T09:29:13.636945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:13.636961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:13.636963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.636966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.636967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.636979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:13.636984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:13.636991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:13.637164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.637176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.637178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.637181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:13.637184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:13.637241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:13.637250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.637262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.637274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.637291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:13.637309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200797:4616], now have 1 active actors on pipe
2025-10-02T09:29:13.637319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200614:2446], now have 1 active actors on pipe
2025-10-02T09:29:13.637324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.637327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.637329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.637342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:13.637359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:13.637377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:13.637384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:13.637383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:13.637386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:13.637389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:13.637412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.637424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:13.637400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 355
2025-10-02T09:29:13.637422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 355
2025-10-02T09:29:13.637435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:13.637467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.637475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.637497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:13.637507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.637511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.637513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:13.637521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.637533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:13.637550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.637717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.637726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.637740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.637829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0
2025-10-02T09:29:13.638118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9a303-e81f49e5-92859158-e24a02e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:13.640872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Write session: try to update token
2025-10-02T09:29:13.640888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:13.647482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:13.647507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.647516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.647554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:13.647556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:13.647740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:13.647896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.648018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.648156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.648394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:13.648438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:13.653221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:13.655527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:13.655736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.655751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.655778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:13.655876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:13.656939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:13.656952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.656955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:13.656957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:13.656965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.656968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.656972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554092823680289:4115]
2025-10-02T09:29:13.657003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:13.657008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.657010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:13.657012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:13.657017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:13.657021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:13.657131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:13.713701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554092899200805:4289]
2025-10-02T09:29:13.713903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7556554092899200805:4289]
2025-10-02T09:29:13.788629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:13.795706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.795729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.795877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.795935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.795991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.796058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.796101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.796109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.796170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.796225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.796284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.796347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.796387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.796392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.796452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.796518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.796584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.796642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.796682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.796687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.796743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.796826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.796895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.796951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.796993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.796998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.797061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.797123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.797183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.797248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.797294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.797301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.797370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.797456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.797518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.797584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.797639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.797642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.797707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.797770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.797843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.797900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.797947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.797954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.798021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.798081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.798159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.798226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.798269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.798276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.798336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.798394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.798450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.798515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.798560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.798567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.798626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.798680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.798735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.798799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.798843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.798850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.798897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200805:4289], now have 1 active actors on pipe
2025-10-02T09:29:13.799231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554092899200805:4289]
2025-10-02T09:29:13.799268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:13.799267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:13.799272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:13.799309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0
2025-10-02T09:29:13.799522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0 is DEAD
2025-10-02T09:29:13.799672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:13.799680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Write session will restart in 0.009603s
2025-10-02T09:29:13.799705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Write session: Do CDS request
2025-10-02T09:29:13.799711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:13.799978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:13.810316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.810383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:13.810402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-10-02T09:29:13.810569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:13.810613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:13.810625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:13.810629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:13.811044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-10-02T09:29:13.811083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:13.811085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:13.811086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:13.811091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554092899200953:4621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:13.811615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554092899200953:4621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:13.814185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:13.814401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554092899200953:4621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:13.816390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:13.816609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:13.816621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:13.816632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:13.816682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554092899200953:4621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:13.816696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554092899200953:4621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:13.816700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554092899200953:4621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:13.816706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:13.816716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:13.816755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554092823680481:4117]
2025-10-02T09:29:13.817363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:13.817656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:13.817706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:13.818017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:13.818085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.818092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.818094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.818095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.818096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.818097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.818098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.818099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.818100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.818101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.818102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.818104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.818109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.818120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.818123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.818127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.818130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.818134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.818137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.818141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.818144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.818149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.818152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.818156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.818163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.818170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:13.818177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.818182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:13.818191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.818196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:13.818205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.818211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:13.818219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.818223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:13.818232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.818237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:13.818241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.818251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:13.818254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.818263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:13.818267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.818272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:13.818280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.818285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.818294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.818299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.818308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.818313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.818351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:13.826843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:13.828578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:13.828601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:13.828604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:13.828608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:13.828615Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [2:7556554092823680481:4117]
2025-10-02T09:29:13.828628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:13.828647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:13.828655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.828658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.828660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.828675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:13.828687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:13.828698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:13.828761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.828769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.828772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.828775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:13.828777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:13.828860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:13.828868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.828881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:13.828897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:13.828919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:13.828941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200994:4621], now have 1 active actors on pipe
2025-10-02T09:29:13.828949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899200815:2446], now have 1 active actors on pipe
2025-10-02T09:29:13.828955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.828957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.828959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.828973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:13.828990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:13.828996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:13.829000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:13.829002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:13.829008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:13.829012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:13.829045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.829059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:13.829024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 356
2025-10-02T09:29:13.829037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 356
2025-10-02T09:29:13.829080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:13.829116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.829124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.829145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:13.829155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:13.829161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:13.829162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:13.829171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:13.829179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:13.829198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.829327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.829336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.829349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:13.829422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0
2025-10-02T09:29:13.829786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e6d05cd-ed12bf0e-39cc790-aeed706d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:13.832294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Write session: try to update token
2025-10-02T09:29:13.832310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:13.839157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:13.839174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.839182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.839221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:13.839222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:13.839388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:13.839524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.839661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.839794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:13.839980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:13.840017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:13.845176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:13.847622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:13.847840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.847861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.847895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:13.847986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:13.849000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:13.849019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:13.849021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:13.849023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:13.849031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.849035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.849039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554092823680476:4117]
2025-10-02T09:29:13.849071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:13.849078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:13.849080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:13.849085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:13.849091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:13.849094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:13.849231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:13.899539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554092899201006:4289]
2025-10-02T09:29:13.899899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7556554092899201006:4289]
2025-10-02T09:29:13.983386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:13.991434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:13.991468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:13.991638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.991710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.991778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.991844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.991892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.991903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.991984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.992050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.992114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.992182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.992234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.992243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.992315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.992370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.992434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.992496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.992541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.992549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.992613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.992671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.992727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.992783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.992846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.992853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.992931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.993002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.993080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.993144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.993187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.993192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.993262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.993324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.993387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.993453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.993499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.993506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.993570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.993632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.993702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.993771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.993838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.993845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.993913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.993975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.994038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.994100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.994146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.994154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.994216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.994275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.994337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.994398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.994436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.994442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.994530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:13.994586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:13.994641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:13.994697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:13.994754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:13.994761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:13.994828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899201006:4289], now have 1 active actors on pipe
2025-10-02T09:29:13.995512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:13.995524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Write session will restart in 0.007352s
2025-10-02T09:29:13.995547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Write session: Do CDS request
2025-10-02T09:29:13.995553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:13.995124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:13.995143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:13.995169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: error at write: Disconnected sessionId: src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0
2025-10-02T09:29:13.995174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554092899201006:4289]
2025-10-02T09:29:13.995200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:13.995354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0 is DEAD
2025-10-02T09:29:13.995963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:14.004329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.004460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:14.004478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-10-02T09:29:14.004604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.004647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:14.004652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:14.004656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:14.005081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-10-02T09:29:14.005112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:14.005120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:14.005121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:14.005129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554097194168366:4625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:14.005633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554097194168366:4625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:14.008060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554097194168366:4625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:14.009152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:14.011056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:14.011253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:14.011262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:14.011271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:14.011319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:14.011359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554097118647961:4120]
2025-10-02T09:29:14.011434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554097194168366:4625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:14.011449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554097194168366:4625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:14.011452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554097194168366:4625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:14.011459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:14.011842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:14.012156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:14.012214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:14.012529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:14.012589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.012594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.012595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.012596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.012597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.012598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.012599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.012600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.012601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.012602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.012603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.012604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.012608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.012619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.012623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.012626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.012630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.012633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.012637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.012640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.012646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.012650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.012654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.012659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.012666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.012677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.012683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.012690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.012694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.012700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.012706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.012711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.012715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.012720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.012724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.012728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.012735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.012739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.012743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.012748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.012751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.012756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.012764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.012768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.012773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.012777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.012782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.012789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.012838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:14.021952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:14.023628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:14.023651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:14.023654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:14.023657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:14.023664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [2:7556554097118647961:4120]
2025-10-02T09:29:14.023680Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:14.023699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:14.023707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.023710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.023713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.023730Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:14.023735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:14.023746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:14.023805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.023813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.023816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.023819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:14.023821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:14.023915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:14.023924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.023950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.023961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.023978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:14.024016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168483:4625], now have 1 active actors on pipe
2025-10-02T09:29:14.024023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554092899201010:2446], now have 1 active actors on pipe
2025-10-02T09:29:14.024029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.024031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.024033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.024044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:14.024054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:14.024056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:14.024058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:14.024061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:14.024069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:14.024072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:14.024064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 357
2025-10-02T09:29:14.024105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.024114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:14.024116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:14.024173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 357
2025-10-02T09:29:14.024275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.024291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.024315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:14.024327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.024331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.024334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:14.024344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.024355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:14.024375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.024650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.024663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.024683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.024813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 36 sessionId: src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0
2025-10-02T09:29:14.025175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f7d76b-2c775fbe-9be92de6-b429433c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:14.027781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Write session: try to update token
2025-10-02T09:29:14.027799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:14.035896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:14.035916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.035919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:14.035922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:14.035929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.035934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.035938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554097118647956:4120]
2025-10-02T09:29:14.035975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:14.035980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.035983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:14.035983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:14.035988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:14.035992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:14.036122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:14.042666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:14.045237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:14.095166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554097194168495:4289]
2025-10-02T09:29:14.095466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7556554097194168495:4289]
2025-10-02T09:29:14.187229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:14.187666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.187681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.187704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168495:4289], now have 1 active actors on pipe
2025-10-02T09:29:14.187913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:14.187920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:14.187934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:14.187974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0
2025-10-02T09:29:14.187978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554097194168495:4289]
2025-10-02T09:29:14.187997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:14.188119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0 is DEAD
2025-10-02T09:29:14.188281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:14.188291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Write session will restart in 0.006163s
2025-10-02T09:29:14.188310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Write session: Do CDS request
2025-10-02T09:29:14.188314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:14.195463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.195577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:14.195592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-10-02T09:29:14.195695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.195722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:14.195730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:14.195733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:14.196115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-10-02T09:29:14.196153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:14.196154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:14.196156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:14.196160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554097194168542:4630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:14.196636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554097194168542:4630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:14.199138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554097194168542:4630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:14.200439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:14.202099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:14.202256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:14.202265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:14.202274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:14.202316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:14.202350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554097118648148:4123]
2025-10-02T09:29:14.202422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554097194168542:4630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:14.202438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554097194168542:4630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:14.202441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554097194168542:4630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:14.202450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:14.202923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:14.203156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:14.203191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:14.203477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:14.203523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.203529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.203530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.203531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.203532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.203533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.203534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.203535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.203536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.203537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.203538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.203540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.203545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.203555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.203562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.203566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.203570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.203573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.203577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.203581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.203584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.203589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.203593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.203596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.203602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.203609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.203614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.203620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.203629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.203634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.203638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.203643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.203648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.203653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.203657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.203662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.203667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.203672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.203682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.203687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.203693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.203702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.203706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.203715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.203720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.203729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.203732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.203742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.203777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:14.212754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:14.214256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:14.214272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:14.214274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:14.214277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:14.214282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [2:7556554097118648148:4123]
2025-10-02T09:29:14.214296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:14.214310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:14.214312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.214314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.214315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.214328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:14.214331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:14.214337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:14.214383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.214390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.214392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.214394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:14.214396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:14.214475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:14.214486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.214497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.214503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.214512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:14.214526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168499:2446], now have 1 active actors on pipe
2025-10-02T09:29:14.214532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168681:4630], now have 1 active actors on pipe
2025-10-02T09:29:14.214536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.214538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.214539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.214548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:14.214558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:14.214570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:14.214570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:14.214573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:14.214575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:14.214576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:14.214603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.214609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:14.214628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:14.214634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.214638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.214595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 358
2025-10-02T09:29:14.214662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:14.214674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.214677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.214670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 358
2025-10-02T09:29:14.214679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:14.214687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.214700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:14.214719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.214873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.214878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.214887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.214998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0
2025-10-02T09:29:14.215354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6223c121-46e5e0b8-7ee78bb9-63fd770a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:14.217972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Write session: try to update token
2025-10-02T09:29:14.217986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:14.230861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:14.231426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:14.231443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.231451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.231495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:14.231510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:14.231693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:14.231877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:14.232016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:14.232150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:14.232328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:14.232360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:14.233760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:14.233966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.233985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.234012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:14.234121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:14.235625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:14.235644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.235647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:14.235649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:14.235655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.235659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.235662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554097118648143:4123]
2025-10-02T09:29:14.235692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:14.235698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.235700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:14.235701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:14.235707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:14.235710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:14.235831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:14.288187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554097194168692:4289]
2025-10-02T09:29:14.288458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7556554097194168692:4289]
2025-10-02T09:29:14.384560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:14.391402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.391423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.391560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.391615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.391671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.391736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.391779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.391789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.391850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.391906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.391963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.392027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.392070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.392077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.392138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.392196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.392259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.392322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.392362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.392370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.392430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.392488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.392549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.392611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.392652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.392658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.392721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.392778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.392853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.392911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.392954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.392961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.393021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.393081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.393138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.393197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.393240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.393246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.393308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.393368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.393424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.393479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.393524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.393531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.393594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.393650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.393709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.393768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.393811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.393819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.393878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.393935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.393995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.394056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.394099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.394106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.394163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:14.394217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:14.394275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:14.394336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:14.394462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:14.394469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:14.394511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168692:4289], now have 1 active actors on pipe
2025-10-02T09:29:14.394730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:14.394745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:14.394749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:14.394772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: error at write: Disconnected sessionId: src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0
2025-10-02T09:29:14.394781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554097194168692:4289]
2025-10-02T09:29:14.394945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0 is DEAD
2025-10-02T09:29:14.395082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:14.395091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Write session will restart in 0.006062s
2025-10-02T09:29:14.395120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Write session: Do CDS request
2025-10-02T09:29:14.395125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:14.395488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:14.402323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.402434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:14.402453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-10-02T09:29:14.402557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.402587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:14.402595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:14.402599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:14.403088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-10-02T09:29:14.403139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:14.403145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:14.403147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:14.403152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554097194168787:4642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:14.403665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554097194168787:4642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:14.406307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554097194168787:4642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:14.407312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:14.409295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:14.409480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:14.409488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:14.409498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:14.409542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:14.409578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554097118648382:4138]
2025-10-02T09:29:14.409673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554097194168787:4642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:14.409688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554097194168787:4642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:14.409691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554097194168787:4642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:14.409701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:14.410110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:14.410338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:14.410372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:14.410581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:14.410619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.410623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.410624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.410624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.410625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.410626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.410627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.410627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.410628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.410628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.410629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.410629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.410633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.410640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.410642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.410645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.410647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.410649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.410651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.410653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.410655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.410658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.410660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.410662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.410665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.410669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.410673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.410676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.410679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.410682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.410684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.410687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.410690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.410693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.410695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.410698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.410701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.410704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.410706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.410709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.410712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.410715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.410719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.410724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.410728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.410732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.410736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.410741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.410763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:14.419605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:14.421308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:14.421327Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:14.421330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:14.421335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:14.421342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [2:7556554097118648382:4138]
2025-10-02T09:29:14.421357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:14.421374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:14.421377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.421380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.421383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.421397Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:14.421407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:14.421416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:14.421481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.421488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.421490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.421493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:14.421495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:14.421561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:14.421568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.421581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.421595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.421614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:14.421633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168910:4642], now have 1 active actors on pipe
2025-10-02T09:29:14.421640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168731:2446], now have 1 active actors on pipe
2025-10-02T09:29:14.421646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.421648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.421650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.421666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:14.421729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 359
2025-10-02T09:29:14.421740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 359
2025-10-02T09:29:14.421683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:14.421692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:14.421696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:14.421699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:14.421704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:14.421707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:14.421741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.421748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:14.421767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:14.421975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.421987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.422014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:14.422025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.422049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.422055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:14.422066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.422080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:14.422099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.422238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.422248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.422261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.422386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0
2025-10-02T09:29:14.422759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0ac4f7-ffc9719c-5d584ce1-aab82640_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:14.425252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Write session: try to update token
2025-10-02T09:29:14.425267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:14.432993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:14.433011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.433014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:14.433016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:14.433024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.433028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.433031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554097118648377:4138]
2025-10-02T09:29:14.433071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:14.433078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.433077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:14.433081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:14.433084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:14.433088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:14.433211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:14.438115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:14.440609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:14.495041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554097194168921:4289]
2025-10-02T09:29:14.495304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7556554097194168921:4289]
2025-10-02T09:29:14.576574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:14.577132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.577145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.577174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168921:4289], now have 1 active actors on pipe
2025-10-02T09:29:14.577338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:14.577387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:14.577407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:14.577418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554097194168921:4289]
2025-10-02T09:29:14.577464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: error at write: Disconnected sessionId: src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0
2025-10-02T09:29:14.577632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0 is DEAD
2025-10-02T09:29:14.577794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:14.577841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:14.577855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Write session will restart in 0.007447s
2025-10-02T09:29:14.577888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Write session: Do CDS request
2025-10-02T09:29:14.577904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:14.586301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.586400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:14.586417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-10-02T09:29:14.586529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.586576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:14.586585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:14.586589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:14.586948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-10-02T09:29:14.586979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:14.586986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:14.586988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:14.586993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554097194169025:4646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:14.587488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554097194169025:4646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:14.589271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:14.589582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554097194169025:4646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:14.591510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:14.591677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:14.591689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:14.591697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:14.591735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:14.591770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554097118648570:4140]
2025-10-02T09:29:14.591974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554097194169025:4646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:14.591997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554097194169025:4646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:14.592000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554097194169025:4646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:14.592009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:14.592321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:14.592617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:14.592669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:14.593006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:14.593066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.593072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.593073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.593074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.593075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.593076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.593077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.593079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.593080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.593081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.593082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.593083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.593087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.593098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.593101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.593105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.593109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.593112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.593116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.593119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.593123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.593127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.593130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.593134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.593140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.593148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.593153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.593159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.593163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.593168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.593172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.593177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.593181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.593186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.593190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.593196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.593201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.593208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.593216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.593221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.593225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.593231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.593234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.593242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.593246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.593255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.593259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.593267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.593301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:14.601580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:14.603150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:14.603168Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:14.603171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:14.603174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:14.603181Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [2:7556554097118648570:4140]
2025-10-02T09:29:14.603196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:14.603211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:14.603214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.603217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.603219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.603234Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:14.603239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:14.603246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:14.603300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.603309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.603311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.603314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:14.603317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:14.603403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:14.603413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.603425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.603438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.603454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:14.603477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194168924:2446], now have 1 active actors on pipe
2025-10-02T09:29:14.603486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169107:4646], now have 1 active actors on pipe
2025-10-02T09:29:14.603492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.603495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.603497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.603507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:14.603521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:14.603526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:14.603529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:14.603532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:14.603498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 360
2025-10-02T09:29:14.603542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:14.603547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:14.603552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 360
2025-10-02T09:29:14.603582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.603594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:14.603599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:14.603611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.603619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.603665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:14.603677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.603683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.603685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:14.603693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.603707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:14.603727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.603901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.603908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.603919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.604005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 36 sessionId: src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0
2025-10-02T09:29:14.604328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22a6e-6d18c4f2-d12ec0d5-32682ed5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:14.606669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Write session: try to update token
2025-10-02T09:29:14.606682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:14.614007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:14.614025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.614027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:14.614029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:14.614036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.614040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.614045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554097118648564:4140]
2025-10-02T09:29:14.614077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:14.614083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.614084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:14.614088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:14.614090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:14.614091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:14.614207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:14.620385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:14.622746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:14.677793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554097194169118:4289]
2025-10-02T09:29:14.678037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7556554097194169118:4289]
2025-10-02T09:29:14.752121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:14.752637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.752650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.752663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169118:4289], now have 1 active actors on pipe
2025-10-02T09:29:14.752838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:14.752859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554097194169118:4289]
2025-10-02T09:29:14.752880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:14.752875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:14.752877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:14.752918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: error at write: Disconnected sessionId: src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0
2025-10-02T09:29:14.753049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0 is DEAD
2025-10-02T09:29:14.753175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:14.753183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Write session will restart in 0.009535s
2025-10-02T09:29:14.753214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Write session: Do CDS request
2025-10-02T09:29:14.753220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:14.762966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:14.764221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.764274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:14.764289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-10-02T09:29:14.764409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.764431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:14.764435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:14.764438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:14.764756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-10-02T09:29:14.764793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:14.764815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:14.764821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:14.764824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554097194169280:4651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:14.764857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:14.765001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:14.765009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:14.765017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:14.765056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:14.765088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554097118648758:4142]
2025-10-02T09:29:14.765176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554097194169280:4651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:14.765639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:14.765871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:14.765905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:14.766179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:14.766226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.766231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.766232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.766233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.766234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.766235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.766236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.766237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.766238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.766239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.766240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.766242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.766246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.766255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.766259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.766263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.766266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.766270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.766273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.766277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.766280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.766284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.766287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.766291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.766296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.766303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.766308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.766312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.766316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.766321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.766325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.766330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.766339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.766344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.766347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.766353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.766357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.766364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.766368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.766374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.766379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.766387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.766390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.766395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.766399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.766409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.766413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.766421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.766455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:14.766987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554097194169280:4651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:14.772590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554097194169280:4651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:14.772604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554097194169280:4651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:14.772606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554097194169280:4651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:14.772613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:14.774353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:14.775955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:14.775969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:14.775971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:14.775975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:14.775980Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [2:7556554097118648758:4142]
2025-10-02T09:29:14.775992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:14.776008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:14.776013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.776016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.776019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.776033Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:14.776042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:14.776050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:14.776102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.776111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.776113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.776115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:14.776118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:14.776179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:14.776186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.776206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.776222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.776235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:14.776257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169127:2446], now have 1 active actors on pipe
2025-10-02T09:29:14.776263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169318:4651], now have 1 active actors on pipe
2025-10-02T09:29:14.776268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.776271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.776273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.776284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:14.776295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:14.776297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:14.776299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:14.776300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:14.776310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:14.776315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:14.776293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 361
2025-10-02T09:29:14.776295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 361
2025-10-02T09:29:14.776340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.776351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:14.776356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:14.776364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.776368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.776407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f012c225-df5263de-f882873b-76a77cd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:14.776417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.776420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.776422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:14.776431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.776443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:14.776460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.776602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.776610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.776623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.776676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 36 sessionId: src_id|f012c225-df5263de-f882873b-76a77cd5_0
2025-10-02T09:29:14.776987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e2dbaa-cf5dbc85-c7dea2-6a4b0ba7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f012c225-df5263de-f882873b-76a77cd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:14.779246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Write session: try to update token
2025-10-02T09:29:14.779259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:14.786531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:14.786554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.786556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:14.786558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:14.786566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.786570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.786575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554097118648752:4142]
2025-10-02T09:29:14.786611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:14.786614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:14.786620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:14.786622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.786623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:14.786624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:14.786753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:14.790252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|f012c225-df5263de-f882873b-76a77cd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:14.792506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:14.852888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554097194169328:4289]
2025-10-02T09:29:14.853103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7556554097194169328:4289]
2025-10-02T09:29:14.917009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:14.917546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.917559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.917596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169328:4289], now have 1 active actors on pipe
2025-10-02T09:29:14.917784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:14.917826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:14.917843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:14.917847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:14.917891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554097194169328:4289]
2025-10-02T09:29:14.917901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: error at write: Disconnected sessionId: src_id|f012c225-df5263de-f882873b-76a77cd5_0
2025-10-02T09:29:14.918060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|f012c225-df5263de-f882873b-76a77cd5_0 is DEAD
2025-10-02T09:29:14.918216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:14.918224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Write session will restart in 0.005820s
2025-10-02T09:29:14.918247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Write session: Do CDS request
2025-10-02T09:29:14.918253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:14.925315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.925462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:14.925479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-10-02T09:29:14.925665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:14.925692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:14.925702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:14.925706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:14.926353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-10-02T09:29:14.926384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:14.926389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:14.926391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:14.926397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554097194169358:4655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:14.926909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554097194169358:4655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:14.929184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554097194169358:4655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:14.934181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554097194169358:4655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:14.934200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554097194169358:4655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:14.934204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554097194169358:4655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:14.934212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:14.936432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:14.939983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:14.940187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:14.940198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:14.940208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:14.940260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:14.940298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554097118648950:4145]
2025-10-02T09:29:14.940884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:14.941581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:14.941631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:14.941955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:14.942028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.942034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.942035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.942036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.942037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.942038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.942039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.942040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.942041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.942043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.942044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.942045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.942050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.942060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.942064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.942067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.942070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.942074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.942077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.942080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.942083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.942087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.942090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.942094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.942100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.942107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:14.942113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.942118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:14.942122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.942126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:14.942130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.942134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:14.942141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.942146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:14.942151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.942155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:14.942160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.942165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:14.942169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.942180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:14.942184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.942189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:14.942193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.942202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.942207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.942212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.942220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.942225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.942265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:14.952996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:14.954715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:14.955145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 362
2025-10-02T09:29:14.954737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:14.954741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:14.955145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 362
2025-10-02T09:29:14.954745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:14.954752Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [2:7556554097118648950:4145]
2025-10-02T09:29:14.954767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:14.954785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:14.954788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.954791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.954793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.954809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:14.954814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:14.954820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:14.954883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.954885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.954887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.954891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:14.954894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:14.954959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:14.954962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.954976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:14.954987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:14.955004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:14.955023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169512:4655], now have 1 active actors on pipe
2025-10-02T09:29:14.955030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.955033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.955034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.955050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:14.955061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554097194169330:2446], now have 1 active actors on pipe
2025-10-02T09:29:14.955065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:14.955069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:14.955072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:14.955077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:14.955082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:14.955085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:14.955130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.955138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:14.955167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:14.955227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.955234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.955270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:14.955279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:14.955284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:14.955286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:14.955296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:14.955307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:14.955322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.955579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.955592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.955608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:14.955737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 36 sessionId: src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0
2025-10-02T09:29:14.956154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f012c225-df5263de-f882873b-76a77cd5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:14.958837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Write session: try to update token
2025-10-02T09:29:14.958855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:14.970206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:14.970232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.970242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.970282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:14.970286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:14.970443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:14.970589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:14.970730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:14.970868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:14.971054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:14.971101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:14.972993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:14.975571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:14.975806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:14.975824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:14.975854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:14.975932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:14.980231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:14.980251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:14.980253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:14.980255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:14.980265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.980269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.980273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554097118648944:4145]
2025-10-02T09:29:14.980307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:14.980316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:14.980318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:14.980320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:14.980322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:14.980326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:14.980452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:15.018305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554101489136822:4289]
2025-10-02T09:29:15.018594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7556554101489136822:4289]
2025-10-02T09:29:15.127795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:15.136089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.136117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.136284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.136365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.136433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.136508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.136878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.136894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.136967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.137031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.137103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.137176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.137223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.137249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.137324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.137388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.137456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.137525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.137576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.137586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.137661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.137730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.137802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.137872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.137921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.137930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.138006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.138079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.138152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.138226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.138277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.138284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.138356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.138420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.138491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.138560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.138624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.138631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.138701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.138766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.138838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.138904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.138963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.138973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.139039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.139100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.139179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.139241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.139288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.139295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.139358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.139417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.139483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.140428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:15.140449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:15.140478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: error at write: Disconnected sessionId: src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0
2025-10-02T09:29:15.140692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0 is DEAD
2025-10-02T09:29:15.140766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:15.139550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.139602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.139605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.139670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.139728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.139787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.139846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.139889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.139892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.139969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489136822:4289], now have 1 active actors on pipe
2025-10-02T09:29:15.140669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:15.140824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554101489136822:4289]
2025-10-02T09:29:15.140874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:15.140884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Write session will restart in 0.008727s
2025-10-02T09:29:15.140915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Write session: Do CDS request
2025-10-02T09:29:15.140921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:15.150326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.150423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:15.150449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-10-02T09:29:15.150548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.150577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:15.150582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:15.150586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:15.151236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-10-02T09:29:15.151282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:15.151289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:15.151290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:15.151297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554101489136880:4660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:15.151846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554101489136880:4660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:15.156020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554101489136880:4660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:15.157787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:15.159963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:15.160134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:15.160147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:15.160157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:15.160187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554101489136880:4660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:15.160205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554101489136880:4660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:15.160208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554101489136880:4660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:15.160215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:15.160209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:15.160251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554101413616440:4148]
2025-10-02T09:29:15.160856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:15.161115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:15.161155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:15.161451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:15.161498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.161507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.161508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.161510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.161511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.161512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.161513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.161514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.161515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.161516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.161517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.161518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.161522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.161534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.161538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.161542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.161545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.161549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.161553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.161557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.161561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.161565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.161569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.161572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.161578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.161593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.161599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.161604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.161607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.161613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.161617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.161622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.161626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.161631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.161640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.161645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.161653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.161658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.161666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.161671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.161676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.161686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.161690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.161694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.161702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.161707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.161712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.161716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.161752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:15.170829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:15.172680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:15.172697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:15.172699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:15.172702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:15.172706Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [2:7556554101413616440:4148]
2025-10-02T09:29:15.172718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:15.172732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:15.172733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.172735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.172737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.172748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:15.172751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:15.172757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:15.172797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.172825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.172827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.172830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:15.172832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:15.172912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:15.172917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.172926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.172932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.172942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:15.172956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137014:4660], now have 1 active actors on pipe
2025-10-02T09:29:15.172967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489136827:2446], now have 1 active actors on pipe
2025-10-02T09:29:15.172972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.172974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.172975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.172985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:15.172995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:15.172997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:15.172998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:15.173000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:15.173011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:15.173013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:15.173047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.173057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:15.173112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:15.173074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 363
2025-10-02T09:29:15.173083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 363
2025-10-02T09:29:15.173296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.173311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.173336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:15.173348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.173354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.173356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:15.173365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.173377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:15.173395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.173540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.173554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.173584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.174794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0
2025-10-02T09:29:15.175148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5badbe42-c66d5bdc-8f4df760-f1862ad8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:15.177689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Write session: try to update token
2025-10-02T09:29:15.177706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:15.185059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:15.185082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.185086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:15.185089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:15.185099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.185105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.185111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554101413616435:4148]
2025-10-02T09:29:15.185162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:15.185171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:15.185178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:15.185181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:15.185181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.185185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:15.185376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:15.191457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:15.193885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:15.241034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554101489137039:4289]
2025-10-02T09:29:15.241329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7556554101489137039:4289]
2025-10-02T09:29:15.329814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:15.330101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.330114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.330146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137039:4289], now have 1 active actors on pipe
2025-10-02T09:29:15.330338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:15.330376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554101489137039:4289]
2025-10-02T09:29:15.330384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:15.330407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:15.330454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0
2025-10-02T09:29:15.330614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0 is DEAD
2025-10-02T09:29:15.330755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:15.330764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Write session will restart in 0.008883s
2025-10-02T09:29:15.330787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Write session: Do CDS request
2025-10-02T09:29:15.330792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:15.340348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.340461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:15.340475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-10-02T09:29:15.340634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.340668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:15.340678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:15.340682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:15.341134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-10-02T09:29:15.341176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:15.341184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:15.341185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:15.341191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554101489137191:4664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:15.341723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554101489137191:4664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:15.341912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:15.343767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554101489137191:4664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:15.343812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:15.344066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:15.344078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:15.344089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:15.344145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:15.344185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554101413616637:4150]
2025-10-02T09:29:15.344697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:15.344989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:15.345031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:15.345316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:15.345375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.345380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.345382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.345383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.345384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.345385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.345386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.345387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.345388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.345389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.345390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.345391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.345396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.345405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.345409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.345412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.345416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.345419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.345423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.345426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.345431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.345435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.345438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.345441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.345446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.345456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.345465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.345474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.345478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.345485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.345494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.345502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.345511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.345520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.345528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.345532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.345539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.345544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.345552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.345562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.345570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.345575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.345585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.345595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.345603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.345613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.345619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.345628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.345671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:15.350302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554101489137191:4664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:15.350319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554101489137191:4664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:15.350325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554101489137191:4664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:15.350333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:15.354151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:15.355964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:15.355982Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:15.355984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:15.355989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:15.355995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [2:7556554101413616637:4150]
2025-10-02T09:29:15.356006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:15.356020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:15.356022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.356025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.356027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.356040Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:15.356049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:15.356055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:15.356107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.356112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.356113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.356114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:15.356116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:15.356170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:15.356177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.356185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.356196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.356204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:15.356220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.356224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.356225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.356231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:15.356241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137244:4664], now have 1 active actors on pipe
2025-10-02T09:29:15.356242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:15.356246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:15.356248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:15.356249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:15.356257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:15.356259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:15.356262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137041:2446], now have 1 active actors on pipe
2025-10-02T09:29:15.356285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.356294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:15.356306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:15.356356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 364
2025-10-02T09:29:15.356402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 364
2025-10-02T09:29:15.356463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.356480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.356509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:15.356520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.356527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.356529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:15.356538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.356553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:15.356572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.356731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.356743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.356757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.356852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 36 sessionId: src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0
2025-10-02T09:29:15.357195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a08bd9e-5869a848-131a5265-adfcd0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:15.359722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Write session: try to update token
2025-10-02T09:29:15.359736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:15.366436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:15.366458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.366465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.366502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:15.366509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:15.366663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:15.366787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.366922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.367050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.367258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:15.367302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:15.372300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:15.374718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:15.374960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.374974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.374998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:15.375061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:15.375935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:15.375948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.375950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:15.375952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:15.375957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.375959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.375961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554101413616627:4150]
2025-10-02T09:29:15.375987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:15.375994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.375993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:15.375995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:15.375998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:15.376002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:15.376112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:15.430455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554101489137274:4289]
2025-10-02T09:29:15.430834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7556554101489137274:4289]
2025-10-02T09:29:15.501749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:15.507992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.508014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.508148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.508198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.508256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.508310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.508513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.508520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.508577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.508627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.508680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.508738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.508782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.508788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.508854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.508907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.508960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.509013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.509053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.509057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.509111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.509162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.509215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.509267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.509305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.509309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.509366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.509417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.509471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.509523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.509560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.509564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.509618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.509667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.509723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.509774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.509813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.509817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.509875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.509928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.509982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.510034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.510072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.510079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.510136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.510184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.510233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.510289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.510326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.510331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.510384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.510433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.510485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.510534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.510570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.510575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.510625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:15.510673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:15.510726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:15.510774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:15.510811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:15.510816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:15.510850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137274:4289], now have 1 active actors on pipe
2025-10-02T09:29:15.511064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:15.511086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:15.511091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:15.511122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: error at write: Disconnected sessionId: src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0
2025-10-02T09:29:15.511150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554101489137274:4289]
2025-10-02T09:29:15.511321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0 is DEAD
2025-10-02T09:29:15.511409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:15.511476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:15.511487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Write session will restart in 0.009530s
2025-10-02T09:29:15.511506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Write session: Do CDS request
2025-10-02T09:29:15.511512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:15.522322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.522408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:15.522425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-10-02T09:29:15.522531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.522560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:15.522568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:15.522572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:15.522796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:15.522932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-10-02T09:29:15.522970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:15.522974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:15.522976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:15.522982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554101489137429:4676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:15.523518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554101489137429:4676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:15.524760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:15.524924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:15.524933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:15.524943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:15.524993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:15.525033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554101413616873:4165]
2025-10-02T09:29:15.525595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:15.525835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:15.525877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:15.526030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554101489137429:4676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:15.526157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:15.526217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.526223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.526224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.526225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.526226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.526226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.526227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.526228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.526229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.526230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.526231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.526232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.526237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.526247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.526250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.526254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.526257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.526260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.526263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.526267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.526271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.526276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.526279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.526283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.526288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.526295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.526300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.526305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.526309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.526313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.526317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.526322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.526325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.526333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.526338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.526343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.526354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.526358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.526361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.526365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.526370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.526374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.526378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.526382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.526386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.526392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.526395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.526399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.526432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:15.532171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554101489137429:4676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:15.532189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554101489137429:4676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:15.532193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554101489137429:4676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:15.532201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:15.534982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:15.536698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:15.536720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:15.536722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:15.536725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:15.536730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [2:7556554101413616873:4165]
2025-10-02T09:29:15.536743Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:15.536758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:15.536766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.536769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.536771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.536785Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:15.536796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:15.536820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:15.536874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.536882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.536884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.536887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:15.536889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:15.536952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:15.536960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.536973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.536983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.536998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:15.537021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137468:4676], now have 1 active actors on pipe
2025-10-02T09:29:15.537028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137276:2446], now have 1 active actors on pipe
2025-10-02T09:29:15.537034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.537036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.537038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.537054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:15.537070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:15.537076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:15.537082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:15.537084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:15.537091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:15.537094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:15.537082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 365
2025-10-02T09:29:15.537084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 365
2025-10-02T09:29:15.537123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.537131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:15.537133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:15.537147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.537151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.537196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|438b5090-dcafdf44-d0c2199d-5604054c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:15.537208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.537211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.537213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:15.537224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.537232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:15.537258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.537521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.537533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.537550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.537638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 36 sessionId: src_id|438b5090-dcafdf44-d0c2199d-5604054c_0
2025-10-02T09:29:15.537970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d52c7-a900941b-70216d1b-d656b0fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|438b5090-dcafdf44-d0c2199d-5604054c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:15.540391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Write session: try to update token
2025-10-02T09:29:15.540406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:15.547945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:15.547958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.547959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:15.547961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:15.547966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.547970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.547972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554101413616868:4165]
2025-10-02T09:29:15.547996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:15.548001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.548002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:15.548028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:15.548049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:15.548054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:15.548109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:15.552145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|438b5090-dcafdf44-d0c2199d-5604054c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:15.554752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:15.611200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554101489137476:4289]
2025-10-02T09:29:15.611482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7556554101489137476:4289]
2025-10-02T09:29:15.679256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:15.679626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.679637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.679669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137476:4289], now have 1 active actors on pipe
2025-10-02T09:29:15.679870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:15.679885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:15.679902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:15.679908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:15.679949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554101489137476:4289]
2025-10-02T09:29:15.679950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: error at write: Disconnected sessionId: src_id|438b5090-dcafdf44-d0c2199d-5604054c_0
2025-10-02T09:29:15.680097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|438b5090-dcafdf44-d0c2199d-5604054c_0 is DEAD
2025-10-02T09:29:15.680242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:15.680252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Write session will restart in 0.007103s
2025-10-02T09:29:15.680275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Write session: Do CDS request
2025-10-02T09:29:15.680281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:15.688277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.688377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:15.688393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-10-02T09:29:15.688490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.688514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:15.688523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:15.688526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:15.688886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-10-02T09:29:15.688927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:15.688933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:15.688935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:15.688939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554101489137571:4680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:15.689398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554101489137571:4680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:15.691270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554101489137571:4680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:15.692141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:15.694016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:15.694183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:15.694197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:15.694206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:15.694253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:15.694292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554101413617067:4167]
2025-10-02T09:29:15.694349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554101489137571:4680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:15.694364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554101489137571:4680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:15.694367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554101489137571:4680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:15.694374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:15.694838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:15.695143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:15.695191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:15.695470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:15.695541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.695549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.695550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.695551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.695552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.695553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.695554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.695555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.695556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.695557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.695558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.695559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.695564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.695573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.695577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.695581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.695585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.695589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.695592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.695596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.695599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.695603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.695606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.695610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.695616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.695623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.695627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.695633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.695637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.695642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.695645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.695650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.695657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.695663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.695666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.695671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.695675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.695680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.695684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.695688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.695692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.695697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.695702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.695706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.695709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.695715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.695719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.695724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.695760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:15.706701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:15.708612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:15.708632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:15.708634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:15.708637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:15.708643Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [2:7556554101413617067:4167]
2025-10-02T09:29:15.708656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:15.708674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:15.708676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.708680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.708682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.708696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:15.708701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:15.708707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:15.708761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.708770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.708772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.708776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:15.708778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:15.708855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:15.708865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.708878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.708888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.708905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:15.708925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137477:2446], now have 1 active actors on pipe
2025-10-02T09:29:15.708933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137666:4680], now have 1 active actors on pipe
2025-10-02T09:29:15.708938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.708940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.708942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.708954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:15.708969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:15.708972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:15.708981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:15.708983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:15.708985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:15.708987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:15.709018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.709025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:15.709040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:15.709019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 366
2025-10-02T09:29:15.709019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 366
2025-10-02T09:29:15.709112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.709123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.709144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:15.709149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.709152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.709154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:15.709162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.709170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:15.709192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.709380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.709389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.709402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.709871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438b5090-dcafdf44-d0c2199d-5604054c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:15.712469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Write session: try to update token
2025-10-02T09:29:15.712488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:15.709507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 36 sessionId: src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0
2025-10-02T09:29:15.719880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:15.719903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.719912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.719952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:15.719971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:15.720120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:15.720272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.720429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.720580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.720865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:15.720919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:15.726394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:15.728922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:15.729814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.729842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.729859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:15.729862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.729864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:15.729866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:15.729874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.729878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.729881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554101413617061:4167]
2025-10-02T09:29:15.729928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:15.729933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:15.729939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:15.729940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.729942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:15.729943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:15.730080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:15.779648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554101489137685:4289]
2025-10-02T09:29:15.779925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7556554101489137685:4289]
2025-10-02T09:29:15.872736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:15.873124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:15.873163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137685:4289], now have 1 active actors on pipe
2025-10-02T09:29:15.873274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:15.873324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554101489137685:4289]
2025-10-02T09:29:15.873354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:15.873366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:15.873368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:15.873435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: error at write: Disconnected sessionId: src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0
2025-10-02T09:29:15.873626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0 is DEAD
2025-10-02T09:29:15.873713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:15.873733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Write session will restart in 0.007567s
2025-10-02T09:29:15.873755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Write session: Do CDS request
2025-10-02T09:29:15.873763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:15.882337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.882877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:15.882896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-10-02T09:29:15.883022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:15.883052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:15.883057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:15.883061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:15.883549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-10-02T09:29:15.883581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:15.883586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:15.883588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:15.883593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554101489137801:4685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:15.884093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554101489137801:4685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:15.885924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554101489137801:4685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:15.886733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:15.888618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:15.888789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554101489137801:4685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:15.888789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:15.888815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554101489137801:4685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:15.888798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:15.888819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554101489137801:4685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:15.888827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:15.888838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:15.888892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:15.888927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554101413617263:4170]
2025-10-02T09:29:15.889505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:15.889848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:15.889915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:15.890232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:15.890334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.890341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.890342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.890343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.890344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.890345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.890346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.890347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.890348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.890349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.890350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.890351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.890357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.890367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.890370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.890374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.890378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.890381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.890385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.890388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.890392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.890396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.890400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.890403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.890410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.890418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:15.890424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.890429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:15.890434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.890439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:15.890443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.890448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:15.890452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.890457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:15.890461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.890465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:15.890475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.890481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:15.890485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.890490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:15.890499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.890504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:15.890508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.890517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.890522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.890529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.890537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.890542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.890577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:15.901988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 367
2025-10-02T09:29:15.902016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 367
2025-10-02T09:29:15.902751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 36 sessionId: src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0
2025-10-02T09:29:15.903220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66d986c-8f917cd-a2e712c9-fa641c1f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:15.899640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:15.901567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:15.901572Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:15.901575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:15.901579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:15.901585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [2:7556554101413617263:4170]
2025-10-02T09:29:15.901599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:15.901616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:15.901619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.901622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.901624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.901638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:15.901643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:15.901650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:15.901708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.901710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.901712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.901716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:15.901718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:15.901816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:15.901818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.901831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:15.901842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:15.901858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:15.901874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.901877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.901878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.901886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:15.901899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137691:2446], now have 1 active actors on pipe
2025-10-02T09:29:15.901897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:15.901901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:15.901903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:15.901905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137881:4685], now have 1 active actors on pipe
2025-10-02T09:29:15.901910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:15.901924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:15.901926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:15.901959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.901969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:15.901975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:15.902129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.902133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.902154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:15.902160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:15.902164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:15.902165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:15.902175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:15.902184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:15.902196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.902628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.902632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.902645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:15.905895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Write session: try to update token
2025-10-02T09:29:15.905912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:15.916022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:15.916042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.916051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.916091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:15.916104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:15.916253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:15.916399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.916543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.916691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:15.916909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:15.916958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:15.921279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:15.923728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:15.923939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:15.923963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:15.923994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:15.924054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:15.926714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:15.926733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:15.926734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:15.926736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:15.926743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.926747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.926750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554101413617258:4170]
2025-10-02T09:29:15.926785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:15.926792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:15.926798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:15.926800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:15.926801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:15.926802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:15.926936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:15.973690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554101489137892:4289]
2025-10-02T09:29:15.973968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7556554101489137892:4289]
2025-10-02T09:29:16.063719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:16.070989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.071014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.071172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.071231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.071297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.071357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.071685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.071698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.071768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.071835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.071895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.071961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.072004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.072011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.072077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.072138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.072202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.072272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.072318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.072325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.072391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.072460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.072524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.072591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.072639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.072644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.072707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.072767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.072855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.072914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.072957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.072963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.073026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.073084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.073142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.073205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.073264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.073269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.073322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.073372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.073427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.073479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.073522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.073529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.073591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.073643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.073707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.073767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.073831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.073837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.073893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.073951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.074008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.074069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.074112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.074118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.074176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:16.074235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:16.074304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:16.074365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:16.074411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:16.074418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:16.074478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554101489137892:4289], now have 1 active actors on pipe
2025-10-02T09:29:16.074690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:16.074695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554101489137892:4289]
2025-10-02T09:29:16.074723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:16.074729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:16.074753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: error at write: Disconnected sessionId: src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0
2025-10-02T09:29:16.074923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0 is DEAD
2025-10-02T09:29:16.075048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:16.075059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Write session will restart in 0.007227s
2025-10-02T09:29:16.075080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Write session: Do CDS request
2025-10-02T09:29:16.075086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:16.075073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:16.083274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.083357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:16.083374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-10-02T09:29:16.083505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.083533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:16.083542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:16.083546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:16.083966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-10-02T09:29:16.083999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:16.084005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:16.084006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:16.084012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554105784105283:4689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:16.084546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554105784105283:4689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:16.086634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554105784105283:4689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:16.086712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:16.088422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:16.088577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:16.088586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:16.088594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:16.088641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:16.088675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554105708584754:4172]
2025-10-02T09:29:16.088771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554105784105283:4689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:16.088783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554105784105283:4689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:16.088785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554105784105283:4689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:16.088789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:16.089224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:16.089456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:16.089494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:16.089771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:16.089819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.089824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.089825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.089826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.089827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.089828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.089829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.089830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.089831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.089832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.089833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.089834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.089838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.089847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.089851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.089855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.089858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.089862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.089865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.089868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.089872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.089876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.089879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.089883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.089889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.089895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.089900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.089905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.089913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.089918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.089926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.089930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.089934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.089939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.089942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.089947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.089955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.089959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.089964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.089972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.089977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.089985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.089989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.089997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.090003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.090007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.090016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.090023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.090058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:16.098246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:16.099772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:16.099789Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:16.099791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:16.099795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:16.099800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [2:7556554105708584754:4172]
2025-10-02T09:29:16.099812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:16.099831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:16.099837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.099840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.099842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.099855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:16.099864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:16.099870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:16.099919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.099925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.099927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.099930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:16.099932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:16.099988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:16.099995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.100005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.100021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.100034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:16.100050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105382:4689], now have 1 active actors on pipe
2025-10-02T09:29:16.100058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105191:2446], now have 1 active actors on pipe
2025-10-02T09:29:16.100063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.100065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.100067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.100079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:16.100093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:16.100101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:16.100103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:16.100105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:16.100109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:16.100111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:16.100137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.100144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:16.100122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 368
2025-10-02T09:29:16.100146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:16.100122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 368
2025-10-02T09:29:16.100173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.100180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.100217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:16.100227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.100230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.100232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:16.100239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.100247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:16.100265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.100390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.100398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.100411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.100465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 36 sessionId: src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0
2025-10-02T09:29:16.100789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefee47a-c0d2403-a13a3dd7-7f15189e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:16.103274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Write session: try to update token
2025-10-02T09:29:16.103295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:16.110508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:16.110528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:16.110530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:16.110531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:16.110539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.110542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.110546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554105708584749:4172]
2025-10-02T09:29:16.110577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:16.110587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.110593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:16.110597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:16.110610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:16.110614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:16.110715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:16.116076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:16.118344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:16.174908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554105784105395:4289]
2025-10-02T09:29:16.175181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7556554105784105395:4289]
2025-10-02T09:29:16.248146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:16.248768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.248786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.248820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105395:4289], now have 1 active actors on pipe
2025-10-02T09:29:16.249024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554105784105395:4289]
2025-10-02T09:29:16.249029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:16.249034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:16.249053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:16.249033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:16.249089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: error at write: Disconnected sessionId: src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0
2025-10-02T09:29:16.249260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0 is DEAD
2025-10-02T09:29:16.249645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:16.249656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Write session will restart in 0.008424s
2025-10-02T09:29:16.249680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Write session: Do CDS request
2025-10-02T09:29:16.249685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:16.259311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.259370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:16.259394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-10-02T09:29:16.260372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.260409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:16.260420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:16.260423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:16.260927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-10-02T09:29:16.260969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:16.260975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:16.260977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:16.260982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554105784105495:4694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:16.261496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554105784105495:4694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:16.263556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554105784105495:4694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:16.264677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:16.266830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:16.266999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:16.267010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:16.267019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:16.267074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:16.267123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554105708584952:4175]
2025-10-02T09:29:16.267163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554105784105495:4694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:16.267180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554105784105495:4694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:16.267183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554105784105495:4694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:16.267189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:16.267748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:16.268016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:16.268057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:16.268344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:16.268394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.268400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.268401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.268402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.268403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.268404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.268405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.268406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.268407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.268408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.268408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.268409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.268414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.268424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.268428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.268432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.268435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.268439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.268442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.268445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.268449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.268453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.268456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.268459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.268464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.268471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.268477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.268481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.268484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.268488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.268492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.268496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.268500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.268504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.268507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.268513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.268517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.268521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.268525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.268529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.268532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.268537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.268540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.268544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.268548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.268552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.268555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.268560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.268589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:16.278484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:16.280220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:16.280241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:16.280244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:16.280248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:16.280254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [2:7556554105708584952:4175]
2025-10-02T09:29:16.280268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:16.280284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:16.280287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.280289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.280291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.280305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:16.280311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:16.280318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:16.280378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.280391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.280393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.280396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:16.280399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:16.280654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 369
2025-10-02T09:29:16.280655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 369
2025-10-02T09:29:16.280722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:16.280734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.280748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.280760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.280783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:16.280823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105590:4694], now have 1 active actors on pipe
2025-10-02T09:29:16.280832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105397:2446], now have 1 active actors on pipe
2025-10-02T09:29:16.280845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.280854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.280874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.280880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.280882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.280894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:16.280909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:16.280911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:16.280918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:16.280920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:16.280926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:16.280929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:16.280943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:16.280954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.280957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.280959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:16.280967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.280980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:16.281025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.281037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:16.281045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:16.281050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.281205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.281214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.281227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.281319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 36 sessionId: src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0
2025-10-02T09:29:16.281643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afdcf1e-6f27573-57f0c6f-dd93f785_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:16.284047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Write session: try to update token
2025-10-02T09:29:16.284063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:16.292907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:16.292926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:16.292928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:16.292930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:16.292937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.292941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.292945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554105708584947:4175]
2025-10-02T09:29:16.292983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:16.292990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.292992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:16.292995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:16.293001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:16.293004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:16.293124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:16.297132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:16.299696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:16.348972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554105784105601:4289]
2025-10-02T09:29:16.349201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7556554105784105601:4289]
2025-10-02T09:29:16.438478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:16.438795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.438809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.438840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105601:4289], now have 1 active actors on pipe
2025-10-02T09:29:16.439020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:16.439036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:16.439039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554105784105601:4289]
2025-10-02T09:29:16.439052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:16.439053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:16.439119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0
2025-10-02T09:29:16.439243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0 is DEAD
2025-10-02T09:29:16.439585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:16.439594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Write session will restart in 0.006776s
2025-10-02T09:29:16.439615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Write session: Do CDS request
2025-10-02T09:29:16.439621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:16.447338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.447418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:16.447435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-10-02T09:29:16.447545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.447574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:16.447584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:16.447587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:16.448073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-10-02T09:29:16.448111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:16.448118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:16.448120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:16.448125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554105784105680:4706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:16.448588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554105784105680:4706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:16.451843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554105784105680:4706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:16.454633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:16.462912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:16.463202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:16.463211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:16.463221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:16.463282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:16.463300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554105784105680:4706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:16.463324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554105708585197:4190]
2025-10-02T09:29:16.463322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554105784105680:4706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:16.463325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554105784105680:4706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:16.463336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:16.463930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:16.464246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:16.464287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:16.464566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:16.464619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.464625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.464626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.464627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.464629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.464630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.464631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.464632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.464633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.464635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.464636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.464637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.464642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.464654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.464658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.464662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.464666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.464669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.464673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.464677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.464682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.464686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.464690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.464694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.464700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.464707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.464713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.464723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.464728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.464733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.464738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.464743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.464750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.464756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.464763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.464769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.464773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.464779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.464786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.464791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.464795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.464815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.464822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.464831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.464836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.464843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.464847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.464852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.464886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:16.473772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:16.475630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:16.475646Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:16.475648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:16.475650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:16.475655Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [2:7556554105708585197:4190]
2025-10-02T09:29:16.475665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:16.475678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:16.475681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.475683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.475684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.475695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:16.475699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:16.475705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:16.475758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.475766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.475768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.475770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:16.475773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:16.475887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:16.475894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.475902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.475908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.475916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:16.475938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105641:2446], now have 1 active actors on pipe
2025-10-02T09:29:16.475945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105831:4706], now have 1 active actors on pipe
2025-10-02T09:29:16.475952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.475958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.475960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.475968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:16.475982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:16.475952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 370
2025-10-02T09:29:16.475985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:16.475988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:16.475990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:16.476001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:16.476003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:16.475972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 370
2025-10-02T09:29:16.476022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.476029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.476067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.476079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:16.476085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:16.476094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1489871-26110449-c150c4d0-f2da9769_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:16.476104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.476107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.476109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:16.476116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.476129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:16.476161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.476270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.476282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.476301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.476393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 36 sessionId: src_id|1489871-26110449-c150c4d0-f2da9769_0
2025-10-02T09:29:16.476717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b2a8-fd02aa72-f3e31d66-a13892b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1489871-26110449-c150c4d0-f2da9769_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:16.479273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Write session: try to update token
2025-10-02T09:29:16.479291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:16.486893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:16.486910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:16.486911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:16.486913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:16.486919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.486922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.486925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554105708585192:4190]
2025-10-02T09:29:16.486956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:16.486962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.486965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:16.486967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:16.486973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:16.486977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:16.487116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:16.492271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|1489871-26110449-c150c4d0-f2da9769_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:16.494989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:16.539414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554105784105846:4289]
2025-10-02T09:29:16.539711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7556554105784105846:4289]
2025-10-02T09:29:16.640205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:16.640655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.640669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.640705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105846:4289], now have 1 active actors on pipe
2025-10-02T09:29:16.640939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:16.641312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:16.641322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Write session will restart in 0.008721s
2025-10-02T09:29:16.641342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Write session: Do CDS request
2025-10-02T09:29:16.641348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:16.640938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:16.640957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:16.641024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: error at write: Disconnected sessionId: src_id|1489871-26110449-c150c4d0-f2da9769_0
2025-10-02T09:29:16.641037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554105784105846:4289]
2025-10-02T09:29:16.641052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:16.641170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|1489871-26110449-c150c4d0-f2da9769_0 is DEAD
2025-10-02T09:29:16.651329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.651760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:16.651782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-10-02T09:29:16.651909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.651947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:16.651950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:16.651954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:16.652274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-10-02T09:29:16.652305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:16.652307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:16.652308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:16.652311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554105784106005:4712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:16.652745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554105784106005:4712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:16.653332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:16.654237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554105784106005:4712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:16.655246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:16.655417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:16.655427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:16.655436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:16.655487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:16.655521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554105708585396:4192]
2025-10-02T09:29:16.656086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:16.656115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554105784106005:4712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:16.656131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554105784106005:4712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:16.656134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554105784106005:4712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:16.656143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:16.656342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:16.656386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:16.656676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:16.656734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.656743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.656744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.656745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.656746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.656747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.656748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.656749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.656750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.656751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.656752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.656753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.656758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.656767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.656771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.656774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.656778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.656782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.656786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.656790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.656794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.656798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.656827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.656830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.656836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.656842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.656847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.656851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.656855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.656860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.656863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.656867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.656871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.656875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.656879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.656883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.656887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.656891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.656894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.656898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.656907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.656912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.656915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.656920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.656924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.656928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.656932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.656936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.656965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:16.665705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:16.667687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:16.667704Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:16.667707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:16.667711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:16.667717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [2:7556554105708585396:4192]
2025-10-02T09:29:16.667732Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:16.667748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:16.667751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.667753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.667755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.667771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:16.667778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:16.667789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:16.667843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.667864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.667870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.667874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:16.667876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:16.667945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:16.667955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.667970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.667982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.668001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:16.668024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784106043:4712], now have 1 active actors on pipe
2025-10-02T09:29:16.668034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784105849:2446], now have 1 active actors on pipe
2025-10-02T09:29:16.668040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.668042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.668045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.668059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:16.668075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:16.668051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 371
2025-10-02T09:29:16.668086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:16.668095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:16.668056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 371
2025-10-02T09:29:16.668097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:16.668098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:16.668098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:16.668142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.668152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.668167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.668179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:16.668207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:16.668209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:16.668215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.668218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.668220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:16.668231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.668239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:16.668263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.668422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.668431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.668442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.668537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0
2025-10-02T09:29:16.668870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489871-26110449-c150c4d0-f2da9769_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:16.671692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Write session: try to update token
2025-10-02T09:29:16.671708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:16.679242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:16.679262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:16.679265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:16.679267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:16.679276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.679280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.679283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554105708585391:4192]
2025-10-02T09:29:16.679318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:16.679324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.679328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:16.679329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:16.679335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:16.679338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:16.679463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:16.685758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:16.688462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:16.741191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554105784106060:4289]
2025-10-02T09:29:16.748452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7556554105784106060:4289]
2025-10-02T09:29:16.825952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:16.826592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.826611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.826628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784106060:4289], now have 1 active actors on pipe
2025-10-02T09:29:16.827268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554105784106060:4289]
2025-10-02T09:29:16.827314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:16.827316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:16.827364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: error at write: Disconnected sessionId: src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0
2025-10-02T09:29:16.827523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0 is DEAD
2025-10-02T09:29:16.827571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:16.827670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:16.827680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Write session will restart in 0.006956s
2025-10-02T09:29:16.827670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:16.827701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Write session: Do CDS request
2025-10-02T09:29:16.827707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:16.836291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.836444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:16.836463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-10-02T09:29:16.836592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:16.836630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:16.836639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:16.836642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:16.837151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-10-02T09:29:16.837192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:16.837201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:16.837202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:16.837207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554105784106137:4717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:16.837759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554105784106137:4717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:16.842698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554105784106137:4717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:16.843119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:16.844886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:16.845062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:16.845073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:16.845084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:16.845252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554105784106137:4717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:16.845269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554105784106137:4717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:16.845273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554105784106137:4717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:16.845281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:16.845137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:16.845178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554105708585598:4195]
2025-10-02T09:29:16.845736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:16.846065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:16.846116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:16.846438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:16.846505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.846512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.846513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.846514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.846515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.846517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.846518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.846519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.846520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.846521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.846522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.846524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.846529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.846540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.846543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.846547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.846551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.846555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.846559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.846563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.846566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.846571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.846574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.846578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.846585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.846593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:16.846598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.846603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:16.846608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.846613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:16.846617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.846621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:16.846626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.846631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:16.846635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.846640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:16.846644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.846649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:16.846653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.846657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:16.846661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.846673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:16.846678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.846687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.846694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.846703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.846708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.846717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.846749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:16.855909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:16.857860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:16.857884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:16.857888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:16.857892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:16.857899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [2:7556554105708585598:4195]
2025-10-02T09:29:16.857914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:16.857931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:16.857934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.857937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.857939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.857954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:16.857959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:16.857965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:16.858025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.858034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.858039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.858042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:16.858044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:16.858114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:16.858126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.858140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:16.858153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:16.858168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:16.858189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784106065:2446], now have 1 active actors on pipe
2025-10-02T09:29:16.858193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784106259:4717], now have 1 active actors on pipe
2025-10-02T09:29:16.858199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.858201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.858204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.858220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:16.858241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:16.858245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:16.858249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:16.858256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:16.858260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:16.858264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:16.858310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.858296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 372
2025-10-02T09:29:16.858331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:16.858305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 372
2025-10-02T09:29:16.858344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:16.858374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.858384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.858412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:16.858428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:16.858432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:16.858435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:16.858444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:16.858454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:16.858467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.858674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:16.858690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:16.858713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:16.858792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 36 sessionId: src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0
2025-10-02T09:29:16.859151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e7f830e-be71d1bd-a7797f0d-5e8fcea2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:16.861950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Write session: try to update token
2025-10-02T09:29:16.861970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:16.870258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:16.870282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:16.870291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.870337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:16.870533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:16.870686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:16.870837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:16.870990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:16.871211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:16.871254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:16.871576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:16.883702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:16.883726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:16.883731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:16.883733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:16.883743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.883749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.883752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554105708585593:4195]
2025-10-02T09:29:16.883792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:16.883800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:16.883808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:16.883816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:16.883823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:16.883829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:16.883956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:16.886189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:16.889058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:16.927563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554105784106271:4289]
2025-10-02T09:29:16.927931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7556554105784106271:4289]
2025-10-02T09:29:17.032567Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:17.032973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.032991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.033011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554105784106271:4289], now have 1 active actors on pipe
2025-10-02T09:29:17.033240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:17.033258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:17.033272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:17.033316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554105784106271:4289]
2025-10-02T09:29:17.033316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: error at write: Disconnected sessionId: src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0
2025-10-02T09:29:17.033492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0 is DEAD
2025-10-02T09:29:17.033234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:17.033879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:17.033890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Write session will restart in 0.006771s
2025-10-02T09:29:17.033923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Write session: Do CDS request
2025-10-02T09:29:17.033930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:17.042241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.043265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:17.043285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-10-02T09:29:17.043440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.043474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:17.043480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:17.043483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:17.043853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-10-02T09:29:17.043884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:17.043885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:17.043887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:17.043892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554110079073624:4721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:17.044443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554110079073624:4721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:17.047290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554110079073624:4721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:17.050117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554110079073624:4721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:17.050135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554110079073624:4721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:17.050138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554110079073624:4721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:17.050144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:17.050727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:17.052860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:17.053269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:17.053285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:17.053302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:17.053380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:17.053426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554110003553096:4197]
2025-10-02T09:29:17.054016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:17.054366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:17.054420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:17.054857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:17.054922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.054923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.054924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.054926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.054927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.054928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.054929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.054930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.054932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.054933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.054934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.054935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.054941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.054952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.054956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.054960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.054963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.054967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.054971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.054975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.054978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.054983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.054986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.054990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.054997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.055004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.055010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.055016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.055021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.055027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.055031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.055037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.055044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.055049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.055055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.055060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.055065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.055070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.055075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.055080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.055086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.055091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.055096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.055112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.055117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.055123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.055128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.055133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.055171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:17.065423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:17.067621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 373
2025-10-02T09:29:17.067210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:17.067215Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:17.067621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 373
2025-10-02T09:29:17.067217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:17.067220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:17.067226Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [2:7556554110003553096:4197]
2025-10-02T09:29:17.067239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:17.067257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:17.067259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.067262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.067264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.067278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:17.067284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:17.067290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:17.067345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.067347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.067349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.067352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:17.067354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:17.067425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:17.067428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.067440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.067450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.067464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:17.067480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.067482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.067484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.067498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:17.067513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079073764:4721], now have 1 active actors on pipe
2025-10-02T09:29:17.067518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079073569:2446], now have 1 active actors on pipe
2025-10-02T09:29:17.067526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:17.067537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:17.067539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:17.067542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:17.067542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:17.067545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:17.067573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.067584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:17.067597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:17.067805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.067822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.067852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:17.067865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.067872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.067874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:17.067885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.067901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:17.067922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.068208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.068219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.068237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.068445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 36 sessionId: src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0
2025-10-02T09:29:17.072124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a7d44fc-b2389cfd-e3647e88-c85fa265_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:17.074905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Write session: try to update token
2025-10-02T09:29:17.074928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:17.081323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:17.081348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:17.081356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.081398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:17.081402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:17.081563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:17.081710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:17.081862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:17.082003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:17.082224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:17.082271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:17.093203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:17.095723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:17.095952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.095979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.096023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:17.096152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:17.100381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:17.100400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:17.100402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:17.100404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:17.100413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.100419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.100423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554110003553091:4197]
2025-10-02T09:29:17.100463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:17.100468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:17.100470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.100473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:17.100482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:17.100486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:17.100602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:17.133360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554110079073778:4289]
2025-10-02T09:29:17.133628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7556554110079073778:4289]
2025-10-02T09:29:17.257702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:17.265938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.265969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.266128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.266188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.266254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.266323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.266746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.266752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.266821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.266879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.266935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.267002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.267207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.267211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.267276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.267335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.267392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.267451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.267602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.267606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.267671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.267816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.267875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.267941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.267981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.267985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.268054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.268114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.268172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.268227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.268265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.268268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.268340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.268398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.268458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.268520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.268563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.268565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.268631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.268688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.268750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.269020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.269072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.269076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.269142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.269196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.269258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.269316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.269358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.269363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.269430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.269488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.269547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.269605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.269652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.269656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.269720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:17.269778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:17.269834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:17.269895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:17.270021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:17.270024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:17.270107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079073778:4289], now have 1 active actors on pipe
2025-10-02T09:29:17.270425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:17.270901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:17.270958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554110079073778:4289]
2025-10-02T09:29:17.270983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:17.271020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0
2025-10-02T09:29:17.271211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0 is DEAD
2025-10-02T09:29:17.273019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:17.273032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Write session will restart in 0.008335s
2025-10-02T09:29:17.273057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Write session: Do CDS request
2025-10-02T09:29:17.273063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:17.285286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.289141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:17.289162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-10-02T09:29:17.289364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.289405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:17.289410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:17.289415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:17.289849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-10-02T09:29:17.289872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:17.289873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:17.289875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:17.289880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554110079073796:4726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:17.290354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554110079073796:4726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:17.297040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554110079073796:4726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:17.308148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554110079073796:4726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:17.308175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554110079073796:4726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:17.308181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554110079073796:4726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:17.308189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:17.308435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:17.311830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:17.312177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:17.312182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:17.312194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:17.312264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:17.312295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554110003553299:4200]
2025-10-02T09:29:17.312870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:17.313138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:17.313189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:17.313495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:17.313576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.313577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.313578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.313579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.313581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.313582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.313583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.313584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.313585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.313586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.313588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.313589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.313594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.313602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.313605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.313607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.313609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.313612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.313614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.313616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.313618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.313621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.313623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.313625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.313631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.313636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.313639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.313643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.313645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.313648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.313650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.313654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.313656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.313659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.313662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.313665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.313670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.313673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.313676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.313679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.313682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.313685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.313687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.313690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.313693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.313696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.313699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.313703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.313722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:17.324520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:17.326545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:17.326568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:17.326571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:17.326574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:17.326580Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [2:7556554110003553299:4200]
2025-10-02T09:29:17.326596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:17.326616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:17.326619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.326622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.326624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.326641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:17.326647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:17.326654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:17.327277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 374
2025-10-02T09:29:17.327296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 374
2025-10-02T09:29:17.326721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.326733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.326736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.326739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:17.326741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:17.326812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:17.326815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.326830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.326843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.326858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:17.326877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.326879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.326882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.326891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:17.326905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:17.326919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:17.326922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:17.326943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:17.326946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:17.326948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:17.326956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.326959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:17.326964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:17.326982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079073976:4726], now have 1 active actors on pipe
2025-10-02T09:29:17.326986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079073781:2446], now have 1 active actors on pipe
2025-10-02T09:29:17.327522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.327529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.327557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:17.327564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.327569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.327571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:17.327582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.327592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:17.327608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.328184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0
2025-10-02T09:29:17.328059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.328070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.328084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.328539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5477a17d-e2092b7d-4b82028a-7f0af2e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:17.331159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Write session: try to update token
2025-10-02T09:29:17.331176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:17.340443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:17.340469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:17.340472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:17.340474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:17.340483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.340488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.340492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554110003553292:4200]
2025-10-02T09:29:17.340532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:17.340543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.340547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:17.340627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:17.340640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:17.340653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:17.340682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:17.346815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:17.349210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:17.369788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554110079073989:4289]
2025-10-02T09:29:17.370168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7556554110079073989:4289]
2025-10-02T09:29:17.491308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:17.491660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.491687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.491722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079073989:4289], now have 1 active actors on pipe
2025-10-02T09:29:17.491961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:17.492879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554110079073989:4289]
2025-10-02T09:29:17.492918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:17.493292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:17.493303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Write session will restart in 0.007595s
2025-10-02T09:29:17.492978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0
2025-10-02T09:29:17.493144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0 is DEAD
2025-10-02T09:29:17.493324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Write session: Do CDS request
2025-10-02T09:29:17.493330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:17.499525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:17.502311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.502418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:17.502434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-10-02T09:29:17.502565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.502603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:17.502612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:17.502616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:17.503010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-10-02T09:29:17.503043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:17.503048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:17.503050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:17.503054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554110079074089:4737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:17.503532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554110079074089:4737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:17.507028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554110079074089:4737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:17.521927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554110079074089:4737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:17.521948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554110079074089:4737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:17.521951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554110079074089:4737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:17.521958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:17.530106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:17.535450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:17.535734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:17.535746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:17.535756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:17.535815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:17.535860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554110003553550:4213]
2025-10-02T09:29:17.536502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:17.536817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:17.536863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:17.537188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:17.537236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.537237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.537238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.537240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.537241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.537242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.537243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.537245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.537246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.537247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.537251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.537253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.537258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.537271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.537276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.537281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.537285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.537290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.537294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.537298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.537302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.537306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.537310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.537314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.537322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.537330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.537336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.537342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.537347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.537352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.537358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.537363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.537369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.537374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.537378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.537384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.537390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.537395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.537400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.537405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.537411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.537419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.537424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.537430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.537435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.537440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.537445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.537450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.537487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:17.548205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:17.550168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:17.550188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:17.550191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:17.550195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:17.550202Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [2:7556554110003553550:4213]
2025-10-02T09:29:17.550215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:17.550233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:17.550236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.550239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.550241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.550257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:17.550262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:17.550270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:17.550333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.550343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.550345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.550348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:17.550350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:17.550419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:17.550426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.550439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.550448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.550462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:17.550486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.550488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.550491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.550498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:17.550508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:17.550509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:17.550518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:17.550520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:17.550521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:17.550523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:17.550532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074217:4737], now have 1 active actors on pipe
2025-10-02T09:29:17.550535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074036:2446], now have 1 active actors on pipe
2025-10-02T09:29:17.550565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.550572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:17.550726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:17.550835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.550843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.550874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:17.550880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.550884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.550886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:17.550896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.550905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:17.550919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.551463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.551479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.551499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.550740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 375
2025-10-02T09:29:17.550777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 375
2025-10-02T09:29:17.551998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0
2025-10-02T09:29:17.555791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a44960e-9fedf3e7-815652e0-ee28e0d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:17.558422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Write session: try to update token
2025-10-02T09:29:17.558439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:17.563385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:17.563404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:17.563407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:17.563409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:17.563416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.563420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.563425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554110003553543:4213]
2025-10-02T09:29:17.563464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:17.563471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:17.563475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.563478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:17.563478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:17.563482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:17.563609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:17.588852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:17.591501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:17.594653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554110079074234:4289]
2025-10-02T09:29:17.594955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7556554110079074234:4289]
2025-10-02T09:29:17.718059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:17.718481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.718491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.718509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074234:4289], now have 1 active actors on pipe
2025-10-02T09:29:17.719298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:17.719320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:17.719372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: error at write: Disconnected sessionId: src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0
2025-10-02T09:29:17.719550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0 is DEAD
2025-10-02T09:29:17.719712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:17.719730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Write session will restart in 0.006287s
2025-10-02T09:29:17.719751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Write session: Do CDS request
2025-10-02T09:29:17.719757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:17.719282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:17.719685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554110079074234:4289]
2025-10-02T09:29:17.719710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:17.727322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.729430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:17.729449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-10-02T09:29:17.729642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.729671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:17.729676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:17.729679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:17.730722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-10-02T09:29:17.730761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:17.730763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:17.730765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:17.730771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554110079074263:4742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:17.731248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554110079074263:4742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:17.745700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554110079074263:4742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:17.755743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554110079074263:4742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:17.755767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554110079074263:4742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:17.755770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554110079074263:4742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:17.755779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:17.757041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:17.763613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:17.763836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:17.763839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:17.763848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:17.763913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:17.763945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554110003553752:4217]
2025-10-02T09:29:17.764599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:17.765142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:17.765191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:17.765506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:17.765552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.765554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.765555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.765556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.765557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.765558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.765559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.765561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.765562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.765563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.765564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.765565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.765570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.765581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.765585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.765589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.765594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.765598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.765602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.765606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.765610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.765615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.765618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.765623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.765628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.765636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.765641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.765647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.765651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.765657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.765661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.765667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.765672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.765678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.765683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.765688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.765695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.765701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.765719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.765724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.765729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.765734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.765739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.765744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.765749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.765755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.765759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.765764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.765801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:17.793931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:17.795660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:17.795666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:17.795669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:17.795672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:17.795679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [2:7556554110003553752:4217]
2025-10-02T09:29:17.795693Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:17.795710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:17.795713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.795717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.795719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.795735Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:17.795740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:17.795748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:17.795815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.795817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.795819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.795822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:17.795824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:17.795896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:17.795898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.795912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.795924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.795940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:17.795956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.795958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.795960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.795975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:17.795988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:17.796003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:17.796006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:17.796020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:17.796023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:17.796025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:17.796041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.796044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:17.796101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:17.796314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074239:2446], now have 1 active actors on pipe
2025-10-02T09:29:17.796317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074438:4742], now have 1 active actors on pipe
2025-10-02T09:29:17.796894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 376
2025-10-02T09:29:17.796952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 376
2025-10-02T09:29:17.801761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.801781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.801813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:17.801823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:17.801828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:17.801831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:17.801843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:17.801857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:17.801878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.805520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.805538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.805566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:17.805739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 36 sessionId: src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0
2025-10-02T09:29:17.809224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0cda9b9-cdedaab6-263cff22-d4f96303_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:17.811798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Write session: try to update token
2025-10-02T09:29:17.811817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:17.814348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:17.814372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:17.814375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:17.814377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:17.814386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.814390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.814394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554110003553745:4217]
2025-10-02T09:29:17.814433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:17.814439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.814441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:17.814578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:17.816861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:17.816880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:17.816884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:17.821847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554110079074454:4289]
2025-10-02T09:29:17.825645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7556554110079074454:4289]
2025-10-02T09:29:17.828025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:17.830434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:17.964260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:17.964550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074454:4289], now have 1 active actors on pipe
2025-10-02T09:29:17.964601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:17.964612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:17.964842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:17.965623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:17.965635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Write session will restart in 0.008243s
2025-10-02T09:29:17.965656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Write session: Do CDS request
2025-10-02T09:29:17.965662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:17.965051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:17.965108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:17.965111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:17.965114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554110079074454:4289]
2025-10-02T09:29:17.965164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0
2025-10-02T09:29:17.965325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0 is DEAD
2025-10-02T09:29:17.980313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.980782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:17.980818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-10-02T09:29:17.980919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:17.980953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:17.980960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:17.980964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:17.981334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-10-02T09:29:17.981373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:17.981374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:17.981376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:17.981381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554110079074582:4747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:17.981919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554110079074582:4747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:17.984991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554110079074582:4747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:17.989495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554110079074582:4747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:17.989513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554110079074582:4747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:17.989517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554110079074582:4747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:17.989524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:17.990129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:17.992456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:17.992843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:17.992855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:17.992866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:17.992925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:17.992964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554110003553957:4220]
2025-10-02T09:29:17.993550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:17.993834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:17.993879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:17.994174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:17.994246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.994253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.994254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.994255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.994256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.994257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.994258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.994259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.994260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.994261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.994262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.994263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.994268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.994279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.994283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.994287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.994291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.994295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.994298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.994302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.994305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.994309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.994313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.994317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.994324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.994332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:17.994338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.994343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:17.994351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.994362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:17.994365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.994370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:17.994379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.994384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:17.994394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.994398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:17.994403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.994408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:17.994411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.994417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:17.994422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.994427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:17.994431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.994436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:17.994440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.994445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:17.994449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.994458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:17.994490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:18.004374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:18.006046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:18.006065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:18.006493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 377
2025-10-02T09:29:18.006068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:18.006514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 377
2025-10-02T09:29:18.006072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:18.006078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [2:7556554110003553957:4220]
2025-10-02T09:29:18.006093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:18.006111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:18.006114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.006117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.006119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.006134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:18.006139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:18.006146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:18.006204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.006206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.006209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.006212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:18.006214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:18.006278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:18.006281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.006293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.006302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.006316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:18.006334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074656:4747], now have 1 active actors on pipe
2025-10-02T09:29:18.006340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.006342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.006344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.006351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:18.006362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:18.006364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:18.006365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:18.006368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:18.006380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:18.006382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:18.006388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554110079074460:2446], now have 1 active actors on pipe
2025-10-02T09:29:18.006416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.006426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:18.006453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:18.006693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.006705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.006729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:18.006735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.006738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.006740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:18.006749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.006758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:18.006771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.007926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.007942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.007964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.008100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0
2025-10-02T09:29:18.008465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e60d705d-380981c8-ad9dfc57-3a5e0cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:18.011022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Write session: try to update token
2025-10-02T09:29:18.011037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:18.017489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:18.017508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.017517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.017559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:18.017562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:18.017733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:18.017877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.018019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.018161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.018357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:18.018399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:18.029092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:18.029108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.029110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:18.029112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:18.029120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.029123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.029126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554110003553950:4220]
2025-10-02T09:29:18.029160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:18.029167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.029169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:18.029190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:18.029206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:18.029209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:18.029245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:18.029311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:18.031864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:18.065713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554114374041965:4289]
2025-10-02T09:29:18.065975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7556554114374041965:4289]
2025-10-02T09:29:18.176728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:18.177106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.177117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.177132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374041965:4289], now have 1 active actors on pipe
2025-10-02T09:29:18.177363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:18.177350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:18.177393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:18.177397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:18.177404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554114374041965:4289]
2025-10-02T09:29:18.177454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0
2025-10-02T09:29:18.177621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0 is DEAD
2025-10-02T09:29:18.177758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:18.177771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Write session will restart in 0.007091s
2025-10-02T09:29:18.177799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Write session: Do CDS request
2025-10-02T09:29:18.177805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:18.186237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.186345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:18.186363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-10-02T09:29:18.186454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.186476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:18.186486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:18.186489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:18.186912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-10-02T09:29:18.186944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:18.186950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:18.186952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:18.186958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554114374042009:4752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:18.187470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554114374042009:4752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:18.189851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554114374042009:4752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:18.192787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:18.193251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554114374042009:4752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:18.193268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554114374042009:4752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:18.193271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554114374042009:4752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:18.193279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:18.194813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:18.195002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:18.195013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:18.195024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:18.195203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:18.195248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554114298521459:4223]
2025-10-02T09:29:18.195780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:18.196106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:18.196140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:18.196449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:18.196518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.196524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.196525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.196526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.196528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.196529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.196530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.196531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.196532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.196534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.196535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.196536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.196541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.196552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.196556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.196560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.196564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.196568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.196572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.196576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.196580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.196584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.196588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.196591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.196598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.196606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.196611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.196617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.196621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.196627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.196631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.196636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.196641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.196646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.196657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.196662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.196667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.196672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.196678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.196683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.196688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.196692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.196696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.196701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.196707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.196712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.196716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.196721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.196755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:18.206120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:18.208013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:18.208034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:18.208036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:18.208040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:18.208046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [2:7556554114298521459:4223]
2025-10-02T09:29:18.208061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:18.208078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:18.208080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.208083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.208085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.208102Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:18.208108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:18.208114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:18.208173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.208182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.208184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.208188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:18.208190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:18.208258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:18.208266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.208281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.208297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.208319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:18.208340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.208347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.208349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.208356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:18.208369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:18.208369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:18.208374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:18.208377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:18.208389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:18.208392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:18.208402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042170:4752], now have 1 active actors on pipe
2025-10-02T09:29:18.208411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374041969:2446], now have 1 active actors on pipe
2025-10-02T09:29:18.208447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.208461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:18.208470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 378
2025-10-02T09:29:18.208590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 378
2025-10-02T09:29:18.208741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:18.208882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.208891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.208925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:18.208935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.208942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.208944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:18.208954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.208965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:18.208981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.209458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.209484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.209505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.209657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0
2025-10-02T09:29:18.210089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bbb63-5f702bb-b89ddfbc-a3048a0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:18.212759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Write session: try to update token
2025-10-02T09:29:18.212776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:18.220935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:18.220957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.220959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:18.220961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:18.220969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.220974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.220977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554114298521453:4223]
2025-10-02T09:29:18.221012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:18.221019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.221019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:18.221022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:18.221026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:18.221029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:18.221159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:18.228708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:18.231297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:18.277723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554114374042182:4289]
2025-10-02T09:29:18.278171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7556554114374042182:4289]
2025-10-02T09:29:18.371702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:18.372067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.372075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.372111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042182:4289], now have 1 active actors on pipe
2025-10-02T09:29:18.372283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:18.372259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:18.372282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:18.372343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0
2025-10-02T09:29:18.372515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0 is DEAD
2025-10-02T09:29:18.372639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554114374042182:4289]
2025-10-02T09:29:18.372651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:18.372926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:18.372938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Write session will restart in 0.009673s
2025-10-02T09:29:18.372962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Write session: Do CDS request
2025-10-02T09:29:18.372969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:18.383353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.383423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:18.383442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-10-02T09:29:18.383554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.383578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:18.383584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:18.383588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:18.383994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-10-02T09:29:18.384032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:18.384038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:18.384040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:18.384045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554114374042208:4756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:18.384547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554114374042208:4756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:18.388028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554114374042208:4756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:18.390652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554114374042208:4756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:18.390669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554114374042208:4756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:18.390673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554114374042208:4756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:18.390681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:18.390933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:18.393234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:18.393440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:18.393454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:18.393464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:18.393521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:18.393561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554114298521665:4225]
2025-10-02T09:29:18.394128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:18.394538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:18.394596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:18.394921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:18.394986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.394992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.394993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.394995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.394996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.394997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.394998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.395000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.395001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.395002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.395003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.395005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.395010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.395021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.395025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.395029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.395032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.395036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.395040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.395044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.395047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.395051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.395054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.395057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.395065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.395072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.395078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.395084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.395088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.395093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.395109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.395114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.395119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.395123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.395128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.395133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.395138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.395143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.395148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.395153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.395160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.395165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.395170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.395175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.395187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.395193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.395197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.395202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.395235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:18.405922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:18.407929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:18.407953Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:18.407956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:18.407959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:18.407965Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [2:7556554114298521665:4225]
2025-10-02T09:29:18.407980Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:18.408000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:18.408004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.408008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.408009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.408027Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:18.408038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:18.408044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:18.408112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.408120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.408122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.408125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:18.408128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:18.408198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:18.408206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.408220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.408229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.408246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:18.408269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.408276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.408278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.408285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:18.408297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:18.408298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:18.408308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:18.408310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:18.408311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:18.408314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:18.408326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042184:2446], now have 1 active actors on pipe
2025-10-02T09:29:18.408329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042386:4756], now have 1 active actors on pipe
2025-10-02T09:29:18.408365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.408379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:18.408407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:18.409041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 379
2025-10-02T09:29:18.409089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 379
2025-10-02T09:29:18.409443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.409457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.409483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:18.409493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.409496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.409499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:18.409508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.409520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:18.409535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.409797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.409811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.409833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.409981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 36 sessionId: src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0
2025-10-02T09:29:18.410353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b73b91a-2f3cf928-6c5a2a2a-2a43ccc6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:18.413252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Write session: try to update token
2025-10-02T09:29:18.413272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:18.421195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:18.421216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.421225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.421266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:18.421271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:18.421436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:18.421584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.421729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.421871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.422059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:18.422099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:18.427429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:18.430275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:18.430634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.430660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.430704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:18.430801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:18.435707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:18.435729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.435731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:18.435733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:18.435742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.435749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.435753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554114298521659:4225]
2025-10-02T09:29:18.435791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:18.435797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.435809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:18.435818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:18.435824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:18.435832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:18.435947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:18.472786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554114374042410:4289]
2025-10-02T09:29:18.473166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7556554114374042410:4289]
2025-10-02T09:29:18.592704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:18.603537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.603565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.603727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.603945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.604017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.604083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.604682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.604698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.604961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.605213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.605495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.605560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.605676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.605680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.605753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.606005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.606198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.606254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.606382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.606385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.606451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.606688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.606926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.606992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.607116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.607120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.607219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.607449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.607688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.607913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.608033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.608036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.608247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.608506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.608747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.609123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.609257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.609266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.609496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.609717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.609906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.610151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.610203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.610212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.610558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.610617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.610673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.610940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.610987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.610990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.611256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.611320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.612761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554114374042410:4289]
2025-10-02T09:29:18.612798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:18.612832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:18.612836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:18.611377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.612874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: error at write: Disconnected sessionId: src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0
2025-10-02T09:29:18.611435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.611476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.611480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.611552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:18.611802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:18.612066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:18.612294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:18.612419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:18.612422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:18.612488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042410:4289], now have 1 active actors on pipe
2025-10-02T09:29:18.613403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:18.613049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0 is DEAD
2025-10-02T09:29:18.614786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:18.614797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Write session will restart in 0.007198s
2025-10-02T09:29:18.614820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Write session: Do CDS request
2025-10-02T09:29:18.614829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:18.624476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.624604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:18.624626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-10-02T09:29:18.624788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.624840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:18.624844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:18.624848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:18.625494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-10-02T09:29:18.625527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:18.625529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:18.625531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:18.625536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554114374042486:4768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:18.626055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554114374042486:4768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:18.632099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554114374042486:4768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:18.633799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:18.636322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:18.636529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:18.636539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:18.636549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:18.636601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:18.636641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554114298521919:4240]
2025-10-02T09:29:18.637257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:18.637565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:18.637611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:18.637896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554114374042486:4768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:18.637907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:18.637916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554114374042486:4768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:18.637919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554114374042486:4768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:18.637928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:18.637965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.637971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.637972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.637973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.637974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.637975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.637977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.637978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.637979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.637981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.637982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.637983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.637988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.637999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.638004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.638008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.638012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.638016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.638021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.638025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.638029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.638034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.638040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.638044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.638053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.638064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.638069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.638075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.638080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.638085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.638089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.638094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.638099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.638104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.638110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.638116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.638124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.638129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.638132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.638137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.638141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.638146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.638150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.638155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.638160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.638165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.638169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.638173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.638211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:18.647787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:18.649669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:18.649692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:18.649694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:18.649698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:18.649705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [2:7556554114298521919:4240]
2025-10-02T09:29:18.649719Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:18.649738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:18.649741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.649744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.649746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.649762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:18.649767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:18.649774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:18.649835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.649843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.649845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.649849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:18.649852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:18.649930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:18.649939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.649954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.649967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.649986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:18.650069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 380
2025-10-02T09:29:18.650110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 380
2025-10-02T09:29:18.650005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042639:4768], now have 1 active actors on pipe
2025-10-02T09:29:18.650014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042437:2446], now have 1 active actors on pipe
2025-10-02T09:29:18.650020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.650022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.650024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.650037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:18.650049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:18.650065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:18.650068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:18.650100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.650102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:18.650125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:18.650128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:18.650130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:18.650137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:18.650332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.650337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.650364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:18.650370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.650376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.650378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:18.650388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.650397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:18.650410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.650560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.650567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.650579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.650661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 36 sessionId: src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0
2025-10-02T09:29:18.651001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f589ef-8ca5313c-8a3fa669-1ed429de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:18.656839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Write session: try to update token
2025-10-02T09:29:18.656858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:18.661598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:18.661615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.661623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.661666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:18.661665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:18.661992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:18.662135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.662439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.662752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:18.662942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:18.662977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:18.674534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:18.674555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.674558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:18.674560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:18.674570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.674574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.674579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554114298521914:4240]
2025-10-02T09:29:18.674622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:18.674628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.674630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:18.674638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:18.674643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:18.674648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:18.674768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:18.679691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:18.682256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:18.713544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554114374042649:4289]
2025-10-02T09:29:18.713988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7556554114374042649:4289]
2025-10-02T09:29:18.839877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:18.840243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.840251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.840271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042649:4289], now have 1 active actors on pipe
2025-10-02T09:29:18.841708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:18.841048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:18.841103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554114374042649:4289]
2025-10-02T09:29:18.841121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:18.841124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:18.841181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0
2025-10-02T09:29:18.841355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0 is DEAD
2025-10-02T09:29:18.845118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:18.845131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Write session will restart in 0.005039s
2025-10-02T09:29:18.845165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Write session: Do CDS request
2025-10-02T09:29:18.845171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:18.853283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.858166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:18.858188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-10-02T09:29:18.858406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:18.858439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:18.858444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:18.858447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:18.859000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-10-02T09:29:18.859038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:18.859040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:18.859042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:18.859048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554114374042667:4773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:18.859589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554114374042667:4773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:18.862821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554114374042667:4773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:18.867495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554114374042667:4773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:18.867515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554114374042667:4773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:18.867521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554114374042667:4773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:18.867529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:18.900678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:18.902344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:18.902737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:18.902741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:18.902754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:18.902820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:18.902859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554114298522132:4243]
2025-10-02T09:29:18.903405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:18.903665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:18.903712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:18.903935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:18.903977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.903977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.903978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.903979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.903979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.903981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.903981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.903982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.903982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.903983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.903984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.903984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.903988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.903995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.903998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.904000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.904002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.904005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.904007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.904009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.904011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.904013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.904016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.904018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.904022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.904028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:18.904032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.904036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:18.904039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.904042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:18.904044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.904048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:18.904050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.904053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:18.904055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.904059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:18.904062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.904067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:18.904072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.904076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:18.904082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.904087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:18.904091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.904097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.904100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.904102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.904105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.904108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.904126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:18.918012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:18.920080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:18.920093Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:18.920096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:18.920099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:18.920106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [2:7556554114298522132:4243]
2025-10-02T09:29:18.920119Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:18.920135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:18.920137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.920140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.920142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.920157Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:18.920162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:18.920170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:18.920229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.920231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.920233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.920239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:18.920251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:18.920324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:18.920327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.920340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:18.920353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:18.920369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:18.920384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.920386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.920390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.920402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:18.920414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:18.920429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:18.920431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:18.920464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.920466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:18.920670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:18.920674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:18.920677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:18.920682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:18.921372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042704:4773], now have 1 active actors on pipe
2025-10-02T09:29:18.921379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042659:2446], now have 1 active actors on pipe
2025-10-02T09:29:18.921556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 381
2025-10-02T09:29:18.921597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 381
2025-10-02T09:29:18.924982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.924998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.925035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:18.925044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:18.925048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:18.925051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:18.925130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:18.925147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:18.925164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.932971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:18.932992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:18.933027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:18.933249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0
2025-10-02T09:29:18.933728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece1208a-a44cb9e3-6cf560e3-1a2f4d37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:18.937037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Write session: try to update token
2025-10-02T09:29:18.937061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:18.940212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554114374042874:4289]
2025-10-02T09:29:18.941918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7556554114374042874:4289]
2025-10-02T09:29:18.942396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554114374042874:4289], now have 1 active actors on pipe
2025-10-02T09:29:18.942417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:18.942420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:18.942423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:18.942425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:18.942438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.942441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.942445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554114298522126:4243]
2025-10-02T09:29:18.942486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:18.942492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:18.942493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:18.942633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:18.944115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:18.944124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:18.944133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:18.965791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:18.968673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:19.097623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:19.097951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.097958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.098345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:19.100867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:19.100875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:19.100932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554114374042874:4289]
2025-10-02T09:29:19.100944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0
2025-10-02T09:29:19.101118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0 is DEAD
2025-10-02T09:29:19.104943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:19.104957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Write session will restart in 0.006409s
2025-10-02T09:29:19.104980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Write session: Do CDS request
2025-10-02T09:29:19.104986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:19.117168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.117489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:19.117510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-10-02T09:29:19.123492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.123550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:19.123555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:19.123559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:19.129196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-10-02T09:29:19.129244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:19.129245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:19.129247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:19.129256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554118669010226:4778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:19.129808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554118669010226:4778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:19.145891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554118669010226:4778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:19.148479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:19.151829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:19.152161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:19.152171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:19.152182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:19.152239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:19.152278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554118593489638:4246]
2025-10-02T09:29:19.152912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:19.154272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:19.154330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:19.154777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:19.154826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.154831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.154832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.154833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.154833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.154834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.154835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.154836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.154837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.154837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.154838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.154838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.154843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.154851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.154853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.154856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.154858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.154860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.154862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.154864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.154867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.154869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.154871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.154873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.154878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.154883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.154887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.154890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.154893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.154896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.154898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.154902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.154905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.154910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.154915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.154919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.154923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.154928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.154932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.154936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.154941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.154946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.154950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.154955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.154959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.154963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.154967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.154970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.155003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:19.153639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554118669010226:4778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:19.153661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554118669010226:4778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:19.153665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554118669010226:4778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:19.153674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:19.165291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:19.167325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:19.167342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:19.167345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:19.167349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:19.167356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [2:7556554118593489638:4246]
2025-10-02T09:29:19.167371Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:19.167389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:19.167392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.167395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.167397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.167412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:19.167418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:19.167425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:19.167490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.167497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.167499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.167502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:19.167504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:19.167578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:19.167581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.167598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.167608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.167624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:19.167644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010177:2446], now have 1 active actors on pipe
2025-10-02T09:29:19.167648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010381:4778], now have 1 active actors on pipe
2025-10-02T09:29:19.167654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.167656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.167658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.167667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:19.167678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:19.167680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:19.167681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:19.167683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:19.167696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:19.167699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:19.167733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.167741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:19.167994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 382
2025-10-02T09:29:19.168041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 382
2025-10-02T09:29:19.168141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:19.168403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.168408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.168433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|972205f4-42351184-ded1b4ef-de17df97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:19.168441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.168444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.168446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:19.168457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.168468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:19.168482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.169021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.169035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.169052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.172039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 36 sessionId: src_id|972205f4-42351184-ded1b4ef-de17df97_0
2025-10-02T09:29:19.172988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6901b9d-8862ee8b-9ad02341-e56c49fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|972205f4-42351184-ded1b4ef-de17df97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:19.175867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Write session: try to update token
2025-10-02T09:29:19.175886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:19.180248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:19.180267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:19.180270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:19.180272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:19.180279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.180284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.180292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554118593489632:4246]
2025-10-02T09:29:19.180332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:19.180338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.180339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:19.180346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:19.180347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:19.180349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:19.180547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:19.203410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554118669010391:4289]
2025-10-02T09:29:19.203457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|972205f4-42351184-ded1b4ef-de17df97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:19.206019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:19.206095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7556554118669010391:4289]
2025-10-02T09:29:19.381265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:19.381600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010391:4289], now have 1 active actors on pipe
2025-10-02T09:29:19.381618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.381624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.381867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:19.382669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554118669010391:4289]
2025-10-02T09:29:19.382716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:19.382747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:19.382812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|972205f4-42351184-ded1b4ef-de17df97_0
2025-10-02T09:29:19.382987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|972205f4-42351184-ded1b4ef-de17df97_0 is DEAD
2025-10-02T09:29:19.384925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:19.384941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Write session will restart in 0.008614s
2025-10-02T09:29:19.384969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Write session: Do CDS request
2025-10-02T09:29:19.384975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:19.394346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.394690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:19.394709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-10-02T09:29:19.394840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.394867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:19.394872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:19.394876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:19.395345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-10-02T09:29:19.395381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:19.395382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:19.395384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:19.395389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554118669010436:4782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:19.395883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554118669010436:4782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:19.401520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554118669010436:4782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:19.409170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554118669010436:4782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:19.409192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554118669010436:4782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:19.409196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554118669010436:4782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:19.409204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:19.411614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:19.413595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:19.413866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:19.413873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:19.413881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:19.413920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:19.413950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554118593489863:4248]
2025-10-02T09:29:19.414359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:19.414608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:19.414647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:19.414932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:19.414976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.414977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.414978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.414978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.414979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.414980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.414981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.414981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.414982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.414983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.414984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.414984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.414988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.414995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.414997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.415000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.415002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.415005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.415007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.415009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.415011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.415014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.415016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.415018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.415023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.415027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.415031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.415034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.415036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.415039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.415042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.415045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.415047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.415050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.415053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.415056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.415058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.415061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.415063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.415067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.415070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.415073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.415076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.415079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.415081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.415084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.415087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.415090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.415120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:19.425557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:19.427410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:19.427428Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:19.427431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:19.427435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:19.427441Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [2:7556554118593489863:4248]
2025-10-02T09:29:19.427455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:19.427472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:19.427475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.427478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.427481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.427497Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:19.427503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:19.427510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:19.427573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.427575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.427580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.427583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:19.427585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:19.427657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:19.427659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.427676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.427688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.427707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:19.427725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.427727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.427729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.427755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:19.427769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:19.427784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:19.427786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:19.427820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.427822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:19.428047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:19.428052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:19.428054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:19.428060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:19.428418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010610:4782], now have 1 active actors on pipe
2025-10-02T09:29:19.428425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010394:2446], now have 1 active actors on pipe
2025-10-02T09:29:19.428894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 383
2025-10-02T09:29:19.428934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 383
2025-10-02T09:29:19.429064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.429074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.429100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:19.429110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.429115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.429117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:19.429126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.429138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:19.429153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.429703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.429710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.429728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.429948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0
2025-10-02T09:29:19.430396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972205f4-42351184-ded1b4ef-de17df97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:19.433984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Write session: try to update token
2025-10-02T09:29:19.434012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:19.441890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:19.441909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:19.441915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:19.441917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:19.441925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.441929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.441933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554118593489858:4248]
2025-10-02T09:29:19.441970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:19.441977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.441979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:19.442126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:19.445113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:19.445125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:19.445129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:19.459755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:19.462489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:19.484931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554118669010624:4289]
2025-10-02T09:29:19.489137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7556554118669010624:4289]
2025-10-02T09:29:19.617970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:19.618327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.618334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.618351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010624:4289], now have 1 active actors on pipe
2025-10-02T09:29:19.621193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:19.622639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:19.622651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Write session will restart in 0.008153s
2025-10-02T09:29:19.622674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Write session: Do CDS request
2025-10-02T09:29:19.622680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:19.622074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554118669010624:4289]
2025-10-02T09:29:19.622109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:19.622175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0
2025-10-02T09:29:19.622358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0 is DEAD
2025-10-02T09:29:19.622468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:19.632475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.633060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:19.633080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-10-02T09:29:19.633385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.633411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:19.633416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:19.633420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:19.633869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-10-02T09:29:19.633894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:19.633896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:19.633899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:19.633904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554118669010666:4793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:19.634386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554118669010666:4793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:19.644725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554118669010666:4793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:19.652977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554118669010666:4793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:19.652999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554118669010666:4793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:19.653003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554118669010666:4793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:19.653011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:19.658623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:19.661208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:19.661506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:19.661510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:19.661520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:19.661573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:19.661607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554118593490110:4261]
2025-10-02T09:29:19.662208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:19.662645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:19.662684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:19.662996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:19.663042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.663043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.663045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.663046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.663047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.663048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.663049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.663050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.663052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.663053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.663054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.663055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.663060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.663072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.663076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.663080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.663084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.663089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.663093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.663113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.663118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.663122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.663125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.663129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.663136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.663143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.663149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.663154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.663159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.663164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.663168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.663173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.663178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.663184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.663188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.663193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.663198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.663202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.663206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.663211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.663217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.663222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.663226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.663231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.663235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.663240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.663244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.663248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.663282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:19.673125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:19.674820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:19.674826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:19.674829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:19.674833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:19.674841Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [2:7556554118593490110:4261]
2025-10-02T09:29:19.674857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:19.674877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:19.674880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.674883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.674886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.674901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:19.674910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:19.674917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:19.674984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.674987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.674989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.674993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:19.674996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:19.675178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:19.675182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.675199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.675211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.675228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:19.675247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.675250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.675252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.675270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:19.675284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:19.675299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:19.675302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:19.675336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.675339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:19.675670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:19.675675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:19.675677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:19.675683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:19.676020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010839:4793], now have 1 active actors on pipe
2025-10-02T09:29:19.676027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010643:2446], now have 1 active actors on pipe
2025-10-02T09:29:19.680659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 384
2025-10-02T09:29:19.680699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 384
2025-10-02T09:29:19.684853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.684872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.684913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:19.684924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.684929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.684932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:19.684943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.684957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:19.684976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.688915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.688934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.688982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.689216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 36 sessionId: src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0
2025-10-02T09:29:19.690668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a387c-f28038fe-656b1c26-6b4d1d7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:19.693560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Write session: try to update token
2025-10-02T09:29:19.693578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:19.693053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:19.693069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:19.693071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:19.693073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:19.693082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.693086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.693090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554118593490104:4261]
2025-10-02T09:29:19.693126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:19.693133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.693136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:19.693278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:19.697106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:19.697116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:19.697120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:19.714562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:19.717229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:19.722053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554118669010871:4289]
2025-10-02T09:29:19.722267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7556554118669010871:4289]
2025-10-02T09:29:19.850987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:19.851340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.851353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.851387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010871:4289], now have 1 active actors on pipe
2025-10-02T09:29:19.852064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:19.852386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:19.852474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0
2025-10-02T09:29:19.852666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0 is DEAD
2025-10-02T09:29:19.852796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554118669010871:4289]
2025-10-02T09:29:19.852933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:19.853064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:19.853082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Write session will restart in 0.008413s
2025-10-02T09:29:19.853113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Write session: Do CDS request
2025-10-02T09:29:19.853121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:19.865336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.865325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:19.865344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-10-02T09:29:19.865853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:19.865887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:19.865892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:19.865896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:19.866273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-10-02T09:29:19.866297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:19.866299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:19.866303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:19.866308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554118669011055:4799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:19.866773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554118669011055:4799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:19.867480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:19.868958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554118669011055:4799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:19.869851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:19.870015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:19.870018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:19.870027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:19.870080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:19.870113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554118593490324:4266]
2025-10-02T09:29:19.870680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:19.871037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:19.871092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:19.871353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554118669011055:4799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:19.871368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554118669011055:4799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:19.871371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554118669011055:4799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:19.871390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:19.871449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:19.871524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.871531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.871532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.871533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.871534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.871536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.871537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.871538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.871540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.871541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.871542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.871543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.871549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.871560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.871565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.871569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.871574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.871579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.871582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.871586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.871590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.871594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.871598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.871602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.871609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.871617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:19.871629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.871635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:19.871640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.871646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:19.871650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.871656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:19.871660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.871665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:19.871670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.871676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:19.871681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.871687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:19.871692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.871698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:19.871703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.871708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:19.871713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.871722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.871727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.871731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.871739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.871744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.871780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:19.881003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:19.882739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:19.882762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:19.882765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:19.882769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:19.882776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [2:7556554118593490324:4266]
2025-10-02T09:29:19.882791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:19.882808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:19.882816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.882820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.882822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.882839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:19.882848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:19.882855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:19.882923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.882936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.882939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.882942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:19.882944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:19.883019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:19.883028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.883043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:19.883055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:19.883079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:19.883117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669010884:2446], now have 1 active actors on pipe
2025-10-02T09:29:19.883125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669011094:4799], now have 1 active actors on pipe
2025-10-02T09:29:19.883132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.883135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.883138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.883152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:19.883170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:19.883176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:19.883179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:19.883181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:19.883135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 385
2025-10-02T09:29:19.883191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:19.883184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 385
2025-10-02T09:29:19.883195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:19.883234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.883248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:19.883260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.883263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:19.883264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.883509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:19.883523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:19.883527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:19.883529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:19.883538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:19.883548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:19.883577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.883940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0
2025-10-02T09:29:19.884895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|299a6f5f-da783fca-f8b0188f-1f1fea19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:19.883800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:19.883809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:19.883825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:19.887496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Write session: try to update token
2025-10-02T09:29:19.887513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:19.894972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:19.894992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:19.894997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:19.895018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:19.895033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.895045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.895092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554118593490319:4266]
2025-10-02T09:29:19.895146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:19.895163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:19.895165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:19.895177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:19.895190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:19.895197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:19.895331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:19.926576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:19.929501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:19.953398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554118669011105:4289]
2025-10-02T09:29:19.953901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7556554118669011105:4289]
2025-10-02T09:29:20.040844Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:20.041525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.041537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.041553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554118669011105:4289], now have 1 active actors on pipe
2025-10-02T09:29:20.041824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:20.041877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554118669011105:4289]
2025-10-02T09:29:20.041837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:20.041884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:20.041963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0
2025-10-02T09:29:20.042152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0 is DEAD
2025-10-02T09:29:20.042292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:20.042303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Write session will restart in 0.006231s
2025-10-02T09:29:20.042343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Write session: Do CDS request
2025-10-02T09:29:20.042349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:20.049362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.049614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:20.049636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-10-02T09:29:20.049767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.049797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:20.049805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:20.049817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:20.050296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-10-02T09:29:20.050327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:20.050328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:20.050330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:20.050335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554122963978424:4803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:20.050844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554122963978424:4803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:20.054579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554122963978424:4803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:20.057739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554122963978424:4803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:20.057756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554122963978424:4803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:20.057760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554122963978424:4803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:20.057767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:20.059088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:20.061411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:20.061661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:20.061672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:20.061685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:20.061762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:20.061803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554122888457836:4268]
2025-10-02T09:29:20.062446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:20.062816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:20.062875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:20.063263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:20.063354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.063361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.063362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.063363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.063364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.063365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.063367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.063368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.063369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.063370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.063371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.063372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.063378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.063389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.063393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.063396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.063400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.063404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.063408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.063411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.063416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.063422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.063426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.063430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.063436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.063444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.063450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.063456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.063460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.063466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.063470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.063476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.063484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.063490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.063497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.063502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.063506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.063512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.063518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.063523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.063528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.063538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.063543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.063548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.063554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.063559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.063566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.063572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.063609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:20.073182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:20.076325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:20.076347Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:20.076349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:20.076353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:20.076359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [2:7556554122888457836:4268]
2025-10-02T09:29:20.076373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:20.076391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:20.076394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.076398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.076399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.076414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:20.076420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:20.076426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:20.076487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.076496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.076498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.076501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:20.076503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:20.076702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:20.076711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.076724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.076736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.076752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:20.076765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978403:2446], now have 1 active actors on pipe
2025-10-02T09:29:20.076768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978609:4803], now have 1 active actors on pipe
2025-10-02T09:29:20.076783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.076789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.076791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.076827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:20.076840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:20.076844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:20.076847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:20.076847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:20.076860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:20.076867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:20.076769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 386
2025-10-02T09:29:20.076848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 386
2025-10-02T09:29:20.076907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.076917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:20.076943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:20.077006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.077015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.077039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:20.077050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.077053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.077056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:20.077067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.077080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:20.077098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.077331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.077339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.077351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.077449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0
2025-10-02T09:29:20.077836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea2a960-51eed85b-931d57f2-34ce467f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:20.084762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Write session: try to update token
2025-10-02T09:29:20.084782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:20.089066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:20.089084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:20.089086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:20.089089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:20.089096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.089101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.089106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554122888457831:4268]
2025-10-02T09:29:20.089142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:20.089148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.089150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:20.089313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:20.089476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:20.089482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:20.089486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:20.108688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:20.111218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:20.141887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554122963978626:4289]
2025-10-02T09:29:20.142297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7556554122963978626:4289]
2025-10-02T09:29:20.246780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:20.247335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.247351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.247368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978626:4289], now have 1 active actors on pipe
2025-10-02T09:29:20.247638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:20.247602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:20.247658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554122963978626:4289]
2025-10-02T09:29:20.247663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:20.247666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:20.247731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0
2025-10-02T09:29:20.248100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:20.248119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Write session will restart in 0.006899s
2025-10-02T09:29:20.248140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Write session: Do CDS request
2025-10-02T09:29:20.248150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:20.247913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0 is DEAD
2025-10-02T09:29:20.257586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.259223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:20.259243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-10-02T09:29:20.259414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.259444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:20.259448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:20.259452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:20.259945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-10-02T09:29:20.259981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:20.259987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:20.259989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:20.259995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554122963978646:4808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:20.260553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554122963978646:4808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:20.267229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554122963978646:4808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:20.273252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554122963978646:4808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:20.273273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554122963978646:4808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:20.273288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554122963978646:4808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:20.273297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:20.275433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:20.279830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:20.280130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:20.280144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:20.280155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:20.280226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:20.280266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554122888458058:4271]
2025-10-02T09:29:20.280919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:20.281400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:20.281442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:20.281785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:20.281827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.281828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.281829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.281830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.281832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.281833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.281834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.281835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.281836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.281837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.281839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.281840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.281845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.281858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.281862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.281867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.281871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.281875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.281879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.281883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.281888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.281892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.281896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.281900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.281907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.281915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.281923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.281929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.281934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.281939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.281944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.281949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.281954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.281961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.281965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.281971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.281976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.281981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.281985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.281990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.281995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.282001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.282005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.282010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.282015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.282020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.282024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.282029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.282068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:20.293767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:20.295448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:20.295461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:20.295463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:20.295467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:20.295474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [2:7556554122888458058:4271]
2025-10-02T09:29:20.295486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:20.295502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:20.295505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.295511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.295513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.295526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:20.295535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:20.295541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:20.295600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.295607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.295609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.295613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:20.295615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:20.295679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:20.295686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.295697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.295713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.295733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:20.295753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978631:2446], now have 1 active actors on pipe
2025-10-02T09:29:20.295760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978838:4808], now have 1 active actors on pipe
2025-10-02T09:29:20.295766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.295768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.295770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.295784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:20.295801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:20.295811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:20.295819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:20.295821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:20.295821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:20.295823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:20.295799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 387
2025-10-02T09:29:20.295799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 387
2025-10-02T09:29:20.295860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.295872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:20.295881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:20.295886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.295890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.295927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f74b763-ba4fa8f9-25401619-4018de91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:20.295936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.295939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.295941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:20.295948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.295956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:20.295978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.296106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.296113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.296124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.296320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f74b763-ba4fa8f9-25401619-4018de91_0
2025-10-02T09:29:20.296687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3e08f5a-81b4e319-b5fbeead-5e018ce5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f74b763-ba4fa8f9-25401619-4018de91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:20.299234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Write session: try to update token
2025-10-02T09:29:20.299248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:20.309983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:20.310002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:20.310006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:20.310008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:20.310016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.310020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.310024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554122888458053:4271]
2025-10-02T09:29:20.310066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:20.310069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:20.310075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:20.310077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.310079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:20.310080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:20.310215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:20.313292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|4f74b763-ba4fa8f9-25401619-4018de91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:20.315797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:20.347724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554122963978855:4289]
2025-10-02T09:29:20.349705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7556554122963978855:4289]
2025-10-02T09:29:20.457600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:20.457981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.457996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.458033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978855:4289], now have 1 active actors on pipe
2025-10-02T09:29:20.458238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:20.458671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554122963978855:4289]
2025-10-02T09:29:20.458710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:20.458776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f74b763-ba4fa8f9-25401619-4018de91_0
2025-10-02T09:29:20.458943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|4f74b763-ba4fa8f9-25401619-4018de91_0 is DEAD
2025-10-02T09:29:20.459011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:20.459302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:20.459369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Write session will restart in 0.007361s
2025-10-02T09:29:20.459397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Write session: Do CDS request
2025-10-02T09:29:20.459403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:20.468468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.468824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:20.468847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-10-02T09:29:20.469002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.469032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:20.469037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:20.469041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:20.469429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-10-02T09:29:20.469467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:20.469469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:20.469470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:20.469475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554122963978883:4813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:20.469978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554122963978883:4813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:20.473169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554122963978883:4813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:20.478511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554122963978883:4813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:20.478528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554122963978883:4813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:20.478532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554122963978883:4813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:20.478539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:20.481226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:20.483019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:20.483303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:20.483316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:20.483330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:20.483395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:20.483436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554122888458285:4274]
2025-10-02T09:29:20.483988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:20.484547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:20.484608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:20.484967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:20.485032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.485042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.485043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.485044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.485045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.485046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.485047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.485048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.485049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.485050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.485051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.485052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.485059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.485068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.485072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.485075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.485079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.485082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.485085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.485089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.485093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.485097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.485100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.485104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.485111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.485118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.485124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.485129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.485133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.485138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.485142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.485147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.485151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.485155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.485159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.485164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.485168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.485172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.485176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.485182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.485189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.485194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.485198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.485203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.485206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.485212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.485216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.485221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.485253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:20.498292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:20.500384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:20.500390Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:20.500392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:20.500396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:20.500402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [2:7556554122888458285:4274]
2025-10-02T09:29:20.500416Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:20.500434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:20.500438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.500441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.500442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.500460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:20.500465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:20.500470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:20.500539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.500541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.500542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.500545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:20.500548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:20.500620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:20.500622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.500637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.500649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.500666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:20.500684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.500689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.500691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.500707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:20.500720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:20.500735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:20.500737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:20.500772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.500773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:20.500774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:20.500777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:20.500779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:20.500786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:20.500993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963978869:2446], now have 1 active actors on pipe
2025-10-02T09:29:20.501005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979077:4813], now have 1 active actors on pipe
2025-10-02T09:29:20.501201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 388
2025-10-02T09:29:20.501243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 388
2025-10-02T09:29:20.501384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.501400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.501434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:20.501446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.501454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.501456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:20.501466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.501478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:20.501500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.501700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.501713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.501733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.501852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 36 sessionId: src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0
2025-10-02T09:29:20.502162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f74b763-ba4fa8f9-25401619-4018de91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:20.504900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Write session: try to update token
2025-10-02T09:29:20.504918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:20.515931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:20.515954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:20.515957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:20.515959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:20.515967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.515971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.515975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554122888458280:4274]
2025-10-02T09:29:20.516011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:20.516016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.516019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:20.516032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:20.516038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:20.516042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:20.516174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:20.520017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:20.522473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:20.558145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554122963979092:4289]
2025-10-02T09:29:20.558473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7556554122963979092:4289]
2025-10-02T09:29:20.664425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:20.664677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.664692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.664726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979092:4289], now have 1 active actors on pipe
2025-10-02T09:29:20.664955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:20.667595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:20.667645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554122963979092:4289]
2025-10-02T09:29:20.667666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:20.667728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0
2025-10-02T09:29:20.667895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0 is DEAD
2025-10-02T09:29:20.672084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:20.672094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Write session will restart in 0.008623s
2025-10-02T09:29:20.672118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Write session: Do CDS request
2025-10-02T09:29:20.672123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:20.682414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.683503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:20.683520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-10-02T09:29:20.683834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.683867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:20.683871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:20.683874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:20.684211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-10-02T09:29:20.684236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:20.684237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:20.684239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:20.684243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554122963979284:4823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:20.684680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554122963979284:4823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:20.687016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:20.687303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554122963979284:4823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:20.690156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:20.690450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:20.690455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:20.690467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:20.690530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:20.690562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554122888458529:4286]
2025-10-02T09:29:20.691139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:20.691565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:20.691853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554122963979284:4823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:20.691870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554122963979284:4823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:20.691873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554122963979284:4823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:20.691881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:20.691618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:20.691937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:20.691993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.691994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.691995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.691996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.691997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.691998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.691999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.692000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.692001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.692002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.692003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.692004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.692010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.692019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.692022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.692026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.692029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.692032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.692035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.692039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.692043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.692047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.692050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.692053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.692061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.692067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.692073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.692077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.692081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.692085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.692089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.692093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.692097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.692101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.692104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.692108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.692112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.692118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.692122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.692127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.692132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.692137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.692140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.692144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.692148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.692153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.692156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.692160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.692193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:20.707821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:20.709645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:20.709662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:20.709665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:20.709669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:20.709676Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [2:7556554122888458529:4286]
2025-10-02T09:29:20.709690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:20.709708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:20.709712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.709715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.709721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.709736Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:20.709741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:20.709754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:20.709809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.709820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.709822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.709825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:20.709827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:20.709904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:20.709915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.709927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.709937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.709951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:20.709967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.709969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.709972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.709979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:20.709991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:20.709993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:20.709997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:20.709999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:20.710005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:20.710008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:20.710017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979112:2446], now have 1 active actors on pipe
2025-10-02T09:29:20.710021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979319:4823], now have 1 active actors on pipe
2025-10-02T09:29:20.710050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.710060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:20.710085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:20.710134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 389
2025-10-02T09:29:20.710139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 389
2025-10-02T09:29:20.710414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.710425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.710448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:20.710455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.710461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.710464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:20.710473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.710484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:20.710497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.710713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.710720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.710735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.710835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 36 sessionId: src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0
2025-10-02T09:29:20.711202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a8fc0-dbf71789-28f7348d-20e04df9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:20.713894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Write session: try to update token
2025-10-02T09:29:20.713910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:20.728124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:20.728564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:20.728579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:20.728581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:20.728585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:20.728593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.728597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.728601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554122888458523:4286]
2025-10-02T09:29:20.728635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:20.728641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.728643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:20.728650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:20.728657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:20.728661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:20.730718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:20.728819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:20.768051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554122963979345:4289]
2025-10-02T09:29:20.768327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7556554122963979345:4289]
2025-10-02T09:29:20.874356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:20.874682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.874695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.874731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979345:4289], now have 1 active actors on pipe
2025-10-02T09:29:20.874957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:20.875367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:20.875447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0
2025-10-02T09:29:20.875811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:20.875894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Write session will restart in 0.007443s
2025-10-02T09:29:20.875920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Write session: Do CDS request
2025-10-02T09:29:20.875926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:20.875744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0 is DEAD
2025-10-02T09:29:20.875919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554122963979345:4289]
2025-10-02T09:29:20.875931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:20.884331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.884502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:20.884521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-10-02T09:29:20.884647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:20.884680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:20.884691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:20.884694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:20.885177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-10-02T09:29:20.885213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:20.885214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:20.885216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:20.885221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554122963979385:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:20.885732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554122963979385:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:20.892058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554122963979385:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:20.895946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:20.896049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554122963979385:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:20.896070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554122963979385:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:20.896074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554122963979385:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:20.896082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:20.897837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:20.898023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:20.898031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:20.898041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:20.898089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:20.898127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554122888458758:4291]
2025-10-02T09:29:20.898709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:20.898992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:20.899035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:20.899352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:20.899436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.899442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.899442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.899443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.899444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.899445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.899446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.899447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.899448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.899449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.899450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.899451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.899456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.899465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.899469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.899473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.899476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.899480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.899483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.899487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.899490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.899494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.899497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.899500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.899508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.899515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:20.899520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.899524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:20.899528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.899532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:20.899536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.899540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:20.899544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.899549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:20.899556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.899562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:20.899570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.899574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:20.899578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.899584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:20.899591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.899596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:20.899600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.899606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.899610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.899614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.899618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.899622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.899653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:20.914308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:20.916206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:20.916221Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:20.916224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:20.916228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:20.916234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [2:7556554122888458758:4291]
2025-10-02T09:29:20.916247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:20.916264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:20.916267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.916270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.916271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.916286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:20.916292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:20.916298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:20.916362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.916369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.916372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.916375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:20.916377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:20.916446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:20.916452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.916465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:20.916474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:20.916490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:20.916505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.916507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.916509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.916516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:20.916527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:20.916529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:20.916530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:20.916533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:20.916543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:20.916545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:20.916556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979351:2446], now have 1 active actors on pipe
2025-10-02T09:29:20.916560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979563:4829], now have 1 active actors on pipe
2025-10-02T09:29:20.916593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.916603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:20.916615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:20.916874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 390
2025-10-02T09:29:20.916882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 390
2025-10-02T09:29:20.917129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.917144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.917179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:20.917187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:20.917191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:20.917193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:20.917204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:20.917214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:20.917229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.920816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.920832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.920861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:20.920976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0
2025-10-02T09:29:20.921362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab35f8-ba0889c2-96ec28b9-1bfae2f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:20.924095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Write session: try to update token
2025-10-02T09:29:20.924112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:20.941181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:20.941201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:20.941213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.941254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:20.941426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:20.941563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:20.941699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:20.941854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:20.942033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:20.942070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:20.942217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:20.942428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:20.944976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:20.945273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:20.945290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:20.945318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:20.945473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:20.954369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:20.954393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:20.954395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:20.954397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:20.954407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.954411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.954415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554122888458752:4291]
2025-10-02T09:29:20.954453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:20.954458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:20.954461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:20.954629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:20.956894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:20.956909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:20.956913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:20.976905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554122963979575:4289]
2025-10-02T09:29:20.977394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7556554122963979575:4289]
2025-10-02T09:29:21.100203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:21.107612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.107634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.107806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.107869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.107938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.108008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.108048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.108058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.108122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.108180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.108244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.108304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.108345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.108348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.108414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.108471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.108525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.108582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.108620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.108624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.108686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.108748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.108939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.109017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.109122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.109133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.109209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.109264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.109319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.109468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.109587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.109591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.109660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.109717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.109775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.109832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.109875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.109878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.109944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.110050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.110148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.110229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.110287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.110290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.110357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.110411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.110506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.110600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.110644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.110647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.110710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.110761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.110818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.110880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.110920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.110922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.110987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:21.111039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:21.111106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:21.111162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:21.111284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:21.111287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:21.111360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554122963979575:4289], now have 1 active actors on pipe
2025-10-02T09:29:21.111601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554122963979575:4289]
2025-10-02T09:29:21.111630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:21.111938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:21.111951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:21.111974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: error at write: Disconnected sessionId: src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0
2025-10-02T09:29:21.112099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:21.112148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0 is DEAD
2025-10-02T09:29:21.112291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:21.112300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Write session will restart in 0.005148s
2025-10-02T09:29:21.112321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Write session: Do CDS request
2025-10-02T09:29:21.112327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:21.118290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.118437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:21.118460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-10-02T09:29:21.118590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.118629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:21.118638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:21.118642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:21.119021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-10-02T09:29:21.119059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:21.119065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:21.119067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:21.119072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554127258946890:4834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:21.119621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554127258946890:4834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:21.122584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554127258946890:4834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:21.126048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554127258946890:4834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:21.126061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554127258946890:4834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:21.126063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554127258946890:4834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:21.126069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:21.128901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:21.131115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:21.131310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:21.131323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:21.131332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:21.131377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:21.131413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554127183426274:4294]
2025-10-02T09:29:21.132032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:21.132328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:21.132374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:21.132678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:21.132756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.132762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.132763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.132764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.132765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.132766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.132767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.132769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.132770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.132770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.132772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.132773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.132778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.132789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.132792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.132796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.132816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.132820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.132823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.132826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.132829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.132835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.132838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.132841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.132848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.132856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.132862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.132866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.132870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.132874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.132879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.132883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.132887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.132892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.132896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.132901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.132906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.132910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.132914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.132924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.132929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.132940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.132952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.132956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.132960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.132965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.132973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.132978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.133010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:21.144294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:21.146170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:21.146185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:21.146187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:21.146191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:21.146197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [2:7556554127183426274:4294]
2025-10-02T09:29:21.146211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:21.146226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:21.146229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.146231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.146234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.146248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:21.146253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:21.146265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:21.146324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.146332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.146334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.146337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:21.146339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:21.146407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:21.146417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.146429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.146440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.146453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:21.146470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.146472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.146474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.146482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:21.146494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:21.146494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:21.146497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:21.146499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:21.146507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:21.146509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:21.146518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258946874:2446], now have 1 active actors on pipe
2025-10-02T09:29:21.146522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947048:4834], now have 1 active actors on pipe
2025-10-02T09:29:21.146553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.146561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:21.146588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 391
2025-10-02T09:29:21.146614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:21.146638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 391
2025-10-02T09:29:21.146787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.146794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.146816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:21.146822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.146825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.146829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:21.146838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.146845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:21.146857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.147101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.147106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.147118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.147241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 36 sessionId: src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0
2025-10-02T09:29:21.147684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b76ae9-97055d7b-e819e93a-61fdedf9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:21.150316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Write session: try to update token
2025-10-02T09:29:21.150331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:21.158436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:21.158455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:21.158458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:21.158460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:21.158467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.158472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.158479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554127183426269:4294]
2025-10-02T09:29:21.158513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:21.158520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.158523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:21.158526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:21.158533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:21.158539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:21.158652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:21.167371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:21.169907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:21.212061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554127258947103:4289]
2025-10-02T09:29:21.212430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7556554127258947103:4289]
2025-10-02T09:29:21.320073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:21.320464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.320482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.320520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947103:4289], now have 1 active actors on pipe
2025-10-02T09:29:21.320798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:21.321299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:21.321311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Write session will restart in 0.009394s
2025-10-02T09:29:21.320835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554127258947103:4289]
2025-10-02T09:29:21.321332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Write session: Do CDS request
2025-10-02T09:29:21.320869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:21.321339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:21.320902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:21.320904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:21.320957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: error at write: Disconnected sessionId: src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0
2025-10-02T09:29:21.321140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0 is DEAD
2025-10-02T09:29:21.332450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.332745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:21.332767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-10-02T09:29:21.332886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.332925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:21.332929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:21.332933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:21.333472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-10-02T09:29:21.333509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:21.333517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:21.333520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:21.333525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554127258947205:4838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:21.334006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554127258947205:4838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:21.338969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:21.341042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:21.341378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:21.341392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:21.341405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:21.341465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:21.341524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554127183426492:4296]
2025-10-02T09:29:21.341523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554127258947205:4838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:21.342143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:21.342442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:21.342487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:21.342799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:21.342851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.342856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.342857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.342858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.342859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.342860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.342861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.342862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.342863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.342864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.342865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.342866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.342871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.342881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.342884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.342887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.342890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.342893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.342896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.342900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.342903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.342908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.342911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.342914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.342920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.342926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.342931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.342936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.342939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.342944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.342948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.342952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.342956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.342961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.342964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.342969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.342974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.342979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.342982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.342987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.342991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.342995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.342999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.343004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.343008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.343012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.343015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.343020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.343051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:21.348014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554127258947205:4838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:21.348040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554127258947205:4838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:21.348043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554127258947205:4838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:21.348050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:21.353654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:21.355921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:21.355942Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:21.355945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:21.355950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:21.355958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [2:7556554127183426492:4296]
2025-10-02T09:29:21.355974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:21.355996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:21.355999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.356003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.356005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.356024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:21.356035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:21.356043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:21.356122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.356129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.356131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.356135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:21.356138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:21.356217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:21.356224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.356239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.356253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.356274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:21.356299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.356306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.356308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.356321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:21.356339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947105:2446], now have 1 active actors on pipe
2025-10-02T09:29:21.356342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:21.356346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:21.356347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947325:4838], now have 1 active actors on pipe
2025-10-02T09:29:21.356348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:21.356356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:21.356370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:21.356377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:21.356421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.356394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 392
2025-10-02T09:29:21.356429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:21.356393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 392
2025-10-02T09:29:21.356436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:21.356481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.356486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.356521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:21.356533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.356543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.356545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:21.356557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.356572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:21.356590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.356750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.356766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.356791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.356907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 36 sessionId: src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0
2025-10-02T09:29:21.357291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8bb33e5-9f6f5b86-558c2147-a653b8fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:21.359971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Write session: try to update token
2025-10-02T09:29:21.359986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:21.368499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:21.368516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:21.368519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:21.368521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:21.368532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.368537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.368542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554127183426487:4296]
2025-10-02T09:29:21.368585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:21.368602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.368604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:21.368611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:21.368612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:21.368617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:21.368777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:21.378558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:21.381104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:21.420884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554127258947344:4289]
2025-10-02T09:29:21.421202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7556554127258947344:4289]
2025-10-02T09:29:21.519509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:21.519943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.519961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.519978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947344:4289], now have 1 active actors on pipe
2025-10-02T09:29:21.520195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:21.520186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554127258947344:4289]
2025-10-02T09:29:21.520196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:21.520199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:21.520224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:21.520257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0
2025-10-02T09:29:21.520414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0 is DEAD
2025-10-02T09:29:21.520510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:21.520521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Write session will restart in 0.008507s
2025-10-02T09:29:21.520544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Write session: Do CDS request
2025-10-02T09:29:21.520550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:21.530282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.530446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:21.530464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-10-02T09:29:21.530583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.530625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:21.530648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:21.530652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:21.531067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-10-02T09:29:21.531107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:21.531114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:21.531115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:21.531120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554127258947465:4845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:21.531621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554127258947465:4845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:21.533749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554127258947465:4845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:21.534253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:21.536336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:21.536393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554127258947465:4845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:21.536406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554127258947465:4845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:21.536408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554127258947465:4845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:21.536415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:21.536568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:21.536581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:21.536591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:21.536641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:21.536682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554127183426725:4299]
2025-10-02T09:29:21.537288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:21.537526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:21.537564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:21.537871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:21.537924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.537931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.537933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.537934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.537935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.537937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.537938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.537939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.537940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.537941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.537943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.537944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.537949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.537959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.537964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.537968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.537973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.537977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.537981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.537986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.537990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.537995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.537999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.538003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.538010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.538018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.538024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.538031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.538036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.538041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.538046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.538052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.538056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.538062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.538066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.538072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.538077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.538082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.538087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.538091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.538095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.538099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.538104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.538110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.538114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.538120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.538132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.538137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.538174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:21.547306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:21.549239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:21.549256Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:21.549259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:21.549262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:21.549269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [2:7556554127183426725:4299]
2025-10-02T09:29:21.549282Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:21.549297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:21.549300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.549303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.549305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.549320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:21.549331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:21.549337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:21.549390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.549393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.549395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.549398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:21.549401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:21.549474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:21.549481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.549495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.549507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.549529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:21.549553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947566:4845], now have 1 active actors on pipe
2025-10-02T09:29:21.549557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947350:2446], now have 1 active actors on pipe
2025-10-02T09:29:21.549563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.549565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.549568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.549578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:21.549589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:21.549593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:21.549596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:21.549598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:21.549601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:21.549604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:21.549631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.549638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:21.549642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:21.549621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 393
2025-10-02T09:29:21.549627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 393
2025-10-02T09:29:21.549664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.549673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.549700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:21.549709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.549713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.549715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:21.549723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.549735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:21.549759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.549885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.549893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.549906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.549977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0
2025-10-02T09:29:21.550322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18703a9a-87127b4c-a1d397b7-d43fda42_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:21.553115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Write session: try to update token
2025-10-02T09:29:21.553134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:21.561375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:21.561393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:21.561395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:21.561398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:21.561407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.561411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.561415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554127183426720:4299]
2025-10-02T09:29:21.561453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:21.561457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:21.561460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.561462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:21.561463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:21.561467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:21.561591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:21.566436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:21.568986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:21.620546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554127258947577:4289]
2025-10-02T09:29:21.620844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7556554127258947577:4289]
2025-10-02T09:29:21.695964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:21.696322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.696336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.696371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947577:4289], now have 1 active actors on pipe
2025-10-02T09:29:21.696566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554127258947577:4289]
2025-10-02T09:29:21.696588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:21.696569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:21.696598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:21.696601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:21.696671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: error at write: Disconnected sessionId: src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0
2025-10-02T09:29:21.696848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0 is DEAD
2025-10-02T09:29:21.696986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:21.696997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Write session will restart in 0.008039s
2025-10-02T09:29:21.697022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Write session: Do CDS request
2025-10-02T09:29:21.697028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:21.706280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.706366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:21.706384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-10-02T09:29:21.706478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.706507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:21.706516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:21.706520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:21.706820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-10-02T09:29:21.706854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:21.706860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:21.706862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:21.706867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554127258947702:4855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:21.707301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554127258947702:4855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:21.709429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554127258947702:4855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:21.710036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:21.710629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:21.710784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:21.710792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:21.710802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:21.710851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:21.710882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554127183426976:4311]
2025-10-02T09:29:21.711403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:21.712419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:21.712476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:21.712729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554127258947702:4855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:21.712744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554127258947702:4855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:21.712747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554127258947702:4855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:21.712754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:21.712791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:21.712865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.712871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.712872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.712873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.712874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.712875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.712876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.712878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.712879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.712880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.712881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.712882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.712887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.712896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.712900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.712904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.712908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.712912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.712916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.712919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.712923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.712927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.712931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.712934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.712942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.712949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.712954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.712966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.712969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.712974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.712978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.712983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.712987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.712991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.712995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.712999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.713003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.713008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.713011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.713016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.713026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.713031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.713036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.713041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.713045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.713049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.713053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.713057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.713090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:21.723471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:21.725233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:21.725248Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:21.725250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:21.725254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:21.725260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [2:7556554127183426976:4311]
2025-10-02T09:29:21.725278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:21.725293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:21.725301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.725304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.725306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.725320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:21.725328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:21.725337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:21.725400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.725405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.725407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.725411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:21.725413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:21.725476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:21.725482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.725496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.725508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.725528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:21.725549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947582:2446], now have 1 active actors on pipe
2025-10-02T09:29:21.725556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947810:4855], now have 1 active actors on pipe
2025-10-02T09:29:21.725561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.725564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.725566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.725577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:21.725593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:21.725595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:21.725608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:21.725610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:21.725613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:21.725617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:21.725645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.725658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:21.725678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:21.725652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 394
2025-10-02T09:29:21.725698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 394
2025-10-02T09:29:21.725923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.725937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.725959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a73937af-1396675e-7cfbce04-7a1585c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:21.725967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.725971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.725973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:21.725982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.725994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:21.726008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.726183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.726188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.726200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.726271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 36 sessionId: src_id|a73937af-1396675e-7cfbce04-7a1585c5_0
2025-10-02T09:29:21.726612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef9ac1ad-c9c0ea87-6f4e778-8ec98ef2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a73937af-1396675e-7cfbce04-7a1585c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:21.729288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Write session: try to update token
2025-10-02T09:29:21.729308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:21.737271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:21.737286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:21.737288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:21.737290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:21.737297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.737300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.737304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554127183426971:4311]
2025-10-02T09:29:21.737338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:21.737344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.737346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:21.737349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:21.737354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:21.737358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:21.737498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:21.743386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|a73937af-1396675e-7cfbce04-7a1585c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:21.745917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:21.796663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554127258947839:4289]
2025-10-02T09:29:21.796932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7556554127258947839:4289]
2025-10-02T09:29:21.870069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:21.870420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.870431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.870449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947839:4289], now have 1 active actors on pipe
2025-10-02T09:29:21.870617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:21.870704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:21.870704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554127258947839:4289]
2025-10-02T09:29:21.870719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:21.870720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:21.870764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: error at write: Disconnected sessionId: src_id|a73937af-1396675e-7cfbce04-7a1585c5_0
2025-10-02T09:29:21.870920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|a73937af-1396675e-7cfbce04-7a1585c5_0 is DEAD
2025-10-02T09:29:21.871033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:21.871041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Write session will restart in 0.005023s
2025-10-02T09:29:21.871060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Write session: Do CDS request
2025-10-02T09:29:21.871075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:21.877272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.877435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:21.877454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-10-02T09:29:21.877667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:21.877736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:21.877748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:21.877754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:21.878438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-10-02T09:29:21.878468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:21.878472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:21.878475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:21.878479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554127258947885:4861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:21.878859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554127258947885:4861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:21.881969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554127258947885:4861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:21.884955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:21.885365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554127258947885:4861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:21.885383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554127258947885:4861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:21.885386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554127258947885:4861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:21.885393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:21.885439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:21.885596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:21.885608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:21.885617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:21.885657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:21.885691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554127183427208:4316]
2025-10-02T09:29:21.886224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:21.887662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:21.887715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:21.888016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:21.888080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.888086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.888087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.888088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.888089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.888089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.888090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.888091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.888092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.888093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.888094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.888095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.888100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.888110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.888114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.888117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.888120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.888123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.888127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.888130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.888133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.888137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.888140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.888143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.888151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.888158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:21.888163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.888167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:21.888171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.888175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:21.888179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.888184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:21.888188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.888192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:21.888196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.888200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:21.888204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.888209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:21.888213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.888218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:21.888221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.888225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:21.888229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.888233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.888241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.888245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.888249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.888253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.888307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:21.898733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:21.900485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:21.900505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:21.900509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:21.900513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:21.900519Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [2:7556554127183427208:4316]
2025-10-02T09:29:21.900533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:21.900551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:21.900558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.900561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.900564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.900578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:21.900584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:21.900591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:21.900647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.900656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.900658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.900661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:21.900663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:21.900731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:21.900740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.900754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:21.900766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:21.900789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:21.900843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258948059:4861], now have 1 active actors on pipe
2025-10-02T09:29:21.900855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.900858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.900860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.900874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:21.900888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258947842:2446], now have 1 active actors on pipe
2025-10-02T09:29:21.900895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:21.900898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:21.900900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:21.900901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:21.900917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:21.900925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:21.900961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.900975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:21.900980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:21.900969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 395
2025-10-02T09:29:21.901020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.901029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.901050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30b59309-f70525b8-439ca057-40e4a66e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:21.901060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:21.901063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:21.901065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:21.901075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:21.901089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:21.901078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 395
2025-10-02T09:29:21.901105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.901286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:21.901294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:21.901307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:21.901389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 36 sessionId: src_id|30b59309-f70525b8-439ca057-40e4a66e_0
2025-10-02T09:29:21.901791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73937af-1396675e-7cfbce04-7a1585c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30b59309-f70525b8-439ca057-40e4a66e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:21.905360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Write session: try to update token
2025-10-02T09:29:21.905380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:21.911940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:21.911964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:21.911972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.912013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:21.912014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:21.912181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:21.912325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:21.912457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:21.912621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:21.912795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:21.912851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:21.924611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:21.924634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:21.924637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:21.924642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:21.924650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.924654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.924658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554127183427202:4316]
2025-10-02T09:29:21.924698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:21.924704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:21.924707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:21.924711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:21.924717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:21.924721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:21.924863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:21.928254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|30b59309-f70525b8-439ca057-40e4a66e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:21.935641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:21.970749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554127258948071:4289]
2025-10-02T09:29:21.971036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7556554127258948071:4289]
2025-10-02T09:29:22.072869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:22.073367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.073383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.073403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554127258948071:4289], now have 1 active actors on pipe
2025-10-02T09:29:22.073670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:22.074045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554127258948071:4289]
2025-10-02T09:29:22.074079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:22.074138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30b59309-f70525b8-439ca057-40e4a66e_0
2025-10-02T09:29:22.074316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|30b59309-f70525b8-439ca057-40e4a66e_0 is DEAD
2025-10-02T09:29:22.074433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:22.074657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:22.074669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Write session will restart in 0.008336s
2025-10-02T09:29:22.074693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Write session: Do CDS request
2025-10-02T09:29:22.074699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:22.084383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.084472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:22.084490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-10-02T09:29:22.084705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.084736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:22.084742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:22.084746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:22.085244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-10-02T09:29:22.085276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:22.085278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:22.085279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:22.085284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554131553915378:4865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:22.085881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554131553915378:4865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:22.088484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554131553915378:4865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:22.091305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554131553915378:4865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:22.091322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554131553915378:4865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:22.091327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554131553915378:4865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:22.091334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:22.105106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:22.107756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:22.107956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:22.107966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:22.107976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:22.108022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:22.108064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554131478394730:4318]
2025-10-02T09:29:22.108727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:22.109095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:22.109145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:22.109468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:22.109523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.109529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.109531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.109532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.109533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.109534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.109535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.109537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.109538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.109539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.109540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.109542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.109546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.109559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.109563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.109567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.109571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.109576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.109580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.109584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.109589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.109593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.109598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.109602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.109609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.109617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.109628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.109634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.109643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.109649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.109653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.109659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.109668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.109672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.109679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.109683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.109687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.109692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.109696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.109700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.109705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.109714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.109718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.109725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.109730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.109735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.109739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.109745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.109792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:22.118792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:22.120767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:22.120782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:22.120785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:22.120789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:22.120796Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [2:7556554131478394730:4318]
2025-10-02T09:29:22.120825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:22.120841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:22.120845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.120848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.120850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.120863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:22.120868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:22.120876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:22.120931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.120940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.120942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.120945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:22.120948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:22.121013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:22.121020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.121035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.121053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.121076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:22.121098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915418:4865], now have 1 active actors on pipe
2025-10-02T09:29:22.121106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915370:2446], now have 1 active actors on pipe
2025-10-02T09:29:22.121113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.121116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.121118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.121131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:22.121143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:22.121151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:22.121158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:22.121161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:22.121162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:22.121163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:22.121195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.121203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:22.121176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 396
2025-10-02T09:29:22.121212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:22.121178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 396
2025-10-02T09:29:22.121236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.121244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.121274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:22.121284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.121289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.121295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:22.121305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.121312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:22.121325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.121479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.121487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.121498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.121563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 36 sessionId: src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0
2025-10-02T09:29:22.121912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b59309-f70525b8-439ca057-40e4a66e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:22.124772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Write session: try to update token
2025-10-02T09:29:22.124786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:22.137139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:22.137157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.137168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.137215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:22.137219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:22.137410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:22.137547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:22.137687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:22.137811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:22.137993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:22.138029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:22.139789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:22.142864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:22.142878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.142880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:22.142882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:22.142889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.142892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.142896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554131478394725:4318]
2025-10-02T09:29:22.142925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:22.142931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.142934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:22.142933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:22.142940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:22.142944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:22.143063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:22.143799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:22.174504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554131553915603:4289]
2025-10-02T09:29:22.174729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7556554131553915603:4289]
2025-10-02T09:29:22.285359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:22.285673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.285691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.285711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915603:4289], now have 1 active actors on pipe
2025-10-02T09:29:22.285947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:22.285962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:22.285966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:22.286005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554131553915603:4289]
2025-10-02T09:29:22.286021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0
2025-10-02T09:29:22.285921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:22.286199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0 is DEAD
2025-10-02T09:29:22.286334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:22.286345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Write session will restart in 0.005069s
2025-10-02T09:29:22.286367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Write session: Do CDS request
2025-10-02T09:29:22.286373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:22.292305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.292391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:22.292403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-10-02T09:29:22.292511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.292540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:22.292548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:22.292551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:22.292953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-10-02T09:29:22.292986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:22.292992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:22.292994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:22.292999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554131553915619:4870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:22.293496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554131553915619:4870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:22.296072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554131553915619:4870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:22.299856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554131553915619:4870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:22.299870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554131553915619:4870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:22.299873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554131553915619:4870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:22.299880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:22.309320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:22.312353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:22.312564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:22.312572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:22.312582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:22.312642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:22.312745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554131478394954:4321]
2025-10-02T09:29:22.313394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:22.313797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:22.313857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:22.314177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:22.314255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.314264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.314265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.314266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.314267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.314268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.314269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.314271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.314272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.314273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.314274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.314275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.314280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.314292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.314296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.314300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.314304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.314307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.314311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.314315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.314318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.314323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.314327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.314331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.314340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.314348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.314354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.314361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.314365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.314370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.314376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.314382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.314387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.314393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.314404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.314409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.314415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.314421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.314425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.314431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.314440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.314446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.314454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.314459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.314463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.314469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.314473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.314479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.314513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:22.323927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:22.325895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:22.325910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:22.325911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:22.325913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:22.325918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [2:7556554131478394954:4321]
2025-10-02T09:29:22.325930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:22.325946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:22.325949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.325952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.325954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.325969Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:22.325974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:22.325980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:22.326025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.326031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.326032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.326035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:22.326036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:22.326106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:22.326115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.326124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.326130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.326139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:22.326154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915605:2446], now have 1 active actors on pipe
2025-10-02T09:29:22.326159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.326162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.326163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.326168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:22.326177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915752:4870], now have 1 active actors on pipe
2025-10-02T09:29:22.326179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:22.326181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:22.326182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:22.326184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:22.326192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:22.326195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:22.326230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.326238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:22.326243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:22.326467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 397
2025-10-02T09:29:22.326500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 397
2025-10-02T09:29:22.326527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.326538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.326563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:22.326578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.326582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.326584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:22.326594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.326604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:22.326620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.326784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.326793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.326805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.326908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 36 sessionId: src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0
2025-10-02T09:29:22.327275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297d28e0-e46729a4-f5e3ba79-97f74a4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:22.329928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Write session: try to update token
2025-10-02T09:29:22.329947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:22.337175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:22.337195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.337203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.337242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:22.337276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:22.337399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:22.337545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:22.337687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:22.337826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:22.338017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:22.338061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:22.347350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:22.347369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.347372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:22.347374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:22.347384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.347388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.347392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554131478394949:4321]
2025-10-02T09:29:22.347431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:22.347439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.347441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:22.347442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:22.347449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:22.347452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:22.347587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:22.348206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:22.350878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:22.385955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554131553915837:4289]
2025-10-02T09:29:22.386240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7556554131553915837:4289]
2025-10-02T09:29:22.494895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:22.494973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0
2025-10-02T09:29:22.495146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0 is DEAD
2025-10-02T09:29:22.495264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554131553915837:4289]
2025-10-02T09:29:22.495275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:22.495398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:22.495415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Write session will restart in 0.007002s
2025-10-02T09:29:22.495453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Write session: Do CDS request
2025-10-02T09:29:22.495460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:22.493751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:22.494258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.494268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.494286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915837:4289], now have 1 active actors on pipe
2025-10-02T09:29:22.494497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:22.503473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.503550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:22.503572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-10-02T09:29:22.503814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.503884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:22.503898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:22.503904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:22.504424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-10-02T09:29:22.504463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:22.504467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:22.504469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:22.504474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554131553915901:4875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:22.505027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554131553915901:4875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:22.509352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554131553915901:4875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:22.512704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:22.515318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:22.515522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:22.515525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:22.515535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:22.515587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:22.515620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554131478395190:4324]
2025-10-02T09:29:22.516159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:22.516621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:22.516664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:22.520511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554131553915901:4875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:22.520527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554131553915901:4875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:22.520531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554131553915901:4875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:22.520539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:22.517012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:22.517091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.517092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.517093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.517095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.517096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.517097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.517098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.517100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.517101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.517102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.517103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.517104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.517109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.517120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.517124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.517128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.517132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.517136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.517140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.517144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.517149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.517153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.517157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.517161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.517168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.517176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.517182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.517188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.517192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.517198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.517202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.517207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.517211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.517217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.517221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.517226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.517230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.517235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.517239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.517244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.517250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.517254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.517258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.517263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.517267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.517272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.517275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.517281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.517319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:22.529442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:22.531177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:22.531195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:22.531197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:22.531202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:22.531209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [2:7556554131478395190:4324]
2025-10-02T09:29:22.531226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:22.531246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:22.531250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.531253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.531255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.531272Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:22.531277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:22.531285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:22.531346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.531354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.531356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.531360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:22.531363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:22.531435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:22.531443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.531458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.531475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.531497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:22.531518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.531526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.531528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.531545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:22.531563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:22.531584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:22.531587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:22.531621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.531629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:22.531664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916076:4875], now have 1 active actors on pipe
2025-10-02T09:29:22.531674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553915853:2446], now have 1 active actors on pipe
2025-10-02T09:29:22.531781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:22.531790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:22.531793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:22.531799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:22.532031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 398
2025-10-02T09:29:22.532067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 398
2025-10-02T09:29:22.532591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.532604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.532633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:22.532641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.532645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.532648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:22.532658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.532669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:22.532684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.537003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.537021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.537053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.537224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 36 sessionId: src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0
2025-10-02T09:29:22.537570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05cb174-de4e9ea-ebf5dd1f-53c133c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:22.540043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Write session: try to update token
2025-10-02T09:29:22.540061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:22.547684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:22.547701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.547704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:22.547706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:22.547714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.547723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.547727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554131478395185:4324]
2025-10-02T09:29:22.547762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:22.547764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:22.547767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:22.547768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.547770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:22.547770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:22.547896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:22.567872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:22.570519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:22.595728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554131553916083:4289]
2025-10-02T09:29:22.596091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7556554131553916083:4289]
2025-10-02T09:29:22.690688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:22.691170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.691182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.691200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916083:4289], now have 1 active actors on pipe
2025-10-02T09:29:22.691400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:22.691475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:22.691559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0
2025-10-02T09:29:22.691722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:22.691724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0 is DEAD
2025-10-02T09:29:22.691763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554131553916083:4289]
2025-10-02T09:29:22.691915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:22.691931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Write session will restart in 0.005197s
2025-10-02T09:29:22.691956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Write session: Do CDS request
2025-10-02T09:29:22.691963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:22.699831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.703267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:22.703282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-10-02T09:29:22.703442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.703476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:22.703486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:22.703490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:22.703990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-10-02T09:29:22.704026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:22.704035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:22.704036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:22.704043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554131553916180:4879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:22.704560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554131553916180:4879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:22.708884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554131553916180:4879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:22.713914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:22.717193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:22.717403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:22.717407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:22.717417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:22.717468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:22.717503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554131478395430:4332]
2025-10-02T09:29:22.718084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:22.719804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:22.719859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:22.720136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:22.720193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.720194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.720196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.720196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.720198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.720199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.720200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.720201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.720203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.720204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.720205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.720206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.720211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.720221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.720224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.720228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.720232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.720236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.720240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.720243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.720247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.720251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.720254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.720258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.720265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.720272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.720278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.720283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.720287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.720292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.720296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.720301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.720306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.720311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.720315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.720320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.720325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.720331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.720335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.720341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.720345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.720350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.720354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.720359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.720363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.720368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.720371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.720376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.720408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:22.719968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554131553916180:4879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:22.719985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554131553916180:4879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:22.719988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554131553916180:4879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:22.719997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:22.733359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:22.735233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:22.735251Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:22.735253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:22.735256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:22.735262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [2:7556554131478395430:4332]
2025-10-02T09:29:22.735276Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:22.735294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:22.735296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.735299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.735301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.735318Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:22.735324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:22.735331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:22.735393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.735403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.735405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.735408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:22.735410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:22.735471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:22.735478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.735491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.735502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.735520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:22.735541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916309:4879], now have 1 active actors on pipe
2025-10-02T09:29:22.735550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.735552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.735554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.735565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:22.735572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916086:2446], now have 1 active actors on pipe
2025-10-02T09:29:22.735575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:22.735579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:22.735582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:22.735584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:22.735592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:22.735594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:22.735617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 399
2025-10-02T09:29:22.735635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 399
2025-10-02T09:29:22.735627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.735635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:22.735765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:22.736086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.736092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.736115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c43dce00-1a49d342-d37cc63-74c486b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:22.736122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.736126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.736127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:22.736136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.736145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:22.736159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.736428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.736446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.736464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.736534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 36 sessionId: src_id|c43dce00-1a49d342-d37cc63-74c486b9_0
2025-10-02T09:29:22.736950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c976d2e0-b246f95-84bb4677-8a77b45e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c43dce00-1a49d342-d37cc63-74c486b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:22.739657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Write session: try to update token
2025-10-02T09:29:22.739677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:22.747634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:22.747658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.747660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:22.747662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:22.747670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.747674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.747678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554131478395425:4332]
2025-10-02T09:29:22.747715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:22.747722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.747724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:22.747732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:22.747747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:22.747753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:22.747866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:22.760719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|c43dce00-1a49d342-d37cc63-74c486b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:22.763682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:22.791956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554131553916346:4289]
2025-10-02T09:29:22.792172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7556554131553916346:4289]
2025-10-02T09:29:22.902391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:22.903016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.903032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.903051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916346:4289], now have 1 active actors on pipe
2025-10-02T09:29:22.903262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:22.903295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:22.903309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:22.903327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554131553916346:4289]
2025-10-02T09:29:22.903351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:22.903364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: error at write: Disconnected sessionId: src_id|c43dce00-1a49d342-d37cc63-74c486b9_0
2025-10-02T09:29:22.903544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|c43dce00-1a49d342-d37cc63-74c486b9_0 is DEAD
2025-10-02T09:29:22.903728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:22.903747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Write session will restart in 0.007844s
2025-10-02T09:29:22.903777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Write session: Do CDS request
2025-10-02T09:29:22.903785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:22.913449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.913532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:22.913550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-10-02T09:29:22.913705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:22.913738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:22.913745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:22.913749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:22.914107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-10-02T09:29:22.914130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:22.914135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:22.914136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:22.914140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554131553916419:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:22.914551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554131553916419:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:22.917790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554131553916419:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:22.919926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:22.922606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:22.922752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554131553916419:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:22.922763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554131553916419:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:22.922765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554131553916419:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:22.922771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:22.922774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:22.922784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:22.922794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:22.922840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:22.922875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554131478395683:4341]
2025-10-02T09:29:22.923485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:22.923765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:22.923810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:22.924120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:22.924183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.924190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.924191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.924192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.924193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.924194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.924195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.924196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.924197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.924197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.924199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.924200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.924205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.924216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.924219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.924223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.924227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.924231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.924234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.924237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.924241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.924246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.924249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.924252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.924258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.924266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:22.924272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.924277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:22.924281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.924285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:22.924290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.924294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:22.924298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.924303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:22.924313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.924318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:22.924327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.924333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:22.924337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.924346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:22.924351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.924360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:22.924364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.924369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.924379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.924383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.924393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.924397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.924434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:22.933098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:22.934747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:22.934768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:22.934771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:22.934775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:22.934781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [2:7556554131478395683:4341]
2025-10-02T09:29:22.934795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:22.934813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:22.934817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.934819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.934822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.934838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:22.934846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:22.934852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:22.934919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.934927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.934929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.934932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:22.934935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:22.935002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:22.935009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.935024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:22.935039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:22.935059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:22.935082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916575:4891], now have 1 active actors on pipe
2025-10-02T09:29:22.935104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554131553916352:2446], now have 1 active actors on pipe
2025-10-02T09:29:22.935117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.935123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.935126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.935143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:22.935166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:22.935169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:22.935177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:22.935179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:22.935185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:22.935188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:22.935192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 400
2025-10-02T09:29:22.935194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 400
2025-10-02T09:29:22.935224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.935236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:22.935237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:22.935266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.935269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.935298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:22.935312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:22.935315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:22.935317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:22.935327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:22.935336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:22.935354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.935520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:22.935528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:22.935541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:22.935621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0
2025-10-02T09:29:22.935934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c43dce00-1a49d342-d37cc63-74c486b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:22.938464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Write session: try to update token
2025-10-02T09:29:22.938479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:22.946168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:22.946190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:22.946193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:22.946195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:22.946203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.946208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.946212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554131478395678:4341]
2025-10-02T09:29:22.946252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:22.946258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:22.946260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:22.946420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:22.948856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:22.948873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:22.948879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:22.952692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:22.955139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:23.003470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554135848883882:4289]
2025-10-02T09:29:23.003722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7556554135848883882:4289]
2025-10-02T09:29:23.099088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:23.099672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.099686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.099701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848883882:4289], now have 1 active actors on pipe
2025-10-02T09:29:23.099912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:23.100556Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:29:23.100711Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:23.100716Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:23.100740Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008351s
2025-10-02T09:29:23.100836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:23.100846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Write session will restart in 0.007173s
2025-10-02T09:29:23.100868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Write session: Do CDS request
2025-10-02T09:29:23.100874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:23.100062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554135848883882:4289]
2025-10-02T09:29:23.100109Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:29:23.100302Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_4674416184496851556_v1 is DEAD
2025-10-02T09:29:23.100501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:23.100552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0
2025-10-02T09:29:23.100624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0 is DEAD
2025-10-02T09:29:23.101248Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554049949518373:4286] disconnected; active server actors: 1
2025-10-02T09:29:23.101258Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554049949518373:4286] client user disconnected session shared/user_1_4_4674416184496851556_v1
2025-10-02T09:29:23.101279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:23.109317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.110162Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:29:23.110762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:23.110762Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:29:23.110767Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-10-02T09:29:23.110777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-10-02T09:29:23.110893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.110926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:23.110930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:23.110934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:23.110962Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:23.111012Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:23.111113Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 auth for : user
2025-10-02T09:29:23.111261Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 Handle describe topics response
2025-10-02T09:29:23.111285Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 auth is DEAD
2025-10-02T09:29:23.111305Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:29:23.111419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-10-02T09:29:23.111449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:23.111455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:23.111457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:23.111463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554135848883987:4896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:23.111569Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:29:23.111643Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554135848883992:4895] connected; active server actors: 1
2025-10-02T09:29:23.111688Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_5_14002753114993164565_v1
2025-10-02T09:29:23.111780Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554135848883992:4895] session shared/user_1_5_14002753114993164565_v1
2025-10-02T09:29:23.111793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:29:23.111802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:29:23.111808Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_14002753114993164565_v1" (Sender=[1:7556554135848883964:4895], Pipe=[1:7556554135848883992:4895], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:23.111812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:29:23.111822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:29:23.111845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_14002753114993164565_v1" (Sender=[1:7556554135848883964:4895], Pipe=[1:7556554135848883992:4895], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:23.111858Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_14002753114993164565_v1" sender [1:7556554135848883964:4895] lock partition 0 for ReadingSession "shared/user_1_5_14002753114993164565_v1" (Sender=[1:7556554135848883964:4895], Pipe=[1:7556554135848883992:4895], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-10-02T09:29:23.111870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:29:23.111873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-02T09:29:23.111945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554135848883987:4896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:23.112089Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_14002753114993164565_v1" ClientId: "user" PipeClient { RawX1: 7556554135848883992 RawX2: 4503603922342687 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:29:23.112109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:29:23.113830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554135848883987:4896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:23.117196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:23.117503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554135848883987:4896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:23.117517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554135848883987:4896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:23.117520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554135848883987:4896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:23.117529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:23.120212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:23.120420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:23.120427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:23.120438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:23.120491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:23.120531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554135773363211:4344]
2025-10-02T09:29:23.121227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:23.121562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:23.121608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:23.121920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:23.121975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.121976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.121977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.121978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.121980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.121982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.121983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.121984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.121985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.121986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.121987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.121988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.121993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.122004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.122008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.122012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.122016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.122020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.122023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.122027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.122031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.122035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.122039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.122043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.122050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.122057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.122063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.122069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.122074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.122079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.122083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.122088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.122093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.122098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.122102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.122107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.122112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.122117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.122121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.122127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.122131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.122136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.122140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.122145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.122149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.122155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.122159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.122165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.122203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:23.135999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 401
2025-10-02T09:29:23.136029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 401
2025-10-02T09:29:23.136058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7556554135848884014:4901]
2025-10-02T09:29:23.133743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:23.135592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:23.135599Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:23.135601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:23.135605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:23.135611Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [2:7556554135773363211:4344]
2025-10-02T09:29:23.135627Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:23.135646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:23.135649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.135652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.135654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.135669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:23.135673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:23.135683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:23.135747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.135749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.135751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.135753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:23.135756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:23.135832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:23.135834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.135848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.135873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.135888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:23.135907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884014:4901], now have 1 active actors on pipe
2025-10-02T09:29:23.135910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884114:4896], now have 1 active actors on pipe
2025-10-02T09:29:23.135913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848883887:2446], now have 1 active actors on pipe
2025-10-02T09:29:23.135918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.135920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.135922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.135936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:23.135947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:23.135950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:23.135954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:23.135956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:23.135961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:23.135964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:23.135998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.136005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:23.136010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:23.136237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.136245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.136267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.136278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.136284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_14002753114993164565_v1 on pipe: [1:7556554135848884014:4901]
2025-10-02T09:29:23.136316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afe056e9-820c351d-a660bc57-3b60a615_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:23.136317Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_14002753114993164565_v1:1 with generation 401
2025-10-02T09:29:23.136328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.136332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.136335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:23.136346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.136362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:23.136377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.136386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.136387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:23.136402Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_14002753114993164565_v1
2025-10-02T09:29:23.136408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.136436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.136454Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:29:23.136746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.136756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.137162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 36 sessionId: src_id|afe056e9-820c351d-a660bc57-3b60a615_0
2025-10-02T09:29:23.136899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.137506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae673af-79bb3289-243b07ed-9bfd51af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afe056e9-820c351d-a660bc57-3b60a615_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:23.140303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Write session: try to update token
2025-10-02T09:29:23.140321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:23.140763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:29:23.140798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:29:23.140820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.140823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.140825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.140834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:29:23.140848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:29:23.142521Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397363136 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:29:23.142541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:29:23.142579Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 sending to client partition status
2025-10-02T09:29:23.151171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:23.151188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.151191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:23.151193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:23.151201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.151205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.151210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554135773363205:4344]
2025-10-02T09:29:23.151247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:23.151252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.151254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:23.151264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:23.151269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:23.151273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:23.151379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:23.157359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|afe056e9-820c351d-a660bc57-3b60a615_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:23.159886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:23.293779Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:23.294048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.294062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.294296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_14002753114993164565_v1
2025-10-02T09:29:23.294315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:23.294343Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_14002753114993164565_v1
2025-10-02T09:29:23.294331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554135848884014:4901]
2025-10-02T09:29:23.294340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:23.294343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:23.294363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:23.294407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: error at write: Disconnected sessionId: src_id|afe056e9-820c351d-a660bc57-3b60a615_0
2025-10-02T09:29:23.294558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|afe056e9-820c351d-a660bc57-3b60a615_0 is DEAD
2025-10-02T09:29:23.294675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:23.294683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Write session will restart in 0.007776s
2025-10-02T09:29:23.294698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Write session: Do CDS request
2025-10-02T09:29:23.294701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:23.303265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.303396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:23.303408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-10-02T09:29:23.303523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.303552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:23.303561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:23.303569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:23.304078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-10-02T09:29:23.304119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:23.304121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:23.304123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:23.304128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554135848884221:4904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:23.304632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554135848884221:4904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:23.307295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554135848884221:4904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:23.308470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:23.310407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:23.310568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:23.310576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:23.310585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:23.310625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:23.310660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554135773363441:4346]
2025-10-02T09:29:23.310725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554135848884221:4904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:23.310735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554135848884221:4904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:23.310737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554135848884221:4904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:23.310742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:23.311129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:23.311352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:23.311379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:23.311639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:23.311689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.311693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.311693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.311694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.311695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.311695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.311696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.311696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.311697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.311698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.311699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.311699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.311702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.311708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.311711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.311713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.311715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.311717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.311719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.311721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.311723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.311726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.311728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.311730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.311734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.311738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.311743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.311746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.311749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.311752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.311754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.311757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.311759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.311762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.311764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.311767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.311769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.311772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.311774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.311777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.311779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.311782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.311784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.311787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.311789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.311791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.311793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.311796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.311813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:23.320019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:23.321572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:23.321589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:23.321592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:23.321596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:23.321601Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [2:7556554135773363441:4346]
2025-10-02T09:29:23.321616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:23.321632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:23.321634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.321637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.321639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.321650Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:23.321654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:23.321660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:23.321704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.321712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.321714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.321717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:23.321719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:23.321790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:23.321797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.321806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.321812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.321821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:23.321836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884131:2446], now have 1 active actors on pipe
2025-10-02T09:29:23.321844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.321846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.321847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.321856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:23.321862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884356:4904], now have 1 active actors on pipe
2025-10-02T09:29:23.321868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:23.321873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:23.321876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:23.321877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:23.321878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:23.321880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:23.321904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.321909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:23.321911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:23.321926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 402
2025-10-02T09:29:23.321961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.321970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.321926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 402
2025-10-02T09:29:23.321993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:23.322002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.322005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.322007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:23.322015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.322022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:23.322039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.322161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.322169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.322183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.322244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 36 sessionId: src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0
2025-10-02T09:29:23.322578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe056e9-820c351d-a660bc57-3b60a615_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:23.325179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Write session: try to update token
2025-10-02T09:29:23.325195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:23.337416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:23.337434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.337443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.337489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:23.337497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:23.337700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:23.337838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.337969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.338118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.338326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:23.338365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:23.341711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:23.342089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:23.342103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.342105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:23.342107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:23.342115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.342119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.342122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554135773363436:4346]
2025-10-02T09:29:23.342153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:23.342164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.342166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:23.342169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:23.342174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:23.342178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:23.342323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:23.343904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:23.394564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554135848884368:4901]
2025-10-02T09:29:23.394779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7556554135848884368:4901]
2025-10-02T09:29:23.479149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:23.479704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.479716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.479733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884368:4901], now have 1 active actors on pipe
2025-10-02T09:29:23.479908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:23.480054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554135848884368:4901]
2025-10-02T09:29:23.480080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:23.480105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:23.480161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0
2025-10-02T09:29:23.480325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0 is DEAD
2025-10-02T09:29:23.480445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:23.480455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Write session will restart in 0.009007s
2025-10-02T09:29:23.480479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Write session: Do CDS request
2025-10-02T09:29:23.480483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:23.490523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.490613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:23.490627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-10-02T09:29:23.490778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.490833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:23.490841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:23.490845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:23.491242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-10-02T09:29:23.491275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:23.491280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:23.491282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:23.491288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554135848884471:4909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:23.491768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554135848884471:4909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:23.494149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554135848884471:4909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:23.495956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:23.498273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:23.498459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:23.498460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554135848884471:4909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:23.498469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:23.498472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554135848884471:4909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:23.498478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:23.498476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554135848884471:4909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:23.498484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:23.498526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:23.498562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554135773363683:4349]
2025-10-02T09:29:23.499123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:23.499369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:23.499415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:23.499691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:23.499738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.499743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.499744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.499745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.499746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.499747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.499748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.499749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.499750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.499751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.499753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.499754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.499758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.499769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.499772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.499776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.499779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.499783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.499786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.499789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.499793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.499800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.499804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.499811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.499816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.499827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.499836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.499844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.499851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.499856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.499863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.499871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.499879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.499884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.499892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.499900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.499904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.499912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.499919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.499924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.499929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.499933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.499937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.499941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.499949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.499955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.499962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.499967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.500003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:23.508722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:23.510413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:23.510431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:23.510435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:23.510438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:23.510445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [2:7556554135773363683:4349]
2025-10-02T09:29:23.510461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:23.510480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:23.510484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.510486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.510489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.510504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:23.510508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:23.510516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:23.510575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.510586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.510588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.510592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:23.510594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:23.510659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:23.510668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.510684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.510695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.510709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:23.510733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884608:4909], now have 1 active actors on pipe
2025-10-02T09:29:23.510741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884382:2446], now have 1 active actors on pipe
2025-10-02T09:29:23.510747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.510749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.510752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.510764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:23.510781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:23.510796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:23.510799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:23.510833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.510844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:23.510882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:23.510891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:23.510893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:23.510900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:23.511248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 403
2025-10-02T09:29:23.511276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 403
2025-10-02T09:29:23.511387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.511403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.511432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:23.511440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.511444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.511446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:23.511455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.511466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:23.511480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.511752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.511762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.511790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.511901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 36 sessionId: src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0
2025-10-02T09:29:23.512243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|940e2dc7-9b1334e8-354f534f-34d31e1f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:23.514985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Write session: try to update token
2025-10-02T09:29:23.515006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:23.522569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:23.522586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.522594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.522624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:23.522632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:23.522810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:23.522940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.523075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.523220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.523410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:23.523451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:23.530824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:23.532903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:23.532918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.532921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:23.532923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:23.532932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.532936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.532940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554135773363678:4349]
2025-10-02T09:29:23.532976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:23.532977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:23.532983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.532985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:23.532980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:23.532991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:23.533157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:23.533375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:23.580473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554135848884620:4901]
2025-10-02T09:29:23.580750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7556554135848884620:4901]
2025-10-02T09:29:23.664043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:23.664411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.664423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.664441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884620:4901], now have 1 active actors on pipe
2025-10-02T09:29:23.664597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:23.664671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554135848884620:4901]
2025-10-02T09:29:23.664692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:23.664698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:23.664765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: status is not ok: tablet will be restarted right now sessionId: src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0
2025-10-02T09:29:23.664960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0 is DEAD
2025-10-02T09:29:23.665082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:23.665090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Write session will restart in 0.007104s
2025-10-02T09:29:23.665107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Write session: Do CDS request
2025-10-02T09:29:23.665112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:23.673263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.673381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:23.673395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-10-02T09:29:23.673518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.673551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:23.673556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:23.673564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:23.673980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-10-02T09:29:23.674011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:23.674017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:23.674019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:23.674024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554135848884701:4913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:23.674519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554135848884701:4913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:23.676929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554135848884701:4913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:23.678659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:23.680628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:23.680748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:23.680755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:23.680760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:23.680791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:23.680843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554135773363914:4351]
2025-10-02T09:29:23.680876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554135848884701:4913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:23.680889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554135848884701:4913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:23.680892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554135848884701:4913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:23.680898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:23.681210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:23.681447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:23.681486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:23.681741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:23.681794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.681800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.681801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.681802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.681803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.681804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.681806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.681807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.681811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.681813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.681814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.681815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.681820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.681826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.681828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.681830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.681833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.681835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.681837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.681839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.681841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.681843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.681845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.681847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.681851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.681856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.681859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.681862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.681864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.681867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.681869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.681872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.681874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.681877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.681879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.681882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.681884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.681888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.681891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.681894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.681897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.681899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.681902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.681904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.681906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.681909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.681911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.681914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.681932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:23.690130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:23.691989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:23.692006Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:23.692009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:23.692013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:23.692018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [2:7556554135773363914:4351]
2025-10-02T09:29:23.692028Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:23.692042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:23.692044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.692047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.692049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.692061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:23.692065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:23.692072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:23.692119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.692126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.692127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.692130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:23.692132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:23.692196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:23.692203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.692216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.692230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.692243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:23.692259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884850:4913], now have 1 active actors on pipe
2025-10-02T09:29:23.692264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884622:2446], now have 1 active actors on pipe
2025-10-02T09:29:23.692269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.692271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.692272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.692283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:23.692293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:23.692295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:23.692297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:23.692299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:23.692310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:23.692313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:23.692294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 404
2025-10-02T09:29:23.692295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 404
2025-10-02T09:29:23.692350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.692357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.692369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.692379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:23.692383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:23.692401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:23.692408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.692411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.692412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:23.692418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.692424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:23.692439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.692583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.692590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.692601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.692658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 36 sessionId: src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0
2025-10-02T09:29:23.692925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defcff9-a8d418b9-8ad90144-5c9bb8ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:23.695307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Write session: try to update token
2025-10-02T09:29:23.695321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:23.702674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:23.702692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.702695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:23.702696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:23.702703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.702707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.702710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554135773363909:4351]
2025-10-02T09:29:23.702744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:23.702749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.702748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:23.702752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:23.702752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:23.702764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:23.702880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:23.710243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:23.712713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:23.764766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554135848884866:4901]
2025-10-02T09:29:23.764980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7556554135848884866:4901]
2025-10-02T09:29:23.838503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:23.838812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.838826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.838844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884866:4901], now have 1 active actors on pipe
2025-10-02T09:29:23.839084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:23.839176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554135848884866:4901]
2025-10-02T09:29:23.839176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:23.839222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:23.839345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0
2025-10-02T09:29:23.839546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0 is DEAD
2025-10-02T09:29:23.839729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:23.839744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Write session will restart in 0.009358s
2025-10-02T09:29:23.839768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Write session: Do CDS request
2025-10-02T09:29:23.839774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:23.850379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.851112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:23.851131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-10-02T09:29:23.851282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:23.851315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:23.851326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:23.851331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:23.851895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-10-02T09:29:23.851955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:23.851969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:23.851972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:23.851981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554135848885036:4925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:23.852762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554135848885036:4925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:23.854411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:23.854856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554135848885036:4925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:23.856999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:23.857184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:23.857193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:23.857201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:23.857248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:23.857284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554135773364184:4366]
2025-10-02T09:29:23.857903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:23.858140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:23.858178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:23.858195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554135848885036:4925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:23.858211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554135848885036:4925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:23.858214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554135848885036:4925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:23.858224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:23.858490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:23.858544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.858550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.858551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.858552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.858553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.858554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.858555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.858556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.858557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.858558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.858559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.858560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.858565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.858575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.858578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.858582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.858585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.858589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.858592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.858595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.858598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.858602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.858605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.858608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.858616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.858623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:23.858628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.858632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:23.858636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.858641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:23.858644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.858649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:23.858653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.858658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:23.858661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.858665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:23.858670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.858674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:23.858678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.858682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:23.858687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.858692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:23.858696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.858700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.858706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.858711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.858715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.858719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.858756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:23.867377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:23.869645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:23.869659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:23.869661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:23.869664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:23.869669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [2:7556554135773364184:4366]
2025-10-02T09:29:23.869681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:23.869698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:23.869701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.869703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.869705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.869718Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:23.869723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:23.869729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:23.869785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.869794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.869796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.869799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:23.869800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:23.869856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:23.869863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.869876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:23.869885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:23.869906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:23.869922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.869924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.869925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.869932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:23.869943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:23.869944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848885123:4925], now have 1 active actors on pipe
2025-10-02T09:29:23.869946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:23.869947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848884895:2446], now have 1 active actors on pipe
2025-10-02T09:29:23.869949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:23.869954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:23.869965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:23.869967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:23.869999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.870006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:23.870012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:23.870181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 405
2025-10-02T09:29:23.870211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 405
2025-10-02T09:29:23.870244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.870258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.870288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf022d6d-518be12b-a9855248-ad78df0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:23.870302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:23.870310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:23.870312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:23.870322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:23.870335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:23.870352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.870528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:23.870538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:23.870553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:23.870640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf022d6d-518be12b-a9855248-ad78df0c_0
2025-10-02T09:29:23.871039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c4ffa4-5a0350ec-ca58daf2-e0703a41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf022d6d-518be12b-a9855248-ad78df0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:23.874119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Write session: try to update token
2025-10-02T09:29:23.874143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:23.883067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:23.883102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.883111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.883158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:23.883162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:23.883372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:23.883527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.883703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.883855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:23.884052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:23.884105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:23.889236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|cf022d6d-518be12b-a9855248-ad78df0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:23.891733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:23.891748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:23.891751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:23.891753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:23.891761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.891766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.891769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554135773364179:4366]
2025-10-02T09:29:23.891811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:23.891818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:23.891820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:23.891824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:23.891829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:23.891833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:23.891949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:23.892266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:23.939404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554135848885132:4901]
2025-10-02T09:29:23.939666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7556554135848885132:4901]
2025-10-02T09:29:24.032667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:24.033226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.033242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.033260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554135848885132:4901], now have 1 active actors on pipe
2025-10-02T09:29:24.033465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:24.033525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554135848885132:4901]
2025-10-02T09:29:24.033519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:24.033534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:24.033559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:24.033590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|cf022d6d-518be12b-a9855248-ad78df0c_0
2025-10-02T09:29:24.033719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|cf022d6d-518be12b-a9855248-ad78df0c_0 is DEAD
2025-10-02T09:29:24.033863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:24.033874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Write session will restart in 0.005089s
2025-10-02T09:29:24.033903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Write session: Do CDS request
2025-10-02T09:29:24.033909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:24.040450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.040433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:24.040450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-10-02T09:29:24.040712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.040747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:24.040753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:24.040758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:24.041221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-10-02T09:29:24.041263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:24.041271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:24.041273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:24.041280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554140143852466:4929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:24.041783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554140143852466:4929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:24.044465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554140143852466:4929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:24.046855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554140143852466:4929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:24.046866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554140143852466:4929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:24.046868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554140143852466:4929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:24.046873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:24.046889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:24.048670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:24.048832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:24.048841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:24.048849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:24.048898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:24.048933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554140068331714:4368]
2025-10-02T09:29:24.049432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:24.049662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:24.049692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:24.049893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:24.050046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.050051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.050052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.050052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.050053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.050053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.050054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.050054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.050055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.050056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.050056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.050057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.050060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.050067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.050069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.050071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.050073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.050075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.050077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.050079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.050081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.050084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.050085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.050087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.050093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.050098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.050103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.050107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.050111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.050114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.050118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.050122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.050126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.050130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.050134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.050138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.050141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.050146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.050150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.050154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.050158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.050162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.050170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.050172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.050175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.050181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.050183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.050185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.050205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:24.058232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:24.059831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:24.059851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:24.059854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:24.059857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:24.059862Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [2:7556554140068331714:4368]
2025-10-02T09:29:24.059875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:24.059894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:24.059897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.059900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.059901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.059915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:24.059920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:24.059926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:24.059986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.059997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.060001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.060004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:24.060006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:24.060069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:24.060076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.060087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.060100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.060116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:24.060139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852658:4929], now have 1 active actors on pipe
2025-10-02T09:29:24.060145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852433:2446], now have 1 active actors on pipe
2025-10-02T09:29:24.060151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.060152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.060154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.060166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:24.060178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:24.060179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:24.060182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:24.060184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:24.060189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:24.060193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:24.060218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.060227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:24.060233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:24.060229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 406
2025-10-02T09:29:24.060291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.060299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.060231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 406
2025-10-02T09:29:24.060323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff718880-72a4d361-e8455fc6-40f9b841_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:24.060334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.060338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.060340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:24.060349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.060357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:24.060369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.060549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.060561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.060581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.060684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff718880-72a4d361-e8455fc6-40f9b841_0
2025-10-02T09:29:24.061002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf022d6d-518be12b-a9855248-ad78df0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff718880-72a4d361-e8455fc6-40f9b841_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:24.063713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Write session: try to update token
2025-10-02T09:29:24.063730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:24.071100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:24.071117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.071119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:24.071121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:24.071129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.071133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.071136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554140068331708:4368]
2025-10-02T09:29:24.071171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:24.071174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:24.071177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.071179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:24.071179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:24.071182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:24.071315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:24.076626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|ff718880-72a4d361-e8455fc6-40f9b841_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:24.079272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:24.133924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554140143852673:4901]
2025-10-02T09:29:24.137008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7556554140143852673:4901]
2025-10-02T09:29:24.204747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:24.205142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.205152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.205180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852673:4901], now have 1 active actors on pipe
2025-10-02T09:29:24.205328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:24.205377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:24.205390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:24.205413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554140143852673:4901]
2025-10-02T09:29:24.205428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:24.205459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: error at write: Disconnected sessionId: src_id|ff718880-72a4d361-e8455fc6-40f9b841_0
2025-10-02T09:29:24.205621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|ff718880-72a4d361-e8455fc6-40f9b841_0 is DEAD
2025-10-02T09:29:24.205789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:24.205803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Write session will restart in 0.006013s
2025-10-02T09:29:24.205881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Write session: Do CDS request
2025-10-02T09:29:24.205893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:24.213227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.213682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:24.213703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-10-02T09:29:24.213810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.213837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:24.213845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:24.213849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:24.214253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-10-02T09:29:24.214289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:24.214290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:24.214292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:24.214297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554140143852752:4934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:24.214801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554140143852752:4934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:24.216850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554140143852752:4934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:24.218549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:24.220877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:24.220975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554140143852752:4934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:24.220998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554140143852752:4934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:24.221001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554140143852752:4934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:24.221007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:24.221054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:24.221063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:24.221071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:24.221114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:24.221150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554140068331950:4371]
2025-10-02T09:29:24.221730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:24.222077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:24.222128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:24.222455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:24.222507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.222512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.222513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.222514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.222515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.222516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.222517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.222518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.222519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.222520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.222521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.222522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.222527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.222537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.222541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.222544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.222548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.222551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.222555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.222559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.222563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.222567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.222570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.222573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.222579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.222586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.222591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.222597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.222601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.222605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.222610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.222615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.222619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.222624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.222632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.222637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.222642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.222650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.222665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.222673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.222677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.222682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.222685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.222690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.222694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.222698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.222702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.222710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.222742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:24.231229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:24.233120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:24.233132Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:24.233134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:24.233138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:24.233144Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [2:7556554140068331950:4371]
2025-10-02T09:29:24.233157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:24.233170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:24.233173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.233176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.233178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.233191Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:24.233196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:24.233202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:24.233256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.233262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.233264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.233267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:24.233269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:24.233329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:24.233336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.233351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.233364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.233382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:24.233402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852675:2446], now have 1 active actors on pipe
2025-10-02T09:29:24.233409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852905:4934], now have 1 active actors on pipe
2025-10-02T09:29:24.233414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.233416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.233418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.233430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:24.233443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:24.233445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:24.233452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:24.233454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:24.233458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:24.233461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:24.233489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.233498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:24.233504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:24.233585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 407
2025-10-02T09:29:24.233604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 407
2025-10-02T09:29:24.233649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.233662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.233683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96544fa2-c61063b2-8b090ceb-186a151f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:24.233690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.233693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.233695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:24.233703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.233711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:24.233724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.233865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.233873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.233885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.233970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 36 sessionId: src_id|96544fa2-c61063b2-8b090ceb-186a151f_0
2025-10-02T09:29:24.234289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff718880-72a4d361-e8455fc6-40f9b841_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96544fa2-c61063b2-8b090ceb-186a151f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:24.236867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Write session: try to update token
2025-10-02T09:29:24.236883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:24.243604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:24.243620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.243628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.243664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:24.243665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:24.243856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:24.243982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.244119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.244252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.244427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:24.244462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:24.249336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|96544fa2-c61063b2-8b090ceb-186a151f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:24.251696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:24.251889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.251908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.253504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:24.253535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:24.253538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.253540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:24.253542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:24.253551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.253555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.253558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554140068331945:4371]
2025-10-02T09:29:24.253583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:24.253586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:24.253593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:24.253592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.253596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:24.253598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:24.253595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:24.253731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:24.305621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554140143852916:4901]
2025-10-02T09:29:24.305872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7556554140143852916:4901]
2025-10-02T09:29:24.400600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:24.408179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.408204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.408368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.408427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.408493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.408555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.408602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.408611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.408676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.408735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.408814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.408878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.408923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.408930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.408990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.409044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.409114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.409173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.409215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.409225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.409290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.409353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.409411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.409473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.409517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.409523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.409586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.409654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.409716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.409780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.409829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.409838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.409906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.409966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.410067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.410171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.410227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.410234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.410323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.410391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.410460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.410517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.410559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.410561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.410629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.410686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.410747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.410805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.410845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.410851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.410910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.410965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.411020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.411072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.411127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.411134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.411194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.411242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.411295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.411350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.411458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.411463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.411507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852916:4901], now have 1 active actors on pipe
2025-10-02T09:29:24.411762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:24.411776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:24.411801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: error at write: Disconnected sessionId: src_id|96544fa2-c61063b2-8b090ceb-186a151f_0
2025-10-02T09:29:24.411810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554140143852916:4901]
2025-10-02T09:29:24.411831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:24.411962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|96544fa2-c61063b2-8b090ceb-186a151f_0 is DEAD
2025-10-02T09:29:24.412104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:24.412115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Write session will restart in 0.007081s
2025-10-02T09:29:24.412135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Write session: Do CDS request
2025-10-02T09:29:24.412141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:24.412348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:24.420297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.420389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:24.420403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-10-02T09:29:24.420496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.420533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:24.420537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:24.420540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:24.420915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-10-02T09:29:24.420947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:24.420954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:24.420955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:24.420960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554140143852965:4939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:24.421387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554140143852965:4939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:24.424289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554140143852965:4939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:24.427183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554140143852965:4939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:24.427201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554140143852965:4939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:24.427204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554140143852965:4939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:24.427212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:24.429010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:24.431332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:24.431520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:24.431533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:24.431541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:24.431589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:24.431632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554140068332199:4374]
2025-10-02T09:29:24.432242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:24.432530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:24.432570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:24.432917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:24.432977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.432983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.432984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.432986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.432987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.432988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.432989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.432990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.432992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.432993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.432994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.432996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.433001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.433013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.433017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.433022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.433026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.433031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.433036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.433040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.433045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.433049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.433054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.433058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.433064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.433072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.433078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.433084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.433093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.433099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.433108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.433114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.433120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.433127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.433132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.433140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.433145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.433156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.433160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.433166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.433175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.433181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.433191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.433197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.433203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.433214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.433218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.433223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.433268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:24.442424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:24.444141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:24.444157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:24.444160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:24.444164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:24.444170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [2:7556554140068332199:4374]
2025-10-02T09:29:24.444186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:24.444204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:24.444210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.444213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.444215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.444229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:24.444240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:24.444247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:24.444309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.444319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.444323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.444327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:24.444329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:24.444394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:24.444406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.444420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.444434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.444453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:24.444475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853159:4939], now have 1 active actors on pipe
2025-10-02T09:29:24.444479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143852919:2446], now have 1 active actors on pipe
2025-10-02T09:29:24.444486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.444489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.444491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.444504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:24.444518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:24.444525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:24.444528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:24.444530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:24.444534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:24.444537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:24.444572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.444580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:24.444587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:24.444578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 408
2025-10-02T09:29:24.444579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 408
2025-10-02T09:29:24.444709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.444718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.444741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:24.444747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.444751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.444753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:24.444763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.444777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:24.444794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.445417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.445431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.445452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.445563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0
2025-10-02T09:29:24.445923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96544fa2-c61063b2-8b090ceb-186a151f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:24.448536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Write session: try to update token
2025-10-02T09:29:24.448553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:24.455930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:24.455947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.455956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.455996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:24.455999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:24.456165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:24.456313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.456456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.456596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.457008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:24.457051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:24.461784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:24.464264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:24.464768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.464789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.465855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:24.465887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:24.465890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.465892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:24.465895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:24.465902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.465906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.465914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554140068332194:4374]
2025-10-02T09:29:24.465937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:24.465940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:24.465946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.465948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:24.465949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:24.465951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:24.465970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:24.466079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:24.514988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554140143853174:4901]
2025-10-02T09:29:24.515382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7556554140143853174:4901]
2025-10-02T09:29:24.613627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:24.620000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.620021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.620160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.620212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.620266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.620322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.620419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.620426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.620485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.620539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.620593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.620649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.620692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.620695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.620764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.620871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.620939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.620993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.621188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.621194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.621250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.621331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.621418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.621474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.621513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.621518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.621576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.621631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.621700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.621752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.621791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.621796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.621872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.621944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.622017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.622071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.622111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.622116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.622170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.622221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.622276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.622327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.622366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.622371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.622432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.622484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.622537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.622588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.622637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.622642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.622693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.622742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.622794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.622846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.622967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.622972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.623027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:24.623076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:24.623140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:24.623189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:24.623226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:24.623231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:24.623266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853174:4901], now have 1 active actors on pipe
2025-10-02T09:29:24.623516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:24.623531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:24.623558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: error at write: Disconnected sessionId: src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0
2025-10-02T09:29:24.623714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0 is DEAD
2025-10-02T09:29:24.623766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554140143853174:4901]
2025-10-02T09:29:24.623792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:24.623901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:24.623915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Write session will restart in 0.007202s
2025-10-02T09:29:24.623936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Write session: Do CDS request
2025-10-02T09:29:24.623941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:24.623972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:24.632393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.632405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:24.632420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-10-02T09:29:24.632707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.632744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:24.632757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:24.632761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:24.633189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-10-02T09:29:24.633221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:24.633226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:24.633229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:24.633234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554140143853259:4943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:24.633696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554140143853259:4943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:24.636766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554140143853259:4943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:24.638870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:24.640934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:24.640932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554140143853259:4943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:24.640944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554140143853259:4943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:24.640947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554140143853259:4943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:24.640954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:24.641190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:24.641202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:24.641214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:24.641272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:24.641314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554140068332435:4376]
2025-10-02T09:29:24.641874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:24.642122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:24.642161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:24.642460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:24.642521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.642527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.642528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.642529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.642530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.642531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.642532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.642533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.642534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.642535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.642537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.642538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.642542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.642553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.642557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.642561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.642564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.642568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.642571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.642575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.642578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.642582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.642586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.642590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.642596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.642604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.642609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.642614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.642618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.642623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.642627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.642632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.642636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.642641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.642645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.642649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.642653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.642657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.642661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.642665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.642674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.642684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.642691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.642699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.642709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.642718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.642726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.642730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.642762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:24.651197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:24.652679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:24.652696Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:24.652698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:24.652702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:24.652707Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [2:7556554140068332435:4376]
2025-10-02T09:29:24.652721Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:24.652738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:24.652741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.652744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.652745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.652758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:24.652763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:24.652774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:24.652843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.652849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.652851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.652854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:24.652856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:24.652920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:24.652935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.652947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.652958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.652976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:24.652999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853407:4943], now have 1 active actors on pipe
2025-10-02T09:29:24.653007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853176:2446], now have 1 active actors on pipe
2025-10-02T09:29:24.653012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.653015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.653016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.653028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:24.653044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:24.653053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:24.653057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:24.653058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:24.653059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:24.653061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:24.653082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.653088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:24.653106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:24.653073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 409
2025-10-02T09:29:24.653077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 409
2025-10-02T09:29:24.653112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.653115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.653136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:24.653140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.653143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.653144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:24.653150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.653156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:24.653165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.653314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.653329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.653349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.653426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 36 sessionId: src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0
2025-10-02T09:29:24.653750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb83225a-59e26ba0-de1573e6-aa1654ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:24.656492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Write session: try to update token
2025-10-02T09:29:24.656508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:24.663184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:24.663195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.663200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.663229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:24.663245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:24.663366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:24.663480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.663591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.663774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:24.663932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:24.663959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:24.671883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:24.672671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:24.672686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.672688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:24.672690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:24.672696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.672699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.672701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554140068332429:4376]
2025-10-02T09:29:24.672728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:24.672732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.672734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:24.672740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:24.672746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:24.672749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:24.672859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:24.674395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:24.723786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554140143853419:4901]
2025-10-02T09:29:24.724312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7556554140143853419:4901]
2025-10-02T09:29:24.811886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:24.812443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.812453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.812465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853419:4901], now have 1 active actors on pipe
2025-10-02T09:29:24.812635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554140143853419:4901]
2025-10-02T09:29:24.812653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:24.812649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:24.812652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:24.812662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:24.812701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: error at write: Disconnected sessionId: src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0
2025-10-02T09:29:24.812869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0 is DEAD
2025-10-02T09:29:24.813052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:24.813069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Write session will restart in 0.007350s
2025-10-02T09:29:24.813100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Write session: Do CDS request
2025-10-02T09:29:24.813108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:24.821409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.821422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:24.821435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-10-02T09:29:24.821727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.821758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:24.821767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:24.821770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:24.822190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-10-02T09:29:24.822222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:24.822228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:24.822230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:24.822235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554140143853569:4948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:24.822705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554140143853569:4948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:24.824224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554140143853569:4948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:24.824877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:24.827243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:24.827400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:24.827409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:24.827418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:24.827460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:24.827493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554140068332702:4389]
2025-10-02T09:29:24.827519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554140143853569:4948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:24.827529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554140143853569:4948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:24.827531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554140143853569:4948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:24.827535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:24.828093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:24.828344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:24.828384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:24.828672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:24.828715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.828720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.828721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.828722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.828723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.828724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.828725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.828726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.828727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.828728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.828729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.828730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.828735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.828745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.828749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.828752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.828756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.828760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.828764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.828768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.828776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.828780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.828784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.828792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.828814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.828825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:24.828830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.828835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:24.828843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.828849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:24.828857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.828862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:24.828867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.828872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:24.828876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.828881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:24.828889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.828899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:24.828906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.828915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:24.828924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.828933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:24.828939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.828945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.828954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.828959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.828963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.828968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.829003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:24.837417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:24.839022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:24.839042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:24.839045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:24.839050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:24.839056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [2:7556554140068332702:4389]
2025-10-02T09:29:24.839069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:24.839084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:24.839096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.839098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.839100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.839114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:24.839119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:24.839125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:24.839180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.839188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.839190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.839192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:24.839195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:24.839260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:24.839270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.839284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:24.839295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:24.839318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:24.839344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853429:2446], now have 1 active actors on pipe
2025-10-02T09:29:24.839348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853665:4948], now have 1 active actors on pipe
2025-10-02T09:29:24.839354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.839357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.839359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.839372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:24.839388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:24.839395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:24.839398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:24.839400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:24.839404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:24.839407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:24.839414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 410
2025-10-02T09:29:24.839458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 410
2025-10-02T09:29:24.839441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.839449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:24.839451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:24.839510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.839518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.839536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:24.839546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:24.839549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:24.839551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:24.839559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:24.839570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:24.839590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.839718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.839728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.839746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:24.839826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0
2025-10-02T09:29:24.840143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53405c7e-33c16cc-1a3fa278-9e44e229_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:24.842481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Write session: try to update token
2025-10-02T09:29:24.842494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:24.850248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:24.850266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:24.850268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:24.850270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:24.850277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.850281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.850284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554140068332697:4389]
2025-10-02T09:29:24.850317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:24.850324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:24.850326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:24.850339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:24.850348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:24.850351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:24.850464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:24.858351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:24.860846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:24.912698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554140143853696:4901]
2025-10-02T09:29:24.913010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7556554140143853696:4901]
2025-10-02T09:29:24.986088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:24.986323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:24.986334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:24.986347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853696:4901], now have 1 active actors on pipe
2025-10-02T09:29:24.986499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:24.986574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:24.986611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:24.986635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554140143853696:4901]
2025-10-02T09:29:24.986680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0
2025-10-02T09:29:24.986839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0 is DEAD
2025-10-02T09:29:24.987014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:24.987028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Write session will restart in 0.006506s
2025-10-02T09:29:24.987053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Write session: Do CDS request
2025-10-02T09:29:24.987059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:24.994350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.994450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:24.994469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-10-02T09:29:24.994632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:24.994666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:24.994672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:24.994675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:24.995041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-10-02T09:29:24.995080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:24.995082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:24.995083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:24.995100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554140143853752:4959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:24.995617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554140143853752:4959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:24.997679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554140143853752:4959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:24.999904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554140143853752:4959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:24.999913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554140143853752:4959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:24.999915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554140143853752:4959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:24.999919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:25.001098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:25.002994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:25.003134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:25.003142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:25.003148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:25.003183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:25.003218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554144363300244:4393]
2025-10-02T09:29:25.003582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:25.003843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:25.003873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:25.004068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:25.004102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.004106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.004107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.004107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.004108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.004109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.004109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.004110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.004110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.004111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.004111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.004112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.004115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.004121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.004123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.004125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.004127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.004129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.004131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.004133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.004135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.004137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.004139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.004141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.004145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.004149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.004152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.004155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.004158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.004161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.004163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.004165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.004168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.004170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.004172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.004175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.004178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.004181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.004183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.004185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.004187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.004190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.004193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.004196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.004198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.004201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.004205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.004209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.004234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:25.012489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:25.014035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:25.014049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:25.014051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:25.014054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:25.014058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [2:7556554144363300244:4393]
2025-10-02T09:29:25.014070Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:25.014083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:25.014084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.014087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.014089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.014100Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:25.014107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:25.014112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:25.014154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.014158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.014160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.014163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:25.014164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:25.014208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:25.014214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.014221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.014229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.014238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:25.014253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.014258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.014259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.014266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:25.014276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:25.014279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853700:2446], now have 1 active actors on pipe
2025-10-02T09:29:25.014282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554140143853927:4959], now have 1 active actors on pipe
2025-10-02T09:29:25.014284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:25.014286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:25.014287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:25.014295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:25.014297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:25.014320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.014327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:25.014338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:25.014364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 411
2025-10-02T09:29:25.014384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 411
2025-10-02T09:29:25.014496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.014502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.014518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:25.014525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.014527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.014528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:25.014533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.014540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:25.014548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.014651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.014655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.014664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.014759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 36 sessionId: src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0
2025-10-02T09:29:25.015139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3ae544-a9c3f5c8-c54eb7d-ec0b5262_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:25.018256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Write session: try to update token
2025-10-02T09:29:25.018279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:25.024494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:25.024514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.024516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:25.024518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:25.024525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.024530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.024533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554144363300239:4393]
2025-10-02T09:29:25.024568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:25.024577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.024579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:25.024587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:25.024607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:25.024612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:25.024709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:25.036026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:25.038523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:25.088903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554144438821239:4901]
2025-10-02T09:29:25.089275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7556554144438821239:4901]
2025-10-02T09:29:25.168953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:25.169433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.169446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.169462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821239:4901], now have 1 active actors on pipe
2025-10-02T09:29:25.169635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:25.169683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:25.169694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554144438821239:4901]
2025-10-02T09:29:25.169716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:25.169776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0
2025-10-02T09:29:25.169929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0 is DEAD
2025-10-02T09:29:25.170024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:25.170029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Write session will restart in 0.005846s
2025-10-02T09:29:25.170046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Write session: Do CDS request
2025-10-02T09:29:25.170050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:25.177214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.177346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:25.177358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-10-02T09:29:25.177469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.177496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:25.177501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:25.177504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:25.177910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-10-02T09:29:25.177947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:25.177953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:25.177954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:25.177960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554144438821325:4964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:25.178596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554144438821325:4964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:25.181139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554144438821325:4964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:25.182661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:25.184721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:25.184882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:25.184890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:25.184898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:25.184931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:25.185003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554144363300485:4396]
2025-10-02T09:29:25.185010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554144438821325:4964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:25.185028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554144438821325:4964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:25.185030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554144438821325:4964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:25.185035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:25.185362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:25.185591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:25.185620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:25.185812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:25.185842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.185846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.185847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.185848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.185848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.185849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.185849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.185850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.185851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.185851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.185852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.185852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.185855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.185862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.185864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.185867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.185869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.185871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.185873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.185875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.185877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.185879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.185881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.185883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.185887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.185891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.185894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.185897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.185899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.185902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.185904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.185907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.185910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.185912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.185914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.185917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.185919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.185922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.185924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.185927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.185929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.185932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.185934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.185937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.185939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.185942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.185944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.185947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.185965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:25.193862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:25.195416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:25.195432Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:25.195434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:25.195438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:25.195444Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [2:7556554144363300485:4396]
2025-10-02T09:29:25.195456Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:25.195471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:25.195478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.195484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.195486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.195497Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:25.195506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:25.195515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:25.195573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.195580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.195582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.195584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:25.195586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:25.195644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:25.195655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.195666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.195676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.195691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:25.195713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821244:2446], now have 1 active actors on pipe
2025-10-02T09:29:25.195720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821479:4964], now have 1 active actors on pipe
2025-10-02T09:29:25.195725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.195727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.195729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.195739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:25.195755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:25.195757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:25.195760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:25.195762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 412
2025-10-02T09:29:25.195762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:25.195781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 412
2025-10-02T09:29:25.195773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:25.195776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:25.195799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.195802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:25.195804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:25.195819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.195822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.195861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6366dd75-62b46dd4-fff54197-543d08f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:25.195872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.195875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.195878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:25.195886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.195899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:25.195919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.196099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.196109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.196124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.196212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 36 sessionId: src_id|6366dd75-62b46dd4-fff54197-543d08f1_0
2025-10-02T09:29:25.196525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61e2107-3c4039d2-2565fda-9d6645fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6366dd75-62b46dd4-fff54197-543d08f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:25.199051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Write session: try to update token
2025-10-02T09:29:25.199067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:25.205824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:25.205847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.205850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:25.205852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:25.205860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.205863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.205866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554144363300479:4396]
2025-10-02T09:29:25.205903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:25.205906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:25.205908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.205910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:25.205911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:25.205913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:25.206053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:25.211657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|6366dd75-62b46dd4-fff54197-543d08f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:25.214057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:25.269539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554144438821490:4901]
2025-10-02T09:29:25.269756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7556554144438821490:4901]
2025-10-02T09:29:25.340630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:25.341405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.341419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.341435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821490:4901], now have 1 active actors on pipe
2025-10-02T09:29:25.341601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:25.341623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:25.341657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:25.341664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554144438821490:4901]
2025-10-02T09:29:25.341708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6366dd75-62b46dd4-fff54197-543d08f1_0
2025-10-02T09:29:25.341764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|6366dd75-62b46dd4-fff54197-543d08f1_0 is DEAD
2025-10-02T09:29:25.341947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:25.341958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Write session will restart in 0.005511s
2025-10-02T09:29:25.341984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Write session: Do CDS request
2025-10-02T09:29:25.341989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:25.348251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.348331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:25.348344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-10-02T09:29:25.348444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.348468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:25.348476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:25.348480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:25.348863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-10-02T09:29:25.348890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:25.348895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:25.348897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:25.348901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554144438821529:4968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:25.349370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554144438821529:4968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:25.351416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554144438821529:4968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:25.353715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554144438821529:4968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:25.353727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554144438821529:4968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:25.353730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554144438821529:4968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:25.353736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:25.355709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:25.358148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:25.358274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:25.358280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:25.358286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:25.358314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:25.358346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554144363300726:4398]
2025-10-02T09:29:25.358719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:25.358982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:25.359012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:25.359255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:25.359296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.359300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.359300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.359301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.359301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.359302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.359303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.359303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.359304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.359304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.359305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.359305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.359308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.359315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.359317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.359319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.359321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.359323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.359325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.359327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.359329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.359331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.359333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.359335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.359339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.359343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.359346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.359349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.359351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.359354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.359356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.359359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.359361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.359364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.359378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.359383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.359387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.359391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.359394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.359398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.359402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.359406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.359410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.359414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.359418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.359422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.359425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.359429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.359459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:25.367256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:25.368872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:25.368886Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:25.368888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:25.368891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:25.368897Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [2:7556554144363300726:4398]
2025-10-02T09:29:25.368909Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:25.368924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:25.368926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.368929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.368931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.368945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:25.368950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:25.368957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:25.369010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.369018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.369020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.369023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:25.369025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:25.369208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 413
2025-10-02T09:29:25.369226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 413
2025-10-02T09:29:25.369323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:25.369334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.369347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.369358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.369373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:25.369398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821491:2446], now have 1 active actors on pipe
2025-10-02T09:29:25.369406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821724:4968], now have 1 active actors on pipe
2025-10-02T09:29:25.369424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.369432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.369447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.369454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.369456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.369468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:25.369478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:25.369481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:25.369482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:25.369487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:25.369500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:25.369503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:25.369518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:25.369527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.369530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.369533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:25.369540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.369553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:25.369584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.369592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:25.369596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:25.369600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.369766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.369773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.369785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.369867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 36 sessionId: src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0
2025-10-02T09:29:25.370195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6366dd75-62b46dd4-fff54197-543d08f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:25.372950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Write session: try to update token
2025-10-02T09:29:25.372965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:25.379619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:25.379638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.379640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:25.379642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:25.379649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.379653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.379656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554144363300721:4398]
2025-10-02T09:29:25.379695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:25.379699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:25.379705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.379707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:25.379707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:25.379710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:25.379826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:25.386463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:25.388890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:25.441583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554144438821752:4901]
2025-10-02T09:29:25.441825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7556554144438821752:4901]
2025-10-02T09:29:25.520269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:25.520613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.520629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.520648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821752:4901], now have 1 active actors on pipe
2025-10-02T09:29:25.520873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:25.520874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:25.520894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:25.520903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:25.520947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: error at write: Disconnected sessionId: src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0
2025-10-02T09:29:25.520948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554144438821752:4901]
2025-10-02T09:29:25.521112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0 is DEAD
2025-10-02T09:29:25.521295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:25.521302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Write session will restart in 0.007786s
2025-10-02T09:29:25.521322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Write session: Do CDS request
2025-10-02T09:29:25.521328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:25.530479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.530723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:25.530737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-10-02T09:29:25.531611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.531653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:25.531664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:25.531668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:25.532084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-10-02T09:29:25.532117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:25.532124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:25.532126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:25.532131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554144438821783:4973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:25.532600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554144438821783:4973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:25.537202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554144438821783:4973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:25.540614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554144438821783:4973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:25.540629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554144438821783:4973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:25.540632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554144438821783:4973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:25.540643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:25.547891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:25.550781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:25.550976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:25.550985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:25.550995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:25.551049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:25.551099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554144363300979:4401]
2025-10-02T09:29:25.551646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:25.551926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:25.551967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:25.552264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:25.552314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.552320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.552321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.552322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.552323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.552324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.552325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.552326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.552327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.552328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.552330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.552330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.552336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.552346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.552349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.552353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.552356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.552360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.552363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.552366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.552369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.552373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.552376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.552380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.552386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.552393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.552398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.552402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.552406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.552411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.552414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.552419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.552423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.552428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.552432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.552437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.552441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.552446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.552450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.552454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.552458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.552463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.552467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.552472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.552478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.552482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.552486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.552495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.552528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:25.561322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:25.563455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:25.563475Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:25.563479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:25.563484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:25.563492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [2:7556554144363300979:4401]
2025-10-02T09:29:25.563507Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:25.563525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:25.563528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.563531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.563533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.563549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:25.563555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:25.563562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:25.563630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.563647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.563650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.563654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:25.563656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:25.563737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:25.563748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.563762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.563779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.563802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:25.563833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821942:4973], now have 1 active actors on pipe
2025-10-02T09:29:25.563843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438821755:2446], now have 1 active actors on pipe
2025-10-02T09:29:25.563851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.563859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.563863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.563877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:25.563888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:25.563891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:25.563894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:25.563898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:25.563930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 414
2025-10-02T09:29:25.563919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:25.563929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:25.563964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.563966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 414
2025-10-02T09:29:25.563968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:25.563978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:25.563996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.564011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.564049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|850b4d94-3498a02-f768b224-de16b1c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:25.564061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.564065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.564066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:25.564077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.564085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:25.564110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.564262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.564272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.564287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.564381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 36 sessionId: src_id|850b4d94-3498a02-f768b224-de16b1c0_0
2025-10-02T09:29:25.564744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0afbdc4-5db5a8c4-691f8351-7717a563_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|850b4d94-3498a02-f768b224-de16b1c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:25.567305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Write session: try to update token
2025-10-02T09:29:25.567324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:25.575315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:25.575336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.575338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:25.575340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:25.575348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.575352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.575356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554144363300974:4401]
2025-10-02T09:29:25.575393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:25.575398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:25.575403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.575404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:25.575405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:25.575407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:25.575540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:25.582840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|850b4d94-3498a02-f768b224-de16b1c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:25.585377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:25.621302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554144438822003:4901]
2025-10-02T09:29:25.621809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7556554144438822003:4901]
2025-10-02T09:29:25.719986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:25.720667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.720682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.720700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438822003:4901], now have 1 active actors on pipe
2025-10-02T09:29:25.720866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:25.721263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:25.721274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Write session will restart in 0.007868s
2025-10-02T09:29:25.721295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Write session: Do CDS request
2025-10-02T09:29:25.721301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:25.720869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:25.720886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:25.720938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: error at write: Disconnected sessionId: src_id|850b4d94-3498a02-f768b224-de16b1c0_0
2025-10-02T09:29:25.721124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|850b4d94-3498a02-f768b224-de16b1c0_0 is DEAD
2025-10-02T09:29:25.721285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554144438822003:4901]
2025-10-02T09:29:25.721296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:25.730344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.730417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:25.730432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-10-02T09:29:25.730575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.730607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:25.730617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:25.730621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:25.731070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-10-02T09:29:25.731115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:25.731121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:25.731123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:25.731128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554144438822027:4977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:25.731642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554144438822027:4977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:25.733651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554144438822027:4977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:25.736155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554144438822027:4977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:25.736169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554144438822027:4977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:25.736172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554144438822027:4977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:25.736179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:25.749288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:25.751908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:25.752102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:25.752112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:25.752123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:25.752174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:25.752214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554144363301223:4403]
2025-10-02T09:29:25.752859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:25.753211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:25.753270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:25.753560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:25.753635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.753640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.753641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.753642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.753643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.753644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.753645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.753646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.753647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.753648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.753649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.753650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.753655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.753666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.753670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.753674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.753678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.753682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.753686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.753691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.753694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.753700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.753705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.753709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.753715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.753723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.753728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.753735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.753739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.753745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.753751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.753760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.753766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.753775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.753780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.753789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.753794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.753803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.753809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.753818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.753822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.753828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.753833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.753840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.753847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.753853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.753861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.753867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.753908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:25.765861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:25.768073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:25.768092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:25.768095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:25.768099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:25.768106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [2:7556554144363301223:4403]
2025-10-02T09:29:25.768120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:25.768137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:25.768140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.768143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.768145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.768161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:25.768169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:25.768176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:25.768236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.768249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.768251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.768253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:25.768256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:25.768325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:25.768332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.768346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.768359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.768379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:25.768403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438822008:2446], now have 1 active actors on pipe
2025-10-02T09:29:25.768413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.768416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.768418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.768431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:25.768444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438822064:4977], now have 1 active actors on pipe
2025-10-02T09:29:25.768445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:25.768448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:25.768449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:25.768456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:25.768470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:25.768474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:25.768461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 415
2025-10-02T09:29:25.768480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 415
2025-10-02T09:29:25.768517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.768529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:25.768536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:25.768544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.768551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.768593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:25.768604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.768608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.768610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:25.768621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.768635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:25.768665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.768908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.768921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.768940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.769028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 36 sessionId: src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0
2025-10-02T09:29:25.769398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850b4d94-3498a02-f768b224-de16b1c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:25.771813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Write session: try to update token
2025-10-02T09:29:25.771826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:25.780211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:25.780237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.780239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:25.780241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:25.780249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.780254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.780258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554144363301218:4403]
2025-10-02T09:29:25.780294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:25.780302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.780304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:25.780304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:25.780310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:25.780314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:25.780462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:25.787182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:25.789718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:25.820929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554144438822272:4901]
2025-10-02T09:29:25.821237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7556554144438822272:4901]
2025-10-02T09:29:25.924745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:25.925156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.925168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.925185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438822272:4901], now have 1 active actors on pipe
2025-10-02T09:29:25.925430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554144438822272:4901]
2025-10-02T09:29:25.925450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:25.925454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:25.925463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:25.925513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: error at write: Disconnected sessionId: src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0
2025-10-02T09:29:25.925678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0 is DEAD
2025-10-02T09:29:25.925816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:25.925823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Write session will restart in 0.006005s
2025-10-02T09:29:25.925416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:25.925854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Write session: Do CDS request
2025-10-02T09:29:25.925860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:25.933248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.933466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:25.933478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-10-02T09:29:25.934048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:25.934078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:25.934082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:25.934086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:25.934462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-10-02T09:29:25.934497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:25.934499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:25.934500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:25.934505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554144438822356:4989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:25.934999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554144438822356:4989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:25.938519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554144438822356:4989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:25.941739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554144438822356:4989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:25.941754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554144438822356:4989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:25.941758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554144438822356:4989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:25.941765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:25.943455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:25.945893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:25.946154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:25.946166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:25.946178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:25.946240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:25.946278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554144363301504:4418]
2025-10-02T09:29:25.946834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:25.947131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:25.947188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:25.947518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:25.947595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.947602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.947603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.947604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.947605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.947606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.947607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.947608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.947609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.947610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.947611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.947612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.947617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.947629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.947632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.947636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.947640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.947644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.947647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.947651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.947654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.947660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.947663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.947666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.947673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.947681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:25.947686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.947691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:25.947695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.947700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:25.947704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.947709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:25.947714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.947718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:25.947723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.947727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:25.947731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.947736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:25.947740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.947744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:25.947749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.947754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:25.947758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.947763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.947773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.947778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.947782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.947787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.947821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:25.956613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:25.958547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:25.958563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:25.958565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:25.958568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:25.958574Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [2:7556554144363301504:4418]
2025-10-02T09:29:25.958586Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:25.958601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:25.958604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.958606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.958608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.958622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:25.958626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:25.958631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:25.958674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.958680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.958683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.958685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:25.958686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:25.958744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:25.958751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.958759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:25.958765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:25.958774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:25.958786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438822299:2446], now have 1 active actors on pipe
2025-10-02T09:29:25.958798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.958800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.958801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.958814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:25.958826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554144438822532:4989], now have 1 active actors on pipe
2025-10-02T09:29:25.958837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:25.958839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:25.958843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:25.958845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:25.958849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:25.958851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:25.958883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.958892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:25.958919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:25.958926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.958935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.958878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 416
2025-10-02T09:29:25.958893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 416
2025-10-02T09:29:25.958955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:25.958966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:25.958970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:25.958971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:25.958981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:25.958990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:25.959001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.959246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:25.959255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:25.959271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:25.959401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0
2025-10-02T09:29:25.959741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91300d08-9ca38fa7-dfb02db6-69eddeef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:25.962364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Write session: try to update token
2025-10-02T09:29:25.962380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:25.969514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:25.969536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.969544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.969582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:25.969596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:25.969742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:25.969872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:25.970002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:25.970139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:25.970327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:25.970371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:25.977566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:25.979363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:25.979380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:25.979383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:25.979384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:25.979393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.979397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.979400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554144363301499:4418]
2025-10-02T09:29:25.979433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:25.979440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:25.979442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:25.979443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:25.979448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:25.979452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:25.979588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:25.980100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:26.025260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554148733789843:4901]
2025-10-02T09:29:26.025541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7556554148733789843:4901]
2025-10-02T09:29:26.114466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:26.114904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.114914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.114928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733789843:4901], now have 1 active actors on pipe
2025-10-02T09:29:26.115141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:26.115132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554148733789843:4901]
2025-10-02T09:29:26.115157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:26.115165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:26.115168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:26.115216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: error at write: Disconnected sessionId: src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0
2025-10-02T09:29:26.115392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0 is DEAD
2025-10-02T09:29:26.115584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:26.115605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Write session will restart in 0.008364s
2025-10-02T09:29:26.115646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Write session: Do CDS request
2025-10-02T09:29:26.115655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:26.125326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.125425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:26.125438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-10-02T09:29:26.125589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.125626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:26.125630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:26.125634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:26.126054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-10-02T09:29:26.126100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:26.126106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:26.126108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:26.126114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554148733789934:4994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:26.126595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554148733789934:4994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:26.130187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554148733789934:4994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:26.132820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554148733789934:4994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:26.132832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554148733789934:4994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:26.132835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554148733789934:4994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:26.132841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:26.132967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:26.135480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:26.135650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:26.135659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:26.135669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:26.135713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:26.135749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554148658269046:4421]
2025-10-02T09:29:26.136350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:26.136652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:26.136691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:26.136991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:26.137060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.137067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.137068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.137069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.137070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.137071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.137071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.137072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.137074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.137075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.137076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.137077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.137081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.137091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.137094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.137098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.137102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.137106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.137110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.137113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.137117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.137121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.137124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.137127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.137134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.137141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.137147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.137152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.137161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.137166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.137175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.137180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.137188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.137193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.137202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.137207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.137211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.137220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.137225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.137234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.137238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.137244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.137252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.137257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.137265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.137270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.137278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.137283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.137321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:26.146282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:26.148374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:26.148394Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:26.148396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:26.148400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:26.148407Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [2:7556554148658269046:4421]
2025-10-02T09:29:26.148424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:26.148441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:26.148445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.148448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.148450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.148464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:26.148474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:26.148482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:26.148543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.148549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.148551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.148554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:26.148557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:26.148628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:26.148639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.148652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.148662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.148678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:26.148695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.148697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.148699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.148707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:26.148716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:26.148721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:26.148723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:26.148725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:26.148733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:26.148736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:26.148747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790086:4994], now have 1 active actors on pipe
2025-10-02T09:29:26.148750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733789845:2446], now have 1 active actors on pipe
2025-10-02T09:29:26.148782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.148797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:26.148818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:26.148837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 417
2025-10-02T09:29:26.148877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 417
2025-10-02T09:29:26.148910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.148920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.148940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:26.148951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.148955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.148957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:26.148964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.148973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:26.148993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.149157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.149166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.149178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.149268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 36 sessionId: src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0
2025-10-02T09:29:26.149598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb4afe4f-a153b4a1-6bd6c785-15f3f8be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:26.152294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Write session: try to update token
2025-10-02T09:29:26.152311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:26.160376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:26.160397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.160400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:26.160401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:26.160409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.160413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.160417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554148658269040:4421]
2025-10-02T09:29:26.160453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:26.160460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.160462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:26.160464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:26.160470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:26.160474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:26.160606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:26.165283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:26.167761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:26.215254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554148733790100:4901]
2025-10-02T09:29:26.215566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7556554148733790100:4901]
2025-10-02T09:29:26.307750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:26.308053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.308067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.308101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790100:4901], now have 1 active actors on pipe
2025-10-02T09:29:26.308568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554148733790100:4901]
2025-10-02T09:29:26.308603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:26.308605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:26.308652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:26.308669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: error at write: Disconnected sessionId: src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0
2025-10-02T09:29:26.309043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:26.309054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Write session will restart in 0.009108s
2025-10-02T09:29:26.308888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0 is DEAD
2025-10-02T09:29:26.308944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:26.309077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Write session: Do CDS request
2025-10-02T09:29:26.309084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:26.319396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.319461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:26.319477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-10-02T09:29:26.319614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.319643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:26.319651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:26.319667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:26.320240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-10-02T09:29:26.320284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:26.320285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:26.320287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:26.320292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554148733790198:4998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:26.320825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554148733790198:4998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:26.323752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554148733790198:4998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:26.325606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:26.328213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:26.328434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:26.328447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:26.328457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:26.328538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:26.328581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554148658269290:4423]
2025-10-02T09:29:26.328780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554148733790198:4998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:26.328796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554148733790198:4998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:26.328813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554148733790198:4998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:26.328821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:26.329165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:26.329447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:26.329498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:26.330039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:26.330130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.330138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.330139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.330140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.330141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.330142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.330143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.330145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.330146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.330147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.330147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.330149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.330155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.330165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.330169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.330172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.330176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.330180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.330183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.330186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.330190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.330195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.330199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.330202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.330210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.330217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.330222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.330227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.330231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.330236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.330239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.330244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.330249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.330253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.330257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.330262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.330269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.330274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.330278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.330283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.330287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.330298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.330303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.330308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.330316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.330322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.330330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.330335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.330372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:26.338943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:26.340529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:26.340547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:26.340550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:26.340554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:26.340560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [2:7556554148658269290:4423]
2025-10-02T09:29:26.340576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:26.340593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:26.340596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.340599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.340601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.340618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:26.340623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:26.340629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:26.340695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.340702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.340704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.340710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:26.340712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:26.340776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:26.340783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.340797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.340830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.340849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:26.340878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790102:2446], now have 1 active actors on pipe
2025-10-02T09:29:26.340881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790341:4998], now have 1 active actors on pipe
2025-10-02T09:29:26.340886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.340888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.340890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.340902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:26.340915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:26.340916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:26.340918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:26.340920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:26.340928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:26.340931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:26.340964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.340976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:26.340980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:26.341145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 418
2025-10-02T09:29:26.341172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 418
2025-10-02T09:29:26.341213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.341228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.341259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:26.341271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.341289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.341296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:26.341305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.341320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:26.341340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.341470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.341478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.341490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.341584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 36 sessionId: src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0
2025-10-02T09:29:26.341965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd31b2d-bc542df2-db9edd0a-fb48503c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:26.344503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Write session: try to update token
2025-10-02T09:29:26.344518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:26.352274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:26.352294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.352296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:26.352298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:26.352306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.352309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.352312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554148658269285:4423]
2025-10-02T09:29:26.352340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:26.352346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.352348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:26.352352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:26.352359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:26.352362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:26.352479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:26.359380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:26.361857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:26.408743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554148733790354:4901]
2025-10-02T09:29:26.409008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7556554148733790354:4901]
2025-10-02T09:29:26.495015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:26.495475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.495492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.495510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790354:4901], now have 1 active actors on pipe
2025-10-02T09:29:26.495743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554148733790354:4901]
2025-10-02T09:29:26.495784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:26.495846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:26.495855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:26.495915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: error at write: Disconnected sessionId: src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0
2025-10-02T09:29:26.495911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:26.496082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0 is DEAD
2025-10-02T09:29:26.496213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:26.496221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Write session will restart in 0.008382s
2025-10-02T09:29:26.496252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Write session: Do CDS request
2025-10-02T09:29:26.496258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:26.505304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.505369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:26.505387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-10-02T09:29:26.505501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.505543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:26.505553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:26.505557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:26.505965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-10-02T09:29:26.505998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:26.506006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:26.506010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:26.506015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554148733790412:5005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:26.506552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554148733790412:5005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:26.509980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554148733790412:5005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:26.513429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554148733790412:5005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:26.513448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554148733790412:5005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:26.513451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554148733790412:5005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:26.513459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:26.516471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:26.519985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:26.520195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:26.520207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:26.520219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:26.520286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:26.520345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554148658269549:4426]
2025-10-02T09:29:26.520990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:26.522563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:26.522620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:26.522983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:26.523050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.523058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.523059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.523060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.523062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.523064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.523067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.523068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.523069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.523074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.523106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.523110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.523114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.523117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.523121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.523125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.523128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.523131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.523135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.523139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.523142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.523149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.523157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.523162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.523167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.523171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.523176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.523180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.523184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.523189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.523193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.523197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.523201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.523205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.523210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.523214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.523219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.523223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.523231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.523235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.523249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.523253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.523257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.523261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.523266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.523298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:26.533071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:26.534699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:26.534720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:26.534723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:26.534727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:26.534734Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [2:7556554148658269549:4426]
2025-10-02T09:29:26.534748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:26.534765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:26.534768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.534771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.534773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.534789Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:26.534799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:26.534806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:26.534863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.534871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.534873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.534876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:26.534878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:26.535169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 419
2025-10-02T09:29:26.535212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 419
2025-10-02T09:29:26.535281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:26.535291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.535306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.535319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.535333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:26.535352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790586:5005], now have 1 active actors on pipe
2025-10-02T09:29:26.535358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790368:2446], now have 1 active actors on pipe
2025-10-02T09:29:26.535372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.535379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.535389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.535391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.535392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.535403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:26.535419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:26.535424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:26.535429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:26.535431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:26.535439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:26.535442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:26.535458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1018802f-f16e5fc0-f645b407-3b64206a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:26.535469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.535472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.535474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:26.535482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.535490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:26.535527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.535538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:26.535543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:26.535548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.535700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.535710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.535721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.535803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 36 sessionId: src_id|1018802f-f16e5fc0-f645b407-3b64206a_0
2025-10-02T09:29:26.536169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b50cf-ec7a163b-877e3f38-6a9e2774_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1018802f-f16e5fc0-f645b407-3b64206a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:26.538971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Write session: try to update token
2025-10-02T09:29:26.538988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:26.546816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:26.546847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.546858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.546908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:26.546911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:26.547237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:26.547437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:26.547642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:26.547855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:26.548145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:26.548207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:26.554445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|1018802f-f16e5fc0-f645b407-3b64206a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:26.557056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:26.557092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.557097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:26.557100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:26.557111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.557119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.557125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554148658269544:4426]
2025-10-02T09:29:26.557144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:26.557162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:26.557176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.557178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:26.557178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:26.557185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:26.557191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:26.557324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:26.596164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554148733790625:4901]
2025-10-02T09:29:26.596461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7556554148733790625:4901]
2025-10-02T09:29:26.700246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:26.700690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.700707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.700726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790625:4901], now have 1 active actors on pipe
2025-10-02T09:29:26.701008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554148733790625:4901]
2025-10-02T09:29:26.701045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:26.701076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:26.700977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:26.701468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:26.701475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Write session will restart in 0.008380s
2025-10-02T09:29:26.701495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Write session: Do CDS request
2025-10-02T09:29:26.701155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1018802f-f16e5fc0-f645b407-3b64206a_0
2025-10-02T09:29:26.701501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:26.701331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|1018802f-f16e5fc0-f645b407-3b64206a_0 is DEAD
2025-10-02T09:29:26.711317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.711568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:26.711584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-10-02T09:29:26.711708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.711735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:26.711739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:26.711744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:26.712120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-10-02T09:29:26.712150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:26.712151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:26.712153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:26.712158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554148733790707:5009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:26.712660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554148733790707:5009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:26.714925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554148733790707:5009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:26.717633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554148733790707:5009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:26.717649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554148733790707:5009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:26.717652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554148733790707:5009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:26.717661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:26.717994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:26.720600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:26.720789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:26.720816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:26.720826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:26.720875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:26.720912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554148658269796:4428]
2025-10-02T09:29:26.721465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:26.721760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:26.721807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:26.722097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:26.722150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.722155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.722156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.722157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.722158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.722159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.722160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.722162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.722163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.722164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.722165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.722165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.722170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.722179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.722183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.722186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.722189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.722192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.722195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.722199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.722202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.722205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.722208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.722212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.722217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.722223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.722228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.722233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.722236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.722241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.722244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.722249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.722253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.722257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.722260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.722265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.722269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.722273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.722277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.722282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.722287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.722291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.722295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.722303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.722307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.722311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.722315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.722353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:26.731126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:26.733088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:26.733102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:26.733103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:26.733107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:26.733113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [2:7556554148658269796:4428]
2025-10-02T09:29:26.733126Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:26.733143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:26.733145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.733148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.733150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.733164Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:26.733168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:26.733179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:26.733232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.733239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.733240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.733243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:26.733245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:26.733310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:26.733317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.733329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.733342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.733359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:26.733382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790628:2446], now have 1 active actors on pipe
2025-10-02T09:29:26.733389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790870:5009], now have 1 active actors on pipe
2025-10-02T09:29:26.733394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.733396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.733398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.733409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:26.733420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:26.733427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:26.733430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:26.733433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:26.733436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:26.733439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:26.733517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 420
2025-10-02T09:29:26.733470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.733517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 420
2025-10-02T09:29:26.733485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:26.733490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:26.733617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.733627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.733651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa158581-e575e652-17348a0d-deade378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:26.733668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.733671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.733674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:26.733682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.733691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:26.733706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.733858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.733865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.733876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.733948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa158581-e575e652-17348a0d-deade378_0
2025-10-02T09:29:26.734301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1018802f-f16e5fc0-f645b407-3b64206a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa158581-e575e652-17348a0d-deade378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:26.736857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Write session: try to update token
2025-10-02T09:29:26.736872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:26.745030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:26.745048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.745051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:26.745053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:26.745061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.745067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.745070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554148658269791:4428]
2025-10-02T09:29:26.745104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:26.745110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.745112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:26.745129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:26.745142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:26.745146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:26.745248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:26.750588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|aa158581-e575e652-17348a0d-deade378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:26.753070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:26.800943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554148733790892:4901]
2025-10-02T09:29:26.801221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7556554148733790892:4901]
2025-10-02T09:29:26.886358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:26.886758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.886777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.886812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790892:4901], now have 1 active actors on pipe
2025-10-02T09:29:26.887201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:26.887255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554148733790892:4901]
2025-10-02T09:29:26.887273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:26.887345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa158581-e575e652-17348a0d-deade378_0
2025-10-02T09:29:26.887025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:26.887514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|aa158581-e575e652-17348a0d-deade378_0 is DEAD
2025-10-02T09:29:26.887677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:26.887686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Write session will restart in 0.005978s
2025-10-02T09:29:26.887711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Write session: Do CDS request
2025-10-02T09:29:26.887717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:26.895346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.895427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:26.895447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-10-02T09:29:26.895563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:26.895593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:26.895601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:26.895605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:26.895983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-10-02T09:29:26.896015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:26.896022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:26.896023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:26.896028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554148733790909:5014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:26.896502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554148733790909:5014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:26.899547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554148733790909:5014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:26.904165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554148733790909:5014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:26.904181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554148733790909:5014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:26.904184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554148733790909:5014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:26.904191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:26.909819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:26.912484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:26.912679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:26.912689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:26.912698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:26.912739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:26.912784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554148658270077:4437]
2025-10-02T09:29:26.913304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:26.913612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:26.913678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:26.913999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:26.914075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.914082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.914084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.914085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.914086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.914087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.914088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.914089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.914090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.914091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.914092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.914093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.914098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.914109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.914113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.914117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.914120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.914123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.914127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.914130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.914134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.914138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.914141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.914144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.914152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.914158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:26.914163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.914168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:26.914172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.914176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:26.914191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.914196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:26.914200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.914204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:26.914208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.914213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:26.914219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.914224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:26.914228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.914233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:26.914239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.914244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:26.914248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.914253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.914257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.914262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.914265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.914270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.914314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:26.922944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:26.924860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:26.924880Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:26.924883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:26.924886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:26.924892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [2:7556554148658270077:4437]
2025-10-02T09:29:26.924904Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:26.924919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:26.924922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.924924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.924926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.924940Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:26.924945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:26.924951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:26.925004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.925012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.925014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.925017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:26.925019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:26.925081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:26.925089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.925102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:26.925113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:26.925129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:26.925148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733790895:2446], now have 1 active actors on pipe
2025-10-02T09:29:26.925157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733791058:5014], now have 1 active actors on pipe
2025-10-02T09:29:26.925163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.925166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.925167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.925186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:26.925198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:26.925198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:26.925201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:26.925203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:26.925217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:26.925220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:26.925250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.925263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:26.925268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:26.925418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 421
2025-10-02T09:29:26.925461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 421
2025-10-02T09:29:26.925491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.925504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.925525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:26.925537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:26.925545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:26.925547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:26.925556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:26.925566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:26.925586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.925751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:26.925762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:26.925781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:26.925859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0
2025-10-02T09:29:26.926194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa158581-e575e652-17348a0d-deade378_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:26.928794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Write session: try to update token
2025-10-02T09:29:26.928839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:26.936926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:26.936944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.936951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.936991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:26.936994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:26.937153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:26.937283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:26.937405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:26.937557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:26.937736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:26.937777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:26.946486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:26.946510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:26.946512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:26.946514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:26.946522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.946526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.946529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554148658270071:4437]
2025-10-02T09:29:26.946561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:26.946566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:26.946568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:26.946569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:26.946584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:26.946588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:26.946695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:26.957945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:26.960407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:26.986821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554148733791172:4901]
2025-10-02T09:29:26.987123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7556554148733791172:4901]
2025-10-02T09:29:27.080006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:27.080688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.080704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.080721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554148733791172:4901], now have 1 active actors on pipe
2025-10-02T09:29:27.080913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:27.080932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:27.080936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554148733791172:4901]
2025-10-02T09:29:27.080954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:27.080956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:27.081005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: error at write: Disconnected sessionId: src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0
2025-10-02T09:29:27.081145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0 is DEAD
2025-10-02T09:29:27.081279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:27.081285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Write session will restart in 0.007180s
2025-10-02T09:29:27.081303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Write session: Do CDS request
2025-10-02T09:29:27.081307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:27.089303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.089401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:27.089413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-10-02T09:29:27.089518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.089549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:27.089558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:27.089562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:27.089969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-10-02T09:29:27.090006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:27.090007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:27.090009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:27.090014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554153028758549:5025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:27.090522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554153028758549:5025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:27.093084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554153028758549:5025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:27.095736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:27.095913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554153028758549:5025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:27.095926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554153028758549:5025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:27.095932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554153028758549:5025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:27.095939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:27.098529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:27.098716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:27.098727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:27.098739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:27.098802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:27.098841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554152953237632:4445]
2025-10-02T09:29:27.099398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:27.099674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:27.099715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:27.099963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:27.100016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.100022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.100023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.100024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.100025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.100026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.100027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.100028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.100029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.100030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.100031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.100032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.100036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.100046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.100050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.100054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.100057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.100061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.100065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.100069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.100072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.100076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.100079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.100083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.100090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.100097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.100102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.100107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.100111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.100115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.100119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.100124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.100128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.100132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.100136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.100141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.100146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.100151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.100156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.100160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.100164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.100169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.100173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.100178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.100183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.100187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.100196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.100201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.100240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:27.108416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:27.110144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:27.110158Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:27.110160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:27.110163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:27.110169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [2:7556554152953237632:4445]
2025-10-02T09:29:27.110182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:27.110197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:27.110199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.110207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.110209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.110219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:27.110224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:27.110233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:27.110286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.110293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.110295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.110298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:27.110300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:27.110365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:27.110372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.110384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.110394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.110408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:27.110428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028758716:5025], now have 1 active actors on pipe
2025-10-02T09:29:27.110435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028758471:2446], now have 1 active actors on pipe
2025-10-02T09:29:27.110441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.110443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.110445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.110456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:27.110467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:27.110473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:27.110477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:27.110479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:27.110483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:27.110486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:27.110514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.110520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:27.110540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:27.110511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 422
2025-10-02T09:29:27.110547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.110563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 422
2025-10-02T09:29:27.110550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.110572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:27.110577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.110580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.110581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:27.110589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.110597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:27.110611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.110771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.110785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.110807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.110904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 36 sessionId: src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0
2025-10-02T09:29:27.111234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4d2790-7ddb2bb9-70f92178-32458dc0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:27.113783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Write session: try to update token
2025-10-02T09:29:27.113800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:27.121072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:27.121091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:27.121094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:27.121095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:27.121102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.121106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.121109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554152953237624:4445]
2025-10-02T09:29:27.121145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:27.121150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.121153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:27.121158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:27.121164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:27.121168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:27.121275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:27.126626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:27.128943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:27.181345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554153028758729:4901]
2025-10-02T09:29:27.181576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7556554153028758729:4901]
2025-10-02T09:29:27.249324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:27.249771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.249783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.249810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028758729:4901], now have 1 active actors on pipe
2025-10-02T09:29:27.249954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:27.250008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:27.250010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:27.250019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:27.250044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554153028758729:4901]
2025-10-02T09:29:27.250077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: error at write: Disconnected sessionId: src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0
2025-10-02T09:29:27.250219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0 is DEAD
2025-10-02T09:29:27.250369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:27.250377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Write session will restart in 0.008827s
2025-10-02T09:29:27.250394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Write session: Do CDS request
2025-10-02T09:29:27.250398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:27.260156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.260234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:27.260243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-10-02T09:29:27.260361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.260401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:27.260407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:27.260410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:27.260782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-10-02T09:29:27.260826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:27.260831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:27.260832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:27.260837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554153028758878:5030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:27.261246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554153028758878:5030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:27.262963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554153028758878:5030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:27.263526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:27.265656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:27.265797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:27.265805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:27.265814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:27.265853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:27.265883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554152953237881:4448]
2025-10-02T09:29:27.265891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554153028758878:5030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:27.265902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554153028758878:5030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:27.265905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554153028758878:5030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:27.265910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:27.266309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:27.266516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:27.266544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:27.266731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:27.266761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.266768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.266768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.266769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.266770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.266770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.266771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.266771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.266772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.266772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.266773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.266773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.266776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.266785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.266789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.266792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.266796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.266799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.266802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.266805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.266809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.266812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.266815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.266817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.266821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.266825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.266829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.266832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.266835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.266838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.266840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.266843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.266845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.266848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.266851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.266854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.266856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.266858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.266861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.266863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.266867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.266871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.266875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.266878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.266881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.266886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.266889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.266893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.266920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:27.274812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:27.276323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:27.276337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:27.276340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:27.276343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:27.276348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [2:7556554152953237881:4448]
2025-10-02T09:29:27.276360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:27.276374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:27.276381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.276384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.276386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.276401Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:27.276410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:27.276416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:27.276465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.276471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.276473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.276476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:27.276478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:27.276533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:27.276539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.276553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.276568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.276587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:27.276609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028758978:5030], now have 1 active actors on pipe
2025-10-02T09:29:27.276612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028758731:2446], now have 1 active actors on pipe
2025-10-02T09:29:27.276617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.276619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.276618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 423
2025-10-02T09:29:27.276621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.276623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 423
2025-10-02T09:29:27.276632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:27.276644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:27.276656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:27.276661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:27.276666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:27.276669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:27.276671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:27.276680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.276682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:27.276692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:27.276704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.276708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.276733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:27.276743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.276747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.276748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:27.276755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.276762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:27.276781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.277046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.277055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.277067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.277289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0
2025-10-02T09:29:27.277551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83546a1f-11c24a79-a1dbfabd-32fd8af5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:27.279943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Write session: try to update token
2025-10-02T09:29:27.279955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:27.286567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:27.286582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:27.286583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:27.286585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:27.286591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.286594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.286596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554152953237876:4448]
2025-10-02T09:29:27.286622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:27.286627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.286628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:27.286634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:27.286640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:27.286643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:27.286739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:27.292268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:27.294531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:27.350323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554153028758989:4901]
2025-10-02T09:29:27.350616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7556554153028758989:4901]
2025-10-02T09:29:27.428210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:27.428751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.428764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.428777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028758989:4901], now have 1 active actors on pipe
2025-10-02T09:29:27.428994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:27.429016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:27.429024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:27.429030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:27.429060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554153028758989:4901]
2025-10-02T09:29:27.429085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: error at write: Disconnected sessionId: src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0
2025-10-02T09:29:27.429252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0 is DEAD
2025-10-02T09:29:27.429395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:27.429405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Write session will restart in 0.005925s
2025-10-02T09:29:27.429423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Write session: Do CDS request
2025-10-02T09:29:27.429427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:27.436221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.436306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:27.436319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-10-02T09:29:27.436437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.436466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:27.436474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:27.436478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:27.436912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-10-02T09:29:27.436949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:27.436956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:27.436957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:27.436962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554153028759036:5035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:27.437475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554153028759036:5035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:27.440472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554153028759036:5035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:27.442957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554153028759036:5035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:27.442970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554153028759036:5035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:27.442972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554153028759036:5035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:27.442980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:27.443988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:27.446273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:27.446426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:27.446436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:27.446445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:27.446491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:27.446524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554152953238145:4451]
2025-10-02T09:29:27.447031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:27.447290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:27.447315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:27.447530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:27.447566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.447570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.447571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.447571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.447572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.447572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.447573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.447573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.447574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.447574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.447575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.447575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.447578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.447586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.447588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.447590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.447592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.447594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.447596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.447598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.447600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.447602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.447604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.447606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.447610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.447614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.447617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.447620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.447623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.447625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.447627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.447631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.447633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.447636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.447641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.447645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.447649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.447653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.447657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.447661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.447665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.447671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.447675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.447679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.447683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.447688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.447691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.447693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.447711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:27.455732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:27.457453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:27.457467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:27.457469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:27.457472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:27.457478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [2:7556554152953238145:4451]
2025-10-02T09:29:27.457490Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:27.457506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:27.457509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.457511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.457513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.457525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:27.457530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:27.457536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:27.457584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.457592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.457594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.457596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:27.457599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:27.457657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:27.457669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.457683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.457700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.457716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:27.457734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759003:2446], now have 1 active actors on pipe
2025-10-02T09:29:27.457743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759248:5035], now have 1 active actors on pipe
2025-10-02T09:29:27.457749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.457751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.457753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.457764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:27.457776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:27.457777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:27.457779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:27.457781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:27.457791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:27.457794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:27.457818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.457831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:27.457820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 424
2025-10-02T09:29:27.457825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 424
2025-10-02T09:29:27.457852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:27.457950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.457958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.457974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:27.457983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.457986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.457988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:27.457996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.458005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:27.458019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.458209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.458216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.458228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.458338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 36 sessionId: src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0
2025-10-02T09:29:27.458681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e8c65ad-a56cb0dd-252a8258-e7d4ce67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:27.461194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Write session: try to update token
2025-10-02T09:29:27.461206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:27.468131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:27.468148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:27.468150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:27.468151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:27.468157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.468161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.468167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554152953238140:4451]
2025-10-02T09:29:27.468194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:27.468198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.468200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:27.468234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:27.468239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:27.468242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:27.468328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:27.474324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:27.476753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:27.529030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554153028759263:4901]
2025-10-02T09:29:27.529288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7556554153028759263:4901]
2025-10-02T09:29:27.607235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:27.607794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.607807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.607824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759263:4901], now have 1 active actors on pipe
2025-10-02T09:29:27.607993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:27.608734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:27.608755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Write session will restart in 0.007075s
2025-10-02T09:29:27.608777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Write session: Do CDS request
2025-10-02T09:29:27.608783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:27.608129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554153028759263:4901]
2025-10-02T09:29:27.608161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:27.608191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:27.608254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0
2025-10-02T09:29:27.608419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0 is DEAD
2025-10-02T09:29:27.617255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.617583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:27.617600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-10-02T09:29:27.617755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.617788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:27.617793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:27.617798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:27.618289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-10-02T09:29:27.618323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:27.618326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:27.618327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:27.618332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554153028759304:5039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:27.618801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554153028759304:5039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:27.621987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554153028759304:5039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:27.625225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554153028759304:5039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:27.625239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554153028759304:5039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:27.625242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554153028759304:5039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:27.625262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:27.627567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:27.630242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:27.630441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:27.630453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:27.630465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:27.630535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:27.630579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554152953238397:4453]
2025-10-02T09:29:27.631150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:27.631521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:27.631573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:27.631887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:27.631941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.631948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.631949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.631950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.631951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.631952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.631953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.631954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.631955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.631956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.631957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.631958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.631962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.631972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.631976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.631979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.631982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.631986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.631989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.631992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.631995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.632000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.632003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.632006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.632012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.632018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.632024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.632029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.632033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.632037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.632040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.632044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.632048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.632052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.632056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.632060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.632064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.632068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.632072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.632076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.632080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.632084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.632088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.632092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.632096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.632102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.632105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.632109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.632138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:27.640875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:27.642712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:27.642737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:27.642740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:27.642744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:27.642751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [2:7556554152953238397:4453]
2025-10-02T09:29:27.642765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:27.642782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:27.642785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.642788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.642790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.642806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:27.642811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:27.642817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:27.642875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.642883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.642885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.642888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:27.642890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:27.642948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:27.642956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.642969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.642979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.642996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:27.643014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759504:5039], now have 1 active actors on pipe
2025-10-02T09:29:27.643018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759265:2446], now have 1 active actors on pipe
2025-10-02T09:29:27.643023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.643025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.643027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.643038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:27.643052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:27.643065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:27.643067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:27.643109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.643116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:27.643123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:27.643134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:27.643137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:27.643114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 425
2025-10-02T09:29:27.643143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:27.643123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 425
2025-10-02T09:29:27.643168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.643178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.643200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:27.643209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.643212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.643214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:27.643222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.643234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:27.643250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.643414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.643424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.643439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.643554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 36 sessionId: src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0
2025-10-02T09:29:27.643895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bd607-a7297a45-62ce2d69-b85ea7db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:27.646737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Write session: try to update token
2025-10-02T09:29:27.646757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:27.660834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:27.660853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:27.660862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.660909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:27.660921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:27.661090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:27.661240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:27.661386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:27.661534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:27.661721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:27.661758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:27.663751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:27.663764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:27.663766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:27.663768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:27.663775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.663779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.663783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554152953238392:4453]
2025-10-02T09:29:27.663812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:27.663818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.663818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:27.663820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:27.663822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:27.663828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:27.663944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:27.668329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:27.671034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:27.708381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554153028759525:4901]
2025-10-02T09:29:27.708719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7556554153028759525:4901]
2025-10-02T09:29:27.805909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:27.806198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.806215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.806232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759525:4901], now have 1 active actors on pipe
2025-10-02T09:29:27.806434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:27.806475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:27.806479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:27.806489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:27.806520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554153028759525:4901]
2025-10-02T09:29:27.806545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0
2025-10-02T09:29:27.806703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0 is DEAD
2025-10-02T09:29:27.806843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:27.806851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Write session will restart in 0.006978s
2025-10-02T09:29:27.806874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Write session: Do CDS request
2025-10-02T09:29:27.806880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:27.815307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.815362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:27.815374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-10-02T09:29:27.815543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:27.815586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:27.815590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:27.815594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:27.816096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-10-02T09:29:27.816128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:27.816130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:27.816132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:27.816136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554153028759584:5044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:27.816564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554153028759584:5044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:27.818769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554153028759584:5044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:27.822053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554153028759584:5044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:27.822070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554153028759584:5044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:27.822073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554153028759584:5044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:27.822081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:27.824681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:27.827763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:27.827963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:27.827973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:27.827982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:27.828029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:27.828064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554152953238652:4455]
2025-10-02T09:29:27.828481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:27.828767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:27.828797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:27.829018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:27.829056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.829060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.829061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.829061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.829062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.829062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.829063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.829064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.829064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.829065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.829066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.829066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.829069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.829076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.829078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.829080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.829083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.829085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.829087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.829089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.829091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.829094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.829096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.829098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.829102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.829107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:27.829111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.829114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:27.829116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.829119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:27.829123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.829126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:27.829129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.829131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:27.829134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.829137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:27.829139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.829142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:27.829144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.829147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:27.829150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.829153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:27.829155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.829158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.829160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.829163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.829165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.829168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.829186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:27.837819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:27.839478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:27.839501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:27.839504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:27.839508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:27.839514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [2:7556554152953238652:4455]
2025-10-02T09:29:27.839527Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:27.839544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:27.839552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.839555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.839558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.839572Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:27.839584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:27.839595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:27.839658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.839668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.839670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.839673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:27.839675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:27.839736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:27.839744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.839757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:27.839769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:27.839789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:27.839812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759537:2446], now have 1 active actors on pipe
2025-10-02T09:29:27.839819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759746:5044], now have 1 active actors on pipe
2025-10-02T09:29:27.839825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.839828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.839829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.839898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 426
2025-10-02T09:29:27.839841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:27.839902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 426
2025-10-02T09:29:27.839853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:27.839856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:27.839858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:27.839858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:27.839873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:27.839875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:27.839906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.839915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:27.839951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:27.840005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.840014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.840036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:27.840047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:27.840050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:27.840052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:27.840061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:27.840073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:27.840086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.840972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.840988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.841007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:27.841089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0
2025-10-02T09:29:27.841413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dedbd8-d53ba5e6-de8e8c7d-c9ca0b37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:27.844127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Write session: try to update token
2025-10-02T09:29:27.844144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:27.851261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:27.851287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:27.851290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:27.851292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:27.851301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.851307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.851310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554152953238647:4455]
2025-10-02T09:29:27.851356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:27.851359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:27.851362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:27.851365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:27.851366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:27.851370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:27.851533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:27.865999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:27.868406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:27.906869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554153028759798:4901]
2025-10-02T09:29:27.907166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7556554153028759798:4901]
2025-10-02T09:29:27.993523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:27.993973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:27.993985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:27.994000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759798:4901], now have 1 active actors on pipe
2025-10-02T09:29:27.994129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:27.994128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:27.994138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:27.994140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:27.994168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554153028759798:4901]
2025-10-02T09:29:27.994184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0
2025-10-02T09:29:27.994335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0 is DEAD
2025-10-02T09:29:27.994472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:27.994483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Write session will restart in 0.007569s
2025-10-02T09:29:27.994505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Write session: Do CDS request
2025-10-02T09:29:27.994512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:28.003341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.003358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:28.003371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-10-02T09:29:28.003832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.003860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:28.003865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:28.003869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:28.004288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-10-02T09:29:28.004320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:28.004321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:28.004323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:28.004328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554157323727206:5055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:28.004825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554157323727206:5055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:28.007240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554157323727206:5055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:28.009321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554157323727206:5055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:28.009334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554157323727206:5055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:28.009337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554157323727206:5055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:28.009344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:28.009256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:28.011998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:28.012172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:28.012191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:28.012201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:28.012244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:28.012278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554157248206238:4470]
2025-10-02T09:29:28.012750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:28.013063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:28.013099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:28.013339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:28.013397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.013402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.013403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.013403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.013404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.013405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.013405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.013406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.013406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.013407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.013408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.013408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.013412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.013419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.013421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.013423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.013425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.013428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.013429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.013431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.013433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.013435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.013437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.013439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.013443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.013448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.013451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.013454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.013456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.013459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.013461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.013464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.013467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.013470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.013472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.013475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.013477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.013480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.013482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.013485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.013487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.013490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.013492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.013494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.013496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.013499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.013501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.013504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.013533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:28.022191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:28.023979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:28.024002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:28.024005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:28.024008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:28.024015Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [2:7556554157248206238:4470]
2025-10-02T09:29:28.024030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:28.024048Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:28.024051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.024053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.024055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.024071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:28.024076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:28.024083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:28.024156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.024165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.024167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.024169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:28.024172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:28.024408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 427
2025-10-02T09:29:28.024399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 427
2025-10-02T09:29:28.024564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:28.024576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.024591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.024604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.024623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:28.024649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554153028759824:2446], now have 1 active actors on pipe
2025-10-02T09:29:28.024657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727366:5055], now have 1 active actors on pipe
2025-10-02T09:29:28.024671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.024674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.024684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.024686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.024687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.024697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:28.024708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:28.024717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:28.024720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:28.024720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:28.024722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:28.024723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:28.024735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78112ead-89cfd980-dc77a009-52917e92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:28.024741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.024743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.024745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:28.024750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.024757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:28.024785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.024793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:28.024815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:28.024817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.024960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.024966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.024974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.025046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 36 sessionId: src_id|78112ead-89cfd980-dc77a009-52917e92_0
2025-10-02T09:29:28.025355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7022f0-3539cb39-2d568fa0-27cc6077_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78112ead-89cfd980-dc77a009-52917e92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:28.027908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Write session: try to update token
2025-10-02T09:29:28.027923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:28.042196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:28.042218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.042229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.042268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:28.042274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:28.042423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:28.042563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:28.042695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:28.042836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:28.043034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:28.043078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:28.045466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|78112ead-89cfd980-dc77a009-52917e92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:28.045322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:28.045339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.045342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:28.045344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:28.045352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.045356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.045360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554157248206232:4470]
2025-10-02T09:29:28.045391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:28.045398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.045401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:28.045413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:28.045422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:28.045426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:28.045547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:28.048019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:28.094295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554157323727379:4901]
2025-10-02T09:29:28.094582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7556554157323727379:4901]
2025-10-02T09:29:28.191012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:28.191423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.191431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.191451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727379:4901], now have 1 active actors on pipe
2025-10-02T09:29:28.191676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:28.196788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:28.196855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:28.196926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78112ead-89cfd980-dc77a009-52917e92_0
2025-10-02T09:29:28.197258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:28.197270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Write session will restart in 0.009553s
2025-10-02T09:29:28.197296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Write session: Do CDS request
2025-10-02T09:29:28.197302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:28.197101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|78112ead-89cfd980-dc77a009-52917e92_0 is DEAD
2025-10-02T09:29:28.197236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554157323727379:4901]
2025-10-02T09:29:28.208588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.212897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:28.212917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-10-02T09:29:28.213156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.213198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:28.213210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:28.213220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:28.213732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-10-02T09:29:28.213779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:28.213787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:28.213789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:28.213795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554157323727481:5060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:28.214435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554157323727481:5060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:28.218681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554157323727481:5060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:28.221834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554157323727481:5060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:28.221846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554157323727481:5060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:28.221848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554157323727481:5060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:28.221853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:28.223507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:28.226411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:28.226608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:28.226617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:28.226626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:28.226671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:28.226713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554157248206496:4473]
2025-10-02T09:29:28.227316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:28.227627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:28.227671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:28.227966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:28.228017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.228021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.228023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.228024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.228024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.228025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.228025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.228026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.228027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.228027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.228031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.228038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.228040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.228042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.228044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.228047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.228049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.228051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.228054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.228058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.228061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.228064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.228071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.228077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.228083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.228088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.228091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.228094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.228096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.228099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.228101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.228104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.228106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.228109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.228122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.228125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.228128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.228130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.228133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.228136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.228139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.228141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.228144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.228147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.228149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.228152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.228179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:28.237835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:28.239694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:28.239699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:28.239702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:28.239706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:28.239713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [2:7556554157248206496:4473]
2025-10-02T09:29:28.239726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:28.239743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:28.239746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.239749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.239751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.239766Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:28.239771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:28.239781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:28.239836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.239838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.239839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.239843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:28.239845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:28.239910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:28.239912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.239926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.239937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.239954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:28.239970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.239973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.239976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.239983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:28.239995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:28.240008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:28.240010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:28.240043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.240045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:28.240272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:28.240281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:28.240282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:28.240287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:28.240535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727630:5060], now have 1 active actors on pipe
2025-10-02T09:29:28.240543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727384:2446], now have 1 active actors on pipe
2025-10-02T09:29:28.240981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 428
2025-10-02T09:29:28.241013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 428
2025-10-02T09:29:28.242091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.242107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.242144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69203999-39ac5680-23faac8c-fec3d5d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:28.242159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.242164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.242166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:28.242177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.242194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:28.242215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.244852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.244869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.244907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.245052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 36 sessionId: src_id|69203999-39ac5680-23faac8c-fec3d5d7_0
2025-10-02T09:29:28.245438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78112ead-89cfd980-dc77a009-52917e92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69203999-39ac5680-23faac8c-fec3d5d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:28.248501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Write session: try to update token
2025-10-02T09:29:28.248522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:28.254691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:28.254713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.254715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:28.254717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:28.254724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.254728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.254732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554157248206490:4473]
2025-10-02T09:29:28.254768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:28.254774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.254776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:28.254861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:28.254867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:28.254875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:28.254906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:28.273941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|69203999-39ac5680-23faac8c-fec3d5d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:28.276303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:28.297518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554157323727645:4901]
2025-10-02T09:29:28.297785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7556554157323727645:4901]
2025-10-02T09:29:28.396677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:28.397198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.397213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.397228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727645:4901], now have 1 active actors on pipe
2025-10-02T09:29:28.397414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:28.397402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:28.397418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:28.397431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554157323727645:4901]
2025-10-02T09:29:28.397459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:28.397486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: error at write: Disconnected sessionId: src_id|69203999-39ac5680-23faac8c-fec3d5d7_0
2025-10-02T09:29:28.397640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|69203999-39ac5680-23faac8c-fec3d5d7_0 is DEAD
2025-10-02T09:29:28.397746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:28.397752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Write session will restart in 0.009293s
2025-10-02T09:29:28.397775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Write session: Do CDS request
2025-10-02T09:29:28.397780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:28.408320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.408399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:28.408418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-10-02T09:29:28.408562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.408592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:28.408597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:28.408601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:28.409203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-10-02T09:29:28.409238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:28.409244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:28.409246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:28.409251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554157323727772:5064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:28.409766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554157323727772:5064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:28.411906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554157323727772:5064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:28.413667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:28.415937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:28.416127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:28.416138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:28.416160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:28.416225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:28.416275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554157248206751:4475]
2025-10-02T09:29:28.416260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554157323727772:5064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:28.416273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554157323727772:5064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:28.416276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554157323727772:5064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:28.416283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:28.416854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:28.417155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:28.417205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:28.417512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:28.417582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.417589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.417590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.417591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.417592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.417593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.417594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.417595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.417596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.417597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.417598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.417600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.417604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.417614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.417617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.417621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.417624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.417628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.417631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.417634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.417638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.417642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.417646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.417649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.417656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.417664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.417668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.417674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.417678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.417683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.417687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.417692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.417696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.417701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.417705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.417710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.417720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.417724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.417728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.417732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.417735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.417745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.417749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.417757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.417761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.417765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.417768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.417773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.417807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:28.426034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:28.427691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:28.427712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:28.427714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:28.427717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:28.427723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [2:7556554157248206751:4475]
2025-10-02T09:29:28.427735Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:28.427751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:28.427754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.427756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.427758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.427773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:28.427779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:28.427785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:28.427837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.427848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.427850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.427853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:28.427855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:28.427913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:28.427920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.427933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.427949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.427967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:28.427994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727900:5064], now have 1 active actors on pipe
2025-10-02T09:29:28.427998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727648:2446], now have 1 active actors on pipe
2025-10-02T09:29:28.428007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.428009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.428011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.428024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:28.428036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:28.428045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:28.428048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:28.428050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:28.428058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:28.428065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:28.428047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 429
2025-10-02T09:29:28.428047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 429
2025-10-02T09:29:28.428092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.428102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:28.428106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:28.428120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.428128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.428168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:28.428179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.428182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.428188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:28.428196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.428209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:28.428228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.428412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.428421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.428434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.428535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0
2025-10-02T09:29:28.428853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69203999-39ac5680-23faac8c-fec3d5d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:28.431261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Write session: try to update token
2025-10-02T09:29:28.431277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:28.438674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:28.438696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.438698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:28.438700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:28.438707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.438711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.438715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554157248206746:4475]
2025-10-02T09:29:28.438751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:28.438752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:28.438756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:28.438758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:28.438761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.438763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:28.438894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:28.443928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:28.446741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:28.497747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554157323727923:4901]
2025-10-02T09:29:28.498068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7556554157323727923:4901]
2025-10-02T09:29:28.580995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:28.581298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.581311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.581329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727923:4901], now have 1 active actors on pipe
2025-10-02T09:29:28.581590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:28.581591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:28.581613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:28.581637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554157323727923:4901]
2025-10-02T09:29:28.581682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: error at write: Disconnected sessionId: src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0
2025-10-02T09:29:28.581733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:28.581886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0 is DEAD
2025-10-02T09:29:28.582032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:28.582043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Write session will restart in 0.007443s
2025-10-02T09:29:28.582064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Write session: Do CDS request
2025-10-02T09:29:28.582072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:28.590284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.590372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:28.590394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-10-02T09:29:28.590542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.590592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:28.590604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:28.590612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:28.591105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-10-02T09:29:28.591144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:28.591151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:28.591152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:28.591157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554157323727999:5069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:28.591683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554157323727999:5069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:28.594172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554157323727999:5069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:28.596436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554157323727999:5069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:28.596445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554157323727999:5069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:28.596447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554157323727999:5069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:28.596451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:28.596816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:28.598950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:28.599128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:28.599138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:28.599147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:28.599189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:28.599225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554157248207021:4478]
2025-10-02T09:29:28.599762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:28.599999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:28.600034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:28.600317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:28.600359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.600364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.600365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.600366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.600367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.600368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.600369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.600370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.600371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.600372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.600373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.600374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.600378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.600388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.600391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.600395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.600399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.600402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.600406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.600409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.600412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.600417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.600421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.600424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.600429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.600435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.600446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.600455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.600458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.600463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.600467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.600471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.600475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.600486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.600490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.600498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.600506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.600511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.600520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.600524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.600527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.600533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.600536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.600540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.600543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.600547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.600550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.600554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.600581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:28.609284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:28.610798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:28.610813Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:28.610816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:28.610820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:28.610826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [2:7556554157248207021:4478]
2025-10-02T09:29:28.610838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:28.610854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:28.610856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.610859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.610861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.610876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:28.610881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:28.610887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:28.610936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.610943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.610946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.610949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:28.610951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:28.610994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:28.611000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.611012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.611024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.611043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:28.611065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728177:5069], now have 1 active actors on pipe
2025-10-02T09:29:28.611072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323727926:2446], now have 1 active actors on pipe
2025-10-02T09:29:28.611077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.611087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.611089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.611104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:28.611112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:28.611116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:28.611118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:28.611120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:28.611133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:28.611139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:28.611141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 430
2025-10-02T09:29:28.611166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.611146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 430
2025-10-02T09:29:28.611174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:28.611177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:28.611188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.611192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.611230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:28.611240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.611244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.611248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:28.611255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.611267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:28.611287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.611502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.611518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.611538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.611656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 36 sessionId: src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0
2025-10-02T09:29:28.612019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffaf2a6-14c1dd85-432753ca-dba0e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:28.614402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Write session: try to update token
2025-10-02T09:29:28.614414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:28.621772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:28.621789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.621791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:28.621793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:28.621800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.621803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.621807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554157248207016:4478]
2025-10-02T09:29:28.621839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:28.621843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:28.621844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.621846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:28.621850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:28.621854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:28.621980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:28.627532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:28.629877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:28.682044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554157323728190:4901]
2025-10-02T09:29:28.682333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7556554157323728190:4901]
2025-10-02T09:29:28.773892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:28.774718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.774733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.774770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728190:4901], now have 1 active actors on pipe
2025-10-02T09:29:28.775148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:28.775461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:28.775508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:28.775573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0
2025-10-02T09:29:28.775752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0 is DEAD
2025-10-02T09:29:28.775883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554157323728190:4901]
2025-10-02T09:29:28.776331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:28.776343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Write session will restart in 0.008763s
2025-10-02T09:29:28.776368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Write session: Do CDS request
2025-10-02T09:29:28.776374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:28.786313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.786413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:28.786430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-10-02T09:29:28.786584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.786633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:28.786642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:28.786647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:28.787283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-10-02T09:29:28.787322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:28.787324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:28.787325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:28.787330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554157323728257:5074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:28.787840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554157323728257:5074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:28.791056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554157323728257:5074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:28.794565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554157323728257:5074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:28.794582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554157323728257:5074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:28.794588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554157323728257:5074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:28.794597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:28.796865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:28.800820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:28.801041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:28.801045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:28.801054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:28.801103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:28.801137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554157248207280:4480]
2025-10-02T09:29:28.801781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:28.802157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:28.802211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:28.802507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:28.802575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.802584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.802585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.802586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.802587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.802588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.802588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.802590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.802591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.802592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.802593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.802595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.802600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.802611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.802614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.802618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.802622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.802625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.802629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.802632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.802635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.802639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.802642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.802645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.802652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.802659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.802665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.802669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.802673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.802678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.802684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.802689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.802693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.802697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.802701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.802706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.802710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.802715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.802719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.802723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.802729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.802733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.802737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.802741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.802745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.802749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.802753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.802758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.802793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:28.815058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:28.818353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:28.818372Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:28.818374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:28.818378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:28.818386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [2:7556554157248207280:4480]
2025-10-02T09:29:28.818400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:28.818419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:28.818421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.818423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.818424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.818435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:28.818440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:28.818446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:28.818566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.818576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.818581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.818585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:28.818590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:28.818696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:28.818709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.818724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.818735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.818752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:28.818768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.818777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.818781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.818795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:28.818807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:28.818819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:28.818823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:28.818826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:28.818830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:28.818836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:28.818861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.818868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:28.818913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:28.819016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728198:2446], now have 1 active actors on pipe
2025-10-02T09:29:28.819022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728448:5074], now have 1 active actors on pipe
2025-10-02T09:29:28.819249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 431
2025-10-02T09:29:28.819293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 431
2025-10-02T09:29:28.819500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.819516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.819542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b5419e-796f428b-729b43a9-c58b4831_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:28.819552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:28.819556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:28.819558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:28.819567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:28.819578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:28.819602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.819917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.819934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.819953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:28.820091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1b5419e-796f428b-729b43a9-c58b4831_0
2025-10-02T09:29:28.821217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89c8b66-ad62b153-1b729def-f52e98a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1b5419e-796f428b-729b43a9-c58b4831_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:28.827415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Write session: try to update token
2025-10-02T09:29:28.827432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:28.829808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:28.829824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.829832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.829875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:28.829887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:28.830051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:28.830196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:28.830348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:28.830492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:28.830688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:28.830726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:28.839976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:28.839997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:28.840005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:28.840007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:28.840017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.840024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.840029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554157248207275:4480]
2025-10-02T09:29:28.840065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:28.840071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.840074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:28.840083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:28.840096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:28.840105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:28.840214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:28.848205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|a1b5419e-796f428b-729b43a9-c58b4831_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:28.850796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:28.876081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554157323728467:4901]
2025-10-02T09:29:28.876351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7556554157323728467:4901]
2025-10-02T09:29:28.974991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:28.975477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:28.975496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:28.975512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728467:4901], now have 1 active actors on pipe
2025-10-02T09:29:28.975700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:28.975777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:28.975805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554157323728467:4901]
2025-10-02T09:29:28.975818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:28.975892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1b5419e-796f428b-729b43a9-c58b4831_0
2025-10-02T09:29:28.976059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|a1b5419e-796f428b-729b43a9-c58b4831_0 is DEAD
2025-10-02T09:29:28.976267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:28.976286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Write session will restart in 0.007087s
2025-10-02T09:29:28.976311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Write session: Do CDS request
2025-10-02T09:29:28.976317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:28.984288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.984381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:28.984399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-10-02T09:29:28.984521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:28.984551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:28.984560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:28.984564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:28.985063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-10-02T09:29:28.985106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:28.985107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:28.985109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:28.985114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554157323728516:5078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:28.985613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554157323728516:5078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:28.987999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554157323728516:5078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:28.990553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554157323728516:5078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:28.990566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554157323728516:5078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:28.990568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554157323728516:5078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:28.990579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:28.992636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:28.995154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:28.995312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:28.995320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:28.995328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:28.995366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:28.995404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554157248207571:4489]
2025-10-02T09:29:28.995777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:28.996021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:28.996047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:28.996235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:28.996264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.996268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.996269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.996269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.996270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.996270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.996271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.996272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.996272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.996273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.996273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.996274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.996277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.996283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.996285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.996287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.996289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.996291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.996293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.996295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.996297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.996299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.996301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.996303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.996307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.996311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:28.996314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.996317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:28.996319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.996322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:28.996324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.996327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:28.996329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.996332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:28.996333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.996336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:28.996338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.996341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:28.996343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.996346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:28.996348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.996351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:28.996353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.996356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:28.996360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.996363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:28.996365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.996368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:28.996392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:29.004616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:29.006299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:29.006312Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:29.006313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:29.006316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:29.006320Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [2:7556554157248207571:4489]
2025-10-02T09:29:29.006328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:29.006339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:29.006341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.006343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.006344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.006354Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:29.006356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:29.006360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:29.006396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.006402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.006403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.006406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:29.006407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:29.006457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:29.006464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.006476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.006483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.006494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:29.006512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728471:2446], now have 1 active actors on pipe
2025-10-02T09:29:29.006519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.006520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.006521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.006529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:29.006534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554157323728701:5078], now have 1 active actors on pipe
2025-10-02T09:29:29.006542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:29.006544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:29.006547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:29.006549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:29.006550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:29.006552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:29.006572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.006579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:29.006585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:29.006640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 432
2025-10-02T09:29:29.006680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 432
2025-10-02T09:29:29.006705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.006713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.006733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:29.006742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.006745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.006747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:29.006754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.006765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:29.006776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.006953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.006959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.006970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.007041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0
2025-10-02T09:29:29.007347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b5419e-796f428b-729b43a9-c58b4831_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:29.009860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Write session: try to update token
2025-10-02T09:29:29.009874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:29.016371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:29.016388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.016396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.016432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:29.016441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:29.016625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:29.016756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.016909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.017038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.017216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:29.017244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:29.025572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:29.027840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:29.028307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.028332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.028348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:29.028351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.028353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:29.028355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:29.028361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.028364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.028366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554157248207565:4489]
2025-10-02T09:29:29.028399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:29.028401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:29.028406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:29.028407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.028409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:29.028410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:29.028546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:29.075764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554161618696052:4901]
2025-10-02T09:29:29.076032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7556554161618696052:4901]
2025-10-02T09:29:29.158439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:29.159004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:29.159033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696052:4901], now have 1 active actors on pipe
2025-10-02T09:29:29.159162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:29.159190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:29.159234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554161618696052:4901]
2025-10-02T09:29:29.159249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:29.159252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:29.159313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: error at write: Disconnected sessionId: src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0
2025-10-02T09:29:29.159474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0 is DEAD
2025-10-02T09:29:29.159579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:29.159587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Write session will restart in 0.006039s
2025-10-02T09:29:29.159605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Write session: Do CDS request
2025-10-02T09:29:29.159613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:29.166391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.166527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:29.166539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-10-02T09:29:29.166645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.166687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:29.166698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:29.166702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:29.167150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-10-02T09:29:29.167183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:29.167188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:29.167190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:29.167194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554161618696082:5090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:29.167644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554161618696082:5090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:29.170638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554161618696082:5090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:29.173428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554161618696082:5090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:29.173439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554161618696082:5090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:29.173441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554161618696082:5090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:29.173446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:29.176674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:29.179372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:29.179616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:29.179627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:29.179635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:29.179685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:29.179733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554161543175136:4498]
2025-10-02T09:29:29.180253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:29.180490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:29.180522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:29.180780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:29.180852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.180858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.180858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.180859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.180860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.180861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.180862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.180863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.180864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.180864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.180865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.180866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.180870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.180880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.180884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.180887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.180890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.180893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.180897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.180900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.180903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.180906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.180909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.180913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.180919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.180925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.180930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.180935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.180938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.180942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.180945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.180950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.180954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.180958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.180962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.180966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.180970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.180974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.180978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.180982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.180985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.180989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.180993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.180997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.181001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.181005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.181008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.181012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.181052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:29.189621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:29.191578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:29.191602Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:29.191604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:29.191608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:29.191614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [2:7556554161543175136:4498]
2025-10-02T09:29:29.191630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:29.191650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:29.191653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.191656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.191658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.191672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:29.191677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:29.191683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:29.191740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.191750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.191753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.191756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:29.191758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:29.191821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:29.191829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.191843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.191858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.191878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:29.191901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696257:5090], now have 1 active actors on pipe
2025-10-02T09:29:29.191909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696056:2446], now have 1 active actors on pipe
2025-10-02T09:29:29.191915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.191919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.191921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.191936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:29.191949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:29.191953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:29.191959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:29.191961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:29.191966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:29.191969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:29.192001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.192015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:29.192022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:29.192029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 433
2025-10-02T09:29:29.192065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.192079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.192100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:29.192107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.192111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.192113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:29.192121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.192131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:29.192152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.192237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 433
2025-10-02T09:29:29.192288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.192296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.192314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.192410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 36 sessionId: src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0
2025-10-02T09:29:29.192746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ad2d3d-93cbdbe0-b813a02d-93987d2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:29.195413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Write session: try to update token
2025-10-02T09:29:29.195430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:29.202701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:29.202724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.202733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.202777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:29.202951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:29.203108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.203240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:29.203248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.203422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.203619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:29.203662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:29.209144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:29.211615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:29.212485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.212516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.212533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:29.212536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.212538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:29.212541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:29.212548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.212551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.212554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554161543175131:4498]
2025-10-02T09:29:29.212602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:29.212614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.212616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:29.212618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:29.212624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:29.212628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:29.212740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:29.259570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554161618696324:4901]
2025-10-02T09:29:29.259868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7556554161618696324:4901]
2025-10-02T09:29:29.355013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:29.355552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:29.355586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696324:4901], now have 1 active actors on pipe
2025-10-02T09:29:29.355705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:29.355820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:29.355867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554161618696324:4901]
2025-10-02T09:29:29.366772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:29.366786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:29.366806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: error at write: Disconnected sessionId: src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0
2025-10-02T09:29:29.366935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0 is DEAD
2025-10-02T09:29:29.367087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:29.367099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Write session will restart in 0.005768s
2025-10-02T09:29:29.367122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Write session: Do CDS request
2025-10-02T09:29:29.367132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:29.374606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.374756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:29.374772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-10-02T09:29:29.374881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.374913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:29.374922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:29.374938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:29.375375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-10-02T09:29:29.375408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:29.375409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:29.375411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:29.375416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554161618696433:5094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:29.375908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554161618696433:5094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:29.379518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554161618696433:5094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:29.381509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:29.384394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:29.384573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:29.384582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:29.384590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:29.384632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:29.384751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554161543175396:4500]
2025-10-02T09:29:29.384845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554161618696433:5094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:29.384859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554161618696433:5094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:29.384863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554161618696433:5094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:29.384870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:29.385384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:29.385758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:29.385823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:29.386176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:29.386256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.386264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.386265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.386266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.386267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.386268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.386269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.386271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.386272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.386273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.386274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.386275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.386281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.386292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.386296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.386300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.386303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.386322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.386326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.386330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.386333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.386337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.386340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.386343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.386350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.386359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.386371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.386377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.386381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.386385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.386389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.386394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.386399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.386405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.386410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.386414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.386418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.386424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.386428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.386435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.386439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.386450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.386454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.386465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.386469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.386474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.386478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.386483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.386515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:29.395153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:29.397063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:29.397081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:29.397084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:29.397089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:29.397094Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [2:7556554161543175396:4500]
2025-10-02T09:29:29.397108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:29.397126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:29.397129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.397131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.397133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.397149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:29.397154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:29.397161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:29.397227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.397235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.397237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.397240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:29.397243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:29.397310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:29.397324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.397337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.397347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.397361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:29.397380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696584:5094], now have 1 active actors on pipe
2025-10-02T09:29:29.397388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696326:2446], now have 1 active actors on pipe
2025-10-02T09:29:29.397394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.397397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.397399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.397410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:29.397421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:29.397427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:29.397431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:29.397433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:29.397440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:29.397442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:29.397421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 434
2025-10-02T09:29:29.397447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 434
2025-10-02T09:29:29.397474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.397486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:29.397491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:29.397504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.397512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.397563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2292356a-efc30d4-480304a4-e1c35b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:29.397574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.397582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.397584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:29.397592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.397605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:29.397625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.397794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.397819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.397840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.397918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 36 sessionId: src_id|2292356a-efc30d4-480304a4-e1c35b32_0
2025-10-02T09:29:29.398278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95d236d-218cacb5-2b336398-9e5bc9cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2292356a-efc30d4-480304a4-e1c35b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:29.400869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Write session: try to update token
2025-10-02T09:29:29.400885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:29.414814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:29.414832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.414834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:29.414836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:29.414845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.414848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.414852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554161543175391:4500]
2025-10-02T09:29:29.414886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:29.414893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.414893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:29.414896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:29.414899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:29.414902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:29.415021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:29.414873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|2292356a-efc30d4-480304a4-e1c35b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:29.417511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:29.456258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554161618696607:4901]
2025-10-02T09:29:29.456580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7556554161618696607:4901]
2025-10-02T09:29:29.553844Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:29.554304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.554321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.554363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696607:4901], now have 1 active actors on pipe
2025-10-02T09:29:29.554690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:29.554712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:29.554777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|2292356a-efc30d4-480304a4-e1c35b32_0
2025-10-02T09:29:29.554609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:29.554994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|2292356a-efc30d4-480304a4-e1c35b32_0 is DEAD
2025-10-02T09:29:29.555142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:29.555152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Write session will restart in 0.009855s
2025-10-02T09:29:29.555175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Write session: Do CDS request
2025-10-02T09:29:29.555182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:29.555208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:29.555269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554161618696607:4901]
2025-10-02T09:29:29.566333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.566750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:29.566765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-10-02T09:29:29.566906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.566933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:29.566937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:29.566941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:29.567344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-10-02T09:29:29.567376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:29.567379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:29.567380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:29.567386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554161618696633:5099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:29.567871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554161618696633:5099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:29.574116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554161618696633:5099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:29.579852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554161618696633:5099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:29.579871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554161618696633:5099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:29.579875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554161618696633:5099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:29.579883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:29.585931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:29.592023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:29.592235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:29.592245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:29.592255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:29.592309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:29.592347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554161543175672:4503]
2025-10-02T09:29:29.592997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:29.598138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:29.598220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:29.598605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:29.598665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.598672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.598673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.598674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.598675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.598677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.598678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.598679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.598680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.598681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.598683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.598683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.598690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.598702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.598705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.598709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.598712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.598715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.598718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.598722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.598725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.598728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.598732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.598735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.598743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.598749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.598754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.598758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.598762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.598766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.598769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.598774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.598780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.598784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.598788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.598792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.598796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.598800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.598804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.598808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.598811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.598815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.598819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.598823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.598829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.598834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.598837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.598842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.598870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:29.609744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:29.611959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:29.611979Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:29.611982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:29.611985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:29.611991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [2:7556554161543175672:4503]
2025-10-02T09:29:29.612006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:29.612023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:29.612026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.612028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.612030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.612044Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:29.612049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:29.612057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:29.612120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.612130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.612132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.612135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:29.612138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:29.612212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:29.612219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.612233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.612243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.612266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:29.612286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.612294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.612296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.612303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:29.612313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:29.612316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696610:2446], now have 1 active actors on pipe
2025-10-02T09:29:29.612316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:29.612318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:29.612323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:29.612337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:29.612343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:29.612348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696811:5099], now have 1 active actors on pipe
2025-10-02T09:29:29.612379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.612393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:29.612427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:29.612430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 435
2025-10-02T09:29:29.612433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 435
2025-10-02T09:29:29.612580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.612602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.612625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:29.612641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.612644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.612646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:29.612656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.612666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:29.612682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.612893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.612902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.612917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.612990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 36 sessionId: src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0
2025-10-02T09:29:29.613342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2292356a-efc30d4-480304a4-e1c35b32_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:29.615929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Write session: try to update token
2025-10-02T09:29:29.615945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:29.632337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:29.632364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.632374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.632420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:29.632449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:29.632480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:29.632633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:29.632790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.632987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.633137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:29.633411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:29.633448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:29.635505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.635523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.635560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:29.635242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:29.635666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:29.638531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:29.638552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.638554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:29.638556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:29.638565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.638569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.638573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554161543175667:4503]
2025-10-02T09:29:29.638612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:29.638619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.638621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:29.638624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:29.638630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:29.638635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:29.638757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:29.660309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554161618696878:4901]
2025-10-02T09:29:29.661081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7556554161618696878:4901]
2025-10-02T09:29:29.785241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:29.792695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.792722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.792895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.792960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.793032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.793093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.793137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.793144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.793216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.793275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.793338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.793402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.793444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.793451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.793516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.793578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.793642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.793708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.793750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.793756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.793820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.793886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.793953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.794019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.794119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.794125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.794190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.794248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.794305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.794367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.794408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.794415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.794482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.794538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.794618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.794713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.794767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.794773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.794837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.794898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.794965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.795047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.795100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.795107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.795166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.795238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.795300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.795359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.795399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.795407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.795465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.795521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.795581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.795640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.795686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.795693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.795752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:29.795810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:29.795870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:29.795922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:29.795961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:29.795968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:29.796023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696878:4901], now have 1 active actors on pipe
2025-10-02T09:29:29.796246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:29.796269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:29.796273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:29.796301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: error at write: Disconnected sessionId: src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0
2025-10-02T09:29:29.796310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554161618696878:4901]
2025-10-02T09:29:29.796490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0 is DEAD
2025-10-02T09:29:29.796600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:29.796610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Write session will restart in 0.007231s
2025-10-02T09:29:29.796632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Write session: Do CDS request
2025-10-02T09:29:29.796638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:29.796983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:29.805395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.805599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:29.805613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-10-02T09:29:29.805757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:29.805795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:29.805804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:29.805808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:29.806241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-10-02T09:29:29.806276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:29.806284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:29.806286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:29.806291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554161618696943:5104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:29.806771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554161618696943:5104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:29.809992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554161618696943:5104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:29.814341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554161618696943:5104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:29.814358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554161618696943:5104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:29.814362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554161618696943:5104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:29.814376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:29.817099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:29.820240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:29.820439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:29.820448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:29.820457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:29.820499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:29.820537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554161543175939:4505]
2025-10-02T09:29:29.821144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:29.821467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:29.821507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:29.821802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:29.821848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.821853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.821854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.821855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.821856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.821857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.821858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.821859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.821861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.821862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.821863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.821864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.821869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.821880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.821883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.821887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.821890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.821894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.821898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.821901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.821904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.821908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.821911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.821915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.821920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.821927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:29.821932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.821937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:29.821941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.821945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:29.821948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.821953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:29.821956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.821960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:29.821970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.821974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:29.821978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.821983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:29.821987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.821996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:29.822000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.822008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:29.822014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.822018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.822022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.822026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.822029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.822034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.822066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:29.831323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:29.833501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:29.833522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:29.833525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:29.833528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:29.833535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [2:7556554161543175939:4505]
2025-10-02T09:29:29.833551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:29.833567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:29.833570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.833573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.833575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.833589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:29.833595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:29.833607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:29.833667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.833676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.833679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.833682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:29.833685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:29.833749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:29.833757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.833773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:29.833786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:29.833809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:29.833833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618697128:5104], now have 1 active actors on pipe
2025-10-02T09:29:29.833842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618696893:2446], now have 1 active actors on pipe
2025-10-02T09:29:29.833849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.833852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.833854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.833869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 436
2025-10-02T09:29:29.833887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 436
2025-10-02T09:29:29.833866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:29.833883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:29.833886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:29.833889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:29.833891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:29.833898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:29.833901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:29.833931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.833938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:29.833951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:29.833953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.833957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.834000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:29.834010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:29.834014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:29.834020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:29.834028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:29.834036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:29.834056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.834286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:29.834294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:29.834306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:29.834397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0
2025-10-02T09:29:29.834751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facb0840-8dca8d66-c8e98470-ea7e7792_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:29.841721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Write session: try to update token
2025-10-02T09:29:29.841743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:29.845112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:29.845153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:29.845156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:29.845162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:29.845177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.845184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.845191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554161543175934:4505]
2025-10-02T09:29:29.845237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:29.845247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:29.845256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:29.845261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:29.845277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:29.845305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:29.845394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:29.858325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:29.860772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:29.896528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554161618697167:4901]
2025-10-02T09:29:29.897149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7556554161618697167:4901]
2025-10-02T09:29:29.999615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:30.000009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.000022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.000041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618697167:4901], now have 1 active actors on pipe
2025-10-02T09:29:30.000259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:30.000270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:30.000274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:30.000323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554161618697167:4901]
2025-10-02T09:29:30.000334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:30.000831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:30.000844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Write session will restart in 0.006310s
2025-10-02T09:29:30.000335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: error at write: Disconnected sessionId: src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0
2025-10-02T09:29:30.000515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0 is DEAD
2025-10-02T09:29:30.000870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Write session: Do CDS request
2025-10-02T09:29:30.000876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:30.008526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.008710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:30.008729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-10-02T09:29:30.008860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.008890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:30.008894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:30.008898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:30.009533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-10-02T09:29:30.009566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:30.009568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:30.009570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:30.009575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554165913664492:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:30.010064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554165913664492:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:30.013912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554165913664492:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:30.020795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554165913664492:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:30.020828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554165913664492:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:30.020831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554165913664492:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:30.020838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:30.022257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:30.025262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:30.025512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:30.025521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:30.025531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:30.025581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:30.025618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554165838143512:4514]
2025-10-02T09:29:30.026176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:30.026523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:30.026587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:30.026971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:30.027036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.027042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.027044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.027045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.027046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.027047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.027048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.027049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.027050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.027051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.027053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.027054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.027059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.027070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.027073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.027086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.027090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.027094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.027098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.027101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.027105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.027109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.027113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.027117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.027123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.027130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.027136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.027141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.027145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.027150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.027154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.027160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.027165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.027176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.027180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.027185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.027190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.027200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.027204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.027209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.027218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.027223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.027227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.027232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.027237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.027242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.027249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.027254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.027294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:30.036832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:30.039247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:30.039270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:30.039273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:30.039277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:30.039284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [2:7556554165838143512:4514]
2025-10-02T09:29:30.039299Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:30.039319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:30.039322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.039325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.039327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.039343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:30.039356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:30.039363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:30.039440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.039450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.039452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.039456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:30.039459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:30.039550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:30.039565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.039581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.039593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.039611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:30.039658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 437
2025-10-02T09:29:30.039702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 437
2025-10-02T09:29:30.039643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913664721:5108], now have 1 active actors on pipe
2025-10-02T09:29:30.039652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554161618697171:2446], now have 1 active actors on pipe
2025-10-02T09:29:30.039660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.039662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.039664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.039680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:30.039695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:30.039696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:30.039698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:30.039700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:30.039716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:30.039719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:30.039774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.039777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.039788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.039801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:30.039816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:30.039831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:30.039853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.039860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.039862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:30.039871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.039885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:30.039916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.040177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.040191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.040223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.040322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 36 sessionId: src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0
2025-10-02T09:29:30.040676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d39e36d-5369553b-78a63b43-cce60b2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:30.045782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Write session: try to update token
2025-10-02T09:29:30.045805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:30.050881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:30.050902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.050904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:30.050906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:30.050913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.050917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.050920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554165838143507:4514]
2025-10-02T09:29:30.050956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:30.050962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.050964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:30.050979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:30.050985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:30.050989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:30.051431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:30.062538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:30.065219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:30.100281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554165913664761:4901]
2025-10-02T09:29:30.100539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7556554165913664761:4901]
2025-10-02T09:29:30.194940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:30.195836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.195854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.195870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913664761:4901], now have 1 active actors on pipe
2025-10-02T09:29:30.196131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554165913664761:4901]
2025-10-02T09:29:30.196245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:30.196274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:30.196341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0
2025-10-02T09:29:30.196520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0 is DEAD
2025-10-02T09:29:30.196060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:30.196927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:30.196940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Write session will restart in 0.007593s
2025-10-02T09:29:30.196966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Write session: Do CDS request
2025-10-02T09:29:30.196972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:30.205419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.205489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:30.205506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-10-02T09:29:30.205639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.205667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:30.205676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:30.205679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:30.206333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-10-02T09:29:30.206364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:30.206365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:30.206366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:30.206381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554165913664810:5122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:30.206821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554165913664810:5122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:30.210220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554165913664810:5122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:30.213737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554165913664810:5122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:30.213751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554165913664810:5122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:30.213754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554165913664810:5122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:30.213767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:30.216565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:30.219862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:30.220109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:30.220120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:30.220132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:30.220189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:30.220233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554165838143809:4525]
2025-10-02T09:29:30.220848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:30.221181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:30.221238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:30.221559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:30.221604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.221605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.221606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.221607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.221608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.221609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.221610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.221611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.221612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.221613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.221614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.221615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.221620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.221630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.221633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.221637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.221640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.221643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.221647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.221650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.221653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.221656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.221660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.221663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.221670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.221677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.221682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.221687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.221691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.221695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.221699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.221705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.221709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.221714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.221718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.221722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.221726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.221730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.221733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.221737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.221741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.221745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.221749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.221753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.221757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.221762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.221765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.221769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.221802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:30.231515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:30.233242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:30.233261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:30.233264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:30.233268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:30.233274Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [2:7556554165838143809:4525]
2025-10-02T09:29:30.233289Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:30.233306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:30.233309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.233312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.233314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.233328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:30.233333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:30.233339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:30.233398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.233406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.233409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.233412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:30.233414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:30.233633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 438
2025-10-02T09:29:30.233642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 438
2025-10-02T09:29:30.233640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:30.233649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.233660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.233670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.233690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:30.233710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665004:5122], now have 1 active actors on pipe
2025-10-02T09:29:30.233714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913664771:2446], now have 1 active actors on pipe
2025-10-02T09:29:30.233729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.233741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.233758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.233769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.233771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.233785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:30.233797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:30.233802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:30.233805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:30.233807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:30.233815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:30.233817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:30.233831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:30.233840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.233844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.233846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:30.233853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.233861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:30.233898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.233910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:30.233924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.233927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:30.234101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.234112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.234123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.234206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 36 sessionId: src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0
2025-10-02T09:29:30.234536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f76d3a-8fae1cde-afcb3edd-fa0ce9fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:30.237200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Write session: try to update token
2025-10-02T09:29:30.237213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:30.246365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:30.246390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.246399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.246445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:30.246449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:30.246613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:30.246849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.246992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.247268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.247473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:30.247522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:30.255142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:30.257513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:30.257532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.257534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:30.257536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:30.257545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.257549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.257553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554165838143804:4525]
2025-10-02T09:29:30.257589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:30.257603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.257606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:30.257630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:30.257776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:30.257778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:30.257791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:30.257795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:30.296368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554165913665043:4901]
2025-10-02T09:29:30.296616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7556554165913665043:4901]
2025-10-02T09:29:30.405896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:30.406293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.406306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.406322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665043:4901], now have 1 active actors on pipe
2025-10-02T09:29:30.406514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:30.406564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:30.406575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:30.406594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554165913665043:4901]
2025-10-02T09:29:30.406617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:30.406622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: error at write: Disconnected sessionId: src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0
2025-10-02T09:29:30.406760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0 is DEAD
2025-10-02T09:29:30.406920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:30.406931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Write session will restart in 0.006084s
2025-10-02T09:29:30.406958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Write session: Do CDS request
2025-10-02T09:29:30.406963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:30.414289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.414366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:30.414380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-10-02T09:29:30.414479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.414500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:30.414507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:30.414510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:30.414909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-10-02T09:29:30.414937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:30.414941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:30.414942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:30.414945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554165913665084:5126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:30.415412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554165913665084:5126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:30.418116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554165913665084:5126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:30.420460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554165913665084:5126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:30.420474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554165913665084:5126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:30.420477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554165913665084:5126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:30.420483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:30.423604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:30.426520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:30.426689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:30.426699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:30.426708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:30.426750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:30.426783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554165838144087:4527]
2025-10-02T09:29:30.427375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:30.427624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:30.427663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:30.427957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:30.428002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.428007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.428009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.428010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.428011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.428012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.428013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.428014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.428015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.428016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.428017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.428019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.428023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.428033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.428037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.428041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.428045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.428049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.428053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.428062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.428066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.428074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.428082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.428086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.428096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.428107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.428112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.428121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.428130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.428139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.428147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.428156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.428165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.428172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.428180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.428185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.428193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.428202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.428210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.428214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.428223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.428231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.428239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.428244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.428252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.428258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.428266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.428271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.428311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:30.436960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:30.438977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:30.438991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:30.438993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:30.438995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:30.438999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [2:7556554165838144087:4527]
2025-10-02T09:29:30.439009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:30.439019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:30.439021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.439023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.439024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.439034Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:30.439040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:30.439044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:30.439093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.439098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.439099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.439101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:30.439103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:30.439147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:30.439153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.439160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.439166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.439175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:30.439190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.439191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.439192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.439200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:30.439207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:30.439209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:30.439210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:30.439211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:30.439222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:30.439228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:30.439236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665245:5126], now have 1 active actors on pipe
2025-10-02T09:29:30.439241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665046:2446], now have 1 active actors on pipe
2025-10-02T09:29:30.439264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.439275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:30.439278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:30.439304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 439
2025-10-02T09:29:30.439305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 439
2025-10-02T09:29:30.439346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.439353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.439368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:30.439373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.439375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.439376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:30.439382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.439388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:30.439400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.439498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.439503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.439512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.439563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 36 sessionId: src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0
2025-10-02T09:29:30.439906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38777aa0-2ca3843f-a3b10bd1-fab8e204_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:30.442394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Write session: try to update token
2025-10-02T09:29:30.442410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:30.449760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:30.449778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.449786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.449826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:30.449826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:30.449984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:30.450136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.450265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.450404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.450583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:30.450623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:30.455132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:30.457234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:30.457417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.457437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.457467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:30.457535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:30.459761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:30.459776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.459779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:30.459780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:30.459787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.459790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.459794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554165838144075:4527]
2025-10-02T09:29:30.459827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:30.459832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:30.459837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:30.459837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.459839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:30.459841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:30.460015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:30.506803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554165913665331:4901]
2025-10-02T09:29:30.507067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7556554165913665331:4901]
2025-10-02T09:29:30.596064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:30.603049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.603088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.603257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.603318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.603381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.603441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.603491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.603499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.603564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.603622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.603684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.603741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.603785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.603793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.603848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.603897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.603950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.604032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.604132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.604138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.604215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.604288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.604337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.604387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.604476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.604481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.604538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.604606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.604664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.604747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.604786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.604792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.604859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.604951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.605011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.605100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.605212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.605217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.605275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.605334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.605403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.605456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.605519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.605524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.605577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.605644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.605706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.605797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.605839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.605846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.605941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.606017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.606063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.606132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.606170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.606176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.606247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.606295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.606364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.606424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.606464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.606471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.606521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665331:4901], now have 1 active actors on pipe
2025-10-02T09:29:30.606792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:30.606806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554165913665331:4901]
2025-10-02T09:29:30.606826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:30.606828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:30.606849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: error at write: Disconnected sessionId: src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0
2025-10-02T09:29:30.606988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0 is DEAD
2025-10-02T09:29:30.607125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:30.607133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Write session will restart in 0.009101s
2025-10-02T09:29:30.607154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Write session: Do CDS request
2025-10-02T09:29:30.607159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:30.607318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:30.617309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.617394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:30.617407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-10-02T09:29:30.617513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.617544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:30.617553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:30.617557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:30.617974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-10-02T09:29:30.618009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:30.618028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:30.618034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:30.618038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554165913665420:5131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:30.618499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554165913665420:5131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:30.621839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554165913665420:5131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:30.623972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554165913665420:5131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:30.623992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554165913665420:5131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:30.623994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554165913665420:5131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:30.623999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:30.624266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:30.626752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:30.626947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:30.626959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:30.626970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:30.627030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:30.627067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554165838144354:4530]
2025-10-02T09:29:30.627644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:30.627959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:30.628004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:30.628289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:30.628332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.628338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.628339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.628340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.628341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.628341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.628342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.628343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.628344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.628345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.628345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.628346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.628351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.628362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.628366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.628370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.628373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.628376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.628378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.628381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.628385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.628390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.628397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.628401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.628407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.628418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.628423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.628433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.628437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.628446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.628449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.628458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.628462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.628471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.628475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.628482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.628487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.628492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.628498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.628503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.628508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.628514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.628518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.628522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.628527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.628532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.628538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.628543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.628576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:30.637371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:30.639262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:30.639282Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:30.639284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:30.639288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:30.639293Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [2:7556554165838144354:4530]
2025-10-02T09:29:30.639307Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:30.639325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:30.639328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.639331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.639333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.639348Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:30.639359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:30.639366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:30.639425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.639433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.639435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.639438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:30.639440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:30.639506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:30.639514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.639527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.639537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.639556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:30.639581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665334:2446], now have 1 active actors on pipe
2025-10-02T09:29:30.639589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665596:5131], now have 1 active actors on pipe
2025-10-02T09:29:30.639594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.639596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.639598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.639609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:30.639624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:30.639627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:30.639635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:30.639637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:30.639639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:30.639642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:30.639685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.639694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:30.639671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 440
2025-10-02T09:29:30.639704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:30.639679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 440
2025-10-02T09:29:30.639731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.639740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.639771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:30.639782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.639785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.639792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:30.639802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.639817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:30.639834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.640032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.640043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.640064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.640146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 36 sessionId: src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0
2025-10-02T09:29:30.640486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e99b46-3e434d8a-b6d9ea73-907dbb79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:30.643114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Write session: try to update token
2025-10-02T09:29:30.643131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:30.650622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:30.650641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.650649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.650692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:30.650692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:30.650855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:30.650987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.651141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.651277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:30.651576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:30.651617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:30.656403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:30.658995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:30.659564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.659588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.660714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:30.660745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:30.660748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.660751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:30.660753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:30.660761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.660764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.660769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554165838144349:4530]
2025-10-02T09:29:30.660794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:30.660793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:30.660799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:30.660818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:30.660822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.660824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:30.660881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:30.660946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:30.707042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554165913665609:4901]
2025-10-02T09:29:30.716763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7556554165913665609:4901]
2025-10-02T09:29:30.808566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:30.816325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.816351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.816496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.816564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.816631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.816693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.816734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.816738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.816828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.816888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.816959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.817025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.817067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.817074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.817145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.820168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:30.820185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:30.820213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: error at write: Disconnected sessionId: src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0
2025-10-02T09:29:30.820621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:30.820639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Write session will restart in 0.008356s
2025-10-02T09:29:30.820427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0 is DEAD
2025-10-02T09:29:30.820463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:30.820499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554165913665609:4901]
2025-10-02T09:29:30.820671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Write session: Do CDS request
2025-10-02T09:29:30.820679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:30.817213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.817281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.817377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.817417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.817421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.817489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.817549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.817612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.817680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.817719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.817722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.817793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.817892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.817994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.818095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.818135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.818138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.818213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.818270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.818333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.818394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.818449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.818452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.818520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.818585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.818658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.818720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.818788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.818791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.818865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.818922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.818981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.819046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.819168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.819171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.819240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.819298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.819360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.819420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.819487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.819490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.819554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:30.819610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:30.819676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:30.819744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:30.819871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:30.819874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:30.819938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665609:4901], now have 1 active actors on pipe
2025-10-02T09:29:30.820994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:30.830336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.830427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:30.830444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-10-02T09:29:30.830560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:30.830586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:30.830593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:30.830597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:30.830989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-10-02T09:29:30.831015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:30.831016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:30.831018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:30.831025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554165913665633:5136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:30.831518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554165913665633:5136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:30.834545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554165913665633:5136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:30.838076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554165913665633:5136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:30.838091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554165913665633:5136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:30.838095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554165913665633:5136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:30.838102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:30.845047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:30.847848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:30.848032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:30.848051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:30.848063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:30.848116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:30.848157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554165838144625:4533]
2025-10-02T09:29:30.848742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:30.849076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:30.849121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:30.849424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:30.849479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.849486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.849487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.849488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.849489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.849491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.849492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.849493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.849494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.849496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.849497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.849498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.849502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.849513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.849522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.849526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.849529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.849538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.849541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.849545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.849554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.849558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.849561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.849564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.849576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.849587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:30.849597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.849606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:30.849616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.849625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:30.849629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.849639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:30.849644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.849651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:30.849659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.849668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:30.849677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.849682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:30.849686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.849694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:30.849703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.849722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:30.849730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.849736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.849740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.849746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.849751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.849755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.849789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:30.858708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:30.860828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:30.860844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:30.860846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:30.860850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:30.860856Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [2:7556554165838144625:4533]
2025-10-02T09:29:30.860871Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:30.860888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:30.860891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.860894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.860896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.860909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:30.860919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:30.860930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:30.860997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.861007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.861009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.861012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:30.861014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:30.861080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:30.861088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.861103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:30.861118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:30.861139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:30.861162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665753:5136], now have 1 active actors on pipe
2025-10-02T09:29:30.861170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665619:2446], now have 1 active actors on pipe
2025-10-02T09:29:30.861176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.861183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.861185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.861198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:30.861210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:30.861215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:30.861195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 441
2025-10-02T09:29:30.861221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:30.861206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 441
2025-10-02T09:29:30.861223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:30.861229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:30.861232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:30.861263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.861271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:30.861273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:30.861290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.861298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.861338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:30.861350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:30.861359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:30.861361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:30.861370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:30.861382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:30.861403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.861544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:30.861556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:30.861571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:30.861650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 36 sessionId: src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0
2025-10-02T09:29:30.862020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afcbb0e3-67bbe65f-c771f1a4-fc2309af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:30.864497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Write session: try to update token
2025-10-02T09:29:30.864512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:30.872618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:30.872642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:30.872645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:30.872647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:30.872656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.872661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.872665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554165838144620:4533]
2025-10-02T09:29:30.872703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:30.872709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:30.872712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:30.872717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:30.872732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:30.872737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:30.872864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:30.877386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:30.879868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:30.920520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554165913665895:4901]
2025-10-02T09:29:30.920763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7556554165913665895:4901]
2025-10-02T09:29:31.017904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:31.018459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.018474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.018512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554165913665895:4901], now have 1 active actors on pipe
2025-10-02T09:29:31.018711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:31.018741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:31.018747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554165913665895:4901]
2025-10-02T09:29:31.018756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:31.018767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:31.018818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: error at write: Disconnected sessionId: src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0
2025-10-02T09:29:31.018984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0 is DEAD
2025-10-02T09:29:31.019206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:31.019221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Write session will restart in 0.006425s
2025-10-02T09:29:31.019250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Write session: Do CDS request
2025-10-02T09:29:31.019257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:31.027500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.027545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:31.027563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-10-02T09:29:31.027738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.027773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:31.027785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:31.027791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:31.028161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-10-02T09:29:31.028194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:31.028199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:31.028201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:31.028206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554170208633217:5140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:31.028732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554170208633217:5140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:31.032703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554170208633217:5140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:31.037155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554170208633217:5140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:31.037173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554170208633217:5140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:31.037175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554170208633217:5140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:31.037183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:31.040533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:31.041178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:31.041357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:31.041360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:31.041370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:31.041417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:31.041446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554170133112197:4535]
2025-10-02T09:29:31.042013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:31.042551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:31.042612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:31.042936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:31.043012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.043018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.043019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.043020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.043021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.043022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.043023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.043024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.043025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.043027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.043028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.043029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.043034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.043045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.043049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.043053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.043056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.043060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.043064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.043067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.043071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.043075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.043089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.043092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.043100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.043107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.043112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.043117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.043121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.043127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.043131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.043136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.043140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.043144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.043150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.043155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.043160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.043174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.043178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.043183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.043188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.043193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.043197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.043202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.043206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.043216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.043220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.043225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.043259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:31.052524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:31.054231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:31.054253Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:31.054255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:31.054259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:31.054265Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [2:7556554170133112197:4535]
2025-10-02T09:29:31.054278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:31.054295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:31.054298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.054301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.054302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.054317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:31.054322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:31.054328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:31.054380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.054387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.054389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.054393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:31.054395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:31.054455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:31.054462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.054476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.054487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.054502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:31.054524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633457:5140], now have 1 active actors on pipe
2025-10-02T09:29:31.054532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.054534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.054535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.054546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:31.054554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633193:2446], now have 1 active actors on pipe
2025-10-02T09:29:31.054566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:31.054584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:31.054592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:31.054621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.054627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:31.054640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 442
2025-10-02T09:29:31.054647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 442
2025-10-02T09:29:31.054668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:31.054683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:31.054685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:31.054693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:31.054824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.054836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.054860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:31.054866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.054874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.054876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:31.054884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.054898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:31.054915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.055070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.055088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.055099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.055209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 36 sessionId: src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0
2025-10-02T09:29:31.055518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a8ae6d-1a9e927-92319a3a-beda5712_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:31.058110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Write session: try to update token
2025-10-02T09:29:31.058128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:31.065801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:31.065825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.065834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.065878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:31.065877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:31.066067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:31.066204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:31.066364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:31.066499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:31.066784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:31.066819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:31.071652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:31.074202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:31.074419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.074443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.074474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:31.074608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:31.076491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:31.076507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.076510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:31.076512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:31.076519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.076523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.076526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554170133112190:4535]
2025-10-02T09:29:31.076560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:31.076564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.076565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:31.076566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:31.076570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:31.076574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:31.076700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:31.119312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554170208633487:4901]
2025-10-02T09:29:31.119821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7556554170208633487:4901]
2025-10-02T09:29:31.218896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:31.226611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.226640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.226807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.226862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.226931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.227005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.227055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.227066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.227149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.227218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.227288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.227361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.227408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.227416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.227480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.227536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.227592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.227661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.227707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.227715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.227779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.227839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.227904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.227959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.228001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.228009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.228078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.228167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.228227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.228282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.228322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.228327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.228386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.228439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.228493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.228549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.228597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.228603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.228661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.228722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.228830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.228892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.228935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.228940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.228999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.229053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.229116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.229177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.229240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.229247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.229315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.229381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.229451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.229510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.229630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.229639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.229704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:31.229761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:31.229818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:31.229878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:31.230003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:31.230012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:31.230070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633487:4901], now have 1 active actors on pipe
2025-10-02T09:29:31.230320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554170208633487:4901]
2025-10-02T09:29:31.230342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:31.230346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:31.230360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:31.230372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: error at write: Disconnected sessionId: src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0
2025-10-02T09:29:31.230548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0 is DEAD
2025-10-02T09:29:31.230712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:31.230724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Write session will restart in 0.007188s
2025-10-02T09:29:31.230745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Write session: Do CDS request
2025-10-02T09:29:31.230752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:31.231361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:31.241229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.241679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:31.241693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-10-02T09:29:31.241804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.241833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:31.241837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:31.241840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:31.242283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-10-02T09:29:31.242322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:31.242329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:31.242331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:31.242335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554170208633595:5152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:31.242824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554170208633595:5152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:31.245217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554170208633595:5152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:31.248302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554170208633595:5152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:31.248317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554170208633595:5152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:31.248321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554170208633595:5152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:31.248327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:31.248427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:31.251647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:31.251837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:31.251849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:31.251859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:31.251906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:31.251940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554170133112500:4550]
2025-10-02T09:29:31.252519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:31.252845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:31.252895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:31.253196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:31.253274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.253280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.253281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.253282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.253283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.253284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.253286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.253287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.253288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.253289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.253290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.253291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.253296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.253308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.253312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.253316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.253320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.253324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.253328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.253331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.253334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.253338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.253341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.253345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.253352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.253359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.253366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.253371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.253375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.253380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.253389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.253394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.253398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.253403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.253411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.253416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.253425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.253430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.253438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.253443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.253448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.253457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.253461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.253466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.253471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.253476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.253480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.253485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.253520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:31.262460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:31.264134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:31.264153Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:31.264156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:31.264160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:31.264165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [2:7556554170133112500:4550]
2025-10-02T09:29:31.264183Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:31.264199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:31.264209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.264211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.264213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.264227Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:31.264236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:31.264242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:31.264303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.264310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.264312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.264315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:31.264317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:31.264378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:31.264384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.264396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.264410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.264423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:31.264443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.264450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.264452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.264463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:31.264477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633763:5152], now have 1 active actors on pipe
2025-10-02T09:29:31.264485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633498:2446], now have 1 active actors on pipe
2025-10-02T09:29:31.264492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:31.264504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:31.264511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:31.264541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.264551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:31.264565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:31.264576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:31.264578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:31.264584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:31.264560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 443
2025-10-02T09:29:31.264600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 443
2025-10-02T09:29:31.264622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.264630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.264654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80f03d6b-42a7b83-72ac687-22885c2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:31.264665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.264668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.264676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:31.264683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.264691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:31.264704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.264865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.264878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.264901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.264996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 36 sessionId: src_id|80f03d6b-42a7b83-72ac687-22885c2c_0
2025-10-02T09:29:31.265327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faa4f552-ddfbbd33-5028a606-ba2d2768_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80f03d6b-42a7b83-72ac687-22885c2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:31.267785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Write session: try to update token
2025-10-02T09:29:31.267803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:31.276346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:31.276368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.276370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:31.276372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:31.276380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.276384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.276389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554170133112494:4550]
2025-10-02T09:29:31.276424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:31.276430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.276430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:31.276432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:31.276439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:31.276442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:31.276560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:31.280764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|80f03d6b-42a7b83-72ac687-22885c2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:31.283359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:31.330627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554170208633775:4901]
2025-10-02T09:29:31.330939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7556554170208633775:4901]
2025-10-02T09:29:31.426080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:31.426662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.426679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.426713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633775:4901], now have 1 active actors on pipe
2025-10-02T09:29:31.426948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:31.426950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554170208633775:4901]
2025-10-02T09:29:31.426963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:31.426977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:31.427017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: error at write: Disconnected sessionId: src_id|80f03d6b-42a7b83-72ac687-22885c2c_0
2025-10-02T09:29:31.427203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|80f03d6b-42a7b83-72ac687-22885c2c_0 is DEAD
2025-10-02T09:29:31.426855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:31.429059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:31.429069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Write session will restart in 0.008215s
2025-10-02T09:29:31.429092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Write session: Do CDS request
2025-10-02T09:29:31.429098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:31.438308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.438487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:31.438504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-10-02T09:29:31.440308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.440373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:31.440384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:31.440389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:31.440879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-10-02T09:29:31.440912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:31.440914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:31.440915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:31.440920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554170208633893:5157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:31.441385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554170208633893:5157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:31.443912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554170208633893:5157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:31.446511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554170208633893:5157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:31.446526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554170208633893:5157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:31.446529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554170208633893:5157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:31.446536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:31.447901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:31.450672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:31.450861Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:31.450872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:31.450880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:31.450922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:31.450956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554170133112784:4553]
2025-10-02T09:29:31.451549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:31.451845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:31.451891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:31.452180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:31.452248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.452255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.452257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.452257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.452259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.452260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.452261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.452263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.452264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.452265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.452266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.452268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.452273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.452285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.452289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.452293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.452298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.452302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.452306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.452310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.452314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.452318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.452322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.452326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.452334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.452342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.452353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.452359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.452368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.452373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.452382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.452386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.452394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.452398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.452405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.452410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.452419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.452424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.452434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.452439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.452444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.452453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.452457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.452465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.452470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.452479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.452483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.452492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.452526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:31.463280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:31.464954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:31.464973Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:31.464976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:31.464980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:31.464985Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [2:7556554170133112784:4553]
2025-10-02T09:29:31.464996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:31.465012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:31.465018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.465020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.465021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.465032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:31.465037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:31.465043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:31.465087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.465092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.465093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.465096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:31.465098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:31.465149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:31.465155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.465163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.465169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.465178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:31.465192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.465203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.465205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.465216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:31.465226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:31.465230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:31.465233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:31.465234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:31.465234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:31.465236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:31.465273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208633778:2446], now have 1 active actors on pipe
2025-10-02T09:29:31.465282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.465289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:31.465299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634054:5157], now have 1 active actors on pipe
2025-10-02T09:29:31.465307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:31.465394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 444
2025-10-02T09:29:31.465441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 444
2025-10-02T09:29:31.465815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.465828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.465848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:31.465853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.465856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.465857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:31.465864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.465871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:31.465881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.466062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.466069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.466080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.466146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 36 sessionId: src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0
2025-10-02T09:29:31.466472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f03d6b-42a7b83-72ac687-22885c2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:31.469110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Write session: try to update token
2025-10-02T09:29:31.469125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:31.475852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:31.475875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.475883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.475925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:31.475931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:31.476099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:31.476270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:31.476419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:31.476565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:31.476785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:31.476846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:31.483258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:31.485396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:31.485418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.485421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:31.485422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:31.485429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.485431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.485433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554170133112779:4553]
2025-10-02T09:29:31.485466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:31.485475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.485478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:31.485478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:31.485483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:31.485486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:31.485605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:31.485839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:31.527243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554170208634071:4901]
2025-10-02T09:29:31.527549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7556554170208634071:4901]
2025-10-02T09:29:31.630909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:31.631217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.631225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.631243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634071:4901], now have 1 active actors on pipe
2025-10-02T09:29:31.631854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:31.631865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Write session will restart in 0.008324s
2025-10-02T09:29:31.631888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Write session: Do CDS request
2025-10-02T09:29:31.631903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:31.631464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:31.631448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:31.631462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:31.631515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: error at write: Disconnected sessionId: src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0
2025-10-02T09:29:31.631698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0 is DEAD
2025-10-02T09:29:31.631816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:31.631846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554170208634071:4901]
2025-10-02T09:29:31.641295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.641403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:31.641419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-10-02T09:29:31.641554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.641584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:31.641588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:31.641592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:31.642564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-10-02T09:29:31.642604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:31.642606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:31.642608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:31.642613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554170208634106:5163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:31.643156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554170208634106:5163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:31.650378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554170208634106:5163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:31.657380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554170208634106:5163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:31.657403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554170208634106:5163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:31.657407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554170208634106:5163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:31.657414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:31.658658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:31.661914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:31.662109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:31.662123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:31.662134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:31.662199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:31.662241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554170133113057:4555]
2025-10-02T09:29:31.662764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:31.663105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:31.663161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:31.663498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:31.663572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.663573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.663574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.663576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.663577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.663578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.663579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.663580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.663581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.663582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.663583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.663584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.663589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.663604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.663608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.663611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.663615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.663619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.663622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.663625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.663630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.663634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.663638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.663644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.663651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.663658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.663664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.663668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.663672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.663676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.663682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.663688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.663692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.663696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.663701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.663710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.663714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.663718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.663722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.663727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.663731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.663735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.663741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.663746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.663749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.663757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.663787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:31.673711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:31.675825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:31.675852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:31.675855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:31.675858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:31.675865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [2:7556554170133113057:4555]
2025-10-02T09:29:31.675878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:31.675899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:31.675901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.675904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.675906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.675921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:31.675926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:31.675932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:31.675997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.676006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.676009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.676012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:31.676014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:31.676084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:31.676093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.676106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.676121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.676139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:31.676163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634074:2446], now have 1 active actors on pipe
2025-10-02T09:29:31.676171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634339:5163], now have 1 active actors on pipe
2025-10-02T09:29:31.676176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.676183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.676187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.676200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:31.676218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:31.676236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:31.676239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:31.676277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.676284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:31.676292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:31.676305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:31.676308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:31.676311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.676243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 445
2025-10-02T09:29:31.676314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:31.676285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 445
2025-10-02T09:29:31.676316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.676344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:31.676357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.676365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.676367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:31.676375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.676388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:31.676418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.676609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.676621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.676643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.676762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 36 sessionId: src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0
2025-10-02T09:29:31.677144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626f2a0-eb350f8b-faa99aba-780411c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:31.679693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Write session: try to update token
2025-10-02T09:29:31.679708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:31.691117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:31.691140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.691142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:31.691145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:31.691154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.691159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.691163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554170133113052:4555]
2025-10-02T09:29:31.691200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:31.691206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.691209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:31.691211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:31.691216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:31.691221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:31.691363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:31.694713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:31.697223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:31.733116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554170208634357:4901]
2025-10-02T09:29:31.733629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7556554170208634357:4901]
2025-10-02T09:29:31.837247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:31.837724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.837738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.837774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634357:4901], now have 1 active actors on pipe
2025-10-02T09:29:31.838096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:31.838184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:31.838200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:31.838260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: error at write: Disconnected sessionId: src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0
2025-10-02T09:29:31.838442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0 is DEAD
2025-10-02T09:29:31.838550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554170208634357:4901]
2025-10-02T09:29:31.838567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:31.840889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:31.840901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Write session will restart in 0.006969s
2025-10-02T09:29:31.840927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Write session: Do CDS request
2025-10-02T09:29:31.840933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:31.850117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.850200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:31.850217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-10-02T09:29:31.850435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:31.850477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:31.850482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:31.850486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:31.853553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-10-02T09:29:31.853594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:31.853596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:31.853598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:31.853604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554170208634389:5168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:31.854115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554170208634389:5168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:31.858724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554170208634389:5168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:31.864509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554170208634389:5168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:31.864528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554170208634389:5168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:31.864531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554170208634389:5168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:31.864539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:31.876047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:31.878946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:31.879165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:31.879175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:31.879184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:31.879233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:31.879279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554170133113333:4558]
2025-10-02T09:29:31.879918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:31.880229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:31.880270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:31.880598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:31.880650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.880656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.880657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.880658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.880659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.880661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.880662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.880664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.880665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.880666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.880667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.880668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.880673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.880684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.880689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.880693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.880697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.880701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.880705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.880709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.880713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.880717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.880721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.880724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.880731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.880738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:31.880744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.880749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:31.880754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.880759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:31.880764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.880775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:31.880779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.880785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:31.880790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.880797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:31.880820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.880829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:31.880833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.880838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:31.880847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.880852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:31.880860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.880870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.880874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.880881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.880890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.880923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:31.890479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:31.892581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:31.892599Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:31.892602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:31.892606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:31.892613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [2:7556554170133113333:4558]
2025-10-02T09:29:31.892628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:31.892646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:31.892649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.892653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.892655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.892671Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:31.892677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:31.892684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:31.892745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.892752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.892755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.892758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:31.892761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:31.893059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 446
2025-10-02T09:29:31.893115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 446
2025-10-02T09:29:31.892847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:31.892856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.892872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:31.892886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:31.892905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:31.892921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.892924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.892926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.892936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:31.892949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:31.892962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:31.892965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:31.892965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:31.892967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:31.892967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:31.892977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634370:2446], now have 1 active actors on pipe
2025-10-02T09:29:31.892982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634485:5168], now have 1 active actors on pipe
2025-10-02T09:29:31.893013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.893021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:31.893112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:31.893333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.893341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.893363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8d78438-e781a486-ca00832d-54b7939d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:31.893369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:31.893373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:31.893375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:31.893386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:31.893395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:31.893409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.893558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:31.893566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:31.893577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:31.894064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c1457b-fcb633b6-3129c381-cfe22e59_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f8d78438-e781a486-ca00832d-54b7939d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:31.893660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 36 sessionId: src_id|f8d78438-e781a486-ca00832d-54b7939d_0
2025-10-02T09:29:31.896752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Write session: try to update token
2025-10-02T09:29:31.896769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:31.905335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:31.905358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:31.905361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:31.905362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:31.905370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.905375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.905380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554170133113328:4558]
2025-10-02T09:29:31.905414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:31.905420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:31.905421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:31.905428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:31.905433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:31.905436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:31.905552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:31.910267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|f8d78438-e781a486-ca00832d-54b7939d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:31.912821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:31.938956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554170208634656:4901]
2025-10-02T09:29:31.939239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7556554170208634656:4901]
2025-10-02T09:29:32.047897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:32.048410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.048427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.048464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554170208634656:4901], now have 1 active actors on pipe
2025-10-02T09:29:32.048656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:32.048735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:32.048749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:32.048752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:32.048789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554170208634656:4901]
2025-10-02T09:29:32.048814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: error at write: Disconnected sessionId: src_id|f8d78438-e781a486-ca00832d-54b7939d_0
2025-10-02T09:29:32.048984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|f8d78438-e781a486-ca00832d-54b7939d_0 is DEAD
2025-10-02T09:29:32.049348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:32.049359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Write session will restart in 0.008953s
2025-10-02T09:29:32.049387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Write session: Do CDS request
2025-10-02T09:29:32.049393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:32.059344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.059417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:32.059433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-10-02T09:29:32.059566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.059595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:32.059604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:32.059607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:32.060063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-10-02T09:29:32.060100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:32.060101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:32.060103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:32.060109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554174503602003:5172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:32.060615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554174503602003:5172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:32.063778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554174503602003:5172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:32.068281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:32.071125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:32.071306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:32.071319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:32.071328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:32.071374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:32.071412Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554174428080902:4560]
2025-10-02T09:29:32.071502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554174503602003:5172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:32.071518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554174503602003:5172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:32.071522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554174503602003:5172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:32.071529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:32.072018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:32.072318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:32.072358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:32.072649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:32.072698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.072703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.072704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.072705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.072706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.072707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.072708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.072710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.072711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.072712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.072713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.072714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.072719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.072730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.072734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.072738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.072741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.072746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.072749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.072753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.072757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.072762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.072766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.072770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.072776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.072787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.072792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.072797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.072819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.072829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.072833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.072839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.072843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.072848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.072852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.072858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.072862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.072867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.072876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.072880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.072885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.072890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.072894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.072903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.072908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.072912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.072916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.072921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.072958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:32.081805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:32.083447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:32.083459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:32.083462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:32.083466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:32.083473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [2:7556554174428080902:4560]
2025-10-02T09:29:32.083488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:32.083506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:32.083509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.083512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.083514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.083529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:32.083537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:32.083543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:32.083607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.083614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.083616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.083620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:32.083623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:32.083686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:32.083693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.083708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.083726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.083749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:32.083772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503601955:2446], now have 1 active actors on pipe
2025-10-02T09:29:32.083782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.083785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.083787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.083798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:32.083810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602225:5172], now have 1 active actors on pipe
2025-10-02T09:29:32.083813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:32.083816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:32.083819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:32.083821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:32.083837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:32.083844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:32.083878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.083886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:32.083888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:32.083857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 447
2025-10-02T09:29:32.083908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 447
2025-10-02T09:29:32.083920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.083928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.083953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:32.083962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.083966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.083973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:32.083981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.083994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:32.084008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.084157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.084163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.084174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.084256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 36 sessionId: src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0
2025-10-02T09:29:32.084646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d78438-e781a486-ca00832d-54b7939d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:32.087395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Write session: try to update token
2025-10-02T09:29:32.087413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:32.098449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:32.098467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.098469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:32.098471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:32.098481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.098485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.098489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554174428080897:4560]
2025-10-02T09:29:32.098527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:32.098533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.098535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:32.098541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:32.098547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:32.098551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:32.098665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:32.101031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:32.103461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:32.148772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554174503602251:4901]
2025-10-02T09:29:32.149009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7556554174503602251:4901]
2025-10-02T09:29:32.244139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:32.244658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.244670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.244703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602251:4901], now have 1 active actors on pipe
2025-10-02T09:29:32.244906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:32.244967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:32.244980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:32.245048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554174503602251:4901]
2025-10-02T09:29:32.245052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: error at write: Disconnected sessionId: src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0
2025-10-02T09:29:32.245083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:32.245209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0 is DEAD
2025-10-02T09:29:32.245366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:32.245376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Write session will restart in 0.008910s
2025-10-02T09:29:32.245410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Write session: Do CDS request
2025-10-02T09:29:32.245416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:32.255286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.255369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:32.255379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-10-02T09:29:32.255483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.255510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:32.255518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:32.255521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:32.255839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-10-02T09:29:32.255868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:32.255874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:32.255876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:32.255880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554174503602328:5184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:32.256343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554174503602328:5184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:32.258611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554174503602328:5184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:32.261498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554174503602328:5184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:32.261508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554174503602328:5184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:32.261510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554174503602328:5184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:32.261515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:32.262579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:32.264658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:32.264814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:32.264822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:32.264830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:32.264865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:32.264892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554174428081216:4575]
2025-10-02T09:29:32.265358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:32.265640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:32.265678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:32.265976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:32.266036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.266042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.266043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.266044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.266045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.266046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.266047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.266048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.266049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.266050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.266051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.266052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.266056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.266066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.266070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.266074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.266077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.266081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.266085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.266088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.266092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.266096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.266099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.266103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.266108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.266115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.266120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.266124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.266128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.266131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.266133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.266136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.266139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.266142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.266144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.266147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.266149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.266152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.266154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.266156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.266159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.266162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.266165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.266167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.266169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.266172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.266174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.266177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.266196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:32.274593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:32.276157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:32.276171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:32.276174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:32.276177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:32.276184Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [2:7556554174428081216:4575]
2025-10-02T09:29:32.276199Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:32.276216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:32.276219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.276222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.276224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.276238Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:32.276242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:32.276249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:32.276302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.276310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.276312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.276314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:32.276317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:32.276527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 448
2025-10-02T09:29:32.276527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 448
2025-10-02T09:29:32.276757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:32.276768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.276781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.276791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.276819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:32.276844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602263:2446], now have 1 active actors on pipe
2025-10-02T09:29:32.276855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602531:5184], now have 1 active actors on pipe
2025-10-02T09:29:32.276871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.276874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.276886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.276892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.276894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.276907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:32.276923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:32.276935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:32.276938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:32.276940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:32.276944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:32.276947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:32.276963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:32.276970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.276973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.276974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:32.276983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.276992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:32.277029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.277040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:32.277048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:32.277053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.277224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.277231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.277243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.277328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0
2025-10-02T09:29:32.277644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a54c1f89-168ac861-4e86d67a-8bda57f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:32.280224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Write session: try to update token
2025-10-02T09:29:32.280239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:32.287727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:32.287747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.287755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.287801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:32.287804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:32.287964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:32.288116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.288268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.288417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.288618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:32.288663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:32.294138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:32.296472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:32.297525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.297547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.297562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:32.297565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.297567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:32.297569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:32.297576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.297579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.297582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554174428081211:4575]
2025-10-02T09:29:32.297614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:32.297618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.297620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:32.297621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:32.297627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:32.297631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:32.297757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:32.345397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554174503602545:4901]
2025-10-02T09:29:32.345730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7556554174503602545:4901]
2025-10-02T09:29:32.432141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:32.432403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:32.432427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602545:4901], now have 1 active actors on pipe
2025-10-02T09:29:32.432470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:32.432550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:32.432589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554174503602545:4901]
2025-10-02T09:29:32.441908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:32.441922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:32.441942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: error at write: Disconnected sessionId: src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0
2025-10-02T09:29:32.442066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0 is DEAD
2025-10-02T09:29:32.442180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:32.442185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Write session will restart in 0.007138s
2025-10-02T09:29:32.442200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Write session: Do CDS request
2025-10-02T09:29:32.442208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:32.450280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.450378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:32.450393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-10-02T09:29:32.450502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.450534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:32.450538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:32.450542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:32.451010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-10-02T09:29:32.451057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:32.451064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:32.451066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:32.451071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554174503602740:5189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:32.451554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554174503602740:5189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:32.453666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554174503602740:5189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:32.457687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:32.457838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554174503602740:5189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:32.457849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554174503602740:5189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:32.457851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554174503602740:5189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:32.457856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:32.458089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:32.458212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:32.458225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:32.458232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:32.458267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:32.458298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554174428081504:4578]
2025-10-02T09:29:32.458822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:32.459142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:32.459203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:32.459475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:32.459527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.459532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.459533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.459534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.459535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.459536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.459537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.459539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.459540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.459541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.459543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.459544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.459549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.459558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.459561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.459565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.459568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.459575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.459578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.459582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.459585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.459588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.459591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.459598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.459605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.459610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.459615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.459626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.459631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.459639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.459644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.459653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.459658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.459665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.459670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.459674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.459679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.459685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.459690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.459694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.459698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.459701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.459705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.459724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.459728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.459731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.459736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.459769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:32.468402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:32.470116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:32.470128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:32.470130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:32.470132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:32.470137Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [2:7556554174428081504:4578]
2025-10-02T09:29:32.470146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:32.470159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:32.470160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.470163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.470164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.470177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:32.470187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:32.470194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:32.470234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.470239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.470240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.470242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:32.470244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:32.470295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:32.470300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.470308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.470313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.470322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:32.470336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602831:5189], now have 1 active actors on pipe
2025-10-02T09:29:32.470345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.470346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.470347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.470352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:32.470417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 449
2025-10-02T09:29:32.470358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602560:2446], now have 1 active actors on pipe
2025-10-02T09:29:32.470364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:32.470365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:32.470367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:32.470421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 449
2025-10-02T09:29:32.470370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:32.470376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:32.470378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:32.470407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.470414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:32.470429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:32.470456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.470460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.470479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:32.470483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.470485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.470486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:32.470492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.470499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:32.470508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.470616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.470624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.470632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.470709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0
2025-10-02T09:29:32.470983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba9556e-7c2a04b4-685a9eda-54190dde_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:32.473431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Write session: try to update token
2025-10-02T09:29:32.473445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:32.480330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:32.480352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.480364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.480399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:32.480401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:32.480558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:32.480717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.480866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.481015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.481221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:32.481262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:32.485686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:32.487781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:32.487949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.487962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.487983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:32.488038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:32.489704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:32.489724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.489727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:32.489729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:32.489736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.489741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.489745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554174428081498:4578]
2025-10-02T09:29:32.489780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:32.489780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:32.489784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:32.489786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:32.489791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.489794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:32.489963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:32.532789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554174503602843:4901]
2025-10-02T09:29:32.532937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7556554174503602843:4901]
2025-10-02T09:29:32.621782Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:32.628606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.628624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.628750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.628816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.628876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.628927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.628969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.628975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.629032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.629081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.629134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.629427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.629464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.629469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.629523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.629577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.629644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.629717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.629759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.629763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.629817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.629869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.629934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.629987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.630023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.630028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.630091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.630147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.630203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.630253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.630293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.630297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.630354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.630409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.630460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.630511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.630558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.630564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.630618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.630667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.630721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.630794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.630843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.630848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.630901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.630950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.631010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.631062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.631179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.631184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.631236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.631292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.631345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.631395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.631430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.631435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.631487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:32.631534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:32.631585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:32.631634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:32.631730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:32.631736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:32.631771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602843:4901], now have 1 active actors on pipe
2025-10-02T09:29:32.632001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554174503602843:4901]
2025-10-02T09:29:32.632023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:32.632038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:32.632041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:32.632067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0
2025-10-02T09:29:32.632258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0 is DEAD
2025-10-02T09:29:32.632360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:32.632368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Write session will restart in 0.006819s
2025-10-02T09:29:32.632388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Write session: Do CDS request
2025-10-02T09:29:32.632394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:32.632357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:32.640259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.640369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:32.640384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-10-02T09:29:32.640489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.640528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:32.640537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:32.640541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:32.640943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-10-02T09:29:32.640978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:32.640986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:32.640988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:32.640993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554174503602878:5193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:32.641489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554174503602878:5193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:32.644113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554174503602878:5193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:32.647490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554174503602878:5193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:32.647505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554174503602878:5193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:32.647510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554174503602878:5193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:32.647517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:32.650234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:32.653187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:32.653362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:32.653374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:32.653383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:32.653429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:32.653463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554174428081782:4580]
2025-10-02T09:29:32.654052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:32.654324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:32.654362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:32.654628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:32.654664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.654668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.654669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.654670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.654671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.654672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.654674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.654675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.654676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.654677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.654678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.654679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.654684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.654694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.654697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.654701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.654704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.654708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.654711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.654714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.654718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.654722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.654724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.654727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.654731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.654735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.654739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.654741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.654744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.654747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.654749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.654751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.654754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.654757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.654760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.654763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.654765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.654768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.654770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.654773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.654775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.654778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.654781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.654783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.654786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.654788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.654790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.654793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.654811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:32.663207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:32.665066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:32.665078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:32.665081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:32.665085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:32.665091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [2:7556554174428081782:4580]
2025-10-02T09:29:32.665108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:32.665124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:32.665126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.665129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.665131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.665144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:32.665149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:32.665161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:32.665219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.665226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.665229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.665232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:32.665234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:32.665294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:32.665302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.665316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.665331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.665351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:32.665375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503603077:5193], now have 1 active actors on pipe
2025-10-02T09:29:32.665379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503602846:2446], now have 1 active actors on pipe
2025-10-02T09:29:32.665384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.665386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.665388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.665403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:32.665416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:32.665423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:32.665426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:32.665428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:32.665431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:32.665434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:32.665421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 450
2025-10-02T09:29:32.665448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 450
2025-10-02T09:29:32.665468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.665477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:32.665479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:32.665492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.665496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.665541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:32.665552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.665556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.665557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:32.665565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.665574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:32.665599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.665789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.665796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.665809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.665894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 36 sessionId: src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0
2025-10-02T09:29:32.666229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f519eac-6187ae6f-b220c827-5f052aa8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:32.668831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Write session: try to update token
2025-10-02T09:29:32.668848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:32.676544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:32.676559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.676561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:32.676563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:32.676568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.676571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.676576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554174428081777:4580]
2025-10-02T09:29:32.676608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:32.676613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:32.676615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.676617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:32.676618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:32.676622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:32.676747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:32.688466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:32.690757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:32.732454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554174503603134:4901]
2025-10-02T09:29:32.732675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7556554174503603134:4901]
2025-10-02T09:29:32.815471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:32.816022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.816036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.816052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503603134:4901], now have 1 active actors on pipe
2025-10-02T09:29:32.816219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:32.816227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:32.816239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:32.816247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:32.816292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: error at write: Disconnected sessionId: src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0
2025-10-02T09:29:32.816297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554174503603134:4901]
2025-10-02T09:29:32.816452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0 is DEAD
2025-10-02T09:29:32.816694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:32.816709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Write session will restart in 0.006439s
2025-10-02T09:29:32.816740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Write session: Do CDS request
2025-10-02T09:29:32.816747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:32.824269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.824366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:32.824381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-10-02T09:29:32.824479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:32.824521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:32.824530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:32.824533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:32.824950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-10-02T09:29:32.824979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:32.824983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:32.824985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:32.824989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554174503603165:5198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:32.825405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554174503603165:5198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:32.828533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554174503603165:5198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:32.831134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554174503603165:5198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:32.831144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554174503603165:5198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:32.831146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554174503603165:5198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:32.831151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:32.833682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:32.836191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:32.836317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:32.836324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:32.836331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:32.836371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:32.836403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554174428082062:4583]
2025-10-02T09:29:32.836774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:32.837017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:32.837046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:32.837241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:32.837271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.837276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.837277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.837278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.837278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.837278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.837279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.837280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.837280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.837281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.837281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.837282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.837285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.837291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.837294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.837296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.837298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.837300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.837302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.837304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.837306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.837308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.837310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.837312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.837316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.837322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:32.837327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.837332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:32.837335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.837339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:32.837343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.837348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:32.837351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.837354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:32.837356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.837358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:32.837361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.837363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:32.837366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.837369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:32.837372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.837374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:32.837376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.837380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.837382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.837385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.837387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.837390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.837410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:32.845528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:32.847030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:32.847043Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:32.847045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:32.847049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:32.847056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [2:7556554174428082062:4583]
2025-10-02T09:29:32.847069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:32.847092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:32.847094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.847097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.847099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.847112Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:32.847117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:32.847128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:32.847177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.847183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.847185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.847188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:32.847191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:32.847244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:32.847254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.847264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:32.847274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:32.847288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:32.847306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503603352:5198], now have 1 active actors on pipe
2025-10-02T09:29:32.847313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503603143:2446], now have 1 active actors on pipe
2025-10-02T09:29:32.847318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.847320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.847322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.847331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:32.847347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:32.847364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:32.847366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:32.847390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.847375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 451
2025-10-02T09:29:32.847394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:32.847396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:32.847385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 451
2025-10-02T09:29:32.847397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:32.847399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:32.847405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:32.847446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.847454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.847476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:32.847485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:32.847489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:32.847494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:32.847503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:32.847511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:32.847524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.847655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.847661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.847672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:32.847746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0
2025-10-02T09:29:32.848042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39315ca0-fa8c86e8-8c142fce-e3a9b4c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:32.850446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Write session: try to update token
2025-10-02T09:29:32.850460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:32.863509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:32.864197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:32.864214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.864221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.864264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:32.864276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:32.864430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:32.864575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.864740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.864892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:32.865074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:32.865113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:32.865907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:32.866682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:32.866696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:32.866709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:32.866711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:32.866713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:32.866715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:32.866720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.866724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.866726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554174428082057:4583]
2025-10-02T09:29:32.866762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:32.866769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:32.866773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:32.866774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:32.866775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:32.866778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:32.866893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:32.916685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554174503603429:4901]
2025-10-02T09:29:32.916990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7556554174503603429:4901]
2025-10-02T09:29:33.013755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:33.014484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:33.014519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554174503603429:4901], now have 1 active actors on pipe
2025-10-02T09:29:33.014648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:33.014701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554174503603429:4901]
2025-10-02T09:29:33.014720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:33.014755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:33.014764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:33.015342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:33.015355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Write session will restart in 0.009486s
2025-10-02T09:29:33.015377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Write session: Do CDS request
2025-10-02T09:29:33.015382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:33.014858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: error at write: Disconnected sessionId: src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0
2025-10-02T09:29:33.014994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0 is DEAD
2025-10-02T09:29:33.026338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.026862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:33.026879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-10-02T09:29:33.027046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.027104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:33.027121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:33.027130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:33.027638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-10-02T09:29:33.027676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:33.027678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:33.027680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:33.027686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554178798570740:5202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:33.028311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554178798570740:5202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:33.030638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554178798570740:5202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:33.035851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554178798570740:5202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:33.035869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554178798570740:5202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:33.035872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554178798570740:5202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:33.035880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:33.049065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:33.056151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:33.056384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:33.056393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:33.056403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:33.056459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:33.056519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554178723049638:4585]
2025-10-02T09:29:33.057161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:33.057482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:33.057532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:33.057849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:33.057920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.057927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.057929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.057930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.057931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.057932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.057933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.057934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.057935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.057936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.057937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.057938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.057944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.057954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.057958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.057961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.057965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.057969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.057972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.057976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.057980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.057984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.057988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.057992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.057999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.058006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.058013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.058018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.058023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.058028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.058035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.058040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.058045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.058051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.058056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.058061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.058066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.058072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.058076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.058082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.058087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.058092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.058096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.058102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.058107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.058112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.058116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.058122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.058161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:33.072157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:33.073805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:33.073824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:33.073827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:33.073830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:33.073837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [2:7556554178723049638:4585]
2025-10-02T09:29:33.073850Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:33.073867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:33.073869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.073872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.073874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.073889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:33.073898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:33.073905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:33.073973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.073980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.073982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.073986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:33.073988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:33.074052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:33.074059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.074073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.074084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.074100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:33.074116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.074119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.074121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.074134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:33.074148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:33.074162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:33.074165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:33.074200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.074211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:33.074802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:33.074811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:33.074812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:33.074819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:33.075140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 452
2025-10-02T09:29:33.075186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 452
2025-10-02T09:29:33.075250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798570729:2446], now have 1 active actors on pipe
2025-10-02T09:29:33.075260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798570796:5202], now have 1 active actors on pipe
2025-10-02T09:29:33.075361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.075370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.075390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:33.075405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.075414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.075416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:33.075425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.075449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:33.075474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.075681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.075687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.075700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.075839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0
2025-10-02T09:29:33.076183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8507d61-ca8ab49-71f15e00-4d08c928_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:33.078653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Write session: try to update token
2025-10-02T09:29:33.078670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:33.089363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:33.089378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:33.089380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:33.089382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:33.089390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.089394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.089398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554178723049633:4585]
2025-10-02T09:29:33.089433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:33.089440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.089442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:33.089445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:33.089450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:33.089455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:33.089570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:33.095206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:33.097950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:33.113896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554178798571013:4901]
2025-10-02T09:29:33.114157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7556554178798571013:4901]
2025-10-02T09:29:33.235058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:33.235568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.235577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.235611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571013:4901], now have 1 active actors on pipe
2025-10-02T09:29:33.235906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:33.236502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:33.236515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Write session will restart in 0.009248s
2025-10-02T09:29:33.236537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Write session: Do CDS request
2025-10-02T09:29:33.236543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:33.235925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554178798571013:4901]
2025-10-02T09:29:33.235933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:33.235961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:33.236035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0
2025-10-02T09:29:33.236201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0 is DEAD
2025-10-02T09:29:33.247327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.247745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:33.247763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-10-02T09:29:33.247886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.247911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:33.247916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:33.247920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:33.248362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-10-02T09:29:33.248386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:33.248387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:33.248389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:33.248394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554178798571074:5214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:33.248917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554178798571074:5214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:33.253422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554178798571074:5214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:33.256632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554178798571074:5214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:33.256649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554178798571074:5214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:33.256652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554178798571074:5214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:33.256660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:33.261435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:33.264120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:33.264390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:33.264400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:33.264412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:33.264470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:33.264509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554178723049956:4600]
2025-10-02T09:29:33.265075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:33.265325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:33.265372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:33.265672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:33.265736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.265737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.265738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.265739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.265740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.265741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.265742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.265743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.265744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.265745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.265746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.265747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.265752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.265762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.265766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.265769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.265773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.265776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.265780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.265783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.265786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.265789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.265792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.265796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.265803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.265810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.265815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.265820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.265824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.265828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.265834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.265838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.265842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.265847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.265851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.265855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.265862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.265866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.265870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.265873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.265876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.265880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.265884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.265888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.265892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.265896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.265901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.265905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.265941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:33.277816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:33.279471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:33.279491Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:33.279494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:33.279498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:33.279505Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [2:7556554178723049956:4600]
2025-10-02T09:29:33.279518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:33.279536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:33.279539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.279542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.279544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.279560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:33.279565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:33.279571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:33.279635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.279643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.279646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.279649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:33.279651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:33.279720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:33.279727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.279740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.279750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.279765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:33.279786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.279788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.279793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.279805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:33.279819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:33.279832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:33.279834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:33.279867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.279869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:33.279944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:33.279949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:33.279950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:33.279954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:33.280197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571043:2446], now have 1 active actors on pipe
2025-10-02T09:29:33.280208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571242:5214], now have 1 active actors on pipe
2025-10-02T09:29:33.280208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 453
2025-10-02T09:29:33.280255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 453
2025-10-02T09:29:33.280382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.280391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.280416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c19df971-2c744235-fe0a3b41-14584426_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:33.280423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.280428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.280430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:33.280442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.280456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:33.280766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 36 sessionId: src_id|c19df971-2c744235-fe0a3b41-14584426_0
2025-10-02T09:29:33.281063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d2b2c2-eac98078-216eea6d-29ec0d33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c19df971-2c744235-fe0a3b41-14584426_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:33.283618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Write session: try to update token
2025-10-02T09:29:33.283632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:33.280477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.280662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.280670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.280691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.294714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:33.294734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:33.294737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:33.294739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:33.294747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.294752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.294756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554178723049951:4600]
2025-10-02T09:29:33.294791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:33.294797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.294800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:33.294933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:33.294943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:33.294949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:33.294952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:33.296716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|c19df971-2c744235-fe0a3b41-14584426_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:33.299242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:33.336135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554178798571327:4901]
2025-10-02T09:29:33.336396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7556554178798571327:4901]
2025-10-02T09:29:33.443492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:33.443932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.443948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.443981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571327:4901], now have 1 active actors on pipe
2025-10-02T09:29:33.444177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:33.444222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:33.444225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554178798571327:4901]
2025-10-02T09:29:33.444248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:33.444315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c19df971-2c744235-fe0a3b41-14584426_0
2025-10-02T09:29:33.444494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|c19df971-2c744235-fe0a3b41-14584426_0 is DEAD
2025-10-02T09:29:33.444646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:33.444654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Write session will restart in 0.009904s
2025-10-02T09:29:33.444679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Write session: Do CDS request
2025-10-02T09:29:33.444685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:33.455298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.455446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:33.455460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-10-02T09:29:33.455594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.455633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:33.455642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:33.455645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:33.456036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-10-02T09:29:33.456077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:33.456083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:33.456084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:33.456089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554178798571410:5219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:33.456505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554178798571410:5219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:33.459618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554178798571410:5219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:33.462405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554178798571410:5219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:33.462425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554178798571410:5219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:33.462429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554178798571410:5219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:33.462436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:33.464491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:33.467384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:33.467560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:33.467569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:33.467578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:33.467619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:33.467655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554178723050249:4603]
2025-10-02T09:29:33.468195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:33.468458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:33.468494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:33.468779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:33.468845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.468850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.468851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.468852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.468853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.468854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.468856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.468857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.468857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.468858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.468859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.468860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.468865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.468874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.468877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.468880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.468883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.468886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.468889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.468892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.468896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.468899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.468902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.468905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.468911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.468917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.468922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.468926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.468930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.468934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.468938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.468942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.468946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.468950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.468954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.468958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.468962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.468966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.468971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.468975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.468985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.468989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.468994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.469002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.469006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.469015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.469019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.469022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.469056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:33.480430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:33.482060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:33.482079Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:33.482081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:33.482083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:33.482089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [2:7556554178723050249:4603]
2025-10-02T09:29:33.482100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:33.482114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:33.482116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.482118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.482120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.482132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:33.482136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:33.482142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:33.482503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 454
2025-10-02T09:29:33.482531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 454
2025-10-02T09:29:33.482199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.482207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.482209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.482213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:33.482215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:33.482283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:33.482285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.482293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.482303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.482312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:33.482326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.482328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.482330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.482335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:33.482347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:33.482351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:33.482355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:33.482356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:33.482357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:33.482358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:33.482390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.482398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:33.482404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:33.482408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571610:5219], now have 1 active actors on pipe
2025-10-02T09:29:33.482411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571342:2446], now have 1 active actors on pipe
2025-10-02T09:29:33.482832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.482844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.482869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:33.482876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.482880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.482882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:33.482891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.482902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:33.482914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.483461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.483472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.483491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.483585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 36 sessionId: src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0
2025-10-02T09:29:33.483927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19df971-2c744235-fe0a3b41-14584426_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:33.486363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Write session: try to update token
2025-10-02T09:29:33.486379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:33.497880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:33.497894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:33.497896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:33.497898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:33.497906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.497914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.497918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554178723050244:4603]
2025-10-02T09:29:33.497955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:33.497960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.497962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:33.497974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:33.497980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:33.497984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:33.498087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:33.501175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:33.503600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:33.544512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554178798571631:4901]
2025-10-02T09:29:33.544822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7556554178798571631:4901]
2025-10-02T09:29:33.648177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:33.648448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.648462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.648498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571631:4901], now have 1 active actors on pipe
2025-10-02T09:29:33.648713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:33.649176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:33.649187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Write session will restart in 0.006784s
2025-10-02T09:29:33.648783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:33.648795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:33.648826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:33.648863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: error at write: Disconnected sessionId: src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0
2025-10-02T09:29:33.649209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Write session: Do CDS request
2025-10-02T09:29:33.649217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:33.648866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554178798571631:4901]
2025-10-02T09:29:33.649028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0 is DEAD
2025-10-02T09:29:33.657267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.657368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:33.657381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-10-02T09:29:33.658037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.658072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:33.658079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:33.658083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:33.658538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-10-02T09:29:33.658583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:33.658589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:33.658590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:33.658596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554178798571657:5223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:33.659081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554178798571657:5223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:33.662264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554178798571657:5223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:33.665055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554178798571657:5223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:33.665070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554178798571657:5223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:33.665073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554178798571657:5223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:33.665079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:33.677759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:33.681179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:33.681372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:33.681382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:33.681393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:33.681440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:33.681479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554178723050532:4605]
2025-10-02T09:29:33.682051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:33.682355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:33.682398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:33.682688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:33.682749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.682758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.682759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.682760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.682762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.682763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.682765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.682766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.682767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.682768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.682769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.682770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.682776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.682786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.682790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.682794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.682797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.682801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.682805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.682809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.682812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.682816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.682819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.682823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.682829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.682836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.682841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.682846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.682852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.682858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.682862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.682866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.682871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.682880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.682884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.682888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.682893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.682898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.682902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.682907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.682911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.682916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.682920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.682925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.682929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.682934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.682938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.682943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.682979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:33.693131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:33.694821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:33.694838Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:33.694840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:33.694843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:33.694850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [2:7556554178723050532:4605]
2025-10-02T09:29:33.694869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:33.694885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:33.694887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.694890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.694892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.694908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:33.694913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:33.694920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:33.694987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.694994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.694996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.694999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:33.695001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:33.695063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:33.695070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.695096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.695112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.695130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:33.695153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571742:5223], now have 1 active actors on pipe
2025-10-02T09:29:33.695167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571633:2446], now have 1 active actors on pipe
2025-10-02T09:29:33.695173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.695176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.695178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.695191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:33.695204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:33.695192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 455
2025-10-02T09:29:33.695207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:33.695210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:33.695218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 455
2025-10-02T09:29:33.695212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:33.695218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:33.695220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:33.695253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.695262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:33.695276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.695280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:33.695284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.695333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67315d48-9fd83358-6307c9d3-7109262a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:33.695345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.695348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.695350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:33.695359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.695369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:33.695386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.695548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.695558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.695573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.695701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 36 sessionId: src_id|67315d48-9fd83358-6307c9d3-7109262a_0
2025-10-02T09:29:33.696042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6f4f89-13c970c7-98a03081-56c3aafb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67315d48-9fd83358-6307c9d3-7109262a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:33.698586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Write session: try to update token
2025-10-02T09:29:33.698604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:33.708836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:33.708856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:33.708859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:33.708862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:33.708872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.708877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.708882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554178723050526:4605]
2025-10-02T09:29:33.708931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:33.708939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.708941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:33.708947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:33.708956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:33.708960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:33.709194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:33.712224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|67315d48-9fd83358-6307c9d3-7109262a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:33.714699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:33.748835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554178798571930:4901]
2025-10-02T09:29:33.749125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7556554178798571930:4901]
2025-10-02T09:29:33.851298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:33.851781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.851791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.851820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571930:4901], now have 1 active actors on pipe
2025-10-02T09:29:33.851977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:33.852015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:33.852028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:33.852035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:33.852086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: error at write: Disconnected sessionId: src_id|67315d48-9fd83358-6307c9d3-7109262a_0
2025-10-02T09:29:33.852090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554178798571930:4901]
2025-10-02T09:29:33.852252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|67315d48-9fd83358-6307c9d3-7109262a_0 is DEAD
2025-10-02T09:29:33.852402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:33.852412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Write session will restart in 0.007894s
2025-10-02T09:29:33.852453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Write session: Do CDS request
2025-10-02T09:29:33.852459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:33.861223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.861333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:33.861358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-10-02T09:29:33.861464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:33.861493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:33.861498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:33.861501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:33.861944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-10-02T09:29:33.861977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:33.861978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:33.861980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:33.861985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554178798571987:5228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:33.862491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554178798571987:5228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:33.864683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554178798571987:5228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:33.867421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554178798571987:5228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:33.867434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554178798571987:5228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:33.867437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554178798571987:5228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:33.867443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:33.870565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:33.873417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:33.873590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:33.873602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:33.873612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:33.873668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:33.873712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554178723050818:4608]
2025-10-02T09:29:33.874272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:33.874633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:33.874667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:33.874913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:33.874961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.874967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.874968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.874970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.874971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.874971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.874972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.874973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.874974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.874975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.874976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.874977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.874981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.874991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.874995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.874998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.875002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.875005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.875008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.875012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.875016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.875021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.875025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.875028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.875036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.875043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:33.875049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.875054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:33.875058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.875063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:33.875067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.875081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:33.875085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.875090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:33.875094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.875099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:33.875103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.875108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:33.875112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.875117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:33.875123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.875126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:33.875128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.875130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.875132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.875135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.875137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.875140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.875159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:33.885668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:33.887808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:33.887829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:33.887832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:33.887835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:33.887841Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [2:7556554178723050818:4608]
2025-10-02T09:29:33.887853Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:33.887871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:33.887874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.887877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.887878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.887892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:33.887911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:33.887917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:33.887973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.887979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.887981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.887984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:33.887986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:33.888047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:33.888054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.888066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:33.888080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:33.888099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:33.888120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.888126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.888128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.888140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:33.888158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798572148:5228], now have 1 active actors on pipe
2025-10-02T09:29:33.888165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798571935:2446], now have 1 active actors on pipe
2025-10-02T09:29:33.888168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:33.888172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:33.888172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:33.888174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:33.888186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:33.888189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:33.888225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.888239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:33.888249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:33.888243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 456
2025-10-02T09:29:33.888254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 456
2025-10-02T09:29:33.888298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.888306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.888328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|939331e8-6efd51b8-685820cb-2555d6e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:33.888339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:33.888349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:33.888351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:33.888360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:33.888369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:33.888386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.888531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:33.888539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:33.888552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:33.888687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 36 sessionId: src_id|939331e8-6efd51b8-685820cb-2555d6e1_0
2025-10-02T09:29:33.889037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67315d48-9fd83358-6307c9d3-7109262a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|939331e8-6efd51b8-685820cb-2555d6e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:33.891513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Write session: try to update token
2025-10-02T09:29:33.891549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:33.899778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:33.899796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:33.899798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:33.899800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:33.899808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.899811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.899815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554178723050812:4608]
2025-10-02T09:29:33.899854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:33.899860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:33.899862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:33.899877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:33.899893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:33.899897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:33.899986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:33.904921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|939331e8-6efd51b8-685820cb-2555d6e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:33.907267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:33.952042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554178798572226:4901]
2025-10-02T09:29:33.952212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7556554178798572226:4901]
2025-10-02T09:29:34.038308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:34.038763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.038778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.038812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554178798572226:4901], now have 1 active actors on pipe
2025-10-02T09:29:34.039014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:34.039023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:34.039038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:34.039055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554178798572226:4901]
2025-10-02T09:29:34.039082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:34.039107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: error at write: Disconnected sessionId: src_id|939331e8-6efd51b8-685820cb-2555d6e1_0
2025-10-02T09:29:34.039283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|939331e8-6efd51b8-685820cb-2555d6e1_0 is DEAD
2025-10-02T09:29:34.039440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:34.039461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Write session will restart in 0.009890s
2025-10-02T09:29:34.039483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Write session: Do CDS request
2025-10-02T09:29:34.039490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:34.050300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.050369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:34.050383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-10-02T09:29:34.050505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.050533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:34.050542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:34.050545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:34.050944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-10-02T09:29:34.050972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:34.050980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:34.050982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:34.050986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554183093539591:5232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:34.051475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554183093539591:5232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:34.053509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554183093539591:5232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:34.056258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554183093539591:5232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:34.056269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554183093539591:5232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:34.056272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554183093539591:5232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:34.056279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:34.058086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:34.061065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:34.061251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:34.061262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:34.061273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:34.061325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:34.061360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554183018018398:4610]
2025-10-02T09:29:34.061927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:34.062265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:34.062315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:34.062615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:34.062689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.062695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.062696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.062697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.062699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.062700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.062701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.062702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.062703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.062705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.062706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.062707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.062712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.062723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.062727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.062731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.062734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.062738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.062742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.062745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.062749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.062752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.062756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.062760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.062767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.062774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.062784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.062789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.062798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.062807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.062811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.062820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.062824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.062828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.062836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.062841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.062847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.062855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.062859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.062864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.062873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.062878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.062883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.062891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.062895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.062900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.062904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.062909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.062941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:34.073249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:34.074905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:34.074915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:34.074917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:34.074919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:34.074923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [2:7556554183018018398:4610]
2025-10-02T09:29:34.074936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:34.074949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:34.074951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.074952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.074953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.074963Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:34.074967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:34.074973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:34.075018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.075024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.075025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.075027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:34.075029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:34.075085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:34.075091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.075100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.075105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.075114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:34.075129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.075131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.075132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.075139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:34.075150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:34.075150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093539525:2446], now have 1 active actors on pipe
2025-10-02T09:29:34.075154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093539802:5232], now have 1 active actors on pipe
2025-10-02T09:29:34.075157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:34.075159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:34.075161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:34.075165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:34.075167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:34.075193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.075204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:34.075227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:34.075240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 457
2025-10-02T09:29:34.075246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 457
2025-10-02T09:29:34.075332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.075339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.075354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:34.075362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.075364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.075365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:34.075371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.075377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:34.075389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.075539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.075549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.075567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.075667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 36 sessionId: src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0
2025-10-02T09:29:34.075983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|939331e8-6efd51b8-685820cb-2555d6e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:34.078512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Write session: try to update token
2025-10-02T09:29:34.078526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:34.086581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:34.086604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.086614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.086658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:34.086663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:34.086845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:34.087009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.087165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.087312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.087510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:34.087556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:34.095247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:34.097442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:34.097461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.097463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:34.097465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:34.097474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.097478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.097481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554183018018393:4610]
2025-10-02T09:29:34.097516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:34.097522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.097524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:34.097567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:34.097592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:34.097596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:34.097678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:34.097774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:34.139423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554183093539818:4901]
2025-10-02T09:29:34.139950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7556554183093539818:4901]
2025-10-02T09:29:34.243905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:34.244348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.244359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.244378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093539818:4901], now have 1 active actors on pipe
2025-10-02T09:29:34.244940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:34.245663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:34.245709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554183093539818:4901]
2025-10-02T09:29:34.245727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:34.245789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0
2025-10-02T09:29:34.245961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0 is DEAD
2025-10-02T09:29:34.246183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:34.246190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Write session will restart in 0.005367s
2025-10-02T09:29:34.246213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Write session: Do CDS request
2025-10-02T09:29:34.246219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:34.252275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.252370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:34.252385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-10-02T09:29:34.252554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.252591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:34.252598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:34.252602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:34.252990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-10-02T09:29:34.253017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:34.253018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:34.253020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:34.253024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554183093539850:5243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:34.253501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554183093539850:5243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:34.255600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554183093539850:5243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:34.259828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554183093539850:5243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:34.259844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554183093539850:5243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:34.259847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554183093539850:5243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:34.259855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:34.280164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:34.283522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:34.283875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:34.283891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:34.283904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:34.283978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:34.284021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554183018018722:4623]
2025-10-02T09:29:34.284601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:34.284961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:34.285014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:34.285321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:34.285380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.285386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.285387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.285388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.285389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.285390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.285391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.285392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.285393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.285394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.285395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.285397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.285401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.285412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.285416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.285420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.285424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.285428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.285431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.285434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.285438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.285442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.285446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.285450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.285456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.285463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.285470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.285476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.285480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.285485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.285489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.285494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.285501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.285506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.285514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.285519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.285523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.285529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.285533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.285538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.285543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.285547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.285553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.285558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.285562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.285569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.285573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.285582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.285616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:34.295529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:34.297158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:34.297172Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:34.297175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:34.297179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:34.297186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [2:7556554183018018722:4623]
2025-10-02T09:29:34.297204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:34.297222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:34.297225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.297227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.297230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.297245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:34.297250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:34.297257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:34.297319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.297328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.297330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.297333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:34.297335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:34.297400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:34.297407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.297419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.297430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.297444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:34.297460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.297466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.297468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.297475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:34.297487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:34.297488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093539837:2446], now have 1 active actors on pipe
2025-10-02T09:29:34.297491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093539918:5243], now have 1 active actors on pipe
2025-10-02T09:29:34.297496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:34.297498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:34.297498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:34.297511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:34.297513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:34.297579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 458
2025-10-02T09:29:34.297582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 458
2025-10-02T09:29:34.297548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.297561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:34.297571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:34.297784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.297794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.297816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:34.297823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.297826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.297828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:34.297837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.297846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:34.297859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.298011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.298018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.298032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.298117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0
2025-10-02T09:29:34.298506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15d973-cbb1d813-83b0c987-ce1d54c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:34.301353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Write session: try to update token
2025-10-02T09:29:34.301372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:34.313103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:34.313118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.313120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:34.313122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:34.313129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.313132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.313135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554183018018717:4623]
2025-10-02T09:29:34.313163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:34.313172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.313173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:34.313181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:34.313189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:34.313193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:34.313283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:34.331739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:34.334234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:34.345261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554183093540135:4901]
2025-10-02T09:29:34.345515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7556554183093540135:4901]
2025-10-02T09:29:34.461151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:34.461671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.461684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.461702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540135:4901], now have 1 active actors on pipe
2025-10-02T09:29:34.461901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:34.462025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554183093540135:4901]
2025-10-02T09:29:34.462034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:34.462058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:34.462118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0
2025-10-02T09:29:34.462300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0 is DEAD
2025-10-02T09:29:34.462439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:34.462451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Write session will restart in 0.005190s
2025-10-02T09:29:34.462476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Write session: Do CDS request
2025-10-02T09:29:34.462482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:34.469234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.469376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:34.469391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-10-02T09:29:34.469523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.469554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:34.469563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:34.469567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:34.470087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-10-02T09:29:34.470121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:34.470122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:34.470124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:34.470129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554183093540173:5249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:34.470592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554183093540173:5249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:34.473645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554183093540173:5249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:34.477057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554183093540173:5249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:34.477069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554183093540173:5249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:34.477073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554183093540173:5249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:34.477080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:34.481342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:34.484550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:34.484726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:34.484734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:34.484744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:34.484786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:34.484835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554183018019020:4628]
2025-10-02T09:29:34.485402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:34.485656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:34.485693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:34.485993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:34.486052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.486057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.486058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.486059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.486060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.486061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.486062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.486063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.486063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.486064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.486065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.486066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.486070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.486081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.486084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.486088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.486092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.486095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.486099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.486102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.486110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.486114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.486121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.486124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.486134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.486144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.486154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.486163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.486167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.486172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.486175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.486180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.486185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.486193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.486201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.486205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.486214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.486222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.486230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.486238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.486242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.486247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.486252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.486259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.486265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.486272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.486279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.486284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.486322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:34.495556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:34.497251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:34.497270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:34.497272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:34.497276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:34.497283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [2:7556554183018019020:4628]
2025-10-02T09:29:34.497297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:34.497313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:34.497317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.497319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.497322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.497337Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:34.497346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:34.497353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:34.497411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.497418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.497419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.497422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:34.497425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:34.497488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:34.497494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.497507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.497522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.497537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:34.497558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.497564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.497567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.497578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:34.497594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:34.497597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:34.497599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540150:2446], now have 1 active actors on pipe
2025-10-02T09:29:34.497602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:34.497602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540327:5249], now have 1 active actors on pipe
2025-10-02T09:29:34.497610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:34.497622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:34.497629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:34.497659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.497672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:34.497690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:34.497689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 459
2025-10-02T09:29:34.497728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 459
2025-10-02T09:29:34.497723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.497731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.497754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40123819-c2f0fe93-76a74252-2d6eb025_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:34.497764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.497767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.497769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:34.497780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.497788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:34.497801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.497942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.497950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.497961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.498029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 36 sessionId: src_id|40123819-c2f0fe93-76a74252-2d6eb025_0
2025-10-02T09:29:34.498375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6e08cbb-65c3d4dc-75ef6c4a-f98ab96c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40123819-c2f0fe93-76a74252-2d6eb025_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:34.500919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Write session: try to update token
2025-10-02T09:29:34.500934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:34.508830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:34.508850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.508861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.508906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:34.508915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:34.509199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:34.509475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.509677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.509852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.510044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:34.510085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:34.514413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|40123819-c2f0fe93-76a74252-2d6eb025_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:34.516864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:34.517058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.517077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.517106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:34.517178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:34.518214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:34.518228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.518230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:34.518232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:34.518240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.518244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.518249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554183018019015:4628]
2025-10-02T09:29:34.518282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:34.518282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:34.518287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:34.518291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:34.518292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.518294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:34.518428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:34.562352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554183093540444:4901]
2025-10-02T09:29:34.562520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7556554183093540444:4901]
2025-10-02T09:29:34.658620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:34.666180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.666206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.666370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.666429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.666493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.666557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.666601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.666610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.666680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.666743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.666809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.666877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.666927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.666931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.666994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.667057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.667135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.667197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.667301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.667305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.667376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.667435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.667494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.667558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.667607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.667610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.667677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.667737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.667798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.667858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.667900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.667903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.667971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.668029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.668089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.668150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.668189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.668191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.668256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.668310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.668368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.668428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.668527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.668531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.668614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.668671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.668727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.668782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.669022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.669037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.669101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.669159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.669221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.669279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.669321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.669324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.669390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.670433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:34.670445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Write session will restart in 0.008203s
2025-10-02T09:29:34.670467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Write session: Do CDS request
2025-10-02T09:29:34.670049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:34.670474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:34.670072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:34.670102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: error at write: Disconnected sessionId: src_id|40123819-c2f0fe93-76a74252-2d6eb025_0
2025-10-02T09:29:34.670274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|40123819-c2f0fe93-76a74252-2d6eb025_0 is DEAD
2025-10-02T09:29:34.670381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554183093540444:4901]
2025-10-02T09:29:34.670396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:34.669451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.669515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.669575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.669614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.669617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.669686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540444:4901], now have 1 active actors on pipe
2025-10-02T09:29:34.670783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:34.680323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.680441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:34.680458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-10-02T09:29:34.680567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.680596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:34.680604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:34.680608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:34.681128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-10-02T09:29:34.681164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:34.681165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:34.681167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:34.681171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554183093540478:5253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:34.681693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554183093540478:5253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:34.685263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554183093540478:5253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:34.689592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554183093540478:5253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:34.689606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554183093540478:5253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:34.689609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554183093540478:5253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:34.689616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:34.693174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:34.696477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:34.696661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:34.696670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:34.696679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:34.696727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:34.696764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554183018019308:4630]
2025-10-02T09:29:34.697340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:34.697679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:34.697738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:34.698044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:34.698098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.698104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.698105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.698107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.698107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.698108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.698109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.698110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.698111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.698112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.698112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.698114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.698118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.698129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.698132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.698136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.698140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.698143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.698147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.698150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.698153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.698157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.698160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.698164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.698171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.698177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.698182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.698187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.698191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.698195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.698199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.698203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.698207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.698212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.698215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.698219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.698222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.698227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.698231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.698235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.698239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.698244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.698248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.698252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.698256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.698262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.698266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.698270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.698309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:34.707500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:34.709416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:34.709434Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:34.709436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:34.709439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:34.709446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [2:7556554183018019308:4630]
2025-10-02T09:29:34.709459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:34.709477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:34.709480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.709482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.709484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.709501Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:34.709511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:34.709516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:34.709582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.709588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.709590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.709593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:34.709595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:34.709658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:34.709663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.709676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.709686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.709706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:34.709727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540446:2446], now have 1 active actors on pipe
2025-10-02T09:29:34.709734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540674:5253], now have 1 active actors on pipe
2025-10-02T09:29:34.709741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.709743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.709745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.709756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:34.709776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:34.709793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:34.709799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:34.709833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.709840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:34.709841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 460
2025-10-02T09:29:34.709892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 460
2025-10-02T09:29:34.709879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:34.709890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:34.709892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:34.709901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:34.709983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.709987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.710009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:34.710015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.710019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.710021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:34.710030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.710039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:34.710052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.710195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.710205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.710222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.710292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 36 sessionId: src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0
2025-10-02T09:29:34.710621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40123819-c2f0fe93-76a74252-2d6eb025_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:34.713181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Write session: try to update token
2025-10-02T09:29:34.713198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:34.721762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:34.721783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.721792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.721836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:34.721840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:34.722024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:34.722186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.722341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.722500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.722709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:34.722762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:34.727724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:34.730403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:34.730613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.730631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.730665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:34.730795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:34.733040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:34.733056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.733058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:34.733060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:34.733069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.733072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.733076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554183018019303:4630]
2025-10-02T09:29:34.733114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:34.733119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:34.733121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.733123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:34.733124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:34.733127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:34.733282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:34.770762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554183093540745:4901]
2025-10-02T09:29:34.771179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7556554183093540745:4901]
2025-10-02T09:29:34.873823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:34.881400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.881420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.881571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.881628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.881695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.881758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.881833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.881850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.881922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.881986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.882050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.882115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.882158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.882168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.882228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.882285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.882344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.882401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.882445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.882452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.882516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.882576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.882655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.882712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.882752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.882760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.882823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.882887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.882950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.883010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.883058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.883061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.883136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.883194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.883258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.883321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.883368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.883378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.883439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.883496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.883558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.883625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.883670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.883677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.883740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.883795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.883856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.883917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.883960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.883967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.884032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.884089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.884148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.884205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.884324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.884332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.884391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:34.884448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:34.884503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:34.884561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:34.884671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:34.884679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:34.884737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540745:4901], now have 1 active actors on pipe
2025-10-02T09:29:34.884972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:34.885017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:34.885021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:34.885023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554183093540745:4901]
2025-10-02T09:29:34.885046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0
2025-10-02T09:29:34.885187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0 is DEAD
2025-10-02T09:29:34.885321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:34.885335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Write session will restart in 0.009492s
2025-10-02T09:29:34.885355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Write session: Do CDS request
2025-10-02T09:29:34.885361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:34.885729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:34.896307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.896393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:34.896411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-10-02T09:29:34.897662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:34.897703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:34.897710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:34.897714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:34.898221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-10-02T09:29:34.898260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:34.898269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:34.898270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:34.898276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554183093540863:5258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:34.898727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554183093540863:5258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:34.901311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554183093540863:5258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:34.904149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554183093540863:5258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:34.904161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554183093540863:5258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:34.904163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554183093540863:5258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:34.904168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:34.905601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:34.908487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:34.908915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:34.908929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:34.908951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:34.909021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:34.909071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554183018019599:4633]
2025-10-02T09:29:34.909718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:34.910203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:34.910257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:34.910606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:34.910670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.910678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.910679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.910681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.910682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.910683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.910685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.910686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.910687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.910689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.910690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.910691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.910697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.910708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.910712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.910716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.910720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.910724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.910727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.910731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.910735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.910739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.910742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.910746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.910754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.910762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:34.910772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.910784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:34.910788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.910799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:34.910803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.910814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:34.910819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.910829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:34.910833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.910844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:34.910849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.910859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:34.910864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.910870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:34.910881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.910887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:34.910891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.910902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.910907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.910912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.910917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.910922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.910963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:34.920274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:34.922187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:34.922206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:34.922209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:34.922214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:34.922221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [2:7556554183018019599:4633]
2025-10-02T09:29:34.922237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:34.922254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:34.922257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.922260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.922261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.922278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:34.922283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:34.922290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:34.922354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.922369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.922371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.922375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:34.922377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:34.922443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:34.922451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.922465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:34.922472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:34.922487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:34.922516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.922526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.922529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.922543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:34.922557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093540751:2446], now have 1 active actors on pipe
2025-10-02T09:29:34.922563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:34.922566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:34.922567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093541031:5258], now have 1 active actors on pipe
2025-10-02T09:29:34.922568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:34.922571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:34.922581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:34.922584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:34.922621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.922636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:34.922671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:34.922629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 461
2025-10-02T09:29:34.922657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 461
2025-10-02T09:29:34.922726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.922739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.922761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:34.922768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:34.922771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:34.922773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:34.922782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:34.922791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:34.922806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.923001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.923012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.923028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:34.923117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 36 sessionId: src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0
2025-10-02T09:29:34.923444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16b504a-d8901ffc-d3084fb7-6ec74e96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:34.926041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Write session: try to update token
2025-10-02T09:29:34.926057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:34.935122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:34.935144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.935153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.935195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:34.935197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:34.935359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:34.935490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.935626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.935768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:34.935976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:34.936021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:34.941629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:34.943916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:34.944126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:34.944147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:34.944193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:34.944274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:34.946402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:34.946416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:34.946418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:34.946420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:34.946429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.946433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.946436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554183018019594:4633]
2025-10-02T09:29:34.946470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:34.946476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:34.946481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:34.946482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:34.946491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:34.946497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:34.946604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:34.985284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554183093541046:4901]
2025-10-02T09:29:34.985581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7556554183093541046:4901]
2025-10-02T09:29:35.083505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:35.090791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.090813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.090957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.091018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.091089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.091146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.091460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.091469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.091531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.091581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.091638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.091702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.091741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.091747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.091804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.091857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.091917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.091978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.092019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.092024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.092078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.092132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.092189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.092252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.092293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.092298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.092372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.092436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.092490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.092545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.092584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.092589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.092643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.092700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.092761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.092828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.092869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.092874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.092931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.092990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.093044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.093099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.093141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.093146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.093206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.093258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.093306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.093356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.093397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.093399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.093457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.093509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.093560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.093612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.093649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.093655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.093712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.093767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.093817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.093873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.093910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.093916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.093955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554183093541046:4901], now have 1 active actors on pipe
2025-10-02T09:29:35.094208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554183093541046:4901]
2025-10-02T09:29:35.094223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:35.094226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:35.094250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:35.094250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0
2025-10-02T09:29:35.094379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0 is DEAD
2025-10-02T09:29:35.094498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:35.094562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:35.094575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Write session will restart in 0.009291s
2025-10-02T09:29:35.094597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Write session: Do CDS request
2025-10-02T09:29:35.094604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:35.105273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.105389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:35.105404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-10-02T09:29:35.105823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.105863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:35.105871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:35.105877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:35.106279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-10-02T09:29:35.106314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:35.106320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:35.106322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:35.106327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554187388508463:5262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:35.106817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554187388508463:5262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:35.109664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554187388508463:5262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:35.112256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554187388508463:5262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:35.112270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554187388508463:5262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:35.112273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554187388508463:5262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:35.112279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:35.112382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:35.114913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:35.115079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:35.115089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:35.115098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:35.115156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:35.115191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554187312987184:4635]
2025-10-02T09:29:35.115769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:35.116033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:35.116073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:35.116362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:35.116417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.116422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.116423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.116424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.116425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.116426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.116427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.116428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.116429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.116430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.116432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.116433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.116437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.116447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.116451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.116455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.116458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.116462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.116465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.116469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.116472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.116476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.116478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.116480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.116485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.116492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.116497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.116502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.116506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.116512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.116516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.116520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.116525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.116530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.116534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.116543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.116546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.116549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.116551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.116554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.116556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.116559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.116562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.116567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.116572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.116576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.116583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.116588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.116612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:35.125093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:35.126722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:35.126739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:35.126742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:35.126746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:35.126753Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [2:7556554187312987184:4635]
2025-10-02T09:29:35.126766Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:35.126783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:35.126791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.126793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.126796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.126810Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:35.126819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:35.126825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:35.126877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.126884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.126886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.126889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:35.126892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:35.126958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:35.126965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.126978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.126988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.127006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:35.127026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.127033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.127035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.127046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:35.127064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508628:5262], now have 1 active actors on pipe
2025-10-02T09:29:35.127066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:35.127076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:35.127078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:35.127081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508345:2446], now have 1 active actors on pipe
2025-10-02T09:29:35.127089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:35.127102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:35.127107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:35.127138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.127145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:35.127150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:35.127116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 462
2025-10-02T09:29:35.127139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 462
2025-10-02T09:29:35.127174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.127182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.127204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:35.127214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.127218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.127220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:35.127228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.127241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:35.127251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.127382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.127390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.127403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.127477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 36 sessionId: src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0
2025-10-02T09:29:35.127786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eaa3838-682fd0a5-f5c1cb49-f3a4537f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:35.130154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Write session: try to update token
2025-10-02T09:29:35.130169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:35.137352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:35.137369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.137371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:35.137373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:35.137381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.137385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.137388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554187312987178:4635]
2025-10-02T09:29:35.137421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:35.137427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.137429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:35.137434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:35.137439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:35.137443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:35.137557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:35.141971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:35.144109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:35.194161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554187388508643:4901]
2025-10-02T09:29:35.194425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7556554187388508643:4901]
2025-10-02T09:29:35.264781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:35.264953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.264964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.264986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508643:4901], now have 1 active actors on pipe
2025-10-02T09:29:35.265149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:35.265187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:35.265189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:35.265231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0
2025-10-02T09:29:35.265392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0 is DEAD
2025-10-02T09:29:35.265552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:35.265547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554187388508643:4901]
2025-10-02T09:29:35.265569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Write session will restart in 0.005016s
2025-10-02T09:29:35.265596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Write session: Do CDS request
2025-10-02T09:29:35.265604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:35.265638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:35.271259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.271362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:35.271375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-10-02T09:29:35.271489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.271515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:35.271522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:35.271526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:35.271903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-10-02T09:29:35.271948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:35.271954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:35.271955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:35.271960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554187388508684:5273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:35.272416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554187388508684:5273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:35.274957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554187388508684:5273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:35.278286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554187388508684:5273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:35.278301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554187388508684:5273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:35.278305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554187388508684:5273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:35.278310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:35.282802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:35.286125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:35.286318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:35.286328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:35.286338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:35.286398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:35.286434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554187312987506:4648]
2025-10-02T09:29:35.287006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:35.287327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:35.287376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:35.287690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:35.287764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.287769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.287770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.287771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.287772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.287773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.287774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.287775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.287776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.287776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.287777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.287778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.287784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.287793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.287797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.287801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.287804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.287807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.287811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.287814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.287817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.287821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.287824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.287826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.287834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.287841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.287846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.287864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.287873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.287878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.287882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.287886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.287891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.287895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.287899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.287904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.287908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.287913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.287919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.287924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.287933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.287938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.287941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.287947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.287952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.287960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.287965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.287969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.288007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:35.296337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:35.297991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:35.298004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:35.298006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:35.298009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:35.298016Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [2:7556554187312987506:4648]
2025-10-02T09:29:35.298027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:35.298041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:35.298043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.298045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.298047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.298069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:35.298078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:35.298085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:35.298134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.298140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.298142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.298145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:35.298147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:35.298191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:35.298198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.298206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.298212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.298224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:35.298240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.298244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.298245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.298251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:35.298262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508838:5273], now have 1 active actors on pipe
2025-10-02T09:29:35.298262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:35.298265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:35.298266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508661:2446], now have 1 active actors on pipe
2025-10-02T09:29:35.298266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:35.298272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:35.298285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:35.298292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:35.298317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.298323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:35.298302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 463
2025-10-02T09:29:35.298332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:35.298306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 463
2025-10-02T09:29:35.298349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.298356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.298380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:35.298388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.298391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.298393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:35.298400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.298407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:35.298421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.298541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.298546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.298554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.298605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 36 sessionId: src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0
2025-10-02T09:29:35.298921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2129656c-9d63754c-9c49cdd5-93d332e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:35.301417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Write session: try to update token
2025-10-02T09:29:35.301433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:35.308056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:35.308072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.308078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.308110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:35.308112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:35.308273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:35.308398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:35.308518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:35.308649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:35.308897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:35.308927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:35.313638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:35.315776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:35.315946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.315962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.315986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:35.316042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:35.317114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:35.317126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.317129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:35.317131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:35.317139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.317142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.317146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554187312987501:4648]
2025-10-02T09:29:35.317176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:35.317181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.317184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:35.317195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:35.317201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:35.317205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:35.317306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:35.350828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:29:35.350850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-02T09:29:35.365675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554187388508967:4901]
2025-10-02T09:29:35.365909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7556554187388508967:4901]
2025-10-02T09:29:35.451637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:35.457961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.457978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.458103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.458152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.458205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.458255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.458294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.458301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.458356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.458405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.458469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.458520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.458557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.458562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.458616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.458667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.458721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.458773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.458811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.458816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.458867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.458916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.458968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.459019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.459060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.459065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.459127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.459175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.459227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.459278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.459313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.459318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.459373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.459423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.459474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.459525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.459562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.459567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.459616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.459663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.459718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.459770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.459808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.459813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.459865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.459915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.459965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.460014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.460050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.460055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.460104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.460150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.460202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.460251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.460286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.460293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.460343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.460390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.460438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.460487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.460523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.460528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.460584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508967:4901], now have 1 active actors on pipe
2025-10-02T09:29:35.460836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:35.460847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:35.460846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:35.460859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-02T09:29:35.460868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0
2025-10-02T09:29:35.460889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554187388508967:4901]
2025-10-02T09:29:35.461000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0 is DEAD
2025-10-02T09:29:35.461137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:35.461147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Write session will restart in 0.005746s
2025-10-02T09:29:35.461167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Write session: Do CDS request
2025-10-02T09:29:35.461172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:35.461328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:35.468159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.468309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:35.468319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-10-02T09:29:35.468430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.468460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:35.468466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:35.468469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:35.468757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-10-02T09:29:35.468786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:35.468791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:35.468793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:35.468798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554187388509026:5279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:35.469182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554187388509026:5279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:35.471153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554187388509026:5279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:35.473670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554187388509026:5279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:35.473678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554187388509026:5279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:35.473680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554187388509026:5279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:35.473691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:35.476366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:35.479118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:35.479255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:35.479264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:35.479271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:35.479305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:35.479329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554187312987817:4654]
2025-10-02T09:29:35.479693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:35.479981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:35.480007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:35.480191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:35.480221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.480225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.480226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.480226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.480227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.480227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.480228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.480229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.480230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.480230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.480231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.480232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.480234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.480241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.480243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.480245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.480248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.480250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.480252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.480254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.480256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.480258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.480260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.480262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.480266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.480269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.480273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.480276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.480278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.480282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.480284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.480287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.480290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.480292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.480295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.480297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.480299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.480302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.480304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.480307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.480309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.480312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.480314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.480316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.480320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.480323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.480325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.480327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.480344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:35.488383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:35.489775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:35.489786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:35.489788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:35.489790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:35.489795Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [2:7556554187312987817:4654]
2025-10-02T09:29:35.489805Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:35.489817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:35.489819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.489821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.489822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.489833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:35.489836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:35.489840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:35.489874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.489875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.489876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.489878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:35.489879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:35.489933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:35.489940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.489951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.489960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.489974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:35.489993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388508981:2446], now have 1 active actors on pipe
2025-10-02T09:29:35.490002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509194:5279], now have 1 active actors on pipe
2025-10-02T09:29:35.490007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.490011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.490012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.490020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:35.490033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:35.490035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:35.490037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:35.490039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:35.490050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:35.490053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:35.490078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.490085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:35.490068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 464
2025-10-02T09:29:35.490105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:35.490110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.490114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.490133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:35.490143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.490147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.490149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:35.490156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.490167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:35.490180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.490186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 464
2025-10-02T09:29:35.490254Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:29:35.490324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.490330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.490341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.490406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:29:35.490415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 36 sessionId: src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0
2025-10-02T09:29:35.490434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:29:35.490721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a044957a-5c42b6c4-9177fad4-dd7617e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:35.493238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Write session: try to update token
2025-10-02T09:29:35.493255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:35.500027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:35.500042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.500044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:35.500045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:35.500051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.500054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.500056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554187312987812:4654]
2025-10-02T09:29:35.500086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:35.500091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.500093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:35.500106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:35.500110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:35.500114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:35.500237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:35.505716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:35.507879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:35.561262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554187388509283:4901]
2025-10-02T09:29:35.561493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7556554187388509283:4901]
2025-10-02T09:29:35.624322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:35.624928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.624939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.624966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509283:4901], now have 1 active actors on pipe
2025-10-02T09:29:35.625134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:35.625157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:35.625197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554187388509283:4901]
2025-10-02T09:29:35.625198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:35.625257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0
2025-10-02T09:29:35.625395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0 is DEAD
2025-10-02T09:29:35.625560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:35.625573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Write session will restart in 0.005001s
2025-10-02T09:29:35.625595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Write session: Do CDS request
2025-10-02T09:29:35.625601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:35.631152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.631263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:35.631276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-10-02T09:29:35.631425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.631452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:35.631461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:35.631465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:35.631885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-10-02T09:29:35.631918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:35.631921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:35.631923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:35.631927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554187388509310:5283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:35.632385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554187388509310:5283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:35.634761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554187388509310:5283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:35.637538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554187388509310:5283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:35.637550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554187388509310:5283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:35.637553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554187388509310:5283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:35.637560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:35.642734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:35.645197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:35.645321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:35.645327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:35.645333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:35.645364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:35.645389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554187312988110:4657]
2025-10-02T09:29:35.645773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:35.646011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:35.646050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:35.646337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:35.646398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.646403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.646404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.646405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.646406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.646407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.646408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.646409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.646410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.646411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.646413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.646414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.646418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.646429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.646433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.646437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.646441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.646444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.646448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.646451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.646455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.646459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.646462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.646466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.646472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.646477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.646482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.646485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.646488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.646490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.646492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.646496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.646498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.646501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.646503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.646506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.646508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.646511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.646513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.646516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.646518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.646521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.646525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.646528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.646530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.646533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.646535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.646538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.646556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:35.654992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:35.656495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:35.656512Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:35.656513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:35.656516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:35.656521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [2:7556554187312988110:4657]
2025-10-02T09:29:35.656531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:35.656544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:35.656547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.656550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.656552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.656566Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:35.656571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:35.656578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:35.656627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.656634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.656635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.656638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:35.656639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:35.656686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:35.656691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.656699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.656705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.656714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:35.656731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509287:2446], now have 1 active actors on pipe
2025-10-02T09:29:35.656737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509453:5283], now have 1 active actors on pipe
2025-10-02T09:29:35.656741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.656742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.656744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.656751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:35.656757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:35.656762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:35.656764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:35.656765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:35.656771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:35.656773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:35.656798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.656822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:35.656827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:35.656798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 465
2025-10-02T09:29:35.656857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 465
2025-10-02T09:29:35.656882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.656891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.656910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:35.656920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.656924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.656926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:35.656935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.656948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:35.656960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.657092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.657099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.657109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.657203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0
2025-10-02T09:29:35.657544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ba2aa3-e6f89297-a67353d5-6efaf2a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:35.660094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Write session: try to update token
2025-10-02T09:29:35.660110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:35.667147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:35.667163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.667172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.667207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:35.667212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:35.667367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:35.667499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:35.667661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:35.667817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:35.667995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:35.668025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:35.672618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:35.674970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:35.675141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.675160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.675191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:35.675279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:35.676737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:35.676756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.676759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:35.676760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:35.676768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.676772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.676775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554187312988105:4657]
2025-10-02T09:29:35.676816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:35.676824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:35.676827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:35.676831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:35.676831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.676833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:35.676959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:35.725115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554187388509587:4901]
2025-10-02T09:29:35.725372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7556554187388509587:4901]
2025-10-02T09:29:35.822644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:35.829176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.829196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.829328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.829383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.829437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.829491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.829531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.829538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.829593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.829643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.829696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.829751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.829789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.829795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.829849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.829898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.829951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.830003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.830044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.830049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.830104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.830181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.830232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.830285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.830324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.830329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.830385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.830438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.830490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.830540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.830578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.830583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.830640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.830691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.830744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.830798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.830840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.830845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.830898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.830948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.831003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.831056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.831102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.831107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.831159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.831209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.831258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.831309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.831361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.831366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.831417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.831465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.831518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.831570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.831607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.831612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.831662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:35.831708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:35.831758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:35.831809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:35.831846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:35.831851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:35.831885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509587:4901], now have 1 active actors on pipe
2025-10-02T09:29:35.832128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:35.832134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554187388509587:4901]
2025-10-02T09:29:35.832340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:35.832347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:35.832366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: error at write: Disconnected sessionId: src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0
2025-10-02T09:29:35.832503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0 is DEAD
2025-10-02T09:29:35.832617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:35.832632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:35.832643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Write session will restart in 0.005883s
2025-10-02T09:29:35.832664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Write session: Do CDS request
2025-10-02T09:29:35.832671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:35.839189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.839266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:35.839286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-10-02T09:29:35.839375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:35.839401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:35.839408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:35.839413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:35.839824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-10-02T09:29:35.839851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:35.839855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:35.839857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:35.839861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554187388509626:5288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:35.840330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554187388509626:5288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:35.842915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554187388509626:5288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:35.845629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554187388509626:5288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:35.845638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554187388509626:5288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:35.845640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554187388509626:5288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:35.845645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:35.849191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:35.851670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:35.851787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:35.851794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:35.851800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:35.851840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:35.851868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554187312988406:4660]
2025-10-02T09:29:35.852236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:35.852435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:35.852458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:35.852656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:35.852692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.852696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.852698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.852698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.852699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.852700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.852701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.852701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.852702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.852702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.852705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.852713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.852715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.852717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.852719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.852721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.852723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.852725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.852727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.852730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.852732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.852738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.852742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:35.852745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.852748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:35.852751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.852754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:35.852756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.852759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:35.852762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.852765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:35.852767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.852770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:35.852772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.852775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:35.852777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.852780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:35.852782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.852785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:35.852788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.852791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.852793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.852796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.852798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.852811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.852828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:35.861138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:35.862849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:35.862866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:35.862868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:35.862872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:35.862877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [2:7556554187312988406:4660]
2025-10-02T09:29:35.862890Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:35.862908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:35.862910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.862913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.862915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.862927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:35.862932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:35.862947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:35.862987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.862993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.862994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.862996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:35.862998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:35.863042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:35.863047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.863055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:35.863061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:35.863082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:35.863096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.863100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.863101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.863106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:35.863115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:35.863117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:35.863120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:35.863122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:35.863123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:35.863124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:35.863131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509789:5288], now have 1 active actors on pipe
2025-10-02T09:29:35.863134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509597:2446], now have 1 active actors on pipe
2025-10-02T09:29:35.863157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.863165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:35.863172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:35.863202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 466
2025-10-02T09:29:35.863204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 466
2025-10-02T09:29:35.863274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.863282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.863301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abae46f0-61af70af-919a05f0-20adfe4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:35.863306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:35.863308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:35.863309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:35.863316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:35.863323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:35.863337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.863459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:35.863465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:35.863473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:35.863540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 36 sessionId: src_id|abae46f0-61af70af-919a05f0-20adfe4f_0
2025-10-02T09:29:35.863850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e7da3c-df1b43ef-5e47c25e-667f2fce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abae46f0-61af70af-919a05f0-20adfe4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:35.866177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Write session: try to update token
2025-10-02T09:29:35.866191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:35.874035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:35.874051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:35.874054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:35.874056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:35.874063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.874067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.874071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554187312988401:4660]
2025-10-02T09:29:35.874105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:35.874114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:35.874116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:35.874252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:35.874395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:35.874409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:35.874413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:35.878959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|abae46f0-61af70af-919a05f0-20adfe4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:35.881464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:35.932471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554187388509898:4901]
2025-10-02T09:29:35.932761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7556554187388509898:4901]
2025-10-02T09:29:36.003042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:36.003489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.003500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.003531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554187388509898:4901], now have 1 active actors on pipe
2025-10-02T09:29:36.003722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:36.004915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554187388509898:4901]
2025-10-02T09:29:36.004940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:36.004941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:36.005005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abae46f0-61af70af-919a05f0-20adfe4f_0
2025-10-02T09:29:36.005191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|abae46f0-61af70af-919a05f0-20adfe4f_0 is DEAD
2025-10-02T09:29:36.005318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:36.005326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Write session will restart in 0.007799s
2025-10-02T09:29:36.005344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Write session: Do CDS request
2025-10-02T09:29:36.005348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:36.014272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.014424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:36.014437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-10-02T09:29:36.015021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.015079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:36.015089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:36.015095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:36.015510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-10-02T09:29:36.015546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:36.015552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:36.015554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:36.015560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554191683477221:5292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:36.016098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554191683477221:5292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:36.020328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554191683477221:5292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:36.023932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554191683477221:5292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:36.023949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554191683477221:5292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:36.023952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554191683477221:5292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:36.023959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:36.028175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:36.031300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:36.031497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:36.031501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:36.031511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:36.031569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:36.031608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554191607955996:4662]
2025-10-02T09:29:36.032172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:36.032542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:36.032608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:36.032947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:36.033015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.033021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.033022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.033022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.033023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.033024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.033024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.033025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.033026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.033027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.033027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.033028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.033032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.033039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.033042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.033044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.033046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.033049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.033051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.033053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.033056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.033058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.033060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.033062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.033068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.033073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.033078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.033081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.033083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.033086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.033089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.033092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.033094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.033098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.033101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.033113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.033116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.033119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.033122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.033124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.033127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.033131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.033133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.033136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.033138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.033141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.033144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.033147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.033166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:36.042068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:36.043666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:36.043683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:36.043686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:36.043689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:36.043694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [2:7556554191607955996:4662]
2025-10-02T09:29:36.043704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:36.043717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:36.043718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.043720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.043722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.043732Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:36.043736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:36.043742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:36.043794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.043805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.043807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.043810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:36.043812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:36.043870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:36.043878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.043889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.043899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.043914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:36.043931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477196:2446], now have 1 active actors on pipe
2025-10-02T09:29:36.043939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477413:5292], now have 1 active actors on pipe
2025-10-02T09:29:36.043945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.043947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.043949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.043959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:36.043969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:36.043973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:36.043977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:36.043979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:36.043985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:36.043988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:36.044022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.044030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:36.044038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:36.044009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 467
2025-10-02T09:29:36.044067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.044010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 467
2025-10-02T09:29:36.044076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.044109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:36.044120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.044123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.044125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:36.044134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.044143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:36.044154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.044506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.044517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.044536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.044647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0
2025-10-02T09:29:36.044982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abae46f0-61af70af-919a05f0-20adfe4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:36.047650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Write session: try to update token
2025-10-02T09:29:36.047666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:36.054637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:36.054659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.054661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:36.054663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:36.054671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.054675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.054679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554191607955991:4662]
2025-10-02T09:29:36.054716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:36.054721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.054724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:36.054848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:36.055976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:36.055990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:36.055994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:36.060326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:36.062655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:36.105326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554191683477498:4901]
2025-10-02T09:29:36.105623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7556554191683477498:4901]
2025-10-02T09:29:36.196050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:36.196677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.196690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.196708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477498:4901], now have 1 active actors on pipe
2025-10-02T09:29:36.196953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:36.197240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:36.197293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554191683477498:4901]
2025-10-02T09:29:36.197314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:36.197372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0
2025-10-02T09:29:36.197595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0 is DEAD
2025-10-02T09:29:36.197670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:36.197681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Write session will restart in 0.006809s
2025-10-02T09:29:36.197704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Write session: Do CDS request
2025-10-02T09:29:36.197711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:36.205229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.205281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:36.205297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-10-02T09:29:36.205444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.205482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:36.205490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:36.205494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:36.207750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-10-02T09:29:36.207798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:36.207803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:36.207805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:36.207810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554191683477535:5297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:36.208272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554191683477535:5297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:36.212861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554191683477535:5297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:36.218652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554191683477535:5297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:36.218668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554191683477535:5297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:36.218671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554191683477535:5297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:36.218678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:36.224061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:36.226854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:36.227019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:36.227029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:36.227037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:36.227091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:36.227127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554191607956294:4665]
2025-10-02T09:29:36.227642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:36.227922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:36.227956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:36.228208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:36.228253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.228257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.228258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.228259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.228260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.228261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.228262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.228262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.228264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.228265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.228265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.228266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.228271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.228280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.228283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.228286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.228289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.228293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.228295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.228298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.228301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.228305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.228308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.228311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.228322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.228328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.228333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.228337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.228341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.228345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.228348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.228352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.228355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.228359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.228362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.228366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.228370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.228375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.228378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.228382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.228386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.228392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.228396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.228400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.228404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.228407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.228412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.228439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:36.237330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:36.239000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:36.239018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:36.239020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:36.239024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:36.239031Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [2:7556554191607956294:4665]
2025-10-02T09:29:36.239044Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:36.239063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:36.239065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.239082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.239084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.239099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:36.239104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:36.239110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:36.239166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.239167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.239169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.239172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:36.239174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:36.239240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:36.239243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.239254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.239263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.239278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:36.239296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477685:5297], now have 1 active actors on pipe
2025-10-02T09:29:36.239300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477503:2446], now have 1 active actors on pipe
2025-10-02T09:29:36.239306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.239308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.239310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.239322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:36.239334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:36.239341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:36.239343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:36.239346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:36.239354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:36.239357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:36.239386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 468
2025-10-02T09:29:36.239386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 468
2025-10-02T09:29:36.239392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.239399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:36.239429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:36.239596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.239609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.239632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:36.239638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.239641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.239644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:36.239654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.239663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:36.239675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.239864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.239878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.239894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.239975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 36 sessionId: src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0
2025-10-02T09:29:36.240353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff56b2e-bb999648-83cb5bd7-90df5d6d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:36.244074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Write session: try to update token
2025-10-02T09:29:36.244101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:36.250603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:36.250620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.250623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:36.250625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:36.250633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.250637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.250641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554191607956289:4665]
2025-10-02T09:29:36.250679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:36.250689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.250691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:36.250832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:36.250963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:36.250980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:36.250984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:36.267850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:36.270455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:36.297612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554191683477806:4901]
2025-10-02T09:29:36.300882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7556554191683477806:4901]
2025-10-02T09:29:36.390158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:36.390384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.390393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.390406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477806:4901], now have 1 active actors on pipe
2025-10-02T09:29:36.390582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:36.390636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:36.390655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:36.390683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554191683477806:4901]
2025-10-02T09:29:36.390703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:36.390715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: error at write: Disconnected sessionId: src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0
2025-10-02T09:29:36.390893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0 is DEAD
2025-10-02T09:29:36.391032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:36.391043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Write session will restart in 0.007935s
2025-10-02T09:29:36.391075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Write session: Do CDS request
2025-10-02T09:29:36.391081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:36.400191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.400383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:36.400399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-10-02T09:29:36.400608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.400637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:36.400646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:36.400649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:36.401163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-10-02T09:29:36.401201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:36.401203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:36.401204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:36.401209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554191683477920:5308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:36.401710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554191683477920:5308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:36.404075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554191683477920:5308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:36.406734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554191683477920:5308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:36.406746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554191683477920:5308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:36.406750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554191683477920:5308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:36.406756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:36.407753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:36.410463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:36.410660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:36.410669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:36.410679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:36.410728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:36.410757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554191607956627:4679]
2025-10-02T09:29:36.411127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:36.411343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:36.411374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:36.411564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:36.411593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.411597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.411598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.411598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.411599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.411599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.411600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.411601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.411601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.411602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.411602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.411603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.411606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.411613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.411615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.411617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.411619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.411622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.411624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.411626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.411628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.411630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.411632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.411634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.411638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.411642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.411646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.411649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.411651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.411654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.411657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.411660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.411662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.411665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.411667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.411670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.411673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.411675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.411677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.411680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.411683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.411687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.411689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.411692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.411695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.411698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.411700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.411703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.411720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:36.419914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:36.421672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:36.421683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:36.421684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:36.421686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:36.421692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [2:7556554191607956627:4679]
2025-10-02T09:29:36.421701Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:36.421713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:36.421714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.421716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.421717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.421727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:36.421730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:36.421735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:36.421783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.421789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.421792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.421795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:36.421797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:36.421841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:36.421846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.421856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.421869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.421882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:36.421902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.421909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.421910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.421918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:36.421928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:36.421929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:36.421937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:36.421939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:36.421942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:36.421944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:36.421952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478117:5308], now have 1 active actors on pipe
2025-10-02T09:29:36.421958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683477831:2446], now have 1 active actors on pipe
2025-10-02T09:29:36.421976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.421984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:36.421999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:36.422018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 469
2025-10-02T09:29:36.422052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.422060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.422061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 469
2025-10-02T09:29:36.422078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:36.422088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.422095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.422097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:36.422107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.422118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:36.422138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.422287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.422296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.422309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.422399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 36 sessionId: src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0
2025-10-02T09:29:36.422738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbed08d-5afc5ece-603ad0c3-89e2972b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:36.425230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Write session: try to update token
2025-10-02T09:29:36.425241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:36.431897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:36.431913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.431915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:36.431916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:36.431925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.431928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.431934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554191607956622:4679]
2025-10-02T09:29:36.431965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:36.431971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.431973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:36.431981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:36.431987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:36.431990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:36.432717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:36.437093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:36.439288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:36.491055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554191683478143:4901]
2025-10-02T09:29:36.491313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7556554191683478143:4901]
2025-10-02T09:29:36.568522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:36.568951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.568961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.568994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478143:4901], now have 1 active actors on pipe
2025-10-02T09:29:36.569192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:36.569253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554191683478143:4901]
2025-10-02T09:29:36.569268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:36.569287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:36.569347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0
2025-10-02T09:29:36.569511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0 is DEAD
2025-10-02T09:29:36.569666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:36.569677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Write session will restart in 0.007834s
2025-10-02T09:29:36.569699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Write session: Do CDS request
2025-10-02T09:29:36.569707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:36.578260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.578392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:36.578405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-10-02T09:29:36.578509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.578549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:36.578557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:36.578561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:36.579102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-10-02T09:29:36.579140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:36.579146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:36.579147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:36.579153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554191683478188:5315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:36.579743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554191683478188:5315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:36.583292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554191683478188:5315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:36.586764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554191683478188:5315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:36.586781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554191683478188:5315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:36.586784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554191683478188:5315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:36.586790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:36.591802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:36.595392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:36.595590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:36.595602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:36.595615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:36.595681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:36.595722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554191607956936:4682]
2025-10-02T09:29:36.596353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:36.596700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:36.596754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:36.597088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:36.597130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.597135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.597136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.597137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.597137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.597138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.597139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.597140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.597140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.597141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.597141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.597142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.597145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.597152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.597155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.597157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.597160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.597163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.597165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.597168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.597171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.597173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.597176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.597178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.597183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.597188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.597192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.597195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.597198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.597201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.597204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.597207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.597210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.597213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.597216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.597219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.597222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.597225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.597227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.597230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.597233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.597237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.597239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.597242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.597245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.597248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.597252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.597255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.597276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:36.608331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:36.610247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:36.610261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:36.610263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:36.610265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:36.610270Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [2:7556554191607956936:4682]
2025-10-02T09:29:36.610280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:36.610292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:36.610294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.610296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.610297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.610309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:36.610312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:36.610317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:36.610356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.610362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.610363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.610365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:36.610367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:36.610413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:36.610419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.610426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.610432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.610440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:36.610451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.610458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.610459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.610467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:36.610477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:36.610482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:36.610485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:36.610487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:36.610491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:36.610493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:36.610526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478149:2446], now have 1 active actors on pipe
2025-10-02T09:29:36.610529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478351:5315], now have 1 active actors on pipe
2025-10-02T09:29:36.610531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.610541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:36.610559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:36.610616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 470
2025-10-02T09:29:36.610628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 470
2025-10-02T09:29:36.610678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.610686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.610707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:36.610719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.610722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.610724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:36.610733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.610741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:36.610750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.610868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.610876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.610887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.610963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0
2025-10-02T09:29:36.611303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32fee3-e7f0081-77ab2f67-bee71c00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:36.617018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Write session: try to update token
2025-10-02T09:29:36.617035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:36.625615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:36.625631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.625637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.625674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:36.625697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:36.625833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:36.625962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:36.626084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:36.626212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:36.626381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:36.626412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:36.629883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:36.631929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:36.631942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.631943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:36.631945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:36.631950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.631953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.631955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554191607956931:4682]
2025-10-02T09:29:36.631979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:36.631983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.631984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:36.632012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:36.632024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:36.632028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:36.632092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:36.636254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:36.669213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554191683478467:4901]
2025-10-02T09:29:36.669458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7556554191683478467:4901]
2025-10-02T09:29:36.759835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:36.760341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.760354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.760369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478467:4901], now have 1 active actors on pipe
2025-10-02T09:29:36.760542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554191683478467:4901]
2025-10-02T09:29:36.760552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:36.760571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:36.760574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:36.760623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: error at write: Disconnected sessionId: src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0
2025-10-02T09:29:36.760633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:36.760782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0 is DEAD
2025-10-02T09:29:36.760936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:36.760946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Write session will restart in 0.005625s
2025-10-02T09:29:36.760962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Write session: Do CDS request
2025-10-02T09:29:36.760966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:36.767156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.767298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:36.767312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-10-02T09:29:36.767414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.767445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:36.767450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:36.767455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:36.767785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-10-02T09:29:36.767807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:36.767811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:36.767812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:36.767815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554191683478489:5320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:36.768198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554191683478489:5320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:36.771448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554191683478489:5320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:36.774808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554191683478489:5320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:36.774820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554191683478489:5320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:36.774823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554191683478489:5320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:36.774828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:36.780862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:36.783714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:36.783874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:36.783882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:36.783890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:36.783931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:36.783961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554191607957234:4684]
2025-10-02T09:29:36.784463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:36.784746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:36.784781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:36.785061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:36.785105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.785110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.785111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.785112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.785113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.785114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.785115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.785116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.785117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.785118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.785119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.785120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.785124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.785134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.785137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.785140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.785143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.785147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.785150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.785153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.785160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.785164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.785171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.785174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.785179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.785189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.785197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.785205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.785213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.785217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.785225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.785233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.785240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.785244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.785252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.785256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.785260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.785268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.785275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.785279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.785285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.785289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.785292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.785296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.785300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.785308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.785314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.785319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.785352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:36.793734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:36.795497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:36.795512Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:36.795515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:36.795519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:36.795525Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [2:7556554191607957234:4684]
2025-10-02T09:29:36.795540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:36.795555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:36.795563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.795566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.795568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.795581Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:36.795586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:36.795597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:36.795655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.795662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.795664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.795667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:36.795670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:36.795729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:36.795737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.795749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.795764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.795783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:36.795805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478638:5320], now have 1 active actors on pipe
2025-10-02T09:29:36.795815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.795821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.795824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.795835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:36.795847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478474:2446], now have 1 active actors on pipe
2025-10-02T09:29:36.795854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:36.795858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:36.795859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:36.795867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:36.795872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:36.795875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:36.795902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.795910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:36.795916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:36.795900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 471
2025-10-02T09:29:36.795900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 471
2025-10-02T09:29:36.795939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.795947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.795971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fab988c-ec956c72-99983c46-c618f50b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:36.795980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.795984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.795989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:36.795999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.796010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:36.796025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.796176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.796186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.796199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.796270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 36 sessionId: src_id|8fab988c-ec956c72-99983c46-c618f50b_0
2025-10-02T09:29:36.796598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e8586b-c35565fe-fe10ef62-2a845902_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8fab988c-ec956c72-99983c46-c618f50b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:36.799059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Write session: try to update token
2025-10-02T09:29:36.799085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:36.806647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:36.806666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.806668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:36.806670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:36.806677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.806684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.806687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554191607957229:4684]
2025-10-02T09:29:36.806719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:36.806725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.806727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:36.806729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:36.806735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:36.806738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:36.806852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:36.811253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|8fab988c-ec956c72-99983c46-c618f50b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:36.814748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:36.860752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554191683478785:4901]
2025-10-02T09:29:36.861044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7556554191683478785:4901]
2025-10-02T09:29:36.946213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:36.946851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554191683478785:4901]
2025-10-02T09:29:36.946868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:36.946872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:36.946878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:36.946499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.946513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.946530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478785:4901], now have 1 active actors on pipe
2025-10-02T09:29:36.946859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:36.947425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:36.947435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Write session will restart in 0.005198s
2025-10-02T09:29:36.947455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Write session: Do CDS request
2025-10-02T09:29:36.947461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:36.946933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: error at write: Disconnected sessionId: src_id|8fab988c-ec956c72-99983c46-c618f50b_0
2025-10-02T09:29:36.947123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|8fab988c-ec956c72-99983c46-c618f50b_0 is DEAD
2025-10-02T09:29:36.954315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.954360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:36.954373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-10-02T09:29:36.954572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:36.954606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:36.954615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:36.954618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:36.954994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-10-02T09:29:36.955025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:36.955031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:36.955033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:36.955037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554191683478803:5324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:36.955535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554191683478803:5324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:36.957355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554191683478803:5324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:36.960064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554191683478803:5324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:36.960075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554191683478803:5324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:36.960079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554191683478803:5324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:36.960093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:36.969781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:36.972592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:36.972768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:36.972784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:36.972794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:36.972855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:36.972890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554191607957535:4687]
2025-10-02T09:29:36.973454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:36.973756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:36.973801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:36.974083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:36.974160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.974166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.974167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.974168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.974169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.974170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.974171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.974172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.974173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.974174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.974175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.974176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.974180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.974190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.974194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.974197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.974201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.974204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.974208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.974211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.974215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.974219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.974223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.974226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.974233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.974239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:36.974244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.974249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:36.974252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.974257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:36.974262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.974267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:36.974271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.974275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:36.974279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.974284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:36.974288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.974298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:36.974302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.974306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:36.974310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.974314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:36.974318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.974322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.974327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.974332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.974338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.974341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.974374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:36.983485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:36.985275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:36.985297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:36.985300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:36.985303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:36.985310Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [2:7556554191607957535:4687]
2025-10-02T09:29:36.985333Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:36.985351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:36.985354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.985357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.985359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.985374Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:36.985379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:36.985386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:36.985440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.985449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.985450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.985452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:36.985454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:36.985518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:36.985527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.985541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:36.985557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:36.985578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:36.985600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478884:5324], now have 1 active actors on pipe
2025-10-02T09:29:36.985610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554191683478787:2446], now have 1 active actors on pipe
2025-10-02T09:29:36.985616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.985619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.985621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.985633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:36.985645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:36.985647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:36.985653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:36.985656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:36.985660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:36.985663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:36.985699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.985688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 472
2025-10-02T09:29:36.985708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:36.985693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 472
2025-10-02T09:29:36.985725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:36.985754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.985762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.985786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|305503fd-d9c3696c-66fd9674-36309c14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:36.985797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:36.985800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:36.985802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:36.985811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:36.985823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:36.985838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.985959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:36.985967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:36.985978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:36.986062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 36 sessionId: src_id|305503fd-d9c3696c-66fd9674-36309c14_0
2025-10-02T09:29:36.986407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fab988c-ec956c72-99983c46-c618f50b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|305503fd-d9c3696c-66fd9674-36309c14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:36.989092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Write session: try to update token
2025-10-02T09:29:36.989111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:36.997731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:36.997750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:36.997752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:36.997754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:36.997762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.997766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.997770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554191607957530:4687]
2025-10-02T09:29:36.997803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:36.997809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:36.997811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:36.997818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:36.997824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:36.997828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:36.997946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:37.002614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|305503fd-d9c3696c-66fd9674-36309c14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:37.005226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:37.047119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554195978446390:4901]
2025-10-02T09:29:37.047402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7556554195978446390:4901]
2025-10-02T09:29:37.129665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:37.130353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.130366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.130394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978446390:4901], now have 1 active actors on pipe
2025-10-02T09:29:37.130626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:37.130637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:37.130654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554195978446390:4901]
2025-10-02T09:29:37.130681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:37.130685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: error at write: Disconnected sessionId: src_id|305503fd-d9c3696c-66fd9674-36309c14_0
2025-10-02T09:29:37.130826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|305503fd-d9c3696c-66fd9674-36309c14_0 is DEAD
2025-10-02T09:29:37.130842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:37.130950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:37.130960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Write session will restart in 0.008694s
2025-10-02T09:29:37.130994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Write session: Do CDS request
2025-10-02T09:29:37.131000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:37.141242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.141350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:37.141361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-10-02T09:29:37.141464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.141494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:37.141497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:37.141500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:37.141912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-10-02T09:29:37.141949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:37.141956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:37.141960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:37.141964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554195978446519:5329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:37.142449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554195978446519:5329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:37.144231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554195978446519:5329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:37.146405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554195978446519:5329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:37.146417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554195978446519:5329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:37.146420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554195978446519:5329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:37.146426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:37.149186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:37.149486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:37.149617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:37.149626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:37.149634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:37.149671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:37.149703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554195902925133:4690]
2025-10-02T09:29:37.150188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:37.150733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:37.150785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:37.150989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:37.151019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.151023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.151023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.151024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.151025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.151026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.151026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.151027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.151027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.151028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.151028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.151029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.151032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.151038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.151040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.151042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.151044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.151046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.151049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.151051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.151053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.151055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.151057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.151059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.151063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.151076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.151080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.151083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.151085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.151088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.151090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.151093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.151096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.151098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.151100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.151103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.151105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.151108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.151110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.151112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.151114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.151119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.151121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.151123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.151129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.151131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.151133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.151139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.151158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:37.159093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:37.160672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:37.160684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:37.160686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:37.160688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:37.160692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [2:7556554195902925133:4690]
2025-10-02T09:29:37.160702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:37.160713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:37.160714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.160717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.160718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.160728Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:37.160735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:37.160740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:37.160776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.160781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.160783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.160785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:37.160786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:37.160843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:37.160850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.160857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.160863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.160875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:37.160891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978446688:5329], now have 1 active actors on pipe
2025-10-02T09:29:37.160896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978446394:2446], now have 1 active actors on pipe
2025-10-02T09:29:37.160900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.160902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.160904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.160911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:37.160920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:37.160930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:37.160931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:37.160933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:37.160938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:37.160940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:37.160949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.160951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:37.160953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:37.160980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 473
2025-10-02T09:29:37.160982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 473
2025-10-02T09:29:37.161048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.161054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.161069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:37.161075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.161077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.161079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:37.161084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.161089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:37.161100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.161215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.161220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.161228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.161293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 36 sessionId: src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0
2025-10-02T09:29:37.161565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305503fd-d9c3696c-66fd9674-36309c14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:37.163828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Write session: try to update token
2025-10-02T09:29:37.163842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:37.170887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:37.170904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.170905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:37.170906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:37.170913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.170915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.170918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554195902925128:4690]
2025-10-02T09:29:37.170943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:37.170947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.170949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:37.170955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:37.170960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:37.170963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:37.171061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:37.175372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:37.177449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:37.230892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554195978446702:4901]
2025-10-02T09:29:37.231175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7556554195978446702:4901]
2025-10-02T09:29:37.300370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:37.300849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.300858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.300885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978446702:4901], now have 1 active actors on pipe
2025-10-02T09:29:37.301048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:37.301118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:37.301120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:37.301131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:37.301152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554195978446702:4901]
2025-10-02T09:29:37.301178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: error at write: Disconnected sessionId: src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0
2025-10-02T09:29:37.301324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0 is DEAD
2025-10-02T09:29:37.301446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:37.301454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Write session will restart in 0.005023s
2025-10-02T09:29:37.301495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Write session: Do CDS request
2025-10-02T09:29:37.301501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:37.307168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.307291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:37.307304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-10-02T09:29:37.307406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.307435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:37.307439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:37.307442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:37.307825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-10-02T09:29:37.307857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:37.307859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:37.307860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:37.307864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554195978446717:5333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:37.308337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554195978446717:5333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:37.310822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554195978446717:5333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:37.314251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554195978446717:5333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:37.314261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554195978446717:5333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:37.314264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554195978446717:5333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:37.314271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:37.321727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:37.324383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:37.324677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:37.324696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:37.324710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:37.324770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:37.324823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554195902925448:4692]
2025-10-02T09:29:37.325376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:37.325649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:37.325705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:37.326005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:37.326085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.326091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.326093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.326094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.326095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.326096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.326097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.326098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.326099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.326100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.326101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.326102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.326106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.326116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.326120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.326124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.326127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.326130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.326133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.326136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.326139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.326143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.326146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.326149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.326155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.326161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.326166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.326171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.326174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.326179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.326182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.326186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.326191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.326194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.326198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.326202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.326206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.326210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.326213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.326217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.326222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.326226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.326232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.326243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.326247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.326252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.326260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.326264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.326304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:37.334447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:37.336068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:37.336085Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:37.336087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:37.336091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:37.336096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [2:7556554195902925448:4692]
2025-10-02T09:29:37.336108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:37.336122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:37.336125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.336127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.336132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.336144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:37.336149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:37.336154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:37.336209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.336216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.336218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.336220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:37.336223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:37.336281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:37.336290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.336302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.336313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.336328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:37.336347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978446846:5333], now have 1 active actors on pipe
2025-10-02T09:29:37.336356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978446703:2446], now have 1 active actors on pipe
2025-10-02T09:29:37.336362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.336364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.336366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.336376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:37.336386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:37.336389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:37.336390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:37.336393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:37.336406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:37.336413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:37.336409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 474
2025-10-02T09:29:37.336439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.336419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 474
2025-10-02T09:29:37.336446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:37.336448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:37.336480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.336488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.336516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:37.336527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.336531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.336533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:37.336540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.336547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:37.336559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.336691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.336699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.336712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.336814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0
2025-10-02T09:29:37.337143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3270174e-3cfdfd5a-f8214694-b81625c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:37.339721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Write session: try to update token
2025-10-02T09:29:37.339735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:37.346602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:37.346619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.346621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:37.346623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:37.346629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.346632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.346635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554195902925442:4692]
2025-10-02T09:29:37.346668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:37.346668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:37.346673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:37.346674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.346675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:37.346676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:37.346796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:37.352717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:37.354881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:37.401370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554195978447033:4901]
2025-10-02T09:29:37.401571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7556554195978447033:4901]
2025-10-02T09:29:37.474615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:37.474911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.474920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.474936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447033:4901], now have 1 active actors on pipe
2025-10-02T09:29:37.475137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:37.475161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554195978447033:4901]
2025-10-02T09:29:37.475183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:37.475186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:37.475149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:37.475242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0
2025-10-02T09:29:37.475407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0 is DEAD
2025-10-02T09:29:37.475537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:37.475545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Write session will restart in 0.009143s
2025-10-02T09:29:37.475566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Write session: Do CDS request
2025-10-02T09:29:37.475572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:37.486327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.486460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:37.486475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-10-02T09:29:37.486596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.486624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:37.486633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:37.486637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:37.487005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-10-02T09:29:37.487038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:37.487043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:37.487044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:37.487048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554195978447101:5345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:37.487522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554195978447101:5345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:37.489811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554195978447101:5345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:37.492606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554195978447101:5345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:37.492618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554195978447101:5345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:37.492621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554195978447101:5345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:37.492627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:37.496735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:37.499462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:37.499654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:37.499663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:37.499672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:37.499734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:37.499771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554195902925785:4707]
2025-10-02T09:29:37.500322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:37.500595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:37.500637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:37.500943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:37.500999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.501004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.501005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.501006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.501007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.501008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.501009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.501010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.501011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.501012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.501013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.501014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.501019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.501028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.501032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.501035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.501038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.501042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.501045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.501049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.501052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.501055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.501058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.501061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.501067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.501073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.501078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.501083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.501086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.501090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.501094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.501098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.501103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.501108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.501111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.501115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.501118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.501122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.501125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.501132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.501136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.501141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.501144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.501148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.501155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.501160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.501165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.501168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.501201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:37.509714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:37.511939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:37.511956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:37.511958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:37.511960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:37.511965Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [2:7556554195902925785:4707]
2025-10-02T09:29:37.511975Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:37.511992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:37.511994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.511998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.512000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.512014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:37.512019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:37.512025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:37.512076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.512085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.512087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.512089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:37.512091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:37.512159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:37.512167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.512181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.512191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.512210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:37.512232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447254:5345], now have 1 active actors on pipe
2025-10-02T09:29:37.512241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447046:2446], now have 1 active actors on pipe
2025-10-02T09:29:37.512247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.512249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.512253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.512267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:37.512283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:37.512300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:37.512306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:37.512307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:37.512310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:37.512312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:37.512310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 475
2025-10-02T09:29:37.512320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 475
2025-10-02T09:29:37.512338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.512346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:37.512348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:37.512372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.512376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.512404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:37.512415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.512419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.512420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:37.512430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.512439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:37.512457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.512606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.512615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.512629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.512711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 36 sessionId: src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0
2025-10-02T09:29:37.513046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3fc37a-3bee1d00-d64a3355-f9f8d604_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:37.515471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Write session: try to update token
2025-10-02T09:29:37.515485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:37.522721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:37.522740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.522742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:37.522744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:37.522751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.522755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.522759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554195902925780:4707]
2025-10-02T09:29:37.522790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:37.522796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.522798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:37.522803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:37.522808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:37.522811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:37.523249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:37.532209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:37.534586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:37.575500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554195978447357:4901]
2025-10-02T09:29:37.575714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7556554195978447357:4901]
2025-10-02T09:29:37.655204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:37.655469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.655482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.655497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447357:4901], now have 1 active actors on pipe
2025-10-02T09:29:37.655701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:37.655712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:37.655715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:37.655749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554195978447357:4901]
2025-10-02T09:29:37.655761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0
2025-10-02T09:29:37.655900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0 is DEAD
2025-10-02T09:29:37.656002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:37.656010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Write session will restart in 0.006631s
2025-10-02T09:29:37.656032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Write session: Do CDS request
2025-10-02T09:29:37.656039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:37.655657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:37.663283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.663384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:37.663398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-10-02T09:29:37.663528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.663556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:37.663565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:37.663569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:37.663985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-10-02T09:29:37.664016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:37.664022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:37.664023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:37.664028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554195978447382:5349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:37.664533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554195978447382:5349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:37.667186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554195978447382:5349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:37.670942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554195978447382:5349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:37.670955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554195978447382:5349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:37.670959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554195978447382:5349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:37.670966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:37.676401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:37.679184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:37.679345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:37.679354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:37.679362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:37.679403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:37.679438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554195902926088:4709]
2025-10-02T09:29:37.679941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:37.680216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:37.680254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:37.680518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:37.680567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.680573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.680574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.680574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.680575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.680576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.680577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.680578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.680579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.680581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.680582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.680583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.680587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.680597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.680600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.680603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.680606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.680609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.680612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.680615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.680618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.680622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.680625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.680628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.680634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.680640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.680645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.680649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.680655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.680659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.680663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.680673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.680676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.680680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.680683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.680692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.680696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.680700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.680708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.680712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.680715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.680719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.680734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.680740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.680744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.680748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.680751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.680755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.680781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:37.689235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:37.691029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:37.691041Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:37.691042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:37.691045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:37.691050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [2:7556554195902926088:4709]
2025-10-02T09:29:37.691060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:37.691085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:37.691088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.691091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.691093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.691107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:37.691117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:37.691124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:37.691166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.691171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.691173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.691175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:37.691177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:37.691224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:37.691229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.691237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.691243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.691255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:37.691269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.691274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.691275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.691280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:37.691291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:37.691295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:37.691298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:37.691300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:37.691302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:37.691304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:37.691311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447537:5349], now have 1 active actors on pipe
2025-10-02T09:29:37.691313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447359:2446], now have 1 active actors on pipe
2025-10-02T09:29:37.691337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.691345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:37.691366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:37.691421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 476
2025-10-02T09:29:37.691490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 476
2025-10-02T09:29:37.691511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.691518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.691534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:37.691537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.691540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.691541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:37.691547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.691553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:37.691562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.691704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.691713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.691727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.691806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 36 sessionId: src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0
2025-10-02T09:29:37.692102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb7735-b5a1b44f-3f4770d5-daa2ec1c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:37.694583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Write session: try to update token
2025-10-02T09:29:37.694598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:37.707131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:37.707148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.707155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.707190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:37.707214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:37.707334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:37.707454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:37.707570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:37.707700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:37.707879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:37.707910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:37.709682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:37.711428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:37.711441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.711443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:37.711445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:37.711451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.711454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.711457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554195902926083:4709]
2025-10-02T09:29:37.711480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:37.711484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.711486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:37.711496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:37.711501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:37.711504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:37.711602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:37.711965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:37.755704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554195978447677:4901]
2025-10-02T09:29:37.755897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7556554195978447677:4901]
2025-10-02T09:29:37.841535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:37.842020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.842033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.842049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447677:4901], now have 1 active actors on pipe
2025-10-02T09:29:37.842234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:37.842271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554195978447677:4901]
2025-10-02T09:29:37.842300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:37.842302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:37.842306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:37.842355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: error at write: Disconnected sessionId: src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0
2025-10-02T09:29:37.842517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0 is DEAD
2025-10-02T09:29:37.842660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:37.842671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Write session will restart in 0.009600s
2025-10-02T09:29:37.842694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Write session: Do CDS request
2025-10-02T09:29:37.842700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:37.853217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.853336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:37.853351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-10-02T09:29:37.853451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:37.853477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:37.853485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:37.853489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:37.853818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-10-02T09:29:37.853843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:37.853845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:37.853846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:37.853850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554195978447769:5354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:37.854277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554195978447769:5354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:37.856742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554195978447769:5354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:37.859367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554195978447769:5354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:37.859383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554195978447769:5354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:37.859386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554195978447769:5354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:37.859392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:37.861251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:37.863750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:37.863910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:37.863919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:37.863928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:37.863974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:37.864008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554195902926395:4712]
2025-10-02T09:29:37.864563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:37.864792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:37.864842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:37.865116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:37.865159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.865164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.865165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.865166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.865167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.865168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.865169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.865170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.865171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.865172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.865174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.865174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.865179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.865189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.865193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.865196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.865200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.865203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.865207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.865211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.865214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.865218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.865222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.865225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.865232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.865242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:37.865247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.865252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:37.865260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.865269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:37.865277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.865285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:37.865293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.865302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:37.865309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.865317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:37.865325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.865330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:37.865338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.865346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:37.865354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.865362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:37.865369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.865378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.865385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.865394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.865402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.865410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.865446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:37.873546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:37.875411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:37.875423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:37.875425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:37.875427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:37.875432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [2:7556554195902926395:4712]
2025-10-02T09:29:37.875448Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:37.875464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:37.875467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.875469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.875471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.875484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:37.875488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:37.875494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:37.875547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.875556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.875558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.875560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:37.875562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:37.875624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:37.875632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.875643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:37.875654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:37.875666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:37.875683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447965:5354], now have 1 active actors on pipe
2025-10-02T09:29:37.875688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447683:2446], now have 1 active actors on pipe
2025-10-02T09:29:37.875692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.875694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.875696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.875706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:37.875722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:37.875722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:37.875725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:37.875727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:37.875737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:37.875739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:37.875767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.875780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:37.875774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 477
2025-10-02T09:29:37.875774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 477
2025-10-02T09:29:37.875803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:37.875836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.875841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.875856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdfa800b-be061d75-ff8d27bc-883820de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:37.875864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:37.875866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:37.875868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:37.875874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:37.875880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:37.875892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.876036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:37.876042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:37.876050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:37.876120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdfa800b-be061d75-ff8d27bc-883820de_0
2025-10-02T09:29:37.876418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17adeff2-e0be4c26-8a7ee7d-fdbf74dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdfa800b-be061d75-ff8d27bc-883820de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:37.878750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Write session: try to update token
2025-10-02T09:29:37.878761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:37.885602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:37.885623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.885631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.885668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:37.885727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:37.887196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:37.887969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:37.888699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:37.888846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:37.889945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:37.889990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:37.892937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|cdfa800b-be061d75-ff8d27bc-883820de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:37.895427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:37.895445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:37.895447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:37.895449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:37.895458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.895461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.895464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554195902926390:4712]
2025-10-02T09:29:37.895496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:37.895508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:37.895510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:37.895514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:37.895520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:37.895524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:37.895695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:37.896057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:37.942590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554195978447994:4901]
2025-10-02T09:29:37.942893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7556554195978447994:4901]
2025-10-02T09:29:38.024260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:38.024608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.024619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.024637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554195978447994:4901], now have 1 active actors on pipe
2025-10-02T09:29:38.024779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:38.024831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:38.024843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:38.024845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:38.024887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554195978447994:4901]
2025-10-02T09:29:38.024906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: error at write: Disconnected sessionId: src_id|cdfa800b-be061d75-ff8d27bc-883820de_0
2025-10-02T09:29:38.025072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|cdfa800b-be061d75-ff8d27bc-883820de_0 is DEAD
2025-10-02T09:29:38.025204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:38.025214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Write session will restart in 0.006333s
2025-10-02T09:29:38.025232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Write session: Do CDS request
2025-10-02T09:29:38.025236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:38.032255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.032328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:38.032341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-10-02T09:29:38.032439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.032463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:38.032477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:38.032480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:38.032875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-10-02T09:29:38.032909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:38.032915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:38.032918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:38.032923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554200273415316:5358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:38.033374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554200273415316:5358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:38.035375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554200273415316:5358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:38.038797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554200273415316:5358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:38.038810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554200273415316:5358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:38.038813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554200273415316:5358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:38.038819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:38.044548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:38.047655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:38.047976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:38.047993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:38.048322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:38.048396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:38.048436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554200197894001:4714]
2025-10-02T09:29:38.049018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:38.049292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:38.049345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:38.049640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:38.049714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.049721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.049722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.049723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.049724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.049725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.049726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.049727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.049728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.049729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.049730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.049731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.049737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.049746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.049751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.049755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.049758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.049762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.049765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.049768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.049771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.049775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.049778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.049782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.049788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.049795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.049800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.049805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.049814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.049820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.049824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.049829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.049834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.049840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.049843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.049848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.049852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.049856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.049865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.049870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.049874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.049878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.049882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.049886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.049894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.049899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.049904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.049909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.049939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:38.058526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:38.060594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:38.060615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:38.060617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:38.060621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:38.060627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [2:7556554200197894001:4714]
2025-10-02T09:29:38.060642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:38.060659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:38.060664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.060667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.060669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.060681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:38.060691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:38.060697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:38.060758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.060765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.060767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.060769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:38.060772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:38.060938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:38.060947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.060959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.060974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.060993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:38.061017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415447:5358], now have 1 active actors on pipe
2025-10-02T09:29:38.060998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 478
2025-10-02T09:29:38.061025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415293:2446], now have 1 active actors on pipe
2025-10-02T09:29:38.061002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 478
2025-10-02T09:29:38.061031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.061033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.061035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.061045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:38.061054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:38.061057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:38.061057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:38.061059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:38.061071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:38.061079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:38.061094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.061102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.061141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.061155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:38.061168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:38.061178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.061179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:38.061182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.061184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:38.061192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.061201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:38.061240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.061385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.061394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.061407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.061485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 36 sessionId: src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0
2025-10-02T09:29:38.061774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfa800b-be061d75-ff8d27bc-883820de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:38.064233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Write session: try to update token
2025-10-02T09:29:38.064247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:38.071693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:38.071709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.071718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.071759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:38.071761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:38.072118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:38.072301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.072482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.072668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.072999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:38.073052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:38.077530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:38.080019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:38.081153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.081171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.081186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:38.081189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.081191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:38.081194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:38.081201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.081205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.081209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554200197893991:4714]
2025-10-02T09:29:38.081252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:38.081254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:38.081262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.081265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:38.081275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:38.081279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:38.081399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:38.124885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554200273415609:4901]
2025-10-02T09:29:38.125134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7556554200273415609:4901]
2025-10-02T09:29:38.220623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:38.221253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:38.221290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415609:4901], now have 1 active actors on pipe
2025-10-02T09:29:38.221382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:38.221422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554200273415609:4901]
2025-10-02T09:29:38.221438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:38.221473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:38.221481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:38.221543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: error at write: Disconnected sessionId: src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0
2025-10-02T09:29:38.221669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0 is DEAD
2025-10-02T09:29:38.221801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:38.221813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Write session will restart in 0.005420s
2025-10-02T09:29:38.221833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Write session: Do CDS request
2025-10-02T09:29:38.221841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:38.228242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.228438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:38.228451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-10-02T09:29:38.228577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.228610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:38.228620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:38.228623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:38.228762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:38.228993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-10-02T09:29:38.229025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:38.229031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:38.229033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:38.229037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554200273415631:5363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:38.229522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554200273415631:5363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:38.230158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:38.230287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:38.230295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:38.230302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:38.230342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:38.230371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554200197894064:4717]
2025-10-02T09:29:38.230865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:38.231365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:38.231408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:38.231459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554200273415631:5363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:38.231696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:38.231748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.231754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.231756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.231757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.231758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.231759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.231760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.231761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.231763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.231764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.231765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.231766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.231770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.231779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.231785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.231789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.231792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.231795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.231799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.231802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.231806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.231810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.231814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.231817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.231823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.231830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.231835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.231840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.231844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.231849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.231855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.231861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.231865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.231870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.231878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.231883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.231890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.231898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.231902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.231906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.231914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.231919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.231923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.231928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.231932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.231938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.231941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.231946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.231980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:38.236360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554200273415631:5363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:38.236375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554200273415631:5363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:38.236378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554200273415631:5363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:38.236385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:38.240272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:38.241920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:38.241939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:38.241942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:38.241945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:38.241952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [2:7556554200197894064:4717]
2025-10-02T09:29:38.241965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:38.241982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:38.241989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.241992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.241994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.242009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:38.242019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:38.242029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:38.242086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.242093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.242095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.242098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:38.242100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:38.242150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:38.242157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.242166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.242171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.242180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:38.242193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.242199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.242201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.242205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:38.242215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:38.242215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:38.242219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:38.242221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:38.242223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:38.242225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:38.242232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415671:5363], now have 1 active actors on pipe
2025-10-02T09:29:38.242235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415613:2446], now have 1 active actors on pipe
2025-10-02T09:29:38.242255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.242263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:38.242272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:38.242322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 479
2025-10-02T09:29:38.242324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 479
2025-10-02T09:29:38.242443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.242451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.242469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10726b25-15eee408-40879ee0-1357c2cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:38.242476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.242479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.242483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:38.242490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.242499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:38.242510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.242660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.242665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.242673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.242750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 36 sessionId: src_id|10726b25-15eee408-40879ee0-1357c2cf_0
2025-10-02T09:29:38.243082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae9c882-cb614bf2-cbc7c915-8c5be70e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10726b25-15eee408-40879ee0-1357c2cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:38.245537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Write session: try to update token
2025-10-02T09:29:38.245552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:38.252447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:38.252465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.252472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.252515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:38.252513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:38.252674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:38.252796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.252949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.253100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.253283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:38.253315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:38.258842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|10726b25-15eee408-40879ee0-1357c2cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:38.261196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:38.262039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.262061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.262076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:38.262078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.262081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:38.262083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:38.262090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.262094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.262097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554200197894059:4717]
2025-10-02T09:29:38.262135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:38.262138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:38.262143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:38.262143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.262145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:38.262147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:38.262259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:38.321460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554200273415678:4901]
2025-10-02T09:29:38.321754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7556554200273415678:4901]
2025-10-02T09:29:38.399736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:38.399945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:38.399971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415678:4901], now have 1 active actors on pipe
2025-10-02T09:29:38.400084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:38.407703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:38.409380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:38.409538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:38.409548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:38.409558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:38.409603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:38.409640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554200197894152:4729]
2025-10-02T09:29:38.410169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:38.410466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:38.410514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:38.410831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:38.410903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.410910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.410911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.410912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.410913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.410914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.410915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.410917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.410918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.410919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.410921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.410922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.410927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.410937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.410941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.410945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.410948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.410952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.410955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.410959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.410963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.410968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.410971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.410974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.410980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.410987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.410991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.410996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.411000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.411004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.411008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.411013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.411017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.411028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.411034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.411038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.411042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.411047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.411051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.411056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.411073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.411077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.411082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.411087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.411091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.411095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.411101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.411105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.411139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:38.413064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554200273415678:4901]
2025-10-02T09:29:38.413089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:38.414872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:38.414885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:38.414904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: error at write: Disconnected sessionId: src_id|10726b25-15eee408-40879ee0-1357c2cf_0
2025-10-02T09:29:38.415037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|10726b25-15eee408-40879ee0-1357c2cf_0 is DEAD
2025-10-02T09:29:38.415228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:38.415237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Write session will restart in 0.009096s
2025-10-02T09:29:38.415258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Write session: Do CDS request
2025-10-02T09:29:38.415264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:38.420210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:38.421878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:38.421896Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:38.421899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:38.421902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:38.421908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [2:7556554200197894152:4729]
2025-10-02T09:29:38.421922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:38.421940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:38.421943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.421945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.421947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.421961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:38.421966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:38.421971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:38.422018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.422027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.422029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.422032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:38.422035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:38.422093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:38.422101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.422115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.422131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.422152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:38.422175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415714:2446], now have 1 active actors on pipe
2025-10-02T09:29:38.422188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.422190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.422192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.422202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:38.422214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:38.422225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:38.422227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:38.422229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:38.422231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:38.422231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:38.422260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.422235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 480
2025-10-02T09:29:38.422266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:38.422275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:38.425196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.425364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:38.425376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-10-02T09:29:38.425500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.425531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:38.425535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:38.425539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:38.425952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-10-02T09:29:38.425990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:38.425996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:38.425998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:38.426003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554200273415731:5374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:38.426489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554200273415731:5374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:38.428587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554200273415731:5374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:38.431776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554200273415731:5374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:38.431789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554200273415731:5374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:38.431792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554200273415731:5374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:38.431815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:38.432073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 480
2025-10-02T09:29:38.432464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415764:5374], now have 1 active actors on pipe
2025-10-02T09:29:38.432487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.432494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.432506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:38.432507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.432512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.432540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:38.432546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:38.432551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.432554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.432555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:38.432562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.432572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:38.432586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:38.432755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:38.432932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.433069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.433217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:38.433398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:38.433435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.433456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:38.433801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.433815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.433833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.433983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 36 sessionId: src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0
2025-10-02T09:29:38.434292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10726b25-15eee408-40879ee0-1357c2cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:38.436916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Write session: try to update token
2025-10-02T09:29:38.436932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:38.442123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:38.442143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.442145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:38.442146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:38.442152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.442155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.442157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554200197894147:4729]
2025-10-02T09:29:38.442185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:38.442189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.442190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:38.442196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:38.442202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:38.442205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:38.442311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:38.449325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:38.451692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:38.513472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554200273415778:4901]
2025-10-02T09:29:38.513763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7556554200273415778:4901]
2025-10-02T09:29:38.586379Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:38.586622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.586633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.586648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415778:4901], now have 1 active actors on pipe
2025-10-02T09:29:38.586820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:38.586862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:38.586905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:38.586986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0
2025-10-02T09:29:38.586994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554200273415778:4901]
2025-10-02T09:29:38.587147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0 is DEAD
2025-10-02T09:29:38.587273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:38.587284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Write session will restart in 0.005676s
2025-10-02T09:29:38.587304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Write session: Do CDS request
2025-10-02T09:29:38.587309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:38.593626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:38.594246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.594436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:38.594455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-10-02T09:29:38.594589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.594618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:38.594630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:38.594636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:38.595021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-10-02T09:29:38.595053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:38.595060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:38.595061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:38.595080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554200273415800:5379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:38.595229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:38.595433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:38.595449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:38.595463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:38.595537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:38.595536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554200273415800:5379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:38.595595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554200197894230:4734]
2025-10-02T09:29:38.596200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:38.596529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:38.596586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:38.597022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:38.597104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.597110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.597112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.597113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.597114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.597115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.597117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.597118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.597119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.597122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.597123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.597124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.597130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.597139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.597143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.597146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.597148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.597152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.597155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.597158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.597161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.597166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.597173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.597177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.597187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.597197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.597207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.597215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.597222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.597226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.597234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.597238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.597246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.597250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.597258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.597267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.597275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.597283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.597291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.597300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.597307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.597314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.597321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.597325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.597329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.597337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.597346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.597350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.597381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:38.597465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554200273415800:5379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:38.602791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554200273415800:5379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:38.602805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554200273415800:5379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:38.602809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554200273415800:5379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:38.602817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:38.605658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:38.607271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:38.607288Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:38.607289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:38.607292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:38.607297Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [2:7556554200197894230:4734]
2025-10-02T09:29:38.607308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:38.607325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:38.607328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.607330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.607332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.607346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:38.607351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:38.607357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:38.607410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.607418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.607420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.607423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:38.607427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:38.607472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:38.607477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.607485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.607491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.607504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:38.607520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415780:2446], now have 1 active actors on pipe
2025-10-02T09:29:38.607526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415839:5379], now have 1 active actors on pipe
2025-10-02T09:29:38.607530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.607531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.607532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.607541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:38.607556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:38.607556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:38.607559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:38.607560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:38.607573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:38.607576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:38.607600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.607607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 481
2025-10-02T09:29:38.607622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 481
2025-10-02T09:29:38.607612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:38.607656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:38.607660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.607662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.607679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:38.607687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.607689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.607691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:38.607697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.607707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:38.607719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.607921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.607931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.607953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.608042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 36 sessionId: src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0
2025-10-02T09:29:38.608405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a08700-3bd1f0b5-eccb824f-ce621c83_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:38.610892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Write session: try to update token
2025-10-02T09:29:38.610906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:38.618761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:38.618784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.618788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:38.618791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:38.618802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.618806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.618812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554200197894225:4734]
2025-10-02T09:29:38.618851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:38.618853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:38.618861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.618863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:38.618867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:38.618870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:38.619022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:38.623675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:38.626235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:38.687044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554200273415847:4901]
2025-10-02T09:29:38.687305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7556554200273415847:4901]
2025-10-02T09:29:38.765076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:38.765429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.765444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.765477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415847:4901], now have 1 active actors on pipe
2025-10-02T09:29:38.765982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:38.765744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:38.765801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554200273415847:4901]
2025-10-02T09:29:38.765826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:38.765828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:38.765881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: error at write: Disconnected sessionId: src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0
2025-10-02T09:29:38.766383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:38.766399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Write session will restart in 0.009688s
2025-10-02T09:29:38.766065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0 is DEAD
2025-10-02T09:29:38.766421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Write session: Do CDS request
2025-10-02T09:29:38.766428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:38.775126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:38.776670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:38.776858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:38.776875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:38.776888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:38.776952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:38.777000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554200197894290:4736]
2025-10-02T09:29:38.777241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.777309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:38.777322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-10-02T09:29:38.777473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.777511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:38.777520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:38.777524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:38.777600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:38.777906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-10-02T09:29:38.777946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:38.777953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:38.777955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:38.777960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554200273415880:5384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:38.778021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:38.778073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:38.778377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:38.778438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554200273415880:5384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:38.778455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.778464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.778466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.778467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.778468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.778469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.778470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.778471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.778473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.778474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.778475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.778478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.778484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.778493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.778496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.778500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.778504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.778507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.778511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.778515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.778518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.778522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.778526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.778529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.778536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.778543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.778548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.778553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.778556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.778561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.778565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.778570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.778573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.778579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.778582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.778587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.778591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.778596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.778600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.778604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.778608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.778613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.778618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.778622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.778625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.778630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.778634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.778639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.778675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:38.780338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554200273415880:5384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:38.787180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554200273415880:5384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:38.787196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554200273415880:5384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:38.787199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554200273415880:5384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:38.787208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:38.788507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:38.790636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 482
2025-10-02T09:29:38.790668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 482
2025-10-02T09:29:38.790136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:38.790155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:38.790158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:38.790162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:38.790169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [2:7556554200197894290:4736]
2025-10-02T09:29:38.790185Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:38.790201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:38.790204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.790207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.790209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.790225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:38.790230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:38.790237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:38.790289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.790292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.790297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.790300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:38.790302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:38.790366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:38.790370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.790383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.790397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.790415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:38.790430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.790433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.790435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.790444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:38.790456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:38.790456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:38.790460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:38.790462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:38.790468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:38.790470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:38.790479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415856:2446], now have 1 active actors on pipe
2025-10-02T09:29:38.790482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415915:5384], now have 1 active actors on pipe
2025-10-02T09:29:38.790510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.790519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:38.790721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:38.791019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.791024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.791049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:38.791076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.791081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.791083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:38.791093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.791105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:38.791119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.791394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.791400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.791422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.791784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0
2025-10-02T09:29:38.795665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be46111d-f9d291ae-9b3547a4-f50a8548_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:38.798255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Write session: try to update token
2025-10-02T09:29:38.798274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:38.802477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:38.802498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.802501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:38.802507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:38.802515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.802519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.802523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554200197894285:4736]
2025-10-02T09:29:38.802559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:38.802566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.802568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:38.802697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:38.804862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:38.804878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:38.804882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:38.816892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:38.819491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:38.866213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554200273415927:4901]
2025-10-02T09:29:38.869203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7556554200273415927:4901]
2025-10-02T09:29:38.953268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:38.953593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.953602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.953619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415927:4901], now have 1 active actors on pipe
2025-10-02T09:29:38.953850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:38.954185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554200273415927:4901]
2025-10-02T09:29:38.954213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:38.954240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:38.954316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0
2025-10-02T09:29:38.954477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0 is DEAD
2025-10-02T09:29:38.954852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:38.954860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Write session will restart in 0.005967s
2025-10-02T09:29:38.954883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Write session: Do CDS request
2025-10-02T09:29:38.954888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:38.962273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.962590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:38.962607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-10-02T09:29:38.962717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:38.962750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:38.962756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:38.962760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:38.963170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-10-02T09:29:38.963206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:38.963209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:38.963211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:38.963219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554200273415953:5388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:38.963746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554200273415953:5388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:38.966268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554200273415953:5388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:38.964330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:38.969099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:38.969301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:38.969313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:38.969324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:38.969388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:38.969425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554200197894354:4739]
2025-10-02T09:29:38.969986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:38.970020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554200273415953:5388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:38.970033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554200273415953:5388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:38.970036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554200273415953:5388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:38.970043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:38.970323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:38.970402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:38.970745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:38.970824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.970831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.970832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.970833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.970834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.970835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.970837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.970838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.970840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.970841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.970842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.970843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.970849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.970859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.970862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.970881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.970885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.970888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.970892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.970895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.970899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.970902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.970905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.970909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.970918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.970931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:38.970941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.970946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:38.970950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.970954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:38.970957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.970962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:38.970971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.970976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:38.970981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.970990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:38.970995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.971010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:38.971022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.971027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:38.971030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.971036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:38.971044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.971049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.971057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.971061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.971077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.971081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.971118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:38.981309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:38.983172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:38.983192Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:38.983195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:38.983199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:38.983207Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [2:7556554200197894354:4739]
2025-10-02T09:29:38.983223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:38.983242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:38.983245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.983248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.983253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.983269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:38.983279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:38.983288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:38.983355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.983362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.983364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.983368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:38.983371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:38.983441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:38.983451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.983466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:38.983477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:38.983493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:38.983511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415932:2446], now have 1 active actors on pipe
2025-10-02T09:29:38.983517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.983519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.983521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.983536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:38.983546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554200273415986:5388], now have 1 active actors on pipe
2025-10-02T09:29:38.983553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:38.983559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:38.983563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:38.983565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:38.983568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:38.983571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:38.983606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.983618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:38.983709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 483
2025-10-02T09:29:38.983748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 483
2025-10-02T09:29:38.983695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:38.983931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.983944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.983968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:38.983981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:38.983993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:38.983999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:38.984009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:38.984019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:38.984033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.984272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:38.984279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:38.984292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:38.984458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 36 sessionId: src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0
2025-10-02T09:29:38.984844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce54bc0-f323a0da-f7abd06c-22f693c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:38.987532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Write session: try to update token
2025-10-02T09:29:38.987549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:38.998342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:38.998365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:38.998368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:38.998370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:38.998380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.998388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.998395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554200197894347:4739]
2025-10-02T09:29:38.998435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:38.998441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:38.998443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:38.998584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:38.998601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:38.998607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:38.998610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:39.007360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:39.009930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:39.054151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554204568383294:4901]
2025-10-02T09:29:39.057077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7556554204568383294:4901]
2025-10-02T09:29:39.150512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:39.150830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.150845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.150862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383294:4901], now have 1 active actors on pipe
2025-10-02T09:29:39.151095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:39.151101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:39.151122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:39.151179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: error at write: Disconnected sessionId: src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0
2025-10-02T09:29:39.151332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0 is DEAD
2025-10-02T09:29:39.151466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:39.151476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Write session will restart in 0.006674s
2025-10-02T09:29:39.151473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554204568383294:4901]
2025-10-02T09:29:39.151496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Write session: Do CDS request
2025-10-02T09:29:39.151490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:39.151505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:39.159299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.159371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:39.159386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-10-02T09:29:39.159498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.159528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:39.159533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:39.159537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:39.159752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:39.159953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-10-02T09:29:39.159982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:39.159984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:39.159986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:39.159991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554204568383320:5393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:39.160513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554204568383320:5393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:39.161659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:39.161835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:39.161848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:39.161860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:39.161928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:39.161967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554204492861714:4742]
2025-10-02T09:29:39.162471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554204568383320:5393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:39.162525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:39.162822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:39.162880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:39.163193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:39.163247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.163252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.163252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.163253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.163254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.163254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.163255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.163256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.163257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.163257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.163258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.163259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.163263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.163270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.163272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.163275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.163277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.163281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.163283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.163285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.163287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.163290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.163291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.163294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.163298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.163302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.163306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.163309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.163312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.163315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.163318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.163321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.163323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.163326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.163328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.163331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.163333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.163336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.163339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.163342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.163344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.163347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.163349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.163351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.163354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.163356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.163358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.163361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.163380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:39.168037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554204568383320:5393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:39.168051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554204568383320:5393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:39.168055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554204568383320:5393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:39.168062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:39.172788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:39.174580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:39.174601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:39.174605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:39.174610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:39.174617Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [2:7556554204492861714:4742]
2025-10-02T09:29:39.174633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:39.174652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:39.174657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.174661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.174665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.174684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:39.174694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:39.174704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:39.174771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.174781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.174784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.174787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:39.174789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:39.174859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:39.174869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.174881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.174890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.174905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:39.174928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383359:5393], now have 1 active actors on pipe
2025-10-02T09:29:39.174933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383298:2446], now have 1 active actors on pipe
2025-10-02T09:29:39.174938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.174941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.174943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.174955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:39.174969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:39.174982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:39.174992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:39.175029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.175031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:39.175086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:39.175090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:39.175092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:39.175099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:39.175670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 484
2025-10-02T09:29:39.175689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 484
2025-10-02T09:29:39.176107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.176122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.176150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18658ec0-d7391877-a15476f9-fdd8e773_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:39.176162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.176166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.176170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:39.176182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.176193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:39.176267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.176475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.176486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.176502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.176596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 36 sessionId: src_id|18658ec0-d7391877-a15476f9-fdd8e773_0
2025-10-02T09:29:39.176992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2383d006-f7dd4968-47b58c9f-bc01b467_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18658ec0-d7391877-a15476f9-fdd8e773_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:39.179655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Write session: try to update token
2025-10-02T09:29:39.179671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:39.187218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:39.187238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.187240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:39.187242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:39.187249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.187255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.187258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554204492861708:4742]
2025-10-02T09:29:39.187302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:39.187309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.187311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:39.187337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:39.187356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:39.187359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:39.187484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:39.194364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|18658ec0-d7391877-a15476f9-fdd8e773_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:39.197073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:39.251795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554204568383367:4901]
2025-10-02T09:29:39.252105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7556554204568383367:4901]
2025-10-02T09:29:39.330653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:39.331018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.331039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.331056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383367:4901], now have 1 active actors on pipe
2025-10-02T09:29:39.331297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:39.331636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:39.331688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554204568383367:4901]
2025-10-02T09:29:39.331707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:39.331770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18658ec0-d7391877-a15476f9-fdd8e773_0
2025-10-02T09:29:39.331930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|18658ec0-d7391877-a15476f9-fdd8e773_0 is DEAD
2025-10-02T09:29:39.332051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:39.332070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Write session will restart in 0.009269s
2025-10-02T09:29:39.332112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Write session: Do CDS request
2025-10-02T09:29:39.332119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:39.339828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:39.341520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:39.341694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:39.341703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:39.341712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:39.341756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:39.341793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554204492861776:4744]
2025-10-02T09:29:39.342343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.342415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:39.342456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:39.342470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-10-02T09:29:39.342695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.342736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:39.342745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:39.342750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:39.342858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:39.342901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:39.343218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-10-02T09:29:39.343228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:39.343252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:39.343258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:39.343260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:39.343266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554204568383396:5397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:39.343279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.343286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.343288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.343289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.343290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.343292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.343293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.343295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.343297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.343298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.343299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.343300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.343305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.343317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.343320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.343324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.343326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.343331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.343334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.343337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.343340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.343344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.343347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.343350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.343356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.343362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.343366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.343371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.343376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.343380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.343384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.343388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.343393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.343403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.343407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.343417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.343422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.343429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.343438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.343443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.343452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.343457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.343463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.343472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.343476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.343481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.343484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.343493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.343529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:39.343778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554204568383396:5397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:39.345735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554204568383396:5397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:39.350965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554204568383396:5397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:39.350980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554204568383396:5397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:39.350984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554204568383396:5397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:39.350992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:39.352350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:39.354128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:39.354146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:39.354148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:39.354153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:39.354159Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [2:7556554204492861776:4744]
2025-10-02T09:29:39.354172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:39.354186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:39.354191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.354193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.354196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.354211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:39.354221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:39.354226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:39.354281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.354289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.354291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.354294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:39.354297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:39.354357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:39.354363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.354372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.354382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.354398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:39.354421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383433:5397], now have 1 active actors on pipe
2025-10-02T09:29:39.354428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383369:2446], now have 1 active actors on pipe
2025-10-02T09:29:39.354431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.354433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.354434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.354443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:39.354453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:39.354457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:39.354460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:39.354461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:39.354465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:39.354467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:39.354493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.354504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:39.354509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:39.354660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 485
2025-10-02T09:29:39.354706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 485
2025-10-02T09:29:39.354862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.354869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.354888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:39.354900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.354908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.354911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:39.354919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.354931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:39.354947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.355087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.355094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.355104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.355323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 36 sessionId: src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0
2025-10-02T09:29:39.355650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18658ec0-d7391877-a15476f9-fdd8e773_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:39.358207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Write session: try to update token
2025-10-02T09:29:39.358222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:39.368686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:39.368713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.368722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.368767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:39.368970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:39.369128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:39.369271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:39.369416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:39.369653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:39.369698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:39.369777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:39.371286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:39.373689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:39.373943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.373968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.374010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:39.374153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:39.378707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:39.378729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.378731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:39.378733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:39.378747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.378750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.378753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554204492861771:4744]
2025-10-02T09:29:39.378791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:39.378793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:39.378798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.378799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:39.378801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:39.378823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:39.378946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:39.432158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554204568383453:4901]
2025-10-02T09:29:39.432799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7556554204568383453:4901]
2025-10-02T09:29:39.520102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:39.526877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.526905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.527083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.527147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.527207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.527275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.527317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.527327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.527386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.527440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.527497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.527560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.527602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.527607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.527664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.527714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.527774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.527831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.527868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.527873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.527936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.527994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.528054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.528120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.528163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.528169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.528228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.528286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.528347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.528413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.528465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.528476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.528547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.528607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.528669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.528735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.528780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.528786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.528881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.528954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.529023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.529086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.529133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.529139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.529210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.529266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.529325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.529383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.529422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.529427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.529486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.529546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.529600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.529660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.529704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.529709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.529764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:39.529819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:39.529876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:39.529932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:39.529972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:39.529978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:39.530020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383453:4901], now have 1 active actors on pipe
2025-10-02T09:29:39.530236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:39.530250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:39.530282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:39.530327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554204568383453:4901]
2025-10-02T09:29:39.530618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: error at write: Disconnected sessionId: src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0
2025-10-02T09:29:39.530790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0 is DEAD
2025-10-02T09:29:39.530936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:39.530943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Write session will restart in 0.005587s
2025-10-02T09:29:39.530959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Write session: Do CDS request
2025-10-02T09:29:39.530963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:39.530952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:39.537187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.537310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:39.537322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-10-02T09:29:39.537405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.537432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:39.537440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:39.537443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:39.537788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-10-02T09:29:39.537815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:39.537817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:39.537819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:39.537823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554204568383501:5409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:39.538054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:39.538217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554204568383501:5409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:39.539609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:39.539743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:39.539751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:39.539758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:39.539790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:39.539815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554204492861888:4759]
2025-10-02T09:29:39.540238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:39.540247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554204568383501:5409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:39.540513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:39.540547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:39.540815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:39.540862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.540868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.540870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.540871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.540872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.540873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.540875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.540876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.540877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.540878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.540879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.540881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.540886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.540896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.540900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.540904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.540907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.540910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.540913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.540917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.540921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.540924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.540927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.540930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.540936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.540943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.540948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.540952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.540956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.540960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.540963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.540968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.540972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.540976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.540980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.540985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.540989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.540994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.540998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.541002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.541006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.541011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.541014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.541020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.541024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.541029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.541032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.541037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.541071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:39.545483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554204568383501:5409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:39.545496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554204568383501:5409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:39.545499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554204568383501:5409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:39.545506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:39.549398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:39.550942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:39.550959Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:39.550960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:39.550963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:39.550967Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [2:7556554204492861888:4759]
2025-10-02T09:29:39.550977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:39.550990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:39.550992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.550994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.550994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.551008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:39.551015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:39.551021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:39.551074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.551082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.551083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.551087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:39.551088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:39.551132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:39.551137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.551145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.551151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.551159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:39.551173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.551177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.551178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.551184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:39.551196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383540:5409], now have 1 active actors on pipe
2025-10-02T09:29:39.551197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:39.551199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:39.551201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:39.551204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383477:2446], now have 1 active actors on pipe
2025-10-02T09:29:39.551211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:39.551223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:39.551230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:39.551257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.551268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:39.551275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:39.551270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 486
2025-10-02T09:29:39.551272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 486
2025-10-02T09:29:39.551332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.551339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.551355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:39.551363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.551366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.551367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:39.551374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.551387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:39.551402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.551541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.551548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.551557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.551644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 36 sessionId: src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0
2025-10-02T09:29:39.551963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a69158-34556ad8-cbb9ff2b-9d9ade79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:39.554409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Write session: try to update token
2025-10-02T09:29:39.554424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:39.561678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:39.561696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.561698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:39.561702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:39.561711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.561714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.561715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554204492861883:4759]
2025-10-02T09:29:39.561742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:39.561747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.561747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:39.561750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:39.561752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:39.561758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:39.561875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:39.567047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:39.569683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:39.630683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554204568383548:4901]
2025-10-02T09:29:39.631050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7556554204568383548:4901]
2025-10-02T09:29:39.705500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:39.705905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.705924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.705943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383548:4901], now have 1 active actors on pipe
2025-10-02T09:29:39.706176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:39.706279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:39.706305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:39.706367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: error at write: Disconnected sessionId: src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0
2025-10-02T09:29:39.706556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0 is DEAD
2025-10-02T09:29:39.706670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:39.706732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:39.706744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Write session will restart in 0.005834s
2025-10-02T09:29:39.706730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554204568383548:4901]
2025-10-02T09:29:39.706781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Write session: Do CDS request
2025-10-02T09:29:39.706788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:39.713691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.713794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:39.713810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-10-02T09:29:39.713940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.713973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:39.713977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:39.713981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:39.714588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:39.714478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-10-02T09:29:39.714512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:39.714514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:39.714515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:39.714520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554204568383578:5413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:39.715021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554204568383578:5413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:39.716322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:39.716500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:39.716509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:39.716518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:39.716569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:39.716605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554204492861954:4761]
2025-10-02T09:29:39.716957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554204568383578:5413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:39.717176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:39.717457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:39.717517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:39.717855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:39.717961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.717968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.717969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.717971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.717972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.717973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.717974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.717975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.717976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.717977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.717978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.717979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.717984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.717995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.717999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.718003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.718006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.718010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.718014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.718018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.718021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.718027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.718031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.718035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.718040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.718049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.718054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.718059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.718063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.718068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.718074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.718080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.718089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.718094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.718099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.718108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.718114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.718118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.718122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.718127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.718131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.718135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.718139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.718144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.718152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.718157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.718161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.718170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.718204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:39.718890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554204568383578:5413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:39.718906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554204568383578:5413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:39.718909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554204568383578:5413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:39.718916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:39.727716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:39.729442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:39.729461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:39.729464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:39.729467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:39.729474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [2:7556554204492861954:4761]
2025-10-02T09:29:39.729488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:39.729505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:39.729508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.729512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.729516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.729531Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:39.729536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:39.729542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:39.729604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.729610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.729612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.729615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:39.729617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:39.729690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:39.729698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.729711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.729726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.729746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:39.729771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383553:2446], now have 1 active actors on pipe
2025-10-02T09:29:39.729779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383623:5413], now have 1 active actors on pipe
2025-10-02T09:29:39.729785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.729787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.729789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.729800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:39.729813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:39.729817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:39.729821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:39.729823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:39.729828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:39.729831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:39.729863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.729870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:39.729873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:39.729839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 487
2025-10-02T09:29:39.729860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 487
2025-10-02T09:29:39.729897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.729904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.729932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:39.729944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.729947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.729949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:39.729958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.729966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:39.729982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.730171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.730186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.730209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.730275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0
2025-10-02T09:29:39.730645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe5096a-bce80ab8-fe3c6d7b-4cf41659_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:39.733279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Write session: try to update token
2025-10-02T09:29:39.733297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:39.740748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:39.740770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.740772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:39.740775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:39.740784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.740788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.740792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554204492861949:4761]
2025-10-02T09:29:39.740845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:39.740843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:39.740850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:39.740854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:39.740854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.740856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:39.740990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:39.746705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:39.749144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:39.806245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554204568383647:4901]
2025-10-02T09:29:39.806514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7556554204568383647:4901]
2025-10-02T09:29:39.882797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:39.883122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.883143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.883164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383647:4901], now have 1 active actors on pipe
2025-10-02T09:29:39.883386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554204568383647:4901]
2025-10-02T09:29:39.883392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:39.883396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:39.883417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:39.883448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0
2025-10-02T09:29:39.883463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:39.883973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:39.883984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Write session will restart in 0.005032s
2025-10-02T09:29:39.884006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Write session: Do CDS request
2025-10-02T09:29:39.884014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:39.883617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0 is DEAD
2025-10-02T09:29:39.890342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.890403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:39.890421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-10-02T09:29:39.890601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:39.890634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:39.890644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:39.890648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:39.890888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:39.891079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-10-02T09:29:39.891108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:39.891111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:39.891113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:39.891118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554204568383676:5418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:39.892636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:39.892855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:39.892866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:39.892876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:39.892928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:39.892969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554204492862023:4764]
2025-10-02T09:29:39.893619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:39.893932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:39.894007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:39.894386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:39.894458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.894468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.894469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.894470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.894471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.894472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.894473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.894474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.894475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.894476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.894477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.894479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.894483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.894492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.894496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.894500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.894503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.894507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.894510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.894514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.894519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.894522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.894525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.894528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.894535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.894542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:39.894549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.894554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:39.894567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.894576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:39.894580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.894585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:39.894591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.894597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:39.894603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.894608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:39.894614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.894619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:39.894624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.894628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:39.894632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.894637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:39.894643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.894648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.894652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.894656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.894660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.894667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.894701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:39.891661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554204568383676:5418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:39.893565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554204568383676:5418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:39.899475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554204568383676:5418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:39.899491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554204568383676:5418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:39.899494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554204568383676:5418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:39.899502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:39.903736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:39.905532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:39.905560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:39.905562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:39.905566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:39.905572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [2:7556554204492862023:4764]
2025-10-02T09:29:39.905587Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:39.905604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:39.905607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.905610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.905612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.905629Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:39.905640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:39.905649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:39.905711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.905720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.905723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.905725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:39.905728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:39.905792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:39.905797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.905813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:39.905823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:39.905837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:39.905856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383716:5418], now have 1 active actors on pipe
2025-10-02T09:29:39.905868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383649:2446], now have 1 active actors on pipe
2025-10-02T09:29:39.905875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.905878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.905880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.905890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:39.905902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:39.905908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:39.905911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:39.905913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:39.905915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:39.905918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:39.905951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.905962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:39.905977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:39.905959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 488
2025-10-02T09:29:39.905969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 488
2025-10-02T09:29:39.906023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.906032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.906053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c822d964-ad34b548-36f95672-6378838d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:39.906064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:39.906067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:39.906069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:39.906077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:39.906089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:39.906107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.906320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.906336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.906372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:39.906469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 36 sessionId: src_id|c822d964-ad34b548-36f95672-6378838d_0
2025-10-02T09:29:39.906844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4cc1b62-65bae97b-16d3fead-6bb6b7e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c822d964-ad34b548-36f95672-6378838d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:39.909528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Write session: try to update token
2025-10-02T09:29:39.909543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:39.917201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:39.917222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.917231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.917268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:39.917292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:39.917477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:39.917619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:39.917750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:39.917882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:39.918074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:39.918118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:39.923926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|c822d964-ad34b548-36f95672-6378838d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:39.926546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:39.927400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:39.927424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:39.927440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:39.927443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:39.927445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:39.927448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:39.927455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.927459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.927463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554204492862018:4764]
2025-10-02T09:29:39.927513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:39.927523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:39.927526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:39.927528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:39.927533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:39.927537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:39.927651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:39.983426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554204568383723:4901]
2025-10-02T09:29:39.983745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7556554204568383723:4901]
2025-10-02T09:29:40.068944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:40.069310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:40.069346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554204568383723:4901], now have 1 active actors on pipe
2025-10-02T09:29:40.069453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:40.069539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554204568383723:4901]
2025-10-02T09:29:40.069564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:40.077591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:40.079090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:40.079245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:40.079253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:40.079259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:40.079308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:40.079340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554208787829386:4766]
2025-10-02T09:29:40.079438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:40.079454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:40.079486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: error at write: Disconnected sessionId: src_id|c822d964-ad34b548-36f95672-6378838d_0
2025-10-02T09:29:40.079645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|c822d964-ad34b548-36f95672-6378838d_0 is DEAD
2025-10-02T09:29:40.079809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:40.079826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Write session will restart in 0.008624s
2025-10-02T09:29:40.079854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Write session: Do CDS request
2025-10-02T09:29:40.079861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:40.079890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:40.084668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:40.084750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:40.085120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:40.085194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.085200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.085201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.085203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.085204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.085205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.085206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.085208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.085209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.085210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.085212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.085214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.085219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.085232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.085235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.085238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.085241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.085245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.085249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.085253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.085257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.085261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.085264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.085268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.085277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.085285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.085290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.085295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.085299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.085303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.085307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.085312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.085321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.085325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.085329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.085337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.085342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.085350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.085354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.085358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.085367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.085372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.085380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.085384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.085393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.085398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.085402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.085410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.085444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:40.089443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.089486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:40.089504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-10-02T09:29:40.089814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.089861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:40.089871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:40.089876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:40.090304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-10-02T09:29:40.090341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:40.090349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:40.090352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:40.090360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554208863351055:5422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:40.090854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554208863351055:5422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:40.093314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554208863351055:5422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:40.094561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:40.096295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:40.096319Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:40.096321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:40.096325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:40.096332Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [2:7556554208787829386:4766]
2025-10-02T09:29:40.096346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:40.096367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:40.096376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.096379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.096381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.096395Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:40.096400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:40.096411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:40.096386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554208863351055:5422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:40.096401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554208863351055:5422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:40.096406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554208863351055:5422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:40.096414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:40.096468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.096478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.096479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.096482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:40.096484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:40.096549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:40.096557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.096572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.096588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.096609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:40.096631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351022:2446], now have 1 active actors on pipe
2025-10-02T09:29:40.096640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351088:5422], now have 1 active actors on pipe
2025-10-02T09:29:40.096645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.096647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.096649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.096663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:40.096656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 489
2025-10-02T09:29:40.096659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 489
2025-10-02T09:29:40.096682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:40.096702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:40.096705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:40.096705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:40.096708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:40.096713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:40.096752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.096763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.096774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.096782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:40.096797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:40.096831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:40.096838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.096841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.096843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:40.096852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.096862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:40.096889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.097048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.097061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.097080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.097192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 36 sessionId: src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0
2025-10-02T09:29:40.097526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c822d964-ad34b548-36f95672-6378838d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:40.100262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Write session: try to update token
2025-10-02T09:29:40.100278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:40.110409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:40.110433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:40.110435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:40.110437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:40.110448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.110452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.110456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554208787829381:4766]
2025-10-02T09:29:40.110488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:40.110494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.110496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:40.110498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:40.110505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:40.110509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:40.110623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:40.114800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:40.117339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:40.169787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554208863351098:4901]
2025-10-02T09:29:40.170058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7556554208863351098:4901]
2025-10-02T09:29:40.247995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:40.248303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.248315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.248349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351098:4901], now have 1 active actors on pipe
2025-10-02T09:29:40.248569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:40.248628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:40.248638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554208863351098:4901]
2025-10-02T09:29:40.248641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:40.248652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:40.248692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: error at write: Disconnected sessionId: src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0
2025-10-02T09:29:40.248865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0 is DEAD
2025-10-02T09:29:40.248956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:40.248962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Write session will restart in 0.006455s
2025-10-02T09:29:40.248986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Write session: Do CDS request
2025-10-02T09:29:40.248991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:40.255008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:40.256225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.256383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:40.256397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-10-02T09:29:40.256474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:40.256510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.256540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:40.256548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:40.256552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:40.256638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:40.256651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:40.256660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:40.256710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:40.256745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554208787829456:4769]
2025-10-02T09:29:40.256948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-10-02T09:29:40.256986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:40.256991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:40.256993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:40.256997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554208863351129:5427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:40.257292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:40.257511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554208863351129:5427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:40.257660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:40.257708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:40.257993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:40.258053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.258058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.258059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.258060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.258061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.258062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.258063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.258064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.258065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.258066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.258068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.258069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.258073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.258082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.258085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.258089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.258093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.258096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.258099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.258103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.258107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.258110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.258115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.258118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.258123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.258130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.258134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.258138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.258142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.258146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.258150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.258154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.258158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.258162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.258169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.258174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.258179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.258188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.258194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.258199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.258205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.258210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.258214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.258219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.258225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.258229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.258233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.258238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.258270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:40.259538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554208863351129:5427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:40.264135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554208863351129:5427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:40.264148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554208863351129:5427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:40.264152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554208863351129:5427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:40.264159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:40.266361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:40.267923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:40.267939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:40.267945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:40.267948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:40.267952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [2:7556554208787829456:4769]
2025-10-02T09:29:40.267964Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:40.267977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:40.267983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.267985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.267988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.267997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:40.268005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:40.268010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:40.268057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.268063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.268064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.268067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:40.268069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:40.268182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:40.268189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.268198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.268211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.268227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:40.268203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 490
2025-10-02T09:29:40.268220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 490
2025-10-02T09:29:40.268247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351168:5427], now have 1 active actors on pipe
2025-10-02T09:29:40.268254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351100:2446], now have 1 active actors on pipe
2025-10-02T09:29:40.268259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.268264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.268267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.268274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:40.268284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:40.268289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:40.268300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:40.268301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:40.268302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:40.268302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:40.268320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.268327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.268357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.268367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:40.268383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:40.268385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:40.268394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.268400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.268401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:40.268409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.268422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:40.268451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.268610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.268616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.268626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.268707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 36 sessionId: src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0
2025-10-02T09:29:40.269029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e083f6-a07f3801-b4f47c02-84c37d61_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:40.271323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Write session: try to update token
2025-10-02T09:29:40.271334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:40.278493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:40.278508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:40.278509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:40.278510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:40.278516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.278519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.278521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554208787829451:4769]
2025-10-02T09:29:40.278549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:40.278555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.278556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:40.278556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:40.278561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:40.278564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:40.278671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:40.283049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:40.285324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:40.348981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554208863351184:4901]
2025-10-02T09:29:40.349194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7556554208863351184:4901]
2025-10-02T09:29:40.412410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:40.412729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.412745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.412780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351184:4901], now have 1 active actors on pipe
2025-10-02T09:29:40.413003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:40.413017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:40.413007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554208863351184:4901]
2025-10-02T09:29:40.413018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:40.413023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:40.413074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0
2025-10-02T09:29:40.413231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0 is DEAD
2025-10-02T09:29:40.413545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:40.413554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Write session will restart in 0.009579s
2025-10-02T09:29:40.413575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Write session: Do CDS request
2025-10-02T09:29:40.413580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:40.422133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:40.423432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:40.423622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:40.423630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:40.423640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:40.423689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:40.423732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554208787829525:4771]
2025-10-02T09:29:40.424284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:40.424327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.424446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:40.424461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-10-02T09:29:40.424575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.424606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:40.424616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:40.424628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:40.424596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:40.424644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:40.424972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:40.424986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-10-02T09:29:40.425014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:40.425016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:40.425017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:40.425023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554208863351218:5431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:40.425033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.425039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.425040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.425041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.425043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.425044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.425045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.425047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.425048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.425049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.425050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.425051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.425056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.425066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.425072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.425075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.425079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.425082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.425085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.425089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.425092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.425097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.425100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.425103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.425110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.425116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.425122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.425127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.425133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.425138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.425142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.425151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.425155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.425165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.425169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.425179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.425183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.425188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.425192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.425197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.425201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.425210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.425214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.425222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.425228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.425238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.425243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.425251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.425284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:40.425546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554208863351218:5431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:40.427561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554208863351218:5431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:40.434034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554208863351218:5431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:40.434051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554208863351218:5431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:40.434054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554208863351218:5431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:40.434062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:40.434616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:40.436273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:40.436297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:40.436299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:40.436303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:40.436309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [2:7556554208787829525:4771]
2025-10-02T09:29:40.436324Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:40.436341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:40.436344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.436347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.436349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.436368Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:40.436378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:40.436385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:40.436446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.436460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.436462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.436465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:40.436468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:40.436530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:40.436538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.436552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.436562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.436578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:40.436597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351255:5431], now have 1 active actors on pipe
2025-10-02T09:29:40.436601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351186:2446], now have 1 active actors on pipe
2025-10-02T09:29:40.436606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.436614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.436615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.436627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:40.436646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:40.436648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:40.436652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:40.436654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:40.436660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:40.436662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:40.436694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.436697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:40.436682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 491
2025-10-02T09:29:40.436685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 491
2025-10-02T09:29:40.436726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:40.436753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.436764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.436796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:40.436849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.436859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.436861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:40.436870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.436879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:40.436898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.437063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.437077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.437091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.437170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 36 sessionId: src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0
2025-10-02T09:29:40.437521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462d1167-e1040eaf-8f57207c-e55d39f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:40.440072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Write session: try to update token
2025-10-02T09:29:40.440087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:40.448513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:40.448538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:40.448540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:40.448542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:40.448549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.448553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.448560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554208787829520:4771]
2025-10-02T09:29:40.448595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:40.448600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.448603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:40.448605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:40.448613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:40.448617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:40.448778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:40.453692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:40.456162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:40.513334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554208863351297:4901]
2025-10-02T09:29:40.513599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7556554208863351297:4901]
2025-10-02T09:29:40.585874Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:40.586219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.586231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.586263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351297:4901], now have 1 active actors on pipe
2025-10-02T09:29:40.586428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:40.586503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:40.586506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554208863351297:4901]
2025-10-02T09:29:40.586525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:40.586580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0
2025-10-02T09:29:40.586773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0 is DEAD
2025-10-02T09:29:40.586877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:40.586887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Write session will restart in 0.005112s
2025-10-02T09:29:40.586915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Write session: Do CDS request
2025-10-02T09:29:40.586921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:40.593255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.593356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:40.593371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-10-02T09:29:40.593467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.593498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:40.593507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:40.593511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:40.593932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:40.594045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-10-02T09:29:40.594081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:40.594086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:40.594088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:40.594093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554208863351330:5443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:40.594596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554208863351330:5443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:40.595451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:40.595603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:40.595612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:40.595620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:40.595659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:40.595710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554208787829643:4786]
2025-10-02T09:29:40.596239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:40.596547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:40.596585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:40.596819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554208863351330:5443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:40.596889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:40.596938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.596945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.596946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.596947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.596948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.596949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.596950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.596951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.596952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.596953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.596954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.596955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.596959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.596970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.596973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.596977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.596981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.596984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.596987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.596991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.596995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.596999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.597002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.597006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.597011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.597018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.597023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.597027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.597032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.597036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.597040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.597044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.597048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.597053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.597057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.597065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.597069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.597073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.597077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.597081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.597085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.597090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.597097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.597102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.597106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.597115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.597118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.597126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.597157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:40.602872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554208863351330:5443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:40.602890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554208863351330:5443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:40.602893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554208863351330:5443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:40.602900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:40.605731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:40.607455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:40.607471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:40.607472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:40.607475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:40.607480Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [2:7556554208787829643:4786]
2025-10-02T09:29:40.607489Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:40.607502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:40.607504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.607506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.607507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.607521Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:40.607524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:40.607529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:40.607704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.607711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.607712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.607714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:40.607716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:40.607761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:40.607771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.607784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.607793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.607808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:40.607825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.607835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.607837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.607845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:40.607859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:40.607866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:40.607871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:40.607874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:40.607876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:40.607879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:40.607888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351299:2446], now have 1 active actors on pipe
2025-10-02T09:29:40.607891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351370:5443], now have 1 active actors on pipe
2025-10-02T09:29:40.607920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.607925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 492
2025-10-02T09:29:40.607935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:40.607953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:40.607930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 492
2025-10-02T09:29:40.607989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.607995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.608017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:40.608028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.608031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.608032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:40.608040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.608048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:40.608060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.608195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.608202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.608214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.608301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0
2025-10-02T09:29:40.608601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdce2c-b1283f2d-da4b7e91-e88d7b52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:40.611310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Write session: try to update token
2025-10-02T09:29:40.611326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:40.619166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:40.619186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:40.619195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.619233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:40.619258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:40.619467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:40.619650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:40.619804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:40.619982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:40.620172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:40.620211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:40.624493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:40.627143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:40.627340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.627363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.627393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:40.627471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:40.630432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:40.630456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:40.630459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:40.630461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:40.630470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.630476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.630481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554208787829638:4786]
2025-10-02T09:29:40.630529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:40.630541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.630544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:40.630545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:40.630552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:40.630566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:40.630739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:40.686901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554208863351377:4901]
2025-10-02T09:29:40.687319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7556554208863351377:4901]
2025-10-02T09:29:40.777975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:40.785726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.785754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.785894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.785967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.786038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.786109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.786156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.786169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.786244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.786306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.786370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.786434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.786487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.786495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.786565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.786627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.786697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.786762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.786801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.786804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.786905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.786969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.787059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.787131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.787176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.787178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.787248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.787307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.787366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.787427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.787468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.787471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.787543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.787601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.787661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.787720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.787761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.787765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.787866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.787923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.787996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.788062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.788120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.788129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.788197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.788267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.788361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.788426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.788486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.788494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.788557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.788619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.788684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.788751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.788797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.788817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.788879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:40.788939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:40.789458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:40.789874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:40.789884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Write session will restart in 0.005792s
2025-10-02T09:29:40.789903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Write session: Do CDS request
2025-10-02T09:29:40.789910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:40.789515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554208863351377:4901]
2025-10-02T09:29:40.789549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:40.789553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:40.789579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: error at write: Disconnected sessionId: src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0
2025-10-02T09:29:40.789756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0 is DEAD
2025-10-02T09:29:40.789002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:40.789064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:40.789102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:40.789105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:40.789164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351377:4901], now have 1 active actors on pipe
2025-10-02T09:29:40.790205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:40.797301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.797429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:40.797446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-10-02T09:29:40.797578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.797610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:40.797615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:40.797619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:40.798159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-10-02T09:29:40.798211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:40.798220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:40.798222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:40.798228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554208863351414:5448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:40.798831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554208863351414:5448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:40.799459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:40.802099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554208863351414:5448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:40.802388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:40.802690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:40.802705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:40.802722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:40.802790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:40.802840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554208787829716:4788]
2025-10-02T09:29:40.803515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:40.803822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:40.803864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:40.804143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:40.804204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.804210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.804211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.804212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.804213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.804214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.804215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.804216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.804229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.804230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.804231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.804233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.804239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.804249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.804253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.804255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.804258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.804260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.804262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.804264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.804267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.804269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.804271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.804274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.804279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.804286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.804290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.804294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.804296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.804299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.804302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.804306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.804309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.804312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.804314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.804317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.804324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.804327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.804330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.804333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.804335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.804338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.804341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.804346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.804351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.804355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.804363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.804368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.804403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:40.805363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554208863351414:5448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:40.805381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554208863351414:5448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:40.805385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554208863351414:5448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:40.805397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:40.813690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:40.815359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:40.815381Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:40.815388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:40.815391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:40.815398Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [2:7556554208787829716:4788]
2025-10-02T09:29:40.815413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:40.815430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:40.815437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.815440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.815442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.815460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:40.815465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:40.815473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:40.815535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.815547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.815549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.815552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:40.815554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:40.815613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:40.815623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.815636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.815648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.815661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:40.815678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351459:5448], now have 1 active actors on pipe
2025-10-02T09:29:40.815686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351385:2446], now have 1 active actors on pipe
2025-10-02T09:29:40.815691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.815692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.815694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.815702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:40.815711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:40.815717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:40.815721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:40.815722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:40.815728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:40.815730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:40.815768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.815786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:40.815797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 493
2025-10-02T09:29:40.815812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 493
2025-10-02T09:29:40.815843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:40.815962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.815972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.815993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:40.816000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:40.816004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:40.816005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:40.816014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:40.816022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:40.816034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.816179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.816189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.816202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:40.816339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0
2025-10-02T09:29:40.816755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee2b78-ce609902-157ec81c-c83e7508_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:40.819342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Write session: try to update token
2025-10-02T09:29:40.819358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:40.826888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:40.826907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:40.826910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:40.826912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:40.826920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.826924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.826928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554208787829710:4788]
2025-10-02T09:29:40.826962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:40.826967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:40.826969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.826971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:40.826974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:40.826977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:40.827114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:40.832609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:40.835222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:40.889658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554208863351467:4901]
2025-10-02T09:29:40.889923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7556554208863351467:4901]
2025-10-02T09:29:40.973620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:40.974024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:40.974032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:40.974049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351467:4901], now have 1 active actors on pipe
2025-10-02T09:29:40.974375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:40.974390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:40.974454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: error at write: Disconnected sessionId: src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0
2025-10-02T09:29:40.974332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:40.974791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:40.974806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Write session will restart in 0.005045s
2025-10-02T09:29:40.974832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Write session: Do CDS request
2025-10-02T09:29:40.974840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:40.974624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0 is DEAD
2025-10-02T09:29:40.974784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554208863351467:4901]
2025-10-02T09:29:40.974799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:40.983653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.983791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:40.983812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-10-02T09:29:40.984282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:40.984346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:40.984364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:40.984374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:40.984925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-10-02T09:29:40.984978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:40.984986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:40.984990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:40.984998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554208863351494:5452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:40.985755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554208863351494:5452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:40.988137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554208863351494:5452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:40.989393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:40.994930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:40.995083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554208863351494:5452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:40.995104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554208863351494:5452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:40.995108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554208863351494:5452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:40.995121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:40.995177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:40.995187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:40.995197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:40.995258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:40.995288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554208787829790:4791]
2025-10-02T09:29:40.995866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:40.996341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:40.996424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:40.996883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:40.996966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.996975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.996976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.996978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.996979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.996981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.996982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.996984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.996985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.996986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.996987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.996989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.996995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.997005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.997009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.997013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.997017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.997020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.997024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.997027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.997031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.997035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.997038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.997046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.997054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.997063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:40.997069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.997074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:40.997078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.997083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:40.997086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.997091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:40.997096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.997101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:40.997106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.997111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:40.997115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.997120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:40.997126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.997131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:40.997138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.997143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:40.997147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.997151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:40.997155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.997160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:40.997164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.997168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:40.997204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:41.006321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:41.007913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:41.007930Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:41.007933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:41.007937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:41.007947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [2:7556554208787829790:4791]
2025-10-02T09:29:41.007965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:41.007983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:41.007986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.007988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.007990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.008004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:41.008009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:41.008019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:41.008070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.008079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.008080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.008082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:41.008087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:41.008148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:41.008155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.008166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.008179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.008196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:41.008215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.008220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.008221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.008229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:41.008243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:41.008246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351471:2446], now have 1 active actors on pipe
2025-10-02T09:29:41.008249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554208863351536:5452], now have 1 active actors on pipe
2025-10-02T09:29:41.008254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:41.008259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:41.008261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:41.008265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:41.008268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:41.008300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.008314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:41.008312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 494
2025-10-02T09:29:41.008340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:41.008338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 494
2025-10-02T09:29:41.008447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.008471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.008506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3184c42f-b8f98702-dbf27bfb-6345805_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:41.008524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.008538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.008544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:41.008562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.008584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:41.008609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.008784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.008790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.008817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.008894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 36 sessionId: src_id|3184c42f-b8f98702-dbf27bfb-6345805_0
2025-10-02T09:29:41.009294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6485fc-f12d19bb-f23fd2cc-8f030745_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3184c42f-b8f98702-dbf27bfb-6345805_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:41.012391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Write session: try to update token
2025-10-02T09:29:41.012411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:41.019246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:41.019274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.019277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:41.019280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:41.019288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.019294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.019298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554208787829784:4791]
2025-10-02T09:29:41.019345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:41.019359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.019357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:41.019365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:41.019366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:41.019370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:41.019526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:41.027767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|3184c42f-b8f98702-dbf27bfb-6345805_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:41.030904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:41.074983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554213158318844:4901]
2025-10-02T09:29:41.075258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7556554213158318844:4901]
2025-10-02T09:29:41.158289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:41.158626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.158636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.158650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158318844:4901], now have 1 active actors on pipe
2025-10-02T09:29:41.158813Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:41.158935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:41.158998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:41.159005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554213158318844:4901]
2025-10-02T09:29:41.159011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:41.159112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|3184c42f-b8f98702-dbf27bfb-6345805_0
2025-10-02T09:29:41.159361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|3184c42f-b8f98702-dbf27bfb-6345805_0 is DEAD
2025-10-02T09:29:41.159520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:41.159532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Write session will restart in 0.006909s
2025-10-02T09:29:41.159575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Write session: Do CDS request
2025-10-02T09:29:41.159580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:41.166956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:41.167253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.167498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:41.167511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-10-02T09:29:41.167585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.167613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:41.167622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:41.167625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:41.167949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-10-02T09:29:41.167977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:41.167978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:41.167979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:41.167985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554213158318882:5457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:41.168381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554213158318882:5457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:41.168717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:41.168894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:41.168904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:41.168914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:41.168965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:41.169007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554213082797161:4794]
2025-10-02T09:29:41.169428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:41.169715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:41.169749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:41.169975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:41.170024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.170030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.170031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.170032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.170033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.170034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.170034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.170035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.170035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.170036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.170037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.170037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.170041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.170047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.170049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.170051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.170053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.170055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.170058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.170060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.170062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.170066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.170068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.170070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.170074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.170078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.170082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.170085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.170088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.170091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.170095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.170098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.170101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.170104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.170106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.170110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.170112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.170115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.170117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.170120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.170122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.170125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.170127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.170129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.170131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.170134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.170136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.170138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.170156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:41.170178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554213158318882:5457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:41.175450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554213158318882:5457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:41.175468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554213158318882:5457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:41.175471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554213158318882:5457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:41.175478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:41.178293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:41.179844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:41.179861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:41.179862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:41.179867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:41.179871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [2:7556554213082797161:4794]
2025-10-02T09:29:41.179883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:41.179897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:41.179899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.179902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.179904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.179919Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:41.179928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:41.179934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:41.179983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.179990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.179992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.179994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:41.179995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:41.180039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:41.180044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.180051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.180056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.180064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:41.180074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.180076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.180077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.180082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:41.180090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:41.180098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:41.180104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:41.180112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:41.180123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:41.180124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.180125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:41.180126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:41.180134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158318921:5457], now have 1 active actors on pipe
2025-10-02T09:29:41.180133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:41.180144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158318848:2446], now have 1 active actors on pipe
2025-10-02T09:29:41.180188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 495
2025-10-02T09:29:41.180195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 495
2025-10-02T09:29:41.180264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.180274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.180293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:41.180300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.180303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.180304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:41.180312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.180319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:41.180334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.180484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.180491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.180501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.180580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 36 sessionId: src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0
2025-10-02T09:29:41.180921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3184c42f-b8f98702-dbf27bfb-6345805_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:41.183620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Write session: try to update token
2025-10-02T09:29:41.183634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:41.194687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:41.194706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.194713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.194747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:41.194750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:41.194910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:41.195040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:41.195177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:41.195296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:41.195466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:41.195456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:41.195499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:41.197688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:41.197872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.197885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.197907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:41.197977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:41.198891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:41.198904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.198907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:41.198908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:41.198916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.198922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.198926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554213082797156:4794]
2025-10-02T09:29:41.198954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:41.198954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:41.198957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:41.198960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:41.198960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.198962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:41.199087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:41.259277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554213158318929:4901]
2025-10-02T09:29:41.259517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7556554213158318929:4901]
2025-10-02T09:29:41.341521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:41.349099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.349125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.349289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.349348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.349409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.349471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.349517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.349526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.349588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.349648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.349709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.349772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.349823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.349831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.349896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.349960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.350027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.350092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.350138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.350148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.350211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.350272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.350335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.350400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.350448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.350455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.350521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.350580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.350657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.350718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.350763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.350769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.350834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.350896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.350955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.351017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.351074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.351083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.352555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:41.352635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:41.352638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:41.352681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: error at write: Disconnected sessionId: src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0
2025-10-02T09:29:41.351146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.351214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.351270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.351325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.351385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.351388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.351453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.351506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.351558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.351637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.351678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.351681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.351742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.351795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.351847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.351907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.351944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.351947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.352010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:41.352059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:41.352113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:41.352168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:41.352211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:41.352213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:41.352276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158318929:4901], now have 1 active actors on pipe
2025-10-02T09:29:41.352824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554213158318929:4901]
2025-10-02T09:29:41.352925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0 is DEAD
2025-10-02T09:29:41.353098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:41.353109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Write session will restart in 0.009118s
2025-10-02T09:29:41.353130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Write session: Do CDS request
2025-10-02T09:29:41.353137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:41.353383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:41.362093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:41.363323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.363487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:41.363503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-10-02T09:29:41.363657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.363697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:41.363705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:41.363710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:41.364019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:41.364241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-10-02T09:29:41.364289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:41.364265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:41.364297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:41.364280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:41.364300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:41.364289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:41.364307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554213158318966:5461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:41.364343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:41.364385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554213082797235:4796]
2025-10-02T09:29:41.364828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554213158318966:5461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:41.365032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:41.365350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:41.365411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:41.365737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:41.365798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.365804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.365806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.365807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.365808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.365810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.365811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.365812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.365813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.365815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.365816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.365817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.365822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.365832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.365836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.365841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.365844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.365848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.365852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.365856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.365859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.365864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.365868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.365872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.365878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.365885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.365891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.365897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.365901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.365906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.365910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.365917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.365921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.365926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.365930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.365935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.365939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.365944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.365950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.365955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.365959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.365964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.365969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.365974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.365978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.365984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.365988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.365993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.366028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:41.367162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554213158318966:5461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:41.372833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554213158318966:5461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:41.372849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554213158318966:5461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:41.372853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554213158318966:5461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:41.372860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:41.374719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:41.376304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:41.376322Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:41.376324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:41.376329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:41.376335Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [2:7556554213082797235:4796]
2025-10-02T09:29:41.376349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:41.376364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:41.376367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.376370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.376372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.376385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:41.376393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:41.376399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:41.376453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.376461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.376463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.376466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:41.376468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:41.376528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:41.376540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.376552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.376563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.376583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:41.376606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158318931:2446], now have 1 active actors on pipe
2025-10-02T09:29:41.376610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319005:5461], now have 1 active actors on pipe
2025-10-02T09:29:41.376615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.376617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.376619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.376631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:41.376644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:41.376645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:41.376651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:41.376658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:41.376660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:41.376663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:41.376654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 496
2025-10-02T09:29:41.376665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 496
2025-10-02T09:29:41.376689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.376697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:41.376699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:41.376724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.376734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.376763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:41.376774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.376779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.376780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:41.376788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.376816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:41.376835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.377119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.377131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.377151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.377247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0
2025-10-02T09:29:41.377639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35a3f4d-9aa6a02f-96d31d6b-c1fab6fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:41.380113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Write session: try to update token
2025-10-02T09:29:41.380128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:41.388733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:41.388758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.388760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:41.388762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:41.388770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.388774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.388778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554213082797230:4796]
2025-10-02T09:29:41.388834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:41.388841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.388842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:41.388844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:41.388850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:41.388853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:41.388967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:41.396233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:41.398671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:41.452874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554213158319013:4901]
2025-10-02T09:29:41.453147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7556554213158319013:4901]
2025-10-02T09:29:41.529847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:41.530081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.530095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.530113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319013:4901], now have 1 active actors on pipe
2025-10-02T09:29:41.530557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:41.530645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554213158319013:4901]
2025-10-02T09:29:41.530669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:41.530693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:41.530695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:41.530738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: error at write: Disconnected sessionId: src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0
2025-10-02T09:29:41.530896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0 is DEAD
2025-10-02T09:29:41.531051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:41.531074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Write session will restart in 0.006336s
2025-10-02T09:29:41.531095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Write session: Do CDS request
2025-10-02T09:29:41.531100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:41.538521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.538578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:41.538593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-10-02T09:29:41.538780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.538810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:41.538818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:41.538822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:41.539345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-10-02T09:29:41.539376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:41.539382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:41.539383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:41.539387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554213158319066:5475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:41.539847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554213158319066:5475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:41.542135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554213158319066:5475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:41.545255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554213158319066:5475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:41.545271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554213158319066:5475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:41.545274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554213158319066:5475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:41.545280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:41.546779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:41.548938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:41.549114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:41.549125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:41.549135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:41.549185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:41.549224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554213082797360:4809]
2025-10-02T09:29:41.549820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:41.550133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:41.550182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:41.550502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:41.550547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.550549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.550550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.550551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.550552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.550553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.550554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.550555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.550556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.550559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.550560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.550561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.550567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.550590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.550594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.550598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.550603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.550607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.550611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.550615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.550619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.550624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.550629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.550633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.550639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.550646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.550653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.550659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.550663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.550668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.550672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.550678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.550683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.550689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.550694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.550700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.550704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.550709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.550714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.550719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.550725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.550730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.550734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.550739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.550745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.550751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.550755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.550760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.550798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:41.559494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:41.561047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:41.561062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:41.561067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:41.561071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:41.561077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [2:7556554213082797360:4809]
2025-10-02T09:29:41.561093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:41.561111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:41.561118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.561121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.561124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.561139Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:41.561149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:41.561155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:41.561211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.561221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.561222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.561226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:41.561228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:41.561366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:41.561374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.561386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.561397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.561419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:41.561441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319119:5475], now have 1 active actors on pipe
2025-10-02T09:29:41.561449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319045:2446], now have 1 active actors on pipe
2025-10-02T09:29:41.561456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.561461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.561463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.561476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:41.561493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:41.561510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:41.561515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:41.561481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 497
2025-10-02T09:29:41.561525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:41.561533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:41.561540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:41.561548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.561550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:41.561555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:41.561577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.561585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.561608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:41.561617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.561621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.561626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:41.561634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.561643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:41.561659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.561719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 497
2025-10-02T09:29:41.561757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.561768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.561784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.561853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0
2025-10-02T09:29:41.562209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7d1862-a9c17692-2448f83c-e6c88aee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:41.564942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Write session: try to update token
2025-10-02T09:29:41.564958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:41.572618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:41.572635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.572637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:41.572639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:41.572646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.572650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.572653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554213082797354:4809]
2025-10-02T09:29:41.572687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:41.572693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.572695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:41.572827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:41.573391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:41.573404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:41.573407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:41.580591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:41.583196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:41.630531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554213158319134:4901]
2025-10-02T09:29:41.630808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7556554213158319134:4901]
2025-10-02T09:29:41.707317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:41.707538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.707547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.707559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319134:4901], now have 1 active actors on pipe
2025-10-02T09:29:41.707846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554213158319134:4901]
2025-10-02T09:29:41.707879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:41.707989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:41.708000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:41.708046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0
2025-10-02T09:29:41.708092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:41.708203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0 is DEAD
2025-10-02T09:29:41.708372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:41.708383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Write session will restart in 0.008829s
2025-10-02T09:29:41.708407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Write session: Do CDS request
2025-10-02T09:29:41.708413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:41.715586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:41.717155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:41.717342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:41.717355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:41.717366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:41.717421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:41.717460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554213082797434:4813]
2025-10-02T09:29:41.718053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:41.718329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:41.718383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:41.718527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.718615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:41.718626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-10-02T09:29:41.718686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:41.718728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.718749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:41.718755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:41.718758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:41.718766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.718772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.718773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.718774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.718775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.718777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.718778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.718779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.718780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.718781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.718782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.718783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.718788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.718799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.718804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.718809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.718813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.718817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.718821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.718825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.718829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.718833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.718837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.718842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.718849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.718857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.718862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.718868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.718872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.718884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.718892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.718896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.718900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.718905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.718914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.718918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.718927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.718932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.718940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.718946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.718955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.718960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.718969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.718975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.718984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.718989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.718996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.719001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.719038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:41.719117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-10-02T09:29:41.719142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:41.719143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:41.719144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:41.719148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554213158319175:5479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:41.719528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554213158319175:5479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:41.721094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554213158319175:5479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:41.726195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554213158319175:5479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:41.726209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554213158319175:5479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:41.726211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554213158319175:5479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:41.726216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:41.727549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:41.729320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:41.729341Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:41.729344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:41.729348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:41.729354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [2:7556554213082797434:4813]
2025-10-02T09:29:41.729367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:41.729383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:41.729386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.729389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.729390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.729407Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:41.729422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:41.729428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:41.729483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.729490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.729492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.729494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:41.729498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:41.729555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:41.729563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.729576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.729591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.729611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:41.729633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319136:2446], now have 1 active actors on pipe
2025-10-02T09:29:41.729640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319213:5479], now have 1 active actors on pipe
2025-10-02T09:29:41.729646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.729648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.729649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.729660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:41.729670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:41.729676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:41.729677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:41.729679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:41.729691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:41.729698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:41.729727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.729734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:41.729712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 498
2025-10-02T09:29:41.729717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 498
2025-10-02T09:29:41.729761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.729760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:41.729770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.729795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:41.729804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.729808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.729814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:41.729822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.729833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:41.729848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.729999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.730006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.730017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.730123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0
2025-10-02T09:29:41.730425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c49e9d-a1407f33-4b5d9154-8aea1a5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:41.732769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Write session: try to update token
2025-10-02T09:29:41.732782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:41.740247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:41.740265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.740267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:41.740269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:41.740277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.740282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.740286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554213082797429:4813]
2025-10-02T09:29:41.740318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:41.740320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:41.740322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:41.740325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:41.740326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.740328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:41.740466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:41.744781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:41.747208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:41.808171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554213158319228:4901]
2025-10-02T09:29:41.808496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7556554213158319228:4901]
2025-10-02T09:29:41.881733Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:41.882142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.882156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.882189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319228:4901], now have 1 active actors on pipe
2025-10-02T09:29:41.882415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:41.882438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554213158319228:4901]
2025-10-02T09:29:41.882497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:41.882504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:41.882549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:41.882553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: error at write: Disconnected sessionId: src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0
2025-10-02T09:29:41.882704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0 is DEAD
2025-10-02T09:29:41.882841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:41.882852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Write session will restart in 0.009035s
2025-10-02T09:29:41.882876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Write session: Do CDS request
2025-10-02T09:29:41.882882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:41.892040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:41.893274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.893362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:41.893379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-10-02T09:29:41.893489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:41.893521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:41.893526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:41.893529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:41.893821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:41.893940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-10-02T09:29:41.893973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:41.893975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:41.893976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:41.893981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554213158319269:5484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:41.894008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:41.894015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:41.894024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:41.894071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:41.894105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554213082797514:4816]
2025-10-02T09:29:41.894466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554213158319269:5484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:41.894678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:41.894958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:41.895007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:41.895329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:41.895406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.895411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.895412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.895413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.895414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.895416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.895416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.895418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.895418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.895419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.895421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.895422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.895426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.895436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.895440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.895445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.895448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.895452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.895456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.895459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.895463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.895467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.895470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.895474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.895480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.895487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:41.895492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.895497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:41.895502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.895507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:41.895511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.895517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:41.895521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.895525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:41.895529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.895535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:41.895539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.895545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:41.895549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.895554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:41.895558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.895564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:41.895577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.895582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.895587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.895592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.895596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.895601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.895636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:41.896719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554213158319269:5484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:41.901287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554213158319269:5484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:41.901301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554213158319269:5484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:41.901305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554213158319269:5484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:41.901312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:41.904273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:41.905882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:41.905900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:41.905902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:41.905906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:41.905912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [2:7556554213082797514:4816]
2025-10-02T09:29:41.905927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:41.905942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:41.905948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.905950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.905952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.905966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:41.905983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:41.905989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:41.906042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.906050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.906052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.906055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:41.906057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:41.906124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:41.906133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.906146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:41.906157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:41.906177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:41.906195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319229:2446], now have 1 active actors on pipe
2025-10-02T09:29:41.906199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319313:5484], now have 1 active actors on pipe
2025-10-02T09:29:41.906205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.906207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.906209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.906220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 499
2025-10-02T09:29:41.906221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:41.906239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:41.906253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:41.906256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:41.906246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 499
2025-10-02T09:29:41.906269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:41.906278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:41.906280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:41.906288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.906298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:41.906299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:41.906316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.906323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.906365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:41.906378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:41.906382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:41.906384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:41.906392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:41.906400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:41.906420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.906602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:41.906614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:41.906632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:41.906738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 36 sessionId: src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0
2025-10-02T09:29:41.907079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9322b52-ad5b83d7-db4ec422-6f92fe29_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:41.909605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Write session: try to update token
2025-10-02T09:29:41.909623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:41.917195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:41.917212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:41.917215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:41.917217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:41.917224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.917236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.917240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554213082797509:4816]
2025-10-02T09:29:41.917275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:41.917279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:41.917285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:41.917289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:41.917289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:41.917291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:41.917412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:41.922968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:41.925411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:41.982767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554213158319325:4901]
2025-10-02T09:29:41.982997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7556554213158319325:4901]
2025-10-02T09:29:42.058025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:42.058414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.058428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.058463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554213158319325:4901], now have 1 active actors on pipe
2025-10-02T09:29:42.058698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:42.059141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:42.059152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Write session will restart in 0.005321s
2025-10-02T09:29:42.059174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Write session: Do CDS request
2025-10-02T09:29:42.058733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554213158319325:4901]
2025-10-02T09:29:42.059180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:42.058762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:42.058794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:42.058796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:42.058849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0
2025-10-02T09:29:42.059008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0 is DEAD
2025-10-02T09:29:42.065266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.065365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:42.065379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-10-02T09:29:42.065508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.065547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:42.065551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:42.065556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:42.066038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-10-02T09:29:42.066068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:42.066070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:42.066071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:42.066076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554217453286635:5488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:42.066562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554217453286635:5488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:42.071048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554217453286635:5488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:42.072582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:42.074930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:42.075081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554217453286635:5488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:42.075097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554217453286635:5488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:42.075101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554217453286635:5488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:42.075109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:42.075132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:42.075141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:42.075151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:42.075206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:42.075241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554217377764889:4818]
2025-10-02T09:29:42.075839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:42.076172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:42.076224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:42.076525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:42.076595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.076602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.076603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.076604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.076605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.076607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.076608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.076608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.076609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.076610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.076611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.076612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.076616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.076627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.076630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.076634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.076638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.076642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.076646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.076650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.076654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.076660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.076664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.076668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.076675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.076682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.076688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.076693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.076697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.076702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.076707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.076718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.076724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.076728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.076737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.076743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.076751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.076766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.076776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.076781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.076785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.076790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.076796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.076820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.076828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.076832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.076840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.076875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:42.086721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:42.088422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:42.088442Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:42.088445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:42.088449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:42.088460Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [2:7556554217377764889:4818]
2025-10-02T09:29:42.088474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:42.088493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:42.088501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.088504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.088508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.088524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:42.088529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:42.088540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:42.088603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.088614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.088617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.088623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:42.088626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:42.088694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:42.088702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.088716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.088726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.088740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:42.088760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286697:5488], now have 1 active actors on pipe
2025-10-02T09:29:42.088770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286622:2446], now have 1 active actors on pipe
2025-10-02T09:29:42.088776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.088778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.088779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.088792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:42.088824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:42.088832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:42.088832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:42.088835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:42.088846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:42.088849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:42.088884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.088892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:42.088895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:42.088908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.088914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.088847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 500
2025-10-02T09:29:42.088885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 500
2025-10-02T09:29:42.088959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99811a49-ae63f7d1-cee9151d-69734301_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:42.088970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.088974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.088977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.088985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.088998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:42.089019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.089184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.089196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.089210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.089297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 36 sessionId: src_id|99811a49-ae63f7d1-cee9151d-69734301_0
2025-10-02T09:29:42.089641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c35fa153-59dcdd6d-e75b912f-99bdf7d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99811a49-ae63f7d1-cee9151d-69734301_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:42.092191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Write session: try to update token
2025-10-02T09:29:42.092209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:42.100006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:42.100020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:42.100024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:42.100026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:42.100033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.100038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.100041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554217377764884:4818]
2025-10-02T09:29:42.100072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:42.100077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.100075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:42.100079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:42.100081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:42.100086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:42.100205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:42.106295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|99811a49-ae63f7d1-cee9151d-69734301_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:42.108592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:42.158919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554217453286711:4901]
2025-10-02T09:29:42.159237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7556554217453286711:4901]
2025-10-02T09:29:42.232709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:42.233018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.233030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.233060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286711:4901], now have 1 active actors on pipe
2025-10-02T09:29:42.233226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:42.233242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:42.233255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:42.233281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554217453286711:4901]
2025-10-02T09:29:42.233296Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:29:42.233305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: error at write: Disconnected sessionId: src_id|99811a49-ae63f7d1-cee9151d-69734301_0
2025-10-02T09:29:42.233377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|99811a49-ae63f7d1-cee9151d-69734301_0 is DEAD
2025-10-02T09:29:42.233393Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_14002753114993164565_v1 is DEAD
2025-10-02T09:29:42.233486Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554135848883992:4895] disconnected; active server actors: 1
2025-10-02T09:29:42.233494Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554135848883992:4895] client user disconnected session shared/user_1_5_14002753114993164565_v1
2025-10-02T09:29:42.233513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:42.233656Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:29:42.233667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:42.233677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Write session will restart in 0.006820s
2025-10-02T09:29:42.233698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Write session: Do CDS request
2025-10-02T09:29:42.233703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:42.233753Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:42.233756Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:29:42.233763Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006717s
2025-10-02T09:29:42.239789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:42.241167Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:29:42.241221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.241393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:42.241416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:42.241419Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:29:42.241422Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-10-02T09:29:42.241428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-10-02T09:29:42.241561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:42.241572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:42.241581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:42.241555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.241577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:42.241580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:42.241584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:42.241585Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:42.241621Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:29:42.241645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:42.241682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554217377764970:4821]
2025-10-02T09:29:42.241694Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 auth for : user
2025-10-02T09:29:42.241788Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 Handle describe topics response
2025-10-02T09:29:42.241808Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 auth is DEAD
2025-10-02T09:29:42.241821Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:29:42.241852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-10-02T09:29:42.241873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:42.241874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:42.241875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:42.241878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554217453286757:5493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:42.242033Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:29:42.242079Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_6_5282540975378770401_v1
2025-10-02T09:29:42.242098Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554217453286758:5494] connected; active server actors: 1
2025-10-02T09:29:42.242109Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554217453286758:5494] session shared/user_1_6_5282540975378770401_v1
2025-10-02T09:29:42.242115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:29:42.242122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:29:42.242127Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_5282540975378770401_v1" (Sender=[1:7556554217453286753:5494], Pipe=[1:7556554217453286758:5494], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:42.242130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:29:42.242138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:29:42.242145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_5282540975378770401_v1" (Sender=[1:7556554217453286753:5494], Pipe=[1:7556554217453286758:5494], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:29:42.242152Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_5282540975378770401_v1" sender [1:7556554217453286753:5494] lock partition 0 for ReadingSession "shared/user_1_6_5282540975378770401_v1" (Sender=[1:7556554217453286753:5494], Pipe=[1:7556554217453286758:5494], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-02T09:29:42.242158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:29:42.242161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000021s
2025-10-02T09:29:42.242214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:42.242238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554217453286757:5493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:42.242282Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_5282540975378770401_v1" ClientId: "user" PipeClient { RawX1: 7556554217453286758 RawX2: 4503603922343286 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:29:42.242302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:29:42.242507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:42.242558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:42.242830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:42.242899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.242908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.242909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.242910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.242911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.242912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.242913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.242914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.242915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.242916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.242917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.242918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.242923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.242932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.242935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.242939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.242942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.242945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.242949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.242952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.242955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.242959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.242962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.242967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.242977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.242983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.242988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.242992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.242999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.243004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.243011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.243016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.243025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.243032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.243040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.243044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.243052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.243069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.243077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.243082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.243089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.243094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.243102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.243107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.243115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.243119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.243124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.243132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.243164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:42.243768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554217453286757:5493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:42.249414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554217453286757:5493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:42.249426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554217453286757:5493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:42.249430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554217453286757:5493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:42.249434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:42.251297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:42.252921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:42.252937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:42.252940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:42.252943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:42.252949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [2:7556554217377764970:4821]
2025-10-02T09:29:42.252966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:42.252984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:42.252991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.252993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.252995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.253011Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:42.253020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:42.253026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:42.253082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.253088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.253091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.253093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:42.253095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:42.253149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:42.253156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.253167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.253180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.253198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:42.253218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286712:2446], now have 1 active actors on pipe
2025-10-02T09:29:42.253228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286799:5493], now have 1 active actors on pipe
2025-10-02T09:29:42.253230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286763:5499], now have 1 active actors on pipe
2025-10-02T09:29:42.253235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.253239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.253241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.253252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:42.253265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:42.253266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:42.253267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:42.253268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:42.253279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:42.253282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:42.253268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 501
2025-10-02T09:29:42.253307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.253316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:42.253281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 501
2025-10-02T09:29:42.253317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:42.253298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7556554217453286763:5499]
2025-10-02T09:29:42.253332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.253337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.253351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.253358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.253363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_5282540975378770401_v1 on pipe: [1:7556554217453286763:5499]
2025-10-02T09:29:42.253399Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_5282540975378770401_v1:1 with generation 501
2025-10-02T09:29:42.253410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75b952c5-47295410-7678bfaf-46b05c2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:42.253415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.253418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.253420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.253427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.253442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:42.253454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.253461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.253463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.253473Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_5282540975378770401_v1
2025-10-02T09:29:42.253479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.253503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.253516Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:29:42.253609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.253620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.253633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.253696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 36 sessionId: src_id|75b952c5-47295410-7678bfaf-46b05c2c_0
2025-10-02T09:29:42.253966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99811a49-ae63f7d1-cee9151d-69734301_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75b952c5-47295410-7678bfaf-46b05c2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:42.256169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Write session: try to update token
2025-10-02T09:29:42.256180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:42.257356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:29:42.257386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:29:42.257397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.257403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.257404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.257410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:29:42.257423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:29:42.257570Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397382253 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:29:42.257593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:29:42.257627Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 sending to client partition status
2025-10-02T09:29:42.263529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:42.263549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:42.263551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:42.263553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:42.263561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.263565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.263569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554217377764965:4821]
2025-10-02T09:29:42.263600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:42.263610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.263616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:42.263627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:42.263632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:42.263636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:42.263750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:42.267096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|75b952c5-47295410-7678bfaf-46b05c2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:42.269066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:42.398378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:42.398757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.398770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.399020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_5282540975378770401_v1
2025-10-02T09:29:42.399042Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:42.399023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:42.399030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:42.399033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:42.399086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554217453286763:5499]
2025-10-02T09:29:42.399095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: error at write: Disconnected sessionId: src_id|75b952c5-47295410-7678bfaf-46b05c2c_0
2025-10-02T09:29:42.399241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|75b952c5-47295410-7678bfaf-46b05c2c_0 is DEAD
2025-10-02T09:29:42.399306Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_5282540975378770401_v1
2025-10-02T09:29:42.399385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:42.399398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Write session will restart in 0.006424s
2025-10-02T09:29:42.399419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Write session: Do CDS request
2025-10-02T09:29:42.399424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:42.408397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:42.409234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.409321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:42.409335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-10-02T09:29:42.409456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.409486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:42.409491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:42.409495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:42.409913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-10-02T09:29:42.409942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:42.409947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:42.409949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:42.409954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554217453286850:5501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:42.410224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:42.410370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:42.410382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:42.410392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:42.410416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554217453286850:5501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:42.410439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:42.410476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554217377765052:4823]
2025-10-02T09:29:42.411025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:42.411304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:42.411353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:42.411656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:42.411704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.411710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.411711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.411712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.411713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.411714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.411716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.411717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.411718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.411719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.411720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.411721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.411726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.411737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.411740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.411744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.411747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.411751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.411754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.411757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.411761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.411765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.411767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.411771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.411776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.411783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.411788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.411792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.411796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.411801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.411804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.411809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.411813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.411823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.411827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.411832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.411841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.411846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.411853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.411857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.411862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.411866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.411871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.411879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.411884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.411888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.411896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.411900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.411932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:42.411941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554217453286850:5501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:42.417536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554217453286850:5501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:42.417552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554217453286850:5501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:42.417556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554217453286850:5501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:42.417565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:42.420429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:42.422048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:42.422066Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:42.422068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:42.422072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:42.422078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [2:7556554217377765052:4823]
2025-10-02T09:29:42.422111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:42.422132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:42.422144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.422147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.422149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.422163Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:42.422169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:42.422175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:42.422232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.422241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.422244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.422246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:42.422251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:42.422315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:42.422324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.422335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.422345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.422362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:42.422409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 502
2025-10-02T09:29:42.422447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 502
2025-10-02T09:29:42.422387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286807:2446], now have 1 active actors on pipe
2025-10-02T09:29:42.422399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286889:5501], now have 1 active actors on pipe
2025-10-02T09:29:42.422405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.422407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.422409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.422422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:42.422435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:42.422450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:42.422453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:42.422460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:42.422463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:42.422465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:42.422482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.422486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:42.422487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:42.422589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.422593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.422614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:42.422620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.422625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.422627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.422634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.422644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:42.422656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.422827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.422836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.422853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.422943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 36 sessionId: src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0
2025-10-02T09:29:42.423289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b952c5-47295410-7678bfaf-46b05c2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:42.425936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Write session: try to update token
2025-10-02T09:29:42.425952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:42.433313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:42.433329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:42.433332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:42.433334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:42.433344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.433352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.433355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554217377765047:4823]
2025-10-02T09:29:42.433392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:42.433398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.433400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:42.433401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:42.433406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:42.433410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:42.433523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:42.439137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:42.441391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:42.499363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554217453286908:5499]
2025-10-02T09:29:42.499578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7556554217453286908:5499]
2025-10-02T09:29:42.558300Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:42.558489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.558498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.558522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286908:5499], now have 1 active actors on pipe
2025-10-02T09:29:42.558666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:42.558654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:42.558690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:42.558692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:42.558734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: error at write: Disconnected sessionId: src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0
2025-10-02T09:29:42.558889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0 is DEAD
2025-10-02T09:29:42.558997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554217453286908:5499]
2025-10-02T09:29:42.559110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:42.559118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Write session will restart in 0.006678s
2025-10-02T09:29:42.559131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Write session: Do CDS request
2025-10-02T09:29:42.559135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:42.564054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:42.565754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:42.565865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:42.565872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:42.565880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:42.565914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:42.565939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554217377765174:4836]
2025-10-02T09:29:42.566358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:42.566617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:42.566649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:42.566888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:42.566932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.566937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.566938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.566939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.566940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.566941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.566942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.566944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.566944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.566945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.566946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.566947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.566952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.566960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.566964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.566968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.566971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.566975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.566978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.566982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.566985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.566989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.566993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.566995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.567000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.567006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.567012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.567016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.567020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.567023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.567027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.567032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.567041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.567046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.567049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.567054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.567067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.567072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.567076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.567080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.567084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.567088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.567096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.567101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.567109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.567114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.567119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.567124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.567160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:42.567185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.567322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:42.567332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-10-02T09:29:42.567451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.567470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:42.567472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:42.567474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:42.567721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-10-02T09:29:42.567748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:42.567749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:42.567751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:42.567755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554217453286980:5513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:42.568134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554217453286980:5513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:42.569430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554217453286980:5513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:42.574393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554217453286980:5513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:42.574405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554217453286980:5513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:42.574407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554217453286980:5513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:42.574412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:42.575073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:42.576621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:42.576632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:42.576633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:42.576636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:42.576642Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [2:7556554217377765174:4836]
2025-10-02T09:29:42.576652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:42.576667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:42.576673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.576675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.576676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.576685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:42.576689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:42.576697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:42.576733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.576738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.576739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.576740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:42.576742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:42.576788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:42.576795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.576822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.576835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.576853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:42.576872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453286924:2446], now have 1 active actors on pipe
2025-10-02T09:29:42.576878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287011:5513], now have 1 active actors on pipe
2025-10-02T09:29:42.576882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.576884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.576885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.576895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:42.576907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:42.576911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:42.576913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:42.576914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:42.576922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:42.576925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:42.576911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 503
2025-10-02T09:29:42.576912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 503
2025-10-02T09:29:42.576948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.576954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:42.576955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:42.576967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.576974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.577007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:42.577016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.577021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.577022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.577029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.577039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:42.577056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.577169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.577176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.577186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.577245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 36 sessionId: src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0
2025-10-02T09:29:42.577527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6071a9a9-a8f421e2-b1f32ba3-677d8ab2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:42.579816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Write session: try to update token
2025-10-02T09:29:42.579828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:42.587122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:42.587138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:42.587139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:42.587143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:42.587148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.587151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.587154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554217377765169:4836]
2025-10-02T09:29:42.587179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:42.587185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.587185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:42.587187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:42.587188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:42.587191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:42.587303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:42.591337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:42.593482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:42.659131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554217453287019:5499]
2025-10-02T09:29:42.659331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7556554217453287019:5499]
2025-10-02T09:29:42.713096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:42.713317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.713328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.713361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287019:5499], now have 1 active actors on pipe
2025-10-02T09:29:42.713517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:42.713586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:42.713588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554217453287019:5499]
2025-10-02T09:29:42.713603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:42.713653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0
2025-10-02T09:29:42.713798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0 is DEAD
2025-10-02T09:29:42.713934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:42.713943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Write session will restart in 0.007935s
2025-10-02T09:29:42.713961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Write session: Do CDS request
2025-10-02T09:29:42.713966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:42.719401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:42.720611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:42.720729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:42.720736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:42.720742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:42.720770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:42.720796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554217377765261:4840]
2025-10-02T09:29:42.721175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:42.721366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:42.721389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:42.721588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:42.721623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.721626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.721627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.721627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.721628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.721628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.721629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.721629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.721630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.721630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.721631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.721632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.721635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.721641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.721643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.721645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.721648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.721650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.721652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.721654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.721656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.721658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.721660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.721662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.721667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.721672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.721675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.721678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.721683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.721686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.721689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.721695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.721697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.721700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.721702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.721705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.721707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.721710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.721712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.721714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.721720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.721723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.721726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.721731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.721734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.721736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.721741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.721743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.721760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:42.723222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.723344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:42.723354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-10-02T09:29:42.723449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.723468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:42.723473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:42.723476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:42.723818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-10-02T09:29:42.723846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:42.723851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:42.723853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:42.723857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554217453287067:5517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:42.724278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554217453287067:5517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:42.725668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554217453287067:5517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:42.729192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554217453287067:5517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:42.729202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554217453287067:5517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:42.729204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554217453287067:5517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:42.729213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:42.729844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:42.731382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:42.731396Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:42.731398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:42.731401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:42.731406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [2:7556554217377765261:4840]
2025-10-02T09:29:42.731417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:42.731430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:42.731439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.731445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.731446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.731458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:42.731465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:42.731471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:42.731516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.731522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.731523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.731525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:42.731527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:42.731577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:42.731583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.731592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.731604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.731620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:42.731638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287102:5517], now have 1 active actors on pipe
2025-10-02T09:29:42.731645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287020:2446], now have 1 active actors on pipe
2025-10-02T09:29:42.731650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.731655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.731657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.731668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:42.731681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:42.731689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:42.731692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:42.731694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:42.731701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:42.731703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:42.731716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.731711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 504
2025-10-02T09:29:42.731725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:42.731717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 504
2025-10-02T09:29:42.731748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.731747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:42.731751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.731769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1325d6-86c3152-63b23181-91201fd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:42.731779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.731782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.731783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.731791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.731800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:42.731812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.731938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.731945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.731954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.732046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba1325d6-86c3152-63b23181-91201fd1_0
2025-10-02T09:29:42.732372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19bbc22-fb2285c3-7c4444ac-5867f015_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba1325d6-86c3152-63b23181-91201fd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:42.735153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Write session: try to update token
2025-10-02T09:29:42.735168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:42.741831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:42.741845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:42.741847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:42.741849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:42.741860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.741863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.741868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554217377765256:4840]
2025-10-02T09:29:42.741897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:42.741899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:42.741902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.741902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:42.741904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:42.741905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:42.742018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:42.752681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|ba1325d6-86c3152-63b23181-91201fd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:42.754842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:42.813728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554217453287118:5499]
2025-10-02T09:29:42.813986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7556554217453287118:5499]
2025-10-02T09:29:42.868689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:42.869037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.869053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.869072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287118:5499], now have 1 active actors on pipe
2025-10-02T09:29:42.869262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:42.869274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:42.869289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:42.869294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:42.869343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554217453287118:5499]
2025-10-02T09:29:42.869452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: error at write: Disconnected sessionId: src_id|ba1325d6-86c3152-63b23181-91201fd1_0
2025-10-02T09:29:42.869611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|ba1325d6-86c3152-63b23181-91201fd1_0 is DEAD
2025-10-02T09:29:42.869743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:42.869753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Write session will restart in 0.005055s
2025-10-02T09:29:42.869774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Write session: Do CDS request
2025-10-02T09:29:42.869781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:42.876246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.876291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:42.876309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-10-02T09:29:42.876302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:42.876432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:42.876454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:42.876457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:42.876459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:42.876751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-10-02T09:29:42.876777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:42.876779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:42.876781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:42.876784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554217453287162:5522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:42.877139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554217453287162:5522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:42.877933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:42.878065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:42.878073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:42.878081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:42.878121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:42.878153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554217377765345:4843]
2025-10-02T09:29:42.878668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:42.878820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554217453287162:5522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:42.878884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:42.878924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:42.879219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:42.879266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.879271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.879272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.879273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.879274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.879275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.879276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.879278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.879279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.879280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.879281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.879282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.879287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.879296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.879300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.879304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.879307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.879311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.879315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.879318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.879322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.879326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.879329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.879331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.879336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.879340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:42.879343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.879345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:42.879348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.879350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:42.879353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.879356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:42.879358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.879361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:42.879363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.879366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:42.879368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.879371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:42.879374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.879377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:42.879379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.879382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:42.879384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.879387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.879389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.879391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.879393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.879396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.879414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:42.883499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554217453287162:5522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:42.883509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554217453287162:5522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:42.883511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554217453287162:5522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:42.883516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:42.887527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:42.888974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:42.888985Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:42.888987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:42.888989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:42.888994Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [2:7556554217377765345:4843]
2025-10-02T09:29:42.889003Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:42.889014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:42.889016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.889018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.889019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.889030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:42.889036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:42.889041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:42.889075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.889080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.889080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.889082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:42.889085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:42.889129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:42.889135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.889145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:42.889158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:42.889175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:42.889194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287202:5522], now have 1 active actors on pipe
2025-10-02T09:29:42.889202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287119:2446], now have 1 active actors on pipe
2025-10-02T09:29:42.889206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.889207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.889208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.889217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:42.889227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:42.889234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:42.889236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:42.889239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:42.889242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:42.889244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:42.889258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.889240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 505
2025-10-02T09:29:42.889260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:42.889266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:42.889284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.889246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 505
2025-10-02T09:29:42.889287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.889310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:42.889319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:42.889322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:42.889323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:42.889331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:42.889337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:42.889349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.889463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:42.889469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:42.889478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:42.889529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 36 sessionId: src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0
2025-10-02T09:29:42.889789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1325d6-86c3152-63b23181-91201fd1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:42.892082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Write session: try to update token
2025-10-02T09:29:42.892095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:42.898928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:42.898944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:42.898946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:42.898947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:42.898955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.898958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.898961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554217377765340:4843]
2025-10-02T09:29:42.898990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:42.898994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:42.898995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:42.899103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:42.899116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:42.899119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:42.899119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:42.903804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:42.906130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:42.969393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554217453287210:5499]
2025-10-02T09:29:42.969650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7556554217453287210:5499]
2025-10-02T09:29:43.029114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:43.029421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.029433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.029464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554217453287210:5499], now have 1 active actors on pipe
2025-10-02T09:29:43.029669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:43.029681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:43.029727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: error at write: Disconnected sessionId: src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0
2025-10-02T09:29:43.029730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554217453287210:5499]
2025-10-02T09:29:43.029721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:43.029756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:43.029889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0 is DEAD
2025-10-02T09:29:43.030056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:43.030067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Write session will restart in 0.009700s
2025-10-02T09:29:43.030091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Write session: Do CDS request
2025-10-02T09:29:43.030097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:43.036133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:43.037788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:43.037945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:43.037953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:43.037963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:43.038013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:43.038049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554221672732724:4845]
2025-10-02T09:29:43.038444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:43.038644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:43.038679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:43.038937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:43.038994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.038999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.038999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.039000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.039001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.039002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.039003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.039004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.039006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.039007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.039008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.039009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.039013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.039023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.039027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.039030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.039035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.039038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.039041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.039043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.039046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.039049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.039052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.039063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.039069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.039075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.039084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.039093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.039100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.039106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.039114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.039122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.039130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.039139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.039147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.039155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.039163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.039171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.039175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.039183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.039191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.039196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.039204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.039212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.039220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.039228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.039235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.039244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.039281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:43.041287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.041383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:43.041397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-10-02T09:29:43.041490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.041513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:43.041517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:43.041520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:43.041879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-10-02T09:29:43.041902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:43.041903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:43.041904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:43.041907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554221748254557:5526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:43.042269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554221748254557:5526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:43.043768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554221748254557:5526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:43.046419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554221748254557:5526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:43.046431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554221748254557:5526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:43.046434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554221748254557:5526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:43.046440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:43.047036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:43.048504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:43.048519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:43.048522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:43.048526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:43.048532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [2:7556554221672732724:4845]
2025-10-02T09:29:43.048544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:43.048564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:43.048570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.048572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.048575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.048588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:43.048596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:43.048602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:43.048645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.048651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.048653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.048656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:43.048658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:43.048716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:43.048723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.048733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.048747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.048766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:43.048788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254591:5526], now have 1 active actors on pipe
2025-10-02T09:29:43.048795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254507:2446], now have 1 active actors on pipe
2025-10-02T09:29:43.048816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.048822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.048825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.048836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:43.048850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:43.048854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:43.048858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:43.048860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:43.048867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:43.048870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:43.048854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 506
2025-10-02T09:29:43.048880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 506
2025-10-02T09:29:43.048891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.048898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:43.048903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:43.048910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.048915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.048946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:43.048952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.048956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.048961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:43.048967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.048973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:43.048998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.049165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.049172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.049181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.049248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0
2025-10-02T09:29:43.049544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84d9b-cd38fbe7-d84cb4ed-1c389f9f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:43.052017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Write session: try to update token
2025-10-02T09:29:43.052035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:43.058844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:43.058859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.058860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:43.058862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:43.058869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.058874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.058876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554221672732719:4845]
2025-10-02T09:29:43.058903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:43.058911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.058912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:43.058939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:43.058959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:43.058964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:43.059035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:43.064176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:43.066379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:43.129623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554221748254601:5499]
2025-10-02T09:29:43.129891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7556554221748254601:5499]
2025-10-02T09:29:43.184776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:43.185039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.185050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.185067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254601:5499], now have 1 active actors on pipe
2025-10-02T09:29:43.185288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:43.185287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:43.185300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:43.185311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554221748254601:5499]
2025-10-02T09:29:43.185330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:43.185369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: error at write: Disconnected sessionId: src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0
2025-10-02T09:29:43.185556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0 is DEAD
2025-10-02T09:29:43.185700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:43.185711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Write session will restart in 0.009443s
2025-10-02T09:29:43.185735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Write session: Do CDS request
2025-10-02T09:29:43.185741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:43.193106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:43.194806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:43.194922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:43.194929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:43.194936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:43.194964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:43.194990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554221672732810:4848]
2025-10-02T09:29:43.195387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:43.195674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:43.195701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:43.195914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:43.195952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.195956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.195957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.195958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.195958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.195959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.195960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.195960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.195961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.195961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.195962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.195962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.195965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.195972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.195974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.195976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.195978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.195981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.195983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.195985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.195987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.195989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.195991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.195993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.195997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.196001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.196006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.196009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.196011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.196014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.196016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.196019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.196021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.196024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.196027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.196029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.196032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.196035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.196037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.196040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.196042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.196045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.196047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.196050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.196056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.196061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.196065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.196070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.196102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:43.196229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.196329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:43.196343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-10-02T09:29:43.196440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.196466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:43.196475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:43.196479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:43.196855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-10-02T09:29:43.196891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:43.196900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:43.196903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:43.196908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554221748254653:5531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:43.197396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554221748254653:5531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:43.198947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554221748254653:5531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:43.203917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554221748254653:5531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:43.203937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554221748254653:5531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:43.203940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554221748254653:5531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:43.203948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:43.204476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:43.205974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:43.205988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:43.205990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:43.205994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:43.205999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [2:7556554221672732810:4848]
2025-10-02T09:29:43.206010Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:43.206023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:43.206029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.206034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.206036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.206049Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:43.206053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:43.206059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:43.206104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.206111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.206113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.206115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:43.206118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:43.206173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:43.206179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.206191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.206204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.206220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:43.206240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254687:5531], now have 1 active actors on pipe
2025-10-02T09:29:43.206248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254602:2446], now have 1 active actors on pipe
2025-10-02T09:29:43.206253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.206255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.206257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.206267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:43.206281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:43.206280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:43.206282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:43.206284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:43.206297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:43.206299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:43.206324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.206336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:43.206343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:43.206328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 507
2025-10-02T09:29:43.206332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 507
2025-10-02T09:29:43.206377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.206385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.206406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|696326fa-35e732ea-50ba35a7-dffbe501_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:43.206415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.206418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.206420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:43.206427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.206438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:43.206453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.206560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.206566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.206576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.206635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 36 sessionId: src_id|696326fa-35e732ea-50ba35a7-dffbe501_0
2025-10-02T09:29:43.206903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9ff61f-4db92bc4-bd1e33c9-640305df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|696326fa-35e732ea-50ba35a7-dffbe501_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:43.209267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Write session: try to update token
2025-10-02T09:29:43.209281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:43.221876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|696326fa-35e732ea-50ba35a7-dffbe501_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:43.222754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:43.222771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.222776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.222816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:43.222834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:43.222969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:43.223114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:43.223253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:43.223403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:43.223630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:43.223674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:43.224132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:43.224334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.224345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.224368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:43.224454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:43.225392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:43.225404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.225406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:43.225407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:43.225414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.225418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.225422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554221672732805:4848]
2025-10-02T09:29:43.225447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:43.225455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.225457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:43.225459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:43.225466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:43.225469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:43.225564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:43.285291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554221748254695:5499]
2025-10-02T09:29:43.285815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7556554221748254695:5499]
2025-10-02T09:29:43.353386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:43.360326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.360349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.360490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.360547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.360596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.360657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.360699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.360706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.360760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.360825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.360876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.360929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.360965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.360970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.361028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.361081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.361134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.361184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.361221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.361228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.361279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.361328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.361379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.361430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.361468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.361473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.361533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.361587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.361637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.361685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.361723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.361728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.361794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.361840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.361889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.361942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.362064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.362073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.362124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.362168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.362404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.362455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.362504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.362509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.362566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.362620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.362668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.362717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.362752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.362757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.362807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.362854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.362910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.362963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.362997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.363002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.363098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:43.363146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:43.363193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:43.363241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:43.363289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:43.363294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:43.363327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254695:5499], now have 1 active actors on pipe
2025-10-02T09:29:43.363527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554221748254695:5499]
2025-10-02T09:29:43.363534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:43.363539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:43.363551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:43.363575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|696326fa-35e732ea-50ba35a7-dffbe501_0
2025-10-02T09:29:43.363739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|696326fa-35e732ea-50ba35a7-dffbe501_0 is DEAD
2025-10-02T09:29:43.363759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:43.363860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:43.363868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Write session will restart in 0.007604s
2025-10-02T09:29:43.363883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Write session: Do CDS request
2025-10-02T09:29:43.363887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:43.370894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:43.372207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.372229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:43.372280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:43.372290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-10-02T09:29:43.372362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:43.372368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:43.372374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:43.372386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.372406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:43.372410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:43.372419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:43.372424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:43.372431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554221672732895:4850]
2025-10-02T09:29:43.372761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-10-02T09:29:43.372787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:43.372793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:43.372794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:43.372799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554221748254744:5535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:43.372793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:43.373025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:43.373054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:43.373179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554221748254744:5535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:43.373246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:43.373278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.373282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.373283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.373283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.373284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.373285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.373285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.373286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.373286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.373287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.373287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.373288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.373291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.373297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.373299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.373302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.373304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.373306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.373308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.373310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.373312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.373314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.373317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.373319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.373323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.373327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.373330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.373333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.373335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.373338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.373340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.373343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.373345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.373348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.373350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.373353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.373356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.373358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.373360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.373363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.373365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.373368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.373370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.373373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.373375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.373383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.373385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.373388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.373405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:43.375543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554221748254744:5535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:43.380062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554221748254744:5535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:43.380076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554221748254744:5535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:43.380080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554221748254744:5535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:43.380087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:43.381488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:43.383311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:43.383329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:43.383334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:43.383336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:43.383342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [2:7556554221672732895:4850]
2025-10-02T09:29:43.383354Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:43.383366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:43.383369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.383376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.383378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.383390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:43.383398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:43.383403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:43.383448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.383455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.383457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.383459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:43.383461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:43.383519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:43.383525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.383537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.383550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.383567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:43.383588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254783:5535], now have 1 active actors on pipe
2025-10-02T09:29:43.383595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254696:2446], now have 1 active actors on pipe
2025-10-02T09:29:43.383600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.383607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.383609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.383621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:43.383632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:43.383637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:43.383639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:43.383640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:43.383650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:43.383632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 508
2025-10-02T09:29:43.383653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:43.383639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 508
2025-10-02T09:29:43.383678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.383687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:43.383689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:43.383703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.383710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.383746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:43.383756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.383763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.383765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:43.383771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.383782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:43.383800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.383936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.383944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.383954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.384045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 36 sessionId: src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0
2025-10-02T09:29:43.384301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696326fa-35e732ea-50ba35a7-dffbe501_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:43.386764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Write session: try to update token
2025-10-02T09:29:43.386779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:43.394118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:43.394134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.394137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:43.394139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:43.394147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.394151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.394155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554221672732890:4850]
2025-10-02T09:29:43.394192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:43.394197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.394210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:43.394210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:43.394215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:43.394219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:43.394332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:43.398721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:43.400971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:43.463471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554221748254791:5499]
2025-10-02T09:29:43.463725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7556554221748254791:5499]
2025-10-02T09:29:43.528980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:43.529218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.529227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.529254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254791:5499], now have 1 active actors on pipe
2025-10-02T09:29:43.529414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:43.529505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:43.529510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554221748254791:5499]
2025-10-02T09:29:43.529520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:43.529529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:43.529578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0
2025-10-02T09:29:43.529747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0 is DEAD
2025-10-02T09:29:43.529885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:43.529892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Write session will restart in 0.009334s
2025-10-02T09:29:43.529918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Write session: Do CDS request
2025-10-02T09:29:43.529922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:43.538383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:43.540060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:43.540224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:43.540233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:43.540243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:43.540304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.540294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:43.540335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554221672732993:4853]
2025-10-02T09:29:43.540400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:43.540414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-10-02T09:29:43.540552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.540583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:43.540591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:43.540595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:43.540908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:43.540975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-10-02T09:29:43.541014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:43.541023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:43.541025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:43.541029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554221748254852:5540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:43.541179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:43.541220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:43.541496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:43.541549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.541555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.541556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.541557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.541558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.541559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.541560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.541552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554221748254852:5540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:43.541561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.541562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.541562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.541563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.541564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.541569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.541578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.541582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.541585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.541589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.541592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.541595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.541599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.541602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.541606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.541609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.541612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.541618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.541625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.541630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.541635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.541640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.541644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.541648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.541652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.541656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.541660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.541669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.541673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.541677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.541686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.541690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.541694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.541698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.541702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.541706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.541710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.541714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.541719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.541722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.541726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.541758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:43.543568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554221748254852:5540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:43.548947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554221748254852:5540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:43.548962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554221748254852:5540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:43.548966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554221748254852:5540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:43.548973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:43.550334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:43.552023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:43.552044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:43.552047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:43.552051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:43.552058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [2:7556554221672732993:4853]
2025-10-02T09:29:43.552072Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:43.552093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:43.552101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.552104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.552107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.552126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:43.552134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:43.552143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:43.552204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.552210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.552212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.552215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:43.552217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:43.552279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:43.552287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.552300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.552315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.552335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:43.552358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254892:5540], now have 1 active actors on pipe
2025-10-02T09:29:43.552365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254804:2446], now have 1 active actors on pipe
2025-10-02T09:29:43.552371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.552377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.552379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.552390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:43.552408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:43.552407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:43.552410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:43.552412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:43.552427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:43.552434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:43.552444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 509
2025-10-02T09:29:43.552467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.552448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 509
2025-10-02T09:29:43.552474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:43.552476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:43.552511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.552518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.552542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:43.552552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.552559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.552560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:43.552569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.552580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:43.552596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.552742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.552750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.552765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.552862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 36 sessionId: src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0
2025-10-02T09:29:43.553163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343e1d0d-d9deeaaf-28f588b0-31c37434_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:43.555804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Write session: try to update token
2025-10-02T09:29:43.555820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:43.564051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:43.564071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.564079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.564122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:43.564128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:43.564427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:43.564666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:43.564912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:43.565131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:43.565393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:43.565438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:43.569777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:43.572301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:43.573332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.573355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.573371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:43.573374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.573376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:43.573378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:43.573386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.573389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.573393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554221672732988:4853]
2025-10-02T09:29:43.573427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:43.573432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:43.573437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:43.573437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.573439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:43.573440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:43.573558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:43.629877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554221748254923:5499]
2025-10-02T09:29:43.630189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7556554221748254923:5499]
2025-10-02T09:29:43.718747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:43.719007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:43.719045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254923:5499], now have 1 active actors on pipe
2025-10-02T09:29:43.719172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:43.719230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:43.719272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:43.719278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554221748254923:5499]
2025-10-02T09:29:43.719280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:43.719345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: error at write: Disconnected sessionId: src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0
2025-10-02T09:29:43.719506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0 is DEAD
2025-10-02T09:29:43.719629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:43.719640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Write session will restart in 0.008713s
2025-10-02T09:29:43.719661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Write session: Do CDS request
2025-10-02T09:29:43.719669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:43.727561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:43.729502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:43.729688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:43.729696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:43.729705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:43.729749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:43.729784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554221672733117:4867]
2025-10-02T09:29:43.729924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.730006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:43.730020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-10-02T09:29:43.730132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.730157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:43.730169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:43.730174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:43.730328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:43.730531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-10-02T09:29:43.730560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:43.730566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:43.730567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:43.730572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554221748254976:5551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:43.730602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:43.730646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:43.730946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:43.730998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.731003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.731004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.731005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.731006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.731008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.731009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.731010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.731011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.731013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.731016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.731017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.731021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.731031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.731034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.731037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.731040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.731043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.731047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.731050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.731053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.731067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.731071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.731074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.731074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554221748254976:5551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:43.731081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.731087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.731092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.731098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.731102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.731106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.731110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.731114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.731121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.731125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.731132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.731137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.731145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.731150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.731154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.731158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.731166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.731171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.731175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.731179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.731186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.731190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.731194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.731200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.731230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:43.733155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554221748254976:5551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:43.738596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554221748254976:5551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:43.738610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554221748254976:5551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:43.738613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554221748254976:5551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:43.738620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:43.739526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:43.741060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:43.741081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:43.741083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:43.741087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:43.741093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [2:7556554221672733117:4867]
2025-10-02T09:29:43.741105Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:43.741118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:43.741121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.741124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.741126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.741140Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:43.741145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:43.741151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:43.741198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.741208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.741209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.741212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:43.741214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:43.741274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:43.741281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.741314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.741329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.741350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:43.741371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748254925:2446], now have 1 active actors on pipe
2025-10-02T09:29:43.741378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748255016:5551], now have 1 active actors on pipe
2025-10-02T09:29:43.741384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.741386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.741388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.741400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:43.741415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:43.741433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:43.741439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:43.741440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:43.741441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:43.741444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:43.741467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.741479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:43.741502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:43.741497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 510
2025-10-02T09:29:43.741528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 510
2025-10-02T09:29:43.741622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.741631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.741652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:43.741660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.741665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.741671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:43.741680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.741687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:43.741701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.741877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.741888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.741907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.742014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0
2025-10-02T09:29:43.742348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afc93-53fbde7a-6990ff7-d9cb2a64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:43.744787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Write session: try to update token
2025-10-02T09:29:43.744823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:43.757616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:43.757640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.757643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:43.757645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:43.757654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.757659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.757663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554221672733112:4867]
2025-10-02T09:29:43.757698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:43.757703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.757705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:43.757740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:43.757752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:43.757756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:43.757841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:43.758755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:43.761275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:43.819337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554221748255031:5499]
2025-10-02T09:29:43.819629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7556554221748255031:5499]
2025-10-02T09:29:43.889221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:43.889467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.889477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.889505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748255031:5499], now have 1 active actors on pipe
2025-10-02T09:29:43.889695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:43.889749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554221748255031:5499]
2025-10-02T09:29:43.889753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:43.889776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:43.889833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0
2025-10-02T09:29:43.889996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0 is DEAD
2025-10-02T09:29:43.890168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:43.890189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Write session will restart in 0.007167s
2025-10-02T09:29:43.890208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Write session: Do CDS request
2025-10-02T09:29:43.890214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:43.898185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.898305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:43.898321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-10-02T09:29:43.898466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:43.898496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:43.898505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:43.898509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:43.898888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-10-02T09:29:43.898919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:43.898924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:43.898925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:43.898929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554221748255081:5556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:43.898967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:43.899428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554221748255081:5556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:43.899533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:43.899665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:43.899673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:43.899682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:43.899727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:43.899759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554221672733208:4870]
2025-10-02T09:29:43.900112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:43.900393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:43.900430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:43.900697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:43.900755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.900761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.900762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.900763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.900764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.900765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.900766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.900767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.900768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.900769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.900770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.900773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.900777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.900786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.900790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.900793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.900797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.900816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.900819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.900822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.900826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.900830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.900834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.900837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.900843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.900849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:43.900854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.900859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:43.900863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.900867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:43.900872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.900876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:43.900881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.900885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:43.900889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.900894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:43.900898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.900904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:43.900907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.900911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:43.900915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.900920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:43.900925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.900929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.900937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.900942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.900946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.900951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.900987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:43.901327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554221748255081:5556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:43.906103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554221748255081:5556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:43.906115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554221748255081:5556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:43.906117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554221748255081:5556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:43.906122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:43.908962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:43.910450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:43.910468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:43.910470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:43.910474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:43.910480Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [2:7556554221672733208:4870]
2025-10-02T09:29:43.910491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:43.910512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:43.910519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.910522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.910524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.910537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:43.910547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:43.910557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:43.910609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.910616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.910621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.910624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:43.910627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:43.910685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:43.910693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.910706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:43.910722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:43.910743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:43.910764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748255032:2446], now have 1 active actors on pipe
2025-10-02T09:29:43.910768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748255123:5556], now have 1 active actors on pipe
2025-10-02T09:29:43.910773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.910775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.910777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.910788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:43.910800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:43.910800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:43.910803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:43.910804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:43.910813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:43.910816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:43.910846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.910857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:43.910805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 511
2025-10-02T09:29:43.910812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 511
2025-10-02T09:29:43.910871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.910878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.910896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:43.910923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:43.910933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:43.910936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:43.910938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:43.910946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:43.910957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:43.910977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.911141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:43.911148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:43.911161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:43.911218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0
2025-10-02T09:29:43.911519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ab922b-50e8381f-ed38bfd0-47641e14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:43.913848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Write session: try to update token
2025-10-02T09:29:43.913864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:43.921022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:43.921039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:43.921046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:43.921047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:43.921055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.921059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.921062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554221672733203:4870]
2025-10-02T09:29:43.921094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:43.921100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:43.921102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:43.921103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:43.921108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:43.921112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:43.921219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:43.925620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:43.927877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:43.989812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554221748255130:5499]
2025-10-02T09:29:43.990068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7556554221748255130:5499]
2025-10-02T09:29:44.046178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:44.046487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.046501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.046532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554221748255130:5499], now have 1 active actors on pipe
2025-10-02T09:29:44.046676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:44.046747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:44.046749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:44.046763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:44.046790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554221748255130:5499]
2025-10-02T09:29:44.046819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0
2025-10-02T09:29:44.047015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0 is DEAD
2025-10-02T09:29:44.047128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:44.047136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Write session will restart in 0.005702s
2025-10-02T09:29:44.047153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Write session: Do CDS request
2025-10-02T09:29:44.047157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:44.053853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:44.054223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.054285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:44.054297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-10-02T09:29:44.054387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.054414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:44.054423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:44.054426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:44.054774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-10-02T09:29:44.054803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:44.054809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:44.054811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:44.054815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554226043222478:5560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:44.055250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554226043222478:5560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:44.055705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:44.055852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:44.055860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:44.055869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:44.055911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:44.055943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554225967700594:4872]
2025-10-02T09:29:44.056440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:44.056739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:44.056775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:44.056931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554226043222478:5560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:44.057047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:44.057101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.057106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.057107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.057108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.057109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.057110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.057111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.057112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.057115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.057115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.057116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.057117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.057121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.057131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.057134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.057138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.057141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.057145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.057148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.057152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.057155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.057159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.057161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.057164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.057171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.057177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.057181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.057185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.057189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.057193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.057196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.057200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.057205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.057212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.057216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.057220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.057223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.057228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.057231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.057235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.057241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.057245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.057248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.057252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.057256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.057264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.057267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.057272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.057301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:44.061594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554226043222478:5560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:44.061608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554226043222478:5560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:44.061611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554226043222478:5560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:44.061617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:44.065473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:44.067204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:44.067218Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:44.067221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:44.067224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:44.067229Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [2:7556554225967700594:4872]
2025-10-02T09:29:44.067242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:44.067256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:44.067259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.067262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.067263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.067279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:44.067289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:44.067294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:44.067347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.067353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.067355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.067358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:44.067360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:44.067413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:44.067421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.067432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.067446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.067464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:44.067484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222517:5560], now have 1 active actors on pipe
2025-10-02T09:29:44.067492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222427:2446], now have 1 active actors on pipe
2025-10-02T09:29:44.067497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.067503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.067505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.067515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:44.067529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:44.067531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:44.067534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:44.067536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:44.067546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:44.067549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:44.067577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.067583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:44.067557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 512
2025-10-02T09:29:44.067582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 512
2025-10-02T09:29:44.067606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:44.067614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.067617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.067639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:44.067650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.067657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.067658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:44.067665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.067676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:44.067690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.067858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.067866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.067879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.067945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 36 sessionId: src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0
2025-10-02T09:29:44.068234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc832cf2-a8481a7c-eb0b5e2d-57a1f8b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:44.070636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Write session: try to update token
2025-10-02T09:29:44.070650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:44.077848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:44.077865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.077867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:44.077869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:44.077877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.077880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.077884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554225967700589:4872]
2025-10-02T09:29:44.077910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:44.077914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:44.077919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:44.077923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:44.077928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.077934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:44.078065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:44.082718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:44.084998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:44.147016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554226043222527:5499]
2025-10-02T09:29:44.147332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7556554226043222527:5499]
2025-10-02T09:29:44.229363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:44.229885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.229902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.229957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222527:5499], now have 1 active actors on pipe
2025-10-02T09:29:44.230195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:44.230211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:44.230219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:44.230277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554226043222527:5499]
2025-10-02T09:29:44.230283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: error at write: Disconnected sessionId: src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0
2025-10-02T09:29:44.230447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0 is DEAD
2025-10-02T09:29:44.230236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:44.230634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:44.230644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Write session will restart in 0.008627s
2025-10-02T09:29:44.230672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Write session: Do CDS request
2025-10-02T09:29:44.230680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:44.238626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:44.240290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.240485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:44.240501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-10-02T09:29:44.240522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:44.240694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:44.240703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:44.240711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:44.240702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.240756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:44.240758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:44.240773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:44.240780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:44.240792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554225967700687:4875]
2025-10-02T09:29:44.241257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-10-02T09:29:44.241304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:44.241312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:44.241314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:44.241322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554226043222582:5565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:44.241352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:44.241676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:44.241726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:44.241870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554226043222582:5565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:44.242011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:44.242063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.242068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.242069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.242070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.242071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.242072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.242073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.242074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.242075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.242076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.242077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.242078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.242083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.242094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.242098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.242102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.242106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.242109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.242113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.242116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.242120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.242124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.242127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.242131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.242137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.242144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.242149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.242154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.242158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.242164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.242167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.242171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.242175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.242179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.242183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.242188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.242192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.242197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.242205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.242210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.242214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.242219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.242227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.242231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.242241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.242245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.242249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.242253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.242286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:44.244118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554226043222582:5565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:44.249665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554226043222582:5565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:44.249686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554226043222582:5565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:44.249690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554226043222582:5565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:44.249764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:44.250935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:44.253765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:44.253780Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:44.253782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:44.253785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:44.253792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [2:7556554225967700687:4875]
2025-10-02T09:29:44.253806Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:44.253822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:44.253825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.253827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.253829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.253846Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:44.253854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:44.253859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:44.253911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.253918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.253920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.253923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:44.253925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:44.253987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:44.253993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.254006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.254020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.254038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:44.254060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222529:2446], now have 1 active actors on pipe
2025-10-02T09:29:44.254069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222621:5565], now have 1 active actors on pipe
2025-10-02T09:29:44.254074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.254076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.254078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.254090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:44.254104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:44.254117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:44.254120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:44.254123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:44.254128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:44.254131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:44.254151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.254163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:44.254178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:44.254173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 513
2025-10-02T09:29:44.254180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 513
2025-10-02T09:29:44.254220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.254230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.254255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:44.254266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.254269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.254270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:44.254278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.254286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:44.254302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.254447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.254454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.254467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.254560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 36 sessionId: src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0
2025-10-02T09:29:44.254936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07e00a8-73b54488-e89296eb-ec9ab5a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:44.260273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Write session: try to update token
2025-10-02T09:29:44.260292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:44.264570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:44.264594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.264603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.264643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:44.264645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:44.264837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:44.265150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:44.265463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:44.265609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:44.265821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:44.265866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:44.274377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:44.274391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.274393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:44.274395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:44.274404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.274408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.274412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554225967700682:4875]
2025-10-02T09:29:44.274446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:44.274456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.274456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:44.274460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:44.274461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:44.274464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:44.274592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:44.279153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:44.282196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:44.330310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554226043222628:5499]
2025-10-02T09:29:44.330656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7556554226043222628:5499]
2025-10-02T09:29:44.417228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:44.417621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.417637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.417656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222628:5499], now have 1 active actors on pipe
2025-10-02T09:29:44.417877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:44.418303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:44.418356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554226043222628:5499]
2025-10-02T09:29:44.418370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:44.418522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0
2025-10-02T09:29:44.418962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:44.418973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Write session will restart in 0.007072s
2025-10-02T09:29:44.418997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Write session: Do CDS request
2025-10-02T09:29:44.419003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:44.418840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0 is DEAD
2025-10-02T09:29:44.427303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.427407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:44.427424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-10-02T09:29:44.427670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.427709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:44.427718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:44.427722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:44.428186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-10-02T09:29:44.428220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:44.428228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:44.428229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:44.428234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554226043222672:5569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:44.428738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554226043222672:5569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:44.431340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554226043222672:5569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:44.433402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:44.434850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:44.434985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554226043222672:5569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:44.434997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:44.435006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:44.435003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554226043222672:5569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:44.435016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:44.435006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554226043222672:5569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:44.435072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:44.435013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:44.435115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554225967700780:4877]
2025-10-02T09:29:44.435531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:44.435837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:44.435882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:44.436238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:44.436307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.436313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.436314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.436315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.436316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.436320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.436321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.436322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.436323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.436324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.436325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.436326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.436331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.436341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.436344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.436348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.436352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.436356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.436360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.436363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.436367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.436371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.436374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.436378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.436384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.436391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.436397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.436401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.436403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.436406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.436408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.436411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.436414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.436417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.436420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.436423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.436426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.436429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.436431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.436434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.436436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.436439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.436441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.436444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.436446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.436449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.436452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.436455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.436473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:44.445157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:44.447031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:44.447052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:44.447067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:44.447071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:44.447078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [2:7556554225967700780:4877]
2025-10-02T09:29:44.447093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:44.447111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:44.447114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.447116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.447120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.447135Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:44.447151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:44.447157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:44.447210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.447214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.447216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.447219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:44.447222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:44.447288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:44.447298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.447312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.447324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.447346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:44.447371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222631:2446], now have 1 active actors on pipe
2025-10-02T09:29:44.447379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222719:5569], now have 1 active actors on pipe
2025-10-02T09:29:44.447386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.447388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.447389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.447402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:44.447422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 514
2025-10-02T09:29:44.447431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 514
2025-10-02T09:29:44.447416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:44.447435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:44.447437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:44.447474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.447476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:44.447481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:44.447484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:44.447487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:44.447493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:44.447531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.447536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.447561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:44.447567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.447571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.447575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:44.447583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.447593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:44.447605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.447751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.447761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.447785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.447864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 36 sessionId: src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0
2025-10-02T09:29:44.448211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe3eaba-735ff3c5-a2605121-94c28f31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:44.450755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Write session: try to update token
2025-10-02T09:29:44.450771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:44.457839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:44.457858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.457865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.457905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:44.458116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:44.458433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:44.458584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:44.458761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:44.459050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:44.459096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:44.459173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:44.465568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:44.468603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:44.469375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.469397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.469417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:44.469421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.469423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:44.469425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:44.469432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.469435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.469439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554225967700775:4877]
2025-10-02T09:29:44.469477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:44.469482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.469484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:44.469484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:44.469490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:44.469494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:44.469614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:44.519712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554226043222742:5499]
2025-10-02T09:29:44.520049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7556554226043222742:5499]
2025-10-02T09:29:44.571299Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:29:44.602441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:44.602739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:44.602763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222742:5499], now have 1 active actors on pipe
2025-10-02T09:29:44.602893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:44.602959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:44.603013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554226043222742:5499]
2025-10-02T09:29:44.603098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:44.603107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:44.603127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: error at write: Disconnected sessionId: src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0
2025-10-02T09:29:44.603288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0 is DEAD
2025-10-02T09:29:44.603412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:44.603421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Write session will restart in 0.009365s
2025-10-02T09:29:44.603436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Write session: Do CDS request
2025-10-02T09:29:44.603439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:44.610837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:44.612304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:44.612457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:44.612466Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:44.612475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:44.612527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:44.612559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554225967700899:4880]
2025-10-02T09:29:44.613103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:44.613331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:44.613367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:44.613611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:44.613649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.613653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.613654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.613654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.613655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.613655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.613656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.613656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.613657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.613657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.613660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.613660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.613663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.613671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.613673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.613675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.613677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.613679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.613681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.613683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.613685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.613687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.613689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.613691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.613695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.613698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.613701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.613704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.613707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.613710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.613712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.613714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.613717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.613720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.613722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.613724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.613727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.613729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.613732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.613735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.613737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.613741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.613743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.613746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.613748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.613751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.613754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.613757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.613774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:44.614217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.614376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:44.614393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-10-02T09:29:44.614563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.614596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:44.614602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:44.614612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:44.615017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-10-02T09:29:44.615050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:44.615062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:44.615064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:44.615069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554226043222804:5574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:44.615503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554226043222804:5574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:44.617414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554226043222804:5574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:44.620978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554226043222804:5574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:44.620990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554226043222804:5574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:44.620992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554226043222804:5574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:44.621000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:44.621559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:44.623045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:44.623067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:44.623068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:44.623071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:44.623075Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [2:7556554225967700899:4880]
2025-10-02T09:29:44.623083Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:44.623097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:44.623101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.623103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.623105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.623118Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:44.623125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:44.623131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:44.623179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.623190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.623192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.623195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:44.623196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:44.623252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:44.623258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.623268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.623282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.623301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:44.623321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222745:2446], now have 1 active actors on pipe
2025-10-02T09:29:44.623328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222838:5574], now have 1 active actors on pipe
2025-10-02T09:29:44.623333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.623335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.623336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.623346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:44.623362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:44.623363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:44.623365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:44.623367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:44.623378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:44.623380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:44.623365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 515
2025-10-02T09:29:44.623404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 515
2025-10-02T09:29:44.623407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.623415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:44.623416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:44.623440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.623449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.623472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|905a0829-717a876c-fb76334d-298dff84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:44.623480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.623482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.623485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:44.623491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.623499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:44.623509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.623638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.623643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.623653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.623709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 36 sessionId: src_id|905a0829-717a876c-fb76334d-298dff84_0
2025-10-02T09:29:44.624006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753cddc7-3e55e877-eaf9dd51-dfd7c6f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|905a0829-717a876c-fb76334d-298dff84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:44.626646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Write session: try to update token
2025-10-02T09:29:44.626665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:44.634184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:44.634206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.634208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:44.634210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:44.634216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.634221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.634224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554225967700885:4880]
2025-10-02T09:29:44.634260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:44.634266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.634270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:44.634272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:44.634276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:44.634279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:44.634429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:44.639438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|905a0829-717a876c-fb76334d-298dff84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:44.641792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:44.703013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554226043222867:5499]
2025-10-02T09:29:44.703206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7556554226043222867:5499]
2025-10-02T09:29:44.763211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:44.763449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.763459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.763483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222867:5499], now have 1 active actors on pipe
2025-10-02T09:29:44.763701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:44.763681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:44.763694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:44.763734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:44.763746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: error at write: Disconnected sessionId: src_id|905a0829-717a876c-fb76334d-298dff84_0
2025-10-02T09:29:44.763771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554226043222867:5499]
2025-10-02T09:29:44.763914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|905a0829-717a876c-fb76334d-298dff84_0 is DEAD
2025-10-02T09:29:44.764041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:44.764049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Write session will restart in 0.008176s
2025-10-02T09:29:44.764080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Write session: Do CDS request
2025-10-02T09:29:44.764086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:44.770745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:44.772203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:44.772363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:44.772370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:44.772379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:44.772421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:44.772454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554225967701015:4894]
2025-10-02T09:29:44.773034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:44.773198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.773262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:44.773300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:44.773304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:44.773317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-10-02T09:29:44.773404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.773424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:44.773427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:44.773429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:44.773575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:44.773615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.773619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.773620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.773621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.773621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.773622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.773622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.773623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.773623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.773624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.773624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.773625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.773628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.773635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.773637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.773640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.773641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.773644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.773646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.773648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.773650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.773652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.773654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.773656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.773660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.773664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.773668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.773670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.773674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.773676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.773678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.773681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.773683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.773686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.773688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.773710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-10-02T09:29:44.773690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.773692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.773695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.773735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:44.773697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.773736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:44.773737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:44.773700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.773741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554226043222935:5586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:44.773702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.773705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.773707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.773710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.773713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.773715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.773718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.773721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.773737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:44.774098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554226043222935:5586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:44.776030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554226043222935:5586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:44.781032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554226043222935:5586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:44.781045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554226043222935:5586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:44.781048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554226043222935:5586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:44.781055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:44.781632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:44.783326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:44.783339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:44.783341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:44.783344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:44.783349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [2:7556554225967701015:4894]
2025-10-02T09:29:44.783358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:44.783371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:44.783372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.783374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.783375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.783384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:44.783386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:44.783390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:44.783423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.783426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.783427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.783429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:44.783430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:44.783471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:44.783476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.783483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.783489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.783498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:44.783509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.783514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.783515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.783520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:44.783530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:44.783530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:44.783533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:44.783535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:44.783541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:44.783544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:44.783550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222972:5586], now have 1 active actors on pipe
2025-10-02T09:29:44.783552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222878:2446], now have 1 active actors on pipe
2025-10-02T09:29:44.783571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.783579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:44.783590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:44.783614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 516
2025-10-02T09:29:44.783618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 516
2025-10-02T09:29:44.783673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.783683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.783705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:44.783713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.783716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.783717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:44.783723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.783735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:44.783747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.783867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.783874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.783882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.783953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0
2025-10-02T09:29:44.784282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905a0829-717a876c-fb76334d-298dff84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:44.786547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Write session: try to update token
2025-10-02T09:29:44.786559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:44.793702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:44.793728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.793730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:44.793731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:44.793737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.793740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.793743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554225967701009:4894]
2025-10-02T09:29:44.793769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:44.793774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.793775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:44.793782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:44.793787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:44.793790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:44.793929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:44.798026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:44.800195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:44.863816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554226043222982:5499]
2025-10-02T09:29:44.864068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7556554226043222982:5499]
2025-10-02T09:29:44.925137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:44.925441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.925454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.925490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222982:5499], now have 1 active actors on pipe
2025-10-02T09:29:44.925775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:44.925789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:44.925800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554226043222982:5499]
2025-10-02T09:29:44.925829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:44.925839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:44.925841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0
2025-10-02T09:29:44.926007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0 is DEAD
2025-10-02T09:29:44.926153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:44.926162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Write session will restart in 0.009887s
2025-10-02T09:29:44.926185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Write session: Do CDS request
2025-10-02T09:29:44.926201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:44.935003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:44.937292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.937361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:44.937376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-10-02T09:29:44.937532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:44.937580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:44.937590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:44.937594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:44.938044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-10-02T09:29:44.938087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:44.938093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:44.938095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:44.938099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554226043223040:5590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:44.938593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554226043223040:5590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:44.939139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:44.939331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:44.939340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:44.939349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:44.939398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:44.939434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554225967701112:4897]
2025-10-02T09:29:44.940006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:44.940281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554226043223040:5590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:44.940470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:44.940526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:44.940845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:44.940920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.940927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.940927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.940928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.940929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.940930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.940930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.940931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.940932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.940933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.940934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.940935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.940940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.940949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.940952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.940955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.940959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.940962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.940966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.940969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.940973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.940976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.940979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.940982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.940988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.940995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:44.941000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.941007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:44.941011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.941017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:44.941021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.941027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:44.941031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.941035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:44.941038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.941042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:44.941047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.941052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:44.941056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.941060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:44.941064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.941068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:44.941071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.941074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.941081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.941085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.941089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.941093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.941131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:44.945711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554226043223040:5590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:44.945726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554226043223040:5590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:44.945729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554226043223040:5590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:44.945736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:44.949686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:44.951476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:44.951496Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:44.951499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:44.951504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:44.951511Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [2:7556554225967701112:4897]
2025-10-02T09:29:44.951526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:44.951541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:44.951545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.951548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.951550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.951566Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:44.951575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:44.951583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:44.951644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.951651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.951654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.951657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:44.951660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:44.951723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:44.951731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.951744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:44.951758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:44.951778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:44.951801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043222984:2446], now have 1 active actors on pipe
2025-10-02T09:29:44.951805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554226043223079:5590], now have 1 active actors on pipe
2025-10-02T09:29:44.951811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.951813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.951816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.951831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:44.951827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 517
2025-10-02T09:29:44.951836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 517
2025-10-02T09:29:44.951844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:44.951858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:44.951860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:44.951862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:44.951864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:44.951867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:44.951900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.951910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:44.951928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:44.951929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.951933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.951979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92955be6-ce6f781d-492550e2-7e0c015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:44.951989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:44.951993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:44.951995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:44.952003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:44.952013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:44.952039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.952198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:44.952208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:44.952220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:44.952315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 36 sessionId: src_id|92955be6-ce6f781d-492550e2-7e0c015_0
2025-10-02T09:29:44.952629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5162e5f-3b788da7-f2baa1fe-11dfe001_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92955be6-ce6f781d-492550e2-7e0c015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:44.955038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Write session: try to update token
2025-10-02T09:29:44.955069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:44.963797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:44.963826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:44.963829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:44.963831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:44.963839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.963844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.963847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554225967701106:4897]
2025-10-02T09:29:44.963887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:44.963893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:44.963895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:44.963910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:44.963920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:44.963929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:44.964050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:44.968628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|92955be6-ce6f781d-492550e2-7e0c015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:44.970976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:45.026106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554230338190382:5499]
2025-10-02T09:29:45.026443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7556554230338190382:5499]
2025-10-02T09:29:45.109017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:45.109229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.109244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.109275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190382:5499], now have 1 active actors on pipe
2025-10-02T09:29:45.109454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:45.109459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554230338190382:5499]
2025-10-02T09:29:45.109465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:45.109477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:45.109517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|92955be6-ce6f781d-492550e2-7e0c015_0
2025-10-02T09:29:45.109563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:45.109665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|92955be6-ce6f781d-492550e2-7e0c015_0 is DEAD
2025-10-02T09:29:45.109786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:45.109797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Write session will restart in 0.006887s
2025-10-02T09:29:45.109817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Write session: Do CDS request
2025-10-02T09:29:45.109823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:45.117582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:45.118253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.118338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:45.118353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-10-02T09:29:45.118442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.118469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:45.118477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:45.118481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:45.118875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-10-02T09:29:45.118903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:45.118908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:45.118910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:45.118915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554230338190442:5594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:45.119148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:45.119294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:45.119303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:45.119311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:45.119355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:45.119390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554230262668505:4899]
2025-10-02T09:29:45.119391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554230338190442:5594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:45.119823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:45.120068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:45.120094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:45.120319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:45.120361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.120365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.120367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.120369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.120369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.120370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.120370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.120371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.120374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.120379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.120382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.120384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.120386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.120388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.120390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.120392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.120394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.120396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.120398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.120400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.120404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.120408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.120411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.120414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.120416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.120420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.120423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.120427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.120431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.120436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.120439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.120444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.120448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.120452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.120456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.120460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.120464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.120469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.120472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.120477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.120480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.120485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.120489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.120493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.120525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:45.120845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554230338190442:5594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:45.125760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554230338190442:5594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:45.125775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554230338190442:5594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:45.125790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554230338190442:5594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:45.125796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:45.128883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:45.130447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:45.130461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:45.130464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:45.130468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:45.130473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [2:7556554230262668505:4899]
2025-10-02T09:29:45.130484Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:45.130496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:45.130498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.130500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.130502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.130514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:45.130518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:45.130523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:45.130563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.130569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.130570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.130572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:45.130574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:45.130621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:45.130627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.130634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.130640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.130650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:45.130668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190385:2446], now have 1 active actors on pipe
2025-10-02T09:29:45.130681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190480:5594], now have 1 active actors on pipe
2025-10-02T09:29:45.130686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.130689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.130691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.130702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:45.130711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:45.130718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:45.130720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:45.130720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:45.130721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:45.130722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:45.130743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.130745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:45.130746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:45.130759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 518
2025-10-02T09:29:45.130761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 518
2025-10-02T09:29:45.130840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.130847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.130875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|571794d1-20b64461-ef95b38a-458d6bd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:45.130883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.130886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.130887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:45.130895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.130901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:45.130915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.131078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.131084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.131092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.131196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 36 sessionId: src_id|571794d1-20b64461-ef95b38a-458d6bd2_0
2025-10-02T09:29:45.131508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92955be6-ce6f781d-492550e2-7e0c015_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|571794d1-20b64461-ef95b38a-458d6bd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:45.138429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Write session: try to update token
2025-10-02T09:29:45.138449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:45.142422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:45.142448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:45.142454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:45.142475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:45.142487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.142496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.142503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554230262668500:4899]
2025-10-02T09:29:45.142554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:45.142569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:45.142570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:45.142574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:45.142583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.142591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:45.142727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:45.153725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|571794d1-20b64461-ef95b38a-458d6bd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:45.155943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:45.209397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554230338190495:5499]
2025-10-02T09:29:45.209641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7556554230338190495:5499]
2025-10-02T09:29:45.276857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:45.277312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.277327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.277354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190495:5499], now have 1 active actors on pipe
2025-10-02T09:29:45.277573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:45.277592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:45.277595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:45.277631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554230338190495:5499]
2025-10-02T09:29:45.277655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:45.277660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: error at write: Disconnected sessionId: src_id|571794d1-20b64461-ef95b38a-458d6bd2_0
2025-10-02T09:29:45.277838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|571794d1-20b64461-ef95b38a-458d6bd2_0 is DEAD
2025-10-02T09:29:45.277970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:45.277979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Write session will restart in 0.005151s
2025-10-02T09:29:45.277998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Write session: Do CDS request
2025-10-02T09:29:45.278002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:45.284227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.284322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:45.284333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-10-02T09:29:45.284433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.284456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:45.284463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:45.284466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:45.285023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-10-02T09:29:45.285079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:45.285086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:45.285089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:45.285094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554230338190520:5599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:45.285626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554230338190520:5599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:45.287475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:45.287531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554230338190520:5599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:45.289235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:45.289452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:45.289463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:45.289474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:45.289537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:45.289571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554230262668607:4902]
2025-10-02T09:29:45.289868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554230338190520:5599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:45.289881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554230338190520:5599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:45.289887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554230338190520:5599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:45.289893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:45.290199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:45.290535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:45.290589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:45.290966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:45.291036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.291041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.291042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.291043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.291044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.291046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.291047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.291048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.291049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.291050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.291051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.291062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.291067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.291078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.291082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.291086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.291090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.291094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.291098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.291102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.291106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.291117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.291121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.291124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.291130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.291137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.291143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.291148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.291152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.291157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.291161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.291166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.291170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.291174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.291178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.291183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.291189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.291194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.291197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.291202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.291208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.291212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.291217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.291221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.291225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.291230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.291235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.291239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.291275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:45.300129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:45.302364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:45.302382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:45.302385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:45.302389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:45.302396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [2:7556554230262668607:4902]
2025-10-02T09:29:45.302410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:45.302428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:45.302434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.302437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.302440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.302454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:45.302463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:45.302469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:45.302523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.302530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.302532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.302535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:45.302537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:45.302607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:45.302617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.302629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.302640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.302656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:45.302676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190497:2446], now have 1 active actors on pipe
2025-10-02T09:29:45.302680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190590:5599], now have 1 active actors on pipe
2025-10-02T09:29:45.302687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.302689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.302691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.302709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:45.302729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:45.302747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:45.302750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:45.302777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:45.302786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.302786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:45.302788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:45.302789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:45.302794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:45.302843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.302852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.302873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:45.302884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.302890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.302897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:45.302906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.302919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:45.302936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.303127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.303139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.303156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.303722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|571794d1-20b64461-ef95b38a-458d6bd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:45.302766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 519
2025-10-02T09:29:45.302810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 519
2025-10-02T09:29:45.303239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 36 sessionId: src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0
2025-10-02T09:29:45.308573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Write session: try to update token
2025-10-02T09:29:45.308589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:45.317184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:45.317205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:45.317207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:45.317210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:45.317217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.317221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.317225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554230262668601:4902]
2025-10-02T09:29:45.317267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:45.317268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:45.317274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.317274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:45.317276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:45.317278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:45.317482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:45.326205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:45.328891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:45.377842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554230338190601:5499]
2025-10-02T09:29:45.378147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7556554230338190601:5499]
2025-10-02T09:29:45.461145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:45.461509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.461524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.461541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190601:5499], now have 1 active actors on pipe
2025-10-02T09:29:45.461725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:45.462131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:45.462211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554230338190601:5499]
2025-10-02T09:29:45.462216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0
2025-10-02T09:29:45.462233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:45.462405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0 is DEAD
2025-10-02T09:29:45.464976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:45.464987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Write session will restart in 0.006019s
2025-10-02T09:29:45.465012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Write session: Do CDS request
2025-10-02T09:29:45.465018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:45.472978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:45.473561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.473704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:45.473721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-10-02T09:29:45.473839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.473871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:45.473880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:45.473893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:45.474809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:45.474872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-10-02T09:29:45.474908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:45.474918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:45.474919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:45.474925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554230338190664:5603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:45.475002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:45.475015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:45.475026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:45.475100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:45.475134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554230262668716:4905]
2025-10-02T09:29:45.475489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554230338190664:5603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:45.475673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:45.475881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:45.475928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:45.476240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:45.476315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.476322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.476322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.476323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.476325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.476325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.476326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.476327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.476329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.476330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.476331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.476332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.476337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.476346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.476350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.476354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.476358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.476362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.476366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.476370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.476374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.476378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.476382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.476386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.476394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.476401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.476406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.476412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.476416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.476421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.476430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.476435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.476440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.476446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.476449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.476452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.476454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.476458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.476460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.476466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.476470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.476475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.476478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.476482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.476486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.476490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.476494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.476498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.476535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:45.477462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554230338190664:5603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:45.486393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554230338190664:5603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:45.486410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554230338190664:5603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:45.486413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554230338190664:5603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:45.486421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:45.487187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 520
2025-10-02T09:29:45.487219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 520
2025-10-02T09:29:45.485296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:45.486904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:45.486909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:45.486911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:45.486915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:45.486920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [2:7556554230262668716:4905]
2025-10-02T09:29:45.486934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:45.486948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:45.486951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.486953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.486955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.486967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:45.486972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:45.486977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:45.487031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.487032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.487034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.487036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:45.487038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:45.487107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:45.487110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.487122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.487132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.487147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:45.487163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190604:2446], now have 1 active actors on pipe
2025-10-02T09:29:45.487166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190701:5603], now have 1 active actors on pipe
2025-10-02T09:29:45.487171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.487173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.487174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.487188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:45.487200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:45.487199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:45.487203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:45.487205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:45.487213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:45.487215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:45.487245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.487248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:45.487249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:45.487265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.487268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.487323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:45.487329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.487332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.487334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:45.487341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.487348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:45.487363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.487570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.487582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.487604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.487685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 36 sessionId: src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0
2025-10-02T09:29:45.488034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0d5ef6-7b872bb3-a89950e0-1cfdd58d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:45.490522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Write session: try to update token
2025-10-02T09:29:45.490537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:45.498141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:45.498159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:45.498161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:45.498163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:45.498170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.498175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.498178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554230262668711:4905]
2025-10-02T09:29:45.498212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:45.498218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.498216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:45.498220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:45.498222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:45.498225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:45.498346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:45.505040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:45.507553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:45.562191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554230338190721:5499]
2025-10-02T09:29:45.562471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7556554230338190721:5499]
2025-10-02T09:29:45.643593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:45.643811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.643819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.643846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190721:5499], now have 1 active actors on pipe
2025-10-02T09:29:45.643984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:45.644033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:45.644049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:45.644064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:45.644085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554230338190721:5499]
2025-10-02T09:29:45.644121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0
2025-10-02T09:29:45.644308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0 is DEAD
2025-10-02T09:29:45.644480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:45.644488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Write session will restart in 0.009862s
2025-10-02T09:29:45.644521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Write session: Do CDS request
2025-10-02T09:29:45.644528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:45.652844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:45.654821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:45.654992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:45.655003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:45.655014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:45.655077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:45.655114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554230262668829:4907]
2025-10-02T09:29:45.655430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.655580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:45.655570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:45.655585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-10-02T09:29:45.655705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.655735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:45.655740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:45.655744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:45.655887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:45.655928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:45.656057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-10-02T09:29:45.656084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:45.656090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:45.656092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:45.656097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554230338190787:5608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:45.656179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:45.656231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.656235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.656237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.656238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.656239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.656240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.656241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.656242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.656243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.656250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.656251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.656252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.656257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.656267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.656272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.656276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.656279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.656283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.656287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.656291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.656299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.656303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.656306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.656309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.656316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.656322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.656328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.656333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.656338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.656345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.656349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.656355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.656361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.656366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.656370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.656377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.656382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.656387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.656392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.656397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.656402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.656408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.656411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.656417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.656421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.656426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.656430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.656435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.656469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:45.656606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554230338190787:5608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:45.658629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554230338190787:5608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:45.664636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554230338190787:5608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:45.664652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554230338190787:5608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:45.664656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554230338190787:5608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:45.664663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:45.665203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:45.666984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:45.667009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:45.667011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:45.667015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:45.667021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [2:7556554230262668829:4907]
2025-10-02T09:29:45.667035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:45.667050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:45.667064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.667067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.667068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.667084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:45.667088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:45.667099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:45.667159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.667167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.667169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.667173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:45.667175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:45.667233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:45.667241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.667387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 521
2025-10-02T09:29:45.667413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 521
2025-10-02T09:29:45.667256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.667275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.667289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:45.667310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190835:5608], now have 1 active actors on pipe
2025-10-02T09:29:45.667313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190724:2446], now have 1 active actors on pipe
2025-10-02T09:29:45.667319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.667321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.667323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.667332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:45.667346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:45.667351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:45.667354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:45.667356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:45.667361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:45.667364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:45.667393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.667402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:45.667444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:45.667487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.667493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.667518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95281b73-8a232353-55844c5c-b3288a81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:45.667526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.667539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.667541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:45.667613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.667629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:45.667644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.667823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.667831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.667842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.667952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 36 sessionId: src_id|95281b73-8a232353-55844c5c-b3288a81_0
2025-10-02T09:29:45.668319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897d8a28-9eb46706-f82da1b9-37a390ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95281b73-8a232353-55844c5c-b3288a81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:45.671255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Write session: try to update token
2025-10-02T09:29:45.671276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:45.678113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:45.678131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:45.678138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.678175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:45.678177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:45.678350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:45.678497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:45.678649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:45.678793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:45.679116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:45.679163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:45.685082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|95281b73-8a232353-55844c5c-b3288a81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:45.687456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:45.687548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:45.687564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:45.687565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:45.687567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:45.687575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.687578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.687582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554230262668824:4907]
2025-10-02T09:29:45.687599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:45.687603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:45.687606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:45.687614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.687623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.687637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:45.687643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.687647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:45.687760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:45.743908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554230338190856:5499]
2025-10-02T09:29:45.744166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7556554230338190856:5499]
2025-10-02T09:29:45.833719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:45.834415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190856:5499], now have 1 active actors on pipe
2025-10-02T09:29:45.841225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:45.841719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554230338190856:5499]
2025-10-02T09:29:45.841761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:45.841837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95281b73-8a232353-55844c5c-b3288a81_0
2025-10-02T09:29:45.841992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:45.842027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|95281b73-8a232353-55844c5c-b3288a81_0 is DEAD
2025-10-02T09:29:45.842353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:45.842366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Write session will restart in 0.007216s
2025-10-02T09:29:45.842389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Write session: Do CDS request
2025-10-02T09:29:45.842395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:45.850428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.852874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:45.852894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-10-02T09:29:45.853021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:45.853047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:45.853051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:45.853055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:45.853525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-10-02T09:29:45.853574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:45.853584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:45.853586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:45.853592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554230338190877:5620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:45.854140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554230338190877:5620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:45.856224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554230338190877:5620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:45.859976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:45.860613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554230338190877:5620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:45.860637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554230338190877:5620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:45.860641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554230338190877:5620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:45.860653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:45.862239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:45.862502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:45.862506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:45.862519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:45.862584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:45.862627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554230262668957:4922]
2025-10-02T09:29:45.863225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:45.863600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:45.863648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:45.863969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:45.864031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.864033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.864034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.864035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.864036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.864038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.864039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.864040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.864041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.864042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.864043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.864045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.864050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.864061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.864067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.864071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.864075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.864079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.864082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.864086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.864089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.864091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.864093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.864095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.864101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.864105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:45.864109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.864112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:45.864117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.864120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:45.864122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.864125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:45.864127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.864130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:45.864132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.864135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:45.864137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.864140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:45.864143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.864146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:45.864148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.864151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:45.864155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.864157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.864160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.864164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.864166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.864169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.864186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:45.872953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:45.874729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:45.874735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:45.874738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:45.874744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:45.874751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [2:7556554230262668957:4922]
2025-10-02T09:29:45.874768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:45.874785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:45.874789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.874792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.874794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.874809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:45.874814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:45.874821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:45.874871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.874872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.874874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.874876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:45.874877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:45.874931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:45.874932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.874941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:45.874947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:45.874956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:45.874968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.874970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.874972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.874977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:45.874987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:45.874996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:45.874999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:45.875024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.875025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:45.875062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:45.875066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:45.875067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:45.875073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:45.875273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190961:5620], now have 1 active actors on pipe
2025-10-02T09:29:45.875280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190865:2446], now have 1 active actors on pipe
2025-10-02T09:29:45.875329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 522
2025-10-02T09:29:45.875365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 522
2025-10-02T09:29:45.875598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.875612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.875639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:45.875650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:45.875654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:45.875657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:45.876224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 36 sessionId: src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0
2025-10-02T09:29:45.876566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95281b73-8a232353-55844c5c-b3288a81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:45.875677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:45.875692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:45.875707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.876001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:45.876005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:45.876019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:45.879449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Write session: try to update token
2025-10-02T09:29:45.879465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:45.886265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:45.886290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:45.886296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:45.886297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:45.886308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.886312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.886315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554230262668950:4922]
2025-10-02T09:29:45.886349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:45.886362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:45.886361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:45.886364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:45.886365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:45.886369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:45.886489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:45.894547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:45.897388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:45.941591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554230338190973:5499]
2025-10-02T09:29:45.941927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7556554230338190973:5499]
2025-10-02T09:29:46.034199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:46.034494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.034508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.034539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554230338190973:5499], now have 1 active actors on pipe
2025-10-02T09:29:46.034955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:46.035008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:46.034735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:46.035086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0
2025-10-02T09:29:46.035256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0 is DEAD
2025-10-02T09:29:46.035434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554230338190973:5499]
2025-10-02T09:29:46.035626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:46.035635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Write session will restart in 0.005232s
2025-10-02T09:29:46.035662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Write session: Do CDS request
2025-10-02T09:29:46.035668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:46.045460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.045568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:46.045585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-10-02T09:29:46.045730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.045759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:46.045769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:46.045774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:46.046240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-10-02T09:29:46.046271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:46.046275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:46.046277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:46.046282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554234633158330:5624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:46.046774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554234633158330:5624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:46.047922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:46.050722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:46.050785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554234633158330:5624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:46.050909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:46.050924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:46.050934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:46.050991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:46.051030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554234557636353:4924]
2025-10-02T09:29:46.051634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:46.051948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:46.052001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:46.052317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:46.052375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.052382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.052384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.052385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.052386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.052387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.052388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.052389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.052391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.052392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.052393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.052394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.052400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.052410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.052414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.052418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.052422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.052426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.052430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.052434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.052438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.052442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.052446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.052450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.052456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.052463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.052469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.052475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.052479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.052499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.052503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.052508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.052513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.052518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.052523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.052528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.052532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.052537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.052541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.052554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.052559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.052564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.052568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.052573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.052577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.052582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.052587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.052591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.052627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:46.056486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554234633158330:5624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:46.056504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554234633158330:5624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:46.056508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554234633158330:5624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:46.056516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:46.064537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:46.066444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:46.066469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:46.066472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:46.066477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:46.066483Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [2:7556554234557636353:4924]
2025-10-02T09:29:46.066497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:46.066517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:46.066520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.066523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.066525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.066541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:46.066547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:46.066554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:46.066614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.066625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.066627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.066629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:46.066632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:46.066700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:46.066709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.066724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.066740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.066759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:46.066784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.066786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.066788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.066802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:46.066814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:46.066828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:46.066835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:46.066874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.066881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:46.066896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:46.066903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158371:5624], now have 1 active actors on pipe
2025-10-02T09:29:46.066907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158271:2446], now have 1 active actors on pipe
2025-10-02T09:29:46.066907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:46.066909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:46.066915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:46.067302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 523
2025-10-02T09:29:46.067337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 523
2025-10-02T09:29:46.067543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.067556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.067584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|159909e8-ad8d576f-212afd4e-38c44e94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:46.067591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.067597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.067601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:46.067610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.067620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:46.067636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.067822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.067831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.067846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.067959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 36 sessionId: src_id|159909e8-ad8d576f-212afd4e-38c44e94_0
2025-10-02T09:29:46.068400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89dadf6c-abc682fc-dc72e30e-8576b593_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|159909e8-ad8d576f-212afd4e-38c44e94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:46.071079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Write session: try to update token
2025-10-02T09:29:46.071097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:46.078376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:46.078400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.078408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.078455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:46.078559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:46.078668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:46.078850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.079085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.079256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.079584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:46.079617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:46.086665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|159909e8-ad8d576f-212afd4e-38c44e94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:46.088627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:46.088646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.088648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:46.088651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:46.088659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.088663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.088671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554234557636348:4924]
2025-10-02T09:29:46.088708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:46.088717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.088719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:46.088721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:46.088725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:46.088729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:46.088891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:46.089154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:46.135612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554234633158381:5499]
2025-10-02T09:29:46.135920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7556554234633158381:5499]
2025-10-02T09:29:46.242774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:46.243095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.243110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.243129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158381:5499], now have 1 active actors on pipe
2025-10-02T09:29:46.243407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:46.243420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:46.243482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: error at write: Disconnected sessionId: src_id|159909e8-ad8d576f-212afd4e-38c44e94_0
2025-10-02T09:29:46.243663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|159909e8-ad8d576f-212afd4e-38c44e94_0 is DEAD
2025-10-02T09:29:46.243814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554234633158381:5499]
2025-10-02T09:29:46.243832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:46.243357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:46.245107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:46.245125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Write session will restart in 0.007490s
2025-10-02T09:29:46.245156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Write session: Do CDS request
2025-10-02T09:29:46.245163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:46.252231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:46.254296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:46.254490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:46.254502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:46.254513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:46.254577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:46.254619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554234557636457:4927]
2025-10-02T09:29:46.255245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:46.255554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:46.255620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:46.255925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:46.256002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.256009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.256010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.256011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.256012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.256014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.256015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.256016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.256017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.256018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.256019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.256021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.256025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.256036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.256040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.256043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.256047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.256050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.256054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.256057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.256060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.256066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.256069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.256073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.256080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.256093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.256103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.256107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.256116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.256120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.256125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.256129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.256133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.256138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.256146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.256150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.256155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.256164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.256169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.256174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.256181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.256186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.256192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.256197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.256206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.256211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.256218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.256223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.256257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:46.261362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.265175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:46.265199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-10-02T09:29:46.265387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.265380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:46.265423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:46.265431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:46.265434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:46.265798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-10-02T09:29:46.265828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:46.265834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:46.265835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:46.265839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554234633158452:5629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:46.266231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554234633158452:5629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:46.267062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:46.267082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:46.267084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:46.267087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:46.267096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [2:7556554234557636457:4927]
2025-10-02T09:29:46.267108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:46.267124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:46.267126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.267129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.267130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.267144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:46.267150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:46.267156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:46.267208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.267218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.267220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.267222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:46.267224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:46.267278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:46.267287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.267298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.267307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.267320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:46.267337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158384:2446], now have 1 active actors on pipe
2025-10-02T09:29:46.267348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.267350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.267352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.267363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:46.267374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:46.267377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:46.267377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:46.267379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:46.267389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:46.267392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:46.267418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.267421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:46.267377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 524
2025-10-02T09:29:46.267423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:46.268122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554234633158452:5629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:46.274162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554234633158452:5629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:46.274180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554234633158452:5629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:46.274183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554234633158452:5629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:46.274191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:46.274452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158490:5629], now have 1 active actors on pipe
2025-10-02T09:29:46.274493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 524
2025-10-02T09:29:46.274562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.274573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.274597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:46.274606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.274610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.274618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:46.274628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.274641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:46.274664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.274863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.274876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.274895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.274986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0
2025-10-02T09:29:46.275345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159909e8-ad8d576f-212afd4e-38c44e94_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:46.277828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Write session: try to update token
2025-10-02T09:29:46.277843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:46.278549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:46.278563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.278571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.278611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:46.278625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:46.278784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:46.278930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.279123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.279272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.279470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:46.279509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:46.288919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:46.288952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.288958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:46.288960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:46.288967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.288973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.288976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554234557636452:4927]
2025-10-02T09:29:46.289010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:46.289017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.289019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:46.289019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:46.289027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:46.289030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:46.289152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:46.291468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:46.294037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:46.344141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554234633158493:5499]
2025-10-02T09:29:46.344620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7556554234633158493:5499]
2025-10-02T09:29:46.435227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:46.435560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.435576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.435594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158493:5499], now have 1 active actors on pipe
2025-10-02T09:29:46.436232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:46.436244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Write session will restart in 0.007226s
2025-10-02T09:29:46.436264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Write session: Do CDS request
2025-10-02T09:29:46.436269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:46.435960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:46.435786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:46.435822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554234633158493:5499]
2025-10-02T09:29:46.435837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:46.435840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:46.435897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: error at write: Disconnected sessionId: src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0
2025-10-02T09:29:46.436065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0 is DEAD
2025-10-02T09:29:46.444337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.444441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:46.444458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-10-02T09:29:46.444607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.444650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:46.444655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:46.444659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:46.445151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-10-02T09:29:46.445183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:46.445191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:46.445193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:46.445198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554234633158555:5633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:46.445713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554234633158555:5633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:46.447732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554234633158555:5633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:46.449193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:46.452307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554234633158555:5633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:46.452322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554234633158555:5633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:46.452325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554234633158555:5633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:46.452333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:46.451859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:46.452036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:46.452039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:46.452047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:46.452089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:46.452119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554234557636561:4929]
2025-10-02T09:29:46.452653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:46.452949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:46.452986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:46.453252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:46.453289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.453290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.453291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.453292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.453293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.453294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.453295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.453296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.453297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.453298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.453299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.453301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.453305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.453315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.453318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.453321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.453325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.453328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.453331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.453334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.453337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.453341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.453344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.453347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.453353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.453359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.453364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.453368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.453372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.453376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.453380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.453384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.453389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.453393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.453396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.453400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.453404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.453408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.453412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.453416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.453419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.453424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.453428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.453432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.453436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.453441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.453444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.453450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.453478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:46.462194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:46.463838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:46.463862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:46.463864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:46.463868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:46.463873Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [2:7556554234557636561:4929]
2025-10-02T09:29:46.463886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:46.463902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:46.463910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.463913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.463914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.463929Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:46.463939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:46.463949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:46.464007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.464018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.464020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.464023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:46.464025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:46.464125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:46.464135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.464147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.464160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.464176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:46.464197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158595:5633], now have 1 active actors on pipe
2025-10-02T09:29:46.464206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158496:2446], now have 1 active actors on pipe
2025-10-02T09:29:46.464213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.464219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.464221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.464236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:46.464248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 525
2025-10-02T09:29:46.464251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 525
2025-10-02T09:29:46.464250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:46.464269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:46.464272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:46.464304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.464307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:46.464318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:46.464326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:46.464329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:46.464336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:46.464524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.464534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.464560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|307a2122-39825b8a-e8669071-39f2da3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:46.464569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.464575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.464576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:46.464585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.464595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:46.464609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.464875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.464890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.464908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.464991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 36 sessionId: src_id|307a2122-39825b8a-e8669071-39f2da3e_0
2025-10-02T09:29:46.465381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d65b866-2351858d-84a6f5ef-961ea6da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|307a2122-39825b8a-e8669071-39f2da3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:46.468488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Write session: try to update token
2025-10-02T09:29:46.468511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:46.475279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:46.475298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.475306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.475345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:46.475347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:46.475584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:46.475735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.475914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.476056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:46.476324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:46.476364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:46.489237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|307a2122-39825b8a-e8669071-39f2da3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:46.491146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:46.491165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.491167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:46.491170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:46.491180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.491186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.491192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554234557636556:4929]
2025-10-02T09:29:46.491225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:46.491235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:46.491237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.491239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:46.491241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:46.491245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:46.491385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:46.491866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:46.535998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554234633158621:5499]
2025-10-02T09:29:46.536339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7556554234633158621:5499]
2025-10-02T09:29:46.637427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:46.637848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.637861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.637878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158621:5499], now have 1 active actors on pipe
2025-10-02T09:29:46.638094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:46.638110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:46.638130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:46.638138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:46.638185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554234633158621:5499]
2025-10-02T09:29:46.638189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: error at write: Disconnected sessionId: src_id|307a2122-39825b8a-e8669071-39f2da3e_0
2025-10-02T09:29:46.638390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|307a2122-39825b8a-e8669071-39f2da3e_0 is DEAD
2025-10-02T09:29:46.638650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:46.638659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Write session will restart in 0.005981s
2025-10-02T09:29:46.638696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Write session: Do CDS request
2025-10-02T09:29:46.638702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:46.646401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.646680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:46.646696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-10-02T09:29:46.646810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.646838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:46.646847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:46.646851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:46.647468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-10-02T09:29:46.647509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:46.647515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:46.647517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:46.647523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554234633158686:5640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:46.648037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554234633158686:5640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:46.648978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:46.650688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554234633158686:5640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:46.652197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:46.652391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:46.652403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:46.652412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:46.652475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:46.652518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554234557636678:4932]
2025-10-02T09:29:46.653116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:46.653417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:46.653457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:46.653433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554234633158686:5640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:46.653457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554234633158686:5640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:46.653460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554234633158686:5640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:46.653467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:46.653748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:46.653794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.653799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.653800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.653801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.653803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.653804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.653805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.653806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.653808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.653809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.653810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.653811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.653816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.653826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.653830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.653834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.653838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.653841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.653845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.653848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.653852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.653855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.653858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.653862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.653868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.653875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.653880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.653885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.653889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.653894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.653900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.653904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.653909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.653914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.653918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.653922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.653935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.653940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.653944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.653949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.653954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.653959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.653964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.653970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.653974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.653979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.653982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.653987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.654022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:46.665125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:46.666737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:46.666757Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:46.666760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:46.666765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:46.666772Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [2:7556554234557636678:4932]
2025-10-02T09:29:46.666787Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:46.666805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:46.666814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.666817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.666819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.666834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:46.666845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:46.666858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:46.666918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.666926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.666928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.666930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:46.666933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:46.666997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:46.667006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.667021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.667033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.667048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:46.667079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158726:5640], now have 1 active actors on pipe
2025-10-02T09:29:46.667088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158624:2446], now have 1 active actors on pipe
2025-10-02T09:29:46.667094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.667096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.667098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.667109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:46.667124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:46.667124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:46.667128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:46.667130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:46.667144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:46.667147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:46.667180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.667192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:46.667197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:46.667200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 526
2025-10-02T09:29:46.667208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 526
2025-10-02T09:29:46.667294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.667308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.667338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:46.667350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.667355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.667359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:46.667369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.667384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:46.667398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.667807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.667819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.667836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.667942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 36 sessionId: src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0
2025-10-02T09:29:46.668315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307a2122-39825b8a-e8669071-39f2da3e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:46.671226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Write session: try to update token
2025-10-02T09:29:46.671247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:46.681911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:46.681932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.681935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:46.681936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:46.681945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.681949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.681953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554234557636672:4932]
2025-10-02T09:29:46.681994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:46.682000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.682002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:46.682007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:46.682014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:46.682017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:46.682157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:46.686201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:46.688576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:46.738244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554234633158751:5499]
2025-10-02T09:29:46.738502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7556554234633158751:5499]
2025-10-02T09:29:46.835863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:46.836297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.836305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.836340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158751:5499], now have 1 active actors on pipe
2025-10-02T09:29:46.836577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:46.836794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:46.836872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554234633158751:5499]
2025-10-02T09:29:46.836888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0
2025-10-02T09:29:46.836891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:46.837058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0 is DEAD
2025-10-02T09:29:46.840890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:46.840904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Write session will restart in 0.008428s
2025-10-02T09:29:46.840930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Write session: Do CDS request
2025-10-02T09:29:46.840935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:46.846373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:46.848636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:46.848851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:46.848862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:46.848873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:46.848931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:46.848977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554234557636821:4947]
2025-10-02T09:29:46.849571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:46.849938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:46.849977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:46.850295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:46.850353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.850359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.850361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.850362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.850363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.850364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.850365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.850366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.850367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.850368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.850369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.850370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.850374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.850385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.850389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.850392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.850395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.850399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.850403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.850407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.850411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.850415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.850418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.850423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.850433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.850441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:46.850446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.850451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:46.850455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.850460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:46.850463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.850467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.850468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:46.850471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.850477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:46.850481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.850486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:46.850491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.850495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:46.850500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.850505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:46.850509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.850513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:46.850518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.850523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.850527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.850532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.850535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.850540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.850572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:46.850887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:46.850901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-10-02T09:29:46.851134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:46.851199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:46.851213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:46.851224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:46.851626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-10-02T09:29:46.851655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:46.851656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:46.851658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:46.851663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554234633158838:5652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:46.852583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554234633158838:5652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:46.855009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554234633158838:5652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:46.861474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554234633158838:5652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:46.861498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554234633158838:5652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:46.861501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554234633158838:5652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:46.861509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:46.861938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:46.863764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:46.863784Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:46.863787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:46.863791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:46.863796Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [2:7556554234557636821:4947]
2025-10-02T09:29:46.863809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:46.863825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:46.863828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.863831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.863833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.863847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:46.863852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:46.863858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:46.863913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.863924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.863926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.863929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:46.863931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:46.863993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:46.864004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.864017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:46.864029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:46.864047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:46.864073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158768:2446], now have 1 active actors on pipe
2025-10-02T09:29:46.864077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158871:5652], now have 1 active actors on pipe
2025-10-02T09:29:46.864083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.864085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.864089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.864105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:46.864122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:46.864137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:46.864140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:46.864172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.864179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:46.864224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:46.864228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:46.864230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:46.864238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:46.864261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 527
2025-10-02T09:29:46.864305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 527
2025-10-02T09:29:46.864359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.864371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.864396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42eb816-bc645ea4-5322b147-7d7083f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:46.864410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:46.864414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:46.864415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:46.864424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:46.864435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:46.864449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.864667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:46.864680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:46.864700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:46.864863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 36 sessionId: src_id|42eb816-bc645ea4-5322b147-7d7083f0_0
2025-10-02T09:29:46.865222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f4b9ac-3d7d625b-3404a47e-add0afc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42eb816-bc645ea4-5322b147-7d7083f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:46.867757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Write session: try to update token
2025-10-02T09:29:46.867774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:46.878091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:46.878112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:46.878114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:46.878116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:46.878123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.878127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.878130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554234557636816:4947]
2025-10-02T09:29:46.878169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:46.878177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:46.878176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:46.878179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:46.878182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:46.878185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:46.878303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:46.882728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|42eb816-bc645ea4-5322b147-7d7083f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:46.885343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:46.936899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554234633158880:5499]
2025-10-02T09:29:46.937190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7556554234633158880:5499]
2025-10-02T09:29:47.018172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:47.018494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.018512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.018554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554234633158880:5499], now have 1 active actors on pipe
2025-10-02T09:29:47.018809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554234633158880:5499]
2025-10-02T09:29:47.018837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:47.018859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:47.018863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:47.018924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|42eb816-bc645ea4-5322b147-7d7083f0_0
2025-10-02T09:29:47.019077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:47.019098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|42eb816-bc645ea4-5322b147-7d7083f0_0 is DEAD
2025-10-02T09:29:47.019232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:47.019245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Write session will restart in 0.009234s
2025-10-02T09:29:47.019268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Write session: Do CDS request
2025-10-02T09:29:47.019273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:47.027658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.029339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.029438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:47.029452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-10-02T09:29:47.029472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.029552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.029578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:47.029587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:47.029591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:47.029644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.029652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:47.029661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.029701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.029731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554238852604222:4949]
2025-10-02T09:29:47.030074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-10-02T09:29:47.030111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:47.030117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:47.030120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:47.030125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554238928126245:5656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:47.030261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:47.030519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:47.030555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:47.030615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554238928126245:5656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:47.030837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:47.030880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.030885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.030885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.030886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.030907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.030907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.030908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.030909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.030910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.030911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.030912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.030913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.030917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.030924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.030928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.030931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.030935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.030938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.030940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.030944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.030947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.030950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.030953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.030956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.030961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.030967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.030972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.030976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.030980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.030984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.030988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.030997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.031000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.031008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.031012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.031020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.031028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.031032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.031040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.031044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.031048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.031061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.031069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.031073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.031077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.031081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.031090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.031095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.031126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:47.032292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554238928126245:5656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:47.038494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554238928126245:5656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:47.038509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554238928126245:5656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:47.038515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554238928126245:5656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:47.038524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:47.041519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:47.043197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:47.043214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:47.043216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.043220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.043227Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [2:7556554238852604222:4949]
2025-10-02T09:29:47.043240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:47.043257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:47.043260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.043263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.043265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.043279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:47.043289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.043296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:47.043350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.043357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.043360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.043363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:47.043365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:47.043425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:47.043433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.043444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.043454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.043473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:47.043495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126177:2446], now have 1 active actors on pipe
2025-10-02T09:29:47.043505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126284:5656], now have 1 active actors on pipe
2025-10-02T09:29:47.043511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.043513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.043515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.043528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:47.043540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:47.043553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:47.043555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:47.043583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.043590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:47.043565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 528
2025-10-02T09:29:47.043594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:47.043596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:47.043598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:47.043604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:47.043575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 528
2025-10-02T09:29:47.043608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.043612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.043752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:47.043762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.043766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.043768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.043776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.043784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:47.043811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.043980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.043987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.043999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.044099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 36 sessionId: src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0
2025-10-02T09:29:47.044453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42eb816-bc645ea4-5322b147-7d7083f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:47.046831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Write session: try to update token
2025-10-02T09:29:47.046848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:47.058122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:47.058139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.058146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:47.058148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:47.058156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.058160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.058164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554238852604217:4949]
2025-10-02T09:29:47.058199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:47.058207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.058210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:47.058210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:47.058225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:47.058229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:47.058343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:47.059992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:47.062440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:47.119164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554238928126292:5499]
2025-10-02T09:29:47.119417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7556554238928126292:5499]
2025-10-02T09:29:47.204846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:47.205157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.205170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.205204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126292:5499], now have 1 active actors on pipe
2025-10-02T09:29:47.205408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:47.205449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:47.205478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554238928126292:5499]
2025-10-02T09:29:47.205485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:47.205548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0
2025-10-02T09:29:47.205718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0 is DEAD
2025-10-02T09:29:47.205872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:47.205881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Write session will restart in 0.009098s
2025-10-02T09:29:47.205904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Write session: Do CDS request
2025-10-02T09:29:47.205911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:47.215066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.216258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.216381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:47.216396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-10-02T09:29:47.216506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.216534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:47.216538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:47.216542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:47.216566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.216724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.216734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:47.216744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.216788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.216841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554238852604331:4952]
2025-10-02T09:29:47.216919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-10-02T09:29:47.216954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:47.216961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:47.216963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:47.216968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554238928126364:5661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:47.217385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:47.217481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554238928126364:5661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:47.217674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:47.217715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:47.218013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:47.218064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.218069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.218071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.218071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.218072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.218073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.218075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.218076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.218077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.218078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.218079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.218080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.218085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.218095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.218099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.218103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.218106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.218110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.218114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.218117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.218121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.218125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.218129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.218132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.218138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.218145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.218150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.218155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.218159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.218164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.218174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.218179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.218186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.218191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.218195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.218204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.218213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.218219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.218223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.218228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.218233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.218238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.218247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.218251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.218260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.218265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.218269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.218278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.218312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:47.219218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554238928126364:5661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:47.225562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554238928126364:5661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:47.225575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554238928126364:5661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:47.225579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554238928126364:5661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:47.225586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:47.229392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:47.231163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:47.231179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:47.231182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.231185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.231191Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [2:7556554238852604331:4952]
2025-10-02T09:29:47.231203Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:47.231217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:47.231219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.231220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.231222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.231233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:47.231238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.231242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:47.231281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.231287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.231288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.231290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:47.231292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:47.231339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:47.231347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.231359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.231369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.231385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:47.231407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126403:5661], now have 1 active actors on pipe
2025-10-02T09:29:47.231414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126296:2446], now have 1 active actors on pipe
2025-10-02T09:29:47.231420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.231422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.231424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.231433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:47.231447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:47.231447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:47.231450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:47.231452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:47.231463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:47.231466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:47.231460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 529
2025-10-02T09:29:47.231479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 529
2025-10-02T09:29:47.231494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.231500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:47.231503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:47.231518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.231523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.231552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f03fd93-b70d351c-c0d33977-28115a5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:47.231564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.231569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.231571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.231579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.231587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:47.231614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.231767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.231775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.231788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.231872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 36 sessionId: src_id|f03fd93-b70d351c-c0d33977-28115a5d_0
2025-10-02T09:29:47.232280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b42dd5-7a187611-4cfd29d1-35bed0b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f03fd93-b70d351c-c0d33977-28115a5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:47.235422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Write session: try to update token
2025-10-02T09:29:47.235447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:47.245372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:47.245394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.245396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:47.245398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:47.245406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.245411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.245414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554238852604326:4952]
2025-10-02T09:29:47.245452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:47.245456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:47.245462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:47.245465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:47.245466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.245469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:47.245639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:47.250721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|f03fd93-b70d351c-c0d33977-28115a5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:47.253184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:47.305506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554238928126411:5499]
2025-10-02T09:29:47.305790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7556554238928126411:5499]
2025-10-02T09:29:47.381738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:47.381961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.381972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.381999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126411:5499], now have 1 active actors on pipe
2025-10-02T09:29:47.382171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:47.382236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:47.382240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:47.382252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:47.382283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554238928126411:5499]
2025-10-02T09:29:47.382304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: error at write: Disconnected sessionId: src_id|f03fd93-b70d351c-c0d33977-28115a5d_0
2025-10-02T09:29:47.382492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|f03fd93-b70d351c-c0d33977-28115a5d_0 is DEAD
2025-10-02T09:29:47.382633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:47.382640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Write session will restart in 0.006943s
2025-10-02T09:29:47.382659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Write session: Do CDS request
2025-10-02T09:29:47.382663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:47.390279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.390354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:47.390368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-10-02T09:29:47.391204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.391245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:47.391256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:47.391260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:47.391552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.391648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-10-02T09:29:47.391680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:47.391686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:47.391687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:47.391693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554238928126481:5665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:47.392201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554238928126481:5665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:47.393411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.393571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.393581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:47.393591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.393634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.393668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554238852604440:4954]
2025-10-02T09:29:47.394206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:47.394278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554238928126481:5665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:47.394438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:47.394477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:47.394765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:47.394821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.394828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.394829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.394830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.394831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.394831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.394832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.394833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.394834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.394835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.394836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.394837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.394842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.394852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.394856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.394859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.394862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.394866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.394870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.394873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.394876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.394880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.394883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.394887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.394893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.394901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.394906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.394910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.394914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.394919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.394922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.394926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.394931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.394935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.394939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.394943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.394947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.394952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.394955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.394960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.394965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.394969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.394973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.394977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.394980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.394985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.394989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.394996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.395026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:47.400030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554238928126481:5665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:47.400047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554238928126481:5665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:47.400050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554238928126481:5665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:47.400057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:47.404933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:47.406681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:47.406698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:47.406701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.406705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.406712Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [2:7556554238852604440:4954]
2025-10-02T09:29:47.406727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:47.406742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:47.406752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.406755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.406757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.406771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:47.406780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.406786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:47.406839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.406846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.406848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.406853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:47.406856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:47.407038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:47.407047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.407071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.407084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.407046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 530
2025-10-02T09:29:47.407057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 530
2025-10-02T09:29:47.407101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:47.407127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126521:5665], now have 1 active actors on pipe
2025-10-02T09:29:47.407133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126412:2446], now have 1 active actors on pipe
2025-10-02T09:29:47.407147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.407155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.407173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.407182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.407184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.407195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:47.407204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:47.407207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:47.407212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:47.407214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:47.407221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:47.407223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:47.407237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:47.407247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.407251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.407253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.407260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.407269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:47.407302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.407315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:47.407318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:47.407329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.407488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.407501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.407522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.407648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 36 sessionId: src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0
2025-10-02T09:29:47.407993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03fd93-b70d351c-c0d33977-28115a5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:47.410708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Write session: try to update token
2025-10-02T09:29:47.410721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:47.418655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:47.418676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.418678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:47.418680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:47.418687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.418691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.418694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554238852604435:4954]
2025-10-02T09:29:47.418727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:47.418736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.418739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:47.418738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:47.418744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:47.418747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:47.418874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:47.423841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:47.426091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:47.482691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554238928126529:5499]
2025-10-02T09:29:47.482950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7556554238928126529:5499]
2025-10-02T09:29:47.553224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:47.553474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.553483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.553512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126529:5499], now have 1 active actors on pipe
2025-10-02T09:29:47.553663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:47.553709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:47.553710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554238928126529:5499]
2025-10-02T09:29:47.553726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:47.553790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0
2025-10-02T09:29:47.553952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0 is DEAD
2025-10-02T09:29:47.554071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:47.554079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Write session will restart in 0.008453s
2025-10-02T09:29:47.554099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Write session: Do CDS request
2025-10-02T09:29:47.554104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:47.562348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.563271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.563362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:47.563375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-10-02T09:29:47.563482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.563521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:47.563530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:47.563533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:47.563907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-10-02T09:29:47.563942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:47.563944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:47.563945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:47.563949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554238928126613:5670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:47.564027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.564179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.564191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:47.564201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.564242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.564277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554238852604561:4957]
2025-10-02T09:29:47.564436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554238928126613:5670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:47.564781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:47.565017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:47.565056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:47.565313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:47.565378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.565383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.565384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.565385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.565387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.565388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.565389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.565390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.565391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.565393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.565394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.565395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.565400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.565410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.565414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.565417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.565421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.565425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.565433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.565437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.565445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.565449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.565456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.565460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.565466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.565478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.565487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.565496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.565504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.565513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.565522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.565530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.565536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.565541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.565546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.565550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.565559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.565564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.565576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.565590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.565594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.565600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.565604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.565608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.565613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.565618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.565622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.565627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.565658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:47.566201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554238928126613:5670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:47.571480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554238928126613:5670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:47.571492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554238928126613:5670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:47.571495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554238928126613:5670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:47.571500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:47.574804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:47.576206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:47.576219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:47.576221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.576224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.576228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [2:7556554238852604561:4957]
2025-10-02T09:29:47.576237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:47.576248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:47.576250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.576252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.576253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.576264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:47.576267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.576272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:47.576313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.576322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.576323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.576325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:47.576326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:47.576371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:47.576376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.576383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.576393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.576401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:47.576416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.576421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.576423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.576428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:47.576433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:47.576436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:47.576437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:47.576438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126651:5670], now have 1 active actors on pipe
2025-10-02T09:29:47.576441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126542:2446], now have 1 active actors on pipe
2025-10-02T09:29:47.576448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:47.576459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:47.576466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:47.576493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.576504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:47.576508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:47.576486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 531
2025-10-02T09:29:47.576491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 531
2025-10-02T09:29:47.576534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.576542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.576560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:47.576564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.576572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.576573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.576579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.576585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:47.576597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.576706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.576712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.576721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.576783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 36 sessionId: src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0
2025-10-02T09:29:47.577094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f781d1c9-6ac5ceb2-2811ecbe-c64ce97a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:47.579643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Write session: try to update token
2025-10-02T09:29:47.579658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:47.592031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:47.592864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:47.592878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.592886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.592922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:47.592924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:47.593066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:47.593187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:47.593311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:47.593432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:47.593597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:47.593627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:47.594238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:47.594388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.594401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.594425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:47.594476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:47.595378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:47.595391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.595393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:47.595394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:47.595399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.595402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.595408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554238852604556:4957]
2025-10-02T09:29:47.595433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:47.595442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.595443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:47.595444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:47.595447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:47.595450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:47.595548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:47.656860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554238928126660:5499]
2025-10-02T09:29:47.657111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7556554238928126660:5499]
2025-10-02T09:29:47.734365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:47.741127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.741150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.741301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.741364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.741429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.741498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.741829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.741843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.741911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.741969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.742027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.742091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.742130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.742133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.742198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.742253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.742312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.742372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.742412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.742414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.742483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.742543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.742632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.742717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.742760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.742763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.742837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.742895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.742954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.743044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.743110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.743112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.743184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.743261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.743320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.743379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.743434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.743436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.743504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.743585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.743653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.743710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.743750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.743755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.743822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.743878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.743933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.743990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.744031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.744034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.744094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.744146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.744202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.744260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.744299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.744302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.744366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:47.744419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:47.744477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:47.744537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:47.744578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:47.744581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:47.744630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126660:5499], now have 1 active actors on pipe
2025-10-02T09:29:47.745117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554238928126660:5499]
2025-10-02T09:29:47.745151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:47.745154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:47.745183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: error at write: Disconnected sessionId: src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0
2025-10-02T09:29:47.745352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0 is DEAD
2025-10-02T09:29:47.745483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:47.745535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:47.749029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:47.749040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Write session will restart in 0.007360s
2025-10-02T09:29:47.749060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Write session: Do CDS request
2025-10-02T09:29:47.749066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:47.757295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.757428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:47.757443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-10-02T09:29:47.757678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.757706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:47.757709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:47.757712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:47.758187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-10-02T09:29:47.758216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:47.758218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:47.758219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:47.758223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554238928126750:5681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:47.758672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554238928126750:5681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:47.760601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554238928126750:5681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:47.766735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554238928126750:5681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:47.766751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554238928126750:5681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:47.766754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554238928126750:5681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:47.766761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:47.766713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.770413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.770614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.770627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:47.770638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.770707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.770750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554238852604703:4965]
2025-10-02T09:29:47.771332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:47.771636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:47.771689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:47.772005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:47.772084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.772092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.772093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.772095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.772096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.772097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.772098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.772100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.772101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.772102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.772103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.772104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.772109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.772119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.772123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.772126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.772130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.772134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.772137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.772140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.772144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.772148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.772151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.772155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.772161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.772168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.772173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.772179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.772182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.772187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.772191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.772201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.772206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.772215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.772220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.772229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.772235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.772245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.772253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.772259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.772268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.772273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.772282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.772287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.772296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.772303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.772311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.772316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.772355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:47.781899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:47.783718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:47.783733Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:47.783736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.783739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.783746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [2:7556554238852604703:4965]
2025-10-02T09:29:47.783761Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:47.783778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:47.783786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.783788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.783790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.783806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:47.783815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.783821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:47.783876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.783884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.783886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.783888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:47.783890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:47.783953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:47.783960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.783973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.783989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.784007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:47.784030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126665:2446], now have 1 active actors on pipe
2025-10-02T09:29:47.784038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126785:5681], now have 1 active actors on pipe
2025-10-02T09:29:47.784044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.784046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.784049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.784064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:47.784079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:47.784082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:47.784086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:47.784088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:47.784099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:47.784107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:47.784107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 532
2025-10-02T09:29:47.784221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 532
2025-10-02T09:29:47.784138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.784156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:47.784174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:47.784286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.784294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.784314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e734755-a442b989-37f416e3-9b2be265_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:47.784321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.784324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.784326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.784334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.784344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:47.784356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.784475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.784484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.784498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.784589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e734755-a442b989-37f416e3-9b2be265_0
2025-10-02T09:29:47.784965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f3b50f-248ad915-6f0d1ef9-7d948243_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e734755-a442b989-37f416e3-9b2be265_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:47.787444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Write session: try to update token
2025-10-02T09:29:47.787459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:47.796153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:47.796178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.796180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:47.796182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:47.796190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.796194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.796197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554238852604682:4965]
2025-10-02T09:29:47.796231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:47.796237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.796241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:47.796246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:47.796251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:47.796254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:47.796390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:47.801462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|4e734755-a442b989-37f416e3-9b2be265_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:47.803863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:47.843134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554238928126810:5499]
2025-10-02T09:29:47.843425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7556554238928126810:5499]
2025-10-02T09:29:47.933615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:47.933918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.933929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.933955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126810:5499], now have 1 active actors on pipe
2025-10-02T09:29:47.934153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:47.934614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:47.934625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Write session will restart in 0.009677s
2025-10-02T09:29:47.934647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Write session: Do CDS request
2025-10-02T09:29:47.934652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:47.934186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:47.934203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554238928126810:5499]
2025-10-02T09:29:47.934231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:47.934301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e734755-a442b989-37f416e3-9b2be265_0
2025-10-02T09:29:47.934480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|4e734755-a442b989-37f416e3-9b2be265_0 is DEAD
2025-10-02T09:29:47.943535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:47.945325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.945469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:47.945488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:47.945506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-10-02T09:29:47.945622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:47.945621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:47.945628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:47.945635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:47.945650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:47.945658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:47.945662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:47.945684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:47.945717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554238852604821:4974]
2025-10-02T09:29:47.946029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-10-02T09:29:47.946061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:47.946067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:47.946068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:47.946073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554238928126886:5686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:47.946108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:47.946300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:47.946338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:47.946577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:47.946589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554238928126886:5686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:47.946612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.946616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.946617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.946617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.946618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.946618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.946619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.946620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.946620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.946621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.946622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.946622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.946626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.946632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.946635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.946637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.946639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.946641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.946643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.946645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.946647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.946650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.946652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.946654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.946658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.946662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:47.946665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.946668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:47.946670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.946673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:47.946675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.946678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:47.946681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.946684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:47.946687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.946691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:47.946693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.946696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:47.946698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.946701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:47.946703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.946706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:47.946708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.946711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.946713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.946716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.946718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.946720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.946737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:47.948610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554238928126886:5686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:47.955093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554238928126886:5686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:47.955110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554238928126886:5686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:47.955113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554238928126886:5686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:47.955120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:47.957688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:47.959179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:47.959195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:47.959197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:47.959201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:47.959206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [2:7556554238852604821:4974]
2025-10-02T09:29:47.959220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:47.959237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:47.959240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.959243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.959245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.959260Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:47.959266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:47.959273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:47.959323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.959331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.959333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.959335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:47.959338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:47.959394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:47.959403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.959414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:47.959424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:47.959438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:47.959455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126813:2446], now have 1 active actors on pipe
2025-10-02T09:29:47.959463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554238928126924:5686], now have 1 active actors on pipe
2025-10-02T09:29:47.959468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.959470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.959472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.959487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:47.959501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:47.959519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:47.959520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:47.959523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:47.959529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:47.959532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:47.959554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.959561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:47.959552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 533
2025-10-02T09:29:47.959577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:47.959587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 533
2025-10-02T09:29:47.959704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.959712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.959729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:47.959739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:47.959742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:47.959748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:47.959756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:47.959764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:47.959781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.959907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:47.959915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:47.959926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:47.960021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0
2025-10-02T09:29:47.960366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e734755-a442b989-37f416e3-9b2be265_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:47.967623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Write session: try to update token
2025-10-02T09:29:47.967643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:47.972592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:47.972613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:47.972616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:47.972618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:47.972625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.972630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.972633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554238852604816:4974]
2025-10-02T09:29:47.972670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:47.972675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:47.972677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:47.972681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:47.972682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:47.972685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:47.972915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:47.989452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:47.996161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:48.034605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554243223094227:5499]
2025-10-02T09:29:48.034833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7556554243223094227:5499]
2025-10-02T09:29:48.106114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:48.106534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.106546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.106561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094227:5499], now have 1 active actors on pipe
2025-10-02T09:29:48.106765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:48.107179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554243223094227:5499]
2025-10-02T09:29:48.107211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:48.107238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:48.107302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0
2025-10-02T09:29:48.107464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0 is DEAD
2025-10-02T09:29:48.107613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:48.107623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Write session will restart in 0.009166s
2025-10-02T09:29:48.107649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Write session: Do CDS request
2025-10-02T09:29:48.107655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:48.115501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:48.117236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:48.117397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:48.117405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:48.117413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:48.117449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:48.117482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554243147572230:4976]
2025-10-02T09:29:48.117966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:48.118293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.118281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:48.118338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:48.118516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:48.118527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-10-02T09:29:48.118693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:48.118749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.118755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.118757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.118758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.118759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.118760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.118761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.118762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.118763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.118764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.118765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.118766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.118783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.118794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.118797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.118803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.118806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.118810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.118818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.118827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.118830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.118834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.118849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.118858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.118876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.118865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.118872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.118877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.118882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.118886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.118906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:48.118913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:48.118891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.118895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.118900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.118917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:48.118904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.118909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.118913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.118917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.118922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.118927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.118931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.118936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.118940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.118945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.118948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.118955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.118959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.118964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.118968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.118972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.119005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:48.119258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-10-02T09:29:48.119283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:48.119288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:48.119290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:48.119296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554243223094307:5690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:48.119735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554243223094307:5690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:48.121301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554243223094307:5690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:48.127986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554243223094307:5690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:48.128006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554243223094307:5690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:48.128010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554243223094307:5690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:48.128017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:48.128499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:48.130095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:48.130115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:48.130118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:48.130122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:48.130129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [2:7556554243147572230:4976]
2025-10-02T09:29:48.130142Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:48.130158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:48.130161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.130163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.130165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.130178Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:48.130184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:48.130190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:48.130245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.130252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.130254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.130261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:48.130263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:48.130439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 534
2025-10-02T09:29:48.130498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 534
2025-10-02T09:29:48.130326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:48.130335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.130348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.130359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.130374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:48.130394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094229:2446], now have 1 active actors on pipe
2025-10-02T09:29:48.130398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094341:5690], now have 1 active actors on pipe
2025-10-02T09:29:48.130403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.130405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.130406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.130417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:48.130429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:48.130442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:48.130445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:48.130475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.130477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:48.130507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:48.130510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:48.130512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:48.130515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:48.130726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.130738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.130758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:48.130768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.130771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.130773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:48.130781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.130791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:48.130807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.130962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.130968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.130978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.131061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 36 sessionId: src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0
2025-10-02T09:29:48.131363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1fada8-bc35de69-ba00efe9-78e6b507_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:48.133766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Write session: try to update token
2025-10-02T09:29:48.133780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:48.144951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:48.144973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.144984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.145028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:48.145032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:48.145208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:48.145353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:48.145493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:48.145634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:48.145825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:48.145863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:48.146588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:48.148795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:48.149154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.149171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.152250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:48.152282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:48.152285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.152287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:48.152288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:48.152295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.152299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.152302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554243147572225:4976]
2025-10-02T09:29:48.152323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:48.152325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:48.152327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:48.152331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:48.152332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.152334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:48.152360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:48.152485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:48.207179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554243223094350:5499]
2025-10-02T09:29:48.207463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7556554243223094350:5499]
2025-10-02T09:29:48.291178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:48.299530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.299571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.299868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.300054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.300233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.300414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.301131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.301160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.301335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.301513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.301689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.301884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.301983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.302007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.302192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.302379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.302548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.302727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.302818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.302831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.302986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.303161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.303332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.303511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.303609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.303624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.303802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.303984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.304162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.304345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.304460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.304480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.304677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.304887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.305147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.305358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.305451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.305465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.305636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.305815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.306017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.306198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.306301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.306315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.306488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.306661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.306840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.307021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.307149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.307164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.307337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.307517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.307702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.307881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.308052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.308067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.308241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:48.308417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:48.308596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:48.308772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:48.308969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:48.308984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:48.309092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094350:5499], now have 1 active actors on pipe
2025-10-02T09:29:48.309324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:48.309341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:48.309345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:48.309375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0
2025-10-02T09:29:48.309383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554243223094350:5499]
2025-10-02T09:29:48.309431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:48.309584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0 is DEAD
2025-10-02T09:29:48.309743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:48.309750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Write session will restart in 0.005158s
2025-10-02T09:29:48.309770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Write session: Do CDS request
2025-10-02T09:29:48.309775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:48.316291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.316465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:48.316481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-10-02T09:29:48.316783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.316824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:48.316833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:48.316836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:48.317200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-10-02T09:29:48.317230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:48.317235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:48.317237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:48.317242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554243223094424:5695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:48.317726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554243223094424:5695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:48.318124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:48.320026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:48.320024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554243223094424:5695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:48.320206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:48.320214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:48.320223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:48.320271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:48.320306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554243147572345:4979]
2025-10-02T09:29:48.320890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:48.321134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:48.321175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:48.321456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:48.321524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.321530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.321531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.321532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.321533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.321534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.321535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.321536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.321537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.321538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.321540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.321541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.321546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.321556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.321560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.321563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.321567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.321571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.321575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.321578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.321582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.321586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.321589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.321593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.321599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.321606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.321611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.321616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.321621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.321630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.321634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.321639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.321643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.321647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.321655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.321660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.321669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.321673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.321681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.321686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.321690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.321698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.321703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.321711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.321715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.321720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.321727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.321732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.321761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:48.322536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554243223094424:5695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:48.322547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554243223094424:5695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:48.322550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554243223094424:5695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:48.322557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:48.329995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:48.331602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:48.331618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:48.331620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:48.331623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:48.331628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [2:7556554243147572345:4979]
2025-10-02T09:29:48.331641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:48.331655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:48.331661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.331663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.331665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.331676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:48.331680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:48.331686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:48.331725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.331730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.331732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.331734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:48.331737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:48.331782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:48.331789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.331798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.331804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.331813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:48.331829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.331831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.331833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.331840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:48.331848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:48.331852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:48.331859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:48.331860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:48.331861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:48.331862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:48.331869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094353:2446], now have 1 active actors on pipe
2025-10-02T09:29:48.331871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094465:5695], now have 1 active actors on pipe
2025-10-02T09:29:48.331896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.331906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:48.331914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:48.331944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 535
2025-10-02T09:29:48.331981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 535
2025-10-02T09:29:48.332033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.332039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.332055Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:48.332063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.332067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.332069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:48.332078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.332090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:48.332106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.332283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.332292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.332306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.332394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 36 sessionId: src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0
2025-10-02T09:29:48.332684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c433ab31-4c594cbf-3a9a6be4-281dd9af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:48.335114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Write session: try to update token
2025-10-02T09:29:48.335131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:48.342969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:48.342989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.342991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:48.342993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:48.343003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.343007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.343010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554243147572339:4979]
2025-10-02T09:29:48.343046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:48.343059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.343062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:48.343178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:48.343193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:48.343198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:48.343203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:48.348258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:48.350839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:48.409410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554243223094473:5499]
2025-10-02T09:29:48.409675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7556554243223094473:5499]
2025-10-02T09:29:48.487879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554243223094473:5499]
2025-10-02T09:29:48.487917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:48.487946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:48.487949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:48.488008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: error at write: Disconnected sessionId: src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0
2025-10-02T09:29:48.488164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0 is DEAD
2025-10-02T09:29:48.487205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:48.487598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.487607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.487643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094473:5499], now have 1 active actors on pipe
2025-10-02T09:29:48.488791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:48.488901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:48.488913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Write session will restart in 0.007076s
2025-10-02T09:29:48.488936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Write session: Do CDS request
2025-10-02T09:29:48.488942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:48.497231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.497831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:48.497844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-10-02T09:29:48.498138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.498180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:48.498185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:48.498189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:48.498861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-10-02T09:29:48.498892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:48.498894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:48.498896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:48.498900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554243223094539:5700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:48.499331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554243223094539:5700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:48.500615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554243223094539:5700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:48.501017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:48.503066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:48.503244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:48.503257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:48.503267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:48.503320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:48.503352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554243147572472:4982]
2025-10-02T09:29:48.503904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:48.504346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:48.504397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:48.504722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:48.504786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.504787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.504789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.504789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.504790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.504791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.504792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.504793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.504794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.504795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.504796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.504797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.504816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.504827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.504830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.504834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.504837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.504840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.504843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.504846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.504850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.504853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.504856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.504859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.504865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.504872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.504877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.504881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.504885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.504890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.504894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.504897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.504901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.504905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.504909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.504913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.504917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.504921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.504926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.504931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.504935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.504939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.504944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.504949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.504953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.504957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.504962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.504967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.505000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:48.504824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554243223094539:5700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:48.504837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554243223094539:5700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:48.504840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554243223094539:5700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:48.504847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:48.521725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:48.523653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:48.523672Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:48.523677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:48.523681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:48.523688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [2:7556554243147572472:4982]
2025-10-02T09:29:48.523705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:48.523722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:48.523726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.523729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.523732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.523747Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:48.523751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:48.523760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:48.523822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.523824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.523826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.523829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:48.523832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:48.523900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:48.523902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.523915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.523925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.523940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:48.523958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.523960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.523962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.523974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:48.523986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:48.523998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:48.524000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:48.524010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:48.524014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:48.524016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:48.524036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.524038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:48.524043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:48.524046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094600:5700], now have 1 active actors on pipe
2025-10-02T09:29:48.524050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094476:2446], now have 1 active actors on pipe
2025-10-02T09:29:48.525041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.525047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.525070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3648d134-22f3e444-428259b5-d43d6d63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:48.525079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.525082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.525084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:48.525093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.525104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:48.525122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.525273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.525276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.525286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.525814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8716d92-5a5aee1-7790b8ed-4ba1a9eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3648d134-22f3e444-428259b5-d43d6d63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:48.528448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Write session: try to update token
2025-10-02T09:29:48.528465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:48.524837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 536
2025-10-02T09:29:48.524868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 536
2025-10-02T09:29:48.525402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 36 sessionId: src_id|3648d134-22f3e444-428259b5-d43d6d63_0
2025-10-02T09:29:48.539565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:48.539590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.539594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:48.539599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:48.539610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.539615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.539621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554243147572467:4982]
2025-10-02T09:29:48.539666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:48.539671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:48.539679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:48.539679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.539681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:48.539695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:48.539906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:48.549498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|3648d134-22f3e444-428259b5-d43d6d63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:48.552068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:48.593077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554243223094610:5499]
2025-10-02T09:29:48.597186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7556554243223094610:5499]
2025-10-02T09:29:48.688716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:48.689077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.689091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.689107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094610:5499], now have 1 active actors on pipe
2025-10-02T09:29:48.689410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:48.689417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:48.689423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:48.689493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: error at write: Disconnected sessionId: src_id|3648d134-22f3e444-428259b5-d43d6d63_0
2025-10-02T09:29:48.689551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554243223094610:5499]
2025-10-02T09:29:48.689672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|3648d134-22f3e444-428259b5-d43d6d63_0 is DEAD
2025-10-02T09:29:48.690040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:48.690049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Write session will restart in 0.009138s
2025-10-02T09:29:48.690078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Write session: Do CDS request
2025-10-02T09:29:48.690088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:48.691188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:48.700310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.701378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:48.701393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-10-02T09:29:48.704908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.704954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:48.704958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:48.704962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:48.705597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-10-02T09:29:48.705628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:48.705633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:48.705635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:48.705639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554243223094644:5704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:48.706121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554243223094644:5704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:48.709042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554243223094644:5704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:48.710380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:48.712529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:48.712603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554243223094644:5704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:48.712618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554243223094644:5704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:48.712621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554243223094644:5704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:48.712627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:48.712717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:48.712726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:48.712736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:48.712783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:48.712832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554243147572587:4984]
2025-10-02T09:29:48.713386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:48.713797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:48.713857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:48.714190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:48.714256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.714262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.714263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.714264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.714265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.714267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.714268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.714269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.714270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.714271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.714273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.714274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.714280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.714291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.714296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.714300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.714304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.714308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.714312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.714316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.714320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.714325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.714329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.714332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.714340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.714348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.714355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.714364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.714368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.714378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.714382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.714389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.714393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.714399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.714406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.714412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.714421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.714426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.714431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.714437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.714443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.714448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.714456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.714461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.714465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.714470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.714474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.714479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.714515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:48.724003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:48.725864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:48.725888Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:48.725890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:48.725893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:48.725900Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [2:7556554243147572587:4984]
2025-10-02T09:29:48.725913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:48.725931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:48.725934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.725937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.725939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.725953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:48.725958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:48.725969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:48.726034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.726044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.726046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.726049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:48.726052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:48.726121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:48.726128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.726143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.726159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.726179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:48.726198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.726205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.726209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.726222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:48.726240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:48.726257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:48.726260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:48.726297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.726303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:48.726304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:48.726306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:48.726307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:48.726313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094612:2446], now have 1 active actors on pipe
2025-10-02T09:29:48.726313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:48.726382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 537
2025-10-02T09:29:48.726528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 537
2025-10-02T09:29:48.727118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0
2025-10-02T09:29:48.726541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094723:5704], now have 1 active actors on pipe
2025-10-02T09:29:48.726680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.726685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.726707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:48.726717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.726721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.726723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:48.726733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.726743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:48.726756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.726956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.726961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.726981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.727452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3648d134-22f3e444-428259b5-d43d6d63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:48.729923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Write session: try to update token
2025-10-02T09:29:48.729939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:48.737452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:48.737473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.737475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:48.737480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:48.737487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.737491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.737494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554243147572582:4984]
2025-10-02T09:29:48.737527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:48.737533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.737535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:48.737538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:48.737544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:48.737547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:48.737677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:48.749839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:48.752357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:48.789733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554243223094740:5499]
2025-10-02T09:29:48.790193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7556554243223094740:5499]
2025-10-02T09:29:48.879076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:48.879465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.879485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.879502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094740:5499], now have 1 active actors on pipe
2025-10-02T09:29:48.879745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:48.880685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:48.880696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Write session will restart in 0.007490s
2025-10-02T09:29:48.880717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Write session: Do CDS request
2025-10-02T09:29:48.880723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:48.879774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:48.879840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554243223094740:5499]
2025-10-02T09:29:48.879857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:48.879860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:48.879919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: error at write: Disconnected sessionId: src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0
2025-10-02T09:29:48.880088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0 is DEAD
2025-10-02T09:29:48.889267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.892849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:48.892867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-10-02T09:29:48.892930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:48.893015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:48.893045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:48.893054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:48.893058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:48.895098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:48.895111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-10-02T09:29:48.895148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:48.895151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:48.895152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:48.895157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554243223094848:5716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:48.895326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:48.895338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:48.895348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:48.895400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:48.895440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554243147572742:4999]
2025-10-02T09:29:48.895644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554243223094848:5716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:48.895964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:48.896222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:48.896253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:48.896525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:48.896565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.896566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.896567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.896568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.896569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.896570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.896571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.896572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.896573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.896574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.896575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.896576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.896580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.896590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.896593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.896597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.896601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.896604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.896608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.896611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.896614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.896618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.896621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.896624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.896630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.896637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:48.896642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.896647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:48.896655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.896661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:48.896665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.896671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:48.896675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.896681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:48.896686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.896691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:48.896695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.896700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:48.896704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.896709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:48.896713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.896718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:48.896722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.896726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.896731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.896735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.896739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.896743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.896781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:48.901677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554243223094848:5716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:48.906224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554243223094848:5716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:48.906244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554243223094848:5716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:48.906248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554243223094848:5716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:48.906255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:48.907242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:48.908928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:48.908948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:48.908951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:48.908954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:48.908963Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [2:7556554243147572742:4999]
2025-10-02T09:29:48.908977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:48.908992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:48.908996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.908999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.909001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.909016Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:48.909021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:48.909027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:48.909086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.909094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.909096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.909099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:48.909101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:48.909165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:48.909174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.909188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:48.909202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:48.909221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:48.909243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094770:2446], now have 1 active actors on pipe
2025-10-02T09:29:48.909251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094882:5716], now have 1 active actors on pipe
2025-10-02T09:29:48.909257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.909263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.909266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.909279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:48.909291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:48.909306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:48.909315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:48.909345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.909352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:48.909465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:48.909477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:48.909481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:48.909489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:48.909341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 538
2025-10-02T09:29:48.909374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 538
2025-10-02T09:29:48.909952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.909963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.909985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:48.910002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:48.910012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:48.910015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:48.910024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:48.910034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:48.910051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.910433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.910443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.910457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:48.910911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fa0a04-5db89d37-ee3bcbd7-de86cf6e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:48.913683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Write session: try to update token
2025-10-02T09:29:48.913702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:48.910598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0
2025-10-02T09:29:48.928027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:48.929836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:48.929859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.929867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.929913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:48.929918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:48.930123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:48.930273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:48.930373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:48.930414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:48.930557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:48.930754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:48.930799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:48.930810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:48.930826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:48.930961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:48.931159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:48.934941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:48.934960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:48.934964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:48.934966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:48.934973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.934979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.934985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554243147572737:4999]
2025-10-02T09:29:48.935016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:48.935022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:48.935025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:48.935030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:48.935038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:48.935043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:48.935188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:48.979761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554243223094891:5499]
2025-10-02T09:29:48.980195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7556554243223094891:5499]
2025-10-02T09:29:49.079759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:49.091534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.091563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.091735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.091792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.091850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.091908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.092109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.092114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.092177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.092242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.092301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.092372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.092414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.092421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.092482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.092537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.092596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.092661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.093037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.093047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.093105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.093199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.093265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.093333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.093380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.093388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.093475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.093542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.093606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.093667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.093710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.093718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.093781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.093837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.093896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.093956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.094009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.094017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.094077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.094135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.094204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.094268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.094321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.094333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.094398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.094460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.094519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.094576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.094647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.094655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.094715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.094776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.094839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.094904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.094949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.094957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.095021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:49.095090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:49.095147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:49.095210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:49.095274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:49.095281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:49.095345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554243223094891:5499], now have 1 active actors on pipe
2025-10-02T09:29:49.095602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554243223094891:5499]
2025-10-02T09:29:49.095628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:49.095665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:49.095673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:49.095699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0
2025-10-02T09:29:49.095863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0 is DEAD
2025-10-02T09:29:49.095935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:49.096877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:49.096896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Write session will restart in 0.008223s
2025-10-02T09:29:49.096918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Write session: Do CDS request
2025-10-02T09:29:49.096924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:49.106083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:49.107093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.107213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:49.107228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-10-02T09:29:49.107413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.107447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:49.107457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:49.107460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:49.107886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-10-02T09:29:49.107919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:49.107923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:49.107926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:49.107931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554247518062269:5720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:49.108435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554247518062269:5720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:49.108846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:49.109025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:49.109036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:49.109044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:49.109093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:49.109126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554247442540155:5001]
2025-10-02T09:29:49.109671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:49.110152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:49.110223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:49.110525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:49.110597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.110598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.110599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.110600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.110601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.110602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.110603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.110604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.110604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.110605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.110606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.110608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.110613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.110622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.110625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.110628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.110632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.110635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.110639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.110642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.110646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.110649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.110653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.110656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.110661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.110668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.110674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.110678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.110681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.110686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.110690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.110694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.110698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.110702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.110706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.110709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.110713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.110717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.110721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.110725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.110728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.110733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.110736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.110740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.110744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.110748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.110752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.110756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.110800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:49.112327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554247518062269:5720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:49.118572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554247518062269:5720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:49.118593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554247518062269:5720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:49.118597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554247518062269:5720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:49.118606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:49.121333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:49.122828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:49.122847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:49.122850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:49.122853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:49.122860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [2:7556554247442540155:5001]
2025-10-02T09:29:49.122875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:49.122892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:49.122895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.122898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.122900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.122916Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:49.122926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:49.122935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:49.122979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.122984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.122986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.122989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:49.122992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:49.123066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:49.123075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.123087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.123098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.123117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:49.123133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.123135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.123137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.123144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:49.123153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:49.123156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:49.123157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062306:5720], now have 1 active actors on pipe
2025-10-02T09:29:49.123158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:49.123163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062190:2446], now have 1 active actors on pipe
2025-10-02T09:29:49.123168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:49.123181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:49.123191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:49.123219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.123230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:49.123247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 539
2025-10-02T09:29:49.123285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 539
2025-10-02T09:29:49.123253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:49.123390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.123395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.123417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77738106-4f80dafa-286b92ee-798f89c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:49.123424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.123435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.123437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:49.123445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.123454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:49.123466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.123669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.123682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.123702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.123800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 36 sessionId: src_id|77738106-4f80dafa-286b92ee-798f89c1_0
2025-10-02T09:29:49.124140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf5b4bb4-be926b7f-ae3a5bfe-c255b2ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77738106-4f80dafa-286b92ee-798f89c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:49.126597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Write session: try to update token
2025-10-02T09:29:49.126613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:49.134711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:49.134729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:49.134732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:49.134735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:49.134743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.134747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.134751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554247442540149:5001]
2025-10-02T09:29:49.134788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:49.134790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:49.134794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:49.134795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.134797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:49.134797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:49.134942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:49.140398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|77738106-4f80dafa-286b92ee-798f89c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:49.142807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:49.195834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554247518062316:5499]
2025-10-02T09:29:49.198025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7556554247518062316:5499]
2025-10-02T09:29:49.273009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:49.273370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.273388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.273406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062316:5499], now have 1 active actors on pipe
2025-10-02T09:29:49.273626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:49.273682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554247518062316:5499]
2025-10-02T09:29:49.273683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:49.273687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:49.273712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:49.273746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: error at write: Disconnected sessionId: src_id|77738106-4f80dafa-286b92ee-798f89c1_0
2025-10-02T09:29:49.273910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|77738106-4f80dafa-286b92ee-798f89c1_0 is DEAD
2025-10-02T09:29:49.274027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:49.274038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Write session will restart in 0.007219s
2025-10-02T09:29:49.274058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Write session: Do CDS request
2025-10-02T09:29:49.274064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:49.282294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.282383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:49.282399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-10-02T09:29:49.282540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.282576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:49.282583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:49.282587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:49.282995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-10-02T09:29:49.283029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:49.283034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:49.283036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:49.283041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554247518062395:5725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:49.283550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554247518062395:5725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:49.284066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:49.285714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554247518062395:5725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:49.286069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:49.286228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:49.286237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:49.286245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:49.286290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:49.286333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554247442540275:5004]
2025-10-02T09:29:49.286989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:49.287286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:49.287325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:49.287665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:49.287725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.287733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.287734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.287735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.287736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.287737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.287738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.287739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.287740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.287741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.287743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.287744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.287748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.287760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.287765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.287769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.287774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.287778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.287782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.287787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.287791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.287796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.287799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.287803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.287809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.287815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.287820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.287826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.287830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.287836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.287840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.287846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.287850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.287856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.287864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.287869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.287879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.287885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.287894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.287899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.287904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.287909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.287913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.287918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.287928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.287933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.287937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.287942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.287982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:49.288055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554247518062395:5725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:49.288069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554247518062395:5725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:49.288072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554247518062395:5725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:49.288077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:49.296386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:49.298005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:49.298024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:49.298027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:49.298032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:49.298038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [2:7556554247442540275:5004]
2025-10-02T09:29:49.298053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:49.298070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:49.298078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.298080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.298083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.298098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:49.298107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:49.298113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:49.298172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.298180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.298183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.298187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:49.298189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:49.298268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:49.298276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.298289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.298304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.298325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:49.298347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.298354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.298357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.298372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:49.298388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:49.298409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:49.298412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:49.298420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:49.298424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:49.298426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:49.298445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.298454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:49.298624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 540
2025-10-02T09:29:49.298627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 540
2025-10-02T09:29:49.298507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:49.298548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062318:2446], now have 1 active actors on pipe
2025-10-02T09:29:49.298553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062435:5725], now have 1 active actors on pipe
2025-10-02T09:29:49.298690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.298694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.298716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eb3438-324de790-3c6704b8-8463a6a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:49.298721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.298724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.298726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:49.298734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.298741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:49.298751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.298965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.298977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.298997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.299083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 36 sessionId: src_id|6eb3438-324de790-3c6704b8-8463a6a1_0
2025-10-02T09:29:49.299431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77738106-4f80dafa-286b92ee-798f89c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6eb3438-324de790-3c6704b8-8463a6a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:49.301964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Write session: try to update token
2025-10-02T09:29:49.301982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:49.313401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:49.313427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:49.313430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:49.313432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:49.313439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.313444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.313447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554247442540269:5004]
2025-10-02T09:29:49.313487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:49.313493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.313495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:49.313498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:49.313505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:49.313509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:49.313618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:49.316583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|6eb3438-324de790-3c6704b8-8463a6a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:49.319043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:49.373772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554247518062444:5499]
2025-10-02T09:29:49.374298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7556554247518062444:5499]
2025-10-02T09:29:49.465494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:49.465886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.465894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.465924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062444:5499], now have 1 active actors on pipe
2025-10-02T09:29:49.466063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:49.466610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:49.466627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:49.466631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:49.466655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554247518062444:5499]
2025-10-02T09:29:49.466696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: error at write: Disconnected sessionId: src_id|6eb3438-324de790-3c6704b8-8463a6a1_0
2025-10-02T09:29:49.466853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|6eb3438-324de790-3c6704b8-8463a6a1_0 is DEAD
2025-10-02T09:29:49.466994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:49.467001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Write session will restart in 0.007599s
2025-10-02T09:29:49.467023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Write session: Do CDS request
2025-10-02T09:29:49.467029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:49.475299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.475387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:49.475400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-10-02T09:29:49.475536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.475577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:49.475589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:49.475594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:49.475982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-10-02T09:29:49.476021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:49.476022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:49.476024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:49.476028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554247518062482:5729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:49.476508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554247518062482:5729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:49.478917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554247518062482:5729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:49.481613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:49.481986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554247518062482:5729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:49.481999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554247518062482:5729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:49.482002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554247518062482:5729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:49.482015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:49.482053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:49.482223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:49.482233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:49.482243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:49.482295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:49.482328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554247442540407:5007]
2025-10-02T09:29:49.482822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:49.483106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:49.483166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:49.483471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:49.483529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.483536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.483537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.483538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.483539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.483540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.483541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.483542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.483543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.483544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.483545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.483546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.483550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.483560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.483563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.483567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.483570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.483573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.483576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.483579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.483582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.483585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.483587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.483590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.483599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.483605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.483609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.483614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.483618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.483622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.483625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.483630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.483634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.483638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.483642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.483645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.483652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.483657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.483660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.483665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.483670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.483675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.483684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.483689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.483693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.483697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.483701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.483705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.483745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:49.492342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:49.493963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:49.493984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:49.493986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:49.493990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:49.493996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [2:7556554247442540407:5007]
2025-10-02T09:29:49.494009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:49.494024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:49.494032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.494035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.494037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.494050Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:49.494055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:49.494061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:49.494114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.494122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.494124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.494127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:49.494129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:49.494258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:49.494269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.494280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.494290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.494304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:49.494322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062447:2446], now have 1 active actors on pipe
2025-10-02T09:29:49.494326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062562:5729], now have 1 active actors on pipe
2025-10-02T09:29:49.494331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.494334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.494336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.494351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:49.494339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 541
2025-10-02T09:29:49.494367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:49.494341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 541
2025-10-02T09:29:49.494377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:49.494383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:49.494383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:49.494385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:49.494385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:49.494427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.494435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.494445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.494453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:49.494471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:49.494479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:49.494485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.494487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.494489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:49.494496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.494503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:49.494525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.494672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.494687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.494709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.494792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 36 sessionId: src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0
2025-10-02T09:29:49.495140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb3438-324de790-3c6704b8-8463a6a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:49.497848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Write session: try to update token
2025-10-02T09:29:49.497866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:49.505705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:49.505729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:49.505731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:49.505733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:49.505743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.505747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.505751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554247442540401:5007]
2025-10-02T09:29:49.505785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:49.505793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.505795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:49.505795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:49.505800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:49.505805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:49.505922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:49.510491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:49.512976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:49.565500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554247518062585:5499]
2025-10-02T09:29:49.565760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7556554247518062585:5499]
2025-10-02T09:29:49.647638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:49.647959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.647974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.648008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062585:5499], now have 1 active actors on pipe
2025-10-02T09:29:49.648197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:49.648225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:49.648254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554247518062585:5499]
2025-10-02T09:29:49.648274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:49.648343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0
2025-10-02T09:29:49.648511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0 is DEAD
2025-10-02T09:29:49.648672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:49.648684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Write session will restart in 0.007530s
2025-10-02T09:29:49.648707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Write session: Do CDS request
2025-10-02T09:29:49.648713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:49.657223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.657333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:49.657348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-10-02T09:29:49.657448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.657479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:49.657488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:49.657493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:49.657862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-10-02T09:29:49.657899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:49.657905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:49.657907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:49.657912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554247518062668:5734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:49.658219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:49.658428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554247518062668:5734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:49.660092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:49.660265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:49.660277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:49.660287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:49.660340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:49.660332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554247518062668:5734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:49.660375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554247442540527:5009]
2025-10-02T09:29:49.660975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:49.661258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:49.661306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:49.661611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:49.661675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.661682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.661683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.661684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.661685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.661686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.661687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.661688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.661689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.661690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.661691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.661692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.661697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.661707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.661711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.661714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.661717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.661720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.661724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.661727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.661731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.661735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.661738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.661742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.661747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.661754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.661760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.661771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.661775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.661784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.661787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.661794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.661799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.661808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.661812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.661821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.661825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.661833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.661837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.661843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.661851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.661856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.661860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.661868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.661872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.661881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.661885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.661894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.661927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:49.662200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554247518062668:5734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:49.662212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554247518062668:5734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:49.662224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554247518062668:5734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:49.662229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:49.670197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:49.671792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:49.671811Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:49.671813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:49.671817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:49.671823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [2:7556554247442540527:5009]
2025-10-02T09:29:49.671837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:49.671853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:49.671856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.671860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.671862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.671876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:49.671888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:49.671895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:49.671951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.671957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.671959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.671963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:49.671965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:49.672154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:49.672164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.672176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.672188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.672205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:49.672182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 542
2025-10-02T09:29:49.672223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062708:5734], now have 1 active actors on pipe
2025-10-02T09:29:49.672231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062588:2446], now have 1 active actors on pipe
2025-10-02T09:29:49.672237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.672239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.672241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.672250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:49.672259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:49.672262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:49.672262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:49.672264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:49.672275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:49.672278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:49.672294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.672298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.672332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.672329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 542
2025-10-02T09:29:49.672345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:49.672358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:49.672361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:49.672366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.672369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.672371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:49.672379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.672387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:49.672422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.672605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.672621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.672643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.672752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 36 sessionId: src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0
2025-10-02T09:29:49.673095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a76b92-d029b07c-2b0a3935-cb2dfcb7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:49.675515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Write session: try to update token
2025-10-02T09:29:49.675528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:49.683232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:49.683249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:49.683251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:49.683253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:49.683261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.683264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.683268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554247442540521:5009]
2025-10-02T09:29:49.683302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:49.683309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.683311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:49.683315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:49.683321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:49.683325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:49.683452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:49.692508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:49.695115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:49.748269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554247518062722:5499]
2025-10-02T09:29:49.748552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7556554247518062722:5499]
2025-10-02T09:29:49.824201Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:49.824473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.824486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.824501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062722:5499], now have 1 active actors on pipe
2025-10-02T09:29:49.824644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:49.824870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:49.824925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554247518062722:5499]
2025-10-02T09:29:49.824943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:49.825008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0
2025-10-02T09:29:49.825166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0 is DEAD
2025-10-02T09:29:49.829019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:49.829030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Write session will restart in 0.007561s
2025-10-02T09:29:49.829053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Write session: Do CDS request
2025-10-02T09:29:49.829058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:49.837259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.838185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:49.840487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:49.840656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:49.840665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:49.840674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:49.840715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:49.840750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554247442540664:5017]
2025-10-02T09:29:49.841321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:49.841569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:49.841606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:49.841887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:49.841934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.841940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.841941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.841942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.841943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.841944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.841945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.841946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.841947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.841947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.841948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.841949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.841954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.841963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.841967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.841971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.841975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.841978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.841982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.841985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.841989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.841993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.841997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.842000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.842006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.842012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:49.842017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.842022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:49.842026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.842031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:49.842036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.842040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:49.842044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.842054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:49.842058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.842065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:49.842069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.842074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:49.842079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.842084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:49.842095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.842100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:49.842104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.842109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.842114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.842123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.842126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.842130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.842163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:49.838439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:49.838453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-10-02T09:29:49.838610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:49.838635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:49.838638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:49.838642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:49.838977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-10-02T09:29:49.839001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:49.839004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:49.839006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:49.839011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554247518062815:5739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:49.839529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554247518062815:5739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:49.841330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554247518062815:5739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:49.851327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:49.850436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554247518062815:5739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:49.850452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554247518062815:5739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:49.850455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554247518062815:5739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:49.850462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:49.853357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:49.853374Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:49.853377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:49.853380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:49.853385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [2:7556554247442540664:5017]
2025-10-02T09:29:49.853396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:49.853416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:49.853425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.853428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.853429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.853442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:49.853447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:49.853453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:49.853504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.853511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.853513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.853515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:49.853517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:49.853572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:49.853579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.853591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:49.853602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:49.853622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:49.853642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062732:2446], now have 1 active actors on pipe
2025-10-02T09:29:49.853649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062866:5739], now have 1 active actors on pipe
2025-10-02T09:29:49.853654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.853657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.853660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.853669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:49.853684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:49.853688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:49.853691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:49.853692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:49.853702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:49.853705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:49.853735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.853743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:49.853745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:49.853864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 543
2025-10-02T09:29:49.853889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 543
2025-10-02T09:29:49.854059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.854071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.854091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:49.854100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:49.854103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:49.854105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:49.854112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:49.854120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:49.854134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.854749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0
2025-10-02T09:29:49.855278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c64da5-3b85763e-309bdbf4-f50ace19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:49.857728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Write session: try to update token
2025-10-02T09:29:49.857743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:49.854356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:49.854363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:49.854376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:49.864947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:49.864967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:49.864969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:49.864971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:49.864978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.864982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.864985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554247442540658:5017]
2025-10-02T09:29:49.865015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:49.865021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:49.865022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:49.865131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:49.867952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:49.867965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:49.867969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:49.871981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:49.874232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:49.924863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554247518062884:5499]
2025-10-02T09:29:49.925853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7556554247518062884:5499]
2025-10-02T09:29:50.009869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:50.010285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.010293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.010330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554247518062884:5499], now have 1 active actors on pipe
2025-10-02T09:29:50.010776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:50.011723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:50.011775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:50.011858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0
2025-10-02T09:29:50.012033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0 is DEAD
2025-10-02T09:29:50.012206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554247518062884:5499]
2025-10-02T09:29:50.012990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:50.013001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Write session will restart in 0.006699s
2025-10-02T09:29:50.013025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Write session: Do CDS request
2025-10-02T09:29:50.013031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:50.021245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.022599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:50.022617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-10-02T09:29:50.023332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.023364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:50.023371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:50.023375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:50.023719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-10-02T09:29:50.023743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:50.023744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:50.023747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:50.023751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554251813030196:5750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:50.024124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554251813030196:5750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:50.026230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554251813030196:5750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:50.029697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554251813030196:5750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:50.029712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554251813030196:5750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:50.029715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554251813030196:5750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:50.029723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:50.034832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:50.038230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:50.038408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:50.038411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:50.038427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:50.038466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:50.038490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554251737508106:5026]
2025-10-02T09:29:50.038892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:50.039257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:50.039305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:50.039618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:50.039680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.039686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.039687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.039688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.039690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.039691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.039692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.039694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.039695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.039696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.039697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.039699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.039703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.039714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.039718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.039722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.039726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.039730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.039734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.039738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.039741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.039746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.039755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.039758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.039766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.039774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.039781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.039790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.039797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.039802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.039806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.039816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.039821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.039825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.039830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.039835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.039840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.039846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.039853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.039858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.039862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.039867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.039872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.039878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.039883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.039889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.039892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.039897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.039954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:50.048833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:50.050553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:50.050573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:50.050576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:50.050582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:50.050587Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [2:7556554251737508106:5026]
2025-10-02T09:29:50.050602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:50.050621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:50.050625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.050628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.050630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.050643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:50.050648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:50.050658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:50.050715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.050717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.050719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.050722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:50.050724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:50.050786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:50.050789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.050801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.050812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.050827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:50.050844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.050846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.050848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.050860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:50.050875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:50.050887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:50.050891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:50.050926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.050928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:50.051062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:50.051065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:50.051067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:50.051073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:50.051370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030296:5750], now have 1 active actors on pipe
2025-10-02T09:29:50.051374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030181:2446], now have 1 active actors on pipe
2025-10-02T09:29:50.051793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 544
2025-10-02T09:29:50.051842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 544
2025-10-02T09:29:50.052284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.052305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.052331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|774a8c10-be919fbf-139f3286-7fb4766b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:50.052341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.052345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.052347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.052356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.052367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:50.052384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.052705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.052714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.052729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.053043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 36 sessionId: src_id|774a8c10-be919fbf-139f3286-7fb4766b_0
2025-10-02T09:29:50.053412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f36ef9-198fdaf3-a29c22f-c2897fa4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|774a8c10-be919fbf-139f3286-7fb4766b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:50.056060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Write session: try to update token
2025-10-02T09:29:50.056074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:50.063734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:50.063765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.063771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:50.063774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:50.063784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.063790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.063794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554251737508100:5026]
2025-10-02T09:29:50.063837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:50.063846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.063853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:50.063855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:50.063858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:50.063862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:50.064114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:50.082118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|774a8c10-be919fbf-139f3286-7fb4766b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:50.085130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:50.108915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554251813030312:5499]
2025-10-02T09:29:50.109405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7556554251813030312:5499]
2025-10-02T09:29:50.210003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:50.210468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.210486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.210504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030312:5499], now have 1 active actors on pipe
2025-10-02T09:29:50.210733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:50.210755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554251813030312:5499]
2025-10-02T09:29:50.210797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:50.210800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:50.210834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:50.210853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: error at write: Disconnected sessionId: src_id|774a8c10-be919fbf-139f3286-7fb4766b_0
2025-10-02T09:29:50.211002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|774a8c10-be919fbf-139f3286-7fb4766b_0 is DEAD
2025-10-02T09:29:50.211122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:50.211132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Write session will restart in 0.007242s
2025-10-02T09:29:50.211152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Write session: Do CDS request
2025-10-02T09:29:50.211156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:50.219278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.219359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:50.219373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-10-02T09:29:50.219499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.219527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:50.219532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:50.219536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:50.220172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-10-02T09:29:50.220207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:50.220215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:50.220216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:50.220221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554251813030397:5755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:50.220725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554251813030397:5755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:50.221270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:50.223614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:50.223868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:50.223880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:50.223891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:50.223941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:50.223977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554251737508230:5029]
2025-10-02T09:29:50.224558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:50.224669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554251813030397:5755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:50.224833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:50.224865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:50.225104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:50.225140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.225146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.225146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.225147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.225148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.225148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.225149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.225150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.225150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.225151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.225151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.225152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.225155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.225162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.225164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.225167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.225169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.225171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.225173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.225176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.225178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.225180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.225182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.225184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.225188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.225193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.225198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.225201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.225204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.225206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.225209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.225213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.225215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.225218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.225220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.225223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.225226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.225230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.225232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.225235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.225238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.225240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.225243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.225245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.225248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.225250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.225254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.225257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.225274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:50.229937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554251813030397:5755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:50.229955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554251813030397:5755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:50.229958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554251813030397:5755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:50.229966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:50.234194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:50.235806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:50.235824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:50.235826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:50.235829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:50.235834Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [2:7556554251737508230:5029]
2025-10-02T09:29:50.235924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:50.235946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:50.235949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.235952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.235954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.235967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:50.235973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:50.235979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:50.236022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.236030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.236032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.236035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:50.236037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:50.236101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:50.236109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.236121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.236132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.236148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:50.236170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030439:5755], now have 1 active actors on pipe
2025-10-02T09:29:50.236178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030316:2446], now have 1 active actors on pipe
2025-10-02T09:29:50.236183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.236187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.236189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.236200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:50.236213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:50.236217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:50.236217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:50.236219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:50.236231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:50.236233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:50.236264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.236272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:50.236297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:50.237668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 545
2025-10-02T09:29:50.237669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 545
2025-10-02T09:29:50.237859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.237874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.237902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:50.237915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.237919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.237921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.237931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.237942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:50.237962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.240471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.240486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.240511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.240609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 36 sessionId: src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0
2025-10-02T09:29:50.240972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|774a8c10-be919fbf-139f3286-7fb4766b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:50.243516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Write session: try to update token
2025-10-02T09:29:50.243533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:50.248943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:50.248974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.248983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.249026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:50.249043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:50.249196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:50.249350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:50.249506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:50.249669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:50.249886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:50.249932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:50.260117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:50.260144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.260147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:50.260149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:50.260158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.260162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.260166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554251737508224:5029]
2025-10-02T09:29:50.260206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:50.260214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.260216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:50.260266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:50.260283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:50.260287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:50.260349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:50.262782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:50.265296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:50.311006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554251813030447:5499]
2025-10-02T09:29:50.311368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7556554251813030447:5499]
2025-10-02T09:29:50.405776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:50.406153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.406161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.406179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030447:5499], now have 1 active actors on pipe
2025-10-02T09:29:50.406426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:50.406492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:50.406514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:50.406580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: error at write: Disconnected sessionId: src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0
2025-10-02T09:29:50.406753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0 is DEAD
2025-10-02T09:29:50.406857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:50.406872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Write session will restart in 0.005412s
2025-10-02T09:29:50.406904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Write session: Do CDS request
2025-10-02T09:29:50.406909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:50.406934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:50.406990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554251813030447:5499]
2025-10-02T09:29:50.413174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.413379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:50.413393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-10-02T09:29:50.413494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.413523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:50.413534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:50.413538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:50.413963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-10-02T09:29:50.413995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:50.414004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:50.414005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:50.414009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554251813030495:5759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:50.414451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554251813030495:5759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:50.416242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554251813030495:5759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:50.416512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:50.418561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:50.418716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554251813030495:5759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:50.418730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554251813030495:5759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:50.418733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554251813030495:5759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:50.418738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:50.418758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:50.418769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:50.418779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:50.418833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:50.418860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554251737508355:5031]
2025-10-02T09:29:50.419385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:50.419770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:50.419827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:50.420141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:50.420216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.420223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.420224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.420225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.420226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.420227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.420228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.420229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.420230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.420231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.420232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.420233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.420238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.420248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.420252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.420256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.420260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.420264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.420268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.420272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.420276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.420280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.420284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.420287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.420295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.420303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.420309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.420314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.420319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.420324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.420328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.420332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.420337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.420342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.420347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.420352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.420356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.420362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.420374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.420379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.420384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.420396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.420400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.420410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.420415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.420421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.420429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.420434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.420472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:50.429657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:50.431541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:50.431567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:50.431571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:50.431576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:50.431585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [2:7556554251737508355:5031]
2025-10-02T09:29:50.431603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:50.431625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:50.431628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.431632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.431635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.431654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:50.431666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:50.431673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:50.431748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.431758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.431761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.431765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:50.431768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:50.431854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:50.431863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.431877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.431889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.431912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:50.431940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030573:5759], now have 1 active actors on pipe
2025-10-02T09:29:50.431949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030453:2446], now have 1 active actors on pipe
2025-10-02T09:29:50.431957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.431959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.431962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.431977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:50.431998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:50.432009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:50.432013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:50.432015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:50.432019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:50.432023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:50.432032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 546
2025-10-02T09:29:50.432074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 546
2025-10-02T09:29:50.432065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.432082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:50.432095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:50.432274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.432292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.432324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:50.432340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.432344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.432346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.432417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.432435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:50.432465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.432715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.432730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.432752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.432900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 36 sessionId: src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0
2025-10-02T09:29:50.433381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84ce708-703b7d54-3391673f-ec6d6c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:50.435978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Write session: try to update token
2025-10-02T09:29:50.435995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:50.443524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:50.443549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.443563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.443610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:50.443620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:50.443804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:50.443970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:50.444142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:50.444293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:50.444506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:50.444557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:50.454652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:50.454680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.454683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:50.454686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:50.454699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.454703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.454711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554251737508349:5031]
2025-10-02T09:29:50.454757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:50.454763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:50.454765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.454769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:50.454769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:50.454774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:50.454935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:50.453023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:50.455525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:50.507056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554251813030597:5499]
2025-10-02T09:29:50.507252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7556554251813030597:5499]
2025-10-02T09:29:50.604691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:50.605145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.605162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.605181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030597:5499], now have 1 active actors on pipe
2025-10-02T09:29:50.605381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:50.605407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:50.605421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:50.605439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554251813030597:5499]
2025-10-02T09:29:50.605457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:50.605482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0
2025-10-02T09:29:50.605651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0 is DEAD
2025-10-02T09:29:50.606041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:50.606052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Write session will restart in 0.009096s
2025-10-02T09:29:50.606091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Write session: Do CDS request
2025-10-02T09:29:50.606097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:50.615739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:50.616302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.616439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:50.616453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-10-02T09:29:50.616530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.616558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:50.616567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:50.616571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:50.616990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-10-02T09:29:50.617028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:50.617030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:50.617031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:50.617036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554251813030685:5764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:50.617517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554251813030685:5764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:50.618037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:50.618213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:50.618225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:50.618234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:50.618280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:50.618321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554251737508492:5034]
2025-10-02T09:29:50.618881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:50.619211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:50.619250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:50.619551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:50.619607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.619613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.619614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.619614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.619615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.619616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.619617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.619618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.619619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.619620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.619621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.619622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.619628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.619638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.619642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.619646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.619649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.619652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.619656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.619660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.619664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.619667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.619671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.619675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.619680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.619687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.619693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.619698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.619703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.619708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.619712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.619717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.619721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.619731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.619735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.619743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.619747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.619751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.619725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554251813030685:5764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:50.619755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.619764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.619768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.619773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.619778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.619783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.619787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.619791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.619794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.619799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.619838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:50.629819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554251813030685:5764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:50.629869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554251813030685:5764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:50.629873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554251813030685:5764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:50.629882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:50.632863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:50.634772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:50.634794Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:50.634797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:50.634802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:50.634809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [2:7556554251737508492:5034]
2025-10-02T09:29:50.634824Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:50.634844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:50.634852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.634855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.634857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.634873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:50.634879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:50.634887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:50.634949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.634957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.634960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.634963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:50.634966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:50.635035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:50.635060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.635075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.635086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.635103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:50.635126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030599:2446], now have 1 active actors on pipe
2025-10-02T09:29:50.635136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030723:5764], now have 1 active actors on pipe
2025-10-02T09:29:50.635143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.635151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.635153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.635167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:50.635178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:50.635184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:50.635185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:50.635188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:50.635203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:50.635207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:50.635188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 547
2025-10-02T09:29:50.635191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 547
2025-10-02T09:29:50.635243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.635256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:50.635261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:50.635280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.635288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.635461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:50.635474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.635479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.635481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.635492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.635509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:50.635534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.635705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.635713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.635727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.635837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 36 sessionId: src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0
2025-10-02T09:29:50.636205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baf8da7-cd7a0ccf-22027b36-6f2d8f8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:50.638823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Write session: try to update token
2025-10-02T09:29:50.638841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:50.646365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:50.646391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.646393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:50.646395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:50.646403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.646407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.646412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554251737508486:5034]
2025-10-02T09:29:50.646459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:50.646465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.646467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:50.646476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:50.646489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:50.646493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:50.646607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:50.654169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:50.656618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:50.705742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554251813030732:5499]
2025-10-02T09:29:50.706021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7556554251813030732:5499]
2025-10-02T09:29:50.791970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:50.792391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.792407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.792422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030732:5499], now have 1 active actors on pipe
2025-10-02T09:29:50.792628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:50.792655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554251813030732:5499]
2025-10-02T09:29:50.792673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:50.792675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:50.792671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:50.792738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: error at write: Disconnected sessionId: src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0
2025-10-02T09:29:50.792922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0 is DEAD
2025-10-02T09:29:50.793053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:50.793064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Write session will restart in 0.009038s
2025-10-02T09:29:50.793087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Write session: Do CDS request
2025-10-02T09:29:50.793093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:50.802878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:50.803457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.803566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:50.803580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-10-02T09:29:50.803694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.803721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:50.803730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:50.803734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:50.804096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-10-02T09:29:50.804125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:50.804130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:50.804132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:50.804137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554251813030828:5769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:50.804603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554251813030828:5769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:50.804862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:50.805040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:50.805050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:50.805059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:50.805106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:50.805145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554251737508618:5036]
2025-10-02T09:29:50.805722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:50.806006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:50.806045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:50.806204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554251813030828:5769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:50.806335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:50.806383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.806390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.806391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.806392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.806393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.806394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.806395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.806397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.806398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.806399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.806400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.806401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.806405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.806416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.806420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.806424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.806428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.806432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.806435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.806439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.806443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.806449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.806453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.806457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.806462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.806469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.806474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.806480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.806485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.806491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.806494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.806500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.806504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.806509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.806514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.806518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.806523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.806537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.806541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.806546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.806550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.806555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.806560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.806565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.806569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.806574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.806578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.806583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.806616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:50.812264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554251813030828:5769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:50.812280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554251813030828:5769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:50.812284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554251813030828:5769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:50.812291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:50.814986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:50.816620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:50.816642Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:50.816645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:50.816649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:50.816656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [2:7556554251737508618:5036]
2025-10-02T09:29:50.816672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:50.816689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:50.816697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.816700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.816702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.816717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:50.816726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:50.816737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:50.816797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.816825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.816827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.816830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:50.816833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:50.816892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:50.816900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.816912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.816927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.816947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:50.816971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030870:5769], now have 1 active actors on pipe
2025-10-02T09:29:50.816979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030741:2446], now have 1 active actors on pipe
2025-10-02T09:29:50.816985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.816987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.816989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.817000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:50.817009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:50.817012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:50.817014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:50.817017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:50.817030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:50.817038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:50.817080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.817088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.817098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.817109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:50.817112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:50.817139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:50.817148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.817152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.817155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.817165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.817176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:50.817202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.817000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 548
2025-10-02T09:29:50.817004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 548
2025-10-02T09:29:50.817326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.817336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.817349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:50.817399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0
2025-10-02T09:29:50.817694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58efb1b-91f87371-4b9f596b-6a448e53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:50.820087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Write session: try to update token
2025-10-02T09:29:50.820102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:50.827626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:50.827651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:50.827654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:50.827656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:50.827664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.827669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.827672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554251737508612:5036]
2025-10-02T09:29:50.827716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:50.827715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:50.827719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:50.827722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:50.827727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.827729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:50.827867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:50.832445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:50.835235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:50.892596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554251813030878:5499]
2025-10-02T09:29:50.892899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7556554251813030878:5499]
2025-10-02T09:29:50.973091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:50.973412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.973428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.973467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030878:5499], now have 1 active actors on pipe
2025-10-02T09:29:50.973695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:50.973690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:50.973729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554251813030878:5499]
2025-10-02T09:29:50.973753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:50.973756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:50.973819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: error at write: Disconnected sessionId: src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0
2025-10-02T09:29:50.973992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0 is DEAD
2025-10-02T09:29:50.974141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:50.974151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Write session will restart in 0.007547s
2025-10-02T09:29:50.974174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Write session: Do CDS request
2025-10-02T09:29:50.974180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:50.983283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.983373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:50.983400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-10-02T09:29:50.983526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:50.983555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:50.983560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:50.983564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:50.983926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-10-02T09:29:50.983956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:50.983962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:50.983964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:50.983969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554251813030990:5780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:50.984225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:50.984676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554251813030990:5780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:50.986424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554251813030990:5780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:50.986510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:50.986686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:50.986697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:50.986706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:50.986752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:50.986788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554251737508783:5051]
2025-10-02T09:29:50.987391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:50.987710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:50.987773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:50.988091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:50.988167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.988175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.988176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.988176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.988178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.988179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.988179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.988180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.988182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.988182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.988183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.988184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.988190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.988199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.988205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.988209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.988212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.988215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.988218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.988221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.988224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.988228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.988231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.988234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.988241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.988247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:50.988252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.988257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:50.988261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.988265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:50.988271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.988275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:50.988280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.988284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:50.988288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.988292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:50.988296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.988301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:50.988305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.988310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:50.988314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.988318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:50.988322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.988326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.988331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.988335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.988338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.988344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.988375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:50.996729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554251813030990:5780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:50.996751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554251813030990:5780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:50.996755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554251813030990:5780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:50.996762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:50.997406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:50.999272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:50.999295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:50.999297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:50.999301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:50.999307Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [2:7556554251737508783:5051]
2025-10-02T09:29:50.999319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:50.999334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:50.999338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.999340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.999342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.999356Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:50.999369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:50.999376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:50.999431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.999438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.999440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.999443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:50.999446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:50.999504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:50.999512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:50.999525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:50.999535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:50.999554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:50.999576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:50.999578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:50.999582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:50.999593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:50.999606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813030904:2446], now have 1 active actors on pipe
2025-10-02T09:29:50.999614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554251813031028:5780], now have 1 active actors on pipe
2025-10-02T09:29:50.999616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:50.999620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:50.999622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:50.999623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:50.999636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:50.999639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:50.999669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:50.999686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:50.999689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 549
2025-10-02T09:29:50.999695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 549
2025-10-02T09:29:50.999702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:50.999855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:50.999867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:50.999889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:50.999901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:50.999905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:50.999907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:50.999916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:50.999931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:50.999947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.000120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.000130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.000143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.000236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0
2025-10-02T09:29:51.000557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5122180-c2d9db39-be8e9b4c-d3aebd4a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:51.003176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Write session: try to update token
2025-10-02T09:29:51.003194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:51.010647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:51.010672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.010675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:51.010677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:51.010687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:51.010691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:51.010695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554251737508777:5051]
2025-10-02T09:29:51.010734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:51.010739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:51.010744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.010745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:51.010746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:51.010748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:51.010891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:51.016064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:51.018680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:51.073845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554256107998332:5499]
2025-10-02T09:29:51.074083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7556554256107998332:5499]
2025-10-02T09:29:51.153297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:51.153726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.153752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.153797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998332:5499], now have 1 active actors on pipe
2025-10-02T09:29:51.154041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:51.154038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:51.154054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:51.154054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:51.154096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554256107998332:5499]
2025-10-02T09:29:51.154109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: error at write: Disconnected sessionId: src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0
2025-10-02T09:29:51.154315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0 is DEAD
2025-10-02T09:29:51.154484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:51.154496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Write session will restart in 0.006951s
2025-10-02T09:29:51.154522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Write session: Do CDS request
2025-10-02T09:29:51.154528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:51.162271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.162338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:51.162353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-10-02T09:29:51.162477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.162508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:51.162517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:51.162520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:51.162912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-10-02T09:29:51.162949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:51.162951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:51.162952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:51.162957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554256107998385:5785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:51.163442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554256107998385:5785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:51.165190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554256107998385:5785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:51.165220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:51.167122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:51.167283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:51.167292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:51.167301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:51.167349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:51.167387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554256032476211:5054]
2025-10-02T09:29:51.167603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554256107998385:5785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:51.167617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554256107998385:5785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:51.167621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554256107998385:5785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:51.167628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:51.167980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:51.168263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:51.168314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:51.168605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:51.168659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.168665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.168665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.168667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.168668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.168668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.168669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.168670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.168671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.168672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.168673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.168673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.168678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.168688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.168691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.168695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.168698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.168701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.168704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.168707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.168710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.168714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.168717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.168720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.168725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.168731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.168736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.168740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.168743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.168747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.168751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.168755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.168758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.168762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.168766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.168770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.168774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.168778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.168781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.168785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.168789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.168792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.168796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.168799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.168822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.168829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.168832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.168835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.168865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:51.177285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:51.178968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:51.178983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:51.178986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:51.178989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:51.178995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [2:7556554256032476211:5054]
2025-10-02T09:29:51.179004Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:51.179015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:51.179017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.179019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.179021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.179031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:51.179039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:51.179056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:51.179099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.179104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.179106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.179108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:51.179109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:51.179154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:51.179160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.179169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.179175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.179184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:51.179198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.179203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.179204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.179210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:51.179218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998336:2446], now have 1 active actors on pipe
2025-10-02T09:29:51.179218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:51.179221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:51.179223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:51.179225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:51.179233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:51.179234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:51.179239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998460:5785], now have 1 active actors on pipe
2025-10-02T09:29:51.179262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.179274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:51.179283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 550
2025-10-02T09:29:51.179293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:51.179336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 550
2025-10-02T09:29:51.179398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.179406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.179421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:51.179426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.179428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.179430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:51.179435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.179442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:51.179453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.179586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.179594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.179606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.179674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0
2025-10-02T09:29:51.179991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b55c16b-a88afd83-ec72034a-b6ac83fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:51.182553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Write session: try to update token
2025-10-02T09:29:51.182568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:51.189733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:51.189757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.189765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.189809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:51.189834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:51.189979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:51.190131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:51.190274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:51.190414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:51.190604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:51.190642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:51.196745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:51.199158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:51.199592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.199617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.199631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:51.199634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.199635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:51.199636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:51.199642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.199644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.199650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554256032476205:5054]
2025-10-02T09:29:51.199682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:51.199685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:51.199686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.199688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:51.199690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:51.199697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:51.199797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:51.254075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554256107998472:5499]
2025-10-02T09:29:51.254431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7556554256107998472:5499]
2025-10-02T09:29:51.342531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:51.342841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:51.342875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998472:5499], now have 1 active actors on pipe
2025-10-02T09:29:51.342983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:51.343019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:51.343073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554256107998472:5499]
2025-10-02T09:29:51.343094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:51.343101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:51.343164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: error at write: Disconnected sessionId: src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0
2025-10-02T09:29:51.343303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0 is DEAD
2025-10-02T09:29:51.343461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:51.343472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Write session will restart in 0.007530s
2025-10-02T09:29:51.343493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Write session: Do CDS request
2025-10-02T09:29:51.343501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:51.352645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.352785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:51.352814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-10-02T09:29:51.352932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.352962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:51.352971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:51.352974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:51.353389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-10-02T09:29:51.353421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:51.353427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:51.353429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:51.353434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554256107998563:5789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:51.353972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554256107998563:5789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:51.354052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:51.355776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554256107998563:5789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:51.356250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:51.356496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:51.356508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:51.356521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:51.356591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:51.356635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554256032476340:5056]
2025-10-02T09:29:51.357232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:51.357532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:51.357580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:51.357882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:51.357960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.357967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.357968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.357969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.357970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.357971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.357972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.357973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.357974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.357975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.357976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.357977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.357982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.357992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.357996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.357999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.358003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.358006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.358010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.358014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.358017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.358022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.358025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.358029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.358035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.358042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.358048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.358053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.358057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.358062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.358068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.358075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.358083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.358089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.358097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.358101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.358105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.358110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.358118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.358122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.358126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.358135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.358140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.358144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.358148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.358155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.358159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.358167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.358201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:51.358203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554256107998563:5789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:51.358218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554256107998563:5789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:51.358221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554256107998563:5789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:51.358228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:51.366752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:51.368364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:51.368382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:51.368385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:51.368387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:51.368392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [2:7556554256032476340:5056]
2025-10-02T09:29:51.368401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:51.368415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:51.368417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.368419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.368421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.368431Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:51.368439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:51.368444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:51.368489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.368494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.368496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.368498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:51.368500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:51.368542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:51.368553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.368562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.368568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.368577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:51.368589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.368595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.368596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.368602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:51.368608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:51.368610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:51.368611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:51.368616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998602:5789], now have 1 active actors on pipe
2025-10-02T09:29:51.368621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:51.368633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:51.368641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:51.368647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998475:2446], now have 1 active actors on pipe
2025-10-02T09:29:51.368677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.368691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:51.368703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 551
2025-10-02T09:29:51.368709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 551
2025-10-02T09:29:51.368715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:51.368823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.368833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.368853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:51.368858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.368867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.368869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:51.368878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.368890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:51.368905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.369069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.369081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.369093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.369185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0
2025-10-02T09:29:51.369501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9ea6fa-e61c89ae-8c4b0594-c0d3be16_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:51.372013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Write session: try to update token
2025-10-02T09:29:51.372026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:51.379423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:51.379440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.379446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.379474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:51.379479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:51.379654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:51.379811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:51.379976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:51.380149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:51.380392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:51.380440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:51.384840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:51.387304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:51.387495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.387517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.387548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:51.387633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:51.390096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:51.390116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.390123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:51.390125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:51.390134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.390137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.390143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554256032476334:5056]
2025-10-02T09:29:51.390180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:51.390192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.390194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:51.390200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:51.390214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:51.390218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:51.390339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:51.442997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554256107998611:5499]
2025-10-02T09:29:51.443246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7556554256107998611:5499]
2025-10-02T09:29:51.528745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:51.535065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.535085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.535215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.535270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.535322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.535382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.535650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.535658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.535714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.535764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.535817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.535869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.535907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.535912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.535968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.536019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.536072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.536125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.536164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.536168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.536223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.536275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.536331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.536382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.536428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.536433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.536485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.536535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.536587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.536640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.536679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.536686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.536739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.536788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.536862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.536918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.536955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.536960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.537010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.537060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.537113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.537167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.537211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.537216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.537268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.537319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.537369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.537422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.537460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.537466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.537518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.537565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.537617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.537668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.537786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.537793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.537847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:51.537903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:51.537963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:51.538023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:51.538065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:51.538070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:51.538106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998611:5499], now have 1 active actors on pipe
2025-10-02T09:29:51.538347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:51.538360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:51.538386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: error at write: Disconnected sessionId: src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0
2025-10-02T09:29:51.538432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:51.538441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554256107998611:5499]
2025-10-02T09:29:51.538469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:51.538553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0 is DEAD
2025-10-02T09:29:51.538679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:51.538689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Write session will restart in 0.009636s
2025-10-02T09:29:51.538709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Write session: Do CDS request
2025-10-02T09:29:51.538716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:51.547191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:51.549090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:51.549246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.549261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:51.549274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:51.549288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:51.549327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:51.549342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-10-02T09:29:51.549361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:51.549403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554256032476481:5059]
2025-10-02T09:29:51.549464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.549500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:51.549508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:51.549513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:51.549845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-10-02T09:29:51.549874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:51.549877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:51.549879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:51.549884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554256107998720:5796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:51.549946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:51.550216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:51.550254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:51.550293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554256107998720:5796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:51.550528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:51.550570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.550575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.550576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.550577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.550578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.550579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.550580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.550582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.550583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.550583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.550584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.550586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.550590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.550599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.550603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.550606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.550609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.550613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.550616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.550620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.550623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.550627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.550631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.550639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.550644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.550655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.550664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.550673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.550681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.550686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.550691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.550700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.550708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.550716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.550724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.550729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.550737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.550745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.550753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.550762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.550769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.550774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.550781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.550790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.550797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.550806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.550814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.550818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.550854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:51.552116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554256107998720:5796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:51.557062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554256107998720:5796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:51.557074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554256107998720:5796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:51.557079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554256107998720:5796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:51.557084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:51.559541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:51.561166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:51.561185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:51.561188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:51.561191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:51.561196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [2:7556554256032476481:5059]
2025-10-02T09:29:51.561208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:51.561222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:51.561224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.561227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.561229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.561241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:51.561252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:51.561258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:51.561304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.561311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.561313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.561316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:51.561318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:51.561373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:51.561381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.561391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.561405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.561423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:51.561440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998629:2446], now have 1 active actors on pipe
2025-10-02T09:29:51.561447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998758:5796], now have 1 active actors on pipe
2025-10-02T09:29:51.561452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.561454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.561456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.561467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:51.561471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 552
2025-10-02T09:29:51.561482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:51.561474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 552
2025-10-02T09:29:51.561483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:51.561491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:51.561493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:51.561494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:51.561497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:51.561521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.561529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:51.561531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:51.561553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.561560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.561587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:51.561597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.561600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.561602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:51.561610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.561617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:51.561631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.561883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.561892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.561905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.561974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 36 sessionId: src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0
2025-10-02T09:29:51.562286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e080cda-eeaa9cf2-be6f7eb6-7bf73659_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:51.564694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Write session: try to update token
2025-10-02T09:29:51.564707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:51.571881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:51.571899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.571901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:51.571903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:51.571909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.571914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.571917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554256032476476:5059]
2025-10-02T09:29:51.571963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:51.571965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:51.571970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:51.571971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.571973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:51.571975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:51.572451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:51.576705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:51.578986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:51.638590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554256107998767:5499]
2025-10-02T09:29:51.638857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7556554256107998767:5499]
2025-10-02T09:29:51.703687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:51.703922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.703934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.703964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998767:5499], now have 1 active actors on pipe
2025-10-02T09:29:51.704127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:51.704190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:51.704199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554256107998767:5499]
2025-10-02T09:29:51.704204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:51.704220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:51.704262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: error at write: Disconnected sessionId: src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0
2025-10-02T09:29:51.704446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0 is DEAD
2025-10-02T09:29:51.704606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:51.704617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Write session will restart in 0.006473s
2025-10-02T09:29:51.704639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Write session: Do CDS request
2025-10-02T09:29:51.704645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:51.712184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.712294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:51.712312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-10-02T09:29:51.712423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.712453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:51.712463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:51.712471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:51.712886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-10-02T09:29:51.712929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:51.712932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:51.712934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:51.712938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554256107998824:5800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:51.713388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554256107998824:5800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:51.715089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:51.715175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554256107998824:5800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:51.716778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:51.716897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:51.716904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:51.716911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:51.716944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:51.716968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554256032476613:5061]
2025-10-02T09:29:51.717348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:51.717494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554256107998824:5800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:51.717507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554256107998824:5800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:51.717510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554256107998824:5800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:51.717516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:51.717545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:51.717569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:51.717756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:51.717790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.717794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.717794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.717795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.717795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.717797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.717797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.717798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.717798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.717799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.717800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.717800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.717803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.717809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.717811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.717813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.717815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.717817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.717819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.717821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.717823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.717825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.717827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.717829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.717834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.717838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.717842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.717846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.717850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.717854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.717862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.717872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.717878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.717881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.717883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.717885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.717887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.717890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.717892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.717895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.717897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.717900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.717905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.717908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.717910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.717913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.717918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.717921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.717938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:51.726214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:51.727941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:51.727962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:51.727964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:51.727968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:51.727973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [2:7556554256032476613:5061]
2025-10-02T09:29:51.727985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:51.727999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:51.728006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.728009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.728010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.728025Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:51.728034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:51.728040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:51.728096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.728104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.728106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.728110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:51.728112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:51.728171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:51.728180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.728193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.728203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.728218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:51.728236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998769:2446], now have 1 active actors on pipe
2025-10-02T09:29:51.728244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998898:5800], now have 1 active actors on pipe
2025-10-02T09:29:51.728250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.728256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.728258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.728269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:51.728282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:51.728286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:51.728290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:51.728293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:51.728299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:51.728301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:51.728329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.728342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:51.728350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:51.728348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 553
2025-10-02T09:29:51.728392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 553
2025-10-02T09:29:51.728460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.728470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.728490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e962d7fe-55bb50b4-344067cd-8a813639_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:51.728500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.728503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.728505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:51.728513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.728526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:51.728542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.728716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.728727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.728744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.728862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 36 sessionId: src_id|e962d7fe-55bb50b4-344067cd-8a813639_0
2025-10-02T09:29:51.729227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e8c6df-301dc1f9-7a482edf-a82e40f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e962d7fe-55bb50b4-344067cd-8a813639_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:51.731650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Write session: try to update token
2025-10-02T09:29:51.731665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:51.738512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:51.738532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.738535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:51.738536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:51.738544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.738549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.738553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554256032476607:5061]
2025-10-02T09:29:51.738581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:51.738585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.738588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:51.738591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:51.738596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:51.738599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:51.738703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:51.744143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|e962d7fe-55bb50b4-344067cd-8a813639_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:51.746386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:51.804473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554256107998914:5499]
2025-10-02T09:29:51.804797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7556554256107998914:5499]
2025-10-02T09:29:51.871884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:51.872157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.872166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.872179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998914:5499], now have 1 active actors on pipe
2025-10-02T09:29:51.872324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:51.872428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:51.872452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:51.872490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554256107998914:5499]
2025-10-02T09:29:51.872519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e962d7fe-55bb50b4-344067cd-8a813639_0
2025-10-02T09:29:51.872696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|e962d7fe-55bb50b4-344067cd-8a813639_0 is DEAD
2025-10-02T09:29:51.872862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:51.872873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Write session will restart in 0.007766s
2025-10-02T09:29:51.872897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Write session: Do CDS request
2025-10-02T09:29:51.872904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:51.881000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:51.881212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.881307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:51.881319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-10-02T09:29:51.881428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:51.881450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:51.881456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:51.881459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:51.881814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-10-02T09:29:51.881846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:51.881852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:51.881854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:51.881858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554256107999013:5805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:51.882362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554256107999013:5805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:51.882762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:51.882944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:51.882954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:51.882963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:51.883014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:51.883061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554256032476746:5064]
2025-10-02T09:29:51.883598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:51.883822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:51.883861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:51.883873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554256107999013:5805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:51.884141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:51.884199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.884205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.884206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.884207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.884208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.884209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.884210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.884210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.884211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.884212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.884213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.884214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.884218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.884227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.884230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.884233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.884237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.884240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.884243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.884246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.884249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.884254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.884257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.884265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.884270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.884276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:51.884286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.884290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:51.884298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.884303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:51.884311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.884320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:51.884328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.884336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:51.884344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.884354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:51.884376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.884381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:51.884384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.884388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:51.884392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.884395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:51.884398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.884402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.884408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.884412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.884416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.884420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.884448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:51.888884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554256107999013:5805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:51.888895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554256107999013:5805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:51.888898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554256107999013:5805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:51.888903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:51.892742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:51.894426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:51.894446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:51.894448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:51.894451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:51.894456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [2:7556554256032476746:5064]
2025-10-02T09:29:51.894468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:51.894483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:51.894491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.894494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.894497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.894510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:51.894519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:51.894529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:51.894584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.894591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.894593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.894596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:51.894599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:51.894655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:51.894663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.894675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:51.894688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:51.894707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:51.894729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107999052:5805], now have 1 active actors on pipe
2025-10-02T09:29:51.894736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107998919:2446], now have 1 active actors on pipe
2025-10-02T09:29:51.894743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.894749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.894752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.894764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:51.894765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 554
2025-10-02T09:29:51.894775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:51.894773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 554
2025-10-02T09:29:51.894778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:51.894779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:51.894784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:51.894799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:51.894801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:51.894837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.894847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.894862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.894874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:51.894882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:51.894900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:51.894910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:51.894914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:51.894918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:51.894928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:51.894940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:51.895055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.895213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:51.895227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:51.895245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:51.895320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 36 sessionId: src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0
2025-10-02T09:29:51.895578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e962d7fe-55bb50b4-344067cd-8a813639_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:51.898395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Write session: try to update token
2025-10-02T09:29:51.898411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:51.904725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:51.904741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:51.904742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:51.904744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:51.904750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.904753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.904755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554256032476741:5064]
2025-10-02T09:29:51.904779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:51.904783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:51.904785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:51.904785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:51.904789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:51.904792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:51.904920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:51.912068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:51.914394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:51.972426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554256107999081:5499]
2025-10-02T09:29:51.972670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7556554256107999081:5499]
2025-10-02T09:29:52.031727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:52.032161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.032175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.032189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554256107999081:5499], now have 1 active actors on pipe
2025-10-02T09:29:52.032368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:52.032438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554256107999081:5499]
2025-10-02T09:29:52.032449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:52.032470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:52.032533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0
2025-10-02T09:29:52.032703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0 is DEAD
2025-10-02T09:29:52.032837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:52.032846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Write session will restart in 0.006753s
2025-10-02T09:29:52.032865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Write session: Do CDS request
2025-10-02T09:29:52.032871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:52.040301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.040406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:52.040419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-10-02T09:29:52.040556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.040590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:52.040599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:52.040603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:52.041197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-10-02T09:29:52.041231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:52.041236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:52.041238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:52.041242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554260402966440:5816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:52.041650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554260402966440:5816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:52.043107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554260402966440:5816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:52.043113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:52.044887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:52.045157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:52.045174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:52.045185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:52.045244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:52.045278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554260327444212:5078]
2025-10-02T09:29:52.045683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554260402966440:5816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:52.045696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554260402966440:5816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:52.045700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554260402966440:5816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:52.045706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:52.045839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:52.046099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:52.046147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:52.046437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:52.046501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.046508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.046509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.046510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.046511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.046512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.046513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.046514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.046515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.046516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.046517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.046518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.046523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.046534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.046537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.046541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.046544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.046547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.046551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.046555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.046558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.046567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.046575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.046578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.046589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.046600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.046609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.046618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.046627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.046636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.046644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.046651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.046658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.046663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.046671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.046679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.046687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.046696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.046705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.046713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.046722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.046731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.046739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.046747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.046759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.046768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.046776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.046785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.046823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:52.055104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:52.056870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:52.056884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:52.056885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:52.056889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:52.056895Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [2:7556554260327444212:5078]
2025-10-02T09:29:52.056908Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:52.056929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:52.056936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.056939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.056941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.056955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:52.056964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:52.056974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:52.057023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.057032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.057034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.057038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:52.057040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:52.057099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:52.057106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.057118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.057133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.057152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:52.057174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966515:5816], now have 1 active actors on pipe
2025-10-02T09:29:52.057183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966379:2446], now have 1 active actors on pipe
2025-10-02T09:29:52.057193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.057199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.057201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.057215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:52.057230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:52.057245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:52.057247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:52.057249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:52.057256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:52.057259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:52.057252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 555
2025-10-02T09:29:52.057280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.057289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:52.057295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:52.057412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 555
2025-10-02T09:29:52.057489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.057499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.057520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9572475-ca5d77e4-15220000-c48e4c92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:52.057531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.057534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.057535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:52.057543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.057552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:52.057565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.057667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.057676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.057687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.057796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9572475-ca5d77e4-15220000-c48e4c92_0
2025-10-02T09:29:52.058178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a2935a-8cda6734-3870e9aa-5a828a7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9572475-ca5d77e4-15220000-c48e4c92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:52.060772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Write session: try to update token
2025-10-02T09:29:52.060793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:52.067410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:52.067434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.067442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.067478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:52.067484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:52.067632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:52.067775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.067901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.068026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.068219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:52.068260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:52.073494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|c9572475-ca5d77e4-15220000-c48e4c92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:52.075668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:52.076296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.076317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.076332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:52.076334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.076336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:52.076338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:52.076347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.076350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.076353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554260327444206:5078]
2025-10-02T09:29:52.076385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:52.076389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:52.076394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.076395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:52.076396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:52.076397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:52.076507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:52.132668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554260402966526:5499]
2025-10-02T09:29:52.132953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7556554260402966526:5499]
2025-10-02T09:29:52.214779Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:52.215123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:52.215166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966526:5499], now have 1 active actors on pipe
2025-10-02T09:29:52.215659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:52.215753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:52.215756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:52.215822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: error at write: Disconnected sessionId: src_id|c9572475-ca5d77e4-15220000-c48e4c92_0
2025-10-02T09:29:52.215959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|c9572475-ca5d77e4-15220000-c48e4c92_0 is DEAD
2025-10-02T09:29:52.215995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554260402966526:5499]
2025-10-02T09:29:52.216011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:52.216348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:52.216360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Write session will restart in 0.006438s
2025-10-02T09:29:52.216381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Write session: Do CDS request
2025-10-02T09:29:52.216390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:52.225998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.226105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:52.226123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-10-02T09:29:52.226250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.226284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:52.226293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:52.226297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:52.226724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-10-02T09:29:52.226761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:52.226769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:52.226772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:52.226777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554260402966611:5821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:52.227305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554260402966611:5821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:52.228483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:52.229261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554260402966611:5821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:52.230551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:52.230738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:52.230746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:52.230755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:52.230796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:52.230832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554260327444348:5081]
2025-10-02T09:29:52.231389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:52.231721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554260402966611:5821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:52.231734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554260402966611:5821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:52.231737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554260402966611:5821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:52.231744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:52.231990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:52.232046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:52.232354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:52.232423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.232429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.232430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.232431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.232432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.232433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.232434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.232435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.232436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.232437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.232438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.232439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.232443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.232453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.232457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.232460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.232463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.232467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.232470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.232474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.232477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.232481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.232483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.232486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.232492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.232499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.232504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.232509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.232513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.232517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.232521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.232525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.232530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.232534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.232537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.232542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.232551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.232555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.232559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.232563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.232571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.232575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.232579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.232587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.232593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.232602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.232607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.232614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.232643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:52.241345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:52.243165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:52.243185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:52.243188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:52.243191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:52.243198Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [2:7556554260327444348:5081]
2025-10-02T09:29:52.243215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:52.243231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:52.243233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.243236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.243239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.243254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:52.243259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:52.243267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:52.243320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.243329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.243331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.243334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:52.243336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:52.243398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:52.243405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.243419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.243431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.243446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:52.243469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966531:2446], now have 1 active actors on pipe
2025-10-02T09:29:52.243477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966663:5821], now have 1 active actors on pipe
2025-10-02T09:29:52.243482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.243489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.243492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.243506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:52.243525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:52.243542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:52.243548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:52.243543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 556
2025-10-02T09:29:52.243561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 556
2025-10-02T09:29:52.243557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:52.243568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:52.243570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:52.243582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.243585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:52.243606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:52.243634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.243638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.243659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:52.243664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.243668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.243669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:52.243679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.243686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:52.243698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.243940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.243957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.243979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.244048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 36 sessionId: src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0
2025-10-02T09:29:52.244378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9572475-ca5d77e4-15220000-c48e4c92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:52.247031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Write session: try to update token
2025-10-02T09:29:52.247058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:52.254644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:52.254669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.254676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.254721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:52.254725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:52.254894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:52.255038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.255196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.255339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.255540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:52.255582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:52.260791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:52.263082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:52.263205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.263227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.263276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:52.263361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:52.264245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:52.264257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.264259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:52.264260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:52.264266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.264273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.264275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554260327444343:5081]
2025-10-02T09:29:52.264306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:52.264312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.264314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:52.264321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:52.264328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:52.264332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:52.264435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:52.315963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554260402966672:5499]
2025-10-02T09:29:52.317164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7556554260402966672:5499]
2025-10-02T09:29:52.407546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:52.415195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.415228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.415396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.415449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.415509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.415562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.415599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.415603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.415666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.415715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.415774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.415840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.415883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.415886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.415963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.416016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.416080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.416139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.416248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.416251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.416320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.416371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.416419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.416470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.416505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.416506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.416563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.416610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.416660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.416716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.416760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.416763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.418811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554260402966672:5499]
2025-10-02T09:29:52.418844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:52.418884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:52.418891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:52.418916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: error at write: Disconnected sessionId: src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0
2025-10-02T09:29:52.419100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0 is DEAD
2025-10-02T09:29:52.419249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:52.419260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Write session will restart in 0.007488s
2025-10-02T09:29:52.419283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Write session: Do CDS request
2025-10-02T09:29:52.419289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:52.416979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.417043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.417104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.417166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.417215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.417218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.417279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.417331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.417390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.417450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.417493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.417496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.417566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.417626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.417685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.417745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.417794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.417797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.417857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.417913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.417968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.418026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.418162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.418165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.418228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.418283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.418342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.418394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.418428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.418430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.418496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966672:5499], now have 1 active actors on pipe
2025-10-02T09:29:52.419512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:52.428355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.428464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:52.428479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-10-02T09:29:52.428633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.428664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:52.428672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:52.428675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:52.429132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-10-02T09:29:52.429167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:52.429173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:52.429175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:52.429180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554260402966737:5825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:52.429710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554260402966737:5825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:52.431977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554260402966737:5825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:52.432179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:52.434324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:52.434494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:52.434503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:52.434512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:52.434553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:52.434589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554260327444484:5083]
2025-10-02T09:29:52.434671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554260402966737:5825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:52.434686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554260402966737:5825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:52.434689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554260402966737:5825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:52.434696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:52.435119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:52.435404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:52.435456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:52.435754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:52.435819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.435825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.435826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.435827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.435828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.435829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.435830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.435831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.435833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.435834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.435835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.435836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.435841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.435852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.435855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.435859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.435863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.435866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.435870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.435873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.435877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.435880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.435884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.435887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.435893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.435900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.435907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.435913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.435921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.435925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.435929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.435934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.435941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.435946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.435950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.435954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.435960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.435964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.435966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.435970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.435972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.435974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.435978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.435980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.435983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.435986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.435988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.435991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.436007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:52.445472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:52.447110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:52.447127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:52.447129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:52.447133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:52.447140Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [2:7556554260327444484:5083]
2025-10-02T09:29:52.447157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:52.447176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:52.447183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.447185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.447187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.447202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:52.447211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:52.447217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:52.447272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.447279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.447281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.447283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:52.447285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:52.447344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:52.447351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.447363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.447375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.447388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:52.447407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.447414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.447416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.447423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:52.447433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:52.447439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966805:5825], now have 1 active actors on pipe
2025-10-02T09:29:52.447444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:52.447445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966675:2446], now have 1 active actors on pipe
2025-10-02T09:29:52.447447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:52.447449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:52.447461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:52.447463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:52.447495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.447506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:52.447520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:52.447513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 557
2025-10-02T09:29:52.447550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.447518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 557
2025-10-02T09:29:52.447558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.447581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:52.447590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.447593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.447596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:52.447605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.447616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:52.447632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.447799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.447806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.447818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.447902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0
2025-10-02T09:29:52.448226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49cc4b4-66780ca5-f7e67d12-6cfc1ff5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:52.450647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Write session: try to update token
2025-10-02T09:29:52.450660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:52.457977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:52.458002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.458011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.458056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:52.458061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:52.458263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:52.458446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.458624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.458811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.459090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:52.459142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:52.466945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:52.467804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:52.467827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.467829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:52.467830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:52.467836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.467840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.467843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554260327444479:5083]
2025-10-02T09:29:52.467871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:52.467876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.467881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:52.467883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:52.467888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:52.467890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:52.468010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:52.469327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:52.519304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554260402966830:5499]
2025-10-02T09:29:52.519651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7556554260402966830:5499]
2025-10-02T09:29:52.610749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:52.611018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.611033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.611061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966830:5499], now have 1 active actors on pipe
2025-10-02T09:29:52.611227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:52.611329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:52.611335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:52.611338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:52.611390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554260402966830:5499]
2025-10-02T09:29:52.611396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: error at write: Disconnected sessionId: src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0
2025-10-02T09:29:52.611563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0 is DEAD
2025-10-02T09:29:52.611728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:52.611740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Write session will restart in 0.006413s
2025-10-02T09:29:52.611764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Write session: Do CDS request
2025-10-02T09:29:52.611769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:52.619275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.619393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:52.619407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-10-02T09:29:52.619819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.619860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:52.619868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:52.619872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:52.620394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-10-02T09:29:52.620434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:52.620440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:52.620442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:52.620446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554260402966884:5830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:52.620989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554260402966884:5830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:52.622834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554260402966884:5830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:52.623164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:52.625375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:52.625543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:52.625552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:52.625561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:52.625606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:52.625642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554260327444632:5086]
2025-10-02T09:29:52.625693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554260402966884:5830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:52.625706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554260402966884:5830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:52.625709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554260402966884:5830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:52.625716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:52.626205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:52.626502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:52.626538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:52.626825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:52.626879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.626883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.626884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.626885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.626886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.626887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.626888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.626889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.626890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.626891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.626892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.626893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.626897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.626908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.626911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.626915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.626919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.626922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.626926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.626930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.626933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.626938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.626942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.626945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.626950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.626956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.626961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.626967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.626971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.626976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.626981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.626985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.626990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.626995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.626998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.627003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.627007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.627013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.627021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.627026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.627031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.627036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.627051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.627055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.627060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.627065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.627074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.627079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.627112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:52.635618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:52.637115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:52.637131Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:52.637134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:52.637137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:52.637142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [2:7556554260327444632:5086]
2025-10-02T09:29:52.637152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:52.637165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:52.637167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.637169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.637171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.637182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:52.637185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:52.637190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:52.637232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.637238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.637240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.637242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:52.637244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:52.637293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:52.637299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.637307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.637313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.637322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:52.637334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.637338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.637340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.637345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:52.637355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:52.637361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:52.637365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:52.637367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:52.637367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:52.637370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:52.637377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966964:5830], now have 1 active actors on pipe
2025-10-02T09:29:52.637379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966832:2446], now have 1 active actors on pipe
2025-10-02T09:29:52.637403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.637413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:52.637436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:52.637436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 558
2025-10-02T09:29:52.637447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 558
2025-10-02T09:29:52.637523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.637536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.637561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:52.637573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.637578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.637581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:52.637590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.637604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:52.637620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.637791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.637805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.637825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.637938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0
2025-10-02T09:29:52.638259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6afa8f9-f4cf8f22-46301768-aa4c386b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:52.640779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Write session: try to update token
2025-10-02T09:29:52.640792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:52.647654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:52.647675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.647683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.647723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:52.647739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:52.647882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:52.648027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.648166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.648322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:52.648532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:52.648579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:52.654250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:52.656707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:52.656963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.656986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.657034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:52.657147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:52.658079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:52.658097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.658099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:52.658101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:52.658109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.658113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.658117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554260327444626:5086]
2025-10-02T09:29:52.658148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:52.658153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.658156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:52.658159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:52.658165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:52.658169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:52.658278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:52.711759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554260402966976:5499]
2025-10-02T09:29:52.712113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7556554260402966976:5499]
2025-10-02T09:29:52.799576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:52.807209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.807237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.807402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.807462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.807534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.807598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.807644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.807657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.807723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.807785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.807855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.807920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.807963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.807971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.808040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.808098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.808165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.808229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.808265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.808267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.808322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.808381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.808443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.808505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.808557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.808565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.808633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.808698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.808758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.808838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.808884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.808892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.808954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.809011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.809068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.809124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.809165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.809170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.809231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.809295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.809362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.809425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.809472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.809479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.809549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.809621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.809682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.809747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.809801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.809808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.809885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.809944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.809999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.810067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.810112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.810121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.810182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:52.810243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:52.810301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:52.810363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:52.810407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:52.810413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:52.810473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966976:5499], now have 1 active actors on pipe
2025-10-02T09:29:52.811244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:52.811253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Write session will restart in 0.005150s
2025-10-02T09:29:52.811275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Write session: Do CDS request
2025-10-02T09:29:52.811281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:52.810882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:52.810895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:52.810920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: error at write: Disconnected sessionId: src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0
2025-10-02T09:29:52.811110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0 is DEAD
2025-10-02T09:29:52.811277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:52.811309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554260402966976:5499]
2025-10-02T09:29:52.811512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:52.817239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.817614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:52.817640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-10-02T09:29:52.817881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:52.817941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:52.817949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:52.817955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:52.818465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-10-02T09:29:52.818500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:52.818502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:52.818504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:52.818511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554260402966998:5835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:52.819154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554260402966998:5835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:52.821628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554260402966998:5835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:52.825119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554260402966998:5835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:52.825141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554260402966998:5835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:52.825145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554260402966998:5835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:52.825154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:52.827266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:52.829807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:52.830033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:52.830044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:52.830055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:52.830105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:52.830153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554260327444770:5088]
2025-10-02T09:29:52.830794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:52.831366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:52.831418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:52.831753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:52.831808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.831814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.831815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.831817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.831818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.831819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.831821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.831822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.831823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.831824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.831825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.831827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.831832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.831843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.831847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.831851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.831854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.831858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.831862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.831865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.831869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.831873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.831877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.831880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.831887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.831895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:52.831900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.831908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:52.831912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.831917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:52.831921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.831925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:52.831929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.831934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:52.831938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.831943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:52.831948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.831952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:52.831956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.831961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:52.831966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.831971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:52.831975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.831980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.831984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.831989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.831994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.831999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.832031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:52.843827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:52.845573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:52.845596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:52.845599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:52.845604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:52.845611Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [2:7556554260327444770:5088]
2025-10-02T09:29:52.845626Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:52.845643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:52.845646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.845650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.845652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.845667Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:52.845671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:52.845678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:52.845734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.845743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.845745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.845748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:52.845750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:52.845811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:52.845819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.845833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:52.845842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:52.845855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:52.845871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.845877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.845879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.845888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:52.845905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:52.845905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:52.845909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:52.845911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:52.845921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:52.845924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:52.845933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402967116:5835], now have 1 active actors on pipe
2025-10-02T09:29:52.845937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402966983:2446], now have 1 active actors on pipe
2025-10-02T09:29:52.845967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.845981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:52.846012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:52.846025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 559
2025-10-02T09:29:52.846031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 559
2025-10-02T09:29:52.846110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.846120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.846145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:52.846157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:52.846160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:52.846162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:52.846170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:52.846184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:52.846196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.846400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:52.846412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:52.846424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:52.846510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 36 sessionId: src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0
2025-10-02T09:29:52.847048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5a8a06-5304fed7-2c2c1bff-631a9f22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:52.849712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Write session: try to update token
2025-10-02T09:29:52.849732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:52.857947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:52.857970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:52.857972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:52.857974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:52.857981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.857985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.857988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554260327444765:5088]
2025-10-02T09:29:52.858030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:52.858041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:52.858047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:52.858047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:52.858050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:52.858051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:52.858216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:52.866565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:52.869083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:52.908340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554260402967131:5499]
2025-10-02T09:29:52.908711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7556554260402967131:5499]
2025-10-02T09:29:53.009609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:53.010021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.010030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.010046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554260402967131:5499], now have 1 active actors on pipe
2025-10-02T09:29:53.010703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:53.010716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:53.010772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: error at write: Disconnected sessionId: src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0
2025-10-02T09:29:53.010915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0 is DEAD
2025-10-02T09:29:53.011056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554260402967131:5499]
2025-10-02T09:29:53.011066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:53.011342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:53.011348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Write session will restart in 0.006846s
2025-10-02T09:29:53.011365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Write session: Do CDS request
2025-10-02T09:29:53.011372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:53.011131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:53.019244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.019413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.019435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-10-02T09:29:53.019589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.019613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:53.019616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:53.019619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.019995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-10-02T09:29:53.020017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.020018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.020019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.020022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554264697934477:5846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.020409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554264697934477:5846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.026318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554264697934477:5846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.027830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:53.030378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:53.030552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:53.030564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:53.030573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:53.030624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:53.030663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554264622412242:5103]
2025-10-02T09:29:53.030911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554264697934477:5846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.030935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554264697934477:5846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.030940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554264697934477:5846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.030951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.031237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:53.031594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:53.031642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:53.031944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:53.032011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.032017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.032018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.032019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.032020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.032021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.032021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.032023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.032024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.032025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.032026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.032027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.032031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.032041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.032045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.032049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.032051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.032055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.032058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.032061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.032065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.032069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.032072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.032075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.032082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.032088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.032093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.032098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.032102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.032107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.032111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.032115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.032120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.032124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.032127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.032131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.032136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.032140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.032144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.032148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.032152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.032156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.032160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.032164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.032169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.032173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.032176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.032180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.032211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:53.046398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:53.048024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:53.048044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:53.048048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:53.048052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:53.048061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [2:7556554264622412242:5103]
2025-10-02T09:29:53.048077Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:53.048099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:53.048103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.048106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.048108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.048123Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:53.048131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:53.048138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:53.048194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.048203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.048206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.048208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:53.048211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:53.048273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:53.048275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.048288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.048300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.048316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:53.048332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.048334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.048336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.048350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:53.048362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:53.048377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:53.048380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:53.048413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.048416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:53.048820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:53.048823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:53.048824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:53.048830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:53.049276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 560
2025-10-02T09:29:53.049276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 560
2025-10-02T09:29:53.049571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934584:5846], now have 1 active actors on pipe
2025-10-02T09:29:53.049583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934454:2446], now have 1 active actors on pipe
2025-10-02T09:29:53.049596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.049600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.049625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:53.049633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.049637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.049639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:53.049648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.049658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:53.049672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.049927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.049933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.049945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.050449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db3cf0-20bcbda8-d5475368-54bd4de7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:53.050069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 36 sessionId: src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0
2025-10-02T09:29:53.052974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Write session: try to update token
2025-10-02T09:29:53.052992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:53.065965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:53.065989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.065992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:53.065994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:53.066004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.066009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.066015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554264622412237:5103]
2025-10-02T09:29:53.066055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:53.066062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.066066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:53.066292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:53.067825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:53.067841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:53.067845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:53.072115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:53.074741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:53.110627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554264697934596:5499]
2025-10-02T09:29:53.110976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7556554264697934596:5499]
2025-10-02T09:29:53.206003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:53.206478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.206492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.206526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934596:5499], now have 1 active actors on pipe
2025-10-02T09:29:53.206690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:53.206801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:53.206807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:53.206821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:53.206870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554264697934596:5499]
2025-10-02T09:29:53.206914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: error at write: Disconnected sessionId: src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0
2025-10-02T09:29:53.207133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0 is DEAD
2025-10-02T09:29:53.207268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:53.207289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Write session will restart in 0.006129s
2025-10-02T09:29:53.207320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Write session: Do CDS request
2025-10-02T09:29:53.207327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:53.214313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.214352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.214370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-10-02T09:29:53.214571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.214605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:53.214616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:53.214620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.215156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-10-02T09:29:53.215194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.215201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.215204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.215210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554264697934631:5851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.215783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554264697934631:5851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.218000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554264697934631:5851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.218087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:53.220375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:53.220565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:53.220578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:53.220590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:53.220641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:53.220691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554264622412383:5106]
2025-10-02T09:29:53.220791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554264697934631:5851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.220821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554264697934631:5851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.220825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554264697934631:5851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.220834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.221282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:53.221550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:53.221594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:53.221831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:53.221875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.221881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.221882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.221883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.221884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.221884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.221885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.221886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.221887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.221888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.221889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.221890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.221893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.221900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.221903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.221905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.221907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.221910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.221912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.221915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.221917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.221920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.221922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.221924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.221929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.221934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.221939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.221942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.221955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.221960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.221964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.221970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.221976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.221981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.221984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.221987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.221991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.221994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.221997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.222000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.222002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.222005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.222007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.222010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.222013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.222015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.222018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.222021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.222039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:53.231060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:53.232995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:53.233013Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:53.233016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:53.233020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:53.233028Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [2:7556554264622412383:5106]
2025-10-02T09:29:53.233046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:53.233068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:53.233071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.233075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.233085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.233104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:53.233115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:53.233128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:53.233199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.233207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.233210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.233214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:53.233217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:53.233297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:53.233305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.233319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.233333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.233351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:53.233379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934736:5851], now have 1 active actors on pipe
2025-10-02T09:29:53.233386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934601:2446], now have 1 active actors on pipe
2025-10-02T09:29:53.233394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.233396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.233399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.233415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:53.233429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:53.233434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:53.233441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:53.233443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:53.233451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:53.233454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:53.233494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.233509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:53.233516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:53.233514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 561
2025-10-02T09:29:53.233522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 561
2025-10-02T09:29:53.233677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.233695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.233731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:53.233746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.233751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.233754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:53.233766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.233783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:53.233805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.234002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.234015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.234035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.234144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0
2025-10-02T09:29:53.234508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37cb5abc-df0c2b4b-b825e826-d8aa6b7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:53.237675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Write session: try to update token
2025-10-02T09:29:53.237696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:53.243849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:53.243871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.243879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.243919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:53.243918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:53.244082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:53.244256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:53.244400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:53.244550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:53.244753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:53.244798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:53.253137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:53.253159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.253162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:53.253163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:53.253172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.253162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:53.253176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.253180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554264622412377:5106]
2025-10-02T09:29:53.253215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:53.253221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.253224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:53.253321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:53.253338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:53.253341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:53.253355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:53.255716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:53.307209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554264697934747:5499]
2025-10-02T09:29:53.307750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7556554264697934747:5499]
2025-10-02T09:29:53.394055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:53.394465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.394479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.394495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934747:5499], now have 1 active actors on pipe
2025-10-02T09:29:53.394760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:53.394769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554264697934747:5499]
2025-10-02T09:29:53.394801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:53.394802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:53.394821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:53.394919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: error at write: Disconnected sessionId: src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0
2025-10-02T09:29:53.395200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0 is DEAD
2025-10-02T09:29:53.395356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:53.395372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Write session will restart in 0.008548s
2025-10-02T09:29:53.395405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Write session: Do CDS request
2025-10-02T09:29:53.395413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:53.405442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.405515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.405531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-10-02T09:29:53.405735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.405768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:53.405772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:53.405777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.406124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:53.406145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-10-02T09:29:53.406176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.406178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.406179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.406184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554264697934850:5855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.406694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554264697934850:5855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.408385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:53.408578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:53.408588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:53.408596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:53.408652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:53.408694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554264622412524:5108]
2025-10-02T09:29:53.409063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554264697934850:5855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.409341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:53.409646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:53.409701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:53.410091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:53.410161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.410163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.410164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.410166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.410167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.410169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.410170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.410171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.410173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.410174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.410175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.410177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.410183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.410193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.410197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.410201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.410205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.410209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.410213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.410217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.410221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.410226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.410230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.410234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.410240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.410249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.410256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.410261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.410266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.410269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.410272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.410277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.410282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.410287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.410292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.410298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.410302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.410306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.410311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.410320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.410326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.410333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.410337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.410345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.410349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.410354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.410358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.410364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.410402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:53.411265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554264697934850:5855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.411277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554264697934850:5855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.411281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554264697934850:5855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.411288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.420291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:53.421796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:53.421815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:53.421818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:53.421822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:53.421828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [2:7556554264622412524:5108]
2025-10-02T09:29:53.421840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:53.421854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:53.421856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.421858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.421860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.421874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:53.421877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:53.421883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:53.421930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.421937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.421939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.421941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:53.421943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:53.421997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:53.422007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.422020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.422030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.422040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:53.422051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.422053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.422055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.422065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:53.422078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:53.422082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:53.422085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:53.422088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:53.422099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:53.422102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:53.422112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934890:5855], now have 1 active actors on pipe
2025-10-02T09:29:53.422116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934750:2446], now have 1 active actors on pipe
2025-10-02T09:29:53.422147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.422161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:53.422171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:53.422190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 562
2025-10-02T09:29:53.422193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 562
2025-10-02T09:29:53.422339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.422351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.422373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:53.422385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.422388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.422390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:53.422401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.422410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:53.422426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.422583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.422600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.422636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.422774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0
2025-10-02T09:29:53.423106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6b4a7-132c06e9-64f5b1b8-f3fa9d4a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:53.425967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Write session: try to update token
2025-10-02T09:29:53.425984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:53.433875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:53.433898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.433901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:53.433904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:53.433915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.433920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.433924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554264622412518:5108]
2025-10-02T09:29:53.433968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:53.433975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.433977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:53.433978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:53.433985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:53.433990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:53.434138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:53.439082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:53.441271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:53.495103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554264697934897:5499]
2025-10-02T09:29:53.495441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7556554264697934897:5499]
2025-10-02T09:29:53.580343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:53.580766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.580783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.580832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934897:5499], now have 1 active actors on pipe
2025-10-02T09:29:53.581030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:53.581109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554264697934897:5499]
2025-10-02T09:29:53.581161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:53.581170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:53.581269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: error at write: Disconnected sessionId: src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0
2025-10-02T09:29:53.581431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:53.581464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0 is DEAD
2025-10-02T09:29:53.581732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:53.581744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Write session will restart in 0.007978s
2025-10-02T09:29:53.581775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Write session: Do CDS request
2025-10-02T09:29:53.581782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:53.591394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.591436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.591455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-10-02T09:29:53.591679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.591714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:53.591722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:53.591729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.592172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-10-02T09:29:53.592219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.592226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.592227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.592232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554264697935012:5860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.592751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554264697935012:5860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.593112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:53.595091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554264697935012:5860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.595449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:53.595740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:53.595761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:53.595781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:53.595893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:53.595933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554264622412677:5111]
2025-10-02T09:29:53.596412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:53.596724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:53.596771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:53.597084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:53.597139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.597146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.597147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.597148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.597149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.597150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.597152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.597153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.597154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.597156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.597158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.597159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.597165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.597176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.597180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.597184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.597188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.597192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.597196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.597200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.597204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.597208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.597213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.597217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.597224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.597235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.597241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.597252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.597257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.597262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.597272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.597278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.597288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.597294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.597304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.597310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.597315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.597326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.597331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.597342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.597347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.597351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.597362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.597367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.597378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.597384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.597393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.597399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.597443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:53.597699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554264697935012:5860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.597718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554264697935012:5860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.597722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554264697935012:5860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.597733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.606843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:53.608412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:53.608435Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:53.608438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:53.608442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:53.608449Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [2:7556554264622412677:5111]
2025-10-02T09:29:53.608465Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:53.608478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:53.608481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.608483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.608484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.608497Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:53.608501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:53.608509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:53.608551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.608552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.608554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.608556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:53.608558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:53.608618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:53.608627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.608640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.608650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.608669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:53.608693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697934912:2446], now have 1 active actors on pipe
2025-10-02T09:29:53.608702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935053:5860], now have 1 active actors on pipe
2025-10-02T09:29:53.608707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.608709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.608710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.608719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:53.608732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:53.608739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:53.608742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:53.608744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:53.608745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:53.608746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:53.608771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.608783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:53.608778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 563
2025-10-02T09:29:53.608798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:53.608789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 563
2025-10-02T09:29:53.608832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.608836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.608862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:53.608874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.608878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.608880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:53.608888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.608896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:53.608908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.609048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.609057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.609066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.609158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 36 sessionId: src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0
2025-10-02T09:29:53.609512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6fc65c-6a749df3-c5b5ea4-a967fae0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:53.611889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Write session: try to update token
2025-10-02T09:29:53.611903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:53.619564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:53.619579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.619585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.619629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:53.619644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:53.619810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:53.619932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:53.620061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:53.620198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:53.620382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:53.620422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:53.624336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:53.626720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:53.626924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.626943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.626972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:53.627090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:53.630072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:53.630085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.630087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:53.630090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:53.630099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.630102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.630106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554264622412671:5111]
2025-10-02T09:29:53.630145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:53.630150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.630152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:53.630169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:53.630184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:53.630189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:53.630281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:53.681495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554264697935061:5499]
2025-10-02T09:29:53.681901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7556554264697935061:5499]
2025-10-02T09:29:53.774976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:53.782721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.782750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.782920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.782983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.783064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.783127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.783377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.783385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.783450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.783510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.783571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.783648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.783693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.783703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.783772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.783834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.783901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.783964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.784253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.784260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.784317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.784374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.784428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.784488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.784536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.784541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.784600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.784656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.784712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.784780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.784843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.784849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.784919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.784984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.785043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.785099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.785222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.785233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.785297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.785359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.785426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.785491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.785533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.785536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.785606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.785664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.785725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.785781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.785823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.785827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.785889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.785944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.786002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.786062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.786102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.786106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.786171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:53.786227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:53.786286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:53.786348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:53.786476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:53.786479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:53.786527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935061:5499], now have 1 active actors on pipe
2025-10-02T09:29:53.786904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:53.786880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:53.786958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:53.786968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:53.787018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: error at write: Disconnected sessionId: src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0
2025-10-02T09:29:53.787154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554264697935061:5499]
2025-10-02T09:29:53.787230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0 is DEAD
2025-10-02T09:29:53.789017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:53.789028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Write session will restart in 0.005103s
2025-10-02T09:29:53.789049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Write session: Do CDS request
2025-10-02T09:29:53.789055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:53.797219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.801550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.801566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-10-02T09:29:53.801735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.801755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:53.801758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:53.801761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.802220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:53.802114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-10-02T09:29:53.802142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.802144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.802146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.802151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554264697935171:5865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.802622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554264697935171:5865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.804529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:53.804687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:53.804690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:53.804700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:53.804745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:53.804773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554264622412819:5113]
2025-10-02T09:29:53.805301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:53.805351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554264697935171:5865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.805643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:53.805685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:53.805979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:53.806026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.806027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.806028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.806029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.806030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.806031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.806032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.806033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.806034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.806035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.806036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.806037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.806041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.806051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.806055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.806058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.806062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.806065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.806069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.806072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.806076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.806079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.806082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.806085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.806091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.806098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.806103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.806108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.806111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.806116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.806119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.806124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.806128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.806132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.806135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.806140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.806144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.806148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.806153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.806158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.806163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.806168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.806172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.806176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.806180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.806185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.806189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.806194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.806228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:53.811739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554264697935171:5865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.811768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554264697935171:5865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.811772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554264697935171:5865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.811780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.815944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:53.817963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:53.817981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:53.817985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:53.817988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:53.817995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [2:7556554264622412819:5113]
2025-10-02T09:29:53.818013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:53.818031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:53.818034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.818037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.818038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.818056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:53.818062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:53.818068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:53.818137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.818143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.818145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.818149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:53.818151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:53.818224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:53.818233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.818248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.818260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.818280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:53.818302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.818308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.818311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.818324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:53.818340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:53.818349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:53.818355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:53.818358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:53.818359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:53.818361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:53.818396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.818404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:53.818445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:53.818532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935209:5865], now have 1 active actors on pipe
2025-10-02T09:29:53.818545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935068:2446], now have 1 active actors on pipe
2025-10-02T09:29:53.818629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 564
2025-10-02T09:29:53.818629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 564
2025-10-02T09:29:53.818714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.818725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.818753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:53.818760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:53.818764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:53.818766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:53.818776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:53.818786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:53.818802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.818966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.818977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.818990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:53.819279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 36 sessionId: src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0
2025-10-02T09:29:53.819657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb9e4a4-441b0407-837d395e-87c836ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:53.822471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Write session: try to update token
2025-10-02T09:29:53.822487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:53.830399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:53.830420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:53.830422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:53.830424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:53.830433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.830441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.830445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554264622412814:5113]
2025-10-02T09:29:53.830489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:53.830495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.830501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:53.830513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:53.830545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:53.830550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:53.831558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:53.841282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:53.843745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:53.887303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554264697935221:5499]
2025-10-02T09:29:53.887632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7556554264697935221:5499]
2025-10-02T09:29:53.977182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:53.977454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:53.977468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:53.977484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935221:5499], now have 1 active actors on pipe
2025-10-02T09:29:53.977768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:53.977826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:53.977905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554264697935221:5499]
2025-10-02T09:29:53.977917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:53.978022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0
2025-10-02T09:29:53.978284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0 is DEAD
2025-10-02T09:29:53.978390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:53.978401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Write session will restart in 0.005829s
2025-10-02T09:29:53.978425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Write session: Do CDS request
2025-10-02T09:29:53.978430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:53.985251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.985372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:53.985387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-10-02T09:29:53.985515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:53.985541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:53.985549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:53.985553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:53.986024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-10-02T09:29:53.986073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:53.986083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:53.986085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:53.986091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554264697935238:5869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:53.986662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554264697935238:5869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:53.989052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554264697935238:5869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:53.993136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554264697935238:5869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:53.993156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554264697935238:5869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:53.993160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554264697935238:5869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:53.993169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:53.995287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:53.997829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:53.998155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:53.998170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:53.998187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:53.998243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:53.998280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554264622412978:5116]
2025-10-02T09:29:53.998807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:53.999233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:53.999304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:53.999674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:53.999735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.999743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.999744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.999745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.999746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.999747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.999748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.999750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.999751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.999752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.999753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.999755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.999760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.999771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.999774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.999778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.999782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.999786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.999790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.999793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.999796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.999800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.999804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.999807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.999814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.999821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:53.999828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.999833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:53.999836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.999841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:53.999846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.999851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:53.999856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.999861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:53.999865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.999869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:53.999876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.999880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:53.999884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.999889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:53.999893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.999897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:53.999901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.999906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:53.999910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.999914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:53.999917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.999922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:53.999952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:54.008997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:54.011159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:54.011176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:54.011178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:54.011182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:54.011189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [2:7556554264622412978:5116]
2025-10-02T09:29:54.011204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:54.011221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:54.011224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.011228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.011229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.011251Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:54.011255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:54.011270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:54.011335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.011343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.011345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.011348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:54.011351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:54.011423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:54.011431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.011445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.011454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.011470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:54.011498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935225:2446], now have 1 active actors on pipe
2025-10-02T09:29:54.011506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554264697935328:5869], now have 1 active actors on pipe
2025-10-02T09:29:54.011514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.011516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.011518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.011532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:54.011548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:54.011556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:54.011559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:54.011561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:54.011566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:54.011569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:54.011556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 565
2025-10-02T09:29:54.011569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 565
2025-10-02T09:29:54.011605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.011614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:54.011617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:54.011637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.011649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.011703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:54.011716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.011720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.011722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:54.011732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.011743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:54.011771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.011946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.011955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.011971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.012043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 36 sessionId: src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0
2025-10-02T09:29:54.012364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97ecc39-81fa1e7f-4450058d-f737cacb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:54.014919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Write session: try to update token
2025-10-02T09:29:54.014936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:54.022956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:54.022970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.022972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:54.022974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:54.022981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.022985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.022989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554264622412973:5116]
2025-10-02T09:29:54.023023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:54.023029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.023029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:54.023032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:54.023034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:54.023046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:54.023183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:54.030143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:54.032884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:54.078252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554268992902691:5499]
2025-10-02T09:29:54.078539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7556554268992902691:5499]
2025-10-02T09:29:54.167092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:54.167454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.167470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.167488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992902691:5499], now have 1 active actors on pipe
2025-10-02T09:29:54.167673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:54.167725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554268992902691:5499]
2025-10-02T09:29:54.167754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:54.167789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:54.167860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0
2025-10-02T09:29:54.168059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0 is DEAD
2025-10-02T09:29:54.168175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:54.168186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Write session will restart in 0.008137s
2025-10-02T09:29:54.168207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Write session: Do CDS request
2025-10-02T09:29:54.168213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:54.177239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.177394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:54.177414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-10-02T09:29:54.177626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.177664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:54.177671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:54.177679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:54.178287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-10-02T09:29:54.178322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:54.178327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:54.178329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:54.178334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554268992902748:5881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:54.178811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554268992902748:5881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:54.181753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:54.181859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554268992902748:5881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:54.184479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554268992902748:5881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:54.184496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554268992902748:5881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:54.184501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554268992902748:5881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:54.184509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:54.183913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:54.184084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:54.184087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:54.184096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:54.184152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:54.184184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554268917380443:5131]
2025-10-02T09:29:54.184726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:54.185031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:54.185095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:54.185429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:54.185487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.185493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.185494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.185495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.185496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.185497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.185498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.185500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.185501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.185501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.185503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.185504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.185509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.185520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.185524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.185528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.185531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.185535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.185539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.185542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.185546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.185550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.185553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.185557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.185564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.185572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.185577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.185582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.185586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.185591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.185594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.185600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.185605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.185616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.185620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.185629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.185634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.185639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.185647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.185652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.185656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.185664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.185670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.185679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.185683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.185688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.185692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.185697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.185734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:54.194814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:54.196664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:54.196684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:54.196686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:54.196690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:54.196697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [2:7556554268917380443:5131]
2025-10-02T09:29:54.196710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:54.196727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:54.197117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 566
2025-10-02T09:29:54.197128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 566
2025-10-02T09:29:54.196729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.196732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.196734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.196748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:54.196753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:54.196759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:54.196835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.196838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.196841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.196844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:54.196846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:54.196918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:54.196921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.196934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.196946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.196961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:54.196976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.196979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.196983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.196991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:54.197005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:54.197012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:54.197019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:54.197021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:54.197021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:54.197027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:54.197031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992902695:2446], now have 1 active actors on pipe
2025-10-02T09:29:54.197035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992902836:5881], now have 1 active actors on pipe
2025-10-02T09:29:54.197064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.197076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:54.197091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:54.197184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.197191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.197217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:54.197226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.197230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.197232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:54.197241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.197251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:54.197264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.197444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.197457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.197478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.197583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0
2025-10-02T09:29:54.197961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96b81c0-f745bda0-3bf49c14-7839d7c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:54.200475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Write session: try to update token
2025-10-02T09:29:54.200493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:54.213828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:54.215091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:54.215109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.215119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.215165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:54.215171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:54.215340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:54.215495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:54.215641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:54.215782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:54.216221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:54.216264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:54.216906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:54.217727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.217745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.217760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:54.217766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.217768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:54.217770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:54.217775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.217779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.217784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554268917380438:5131]
2025-10-02T09:29:54.217824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:54.217834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.217836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:54.217845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:54.217851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:54.217854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:54.217973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:54.267745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554268992902847:5499]
2025-10-02T09:29:54.268075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7556554268992902847:5499]
2025-10-02T09:29:54.355980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:54.356297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:54.356330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992902847:5499], now have 1 active actors on pipe
2025-10-02T09:29:54.357511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:54.357523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Write session will restart in 0.005421s
2025-10-02T09:29:54.356899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:54.357046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:54.357050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:54.357138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: error at write: Disconnected sessionId: src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0
2025-10-02T09:29:54.357291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0 is DEAD
2025-10-02T09:29:54.357544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Write session: Do CDS request
2025-10-02T09:29:54.357446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:54.357478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554268992902847:5499]
2025-10-02T09:29:54.357567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:54.364631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.365058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:54.365073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-10-02T09:29:54.365204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.365238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:54.365250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:54.365254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:54.365707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-10-02T09:29:54.365743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:54.365744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:54.365746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:54.365751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554268992902878:5885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:54.366270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554268992902878:5885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:54.368422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554268992902878:5885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:54.370683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:54.370692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554268992902878:5885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:54.370708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554268992902878:5885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:54.370711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554268992902878:5885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:54.370718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:54.372908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:54.373078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:54.373087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:54.373097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:54.373143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:54.373292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554268917380589:5133]
2025-10-02T09:29:54.373836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:54.374170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:54.374212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:54.374492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:54.374554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.374560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.374561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.374561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.374563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.374564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.374565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.374566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.374567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.374569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.374569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.374570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.374575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.374586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.374590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.374594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.374598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.374601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.374605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.374609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.374612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.374617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.374620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.374624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.374631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.374637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.374642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.374647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.374651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.374656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.374659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.374663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.374673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.374677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.374681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.374685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.374690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.374694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.374698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.374702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.374707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.374711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.374715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.374719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.374728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.374732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.374736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.374740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.374771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:54.384047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:54.385814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:54.385831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:54.385833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:54.385837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:54.385843Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [2:7556554268917380589:5133]
2025-10-02T09:29:54.385860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:54.385881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:54.385884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.385887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.385889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.385906Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:54.385910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:54.385917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:54.385980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.385993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.385995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.385997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:54.386000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:54.386066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:54.386078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.386092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.386102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.386116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:54.386140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992902990:5885], now have 1 active actors on pipe
2025-10-02T09:29:54.386148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992902850:2446], now have 1 active actors on pipe
2025-10-02T09:29:54.386154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.386156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.386157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.386167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:54.386179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:54.386187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:54.386191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:54.386192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:54.386193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:54.386195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:54.386225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.386237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:54.386254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 567
2025-10-02T09:29:54.386291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 567
2025-10-02T09:29:54.386288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:54.386443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.386451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.386484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:54.386497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.386504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.386510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:54.386520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.386531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:54.386552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.386711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.386721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.386739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.386846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0
2025-10-02T09:29:54.387165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fd3df4-fcc2d981-d07e3ee3-d353a351_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:54.389788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Write session: try to update token
2025-10-02T09:29:54.389804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:54.397430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:54.397449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.397453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:54.397455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:54.397463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.397468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.397472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554268917380583:5133]
2025-10-02T09:29:54.397511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:54.397519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.397521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:54.397660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:54.400864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:54.400883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:54.400887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:54.405143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:54.407695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:54.457664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554268992903002:5499]
2025-10-02T09:29:54.457966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7556554268992903002:5499]
2025-10-02T09:29:54.539932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:54.540330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.540345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.540363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903002:5499], now have 1 active actors on pipe
2025-10-02T09:29:54.540581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:54.540595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:54.540606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554268992903002:5499]
2025-10-02T09:29:54.540632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:54.540649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: error at write: Disconnected sessionId: src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0
2025-10-02T09:29:54.540795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0 is DEAD
2025-10-02T09:29:54.540880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:54.540961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:54.540970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Write session will restart in 0.005386s
2025-10-02T09:29:54.540993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Write session: Do CDS request
2025-10-02T09:29:54.540999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:54.547257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.547337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:54.547353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-10-02T09:29:54.547463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.547492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:54.547499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:54.547503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:54.547868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-10-02T09:29:54.547905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:54.547911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:54.547913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:54.547918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554268992903031:5890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:54.548421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554268992903031:5890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:54.551035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554268992903031:5890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:54.553664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554268992903031:5890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:54.553677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554268992903031:5890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:54.553680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554268992903031:5890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:54.553686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:54.553766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:54.555990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:54.556264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:54.556276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:54.556290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:54.556355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:54.556396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554268917380747:5136]
2025-10-02T09:29:54.557001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:54.557943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:54.558017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:54.558383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:54.558463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.558472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.558474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.558475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.558476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.558477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.558478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.558479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.558480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.558481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.558482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.558483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.558491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.558503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.558507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.558511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.558515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.558519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.558523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.558527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.558531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.558536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.558540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.558543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.558551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.558558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.558570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.558584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.558594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.558599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.558603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.558608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.558613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.558626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.558631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.558636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.558641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.558645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.558649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.558653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.558657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.558661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.558667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.558672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.558700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.558705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.558708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.558713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.558747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:54.567597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:54.569253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:54.569267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:54.569270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:54.569274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:54.569281Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [2:7556554268917380747:5136]
2025-10-02T09:29:54.569295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:54.569311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:54.569314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.569317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.569324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.569337Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:54.569344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:54.569353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:54.569413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.569420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.569423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.569425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:54.569428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:54.569497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:54.569503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.569516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.569526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.569543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:54.569666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 568
2025-10-02T09:29:54.569686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 568
2025-10-02T09:29:54.569564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903017:2446], now have 1 active actors on pipe
2025-10-02T09:29:54.569575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903158:5890], now have 1 active actors on pipe
2025-10-02T09:29:54.569582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.569585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.569587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.569603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:54.569618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:54.569633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:54.569635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:54.569637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:54.569640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:54.569642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:54.569668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.569677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:54.569677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:54.569732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.569736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.569758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:54.569843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.569857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.569859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:54.569868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.569877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:54.569892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.570088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.570099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.570112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.570208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0
2025-10-02T09:29:54.570513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed1489e-bfce11de-54f05351-8b46bfb8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:54.573100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Write session: try to update token
2025-10-02T09:29:54.573117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:54.580675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:54.580692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.580699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.580731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:54.580777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:54.580918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:54.581075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:54.581210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:54.581352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:54.581538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:54.581568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:54.588850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:54.590532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:54.590552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.590554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:54.590556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:54.590565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.590573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.590577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554268917380741:5136]
2025-10-02T09:29:54.590615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:54.590621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.590621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:54.590623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:54.590627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:54.590633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:54.590756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:54.591225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:54.640973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554268992903170:5499]
2025-10-02T09:29:54.641267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7556554268992903170:5499]
2025-10-02T09:29:54.733683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:54.734082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.734095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.734112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903170:5499], now have 1 active actors on pipe
2025-10-02T09:29:54.734304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:54.734383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:54.734440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554268992903170:5499]
2025-10-02T09:29:54.734463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:54.734469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:54.734524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: error at write: Disconnected sessionId: src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0
2025-10-02T09:29:54.734711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0 is DEAD
2025-10-02T09:29:54.734857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:54.734868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Write session will restart in 0.008617s
2025-10-02T09:29:54.734898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Write session: Do CDS request
2025-10-02T09:29:54.734905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:54.744287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.744507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:54.744532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-10-02T09:29:54.745620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.745689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:54.745701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:54.745708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:54.746224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-10-02T09:29:54.746272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:54.746280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:54.746282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:54.746294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554268992903190:5894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:54.746933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554268992903190:5894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:54.750534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554268992903190:5894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:54.754244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554268992903190:5894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:54.754262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554268992903190:5894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:54.754265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554268992903190:5894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:54.754272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:54.755246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:54.757501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:54.757758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:54.757766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:54.757776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:54.757829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:54.757870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554268917380895:5138]
2025-10-02T09:29:54.758437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:54.758700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:54.758742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:54.759045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:54.759097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.759102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.759103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.759104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.759105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.759106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.759107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.759108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.759109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.759111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.759112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.759113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.759118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.759129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.759131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.759135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.759139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.759142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.759146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.759149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.759152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.759155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.759158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.759161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.759167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.759174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.759179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.759183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.759186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.759191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.759196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.759200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.759205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.759209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.759212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.759216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.759220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.759224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.759228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.759232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.759236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.759246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.759250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.759255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.759262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.759266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.759270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.759274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.759309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:54.768825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:54.770700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:54.770720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:54.770723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:54.770727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:54.770734Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [2:7556554268917380895:5138]
2025-10-02T09:29:54.770750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:54.770770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:54.770773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.770776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.770778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.770794Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:54.770805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:54.770812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:54.770875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.770881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.770884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.770886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:54.770889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:54.770952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:54.770958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.770971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.770986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.771005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:54.771028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903316:5894], now have 1 active actors on pipe
2025-10-02T09:29:54.771035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903173:2446], now have 1 active actors on pipe
2025-10-02T09:29:54.771053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.771059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.771061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.771075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:54.771092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:54.771098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:54.771102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:54.771105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:54.771108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:54.771110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:54.771144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.771154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:54.771176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:54.771138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 569
2025-10-02T09:29:54.771166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 569
2025-10-02T09:29:54.771271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.771280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.771313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:54.771324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.771330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.771332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:54.771340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.771348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:54.771369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.771549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.771556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.771569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.771742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0
2025-10-02T09:29:54.772081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc52249-8c8d689b-6d0de61b-f8785875_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:54.774825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Write session: try to update token
2025-10-02T09:29:54.774845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:54.781759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:54.781776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.781779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:54.781781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:54.781789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.781794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.781798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554268917380890:5138]
2025-10-02T09:29:54.781835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:54.781841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.781844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:54.781845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:54.781851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:54.781855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:54.781977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:54.794729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:54.797090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:54.834538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554268992903335:5499]
2025-10-02T09:29:54.834796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7556554268992903335:5499]
2025-10-02T09:29:54.927320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:54.927668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.927682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.927699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903335:5499], now have 1 active actors on pipe
2025-10-02T09:29:54.928048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:54.928094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:54.928546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:54.928572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Write session will restart in 0.005887s
2025-10-02T09:29:54.928594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Write session: Do CDS request
2025-10-02T09:29:54.928599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:54.928108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:54.928168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: error at write: Disconnected sessionId: src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0
2025-10-02T09:29:54.928335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0 is DEAD
2025-10-02T09:29:54.928466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:54.928497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554268992903335:5499]
2025-10-02T09:29:54.937827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.938152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:54.938168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-10-02T09:29:54.938484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:54.938514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:54.938519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:54.938523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:54.939109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-10-02T09:29:54.939139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:54.939141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:54.939145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:54.939150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554268992903346:5899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:54.939641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554268992903346:5899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:54.943870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554268992903346:5899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:54.957748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554268992903346:5899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:54.957769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554268992903346:5899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:54.957773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554268992903346:5899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:54.957781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:54.961523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:54.964470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:54.964670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:54.964679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:54.964688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:54.964737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:54.964775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554268917381045:5141]
2025-10-02T09:29:54.965339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:54.965669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:54.965711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:54.966005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:54.966057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.966063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.966064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.966065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.966066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.966067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.966069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.966070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.966071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.966072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.966073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.966075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.966079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.966090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.966094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.966098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.966102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.966106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.966110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.966113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.966117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.966121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.966125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.966129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.966134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.966141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:54.966146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.966152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:54.966156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.966161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:54.966165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.966170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:54.966174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.966183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:54.966191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.966198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:54.966203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.966212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:54.966219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.966224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:54.966232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.966237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:54.966244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.966249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.966256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.966265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.966273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.966281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.966317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:54.974849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:54.976965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:54.976980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:54.976983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:54.976986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:54.976992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [2:7556554268917381045:5141]
2025-10-02T09:29:54.977008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:54.977026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:54.977034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.977040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.977042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.977057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:54.977065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:54.977072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:54.977135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.977142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.977145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.977148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:54.977150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:54.977210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:54.977217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.977230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:54.977242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:54.977262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:54.977283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903338:2446], now have 1 active actors on pipe
2025-10-02T09:29:54.977290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554268992903478:5899], now have 1 active actors on pipe
2025-10-02T09:29:54.977296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.977300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.977302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.977316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:54.977329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:54.977335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:54.977338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:54.977340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:54.977346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:54.977349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:54.977340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 570
2025-10-02T09:29:54.977380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.977372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 570
2025-10-02T09:29:54.977386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:54.977388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:54.977411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.977419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.977446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:54.977458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:54.977467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:54.977469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:54.977476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:54.977488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:54.977504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.977628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:54.977636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:54.977647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:54.977711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0
2025-10-02T09:29:54.978028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6cdb34-3f2608a-a118ecfd-a3b1a623_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:54.980581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Write session: try to update token
2025-10-02T09:29:54.980597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:54.989124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:54.989142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:54.989144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:54.989146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:54.989156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.989165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.989168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554268917381040:5141]
2025-10-02T09:29:54.989206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:54.989212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:54.989214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:54.989218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:54.989225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:54.989231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:54.989357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:54.996944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:55.000196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:55.028560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554273287870790:5499]
2025-10-02T09:29:55.032012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7556554273287870790:5499]
2025-10-02T09:29:55.137279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:55.137582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.137595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.137611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287870790:5499], now have 1 active actors on pipe
2025-10-02T09:29:55.137795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:55.137853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:55.137870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:55.137929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: error at write: Disconnected sessionId: src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0
2025-10-02T09:29:55.137961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554273287870790:5499]
2025-10-02T09:29:55.137978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:55.138106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0 is DEAD
2025-10-02T09:29:55.138253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:55.138261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Write session will restart in 0.007230s
2025-10-02T09:29:55.138285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Write session: Do CDS request
2025-10-02T09:29:55.138290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:55.146435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.146923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:55.146937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-10-02T09:29:55.147089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.147129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:55.147137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:55.147142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:55.147543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-10-02T09:29:55.147575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:55.147581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:55.147583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:55.147588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554273287870902:5911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:55.148100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554273287870902:5911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:55.149736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:55.150340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554273287870902:5911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:55.152019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:55.152183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:55.152190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:55.152199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:55.152240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:55.152303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554273212348527:5156]
2025-10-02T09:29:55.152731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554273287870902:5911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:55.152753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554273287870902:5911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:55.152757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554273287870902:5911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:55.152766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:55.152863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:55.153196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:55.153260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:55.153561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:55.153621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.153627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.153628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.153629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.153630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.153631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.153632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.153633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.153634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.153635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.153636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.153636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.153641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.153652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.153655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.153659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.153663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.153667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.153670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.153673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.153677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.153681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.153684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.153688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.153694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.153701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.153706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.153711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.153714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.153719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.153723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.153728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.153732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.153736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.153740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.153745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.153749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.153754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.153758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.153762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.153767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.153771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.153776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.153782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.153790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.153794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.153803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.153807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.153839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:55.162341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:55.164094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:55.164112Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:55.164115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:55.164118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:55.164124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [2:7556554273212348527:5156]
2025-10-02T09:29:55.164137Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:55.164154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:55.164157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.164160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.164163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.164177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:55.164181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:55.164185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:55.164228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.164234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.164236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.164238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:55.164240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:55.164296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:55.164303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.164316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.164332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.164351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:55.164376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287870960:5911], now have 1 active actors on pipe
2025-10-02T09:29:55.164385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287870817:2446], now have 1 active actors on pipe
2025-10-02T09:29:55.164390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.164392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.164394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.164407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:55.164418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:55.164420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:55.164423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:55.164425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:55.164430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:55.164433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:55.164467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.164479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:55.164487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:55.164463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 571
2025-10-02T09:29:55.164465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 571
2025-10-02T09:29:55.164604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.164616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.164637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:55.164645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.164652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.164654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:55.164662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.164671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:55.164682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.164856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.164863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.164875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.164951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 36 sessionId: src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0
2025-10-02T09:29:55.165282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a9eb1-2caadff4-9409e187-8e4982dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:55.167620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Write session: try to update token
2025-10-02T09:29:55.167633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:55.175136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:55.175152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:55.175154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:55.175156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:55.175165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.175169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.175175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554273212348522:5156]
2025-10-02T09:29:55.175211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:55.175216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.175215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:55.175218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:55.175219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:55.175222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:55.175352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:55.180113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:55.182367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:55.237983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554273287870972:5499]
2025-10-02T09:29:55.238318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7556554273287870972:5499]
2025-10-02T09:29:55.312835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:55.313124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.313133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.313161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287870972:5499], now have 1 active actors on pipe
2025-10-02T09:29:55.313354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:55.313470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:55.313498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554273287870972:5499]
2025-10-02T09:29:55.313513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:55.313572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0
2025-10-02T09:29:55.313707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0 is DEAD
2025-10-02T09:29:55.313873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:55.313883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Write session will restart in 0.005586s
2025-10-02T09:29:55.313905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Write session: Do CDS request
2025-10-02T09:29:55.313910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:55.320215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.320315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:55.320334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-10-02T09:29:55.320514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.320554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:55.320568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:55.320579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:55.321014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-10-02T09:29:55.321052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:55.321061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:55.321064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:55.321070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554273287870990:5915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:55.321638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554273287870990:5915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:55.324405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554273287870990:5915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:55.325352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:55.327360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:55.327487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:55.327494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:55.327500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:55.327533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:55.327560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554273212348678:5158]
2025-10-02T09:29:55.327758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554273287870990:5915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:55.327776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554273287870990:5915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:55.327781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554273287870990:5915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:55.327789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:55.327938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:55.328146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:55.328171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:55.328379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:55.328413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.328417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.328418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.328418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.328419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.328420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.328420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.328421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.328421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.328422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.328422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.328423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.328426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.328433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.328435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.328438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.328440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.328442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.328444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.328446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.328448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.328450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.328452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.328454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.328458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.328462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.328465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.328468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.328470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.328473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.328475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.328478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.328480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.328483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.328486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.328488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.328491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.328494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.328500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.328502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.328505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.328507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.328510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.328516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.328518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.328521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.328527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.328530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.328548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:55.337370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:55.338984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:55.338997Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:55.338998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:55.339002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:55.339006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [2:7556554273212348678:5158]
2025-10-02T09:29:55.339018Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:55.339030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:55.339032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.339034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.339045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.339056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:55.339060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:55.339064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:55.339107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.339112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.339113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.339116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:55.339117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:55.339164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:55.339168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.339176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.339182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.339190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:55.339202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.339205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.339206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.339211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:55.339218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:55.339219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:55.339222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:55.339224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:55.339229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:55.339231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:55.339239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871119:5915], now have 1 active actors on pipe
2025-10-02T09:29:55.339241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287870974:2446], now have 1 active actors on pipe
2025-10-02T09:29:55.339263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.339271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:55.339276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:55.339306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 572
2025-10-02T09:29:55.339315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 572
2025-10-02T09:29:55.339413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.339420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.339438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|406a9de-e250da7e-ab41a8f5-7f362743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:55.339445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.339447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.339449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:55.339454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.339460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:55.339469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.339631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.339640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.339653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.339761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 36 sessionId: src_id|406a9de-e250da7e-ab41a8f5-7f362743_0
2025-10-02T09:29:55.340069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abc0e5d-3dce4f6e-e8944750-a3b7e5d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|406a9de-e250da7e-ab41a8f5-7f362743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:55.342380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Write session: try to update token
2025-10-02T09:29:55.342393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:55.349578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:55.349593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:55.349594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:55.349596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:55.349602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.349605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.349607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554273212348673:5158]
2025-10-02T09:29:55.349639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:55.349644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:55.349647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.349649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:55.349649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:55.349652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:55.349783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:55.353890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|406a9de-e250da7e-ab41a8f5-7f362743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:55.356797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:55.413549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554273287871131:5499]
2025-10-02T09:29:55.413774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7556554273287871131:5499]
2025-10-02T09:29:55.481771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:55.481998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.482006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.482032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871131:5499], now have 1 active actors on pipe
2025-10-02T09:29:55.482215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:55.482316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554273287871131:5499]
2025-10-02T09:29:55.482317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:55.482353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:55.482436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|406a9de-e250da7e-ab41a8f5-7f362743_0
2025-10-02T09:29:55.482594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|406a9de-e250da7e-ab41a8f5-7f362743_0 is DEAD
2025-10-02T09:29:55.482744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:55.482754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Write session will restart in 0.008464s
2025-10-02T09:29:55.482770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Write session: Do CDS request
2025-10-02T09:29:55.482774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:55.492203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.492395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:55.492420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-10-02T09:29:55.492635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.492684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:55.492698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:55.492710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:55.493132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:55.493248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-10-02T09:29:55.493307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:55.493317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:55.493320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:55.493327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554273287871244:5919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:55.494047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554273287871244:5919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:55.495057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:55.495208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:55.495216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:55.495225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:55.495271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:55.495302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554273212348841:5161]
2025-10-02T09:29:55.495695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:55.495912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:55.495955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:55.496203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:55.496244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.496248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.496249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.496250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.496250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.496251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.496251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.496252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.496253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.496253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.496254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.496254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.496257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.496265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.496267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.496269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.496271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.496273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.496275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.496277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.496279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.496281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.496283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.496285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.496289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.496294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.496297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.496300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.496303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.496305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.496308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.496311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.496313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.496315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.496318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.496320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.496324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.496327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.496329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.496334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.496337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.496342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.496346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.496350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.496354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.496365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554273287871244:5919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:55.496359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.496363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.496368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.496401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:55.501775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554273287871244:5919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:55.501793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554273287871244:5919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:55.501796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554273287871244:5919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:55.501801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:55.504697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:55.506565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:55.506588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:55.506591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:55.506594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:55.506600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [2:7556554273212348841:5161]
2025-10-02T09:29:55.506613Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:55.506628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:55.506632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.506634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.506636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.506649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:55.506656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:55.506663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:55.506732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.506740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.506742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.506745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:55.506747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:55.506811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:55.506818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.506831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.506848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.506868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:55.506890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871283:5919], now have 1 active actors on pipe
2025-10-02T09:29:55.506897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871132:2446], now have 1 active actors on pipe
2025-10-02T09:29:55.506903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.506905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.506908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.506921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:55.506936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:55.506937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:55.506945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:55.506948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:55.506953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:55.506956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:55.506949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 573
2025-10-02T09:29:55.506972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 573
2025-10-02T09:29:55.506983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.506996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:55.506998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:55.507011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.507015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.507070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:55.507083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.507087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.507089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:55.507097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.507106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:55.507129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.507259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.507270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.507288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.507371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0
2025-10-02T09:29:55.507685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406a9de-e250da7e-ab41a8f5-7f362743_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:55.510138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Write session: try to update token
2025-10-02T09:29:55.510154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:55.518059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:55.518077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:55.518079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:55.518081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:55.518088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.518093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.518097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554273212348835:5161]
2025-10-02T09:29:55.518135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:55.518142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.518145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:55.518153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:55.518161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:55.518172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:55.518305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:55.524189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:55.526506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:55.582543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554273287871304:5499]
2025-10-02T09:29:55.582828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7556554273287871304:5499]
2025-10-02T09:29:55.659844Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:55.660253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.660269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.660287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871304:5499], now have 1 active actors on pipe
2025-10-02T09:29:55.660644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:55.660666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:55.660723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:55.660777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: error at write: Disconnected sessionId: src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0
2025-10-02T09:29:55.660885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:55.660948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554273287871304:5499]
2025-10-02T09:29:55.660991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0 is DEAD
2025-10-02T09:29:55.661403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:55.661415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Write session will restart in 0.006462s
2025-10-02T09:29:55.661446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Write session: Do CDS request
2025-10-02T09:29:55.661454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:55.669325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.669405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:55.669422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-10-02T09:29:55.669516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.669539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:55.669544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:55.669547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:55.670009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-10-02T09:29:55.670041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:55.670042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:55.670047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:55.670053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554273287871319:5924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:55.670542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554273287871319:5924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:55.673582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554273287871319:5924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:55.676527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554273287871319:5924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:55.676535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554273287871319:5924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:55.676538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554273287871319:5924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:55.676545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:55.676792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:55.679004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:55.679298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:55.679310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:55.679323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:55.679390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:55.679424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554273212348995:5163]
2025-10-02T09:29:55.680009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:55.680345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:55.680392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:55.680700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:55.680762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.680764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.680764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.680766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.680767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.680768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.680769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.680770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.680771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.680772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.680773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.680774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.680779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.680790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.680793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.680796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.680813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.680816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.680820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.680823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.680827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.680831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.680835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.680838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.680846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.680853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.680857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.680862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.680866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.680871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.680874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.680878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.680882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.680887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.680890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.680895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.680899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.680903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.680908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.680912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.680916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.680921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.680925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.680929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.680933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.680937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.680940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.680945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.680975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:55.689663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:55.691448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:55.691463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:55.691464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:55.691467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:55.691473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [2:7556554273212348995:5163]
2025-10-02T09:29:55.691483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:55.691496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:55.691498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.691500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.691501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.691513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:55.691517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:55.691523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:55.691580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.691588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.691590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.691592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:55.691594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:55.691649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:55.691655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.691663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.691669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.691679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:55.691695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.691699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.691701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.691707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:55.691717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:55.691717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:55.691720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:55.691723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:55.691729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:55.691730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:55.691739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871305:2446], now have 1 active actors on pipe
2025-10-02T09:29:55.691741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871453:5924], now have 1 active actors on pipe
2025-10-02T09:29:55.691766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.691773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:55.691791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:55.691819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 574
2025-10-02T09:29:55.691829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 574
2025-10-02T09:29:55.691915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.691921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.691939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|873cdb29-4de6c29f-757f7c98-a847577c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:55.691947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.691949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.691951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:55.691959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.691967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:55.691984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.692127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.692138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.692156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.692261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 36 sessionId: src_id|873cdb29-4de6c29f-757f7c98-a847577c_0
2025-10-02T09:29:55.692591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d9e71b-202a3c97-b0a0f3d4-845ef40_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|873cdb29-4de6c29f-757f7c98-a847577c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:55.695255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Write session: try to update token
2025-10-02T09:29:55.695274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:55.703605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:55.703630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:55.703632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:55.703635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:55.703642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.703648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.703655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554273212348990:5163]
2025-10-02T09:29:55.703691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:55.703697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.703699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:55.703701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:55.703707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:55.703710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:55.703836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:55.708593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|873cdb29-4de6c29f-757f7c98-a847577c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:55.711085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:55.765807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554273287871473:5499]
2025-10-02T09:29:55.770390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7556554273287871473:5499]
2025-10-02T09:29:55.842619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:55.842929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.842945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.842981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871473:5499], now have 1 active actors on pipe
2025-10-02T09:29:55.843446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:55.843497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:55.843218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:55.843888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:55.843899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Write session will restart in 0.005278s
2025-10-02T09:29:55.843920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Write session: Do CDS request
2025-10-02T09:29:55.843927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:55.843558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|873cdb29-4de6c29f-757f7c98-a847577c_0
2025-10-02T09:29:55.843738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|873cdb29-4de6c29f-757f7c98-a847577c_0 is DEAD
2025-10-02T09:29:55.843851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554273287871473:5499]
2025-10-02T09:29:55.850512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.850539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:55.850558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-10-02T09:29:55.850751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:55.850792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:55.850801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:55.850805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:55.851230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-10-02T09:29:55.851279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:55.851281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:55.851285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:55.851290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554273287871493:5929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:55.851791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554273287871493:5929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:55.854777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554273287871493:5929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:55.857892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:55.859500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554273287871493:5929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:55.859517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554273287871493:5929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:55.859521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554273287871493:5929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:55.859530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:55.860275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:55.860468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:55.860477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:55.860486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:55.860539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:55.860590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554273212349150:5166]
2025-10-02T09:29:55.861274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:55.861563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:55.861606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:55.861909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:55.861956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.861962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.861963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.861964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.861965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.861966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.861967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.861968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.861969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.861970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.861972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.861973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.861977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.861988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.861991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.861995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.861998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.862001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.862005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.862008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.862012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.862016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.862019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.862022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.862028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.862035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:55.862040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.862045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:55.862048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.862053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:55.862056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.862061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:55.862065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.862070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:55.862073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.862078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:55.862081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.862086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:55.862095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.862099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:55.862104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.862109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:55.862116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.862122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.862130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.862135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.862140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.862148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.862182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:55.870817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:55.872627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:55.872641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:55.872643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:55.872646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:55.872653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [2:7556554273212349150:5166]
2025-10-02T09:29:55.872666Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:55.872681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:55.872684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.872687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.872688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.872701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:55.872706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:55.872711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:55.872760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.872770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.872771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.872774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:55.872777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:55.872852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:55.872860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.872870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:55.872878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:55.872896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:55.872918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871628:5929], now have 1 active actors on pipe
2025-10-02T09:29:55.872926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871478:2446], now have 1 active actors on pipe
2025-10-02T09:29:55.872931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.872933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.872935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.872945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:55.872957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:55.872959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:55.872962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:55.872964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:55.872969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:55.872971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:55.873000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.873010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:55.873016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:55.873014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 575
2025-10-02T09:29:55.873070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 575
2025-10-02T09:29:55.873095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.873104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.873124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:55.873134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:55.873137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:55.873139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:55.873148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:55.873160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:55.873177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.873354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:55.873362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:55.873375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:55.873510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0
2025-10-02T09:29:55.873856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873cdb29-4de6c29f-757f7c98-a847577c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:55.876392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Write session: try to update token
2025-10-02T09:29:55.876409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:55.884311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:55.884335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:55.884338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:55.884340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:55.884349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.884354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.884359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554273212349144:5166]
2025-10-02T09:29:55.884398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:55.884400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:55.884405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:55.884409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:55.884409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:55.884411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:55.884546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:55.897478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:55.900118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:55.943991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554273287871639:5499]
2025-10-02T09:29:55.944326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7556554273287871639:5499]
2025-10-02T09:29:56.038657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:56.039078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.039094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.039113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554273287871639:5499], now have 1 active actors on pipe
2025-10-02T09:29:56.039362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:56.039384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:56.039397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:56.039403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554273287871639:5499]
2025-10-02T09:29:56.039427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:56.039450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: error at write: Disconnected sessionId: src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0
2025-10-02T09:29:56.039615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0 is DEAD
2025-10-02T09:29:56.039761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:56.039771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Write session will restart in 0.007710s
2025-10-02T09:29:56.039790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Write session: Do CDS request
2025-10-02T09:29:56.039796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:56.048267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.048385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:56.048401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-10-02T09:29:56.048525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.048556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:56.048564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:56.048568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:56.048934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-10-02T09:29:56.048961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:56.048965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:56.048966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:56.048971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554277582839023:5933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:56.049426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554277582839023:5933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:56.051002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:56.051191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554277582839023:5933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:56.053183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:56.053382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:56.053395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:56.053407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:56.053464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:56.053512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554277507316599:5168]
2025-10-02T09:29:56.053566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554277582839023:5933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:56.053579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554277582839023:5933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:56.053584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554277582839023:5933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:56.053591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:56.054140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:56.054461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:56.054512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:56.054847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:56.054921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.054933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.054934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.054935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.054936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.054937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.054939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.054940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.054941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.054942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.054943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.054945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.054951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.054962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.054966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.054970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.054974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.054978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.054982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.054986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.054989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.054992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.054996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.054999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.055006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.055014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.055022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.055028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.055033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.055051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.055055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.055060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.055065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.055070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.055074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.055078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.055083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.055088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.055093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.055104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.055110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.055114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.055118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.055126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.055133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.055146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.055151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.055156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.055188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:56.063914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:56.065758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:56.065776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:56.065779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:56.065782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:56.065788Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [2:7556554277507316599:5168]
2025-10-02T09:29:56.065801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:56.065818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:56.065821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.065823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.065825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.065840Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:56.065844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:56.065850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:56.065903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.065910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.065912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.065914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:56.065916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:56.065971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:56.065978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.065990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.066002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.066018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:56.066040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582838938:2446], now have 1 active actors on pipe
2025-10-02T09:29:56.066050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839088:5933], now have 1 active actors on pipe
2025-10-02T09:29:56.066055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.066058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.066060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.066072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:56.066083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:56.066088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:56.066090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:56.066093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:56.066094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:56.066097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:56.066126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.066088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 576
2025-10-02T09:29:56.066133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:56.066088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 576
2025-10-02T09:29:56.066134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:56.066160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.066167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.066195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:56.066208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.066210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.066212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:56.066220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.066227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:56.066242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.066373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.066386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.066404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.066485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 36 sessionId: src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0
2025-10-02T09:29:56.066789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b312f6-ae2d359d-fdd8c183-153b8b56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:56.069321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Write session: try to update token
2025-10-02T09:29:56.069338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:56.077228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:56.077249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.077251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:56.077253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:56.077260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.077264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.077267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554277507316593:5168]
2025-10-02T09:29:56.077299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:56.077305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.077307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:56.077314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:56.077323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:56.077328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:56.077480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:56.082236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:56.084582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:56.139566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554277582839121:5499]
2025-10-02T09:29:56.139737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7556554277582839121:5499]
2025-10-02T09:29:56.212233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:56.212552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.212563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.212599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839121:5499], now have 1 active actors on pipe
2025-10-02T09:29:56.212838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:56.212866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:56.212881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554277582839121:5499]
2025-10-02T09:29:56.212903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:56.212967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0
2025-10-02T09:29:56.213125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0 is DEAD
2025-10-02T09:29:56.216897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:56.216908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Write session will restart in 0.008764s
2025-10-02T09:29:56.216954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Write session: Do CDS request
2025-10-02T09:29:56.216960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:56.224997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:56.227247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:56.227317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.227410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:56.227441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:56.227428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-10-02T09:29:56.227450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:56.227460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:56.227517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:56.227575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554277507316793:5183]
2025-10-02T09:29:56.227879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.227907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:56.227917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:56.227921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:56.228078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:56.228284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-10-02T09:29:56.228314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:56.228316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:56.228317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:56.228321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554277582839245:5945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:56.228341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:56.228377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:56.228601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:56.228637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.228642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.228643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.228643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.228644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.228644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.228645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.228646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.228646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.228647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.228647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.228647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.228650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.228657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.228659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.228661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.228663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.228665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.228667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.228669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.228671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.228674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.228676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.228677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.228682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.228686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.228690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.228692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.228695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.228697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.228700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.228703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.228706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.228709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.228711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.228714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.228716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.228719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.228722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.228724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.228727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.228729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.228731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.228735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.228737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.228740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.228742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.228745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.228771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:56.228821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554277582839245:5945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:56.231204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554277582839245:5945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:56.236529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554277582839245:5945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:56.236550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554277582839245:5945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:56.236553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554277582839245:5945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:56.236561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:56.237112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:56.238886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:56.238896Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:56.238898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:56.238900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:56.238904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [2:7556554277507316793:5183]
2025-10-02T09:29:56.238914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:56.238926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:56.238927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.238929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.238930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.238941Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:56.238944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:56.238949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:56.238990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.238995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.238996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.238998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:56.239000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:56.239053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:56.239058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.239066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.239072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.239084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:56.239099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.239105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.239107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.239114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:56.239125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839281:5945], now have 1 active actors on pipe
2025-10-02T09:29:56.239131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:56.239135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839125:2446], now have 1 active actors on pipe
2025-10-02T09:29:56.239135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:56.239137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:56.239140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:56.239148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:56.239150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:56.239174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.239182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:56.239188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:56.239213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 577
2025-10-02T09:29:56.239218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 577
2025-10-02T09:29:56.239309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.239316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.239333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:56.239341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.239343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.239344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:56.239349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.239356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:56.239365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.239473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.239479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.239487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.239545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0
2025-10-02T09:29:56.239879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61875c48-c31e76f4-6b5f9971-9c9efbd4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:56.242501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Write session: try to update token
2025-10-02T09:29:56.242518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:56.249711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:56.249727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.249729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:56.249732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:56.249739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.249743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.249747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554277507316788:5183]
2025-10-02T09:29:56.249780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:56.249786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.249794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:56.249793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:56.249799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:56.249802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:56.249920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:56.255514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:56.257833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:56.313143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554277582839288:5499]
2025-10-02T09:29:56.313416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7556554277582839288:5499]
2025-10-02T09:29:56.388313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:56.388688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.388700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.388733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839288:5499], now have 1 active actors on pipe
2025-10-02T09:29:56.388948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:56.389042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:56.389042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554277582839288:5499]
2025-10-02T09:29:56.389057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:56.389065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:56.389115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: error at write: Disconnected sessionId: src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0
2025-10-02T09:29:56.389267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0 is DEAD
2025-10-02T09:29:56.389418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:56.389429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Write session will restart in 0.007264s
2025-10-02T09:29:56.389451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Write session: Do CDS request
2025-10-02T09:29:56.389458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:56.398310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.398390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:56.398407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-10-02T09:29:56.398514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.398542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:56.398551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:56.398554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:56.399002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-10-02T09:29:56.399049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:56.399057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:56.399059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:56.399064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554277582839360:5949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:56.399588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554277582839360:5949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:56.401556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554277582839360:5949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:56.401710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:56.404465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:56.404652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:56.404661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:56.404670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:56.404711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:56.404749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554277507316949:5185]
2025-10-02T09:29:56.404827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554277582839360:5949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:56.404839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554277582839360:5949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:56.404842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554277582839360:5949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:56.404847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:56.405327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:56.405600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:56.405635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:56.405903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:56.405948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.405953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.405954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.405955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.405955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.405956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.405957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.405958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.405959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.405960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.405961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.405962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.405966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.405976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.405979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.405983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.405986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.405989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.405992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.405995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.405999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.406002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.406005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.406009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.406014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.406020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.406025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.406029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.406034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.406038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.406041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.406050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.406054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.406059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.406067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.406071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.406074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.406079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.406087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.406091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.406095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.406103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.406106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.406111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.406117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.406121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.406128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.406132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.406161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:56.415395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:56.417114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:56.417126Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:56.417127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:56.417130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:56.417135Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [2:7556554277507316949:5185]
2025-10-02T09:29:56.417146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:56.417158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:56.417160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.417162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.417163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.417173Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:56.417178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:56.417183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:56.417224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.417226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.417227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.417229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:56.417230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:56.417275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:56.417280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.417288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.417294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.417303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:56.417316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.417319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.417320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.417326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:56.417337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839290:2446], now have 1 active actors on pipe
2025-10-02T09:29:56.417336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:56.417339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:56.417341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:56.417344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:56.417352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:56.417353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:56.417357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839444:5949], now have 1 active actors on pipe
2025-10-02T09:29:56.417380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.417387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:56.417395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:56.417430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 578
2025-10-02T09:29:56.417450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 578
2025-10-02T09:29:56.417528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.417534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.417550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:56.417554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.417556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.417558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:56.417564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.417573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:56.417584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.417724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.417730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.417739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.417822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 36 sessionId: src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0
2025-10-02T09:29:56.418147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed69c022-66700a74-bb0707d9-db9c3c84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:56.420596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Write session: try to update token
2025-10-02T09:29:56.420611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:56.428081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:56.428100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.428106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.428139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:56.428144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:56.428316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:56.428460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:56.428599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:56.428735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:56.428953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:56.428982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:56.434721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:56.437054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:56.437345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.437365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.437382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:56.437384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.437386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:56.437387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:56.437393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.437395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.437399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554277507316944:5185]
2025-10-02T09:29:56.437431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:56.437434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:56.437439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.437443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:56.437444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:56.437447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:56.437560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:56.489292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554277582839455:5499]
2025-10-02T09:29:56.489561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7556554277582839455:5499]
2025-10-02T09:29:56.568157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:56.568472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:56.568494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839455:5499], now have 1 active actors on pipe
2025-10-02T09:29:56.568592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:56.568621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:56.568703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554277582839455:5499]
2025-10-02T09:29:56.578081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:56.578539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:56.578554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:56.578575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: error at write: Disconnected sessionId: src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0
2025-10-02T09:29:56.578709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0 is DEAD
2025-10-02T09:29:56.578869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:56.578880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Write session will restart in 0.006242s
2025-10-02T09:29:56.578904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Write session: Do CDS request
2025-10-02T09:29:56.578910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:56.581242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:56.581375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:56.581382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:56.581388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:56.581422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:56.581448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554277507317118:5188]
2025-10-02T09:29:56.581856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:56.582052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:56.582089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:56.582349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:56.582394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.582400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.582401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.582402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.582403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.582404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.582405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.582406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.582407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.582408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.582409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.582410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.582414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.582425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.582428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.582432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.582436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.582439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.582443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.582446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.582450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.582454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.582457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.582462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.582467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.582474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.582484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.582492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.582500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.582508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.582514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.582516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.582519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.582522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.582527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.582530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.582532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.582535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.582540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.582543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.582545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.582548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.582550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.582553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.582558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.582561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.582563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.582566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.582597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:56.586260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.586358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:56.586372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-10-02T09:29:56.586473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.586504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:56.586513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:56.586518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:56.586866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-10-02T09:29:56.586901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:56.586907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:56.586911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:56.586915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554277582839596:5956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:56.587423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554277582839596:5956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:56.589650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554277582839596:5956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:56.590775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:56.592217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554277582839596:5956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:56.592229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554277582839596:5956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:56.592231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554277582839596:5956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:56.592235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:56.592551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:56.592566Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:56.592568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:56.592571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:56.592576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [2:7556554277507317118:5188]
2025-10-02T09:29:56.592589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:56.592602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:56.592609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.592611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.592613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.592628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:56.592639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:56.592646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:56.592682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.592688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.592690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.592691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:56.592693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:56.592732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:56.592736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.592743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.592752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.592764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:56.592778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839629:5956], now have 1 active actors on pipe
2025-10-02T09:29:56.592784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839473:2446], now have 1 active actors on pipe
2025-10-02T09:29:56.592787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.592788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.592789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.592818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:56.592823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:56.592826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:56.592827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:56.592834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:56.592831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 579
2025-10-02T09:29:56.592847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:56.592854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:56.592851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 579
2025-10-02T09:29:56.592887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.592893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.592904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.592912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:56.592920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:56.592931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|798beb28-39b4962a-3efab42d-51592818_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:56.592938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.592941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.592942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:56.592948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.592954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:56.592967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.593119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.593129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.593142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.593219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 36 sessionId: src_id|798beb28-39b4962a-3efab42d-51592818_0
2025-10-02T09:29:56.593478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62980bf9-75a2cde-d4bd84f6-68be72ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|798beb28-39b4962a-3efab42d-51592818_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:56.595717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Write session: try to update token
2025-10-02T09:29:56.595731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:56.604099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:56.604125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.604129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:56.604131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:56.604142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.604149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.604154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554277507317112:5188]
2025-10-02T09:29:56.604199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:56.604200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:56.604208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.604210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:56.604211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:56.604215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:56.604381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:56.609723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|798beb28-39b4962a-3efab42d-51592818_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:56.611773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:56.668995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554277582839637:5499]
2025-10-02T09:29:56.669270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7556554277582839637:5499]
2025-10-02T09:29:56.731756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:56.732150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.732161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.732176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839637:5499], now have 1 active actors on pipe
2025-10-02T09:29:56.732402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:56.732417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:56.732432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554277582839637:5499]
2025-10-02T09:29:56.732450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:56.732475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: error at write: Disconnected sessionId: src_id|798beb28-39b4962a-3efab42d-51592818_0
2025-10-02T09:29:56.732374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:56.732646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|798beb28-39b4962a-3efab42d-51592818_0 is DEAD
2025-10-02T09:29:56.732766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:56.732774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Write session will restart in 0.009381s
2025-10-02T09:29:56.732792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Write session: Do CDS request
2025-10-02T09:29:56.732796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:56.743268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.743343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:56.743358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-10-02T09:29:56.743482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.743511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:56.743515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:56.743519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:56.743874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-10-02T09:29:56.743913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:56.743919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:56.743922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:56.743927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554277582839760:5960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:56.744174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:56.744388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554277582839760:5960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:56.746069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554277582839760:5960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:56.746529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:56.746738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:56.746756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:56.746769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:56.746834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:56.746872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554277507317276:5190]
2025-10-02T09:29:56.747433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:56.747751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:56.747804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:56.748108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:56.748194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.748201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.748202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.748202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.748203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.748205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.748206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.748207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.748208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.748209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.748210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.748211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.748216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.748225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.748228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.748231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.748235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.748238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.748246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.748249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.748252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.748261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.748268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.748271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.748281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.748291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.748295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.748300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.748308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.748312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.748319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.748324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.748331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.748340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.748347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.748351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.748359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.748367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.748375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.748380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.748389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.748393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.748397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.748402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.748410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.748416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.748424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.748428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.748433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554277582839760:5960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:56.748443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554277582839760:5960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:56.748446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554277582839760:5960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:56.748469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:56.748451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:56.756864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:56.758625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:56.758639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:56.758640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:56.758642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:56.758646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [2:7556554277507317276:5190]
2025-10-02T09:29:56.758655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:56.758667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:56.758669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.758671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.758672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.758683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:56.758687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:56.758692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:56.758729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.758735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.758736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.758739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:56.758740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:56.758787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:56.758795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.758803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.758809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.758817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:56.758828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.758830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.758832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.758836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:56.758845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839639:2446], now have 1 active actors on pipe
2025-10-02T09:29:56.758847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:56.758847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839798:5960], now have 1 active actors on pipe
2025-10-02T09:29:56.758850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:56.758852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:56.758853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:56.758860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:56.758862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:56.758884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.758889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:56.758896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:56.758898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 580
2025-10-02T09:29:56.758944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 580
2025-10-02T09:29:56.758999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.759010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.759030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca2f68e-93bc01a9-ec5be173-92806878_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:56.759045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.759050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.759057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:56.759067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.759076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:56.759090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.759231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.759236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.759246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.759367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 36 sessionId: src_id|eca2f68e-93bc01a9-ec5be173-92806878_0
2025-10-02T09:29:56.759688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|798beb28-39b4962a-3efab42d-51592818_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eca2f68e-93bc01a9-ec5be173-92806878_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:56.762056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Write session: try to update token
2025-10-02T09:29:56.762070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:56.769652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:56.769672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.769674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:56.769676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:56.769686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.769689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.769693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554277507317270:5190]
2025-10-02T09:29:56.769727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:56.769734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.769734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:56.769736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:56.769740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:56.769744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:56.769897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:56.777112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|eca2f68e-93bc01a9-ec5be173-92806878_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:56.779395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:56.832837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554277582839814:5499]
2025-10-02T09:29:56.833150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7556554277582839814:5499]
2025-10-02T09:29:56.911227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:56.911568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.911583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.911599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839814:5499], now have 1 active actors on pipe
2025-10-02T09:29:56.911838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:56.911873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:56.911877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:56.911880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554277582839814:5499]
2025-10-02T09:29:56.911930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: error at write: Disconnected sessionId: src_id|eca2f68e-93bc01a9-ec5be173-92806878_0
2025-10-02T09:29:56.911975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:56.912067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|eca2f68e-93bc01a9-ec5be173-92806878_0 is DEAD
2025-10-02T09:29:56.912179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:56.912188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Write session will restart in 0.007289s
2025-10-02T09:29:56.912205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Write session: Do CDS request
2025-10-02T09:29:56.912209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:56.920297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.920425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:56.920438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-10-02T09:29:56.920556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:56.920586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:56.920591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:56.920595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:56.921050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-10-02T09:29:56.921087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:56.921092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:56.921094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:56.921098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554277582839881:5965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:56.921567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554277582839881:5965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:56.923817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554277582839881:5965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:56.924489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:56.926912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:56.927002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554277582839881:5965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:56.927012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554277582839881:5965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:56.927014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554277582839881:5965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:56.927019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:56.927154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:56.927168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:56.927180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:56.927249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:56.927289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554277507317438:5193]
2025-10-02T09:29:56.927821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:56.928171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:56.928226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:56.928517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:56.928589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.928596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.928597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.928598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.928598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.928599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.928601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.928601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.928602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.928603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.928604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.928605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.928610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.928620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.928623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.928626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.928629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.928632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.928635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.928638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.928641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.928644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.928648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.928650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.928656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.928662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:56.928666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.928671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:56.928674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.928678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:56.928682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.928686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:56.928690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.928697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:56.928701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.928704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:56.928709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.928713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:56.928717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.928726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:56.928729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.928733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:56.928737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.928741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.928745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.928749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.928758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.928762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.928793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:56.937984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:56.939803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:56.939826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:56.939828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:56.939832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:56.939838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [2:7556554277507317438:5193]
2025-10-02T09:29:56.939852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:56.939869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:56.939872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.939875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.939877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.939892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:56.939897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:56.939909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:56.939963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.939971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.939973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.939976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:56.939978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:56.940047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:56.940056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.940070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:56.940080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:56.940094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:56.940119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839972:5965], now have 1 active actors on pipe
2025-10-02T09:29:56.940122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554277582839817:2446], now have 1 active actors on pipe
2025-10-02T09:29:56.940128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.940172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 581
2025-10-02T09:29:56.940130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.940132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.940179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 581
2025-10-02T09:29:56.940145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:56.940158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:56.940166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:56.940171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:56.940171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:56.940173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:56.940174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:56.940204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.940207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:56.940213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:56.940240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.940243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.940267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:56.940272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:56.940284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:56.940285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:56.940294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:56.940307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:56.940326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.940504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.940515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.940529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:56.940626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0
2025-10-02T09:29:56.940972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca2f68e-93bc01a9-ec5be173-92806878_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:56.943413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Write session: try to update token
2025-10-02T09:29:56.943431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:56.950826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:56.950846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.950855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.950893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:56.950895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:56.951079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:56.951233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:56.951382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:56.951546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:56.951830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:56.951874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:56.957194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:56.959714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:56.960414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:56.960439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:56.960456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:56.960460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:56.960462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:56.960464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:56.960472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.960475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.960479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554277507317433:5193]
2025-10-02T09:29:56.960512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:56.960522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:56.960525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:56.960525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:56.960530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:56.960532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:56.960665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:57.012017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554281877807279:5499]
2025-10-02T09:29:57.012338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7556554281877807279:5499]
2025-10-02T09:29:57.102213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:57.102640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:57.102676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807279:5499], now have 1 active actors on pipe
2025-10-02T09:29:57.102790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:57.102818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:57.102879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554281877807279:5499]
2025-10-02T09:29:57.102881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:57.102883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:57.102946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: error at write: Disconnected sessionId: src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0
2025-10-02T09:29:57.103116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0 is DEAD
2025-10-02T09:29:57.103251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:57.103261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Write session will restart in 0.008850s
2025-10-02T09:29:57.103281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Write session: Do CDS request
2025-10-02T09:29:57.103291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:57.113309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.113428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:57.113446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-10-02T09:29:57.113589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.113614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:57.113619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:57.113622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:57.114056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-10-02T09:29:57.114093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:57.114096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:57.114098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:57.114104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554281877807352:5969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:57.114604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554281877807352:5969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:57.116880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554281877807352:5969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:57.117492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:57.119890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:57.120106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:57.120117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:57.120129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:57.120187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:57.120228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554281802284898:5195]
2025-10-02T09:29:57.120455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554281877807352:5969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:57.120479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554281877807352:5969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:57.120483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554281877807352:5969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:57.120496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:57.120855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:57.121220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:57.121304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:57.121713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:57.121781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.121788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.121790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.121791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.121792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.121794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.121796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.121797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.121799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.121801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.121802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.121804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.121812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.121823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.121828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.121831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.121835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.121839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.121843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.121848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.121851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.121856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.121860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.121864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.121872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.121880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.121887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.121893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.121898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.121903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.121907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.121913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.121918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.121923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.121937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.121943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.121949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.121955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.121965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.121971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.121976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.121981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.121986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.121992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.122003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.122009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.122013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.122025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.122062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:57.131149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:57.133001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:57.133018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:57.133020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:57.133024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:57.133031Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [2:7556554281802284898:5195]
2025-10-02T09:29:57.133044Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:57.133059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:57.133063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.133066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.133068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.133082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:57.133091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:57.133098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:57.133155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.133163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.133166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.133168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:57.133171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:57.133235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:57.133242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.133254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.133265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.133284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:57.133306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.133313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.133315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.133323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:57.133333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:57.133336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:57.133342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:57.133344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:57.133349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:57.133352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:57.133362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807442:5969], now have 1 active actors on pipe
2025-10-02T09:29:57.133366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807282:2446], now have 1 active actors on pipe
2025-10-02T09:29:57.133401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.133417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:57.133440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:57.133440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 582
2025-10-02T09:29:57.133455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 582
2025-10-02T09:29:57.133518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.133528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.133554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a70f385-f6ae7e59-4f323332-815832e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:57.133560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.133563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.133565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:57.133572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.133581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:57.133595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.133782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.133792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.133807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.133939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a70f385-f6ae7e59-4f323332-815832e1_0
2025-10-02T09:29:57.134369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0fda5a-c3a935ca-1619def1-774a8d51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a70f385-f6ae7e59-4f323332-815832e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:57.136848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Write session: try to update token
2025-10-02T09:29:57.136862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:57.144850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:57.144869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.144871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:57.144873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:57.144879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.144883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.144889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554281802284889:5195]
2025-10-02T09:29:57.144927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:57.144932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.144934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:57.144951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:57.144960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:57.144964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:57.145122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:57.151132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|6a70f385-f6ae7e59-4f323332-815832e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:57.154187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:57.203018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554281877807477:5499]
2025-10-02T09:29:57.203333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7556554281877807477:5499]
2025-10-02T09:29:57.287080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:57.287373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.287384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.287401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807477:5499], now have 1 active actors on pipe
2025-10-02T09:29:57.289155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:57.289164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554281877807477:5499]
2025-10-02T09:29:57.289200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:57.289203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:57.289305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: error at write: Disconnected sessionId: src_id|6a70f385-f6ae7e59-4f323332-815832e1_0
2025-10-02T09:29:57.289038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:57.289508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|6a70f385-f6ae7e59-4f323332-815832e1_0 is DEAD
2025-10-02T09:29:57.289668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:57.289681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Write session will restart in 0.006751s
2025-10-02T09:29:57.289713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Write session: Do CDS request
2025-10-02T09:29:57.289720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:57.297320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.297777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:57.297797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-10-02T09:29:57.297924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.297956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:57.297961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:57.297965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:57.298610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-10-02T09:29:57.298654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:57.298661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:57.298663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:57.298670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554281877807528:5981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:57.299273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554281877807528:5981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:57.302084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554281877807528:5981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:57.303125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:57.306201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:57.306446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:57.306465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:57.306478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:57.306543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:57.306597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554281802285093:5210]
2025-10-02T09:29:57.306779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554281877807528:5981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:57.306798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554281877807528:5981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:57.306802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554281877807528:5981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:57.306812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:57.307259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:57.307633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:57.307690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:57.308065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:57.308130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.308137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.308139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.308140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.308142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.308143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.308144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.308145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.308147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.308149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.308150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.308152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.308158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.308169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.308173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.308177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.308180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.308185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.308189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.308193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.308197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.308201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.308205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.308209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.308216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.308223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.308232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.308237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.308248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.308254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.308259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.308264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.308269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.308279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.308284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.308289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.308295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.308305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.308311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.308316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.308321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.308326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.308339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.308345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.308356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.308360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.308366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.308400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:57.317391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:57.319882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:57.319906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:57.319909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:57.319913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:57.319922Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [2:7556554281802285093:5210]
2025-10-02T09:29:57.319941Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:57.319963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:57.319973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.319976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.319979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.319999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:57.320011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:57.320020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:57.320096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.320106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.320108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.320113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:57.320116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:57.320195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:57.320204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.320222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.320237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.320259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:57.320286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807480:2446], now have 1 active actors on pipe
2025-10-02T09:29:57.320298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807638:5981], now have 1 active actors on pipe
2025-10-02T09:29:57.320307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.320310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.320312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.320325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:57.320341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:57.320340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:57.320343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:57.320345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:57.320356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:57.320359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:57.320407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.320417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:57.320420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:57.320371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 583
2025-10-02T09:29:57.320411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 583
2025-10-02T09:29:57.320460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.320473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.320502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:57.320523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.320529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.320531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:57.320545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.320557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:57.320575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.320740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.320750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.320767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.320886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 36 sessionId: src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0
2025-10-02T09:29:57.321289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a70f385-f6ae7e59-4f323332-815832e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:57.324402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Write session: try to update token
2025-10-02T09:29:57.324422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:57.331343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:57.331363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.331366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:57.331369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:57.331379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.331384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.331388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554281802285088:5210]
2025-10-02T09:29:57.331431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:57.331446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.331446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:57.331448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:57.331452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:57.331456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:57.331595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:57.339333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:57.341857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:57.389389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554281877807649:5499]
2025-10-02T09:29:57.389813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7556554281877807649:5499]
2025-10-02T09:29:57.473471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:57.473808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.473818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.473835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807649:5499], now have 1 active actors on pipe
2025-10-02T09:29:57.474101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:57.474131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:57.474137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:57.474167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:57.474178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554281877807649:5499]
2025-10-02T09:29:57.474224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0
2025-10-02T09:29:57.474417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0 is DEAD
2025-10-02T09:29:57.474583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:57.474594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Write session will restart in 0.007295s
2025-10-02T09:29:57.474617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Write session: Do CDS request
2025-10-02T09:29:57.474623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:57.483325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.483393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:57.483415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-10-02T09:29:57.483594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.483636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:57.483650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:57.483656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:57.484079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-10-02T09:29:57.484115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:57.484117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:57.484119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:57.484125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554281877807678:5985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:57.484814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554281877807678:5985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:57.487131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554281877807678:5985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:57.489007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:57.490976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554281877807678:5985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:57.490990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554281877807678:5985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:57.490992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554281877807678:5985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:57.490997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:57.491030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:57.491227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:57.491235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:57.491246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:57.491292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:57.491326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554281802285268:5212]
2025-10-02T09:29:57.491808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:57.492041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:57.492074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:57.492461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:57.492522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.492528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.492529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.492529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.492530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.492531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.492532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.492533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.492534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.492534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.492535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.492536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.492540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.492547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.492550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.492553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.492555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.492558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.492560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.492562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.492565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.492569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.492571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.492574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.492580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.492586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.492590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.492594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.492598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.492601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.492603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.492606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.492609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.492614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.492616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.492619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.492626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.492629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.492632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.492639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.492644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.492650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.492653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.492656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.492662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.492665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.492672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.492675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.492698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:57.502036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:57.503893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:57.503910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:57.503914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:57.503918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:57.503927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [2:7556554281802285268:5212]
2025-10-02T09:29:57.503945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:57.503965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:57.503969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.503973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.503975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.503993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:57.503997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:57.504004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:57.504062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.504071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.504074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.504078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:57.504081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:57.504154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:57.504161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.504172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.504179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.504191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:57.504218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.504226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.504229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.504239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:57.504252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:57.504256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:57.504257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:57.504260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:57.504272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:57.504275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:57.504291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807810:5985], now have 1 active actors on pipe
2025-10-02T09:29:57.504300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807652:2446], now have 1 active actors on pipe
2025-10-02T09:29:57.504339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.504362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:57.504342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 584
2025-10-02T09:29:57.504350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 584
2025-10-02T09:29:57.504387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:57.504450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.504458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.504488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:57.504499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.504504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.504506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:57.504517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.504528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:57.504549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.504777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.504797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.504844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.504959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 36 sessionId: src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0
2025-10-02T09:29:57.505321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fdc4de-ecafa192-51f35717-6f1ab384_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:57.508141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Write session: try to update token
2025-10-02T09:29:57.508160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:57.516118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:57.516138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.516142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:57.516144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:57.516156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.516161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.516167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554281802285262:5212]
2025-10-02T09:29:57.516220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:57.516222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:57.516231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:57.516235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:57.516236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.516239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:57.516494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:57.522183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:57.524753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:57.574231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554281877807833:5499]
2025-10-02T09:29:57.574574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7556554281877807833:5499]
2025-10-02T09:29:57.655521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:57.655833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.655845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.655858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807833:5499], now have 1 active actors on pipe
2025-10-02T09:29:57.656156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:57.656156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554281877807833:5499]
2025-10-02T09:29:57.656194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:57.656200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:57.656239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:57.656265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: error at write: Disconnected sessionId: src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0
2025-10-02T09:29:57.656431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0 is DEAD
2025-10-02T09:29:57.656571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:57.656582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Write session will restart in 0.007209s
2025-10-02T09:29:57.656605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Write session: Do CDS request
2025-10-02T09:29:57.656610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:57.665262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.665354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:57.665369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-10-02T09:29:57.665502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.665542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:57.665551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:57.665555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:57.665933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-10-02T09:29:57.665964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:57.665966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:57.665968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:57.665973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554281877807891:5990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:57.666500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554281877807891:5990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:57.668314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554281877807891:5990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:57.669634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:57.671974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:57.672159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:57.672172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:57.672183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:57.672248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:57.672254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554281877807891:5990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:57.672269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554281877807891:5990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:57.672272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554281877807891:5990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:57.672279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:57.672306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554281802285430:5215]
2025-10-02T09:29:57.672899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:57.673133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:57.673173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:57.673512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:57.673555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.673560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.673561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.673561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.673562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.673563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.673563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.673564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.673564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.673565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.673566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.673566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.673569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.673577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.673579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.673581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.673583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.673586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.673588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.673590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.673592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.673594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.673596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.673598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.673602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.673607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.673610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.673613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.673615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.673618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.673620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.673624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.673626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.673629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.673631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.673634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.673636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.673640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.673642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.673645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.673649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.673651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.673653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.673656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.673659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.673662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.673664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.673667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.673684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:57.682499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:57.684259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:57.684278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:57.684281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:57.684285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:57.684291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [2:7556554281802285430:5215]
2025-10-02T09:29:57.684305Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:57.684323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:57.684325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.684328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.684331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.684347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:57.684352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:57.684358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:57.684414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.684420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.684423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.684427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:57.684429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:57.684491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:57.684499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.684512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.684526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.684546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:57.684569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807836:2446], now have 1 active actors on pipe
2025-10-02T09:29:57.684577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877807995:5990], now have 1 active actors on pipe
2025-10-02T09:29:57.684583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.684586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.684588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.684596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:57.684607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:57.684611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:57.684614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:57.684616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:57.684625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:57.684628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:57.684661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.684672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:57.684676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:57.684677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 585
2025-10-02T09:29:57.684688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 585
2025-10-02T09:29:57.684750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.684757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.684777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a7410ef-70b60d82-9703251c-42117aae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:57.684784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.684788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.684789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:57.684795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.684814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:57.684827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.685036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.685045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.685058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.685134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a7410ef-70b60d82-9703251c-42117aae_0
2025-10-02T09:29:57.685514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b6dbe1-eaa1a2a9-c077103d-26217a5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a7410ef-70b60d82-9703251c-42117aae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:57.688348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Write session: try to update token
2025-10-02T09:29:57.688365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:57.696367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:57.696385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.696394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.696443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:57.696444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:57.696670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:57.696879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:57.697177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:57.697355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:57.697702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:57.697752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:57.703352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|9a7410ef-70b60d82-9703251c-42117aae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:57.706078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:57.706448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:57.706302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.706322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.706354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:57.708084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:57.708099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.708101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:57.708103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:57.708111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.708115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.708118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554281802285425:5215]
2025-10-02T09:29:57.708165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:57.708165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:57.708171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:57.708174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.708175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:57.708176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:57.708328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:57.756480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554281877808009:5499]
2025-10-02T09:29:57.756998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7556554281877808009:5499]
2025-10-02T09:29:57.855528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:57.863149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.863174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.863338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.863403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.863460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.863515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.863786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.863791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.863860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.863924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.863986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.864049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.864090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.864093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.864154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.864208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.864273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.864331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.864370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.864373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.864438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.864756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.864925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.864993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.865037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.865048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.865119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.865178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.865248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.865312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.865360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.865370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.865435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.865498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.865566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.865632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.865678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.865686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.865752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.865813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.865879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.865944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.865988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.865994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.866059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.866119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.866176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.866234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.866276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.866282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.866342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.866401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.866458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.866519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.866561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.866567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.866631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:57.866773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:57.866908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:57.867062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:57.867122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:57.867129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:57.867191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877808009:5499], now have 1 active actors on pipe
2025-10-02T09:29:57.867579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554281877808009:5499]
2025-10-02T09:29:57.867634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:57.867637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:57.867670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: error at write: Disconnected sessionId: src_id|9a7410ef-70b60d82-9703251c-42117aae_0
2025-10-02T09:29:57.867747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:57.867876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|9a7410ef-70b60d82-9703251c-42117aae_0 is DEAD
2025-10-02T09:29:57.868041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:57.868052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Write session will restart in 0.007039s
2025-10-02T09:29:57.868074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Write session: Do CDS request
2025-10-02T09:29:57.867998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:57.868080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:57.876282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.876387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:57.876405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-10-02T09:29:57.876506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:57.876536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:57.876544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:57.876549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:57.877147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-10-02T09:29:57.877197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:57.877205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:57.877209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:57.877217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554281877808064:5995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:57.877790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554281877808064:5995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:57.880955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554281877808064:5995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:57.883160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:57.885822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:57.886004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:57.886013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:57.886022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:57.886069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:57.886037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554281877808064:5995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:57.886054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554281877808064:5995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:57.886113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554281802285597:5218]
2025-10-02T09:29:57.886058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554281877808064:5995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:57.886065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:57.886703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:57.886970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:57.887001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:57.887217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:57.887250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.887254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.887255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.887255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.887256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.887257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.887258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.887258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.887259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.887260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.887260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.887261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.887264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.887271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.887274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.887276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.887278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.887280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.887283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.887285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.887287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.887289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.887291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.887293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.887298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.887302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:57.887307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.887310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:57.887313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.887316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:57.887318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.887321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:57.887324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.887327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:57.887329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.887332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:57.887334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.887337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:57.887340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.887343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:57.887346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.887349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:57.887351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.887354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.887357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.887360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.887363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.887365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.887387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:57.896060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:57.897541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:57.897554Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:57.897556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:57.897559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:57.897564Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [2:7556554281802285597:5218]
2025-10-02T09:29:57.897575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:57.897588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:57.897589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.897592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.897593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.897605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:57.897608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:57.897617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:57.897659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.897665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.897666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.897669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:57.897670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:57.897723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:57.897730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.897741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:57.897754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:57.897765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:57.897779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877808179:5995], now have 1 active actors on pipe
2025-10-02T09:29:57.897784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877808019:2446], now have 1 active actors on pipe
2025-10-02T09:29:57.897789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.897790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.897792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.897800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:57.897810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:57.897816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:57.897819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:57.897820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:57.897822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:57.897823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:57.897844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.897851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:57.897859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:57.897881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 586
2025-10-02T09:29:57.897889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 586
2025-10-02T09:29:57.897960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.897967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.897985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed3275-633840a9-e74d92c2-53c2d580_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:57.897992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:57.897995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:57.897997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:57.898003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:57.898009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:57.898023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.898184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.898197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.898216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:57.898317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ed3275-633840a9-e74d92c2-53c2d580_0
2025-10-02T09:29:57.898659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7410ef-70b60d82-9703251c-42117aae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ed3275-633840a9-e74d92c2-53c2d580_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:57.901149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Write session: try to update token
2025-10-02T09:29:57.901164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:57.908569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:57.908583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.908593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.908626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:57.908632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:57.908777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:57.908930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:57.909062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:57.909205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:57.909419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:57.909471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:57.914536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|5ed3275-633840a9-e74d92c2-53c2d580_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:57.917151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:57.917457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:57.917471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:57.918450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:57.918462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:57.918464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:57.918465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:57.918471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.918474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.918477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554281802285592:5218]
2025-10-02T09:29:57.918502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:57.918516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:57.918520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:57.918522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:57.918522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:57.918527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:57.918531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:57.918598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:57.918638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:57.967962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554281877808191:5499]
2025-10-02T09:29:57.968374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7556554281877808191:5499]
2025-10-02T09:29:58.057002Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:58.063733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.063753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.063885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.063937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.063993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.064045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.064272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.064279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.064342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.064396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.064453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.064508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.064546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.064553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.064613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.064666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.064717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.064786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.064845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.064850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.064909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.064970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.065030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.065088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.065130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.065135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.065189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.065239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.065293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.065345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.065384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.065391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.065455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.065510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.065562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.065612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.065662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.065669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.065722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.065768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.065825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.065878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.065917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.065922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.065977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.066027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.066080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.066130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.066172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.066183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.066242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.066291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.066341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.066392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.066429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.066434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.066487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.066535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.066588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.066652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.066704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.066710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.066748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554281877808191:5499], now have 1 active actors on pipe
2025-10-02T09:29:58.067007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:58.067022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:58.067028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:58.067067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: error at write: Disconnected sessionId: src_id|5ed3275-633840a9-e74d92c2-53c2d580_0
2025-10-02T09:29:58.067080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554281877808191:5499]
2025-10-02T09:29:58.067206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:58.067253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|5ed3275-633840a9-e74d92c2-53c2d580_0 is DEAD
2025-10-02T09:29:58.067437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:58.067453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Write session will restart in 0.009267s
2025-10-02T09:29:58.067480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Write session: Do CDS request
2025-10-02T09:29:58.067489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:58.077958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:58.078259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.078375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:58.078396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-10-02T09:29:58.078568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.078602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:58.078615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:58.078621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:58.078985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-10-02T09:29:58.079027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:58.079047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:58.079049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:58.079054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554286172775616:5999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:58.079506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554286172775616:5999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:58.079740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:58.079882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:58.079891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:58.079900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:58.079938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:58.079972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554286097253058:5220]
2025-10-02T09:29:58.080532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:58.080828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:58.080868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:58.081151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:58.081194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.081203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.081204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.081205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.081206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.081207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.081208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.081209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.081210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.081211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.081212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.081212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.081217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.081226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.081230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.081235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.081238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.081242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.081246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.081250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.081253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.081257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.081260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.081264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.081269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.081276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.081281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.081286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.081290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.081295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.081298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.081303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.081307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.081315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.081320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.081329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.081334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.081338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.081347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.081351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.081359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.081364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.081373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.081378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.081386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.081391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.081399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.081405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.081443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:58.081644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554286172775616:5999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:58.087406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554286172775616:5999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:58.087420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554286172775616:5999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:58.087423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554286172775616:5999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:58.087428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:58.089743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:58.091285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:58.091302Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:58.091305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:58.091309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:58.091315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [2:7556554286097253058:5220]
2025-10-02T09:29:58.091327Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:58.091343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:58.091350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.091353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.091355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.091368Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:58.091377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:58.091387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:58.091439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.091446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.091448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.091451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:58.091453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:58.091509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:58.091516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.091528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.091543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.091562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:58.091584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775653:5999], now have 1 active actors on pipe
2025-10-02T09:29:58.091592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775489:2446], now have 1 active actors on pipe
2025-10-02T09:29:58.091602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.091608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.091610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.091623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:58.091637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:58.091640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:58.091643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:58.091644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:58.091654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:58.091661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:58.091649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 587
2025-10-02T09:29:58.091686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.091693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:58.091694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:58.092024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 587
2025-10-02T09:29:58.092331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.092340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.092362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:58.092371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.092377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.092378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:58.092386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.092397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:58.092415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.092642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.092650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.092664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.092789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 36 sessionId: src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0
2025-10-02T09:29:58.093158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed3275-633840a9-e74d92c2-53c2d580_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:58.095445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Write session: try to update token
2025-10-02T09:29:58.095458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:58.102105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:58.102121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.102122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:58.102124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:58.102129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.102132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.102135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554286097253052:5220]
2025-10-02T09:29:58.102162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:58.102167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.102168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:58.102174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:58.102185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:58.102188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:58.102301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:58.106884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:58.110404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:58.167124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554286172775664:5499]
2025-10-02T09:29:58.167307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7556554286172775664:5499]
2025-10-02T09:29:58.241554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:58.242071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.242088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.242128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775664:5499], now have 1 active actors on pipe
2025-10-02T09:29:58.242355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554286172775664:5499]
2025-10-02T09:29:58.242358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:58.242365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:58.242369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:58.242383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:58.242425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: error at write: Disconnected sessionId: src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0
2025-10-02T09:29:58.242570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0 is DEAD
2025-10-02T09:29:58.242682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:58.242692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Write session will restart in 0.006805s
2025-10-02T09:29:58.242712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Write session: Do CDS request
2025-10-02T09:29:58.242718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:58.250306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.250409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:58.250425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-10-02T09:29:58.250634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.250666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:58.250675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:58.250679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:58.251063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-10-02T09:29:58.251097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:58.251104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:58.251106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:58.251111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554286172775719:6011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:58.251820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554286172775719:6011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:58.254413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554286172775719:6011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:58.257362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554286172775719:6011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:58.257380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554286172775719:6011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:58.257384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554286172775719:6011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:58.257391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:58.257835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:58.260962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:58.261174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:58.261183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:58.261194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:58.261246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:58.261289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554286097253264:5235]
2025-10-02T09:29:58.261910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:58.262250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:58.262291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:58.262603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:58.262668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.262673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.262674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.262676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.262677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.262678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.262679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.262681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.262682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.262683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.262684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.262686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.262690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.262702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.262707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.262711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.262715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.262719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.262723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.262727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.262731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.262735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.262739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.262742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.262749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.262756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.262762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.262767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.262772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.262777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.262783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.262788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.262793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.262798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.262805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.262809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.262814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.262819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.262822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.262827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.262831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.262836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.262840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.262844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.262853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.262858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.262862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.262867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.262903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:58.271622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:58.273438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:58.273452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:58.273456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:58.273460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:58.273466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [2:7556554286097253264:5235]
2025-10-02T09:29:58.273481Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:58.273497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:58.273503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.273507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.273509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.273522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:58.273531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:58.273538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:58.273593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.273604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.273606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.273610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:58.273612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:58.273668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:58.273676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.273688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.273704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.273725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:58.273748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775848:6011], now have 1 active actors on pipe
2025-10-02T09:29:58.273756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775690:2446], now have 1 active actors on pipe
2025-10-02T09:29:58.273761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.273763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.273765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.273782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:58.273798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:58.273802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:58.273805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:58.273808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:58.273816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:58.273823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:58.273814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 588
2025-10-02T09:29:58.273820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 588
2025-10-02T09:29:58.273855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.273865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:58.273866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:58.273882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.273889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.273931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:58.273940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.273943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.273945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:58.273953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.273965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:58.273988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.274097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.274109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.274120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.274196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0
2025-10-02T09:29:58.274518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27584e2-b73d2a68-dbf6d0a4-76472c1d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:58.277028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Write session: try to update token
2025-10-02T09:29:58.277041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:58.285465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:58.285485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.285488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:58.285490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:58.285498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.285502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.285505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554286097253259:5235]
2025-10-02T09:29:58.285545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:58.285551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.285553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:58.285559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:58.285566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:58.285570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:58.286712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:58.294017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:58.296587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:58.342746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554286172775861:5499]
2025-10-02T09:29:58.345064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7556554286172775861:5499]
2025-10-02T09:29:58.425129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:58.425406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.425415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.425442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775861:5499], now have 1 active actors on pipe
2025-10-02T09:29:58.425671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:58.425705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:58.425714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554286172775861:5499]
2025-10-02T09:29:58.425722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:58.425741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:58.425789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0
2025-10-02T09:29:58.425952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0 is DEAD
2025-10-02T09:29:58.426122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:58.426129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Write session will restart in 0.005983s
2025-10-02T09:29:58.426155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Write session: Do CDS request
2025-10-02T09:29:58.426159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:58.433186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.433235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:58.433254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-10-02T09:29:58.433402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.433429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:58.433438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:58.433443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:58.433913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-10-02T09:29:58.433947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:58.433953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:58.433954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:58.433958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554286172775979:6015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:58.434315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554286172775979:6015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:58.434972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:58.435780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554286172775979:6015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:58.437011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:58.437178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:58.437188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:58.437198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:58.437254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:58.437288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554286097253429:5237]
2025-10-02T09:29:58.437711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:58.437934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554286172775979:6015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:58.437947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554286172775979:6015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:58.437950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554286172775979:6015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:58.437955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:58.437943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:58.437971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:58.438161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:58.438198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.438203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.438204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.438204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.438205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.438205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.438206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.438206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.438207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.438208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.438208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.438209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.438212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.438218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.438220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.438222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.438224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.438226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.438228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.438230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.438233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.438235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.438237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.438239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.438242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.438247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.438252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.438257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.438265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.438270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.438277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.438282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.438290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.438298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.438306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.438314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.438321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.438325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.438329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.438334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.438343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.438348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.438355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.438359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.438367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.438373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.438375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.438378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.438402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:58.446470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:58.448173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:58.448192Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:58.448194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:58.448197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:58.448202Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [2:7556554286097253429:5237]
2025-10-02T09:29:58.448215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:58.448234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:58.448241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.448244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.448245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.448258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:58.448267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:58.448274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:58.448328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.448334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.448336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.448338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:58.448340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:58.448395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:58.448403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.448415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.448425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.448439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:58.448460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172775863:2446], now have 1 active actors on pipe
2025-10-02T09:29:58.448467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776027:6015], now have 1 active actors on pipe
2025-10-02T09:29:58.448473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.448476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.448478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.448490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:58.448502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:58.448506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:58.448508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:58.448509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:58.448519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:58.448522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:58.448531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 589
2025-10-02T09:29:58.448553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 589
2025-10-02T09:29:58.448544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.448556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:58.448558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:58.448578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.448581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.448610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:58.448618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.448626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.448628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:58.448637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.448646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:58.448660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.448817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.448825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.448838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.448930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0
2025-10-02T09:29:58.449286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b796eec-141d4f9d-df9e1d3b-62ae2cb4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:58.451458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Write session: try to update token
2025-10-02T09:29:58.451469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:58.458982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:58.458999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.459000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:58.459001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:58.459007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.459011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.459013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554286097253424:5237]
2025-10-02T09:29:58.459052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:58.459056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.459057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:58.459070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:58.459074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:58.459077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:58.459180Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:58.462708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:58.465032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:58.525490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554286172776038:5499]
2025-10-02T09:29:58.525787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7556554286172776038:5499]
2025-10-02T09:29:58.587926Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:58.588137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.588148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.588177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776038:5499], now have 1 active actors on pipe
2025-10-02T09:29:58.588314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:58.588371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:58.588387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:58.588442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554286172776038:5499]
2025-10-02T09:29:58.588458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0
2025-10-02T09:29:58.588635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0 is DEAD
2025-10-02T09:29:58.588776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:58.588786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Write session will restart in 0.008151s
2025-10-02T09:29:58.588822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Write session: Do CDS request
2025-10-02T09:29:58.588828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:58.598180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.598329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:58.598343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-10-02T09:29:58.598515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.598542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:58.598549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:58.598553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:58.598602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:58.598940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-10-02T09:29:58.598985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:58.598990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:58.598991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:58.598996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554286172776180:6020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:58.599491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554286172776180:6020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:58.600916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:58.601054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:58.601061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:58.601067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:58.601101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:58.601230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554286097253610:5240]
2025-10-02T09:29:58.601622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:58.601665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554286172776180:6020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:58.601857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:58.601885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:58.602105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:58.602143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.602147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.602148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.602148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.602149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.602150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.602150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.602151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.602152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.602152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.602153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.602153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.602156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.602163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.602165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.602167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.602170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.602172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.602174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.602176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.602178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.602180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.602182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.602184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.602188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.602192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.602196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.602199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.602201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.602204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.602206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.602209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.602211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.602214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.602218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.602222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.602227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.602232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.602236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.602240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.602245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.602249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.602253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.602256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.602261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.602265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.602269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.602273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.602300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:58.607500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554286172776180:6020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:58.607514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554286172776180:6020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:58.607517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554286172776180:6020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:58.607524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:58.610138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:58.611575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:58.611584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:58.611585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:58.611587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:58.611591Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [2:7556554286097253610:5240]
2025-10-02T09:29:58.611599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:58.611611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:58.611613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.611615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.611616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.611626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:58.611629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:58.611633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:58.611668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.611674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.611675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.611677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:58.611679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:58.611717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:58.611722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.611728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.611733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.611747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:58.611759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.611761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.611762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.611769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:58.611776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:58.611781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:58.611784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:58.611785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:58.611786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:58.611787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:58.611795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776219:6020], now have 1 active actors on pipe
2025-10-02T09:29:58.611802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776051:2446], now have 1 active actors on pipe
2025-10-02T09:29:58.611822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.611832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:58.611850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:58.611898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 590
2025-10-02T09:29:58.611902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 590
2025-10-02T09:29:58.611959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.611965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.611980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:58.611987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.611989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.611990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:58.611997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.612006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:58.612016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.612176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.612182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.612192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.612281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0
2025-10-02T09:29:58.612635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea50159-3036340a-9d0e2cec-cd330a15_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:58.615119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Write session: try to update token
2025-10-02T09:29:58.615132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:58.627229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:58.627927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:58.627943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.627949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.627985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:58.628001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:58.628147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:58.628280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.628409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.628541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.628789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:58.628876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:58.629789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:58.630041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.630054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.630912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:58.630922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.630923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:58.630925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:58.630930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.630933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.630937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554286097253604:5240]
2025-10-02T09:29:58.630957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:58.630969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:58.630968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:58.630973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:58.630975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.630976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:58.630977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:58.631069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:58.631087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:58.688850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554286172776227:5499]
2025-10-02T09:29:58.689143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7556554286172776227:5499]
2025-10-02T09:29:58.759682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:58.765849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.765866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.765999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.766055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.766108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.766163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.766452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.766462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.766513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.766562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.766612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.766664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.766701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.766706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.766755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.766801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.766852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.766902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.767009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.767014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.767083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.767147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.767196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.767246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.767285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.767290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.767343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.767392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.767443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.767495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.767530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.767535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.767589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.767638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.767690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.767738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.767846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.767853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.767907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.767952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.768004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.768053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.768090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.768095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.768144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.768191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.768237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.768284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.768339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.768343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.768392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.768446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.768498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.768548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.768583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.768589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.768636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:58.768680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:58.768727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:58.768776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:58.768828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:58.768833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:58.768862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776227:5499], now have 1 active actors on pipe
2025-10-02T09:29:58.769067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:58.769068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:58.769082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:58.769105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: error at write: Disconnected sessionId: src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0
2025-10-02T09:29:58.769143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:58.769128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554286172776227:5499]
2025-10-02T09:29:58.769244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0 is DEAD
2025-10-02T09:29:58.769393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:58.769405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Write session will restart in 0.005260s
2025-10-02T09:29:58.769421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Write session: Do CDS request
2025-10-02T09:29:58.769426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:58.775252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.775355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:58.775373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-10-02T09:29:58.775551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.775583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:58.775593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:58.775601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:58.775927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-10-02T09:29:58.775962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:58.775968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:58.775969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:58.775973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554286172776261:6025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:58.776344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554286172776261:6025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:58.779483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554286172776261:6025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:58.780406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:58.782302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:58.782433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:58.782440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:58.782446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:58.782479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:58.782502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554286097253779:5242]
2025-10-02T09:29:58.782576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554286172776261:6025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:58.782589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554286172776261:6025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:58.782593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554286172776261:6025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:58.782599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:58.782886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:58.783131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:58.783158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:58.783353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:58.783389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.783393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.783394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.783395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.783395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.783396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.783396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.783397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.783398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.783398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.783399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.783399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.783402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.783409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.783411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.783413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.783415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.783417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.783419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.783421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.783423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.783426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.783428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.783430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.783433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.783439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.783444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.783453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.783457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.783461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.783465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.783470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.783479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.783488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.783496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.783503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.783506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.783512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.783514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.783517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.783523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.783526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.783532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.783535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.783538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.783541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.783546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.783549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.783569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:58.791464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:58.793038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:58.793049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:58.793051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:58.793059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:58.793063Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [2:7556554286097253779:5242]
2025-10-02T09:29:58.793074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:58.793087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:58.793092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.793093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.793094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.793105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:58.793111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:58.793116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:58.793170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.793176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.793178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.793181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:58.793183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:58.793244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:58.793252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.793263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.793274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.793293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:58.793313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.793319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.793320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.793327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:58.793340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:58.793343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:58.793353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:58.793355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:58.793356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:58.793359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:58.793367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776399:6025], now have 1 active actors on pipe
2025-10-02T09:29:58.793370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776234:2446], now have 1 active actors on pipe
2025-10-02T09:29:58.793395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.793404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:58.793416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 591
2025-10-02T09:29:58.793432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:58.793418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 591
2025-10-02T09:29:58.793499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.793507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.793523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47898f18-c681895f-9981cff0-93695a9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:58.793529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.793532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.793533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:58.793539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.793545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:58.793559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.793688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.793693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.793701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.793770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 36 sessionId: src_id|47898f18-c681895f-9981cff0-93695a9c_0
2025-10-02T09:29:58.794085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd541fc0-1c9859bc-efbfd9da-c19f6864_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47898f18-c681895f-9981cff0-93695a9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:58.796362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Write session: try to update token
2025-10-02T09:29:58.796374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:58.803174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:58.803191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.803199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.803242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:58.803246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:58.803408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:58.803542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.803678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.803820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.804028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:58.804062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:58.808573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|47898f18-c681895f-9981cff0-93695a9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:58.811313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:58.812104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.812121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.812135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:58.812137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.812138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:58.812140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:58.812145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.812147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.812150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554286097253773:5242]
2025-10-02T09:29:58.812181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:58.812185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.812187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:58.812192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:58.812199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:58.812203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:58.812302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:58.869077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554286172776414:5499]
2025-10-02T09:29:58.869391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7556554286172776414:5499]
2025-10-02T09:29:58.950144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:58.950584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:58.950611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776414:5499], now have 1 active actors on pipe
2025-10-02T09:29:58.950784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:58.950903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:58.950911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:58.950991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: error at write: Disconnected sessionId: src_id|47898f18-c681895f-9981cff0-93695a9c_0
2025-10-02T09:29:58.951152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|47898f18-c681895f-9981cff0-93695a9c_0 is DEAD
2025-10-02T09:29:58.951313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:58.951326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Write session will restart in 0.007801s
2025-10-02T09:29:58.951346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Write session: Do CDS request
2025-10-02T09:29:58.951352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:58.951342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554286172776414:5499]
2025-10-02T09:29:58.951359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:58.960287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.960400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:58.960420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-10-02T09:29:58.960536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:58.960567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:58.960576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:58.960579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:58.961254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-10-02T09:29:58.961289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:58.961294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:58.961296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:58.961301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554286172776468:6029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:58.961812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554286172776468:6029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:58.964727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554286172776468:6029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:58.965920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:58.968684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:58.968947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:58.968960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:58.968972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:58.969037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:58.969088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554286097253951:5245]
2025-10-02T09:29:58.969070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554286172776468:6029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:58.969092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554286172776468:6029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:58.969096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554286172776468:6029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:58.969106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:58.969747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:58.970104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:58.970156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:58.970426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:58.970482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.970488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.970489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.970489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.970491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.970492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.970492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.970493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.970494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.970495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.970496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.970497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.970501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.970508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.970510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.970513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.970515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.970518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.970520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.970523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.970525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.970530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.970533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.970537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.970544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.970552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:58.970560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.970564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:58.970567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.970570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:58.970573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.970578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:58.970580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.970584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:58.970586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.970589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:58.970592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.970595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:58.970599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.970602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:58.970605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.970608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:58.970610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.970613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.970616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.970619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.970621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.970625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.970645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:58.979514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:58.981640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:58.981658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:58.981661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:58.981664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:58.981670Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [2:7556554286097253951:5245]
2025-10-02T09:29:58.981684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:58.981701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:58.981708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.981711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.981713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.981730Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:58.981741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:58.981747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:58.981802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.981809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.981811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.981816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:58.981818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:58.981872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:58.981877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:58.981887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:58.981896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:58.981905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:58.981923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:58.981929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:58.981931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:58.981938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:58.981951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:58.981959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:58.981964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:58.981966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:58.981968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:58.981970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:58.981979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776419:2446], now have 1 active actors on pipe
2025-10-02T09:29:58.982016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554286172776582:6029], now have 1 active actors on pipe
2025-10-02T09:29:58.982022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:58.982031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:58.982047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:58.982119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 592
2025-10-02T09:29:58.982133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 592
2025-10-02T09:29:58.982193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.982201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.982223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:58.982235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:58.982242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:58.982243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:58.982251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:58.982262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:58.982281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.982501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:58.982510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:58.982525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:58.982631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 36 sessionId: src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0
2025-10-02T09:29:58.982997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47898f18-c681895f-9981cff0-93695a9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:58.985364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Write session: try to update token
2025-10-02T09:29:58.985376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:58.993496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:58.993518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:58.993525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:58.993572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:58.993766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:58.993919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.994064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.994208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:58.994407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:58.994456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:58.996860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:58.998169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:59.001064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:59.001269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.001286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.001317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:59.001431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:59.003716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:59.003729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.003731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:59.003733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:59.003740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:59.003745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:59.003749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554286097253946:5245]
2025-10-02T09:29:59.003776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:59.003786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.003788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:59.003791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:59.003797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:59.003801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:59.003902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:59.051348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554290467743889:5499]
2025-10-02T09:29:59.051701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7556554290467743889:5499]
2025-10-02T09:29:59.142378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:59.148859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.148884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.149035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.149089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.149141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.149199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.149242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.149256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.149323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.149379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.149432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.149625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.149668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.149673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.149731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.149781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.149834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.149883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.149926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.149931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.149990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.150050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.150103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.150157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.150194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.150202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.150259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.150312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.150362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.150420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.150461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.150466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.150529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.150583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.150636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.150688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.150730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.150738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.150791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.150841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.150930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.150985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.151043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.151051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.151107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.151155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.151206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.151256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.151293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.151298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.151350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.151401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.151456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.151508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.151559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.151567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.151619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.151669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.151721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.151774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.151816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.151821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.151858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467743889:5499], now have 1 active actors on pipe
2025-10-02T09:29:59.152093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:59.152117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554290467743889:5499]
2025-10-02T09:29:59.152227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:59.152237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:59.152263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: error at write: Disconnected sessionId: src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0
2025-10-02T09:29:59.152432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0 is DEAD
2025-10-02T09:29:59.152460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:59.152575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:59.152584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Write session will restart in 0.005868s
2025-10-02T09:29:59.152604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Write session: Do CDS request
2025-10-02T09:29:59.152610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:59.159237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.159295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:59.159311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-10-02T09:29:59.159413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.159444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:59.159452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:59.159456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:59.159945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-10-02T09:29:59.159977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:59.159983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:59.159984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:59.159988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554290467743922:6034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:59.160475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554290467743922:6034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:59.163150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554290467743922:6034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:59.165288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:59.165692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554290467743922:6034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:59.165714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554290467743922:6034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:59.165718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554290467743922:6034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:59.165727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:59.167811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:59.167943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:59.167951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:59.167959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:59.167998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:59.168026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554290392221421:5248]
2025-10-02T09:29:59.168508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:59.168747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:59.168785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:59.169101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:59.169166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.169171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.169172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.169173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.169174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.169175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.169177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.169178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.169179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.169180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.169180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.169181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.169184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.169191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.169193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.169195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.169197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.169200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.169202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.169204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.169206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.169208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.169211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.169213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.169217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.169221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.169224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.169228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.169231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.169240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.169244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.169248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.169252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.169256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.169264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.169272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.169275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.169282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.169291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.169300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.169305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.169309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.169315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.169319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.169324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.169327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.169329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.169332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.169355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:59.177833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:59.179664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:59.179681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:59.179684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:59.179688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:59.179694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [2:7556554290392221421:5248]
2025-10-02T09:29:59.179707Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:59.179725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:59.179733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.179736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.179738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.179752Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:59.179762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:59.179770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:59.179827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.179834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.179836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.179840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:59.179842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:59.179902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:59.179911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.179924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.179936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.179954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:59.179979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467743894:2446], now have 1 active actors on pipe
2025-10-02T09:29:59.179992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744060:6034], now have 1 active actors on pipe
2025-10-02T09:29:59.179998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.180001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.180003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.180014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:59.180029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:59.180049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:59.180053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:59.180057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:59.180058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:59.180060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:59.180088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.180057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 593
2025-10-02T09:29:59.180091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:59.180058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 593
2025-10-02T09:29:59.180100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:59.180119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.180123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.180152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:59.180162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.180166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.180168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:59.180178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.180190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:59.180215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.180406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.180415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.180428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.180536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0
2025-10-02T09:29:59.180916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef97de6-f81c0223-7ff9bd2b-7016eecb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:59.183448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Write session: try to update token
2025-10-02T09:29:59.183463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:59.190916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:59.190934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.190936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:59.190937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:59.190943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.190947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.190949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554290392221415:5248]
2025-10-02T09:29:59.190978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:59.190978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:59.190982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.190983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:59.190984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:59.190985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:59.191136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:59.196345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:59.199749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:59.252008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554290467744085:5499]
2025-10-02T09:29:59.252207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7556554290467744085:5499]
2025-10-02T09:29:59.334382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:59.334683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.334696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.334712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744085:5499], now have 1 active actors on pipe
2025-10-02T09:29:59.334924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:59.334964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:59.334973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554290467744085:5499]
2025-10-02T09:29:59.334993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:59.335070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0
2025-10-02T09:29:59.335244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0 is DEAD
2025-10-02T09:29:59.335365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:59.335376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Write session will restart in 0.008820s
2025-10-02T09:29:59.335404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Write session: Do CDS request
2025-10-02T09:29:59.335410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:59.345273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.345379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:59.345399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-10-02T09:29:59.345508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.345538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:59.345547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:59.345550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:59.345995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-10-02T09:29:59.346036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:59.346042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:59.346044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:59.346050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554290467744177:6045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:59.346553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554290467744177:6045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:59.349041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554290467744177:6045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:59.349949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:59.350473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:59.350649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:59.350658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:59.350668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:59.350718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:59.350761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554290392221628:5262]
2025-10-02T09:29:59.351369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:59.352602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:59.352654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:59.352977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:59.353039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.353045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.353046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.353048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.353048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.353049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.353050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.353052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.353053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.353054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.353055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.353056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.353061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.353071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.353075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.353078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.353082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.353085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.353089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.353092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.353096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.353100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.353103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.353107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.353113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.353119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.353125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.353129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.353133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.353137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.353141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.353146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.353151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.353156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.353159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.353171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.353176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.353185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.353190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.353199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.353203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.353208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.353216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.353221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.353226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.353231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.353235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.353240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.353278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:59.353265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554290467744177:6045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:59.353279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554290467744177:6045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:59.353282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554290467744177:6045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:59.353289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:59.362105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:59.363821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:59.363835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:59.363838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:59.363841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:59.363848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [2:7556554290392221628:5262]
2025-10-02T09:29:59.363861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:59.363878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:59.363880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.363883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.363885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.363901Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:59.363905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:59.363912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:59.363968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.363982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.363984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.363987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:59.363989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:59.364056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:59.364064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.364076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.364085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.364097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:59.364116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.364123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.364125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.364137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:59.364153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744266:6045], now have 1 active actors on pipe
2025-10-02T09:29:59.364160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:59.364163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744097:2446], now have 1 active actors on pipe
2025-10-02T09:29:59.364166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:59.364168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:59.364169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:59.364180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:59.364183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:59.364213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.364227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:59.364235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:59.364297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 594
2025-10-02T09:29:59.364311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 594
2025-10-02T09:29:59.364379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.364388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.364413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb403c80-174428fb-63205e97-5189a631_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:59.364422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.364426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.364428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:59.364437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.364446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:59.364464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.364678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.364684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.364696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.364839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb403c80-174428fb-63205e97-5189a631_0
2025-10-02T09:29:59.365236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4cedd6f-469a8faf-a8f6df89-122ac7e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb403c80-174428fb-63205e97-5189a631_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:59.367743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Write session: try to update token
2025-10-02T09:29:59.367757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:59.377979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:29:59.377996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.378005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.378054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:29:59.378067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:29:59.378243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:29:59.378400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:59.378551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:59.378697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:29:59.378921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:29:59.378971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:29:59.381710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|eb403c80-174428fb-63205e97-5189a631_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:59.384182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:59.384365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.384382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.384411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:29:59.384476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:59.387993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:59.388012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.388015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:59.388017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:59.388024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.388028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.388031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554290392221623:5262]
2025-10-02T09:29:59.388067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:59.388073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.388074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:59.388080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:59.388084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:59.388088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:59.388215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:59.435333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554290467744276:5499]
2025-10-02T09:29:59.435637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7556554290467744276:5499]
2025-10-02T09:29:59.531502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:59.545725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.545752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.545899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.545966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.546035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.546101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.546152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.546168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.546236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.546295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.546360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.546600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.546721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.546729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.546922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.547195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.547263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.547477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.547529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.547536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.547744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.548261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.548475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.548538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.548580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.548587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.548648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.548703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.548757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.548824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.548869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.548877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.548938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.548992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.549045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.549101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.549143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.549148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.549201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.549398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.549598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.549654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.549692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.549697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.549763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.549828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.549890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.549955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.549994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.550000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.550062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.550120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.550174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.550226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.550264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.550269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.550323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:29:59.550375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:29:59.550424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:29:59.550479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:29:59.550524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:29:59.550531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:29:59.550586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744276:5499], now have 1 active actors on pipe
2025-10-02T09:29:59.551104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:59.551178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554290467744276:5499]
2025-10-02T09:29:59.551272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:59.551288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:59.551317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: error at write: Disconnected sessionId: src_id|eb403c80-174428fb-63205e97-5189a631_0
2025-10-02T09:29:59.551349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:59.551636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|eb403c80-174428fb-63205e97-5189a631_0 is DEAD
2025-10-02T09:29:59.551702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:59.551713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Write session will restart in 0.007052s
2025-10-02T09:29:59.551734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Write session: Do CDS request
2025-10-02T09:29:59.551740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:59.560296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.560428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:59.560447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-10-02T09:29:59.560627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.560658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:59.560667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:59.560671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:59.561216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-10-02T09:29:59.561254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:59.561258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:59.561260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:59.561266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554290467744347:6050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:59.561757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554290467744347:6050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:59.563975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554290467744347:6050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:59.565213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:59.568243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:59.568456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:59.568466Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:59.568477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:59.568528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:59.568570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554290392221814:5265]
2025-10-02T09:29:59.568557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554290467744347:6050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:59.568573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554290467744347:6050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:59.568578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554290467744347:6050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:59.568586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:59.569143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:59.569407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:59.569453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:59.569688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:59.569725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.569731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.569732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.569732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.569733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.569734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.569734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.569735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.569736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.569737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.569737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.569738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.569742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.569750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.569753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.569755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.569757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.569759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.569761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.569764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.569766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.569768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.569771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.569773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.569777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.569782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.569786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.569790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.569792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.569795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.569798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.569801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.569804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.569807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.569809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.569812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.569815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.569818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.569820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.569823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.569826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.569829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.569832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.569835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.569838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.569841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.569843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.569846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.569863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:59.578327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:59.580423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:59.580441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:59.580444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:59.580447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:59.580454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [2:7556554290392221814:5265]
2025-10-02T09:29:59.580471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:59.580491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:59.580498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.580501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.580502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.580519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:59.580528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:59.580534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:59.580593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.580600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.580602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.580605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:59.580607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:59.580682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:59.580691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.580706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.580716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.580737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:59.580762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744460:6050], now have 1 active actors on pipe
2025-10-02T09:29:59.580771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744291:2446], now have 1 active actors on pipe
2025-10-02T09:29:59.580779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.580787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.580789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.580817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:59.580833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:59.580838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:59.580845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:59.580847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:59.580853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:59.580857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:59.580866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 595
2025-10-02T09:29:59.580894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.580902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 595
2025-10-02T09:29:59.580905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:59.580908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:59.580925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.580931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.580980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:59.580993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.580998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.581000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:59.581010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.581020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:59.581048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.581169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.581179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.581193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.581282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 36 sessionId: src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0
2025-10-02T09:29:59.581704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb403c80-174428fb-63205e97-5189a631_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:59.584122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Write session: try to update token
2025-10-02T09:29:59.584136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:59.591564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:59.591583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.591585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:59.591587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:59.591596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.591601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.591605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554290392221809:5265]
2025-10-02T09:29:59.591641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:59.591647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.591650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:59.591660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:59.591666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:59.591672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:59.591803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:59.601988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:59.604638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:59.651423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554290467744472:5499]
2025-10-02T09:29:59.651732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7556554290467744472:5499]
2025-10-02T09:29:59.733442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:59.734083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.734091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.734108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744472:5499], now have 1 active actors on pipe
2025-10-02T09:29:59.734343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:59.734880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:29:59.734891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Write session will restart in 0.007915s
2025-10-02T09:29:59.734916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Write session: Do CDS request
2025-10-02T09:29:59.734923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:59.734348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554290467744472:5499]
2025-10-02T09:29:59.734371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:29:59.734376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:29:59.734384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:59.734468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: error at write: Disconnected sessionId: src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0
2025-10-02T09:29:59.734655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0 is DEAD
2025-10-02T09:29:59.744323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.744451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:59.744478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-10-02T09:29:59.744671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.744711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:59.744718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:59.744723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:59.745293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-10-02T09:29:59.745341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:59.745343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:59.745345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:59.745352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554290467744526:6054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:59.745960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554290467744526:6054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:59.748619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554290467744526:6054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:59.750193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:59.752821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:59.752991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:59.752998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:59.753006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:59.753052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:59.753092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554290392221989:5267]
2025-10-02T09:29:59.753191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554290467744526:6054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:59.753211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554290467744526:6054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:59.753214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554290467744526:6054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:59.753220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:59.753602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:59.753960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:59.754004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:59.754231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:59.754279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.754284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.754285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.754286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.754287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.754288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.754289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.754290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.754291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.754292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.754293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.754295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.754299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.754310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.754314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.754318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.754322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.754326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.754330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.754333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.754337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.754341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.754345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.754349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.754355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.754362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.754368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.754374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.754378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.754384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.754392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.754397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.754403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.754408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.754412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.754417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.754425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.754429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.754433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.754438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.754442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.754447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.754454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.754459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.754467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.754471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.754476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.754481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.754516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:59.762700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:59.764262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:59.764282Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:59.764285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:59.764289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:59.764295Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [2:7556554290392221989:5267]
2025-10-02T09:29:59.764311Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:59.764331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:59.764334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.764337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.764340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.764354Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:59.764362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:59.764370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:59.764424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.764430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.764432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.764435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:59.764437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:59.764498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:59.764503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.764516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.764527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.764543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:59.764566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744478:2446], now have 1 active actors on pipe
2025-10-02T09:29:59.764573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744651:6054], now have 1 active actors on pipe
2025-10-02T09:29:59.764579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.764581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.764584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.764595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:59.764610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:59.764610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:59.764614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:59.764616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:59.764627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:59.764631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:59.764606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 596
2025-10-02T09:29:59.764629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 596
2025-10-02T09:29:59.764670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.764679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:59.764689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:59.764693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.764697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.764733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba2880a1-759d2763-15874fa3-b992d774_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:59.764744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.764747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.764749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:59.764760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.764771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:59.764794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.764946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.764957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.764978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.765044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba2880a1-759d2763-15874fa3-b992d774_0
2025-10-02T09:29:59.765378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85ade50-d6469cd6-5331ff28-f1bf594f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba2880a1-759d2763-15874fa3-b992d774_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:59.767835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Write session: try to update token
2025-10-02T09:29:59.767851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:59.776709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:59.776733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.776736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:59.776738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:59.776745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.776750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.776753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554290392221983:5267]
2025-10-02T09:29:59.776790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:59.776797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.776814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:59.776815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:59.776822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:59.776826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:59.776976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:59.786369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|ba2880a1-759d2763-15874fa3-b992d774_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:59.788752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:29:59.834705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554290467744671:5499]
2025-10-02T09:29:59.835005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7556554290467744671:5499]
2025-10-02T09:29:59.919635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:29:59.919994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.920017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.920038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744671:5499], now have 1 active actors on pipe
2025-10-02T09:29:59.920249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:29:59.920342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554290467744671:5499]
2025-10-02T09:29:59.920359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:29:59.920382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:29:59.920433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba2880a1-759d2763-15874fa3-b992d774_0
2025-10-02T09:29:59.920753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:29:59.920764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Write session will restart in 0.006681s
2025-10-02T09:29:59.920786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Write session: Do CDS request
2025-10-02T09:29:59.920793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:29:59.920607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|ba2880a1-759d2763-15874fa3-b992d774_0 is DEAD
2025-10-02T09:29:59.928401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.928518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:29:59.928542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-10-02T09:29:59.928688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:29:59.928718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:29:59.928728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:29:59.928732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:29:59.929343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-10-02T09:29:59.929384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:29:59.929391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:29:59.929393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:29:59.929398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554290467744711:6059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:29:59.929901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554290467744711:6059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:29:59.932553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554290467744711:6059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:29:59.935219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554290467744711:6059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:29:59.935234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554290467744711:6059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:29:59.935238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554290467744711:6059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:29:59.935246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:29:59.935272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:29:59.937688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:29:59.937868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:29:59.937876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:29:59.937884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:29:59.937931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:29:59.937969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554290392222168:5270]
2025-10-02T09:29:59.938574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:29:59.938883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:29:59.938933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:29:59.939255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:29:59.939310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.939315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.939317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.939317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.939319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.939320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.939321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.939322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.939323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.939324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.939325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.939326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.939331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.939342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.939346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.939349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.939353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.939356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.939360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.939364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.939368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.939371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.939375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.939378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.939384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.939391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:29:59.939397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.939402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:29:59.939406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.939415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:29:59.939420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.939429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:29:59.939434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.939443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:29:59.939447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.939456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:29:59.939461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.939466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:29:59.939474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.939479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:29:59.939483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.939488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:29:59.939492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.939497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.939501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.939507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.939511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.939519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.939555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:29:59.948581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:29:59.950871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 597
2025-10-02T09:29:59.950883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 597
2025-10-02T09:29:59.950209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:29:59.950227Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:29:59.950230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:29:59.950233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:29:59.950240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [2:7556554290392222168:5270]
2025-10-02T09:29:59.950256Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:29:59.950273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:29:59.950276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.950279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.950282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.950295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:29:59.950300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:29:59.950307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:29:59.950363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.950365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.950367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.950371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:29:59.950373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:29:59.950437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:29:59.950440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.950452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:29:59.950463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:29:59.950479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:29:59.950495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.950497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.950499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.950514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:29:59.950527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:29:59.950541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:29:59.950543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:29:59.950571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.950574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:29:59.950715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:29:59.950719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:29:59.950720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:29:59.950725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:29:59.950880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744843:6059], now have 1 active actors on pipe
2025-10-02T09:29:59.950885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554290467744673:2446], now have 1 active actors on pipe
2025-10-02T09:29:59.951043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.951047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.951069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:29:59.951075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:29:59.951078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:29:59.951080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:29:59.951090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:29:59.951100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:29:59.951112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.951378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:29:59.951381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:29:59.951395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:29:59.951519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0
2025-10-02T09:29:59.951981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2880a1-759d2763-15874fa3-b992d774_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:29:59.954913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Write session: try to update token
2025-10-02T09:29:59.954931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:29:59.961653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:29:59.961675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:29:59.961677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:29:59.961679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:29:59.961687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.961691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.961695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554290392222162:5270]
2025-10-02T09:29:59.961730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:29:59.961734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:29:59.961736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:29:59.961739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:29:59.961739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:29:59.961743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:29:59.961865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:29:59.972979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:29:59.975390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:00.020548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554294762712152:5499]
2025-10-02T09:30:00.020859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7556554294762712152:5499]
2025-10-02T09:30:00.098243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:00.098586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.098597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.098611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712152:5499], now have 1 active actors on pipe
2025-10-02T09:30:00.098774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:00.098819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:00.098859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:00.098879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554294762712152:5499]
2025-10-02T09:30:00.098919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0
2025-10-02T09:30:00.099082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0 is DEAD
2025-10-02T09:30:00.099241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:00.099250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Write session will restart in 0.009980s
2025-10-02T09:30:00.099266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Write session: Do CDS request
2025-10-02T09:30:00.099271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:00.109747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:00.110212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.110323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:00.110345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-10-02T09:30:00.110481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.110507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:00.110517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:00.110521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:00.110896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-10-02T09:30:00.110933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:00.110938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:00.110940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:00.110945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554294762712294:6065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:00.111425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554294762712294:6065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:00.112068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:00.112218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:00.112225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:00.112232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:00.112266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:00.112302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554294687189641:5274]
2025-10-02T09:30:00.112714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:00.112938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:00.112977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:00.113255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:00.113320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.113327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.113327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.113328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.113329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.113330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.113331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.113332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.113333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.113334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.113335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.113336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.113340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.113348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.113352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.113355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.113358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.113361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.113364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.113367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.113371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.113375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.113378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.113381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.113370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554294762712294:6065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:00.113386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.113393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.113398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.113402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.113406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.113410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.113413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.113418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.113422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.113426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.113430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.113434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.113440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.113444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.113448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.113452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.113456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.113460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.113463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.113468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.113472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.113475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.113479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.113483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.113514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:00.119589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554294762712294:6065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:00.119611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554294762712294:6065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:00.119614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554294762712294:6065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:00.119625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:00.122570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:00.124063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:00.124079Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:00.124081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:00.124084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:00.124089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [2:7556554294687189641:5274]
2025-10-02T09:30:00.124099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:00.124111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:00.124113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.124115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.124116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.124127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:00.124130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:00.124135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:00.124180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.124185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.124187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.124189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:00.124191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:00.124245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:00.124254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.124262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.124269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.124277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:00.124289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.124294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.124296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.124302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:00.124311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:00.124313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712332:6065], now have 1 active actors on pipe
2025-10-02T09:30:00.124318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:00.124323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:00.124325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:00.124326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:00.124328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:00.124333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712156:2446], now have 1 active actors on pipe
2025-10-02T09:30:00.124357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.124365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:00.124375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:00.124423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 598
2025-10-02T09:30:00.124444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 598
2025-10-02T09:30:00.124500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.124510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.124535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:00.124546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.124555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.124557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:00.124566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.124583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:00.124597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.124796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.124818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.124832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.124939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0
2025-10-02T09:30:00.125291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb228783-101ba87e-9ccd5fb0-ae4d7b93_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:00.127883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Write session: try to update token
2025-10-02T09:30:00.127896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:00.141496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:00.141517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.141525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.141562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:00.141567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:00.141731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:00.141814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:00.141956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.142121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.142293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.142578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:00.142625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:00.144142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:00.144657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.144671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.144683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:00.144685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.144689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:00.144691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:00.144695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.144698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.144700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554294687189635:5274]
2025-10-02T09:30:00.144724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:00.144729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:00.144732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:00.144734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.144734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:00.144735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:00.144866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:00.199203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554294762712347:5499]
2025-10-02T09:30:00.199389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7556554294762712347:5499]
2025-10-02T09:30:00.278105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:00.278573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:00.278612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712347:5499], now have 1 active actors on pipe
2025-10-02T09:30:00.278784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:00.278871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:00.278879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:00.278947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: error at write: Disconnected sessionId: src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0
2025-10-02T09:30:00.279233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:00.279245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Write session will restart in 0.008312s
2025-10-02T09:30:00.279269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Write session: Do CDS request
2025-10-02T09:30:00.279275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:00.279095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0 is DEAD
2025-10-02T09:30:00.279230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554294762712347:5499]
2025-10-02T09:30:00.279244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:00.288308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.288426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:00.288443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-10-02T09:30:00.288709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.288739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:00.288747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:00.288751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:00.289268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-10-02T09:30:00.289301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:00.289307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:00.289308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:00.289313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554294762712467:6076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:00.289772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554294762712467:6076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:00.291791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554294762712467:6076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:00.292176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:00.294313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:00.294455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554294762712467:6076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:00.294471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554294762712467:6076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:00.294475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554294762712467:6076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:00.294481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:00.294504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:00.294513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:00.294522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:00.294570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:00.294604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554294687189851:5283]
2025-10-02T09:30:00.295230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:00.295580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:00.295634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:00.295948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:00.296019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.296025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.296026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.296027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.296028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.296030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.296031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.296032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.296033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.296034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.296035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.296036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.296042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.296052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.296056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.296060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.296064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.296067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.296070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.296074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.296077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.296082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.296085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.296089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.296095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.296102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.296108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.296113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.296119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.296129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.296133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.296138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.296142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.296152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.296156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.296160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.296169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.296174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.296178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.296183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.296192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.296197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.296205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.296210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.296215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.296224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.296228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.296234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.296274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:00.305446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:00.307094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:00.307109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:00.307111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:00.307113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:00.307117Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [2:7556554294687189851:5283]
2025-10-02T09:30:00.307126Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:00.307138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:00.307141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.307142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.307143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.307154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:00.307158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:00.307163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:00.307203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.307208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.307209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.307211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:00.307213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:00.307269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:00.307278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.307289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.307300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.307315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:00.307334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712534:6076], now have 1 active actors on pipe
2025-10-02T09:30:00.307343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712352:2446], now have 1 active actors on pipe
2025-10-02T09:30:00.307349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.307351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.307353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.307365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:00.307377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:00.307384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:00.307387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:00.307390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:00.307394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:00.307397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:00.307427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.307444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:00.307458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:00.307466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 599
2025-10-02T09:30:00.307505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 599
2025-10-02T09:30:00.307565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.307572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.307589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:00.307600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.307605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.307611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:00.307620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.307633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:00.307653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.307803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.307811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.307823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.307903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0
2025-10-02T09:30:00.308173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2bea2d-88d06b65-6bcb44ce-bfad8118_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:00.310482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Write session: try to update token
2025-10-02T09:30:00.310495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:00.318994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:00.319018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.319025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.319085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:00.319085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:00.319302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:00.319459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.319604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.319782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.319993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:00.320037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:00.324001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:00.326446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:00.326936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.326954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.326985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:00.327088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:00.329502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:00.329518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.329520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:00.329522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:00.329532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.329535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.329540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554294687189844:5283]
2025-10-02T09:30:00.329572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:00.329577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.329579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:00.329582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:00.329597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:00.329601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:00.329704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:00.379465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554294762712555:5499]
2025-10-02T09:30:00.379814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7556554294762712555:5499]
2025-10-02T09:30:00.471529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:00.478918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.478945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.479118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.479183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.479252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.479314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.479358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.479366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.479434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.479493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.479556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.479615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.479665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.479672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.479735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.479804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.479887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.479950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.479993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.480000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.480085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.480151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.480214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.480277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.480321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.480328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.480392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.480456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.480523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.480582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.480624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.480631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.480694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.480755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.480834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.480898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.480944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.480950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.481010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.481091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.481172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.481259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.481303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.481310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.481408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.481502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.481567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.481631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.481678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.481685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.481744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.481803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.481863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.481925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.481966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.481976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.482035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:00.482089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:00.482166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:00.482240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:00.482295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:00.482302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:00.482356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712555:5499], now have 1 active actors on pipe
2025-10-02T09:30:00.482627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:00.482636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:00.482638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554294762712555:5499]
2025-10-02T09:30:00.482666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:00.482669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:00.482705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: error at write: Disconnected sessionId: src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0
2025-10-02T09:30:00.482909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0 is DEAD
2025-10-02T09:30:00.483058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:00.483067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Write session will restart in 0.006169s
2025-10-02T09:30:00.483083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Write session: Do CDS request
2025-10-02T09:30:00.483087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:00.490227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.490338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:00.490360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-10-02T09:30:00.490537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.490574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:00.490587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:00.490592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:00.490991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-10-02T09:30:00.491039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:00.491045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:00.491047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:00.491052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554294762712637:6081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:00.491460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554294762712637:6081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:00.493414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:00.494073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554294762712637:6081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:00.495302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:00.495475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:00.495488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:00.495498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:00.495557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:00.495596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554294687190049:5291]
2025-10-02T09:30:00.496117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:00.496384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:00.496428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:00.496709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:00.496765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.496770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.496771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.496772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.496773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.496774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.496775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.496776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.496777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.496778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.496779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.496780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.496784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.496781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554294762712637:6081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:00.496793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.496793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554294762712637:6081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:00.496796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.496797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554294762712637:6081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:00.496815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.496818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:00.496818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.496822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.496826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.496829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.496832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.496836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.496839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.496843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.496848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.496854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.496858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.496862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.496867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.496872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.496876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.496881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.496885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.496890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.496893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.496897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.496901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.496905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.496914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.496918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.496922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.496927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.496935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.496940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.496948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.496953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.496956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.496961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.496993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:00.505819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:00.507479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:00.507500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:00.507503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:00.507507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:00.507513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [2:7556554294687190049:5291]
2025-10-02T09:30:00.507528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:00.507545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:00.507549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.507552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.507554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.507570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:00.507575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:00.507590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:00.507659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.507668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.507670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.507674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:00.507676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:00.507936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 600
2025-10-02T09:30:00.507981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 600
2025-10-02T09:30:00.508016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:00.508028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.508043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.508057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.508075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:00.508097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712558:2446], now have 1 active actors on pipe
2025-10-02T09:30:00.508101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712734:6081], now have 1 active actors on pipe
2025-10-02T09:30:00.508118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.508122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.508140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.508148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.508150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.508163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:00.508177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:00.508181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:00.508183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:00.508186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:00.508200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:00.508203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:00.508219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:00.508230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.508233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.508235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:00.508245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.508259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:00.508302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.508315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:00.508332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.508340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:00.508521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.508533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.508550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.508700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0
2025-10-02T09:30:00.509116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f540b6-c3ac17d5-5d3b54f5-9ec193c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:00.511666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Write session: try to update token
2025-10-02T09:30:00.511685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:00.519118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:00.519136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.519146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.519185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:00.519189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:00.519355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:00.519498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.519633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.519768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:00.519987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:00.520030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:00.526566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:00.528885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:00.528904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.528907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:00.528908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:00.528917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.528921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.528925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554294687190043:5291]
2025-10-02T09:30:00.528959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:00.528966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:00.528970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.528971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:00.528972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:00.528976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:00.529105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:00.529341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:00.582733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554294762712755:5499]
2025-10-02T09:30:00.583058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7556554294762712755:5499]
2025-10-02T09:30:00.675762Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:00.676228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.676244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.676262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712755:5499], now have 1 active actors on pipe
2025-10-02T09:30:00.676494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:00.676514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:00.676538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554294762712755:5499]
2025-10-02T09:30:00.676583Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:30:00.676673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:00.676766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0
2025-10-02T09:30:00.676851Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_5282540975378770401_v1 is DEAD
2025-10-02T09:30:00.676997Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:30:00.677051Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:00.677056Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:00.677068Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005652s
2025-10-02T09:30:00.676964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0 is DEAD
2025-10-02T09:30:00.677179Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554217453286758:5494] disconnected; active server actors: 1
2025-10-02T09:30:00.677192Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554217453286758:5494] client user disconnected session shared/user_1_6_5282540975378770401_v1
2025-10-02T09:30:00.680394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:00.680406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Write session will restart in 0.009872s
2025-10-02T09:30:00.680429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Write session: Do CDS request
2025-10-02T09:30:00.680436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:00.683171Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:30:00.683381Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:30:00.683394Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-10-02T09:30:00.683579Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:00.683630Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:00.683726Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 auth for : user
2025-10-02T09:30:00.683915Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 Handle describe topics response
2025-10-02T09:30:00.683948Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 auth is DEAD
2025-10-02T09:30:00.683953Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:30:00.684196Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:30:00.684280Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_7_9436659019505251152_v1
2025-10-02T09:30:00.684277Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554294762712768:6086] connected; active server actors: 1
2025-10-02T09:30:00.684291Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554294762712768:6086] session shared/user_1_7_9436659019505251152_v1
2025-10-02T09:30:00.684298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:30:00.684307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:30:00.684313Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_9436659019505251152_v1" (Sender=[1:7556554294762712764:6086], Pipe=[1:7556554294762712768:6086], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:00.684317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:30:00.684326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:30:00.684339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_9436659019505251152_v1" (Sender=[1:7556554294762712764:6086], Pipe=[1:7556554294762712768:6086], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:00.684354Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_9436659019505251152_v1" sender [1:7556554294762712764:6086] lock partition 0 for ReadingSession "shared/user_1_7_9436659019505251152_v1" (Sender=[1:7556554294762712764:6086], Pipe=[1:7556554294762712768:6086], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-10-02T09:30:00.684364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:30:00.684372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000038s
2025-10-02T09:30:00.684579Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_9436659019505251152_v1" ClientId: "user" PipeClient { RawX1: 7556554294762712768 RawX2: 4503603922343878 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:30:00.684605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:30:00.691412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.691502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:00.691517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-10-02T09:30:00.691638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.691695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:00.691706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:00.691711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:00.692285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-10-02T09:30:00.692319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:00.692327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:00.692329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:00.692334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554294762712862:6090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:00.692797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554294762712862:6090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:00.695122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554294762712862:6090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:00.695345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:00.698432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:00.698769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:00.698781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:00.698792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:00.698849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:00.698886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554294687190230:5294]
2025-10-02T09:30:00.698776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554294762712862:6090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:00.698790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554294762712862:6090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:00.698794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554294762712862:6090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:00.698801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:00.699466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:00.699778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:00.699846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:00.700163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:00.700218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.700224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.700225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.700226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.700227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.700228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.700229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.700231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.700232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.700233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.700234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.700235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.700240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.700250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.700254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.700258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.700262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.700266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.700270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.700274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.700277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.700281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.700284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.700287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.700292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.700296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.700300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.700312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.700323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.700328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.700336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.700341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.700345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.700351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.700359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.700364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.700369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.700377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.700381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.700387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.700391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.700396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.700399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.700408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.700413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.700418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.700426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.700431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.700472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:00.712752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:00.714668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:00.714684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:00.714686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:00.714690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:00.714696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [2:7556554294687190230:5294]
2025-10-02T09:30:00.714708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:00.714726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:00.714729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.714732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.714734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.714749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:00.714753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:00.714759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:00.714819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.714825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.714827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.714829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:00.714831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:00.714890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:00.714899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.714912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.714921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.714934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:00.714954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.714959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.714961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.714968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:00.714979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712940:6090], now have 1 active actors on pipe
2025-10-02T09:30:00.714979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:00.714984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:00.714984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712758:2446], now have 1 active actors on pipe
2025-10-02T09:30:00.714986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:00.714989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:00.715001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:00.715008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:00.715013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712772:6089], now have 1 active actors on pipe
2025-10-02T09:30:00.715057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.715068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:00.715075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:00.715303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.715312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.715326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.715328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.715333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_9436659019505251152_v1 on pipe: [1:7556554294762712772:6089]
2025-10-02T09:30:00.715358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:00.715368Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_9436659019505251152_v1:1 with generation 601
2025-10-02T09:30:00.715369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.715374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.715376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:00.715384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.715392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:00.715401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.715404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.715406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:00.715417Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_9436659019505251152_v1
2025-10-02T09:30:00.715429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.715451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.715466Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:30:00.715586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.715593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.715604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.715990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8feaec1-ef99086-44cddf1d-8c1520be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:00.715102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 601
2025-10-02T09:30:00.715117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7556554294762712772:6089]
2025-10-02T09:30:00.715142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 601
2025-10-02T09:30:00.715678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 36 sessionId: src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0
2025-10-02T09:30:00.718625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Write session: try to update token
2025-10-02T09:30:00.718646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:00.719669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:30:00.719713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:30:00.719730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.719738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.719740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.719751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:30:00.719784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:30:00.719922Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397400715 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:30:00.719944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:30:00.719977Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 sending to client partition status
2025-10-02T09:30:00.727225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:00.727247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.727249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:00.727251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:00.727259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.727264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.727267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554294687190225:5294]
2025-10-02T09:30:00.727301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:00.727309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.727311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:00.727534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:00.729156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:00.729177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:00.729184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:00.735726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:00.738385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:00.874948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:00.874037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:00.874339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.874346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.874705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_9436659019505251152_v1
2025-10-02T09:30:00.874989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:00.875038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554294762712772:6089]
2025-10-02T09:30:00.875086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0
2025-10-02T09:30:00.874716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:00.875099Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_9436659019505251152_v1
2025-10-02T09:30:00.875272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0 is DEAD
2025-10-02T09:30:00.875477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:00.875489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Write session will restart in 0.005052s
2025-10-02T09:30:00.875519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Write session: Do CDS request
2025-10-02T09:30:00.875527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:00.881266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.881488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:00.881511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-10-02T09:30:00.881683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:00.881733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:00.881744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:00.881750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:00.883419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-10-02T09:30:00.883464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:00.883474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:00.883476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:00.883482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554294762712971:6095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:00.884098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554294762712971:6095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:00.886251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554294762712971:6095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:00.889375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554294762712971:6095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:00.889391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554294762712971:6095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:00.889396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554294762712971:6095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:00.889406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:00.895512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:00.899250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:00.899533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:00.899538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:00.899552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:00.899619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:00.899665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554294687190415:5297]
2025-10-02T09:30:00.900242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:00.900738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:00.900821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:00.901142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:00.901211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.901221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.901222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.901223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.901225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.901226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.901228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.901229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.901231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.901232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.901233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.901235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.901241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.901254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.901259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.901263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.901268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.901273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.901277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.901281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.901285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.901289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.901291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.901296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.901303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.901309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:00.901314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.901317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:00.901320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.901323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:00.901327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.901331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:00.901334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.901338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:00.901341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.901344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:00.901348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.901351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:00.901354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.901360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:00.901363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.901367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:00.901370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.901373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.901376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.901379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.901382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.901385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.901406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:00.915774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:00.917784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:00.917803Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:00.917806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:00.917809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:00.917816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [2:7556554294687190415:5297]
2025-10-02T09:30:00.917830Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:00.917850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:00.917852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.917855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.917856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.917873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:00.917878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:00.917886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:00.917945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.917952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.917954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.917958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:00.917960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:00.918030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:00.918039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.918053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:00.918064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:00.918199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 602
2025-10-02T09:30:00.918078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:00.918096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762713033:6095], now have 1 active actors on pipe
2025-10-02T09:30:00.918247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 602
2025-10-02T09:30:00.918099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762712962:2446], now have 1 active actors on pipe
2025-10-02T09:30:00.918105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.918108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.918110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.918121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:00.918131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:00.918133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:00.918136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:00.918136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:00.918149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:00.918152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:00.918187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.918192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:00.918197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:00.918365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.918373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.918398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4688330-d9792411-863ab34f-b56586b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:00.918404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:00.918408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:00.918410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:00.918418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:00.918427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:00.918440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.918604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:00.918610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:00.918621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:00.918726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4688330-d9792411-863ab34f-b56586b0_0
2025-10-02T09:30:00.920981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94cab33c-1d0f41d1-15ac5531-f0355845_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4688330-d9792411-863ab34f-b56586b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:00.923735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Write session: try to update token
2025-10-02T09:30:00.923755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:00.929606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:00.929628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:00.929630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:00.929632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:00.929640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.929645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.929648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554294687190410:5297]
2025-10-02T09:30:00.929686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:00.929693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:00.929695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:00.929835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:00.932830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:00.932847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:00.932852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:00.940795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|c4688330-d9792411-863ab34f-b56586b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:00.943333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:00.974889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554294762713150:6089]
2025-10-02T09:30:00.975221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7556554294762713150:6089]
2025-10-02T09:30:01.070446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:01.070732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.070744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.070760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554294762713150:6089], now have 1 active actors on pipe
2025-10-02T09:30:01.070965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:01.071057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:01.071060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:01.071073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:01.071120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554294762713150:6089]
2025-10-02T09:30:01.071136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|c4688330-d9792411-863ab34f-b56586b0_0
2025-10-02T09:30:01.071295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|c4688330-d9792411-863ab34f-b56586b0_0 is DEAD
2025-10-02T09:30:01.071482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:01.071496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Write session will restart in 0.007101s
2025-10-02T09:30:01.071527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Write session: Do CDS request
2025-10-02T09:30:01.071533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:01.080272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.080429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:01.080451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-10-02T09:30:01.080632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.080684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:01.080694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:01.080698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:01.081169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-10-02T09:30:01.081210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:01.081211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:01.081213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:01.081216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554299057680486:6099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:01.081562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554299057680486:6099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:01.083914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554299057680486:6099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:01.086325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554299057680486:6099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:01.086338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554299057680486:6099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:01.086342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554299057680486:6099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:01.086348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:01.086448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:01.088671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:01.088848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:01.088857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:01.088864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:01.088903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:01.088937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554298982157892:5299]
2025-10-02T09:30:01.089357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:01.089631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:01.089668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:01.089970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:01.090047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.090053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.090053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.090054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.090055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.090056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.090056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.090057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.090058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.090059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.090060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.090060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.090064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.090071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.090074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.090076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.090079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.090081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.090083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.090085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.090088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.090091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.090093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.090095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.090100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.090104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.090109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.090112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.090114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.090118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.090120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.090123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.090127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.090130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.090133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.090136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.090138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.090141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.090143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.090146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.090149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.090152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.090154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.090157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.090161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.090163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.090170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.090172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.090190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:01.098706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:01.100489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:01.100507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:01.100509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:01.100513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:01.100518Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [2:7556554298982157892:5299]
2025-10-02T09:30:01.100530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:01.100548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:01.100555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.100557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.100559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.100574Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:01.100579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:01.100586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:01.100635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.100643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.100644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.100648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:01.100650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:01.100701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:01.100707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.100716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.100722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.100731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:01.100743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.100752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.100753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.100759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:01.100772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680448:2446], now have 1 active actors on pipe
2025-10-02T09:30:01.100773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:01.100776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:01.100777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:01.100778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:01.100785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:01.100787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:01.100790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680623:6099], now have 1 active actors on pipe
2025-10-02T09:30:01.100832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.100843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:01.100849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:01.100875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 603
2025-10-02T09:30:01.100920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 603
2025-10-02T09:30:01.100949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.100955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.100970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:01.100977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.100980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.100982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:01.100988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.100996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:01.101010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.101163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.101170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.101181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.101282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 36 sessionId: src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0
2025-10-02T09:30:01.101628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4688330-d9792411-863ab34f-b56586b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:01.104125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Write session: try to update token
2025-10-02T09:30:01.104143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:01.111331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:01.111351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.111353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:01.111355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:01.111363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.111369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.111373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554298982157886:5299]
2025-10-02T09:30:01.111410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:01.111411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:01.111416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:01.111417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.111418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:01.111420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:01.111567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:01.117493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:01.120171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:01.171532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554299057680639:6089]
2025-10-02T09:30:01.171885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7556554299057680639:6089]
2025-10-02T09:30:01.238721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:01.239085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.239095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.239108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680639:6089], now have 1 active actors on pipe
2025-10-02T09:30:01.239344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:01.239381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:01.239406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554299057680639:6089]
2025-10-02T09:30:01.239429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:01.239507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0
2025-10-02T09:30:01.239675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0 is DEAD
2025-10-02T09:30:01.239830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:01.239838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Write session will restart in 0.007740s
2025-10-02T09:30:01.239856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Write session: Do CDS request
2025-10-02T09:30:01.239861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:01.248209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.248328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:01.248344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-10-02T09:30:01.248455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.248482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:01.248491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:01.248495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:01.248918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-10-02T09:30:01.248948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:01.248954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:01.248955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:01.248960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554299057680738:6104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:01.249448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554299057680738:6104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:01.251162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554299057680738:6104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:01.251482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:01.253426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:01.253656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:01.253664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:01.253673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:01.253712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:01.253739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554298982158075:5302]
2025-10-02T09:30:01.253779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554299057680738:6104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:01.253792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554299057680738:6104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:01.253795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554299057680738:6104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:01.253801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:01.254097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:01.254328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:01.254353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:01.254538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:01.254568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.254572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.254572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.254573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.254574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.254574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.254575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.254575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.254576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.254576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.254577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.254578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.254581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.254587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.254589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.254592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.254593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.254595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.254597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.254599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.254601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.254603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.254605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.254607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.254612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.254616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.254619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.254623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.254625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.254627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.254629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.254632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.254634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.254637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.254639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.254642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.254644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.254647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.254649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.254651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.254654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.254658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.254660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.254666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.254668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.254671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.254676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.254678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.254698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:01.262651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:01.264131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:01.264147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:01.264149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:01.264152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:01.264158Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [2:7556554298982158075:5302]
2025-10-02T09:30:01.264169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:01.264184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:01.264187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.264190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.264192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.264204Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:01.264212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:01.264218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:01.264268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.264276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.264278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.264281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:01.264283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:01.264338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:01.264344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.264356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.264369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.264389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:01.264411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680818:6104], now have 1 active actors on pipe
2025-10-02T09:30:01.264418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680640:2446], now have 1 active actors on pipe
2025-10-02T09:30:01.264423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.264425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.264427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.264440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:01.264454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:01.264458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:01.264462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:01.264464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:01.264471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:01.264473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:01.264496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.264503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:01.264475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 604
2025-10-02T09:30:01.264475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 604
2025-10-02T09:30:01.264522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:01.264529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.264532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.264558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94f412cf-313e0a17-65387a11-97127358_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:01.264569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.264575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.264577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:01.264585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.264596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:01.264613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.264747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.264755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.264767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.264861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 36 sessionId: src_id|94f412cf-313e0a17-65387a11-97127358_0
2025-10-02T09:30:01.265204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef06cb4-8a7ac7ea-e375a72b-bc879b6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94f412cf-313e0a17-65387a11-97127358_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:01.267726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Write session: try to update token
2025-10-02T09:30:01.267740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:01.275465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:01.275484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.275490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:01.275491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:01.275497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.275500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.275504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554298982158070:5302]
2025-10-02T09:30:01.275531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:01.275535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.275537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:01.275550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:01.275556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:01.275560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:01.275687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:01.280555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|94f412cf-313e0a17-65387a11-97127358_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:01.283064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:01.339444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554299057680843:6089]
2025-10-02T09:30:01.339696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7556554299057680843:6089]
2025-10-02T09:30:01.406042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:01.406434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.406447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.406481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680843:6089], now have 1 active actors on pipe
2025-10-02T09:30:01.406694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:01.406731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:01.406745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:01.406747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:01.406788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554299057680843:6089]
2025-10-02T09:30:01.406804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|94f412cf-313e0a17-65387a11-97127358_0
2025-10-02T09:30:01.406968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|94f412cf-313e0a17-65387a11-97127358_0 is DEAD
2025-10-02T09:30:01.407125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:01.407137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Write session will restart in 0.007514s
2025-10-02T09:30:01.407161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Write session: Do CDS request
2025-10-02T09:30:01.407167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:01.416329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.416471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:01.416491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-10-02T09:30:01.416611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.416643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:01.416648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:01.416653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:01.417128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-10-02T09:30:01.417163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:01.417170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:01.417171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:01.417176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554299057680914:6115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:01.417638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554299057680914:6115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:01.420132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554299057680914:6115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:01.421221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:01.424160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:01.424322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554299057680914:6115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:01.424337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554299057680914:6115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:01.424346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:01.424340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554299057680914:6115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:01.424364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:01.424359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:01.424370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:01.424425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:01.424465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554298982158294:5316]
2025-10-02T09:30:01.425020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:01.425360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:01.425413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:01.425684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:01.425734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.425739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.425740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.425741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.425742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.425743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.425744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.425745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.425746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.425747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.425748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.425748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.425753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.425763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.425766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.425769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.425772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.425776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.425779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.425782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.425785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.425788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.425792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.425795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.425802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.425808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.425812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.425816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.425820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.425824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.425828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.425831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.425835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.425838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.425842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.425846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.425849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.425853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.425856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.425860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.425864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.425868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.425871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.425875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.425879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.425884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.425888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.425891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.425920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:01.435519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:01.437338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:01.437353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:01.437355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:01.437358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:01.437365Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [2:7556554298982158294:5316]
2025-10-02T09:30:01.437379Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:01.437396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:01.437399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.437402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.437404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.437418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:01.437422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:01.437429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:01.437497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.437503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.437504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.437506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:01.437508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:01.437569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:01.437576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.437589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.437606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.437622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:01.437640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057680853:2446], now have 1 active actors on pipe
2025-10-02T09:30:01.437649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681033:6115], now have 1 active actors on pipe
2025-10-02T09:30:01.437654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.437657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.437659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.437672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:01.437686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:01.437688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:01.437695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:01.437697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:01.437702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:01.437704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:01.437735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.437745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:01.437751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:01.437776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 605
2025-10-02T09:30:01.437784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 605
2025-10-02T09:30:01.437939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.437949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.437970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:01.437980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.437983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.437988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:01.437995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.438008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:01.438024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.438195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.438207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.438224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.438338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 36 sessionId: src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0
2025-10-02T09:30:01.438675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f412cf-313e0a17-65387a11-97127358_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:01.441267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Write session: try to update token
2025-10-02T09:30:01.441285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:01.449026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:01.449045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.449054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.449102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:01.449118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:01.449272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:01.449426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.449566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.449730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.449932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:01.449979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:01.455053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:01.457380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:01.457718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.457753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.457798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:01.457915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:01.459775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:01.459792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.459795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:01.459797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:01.459808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.459812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.459818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554298982158289:5316]
2025-10-02T09:30:01.459857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:01.459865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:01.459868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.459871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:01.459872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:01.459877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:01.460031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:01.506875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554299057681048:6089]
2025-10-02T09:30:01.507165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7556554299057681048:6089]
2025-10-02T09:30:01.605271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:01.612358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.612387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.612547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.612612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.612674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.612736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.612784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.612792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.612877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.612939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.612999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.613061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.613102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.613109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.613178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.613238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.613304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.613367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.613421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.613425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.613492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.613551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.613619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.613678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.613736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.613740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.613812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.613891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.613960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.614093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.614173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.614183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.614251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.614312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.614380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.614452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.614508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.614516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.614602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.614691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.614756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.614817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.614896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.614907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.614974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.615050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.615113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.615194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.615235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.615238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.615300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.615351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.615415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.615476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.615530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.615543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.615609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:01.615671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:01.615733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:01.615799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:01.615846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:01.615856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:01.615911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681048:6089], now have 1 active actors on pipe
2025-10-02T09:30:01.616200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:01.616318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:01.616327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:01.616348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554299057681048:6089]
2025-10-02T09:30:01.616354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: error at write: Disconnected sessionId: src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0
2025-10-02T09:30:01.616512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0 is DEAD
2025-10-02T09:30:01.616655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:01.616669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Write session will restart in 0.009780s
2025-10-02T09:30:01.616695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Write session: Do CDS request
2025-10-02T09:30:01.616701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:01.616710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:01.627338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.627404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:01.627422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-10-02T09:30:01.627573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.627604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:01.627614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:01.627618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:01.628012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-10-02T09:30:01.628051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:01.628057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:01.628059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:01.628064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554299057681078:6122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:01.628591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554299057681078:6122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:01.631518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554299057681078:6122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:01.634870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554299057681078:6122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:01.634891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554299057681078:6122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:01.634894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554299057681078:6122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:01.634901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:01.637519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:01.639965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:01.640144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:01.640155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:01.640164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:01.640211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:01.640249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554298982158492:5319]
2025-10-02T09:30:01.640837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:01.641118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:01.641169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:01.641475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:01.641542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.641548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.641549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.641550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.641551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.641552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.641554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.641555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.641556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.641558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.641559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.641560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.641565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.641576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.641580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.641583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.641587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.641591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.641594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.641598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.641602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.641606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.641609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.641613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.641621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.641628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.641633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.641638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.641643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.641647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.641657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.641662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.641671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.641676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.641680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.641688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.641693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.641697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.641701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.641706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.641711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.641716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.641721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.641726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.641735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.641742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.641750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.641755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.641794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:01.650782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:01.652656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:01.652678Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:01.652680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:01.652684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:01.652691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [2:7556554298982158492:5319]
2025-10-02T09:30:01.652705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:01.652721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:01.652724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.652727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.652729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.652743Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:01.652748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:01.652755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:01.652824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.652834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.652836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.652839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:01.652841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:01.652911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:01.652922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.652935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.652947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.652964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:01.652986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681211:6122], now have 1 active actors on pipe
2025-10-02T09:30:01.652990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681063:2446], now have 1 active actors on pipe
2025-10-02T09:30:01.652996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.652999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.653001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.653015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:01.653033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:01.653038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:01.653046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:01.653048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:01.653052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:01.653060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:01.653081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 606
2025-10-02T09:30:01.653099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 606
2025-10-02T09:30:01.653091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.653096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:01.653123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:01.653132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.653137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.653164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:01.653175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.653179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.653185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:01.653194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.653207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:01.653224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.653435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.653443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.653456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.653556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0
2025-10-02T09:30:01.653947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f389cf7b-66219d2d-ba4b5aec-1e2a1640_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:01.656578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Write session: try to update token
2025-10-02T09:30:01.656596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:01.664094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:01.664117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.664126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.664171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:01.664360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:01.664518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.664674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.664855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.665227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:01.665277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:01.666923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:01.671922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:01.674080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:01.674101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.674104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:01.674106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:01.674114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.674117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.674121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554298982158487:5319]
2025-10-02T09:30:01.674158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:01.674165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.674167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:01.674309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:01.674801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:01.674942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:01.674962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:01.674966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:01.716343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554299057681255:6089]
2025-10-02T09:30:01.716751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7556554299057681255:6089]
2025-10-02T09:30:01.818337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:01.818716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.818728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.818746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681255:6089], now have 1 active actors on pipe
2025-10-02T09:30:01.818930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:01.819022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:01.819059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:01.819060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:01.819119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554299057681255:6089]
2025-10-02T09:30:01.819151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: error at write: Disconnected sessionId: src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0
2025-10-02T09:30:01.819346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0 is DEAD
2025-10-02T09:30:01.819500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:01.819512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Write session will restart in 0.008929s
2025-10-02T09:30:01.819536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Write session: Do CDS request
2025-10-02T09:30:01.819543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:01.829314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.829478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:01.829502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-10-02T09:30:01.829706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:01.829744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:01.829758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:01.829764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:01.830300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-10-02T09:30:01.830349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:01.830358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:01.830361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:01.830368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554299057681358:6127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:01.830970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554299057681358:6127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:01.833505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554299057681358:6127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:01.833848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:01.836335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:01.836483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:01.836492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:01.836498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:01.836531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:01.836575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554298982158677:5321]
2025-10-02T09:30:01.836585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554299057681358:6127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:01.836605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554299057681358:6127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:01.836609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554299057681358:6127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:01.836620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:01.837045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:01.837376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:01.837432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:01.837786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:01.837841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.837846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.837848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.837849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.837850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.837851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.837852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.837853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.837854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.837855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.837856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.837857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.837862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.837873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.837877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.837880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.837885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.837889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.837893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.837897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.837901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.837905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.837909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.837913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.837920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.837927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:01.837933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.837944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:01.837951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.837957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:01.837965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.837970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:01.837978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.837984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:01.837992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.837997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:01.838005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.838011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:01.838018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.838024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:01.838031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.838036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:01.838045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.838054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.838059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.838067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.838072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.838080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.838116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:01.846586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:01.848133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:01.848151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:01.848153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:01.848157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:01.848164Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [2:7556554298982158677:5321]
2025-10-02T09:30:01.848180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:01.848199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:01.848202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.848204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.848207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.848224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:01.848234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:01.848241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:01.848301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.848308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.848310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.848313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:01.848314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:01.848377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:01.848384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.848397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:01.848408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:01.848429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:01.848450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681449:6127], now have 1 active actors on pipe
2025-10-02T09:30:01.848458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681268:2446], now have 1 active actors on pipe
2025-10-02T09:30:01.848462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.848464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.848465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.848474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:01.848484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:01.848496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:01.848499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:01.848502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:01.848506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:01.848509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:01.848528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.848534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:01.848552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:01.848527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 607
2025-10-02T09:30:01.848587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 607
2025-10-02T09:30:01.848678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.848691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.848715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:01.848727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:01.848732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:01.848738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:01.848749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:01.848758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:01.848779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.849018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.849030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.849050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:01.849137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0
2025-10-02T09:30:01.849470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf774cae-b20494e6-85d65551-3ec3d64a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:01.852024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Write session: try to update token
2025-10-02T09:30:01.852039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:01.860046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:01.860063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.860071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.860109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:01.860132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:01.860353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:01.860488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.860644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.860838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:01.861037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:01.861075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:01.865383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:01.867741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:01.868202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:01.868222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:01.868252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:01.868372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:01.869492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:01.869500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:01.869502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:01.869503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:01.869509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.869512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.869514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554298982158672:5321]
2025-10-02T09:30:01.869541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:01.869546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:01.869547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:01.869577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:01.869583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:01.869587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:01.869703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:01.919559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554299057681460:6089]
2025-10-02T09:30:01.919829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7556554299057681460:6089]
2025-10-02T09:30:02.007404Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:02.013833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.013854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.013986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.014039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.014090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.014144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.014189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.014196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.014251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.014301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.014354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.014406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.014444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.014449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.014502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.014550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.014606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.014656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.014694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.014699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.014752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.014804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.014859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.014914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.014955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.014960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.015018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.015084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.015137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.015188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.015231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.015236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.015290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.015340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.015395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.015447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.015492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.015497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.015550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.015601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.015653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.015704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.015743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.015747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.015804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.015853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.015906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.015958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.016018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.016026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.016092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.016154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.016209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.016260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.016313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.016318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.016375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:02.016426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:02.016476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:02.016528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:02.016567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:02.016572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:02.016608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554299057681460:6089], now have 1 active actors on pipe
2025-10-02T09:30:02.016913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:02.016928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:02.016955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: error at write: Disconnected sessionId: src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0
2025-10-02T09:30:02.017108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0 is DEAD
2025-10-02T09:30:02.017195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554299057681460:6089]
2025-10-02T09:30:02.017234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:02.017255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:02.017264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Write session will restart in 0.008541s
2025-10-02T09:30:02.017287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Write session: Do CDS request
2025-10-02T09:30:02.017291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:02.017449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:02.027286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.027347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:02.027364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-10-02T09:30:02.027493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.027521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:02.027531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:02.027533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:02.027906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-10-02T09:30:02.027928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:02.027933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:02.027934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:02.027938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554303352648887:6131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:02.028312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554303352648887:6131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:02.029659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:02.030753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554303352648887:6131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:02.032487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:02.032643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:02.032650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:02.032656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:02.032697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:02.032727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554303277126162:5324]
2025-10-02T09:30:02.033142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:02.033271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554303352648887:6131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:02.033285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554303352648887:6131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:02.033288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554303352648887:6131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:02.033296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:02.033429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:02.033477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:02.033732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:02.033784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.033790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.033791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.033792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.033793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.033794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.033795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.033796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.033797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.033799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.033800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.033801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.033806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.033818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.033822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.033827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.033831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.033836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.033840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.033844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.033848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.033853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.033857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.033861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.033871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.033879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.033888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.033893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.033898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.033903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.033907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.033912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.033918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.033924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.033929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.033935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.033940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.033946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.033951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.033960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.033964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.033970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.033979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.033984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.033989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.033994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.033999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.034005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.034036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:02.043177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:02.045047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:02.045067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:02.045070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:02.045073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:02.045079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [2:7556554303277126162:5324]
2025-10-02T09:30:02.045092Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:02.045109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:02.045112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.045116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.045118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.045131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:02.045136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:02.045142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:02.045202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.045211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.045213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.045216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:02.045218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:02.045285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:02.045292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.045305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.045315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.045336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:02.045354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352648759:2446], now have 1 active actors on pipe
2025-10-02T09:30:02.045357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352648943:6131], now have 1 active actors on pipe
2025-10-02T09:30:02.045363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.045365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.045367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.045380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:02.045396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:02.045410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:02.045415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:02.045415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:02.045417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:02.045418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:02.045455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.045468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:02.045451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 608
2025-10-02T09:30:02.045495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 608
2025-10-02T09:30:02.045485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:02.045501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.045505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.045526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:02.045532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.045537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.045539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:02.045551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.045565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:02.045585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.045743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.045755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.045776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.045849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0
2025-10-02T09:30:02.046202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e679a88-6c7289cb-7bd7ce46-33ecc9a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:02.048763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Write session: try to update token
2025-10-02T09:30:02.048779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:02.057198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:02.057216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.057224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.057273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:02.057286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:02.057442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:02.057587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.057734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.057907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.058154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:02.058199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:02.063942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:02.066437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:02.066671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:02.066690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.066693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:02.066694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:02.066703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.066707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.066711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554303277126156:5324]
2025-10-02T09:30:02.066751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:02.066755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.066756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:02.066760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:02.066761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.066778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:02.066783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.066785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:02.066904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:02.117189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554303352648952:6089]
2025-10-02T09:30:02.117464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7556554303352648952:6089]
2025-10-02T09:30:02.198138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:02.198542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352648952:6089], now have 1 active actors on pipe
2025-10-02T09:30:02.198701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:02.198741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:02.198758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:02.198818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: error at write: Disconnected sessionId: src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0
2025-10-02T09:30:02.198850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554303352648952:6089]
2025-10-02T09:30:02.198899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:02.198986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0 is DEAD
2025-10-02T09:30:02.199138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:02.199149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Write session will restart in 0.009529s
2025-10-02T09:30:02.199170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Write session: Do CDS request
2025-10-02T09:30:02.199175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:02.210229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.210334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:02.210352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-10-02T09:30:02.210494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.210521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:02.210532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:02.210535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:02.210895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-10-02T09:30:02.210923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:02.210931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:02.210933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:02.210938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554303352649104:6136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:02.211406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554303352649104:6136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:02.211410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:02.213177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554303352649104:6136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:02.213575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:02.213697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:02.213704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:02.213710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:02.213740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:02.213767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554303277126351:5327]
2025-10-02T09:30:02.214124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:02.214312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:02.214336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:02.214527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:02.214564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.214568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.214568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.214569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.214569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.214570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.214571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.214571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.214572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.214572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.214573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.214573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.214576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.214582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.214585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.214587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.214589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.214591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.214593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.214595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.214597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.214600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.214602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.214604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.214607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.214611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.214615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.214618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.214621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.214625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.214627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.214630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.214632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.214635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.214637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.214639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.214642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.214645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.214647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.214649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.214651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.214654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.214656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.214659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.214661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.214664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.214667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.214670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.214688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:02.219045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554303352649104:6136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:02.219063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554303352649104:6136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:02.219065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554303352649104:6136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:02.219072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:02.222930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:02.224586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:02.224604Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:02.224606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:02.224611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:02.224617Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [2:7556554303277126351:5327]
2025-10-02T09:30:02.224633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:02.224651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:02.224654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.224658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.224660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.224676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:02.224687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:02.224694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:02.224761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.224769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.224771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.224775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:02.224777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:02.224869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:02.224878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.224891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.224902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.224918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:02.224940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352648957:2446], now have 1 active actors on pipe
2025-10-02T09:30:02.224946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649143:6136], now have 1 active actors on pipe
2025-10-02T09:30:02.224952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.224954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.224956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.224971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:02.224989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:02.224991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:02.224994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:02.224997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:02.225003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:02.225007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:02.225037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 609
2025-10-02T09:30:02.225078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 609
2025-10-02T09:30:02.225043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.225056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:02.225077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:02.225298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.225304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.225328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55490ee7-3878dcab-f11adcd-4837586d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:02.225337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.225340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.225343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:02.225353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.225364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:02.225383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.225556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.225564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.225576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.225684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 36 sessionId: src_id|55490ee7-3878dcab-f11adcd-4837586d_0
2025-10-02T09:30:02.226029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4179e47-8d0d9c28-fdfed18-3a0971b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55490ee7-3878dcab-f11adcd-4837586d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:02.228709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Write session: try to update token
2025-10-02T09:30:02.228725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:02.237059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:02.237076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.237078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:02.237079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:02.237087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.237091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.237095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554303277126346:5327]
2025-10-02T09:30:02.237132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:02.237138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.237138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:02.237139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:02.237143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:02.237146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:02.237288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:02.241792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|55490ee7-3878dcab-f11adcd-4837586d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:02.244214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:02.298958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554303352649152:6089]
2025-10-02T09:30:02.299296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7556554303352649152:6089]
2025-10-02T09:30:02.376013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:02.376527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.376541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.376574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649152:6089], now have 1 active actors on pipe
2025-10-02T09:30:02.376758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:02.376839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:02.376885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:02.376954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55490ee7-3878dcab-f11adcd-4837586d_0
2025-10-02T09:30:02.377119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|55490ee7-3878dcab-f11adcd-4837586d_0 is DEAD
2025-10-02T09:30:02.377284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:02.377302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Write session will restart in 0.007623s
2025-10-02T09:30:02.377278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554303352649152:6089]
2025-10-02T09:30:02.377323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Write session: Do CDS request
2025-10-02T09:30:02.377329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:02.386313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.386376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:02.386395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-10-02T09:30:02.386786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.386826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:02.386835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:02.386839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:02.387217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-10-02T09:30:02.387247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:02.387252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:02.387254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:02.387258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554303352649244:6146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:02.387674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554303352649244:6146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:02.390712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:02.390379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554303352649244:6146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:02.393161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:02.393332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:02.393342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:02.393353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:02.393403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:02.393443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554303277126568:5339]
2025-10-02T09:30:02.393539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554303352649244:6146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:02.393551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554303352649244:6146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:02.393554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554303352649244:6146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:02.393560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:02.394009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:02.394299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:02.394348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:02.394668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:02.394733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.394739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.394740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.394741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.394741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.394743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.394744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.394745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.394746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.394747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.394748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.394749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.394754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.394764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.394768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.394772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.394775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.394779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.394783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.394786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.394790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.394794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.394798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.394814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.394820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.394828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.394833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.394837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.394847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.394851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.394855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.394860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.394864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.394869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.394873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.394878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.394883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.394892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.394896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.394900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.394910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.394915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.394919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.394925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.394930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.394934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.394938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.394942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.394975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:02.403932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:02.405502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:02.405515Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:02.405517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:02.405519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:02.405523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [2:7556554303277126568:5339]
2025-10-02T09:30:02.405533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:02.405545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:02.405547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.405549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.405550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.405561Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:02.405564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:02.405569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:02.405607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.405612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.405614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.405616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:02.405618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:02.405669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:02.405675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.405683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.405689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.405697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:02.405711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.405716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.405717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.405722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:02.405732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:02.405736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:02.405739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:02.405740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:02.405742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:02.405743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:02.405750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649349:6146], now have 1 active actors on pipe
2025-10-02T09:30:02.405753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649169:2446], now have 1 active actors on pipe
2025-10-02T09:30:02.405774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.405783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:02.405791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:02.405820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 610
2025-10-02T09:30:02.405866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.405872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.405862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 610
2025-10-02T09:30:02.405892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:02.405903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.405907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.405913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:02.405920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.405926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:02.405936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.406118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.406125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.406136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.406246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 36 sessionId: src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0
2025-10-02T09:30:02.406624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55490ee7-3878dcab-f11adcd-4837586d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:02.409329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Write session: try to update token
2025-10-02T09:30:02.409344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:02.417209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:02.417223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.417225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:02.417226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:02.417233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.417236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.417239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554303277126563:5339]
2025-10-02T09:30:02.417270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:02.417275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.417277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:02.417289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:02.417295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:02.417300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:02.417415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:02.422969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:02.425678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:02.477637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554303352649371:6089]
2025-10-02T09:30:02.477905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7556554303352649371:6089]
2025-10-02T09:30:02.558128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:02.558469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.558480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.558496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649371:6089], now have 1 active actors on pipe
2025-10-02T09:30:02.558747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:02.558758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554303352649371:6089]
2025-10-02T09:30:02.558785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:02.558787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:02.558773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:02.558859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: error at write: Disconnected sessionId: src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0
2025-10-02T09:30:02.559073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0 is DEAD
2025-10-02T09:30:02.559252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:02.559268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Write session will restart in 0.007786s
2025-10-02T09:30:02.559303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Write session: Do CDS request
2025-10-02T09:30:02.559311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:02.568276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.568438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:02.568463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-10-02T09:30:02.568664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.568705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:02.568718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:02.568731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:02.569313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-10-02T09:30:02.569355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:02.569365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:02.569368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:02.569375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554303352649511:6152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:02.569975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554303352649511:6152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:02.571401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:02.572005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554303352649511:6152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:02.573485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:02.573687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:02.573699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:02.573710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:02.573767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:02.573798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554303277126776:5344]
2025-10-02T09:30:02.573862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554303352649511:6152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:02.573875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554303352649511:6152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:02.573879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554303352649511:6152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:02.573886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:02.574336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:02.574667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:02.574717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:02.575021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:02.575099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.575106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.575106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.575107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.575108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.575110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.575111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.575112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.575113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.575114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.575115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.575115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.575121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.575130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.575134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.575138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.575141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.575145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.575149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.575152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.575156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.575159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.575163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.575166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.575172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.575179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.575187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.575196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.575205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.575211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.575217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.575221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.575230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.575234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.575238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.575246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.575251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.575256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.575262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.575266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.575277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.575282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.575290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.575295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.575300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.575308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.575312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.575317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.575351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:02.583947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:02.585809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:02.585824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:02.585826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:02.585830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:02.585835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [2:7556554303277126776:5344]
2025-10-02T09:30:02.585848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:02.585864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:02.585867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.585869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.585871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.585885Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:02.585890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:02.585896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:02.585949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.585956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.585958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.585960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:02.585963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:02.586026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:02.586037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.586048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.586059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.586075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:02.586093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649385:2446], now have 1 active actors on pipe
2025-10-02T09:30:02.586096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649570:6152], now have 1 active actors on pipe
2025-10-02T09:30:02.586102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.586104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.586106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.586116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:02.586128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:02.586132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:02.586141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:02.586144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:02.586146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:02.586148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:02.586172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.586184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:02.586187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 611
2025-10-02T09:30:02.586203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 611
2025-10-02T09:30:02.586221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:02.586306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.586314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.586333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:02.586343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.586347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.586353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:02.586361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.586369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:02.586386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.586573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.586584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.586607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.586695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0
2025-10-02T09:30:02.587032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda8d127-fe4c01cd-306b688d-918dc4b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:02.589660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Write session: try to update token
2025-10-02T09:30:02.589674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:02.597034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:02.597050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.597059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.597099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:02.597102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:02.597271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:02.597422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.597565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.597714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.597919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:02.597962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:02.603278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:02.605760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:02.606770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.606791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.606808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:02.606811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.606813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:02.606815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:02.606822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.606826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.606829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554303277126771:5344]
2025-10-02T09:30:02.606868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:02.606873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:02.606878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:02.606879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.606881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:02.606881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:02.606996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:02.658892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554303352649582:6089]
2025-10-02T09:30:02.659237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7556554303352649582:6089]
2025-10-02T09:30:02.747527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:02.748053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:02.748088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649582:6089], now have 1 active actors on pipe
2025-10-02T09:30:02.748232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:02.748331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554303352649582:6089]
2025-10-02T09:30:02.748362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:02.758975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:02.758989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Write session will restart in 0.005509s
2025-10-02T09:30:02.759009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Write session: Do CDS request
2025-10-02T09:30:02.759016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:02.758681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:02.758699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:02.758720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: error at write: Disconnected sessionId: src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0
2025-10-02T09:30:02.758846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0 is DEAD
2025-10-02T09:30:02.765224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.765305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:02.765320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-10-02T09:30:02.765442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.765482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:02.765491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:02.765495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:02.765865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-10-02T09:30:02.765900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:02.765902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:02.765903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:02.765908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554303352649740:6157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:02.766404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554303352649740:6157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:02.767273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:02.768509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554303352649740:6157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:02.769714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:02.769872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:02.769882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:02.769890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:02.769934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:02.770008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554303277126966:5346]
2025-10-02T09:30:02.770540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554303352649740:6157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:02.770551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554303352649740:6157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:02.770553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554303352649740:6157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:02.770559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:02.770634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:02.770891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:02.770930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:02.771410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:02.771469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.771475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.771476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.771477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.771478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.771479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.771480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.771482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.771483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.771485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.771486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.771487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.771492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.771503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.771508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.771512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.771516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.771521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.771525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.771529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.771533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.771538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.771547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.771552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.771558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.771566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.771575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.771582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.771587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.771592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.771601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.771606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.771611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.771617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.771621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.771628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.771638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.771643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.771653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.771658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.771667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.771672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.771681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.771686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.771694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.771700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.771708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.771714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.771751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:02.780207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:02.781765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:02.781779Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:02.781783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:02.781787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:02.781793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [2:7556554303277126966:5346]
2025-10-02T09:30:02.781808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:02.781825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:02.781828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.781831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.781834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.781845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:02.781850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:02.781857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:02.781919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.781927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.781929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.781933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:02.781935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:02.782117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:02.782129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.782143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.782156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.782176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:02.782152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 612
2025-10-02T09:30:02.782152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 612
2025-10-02T09:30:02.782194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649777:6157], now have 1 active actors on pipe
2025-10-02T09:30:02.782205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649587:2446], now have 1 active actors on pipe
2025-10-02T09:30:02.782211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.782213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.782215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.782231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:02.782243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:02.782243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:02.782246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:02.782247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:02.782263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:02.782266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:02.782281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.782290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.782328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.782339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:02.782344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:02.782354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68cfcc9c-e3a75214-144fcd4-642be823_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:02.782360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.782368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.782371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:02.782379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.782388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:02.782427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.782629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.782638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.782653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.782747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 36 sessionId: src_id|68cfcc9c-e3a75214-144fcd4-642be823_0
2025-10-02T09:30:02.783110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e35691b-a32725ad-6d5ce8c5-bc3b7038_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68cfcc9c-e3a75214-144fcd4-642be823_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:02.785635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Write session: try to update token
2025-10-02T09:30:02.785651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:02.793113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:02.793133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.793141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.793184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:02.793184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:02.793355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:02.793500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.793677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.793869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:02.794070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:02.794113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:02.802025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|68cfcc9c-e3a75214-144fcd4-642be823_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:02.802713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:02.802731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.802733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:02.802735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:02.802744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.802748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.802752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554303277126961:5346]
2025-10-02T09:30:02.802789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:02.802795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:02.802800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.802800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:02.802802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:02.802803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:02.802946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:02.804173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:02.848320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554303352649792:6089]
2025-10-02T09:30:02.848626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7556554303352649792:6089]
2025-10-02T09:30:02.948071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:02.948485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.948498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.948517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649792:6089], now have 1 active actors on pipe
2025-10-02T09:30:02.948814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:02.948831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:02.948850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:02.948909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554303352649792:6089]
2025-10-02T09:30:02.948952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: error at write: Disconnected sessionId: src_id|68cfcc9c-e3a75214-144fcd4-642be823_0
2025-10-02T09:30:02.948767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:02.949116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|68cfcc9c-e3a75214-144fcd4-642be823_0 is DEAD
2025-10-02T09:30:02.949272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:02.949280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Write session will restart in 0.008941s
2025-10-02T09:30:02.949304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Write session: Do CDS request
2025-10-02T09:30:02.949310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:02.959324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.959402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:02.959420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-10-02T09:30:02.959532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:02.959556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:02.959561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:02.959565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:02.959983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-10-02T09:30:02.960018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:02.960020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:02.960021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:02.960026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554303352649878:6161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:02.960470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554303352649878:6161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:02.962594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554303352649878:6161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:02.964003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:02.966603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:02.966918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:02.966930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:02.966940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:02.966992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:02.967040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554303277127159:5349]
2025-10-02T09:30:02.967660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:02.967964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:02.968003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:02.968323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:02.968380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.968386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.968387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.968389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.968390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.968391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.968392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.968393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.968394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.968395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.968397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.968398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.968403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.968414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.968419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.968423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.968427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.968431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.968435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.968439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.968443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.968447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.968451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.968455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.968461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.968469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:02.968474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.968480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:02.968485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.968490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:02.968495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.968500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:02.968505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.968511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:02.968515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.968521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:02.968529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.968534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:02.968538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.968544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:02.968550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.968555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:02.968559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.968568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.968573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.968583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.968587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.968596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.968630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:02.967101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554303352649878:6161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:02.967121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554303352649878:6161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:02.967124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554303352649878:6161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:02.967132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:02.978168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:02.980100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:02.980118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:02.980122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:02.980125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:02.980132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [2:7556554303277127159:5349]
2025-10-02T09:30:02.980145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:02.980163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:02.980166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.980170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.980172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.980189Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:02.980194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:02.980201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:02.980260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.980263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.980265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.980268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:02.980271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:02.980334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:02.980337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.980351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:02.980363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:02.980380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:02.980398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649981:6161], now have 1 active actors on pipe
2025-10-02T09:30:02.980401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554303352649794:2446], now have 1 active actors on pipe
2025-10-02T09:30:02.980407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.980409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.980412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.980418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:02.980430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:02.980430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:02.980434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:02.980436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:02.980444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:02.980447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:02.980480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.980489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:02.980539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:02.980755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.980763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.980784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:02.980791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:02.980794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:02.980797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:02.980822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:02.980831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:02.980845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.981343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:02.981353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:02.981367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:02.981944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68cfcc9c-e3a75214-144fcd4-642be823_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:02.984715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Write session: try to update token
2025-10-02T09:30:02.984733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:02.980717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 613
2025-10-02T09:30:02.980770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 613
2025-10-02T09:30:02.981598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 36 sessionId: src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0
2025-10-02T09:30:02.993741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:02.993762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:02.993764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:02.993766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:02.993774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.993778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.993782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554303277127154:5349]
2025-10-02T09:30:02.993822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:02.993829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:02.993834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:02.993973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:02.996878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:02.996894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:02.996898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:03.006441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:03.009084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:03.049002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554307647617289:6089]
2025-10-02T09:30:03.049705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7556554307647617289:6089]
2025-10-02T09:30:03.142004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:03.142307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.142319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.142354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617289:6089], now have 1 active actors on pipe
2025-10-02T09:30:03.142521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:03.142657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:03.142676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:03.142746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: error at write: Disconnected sessionId: src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0
2025-10-02T09:30:03.142933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0 is DEAD
2025-10-02T09:30:03.143106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:03.143129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:03.143141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Write session will restart in 0.007809s
2025-10-02T09:30:03.143144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554307647617289:6089]
2025-10-02T09:30:03.143164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Write session: Do CDS request
2025-10-02T09:30:03.143171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:03.153014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.153126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:03.153145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-10-02T09:30:03.153240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.153269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:03.153280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:03.153284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:03.153731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-10-02T09:30:03.153768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:03.153769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:03.153771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:03.153776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554307647617339:6166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:03.154276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554307647617339:6166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:03.157756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554307647617339:6166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:03.160034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:03.162577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:03.162776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:03.162787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:03.162797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:03.162851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:03.162897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554307572094650:5352]
2025-10-02T09:30:03.162627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554307647617339:6166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:03.162641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554307647617339:6166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:03.162644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554307647617339:6166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:03.162652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:03.163501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:03.163798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:03.163839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:03.164150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:03.164205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.164211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.164212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.164213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.164214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.164215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.164216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.164218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.164219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.164220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.164222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.164223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.164228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.164238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.164242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.164246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.164250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.164253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.164257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.164261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.164264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.164267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.164271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.164274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.164280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.164287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.164293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.164298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.164302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.164307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.164312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.164316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.164320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.164324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.164328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.164331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.164335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.164339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.164343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.164347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.164351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.164356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.164359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.164363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.164367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.164373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.164383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.164387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.164419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:03.173187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:03.175183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:03.175198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:03.175199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:03.175202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:03.175206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [2:7556554307572094650:5352]
2025-10-02T09:30:03.175216Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:03.175229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:03.175231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.175233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.175234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.175246Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:03.175250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:03.175256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:03.175301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.175307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.175308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.175310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:03.175312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:03.175362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:03.175369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.175378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.175383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.175391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:03.175404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.175409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.175410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.175416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:03.175424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:03.175430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:03.175432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:03.175433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:03.175434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:03.175436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:03.175441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617481:6166], now have 1 active actors on pipe
2025-10-02T09:30:03.175443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617292:2446], now have 1 active actors on pipe
2025-10-02T09:30:03.175467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.175475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:03.175484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:03.175532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 614
2025-10-02T09:30:03.175533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 614
2025-10-02T09:30:03.175632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.175639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.175657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:03.175664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.175667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.175668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:03.175676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.175682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:03.175691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.175829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.175841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.175864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.175966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0
2025-10-02T09:30:03.176324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9b569f6-acdb2dbe-4f011ff5-1696065d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:03.178994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Write session: try to update token
2025-10-02T09:30:03.179013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:03.186526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:03.186546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.186554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.186600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:03.186611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:03.186798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:03.186960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:03.187125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:03.187270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:03.187469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:03.187512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:03.194900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:03.196797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:03.196830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.196834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:03.196836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:03.196845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.196849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.196853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554307572094645:5352]
2025-10-02T09:30:03.196889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:03.196889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:03.196893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:03.196896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.196896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:03.196899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:03.197631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:03.197035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:03.243083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554307647617493:6089]
2025-10-02T09:30:03.243781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7556554307647617493:6089]
2025-10-02T09:30:03.340236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:03.340682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.340693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.340708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617493:6089], now have 1 active actors on pipe
2025-10-02T09:30:03.340921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:03.340969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554307647617493:6089]
2025-10-02T09:30:03.340975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:03.341002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:03.341048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0
2025-10-02T09:30:03.341219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0 is DEAD
2025-10-02T09:30:03.341780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:03.341790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Write session will restart in 0.008242s
2025-10-02T09:30:03.341811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Write session: Do CDS request
2025-10-02T09:30:03.341817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:03.351260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.351370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:03.351387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-10-02T09:30:03.351645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.351673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:03.351678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:03.351681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:03.352062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-10-02T09:30:03.352085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:03.352087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:03.352090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:03.352095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554307647617545:6170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:03.352591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554307647617545:6170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:03.354957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554307647617545:6170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:03.361547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554307647617545:6170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:03.361566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554307647617545:6170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:03.361570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554307647617545:6170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:03.361579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:03.363258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:03.367053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:03.367256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:03.367269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:03.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:03.367334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:03.367373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554307572094848:5354]
2025-10-02T09:30:03.367946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:03.368661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:03.368712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:03.369149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:03.369230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.369231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.369234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.369236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.369237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.369238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.369239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.369241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.369241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.369242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.369244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.369245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.369250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.369260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.369264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.369268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.369274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.369278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.369282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.369286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.369290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.369294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.369299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.369304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.369314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.369324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.369331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.369339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.369343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.369347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.369351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.369355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.369360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.369364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.369368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.369372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.369376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.369380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.369384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.369389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.369395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.369401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.369404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.369409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.369413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.369418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.369421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.369428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.369460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:03.379339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:03.381087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:03.381102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:03.381106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:03.381110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:03.381116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [2:7556554307572094848:5354]
2025-10-02T09:30:03.381131Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:03.381147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:03.381149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.381152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.381154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.381169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:03.381174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:03.381180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:03.381237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.381246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.381248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.381251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:03.381253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:03.381522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 615
2025-10-02T09:30:03.381525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 615
2025-10-02T09:30:03.381317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:03.381326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.381339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.381350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.381368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:03.381383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.381386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.381387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.381396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:03.381408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:03.381417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:03.381422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:03.381423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:03.381425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:03.381426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:03.381434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617682:6170], now have 1 active actors on pipe
2025-10-02T09:30:03.381442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617496:2446], now have 1 active actors on pipe
2025-10-02T09:30:03.381473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.381488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:03.381506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:03.381707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.381720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.381741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45d170e-1ae78589-35814fc0-a357b0c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:03.381753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.381759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.381766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:03.381776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.381794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:03.381812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.382021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.382028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.382039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.382132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 36 sessionId: src_id|45d170e-1ae78589-35814fc0-a357b0c1_0
2025-10-02T09:30:03.382544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3940ab8-79c0a2c-ddd0e837-55a94802_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45d170e-1ae78589-35814fc0-a357b0c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:03.385098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Write session: try to update token
2025-10-02T09:30:03.385113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:03.394308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:03.394327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.394329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:03.394331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:03.394338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.394343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.394346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554307572094838:5354]
2025-10-02T09:30:03.394384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:03.394390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.394392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:03.394409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:03.394416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:03.394419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:03.394517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:03.399247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|45d170e-1ae78589-35814fc0-a357b0c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:03.401878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:03.441247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554307647617709:6089]
2025-10-02T09:30:03.441585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7556554307647617709:6089]
2025-10-02T09:30:03.542750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:03.542780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:03.542807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554307647617709:6089]
2025-10-02T09:30:03.542825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:03.542839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: error at write: Disconnected sessionId: src_id|45d170e-1ae78589-35814fc0-a357b0c1_0
2025-10-02T09:30:03.543047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|45d170e-1ae78589-35814fc0-a357b0c1_0 is DEAD
2025-10-02T09:30:03.543274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:03.543285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Write session will restart in 0.005173s
2025-10-02T09:30:03.543306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Write session: Do CDS request
2025-10-02T09:30:03.543312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:03.541983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:03.542295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.542300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.542332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617709:6089], now have 1 active actors on pipe
2025-10-02T09:30:03.542765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:03.549464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.549504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:03.549520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-10-02T09:30:03.549690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.549720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:03.549725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:03.549729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:03.550098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-10-02T09:30:03.550125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:03.550127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:03.550129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:03.550134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554307647617746:6182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:03.550597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554307647617746:6182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:03.552568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554307647617746:6182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:03.556555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554307647617746:6182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:03.556571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554307647617746:6182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:03.556575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554307647617746:6182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:03.556582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:03.560668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:03.564236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:03.564592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:03.564604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:03.564618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:03.564686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:03.564737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554307572095087:5369]
2025-10-02T09:30:03.565400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:03.565801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:03.565863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:03.566228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:03.566299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.566301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.566302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.566303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.566304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.566305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.566306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.566307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.566309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.566310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.566311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.566312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.566318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.566330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.566334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.566338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.566342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.566346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.566350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.566354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.566359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.566363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.566367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.566371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.566378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.566386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.566391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.566397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.566402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.566408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.566412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.566418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.566423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.566429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.566434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.566440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.566445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.566451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.566456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.566461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.566467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.566472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.566476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.566482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.566487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.566493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.566497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.566503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.566557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:03.576189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:03.578270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:03.578284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:03.578286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:03.578289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:03.578295Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [2:7556554307572095087:5369]
2025-10-02T09:30:03.578309Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:03.578326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:03.578330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.578332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.578334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.578349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:03.578354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:03.578359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:03.578415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.578425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.578427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.578429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:03.578432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:03.578500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:03.578505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.578516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.578525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.578545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:03.578560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.578562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.578564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.578571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:03.578582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:03.578584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617839:6182], now have 1 active actors on pipe
2025-10-02T09:30:03.578587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617721:2446], now have 1 active actors on pipe
2025-10-02T09:30:03.578593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:03.578595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:03.578595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:03.578607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:03.578609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:03.578640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.578656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:03.578679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:03.578682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 616
2025-10-02T09:30:03.578878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 616
2025-10-02T09:30:03.578924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.578936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.578962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:03.578975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.578981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.578984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:03.578994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.579008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:03.579038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.579307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.579318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.579337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.579457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 36 sessionId: src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0
2025-10-02T09:30:03.579803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d170e-1ae78589-35814fc0-a357b0c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:03.582356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Write session: try to update token
2025-10-02T09:30:03.582372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:03.589845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:03.589866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.589868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:03.589869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:03.589878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.589882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.589885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554307572095082:5369]
2025-10-02T09:30:03.589921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:03.589928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.589930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:03.589934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:03.589938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:03.589944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:03.590060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:03.596729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:03.599127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:03.642431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554307647617935:6089]
2025-10-02T09:30:03.642672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7556554307647617935:6089]
2025-10-02T09:30:03.727756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:03.728213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.728228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.728246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617935:6089], now have 1 active actors on pipe
2025-10-02T09:30:03.728453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:03.728478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554307647617935:6089]
2025-10-02T09:30:03.728511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:03.728541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:03.728607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0
2025-10-02T09:30:03.728786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0 is DEAD
2025-10-02T09:30:03.728989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:03.729000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Write session will restart in 0.007363s
2025-10-02T09:30:03.729025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Write session: Do CDS request
2025-10-02T09:30:03.729031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:03.737352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.737477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:03.737498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-10-02T09:30:03.737643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.737684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:03.737694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:03.737700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:03.738270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-10-02T09:30:03.738315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:03.738322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:03.738326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:03.738332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554307647617976:6186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:03.738870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554307647617976:6186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:03.741794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554307647617976:6186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:03.744484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554307647617976:6186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:03.744498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554307647617976:6186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:03.744501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554307647617976:6186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:03.744514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:03.744843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:03.747187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:03.747507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:03.747517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:03.747529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:03.747584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:03.747625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554307572095282:5371]
2025-10-02T09:30:03.748194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:03.748549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:03.748599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:03.748928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:03.748971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.748976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.748977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.748978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.748979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.748981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.748982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.748983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.748984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.748985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.748986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.748987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.748992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.749001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.749005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.749008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.749011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.749017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.749021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.749025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.749029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.749032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.749036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.749042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.749049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.749055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.749061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.749065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.749070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.749080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.749084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.749089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.749093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.749098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.749102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.749107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.749113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.749120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.749126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.749131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.749135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.749140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.749143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.749152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.749157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.749161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.749193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:03.758021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:03.759801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:03.759816Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:03.759817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:03.759821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:03.759825Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [2:7556554307572095282:5371]
2025-10-02T09:30:03.759837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:03.759854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:03.759863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.759871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.759873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.759888Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:03.759896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:03.759905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:03.759963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.759970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.759972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.759974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:03.759977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:03.760045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:03.760052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.760141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 617
2025-10-02T09:30:03.760160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 617
2025-10-02T09:30:03.760065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.760081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.760096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:03.760114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647617937:2446], now have 1 active actors on pipe
2025-10-02T09:30:03.760117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647618130:6186], now have 1 active actors on pipe
2025-10-02T09:30:03.760123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.760125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.760127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.760138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:03.760152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:03.760153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:03.760156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:03.760158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:03.760166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:03.760168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:03.760203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.760208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:03.760211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:03.760239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.760242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.760273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:03.760278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.760282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.760283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:03.760292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.760300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:03.760314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.760462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.760470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.760483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.760548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 36 sessionId: src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0
2025-10-02T09:30:03.760930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c761ae52-8d3280e3-5287b2a2-81e8ac25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:03.763438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Write session: try to update token
2025-10-02T09:30:03.763453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:03.770826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:03.770847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.770849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:03.770850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:03.770857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.770862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.770866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554307572095277:5371]
2025-10-02T09:30:03.770912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:03.770925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.770927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:03.770935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:03.770947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:03.770951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:03.771158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:03.777078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:03.779442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:03.828790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554307647618150:6089]
2025-10-02T09:30:03.829686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7556554307647618150:6089]
2025-10-02T09:30:03.910693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:03.911110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.911124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.911142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647618150:6089], now have 1 active actors on pipe
2025-10-02T09:30:03.911399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:03.911409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554307647618150:6089]
2025-10-02T09:30:03.911454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:03.911465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:03.911524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: error at write: Disconnected sessionId: src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0
2025-10-02T09:30:03.911702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0 is DEAD
2025-10-02T09:30:03.911969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:03.912893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:03.912905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Write session will restart in 0.007306s
2025-10-02T09:30:03.912930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Write session: Do CDS request
2025-10-02T09:30:03.912936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:03.921347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.921443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:03.921473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-10-02T09:30:03.921609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:03.921653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:03.921659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:03.921663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:03.922328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-10-02T09:30:03.922363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:03.922369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:03.922371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:03.922376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554307647618220:6191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:03.922918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554307647618220:6191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:03.925401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554307647618220:6191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:03.928362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554307647618220:6191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:03.928383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554307647618220:6191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:03.928386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554307647618220:6191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:03.928394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:03.928788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:03.931318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:03.931611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:03.931622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:03.931631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:03.931689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:03.931727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554307572095480:5374]
2025-10-02T09:30:03.932369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:03.932686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:03.932731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:03.933078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:03.933134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.933140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.933141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.933142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.933143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.933144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.933146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.933147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.933148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.933150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.933151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.933152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.933157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.933169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.933173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.933177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.933186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.933190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.933197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.933201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.933205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.933209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.933217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.933221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.933232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.933239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:03.933249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.933259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:03.933267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.933271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:03.933281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.933290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:03.933299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.933307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:03.933316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.933320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:03.933329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.933336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:03.933343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.933348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:03.933352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.933361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:03.933365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.933369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.933378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.933382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.933390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.933395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.933435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:03.942563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:03.944472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:03.944488Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:03.944491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:03.944494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:03.944501Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [2:7556554307572095480:5374]
2025-10-02T09:30:03.944517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:03.944534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:03.944538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.944540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.944543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.944558Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:03.944566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:03.944573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:03.944637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.944644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.944646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.944649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:03.944651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:03.944720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:03.944730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.944745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:03.944758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:03.944775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:03.944794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647618152:2446], now have 1 active actors on pipe
2025-10-02T09:30:03.944820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554307647618342:6191], now have 1 active actors on pipe
2025-10-02T09:30:03.944827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.944829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.944832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.944843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:03.944856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:03.944858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:03.944863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:03.944865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:03.944872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:03.944875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:03.944908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.944921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:03.944928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:03.944903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 618
2025-10-02T09:30:03.944905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 618
2025-10-02T09:30:03.944960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.944967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.944992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:03.945005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:03.945009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:03.945011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:03.945021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:03.945029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:03.945045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.945174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:03.945182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:03.945194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:03.945258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0
2025-10-02T09:30:03.945626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30d03b5-46aa7be5-bfa44270-27390f11_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:03.948364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Write session: try to update token
2025-10-02T09:30:03.948381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:03.955810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:03.955829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.955837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.955878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:03.955883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:03.956053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:03.956223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:03.956379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:03.956520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:03.956733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:03.956777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:03.962935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:03.965640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:03.965707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:03.965728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:03.965730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:03.965732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:03.965742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.965746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.965749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554307572095475:5374]
2025-10-02T09:30:03.965771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:03.965779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:03.965782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:03.965785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:03.965791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:03.965793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:03.965928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:04.011580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554311942585652:6089]
2025-10-02T09:30:04.011844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7556554311942585652:6089]
2025-10-02T09:30:04.108043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:04.108521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.108533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.108552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942585652:6089], now have 1 active actors on pipe
2025-10-02T09:30:04.108763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:04.109217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:04.109228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Write session will restart in 0.008540s
2025-10-02T09:30:04.109248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Write session: Do CDS request
2025-10-02T09:30:04.108781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:04.109253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:04.108839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:04.108839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554311942585652:6089]
2025-10-02T09:30:04.108842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:04.108900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: error at write: Disconnected sessionId: src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0
2025-10-02T09:30:04.109062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0 is DEAD
2025-10-02T09:30:04.119350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.119483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:04.119500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-10-02T09:30:04.119625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.119655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:04.119664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:04.119668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:04.120072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-10-02T09:30:04.120103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:04.120111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:04.120113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:04.120118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554311942585766:6195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:04.120626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554311942585766:6195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:04.122409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554311942585766:6195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:04.122777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:04.124934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:04.125239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:04.125247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554311942585766:6195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:04.125256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:04.125269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:04.125260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554311942585766:6195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:04.125264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554311942585766:6195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:04.125271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:04.125337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:04.125380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554311867062972:5376]
2025-10-02T09:30:04.125964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:04.126315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:04.126365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:04.126697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:04.126770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.126777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.126778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.126780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.126781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.126782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.126784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.126785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.126786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.126787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.126789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.126790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.126795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.126806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.126811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.126815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.126818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.126823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.126827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.126831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.126835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.126839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.126848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.126852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.126864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.126875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.126885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.126893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.126901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.126907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.126915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.126921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.126930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.126940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.126946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.126952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.126957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.126963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.126967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.126977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.126982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.126991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.126995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.127005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.127009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.127019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.127041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.127046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.127085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:04.135687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:04.137517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:04.137528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:04.137531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:04.137535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:04.137541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [2:7556554311867062972:5376]
2025-10-02T09:30:04.137558Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:04.137576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:04.137578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.137581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.137582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.137595Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:04.137606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:04.137612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:04.137668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.137670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.137672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.137674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:04.137677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:04.137740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:04.137743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.137756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.137767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.137784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:04.137802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942585654:2446], now have 1 active actors on pipe
2025-10-02T09:30:04.137812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.137814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.137816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.137827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:04.137838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942585847:6195], now have 1 active actors on pipe
2025-10-02T09:30:04.137840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:04.137843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:04.137845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:04.137846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:04.137863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:04.137866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:04.137897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.137907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:04.137923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:04.137906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 619
2025-10-02T09:30:04.137911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 619
2025-10-02T09:30:04.137951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.137959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.137983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fab7d12-64713531-9cbbe90-3d9305c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:04.137988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.137991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.137993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:04.138001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.138008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:04.138018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.138154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.138160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.138172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.138252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 36 sessionId: src_id|fab7d12-64713531-9cbbe90-3d9305c2_0
2025-10-02T09:30:04.138582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bbb6a1c-8752905d-8105e5c1-3d606273_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fab7d12-64713531-9cbbe90-3d9305c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:04.141109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Write session: try to update token
2025-10-02T09:30:04.141124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:04.148777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:04.148815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.148822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.148863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:04.148865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:04.149062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:04.149205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.149336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.149503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.149744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:04.149782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:04.154340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|fab7d12-64713531-9cbbe90-3d9305c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:04.156762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:04.156986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.157004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.157034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:04.157083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:04.158033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:04.158048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.158049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:04.158051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:04.158058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.158061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.158064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554311867062967:5376]
2025-10-02T09:30:04.158094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:04.158099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.158100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:04.158102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:04.158107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:04.158111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:04.158219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:04.209209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554311942585861:6089]
2025-10-02T09:30:04.209518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7556554311942585861:6089]
2025-10-02T09:30:04.291995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:04.298481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.298498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.298638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.298689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.298741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.298802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.298845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.298852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.298911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.298962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.299014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.299083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.299131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.299141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.299200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.299248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.299301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.299403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.299440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.299445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.299498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.299550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.299606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.299665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.299706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.299711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.299768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.299821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.299879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.299941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.299978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.299983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.300041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.300096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.300157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.300218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.300268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.300273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.300328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.300377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.300431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.300485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.300760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.300768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.300841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.300893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.300943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.300993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.301032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.301036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.301090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.301145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.301200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.301256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.301300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.301309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.301360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.301429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.301479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.301530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.301567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.301572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.301604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942585861:6089], now have 1 active actors on pipe
2025-10-02T09:30:04.301793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:04.301828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:04.301829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:04.301842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554311942585861:6089]
2025-10-02T09:30:04.301850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: error at write: Disconnected sessionId: src_id|fab7d12-64713531-9cbbe90-3d9305c2_0
2025-10-02T09:30:04.301986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|fab7d12-64713531-9cbbe90-3d9305c2_0 is DEAD
2025-10-02T09:30:04.302121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:04.302130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Write session will restart in 0.006282s
2025-10-02T09:30:04.302144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Write session: Do CDS request
2025-10-02T09:30:04.302149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:04.302158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:04.309252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.309324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:04.309335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-10-02T09:30:04.309573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.309594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:04.309600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:04.309603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:04.309918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-10-02T09:30:04.309937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:04.309942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:04.309943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:04.309946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554311942585916:6200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:04.310293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554311942585916:6200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:04.312695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554311942585916:6200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:04.317317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554311942585916:6200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:04.317328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554311942585916:6200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:04.317330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554311942585916:6200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:04.317349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:04.317521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:04.317984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:04.318224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:04.318239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:04.318253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:04.318323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:04.318379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554311867063174:5379]
2025-10-02T09:30:04.319178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:04.319509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:04.319548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:04.319802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:04.319844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.319850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.319851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.319852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.319853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.319854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.319855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.319856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.319857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.319857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.319858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.319859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.319863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.319871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.319874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.319876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.319878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.319881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.319883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.319886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.319889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.319891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.319894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.319896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.319903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.319909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.319913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.319916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.319919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.319922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.319925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.319929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.319933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.319936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.319939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.319942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.319945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.319948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.319951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.319954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.319957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.319961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.319964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.319967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.319970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.319974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.319977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.319980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.320001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:04.328674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:04.330630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:04.330645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:04.330648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:04.330651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:04.330657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [2:7556554311867063174:5379]
2025-10-02T09:30:04.330669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:04.330686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:04.330694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.330696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.330698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.330713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:04.330721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:04.330727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:04.330780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.330787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.330789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.330792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:04.330794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:04.330850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:04.330860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.330874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.330887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.330898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:04.330921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942585864:2446], now have 1 active actors on pipe
2025-10-02T09:30:04.330930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586056:6200], now have 1 active actors on pipe
2025-10-02T09:30:04.330937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.330943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.330945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.330962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:04.330980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:04.330993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:04.330994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:04.330999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:04.331000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:04.331001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:04.330986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 620
2025-10-02T09:30:04.331036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 620
2025-10-02T09:30:04.331046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.331053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:04.331058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:04.331084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.331093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.331129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:04.331140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.331143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.331145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:04.331153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.331165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:04.331184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.331336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.331342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.331352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.331441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 36 sessionId: src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0
2025-10-02T09:30:04.331779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab7d12-64713531-9cbbe90-3d9305c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:04.334019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Write session: try to update token
2025-10-02T09:30:04.334037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:04.341672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:04.341689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.341692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:04.341695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:04.341704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.341709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.341713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554311867063168:5379]
2025-10-02T09:30:04.341757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:04.341773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.341775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:04.341774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:04.341785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:04.341802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:04.341923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:04.346096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:04.348462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:04.402262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554311942586068:6089]
2025-10-02T09:30:04.402567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7556554311942586068:6089]
2025-10-02T09:30:04.480184Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:04.480582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.480602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.480650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586068:6089], now have 1 active actors on pipe
2025-10-02T09:30:04.480858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:04.480881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:04.480927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:04.480990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0
2025-10-02T09:30:04.481167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0 is DEAD
2025-10-02T09:30:04.481308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:04.481317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Write session will restart in 0.009058s
2025-10-02T09:30:04.481336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Write session: Do CDS request
2025-10-02T09:30:04.481340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:04.481368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554311942586068:6089]
2025-10-02T09:30:04.491270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.491393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:04.491418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-10-02T09:30:04.491522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.491550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:04.491558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:04.491562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:04.491900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-10-02T09:30:04.491928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:04.491933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:04.491934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:04.491939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554311942586195:6210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:04.492537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554311942586195:6210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:04.493901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554311942586195:6210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:04.494310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:04.496720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:04.496897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:04.496905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:04.496914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:04.496962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:04.496994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554311867063409:5391]
2025-10-02T09:30:04.497007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554311942586195:6210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:04.497019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554311942586195:6210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:04.497022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554311942586195:6210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:04.497028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:04.497529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:04.497740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:04.497770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:04.497968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:04.497997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.498003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.498004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.498005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.498006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.498006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.498007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.498007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.498008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.498009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.498009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.498010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.498013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.498019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.498021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.498023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.498026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.498028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.498030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.498032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.498034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.498036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.498038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.498040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.498044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.498048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.498052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.498055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.498057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.498060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.498062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.498066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.498068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.498071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.498073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.498076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.498078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.498081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.498084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.498087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.498089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.498092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.498095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.498098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.498100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.498103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.498106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.498108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.498126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:04.506440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:04.508146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:04.508161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:04.508164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:04.508167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:04.508172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [2:7556554311867063409:5391]
2025-10-02T09:30:04.508184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:04.508200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:04.508204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.508206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.508208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.508223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:04.508228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:04.508234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:04.508287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.508293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.508297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.508300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:04.508302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:04.508358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:04.508364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.508376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.508388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.508407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:04.508430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586086:2446], now have 1 active actors on pipe
2025-10-02T09:30:04.508439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.508445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.508447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.508457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:04.508471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586285:6210], now have 1 active actors on pipe
2025-10-02T09:30:04.508473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:04.508475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:04.508477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:04.508482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:04.508492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:04.508498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:04.508529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.508540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:04.508526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 621
2025-10-02T09:30:04.508556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:04.508531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 621
2025-10-02T09:30:04.508572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.508580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.508603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:04.508612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.508616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.508622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:04.508630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.508641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:04.508656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.508822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.508828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.508841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.508918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 36 sessionId: src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0
2025-10-02T09:30:04.509270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbeda0ed-a74fe2c3-1c4be658-72690d07_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:04.511790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Write session: try to update token
2025-10-02T09:30:04.511805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:04.519117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:04.519131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.519139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.519178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:04.519194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:04.519339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:04.519482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.519609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.519748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.520079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:04.520121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:04.524981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:04.527243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:04.528057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.528076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.528089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:04.528091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.528092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:04.528094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:04.528103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.528106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.528107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554311867063397:5391]
2025-10-02T09:30:04.528140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:04.528148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.528150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:04.528152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:04.528156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:04.528160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:04.528259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:04.581433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554311942586310:6089]
2025-10-02T09:30:04.581687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7556554311942586310:6089]
2025-10-02T09:30:04.666050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:04.666462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:04.666490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586310:6089], now have 1 active actors on pipe
2025-10-02T09:30:04.666634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:04.666694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554311942586310:6089]
2025-10-02T09:30:04.666942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:04.667043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:04.667052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:04.667116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: error at write: Disconnected sessionId: src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0
2025-10-02T09:30:04.667255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0 is DEAD
2025-10-02T09:30:04.667374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:04.667384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Write session will restart in 0.006455s
2025-10-02T09:30:04.667405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Write session: Do CDS request
2025-10-02T09:30:04.667415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:04.675342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.675393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:04.675412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-10-02T09:30:04.675553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.675584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:04.675593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:04.675597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:04.676072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-10-02T09:30:04.676109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:04.676111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:04.676113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:04.676118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554311942586351:6216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:04.676533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554311942586351:6216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:04.679079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554311942586351:6216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:04.681909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554311942586351:6216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:04.681923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554311942586351:6216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:04.681926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554311942586351:6216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:04.681931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:04.682426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:04.684563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:04.684733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:04.684745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:04.684756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:04.684834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:04.684871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554311867063622:5396]
2025-10-02T09:30:04.685426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:04.685727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:04.685778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:04.686077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:04.686158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.686166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.686167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.686168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.686170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.686171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.686172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.686173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.686174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.686175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.686176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.686177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.686183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.686193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.686196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.686200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.686204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.686208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.686211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.686215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.686218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.686222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.686226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.686229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.686235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.686242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.686247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.686252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.686256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.686261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.686264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.686269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.686273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.686278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.686281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.686286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.686291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.686298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.686302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.686307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.686311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.686315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.686320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.686324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.686329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.686334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.686350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.686354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.686388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:04.694880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:04.696668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:04.696683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:04.696685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:04.696689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:04.696694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [2:7556554311867063622:5396]
2025-10-02T09:30:04.696710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:04.696727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:04.696730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.696733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.696735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.696751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:04.696756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:04.696763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:04.696840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.696849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.696851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.696854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:04.696857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:04.696920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:04.696928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.696941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.696956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.696976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:04.696997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586313:2446], now have 1 active actors on pipe
2025-10-02T09:30:04.697005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586507:6216], now have 1 active actors on pipe
2025-10-02T09:30:04.697011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.697018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.697020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.697037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:04.697020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 622
2025-10-02T09:30:04.697052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:04.697063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:04.697071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:04.697072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:04.697074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:04.697074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:04.697103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 622
2025-10-02T09:30:04.697110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.697121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:04.697141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:04.697169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.697178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.697209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:04.697218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.697222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.697224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:04.697234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.697250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:04.697270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.697381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.697389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.697401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.697462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 36 sessionId: src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0
2025-10-02T09:30:04.697775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef7b9c3-b4af2e08-31553502-43d6d72c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:04.700372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Write session: try to update token
2025-10-02T09:30:04.700388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:04.707893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:04.707912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.707920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.707961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:04.707963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:04.708150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:04.708313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.708471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.708622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:04.708854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:04.708891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:04.713836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:04.716375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:04.716566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.716595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.716627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:04.716738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:04.717992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:04.718009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.718012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:04.718014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:04.718023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.718028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.718032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554311867063617:5396]
2025-10-02T09:30:04.718068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:04.718075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.718077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:04.718077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:04.718083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:04.718086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:04.718311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:04.766778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554311942586525:6089]
2025-10-02T09:30:04.767052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7556554311942586525:6089]
2025-10-02T09:30:04.861289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:04.869217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.869243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.869400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.869469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.869535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.869601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.869658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.869668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.869733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.869788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.869857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.869933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.869977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.869989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.870062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.870122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.870192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.870258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.870301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.870307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.870374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.870441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.870503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.870573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.870616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.870624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.870690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.870749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.870819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.870882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.870936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.870944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.871008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.871079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.871142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.871204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.871251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.871256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.871311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.871366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.871422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.871478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.871525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.871530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.871588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.871640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.871695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.871750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.871788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.871793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.871854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.871908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.871963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.872015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.872055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.872060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.872112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:04.872162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:04.872226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:04.872288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:04.872332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:04.872338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:04.872398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586525:6089], now have 1 active actors on pipe
2025-10-02T09:30:04.872634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554311942586525:6089]
2025-10-02T09:30:04.872653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:04.872673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:04.872675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:04.872699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: error at write: Disconnected sessionId: src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0
2025-10-02T09:30:04.872880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0 is DEAD
2025-10-02T09:30:04.873029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:04.873038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Write session will restart in 0.005673s
2025-10-02T09:30:04.873056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Write session: Do CDS request
2025-10-02T09:30:04.873060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:04.873377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:04.880342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.880394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:04.880412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-10-02T09:30:04.880641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:04.880666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:04.880671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:04.880676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:04.881085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-10-02T09:30:04.881118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:04.881120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:04.881122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:04.881127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554311942586545:6221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:04.881622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554311942586545:6221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:04.884966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554311942586545:6221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:04.887935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554311942586545:6221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:04.887949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554311942586545:6221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:04.887952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554311942586545:6221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:04.887958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:04.889616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:04.891885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:04.892051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:04.892066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:04.892075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:04.892126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:04.892165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554311867063826:5399]
2025-10-02T09:30:04.892696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:04.893024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:04.893066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:04.893391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:04.893442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.893447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.893448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.893449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.893450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.893451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.893452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.893453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.893454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.893455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.893456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.893457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.893461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.893472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.893475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.893479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.893482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.893485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.893488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.893491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.893494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.893498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.893501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.893504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.893510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.893519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:04.893523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.893528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:04.893531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.893541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:04.893545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.893549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:04.893557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.893561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:04.893565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.893569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:04.893572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.893581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:04.893584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.893589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:04.893597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.893601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:04.893605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.893614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.893620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.893629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.893632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.893641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.893672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:04.902265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:04.903903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:04.903919Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:04.903922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:04.903926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:04.903933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [2:7556554311867063826:5399]
2025-10-02T09:30:04.903946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:04.903963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:04.903966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.903970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.903972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.903986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:04.903991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:04.903999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:04.904061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.904068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.904070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.904075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:04.904077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:04.904141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:04.904149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.904163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:04.904181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:04.904205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:04.904228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586725:6221], now have 1 active actors on pipe
2025-10-02T09:30:04.904232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586531:2446], now have 1 active actors on pipe
2025-10-02T09:30:04.904238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.904240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.904243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.904257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:04.904272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:04.904283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:04.904291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:04.904294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:04.904295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:04.904296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:04.904327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.904340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:04.904359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:04.904329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 623
2025-10-02T09:30:04.904333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 623
2025-10-02T09:30:04.904391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.904399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.904421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:04.904430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:04.904435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:04.904440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:04.904448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:04.904461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:04.904477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.904631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:04.904641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:04.904654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:04.904717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0
2025-10-02T09:30:04.905076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829e66dd-7defaf27-fdfa16c8-7402837d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:04.907782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Write session: try to update token
2025-10-02T09:30:04.907797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:04.916237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:04.916252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:04.916255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:04.916258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:04.916265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.916269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.916273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554311867063821:5399]
2025-10-02T09:30:04.916309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:04.916314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:04.916317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:04.916320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:04.916326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:04.916329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:04.916661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:04.923481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:04.926114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:04.972589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554311942586740:6089]
2025-10-02T09:30:04.972864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7556554311942586740:6089]
2025-10-02T09:30:05.054015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:05.054646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.054657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.054669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554311942586740:6089], now have 1 active actors on pipe
2025-10-02T09:30:05.054884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:05.054869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:05.054887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:05.054900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:05.054949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554311942586740:6089]
2025-10-02T09:30:05.054953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: error at write: Disconnected sessionId: src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0
2025-10-02T09:30:05.055103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0 is DEAD
2025-10-02T09:30:05.055272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:05.055278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Write session will restart in 0.005025s
2025-10-02T09:30:05.055295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Write session: Do CDS request
2025-10-02T09:30:05.055304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:05.061121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.061237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:05.061251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-10-02T09:30:05.061381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.061422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:05.061430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:05.061434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:05.061801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-10-02T09:30:05.061833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:05.061834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:05.061836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:05.061840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554316237554064:6225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:05.062213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554316237554064:6225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:05.064420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554316237554064:6225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:05.066787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554316237554064:6225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:05.066807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554316237554064:6225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:05.066809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554316237554064:6225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:05.066815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:05.067116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:05.069033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:05.069168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:05.069175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:05.069181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:05.069210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:05.069237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554316162031324:5401]
2025-10-02T09:30:05.069602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:05.069856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:05.069898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:05.070129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:05.070167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.070171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.070172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.070173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.070173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.070174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.070174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.070175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.070175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.070176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.070176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.070177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.070180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.070187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.070189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.070192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.070194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.070196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.070198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.070200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.070202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.070205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.070207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.070209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.070213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.070218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.070221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.070224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.070226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.070229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.070231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.070234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.070237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.070240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.070243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.070245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.070247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.070250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.070252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.070255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.070257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.070260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.070262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.070265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.070267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.070270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.070272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.070274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.070292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:05.079056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:05.082561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:05.082578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:05.082581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:05.082584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:05.082590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [2:7556554316162031324:5401]
2025-10-02T09:30:05.082603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:05.082620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:05.082623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.082626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.082628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.082641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:05.082646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:05.082653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:05.082714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.082723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.082726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.082729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:05.082731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:05.082804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:05.082812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.082825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.082835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.082850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:05.082872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.082878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.082880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.082888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:05.082897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:05.082900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:05.082902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:05.082903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:05.082916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:05.082923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:05.082932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554234:6225], now have 1 active actors on pipe
2025-10-02T09:30:05.082939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554038:2446], now have 1 active actors on pipe
2025-10-02T09:30:05.082968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.082980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:05.082999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:05.083291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 624
2025-10-02T09:30:05.083327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 624
2025-10-02T09:30:05.083387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.083398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.083428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:05.083436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.083439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.083442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:05.083451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.083462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:05.083480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.083613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.083620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.083632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.083693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0
2025-10-02T09:30:05.084028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0d4f2e-3b30e1f9-65633953-22ee1df8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:05.089965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Write session: try to update token
2025-10-02T09:30:05.089983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:05.098016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:05.098033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.098036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:05.098038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:05.098046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.098051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.098054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554316162031319:5401]
2025-10-02T09:30:05.098090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:05.098096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.098099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:05.098116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:05.098123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:05.098127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:05.098413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:05.112895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:05.115258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:05.154883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554316237554250:6089]
2025-10-02T09:30:05.155156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7556554316237554250:6089]
2025-10-02T09:30:05.246335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:05.246662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.246679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.246696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554250:6089], now have 1 active actors on pipe
2025-10-02T09:30:05.246904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:05.247493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554316237554250:6089]
2025-10-02T09:30:05.247523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:05.247584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0
2025-10-02T09:30:05.247769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0 is DEAD
2025-10-02T09:30:05.247899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:05.248168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:05.248179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Write session will restart in 0.008089s
2025-10-02T09:30:05.248204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Write session: Do CDS request
2025-10-02T09:30:05.248210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:05.257309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.261010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:05.261028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-10-02T09:30:05.264919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.264971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:05.264977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:05.264981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:05.265454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-10-02T09:30:05.265486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:05.265488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:05.265490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:05.265495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554316237554338:6230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:05.266009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554316237554338:6230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:05.268879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554316237554338:6230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:05.273514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554316237554338:6230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:05.273532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554316237554338:6230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:05.273536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554316237554338:6230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:05.273543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:05.273607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:05.276686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:05.276910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:05.276923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:05.276935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:05.276997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:05.277036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554316162031529:5404]
2025-10-02T09:30:05.277618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:05.278037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:05.278084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:05.278391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:05.278437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.278438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.278439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.278439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.278441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.278442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.278442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.278443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.278444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.278444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.278445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.278446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.278449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.278456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.278459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.278461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.278463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.278466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.278468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.278470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.278472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.278475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.278477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.278479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.278484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.278489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.278494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.278499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.278504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.278508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.278512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.278518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.278523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.278528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.278532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.278535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.278538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.278541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.278543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.278545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.278548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.278551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.278553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.278556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.278558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.278561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.278564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.278567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.278586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:05.289086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:05.290789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:05.290806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:05.290809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:05.290813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:05.290820Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [2:7556554316162031529:5404]
2025-10-02T09:30:05.290837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:05.290861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:05.290867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.290871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.290873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.290887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:05.290896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:05.290903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:05.290973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.290980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.290982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.290985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:05.290987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:05.291062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:05.291070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.291082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.291097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.291118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:05.291140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554252:2446], now have 1 active actors on pipe
2025-10-02T09:30:05.291147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554449:6230], now have 1 active actors on pipe
2025-10-02T09:30:05.291153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.291155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.291157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.291171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:05.291188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:05.291206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:05.291213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:05.291247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.291254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:05.291289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:05.291299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:05.291301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:05.291307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:05.291422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 625
2025-10-02T09:30:05.291463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 625
2025-10-02T09:30:05.291536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.291546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.291568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:05.291577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.291584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.291586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:05.291596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.291608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:05.291624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.291789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.291797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.291811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.291890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 36 sessionId: src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0
2025-10-02T09:30:05.292264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1515a9c-d852a65d-170b6e04-a41210a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:05.294778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Write session: try to update token
2025-10-02T09:30:05.294793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:05.307178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:05.307194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.307197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:05.307199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:05.307208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.307212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.307216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554316162031523:5404]
2025-10-02T09:30:05.307254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:05.307261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.307263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:05.307262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:05.307268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:05.307276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:05.307400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:05.325838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:05.328672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:05.349220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554316237554466:6089]
2025-10-02T09:30:05.349749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7556554316237554466:6089]
2025-10-02T09:30:05.352949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:30:05.352980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-02T09:30:05.474526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:05.475017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.475037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.475071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554466:6089], now have 1 active actors on pipe
2025-10-02T09:30:05.475392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:05.476170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:05.476195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-02T09:30:05.476229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:05.476292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0
2025-10-02T09:30:05.476447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0 is DEAD
2025-10-02T09:30:05.476493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554316237554466:6089]
2025-10-02T09:30:05.477056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:05.477068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Write session will restart in 0.006667s
2025-10-02T09:30:05.477089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Write session: Do CDS request
2025-10-02T09:30:05.477096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:05.485284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.489578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:05.489598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-10-02T09:30:05.489948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.489973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:05.489979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:05.489983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:05.490459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-10-02T09:30:05.490499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:05.490501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:05.490503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:05.490508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554316237554483:6234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:05.491066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554316237554483:6234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:05.495716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554316237554483:6234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:05.499358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554316237554483:6234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:05.499390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554316237554483:6234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:05.499394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554316237554483:6234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:05.499404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:05.503035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:05.505548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:05.505723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:05.505727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:05.505737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:05.505782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:05.505821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554316162031776:5413]
2025-10-02T09:30:05.506377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:05.506762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:05.506802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:05.507095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:05.507153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.507158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.507160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.507161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.507161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.507162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.507163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.507164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.507166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.507166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.507167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.507168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.507172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.507184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.507187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.507191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.507194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.507197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.507201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.507204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.507207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.507211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.507214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.507217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.507224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.507230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.507236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.507241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.507244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.507249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.507252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.507258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.507261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.507266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.507270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.507274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.507279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.507283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.507287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.507291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.507295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.507300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.507304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.507308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.507313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.507317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.507320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.507325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.507358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:05.518588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:05.520689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:05.520710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:05.520712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:05.520716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:05.520726Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [2:7556554316162031776:5413]
2025-10-02T09:30:05.520739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:05.520757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:05.520759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.520762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.520764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.520779Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:05.520783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:05.520789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:05.520871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.520879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.520881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.520884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:05.520886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:05.520949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:05.520958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.520971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.520980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.520994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:05.521011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.521013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.521015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.521033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:05.521047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:05.521060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:05.521062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:05.521064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:05.521065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:05.521066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:05.521099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.521102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:05.521153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:05.521437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 626
2025-10-02T09:30:05.521483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 626
2025-10-02T09:30:05.521293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554637:6234], now have 1 active actors on pipe
2025-10-02T09:30:05.521301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554468:2446], now have 1 active actors on pipe
2025-10-02T09:30:05.522583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.522599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.522645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bb0025c-c2461cce-e1534e92-182f77f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:05.522659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.522664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.522666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:05.522676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.522692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:05.522753Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:30:05.522779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.523461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.523473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.523491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.523085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:30:05.523121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:30:05.523607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bb0025c-c2461cce-e1534e92-182f77f_0
2025-10-02T09:30:05.525031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8714e8b9-5322e8c8-faebc06f-afe862a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bb0025c-c2461cce-e1534e92-182f77f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:05.527728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Write session: try to update token
2025-10-02T09:30:05.527746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:05.540326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:05.540347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.540355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.540400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:05.540585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:05.540737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:05.540913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:05.541035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:05.541067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:05.541298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:05.541334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:05.552770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:05.552790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.552793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:05.552795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:05.552817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.552821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.552824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554316162031771:5413]
2025-10-02T09:30:05.552853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:05.552857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:05.552859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:05.552862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.552863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:05.552865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:05.552993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:05.553880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|6bb0025c-c2461cce-e1534e92-182f77f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:05.556473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:05.576777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554316237554717:6089]
2025-10-02T09:30:05.580884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7556554316237554717:6089]
2025-10-02T09:30:05.700149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:05.700628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.700643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.700659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554717:6089], now have 1 active actors on pipe
2025-10-02T09:30:05.700932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:05.701328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:05.701338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Write session will restart in 0.005737s
2025-10-02T09:30:05.700915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554316237554717:6089]
2025-10-02T09:30:05.700951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:05.700954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:05.701013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: error at write: Disconnected sessionId: src_id|6bb0025c-c2461cce-e1534e92-182f77f_0
2025-10-02T09:30:05.701200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|6bb0025c-c2461cce-e1534e92-182f77f_0 is DEAD
2025-10-02T09:30:05.701203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:05.701361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Write session: Do CDS request
2025-10-02T09:30:05.701511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:05.708309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.708440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:05.708456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-10-02T09:30:05.708613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.708636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:05.708641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:05.708644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:05.709141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-10-02T09:30:05.709183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:05.709187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:05.709189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:05.709194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554316237554738:6246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:05.709742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554316237554738:6246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:05.714448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554316237554738:6246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:05.717601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554316237554738:6246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:05.717619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554316237554738:6246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:05.717622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554316237554738:6246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:05.717630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:05.720089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:05.722709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:05.722906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:05.722917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:05.722926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:05.722993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:05.723055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554316162031990:5423]
2025-10-02T09:30:05.723681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:05.724007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:05.724052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:05.724358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:05.724650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.724658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.724659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.724660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.724662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.724663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.724664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.724665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.724666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.724667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.724668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.724670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.724677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.724689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.724693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.724697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.724701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.724705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.724709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.724713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.724717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.724721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.724725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.724729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.724739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.724747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.724753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.724758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.724762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.724771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.724781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.724786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.724792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.724815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.724820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.724824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.724828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.724838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.724841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.724846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.724855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.724860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.724868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.724873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.724881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.724887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.724891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.724900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.724935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:05.735401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:05.737078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:05.737097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:05.737100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:05.737104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:05.737110Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [2:7556554316162031990:5423]
2025-10-02T09:30:05.737127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:05.737147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:05.737151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.737154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.737157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.737172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:05.737177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:05.737184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:05.737247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.737255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.737258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.737261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:05.737264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:05.737328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:05.737338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.737350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.737360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.737374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:05.737392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.737396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.737398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.737406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:05.737417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:05.737420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554723:2446], now have 1 active actors on pipe
2025-10-02T09:30:05.737426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554920:6246], now have 1 active actors on pipe
2025-10-02T09:30:05.737428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:05.737430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:05.737431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:05.737443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:05.737447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:05.737481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.737494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:05.737502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:05.738141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 627
2025-10-02T09:30:05.738184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 627
2025-10-02T09:30:05.738447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.738463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.738488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:05.738495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.738499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.738501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:05.738511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.738523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:05.738536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.738766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.738775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.738789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.738940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0
2025-10-02T09:30:05.739308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bb0025c-c2461cce-e1534e92-182f77f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:05.742285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Write session: try to update token
2025-10-02T09:30:05.742302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:05.757503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:05.757524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.757533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.757581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:05.757858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:05.758071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:05.758236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:05.758405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:05.758686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:05.758746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:05.758750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:05.759779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:05.760121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:05.760133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.760136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:05.760138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:05.760145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.760149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.760153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554316162031985:5423]
2025-10-02T09:30:05.760183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:05.760189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.760191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:05.760201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:05.760206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:05.760212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:05.760324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:05.762512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:05.801023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554316237554939:6089]
2025-10-02T09:30:05.803184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7556554316237554939:6089]
2025-10-02T09:30:05.905699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:05.906160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.906169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.906189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554939:6089], now have 1 active actors on pipe
2025-10-02T09:30:05.906476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:05.906505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554316237554939:6089]
2025-10-02T09:30:05.906539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:05.906539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:05.906542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:05.906595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0
2025-10-02T09:30:05.906755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0 is DEAD
2025-10-02T09:30:05.907168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:05.907180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Write session will restart in 0.008526s
2025-10-02T09:30:05.907204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Write session: Do CDS request
2025-10-02T09:30:05.907210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:05.917245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.917360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:05.917377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-10-02T09:30:05.917507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:05.917532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:05.917537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:05.917541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:05.917961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-10-02T09:30:05.917990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:05.917991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:05.917993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:05.917998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554316237554959:6251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:05.918496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554316237554959:6251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:05.922008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554316237554959:6251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:05.929820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554316237554959:6251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:05.929840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554316237554959:6251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:05.929844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554316237554959:6251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:05.929852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:05.932974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:05.936192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:05.936387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:05.936398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:05.936407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:05.936458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:05.936492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554316162032198:5426]
2025-10-02T09:30:05.937125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:05.937519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:05.937568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:05.937891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:05.937953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.937959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.937961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.937962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.937963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.937964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.937965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.937966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.937967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.937968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.937969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.937970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.937975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.937985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.937989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.937992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.937996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.938000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.938004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.938007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.938011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.938015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.938019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.938022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.938029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.938036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:05.938042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.938047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:05.938051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.938056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:05.938062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.938066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:05.938072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.938076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:05.938081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.938086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:05.938091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.938095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:05.938100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.938104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:05.938109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.938114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:05.938119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.938123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.938128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.938133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.938138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.938142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.938179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:05.955591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:05.957521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:05.957540Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:05.957543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:05.957547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:05.957554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [2:7556554316162032198:5426]
2025-10-02T09:30:05.957568Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:05.957587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:05.957590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.957594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.957596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.957612Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:05.957618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:05.957625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:05.957693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.957707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.957709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.957713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:05.957715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:05.957791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:05.957799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.957812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:05.957822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:05.957837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:05.957855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.957857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.957860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.957867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:05.957879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:05.957881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237555139:6251], now have 1 active actors on pipe
2025-10-02T09:30:05.957882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:05.957884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:05.957887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554316237554945:2446], now have 1 active actors on pipe
2025-10-02T09:30:05.957892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:05.957907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:05.957910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:05.957945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.957986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 628
2025-10-02T09:30:05.958017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 628
2025-10-02T09:30:05.957953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:05.958279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:05.958615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.958621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.958649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:05.958656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:05.958659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:05.958661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:05.958674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:05.958684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:05.958700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.959223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:05.959232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:05.959248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:05.959371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 36 sessionId: src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0
2025-10-02T09:30:05.961048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c388120-4988c5f5-b6d2709b-dd723f47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:05.963700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Write session: try to update token
2025-10-02T09:30:05.963719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:05.971618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:05.971637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:05.971639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:05.971641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:05.971650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.971655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.971659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554316162032193:5426]
2025-10-02T09:30:05.971698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:05.971704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:05.971707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:05.971851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:05.972300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:05.972312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:05.972316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:05.982773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:05.985582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:06.004867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554320532522454:6089]
2025-10-02T09:30:06.005529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7556554320532522454:6089]
2025-10-02T09:30:06.118557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:06.118871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.118893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.118914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522454:6089], now have 1 active actors on pipe
2025-10-02T09:30:06.119170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554320532522454:6089]
2025-10-02T09:30:06.119203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:06.119206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:06.119264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0
2025-10-02T09:30:06.119437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0 is DEAD
2025-10-02T09:30:06.119495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:06.119576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:06.119586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Write session will restart in 0.009805s
2025-10-02T09:30:06.119156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:06.119608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Write session: Do CDS request
2025-10-02T09:30:06.119614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:06.130370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.130458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:06.130478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-10-02T09:30:06.130591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.130619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:06.130624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:06.130627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:06.131108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-10-02T09:30:06.131146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:06.131152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:06.131153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:06.131158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554320532522504:6255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:06.131684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554320532522504:6255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:06.134052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554320532522504:6255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:06.136519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554320532522504:6255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:06.136549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554320532522504:6255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:06.136552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554320532522504:6255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:06.136559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:06.137365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:06.139947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:06.140115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:06.140126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:06.140135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:06.140186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:06.140226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554320456999701:5428]
2025-10-02T09:30:06.140662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:06.140959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:06.140998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:06.141296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:06.141350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.141355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.141356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.141357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.141359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.141360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.141361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.141362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.141363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.141364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.141365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.141366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.141370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.141377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.141380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.141382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.141384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.141387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.141389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.141391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.141393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.141397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.141400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.141402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.141407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.141412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.141415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.141418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.141420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.141424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.141426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.141429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.141431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.141434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.141437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.141439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.141442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.141445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.141447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.141450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.141452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.141455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.141459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.141462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.141464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.141467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.141469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.141472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.141490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:06.151516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:06.153559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:06.153578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:06.153581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:06.153584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:06.153591Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [2:7556554320456999701:5428]
2025-10-02T09:30:06.153608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:06.153623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:06.153627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.153629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.153631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.153647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:06.153657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:06.153665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:06.153729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.153736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.153738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.153741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:06.153744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:06.153802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:06.153813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.153826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.153837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.153852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:06.153868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.153871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.153874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.153881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:06.153891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:06.153894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:06.153894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:06.153896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:06.153908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:06.153911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:06.153921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522457:2446], now have 1 active actors on pipe
2025-10-02T09:30:06.153924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522658:6255], now have 1 active actors on pipe
2025-10-02T09:30:06.153956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.153973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:06.153999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:06.154279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 629
2025-10-02T09:30:06.154321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 629
2025-10-02T09:30:06.154369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.154381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.154404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:06.154413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.154416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.154418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:06.154427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.154437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:06.154459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.160931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.160950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.160980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.161144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0
2025-10-02T09:30:06.161508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353e8eb6-df8d15bf-ed18235a-85041b08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:06.164166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Write session: try to update token
2025-10-02T09:30:06.164183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:06.165262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:06.165277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.165279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:06.165281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:06.165289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.165294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.165298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554320456999696:5428]
2025-10-02T09:30:06.165332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:06.165338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.165340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:06.165467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:06.165710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:06.165717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:06.165720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:06.178745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:06.181140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:06.219312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554320532522674:6089]
2025-10-02T09:30:06.219614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7556554320532522674:6089]
2025-10-02T09:30:06.308098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:06.308334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.308344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.308357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522674:6089], now have 1 active actors on pipe
2025-10-02T09:30:06.308624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:06.308633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:06.308649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554320532522674:6089]
2025-10-02T09:30:06.308674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:06.308676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:06.308733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0
2025-10-02T09:30:06.308938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0 is DEAD
2025-10-02T09:30:06.309083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:06.309095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Write session will restart in 0.007640s
2025-10-02T09:30:06.309119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Write session: Do CDS request
2025-10-02T09:30:06.309125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:06.318336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.318379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:06.318398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-10-02T09:30:06.318579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.318620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:06.318624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:06.318629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:06.319190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-10-02T09:30:06.319236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:06.319243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:06.319244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:06.319249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554320532522715:6260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:06.319762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554320532522715:6260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:06.324782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554320532522715:6260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:06.326228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:06.328975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:06.329166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:06.329176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:06.329187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:06.329247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:06.329290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554320456999910:5431]
2025-10-02T09:30:06.329702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554320532522715:6260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:06.329724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554320532522715:6260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:06.329727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554320532522715:6260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:06.329735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:06.329875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:06.330151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:06.330191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:06.330513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:06.330578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.330584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.330586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.330587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.330588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.330589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.330590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.330592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.330593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.330594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.330595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.330596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.330602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.330613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.330617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.330621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.330625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.330629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.330632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.330636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.330640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.330646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.330650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.330654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.330661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.330669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.330674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.330680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.330687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.330692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.330696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.330706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.330711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.330716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.330724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.330729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.330734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.330739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.330744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.330753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.330757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.330766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.330772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.330777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.330782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.330791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.330794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.330799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.330835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:06.340467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:06.342370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:06.342388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:06.342391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:06.342395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:06.342401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [2:7556554320456999910:5431]
2025-10-02T09:30:06.342415Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:06.342431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:06.342435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.342438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.342440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.342458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:06.342469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:06.342477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:06.342540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.342548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.342550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.342553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:06.342556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:06.342771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 630
2025-10-02T09:30:06.342771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 630
2025-10-02T09:30:06.342621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:06.342633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.342648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.342659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.342675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:06.342695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522880:6260], now have 1 active actors on pipe
2025-10-02T09:30:06.342699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522676:2446], now have 1 active actors on pipe
2025-10-02T09:30:06.342705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.342707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.342710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.342723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:06.342739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:06.342754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:06.342756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:06.342788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.342790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:06.342800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:06.342803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:06.342805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:06.342810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:06.342947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.342960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.342988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f506da40-abafa883-977c19db-8e560fb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:06.343000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.343005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.343007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:06.343031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.343046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:06.343071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.343219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.343227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.343241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.343335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 36 sessionId: src_id|f506da40-abafa883-977c19db-8e560fb0_0
2025-10-02T09:30:06.343680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c34fb7-8ee4c2e7-c665c879-11cdd1f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f506da40-abafa883-977c19db-8e560fb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:06.346285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Write session: try to update token
2025-10-02T09:30:06.346303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:06.355044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:06.355059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.355067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.355112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:06.355119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:06.355312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:06.355467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.355673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.355875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.356101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:06.356151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:06.364494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|f506da40-abafa883-977c19db-8e560fb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:06.366973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:06.365018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:06.365032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.365033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:06.365035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:06.365042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.365046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.365051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554320456999905:5431]
2025-10-02T09:30:06.365087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:06.365092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.365095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:06.365232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:06.366186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:06.366192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:06.366197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:06.408751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554320532522892:6089]
2025-10-02T09:30:06.409142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7556554320532522892:6089]
2025-10-02T09:30:06.519972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:06.520413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.520432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.520451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522892:6089], now have 1 active actors on pipe
2025-10-02T09:30:06.520982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:06.520759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554320532522892:6089]
2025-10-02T09:30:06.520819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:06.520822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:06.520889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|f506da40-abafa883-977c19db-8e560fb0_0
2025-10-02T09:30:06.521088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|f506da40-abafa883-977c19db-8e560fb0_0 is DEAD
2025-10-02T09:30:06.521155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:06.521531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:06.521543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Write session will restart in 0.009314s
2025-10-02T09:30:06.521581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Write session: Do CDS request
2025-10-02T09:30:06.521587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:06.532344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.532443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:06.532462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-10-02T09:30:06.532578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.532612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:06.532619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:06.532623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:06.533250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-10-02T09:30:06.533283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:06.533284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:06.533286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:06.533290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554320532523003:6268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:06.533781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554320532523003:6268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:06.535868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554320532523003:6268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:06.537406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:06.540489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554320532523003:6268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:06.540506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554320532523003:6268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:06.540510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554320532523003:6268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:06.540517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:06.540087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:06.540483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:06.540487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:06.540497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:06.540552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:06.540585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554320457000146:5440]
2025-10-02T09:30:06.541228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:06.541575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:06.541625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:06.541943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:06.542016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.542024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.542025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.542026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.542027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.542028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.542029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.542031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.542031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.542033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.542034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.542035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.542041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.542051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.542055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.542059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.542063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.542067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.542070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.542074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.542078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.542082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.542086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.542089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.542096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.542103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.542110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.542115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.542119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.542126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.542130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.542135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.542140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.542144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.542149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.542153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.542162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.542168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.542173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.542177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.542188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.542192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.542197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.542212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.542218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.542227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.542232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.542269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:06.551277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:06.554177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:06.554193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:06.554195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:06.554197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:06.554201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [2:7556554320457000146:5440]
2025-10-02T09:30:06.554209Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:06.554221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:06.554222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.554224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.554225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.554235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:06.554238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:06.554243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:06.554285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.554290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.554291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.554293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:06.554294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:06.554353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:06.554361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.554372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.554381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.554401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:06.554422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523106:6268], now have 1 active actors on pipe
2025-10-02T09:30:06.554430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532522901:2446], now have 1 active actors on pipe
2025-10-02T09:30:06.554435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.554437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.554438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.554450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:06.554467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:06.554470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:06.554474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 631
2025-10-02T09:30:06.554474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:06.554475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:06.554485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:06.554509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 631
2025-10-02T09:30:06.554489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:06.554518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.554525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:06.554535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:06.554668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.554681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.554709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:06.554717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.554721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.554723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:06.554733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.554742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:06.554757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.554909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.554918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.554932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.555033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0
2025-10-02T09:30:06.555304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f506da40-abafa883-977c19db-8e560fb0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:06.562045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Write session: try to update token
2025-10-02T09:30:06.562065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:06.565571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:06.565592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.565599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.565639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:06.565641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:06.565810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:06.565956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.566127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.566299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.566582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:06.566617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:06.576326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:06.576342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.576345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:06.576347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:06.576355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.576361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.576363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554320457000141:5440]
2025-10-02T09:30:06.576395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:06.576400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.576402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:06.576403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:06.576411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:06.576414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:06.576535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:06.578450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:06.580764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:06.620718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554320532523154:6089]
2025-10-02T09:30:06.621063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7556554320532523154:6089]
2025-10-02T09:30:06.719272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:06.719632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.719649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.719667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523154:6089], now have 1 active actors on pipe
2025-10-02T09:30:06.719891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:06.719910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:06.719976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: error at write: Disconnected sessionId: src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0
2025-10-02T09:30:06.720173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0 is DEAD
2025-10-02T09:30:06.720184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:06.720226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554320532523154:6089]
2025-10-02T09:30:06.720282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 164 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:30:06.720312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:06.720331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Write session will restart in 0.009356s
2025-10-02T09:30:06.720350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Write session: Do CDS request
2025-10-02T09:30:06.720356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:06.719913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:06.731435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.731610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:06.731628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-10-02T09:30:06.731771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.731814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:06.731826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:06.731831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:06.732304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-10-02T09:30:06.732336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:06.732338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:06.732341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:06.732346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554320532523233:6282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:06.733336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554320532523233:6282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:06.736533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554320532523233:6282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:06.739659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554320532523233:6282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:06.739676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554320532523233:6282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:06.739680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554320532523233:6282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:06.739687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:06.739881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:06.743164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:06.743372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:06.743383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:06.743393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:06.743450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:06.743587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554320457000381:5448]
2025-10-02T09:30:06.744216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:06.744552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:06.744605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:06.744946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:06.745001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.745006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.745007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.745008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.745010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.745011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.745012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.745013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.745015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.745016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.745017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.745018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.745023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.745034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.745038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.745043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.745047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.745051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.745055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.745059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.745064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.745069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.745073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.745077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.745083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.745091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.745096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.745106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.745114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.745123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.745132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.745138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.745146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.745153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.745162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.745167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.745176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.745183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.745191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.745196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.745205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.745211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.745220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.745226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.745234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.745240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.745248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.745254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.745297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:06.756392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:06.758197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:06.758211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:06.758213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:06.758216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:06.758223Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [2:7556554320457000381:5448]
2025-10-02T09:30:06.758237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:06.758253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:06.758256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.758259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.758260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.758274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:06.758278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:06.758284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:06.758339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.758347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.758349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.758352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:06.758354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:06.758415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:06.758422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.758435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.758449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.758474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:06.758492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523363:6282], now have 1 active actors on pipe
2025-10-02T09:30:06.758495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523157:2446], now have 1 active actors on pipe
2025-10-02T09:30:06.758501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.758503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.758505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.758515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:06.758526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:06.758533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:06.758533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:06.758536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:06.758545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:06.758548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:06.758578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.758589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:06.758597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:06.758829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 632
2025-10-02T09:30:06.758954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 632
2025-10-02T09:30:06.759066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.759078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.759097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:06.759107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.759110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.759112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:06.759119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.759131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:06.759145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.759265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.759275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.759285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.759351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0
2025-10-02T09:30:06.759644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca61480-efb90230-cc33d15e-1c136c4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:06.762211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Write session: try to update token
2025-10-02T09:30:06.762224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:06.769545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:06.769563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.769572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.769609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:06.769622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:06.769836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:06.769976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.770111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.770251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:06.770448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:06.770485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:06.775916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:06.778355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:06.779451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.779476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.779494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:06.779497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.779500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:06.779502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:06.779509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.779513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.779516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554320457000374:5448]
2025-10-02T09:30:06.779556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:06.779561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:06.779566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.779568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:06.779570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:06.779573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:06.779700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:06.820408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554320532523380:6089]
2025-10-02T09:30:06.820843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7556554320532523380:6089]
2025-10-02T09:30:06.923030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:06.923344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:06.923376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523380:6089], now have 1 active actors on pipe
2025-10-02T09:30:06.923958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:06.923970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Write session will restart in 0.006780s
2025-10-02T09:30:06.923991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Write session: Do CDS request
2025-10-02T09:30:06.923997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:06.923492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:06.923542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554320532523380:6089]
2025-10-02T09:30:06.923560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:06.923584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:06.923586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:06.923653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: error at write: Disconnected sessionId: src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0
2025-10-02T09:30:06.923801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0 is DEAD
2025-10-02T09:30:06.932346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.932633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:06.932652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-10-02T09:30:06.932845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:06.932882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:06.932891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:06.932894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:06.933362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-10-02T09:30:06.933399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:06.933405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:06.933407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:06.933413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554320532523460:6287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:06.933920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554320532523460:6287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:06.938293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554320532523460:6287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:06.940246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:06.940438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554320532523460:6287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:06.940454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554320532523460:6287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:06.940457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554320532523460:6287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:06.940464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:06.940719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:06.940943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:06.940951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:06.940958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:06.940995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:06.941022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554320457000594:5451]
2025-10-02T09:30:06.941415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:06.941735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:06.941788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:06.942018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:06.942054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.942058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.942059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.942059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.942060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.942061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.942061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.942062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.942063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.942063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.942064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.942064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.942068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.942076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.942078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.942080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.942083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.942085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.942087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.942089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.942091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.942094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.942096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.942098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.942104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.942111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:06.942116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.942121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:06.942124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.942129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:06.942133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.942138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:06.942145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.942147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:06.942150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.942153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:06.942156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.942159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:06.942161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.942164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:06.942167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.942169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:06.942171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.942174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.942176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.942179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.942182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.942184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.942218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:06.951090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:06.952971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:06.952987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:06.952990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:06.952994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:06.953001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [2:7556554320457000594:5451]
2025-10-02T09:30:06.953015Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:06.953031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:06.953035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.953037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.953039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.953059Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:06.953063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:06.953071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:06.953134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.953142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.953144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.953147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:06.953149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:06.953219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:06.953227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.953240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:06.953250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:06.953265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:06.953284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523592:6287], now have 1 active actors on pipe
2025-10-02T09:30:06.953292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554320532523386:2446], now have 1 active actors on pipe
2025-10-02T09:30:06.953299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.953302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.953304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.953316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:06.953333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:06.953351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:06.953359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:06.953386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:06.953389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.953391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:06.953402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:06.953404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:06.953410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:06.953464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.953469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.953493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:06.953509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:06.953513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:06.953515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:06.953522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:06.953532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:06.953545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.953691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:06.953702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:06.953714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:06.954161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b0514e-582ced2d-cfd401d6-6961082b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:06.956783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Write session: try to update token
2025-10-02T09:30:06.956814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:06.953364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 633
2025-10-02T09:30:06.953362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 633
2025-10-02T09:30:06.953813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 36 sessionId: src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0
2025-10-02T09:30:06.965122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:06.965142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:06.965144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:06.965146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:06.965154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.965159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.965163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554320457000588:5451]
2025-10-02T09:30:06.965199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:06.965205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:06.965208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:06.965212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:06.965219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:06.965223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:06.965373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:06.969973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:06.972501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:07.023669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554324827490901:6089]
2025-10-02T09:30:07.023925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7556554324827490901:6089]
2025-10-02T09:30:07.113752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:07.114058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.114072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.114107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827490901:6089], now have 1 active actors on pipe
2025-10-02T09:30:07.114316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:07.114367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:07.114368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:07.114383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:07.114410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554324827490901:6089]
2025-10-02T09:30:07.114447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: error at write: Disconnected sessionId: src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0
2025-10-02T09:30:07.114612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0 is DEAD
2025-10-02T09:30:07.114752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:07.114762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Write session will restart in 0.009800s
2025-10-02T09:30:07.114785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Write session: Do CDS request
2025-10-02T09:30:07.114791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:07.125282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.125371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:07.125390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-10-02T09:30:07.125512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.125552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:07.125562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:07.125566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:07.125996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-10-02T09:30:07.126032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:07.126033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:07.126036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:07.126040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554324827491021:6291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:07.126532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554324827491021:6291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:07.128354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554324827491021:6291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:07.129071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:07.131537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:07.131768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554324827491021:6291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:07.131782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554324827491021:6291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:07.131781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:07.131789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:07.131798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:07.131785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554324827491021:6291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:07.131792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:07.131853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:07.131891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554324751968101:5453]
2025-10-02T09:30:07.132369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:07.132725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:07.132767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:07.133016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:07.133050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.133056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.133057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.133058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.133059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.133060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.133061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.133062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.133063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.133064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.133065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.133066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.133071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.133080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.133083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.133087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.133091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.133095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.133099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.133102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.133106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.133110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.133114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.133118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.133124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.133131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.133137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.133142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.133148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.133153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.133157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.133162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.133166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.133171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.133175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.133181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.133186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.133191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.133195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.133200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.133206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.133214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.133219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.133225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.133229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.133235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.133240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.133246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.133272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:07.141844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:07.143696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:07.143712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:07.143714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:07.143718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:07.143725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [2:7556554324751968101:5453]
2025-10-02T09:30:07.143738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:07.143754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:07.143757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.143760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.143762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.143778Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:07.143783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:07.143789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:07.143844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.143853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.143855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.143858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:07.143860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:07.143922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:07.143933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.143947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.143963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.143984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:07.144005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827490903:2446], now have 1 active actors on pipe
2025-10-02T09:30:07.144012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491111:6291], now have 1 active actors on pipe
2025-10-02T09:30:07.144019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.144020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.144022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.144033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:07.144049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:07.144053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:07.144056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:07.144058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:07.144066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:07.144068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:07.144100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.144110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:07.144118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:07.144116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 634
2025-10-02T09:30:07.144169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 634
2025-10-02T09:30:07.144296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.144305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.144331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:07.144342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.144348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.144350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:07.144358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.144371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:07.144388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.144582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.144593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.144613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.144712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 36 sessionId: src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0
2025-10-02T09:30:07.145063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883da5e6-a0b945cf-456a1c4a-81b5fc19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:07.147724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Write session: try to update token
2025-10-02T09:30:07.147741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:07.154891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:07.154913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.154916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:07.154918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:07.154926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.154931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.154934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554324751968096:5453]
2025-10-02T09:30:07.154967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:07.154978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.154985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:07.154980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:07.155003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:07.155009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:07.155146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:07.162354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:07.165122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:07.214639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554324827491125:6089]
2025-10-02T09:30:07.214910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7556554324827491125:6089]
2025-10-02T09:30:07.299847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:07.300185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.300197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.300213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491125:6089], now have 1 active actors on pipe
2025-10-02T09:30:07.300512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:07.300531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554324827491125:6089]
2025-10-02T09:30:07.300554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:07.300557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:07.300608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: error at write: Disconnected sessionId: src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0
2025-10-02T09:30:07.300616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:07.300787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0 is DEAD
2025-10-02T09:30:07.300943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:07.300953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Write session will restart in 0.006099s
2025-10-02T09:30:07.300975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Write session: Do CDS request
2025-10-02T09:30:07.300981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:07.308264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.308398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:07.308413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-10-02T09:30:07.308499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.308530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:07.308535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:07.308544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:07.308995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-10-02T09:30:07.309027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:07.309028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:07.309029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:07.309033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554324827491150:6296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:07.309434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554324827491150:6296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:07.311880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554324827491150:6296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:07.314651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554324827491150:6296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:07.314669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554324827491150:6296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:07.314672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554324827491150:6296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:07.314679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:07.316412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:07.319177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:07.319352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:07.319365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:07.319374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:07.319418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:07.319463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554324751968317:5456]
2025-10-02T09:30:07.320040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:07.320300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:07.320340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:07.320641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:07.320692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.320698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.320700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.320701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.320702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.320703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.320704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.320705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.320706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.320707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.320708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.320709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.320714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.320724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.320728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.320732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.320736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.320740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.320744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.320748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.320751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.320757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.320760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.320764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.320770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.320777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.320783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.320790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.320795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.320827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.320835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.320840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.320845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.320850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.320857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.320862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.320866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.320872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.320878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.320883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.320887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.320892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.320896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.320901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.320908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.320913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.320917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.320924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.320957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:07.329503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:07.331326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:07.331341Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:07.331343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:07.331347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:07.331353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [2:7556554324751968317:5456]
2025-10-02T09:30:07.331364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:07.331380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:07.331383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.331386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.331388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.331403Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:07.331409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:07.331417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:07.331474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.331481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.331483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.331486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:07.331488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:07.331550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:07.331557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.331570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.331581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.331598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:07.331614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.331620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.331622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.331634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:07.331648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:07.331650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491333:6296], now have 1 active actors on pipe
2025-10-02T09:30:07.331655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491127:2446], now have 1 active actors on pipe
2025-10-02T09:30:07.331657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:07.331659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:07.331662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:07.331676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:07.331679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:07.331708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.331719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:07.331725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:07.331715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 635
2025-10-02T09:30:07.331715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 635
2025-10-02T09:30:07.331762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.331773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.331795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:07.331800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.331804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.331806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:07.331815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.331822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:07.331836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.332049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.332064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.332086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.332197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 36 sessionId: src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0
2025-10-02T09:30:07.332565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f7f70d-4e73c243-985c0e1a-652e7155_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:07.335226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Write session: try to update token
2025-10-02T09:30:07.335241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:07.349156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:07.349170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.349357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.349413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:07.349418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:07.349593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:07.349756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.349905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.350060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.350254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:07.350299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:07.349422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:07.352068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:07.352232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.352248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.352279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:07.352349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:07.353389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:07.353404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.353407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:07.353409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:07.353416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.353420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.353424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554324751968312:5456]
2025-10-02T09:30:07.353454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:07.353455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:07.353459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:07.353462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.353465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:07.353471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:07.353599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:07.400504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554324827491348:6089]
2025-10-02T09:30:07.400778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7556554324827491348:6089]
2025-10-02T09:30:07.498033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:07.505951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.505979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.506152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.506210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.506272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.506334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.506614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.506628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.506698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.506754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.506813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.506997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.507056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.507064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.507124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.507185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.507246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.507309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.507350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.507357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.507419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.507494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.507558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.507622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.507667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.507675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.507740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.507803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.507864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.507923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.507966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.507973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.508039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.508099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.508157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.508219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.508269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.508275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.508355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.508421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.508486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.508552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.508601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.508609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.508700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.508766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.508843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.508910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.509092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.509101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.509159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.509218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.509280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.509345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.509407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.509414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.509477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.509535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.509594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.509652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.509704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.509711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.509814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491348:6089], now have 1 active actors on pipe
2025-10-02T09:30:07.510039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:07.510044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:07.510056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:07.510080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: error at write: Disconnected sessionId: src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0
2025-10-02T09:30:07.510082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554324827491348:6089]
2025-10-02T09:30:07.510107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:07.510249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0 is DEAD
2025-10-02T09:30:07.510383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:07.510393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Write session will restart in 0.008446s
2025-10-02T09:30:07.510413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Write session: Do CDS request
2025-10-02T09:30:07.510418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:07.520326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.520412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:07.520430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-10-02T09:30:07.520562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.520602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:07.520612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:07.520615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:07.521077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-10-02T09:30:07.521115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:07.521121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:07.521125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:07.521129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554324827491433:6300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:07.521603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554324827491433:6300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:07.524107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554324827491433:6300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:07.526732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:07.529487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554324827491433:6300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:07.529503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554324827491433:6300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:07.529508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554324827491433:6300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:07.529515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:07.533008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:07.533283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:07.533295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:07.533306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:07.533356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:07.533395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554324751968544:5459]
2025-10-02T09:30:07.534026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:07.534339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:07.534406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:07.534733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:07.534808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.534817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.534819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.534820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.534821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.534822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.534824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.534825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.534826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.534827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.534828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.534829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.534835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.534846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.534850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.534855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.534859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.534863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.534867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.534870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.534874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.534879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.534883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.534886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.534893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.534901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.534907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.534911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.534917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.534923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.534926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.534931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.534937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.534942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.534945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.534950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.534959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.534964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.534968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.534973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.534978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.534987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.534991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.534995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.535003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.535009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.535013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.535033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.535066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:07.545756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:07.547629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:07.547648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:07.547650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:07.547654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:07.547660Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [2:7556554324751968544:5459]
2025-10-02T09:30:07.547675Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:07.547690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:07.547693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.547696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.547698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.547713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:07.547718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:07.547724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:07.547781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.547788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.547791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.547793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:07.547795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:07.547863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:07.547871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.547885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.547895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.547910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:07.547928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491561:6300], now have 1 active actors on pipe
2025-10-02T09:30:07.547938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.547941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.547943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.547954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:07.547966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:07.547968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491350:2446], now have 1 active actors on pipe
2025-10-02T09:30:07.547969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:07.547971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:07.547975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:07.547988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:07.547996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:07.548028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.548040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:07.548065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:07.548060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 636
2025-10-02T09:30:07.548069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 636
2025-10-02T09:30:07.548195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.548208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.548235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:07.548243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.548252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.548254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:07.548264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.548279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:07.548299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.548518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.548529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.548542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.548662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0
2025-10-02T09:30:07.549005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138cd507-cd4df398-4615633e-fc7f9d2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:07.551726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Write session: try to update token
2025-10-02T09:30:07.551742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:07.561159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:07.561174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.561183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.561224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:07.561235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:07.561411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:07.561565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.561711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.561858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.562279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:07.562326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:07.565234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:07.567570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:07.567738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.567754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.567783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:07.567862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:07.570912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:07.570929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.570930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:07.570932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:07.570942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.570945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.570948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554324751968538:5459]
2025-10-02T09:30:07.570976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:07.570985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.570986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:07.570979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:07.570993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:07.571002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:07.571132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:07.610572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554324827491597:6089]
2025-10-02T09:30:07.610826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7556554324827491597:6089]
2025-10-02T09:30:07.620939Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 6 CurrentSessionLifetimeMs: 121146 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:30:07.700717Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:07.707443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.707460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.707613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.707673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.707733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.707798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.707848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.707857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.707918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.707974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.708033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.708094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.708136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.708143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.708206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.708262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.708320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.708381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.708781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.708792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.708855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.708908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.708955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.709027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.709065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.709069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.709123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.709171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.709220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.709296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.709338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.709342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.709422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.709471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.709522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.709576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.709627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.709633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.709687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.709747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.709832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.710019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.710078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.710085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.710248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.710301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.710353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.710401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.710442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.710447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.710496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.710551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.710598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.710653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.710703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.710708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.710763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:07.710817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:07.710864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:07.710914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:07.710951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:07.710955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:07.710999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491597:6089], now have 1 active actors on pipe
2025-10-02T09:30:07.711206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:07.711219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:07.711222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:07.711250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: error at write: Disconnected sessionId: src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0
2025-10-02T09:30:07.711261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554324827491597:6089]
2025-10-02T09:30:07.711379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:07.711422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0 is DEAD
2025-10-02T09:30:07.711583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:07.711591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Write session will restart in 0.009267s
2025-10-02T09:30:07.711607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Write session: Do CDS request
2025-10-02T09:30:07.711611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:07.722182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.722310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:07.722325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-10-02T09:30:07.722418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.722448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:07.722456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:07.722460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:07.722965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:07.723221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-10-02T09:30:07.723254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:07.723260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:07.723262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:07.723266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554324827491785:6312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:07.723672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554324827491785:6312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:07.725147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554324827491785:6312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:07.725282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:07.725435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:07.725442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:07.725448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:07.725484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:07.725514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554324751968795:5473]
2025-10-02T09:30:07.725899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:07.726103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:07.726137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:07.726378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:07.726414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.726417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.726418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.726419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.726419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.726420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.726420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.726421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.726421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.726422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.726422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.726423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.726426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.726432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.726434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.726436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.726438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.726440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.726442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.726444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.726446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.726448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.726450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.726452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.726455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.726459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.726462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.726465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.726469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.726471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.726474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.726476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.726479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.726481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.726483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.726486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.726488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.726491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.726493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.726495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.726498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.726500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.726502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.726507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.726511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.726515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.726519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.726523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.726543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:07.727431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554324827491785:6312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:07.727444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554324827491785:6312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:07.727447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554324827491785:6312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:07.727454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:07.734498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:07.736445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:07.736459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:07.736461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:07.736464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:07.736469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [2:7556554324751968795:5473]
2025-10-02T09:30:07.736481Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:07.736496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:07.736498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.736501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.736503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.736516Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:07.736521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:07.736527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:07.736578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.736584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.736587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.736590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:07.736591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:07.736642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:07.736649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.736663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.736674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.736696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:07.736717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491823:6312], now have 1 active actors on pipe
2025-10-02T09:30:07.736724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491609:2446], now have 1 active actors on pipe
2025-10-02T09:30:07.736730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.736733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.736735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.736746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:07.736757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:07.736761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:07.736764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:07.736766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:07.736774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:07.736777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:07.736777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 637
2025-10-02T09:30:07.736783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 637
2025-10-02T09:30:07.736821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.736832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:07.736837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:07.736847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.736856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.736898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:07.736907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.736915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.736917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:07.736924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.736936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:07.736956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.737116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.737126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.737142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.737224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 36 sessionId: src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0
2025-10-02T09:30:07.737528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd0a91bc-bacbc9b5-9b0b2d74-7050e053_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:07.740110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Write session: try to update token
2025-10-02T09:30:07.740122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:07.747458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:07.747476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.747479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:07.747481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:07.747490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.747495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.747499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554324751968788:5473]
2025-10-02T09:30:07.747532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:07.747532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:07.747536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:07.747538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:07.747541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.747542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:07.747670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:07.751757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:07.754169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:07.811624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554324827491838:6089]
2025-10-02T09:30:07.811880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7556554324827491838:6089]
2025-10-02T09:30:07.876110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:07.876545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.876557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.876589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491838:6089], now have 1 active actors on pipe
2025-10-02T09:30:07.876829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:07.876837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:07.876843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:07.876871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554324827491838:6089]
2025-10-02T09:30:07.876891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0
2025-10-02T09:30:07.876987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:07.877054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0 is DEAD
2025-10-02T09:30:07.877172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:07.877182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Write session will restart in 0.006859s
2025-10-02T09:30:07.877205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Write session: Do CDS request
2025-10-02T09:30:07.877212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:07.885158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.885255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:07.885269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-10-02T09:30:07.885682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:07.885706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:07.885712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:07.885716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:07.886109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-10-02T09:30:07.886145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:07.886152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:07.886154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:07.886158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554324827491911:6317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:07.886615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554324827491911:6317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:07.888855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554324827491911:6317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:07.890210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:07.892237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:07.892366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:07.892374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:07.892383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:07.892413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554324827491911:6317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:07.892424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:07.892423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554324827491911:6317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:07.892425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554324827491911:6317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:07.892458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554324751969013:5476]
2025-10-02T09:30:07.892430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:07.892925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:07.893145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:07.893178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:07.893495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:07.893539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.893544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.893545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.893546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.893547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.893547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.893548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.893549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.893550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.893551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.893552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.893552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.893557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.893567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.893571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.893575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.893577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.893580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.893582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.893584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.893586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.893588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.893590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.893592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.893596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.893601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:07.893607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.893610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:07.893618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.893621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:07.893624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.893627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:07.893629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.893632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:07.893635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.893637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:07.893640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.893643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:07.893645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.893648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:07.893651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.893654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:07.893656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.893658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.893661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.893664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.893666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.893668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.893686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:07.901989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:07.903404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:07.903417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:07.903418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:07.903421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:07.903424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [2:7556554324751969013:5476]
2025-10-02T09:30:07.903435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:07.903447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:07.903449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.903450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.903452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.903461Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:07.903467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:07.903472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:07.903510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.903515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.903517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.903519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:07.903520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:07.903700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 638
2025-10-02T09:30:07.903723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:07.903704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 638
2025-10-02T09:30:07.903729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.903736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:07.903742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:07.903751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:07.903765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827492055:6317], now have 1 active actors on pipe
2025-10-02T09:30:07.903767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827491843:2446], now have 1 active actors on pipe
2025-10-02T09:30:07.903780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.903783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.903793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.903795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.903796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.903805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:07.903814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:07.903823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:07.903826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:07.903826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:07.903828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:07.903828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:07.903838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:07.903845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:07.903848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:07.903849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:07.903855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:07.903864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:07.903886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.903894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:07.903900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.903905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:07.904034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.904040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.904051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:07.904112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 36 sessionId: src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0
2025-10-02T09:30:07.904437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14349ba5-7e6f24ba-f465e429-b41e4c23_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:07.906988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Write session: try to update token
2025-10-02T09:30:07.907003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:07.914614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:07.914636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.914647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.914685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:07.914688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:07.914859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:07.915013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.915191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.915332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:07.915519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:07.915560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:07.920103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:07.922189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:07.922372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:07.922389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:07.922418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:07.922503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:07.924068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:07.924085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:07.924088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:07.924090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:07.924098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.924108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.924117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554324751969007:5476]
2025-10-02T09:30:07.924152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:07.924153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:07.924161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:07.924160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:07.924163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:07.924163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:07.924399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:07.977004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554324827492066:6089]
2025-10-02T09:30:07.977295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7556554324827492066:6089]
2025-10-02T09:30:08.057992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:08.064897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.064915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.065089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.065143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.065202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.065256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.065295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.065301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.065358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.065409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.065475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.065537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.065578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.065586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.065641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.065689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.065774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.065873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.065922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.065929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.065988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.066339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.066398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.066452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.066490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.066495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.066558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.066618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.066670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.066722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.066770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.066775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.066832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.066881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.066934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.066988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.067047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.067052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.067106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.067161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.067217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.067270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.067321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.067327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.067390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.067438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.067485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.067535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.067577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.067583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.067640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.067691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.067740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.067793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.067868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.067875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.067938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.068000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.068060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.068108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.068165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.068171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.068213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554324827492066:6089], now have 1 active actors on pipe
2025-10-02T09:30:08.068446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:08.068451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:08.068467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:08.068495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: error at write: Disconnected sessionId: src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0
2025-10-02T09:30:08.068495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554324827492066:6089]
2025-10-02T09:30:08.068683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0 is DEAD
2025-10-02T09:30:08.068818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:08.068837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:08.068869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Write session will restart in 0.009165s
2025-10-02T09:30:08.068890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Write session: Do CDS request
2025-10-02T09:30:08.068897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:08.079294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.079362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:08.079379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-10-02T09:30:08.079524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.079562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:08.079574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:08.079578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:08.079976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-10-02T09:30:08.080017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:08.080023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:08.080026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:08.080031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554329122459471:6321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:08.080575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554329122459471:6321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:08.083076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554329122459471:6321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:08.083276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:08.086479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:08.086651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:08.086660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:08.086669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:08.086714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:08.086752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554329046936526:5478]
2025-10-02T09:30:08.086768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554329122459471:6321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:08.086781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554329122459471:6321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:08.086784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554329122459471:6321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:08.086794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:08.087309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:08.087615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:08.087655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:08.087943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:08.087993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.087998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.087999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.088000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.088001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.088002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.088003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.088004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.088005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.088006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.088007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.088008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.088013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.088023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.088026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.088030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.088034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.088037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.088040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.088043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.088047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.088051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.088054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.088057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.088063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.088069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.088074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.088079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.088083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.088087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.088091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.088096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.088101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.088105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.088109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.088113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.088117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.088122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.088125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.088130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.088138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.088143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.088147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.088152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.088158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.088163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.088168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.088174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.088206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:08.098647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:08.100300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:08.100316Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:08.100318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:08.100322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:08.100328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [2:7556554329046936526:5478]
2025-10-02T09:30:08.100337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:08.100353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:08.100356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.100358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.100359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.100372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:08.100379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:08.100384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:08.100431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.100437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.100438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.100441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:08.100442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:08.100499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:08.100504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.100516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.100526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.100545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:08.100565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.100574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.100575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.100583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:08.100592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:08.100595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:08.100597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:08.100599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459578:6321], now have 1 active actors on pipe
2025-10-02T09:30:08.100605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:08.100617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:08.100621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:08.100627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459365:2446], now have 1 active actors on pipe
2025-10-02T09:30:08.100659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.100670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:08.100680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:08.100696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 639
2025-10-02T09:30:08.100701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 639
2025-10-02T09:30:08.100888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.100901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.100927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e24d8c5-9847da94-ebafda36-86808f01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:08.100939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.100943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.100945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:08.100955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.100969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:08.100987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.101176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.101186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.101202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.101304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e24d8c5-9847da94-ebafda36-86808f01_0
2025-10-02T09:30:08.101711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b91024-211f7a2a-8b382ce8-d0d86b58_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e24d8c5-9847da94-ebafda36-86808f01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:08.104241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Write session: try to update token
2025-10-02T09:30:08.104253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:08.116554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|9e24d8c5-9847da94-ebafda36-86808f01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:08.117975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:08.117992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.117999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.118041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:08.118048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:08.118210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:08.118358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:08.118487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:08.118628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:08.118743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:08.118799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:08.118841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:08.118898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.118908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.118930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:08.119000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:08.125058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:08.125072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.125073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:08.125075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:08.125081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.125083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.125086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554329046936521:5478]
2025-10-02T09:30:08.125114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:08.125118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.125120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:08.125123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:08.125129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:08.125133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:08.125248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:08.168530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554329122459591:6089]
2025-10-02T09:30:08.168884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7556554329122459591:6089]
2025-10-02T09:30:08.256922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:08.264369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.264393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.264561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.264629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.264699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.264770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.264833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.264841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.264916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.264979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.265044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.265116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.265161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.265169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.265236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.265301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.265372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.265449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.265505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.265516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.265585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.265684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.265762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.265834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.265889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.265897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.265965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.266085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.266146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.266211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.266359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.266368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.266435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.266494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.266560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.266621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.266666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.266673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.266741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.266799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.266858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.266910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.266965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.266970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.267034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.267083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.267132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.267182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.267220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.267225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.267280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.267330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.267380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.267429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.267467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.267477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.267531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.267581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.267638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.267687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.267731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.267739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.267794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459591:6089], now have 1 active actors on pipe
2025-10-02T09:30:08.268072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554329122459591:6089]
2025-10-02T09:30:08.268087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:08.268091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:08.268108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:08.268113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: error at write: Disconnected sessionId: src_id|9e24d8c5-9847da94-ebafda36-86808f01_0
2025-10-02T09:30:08.268275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|9e24d8c5-9847da94-ebafda36-86808f01_0 is DEAD
2025-10-02T09:30:08.268424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:08.268432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Write session will restart in 0.009746s
2025-10-02T09:30:08.268458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Write session: Do CDS request
2025-10-02T09:30:08.268463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:08.268549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:08.279295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.279395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:08.279410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-10-02T09:30:08.279520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.279549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:08.279558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:08.279562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:08.279900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-10-02T09:30:08.279934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:08.279939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:08.279940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:08.279945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554329122459771:6326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:08.280409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554329122459771:6326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:08.280881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:08.282924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554329122459771:6326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:08.283316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:08.283482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:08.283492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:08.283502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:08.283552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:08.283592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554329046936746:5481]
2025-10-02T09:30:08.284140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:08.284381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:08.284420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:08.284712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:08.284780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.284785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.284786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.284787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.284788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.284790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.284791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.284792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.284793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.284794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.284795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.284797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.284817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.284827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.284830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.284834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.284838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.284842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.284845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.284855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.284858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.284862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.284869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.284873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.284879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.284891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.284897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.284902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.284906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.284911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.284915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.284919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.284924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.284928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.284933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.284937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.284941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.284946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.284950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.284955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.284959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.284963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.284967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.284972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.284978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.284982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.284986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.284990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.285024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:08.285245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554329122459771:6326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:08.285257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554329122459771:6326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:08.285260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554329122459771:6326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:08.285266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:08.295311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:08.297402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:08.297417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:08.297419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:08.297423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:08.297426Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [2:7556554329046936746:5481]
2025-10-02T09:30:08.297435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:08.297448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:08.297450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.297452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.297453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.297464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:08.297468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:08.297472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:08.297510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.297516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.297517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.297520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:08.297521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:08.297571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:08.297582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.297593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.297603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.297619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:08.297635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.297641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.297642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.297650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:08.297661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459812:6326], now have 1 active actors on pipe
2025-10-02T09:30:08.297664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459594:2446], now have 1 active actors on pipe
2025-10-02T09:30:08.297664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:08.297667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:08.297669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:08.297670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:08.297681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:08.297688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:08.297717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.297727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:08.297737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:08.297717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 640
2025-10-02T09:30:08.297717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 640
2025-10-02T09:30:08.297819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.297829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.297851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:08.297864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.297873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.297875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:08.297884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.297893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:08.297910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.298044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.298053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.298067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.298173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0
2025-10-02T09:30:08.298480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e24d8c5-9847da94-ebafda36-86808f01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:08.301003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Write session: try to update token
2025-10-02T09:30:08.301018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:08.312372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:08.312390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.312393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:08.312395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:08.312404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.312408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.312412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554329046936741:5481]
2025-10-02T09:30:08.312448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:08.312450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:08.312453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:08.312455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:08.312457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.312459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:08.312586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:08.314952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:08.317380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:08.368188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554329122459820:6089]
2025-10-02T09:30:08.368419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7556554329122459820:6089]
2025-10-02T09:30:08.439886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:08.440107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.440117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.440143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459820:6089], now have 1 active actors on pipe
2025-10-02T09:30:08.440352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:08.440360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554329122459820:6089]
2025-10-02T09:30:08.440368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:08.440388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:08.440415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: error at write: Disconnected sessionId: src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0
2025-10-02T09:30:08.440546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0 is DEAD
2025-10-02T09:30:08.440689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:08.440694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Write session will restart in 0.005807s
2025-10-02T09:30:08.440709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Write session: Do CDS request
2025-10-02T09:30:08.440716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:08.440760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:08.447169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.447258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:08.447270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-10-02T09:30:08.447355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.447377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:08.447386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:08.447389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:08.447682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-10-02T09:30:08.447707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:08.447712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:08.447713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:08.447717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554329122459866:6330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:08.448057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554329122459866:6330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:08.450114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554329122459866:6330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:08.452378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:08.452635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554329122459866:6330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:08.452645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554329122459866:6330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:08.452647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554329122459866:6330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:08.452651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:08.454494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:08.454641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:08.454654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:08.454662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:08.454705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:08.454737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554329046936966:5483]
2025-10-02T09:30:08.455116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:08.455351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:08.455382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:08.455574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:08.455606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.455610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.455611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.455611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.455612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.455613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.455613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.455614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.455615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.455615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.455616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.455616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.455619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.455625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.455627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.455629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.455631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.455633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.455635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.455637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.455639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.455641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.455643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.455644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.455649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.455653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.455656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.455659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.455661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.455664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.455666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.455669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.455671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.455674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.455676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.455678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.455681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.455684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.455686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.455689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.455691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.455694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.455697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.455699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.455704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.455707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.455709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.455712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.455729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:08.465636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:08.467141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:08.467157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:08.467161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:08.467165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:08.467170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [2:7556554329046936966:5483]
2025-10-02T09:30:08.467183Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:08.467199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:08.467202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.467205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.467207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.467221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:08.467232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:08.467244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:08.467304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.467311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.467312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.467314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:08.467316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:08.467373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:08.467380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.467391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.467406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.467421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:08.467437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122459821:2446], now have 1 active actors on pipe
2025-10-02T09:30:08.467445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460037:6330], now have 1 active actors on pipe
2025-10-02T09:30:08.467450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.467452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.467454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.467466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:08.467476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:08.467478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:08.467483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:08.467485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:08.467491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:08.467494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:08.467522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.467534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:08.467535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 641
2025-10-02T09:30:08.467544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 641
2025-10-02T09:30:08.467561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:08.467593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.467600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.467617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e368662-294bc271-b8280685-3bb2e09f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:08.467626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.467630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.467632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:08.467639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.467646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:08.467661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.467834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.467846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.467864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.467966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e368662-294bc271-b8280685-3bb2e09f_0
2025-10-02T09:30:08.468261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c96ea90-81d7c4fa-6f6c693b-c9edf701_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e368662-294bc271-b8280685-3bb2e09f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:08.470712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Write session: try to update token
2025-10-02T09:30:08.470729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:08.480238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:08.480252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.480254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:08.480255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:08.480261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.480264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.480267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554329046936960:5483]
2025-10-02T09:30:08.480299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:08.480311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.480312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:08.480314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:08.480320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:08.480323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:08.480428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:08.483516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|3e368662-294bc271-b8280685-3bb2e09f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:08.485808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:08.540725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554329122460049:6089]
2025-10-02T09:30:08.541021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7556554329122460049:6089]
2025-10-02T09:30:08.622868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:08.623526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.623545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.623581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460049:6089], now have 1 active actors on pipe
2025-10-02T09:30:08.623784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:08.623827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554329122460049:6089]
2025-10-02T09:30:08.623855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:08.623928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:08.624000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e368662-294bc271-b8280685-3bb2e09f_0
2025-10-02T09:30:08.624372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:08.624384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Write session will restart in 0.007513s
2025-10-02T09:30:08.624405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Write session: Do CDS request
2025-10-02T09:30:08.624411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:08.624177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|3e368662-294bc271-b8280685-3bb2e09f_0 is DEAD
2025-10-02T09:30:08.633350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.633387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:08.633403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-10-02T09:30:08.633542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.633571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:08.633582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:08.633587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:08.633930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-10-02T09:30:08.633961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:08.633967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:08.633969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:08.633974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554329122460087:6341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:08.634420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554329122460087:6341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:08.636128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554329122460087:6341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:08.639209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554329122460087:6341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:08.639224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554329122460087:6341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:08.639226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554329122460087:6341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:08.639233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:08.646711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:08.649503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:08.649708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:08.649723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:08.649733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:08.649783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:08.649825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554329046937227:5492]
2025-10-02T09:30:08.650515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:08.650806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:08.650848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:08.651183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:08.651245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.651251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.651252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.651253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.651254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.651255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.651257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.651258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.651259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.651260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.651261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.651262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.651267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.651277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.651281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.651285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.651289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.651292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.651296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.651300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.651305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.651309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.651312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.651316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.651322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.651329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.651335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.651340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.651344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.651349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.651355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.651360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.651365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.651369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.651373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.651378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.651382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.651387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.651391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.651395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.651400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.651404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.651408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.651413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.651420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.651425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.651434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.651438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.651470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:08.662704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:08.664219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:08.664234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:08.664236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:08.664239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:08.664244Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [2:7556554329046937227:5492]
2025-10-02T09:30:08.664255Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:08.664270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:08.664272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.664275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.664277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.664295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:08.664306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:08.664316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:08.664363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.664369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.664371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.664373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:08.664376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:08.664442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:08.664455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.664468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.664478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.664494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:08.664518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460136:6341], now have 1 active actors on pipe
2025-10-02T09:30:08.664522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460063:2446], now have 1 active actors on pipe
2025-10-02T09:30:08.664530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.664532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.664534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.664545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:08.664558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:08.664560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:08.664562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:08.664564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:08.664575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:08.664578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:08.664611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.664622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:08.664628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:08.664606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 642
2025-10-02T09:30:08.664648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 642
2025-10-02T09:30:08.664828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.664835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.664853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c58a963-f796c4ee-38011230-4a94634d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:08.664862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.664866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.664867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:08.664876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.664889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:08.664905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.667316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.667333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.667358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.667466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 36 sessionId: src_id|c58a963-f796c4ee-38011230-4a94634d_0
2025-10-02T09:30:08.667827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e368662-294bc271-b8280685-3bb2e09f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c58a963-f796c4ee-38011230-4a94634d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:08.670358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Write session: try to update token
2025-10-02T09:30:08.670374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:08.678493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:08.678515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.678524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.678545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:08.678561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:08.678743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:08.678894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:08.679058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:08.679214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:08.679427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:08.679479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:08.685779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|c58a963-f796c4ee-38011230-4a94634d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:08.688417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:08.688715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.688736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.688770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:08.688857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:08.692687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:08.692706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.692709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:08.692711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:08.692721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.692725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.692729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554329046937222:5492]
2025-10-02T09:30:08.692767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:08.692776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.692775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:08.692778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:08.692781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:08.692784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:08.692935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:08.724014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554329122460313:6089]
2025-10-02T09:30:08.724288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7556554329122460313:6089]
2025-10-02T09:30:08.837345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:08.845402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.845431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.845593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.845662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.845726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.845788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.845830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.845840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.845912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.845978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.846043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.846111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.846153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.846160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.846228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.846287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.846350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.846417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.846460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.846467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.846530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.846600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.846693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.846762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.846806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.846814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.846887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.846978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.847051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.847118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.847170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.847177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.847245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.847312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.847375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.847436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.847494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.847505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.847572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.847632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.847719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.847795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.847855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.847862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.847931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.847992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.848058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.848120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.848183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.848190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.848252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.848312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.848380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.848450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.848513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.848520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.848583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:08.848643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:08.848705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:08.848772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:08.848841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:08.848849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:08.848907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460313:6089], now have 1 active actors on pipe
2025-10-02T09:30:08.849078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:08.849131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554329122460313:6089]
2025-10-02T09:30:08.849131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:08.849135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:08.849160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: error at write: Disconnected sessionId: src_id|c58a963-f796c4ee-38011230-4a94634d_0
2025-10-02T09:30:08.849345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|c58a963-f796c4ee-38011230-4a94634d_0 is DEAD
2025-10-02T09:30:08.849491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:08.849498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Write session will restart in 0.006361s
2025-10-02T09:30:08.849518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Write session: Do CDS request
2025-10-02T09:30:08.849524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:08.849993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:08.857316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.857423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:08.857446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-10-02T09:30:08.857555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:08.857601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:08.857611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:08.857614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:08.857967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-10-02T09:30:08.857997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:08.858002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:08.858003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:08.858006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554329122460349:6347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:08.858493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554329122460349:6347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:08.861358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554329122460349:6347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:08.864704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554329122460349:6347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:08.864734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554329122460349:6347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:08.864738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554329122460349:6347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:08.864745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:08.866423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:08.869297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:08.869583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:08.869591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:08.869601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:08.869651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:08.869683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554329046937458:5501]
2025-10-02T09:30:08.870092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:08.870474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:08.870532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:08.870786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:08.870835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.870840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.870841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.870842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.870843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.870844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.870845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.870846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.870847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.870847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.870848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.870849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.870854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.870862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.870865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.870867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.870869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.870871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.870873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.870876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.870878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.870880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.870882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.870884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.870889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.870894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:08.870899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.870902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:08.870907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.870909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:08.870912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.870915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:08.870917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.870920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:08.870923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.870926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:08.870928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.870931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:08.870934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.870936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:08.870939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.870942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:08.870945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.870948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.870950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.870953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.870956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.870958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.870980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:08.882052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:08.883798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:08.883817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:08.883821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:08.883825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:08.883832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [2:7556554329046937458:5501]
2025-10-02T09:30:08.883846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:08.883864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:08.883873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.883877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.883879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.883897Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:08.883908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:08.883915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:08.883976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.883985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.883986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.883989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:08.883992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:08.884064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:08.884076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.884088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:08.884097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:08.884112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:08.884133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460326:2446], now have 1 active actors on pipe
2025-10-02T09:30:08.884138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460540:6347], now have 1 active actors on pipe
2025-10-02T09:30:08.884144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.884148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.884150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.884165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:08.884182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:08.884189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:08.884162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 643
2025-10-02T09:30:08.884192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:08.884170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 643
2025-10-02T09:30:08.884194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:08.884200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:08.884203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:08.884246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.884258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:08.884264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:08.884273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.884280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.884324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47621a7a-6300e73d-cb146ee3-c321e452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:08.884335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:08.884338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:08.884340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:08.884349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:08.884358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:08.884380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.884553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:08.884562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:08.884577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:08.884648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 36 sessionId: src_id|47621a7a-6300e73d-cb146ee3-c321e452_0
2025-10-02T09:30:08.885009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58a963-f796c4ee-38011230-4a94634d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47621a7a-6300e73d-cb146ee3-c321e452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:08.887537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Write session: try to update token
2025-10-02T09:30:08.887552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:08.898236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:08.898255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:08.898257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:08.898260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:08.898266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.898271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.898274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554329046937453:5501]
2025-10-02T09:30:08.898308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:08.898314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:08.898317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:08.898319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:08.898328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:08.898333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:08.898471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:08.903444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|47621a7a-6300e73d-cb146ee3-c321e452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:08.906276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:08.950837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554329122460554:6089]
2025-10-02T09:30:08.951278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7556554329122460554:6089]
2025-10-02T09:30:09.041842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:09.042414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.042429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.042464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554329122460554:6089], now have 1 active actors on pipe
2025-10-02T09:30:09.042668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:09.042687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:09.042742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554329122460554:6089]
2025-10-02T09:30:09.042762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:09.042830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47621a7a-6300e73d-cb146ee3-c321e452_0
2025-10-02T09:30:09.042996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|47621a7a-6300e73d-cb146ee3-c321e452_0 is DEAD
2025-10-02T09:30:09.043143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:09.043156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Write session will restart in 0.008542s
2025-10-02T09:30:09.043178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Write session: Do CDS request
2025-10-02T09:30:09.043183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:09.053418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.053493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:09.053510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-10-02T09:30:09.053595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.053622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:09.053631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:09.053635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:09.053977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-10-02T09:30:09.054008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:09.054014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:09.054016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:09.054021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554333417427976:6351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:09.054474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554333417427976:6351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:09.056475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554333417427976:6351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:09.056826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:09.059475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:09.059662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:09.059673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:09.059682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:09.059744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:09.059786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554333341904975:5503]
2025-10-02T09:30:09.060371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:09.060693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:09.060738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:09.060960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554333417427976:6351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:09.060976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554333417427976:6351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:09.060981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554333417427976:6351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:09.060988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:09.061029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:09.061093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.061094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.061095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.061096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.061097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.061098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.061099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.061100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.061101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.061102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.061103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.061104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.061109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.061120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.061123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.061126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.061130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.061133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.061136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.061139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.061143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.061146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.061150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.061153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.061159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.061166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.061171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.061175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.061179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.061183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.061186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.061190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.061197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.061200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.061204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.061208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.061212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.061216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.061220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.061224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.061227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.061232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.061235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.061239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.061243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.061247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.061250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.061254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.061284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:09.071499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:09.073104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:09.073120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:09.073123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:09.073127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:09.073133Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [2:7556554333341904975:5503]
2025-10-02T09:30:09.073147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:09.073164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:09.073166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.073169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.073171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.073184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:09.073189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:09.073196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:09.073250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.073261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.073263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.073266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:09.073268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:09.073330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:09.073337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.073349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.073363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.073379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:09.073401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417427853:2446], now have 1 active actors on pipe
2025-10-02T09:30:09.073408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428072:6351], now have 1 active actors on pipe
2025-10-02T09:30:09.073414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.073416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.073419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.073431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:09.073468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 644
2025-10-02T09:30:09.073488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 644
2025-10-02T09:30:09.073446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:09.073458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:09.073461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:09.073492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.073494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:09.073520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:09.073524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:09.073527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:09.073533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:09.073658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.073670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.073690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d32211a-edc7056a-be09678e-940b8390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:09.073696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.073699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.073701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:09.073712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.073725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:09.073743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.074032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.074041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.074055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.074189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d32211a-edc7056a-be09678e-940b8390_0
2025-10-02T09:30:09.074556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47621a7a-6300e73d-cb146ee3-c321e452_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d32211a-edc7056a-be09678e-940b8390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:09.077188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Write session: try to update token
2025-10-02T09:30:09.077204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:09.090757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:09.090778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.090788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.090834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:09.090838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:09.091035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:09.091220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|5d32211a-edc7056a-be09678e-940b8390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:09.091183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:09.091363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:09.091518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:09.091716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:09.091762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:09.093807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:09.093998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.094014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.094041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:09.094129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:09.095386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:09.095399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.095401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:09.095402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:09.095408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.095412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.095415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554333341904970:5503]
2025-10-02T09:30:09.095441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:09.095446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.095452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:09.095458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:09.095463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:09.095470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:09.095565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:09.142827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554333417428082:6089]
2025-10-02T09:30:09.143147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7556554333417428082:6089]
2025-10-02T09:30:09.229145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:09.235971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.235992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.236121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.236172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.236233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.236285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.236327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.236337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.236393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.236444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.236508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.236568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.236606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.236613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.236673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.236728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.236784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.236856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.236905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.236912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.236967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.237022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.237080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.237138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.237178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.237185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.237246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.237332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.237387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.237439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.237479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.237486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.237554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.237613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.237668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.237723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.237767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.237774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.237838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.237893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.237950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.238003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.238049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.238055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.238112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.238168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.238224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.238281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.238324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.238330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.238386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.238438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.238493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.238578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.238662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.238667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.238718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.238764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.238813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.238868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.238921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.238926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.238962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428082:6089], now have 1 active actors on pipe
2025-10-02T09:30:09.239156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:09.239191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:09.239194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:09.239201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554333417428082:6089]
2025-10-02T09:30:09.239220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: error at write: Disconnected sessionId: src_id|5d32211a-edc7056a-be09678e-940b8390_0
2025-10-02T09:30:09.239404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|5d32211a-edc7056a-be09678e-940b8390_0 is DEAD
2025-10-02T09:30:09.239538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:09.239547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Write session will restart in 0.006563s
2025-10-02T09:30:09.239565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Write session: Do CDS request
2025-10-02T09:30:09.239571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:09.239748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:09.247289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.247390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:09.247413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-10-02T09:30:09.247509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.247546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:09.247556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:09.247560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:09.247947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-10-02T09:30:09.247977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:09.247983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:09.247985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:09.247991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554333417428128:6356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:09.248662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554333417428128:6356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:09.251703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554333417428128:6356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:09.254606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554333417428128:6356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:09.254618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554333417428128:6356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:09.254621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554333417428128:6356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:09.254627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:09.254783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:09.257192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:09.257353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:09.257365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:09.257374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:09.257426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:09.257472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554333341905202:5506]
2025-10-02T09:30:09.257856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:09.258096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:09.258140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:09.258430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:09.258504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.258513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.258514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.258515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.258516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.258517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.258518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.258519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.258520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.258521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.258522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.258523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.258528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.258538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.258543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.258546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.258549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.258552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.258555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.258559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.258563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.258567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.258570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.258574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.258580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.258587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.258591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.258596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.258598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.258601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.258603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.258606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.258608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.258611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.258613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.258616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.258618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.258621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.258623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.258626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.258628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.258631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.258633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.258636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.258639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.258641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.258643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.258646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.258663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:09.267434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:09.269023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:09.269039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:09.269042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:09.269045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:09.269051Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [2:7556554333341905202:5506]
2025-10-02T09:30:09.269069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:09.269088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:09.269094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.269097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.269099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.269112Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:09.269121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:09.269127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:09.269184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.269191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.269193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.269196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:09.269199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:09.269259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:09.269266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.269280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.269294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.269311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:09.269333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428305:6356], now have 1 active actors on pipe
2025-10-02T09:30:09.269340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428087:2446], now have 1 active actors on pipe
2025-10-02T09:30:09.269345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.269351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.269353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.269364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:09.269379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:09.269384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:09.269387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:09.269390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:09.269397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:09.269400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:09.269427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.269397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 645
2025-10-02T09:30:09.269434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:09.269401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 645
2025-10-02T09:30:09.269436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:09.269447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.269451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.269489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:09.269498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.269503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.269506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:09.269513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.269524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:09.269544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.269666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.269673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.269684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.269737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 36 sessionId: src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0
2025-10-02T09:30:09.270007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d32211a-edc7056a-be09678e-940b8390_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:09.272285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Write session: try to update token
2025-10-02T09:30:09.272300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:09.280139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:09.280153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.280155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:09.280157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:09.280163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.280166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.280170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554333341905196:5506]
2025-10-02T09:30:09.280196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:09.280200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.280202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:09.280208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:09.280213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:09.280217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:09.280328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:09.284827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:09.287225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:09.339435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554333417428317:6089]
2025-10-02T09:30:09.339709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7556554333417428317:6089]
2025-10-02T09:30:09.411219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:09.411710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.411720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.411747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428317:6089], now have 1 active actors on pipe
2025-10-02T09:30:09.411948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:09.411946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:09.411963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:09.411970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554333417428317:6089]
2025-10-02T09:30:09.411999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:09.412018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: error at write: Disconnected sessionId: src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0
2025-10-02T09:30:09.412157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0 is DEAD
2025-10-02T09:30:09.412316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:09.412324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Write session will restart in 0.006747s
2025-10-02T09:30:09.412340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Write session: Do CDS request
2025-10-02T09:30:09.412344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:09.420225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.420333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:09.420351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-10-02T09:30:09.420453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.420494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:09.420503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:09.420507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:09.420933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-10-02T09:30:09.420967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:09.420972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:09.420974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:09.420979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554333417428370:6360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:09.421455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554333417428370:6360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:09.424043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554333417428370:6360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:09.426595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:09.426648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554333417428370:6360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:09.426664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554333417428370:6360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:09.426668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554333417428370:6360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:09.426674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:09.429118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:09.429276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:09.429284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:09.429292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:09.429331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:09.429366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554333341905427:5508]
2025-10-02T09:30:09.429764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:09.430018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:09.430049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:09.430277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:09.430315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.430318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.430319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.430320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.430320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.430321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.430321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.430322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.430323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.430324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.430324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.430325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.430328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.430334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.430337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.430339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.430341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.430343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.430345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.430347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.430349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.430351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.430353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.430355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.430359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.430363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.430366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.430369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.430374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.430376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.430380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.430383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.430385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.430388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.430391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.430394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.430396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.430399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.430401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.430404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.430406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.430409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.430411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.430414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.430416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.430419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.430422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.430425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.430450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:09.439848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:09.441317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:09.441332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:09.441335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:09.441339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:09.441346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [2:7556554333341905427:5508]
2025-10-02T09:30:09.441356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:09.441369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:09.441375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.441378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.441379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.441391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:09.441398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:09.441403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:09.441460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.441464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.441466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.441468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:09.441470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:09.441518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:09.441526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.441534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.441540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.441548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:09.441560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.441563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.441564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.441569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:09.441578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:09.441579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:09.441582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:09.441584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:09.441586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:09.441588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:09.441597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428319:2446], now have 1 active actors on pipe
2025-10-02T09:30:09.441600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428539:6360], now have 1 active actors on pipe
2025-10-02T09:30:09.441629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.441642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:09.441652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:09.441658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 646
2025-10-02T09:30:09.441690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 646
2025-10-02T09:30:09.441743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.441749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.441764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:09.441772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.441775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.441776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:09.441783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.441792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:09.441807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.441933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.441941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.441949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.442008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 36 sessionId: src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0
2025-10-02T09:30:09.442298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f85390-ae61ad5c-7b1838c7-3fbb739e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:09.444582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Write session: try to update token
2025-10-02T09:30:09.444595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:09.456549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:09.456903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:09.456918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.456925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.456965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:09.456975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:09.457116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:09.457246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:09.457380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:09.457519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:09.457732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:09.457776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:09.458997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:09.459173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.459189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.459214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:09.459286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:09.461392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:09.461402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.461404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:09.461406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:09.461410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.461413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.461416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554333341905420:5508]
2025-10-02T09:30:09.461439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:09.461443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.461445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:09.461468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:09.461484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:09.461488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:09.461550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:09.511999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554333417428550:6089]
2025-10-02T09:30:09.512246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7556554333417428550:6089]
2025-10-02T09:30:09.589752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:09.602849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.602872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.603040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.603101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.603158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.603211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.603253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.603259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.603322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.603379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.603430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.603482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.603520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.603525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.603587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.603638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.603691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.603742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.603781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.603786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.603848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.603900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.603948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.604001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.604040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.604046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.604110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.604160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.604214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.604267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.604306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.604311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.604377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.604428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.604489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.604810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.604856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.604867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.605172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.605226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.605283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.605371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.605411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.605416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.605473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.605522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.605586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.605649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.605688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.605695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.605776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.605855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.605912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.605968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.606010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.606016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.606071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:09.606120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:09.606177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:09.606230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:09.606310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:09.606315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:09.606361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428550:6089], now have 1 active actors on pipe
2025-10-02T09:30:09.606616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:09.606635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554333417428550:6089]
2025-10-02T09:30:09.606665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:09.606668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:09.606694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: error at write: Disconnected sessionId: src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0
2025-10-02T09:30:09.606895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0 is DEAD
2025-10-02T09:30:09.606985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:09.606991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Write session will restart in 0.009885s
2025-10-02T09:30:09.607020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Write session: Do CDS request
2025-10-02T09:30:09.607025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:09.607290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:09.618288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.618440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:09.618455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-10-02T09:30:09.618567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.618607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:09.618617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:09.618620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:09.619005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-10-02T09:30:09.619041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:09.619046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:09.619048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:09.619053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554333417428741:6365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:09.619521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554333417428741:6365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:09.620637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:09.621511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554333417428741:6365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:09.623293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:09.623477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:09.623486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:09.623495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:09.623551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:09.623589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554333341905663:5511]
2025-10-02T09:30:09.623739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554333417428741:6365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:09.623756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554333417428741:6365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:09.623759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554333417428741:6365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:09.623765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:09.624099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:09.624351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:09.624381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:09.624580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:09.624611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.624616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.624616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.624617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.624618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.624618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.624619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.624620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.624620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.624621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.624622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.624622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.624626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.624633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.624635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.624637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.624640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.624642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.624644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.624646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.624649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.624651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.624653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.624655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.624659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.624663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.624667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.624670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.624672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.624676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.624679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.624682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.624684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.624687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.624689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.624692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.624694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.624697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.624699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.624702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.624705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.624707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.624710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.624712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.624715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.624719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.624721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.624724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.624742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:09.635701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:09.637392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:09.637411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:09.637413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:09.637417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:09.637423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [2:7556554333341905663:5511]
2025-10-02T09:30:09.637442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:09.637460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:09.637466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.637469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.637472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.637486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:09.637495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:09.637505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:09.637563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.637570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.637572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.637575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:09.637577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:09.637635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:09.637642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.637654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.637670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.637692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:09.637714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428786:6365], now have 1 active actors on pipe
2025-10-02T09:30:09.637722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428565:2446], now have 1 active actors on pipe
2025-10-02T09:30:09.637727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.637733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.637735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.637750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:09.637767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:09.637766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:09.637769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:09.637770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:09.637784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:09.637787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:09.637816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.637821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:09.637823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:09.637800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 647
2025-10-02T09:30:09.637805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 647
2025-10-02T09:30:09.637842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.637850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.637885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:09.637898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.637901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.637903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:09.637910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.637919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:09.637937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.638110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.638123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.638142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.638205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 36 sessionId: src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0
2025-10-02T09:30:09.638524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572997f-4af5ac57-b0d7b0fe-3205ad4d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:09.643828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Write session: try to update token
2025-10-02T09:30:09.643847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:09.649009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:09.649029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.649031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:09.649033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:09.649041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.649047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.649051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554333341905658:5511]
2025-10-02T09:30:09.649086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:09.649092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.649094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:09.649094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:09.649100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:09.649103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:09.649219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:09.656937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:09.661189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:09.706547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554333417428813:6089]
2025-10-02T09:30:09.706784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7556554333417428813:6089]
2025-10-02T09:30:09.777295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:09.777625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.777634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.777648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428813:6089], now have 1 active actors on pipe
2025-10-02T09:30:09.777824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:09.777908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554333417428813:6089]
2025-10-02T09:30:09.777918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:09.777939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:09.778001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0
2025-10-02T09:30:09.778163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0 is DEAD
2025-10-02T09:30:09.778299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:09.778310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Write session will restart in 0.009260s
2025-10-02T09:30:09.778331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Write session: Do CDS request
2025-10-02T09:30:09.778337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:09.788371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.788466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:09.788486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-10-02T09:30:09.788589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.788615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:09.788624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:09.788627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:09.789002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-10-02T09:30:09.789030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:09.789035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:09.789037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:09.789041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554333417428933:6377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:09.789467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554333417428933:6377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:09.791679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554333417428933:6377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:09.792924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:09.795252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:09.795404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:09.795413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:09.795421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:09.795463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:09.795464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554333417428933:6377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:09.795477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554333417428933:6377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:09.795480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554333417428933:6377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:09.795498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554333341905926:5525]
2025-10-02T09:30:09.795487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:09.795897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:09.796143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:09.796174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:09.796363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:09.796392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.796395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.796396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.796396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.796397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.796398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.796398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.796399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.796399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.796400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.796400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.796401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.796404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.796410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.796412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.796415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.796417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.796419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.796421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.796423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.796425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.796427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.796429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.796431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.796435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.796439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.796443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.796446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.796448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.796451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.796453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.796456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.796458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.796461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.796465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.796470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.796474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.796478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.796481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.796486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.796490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.796494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.796496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.796499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.796511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.796514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.796516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.796519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.796538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:09.804781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:09.806408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:09.806421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:09.806423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:09.806426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:09.806432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [2:7556554333341905926:5525]
2025-10-02T09:30:09.806443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:09.806460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:09.806462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.806465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.806467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.806479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:09.806484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:09.806490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:09.806539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.806546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.806548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.806551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:09.806553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:09.806613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:09.806620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.806631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.806645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.806663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:09.806685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417429056:6377], now have 1 active actors on pipe
2025-10-02T09:30:09.806692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417428833:2446], now have 1 active actors on pipe
2025-10-02T09:30:09.806697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.806699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.806701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.806711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:09.806724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:09.806726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:09.806728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:09.806729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:09.806740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:09.806746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:09.806762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 648
2025-10-02T09:30:09.806773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.806781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:09.806775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 648
2025-10-02T09:30:09.806798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:09.806808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.806812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.806837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:09.806843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.806846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.806847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:09.806857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.806865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:09.806882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.806989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.806995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.807005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.807084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 36 sessionId: src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0
2025-10-02T09:30:09.807413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42db75fd-d7528031-e8cfd755-c586ccc0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:09.809941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Write session: try to update token
2025-10-02T09:30:09.809957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:09.818178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:09.818201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:09.818204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:09.818205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:09.818212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.818217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.818223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554333341905921:5525]
2025-10-02T09:30:09.818260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:09.818270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.818271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:09.818272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:09.818276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:09.818280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:09.818397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:09.823122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:09.825406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:09.878076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554333417429071:6089]
2025-10-02T09:30:09.878341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7556554333417429071:6089]
2025-10-02T09:30:09.963340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:09.964002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.964018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.964054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417429071:6089], now have 1 active actors on pipe
2025-10-02T09:30:09.964255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:09.964381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554333417429071:6089]
2025-10-02T09:30:09.964391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:09.964394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:09.964406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:09.964449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: error at write: Disconnected sessionId: src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0
2025-10-02T09:30:09.964617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0 is DEAD
2025-10-02T09:30:09.964773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:09.964785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Write session will restart in 0.007484s
2025-10-02T09:30:09.964831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Write session: Do CDS request
2025-10-02T09:30:09.964839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:09.973276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.973386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:09.973403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-10-02T09:30:09.973525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:09.973569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:09.973578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:09.973582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:09.973966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-10-02T09:30:09.974005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:09.974013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:09.974015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:09.974019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554333417429123:6381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:09.974499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554333417429123:6381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:09.977394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554333417429123:6381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:09.980060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554333417429123:6381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:09.980072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554333417429123:6381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:09.980076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554333417429123:6381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:09.980082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:09.980500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:09.983180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:09.983357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:09.983360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:09.983370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:09.983424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:09.983458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554333341906156:5528]
2025-10-02T09:30:09.984005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:09.984327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:09.984375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:09.984668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:09.984739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.984746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.984747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.984748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.984749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.984750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.984751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.984752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.984753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.984754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.984755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.984756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.984761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.984770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.984774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.984778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.984781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.984785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.984788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.984791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.984795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.984815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.984820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.984824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.984831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.984837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:09.984845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.984849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:09.984858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.984863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:09.984867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.984876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:09.984880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.984889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:09.984893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.984897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:09.984903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.984907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:09.984911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.984915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:09.984924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.984929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:09.984936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.984940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.984945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.984952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.984956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.984961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.985001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:09.993880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:09.995557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:09.995578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:09.995581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:09.995585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:09.995592Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [2:7556554333341906156:5528]
2025-10-02T09:30:09.995607Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:09.995625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:09.995628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.995631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.995633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.995650Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:09.995656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:09.995668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:09.995733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.995741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.995744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.995747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:09.995749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:09.995817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:09.995824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:09.995837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:09.995850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:09.995869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:09.995892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:09.995898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:09.995900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:09.995914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:09.995932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417429075:2446], now have 1 active actors on pipe
2025-10-02T09:30:09.995937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:09.995940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554333417429294:6381], now have 1 active actors on pipe
2025-10-02T09:30:09.995942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:09.995944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:09.995948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:09.995961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:09.995964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:09.996000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:09.995966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 649
2025-10-02T09:30:09.996018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:09.995985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 649
2025-10-02T09:30:09.996040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:09.996087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.996096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.996122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32616e73-4511bf96-71043e-772d2697_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:09.996132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:09.996136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:09.996140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:09.996149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:09.996162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:09.996178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.996369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:09.996380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:09.996408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:09.996493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 36 sessionId: src_id|32616e73-4511bf96-71043e-772d2697_0
2025-10-02T09:30:09.996900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63ca9ea-5ca06969-2b6ec226-b2148c37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32616e73-4511bf96-71043e-772d2697_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:09.999456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Write session: try to update token
2025-10-02T09:30:09.999474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:10.007257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:10.007276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.007279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:10.007281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:10.007290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:10.007293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:10.007297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554333341906151:5528]
2025-10-02T09:30:10.007330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:10.007336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.007337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:10.007338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:10.007343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:10.007347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:10.007478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:10.014378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|32616e73-4511bf96-71043e-772d2697_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:10.016717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:10.064428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554337712396603:6089]
2025-10-02T09:30:10.064670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7556554337712396603:6089]
2025-10-02T09:30:10.148534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:10.149090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.149107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.149126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712396603:6089], now have 1 active actors on pipe
2025-10-02T09:30:10.149362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:10.149361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554337712396603:6089]
2025-10-02T09:30:10.149373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:10.149377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:10.149394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:10.149433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: error at write: Disconnected sessionId: src_id|32616e73-4511bf96-71043e-772d2697_0
2025-10-02T09:30:10.149760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:10.149774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Write session will restart in 0.007219s
2025-10-02T09:30:10.149601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|32616e73-4511bf96-71043e-772d2697_0 is DEAD
2025-10-02T09:30:10.149819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Write session: Do CDS request
2025-10-02T09:30:10.149828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:10.158253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.158592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:10.158607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-10-02T09:30:10.158732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.158763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:10.158767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:10.158772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:10.159239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-10-02T09:30:10.159272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:10.159274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:10.159275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:10.159280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554337712396633:6386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:10.159779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554337712396633:6386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:10.162072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554337712396633:6386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:10.166001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554337712396633:6386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:10.166022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554337712396633:6386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:10.166026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554337712396633:6386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:10.166034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:10.168943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:10.171781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:10.171964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:10.171971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:10.171978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:10.172014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:10.172046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554337636873682:5531]
2025-10-02T09:30:10.172446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:10.172688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:10.172722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:10.173001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:10.173046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.173051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.173052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.173053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.173053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.173054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.173055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.173056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.173056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.173057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.173058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.173058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.173061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.173068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.173070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.173073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.173075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.173077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.173079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.173081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.173084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.173086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.173088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.173090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.173095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.173100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.173103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.173107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.173109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.173112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.173114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.173117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.173120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.173123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.173125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.173128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.173131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.173134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.173136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.173139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.173141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.173144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.173148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.173151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.173156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.173159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.173161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.173164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.173182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:10.182536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:10.184318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:10.184336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:10.184339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:10.184342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:10.184350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [2:7556554337636873682:5531]
2025-10-02T09:30:10.184365Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:10.184380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:10.184383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.184385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.184388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.184403Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:10.184407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:10.184414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:10.184468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.184476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.184478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.184481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:10.184483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:10.184543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:10.184554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.184566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.184576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.184591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:10.184606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.184608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.184609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.184616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:10.184625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:10.184627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:10.184628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:10.184630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:10.184640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:10.184643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:10.184653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712396804:6386], now have 1 active actors on pipe
2025-10-02T09:30:10.184769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 650
2025-10-02T09:30:10.184797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 650
2025-10-02T09:30:10.184656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712396605:2446], now have 1 active actors on pipe
2025-10-02T09:30:10.184685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.184693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:10.184723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:10.184986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.185001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.185024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:10.185034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.185037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.185043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:10.185054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.185069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:10.185088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.185286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.185298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.185316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.185392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 36 sessionId: src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0
2025-10-02T09:30:10.185729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32616e73-4511bf96-71043e-772d2697_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:10.188257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Write session: try to update token
2025-10-02T09:30:10.188276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:10.196206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:10.196227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.196229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:10.196232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:10.196239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.196243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.196246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554337636873677:5531]
2025-10-02T09:30:10.196280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:10.196286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.196286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:10.196291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:10.196294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:10.196294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:10.196499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:10.201588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:10.205414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:10.249764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554337712396843:6089]
2025-10-02T09:30:10.250017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7556554337712396843:6089]
2025-10-02T09:30:10.342151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:10.342470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.342484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.342500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712396843:6089], now have 1 active actors on pipe
2025-10-02T09:30:10.342708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:10.343619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:10.343631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Write session will restart in 0.009523s
2025-10-02T09:30:10.343653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Write session: Do CDS request
2025-10-02T09:30:10.343659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:10.343223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554337712396843:6089]
2025-10-02T09:30:10.343255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:10.343316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0
2025-10-02T09:30:10.343475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0 is DEAD
2025-10-02T09:30:10.343626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:10.354297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.354514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:10.354534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-10-02T09:30:10.355237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.355278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:10.355283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:10.355287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:10.355694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-10-02T09:30:10.355724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:10.355730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:10.355732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:10.355737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554337712396899:6390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:10.356222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554337712396899:6390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:10.360157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554337712396899:6390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:10.368167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:10.368185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554337712396899:6390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:10.368203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554337712396899:6390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:10.368207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554337712396899:6390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:10.368215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:10.371403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:10.371624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:10.371636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:10.371645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:10.371692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:10.371730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554337636873912:5533]
2025-10-02T09:30:10.372345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:10.372656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:10.372696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:10.373000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:10.373047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.373048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.373049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.373050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.373052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.373053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.373054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.373055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.373056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.373057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.373058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.373059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.373064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.373074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.373078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.373082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.373085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.373088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.373092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.373095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.373099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.373103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.373107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.373110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.373117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.373124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.373129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.373134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.373139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.373144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.373148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.373153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.373157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.373162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.373166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.373171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.373176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.373181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.373186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.373191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.373195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.373200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.373204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.373209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.373215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.373219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.373223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.373228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.373264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:10.382264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:10.383925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:10.383941Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:10.383944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:10.383948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:10.383953Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [2:7556554337636873912:5533]
2025-10-02T09:30:10.383966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:10.383984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:10.383986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.383989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.383991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.384005Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:10.384014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:10.384020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:10.384074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.384080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.384083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.384086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:10.384089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:10.384149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:10.384155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.384167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.384182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.384201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:10.384224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397068:6390], now have 1 active actors on pipe
2025-10-02T09:30:10.384232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712396847:2446], now have 1 active actors on pipe
2025-10-02T09:30:10.384238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.384239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.384241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.384252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:10.384266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:10.384268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:10.384278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:10.384280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:10.384280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:10.384283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:10.384316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.384323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:10.384329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:10.384366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 651
2025-10-02T09:30:10.384398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 651
2025-10-02T09:30:10.384476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.384487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.384512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:10.384518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.384521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.384523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:10.384531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.384540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:10.384554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.384704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.384716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.384737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.386727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 36 sessionId: src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0
2025-10-02T09:30:10.387191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fcad407-a13f25ff-5cb347d-644dc3e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:10.389666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Write session: try to update token
2025-10-02T09:30:10.389681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:10.395233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:10.395249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.395251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:10.395252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:10.395258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.395262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.395266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554337636873905:5533]
2025-10-02T09:30:10.395303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:10.395310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.395312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:10.395344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:10.395360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:10.395363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:10.395449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:10.402798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:10.405530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:10.443332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554337712397081:6089]
2025-10-02T09:30:10.443606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7556554337712397081:6089]
2025-10-02T09:30:10.528537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:10.529046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.529059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.529076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397081:6089], now have 1 active actors on pipe
2025-10-02T09:30:10.529276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:10.529659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:10.529670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Write session will restart in 0.006488s
2025-10-02T09:30:10.529689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Write session: Do CDS request
2025-10-02T09:30:10.529694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:10.529290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:10.529307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:10.529321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554337712397081:6089]
2025-10-02T09:30:10.529340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:10.529360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0
2025-10-02T09:30:10.529521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0 is DEAD
2025-10-02T09:30:10.537300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.537380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:10.537396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-10-02T09:30:10.537520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.537560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:10.537568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:10.537572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:10.538052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-10-02T09:30:10.538092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:10.538093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:10.538094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:10.538099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554337712397116:6394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:10.538575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554337712397116:6394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:10.541484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554337712397116:6394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:10.543881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554337712397116:6394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:10.543893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554337712397116:6394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:10.543896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554337712397116:6394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:10.543902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:10.545410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:10.547986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:10.548144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:10.548157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:10.548167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:10.548212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:10.548245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554337636874154:5536]
2025-10-02T09:30:10.548864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:10.549177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:10.549216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:10.549515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:10.549564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.549570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.549571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.549572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.549573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.549574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.549575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.549576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.549578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.549579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.549580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.549581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.549586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.549597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.549601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.549605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.549609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.549613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.549617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.549620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.549624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.549628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.549632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.549636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.549642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.549649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.549655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.549660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.549664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.549669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.549673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.549678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.549683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.549688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.549694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.549704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.549709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.549719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.549723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.549732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.549736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.549742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.549750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.549756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.549760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.549767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.549775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.549780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.549815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:10.558484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:10.560315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:10.560331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:10.560333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:10.560336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:10.560341Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [2:7556554337636874154:5536]
2025-10-02T09:30:10.560353Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:10.560367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:10.560370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.560372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.560374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.560389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:10.560393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:10.560399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:10.560654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 652
2025-10-02T09:30:10.560456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.560466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.560709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 652
2025-10-02T09:30:10.560468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.560471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:10.560474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:10.560536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:10.560538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.560550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.560561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.560577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:10.560593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.560595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.560597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.560604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:10.560616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397084:2446], now have 1 active actors on pipe
2025-10-02T09:30:10.560620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397307:6394], now have 1 active actors on pipe
2025-10-02T09:30:10.560621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:10.560626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:10.560627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:10.560628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:10.560641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:10.560644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:10.560672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.560676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:10.560683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:10.560857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.560874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.560903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7370229-b6d6e6ba-621c258f-332e2151_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:10.560918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.560927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.560930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:10.560943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.560965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:10.560981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.561178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.561186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.561197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.561270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 36 sessionId: src_id|7370229-b6d6e6ba-621c258f-332e2151_0
2025-10-02T09:30:10.561724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4077639a-454dc72e-ca1a4389-95b8bfd3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7370229-b6d6e6ba-621c258f-332e2151_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:10.564394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Write session: try to update token
2025-10-02T09:30:10.564411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:10.571890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:10.571908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.571910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:10.571911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:10.571919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.571923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.571927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554337636874149:5536]
2025-10-02T09:30:10.571961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:10.571966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.571968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:10.571978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:10.571984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:10.571988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:10.572142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:10.578376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|7370229-b6d6e6ba-621c258f-332e2151_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:10.580675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:10.629674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554337712397333:6089]
2025-10-02T09:30:10.629977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7556554337712397333:6089]
2025-10-02T09:30:10.704256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:10.704494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.704506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.704519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397333:6089], now have 1 active actors on pipe
2025-10-02T09:30:10.704724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:10.704716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554337712397333:6089]
2025-10-02T09:30:10.704724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:10.704749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:10.704751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:10.704812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|7370229-b6d6e6ba-621c258f-332e2151_0
2025-10-02T09:30:10.704964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|7370229-b6d6e6ba-621c258f-332e2151_0 is DEAD
2025-10-02T09:30:10.705108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:10.705119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Write session will restart in 0.009608s
2025-10-02T09:30:10.705140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Write session: Do CDS request
2025-10-02T09:30:10.705146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:10.716254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.716334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:10.716349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-10-02T09:30:10.716475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.716516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:10.716524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:10.716528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:10.716919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-10-02T09:30:10.716949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:10.716954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:10.716955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:10.716960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554337712397474:6405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:10.717423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554337712397474:6405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:10.719323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554337712397474:6405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:10.720859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:10.723653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:10.723825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:10.723835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:10.723845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:10.723908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:10.723942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554337636874413:5548]
2025-10-02T09:30:10.724036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554337712397474:6405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:10.724047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554337712397474:6405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:10.724049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554337712397474:6405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:10.724054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:10.724518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:10.724834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:10.724886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:10.725189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:10.725242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.725246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.725247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.725248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.725248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.725249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.725250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.725250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.725251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.725251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.725252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.725253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.725256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.725262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.725267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.725269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.725271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.725273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.725275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.725278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.725280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.725282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.725284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.725288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.725293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.725296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.725299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.725301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.725304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.725307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.725310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.725312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.725315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.725319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.725323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.725327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.725332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.725337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.725342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.725346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.725351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.725355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.725359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.725363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.725368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.725371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.725376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.725408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:10.737560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:10.739567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:10.739582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:10.739585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:10.739589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:10.739595Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [2:7556554337636874413:5548]
2025-10-02T09:30:10.739614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:10.739635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:10.739642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.739645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.739647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.739665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:10.739673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:10.739679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:10.739807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.739814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.739816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.739818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:10.739821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:10.739916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:10.739923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.739933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.739946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.739963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:10.739984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397338:2446], now have 1 active actors on pipe
2025-10-02T09:30:10.739991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397574:6405], now have 1 active actors on pipe
2025-10-02T09:30:10.739997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.739998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.740000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.740011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:10.740023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:10.740029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:10.740032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:10.740034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:10.740040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:10.740043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:10.740079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.740092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:10.740097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:10.740177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 653
2025-10-02T09:30:10.740216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 653
2025-10-02T09:30:10.740275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.740287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.740305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3de6907a-37d57905-c42120ca-a74f5d20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:10.740315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.740318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.740320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:10.740326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.740337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:10.740350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.740557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.740566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.740580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.740653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 36 sessionId: src_id|3de6907a-37d57905-c42120ca-a74f5d20_0
2025-10-02T09:30:10.740985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7370229-b6d6e6ba-621c258f-332e2151_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3de6907a-37d57905-c42120ca-a74f5d20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:10.743368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Write session: try to update token
2025-10-02T09:30:10.743379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:10.750962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:10.750974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.750976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:10.750977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:10.750982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.750985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.750987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554337636874408:5548]
2025-10-02T09:30:10.751027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:10.751032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.751035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:10.751051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:10.751059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:10.751064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:10.751295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:10.761552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|3de6907a-37d57905-c42120ca-a74f5d20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:10.763940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:10.804839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554337712397600:6089]
2025-10-02T09:30:10.805095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7556554337712397600:6089]
2025-10-02T09:30:10.879586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:10.880036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.880049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.880064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397600:6089], now have 1 active actors on pipe
2025-10-02T09:30:10.880255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:10.880296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:10.880305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:10.880309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:10.880356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554337712397600:6089]
2025-10-02T09:30:10.880367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: error at write: Disconnected sessionId: src_id|3de6907a-37d57905-c42120ca-a74f5d20_0
2025-10-02T09:30:10.880526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|3de6907a-37d57905-c42120ca-a74f5d20_0 is DEAD
2025-10-02T09:30:10.880689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:10.880700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Write session will restart in 0.008539s
2025-10-02T09:30:10.880721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Write session: Do CDS request
2025-10-02T09:30:10.880728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:10.890206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.890337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:10.890355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-10-02T09:30:10.890880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:10.890916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:10.890925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:10.890930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:10.891381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-10-02T09:30:10.891422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:10.891428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:10.891430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:10.891435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554337712397704:6411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:10.891916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554337712397704:6411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:10.893899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554337712397704:6411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:10.896245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:10.896400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554337712397704:6411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:10.896413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554337712397704:6411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:10.896417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554337712397704:6411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:10.896422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:10.899808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:10.899958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:10.899966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:10.899973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:10.900014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:10.900052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554337636874656:5553]
2025-10-02T09:30:10.900608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:10.900816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:10.900848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:10.901124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:10.901168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.901174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.901175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.901176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.901177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.901178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.901179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.901180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.901181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.901182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.901183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.901184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.901188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.901198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.901201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.901205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.901208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.901212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.901216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.901219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.901222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.901226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.901230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.901233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.901238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.901244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:10.901253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.901262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:10.901269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.901274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:10.901282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.901286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:10.901295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.901304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:10.901311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.901320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:10.901327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.901332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:10.901340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.901349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:10.901356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.901364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:10.901368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.901376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.901384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.901389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.901392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.901400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.901436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:10.909578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:10.911263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:10.911280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:10.911283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:10.911287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:10.911293Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [2:7556554337636874656:5553]
2025-10-02T09:30:10.911308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:10.911326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:10.911329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.911332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.911334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.911347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:10.911352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:10.911358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:10.911412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.911420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.911422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.911424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:10.911426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:10.911490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:10.911497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.911509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:10.911520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:10.911538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:10.911559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397606:2446], now have 1 active actors on pipe
2025-10-02T09:30:10.911567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397832:6411], now have 1 active actors on pipe
2025-10-02T09:30:10.911574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.911576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.911578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.911589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:10.911604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:10.911604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:10.911606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:10.911608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:10.911623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:10.911626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:10.911656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.911671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:10.911648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 654
2025-10-02T09:30:10.911681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:10.911664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 654
2025-10-02T09:30:10.911723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.911731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.911753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:10.911762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:10.911765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:10.911767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:10.911775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:10.911784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:10.911803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.911948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.911954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.911966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:10.912055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0
2025-10-02T09:30:10.912389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de6907a-37d57905-c42120ca-a74f5d20_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:10.914961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Write session: try to update token
2025-10-02T09:30:10.914975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:10.924719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:10.924738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.924747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.924786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:10.924786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:10.924986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:10.925118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:10.925239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:10.925374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:10.925551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:10.925586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:10.928765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:10.931184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:10.933616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:10.933633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:10.933648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:10.933650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:10.933652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:10.933654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:10.933662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.933665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.933668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554337636874649:5553]
2025-10-02T09:30:10.933710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:10.933714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:10.933720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:10.933721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:10.933722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:10.933724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:10.933876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:10.980459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554337712397844:6089]
2025-10-02T09:30:10.980753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7556554337712397844:6089]
2025-10-02T09:30:11.068846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:11.069467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:11.069498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554337712397844:6089], now have 1 active actors on pipe
2025-10-02T09:30:11.069626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:11.069714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554337712397844:6089]
2025-10-02T09:30:11.069728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:11.069731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:11.069734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:11.069794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: error at write: Disconnected sessionId: src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0
2025-10-02T09:30:11.069951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0 is DEAD
2025-10-02T09:30:11.070090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:11.070098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Write session will restart in 0.009442s
2025-10-02T09:30:11.070117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Write session: Do CDS request
2025-10-02T09:30:11.070124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:11.080366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.080441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:11.080459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-10-02T09:30:11.080568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.080600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:11.080609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:11.080613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:11.081075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-10-02T09:30:11.081107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:11.081111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:11.081113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:11.081118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554342007365273:6415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:11.081555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554342007365273:6415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:11.083585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554342007365273:6415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:11.084510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:11.086815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:11.086977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:11.086989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:11.086998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:11.087051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:11.087087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554341931842184:5555]
2025-10-02T09:30:11.087113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554342007365273:6415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:11.087124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554342007365273:6415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:11.087128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554342007365273:6415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:11.087132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:11.087678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:11.087957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:11.088001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:11.088322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:11.088377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.088383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.088384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.088385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.088386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.088387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.088389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.088390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.088391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.088392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.088393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.088394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.088399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.088409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.088414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.088422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.088430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.088435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.088443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.088447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.088455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.088460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.088468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.088476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.088486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.088497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.088506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.088516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.088524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.088533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.088542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.088551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.088560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.088568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.088577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.088582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.088591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.088600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.088609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.088614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.088623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.088628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.088637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.088642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.088648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.088659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.088667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.088676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.088717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:11.096836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:11.098856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:11.098876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:11.098878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:11.098881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:11.098887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [2:7556554341931842184:5555]
2025-10-02T09:30:11.098899Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:11.098916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:11.098924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.098927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.098929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.098943Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:11.098954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:11.098961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:11.099028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.099037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.099039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.099043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:11.099045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:11.099109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:11.099117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.099131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.099142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.099158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:11.099175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.099182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.099184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.099195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:11.099209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:11.099212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:11.099214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:11.099218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365143:2446], now have 1 active actors on pipe
2025-10-02T09:30:11.099221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365372:6415], now have 1 active actors on pipe
2025-10-02T09:30:11.099229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:11.099241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:11.099244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:11.099275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.099291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:11.099278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 655
2025-10-02T09:30:11.099304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:11.099425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 655
2025-10-02T09:30:11.099482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.099495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.099518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:11.099533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.099541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.099543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:11.099553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.099563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:11.099576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.099771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.099784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.099798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.099892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 36 sessionId: src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0
2025-10-02T09:30:11.100218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9412d5-23ff69c1-6318d981-4ca2715c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:11.102789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Write session: try to update token
2025-10-02T09:30:11.102811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:11.110499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:11.110521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.110529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.110570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:11.110573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:11.110737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:11.110890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:11.111212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:11.111514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:11.111864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:11.111913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:11.117315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:11.119651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:11.119791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.119812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.121105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:11.121139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:11.121142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.121144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:11.121147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:11.121154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.121158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.121161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554341931842179:5555]
2025-10-02T09:30:11.121186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:11.121188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:11.121195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.121197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:11.121199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:11.121203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:11.121236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:11.121406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:11.170133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554342007365385:6089]
2025-10-02T09:30:11.170436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7556554342007365385:6089]
2025-10-02T09:30:11.264264Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:11.272149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.272185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.272352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.272415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.272481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.272548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.272594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.272603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.272675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.272736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.272795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.272880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.273155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.273169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.273231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.273294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.273361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.273424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.273481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.273488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.273558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.273623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.273685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.273750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.273794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.273801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.273916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.274009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.274099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.274166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.274210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.274217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.274287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.274385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.274447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.274507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.274617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.274624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.274722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.274816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.274880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.274988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.275045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.275051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.275120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.275185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.275250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.275313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.275379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.275386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.275482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.275545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.275604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.275664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.275707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.275714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.275779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:11.275837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:11.275895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:11.275959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:11.276003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:11.276010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:11.276071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365385:6089], now have 1 active actors on pipe
2025-10-02T09:30:11.276277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:11.276291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554342007365385:6089]
2025-10-02T09:30:11.276345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:11.276354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:11.276374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: error at write: Disconnected sessionId: src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0
2025-10-02T09:30:11.276595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0 is DEAD
2025-10-02T09:30:11.276713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:11.276724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Write session will restart in 0.008679s
2025-10-02T09:30:11.276747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Write session: Do CDS request
2025-10-02T09:30:11.276752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:11.276975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:11.286380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.287591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:11.287613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-10-02T09:30:11.287726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.287756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:11.287769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:11.287773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:11.288219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-10-02T09:30:11.288256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:11.288262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:11.288264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:11.288269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554342007365411:6420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:11.288834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554342007365411:6420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:11.291847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554342007365411:6420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:11.294944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554342007365411:6420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:11.294961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554342007365411:6420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:11.294964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554342007365411:6420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:11.294971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:11.297505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:11.299806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:11.299983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:11.299992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:11.300001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:11.300044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:11.300082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554341931842421:5558]
2025-10-02T09:30:11.300619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:11.300949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:11.301007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:11.301320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:11.301389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.301395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.301396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.301397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.301398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.301400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.301401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.301402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.301403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.301404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.301404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.301405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.301410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.301420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.301423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.301427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.301430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.301433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.301437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.301440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.301443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.301447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.301450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.301453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.301460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.301468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.301473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.301478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.301482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.301486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.301492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.301497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.301501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.301511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.301515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.301519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.301528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.301532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.301540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.301544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.301549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.301553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.301561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.301565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.301569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.301578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.301582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.301586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.301625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:11.310310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:11.311904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:11.311923Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:11.311927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:11.311930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:11.311937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [2:7556554341931842421:5558]
2025-10-02T09:30:11.311949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:11.311966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:11.311969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.311972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.311974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.311989Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:11.311999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:11.312005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:11.312072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.312079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.312082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.312085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:11.312087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:11.312152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:11.312159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.312172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.312186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.312205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:11.312228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365388:2446], now have 1 active actors on pipe
2025-10-02T09:30:11.312236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365581:6420], now have 1 active actors on pipe
2025-10-02T09:30:11.312244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.312246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.312248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.312262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:11.312278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:11.312278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:11.312282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:11.312284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:11.312295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:11.312299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:11.312294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 656
2025-10-02T09:30:11.312330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.312295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 656
2025-10-02T09:30:11.312343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:11.312349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:11.312362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.312370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.312415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:11.312426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.312430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.312434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:11.312444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.312458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:11.312481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.312653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.312665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.312693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.312776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 36 sessionId: src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0
2025-10-02T09:30:11.313112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84714bb-16adc9c9-8fee80bc-fceb9399_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:11.315560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Write session: try to update token
2025-10-02T09:30:11.315574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:11.323071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:11.323093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.323095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:11.323097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:11.323105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.323109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.323113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554341931842416:5558]
2025-10-02T09:30:11.323148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:11.323154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.323156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:11.323156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:11.323161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:11.323164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:11.323339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:11.331637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:11.334121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:11.376704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554342007365638:6089]
2025-10-02T09:30:11.377009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7556554342007365638:6089]
2025-10-02T09:30:11.467801Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:11.468358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.468373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.468388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365638:6089], now have 1 active actors on pipe
2025-10-02T09:30:11.468598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:11.468623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554342007365638:6089]
2025-10-02T09:30:11.468630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:11.468633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:11.468662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:11.468685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: error at write: Disconnected sessionId: src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0
2025-10-02T09:30:11.468860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0 is DEAD
2025-10-02T09:30:11.468997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:11.469007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Write session will restart in 0.006210s
2025-10-02T09:30:11.469029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Write session: Do CDS request
2025-10-02T09:30:11.469036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:11.476284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.476361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:11.476377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-10-02T09:30:11.476484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.476512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:11.476521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:11.476524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:11.476914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-10-02T09:30:11.476950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:11.476952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:11.476955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:11.476960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554342007365668:6424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:11.477462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554342007365668:6424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:11.480233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554342007365668:6424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:11.482960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554342007365668:6424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:11.482975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554342007365668:6424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:11.482979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554342007365668:6424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:11.482985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:11.484922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:11.487191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:11.487365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:11.487376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:11.487387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:11.487439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:11.487478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554341931842656:5560]
2025-10-02T09:30:11.488043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:11.488362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:11.488403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:11.488710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:11.488753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.488755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.488756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.488756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.488757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.488758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.488758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.488759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.488759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.488760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.488760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.488761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.488765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.488772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.488774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.488776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.488778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.488781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.488784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.488788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.488791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.488795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.488798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.488815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.488822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.488829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.488834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.488838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.488842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.488846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.488850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.488855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.488864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.488869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.488881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.488886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.488891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.488894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.488898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.488906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.488910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.488918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.488923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.488932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.488936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.488945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.488951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.488986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:11.497404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:11.499001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:11.499026Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:11.499028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:11.499031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:11.499036Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [2:7556554341931842656:5560]
2025-10-02T09:30:11.499047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:11.499059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:11.499061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.499063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.499065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.499075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:11.499078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:11.499083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:11.499124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.499130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.499132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.499134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:11.499136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:11.499195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:11.499203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.499215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.499229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.499247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:11.499267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365641:2446], now have 1 active actors on pipe
2025-10-02T09:30:11.499273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365869:6424], now have 1 active actors on pipe
2025-10-02T09:30:11.499277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.499279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.499280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.499289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:11.499302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:11.499303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:11.499305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:11.499308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:11.499319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:11.499321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:11.499315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 657
2025-10-02T09:30:11.499349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.499326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 657
2025-10-02T09:30:11.499356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:11.499357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:11.499370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.499373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.499409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:11.499419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.499423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.499429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:11.499438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.499446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:11.499464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.499660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.499675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.499696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.499781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0
2025-10-02T09:30:11.500089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a71b7f-39023e64-2bf4ac9e-80624635_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:11.502559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Write session: try to update token
2025-10-02T09:30:11.502573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:11.510252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:11.510270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.510271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:11.510273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:11.510280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.510283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.510286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554341931842651:5560]
2025-10-02T09:30:11.510314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:11.510318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.510320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:11.510328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:11.510335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:11.510339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:11.510471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:11.518930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:11.521495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:11.568683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554342007365902:6089]
2025-10-02T09:30:11.568971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7556554342007365902:6089]
2025-10-02T09:30:11.652833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:11.653507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.653521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.653537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365902:6089], now have 1 active actors on pipe
2025-10-02T09:30:11.653734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:11.653847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:11.653873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:11.653876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:11.653903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554342007365902:6089]
2025-10-02T09:30:11.653930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: error at write: Disconnected sessionId: src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0
2025-10-02T09:30:11.654097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0 is DEAD
2025-10-02T09:30:11.654223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:11.654231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Write session will restart in 0.009982s
2025-10-02T09:30:11.654247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Write session: Do CDS request
2025-10-02T09:30:11.654251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:11.665285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.665370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:11.665396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-10-02T09:30:11.665519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.665559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:11.665567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:11.665571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:11.666000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-10-02T09:30:11.666030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:11.666036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:11.666038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:11.666043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554342007366013:6433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:11.666487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554342007366013:6433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:11.668890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554342007366013:6433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:11.670555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:11.672913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:11.673061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:11.673069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:11.673075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:11.673107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:11.673089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554342007366013:6433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:11.673107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554342007366013:6433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:11.673110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554342007366013:6433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:11.673123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:11.673145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554341931842903:5563]
2025-10-02T09:30:11.673571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:11.673820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:11.673848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:11.674048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:11.674080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.674084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.674085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.674085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.674086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.674086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.674087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.674088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.674088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.674089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.674089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.674090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.674093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.674100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.674102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.674104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.674106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.674109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.674111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.674113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.674115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.674118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.674120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.674122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.674126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.674132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.674137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.674142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.674147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.674152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.674156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.674165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.674171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.674176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.674181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.674184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.674187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.674190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.674192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.674198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.674200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.674204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.674209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.674212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.674215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.674221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.674224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.674227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.674245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:11.682385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:11.684121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:11.684133Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:11.684134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:11.684137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:11.684141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [2:7556554341931842903:5563]
2025-10-02T09:30:11.684151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:11.684162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:11.684164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.684166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.684167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.684177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:11.684181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:11.684186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:11.684226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.684232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.684233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.684235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:11.684237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:11.684277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:11.684283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.684290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.684300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.684312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:11.684332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007366136:6433], now have 1 active actors on pipe
2025-10-02T09:30:11.684336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.684337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.684338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.684343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:11.684348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007365904:2446], now have 1 active actors on pipe
2025-10-02T09:30:11.684353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:11.684353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:11.684356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:11.684357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:11.684361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:11.684363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:11.684383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.684386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:11.684395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:11.684412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 658
2025-10-02T09:30:11.684423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 658
2025-10-02T09:30:11.684483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.684490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.684508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4beb976d-3000749-69210575-bd4bbfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:11.684515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.684517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.684519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:11.684525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.684535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:11.684548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.684665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.684671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.684678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.684777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 36 sessionId: src_id|4beb976d-3000749-69210575-bd4bbfb_0
2025-10-02T09:30:11.685092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c2646-8cf0d772-e932ca47-66df7f80_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4beb976d-3000749-69210575-bd4bbfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:11.687344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Write session: try to update token
2025-10-02T09:30:11.687356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:11.694407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:11.694433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.694434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:11.694436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:11.694444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.694448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.694452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554341931842898:5563]
2025-10-02T09:30:11.694479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:11.694487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.694486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:11.694489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:11.694491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:11.694493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:11.694600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:11.701115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|4beb976d-3000749-69210575-bd4bbfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:11.703331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:11.754029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554342007366151:6089]
2025-10-02T09:30:11.754254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7556554342007366151:6089]
2025-10-02T09:30:11.832593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:11.833103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.833121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.833137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007366151:6089], now have 1 active actors on pipe
2025-10-02T09:30:11.835513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:11.835526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:11.835529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:11.835609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: error at write: Disconnected sessionId: src_id|4beb976d-3000749-69210575-bd4bbfb_0
2025-10-02T09:30:11.835784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|4beb976d-3000749-69210575-bd4bbfb_0 is DEAD
2025-10-02T09:30:11.835894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554342007366151:6089]
2025-10-02T09:30:11.835925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:11.835962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:11.835979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Write session will restart in 0.006183s
2025-10-02T09:30:11.836013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Write session: Do CDS request
2025-10-02T09:30:11.836021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:11.843468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.843526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:11.843543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-10-02T09:30:11.843726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:11.843758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:11.843763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:11.843768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:11.844198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-10-02T09:30:11.844235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:11.844239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:11.844240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:11.844245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554342007366200:6445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:11.844755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554342007366200:6445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:11.847076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554342007366200:6445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:11.850954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554342007366200:6445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:11.850970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554342007366200:6445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:11.850973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554342007366200:6445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:11.850979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:11.855197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:11.857762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:11.857962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:11.857974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:11.857984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:11.858040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:11.858085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554341931843179:5577]
2025-10-02T09:30:11.858620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:11.858967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:11.859044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:11.859343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:11.859394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.859404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.859405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.859406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.859407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.859408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.859409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.859410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.859412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.859413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.859414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.859415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.859420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.859429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.859433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.859436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.859439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.859443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.859447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.859450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.859453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.859457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.859460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.859463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.859469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.859475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:11.859480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.859485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:11.859489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.859494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:11.859499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.859504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:11.859508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.859512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:11.859516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.859521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:11.859525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.859530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:11.859534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.859539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:11.859543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.859548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:11.859552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.859556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.859561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.859566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.859570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.859574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.859605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:11.868363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:11.870397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:11.870417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:11.870419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:11.870422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:11.870428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [2:7556554341931843179:5577]
2025-10-02T09:30:11.870445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:11.870463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:11.870466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.870469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.870471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.870487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:11.870497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:11.870503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:11.870566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.870574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.870576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.870579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:11.870581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:11.870644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:11.870652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.870664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:11.870678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:11.870698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:11.870722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007366337:6445], now have 1 active actors on pipe
2025-10-02T09:30:11.870730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007366182:2446], now have 1 active actors on pipe
2025-10-02T09:30:11.870736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.870738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.870741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.870752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:11.870764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:11.870768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:11.870770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:11.870771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:11.870784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:11.870791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:11.870823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.870834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:11.870846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:11.871284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.871298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.871326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:11.871340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:11.871345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:11.871347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:11.871356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:11.871365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:11.871381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.871592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:11.871604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:11.871624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:11.872144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb976d-3000749-69210575-bd4bbfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:11.871197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 659
2025-10-02T09:30:11.871236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 659
2025-10-02T09:30:11.871763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 36 sessionId: src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0
2025-10-02T09:30:11.875167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Write session: try to update token
2025-10-02T09:30:11.875187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:11.882647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:11.882672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.882683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.882734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:11.883051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:11.883294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:11.883531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:11.883719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:11.883928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:11.883975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:11.884039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:11.893967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:11.896629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:11.893334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:11.893356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:11.893359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:11.893361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:11.893370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.893374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.893379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554341931843174:5577]
2025-10-02T09:30:11.893413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:11.893419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:11.893422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:11.893554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:11.896840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:11.896851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:11.896855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:11.936306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554342007366423:6089]
2025-10-02T09:30:11.936614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7556554342007366423:6089]
2025-10-02T09:30:12.036133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:12.036455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.036464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.036479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554342007366423:6089], now have 1 active actors on pipe
2025-10-02T09:30:12.036679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554342007366423:6089]
2025-10-02T09:30:12.036696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:12.036694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:12.036698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:12.036707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:12.036751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0
2025-10-02T09:30:12.036937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0 is DEAD
2025-10-02T09:30:12.037078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:12.037087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Write session will restart in 0.008758s
2025-10-02T09:30:12.037110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Write session: Do CDS request
2025-10-02T09:30:12.037116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:12.047314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.047403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:12.047420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-10-02T09:30:12.047518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.047558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:12.047566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:12.047570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:12.047921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-10-02T09:30:12.047949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:12.047952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:12.047955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:12.047960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554346302333805:6449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:12.048422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554346302333805:6449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:12.050718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554346302333805:6449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:12.053303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554346302333805:6449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:12.053317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554346302333805:6449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:12.053320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554346302333805:6449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:12.053326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:12.053333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:12.055872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:12.056143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:12.056153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:12.056167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:12.056220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:12.056253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554346226810715:5580]
2025-10-02T09:30:12.056701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:12.056990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:12.057030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:12.057303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:12.057353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.057359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.057360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.057361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.057362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.057363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.057364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.057365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.057366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.057367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.057368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.057369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.057373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.057384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.057387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.057390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.057394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.057397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.057401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.057404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.057407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.057410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.057413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.057417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.057423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.057429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.057434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.057438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.057442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.057446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.057449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.057454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.057458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.057462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.057466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.057470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.057473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.057478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.057482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.057486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.057490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.057494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.057498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.057503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.057507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.057511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.057514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.057517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.057548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:12.065940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:12.067517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:12.067533Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:12.067535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:12.067539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:12.067545Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [2:7556554346226810715:5580]
2025-10-02T09:30:12.067559Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:12.067576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:12.067584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.067586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.067589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.067603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:12.067612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:12.067619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:12.067681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.067691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.067693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.067696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:12.067699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:12.067900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 660
2025-10-02T09:30:12.067906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 660
2025-10-02T09:30:12.068022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:12.068033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.068046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.068065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.068085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:12.068109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302333954:6449], now have 1 active actors on pipe
2025-10-02T09:30:12.068117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302333724:2446], now have 1 active actors on pipe
2025-10-02T09:30:12.068133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.068141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.068154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.068161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.068163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.068177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:12.068194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:12.068197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:12.068201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:12.068202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:12.068212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:12.068215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:12.068231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:12.068240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.068244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.068246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:12.068253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.068267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:12.068298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.068313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:12.068325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.068339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:12.068471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.068480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.068493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.068564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0
2025-10-02T09:30:12.068902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d367f83a-6812f54a-ecfc25f9-974b42a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:12.071601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Write session: try to update token
2025-10-02T09:30:12.071615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:12.078784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:12.078803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.078811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.078851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:12.078853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:12.079041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:12.079221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.079367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.079518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.079718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:12.079767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:12.084412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:12.086699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:12.086868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.086889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.086919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:12.087000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:12.088329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:12.088346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.088348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:12.088350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:12.088358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.088362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.088365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554346226810709:5580]
2025-10-02T09:30:12.088398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:12.088404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:12.088408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.088410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:12.088411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:12.088414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:12.088545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:12.137032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554346302333967:6089]
2025-10-02T09:30:12.137323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7556554346302333967:6089]
2025-10-02T09:30:12.228344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:12.236779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.236820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.236983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.237069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.237142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.237212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.237262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.237276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.237348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.237420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.237490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.237558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.237604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.237612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.237679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.237740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.237813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.237883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.237925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.237933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.237998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.238385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.238483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.238554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.238600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.238608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.238680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.238738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.238813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.238887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.238934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.238941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.239042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.239105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.239204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.239279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.239326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.239333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.239405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.239476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.239539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.239607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.239669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.239676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.239745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.239809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.239871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.239965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.240011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.240017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.240079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.240156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.240256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.240360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.240405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.240412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.240511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:12.240575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:12.240640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:12.240702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:12.240749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:12.240758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:12.240832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302333967:6089], now have 1 active actors on pipe
2025-10-02T09:30:12.241049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:12.241065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554346302333967:6089]
2025-10-02T09:30:12.241066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:12.241086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:12.241094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: error at write: Disconnected sessionId: src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0
2025-10-02T09:30:12.241264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0 is DEAD
2025-10-02T09:30:12.241410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:12.241420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Write session will restart in 0.007082s
2025-10-02T09:30:12.241440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Write session: Do CDS request
2025-10-02T09:30:12.241446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:12.241497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:12.249300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.249375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:12.249392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-10-02T09:30:12.249499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.249526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:12.249534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:12.249537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:12.249968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-10-02T09:30:12.250004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:12.250006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:12.250008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:12.250012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554346302334000:6454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:12.250518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554346302334000:6454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:12.253916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554346302334000:6454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:12.256791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554346302334000:6454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:12.256820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554346302334000:6454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:12.256823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554346302334000:6454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:12.256830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:12.259845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:12.262415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:12.262611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:12.262619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:12.262627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:12.262670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:12.262699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554346226810957:5583]
2025-10-02T09:30:12.263253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:12.263670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:12.263725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:12.264059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:12.264133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.264140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.264141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.264143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.264144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.264145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.264146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.264147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.264148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.264148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.264149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.264151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.264156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.264167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.264171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.264175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.264179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.264182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.264186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.264190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.264194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.264198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.264202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.264206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.264214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.264224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.264229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.264234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.264243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.264251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.264259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.264264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.264270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.264276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.264282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.264287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.264292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.264302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.264306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.264310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.264315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.264319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.264326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.264331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.264341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.264346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.264350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.264354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.264389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:12.273183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:12.274947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:12.274962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:12.274964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:12.274967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:12.274971Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [2:7556554346226810957:5583]
2025-10-02T09:30:12.274982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:12.274994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:12.274995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.274998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.274999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.275023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:12.275027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:12.275032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:12.275086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.275092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.275093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.275095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:12.275097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:12.275147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:12.275153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.275161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.275168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.275182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:12.275196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334168:6454], now have 1 active actors on pipe
2025-10-02T09:30:12.275201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.275203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.275204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.275209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:12.275218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:12.275220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:12.275220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:12.275222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:12.275228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:12.275230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:12.275234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302333971:2446], now have 1 active actors on pipe
2025-10-02T09:30:12.275258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.275268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:12.275301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:12.275289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 661
2025-10-02T09:30:12.275288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 661
2025-10-02T09:30:12.275339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.275346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.275364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:12.275372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.275376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.275377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:12.275384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.275394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:12.275403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.275528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.275534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.275542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.275613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 36 sessionId: src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0
2025-10-02T09:30:12.275949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed370a33-9f1895f6-1ccfba96-1907545d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:12.278551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Write session: try to update token
2025-10-02T09:30:12.278566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:12.285673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:12.285698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.285709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.285741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:12.285753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:12.286023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:12.286198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.286394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.286586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.286779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:12.286820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:12.291727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:12.294035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:12.294048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:12.294063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.294064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:12.294066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:12.294071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.294074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.294077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554346226810952:5583]
2025-10-02T09:30:12.294101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:12.294102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:12.294105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.294106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:12.294107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:12.294109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:12.294231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:12.341292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554346302334217:6089]
2025-10-02T09:30:12.341897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7556554346302334217:6089]
2025-10-02T09:30:12.422127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:12.422531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.422541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.422555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334217:6089], now have 1 active actors on pipe
2025-10-02T09:30:12.422701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:12.422786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:12.422792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:12.422795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:12.422836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554346302334217:6089]
2025-10-02T09:30:12.422853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: error at write: Disconnected sessionId: src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0
2025-10-02T09:30:12.423024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0 is DEAD
2025-10-02T09:30:12.423165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:12.423174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Write session will restart in 0.006306s
2025-10-02T09:30:12.423201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Write session: Do CDS request
2025-10-02T09:30:12.423205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:12.430223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.430345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:12.430372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-10-02T09:30:12.430458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.430491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:12.430496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:12.430503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:12.430910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-10-02T09:30:12.430942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:12.430943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:12.430945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:12.430949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554346302334268:6458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:12.431403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554346302334268:6458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:12.433356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554346302334268:6458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:12.435562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554346302334268:6458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:12.435574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554346302334268:6458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:12.435577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554346302334268:6458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:12.435583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:12.436490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:12.438491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:12.438600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:12.438607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:12.438613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:12.438642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:12.438669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554346226811197:5585]
2025-10-02T09:30:12.439031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:12.439213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:12.439237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:12.439419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:12.439450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.439454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.439454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.439455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.439456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.439456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.439457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.439457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.439458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.439458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.439459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.439460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.439462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.439469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.439471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.439473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.439476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.439478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.439480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.439482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.439483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.439485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.439487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.439489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.439493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.439497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.439501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.439504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.439506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.439509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.439513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.439516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.439519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.439521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.439523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.439526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.439529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.439533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.439537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.439541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.439550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.439554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.439562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.439564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.439567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.439569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.439575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.439578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.439595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:12.447323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:12.448986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:12.449003Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:12.449005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:12.449009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:12.449014Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [2:7556554346226811197:5585]
2025-10-02T09:30:12.449027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:12.449045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:12.449052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.449054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.449056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.449069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:12.449078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:12.449089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:12.449139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.449146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.449148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.449151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:12.449154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:12.449210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:12.449218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.449229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.449244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.449263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:12.449286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334220:2446], now have 1 active actors on pipe
2025-10-02T09:30:12.449295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334452:6458], now have 1 active actors on pipe
2025-10-02T09:30:12.449302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.449304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.449307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.449318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:12.449330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:12.449331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:12.449332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:12.449333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:12.449344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:12.449346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:12.449322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 662
2025-10-02T09:30:12.449326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 662
2025-10-02T09:30:12.449370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.449382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:12.449385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:12.449399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.449406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.449444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:12.449451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.449454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.449455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:12.449461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.449468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:12.449481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.449591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.449597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.449606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.449666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 36 sessionId: src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0
2025-10-02T09:30:12.449949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa67bfd-bab78b7e-8fc33c8b-a47b0284_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:12.452263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Write session: try to update token
2025-10-02T09:30:12.452276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:12.459461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:12.459485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.459487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:12.459489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:12.459498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.459501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.459505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554346226811192:5585]
2025-10-02T09:30:12.459535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:12.459537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:12.459539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:12.459542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.459543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:12.459544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:12.459692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:12.463570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:12.465973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:12.523043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554346302334468:6089]
2025-10-02T09:30:12.523224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7556554346302334468:6089]
2025-10-02T09:30:12.581486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:12.582005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.582016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.582043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334468:6089], now have 1 active actors on pipe
2025-10-02T09:30:12.582276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:12.582264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:12.582268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554346302334468:6089]
2025-10-02T09:30:12.582278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:12.582281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:12.582324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: error at write: Disconnected sessionId: src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0
2025-10-02T09:30:12.582495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0 is DEAD
2025-10-02T09:30:12.582648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:12.582656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Write session will restart in 0.009146s
2025-10-02T09:30:12.582671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Write session: Do CDS request
2025-10-02T09:30:12.582676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:12.593303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.593304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:12.593320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-10-02T09:30:12.593501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.593530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:12.593538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:12.593542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:12.593874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-10-02T09:30:12.593906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:12.593912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:12.593913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:12.593918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554346302334634:6463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:12.594339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554346302334634:6463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:12.595779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554346302334634:6463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:12.596056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:12.598176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:12.598327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:12.598335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:12.598343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:12.598385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:12.598418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554346226811449:5588]
2025-10-02T09:30:12.598399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554346302334634:6463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:12.598410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554346302334634:6463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:12.598412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554346302334634:6463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:12.598417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:12.598967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:12.599180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:12.599215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:12.599490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:12.599540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.599545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.599546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.599547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.599548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.599549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.599550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.599552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.599553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.599554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.599555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.599556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.599560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.599570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.599574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.599578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.599581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.599585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.599588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.599592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.599599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.599604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.599611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.599614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.599623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.599633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.599642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.599651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.599658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.599666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.599674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.599679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.599686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.599695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.599702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.599711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.599720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.599727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.599735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.599743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.599751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.599759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.599768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.599776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.599784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.599793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.599801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.599809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.599846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:12.607807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:12.609254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:12.609269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:12.609271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:12.609273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:12.609278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [2:7556554346226811449:5588]
2025-10-02T09:30:12.609290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:12.609302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:12.609308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.609310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.609311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.609323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:12.609326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:12.609331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:12.609373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.609378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.609380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.609382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:12.609384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:12.609550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 663
2025-10-02T09:30:12.609553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 663
2025-10-02T09:30:12.609729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:12.609736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.609745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.609751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.609759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:12.609774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334717:6463], now have 1 active actors on pipe
2025-10-02T09:30:12.609780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334481:2446], now have 1 active actors on pipe
2025-10-02T09:30:12.609790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.609796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.609809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.609813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.609815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.609824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:12.609837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:12.609847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:12.609848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:12.609850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:12.609857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:12.609859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:12.609861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:12.609865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.609868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.609869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:12.609874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.609881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:12.609909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.609916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:12.609926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.609927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:12.610052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.610059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.610068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.610114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 36 sessionId: src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0
2025-10-02T09:30:12.610420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b0b98c-4a9f89d4-42505dd4-1f3d3f89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:12.612972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Write session: try to update token
2025-10-02T09:30:12.612984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:12.621004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:12.621024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.621026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:12.621027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:12.621034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.621037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.621040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554346226811444:5588]
2025-10-02T09:30:12.621067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:12.621072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.621073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:12.621079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:12.621084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:12.621089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:12.621200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:12.626253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:12.628620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:12.682296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554346302334728:6089]
2025-10-02T09:30:12.682552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7556554346302334728:6089]
2025-10-02T09:30:12.751177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:12.751426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.751441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.751474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334728:6089], now have 1 active actors on pipe
2025-10-02T09:30:12.751634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:12.751652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:12.751645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554346302334728:6089]
2025-10-02T09:30:12.751650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:12.751676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:12.751704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0
2025-10-02T09:30:12.751860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0 is DEAD
2025-10-02T09:30:12.752003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:12.752012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Write session will restart in 0.005542s
2025-10-02T09:30:12.752033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Write session: Do CDS request
2025-10-02T09:30:12.752039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:12.758245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.758315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:12.758332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-10-02T09:30:12.758479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.758518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:12.758530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:12.758533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:12.758888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-10-02T09:30:12.758917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:12.758922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:12.758923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:12.758926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554346302334756:6467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:12.759377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554346302334756:6467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:12.761851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554346302334756:6467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:12.765176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554346302334756:6467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:12.765190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554346302334756:6467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:12.765192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554346302334756:6467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:12.765198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:12.766291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:12.768535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:12.768685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:12.768695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:12.768704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:12.768749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:12.768790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554346226811705:5596]
2025-10-02T09:30:12.769360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:12.769630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:12.769673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:12.769960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:12.770007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.770014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.770015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.770015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.770017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.770018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.770019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.770020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.770021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.770022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.770023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.770024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.770028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.770038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.770042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.770046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.770050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.770053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.770057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.770061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.770065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.770069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.770072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.770077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.770084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.770097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.770102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.770111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.770115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.770121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.770128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.770137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.770145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.770154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.770162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.770171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.770179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.770187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.770195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.770200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.770208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.770212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.770216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.770224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.770232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.770241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.770249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.770258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.770295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:12.778425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:12.780486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:12.780503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:12.780505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:12.780509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:12.780516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [2:7556554346226811705:5596]
2025-10-02T09:30:12.780528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:12.780542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:12.780544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.780547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.780549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.780563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:12.780572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:12.780581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:12.780635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.780642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.780644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.780646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:12.780649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:12.780706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:12.780712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.780724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.780737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.780756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:12.780778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334970:6467], now have 1 active actors on pipe
2025-10-02T09:30:12.780787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.780789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.780791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.780820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:12.780820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:12.780827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302334733:2446], now have 1 active actors on pipe
2025-10-02T09:30:12.780828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:12.780830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:12.780835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:12.780848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:12.780855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:12.780883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.780890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:12.780866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 664
2025-10-02T09:30:12.780900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:12.780867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 664
2025-10-02T09:30:12.780919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.780926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.780950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:12.780961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.780964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.780966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:12.780974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.780982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:12.780994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.781160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.781169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.781181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.781262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0
2025-10-02T09:30:12.781577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ce5eee-a5b4466f-ef154f45-df307c0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:12.783883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Write session: try to update token
2025-10-02T09:30:12.783896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:12.790982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:12.791003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.791021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.791051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:12.791067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:12.791214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:12.791343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.791462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.791585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:12.791758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:12.791797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:12.796843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:12.799210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:12.800051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.800069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.800081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:12.800084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.800085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:12.800087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:12.800092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.800095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.800098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554346226811700:5596]
2025-10-02T09:30:12.800131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:12.800131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:12.800136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:12.800137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.800138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:12.800140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:12.800276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:12.851775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554346302335009:6089]
2025-10-02T09:30:12.852009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7556554346302335009:6089]
2025-10-02T09:30:12.931563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:12.931842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:12.931871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302335009:6089], now have 1 active actors on pipe
2025-10-02T09:30:12.931972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:12.931995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:12.932037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554346302335009:6089]
2025-10-02T09:30:12.932062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:12.932071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:12.932137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: error at write: Disconnected sessionId: src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0
2025-10-02T09:30:12.932278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0 is DEAD
2025-10-02T09:30:12.932424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:12.932435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Write session will restart in 0.008684s
2025-10-02T09:30:12.932454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Write session: Do CDS request
2025-10-02T09:30:12.932462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:12.942238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.942300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:12.942315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-10-02T09:30:12.942442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:12.942474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:12.942483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:12.942487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:12.942847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-10-02T09:30:12.942877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:12.942881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:12.942883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:12.942886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554346302335079:6479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:12.943365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554346302335079:6479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:12.945635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554346302335079:6479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:12.948165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554346302335079:6479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:12.948179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554346302335079:6479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:12.948182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554346302335079:6479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:12.948188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:12.949264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:12.951544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:12.951731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:12.951738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:12.951746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:12.951794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:12.951836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554346226811973:5605]
2025-10-02T09:30:12.952365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:12.952653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:12.952705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:12.953008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:12.953089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.953097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.953098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.953099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.953100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.953101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.953102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.953103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.953104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.953105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.953106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.953107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.953112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.953122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.953126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.953130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.953134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.953138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.953141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.953145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.953149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.953153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.953157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.953161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.953167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.953174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:12.953185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.953190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:12.953198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.953204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:12.953208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.953213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:12.953221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.953230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:12.953238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.953243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:12.953248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.953256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:12.953265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.953269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:12.953278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.953283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:12.953291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.953300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.953309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.953318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.953325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.953334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.953370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:12.961768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:12.963748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:12.963773Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:12.963775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:12.963779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:12.963785Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [2:7556554346226811973:5605]
2025-10-02T09:30:12.963812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:12.963829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:12.963839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.963842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.963844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.963860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:12.963865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:12.963871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:12.963937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.963946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.963947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.963950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:12.963952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:12.964021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:12.964028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.964040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:12.964053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:12.964069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:12.964093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302335248:6479], now have 1 active actors on pipe
2025-10-02T09:30:12.964100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554346302335012:2446], now have 1 active actors on pipe
2025-10-02T09:30:12.964104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.964108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.964110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.964121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:12.964132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:12.964140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:12.964143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:12.964145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:12.964153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:12.964156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:12.964133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 665
2025-10-02T09:30:12.964199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.964209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.964220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.964223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:12.964225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:12.964200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 665
2025-10-02T09:30:12.964249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:12.964261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:12.964265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:12.964266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:12.964274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:12.964283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:12.964313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.964477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:12.964488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:12.964503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:12.964692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0
2025-10-02T09:30:12.965066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fe09215-976abd35-867a507b-7dfe1dc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:12.967597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Write session: try to update token
2025-10-02T09:30:12.967612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:12.974748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:12.974768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:12.974770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:12.974772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:12.974781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.974784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.974788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554346226811968:5605]
2025-10-02T09:30:12.974824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:12.974832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:12.974835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:12.974837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:12.974849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:12.974853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:12.975028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:12.979837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:12.982197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.031984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554350597302559:6089]
2025-10-02T09:30:13.032212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7556554350597302559:6089]
2025-10-02T09:30:13.113249Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:13.113614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.113624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.113650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597302559:6089], now have 1 active actors on pipe
2025-10-02T09:30:13.113805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:13.113887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554350597302559:6089]
2025-10-02T09:30:13.113904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:13.113921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:13.113977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0
2025-10-02T09:30:13.114139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0 is DEAD
2025-10-02T09:30:13.114269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:13.114278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Write session will restart in 0.005319s
2025-10-02T09:30:13.114294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Write session: Do CDS request
2025-10-02T09:30:13.114298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:13.120225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.120304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:13.120319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-10-02T09:30:13.120422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.120450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:13.120459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:13.120463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:13.120822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-10-02T09:30:13.120851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:13.120857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:13.120859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:13.120863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554350597302574:6483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:13.121324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554350597302574:6483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:13.123617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554350597302574:6483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:13.126733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554350597302574:6483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:13.126749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554350597302574:6483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:13.126753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554350597302574:6483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:13.126759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:13.130352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:13.132393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:13.132632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:13.132640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:13.132649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:13.132688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:13.132723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554350521779513:5607]
2025-10-02T09:30:13.133099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:13.133306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:13.133330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:13.133511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:13.133540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.133541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.133541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.133542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.133543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.133543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.133544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.133545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.133545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.133546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.133547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.133547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.133550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.133557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.133560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.133562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.133564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.133566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.133568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.133570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.133572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.133575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.133577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.133580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.133583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.133587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.133590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.133593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.133595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.133598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.133601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.133604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.133606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.133609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.133611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.133614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.133616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.133619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.133621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.133624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.133628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.133631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.133633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.133635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.133638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.133640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.133642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.133645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.133662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:13.143202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:13.146161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:13.146185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:13.146188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:13.146193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:13.146200Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [2:7556554350521779513:5607]
2025-10-02T09:30:13.146220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:13.146238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:13.146241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.146244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.146246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.146264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:13.146269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:13.146277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:13.146350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.146365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.146368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.146371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:13.146373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:13.146461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:13.146471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.146486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.146503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.146526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:13.146556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597302702:6483], now have 1 active actors on pipe
2025-10-02T09:30:13.146566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597302561:2446], now have 1 active actors on pipe
2025-10-02T09:30:13.146574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.146582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.146585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.146603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:13.146604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 666
2025-10-02T09:30:13.146627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:13.146630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:13.146606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 666
2025-10-02T09:30:13.146632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:13.146635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:13.146650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:13.146654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:13.146689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.146705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:13.146707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:13.146734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.146745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.146794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:13.146807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.146811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.146814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:13.146824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.146834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:13.146870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.147040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.147052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.147068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.147172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 36 sessionId: src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0
2025-10-02T09:30:13.147484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4157c0-8d492f51-773abbee-4b7f54b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:13.149885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Write session: try to update token
2025-10-02T09:30:13.149899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:13.157556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:13.157576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.157578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:13.157580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:13.157587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.157591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.157597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554350521779508:5607]
2025-10-02T09:30:13.157630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:13.157635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.157638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:13.157640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:13.157645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:13.157649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:13.157767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:13.162479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:13.164882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.214240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554350597302815:6089]
2025-10-02T09:30:13.214469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7556554350597302815:6089]
2025-10-02T09:30:13.299968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:13.300361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.300374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.300407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597302815:6089], now have 1 active actors on pipe
2025-10-02T09:30:13.300609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:13.300611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554350597302815:6089]
2025-10-02T09:30:13.300625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:13.300636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:13.300680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: error at write: Disconnected sessionId: src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0
2025-10-02T09:30:13.300777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:13.300869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0 is DEAD
2025-10-02T09:30:13.300992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:13.301000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Write session will restart in 0.008449s
2025-10-02T09:30:13.301015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Write session: Do CDS request
2025-10-02T09:30:13.301020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:13.310251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.310359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:13.310377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-10-02T09:30:13.310484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.310512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:13.310521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:13.310526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:13.310830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-10-02T09:30:13.310868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:13.310870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:13.310871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:13.310876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554350597302882:6488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:13.311308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554350597302882:6488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:13.313460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554350597302882:6488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:13.315663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554350597302882:6488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:13.315678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554350597302882:6488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:13.315681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554350597302882:6488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:13.315686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:13.316728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:13.318764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:13.319022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:13.319032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:13.319042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:13.319081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:13.319113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554350521779760:5610]
2025-10-02T09:30:13.319489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:13.319667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:13.319700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:13.319924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:13.319958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.319962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.319963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.319963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.319964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.319965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.319967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.319967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.319968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.319968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.319971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.319978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.319980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.319982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.319984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.319986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.319988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.319990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.319992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.319994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.319996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.319998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.320002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.320007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.320010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.320013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.320015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.320018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.320021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.320024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.320026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.320030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.320032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.320034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.320036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.320040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.320042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.320044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.320046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.320049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.320051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.320053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.320056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.320059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.320061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.320063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.320080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:13.328134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:13.329710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:13.329727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:13.329730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:13.329733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:13.329738Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [2:7556554350521779760:5610]
2025-10-02T09:30:13.329752Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:13.329765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:13.329768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.329771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.329772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.329783Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:13.329789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:13.329794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:13.329845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.329853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.329855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.329858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:13.329860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:13.330063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 667
2025-10-02T09:30:13.330107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:13.330118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.330131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.330142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.330148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 667
2025-10-02T09:30:13.330158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:13.330179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303055:6488], now have 1 active actors on pipe
2025-10-02T09:30:13.330183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597302817:2446], now have 1 active actors on pipe
2025-10-02T09:30:13.330199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.330203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.330220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.330227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.330229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.330240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:13.330249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:13.330251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:13.330252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:13.330258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:13.330272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:13.330279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:13.330293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:13.330301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.330304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.330306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:13.330315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.330323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:13.330354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.330365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:13.330368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:13.330375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.330491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.330497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.330509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.330564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 36 sessionId: src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0
2025-10-02T09:30:13.330863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc32023-50b3ad71-aeea9865-7862b2a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:13.333326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Write session: try to update token
2025-10-02T09:30:13.333342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:13.339875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:13.339895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.339901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.339928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:13.339928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:13.340095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:13.340221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:13.340349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:13.340480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:13.340817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:13.340868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:13.345455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:13.347581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.347699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.347714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.348647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:13.348673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:13.348676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.348678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:13.348680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:13.348685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.348687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.348689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554350521779755:5610]
2025-10-02T09:30:13.348715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:13.348718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:13.348723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:13.348725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.348727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:13.348727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:13.348760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:13.348869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:13.400628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554350597303070:6089]
2025-10-02T09:30:13.400910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7556554350597303070:6089]
2025-10-02T09:30:13.471903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:13.479020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.479044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.479192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.479246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.479303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.479363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.479408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.479417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.479479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.479539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.479599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.479662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.479704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.479711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.479774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.479830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.479889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.479951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.479990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.479996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.480070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.480123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.480183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.480240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.480284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.480289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.480346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.480397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.480459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.480529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.480565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.480569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.480675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.480753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.480812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.480861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.480904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.480909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.480968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.481020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.481070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.481121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.481160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.481165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.481226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.481278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.481328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.481380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.481416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.481420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.481477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.481530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.481580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.481630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.481666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.481671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.481729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:13.481778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:13.481828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:13.481882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:13.481919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:13.481924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:13.481959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303070:6089], now have 1 active actors on pipe
2025-10-02T09:30:13.482172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:13.482183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:13.482187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:13.482207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: error at write: Disconnected sessionId: src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0
2025-10-02T09:30:13.482214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554350597303070:6089]
2025-10-02T09:30:13.482334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0 is DEAD
2025-10-02T09:30:13.482468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:13.482477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Write session will restart in 0.008086s
2025-10-02T09:30:13.482492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Write session: Do CDS request
2025-10-02T09:30:13.482496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:13.482723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:13.491260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.491341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:13.491366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-10-02T09:30:13.491461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.491487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:13.491495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:13.491498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:13.491858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-10-02T09:30:13.491889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:13.491895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:13.491897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:13.491901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554350597303150:6492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:13.492357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554350597303150:6492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:13.494439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554350597303150:6492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:13.496913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:13.496937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554350597303150:6492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:13.496951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554350597303150:6492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:13.496954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554350597303150:6492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:13.496961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:13.499286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:13.499425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:13.499433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:13.499439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:13.499469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:13.499493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554350521780006:5612]
2025-10-02T09:30:13.499843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:13.500096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:13.500132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:13.500408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:13.500444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.500448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.500448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.500449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.500450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.500450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.500451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.500451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.500452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.500452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.500453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.500453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.500456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.500463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.500465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.500468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.500469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.500471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.500473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.500475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.500477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.500479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.500481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.500483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.500487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.500491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.500494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.500497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.500500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.500502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.500505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.500508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.500510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.500513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.500515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.500518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.500520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.500523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.500525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.500528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.500530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.500536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.500538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.500541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.500544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.500547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.500553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.500555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.500574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:13.508447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:13.509890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:13.509906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:13.509909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:13.509913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:13.509919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [2:7556554350521780006:5612]
2025-10-02T09:30:13.509932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:13.509944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:13.509946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.509948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.509949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.509959Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:13.509968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:13.509972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:13.510010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.510015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.510017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.510019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:13.510020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:13.510073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:13.510081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.510091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.510099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.510117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:13.510137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303072:2446], now have 1 active actors on pipe
2025-10-02T09:30:13.510144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303313:6492], now have 1 active actors on pipe
2025-10-02T09:30:13.510150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.510152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.510154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.510163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:13.510177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:13.510181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:13.510184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:13.510186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:13.510193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:13.510195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:13.510182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 668
2025-10-02T09:30:13.510220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.510194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 668
2025-10-02T09:30:13.510226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:13.510228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:13.510240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.510248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.510283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:13.510293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.510296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.510298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:13.510307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.510314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:13.510331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.510497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.510504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.510515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.510582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0
2025-10-02T09:30:13.510899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3584608d-e89e8a59-c8fa53a9-ed7d1675_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:13.513293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Write session: try to update token
2025-10-02T09:30:13.513305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:13.520585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:13.520604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.520606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:13.520609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:13.520617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.520621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.520625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554350521780000:5612]
2025-10-02T09:30:13.520659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:13.520659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:13.520663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:13.520666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:13.520669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.520671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:13.520795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:13.525140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:13.527438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.582376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554350597303338:6089]
2025-10-02T09:30:13.582589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7556554350597303338:6089]
2025-10-02T09:30:13.646025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:13.646377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.646387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.646415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303338:6089], now have 1 active actors on pipe
2025-10-02T09:30:13.646595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:13.646649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:13.646653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:13.646657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:13.646698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554350597303338:6089]
2025-10-02T09:30:13.646709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: error at write: Disconnected sessionId: src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0
2025-10-02T09:30:13.646885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0 is DEAD
2025-10-02T09:30:13.647038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:13.647050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Write session will restart in 0.009423s
2025-10-02T09:30:13.647072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Write session: Do CDS request
2025-10-02T09:30:13.647078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:13.657314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.657451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:13.657467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-10-02T09:30:13.657593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.657622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:13.657631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:13.657634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:13.657965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-10-02T09:30:13.657996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:13.658000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:13.658002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:13.658005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554350597303467:6497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:13.658391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554350597303467:6497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:13.660554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554350597303467:6497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:13.661749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:13.664040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:13.664194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:13.664203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:13.664211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:13.664253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:13.664290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554350521780264:5615]
2025-10-02T09:30:13.664332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554350597303467:6497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:13.664347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554350597303467:6497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:13.664349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554350597303467:6497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:13.664355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:13.664793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:13.665030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:13.665067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:13.665324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:13.665370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.665376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.665377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.665378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.665378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.665379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.665380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.665381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.665383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.665383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.665384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.665385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.665389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.665398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.665401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.665404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.665407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.665410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.665413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.665417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.665420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.665423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.665426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.665428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.665434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.665444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.665452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.665456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.665460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.665464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.665467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.665471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.665481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.665489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.665492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.665500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.665507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.665512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.665515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.665523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.665527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.665534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.665542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.665546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.665554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.665558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.665566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.665573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.665604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:13.674783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:13.676414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:13.676433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:13.676436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:13.676439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:13.676445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [2:7556554350521780264:5615]
2025-10-02T09:30:13.676459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:13.676477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:13.676480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.676482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.676485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.676500Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:13.676506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:13.676511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:13.676567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.676580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.676582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.676586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:13.676589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:13.676754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:13.676769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.676784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.676796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.676784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 669
2025-10-02T09:30:13.676831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:13.676823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 669
2025-10-02T09:30:13.676857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303582:6497], now have 1 active actors on pipe
2025-10-02T09:30:13.676865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303339:2446], now have 1 active actors on pipe
2025-10-02T09:30:13.676871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.676874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.676878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.676891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:13.676906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:13.676912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.676916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.676917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:13.676918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:13.676931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:13.676951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:13.676954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:13.677004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:13.677017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.677020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.677022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:13.677031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.677040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:13.677052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.677062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:13.677078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:13.677093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.677335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.677351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.677370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.677454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 36 sessionId: src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0
2025-10-02T09:30:13.677769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3d85cb-7245a7ca-98c2d74b-968842c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:13.680454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Write session: try to update token
2025-10-02T09:30:13.680471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:13.687506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:13.687523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.687525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:13.687526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:13.687533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.687535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.687538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554350521780259:5615]
2025-10-02T09:30:13.687566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:13.687572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.687574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:13.687586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:13.687612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:13.687617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:13.687719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:13.693183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:13.695497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.746742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554350597303594:6089]
2025-10-02T09:30:13.746996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7556554350597303594:6089]
2025-10-02T09:30:13.825251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:13.825504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.825520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.825535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303594:6089], now have 1 active actors on pipe
2025-10-02T09:30:13.825672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:13.825693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554350597303594:6089]
2025-10-02T09:30:13.825721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:13.825723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:13.825773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: error at write: Disconnected sessionId: src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0
2025-10-02T09:30:13.825892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:13.825928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0 is DEAD
2025-10-02T09:30:13.826046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:13.826057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Write session will restart in 0.008931s
2025-10-02T09:30:13.826079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Write session: Do CDS request
2025-10-02T09:30:13.826084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:13.836337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.836422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:13.836438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-10-02T09:30:13.836521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:13.836552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:13.836557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:13.836561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:13.836952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-10-02T09:30:13.836982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:13.836987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:13.836989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:13.836993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554350597303727:6508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:13.837440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554350597303727:6508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:13.839801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554350597303727:6508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:13.841485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:13.843924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:13.844085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:13.844093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:13.844100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:13.844113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554350597303727:6508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:13.844132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:13.844126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554350597303727:6508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:13.844129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554350597303727:6508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:13.844136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:13.844158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554350521780541:5627]
2025-10-02T09:30:13.844593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:13.844842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:13.844884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:13.845155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:13.845371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.845380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.845381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.845381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.845382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.845383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.845385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.845386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.845387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.845388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.845389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.845390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.845395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.845404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.845408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.845413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.845416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.845420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.845424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.845428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.845432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.845435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.845440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.845443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.845450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.845457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:13.845464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.845469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:13.845473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.845478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:13.845483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.845493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:13.845497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.845502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:13.845513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.845519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:13.845523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.845528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:13.845537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.845543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:13.845549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.845554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:13.845562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.845567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.845575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.845580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.845584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.845589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.845626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:13.854356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:13.855949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:13.855967Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:13.855970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:13.855974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:13.855980Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [2:7556554350521780541:5627]
2025-10-02T09:30:13.855993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:13.856008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:13.856017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.856020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.856022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.856035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:13.856041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:13.856051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:13.856104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.856111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.856113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.856116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:13.856119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:13.856179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:13.856186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.856197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:13.856210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:13.856232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:13.856255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303861:6508], now have 1 active actors on pipe
2025-10-02T09:30:13.856263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303605:2446], now have 1 active actors on pipe
2025-10-02T09:30:13.856268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.856270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.856272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.856285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:13.856298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:13.856301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:13.856302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:13.856302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:13.856317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:13.856325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:13.856351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.856364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:13.856339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 670
2025-10-02T09:30:13.856372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 670
2025-10-02T09:30:13.856377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:13.856406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.856415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.856437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:13.856447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:13.856451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:13.856456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:13.856464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:13.856472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:13.856489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.856641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.856649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.856664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:13.856761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 36 sessionId: src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0
2025-10-02T09:30:13.857048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d26aa-79f69614-5cf0d920-6770c3f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:13.859503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Write session: try to update token
2025-10-02T09:30:13.859515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:13.866636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:13.866658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.866666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.866697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:13.866700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:13.866844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:13.866999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:13.867123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:13.867240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:13.867433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:13.867466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:13.871334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:13.873435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:13.873599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:13.873618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:13.873647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:13.873723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:13.876219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:13.876232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:13.876233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:13.876235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:13.876241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.876243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.876246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554350521780536:5627]
2025-10-02T09:30:13.876268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:13.876276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:13.876277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:13.876278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:13.876282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:13.876284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:13.876434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:13.925929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554350597303883:6089]
2025-10-02T09:30:13.926238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7556554350597303883:6089]
E1002 09:30:13.955879900 3223199 chttp2_transport.cc:1143]             ipv4:127.0.0.1:13253: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T09:30:14.004750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:14.011533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.011560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.011709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.011773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.011830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.011893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.011937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.011947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.012011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.012067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.012125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.012184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.012224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.012229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.012282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.012328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.012383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.012444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.012487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.012493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.012545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.012594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.012678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.012731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.012770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.012775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.012847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.012905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.012963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.013016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.013075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.013083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.013155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.013220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.013280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.013345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.013398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.013409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.013477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.013536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.013601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.013659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.013703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.013710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.013767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.013816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.013865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.013914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.014017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.014023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.014075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.014121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.014171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.014228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.014279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.014284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.014333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:14.014383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:14.014442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:14.014493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:14.014527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:14.014532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:14.014566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554350597303883:6089], now have 1 active actors on pipe
2025-10-02T09:30:14.014791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554350597303883:6089]
2025-10-02T09:30:14.014821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:14.014832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:14.014835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:14.014862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0
2025-10-02T09:30:14.015072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0 is DEAD
2025-10-02T09:30:14.015177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:14.015197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Write session will restart in 0.007357s
2025-10-02T09:30:14.015215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Write session: Do CDS request
2025-10-02T09:30:14.015221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:14.015430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:14.023443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.023487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:14.023502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-10-02T09:30:14.023671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.023707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:14.023717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:14.023720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:14.024059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-10-02T09:30:14.024096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:14.024101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:14.024103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:14.024107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554354892271213:6513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:14.024575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554354892271213:6513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:14.027766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554354892271213:6513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:14.030589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554354892271213:6513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:14.030602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554354892271213:6513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:14.030605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554354892271213:6513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:14.030612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:14.032379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:14.034962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:14.035165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:14.035179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:14.035188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:14.035244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:14.035289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554354816748096:5632]
2025-10-02T09:30:14.035870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:14.036193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:14.036247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:14.036568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:14.036629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.036637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.036638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.036639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.036640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.036642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.036643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.036644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.036645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.036647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.036648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.036649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.036654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.036665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.036669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.036672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.036676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.036680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.036684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.036687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.036691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.036695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.036699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.036703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.036709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.036715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.036721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.036726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.036730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.036734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.036738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.036742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.036746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.036751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.036754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.036759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.036764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.036769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.036773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.036778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.036782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.036786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.036815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.036820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.036825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.036832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.036836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.036840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.036875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:14.046513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:14.048424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:14.048436Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:14.048438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:14.048440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:14.048445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [2:7556554354816748096:5632]
2025-10-02T09:30:14.048454Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:14.048467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:14.048470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.048472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.048473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.048484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:14.048487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:14.048493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:14.048533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.048539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.048541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.048544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:14.048546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:14.048607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:14.048613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.048621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.048627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.048639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:14.048652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271423:6513], now have 1 active actors on pipe
2025-10-02T09:30:14.048658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271183:2446], now have 1 active actors on pipe
2025-10-02T09:30:14.048662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.048664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.048665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.048675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:14.048684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:14.048695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:14.048698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:14.048699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:14.048702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:14.048704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:14.048721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.048727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:14.048735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:14.048709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 671
2025-10-02T09:30:14.048744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.048709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 671
2025-10-02T09:30:14.048748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.048771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:14.048779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.048782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.048783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:14.048788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.048794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:14.048819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.048915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.048927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.048944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.048999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 36 sessionId: src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0
2025-10-02T09:30:14.049286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed16d0b-f339db75-2e8ab403-1bfa4926_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:14.051544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Write session: try to update token
2025-10-02T09:30:14.051556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:14.058706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:14.058724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:14.058726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:14.058728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:14.058733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.058736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.058739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554354816748091:5632]
2025-10-02T09:30:14.058767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:14.058772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.058773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:14.058777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:14.058780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:14.058783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:14.058994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:14.063638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:14.065716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:14.114870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554354892271437:6089]
2025-10-02T09:30:14.115155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7556554354892271437:6089]
2025-10-02T09:30:14.198451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:14.198735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.198747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.198780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271437:6089], now have 1 active actors on pipe
2025-10-02T09:30:14.198954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:14.198982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554354892271437:6089]
2025-10-02T09:30:14.198993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:14.198997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:14.199019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:14.199055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: error at write: Disconnected sessionId: src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0
2025-10-02T09:30:14.199184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0 is DEAD
2025-10-02T09:30:14.199353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:14.199364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Write session will restart in 0.009588s
2025-10-02T09:30:14.199386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Write session: Do CDS request
2025-10-02T09:30:14.199392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:14.210263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.210362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:14.210380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-10-02T09:30:14.210494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.210516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:14.210531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:14.210537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:14.210921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-10-02T09:30:14.210956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:14.210962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:14.210964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:14.210969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554354892271593:6518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:14.211397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554354892271593:6518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:14.213063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554354892271593:6518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:14.215310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:14.215380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554354892271593:6518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:14.215388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554354892271593:6518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:14.215390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554354892271593:6518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:14.215394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:14.215642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:14.215778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:14.215788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:14.215798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:14.215842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:14.215877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554354816748349:5635]
2025-10-02T09:30:14.216435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:14.216672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:14.216718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:14.217023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:14.217083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.217089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.217090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.217091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.217092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.217093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.217094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.217095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.217096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.217097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.217098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.217099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.217104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.217114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.217118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.217123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.217127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.217131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.217135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.217139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.217143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.217147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.217152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.217156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.217161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.217169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.217174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.217179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.217184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.217189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.217193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.217199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.217203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.217209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.217218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.217222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.217226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.217231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.217235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.217239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.217248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.217253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.217256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.217266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.217271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.217280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.217285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.217290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.217332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:14.225404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:14.227441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:14.227458Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:14.227461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:14.227464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:14.227470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [2:7556554354816748349:5635]
2025-10-02T09:30:14.227482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:14.227498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:14.227501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.227504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.227506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.227520Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:14.227527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:14.227533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:14.227590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.227598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.227600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.227603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:14.227606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:14.227669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:14.227677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.227689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.227701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.227723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:14.227743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271688:6518], now have 1 active actors on pipe
2025-10-02T09:30:14.227752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271442:2446], now have 1 active actors on pipe
2025-10-02T09:30:14.227758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.227760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.227762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.227776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:14.227792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:14.227801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:14.227804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:14.227806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:14.227809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:14.227812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:14.227803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 672
2025-10-02T09:30:14.227840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.227803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 672
2025-10-02T09:30:14.227847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:14.227849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:14.227862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.227870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.227916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70205ce-be55caea-6d1248cf-9083d041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:14.227926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.227929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.227931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:14.227940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.227948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:14.227968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.228129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.228137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.228151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.228233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 36 sessionId: src_id|c70205ce-be55caea-6d1248cf-9083d041_0
2025-10-02T09:30:14.228583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e26cd-2fa6bb2d-c236d415-163c4f18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c70205ce-be55caea-6d1248cf-9083d041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:14.231118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Write session: try to update token
2025-10-02T09:30:14.231136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:14.239971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:14.239990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:14.239993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:14.239995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:14.240002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.240007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.240011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554354816748343:5635]
2025-10-02T09:30:14.240047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:14.240052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.240052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:14.240055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:14.240058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:14.240062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:14.240187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:14.245806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|c70205ce-be55caea-6d1248cf-9083d041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:14.248178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:14.299192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554354892271699:6089]
2025-10-02T09:30:14.299437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7556554354892271699:6089]
2025-10-02T09:30:14.382517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:14.382530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Write session will restart in 0.008858s
2025-10-02T09:30:14.382550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Write session: Do CDS request
2025-10-02T09:30:14.382555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:14.382094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:14.382144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:14.382147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:14.382200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: error at write: Disconnected sessionId: src_id|c70205ce-be55caea-6d1248cf-9083d041_0
2025-10-02T09:30:14.382368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|c70205ce-be55caea-6d1248cf-9083d041_0 is DEAD
2025-10-02T09:30:14.382551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554354892271699:6089]
2025-10-02T09:30:14.381080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:14.381362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.381370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.381402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271699:6089], now have 1 active actors on pipe
2025-10-02T09:30:14.381817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:14.392293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.392635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:14.392653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-10-02T09:30:14.392944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.392976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:14.392981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:14.392985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:14.393425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-10-02T09:30:14.393464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:14.393468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:14.393470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:14.393476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554354892271728:6522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:14.393985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554354892271728:6522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:14.396408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554354892271728:6522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:14.401050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554354892271728:6522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:14.401069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554354892271728:6522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:14.401072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554354892271728:6522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:14.401080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:14.402464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:14.405199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:14.405489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:14.405498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:14.405508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:14.405562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:14.405600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554354816748600:5637]
2025-10-02T09:30:14.406223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:14.406526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:14.406566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:14.406873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:14.406928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.406934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.406935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.406936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.406938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.406939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.406939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.406940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.406941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.406943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.406944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.406945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.406951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.406962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.406966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.406970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.406974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.406978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.406982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.406987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.406991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.406997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.407001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.407017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.407024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.407032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.407039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.407044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.407049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.407054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.407058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.407064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.407071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.407076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.407082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.407088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.407092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.407098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.407102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.407107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.407111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.407117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.407122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.407127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.407135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.407145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.407150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.407155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.407191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:14.416558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:14.418535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:14.418554Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:14.418557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:14.418560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:14.418567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [2:7556554354816748600:5637]
2025-10-02T09:30:14.418582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:14.418599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:14.418602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.418605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.418608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.418623Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:14.418628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:14.418635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:14.418698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.418706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.418710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.418714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:14.418716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:14.418778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:14.418788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.418802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.418815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.418834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:14.418852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271944:6522], now have 1 active actors on pipe
2025-10-02T09:30:14.418861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271702:2446], now have 1 active actors on pipe
2025-10-02T09:30:14.418867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.418869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.418872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.418882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:14.418893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:14.418894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:14.418896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:14.418897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:14.418910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:14.418913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:14.418946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.418955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:14.418958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:14.418933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 673
2025-10-02T09:30:14.418936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 673
2025-10-02T09:30:14.418981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.418990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.419035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:14.419045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.419050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.419054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:14.419061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.419069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:14.419090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.419293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.419301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.419314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.419402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0
2025-10-02T09:30:14.419753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70205ce-be55caea-6d1248cf-9083d041_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:14.422298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Write session: try to update token
2025-10-02T09:30:14.422314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:14.432638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:14.432659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:14.432662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:14.432664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:14.432673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.432678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.432682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554354816748595:5637]
2025-10-02T09:30:14.432727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:14.432734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.432737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:14.432820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:14.432835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:14.432840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:14.432895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:14.437736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:14.440312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:14.482548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554354892271959:6089]
2025-10-02T09:30:14.482854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7556554354892271959:6089]
2025-10-02T09:30:14.583842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:14.583848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:14.583852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:14.583906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554354892271959:6089]
2025-10-02T09:30:14.583929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0
2025-10-02T09:30:14.584100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0 is DEAD
2025-10-02T09:30:14.583014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:14.583536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.583544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.583578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271959:6089], now have 1 active actors on pipe
2025-10-02T09:30:14.584440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:14.584457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Write session will restart in 0.005951s
2025-10-02T09:30:14.584023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:14.584476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Write session: Do CDS request
2025-10-02T09:30:14.584483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:14.591244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.591359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:14.591376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-10-02T09:30:14.591500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.591527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:14.591538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:14.591542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:14.591961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-10-02T09:30:14.591994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:14.591995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:14.591996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:14.592001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554354892271988:6527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:14.592502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554354892271988:6527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:14.594936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554354892271988:6527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:14.598418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554354892271988:6527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:14.598435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554354892271988:6527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:14.598438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554354892271988:6527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:14.598446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:14.603106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:14.605891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:14.606048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:14.606057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:14.606067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:14.606110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:14.606141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554354816748865:5640]
2025-10-02T09:30:14.606687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:14.606989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:14.607055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:14.607364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:14.607421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.607427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.607428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.607429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.607430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.607431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.607432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.607434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.607435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.607436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.607437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.607438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.607444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.607455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.607459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.607463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.607466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.607470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.607473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.607477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.607480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.607483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.607486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.607489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.607495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.607502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.607507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.607512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.607516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.607522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.607528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.607534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.607543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.607548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.607552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.607557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.607565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.607570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.607578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.607583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.607590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.607599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.607604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.607613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.607621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.607626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.607631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.607635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.607670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:14.616010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:14.617876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:14.617887Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:14.617889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:14.617891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:14.617896Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [2:7556554354816748865:5640]
2025-10-02T09:30:14.617907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:14.617920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:14.617922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.617924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.617925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.617936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:14.617939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:14.617944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:14.617985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.617989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.617990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.617992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:14.617994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:14.618037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:14.618043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.618051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.618056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.618064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:14.618076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.618077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.618079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.618085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:14.618093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:14.618095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:14.618098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:14.618100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:14.618101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:14.618102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:14.618130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892272132:6527], now have 1 active actors on pipe
2025-10-02T09:30:14.618132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892271974:2446], now have 1 active actors on pipe
2025-10-02T09:30:14.618134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.618139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:14.618151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:14.618209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 674
2025-10-02T09:30:14.618209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 674
2025-10-02T09:30:14.618287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.618299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.618322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:14.618335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.618341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.618343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:14.618352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.618362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:14.618377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.618494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.618500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.618508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.618574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 36 sessionId: src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0
2025-10-02T09:30:14.618899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee36fcd5-5b531bc-8a81b1e3-793407_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:14.621530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Write session: try to update token
2025-10-02T09:30:14.621545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:14.628321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:14.628337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:14.628346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.628383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:14.628389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:14.628568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:14.628711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:14.628855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:14.628984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:14.629148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:14.629182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:14.635029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:14.637451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:14.638538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.638558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.638574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:14.638577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:14.638579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:14.638582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:14.638589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.638593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.638597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554354816748860:5640]
2025-10-02T09:30:14.638636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:14.638641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:14.638647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.638648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:14.638649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:14.638651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:14.638789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:14.684226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554354892272233:6089]
2025-10-02T09:30:14.684497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7556554354892272233:6089]
2025-10-02T09:30:14.791841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:14.792279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:14.792896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:14.792907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Write session will restart in 0.009952s
2025-10-02T09:30:14.792928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Write session: Do CDS request
2025-10-02T09:30:14.792933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:14.792315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892272233:6089], now have 1 active actors on pipe
2025-10-02T09:30:14.792421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:14.792519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:14.792522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:14.792590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: error at write: Disconnected sessionId: src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0
2025-10-02T09:30:14.792732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0 is DEAD
2025-10-02T09:30:14.792881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:14.792926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554354892272233:6089]
2025-10-02T09:30:14.804289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.804459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:14.804479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-10-02T09:30:14.804598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:14.804628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:14.804633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:14.804641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:14.805082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-10-02T09:30:14.805120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:14.805126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:14.805128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:14.805133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554354892272285:6532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:14.805644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554354892272285:6532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:14.808318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554354892272285:6532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:14.811098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554354892272285:6532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:14.811113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554354892272285:6532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:14.811117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554354892272285:6532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:14.811125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:14.813258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:14.815766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:14.815921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:14.815930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:14.815939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:14.815984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:14.816019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554354816749118:5642]
2025-10-02T09:30:14.816573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:14.816907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:14.816961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:14.817421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:14.817488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.817493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.817494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.817495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.817496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.817497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.817498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.817499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.817500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.817501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.817501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.817502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.817507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.817516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.817520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.817523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.817526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.817529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.817532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.817535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.817539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.817544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.817546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.817550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.817555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.817561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:14.817566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.817570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:14.817576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.817581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:14.817584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.817588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:14.817592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.817596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:14.817601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.817604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:14.817608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.817612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:14.817616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.817620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:14.817624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.817628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:14.817631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.817635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.817639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.817643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.817646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.817651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.817678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:14.826678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:14.828281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:14.828297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:14.828299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:14.828301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:14.828310Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [2:7556554354816749118:5642]
2025-10-02T09:30:14.828320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:14.828331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:14.828333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.828335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.828336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.828346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:14.828350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:14.828356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:14.828408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.828414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.828415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.828419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:14.828420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:14.828476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:14.828483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.828494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:14.828509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:14.828523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:14.828545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892272472:6532], now have 1 active actors on pipe
2025-10-02T09:30:14.828552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892272245:2446], now have 1 active actors on pipe
2025-10-02T09:30:14.828558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.828560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.828562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.828571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:14.828586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:14.828598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:14.828573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 675
2025-10-02T09:30:14.828605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:14.828574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 675
2025-10-02T09:30:14.828608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:14.828608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:14.828610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:14.828651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.828658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.828667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.828674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:14.828704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:14.828866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:14.828877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:14.828880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:14.828883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:14.828891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:14.828903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:14.828927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.829114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.829125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.829145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:14.829235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0
2025-10-02T09:30:14.829601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621c766d-2e31a1d4-6ce97ea8-b157a0d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:14.832359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Write session: try to update token
2025-10-02T09:30:14.832375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:14.839765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:14.839782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:14.839784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:14.839786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:14.839794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.839799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.839803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554354816749113:5642]
2025-10-02T09:30:14.839842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:14.839849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:14.839852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:14.839852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:14.839858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:14.839862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:14.839986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:14.847062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:14.849730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:14.893127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554354892272522:6089]
2025-10-02T09:30:14.893502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7556554354892272522:6089]
2025-10-02T09:30:14.995565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:14.995958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:14.995973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:14.995989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892272522:6089], now have 1 active actors on pipe
2025-10-02T09:30:14.996162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:14.996214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:14.996216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554354892272522:6089]
2025-10-02T09:30:14.996230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:14.996234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:14.996300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0
2025-10-02T09:30:14.996475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0 is DEAD
2025-10-02T09:30:14.996618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:14.996625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Write session will restart in 0.008349s
2025-10-02T09:30:14.996642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Write session: Do CDS request
2025-10-02T09:30:14.996647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:15.006300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.006604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:15.006633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-10-02T09:30:15.006755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.006786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:15.006795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:15.006799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:15.007313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-10-02T09:30:15.007351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:15.007357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:15.007359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:15.007364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554359187239927:6543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:15.007848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554359187239927:6543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:15.009799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554359187239927:6543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:15.012345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:15.012430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554359187239927:6543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:15.012445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554359187239927:6543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:15.012449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554359187239927:6543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:15.012456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:15.015324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:15.015521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:15.015532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:15.015544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:15.015593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:15.015640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554359111716706:5657]
2025-10-02T09:30:15.016247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:15.016524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:15.016564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:15.016893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:15.016953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.016961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.016962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.016963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.016964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.016965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.016966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.016967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.016968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.016969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.016970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.016971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.016976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.016985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.016989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.016993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.016996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.017000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.017003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.017006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.017010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.017015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.017018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.017022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.017033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.017039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.017049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.017055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.017063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.017068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.017071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.017081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.017089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.017095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.017104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.017108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.017122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.017127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.017131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.017135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.017139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.017144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.017148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.017153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.017158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.017162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.017166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.017175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.017208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:15.025853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:15.027840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:15.027856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:15.027859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:15.027862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:15.027868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [2:7556554359111716706:5657]
2025-10-02T09:30:15.027881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:15.027896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:15.027898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.027901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.027903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.027918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:15.027925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:15.027931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:15.027987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.027994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.027996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.027999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:15.028002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:15.028066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:15.028073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.028086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.028099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.028121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:15.028144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554354892272535:2446], now have 1 active actors on pipe
2025-10-02T09:30:15.028151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240077:6543], now have 1 active actors on pipe
2025-10-02T09:30:15.028157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.028159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.028161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.028176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:15.028192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:15.028198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:15.028209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:15.028183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 676
2025-10-02T09:30:15.028210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:15.028213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:15.028216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:15.028247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.028254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:15.028256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:15.028283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 676
2025-10-02T09:30:15.028371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.028380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.028401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3980af6c-b490a222-b9d144d6-c375a82a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:15.028410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.028413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.028415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:15.028424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.028436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:15.028452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.028578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.028585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.028596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.028664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 36 sessionId: src_id|3980af6c-b490a222-b9d144d6-c375a82a_0
2025-10-02T09:30:15.029057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe91dbf6-9e04be26-9dbf9e35-40248779_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3980af6c-b490a222-b9d144d6-c375a82a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:15.031721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Write session: try to update token
2025-10-02T09:30:15.031738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:15.038699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:15.038718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.038726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.038764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:15.038764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:15.038963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:15.039144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:15.039294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:15.039448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:15.039638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:15.039677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:15.046223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|3980af6c-b490a222-b9d144d6-c375a82a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:15.048298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:15.048313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.048315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:15.048317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:15.048325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.048329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.048332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554359111716700:5657]
2025-10-02T09:30:15.048363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:15.048368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.048370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:15.048381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:15.048387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:15.048389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:15.048530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:15.048574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:15.096443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554359187240090:6089]
2025-10-02T09:30:15.096728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7556554359187240090:6089]
2025-10-02T09:30:15.188480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:15.189037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.189051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.189070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240090:6089], now have 1 active actors on pipe
2025-10-02T09:30:15.189296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554359187240090:6089]
2025-10-02T09:30:15.189326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:15.189357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:15.189434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3980af6c-b490a222-b9d144d6-c375a82a_0
2025-10-02T09:30:15.189610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|3980af6c-b490a222-b9d144d6-c375a82a_0 is DEAD
2025-10-02T09:30:15.189286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:15.189915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:15.189923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Write session will restart in 0.007936s
2025-10-02T09:30:15.189945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Write session: Do CDS request
2025-10-02T09:30:15.189951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:15.199287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.199601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:15.199619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-10-02T09:30:15.199759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.199796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:15.199804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:15.199807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:15.200270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-10-02T09:30:15.200310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:15.200316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:15.200318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:15.200323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554359187240162:6548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:15.200885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554359187240162:6548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:15.203237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554359187240162:6548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:15.206667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554359187240162:6548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:15.206686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554359187240162:6548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:15.206689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554359187240162:6548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:15.206696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:15.209258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:15.211837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:15.212055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:15.212064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:15.212074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:15.212126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:15.212163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554359111716967:5660]
2025-10-02T09:30:15.212729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:15.213089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:15.213136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:15.213457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:15.213512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.213517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.213518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.213519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.213520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.213521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.213522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.213524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.213525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.213526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.213527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.213528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.213533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.213544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.213548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.213551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.213555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.213558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.213562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.213565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.213569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.213573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.213576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.213579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.213585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.213591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.213596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.213601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.213605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.213609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.213614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.213618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.213625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.213630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.213638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.213642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.213647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.213651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.213656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.213661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.213665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.213670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.213674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.213679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.213683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.213687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.213690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.213695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.213727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:15.223258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:15.225165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:15.225180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:15.225183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:15.225187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:15.225194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [2:7556554359111716967:5660]
2025-10-02T09:30:15.225208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:15.225224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:15.225228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.225231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.225233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.225247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:15.225252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:15.225259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:15.225316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.225318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.225320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.225323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:15.225325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:15.225390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:15.225392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.225405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.225416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.225431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:15.225448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.225451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.225453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.225461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:15.225473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:15.225476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:15.225479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:15.225481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:15.225487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:15.225489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:15.225499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240329:6548], now have 1 active actors on pipe
2025-10-02T09:30:15.225503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240098:2446], now have 1 active actors on pipe
2025-10-02T09:30:15.225533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.225550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:15.225578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:15.225855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.225865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.225890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60530a59-b46263db-8463e561-60438b02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:15.225900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.225904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.225906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:15.225916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.225924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:15.225939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.226168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.226178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.226202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.225589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 677
2025-10-02T09:30:15.225589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 677
2025-10-02T09:30:15.226284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 36 sessionId: src_id|60530a59-b46263db-8463e561-60438b02_0
2025-10-02T09:30:15.226641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3980af6c-b490a222-b9d144d6-c375a82a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60530a59-b46263db-8463e561-60438b02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:15.229197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Write session: try to update token
2025-10-02T09:30:15.229216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:15.237298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:15.237317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.237319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:15.237321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:15.237329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.237333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.237336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554359111716962:5660]
2025-10-02T09:30:15.237371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:15.237379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.237381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:15.237396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:15.237405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:15.237409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:15.237521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:15.243377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|60530a59-b46263db-8463e561-60438b02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:15.245836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:15.289405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554359187240361:6089]
2025-10-02T09:30:15.289712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7556554359187240361:6089]
2025-10-02T09:30:15.383519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:15.383876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.383887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.383922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240361:6089], now have 1 active actors on pipe
2025-10-02T09:30:15.384164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:15.384695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554359187240361:6089]
2025-10-02T09:30:15.384737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:15.384828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60530a59-b46263db-8463e561-60438b02_0
2025-10-02T09:30:15.384999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|60530a59-b46263db-8463e561-60438b02_0 is DEAD
2025-10-02T09:30:15.385084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:15.389030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:15.389043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Write session will restart in 0.007272s
2025-10-02T09:30:15.389067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Write session: Do CDS request
2025-10-02T09:30:15.389073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:15.397254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.397365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:15.397384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-10-02T09:30:15.397515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.397543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:15.397547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:15.397552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:15.398112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-10-02T09:30:15.398149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:15.398151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:15.398152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:15.398157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554359187240469:6552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:15.398614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554359187240469:6552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:15.402331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554359187240469:6552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:15.404940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:15.405087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554359187240469:6552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:15.405105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554359187240469:6552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:15.405111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554359187240469:6552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:15.405118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:15.407788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:15.407973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:15.407976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:15.407984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:15.408027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:15.408066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554359111717223:5662]
2025-10-02T09:30:15.408592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:15.408931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:15.408981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:15.409199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:15.409233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.409237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.409238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.409238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.409239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.409240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.409241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.409241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.409242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.409243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.409244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.409244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.409248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.409255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.409257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.409259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.409261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.409263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.409265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.409267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.409270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.409272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.409275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.409279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.409285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.409291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.409298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.409303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.409308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.409312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.409315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.409318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.409321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.409324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.409326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.409329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.409331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.409334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.409337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.409340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.409342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.409345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.409348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.409350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.409353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.409356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.409358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.409360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.409380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:15.419799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:15.421962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:15.421980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:15.421982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:15.421986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:15.421992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [2:7556554359111717223:5662]
2025-10-02T09:30:15.422008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:15.422027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:15.422030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.422033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.422035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.422050Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:15.422056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:15.422063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:15.422122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.422129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.422131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.422136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:15.422138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:15.422206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:15.422213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.422226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.422242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.422262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:15.422284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240364:2446], now have 1 active actors on pipe
2025-10-02T09:30:15.422292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240616:6552], now have 1 active actors on pipe
2025-10-02T09:30:15.422297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.422300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.422302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.422312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:15.422326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:15.422328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:15.422335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:15.422341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:15.422342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:15.422345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:15.422379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.422389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:15.422395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:15.422438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.422393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 678
2025-10-02T09:30:15.422445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.422393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 678
2025-10-02T09:30:15.422467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb055e59-a59676d-96c2fb6-9348be04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:15.422480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.422489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.422491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:15.422500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.422511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:15.422526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.422751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.422758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.422769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.422837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb055e59-a59676d-96c2fb6-9348be04_0
2025-10-02T09:30:15.423239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60530a59-b46263db-8463e561-60438b02_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb055e59-a59676d-96c2fb6-9348be04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:15.425741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Write session: try to update token
2025-10-02T09:30:15.425757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:15.434284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:15.434309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.434312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:15.434314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:15.434321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.434325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.434329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554359111717217:5662]
2025-10-02T09:30:15.434364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:15.434370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.434372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:15.434379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:15.434386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:15.434390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:15.434506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:15.441171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|cb055e59-a59676d-96c2fb6-9348be04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:15.443736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:15.484993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554359187240627:6089]
2025-10-02T09:30:15.485285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7556554359187240627:6089]
2025-10-02T09:30:15.574106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:15.574493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.574506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.574519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240627:6089], now have 1 active actors on pipe
2025-10-02T09:30:15.574673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:15.574674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:15.574677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:15.574720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: error at write: Disconnected sessionId: src_id|cb055e59-a59676d-96c2fb6-9348be04_0
2025-10-02T09:30:15.574721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554359187240627:6089]
2025-10-02T09:30:15.574867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|cb055e59-a59676d-96c2fb6-9348be04_0 is DEAD
2025-10-02T09:30:15.575023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:15.575033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Write session will restart in 0.005086s
2025-10-02T09:30:15.575053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Write session: Do CDS request
2025-10-02T09:30:15.575066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:15.575483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:15.581226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.581302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:15.581321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-10-02T09:30:15.581448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.581471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:15.581478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:15.581482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:15.581899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-10-02T09:30:15.581933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:15.581940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:15.581942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:15.581947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554359187240656:6557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:15.582435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554359187240656:6557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:15.585046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554359187240656:6557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:15.588019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554359187240656:6557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:15.588032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554359187240656:6557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:15.588035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554359187240656:6557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:15.588043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:15.592489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:15.595179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:15.595300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:15.595307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:15.595313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:15.595342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:15.595370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554359111717492:5665]
2025-10-02T09:30:15.595801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:15.596039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:15.596077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:15.596365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:15.596413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.596418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.596419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.596420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.596421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.596422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.596423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.596424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.596425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.596426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.596427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.596429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.596433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.596443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.596446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.596448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.596450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.596452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.596454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.596456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.596458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.596461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.596464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.596466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.596470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.596474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.596478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.596481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.596487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.596496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.596503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.596508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.596516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.596523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.596530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.596535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.596539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.596548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.596555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.596560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.596568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.596577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.596584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.596589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.596595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.596602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.596606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.596612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.596643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:15.604712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:15.606454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:15.606466Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:15.606468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:15.606471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:15.606477Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [2:7556554359111717492:5665]
2025-10-02T09:30:15.606492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:15.606509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:15.606515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.606518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.606519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.606530Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:15.606538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:15.606544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:15.606606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.606612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.606614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.606617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:15.606619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:15.606681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:15.606691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.606703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.606714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.606732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:15.606753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240642:2446], now have 1 active actors on pipe
2025-10-02T09:30:15.606760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240784:6557], now have 1 active actors on pipe
2025-10-02T09:30:15.606765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.606767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.606768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.606780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:15.606794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:15.606797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:15.606800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:15.606802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:15.606812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:15.606814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:15.606838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.606847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:15.606855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:15.606864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 679
2025-10-02T09:30:15.606891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 679
2025-10-02T09:30:15.606968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.606981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.607015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:15.607026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.607029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.607035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:15.607044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.607054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:15.607073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.607243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.607254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.607272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.607345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 36 sessionId: src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0
2025-10-02T09:30:15.607649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb055e59-a59676d-96c2fb6-9348be04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:15.610080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Write session: try to update token
2025-10-02T09:30:15.610094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:15.617841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:15.617857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.617860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:15.617861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:15.617869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.617873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.617877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554359111717487:5665]
2025-10-02T09:30:15.617912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:15.617918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.617922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:15.617925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:15.617928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:15.617932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:15.618103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:15.622979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:15.625535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:15.674960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554359187240906:6089]
2025-10-02T09:30:15.675504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7556554359187240906:6089]
2025-10-02T09:30:15.752717Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:15.753217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.753230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.753246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240906:6089], now have 1 active actors on pipe
2025-10-02T09:30:15.753465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:15.753501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:15.753528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:15.753532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:15.753543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554359187240906:6089]
2025-10-02T09:30:15.753587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: error at write: Disconnected sessionId: src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0
2025-10-02T09:30:15.753755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0 is DEAD
2025-10-02T09:30:15.753893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:15.753897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Write session will restart in 0.007265s
2025-10-02T09:30:15.753911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Write session: Do CDS request
2025-10-02T09:30:15.753915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:15.762286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.762353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:15.762371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-10-02T09:30:15.762480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.762511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:15.762517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:15.762521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:15.763095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-10-02T09:30:15.763148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:15.763154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:15.763156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:15.763163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554359187240957:6561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:15.763593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554359187240957:6561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:15.766757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554359187240957:6561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:15.769995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554359187240957:6561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:15.770009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554359187240957:6561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:15.770012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554359187240957:6561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:15.770017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:15.771081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:15.773506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:15.773670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:15.773680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:15.773689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:15.773730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:15.773766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554359111717750:5667]
2025-10-02T09:30:15.774365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:15.774668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:15.774707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:15.774998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:15.775061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.775067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.775068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.775069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.775070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.775071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.775072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.775073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.775075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.775076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.775077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.775078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.775083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.775093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.775097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.775100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.775104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.775108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.775112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.775115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.775119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.775123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.775126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.775130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.775137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.775144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.775149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.775154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.775158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.775162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.775166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.775171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.775176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.775181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.775185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.775189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.775193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.775197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.775200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.775203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.775205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.775208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.775210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.775213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.775215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.775218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.775220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.775223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.775240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:15.783801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:15.785377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:15.785395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:15.785398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:15.785401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:15.785408Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [2:7556554359111717750:5667]
2025-10-02T09:30:15.785425Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:15.785445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:15.785453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.785456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.785458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.785473Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:15.785481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:15.785489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:15.785544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.785550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.785553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.785556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:15.785558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:15.785765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 680
2025-10-02T09:30:15.785765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 680
2025-10-02T09:30:15.785960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:15.785973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.785987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.785998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.786013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:15.786029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187240912:2446], now have 1 active actors on pipe
2025-10-02T09:30:15.786037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187241167:6561], now have 1 active actors on pipe
2025-10-02T09:30:15.786053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.786059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.786073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.786079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.786081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.786094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:15.786108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:15.786109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:15.786112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:15.786114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:15.786130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:15.786133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:15.786151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:15.786157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.786161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.786163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:15.786171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.786180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:15.786214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.786225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:15.786232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:15.786233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.786377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.786383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.786393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.786498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 36 sessionId: src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0
2025-10-02T09:30:15.786865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f606fba9-1019adf1-8c1bc97-c5a3dab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:15.789529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Write session: try to update token
2025-10-02T09:30:15.789548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:15.797025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:15.797045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.797054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.797093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:15.797097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:15.797257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:15.797400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:15.797531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:15.797675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:15.797878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:15.797922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:15.803203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:15.805702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:15.805931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.805948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.805980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:15.806104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:15.806977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:15.806989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:15.806991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:15.806993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:15.807000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.807016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.807019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554359111717745:5667]
2025-10-02T09:30:15.807055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:15.807065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.807067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:15.807072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:15.807088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:15.807098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:15.807189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:15.853656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554359187241184:6089]
2025-10-02T09:30:15.853908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7556554359187241184:6089]
2025-10-02T09:30:15.949589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:15.957959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.957985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.958141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.958201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.958263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.958327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.958369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.958378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.958441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.958501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.958569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.958629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.958673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.958682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.958747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.958805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.958867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.958956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.958996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.959014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.959074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.959133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.959193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.959254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.959365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.959376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.959463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.959521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.959585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.959648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.959698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.959706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.959769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.959829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.959888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.959946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.959999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.960006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.960070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.960125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.960189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.960254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.960298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.960305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.960368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.960427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.960484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.960544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.960589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.960596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.960656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.960716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.960773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.960845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.960900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.960906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.960966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:15.961023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:15.961086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:15.961147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:15.961188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:15.961195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:15.961264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187241184:6089], now have 1 active actors on pipe
2025-10-02T09:30:15.961509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:15.961518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554359187241184:6089]
2025-10-02T09:30:15.961529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:15.961535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:15.961556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: error at write: Disconnected sessionId: src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0
2025-10-02T09:30:15.961738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0 is DEAD
2025-10-02T09:30:15.961890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:15.961897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Write session will restart in 0.007782s
2025-10-02T09:30:15.961917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Write session: Do CDS request
2025-10-02T09:30:15.961923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:15.962322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:15.971285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.971407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:15.971427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-10-02T09:30:15.971531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:15.971559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:15.971568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:15.971572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:15.972006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-10-02T09:30:15.972040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:15.972046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:15.972048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:15.972054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554359187241253:6573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:15.972559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554359187241253:6573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:15.975431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554359187241253:6573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:15.978527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554359187241253:6573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:15.978544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554359187241253:6573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:15.978547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554359187241253:6573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:15.978555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:15.980479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:15.983269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:15.983432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:15.983441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:15.983449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:15.983494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:15.983532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554359111718048:5682]
2025-10-02T09:30:15.984126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:15.984464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:15.984502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:15.984791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:15.984853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.984859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.984860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.984862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.984863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.984864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.984865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.984866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.984867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.984868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.984869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.984871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.984876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.984886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.984890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.984894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.984898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.984902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.984905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.984909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.984913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.984917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.984921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.984925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.984931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.984938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:15.984943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.984949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:15.984953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.984958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:15.984961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.984966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:15.984975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.984981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:15.984986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.984995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:15.985000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.985010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:15.985014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.985019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:15.985026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.985031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:15.985039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.985044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.985050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.985055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.985058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.985064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.985098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:15.993634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:15.995525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:15.995544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:15.995546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:15.995550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:15.995557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [2:7556554359111718048:5682]
2025-10-02T09:30:15.995572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:15.995589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:15.995591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.995594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.995597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.995612Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:15.995622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:15.995630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:15.995689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.995696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.995698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.995701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:15.995704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:15.995926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 681
2025-10-02T09:30:15.996051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:15.996064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:15.996079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:15.996093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:15.996111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:15.996134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187241452:6573], now have 1 active actors on pipe
2025-10-02T09:30:15.996143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554359187241211:2446], now have 1 active actors on pipe
2025-10-02T09:30:15.996155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:15.996161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:15.996163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:15.996176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:15.996184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 681
2025-10-02T09:30:15.996193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:15.996206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:15.996209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:15.996211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:15.996212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:15.996213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:15.996242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:15.996249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:15.996254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:15.996263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.996267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.996305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:15.996316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:15.996319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:15.996321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:15.996329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:15.996336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:15.996353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.996514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:15.996522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:15.996534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:15.996609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0
2025-10-02T09:30:15.996943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87c9cbb-a211ec8f-5d280072-9a3d9d0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:15.999386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Write session: try to update token
2025-10-02T09:30:15.999400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:16.007432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:16.007452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.007455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:16.007457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:16.007465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:16.007469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:16.007473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554359111718043:5682]
2025-10-02T09:30:16.007509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:16.007521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.007521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:16.007527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:16.007527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:16.007531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:16.007646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:16.013372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:16.015774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:16.061520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554363482208771:6089]
2025-10-02T09:30:16.061832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7556554363482208771:6089]
2025-10-02T09:30:16.152025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:16.152318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.152329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.152343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482208771:6089], now have 1 active actors on pipe
2025-10-02T09:30:16.152582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:16.152605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:16.152614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554363482208771:6089]
2025-10-02T09:30:16.152635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:16.152696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0
2025-10-02T09:30:16.152896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0 is DEAD
2025-10-02T09:30:16.153045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:16.153055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Write session will restart in 0.006971s
2025-10-02T09:30:16.153074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Write session: Do CDS request
2025-10-02T09:30:16.153079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:16.161266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.161356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:16.161379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-10-02T09:30:16.161481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.161512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:16.161516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:16.161520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:16.162042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-10-02T09:30:16.162083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:16.162103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:16.162110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:16.162115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554363482208820:6578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:16.162597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554363482208820:6578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:16.165137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554363482208820:6578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:16.167747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554363482208820:6578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:16.167762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554363482208820:6578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:16.167766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554363482208820:6578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:16.167772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:16.169261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:16.172312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:16.172486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:16.172496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:16.172505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:16.172560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:16.172597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554363406685607:5685]
2025-10-02T09:30:16.173150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:16.173407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:16.173441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:16.173709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:16.173762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.173768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.173769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.173770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.173771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.173773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.173774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.173775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.173776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.173777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.173778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.173780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.173784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.173795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.173799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.173803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.173806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.173810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.173814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.173818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.173821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.173825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.173829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.173833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.173838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.173845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.173850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.173856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.173860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.173865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.173873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.173876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.173878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.173881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.173884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.173887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.173889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.173892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.173894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.173897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.173900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.173903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.173905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.173908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.173911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.173913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.173916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.173918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.173938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:16.182327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:16.183900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:16.183917Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:16.183920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:16.183925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:16.183931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [2:7556554363406685607:5685]
2025-10-02T09:30:16.183945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:16.183962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:16.183970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.183973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.183975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.183991Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:16.184000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:16.184008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:16.184062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.184070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.184072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.184078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:16.184081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:16.184145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:16.184151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.184164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.184178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.184197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:16.184218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482208773:2446], now have 1 active actors on pipe
2025-10-02T09:30:16.184221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209028:6578], now have 1 active actors on pipe
2025-10-02T09:30:16.184226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.184230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.184232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.184244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:16.184256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:16.184260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:16.184263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:16.184264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:16.184273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:16.184276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:16.184309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.184316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:16.184322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:16.184328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 682
2025-10-02T09:30:16.184358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.184365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.184328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 682
2025-10-02T09:30:16.184385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:16.184394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.184398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.184400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:16.184409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.184421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:16.184435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.184557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.184565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.184579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.184652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0
2025-10-02T09:30:16.185021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce01c0d6-e5090775-38fb6373-1f825a07_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:16.187363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Write session: try to update token
2025-10-02T09:30:16.187376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:16.194684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:16.194710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.194718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.194759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:16.194767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:16.194923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:16.195473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.195620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.195745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.195927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:16.195962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:16.200036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:16.202393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:16.202693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.202710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.202753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:16.202816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:16.203773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:16.203785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.203788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:16.203790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:16.203798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.203802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.203805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554363406685602:5685]
2025-10-02T09:30:16.203837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:16.203839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:16.203845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:16.203847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.203848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:16.203849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:16.203968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:16.252993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554363482209043:6089]
2025-10-02T09:30:16.253283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7556554363482209043:6089]
2025-10-02T09:30:16.340506Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:16.348388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.348414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.348568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.348629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.348692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.348756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.348796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.348816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.348878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.348933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.348996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.349058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.349110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.349118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.349182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.349243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.349304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.349365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.349406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.349414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.349482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.349541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.349597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.349665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.349712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.349719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.349788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.349851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.349916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.349981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.350040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.350046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.350139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.350219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.350283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.350344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.350397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.350404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.350467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.350524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.350590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.350663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.350773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.350782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.350850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.350909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.350969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.351048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.351102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.351113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.351175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.351234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.351295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.351357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.351407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.351415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.351476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.351536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.351597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.351655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.351708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.351713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.351771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209043:6089], now have 1 active actors on pipe
2025-10-02T09:30:16.352015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554363482209043:6089]
2025-10-02T09:30:16.352016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:16.352051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:16.352054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:16.352079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: error at write: Disconnected sessionId: src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0
2025-10-02T09:30:16.352261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0 is DEAD
2025-10-02T09:30:16.352472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:16.352483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Write session will restart in 0.008298s
2025-10-02T09:30:16.352506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Write session: Do CDS request
2025-10-02T09:30:16.352512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:16.353005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:16.362291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.362383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:16.362400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-10-02T09:30:16.362507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.362535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:16.362546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:16.362549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:16.362947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-10-02T09:30:16.362978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:16.363018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:16.363024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:16.363028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554363482209095:6582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:16.363422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554363482209095:6582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:16.366051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554363482209095:6582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:16.369347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554363482209095:6582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:16.369363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554363482209095:6582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:16.369365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554363482209095:6582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:16.369371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:16.370912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:16.373837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:16.374026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:16.374037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:16.374046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:16.374097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:16.374138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554363406685869:5687]
2025-10-02T09:30:16.374725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:16.375043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:16.375085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:16.375539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:16.375611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.375612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.375613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.375614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.375615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.375616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.375617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.375618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.375619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.375620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.375621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.375622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.375628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.375639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.375642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.375646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.375649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.375653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.375656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.375660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.375664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.375668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.375671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.375675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.375681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.375688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.375694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.375699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.375704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.375708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.375712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.375717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.375722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.375734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.375738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.375743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.375748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.375758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.375762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.375767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.375776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.375780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.375784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.375788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.375792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.375803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.375807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.375818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.375854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:16.384971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:16.386724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:16.386743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:16.386746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:16.386750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:16.386757Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [2:7556554363406685869:5687]
2025-10-02T09:30:16.386772Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:16.386791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:16.386793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.386797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.386799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.386816Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:16.386821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:16.386827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:16.386887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.386896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.386898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.386901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:16.386904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:16.386972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:16.386980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.386995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.387022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.387043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:16.387072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209045:2446], now have 1 active actors on pipe
2025-10-02T09:30:16.387076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209300:6582], now have 1 active actors on pipe
2025-10-02T09:30:16.387082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.387084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.387086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.387098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:16.387112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:16.387111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:16.387114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:16.387116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:16.387126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:16.387129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:16.387167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.387178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:16.387179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 683
2025-10-02T09:30:16.387179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 683
2025-10-02T09:30:16.387304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.387314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.387335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:16.387341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:16.387346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.387349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.387350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:16.387358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.387368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:16.387379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.387540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.387547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.387558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.387651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 36 sessionId: src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0
2025-10-02T09:30:16.387958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed34ead8-4e97b01-658a8cd8-3310e5de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:16.390999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Write session: try to update token
2025-10-02T09:30:16.391032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:16.399035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:16.399053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.399055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:16.399056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:16.399062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.399065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.399068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554363406685864:5687]
2025-10-02T09:30:16.399104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:16.399107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:16.399111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.399111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:16.399114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:16.399116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:16.399254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:16.405312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:16.408369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:16.452178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554363482209314:6089]
2025-10-02T09:30:16.452472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7556554363482209314:6089]
2025-10-02T09:30:16.542111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:16.542663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.542674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.542691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209314:6089], now have 1 active actors on pipe
2025-10-02T09:30:16.542849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:16.542911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:16.542932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:16.542967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554363482209314:6089]
2025-10-02T09:30:16.542991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0
2025-10-02T09:30:16.543165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0 is DEAD
2025-10-02T09:30:16.543310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:16.543318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Write session will restart in 0.008980s
2025-10-02T09:30:16.543337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Write session: Do CDS request
2025-10-02T09:30:16.543341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:16.553312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.553372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:16.553390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-10-02T09:30:16.553504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.553533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:16.553539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:16.553543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:16.554032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-10-02T09:30:16.554065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:16.554072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:16.554073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:16.554079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554363482209413:6588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:16.554573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554363482209413:6588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:16.556657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554363482209413:6588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:16.559309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554363482209413:6588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:16.559325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554363482209413:6588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:16.559328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554363482209413:6588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:16.559360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:16.559879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:16.562714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:16.562865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:16.562875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:16.562882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:16.562918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:16.562944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554363406686143:5690]
2025-10-02T09:30:16.563405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:16.563684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:16.563718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:16.563986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:16.564051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.564056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.564057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.564058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.564059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.564060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.564061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.564063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.564064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.564065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.564066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.564067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.564072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.564083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.564086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.564090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.564094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.564098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.564101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.564105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.564109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.564111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.564113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.564117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.564123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.564131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.564135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.564140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.564144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.564149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.564154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.564158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.564163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.564178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.564187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.564192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.564196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.564205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.564209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.564213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.564221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.564225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.564229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.564237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.564241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.564246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.564253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.564258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.564295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:16.573010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:16.574663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:16.574678Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:16.574680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:16.574683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:16.574688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [2:7556554363406686143:5690]
2025-10-02T09:30:16.574697Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:16.574710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:16.574711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.574713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.574715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.574727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:16.574730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:16.574735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:16.574776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.574782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.574783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.574785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:16.574787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:16.574838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:16.574844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.574852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.574857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.574867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:16.574884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209577:6588], now have 1 active actors on pipe
2025-10-02T09:30:16.574892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.574894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.574895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.574900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:16.574908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209321:2446], now have 1 active actors on pipe
2025-10-02T09:30:16.574912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:16.574913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:16.574916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:16.574918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:16.574922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:16.574924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:16.574951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.574959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:16.574963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:16.574997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.575016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.574971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 684
2025-10-02T09:30:16.575036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:16.575044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.575012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 684
2025-10-02T09:30:16.575047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.575048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:16.575054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.575060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:16.575072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.575160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.575165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.575174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.575245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 36 sessionId: src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0
2025-10-02T09:30:16.575595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280d429-9f83fc82-58da0a5f-9ccfbee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:16.578122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Write session: try to update token
2025-10-02T09:30:16.578141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:16.585408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:16.585428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.585436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.585476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:16.585484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:16.585658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:16.585812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.585960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.586106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.586290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:16.586326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:16.591513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:16.593784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:16.593988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.594007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.594974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:16.594986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.594988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:16.594989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:16.594996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.594998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.595014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554363406686138:5690]
2025-10-02T09:30:16.595041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:16.595056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:16.595055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:16.595061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:16.595062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.595064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:16.595065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:16.595125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:16.595179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:16.643128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554363482209602:6089]
2025-10-02T09:30:16.643397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7556554363482209602:6089]
2025-10-02T09:30:16.719780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:16.726443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.726463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.726602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.726657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.726714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.726772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.726811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.726818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.726874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.726927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.726986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.727049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.727089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.727095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.727152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.727205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.727264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.727321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.727366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.727370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.727425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.727479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.727536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.727596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.727635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.727640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.727696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.727750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.727804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.727861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.727902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.727908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.727964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.728016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.728070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.728125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.728165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.728170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.728223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.728276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.728331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.728387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.728431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.728436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.728489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.728546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.728599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.728654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.728714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.728720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.728811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.728863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.728916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.728969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.729008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.729013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.729067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.729121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.729174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.729226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.729268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.729273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.729306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209602:6089], now have 1 active actors on pipe
2025-10-02T09:30:16.729553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:16.729562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:16.729565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:16.729592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: error at write: Disconnected sessionId: src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0
2025-10-02T09:30:16.729613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554363482209602:6089]
2025-10-02T09:30:16.729778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0 is DEAD
2025-10-02T09:30:16.729924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:16.729932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Write session will restart in 0.007390s
2025-10-02T09:30:16.729952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Write session: Do CDS request
2025-10-02T09:30:16.729958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:16.730195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:16.738232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.738303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:16.738317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-10-02T09:30:16.738405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.738432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:16.738440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:16.738443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:16.738788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-10-02T09:30:16.738811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:16.738815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:16.738816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:16.738823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554363482209668:6593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:16.739242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554363482209668:6593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:16.741487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554363482209668:6593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:16.743816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554363482209668:6593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:16.743829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554363482209668:6593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:16.743832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554363482209668:6593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:16.743838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:16.745010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:16.747606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:16.747737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:16.747744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:16.747750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:16.747782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:16.747817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554363406686406:5692]
2025-10-02T09:30:16.748217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:16.748455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:16.748480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:16.748661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:16.748693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.748697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.748698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.748699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.748700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.748701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.748702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.748703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.748704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.748705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.748706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.748707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.748711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.748721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.748725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.748728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.748732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.748735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.748737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.748739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.748741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.748743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.748745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.748747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.748751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.748756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.748759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.748762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.748764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.748767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.748770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.748772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.748774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.748778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.748780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.748783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.748785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.748787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.748790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.748792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.748795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.748798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.748813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.748816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.748818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.748821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.748823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.748826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.748858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:16.756910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:16.758559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:16.758576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:16.758578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:16.758582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:16.758588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [2:7556554363406686406:5692]
2025-10-02T09:30:16.758602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:16.758622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:16.758630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.758633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.758634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.758648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:16.758661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:16.758667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:16.758711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.758716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.758718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.758720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:16.758721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:16.758765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:16.758770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.758778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.758784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.758792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:16.758806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.758811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.758812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.758817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:16.758826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:16.758829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:16.758833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:16.758835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:16.758839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:16.758841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:16.758850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209605:2446], now have 1 active actors on pipe
2025-10-02T09:30:16.758857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209860:6593], now have 1 active actors on pipe
2025-10-02T09:30:16.758884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.758897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:16.758909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:16.758916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 685
2025-10-02T09:30:16.758923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 685
2025-10-02T09:30:16.759022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.759030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.759051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:16.759061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.759069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.759072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:16.759085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.759097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:16.759111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.759292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.759298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.759310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.759383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0
2025-10-02T09:30:16.759659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece7f71f-674d78a3-e3bf1e07-6bc6a978_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:16.762172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Write session: try to update token
2025-10-02T09:30:16.762186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:16.768792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:16.768825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.768834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.768872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:16.768873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:16.769034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:16.769173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.769313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.769452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.769635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:16.769670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:16.774597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:16.776731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:16.776890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.776906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.776931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:16.777003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:16.777942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:16.777955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.777958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:16.777960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:16.777969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.777973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.777976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554363406686401:5692]
2025-10-02T09:30:16.778008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:16.778015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:16.778017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.778019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:16.778021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:16.778024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:16.778148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:16.829994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554363482209883:6089]
2025-10-02T09:30:16.830237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7556554363482209883:6089]
2025-10-02T09:30:16.908605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:16.915587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.915609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.915740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.915791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.915844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.915900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.915939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.915945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.915999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.916057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.916112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.916189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.916227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.916232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.916287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.916339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.916394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.916448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.916489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.916494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.916548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.916603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.916659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.916714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.916759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.916764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.916835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.916888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.916945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.917004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.917047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.917052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.917112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.917168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.917226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.917283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.917326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.917332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.917388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.917439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.917496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.917550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.917590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.917598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.917655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.917709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.917765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.917820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.917867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.917875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.917938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.917992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.918046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.918101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.918152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.918157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.918211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:16.918261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:16.918317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:16.918374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:16.918412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:16.918416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:16.918455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209883:6089], now have 1 active actors on pipe
2025-10-02T09:30:16.918668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554363482209883:6089]
2025-10-02T09:30:16.918701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:16.918705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:16.918707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:16.918728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: error at write: Disconnected sessionId: src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0
2025-10-02T09:30:16.918876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0 is DEAD
2025-10-02T09:30:16.919033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:16.919041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Write session will restart in 0.008586s
2025-10-02T09:30:16.919056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Write session: Do CDS request
2025-10-02T09:30:16.919060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:16.919247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:16.928221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.928290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:16.928306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-10-02T09:30:16.928419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:16.928442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:16.928449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:16.928452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:16.928771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-10-02T09:30:16.928797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:16.928818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:16.928820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:16.928823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554363482209956:6598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:16.929216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554363482209956:6598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:16.931348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554363482209956:6598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:16.933917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554363482209956:6598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:16.933930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554363482209956:6598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:16.933933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554363482209956:6598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:16.933939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:16.934751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:16.937308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:16.937479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:16.937489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:16.937498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:16.937542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:16.937577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554363406686685:5701]
2025-10-02T09:30:16.938156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:16.938484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:16.938523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:16.938812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:16.938863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.938869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.938870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.938871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.938873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.938874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.938875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.938876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.938877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.938878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.938879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.938880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.938884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.938893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.938897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.938901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.938904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.938907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.938911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.938915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.938919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.938923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.938926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.938930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.938935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.938942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:16.938947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.938952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:16.938956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.938961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:16.938965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.938970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:16.938974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.938979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:16.938983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.938988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:16.938992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.938997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:16.939013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.939023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:16.939027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.939032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:16.939040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.939045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.939054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.939058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.939063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.939068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.939105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:16.947363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:16.948955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:16.948969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:16.948971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:16.948974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:16.948979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [2:7556554363406686685:5701]
2025-10-02T09:30:16.948991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:16.949004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:16.949006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.949009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.949010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.949023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:16.949028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:16.949034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:16.949083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.949091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.949093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.949096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:16.949098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:16.949156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:16.949165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.949176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:16.949186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:16.949200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:16.949218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482209886:2446], now have 1 active actors on pipe
2025-10-02T09:30:16.949227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554363482210144:6598], now have 1 active actors on pipe
2025-10-02T09:30:16.949232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.949234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.949236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.949247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:16.949262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:16.949264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:16.949267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:16.949269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:16.949277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:16.949280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:16.949308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.949316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:16.949320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:16.949303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 686
2025-10-02T09:30:16.949353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 686
2025-10-02T09:30:16.949436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.949446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.949466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:16.949476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:16.949479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:16.949481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:16.949491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:16.949504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:16.949519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.949647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.949655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.949666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:16.949733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 36 sessionId: src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0
2025-10-02T09:30:16.950052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6c6874-cb02f294-d5aaec8-bad0e7f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:16.952439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Write session: try to update token
2025-10-02T09:30:16.952451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:16.959781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:16.959801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.959809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.959848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:16.959849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:16.960010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:16.960151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.960290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.960421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:16.960598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:16.960639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:16.965260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:16.967585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:16.967794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:16.967812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:16.967860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:16.967938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:16.968933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:16.968947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:16.968950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:16.968953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:16.968960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.968964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.968970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554363406686680:5701]
2025-10-02T09:30:16.969003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:16.969010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:16.969015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:16.969015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:16.969017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:16.969019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:16.969149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:17.018933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554367777177475:6089]
2025-10-02T09:30:17.019221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7556554367777177475:6089]
2025-10-02T09:30:17.110551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:17.119145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.119175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.119354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.119419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.119485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.119550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.119594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.119602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.119673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.119746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.119817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.119890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.119942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.119950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.120021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.120081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.120147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.120219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.120272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.120279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.120343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.120404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.120468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.120531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.120582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.120589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.120659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.120723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.120797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.120887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.120942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.120949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.121020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.121089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.121162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.121231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.121276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.121283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.121352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.121419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.121487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.121552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.121605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.121614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.121682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.121749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.121817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.121879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.121923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.121930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.121998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.122056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.122120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.122188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.122236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.122243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.122325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.122393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.122456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.122524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.122577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.122584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.122643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777177475:6089], now have 1 active actors on pipe
2025-10-02T09:30:17.122851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:17.122886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554367777177475:6089]
2025-10-02T09:30:17.122897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:17.122899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:17.122922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0
2025-10-02T09:30:17.123266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:17.123276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Write session will restart in 0.006590s
2025-10-02T09:30:17.123297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Write session: Do CDS request
2025-10-02T09:30:17.123303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:17.123101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0 is DEAD
2025-10-02T09:30:17.123781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:17.131327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.131421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:17.131442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-10-02T09:30:17.131592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.131631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:17.131640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:17.131644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:17.132072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-10-02T09:30:17.132105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:17.132107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:17.132108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:17.132114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554367777177492:6609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:17.132597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554367777177492:6609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:17.135975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554367777177492:6609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:17.139219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554367777177492:6609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:17.139236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554367777177492:6609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:17.139240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554367777177492:6609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:17.139248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:17.144234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:17.144676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:17.144787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:17.144794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:17.144811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:17.144840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:17.144868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554367701654269:5709]
2025-10-02T09:30:17.145428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:17.147479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:17.147521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:17.147775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:17.147824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.147832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.147833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.147834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.147834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.147835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.147836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.147836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.147837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.147837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.147838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.147839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.147843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.147850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.147852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.147854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.147856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.147858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.147861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.147863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.147865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.147867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.147869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.147871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.147877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.147882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.147886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.147889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.147891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.147894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.147896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.147899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.147901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.147904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.147906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.147909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.147911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.147914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.147917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.147919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.147921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.147924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.147928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.147931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.147933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.147938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.147940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.147943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.147961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:17.156926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:17.158863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:17.158882Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:17.158884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:17.158888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:17.158894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [2:7556554367701654269:5709]
2025-10-02T09:30:17.158908Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:17.158926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:17.158929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.158932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.158937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.158953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:17.158962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:17.158968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:17.159039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.159058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.159060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.159063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:17.159066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:17.159129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:17.159136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.159147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.159156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.159170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:17.159188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777177622:6609], now have 1 active actors on pipe
2025-10-02T09:30:17.159191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777177478:2446], now have 1 active actors on pipe
2025-10-02T09:30:17.159196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.159199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.159200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.159212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:17.159224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:17.159238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:17.159242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:17.159244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:17.159249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:17.159251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:17.159276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.159287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:17.159295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:17.159352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 687
2025-10-02T09:30:17.159352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 687
2025-10-02T09:30:17.159439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.159449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.159470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d822347f-e085fbac-4f9fb62f-e731e38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:17.159480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.159483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.159485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:17.159494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.159507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:17.159520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.159661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.159670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.159683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.164948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 36 sessionId: src_id|d822347f-e085fbac-4f9fb62f-e731e38_0
2025-10-02T09:30:17.166468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|962805c6-d9786eb8-b5c354f4-fd15b6de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d822347f-e085fbac-4f9fb62f-e731e38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:17.169029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Write session: try to update token
2025-10-02T09:30:17.169045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:17.170063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:17.170081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:17.170090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.170131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:17.170138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:17.170301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:17.170445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:17.170585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:17.170720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:17.170913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:17.170965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:17.180286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:17.180305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:17.180307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:17.180310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:17.180319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.180323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.180328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554367701654264:5709]
2025-10-02T09:30:17.180363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:17.180370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.180372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:17.180385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:17.180391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:17.180395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:17.180512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:17.186962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|d822347f-e085fbac-4f9fb62f-e731e38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:17.189806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:17.223843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554367777177753:6089]
2025-10-02T09:30:17.224140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7556554367777177753:6089]
2025-10-02T09:30:17.347615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:17.348193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.348201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.348219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777177753:6089], now have 1 active actors on pipe
2025-10-02T09:30:17.349489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:17.349505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:17.349572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|d822347f-e085fbac-4f9fb62f-e731e38_0
2025-10-02T09:30:17.349751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|d822347f-e085fbac-4f9fb62f-e731e38_0 is DEAD
2025-10-02T09:30:17.349952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554367777177753:6089]
2025-10-02T09:30:17.349964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:17.350018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:17.353013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:17.353025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Write session will restart in 0.007211s
2025-10-02T09:30:17.353050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Write session: Do CDS request
2025-10-02T09:30:17.353056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:17.361260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.361403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:17.361425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-10-02T09:30:17.361543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.361574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:17.361583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:17.361588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:17.362301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-10-02T09:30:17.362346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:17.362352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:17.362354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:17.362360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554367777177778:6614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:17.362933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554367777177778:6614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:17.366590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554367777177778:6614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:17.370425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554367777177778:6614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:17.370442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554367777177778:6614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:17.370446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554367777177778:6614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:17.370453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:17.374870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:17.377560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:17.377761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:17.377772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:17.377782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:17.377829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:17.377866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554367701654539:5712]
2025-10-02T09:30:17.378526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:17.378810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:17.378852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:17.379211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:17.379265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.379271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.379272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.379273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.379274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.379275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.379276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.379277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.379278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.379279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.379280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.379281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.379287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.379297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.379301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.379305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.379308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.379312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.379316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.379320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.379323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.379327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.379331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.379335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.379342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.379350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.379355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.379361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.379365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.379370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.379375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.379386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.379390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.379395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.379401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.379414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.379422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.379428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.379432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.379441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.379445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.379454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.379458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.379463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.379471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.379476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.379484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.379487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.379516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:17.387796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:17.389343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:17.389357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:17.389359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:17.389363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:17.389368Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [2:7556554367701654539:5712]
2025-10-02T09:30:17.389383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:17.389403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:17.389409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.389411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.389413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.389425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:17.389429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:17.389438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:17.389483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.389488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.389490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.389492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:17.389493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:17.389541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:17.389550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.389561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.389572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.389588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:17.389600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.389605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.389607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.389613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:17.389624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:17.389632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:17.389635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:17.389636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:17.389641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:17.389654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:17.389667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777177755:2446], now have 1 active actors on pipe
2025-10-02T09:30:17.389674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777177930:6614], now have 1 active actors on pipe
2025-10-02T09:30:17.389676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.389679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:17.389684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:17.389715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 688
2025-10-02T09:30:17.389756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 688
2025-10-02T09:30:17.389825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.389833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.389854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce97319c-413fced3-950db450-d14deff2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:17.389860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.389863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.389865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:17.389874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.389883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:17.389899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.390284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.390290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.390302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.390388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce97319c-413fced3-950db450-d14deff2_0
2025-10-02T09:30:17.390727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d822347f-e085fbac-4f9fb62f-e731e38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce97319c-413fced3-950db450-d14deff2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:17.393386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Write session: try to update token
2025-10-02T09:30:17.393403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:17.400156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:17.400174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:17.400182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.400224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:17.400233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:17.400400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:17.400537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:17.400672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:17.400829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:17.401020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:17.401060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:17.406805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId: src_id|ce97319c-413fced3-950db450-d14deff2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:17.409435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:17.409543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.409566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.409616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:17.409682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:17.410686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:17.410696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:17.410699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:17.410700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:17.410708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.410713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.410717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554367701654534:5712]
2025-10-02T09:30:17.410753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:17.410760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.410760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:17.410762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:17.410767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:17.410771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:17.410892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:17.446973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554367777178029:6089]
2025-10-02T09:30:17.447477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7556554367777178029:6089]
2025-10-02T09:30:17.555592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:17.563073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.563094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.563231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.563286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.563341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.563403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.563446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.563453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.563511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.563564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.563618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.563677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.563718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.563727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.563790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.563844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.563900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.563956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.563994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.564000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.564056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.564111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.564173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.564233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.564277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.564285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.564348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.564413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.564478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.564541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.564588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.564593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.564658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.564719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.564779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.564860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.564908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.564916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.564972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.565024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.565077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.565129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.565168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.565170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.565240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.565305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.565375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.565439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.565484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.565493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.565559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.565613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.565674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.565741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.565785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.565793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.565862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:17.565924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:17.565991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:17.566047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:17.566088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:17.566097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:17.566146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178029:6089], now have 1 active actors on pipe
2025-10-02T09:30:17.566395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:17.566417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:17.566419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554367777178029:6089]
2025-10-02T09:30:17.566439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:17.566447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: error at write: Disconnected sessionId: src_id|ce97319c-413fced3-950db450-d14deff2_0
2025-10-02T09:30:17.566627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|ce97319c-413fced3-950db450-d14deff2_0 is DEAD
2025-10-02T09:30:17.566776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:17.566784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Write session will restart in 0.007008s
2025-10-02T09:30:17.566806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Write session: Do CDS request
2025-10-02T09:30:17.566811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:17.567200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:17.575371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.575461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:17.575482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-10-02T09:30:17.575602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.575628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:17.575633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:17.575637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:17.576163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-10-02T09:30:17.576193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:17.576195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:17.576197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:17.576202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554367777178057:6618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:17.576714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554367777178057:6618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:17.583470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554367777178057:6618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:17.587088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554367777178057:6618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:17.587112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554367777178057:6618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:17.587116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554367777178057:6618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:17.587124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:17.588647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:17.591908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:17.592069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:17.592076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:17.592082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:17.592115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:17.592145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554367701654818:5715]
2025-10-02T09:30:17.592662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:17.592982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:17.593026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:17.593256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:17.593302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.593308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.593309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.593310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.593312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.593313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.593314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.593315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.593316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.593317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.593318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.593319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.593323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.593334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.593338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.593342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.593345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.593348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.593352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.593355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.593358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.593362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.593365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.593369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.593374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.593381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.593386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.593391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.593398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.593403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.593413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.593419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.593428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.593444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.593454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.593459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.593468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.593473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.593481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.593487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.593495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.593499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.593503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.593513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.593519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.593529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.593533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.593536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.593568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:17.602826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:17.604396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:17.604411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:17.604413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:17.604416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:17.604422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [2:7556554367701654818:5715]
2025-10-02T09:30:17.604433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:17.604453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:17.604455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.604458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.604460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.604474Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:17.604479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:17.604486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:17.604539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.604550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.604552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.604556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:17.604558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:17.604679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:17.604691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.604704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.604715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.604730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:17.604755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178304:6618], now have 1 active actors on pipe
2025-10-02T09:30:17.604764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178032:2446], now have 1 active actors on pipe
2025-10-02T09:30:17.604771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.604773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.604775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.604849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 689
2025-10-02T09:30:17.604884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 689
2025-10-02T09:30:17.604788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:17.604817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:17.604821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:17.604823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:17.604823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:17.604835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:17.604839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:17.604872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.604874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:17.604901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:17.604950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.604958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.604981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:17.604989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.604993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.604996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:17.605006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.605016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:17.605033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.605156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.605166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.605178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.605255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 36 sessionId: src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0
2025-10-02T09:30:17.605601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce97319c-413fced3-950db450-d14deff2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:17.608174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Write session: try to update token
2025-10-02T09:30:17.608191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:17.616511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:17.616532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:17.616535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:17.616537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:17.616546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.616549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.616553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554367701654813:5715]
2025-10-02T09:30:17.616590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:17.616596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.616598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:17.616601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:17.616624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:17.616628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:17.616754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:17.621216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:17.623756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:17.666637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554367777178318:6089]
2025-10-02T09:30:17.666936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7556554367777178318:6089]
2025-10-02T09:30:17.764628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:17.765376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.765389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.765426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178318:6089], now have 1 active actors on pipe
2025-10-02T09:30:17.765651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554367777178318:6089]
2025-10-02T09:30:17.765686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:17.765757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: status is not ok: tablet will be restarted right now sessionId: src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0
2025-10-02T09:30:17.765616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:17.766048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:17.766059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Write session will restart in 0.009899s
2025-10-02T09:30:17.766078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Write session: Do CDS request
2025-10-02T09:30:17.766085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:17.765925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0 is DEAD
2025-10-02T09:30:17.765949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:17.777251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.777331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:17.777349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-10-02T09:30:17.777480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.777503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:17.777517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:17.777521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:17.778038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-10-02T09:30:17.778067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:17.778069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:17.778070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:17.778075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554367777178429:6624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:17.778577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554367777178429:6624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:17.780897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554367777178429:6624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:17.783567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554367777178429:6624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:17.783582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554367777178429:6624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:17.783585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554367777178429:6624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:17.783592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:17.784260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:17.787051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:17.787235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:17.787244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:17.787253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:17.787297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:17.787336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554367701655086:5717]
2025-10-02T09:30:17.787940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:17.788257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:17.788327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:17.788660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:17.788720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.788725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.788726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.788727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.788729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.788730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.788732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.788733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.788734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.788735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.788736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.788737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.788742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.788752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.788756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.788760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.788763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.788766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.788769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.788773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.788776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.788781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.788784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.788788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.788794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.788816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.788822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.788827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.788831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.788836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.788840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.788844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.788854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.788859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.788865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.788877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.788881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.788886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.788890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.788895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.788899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.788903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.788908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.788912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.788916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.788921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.788925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.788929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.788962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:17.798056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:17.799814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:17.799831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:17.799834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:17.799838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:17.799846Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [2:7556554367701655086:5717]
2025-10-02T09:30:17.799860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:17.799878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:17.799881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.799884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.799887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.799902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:17.799913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:17.799924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:17.799989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.799997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.799999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.800002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:17.800004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:17.800075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:17.800084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.800097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.800108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.800128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:17.800153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178587:6624], now have 1 active actors on pipe
2025-10-02T09:30:17.800163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178324:2446], now have 1 active actors on pipe
2025-10-02T09:30:17.800170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.800172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.800175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.800187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:17.800201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:17.800203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:17.800205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:17.800207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:17.800221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:17.800224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:17.800217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 690
2025-10-02T09:30:17.800229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 690
2025-10-02T09:30:17.800257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.800269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:17.800273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:17.800288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.800297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.800339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:17.800349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.800353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.800354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:17.800366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.800376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:17.800396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.800579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.800587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.800616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.800719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0
2025-10-02T09:30:17.801115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505577a5-3b19ad77-f5539ed-f1c2ade8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:17.803677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Write session: try to update token
2025-10-02T09:30:17.803693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:17.811365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:17.811383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:17.811385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:17.811387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:17.811395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.811400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.811403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554367701655081:5717]
2025-10-02T09:30:17.811436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:17.811441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.811444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:17.811447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:17.811453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:17.811456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:17.811564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:17.816680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:17.819202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:17.865787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554367777178604:6089]
2025-10-02T09:30:17.866099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7556554367777178604:6089]
2025-10-02T09:30:17.956351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:17.956368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:17.956422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: error at write: Disconnected sessionId: src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0
2025-10-02T09:30:17.956472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:17.956521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554367777178604:6089]
2025-10-02T09:30:17.956582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0 is DEAD
2025-10-02T09:30:17.956720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:17.956731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Write session will restart in 0.009709s
2025-10-02T09:30:17.956751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Write session: Do CDS request
2025-10-02T09:30:17.956757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:17.955843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:17.956103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.956112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.956146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178604:6089], now have 1 active actors on pipe
2025-10-02T09:30:17.956333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:17.967327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.967407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:17.967423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-10-02T09:30:17.967520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:17.967542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:17.967545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:17.967549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:17.968099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-10-02T09:30:17.968134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:17.968142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:17.968146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:17.968151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554367777178679:6628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:17.968609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554367777178679:6628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:17.972880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554367777178679:6628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:17.975483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554367777178679:6628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:17.975495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554367777178679:6628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:17.975497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554367777178679:6628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:17.975502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:17.975463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:17.978263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:17.978430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:17.978440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:17.978449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:17.978491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:17.978520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554367701655370:5726]
2025-10-02T09:30:17.979034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:17.979357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:17.979398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:17.979654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:17.979705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.979710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.979711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.979712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.979713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.979714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.979715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.979716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.979717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.979717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.979718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.979720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.979724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.979734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.979737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.979741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.979744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.979747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.979750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.979754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.979757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.979761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.979764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.979768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.979773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.979780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:17.979785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.979790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:17.979793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.979797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:17.979800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.979805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:17.979808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.979812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:17.979816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.979819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:17.979823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.979827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:17.979830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.979835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:17.979844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.979849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:17.979853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.979857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.979864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.979869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.979873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.979877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.979909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:17.988881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:17.990947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:17.990963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:17.990965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:17.990968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:17.990974Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [2:7556554367701655370:5726]
2025-10-02T09:30:17.990987Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:17.991009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:17.991011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.991013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.991015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.991029Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:17.991033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:17.991038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:17.991090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.991097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.991099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.991102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:17.991104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:17.991160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:17.991169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:17.991181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:17.991190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:17.991203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:17.991221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178609:2446], now have 1 active actors on pipe
2025-10-02T09:30:17.991224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554367777178870:6628], now have 1 active actors on pipe
2025-10-02T09:30:17.991229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:17.991232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:17.991234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:17.991245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:17.991257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:17.991258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:17.991262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:17.991264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:17.991270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:17.991272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:17.991301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:17.991315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:17.991310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 691
2025-10-02T09:30:17.991330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:17.991348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 691
2025-10-02T09:30:17.991434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.991442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.991461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:17.991470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:17.991474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:17.991479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:17.991487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:17.991496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:17.991512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.991660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:17.991674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:17.991695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:17.991822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0
2025-10-02T09:30:17.992151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e3c8e6-77c73f91-3a60e810-f006c154_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:17.994591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Write session: try to update token
2025-10-02T09:30:17.994604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:18.001566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:18.001584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.001592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:18.001628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:18.001656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:18.001785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:18.001924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.002062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.002192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.002374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:18.002409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:18.007171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:18.009558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:18.009772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.009792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.009826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:18.009905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:18.011166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:18.011180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.011182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:18.011184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:18.011192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:18.011196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:18.011200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554367701655364:5726]
2025-10-02T09:30:18.011232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:18.011240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.011242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:18.011244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:18.011250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:18.011254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:18.011385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:18.056759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554372072146201:6089]
2025-10-02T09:30:18.057046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7556554372072146201:6089]
2025-10-02T09:30:18.149850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:18.157286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.157307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.157441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.157499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.157559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.157620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.157665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.157674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.157733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.157782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.157840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.157906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.157948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.157957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.158018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.158073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.158130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.158186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.158232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.158238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.158299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.158357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.158414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.158472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.158515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.158521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.158584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.158641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.158702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.158762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.158805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.158811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.158873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.158932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.158988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.159056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.159097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.159103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.159160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.159218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.159278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.159337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.159382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.159385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.159448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.159499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.159558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.159619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.159660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.159666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.159727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.159781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.159833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.159889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.159959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.159967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.160021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.160071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.160122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.160178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.160216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.160221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.160255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146201:6089], now have 1 active actors on pipe
2025-10-02T09:30:18.160435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:18.160456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554372072146201:6089]
2025-10-02T09:30:18.160483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:18.160495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:18.160520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0
2025-10-02T09:30:18.160684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0 is DEAD
2025-10-02T09:30:18.160823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:18.160831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Write session will restart in 0.007480s
2025-10-02T09:30:18.160849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Write session: Do CDS request
2025-10-02T09:30:18.160855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:18.161305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:18.169231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.169338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:18.169355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-10-02T09:30:18.169912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.169952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:18.169961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:18.169965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:18.170428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-10-02T09:30:18.170466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:18.170476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:18.170477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:18.170482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554372072146247:6640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:18.170972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554372072146247:6640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:18.174253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554372072146247:6640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:18.178175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554372072146247:6640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:18.178192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554372072146247:6640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:18.178195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554372072146247:6640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:18.178208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:18.180653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:18.183335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:18.183518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:18.183543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:18.183554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:18.183609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:18.183647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554371996622962:5735]
2025-10-02T09:30:18.184208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:18.184481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:18.184515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:18.184751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:18.184792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.184797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.184797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.184798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.184811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.184812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.184812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.184813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.184814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.184814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.184815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.184815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.184819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.184826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.184829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.184831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.184833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.184836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.184838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.184840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.184842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.184844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.184846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.184848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.184853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.184858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.184861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.184864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.184866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.184869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.184871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.184875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.184877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.184880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.184882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.184885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.184888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.184891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.184893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.184896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.184899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.184902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.184905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.184908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.184910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.184913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.184915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.184918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.184936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:18.193590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:18.195193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:18.195207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:18.195209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:18.195212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:18.195216Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [2:7556554371996622962:5735]
2025-10-02T09:30:18.195228Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:18.195242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:18.195245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.195247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.195248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.195261Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:18.195266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:18.195272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:18.195318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.195326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.195327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.195330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:18.195331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:18.195378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:18.195383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.195391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.195396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.195405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:18.195418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.195426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.195428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.195436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:18.195446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:18.195447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:18.195449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:18.195451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:18.195459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:18.195462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:18.195471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146205:2446], now have 1 active actors on pipe
2025-10-02T09:30:18.195475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146449:6640], now have 1 active actors on pipe
2025-10-02T09:30:18.195503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.195516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:18.195534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:18.195531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 692
2025-10-02T09:30:18.195561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 692
2025-10-02T09:30:18.195579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.195587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.195606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:18.195615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.195618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.195620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:18.195629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.195644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:18.195655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.195760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.195767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.195778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.195862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0
2025-10-02T09:30:18.196202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c44e29e-fbba4363-2ea0aef3-2eac8dde_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:18.198657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Write session: try to update token
2025-10-02T09:30:18.198670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:18.205874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:18.205896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.205904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.205942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:18.205951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:18.206103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:18.206252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.206393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.206541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.206712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:18.206751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:18.212606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:18.215070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:18.215219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.215239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.216199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:18.216212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.216215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:18.216216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:18.216224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.216228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.216232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554371996622957:5735]
2025-10-02T09:30:18.216265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:18.216271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:18.216277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:18.216280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:18.216283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:18.216288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.216291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:18.216362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:18.216413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:18.260529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554372072146483:6089]
2025-10-02T09:30:18.260817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7556554372072146483:6089]
2025-10-02T09:30:18.360343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:18.368254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.368280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.368447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.368514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.368577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.368639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.368691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.368700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.368766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.368842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.368905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.368967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.369007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.369014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.369075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.369131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.369189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.369249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.369290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.369297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.369358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.369421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.369488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.369549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.369590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.369598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.369658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.369714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.369773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.369834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.369883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.369889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.369953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.370010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.370071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.370132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.370174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.370181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.370243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.370301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.370363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.370424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.370534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.370541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.370605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.370662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.370718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.370778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.370823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.370826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.370894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.370946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.371009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.371063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.371101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.371112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.371168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.371224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.371279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.371342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.371387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.371394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.371450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146483:6089], now have 1 active actors on pipe
2025-10-02T09:30:18.371675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:18.371731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:18.371735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:18.371763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0
2025-10-02T09:30:18.371889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554372072146483:6089]
2025-10-02T09:30:18.371943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0 is DEAD
2025-10-02T09:30:18.372406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:18.376996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:18.377008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Write session will restart in 0.005454s
2025-10-02T09:30:18.377030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Write session: Do CDS request
2025-10-02T09:30:18.377035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:18.383284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.383686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:18.383713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-10-02T09:30:18.383851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.383881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:18.383890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:18.383894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:18.384297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-10-02T09:30:18.384329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:18.384337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:18.384339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:18.384344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554372072146556:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:18.384856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554372072146556:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:18.387547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554372072146556:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:18.390205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554372072146556:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:18.390220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554372072146556:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:18.390223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554372072146556:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:18.390229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:18.391922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:18.394870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:18.395076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:18.395086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:18.395097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:18.395147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:18.395186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554371996623234:5737]
2025-10-02T09:30:18.395776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:18.396070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:18.396110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:18.396404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:18.396452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.396458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.396459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.396460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.396461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.396463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.396464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.396465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.396466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.396467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.396468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.396469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.396474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.396485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.396489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.396492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.396496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.396500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.396504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.396508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.396512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.396516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.396519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.396523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.396529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.396536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.396547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.396552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.396560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.396569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.396574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.396583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.396587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.396593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.396596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.396602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.396606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.396611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.396620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.396625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.396634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.396639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.396643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.396648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.396655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.396660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.396665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.396670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.396703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:18.405615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:18.407246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:18.407264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:18.407267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:18.407271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:18.407276Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [2:7556554371996623234:5737]
2025-10-02T09:30:18.407291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:18.407308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:18.407311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.407314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.407316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.407330Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:18.407336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:18.407343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:18.407397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.407406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.407408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.407411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:18.407414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:18.407478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:18.407486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.407499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.407510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.407525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:18.407547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146750:6644], now have 1 active actors on pipe
2025-10-02T09:30:18.407555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146486:2446], now have 1 active actors on pipe
2025-10-02T09:30:18.407561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.407563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.407564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.407577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:18.407592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:18.407600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:18.407603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:18.407606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:18.407608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:18.407611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:18.407642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.407655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:18.407619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 693
2025-10-02T09:30:18.407657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:18.407670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.407674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.407716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:18.407742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 693
2025-10-02T09:30:18.407726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.407730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.407732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:18.407740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.407749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:18.407763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.407937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.407944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.407957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.408037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 36 sessionId: src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0
2025-10-02T09:30:18.408364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad2e0cf5-aef5d8ac-e31edc41-331f7e53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:18.411035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Write session: try to update token
2025-10-02T09:30:18.411052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:18.418421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:18.418440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.418448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.418486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:18.418486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:18.418644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:18.418776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.418911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.419064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.419242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:18.419283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:18.424819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:18.427150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:18.428158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.428179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.428196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:18.428199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.428201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:18.428204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:18.428211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.428215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.428219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554371996623229:5737]
2025-10-02T09:30:18.428256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:18.428257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:18.428260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.428261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:18.428262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:18.428264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:18.428370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:18.472016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554372072146764:6089]
2025-10-02T09:30:18.472314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7556554372072146764:6089]
2025-10-02T09:30:18.563932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:18.564198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:18.564234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146764:6089], now have 1 active actors on pipe
2025-10-02T09:30:18.564360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:18.564365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:18.564419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554372072146764:6089]
2025-10-02T09:30:18.564451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:18.564460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:18.564538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: error at write: Disconnected sessionId: src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0
2025-10-02T09:30:18.564659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0 is DEAD
2025-10-02T09:30:18.564773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:18.564788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Write session will restart in 0.009518s
2025-10-02T09:30:18.564819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Write session: Do CDS request
2025-10-02T09:30:18.564828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:18.575307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.575362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:18.575378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-10-02T09:30:18.575533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.575568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:18.575576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:18.575580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:18.575930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-10-02T09:30:18.575962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:18.575968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:18.575970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:18.575976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554372072146831:6648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:18.576434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554372072146831:6648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:18.580302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554372072146831:6648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:18.583616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554372072146831:6648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:18.583632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554372072146831:6648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:18.583636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554372072146831:6648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:18.583644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:18.583882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:18.586771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:18.586948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:18.586957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:18.586967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:18.587024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:18.587061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554371996623518:5740]
2025-10-02T09:30:18.587598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:18.587958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:18.588022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:18.588349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:18.588410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.588416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.588418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.588418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.588420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.588421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.588422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.588423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.588424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.588425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.588426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.588427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.588432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.588442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.588446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.588449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.588453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.588458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.588461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.588464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.588469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.588472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.588475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.588479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.588486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.588493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.588498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.588503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.588507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.588511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.588516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.588520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.588524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.588528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.588534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.588538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.588542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.588547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.588551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.588555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.588558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.588562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.588566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.588571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.588575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.588581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.588584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.588589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.588622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:18.597479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:18.599080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:18.599094Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:18.599096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:18.599099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:18.599105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [2:7556554371996623518:5740]
2025-10-02T09:30:18.599115Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:18.599128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:18.599130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.599132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.599134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.599146Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:18.599149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:18.599155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:18.599198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.599203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.599205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.599207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:18.599209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:18.599256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:18.599261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.599268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.599274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.599283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:18.599299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.599304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.599305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.599311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:18.599321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:18.599322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:18.599326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:18.599329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:18.599330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:18.599332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:18.599338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072146767:2446], now have 1 active actors on pipe
2025-10-02T09:30:18.599341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072147037:6648], now have 1 active actors on pipe
2025-10-02T09:30:18.599370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.599381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:18.599400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:18.599423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 694
2025-10-02T09:30:18.599436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 694
2025-10-02T09:30:18.599529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.599539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.599564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67870a59-4fa57ba-86cabaad-6d68765a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:18.599572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.599581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.599582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:18.599592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.599601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:18.599617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.599812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.599829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.599855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.599965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 36 sessionId: src_id|67870a59-4fa57ba-86cabaad-6d68765a_0
2025-10-02T09:30:18.600370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d2b6ac-2b129565-58720d39-63a3cdb8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67870a59-4fa57ba-86cabaad-6d68765a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:18.602903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Write session: try to update token
2025-10-02T09:30:18.602920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:18.610199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:18.610222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.610231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.610272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:18.610279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:18.610497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:18.610666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.610823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.610977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:18.611196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:18.611251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:18.616002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|67870a59-4fa57ba-86cabaad-6d68765a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:18.618402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:18.618576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.618594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.618622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:18.618676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:18.619953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:18.619971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.619974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:18.619976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:18.619986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.619991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.619995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554371996623512:5740]
2025-10-02T09:30:18.620032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:18.620038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:18.620044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:18.620046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.620048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:18.620048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:18.620193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:18.664504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554372072147058:6089]
2025-10-02T09:30:18.664766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7556554372072147058:6089]
2025-10-02T09:30:18.775495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:18.785025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.785053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.785251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.785347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.785422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.785501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.785573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.785584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.785671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.785762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.785852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.785944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.785987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.786000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.786085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.786161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.786239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.786329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.786394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.786399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.786475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.786548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.786622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.786695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.786741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.786745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.786829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.786901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.786979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.787070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.787124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.787128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.787213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.787290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.787366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.787453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.787499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.787503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.787589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.787656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.787731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.787809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.787868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.787874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.787960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.788034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.788108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.788176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.788309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.788314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.788393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.788462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.788535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.788615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.788659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.788663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.788735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:18.789681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554372072147058:6089]
2025-10-02T09:30:18.789685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:18.789721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:18.789726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:18.789751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: error at write: Disconnected sessionId: src_id|67870a59-4fa57ba-86cabaad-6d68765a_0
2025-10-02T09:30:18.789923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|67870a59-4fa57ba-86cabaad-6d68765a_0 is DEAD
2025-10-02T09:30:18.790060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:18.790070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Write session will restart in 0.006534s
2025-10-02T09:30:18.790091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Write session: Do CDS request
2025-10-02T09:30:18.790097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:18.789036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:18.789120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:18.789198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:18.789351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:18.789356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:18.789426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072147058:6089], now have 1 active actors on pipe
2025-10-02T09:30:18.790585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:18.797314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.798427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:18.798444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-10-02T09:30:18.798576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:18.798606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:18.798611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:18.798614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:18.799130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-10-02T09:30:18.799188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:18.799201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:18.799203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:18.799211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554372072147089:6654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:18.799861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554372072147089:6654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:18.804830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554372072147089:6654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:18.809389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554372072147089:6654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:18.809407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554372072147089:6654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:18.809410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554372072147089:6654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:18.809419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:18.815076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:18.818235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:18.818435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:18.818446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:18.818466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:18.818524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:18.818563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554371996623792:5742]
2025-10-02T09:30:18.819130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:18.819463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:18.819512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:18.819832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:18.819892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.819907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.819908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.819909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.819910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.819911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.819912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.819913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.819914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.819915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.819916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.819917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.819922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.819933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.819937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.819942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.819945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.819948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.819952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.819955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.819959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.819962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.819966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.819969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.819976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.819983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:18.819991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.819996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:18.820000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.820005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:18.820014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.820020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:18.820025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.820031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:18.820035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.820040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:18.820045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.820050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:18.820059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.820064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:18.820069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.820073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:18.820082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.820087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.820093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.820102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.820107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.820112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.820147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:18.832773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 695
2025-10-02T09:30:18.832826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 695
2025-10-02T09:30:18.833675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0
2025-10-02T09:30:18.834018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67870a59-4fa57ba-86cabaad-6d68765a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:18.836589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Write session: try to update token
2025-10-02T09:30:18.836606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:18.830554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:18.832211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:18.832217Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:18.832220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:18.832224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:18.832231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [2:7556554371996623792:5742]
2025-10-02T09:30:18.832247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:18.832269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:18.832272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.832276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.832278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.832295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:18.832302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:18.832309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:18.832365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.832366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.832368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.832371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:18.832373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:18.832430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:18.832433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.832446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:18.832459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:18.832476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:18.832492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.832494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.832497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.832504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:18.832516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:18.832515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:18.832519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:18.832521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:18.832529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:18.832532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:18.832542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072147066:2446], now have 1 active actors on pipe
2025-10-02T09:30:18.832546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072147244:6654], now have 1 active actors on pipe
2025-10-02T09:30:18.832576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.832585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:18.832592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:18.832965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.832977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.833015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:18.833026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:18.833032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:18.833035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:18.833046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:18.833059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:18.833094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.833320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.833325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.833342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:18.846545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:18.846563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:18.846565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:18.846568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:18.846576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.846580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.846584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554371996623786:5742]
2025-10-02T09:30:18.846620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:18.846622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:18.846627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:18.846627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:18.846630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:18.846631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:18.846748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:18.850829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:18.853533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:18.891337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554372072147350:6089]
2025-10-02T09:30:18.891611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7556554372072147350:6089]
2025-10-02T09:30:18.993774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:18.994270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:18.994286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:18.994318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072147350:6089], now have 1 active actors on pipe
2025-10-02T09:30:18.994481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:18.994471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:18.994520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:18.994593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0
2025-10-02T09:30:18.994750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0 is DEAD
2025-10-02T09:30:18.994856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554372072147350:6089]
2025-10-02T09:30:18.995071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:18.995081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Write session will restart in 0.009537s
2025-10-02T09:30:18.995104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Write session: Do CDS request
2025-10-02T09:30:18.995109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:19.005325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.005448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:19.005467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-10-02T09:30:19.005719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.005752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:19.005756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:19.005762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:19.006262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-10-02T09:30:19.006296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:19.006303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:19.006305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:19.006310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554376367114664:6658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:19.006788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554376367114664:6658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:19.009069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554376367114664:6658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:19.013992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554376367114664:6658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:19.014011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554376367114664:6658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:19.014013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554376367114664:6658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:19.014020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:19.028369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:19.031749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:19.031927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:19.031936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:19.031945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:19.031995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:19.032031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554376291591393:5751]
2025-10-02T09:30:19.032610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:19.033352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:19.033407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:19.033754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:19.033810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.033815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.033816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.033817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.033818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.033819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.033820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.033821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.033822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.033823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.033824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.033825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.033831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.033841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.033846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.033850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.033854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.033858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.033862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.033866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.033870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.033875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.033879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.033883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.033889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.033897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.033906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.033912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.033918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.033923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.033927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.033936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.033940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.033945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.033953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.033958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.033965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.033970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.033978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.033984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.033990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.033995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.034003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.034007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.034014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.034021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.034028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.034033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.034064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:19.044301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:19.045866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:19.045883Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:19.045885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:19.045888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:19.045892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [2:7556554376291591393:5751]
2025-10-02T09:30:19.045904Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:19.045917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:19.045919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.045921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.045923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.045934Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:19.045939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:19.045946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:19.046011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.046018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.046020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.046023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:19.046025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:19.046082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:19.046087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.046096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.046102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.046111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:19.046124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.046125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.046127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.046132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:19.046141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:19.046149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:19.046151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:19.046152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:19.046154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:19.046156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:19.046178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.046180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:19.046183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:19.046186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367114712:6658], now have 1 active actors on pipe
2025-10-02T09:30:19.046189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554372072147354:2446], now have 1 active actors on pipe
2025-10-02T09:30:19.046426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 696
2025-10-02T09:30:19.046459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 696
2025-10-02T09:30:19.046663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.046671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.046690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:19.046694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.046698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.046700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:19.046710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.046719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:19.046731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.047006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.047015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.047037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.049184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0
2025-10-02T09:30:19.049567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e73552e-552152d1-16f5e2b9-dd0cf2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:19.052585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Write session: try to update token
2025-10-02T09:30:19.052600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:19.057719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:19.057734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.057742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.057775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:19.057810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:19.057926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:19.058048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.058167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.058290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.058457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:19.058484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:19.068378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:19.068399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.068401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:19.068403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:19.068411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.068415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.068418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554376291591378:5751]
2025-10-02T09:30:19.068450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:19.068456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.068458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:19.068574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:19.068580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:19.068583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:19.068591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:19.079568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:19.082000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:19.095482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554376367114950:6089]
2025-10-02T09:30:19.095959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7556554376367114950:6089]
2025-10-02T09:30:19.210118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:19.211081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.211097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.211114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367114950:6089], now have 1 active actors on pipe
2025-10-02T09:30:19.211299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:19.211370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:19.211390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:19.211450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0
2025-10-02T09:30:19.211634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0 is DEAD
2025-10-02T09:30:19.211663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554376367114950:6089]
2025-10-02T09:30:19.211678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:19.211774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:19.211782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Write session will restart in 0.005855s
2025-10-02T09:30:19.211806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Write session: Do CDS request
2025-10-02T09:30:19.211812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:19.219314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.219391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:19.219408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-10-02T09:30:19.219682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.219723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:19.219730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:19.219734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:19.220110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-10-02T09:30:19.220135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:19.220136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:19.220137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:19.220140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554376367114972:6670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:19.220554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554376367114972:6670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:19.222547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554376367114972:6670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:19.225398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554376367114972:6670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:19.225413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554376367114972:6670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:19.225416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554376367114972:6670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:19.225422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:19.230718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:19.233071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:19.233228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:19.233238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:19.233247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:19.233299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:19.233334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554376291591678:5760]
2025-10-02T09:30:19.233958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:19.234193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:19.234231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:19.234530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:19.234573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.234579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.234579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.234580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.234581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.234582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.234583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.234584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.234586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.234587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.234587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.234589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.234594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.234604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.234608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.234612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.234616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.234620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.234624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.234628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.234632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.234636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.234640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.234644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.234652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.234664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.234674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.234683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.234691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.234701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.234709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.234719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.234729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.234738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.234748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.234757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.234766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.234775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.234783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.234790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.234799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.234809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.234817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.234825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.234832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.234842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.234850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.234857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.234895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:19.242890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:19.244507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:19.244522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:19.244525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:19.244529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:19.244537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [2:7556554376291591678:5760]
2025-10-02T09:30:19.244548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:19.244563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:19.244565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.244568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.244570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.244588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:19.244598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:19.244604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:19.244656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.244663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.244665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.244668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:19.244670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:19.244727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:19.244734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.244745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.244761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.244781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:19.244821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115102:6670], now have 1 active actors on pipe
2025-10-02T09:30:19.244829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367114955:2446], now have 1 active actors on pipe
2025-10-02T09:30:19.244834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.244836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.244838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.244850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:19.244859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:19.244866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:19.244866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:19.244868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:19.244880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:19.244887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:19.244911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.244918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:19.244924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:19.244895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 697
2025-10-02T09:30:19.244939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.244900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 697
2025-10-02T09:30:19.244947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.245010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dc14135-78243873-2660bd49-fe708ac2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:19.245020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.245024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.245030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:19.245037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.245048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:19.245073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.245258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.245267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.245279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.245363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dc14135-78243873-2660bd49-fe708ac2_0
2025-10-02T09:30:19.245686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a0e060-13b29b5c-cd59aecd-eb7ff4b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dc14135-78243873-2660bd49-fe708ac2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:19.248122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Write session: try to update token
2025-10-02T09:30:19.248135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:19.255781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:19.255800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.255802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:19.255804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:19.255811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.255815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.255819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554376291591673:5760]
2025-10-02T09:30:19.255852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:19.255858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:19.255861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:19.255863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:19.255868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.255870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:19.255987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:19.260955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|8dc14135-78243873-2660bd49-fe708ac2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:19.263372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:19.311652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554376367115240:6089]
2025-10-02T09:30:19.311864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7556554376367115240:6089]
2025-10-02T09:30:19.387587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:19.387787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.387798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.387825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115240:6089], now have 1 active actors on pipe
2025-10-02T09:30:19.387995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:19.388027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:19.388040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:19.388043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:19.388085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554376367115240:6089]
2025-10-02T09:30:19.388107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: error at write: Disconnected sessionId: src_id|8dc14135-78243873-2660bd49-fe708ac2_0
2025-10-02T09:30:19.388249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|8dc14135-78243873-2660bd49-fe708ac2_0 is DEAD
2025-10-02T09:30:19.388409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:19.388420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Write session will restart in 0.007512s
2025-10-02T09:30:19.388444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Write session: Do CDS request
2025-10-02T09:30:19.388450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:19.397238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.397341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:19.397355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-10-02T09:30:19.397484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.397514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:19.397534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:19.397542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:19.398017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-10-02T09:30:19.398054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:19.398062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:19.398064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:19.398070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554376367115312:6674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:19.398481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554376367115312:6674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:19.401234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554376367115312:6674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:19.403873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554376367115312:6674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:19.403886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554376367115312:6674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:19.403889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554376367115312:6674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:19.403895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:19.405006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:19.407460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:19.407615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:19.407623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:19.407629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:19.407662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:19.407688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554376291591954:5762]
2025-10-02T09:30:19.408067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:19.408268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:19.408293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:19.408490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:19.408523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.408527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.408528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.408528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.408529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.408529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.408530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.408531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.408531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.408532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.408533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.408533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.408536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.408543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.408545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.408548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.408550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.408552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.408554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.408556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.408558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.408560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.408562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.408564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.408569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.408573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.408576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.408579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.408581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.408584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.408586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.408589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.408591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.408595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.408597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.408601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.408603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.408606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.408608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.408610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.408612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.408626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.408631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.408634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.408637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.408640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.408642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.408644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.408663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:19.416766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:19.418299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:19.418321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:19.418324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:19.418327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:19.418333Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [2:7556554376291591954:5762]
2025-10-02T09:30:19.418345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:19.418365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:19.418372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.418375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.418377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.418390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:19.418395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:19.418406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:19.418459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.418466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.418468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.418472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:19.418474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:19.418538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:19.418545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.418557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.418575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.418593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:19.418614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115243:2446], now have 1 active actors on pipe
2025-10-02T09:30:19.418622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115513:6674], now have 1 active actors on pipe
2025-10-02T09:30:19.418628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.418630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.418632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.418643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:19.418657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:19.418660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:19.418662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:19.418665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:19.418677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:19.418680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:19.418670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 698
2025-10-02T09:30:19.418704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.418676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 698
2025-10-02T09:30:19.418715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:19.418720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:19.418732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.418740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.418778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:19.418788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.418792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.418796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:19.418804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.418815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:19.418833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.418975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.418982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.419005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.419081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0
2025-10-02T09:30:19.419401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc14135-78243873-2660bd49-fe708ac2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:19.421778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Write session: try to update token
2025-10-02T09:30:19.421791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:19.428909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:19.428923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.428926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:19.428928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:19.428935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.428940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.428943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554376291591949:5762]
2025-10-02T09:30:19.428977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:19.428984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.428990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:19.428994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:19.429000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:19.429004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:19.429118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:19.434342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:19.436786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:19.488308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554376367115527:6089]
2025-10-02T09:30:19.488550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7556554376367115527:6089]
2025-10-02T09:30:19.571423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:19.572032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.572042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.572070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115527:6089], now have 1 active actors on pipe
2025-10-02T09:30:19.572282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:19.572304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:19.572346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:19.572459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0
2025-10-02T09:30:19.572558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554376367115527:6089]
2025-10-02T09:30:19.572681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0 is DEAD
2025-10-02T09:30:19.572819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:19.572830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Write session will restart in 0.007115s
2025-10-02T09:30:19.572853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Write session: Do CDS request
2025-10-02T09:30:19.572858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:19.581251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.581369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:19.581387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-10-02T09:30:19.581517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.581552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:19.581559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:19.581568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:19.581958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-10-02T09:30:19.581988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:19.581995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:19.581997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:19.582002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554376367115583:6678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:19.582564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554376367115583:6678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:19.585042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554376367115583:6678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:19.587814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554376367115583:6678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:19.587829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554376367115583:6678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:19.587832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554376367115583:6678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:19.587837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:19.590068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:19.592756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:19.592933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:19.592943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:19.592952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:19.593001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:19.593034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554376291592243:5765]
2025-10-02T09:30:19.593448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:19.593692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:19.593726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:19.593997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:19.594050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.594055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.594056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.594057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.594058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.594059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.594060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.594061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.594062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.594062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.594063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.594064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.594069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.594078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.594081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.594085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.594088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.594091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.594094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.594098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.594102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.594105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.594109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.594112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.594118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.594128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.594137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.594145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.594153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.594158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.594161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.594165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.594169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.594173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.594177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.594183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.594187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.594196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.594202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.594210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.594218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.594229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.594234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.594242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.594250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.594256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.594264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.594272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.594309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:19.602463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:19.604146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:19.604161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:19.604163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:19.604167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:19.604173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [2:7556554376291592243:5765]
2025-10-02T09:30:19.604187Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:19.604205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:19.604208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.604211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.604213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.604226Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:19.604235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:19.604240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:19.604294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.604300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.604302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.604305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:19.604307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:19.604366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:19.604375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.604387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.604397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.604411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:19.604433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115530:2446], now have 1 active actors on pipe
2025-10-02T09:30:19.604441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115779:6678], now have 1 active actors on pipe
2025-10-02T09:30:19.604446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.604449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.604450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.604461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:19.604472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:19.604476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:19.604479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:19.604481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:19.604484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:19.604487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:19.604516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.604526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:19.604519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 699
2025-10-02T09:30:19.604539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:19.604563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 699
2025-10-02T09:30:19.604584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.604592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.604615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:19.604621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.604625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.604627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:19.604635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.604643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:19.604656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.604842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.604856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.604878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.605036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 36 sessionId: src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0
2025-10-02T09:30:19.605362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b21d5fd-a30fba17-dba89d8c-da0633fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:19.608128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Write session: try to update token
2025-10-02T09:30:19.608147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:19.615101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:19.615120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.615129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.615168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:19.615179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:19.615338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:19.615484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.615625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.615760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.615947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:19.615976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:19.621679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:19.624018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:19.624849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.624870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.624884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:19.624886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.624887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:19.624889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:19.624894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.624897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.624899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554376291592238:5765]
2025-10-02T09:30:19.624930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:19.624936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.624938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:19.624947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:19.624961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:19.624965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:19.625045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:19.672611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554376367115826:6089]
2025-10-02T09:30:19.672894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7556554376367115826:6089]
2025-10-02T09:30:19.756269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:19.756926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:19.756960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115826:6089], now have 1 active actors on pipe
2025-10-02T09:30:19.757377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:19.757397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:19.757435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554376367115826:6089]
2025-10-02T09:30:19.757459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:19.757467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:19.757530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: error at write: Disconnected sessionId: src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0
2025-10-02T09:30:19.757667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0 is DEAD
2025-10-02T09:30:19.757792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:19.757800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Write session will restart in 0.007937s
2025-10-02T09:30:19.757815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Write session: Do CDS request
2025-10-02T09:30:19.757822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:19.767312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.767413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:19.767428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-10-02T09:30:19.767578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.767615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:19.767625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:19.767629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:19.768035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-10-02T09:30:19.768072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:19.768077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:19.768080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:19.768085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554376367115893:6684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:19.768558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554376367115893:6684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:19.771205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554376367115893:6684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:19.774361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554376367115893:6684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:19.774375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554376367115893:6684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:19.774378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554376367115893:6684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:19.774384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:19.776978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:19.779925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:19.780133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:19.780145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:19.780155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:19.780212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:19.780248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554376291592522:5767]
2025-10-02T09:30:19.780709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:19.781001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:19.781044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:19.781270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:19.781315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.781319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.781319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.781320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.781320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.781321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.781322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.781323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.781323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.781324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.781324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.781325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.781328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.781335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.781337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.781340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.781342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.781344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.781346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.781348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.781350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.781352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.781355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.781357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.781361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.781366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.781369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.781372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.781375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.781378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.781380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.781383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.781385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.781388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.781392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.781395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.781398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.781401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.781403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.781406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.781408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.781413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.781417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.781421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.781425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.781429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.781433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.781437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.781467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:19.789947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:19.791551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:19.791568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:19.791572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:19.791575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:19.791582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [2:7556554376291592522:5767]
2025-10-02T09:30:19.791597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:19.791615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:19.791624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.791627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.791629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.791644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:19.791654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:19.791669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:19.791729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.791735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.791737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.791741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:19.791744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:19.791809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:19.791816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.791830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.791847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.791866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:19.791884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367116071:6684], now have 1 active actors on pipe
2025-10-02T09:30:19.791893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367115836:2446], now have 1 active actors on pipe
2025-10-02T09:30:19.791899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.791902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.791904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.791914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:19.791926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:19.791933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:19.791940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:19.791942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:19.791943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:19.791944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:19.791973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.791984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:19.791989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:19.791992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 700
2025-10-02T09:30:19.792030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.792003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 700
2025-10-02T09:30:19.792042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.792066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:19.792071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:19.792079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:19.792081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:19.792089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:19.792101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:19.792121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.792274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.792282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.792294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:19.792403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0
2025-10-02T09:30:19.792707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17b702fb-2ed59f2e-d36f38bf-b0b951ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:19.795328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Write session: try to update token
2025-10-02T09:30:19.795345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:19.802527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:19.802541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.802546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.802577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:19.802591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:19.802729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:19.802847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.802975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.803122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:19.803296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:19.803328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:19.807940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:19.810354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:19.810540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.810561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.810593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:19.810675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:19.812211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:19.812226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:19.812229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:19.812231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:19.812239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.812243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.812247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554376291592517:5767]
2025-10-02T09:30:19.812279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:19.812288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.812291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:19.812292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:19.812298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:19.812301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:19.812426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:19.857487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554376367116129:6089]
2025-10-02T09:30:19.857757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7556554376367116129:6089]
2025-10-02T09:30:19.957981Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:19.967267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:19.967295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:19.967628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.967693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.967755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.968000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.968046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.968055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.968115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.968329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.968398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.968460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.968507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.968518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.968580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.968638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.968888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.968949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.968993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.969001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.969061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.969120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.969186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.969251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.969301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.969308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.969376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.969432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.969494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.969733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.969791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.969803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.970030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.970274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.970528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.970759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.970957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.970965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.971211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.971449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.971673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.971902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.972022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.972031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.972096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.972152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.972211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.972265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.972304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.972309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.972496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.972687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.972739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.972792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.972843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.972848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.972902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:19.972950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:19.973143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:19.973340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:19.973448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:19.973458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:19.973518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367116129:6089], now have 1 active actors on pipe
2025-10-02T09:30:19.973792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554376367116129:6089]
2025-10-02T09:30:19.973799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:19.973827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:19.973829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:19.973849Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:30:19.973852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0
2025-10-02T09:30:19.973929Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_9436659019505251152_v1 is DEAD
2025-10-02T09:30:19.973934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0 is DEAD
2025-10-02T09:30:19.974044Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554294762712768:6086] disconnected; active server actors: 1
2025-10-02T09:30:19.974052Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554294762712768:6086] client user disconnected session shared/user_1_7_9436659019505251152_v1
2025-10-02T09:30:19.974174Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:30:19.974176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:19.974189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Write session will restart in 0.006075s
2025-10-02T09:30:19.974215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Write session: Do CDS request
2025-10-02T09:30:19.974222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:19.974292Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:19.974297Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:19.974307Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006078s
2025-10-02T09:30:19.974695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:19.981246Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:30:19.981256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.981357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:19.981371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-10-02T09:30:19.981436Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:30:19.981444Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-10-02T09:30:19.981498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:19.981528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:19.981539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:19.981542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:19.981560Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:19.981604Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:19.981668Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 auth for : user
2025-10-02T09:30:19.981874Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 Handle describe topics response
2025-10-02T09:30:19.981894Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 auth is DEAD
2025-10-02T09:30:19.981915Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:30:19.982071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-10-02T09:30:19.982103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:19.982111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:19.982112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:19.982117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554376367116155:6688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:19.982173Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:30:19.982261Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_8_14043147616604604993_v1
2025-10-02T09:30:19.982358Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554376367116156:6689] connected; active server actors: 1
2025-10-02T09:30:19.982469Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554376367116156:6689] session shared/user_1_8_14043147616604604993_v1
2025-10-02T09:30:19.982480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:30:19.982489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:30:19.982496Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_14043147616604604993_v1" (Sender=[1:7556554376367116148:6689], Pipe=[1:7556554376367116156:6689], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:19.982500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:30:19.982508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:30:19.982515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_14043147616604604993_v1" (Sender=[1:7556554376367116148:6689], Pipe=[1:7556554376367116156:6689], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:19.982527Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_14043147616604604993_v1" sender [1:7556554376367116148:6689] lock partition 0 for ReadingSession "shared/user_1_8_14043147616604604993_v1" (Sender=[1:7556554376367116148:6689], Pipe=[1:7556554376367116156:6689], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-10-02T09:30:19.982532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:30:19.982536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000026s
2025-10-02T09:30:19.982596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554376367116155:6688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:19.982720Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_14043147616604604993_v1" ClientId: "user" PipeClient { RawX1: 7556554376367116156 RawX2: 4503603922344481 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:30:19.982741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:30:19.985735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554376367116155:6688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:19.988303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554376367116155:6688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:19.988314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554376367116155:6688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:19.988317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554376367116155:6688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:19.988336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:19.994218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:19.996688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:19.996868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:19.996877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:19.996886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:19.996933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:19.996975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554376291592805:5770]
2025-10-02T09:30:19.997453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:19.997685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:19.997723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:19.997995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:19.998044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.998049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.998050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.998051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.998053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.998053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.998054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.998055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.998056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.998058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.998059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.998060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.998064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.998075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.998079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.998083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.998086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.998090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.998094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.998098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.998101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.998105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.998109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.998112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.998120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.998127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:19.998132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.998138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:19.998142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.998147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:19.998151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.998156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:19.998160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.998167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:19.998172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.998181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:19.998185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.998189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:19.998192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.998202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:19.998206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.998211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:19.998218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.998223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:19.998227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.998236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:19.998240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.998245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:19.998281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:20.007084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:20.009005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:20.009021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:20.009024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:20.009028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:20.009034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [2:7556554376291592805:5770]
2025-10-02T09:30:20.009048Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:20.009065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:20.009068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.009070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.009072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.009087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:20.009092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:20.009098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:20.009147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.009154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.009157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.009160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:20.009163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:20.009225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:20.009233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.009245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.009256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.009274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:20.009297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367116290:6688], now have 1 active actors on pipe
2025-10-02T09:30:20.009304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367116167:6694], now have 1 active actors on pipe
2025-10-02T09:30:20.009308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554376367116135:2446], now have 1 active actors on pipe
2025-10-02T09:30:20.009312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.009315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.009317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.009328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:20.009344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:20.009343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:20.009346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:20.009348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:20.009359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:20.009362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:20.009393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.009410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:20.009392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 701
2025-10-02T09:30:20.009422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 701
2025-10-02T09:30:20.009447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:20.009467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7556554376367116167:6694]
2025-10-02T09:30:20.009511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.009529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.009553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.009569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.009577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_14043147616604604993_v1 on pipe: [1:7556554376367116167:6694]
2025-10-02T09:30:20.009609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|400b9eb9-93b338-da4d83e8-cd007819_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:20.009612Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_14043147616604604993_v1:1 with generation 701
2025-10-02T09:30:20.009622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.009633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.009635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.009644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.009654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:20.009670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.009678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.009680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.009695Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_14043147616604604993_v1
2025-10-02T09:30:20.009701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.009731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.009751Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:30:20.009869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.009877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.009890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.009955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 36 sessionId: src_id|400b9eb9-93b338-da4d83e8-cd007819_0
2025-10-02T09:30:20.010309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb00edc-b1e5f196-ade7870a-34d99a40_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|400b9eb9-93b338-da4d83e8-cd007819_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:20.014293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:30:20.014327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:30:20.014341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.014348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.014351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.014359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:30:20.014370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:30:20.014506Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397420009 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:30:20.014525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:30:20.014573Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 sending to client partition status
2025-10-02T09:30:20.016337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Write session: try to update token
2025-10-02T09:30:20.016352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:20.020197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:20.020221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.020229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.020267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:20.020271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:20.020434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:20.020568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.020708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.020876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.021066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:20.021115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:20.031621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:20.031643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.031647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:20.031649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:20.031658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.031662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.031666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554376291592800:5770]
2025-10-02T09:30:20.031702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:20.031709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.031711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:20.031715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:20.031720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:20.031723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:20.031944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:20.034795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|400b9eb9-93b338-da4d83e8-cd007819_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:20.037236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:20.168253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:20.168871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.168887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.169137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_14043147616604604993_v1
2025-10-02T09:30:20.169157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:20.169191Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_14043147616604604993_v1
2025-10-02T09:30:20.169219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554376367116167:6694]
2025-10-02T09:30:20.169259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:20.169329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: status is not ok: tablet will be restarted right now sessionId: src_id|400b9eb9-93b338-da4d83e8-cd007819_0
2025-10-02T09:30:20.169488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|400b9eb9-93b338-da4d83e8-cd007819_0 is DEAD
2025-10-02T09:30:20.169626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:20.169634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Write session will restart in 0.006565s
2025-10-02T09:30:20.169650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Write session: Do CDS request
2025-10-02T09:30:20.169657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:20.169788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:20.177208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.177289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:20.177300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-10-02T09:30:20.177401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.177425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:20.177433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:20.177437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:20.177864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-10-02T09:30:20.177897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:20.177903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:20.177905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:20.177909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554380662083797:6704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:20.178399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554380662083797:6704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:20.180344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554380662083797:6704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:20.182893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554380662083797:6704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:20.182905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554380662083797:6704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:20.182908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554380662083797:6704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:20.182914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:20.184967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:20.187106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:20.187240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:20.187247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:20.187256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:20.187297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:20.187329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554380586560421:5785]
2025-10-02T09:30:20.187742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:20.187948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:20.187981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:20.188169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:20.188202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.188208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.188208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.188209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.188210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.188212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.188212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.188213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.188214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.188215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.188217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.188218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.188222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.188229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.188231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.188234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.188236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.188238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.188240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.188242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.188244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.188246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.188248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.188250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.188254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.188258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.188261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.188264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.188266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.188269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.188272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.188274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.188276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.188281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.188284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.188286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.188289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.188291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.188294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.188296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.188298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.188300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.188303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.188305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.188307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.188310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.188312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.188314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.188332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:20.196119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:20.197852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:20.197866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:20.197869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:20.197872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:20.197876Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [2:7556554380586560421:5785]
2025-10-02T09:30:20.197885Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:20.197898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:20.197899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.197901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.197903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.197914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:20.197921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:20.197927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:20.197970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.197976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.197977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.197980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:20.197981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:20.198030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:20.198037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.198048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.198062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.198083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:20.198101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662083750:2446], now have 1 active actors on pipe
2025-10-02T09:30:20.198104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662083977:6704], now have 1 active actors on pipe
2025-10-02T09:30:20.198108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.198109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.198111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.198119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:20.198129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:20.198132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:20.198133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:20.198134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:20.198141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:20.198147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:20.198171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.198178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:20.198179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:20.198153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 702
2025-10-02T09:30:20.198169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 702
2025-10-02T09:30:20.198201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.198208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.198231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:20.198241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.198247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.198249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.198256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.198268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:20.198287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.198440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.198450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.198461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.198544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 36 sessionId: src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0
2025-10-02T09:30:20.198854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400b9eb9-93b338-da4d83e8-cd007819_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:20.201186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Write session: try to update token
2025-10-02T09:30:20.201201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:20.208284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:20.208300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.208301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:20.208303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:20.208308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.208310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.208313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554380586560416:5785]
2025-10-02T09:30:20.208342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:20.208345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.208347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:20.208354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:20.208358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:20.208361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:20.208480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:20.214755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:20.217038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:20.269653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554380662084035:6694]
2025-10-02T09:30:20.269924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7556554380662084035:6694]
2025-10-02T09:30:20.347737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:20.348073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.348087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.348105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084035:6694], now have 1 active actors on pipe
2025-10-02T09:30:20.348328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:20.348888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:20.348908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Write session will restart in 0.006187s
2025-10-02T09:30:20.348940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Write session: Do CDS request
2025-10-02T09:30:20.348948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:20.348353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:20.348405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:20.348408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:20.348472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: error at write: Disconnected sessionId: src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0
2025-10-02T09:30:20.348647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0 is DEAD
2025-10-02T09:30:20.348827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554380662084035:6694]
2025-10-02T09:30:20.356417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.356488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:20.356502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-10-02T09:30:20.356678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.356707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:20.356716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:20.356720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:20.357249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-10-02T09:30:20.357286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:20.357293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:20.357294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:20.357299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554380662084054:6708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:20.357832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554380662084054:6708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:20.360561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554380662084054:6708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:20.365820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554380662084054:6708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:20.365838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554380662084054:6708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:20.365841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554380662084054:6708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:20.365848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:20.371141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:20.374507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:20.374720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:20.374734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:20.374746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:20.374805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:20.374843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554380586560702:5787]
2025-10-02T09:30:20.375460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:20.375739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:20.375786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:20.376093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:20.376150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.376155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.376157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.376158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.376159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.376160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.376162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.376163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.376164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.376165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.376166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.376167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.376172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.376183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.376187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.376209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.376213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.376217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.376221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.376224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.376228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.376232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.376236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.376239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.376246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.376254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.376262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.376268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.376271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.376276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.376280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.376285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.376290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.376295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.376299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.376305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.376309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.376315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.376319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.376329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.376334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.376339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.376343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.376350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.376357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.376361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.376365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.376370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.376408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:20.385621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:20.387335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:20.387351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:20.387353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:20.387356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:20.387361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [2:7556554380586560702:5787]
2025-10-02T09:30:20.387372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:20.387390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:20.387393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.387397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.387398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.387410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:20.387413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:20.387418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:20.387460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.387466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.387467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.387470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:20.387471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:20.387523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:20.387530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.387538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.387544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.387553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:20.387566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.387568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.387570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.387576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:20.387586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:20.387592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:20.387595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:20.387595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:20.387597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:20.387599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:20.387605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084040:2446], now have 1 active actors on pipe
2025-10-02T09:30:20.387607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084228:6708], now have 1 active actors on pipe
2025-10-02T09:30:20.387632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.387641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:20.387662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:20.387716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 703
2025-10-02T09:30:20.387719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 703
2025-10-02T09:30:20.387791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.387798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.387814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6338bad2-68cebdce-58967694-380f7ab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:20.387822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.387825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.387827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.387833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.387840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:20.387853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.387997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.388002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.388011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.388101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 36 sessionId: src_id|6338bad2-68cebdce-58967694-380f7ab9_0
2025-10-02T09:30:20.388449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87932519-dbaadca-f9e6b36a-6d8b0cf1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6338bad2-68cebdce-58967694-380f7ab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:20.390961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Write session: try to update token
2025-10-02T09:30:20.390975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:20.404250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:20.404273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.404283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.404334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:20.404333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:20.404508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:20.404658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.404798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.404937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.405102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|6338bad2-68cebdce-58967694-380f7ab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:20.405132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:20.405176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:20.407660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:20.408242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.408259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.409449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:20.409478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:20.409480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.409482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:20.409483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:20.409488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.409491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.409493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554380586560697:5787]
2025-10-02T09:30:20.409515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:20.409514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:20.409518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:20.409521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.409523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:20.409523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:20.409567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:20.409664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:20.448313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554380662084328:6694]
2025-10-02T09:30:20.448560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7556554380662084328:6694]
2025-10-02T09:30:20.547999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:20.556429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.556461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.556637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.556701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.556763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.556849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.556900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.556911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.556980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.557041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.557109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.557173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.557223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.557230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.557294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.557353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.557415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.557479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.557523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.557529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.557599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.557667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.557739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.557804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.557850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.557858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.557926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.557992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.558057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.558125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.558187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.558195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.558260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.558327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.558386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.558459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.558520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.558528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.558599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.558663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.558729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.558793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.558845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.558853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.558924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.558989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.559073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.559186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.559236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.559243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.559310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.559369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.559434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.559500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.559552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.559559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.559648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.559734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.559839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.559905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.559961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.559971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.560032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084328:6694], now have 1 active actors on pipe
2025-10-02T09:30:20.561049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:20.561101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:20.561108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:20.561138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: error at write: Disconnected sessionId: src_id|6338bad2-68cebdce-58967694-380f7ab9_0
2025-10-02T09:30:20.561310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|6338bad2-68cebdce-58967694-380f7ab9_0 is DEAD
2025-10-02T09:30:20.561376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554380662084328:6694]
2025-10-02T09:30:20.561507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:20.561524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Write session will restart in 0.005888s
2025-10-02T09:30:20.561557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Write session: Do CDS request
2025-10-02T09:30:20.561565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:20.561585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:20.568486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.568482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:20.568503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-10-02T09:30:20.568744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.568780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:20.568791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:20.568795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:20.569239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-10-02T09:30:20.569278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:20.569284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:20.569286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:20.569295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554380662084347:6712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:20.569852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554380662084347:6712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:20.572995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554380662084347:6712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:20.577723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554380662084347:6712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:20.577739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554380662084347:6712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:20.577742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554380662084347:6712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:20.577750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:20.585074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:20.587874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:20.588077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:20.588089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:20.588099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:20.588155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:20.588207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554380586560997:5790]
2025-10-02T09:30:20.588781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:20.589121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:20.589173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:20.589511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:20.589577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.589584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.589585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.589586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.589587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.589588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.589590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.589591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.589592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.589593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.589594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.589595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.589601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.589612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.589616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.589620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.589625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.589629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.589633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.589637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.589641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.589646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.589650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.589653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.589660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.589668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.589675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.589686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.589691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.589702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.589706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.589717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.589721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.589732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.589736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.589749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.589754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.589760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.589764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.589770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.589775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.589780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.589784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.589790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.589795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.589800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.589805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.589810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.589847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:20.600859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:20.602490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:20.602508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:20.602511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:20.602514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:20.602521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [2:7556554380586560997:5790]
2025-10-02T09:30:20.602536Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:20.602555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:20.602564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.602567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.602569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.602585Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:20.602596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:20.602603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:20.602666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.602675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.602677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.602680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:20.602683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:20.602750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:20.602758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.602770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.602782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.602797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:20.602823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084331:2446], now have 1 active actors on pipe
2025-10-02T09:30:20.602835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.602837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.602839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.602850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:20.602863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084483:6712], now have 1 active actors on pipe
2025-10-02T09:30:20.602870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:20.602883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:20.602891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:20.602926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.602935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:20.602971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:20.602979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:20.602981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:20.602988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:20.603344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 704
2025-10-02T09:30:20.603379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 704
2025-10-02T09:30:20.603407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.603418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.603441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:20.603458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.603462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.603464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.603473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.603484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:20.603498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.603671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.603681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.603695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.604892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0
2025-10-02T09:30:20.605255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6338bad2-68cebdce-58967694-380f7ab9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:20.607910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Write session: try to update token
2025-10-02T09:30:20.607926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:20.623416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:20.623437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.623446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.623484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:20.623499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:20.623705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:20.623906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.624141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.624301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:20.624508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:20.624550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:20.623845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:20.626514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:20.626706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.626736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.626766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:20.626854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:20.633858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:20.633880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.633882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:20.633884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:20.633894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.633898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.633902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554380586560992:5790]
2025-10-02T09:30:20.633936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:20.633943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.633950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:20.634078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:20.634090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:20.634091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:20.634097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:20.661311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554380662084632:6694]
2025-10-02T09:30:20.661591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7556554380662084632:6694]
2025-10-02T09:30:20.775933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:20.783971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.783994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.784129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.784184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.784245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.784309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.784355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.784364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.784432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.784491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.784551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.784617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.784660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.784671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.784740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.784798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.784880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.784940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.784984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.784991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.785059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.785121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.785182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.785255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.785301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.785309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.785371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.785424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.785477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.785529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.785585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.785594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.785652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.785716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.785783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.785852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.785919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.785927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.785989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.786053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.786117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.786186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.786290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.786301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.786358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.786420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.786489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.786552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.786686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.786695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.786754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.786805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.786859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.786913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.787038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.787046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.787113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:20.787177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:20.787240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:20.787305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:20.787365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:20.787372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:20.787425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084632:6694], now have 1 active actors on pipe
2025-10-02T09:30:20.787669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:20.787702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554380662084632:6694]
2025-10-02T09:30:20.787725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:20.787728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:20.787754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0
2025-10-02T09:30:20.787944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0 is DEAD
2025-10-02T09:30:20.788078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:20.788088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Write session will restart in 0.008303s
2025-10-02T09:30:20.788108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Write session: Do CDS request
2025-10-02T09:30:20.788113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:20.788582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:20.797320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.797405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:20.797420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-10-02T09:30:20.797583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.797615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:20.797624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:20.797627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:20.798079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-10-02T09:30:20.798113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:20.798114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:20.798116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:20.798121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554380662084672:6718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:20.798611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554380662084672:6718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:20.800963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554380662084672:6718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:20.804153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554380662084672:6718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:20.804167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554380662084672:6718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:20.804171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554380662084672:6718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:20.804177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:20.808672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:20.811357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:20.811515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:20.811524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:20.811530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:20.811562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:20.811591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554380586561280:5792]
2025-10-02T09:30:20.812014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:20.812310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:20.812340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:20.812540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:20.812573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.812577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.812578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.812578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.812579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.812580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.812580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.812581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.812582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.812583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.812583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.812584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.812587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.812595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.812597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.812599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.812601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.812604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.812606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.812608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.812610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.812612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.812614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.812617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.812621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.812625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.812628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.812631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.812634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.812636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.812639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.812642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.812644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.812647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.812649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.812652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.812654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.812657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.812659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.812662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.812665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.812667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.812670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.812672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.812675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.812679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.812681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.812684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.812702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:20.821342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:20.823049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:20.823067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:20.823070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:20.823074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:20.823081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [2:7556554380586561280:5792]
2025-10-02T09:30:20.823097Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:20.823117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:20.823124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.823127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.823129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.823144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:20.823149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:20.823157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:20.823216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.823225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.823227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.823230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:20.823233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:20.823301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:20.823309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.823323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.823339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.823360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:20.823383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084642:2446], now have 1 active actors on pipe
2025-10-02T09:30:20.823391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084827:6718], now have 1 active actors on pipe
2025-10-02T09:30:20.823398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.823404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.823407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.823423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:20.823443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:20.823449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:20.823453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:20.823456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:20.823463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:20.823468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:20.823461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 705
2025-10-02T09:30:20.823500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.823509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:20.823513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:20.823506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 705
2025-10-02T09:30:20.823546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.823557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.823581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19bab97c-5ef857c1-8b734f08-587d21db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:20.823587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.823591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.823593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.823601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.823610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:20.823623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.823783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.823798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.823823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:20.823916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 36 sessionId: src_id|19bab97c-5ef857c1-8b734f08-587d21db_0
2025-10-02T09:30:20.824281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd322a7d-f0987c4f-650a97dd-e275a6c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19bab97c-5ef857c1-8b734f08-587d21db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:20.826845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Write session: try to update token
2025-10-02T09:30:20.826863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:20.835030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:20.835046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:20.835048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:20.835051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:20.835059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.835064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.835069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554380586561275:5792]
2025-10-02T09:30:20.835107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:20.835111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:20.835116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.835116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:20.835118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:20.835120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:20.835321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:20.841001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|19bab97c-5ef857c1-8b734f08-587d21db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:20.843673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:20.887630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554380662084936:6694]
2025-10-02T09:30:20.887903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7556554380662084936:6694]
2025-10-02T09:30:20.968105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:20.968915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.968930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.968947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084936:6694], now have 1 active actors on pipe
2025-10-02T09:30:20.969128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:20.969130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:20.969155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554380662084936:6694]
2025-10-02T09:30:20.969175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:20.969234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19bab97c-5ef857c1-8b734f08-587d21db_0
2025-10-02T09:30:20.969389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|19bab97c-5ef857c1-8b734f08-587d21db_0 is DEAD
2025-10-02T09:30:20.969517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:20.969525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Write session will restart in 0.005979s
2025-10-02T09:30:20.969551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Write session: Do CDS request
2025-10-02T09:30:20.969556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:20.976208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.976376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:20.976387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-10-02T09:30:20.976490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:20.976516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:20.976524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:20.976527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:20.976935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-10-02T09:30:20.976967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:20.976973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:20.976975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:20.976980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554380662084963:6722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:20.977459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554380662084963:6722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:20.979748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554380662084963:6722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:20.982202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554380662084963:6722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:20.982214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554380662084963:6722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:20.982218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554380662084963:6722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:20.982225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:20.985588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:20.988014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:20.988154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:20.988164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:20.988173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:20.988209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:20.988247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554380586561567:5795]
2025-10-02T09:30:20.988681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:20.988906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:20.988938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:20.989212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:20.989264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.989270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.989271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.989272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.989273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.989274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.989275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.989276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.989277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.989278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.989279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.989280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.989285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.989294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.989298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.989301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.989305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.989309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.989312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.989316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.989319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.989323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.989326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.989329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.989335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.989343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:20.989347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.989352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:20.989356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.989360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:20.989369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.989373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:20.989377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.989385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:20.989390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.989394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:20.989398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.989402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:20.989409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.989414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:20.989418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.989427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:20.989430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.989437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.989441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.989448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.989452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.989455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.989483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:20.997800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:20.999454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:20.999471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:20.999474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:20.999478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:20.999485Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [2:7556554380586561567:5795]
2025-10-02T09:30:20.999499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:20.999516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:20.999519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.999522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.999525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.999539Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:20.999549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:20.999555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:20.999616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.999623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.999626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.999629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:20.999631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:20.999695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:20.999702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:20.999714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:20.999729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:20.999749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:20.999770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662085137:6722], now have 1 active actors on pipe
2025-10-02T09:30:20.999778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554380662084940:2446], now have 1 active actors on pipe
2025-10-02T09:30:20.999784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:20.999786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:20.999787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:20.999801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:20.999818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:20.999832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:20.999834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:20.999839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:20.999849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:20.999851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:20.999819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 706
2025-10-02T09:30:20.999867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:20.999874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:20.999826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 706
2025-10-02T09:30:20.999876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:20.999902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:20.999910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:20.999939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:20.999950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:20.999954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:20.999955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:20.999966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:20.999974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:20.999988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.000144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.000157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.000179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.000272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 36 sessionId: src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0
2025-10-02T09:30:21.000621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bab97c-5ef857c1-8b734f08-587d21db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:21.003247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Write session: try to update token
2025-10-02T09:30:21.003264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:21.011681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:21.011698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.011700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:21.011702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:21.011711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:21.011714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:21.011717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554380586561561:5795]
2025-10-02T09:30:21.011750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:21.011755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.011759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:21.011762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:21.011767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:21.011771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:21.011895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:21.017204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:21.019635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:21.069345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554384957052525:6694]
2025-10-02T09:30:21.069647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7556554384957052525:6694]
2025-10-02T09:30:21.146904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:21.147365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.147376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.147402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957052525:6694], now have 1 active actors on pipe
2025-10-02T09:30:21.147536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:21.147613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:21.147649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:21.147709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0
2025-10-02T09:30:21.147858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554384957052525:6694]
2025-10-02T09:30:21.147869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0 is DEAD
2025-10-02T09:30:21.148038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:21.148046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Write session will restart in 0.009504s
2025-10-02T09:30:21.148060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Write session: Do CDS request
2025-10-02T09:30:21.148065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:21.158215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.158315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:21.158326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-10-02T09:30:21.158406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.158431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:21.158438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:21.158442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:21.158810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-10-02T09:30:21.158851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:21.158857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:21.158858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:21.158864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554384957052651:6734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:21.159319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554384957052651:6734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:21.161112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554384957052651:6734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:21.163977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554384957052651:6734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:21.163989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554384957052651:6734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:21.163991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554384957052651:6734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:21.163998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:21.166512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:21.166921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:21.167073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:21.167081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:21.167087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:21.167119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:21.167153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554384881529187:5809]
2025-10-02T09:30:21.167552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:21.167755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:21.167782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:21.167963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:21.167991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.167995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.167995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.167996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.167997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.167997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.167998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.167998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.167999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.167999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.168000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.168000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.168003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.168009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.168011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.168013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.168015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.168018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.168020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.168022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.168024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.168026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.168027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.168029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.168033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.168037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.168040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.168043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.168045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.168048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.168050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.168053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.168055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.168058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.168060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.168063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.168065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.168068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.168070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.168073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.168075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.168079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.168081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.168084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.168086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.168089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.168091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.168093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.168110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:21.175656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:21.177218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:21.177230Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:21.177243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:21.177246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:21.177250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [2:7556554384881529187:5809]
2025-10-02T09:30:21.177263Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:21.177276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:21.177279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.177283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.177284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.177294Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:21.177301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:21.177306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:21.177638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.177647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.177649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.177653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:21.177655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:21.177698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:21.177703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.177710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.177716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.177724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:21.177738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.177743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.177744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.177753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:21.177761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:21.177767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:21.177771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:21.177772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:21.177779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:21.177781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:21.177791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957052829:6734], now have 1 active actors on pipe
2025-10-02T09:30:21.177799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957052551:2446], now have 1 active actors on pipe
2025-10-02T09:30:21.177819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.177832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:21.177841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:21.177822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 707
2025-10-02T09:30:21.177825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 707
2025-10-02T09:30:21.177870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.177877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.177896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:21.177906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.177913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.177915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:21.177922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.177933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:21.177945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.178077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.178088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.178104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.178202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 36 sessionId: src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0
2025-10-02T09:30:21.178477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29dafcf6-46532fa0-51ec3928-fa057e7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:21.181001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Write session: try to update token
2025-10-02T09:30:21.181015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:21.188369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:21.188393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.188402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.188438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:21.188444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:21.188615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:21.188753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:21.188925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:21.189068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:21.189264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:21.189300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:21.193320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:21.195783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:21.195999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.196023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.196059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:21.196161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:21.197629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:21.197646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.197649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:21.197651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:21.197661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.197665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.197670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554384881529182:5809]
2025-10-02T09:30:21.197709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:21.197722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.197725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:21.197723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:21.197730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:21.197734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:21.197873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:21.248055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554384957052843:6694]
2025-10-02T09:30:21.248313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7556554384957052843:6694]
2025-10-02T09:30:21.327978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:21.335416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.335441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.335585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.335640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.335700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.335757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.335796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.335803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.335865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.335919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.335977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.336034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.336077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.336084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.336140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.336192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.336248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.336302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.336340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.336346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.336400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.336457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.336511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.336568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.336609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.336615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.336673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.336726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.336780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.336853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.336894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.336904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.336962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.337018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.337076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.337140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.337181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.337187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.337244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.337295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.337358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.337419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.337459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.337465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.337525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.337579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.337636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.337696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.337746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.337753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.337807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.337862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.337917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.338011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.338055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.338060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.338116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.338168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.338223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.338276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.338316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.338322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.338370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957052843:6694], now have 1 active actors on pipe
2025-10-02T09:30:21.338577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554384957052843:6694]
2025-10-02T09:30:21.338594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:21.338615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:21.338619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:21.338641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: error at write: Disconnected sessionId: src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0
2025-10-02T09:30:21.338825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0 is DEAD
2025-10-02T09:30:21.338926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:21.338935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Write session will restart in 0.008919s
2025-10-02T09:30:21.338950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Write session: Do CDS request
2025-10-02T09:30:21.338955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:21.339236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:21.349237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.349351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:21.349365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-10-02T09:30:21.349474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.349502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:21.349510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:21.349514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:21.349892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-10-02T09:30:21.349927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:21.349934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:21.349936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:21.349941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554384957052926:6738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:21.350462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554384957052926:6738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:21.352675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554384957052926:6738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:21.355441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554384957052926:6738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:21.355455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554384957052926:6738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:21.355459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554384957052926:6738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:21.355465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:21.357470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:21.360076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:21.360242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:21.360252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:21.360261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:21.360302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:21.360337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554384881529473:5812]
2025-10-02T09:30:21.360916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:21.361226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:21.361267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:21.361567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:21.361615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.361621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.361622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.361623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.361624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.361625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.361626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.361627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.361628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.361629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.361630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.361632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.361637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.361648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.361651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.361655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.361659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.361665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.361674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.361678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.361682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.361686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.361695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.361699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.361705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.361714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.361719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.361724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.361728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.361732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.361739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.361744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.361750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.361754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.361763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.361768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.361777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.361781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.361790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.361795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.361799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.361804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.361812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.361817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.361825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.361829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.361837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.361842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.361876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:21.370416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:21.372313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:21.372337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:21.372339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:21.372343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:21.372349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [2:7556554384881529473:5812]
2025-10-02T09:30:21.372364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:21.372383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:21.372386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.372389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.372391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.372406Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:21.372415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:21.372420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:21.372476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.372483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.372486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.372489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:21.372491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:21.372559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:21.372566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.372579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.372590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.372609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:21.372632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053111:6738], now have 1 active actors on pipe
2025-10-02T09:30:21.372640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957052846:2446], now have 1 active actors on pipe
2025-10-02T09:30:21.372646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.372648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.372650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.372723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 708
2025-10-02T09:30:21.372668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:21.372735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 708
2025-10-02T09:30:21.372687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:21.372693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:21.372697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:21.372699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:21.372701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:21.372704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:21.372739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.372742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:21.372762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:21.372776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.372780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.372823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:21.372834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.372838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.372840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:21.372848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.372860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:21.372872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.373050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.373058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.373069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.373125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 36 sessionId: src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0
2025-10-02T09:30:21.373436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671c5a32-69c18d5c-c6a44a29-b7c6a825_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:21.375787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Write session: try to update token
2025-10-02T09:30:21.375799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:21.383257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:21.383280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.383289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.383330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:21.383334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:21.383508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:21.383648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:21.383782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:21.383922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:21.384108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:21.384151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:21.388035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:21.390457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:21.390641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.390661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.390692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:21.390771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:21.393077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:21.393095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.393098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:21.393099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:21.393108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.393112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.393115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554384881529468:5812]
2025-10-02T09:30:21.393150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:21.393150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:21.393155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:21.393157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:21.393164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.393167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:21.393290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:21.438507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554384957053140:6694]
2025-10-02T09:30:21.438753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7556554384957053140:6694]
2025-10-02T09:30:21.539934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:21.548097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.548124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.548276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.548342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.548403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.548463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.548508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.548521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.548584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.548642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.548700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.548758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.548815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.548825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.548884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.548982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.549069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.549126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.549168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.549175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.549237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.549301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.549359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.549417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.549460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.549467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.549532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.549592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.549652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.549709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.549752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.549759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.549821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.549876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.549934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.549995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.550038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.550044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.550103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.550177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.550242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.550319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.550361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.550368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.550428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.550482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.550539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.550593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.550633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.550640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.550695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.550748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.550805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.550863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.550907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.550914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.550974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:21.551040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:21.551096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:21.551155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:21.551200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:21.551207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:21.551261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053140:6694], now have 1 active actors on pipe
2025-10-02T09:30:21.551473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554384957053140:6694]
2025-10-02T09:30:21.551497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:21.551699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:21.551709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:21.551735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: error at write: Disconnected sessionId: src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0
2025-10-02T09:30:21.552058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:21.552068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Write session will restart in 0.007098s
2025-10-02T09:30:21.552088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Write session: Do CDS request
2025-10-02T09:30:21.552095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:21.551917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0 is DEAD
2025-10-02T09:30:21.552232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:21.560260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.560350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:21.560361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-10-02T09:30:21.560446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.560468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:21.560471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:21.560474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:21.561005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-10-02T09:30:21.561028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:21.561257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:21.561262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:21.561267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554384957053191:6744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:21.561668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554384957053191:6744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:21.564601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554384957053191:6744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:21.567178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554384957053191:6744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:21.567198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554384957053191:6744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:21.567202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554384957053191:6744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:21.567208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:21.571957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:21.572305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:21.572441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:21.572450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:21.572458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:21.572494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:21.572526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554384881529772:5815]
2025-10-02T09:30:21.573144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:21.573383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:21.573419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:21.573724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:21.573765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.573771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.573773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.573774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.573775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.573776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.573777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.573778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.573780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.573781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.573782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.573783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.573788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.573799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.573803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.573807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.573811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.573815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.573818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.573822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.573826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.573830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.573834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.573838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.573844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.573851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.573856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.573861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.573865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.573870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.573874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.573879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.573883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.573889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.573893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.573902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.573906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.573912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.573916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.573923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.573927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.573932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.573936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.573942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.573947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.573956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.573960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.573966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.574001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:21.582168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:21.583734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:21.583749Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:21.583752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:21.583756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:21.583761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [2:7556554384881529772:5815]
2025-10-02T09:30:21.583773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:21.583786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:21.583794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.583797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.583799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.583813Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:21.583822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:21.583828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:21.583876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.583883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.583885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.583888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:21.583891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:21.583953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:21.583964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.583976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.583986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.584002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:21.584024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053382:6744], now have 1 active actors on pipe
2025-10-02T09:30:21.584035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053146:2446], now have 1 active actors on pipe
2025-10-02T09:30:21.584042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.584045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.584047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.584056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:21.584067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:21.584070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:21.584072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:21.584074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:21.584081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:21.584056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 709
2025-10-02T09:30:21.584084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:21.584067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 709
2025-10-02T09:30:21.584117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.584125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.584135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.584149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:21.584153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:21.584172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:21.584182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.584186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.584188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:21.584196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.584203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:21.584219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.584368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.584378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.584390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.584464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 36 sessionId: src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0
2025-10-02T09:30:21.584749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|552e187d-89c2a095-36ac4a93-eced0ab7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:21.587379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Write session: try to update token
2025-10-02T09:30:21.587394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:21.594380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:21.594402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.594404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:21.594406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:21.594413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.594417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.594420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554384881529767:5815]
2025-10-02T09:30:21.594456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:21.594462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.594464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:21.594464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:21.594470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:21.594472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:21.594597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:21.600007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:21.602156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:21.651507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554384957053452:6694]
2025-10-02T09:30:21.651790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7556554384957053452:6694]
2025-10-02T09:30:21.729819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:21.730266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.730276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.730302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053452:6694], now have 1 active actors on pipe
2025-10-02T09:30:21.730445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:21.730506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:21.730514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:21.730556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554384957053452:6694]
2025-10-02T09:30:21.730584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0
2025-10-02T09:30:21.730764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0 is DEAD
2025-10-02T09:30:21.730909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:21.730920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Write session will restart in 0.006985s
2025-10-02T09:30:21.730943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Write session: Do CDS request
2025-10-02T09:30:21.730949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:21.739231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.739328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:21.739341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-10-02T09:30:21.739461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.739494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:21.739511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:21.739519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:21.739934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-10-02T09:30:21.739964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:21.739965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:21.739967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:21.739971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554384957053502:6749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:21.740463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554384957053502:6749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:21.743172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554384957053502:6749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:21.749334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554384957053502:6749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:21.749345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554384957053502:6749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:21.749349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554384957053502:6749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:21.749355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:21.750537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:21.753038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:21.753171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:21.753178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:21.753184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:21.753220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:21.753255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554384881530061:5817]
2025-10-02T09:30:21.753636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:21.753860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:21.753884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:21.754075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:21.754106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.754111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.754111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.754112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.754113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.754113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.754114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.754115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.754115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.754116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.754116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.754117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.754120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.754127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.754129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.754132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.754134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.754136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.754138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.754140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.754142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.754145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.754147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.754149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.754153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.754158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.754161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.754164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.754166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.754169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.754172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.754175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.754179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.754181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.754184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.754186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.754189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.754192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.754194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.754197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.754200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.754203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.754205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.754207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.754210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.754213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.754215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.754218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.754237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:21.762373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:21.764119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:21.764135Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:21.764137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:21.764140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:21.764146Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [2:7556554384881530061:5817]
2025-10-02T09:30:21.764157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:21.764172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:21.764177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.764179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.764182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.764196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:21.764200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:21.764208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:21.764260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.764267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.764270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.764274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:21.764277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:21.764332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:21.764340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.764351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.764363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.764383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:21.764403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053455:2446], now have 1 active actors on pipe
2025-10-02T09:30:21.764410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053735:6749], now have 1 active actors on pipe
2025-10-02T09:30:21.764416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.764418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.764421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.764430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:21.764438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:21.764447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:21.764447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:21.764449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:21.764450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:21.764452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:21.764471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.764476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:21.764479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:21.764454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 710
2025-10-02T09:30:21.764457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 710
2025-10-02T09:30:21.764498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.764505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.764533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:21.764542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.764545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.764547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:21.764556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.764563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:21.764584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.764720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.764726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.764738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.764899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 36 sessionId: src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0
2025-10-02T09:30:21.765204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2843783-9516bc85-a6d79e4c-86fe1153_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:21.767514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Write session: try to update token
2025-10-02T09:30:21.767525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:21.774238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:21.774253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.774254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:21.774255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:21.774261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.774264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.774267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554384881530056:5817]
2025-10-02T09:30:21.774292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:21.774296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.774298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:21.774305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:21.774309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:21.774315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:21.774418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:21.778850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:21.780890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:21.830752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554384957053760:6694]
2025-10-02T09:30:21.831091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7556554384957053760:6694]
2025-10-02T09:30:21.911568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:21.912225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.912240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.912278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053760:6694], now have 1 active actors on pipe
2025-10-02T09:30:21.912413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:21.912487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554384957053760:6694]
2025-10-02T09:30:21.912495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:21.912519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:21.912587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: status is not ok: tablet will be restarted right now sessionId: src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0
2025-10-02T09:30:21.912749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0 is DEAD
2025-10-02T09:30:21.912937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:21.912949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Write session will restart in 0.006981s
2025-10-02T09:30:21.912972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Write session: Do CDS request
2025-10-02T09:30:21.912979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:21.921257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.921358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:21.921371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-10-02T09:30:21.921467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:21.921493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:21.921503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:21.921507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:21.921902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-10-02T09:30:21.921932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:21.921938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:21.921939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:21.921943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554384957053809:6754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:21.922387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554384957053809:6754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:21.924606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554384957053809:6754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:21.927601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554384957053809:6754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:21.927611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554384957053809:6754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:21.927613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554384957053809:6754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:21.927620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:21.931448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:21.934047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:21.934187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:21.934196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:21.934204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:21.934245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:21.934278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554384881530352:5820]
2025-10-02T09:30:21.934873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:21.935128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:21.935171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:21.935518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:21.935611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.935620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.935621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.935622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.935623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.935624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.935625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.935627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.935628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.935628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.935629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.935630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.935636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.935646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.935650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.935653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.935656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.935660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.935663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.935666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.935675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.935684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.935692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.935699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.935707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.935720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:21.935730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.935741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:21.935750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.935759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:21.935776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.935786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:21.935796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.935804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:21.935814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.935818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:21.935823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.935833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:21.935837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.935846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:21.935850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.935859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:21.935866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.935870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.935875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.935880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.935888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.935893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.935931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:21.943669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:21.945242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:21.945256Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:21.945258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:21.945262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:21.945268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [2:7556554384881530352:5820]
2025-10-02T09:30:21.945282Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:21.945297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:21.945299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.945302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.945304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.945317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:21.945322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:21.945328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:21.945375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.945377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.945379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.945383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:21.945385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:21.945449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:21.945451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.945463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:21.945475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:21.945491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:21.945508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053972:6754], now have 1 active actors on pipe
2025-10-02T09:30:21.945518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554384957053763:2446], now have 1 active actors on pipe
2025-10-02T09:30:21.945523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.945525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.945528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.945539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:21.945554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:21.945555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:21.945558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:21.945560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:21.945541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 711
2025-10-02T09:30:21.945572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:21.945578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:21.945560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 711
2025-10-02T09:30:21.945613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.945621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.945631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.945641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:21.945658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:21.945673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8188df48-7388d898-a9158847-d2dbac96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:21.945683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:21.945690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:21.945696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:21.945704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:21.945715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:21.946076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.946263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:21.946271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:21.946285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:21.946371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 36 sessionId: src_id|8188df48-7388d898-a9158847-d2dbac96_0
2025-10-02T09:30:21.946659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f8dc38-7d17b64a-c5ef9f4c-1bb88bf1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8188df48-7388d898-a9158847-d2dbac96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:21.948995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Write session: try to update token
2025-10-02T09:30:21.949007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:21.955630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:21.955656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:21.955658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:21.955660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:21.955668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.955672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.955677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554384881530347:5820]
2025-10-02T09:30:21.955714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:21.955719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:21.955722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:21.955721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:21.955727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:21.955730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:21.955851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:21.961695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|8188df48-7388d898-a9158847-d2dbac96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:21.964110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:22.012453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554389252021356:6694]
2025-10-02T09:30:22.012666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7556554389252021356:6694]
2025-10-02T09:30:22.091064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:22.091358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.091369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.091653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554389252021356:6694]
2025-10-02T09:30:22.091658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:22.091690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:22.091762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8188df48-7388d898-a9158847-d2dbac96_0
2025-10-02T09:30:22.091385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021356:6694], now have 1 active actors on pipe
2025-10-02T09:30:22.091939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|8188df48-7388d898-a9158847-d2dbac96_0 is DEAD
2025-10-02T09:30:22.091568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:22.092125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:22.092132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Write session will restart in 0.006074s
2025-10-02T09:30:22.092156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Write session: Do CDS request
2025-10-02T09:30:22.092162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:22.099335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.099407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:22.099427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-10-02T09:30:22.099551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.099581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:22.099591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:22.099595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:22.100023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-10-02T09:30:22.100059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:22.100061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:22.100063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:22.100068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554389252021372:6758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:22.100522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554389252021372:6758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:22.103466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554389252021372:6758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:22.107319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554389252021372:6758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:22.107336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554389252021372:6758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:22.107340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554389252021372:6758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:22.107347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:22.112899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:22.115761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:22.115961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:22.115972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:22.115983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:22.116030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:22.116085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554389176497940:5822]
2025-10-02T09:30:22.116688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:22.117007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:22.117053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:22.117379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:22.117429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.117437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.117439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.117440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.117443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.117444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.117445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.117446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.117447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.117449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.117450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.117451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.117456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.117466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.117471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.117476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.117480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.117485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.117489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.117492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.117497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.117501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.117504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.117510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.117516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.117523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.117529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.117534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.117538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.117543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.117547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.117552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.117557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.117562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.117567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.117573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.117577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.117583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.117590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.117595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.117599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.117605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.117611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.117616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.117619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.117624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.117628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.117633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.117668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:22.126447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:22.128276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:22.128296Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:22.128299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:22.128303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:22.128309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [2:7556554389176497940:5822]
2025-10-02T09:30:22.128323Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:22.128339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:22.128343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.128346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.128348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.128361Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:22.128365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:22.128371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:22.128437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.128443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.128445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.128448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:22.128450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:22.128510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:22.128517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.128531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.128547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.128569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:22.128594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021519:6758], now have 1 active actors on pipe
2025-10-02T09:30:22.128602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021358:2446], now have 1 active actors on pipe
2025-10-02T09:30:22.128607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.128609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.128611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.128624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:22.128640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:22.128652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:22.128657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:22.128662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:22.128662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:22.128664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:22.128655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 712
2025-10-02T09:30:22.128693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.128701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:22.128702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:22.128715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.128723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.128727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 712
2025-10-02T09:30:22.128760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da032a02-12c61947-e1602bf1-86702b38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:22.128770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.128774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.128775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:22.128783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.128791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:22.128833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.128993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.129000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.129011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.129111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 36 sessionId: src_id|da032a02-12c61947-e1602bf1-86702b38_0
2025-10-02T09:30:22.129455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8188df48-7388d898-a9158847-d2dbac96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da032a02-12c61947-e1602bf1-86702b38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:22.132026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Write session: try to update token
2025-10-02T09:30:22.132041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:22.140514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:22.140536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:22.140539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:22.140541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:22.140549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.140554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.140560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554389176497933:5822]
2025-10-02T09:30:22.140596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:22.140602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.140603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:22.140604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:22.140609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:22.140614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:22.140740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:22.145046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|da032a02-12c61947-e1602bf1-86702b38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:22.147454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:22.191660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554389252021680:6694]
2025-10-02T09:30:22.191865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7556554389252021680:6694]
2025-10-02T09:30:22.291002Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:22.291364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.291378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.291416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021680:6694], now have 1 active actors on pipe
2025-10-02T09:30:22.291640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:22.292055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:22.292064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Write session will restart in 0.008859s
2025-10-02T09:30:22.292079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Write session: Do CDS request
2025-10-02T09:30:22.292084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:22.291681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:22.291695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:22.291701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:22.291747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554389252021680:6694]
2025-10-02T09:30:22.291748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|da032a02-12c61947-e1602bf1-86702b38_0
2025-10-02T09:30:22.291910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|da032a02-12c61947-e1602bf1-86702b38_0 is DEAD
2025-10-02T09:30:22.302287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.302371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:22.302386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-10-02T09:30:22.302523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.302551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:22.302559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:22.302563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:22.303142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-10-02T09:30:22.303178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:22.303179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:22.303181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:22.303186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554389252021730:6770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:22.303681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554389252021730:6770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:22.307254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554389252021730:6770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:22.310807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554389252021730:6770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:22.310820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554389252021730:6770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:22.310825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554389252021730:6770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:22.310840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:22.313222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:22.316156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:22.316338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:22.316348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:22.316358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:22.316402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:22.316443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554389176498266:5837]
2025-10-02T09:30:22.317203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:22.317537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:22.317607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:22.317952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:22.318027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.318037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.318038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.318039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.318040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.318042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.318043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.318044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.318045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.318046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.318048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.318049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.318054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.318065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.318069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.318073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.318077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.318080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.318084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.318087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.318091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.318094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.318098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.318101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.318108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.318116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.318122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.318128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.318133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.318137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.318142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.318148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.318154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.318170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.318181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.318192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.318204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.318213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.318218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.318223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.318228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.318234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.318239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.318244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.318249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.318254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.318258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.318263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.318301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:22.326674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:22.328283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:22.328304Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:22.328306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:22.328310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:22.328316Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [2:7556554389176498266:5837]
2025-10-02T09:30:22.328329Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:22.328345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:22.328348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.328351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.328353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.328367Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:22.328371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:22.328378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:22.328441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.328450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.328452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.328456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:22.328458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:22.328680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 713
2025-10-02T09:30:22.328681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 713
2025-10-02T09:30:22.329050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:22.329061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.329074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.329086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.329104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:22.329129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021949:6770], now have 1 active actors on pipe
2025-10-02T09:30:22.329132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021682:2446], now have 1 active actors on pipe
2025-10-02T09:30:22.329145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.329154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.329171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.329181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.329184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.329199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:22.329219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:22.329233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:22.329236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:22.329250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:22.329261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.329264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.329266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:22.329274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.329283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:22.329294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:22.329306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:22.329308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:22.329323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.329332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:22.329335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:22.329343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.329528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.329543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.329564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.329653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 36 sessionId: src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0
2025-10-02T09:30:22.329987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da032a02-12c61947-e1602bf1-86702b38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:22.332488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Write session: try to update token
2025-10-02T09:30:22.332503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:22.345872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:22.346893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:22.346916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:22.346924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.346966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:22.346968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:22.347151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:22.347294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:22.347437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:22.347583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:22.347772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:22.347816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:22.348274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:22.348463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.348477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.348502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:22.348584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:22.349514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:22.349541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:22.349544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:22.349547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:22.349556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.349559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.349564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554389176498261:5837]
2025-10-02T09:30:22.349599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:22.349610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:22.349614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.349616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:22.349618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:22.349620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:22.349833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:22.391872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554389252021981:6694]
2025-10-02T09:30:22.392164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7556554389252021981:6694]
2025-10-02T09:30:22.488603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:22.496594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.496623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.496797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.496879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.496947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.497010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.497055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.497064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.497128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.497189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.497248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.497314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.497357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.497364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.497425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.497482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.497558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.497617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.497657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.497663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.497728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.497787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.497847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.497903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.497946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.497953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.498014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.498073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.498131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.498191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.498238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.498246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.498315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.498374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.498437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.498507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.498556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.498563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.498625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.498684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.498748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.498814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.498858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.498866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.498930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.498986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.499054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.499111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.499154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.499161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.499218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.499272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.499329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.499386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.499426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.499433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.499495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:22.499550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:22.499607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:22.499666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:22.499711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:22.499719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:22.499772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021981:6694], now have 1 active actors on pipe
2025-10-02T09:30:22.500061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:22.500076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:22.500077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554389252021981:6694]
2025-10-02T09:30:22.500094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:22.500109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0
2025-10-02T09:30:22.500274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0 is DEAD
2025-10-02T09:30:22.500405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:22.500413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Write session will restart in 0.007800s
2025-10-02T09:30:22.500428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Write session: Do CDS request
2025-10-02T09:30:22.500432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:22.500830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:22.509251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.509341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:22.509358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-10-02T09:30:22.509507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.509537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:22.509545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:22.509550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:22.509952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-10-02T09:30:22.509981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:22.509987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:22.509989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:22.509994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554389252022045:6774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:22.510495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554389252022045:6774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:22.513382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554389252022045:6774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:22.516367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554389252022045:6774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:22.516378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554389252022045:6774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:22.516381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554389252022045:6774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:22.516388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:22.517568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:22.520201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:22.520351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:22.520360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:22.520369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:22.520412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:22.520447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554389176498557:5839]
2025-10-02T09:30:22.521021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:22.521285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:22.521321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:22.521608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:22.521656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.521662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.521663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.521663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.521665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.521666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.521667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.521668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.521669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.521670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.521671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.521672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.521676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.521686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.521689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.521693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.521697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.521700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.521704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.521707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.521710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.521714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.521717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.521721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.521727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.521734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.521739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.521744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.521752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.521757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.521761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.521765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.521769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.521774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.521781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.521785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.521793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.521798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.521806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.521811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.521819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.521826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.521834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.521838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.521847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.521852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.521859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.521864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.521899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:22.530213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:22.531749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:22.531768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:22.531771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:22.531775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:22.531781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [2:7556554389176498557:5839]
2025-10-02T09:30:22.531795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:22.531812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:22.531815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.531818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.531819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.531834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:22.531844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:22.531853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:22.531910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.531917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.531919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.531922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:22.531925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:22.531989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:22.532002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.532014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.532024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.532045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:22.532067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022269:6774], now have 1 active actors on pipe
2025-10-02T09:30:22.532075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252021983:2446], now have 1 active actors on pipe
2025-10-02T09:30:22.532080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.532083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.532085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.532094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:22.532106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:22.532106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:22.532109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:22.532111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:22.532123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:22.532126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:22.532115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 714
2025-10-02T09:30:22.532115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 714
2025-10-02T09:30:22.532153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.532160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:22.532163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:22.532177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.532180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.532218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:22.532227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.532231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.532233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:22.532241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.532249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:22.532270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.532425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.532434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.532448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.532527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 36 sessionId: src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0
2025-10-02T09:30:22.532876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f1eedb-10a5e122-65911d97-79564f8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:22.535829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Write session: try to update token
2025-10-02T09:30:22.535847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:22.542570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:22.542591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:22.542593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:22.542595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:22.542602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.542607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.542610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554389176498552:5839]
2025-10-02T09:30:22.542632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:22.542636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:22.542638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:22.542640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:22.542646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.542648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:22.542774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:22.549327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:22.551704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:22.600225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554389252022295:6694]
2025-10-02T09:30:22.600429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7556554389252022295:6694]
2025-10-02T09:30:22.680107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:22.680331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.680341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.680353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022295:6694], now have 1 active actors on pipe
2025-10-02T09:30:22.680554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:22.680581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554389252022295:6694]
2025-10-02T09:30:22.680587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:22.680589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:22.680596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:22.680634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: error at write: Disconnected sessionId: src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0
2025-10-02T09:30:22.680767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0 is DEAD
2025-10-02T09:30:22.680926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:22.680937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Write session will restart in 0.007612s
2025-10-02T09:30:22.680958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Write session: Do CDS request
2025-10-02T09:30:22.680964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:22.689127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.689232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:22.689242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-10-02T09:30:22.689375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.689408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:22.689416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:22.689419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:22.690071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-10-02T09:30:22.690104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:22.690109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:22.690110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:22.690115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554389252022345:6779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:22.690559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554389252022345:6779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:22.693239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554389252022345:6779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:22.695748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554389252022345:6779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:22.695759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554389252022345:6779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:22.695764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554389252022345:6779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:22.695769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:22.698526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:22.700938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:22.701094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:22.701100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:22.701107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:22.701144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:22.701170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554389176498861:5842]
2025-10-02T09:30:22.701695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:22.702042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:22.702082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:22.702348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:22.702400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.702406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.702407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.702408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.702409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.702410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.702410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.702411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.702412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.702413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.702414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.702415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.702419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.702428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.702432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.702435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.702439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.702442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.702445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.702449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.702452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.702456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.702459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.702462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.702467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.702475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.702481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.702485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.702488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.702492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.702495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.702500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.702503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.702507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.702511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.702515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.702519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.702523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.702525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.702530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.702536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.702540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.702544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.702554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.702557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.702562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.702566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.702570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.702600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:22.710554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:22.712013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:22.712028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:22.712030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:22.712033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:22.712039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [2:7556554389176498861:5842]
2025-10-02T09:30:22.712051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:22.712068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:22.712077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.712079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.712081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.712096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:22.712101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:22.712106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:22.712154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.712161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.712162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.712165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:22.712166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:22.712208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:22.712213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.712220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.712226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.712234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:22.712246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.712251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.712252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.712260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:22.712268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022298:2446], now have 1 active actors on pipe
2025-10-02T09:30:22.712270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:22.712272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:22.712275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:22.712275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022531:6779], now have 1 active actors on pipe
2025-10-02T09:30:22.712279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:22.712286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:22.712288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:22.712309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.712323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:22.712351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:22.712349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 715
2025-10-02T09:30:22.712366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 715
2025-10-02T09:30:22.712412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.712419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.712434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:22.712441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.712445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.712447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:22.712454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.712461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:22.712476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.712616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.712623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.712631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.712697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0
2025-10-02T09:30:22.713045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c169dc1a-ab2b37c6-6d17c02-e18ac463_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:22.715471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Write session: try to update token
2025-10-02T09:30:22.715485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:22.722487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:22.722506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:22.722508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:22.722509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:22.722517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.722521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.722524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554389176498856:5842]
2025-10-02T09:30:22.722558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:22.722564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.722566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:22.722569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:22.722575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:22.722579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:22.722680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:22.727716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:22.730121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:22.780996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554389252022603:6694]
2025-10-02T09:30:22.781269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7556554389252022603:6694]
2025-10-02T09:30:22.850850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:22.851106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.851115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.851142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022603:6694], now have 1 active actors on pipe
2025-10-02T09:30:22.851305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:22.851328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:22.851367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:22.851372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:22.851375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554389252022603:6694]
2025-10-02T09:30:22.851446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0
2025-10-02T09:30:22.851600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0 is DEAD
2025-10-02T09:30:22.851734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:22.851743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Write session will restart in 0.005641s
2025-10-02T09:30:22.851760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Write session: Do CDS request
2025-10-02T09:30:22.851765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:22.858212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.858284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:22.858295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-10-02T09:30:22.858395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:22.858423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:22.858427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:22.858431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:22.858865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-10-02T09:30:22.858904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:22.858910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:22.858911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:22.858915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554389252022640:6784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:22.859351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554389252022640:6784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:22.861175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554389252022640:6784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:22.864649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554389252022640:6784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:22.864662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554389252022640:6784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:22.864665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554389252022640:6784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:22.864672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:22.870071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:22.870419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:22.870521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:22.870529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:22.870536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:22.870568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:22.870598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554389176499156:5844]
2025-10-02T09:30:22.870976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:22.872729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:22.872764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:22.873013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:22.873064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.873070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.873071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.873072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.873073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.873073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.873074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.873075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.873076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.873076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.873077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.873078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.873082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.873092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.873096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.873099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.873103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.873107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.873110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.873114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.873117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.873121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.873124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.873127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.873133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.873138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:22.873142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.873145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:22.873147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.873150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:22.873153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.873155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:22.873160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.873163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:22.873165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.873168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:22.873170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.873172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:22.873174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.873177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:22.873179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.873182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:22.873184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.873186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.873188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.873191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.873193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.873196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.873225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:22.880975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:22.882476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:22.882492Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:22.882494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:22.882498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:22.882504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [2:7556554389176499156:5844]
2025-10-02T09:30:22.882519Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:22.882538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:22.882545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.882548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.882550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.882564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:22.882573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:22.882584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:22.882636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.882644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.882646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.882649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:22.882651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:22.882708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:22.882715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.882726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:22.882741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:22.882761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:22.882783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022774:6784], now have 1 active actors on pipe
2025-10-02T09:30:22.882791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022608:2446], now have 1 active actors on pipe
2025-10-02T09:30:22.882797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.882799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.882803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.882815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:22.882827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:22.882830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:22.882830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:22.882831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:22.882811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 716
2025-10-02T09:30:22.882844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:22.882851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:22.882814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 716
2025-10-02T09:30:22.882885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.882893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.882907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.882918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:22.882922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:22.882942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|129f2e98-957c579f-984760b5-2efc7f2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:22.882952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:22.882956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:22.882958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:22.882965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:22.882977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:22.883008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.883145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:22.883154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:22.883168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:22.883234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 36 sessionId: src_id|129f2e98-957c579f-984760b5-2efc7f2e_0
2025-10-02T09:30:22.883535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b05bde2-fae38801-47f5d1bc-c17a504d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|129f2e98-957c579f-984760b5-2efc7f2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:22.885711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Write session: try to update token
2025-10-02T09:30:22.885722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:22.892771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:22.892791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:22.892793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:22.892795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:22.892816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.892821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.892825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554389176499151:5844]
2025-10-02T09:30:22.892859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:22.892859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:22.892863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:22.892863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:22.892865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:22.892865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:22.892987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:22.897522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|129f2e98-957c579f-984760b5-2efc7f2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:22.899884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:22.951470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554389252022910:6694]
2025-10-02T09:30:22.951679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7556554389252022910:6694]
2025-10-02T09:30:23.010247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:23.010926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.010940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.010973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554389252022910:6694], now have 1 active actors on pipe
2025-10-02T09:30:23.011211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:23.011314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:23.011359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:23.011393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554389252022910:6694]
2025-10-02T09:30:23.011418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: status is not ok: tablet will be restarted right now sessionId: src_id|129f2e98-957c579f-984760b5-2efc7f2e_0
2025-10-02T09:30:23.011543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|129f2e98-957c579f-984760b5-2efc7f2e_0 is DEAD
2025-10-02T09:30:23.011678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:23.011688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Write session will restart in 0.008640s
2025-10-02T09:30:23.011711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Write session: Do CDS request
2025-10-02T09:30:23.011716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:23.021268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.021345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:23.021355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-10-02T09:30:23.021446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.021467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:23.021471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:23.021473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:23.021814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-10-02T09:30:23.021837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:23.021841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:23.021843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:23.021846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554393546990275:6788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:23.022209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554393546990275:6788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:23.024112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554393546990275:6788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:23.026572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554393546990275:6788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:23.026584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554393546990275:6788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:23.026587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554393546990275:6788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:23.026592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:23.029072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:23.031256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:23.031405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:23.031412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:23.031421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:23.031463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:23.031494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554393471466746:5847]
2025-10-02T09:30:23.031878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:23.032126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:23.032163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:23.032435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:23.032487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.032493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.032494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.032495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.032496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.032497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.032497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.032498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.032499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.032500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.032501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.032502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.032506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.032516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.032520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.032524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.032527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.032531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.032534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.032538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.032541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.032545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.032549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.032552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.032558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.032569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.032576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.032579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.032581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.032585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.032587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.032590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.032592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.032595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.032597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.032601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.032604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.032606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.032609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.032611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.032613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.032617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.032619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.032622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.032624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.032626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.032629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.032631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.032648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:23.040417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:23.041894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:23.041905Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:23.041907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:23.041909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:23.041914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [2:7556554393471466746:5847]
2025-10-02T09:30:23.041921Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:23.041933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:23.041938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.041940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.041941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.041952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:23.041955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:23.041960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:23.041995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.042000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.042001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.042003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:23.042005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:23.042052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:23.042057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.042063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.042071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.042083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:23.042098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990436:6788], now have 1 active actors on pipe
2025-10-02T09:30:23.042104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990208:2446], now have 1 active actors on pipe
2025-10-02T09:30:23.042108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.042109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.042110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.042118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:23.042128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:23.042132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:23.042134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:23.042135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:23.042139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:23.042141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:23.042159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.042163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:23.042169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:23.042157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 717
2025-10-02T09:30:23.042190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.042157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 717
2025-10-02T09:30:23.042196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.042211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c76f080-f072d39-7d328322-d04dc127_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:23.042218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.042220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.042221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:23.042227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.042232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:23.042240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.042346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.042351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.042358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.042419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 36 sessionId: src_id|4c76f080-f072d39-7d328322-d04dc127_0
2025-10-02T09:30:23.042673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|129f2e98-957c579f-984760b5-2efc7f2e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4c76f080-f072d39-7d328322-d04dc127_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:23.044885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Write session: try to update token
2025-10-02T09:30:23.044895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:23.051764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:23.051775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.051780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.051803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:23.051805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:23.051951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:23.052071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.052190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.052308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.052458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:23.052482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:23.055714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|4c76f080-f072d39-7d328322-d04dc127_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:23.057794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:23.058316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.058328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.058353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:23.058437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:23.060590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:23.060604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.060606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:23.060607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:23.060613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.060616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.060620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554393471466741:5847]
2025-10-02T09:30:23.060643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:23.060647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.060648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:23.060655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:23.060659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:23.060662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:23.060769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:23.111703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554393546990510:6694]
2025-10-02T09:30:23.111920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7556554393546990510:6694]
2025-10-02T09:30:23.179584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:23.186207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.186230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.186353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.186404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.186457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.186510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.186549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.186555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.186611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.186658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.186710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.186762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.186800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.186805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.186858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.186904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.186966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.187040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.187082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.187091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.187157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.187216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.187282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.187338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.187381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.187388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.187453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.187510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.187564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.187615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.187656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.187662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.187717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.187767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.187819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.187870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.187908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.187913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.187965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.188018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.188071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.188123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.188160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.188166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.188218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.188266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.188315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.188366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.188402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.188407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.188457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.188510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.188561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.188614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.188655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.188659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.188709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.188756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.188820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.188875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.188913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.188918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.188949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990510:6694], now have 1 active actors on pipe
2025-10-02T09:30:23.189145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:23.189151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554393546990510:6694]
2025-10-02T09:30:23.189175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:23.189177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:23.189200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: error at write: Disconnected sessionId: src_id|4c76f080-f072d39-7d328322-d04dc127_0
2025-10-02T09:30:23.189383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|4c76f080-f072d39-7d328322-d04dc127_0 is DEAD
2025-10-02T09:30:23.189508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:23.189518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Write session will restart in 0.007832s
2025-10-02T09:30:23.189538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Write session: Do CDS request
2025-10-02T09:30:23.189543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:23.189650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:23.198171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.198350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:23.198363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-10-02T09:30:23.198470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.198496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:23.198512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:23.198519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:23.198828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-10-02T09:30:23.198855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:23.198860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:23.198862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:23.198866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554393546990592:6799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:23.199278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554393546990592:6799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:23.200994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554393546990592:6799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:23.203615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554393546990592:6799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:23.203642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554393546990592:6799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:23.203645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554393546990592:6799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:23.203650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:23.206217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:23.208724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:23.209045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:23.209053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:23.209061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:23.209098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:23.209122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554393471467073:5856]
2025-10-02T09:30:23.209495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:23.209696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:23.209735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:23.209927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:23.209965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.209971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.209971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.209972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.209973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.209974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.209975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.209976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.209977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.209978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.209979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.209979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.209984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.209993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.209997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.210000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.210003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.210006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.210009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.210013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.210016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.210020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.210027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.210031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.210035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.210038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.210043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.210045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.210047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.210049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.210052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.210055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.210057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.210059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.210062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.210064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.210069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.210071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.210074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.210076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.210078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.210080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.210083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.210089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.210091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.210093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.210096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.210114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:23.218116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:23.219549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:23.219564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:23.219565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:23.219567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:23.219571Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [2:7556554393471467073:5856]
2025-10-02T09:30:23.219579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:23.219589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:23.219591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.219592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.219593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.219603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:23.219606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:23.219610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:23.219647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.219656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.219660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.219663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:23.219665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:23.219716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:23.219722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.219729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.219734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.219742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:23.219754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990750:6799], now have 1 active actors on pipe
2025-10-02T09:30:23.219761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.219762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.219763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.219767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:23.219772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990514:2446], now have 1 active actors on pipe
2025-10-02T09:30:23.219776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:23.219778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:23.219779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:23.219781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:23.219785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:23.219787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:23.219805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.219811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:23.219817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:23.219841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 718
2025-10-02T09:30:23.219868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 718
2025-10-02T09:30:23.219915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.219925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.219946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:23.219960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.219963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.219965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:23.219972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.219980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:23.219990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.220112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.220120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.220130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.220195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 36 sessionId: src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0
2025-10-02T09:30:23.220499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c76f080-f072d39-7d328322-d04dc127_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:23.222900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Write session: try to update token
2025-10-02T09:30:23.222913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:23.229117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:23.229133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.229140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.229173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:23.229178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:23.229322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:23.229457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.229583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.229705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.229869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:23.229903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:23.234343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:23.236293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:23.236413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.236425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.236443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:23.236524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:23.237495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:23.237507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.237509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:23.237510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:23.237515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.237518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.237520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554393471467068:5856]
2025-10-02T09:30:23.237542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:23.237550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.237549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:23.237551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:23.237553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:23.237555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:23.237661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:23.241229Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:30:23.289389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554393546990840:6694]
2025-10-02T09:30:23.289619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7556554393546990840:6694]
2025-10-02T09:30:23.355903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:23.362399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.362420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.362545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.362596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.362646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.362696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.362738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.362746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.362799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.362848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.362901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.362952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.363002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.363013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.363078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.363139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.363194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.363243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.363279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.363284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.363336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.363386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.363435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.363485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.363522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.363528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.363580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.363628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.363678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.363728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.363770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.363775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.363825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.363872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.363921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.363971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.364007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.364011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.364065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.364112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.364167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.364218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.364254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.364259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.364311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.364357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.364405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.364452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.364492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.364497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.364543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.364588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.364634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.364683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.364787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.364793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.364852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.364900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.364948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.364998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.365033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.365039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.365070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990840:6694], now have 1 active actors on pipe
2025-10-02T09:30:23.365296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554393546990840:6694]
2025-10-02T09:30:23.365302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:23.365330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:23.365331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:23.365352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: error at write: Disconnected sessionId: src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0
2025-10-02T09:30:23.365489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0 is DEAD
2025-10-02T09:30:23.365639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:23.365687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:23.365698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Write session will restart in 0.009367s
2025-10-02T09:30:23.365718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Write session: Do CDS request
2025-10-02T09:30:23.365723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:23.376187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.376287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:23.376295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-10-02T09:30:23.376428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.376448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:23.376454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:23.376457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:23.376882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-10-02T09:30:23.376911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:23.376917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:23.376918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:23.376923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554393546990953:6804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:23.377634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554393546990953:6804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:23.379951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554393546990953:6804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:23.382059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554393546990953:6804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:23.382068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554393546990953:6804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:23.382070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554393546990953:6804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:23.382074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:23.383968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:23.384272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:23.384367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:23.384374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:23.384380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:23.384405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:23.384430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554393471467377:5864]
2025-10-02T09:30:23.384775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:23.386489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:23.386545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:23.386984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:23.387059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.387067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.387070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.387074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.387077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.387080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.387082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.387084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.387085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.387088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.387090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.387092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.387098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.387106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.387110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.387114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.387118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.387122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.387124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.387130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.387134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.387149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.387152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.387159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.387168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.387177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.387184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.387199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.387210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.387214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.387217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.387221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.387226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.387228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.387232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.387236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.387239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.387242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.387247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.387250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.387254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.387257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.387262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.387266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.387268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.387272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.387275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.387308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:23.395094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:23.397844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:23.397854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:23.397856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:23.397859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:23.397863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [2:7556554393471467377:5864]
2025-10-02T09:30:23.397872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:23.397885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:23.397888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.397891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.397895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.397912Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:23.397918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:23.397924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:23.397989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.397995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.397996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.397999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:23.398004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:23.398050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:23.398056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.398066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.398082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.398102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:23.398118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991134:6804], now have 1 active actors on pipe
2025-10-02T09:30:23.398126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546990843:2446], now have 1 active actors on pipe
2025-10-02T09:30:23.398137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.398144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.398146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.398159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:23.398177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:23.398179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:23.398182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:23.398184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:23.398192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:23.398173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 719
2025-10-02T09:30:23.398196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:23.398179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 719
2025-10-02T09:30:23.398222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.398228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:23.398230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:23.398245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.398252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.398284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d0c80ef-88d021f5-c2382375-4f670885_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:23.398292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.398295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.398297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:23.398305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.398314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:23.398330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.398437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.398444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.398453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.398519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d0c80ef-88d021f5-c2382375-4f670885_0
2025-10-02T09:30:23.398902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261af9f4-905dfa45-9c906b3d-5a6b208c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d0c80ef-88d021f5-c2382375-4f670885_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:23.405069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Write session: try to update token
2025-10-02T09:30:23.405081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:23.408124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:23.408137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.408138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:23.408139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:23.408144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.408149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.408153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554393471467372:5864]
2025-10-02T09:30:23.408176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:23.408184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.408190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:23.408191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:23.408196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:23.408201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:23.408429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:23.419090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|1d0c80ef-88d021f5-c2382375-4f670885_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:23.421135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:23.465520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554393546991147:6694]
2025-10-02T09:30:23.465710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7556554393546991147:6694]
2025-10-02T09:30:23.523292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:23.523981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.523991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.524003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991147:6694], now have 1 active actors on pipe
2025-10-02T09:30:23.524250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:23.524260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:23.524262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554393546991147:6694]
2025-10-02T09:30:23.524284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:23.524280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:23.524324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|1d0c80ef-88d021f5-c2382375-4f670885_0
2025-10-02T09:30:23.524460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|1d0c80ef-88d021f5-c2382375-4f670885_0 is DEAD
2025-10-02T09:30:23.524590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:23.524599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Write session will restart in 0.006793s
2025-10-02T09:30:23.524618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Write session: Do CDS request
2025-10-02T09:30:23.524622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:23.532200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.532339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:23.532349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-10-02T09:30:23.532455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.532482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:23.532490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:23.532493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:23.532853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-10-02T09:30:23.532881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:23.532888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:23.532890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:23.532894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554393546991182:6808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:23.533275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554393546991182:6808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:23.535723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554393546991182:6808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:23.537931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554393546991182:6808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:23.537938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554393546991182:6808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:23.537940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554393546991182:6808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:23.537944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:23.541395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:23.543559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:23.543747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:23.543757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:23.543767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:23.543812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:23.543850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554393471467677:5866]
2025-10-02T09:30:23.544439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:23.544630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:23.544665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:23.544882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:23.544911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.544916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.544916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.544917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.544917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.544918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.544918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.544919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.544919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.544920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.544920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.544921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.544924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.544930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.544932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.544934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.544936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.544938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.544940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.544942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.544944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.544945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.544947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.544949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.544953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.544957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.544960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.544962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.544964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.544967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.544969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.544972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.544974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.544976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.544978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.544981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.544983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.544985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.544987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.544990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.544993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.544995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.544997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.544999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.545001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.545004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.545006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.545009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.545025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:23.552501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:23.553859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:23.553872Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:23.553874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:23.553876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:23.553879Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [2:7556554393471467677:5866]
2025-10-02T09:30:23.553886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:23.553896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:23.553898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.553899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.553901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.553910Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:23.553914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:23.553918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:23.553952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.553956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.553957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.553960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:23.553961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:23.554003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:23.554008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.554014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.554019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.554031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:23.554046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991330:6808], now have 1 active actors on pipe
2025-10-02T09:30:23.554052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991149:2446], now have 1 active actors on pipe
2025-10-02T09:30:23.554056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.554057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.554059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.554066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:23.554076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:23.554080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:23.554082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:23.554083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:23.554086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:23.554088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:23.554102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.554107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:23.554120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:23.554106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 720
2025-10-02T09:30:23.554111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 720
2025-10-02T09:30:23.554137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.554142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.554156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:23.554162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.554165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.554166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:23.554172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.554180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:23.554192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.554270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.554275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.554282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.554341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0
2025-10-02T09:30:23.554616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d0c80ef-88d021f5-c2382375-4f670885_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:23.556760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Write session: try to update token
2025-10-02T09:30:23.556769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:23.563382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:23.563395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.563396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:23.563397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:23.563402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.563405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.563407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554393471467670:5866]
2025-10-02T09:30:23.563430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:23.563433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.563435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:23.563443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:23.563447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:23.563450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:23.563538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:23.568216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:23.570156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:23.624233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554393546991466:6694]
2025-10-02T09:30:23.624428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7556554393546991466:6694]
2025-10-02T09:30:23.677890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:23.678532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.678551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.678584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991466:6694], now have 1 active actors on pipe
2025-10-02T09:30:23.678727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:23.678774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:23.678783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:23.678795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:23.678827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0
2025-10-02T09:30:23.678828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554393546991466:6694]
2025-10-02T09:30:23.678976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0 is DEAD
2025-10-02T09:30:23.679125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:23.679133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Write session will restart in 0.005966s
2025-10-02T09:30:23.679149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Write session: Do CDS request
2025-10-02T09:30:23.679153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:23.686143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.686254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:23.686262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-10-02T09:30:23.686338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.686357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:23.686363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:23.686366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:23.686656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-10-02T09:30:23.686679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:23.686684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:23.686685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:23.686688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554393546991516:6813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:23.687048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554393546991516:6813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:23.688846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554393546991516:6813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:23.691213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554393546991516:6813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:23.691228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554393546991516:6813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:23.691232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554393546991516:6813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:23.691238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:23.694142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:23.696126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:23.696232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:23.696238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:23.696244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:23.696269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:23.696297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554393471467985:5869]
2025-10-02T09:30:23.696656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:23.696831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:23.696854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:23.697034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:23.697062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.697066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.697067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.697067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.697068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.697068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.697069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.697070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.697070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.697070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.697071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.697072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.697074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.697080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.697082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.697084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.697086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.697088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.697090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.697092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.697094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.697096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.697098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.697100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.697103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.697107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.697110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.697113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.697115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.697118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.697120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.697123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.697125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.697127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.697130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.697132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.697134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.697138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.697140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.697142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.697144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.697147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.697149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.697151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.697153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.697156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.697158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.697160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.697177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:23.705061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:23.706369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:23.706382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:23.706383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:23.706385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:23.706389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [2:7556554393471467985:5869]
2025-10-02T09:30:23.706396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:23.706406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:23.706413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.706414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.706415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.706424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:23.706427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:23.706432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:23.706463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.706467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.706468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.706470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:23.706472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:23.706510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:23.706515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.706521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.706527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.706536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:23.706549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.706554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.706555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.706560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:23.706568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991663:6813], now have 1 active actors on pipe
2025-10-02T09:30:23.706567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:23.706570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:23.706571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:23.706574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991468:2446], now have 1 active actors on pipe
2025-10-02T09:30:23.706579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:23.706586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:23.706587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:23.706601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.706608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:23.706613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:23.706614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 721
2025-10-02T09:30:23.706664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 721
2025-10-02T09:30:23.706702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.706708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.706722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15d7b586-ab431734-a5e93987-1a256806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:23.706729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.706731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.706732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:23.706738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.706746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:23.706763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.706893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.706902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.706912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.706968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 36 sessionId: src_id|15d7b586-ab431734-a5e93987-1a256806_0
2025-10-02T09:30:23.707197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e7845f8-c2d2c2a8-fbaa549e-925b4151_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15d7b586-ab431734-a5e93987-1a256806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:23.709847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Write session: try to update token
2025-10-02T09:30:23.709859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:23.716094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:23.716107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.716112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.716135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:23.716138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:23.716261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:23.716370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.716477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.716585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:23.716733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:23.716755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:23.720796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|15d7b586-ab431734-a5e93987-1a256806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:23.722669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:23.722831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.722840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.722857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:23.722922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:23.724961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:23.724971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.724972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:23.724973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:23.724977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.724979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.724982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554393471467980:5869]
2025-10-02T09:30:23.725002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:23.725007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:23.725009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.725010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:23.725011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:23.725012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:23.725133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:23.778841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554393546991779:6694]
2025-10-02T09:30:23.779033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7556554393546991779:6694]
2025-10-02T09:30:23.836987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:23.843301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.843321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.843440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.843488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.843538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.843587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.843623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.843629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.843680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.843727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.843778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.843826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.843862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.843867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.843917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.843964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.844013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.844079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.844115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.844120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.844173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.844219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.844268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.844317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.844353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.844358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.844409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.844457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.844513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.844572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.844616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.844623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.844683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.844737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.844795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.844866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.844908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.844915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.844968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.845024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.845085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.845137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.845173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.845178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.845230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.845275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.845321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.845365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.845402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.845408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.845484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.845554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.845602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.845649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.845691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.845696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.845742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:23.845787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:23.845839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:23.845890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:23.845931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:23.845935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:23.845965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991779:6694], now have 1 active actors on pipe
2025-10-02T09:30:23.846157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:23.846167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:23.846190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|15d7b586-ab431734-a5e93987-1a256806_0
2025-10-02T09:30:23.846192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554393546991779:6694]
2025-10-02T09:30:23.846219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:23.846326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|15d7b586-ab431734-a5e93987-1a256806_0 is DEAD
2025-10-02T09:30:23.846465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:23.846474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Write session will restart in 0.009132s
2025-10-02T09:30:23.846496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Write session: Do CDS request
2025-10-02T09:30:23.846502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:23.846764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:23.856127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.856198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:23.856207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-10-02T09:30:23.856294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:23.856313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:23.856316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:23.856318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:23.856747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-10-02T09:30:23.856784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:23.856791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:23.856792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:23.856797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554393546991869:6818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:23.857290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554393546991869:6818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:23.860303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554393546991869:6818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:23.863135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554393546991869:6818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:23.863149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554393546991869:6818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:23.863152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554393546991869:6818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:23.863159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:23.864631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:23.867088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:23.867210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:23.867217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:23.867222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:23.867251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:23.867273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554393471468288:5871]
2025-10-02T09:30:23.867644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:23.867835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:23.867861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:23.868050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:23.868082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.868086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.868086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.868087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.868087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.868088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.868088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.868089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.868089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.868090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.868090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.868091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.868093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.868100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.868102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.868104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.868106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.868108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.868110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.868112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.868114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.868118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.868121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.868124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.868129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.868135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:23.868140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.868144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:23.868147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.868149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:23.868151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.868154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:23.868156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.868159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:23.868163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.868165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:23.868167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.868170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:23.868172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.868174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:23.868177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.868180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:23.868181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.868184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.868187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.868190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.868197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.868201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.868217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:23.875861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:23.877220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:23.877232Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:23.877233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:23.877236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:23.877239Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [2:7556554393471468288:5871]
2025-10-02T09:30:23.877246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:23.877257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:23.877259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.877260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.877261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.877271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:23.877273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:23.877277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:23.877307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.877312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.877313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.877315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:23.877317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:23.877366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:23.877371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.877378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:23.877383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:23.877391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:23.877407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546992070:6818], now have 1 active actors on pipe
2025-10-02T09:30:23.877412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546991784:2446], now have 1 active actors on pipe
2025-10-02T09:30:23.877417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.877418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.877419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.877426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:23.877437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:23.877440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:23.877442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:23.877443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:23.877447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:23.877449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:23.877463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.877471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:23.877475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:23.877490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 722
2025-10-02T09:30:23.877507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 722
2025-10-02T09:30:23.877521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.877526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.877540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:23.877544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:23.877546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:23.877548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:23.877553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:23.877558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:23.877568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.877665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:23.877670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:23.877677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:23.877739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0
2025-10-02T09:30:23.878012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d7b586-ab431734-a5e93987-1a256806_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:23.880206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Write session: try to update token
2025-10-02T09:30:23.880218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:23.887070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:23.887087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:23.887090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:23.887092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:23.887099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.887101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.887104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554393471468280:5871]
2025-10-02T09:30:23.887126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:23.887130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:23.887131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:23.887135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:23.887140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:23.887151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:23.887238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:23.891525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:23.893459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:23.946285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554393546992092:6694]
2025-10-02T09:30:23.946532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7556554393546992092:6694]
2025-10-02T09:30:24.002520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:24.003030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.003042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.003071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554393546992092:6694], now have 1 active actors on pipe
2025-10-02T09:30:24.003244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:24.003318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554393546992092:6694]
2025-10-02T09:30:24.003328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:24.003331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:24.003347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:24.003380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: error at write: Disconnected sessionId: src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0
2025-10-02T09:30:24.003520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0 is DEAD
2025-10-02T09:30:24.003643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:24.003653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Write session will restart in 0.006024s
2025-10-02T09:30:24.003668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Write session: Do CDS request
2025-10-02T09:30:24.003672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:24.011141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.011245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:24.011254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-10-02T09:30:24.011331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.011351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:24.011357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:24.011359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:24.011714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-10-02T09:30:24.011739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:24.011744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:24.011745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:24.011748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554397841959425:6822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:24.012105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554397841959425:6822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:24.014650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554397841959425:6822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:24.017396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554397841959425:6822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:24.017404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554397841959425:6822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:24.017406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554397841959425:6822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:24.017410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:24.021349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:24.023529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:24.023646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:24.023653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:24.023659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:24.023693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:24.023715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554397766435884:5874]
2025-10-02T09:30:24.024069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:24.024277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:24.024304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:24.024500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:24.024532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.024536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.024537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.024537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.024538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.024538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.024539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.024539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.024540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.024540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.024541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.024541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.024544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.024550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.024552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.024554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.024556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.024558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.024560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.024562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.024564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.024566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.024568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.024570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.024574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.024578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.024581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.024584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.024586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.024589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.024595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.024597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.024600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.024603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.024609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.024613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.024620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.024628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.024635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.024639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.024645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.024647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.024649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.024652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.024654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.024657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.024662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.024664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.024682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:24.032529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:24.033899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:24.033913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:24.033915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:24.033919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:24.033923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [2:7556554397766435884:5874]
2025-10-02T09:30:24.033934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:24.033947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:24.033949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.033951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.033952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.033961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:24.033965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:24.033969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:24.034012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.034021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.034023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.034026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:24.034028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:24.034069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:24.034075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.034081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.034087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.034105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:24.034126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841959389:2446], now have 1 active actors on pipe
2025-10-02T09:30:24.034129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841959583:6822], now have 1 active actors on pipe
2025-10-02T09:30:24.034134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.034136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.034138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.034148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:24.034157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:24.034164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:24.034167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:24.034169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:24.034169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:24.034171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:24.034186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.034191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:24.034167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 723
2025-10-02T09:30:24.034193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 723
2025-10-02T09:30:24.034202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:24.034213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.034215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.034230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:24.034234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.034236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.034237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:24.034242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.034248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:24.034259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.034377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.034385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.034394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.034477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 36 sessionId: src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0
2025-10-02T09:30:24.034728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4087af7-f7aaae46-a5d25a28-ed191808_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:24.037040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Write session: try to update token
2025-10-02T09:30:24.037053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:24.043730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:24.043748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.043750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:24.043752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:24.043759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.043764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.043767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554397766435879:5874]
2025-10-02T09:30:24.043796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:24.043800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:24.043803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.043804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:24.043805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:24.043806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:24.043917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:24.048239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:24.050283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:24.103460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554397841959698:6694]
2025-10-02T09:30:24.103654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7556554397841959698:6694]
2025-10-02T09:30:24.168391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:24.169043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.169053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.169080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841959698:6694], now have 1 active actors on pipe
2025-10-02T09:30:24.169236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:24.169293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:24.169318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554397841959698:6694]
2025-10-02T09:30:24.169333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:24.169355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0
2025-10-02T09:30:24.169471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0 is DEAD
2025-10-02T09:30:24.169589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:24.169599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Write session will restart in 0.005352s
2025-10-02T09:30:24.169622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Write session: Do CDS request
2025-10-02T09:30:24.169628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:24.176194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.176303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:24.176312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-10-02T09:30:24.176407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.176427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:24.176433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:24.176436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:24.176709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-10-02T09:30:24.176743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:24.176749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:24.176750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:24.176754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554397841959738:6827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:24.177114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554397841959738:6827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:24.178897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554397841959738:6827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:24.181141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554397841959738:6827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:24.181149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554397841959738:6827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:24.181151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554397841959738:6827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:24.181159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:24.186955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:24.187236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:24.187358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:24.187367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:24.187376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:24.187412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:24.187441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554397766436188:5877]
2025-10-02T09:30:24.187962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:24.188167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:24.188198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:24.188460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:24.188503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.188508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.188509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.188510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.188511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.188511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.188512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.188513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.188514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.188515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.188516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.188517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.188520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.188530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.188533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.188537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.188540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.188544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.188547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.188550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.188557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.188561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.188568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.188571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.188580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.188589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.188597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.188605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.188613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.188621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.188628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.188635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.188643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.188650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.188658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.188666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.188670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.188678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.188685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.188690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.188697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.188705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.188712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.188721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.188728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.188736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.188743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.188747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.188782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:24.196281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:24.197736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:24.197748Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:24.197750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:24.197753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:24.197757Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [2:7556554397766436188:5877]
2025-10-02T09:30:24.197767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:24.197779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:24.197782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.197784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.197786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.197797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:24.197806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:24.197811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:24.197857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.197864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.197866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.197868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:24.197871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:24.197922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:24.197928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.197938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.197952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.197971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:24.197989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841959872:6827], now have 1 active actors on pipe
2025-10-02T09:30:24.197996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841959701:2446], now have 1 active actors on pipe
2025-10-02T09:30:24.198001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.198003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.198005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.198015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:24.198028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:24.198031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:24.198033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:24.198035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:24.198043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:24.198046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:24.198012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 724
2025-10-02T09:30:24.198012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 724
2025-10-02T09:30:24.198075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.198081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.198094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.198104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:24.198114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:24.198128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:24.198137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.198143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.198145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:24.198151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.198161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:24.198183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.198283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.198292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.198303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.198362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 36 sessionId: src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0
2025-10-02T09:30:24.198592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612bc45-9dc56787-4eabad2f-2d7a4ae1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:24.200755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Write session: try to update token
2025-10-02T09:30:24.200765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:24.208150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:24.208167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.208169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:24.208172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:24.208179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.208182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.208185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554397766436183:5877]
2025-10-02T09:30:24.208213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:24.208215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:24.208218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:24.208220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:24.208234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.208241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:24.208359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:24.211778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:24.213816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:24.269349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554397841960033:6694]
2025-10-02T09:30:24.269530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7556554397841960033:6694]
2025-10-02T09:30:24.326832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:24.327109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.327121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.327148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960033:6694], now have 1 active actors on pipe
2025-10-02T09:30:24.327316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:24.327412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554397841960033:6694]
2025-10-02T09:30:24.327433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:24.327443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:24.327506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0
2025-10-02T09:30:24.327642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0 is DEAD
2025-10-02T09:30:24.327801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:24.327810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Write session will restart in 0.008561s
2025-10-02T09:30:24.327828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Write session: Do CDS request
2025-10-02T09:30:24.327833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:24.337118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.337229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:24.337237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-10-02T09:30:24.337355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.337375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:24.337381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:24.337384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:24.337678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-10-02T09:30:24.337702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:24.337707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:24.337708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:24.337711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554397841960116:6838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:24.338073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554397841960116:6838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:24.340137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554397841960116:6838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:24.342636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554397841960116:6838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:24.342645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554397841960116:6838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:24.342647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554397841960116:6838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:24.342651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:24.346642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:24.346911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:24.347039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:24.347048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:24.347055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:24.347094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:24.347127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554397766436527:5891]
2025-10-02T09:30:24.347667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:24.347857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:24.347891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:24.348163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:24.348203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.348209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.348210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.348211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.348212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.348213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.348214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.348215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.348215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.348216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.348217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.348218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.348222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.348232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.348236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.348239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.348242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.348250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.348254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.348261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.348264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.348268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.348275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.348279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.348288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.348298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.348307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.348311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.348315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.348323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.348330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.348335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.348343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.348349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.348357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.348365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.348369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.348377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.348381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.348385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.348394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.348402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.348409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.348418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.348426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.348434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.348442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.348450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.348487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:24.356153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:24.357568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:24.357581Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:24.357582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:24.357585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:24.357589Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [2:7556554397766436527:5891]
2025-10-02T09:30:24.357597Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:24.357609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:24.357611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.357614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.357615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.357627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:24.357636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:24.357645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:24.357675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.357679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.357681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.357683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:24.357684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:24.357725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:24.357730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.357737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.357746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.357757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:24.357772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.357776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.357778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.357782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:24.357790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960034:2446], now have 1 active actors on pipe
2025-10-02T09:30:24.357790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:24.357792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:24.357793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960329:6838], now have 1 active actors on pipe
2025-10-02T09:30:24.357793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:24.357798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:24.357805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:24.357806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:24.357820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.357829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:24.357848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 725
2025-10-02T09:30:24.357860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 725
2025-10-02T09:30:24.357848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:24.357897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.357904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.357920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:24.357927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.357929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.357933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:24.357939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.357944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:24.357955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.358083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.358093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.358104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.358177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 36 sessionId: src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0
2025-10-02T09:30:24.358451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8c6fc5-9ad38222-56e21235-155c05a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:24.360751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Write session: try to update token
2025-10-02T09:30:24.360763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:24.367172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:24.367191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.367197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.367221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:24.367227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:24.367352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:24.367460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:24.367567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:24.367681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:24.367844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:24.367872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:24.371732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:24.373707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:24.374315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.374332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.374355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:24.374429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:24.376350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:24.376361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.376362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:24.376363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:24.376369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.376371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.376373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554397766436522:5891]
2025-10-02T09:30:24.376392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:24.376396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.376397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:24.376430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:24.376446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:24.376450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:24.376502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:24.427583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554397841960345:6694]
2025-10-02T09:30:24.427838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7556554397841960345:6694]
2025-10-02T09:30:24.498081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:24.504430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.504454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.504576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.504626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.504673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.504722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.504757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.504763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.504832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.504881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.504930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.504982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.505018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.505023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.505074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.505120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.505169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.505215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.505250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.505255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.505303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.505351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.505399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.505445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.505481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.505486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.505536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.505584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.505631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.505682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.505718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.505722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.505805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.505872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.505921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.505968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.506014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.506019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.506067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.506113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.506167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.506224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.506272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.506278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.506328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.506373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.506419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.506466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.506500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.506506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.506553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.506597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.506643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.506690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.506724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.506729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.506775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.506819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.506869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.506917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.507034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.507040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.507069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960345:6694], now have 1 active actors on pipe
2025-10-02T09:30:24.507289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554397841960345:6694]
2025-10-02T09:30:24.507310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:24.507324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:24.507327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:24.507345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: error at write: Disconnected sessionId: src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0
2025-10-02T09:30:24.507511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0 is DEAD
2025-10-02T09:30:24.507616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:24.507625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Write session will restart in 0.006506s
2025-10-02T09:30:24.507650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Write session: Do CDS request
2025-10-02T09:30:24.507654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:24.507842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:24.515176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.515298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:24.515313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-10-02T09:30:24.515484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.515512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:24.515521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:24.515527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:24.515917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-10-02T09:30:24.515947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:24.515954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:24.515955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:24.515959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554397841960410:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:24.516401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554397841960410:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:24.518841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554397841960410:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:24.521403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554397841960410:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:24.521414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554397841960410:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:24.521418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554397841960410:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:24.521424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:24.524002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:24.526097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:24.526212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:24.526219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:24.526225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:24.526252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:24.526277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554397766436831:5893]
2025-10-02T09:30:24.526631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:24.526867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:24.526891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:24.527096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:24.527125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.527130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.527130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.527131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.527131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.527132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.527132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.527133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.527133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.527134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.527135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.527135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.527138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.527144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.527147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.527149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.527151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.527153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.527155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.527157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.527159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.527161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.527163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.527170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.527174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.527178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.527181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.527183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.527186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.527188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.527191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.527193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.527196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.527198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.527201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.527203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.527205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.527208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.527210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.527213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.527215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.527217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.527220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.527223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.527229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.527231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.527234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.527251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:24.535954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:24.537364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:24.537378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:24.537380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:24.537383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:24.537388Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [2:7556554397766436831:5893]
2025-10-02T09:30:24.537398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:24.537412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:24.537417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.537419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.537421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.537431Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:24.537437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:24.537442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:24.537482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.537487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.537489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.537491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:24.537493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:24.537536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:24.537541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.537548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.537554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.537569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:24.537584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.537591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.537594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.537601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:24.537610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:24.537618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960594:6842], now have 1 active actors on pipe
2025-10-02T09:30:24.537619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:24.537621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:24.537623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960347:2446], now have 1 active actors on pipe
2025-10-02T09:30:24.537626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:24.537634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:24.537639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:24.537663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.537672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:24.537692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:24.537672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 726
2025-10-02T09:30:24.537691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 726
2025-10-02T09:30:24.537734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.537740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.537755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:24.537762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.537764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.537768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:24.537773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.537779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:24.537792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.537902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.537907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.537916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.537978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 36 sessionId: src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0
2025-10-02T09:30:24.538273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d31e817e-461ee9b0-dc27aaac-f2a9198c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:24.540703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Write session: try to update token
2025-10-02T09:30:24.540716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:24.547487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:24.547508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.547525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.547561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:24.547562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:24.547722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:24.547863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:24.547993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:24.548119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:24.548335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:24.548366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:24.553261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:24.555455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:24.555611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.555633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.555663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:24.555736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:24.556730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:24.556743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.556746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:24.556748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:24.556755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.556759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.556764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554397766436826:5893]
2025-10-02T09:30:24.556793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:24.556812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:24.556816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:24.556818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:24.556820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.556822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:24.556941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:24.607295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554397841960670:6694]
2025-10-02T09:30:24.607553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7556554397841960670:6694]
2025-10-02T09:30:24.683472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:24.691035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.691061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.691206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.691267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.691325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.691385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.691429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.691437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.691499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.691555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.691614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.691673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.691717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.691725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.691784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.691843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.691905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.691961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.692003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.692013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.692101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.692160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.692215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.692275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.692317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.692324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.692387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.692444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.692502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.692562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.692603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.692610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.692669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.692722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.692784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.692857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.692898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.692905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.692970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.693028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.693089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.693148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.693203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.693210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.693269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.693324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.693381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.693438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.693479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.693486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.693540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.693595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.693654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.693709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.693750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.693759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.693819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:24.693871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:24.693927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:24.693986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:24.694105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:24.694112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:24.694160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960670:6694], now have 1 active actors on pipe
2025-10-02T09:30:24.694340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554397841960670:6694]
2025-10-02T09:30:24.694369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:24.694368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:24.694373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:24.694397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: error at write: Disconnected sessionId: src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0
2025-10-02T09:30:24.694568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0 is DEAD
2025-10-02T09:30:24.694691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:24.694703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Write session will restart in 0.008905s
2025-10-02T09:30:24.694722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Write session: Do CDS request
2025-10-02T09:30:24.694728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:24.695080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:24.704250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.704297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:24.704312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-10-02T09:30:24.704451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.704479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:24.704488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:24.704492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:24.704856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-10-02T09:30:24.704886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:24.704891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:24.704892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:24.704895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554397841960727:6847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:24.705296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554397841960727:6847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:24.708153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554397841960727:6847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:24.710771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554397841960727:6847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:24.710782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554397841960727:6847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:24.710785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554397841960727:6847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:24.710791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:24.714010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:24.716397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:24.716830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:24.716839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:24.716849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:24.716894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:24.716928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554397766437158:5896]
2025-10-02T09:30:24.717478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:24.717770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:24.717832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:24.718068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:24.718107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.718112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.718112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.718113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.718113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.718114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.718114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.718115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.718116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.718116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.718117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.718117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.718121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.718128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.718130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.718132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.718134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.718144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.718148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.718151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.718154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.718158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.718161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.718165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.718170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.718177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.718180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.718183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.718185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.718187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.718189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.718192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.718194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.718197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.718199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.718202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.718204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.718207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.718209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.718212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.718214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.718217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.718219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.718221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.718224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.718226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.718228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.718231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.718251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:24.726163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:24.727614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:24.727628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:24.727630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:24.727632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:24.727638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [2:7556554397766437158:5896]
2025-10-02T09:30:24.727647Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:24.727660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:24.727661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.727663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.727664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.727675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:24.727677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:24.727681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:24.727717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.727722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.727724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.727726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:24.727727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:24.727770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:24.727777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.727786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.727797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.727809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:24.727825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960900:6847], now have 1 active actors on pipe
2025-10-02T09:30:24.727831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960673:2446], now have 1 active actors on pipe
2025-10-02T09:30:24.727835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.727836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.727838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.727848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:24.727862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:24.727863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:24.727865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:24.727867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:24.727879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:24.727882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:24.727904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.727916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:24.727919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:24.727907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 727
2025-10-02T09:30:24.727908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 727
2025-10-02T09:30:24.727943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.727951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.727978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:24.727986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.727989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.727990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:24.727996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.728002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:24.728011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.728116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.728123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.728133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.728194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0
2025-10-02T09:30:24.728500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29634c1-66ba9149-20a5c3de-306dafe8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:24.730876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Write session: try to update token
2025-10-02T09:30:24.730890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:24.737864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:24.737880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.737882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:24.737884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:24.737889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.737892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.737895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554397766437149:5896]
2025-10-02T09:30:24.737923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:24.737927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.737928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:24.737930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:24.737935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:24.737939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:24.738044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:24.742778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:24.745101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:24.794667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554397841960993:6694]
2025-10-02T09:30:24.794999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7556554397841960993:6694]
2025-10-02T09:30:24.862151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:24.862709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.862723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.862749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960993:6694], now have 1 active actors on pipe
2025-10-02T09:30:24.862920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:24.862948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554397841960993:6694]
2025-10-02T09:30:24.862965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:24.862970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:24.862970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:24.863058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: error at write: Disconnected sessionId: src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0
2025-10-02T09:30:24.863245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0 is DEAD
2025-10-02T09:30:24.863388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:24.863396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Write session will restart in 0.008884s
2025-10-02T09:30:24.863426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Write session: Do CDS request
2025-10-02T09:30:24.863431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:24.869580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:24.870963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:24.871085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:24.871094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:24.871101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:24.871129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:24.871159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554397766437217:5898]
2025-10-02T09:30:24.871525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:24.871729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:24.871753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:24.871933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:24.871968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.871971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.871972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.871973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.871974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.871974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.871975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.871976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.871976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.871977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.871978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.871979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.871982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.871988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.871991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.871993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.871995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.871997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.871999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.872001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.872004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.872006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.872008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.872010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.872016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.872019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:24.872022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.872025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:24.872028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.872031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:24.872033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.872036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:24.872039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.872042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:24.872044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.872047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:24.872050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.872053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:24.872055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.872058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:24.872060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.872063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:24.872065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.872068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.872070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.872073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.872075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.872078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.872096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:24.873161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.873324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:24.873335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-10-02T09:30:24.873453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:24.873473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:24.873480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:24.873483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:24.873816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-10-02T09:30:24.873862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:24.873870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:24.873872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:24.873878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554397841961022:6852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:24.874335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554397841961022:6852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:24.876061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554397841961022:6852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:24.879368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554397841961022:6852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:24.879383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554397841961022:6852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:24.879386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554397841961022:6852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:24.879391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:24.879899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:24.881338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:24.881355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:24.881358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:24.881361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:24.881367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [2:7556554397766437217:5898]
2025-10-02T09:30:24.881379Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:24.881397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:24.881399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.881402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.881404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.881417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:24.881423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:24.881434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:24.881472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.881477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.881479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.881481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:24.881483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:24.881542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:24.881548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.881558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:24.881568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:24.881585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:24.881604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841961057:6852], now have 1 active actors on pipe
2025-10-02T09:30:24.881610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841960998:2446], now have 1 active actors on pipe
2025-10-02T09:30:24.881615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.881617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.881619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.881607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 728
2025-10-02T09:30:24.881614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 728
2025-10-02T09:30:24.881627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:24.881636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:24.881638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:24.881639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:24.881642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:24.881655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:24.881661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:24.881699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.881706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.881716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.881723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:24.881729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:24.881749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|622f764e-efa54b76-a921eace-d41fea35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:24.881758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:24.881761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:24.881763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:24.881771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:24.881779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:24.881797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.881921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:24.881931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:24.881948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:24.881998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 36 sessionId: src_id|622f764e-efa54b76-a921eace-d41fea35_0
2025-10-02T09:30:24.882289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7f9a9e2-371a9fce-b7a7e0a7-71c16b44_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|622f764e-efa54b76-a921eace-d41fea35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:24.884763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Write session: try to update token
2025-10-02T09:30:24.884780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:24.891329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:24.891347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:24.891350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:24.891352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:24.891359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.891363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.891367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554397766437212:5898]
2025-10-02T09:30:24.891391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:24.891395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:24.891397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:24.891399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:24.891404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:24.891406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:24.891523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:24.896825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|622f764e-efa54b76-a921eace-d41fea35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:24.898740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:24.963127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554397841961064:6694]
2025-10-02T09:30:24.963345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7556554397841961064:6694]
2025-10-02T09:30:25.010062Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.010303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.010313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.010330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554397841961064:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.010479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:25.010495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.010528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:25.010550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554397841961064:6694]
2025-10-02T09:30:25.010585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: status is not ok: tablet will be restarted right now sessionId: src_id|622f764e-efa54b76-a921eace-d41fea35_0
2025-10-02T09:30:25.010723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|622f764e-efa54b76-a921eace-d41fea35_0 is DEAD
2025-10-02T09:30:25.010892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:25.010903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Write session will restart in 0.005584s
2025-10-02T09:30:25.010923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Write session: Do CDS request
2025-10-02T09:30:25.010930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.016335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.017111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.017187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.017196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-10-02T09:30:25.017284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.017305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.017311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.017313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.017686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-10-02T09:30:25.017737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.017744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.017746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.017750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928381:6856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.017896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.018003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.018012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.018019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.018059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.018091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404570:5901]
2025-10-02T09:30:25.018183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928381:6856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.018454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.018659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.018690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.018896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.018942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.018946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.018948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.018949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.018950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.018951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.018952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.018953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.018954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.018955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.018956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.018957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.018962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.018971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.018975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.018979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.018983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.018995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.018998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.019002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.019006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.019011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.019017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.019021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.019026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.019037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.019043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.019052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.019056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.019061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.019068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.019073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.019077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.019082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.019086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.019091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.019097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.019102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.019106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.019113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.019117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.019122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.019127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.019132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.019136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.019142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.019147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.019152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.019185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.019905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928381:6856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.025252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928381:6856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.025262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928381:6856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.025265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928381:6856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.025269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:25.027051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:25.028497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:25.028511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:25.028514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:25.028517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:25.028522Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [2:7556554402061404570:5901]
2025-10-02T09:30:25.028536Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:25.028550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:25.028557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.028559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.028564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.028578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:25.028585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:25.028591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:25.028633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.028640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.028641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.028644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:25.028646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:25.028704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:25.028712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.028723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.028738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.028757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:25.028775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928362:2446], now have 1 active actors on pipe
2025-10-02T09:30:25.028782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928420:6856], now have 1 active actors on pipe
2025-10-02T09:30:25.028786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.028788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.028790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.028797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:25.028772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 729
2025-10-02T09:30:25.028773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 729
2025-10-02T09:30:25.028819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:25.028827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:25.028832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:25.028833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:25.028839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:25.028842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:25.028859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.028868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.028893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.028906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:25.028915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:25.028922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:25.028931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.028934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.028937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:25.028944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.028954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:25.028985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.029113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.029119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.029129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.029179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 36 sessionId: src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0
2025-10-02T09:30:25.029452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622f764e-efa54b76-a921eace-d41fea35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:25.031690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Write session: try to update token
2025-10-02T09:30:25.031703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:25.039159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:25.039180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.039184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:25.039186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:25.039195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.039201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.039205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404565:5901]
2025-10-02T09:30:25.039239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:25.039243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:25.039249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.039250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:25.039252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:25.039253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:25.039657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:25.043495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:25.045960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:25.110584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554402136928427:6694]
2025-10-02T09:30:25.110853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7556554402136928427:6694]
2025-10-02T09:30:25.166874Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.167119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.167129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.167162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928427:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.167322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:25.167409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.167418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554402136928427:6694]
2025-10-02T09:30:25.167449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:25.167552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0
2025-10-02T09:30:25.167738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0 is DEAD
2025-10-02T09:30:25.167902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:25.167912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Write session will restart in 0.008348s
2025-10-02T09:30:25.167958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Write session: Do CDS request
2025-10-02T09:30:25.167964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.173264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.174776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.174945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.174954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.174964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.175026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.175061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404631:5904]
2025-10-02T09:30:25.175430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.175645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.175678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.175890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.175934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.175941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.175942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.175943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.175944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.175945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.175946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.175947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.175948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.175949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.175950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.175951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.175956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.175968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.175972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.175976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.175980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.175983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.175987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.175991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.175995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.175999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.176006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.176009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.176016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.176022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.176027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.176035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.176039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.176044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.176050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.176058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.176063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.176071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.176075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.176080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.176085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.176090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.176094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.176098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.176102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.176107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.176112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.176117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.176121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.176127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.176131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.176135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.176171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.177165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.177247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.177263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-10-02T09:30:25.177415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.177447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.177459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.177463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.177866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-10-02T09:30:25.177901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.177908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.177909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.177915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928455:6861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.178360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928455:6861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.180534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928455:6861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.183384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928455:6861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.183399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928455:6861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.183404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928455:6861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.183412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:25.183853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:25.185333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:25.185346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:25.185348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:25.185351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:25.185358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [2:7556554402061404631:5904]
2025-10-02T09:30:25.185370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:25.185384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:25.185387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.185390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.185392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.185405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:25.185410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:25.185418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:25.185462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.185467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.185470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.185473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:25.185475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:25.185524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:25.185530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.185542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.185556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.185575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:25.185593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928430:2446], now have 1 active actors on pipe
2025-10-02T09:30:25.185599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928490:6861], now have 1 active actors on pipe
2025-10-02T09:30:25.185604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.185607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.185608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.185614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:25.185622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:25.185624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:25.185625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:25.185629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:25.185642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:25.185648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:25.185680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.185686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.185697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.185706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:25.185714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:25.185726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:25.185734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.185738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.185741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:25.185749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.185758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:25.185601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 730
2025-10-02T09:30:25.185777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.185642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 730
2025-10-02T09:30:25.185898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.185903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.185913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.185960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0
2025-10-02T09:30:25.186207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd85f6-1a82083e-eb2c9f29-b7e6e935_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:25.188494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Write session: try to update token
2025-10-02T09:30:25.188506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:25.195756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:25.195773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.195775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:25.195776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:25.195784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.195790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.195794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404626:5904]
2025-10-02T09:30:25.195831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:25.195835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:25.195838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.195840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:25.195841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:25.195842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:25.196034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:25.200248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:25.202332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:25.267755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554402136928510:6694]
2025-10-02T09:30:25.268018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7556554402136928510:6694]
2025-10-02T09:30:25.321268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.321504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.321513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.321541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928510:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.321775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:25.321775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:25.321795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554402136928510:6694]
2025-10-02T09:30:25.321796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:25.321816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.321853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: error at write: Disconnected sessionId: src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0
2025-10-02T09:30:25.322010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0 is DEAD
2025-10-02T09:30:25.322169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:25.322177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Write session will restart in 0.007296s
2025-10-02T09:30:25.322198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Write session: Do CDS request
2025-10-02T09:30:25.322204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.328938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.330234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.330411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.330311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.330325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-10-02T09:30:25.330411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.330434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.330438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.330442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.330567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.330575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.330592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.330636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.330671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404727:5918]
2025-10-02T09:30:25.330835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-10-02T09:30:25.330869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.330875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.330877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.330881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928541:6872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.331205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.331358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928541:6872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.331448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.331485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.331707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.331744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.331748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.331749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.331750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.331750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.331751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.331752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.331752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.331753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.331753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.331754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.331755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.331758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.331764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.331766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.331768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.331770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.331772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.331774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.331777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.331780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.331783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.331784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.331786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.331790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.331794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.331797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.331800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.331802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.331805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.331807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.331810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.331816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.331818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.331821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.331824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.331826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.331828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.331831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.331835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.331840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.331843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.331847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.331851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.331855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.331858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.331862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.331894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.333794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928541:6872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.339536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928541:6872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.339551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928541:6872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.339554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928541:6872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.339562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:25.339938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:25.341455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:25.341470Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:25.341473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:25.341475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:25.341480Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [2:7556554402061404727:5918]
2025-10-02T09:30:25.341492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:25.341506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:25.341508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.341510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.341512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.341527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:25.341531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:25.341537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:25.341579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.341586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.341588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.341591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:25.341593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:25.341650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:25.341657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.341668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.341677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.341691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:25.341710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928579:6872], now have 1 active actors on pipe
2025-10-02T09:30:25.341716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928520:2446], now have 1 active actors on pipe
2025-10-02T09:30:25.341721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.341722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.341724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.341733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:25.341744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:25.341753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:25.341756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:25.341758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:25.341761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:25.341764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:25.341766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 731
2025-10-02T09:30:25.341792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.341771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 731
2025-10-02T09:30:25.341798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:25.341800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:25.341810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.341813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.341853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:25.341862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.341866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.341867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:25.341875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.341886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:25.341904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.342044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.342051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.342063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.342133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 36 sessionId: src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0
2025-10-02T09:30:25.342488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c080fd6-e56a82e4-aea43ca8-134cad5a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:25.344912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Write session: try to update token
2025-10-02T09:30:25.344927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:25.351955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:25.351972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.351974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:25.351976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:25.351985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.351989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.351992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404722:5918]
2025-10-02T09:30:25.352031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:25.352041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.352043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:25.352062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:25.352073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:25.352076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:25.352173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:25.357708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:25.360544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:25.421884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554402136928588:6694]
2025-10-02T09:30:25.422127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7556554402136928588:6694]
2025-10-02T09:30:25.475821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.476087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.476099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.476115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928588:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.476347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:25.476349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.476360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554402136928588:6694]
2025-10-02T09:30:25.476389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:25.476474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: status is not ok: tablet will be restarted right now sessionId: src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0
2025-10-02T09:30:25.476631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0 is DEAD
2025-10-02T09:30:25.476780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:25.476792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Write session will restart in 0.008260s
2025-10-02T09:30:25.476825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Write session: Do CDS request
2025-10-02T09:30:25.476831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.482964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.484149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.484266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.484274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.484279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.484310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.484336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404788:5920]
2025-10-02T09:30:25.484696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.484943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.484968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.485163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.485197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.485201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.485201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.485202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.485202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.485203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.485204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.485204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.485205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.485205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.485206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.485206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.485209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.485216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.485218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.485220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.485222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.485224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.485226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.485228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.485230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.485234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.485236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.485238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.485242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.485247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.485251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.485254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.485258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.485261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.485263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.485266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.485268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.485271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.485273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.485277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.485279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.485282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.485284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.485286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.485289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.485291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.485293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.485296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.485298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.485301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.485303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.485306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.485322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.486314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.486381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.486398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-10-02T09:30:25.486554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.486583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.486592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.486597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.487044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-10-02T09:30:25.487083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.487084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.487086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.487090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928615:6876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.487517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928615:6876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.489076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928615:6876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.492671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928615:6876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.492681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928615:6876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.492683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928615:6876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.492690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:25.493190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:25.494656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:25.494674Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:25.494676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:25.494681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:25.494687Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [2:7556554402061404788:5920]
2025-10-02T09:30:25.494695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:25.494705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:25.494707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.494710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.494711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.494721Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:25.494723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:25.494727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:25.494768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.494776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.494777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.494780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:25.494782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:25.494823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:25.494829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.494836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.494845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.494856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:25.494870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.494874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.494875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.494880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:25.494889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928650:6876], now have 1 active actors on pipe
2025-10-02T09:30:25.494890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:25.494893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:25.494894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928589:2446], now have 1 active actors on pipe
2025-10-02T09:30:25.494895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:25.494899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:25.494908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:25.494910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:25.494926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.494936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:25.494946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:25.494997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 732
2025-10-02T09:30:25.495011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 732
2025-10-02T09:30:25.495068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.495077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.495096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f0bc28-885ea093-ae3092ff-949920f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:25.495106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.495109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.495112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:25.495119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.495129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:25.495139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.495281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.495291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.495301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.495380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f0bc28-885ea093-ae3092ff-949920f2_0
2025-10-02T09:30:25.495717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368f6a2b-b98bab3a-37c3a3e4-e5bc750a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f0bc28-885ea093-ae3092ff-949920f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:25.498272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Write session: try to update token
2025-10-02T09:30:25.498285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:25.504376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:25.504388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.504394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.504422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:25.504425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:25.504562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:25.504679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:25.504795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:25.504914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:25.505088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:25.505117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:25.510527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|5f0bc28-885ea093-ae3092ff-949920f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:25.512495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:25.512953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.512969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.512983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:25.512985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.512987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:25.512988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:25.512993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.512995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.512997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404783:5920]
2025-10-02T09:30:25.513024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:25.513023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:25.513026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:25.513029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:25.513031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.513032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:25.513137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:25.576490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554402136928658:6694]
2025-10-02T09:30:25.576749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7556554402136928658:6694]
2025-10-02T09:30:25.639820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.640086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:25.640119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928658:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.640259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:25.640362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554402136928658:6694]
2025-10-02T09:30:25.640395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.647963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:25.647972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:25.647988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: error at write: Disconnected sessionId: src_id|5f0bc28-885ea093-ae3092ff-949920f2_0
2025-10-02T09:30:25.648000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.648087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|5f0bc28-885ea093-ae3092ff-949920f2_0 is DEAD
2025-10-02T09:30:25.648221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:25.648230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Write session will restart in 0.006693s
2025-10-02T09:30:25.648262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Write session: Do CDS request
2025-10-02T09:30:25.648266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.651946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.652106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.652117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.652126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.652169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.652211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404862:5923]
2025-10-02T09:30:25.652766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.653015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.653055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.653333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.653380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.653386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.653387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.653388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.653390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.653390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.653392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.653393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.653395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.653397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.653399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.653399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.653404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.653414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.653419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.653423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.653426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.653434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.653438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.653445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.653448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.653452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.653456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.653463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.653469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.653478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.653484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.653489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.653492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.653497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.653502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.653506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.653510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.653517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.653525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.653530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.653534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.653541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.653545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.653549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.653554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.653561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.653565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.653571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.653580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.653586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.653590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.653596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.653628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.656266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.656352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.656362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-10-02T09:30:25.656444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.656464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.656467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.656470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.656793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-10-02T09:30:25.656831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.656836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.656838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.656844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928700:6881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.657197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928700:6881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.659548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928700:6881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.661317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:25.662069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928700:6881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.662082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928700:6881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.662085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928700:6881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.662090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:25.662753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:25.662769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:25.662771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:25.662774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:25.662779Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [2:7556554402061404862:5923]
2025-10-02T09:30:25.662790Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:25.662803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:25.662806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.662808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.662810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.662821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:25.662829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:25.662834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:25.662880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.662888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.662889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.662893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:25.662895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:25.662954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:25.662963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.662973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.662995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.663015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:25.663035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928734:6881], now have 1 active actors on pipe
2025-10-02T09:30:25.663042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928671:2446], now have 1 active actors on pipe
2025-10-02T09:30:25.663047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.663049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.663050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.663061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:25.663072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:25.663075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:25.663079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:25.663081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:25.663078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 733
2025-10-02T09:30:25.663087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 733
2025-10-02T09:30:25.663089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:25.663091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:25.663110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.663117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:25.663119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:25.663141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.663150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.663173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:25.663183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.663188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.663192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:25.663200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.663207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:25.663226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.663364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.663374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.663386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.663462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 36 sessionId: src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0
2025-10-02T09:30:25.663732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0bc28-885ea093-ae3092ff-949920f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:25.666463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Write session: try to update token
2025-10-02T09:30:25.666477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:25.672962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:25.672978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.672980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:25.672982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:25.672988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.672991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.672994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404857:5923]
2025-10-02T09:30:25.673024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:25.673033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.673035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:25.673035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:25.673042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:25.673054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:25.673165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:25.678930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:25.681221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:25.740372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554402136928742:6694]
2025-10-02T09:30:25.740647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7556554402136928742:6694]
2025-10-02T09:30:25.807888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.808233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.808243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.808256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928742:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.808420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:25.808571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554402136928742:6694]
2025-10-02T09:30:25.808605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.808655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:25.808754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: status is not ok: tablet will be restarted right now sessionId: src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0
2025-10-02T09:30:25.808950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0 is DEAD
2025-10-02T09:30:25.809129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:25.809143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Write session will restart in 0.006077s
2025-10-02T09:30:25.809185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Write session: Do CDS request
2025-10-02T09:30:25.809206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.816236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.816488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.816499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-10-02T09:30:25.816594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.816617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.816625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.816628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.817003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.817076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-10-02T09:30:25.817119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.817125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.817127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.817138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928773:6886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.817707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928773:6886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.818842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.819012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.819023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.819033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.819084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.819121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404925:5925]
2025-10-02T09:30:25.819487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928773:6886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.819666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.819991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.820035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.820330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.820379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.820386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.820387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.820388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.820389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.820391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.820392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.820393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.820395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.820396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.820397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.820399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.820403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.820414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.820418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.820422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.820426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.820434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.820439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.820446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.820455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.820459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.820466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.820470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.820481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.820492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.820501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.820507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.820515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.820521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.820528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.820537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.820546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.820557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.820564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.820573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.820581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.820589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.820593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.820602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.820610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.820619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.820627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.820635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.820640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.820647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.820651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.820660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.820695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.831441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928773:6886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.831467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928773:6886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.831473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928773:6886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.831481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:25.835873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:25.837372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:25.837385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:25.837386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:25.837389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:25.837393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [2:7556554402061404925:5925]
2025-10-02T09:30:25.837403Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:25.837414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:25.837417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.837419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.837421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.837433Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:25.837438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:25.837442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:25.837478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.837483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.837484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.837486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:25.837488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:25.837533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:25.837539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.837546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.837551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.837559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:25.837570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.837575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.837576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.837581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:25.837589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:25.837591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:25.837594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:25.837596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:25.837598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:25.837599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:25.837624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.837632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:25.837638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928750:2446], now have 1 active actors on pipe
2025-10-02T09:30:25.837641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928812:6886], now have 1 active actors on pipe
2025-10-02T09:30:25.837641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:25.837702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 734
2025-10-02T09:30:25.837778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.837784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.837800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:25.837805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:25.837761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 734
2025-10-02T09:30:25.837809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:25.837810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:25.837818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:25.837825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:25.837837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.838008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.838016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.838027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:25.838114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0
2025-10-02T09:30:25.838399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985f9949-f7f527d7-78dc17bf-b9018c90_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:25.841044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Write session: try to update token
2025-10-02T09:30:25.841057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:25.849881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:25.849902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:25.849904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:25.849905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:25.849911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.849914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.849917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404920:5925]
2025-10-02T09:30:25.849943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:25.849948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.849949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:25.849951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:25.849956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:25.849959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:25.850070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:25.853076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:25.855810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:25.908821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554402136928824:6694]
2025-10-02T09:30:25.909166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7556554402136928824:6694]
2025-10-02T09:30:25.978800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:25.979077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:25.979087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:25.979114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928824:6694], now have 1 active actors on pipe
2025-10-02T09:30:25.979268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:25.979380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:25.979396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554402136928824:6694]
2025-10-02T09:30:25.979430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:25.979527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0
2025-10-02T09:30:25.979866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:25.979877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Write session will restart in 0.006881s
2025-10-02T09:30:25.979893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Write session: Do CDS request
2025-10-02T09:30:25.979897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:25.979930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0 is DEAD
2025-10-02T09:30:25.988006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:25.988263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.988332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:25.988344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-10-02T09:30:25.988447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:25.988471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:25.988475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:25.988478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:25.988905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-10-02T09:30:25.988937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:25.988938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:25.988939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:25.988943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554402136928853:6890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:25.989339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554402136928853:6890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:25.989890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:25.990049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:25.990059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:25.990068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:25.990118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:25.990157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554402061404991:5928]
2025-10-02T09:30:25.990655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554402136928853:6890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:25.990719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:25.990932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:25.990972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:25.991275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:25.991328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.991334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.991335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.991336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.991338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.991339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.991340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.991341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.991342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.991343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.991344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.991345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.991350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.991360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.991363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.991367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.991371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.991374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.991378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.991382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.991386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.991389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.991393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.991397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.991405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.991411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:25.991417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.991425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:25.991434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.991439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:25.991442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.991452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:25.991456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.991463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:25.991467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.991476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:25.991480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.991489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:25.991493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.991498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:25.991504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.991508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:25.991513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.991520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:25.991525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.991531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:25.991535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.991540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:25.991577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:25.996570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554402136928853:6890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:25.996581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554402136928853:6890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:25.996583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554402136928853:6890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:25.996589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.001318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.002981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.003006Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.003008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.003012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.003017Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [2:7556554402061404991:5928]
2025-10-02T09:30:26.003030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.003047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.003049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.003052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.003054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.003066Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.003075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.003081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.003126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.003133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.003134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.003137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.003139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.003197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.003204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.003216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.003227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.003246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.003266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928889:6890], now have 1 active actors on pipe
2025-10-02T09:30:26.003274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554402136928828:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.003279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.003281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.003283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.003292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.003307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.003315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.003318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.003320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.003323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.003326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.003353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.003363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.003370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.003378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 735
2025-10-02T09:30:26.003380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 735
2025-10-02T09:30:26.003464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.003473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.003496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed3c71fe-be554325-b0c22471-10be4d84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.003505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.003508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.003509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.003516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.003527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.003537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.003665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.003674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.003685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.003750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed3c71fe-be554325-b0c22471-10be4d84_0
2025-10-02T09:30:26.004021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b19c4-ddd4309a-6eef3508-bee16cc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed3c71fe-be554325-b0c22471-10be4d84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.006284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Write session: try to update token
2025-10-02T09:30:26.006298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.014974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.015004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.015005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.015009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.015014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.015017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.015019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554402061404986:5928]
2025-10-02T09:30:26.015044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.015048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.015052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.015059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.015072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.015074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.015160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.017567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|ed3c71fe-be554325-b0c22471-10be4d84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.019592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:26.079762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554406431896193:6694]
2025-10-02T09:30:26.079972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7556554406431896193:6694]
2025-10-02T09:30:26.138261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:26.138494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.138504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.138531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896193:6694], now have 1 active actors on pipe
2025-10-02T09:30:26.138674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:26.138696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:26.138709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:26.138715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554406431896193:6694]
2025-10-02T09:30:26.138730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:26.138759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|ed3c71fe-be554325-b0c22471-10be4d84_0
2025-10-02T09:30:26.138891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|ed3c71fe-be554325-b0c22471-10be4d84_0 is DEAD
2025-10-02T09:30:26.139040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:26.139050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Write session will restart in 0.006813s
2025-10-02T09:30:26.139065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Write session: Do CDS request
2025-10-02T09:30:26.139070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:26.144455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:26.145843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:26.145945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:26.145951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:26.145957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:26.145983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:26.146008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554406356372352:5930]
2025-10-02T09:30:26.146360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:26.146545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:26.146568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:26.146743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:26.146773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.146776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.146777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.146777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.146778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.146778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.146779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.146779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.146780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.146780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.146781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.146781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.146784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.146791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.146793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.146795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.146797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.146800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.146802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.146804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.146806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.146808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.146811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.146813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.146817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.146820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.146824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.146827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.146829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.146832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.146834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.146836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.146839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.146842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.146848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.146852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.146854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.146856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.146858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.146861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.146863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.146865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.146867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.146870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.146873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.146875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.146877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.146880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.146899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:26.147135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.147244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:26.147254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-10-02T09:30:26.147333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.147352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:26.147355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:26.147357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:26.147627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-10-02T09:30:26.147651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:26.147657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:26.147658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:26.147661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554406431896225:6894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:26.147999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554406431896225:6894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:26.149317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554406431896225:6894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:26.154761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554406431896225:6894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:26.154772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554406431896225:6894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:26.154776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554406431896225:6894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:26.154780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.156206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.157655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.157667Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.157668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.157671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.157676Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [2:7556554406356372352:5930]
2025-10-02T09:30:26.157684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.157699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.157703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.157705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.157708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.157718Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.157724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.157729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.157763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.157768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.157769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.157771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.157773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.157815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.157820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.157827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.157839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.157851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.157867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896260:6894], now have 1 active actors on pipe
2025-10-02T09:30:26.157872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896195:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.157876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.157877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.157878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.157886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.157895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.157902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.157905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.157906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.157908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.157910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.157888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 736
2025-10-02T09:30:26.157899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 736
2025-10-02T09:30:26.157928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.157934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.157935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.157943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.157949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.157976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.157983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.157986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.157990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.157995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.158002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.158017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.158145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.158150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.158158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.158224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 36 sessionId: src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0
2025-10-02T09:30:26.158522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3c71fe-be554325-b0c22471-10be4d84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.161165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Write session: try to update token
2025-10-02T09:30:26.161179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.170001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.170019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.170020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.170022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.170027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.170030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.170033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554406356372347:5930]
2025-10-02T09:30:26.170060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.170066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.170068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.170072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.170077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.170081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.170207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.173286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.175310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:26.239036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554406431896270:6694]
2025-10-02T09:30:26.239265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7556554406431896270:6694]
2025-10-02T09:30:26.292407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:26.292643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.292652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.292677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896270:6694], now have 1 active actors on pipe
2025-10-02T09:30:26.292796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:26.292788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:26.292808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:26.292846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: error at write: Disconnected sessionId: src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0
2025-10-02T09:30:26.292992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0 is DEAD
2025-10-02T09:30:26.293120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554406431896270:6694]
2025-10-02T09:30:26.293136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:26.293475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:26.293484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Write session will restart in 0.007724s
2025-10-02T09:30:26.293504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Write session: Do CDS request
2025-10-02T09:30:26.293509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:26.299638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:26.300991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:26.301115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:26.301121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:26.301127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:26.301154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:26.301179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554406356372433:5939]
2025-10-02T09:30:26.301582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:26.301766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:26.301790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:26.302005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:26.302045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.302049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.302050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.302050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.302051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.302051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.302052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.302053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.302053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.302054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.302054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.302055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.302058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.302064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.302066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.302068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.302070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.302072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.302074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.302076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.302078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.302081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.302083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.302085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.302088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.302093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.302096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.302099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.302101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.302106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.302108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.302111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.302114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.302117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.302119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.302122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.302128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.302130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.302132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.302135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.302137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.302140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.302145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.302148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.302150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.302157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.302160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.302165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.302186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.302184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:26.302314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:26.302326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-10-02T09:30:26.302412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.302440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:26.302447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:26.302449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:26.302682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-10-02T09:30:26.302701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:26.302706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:26.302707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:26.302709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554406431896315:6905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:26.303065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554406431896315:6905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:26.304549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554406431896315:6905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:26.310067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554406431896315:6905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:26.310076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554406431896315:6905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:26.310078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554406431896315:6905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:26.310082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.311520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.313005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.313018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.313020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.313024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.313028Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [2:7556554406356372433:5939]
2025-10-02T09:30:26.313036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.313047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.313049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.313051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.313052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.313062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.313065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.313070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.313108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.313112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.313113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.313115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.313116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.313156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.313161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.313168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.313173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.313181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.313195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896284:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.313200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896349:6905], now have 1 active actors on pipe
2025-10-02T09:30:26.313204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.313205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.313206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.313213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.313222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.313226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.313229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.313231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.313232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.313233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.313252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.313259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.313264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.313294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 737
2025-10-02T09:30:26.313321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 737
2025-10-02T09:30:26.313361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.313367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.313380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7730c0ce-e745eb1-919342de-cec60b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.313386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.313388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.313389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.313394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.313400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.313409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.313499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.313503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.313510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.313561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 36 sessionId: src_id|7730c0ce-e745eb1-919342de-cec60b56_0
2025-10-02T09:30:26.313855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5b822e-2ec0ec3b-819aac21-3dd98fcf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7730c0ce-e745eb1-919342de-cec60b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.316190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Write session: try to update token
2025-10-02T09:30:26.316202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.325198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:26.325215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.325220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.325248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:26.325258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:26.325395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:26.325515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:26.325630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:26.325741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:26.325941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:26.325977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:26.328925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|7730c0ce-e745eb1-919342de-cec60b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.331098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:26.331225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.331238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.331256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:26.331337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:26.335650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.335664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.335665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.335666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.335673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.335675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.335677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554406356372428:5939]
2025-10-02T09:30:26.335701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.335704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.335705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.335710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.335713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.335715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.335814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.393157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554406431896367:6694]
2025-10-02T09:30:26.393363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7556554406431896367:6694]
2025-10-02T09:30:26.454239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:26.460529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.460549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.460680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.460732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.460787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.460852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.461161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.461173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.461227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.461278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.461331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.461385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.461420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.461425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.461480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.461531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.461583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.461634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.461670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.461676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.461726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.461779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.461834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.461887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.461923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.461927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.461983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.462036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.462088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.462138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.462184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.462191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.462247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.462299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.462353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.462403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.462437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.462442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.462490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.462544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.462598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.462652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.462710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.462715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.462786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.462836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.462887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.462942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.462981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.462993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.463044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.463094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.463147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.463198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.463249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.463254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.463303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:26.463351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:26.463400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:26.463448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:26.463483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:26.463488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:26.463519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896367:6694], now have 1 active actors on pipe
2025-10-02T09:30:26.463773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:26.463793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:26.463796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:26.463813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554406431896367:6694]
2025-10-02T09:30:26.463815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: error at write: Disconnected sessionId: src_id|7730c0ce-e745eb1-919342de-cec60b56_0
2025-10-02T09:30:26.463849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:26.463947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|7730c0ce-e745eb1-919342de-cec60b56_0 is DEAD
2025-10-02T09:30:26.464059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:26.464068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Write session will restart in 0.005152s
2025-10-02T09:30:26.464095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Write session: Do CDS request
2025-10-02T09:30:26.464101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:26.470221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.470301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:26.470298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:26.470307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-10-02T09:30:26.470403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.470423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:26.470426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:26.470428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:26.470708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-10-02T09:30:26.470732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:26.470733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:26.470734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:26.470737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554406431896397:6910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:26.471096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554406431896397:6910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:26.471474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:26.471569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:26.471576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:26.471582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:26.471606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:26.471631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554406356372523:5947]
2025-10-02T09:30:26.471975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:26.472207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:26.472230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:26.472427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:26.472460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.472465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.472465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.472466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.472468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.472468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.472469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.472469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.472470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.472470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.472471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.472472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.472475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.472481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.472483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.472485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.472487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.472489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.472491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.472493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.472495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.472497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.472499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.472501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.472504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.472508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.472511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.472515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.472517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.472520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.472522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.472525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.472527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.472530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.472532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.472535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.472537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.472539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.472545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.472548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.472550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.472553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.472555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.472558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.472560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.472563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.472566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.472570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.472588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:26.473017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554406431896397:6910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:26.478755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554406431896397:6910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:26.478763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554406431896397:6910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:26.478765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554406431896397:6910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:26.478769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.482049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.483511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.483523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.483524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.483526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.483530Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [2:7556554406356372523:5947]
2025-10-02T09:30:26.483537Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.483548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.483549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.483551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.483552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.483562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.483565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.483569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.483603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.483608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.483609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.483612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.483613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.483653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.483661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.483667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.483672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.483680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.483692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896436:6910], now have 1 active actors on pipe
2025-10-02T09:30:26.483699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896368:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.483703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.483704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.483705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.483712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.483720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.483730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.483731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.483734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.483735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.483736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.483749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.483754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.483755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.483735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 738
2025-10-02T09:30:26.483770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.483737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 738
2025-10-02T09:30:26.483775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.483795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.483799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.483804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.483805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.483810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.483819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.483833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.483938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.483943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.483950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.484018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 36 sessionId: src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0
2025-10-02T09:30:26.484292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7730c0ce-e745eb1-919342de-cec60b56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.486748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Write session: try to update token
2025-10-02T09:30:26.486760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.495331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.495346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.495347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.495349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.495354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.495357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.495359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554406356372518:5947]
2025-10-02T09:30:26.495383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.495387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.495389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.495393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.495396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.495398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.495513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.498450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.500632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:26.564147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554406431896447:6694]
2025-10-02T09:30:26.564397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7556554406431896447:6694]
2025-10-02T09:30:26.611050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:26.611360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.611369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.611395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896447:6694], now have 1 active actors on pipe
2025-10-02T09:30:26.611534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:26.611598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:26.611617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554406431896447:6694]
2025-10-02T09:30:26.611630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:26.611685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0
2025-10-02T09:30:26.611816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0 is DEAD
2025-10-02T09:30:26.611939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:26.611948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Write session will restart in 0.005648s
2025-10-02T09:30:26.611963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Write session: Do CDS request
2025-10-02T09:30:26.611967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:26.617621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:26.618134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.618232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:26.618241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-10-02T09:30:26.618332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.618352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:26.618355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:26.618357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:26.618630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-10-02T09:30:26.618653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:26.618657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:26.618659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:26.618662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554406431896489:6917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:26.618731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:26.618833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:26.618840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:26.618846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:26.618871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:26.618900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554406356372603:5950]
2025-10-02T09:30:26.619005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554406431896489:6917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:26.619253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:26.619531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:26.619553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:26.619729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:26.619761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.619762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.619763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.619763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.619764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.619764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.619765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.619766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.619767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.619767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.619768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.619768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.619772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.619778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.619780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.619782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.619784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.619786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.619788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.619790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.619792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.619795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.619797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.619799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.619803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.619807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.619811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.619813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.619815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.619818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.619820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.619824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.619826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.619829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.619831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.619835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.619837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.619840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.619842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.619845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.619848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.619850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.619853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.619855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.619857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.619860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.619861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.619864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.619882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:26.620344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554406431896489:6917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:26.626624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554406431896489:6917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:26.626633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554406431896489:6917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:26.626635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554406431896489:6917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:26.626638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.628600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.630066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.630078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.630081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.630083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.630087Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [2:7556554406356372603:5950]
2025-10-02T09:30:26.630096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.630107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.630109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.630111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.630112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.630121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.630124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.630129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.630161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.630166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.630167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.630169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.630170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.630209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.630214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.630220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.630226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.630234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.630247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.630252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.630253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.630259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.630266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896460:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.630266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.630269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.630270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.630272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896528:6917], now have 1 active actors on pipe
2025-10-02T09:30:26.630277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.630285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.630287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.630302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.630310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.630321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.630326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 739
2025-10-02T09:30:26.630331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 739
2025-10-02T09:30:26.630410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.630421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.630448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.630456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.630459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.630460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.630466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.630473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.630484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.630599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.630605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.630626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.630707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0
2025-10-02T09:30:26.630919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc3a83-d8b18d26-6bb8e866-18fc9483_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.633086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Write session: try to update token
2025-10-02T09:30:26.633097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.640125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.640140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.640142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.640143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.640148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.640150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.640152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554406356372598:5950]
2025-10-02T09:30:26.640176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.640182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.640183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.640194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.640198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.640201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.640306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.644266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.646265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:26.711597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554406431896536:6694]
2025-10-02T09:30:26.711829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7556554406431896536:6694]
2025-10-02T09:30:26.760427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:26.760638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.760647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.760672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896536:6694], now have 1 active actors on pipe
2025-10-02T09:30:26.760849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554406431896536:6694]
2025-10-02T09:30:26.760872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:26.760921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:26.760929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:26.760972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0
2025-10-02T09:30:26.760987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:26.761116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0 is DEAD
2025-10-02T09:30:26.761256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:26.761266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Write session will restart in 0.009018s
2025-10-02T09:30:26.761287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Write session: Do CDS request
2025-10-02T09:30:26.761292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:26.766649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:26.767956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:26.768054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:26.768061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:26.768066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:26.768092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:26.768118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554406356372673:5952]
2025-10-02T09:30:26.768464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:26.768639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:26.768660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:26.768851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:26.768881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.768885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.768885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.768886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.768886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.768887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.768888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.768888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.768889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.768889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.768890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.768890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.768893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.768900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.768903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.768905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.768907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.768909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.768911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.768914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.768917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.768919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.768921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.768923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.768926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.768930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.768934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.768937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.768939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.768942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.768948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.768951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.768953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.768957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.768959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.768962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.768966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.768968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.768971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.768973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.768975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.768978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.768980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.768984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.768989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.768992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.768994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.768997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.769015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:26.771204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.771273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:26.771283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-10-02T09:30:26.771398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.771416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:26.771422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:26.771425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:26.771679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-10-02T09:30:26.771702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:26.771707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:26.771708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:26.771711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554406431896578:6922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:26.772039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554406431896578:6922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:26.773398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554406431896578:6922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:26.777192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554406431896578:6922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:26.777202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554406431896578:6922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:26.777204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554406431896578:6922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:26.777208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.777752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.779172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.779183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.779185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.779187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.779190Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [2:7556554406356372673:5952]
2025-10-02T09:30:26.779198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.779211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.779217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.779219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.779220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.779231Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.779234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.779239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.779274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.779279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.779280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.779282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.779284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.779326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.779331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.779339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.779348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.779359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.779374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896613:6922], now have 1 active actors on pipe
2025-10-02T09:30:26.779379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896540:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.779383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.779385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.779387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.779394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.779404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.779407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.779409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.779411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.779415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.779417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.779426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 740
2025-10-02T09:30:26.779436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.779433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 740
2025-10-02T09:30:26.779440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.779443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.779465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.779507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.779526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.779533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.779535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.779536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.779541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.779549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.779560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.779665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.779670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.779677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.779727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0
2025-10-02T09:30:26.779959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d38bf3f-dc5077c6-2639df26-ee13aba4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.782126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Write session: try to update token
2025-10-02T09:30:26.782137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.789381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.789396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.789398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.789400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.789406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.789409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.789415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554406356372668:5952]
2025-10-02T09:30:26.789438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.789445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.789446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.789452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.789461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.789463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.789566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.793377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.795340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:26.861094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554406431896625:6694]
2025-10-02T09:30:26.861287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7556554406431896625:6694]
2025-10-02T09:30:26.910026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:26.910270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.910281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.910308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896625:6694], now have 1 active actors on pipe
2025-10-02T09:30:26.910458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:26.910489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554406431896625:6694]
2025-10-02T09:30:26.910509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:26.910523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:26.910599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0
2025-10-02T09:30:26.910776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0 is DEAD
2025-10-02T09:30:26.910894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:26.910902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Write session will restart in 0.005293s
2025-10-02T09:30:26.910915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Write session: Do CDS request
2025-10-02T09:30:26.910919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:26.916677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:26.917191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.917415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:26.917423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-10-02T09:30:26.917499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:26.917519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:26.917525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:26.917528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:26.917798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:26.917890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-10-02T09:30:26.917912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:26.917918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:26.917923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:26.917929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:26.917927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:26.917931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:26.917935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554406431896657:6926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:26.917966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:26.917994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554406356372744:5955]
2025-10-02T09:30:26.918347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:26.918425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554406431896657:6926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:26.918564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:26.918605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:26.918825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:26.918857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.918861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.918862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.918862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.918863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.918864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.918865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.918865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.918866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.918866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.918867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.918869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.918872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.918878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.918881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.918883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.918886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.918888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.918890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.918892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.918894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.918897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.918899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.918901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.918905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.918909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:26.918912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.918915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:26.918918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.918920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:26.918924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.918927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:26.918929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.918932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:26.918935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.918937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:26.918941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.918944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:26.918946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.918949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:26.918955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.918957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:26.918960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.918966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.918968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.918971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.918975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.918981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.919009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:26.920000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554406431896657:6926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:26.926247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554406431896657:6926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:26.926261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554406431896657:6926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:26.926263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554406431896657:6926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:26.926270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:26.927895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:26.929409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:26.929421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:26.929422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:26.929425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:26.929429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [2:7556554406356372744:5955]
2025-10-02T09:30:26.929439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:26.929450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:26.929455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.929457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.929459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.929469Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:26.929473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:26.929477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:26.929518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.929522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.929525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.929527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:26.929529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:26.929568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:26.929573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.929580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:26.929586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:26.929598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:26.929614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896696:6926], now have 1 active actors on pipe
2025-10-02T09:30:26.929621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.929623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.929624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.929631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:26.929640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554406431896626:2446], now have 1 active actors on pipe
2025-10-02T09:30:26.929646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:26.929650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:26.929652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:26.929653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:26.929656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:26.929658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:26.929675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.929681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:26.929689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:26.929689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 741
2025-10-02T09:30:26.929718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 741
2025-10-02T09:30:26.929739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.929746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.929761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:26.929767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:26.929770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:26.929771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:26.929777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:26.929785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:26.929798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.929920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:26.929925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:26.929933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:26.929996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0
2025-10-02T09:30:26.930277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f646c0-9359d846-3f0a35a6-88682a7f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:26.932550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Write session: try to update token
2025-10-02T09:30:26.932561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:26.939808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:26.939823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:26.939824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:26.939827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:26.939833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.939837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.939841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554406356372739:5955]
2025-10-02T09:30:26.939871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:26.939879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:26.939881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:26.939896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:26.939907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:26.939911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:26.939999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:26.943764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:26.945753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.010607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726863999:6694]
2025-10-02T09:30:27.010877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7556554410726863999:6694]
2025-10-02T09:30:27.066678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.067011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.067025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.067055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726863999:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.067296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726863999:6694]
2025-10-02T09:30:27.067308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:27.067311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:27.067320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.067363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: error at write: Disconnected sessionId: src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0
2025-10-02T09:30:27.067498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0 is DEAD
2025-10-02T09:30:27.067613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.067657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:27.067668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Write session will restart in 0.005368s
2025-10-02T09:30:27.067691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Write session: Do CDS request
2025-10-02T09:30:27.067697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.074180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.074170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.074252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.074260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-10-02T09:30:27.074362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.074383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.074388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.074391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.074647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-10-02T09:30:27.074671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.074675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.074676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.074679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864033:6930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.075031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864033:6930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.075704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.075838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.075844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.075850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.075879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.075906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340111:5957]
2025-10-02T09:30:27.076269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.076466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.076489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.076485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864033:6930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.076676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.076706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.076710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.076711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.076711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.076713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.076714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.076715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.076715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.076716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.076716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.076720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.076726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.076728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.076730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.076732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.076734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.076736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.076738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.076740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.076743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.076745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.076747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.076751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.076755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.076758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.076762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.076764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.076767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.076769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.076772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.076775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.076778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.076780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.076786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.076788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.076791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.076797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.076809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.076812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.076814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.076818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.076821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.076823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.076826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.076828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.076830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.076847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.082460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864033:6930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.082470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864033:6930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.082472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864033:6930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.082477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.085520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.086929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.086940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.086941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.086943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.086947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [2:7556554410651340111:5957]
2025-10-02T09:30:27.086955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.086968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.086969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.086971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.086973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.086992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.086999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.087005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.087039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.087044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.087045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.087047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.087049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.087091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.087096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.087104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.087112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.087124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.087138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864001:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.087143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864072:6930], now have 1 active actors on pipe
2025-10-02T09:30:27.087147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.087148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.087150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.087157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.087169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.087178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.087165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 742
2025-10-02T09:30:27.087179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.087181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.087185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.087186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.087169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 742
2025-10-02T09:30:27.087200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.087201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.087210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.087212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.087214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.087239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.087246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.087248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.087249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.087253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.087261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.087275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.087363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.087368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.087375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.087436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 36 sessionId: src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0
2025-10-02T09:30:27.087687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e785db-8287be50-8fdca9e9-6a7c3443_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.089996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Write session: try to update token
2025-10-02T09:30:27.090008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.096887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.096898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.096900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.096901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.096907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.096910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.096917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340106:5957]
2025-10-02T09:30:27.096942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.096949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.096951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.096960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.096970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.096974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.097076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.102355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.104682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.167289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726864081:6694]
2025-10-02T09:30:27.167658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7556554410726864081:6694]
2025-10-02T09:30:27.215399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.215719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.215727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.215740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864081:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.215966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726864081:6694]
2025-10-02T09:30:27.215978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:27.215981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:27.215991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.216043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: error at write: Disconnected sessionId: src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0
2025-10-02T09:30:27.216184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0 is DEAD
2025-10-02T09:30:27.216252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.216340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:27.216347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Write session will restart in 0.005488s
2025-10-02T09:30:27.216366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Write session: Do CDS request
2025-10-02T09:30:27.216372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.222237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.223112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.223236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.223247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-10-02T09:30:27.223284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.223341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.223368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.223376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.223380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.223383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.223389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.223394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.223419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.223442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340185:5960]
2025-10-02T09:30:27.223659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-10-02T09:30:27.223680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.223684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.223686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.223688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864116:6935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.223781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.223949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.223971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.224031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864116:6935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.224139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.224179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.224183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.224183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.224184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.224184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.224185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.224186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.224186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.224187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.224187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.224188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.224189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.224191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.224197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.224199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.224201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.224203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.224214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.224216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.224218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.224220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.224222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.224224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.224226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.224230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.224234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.224237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.224240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.224242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.224245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.224247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.224251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.224255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.224258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.224260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.224263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.224265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.224269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.224271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.224274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.224276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.224279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.224281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.224284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.224286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.224288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.224292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.224294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.224312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.225652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864116:6935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.229540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864116:6935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.229547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864116:6935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.229549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864116:6935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.229553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.231738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.233152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.233162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.233164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.233166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.233170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [2:7556554410651340185:5960]
2025-10-02T09:30:27.233179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.233190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.233191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.233192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.233193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.233202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.233207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.233211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.233245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.233249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.233251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.233253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.233254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.233299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.233304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.233311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.233316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.233324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.233337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864155:6935], now have 1 active actors on pipe
2025-10-02T09:30:27.233342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864083:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.233346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.233347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.233348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.233356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.233366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.233368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.233371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.233372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.233377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.233379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.233371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 743
2025-10-02T09:30:27.233372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 743
2025-10-02T09:30:27.233395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.233399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.233401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.233410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.233415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.233443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.233450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.233453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.233454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.233459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.233464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.233476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.233572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.233576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.233583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.233648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 36 sessionId: src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0
2025-10-02T09:30:27.233864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02fea58-99584acd-66ee3404-5dfa9e3a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.236027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Write session: try to update token
2025-10-02T09:30:27.236038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.243044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.243056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.243058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.243059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.243064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.243068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.243071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340180:5960]
2025-10-02T09:30:27.243092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.243096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.243099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.243108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.243113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.243116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.243217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.246695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.248716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.316298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726864162:6694]
2025-10-02T09:30:27.316586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7556554410726864162:6694]
2025-10-02T09:30:27.362406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.362572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.362580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.362601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864162:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.362799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.362831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:27.362832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:27.362870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: error at write: Disconnected sessionId: src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0
2025-10-02T09:30:27.363017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0 is DEAD
2025-10-02T09:30:27.363132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726864162:6694]
2025-10-02T09:30:27.363148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:27.363156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Write session will restart in 0.006550s
2025-10-02T09:30:27.363171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Write session: Do CDS request
2025-10-02T09:30:27.363178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.363254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.369247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.370657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.370753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.370759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.370764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.370790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.370813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340293:5974]
2025-10-02T09:30:27.371119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.371170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.371224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.371231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-10-02T09:30:27.371306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.371325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.371328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.371331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.371367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.371390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.371575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.371582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-10-02T09:30:27.371603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.371607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.371608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.371606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.371611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864225:6946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.371610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.371610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.371611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.371612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.371612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.371613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.371613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.371614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.371615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.371615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.371616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.371619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.371625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.371627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.371629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.371632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.371634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.371636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.371638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.371640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.371643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.371645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.371647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.371651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.371655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.371658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.371661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.371664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.371666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.371669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.371672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.371674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.371678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.371680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.371683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.371686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.371689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.371691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.371693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.371696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.371699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.371701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.371704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.371707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.371709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.371711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.371714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.371730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.371942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864225:6946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.373527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864225:6946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.378747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864225:6946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.378755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864225:6946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.378757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864225:6946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.378761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.379481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.381011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.381021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.381022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.381026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.381030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [2:7556554410651340293:5974]
2025-10-02T09:30:27.381037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.381048Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.381050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.381051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.381052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.381061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.381064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.381068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.381101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.381106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.381107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.381109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.381112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.381169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.381175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.381182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.381191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.381202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.381215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864258:6946], now have 1 active actors on pipe
2025-10-02T09:30:27.381218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864189:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.381221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.381224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.381226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.381234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.381243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.381252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.381252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.381255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.381257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.381258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.381272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.381274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.381276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.381284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 744
2025-10-02T09:30:27.381295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 744
2025-10-02T09:30:27.381348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.381353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.381369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adc2efbd-1f776912-137eec77-36c1a904_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.381376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.381378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.381379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.381384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.381394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.381404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.381498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.381502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.381510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.381563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 36 sessionId: src_id|adc2efbd-1f776912-137eec77-36c1a904_0
2025-10-02T09:30:27.381802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e1ad78-57b1d9de-6ea4e1e1-8bc303a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|adc2efbd-1f776912-137eec77-36c1a904_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.384065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Write session: try to update token
2025-10-02T09:30:27.384077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.391113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.391125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.391126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.391127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.391133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.391136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.391138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340288:5974]
2025-10-02T09:30:27.391166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.391167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.391170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.391170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.391171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.391172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.391330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.395861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|adc2efbd-1f776912-137eec77-36c1a904_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.397901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.463218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726864266:6694]
2025-10-02T09:30:27.463419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7556554410726864266:6694]
2025-10-02T09:30:27.505883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.506128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.506137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.506163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864266:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.506307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.506366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726864266:6694]
2025-10-02T09:30:27.506370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:27.506387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.506435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: status is not ok: tablet will be restarted right now sessionId: src_id|adc2efbd-1f776912-137eec77-36c1a904_0
2025-10-02T09:30:27.506572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|adc2efbd-1f776912-137eec77-36c1a904_0 is DEAD
2025-10-02T09:30:27.506710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:27.506718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Write session will restart in 0.009591s
2025-10-02T09:30:27.506731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Write session: Do CDS request
2025-10-02T09:30:27.506736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.511805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.512895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.512995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.513001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.513006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.513032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.513055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340367:5976]
2025-10-02T09:30:27.513395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.513543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.513565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.513738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.513766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.513770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.513770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.513771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.513771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.513772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.513773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.513773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.513774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.513774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.513775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.513776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.513779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.513786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.513788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.513790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.513792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.513794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.513796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.513798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.513800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.513803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.513805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.513806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.513810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.513814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.513817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.513821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.513824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.513826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.513828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.513831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.513833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.513835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.513838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.513841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.513843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.513846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.513847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.513850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.513852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.513855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.513858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.513861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.513864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.513866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.513868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.513872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.513889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.517108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.517179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.517189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-10-02T09:30:27.517268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.517287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.517293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.517295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.517561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-10-02T09:30:27.517585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.517589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.517591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.517594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864308:6950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.517946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864308:6950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.519358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864308:6950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.520881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864308:6950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.520890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864308:6950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.520893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864308:6950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.520897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.521350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.522723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.522733Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.522734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.522736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.522740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [2:7556554410651340367:5976]
2025-10-02T09:30:27.522747Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.522759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.522763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.522765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.522766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.522808Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.522814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.522818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.522852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.522856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.522857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.522859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.522860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.522899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.522903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.522909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.522914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.522925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.522938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864343:6950], now have 1 active actors on pipe
2025-10-02T09:30:27.522943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864267:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.522947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.522948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.522950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.522953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 745
2025-10-02T09:30:27.522958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 745
2025-10-02T09:30:27.522961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.522971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.522979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.522990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.522991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.522998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.522999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.523014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.523019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.523026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.523034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.523038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.523052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.523058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.523060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.523061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.523067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.523074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.523086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.523178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.523182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.523189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.523244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 36 sessionId: src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0
2025-10-02T09:30:27.523416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adc2efbd-1f776912-137eec77-36c1a904_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.525614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Write session: try to update token
2025-10-02T09:30:27.525624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.532271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.532283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.532285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.532286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.532293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.532296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.532298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340362:5976]
2025-10-02T09:30:27.532319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.532323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.532324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.532330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.532333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.532336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.532442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.536214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.538367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.606556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726864362:6694]
2025-10-02T09:30:27.606690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7556554410726864362:6694]
2025-10-02T09:30:27.648263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.648545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.648555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.648582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864362:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.648796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.648817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726864362:6694]
2025-10-02T09:30:27.648839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.648854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:27.648857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:27.648906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0
2025-10-02T09:30:27.649068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0 is DEAD
2025-10-02T09:30:27.649206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:27.649217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Write session will restart in 0.008363s
2025-10-02T09:30:27.649236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Write session: Do CDS request
2025-10-02T09:30:27.649241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.654413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.655511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.655642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.655650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.655659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.655703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.655736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340454:5979]
2025-10-02T09:30:27.656104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.656272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.656296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.656476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.656504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.656508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.656509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.656509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.656510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.656510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.656511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.656511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.656512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.656512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.656513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.656513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.656516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.656523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.656525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.656527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.656530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.656533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.656535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.656537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.656539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.656541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.656543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.656545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.656549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.656553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.656556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.656558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.656560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.656563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.656565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.656568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.656570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.656573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.656575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.656579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.656581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.656584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.656586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.656589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.656591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.656594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.656596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.656603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.656605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.656608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.656610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.656613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.656634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.658137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.658246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.658256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-10-02T09:30:27.658367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.658387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.658392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.658395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.658670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-10-02T09:30:27.658696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.658701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.658702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.658705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864403:6955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.659060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864403:6955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.660823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864403:6955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.663579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864403:6955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.663592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864403:6955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.663595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864403:6955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.663602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.664111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.665551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.665561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.665563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.665565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.665568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [2:7556554410651340454:5979]
2025-10-02T09:30:27.665577Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.665587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.665588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.665591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.665592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.665602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.665604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.665609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.665647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.665652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.665653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.665655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.665656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.665697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.665701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.665707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.665713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.665722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.665737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864363:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.665743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864438:6955], now have 1 active actors on pipe
2025-10-02T09:30:27.665746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.665747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.665748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.665755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.665766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.665773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.665775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.665777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.665780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.665781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.665792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.665797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.665783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 746
2025-10-02T09:30:27.665808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.665784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 746
2025-10-02T09:30:27.665815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.665817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.665834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12c16495-f35cab3a-11794822-d8407b77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.665841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.665844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.665848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.665853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.665862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.665873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.665981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.665986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.665993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.666050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 36 sessionId: src_id|12c16495-f35cab3a-11794822-d8407b77_0
2025-10-02T09:30:27.666307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e332d4-6bde69b0-ca5248ea-81e98e84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12c16495-f35cab3a-11794822-d8407b77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.668673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Write session: try to update token
2025-10-02T09:30:27.668687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.675165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.675175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.675176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.675178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.675183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.675188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.675190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340449:5979]
2025-10-02T09:30:27.675213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.675217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.675219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.675225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.675230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.675234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.675327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.680718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|12c16495-f35cab3a-11794822-d8407b77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.682678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.748862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726864446:6694]
2025-10-02T09:30:27.749053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7556554410726864446:6694]
2025-10-02T09:30:27.794378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.794647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.794660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.794675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864446:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.794856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726864446:6694]
2025-10-02T09:30:27.794877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.794901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:27.794911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:27.795037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: error at write: Disconnected sessionId: src_id|12c16495-f35cab3a-11794822-d8407b77_0
2025-10-02T09:30:27.795130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.795220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|12c16495-f35cab3a-11794822-d8407b77_0 is DEAD
2025-10-02T09:30:27.795328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:27.795333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Write session will restart in 0.009317s
2025-10-02T09:30:27.795349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Write session: Do CDS request
2025-10-02T09:30:27.795354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.801206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.802359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.802464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.802470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.802476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.802504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.802530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340530:5981]
2025-10-02T09:30:27.802909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.803103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.803149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.803375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.803425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.803430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.803430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.803431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.803431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.803432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.803432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.803433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.803434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.803434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.803435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.803435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.803438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.803445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.803447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.803449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.803451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.803454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.803456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.803458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.803460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.803462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.803466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.803468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.803473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.803478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.803481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.803484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.803486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.803489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.803491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.803493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.803496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.803499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.803502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.803504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.803507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.803510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.803514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.803517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.803519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.803522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.803527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.803530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.803532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.803535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.803540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.803543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.803560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.805255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.805327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.805339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-10-02T09:30:27.805527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.805549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.805556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.805560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.805904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-10-02T09:30:27.805935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.805940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.805942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.805947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864495:6960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.806422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864495:6960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.807832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864495:6960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.811084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864495:6960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.811096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864495:6960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.811100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864495:6960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.811105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.811569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.813019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.813030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.813031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.813033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.813039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [2:7556554410651340530:5981]
2025-10-02T09:30:27.813047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.813057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.813061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.813062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.813064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.813075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.813082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.813087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.813124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.813129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.813130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.813132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.813133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.813217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.813221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.813228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.813237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.813250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.813265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864530:6960], now have 1 active actors on pipe
2025-10-02T09:30:27.813271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864454:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.813275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.813276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.813278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.813288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.813281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 747
2025-10-02T09:30:27.813299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.813308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.813310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.813312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.813306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 747
2025-10-02T09:30:27.813315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.813317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.813333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.813339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.813348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.813349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.813352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.813384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.813392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.813396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.813402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.813408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.813414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.813425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.813547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.813552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.813560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.813612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 36 sessionId: src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0
2025-10-02T09:30:27.813881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c16495-f35cab3a-11794822-d8407b77_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.816325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Write session: try to update token
2025-10-02T09:30:27.816338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.823055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.823066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.823067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.823069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.823074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.823077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.823079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340525:5981]
2025-10-02T09:30:27.823104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.823111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.823112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.823112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.823116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.823119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.823224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.828108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.830215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:27.894834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554410726864541:6694]
2025-10-02T09:30:27.895020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7556554410726864541:6694]
2025-10-02T09:30:27.941974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:27.942234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.942246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.942278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864541:6694], now have 1 active actors on pipe
2025-10-02T09:30:27.942502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554410726864541:6694]
2025-10-02T09:30:27.942525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:27.942541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:27.942544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:27.942555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:27.942593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: error at write: Disconnected sessionId: src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0
2025-10-02T09:30:27.942751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0 is DEAD
2025-10-02T09:30:27.942857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:27.942862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Write session will restart in 0.009965s
2025-10-02T09:30:27.942882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Write session: Do CDS request
2025-10-02T09:30:27.942886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:27.948647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:27.949971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:27.950085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:27.950091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:27.950097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:27.950133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:27.950158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554410651340609:5984]
2025-10-02T09:30:27.950531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:27.950746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:27.950779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:27.950966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:27.951008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.951011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.951012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.951013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.951013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.951014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.951014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.951015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.951015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.951016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.951016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.951017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.951020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.951027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.951029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.951031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.951034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.951036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.951038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.951040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.951042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.951044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.951046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.951048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.951052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.951057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:27.951061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.951064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:27.951066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.951069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:27.951071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.951073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:27.951076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.951079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:27.951081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.951083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:27.951086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.951088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:27.951090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.951093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:27.951095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.951098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:27.951100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.951103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.951105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.951107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.951109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.951112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.951130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:27.954254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.954342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:27.954355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-10-02T09:30:27.954471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:27.954493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:27.954498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:27.954501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:27.954777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-10-02T09:30:27.954800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:27.954805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:27.954806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:27.954811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554410726864588:6964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:27.955173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554410726864588:6964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:27.956754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554410726864588:6964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:27.958773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:27.958786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554410726864588:6964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:27.958796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554410726864588:6964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:27.958799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554410726864588:6964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:27.958803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:27.960201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:27.960211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:27.960212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:27.960215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:27.960219Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [2:7556554410651340609:5984]
2025-10-02T09:30:27.960227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:27.960239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:27.960242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.960246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.960248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.960260Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:27.960270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:27.960279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:27.960323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.960327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.960328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.960330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:27.960331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:27.960372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:27.960378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.960385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:27.960390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:27.960399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:27.960410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.960412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.960413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.960417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:27.960426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864542:2446], now have 1 active actors on pipe
2025-10-02T09:30:27.960426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:27.960429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:27.960431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:27.960432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554410726864619:6964], now have 1 active actors on pipe
2025-10-02T09:30:27.960436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:27.960444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:27.960446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:27.960452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 748
2025-10-02T09:30:27.960463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.960455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 748
2025-10-02T09:30:27.960469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:27.960470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:27.960548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.960554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.960572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:27.960579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:27.960582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:27.960583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:27.960587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:27.960596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:27.960606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.960732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:27.960742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:27.960762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:27.960828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 36 sessionId: src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0
2025-10-02T09:30:27.961089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81ce2bd-3c9b34b-b2d35ba7-33504eb3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:27.963423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Write session: try to update token
2025-10-02T09:30:27.963435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:27.969872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:27.969883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:27.969885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:27.969886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:27.969892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.969894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.969899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554410651340604:5984]
2025-10-02T09:30:27.969924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:27.969928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:27.969931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:27.969941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:27.969949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:27.969953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:27.970047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:27.975057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:27.977122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.042804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021831923:6694]
2025-10-02T09:30:28.042965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7556554415021831923:6694]
2025-10-02T09:30:28.088641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:28.088885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.088895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.088924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021831923:6694], now have 1 active actors on pipe
2025-10-02T09:30:28.089121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:28.089113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:28.089153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021831923:6694]
2025-10-02T09:30:28.089157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:28.089159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:28.089210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: error at write: Disconnected sessionId: src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0
2025-10-02T09:30:28.089371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0 is DEAD
2025-10-02T09:30:28.089545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:28.089555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Write session will restart in 0.007825s
2025-10-02T09:30:28.089578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Write session: Do CDS request
2025-10-02T09:30:28.089584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:28.095613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:28.096898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:28.097007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:28.097014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:28.097030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:28.097062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:28.097089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554414946307983:5986]
2025-10-02T09:30:28.097440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:28.097625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:28.097651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:28.097834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:28.097874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.097879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.097880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.097881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.097882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.097882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.097883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.097884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.097884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.097886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.097887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.097887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.097890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.097898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.097900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.097902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.097904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.097906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.097908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.097910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.097912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.097914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.097916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.097918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.097922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.097926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.097930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.097932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.097934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.097937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.097939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.097942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.097945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.097947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.097950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.097952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.097954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.097957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.097959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.097962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.097965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.097968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.097970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.097972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.097975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.097977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.097979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.097982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.098000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:28.098185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.098267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:28.098277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-10-02T09:30:28.098385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.098409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:28.098417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:28.098420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:28.098719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-10-02T09:30:28.098745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:28.098750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:28.098751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:28.098754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554415021831967:6968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:28.099138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554415021831967:6968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:28.100938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554415021831967:6968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:28.105332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554415021831967:6968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:28.105346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554415021831967:6968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:28.105349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554415021831967:6968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:28.105356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:28.105953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:28.107559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:28.107576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:28.107578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:28.107582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:28.107587Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [2:7556554414946307983:5986]
2025-10-02T09:30:28.107601Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:28.107618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:28.107621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.107625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.107627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.107643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:28.107653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:28.107659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:28.107767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.107774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.107776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.107777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:28.107779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:28.107821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:28.107826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.107836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.107845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.107865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:28.107884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.107889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.107891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.107901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:28.107913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832002:6968], now have 1 active actors on pipe
2025-10-02T09:30:28.107913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:28.107915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:28.107917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:28.107920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021831924:2446], now have 1 active actors on pipe
2025-10-02T09:30:28.107928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:28.107942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:28.107949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:28.107973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.107985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:28.108006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:28.107999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 749
2025-10-02T09:30:28.108002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 749
2025-10-02T09:30:28.108148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.108159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.108186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:28.108199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.108202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.108204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:28.108212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.108222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:28.108240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.108443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.108452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.108466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.108566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0
2025-10-02T09:30:28.108861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73632e8c-6e8ebf1a-72530463-17ef41a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:28.111235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Write session: try to update token
2025-10-02T09:30:28.111247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:28.118313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:28.118331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.118333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:28.118335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:28.118342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.118347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.118353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554414946307978:5986]
2025-10-02T09:30:28.118384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:28.118385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:28.118391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.118392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:28.118393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:28.118397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:28.118515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:28.122840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:28.125179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.189237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021832012:6694]
2025-10-02T09:30:28.189460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7556554415021832012:6694]
2025-10-02T09:30:28.243284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:28.243504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.243518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.243547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832012:6694], now have 1 active actors on pipe
2025-10-02T09:30:28.243789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:28.243801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:28.243824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021832012:6694]
2025-10-02T09:30:28.243844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:28.243849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0
2025-10-02T09:30:28.243912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:28.243986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0 is DEAD
2025-10-02T09:30:28.244126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:28.244135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Write session will restart in 0.006667s
2025-10-02T09:30:28.244155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Write session: Do CDS request
2025-10-02T09:30:28.244160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:28.250750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:28.252143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.252231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:28.252248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:28.252258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-10-02T09:30:28.252369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:28.252377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:28.252386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:28.252382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.252413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:28.252419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:28.252421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:28.252430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:28.252466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554414946308063:5989]
2025-10-02T09:30:28.252739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-10-02T09:30:28.252769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:28.252775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:28.252776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:28.252781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554415021832053:6973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:28.253376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554415021832053:6973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:28.255496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:28.255548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554415021832053:6973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:28.255796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:28.255843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:28.256177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:28.256245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.256254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.256255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.256256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.256257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.256258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.256259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.256260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.256261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.256262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.256263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.256264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.256269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.256280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.256283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.256288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.256292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.256295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.256299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.256303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.256307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.256314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.256317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.256321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.256329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.256335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.256340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.256346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.256349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.256354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.256358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.256367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.256372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.256377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.256381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.256387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.256392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.256397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.256406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.256410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.256416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.256421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.256425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.256433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.256437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.256442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.256445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.256451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.256486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:28.260977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554415021832053:6973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:28.260988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554415021832053:6973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:28.260991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554415021832053:6973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:28.260997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:28.267045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:28.268650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:28.268662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:28.268665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:28.268670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:28.268675Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [2:7556554414946308063:5989]
2025-10-02T09:30:28.268685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:28.268697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:28.268699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.268702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.268704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.268716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:28.268725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:28.268731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:28.268786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.268792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.268793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.268796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:28.268811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:28.268869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:28.268874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.268882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.268888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.268900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:28.268916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832013:2446], now have 1 active actors on pipe
2025-10-02T09:30:28.268923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.268924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.268925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.268935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:28.268943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832092:6973], now have 1 active actors on pipe
2025-10-02T09:30:28.268950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:28.268945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:28.268958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:28.268960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:28.268965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:28.268968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:28.268991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.268996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:28.269012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:28.269023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.268987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 750
2025-10-02T09:30:28.269026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.269000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 750
2025-10-02T09:30:28.269048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:28.269058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.269061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.269062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:28.269070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.269077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:28.269087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.269231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.269238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.269253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.269355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 36 sessionId: src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0
2025-10-02T09:30:28.269727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3db6ff-6f14a02e-8f9def2d-8cc870cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:28.274338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Write session: try to update token
2025-10-02T09:30:28.274350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:28.278643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:28.278653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.278660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.278692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:28.278702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:28.278840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:28.278975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:28.279114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:28.279245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:28.279418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:28.279456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:28.285559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:28.289340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:28.289352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.289354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:28.289355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:28.289360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.289363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.289366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554414946308058:5989]
2025-10-02T09:30:28.289389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:28.289393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.289394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:28.289396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:28.289400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:28.289403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:28.289506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:28.291685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.343870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021832099:6694]
2025-10-02T09:30:28.344106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7556554415021832099:6694]
2025-10-02T09:30:28.408878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:28.409156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.409166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.409181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832099:6694], now have 1 active actors on pipe
2025-10-02T09:30:28.409334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:28.409394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021832099:6694]
2025-10-02T09:30:28.409406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:28.409417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:28.409461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0
2025-10-02T09:30:28.409598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0 is DEAD
2025-10-02T09:30:28.409705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:28.409714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Write session will restart in 0.006449s
2025-10-02T09:30:28.409730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Write session: Do CDS request
2025-10-02T09:30:28.409735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:28.415943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:28.417124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:28.417161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.417233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:28.417241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-10-02T09:30:28.417259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:28.417268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:28.417275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:28.417309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:28.417336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554414946308178:6003]
2025-10-02T09:30:28.417530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.417556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:28.417562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:28.417566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:28.417709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:28.417851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-10-02T09:30:28.417875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:28.417880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:28.417876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:28.417880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:28.417884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554415021832169:6984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:28.417901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:28.418090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:28.418122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.418126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.418127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.418127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.418128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.418129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.418129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.418130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.418130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.418131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.418131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.418132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.418135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.418141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.418143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.418145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.418148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.418150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.418152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.418154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.418156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.418158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.418160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.418162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.418166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.418170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.418173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.418176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.418178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.418181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.418183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.418186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.418188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.418191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.418193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.418196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.418200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.418207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.418211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.418216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.418219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.418222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.418224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.418227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.418229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.418232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.418234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.418237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.418254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:28.418240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554415021832169:6984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:28.419685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554415021832169:6984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:28.424261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554415021832169:6984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:28.424270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554415021832169:6984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:28.424272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554415021832169:6984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:28.424276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:28.425975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:28.427425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:28.427438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:28.427440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:28.427443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:28.427448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [2:7556554414946308178:6003]
2025-10-02T09:30:28.427459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:28.427474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:28.427475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.427477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.427478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.427488Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:28.427494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:28.427498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:28.427529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.427534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.427535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.427537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:28.427538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:28.427577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:28.427582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.427589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.427594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.427604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:28.427620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832126:2446], now have 1 active actors on pipe
2025-10-02T09:30:28.427622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832203:6984], now have 1 active actors on pipe
2025-10-02T09:30:28.427626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.427627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.427628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.427661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 751
2025-10-02T09:30:28.427662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 751
2025-10-02T09:30:28.427637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:28.427645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:28.427650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:28.427652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:28.427653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:28.427654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:28.427654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:28.427668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.427670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:28.427673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:28.427691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.427694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.427715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:28.427725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.427727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.427728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:28.427733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.427738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:28.427745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.427841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.427846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.427854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.427922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0
2025-10-02T09:30:28.428148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbff21a-e6155dad-e83972bf-c81151a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:28.430536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Write session: try to update token
2025-10-02T09:30:28.430548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:28.437462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:28.437477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.437478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:28.437480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:28.437485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.437491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.437494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554414946308173:6003]
2025-10-02T09:30:28.437517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:28.437520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:28.437521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.437523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:28.437523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:28.437526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:28.437912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:28.443554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:28.446384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.509766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021832210:6694]
2025-10-02T09:30:28.510024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7556554415021832210:6694]
2025-10-02T09:30:28.561886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:28.562109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.562118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.562131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832210:6694], now have 1 active actors on pipe
2025-10-02T09:30:28.562255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:28.562326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:28.562331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:28.562374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021832210:6694]
2025-10-02T09:30:28.562397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0
2025-10-02T09:30:28.562555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0 is DEAD
2025-10-02T09:30:28.562705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:28.562715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Write session will restart in 0.009010s
2025-10-02T09:30:28.562733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Write session: Do CDS request
2025-10-02T09:30:28.562738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:28.568713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:28.569898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:28.569999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:28.570006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:28.570012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:28.570036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:28.570062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554414946308270:6006]
2025-10-02T09:30:28.570415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:28.570585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:28.570609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:28.570793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:28.570823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.570827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.570828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.570828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.570829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.570830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.570830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.570831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.570831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.570832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.570833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.570833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.570836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.570843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.570845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.570847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.570850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.570852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.570854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.570856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.570858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.570860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.570862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.570864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.570869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.570874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.570877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.570880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.570884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.570887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.570889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.570892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.570895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.570899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.570901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.570904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.570907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.570913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.570915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.570918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.570920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.570924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.570927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.570930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.570933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.570939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.570941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.570943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.570960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:28.573142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.573241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:28.573252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-10-02T09:30:28.573355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.573379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:28.573387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:28.573391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:28.573716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-10-02T09:30:28.573743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:28.573748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:28.573750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:28.573754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554415021832259:6988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:28.574188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554415021832259:6988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:28.575820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554415021832259:6988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:28.578266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554415021832259:6988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:28.578277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554415021832259:6988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:28.578280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554415021832259:6988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:28.578286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:28.578782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:28.580203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:28.580214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:28.580215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:28.580217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:28.580221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [2:7556554414946308270:6006]
2025-10-02T09:30:28.580230Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:28.580241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:28.580243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.580244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.580247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.580261Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:28.580270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:28.580276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:28.580324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.580331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.580332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.580335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:28.580336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:28.580383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:28.580388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.580396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.580402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.580413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:28.580428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832294:6988], now have 1 active actors on pipe
2025-10-02T09:30:28.580434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832213:2446], now have 1 active actors on pipe
2025-10-02T09:30:28.580437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.580439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.580440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.580449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:28.580459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:28.580459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:28.580461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:28.580462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:28.580471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:28.580473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:28.580489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.580497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:28.580488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 752
2025-10-02T09:30:28.580512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:28.580524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.580491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 752
2025-10-02T09:30:28.580528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.580558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb84bae5-848ff141-6d4bf962-83515301_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:28.580566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.580569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.580573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:28.580579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.580587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:28.580598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.580705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.580709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.580717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.580784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb84bae5-848ff141-6d4bf962-83515301_0
2025-10-02T09:30:28.581051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5edd18b-e64bc858-9ba04139-a66dd71d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb84bae5-848ff141-6d4bf962-83515301_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:28.583552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Write session: try to update token
2025-10-02T09:30:28.583566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:28.590193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:28.590205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.590206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:28.590207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:28.590212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.590215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.590218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554414946308265:6006]
2025-10-02T09:30:28.590243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:28.590247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.590248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:28.590255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:28.590261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:28.590265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:28.590359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:28.595433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|cb84bae5-848ff141-6d4bf962-83515301_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:28.597597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.662317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021832313:6694]
2025-10-02T09:30:28.662562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7556554415021832313:6694]
2025-10-02T09:30:28.716045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:28.716341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.716353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.716383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832313:6694], now have 1 active actors on pipe
2025-10-02T09:30:28.716548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:28.716527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:28.716566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021832313:6694]
2025-10-02T09:30:28.716568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:28.716571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:28.716697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: error at write: Disconnected sessionId: src_id|cb84bae5-848ff141-6d4bf962-83515301_0
2025-10-02T09:30:28.716822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|cb84bae5-848ff141-6d4bf962-83515301_0 is DEAD
2025-10-02T09:30:28.716881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:28.716886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Write session will restart in 0.009324s
2025-10-02T09:30:28.716903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Write session: Do CDS request
2025-10-02T09:30:28.716907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:28.722960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:28.724251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:28.724364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:28.724370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:28.724376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:28.724403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:28.724431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554414946308351:6008]
2025-10-02T09:30:28.724794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:28.725004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:28.725031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:28.725217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:28.725248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.725252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.725253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.725253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.725254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.725255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.725255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.725256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.725256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.725257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.725258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.725258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.725261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.725268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.725270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.725272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.725274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.725276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.725280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.725282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.725284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.725287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.725290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.725292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.725295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.725300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.725303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.725306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.725308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.725311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.725313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.725316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.725318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.725321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.725323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.725326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.725328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.725331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.725333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.725337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.725339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.725342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.725345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.725347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.725351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.725354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.725357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.725360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.725377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:28.727225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.727309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:28.727319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-10-02T09:30:28.727414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.727433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:28.727450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:28.727455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:28.727739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-10-02T09:30:28.727760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:28.727765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:28.727766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:28.727769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554415021832362:6993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:28.728142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554415021832362:6993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:28.729837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554415021832362:6993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:28.732565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554415021832362:6993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:28.732574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554415021832362:6993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:28.732576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554415021832362:6993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:28.732581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:28.733171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:28.734618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:28.734630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:28.734632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:28.734636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:28.734644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [2:7556554414946308351:6008]
2025-10-02T09:30:28.734656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:28.734673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:28.734677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.734679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.734680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.734691Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:28.734694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:28.734700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:28.734796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.734802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.734803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.734805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:28.734806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:28.734856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:28.734862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.734873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.734886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.734905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:28.734926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832315:2446], now have 1 active actors on pipe
2025-10-02T09:30:28.734933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832397:6993], now have 1 active actors on pipe
2025-10-02T09:30:28.734937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.734938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.734939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.734947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:28.734955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:28.734962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:28.734963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:28.734964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:28.734965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:28.734965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:28.734994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.735001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:28.735008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:28.735006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 753
2025-10-02T09:30:28.735017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 753
2025-10-02T09:30:28.735043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.735051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.735070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:28.735080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.735083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.735087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:28.735095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.735106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:28.735119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.735246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.735251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.735261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.735319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 36 sessionId: src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0
2025-10-02T09:30:28.735615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb84bae5-848ff141-6d4bf962-83515301_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:28.738071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Write session: try to update token
2025-10-02T09:30:28.738086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:28.745061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:28.745079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.745081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:28.745083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:28.745093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.745097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.745100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554414946308346:6008]
2025-10-02T09:30:28.745133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:28.745139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.745141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:28.745155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:28.745161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:28.745165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:28.745255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:28.750700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:28.753004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.816937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021832409:6694]
2025-10-02T09:30:28.817170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7556554415021832409:6694]
2025-10-02T09:30:28.875086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:28.875407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.875418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.875434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832409:6694], now have 1 active actors on pipe
2025-10-02T09:30:28.875626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:28.875649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021832409:6694]
2025-10-02T09:30:28.875667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:28.875674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:28.875676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:28.875719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: error at write: Disconnected sessionId: src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0
2025-10-02T09:30:28.875840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0 is DEAD
2025-10-02T09:30:28.876009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:28.876020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Write session will restart in 0.008741s
2025-10-02T09:30:28.876039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Write session: Do CDS request
2025-10-02T09:30:28.876045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:28.883076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:28.884785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:28.884925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:28.884932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:28.884938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:28.884970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:28.885006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554414946308435:6011]
2025-10-02T09:30:28.885390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:28.885663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:28.885707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:28.885989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:28.886041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.886047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.886047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.886048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.886049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.886050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.886051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.886052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.886053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.886053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.886054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.886055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.886060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.886070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.886074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.886078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.886083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.886087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.886091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.886095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.886098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.886102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.886106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.886109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.886116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.886123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:28.886128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.886133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:28.886136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.886141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:28.886145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.886149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:28.886155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.886161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:28.886169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.886174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:28.886178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.886183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:28.886187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.886192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:28.886196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.886203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:28.886207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.886213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.886220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.886225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.886233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.886238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.886261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.886272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:28.886337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:28.886348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-10-02T09:30:28.886430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:28.886454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:28.886462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:28.886465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:28.886790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-10-02T09:30:28.886821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:28.886827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:28.886829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:28.886833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554415021832462:6998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:28.887323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554415021832462:6998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:28.889128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554415021832462:6998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:28.893679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554415021832462:6998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:28.893691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554415021832462:6998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:28.893694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554415021832462:6998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:28.893700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:28.894281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:28.895799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:28.895811Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:28.895813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:28.895815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:28.895819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [2:7556554414946308435:6011]
2025-10-02T09:30:28.895828Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:28.895839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:28.895841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.895843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.895844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.895855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:28.895858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:28.895862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:28.895899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.895904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.895906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.895908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:28.895909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:28.895954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:28.895960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.895970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:28.895984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:28.896006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:28.896023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832497:6998], now have 1 active actors on pipe
2025-10-02T09:30:28.896028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832414:2446], now have 1 active actors on pipe
2025-10-02T09:30:28.896032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.896033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.896035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.896044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:28.896057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:28.896063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:28.896066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:28.896067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:28.896071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:28.896074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:28.896054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 754
2025-10-02T09:30:28.896073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 754
2025-10-02T09:30:28.896095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.896105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:28.896109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:28.896117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.896122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.896151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:28.896158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:28.896161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:28.896162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:28.896168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:28.896174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:28.896184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.896331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:28.896339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:28.896347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:28.896415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 36 sessionId: src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0
2025-10-02T09:30:28.896695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdfcab9-8f83efd1-4a2af889-5d8bd878_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:28.899086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Write session: try to update token
2025-10-02T09:30:28.899099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:28.906588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:28.906601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:28.906602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:28.906604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:28.906609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.906615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.906618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554414946308430:6011]
2025-10-02T09:30:28.906643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:28.906646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:28.906647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:28.906654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:28.906659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:28.906662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:28.906757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:28.911236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:28.913322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:28.975647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554415021832504:6694]
2025-10-02T09:30:28.975870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7556554415021832504:6694]
2025-10-02T09:30:29.030657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:29.030866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.030875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.030902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554415021832504:6694], now have 1 active actors on pipe
2025-10-02T09:30:29.031070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:29.031100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:29.031106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554415021832504:6694]
2025-10-02T09:30:29.031112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:29.031122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:29.031162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: error at write: Disconnected sessionId: src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0
2025-10-02T09:30:29.031292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0 is DEAD
2025-10-02T09:30:29.031397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:29.031404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Write session will restart in 0.009094s
2025-10-02T09:30:29.031419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Write session: Do CDS request
2025-10-02T09:30:29.031423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:29.038091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:29.039225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:29.039324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:29.039331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:29.039337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:29.039362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:29.039390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554419241275814:6013]
2025-10-02T09:30:29.039791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:29.040011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:29.040038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:29.040282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:29.040342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.040347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.040348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.040348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.040349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.040350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.040350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.040351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.040351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.040352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.040352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.040353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.040356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.040363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.040365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.040367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.040370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.040374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.040377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.040381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.040384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.040387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.040390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.040393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.040399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.040405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.040410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.040414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.040421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.040425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.040427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.040431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.040438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.040440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.040442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.040445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.040447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.040453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.040455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.040458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.040460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.040463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.040465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.040472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.040474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.040480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.040482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.040485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.040503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:29.041104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.041231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:29.041242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-10-02T09:30:29.041340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.041364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:29.041373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:29.041377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:29.041653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-10-02T09:30:29.041676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:29.041681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:29.041682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:29.041685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554419316799851:7002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:29.042025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554419316799851:7002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:29.043718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554419316799851:7002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:29.047563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554419316799851:7002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:29.047574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554419316799851:7002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:29.047577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554419316799851:7002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:29.047583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:29.048115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:29.049564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:29.049577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:29.049578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:29.049581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:29.049586Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [2:7556554419241275814:6013]
2025-10-02T09:30:29.049594Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:29.049604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:29.049606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.049607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.049609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.049621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:29.049624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:29.049628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:29.049670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.049677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.049678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.049680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:29.049682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:29.049738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:29.049744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.049756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.049764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.049776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:29.049796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799886:7002], now have 1 active actors on pipe
2025-10-02T09:30:29.049809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799802:2446], now have 1 active actors on pipe
2025-10-02T09:30:29.049815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.049816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.049818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.049829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:29.049840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:29.049852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:29.049833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 755
2025-10-02T09:30:29.049854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:29.049836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 755
2025-10-02T09:30:29.049856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:29.049861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:29.049863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:29.049877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.049879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:29.049886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:29.049906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.049914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.049939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7e43e66-544380f2-63a76ca-d768b380_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:29.049948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.049952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.049953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:29.049960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.049971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:29.049986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.050116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.050124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.050135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.050204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7e43e66-544380f2-63a76ca-d768b380_0
2025-10-02T09:30:29.050471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7464d6b2-6bd4b80d-bf55ddd3-2ea7baf4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7e43e66-544380f2-63a76ca-d768b380_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:29.052901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Write session: try to update token
2025-10-02T09:30:29.052914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:29.060126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:29.060142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.060144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:29.060146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:29.060155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.060160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.060163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554419241275809:6013]
2025-10-02T09:30:29.060202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:29.060204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:29.060207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.060209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:29.060210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:29.060213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:29.060334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:29.064883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|a7e43e66-544380f2-63a76ca-d768b380_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:29.067054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:29.131313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554419316799893:6694]
2025-10-02T09:30:29.131548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7556554419316799893:6694]
2025-10-02T09:30:29.187152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:29.187421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.187430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.187459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799893:6694], now have 1 active actors on pipe
2025-10-02T09:30:29.187665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:29.187683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554419316799893:6694]
2025-10-02T09:30:29.187701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:29.187702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:29.187753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: error at write: Disconnected sessionId: src_id|a7e43e66-544380f2-63a76ca-d768b380_0
2025-10-02T09:30:29.187863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:29.187883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|a7e43e66-544380f2-63a76ca-d768b380_0 is DEAD
2025-10-02T09:30:29.187999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:29.188008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Write session will restart in 0.009085s
2025-10-02T09:30:29.188022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Write session: Do CDS request
2025-10-02T09:30:29.188026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:29.193945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:29.195034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:29.195139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:29.195145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:29.195151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:29.195182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:29.195208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554419241275900:6016]
2025-10-02T09:30:29.195550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:29.195719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:29.195743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:29.195921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:29.195950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.195954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.195954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.195955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.195956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.195957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.195958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.195959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.195959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.195960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.195960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.195961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.195963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.195970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.195972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.195974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.195975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.195977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.195979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.195981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.195983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.195985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.195987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.195989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.195992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.195996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.195999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.196002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.196004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.196007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.196009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.196012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.196015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.196018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.196020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.196023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.196026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.196028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.196030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.196033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.196035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.196038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.196042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.196044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.196046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.196049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.196051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.196054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.196072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:29.198106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.198230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:29.198239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-10-02T09:30:29.198320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.198338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:29.198344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:29.198347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:29.198614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-10-02T09:30:29.198638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:29.198645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:29.198646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:29.198649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554419316799947:7007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:29.199010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554419316799947:7007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:29.200236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554419316799947:7007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:29.202895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554419316799947:7007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:29.202904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554419316799947:7007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:29.202906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554419316799947:7007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:29.202910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:29.203489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:29.204886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:29.204897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:29.204898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:29.204901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:29.204904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [2:7556554419241275900:6016]
2025-10-02T09:30:29.204912Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:29.204922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:29.204927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.204929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.204930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.204939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:29.204942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:29.204948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:29.204980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.204985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.204986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.204989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:29.204990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:29.205026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:29.205031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.205037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.205042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.205054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:29.205069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799981:7007], now have 1 active actors on pipe
2025-10-02T09:30:29.205071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799897:2446], now have 1 active actors on pipe
2025-10-02T09:30:29.205074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.205075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.205077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.205084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:29.205091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:29.205093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:29.205095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:29.205096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:29.205100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:29.205102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:29.205096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 756
2025-10-02T09:30:29.205102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 756
2025-10-02T09:30:29.205116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.205121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:29.205124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:29.205136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.205142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.205170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:29.205178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.205181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.205183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:29.205187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.205192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:29.205202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.205326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.205332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.205340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.205407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 36 sessionId: src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0
2025-10-02T09:30:29.205633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e43e66-544380f2-63a76ca-d768b380_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:29.207942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Write session: try to update token
2025-10-02T09:30:29.207955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:29.214282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:29.214294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.214295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:29.214296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:29.214302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.214305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.214307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554419241275895:6016]
2025-10-02T09:30:29.214331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:29.214332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:29.214336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.214339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:29.214338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:29.214341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:29.214471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:29.220097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:29.222043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:29.287966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554419316799989:6694]
2025-10-02T09:30:29.288163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7556554419316799989:6694]
2025-10-02T09:30:29.335110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:29.335366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.335376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.335389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799989:6694], now have 1 active actors on pipe
2025-10-02T09:30:29.335603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:29.335613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:29.335640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554419316799989:6694]
2025-10-02T09:30:29.335662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:29.335664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0
2025-10-02T09:30:29.335797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0 is DEAD
2025-10-02T09:30:29.335856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:29.335930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:29.335938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Write session will restart in 0.005664s
2025-10-02T09:30:29.335960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Write session: Do CDS request
2025-10-02T09:30:29.335965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:29.341762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:29.342191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.342245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:29.342253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-10-02T09:30:29.342341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.342360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:29.342366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:29.342368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:29.342635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-10-02T09:30:29.342659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:29.342663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:29.342665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:29.342668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554419316800037:7011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:29.343067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:29.343071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554419316800037:7011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:29.343167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:29.343173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:29.343179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:29.343206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:29.343233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554419241275985:6018]
2025-10-02T09:30:29.343604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:29.343772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:29.343795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:29.343975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:29.344004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.344008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.344008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.344009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.344010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.344010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.344011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.344012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.344012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.344013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.344015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.344016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.344018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.344024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.344026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.344028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.344031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.344033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.344035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.344037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.344039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.344041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.344043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.344045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.344049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.344052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.344056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.344059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.344061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.344064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.344066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.344069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.344072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.344075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.344077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.344079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.344082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.344086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.344088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.344091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.344093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.344096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.344098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.344101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.344103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.344106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.344108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.344111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.344128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:29.344622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554419316800037:7011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:29.348983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554419316800037:7011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:29.348991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554419316800037:7011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:29.348993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554419316800037:7011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:29.348998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:29.351710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:29.353307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:29.353320Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:29.353322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:29.353325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:29.353330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [2:7556554419241275985:6018]
2025-10-02T09:30:29.353340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:29.353356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:29.353361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.353363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.353365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.353378Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:29.353387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:29.353392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:29.353434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.353440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.353443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.353445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:29.353447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:29.353497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:29.353504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.353515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.353530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.353548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:29.353568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800076:7011], now have 1 active actors on pipe
2025-10-02T09:30:29.353575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316799990:2446], now have 1 active actors on pipe
2025-10-02T09:30:29.353579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.353581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.353583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.353560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 757
2025-10-02T09:30:29.353567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 757
2025-10-02T09:30:29.353589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:29.353595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:29.353598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:29.353599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:29.353601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:29.353613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:29.353619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:29.353635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.353641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.353662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.353673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:29.353679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:29.353687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|889dcdc9-a003a02f-cd713708-20be72da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:29.353695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.353701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.353706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:29.353713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.353722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:29.353752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.353839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.353846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.353855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.353897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 36 sessionId: src_id|889dcdc9-a003a02f-cd713708-20be72da_0
2025-10-02T09:30:29.354114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69353fa-5bc23614-fd3c7911-46cffa0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|889dcdc9-a003a02f-cd713708-20be72da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:29.356673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Write session: try to update token
2025-10-02T09:30:29.356685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:29.362751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:29.362765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.362772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.362800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:29.362803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:29.362955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:29.363184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:29.363325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:29.363455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:29.363631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:29.363666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:29.367796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|889dcdc9-a003a02f-cd713708-20be72da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:29.369697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:29.369845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.369859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.369882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:29.369938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:29.372891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:29.372904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.372906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:29.372908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:29.372915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.372919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.372924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554419241275980:6018]
2025-10-02T09:30:29.372951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:29.372952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:29.372957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:29.372959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:29.372960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.372962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:29.373079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:29.435921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554419316800106:6694]
2025-10-02T09:30:29.436069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7556554419316800106:6694]
2025-10-02T09:30:29.494123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:29.500312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.500331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.500459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.500511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.500562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.500612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.500863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.500874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.500927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.500979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.501030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.501079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.501112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.501117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.501170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.501219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.501269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.501318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.501359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.501364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.501414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.501574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.501626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.501673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.501709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.501714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.501768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.501819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.501870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.501920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.501957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.501962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.502012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.502062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.502112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.502163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.502199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.502204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.502252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.502300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.502363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.502414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.502449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.502453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.502503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.502549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.502598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.502647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.502680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.502685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.502734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.502781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.502829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.502878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.502912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.502917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.502962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.503019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.503067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.503112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.503150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.503156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.503187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800106:6694], now have 1 active actors on pipe
2025-10-02T09:30:29.503374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554419316800106:6694]
2025-10-02T09:30:29.503376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:29.503402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:29.503404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:29.503424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|889dcdc9-a003a02f-cd713708-20be72da_0
2025-10-02T09:30:29.503502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:29.503592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|889dcdc9-a003a02f-cd713708-20be72da_0 is DEAD
2025-10-02T09:30:29.503706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:29.503718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Write session will restart in 0.009982s
2025-10-02T09:30:29.503737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Write session: Do CDS request
2025-10-02T09:30:29.503744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:29.509356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:29.510413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:29.510528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:29.510535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:29.510541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:29.510569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:29.510595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554419241276108:6032]
2025-10-02T09:30:29.510992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:29.511163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:29.511188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:29.511385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:29.511416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.511419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.511420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.511421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.511421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.511422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.511422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.511423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.511424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.511424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.511425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.511425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.511428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.511435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.511437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.511439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.511441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.511443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.511446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.511448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.511451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.511454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.511456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.511458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.511462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.511466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.511469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.511472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.511474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.511477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.511479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.511482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.511484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.511486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.511489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.511492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.511494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.511497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.511499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.511502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.511504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.511507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.511509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.511511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.511514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.511518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.511521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.511523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.511542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:29.515166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.515240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:29.515249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-10-02T09:30:29.515329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.515348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:29.515354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:29.515358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:29.515711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-10-02T09:30:29.515737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:29.515741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:29.515742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:29.515746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554419316800161:7022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:29.516111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554419316800161:7022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:29.517986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554419316800161:7022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:29.519314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:29.519930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554419316800161:7022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:29.519940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554419316800161:7022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:29.519942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554419316800161:7022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:29.519946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:29.520741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:29.520753Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:29.520756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:29.520759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:29.520762Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [2:7556554419241276108:6032]
2025-10-02T09:30:29.520770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:29.520780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:29.520781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.520783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.520784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.520795Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:29.520820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:29.520827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:29.520863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.520866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.520867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.520869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:29.520871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:29.520913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:29.520918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.520925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.520931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.520939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:29.520950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800196:7022], now have 1 active actors on pipe
2025-10-02T09:30:29.520953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800107:2446], now have 1 active actors on pipe
2025-10-02T09:30:29.520958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.520960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.520961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.520973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:29.520987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:29.520990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:29.520992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:29.520994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:29.521001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:29.521003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:29.520998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 758
2025-10-02T09:30:29.521001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 758
2025-10-02T09:30:29.521022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.521029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:29.521031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:29.521042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.521045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.521070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:29.521078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.521080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.521080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:29.521086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.521092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:29.521102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.521211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.521217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.521227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.521293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0
2025-10-02T09:30:29.521525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889dcdc9-a003a02f-cd713708-20be72da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:29.523935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Write session: try to update token
2025-10-02T09:30:29.523948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:29.530665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:29.530680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.530683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:29.530684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:29.530690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.530692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.530695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554419241276103:6032]
2025-10-02T09:30:29.530724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:29.530732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.530736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:29.530738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:29.530743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:29.530746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:29.530850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:29.536139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:29.538279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:29.603386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554419316800203:6694]
2025-10-02T09:30:29.603637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7556554419316800203:6694]
2025-10-02T09:30:29.668466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:29.668760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.668773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.668790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800203:6694], now have 1 active actors on pipe
2025-10-02T09:30:29.668976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:29.668987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:29.668995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:29.669001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:29.669043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554419316800203:6694]
2025-10-02T09:30:29.669085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: error at write: Disconnected sessionId: src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0
2025-10-02T09:30:29.669212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0 is DEAD
2025-10-02T09:30:29.669369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:29.669379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Write session will restart in 0.009407s
2025-10-02T09:30:29.669398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Write session: Do CDS request
2025-10-02T09:30:29.669404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:29.675799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:29.677010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:29.677155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:29.677163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:29.677172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:29.677214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:29.677250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554419241276208:6035]
2025-10-02T09:30:29.677793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:29.678001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:29.678040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:29.678320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:29.678374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.678380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.678381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.678382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.678383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.678384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.678385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.678386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.678387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.678388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.678389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.678390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.678394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.678405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.678408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.678412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.678417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.678424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.678428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.678431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.678434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.678437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.678441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.678447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.678453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.678458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.678463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.678467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.678471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.678475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.678480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.678483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.678487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.678491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.678500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.678505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.678510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.678513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.678518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.678522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.678527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.678532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.678537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.678541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.678545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.678553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.678559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.678591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:29.680154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.680257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:29.680265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-10-02T09:30:29.680345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.680363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:29.680369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:29.680372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:29.680652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-10-02T09:30:29.680673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:29.680678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:29.680680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:29.680683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554419316800270:7027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:29.681052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554419316800270:7027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:29.682564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554419316800270:7027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:29.685737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554419316800270:7027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:29.685746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554419316800270:7027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:29.685749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554419316800270:7027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:29.685753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:29.686447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:29.687906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:29.687918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:29.687919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:29.687921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:29.687925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [2:7556554419241276208:6035]
2025-10-02T09:30:29.687933Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:29.687944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:29.687945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.687947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.687948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.687957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:29.687961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:29.687966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:29.687997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.688002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.688003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.688005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:29.688007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:29.688047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:29.688052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.688059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.688064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.688074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:29.688087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800216:2446], now have 1 active actors on pipe
2025-10-02T09:30:29.688093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800306:7027], now have 1 active actors on pipe
2025-10-02T09:30:29.688097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.688098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.688099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.688107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:29.688114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:29.688118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:29.688123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:29.688123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:29.688124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:29.688125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:29.688140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.688141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:29.688135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 759
2025-10-02T09:30:29.688139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 759
2025-10-02T09:30:29.688155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:29.688162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.688164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.688178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd496d55-75ef2c12-587174a4-5549f05e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:29.688185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.688187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.688188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:29.688193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.688198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:29.688205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.688314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.688322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.688335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.688410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd496d55-75ef2c12-587174a4-5549f05e_0
2025-10-02T09:30:29.688646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd105e4d-5106ca54-f3b347cc-c77a7aec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd496d55-75ef2c12-587174a4-5549f05e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:29.690938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Write session: try to update token
2025-10-02T09:30:29.690951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:29.697793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:29.697809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.697816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.697844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:29.697846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:29.697994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:29.698131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:29.698277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:29.698397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:29.698547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:29.698579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:29.701756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|bd496d55-75ef2c12-587174a4-5549f05e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:29.703637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:29.703734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.703745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.703766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:29.703835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:29.707637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:29.707654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.707657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:29.707659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:29.707666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.707670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.707679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554419241276203:6035]
2025-10-02T09:30:29.707714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:29.707715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:29.707720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:29.707724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:29.707726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.707728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:29.707903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:29.769241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554419316800322:6694]
2025-10-02T09:30:29.769413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7556554419316800322:6694]
2025-10-02T09:30:29.842273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:29.861630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.861657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.861777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.861822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.861868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.861921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.861962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.861972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.862053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.862101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.862153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.862223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.862314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.862321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.862481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.862529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.862579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.862628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.862712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.862717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.862914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.863067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.863117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.863166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.863211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.863217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.863407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.863597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.863784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.863837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.863937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.863942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.864003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.864533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.865064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.865117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.865327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.865333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.865383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.865431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.865485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.865534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.865570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.865583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.865635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.865684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.865869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.866059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.866225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.866230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.866410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.866457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.866504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.866552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.866638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.866644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.866691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:29.866736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:29.866782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:29.866928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:29.867033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:29.867039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:29.867080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800322:6694], now have 1 active actors on pipe
2025-10-02T09:30:29.867280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:29.867297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:29.867310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:29.867341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|bd496d55-75ef2c12-587174a4-5549f05e_0
2025-10-02T09:30:29.867360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554419316800322:6694]
2025-10-02T09:30:29.867474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|bd496d55-75ef2c12-587174a4-5549f05e_0 is DEAD
2025-10-02T09:30:29.867600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:29.867608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Write session will restart in 0.007902s
2025-10-02T09:30:29.867638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Write session: Do CDS request
2025-10-02T09:30:29.867643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:29.867933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:29.874927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:29.876146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.876238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:29.876249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-10-02T09:30:29.876334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:29.876362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:29.876369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:29.876372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:29.876696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-10-02T09:30:29.876716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:29.876720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:29.876721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:29.876724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554419316800380:7032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:29.877096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554419316800380:7032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:29.878123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:29.878226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:29.878233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:29.878239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:29.878271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:29.878300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554419241276300:6038]
2025-10-02T09:30:29.878657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:29.878832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:29.878859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:29.879053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:29.879085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.879089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.879089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.879090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.879091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.879092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.879092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.879093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.879094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.879094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.879095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.879095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.879098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.879104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.879106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.879108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.879110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.879112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.879114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.879128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.879130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.879133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.879135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.879137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.879140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.879144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:29.879147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.879150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:29.879152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.879155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:29.879157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.879160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:29.879162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.879165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554419316800380:7032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:29.879165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:29.879167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.879170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:29.879172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.879175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:29.879177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.879180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:29.879182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.879185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:29.879188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.879190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.879193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.879196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.879198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.879201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.879218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:29.884109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554419316800380:7032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:29.884119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554419316800380:7032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:29.884122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554419316800380:7032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:29.884127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:29.886793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:29.888254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:29.888264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:29.888267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:29.888269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:29.888272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [2:7556554419241276300:6038]
2025-10-02T09:30:29.888280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:29.888291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:29.888292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.888294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.888295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.888304Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:29.888307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:29.888312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:29.888351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.888357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.888358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.888360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:29.888361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:29.888403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:29.888408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.888415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:29.888420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:29.888432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:29.888444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800418:7032], now have 1 active actors on pipe
2025-10-02T09:30:29.888449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800330:2446], now have 1 active actors on pipe
2025-10-02T09:30:29.888453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.888455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.888456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.888464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:29.888476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:29.888479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:29.888484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:29.888485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:29.888487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:29.888489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:29.888481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 760
2025-10-02T09:30:29.888504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.888484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 760
2025-10-02T09:30:29.888509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:29.888511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:29.888519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.888521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.888544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b702e820-dbb1514e-c7476491-f25f8b87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:29.888551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:29.888553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:29.888554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:29.888560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:29.888567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:29.888578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.888670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:29.888676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:29.888684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:29.888731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 36 sessionId: src_id|b702e820-dbb1514e-c7476491-f25f8b87_0
2025-10-02T09:30:29.888957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd496d55-75ef2c12-587174a4-5549f05e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b702e820-dbb1514e-c7476491-f25f8b87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:29.891371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Write session: try to update token
2025-10-02T09:30:29.891381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:29.897999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:29.898013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:29.898015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:29.898019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:29.898026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.898029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.898032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554419241276295:6038]
2025-10-02T09:30:29.898063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:29.898064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:29.898069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:29.898070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:29.898071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:29.898074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:29.898190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:29.905702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|b702e820-dbb1514e-c7476491-f25f8b87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:29.907651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:29.967395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554419316800426:6694]
2025-10-02T09:30:29.967585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7556554419316800426:6694]
2025-10-02T09:30:30.012868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.013144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.013154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.013167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554419316800426:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.013319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:30.013369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554419316800426:6694]
2025-10-02T09:30:30.013375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:30.013378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:30.013392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.013428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: error at write: Disconnected sessionId: src_id|b702e820-dbb1514e-c7476491-f25f8b87_0
2025-10-02T09:30:30.013570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|b702e820-dbb1514e-c7476491-f25f8b87_0 is DEAD
2025-10-02T09:30:30.013733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:30.013741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Write session will restart in 0.005957s
2025-10-02T09:30:30.013759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Write session: Do CDS request
2025-10-02T09:30:30.013764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.020518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.021128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.021246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.021254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-10-02T09:30:30.021340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.021361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.021367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.021370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.021671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-10-02T09:30:30.021676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.021694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.021698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.021699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.021705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611767775:7036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.021797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.021804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.021810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.021839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.021863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536243686:6040]
2025-10-02T09:30:30.022041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611767775:7036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.022208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.022376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.022398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.022575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.022603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.022607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.022607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.022608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.022608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.022609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.022609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.022610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.022611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.022611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.022612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.022612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.022615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.022621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.022623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.022625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.022628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.022630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.022632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.022634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.022636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.022638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.022640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.022642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.022646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.022651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.022654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.022657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.022659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.022662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.022664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.022666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.022668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.022676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.022678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.022681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.022683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.022686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.022688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.022690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.022692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.022695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.022697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.022700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.022702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.022704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.022710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.022712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.022729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.023602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611767775:7036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.027660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611767775:7036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.027670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611767775:7036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.027684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611767775:7036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.027698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.030378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.031888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.031897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.031898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.031901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.031905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [2:7556554423536243686:6040]
2025-10-02T09:30:30.031914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.031925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.031930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.031932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.031933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.031943Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.031949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.031953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.031985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.031990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.031991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.031994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.031995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.032050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.032056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.032062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.032067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.032076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.032093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767814:7036], now have 1 active actors on pipe
2025-10-02T09:30:30.032095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767723:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.032099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.032100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.032101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.032109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.032118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.032125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.032125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 761
2025-10-02T09:30:30.032127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.032129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 761
2025-10-02T09:30:30.032143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.032144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.032174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.032179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.032197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.032199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.032200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.032202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.032204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.032205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.032206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.032208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.032212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.032218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.032227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.032335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.032341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.032348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.032392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0
2025-10-02T09:30:30.032638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b702e820-dbb1514e-c7476491-f25f8b87_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.034902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Write session: try to update token
2025-10-02T09:30:30.034913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.041935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.041951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.041953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.041955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.041963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.041967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.041971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536243681:6040]
2025-10-02T09:30:30.042003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.042003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.042007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.042007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.042009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.042011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.042141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:30.052308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.054322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.113334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554423611767821:6694]
2025-10-02T09:30:30.113564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7556554423611767821:6694]
2025-10-02T09:30:30.161487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.161697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.161706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.161718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767821:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.161861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:30.161899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554423611767821:6694]
2025-10-02T09:30:30.161923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:30.161930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.161973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0
2025-10-02T09:30:30.162109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0 is DEAD
2025-10-02T09:30:30.162225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:30.162233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Write session will restart in 0.008635s
2025-10-02T09:30:30.162247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Write session: Do CDS request
2025-10-02T09:30:30.162252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.168895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.170336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.170438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.170445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.170451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.170476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.170501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536243784:6045]
2025-10-02T09:30:30.170851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.171083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.171106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.171303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.171334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.171337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.171338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.171339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.171339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.171340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.171340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.171341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.171342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.171342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.171343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.171343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.171346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.171353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.171355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.171357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.171359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.171361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.171363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.171365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.171367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.171369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.171371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.171373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.171378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.171382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.171385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.171388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.171391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.171394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.171396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.171399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.171401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.171403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.171406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.171408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.171410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.171413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.171415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.171417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.171420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.171423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.171425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.171428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.171430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.171433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.171436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.171439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.171456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.172169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.172261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.172271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-10-02T09:30:30.172357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.172375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.172378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.172381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.172647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-10-02T09:30:30.172669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.172670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.172671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.172676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611767884:7041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.173036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611767884:7041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.174631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611767884:7041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.178410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611767884:7041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.178418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611767884:7041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.178420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611767884:7041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.178425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.178969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.180431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.180441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.180442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.180445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.180450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [2:7556554423536243784:6045]
2025-10-02T09:30:30.180457Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.180468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.180470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.180471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.180473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.180482Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.180486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.180490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.180522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.180527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.180529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.180530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.180532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.180571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.180576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.180583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.180588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.180596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.180608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767919:7041], now have 1 active actors on pipe
2025-10-02T09:30:30.180614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767825:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.180617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.180618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.180619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.180627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.180635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.180641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.180644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.180645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.180647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.180647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.180666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.180670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.180678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.180663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 762
2025-10-02T09:30:30.180692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.180697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.180711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b2edc5-6bd9b289-d295286c-55062b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.180674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 762
2025-10-02T09:30:30.180716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.180723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.180726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.180731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.180736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.180743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.180844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.180849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.180856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.180902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 36 sessionId: src_id|49b2edc5-6bd9b289-d295286c-55062b5_0
2025-10-02T09:30:30.181171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c68212-ff6bbce6-30de34fc-e3c2141d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49b2edc5-6bd9b289-d295286c-55062b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.183812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Write session: try to update token
2025-10-02T09:30:30.183824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.194621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:30.194636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.194644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.194679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:30.194680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:30.194849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:30.194991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:30.195125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:30.195265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:30.195443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:30.195477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:30.196469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|49b2edc5-6bd9b289-d295286c-55062b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.198472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.198768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.198782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.198794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.198798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.198801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.198802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.198807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.198810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.198815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536243779:6045]
2025-10-02T09:30:30.198839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.198841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.198844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.198846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.198856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.198858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.199004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:30.262305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554423611767928:6694]
2025-10-02T09:30:30.262511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7556554423611767928:6694]
2025-10-02T09:30:30.313589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.313803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:30.313826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767928:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.313907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:30.313937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554423611767928:6694]
2025-10-02T09:30:30.313952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.313980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:30.313984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:30.314037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|49b2edc5-6bd9b289-d295286c-55062b5_0
2025-10-02T09:30:30.314141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|49b2edc5-6bd9b289-d295286c-55062b5_0 is DEAD
2025-10-02T09:30:30.314259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:30.314267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Write session will restart in 0.006824s
2025-10-02T09:30:30.314281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Write session: Do CDS request
2025-10-02T09:30:30.314286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.320684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.321980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.322100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.322108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.322114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.322141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.322167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536243877:6047]
2025-10-02T09:30:30.322217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.322264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.322274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-10-02T09:30:30.322367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.322386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.322390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.322393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.322519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.322727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-10-02T09:30:30.322738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.322751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.322756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.322757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.322761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.322760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611767984:7045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.322937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.322965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.322969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.322970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.322971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.322971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.322972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.322973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.322973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.322974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.322974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.322975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.322976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.322987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.322995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.322998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.323000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.323002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.323004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.323006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.323008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.323010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.323013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.323015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.323017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.323021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.323028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.323032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.323038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.323040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.323042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.323048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.323051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.323053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.323058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.323060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.323063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.323068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.323071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.323073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.323076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.323081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.323084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.323086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.323089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.323094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.323097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.323099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.323105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.323123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.323127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611767984:7045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.324613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611767984:7045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.328441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611767984:7045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.328449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611767984:7045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.328451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611767984:7045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.328455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.330625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.332075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.332086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.332087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.332090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.332093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [2:7556554423536243877:6047]
2025-10-02T09:30:30.332124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.332138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.332143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.332145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.332146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.332156Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.332162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.332168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.332206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.332211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.332212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.332214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.332215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.332254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.332259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.332265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.332274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.332285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.332302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768021:7045], now have 1 active actors on pipe
2025-10-02T09:30:30.332307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611767929:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.332312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.332313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.332315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.332322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.332334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.332334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.332337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.332338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.332327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 763
2025-10-02T09:30:30.332344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.332346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.332332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 763
2025-10-02T09:30:30.332363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.332368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.332370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.332377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.332382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.332412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.332419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.332422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.332423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.332427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.332436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.332448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.332544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.332549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.332557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.332610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0
2025-10-02T09:30:30.332870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2edc5-6bd9b289-d295286c-55062b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.335171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Write session: try to update token
2025-10-02T09:30:30.335182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.341751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.341766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.341770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.341772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.341779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.341783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.341786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536243872:6047]
2025-10-02T09:30:30.341814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.341820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.341823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.341825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.341826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.341829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.342054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:30.346246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.348202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.413859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554423611768029:6694]
2025-10-02T09:30:30.414091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7556554423611768029:6694]
2025-10-02T09:30:30.457661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.457862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.457870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.457895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768029:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.458049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554423611768029:6694]
2025-10-02T09:30:30.458063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:30.458066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:30.458079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.458112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0
2025-10-02T09:30:30.458151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:30.458236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0 is DEAD
2025-10-02T09:30:30.458366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:30.458376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Write session will restart in 0.005000s
2025-10-02T09:30:30.458390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Write session: Do CDS request
2025-10-02T09:30:30.458395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.464165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.464207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.464216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-10-02T09:30:30.464318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.464338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.464344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.464347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.464590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.464603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-10-02T09:30:30.464627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.464628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.464629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.464632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611768108:7056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.464977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611768108:7056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.465879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.466007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.466015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.466023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.466054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.466080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536244005:6061]
2025-10-02T09:30:30.466444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.466653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611768108:7056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.466682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.466719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.466970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.467022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.467027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.467028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.467028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.467029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.467030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.467030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.467031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.467031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.467032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.467033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.467033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.467036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.467042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.467044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.467046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.467048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.467050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.467052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.467054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.467057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.467059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.467061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.467063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.467067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.467073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.467076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.467079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.467081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.467084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.467086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.467089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.467092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.467095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.467098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.467101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.467103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.467106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.467108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.467111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.467113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.467116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.467118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.467121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.467123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.467126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.467132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.467135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.467152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.471156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611768108:7056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.471167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611768108:7056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.471169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611768108:7056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.471173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.474849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.476326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.476337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.476338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.476340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.476344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [2:7556554423536244005:6061]
2025-10-02T09:30:30.476351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.476361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.476364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.476366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.476367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.476376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.476378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.476382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.476415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.476421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.476422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.476424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.476425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.476465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.476469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.476476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.476481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.476492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.476508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.476511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.476512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.476516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.476524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768145:7056], now have 1 active actors on pipe
2025-10-02T09:30:30.476525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.476527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768055:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.476528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.476530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.476533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.476540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.476542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.476557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.476563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.476560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 764
2025-10-02T09:30:30.476562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 764
2025-10-02T09:30:30.476583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.476603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.476608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.476622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.476629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.476632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.476636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.476641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.476649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.476660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.476769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.476776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.476786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.476868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 36 sessionId: src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0
2025-10-02T09:30:30.477110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f54e7ff-8b449bb7-ed3fe68b-d5a78139_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.479413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Write session: try to update token
2025-10-02T09:30:30.479425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.486312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.486328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.486329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.486331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.486337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.486341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.486344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536244000:6061]
2025-10-02T09:30:30.486374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.486376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.486380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.486383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.486385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.486387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.486557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:30.491216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.493234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.558240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554423611768153:6694]
2025-10-02T09:30:30.558404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7556554423611768153:6694]
2025-10-02T09:30:30.608073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.608370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.608379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.608407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768153:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.608549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:30.608612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554423611768153:6694]
2025-10-02T09:30:30.608630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.608651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:30.608700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0
2025-10-02T09:30:30.608839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0 is DEAD
2025-10-02T09:30:30.608998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:30.609007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Write session will restart in 0.007116s
2025-10-02T09:30:30.609025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Write session: Do CDS request
2025-10-02T09:30:30.609030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.614833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.616011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.616111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.616117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.616123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.616147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.616171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536244111:6064]
2025-10-02T09:30:30.616559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.616710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.616731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.616926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.616956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.616960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.616960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.616961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.616961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.616962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.616962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.616963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.616963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.616964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.616964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.616965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.616967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.616974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.616976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.616978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.616980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.616982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.616984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.616986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.616988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.616990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.616992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.616994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.616998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.617002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.617006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.617009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.617011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.617014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.617016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.617018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.617020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.617023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.617025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.617027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.617030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.617033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.617034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.617037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.617039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.617042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.617044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.617047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.617049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.617051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.617053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.617056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.617072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.617235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.617714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.617724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-10-02T09:30:30.617818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.617836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.617842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.617844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.618121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-10-02T09:30:30.618146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.618151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.618152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.618155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611768226:7061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.618438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611768226:7061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.619989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611768226:7061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.624078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611768226:7061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.624090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611768226:7061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.624094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611768226:7061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.624100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.624859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.626312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.626323Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.626325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.626327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.626331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [2:7556554423536244111:6064]
2025-10-02T09:30:30.626339Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.626350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.626352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.626353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.626356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.626366Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.626369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.626379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.626411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.626416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.626417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.626419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.626421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.626466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.626471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.626478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.626484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.626496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.626512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768154:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.626518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768261:7061], now have 1 active actors on pipe
2025-10-02T09:30:30.626521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.626522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.626523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.626530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.626538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.626543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.626545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.626546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.626549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.626551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.626542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 765
2025-10-02T09:30:30.626557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 765
2025-10-02T09:30:30.626569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.626574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.626576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.626588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.626594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.626621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.626628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.626631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.626632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.626637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.626645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.626658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.626752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.626757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.626766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.626819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 36 sessionId: src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0
2025-10-02T09:30:30.627079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f14ebec0-af6027b8-9397d9b4-e66d7128_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.629418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Write session: try to update token
2025-10-02T09:30:30.629429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.636470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.636486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.636487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.636488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.636493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.636497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.636500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536244106:6064]
2025-10-02T09:30:30.636523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.636526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.636528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.636535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.636547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.636551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.636659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:30.641221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.643300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.708770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554423611768269:6694]
2025-10-02T09:30:30.709001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7556554423611768269:6694]
2025-10-02T09:30:30.761352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.761615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.761625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.761650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768269:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.761834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.761843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554423611768269:6694]
2025-10-02T09:30:30.761872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:30.761875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:30.761943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: error at write: Disconnected sessionId: src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0
2025-10-02T09:30:30.761950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:30.762121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0 is DEAD
2025-10-02T09:30:30.762243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:30.762255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Write session will restart in 0.006808s
2025-10-02T09:30:30.762279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Write session: Do CDS request
2025-10-02T09:30:30.762285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.770216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.770316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.770330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-10-02T09:30:30.770430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.770459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.770465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.770468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.770600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.770823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-10-02T09:30:30.770851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.770855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.770858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.770861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611768328:7065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.771240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611768328:7065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.772110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.772270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.772278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.772286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.772330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.772362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536244206:6066]
2025-10-02T09:30:30.772677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611768328:7065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.772727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.772925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.772950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.773132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.773173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.773178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.773178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.773179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.773179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.773180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.773181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.773181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.773182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.773182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.773183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.773183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.773186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.773194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.773196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.773199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.773201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.773203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.773205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.773207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.773209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.773211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.773213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.773215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.773219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.773223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.773226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.773228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.773230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.773233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.773235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.773238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.773240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.773243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.773245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.773248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.773251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.773253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.773256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.773259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.773261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.773264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.773266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.773269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.773272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.773275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.773277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.773280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.773299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.777397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611768328:7065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.777408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611768328:7065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.777410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611768328:7065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.777414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.781237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.782617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.782632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.782633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.782636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.782640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [2:7556554423536244206:6066]
2025-10-02T09:30:30.782648Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.782659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.782660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.782662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.782663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.782675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.782683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.782687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.782720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.782725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.782726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.782729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.782732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.782790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.782795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.782802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.782808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.782818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.782834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768369:7065], now have 1 active actors on pipe
2025-10-02T09:30:30.782840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768273:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.782843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.782845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.782846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.782854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.782865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.782871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.782875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.782876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.782877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.782878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.782858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 766
2025-10-02T09:30:30.782877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 766
2025-10-02T09:30:30.782897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.782902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.782904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.782912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.782916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.782957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4100a2d7-6be42cad-91b4554-9aa10028_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.782965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.782967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.782968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.782984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.782993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.783004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.783113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.783118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.783128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.783197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 36 sessionId: src_id|4100a2d7-6be42cad-91b4554-9aa10028_0
2025-10-02T09:30:30.783454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ea07ca-579ce79b-94dd8afd-d05e91e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4100a2d7-6be42cad-91b4554-9aa10028_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.785643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Write session: try to update token
2025-10-02T09:30:30.785655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.792962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.792979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.792983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.792985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.792993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.792996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.793000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536244201:6066]
2025-10-02T09:30:30.793029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.793033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.793034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.793038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.793042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.793044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.793150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:30.796702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|4100a2d7-6be42cad-91b4554-9aa10028_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.798675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.861858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554423611768381:6694]
2025-10-02T09:30:30.862047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7556554423611768381:6694]
2025-10-02T09:30:30.913700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:30.913911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.913919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.913945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768381:6694], now have 1 active actors on pipe
2025-10-02T09:30:30.914112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554423611768381:6694]
2025-10-02T09:30:30.914130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:30.914134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:30.914136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:30.914183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|4100a2d7-6be42cad-91b4554-9aa10028_0
2025-10-02T09:30:30.914316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|4100a2d7-6be42cad-91b4554-9aa10028_0 is DEAD
2025-10-02T09:30:30.914448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:30.914453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Write session will restart in 0.009761s
2025-10-02T09:30:30.914469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Write session: Do CDS request
2025-10-02T09:30:30.914473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:30.914492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:30.920664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:30.921881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:30.922003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:30.922011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:30.922018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:30.922047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:30.922071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554423536244304:6069]
2025-10-02T09:30:30.922422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:30.922589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:30.922611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:30.922790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:30.922819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.922823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.922823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.922824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.922824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.922825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.922825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.922826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.922826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.922827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.922827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.922828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.922830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.922837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.922839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.922841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.922843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.922845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.922849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.922850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.922852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.922854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.922856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.922858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.922862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.922866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:30.922869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.922872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:30.922874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.922877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:30.922879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.922881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:30.922884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.922886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:30.922889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.922891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:30.922893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.922896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:30.922901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.922903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:30.922906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.922908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:30.922911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.922917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.922919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.922922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.922924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.922929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.922946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:30.925274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.925362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:30.925374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-10-02T09:30:30.925455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:30.925475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:30.925481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:30.925484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:30.925760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-10-02T09:30:30.925785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:30.925789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:30.925791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:30.925795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554423611768443:7070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:30.926142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554423611768443:7070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:30.927824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554423611768443:7070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:30.929923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554423611768443:7070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:30.929936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554423611768443:7070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:30.929939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554423611768443:7070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:30.929945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:30.930510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:30.931913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:30.931927Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:30.931929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:30.931932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:30.931936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [2:7556554423536244304:6069]
2025-10-02T09:30:30.931943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:30.931953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:30.931956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.931958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.931959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.931968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:30.931971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:30.931978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:30.932063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.932068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.932069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.932071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:30.932072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:30.932113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:30.932117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.932124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:30.932129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:30.932139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:30.932154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.932159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.932161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.932167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:30.932175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:30.932179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768382:2446], now have 1 active actors on pipe
2025-10-02T09:30:30.932184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:30.932185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554423611768477:7070], now have 1 active actors on pipe
2025-10-02T09:30:30.932186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:30.932189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:30.932200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:30.932202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:30.932224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.932239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:30.932244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 767
2025-10-02T09:30:30.932245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 767
2025-10-02T09:30:30.932272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:30.932321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.932331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.932353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:30.932363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:30.932365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:30.932367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:30.932376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:30.932389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:30.932399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.932554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.932558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.932567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:30.932658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0
2025-10-02T09:30:30.932898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4100a2d7-6be42cad-91b4554-9aa10028_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:30.935160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Write session: try to update token
2025-10-02T09:30:30.935171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:30.941932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:30.941946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.941951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.941981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:30.941990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:30.942122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:30.942238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:30.942351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:30.942471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:30.942627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:30.942653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:30.945529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:30.947605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:30.947724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:30.947735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:30.947757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:30.947811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:30.950039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:30.950050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:30.950052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:30.950053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:30.950058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.950060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.950064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554423536244299:6069]
2025-10-02T09:30:30.950089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:30.950091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:30.950095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:30.950097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:30.950098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:30.950100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:30.950227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.014439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906735781:6694]
2025-10-02T09:30:31.014660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7556554427906735781:6694]
2025-10-02T09:30:31.064947Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:31.070850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.070873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.071012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.071066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.071119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.071171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.071301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.071309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.071364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.071411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.071470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.071532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.071575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.071582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.071639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.071685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.071734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.071784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.071819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.071824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.071874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.071924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.071977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.072028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.072063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.072067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.072120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.072168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.072229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.072286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.072322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.072327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.072378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.072427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.072477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.072530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.072565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.072571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.072620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.072668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.072718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.072767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.072828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.072833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.072887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.072935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.072983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.073030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.073065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.073070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.073117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.073161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.073208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.073254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.073346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.073353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.073400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.073445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.073490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.073537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.073571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.073576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.073605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906735781:6694], now have 1 active actors on pipe
2025-10-02T09:30:31.073807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:31.073845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:31.073851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:31.073872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: error at write: Disconnected sessionId: src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0
2025-10-02T09:30:31.073879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906735781:6694]
2025-10-02T09:30:31.074013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0 is DEAD
2025-10-02T09:30:31.074106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:31.074138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:31.074147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Write session will restart in 0.005161s
2025-10-02T09:30:31.074161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Write session: Do CDS request
2025-10-02T09:30:31.074166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:31.080183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.080252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:31.080261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-10-02T09:30:31.080360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.080380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:31.080388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:31.080390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:31.080560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:31.080656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-10-02T09:30:31.080674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:31.080675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:31.080676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:31.080679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554427906735841:7074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:31.081163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554427906735841:7074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:31.081730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:31.081831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:31.081838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:31.081844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:31.081871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:31.081895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554427831211697:6071]
2025-10-02T09:30:31.082234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:31.082404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:31.082426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:31.082600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:31.082627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.082631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.082632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.082632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.082633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.082634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.082634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.082634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.082635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.082635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.082636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.082636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.082639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.082645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.082647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.082649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.082651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.082653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.082655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.082656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.082658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.082660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.082662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.082664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.082668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.082671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.082676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.082679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.082680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.082683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.082685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.082687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.082689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.082692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.082694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.082696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.082698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.082701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.082703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.082705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.082707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.082710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.082713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.082717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.082719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.082722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.082724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.082726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.082745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:31.082749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554427906735841:7074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:31.087503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554427906735841:7074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:31.087513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554427906735841:7074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:31.087515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554427906735841:7074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:31.087518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:31.090178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:31.091562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:31.091574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:31.091575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:31.091577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:31.091581Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [2:7556554427831211697:6071]
2025-10-02T09:30:31.091588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:31.091598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:31.091603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.091606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.091608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.091618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:31.091624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:31.091628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:31.091658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.091663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.091664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.091666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:31.091667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:31.091711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:31.091718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.091727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.091741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.091759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:31.091778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906735783:2446], now have 1 active actors on pipe
2025-10-02T09:30:31.091785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906735880:7074], now have 1 active actors on pipe
2025-10-02T09:30:31.091780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 768
2025-10-02T09:30:31.091790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.091786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 768
2025-10-02T09:30:31.091796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.091797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.091801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:31.091811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:31.091811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:31.091819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:31.091819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:31.091820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:31.091820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:31.091832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.091838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.091856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.091865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:31.091872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:31.091877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b276798e-2399a6f-607d3646-ce8c7b85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:31.091881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.091883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.091884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:31.091889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.091898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:31.091920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.092039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.092044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.092052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.092105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 36 sessionId: src_id|b276798e-2399a6f-607d3646-ce8c7b85_0
2025-10-02T09:30:31.092309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c950a23-319afb3c-7cd407d3-b7dcc08d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b276798e-2399a6f-607d3646-ce8c7b85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:31.094898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Write session: try to update token
2025-10-02T09:30:31.094913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:31.101410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:31.101426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.101428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:31.101430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:31.101438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.101441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.101445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554427831211692:6071]
2025-10-02T09:30:31.101461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:31.101464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:31.101467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:31.101471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:31.101482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.101485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:31.101617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.108201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|b276798e-2399a6f-607d3646-ce8c7b85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:31.110267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:31.173647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906735889:6694]
2025-10-02T09:30:31.173852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7556554427906735889:6694]
2025-10-02T09:30:31.220243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:31.220546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.220555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.220567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906735889:6694], now have 1 active actors on pipe
2025-10-02T09:30:31.220693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:31.220737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906735889:6694]
2025-10-02T09:30:31.220748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:31.220762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:31.220828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b276798e-2399a6f-607d3646-ce8c7b85_0
2025-10-02T09:30:31.220961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|b276798e-2399a6f-607d3646-ce8c7b85_0 is DEAD
2025-10-02T09:30:31.221461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:31.221471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Write session will restart in 0.005717s
2025-10-02T09:30:31.221485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Write session: Do CDS request
2025-10-02T09:30:31.221490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:31.227305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:31.228130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.228232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:31.228242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-10-02T09:30:31.228339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.228369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:31.228384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:31.228387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:31.228529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:31.228644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:31.228652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:31.228658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:31.228678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-10-02T09:30:31.228697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:31.228687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:31.228713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554427831211797:6074]
2025-10-02T09:30:31.228701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:31.228702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:31.228706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554427906735950:7079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:31.229070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554427906735950:7079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:31.229087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:31.229283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:31.229310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:31.229528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:31.229585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.229592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.229593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.229594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.229595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.229596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.229597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.229598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.229599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.229600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.229601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.229602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.229606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.229614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.229617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.229620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.229623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.229626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.229629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.229632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.229635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.229639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.229642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.229646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.229651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.229657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.229668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.229676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.229682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.229688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.229695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.229699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.229707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.229711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.229718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.229722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.229727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.229735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.229743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.229747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.229754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.229758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.229765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.229769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.229772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.229780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.229783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.229791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.229826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:31.230373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554427906735950:7079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:31.235060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554427906735950:7079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:31.235070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554427906735950:7079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:31.235072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554427906735950:7079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:31.235077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:31.237266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:31.238595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:31.238606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:31.238607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:31.238609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:31.238613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [2:7556554427831211797:6074]
2025-10-02T09:30:31.238622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:31.238636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:31.238641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.238643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.238644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.238653Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:31.238659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:31.238663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:31.238695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.238700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.238701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.238702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:31.238704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:31.238740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:31.238745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.238751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.238757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.238768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:31.238787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906735993:7079], now have 1 active actors on pipe
2025-10-02T09:30:31.238793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906735891:2446], now have 1 active actors on pipe
2025-10-02T09:30:31.238798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.238799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.238801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.238810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:31.238821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:31.238823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:31.238825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:31.238826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:31.238837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:31.238843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:31.238829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 769
2025-10-02T09:30:31.238831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 769
2025-10-02T09:30:31.238868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.238873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.238883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.238889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:31.238895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:31.238905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c2c43de-6f995522-f174901b-3128b37f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:31.238912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.238915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.238916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:31.238921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.238926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:31.238940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.239038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.239045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.239054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.239098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c2c43de-6f995522-f174901b-3128b37f_0
2025-10-02T09:30:31.239292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b276798e-2399a6f-607d3646-ce8c7b85_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c2c43de-6f995522-f174901b-3128b37f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:31.241465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Write session: try to update token
2025-10-02T09:30:31.241476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:31.248343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:31.248354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.248356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:31.248357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:31.248363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.248366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.248368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554427831211792:6074]
2025-10-02T09:30:31.248391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:31.248394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:31.248396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.248398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:31.248398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:31.248400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:31.248505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.252032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|2c2c43de-6f995522-f174901b-3128b37f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:31.254102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:31.321125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906736000:6694]
2025-10-02T09:30:31.321326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7556554427906736000:6694]
2025-10-02T09:30:31.382101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:31.382380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.382389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.382415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736000:6694], now have 1 active actors on pipe
2025-10-02T09:30:31.382600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:31.382611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:31.382620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:31.382637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906736000:6694]
2025-10-02T09:30:31.382654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:31.382666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: error at write: Disconnected sessionId: src_id|2c2c43de-6f995522-f174901b-3128b37f_0
2025-10-02T09:30:31.382803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|2c2c43de-6f995522-f174901b-3128b37f_0 is DEAD
2025-10-02T09:30:31.382939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:31.382947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Write session will restart in 0.005558s
2025-10-02T09:30:31.382964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Write session: Do CDS request
2025-10-02T09:30:31.382968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:31.388849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:31.389151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.389223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:31.389232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-10-02T09:30:31.389308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.389328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:31.389332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:31.389334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:31.389655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-10-02T09:30:31.389694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:31.389699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:31.389701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:31.389705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554427906736062:7083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:31.390037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:31.390132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:31.390139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:31.390145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:31.390169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:31.390137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554427906736062:7083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:31.390191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554427831211896:6076]
2025-10-02T09:30:31.390525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:31.390682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:31.390704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:31.390876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:31.390905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.390908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.390909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.390910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.390910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.390911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.390911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.390912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.390912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.390912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.390913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.390913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.390916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.390922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.390924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.390926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.390928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.390930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.390932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.390934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.390936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.390939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.390941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.390943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.390946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.390950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.390953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.390956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.390958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.390961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.390963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.390966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.390970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.390972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.390982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.390984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.390987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.390989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.390995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.390998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.391000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.391003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.391005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.391007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.391011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.391017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.391019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.391021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.391037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:31.391677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554427906736062:7083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:31.396363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554427906736062:7083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:31.396374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554427906736062:7083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:31.396377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554427906736062:7083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:31.396382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:31.398449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:31.399835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:31.399844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:31.399845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:31.399847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:31.399851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [2:7556554427831211896:6076]
2025-10-02T09:30:31.399858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:31.399871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:31.399876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.399877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.399878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.399887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:31.399890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:31.399897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:31.399928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.399933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.399934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.399936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:31.399937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:31.399976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:31.399981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.399987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.399992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.400004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:31.400019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736102:7083], now have 1 active actors on pipe
2025-10-02T09:30:31.400024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736002:2446], now have 1 active actors on pipe
2025-10-02T09:30:31.400028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.400029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.400030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.400039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:31.400049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:31.400050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:31.400052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:31.400053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:31.400059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:31.400061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:31.400040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 770
2025-10-02T09:30:31.400060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 770
2025-10-02T09:30:31.400079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.400086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:31.400090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:31.400094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.400096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.400126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95414b99-ceeeea79-d731411e-163e691f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:31.400133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.400135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.400137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:31.400142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.400150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:31.400161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.400249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.400254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.400262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.400319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 36 sessionId: src_id|95414b99-ceeeea79-d731411e-163e691f_0
2025-10-02T09:30:31.400550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2c43de-6f995522-f174901b-3128b37f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95414b99-ceeeea79-d731411e-163e691f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:31.402743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Write session: try to update token
2025-10-02T09:30:31.402753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:31.409887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:31.409903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.409905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:31.409906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:31.409911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.409914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.409916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554427831211891:6076]
2025-10-02T09:30:31.409941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:31.409943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:31.409945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.409946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:31.409946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:31.409950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:31.410057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.413694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|95414b99-ceeeea79-d731411e-163e691f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:31.415852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:31.482916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906736132:6694]
2025-10-02T09:30:31.483093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7556554427906736132:6694]
2025-10-02T09:30:31.530356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:31.530577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.530587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.530611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736132:6694], now have 1 active actors on pipe
2025-10-02T09:30:31.530729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:31.530780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906736132:6694]
2025-10-02T09:30:31.530804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:31.531148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:31.531200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95414b99-ceeeea79-d731411e-163e691f_0
2025-10-02T09:30:31.531327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|95414b99-ceeeea79-d731411e-163e691f_0 is DEAD
2025-10-02T09:30:31.531471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:31.531484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Write session will restart in 0.006958s
2025-10-02T09:30:31.531514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Write session: Do CDS request
2025-10-02T09:30:31.531520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:31.537021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:31.538205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:31.538305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:31.538312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:31.538318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:31.538342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:31.538366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554427831212032:6090]
2025-10-02T09:30:31.538714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:31.538870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:31.538894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:31.539100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:31.539131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.539136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.539136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.539137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.539137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.539138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.539138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.539139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.539139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.539140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.539140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.539141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.539144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.539150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.539152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.539154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.539177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.539157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.539159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.539161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.539163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.539165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.539167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.539169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.539171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.539174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.539179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.539182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.539185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.539187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.539190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.539192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.539194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.539197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.539199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.539202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.539204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.539207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.539209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.539211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.539214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.539217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.539220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.539222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.539225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.539227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.539230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.539233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.539236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.539228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:31.539253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:31.539236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-10-02T09:30:31.539348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.539367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:31.539373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:31.539376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:31.539645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-10-02T09:30:31.539668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:31.539669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:31.539670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:31.539674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554427906736202:7096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:31.540016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554427906736202:7096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:31.541850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554427906736202:7096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:31.545644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554427906736202:7096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:31.545653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554427906736202:7096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:31.545655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554427906736202:7096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:31.545659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:31.546883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:31.548420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:31.548433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:31.548434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:31.548436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:31.548441Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [2:7556554427831212032:6090]
2025-10-02T09:30:31.548453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:31.548467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:31.548474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.548477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.548479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.548490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:31.548500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:31.548505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:31.548549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.548554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.548556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.548559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:31.548561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:31.548600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:31.548605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.548611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.548617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.548628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:31.548641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736237:7096], now have 1 active actors on pipe
2025-10-02T09:30:31.548647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736137:2446], now have 1 active actors on pipe
2025-10-02T09:30:31.548650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.548651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.548652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.548660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:31.548668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:31.548670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:31.548676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:31.548677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:31.548678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:31.548680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:31.548693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.548698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:31.548700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:31.548698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 771
2025-10-02T09:30:31.548714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 771
2025-10-02T09:30:31.548733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.548740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.548761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:31.548771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.548778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.548784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:31.548791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.549138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:31.549156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.549284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.549293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.549304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.549355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0
2025-10-02T09:30:31.549623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95414b99-ceeeea79-d731411e-163e691f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:31.552273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Write session: try to update token
2025-10-02T09:30:31.552283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:31.561989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:31.562005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.562011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.562040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:31.562039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:31.562179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:31.562296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:31.562408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:31.562517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:31.562668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:31.562697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:31.563612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:31.565569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:31.565646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.565656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.566486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:31.566508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:31.566517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.566518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:31.566519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:31.566524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.566526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.566528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554427831212027:6090]
2025-10-02T09:30:31.566543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:31.566545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:31.566546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:31.566548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:31.566549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.566551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:31.566651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.566670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:31.630892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906736256:6694]
2025-10-02T09:30:31.631120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7556554427906736256:6694]
2025-10-02T09:30:31.682148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:31.688092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.688111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.688237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.688290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.688344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.688395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.688434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.688445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.688497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.688548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.688602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.688653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.688691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.688697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.688748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.688796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.688862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.688913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.688950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.688955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.689006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.689060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.689112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.689184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.689224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.689229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.689281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.689331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.689382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.689466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.689504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.689508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.689563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.689633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.689706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.689758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.689808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.689813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.689941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.689993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.690046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.690098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.690135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.690141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.690192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.690243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.690293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.690345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.690382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.690389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.690499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.690548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.690617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.690666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.690703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.690708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.690762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:31.690823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:31.690872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:31.690924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:31.690960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:31.690965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:31.691006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736256:6694], now have 1 active actors on pipe
2025-10-02T09:30:31.691225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:31.691259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906736256:6694]
2025-10-02T09:30:31.691270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:31.691273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:31.691306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: error at write: Disconnected sessionId: src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0
2025-10-02T09:30:31.691485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0 is DEAD
2025-10-02T09:30:31.691604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:31.691615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Write session will restart in 0.008600s
2025-10-02T09:30:31.691635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Write session: Do CDS request
2025-10-02T09:30:31.691642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:31.691657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:31.699491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:31.700835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:31.700985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:31.700993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:31.701000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:31.701035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:31.701061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554427831212145:6093]
2025-10-02T09:30:31.701184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.701290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:31.701301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-10-02T09:30:31.701406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.701420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:31.701431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:31.701440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:31.701443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:31.701683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:31.701713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:31.701820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-10-02T09:30:31.701848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:31.701854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:31.701856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:31.701860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554427906736322:7101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:31.701967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:31.702021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.702028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.702029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.702030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.702031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.702031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.702033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.702034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.702034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.702035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.702038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.702044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.702047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.702050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.702052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.702054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.702056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.702059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.702061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.702063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.702065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.702067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.702072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.702076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.702081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.702085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.702087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.702090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.702093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.702096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.702098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.702101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.702103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.702106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.702109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.702112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.702114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.702117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.702119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.702122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.702125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.702128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.702130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.702133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.702135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.702138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.702156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:31.702456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554427906736322:7101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:31.704242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554427906736322:7101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:31.709708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554427906736322:7101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:31.709719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554427906736322:7101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:31.709722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554427906736322:7101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:31.709728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:31.710207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:31.711646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:31.711659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:31.711661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:31.711664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:31.711669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [2:7556554427831212145:6093]
2025-10-02T09:30:31.711682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:31.711698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:31.711704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.711705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.711707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.711716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:31.711719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:31.711724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:31.711757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.711762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.711763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.711765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:31.711766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:31.711811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:31.711816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.711822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.711828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.711836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:31.711848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736258:2446], now have 1 active actors on pipe
2025-10-02T09:30:31.711854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736359:7101], now have 1 active actors on pipe
2025-10-02T09:30:31.711858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.711859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.711861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.711869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:31.711876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:31.711883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:31.711885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:31.711885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:31.711887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:31.711887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:31.711902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.711905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:31.711898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 772
2025-10-02T09:30:31.711903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 772
2025-10-02T09:30:31.711920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:31.711945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.711951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.711966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:31.711973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.711975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.711976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:31.711981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.711987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:31.711994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.712085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.712090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.712098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.712149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0
2025-10-02T09:30:31.712373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9874efe-d4239b73-f51c8d58-74516fa5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:31.714715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Write session: try to update token
2025-10-02T09:30:31.714727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:31.721485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:31.721503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.721510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.721544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:31.721552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:31.721689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:31.721811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:31.721931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:31.722055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:31.722234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:31.722270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:31.727989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:31.730288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:31.730691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.730709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.730721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:31.730723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.730725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:31.730726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:31.730732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.730734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.730737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554427831212140:6093]
2025-10-02T09:30:31.730764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:31.730768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:31.730772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.730772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:31.730773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:31.730778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:31.730885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.791647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906736373:6694]
2025-10-02T09:30:31.791838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7556554427906736373:6694]
2025-10-02T09:30:31.855633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:31.855930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:31.855955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736373:6694], now have 1 active actors on pipe
2025-10-02T09:30:31.856065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:31.856098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906736373:6694]
2025-10-02T09:30:31.856116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:31.856161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:31.856170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:31.856235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0
2025-10-02T09:30:31.856370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0 is DEAD
2025-10-02T09:30:31.856492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:31.856501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Write session will restart in 0.005564s
2025-10-02T09:30:31.856516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Write session: Do CDS request
2025-10-02T09:30:31.856523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:31.863232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.863294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:31.863308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-10-02T09:30:31.863427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:31.863466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:31.863475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:31.863479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:31.863836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-10-02T09:30:31.863868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:31.863874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:31.863876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:31.863880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554427906736440:7106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:31.863930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:31.864348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554427906736440:7106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:31.865443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:31.865560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:31.865567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:31.865573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:31.865606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:31.865657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554427831212248:6095]
2025-10-02T09:30:31.866048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554427906736440:7106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:31.866052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:31.866266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:31.866295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:31.866495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:31.866531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.866535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.866535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.866536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.866536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.866537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.866538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.866538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.866539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.866540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.866540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.866540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.866543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.866549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.866551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.866553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.866555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.866557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.866559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.866561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.866563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.866566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.866568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.866569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.866573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.866577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:31.866580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.866583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:31.866585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.866588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:31.866591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.866594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:31.866596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.866599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:31.866602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.866605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:31.866608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.866610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:31.866613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.866615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:31.866617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.866620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:31.866622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.866625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.866627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.866630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.866633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.866636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.866658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:31.870913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554427906736440:7106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:31.870925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554427906736440:7106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:31.870928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554427906736440:7106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:31.870934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:31.874704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:31.876218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:31.876232Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:31.876235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:31.876238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:31.876242Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [2:7556554427831212248:6095]
2025-10-02T09:30:31.876251Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:31.876262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:31.876264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.876266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.876267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.876277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:31.876283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:31.876288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:31.876327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.876332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.876334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.876336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:31.876338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:31.876384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:31.876392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.876403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:31.876413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:31.876428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:31.876449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736480:7106], now have 1 active actors on pipe
2025-10-02T09:30:31.876455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736378:2446], now have 1 active actors on pipe
2025-10-02T09:30:31.876458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.876460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.876461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.876472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:31.876485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:31.876487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:31.876493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:31.876495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:31.876500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:31.876503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:31.876525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.876498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 773
2025-10-02T09:30:31.876501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 773
2025-10-02T09:30:31.876527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:31.876529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:31.876540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.876543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.876573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:31.876578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:31.876587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:31.876589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:31.876595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:31.876603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:31.876616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.876718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:31.876724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:31.876732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:31.876782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0
2025-10-02T09:30:31.877073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f78c729-9e4e8303-15512ee6-9dae4e67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:31.879487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Write session: try to update token
2025-10-02T09:30:31.879499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:31.886662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:31.886677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:31.886679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:31.886681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:31.886687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.886690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.886692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554427831212243:6095]
2025-10-02T09:30:31.886723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:31.886726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:31.886728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:31.886729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:31.886730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:31.886732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:31.886850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:31.890737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:31.893047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:31.956005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554427906736487:6694]
2025-10-02T09:30:31.956221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7556554427906736487:6694]
2025-10-02T09:30:32.009639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.009918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.009929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.009956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554427906736487:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.010135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554427906736487:6694]
2025-10-02T09:30:32.010141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.010161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.010169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.010181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.010217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0
2025-10-02T09:30:32.010366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0 is DEAD
2025-10-02T09:30:32.010496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.010506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Write session will restart in 0.007420s
2025-10-02T09:30:32.010524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Write session: Do CDS request
2025-10-02T09:30:32.010530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.017290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.018568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.018701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.018709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.018716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.018756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.018785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126179648:6098]
2025-10-02T09:30:32.019309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.019303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.019401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.019423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-10-02T09:30:32.019526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.019551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.019559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.019563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.019560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.019606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.019887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.019918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-10-02T09:30:32.019935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.019940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.019941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.019942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.019943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.019944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.019944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.019945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.019946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.019947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.019948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.019949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.019953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.019963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.019967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.019957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.019970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.019964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.019973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.019977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.019965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.019981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.019984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.019970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201703850:7110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.019988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.019991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.019995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.019998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.020004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.020010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.020015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.020019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.020028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.020033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.020041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.020045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.020052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.020056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.020065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.020070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.020078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.020087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.020091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.020096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.020104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.020109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.020117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.020122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.020128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.020132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.020140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.020144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.020181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.020341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201703850:7110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.022144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201703850:7110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.026966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201703850:7110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.026987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201703850:7110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.026992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201703850:7110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.026998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.028240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.029794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.029809Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.029812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.029815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.029821Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [2:7556554432126179648:6098]
2025-10-02T09:30:32.029832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.029844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.029846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.029848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.029849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.029863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.029866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.029871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.029909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.029914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.029916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.029917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.029919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.029965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.029970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.029977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.029982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.029993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.030011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201703784:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.030019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201703888:7110], now have 1 active actors on pipe
2025-10-02T09:30:32.030025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.030027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.030029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.030040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.030049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.030051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.030052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.030053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.030061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.030043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 774
2025-10-02T09:30:32.030063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.030045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 774
2025-10-02T09:30:32.030088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.030096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.030103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.030110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.030112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.030141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.030149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.030151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.030152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.030159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.030165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.030180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.030294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.030299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.030306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.030352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 36 sessionId: src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0
2025-10-02T09:30:32.030640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b91a807-4b0a88af-b3de7b43-96d66c09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.033007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Write session: try to update token
2025-10-02T09:30:32.033022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.040213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.040233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.040235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.040237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.040245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.040249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.040252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126179643:6098]
2025-10-02T09:30:32.040289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.040294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.040295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.040296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.040299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.040301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.040430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.045265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.047342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:32.110113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554432201703895:6694]
2025-10-02T09:30:32.110311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7556554432201703895:6694]
2025-10-02T09:30:32.160228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.160476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.160485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.160512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201703895:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.160684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554432201703895:6694]
2025-10-02T09:30:32.160691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.160707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.160709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.160753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0
2025-10-02T09:30:32.160776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.160904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0 is DEAD
2025-10-02T09:30:32.161087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.161096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Write session will restart in 0.008464s
2025-10-02T09:30:32.161113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Write session: Do CDS request
2025-10-02T09:30:32.161117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.168576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.169878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.169988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.169995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.170001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.170030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.170058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126179754:6100]
2025-10-02T09:30:32.170234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.170332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.170342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-10-02T09:30:32.170433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.170440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.170459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.170462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.170465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.170634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.170657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.170729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-10-02T09:30:32.170754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.170759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.170760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.170763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201703965:7115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.170837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.170865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.170869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.170870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.170871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.170871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.170872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.170873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.170873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.170874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.170874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.170875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.170875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.170878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.170884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.170887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.170889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.170891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.170893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.170894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.170897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.170898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.170901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.170903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.170905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.170908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.170912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.170915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.170918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.170920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.170923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.170925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.170928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.170930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.170932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.170934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.170937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.170939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.170942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.170947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.170949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.170953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.170958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.170962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.170965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.170970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.170973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.170988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.170991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.171007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.171130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201703965:7115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.172381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201703965:7115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.176304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201703965:7115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.176314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201703965:7115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.176316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201703965:7115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.176320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.178449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.179915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.179929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.179931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.179933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.179936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [2:7556554432126179754:6100]
2025-10-02T09:30:32.179944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.179954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.179955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.179957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.179958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.179967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.179970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.179974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.180006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.180012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.180013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.180014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.180016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.180052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.180057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.180064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.180070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.180081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.180095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704002:7115], now have 1 active actors on pipe
2025-10-02T09:30:32.180101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201703898:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.180106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.180108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.180110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.180117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.180126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.180128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.180133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.180135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.180136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.180142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.180150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.180156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.180157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.180143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 775
2025-10-02T09:30:32.180175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.180180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.180162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 775
2025-10-02T09:30:32.180198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1683aa98-8814dc6-96754454-41d70004_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.180205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.180207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.180208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.180214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.180222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.180232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.180323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.180330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.180337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.180394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 36 sessionId: src_id|1683aa98-8814dc6-96754454-41d70004_0
2025-10-02T09:30:32.180634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fcdcb4-5a63ec5a-aa3c6815-60e54f2d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1683aa98-8814dc6-96754454-41d70004_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.183031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Write session: try to update token
2025-10-02T09:30:32.183044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.189759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.189778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.189780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.189781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.189787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.189789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.189794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126179749:6100]
2025-10-02T09:30:32.189818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.189823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.189827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.189828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.189829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.189830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.189969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.194680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|1683aa98-8814dc6-96754454-41d70004_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.196767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:32.260675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554432201704010:6694]
2025-10-02T09:30:32.260897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7556554432201704010:6694]
2025-10-02T09:30:32.306157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.306410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.306419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.306446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704010:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.306642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554432201704010:6694]
2025-10-02T09:30:32.306678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.306681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.306683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.306732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|1683aa98-8814dc6-96754454-41d70004_0
2025-10-02T09:30:32.306853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.306891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|1683aa98-8814dc6-96754454-41d70004_0 is DEAD
2025-10-02T09:30:32.307037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.307050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Write session will restart in 0.005007s
2025-10-02T09:30:32.307073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Write session: Do CDS request
2025-10-02T09:30:32.307080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.313172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.313218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.313231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-10-02T09:30:32.313352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.313382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.313389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.313393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.313762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-10-02T09:30:32.313746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.313794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.313799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.313801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.313807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201704076:7119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.314285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201704076:7119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.314959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.315071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.315079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.315085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.315113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.315138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126179859:6103]
2025-10-02T09:30:32.315490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.315661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.315694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.315868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201704076:7119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.315961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.316020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.316025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.316026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.316027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.316028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.316029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.316030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.316031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.316031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.316032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.316033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.316034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.316038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.316046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.316049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.316052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.316055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.316058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.316061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.316064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.316066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.316070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.316073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.316076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.316081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.316091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.316100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.316108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.316112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.316116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.316119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.316127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.316130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.316137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.316140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.316148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.316156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.316163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.316170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.316175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.316184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.316192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.316199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.316207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.316212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.316220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.316228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.316236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.316270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.320853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201704076:7119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.320864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201704076:7119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.320866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201704076:7119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.320871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.324057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.325753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.325767Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.325769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.325771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.325776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [2:7556554432126179859:6103]
2025-10-02T09:30:32.325786Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.325797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.325802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.325805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.325806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.325816Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.325822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.325827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.325859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.325864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.325865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.325867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.325868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.325909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.325914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.325921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.325926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.325935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.325950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704011:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.325955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704116:7119], now have 1 active actors on pipe
2025-10-02T09:30:32.325959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.325960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.325961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.325969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.325980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.325989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.325991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.325992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.325976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 776
2025-10-02T09:30:32.325997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.325978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 776
2025-10-02T09:30:32.325999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.326019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.326025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.326032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.326042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.326057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.326061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.326066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.326069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.326070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.326075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.326083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.326102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.326234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.326239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.326248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.326311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0
2025-10-02T09:30:32.326585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1683aa98-8814dc6-96754454-41d70004_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.328993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Write session: try to update token
2025-10-02T09:30:32.329006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.335796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.335812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.335814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.335815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.335820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.335824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.335829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126179854:6103]
2025-10-02T09:30:32.335853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.335857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.335858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.335876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.335880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.335883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.335966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.340727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.342795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:32.406561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554432201704124:6694]
2025-10-02T09:30:32.406739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7556554432201704124:6694]
2025-10-02T09:30:32.458489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.458764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.458773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.458799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704124:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.458943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.459017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.459027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.459040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.459072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554432201704124:6694]
2025-10-02T09:30:32.459076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: error at write: Disconnected sessionId: src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0
2025-10-02T09:30:32.459202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0 is DEAD
2025-10-02T09:30:32.459336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.459341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Write session will restart in 0.008231s
2025-10-02T09:30:32.459358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Write session: Do CDS request
2025-10-02T09:30:32.459363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.466571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.467836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.467950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.467957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.467963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.467991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.468015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126179964:6105]
2025-10-02T09:30:32.468141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.468205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.468212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-10-02T09:30:32.468300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.468318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.468324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.468326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.468362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.468525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.468548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.468598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-10-02T09:30:32.468621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.468625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.468626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.468629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201704194:7123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.468722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.468749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.468753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.468753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.468754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.468754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.468755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.468756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.468756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.468757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.468757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.468758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.468758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.468761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.468767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.468769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.468772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.468774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.468776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.468778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.468780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.468781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.468783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.468785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.468787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.468791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.468795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.468813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.468818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.468822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.468826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.468829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.468838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.468844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.468846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.468848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.468851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.468853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.468855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.468857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.468860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.468862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.468865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.468867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.468869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.468874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.468877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.468880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.468889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.468906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.469020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201704194:7123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.470515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201704194:7123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.475193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201704194:7123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.475202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201704194:7123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.475204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201704194:7123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.475207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.476378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.477858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.477870Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.477871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.477873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.477877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [2:7556554432126179964:6105]
2025-10-02T09:30:32.477885Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.477895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.477896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.477898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.477899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.477908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.477912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.477916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.477944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.477951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.477952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.477954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.477955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.477993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.477998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.478004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.478009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.478020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.478036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704231:7123], now have 1 active actors on pipe
2025-10-02T09:30:32.478041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704125:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.478044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.478045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.478046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.478053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.478061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.478066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.478068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.478069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.478074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.478075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.478083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.478084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.478086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.478106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 777
2025-10-02T09:30:32.478125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 777
2025-10-02T09:30:32.478152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.478159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.478174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c4659be-db50e833-8af0354f-aa2f314c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.478178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.478180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.478181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.478187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.478192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.478202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.478292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.478297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.478304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.478366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c4659be-db50e833-8af0354f-aa2f314c_0
2025-10-02T09:30:32.478585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c052340-6783ba35-f09bfa0-736ea8fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c4659be-db50e833-8af0354f-aa2f314c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.481167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Write session: try to update token
2025-10-02T09:30:32.481178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.488237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:32.488258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.488265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.488290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:32.488300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:32.488443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:32.488755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:32.489210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:32.489351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:32.490140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:32.490183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:32.493114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|5c4659be-db50e833-8af0354f-aa2f314c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.495598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:32.495752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.495765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.495788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:32.495857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:32.496933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.496945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.496947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.496949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.496954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.496957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.496959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126179959:6105]
2025-10-02T09:30:32.496981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.496984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.496987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.496988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.496989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.496989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.497097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.559135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554432201704261:6694]
2025-10-02T09:30:32.559317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7556554432201704261:6694]
2025-10-02T09:30:32.617272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.623601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.623624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.623748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.623803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.623857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.623909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.624401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.624412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.624465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.624514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.624571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.624627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.624666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.624671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.624723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.624772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.624845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.624897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.624933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.624939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.624991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.625048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.625112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.625166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.625204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.625209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.625282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.625336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.625390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.625443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.625493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.625498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.625593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.625640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.625689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.625741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.625779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.625784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.625839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.625890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.625943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.625996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.626033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.626038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.626097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.626152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.626201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.626252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.626290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.626295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.626351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.626402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.626450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.626497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.626533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.626538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.626591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:32.626642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:32.626690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:32.626738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:32.626774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:32.626780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:32.626812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704261:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.627030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.627035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.627038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.627058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: error at write: Disconnected sessionId: src_id|5c4659be-db50e833-8af0354f-aa2f314c_0
2025-10-02T09:30:32.627074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554432201704261:6694]
2025-10-02T09:30:32.627186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.627205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|5c4659be-db50e833-8af0354f-aa2f314c_0 is DEAD
2025-10-02T09:30:32.627331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.627337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Write session will restart in 0.008965s
2025-10-02T09:30:32.627351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Write session: Do CDS request
2025-10-02T09:30:32.627355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.634670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.635008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.635114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.635120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.635126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.635154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.635180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126180118:6120]
2025-10-02T09:30:32.635561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.636052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.636088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.636278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.636310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.636311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.636312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.636313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.636314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.636315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.636316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.636317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.636317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.636318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.636319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.636320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.636324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.636334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.636338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.636341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.636345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.636348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.636351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.636353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.636355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.636358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.636360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.636362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.636366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.636370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.636373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.636376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.636379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.636381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.636383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.636386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.636388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.636391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.636393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.636395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.636397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.636400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.636402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.636404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.636407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.636410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.636412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.636414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.636417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.636421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.636423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.636425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.636441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.637195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.637274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.637285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-10-02T09:30:32.637366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.637385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.637392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.637394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.637668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-10-02T09:30:32.637695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.637700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.637701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.637705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201704347:7135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.638054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201704347:7135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.639533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201704347:7135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.643709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201704347:7135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.643720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201704347:7135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.643723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201704347:7135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.643730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.644198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.645613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.645626Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.645628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.645630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.645633Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [2:7556554432126180118:6120]
2025-10-02T09:30:32.645642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.645653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.645654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.645656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.645657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.645667Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.645670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.645676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.645720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.645727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.645729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.645731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.645733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.645772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.645777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.645784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.645789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.645797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.645810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704274:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.645815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704382:7135], now have 1 active actors on pipe
2025-10-02T09:30:32.645819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.645821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.645822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.645829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.645837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.645842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.645844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.645846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.645848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.645850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.645841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 778
2025-10-02T09:30:32.645868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.645873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.645847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 778
2025-10-02T09:30:32.645874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.645885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.645890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.645917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.645923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.645925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.645927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.645933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.645938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.645952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.646070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.646074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.646082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.646128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 36 sessionId: src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0
2025-10-02T09:30:32.646360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c4659be-db50e833-8af0354f-aa2f314c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.648602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Write session: try to update token
2025-10-02T09:30:32.648612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.655554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.655567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.655569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.655570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.655576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.655579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.655582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126180113:6120]
2025-10-02T09:30:32.655606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.655610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.655610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.655611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.655613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.655616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.655730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.659831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.661891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:32.727083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554432201704390:6694]
2025-10-02T09:30:32.727312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7556554432201704390:6694]
2025-10-02T09:30:32.770233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.770498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.770507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.770530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704390:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.770639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.770643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.770648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554432201704390:6694]
2025-10-02T09:30:32.770664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.770666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.770720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: error at write: Disconnected sessionId: src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0
2025-10-02T09:30:32.770842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0 is DEAD
2025-10-02T09:30:32.770967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.770982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Write session will restart in 0.006817s
2025-10-02T09:30:32.771010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Write session: Do CDS request
2025-10-02T09:30:32.771014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.776824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.778012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.778114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.778120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.778126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.778150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.778175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126180225:6122]
2025-10-02T09:30:32.778547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.778725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.778749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.778927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.778955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.778958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.778959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.778960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.778960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.778961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.778961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.778962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.778962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.778962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.778963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.778964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.778967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.778984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.778987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.778989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.778991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.778993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.778995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.778997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.778999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.779001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.779003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.779004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.779008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.779012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.779015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.779018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.779020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.779023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.779025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.779027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.779029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.779033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.779035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.779038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.779040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.779043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.779045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.779047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.779049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.779052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.779053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.779056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.779061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.779064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.779066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.779068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.779086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.779122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.779458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.779467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-10-02T09:30:32.779570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.779597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.779602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.779604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.779854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-10-02T09:30:32.779876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.779882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.779883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.779887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201704471:7140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.780270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201704471:7140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.781790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201704471:7140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.785985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201704471:7140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.785994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201704471:7140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.785997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201704471:7140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.786001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.786530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.788005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.788016Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.788018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.788020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.788023Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [2:7556554432126180225:6122]
2025-10-02T09:30:32.788032Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.788046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.788051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.788052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.788053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.788062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.788068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.788072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.788102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.788107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.788108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.788109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.788111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.788154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.788159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.788165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.788170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.788181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.788196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704506:7140], now have 1 active actors on pipe
2025-10-02T09:30:32.788201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704396:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.788204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.788205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.788206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.788210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.788217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.788217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.788219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.788221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.788227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.788229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.788221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 779
2025-10-02T09:30:32.788242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.788223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 779
2025-10-02T09:30:32.788247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.788249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.788262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.788267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.788285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61abc85d-8b605f98-ddfad316-b8d58727_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.788292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.788294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.788295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.788302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.788309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.788320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.788403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.788408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.788415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.788462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 36 sessionId: src_id|61abc85d-8b605f98-ddfad316-b8d58727_0
2025-10-02T09:30:32.788674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f8620a-2d11e0b2-6697b11-7a476bda_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61abc85d-8b605f98-ddfad316-b8d58727_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.790919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Write session: try to update token
2025-10-02T09:30:32.790930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.797476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.797492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.797493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.797495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.797500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.797503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.797505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126180220:6122]
2025-10-02T09:30:32.797530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.797533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.797537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.797537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.797539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.797539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.797656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.801661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|61abc85d-8b605f98-ddfad316-b8d58727_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.804077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:32.870941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554432201704517:6694]
2025-10-02T09:30:32.871125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7556554432201704517:6694]
2025-10-02T09:30:32.915288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:32.915543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.915554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.915582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704517:6694], now have 1 active actors on pipe
2025-10-02T09:30:32.915729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:32.915783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:32.915794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:32.915807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:32.915842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554432201704517:6694]
2025-10-02T09:30:32.915845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: error at write: Disconnected sessionId: src_id|61abc85d-8b605f98-ddfad316-b8d58727_0
2025-10-02T09:30:32.915975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|61abc85d-8b605f98-ddfad316-b8d58727_0 is DEAD
2025-10-02T09:30:32.916118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:32.916125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Write session will restart in 0.006082s
2025-10-02T09:30:32.916146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Write session: Do CDS request
2025-10-02T09:30:32.916152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:32.922801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:32.923242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.923325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:32.923337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-10-02T09:30:32.923422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:32.923442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:32.923448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:32.923451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:32.923784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-10-02T09:30:32.923815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:32.923821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:32.923823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:32.923827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554432201704588:7144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:32.924210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:32.924271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554432201704588:7144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:32.924317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:32.924326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:32.924334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:32.924367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:32.924389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554432126180335:6125]
2025-10-02T09:30:32.924828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:32.925004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:32.925027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:32.925218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:32.925252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.925256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.925256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.925257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.925257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.925258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.925258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.925259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.925259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.925260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.925260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.925261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.925264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.925269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.925271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.925274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.925276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.925278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.925280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.925282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.925284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.925286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.925288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.925290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.925294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.925298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:32.925301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.925304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:32.925306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.925309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:32.925311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.925314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:32.925317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.925320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:32.925322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.925325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:32.925327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.925330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:32.925333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.925342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:32.925345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.925354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:32.925360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.925363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.925366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.925373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.925375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.925377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.925398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:32.925650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554432201704588:7144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:32.930319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554432201704588:7144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:32.930330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554432201704588:7144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:32.930333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554432201704588:7144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:32.930338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:32.932948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:32.934300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:32.934315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:32.934317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:32.934320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:32.934323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [2:7556554432126180335:6125]
2025-10-02T09:30:32.934331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:32.934345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:32.934349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.934351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.934352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.934361Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:32.934366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:32.934370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:32.934404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.934409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.934410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.934412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:32.934414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:32.934453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:32.934458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.934465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:32.934470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:32.934481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:32.934496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704518:2446], now have 1 active actors on pipe
2025-10-02T09:30:32.934501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554432201704627:7144], now have 1 active actors on pipe
2025-10-02T09:30:32.934505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.934507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.934508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.934518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:32.934529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:32.934531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:32.934533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:32.934534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:32.934540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:32.934541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:32.934524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 780
2025-10-02T09:30:32.934528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 780
2025-10-02T09:30:32.934562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.934571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:32.934575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:32.934583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.934588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.934663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:32.934670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:32.934673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:32.934674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:32.934679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:32.934684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:32.934700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.934802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:32.934811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:32.934822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:32.934882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 36 sessionId: src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0
2025-10-02T09:30:32.935101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61abc85d-8b605f98-ddfad316-b8d58727_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:32.937489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Write session: try to update token
2025-10-02T09:30:32.937502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:32.943850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:32.943864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:32.943866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:32.943867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:32.943872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.943874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.943878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554432126180330:6125]
2025-10-02T09:30:32.943902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:32.943905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:32.943906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:32.943906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:32.943909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:32.943911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:32.944012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:32.948572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:32.950958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.015843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496671930:6694]
2025-10-02T09:30:33.016039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7556554436496671930:6694]
2025-10-02T09:30:33.056861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.057071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.057081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.057106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496671930:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.057252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.057280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.057312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496671930:6694]
2025-10-02T09:30:33.057313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:33.057369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0
2025-10-02T09:30:33.057491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0 is DEAD
2025-10-02T09:30:33.057621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:33.057627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Write session will restart in 0.006751s
2025-10-02T09:30:33.057644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Write session: Do CDS request
2025-10-02T09:30:33.057648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.064185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.065133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.065188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.065200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-10-02T09:30:33.065292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.065311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.065318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.065321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.065342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.065469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.065476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.065482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.065511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.065534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421147740:6127]
2025-10-02T09:30:33.065647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-10-02T09:30:33.065670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.065674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.065675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.065678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672003:7148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.066056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672003:7148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.066146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.066312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.066335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.066608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.066639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.066643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.066644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.066645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.066645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.066646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.066646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.066647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.066648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.066648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.066649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.066649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.066652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.066658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.066661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.066663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.066665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.066667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.066669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.066671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.066673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.066675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.066677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.066679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.066683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.066687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.066690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.066693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.066695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.066698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.066700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.066703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.066706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.066708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.066711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.066713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.066716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.066718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.066720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.066723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.066726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.066729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.066731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.066734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.066736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.066739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.066741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.066744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.066763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.067400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672003:7148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.072501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672003:7148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.072512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672003:7148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.072514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672003:7148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.072519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.074155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.075467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.075479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.075480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.075482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.075485Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [2:7556554436421147740:6127]
2025-10-02T09:30:33.075492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.075502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.075507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.075509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.075510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.075519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.075525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.075530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.075563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.075567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.075568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.075570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.075571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.075607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.075611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.075617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.075623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.075633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.075646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672042:7148], now have 1 active actors on pipe
2025-10-02T09:30:33.075652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496671932:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.075655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.075657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.075658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.075665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.075674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.075676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.075678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.075679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.075685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.075686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.075681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 781
2025-10-02T09:30:33.075685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 781
2025-10-02T09:30:33.075701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.075705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.075707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.075717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.075721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.075746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.075752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.075755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.075759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.075764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.075770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.075781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.075856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.075860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.075867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.075932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0
2025-10-02T09:30:33.076108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96394d2-53c5ee53-5694fa5c-58235c12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.078231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Write session: try to update token
2025-10-02T09:30:33.078240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.085380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.085394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.085395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.085397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.085402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.085405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.085407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421147735:6127]
2025-10-02T09:30:33.085430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.085433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.085434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.085436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.085436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.085438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.085540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:33.088815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:33.090777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.157674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496672049:6694]
2025-10-02T09:30:33.157875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7556554436496672049:6694]
2025-10-02T09:30:33.203906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.204200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.204209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.204235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672049:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.204359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.204369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:33.204369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.204380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:33.204417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496672049:6694]
2025-10-02T09:30:33.204428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: error at write: Disconnected sessionId: src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0
2025-10-02T09:30:33.204561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0 is DEAD
2025-10-02T09:30:33.204676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:33.204680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Write session will restart in 0.005227s
2025-10-02T09:30:33.204696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Write session: Do CDS request
2025-10-02T09:30:33.204700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.210875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.211163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.211242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.211252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-10-02T09:30:33.211328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.211347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.211353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.211356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.211622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-10-02T09:30:33.211656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.211662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.211663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.211666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672125:7153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.212012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672125:7153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.212042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.212148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.212155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.212160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.212187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.212210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421147853:6130]
2025-10-02T09:30:33.212548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.212747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.212769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.212973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.213020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.213026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.213027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.213027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.213028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.213029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.213030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.213031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.213032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.213032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.213033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.213034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.213039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.213048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.213051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.213054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.213058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.213061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.213064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.213067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.213070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.213074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.213077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.213080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.213085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.213090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.213095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.213099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.213103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.213106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.213108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.213111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.213114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.213116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.213118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.213122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.213125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.213127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.213129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.213132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.213134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.213137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.213139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.213141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.213143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.213146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.213148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.213150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.213167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.213503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672125:7153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.218072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672125:7153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.218081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672125:7153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.218083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672125:7153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.218088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.220830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.222334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.222351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.222353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.222357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.222362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [2:7556554436421147853:6130]
2025-10-02T09:30:33.222373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.222393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.222396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.222399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.222401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.222413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.222418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.222424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.222468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.222475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.222477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.222480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.222483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.222538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.222545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.222556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.222571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.222589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.222611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672163:7153], now have 1 active actors on pipe
2025-10-02T09:30:33.222618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672053:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.222624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.222630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.222632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.222645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.222624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 782
2025-10-02T09:30:33.222626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 782
2025-10-02T09:30:33.222659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.222666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.222670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.222677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.222678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.222680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.222713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.222721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.222731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.222738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.222748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.222765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.222775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.222782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.222784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.222792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.222800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.222841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.222931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.222938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.222949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.223016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 36 sessionId: src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0
2025-10-02T09:30:33.223262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc5e2c7-ea71509a-3d69f9fc-e69255dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.225645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Write session: try to update token
2025-10-02T09:30:33.225657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.233036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.233054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.233057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.233058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.233069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.233073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.233076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421147848:6130]
2025-10-02T09:30:33.233112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.233113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.233118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.233118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.233121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.233121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.233256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:33.238291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:33.240632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.304629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496672170:6694]
2025-10-02T09:30:33.304893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7556554436496672170:6694]
2025-10-02T09:30:33.359897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.360165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.360179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.360206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672170:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.360343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.360407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:33.360414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.360422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:33.360456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496672170:6694]
2025-10-02T09:30:33.360480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: error at write: Disconnected sessionId: src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0
2025-10-02T09:30:33.360643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0 is DEAD
2025-10-02T09:30:33.360784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:33.360792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Write session will restart in 0.009267s
2025-10-02T09:30:33.360825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Write session: Do CDS request
2025-10-02T09:30:33.360830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.368393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.369808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.369950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.369959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.369968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.370004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.370034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421147963:6132]
2025-10-02T09:30:33.370415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.370639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.370678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.370883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.370911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.370918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.370919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.370920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.370921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.370922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.370923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.370924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.370924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.370925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.370926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.370927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.370931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.370942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.370945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.370948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.370950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.370952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.370954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.370956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.370958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.370960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.370962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.370964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.370968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.370982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.370986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.370988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.370990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.370993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.370995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.370998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.371000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.371003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.371005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.371008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.371010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.371013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.371015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.371018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.371020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.371024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.371026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.371029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.371031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.371034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.371036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.371039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.371056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.371242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.371288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.371299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-10-02T09:30:33.371417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.371439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.371447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.371450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.371743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-10-02T09:30:33.371770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.371774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.371776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.371779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672249:7157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.372118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672249:7157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.373687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672249:7157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.377879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672249:7157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.377892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672249:7157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.377894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672249:7157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.377898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.379435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.381018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.381032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.381035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.381039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.381043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [2:7556554436421147963:6132]
2025-10-02T09:30:33.381055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.381074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.381081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.381083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.381085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.381099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.381108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.381114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.381167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.381175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.381177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.381180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.381182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.381233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.381243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.381253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.381262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.381278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.381298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672172:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.381305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672284:7157], now have 1 active actors on pipe
2025-10-02T09:30:33.381310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.381312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.381315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.381329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.381336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.381338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.381339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.381346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.381332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 783
2025-10-02T09:30:33.381343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 783
2025-10-02T09:30:33.381362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.381369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.381405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.381413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.381428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.381438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.381441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.381461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.381470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.381477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.381479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.381486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.381497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.381517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.381627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.381634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.381645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.381713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0
2025-10-02T09:30:33.381944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd68a5b-e30d075a-ece1df7a-b7d9bdfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.384345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Write session: try to update token
2025-10-02T09:30:33.384356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.391770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.391786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.391788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.391789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.391796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.391799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.391806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421147958:6132]
2025-10-02T09:30:33.391838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.391842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.391843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.391843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.391849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.391852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.391978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:33.396151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:33.398244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.460816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496672291:6694]
2025-10-02T09:30:33.461105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7556554436496672291:6694]
2025-10-02T09:30:33.516386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.516626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.516636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.516663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672291:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.516830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.516908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:33.516920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:33.516967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: error at write: Disconnected sessionId: src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0
2025-10-02T09:30:33.517098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0 is DEAD
2025-10-02T09:30:33.517326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496672291:6694]
2025-10-02T09:30:33.517342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.517361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:33.517370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Write session will restart in 0.007411s
2025-10-02T09:30:33.517384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Write session: Do CDS request
2025-10-02T09:30:33.517388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.526064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.526313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.526364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.526376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-10-02T09:30:33.526503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.526556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.526564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.526570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.526917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-10-02T09:30:33.526949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.526955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.526956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.526961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672380:7167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.527452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672380:7167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.527504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.527665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.527673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.527682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.527738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.527772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421148088:6140]
2025-10-02T09:30:33.528169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.528388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.528417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.528609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.528651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.528656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.528657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.528657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.528658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.528658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.528659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.528660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.528660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.528661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.528661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.528662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.528665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.528671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.528673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.528675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.528677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.528679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.528681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.528684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.528686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.528688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.528691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.528692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.528696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.528700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.528703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.528706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.528709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.528711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.528713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.528716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.528718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.528721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.528723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.528725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.528729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.528734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.528738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.528742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.528747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.528752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.528756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.528761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.528765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.528770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.528773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.528777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.528832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.529038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672380:7167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.533982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672380:7167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.533996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672380:7167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.533999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672380:7167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.534005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.536718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.538323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.538342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.538344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.538347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.538353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [2:7556554436421148088:6140]
2025-10-02T09:30:33.538366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.538382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.538384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.538386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.538388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.538403Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.538407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.538413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.538459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.538466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.538467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.538470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.538472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.538524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.538530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.538543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.538557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.538577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.538597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672305:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.538604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672417:7167], now have 1 active actors on pipe
2025-10-02T09:30:33.538609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.538611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.538613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.538624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.538632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.538638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.538640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.538642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.538629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 784
2025-10-02T09:30:33.538651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.538657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 784
2025-10-02T09:30:33.538654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.538685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.538698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.538702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.538710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.538717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.538824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ed1b592-7fa61914-3298292e-f11c7599_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.538833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.538835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.538836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.538841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.538846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.538859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.538939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.538945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.538953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.539018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ed1b592-7fa61914-3298292e-f11c7599_0
2025-10-02T09:30:33.539278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e9e293-fa4907f-3ccdfe5d-a490d801_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ed1b592-7fa61914-3298292e-f11c7599_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.541516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Write session: try to update token
2025-10-02T09:30:33.541531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.548523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.548540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.548542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.548544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.548550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.548553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.548556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421148083:6140]
2025-10-02T09:30:33.548587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.548589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.548594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.548596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.548598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.548601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.548726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:33.553278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|3ed1b592-7fa61914-3298292e-f11c7599_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:33.555289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.617433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496672446:6694]
2025-10-02T09:30:33.617557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7556554436496672446:6694]
2025-10-02T09:30:33.670090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.670332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.670341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.670368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672446:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.670527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.670552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:33.670563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:33.670571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.670610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496672446:6694]
2025-10-02T09:30:33.670613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: error at write: Disconnected sessionId: src_id|3ed1b592-7fa61914-3298292e-f11c7599_0
2025-10-02T09:30:33.670750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|3ed1b592-7fa61914-3298292e-f11c7599_0 is DEAD
2025-10-02T09:30:33.670891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:33.670900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Write session will restart in 0.008865s
2025-10-02T09:30:33.670917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Write session: Do CDS request
2025-10-02T09:30:33.670921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.677486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.678612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.678729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.678736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.678743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.678772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.678796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421148236:6149]
2025-10-02T09:30:33.679148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.679339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.679362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.679534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.679563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.679567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.679567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.679568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.679569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.679569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.679570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.679570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.679571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.679571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.679572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.679572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.679575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.679582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.679585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.679587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.679589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.679591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.679593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.679595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.679597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.679599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.679600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.679602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.679606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.679610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.679613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.679616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.679618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.679620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.679622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.679625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.679631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.679633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.679635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.679638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.679641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.679646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.679648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.679651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.679653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.679655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.679658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.679660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.679662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.679665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.679671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.679673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.679690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.681148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.681251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.681262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-10-02T09:30:33.681359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.681380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.681384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.681387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.681656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-10-02T09:30:33.681676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.681680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.681681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.681684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672526:7173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.682037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672526:7173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.683362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672526:7173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.686740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672526:7173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.686751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672526:7173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.686754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672526:7173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.686759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.687319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.688714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.688726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.688727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.688729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.688732Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [2:7556554436421148236:6149]
2025-10-02T09:30:33.688740Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.688750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.688755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.688757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.688758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.688768Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.688771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.688779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.688837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.688841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.688843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.688844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.688846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.688885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.688890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.688898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.688907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.688923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.688941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672447:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.688949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672561:7173], now have 1 active actors on pipe
2025-10-02T09:30:33.688955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.688956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.688958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.688969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.688979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 785
2025-10-02T09:30:33.688985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 785
2025-10-02T09:30:33.688980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.688983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.688985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.688986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.688991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.688993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.689009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.689011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.689013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.689025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.689031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.689056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.689063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.689065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.689068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.689072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.689078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.689090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.689176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.689181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.689188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.689227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0
2025-10-02T09:30:33.689419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ed1b592-7fa61914-3298292e-f11c7599_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.691618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Write session: try to update token
2025-10-02T09:30:33.691630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.698612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.698629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.698631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.698633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.698640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.698644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.698647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421148231:6149]
2025-10-02T09:30:33.698676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.698683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.698682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.698685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.698686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.698688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.698860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:33.702057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:33.703925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.770527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496672572:6694]
2025-10-02T09:30:33.770703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7556554436496672572:6694]
2025-10-02T09:30:33.820890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.821233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.821244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.821271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672572:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.821417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.821481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.821504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:33.821524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496672572:6694]
2025-10-02T09:30:33.821574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0
2025-10-02T09:30:33.821747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0 is DEAD
2025-10-02T09:30:33.821869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:33.821874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Write session will restart in 0.005011s
2025-10-02T09:30:33.821889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Write session: Do CDS request
2025-10-02T09:30:33.821893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.828161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.828275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.828285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-10-02T09:30:33.828364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.828385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.828392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.828395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.828680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-10-02T09:30:33.828707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.828749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.828754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.828757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672651:7178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.829106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.829138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672651:7178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.830341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.830464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.830472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.830479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.830510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.830534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421148351:6151]
2025-10-02T09:30:33.830863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672651:7178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.830948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.831184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.831214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.831434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.831478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.831484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.831484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.831486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.831487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.831488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.831489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.831490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.831491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.831492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.831493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.831494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.831498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.831508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.831515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.831519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.831523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.831530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.831534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.831537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.831544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.831549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.831556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.831562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.831567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.831571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.831578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.831582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.831587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.831590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.831592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.831598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.831600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.831604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.831609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.831612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.831615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.831620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.831622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.831625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.831627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.831630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.831634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.831638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.831647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.831654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.831658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.831666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.831704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.835807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672651:7178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.835819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672651:7178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.835821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672651:7178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.835826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.839503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.841058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.841070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.841071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.841074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.841077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [2:7556554436421148351:6151]
2025-10-02T09:30:33.841086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.841096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.841101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.841103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.841105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.841116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.841121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.841126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.841173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.841178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.841179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.841181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.841182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.841220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.841226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.841233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.841242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.841253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.841267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.841269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.841270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.841275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.841283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672695:7178], now have 1 active actors on pipe
2025-10-02T09:30:33.841286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672577:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.841285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.841288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.841290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.841291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.841298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.841300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.841317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.841320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.841327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 786
2025-10-02T09:30:33.841339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.841330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 786
2025-10-02T09:30:33.841379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.841388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.841404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.841412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.841414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.841416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.841421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.841430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.841443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.841564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.841569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.841578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.841633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0
2025-10-02T09:30:33.841880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd004b-d0c6158f-7521c13-cea19c7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.844105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Write session: try to update token
2025-10-02T09:30:33.844116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.851068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.851086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.851088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.851090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.851096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.851102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.851105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421148346:6151]
2025-10-02T09:30:33.851137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.851145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.851147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.851149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.851150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.851153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.851283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:33.855025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:33.857008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:33.921571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554436496672703:6694]
2025-10-02T09:30:33.921759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7556554436496672703:6694]
2025-10-02T09:30:33.967989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:33.968208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.968218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.968247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672703:6694], now have 1 active actors on pipe
2025-10-02T09:30:33.968432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:33.968450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:33.968463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:33.968466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:33.968492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554436496672703:6694]
2025-10-02T09:30:33.968516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: error at write: Disconnected sessionId: src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0
2025-10-02T09:30:33.968657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0 is DEAD
2025-10-02T09:30:33.968794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:33.968816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Write session will restart in 0.008868s
2025-10-02T09:30:33.968833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Write session: Do CDS request
2025-10-02T09:30:33.968837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:33.975548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:33.976685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:33.976786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:33.976792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:33.976798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:33.976836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:33.976857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554436421148469:6154]
2025-10-02T09:30:33.977197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:33.977362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:33.977391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:33.977585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:33.977629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.977635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.977635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.977636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.977637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.977638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.977638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.977639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.977640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.977641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.977642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.977642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.977646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.977656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.977660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.977662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.977664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.977666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.977668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.977670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.977672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.977674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.977680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.977682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.977686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.977693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:33.977696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.977703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:33.977705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.977708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:33.977713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.977716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:33.977718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.977721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:33.977726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.977728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:33.977731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.977733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:33.977735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.977741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:33.977743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.977746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:33.977748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.977754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.977757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.977763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.977765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.977768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.977786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:33.979158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.979221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:33.979231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-10-02T09:30:33.979303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:33.979330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:33.979336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:33.979339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:33.979609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-10-02T09:30:33.979630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:33.979634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:33.979635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:33.979638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554436496672785:7182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:33.979981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554436496672785:7182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:33.981283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554436496672785:7182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:33.984643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554436496672785:7182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:33.984652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554436496672785:7182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:33.984654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554436496672785:7182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:33.984658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:33.985371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:33.986993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:33.987009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:33.987011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:33.987014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:33.987019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [2:7556554436421148469:6154]
2025-10-02T09:30:33.987029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:33.987046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:33.987053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.987055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.987057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.987069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:33.987078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:33.987088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:33.987132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.987140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.987141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.987143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:33.987147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:33.987194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:33.987200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.987209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:33.987222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:33.987236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:33.987254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672704:2446], now have 1 active actors on pipe
2025-10-02T09:30:33.987261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554436496672820:7182], now have 1 active actors on pipe
2025-10-02T09:30:33.987266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.987269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.987270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.987277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:33.987286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:33.987288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:33.987290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:33.987292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:33.987304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:33.987310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:33.987322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.987329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.987357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.987368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:33.987377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:33.987383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:33.987391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:33.987398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:33.987399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:33.987406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:33.987419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:33.987452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.987249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 787
2025-10-02T09:30:33.987260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 787
2025-10-02T09:30:33.987551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:33.987559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:33.987572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:33.987633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0
2025-10-02T09:30:33.987818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3216fe-960f2ad8-8795546b-f8a9aa34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:33.989928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Write session: try to update token
2025-10-02T09:30:33.989938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:33.996710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:33.996730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:33.996732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:33.996733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:33.996745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.996749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.996752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554436421148464:6154]
2025-10-02T09:30:33.996778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:33.996779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:33.996783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:33.996785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:33.996786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:33.996788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:33.996915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.000244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.002306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:34.068508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554440791640124:6694]
2025-10-02T09:30:34.068759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7556554440791640124:6694]
2025-10-02T09:30:34.120325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:34.120670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.120687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.120720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640124:6694], now have 1 active actors on pipe
2025-10-02T09:30:34.120953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:34.120939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:34.120989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554440791640124:6694]
2025-10-02T09:30:34.121045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:34.121107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0
2025-10-02T09:30:34.121260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0 is DEAD
2025-10-02T09:30:34.121392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:34.121403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Write session will restart in 0.009660s
2025-10-02T09:30:34.121425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Write session: Do CDS request
2025-10-02T09:30:34.121431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:34.131097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:34.132257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.132392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:34.132405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-10-02T09:30:34.132515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.132544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:34.132552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:34.132556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:34.132624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:34.132771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:34.132779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:34.132787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:34.132844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:34.132876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554440716115883:6156]
2025-10-02T09:30:34.132912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-10-02T09:30:34.132944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:34.132945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:34.132947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:34.132951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554440791640204:7186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:34.133419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:34.133417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554440791640204:7186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:34.133673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:34.133713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:34.133915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:34.133949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.133953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.133954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.133955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.133955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.133956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.133956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.133957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.133957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.133958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.133958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.133959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.133962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.133968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.133970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.133972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.133974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.133976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.133978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.133980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.133982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.133984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.133986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.133988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.133992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.133996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.133999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.134002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.134004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.134007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.134010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.134013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.134016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.134019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.134021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.134024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.134026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.134029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.134031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.134034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.134036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.134039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.134041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.134043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.134045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.134048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.134050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.134053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.134069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:34.135210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554440791640204:7186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:34.139714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554440791640204:7186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:34.139725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554440791640204:7186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:34.139727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554440791640204:7186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:34.139733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:34.141986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:34.143489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:34.143503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:34.143504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:34.143508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:34.143512Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [2:7556554440716115883:6156]
2025-10-02T09:30:34.143522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:34.143533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:34.143535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.143537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.143538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.143548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:34.143551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:34.143555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:34.143593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.143598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.143599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.143601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:34.143603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:34.143654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:34.143661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.143670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.143676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.143685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:34.143697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.143703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.143704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.143713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:34.143719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:34.143721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:34.143723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:34.143724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640125:2446], now have 1 active actors on pipe
2025-10-02T09:30:34.143728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640242:7186], now have 1 active actors on pipe
2025-10-02T09:30:34.143734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:34.143747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:34.143752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:34.143775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.143784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:34.143796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:34.143805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 788
2025-10-02T09:30:34.143815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 788
2025-10-02T09:30:34.143899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.143905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.143921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:34.143928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.143931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.143932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:34.143938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.143944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:34.143957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.144102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.144108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.144117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.144439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 36 sessionId: src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0
2025-10-02T09:30:34.144724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f3050b-c4ab3f69-1fa9504c-f9c2fb7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:34.147052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Write session: try to update token
2025-10-02T09:30:34.147067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:34.153751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:34.153770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:34.153772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:34.153773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:34.153779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.153782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.153784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554440716115877:6156]
2025-10-02T09:30:34.153816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:34.153820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.153822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:34.153826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:34.153831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:34.153833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:34.153936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.158798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.160855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:34.221087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554440791640252:6694]
2025-10-02T09:30:34.221261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7556554440791640252:6694]
2025-10-02T09:30:34.272308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:34.272576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.272592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.272623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640252:6694], now have 1 active actors on pipe
2025-10-02T09:30:34.272832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554440791640252:6694]
2025-10-02T09:30:34.272843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:34.272854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:34.272857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:34.272897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: error at write: Disconnected sessionId: src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0
2025-10-02T09:30:34.273042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0 is DEAD
2025-10-02T09:30:34.273160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:34.273174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:34.273183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Write session will restart in 0.006875s
2025-10-02T09:30:34.273200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Write session: Do CDS request
2025-10-02T09:30:34.273204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:34.279758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:34.280904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:34.281005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:34.281014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:34.281020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:34.281045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:34.281070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554440716116002:6159]
2025-10-02T09:30:34.281101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.281210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:34.281219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-10-02T09:30:34.281290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.281308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:34.281314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:34.281316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:34.281445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:34.281564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-10-02T09:30:34.281588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:34.281592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:34.281593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:34.281596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554440791640334:7191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:34.281602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:34.281626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:34.281795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:34.281824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.281828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.281828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.281829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.281829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.281830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.281830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.281831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.281831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.281832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.281832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.281833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.281835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.281842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.281844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.281846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.281848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.281850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.281852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.281854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.281856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.281858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.281860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.281862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.281865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.281869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.281872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.281875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.281877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.281879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.281881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.281884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.281887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.281889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.281891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.281894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.281896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.281899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.281902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.281904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.281906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.281909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.281911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.281913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.281916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.281918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.281920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.281923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.281925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554440791640334:7191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:34.281939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:34.283504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554440791640334:7191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:34.287316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554440791640334:7191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:34.287324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554440791640334:7191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:34.287327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554440791640334:7191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:34.287331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:34.289493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:34.290869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:34.290880Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:34.290882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:34.290884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:34.290887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [2:7556554440716116002:6159]
2025-10-02T09:30:34.290894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:34.290904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:34.290909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.290910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.290911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.290920Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:34.290923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:34.290927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:34.290956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.290961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.290962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.290964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:34.290965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:34.291014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:34.291019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.291025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.291030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.291041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:34.291055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640371:7191], now have 1 active actors on pipe
2025-10-02T09:30:34.291060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640253:2446], now have 1 active actors on pipe
2025-10-02T09:30:34.291063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.291065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.291067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.291076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:34.291074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 789
2025-10-02T09:30:34.291077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 789
2025-10-02T09:30:34.291091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:34.291097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:34.291103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:34.291104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:34.291105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:34.291106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:34.291131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.291133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.291140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.291146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:34.291155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:34.291214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:34.291221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.291223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.291225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:34.291230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.291235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:34.291250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.291362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.291373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.291389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.291455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0
2025-10-02T09:30:34.291678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13fe56bd-84e0438c-25642d4c-dc1fc625_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:34.293944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Write session: try to update token
2025-10-02T09:30:34.293955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:34.300403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:34.300419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:34.300421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:34.300423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:34.300431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.300434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.300438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554440716115997:6159]
2025-10-02T09:30:34.300468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:34.300474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:34.300476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.300477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:34.300478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:34.300480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:34.300589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.304438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.306611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:34.373153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554440791640379:6694]
2025-10-02T09:30:34.373343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7556554440791640379:6694]
2025-10-02T09:30:34.419882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:34.420142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.420153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.420180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640379:6694], now have 1 active actors on pipe
2025-10-02T09:30:34.420379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:34.420401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554440791640379:6694]
2025-10-02T09:30:34.420401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:34.420405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:34.420424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:34.420531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: error at write: Disconnected sessionId: src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0
2025-10-02T09:30:34.420663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0 is DEAD
2025-10-02T09:30:34.420836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:34.420847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Write session will restart in 0.006187s
2025-10-02T09:30:34.420871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Write session: Do CDS request
2025-10-02T09:30:34.420877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:34.428063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:34.428149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.428280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:34.428291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-10-02T09:30:34.428384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.428404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:34.428410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:34.428413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:34.428713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-10-02T09:30:34.428739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:34.428743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:34.428745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:34.428747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554440791640460:7195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:34.429117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554440791640460:7195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:34.429425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:34.429531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:34.429539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:34.429545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:34.429573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:34.429592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554440716116121:6161]
2025-10-02T09:30:34.429943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:34.430114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:34.430137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:34.430329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:34.430361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.430365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.430365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.430366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.430366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.430367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.430368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.430368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.430368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.430369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.430370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.430370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.430352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554440791640460:7195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:34.430374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.430380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.430382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.430384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.430386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.430388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.430390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.430392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.430394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.430396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.430398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.430400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.430403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.430407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.430411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.430414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.430417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.430419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.430421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.430424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.430426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.430429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.430431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.430433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.430436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.430438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.430441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.430443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.430446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.430448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.430451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.430454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.430457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.430460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.430462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.430464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.430481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:34.435403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554440791640460:7195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:34.435412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554440791640460:7195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:34.435414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554440791640460:7195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:34.435418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:34.438102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:34.439500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:34.439512Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:34.439513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:34.439516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:34.439520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [2:7556554440716116121:6161]
2025-10-02T09:30:34.439527Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:34.439538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:34.439539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.439541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.439542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.439551Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:34.439554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:34.439559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:34.439590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.439595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.439596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.439598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:34.439600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:34.439651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:34.439659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.439666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.439672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.439680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:34.439692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640499:7195], now have 1 active actors on pipe
2025-10-02T09:30:34.439699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640380:2446], now have 1 active actors on pipe
2025-10-02T09:30:34.439702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.439704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.439705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.439713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:34.439721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:34.439730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:34.439712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 790
2025-10-02T09:30:34.439732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:34.439728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 790
2025-10-02T09:30:34.439734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:34.439740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:34.439742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:34.439749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.439751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:34.439753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:34.439762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.439764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.439861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|397db9db-8097cab4-fcf91330-ea970bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:34.439869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.439872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.439873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:34.439878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.439884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:34.439900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.440002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.440008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.440015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.440067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 36 sessionId: src_id|397db9db-8097cab4-fcf91330-ea970bd_0
2025-10-02T09:30:34.440317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40915-d6ed87d0-8ac72b2d-5de836e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|397db9db-8097cab4-fcf91330-ea970bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:34.442594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Write session: try to update token
2025-10-02T09:30:34.442605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:34.449140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:34.449157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:34.449158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:34.449159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:34.449165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.449167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.449172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554440716116116:6161]
2025-10-02T09:30:34.449196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:34.449203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.449204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:34.449205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:34.449209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:34.449220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:34.449327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.453372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|397db9db-8097cab4-fcf91330-ea970bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.455280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:34.520614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554440791640506:6694]
2025-10-02T09:30:34.520828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7556554440791640506:6694]
2025-10-02T09:30:34.567547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:34.568091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.568106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.568132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640506:6694], now have 1 active actors on pipe
2025-10-02T09:30:34.568272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:34.568272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:34.568304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:34.568305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:34.568354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: error at write: Disconnected sessionId: src_id|397db9db-8097cab4-fcf91330-ea970bd_0
2025-10-02T09:30:34.568510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|397db9db-8097cab4-fcf91330-ea970bd_0 is DEAD
2025-10-02T09:30:34.568656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:34.568665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Write session will restart in 0.009495s
2025-10-02T09:30:34.568647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554440791640506:6694]
2025-10-02T09:30:34.568683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Write session: Do CDS request
2025-10-02T09:30:34.568688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:34.575553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:34.576740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:34.576892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:34.576901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:34.576909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:34.576952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:34.576982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554440716116266:6170]
2025-10-02T09:30:34.577525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:34.577738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:34.577771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:34.578040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:34.578091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.578096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.578097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.578098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.578099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.578100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.578101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.578102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.578102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.578103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.578104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.578105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.578109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.578118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.578121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.578126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.578130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.578138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.578141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.578149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.578152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.578156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.578165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.578168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.578177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.578187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.578196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.578205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.578213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.578221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.578229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.578235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.578243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.578251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.578257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.578267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.578276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.578284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.578292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.578298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.578305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.578309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.578316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.578321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.578329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.578337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.578342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.578350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.578380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:34.579164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.579261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:34.579272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-10-02T09:30:34.579359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.579379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:34.579384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:34.579387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:34.579606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-10-02T09:30:34.579624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:34.579628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:34.579629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:34.579632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554440791640606:7205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:34.579926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554440791640606:7205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:34.581463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554440791640606:7205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:34.585698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554440791640606:7205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:34.585708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554440791640606:7205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:34.585710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554440791640606:7205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:34.585714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:34.586352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:34.587901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:34.587914Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:34.587915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:34.587917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:34.587921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [2:7556554440716116266:6170]
2025-10-02T09:30:34.587927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:34.587938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:34.587939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.587941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.587942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.587952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:34.587956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:34.587964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:34.587995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.587999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.588000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.588002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:34.588004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:34.588041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:34.588045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.588053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.588058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.588070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:34.588085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640650:7205], now have 1 active actors on pipe
2025-10-02T09:30:34.588090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640521:2446], now have 1 active actors on pipe
2025-10-02T09:30:34.588094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.588095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.588096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.588104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:34.588111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:34.588118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:34.588118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:34.588120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:34.588121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:34.588122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:34.588135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.588138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 791
2025-10-02T09:30:34.588144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:34.588142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 791
2025-10-02T09:30:34.588146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:34.588162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.588167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.588185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:34.588191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.588194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.588195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:34.588200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.588208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:34.588218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.588347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.588352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.588359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.588406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0
2025-10-02T09:30:34.588657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397db9db-8097cab4-fcf91330-ea970bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:34.590984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Write session: try to update token
2025-10-02T09:30:34.590997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:34.597965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:34.597979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:34.597982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:34.597983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:34.597989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.597992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.597995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554440716116261:6170]
2025-10-02T09:30:34.598025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:34.598026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:34.598029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:34.598032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:34.598036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.598037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:34.598163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.601992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.603921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:34.668588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554440791640669:6694]
2025-10-02T09:30:34.668785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7556554440791640669:6694]
2025-10-02T09:30:34.723978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:34.724295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.724305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.724334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640669:6694], now have 1 active actors on pipe
2025-10-02T09:30:34.724559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:34.724570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:34.724584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:34.724602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:34.724636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554440791640669:6694]
2025-10-02T09:30:34.724645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: error at write: Disconnected sessionId: src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0
2025-10-02T09:30:34.724825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0 is DEAD
2025-10-02T09:30:34.724974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:34.724984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Write session will restart in 0.008739s
2025-10-02T09:30:34.725002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Write session: Do CDS request
2025-10-02T09:30:34.725006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:34.733983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:34.735265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.735416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:34.735431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-10-02T09:30:34.735541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.735570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:34.735579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:34.735583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:34.735666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:34.735852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:34.735862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:34.735870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:34.735915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:34.735945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554440716116410:6178]
2025-10-02T09:30:34.735950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-10-02T09:30:34.735979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:34.735984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:34.735986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:34.735991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554440791640753:7211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:34.736411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:34.736460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554440791640753:7211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:34.736667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:34.736712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:34.736995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:34.737035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.737039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.737039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.737040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.737041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.737043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.737044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.737045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.737046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.737047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.737048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.737049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.737054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.737064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.737068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.737070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.737072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.737075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.737077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.737079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.737081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.737083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.737085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.737087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.737092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.737097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.737103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.737112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.737120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.737125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.737128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.737137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.737145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.737152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.737162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.737171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.737175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.737180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.737190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.737198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.737204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.737208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.737216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.737221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.737229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.737236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.737239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.737242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.737264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:34.738267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554440791640753:7211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:34.743868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554440791640753:7211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:34.743879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554440791640753:7211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:34.743881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554440791640753:7211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:34.743886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:34.745596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:34.747426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:34.747443Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:34.747445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:34.747448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:34.747453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [2:7556554440716116410:6178]
2025-10-02T09:30:34.747466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:34.747481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:34.747484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.747488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.747490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.747503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:34.747511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:34.747517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:34.747557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.747562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.747563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.747565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:34.747567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:34.747730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:34.747740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.747751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.747761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.747745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 792
2025-10-02T09:30:34.747779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:34.747752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 792
2025-10-02T09:30:34.747802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640671:2446], now have 1 active actors on pipe
2025-10-02T09:30:34.747806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640791:7211], now have 1 active actors on pipe
2025-10-02T09:30:34.747816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.747819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.747821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.747832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:34.747844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:34.747849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.747852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:34.747853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.747854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:34.747867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:34.747880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:34.747885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:34.747919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:34.747929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.747932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.747934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:34.747941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.747949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:34.747959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.747965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:34.747971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:34.747984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.748125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.748138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.748158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.748245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 36 sessionId: src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0
2025-10-02T09:30:34.748577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2636cd3-fe698a32-37ac4ea9-e3fe4823_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:34.750894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Write session: try to update token
2025-10-02T09:30:34.750906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:34.758161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:34.758178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:34.758180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:34.758182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:34.758189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.758193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.758197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554440716116405:6178]
2025-10-02T09:30:34.758230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:34.758233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:34.758238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:34.758241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:34.758241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.758244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:34.758389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.762197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.764363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:34.824777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554440791640804:6694]
2025-10-02T09:30:34.825058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7556554440791640804:6694]
2025-10-02T09:30:34.901146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:34.901661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.901675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.901716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640804:6694], now have 1 active actors on pipe
2025-10-02T09:30:34.901932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554440791640804:6694]
2025-10-02T09:30:34.901939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:34.901974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:34.901977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:34.901997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:34.902033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: error at write: Disconnected sessionId: src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0
2025-10-02T09:30:34.902214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0 is DEAD
2025-10-02T09:30:34.902366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:34.902372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Write session will restart in 0.008473s
2025-10-02T09:30:34.902403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Write session: Do CDS request
2025-10-02T09:30:34.902407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:34.912009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:34.912459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.912550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:34.912564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-10-02T09:30:34.912694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:34.912723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:34.912731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:34.912736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:34.913110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-10-02T09:30:34.913138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:34.913143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:34.913144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:34.913148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554440791640893:7216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:34.913536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554440791640893:7216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:34.913601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:34.913755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:34.913764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:34.913773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:34.913815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:34.913846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554440716116534:6181]
2025-10-02T09:30:34.914370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:34.914696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:34.914739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:34.915019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:34.915077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.915083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.915084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.915085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.915086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.915086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.915087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.915088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.915089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.915090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.915091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.915092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.915096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.915105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.915109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.915113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.915116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.915126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.915130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.915134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.915141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.915145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.915149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.915156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.915164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.915173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:34.915182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.915190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:34.915198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.915206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:34.915212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.915220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:34.915228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.915237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:34.915244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.915252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:34.915258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.915266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:34.915270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.915279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:34.915286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.915295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:34.915298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.915307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.915314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.915323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.915330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.915335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.915370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:34.915438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554440791640893:7216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:34.920645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554440791640893:7216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:34.920657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554440791640893:7216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:34.920659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554440791640893:7216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:34.920679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:34.923517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:34.925152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:34.925168Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:34.925170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:34.925173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:34.925179Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [2:7556554440716116534:6181]
2025-10-02T09:30:34.925195Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:34.925211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:34.925218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.925221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.925223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.925236Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:34.925246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:34.925256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:34.925308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.925315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.925317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.925320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:34.925323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:34.925382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:34.925390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.925402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:34.925417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:34.925432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:34.925449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640932:7216], now have 1 active actors on pipe
2025-10-02T09:30:34.925458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554440791640809:2446], now have 1 active actors on pipe
2025-10-02T09:30:34.925464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.925468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.925470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.925488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:34.925503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:34.925504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:34.925507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:34.925508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:34.925520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:34.925523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:34.925509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 793
2025-10-02T09:30:34.925512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 793
2025-10-02T09:30:34.925550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.925561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:34.925565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:34.925578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.925586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.925734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d266a1b-16d132bf-6eab682d-14741a56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:34.925744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:34.925747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:34.925748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:34.925755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:34.925764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:34.925783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.925890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:34.925898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:34.925910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:34.925972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 36 sessionId: src_id|d266a1b-16d132bf-6eab682d-14741a56_0
2025-10-02T09:30:34.926311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2642213f-f428df53-16bbf8ce-ca9a200c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d266a1b-16d132bf-6eab682d-14741a56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:34.928836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Write session: try to update token
2025-10-02T09:30:34.928849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:34.935483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:34.935497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:34.935499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:34.935501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:34.935509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.935513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.935519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554440716116529:6181]
2025-10-02T09:30:34.935552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:34.935561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:34.935563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:34.935573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:34.935584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:34.935587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:34.935675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:34.941961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|d266a1b-16d132bf-6eab682d-14741a56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:34.944479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.001902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086608235:6694]
2025-10-02T09:30:35.002106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7556554445086608235:6694]
2025-10-02T09:30:35.059187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.059444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.059459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.059474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608235:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.059661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086608235:6694]
2025-10-02T09:30:35.059683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.059691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:35.059695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:35.059743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|d266a1b-16d132bf-6eab682d-14741a56_0
2025-10-02T09:30:35.059882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|d266a1b-16d132bf-6eab682d-14741a56_0 is DEAD
2025-10-02T09:30:35.059969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.060037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:35.060048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Write session will restart in 0.008916s
2025-10-02T09:30:35.060069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Write session: Do CDS request
2025-10-02T09:30:35.060075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.067509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.068751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.068864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.068870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.068876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.068902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.068923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011083953:6183]
2025-10-02T09:30:35.069281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.069461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.069489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.069671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.069699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.069703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.069704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.069705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.069705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.069706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.069706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.069707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.069707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.069708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.069708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.069709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.069712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.069718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.069720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.069722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.069724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.069726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.069728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.069730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.069732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.069734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.069736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.069738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.069742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.069746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.069749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.069751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.069755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.069757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.069760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.069763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.069765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.069768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.069770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.069773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.069775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.069778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.069781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.069783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.069786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.069788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.069790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.069793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.069795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.069798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.069800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.069802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.069820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.070243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.070386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.070397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-10-02T09:30:35.070480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.070500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.070503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.070507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.070781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-10-02T09:30:35.070806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.070810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.070812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.070815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086608325:7220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.071167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086608325:7220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:35.072343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086608325:7220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:35.076533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086608325:7220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:35.076545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086608325:7220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:35.076547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086608325:7220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:35.076553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:35.077806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:35.079292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:35.079305Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:35.079306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:35.079308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:35.079313Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [2:7556554445011083953:6183]
2025-10-02T09:30:35.079320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:35.079330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:35.079332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.079334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.079335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.079345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:35.079348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:35.079352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:35.079390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.079394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.079395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.079398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:35.079399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:35.079438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:35.079444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.079450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.079456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.079464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:35.079478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.079482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.079483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.079488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:35.079495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:35.079497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608360:7220], now have 1 active actors on pipe
2025-10-02T09:30:35.079503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:35.079503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:35.079505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:35.079510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:35.079512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:35.079515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608237:2446], now have 1 active actors on pipe
2025-10-02T09:30:35.079530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.079535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:35.079528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 794
2025-10-02T09:30:35.079531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 794
2025-10-02T09:30:35.079557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:35.079604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.079612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.079631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:35.079640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.079643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.079644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:35.079651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.079661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:35.079674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.079848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.079856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.079870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.079951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 36 sessionId: src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0
2025-10-02T09:30:35.080206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d266a1b-16d132bf-6eab682d-14741a56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:35.082541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Write session: try to update token
2025-10-02T09:30:35.082554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:35.089470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:35.089485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:35.089487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:35.089488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:35.089496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.089500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.089503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011083948:6183]
2025-10-02T09:30:35.089537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:35.089546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:35.089549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.089551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:35.089556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:35.089562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:35.089702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:35.094378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:35.096601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.159601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086608367:6694]
2025-10-02T09:30:35.159815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7556554445086608367:6694]
2025-10-02T09:30:35.220563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.220824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.220834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.220865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608367:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.221077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.221053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.221074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086608367:6694]
2025-10-02T09:30:35.221091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:35.221092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:35.221138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: error at write: Disconnected sessionId: src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0
2025-10-02T09:30:35.221272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0 is DEAD
2025-10-02T09:30:35.221402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:35.221410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Write session will restart in 0.009881s
2025-10-02T09:30:35.221428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Write session: Do CDS request
2025-10-02T09:30:35.221432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.229514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.229769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.229875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.229881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.229887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.229926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.229958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011084079:6186]
2025-10-02T09:30:35.230344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.230986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.231016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.231255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.231289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.231293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.231293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.231294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.231295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.231295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.231296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.231296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.231297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.231297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.231298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.231298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.231301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.231308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.231310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.231312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.231314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.231316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.231318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.231320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.231321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.231324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.231325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.231327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.231331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.231335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.231339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.231341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.231344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.231346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.231348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.231351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.231353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.231356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.231358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.231361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.231363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.231366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.231369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.231371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.231374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.231377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.231379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.231381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.231384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.231386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.231388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.231391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.231407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.232243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.232314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.232324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-10-02T09:30:35.232407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.232426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.232433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.232435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.232718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-10-02T09:30:35.232738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.232743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.232744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.232747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086608460:7225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.233102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086608460:7225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:35.234676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086608460:7225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:35.238130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086608460:7225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:35.238140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086608460:7225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:35.238141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086608460:7225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:35.238147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:35.238957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:35.240492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:35.240503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:35.240504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:35.240506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:35.240510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [2:7556554445011084079:6186]
2025-10-02T09:30:35.240517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:35.240529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:35.240531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.240533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.240535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.240545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:35.240548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:35.240553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:35.240586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.240591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.240592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.240594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:35.240596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:35.240634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:35.240639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.240646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.240652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.240664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:35.240677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608371:2446], now have 1 active actors on pipe
2025-10-02T09:30:35.240683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608495:7225], now have 1 active actors on pipe
2025-10-02T09:30:35.240688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.240690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.240692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.240703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:35.240715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:35.240720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:35.240723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:35.240724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:35.240724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:35.240726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:35.240721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 795
2025-10-02T09:30:35.240745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.240740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 795
2025-10-02T09:30:35.240751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:35.240753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:35.240762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.240765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.240789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:35.240796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.240812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.240814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:35.240819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.240827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:35.240836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.241032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.241038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.241048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.241103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 36 sessionId: src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0
2025-10-02T09:30:35.241321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4824fd66-231680a2-7f4eb9d6-23aa492f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:35.243527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Write session: try to update token
2025-10-02T09:30:35.243537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:35.250194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:35.250206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:35.250208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:35.250210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:35.250215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.250218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.250220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011084074:6186]
2025-10-02T09:30:35.250247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:35.250251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.250252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:35.250253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:35.250258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:35.250263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:35.250385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:35.254548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:35.256543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.321388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086608502:6694]
2025-10-02T09:30:35.321632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7556554445086608502:6694]
2025-10-02T09:30:35.353124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:30:35.353146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-02T09:30:35.373605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.373802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.373813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.373845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608502:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.374019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.374065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.374084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-02T09:30:35.374088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086608502:6694]
2025-10-02T09:30:35.374112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:35.374449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:35.374458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Write session will restart in 0.006663s
2025-10-02T09:30:35.374472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Write session: Do CDS request
2025-10-02T09:30:35.374477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.374175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0
2025-10-02T09:30:35.374331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0 is DEAD
2025-10-02T09:30:35.382094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.382187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.382303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.382314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-10-02T09:30:35.382404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.382424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.382431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.382434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.382729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-10-02T09:30:35.382752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.382753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.382754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.382758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086608592:7229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.383134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086608592:7229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:35.383635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.383750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.383757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.383763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.383791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.383819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011084205:6189]
2025-10-02T09:30:35.384168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.384374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.384399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.384577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.384616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.384621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.384622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.384623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.384623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.384624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.384624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.384625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.384625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.384626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.384626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.384627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.384630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.384636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.384638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.384640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.384642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.384644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.384646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.384648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.384650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.384652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.384654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.384656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.384659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.384663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.384666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.384669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.384671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.384674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.384676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.384678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.384681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.384683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.384685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.384688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.384690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.384693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.384695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.384697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.384700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.384702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.384704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.384707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.384710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.384712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.384714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.384717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.384733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.384842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086608592:7229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:35.390058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086608592:7229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:35.390071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086608592:7229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:35.390074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086608592:7229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:35.390082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:35.392684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:35.394069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:35.394081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:35.394082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:35.394085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:35.394088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [2:7556554445011084205:6189]
2025-10-02T09:30:35.394096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:35.394108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:35.394112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.394114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.394116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.394125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:35.394131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:35.394136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:35.394169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.394174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.394175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.394177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:35.394178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:35.394217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:35.394222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.394228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.394234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.394242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:35.394255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.394259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.394260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.394266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:35.394274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:35.394279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:35.394282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:35.394284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:35.394284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:35.394286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:35.394293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608631:7229], now have 1 active actors on pipe
2025-10-02T09:30:35.394298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608506:2446], now have 1 active actors on pipe
2025-10-02T09:30:35.394315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.394323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:35.394350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:35.394346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 796
2025-10-02T09:30:35.394353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 796
2025-10-02T09:30:35.394400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.394407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.394432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:35.394439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.394441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.394442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:35.394448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.394457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:35.394498Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:30:35.394517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.394655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.394659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.394666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.394669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 5 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:30:35.394696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:30:35.394725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0
2025-10-02T09:30:35.395018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c479c0d2-504a8313-7d57f078-27eaa97d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:35.397351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Write session: try to update token
2025-10-02T09:30:35.397365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:35.404226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:35.404239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:35.404240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:35.404242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:35.404247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.404249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.404252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011084200:6189]
2025-10-02T09:30:35.404278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:35.404281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.404283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:35.404311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:35.404323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:35.404326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:35.404406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:35.408928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:35.411032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.474473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086608641:6694]
2025-10-02T09:30:35.474753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7556554445086608641:6694]
2025-10-02T09:30:35.521055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.521345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.521353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.521379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608641:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.521554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.521570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086608641:6694]
2025-10-02T09:30:35.521578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:35.521580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:35.521592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.521604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:30:35.521630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0
2025-10-02T09:30:35.521773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0 is DEAD
2025-10-02T09:30:35.521907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:35.521924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Write session will restart in 0.008828s
2025-10-02T09:30:35.521946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Write session: Do CDS request
2025-10-02T09:30:35.521952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.529408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.530633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.530728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.530734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.530741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.530766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.530791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011084330:6192]
2025-10-02T09:30:35.531144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.531369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.531390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.531567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.531594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.531598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.531599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.531599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.531600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.531600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.531601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.531602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.531602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.531603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.531603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.531604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.531606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.531613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.531615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.531617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.531619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.531622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.531624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.531625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.531628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.531630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.531631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.531633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.531637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.531641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.531644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.531647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.531649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.531652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.531654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.531657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.531660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.531662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.531664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.531667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.531669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.531672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.531675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.531677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.531679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.531682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.531684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.531686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.531689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.531691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.531693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.531695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.531713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.532225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.532251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.532263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-10-02T09:30:35.532487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.532505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.532512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.532514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.532793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-10-02T09:30:35.532831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.532836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.532837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.532840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086608737:7233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.533197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086608737:7233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:35.534703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086608737:7233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:35.538633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086608737:7233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:35.538650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086608737:7233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:35.538653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086608737:7233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:35.538658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:35.539314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:35.540753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:35.540765Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:35.540768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:35.540770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:35.540774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [2:7556554445011084330:6192]
2025-10-02T09:30:35.540782Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:35.540795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:35.540822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.540829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.540831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.540844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:35.540850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:35.540855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:35.540896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.540900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.540901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.540903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:35.540905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:35.540945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:35.540950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.540957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.540962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.540974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:35.540992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.540993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.540995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.540999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:35.541008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:35.541017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:35.541019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:35.541034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:35.541039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.541041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:35.541041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:35.541045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:35.541047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608646:2446], now have 1 active actors on pipe
2025-10-02T09:30:35.541050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608772:7233], now have 1 active actors on pipe
2025-10-02T09:30:35.541052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:35.541093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 797
2025-10-02T09:30:35.541103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 797
2025-10-02T09:30:35.541152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.541159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.541185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:35.541192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.541195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.541197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:35.541274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.541284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:35.541314Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:30:35.541333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.541467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.541471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.541479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.541479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 6 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:30:35.541500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:30:35.541546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 36 sessionId: src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0
2025-10-02T09:30:35.541807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ac17ac-35622c4f-b249a74e-741270b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:35.544248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Write session: try to update token
2025-10-02T09:30:35.544262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:35.550798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:35.550812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:35.550815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:35.550817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:35.550822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.550825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.550827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011084325:6192]
2025-10-02T09:30:35.550852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:35.550856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.550858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:35.550882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:35.550886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:35.550889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:35.550993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:35.555924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:35.558071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.621908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086608816:6694]
2025-10-02T09:30:35.622048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7556554445086608816:6694]
2025-10-02T09:30:35.671135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.671388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.671397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.671424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608816:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.671583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.671629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.671660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086608816:6694]
2025-10-02T09:30:35.671679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:35.671762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0
2025-10-02T09:30:35.671914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0 is DEAD
2025-10-02T09:30:35.672088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:35.672098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Write session will restart in 0.007558s
2025-10-02T09:30:35.672117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Write session: Do CDS request
2025-10-02T09:30:35.672123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.679906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.681142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.681172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.681272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.681278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.681284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.681282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.681295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-10-02T09:30:35.681310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.681334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011084506:6208]
2025-10-02T09:30:35.681404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.681428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.681437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.681440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.681697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.681870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.681893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.682077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.682083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-10-02T09:30:35.682106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.682111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.682111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.682112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.682112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.682113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.682113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.682114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.682121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.682114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.682115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.682130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.682116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.682131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.682116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.682136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086608911:7245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.682119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.682126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.682128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.682130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.682132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.682134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.682136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.682138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.682140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.682142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.682144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.682146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.682151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.682155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.682158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.682161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.682164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.682167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.682169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.682171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.682173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.682176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.682178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.682181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.682183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.682186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.682188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.682190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.682193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.682195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.682199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.682201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.682203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.682206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.682208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.682211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.682228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.682555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086608911:7245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:35.684377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086608911:7245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:35.688872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086608911:7245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:35.688881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086608911:7245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:35.688883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086608911:7245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:35.688888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:35.689879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:35.691289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:35.691301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:35.691302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:35.691305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:35.691309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [2:7556554445011084506:6208]
2025-10-02T09:30:35.691318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:35.691329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:35.691330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.691332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.691333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.691343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:35.691346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:35.691351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:35.691380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.691386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.691387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.691389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:35.691390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:35.691429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:35.691434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.691441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.691446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.691458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:35.691472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608948:7245], now have 1 active actors on pipe
2025-10-02T09:30:35.691477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608821:2446], now have 1 active actors on pipe
2025-10-02T09:30:35.691482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.691486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.691488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.691495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:35.691503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:35.691509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:35.691511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:35.691512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:35.691513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:35.691515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:35.691530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.691535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:35.691539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:35.691520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 798
2025-10-02T09:30:35.691529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 798
2025-10-02T09:30:35.691551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.691556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.691577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:35.691584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.691586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.691587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:35.691592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.691600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:35.691614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.691719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.691724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.691732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.691801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0
2025-10-02T09:30:35.692105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac72143-9a9bfa3b-27cddc34-d8fc76ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:35.694797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Write session: try to update token
2025-10-02T09:30:35.694811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:35.700912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:35.700922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:35.700923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:35.700924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:35.700929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.700932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.700934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011084501:6208]
2025-10-02T09:30:35.700956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:35.700962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.700961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:35.700963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:35.700965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:35.700967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:35.701078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:35.706629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:35.708923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.771995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086608958:6694]
2025-10-02T09:30:35.772218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7556554445086608958:6694]
2025-10-02T09:30:35.827384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.827605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.827615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.827627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608958:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.827815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.827817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:35.827826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086608958:6694]
2025-10-02T09:30:35.827831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:35.827844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.827890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: error at write: Disconnected sessionId: src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0
2025-10-02T09:30:35.828045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0 is DEAD
2025-10-02T09:30:35.828219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:35.828233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Write session will restart in 0.005897s
2025-10-02T09:30:35.828263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Write session: Do CDS request
2025-10-02T09:30:35.828271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.835248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.835304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.835316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-10-02T09:30:35.835434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.835457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.835460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.835463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.835740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-10-02T09:30:35.835762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.835763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.835766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.835769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086609047:7250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.836175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086609047:7250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:35.836943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.838008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086609047:7250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:35.838247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.838427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.838438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.838449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.838491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.838541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011084634:6210]
2025-10-02T09:30:35.839194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.839413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.839456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.839810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.839871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.839879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.839880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.839882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.839883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.839884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.839885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.839886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.839887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.839888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.839890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.839891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.839896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.839907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.839911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.839915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.839919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.839924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.839928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.839931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.839935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.839939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.839943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.839929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086609047:7250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:35.839942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086609047:7250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:35.839947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.839953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.839945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086609047:7250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:35.839962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.839950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:35.839969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.839974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.839979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.839984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.839989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.839994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.839999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.840011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.840015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.840023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.840028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.840033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.840043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.840049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.840060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.840065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.840075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.840080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.840091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.840096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.840100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.840112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.840145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.848139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:35.849918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:35.849932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:35.849933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:35.849936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:35.849941Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [2:7556554445011084634:6210]
2025-10-02T09:30:35.849950Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:35.849961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:35.849966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.849969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.849970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.849981Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:35.849988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:35.849992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:35.850033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.850038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.850039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.850041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:35.850043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:35.850088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:35.850094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.850106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.850121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.850133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:35.850150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086609091:7250], now have 1 active actors on pipe
2025-10-02T09:30:35.850155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086608961:2446], now have 1 active actors on pipe
2025-10-02T09:30:35.850159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.850161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.850162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.850173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:35.850185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:35.850185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:35.850187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:35.850165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 799
2025-10-02T09:30:35.850188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:35.850167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 799
2025-10-02T09:30:35.850197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:35.850199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:35.850233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.850238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.850256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.850265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:35.850272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:35.850284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:35.850290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:35.850293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:35.850294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:35.850299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:35.850308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:35.850326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.850482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 36 sessionId: src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0
2025-10-02T09:30:35.850415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.850421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.850429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:35.850785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8d4de4-c35559fe-cbd94354-91acbb6d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:35.853640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Write session: try to update token
2025-10-02T09:30:35.853658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:35.859979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:35.859991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:35.859992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:35.859994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:35.859998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.860000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.860002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011084629:6210]
2025-10-02T09:30:35.860025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:35.860026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:35.860029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.860029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:35.860030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:35.860032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:35.860143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:35.868612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:35.870776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:35.928104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554445086609100:6694]
2025-10-02T09:30:35.928359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7556554445086609100:6694]
2025-10-02T09:30:35.984716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:35.985104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:35.985118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:35.985132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086609100:6694], now have 1 active actors on pipe
2025-10-02T09:30:35.985505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:35.985497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:35.985501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:35.985504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:35.985548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: error at write: Disconnected sessionId: src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0
2025-10-02T09:30:35.985550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554445086609100:6694]
2025-10-02T09:30:35.985697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0 is DEAD
2025-10-02T09:30:35.985921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:35.985931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Write session will restart in 0.009831s
2025-10-02T09:30:35.985954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Write session: Do CDS request
2025-10-02T09:30:35.985959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:35.993789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:35.995126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:35.995234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:35.995241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:35.995246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:35.995275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:35.995297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554445011084765:6213]
2025-10-02T09:30:35.995657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:35.995849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:35.995875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:35.996070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:35.996097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.996101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.996102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.996102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.996103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.996103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.996104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.996104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.996105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.996105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.996106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.996106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.996109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.996116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.996118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.996120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.996122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.996124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.996126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.996128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.996130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.996132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.996134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.996136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.996140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.996144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:35.996147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.996150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:35.996153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.996155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:35.996157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.996160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:35.996162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.996165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:35.996167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.996170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:35.996172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.996175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:35.996177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.996180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:35.996184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.996186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:35.996191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.996194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:35.996196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.996199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:35.996203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.996206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:35.996224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:35.997247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.997366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:35.997380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-10-02T09:30:35.997873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:35.997908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:35.997916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:35.997919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:35.998215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-10-02T09:30:35.998240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:35.998246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:35.998247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:35.998250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554445086609196:7254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:35.998595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554445086609196:7254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.000174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554445086609196:7254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.003299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554445086609196:7254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.003310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554445086609196:7254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.003312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554445086609196:7254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.003316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.003889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.005393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.005403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.005404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.005406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.005410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [2:7556554445011084765:6213]
2025-10-02T09:30:36.005417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.005427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.005432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.005434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.005435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.005445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.005452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.005456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.005491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.005496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.005497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.005499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.005500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.005537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.005542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.005548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.005554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.005562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.005576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576527:7254], now have 1 active actors on pipe
2025-10-02T09:30:36.005582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554445086609101:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.005586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.005587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.005588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.005594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.005602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.005605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.005607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.005609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.005613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.005615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.005629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.005634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.005636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.005614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 800
2025-10-02T09:30:36.005658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 800
2025-10-02T09:30:36.005678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.005683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.005698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.005705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.005707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.005708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.005714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.005722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.005732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.005829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.005833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.005841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.005906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0
2025-10-02T09:30:36.006116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9642d1cc-1c48ac03-e6b6624c-176c8fd4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.008722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Write session: try to update token
2025-10-02T09:30:36.008734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.014921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:36.014933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.014938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.014961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:36.014965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:36.015109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:36.015224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.015336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.015452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.015611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:36.015635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:36.020994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.022978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.023605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.023621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.023633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.023635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.023636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.023637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.023642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.023645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.023650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554445011084760:6213]
2025-10-02T09:30:36.023684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.023688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.023692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.023693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.023694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.023695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.023803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.085779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554449381576534:6694]
2025-10-02T09:30:36.086027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7556554449381576534:6694]
2025-10-02T09:30:36.142882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:36.143118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:36.143143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576534:6694], now have 1 active actors on pipe
2025-10-02T09:30:36.143225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:36.143251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:36.143287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381576534:6694]
2025-10-02T09:30:36.143297Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:30:36.143305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:36.143307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:36.143354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: error at write: Disconnected sessionId: src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0
2025-10-02T09:30:36.143386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0 is DEAD
2025-10-02T09:30:36.143457Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_14043147616604604993_v1 is DEAD
2025-10-02T09:30:36.143553Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:30:36.143603Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:36.143606Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:36.143592Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554376367116156:6689] disconnected; active server actors: 1
2025-10-02T09:30:36.143613Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007995s
2025-10-02T09:30:36.143603Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554376367116156:6689] client user disconnected session shared/user_1_8_14043147616604604993_v1
2025-10-02T09:30:36.143678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:36.143687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Write session will restart in 0.009572s
2025-10-02T09:30:36.143700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Write session: Do CDS request
2025-10-02T09:30:36.143705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:36.150287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:36.151602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:36.151705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:36.151713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:36.151719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:36.151744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:36.151763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554449306052191:6215]
2025-10-02T09:30:36.152094Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:30:36.152106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:36.152234Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:30:36.152245Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-10-02T09:30:36.152277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:36.152299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:36.152361Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:36.152393Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:36.152450Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 auth for : user
2025-10-02T09:30:36.152477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:36.152505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.152508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.152509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.152510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.152510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.152511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.152511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.152512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.152512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.152513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.152513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.152514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.152516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.152523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.152525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.152527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.152529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.152531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.152533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.152535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.152537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.152539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.152541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.152543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.152547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.152550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.152553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.152556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.152559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.152561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.152563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.152566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.152568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.152571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.152573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.152577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.152582Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 Handle describe topics response
2025-10-02T09:30:36.152579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.152582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.152584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.152586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.152588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.152591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.152593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.152596Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 auth is DEAD
2025-10-02T09:30:36.152595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.152597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.152601Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:30:36.152600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.152602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.152604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.152620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:36.152782Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:30:36.152852Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_9_9887809511957613091_v1
2025-10-02T09:30:36.152849Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554449381576631:7258] connected; active server actors: 1
2025-10-02T09:30:36.152860Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554449381576631:7258] session shared/user_1_9_9887809511957613091_v1
2025-10-02T09:30:36.152865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:30:36.152869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:30:36.152873Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_9887809511957613091_v1" (Sender=[1:7556554449381576626:7258], Pipe=[1:7556554449381576631:7258], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:36.152875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:30:36.152880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:30:36.152890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_9887809511957613091_v1" (Sender=[1:7556554449381576626:7258], Pipe=[1:7556554449381576631:7258], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:36.152898Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_9887809511957613091_v1" sender [1:7556554449381576626:7258] lock partition 0 for ReadingSession "shared/user_1_9_9887809511957613091_v1" (Sender=[1:7556554449381576626:7258], Pipe=[1:7556554449381576631:7258], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-10-02T09:30:36.152906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:30:36.152911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000025s
2025-10-02T09:30:36.153076Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_9887809511957613091_v1" ClientId: "user" PipeClient { RawX1: 7556554449381576631 RawX2: 4503603922345050 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:30:36.153092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:30:36.154034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.154054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:36.154062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-10-02T09:30:36.154136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.154160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:36.154166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:36.154168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:36.154362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-10-02T09:30:36.154380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:36.154392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:36.154396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:36.154399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554449381576638:7262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:36.154731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554449381576638:7262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.156298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554449381576638:7262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.159687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554449381576638:7262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.159695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554449381576638:7262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.159696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554449381576638:7262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.159701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.160303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.161718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.161729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.161730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.161732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.161736Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [2:7556554449306052191:6215]
2025-10-02T09:30:36.161744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.161754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.161759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.161761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.161762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.161772Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.161778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.161783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.161815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.161819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.161821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.161823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.161824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.161861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.161866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.161873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.161878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.161889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.161904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576672:7262], now have 1 active actors on pipe
2025-10-02T09:30:36.161910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576535:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.161911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576634:7261], now have 1 active actors on pipe
2025-10-02T09:30:36.161914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.161916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.161917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.161924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.161935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.161938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.161940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.161941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.161946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.161948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.161965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.161943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 801
2025-10-02T09:30:36.161946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 801
2025-10-02T09:30:36.161965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7556554449381576634:7261]
2025-10-02T09:30:36.161969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.161971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.161979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.161981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.162001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.162005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.162009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_9887809511957613091_v1 on pipe: [1:7556554449381576634:7261]
2025-10-02T09:30:36.162033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.162041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.162043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.162044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.162050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.162056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.162056Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_9887809511957613091_v1:1 with generation 801
2025-10-02T09:30:36.162065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.162066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.162067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.162074Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_9887809511957613091_v1
2025-10-02T09:30:36.162075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.162094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.162103Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:30:36.162163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.162168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.162175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.162219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 36 sessionId: src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0
2025-10-02T09:30:36.162444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2729752-ba5f7f41-8fda9ab7-2661eb86_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.164701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Write session: try to update token
2025-10-02T09:30:36.164713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.165654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:30:36.165672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:30:36.165678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.165680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.165680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.165685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:30:36.165690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:30:36.165785Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397436162 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:30:36.165797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:30:36.165817Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 sending to client partition status
2025-10-02T09:30:36.171489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.171503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.171514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.171516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.171521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.171526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.171528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554449306052186:6215]
2025-10-02T09:30:36.171551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.171556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.171558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.171559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.171560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.171562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.171665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.176491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.178679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.290400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:36.290631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.290640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.290830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_9887809511957613091_v1
2025-10-02T09:30:36.290843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:36.290842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:36.290853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:36.290855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:36.290868Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_9887809511957613091_v1
2025-10-02T09:30:36.290887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381576634:7261]
2025-10-02T09:30:36.290905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0
2025-10-02T09:30:36.291056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0 is DEAD
2025-10-02T09:30:36.291201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:36.291212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Write session will restart in 0.006062s
2025-10-02T09:30:36.291228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Write session: Do CDS request
2025-10-02T09:30:36.291232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:36.298011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:36.298165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.298308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:36.298317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-10-02T09:30:36.298415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.298435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:36.298441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:36.298445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:36.298736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-10-02T09:30:36.298760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:36.298761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:36.298762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:36.298765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554449381576775:7267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:36.299132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554449381576775:7267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.299370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:36.299462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:36.299469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:36.299474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:36.299499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:36.299521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554449306052327:6218]
2025-10-02T09:30:36.299858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:36.300066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:36.300087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:36.300258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:36.300289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.300293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.300294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.300295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.300295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.300296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.300296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.300297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.300297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.300298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.300298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.300299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.300301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.300307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.300309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.300311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.300313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.300315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.300317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.300319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.300321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.300323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.300325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.300327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.300331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.300335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.300338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.300340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.300342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.300345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.300347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.300350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.300352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.300355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.300357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.300359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.300361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.300364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.300366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.300369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.300371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.300373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.300376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.300379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.300381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.300383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.300385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.300388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.300405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:36.301006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554449381576775:7267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.305263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554449381576775:7267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.305271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554449381576775:7267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.305273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554449381576775:7267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.305277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.307936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.309274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.309284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.309285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.309286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.309290Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [2:7556554449306052327:6218]
2025-10-02T09:30:36.309296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.309306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.309312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.309313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.309314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.309322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.309329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.309333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.309362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.309366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.309368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.309369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.309371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.309409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.309413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.309419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.309425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.309436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.309448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.309452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.309453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.309458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.309464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.309466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576813:7267], now have 1 active actors on pipe
2025-10-02T09:30:36.309468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576683:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.309470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.309472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.309473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.309480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.309481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.309495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.309500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.309502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.309501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 802
2025-10-02T09:30:36.309505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 802
2025-10-02T09:30:36.309540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.309545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.309559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4647496a-2254d00c-63741973-3e9f9c06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.309566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.309568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.309569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.309574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.309581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.309590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.309690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.309695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.309702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.309753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 36 sessionId: src_id|4647496a-2254d00c-63741973-3e9f9c06_0
2025-10-02T09:30:36.309968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac3261-8a50af5c-d2da2d9a-d3f60cbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4647496a-2254d00c-63741973-3e9f9c06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.312365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Write session: try to update token
2025-10-02T09:30:36.312375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.318462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:36.318475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.318479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.318506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:36.318518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:36.318637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:36.318745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.318852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.318956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.319127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:36.319154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:36.323222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|4647496a-2254d00c-63741973-3e9f9c06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.325352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.325490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.325501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.325522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:36.325581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:36.327032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.327044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.327046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.327047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.327051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.327054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.327056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554449306052322:6218]
2025-10-02T09:30:36.327078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.327084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.327085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.327088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.327092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.327095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.327187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.390948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554449381576822:7261]
2025-10-02T09:30:36.391113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7556554449381576822:7261]
2025-10-02T09:30:36.442321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:36.448188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.448207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.448332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.448380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.448429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.448483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.448519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.448525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.448579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.448625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.448674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.448727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.448765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.448770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.448831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.448877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.448927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.448976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.449011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.449016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.449066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.449118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.449166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.449216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.449251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.449256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.449307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.449355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.449406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.449453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.449488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.449493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.449542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.449589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.449637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.449686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.449736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.449742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.449789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.449832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.449882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.449927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.449960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.449964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.450011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.450057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.450103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.450150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.450182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.450188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.450233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.450280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.450328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.450375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.450408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.450412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.450458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:36.450502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:36.450544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:36.450591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:36.450625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:36.450630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:36.450660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576822:7261], now have 1 active actors on pipe
2025-10-02T09:30:36.450821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:36.450843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:36.450846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:36.450861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381576822:7261]
2025-10-02T09:30:36.450865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: error at write: Disconnected sessionId: src_id|4647496a-2254d00c-63741973-3e9f9c06_0
2025-10-02T09:30:36.451175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:36.451183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Write session will restart in 0.008254s
2025-10-02T09:30:36.451198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Write session: Do CDS request
2025-10-02T09:30:36.451203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:36.451205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|4647496a-2254d00c-63741973-3e9f9c06_0 is DEAD
2025-10-02T09:30:36.451291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:36.459107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:36.460101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.460183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:36.460192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-10-02T09:30:36.460271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.460290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:36.460296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:36.460298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:36.460424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:36.460536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:36.460543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:36.460548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:36.460564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-10-02T09:30:36.460575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:36.460585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:36.460589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:36.460590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:36.460593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554449381576916:7271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:36.460599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554449306052460:6220]
2025-10-02T09:30:36.460945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554449381576916:7271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.460963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:36.461171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:36.461193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:36.461370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:36.461398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.461402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.461403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.461403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.461404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.461404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.461405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.461405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.461406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.461406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.461407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.461407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.461410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.461416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.461419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.461421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.461423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.461425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.461427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.461429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.461431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.461433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.461435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.461437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.461440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.461444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.461448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.461451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.461453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.461455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.461457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.461460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.461462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.461465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.461467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.461469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.461471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.461474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.461476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.461478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.461481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.461483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.461486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.461488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.461490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.461493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.461495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.461499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.461515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:36.462757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554449381576916:7271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.466873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554449381576916:7271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.466881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554449381576916:7271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.466883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554449381576916:7271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.466886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.469133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.470525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.470536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.470537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.470540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.470543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [2:7556554449306052460:6220]
2025-10-02T09:30:36.470551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.470562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.470563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.470565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.470566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.470575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.470578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.470583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.470613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.470618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.470619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.470621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.470623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.470660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.470665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.470672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.470677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.470686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.470701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576955:7271], now have 1 active actors on pipe
2025-10-02T09:30:36.470706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576823:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.470710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.470711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.470713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.470720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.470731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.470733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.470735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.470737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.470742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.470744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.470759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.470736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 803
2025-10-02T09:30:36.470764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.470765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.470778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.470742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 803
2025-10-02T09:30:36.470780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.470803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.470812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.470814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.470815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.470820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.470825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.470834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.470922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.470928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.470935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.470987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 36 sessionId: src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0
2025-10-02T09:30:36.471172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4647496a-2254d00c-63741973-3e9f9c06_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.473393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Write session: try to update token
2025-10-02T09:30:36.473403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.480149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.480161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.480163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.480164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.480169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.480171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.480174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554449306052455:6220]
2025-10-02T09:30:36.480196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.480199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.480200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.480200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.480203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.480205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.480314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.483645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.485574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.551202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554449381576966:7261]
2025-10-02T09:30:36.551336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7556554449381576966:7261]
2025-10-02T09:30:36.592254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:36.592646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.592655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.592682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576966:7261], now have 1 active actors on pipe
2025-10-02T09:30:36.592844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:36.592868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381576966:7261]
2025-10-02T09:30:36.592891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:36.592893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:36.592896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:36.592944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: error at write: Disconnected sessionId: src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0
2025-10-02T09:30:36.593080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0 is DEAD
2025-10-02T09:30:36.593233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:36.593238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Write session will restart in 0.007963s
2025-10-02T09:30:36.593252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Write session: Do CDS request
2025-10-02T09:30:36.593256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:36.601067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:36.602188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.602277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:36.602289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-10-02T09:30:36.602391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.602413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:36.602420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:36.602424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:36.602438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:36.602560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:36.602567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:36.602574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:36.602605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:36.602631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554449306052605:6223]
2025-10-02T09:30:36.602719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-10-02T09:30:36.602746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:36.602751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:36.602753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:36.602756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554449381577061:7277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:36.603046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:36.603138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554449381577061:7277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.603232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:36.603260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:36.603529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:36.603595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.603601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.603602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.603603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.603604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.603605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.603606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.603607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.603608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.603609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.603610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.603611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.603615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.603626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.603630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.603634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.603637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.603641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.603644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.603648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.603652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.603657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.603661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.603665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.603672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.603678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.603684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.603689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.603693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.603698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.603702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.603706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.603710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.603715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.603720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.603730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.603734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.603740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.603748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.603754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.603759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.603768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.603772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.603777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.603785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.603791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.603795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.603805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.603843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:36.604824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554449381577061:7277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.609543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554449381577061:7277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.609551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554449381577061:7277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.609553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554449381577061:7277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.609556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.611927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.613508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.613526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.613528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.613532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.613537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [2:7556554449306052605:6223]
2025-10-02T09:30:36.613548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.613561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.613564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.613566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.613568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.613581Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.613590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.613596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.613639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.613646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.613648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.613651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.613653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.613703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.613710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.613721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.613730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.613748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.613767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577100:7277], now have 1 active actors on pipe
2025-10-02T09:30:36.613774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381576967:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.613780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.613785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.613787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.613789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 804
2025-10-02T09:30:36.613799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.613795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 804
2025-10-02T09:30:36.613813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.613813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.613815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.613817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.613832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.613834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.613868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.613876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.613886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.613897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.613914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.613923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.613927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.613930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.613932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.613939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.613946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.613967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.614100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.614110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.614123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.614185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0
2025-10-02T09:30:36.614418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33a0284-855f9bcb-5a69d978-a95b91b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.616605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Write session: try to update token
2025-10-02T09:30:36.616616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.623641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.623657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.623658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.623659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.623664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.623667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.623669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554449306052600:6223]
2025-10-02T09:30:36.623694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.623697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.623699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.623700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.623703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.623705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.623806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.627938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.629889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.693047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554449381577142:7261]
2025-10-02T09:30:36.693274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7556554449381577142:7261]
2025-10-02T09:30:36.740315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:36.740540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.740549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.740577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577142:7261], now have 1 active actors on pipe
2025-10-02T09:30:36.740725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:36.740737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:36.740752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381577142:7261]
2025-10-02T09:30:36.740769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:36.740757Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:36.740784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: error at write: Disconnected sessionId: src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0
2025-10-02T09:30:36.740945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0 is DEAD
2025-10-02T09:30:36.741065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:36.741074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Write session will restart in 0.008968s
2025-10-02T09:30:36.741091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Write session: Do CDS request
2025-10-02T09:30:36.741096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:36.749083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:36.750391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:36.750504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:36.750511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:36.750516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:36.750545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:36.750574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554449306052775:6237]
2025-10-02T09:30:36.750950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:36.751146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:36.751175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:36.751212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.751285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:36.751296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-10-02T09:30:36.751368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:36.751382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.751398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.751401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:36.751402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.751408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:36.751403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.751410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:36.751403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.751404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.751405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.751405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.751406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.751406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.751406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.751407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.751408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.751410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.751418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.751420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.751422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.751424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.751426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.751428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.751430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.751432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.751434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.751436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.751438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.751442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.751446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.751450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.751453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.751455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.751457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.751460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.751464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.751469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.751473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.751476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.751480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.751488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.751492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.751499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.751503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.751511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.751515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.751521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.751526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.751534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.751537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.751542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.751545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.751562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:36.751684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-10-02T09:30:36.751709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:36.751713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:36.751714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:36.751717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554449381577241:7289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:36.752050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554449381577241:7289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.753513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554449381577241:7289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.758250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554449381577241:7289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.758260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554449381577241:7289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.758263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554449381577241:7289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.758267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.759501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.760935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.760948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.760950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.760953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.760957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [2:7556554449306052775:6237]
2025-10-02T09:30:36.760965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.760979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.760984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.760986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.760987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.760996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.761002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.761008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.761049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.761054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.761055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.761057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.761058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.761107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.761113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.761123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.761137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.761150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.761165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577281:7289], now have 1 active actors on pipe
2025-10-02T09:30:36.761170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577144:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.761173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.761174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.761175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.761180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.761187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.761170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 805
2025-10-02T09:30:36.761174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 805
2025-10-02T09:30:36.761196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.761198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.761200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.761202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.761203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.761224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.761229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.761238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.761245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.761249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.761261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.761267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.761270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.761271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.761276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.761284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.761300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.761415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.761422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.761433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.761489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0
2025-10-02T09:30:36.761694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe8c9bb-d3395465-1a5dfd89-5c86a0b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.764036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Write session: try to update token
2025-10-02T09:30:36.764048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.771115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.771130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.771132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.771134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.771141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.771145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.771148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554449306052770:6237]
2025-10-02T09:30:36.771177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.771178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.771183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.771185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.771185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.771187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.771303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.775337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.777406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.840977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554449381577294:7261]
2025-10-02T09:30:36.841174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7556554449381577294:7261]
2025-10-02T09:30:36.886766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:36.887140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.887149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.887175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577294:7261], now have 1 active actors on pipe
2025-10-02T09:30:36.887337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:36.887339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381577294:7261]
2025-10-02T09:30:36.887365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:36.887367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:36.887405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: error at write: Disconnected sessionId: src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0
2025-10-02T09:30:36.887550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0 is DEAD
2025-10-02T09:30:36.887575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:36.887698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:36.887708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Write session will restart in 0.009376s
2025-10-02T09:30:36.887722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Write session: Do CDS request
2025-10-02T09:30:36.887727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:36.895169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:36.896407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:36.896530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:36.896538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:36.896544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:36.896576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:36.896600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554449306052913:6240]
2025-10-02T09:30:36.896973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:36.897215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:36.897268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:36.897590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:36.897661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.897669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.897670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.897670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.897671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.897672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.897673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.897674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.897675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.897676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.897677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.897678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.897682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.897693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.897697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.897700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.897703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.897706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.897710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.897716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.897720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.897726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.897730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.897736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.897745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.897762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:36.897774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.897783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:36.897788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.897797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:36.897801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.897810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:36.897816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.897821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:36.897827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.897831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:36.897840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.897846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:36.897854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.897858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:36.897866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.897870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:36.897874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.897883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.897887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.897895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.897899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.897905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.897939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:36.898181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.898275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:36.898284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-10-02T09:30:36.898361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:36.898378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:36.898385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:36.898387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:36.898638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-10-02T09:30:36.898656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:36.898661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:36.898662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:36.898665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554449381577395:7294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:36.899028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554449381577395:7294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:36.900206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554449381577395:7294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:36.904229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554449381577395:7294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:36.904237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554449381577395:7294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:36.904239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554449381577395:7294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:36.904243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:36.905587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:36.907066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:36.907078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:36.907079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:36.907081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:36.907085Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [2:7556554449306052913:6240]
2025-10-02T09:30:36.907093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:36.907103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:36.907108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.907110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.907111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.907121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:36.907125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:36.907129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:36.907159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.907164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.907165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.907167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:36.907168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:36.907204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:36.907209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.907215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:36.907221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:36.907229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:36.907242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.907246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.907247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.907252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:36.907260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:36.907262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577429:7294], now have 1 active actors on pipe
2025-10-02T09:30:36.907264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577295:2446], now have 1 active actors on pipe
2025-10-02T09:30:36.907269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:36.907269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:36.907270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:36.907276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:36.907278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:36.907297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.907305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:36.907317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:36.907297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 806
2025-10-02T09:30:36.907329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.907298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 806
2025-10-02T09:30:36.907335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.907349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:36.907355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:36.907357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:36.907359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:36.907365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:36.907373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:36.907384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.907480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.907486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.907494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:36.907548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 36 sessionId: src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0
2025-10-02T09:30:36.907772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0d0894-fd8aca76-b57f21c-8dfc413e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:36.910153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Write session: try to update token
2025-10-02T09:30:36.910163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:36.916207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:36.916220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.916225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.916256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:36.916259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:36.916394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:36.916523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.916646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.916774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:36.916954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:36.916986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:36.920826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:36.922715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:36.922829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:36.922837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:36.922855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:36.922909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:36.924669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:36.924684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:36.924686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:36.924688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:36.924695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.924698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.924701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554449306052908:6240]
2025-10-02T09:30:36.924730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:36.924740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:36.924742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:36.924744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:36.924745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:36.924749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:36.924878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:36.987437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554449381577436:7261]
2025-10-02T09:30:36.987696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7556554449381577436:7261]
2025-10-02T09:30:37.062398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.068446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.068464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.068586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.068635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.068688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.068739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.068774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.068781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.068845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.068896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.068945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.068996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.069034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.069039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.069088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.069138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.069187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.069240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.069275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.069280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.069363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.069412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.069459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.069509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.069549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.069554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.069605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.069653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.069702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.069752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.069792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.069797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.069846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.069893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.069941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.069990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.070029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.070039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.070099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.070150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.070201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.070249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.070284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.070289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.070348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.070401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.070450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.070498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.070535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.070544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.070607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.070657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.070706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.070754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.070787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.070792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.070839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.070884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.070934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.070989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.071071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.071077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.071113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554449381577436:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.071286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:37.071298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:37.071304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554449381577436:7261]
2025-10-02T09:30:37.071318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: error at write: Disconnected sessionId: src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0
2025-10-02T09:30:37.071326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.071457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0 is DEAD
2025-10-02T09:30:37.071590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:37.071598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Write session will restart in 0.005366s
2025-10-02T09:30:37.071618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Write session: Do CDS request
2025-10-02T09:30:37.071624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.071658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.078216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.078276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.078284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-10-02T09:30:37.078356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.078376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.078382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.078384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.078699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-10-02T09:30:37.078741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.078748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.078750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.078754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676544820:7298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.079171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676544820:7298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.079682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.080853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676544820:7298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.081098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.081192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.081198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.081204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.081228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.081251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601020344:6242]
2025-10-02T09:30:37.081590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.081756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.081779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.081955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.081984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.081988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.081989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.081989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.081990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.081990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.081991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.081991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.081991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.081992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.081992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.081993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.081996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.082002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.082004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.082006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.082008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.082010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.082012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.082014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.082016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.082018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.082020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.082022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.082025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.082029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.082032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.082035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.082037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.082040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.082042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.082045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.082047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.082050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.082052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.082055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.082058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.082060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.082063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.082065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.082067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.082070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.082072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.082075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.082078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.082080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.082082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.082085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.082101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.085917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676544820:7298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.085927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676544820:7298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.085930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676544820:7298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.085935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.089535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.090976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.090986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.090988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.090990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.090993Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [2:7556554453601020344:6242]
2025-10-02T09:30:37.091000Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.091014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.091018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.091020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.091021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.091030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.091036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.091040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.091071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.091075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.091076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.091078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.091079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.091115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.091122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.091128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.091134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.091142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.091153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676544735:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.091156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676544871:7298], now have 1 active actors on pipe
2025-10-02T09:30:37.091159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.091161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.091162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.091170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.091182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.091181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.091183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.091184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.091189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.091190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.091185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 807
2025-10-02T09:30:37.091205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.091210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.091211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.091185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 807
2025-10-02T09:30:37.091221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.091227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.091252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.091259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.091261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.091262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.091267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.091272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.091285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.091366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.091371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.091379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.091432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0
2025-10-02T09:30:37.091640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7bef80-c42d55bc-fef814f5-65f6d0aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.094050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Write session: try to update token
2025-10-02T09:30:37.094063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.100496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.100512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.100515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.100517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.100522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.100525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.100528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601020339:6242]
2025-10-02T09:30:37.100552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.100552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.100556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.100559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.100559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.100560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.100686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.106124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:37.108124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:37.171257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554453676544880:7261]
2025-10-02T09:30:37.171439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7556554453676544880:7261]
2025-10-02T09:30:37.215721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.216064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.216074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.216086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676544880:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.216203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.216216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.216222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:37.216225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:37.216280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0
2025-10-02T09:30:37.216288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554453676544880:7261]
2025-10-02T09:30:37.216461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0 is DEAD
2025-10-02T09:30:37.216594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:37.216602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Write session will restart in 0.005887s
2025-10-02T09:30:37.216617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Write session: Do CDS request
2025-10-02T09:30:37.216621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.223224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.223365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.223374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-10-02T09:30:37.223474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.223494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.223500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.223505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.223764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-10-02T09:30:37.223782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.223787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.223788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.223791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676544978:7303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.224112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.224133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676544978:7303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.225366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676544978:7303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.225500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.225594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.225601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.225606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.225632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.225656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601020483:6245]
2025-10-02T09:30:37.225993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.226151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.226174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.226367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.226402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.226406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.226406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.226407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.226407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.226408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.226408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.226409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.226409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.226410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.226410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.226411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.226413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.226419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.226421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.226423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.226425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.226427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.226429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.226431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.226433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.226435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.226436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.226440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.226444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.226451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.226455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.226464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.226468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.226473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.226481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.226488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.226495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.226497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.226503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.226505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.226507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.226510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.226513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.226516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.226518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.226524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.226526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.226528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.226531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.226537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.226539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.226542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.226558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.226894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676544978:7303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.226902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676544978:7303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.226904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676544978:7303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.226907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.233891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.235330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.235343Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.235344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.235346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.235350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [2:7556554453601020483:6245]
2025-10-02T09:30:37.235357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.235370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.235374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.235376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.235377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.235387Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.235389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.235394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.235429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.235435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.235437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.235439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.235441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.235499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.235506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.235517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.235531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.235550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.235546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 808
2025-10-02T09:30:37.235547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 808
2025-10-02T09:30:37.235568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545018:7303], now have 1 active actors on pipe
2025-10-02T09:30:37.235574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676544882:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.235579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.235585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.235587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.235596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.235604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.235610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.235610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.235612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.235622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.235628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.235641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.235647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.235669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.235677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.235684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.235687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.235690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.235692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.235693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.235698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.235704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.235722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.235807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.235811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.235819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.235862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 36 sessionId: src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0
2025-10-02T09:30:37.236094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa1abc1-86afc4f5-af9c4508-9ceed2f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.238815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Write session: try to update token
2025-10-02T09:30:37.238827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.244794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.244819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.244820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.244821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.244824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.244827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.244829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601020478:6245]
2025-10-02T09:30:37.244850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.244851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.244853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.244853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.244854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.244855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.244965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.251984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId: src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:37.254071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:37.316653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554453676545026:7261]
2025-10-02T09:30:37.317169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7556554453676545026:7261]
2025-10-02T09:30:37.359013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.359370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.359378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.359391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545026:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.359563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.359564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.359584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554453676545026:7261]
2025-10-02T09:30:37.359600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:37.359655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0
2025-10-02T09:30:37.359780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0 is DEAD
2025-10-02T09:30:37.359889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:37.359897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Write session will restart in 0.006755s
2025-10-02T09:30:37.359914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Write session: Do CDS request
2025-10-02T09:30:37.359918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.367263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.367353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.367367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-10-02T09:30:37.367525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.367558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.367567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.367570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.367891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-10-02T09:30:37.367918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.367922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.367923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.367927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676545089:7307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.368277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676545089:7307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.369898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676545089:7307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.370043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.371431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.371570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.371582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.371591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.371632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.371668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601020620:6247]
2025-10-02T09:30:37.371937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676545089:7307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.371951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676545089:7307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.371955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676545089:7307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.371963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.372120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.372325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.372353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.372611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.372668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.372673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.372674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.372675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.372676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.372677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.372678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.372679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.372680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.372681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.372682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.372683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.372688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.372698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.372701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.372705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.372709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.372712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.372715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.372719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.372723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.372727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.372730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.372733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.372739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.372745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.372751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.372756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.372760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.372764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.372768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.372773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.372779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.372783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.372787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.372790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.372792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.372795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.372797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.372813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.372815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.372818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.372821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.372824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.372826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.372829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.372831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.372834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.372851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.380646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.382516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.382534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.382537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.382540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.382546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [2:7556554453601020620:6247]
2025-10-02T09:30:37.382564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.382583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.382592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.382600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.382602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.382616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.382627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.382634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.382695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.382702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.382704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.382707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.382709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.382771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.382783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.382796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.382806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.382820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.382844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545162:7307], now have 1 active actors on pipe
2025-10-02T09:30:37.382840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 809
2025-10-02T09:30:37.382851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 809
2025-10-02T09:30:37.382855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545028:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.382863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.382865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.382867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.382874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.382881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.382883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.382884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.382887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.382901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.382904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.382923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.382927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.382963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.382987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.382995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.383008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.383019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.383028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.383035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.383046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.383061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.383104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.383251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.383262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.383278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.383345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 36 sessionId: src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0
2025-10-02T09:30:37.383642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aba8f2c-ebd432a-f5290255-c9edc96c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.386374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Write session: try to update token
2025-10-02T09:30:37.386389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.392489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.392504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.392506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.392507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.392511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.392514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.392516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601020614:6247]
2025-10-02T09:30:37.392539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.392543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.392543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.392544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.392546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.392548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.392673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.399917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:37.401998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:37.459492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554453676545173:7261]
2025-10-02T09:30:37.459697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7556554453676545173:7261]
2025-10-02T09:30:37.511574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.511847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.511857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.511870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545173:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.512009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.512055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554453676545173:7261]
2025-10-02T09:30:37.512069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:37.512074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.512124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0
2025-10-02T09:30:37.512276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0 is DEAD
2025-10-02T09:30:37.512454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:37.512469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Write session will restart in 0.007884s
2025-10-02T09:30:37.512492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Write session: Do CDS request
2025-10-02T09:30:37.512499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.519667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.520955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.521052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.521058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.521064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.521088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.521113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601020758:6249]
2025-10-02T09:30:37.521264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.521360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.521369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-10-02T09:30:37.521463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.521506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.521526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.521532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.521535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.521632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.521655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.521786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-10-02T09:30:37.521809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.521813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.521814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.521818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676545277:7311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.521834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.521862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.521866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.521867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.521867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.521868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.521868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.521869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.521870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.521870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.521871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.521872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.521872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.521875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.521882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.521884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.521886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.521888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.521891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.521893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.521895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.521897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.521899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.521901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.521903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.521907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.521911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.521915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.521918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.521920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.521923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.521926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.521929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.521931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.521934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.521936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.521939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.521944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.521947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.521949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.521952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.521954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.521957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.521962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.521965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.521967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.521970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.521972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.521976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.521996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.522160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676545277:7311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.523373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676545277:7311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.527695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676545277:7311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.527705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676545277:7311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.527707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676545277:7311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.527712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.530027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.531437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.531449Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.531450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.531452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.531456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [2:7556554453601020758:6249]
2025-10-02T09:30:37.531464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.531473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.531476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.531478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.531480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.531489Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.531496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.531500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.531531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.531536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.531537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.531539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.531540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.531578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.531588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.531595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.531600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.531608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.531621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545175:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.531628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545314:7311], now have 1 active actors on pipe
2025-10-02T09:30:37.531631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.531633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.531634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.531642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.531649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.531657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.531659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.531660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.531665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.531666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.531674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.531676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.531678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.531669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 810
2025-10-02T09:30:37.531670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 810
2025-10-02T09:30:37.531698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.531704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.531718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.531725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.531727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.531729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.531734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.531743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.531750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.531852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.531857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.531864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.531926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 36 sessionId: src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0
2025-10-02T09:30:37.532172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf738dd-9b460ac4-f9cc370d-be1d2a0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.534761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Write session: try to update token
2025-10-02T09:30:37.534772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.545890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:37.545907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.545912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.545942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:37.545950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:37.546081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:37.546210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:37.546328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:37.546444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:37.546606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:37.546639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:37.546886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:37.549160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:37.549316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.549332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.549357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:37.549423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:37.550559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.550572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.550573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.550575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.550580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.550582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.550584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601020753:6249]
2025-10-02T09:30:37.550605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.550611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.550613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.550614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.550614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.550616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.550722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.612073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554453676545321:7261]
2025-10-02T09:30:37.612313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7556554453676545321:7261]
2025-10-02T09:30:37.669004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.675013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.675033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.675150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.675197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.675250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.675302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.675340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.675346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.675400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.675448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.675498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.675557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.675594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.675599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.675650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.675696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.675746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.675797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.675833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.675838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.675890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.675939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.675987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.676038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.676073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.676078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.676129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.676178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.676229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.676281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.676318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.676323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.676373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.676421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.676470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.676523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.676562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.676566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.676616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.676663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.676784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.676855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.676892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.676897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.676947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.676993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.677041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.677089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.677126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.677130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.677177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.677223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.677272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.677367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.677404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.677411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.677457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:37.677505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:37.677551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:37.677597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:37.677632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:37.677637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:37.677667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545321:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.677818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.677866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:37.677870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:37.677887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: error at write: Disconnected sessionId: src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0
2025-10-02T09:30:37.678021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0 is DEAD
2025-10-02T09:30:37.678153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554453676545321:7261]
2025-10-02T09:30:37.678197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:37.678213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Write session will restart in 0.008248s
2025-10-02T09:30:37.678245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Write session: Do CDS request
2025-10-02T09:30:37.678251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.678285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.685868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.687162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.687213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.687242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.687250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 812
2025-10-02T09:30:37.687310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.687316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.687322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.687349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.687371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601020930:6258]
2025-10-02T09:30:37.687389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.687406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.687412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.687414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.687641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 812 sessionId:  describe result for acl check
2025-10-02T09:30:37.687663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.687667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.687668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.687671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676545461:7323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.687716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.687885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.687906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.687945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676545461:7323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.688079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.688108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.688112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.688112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.688113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.688113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.688114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.688114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.688115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.688115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.688116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.688117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.688117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.688120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.688126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.688129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.688131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.688133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.688135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.688137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.688139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.688141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.688143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.688145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.688147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.688150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.688153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.688157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.688160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.688162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.688165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.688167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.688169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.688172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.688174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.688176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.688179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.688181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.688184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.688186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.688189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.688191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.688196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.688198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.688201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.688203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.688207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.688212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.688215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.688232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.688982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676545461:7323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.693753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676545461:7323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.693761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676545461:7323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.693763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676545461:7323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.693767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.696090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.697578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.697591Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.697592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.697594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.697598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 811 [2:7556554453601020930:6258]
2025-10-02T09:30:37.697604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.697614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.697615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.697617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.697618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.697627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.697634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.697638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.697670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.697675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.697676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.697677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.697679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.697715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.697720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.697727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.697732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.697740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.697754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545496:7323], now have 1 active actors on pipe
2025-10-02T09:30:37.697760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545348:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.697763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.697764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.697765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.697773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.697783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.697785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.697787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.697788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.697793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.697795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.697790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 811
2025-10-02T09:30:37.697811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.697816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.697818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.697801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 811
2025-10-02T09:30:37.697828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.697830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.697853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26be8be3-d6461f28-87bcad9f-4da963db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.697859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.697862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.697863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.697868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.697874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.697885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.697975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.697979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.697987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.698053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 812 partition: 0 MaxSeqNo: 36 sessionId: src_id|26be8be3-d6461f28-87bcad9f-4da963db_0
2025-10-02T09:30:37.698295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b25e1708-760d9eb0-bb2c3eca-ddb48f03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|26be8be3-d6461f28-87bcad9f-4da963db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.700421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Write session: try to update token
2025-10-02T09:30:37.700431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.707610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.707624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.707626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.707627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.707631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.707634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.707636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601020925:6258]
2025-10-02T09:30:37.707658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.707662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.707662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.707663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.707665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.707667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.707772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.712247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId: src_id|26be8be3-d6461f28-87bcad9f-4da963db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:37.714357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:37.778459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554453676545511:7261]
2025-10-02T09:30:37.778630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 811, pipe: [1:7556554453676545511:7261]
2025-10-02T09:30:37.821235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.821545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.821554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.821580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545511:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.821713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.821761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.821778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554453676545511:7261]
2025-10-02T09:30:37.821794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:37.821796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:37.821840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 812 reason: error at write: Disconnected sessionId: src_id|26be8be3-d6461f28-87bcad9f-4da963db_0
2025-10-02T09:30:37.821980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 812 sessionId: src_id|26be8be3-d6461f28-87bcad9f-4da963db_0 is DEAD
2025-10-02T09:30:37.822184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:37.822197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Write session will restart in 0.005057s
2025-10-02T09:30:37.822218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Write session: Do CDS request
2025-10-02T09:30:37.822223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.828156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.828291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.828303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 813
2025-10-02T09:30:37.828417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.828446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.828454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.828458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.828753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 813 sessionId:  describe result for acl check
2025-10-02T09:30:37.828776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.828780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.828781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.828784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676545611:7328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.829133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676545611:7328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.829249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.830540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.830557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676545611:7328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.830640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.830646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.830652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.830677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.830700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601021087:6266]
2025-10-02T09:30:37.831048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.831266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.831288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.831460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.831489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.831493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.831493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.831494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.831495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.831495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.831495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.831496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.831496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.831497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.831497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.831498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.831501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.831506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.831508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.831510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.831512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.831514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.831516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.831518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.831520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.831522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.831524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.831526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.831529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.831533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.831537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.831539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.831541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.831544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.831546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.831549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.831551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.831554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.831556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.831558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.831560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.831563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.831565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.831568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.831570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.831573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.831576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.831578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.831581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.831584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.831589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.831592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.831609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.835427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676545611:7328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.835436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676545611:7328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.835439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676545611:7328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.835442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.839058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.840533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.840550Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.840552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.840555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.840560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 812 [2:7556554453601021087:6266]
2025-10-02T09:30:37.840570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.840587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.840593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.840595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.840597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.840609Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.840617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.840623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.840663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.840669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.840670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.840672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.840673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.840708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.840713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.840721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.840726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.840737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.840751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545653:7328], now have 1 active actors on pipe
2025-10-02T09:30:37.840757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545512:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.840760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.840761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.840762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.840770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.840777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.840785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.840775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 812
2025-10-02T09:30:37.840794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 812
2025-10-02T09:30:37.840788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.840789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.840793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.840795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.840821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.840824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.840826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.840836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.840843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.840869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.840876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.840878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.840879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.840884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.840893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.840902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.841020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.841025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.841032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.841084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 813 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0
2025-10-02T09:30:37.841339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26be8be3-d6461f28-87bcad9f-4da963db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.843570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Write session: try to update token
2025-10-02T09:30:37.843581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.850140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.850154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.850156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.850157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.850163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.850165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.850167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601021082:6266]
2025-10-02T09:30:37.850190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.850196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.850197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.850198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.850199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.850201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.850310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.855383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId: src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:37.857526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:37.921832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554453676545664:7261]
2025-10-02T09:30:37.922057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 812, pipe: [1:7556554453676545664:7261]
2025-10-02T09:30:37.964813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:37.965159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.965167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.965180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545664:7261], now have 1 active actors on pipe
2025-10-02T09:30:37.965317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:37.965385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:37.965398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:37.965432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554453676545664:7261]
2025-10-02T09:30:37.965485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0
2025-10-02T09:30:37.965664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 813 sessionId: src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0 is DEAD
2025-10-02T09:30:37.965816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:37.965833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Write session will restart in 0.006622s
2025-10-02T09:30:37.965858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Write session: Do CDS request
2025-10-02T09:30:37.965864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:37.973213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.973351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:37.973370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 814
2025-10-02T09:30:37.973497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:37.973526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:37.973537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:37.973541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:37.973812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:37.973915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 814 sessionId:  describe result for acl check
2025-10-02T09:30:37.973945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:37.973947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:37.973949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:37.973953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554453676545771:7332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:37.974417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554453676545771:7332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:37.975092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:37.975192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:37.975199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:37.975205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:37.975232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:37.975274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554453601021231:6269]
2025-10-02T09:30:37.975635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:37.975810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:37.975836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:37.976014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:37.976056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.976061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.976062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.976062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.976063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.976063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.976064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.976064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.976065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.976066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.976066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.976067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.976070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.976076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.976078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.976080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.976082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.976084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.976086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.976088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.976106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554453676545771:7332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:37.976090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.976093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.976095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.976098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.976102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.976106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:37.976109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.976112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:37.976114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.976118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:37.976120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.976123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:37.976125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.976127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:37.976130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.976133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:37.976135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.976137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:37.976139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.976142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:37.976145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.976147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:37.976150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.976152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.976154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.976157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.976159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.976162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.976181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:37.981120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554453676545771:7332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:37.981133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554453676545771:7332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:37.981135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554453676545771:7332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:37.981163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:37.983751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:37.985109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:37.985120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:37.985122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:37.985124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:37.985128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 813 [2:7556554453601021231:6269]
2025-10-02T09:30:37.985136Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:37.985146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:37.985151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.985153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.985154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.985163Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:37.985166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:37.985175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:37.985209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.985214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.985215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.985218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:37.985220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:37.985337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:37.985342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.985348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:37.985354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:37.985365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:37.985381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545668:2446], now have 1 active actors on pipe
2025-10-02T09:30:37.985387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554453676545806:7332], now have 1 active actors on pipe
2025-10-02T09:30:37.985391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.985393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.985394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.985400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:37.985376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 813
2025-10-02T09:30:37.985408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:37.985378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 813
2025-10-02T09:30:37.985412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:37.985414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:37.985416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:37.985419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:37.985421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:37.985446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.985451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.985458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.985466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:37.985482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:37.985483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10876888-b632c039-8116f49b-af4e572d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:37.985486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:37.985489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:37.985490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:37.985495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:37.985500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:37.985514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.985626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:37.985631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:37.985638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:37.985687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 814 partition: 0 MaxSeqNo: 36 sessionId: src_id|10876888-b632c039-8116f49b-af4e572d_0
2025-10-02T09:30:37.985952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3731312-34bc5e0f-cd45f60b-f9c9d92a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10876888-b632c039-8116f49b-af4e572d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:37.988055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Write session: try to update token
2025-10-02T09:30:37.988065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:37.994795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:37.994818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:37.994821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:37.994823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:37.994831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.994836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.994841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554453601021226:6269]
2025-10-02T09:30:37.994875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:37.994881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:37.994884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:37.994887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:37.994888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:37.994891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:37.995155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:37.998943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId: src_id|10876888-b632c039-8116f49b-af4e572d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.000867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.065699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971513111:7261]
2025-10-02T09:30:38.065895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 813, pipe: [1:7556554457971513111:7261]
2025-10-02T09:30:38.114907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:38.115206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.115215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.115242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513111:7261], now have 1 active actors on pipe
2025-10-02T09:30:38.115470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:38.115500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971513111:7261]
2025-10-02T09:30:38.115501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:38.115524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:38.115576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 814 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10876888-b632c039-8116f49b-af4e572d_0
2025-10-02T09:30:38.115711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 814 sessionId: src_id|10876888-b632c039-8116f49b-af4e572d_0 is DEAD
2025-10-02T09:30:38.115844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:38.115849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Write session will restart in 0.007958s
2025-10-02T09:30:38.115863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Write session: Do CDS request
2025-10-02T09:30:38.115866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:38.123903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:38.125080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.125158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:38.125187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:38.125197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 815
2025-10-02T09:30:38.125275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:38.125284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:38.125292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:38.125295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.125315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:38.125321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:38.125324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:38.125330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:38.125354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554457895988670:6271]
2025-10-02T09:30:38.125617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 815 sessionId:  describe result for acl check
2025-10-02T09:30:38.125643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:38.125648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:38.125649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:38.125652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554457971513217:7336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:38.125716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:38.125937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:38.125965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:38.126018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554457971513217:7336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:38.126152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:38.126182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.126186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.126187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.126187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.126188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.126188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.126189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.126190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.126190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.126191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.126191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.126192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.126194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.126200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.126202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.126204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.126206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.126208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.126210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.126212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.126214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.126217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.126219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.126220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.126225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.126228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.126231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.126234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.126236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.126239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.126241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.126244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.126246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.126249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.126251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.126254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.126256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.126259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.126261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.126263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.126265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.126268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.126270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.126273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.126275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.126278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.126280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.126283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.126301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:38.127475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554457971513217:7336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:38.131814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554457971513217:7336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:38.131823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554457971513217:7336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:38.131824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554457971513217:7336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:38.131828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:38.134186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:38.135682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:38.135694Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:38.135695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:38.135697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:38.135701Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 814 [2:7556554457895988670:6271]
2025-10-02T09:30:38.135709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:38.135719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:38.135724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.135726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.135727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.135736Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:38.135739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:38.135745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:38.135776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.135780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.135781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.135783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:38.135784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:38.135821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:38.135826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.135833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.135838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.135846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:38.135861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513112:2446], now have 1 active actors on pipe
2025-10-02T09:30:38.135865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513256:7336], now have 1 active actors on pipe
2025-10-02T09:30:38.135869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.135870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.135872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.135880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:38.135887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:38.135898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:38.135897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:38.135899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:38.135901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:38.135901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:38.135916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.135900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 814
2025-10-02T09:30:38.135907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 814
2025-10-02T09:30:38.135918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:38.135920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:38.135932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.135934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.135953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:38.135961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.135963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.135964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:38.135969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.135974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:38.135983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.136070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.136075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.136083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.136138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 815 partition: 0 MaxSeqNo: 36 sessionId: src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0
2025-10-02T09:30:38.136343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10876888-b632c039-8116f49b-af4e572d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:38.138464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Write session: try to update token
2025-10-02T09:30:38.138473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:38.146649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:38.146678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.146682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:38.146685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:38.146698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.146704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.146709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554457895988665:6271]
2025-10-02T09:30:38.146756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:38.146760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:38.146765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:38.146769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:38.146772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.146774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:38.147023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:38.150339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId: src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.152340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.215705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971513266:7261]
2025-10-02T09:30:38.216033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 814, pipe: [1:7556554457971513266:7261]
2025-10-02T09:30:38.264625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:38.264900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.264911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.264940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513266:7261], now have 1 active actors on pipe
2025-10-02T09:30:38.265080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:38.265117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:38.265142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971513266:7261]
2025-10-02T09:30:38.265154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:38.265211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 815 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0
2025-10-02T09:30:38.265357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 815 sessionId: src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0 is DEAD
2025-10-02T09:30:38.265473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:38.265480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Write session will restart in 0.008069s
2025-10-02T09:30:38.265495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Write session: Do CDS request
2025-10-02T09:30:38.265500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:38.272615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:38.274042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:38.274150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:38.274166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.274157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:38.274163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:38.274189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:38.274214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554457895988816:6274]
2025-10-02T09:30:38.274212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:38.274221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 816
2025-10-02T09:30:38.274318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.274337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:38.274343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:38.274346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:38.274569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:38.274672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 816 sessionId:  describe result for acl check
2025-10-02T09:30:38.274698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:38.274703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:38.274704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:38.274708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554457971513374:7341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:38.274755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:38.274779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:38.274961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:38.275000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.275004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.275005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.275006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.275006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.275007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.275007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.275008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.275008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.275009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.275009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.275010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.275013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.275019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.275021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.275023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.275025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.275028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.275032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.275035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.275038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.275042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.275045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.275049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.275054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.275063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.275069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.275072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.275076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.275070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554457971513374:7341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:38.275079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.275081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.275084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.275086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.275089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.275095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.275098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.275100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.275103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.275105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.275108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.275112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.275115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.275117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.275121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.275123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.275126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.275129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.275132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.275151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:38.276574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554457971513374:7341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:38.280388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554457971513374:7341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:38.280397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554457971513374:7341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:38.280398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554457971513374:7341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:38.280402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:38.282602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:38.284057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:38.284069Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:38.284070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:38.284072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:38.284076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 815 [2:7556554457895988816:6274]
2025-10-02T09:30:38.284083Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:38.284093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:38.284095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.284096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.284097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.284107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:38.284109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:38.284115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:38.284146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.284152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.284153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.284155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:38.284157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:38.284195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:38.284200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.284206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.284211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.284220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:38.284233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513411:7341], now have 1 active actors on pipe
2025-10-02T09:30:38.284238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513267:2446], now have 1 active actors on pipe
2025-10-02T09:30:38.284242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.284243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.284244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.284252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:38.284261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:38.284268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:38.284270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:38.284271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:38.284272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:38.284273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:38.284288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.284293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:38.284298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:38.284285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 815
2025-10-02T09:30:38.284295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 815
2025-10-02T09:30:38.284312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.284317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.284338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:38.284345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.284348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.284349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:38.284354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.284359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:38.284367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.284461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.284466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.284473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.284531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 816 partition: 0 MaxSeqNo: 36 sessionId: src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0
2025-10-02T09:30:38.284746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88cff6d-845f1fd0-364d3672-c622ae17_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:38.286867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Write session: try to update token
2025-10-02T09:30:38.286877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:38.293599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:38.293614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.293616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:38.293617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:38.293622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.293625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.293627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554457895988811:6274]
2025-10-02T09:30:38.293650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:38.293654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.293658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:38.293661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:38.293665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:38.293669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:38.293769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:38.297159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId: src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.299114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.365226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971513419:7261]
2025-10-02T09:30:38.365443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 815, pipe: [1:7556554457971513419:7261]
2025-10-02T09:30:38.420987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:38.421337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.421349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.421381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513419:7261], now have 1 active actors on pipe
2025-10-02T09:30:38.421586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:38.421579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:38.421592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:38.421606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971513419:7261]
2025-10-02T09:30:38.421627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:38.421647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 816 reason: error at write: Disconnected sessionId: src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0
2025-10-02T09:30:38.421796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 816 sessionId: src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0 is DEAD
2025-10-02T09:30:38.421937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:38.421947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Write session will restart in 0.009456s
2025-10-02T09:30:38.421966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Write session: Do CDS request
2025-10-02T09:30:38.421972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:38.432043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:38.432319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.432376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:38.432390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 817
2025-10-02T09:30:38.432559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.432585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:38.432589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:38.432592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:38.432974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 817 sessionId:  describe result for acl check
2025-10-02T09:30:38.433008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:38.433015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:38.433017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:38.433022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554457971513526:7345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:38.433436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554457971513526:7345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:38.433636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:38.433776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:38.433784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:38.433792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:38.433844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:38.433877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554457895988962:6276]
2025-10-02T09:30:38.434386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:38.434629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:38.434668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:38.434953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:38.434973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554457971513526:7345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:38.435014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.435019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.435019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.435020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.435020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.435021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.435022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.435022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.435023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.435023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.435024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.435024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.435027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.435033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.435035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.435037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.435039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.435041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.435043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.435045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.435047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.435049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.435051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.435053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.435058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.435062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.435065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.435067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.435070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.435072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.435075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.435077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.435081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.435084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.435088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.435093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.435096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.435100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.435104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.435108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.435112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.435116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.435120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.435124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.435128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.435132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.435135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.435140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.435173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:38.440312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554457971513526:7345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:38.440323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554457971513526:7345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:38.440325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554457971513526:7345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:38.440330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:38.443126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:38.444651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:38.444665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:38.444667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:38.444671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:38.444677Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 816 [2:7556554457895988962:6276]
2025-10-02T09:30:38.444690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:38.444704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:38.444707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.444709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.444711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.444723Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:38.444726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:38.444731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:38.444766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.444772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.444774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.444776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:38.444778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:38.444840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:38.444846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.444853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.444859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.444868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:38.444884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513420:2446], now have 1 active actors on pipe
2025-10-02T09:30:38.444891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.444893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.444895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.444903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:38.444909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513564:7345], now have 1 active actors on pipe
2025-10-02T09:30:38.444914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:38.444917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:38.444919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:38.444921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:38.444923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:38.444925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:38.444944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.444952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:38.444967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:38.444957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 816
2025-10-02T09:30:38.444972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 816
2025-10-02T09:30:38.445066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.445076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.445093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:38.445100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.445103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.445104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:38.445110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.445116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:38.445126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.445321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.445334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.445358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.445448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 817 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0
2025-10-02T09:30:38.445762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621531a1-d2edfed0-1f705ff-2eb17be3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:38.448239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Write session: try to update token
2025-10-02T09:30:38.448254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:38.454961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:38.454991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.455000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.455033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:38.455036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:38.455200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:38.455334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:38.455469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:38.455594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:38.455767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:38.455798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:38.460464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId: src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.462675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.462846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.462863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.462891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:38.462941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:38.463909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:38.463923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.463926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:38.463927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:38.463935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.463939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.463942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554457895988956:6276]
2025-10-02T09:30:38.463972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:38.463977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.463979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:38.463982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:38.463986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:38.463990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:38.464099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:38.521892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971513573:7261]
2025-10-02T09:30:38.522351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 816, pipe: [1:7556554457971513573:7261]
2025-10-02T09:30:38.587929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:38.593774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.593793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.593916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.593963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.594011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.594060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.594099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.594106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.594158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.594207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.594257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.594305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.594340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.594345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.594396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.594440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.594489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.594541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.594576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.594581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.594631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.594678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.594726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.594774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.594809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.594814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.594862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.594910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.594977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.595027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.595062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.595067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.595116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.595166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.595214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.595263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.595299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.595304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.595351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.595396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.595448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.595500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.595534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.595539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.595587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.595633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.595680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.595728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.595764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.595770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.595816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.595864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.595909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.595957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.595990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.595994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.596040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:38.596086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:38.596133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:38.596178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:38.596212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:38.596216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:38.596245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513573:7261], now have 1 active actors on pipe
2025-10-02T09:30:38.596459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:38.596467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:38.596470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:38.596490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 817 reason: error at write: Disconnected sessionId: src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0
2025-10-02T09:30:38.596510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971513573:7261]
2025-10-02T09:30:38.596628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 817 sessionId: src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0 is DEAD
2025-10-02T09:30:38.596754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:38.596764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Write session will restart in 0.008931s
2025-10-02T09:30:38.596783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Write session: Do CDS request
2025-10-02T09:30:38.596788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:38.596910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:38.604880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:38.606266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:38.606375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:38.606382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:38.606388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:38.606414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:38.606439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554457895989119:6279]
2025-10-02T09:30:38.606794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:38.606992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:38.607026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:38.607192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.607253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:38.607303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.607307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.607308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.607309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.607309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.607310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.607310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.607311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.607311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.607312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.607312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.607313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.607316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.607323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.607326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.607328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.607330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.607332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.607334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.607336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.607338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.607340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.607342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.607344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.607348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.607353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.607356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.607359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.607361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.607364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.607366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.607369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.607375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.607378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.607380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.607383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.607385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.607388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.607390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.607394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.607397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.607399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.607402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.607404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.607407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.607410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.607413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.607417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.607435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:38.607472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:38.607480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 818
2025-10-02T09:30:38.607582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.607601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:38.607607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:38.607610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:38.607879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 818 sessionId:  describe result for acl check
2025-10-02T09:30:38.607902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:38.607906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:38.607907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:38.607910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554457971513686:7349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:38.608267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554457971513686:7349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:38.610219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554457971513686:7349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:38.614602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554457971513686:7349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:38.614612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554457971513686:7349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:38.614614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554457971513686:7349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:38.614618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:38.615092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:38.616451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:38.616464Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:38.616465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:38.616467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:38.616471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 817 [2:7556554457895989119:6279]
2025-10-02T09:30:38.616477Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:38.616487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:38.616489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.616490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.616491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.616500Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:38.616507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:38.616511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:38.616541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.616545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.616547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.616548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:38.616549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:38.616587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:38.616592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.616598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.616604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.616612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:38.616624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513574:2446], now have 1 active actors on pipe
2025-10-02T09:30:38.616627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513720:7349], now have 1 active actors on pipe
2025-10-02T09:30:38.616631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.616632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.616633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.616640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:38.616648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:38.616657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:38.616658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:38.616660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:38.616665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:38.616666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:38.616674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.616669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 817
2025-10-02T09:30:38.616675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:38.616677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:38.616694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.616697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.616700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 817
2025-10-02T09:30:38.616716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c02aeba-a25e1377-6b80903-6e984216_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:38.616722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.616725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.616726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:38.616731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.616736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:38.616743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.616858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.616863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.616871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.616944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 818 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c02aeba-a25e1377-6b80903-6e984216_0
2025-10-02T09:30:38.617158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a4b5b1-9a799a84-45374ac9-ce37a61b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c02aeba-a25e1377-6b80903-6e984216_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:38.619400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Write session: try to update token
2025-10-02T09:30:38.619411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:38.626397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:38.626415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.626418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:38.626420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:38.626427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.626432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.626436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554457895989114:6279]
2025-10-02T09:30:38.626470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:38.626471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:38.626476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.626477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:38.626478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:38.626480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:38.626612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:38.630415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId: src_id|8c02aeba-a25e1377-6b80903-6e984216_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.632595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.696495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971513754:7261]
2025-10-02T09:30:38.696633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 817, pipe: [1:7556554457971513754:7261]
2025-10-02T09:30:38.744665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:38.744947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.744957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.744980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513754:7261], now have 1 active actors on pipe
2025-10-02T09:30:38.745148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:38.745151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:38.745160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:38.745183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971513754:7261]
2025-10-02T09:30:38.745203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 818 reason: error at write: Disconnected sessionId: src_id|8c02aeba-a25e1377-6b80903-6e984216_0
2025-10-02T09:30:38.745331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 818 sessionId: src_id|8c02aeba-a25e1377-6b80903-6e984216_0 is DEAD
2025-10-02T09:30:38.745467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:38.745478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Write session will restart in 0.008812s
2025-10-02T09:30:38.745479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:38.745496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Write session: Do CDS request
2025-10-02T09:30:38.745515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:38.753896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:38.755170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.755217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:38.755224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 819
2025-10-02T09:30:38.755308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.755313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:38.755326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:38.755332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:38.755334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:38.755421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:38.755427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:38.755432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:38.755460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:38.755483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554457895989301:6293]
2025-10-02T09:30:38.755588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 819 sessionId:  describe result for acl check
2025-10-02T09:30:38.755611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:38.755615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:38.755616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:38.755619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554457971513872:7361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:38.755825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:38.755940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554457971513872:7361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:38.755993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:38.756014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:38.756190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:38.756220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.756224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.756225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.756226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.756226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.756227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.756227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.756228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.756228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.756229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.756229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.756230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.756232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.756239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.756241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.756243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.756245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.756247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.756249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.756251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.756253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.756255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.756257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.756259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.756262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.756266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.756269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.756272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.756274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.756277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.756279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.756282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.756285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.756287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.756289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.756293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.756295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.756301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.756303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.756305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.756308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.756310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.756312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.756315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.756317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.756319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.756322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.756326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.756342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:38.757516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554457971513872:7361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:38.761717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554457971513872:7361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:38.761727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554457971513872:7361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:38.761729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554457971513872:7361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:38.761732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:38.763872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:38.765197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:38.765208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:38.765209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:38.765211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:38.765215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 818 [2:7556554457895989301:6293]
2025-10-02T09:30:38.765222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:38.765232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:38.765233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.765235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.765236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.765245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:38.765251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:38.765256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:38.765285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.765290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.765291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.765292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:38.765294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:38.765332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:38.765337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.765343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.765348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.765360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:38.765374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513914:7361], now have 1 active actors on pipe
2025-10-02T09:30:38.765380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513764:2446], now have 1 active actors on pipe
2025-10-02T09:30:38.765383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.765385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.765386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.765394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:38.765403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:38.765412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:38.765412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:38.765414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:38.765409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 818
2025-10-02T09:30:38.765416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:38.765417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:38.765411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 818
2025-10-02T09:30:38.765429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.765431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:38.765434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:38.765445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.765451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.765471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:38.765478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.765480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.765481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:38.765487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.765493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:38.765502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.765592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.765599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.765609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.765663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 819 partition: 0 MaxSeqNo: 36 sessionId: src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0
2025-10-02T09:30:38.765844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c02aeba-a25e1377-6b80903-6e984216_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:38.768008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Write session: try to update token
2025-10-02T09:30:38.768017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:38.774859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:38.774873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.774875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:38.774876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:38.774880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.774883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.774885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554457895989296:6293]
2025-10-02T09:30:38.774907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:38.774912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.774913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:38.774918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:38.774918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:38.774921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:38.775061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:38.778997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId: src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.780948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.845495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971513929:7261]
2025-10-02T09:30:38.845711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 818, pipe: [1:7556554457971513929:7261]
2025-10-02T09:30:38.892576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:38.892789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.892798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.892839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513929:7261], now have 1 active actors on pipe
2025-10-02T09:30:38.892991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:38.893047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:38.893054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971513929:7261]
2025-10-02T09:30:38.893080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:38.893132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 819 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0
2025-10-02T09:30:38.893261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 819 sessionId: src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0 is DEAD
2025-10-02T09:30:38.893612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:38.893621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Write session will restart in 0.006375s
2025-10-02T09:30:38.893634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Write session: Do CDS request
2025-10-02T09:30:38.893638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:38.901131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.901221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:38.901234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 820
2025-10-02T09:30:38.901329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:38.901358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:38.901366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:38.901370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:38.901749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 820 sessionId:  describe result for acl check
2025-10-02T09:30:38.901780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:38.901787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:38.901788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:38.901791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554457971514038:7366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:38.901834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:38.902153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554457971514038:7366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:38.903126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:38.903222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:38.903229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:38.903234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:38.903260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:38.903282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554457895989450:6296]
2025-10-02T09:30:38.903668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:38.903876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:38.903880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554457971514038:7366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:38.903909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:38.904135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:38.904174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.904179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.904180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.904181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.904182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.904183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.904184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.904185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.904186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.904187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.904188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.904189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.904193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.904201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.904205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.904209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.904212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.904216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.904219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.904227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.904230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.904233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.904237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.904242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.904247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.904254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:38.904263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.904267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:38.904275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.904279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:38.904284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.904289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:38.904294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.904299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:38.904303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.904308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:38.904312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.904319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:38.904324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.904330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:38.904334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.904338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:38.904345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.904350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.904356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.904359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.904361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.904363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.904383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:38.908430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554457971514038:7366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:38.908443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554457971514038:7366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:38.908446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554457971514038:7366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:38.908451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:38.912205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:38.913777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:38.913791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:38.913793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:38.913797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:38.913802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 819 [2:7556554457895989450:6296]
2025-10-02T09:30:38.913813Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:38.913827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:38.913829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.913831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.913833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.913846Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:38.913850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:38.913856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:38.913910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.913917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.913919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.913921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:38.913923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:38.913976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:38.913987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.913999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:38.914008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:38.914024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:38.914048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971514078:7366], now have 1 active actors on pipe
2025-10-02T09:30:38.914051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971513930:2446], now have 1 active actors on pipe
2025-10-02T09:30:38.914056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.914066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.914068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.914080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:38.914094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:38.914095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:38.914098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:38.914100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:38.914112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:38.914115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:38.914107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 819
2025-10-02T09:30:38.914124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 819
2025-10-02T09:30:38.914142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.914148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:38.914150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:38.914161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.914168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.914209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:38.914219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:38.914222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:38.914224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:38.914233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:38.914241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:38.914262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.914382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:38.914390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:38.914401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:38.914473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 820 partition: 0 MaxSeqNo: 36 sessionId: src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0
2025-10-02T09:30:38.914782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8737ed3c-4f27d703-3196450a-7b3f89e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:38.917091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Write session: try to update token
2025-10-02T09:30:38.917102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:38.924228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:38.924246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:38.924248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:38.924250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:38.924259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.924262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.924265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554457895989445:6296]
2025-10-02T09:30:38.924292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:38.924297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:38.924299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:38.924300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:38.924306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:38.924309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:38.924433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:38.929179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId: src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:38.931429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:38.993464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554457971514085:7261]
2025-10-02T09:30:38.993753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 819, pipe: [1:7556554457971514085:7261]
2025-10-02T09:30:39.050898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:39.051187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.051199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.051227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554457971514085:7261], now have 1 active actors on pipe
2025-10-02T09:30:39.051396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:39.051416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:39.051427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:39.051431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:39.051475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 820 reason: error at write: Disconnected sessionId: src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0
2025-10-02T09:30:39.051475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554457971514085:7261]
2025-10-02T09:30:39.051612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 820 sessionId: src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0 is DEAD
2025-10-02T09:30:39.051737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:39.051744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Write session will restart in 0.007820s
2025-10-02T09:30:39.051766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Write session: Do CDS request
2025-10-02T09:30:39.051771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:39.060286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.060362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:39.060373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 821
2025-10-02T09:30:39.060453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.060480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:39.060487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:39.060490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:39.060844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 821 sessionId:  describe result for acl check
2025-10-02T09:30:39.060877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:39.060879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:39.060880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:39.060885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554462266481490:7370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:39.061315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554462266481490:7370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:39.061499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:39.063027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:39.063156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:39.063172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:39.063180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:39.063212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:39.063226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554462266481490:7370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:39.063236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554462190956894:6298]
2025-10-02T09:30:39.063592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:39.063785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:39.063809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:39.063990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:39.064022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.064026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.064027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.064027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.064028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.064028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.064029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.064029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.064030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.064030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.064031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.064031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.064034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.064040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.064042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.064044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.064046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.064048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.064050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.064052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.064054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.064056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.064058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.064060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.064063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.064067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.064070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.064073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.064075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.064078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.064080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.064083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.064085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.064088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.064090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.064093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.064096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.064099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.064101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.064104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.064106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.064108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.064111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.064113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.064115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.064118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.064120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.064123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.064140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:39.068258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554462266481490:7370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:39.068274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554462266481490:7370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:39.068277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554462266481490:7370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:39.068284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:39.071971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:39.073422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:39.073437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:39.073439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:39.073443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:39.073448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 820 [2:7556554462190956894:6298]
2025-10-02T09:30:39.073461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:39.073472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:39.073473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.073475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.073476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.073486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:39.073491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:39.073500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:39.073535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.073540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.073541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.073543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:39.073545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:39.073587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:39.073592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.073598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.073604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.073613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:39.073628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481532:7370], now have 1 active actors on pipe
2025-10-02T09:30:39.073635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.073636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.073638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.073643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:39.073650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:39.073654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:39.073658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:39.073660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:39.073662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:39.073663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481383:2446], now have 1 active actors on pipe
2025-10-02T09:30:39.073663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:39.073680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.073685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:39.073687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:39.073703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 820
2025-10-02T09:30:39.073743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 820
2025-10-02T09:30:39.073751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.073757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.073771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:39.073778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.073780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.073781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:39.073787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.073797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:39.073809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.073896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.073900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.073907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.073978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 821 partition: 0 MaxSeqNo: 36 sessionId: src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0
2025-10-02T09:30:39.074254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6c27f9-1bfcbf79-4800f7ac-1a4f8709_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:39.076822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Write session: try to update token
2025-10-02T09:30:39.076836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:39.087943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:39.087960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.087967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.088005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:39.088008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:39.088163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:39.088293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:39.088418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:39.088571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:39.088575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId: src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:39.088753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:39.088785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:39.090675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:39.090936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.090950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.090983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:39.091042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:39.091958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:39.091972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.091974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:39.091976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:39.091982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.091985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.091988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554462190956889:6298]
2025-10-02T09:30:39.092016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:39.092022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.092023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:39.092034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:39.092040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:39.092045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:39.092134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:39.151662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554462266481539:7261]
2025-10-02T09:30:39.151942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 820, pipe: [1:7556554462266481539:7261]
2025-10-02T09:30:39.220562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:39.227991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.228014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.228164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.228228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.228288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.228353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.228400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.228409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.228472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.228527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.228585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.228652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.228698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.228705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.228769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.228843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.228905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.228965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.229007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.229011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.229072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.229126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.229179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.229245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.229287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.229294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.229361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.229422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.229484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.229549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.229595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.229602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.229667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.229730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.229791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.229854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.229895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.229903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.229963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.230021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.230081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.230142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.230182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.230189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.230252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.230308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.230362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.230420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.230461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.230467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.230531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.230588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.230646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.230703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.230743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.230749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.230803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:39.230860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:39.230913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:39.230985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:39.231040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:39.231046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:39.231098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481539:7261], now have 1 active actors on pipe
2025-10-02T09:30:39.231331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:39.231359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:39.231363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:39.231388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 821 reason: error at write: Disconnected sessionId: src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0
2025-10-02T09:30:39.231391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554462266481539:7261]
2025-10-02T09:30:39.231573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 821 sessionId: src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0 is DEAD
2025-10-02T09:30:39.231704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:39.231714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Write session will restart in 0.009943s
2025-10-02T09:30:39.231730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Write session: Do CDS request
2025-10-02T09:30:39.231734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:39.231899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:39.242276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.242340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:39.242352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 822
2025-10-02T09:30:39.242447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.242470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:39.242477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:39.242480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:39.242868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 822 sessionId:  describe result for acl check
2025-10-02T09:30:39.242907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:39.242915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:39.242916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:39.242922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554462266481655:7375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:39.242996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:39.243456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554462266481655:7375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:39.244938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:39.245066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:39.245074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:39.245080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:39.245110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:39.245135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554462190957046:6301]
2025-10-02T09:30:39.245539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554462266481655:7375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:39.245599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:39.245822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:39.245865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:39.246149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:39.246197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.246202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.246202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.246203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.246204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.246204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.246205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.246206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.246206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.246207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.246207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.246208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.246211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.246217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.246220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.246222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.246224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.246226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.246228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.246231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.246233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.246235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.246237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.246240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.246245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.246249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.246252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.246256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.246258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.246261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.246263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.246266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.246269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.246271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.246274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.246276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.246279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.246281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.246288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.246290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.246293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.246296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.246298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.246301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.246303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.246306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.246308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.246311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.246332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:39.250728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554462266481655:7375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:39.250741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554462266481655:7375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:39.250745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554462266481655:7375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:39.250752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:39.254541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:39.255982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:39.255997Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:39.255998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:39.256001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:39.256005Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 821 [2:7556554462190957046:6301]
2025-10-02T09:30:39.256013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:39.256024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:39.256029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.256031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.256032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.256044Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:39.256052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:39.256056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:39.256092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.256097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.256099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.256101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:39.256103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:39.256143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:39.256148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.256155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.256160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.256168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:39.256183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.256187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.256189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.256195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:39.256203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:39.256206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481693:7375], now have 1 active actors on pipe
2025-10-02T09:30:39.256208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481544:2446], now have 1 active actors on pipe
2025-10-02T09:30:39.256210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:39.256212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:39.256214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:39.256221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:39.256222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:39.256240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.256248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:39.256252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:39.256290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 821
2025-10-02T09:30:39.256308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 821
2025-10-02T09:30:39.256342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.256347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.256362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf275d74-f1bec466-e703a4fa-6836174b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:39.256370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.256372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.256375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:39.256380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.256386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:39.256394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.256507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.256513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.256520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.256605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 822 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf275d74-f1bec466-e703a4fa-6836174b_0
2025-10-02T09:30:39.256945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f8e97-91c7698a-ffaf5fde-cbd570c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf275d74-f1bec466-e703a4fa-6836174b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:39.259448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Write session: try to update token
2025-10-02T09:30:39.259463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:39.265902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:39.265919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.265924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.265954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:39.265955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:39.266092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:39.266236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:39.266384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:39.266502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:39.266753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:39.266796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:39.271898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId: src_id|cf275d74-f1bec466-e703a4fa-6836174b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:39.274297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:39.274953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.274981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.274994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:39.274995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.274997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:39.274998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:39.275003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.275006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.275008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554462190957041:6301]
2025-10-02T09:30:39.275040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:39.275041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:39.275045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:39.275048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.275049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:39.275050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:39.275157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:39.331370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554462266481701:7261]
2025-10-02T09:30:39.331614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 821, pipe: [1:7556554462266481701:7261]
2025-10-02T09:30:39.402329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:39.402632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:39.402659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481701:7261], now have 1 active actors on pipe
2025-10-02T09:30:39.402753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:39.402795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:39.402826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:39.402832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:39.402852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554462266481701:7261]
2025-10-02T09:30:39.402890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 822 reason: error at write: Disconnected sessionId: src_id|cf275d74-f1bec466-e703a4fa-6836174b_0
2025-10-02T09:30:39.403008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 822 sessionId: src_id|cf275d74-f1bec466-e703a4fa-6836174b_0 is DEAD
2025-10-02T09:30:39.403142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:39.403148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Write session will restart in 0.005852s
2025-10-02T09:30:39.403166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Write session: Do CDS request
2025-10-02T09:30:39.403175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:39.410190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.410257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:39.410270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 823
2025-10-02T09:30:39.410370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.410396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:39.410405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:39.410410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:39.410788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 823 sessionId:  describe result for acl check
2025-10-02T09:30:39.410819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:39.410825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:39.410827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:39.410831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554462266481813:7379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:39.411305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554462266481813:7379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:39.411573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:39.412772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554462266481813:7379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:39.413446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:39.413580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:39.413586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:39.413592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:39.413623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:39.413654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554462190957195:6303]
2025-10-02T09:30:39.414014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:39.414197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:39.414237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:39.414458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:39.414520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.414528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.414529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.414530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.414531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.414532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.414533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.414536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.414537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.414538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.414539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.414540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.414546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.414551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.414554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.414556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.414558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.414560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.414562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.414564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.414566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.414568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.414570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.414572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.414578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.414583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.414586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.414589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.414593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.414595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.414599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.414602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.414604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.414608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.414612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.414621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.414624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.414626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.414628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.414631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.414633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.414636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.414638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.414643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.414645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.414648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.414653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.414656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.414679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:39.414901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554462266481813:7379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:39.414916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554462266481813:7379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:39.414919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554462266481813:7379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:39.414922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:39.422851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:39.425397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:39.425414Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:39.425416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:39.425418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:39.425423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 822 [2:7556554462190957195:6303]
2025-10-02T09:30:39.425433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:39.425446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:39.425447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.425449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.425450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.425464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:39.425470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:39.425477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:39.425537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.425546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.425548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.425551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:39.425554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:39.425610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:39.425617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.425629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.425640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.425659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:39.425680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481703:2446], now have 1 active actors on pipe
2025-10-02T09:30:39.425687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481854:7379], now have 1 active actors on pipe
2025-10-02T09:30:39.425692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.425695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.425697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.425713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:39.425723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:39.425725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:39.425726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:39.425729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:39.425710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 822
2025-10-02T09:30:39.425740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:39.425745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:39.425743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 822
2025-10-02T09:30:39.425782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.425788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.425796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.425801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:39.425815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:39.425820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:39.425824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.425828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.425830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:39.425835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.425842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:39.425856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.425949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.425957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.425967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.426023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 823 partition: 0 MaxSeqNo: 36 sessionId: src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0
2025-10-02T09:30:39.426354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf275d74-f1bec466-e703a4fa-6836174b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:39.431960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Write session: try to update token
2025-10-02T09:30:39.431975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:39.436383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:39.436400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.436402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:39.436404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:39.436411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.436415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.436419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554462190957190:6303]
2025-10-02T09:30:39.436449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:39.436451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:39.436455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.436455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:39.436456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:39.436458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:39.436703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:39.447739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId: src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:39.449890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:39.502903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554462266481862:7261]
2025-10-02T09:30:39.503223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 822, pipe: [1:7556554462266481862:7261]
2025-10-02T09:30:39.566697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:39.567018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.567035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.567054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481862:7261], now have 1 active actors on pipe
2025-10-02T09:30:39.567221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:39.567227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554462266481862:7261]
2025-10-02T09:30:39.567244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:39.567246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:39.567327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 823 reason: error at write: Disconnected sessionId: src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0
2025-10-02T09:30:39.567390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:39.567495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 823 sessionId: src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0 is DEAD
2025-10-02T09:30:39.567692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:39.567711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Write session will restart in 0.009050s
2025-10-02T09:30:39.567735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Write session: Do CDS request
2025-10-02T09:30:39.567741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:39.576521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:39.578062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:39.578233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:39.578242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:39.578251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:39.578308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:39.578343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554462190957357:6305]
2025-10-02T09:30:39.578401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.578395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:39.578407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 824
2025-10-02T09:30:39.578667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.578699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:39.578706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:39.578709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:39.578810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:39.579026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:39.579046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 824 sessionId:  describe result for acl check
2025-10-02T09:30:39.579057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:39.579076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:39.579081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:39.579083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:39.579088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554462266481992:7383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:39.579246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:39.579274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.579276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.579277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.579277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.579278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.579278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.579279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.579279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.579280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.579280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.579281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.579281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.579285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.579291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.579293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.579295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.579297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.579299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.579301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.579303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.579305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.579307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.579309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.579310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.579314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.579318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.579321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.579324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.579326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.579328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.579330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.579333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.579335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.579338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.579340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.579343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.579346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.579351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.579354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.579358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.579361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.579366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.579370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.579374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.579376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.579379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.579381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.579384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.579400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:39.579511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554462266481992:7383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:39.581116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554462266481992:7383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:39.586231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554462266481992:7383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:39.586243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554462266481992:7383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:39.586246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554462266481992:7383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:39.586253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:39.587483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:39.589001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:39.589016Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:39.589018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:39.589022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:39.589027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 823 [2:7556554462190957357:6305]
2025-10-02T09:30:39.589037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:39.589051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:39.589053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.589055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.589058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.589068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:39.589071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:39.589075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:39.589107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.589113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.589114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.589116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:39.589118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:39.589155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:39.589160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.589171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.589180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.589200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:39.589220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482027:7383], now have 1 active actors on pipe
2025-10-02T09:30:39.589229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.589231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.589232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.589241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:39.589250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266481864:2446], now have 1 active actors on pipe
2025-10-02T09:30:39.589255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:39.589255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:39.589259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:39.589263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:39.589263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:39.589264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:39.589286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.589293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:39.589282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 823
2025-10-02T09:30:39.589307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:39.589316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.589287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 823
2025-10-02T09:30:39.589319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.589342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ace8c522-3971438c-4baa217c-a0dab76c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:39.589352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.589355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.589357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:39.589363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.589371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:39.589386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.589574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.589583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.589595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.589702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 824 partition: 0 MaxSeqNo: 36 sessionId: src_id|ace8c522-3971438c-4baa217c-a0dab76c_0
2025-10-02T09:30:39.589979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de29e67c-f4ffbe75-ca0d8487-ec33b159_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ace8c522-3971438c-4baa217c-a0dab76c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:39.592316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Write session: try to update token
2025-10-02T09:30:39.592331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:39.599227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:39.599246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.599248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:39.599250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:39.599256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.599259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.599263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554462190957341:6305]
2025-10-02T09:30:39.599295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:39.599304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.599313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:39.599345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:39.599369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:39.599375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:39.599457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:39.606026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId: src_id|ace8c522-3971438c-4baa217c-a0dab76c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:39.608322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:39.667240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554462266482047:7261]
2025-10-02T09:30:39.667443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 823, pipe: [1:7556554462266482047:7261]
2025-10-02T09:30:39.717559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:39.717849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.717859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.717871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482047:7261], now have 1 active actors on pipe
2025-10-02T09:30:39.718012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:39.718060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:39.718073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:39.718078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554462266482047:7261]
2025-10-02T09:30:39.718093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:39.718129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 824 reason: error at write: Disconnected sessionId: src_id|ace8c522-3971438c-4baa217c-a0dab76c_0
2025-10-02T09:30:39.718254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 824 sessionId: src_id|ace8c522-3971438c-4baa217c-a0dab76c_0 is DEAD
2025-10-02T09:30:39.718425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:39.718433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Write session will restart in 0.005014s
2025-10-02T09:30:39.718450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Write session: Do CDS request
2025-10-02T09:30:39.718455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:39.724127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.724221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:39.724229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 825
2025-10-02T09:30:39.724352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.724373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:39.724380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:39.724382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:39.724624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 825 sessionId:  describe result for acl check
2025-10-02T09:30:39.724643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:39.724647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:39.724648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:39.724653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554462266482109:7394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:39.724926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554462266482109:7394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:39.726514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554462266482109:7394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:39.728541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:39.728691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554462266482109:7394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:39.728704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554462266482109:7394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:39.728707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554462266482109:7394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:39.728712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:39.728848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:39.729003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:39.729013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:39.729024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:39.729069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:39.729102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554462190957525:6308]
2025-10-02T09:30:39.729649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:39.729847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:39.729885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:39.730171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:39.730229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.730234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.730235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.730236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.730237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.730238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.730239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.730240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.730241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.730242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.730243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.730244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.730248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.730257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.730261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.730264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.730268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.730272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.730275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.730278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.730282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.730286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.730289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.730293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.730298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.730304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.730310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.730315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.730319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.730323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.730327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.730332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.730336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.730340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.730344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.730349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.730353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.730364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.730369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.730373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.730378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.730383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.730386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.730391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.730397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.730401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.730406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.730411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.730442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:39.738430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:39.740049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:39.740067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:39.740069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:39.740072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:39.740076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 824 [2:7556554462190957525:6308]
2025-10-02T09:30:39.740087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:39.740099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:39.740102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.740106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.740108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.740119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:39.740123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:39.740128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:39.740170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.740193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.740195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.740198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:39.740200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:39.740248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:39.740255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.740267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.740280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.740300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:39.740320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482051:2446], now have 1 active actors on pipe
2025-10-02T09:30:39.740328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482211:7394], now have 1 active actors on pipe
2025-10-02T09:30:39.740309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 824
2025-10-02T09:30:39.740332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.740339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 824
2025-10-02T09:30:39.740334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.740336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.740341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:39.740350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:39.740352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:39.740352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:39.740354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:39.740364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:39.740367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:39.740399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.740407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.740417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.740425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:39.740436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:39.740451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:39.740460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.740464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.740466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:39.740473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.740480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:39.740501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.740596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.740604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.740615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.740668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 825 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0
2025-10-02T09:30:39.740919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c522-3971438c-4baa217c-a0dab76c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:39.743123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Write session: try to update token
2025-10-02T09:30:39.743134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:39.750270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:39.750289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.750290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:39.750291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:39.750296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.750297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.750301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554462190957519:6308]
2025-10-02T09:30:39.750324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:39.750324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:39.750327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:39.750328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.750329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:39.750330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:39.750439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:39.754269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId: src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:39.756430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:39.818291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554462266482243:7261]
2025-10-02T09:30:39.818499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 824, pipe: [1:7556554462266482243:7261]
2025-10-02T09:30:39.869523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:39.869757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.869768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.869800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482243:7261], now have 1 active actors on pipe
2025-10-02T09:30:39.870017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:39.870022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:39.870035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:39.870060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554462266482243:7261]
2025-10-02T09:30:39.870074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:39.870083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 825 reason: error at write: Disconnected sessionId: src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0
2025-10-02T09:30:39.870215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 825 sessionId: src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0 is DEAD
2025-10-02T09:30:39.870429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:39.870442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Write session will restart in 0.005033s
2025-10-02T09:30:39.870467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Write session: Do CDS request
2025-10-02T09:30:39.870473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:39.876200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.876312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:39.876322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 826
2025-10-02T09:30:39.876445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:39.876466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:39.876473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:39.876476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:39.876744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 826 sessionId:  describe result for acl check
2025-10-02T09:30:39.876773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:39.876779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:39.876780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:39.876784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554462266482312:7400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:39.877145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554462266482312:7400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:39.878439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:39.878907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554462266482312:7400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:39.879863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:39.880061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:39.880069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:39.880075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:39.880107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:39.880131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554462190957702:6322]
2025-10-02T09:30:39.880469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:39.880628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:39.880653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:39.880669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554462266482312:7400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:39.880678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554462266482312:7400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:39.880680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554462266482312:7400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:39.880684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:39.880848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:39.880880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.880884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.880884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.880886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.880886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.880887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.880887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.880888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.880888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.880889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.880891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.880897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.880899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.880901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.880903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.880905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.880907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.880909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.880911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.880913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.880915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.880917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.880921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.880925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:39.880928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.880931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:39.880933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.880935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:39.880938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.880941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:39.880943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.880945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:39.880947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.880950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:39.880952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.880954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:39.880956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.880958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:39.880960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.880963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:39.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.880967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.880969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.880972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.880974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.880976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.881003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:39.888970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:39.890432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:39.890446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:39.890447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:39.890449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:39.890452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 825 [2:7556554462190957702:6322]
2025-10-02T09:30:39.890461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:39.890471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:39.890473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.890474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.890476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.890484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:39.890486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:39.890491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:39.890521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.890527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.890528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.890530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:39.890531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:39.890569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:39.890574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.890581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:39.890586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:39.890594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:39.890609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482248:2446], now have 1 active actors on pipe
2025-10-02T09:30:39.890615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.890618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.890619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.890627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:39.890634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482399:7400], now have 1 active actors on pipe
2025-10-02T09:30:39.890639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:39.890639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:39.890641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:39.890643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:39.890646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:39.890647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:39.890661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.890667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:39.890668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:39.890670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 825
2025-10-02T09:30:39.890677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 825
2025-10-02T09:30:39.890728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.890733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.890747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3a91f89-133b5703-4218a328-21a13d3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:39.890750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:39.890756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:39.890757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:39.890762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:39.890767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:39.890777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.890877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:39.890882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:39.890889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:39.890948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 826 partition: 0 MaxSeqNo: 36 sessionId: src_id|e3a91f89-133b5703-4218a328-21a13d3d_0
2025-10-02T09:30:39.891263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fe7ee-2b34dec1-6db2c940-934c6f9f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e3a91f89-133b5703-4218a328-21a13d3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:39.894004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Write session: try to update token
2025-10-02T09:30:39.894019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:39.900561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:39.900578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:39.900579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:39.900580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:39.900584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.900586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.900588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554462190957697:6322]
2025-10-02T09:30:39.900611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:39.900615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:39.900617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:39.900618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:39.900621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:39.900624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:39.900726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:39.908876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId: src_id|e3a91f89-133b5703-4218a328-21a13d3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:39.911011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:39.970331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554462266482409:7261]
2025-10-02T09:30:39.970516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 825, pipe: [1:7556554462266482409:7261]
2025-10-02T09:30:40.016328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.016567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.016576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.016587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554462266482409:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.016718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.016751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554462266482409:7261]
2025-10-02T09:30:40.016774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.017055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:40.017107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 826 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3a91f89-133b5703-4218a328-21a13d3d_0
2025-10-02T09:30:40.017242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 826 sessionId: src_id|e3a91f89-133b5703-4218a328-21a13d3d_0 is DEAD
2025-10-02T09:30:40.017401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:40.017415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Write session will restart in 0.005602s
2025-10-02T09:30:40.017437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Write session: Do CDS request
2025-10-02T09:30:40.017443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.024185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.024316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.024326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 827
2025-10-02T09:30:40.024460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.024489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.024495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.024498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.024761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 827 sessionId:  describe result for acl check
2025-10-02T09:30:40.024781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.024785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.024787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.024790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561449822:7404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.024894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.025147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561449822:7404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.026300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.026407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.026414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.026420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.026448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.026471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485925153:6325]
2025-10-02T09:30:40.026513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561449822:7404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.026839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.027053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.027078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.027264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.027296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.027301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.027302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.027303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.027304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.027305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.027305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.027306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.027307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.027308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.027309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.027310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.027313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.027323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.027327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.027330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.027332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.027334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.027336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.027337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.027340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.027342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.027344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.027346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.027350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.027354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.027357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.027360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.027362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.027365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.027367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.027369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.027372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.027374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.027376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.027379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.027381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.027384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.027386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.027389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.027395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.027398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.027400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.027404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.027406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.027408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.027411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.027417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.027434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.031367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561449822:7404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.031377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561449822:7404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.031379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561449822:7404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.031383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.034924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.036281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.036293Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.036294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.036296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.036299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 826 [2:7556554466485925153:6325]
2025-10-02T09:30:40.036306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.036315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.036316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.036318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.036319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.036328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.036330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.036335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.036365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.036370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.036371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.036374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.036375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.036412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.036417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.036423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.036428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.036436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.036446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561449862:7404], now have 1 active actors on pipe
2025-10-02T09:30:40.036452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561449707:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.036455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.036457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.036458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.036465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.036472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.036483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.036484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.036484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.036486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.036483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 826
2025-10-02T09:30:40.036488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.036497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.036499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.036484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 826
2025-10-02T09:30:40.036504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.036515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.036521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.036537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.036544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.036546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.036547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.036551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.036557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.036564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.036654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.036659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.036666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.036724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 827 partition: 0 MaxSeqNo: 36 sessionId: src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0
2025-10-02T09:30:40.037018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a91f89-133b5703-4218a328-21a13d3d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.039746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Write session: try to update token
2025-10-02T09:30:40.039762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.045581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.045593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.045594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.045595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.045598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.045601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.045603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485925148:6325]
2025-10-02T09:30:40.045624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.045626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.045631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.045637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.045643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.045647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.045738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.053316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId: src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:40.055416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:40.116780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554466561449869:7261]
2025-10-02T09:30:40.117052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 826, pipe: [1:7556554466561449869:7261]
2025-10-02T09:30:40.171034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.171480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.171493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.171510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561449869:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.171708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.171742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:40.171756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:40.171755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554466561449869:7261]
2025-10-02T09:30:40.171769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.171808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 827 reason: error at write: Disconnected sessionId: src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0
2025-10-02T09:30:40.171982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 827 sessionId: src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0 is DEAD
2025-10-02T09:30:40.172163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:40.172180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Write session will restart in 0.005345s
2025-10-02T09:30:40.172211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Write session: Do CDS request
2025-10-02T09:30:40.172219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.178228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.178404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.178416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 828
2025-10-02T09:30:40.178504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.178525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.178528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.178532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.179023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 828 sessionId:  describe result for acl check
2025-10-02T09:30:40.179056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.179062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.179064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.179068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561449913:7409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.179553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561449913:7409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.181617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561449913:7409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.182051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.183713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.183824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561449913:7409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.183836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561449913:7409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.183839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561449913:7409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.183845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.183853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.183861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.183867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.183902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.183933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485925312:6328]
2025-10-02T09:30:40.184426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.184662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.184707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.185033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.185082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.185086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.185087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.185088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.185089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.185090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.185091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.185092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.185093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.185093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.185094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.185095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.185100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.185111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.185115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.185119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.185122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.185126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.185129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.185133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.185137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.185140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.185144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.185148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.185154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.185161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.185170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.185176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.185181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.185185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.185190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.185198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.185202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.185207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.185214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.185219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.185223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.185226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.185229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.185233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.185237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.185242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.185246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.185252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.185256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.185264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.185268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.185273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.185303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.193177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.194785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.194801Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.194802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.194805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.194809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 827 [2:7556554466485925312:6328]
2025-10-02T09:30:40.194818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.194828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.194830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.194832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.194834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.194843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.194852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.194858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.194895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.194900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.194901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.194903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.194904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.194946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.194951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.194958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.194976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.194996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.195016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450025:7409], now have 1 active actors on pipe
2025-10-02T09:30:40.195023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561449872:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.195029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.195031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.195033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.195044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.195059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.195060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.195062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.195064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.195073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.195074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.195096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.195102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.195087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 827
2025-10-02T09:30:40.195113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.195092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 827
2025-10-02T09:30:40.195137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.195148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.195167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.195179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.195185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.195186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.195194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.195203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.195216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.195351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.195361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.195380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.195457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 828 partition: 0 MaxSeqNo: 36 sessionId: src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0
2025-10-02T09:30:40.195806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a87a0559-c3d6b24e-5d85322e-10ded982_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.199117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Write session: try to update token
2025-10-02T09:30:40.199140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.208909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:40.208925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.208938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.208971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:40.208987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:40.209129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:40.209247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:40.209364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:40.209481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:40.209647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:40.209676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:40.213429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.213443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.213444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.213446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.213452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.213454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.213457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485925306:6328]
2025-10-02T09:30:40.213477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.213481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.213483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.213485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.213489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.213493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.213595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.216183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId: src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:40.218412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:40.271932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554466561450036:7261]
2025-10-02T09:30:40.272130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 827, pipe: [1:7556554466561450036:7261]
2025-10-02T09:30:40.332263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.332518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.332535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.332551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450036:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.332785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.332841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:40.332855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:40.332877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554466561450036:7261]
2025-10-02T09:30:40.332897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.332910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 828 reason: error at write: Disconnected sessionId: src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0
2025-10-02T09:30:40.333067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 828 sessionId: src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0 is DEAD
2025-10-02T09:30:40.333270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:40.333288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Write session will restart in 0.009935s
2025-10-02T09:30:40.333310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Write session: Do CDS request
2025-10-02T09:30:40.333316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.344014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.344209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.344304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.344318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 829
2025-10-02T09:30:40.344485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.344507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.344514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.344517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.344880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 829 sessionId:  describe result for acl check
2025-10-02T09:30:40.344915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.344920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.344922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.344927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561450157:7413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.345444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561450157:7413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.345780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.345893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.345900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.345906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.345934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.345958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485925469:6330]
2025-10-02T09:30:40.346309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.346473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.346496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.346678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.346710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.346714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.346715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.346716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.346717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.346717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.346718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.346718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.346719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.346719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.346720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.346720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.346724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.346730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.346732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.346734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.346736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.346738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.346740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.346742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.346744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.346746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.346748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.346750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.346754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.346758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.346761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.346763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.346766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.346769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.346772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.346775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.346777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.346780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.346783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.346785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.346788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.346791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.346793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.346796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.346798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.346801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.346803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.346806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.346809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.346812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.346814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.346817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.346834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.347054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561450157:7413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.351838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561450157:7413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.351849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561450157:7413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.351852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561450157:7413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.351857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.354612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.356088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.356102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.356104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.356106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.356109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 828 [2:7556554466485925469:6330]
2025-10-02T09:30:40.356116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.356127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.356128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.356130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.356131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.356140Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.356143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.356148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.356179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.356180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.356181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.356183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.356185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.356226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.356231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.356239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.356244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.356252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.356261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.356262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.356263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.356267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.356275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.356282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.356285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.356287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.356288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.356290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.356307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450195:7413], now have 1 active actors on pipe
2025-10-02T09:30:40.356309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450037:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.356310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.356312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.356314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.356347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 828
2025-10-02T09:30:40.356356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 828
2025-10-02T09:30:40.356420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.356426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.356441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|894b3502-3445e583-59722d3d-9111a348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.356445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.356447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.356448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.356454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.356459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.356468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.356573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.356578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.356585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.356642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 829 partition: 0 MaxSeqNo: 36 sessionId: src_id|894b3502-3445e583-59722d3d-9111a348_0
2025-10-02T09:30:40.356954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e6bcf-d5a0783a-349f282f-8f9a3ee0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|894b3502-3445e583-59722d3d-9111a348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.359909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Write session: try to update token
2025-10-02T09:30:40.359926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.365514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:40.365528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.365535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.365562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:40.365569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:40.365738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:40.365882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:40.366007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:40.366153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:40.366313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:40.366340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:40.374232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId: src_id|894b3502-3445e583-59722d3d-9111a348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:40.374757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.374776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.374778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.374780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.374786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.374789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.374792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485925463:6330]
2025-10-02T09:30:40.374821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.374828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.374830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.374842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.374853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.374857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.374987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.376396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:40.433172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554466561450202:7261]
2025-10-02T09:30:40.433396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 828, pipe: [1:7556554466561450202:7261]
2025-10-02T09:30:40.496500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.496851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.496862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.496880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450202:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.497063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.497100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554466561450202:7261]
2025-10-02T09:30:40.497100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:40.497104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:40.497124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.497158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 829 reason: error at write: Disconnected sessionId: src_id|894b3502-3445e583-59722d3d-9111a348_0
2025-10-02T09:30:40.497302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 829 sessionId: src_id|894b3502-3445e583-59722d3d-9111a348_0 is DEAD
2025-10-02T09:30:40.497453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:40.497470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Write session will restart in 0.006044s
2025-10-02T09:30:40.497493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Write session: Do CDS request
2025-10-02T09:30:40.497499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.504161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.504308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.504320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 830
2025-10-02T09:30:40.504444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.504476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.504483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.504486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.504828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 830 sessionId:  describe result for acl check
2025-10-02T09:30:40.504858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.504860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.504861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.504865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561450237:7417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.505323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561450237:7417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.507224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561450237:7417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.507863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.509313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.509452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.509461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.509470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.509512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.509545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485925627:6332]
2025-10-02T09:30:40.509566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561450237:7417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.509577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561450237:7417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.509580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561450237:7417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.509595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.509948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.510181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.510224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.510460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.510505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.510509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.510510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.510510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.510511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.510512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.510512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.510513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.510514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.510514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.510515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.510515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.510518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.510524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.510526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.510528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.510530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.510532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.510534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.510536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.510538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.510540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.510542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.510544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.510548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.510552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.510555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.510558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.510561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.510563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.510565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.510568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.510572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.510575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.510578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.510584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.510586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.510589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.510591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.510593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.510595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.510598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.510600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.510603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.510605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.510608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.510610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.510612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.510630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.518378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.519954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.519969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.519970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.519972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.519976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 829 [2:7556554466485925627:6332]
2025-10-02T09:30:40.519984Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.519994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.519996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.519998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.519999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.520009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.520012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.520020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.520053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.520058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.520059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.520061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.520063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.520104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.520108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.520116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.520122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.520130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.520146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450357:7417], now have 1 active actors on pipe
2025-10-02T09:30:40.520151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450203:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.520155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.520156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.520157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.520164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.520175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.520180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.520182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.520183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.520185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.520187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.520208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.520216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.520234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.520209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 829
2025-10-02T09:30:40.520213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 829
2025-10-02T09:30:40.520265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.520271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.520296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.520303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.520306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.520307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.520312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.520320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.520330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.520459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.520464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.520472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.520540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 830 partition: 0 MaxSeqNo: 36 sessionId: src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0
2025-10-02T09:30:40.520874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894b3502-3445e583-59722d3d-9111a348_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.523931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Write session: try to update token
2025-10-02T09:30:40.523951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.529802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.529817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.529818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.529820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.529825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.529827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.529830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485925621:6332]
2025-10-02T09:30:40.529854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.529858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.529860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.529861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.529865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.529867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.529974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.539045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId: src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:40.541253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:40.597024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554466561450369:7261]
2025-10-02T09:30:40.597215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 829, pipe: [1:7556554466561450369:7261]
2025-10-02T09:30:40.644555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.644851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.644860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.644872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450369:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.645062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:40.645065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.645073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:40.645100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554466561450369:7261]
2025-10-02T09:30:40.645118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 830 reason: error at write: Disconnected sessionId: src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0
2025-10-02T09:30:40.645134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.645270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 830 sessionId: src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0 is DEAD
2025-10-02T09:30:40.645435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:40.645450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Write session will restart in 0.005723s
2025-10-02T09:30:40.645474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Write session: Do CDS request
2025-10-02T09:30:40.645479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.652317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.652353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.652365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 831
2025-10-02T09:30:40.652537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.652556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.652563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.652566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.652864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 831 sessionId:  describe result for acl check
2025-10-02T09:30:40.652884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.652888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.652889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.652892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561450496:7422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.653217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561450496:7422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.653736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.654888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561450496:7422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.655336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.655447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.655455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.655460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.655488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.655514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485925797:6335]
2025-10-02T09:30:40.655862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.656048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.656072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.656256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.656285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.656291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.656291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.656292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.656293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.656293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.656294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.656294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.656295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.656295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.656296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.656296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.656299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.656305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.656307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.656309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.656311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.656313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.656315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.656317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.656319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.656322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.656324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.656326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.656330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.656334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.656337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.656341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.656343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.656346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.656348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.656351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.656353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.656355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.656357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.656360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.656363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.656366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.656368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.656371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.656373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.656376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.656378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.656381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.656384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.656387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.656389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.656392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.656410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.656765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561450496:7422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.656775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561450496:7422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.656778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561450496:7422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.656783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.664082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.665614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.665628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.665629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.665631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.665635Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 830 [2:7556554466485925797:6335]
2025-10-02T09:30:40.665641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.665652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.665654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.665655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.665657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.665665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.665669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.665673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.665703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.665704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.665705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.665707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.665708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.665748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.665753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.665760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.665766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.665775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.665786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450382:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.665791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450540:7422], now have 1 active actors on pipe
2025-10-02T09:30:40.665796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.665797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.665798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.665806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.665814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.665820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.665823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.665825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.665826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.665828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.665841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.665843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.665830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 830
2025-10-02T09:30:40.665853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.665842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 830
2025-10-02T09:30:40.665860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.665862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.665880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.665889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.665891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.665892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.665897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.665902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.665911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.666000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.666005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.666013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.666072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 831 partition: 0 MaxSeqNo: 36 sessionId: src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0
2025-10-02T09:30:40.666411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf2d09f-5d81b713-a3506f96-a0f1d4a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.669800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Write session: try to update token
2025-10-02T09:30:40.669817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.675008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.675022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.675024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.675025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.675030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.675033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.675036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485925792:6335]
2025-10-02T09:30:40.675056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.675061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.675062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.675063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.675064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.675068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.675163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.689166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId: src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:40.691507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:40.745011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554466561450549:7261]
2025-10-02T09:30:40.745253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 830, pipe: [1:7556554466561450549:7261]
2025-10-02T09:30:40.792052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.792242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.792251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.792262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450549:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.792437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.792444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554466561450549:7261]
2025-10-02T09:30:40.792466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:40.792468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:40.792514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 831 reason: error at write: Disconnected sessionId: src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0
2025-10-02T09:30:40.792680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 831 sessionId: src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0 is DEAD
2025-10-02T09:30:40.792775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.792893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:40.792912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Write session will restart in 0.006659s
2025-10-02T09:30:40.792944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Write session: Do CDS request
2025-10-02T09:30:40.792951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.800358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.800407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.800416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 832
2025-10-02T09:30:40.800824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.800865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.800873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.800877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.801221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 832 sessionId:  describe result for acl check
2025-10-02T09:30:40.801252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.801257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.801259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.801263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561450698:7434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.801724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561450698:7434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.802210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.803288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561450698:7434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.803876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.804033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.804044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.804054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.804105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.804139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485925994:6349]
2025-10-02T09:30:40.804571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.804753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.804779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.805089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.805135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.805140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.805141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.805143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.805144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.805145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.805146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.805146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.805147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.805148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.805149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.805150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.805154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.805162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.805165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.805169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.805172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.805176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.805179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.805182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.805185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.805188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.805191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.805194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.805200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.805206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.805211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.805217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.805221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.805225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.805228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.805231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.805233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.805235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.805237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.805240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.805242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.805245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.805247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.805250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.805252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.805255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.805257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.805259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.805262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.805265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.805267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.805269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.805289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.805541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561450698:7434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.805552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561450698:7434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.805554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561450698:7434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.805559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.813336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.814928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.814947Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.814949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.814952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.814957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 831 [2:7556554466485925994:6349]
2025-10-02T09:30:40.814982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.814996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.814999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.815002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.815004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.815018Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.815027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.815033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.815083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.815090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.815092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.815094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.815096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.815246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.815254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.815266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.815278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.815265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 831
2025-10-02T09:30:40.815278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 831
2025-10-02T09:30:40.815294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.815316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450580:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.815324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450737:7434], now have 1 active actors on pipe
2025-10-02T09:30:40.815329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.815333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.815335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.815348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.815367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.815373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.815375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.815379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.815381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.815386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.815397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.815400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.815427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93dab287-379c725c-32659516-7518d1c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.815434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.815436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.815438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.815444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.815453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.815459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.815464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.815473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.815484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.815614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.815622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.815634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.815700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 832 partition: 0 MaxSeqNo: 36 sessionId: src_id|93dab287-379c725c-32659516-7518d1c8_0
2025-10-02T09:30:40.816047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1182ec84-65b70b40-8e4df97e-9cb3ec5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93dab287-379c725c-32659516-7518d1c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.819063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Write session: try to update token
2025-10-02T09:30:40.819085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.824979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.824994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.824996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.824997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.825002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.825004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.825006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485925988:6349]
2025-10-02T09:30:40.825028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.825033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.825036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.825038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.825041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.825044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.825157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.834432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId: src_id|93dab287-379c725c-32659516-7518d1c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:40.836772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:40.892472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554466561450748:7261]
2025-10-02T09:30:40.892720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 831, pipe: [1:7556554466561450748:7261]
2025-10-02T09:30:40.950680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:40.951035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.951055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.951075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450748:7261], now have 1 active actors on pipe
2025-10-02T09:30:40.951240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:40.951276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:40.951279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:40.951291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554466561450748:7261]
2025-10-02T09:30:40.951328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 832 reason: error at write: Disconnected sessionId: src_id|93dab287-379c725c-32659516-7518d1c8_0
2025-10-02T09:30:40.951490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 832 sessionId: src_id|93dab287-379c725c-32659516-7518d1c8_0 is DEAD
2025-10-02T09:30:40.951626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:40.951637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Write session will restart in 0.009911s
2025-10-02T09:30:40.951653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Write session: Do CDS request
2025-10-02T09:30:40.951658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:40.951945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:40.962264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.962377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:40.962390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 833
2025-10-02T09:30:40.962527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:40.962556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:40.962560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:40.962563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:40.962890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 833 sessionId:  describe result for acl check
2025-10-02T09:30:40.962918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:40.962923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:40.962925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:40.962929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554466561450873:7438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:40.963367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554466561450873:7438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:40.963445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:40.963855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:40.964002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:40.964012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:40.964022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:40.964068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:40.964102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554466485926157:6352]
2025-10-02T09:30:40.964625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:40.964868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:40.964918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:40.965206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:40.965277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.965282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.965284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.965285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.965286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.965287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.965288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.965289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.965290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.965291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.965293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.965294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.965298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.965307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.965310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.965316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554466561450873:7438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:40.965314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.965318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.965321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.965325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.965328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.965332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.965336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.965339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.965342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.965349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.965355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:40.965360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.965365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:40.965369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.965373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:40.965376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.965380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:40.965385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.965389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:40.965392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.965397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:40.965402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.965406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:40.965410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.965414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:40.965418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.965423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:40.965426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.965431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.965443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.965450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.965456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.965461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.965499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:40.969804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554466561450873:7438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:40.969815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554466561450873:7438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:40.969818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554466561450873:7438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:40.969826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:40.973910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:40.975816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:40.975836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:40.975839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:40.975843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:40.975848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 832 [2:7556554466485926157:6352]
2025-10-02T09:30:40.975864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:40.975883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:40.975886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.975891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.975893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.975906Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:40.975916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:40.975923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:40.975979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.975987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.975989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.975992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:40.975994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:40.976050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:40.976058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.976070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:40.976085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:40.976105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:40.976126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450752:2446], now have 1 active actors on pipe
2025-10-02T09:30:40.976134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554466561450910:7438], now have 1 active actors on pipe
2025-10-02T09:30:40.976139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.976141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.976143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.976153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:40.976170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:40.976172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:40.976175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:40.976177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:40.976161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 832
2025-10-02T09:30:40.976163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 832
2025-10-02T09:30:40.976183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:40.976186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:40.976223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.976229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.976242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.976253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:40.976262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:40.976278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:40.976287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:40.976290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:40.976293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:40.976301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:40.976307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:40.976327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.976447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:40.976454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:40.976466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:40.976531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 833 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0
2025-10-02T09:30:40.976882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab287-379c725c-32659516-7518d1c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:40.979883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Write session: try to update token
2025-10-02T09:30:40.979900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:40.986550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:40.986566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:40.986567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:40.986569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:40.986574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.986577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.986580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554466485926152:6352]
2025-10-02T09:30:40.986607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:40.986612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:40.986614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:40.986618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:40.986621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:40.986624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:40.986800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:40.998528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId: src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.000850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.051700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856418214:7261]
2025-10-02T09:30:41.051960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 832, pipe: [1:7556554470856418214:7261]
2025-10-02T09:30:41.114077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:41.114415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.114429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.114447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418214:7261], now have 1 active actors on pipe
2025-10-02T09:30:41.114675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:41.114685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856418214:7261]
2025-10-02T09:30:41.114692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:41.114714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:41.114716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:41.114764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 833 reason: error at write: Disconnected sessionId: src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0
2025-10-02T09:30:41.114951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 833 sessionId: src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0 is DEAD
2025-10-02T09:30:41.115074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:41.115082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Write session will restart in 0.008237s
2025-10-02T09:30:41.115108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Write session: Do CDS request
2025-10-02T09:30:41.115113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:41.124313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.124439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:41.124453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 834
2025-10-02T09:30:41.124589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.124616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:41.124624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:41.124627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:41.125125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:41.125159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 834 sessionId:  describe result for acl check
2025-10-02T09:30:41.125186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:41.125190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:41.125192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:41.125196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554470856418338:7442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:41.125623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554470856418338:7442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:41.126663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:41.126768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:41.126774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:41.126779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:41.126806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:41.126830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554470780893615:6354]
2025-10-02T09:30:41.127233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:41.127419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554470856418338:7442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:41.127444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:41.127479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:41.127746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:41.127796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.127801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.127802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.127803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.127804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.127806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.127807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.127808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.127809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.127810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.127811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.127811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.127816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.127826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.127829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.127833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.127836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.127839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.127843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.127846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.127850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.127854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.127857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.127861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.127866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.127873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.127879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.127888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.127896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.127904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.127912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.127921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.127930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.127938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.127946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.127955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.127963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.127968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.127972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.127979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.127985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.127989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.127997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.128001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.128005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.128013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.128021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.128029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.128065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:41.132483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554470856418338:7442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:41.132495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554470856418338:7442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:41.132498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554470856418338:7442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:41.132503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:41.136299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:41.138082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:41.138097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:41.138098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:41.138100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:41.138104Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 833 [2:7556554470780893615:6354]
2025-10-02T09:30:41.138113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:41.138124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:41.138126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.138128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.138129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.138141Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:41.138146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:41.138152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:41.138199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.138207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.138209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.138212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:41.138214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:41.138265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:41.138270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.138280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.138292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.138311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:41.138332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418378:7442], now have 1 active actors on pipe
2025-10-02T09:30:41.138339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418215:2446], now have 1 active actors on pipe
2025-10-02T09:30:41.138344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.138346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.138348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.138359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:41.138371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 833
2025-10-02T09:30:41.138374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:41.138381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 833
2025-10-02T09:30:41.138374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:41.138377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:41.138379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:41.138396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:41.138399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:41.138430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.138437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:41.138443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:41.138452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.138456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.138495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:41.138509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.138513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.138515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:41.138522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.138530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:41.138549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.138668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.138675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.138687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.138777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 834 partition: 0 MaxSeqNo: 36 sessionId: src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0
2025-10-02T09:30:41.139065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6eb5ca-58719cfd-e2438705-1efd4239_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:41.141641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Write session: try to update token
2025-10-02T09:30:41.141656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:41.150345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:41.150360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.150362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:41.150363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:41.150368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.150371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.150374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554470780893609:6354]
2025-10-02T09:30:41.150400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:41.150404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.150405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:41.150412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:41.150417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:41.150421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:41.150553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:41.155476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId: src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.157801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.215020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856418388:7261]
2025-10-02T09:30:41.215276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 833, pipe: [1:7556554470856418388:7261]
2025-10-02T09:30:41.272654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:41.272901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.272911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.272924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418388:7261], now have 1 active actors on pipe
2025-10-02T09:30:41.273087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:41.273159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856418388:7261]
2025-10-02T09:30:41.273185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:41.273240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:41.273343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0
2025-10-02T09:30:41.273627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:41.273634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Write session will restart in 0.006806s
2025-10-02T09:30:41.273648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Write session: Do CDS request
2025-10-02T09:30:41.273652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:41.273509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 834 sessionId: src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0 is DEAD
2025-10-02T09:30:41.281138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.281252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:41.281263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 835
2025-10-02T09:30:41.281415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.281454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:41.281464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:41.281468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:41.281583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:41.281838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 835 sessionId:  describe result for acl check
2025-10-02T09:30:41.281879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:41.281886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:41.281887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:41.281892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554470856418513:7447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:41.282343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554470856418513:7447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:41.282937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:41.283046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:41.283053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:41.283059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:41.283086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:41.283110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554470780893779:6357]
2025-10-02T09:30:41.283456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:41.283624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:41.283648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:41.283828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:41.283857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.283861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.283861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.283862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.283862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.283863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.283864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.283864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.283865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.283865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.283866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.283867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.283869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.283876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.283878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.283880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.283882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.283884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.283886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.283888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.283890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.283892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.283894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.283896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.283899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.283904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.283907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.283910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.283912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.283914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.283916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.283919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.283921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.283924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.283926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.283931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.283933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.283939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.283942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.283945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.283947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.283950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.283955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.283957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.283959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.283962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.283964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.283967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.283987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:41.284181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554470856418513:7447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:41.288992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554470856418513:7447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:41.289008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554470856418513:7447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:41.289012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554470856418513:7447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:41.289020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:41.291523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:41.292948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:41.292960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:41.292961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:41.292964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:41.292968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 834 [2:7556554470780893779:6357]
2025-10-02T09:30:41.293064Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:41.293077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:41.293082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.293084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.293084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.293093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:41.293099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:41.293103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:41.293137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.293141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.293142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.293144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:41.293146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:41.293181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:41.293186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.293192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.293200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.293212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:41.293227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418389:2446], now have 1 active actors on pipe
2025-10-02T09:30:41.293232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418552:7447], now have 1 active actors on pipe
2025-10-02T09:30:41.293236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.293240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.293241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.293249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:41.293259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:41.293259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:41.293261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:41.293263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:41.293269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:41.293271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:41.293285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.293292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:41.293300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:41.293278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 834
2025-10-02T09:30:41.293319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.293326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.293296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 834
2025-10-02T09:30:41.293347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:41.293356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.293362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.293363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:41.293368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.293377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:41.293389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.293512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.293518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.293525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.293588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 835 partition: 0 MaxSeqNo: 36 sessionId: src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0
2025-10-02T09:30:41.293848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0261d-aedf823a-4207bca4-6ec0b896_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:41.296057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Write session: try to update token
2025-10-02T09:30:41.296066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:41.303339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:41.303357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.303359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:41.303361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:41.303368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.303373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.303376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554470780893774:6357]
2025-10-02T09:30:41.303402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:41.303405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:41.303407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:41.303407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:41.303412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.303414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:41.303618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:41.309314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId: src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.311897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.373254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856418561:7261]
2025-10-02T09:30:41.373497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 834, pipe: [1:7556554470856418561:7261]
2025-10-02T09:30:41.418118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:41.418330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.418341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.418354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418561:7261], now have 1 active actors on pipe
2025-10-02T09:30:41.418483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:41.418575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:41.418641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856418561:7261]
2025-10-02T09:30:41.418667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:41.418771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 835 reason: status is not ok: tablet will be restarted right now sessionId: src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0
2025-10-02T09:30:41.418927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 835 sessionId: src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0 is DEAD
2025-10-02T09:30:41.419077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:41.419084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Write session will restart in 0.006370s
2025-10-02T09:30:41.419101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Write session: Do CDS request
2025-10-02T09:30:41.419105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:41.426211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.426337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:41.426349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 836
2025-10-02T09:30:41.426449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.426470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:41.426477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:41.426479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:41.426800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 836 sessionId:  describe result for acl check
2025-10-02T09:30:41.426827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:41.426831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:41.426832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:41.426835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554470856418684:7451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:41.427215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554470856418684:7451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:41.427800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:41.428392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554470856418684:7451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:41.429394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:41.429514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:41.429520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:41.429527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:41.429554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:41.429585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554470780893943:6359]
2025-10-02T09:30:41.429918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554470856418684:7451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:41.429926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554470856418684:7451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:41.429928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554470856418684:7451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:41.429931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:41.429954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:41.430145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:41.430170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:41.430351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:41.430381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.430385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.430385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.430386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.430386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.430387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.430387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.430388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.430388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.430389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.430390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.430390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.430393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.430399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.430401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.430403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.430405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.430407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.430409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.430410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.430412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.430414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.430416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.430418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.430421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.430425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.430428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.430431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.430434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.430436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.430438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.430441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.430443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.430446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.430448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.430451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.430453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.430456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.430459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.430462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.430464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.430468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.430470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.430473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.430475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.430477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.430479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.430482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.430502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:41.438369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:41.439939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:41.439951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:41.439952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:41.439955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:41.439958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 835 [2:7556554470780893943:6359]
2025-10-02T09:30:41.439967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:41.439976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:41.439977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.439979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.439981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.439989Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:41.439996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:41.440000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:41.440030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.440035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.440036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.440038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:41.440040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:41.440076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:41.440081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.440088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.440093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.440101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:41.440113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.440118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.440119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.440124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:41.440131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:41.440134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:41.440137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:41.440139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:41.440139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:41.440141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:41.440147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418562:2446], now have 1 active actors on pipe
2025-10-02T09:30:41.440151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418721:7451], now have 1 active actors on pipe
2025-10-02T09:30:41.440162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.440170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:41.440192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:41.440188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 835
2025-10-02T09:30:41.440192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 835
2025-10-02T09:30:41.440268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.440274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.440291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:41.440299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.440301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.440304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:41.440309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.440314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:41.440325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.440445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.440449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.440456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.440514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 836 partition: 0 MaxSeqNo: 36 sessionId: src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0
2025-10-02T09:30:41.440748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231be630-10fb759b-c1ba4b3f-94927e4d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:41.443004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Write session: try to update token
2025-10-02T09:30:41.443018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:41.450077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:41.450094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.450096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:41.450097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:41.450103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.450106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.450109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554470780893938:6359]
2025-10-02T09:30:41.450133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:41.450136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.450138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:41.450148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:41.450162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:41.450165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:41.450266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:41.453839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId: src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.455776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.518615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856418737:7261]
2025-10-02T09:30:41.518845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 835, pipe: [1:7556554470856418737:7261]
2025-10-02T09:30:41.574204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:41.574468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.574478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.574504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418737:7261], now have 1 active actors on pipe
2025-10-02T09:30:41.574647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:41.574707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:41.574720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:41.574743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856418737:7261]
2025-10-02T09:30:41.574767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 836 reason: error at write: Disconnected sessionId: src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0
2025-10-02T09:30:41.574809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:41.574886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 836 sessionId: src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0 is DEAD
2025-10-02T09:30:41.575020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:41.575030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Write session will restart in 0.007508s
2025-10-02T09:30:41.575049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Write session: Do CDS request
2025-10-02T09:30:41.575055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:41.583245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.583357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:41.583370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 837
2025-10-02T09:30:41.583491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.583518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:41.583522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:41.583528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:41.583921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 837 sessionId:  describe result for acl check
2025-10-02T09:30:41.583946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:41.583952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:41.583953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:41.583958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554470856418861:7457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:41.584377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554470856418861:7457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:41.585067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:41.585634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554470856418861:7457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:41.586551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:41.586660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:41.586668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:41.586674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:41.586702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:41.586721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554470780894121:6361]
2025-10-02T09:30:41.587093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:41.587282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:41.587320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:41.587558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:41.587599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.587604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.587605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.587605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.587606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.587606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.587607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.587607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.587608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.587608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.587609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.587609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.587612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.587618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.587620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.587622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.587624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.587659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554470856418861:7457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:41.587626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.587670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554470856418861:7457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:41.587628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.587630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.587673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554470856418861:7457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:41.587632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.587679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:41.587635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.587637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.587639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.587643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.587647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.587650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.587653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.587655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.587658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.587660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.587663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.587665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.587668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.587670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.587672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.587674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.587677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.587679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.587682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.587684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.587687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.587689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.587692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.587694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.587697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.587699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.587701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.587719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:41.595660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:41.597146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:41.597158Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:41.597159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:41.597161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:41.597164Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 836 [2:7556554470780894121:6361]
2025-10-02T09:30:41.597171Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:41.597180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:41.597182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.597183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.597184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.597193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:41.597196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:41.597200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:41.597229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.597234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.597236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.597238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:41.597239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:41.597360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 836
2025-10-02T09:30:41.597372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 836
2025-10-02T09:30:41.597396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:41.597404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.597414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.597420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.597429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:41.597445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418901:7457], now have 1 active actors on pipe
2025-10-02T09:30:41.597451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418738:2446], now have 1 active actors on pipe
2025-10-02T09:30:41.597461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.597464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.597473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.597478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.597479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.597488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:41.597496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:41.597501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:41.597503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:41.597504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:41.597508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:41.597510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:41.597519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:41.597523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.597524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.597526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:41.597530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.597537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:41.597552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.597559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:41.597563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:41.597566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.597674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.597681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.597691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.597738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 837 partition: 0 MaxSeqNo: 36 sessionId: src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0
2025-10-02T09:30:41.598019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d7b3b-7f9c7c97-514f258e-4dd1436c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:41.600728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Write session: try to update token
2025-10-02T09:30:41.600741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:41.611500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:41.611513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.611517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.611544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:41.611553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:41.611684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:41.611810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:41.611926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:41.612049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:41.612224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:41.612253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:41.614731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId: src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.615719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:41.615731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.615733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:41.615734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:41.615739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.615743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.615746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554470780894115:6361]
2025-10-02T09:30:41.615766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:41.615767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:41.615771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:41.615771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.615774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:41.615774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:41.615946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:41.616975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.674789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856418922:7261]
2025-10-02T09:30:41.675039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 836, pipe: [1:7556554470856418922:7261]
2025-10-02T09:30:41.735340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:41.735563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.735589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.735604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418922:7261], now have 1 active actors on pipe
2025-10-02T09:30:41.735781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856418922:7261]
2025-10-02T09:30:41.735786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:41.735811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:41.735813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:41.735791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:41.735869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 837 reason: error at write: Disconnected sessionId: src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0
2025-10-02T09:30:41.736031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 837 sessionId: src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0 is DEAD
2025-10-02T09:30:41.736206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:41.736218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Write session will restart in 0.008102s
2025-10-02T09:30:41.736243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Write session: Do CDS request
2025-10-02T09:30:41.736249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:41.745160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:41.745223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.745328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:41.745341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 838
2025-10-02T09:30:41.745454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.745475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:41.745482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:41.745485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:41.745809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 838 sessionId:  describe result for acl check
2025-10-02T09:30:41.745842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:41.745848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:41.745850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:41.745854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554470856419051:7462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:41.746307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554470856419051:7462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:41.746894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:41.747009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:41.747017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:41.747025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:41.747062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:41.747098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554470780894286:6364]
2025-10-02T09:30:41.747597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:41.747806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:41.747840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:41.747923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554470856419051:7462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:41.748074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:41.748114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.748119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.748119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.748120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.748121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.748121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.748122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.748122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.748123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.748123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.748124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.748124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.748128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.748133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.748136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.748138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.748140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.748142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.748144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.748146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.748148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.748150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.748154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.748157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.748162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.748167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.748171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.748176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.748179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.748186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.748190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.748198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.748203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.748211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.748213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.748216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.748218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.748221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.748223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.748226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.748230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.748233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.748235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.748238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.748240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.748243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.748246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.748249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.748273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:41.753393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554470856419051:7462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:41.753403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554470856419051:7462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:41.753405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554470856419051:7462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:41.753409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:41.756187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:41.757849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:41.757860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:41.757862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:41.757864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:41.757867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 837 [2:7556554470780894286:6364]
2025-10-02T09:30:41.757875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:41.757885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:41.757891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.757892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.757893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.757902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:41.757905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:41.757910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:41.757941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.757946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.757947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.757948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:41.757950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:41.757987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:41.757991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.757997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.758002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.758012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:41.758024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.758028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.758030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.758038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:41.758045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:41.758051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856419089:7462], now have 1 active actors on pipe
2025-10-02T09:30:41.758054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856418924:2446], now have 1 active actors on pipe
2025-10-02T09:30:41.758055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:41.758057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:41.758060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:41.758071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:41.758077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:41.758069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 837
2025-10-02T09:30:41.758077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 837
2025-10-02T09:30:41.758094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.758101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:41.758102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:41.758117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.758122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.758139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:41.758146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.758149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.758150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:41.758156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.758166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:41.758182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.758310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.758317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.758326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.758404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 838 partition: 0 MaxSeqNo: 36 sessionId: src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0
2025-10-02T09:30:41.758653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957d220e-f2fde9c1-37cceba9-cdaf21b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:41.761236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Write session: try to update token
2025-10-02T09:30:41.761250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:41.768145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:41.768162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.768164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:41.768166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:41.768172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.768176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.768178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554470780894281:6364]
2025-10-02T09:30:41.768208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:41.768218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.768218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:41.768223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:41.768223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:41.768226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:41.768346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:41.773988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId: src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.776022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.836059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856419124:7261]
2025-10-02T09:30:41.836222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 837, pipe: [1:7556554470856419124:7261]
2025-10-02T09:30:41.887840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:41.888147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.888165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.888180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856419124:7261], now have 1 active actors on pipe
2025-10-02T09:30:41.888357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856419124:7261]
2025-10-02T09:30:41.888377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:41.888380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:41.888380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:41.888447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 838 reason: error at write: Disconnected sessionId: src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0
2025-10-02T09:30:41.888636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 838 sessionId: src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0 is DEAD
2025-10-02T09:30:41.888724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:41.888783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:41.888792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Write session will restart in 0.009408s
2025-10-02T09:30:41.888820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Write session: Do CDS request
2025-10-02T09:30:41.888825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:41.896974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:41.898367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:41.898476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:41.898484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:41.898491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:41.898520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:41.898545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554470780894491:6379]
2025-10-02T09:30:41.898907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:41.899087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:41.899112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:41.899206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.899289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:41.899300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 839
2025-10-02T09:30:41.899304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:41.899351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.899355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.899355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.899356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.899357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.899357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.899358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.899359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.899359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.899359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.899360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.899361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.899363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.899370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.899372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.899374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.899376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.899378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.899380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.899382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.899384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.899387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.899388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.899390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.899395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.899420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:41.899399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:41.899439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:41.899442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:41.899403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.899445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:41.899406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:41.899409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.899414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:41.899417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.899422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:41.899425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.899429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:41.899432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.899435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:41.899439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.899443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:41.899447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.899451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:41.899454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.899456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:41.899460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.899462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.899464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.899467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.899469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.899471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.899487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:41.899784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 839 sessionId:  describe result for acl check
2025-10-02T09:30:41.899815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:41.899820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:41.899822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:41.899826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554470856419261:7474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:41.900285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554470856419261:7474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:41.901919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554470856419261:7474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:41.906136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554470856419261:7474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:41.906146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554470856419261:7474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:41.906148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554470856419261:7474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:41.906152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:41.907422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:41.909134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:41.909148Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:41.909150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:41.909153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:41.909158Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 838 [2:7556554470780894491:6379]
2025-10-02T09:30:41.909169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:41.909184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:41.909187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.909190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.909192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.909202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:41.909205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:41.909209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:41.909243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.909249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.909250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.909252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:41.909254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:41.909292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:41.909297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.909304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:41.909309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:41.909317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:41.909330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856419295:7474], now have 1 active actors on pipe
2025-10-02T09:30:41.909335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856419129:2446], now have 1 active actors on pipe
2025-10-02T09:30:41.909339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.909341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.909342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.909350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:41.909359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:41.909361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:41.909364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:41.909365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:41.909370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:41.909371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:41.909368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 838
2025-10-02T09:30:41.909386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.909390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 838
2025-10-02T09:30:41.909390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:41.909391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:41.909400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.909404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.909437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:41.909445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:41.909447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:41.909448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:41.909453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:41.909459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:41.909469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.909558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:41.909564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:41.909573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:41.909613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 839 partition: 0 MaxSeqNo: 36 sessionId: src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0
2025-10-02T09:30:41.909866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25a3bed-f1d4b48d-396900ef-ce278428_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:41.912016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Write session: try to update token
2025-10-02T09:30:41.912028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:41.919563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:41.919581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:41.919583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:41.919584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:41.919590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.919594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.919596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554470780894486:6379]
2025-10-02T09:30:41.919620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:41.919621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:41.919624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:41.919625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:41.919626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:41.919627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:41.919750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:41.922857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId: src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:41.924891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:41.988646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554470856419303:7261]
2025-10-02T09:30:41.988903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 838, pipe: [1:7556554470856419303:7261]
2025-10-02T09:30:42.037478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.037694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.037710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.037739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554470856419303:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.037919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:42.037931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:42.037942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554470856419303:7261]
2025-10-02T09:30:42.037960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.037977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 839 reason: error at write: Disconnected sessionId: src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0
2025-10-02T09:30:42.038109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 839 sessionId: src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0 is DEAD
2025-10-02T09:30:42.038262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:42.038270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Write session will restart in 0.005356s
2025-10-02T09:30:42.038283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Write session: Do CDS request
2025-10-02T09:30:42.038290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.038294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.044193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.044274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.044285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 840
2025-10-02T09:30:42.044387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.044407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.044413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.044416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.044754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 840 sessionId:  describe result for acl check
2025-10-02T09:30:42.044779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.044784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.044785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.044788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151386687:7478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.045142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151386687:7478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.046284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.046612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151386687:7478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.048024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.048177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.048186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.048194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.048238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.048272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075861954:6381]
2025-10-02T09:30:42.048548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151386687:7478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.048560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151386687:7478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.048563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151386687:7478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.048569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.048692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.048927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.048953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.049134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.049162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.049166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.049167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.049168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.049168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.049169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.049170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.049170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.049171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.049171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.049172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.049172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.049175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.049182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.049184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.049186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.049188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.049190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.049192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.049194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.049196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.049198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.049200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.049202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.049206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.049210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.049213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.049216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.049218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.049220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.049223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.049225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.049227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.049230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.049232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.049234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.049237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.049239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.049242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.049244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.049247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.049249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.049255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.049258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.049261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.049267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.049270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.049272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.049292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.057083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.058619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.058634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.058636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.058638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.058642Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 839 [2:7556554475075861954:6381]
2025-10-02T09:30:42.058649Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.058661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.058662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.058664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.058665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.058675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.058678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.058683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.058716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.058722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.058723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.058726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.058727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.058767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.058774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.058781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.058786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.058794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.058805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.058806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.058807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.058812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.058823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.058825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386764:7478], now have 1 active actors on pipe
2025-10-02T09:30:42.058826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.058828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.058829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386601:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.058833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.058843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.058846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.058867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.058878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.058891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.058905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 839
2025-10-02T09:30:42.058930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 839
2025-10-02T09:30:42.058941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.058949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.058977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e89a826c-2642a44e-2ac51098-434c3fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.058987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.058994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.058997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.059006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.059017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.059031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.059190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.059197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.059207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.059320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 840 partition: 0 MaxSeqNo: 36 sessionId: src_id|e89a826c-2642a44e-2ac51098-434c3fc_0
2025-10-02T09:30:42.059568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124bb03d-73bc5c74-8a3d1855-da14feb0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e89a826c-2642a44e-2ac51098-434c3fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.061778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Write session: try to update token
2025-10-02T09:30:42.061790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.068963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.068991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.068994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.068996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.069004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.069008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.069012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075861949:6381]
2025-10-02T09:30:42.069044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.069048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.069052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.069054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.069059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.069062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.069229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:42.073343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId: src_id|e89a826c-2642a44e-2ac51098-434c3fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:42.075599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:42.138159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554475151386776:7261]
2025-10-02T09:30:42.138428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 839, pipe: [1:7556554475151386776:7261]
2025-10-02T09:30:42.197530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.197761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.197769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.197798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386776:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.197972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.198062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554475151386776:7261]
2025-10-02T09:30:42.198094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:42.198096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.198148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 840 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e89a826c-2642a44e-2ac51098-434c3fc_0
2025-10-02T09:30:42.198301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 840 sessionId: src_id|e89a826c-2642a44e-2ac51098-434c3fc_0 is DEAD
2025-10-02T09:30:42.198455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:42.198464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Write session will restart in 0.006358s
2025-10-02T09:30:42.198481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Write session: Do CDS request
2025-10-02T09:30:42.198494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.206184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.206291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.206303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 841
2025-10-02T09:30:42.206411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.206439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.206451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.206454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.206823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 841 sessionId:  describe result for acl check
2025-10-02T09:30:42.206851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.206857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.206860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.206865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151386810:7483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.207338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151386810:7483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.209365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151386810:7483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.210885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.212493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.212610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.212618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151386810:7483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.212628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151386810:7483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.212630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151386810:7483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.212617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.212634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.212623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.212661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.212686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075862126:6384]
2025-10-02T09:30:42.213210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.213420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.213447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.213699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.213774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.213780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.213781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.213782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.213783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.213784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.213785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.213786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.213787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.213788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.213789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.213790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.213794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.213804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.213808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.213811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.213814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.213818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.213821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.213824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.213827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.213831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.213834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.213838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.213844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.213851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.213856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.213861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.213865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.213869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.213873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.213878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.213881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.213884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.213886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.213889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.213891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.213894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.213896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.213899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.213901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.213904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.213906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.213909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.213911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.213914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.213916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.213919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.213937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.221691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.223147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.223162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.223163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.223165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.223170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 840 [2:7556554475075862126:6384]
2025-10-02T09:30:42.223179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.223191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.223193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.223195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.223196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.223206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.223209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.223214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.223246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.223251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.223253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.223255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.223256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.223304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.223311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.223318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.223323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.223331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.223344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386780:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.223352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.223353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.223354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.223359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.223364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386952:7483], now have 1 active actors on pipe
2025-10-02T09:30:42.223369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.223369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.223373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.223374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.223376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.223378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.223393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.223399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.223400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.223413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 840
2025-10-02T09:30:42.223417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 840
2025-10-02T09:30:42.223575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.223583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.223603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.223614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.223617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.223620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.223628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.223635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.223646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.223785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.223791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.223802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.223855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 841 partition: 0 MaxSeqNo: 36 sessionId: src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0
2025-10-02T09:30:42.224120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89a826c-2642a44e-2ac51098-434c3fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.226429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Write session: try to update token
2025-10-02T09:30:42.226440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.233290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:42.233308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.233316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.233350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:42.233349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:42.233500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:42.233720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:42.233945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:42.234105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:42.234294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:42.234327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:42.237946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId: src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:42.240075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:42.240383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.240392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.240411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:42.240482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:42.241282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.241296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.241297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.241298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.241303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.241306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.241309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075862121:6384]
2025-10-02T09:30:42.241330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.241337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.241338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.241339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.241342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.241344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.241448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:42.298406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554475151386963:7261]
2025-10-02T09:30:42.298674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 840, pipe: [1:7556554475151386963:7261]
2025-10-02T09:30:42.359645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.365847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.365869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.366000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.366051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.366116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.366173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.366261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.366267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.366325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.366378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.366435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.366490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.366528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.366533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.366590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.366650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.366708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.366761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.366986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.366993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.367047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.367136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.367217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.367282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.367319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.367324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.367381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.367434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.367489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.367545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.367582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.367587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.367666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.367721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.367774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.367827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.367864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.367870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.367924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.367976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.368032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.368084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.368179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.368184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.368237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.368289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.368341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.368392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.368439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.368444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.368497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.368548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.368600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.368657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.368698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.368704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.368755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:42.368817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:42.368872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:42.368924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:42.368973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:42.368978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:42.369010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386963:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.369239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554475151386963:7261]
2025-10-02T09:30:42.369242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.369268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:42.369270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:42.369289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 841 reason: error at write: Disconnected sessionId: src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0
2025-10-02T09:30:42.369419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 841 sessionId: src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0 is DEAD
2025-10-02T09:30:42.369523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.369574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:42.369584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Write session will restart in 0.008115s
2025-10-02T09:30:42.369598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Write session: Do CDS request
2025-10-02T09:30:42.369602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.378479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.379152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.379222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.379233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 842
2025-10-02T09:30:42.379320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.379345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.379354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.379357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.379639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 842 sessionId:  describe result for acl check
2025-10-02T09:30:42.379660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.379667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.379668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.379671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151387097:7487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.380028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151387097:7487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.380085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.380180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.380187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.380192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.380218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.380240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075862295:6386]
2025-10-02T09:30:42.380605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.380764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.380793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.381022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.381058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.381062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.381062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.381063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.381064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.381064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.381065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.381065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.381066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.381066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.381067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.381067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.381071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.381076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.381078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.381080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.381082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.381085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.381087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.381088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.381090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.381092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.381094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.381096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.381100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.381104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.381107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.381110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.381112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.381115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.381117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.381119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.381122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.381125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.381127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.381130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.381132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.381134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.381136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.381139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.381141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.381143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.381145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.381149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.381152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.381154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.381160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.381163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.381179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.381654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151387097:7487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.386992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151387097:7487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.387002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151387097:7487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.387004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151387097:7487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.387009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.388616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.390088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.390101Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.390103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.390105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.390108Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 841 [2:7556554475075862295:6386]
2025-10-02T09:30:42.390115Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.390125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.390130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.390131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.390132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.390144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.390148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.390154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.390193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.390198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.390199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.390202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.390203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.390239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.390244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.390251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.390260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.390271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.390286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151386965:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.390291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387136:7487], now have 1 active actors on pipe
2025-10-02T09:30:42.390296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.390297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.390299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.390306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.390317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.390323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.390326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.390312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 841
2025-10-02T09:30:42.390327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.390328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.390329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.390312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 841
2025-10-02T09:30:42.390352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.390357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.390365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.390372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.390378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.390388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84ce74c6-14181f68-c77ea17a-b948154c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.390392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.390394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.390395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.390400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.390409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.390423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.390527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.390533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.390544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.390597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 842 partition: 0 MaxSeqNo: 36 sessionId: src_id|84ce74c6-14181f68-c77ea17a-b948154c_0
2025-10-02T09:30:42.390822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1075af94-5a6d1cc8-3fd955f5-5f3c17f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84ce74c6-14181f68-c77ea17a-b948154c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.393030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Write session: try to update token
2025-10-02T09:30:42.393040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.399854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.399872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.399874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.399876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.399883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.399886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.399889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075862290:6386]
2025-10-02T09:30:42.399914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.399918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.399920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.399920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.399924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.399926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.400045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:42.403528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId: src_id|84ce74c6-14181f68-c77ea17a-b948154c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:42.405554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:42.469410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554475151387143:7261]
2025-10-02T09:30:42.469660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 841, pipe: [1:7556554475151387143:7261]
2025-10-02T09:30:42.517372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.517757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.517767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.517793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387143:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.517932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.517962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.517991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554475151387143:7261]
2025-10-02T09:30:42.518004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:42.518066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 842 reason: status is not ok: tablet will be restarted right now sessionId: src_id|84ce74c6-14181f68-c77ea17a-b948154c_0
2025-10-02T09:30:42.518201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 842 sessionId: src_id|84ce74c6-14181f68-c77ea17a-b948154c_0 is DEAD
2025-10-02T09:30:42.518322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:42.518331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Write session will restart in 0.009283s
2025-10-02T09:30:42.518348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Write session: Do CDS request
2025-10-02T09:30:42.518353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.527553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.528183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.528311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.528322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 843
2025-10-02T09:30:42.528417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.528443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.528451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.528454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.528792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 843 sessionId:  describe result for acl check
2025-10-02T09:30:42.528832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.528837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.528838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.528843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151387277:7491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.528997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.529112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.529119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.529125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.529152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.529176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075862466:6388]
2025-10-02T09:30:42.529224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151387277:7491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.529584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.529778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.529816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.530035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.530079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.530084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.530085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.530085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.530086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.530087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.530087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.530088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.530088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.530089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.530089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.530090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.530093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.530098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.530100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.530102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.530104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.530106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.530108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.530110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.530112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.530114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.530116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.530118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.530122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.530125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.530129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.530132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.530134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.530137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.530139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.530142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.530146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.530148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.530150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.530153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.530155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.530158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.530160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.530163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.530165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.530167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.530170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.530172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.530174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.530177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.530179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.530181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.530198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.530743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151387277:7491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.535930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151387277:7491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.535939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151387277:7491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.535942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151387277:7491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.535950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.537640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.539097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.539111Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.539113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.539115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.539119Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 842 [2:7556554475075862466:6388]
2025-10-02T09:30:42.539127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.539136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.539138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.539139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.539140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.539150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.539154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.539158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.539191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.539196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.539198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.539200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.539202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.539282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.539290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.539301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.539316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.539337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.539358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387145:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.539364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387316:7491], now have 1 active actors on pipe
2025-10-02T09:30:42.539369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.539371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.539374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.539367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 842
2025-10-02T09:30:42.539388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.539374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 842
2025-10-02T09:30:42.539400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.539401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.539402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.539404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.539414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.539416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.539438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.539444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.539452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.539460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.539470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.539477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.539480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.539482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.539484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.539489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.539498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.539517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.539672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.539681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.539692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.539758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 843 partition: 0 MaxSeqNo: 36 sessionId: src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0
2025-10-02T09:30:42.539995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce74c6-14181f68-c77ea17a-b948154c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.542190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Write session: try to update token
2025-10-02T09:30:42.542202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.549060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.549082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.549085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.549087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.549094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.549098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.549101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075862461:6388]
2025-10-02T09:30:42.549128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.549132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.549133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.549133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.549136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.549138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.549254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:42.553252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId: src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:42.555374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:42.617903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554475151387323:7261]
2025-10-02T09:30:42.618103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 842, pipe: [1:7556554475151387323:7261]
2025-10-02T09:30:42.668557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.668961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.668974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.669009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387323:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.669149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.669198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.669222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554475151387323:7261]
2025-10-02T09:30:42.669328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:42.669390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0
2025-10-02T09:30:42.669526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 843 sessionId: src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0 is DEAD
2025-10-02T09:30:42.669649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:42.669659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Write session will restart in 0.006930s
2025-10-02T09:30:42.669674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Write session: Do CDS request
2025-10-02T09:30:42.669678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.677055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.677155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.677166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 844
2025-10-02T09:30:42.677254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.677279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.677286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.677290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.677634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 844 sessionId:  describe result for acl check
2025-10-02T09:30:42.677666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.677672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.677673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.677677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151387466:7496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.678133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151387466:7496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.678371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.679791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151387466:7496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.679987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.680097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.680104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.680109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.680137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.680158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075862650:6391]
2025-10-02T09:30:42.680514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.680712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.680737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.680925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.680958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.680963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.680963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.680964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.680964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.680965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.680965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.680966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.680966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.680967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.680967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.680968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.680970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.680977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.680979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.680981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.680983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.680985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.680987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.680989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.680991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.680993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.680995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.680997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.681000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.681005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.681008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.681011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.681013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.681015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.681017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.681020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.681022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.681025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.681027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.681030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.681032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.681034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.681036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.681039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.681041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.681044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.681046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.681050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.681052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.681055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.681060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.681062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.681080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.685020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151387466:7496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.685029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151387466:7496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.685031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151387466:7496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.685035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.688581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.690030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.690045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.690047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.690049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.690052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 843 [2:7556554475075862650:6391]
2025-10-02T09:30:42.690060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.690071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.690072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.690073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.690074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.690083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.690086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.690090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.690123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.690128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.690129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.690131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.690133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.690216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.690222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.690229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.690234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.690243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.690257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387336:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.690264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387508:7496], now have 1 active actors on pipe
2025-10-02T09:30:42.690269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.690271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.690272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.690282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.690294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.690298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.690301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.690303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.690310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.690294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 843
2025-10-02T09:30:42.690315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.690298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 843
2025-10-02T09:30:42.690334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.690344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.690350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.690357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.690362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.690387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|684c0902-2fd1ae0a-b861060c-d768170d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.690395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.690397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.690398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.690404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.690409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.690420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.690530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.690537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.690545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.690591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 844 partition: 0 MaxSeqNo: 36 sessionId: src_id|684c0902-2fd1ae0a-b861060c-d768170d_0
2025-10-02T09:30:42.690836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52800caf-ca9f6305-be6beabf-9f38f5a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|684c0902-2fd1ae0a-b861060c-d768170d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.693034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Write session: try to update token
2025-10-02T09:30:42.693046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.699980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.700002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.700005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.700007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.700016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.700021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.700025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075862645:6391]
2025-10-02T09:30:42.700061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.700070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.700069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.700072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.700073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.700076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.700239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:42.703728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId: src_id|684c0902-2fd1ae0a-b861060c-d768170d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:42.705954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:42.769477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554475151387519:7261]
2025-10-02T09:30:42.769755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 843, pipe: [1:7556554475151387519:7261]
2025-10-02T09:30:42.817157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.817359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.817367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.817394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387519:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.817563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.817601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.817603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:42.817651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554475151387519:7261]
2025-10-02T09:30:42.817657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 844 reason: status is not ok: tablet will be restarted right now sessionId: src_id|684c0902-2fd1ae0a-b861060c-d768170d_0
2025-10-02T09:30:42.817796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 844 sessionId: src_id|684c0902-2fd1ae0a-b861060c-d768170d_0 is DEAD
2025-10-02T09:30:42.817917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:42.817922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Write session will restart in 0.006071s
2025-10-02T09:30:42.817939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Write session: Do CDS request
2025-10-02T09:30:42.817943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.825123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.825241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.825250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 845
2025-10-02T09:30:42.825338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.825356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.825363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.825366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.825658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 845 sessionId:  describe result for acl check
2025-10-02T09:30:42.825677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.825678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.825679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.825682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151387616:7507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.825950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151387616:7507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.827354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151387616:7507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.827452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.829141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.829240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.829246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.829252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.829282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.829303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075862836:6393]
2025-10-02T09:30:42.829359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151387616:7507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.829368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151387616:7507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.829370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151387616:7507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.829373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.829638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.829828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.829867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.830076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.830106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.830110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.830111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.830111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.830112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.830113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.830113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.830114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.830114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.830115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.830115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.830116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.830119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.830125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.830127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.830129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.830131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.830134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.830135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.830138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.830140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.830142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.830144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.830146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.830149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.830153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.830156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.830159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.830163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.830165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.830168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.830170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.830173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.830175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.830177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.830180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.830182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.830185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.830187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.830189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.830191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.830194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.830196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.830199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.830213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.830219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.830221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.830224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.830239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.837745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.839238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.839250Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.839251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.839254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.839257Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 844 [2:7556554475075862836:6393]
2025-10-02T09:30:42.839264Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.839274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.839276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.839277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.839278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.839288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.839294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.839299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.839333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.839338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.839339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.839341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.839342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.839378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.839382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.839389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.839394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.839405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.839419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.839424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.839425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.839429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.839438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.839440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387702:7507], now have 1 active actors on pipe
2025-10-02T09:30:42.839442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387522:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.839447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.839448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.839450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.839455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.839456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.839473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.839484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.839484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 844
2025-10-02T09:30:42.839503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 844
2025-10-02T09:30:42.839499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.839537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.839543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.839559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.839566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.839568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.839570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.839575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.839584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.839593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.839723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.839728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.839736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.839790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 845 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0
2025-10-02T09:30:42.840005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684c0902-2fd1ae0a-b861060c-d768170d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.842225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Write session: try to update token
2025-10-02T09:30:42.842236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.848790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.848819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.848821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.848822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.848827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.848830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.848832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075862831:6393]
2025-10-02T09:30:42.848856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.848858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.848861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.848861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.848863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.848863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.848974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:42.853053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId: src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:42.855277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:42.917931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554475151387728:7261]
2025-10-02T09:30:42.918141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 844, pipe: [1:7556554475151387728:7261]
2025-10-02T09:30:42.967615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:42.967916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.967926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.967952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387728:7261], now have 1 active actors on pipe
2025-10-02T09:30:42.968113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:42.968174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:42.968176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:42.968222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554475151387728:7261]
2025-10-02T09:30:42.968247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 845 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0
2025-10-02T09:30:42.968396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 845 sessionId: src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0 is DEAD
2025-10-02T09:30:42.968527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:42.968535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Write session will restart in 0.009405s
2025-10-02T09:30:42.968554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Write session: Do CDS request
2025-10-02T09:30:42.968560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:42.977860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:42.979247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:42.979255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 846
2025-10-02T09:30:42.979288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.979349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:42.979451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:42.979458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:42.979464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:42.979491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:42.979515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554475075863035:6408]
2025-10-02T09:30:42.979610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:42.979628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:42.979634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:42.979636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:42.979945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:42.980125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:42.980158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:42.980292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 846 sessionId:  describe result for acl check
2025-10-02T09:30:42.980313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:42.980317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:42.980318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:42.980321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554475151387870:7512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:42.980374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:42.980414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.980418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.980419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.980419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.980420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.980421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.980421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.980422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.980422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.980423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.980423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.980424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.980427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.980433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.980435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.980437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.980439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.980441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.980443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.980445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.980447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.980449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.980451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.980453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.980457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.980461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:42.980464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.980467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:42.980469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.980471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:42.980474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.980476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:42.980479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.980481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:42.980483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.980486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:42.980488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.980491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:42.980493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.980495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:42.980498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.980500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:42.980502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.980505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.980507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.980510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.980515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.980518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.980536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:42.980644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554475151387870:7512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:42.982316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554475151387870:7512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:42.987566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554475151387870:7512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:42.987581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554475151387870:7512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:42.987585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554475151387870:7512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:42.987593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:42.988142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:42.989715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:42.989732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:42.989734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:42.989737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:42.989741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 845 [2:7556554475075863035:6408]
2025-10-02T09:30:42.989752Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:42.989765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:42.989768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.989770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.989772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.989785Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:42.989790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:42.989795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:42.989830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.989837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.989839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.989841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:42.989843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:42.989889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:42.989894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.989902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:42.989908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:42.989916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:42.989933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387732:2446], now have 1 active actors on pipe
2025-10-02T09:30:42.989936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554475151387903:7512], now have 1 active actors on pipe
2025-10-02T09:30:42.989940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.989941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.989942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.989951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:42.989960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:42.989964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:42.989966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:42.989967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:42.989976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:42.989979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:42.989988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 845
2025-10-02T09:30:42.989994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 845
2025-10-02T09:30:42.989998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.990006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:42.990007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:42.990024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.990027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.990050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:42.990055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:42.990057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:42.990058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:42.990063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:42.990068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:42.990078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.990183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:42.990188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:42.990195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:42.990275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 846 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0
2025-10-02T09:30:42.990526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff375fe-2e97f92f-2b6f1b2b-300db50f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:42.992912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Write session: try to update token
2025-10-02T09:30:42.992923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:42.999366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:42.999385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:42.999387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:42.999389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:42.999396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.999400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.999403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554475075863030:6408]
2025-10-02T09:30:42.999433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:42.999442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:42.999443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:42.999447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:42.999452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:42.999455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:42.999564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.004810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId: src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.006822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:43.068453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554479446355207:7261]
2025-10-02T09:30:43.068643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 845, pipe: [1:7556554479446355207:7261]
2025-10-02T09:30:43.116090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:43.116496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.116508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.116521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355207:7261], now have 1 active actors on pipe
2025-10-02T09:30:43.116686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:43.116737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:43.116748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:43.116751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:43.116788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554479446355207:7261]
2025-10-02T09:30:43.116818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 846 reason: error at write: Disconnected sessionId: src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0
2025-10-02T09:30:43.116969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 846 sessionId: src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0 is DEAD
2025-10-02T09:30:43.117121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:43.117130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Write session will restart in 0.007135s
2025-10-02T09:30:43.117151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Write session: Do CDS request
2025-10-02T09:30:43.117156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:43.125196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.125268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:43.125279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 847
2025-10-02T09:30:43.125381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.125402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:43.125408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:43.125412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:43.125744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 847 sessionId:  describe result for acl check
2025-10-02T09:30:43.125777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:43.125783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:43.125784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:43.125789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554479446355343:7516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:43.126175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554479446355343:7516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:43.126365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:43.127690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:43.127795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:43.127801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:43.127807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:43.127835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:43.127803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554479446355343:7516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:43.127864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554479370830506:6410]
2025-10-02T09:30:43.128264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:43.128477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:43.128513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:43.128769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:43.128818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.128823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.128824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.128824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.128825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.128825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.128826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.128826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.128827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.128827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.128828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.128828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.128831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.128837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.128839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.128841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.128843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.128845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.128847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.128849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.128851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.128853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.128855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.128857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.128860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.128864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.128867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.128872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.128875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.128880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.128883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.128888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.128892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.128895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.128898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.128901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.128903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.128906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.128913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.128916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.128918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.128921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.128923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.128930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.128932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.128935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.128937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.128939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.128962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:43.132838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554479446355343:7516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:43.132847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554479446355343:7516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:43.132849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554479446355343:7516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:43.132853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:43.136491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:43.137953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:43.137968Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:43.137969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:43.137972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:43.137997Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 846 [2:7556554479370830506:6410]
2025-10-02T09:30:43.138013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:43.138027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:43.138032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.138034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.138035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.138045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:43.138049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:43.138055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:43.138086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.138091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.138092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.138094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:43.138095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:43.138136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:43.138141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.138148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.138153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.138163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:43.138179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355208:2446], now have 1 active actors on pipe
2025-10-02T09:30:43.138186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355384:7516], now have 1 active actors on pipe
2025-10-02T09:30:43.138190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.138198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.138204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.138215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:43.138225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:43.138234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:43.138236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:43.138236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:43.138238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:43.138209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 846
2025-10-02T09:30:43.138238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:43.138213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 846
2025-10-02T09:30:43.138258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.138260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:43.138266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:43.138268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.138270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.138291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:43.138298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.138300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.138301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:43.138306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.138311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:43.138320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.138422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.138427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.138434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.138478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 847 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0
2025-10-02T09:30:43.138726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc91831-cc804bd9-103ff766-5d9576b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:43.140990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Write session: try to update token
2025-10-02T09:30:43.141002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:43.148044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:43.148066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.148068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:43.148070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:43.148078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.148082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.148088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554479370830501:6410]
2025-10-02T09:30:43.148122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:43.148134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.148138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:43.148141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:43.148143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:43.148146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:43.148292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.152333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId: src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.154370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:43.216929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554479446355394:7261]
2025-10-02T09:30:43.217107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 846, pipe: [1:7556554479446355394:7261]
2025-10-02T09:30:43.276256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:43.276677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.276686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.276711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355394:7261], now have 1 active actors on pipe
2025-10-02T09:30:43.276884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:43.276921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554479446355394:7261]
2025-10-02T09:30:43.276942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:43.276952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:43.277016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 847 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0
2025-10-02T09:30:43.277148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 847 sessionId: src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0 is DEAD
2025-10-02T09:30:43.277250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:43.277258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Write session will restart in 0.009398s
2025-10-02T09:30:43.277273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Write session: Do CDS request
2025-10-02T09:30:43.277278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:43.286622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:43.287168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.287243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:43.287253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 848
2025-10-02T09:30:43.287327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.287346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:43.287353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:43.287357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:43.287691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 848 sessionId:  describe result for acl check
2025-10-02T09:30:43.287716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:43.287721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:43.287723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:43.287727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554479446355532:7521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:43.288080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554479446355532:7521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:43.288092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:43.288202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:43.288208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:43.288214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:43.288243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:43.288269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554479370830684:6413]
2025-10-02T09:30:43.288620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:43.288875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:43.288912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:43.289177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:43.289219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.289223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.289224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.289224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.289225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.289225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.289226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.289227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.289227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.289228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.289228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.289229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.289231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.289237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.289239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.289241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.289243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.289245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.289247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.289249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.289251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.289253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.289255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.289257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.289261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.289268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.289272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.289277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.289280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.289284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.289291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.289296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.289303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.289312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.289320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.289328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.289336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.289342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.289349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.289351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.289353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.289356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.289362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.289365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.289367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.289370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.289375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.289377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.289395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:43.289533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554479446355532:7521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:43.294113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554479446355532:7521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:43.294123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554479446355532:7521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:43.294125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554479446355532:7521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:43.294128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:43.296844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:43.298321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:43.298333Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:43.298334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:43.298336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:43.298340Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 847 [2:7556554479370830684:6413]
2025-10-02T09:30:43.298347Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:43.298357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:43.298358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.298359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.298360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.298369Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:43.298375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:43.298380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:43.298407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.298412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.298414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.298416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:43.298417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:43.298453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:43.298458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.298464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.298469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.298480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:43.298498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355395:2446], now have 1 active actors on pipe
2025-10-02T09:30:43.298505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355571:7521], now have 1 active actors on pipe
2025-10-02T09:30:43.298509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.298515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.298516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.298526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:43.298539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:43.298542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:43.298547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:43.298548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:43.298553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:43.298556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:43.298536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 847
2025-10-02T09:30:43.298573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.298579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:43.298580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:43.298537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 847
2025-10-02T09:30:43.298589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.298594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.298620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afdefc7c-f6a70950-935a7906-85785ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:43.298628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.298630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.298631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:43.298636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.298641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:43.298654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.298761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.298769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.298779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.298838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 848 partition: 0 MaxSeqNo: 36 sessionId: src_id|afdefc7c-f6a70950-935a7906-85785ec_0
2025-10-02T09:30:43.299079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9f28a3-dfdf1f41-23b52f7-c20cb658_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afdefc7c-f6a70950-935a7906-85785ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:43.301347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Write session: try to update token
2025-10-02T09:30:43.301358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:43.308030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:43.308050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.308052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:43.308053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:43.308058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.308060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.308063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554479370830679:6413]
2025-10-02T09:30:43.308085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:43.308087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:43.308090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.308091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:43.308091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:43.308093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:43.308211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.311811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId: src_id|afdefc7c-f6a70950-935a7906-85785ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.313865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:43.377194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554479446355579:7261]
2025-10-02T09:30:43.377384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 847, pipe: [1:7556554479446355579:7261]
2025-10-02T09:30:43.426311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:43.426596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.426610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.426639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355579:7261], now have 1 active actors on pipe
2025-10-02T09:30:43.426853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:43.426860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554479446355579:7261]
2025-10-02T09:30:43.426865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:43.426878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:43.426912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 848 reason: error at write: Disconnected sessionId: src_id|afdefc7c-f6a70950-935a7906-85785ec_0
2025-10-02T09:30:43.427059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 848 sessionId: src_id|afdefc7c-f6a70950-935a7906-85785ec_0 is DEAD
2025-10-02T09:30:43.427094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:43.427176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:43.427185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Write session will restart in 0.009294s
2025-10-02T09:30:43.427202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Write session: Do CDS request
2025-10-02T09:30:43.427207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:43.435981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:43.437104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.437178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:43.437187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 849
2025-10-02T09:30:43.437284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.437304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:43.437311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:43.437313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:43.437515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:43.437595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 849 sessionId:  describe result for acl check
2025-10-02T09:30:43.437619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:43.437614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:43.437623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:43.437624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:43.437627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554479446355718:7525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:43.437621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:43.437626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:43.437652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:43.437674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554479370830861:6415]
2025-10-02T09:30:43.437963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554479446355718:7525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:43.438018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:43.438203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:43.438232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:43.438412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:43.438441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.438445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.438445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.438446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.438446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.438447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.438448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.438448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.438449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.438449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.438449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.438450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.438453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.438459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.438461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.438463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.438465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.438467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.438469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.438471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.438473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.438475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.438477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.438479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.438483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.438487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.438490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.438492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.438495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.438497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.438501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.438503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.438506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.438508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.438510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.438513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.438515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.438518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.438520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.438523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.438525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.438528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.438530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.438533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.438535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.438537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.438539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.438542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.438559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:43.439588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554479446355718:7525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:43.443775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554479446355718:7525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:43.443783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554479446355718:7525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:43.443785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554479446355718:7525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:43.443789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:43.446011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:43.447456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:43.447468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:43.447469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:43.447471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:43.447475Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 848 [2:7556554479370830861:6415]
2025-10-02T09:30:43.447481Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:43.447491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:43.447492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.447494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.447495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.447504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:43.447506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:43.447510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:43.447541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.447547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.447548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.447549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:43.447551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:43.447589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:43.447593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.447599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.447605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.447613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:43.447625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.447629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.447630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.447635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:43.447642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355756:7525], now have 1 active actors on pipe
2025-10-02T09:30:43.447642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:43.447644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:43.447645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:43.447648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355580:2446], now have 1 active actors on pipe
2025-10-02T09:30:43.447653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:43.447660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:43.447662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:43.447676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.447683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:43.447688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:43.447694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 848
2025-10-02T09:30:43.447713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 848
2025-10-02T09:30:43.447764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.447769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.447785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:43.447794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.447797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.447799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:43.447805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.447812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:43.447826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.447955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.447959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.447967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.448048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 849 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0
2025-10-02T09:30:43.448288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdefc7c-f6a70950-935a7906-85785ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:43.450587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Write session: try to update token
2025-10-02T09:30:43.450599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:43.457382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:43.457403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.457405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:43.457407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:43.457417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.457421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.457429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554479370830856:6415]
2025-10-02T09:30:43.457466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:43.457477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.457480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:43.457489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:43.457503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:43.457506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:43.457631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.461418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId: src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.463473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:43.527214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554479446355765:7261]
2025-10-02T09:30:43.527514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 848, pipe: [1:7556554479446355765:7261]
2025-10-02T09:30:43.582884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:43.583318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.583332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.583362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355765:7261], now have 1 active actors on pipe
2025-10-02T09:30:43.583578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:43.583598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554479446355765:7261]
2025-10-02T09:30:43.583628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:43.583683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:43.583691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 849 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0
2025-10-02T09:30:43.583848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 849 sessionId: src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0 is DEAD
2025-10-02T09:30:43.584017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:43.584027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Write session will restart in 0.009716s
2025-10-02T09:30:43.584041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Write session: Do CDS request
2025-10-02T09:30:43.584045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:43.593182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:43.594636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:43.594752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:43.594758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:43.594765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:43.594791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:43.594816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554479370831051:6418]
2025-10-02T09:30:43.595237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.595268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:43.595303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:43.595315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 850
2025-10-02T09:30:43.595421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.595445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:43.595449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:43.595452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:43.595481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:43.595514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:43.595778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:43.595789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 850 sessionId:  describe result for acl check
2025-10-02T09:30:43.595819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:43.595831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.595820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:43.595837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.595822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:43.595838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.595826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554479446355908:7529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:43.595839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.595839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.595840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.595841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.595842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.595843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.595844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.595844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.595845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.595849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.595858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.595861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.595865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.595868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.595871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.595874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.595877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.595880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.595884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.595887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.595890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.595895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.595901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.595906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.595915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.595927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.595935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.595943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.595950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.595954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.595962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.595969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.595973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.595980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.595985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.595988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.595997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.596001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.596010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.596017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.596026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.596034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.596043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.596050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.596057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.596090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:43.596235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554479446355908:7529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:43.597715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554479446355908:7529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:43.601521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554479446355908:7529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:43.601530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554479446355908:7529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:43.601532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554479446355908:7529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:43.601537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:43.603762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:43.605185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:43.605198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:43.605200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:43.605202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:43.605206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 849 [2:7556554479370831051:6418]
2025-10-02T09:30:43.605214Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:43.605225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:43.605230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.605232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.605234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.605243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:43.605247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:43.605256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:43.605299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.605304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.605305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.605307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:43.605309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:43.605352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:43.605357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.605364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.605369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.605380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:43.605396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355944:7529], now have 1 active actors on pipe
2025-10-02T09:30:43.605401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355766:2446], now have 1 active actors on pipe
2025-10-02T09:30:43.605406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.605410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.605411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.605419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:43.605430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:43.605431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:43.605433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:43.605435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:43.605440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:43.605442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:43.605462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.605471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:43.605474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:43.605478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 849
2025-10-02T09:30:43.605510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 849
2025-10-02T09:30:43.605558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.605564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.605578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:43.605586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.605588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.605589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:43.605594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.605603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:43.605613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.605722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.605727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.605734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.605793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 850 partition: 0 MaxSeqNo: 36 sessionId: src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0
2025-10-02T09:30:43.606057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d8f93a-30eb8dc5-bbcfba4d-450dddbb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:43.608365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Write session: try to update token
2025-10-02T09:30:43.608378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:43.614902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:43.614918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.614924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.614952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:43.614965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:43.615106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:43.615224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:43.615344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:43.615463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:43.615627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:43.615654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:43.619651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId: src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.621861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:43.622040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.622058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.622081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:43.622169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:43.623875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:43.623894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.623896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:43.623898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:43.623906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.623910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.623914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554479370831046:6418]
2025-10-02T09:30:43.623942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:43.623945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:43.623950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.623953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:43.623953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:43.623956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:43.624069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.683865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554479446355964:7261]
2025-10-02T09:30:43.684131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 849, pipe: [1:7556554479446355964:7261]
2025-10-02T09:30:43.746916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:43.755244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.755278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.755651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.755706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.755882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.755940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.755979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.755994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.756174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.756365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.756549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.756708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.756749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.756756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.756825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.756877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.756931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.756988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.757085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.757092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.757172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.757228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.757398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.757455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.757493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.757498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.757556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.757610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.757668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.757746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.757803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.757812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.757908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.757968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.758029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.758108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.758145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.758150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.758278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.758331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.758407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.758465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.758504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.758510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.758570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.758622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.758673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.758728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.758766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.758771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.758828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.758880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.758939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.759011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.759050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.759061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.759125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:43.759177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:43.759230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:43.759287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:43.759389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:43.759394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:43.759442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355964:7261], now have 1 active actors on pipe
2025-10-02T09:30:43.759670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554479446355964:7261]
2025-10-02T09:30:43.759670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:43.759712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:43.759714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:43.759748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 850 reason: error at write: Disconnected sessionId: src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0
2025-10-02T09:30:43.759917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 850 sessionId: src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0 is DEAD
2025-10-02T09:30:43.760078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:43.760095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Write session will restart in 0.007260s
2025-10-02T09:30:43.760115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Write session: Do CDS request
2025-10-02T09:30:43.760119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:43.760588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:43.768317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.768449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:43.768461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 851
2025-10-02T09:30:43.768578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.768606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:43.768615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:43.768618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:43.769113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 851 sessionId:  describe result for acl check
2025-10-02T09:30:43.769145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:43.769154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:43.769157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:43.769164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554479446356106:7534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:43.769702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554479446356106:7534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:43.770439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:43.771538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554479446356106:7534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:43.771980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:43.772156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:43.772163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:43.772169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:43.772200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:43.772224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554479370831231:6420]
2025-10-02T09:30:43.772684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:43.772895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:43.772925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:43.773179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:43.773211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.773215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.773216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.773216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.773217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.773217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.773218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.773218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.773219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.773219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.773220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.773220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.773223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.773229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.773231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.773233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.773235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.773237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.773239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.773241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.773243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.773245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.773247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.773250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.773256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.773262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.773266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.773270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.773273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.773276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.773279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.773283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.773287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.773291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.773294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.773298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.773306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.773310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.773317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.773321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.773328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.773332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.773339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.773343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.773350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.773355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.773362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.773366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.773395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:43.773423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554479446356106:7534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:43.773445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554479446356106:7534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:43.773449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554479446356106:7534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:43.773456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:43.781022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:43.782607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:43.782625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:43.782627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:43.782630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:43.782635Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 850 [2:7556554479370831231:6420]
2025-10-02T09:30:43.782645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:43.782664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:43.782671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.782673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.782674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.782686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:43.782695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:43.782705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:43.782754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.782761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.782763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.782766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:43.782768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:43.782815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:43.782820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.782828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.782833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.782841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:43.782858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446355965:2446], now have 1 active actors on pipe
2025-10-02T09:30:43.782864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446356146:7534], now have 1 active actors on pipe
2025-10-02T09:30:43.782869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.782874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.782876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.782890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:43.782904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:43.782904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:43.782906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:43.782908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:43.782902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 850
2025-10-02T09:30:43.782919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:43.782925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:43.782914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 850
2025-10-02T09:30:43.782953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.782967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.782973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.782983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:43.782992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:43.783002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:43.783008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.783013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.783014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:43.783019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.783029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:43.783044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.783155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.783160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.783168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.783224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 851 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0
2025-10-02T09:30:43.783497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e69c60-f91b66ac-20f565a2-a9df0740_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:43.788772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Write session: try to update token
2025-10-02T09:30:43.788783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:43.792304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:43.792319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.792320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:43.792321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:43.792325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.792328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.792330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554479370831225:6420]
2025-10-02T09:30:43.792353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:43.792357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.792358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:43.792369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:43.792375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:43.792378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:43.792468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.801352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId: src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.803283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:43.859983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554479446356167:7261]
2025-10-02T09:30:43.860211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 850, pipe: [1:7556554479446356167:7261]
2025-10-02T09:30:43.919230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:43.919457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.919467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.919478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446356167:7261], now have 1 active actors on pipe
2025-10-02T09:30:43.919628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:43.919661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:43.919689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:43.919698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554479446356167:7261]
2025-10-02T09:30:43.919746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 851 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0
2025-10-02T09:30:43.919886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 851 sessionId: src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0 is DEAD
2025-10-02T09:30:43.920036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:43.920050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Write session will restart in 0.005153s
2025-10-02T09:30:43.920075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Write session: Do CDS request
2025-10-02T09:30:43.920081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:43.926249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.926326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:43.926336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 852
2025-10-02T09:30:43.926699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:43.926720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:43.926726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:43.926729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:43.927188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 852 sessionId:  describe result for acl check
2025-10-02T09:30:43.927222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:43.927227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:43.927228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:43.927231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554479446356249:7546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:43.927564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554479446356249:7546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:43.929539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554479446356249:7546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:43.930285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:43.931983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:43.932085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:43.932094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:43.932099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:43.932128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:43.932157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554479370831450:6435]
2025-10-02T09:30:43.932209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554479446356249:7546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:43.932219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554479446356249:7546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:43.932221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554479446356249:7546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:43.932225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:43.932558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:43.932724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:43.932749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:43.932936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:43.932967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.932971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.932971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.932972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.932972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.932973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.932974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.932974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.932975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.932975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.932976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.932976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.932979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.932987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.932990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.932994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.932997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.933000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.933003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.933006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.933010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.933013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.933016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.933018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.933022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.933030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:43.933033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.933040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:43.933042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.933045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:43.933050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.933053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:43.933055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.933058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:43.933064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.933066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:43.933068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.933071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:43.933076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.933078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:43.933081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.933083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:43.933085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.933088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.933090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.933092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.933097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.933100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.933118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:43.940658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:43.942264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:43.942277Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:43.942279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:43.942283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:43.942288Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 851 [2:7556554479370831450:6435]
2025-10-02T09:30:43.942298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:43.942311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:43.942317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.942319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.942321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.942333Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:43.942341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:43.942348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:43.942391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.942397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.942398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.942401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:43.942403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:43.942453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:43.942460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.942470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:43.942484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:43.942504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:43.942522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446356186:2446], now have 1 active actors on pipe
2025-10-02T09:30:43.942529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554479446356362:7546], now have 1 active actors on pipe
2025-10-02T09:30:43.942534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.942541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.942543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.942553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:43.942561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:43.942563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:43.942564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:43.942564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:43.942576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:43.942582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:43.942559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 851
2025-10-02T09:30:43.942561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 851
2025-10-02T09:30:43.942608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.942614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.942627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.942637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:43.942640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:43.942657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:43.942665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:43.942672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:43.942674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:43.942681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:43.942691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:43.942710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.942801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:43.942808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:43.942819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:43.942884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 852 partition: 0 MaxSeqNo: 36 sessionId: src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0
2025-10-02T09:30:43.943237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca12cd0-a81db354-1daffabd-abffd8d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:43.946100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Write session: try to update token
2025-10-02T09:30:43.946116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:43.951942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:43.951958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:43.951960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:43.951961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:43.951967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.951970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.951973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554479370831444:6435]
2025-10-02T09:30:43.951998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:43.952002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:43.952006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:43.952006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:43.952008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:43.952008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:43.952128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:43.960250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId: src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:43.962352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.019745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741323670:7261]
2025-10-02T09:30:44.019923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 851, pipe: [1:7556554483741323670:7261]
2025-10-02T09:30:44.076203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.076496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.076510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.076525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741323670:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.076739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.076773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.076829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:44.076884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 852 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0
2025-10-02T09:30:44.076893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741323670:7261]
2025-10-02T09:30:44.077024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 852 sessionId: src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0 is DEAD
2025-10-02T09:30:44.077148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:44.077154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Write session will restart in 0.007038s
2025-10-02T09:30:44.077172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Write session: Do CDS request
2025-10-02T09:30:44.077177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.085130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.085220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.085231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 853
2025-10-02T09:30:44.085345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.085366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.085372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.085374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.085665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 853 sessionId:  describe result for acl check
2025-10-02T09:30:44.085692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.085693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.085694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.085697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741323799:7550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.086046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741323799:7550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.086909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.087776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741323799:7550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.088473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.088598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.088604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.088610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.088642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.088663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665798927:6437]
2025-10-02T09:30:44.089017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.089192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.089218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.089411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.089460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.089466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.089467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.089468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.089468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.089469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.089470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.089471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.089472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.089473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.089474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.089475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.089478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.089487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.089490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.089493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.089496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.089499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.089502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.089505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.089508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.089512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.089515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.089519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.089524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.089532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.089535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.089541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.089543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.089546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.089551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.089554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.089557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.089562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.089568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.089576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.089583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.089587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.089594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.089598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.089606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.089614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.089617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.089624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.089629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.089637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.089644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.089651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.089675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.089755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741323799:7550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.089763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741323799:7550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.089765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741323799:7550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.089769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.097120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:44.098489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:44.098501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:44.098502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:44.098504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:44.098507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 852 [2:7556554483665798927:6437]
2025-10-02T09:30:44.098516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:44.098526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:44.098527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.098529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.098530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.098539Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:44.098542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:44.098547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:44.098579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.098584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.098585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.098587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:44.098589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:44.098626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:44.098630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.098636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.098641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.098653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:44.098672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741323852:7550], now have 1 active actors on pipe
2025-10-02T09:30:44.098679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741323671:2446], now have 1 active actors on pipe
2025-10-02T09:30:44.098683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.098685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.098687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.098696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:44.098707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:44.098708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:44.098713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:44.098714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:44.098720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:44.098723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:44.098722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 852
2025-10-02T09:30:44.098741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.098733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 852
2025-10-02T09:30:44.098747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:44.098748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:44.098764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.098769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.098788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:44.098796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.098801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.098802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:44.098807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.098815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:44.098835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.098936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.098941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.098949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.099019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 853 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0
2025-10-02T09:30:44.099273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3673a-df3cee8e-25b49bdb-42be3755_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:44.101761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Write session: try to update token
2025-10-02T09:30:44.101774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:44.108338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:44.108352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:44.108354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:44.108356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:44.108360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.108363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.108365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665798920:6437]
2025-10-02T09:30:44.108394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:44.108399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.108401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:44.108409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:44.108414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:44.108418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:44.108537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:44.113280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId: src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:44.115304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.176961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741323861:7261]
2025-10-02T09:30:44.177203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 852, pipe: [1:7556554483741323861:7261]
2025-10-02T09:30:44.225591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.225802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.225811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.225838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741323861:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.226034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.226027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:44.226039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:44.226045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741323861:7261]
2025-10-02T09:30:44.226064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.226091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 853 reason: error at write: Disconnected sessionId: src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0
2025-10-02T09:30:44.226247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 853 sessionId: src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0 is DEAD
2025-10-02T09:30:44.226375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:44.226382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Write session will restart in 0.005479s
2025-10-02T09:30:44.226396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Write session: Do CDS request
2025-10-02T09:30:44.226399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.233185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.233358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.233368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 854
2025-10-02T09:30:44.233485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.233509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.233517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.233521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.233807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 854 sessionId:  describe result for acl check
2025-10-02T09:30:44.233833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.233835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.233836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.233840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741323965:7555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.234179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741323965:7555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.235422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.235732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741323965:7555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.236784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.236899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.236906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.236912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.236939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.236961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665799109:6440]
2025-10-02T09:30:44.237319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.237504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.237538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.237687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741323965:7555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.237695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741323965:7555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.237696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741323965:7555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.237700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.237795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.237833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.237837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.237838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.237838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.237839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.237839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.237840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.237840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.237840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.237841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.237841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.237842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.237845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.237851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.237853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.237855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.237857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.237859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.237861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.237863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.237865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.237867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.237869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.237871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.237875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.237878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.237882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.237885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.237887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.237890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.237892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.237895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.237897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.237903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.237905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.237909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.237914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.237917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.237919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.237922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.237924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.237926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.237928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.237930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.237933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.237935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.237941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.237943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.237960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.245433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:44.247006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:44.247018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:44.247020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:44.247023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:44.247027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 853 [2:7556554483665799109:6440]
2025-10-02T09:30:44.247040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:44.247057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:44.247063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.247065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.247067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.247080Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:44.247088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:44.247097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:44.247141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.247147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.247148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.247150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:44.247153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:44.247204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:44.247211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.247222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.247236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.247256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:44.247276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324042:7555], now have 1 active actors on pipe
2025-10-02T09:30:44.247283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741323863:2446], now have 1 active actors on pipe
2025-10-02T09:30:44.247288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.247294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.247296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.247306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:44.247317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:44.247320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:44.247323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:44.247324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:44.247309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 853
2025-10-02T09:30:44.247334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:44.247312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 853
2025-10-02T09:30:44.247340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:44.247366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.247374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.247386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.247397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:44.247403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:44.247418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef1f2e1d-838a8231-596350ac-222091e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:44.247426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.247433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.247434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:44.247441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.247451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:44.247472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.247564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.247574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.247584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.247646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 854 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef1f2e1d-838a8231-596350ac-222091e7_0
2025-10-02T09:30:44.247918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea3817e-f33b3b92-6fe806e4-a6f3f78f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef1f2e1d-838a8231-596350ac-222091e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:44.250680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Write session: try to update token
2025-10-02T09:30:44.250696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:44.256761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:44.256775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:44.256777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:44.256779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:44.256785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.256788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.256791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665799104:6440]
2025-10-02T09:30:44.256826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:44.256831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:44.256833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:44.256833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:44.256837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.256839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:44.256957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:44.266295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId: src_id|ef1f2e1d-838a8231-596350ac-222091e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:44.268323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.325944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741324052:7261]
2025-10-02T09:30:44.326208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 853, pipe: [1:7556554483741324052:7261]
2025-10-02T09:30:44.378408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.378667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.378676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.378689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324052:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.378845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.378885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:44.378894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:44.378906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741324052:7261]
2025-10-02T09:30:44.378922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.378946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 854 reason: error at write: Disconnected sessionId: src_id|ef1f2e1d-838a8231-596350ac-222091e7_0
2025-10-02T09:30:44.379103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 854 sessionId: src_id|ef1f2e1d-838a8231-596350ac-222091e7_0 is DEAD
2025-10-02T09:30:44.379265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:44.379281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Write session will restart in 0.006131s
2025-10-02T09:30:44.379311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Write session: Do CDS request
2025-10-02T09:30:44.379319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.386310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.386387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.386394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 855
2025-10-02T09:30:44.386637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.386659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.386663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.386666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.386947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 855 sessionId:  describe result for acl check
2025-10-02T09:30:44.386974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.386978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.386979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.386982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741324171:7559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.387313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741324171:7559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.388393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.388857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741324171:7559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.389994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.390105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.390112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.390118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.390147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.390169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665799291:6442]
2025-10-02T09:30:44.390510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.390659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.390687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.390865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.390895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.390899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.390900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.390900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.390901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.390902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.390894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741324171:7559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.390902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.390903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.390905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741324171:7559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.390904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.390907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741324171:7559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.390904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.390912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.390905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.390905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.390908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.390914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.390916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.390919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.390921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.390923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.390925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.390927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.390929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.390931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.390933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.390935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.390939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.390943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.390946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.390949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.390951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.390964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.390967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.390969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.390971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.390974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.390976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.390979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.390981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.390984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.390986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.390989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.390991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.390994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.390996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.390998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.391002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.391005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.391007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.391009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.391025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.398556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:44.400063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:44.400073Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:44.400075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:44.400077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:44.400080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 854 [2:7556554483665799291:6442]
2025-10-02T09:30:44.400088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:44.400099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:44.400104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.400106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.400107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.400116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:44.400123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:44.400127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:44.400163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.400167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.400168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.400171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:44.400172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:44.400211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:44.400217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.400223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.400228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.400236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:44.400251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324235:7559], now have 1 active actors on pipe
2025-10-02T09:30:44.400256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324054:2446], now have 1 active actors on pipe
2025-10-02T09:30:44.400260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.400261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.400263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.400271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:44.400283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:44.400292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:44.400294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:44.400296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:44.400296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:44.400298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:44.400311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.400316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:44.400326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:44.400335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.400337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.400307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 854
2025-10-02T09:30:44.400312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 854
2025-10-02T09:30:44.400355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3d66db3-b639d78b-131bc87a-81e30981_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:44.400362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.400364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.400365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:44.400370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.400376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:44.400384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.400478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.400483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.400490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.400535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 855 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3d66db3-b639d78b-131bc87a-81e30981_0
2025-10-02T09:30:44.400868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1f2e1d-838a8231-596350ac-222091e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3d66db3-b639d78b-131bc87a-81e30981_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:44.403581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Write session: try to update token
2025-10-02T09:30:44.403593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:44.409649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:44.409663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:44.409665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:44.409666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:44.409671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.409673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.409676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665799286:6442]
2025-10-02T09:30:44.409697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:44.409700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.409701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:44.409701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:44.409704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:44.409706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:44.409817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:44.415594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId: src_id|a3d66db3-b639d78b-131bc87a-81e30981_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:44.417862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.479056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741324244:7261]
2025-10-02T09:30:44.479308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 854, pipe: [1:7556554483741324244:7261]
2025-10-02T09:30:44.525456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.525817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.525825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.525838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324244:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.526000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.526059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.526059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741324244:7261]
2025-10-02T09:30:44.526078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:44.526138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 855 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3d66db3-b639d78b-131bc87a-81e30981_0
2025-10-02T09:30:44.526292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 855 sessionId: src_id|a3d66db3-b639d78b-131bc87a-81e30981_0 is DEAD
2025-10-02T09:30:44.526451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:44.526463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Write session will restart in 0.007437s
2025-10-02T09:30:44.526483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Write session: Do CDS request
2025-10-02T09:30:44.526489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.535174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.535272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.535284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 856
2025-10-02T09:30:44.535369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.535394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.535402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.535405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.535722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 856 sessionId:  describe result for acl check
2025-10-02T09:30:44.535748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.535753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.535754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.535759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741324388:7563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.536191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741324388:7563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.536300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.537921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741324388:7563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.538000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.538093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.538099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.538105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.538131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.538153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665799476:6444]
2025-10-02T09:30:44.538514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.538686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.538710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.538920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.538963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.538966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.538967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.538968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.538968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.538969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.538969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.538970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.538970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.538971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.538972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.538972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.538975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.538981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.538983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.538985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.538987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.538989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.538991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.538993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.538995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.538997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.538999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.539001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.539005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.539009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.539012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.539015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.539018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.539020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.539022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.539025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.539027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.539030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.539032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.539035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.539037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.539040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.539045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.539048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.539050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.539053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.539058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.539061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.539063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.539066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.539068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.539071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.539090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.543078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741324388:7563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.543089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741324388:7563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.543090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741324388:7563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.543095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.546775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:44.548377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:44.548389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:44.548392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:44.548395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:44.548401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 855 [2:7556554483665799476:6444]
2025-10-02T09:30:44.548413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:44.548430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:44.548436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.548439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.548441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.548453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:44.548463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:44.548472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:44.548521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.548527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.548528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.548531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:44.548533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:44.548589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:44.548595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.548606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.548620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.548639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:44.548658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324429:7563], now have 1 active actors on pipe
2025-10-02T09:30:44.548665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324246:2446], now have 1 active actors on pipe
2025-10-02T09:30:44.548670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.548676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.548678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.548688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:44.548700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:44.548704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:44.548707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:44.548708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:44.548716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:44.548722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:44.548703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 855
2025-10-02T09:30:44.548721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 855
2025-10-02T09:30:44.548752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.548758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.548768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.548777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:44.548783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:44.548817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:44.548826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.548833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.548835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:44.548843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.548853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:44.548878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.549003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.549009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.549017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.549085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 856 partition: 0 MaxSeqNo: 36 sessionId: src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0
2025-10-02T09:30:44.549395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3d66db3-b639d78b-131bc87a-81e30981_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:44.551705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Write session: try to update token
2025-10-02T09:30:44.551719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:44.558557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:44.558571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:44.558572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:44.558574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:44.558581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.558585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.558588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665799470:6444]
2025-10-02T09:30:44.558617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:44.558618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:44.558622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:44.558624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:44.558625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.558628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:44.558764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:44.562795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId: src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:44.564789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.625983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741324437:7261]
2025-10-02T09:30:44.626217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 855, pipe: [1:7556554483741324437:7261]
2025-10-02T09:30:44.684185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.684462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.684471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.684503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324437:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.684682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.684701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:44.684717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:44.684768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 856 reason: error at write: Disconnected sessionId: src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0
2025-10-02T09:30:44.684852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.684895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741324437:7261]
2025-10-02T09:30:44.684954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 856 sessionId: src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0 is DEAD
2025-10-02T09:30:44.685059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:44.685067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Write session will restart in 0.006498s
2025-10-02T09:30:44.685083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Write session: Do CDS request
2025-10-02T09:30:44.685088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.692275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.692388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.692399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 857
2025-10-02T09:30:44.692491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.692515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.692523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.692527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.692855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 857 sessionId:  describe result for acl check
2025-10-02T09:30:44.692882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.692886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.692888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.692891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741324572:7568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.693232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741324572:7568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.694063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.694440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741324572:7568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.695553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.695671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.695678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.695684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.695712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.695735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665799672:6447]
2025-10-02T09:30:44.696104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.696315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.696340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.696493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741324572:7568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.696502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741324572:7568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.696504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741324572:7568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.696507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.696517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.696552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.696556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.696557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.696558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.696559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.696560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.696561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.696562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.696563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.696564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.696565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.696566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.696570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.696577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.696579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.696581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.696583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.696585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.696587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.696589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.696591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.696593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.696595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.696597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.696600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.696604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.696608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.696610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.696613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.696615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.696617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.696620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.696622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.696624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.696627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.696629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.696633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.696635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.696637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.696640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.696642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.696645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.696647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.696649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.696652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.696654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.696656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.696659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.696674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.704639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:44.706366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:44.706380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:44.706382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:44.706385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:44.706391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 856 [2:7556554483665799672:6447]
2025-10-02T09:30:44.706401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:44.706418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:44.706425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.706427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.706429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.706442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:44.706451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:44.706460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:44.706510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.706516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.706518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.706521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:44.706523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:44.706578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:44.706587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.706599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.706610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.706626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:44.706649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324632:7568], now have 1 active actors on pipe
2025-10-02T09:30:44.706657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324451:2446], now have 1 active actors on pipe
2025-10-02T09:30:44.706662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.706664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.706666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.706677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:44.706664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 856
2025-10-02T09:30:44.706684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:44.706685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 856
2025-10-02T09:30:44.706688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:44.706690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:44.706692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:44.706701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:44.706703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:44.706736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.706744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.706758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.706769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:44.706776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:44.706792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:44.706801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.706809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.706811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:44.706820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.706830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:44.706850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.706972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.706980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.706991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.707069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 857 partition: 0 MaxSeqNo: 36 sessionId: src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0
2025-10-02T09:30:44.707404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51be5db-6d06eb4b-7d877b94-c5fe9bdb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:44.710299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Write session: try to update token
2025-10-02T09:30:44.710315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:44.716607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:44.716624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:44.716626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:44.716628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:44.716634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.716637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.716641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665799667:6447]
2025-10-02T09:30:44.716672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:44.716678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:44.716681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.716683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:44.716683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:44.716686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:44.716825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:44.724535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId: src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:44.726718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.785214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741324652:7261]
2025-10-02T09:30:44.785479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 856, pipe: [1:7556554483741324652:7261]
2025-10-02T09:30:44.833161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.833386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.833395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.833409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324652:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.833566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.833611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:44.833613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741324652:7261]
2025-10-02T09:30:44.833631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.833686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 857 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0
2025-10-02T09:30:44.833848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 857 sessionId: src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0 is DEAD
2025-10-02T09:30:44.834002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:44.834016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Write session will restart in 0.008923s
2025-10-02T09:30:44.834037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Write session: Do CDS request
2025-10-02T09:30:44.834043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.842764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.844184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.844278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.844294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.844301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.844307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.844332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.844356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665799858:6449]
2025-10-02T09:30:44.844364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.844377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 858
2025-10-02T09:30:44.844526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.844555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.844558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.844561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.844701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.844889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.844915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.844918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 858 sessionId:  describe result for acl check
2025-10-02T09:30:44.844942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.844947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.844949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.844953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741324805:7573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.845123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.845158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.845162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.845163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.845163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.845164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.845164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.845165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.845165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.845166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.845166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.845167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.845167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.845170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.845176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.845178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.845180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.845182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.845184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.845186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.845188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.845190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.845192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.845194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.845196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.845200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.845205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.845208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.845210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.845213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.845215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.845217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.845220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.845223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.845229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.845232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.845235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.845240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.845242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.845245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.845247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.845249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.845252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.845258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.845261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.845263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.845266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.845271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.845273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.845289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.845392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741324805:7573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.847115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741324805:7573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.851556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741324805:7573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.851565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741324805:7573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.851569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741324805:7573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.851574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.852719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:44.854187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:44.854198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:44.854199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:44.854201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:44.854205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 857 [2:7556554483665799858:6449]
2025-10-02T09:30:44.854213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:44.854223Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:44.854228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.854230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.854231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.854240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:44.854244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:44.854248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:44.854281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.854286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.854287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.854289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:44.854290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:44.854391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 857
2025-10-02T09:30:44.854396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 857
2025-10-02T09:30:44.854421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:44.854426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.854433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.854438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.854451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:44.854466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324653:2446], now have 1 active actors on pipe
2025-10-02T09:30:44.854471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324843:7573], now have 1 active actors on pipe
2025-10-02T09:30:44.854480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.854485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.854498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.854502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.854504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.854512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:44.854522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:44.854525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:44.854527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:44.854528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:44.854533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:44.854535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:44.854543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:44.854550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:44.854552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:44.854553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:44.854557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:44.854563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:44.854583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.854590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:44.854597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:44.854600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.854692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.854697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.854705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:44.854757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 858 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0
2025-10-02T09:30:44.855010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88760e9-12c10710-d5b727f5-9f8ad69_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:44.857435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Write session: try to update token
2025-10-02T09:30:44.857446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:44.864438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:44.864453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:44.864455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:44.864457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:44.864463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.864467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.864473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665799853:6449]
2025-10-02T09:30:44.864504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:44.864508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:44.864511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:44.864511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:44.864517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.864521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:44.864744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:44.868401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId: src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:44.870263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:44.933684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554483741324872:7261]
2025-10-02T09:30:44.933863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 857, pipe: [1:7556554483741324872:7261]
2025-10-02T09:30:44.978971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:44.979340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:44.979351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:44.979382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324872:7261], now have 1 active actors on pipe
2025-10-02T09:30:44.979525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:44.979576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:44.979579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:44.979610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554483741324872:7261]
2025-10-02T09:30:44.979644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 858 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0
2025-10-02T09:30:44.979776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 858 sessionId: src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0 is DEAD
2025-10-02T09:30:44.979920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:44.979929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Write session will restart in 0.007134s
2025-10-02T09:30:44.979949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Write session: Do CDS request
2025-10-02T09:30:44.979953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:44.988246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.988547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:44.988561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 859
2025-10-02T09:30:44.988652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:44.988672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:44.988679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:44.988681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:44.988699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:44.988986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 859 sessionId:  describe result for acl check
2025-10-02T09:30:44.989013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:44.989017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:44.989018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:44.989021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554483741325021:7584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:44.989388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554483741325021:7584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:44.990185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:44.990283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:44.990289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:44.990294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:44.990320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:44.990343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554483665800083:6464]
2025-10-02T09:30:44.990707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:44.990841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554483741325021:7584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:44.990883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:44.990914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:44.991104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:44.991141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.991146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.991147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.991148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.991149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.991150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.991150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.991151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.991151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.991152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.991152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.991153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.991156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.991161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.991164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.991166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.991168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.991170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.991172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.991174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.991176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.991178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.991180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.991182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.991186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.991189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:44.991192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.991195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:44.991197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.991200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:44.991202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.991204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:44.991206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.991209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:44.991211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.991213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:44.991216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.991218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:44.991220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.991223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:44.991227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.991230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:44.991232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.991236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:44.991238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.991241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:44.991244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.991247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:44.991262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:44.996297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554483741325021:7584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:44.996305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554483741325021:7584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:44.996307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554483741325021:7584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:44.996311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:44.999065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:45.000524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:45.000535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:45.000536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:45.000538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:45.000542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 858 [2:7556554483665800083:6464]
2025-10-02T09:30:45.000549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:45.000558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:45.000560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.000561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.000562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.000571Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:45.000577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:45.000582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:45.000617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.000623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.000624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.000627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:45.000629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:45.000666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:45.000670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.000677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.000682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.000694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:45.000709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741324873:2446], now have 1 active actors on pipe
2025-10-02T09:30:45.000711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554483741325060:7584], now have 1 active actors on pipe
2025-10-02T09:30:45.000715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.000718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.000719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.000728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:45.000737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:45.000743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:45.000746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:45.000747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:45.000748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:45.000749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:45.000740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 858
2025-10-02T09:30:45.000758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 858
2025-10-02T09:30:45.000760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.000765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:45.000767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:45.000781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.000786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.000818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|554a6261-1b216651-374b142f-31a9a2d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:45.000825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.000827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.000829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:45.000833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.000839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:45.000851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.000947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.000954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.000963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.001034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 859 partition: 0 MaxSeqNo: 36 sessionId: src_id|554a6261-1b216651-374b142f-31a9a2d1_0
2025-10-02T09:30:45.001289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a3b5c-7672421b-12494a61-90f2f83_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|554a6261-1b216651-374b142f-31a9a2d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:45.003553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Write session: try to update token
2025-10-02T09:30:45.003565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:45.011058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:45.011073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.011074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:45.011078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:45.011083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.011087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.011090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554483665800078:6464]
2025-10-02T09:30:45.011118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:45.011122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:45.011126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:45.011127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.011128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:45.011128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:45.011234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:45.014294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId: src_id|554a6261-1b216651-374b142f-31a9a2d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:45.016480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:45.079613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554488036292364:7261]
2025-10-02T09:30:45.079806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 858, pipe: [1:7556554488036292364:7261]
2025-10-02T09:30:45.131996Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:45.132208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.132219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.132247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292364:7261], now have 1 active actors on pipe
2025-10-02T09:30:45.132370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:45.132464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:45.132472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554488036292364:7261]
2025-10-02T09:30:45.132489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:45.132531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 859 reason: status is not ok: tablet will be restarted right now sessionId: src_id|554a6261-1b216651-374b142f-31a9a2d1_0
2025-10-02T09:30:45.132678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 859 sessionId: src_id|554a6261-1b216651-374b142f-31a9a2d1_0 is DEAD
2025-10-02T09:30:45.132855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:45.132865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Write session will restart in 0.005645s
2025-10-02T09:30:45.132880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Write session: Do CDS request
2025-10-02T09:30:45.132884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:45.139246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.139322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:45.139333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 860
2025-10-02T09:30:45.139425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.139445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:45.139452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:45.139455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:45.139772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 860 sessionId:  describe result for acl check
2025-10-02T09:30:45.139802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:45.139807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:45.139810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:45.139813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554488036292420:7588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:45.140183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554488036292420:7588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:45.141721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554488036292420:7588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:45.142932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:45.144523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:45.144703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:45.144710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:45.144717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:45.144757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:45.144761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554488036292420:7588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:45.144771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554488036292420:7588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:45.144773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554488036292420:7588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:45.144776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:45.144782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554487960767570:6466]
2025-10-02T09:30:45.145169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:45.145354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:45.145382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:45.145581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:45.145613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.145617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.145617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.145618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.145618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.145619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.145619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.145620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.145620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.145621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.145621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.145622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.145625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.145631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.145633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.145635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.145637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.145639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.145641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.145644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.145646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.145648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.145650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.145652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.145656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.145661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.145664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.145668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.145670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.145672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.145674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.145677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.145679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.145682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.145684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.145686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.145692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.145695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.145697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.145700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.145702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.145705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.145707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.145709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.145711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.145715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.145717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.145720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.145737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:45.153738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:45.155179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:45.155190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:45.155192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:45.155194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:45.155197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 859 [2:7556554487960767570:6466]
2025-10-02T09:30:45.155204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:45.155214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:45.155220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.155222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.155224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.155234Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:45.155242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:45.155250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:45.155284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.155289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.155290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.155293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:45.155294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:45.155331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:45.155335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.155344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.155352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.155364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:45.155376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292550:7588], now have 1 active actors on pipe
2025-10-02T09:30:45.155378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292365:2446], now have 1 active actors on pipe
2025-10-02T09:30:45.155381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.155384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.155385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.155393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:45.155403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:45.155405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:45.155407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:45.155408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:45.155414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:45.155416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:45.155430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.155438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:45.155442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:45.155437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 859
2025-10-02T09:30:45.155462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.155467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.155443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 859
2025-10-02T09:30:45.155485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:45.155494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.155500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.155502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:45.155510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.155519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:45.155531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.155632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.155639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.155648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.155719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 860 partition: 0 MaxSeqNo: 36 sessionId: src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0
2025-10-02T09:30:45.155984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554a6261-1b216651-374b142f-31a9a2d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:45.158289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Write session: try to update token
2025-10-02T09:30:45.158303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:45.169739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:45.169750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.169756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.169781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:45.169783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:45.169780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId: src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:45.169937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:45.170061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.170191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.170315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.170494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:45.170522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:45.171827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:45.171957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.171966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.171984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:45.172047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:45.174084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:45.174095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.174096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:45.174097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:45.174101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.174104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.174106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554487960767562:6466]
2025-10-02T09:30:45.174127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:45.174135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.174136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:45.174166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:45.174184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:45.174189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:45.174257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:45.232702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554488036292568:7261]
2025-10-02T09:30:45.232927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 859, pipe: [1:7556554488036292568:7261]
2025-10-02T09:30:45.294425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:45.300624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.300645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.300781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.300846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.300911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.300972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.301161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.301169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.301230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.301279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.301334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.301390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.301479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.301485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.301539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.301589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.301645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.301708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.301745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.301750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.301801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.301853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.301932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.301991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.302028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.302033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.302106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.302159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.302222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.302276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.302315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.302319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.302373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.302426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.302487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.302542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.302582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.302587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.302639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.302697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.302783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.302837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.302874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.302881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.302947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.303010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.303064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.303116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.303154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.303159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.303218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.303273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.303326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.303380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.303417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.303422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.303482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.303533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.303583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.303634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.303687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.303692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.303731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292568:7261], now have 1 active actors on pipe
2025-10-02T09:30:45.303942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:45.303954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:45.303968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554488036292568:7261]
2025-10-02T09:30:45.303979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 860 reason: error at write: Disconnected sessionId: src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0
2025-10-02T09:30:45.304006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:45.304150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 860 sessionId: src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0 is DEAD
2025-10-02T09:30:45.304267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:45.304231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:45.304278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Write session will restart in 0.007999s
2025-10-02T09:30:45.304298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Write session: Do CDS request
2025-10-02T09:30:45.304304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:45.313239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.313330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:45.313343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 861
2025-10-02T09:30:45.313453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.313482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:45.313492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:45.313496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:45.313933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 861 sessionId:  describe result for acl check
2025-10-02T09:30:45.313967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:45.313972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:45.313974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:45.313979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554488036292649:7593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:45.314503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554488036292649:7593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:45.316999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:45.317022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554488036292649:7593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:45.318854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:45.319019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:45.319028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:45.319037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:45.319090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:45.319124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554487960767763:6469]
2025-10-02T09:30:45.319172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554488036292649:7593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:45.319183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554488036292649:7593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:45.319186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554488036292649:7593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:45.319189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:45.319658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:45.319935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:45.319975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:45.320256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:45.320322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.320330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.320331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.320332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.320333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.320333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.320334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.320335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.320336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.320349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.320351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.320351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.320356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.320367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.320378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.320382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.320386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.320389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.320393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.320397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.320400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.320404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.320408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.320411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.320418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.320424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.320429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.320434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.320437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.320444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.320452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.320457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.320465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.320469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.320473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.320480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.320483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.320490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.320494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.320499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.320506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.320510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.320514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.320520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.320525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.320534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.320538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.320546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.320575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:45.328690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:45.330334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:45.330348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:45.330351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:45.330354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:45.330360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 860 [2:7556554487960767763:6469]
2025-10-02T09:30:45.330374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:45.330389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:45.330392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.330395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.330397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.330411Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:45.330422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:45.330428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:45.330478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.330486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.330488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.330491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:45.330494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:45.330554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:45.330562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.330573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.330588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.330604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:45.330625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292569:2446], now have 1 active actors on pipe
2025-10-02T09:30:45.330634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292754:7593], now have 1 active actors on pipe
2025-10-02T09:30:45.330639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.330641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.330643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.330653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:45.330664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:45.330668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:45.330671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:45.330674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:45.330678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:45.330681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:45.330708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.330715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:45.330702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 860
2025-10-02T09:30:45.330713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 860
2025-10-02T09:30:45.330733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:45.330746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.330752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.330775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:45.330785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.330789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.330802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:45.330821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.330829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:45.330840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.330966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.330973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.330982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.331055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 861 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0
2025-10-02T09:30:45.331374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825e3880-5f02d01a-32dda47f-ed2d746f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:45.333832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Write session: try to update token
2025-10-02T09:30:45.333846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:45.340342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:45.340357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.340364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.340398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:45.340401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:45.340535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:45.340656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.340770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.340916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.341098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:45.341134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:45.345367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId: src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:45.347808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:45.348019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.348036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.348064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:45.348158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:45.349457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:45.349469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.349471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:45.349473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:45.349481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.349484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.349488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554487960767757:6469]
2025-10-02T09:30:45.349516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:45.349525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.349531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:45.349536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:45.349548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:45.349552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:45.349648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:45.404217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554488036292766:7261]
2025-10-02T09:30:45.404463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 860, pipe: [1:7556554488036292766:7261]
2025-10-02T09:30:45.478693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:45.485206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.485224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.485354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.485403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.485459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.485511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.485549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.485555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.485610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.485660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.485711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.485765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.486105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.486112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.486168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.486218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.486269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.486321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.486358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.486363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.486416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.486466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.486514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.486565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.486604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.486609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.486663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.486715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.486768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.486819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.486854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.486859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.486916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.487005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.487081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.487134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.487182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.487187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.487242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.487295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.487346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.487400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.487512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.487517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.487572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.487620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.487673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.487722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.487761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.487766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.487814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.487860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.487919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.487973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.488008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.488013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.488062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.488110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.488157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.488208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.488246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.488250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.488282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292766:7261], now have 1 active actors on pipe
2025-10-02T09:30:45.488492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:45.488522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554488036292766:7261]
2025-10-02T09:30:45.488539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:45.488546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:45.488569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 861 reason: error at write: Disconnected sessionId: src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0
2025-10-02T09:30:45.488635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:45.488741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 861 sessionId: src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0 is DEAD
2025-10-02T09:30:45.488889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:45.488899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Write session will restart in 0.007465s
2025-10-02T09:30:45.488914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Write session: Do CDS request
2025-10-02T09:30:45.488919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:45.497136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.497257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:45.497271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 862
2025-10-02T09:30:45.497398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.497428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:45.497438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:45.497448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:45.497872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 862 sessionId:  describe result for acl check
2025-10-02T09:30:45.497905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:45.497911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:45.497913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:45.497918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554488036292911:7597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:45.498433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554488036292911:7597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:45.499082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:45.500247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554488036292911:7597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:45.500840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:45.500985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:45.500992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:45.501000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:45.501037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:45.501063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554487960767953:6471]
2025-10-02T09:30:45.501424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:45.501629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:45.501652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:45.501834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:45.501862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.501866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.501867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.501868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.501868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.501869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.501869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.501870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.501871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.501871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.501872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.501872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.501875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.501882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.501885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.501887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.501889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.501891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.501893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.501895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.501897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.501899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.501901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.501903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.501906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.501910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.501913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.501916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.501918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.501921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.501923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.501926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.501928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.501931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.501933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.501936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.501938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.501941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.501944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.501946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.501948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.501951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.501954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.501956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.501959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.501962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.501964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.501967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.501983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:45.502686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554488036292911:7597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:45.502699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554488036292911:7597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:45.502702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554488036292911:7597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:45.502708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:45.509744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:45.511170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:45.511180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:45.511182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:45.511185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:45.511189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 861 [2:7556554487960767953:6471]
2025-10-02T09:30:45.511197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:45.511208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:45.511212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.511214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.511215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.511224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:45.511231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:45.511235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:45.511271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.511276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.511277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.511279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:45.511281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:45.511321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:45.511325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.511332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.511341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.511353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:45.511369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292958:7597], now have 1 active actors on pipe
2025-10-02T09:30:45.511374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292768:2446], now have 1 active actors on pipe
2025-10-02T09:30:45.511378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.511379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.511380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.511388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:45.511398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:45.511409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:45.511414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:45.511430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.511434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:45.511433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 861
2025-10-02T09:30:45.511473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:45.511445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 861
2025-10-02T09:30:45.511483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:45.511486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:45.511494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:45.511537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.511544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.511560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:45.511567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.511569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.511571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:45.511576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.511582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:45.511590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.511686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.511691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.511698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.511775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 862 partition: 0 MaxSeqNo: 36 sessionId: src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0
2025-10-02T09:30:45.512022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a54361c-5f1a0df4-610f35a6-c5b5ef2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:45.514375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Write session: try to update token
2025-10-02T09:30:45.514389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:45.520782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:45.520797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.520818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.520843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:45.520845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:45.520982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:45.521101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.521221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.521338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:45.521503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:45.521527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:45.525731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId: src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:45.528085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:45.528276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.528286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.528304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:45.528376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:45.529668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:45.529679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.529681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:45.529683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:45.529688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.529690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.529693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554487960767947:6471]
2025-10-02T09:30:45.529714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:45.529718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:45.529721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.529722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:45.529722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:45.529724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:45.529833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:45.588527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554488036292966:7261]
2025-10-02T09:30:45.588711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 861, pipe: [1:7556554488036292966:7261]
2025-10-02T09:30:45.653996Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:45.660045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.660064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.660190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.660238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.660293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.660345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.660383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.660388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.660441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.660491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.660541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.660595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.660632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.660637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.660690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.660738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.660794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.660856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.660893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.660897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.660948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.660996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.661045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.661096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.661134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.661139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.661191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.661240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.661290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.661343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.661387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.661393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.661447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.661496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.661548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.661600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.661639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.661644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.661694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.661742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.661793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.661843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.661879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.661885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.661937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.661986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.662037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.662086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.662122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.662127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.662179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.662228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.662277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.662324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.662360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.662365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.662414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:45.662463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:45.662510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:45.662558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:45.662594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:45.662599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:45.662631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292966:7261], now have 1 active actors on pipe
2025-10-02T09:30:45.662819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:45.662833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:45.662836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554488036292966:7261]
2025-10-02T09:30:45.662854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 862 reason: error at write: Disconnected sessionId: src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0
2025-10-02T09:30:45.662860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:45.662995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 862 sessionId: src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0 is DEAD
2025-10-02T09:30:45.663107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:45.663113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Write session will restart in 0.005502s
2025-10-02T09:30:45.663130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Write session: Do CDS request
2025-10-02T09:30:45.663135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:45.663203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:45.669191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.669260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:45.669269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 863
2025-10-02T09:30:45.669344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.669365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:45.669368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:45.669371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:45.669802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 863 sessionId:  describe result for acl check
2025-10-02T09:30:45.669823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:45.669824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:45.669825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:45.669828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554488036293023:7602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:45.670289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554488036293023:7602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:45.672218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554488036293023:7602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:45.672920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:45.674289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:45.674401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:45.674409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:45.674415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:45.674442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:45.674472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554487960768155:6474]
2025-10-02T09:30:45.674526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554488036293023:7602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:45.674536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554488036293023:7602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:45.674539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554488036293023:7602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:45.674542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:45.674829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:45.675008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:45.675031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:45.675226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:45.675258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.675262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.675262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.675263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.675263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.675264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.675265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.675265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.675265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.675266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.675267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.675267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.675270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.675276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.675278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.675281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.675283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.675285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.675287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.675289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.675291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.675293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.675295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.675297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.675300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.675304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.675308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.675311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.675313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.675316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.675318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.675320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.675323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.675325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.675328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.675330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.675335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.675338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.675340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.675343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.675348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.675351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.675353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.675359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.675361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.675364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.675366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.675370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.675391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:45.683222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:45.684831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:45.684840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:45.684842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:45.684844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:45.684847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 862 [2:7556554487960768155:6474]
2025-10-02T09:30:45.684855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:45.684867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:45.684872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.684874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.684876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.684886Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:45.684893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:45.684897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:45.684931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.684936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.684937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.684939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:45.684940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:45.684982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:45.684987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.684994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.684999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.685011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:45.685027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293167:7602], now have 1 active actors on pipe
2025-10-02T09:30:45.685036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036292979:2446], now have 1 active actors on pipe
2025-10-02T09:30:45.685040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.685042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.685044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.685052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:45.685061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:45.685064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:45.685066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:45.685067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 862
2025-10-02T09:30:45.685073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 862
2025-10-02T09:30:45.685067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:45.685069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:45.685070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:45.685086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.685088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:45.685090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:45.685099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.685101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.685127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:45.685131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.685133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.685135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:45.685141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.685146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:45.685156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.685268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.685273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.685280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.685331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 863 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0
2025-10-02T09:30:45.685597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f2990e-c636b4a3-1d0d3f86-8653a70d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:45.687824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Write session: try to update token
2025-10-02T09:30:45.687835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:45.694917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:45.694932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.694933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:45.694934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:45.694941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.694944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.694946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554487960768150:6474]
2025-10-02T09:30:45.694980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:45.694984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:45.694985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.694987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:45.694989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:45.694991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:45.695099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:45.698977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId: src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:45.701274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:45.763182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554488036293182:7261]
2025-10-02T09:30:45.763400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 862, pipe: [1:7556554488036293182:7261]
2025-10-02T09:30:45.815940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:45.816192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.816205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.816235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293182:7261], now have 1 active actors on pipe
2025-10-02T09:30:45.816390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:45.816398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:45.816403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:45.816431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554488036293182:7261]
2025-10-02T09:30:45.816454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 863 reason: error at write: Disconnected sessionId: src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0
2025-10-02T09:30:45.816552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:45.816588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 863 sessionId: src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0 is DEAD
2025-10-02T09:30:45.816734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:45.816746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Write session will restart in 0.006974s
2025-10-02T09:30:45.816766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Write session: Do CDS request
2025-10-02T09:30:45.816772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:45.825183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.825232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:45.825246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 864
2025-10-02T09:30:45.825352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.825373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:45.825379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:45.825382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:45.825690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 864 sessionId:  describe result for acl check
2025-10-02T09:30:45.825719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:45.825724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:45.825725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:45.825728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554488036293291:7607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:45.826090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554488036293291:7607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:45.827501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:45.827548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554488036293291:7607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:45.828949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:45.829047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:45.829053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:45.829059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:45.829086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:45.829110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554487960768348:6476]
2025-10-02T09:30:45.829453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:45.829501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554488036293291:7607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:45.829510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554488036293291:7607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:45.829512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554488036293291:7607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:45.829516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:45.829636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:45.829677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:45.829889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:45.829920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.829925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.829925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.829926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.829926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.829927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.829927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.829928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.829928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.829929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.829929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.829930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.829933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.829939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.829941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.829943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.829952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.829954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.829956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.829958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.829960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.829962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.829964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.829966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.829970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.829973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.829977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.829980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.829982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.829986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.829988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.829991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.829993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.829996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.829998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.830001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.830003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.830006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.830010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.830013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.830015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.830017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.830019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.830022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.830026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.830028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.830030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.830033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.830050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:45.838285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:45.839785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:45.839799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:45.839802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:45.839805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:45.839811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 863 [2:7556554487960768348:6476]
2025-10-02T09:30:45.839823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:45.839838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:45.839841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.839843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.839845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.839859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:45.839864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:45.839869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:45.839920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.839926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.839928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.839930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:45.839933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:45.839978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:45.839983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.839991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.839996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.840005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:45.840021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.840026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.840027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.840034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:45.840043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293377:7607], now have 1 active actors on pipe
2025-10-02T09:30:45.840044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:45.840046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:45.840048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:45.840049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293187:2446], now have 1 active actors on pipe
2025-10-02T09:30:45.840054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:45.840062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:45.840064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:45.840087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.840096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:45.840120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:45.840105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 863
2025-10-02T09:30:45.840126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 863
2025-10-02T09:30:45.840163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.840175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.840193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:45.840202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:45.840205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:45.840207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:45.840214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:45.840226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:45.840240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.840351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.840356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.840373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:45.840438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 864 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0
2025-10-02T09:30:45.840715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fc0613-60dafe53-2f8e3e29-db096324_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:45.843279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Write session: try to update token
2025-10-02T09:30:45.843296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:45.850661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:45.850680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:45.850682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:45.850684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:45.850692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.850696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.850700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554487960768342:6476]
2025-10-02T09:30:45.850725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:45.850731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.850736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:45.850740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:45.850742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:45.850744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:45.850873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:45.854963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId: src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:45.857028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:45.916704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554488036293394:7261]
2025-10-02T09:30:45.916937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 863, pipe: [1:7556554488036293394:7261]
2025-10-02T09:30:45.978237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:45.978455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:45.978465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:45.978493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293394:7261], now have 1 active actors on pipe
2025-10-02T09:30:45.978636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:45.978694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:45.978708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:45.978725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554488036293394:7261]
2025-10-02T09:30:45.978743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:45.978756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 864 reason: error at write: Disconnected sessionId: src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0
2025-10-02T09:30:45.978910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 864 sessionId: src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0 is DEAD
2025-10-02T09:30:45.979038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:45.979046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Write session will restart in 0.005651s
2025-10-02T09:30:45.979064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Write session: Do CDS request
2025-10-02T09:30:45.979068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:45.986338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.986427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:45.986439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 865
2025-10-02T09:30:45.986534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:45.986562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:45.986570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:45.986573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:45.986964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 865 sessionId:  describe result for acl check
2025-10-02T09:30:45.986994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:45.986999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:45.987000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:45.987004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554488036293541:7618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:45.987440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554488036293541:7618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:45.988431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:45.989388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554488036293541:7618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:45.989925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:45.990066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:45.990074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:45.990081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:45.990118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:45.990145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554487960768578:6491]
2025-10-02T09:30:45.990518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:45.990666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:45.990690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:45.990867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:45.990897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.990901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.990901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.990902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.990903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.990903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.990904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.990904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.990905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.990906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.990906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.990907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.990909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.990915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.990917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.990919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.990921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.990923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.990925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.990927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.990929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.990931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.990933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.990935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.990939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.990943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:45.990948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.990959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:45.990963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.990967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:45.990970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.990974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:45.990978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.990981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:45.990984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.990989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:45.990992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.990996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:45.991000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.991004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:45.991007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.991011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:45.991019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.991023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:45.991031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.991035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:45.991042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.991046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:45.991079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:45.991409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554488036293541:7618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:45.991418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554488036293541:7618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:45.991421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554488036293541:7618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:45.991426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:45.999011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:46.000410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:46.000422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:46.000423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:46.000425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:46.000429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 864 [2:7556554487960768578:6491]
2025-10-02T09:30:46.000439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:46.000451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:46.000453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.000454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.000456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.000465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:46.000469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:46.000473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:46.000504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.000510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.000511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.000514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:46.000515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:46.000555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:46.000561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.000567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.000572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.000582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:46.000598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293606:7618], now have 1 active actors on pipe
2025-10-02T09:30:46.000604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554488036293413:2446], now have 1 active actors on pipe
2025-10-02T09:30:46.000608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.000609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.000611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.000620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:46.000634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:46.000636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:46.000641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:46.000642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:46.000648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:46.000650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:46.000672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.000679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:46.000680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:46.000658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 864
2025-10-02T09:30:46.000665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 864
2025-10-02T09:30:46.000692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.000699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.000935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcfce4a-643d636-511c34e-231003fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:46.000945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.000948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.000949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:46.000954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.000960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:46.000975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.001106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.001111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.001119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.001172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 865 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcfce4a-643d636-511c34e-231003fc_0
2025-10-02T09:30:46.001466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4e037a-19bd2361-5c011b0b-65e386be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcfce4a-643d636-511c34e-231003fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:46.003778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Write session: try to update token
2025-10-02T09:30:46.003789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:46.010677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:46.010693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.010695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:46.010696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:46.010702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.010705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.010707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554487960768573:6491]
2025-10-02T09:30:46.010731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:46.010733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:46.010735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.010737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:46.010737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:46.010740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:46.010866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:46.015146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId: src_id|fcfce4a-643d636-511c34e-231003fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:46.017182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:46.079023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554492331260910:7261]
2025-10-02T09:30:46.079266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 864, pipe: [1:7556554492331260910:7261]
2025-10-02T09:30:46.137451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:46.137668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.137679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.137707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331260910:7261], now have 1 active actors on pipe
2025-10-02T09:30:46.137868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:46.137893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:46.137906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:46.137953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 865 reason: error at write: Disconnected sessionId: src_id|fcfce4a-643d636-511c34e-231003fc_0
2025-10-02T09:30:46.138084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 865 sessionId: src_id|fcfce4a-643d636-511c34e-231003fc_0 is DEAD
2025-10-02T09:30:46.138208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:46.138235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554492331260910:7261]
2025-10-02T09:30:46.138264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:46.138281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Write session will restart in 0.005031s
2025-10-02T09:30:46.138311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Write session: Do CDS request
2025-10-02T09:30:46.138319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:46.144196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.144285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:46.144295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 866
2025-10-02T09:30:46.144402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.144424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:46.144430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:46.144433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:46.144824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 866 sessionId:  describe result for acl check
2025-10-02T09:30:46.144849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:46.144855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:46.144856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:46.144861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554492331260935:7622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:46.145222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554492331260935:7622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:46.147141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554492331260935:7622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:46.149184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554492331260935:7622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:46.149195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554492331260935:7622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:46.149198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554492331260935:7622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:46.149203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:46.149778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:46.151602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:46.151720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:46.151727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:46.151734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:46.151764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:46.151800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554492255736070:6493]
2025-10-02T09:30:46.152311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:46.152549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:46.152576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:46.152784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:46.152843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.152849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.152850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.152850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.152851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.152852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.152853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.152854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.152855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.152855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.152856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.152857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.152862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.152871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.152875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.152879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.152882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.152886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.152888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.152890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.152892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.152894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.152896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.152898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.152903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.152908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.152912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.152916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.152920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.152924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.152928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.152933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.152938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.152943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.152951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.152955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.152960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.152968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.152972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.152977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.152985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.152990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.152997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.153002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.153006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.153011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.153019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.153022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.153041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:46.161367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:46.163156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:46.163171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:46.163173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:46.163176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:46.163181Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 865 [2:7556554492255736070:6493]
2025-10-02T09:30:46.163193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:46.163208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:46.163214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.163217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.163219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.163232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:46.163240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:46.163246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:46.163295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.163300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.163302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.163305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:46.163307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:46.163360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:46.163366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.163373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.163383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.163395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:46.163412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331260912:2446], now have 1 active actors on pipe
2025-10-02T09:30:46.163421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.163427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.163429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.163443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:46.163460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261099:7622], now have 1 active actors on pipe
2025-10-02T09:30:46.163467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:46.163479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:46.163486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:46.163486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:46.163466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 865
2025-10-02T09:30:46.163490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:46.163492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:46.163508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.163478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 865
2025-10-02T09:30:46.163510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:46.163515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:46.163534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.163540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.163556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:46.163563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.163567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.163568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:46.163574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.163581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:46.163591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.163723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.163730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.163741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.163818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 866 partition: 0 MaxSeqNo: 36 sessionId: src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0
2025-10-02T09:30:46.164080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfce4a-643d636-511c34e-231003fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:46.166637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Write session: try to update token
2025-10-02T09:30:46.166650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:46.173416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:46.173431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.173439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.173469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:46.173471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:46.173626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:46.173770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:46.173910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:46.174042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:46.174223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:46.174260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:46.178589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId: src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:46.180743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:46.180923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.180942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.180971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:46.181027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:46.182668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:46.182684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.182687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:46.182688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:46.182696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.182700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.182703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554492255736065:6493]
2025-10-02T09:30:46.182734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:46.182737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:46.182742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:46.182745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.182746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:46.182747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:46.182883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:46.238240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554492331261116:7261]
2025-10-02T09:30:46.238460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 865, pipe: [1:7556554492331261116:7261]
2025-10-02T09:30:46.305893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:46.312003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.312024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.312160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.312211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.312265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.312316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.312355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.312362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.312418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.312469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.312523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.312581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.312620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.312626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.312683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.312735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.312789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.312853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.312890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.312896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.312950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.313002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.313054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.313138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.313176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.313181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.313235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.313287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.313367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.313421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.313459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.313465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.313519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.313570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.313623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.313678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.313727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.313734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.313785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.313835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.313887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.313937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.313974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.313979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.314032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.314084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.314136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.314185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.314224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.314229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.314278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.314328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.314379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.314426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.314465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.314470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.314521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.314567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.314616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.314665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.314701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.314707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.314738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261116:7261], now have 1 active actors on pipe
2025-10-02T09:30:46.314926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554492331261116:7261]
2025-10-02T09:30:46.314945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:46.314955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:46.314957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:46.314984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 866 reason: error at write: Disconnected sessionId: src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0
2025-10-02T09:30:46.315137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 866 sessionId: src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0 is DEAD
2025-10-02T09:30:46.315254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:46.315263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Write session will restart in 0.005140s
2025-10-02T09:30:46.315283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Write session: Do CDS request
2025-10-02T09:30:46.315287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:46.315406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:46.321158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.321240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:46.321250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 867
2025-10-02T09:30:46.321330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.321350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:46.321356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:46.321359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:46.321623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 867 sessionId:  describe result for acl check
2025-10-02T09:30:46.321642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:46.321647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:46.321649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:46.321652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554492331261136:7627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:46.321990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554492331261136:7627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:46.324606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554492331261136:7627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:46.326273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:46.328086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:46.328208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:46.328216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:46.328222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:46.328221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554492331261136:7627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:46.328231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554492331261136:7627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:46.328234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554492331261136:7627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:46.328238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:46.328251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:46.328275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554492255736266:6496]
2025-10-02T09:30:46.328627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:46.328831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:46.328859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:46.329038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:46.329066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.329070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.329071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.329071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.329072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.329072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.329073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.329073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.329074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.329075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.329075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.329076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.329079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.329085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.329087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.329089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.329091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.329093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.329095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.329097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.329099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.329101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.329103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.329105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.329109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.329113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.329117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.329120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.329122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.329124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.329126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.329129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.329131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.329134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.329136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.329138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.329141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.329143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.329145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.329148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.329150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.329152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.329154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.329157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.329159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.329162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.329164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.329166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.329184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:46.336778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:46.338199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:46.338212Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:46.338213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:46.338215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:46.338219Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 866 [2:7556554492255736266:6496]
2025-10-02T09:30:46.338227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:46.338237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:46.338243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.338244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.338245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.338257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:46.338260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:46.338267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:46.338302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.338307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.338308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.338310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:46.338312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:46.338351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:46.338356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.338362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.338368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.338380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:46.338396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261118:2446], now have 1 active actors on pipe
2025-10-02T09:30:46.338401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261309:7627], now have 1 active actors on pipe
2025-10-02T09:30:46.338405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.338408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.338409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.338417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:46.338428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:46.338432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:46.338434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:46.338435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:46.338439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:46.338440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:46.338456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.338461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:46.338471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:46.338456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 866
2025-10-02T09:30:46.338466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 866
2025-10-02T09:30:46.338484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.338489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.338505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:46.338511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.338513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.338515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:46.338520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.338529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:46.338539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.338639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.338645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.338654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.338703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 867 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0
2025-10-02T09:30:46.338970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8684a069-dee050aa-da4baf1e-fea72ad2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:46.341160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Write session: try to update token
2025-10-02T09:30:46.341171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:46.348175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:46.348188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.348190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:46.348191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:46.348196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.348199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.348201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554492255736260:6496]
2025-10-02T09:30:46.348223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:46.348227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.348229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:46.348241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:46.348251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:46.348254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:46.348342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:46.351851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId: src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:46.353954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:46.414910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554492331261321:7261]
2025-10-02T09:30:46.415157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 866, pipe: [1:7556554492331261321:7261]
2025-10-02T09:30:46.474783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:46.475094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.475105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.475134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261321:7261], now have 1 active actors on pipe
2025-10-02T09:30:46.475381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554492331261321:7261]
2025-10-02T09:30:46.475390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:46.475405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:46.475341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:46.475457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0
2025-10-02T09:30:46.475587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 867 sessionId: src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0 is DEAD
2025-10-02T09:30:46.475714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:46.475722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Write session will restart in 0.009586s
2025-10-02T09:30:46.475744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Write session: Do CDS request
2025-10-02T09:30:46.475750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:46.485850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:46.486185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.486249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:46.486260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 868
2025-10-02T09:30:46.486338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.486365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:46.486373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:46.486376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:46.486660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 868 sessionId:  describe result for acl check
2025-10-02T09:30:46.486684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:46.486689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:46.486690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:46.486695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554492331261479:7631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:46.487057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554492331261479:7631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:46.487473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:46.487621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:46.487631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:46.487640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:46.487690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:46.487724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554492255736463:6498]
2025-10-02T09:30:46.488256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:46.488506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:46.488546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:46.488564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554492331261479:7631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:46.488858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:46.488918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.488924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.488925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.488927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.488927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.488928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.488929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.488930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.488931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.488932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.488933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.488934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.488939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.488949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.488953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.488957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.488961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.488965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.488969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.488972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.488976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.488980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.488983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.488987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.488992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.488999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.489004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.489009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.489018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.489027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.489033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.489038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.489042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.489052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.489060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.489070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.489077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.489083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.489091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.489100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.489107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.489111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.489120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.489128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.489132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.489140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.489148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.489152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.489190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:46.493498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554492331261479:7631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:46.493510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554492331261479:7631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:46.493512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554492331261479:7631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:46.493528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:46.497403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:46.498988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:46.499003Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:46.499005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:46.499009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:46.499014Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 867 [2:7556554492255736463:6498]
2025-10-02T09:30:46.499027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:46.499041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:46.499043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.499046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.499048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.499062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:46.499072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:46.499078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:46.499128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.499135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.499137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.499140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:46.499143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:46.499200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:46.499207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.499219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.499233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.499252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:46.499272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261518:7631], now have 1 active actors on pipe
2025-10-02T09:30:46.499279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261322:2446], now have 1 active actors on pipe
2025-10-02T09:30:46.499285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.499286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.499288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.499300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:46.499291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 867
2025-10-02T09:30:46.499314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:46.499315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:46.499294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 867
2025-10-02T09:30:46.499322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:46.499325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:46.499328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:46.499330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:46.499354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.499369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:46.499371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:46.499382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.499385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.499425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:46.499436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.499440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.499441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:46.499450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.499462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:46.499480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.499586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.499600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.499616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.499687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 868 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0
2025-10-02T09:30:46.499970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca5ad4a-d4663d22-de45fd17-b2e53dd1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:46.502235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Write session: try to update token
2025-10-02T09:30:46.502246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:46.509606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:46.509621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.509623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:46.509625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:46.509631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.509634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.509636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554492255736457:6498]
2025-10-02T09:30:46.509662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:46.509666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.509668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:46.509674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:46.509680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:46.509684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:46.509795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:46.514120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId: src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:46.516350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:46.575668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554492331261529:7261]
2025-10-02T09:30:46.575897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 867, pipe: [1:7556554492331261529:7261]
2025-10-02T09:30:46.635075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:46.635539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.635549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.635575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261529:7261], now have 1 active actors on pipe
2025-10-02T09:30:46.635778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:46.635804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554492331261529:7261]
2025-10-02T09:30:46.635816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:46.635818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:46.635861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 868 reason: error at write: Disconnected sessionId: src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0
2025-10-02T09:30:46.635906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:46.636030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 868 sessionId: src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0 is DEAD
2025-10-02T09:30:46.636170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:46.636179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Write session will restart in 0.007497s
2025-10-02T09:30:46.636199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Write session: Do CDS request
2025-10-02T09:30:46.636205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:46.645203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.645298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:46.645311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 869
2025-10-02T09:30:46.645412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.645434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:46.645440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:46.645443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:46.645795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 869 sessionId:  describe result for acl check
2025-10-02T09:30:46.645825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:46.645830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:46.645831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:46.645834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554492331261697:7638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:46.646223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554492331261697:7638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:46.646561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:46.647683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554492331261697:7638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:46.648533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:46.648695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:46.648706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:46.648715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:46.648757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:46.648788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554492255736672:6501]
2025-10-02T09:30:46.649325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554492331261697:7638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:46.649336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554492331261697:7638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:46.649339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554492331261697:7638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:46.649344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:46.649360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:46.649591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:46.649630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:46.649899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:46.649949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.649954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.649955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.649956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.649957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.649958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.649959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.649960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.649961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.649961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.649962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.649963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.649967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.649978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.649982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.649987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.649990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.649994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.649997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.650000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.650004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.650008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.650011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.650014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.650019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.650025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.650030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.650035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.650039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.650043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.650047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.650052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.650056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.650062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.650065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.650070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.650074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.650079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.650083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.650087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.650092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.650096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.650100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.650110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.650115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.650120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.650123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.650128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.650163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:46.658204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:46.659812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:46.659828Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:46.659830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:46.659834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:46.659839Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 868 [2:7556554492255736672:6501]
2025-10-02T09:30:46.659852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:46.659867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:46.659874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.659876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.659878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.659890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:46.659895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:46.659901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:46.659960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.659967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.659969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.659972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:46.659974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:46.660140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 868
2025-10-02T09:30:46.660142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 868
2025-10-02T09:30:46.660239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:46.660248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.660261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.660271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.660290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:46.660309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261530:2446], now have 1 active actors on pipe
2025-10-02T09:30:46.660317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261735:7638], now have 1 active actors on pipe
2025-10-02T09:30:46.660334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.660342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.660356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.660362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.660364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.660376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:46.660392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:46.660396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:46.660399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:46.660401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:46.660411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:46.660418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:46.660432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b465b922-40461da4-271619f3-307db147_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:46.660441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.660444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.660451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:46.660459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.660467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:46.660498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.660509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:46.660518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:46.660523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.660626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.660636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.660653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.660715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 869 partition: 0 MaxSeqNo: 36 sessionId: src_id|b465b922-40461da4-271619f3-307db147_0
2025-10-02T09:30:46.660994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc18e4c1-b7d18fe-8b3aec92-e945f00f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b465b922-40461da4-271619f3-307db147_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:46.663499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Write session: try to update token
2025-10-02T09:30:46.663512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:46.669715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:46.669732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.669737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.669765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:46.669773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:46.669901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:46.670017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:46.670136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:46.670251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:46.670415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:46.670448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:46.674482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId: src_id|b465b922-40461da4-271619f3-307db147_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:46.676585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:46.676774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.676793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.676837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:46.676919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:46.679166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:46.679180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.679182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:46.679184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:46.679191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.679195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.679199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554492255736666:6501]
2025-10-02T09:30:46.679231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:46.679241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.679243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:46.679245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:46.679250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:46.679254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:46.679369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:46.735910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554492331261747:7261]
2025-10-02T09:30:46.736173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 868, pipe: [1:7556554492331261747:7261]
2025-10-02T09:30:46.815245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:46.821671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.821690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.821823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.821876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.821929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.821987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.822027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.822034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.822090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.822144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.822197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.822257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.822295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.822300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.822354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.822408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.822464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.822518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.822557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.822562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.822614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.822668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.822721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.822777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.822815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.822820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.822878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.822932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.823002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.823059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.823099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.823104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.823161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.823246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.823300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.823353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.823529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.823534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.823587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.823639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.823696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.823750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.823789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.823793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.823850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.823903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.823954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.824011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.824049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.824054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.824107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.824161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.824215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.824268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.824318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.824325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.824378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:46.824430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:46.824484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:46.824537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:46.824575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:46.824580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:46.824612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261747:7261], now have 1 active actors on pipe
2025-10-02T09:30:46.824875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:46.824887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:46.824891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554492331261747:7261]
2025-10-02T09:30:46.824909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 869 reason: error at write: Disconnected sessionId: src_id|b465b922-40461da4-271619f3-307db147_0
2025-10-02T09:30:46.824913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:46.825060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 869 sessionId: src_id|b465b922-40461da4-271619f3-307db147_0 is DEAD
2025-10-02T09:30:46.825159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:46.825168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Write session will restart in 0.009376s
2025-10-02T09:30:46.825190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Write session: Do CDS request
2025-10-02T09:30:46.825194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:46.825242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:46.835230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.835348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:46.835361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 870
2025-10-02T09:30:46.835427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:46.835452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:46.835460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:46.835464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:46.835839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 870 sessionId:  describe result for acl check
2025-10-02T09:30:46.835873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:46.835879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:46.835881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:46.835886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554492331261910:7643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:46.836367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554492331261910:7643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:46.837138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:46.838389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554492331261910:7643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:46.838946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:46.839100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:46.839108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:46.839117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:46.839153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:46.839186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554492255736870:6503]
2025-10-02T09:30:46.839732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:46.840012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:46.840050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:46.840329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:46.840372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.840379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.840380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.840381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.840382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.840383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.840384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.840385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.840386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.840387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.840388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.840389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.840393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.840402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.840405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.840409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.840412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.840416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.840420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.840423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.840426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.840430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.840433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.840437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.840442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.840448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:46.840453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.840458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:46.840462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.840466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:46.840470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.840475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:46.840479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.840483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:46.840486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.840490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:46.840494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.840498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:46.840502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.840506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:46.840510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.840514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:46.840518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.840522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.840526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.840531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.840534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.840538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.840568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:46.840901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554492331261910:7643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:46.840911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554492331261910:7643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:46.840913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554492331261910:7643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:46.840918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:46.848720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:46.850541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:46.850558Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:46.850560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:46.850563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:46.850568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 869 [2:7556554492255736870:6503]
2025-10-02T09:30:46.850581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:46.850596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:46.850599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.850601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.850603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.850615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:46.850620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:46.850626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:46.850684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.850692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.850694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.850696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:46.850699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:46.850757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:46.850765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.850777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:46.850791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:46.850810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:46.850832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261952:7643], now have 1 active actors on pipe
2025-10-02T09:30:46.850839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261754:2446], now have 1 active actors on pipe
2025-10-02T09:30:46.850844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.850846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.850848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.850859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:46.850875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:46.850891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:46.850891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:46.850895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:46.850897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:46.850898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:46.850893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 869
2025-10-02T09:30:46.850925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.850932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:46.850934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:46.850968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.850977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.851003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92baac77-dad6d25a-a436381b-dd27ae57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:46.851013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:46.851013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 869
2025-10-02T09:30:46.851018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:46.851029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:46.851037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:46.851045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:46.851063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.851188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.851196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.851208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:46.851275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 870 partition: 0 MaxSeqNo: 36 sessionId: src_id|92baac77-dad6d25a-a436381b-dd27ae57_0
2025-10-02T09:30:46.851574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b465b922-40461da4-271619f3-307db147_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92baac77-dad6d25a-a436381b-dd27ae57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:46.854026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Write session: try to update token
2025-10-02T09:30:46.854039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:46.860939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:46.860955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:46.860957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:46.860959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:46.860966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.860971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.860975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554492255736865:6503]
2025-10-02T09:30:46.861010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:46.861013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:46.861016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:46.861018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:46.861018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:46.861022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:46.861145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:46.866215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId: src_id|92baac77-dad6d25a-a436381b-dd27ae57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:46.868666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:46.924855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554492331261963:7261]
2025-10-02T09:30:46.925099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 869, pipe: [1:7556554492331261963:7261]
2025-10-02T09:30:46.994702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:46.995054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:46.995065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:46.995078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261963:7261], now have 1 active actors on pipe
2025-10-02T09:30:46.995225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:46.995273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:46.995288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:46.995290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554492331261963:7261]
2025-10-02T09:30:46.995306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:46.995344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 870 reason: error at write: Disconnected sessionId: src_id|92baac77-dad6d25a-a436381b-dd27ae57_0
2025-10-02T09:30:46.995503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 870 sessionId: src_id|92baac77-dad6d25a-a436381b-dd27ae57_0 is DEAD
2025-10-02T09:30:46.995654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:46.995665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Write session will restart in 0.006739s
2025-10-02T09:30:46.995688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Write session: Do CDS request
2025-10-02T09:30:46.995695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.003200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.003296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.003317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 871
2025-10-02T09:30:47.003408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.003429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.003435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.003438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.003856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 871 sessionId:  describe result for acl check
2025-10-02T09:30:47.003885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.003890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.003891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.003894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626229392:7654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.004347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626229392:7654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.005716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.006257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626229392:7654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.007588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.007693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.007700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.007705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.007732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.007754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550704403:6518]
2025-10-02T09:30:47.008206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.008389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.008411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.008464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626229392:7654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.008473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626229392:7654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.008475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626229392:7654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.008479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.008586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.008614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.008618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.008618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.008619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.008619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.008620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.008620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.008621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.008621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.008622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.008622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.008623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.008626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.008632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.008634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.008636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.008638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.008640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.008642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.008644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.008646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.008648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.008650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.008652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.008657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.008660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.008664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.008666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.008668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.008671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.008673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.008676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.008678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.008680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.008683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.008686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.008688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.008690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.008692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.008695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.008697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.008699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.008701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.008704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.008706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.008710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.008712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.008714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.008731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.016372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.017823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.017835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.017836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.017839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.017843Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 870 [2:7556554496550704403:6518]
2025-10-02T09:30:47.017851Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.017862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.017864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.017865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.017867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.017877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.017880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.017884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.017918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.017923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.017924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.017927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.017928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.017980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.017988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.017998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.018008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.018016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.018032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229479:7654], now have 1 active actors on pipe
2025-10-02T09:30:47.018036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554492331261989:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.018040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.018042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.018043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.018051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.018060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.018067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.018069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.018070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.018071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.018073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.018091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.018097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.018101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.018099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 870
2025-10-02T09:30:47.018101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 870
2025-10-02T09:30:47.018129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.018134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.018150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.018157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.018159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.018160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.018167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.018173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.018182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.018267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.018272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.018280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.018344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 871 partition: 0 MaxSeqNo: 36 sessionId: src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0
2025-10-02T09:30:47.018615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92baac77-dad6d25a-a436381b-dd27ae57_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.020950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Write session: try to update token
2025-10-02T09:30:47.020962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.027427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:47.027444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.027452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.027486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:47.027487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:47.027636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:47.027778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:47.027924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:47.028056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:47.028241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:47.028279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:47.032688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId: src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:47.034878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:47.035043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.035059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.035082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:47.035240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:47.036350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.036363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.036365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.036367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.036373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.036376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.036378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550704397:6518]
2025-10-02T09:30:47.036405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.036411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.036412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.036416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.036423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.036426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.036521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.095321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554496626229489:7261]
2025-10-02T09:30:47.095579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 870, pipe: [1:7556554496626229489:7261]
2025-10-02T09:30:47.166696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:47.173080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.173103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.173231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.173281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.173336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.173389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.173427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.173433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.173488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.173538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.173591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.173658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.173703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.173713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.173771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.173820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.173872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.173927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.173965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.173971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.174023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.174075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.174127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.174180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.174219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.174224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.174281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.174335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.174400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.174454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.174494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.174498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.174582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.174639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.174694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.174771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.174814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.174818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.174874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.174925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.174987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.175042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.175080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.175085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.175140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.175190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.175244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.175296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.175375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.175381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.175445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.175493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.175545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.175598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.175634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.175639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.175694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:47.175744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:47.175795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:47.175846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:47.175883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:47.175888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:47.175922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229489:7261], now have 1 active actors on pipe
2025-10-02T09:30:47.176112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:47.176121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554496626229489:7261]
2025-10-02T09:30:47.176123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:47.176140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:47.176142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 871 reason: error at write: Disconnected sessionId: src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0
2025-10-02T09:30:47.176296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 871 sessionId: src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0 is DEAD
2025-10-02T09:30:47.176422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:47.176429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Write session will restart in 0.006981s
2025-10-02T09:30:47.176445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Write session: Do CDS request
2025-10-02T09:30:47.176448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.176504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:47.184190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.184286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.184302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 872
2025-10-02T09:30:47.184393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.184418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.184423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.184426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.184877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 872 sessionId:  describe result for acl check
2025-10-02T09:30:47.184905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.184909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.185062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.185068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626229588:7659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.185492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626229588:7659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.187105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.187287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626229588:7659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.188650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.188873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.188882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.188891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.188940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.188973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550704605:6521]
2025-10-02T09:30:47.189409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626229588:7659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.189419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626229588:7659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.189422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626229588:7659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.189426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.189512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.189676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.189709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.189979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.190022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.190027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.190028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.190029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.190030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.190031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.190032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.190033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.190034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.190035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.190036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.190037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.190041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.190050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.190054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.190057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.190061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.190065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.190068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.190072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.190075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.190083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.190087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.190090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.190099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.190109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.190118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.190126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.190134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.190139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.190147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.190151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.190155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.190160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.190168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.190173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.190181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.190189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.190197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.190201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.190209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.190217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.190224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.190229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.190233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.190238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.190243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.190252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.190287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.197906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.199431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.199446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.199448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.199451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.199456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 871 [2:7556554496550704605:6521]
2025-10-02T09:30:47.199469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.199488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.199494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.199497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.199499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.199511Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.199521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.199527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.199575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.199582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.199584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.199586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.199589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.199645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.199651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.199662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.199676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.199695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.199716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229493:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.199723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229689:7659], now have 1 active actors on pipe
2025-10-02T09:30:47.199729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.199734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.199712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 871
2025-10-02T09:30:47.199736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.199716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 871
2025-10-02T09:30:47.199743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.199751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.199755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.199758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.199759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.199767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.199774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.199791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.199798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.199823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.199834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.199842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.199852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.199860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.199867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.199869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.199880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.199892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.199921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.200038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.200046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.200058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.200144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 872 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0
2025-10-02T09:30:47.200396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afef900-c8fb5d9c-1a7968aa-72f330ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.202621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Write session: try to update token
2025-10-02T09:30:47.202632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.209657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.209672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.209674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.209675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.209683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.209687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.209691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550704599:6521]
2025-10-02T09:30:47.209721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.209723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.209728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.209731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.209731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.209734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.209861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.213731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId: src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:47.215862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:47.276075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554496626229701:7261]
2025-10-02T09:30:47.276310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 871, pipe: [1:7556554496626229701:7261]
2025-10-02T09:30:47.342302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:47.342726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.342736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.342763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229701:7261], now have 1 active actors on pipe
2025-10-02T09:30:47.342897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:47.342995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554496626229701:7261]
2025-10-02T09:30:47.343020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:47.343019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:47.343078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 872 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0
2025-10-02T09:30:47.343213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 872 sessionId: src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0 is DEAD
2025-10-02T09:30:47.343339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:47.343349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Write session will restart in 0.006726s
2025-10-02T09:30:47.343366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Write session: Do CDS request
2025-10-02T09:30:47.343371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.351186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.351258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.351270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 873
2025-10-02T09:30:47.351380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.351406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.351415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.351417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.351812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 873 sessionId:  describe result for acl check
2025-10-02T09:30:47.351834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.351836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.351838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.351842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626229791:7663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.352244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626229791:7663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.353886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626229791:7663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.354147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.355813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.355878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626229791:7663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.355885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626229791:7663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.355887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626229791:7663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.355891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.355927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.355934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.355939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.355967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.355993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550704806:6523]
2025-10-02T09:30:47.356337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.356498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.356521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.356702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.356731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.356735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.356736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.356737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.356737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.356738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.356738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.356739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.356739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.356740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.356740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.356741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.356744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.356750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.356752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.356754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.356756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.356758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.356760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.356762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.356764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.356766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.356768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.356770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.356774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.356778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.356781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.356784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.356786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.356788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.356790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.356793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.356795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.356798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.356815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.356818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.356820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.356823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.356825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.356831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.356836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.356839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.356842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.356844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.356847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.356853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.356855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.356857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.356873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.366609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.367988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.368001Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.368003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.368005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.368008Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 872 [2:7556554496550704806:6523]
2025-10-02T09:30:47.368015Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.368026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.368031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.368033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.368034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.368044Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.368051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.368055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.368089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.368093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.368094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.368096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.368098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.368137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.368142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.368149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.368154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.368166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.368180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229702:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.368186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229901:7663], now have 1 active actors on pipe
2025-10-02T09:30:47.368190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.368191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.368193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.368201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.368211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.368218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.368222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.368224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.368226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.368227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.368213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 872
2025-10-02T09:30:47.368239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.368244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.368216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 872
2025-10-02T09:30:47.368246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.368260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.368266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.368284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.368290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.368292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.368293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.368298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.368304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.368316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.368435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.368440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.368448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.368509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 873 partition: 0 MaxSeqNo: 36 sessionId: src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0
2025-10-02T09:30:47.368759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7371b5-1ac69244-c37ffcf4-f7defff7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.370984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Write session: try to update token
2025-10-02T09:30:47.370995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.380476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.380494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.380495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.380496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.380505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.380508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.380510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550704800:6523]
2025-10-02T09:30:47.380535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.380539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.380540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.380542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.380545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.380547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.380656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.381373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId: src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:47.383364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:47.442983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554496626229912:7261]
2025-10-02T09:30:47.443180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 872, pipe: [1:7556554496626229912:7261]
2025-10-02T09:30:47.495652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:47.496141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.496154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.496195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229912:7261], now have 1 active actors on pipe
2025-10-02T09:30:47.496335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:47.496391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:47.496397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554496626229912:7261]
2025-10-02T09:30:47.496417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:47.496566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0
2025-10-02T09:30:47.496731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 873 sessionId: src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0 is DEAD
2025-10-02T09:30:47.496888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:47.496897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Write session will restart in 0.005796s
2025-10-02T09:30:47.496914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Write session: Do CDS request
2025-10-02T09:30:47.496918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.504179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.504222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.504232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 874
2025-10-02T09:30:47.504333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.504356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.504363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.504366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.504626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 874 sessionId:  describe result for acl check
2025-10-02T09:30:47.504651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.504656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.504657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.504660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626230031:7667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.505016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626230031:7667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.506256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626230031:7667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.506304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.507868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.508000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.508008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.508016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.508038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626230031:7667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.508047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626230031:7667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.508053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.508048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626230031:7667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.508052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.508085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550705007:6525]
2025-10-02T09:30:47.508620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.508823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.508859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.509136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.509183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.509188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.509189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.509190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.509191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.509192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.509193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.509194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.509194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.509195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.509196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.509197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.509201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.509211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.509214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.509218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.509221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.509225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.509228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.509231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.509235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.509238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.509242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.509245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.509250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.509257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.509262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.509267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.509271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.509275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.509279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.509283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.509287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.509292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.509295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.509300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.509308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.509313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.509317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.509321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.509325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.509330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.509335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.509340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.509344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.509353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.509358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.509363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.509394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.518698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.520176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.520191Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.520194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.520197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.520202Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 873 [2:7556554496550705007:6525]
2025-10-02T09:30:47.520213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.520227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.520230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.520232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.520234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.520245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.520249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.520255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.520299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.520306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.520308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.520311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.520314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.520366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.520373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.520383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.520394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.520411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.520431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626229913:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.520438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230111:7667], now have 1 active actors on pipe
2025-10-02T09:30:47.520443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.520445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.520447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.520425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 873
2025-10-02T09:30:47.520454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.520448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 873
2025-10-02T09:30:47.520460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.520464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.520466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.520467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.520477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.520480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.520510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.520519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.520528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.520539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.520552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.520567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.520576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.520579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.520581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.520587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.520595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.520616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.520710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.520717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.520728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.520777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 874 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0
2025-10-02T09:30:47.521062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32cb39e-f59750a3-7f142e4-6ce99859_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.523274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Write session: try to update token
2025-10-02T09:30:47.523286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.532124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.532139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.532140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.532141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.532147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.532150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.532153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550705002:6525]
2025-10-02T09:30:47.532179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.532180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.532183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.532185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.532184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.532187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.532297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.534158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId: src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:47.536168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:47.596582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554496626230123:7261]
2025-10-02T09:30:47.596749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 873, pipe: [1:7556554496626230123:7261]
2025-10-02T09:30:47.652344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:47.652776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.652786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.652821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230123:7261], now have 1 active actors on pipe
2025-10-02T09:30:47.652970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:47.653004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:47.653019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554496626230123:7261]
2025-10-02T09:30:47.653034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:47.653085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 874 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0
2025-10-02T09:30:47.653225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 874 sessionId: src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0 is DEAD
2025-10-02T09:30:47.653417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:47.653433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Write session will restart in 0.007277s
2025-10-02T09:30:47.653456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Write session: Do CDS request
2025-10-02T09:30:47.653462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.662186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.662257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.662268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 875
2025-10-02T09:30:47.662355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.662376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.662382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.662386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.662660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 875 sessionId:  describe result for acl check
2025-10-02T09:30:47.662685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.662690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.662691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.662694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626230299:7672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.662765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.663035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626230299:7672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.664311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.664420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.664427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.664433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.664462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.664486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550705222:6528]
2025-10-02T09:30:47.664612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626230299:7672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.664861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.665014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.665037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.665227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.665257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.665262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.665262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.665263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.665263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.665264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.665265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.665266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.665266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.665267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.665267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.665268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.665271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.665277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.665279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.665281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.665283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.665285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.665288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.665290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.665292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.665294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.665296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.665298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.665302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.665306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.665309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.665312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.665314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.665317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.665321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.665324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.665328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.665330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.665333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.665335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.665338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.665340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.665342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.665345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.665348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.665350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.665352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.665355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.665357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.665360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.665362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.665365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.665385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.670493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626230299:7672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.670503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626230299:7672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.670505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626230299:7672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.670509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.675245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.676799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.676823Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.676825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.676827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.676830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 874 [2:7556554496550705222:6528]
2025-10-02T09:30:47.676837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.676847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.676848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.676850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.676851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.676861Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.676864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.676869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.676901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.676902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.676903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.676905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.676907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.676947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.676953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.676959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.676964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.676973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.676985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230136:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.676987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230339:7672], now have 1 active actors on pipe
2025-10-02T09:30:47.676990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.676995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.676996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.677004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.677011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.677015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.677019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.677020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.677023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.677024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.677036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.677037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.677030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 874
2025-10-02T09:30:47.677047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 874
2025-10-02T09:30:47.677050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.677056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.677058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.677076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d97838a9-178768b3-d111290b-e6958c47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.677084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.677087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.677088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.677094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.677099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.677106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.677188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.677193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.677201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.677252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 875 partition: 0 MaxSeqNo: 36 sessionId: src_id|d97838a9-178768b3-d111290b-e6958c47_0
2025-10-02T09:30:47.677537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c979ff5-ed75af7f-1dbedd24-f1b8d000_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d97838a9-178768b3-d111290b-e6958c47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.680231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Write session: try to update token
2025-10-02T09:30:47.680244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.688942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.688953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.688955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.688956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.688960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.688962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.688964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550705217:6528]
2025-10-02T09:30:47.688985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.688988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.688987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.688989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.688990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.688992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.689099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.692432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId: src_id|d97838a9-178768b3-d111290b-e6958c47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:47.694534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:47.753253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554496626230347:7261]
2025-10-02T09:30:47.753470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 874, pipe: [1:7556554496626230347:7261]
2025-10-02T09:30:47.810091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:47.810419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.810429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.810455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230347:7261], now have 1 active actors on pipe
2025-10-02T09:30:47.810585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:47.810630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:47.810643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:47.810643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:47.810674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554496626230347:7261]
2025-10-02T09:30:47.810684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 875 reason: error at write: Disconnected sessionId: src_id|d97838a9-178768b3-d111290b-e6958c47_0
2025-10-02T09:30:47.810820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 875 sessionId: src_id|d97838a9-178768b3-d111290b-e6958c47_0 is DEAD
2025-10-02T09:30:47.810999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:47.811012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Write session will restart in 0.007965s
2025-10-02T09:30:47.811043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Write session: Do CDS request
2025-10-02T09:30:47.811048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.820173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.820214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.820225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 876
2025-10-02T09:30:47.820323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.820343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.820349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.820351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.820626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 876 sessionId:  describe result for acl check
2025-10-02T09:30:47.820657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.820664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.820665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.820669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626230517:7677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.820860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.821063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626230517:7677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.822303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626230517:7677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.822352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.822491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.822500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.822509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.822552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.822586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550705427:6530]
2025-10-02T09:30:47.823144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.823348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.823385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.823662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.823704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.823709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.823710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.823711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.823712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.823713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.823713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.823714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.823715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.823716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.823717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.823717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.823722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.823731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.823734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.823738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.823741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.823745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.823748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.823751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.823755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.823759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.823762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.823765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.823771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.823777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.823782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.823787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.823791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.823795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.823798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.823803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.823807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.823811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.823815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.823820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.823824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.823831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.823834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.823841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.823845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.823850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.823854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.823858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.823864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.823869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.823874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.823878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.823911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.824225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626230517:7677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.824233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626230517:7677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.824235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626230517:7677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.824238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.833512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.834984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.834996Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.834998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.835002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.835006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 875 [2:7556554496550705427:6530]
2025-10-02T09:30:47.835017Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.835034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.835041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.835043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.835045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.835057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.835066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.835071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.835114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.835120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.835122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.835125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.835128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.835179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.835190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.835201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.835212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.835227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.835247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230353:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.835254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230557:7677], now have 1 active actors on pipe
2025-10-02T09:30:47.835236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 875
2025-10-02T09:30:47.835259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.835261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.835249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 875
2025-10-02T09:30:47.835262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.835273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.835283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.835283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.835286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.835287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.835297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.835299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.835319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.835326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.835327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.835347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.835354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.835378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db744e7f-84dabe61-5771761c-38970249_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.835388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.835391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.835397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.835404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.835415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.835435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.835535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.835544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.835554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.835613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 876 partition: 0 MaxSeqNo: 36 sessionId: src_id|db744e7f-84dabe61-5771761c-38970249_0
2025-10-02T09:30:47.835827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97838a9-178768b3-d111290b-e6958c47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db744e7f-84dabe61-5771761c-38970249_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.838219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Write session: try to update token
2025-10-02T09:30:47.838230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.847520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.847537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.847539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.847541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.847549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.847553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.847557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550705421:6530]
2025-10-02T09:30:47.847589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.847592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.847598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.847598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.847600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.847601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.847731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.848446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId: src_id|db744e7f-84dabe61-5771761c-38970249_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:47.850552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:47.910966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554496626230568:7261]
2025-10-02T09:30:47.911193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 875, pipe: [1:7556554496626230568:7261]
2025-10-02T09:30:47.961017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:47.961219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.961228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.961253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230568:7261], now have 1 active actors on pipe
2025-10-02T09:30:47.961397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:47.961406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:47.961407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:47.961410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:47.961456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 876 reason: error at write: Disconnected sessionId: src_id|db744e7f-84dabe61-5771761c-38970249_0
2025-10-02T09:30:47.961505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554496626230568:7261]
2025-10-02T09:30:47.961593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 876 sessionId: src_id|db744e7f-84dabe61-5771761c-38970249_0 is DEAD
2025-10-02T09:30:47.961731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:47.961740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Write session will restart in 0.005869s
2025-10-02T09:30:47.961755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Write session: Do CDS request
2025-10-02T09:30:47.961759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:47.968146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.968211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:47.968220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 877
2025-10-02T09:30:47.968284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:47.968302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:47.968307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:47.968310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:47.968568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 877 sessionId:  describe result for acl check
2025-10-02T09:30:47.968593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:47.968597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:47.968598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:47.968602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554496626230657:7681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:47.968957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554496626230657:7681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:47.970343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554496626230657:7681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:47.971095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:47.972558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:47.972686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:47.972695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:47.972703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:47.972720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554496626230657:7681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:47.972729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554496626230657:7681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:47.972730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554496626230657:7681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:47.972734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:47.972746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:47.972775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554496550705632:6533]
2025-10-02T09:30:47.973323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:47.973513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:47.973550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:47.973827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:47.973871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.973878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.973879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.973880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.973881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.973882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.973883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.973884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.973885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.973886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.973887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.973888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.973892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.973901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.973905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.973909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.973912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.973916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.973919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.973922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.973926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.973929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.973933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.973937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.973942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.973948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:47.973956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.973961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:47.973966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.973971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:47.973976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.973981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:47.973986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.973995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:47.973999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.974012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:47.974020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.974025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:47.974030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.974034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:47.974039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.974044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:47.974049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.974053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.974058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.974064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.974068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.974074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.974104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:47.983187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:47.984594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:47.984606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:47.984607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:47.984609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:47.984613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 876 [2:7556554496550705632:6533]
2025-10-02T09:30:47.984619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:47.984630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:47.984635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.984636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.984637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.984646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:47.984649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:47.984654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:47.984685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.984689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.984691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.984692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:47.984693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:47.984729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:47.984735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.984742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:47.984748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:47.984756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:47.984768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230572:2446], now have 1 active actors on pipe
2025-10-02T09:30:47.984773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554496626230769:7681], now have 1 active actors on pipe
2025-10-02T09:30:47.984777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.984778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.984779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.984785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:47.984796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:47.984810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:47.984812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:47.984813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:47.984822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:47.984827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:47.984841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.984849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:47.984865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:47.984846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 876
2025-10-02T09:30:47.984880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 876
2025-10-02T09:30:47.984909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.984918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.984931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:47.984938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:47.984942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:47.984946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:47.984952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:47.984961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:47.984971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.985085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:47.985091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:47.985098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:47.985160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 877 partition: 0 MaxSeqNo: 36 sessionId: src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0
2025-10-02T09:30:47.985394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db744e7f-84dabe61-5771761c-38970249_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:47.987556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Write session: try to update token
2025-10-02T09:30:47.987567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:47.994597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:47.994610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:47.994612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:47.994613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:47.994617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.994619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.994621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554496550705627:6533]
2025-10-02T09:30:47.994644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:47.994647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:47.994648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:47.994650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:47.994650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:47.994651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:47.994760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:47.998017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId: src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.000151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.061470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921198100:7261]
2025-10-02T09:30:48.061643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 876, pipe: [1:7556554500921198100:7261]
2025-10-02T09:30:48.110083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:48.110367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.110378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.110406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198100:7261], now have 1 active actors on pipe
2025-10-02T09:30:48.110567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:48.110575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921198100:7261]
2025-10-02T09:30:48.110596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:48.110598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:48.110611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:48.110650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 877 reason: error at write: Disconnected sessionId: src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0
2025-10-02T09:30:48.110816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 877 sessionId: src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0 is DEAD
2025-10-02T09:30:48.110955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:48.110961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Write session will restart in 0.007685s
2025-10-02T09:30:48.110980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Write session: Do CDS request
2025-10-02T09:30:48.110984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:48.119199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.119289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:48.119300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 878
2025-10-02T09:30:48.119393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.119414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:48.119420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:48.119422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:48.119699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 878 sessionId:  describe result for acl check
2025-10-02T09:30:48.119723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:48.119728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:48.119729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:48.119732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554500921198214:7692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:48.120065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554500921198214:7692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:48.121508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:48.121861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554500921198214:7692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:48.122999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:48.123097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:48.123104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:48.123109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:48.123134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:48.123157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554500845673170:6547]
2025-10-02T09:30:48.123494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:48.123663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:48.123687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:48.123775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554500921198214:7692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:48.123784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554500921198214:7692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:48.123786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554500921198214:7692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:48.123789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:48.123928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:48.123981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.123987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.123988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.123989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.123990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.123991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.123991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.123992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.123993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.123993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.123994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.123995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.123999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.124007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.124011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.124014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.124017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.124020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.124023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.124026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.124029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.124032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.124035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.124038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.124043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.124053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.124061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.124069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.124076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.124081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.124088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.124097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.124104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.124108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.124115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.124119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.124126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.124130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.124137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.124141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.124149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.124157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.124165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.124170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.124177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.124182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.124189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.124197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.124233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:48.132591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:48.134064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:48.134074Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:48.134075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:48.134077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:48.134080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 877 [2:7556554500845673170:6547]
2025-10-02T09:30:48.134087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:48.134097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:48.134099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.134100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.134101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.134110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:48.134113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:48.134117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:48.134149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.134154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.134155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.134157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:48.134159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:48.134198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:48.134203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.134209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.134215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.134227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:48.134241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198101:2446], now have 1 active actors on pipe
2025-10-02T09:30:48.134246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198306:7692], now have 1 active actors on pipe
2025-10-02T09:30:48.134250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.134251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.134252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.134259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:48.134270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:48.134271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:48.134273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:48.134265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 877
2025-10-02T09:30:48.134276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:48.134281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:48.134283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:48.134269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 877
2025-10-02T09:30:48.134306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.134311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.134319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.134326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:48.134333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:48.134347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:48.134354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.134356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.134357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:48.134361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.134368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:48.134386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.134463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.134468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.134476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.134525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 878 partition: 0 MaxSeqNo: 36 sessionId: src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0
2025-10-02T09:30:48.134719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f8e388-e26ccfb9-2808abca-8b6a2992_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:48.136988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Write session: try to update token
2025-10-02T09:30:48.136999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:48.145016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:48.145030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.145031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:48.145032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:48.145037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.145041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.145043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554500845673164:6547]
2025-10-02T09:30:48.145064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:48.145068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.145069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:48.145074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:48.145077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:48.145079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:48.145176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:48.147755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId: src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.149645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.210968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921198318:7261]
2025-10-02T09:30:48.211155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 877, pipe: [1:7556554500921198318:7261]
2025-10-02T09:30:48.257252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:48.257665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.257674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.257698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198318:7261], now have 1 active actors on pipe
2025-10-02T09:30:48.257847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:48.257888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:48.257898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:48.257900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:48.257933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921198318:7261]
2025-10-02T09:30:48.257940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 878 reason: error at write: Disconnected sessionId: src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0
2025-10-02T09:30:48.258073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 878 sessionId: src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0 is DEAD
2025-10-02T09:30:48.258456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:48.258464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Write session will restart in 0.005342s
2025-10-02T09:30:48.258480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Write session: Do CDS request
2025-10-02T09:30:48.258484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:48.265197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.265276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:48.265283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 879
2025-10-02T09:30:48.265382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.265401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:48.265407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:48.265410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:48.265657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 879 sessionId:  describe result for acl check
2025-10-02T09:30:48.265681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:48.265685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:48.265686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:48.265689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554500921198423:7697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:48.266023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554500921198423:7697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:48.267451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:48.267644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554500921198423:7697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:48.269019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:48.269112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:48.269118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:48.269124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:48.269148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:48.269170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554500845673377:6550]
2025-10-02T09:30:48.269197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554500921198423:7697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:48.269205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554500921198423:7697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:48.269207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554500921198423:7697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:48.269211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:48.269508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:48.269681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:48.269705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:48.269877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:48.269905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.269909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.269910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.269910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.269911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.269912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.269912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.269912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.269913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.269913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.269914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.269914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.269917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.269923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.269925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.269927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.269928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.269931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.269933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.269934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.269936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.269939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.269940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.269943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.269946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.269950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.269953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.269955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.269957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.269960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.269962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.269965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.269967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.269969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.269971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.269973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.269976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.269978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.269980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.269983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.269985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.269988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.269990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.269993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.269995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.269998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.270000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.270002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.270019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:48.277965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:48.279491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:48.279502Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:48.279503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:48.279505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:48.279509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 878 [2:7556554500845673377:6550]
2025-10-02T09:30:48.279516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:48.279525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:48.279530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.279532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.279533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.279541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:48.279544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:48.279549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:48.279579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.279583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.279584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.279586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:48.279587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:48.279624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:48.279629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.279635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.279640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.279648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:48.279662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198319:2446], now have 1 active actors on pipe
2025-10-02T09:30:48.279668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198521:7697], now have 1 active actors on pipe
2025-10-02T09:30:48.279671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.279672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.279673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.279680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:48.279689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:48.279692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:48.279694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:48.279696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:48.279699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:48.279701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:48.279716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.279720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:48.279706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 878
2025-10-02T09:30:48.279725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 878
2025-10-02T09:30:48.279730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:48.279740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.279742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.279758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:48.279765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.279767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.279768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:48.279773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.279779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:48.279787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.279880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.279884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.279892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.279942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 879 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0
2025-10-02T09:30:48.280217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8b5cf4-6a5fcaa6-9fcae167-fc8c9ea5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:48.283022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Write session: try to update token
2025-10-02T09:30:48.283038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:48.289363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:48.289374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.289376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:48.289377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:48.289381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.289383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.289385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554500845673372:6550]
2025-10-02T09:30:48.289408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:48.289410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.289412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:48.289416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:48.289420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:48.289422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:48.289538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:48.296903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId: src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.299005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.357903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921198534:7261]
2025-10-02T09:30:48.358064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 878, pipe: [1:7556554500921198534:7261]
2025-10-02T09:30:48.398543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:48.398755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.398764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.398777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198534:7261], now have 1 active actors on pipe
2025-10-02T09:30:48.398925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:48.398928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:48.398969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:48.398971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:48.398983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921198534:7261]
2025-10-02T09:30:48.399021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 879 reason: error at write: Disconnected sessionId: src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0
2025-10-02T09:30:48.399177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 879 sessionId: src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0 is DEAD
2025-10-02T09:30:48.399312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:48.399324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Write session will restart in 0.008051s
2025-10-02T09:30:48.399348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Write session: Do CDS request
2025-10-02T09:30:48.399354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:48.408208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.408284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:48.408292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 880
2025-10-02T09:30:48.408439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.408458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:48.408463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:48.408474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:48.408570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:48.408818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 880 sessionId:  describe result for acl check
2025-10-02T09:30:48.408847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:48.408853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:48.408854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:48.408858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554500921198704:7701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:48.409220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554500921198704:7701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:48.410109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:48.410210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:48.410216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:48.410222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:48.410247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:48.410269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554500845673584:6552]
2025-10-02T09:30:48.410603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:48.410655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554500921198704:7701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:48.410752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:48.410775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:48.410955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:48.410985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.410988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.410989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.410990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.410990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.410990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.410991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.410992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.410992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.410993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.410993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.410994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.410996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.411002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.411004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.411006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.411008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.411010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.411012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.411014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.411016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.411018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.411020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.411022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.411025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.411029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.411033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.411035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.411037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.411040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.411042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.411045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.411047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.411050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.411052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.411054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.411057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.411059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.411061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.411064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.411071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.411074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.411076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.411082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.411085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.411087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.411093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.411096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.411111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:48.414934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554500921198704:7701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:48.414944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554500921198704:7701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:48.414954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554500921198704:7701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:48.414959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:48.419202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:48.420747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:48.420758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:48.420759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:48.420761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:48.420764Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 879 [2:7556554500845673584:6552]
2025-10-02T09:30:48.420772Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:48.420782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:48.420787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.420788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.420789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.420798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:48.420813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:48.420817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:48.420852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.420857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.420858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.420860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:48.420861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:48.420897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:48.420902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.420908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.420913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.420925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:48.420939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.420943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.420945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.420949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:48.420956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:48.420960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198535:2446], now have 1 active actors on pipe
2025-10-02T09:30:48.420963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198747:7701], now have 1 active actors on pipe
2025-10-02T09:30:48.420963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:48.420965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:48.420966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:48.420973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:48.420974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:48.420988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.420995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:48.420996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:48.420994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 879
2025-10-02T09:30:48.421026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.421031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.421007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 879
2025-10-02T09:30:48.421044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:48.421051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.421053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.421058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:48.421063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.421068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:48.421078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.421184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.421188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.421195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.421249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 880 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0
2025-10-02T09:30:48.421497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c69932e-1c49da11-845d3a4d-7d4c054d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:48.424141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Write session: try to update token
2025-10-02T09:30:48.424154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:48.434391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:48.434403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.434408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.434430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:48.434436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:48.434569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:48.434677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.434784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.434891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.435050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:48.435074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:48.438103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId: src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.438877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:48.438888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.438890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:48.438891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:48.438895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.438897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.438899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554500845673579:6552]
2025-10-02T09:30:48.438918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:48.438922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:48.438924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.438925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:48.438926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:48.438926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:48.439050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:48.440304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.499238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921198754:7261]
2025-10-02T09:30:48.499461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 879, pipe: [1:7556554500921198754:7261]
2025-10-02T09:30:48.560787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:48.561200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.561213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.561230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198754:7261], now have 1 active actors on pipe
2025-10-02T09:30:48.561423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:48.561432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:48.561434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921198754:7261]
2025-10-02T09:30:48.561455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:48.561457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:48.561511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 880 reason: error at write: Disconnected sessionId: src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0
2025-10-02T09:30:48.561669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 880 sessionId: src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0 is DEAD
2025-10-02T09:30:48.561780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:48.561791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Write session will restart in 0.008136s
2025-10-02T09:30:48.561811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Write session: Do CDS request
2025-10-02T09:30:48.561816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:48.571202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.571237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:48.571248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 881
2025-10-02T09:30:48.571344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.571367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:48.571370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:48.571372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:48.571729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 881 sessionId:  describe result for acl check
2025-10-02T09:30:48.571761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:48.571767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:48.571768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:48.571772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554500921198922:7705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:48.572223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554500921198922:7705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:48.572593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:48.574066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554500921198922:7705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:48.574221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:48.574356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:48.574365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:48.574373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:48.574411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:48.574446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554500845673793:6554]
2025-10-02T09:30:48.574994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:48.575218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:48.575258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:48.575535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:48.575579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.575585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.575586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.575587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.575588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.575589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.575590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.575591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.575592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.575593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.575594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.575595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.575599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.575608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.575612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.575616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.575619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.575623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.575626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.575629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.575632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.575636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.575639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.575642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.575647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.575654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.575659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.575663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.575668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.575672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.575676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.575681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.575685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.575689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.575693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.575697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.575702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.575711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.575715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.575719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.575724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.575728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.575734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.575738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.575742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.575748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.575752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.575756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.575794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:48.575905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554500921198922:7705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:48.575914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554500921198922:7705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:48.575916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554500921198922:7705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:48.575920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:48.585041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:48.586510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:48.586524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:48.586526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:48.586530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:48.586534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 880 [2:7556554500845673793:6554]
2025-10-02T09:30:48.586547Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:48.586560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:48.586563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.586565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.586567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.586579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:48.586588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:48.586594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:48.586642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.586649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.586651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.586654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:48.586656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:48.586710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:48.586717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.586728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.586738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.586757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:48.586778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198964:7705], now have 1 active actors on pipe
2025-10-02T09:30:48.586785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198755:2446], now have 1 active actors on pipe
2025-10-02T09:30:48.586790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.586792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.586794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.586804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:48.586795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 880
2025-10-02T09:30:48.586817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:48.586822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:48.586821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 880
2025-10-02T09:30:48.586824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:48.586826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:48.586831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:48.586834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:48.586863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.586870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.586880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.586888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:48.586891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:48.586912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:48.586918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.586921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.586923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:48.586930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.586936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:48.586966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.587084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.587092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.587104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.587149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 881 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0
2025-10-02T09:30:48.587447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8ba0b5-e91ac0fd-ee1b9cc1-474d5e8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:48.590145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Write session: try to update token
2025-10-02T09:30:48.590161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:48.597138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:48.597157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.597158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:48.597160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:48.597167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.597171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.597174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554500845673787:6554]
2025-10-02T09:30:48.597207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:48.597208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:48.597212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:48.597212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.597215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:48.597215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:48.597341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:48.604335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId: src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.606966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.661536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921198985:7261]
2025-10-02T09:30:48.661727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 880, pipe: [1:7556554500921198985:7261]
2025-10-02T09:30:48.729338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:48.729766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.729776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.729788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198985:7261], now have 1 active actors on pipe
2025-10-02T09:30:48.729926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:48.729991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921198985:7261]
2025-10-02T09:30:48.730004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:48.730022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:48.730058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 881 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0
2025-10-02T09:30:48.730197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 881 sessionId: src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0 is DEAD
2025-10-02T09:30:48.730348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:48.730363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Write session will restart in 0.006527s
2025-10-02T09:30:48.730401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Write session: Do CDS request
2025-10-02T09:30:48.730408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:48.738230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.738328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:48.738336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 882
2025-10-02T09:30:48.738473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.738495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:48.738501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:48.738504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:48.738806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 882 sessionId:  describe result for acl check
2025-10-02T09:30:48.738830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:48.738834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:48.738835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:48.738838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554500921199102:7710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:48.739192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554500921199102:7710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:48.740775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554500921199102:7710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:48.740997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:48.742727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:48.742842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:48.742849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:48.742855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:48.742885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:48.742908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554500845674014:6557]
2025-10-02T09:30:48.742990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554500921199102:7710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:48.742997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554500921199102:7710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:48.743000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554500921199102:7710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:48.743004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:48.743257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:48.743430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:48.743453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:48.743624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:48.743653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.743657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.743658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.743658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.743658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.743659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.743659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.743660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.743660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.743661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.743661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.743662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.743665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.743670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.743672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.743674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.743676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.743678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.743680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.743682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.743684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.743686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.743688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.743689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.743694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.743698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.743701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.743704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.743706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.743708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.743710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.743713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.743715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.743718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.743720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.743722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.743725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.743728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.743730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.743732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.743734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.743737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.743739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.743741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.743744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.743747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.743749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.743751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.743767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:48.751249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:48.752638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:48.752649Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:48.752651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:48.752653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:48.752656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 881 [2:7556554500845674014:6557]
2025-10-02T09:30:48.752664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:48.752674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:48.752675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.752677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.752678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.752687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:48.752692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:48.752698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:48.752729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.752734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.752735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.752739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:48.752741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:48.752778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:48.752783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.752789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.752795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.752823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:48.752840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921198986:2446], now have 1 active actors on pipe
2025-10-02T09:30:48.752842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921199193:7710], now have 1 active actors on pipe
2025-10-02T09:30:48.752846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.752847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.752848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.752855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:48.752863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:48.752870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:48.752871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:48.752872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:48.752877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:48.752879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:48.752888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.752890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:48.752892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:48.752881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 881
2025-10-02T09:30:48.752904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 881
2025-10-02T09:30:48.752912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.752918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.752931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31af3828-440d49fe-8399cb9e-6825714c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:48.752939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.752942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.752943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:48.752948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.752956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:48.752966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.753068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.753073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.753080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.753146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 882 partition: 0 MaxSeqNo: 36 sessionId: src_id|31af3828-440d49fe-8399cb9e-6825714c_0
2025-10-02T09:30:48.753431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbcbbfa-3d5e9d62-61e8ba3e-afaf03d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31af3828-440d49fe-8399cb9e-6825714c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:48.756198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Write session: try to update token
2025-10-02T09:30:48.756210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:48.762275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:48.762289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.762296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.762325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:48.762331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:48.762473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:48.762603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.762719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.762829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.762992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:48.763017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:48.769694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId: src_id|31af3828-440d49fe-8399cb9e-6825714c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.771141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:48.771155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.771157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:48.771159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:48.771166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.771170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.771173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554500845674008:6557]
2025-10-02T09:30:48.771202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:48.771208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.771209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:48.771208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:48.771214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:48.771217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:48.771317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:48.771759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.829982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921199210:7261]
2025-10-02T09:30:48.830167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 881, pipe: [1:7556554500921199210:7261]
2025-10-02T09:30:48.887507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:48.887947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.887956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.887969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921199210:7261], now have 1 active actors on pipe
2025-10-02T09:30:48.888100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:48.888185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921199210:7261]
2025-10-02T09:30:48.888189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:48.888214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:48.888297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 882 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31af3828-440d49fe-8399cb9e-6825714c_0
2025-10-02T09:30:48.888431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 882 sessionId: src_id|31af3828-440d49fe-8399cb9e-6825714c_0 is DEAD
2025-10-02T09:30:48.888603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:48.888621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Write session will restart in 0.009086s
2025-10-02T09:30:48.888649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Write session: Do CDS request
2025-10-02T09:30:48.888656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:48.898213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:48.899371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:48.899411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.899383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 883
2025-10-02T09:30:48.899618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:48.899650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:48.899658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:48.899661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:48.899863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:48.899934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 883 sessionId:  describe result for acl check
2025-10-02T09:30:48.899953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:48.899954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:48.899955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:48.899958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554500921199387:7715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:48.899977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:48.899983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:48.899989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:48.900016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:48.900039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554500845674226:6560]
2025-10-02T09:30:48.900295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554500921199387:7715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:48.900382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:48.900584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:48.900608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:48.900827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:48.900875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.900880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.900881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.900882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.900883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.900884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.900885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.900886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.900886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.900887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.900888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.900889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.900893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.900902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.900906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.900908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.900910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.900912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.900914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.900916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.900918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.900920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.900922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.900924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.900928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.900932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:48.900938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.900942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:48.900945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.900949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:48.900953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.900957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:48.900961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.900965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:48.900969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.900973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:48.900977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.900981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:48.900985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.900989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:48.900992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.900997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:48.901000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.901004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.901008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.901012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.901016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.901020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.901057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:48.901541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554500921199387:7715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:48.906066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554500921199387:7715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:48.906077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554500921199387:7715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:48.906079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554500921199387:7715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:48.906084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:48.908611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:48.910045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:48.910058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:48.910059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:48.910062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:48.910066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 882 [2:7556554500845674226:6560]
2025-10-02T09:30:48.910074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:48.910084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:48.910085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.910087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.910088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.910097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:48.910101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:48.910105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:48.910136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.910142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.910143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.910145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:48.910147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:48.910332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:48.910338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.910345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:48.910306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 882
2025-10-02T09:30:48.910319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 882
2025-10-02T09:30:48.910350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:48.910362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:48.910378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921199425:7715], now have 1 active actors on pipe
2025-10-02T09:30:48.910384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921199214:2446], now have 1 active actors on pipe
2025-10-02T09:30:48.910396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.910401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.910411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.910416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.910417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.910424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:48.910435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:48.910436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:48.910442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:48.910443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:48.910443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:48.910445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:48.910455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:48.910461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:48.910463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:48.910465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:48.910470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:48.910479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:48.910499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.910506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:48.910510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:48.910512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.910622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:48.910627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:48.910635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:48.910692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 883 partition: 0 MaxSeqNo: 36 sessionId: src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0
2025-10-02T09:30:48.911006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31af3828-440d49fe-8399cb9e-6825714c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:48.914040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Write session: try to update token
2025-10-02T09:30:48.914062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:48.920164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:48.920179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.920185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.920223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:48.920231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:48.920371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:48.920491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.920616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.920740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:48.920920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:48.920949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:48.928791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId: src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:48.929440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:48.929452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:48.929454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:48.929455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:48.929460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.929463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.929465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554500845674220:6560]
2025-10-02T09:30:48.929488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:48.929493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:48.929494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:48.929606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:48.929646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:48.929659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:48.929663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:48.930998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:48.988203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554500921199433:7261]
2025-10-02T09:30:48.988415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 882, pipe: [1:7556554500921199433:7261]
2025-10-02T09:30:49.054301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:49.054577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.054589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.054604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554500921199433:7261], now have 1 active actors on pipe
2025-10-02T09:30:49.054763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:49.054775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:49.054786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:49.054791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:49.054818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554500921199433:7261]
2025-10-02T09:30:49.054838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 883 reason: error at write: Disconnected sessionId: src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0
2025-10-02T09:30:49.055002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 883 sessionId: src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0 is DEAD
2025-10-02T09:30:49.055106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:49.055114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Write session will restart in 0.007295s
2025-10-02T09:30:49.055130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Write session: Do CDS request
2025-10-02T09:30:49.055134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:49.063202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.063290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:49.063302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 884
2025-10-02T09:30:49.063419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.063449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:49.063456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:49.063460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:49.063811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 884 sessionId:  describe result for acl check
2025-10-02T09:30:49.063839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:49.063845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:49.063847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:49.063851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554505216166896:7726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:49.064275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554505216166896:7726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:49.065172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:49.066044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554505216166896:7726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:49.066651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:49.066781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:49.066789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:49.066795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:49.066825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:49.066847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554505140641770:6574]
2025-10-02T09:30:49.067187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:49.067337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:49.067358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:49.067530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:49.067558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.067561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.067562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.067562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.067563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.067563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.067564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.067564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.067565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.067565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.067566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.067566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.067569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.067575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.067577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.067579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.067581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.067583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.067585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.067587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.067589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.067591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.067593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.067595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.067598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.067602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.067605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.067608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.067610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.067613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.067615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.067617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.067619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.067622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.067624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.067627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.067629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.067632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.067634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.067637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.067639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.067642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.067644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.067647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.067649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.067654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.067656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.067658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.067674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:49.071832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554505216166896:7726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:49.071842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554505216166896:7726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:49.071844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554505216166896:7726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:49.071848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:49.075655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:49.077139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:49.077151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:49.077152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:49.077155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:49.077159Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 883 [2:7556554505140641770:6574]
2025-10-02T09:30:49.077168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:49.077178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:49.077179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.077181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.077182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.077191Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:49.077198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:49.077202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:49.077236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.077241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.077242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.077244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:49.077245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:49.077282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:49.077290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.077297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.077302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.077310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:49.077322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216166964:7726], now have 1 active actors on pipe
2025-10-02T09:30:49.077324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216166755:2446], now have 1 active actors on pipe
2025-10-02T09:30:49.077328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.077330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.077331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.077338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:49.077347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:49.077348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:49.077350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:49.077351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:49.077359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:49.077360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:49.077379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.077383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:49.077386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:49.077374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 883
2025-10-02T09:30:49.077398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.077391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 883
2025-10-02T09:30:49.077404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.077423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:49.077429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.077432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.077433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:49.077438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.077446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:49.077459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.077540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.077545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.077552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.077602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 884 partition: 0 MaxSeqNo: 36 sessionId: src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0
2025-10-02T09:30:49.077827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da8f5b79-cde283a7-9aa047d5-6ae53671_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:49.080233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Write session: try to update token
2025-10-02T09:30:49.080245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:49.087386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:49.087402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.087403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:49.087405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:49.087410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.087413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.087415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554505140641764:6574]
2025-10-02T09:30:49.087440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:49.087446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.087449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:49.087449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:49.087454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:49.087456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:49.087560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:49.091237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId: src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:49.093334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:49.155119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554505216166972:7261]
2025-10-02T09:30:49.155330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 883, pipe: [1:7556554505216166972:7261]
2025-10-02T09:30:49.212796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:49.213120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.213129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.213160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216166972:7261], now have 1 active actors on pipe
2025-10-02T09:30:49.213323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:49.213347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554505216166972:7261]
2025-10-02T09:30:49.213365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:49.213368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:49.213372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:49.213414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 884 reason: error at write: Disconnected sessionId: src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0
2025-10-02T09:30:49.213543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 884 sessionId: src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0 is DEAD
2025-10-02T09:30:49.213704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:49.213714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Write session will restart in 0.006573s
2025-10-02T09:30:49.213739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Write session: Do CDS request
2025-10-02T09:30:49.213744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:49.221199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.221310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:49.221323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 885
2025-10-02T09:30:49.221413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.221440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:49.221447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:49.221451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:49.221846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 885 sessionId:  describe result for acl check
2025-10-02T09:30:49.221880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:49.221886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:49.221888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:49.221892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554505216167024:7731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:49.222370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554505216167024:7731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:49.224463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554505216167024:7731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:49.226341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:49.228061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554505216167024:7731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:49.228069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554505216167024:7731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:49.228071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554505216167024:7731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:49.228075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:49.228083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:49.228198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:49.228206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:49.228212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:49.228238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:49.228261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554505140641986:6577]
2025-10-02T09:30:49.228627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:49.228817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:49.228845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:49.229029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:49.229061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.229065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.229066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.229066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.229067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.229068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.229068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.229069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.229070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.229070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.229071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.229071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.229074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.229081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.229083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.229085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.229087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.229089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.229092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.229095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.229099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.229102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.229105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.229108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.229114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.229120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.229128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.229131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.229137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.229140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.229144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.229146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.229149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.229153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.229155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.229158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.229164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.229166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.229168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.229171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.229173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.229176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.229178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.229181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.229183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.229189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.229191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.229194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.229213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:49.236850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:49.238196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:49.238208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:49.238210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:49.238212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:49.238217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 884 [2:7556554505140641986:6577]
2025-10-02T09:30:49.238226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:49.238237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:49.238242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.238244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.238245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.238255Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:49.238260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:49.238264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:49.238301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.238306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.238307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.238309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:49.238310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:49.238352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:49.238357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.238363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.238368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.238378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:49.238392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.238397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.238398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.238404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:49.238410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:49.238413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167185:7731], now have 1 active actors on pipe
2025-10-02T09:30:49.238415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216166975:2446], now have 1 active actors on pipe
2025-10-02T09:30:49.238417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:49.238419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:49.238420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:49.238427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:49.238429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:49.238446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.238454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:49.238461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:49.238476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 884
2025-10-02T09:30:49.238485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 884
2025-10-02T09:30:49.238549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.238555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.238570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad5603b1-4e188149-8b824744-34be13a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:49.238577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.238579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.238580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:49.238585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.238594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:49.238602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.238728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.238735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.238744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.238810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 885 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad5603b1-4e188149-8b824744-34be13a_0
2025-10-02T09:30:49.239072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daedf77a-14fb1e20-2e8b7a36-cff753fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad5603b1-4e188149-8b824744-34be13a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:49.241273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Write session: try to update token
2025-10-02T09:30:49.241284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:49.247982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:49.248000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.248002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:49.248003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:49.248010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.248013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.248017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554505140641980:6577]
2025-10-02T09:30:49.248049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:49.248058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.248060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:49.248059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:49.248064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:49.248068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:49.248194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:49.252645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId: src_id|ad5603b1-4e188149-8b824744-34be13a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:49.255053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:49.313315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554505216167197:7261]
2025-10-02T09:30:49.313541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 884, pipe: [1:7556554505216167197:7261]
2025-10-02T09:30:49.369180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:49.369381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.369392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.369424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167197:7261], now have 1 active actors on pipe
2025-10-02T09:30:49.369565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:49.369592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:49.369592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:49.369603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:49.369623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554505216167197:7261]
2025-10-02T09:30:49.369656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 885 reason: error at write: Disconnected sessionId: src_id|ad5603b1-4e188149-8b824744-34be13a_0
2025-10-02T09:30:49.369795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 885 sessionId: src_id|ad5603b1-4e188149-8b824744-34be13a_0 is DEAD
2025-10-02T09:30:49.369910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:49.369918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Write session will restart in 0.009372s
2025-10-02T09:30:49.369933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Write session: Do CDS request
2025-10-02T09:30:49.369937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:49.380186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.380320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:49.380335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 886
2025-10-02T09:30:49.380455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.380484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:49.380493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:49.380496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:49.380784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 886 sessionId:  describe result for acl check
2025-10-02T09:30:49.380819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:49.380825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:49.380826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:49.380829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554505216167370:7735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:49.381181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554505216167370:7735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:49.381746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:49.382784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554505216167370:7735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:49.383566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:49.383713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:49.383721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:49.383728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:49.383762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:49.383793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554505140642199:6579]
2025-10-02T09:30:49.384153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:49.384319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554505216167370:7735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:49.384327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554505216167370:7735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:49.384329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554505216167370:7735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:49.384322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:49.384333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:49.384347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:49.384530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:49.384561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.384565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.384565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.384566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.384566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.384567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.384568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.384568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.384569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.384569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.384570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.384570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.384573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.384579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.384581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.384583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.384585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.384587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.384589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.384591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.384593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.384595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.384597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.384599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.384603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.384607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.384611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.384614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.384616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.384619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.384621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.384624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.384626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.384629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.384631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.384634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.384636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.384638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.384640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.384643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.384646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.384649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.384652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.384658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.384660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.384662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.384664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.384667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.384684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:49.393083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:49.394570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:49.394581Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:49.394582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:49.394584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:49.394588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 885 [2:7556554505140642199:6579]
2025-10-02T09:30:49.394595Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:49.394604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:49.394609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.394611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.394612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.394621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:49.394627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:49.394632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:49.394666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.394670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.394672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.394674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:49.394675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:49.394715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:49.394719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.394725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.394731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.394738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:49.394749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167198:2446], now have 1 active actors on pipe
2025-10-02T09:30:49.394755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167410:7735], now have 1 active actors on pipe
2025-10-02T09:30:49.394758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.394760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.394761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.394769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:49.394777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:49.394779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:49.394784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:49.394785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:49.394786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:49.394788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:49.394801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.394806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:49.394807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:49.394815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 885
2025-10-02T09:30:49.394823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 885
2025-10-02T09:30:49.394904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.394909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.394924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:49.394931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.394933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.394934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:49.394939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.394953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:49.394960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.395053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.395058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.395065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.395149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 886 partition: 0 MaxSeqNo: 36 sessionId: src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0
2025-10-02T09:30:49.395382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5603b1-4e188149-8b824744-34be13a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:49.397655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Write session: try to update token
2025-10-02T09:30:49.397667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:49.405094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:49.405109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.405111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:49.405112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:49.405118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.405120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.405122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554505140642194:6579]
2025-10-02T09:30:49.405146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:49.405152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.405153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:49.405152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:49.405156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:49.405158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:49.405266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:49.408397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId: src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:49.410285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:49.470030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554505216167420:7261]
2025-10-02T09:30:49.470242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 885, pipe: [1:7556554505216167420:7261]
2025-10-02T09:30:49.524734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:49.524955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.524965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.524992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167420:7261], now have 1 active actors on pipe
2025-10-02T09:30:49.525140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:49.525206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:49.525207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:49.525253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554505216167420:7261]
2025-10-02T09:30:49.525285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0
2025-10-02T09:30:49.525419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 886 sessionId: src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0 is DEAD
2025-10-02T09:30:49.525587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:49.525598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Write session will restart in 0.008432s
2025-10-02T09:30:49.525621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Write session: Do CDS request
2025-10-02T09:30:49.525627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:49.535255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.535326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:49.535339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 887
2025-10-02T09:30:49.535431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.535459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:49.535468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:49.535471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:49.535777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 887 sessionId:  describe result for acl check
2025-10-02T09:30:49.535801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:49.535805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:49.535806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:49.535810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554505216167595:7739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:49.536163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554505216167595:7739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:49.536257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:49.537523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554505216167595:7739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:49.537918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:49.538017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:49.538024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:49.538030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:49.538054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:49.538077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554505140642412:6581]
2025-10-02T09:30:49.538414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:49.538568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:49.538589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:49.538761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:49.538789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.538792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.538793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.538794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.538794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.538794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.538795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.538796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.538796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.538797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.538797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.538798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.538801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.538806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.538808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.538811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.538812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.538815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.538817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.538819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.538820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.538823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.538825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.538827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.538830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.538834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.538838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.538840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.538843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.538845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.538847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.538850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.538852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.538854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.538857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.538859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.538861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.538864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.538866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.538869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.538871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.538873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.538876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.538878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.538880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.538883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.538885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.538888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.538903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:49.542226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554505216167595:7739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:49.542235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554505216167595:7739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:49.542237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554505216167595:7739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:49.542241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:49.546304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:49.547650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:49.547663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:49.547664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:49.547666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:49.547669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 886 [2:7556554505140642412:6581]
2025-10-02T09:30:49.547676Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:49.547686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:49.547687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.547689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.547690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.547699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:49.547702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:49.547707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:49.547737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.547743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.547744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.547746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:49.547747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:49.547783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:49.547788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.547794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.547799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.547807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:49.547823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167421:2446], now have 1 active actors on pipe
2025-10-02T09:30:49.547825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167636:7739], now have 1 active actors on pipe
2025-10-02T09:30:49.547829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.547830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.547831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.547838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:49.547845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:49.547855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:49.547840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 886
2025-10-02T09:30:49.547855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:49.547858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:49.547841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 886
2025-10-02T09:30:49.547859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:49.547860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:49.547873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.547878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:49.547880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:49.547890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.547895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.547919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:49.547926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.547929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.547930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:49.547935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.547940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:49.547952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.548043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.548048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.548055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.548103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 887 partition: 0 MaxSeqNo: 36 sessionId: src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0
2025-10-02T09:30:49.548312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15107fe-4d6ac23e-14cf9be5-1a2e73f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:49.550610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Write session: try to update token
2025-10-02T09:30:49.550622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:49.557331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:49.557346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.557347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:49.557348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:49.557353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.557356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.557358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554505140642406:6581]
2025-10-02T09:30:49.557381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:49.557384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.557385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:49.557386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:49.557389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:49.557392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:49.557492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:49.561639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId: src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:49.563734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:49.625640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554505216167644:7261]
2025-10-02T09:30:49.625840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 886, pipe: [1:7556554505216167644:7261]
2025-10-02T09:30:49.676901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:49.677084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.677092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.677116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167644:7261], now have 1 active actors on pipe
2025-10-02T09:30:49.677229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:49.677305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554505216167644:7261]
2025-10-02T09:30:49.677313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:49.677325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:49.677376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 887 reason: status is not ok: tablet will be restarted right now sessionId: src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0
2025-10-02T09:30:49.677689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:49.677699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Write session will restart in 0.008940s
2025-10-02T09:30:49.677713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Write session: Do CDS request
2025-10-02T09:30:49.677717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:49.677549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 887 sessionId: src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0 is DEAD
2025-10-02T09:30:49.687160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.687294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:49.687306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 888
2025-10-02T09:30:49.687419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.687444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:49.687452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:49.687455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:49.687799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 888 sessionId:  describe result for acl check
2025-10-02T09:30:49.687824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:49.687827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:49.687829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:49.687832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554505216167834:7744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:49.687934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:49.688248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554505216167834:7744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:49.689434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:49.689536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:49.689542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:49.689548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:49.689575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:49.689560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554505216167834:7744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:49.689606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554505140642640:6584]
2025-10-02T09:30:49.689941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:49.690101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:49.690125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:49.690311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:49.690339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.690343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.690343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.690344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.690344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.690345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.690345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.690346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.690346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.690347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.690347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.690348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.690351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.690356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.690358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.690360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.690362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.690364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.690366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.690368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.690370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.690372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.690374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.690376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.690380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.690383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.690387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.690390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.690393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.690396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.690398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.690401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.690403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.690405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.690407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.690410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.690412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.690414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.690416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.690419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.690421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.690423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.690426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.690429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.690431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.690433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.690435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.690437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.690454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:49.694864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554505216167834:7744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:49.694873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554505216167834:7744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:49.694875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554505216167834:7744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:49.694879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:49.698830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:49.700211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:49.700221Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:49.700223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:49.700225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:49.700228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 887 [2:7556554505140642640:6584]
2025-10-02T09:30:49.700237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:49.700246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:49.700253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.700254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.700255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.700264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:49.700267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:49.700271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:49.700302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.700308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.700309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.700311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:49.700312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:49.700442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 887
2025-10-02T09:30:49.700464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 887
2025-10-02T09:30:49.700496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:49.700504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.700516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.700530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.700544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:49.700561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167658:2446], now have 1 active actors on pipe
2025-10-02T09:30:49.700567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167874:7744], now have 1 active actors on pipe
2025-10-02T09:30:49.700578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.700583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.700592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.700597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.700598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.700607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:49.700620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:49.700621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:49.700623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:49.700624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:49.700632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:49.700633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:49.700643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|820f7e4e-856289fd-41322f01-65b307c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:49.700650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.700652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.700657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:49.700663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.700672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:49.700690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.700697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:49.700703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:49.700704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.700842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.700847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.700857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.700930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 888 partition: 0 MaxSeqNo: 36 sessionId: src_id|820f7e4e-856289fd-41322f01-65b307c1_0
2025-10-02T09:30:49.701188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179f4071-a8a8a0bc-755995e4-d72c2b9f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|820f7e4e-856289fd-41322f01-65b307c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:49.703622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Write session: try to update token
2025-10-02T09:30:49.703634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:49.714990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId: src_id|820f7e4e-856289fd-41322f01-65b307c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:49.715593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:49.715609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.715615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.715641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:49.715644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:49.715781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:49.715900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:49.716017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:49.716146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:49.716327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:49.716362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:49.717324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:49.717448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.717458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.717473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:49.717560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:49.720174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:49.720184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.720185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:49.720187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:49.720191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.720193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.720195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554505140642634:6584]
2025-10-02T09:30:49.720222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:49.720225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:49.720228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.720230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:49.720232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:49.720234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:49.720332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:49.777687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554505216167889:7261]
2025-10-02T09:30:49.777858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 887, pipe: [1:7556554505216167889:7261]
2025-10-02T09:30:49.835176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:49.842154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.842178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.842319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.842376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.842436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.842496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.842536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.842545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.842609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.842665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.842725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.842787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.842829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.842837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.842894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.842958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.843017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.843075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.843117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.843123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.843177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.843235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.843291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.843349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.843390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.843396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.843458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.843517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.843576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.843639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.843681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.843690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.843749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.843805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.843861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.843916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.843956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.843963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.844020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.844075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.844138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.844199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.844240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.844247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.844307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.844364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.844420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.844479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.844522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.844530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.844590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.844643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.844698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.844752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.844792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.844812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.844870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:49.844919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:49.844975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:49.845034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:49.845087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:49.845096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:49.845139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167889:7261], now have 1 active actors on pipe
2025-10-02T09:30:49.845288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:49.845300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:49.845303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:49.845321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 888 reason: error at write: Disconnected sessionId: src_id|820f7e4e-856289fd-41322f01-65b307c1_0
2025-10-02T09:30:49.845338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554505216167889:7261]
2025-10-02T09:30:49.845470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 888 sessionId: src_id|820f7e4e-856289fd-41322f01-65b307c1_0 is DEAD
2025-10-02T09:30:49.845605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:49.845614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Write session will restart in 0.007514s
2025-10-02T09:30:49.845628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Write session: Do CDS request
2025-10-02T09:30:49.845633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:49.845994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:49.854173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.854243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:49.854253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 889
2025-10-02T09:30:49.854615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:49.854636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:49.854641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:49.854644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:49.854898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 889 sessionId:  describe result for acl check
2025-10-02T09:30:49.854920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:49.854925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:49.854926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:49.854929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554505216168071:7749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:49.855276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554505216168071:7749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:49.856057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:49.857095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554505216168071:7749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:49.857493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:49.857619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:49.857627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:49.857635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:49.857674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:49.857702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554505140642858:6586]
2025-10-02T09:30:49.858229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:49.858408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:49.858441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:49.858710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:49.858749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.858755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.858756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.858757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.858757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.858758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.858759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.858760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.858761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.858762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.858763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.858764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.858768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.858777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.858781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.858784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.858787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.858791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.858795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.858798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.858805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.858808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.858815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.858819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.858827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.858837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:49.858845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.858853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:49.858861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.858867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:49.858872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.858880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:49.858888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.858894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:49.858902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.858908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:49.858915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.858914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554505216168071:7749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:49.858921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:49.858921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554505216168071:7749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:49.858923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554505216168071:7749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:49.858929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.858926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:49.858934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:49.858941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.858956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:49.858964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.858968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.858976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.858980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.858988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.858996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.859031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:49.866706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:49.868087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:49.868100Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:49.868102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:49.868105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:49.868109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 888 [2:7556554505140642858:6586]
2025-10-02T09:30:49.868120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:49.868136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:49.868139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.868141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.868142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.868153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:49.868162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:49.868167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:49.868208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.868214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.868216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.868218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:49.868220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:49.868265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:49.868271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.868282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:49.868296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:49.868315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:49.868333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216168113:7749], now have 1 active actors on pipe
2025-10-02T09:30:49.868340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216167897:2446], now have 1 active actors on pipe
2025-10-02T09:30:49.868332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 888
2025-10-02T09:30:49.868345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.868344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 888
2025-10-02T09:30:49.868348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.868350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.868357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:49.868362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:49.868367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:49.868369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:49.868370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:49.868379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:49.868381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:49.868396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.868403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.868422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.868432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:49.868438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:49.868448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|478baa45-34460c77-56ff3fde-9e987454_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:49.868459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:49.868462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:49.868463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:49.868469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:49.868476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:49.868499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.868614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:49.868622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:49.868634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:49.868698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 889 partition: 0 MaxSeqNo: 36 sessionId: src_id|478baa45-34460c77-56ff3fde-9e987454_0
2025-10-02T09:30:49.868921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820f7e4e-856289fd-41322f01-65b307c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|478baa45-34460c77-56ff3fde-9e987454_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:49.871098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Write session: try to update token
2025-10-02T09:30:49.871107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:49.877774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:49.877793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:49.877795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:49.877797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:49.877803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.877807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.877810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554505140642852:6586]
2025-10-02T09:30:49.877837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:49.877836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:49.877839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:49.877841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:49.877845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:49.877847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:49.877972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:49.881898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId: src_id|478baa45-34460c77-56ff3fde-9e987454_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:49.884144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:49.945636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554505216168123:7261]
2025-10-02T09:30:49.945843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 888, pipe: [1:7556554505216168123:7261]
2025-10-02T09:30:50.005933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.006243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.006252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.006279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554505216168123:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.006410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:50.006501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:50.006514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:50.006569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 889 reason: error at write: Disconnected sessionId: src_id|478baa45-34460c77-56ff3fde-9e987454_0
2025-10-02T09:30:50.006611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554505216168123:7261]
2025-10-02T09:30:50.006635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.006702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 889 sessionId: src_id|478baa45-34460c77-56ff3fde-9e987454_0 is DEAD
2025-10-02T09:30:50.006844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:50.006850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Write session will restart in 0.008499s
2025-10-02T09:30:50.006865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Write session: Do CDS request
2025-10-02T09:30:50.006870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.016140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.016240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.016252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 890
2025-10-02T09:30:50.016352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.016380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.016388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.016396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.016742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 890 sessionId:  describe result for acl check
2025-10-02T09:30:50.016768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.016773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.016775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.016778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511135598:7753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.016913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.017236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511135598:7753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.018392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.018485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.018491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.018497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.018520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.018543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435610374:6589]
2025-10-02T09:30:50.018881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.018893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511135598:7753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.019039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.019062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.019235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.019262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.019266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.019267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.019267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.019268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.019268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.019269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.019269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.019270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.019270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.019271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.019271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.019274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.019279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.019282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.019284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.019286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.019288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.019289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.019291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.019293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.019295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.019297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.019299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.019302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.019305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.019309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.019312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.019314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.019316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.019318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.019321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.019326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.019329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.019331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.019333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.019339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.019342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.019347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.019349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.019353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.019358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.019360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.019363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.019365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.019367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.019372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.019375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.019392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.023278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511135598:7753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.023289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511135598:7753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.023292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511135598:7753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.023296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.026815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.028310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.028321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.028323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.028325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.028329Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 889 [2:7556554509435610374:6589]
2025-10-02T09:30:50.028337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.028346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.028348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.028350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.028351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.028360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.028363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.028368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.028401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.028406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.028407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.028409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.028411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.028450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.028458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.028465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.028470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.028479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.028490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135420:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.028496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135638:7753], now have 1 active actors on pipe
2025-10-02T09:30:50.028500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.028501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.028502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.028510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.028518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.028524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.028526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.028528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.028528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.028530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.028545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.028550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.028552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.028537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 889
2025-10-02T09:30:50.028556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 889
2025-10-02T09:30:50.028572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.028578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.028594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.028601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.028604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.028605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.028610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.028618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.028628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.028723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.028728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.028735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.028794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 890 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0
2025-10-02T09:30:50.029079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478baa45-34460c77-56ff3fde-9e987454_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.031224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Write session: try to update token
2025-10-02T09:30:50.031235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.038092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.038110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.038112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.038113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.038119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.038122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.038125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435610368:6589]
2025-10-02T09:30:50.038151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.038155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.038156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.038158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.038164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.038166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.038282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.041974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId: src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.044085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:50.106932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554509511135668:7261]
2025-10-02T09:30:50.107130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 889, pipe: [1:7556554509511135668:7261]
2025-10-02T09:30:50.155031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.155363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.155377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.155406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135668:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.155624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.155636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:50.155639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:50.155678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554509511135668:7261]
2025-10-02T09:30:50.155687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 890 reason: error at write: Disconnected sessionId: src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0
2025-10-02T09:30:50.155827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 890 sessionId: src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0 is DEAD
2025-10-02T09:30:50.155942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:50.155972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:50.155982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Write session will restart in 0.005054s
2025-10-02T09:30:50.156007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Write session: Do CDS request
2025-10-02T09:30:50.156013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.162096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.162239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.162254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 891
2025-10-02T09:30:50.162346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.162374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.162382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.162394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.162768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 891 sessionId:  describe result for acl check
2025-10-02T09:30:50.162797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.162802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.162804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.162807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511135710:7764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.163269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511135710:7764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.165637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511135710:7764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.167007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.168502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.168605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.168612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.168618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.168654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.168678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435610629:6603]
2025-10-02T09:30:50.169015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511135710:7764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.169025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511135710:7764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.169027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511135710:7764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.169030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.169187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.169365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.169393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.169598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.169631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.169635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.169636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.169636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.169637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.169638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.169638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.169639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.169639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.169640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.169640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.169641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.169644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.169650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.169652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.169654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.169656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.169657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.169659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.169661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.169663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.169665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.169667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.169669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.169673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.169676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.169679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.169683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.169686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.169691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.169694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.169698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.169702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.169711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.169717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.169725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.169733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.169737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.169745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.169750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.169755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.169758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.169760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.169766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.169769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.169776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.169784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.169790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.169824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.177320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.178788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.178799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.178801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.178803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.178807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 890 [2:7556554509435610629:6603]
2025-10-02T09:30:50.178815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.178825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.178826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.178828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.178829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.178838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.178841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.178845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.178880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.178885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.178886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.178888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.178890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.178927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.178932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.178939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.178955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.178968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.178983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135669:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.178990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135886:7764], now have 1 active actors on pipe
2025-10-02T09:30:50.178995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.179001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.179003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.179014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.179026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.179027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.179029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.179030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.179037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.179038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.179017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 890
2025-10-02T09:30:50.179039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 890
2025-10-02T09:30:50.179058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.179062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.179064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.179071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.179073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.179099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.179106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.179108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.179110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.179117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.179127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.179143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.179245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.179252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.179261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.179333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 891 partition: 0 MaxSeqNo: 36 sessionId: src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0
2025-10-02T09:30:50.179611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd192942-536b3bf6-323b7fce-bc2acf23_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.181903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Write session: try to update token
2025-10-02T09:30:50.181917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.188699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.188713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.188715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.188716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.188721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.188725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.188729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435610623:6603]
2025-10-02T09:30:50.188759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.188759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.188762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.188764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.188771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.188772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.188898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.193326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId: src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.195423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:50.255893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554509511135898:7261]
2025-10-02T09:30:50.256071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 890, pipe: [1:7556554509511135898:7261]
2025-10-02T09:30:50.306845Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.307210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.307219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.307245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135898:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.307442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.307451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554509511135898:7261]
2025-10-02T09:30:50.307478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:50.307481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:50.307534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 891 reason: error at write: Disconnected sessionId: src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0
2025-10-02T09:30:50.307558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:50.307705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 891 sessionId: src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0 is DEAD
2025-10-02T09:30:50.307838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:50.307848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Write session will restart in 0.008032s
2025-10-02T09:30:50.307864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Write session: Do CDS request
2025-10-02T09:30:50.307869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.317113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.317210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.317220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 892
2025-10-02T09:30:50.317308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.317329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.317336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.317339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.317631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 892 sessionId:  describe result for acl check
2025-10-02T09:30:50.317657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.317661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.317662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.317665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511136077:7769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.318029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511136077:7769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.318529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.319360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511136077:7769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.320226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.320359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.320369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.320379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.320422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.320455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435610851:6606]
2025-10-02T09:30:50.320998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.321182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.321218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.321368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511136077:7769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.321378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511136077:7769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.321381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511136077:7769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.321387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.321498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.321545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.321550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.321551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.321552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.321553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.321554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.321555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.321556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.321556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.321557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.321558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.321559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.321563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.321572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.321576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.321579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.321582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.321586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.321589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.321592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.321595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.321598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.321602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.321605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.321611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.321617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.321623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.321628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.321631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.321636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.321644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.321648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.321652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.321656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.321661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.321670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.321673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.321681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.321689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.321693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.321701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.321709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.321717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.321723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.321731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.321739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.321746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.321751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.321787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.329627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.331250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.331263Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.331264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.331266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.331271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 891 [2:7556554509435610851:6606]
2025-10-02T09:30:50.331280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.331292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.331294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.331296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.331297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.331306Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.331309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.331314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.331349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.331355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.331356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.331357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.331359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.331400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.331405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.331411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.331417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.331425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.331441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136116:7769], now have 1 active actors on pipe
2025-10-02T09:30:50.331447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511135899:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.331450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.331452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.331453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.331458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.331465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.331466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.331468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.331469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.331473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.331475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.331491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.331499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.331503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.331509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 891
2025-10-02T09:30:50.331510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 891
2025-10-02T09:30:50.331533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.331539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.331556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.331560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.331564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.331566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.331572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.331577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.331585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.331684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.331691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.331698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.331764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 892 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0
2025-10-02T09:30:50.332035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da125d75-a72ec00f-118bcaed-b41d70a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.334609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Write session: try to update token
2025-10-02T09:30:50.334624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.340906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:50.340919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.340927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.340960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:50.340969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:50.341111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:50.341246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:50.341380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:50.341508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:50.341692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:50.341731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:50.347026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId: src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.349116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:50.349753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.349770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.349783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.349786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.349788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.349790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.349798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.349801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.349805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435610845:6606]
2025-10-02T09:30:50.349831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.349839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.349840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.349843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.349843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.349844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.349950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.407471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554509511136129:7261]
2025-10-02T09:30:50.407678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 891, pipe: [1:7556554509511136129:7261]
2025-10-02T09:30:50.471075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.471383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:50.471409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136129:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.471531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:50.471621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:50.471629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:50.471688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 892 reason: error at write: Disconnected sessionId: src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0
2025-10-02T09:30:50.471789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554509511136129:7261]
2025-10-02T09:30:50.471821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.471823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 892 sessionId: src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0 is DEAD
2025-10-02T09:30:50.471934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:50.471939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Write session will restart in 0.006248s
2025-10-02T09:30:50.471954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Write session: Do CDS request
2025-10-02T09:30:50.471961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.479162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.479282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.479295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 893
2025-10-02T09:30:50.479411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.479435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.479441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.479445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.479776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 893 sessionId:  describe result for acl check
2025-10-02T09:30:50.479808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.479813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.479815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.479820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511136156:7773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.480206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511136156:7773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.482523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511136156:7773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.484763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511136156:7773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.484775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511136156:7773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.484778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511136156:7773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.484784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.486043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.488003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.488119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.488127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.488133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.488163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.488188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435611073:6608]
2025-10-02T09:30:50.488564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.488781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.488825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.489010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.489037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.489042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.489043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.489044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.489045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.489046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.489047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.489048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.489049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.489049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.489050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.489051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.489056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.489066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.489070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.489073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.489075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.489077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.489079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.489081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.489083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.489085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.489087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.489089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.489093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.489097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.489101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.489104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.489106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.489108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.489111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.489113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.489116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.489122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.489124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.489127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.489129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.489132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.489134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.489137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.489139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.489142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.489147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.489149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.489151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.489154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.489156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.489159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.489177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.497161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.498616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.498627Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.498628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.498630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.498634Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 892 [2:7556554509435611073:6608]
2025-10-02T09:30:50.498643Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.498653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.498654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.498655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.498656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.498665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.498668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.498673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.498706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.498711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.498712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.498713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.498715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.498754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.498759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.498766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.498771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.498789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.498806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.498811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.498812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.498820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.498828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.498839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.498844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.498854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.498858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.498860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.498863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.498865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.498870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.498954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136344:7773], now have 1 active actors on pipe
2025-10-02T09:30:50.498962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136130:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.499003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 892
2025-10-02T09:30:50.499004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 892
2025-10-02T09:30:50.499429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.499435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.499450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1e36c57-15dbe50-87420067-ccda34d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.499458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.499460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.499461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.499467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.499477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.499488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.499607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.499612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.499619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.499694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 893 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1e36c57-15dbe50-87420067-ccda34d4_0
2025-10-02T09:30:50.499946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b53c96f-4125e4fc-96d1ba23-55e81032_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1e36c57-15dbe50-87420067-ccda34d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.502241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Write session: try to update token
2025-10-02T09:30:50.502253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.508732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.508748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.508750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.508752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.508759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.508764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.508768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435611068:6608]
2025-10-02T09:30:50.508798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.508815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.508820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.508822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.508822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.508824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.508943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.513195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId: src_id|c1e36c57-15dbe50-87420067-ccda34d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.515099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:50.571820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554509511136359:7261]
2025-10-02T09:30:50.572020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 892, pipe: [1:7556554509511136359:7261]
2025-10-02T09:30:50.630793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.631020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.631033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.631065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136359:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.631293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:50.631306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:50.631353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 893 reason: error at write: Disconnected sessionId: src_id|c1e36c57-15dbe50-87420067-ccda34d4_0
2025-10-02T09:30:50.631367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.631402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554509511136359:7261]
2025-10-02T09:30:50.631476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 893 sessionId: src_id|c1e36c57-15dbe50-87420067-ccda34d4_0 is DEAD
2025-10-02T09:30:50.631613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:50.631622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Write session will restart in 0.005718s
2025-10-02T09:30:50.631637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Write session: Do CDS request
2025-10-02T09:30:50.631627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:50.631644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.638070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.638179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.638190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 894
2025-10-02T09:30:50.638291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.638318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.638326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.638329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.638672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 894 sessionId:  describe result for acl check
2025-10-02T09:30:50.638699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.638705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.638707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.638712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511136419:7777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.639193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511136419:7777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.641154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511136419:7777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.642810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.644327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511136419:7777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.644338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511136419:7777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.644340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511136419:7777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.644344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.644349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.644453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.644459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.644465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.644492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.644518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435611306:6611]
2025-10-02T09:30:50.644893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.645088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.645113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.645301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.645340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.645344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.645346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.645346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.645347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.645347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.645348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.645349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.645349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.645350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.645350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.645351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.645354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.645361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.645363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.645365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.645367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.645369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.645371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.645374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.645375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.645378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.645379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.645381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.645386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.645390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.645394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.645397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.645399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.645402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.645404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.645406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.645409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.645412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.645414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.645417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.645421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.645424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.645426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.645429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.645431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.645434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.645437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.645441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.645444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.645447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.645449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.645451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.645469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.653545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.654982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.654994Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.654995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.654997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.655001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 893 [2:7556554509435611306:6611]
2025-10-02T09:30:50.655009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.655020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.655025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.655027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.655028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.655037Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.655040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.655046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.655079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.655085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.655086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.655088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.655089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.655143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.655152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.655158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.655164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.655172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.655184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136578:7777], now have 1 active actors on pipe
2025-10-02T09:30:50.655186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136360:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.655190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.655192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.655193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.655201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.655208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.655216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.655218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.655217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.655220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.655221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.655234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.655240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.655225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 893
2025-10-02T09:30:50.655242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.655227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 893
2025-10-02T09:30:50.655260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.655262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.655472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.655482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.655484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.655485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.655491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.655497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.655511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.655633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.655638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.655646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.655698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 894 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0
2025-10-02T09:30:50.655969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e36c57-15dbe50-87420067-ccda34d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.658184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Write session: try to update token
2025-10-02T09:30:50.658195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.665087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.665109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.665113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.665115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.665125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.665129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.665133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435611300:6611]
2025-10-02T09:30:50.665170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.665171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.665177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.665180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.665190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.665192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.665443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.669597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId: src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.671571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:50.731568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554509511136602:7261]
2025-10-02T09:30:50.731779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 893, pipe: [1:7556554509511136602:7261]
2025-10-02T09:30:50.785703Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.786017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.786026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.786051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136602:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.786168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:50.786178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554509511136602:7261]
2025-10-02T09:30:50.786180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:50.786183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:50.786200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.786225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 894 reason: error at write: Disconnected sessionId: src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0
2025-10-02T09:30:50.786361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 894 sessionId: src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0 is DEAD
2025-10-02T09:30:50.786488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:50.786497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Write session will restart in 0.008083s
2025-10-02T09:30:50.786510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Write session: Do CDS request
2025-10-02T09:30:50.786514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.795167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.795249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.795261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 895
2025-10-02T09:30:50.795337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.795359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.795365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.795368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.795650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 895 sessionId:  describe result for acl check
2025-10-02T09:30:50.795676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.795680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.795682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.795684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511136782:7783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.796015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511136782:7783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.797131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.797489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511136782:7783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.798656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.798767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.798773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.798779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.798806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.798828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435611529:6613]
2025-10-02T09:30:50.799201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.799374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.799405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.799497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511136782:7783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.799506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511136782:7783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.799508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511136782:7783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.799512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.799653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.799693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.799698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.799698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.799699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.799699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.799700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.799700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.799701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.799701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.799702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.799702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.799703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.799706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.799711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.799713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.799715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.799717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.799719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.799721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.799723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.799725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.799727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.799729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.799731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.799735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.799739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.799742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.799745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.799747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.799749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.799752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.799754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.799757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.799759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.799762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.799765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.799767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.799770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.799772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.799775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.799777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.799779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.799782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.799784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.799786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.799789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.799791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.799793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.799811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.807353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.808657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.808669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.808670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.808672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.808675Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 894 [2:7556554509435611529:6613]
2025-10-02T09:30:50.808682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.808692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.808697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.808698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.808699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.808708Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.808714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.808718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.808749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.808754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.808754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.808756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.808758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.808793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.808799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.808828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.808841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.808859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.808878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136831:7783], now have 1 active actors on pipe
2025-10-02T09:30:50.808885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136610:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.808890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.808895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.808896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.808882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 894
2025-10-02T09:30:50.808896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 894
2025-10-02T09:30:50.808903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.808910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.808917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.808918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.808920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.808928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.808934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.808946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.808953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.808979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.808989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.808995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.809001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d35db8d5-452bc454-c17ebba5-9072c002_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.809008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.809010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.809011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.809017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.809022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.809044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.809144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.809151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.809161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.809208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 895 partition: 0 MaxSeqNo: 36 sessionId: src_id|d35db8d5-452bc454-c17ebba5-9072c002_0
2025-10-02T09:30:50.809416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8dbf69-ffd88ecd-9aeac75c-1acb6542_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d35db8d5-452bc454-c17ebba5-9072c002_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.811682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Write session: try to update token
2025-10-02T09:30:50.811693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.819049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.819073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.819075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.819077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.819087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.819093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.819099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435611523:6613]
2025-10-02T09:30:50.819140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.819151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.819157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.819157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.819160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.819159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.819414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.823267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId: src_id|d35db8d5-452bc454-c17ebba5-9072c002_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.825591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:50.886176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554509511136844:7261]
2025-10-02T09:30:50.886346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 894, pipe: [1:7556554509511136844:7261]
2025-10-02T09:30:50.939570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:50.940071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.940081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.940109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136844:7261], now have 1 active actors on pipe
2025-10-02T09:30:50.940290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:50.940324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:50.940370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:50.940375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554509511136844:7261]
2025-10-02T09:30:50.940424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 895 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d35db8d5-452bc454-c17ebba5-9072c002_0
2025-10-02T09:30:50.940566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 895 sessionId: src_id|d35db8d5-452bc454-c17ebba5-9072c002_0 is DEAD
2025-10-02T09:30:50.940688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:50.940693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Write session will restart in 0.009932s
2025-10-02T09:30:50.940709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Write session: Do CDS request
2025-10-02T09:30:50.940713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:50.951175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.951313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:50.951325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 896
2025-10-02T09:30:50.951434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:50.951468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:50.951474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:50.951477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:50.951750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 896 sessionId:  describe result for acl check
2025-10-02T09:30:50.951769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:50.951770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:50.951771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:50.951773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554509511137031:7787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:50.952012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:50.952126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554509511137031:7787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:50.953586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:50.953653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554509511137031:7787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:50.953684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:50.953691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:50.953698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:50.953725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:50.953749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554509435611755:6616]
2025-10-02T09:30:50.954101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:50.954284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:50.954308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:50.954492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:50.954522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.954526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.954526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.954527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.954528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.954528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.954529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.954529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.954530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.954530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.954531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.954531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.954534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.954541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.954543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.954545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.954547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.954549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.954551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.954553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.954555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.954557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.954559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.954561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.954565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.954568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:50.954573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.954575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:50.954578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.954580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:50.954583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.954586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:50.954588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.954591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:50.954593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.954596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:50.954598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.954601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:50.954603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.954606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:50.954610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.954612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:50.954614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.954617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.954619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.954623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.954625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.954628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.954648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:50.958653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554509511137031:7787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:50.958663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554509511137031:7787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:50.958665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554509511137031:7787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:50.958669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:50.962339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:50.963785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:50.963798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:50.963799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:50.963801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:50.963805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 895 [2:7556554509435611755:6616]
2025-10-02T09:30:50.963813Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:50.963824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:50.963829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.963830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.963831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.963841Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:50.963844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:50.963848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:50.963881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.963886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.963888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.963890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:50.963891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:50.963932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:50.963935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.963942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:50.963947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:50.963964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:50.963984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511137069:7787], now have 1 active actors on pipe
2025-10-02T09:30:50.963991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554509511136845:2446], now have 1 active actors on pipe
2025-10-02T09:30:50.963996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.963998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.964000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.964010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:50.964023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:50.964024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:50.964031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:50.964032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:50.964036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:50.964039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:50.964058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.964064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:50.964066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:50.964047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 895
2025-10-02T09:30:50.964047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 895
2025-10-02T09:30:50.964239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.964249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.964275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|237b75f7-98c27b86-bd53cbba-90c31238_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:50.964285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:50.964287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:50.964288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:50.964294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:50.964300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:50.964313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.964434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:50.964441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:50.964450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:50.964506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 896 partition: 0 MaxSeqNo: 36 sessionId: src_id|237b75f7-98c27b86-bd53cbba-90c31238_0
2025-10-02T09:30:50.964764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35db8d5-452bc454-c17ebba5-9072c002_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|237b75f7-98c27b86-bd53cbba-90c31238_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:50.966964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Write session: try to update token
2025-10-02T09:30:50.966975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:50.973679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:50.973695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:50.973697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:50.973698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:50.973703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.973706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.973708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554509435611749:6616]
2025-10-02T09:30:50.973730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:50.973734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:50.973735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:50.973739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:50.973744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:50.973747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:50.973855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:50.977785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId: src_id|237b75f7-98c27b86-bd53cbba-90c31238_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:50.979987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.040320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554513806104373:7261]
2025-10-02T09:30:51.040603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 895, pipe: [1:7556554513806104373:7261]
2025-10-02T09:30:51.095197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:51.095499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.095510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.095536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104373:7261], now have 1 active actors on pipe
2025-10-02T09:30:51.095681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:51.095750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:51.095764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:51.095826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 896 reason: error at write: Disconnected sessionId: src_id|237b75f7-98c27b86-bd53cbba-90c31238_0
2025-10-02T09:30:51.095991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 896 sessionId: src_id|237b75f7-98c27b86-bd53cbba-90c31238_0 is DEAD
2025-10-02T09:30:51.096118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:51.096129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Write session will restart in 0.008900s
2025-10-02T09:30:51.096146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Write session: Do CDS request
2025-10-02T09:30:51.096152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:51.096141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:51.096180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806104373:7261]
2025-10-02T09:30:51.106342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.106421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:51.106435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 897
2025-10-02T09:30:51.106728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.106760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:51.106768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:51.106771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:51.107126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 897 sessionId:  describe result for acl check
2025-10-02T09:30:51.107155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:51.107161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:51.107162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:51.107166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554513806104581:7798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:51.107666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554513806104581:7798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:51.108623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:51.109051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554513806104581:7798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:51.110253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:51.110420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:51.110434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:51.110446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:51.110512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:51.110553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554513730579313:6624]
2025-10-02T09:30:51.110915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554513806104581:7798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:51.110924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554513806104581:7798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:51.110926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554513806104581:7798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:51.110930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:51.111161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:51.111352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:51.111378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:51.111570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:51.111599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.111603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.111603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.111604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.111605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.111605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.111606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.111606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.111607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.111607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.111608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.111608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.111611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.111617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.111619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.111621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.111623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.111625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.111627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.111629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.111631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.111633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.111635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.111637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.111640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.111644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.111647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.111650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.111652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.111655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.111658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.111660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.111663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.111665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.111668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.111670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.111673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.111675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.111677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.111680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.111683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.111686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.111688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.111691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.111693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.111696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.111698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.111700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.111718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:51.121178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:51.122715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:51.122729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:51.122730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:51.122737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:51.122740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 896 [2:7556554513730579313:6624]
2025-10-02T09:30:51.122748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:51.122759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:51.122760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.122762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.122764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.122773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:51.122776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:51.122780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:51.122815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.122820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.122822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.122824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:51.122825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:51.122863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:51.122868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.122874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.122879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.122887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:51.122900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104616:7798], now have 1 active actors on pipe
2025-10-02T09:30:51.122908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.122909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.122910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.122920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:51.122925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104387:2446], now have 1 active actors on pipe
2025-10-02T09:30:51.122930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:51.122930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:51.122932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:51.122934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:51.122939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:51.122941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:51.122965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.122974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:51.122980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:51.122975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 896
2025-10-02T09:30:51.122978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 896
2025-10-02T09:30:51.123009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.123014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.123031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:51.123035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.123037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.123038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.123044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.123050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:51.123058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.123143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.123150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.123157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.123213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 897 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0
2025-10-02T09:30:51.123483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b75f7-98c27b86-bd53cbba-90c31238_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:51.131064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Write session: try to update token
2025-10-02T09:30:51.131082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:51.134264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:51.134281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.134283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:51.134284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:51.134292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.134296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.134299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554513730579308:6624]
2025-10-02T09:30:51.134330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:51.134333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:51.134336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:51.134338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.134339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:51.134341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:51.134463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:51.149823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId: src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:51.154356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.196458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554513806104630:7261]
2025-10-02T09:30:51.196694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 896, pipe: [1:7556554513806104630:7261]
2025-10-02T09:30:51.253365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:51.253689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.253698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.253711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104630:7261], now have 1 active actors on pipe
2025-10-02T09:30:51.253953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:51.253966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:51.253970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:51.254013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 897 reason: error at write: Disconnected sessionId: src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0
2025-10-02T09:30:51.254014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:51.254019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806104630:7261]
2025-10-02T09:30:51.254141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 897 sessionId: src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0 is DEAD
2025-10-02T09:30:51.254308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:51.254320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Write session will restart in 0.008107s
2025-10-02T09:30:51.254343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Write session: Do CDS request
2025-10-02T09:30:51.254349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:51.263252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.263375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:51.263386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 898
2025-10-02T09:30:51.263491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.263511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:51.263517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:51.263520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:51.263815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 898 sessionId:  describe result for acl check
2025-10-02T09:30:51.263843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:51.263847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:51.263848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:51.263851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554513806104784:7803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:51.264180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554513806104784:7803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:51.265264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:51.265540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554513806104784:7803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:51.267235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:51.267373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:51.267381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:51.267386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:51.267416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:51.267439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554513730579541:6633]
2025-10-02T09:30:51.267467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554513806104784:7803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:51.267476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554513806104784:7803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:51.267478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554513806104784:7803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:51.267482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:51.267780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:51.267980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:51.268001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:51.268176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:51.268205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.268209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.268209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.268210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.268211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.268211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.268212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.268212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.268213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.268213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.268214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.268214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.268217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.268223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.268225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.268227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.268229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.268231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.268233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.268235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.268237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.268239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.268241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.268243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.268247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.268251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.268255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.268258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.268260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.268262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.268264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.268267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.268271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.268274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.268276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.268279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.268281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.268284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.268286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.268288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.268294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.268298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.268300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.268302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.268304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.268307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.268309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.268311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.268326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:51.275737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:51.277227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:51.277239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:51.277240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:51.277242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:51.277245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 897 [2:7556554513730579541:6633]
2025-10-02T09:30:51.277252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:51.277261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:51.277264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.277266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.277267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.277277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:51.277284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:51.277288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:51.277317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.277321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.277323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.277325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:51.277326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:51.277362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:51.277367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.277373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.277378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.277385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:51.277400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104853:7803], now have 1 active actors on pipe
2025-10-02T09:30:51.277405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104631:2446], now have 1 active actors on pipe
2025-10-02T09:30:51.277409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.277410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.277411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.277419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:51.277427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:51.277433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:51.277435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:51.277436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:51.277437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:51.277439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:51.277452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.277457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:51.277446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 897
2025-10-02T09:30:51.277449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 897
2025-10-02T09:30:51.277470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:51.277475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.277477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.277494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:51.277501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.277503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.277504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.277509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.277516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:51.277525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.277618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.277622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.277630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.277683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 898 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0
2025-10-02T09:30:51.277908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d323e8a-85d60ddc-18a7e7c9-faf1d188_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:51.280277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Write session: try to update token
2025-10-02T09:30:51.280287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:51.287033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:51.287049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.287051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:51.287052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:51.287058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.287061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.287065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554513730579535:6633]
2025-10-02T09:30:51.287089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:51.287092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.287094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:51.287103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:51.287108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:51.287110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:51.287214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:51.290679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId: src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:51.292922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.354158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554513806104865:7261]
2025-10-02T09:30:51.354411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 897, pipe: [1:7556554513806104865:7261]
2025-10-02T09:30:51.410788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:51.411140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.411156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.411188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104865:7261], now have 1 active actors on pipe
2025-10-02T09:30:51.411382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:51.411385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:51.411398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:51.411421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806104865:7261]
2025-10-02T09:30:51.411465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 898 reason: error at write: Disconnected sessionId: src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0
2025-10-02T09:30:51.411562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:51.411629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 898 sessionId: src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0 is DEAD
2025-10-02T09:30:51.411756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:51.411762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Write session will restart in 0.009699s
2025-10-02T09:30:51.411778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Write session: Do CDS request
2025-10-02T09:30:51.411782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:51.422252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.422328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:51.422348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 899
2025-10-02T09:30:51.422441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.422471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:51.422476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:51.422479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:51.422845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 899 sessionId:  describe result for acl check
2025-10-02T09:30:51.422875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:51.422880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:51.422882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:51.422887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554513806105005:7807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:51.423366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554513806105005:7807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:51.424775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554513806105005:7807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:51.425133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:51.426933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:51.427022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554513806105005:7807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:51.427037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554513806105005:7807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:51.427039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554513806105005:7807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:51.427043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:51.427076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:51.427084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:51.427090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:51.427120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:51.427143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554513730579768:6635]
2025-10-02T09:30:51.427503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:51.427704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:51.427728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:51.427918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:51.427953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.427958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.427958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.427959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.427960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.427960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.427961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.427961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.427962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.427962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.427963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.427963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.427966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.427973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.427975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.427977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.427979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.427981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.427983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.427985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.427987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.427990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.427991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.427993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.427997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.428001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.428004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.428007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.428009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.428012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.428014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.428016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.428018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.428022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.428026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.428030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.428034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.428038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.428041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.428045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.428049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.428053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.428056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.428060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.428063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.428069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.428077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.428086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.428120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:51.436104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:51.437580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:51.437600Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:51.437602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:51.437606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:51.437612Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 898 [2:7556554513730579768:6635]
2025-10-02T09:30:51.437623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:51.437639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:51.437644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.437647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.437649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.437661Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:51.437667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:51.437672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:51.437721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.437733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.437734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.437737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:51.437739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:51.437792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:51.437800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.437812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.437822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.437836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:51.437857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806104866:2446], now have 1 active actors on pipe
2025-10-02T09:30:51.437866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105089:7807], now have 1 active actors on pipe
2025-10-02T09:30:51.437871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.437873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.437875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.437886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:51.437905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:51.437905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:51.437908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:51.437910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:51.437922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:51.437925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:51.437918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 898
2025-10-02T09:30:51.437920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 898
2025-10-02T09:30:51.437949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.437959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:51.437961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:51.437982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.437992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.438017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:51.438029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.438033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.438035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.438044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.438052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:51.438066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.438196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.438203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.438212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.438267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 899 partition: 0 MaxSeqNo: 36 sessionId: src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0
2025-10-02T09:30:51.438549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8a86c-577939f9-3d6f5971-381e16d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:51.440869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Write session: try to update token
2025-10-02T09:30:51.440882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:51.448083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:51.448106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.448108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:51.448111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:51.448119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.448124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.448128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554513730579763:6635]
2025-10-02T09:30:51.448163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:51.448165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:51.448170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.448172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:51.448174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:51.448176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:51.448304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:51.452371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId: src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:51.454579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.511324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554513806105101:7261]
2025-10-02T09:30:51.511515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 898, pipe: [1:7556554513806105101:7261]
2025-10-02T09:30:51.577163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:51.577655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.577666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.577694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105101:7261], now have 1 active actors on pipe
2025-10-02T09:30:51.577827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:51.577893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:51.577906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806105101:7261]
2025-10-02T09:30:51.577924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:51.577975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 899 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0
2025-10-02T09:30:51.578102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 899 sessionId: src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0 is DEAD
2025-10-02T09:30:51.578197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:51.578205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Write session will restart in 0.005611s
2025-10-02T09:30:51.578222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Write session: Do CDS request
2025-10-02T09:30:51.578226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:51.585168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.585267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:51.585278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 900
2025-10-02T09:30:51.585381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.585407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:51.585421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:51.585428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:51.585802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 900 sessionId:  describe result for acl check
2025-10-02T09:30:51.585828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:51.585833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:51.585835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:51.585839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554513806105184:7813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:51.586274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554513806105184:7813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:51.588024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554513806105184:7813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:51.590778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:51.590950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554513806105184:7813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:51.590961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554513806105184:7813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:51.590963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554513806105184:7813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:51.590966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:51.591025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:51.591117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:51.591124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:51.591129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:51.591154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:51.591176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554513730579997:6637]
2025-10-02T09:30:51.591512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:51.591661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:51.591683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:51.591853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:51.591882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.591886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.591887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.591887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.591888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.591888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.591889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.591889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.591890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.591890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.591891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.591891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.591894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.591900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.591902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.591904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.591906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.591908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.591910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.591912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.591914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.591916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.591918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.591920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.591924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.591927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.591931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.591934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.591936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.591939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.591941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.591944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.591946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.591950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.591952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.591954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.591957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.591959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.591961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.591964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.591966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.591968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.591970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.591973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.591975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.591977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.591981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.591983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.592000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:51.599471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:51.601093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:51.601106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:51.601107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:51.601109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:51.601113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 899 [2:7556554513730579997:6637]
2025-10-02T09:30:51.601120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:51.601130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:51.601131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.601133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.601134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.601143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:51.601146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:51.601151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:51.601184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.601189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.601190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.601192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:51.601194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:51.601231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:51.601236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.601242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.601247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.601255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:51.601270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105329:7813], now have 1 active actors on pipe
2025-10-02T09:30:51.601275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105105:2446], now have 1 active actors on pipe
2025-10-02T09:30:51.601278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.601280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.601281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.601287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:51.601295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:51.601300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:51.601302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:51.601304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:51.601307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:51.601308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:51.601319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.601320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:51.601341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:51.601348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.601318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 899
2025-10-02T09:30:51.601350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.601326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 899
2025-10-02T09:30:51.601363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:51.601366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.601369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.601370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.601376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.601381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:51.601395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.601486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.601491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.601498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.601564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 900 partition: 0 MaxSeqNo: 36 sessionId: src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0
2025-10-02T09:30:51.601908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e50de45d-8c1eab64-dc85e72f-4a4c73e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:51.604913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Write session: try to update token
2025-10-02T09:30:51.604928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:51.610737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:51.610754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.610755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:51.610756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:51.610761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.610764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.610766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554513730579991:6637]
2025-10-02T09:30:51.610789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:51.610792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.610793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:51.610795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:51.610799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:51.610801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:51.610912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:51.619006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId: src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:51.621031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.678232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554513806105353:7261]
2025-10-02T09:30:51.678413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 899, pipe: [1:7556554513806105353:7261]
2025-10-02T09:30:51.726545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:51.726890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.726898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.726911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105353:7261], now have 1 active actors on pipe
2025-10-02T09:30:51.727054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:51.727078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:51.727079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:51.727093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:51.727107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806105353:7261]
2025-10-02T09:30:51.727138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 900 reason: error at write: Disconnected sessionId: src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0
2025-10-02T09:30:51.727271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 900 sessionId: src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0 is DEAD
2025-10-02T09:30:51.727461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:51.727485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Write session will restart in 0.008279s
2025-10-02T09:30:51.727507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Write session: Do CDS request
2025-10-02T09:30:51.727514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:51.737183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.737262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:51.737271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 901
2025-10-02T09:30:51.737408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.737433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:51.737441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:51.737443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:51.737709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 901 sessionId:  describe result for acl check
2025-10-02T09:30:51.737733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:51.737737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:51.737738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:51.737741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554513806105544:7818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:51.737819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:51.738098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554513806105544:7818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:51.739381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:51.739482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:51.739489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:51.739495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:51.739522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:51.739544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554513730580237:6640]
2025-10-02T09:30:51.739773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554513806105544:7818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:51.739886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:51.740049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:51.740071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:51.740241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:51.740269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.740272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.740273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.740274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.740274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.740275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.740275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.740276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.740278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.740278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.740281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.740287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.740289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.740292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.740294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.740295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.740298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.740299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.740301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.740303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.740305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.740307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.740311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.740314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.740318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.740321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.740323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.740326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.740328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.740331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.740334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.740336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.740338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.740341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.740343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.740346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.740349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.740352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.740354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.740357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.740359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.740362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.740364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.740366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.740368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.740371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.740388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:51.744261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554513806105544:7818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:51.744272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554513806105544:7818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:51.744275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554513806105544:7818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:51.744280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:51.747858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:51.749270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:51.749284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:51.749285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:51.749288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:51.749291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 900 [2:7556554513730580237:6640]
2025-10-02T09:30:51.749299Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:51.749309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:51.749310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.749312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.749313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.749321Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:51.749330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:51.749335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:51.749366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.749371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.749372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.749374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:51.749375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:51.749412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:51.749417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.749423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.749428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.749439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:51.749454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105355:2446], now have 1 active actors on pipe
2025-10-02T09:30:51.749459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105584:7818], now have 1 active actors on pipe
2025-10-02T09:30:51.749463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.749464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.749465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.749473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:51.749480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:51.749485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:51.749487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:51.749489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:51.749490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:51.749492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:51.749487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 900
2025-10-02T09:30:51.749487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 900
2025-10-02T09:30:51.749506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.749511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:51.749512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:51.749606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.749612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.749639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:51.749646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.749648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.749653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.749658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.749664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:51.749676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.749768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.749773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.749780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.749837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 901 partition: 0 MaxSeqNo: 36 sessionId: src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0
2025-10-02T09:30:51.750124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29d921e-84a4bfc5-5d7cb26-882870f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:51.752835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Write session: try to update token
2025-10-02T09:30:51.752847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:51.758776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:51.758790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.758792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:51.758794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:51.758798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.758803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.758806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554513730580231:6640]
2025-10-02T09:30:51.758829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:51.758834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:51.758837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.758838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:51.758839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:51.758841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:51.759036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:51.764183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId: src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:51.766297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.827253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554513806105598:7261]
2025-10-02T09:30:51.827466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 900, pipe: [1:7556554513806105598:7261]
2025-10-02T09:30:51.870619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:51.871036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.871045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.871058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105598:7261], now have 1 active actors on pipe
2025-10-02T09:30:51.871270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806105598:7261]
2025-10-02T09:30:51.871276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:51.871281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:51.871302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:51.871331Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:30:51.871333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 901 reason: error at write: Disconnected sessionId: src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0
2025-10-02T09:30:51.871409Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 9 consumer shared/user session shared/user_1_9_9887809511957613091_v1 is DEAD
2025-10-02T09:30:51.871429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 901 sessionId: src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0 is DEAD
2025-10-02T09:30:51.871509Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554449381576631:7258] disconnected; active server actors: 1
2025-10-02T09:30:51.871516Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554449381576631:7258] client user disconnected session shared/user_1_9_9887809511957613091_v1
2025-10-02T09:30:51.871567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:51.871656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:51.871661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Write session will restart in 0.006809s
2025-10-02T09:30:51.871676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Write session: Do CDS request
2025-10-02T09:30:51.871681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:51.871736Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:30:51.871900Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:51.871905Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:30:51.871916Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006474s
2025-10-02T09:30:51.879070Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:30:51.879220Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:30:51.879229Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 10
2025-10-02T09:30:51.879289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.879350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:51.879365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 902
2025-10-02T09:30:51.879380Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:51.879419Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:30:51.879448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:51.879480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:51.879488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:51.879491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:51.879509Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 auth for : user
2025-10-02T09:30:51.879724Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 Handle describe topics response
2025-10-02T09:30:51.879745Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 auth is DEAD
2025-10-02T09:30:51.879762Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:30:51.879910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 902 sessionId:  describe result for acl check
2025-10-02T09:30:51.879936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:51.879942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:51.879943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:51.879948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554513806105711:7824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:51.879984Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:30:51.880039Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_10_3393095593970451761_v1
2025-10-02T09:30:51.880092Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554513806105713:7823] connected; active server actors: 1
2025-10-02T09:30:51.880133Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554513806105713:7823] session shared/user_1_10_3393095593970451761_v1
2025-10-02T09:30:51.880142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:30:51.880154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:30:51.880163Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_10_3393095593970451761_v1" (Sender=[1:7556554513806105679:7823], Pipe=[1:7556554513806105713:7823], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:51.880170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:30:51.880178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:30:51.880189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_10_3393095593970451761_v1" (Sender=[1:7556554513806105679:7823], Pipe=[1:7556554513806105713:7823], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:30:51.880200Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_10_3393095593970451761_v1" sender [1:7556554513806105679:7823] lock partition 0 for ReadingSession "shared/user_1_10_3393095593970451761_v1" (Sender=[1:7556554513806105679:7823], Pipe=[1:7556554513806105713:7823], Partitions=[], ActiveFamilyCount=1) generation 1 step 10
2025-10-02T09:30:51.880209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:30:51.880217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-10-02T09:30:51.880388Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 10 Session: "shared/user_1_10_3393095593970451761_v1" ClientId: "user" PipeClient { RawX1: 7556554513806105713 RawX2: 4503603922345615 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:30:51.880397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554513806105711:7824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:51.880401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:30:51.882188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554513806105711:7824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:51.882614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:51.884235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:51.884427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:51.884436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:51.884443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:51.884475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554513806105711:7824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:51.884488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554513806105711:7824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:51.884476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:51.884491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554513806105711:7824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:51.884496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:51.884499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554513730580467:6642]
2025-10-02T09:30:51.884890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:51.885063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:51.885090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:51.885278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:51.885307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.885311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.885311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.885312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.885312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.885313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.885313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.885314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.885314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.885315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.885316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.885316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.885319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.885325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.885328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.885330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.885332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.885334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.885336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.885338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.885340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.885342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.885344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.885346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.885350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.885354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:51.885357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.885359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:51.885363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.885366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:51.885368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.885371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:51.885373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.885376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:51.885378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.885381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:51.885383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.885387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:51.885389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.885392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:51.885398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.885401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:51.885403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.885406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.885411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.885414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.885416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.885418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.885435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:51.893070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:51.894497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:51.894512Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:51.894513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:51.894515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:51.894519Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 901 [2:7556554513730580467:6642]
2025-10-02T09:30:51.894526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:51.894536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:51.894537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.894539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.894541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.894549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:51.894556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:51.894560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:51.894592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.894597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.894598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.894600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:51.894601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:51.894640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:51.894645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.894652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:51.894657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:51.894669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:51.894684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105836:7824], now have 1 active actors on pipe
2025-10-02T09:30:51.894690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105736:7829], now have 1 active actors on pipe
2025-10-02T09:30:51.894691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554513806105603:2446], now have 1 active actors on pipe
2025-10-02T09:30:51.894695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.894696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.894697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.894707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:51.894717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:51.894728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:51.894733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:51.894735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:51.894738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:51.894740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:51.894735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 901
2025-10-02T09:30:51.894738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 901
2025-10-02T09:30:51.894749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.894764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 901, pipe: [1:7556554513806105736:7829]
2025-10-02T09:30:51.894754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:51.894763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:51.894779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.894784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.894797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.894801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.894804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_10_3393095593970451761_v1 on pipe: [1:7556554513806105736:7829]
2025-10-02T09:30:51.894822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:51.894830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.894830Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_10_3393095593970451761_v1:1 with generation 901
2025-10-02T09:30:51.894832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.894833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.894838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.894844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:51.894853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.894858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.894859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:51.894867Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_10_3393095593970451761_v1
2025-10-02T09:30:51.894872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.894886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.894898Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:30:51.895007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.895013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.895021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:51.895079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 902 partition: 0 MaxSeqNo: 36 sessionId: src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0
2025-10-02T09:30:51.895290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51dab79-f2363f90-4ac52eb3-38d40f7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:51.897757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Write session: try to update token
2025-10-02T09:30:51.897768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:51.898673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:30:51.898690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:30:51.898695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:51.898696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:51.898697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:51.898701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:30:51.898706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:30:51.898807Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397451894 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:30:51.898822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:30:51.898846Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 sending to client partition status
2025-10-02T09:30:51.903980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:51.903995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.904000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.904023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:51.904024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:51.904178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:51.904302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:51.904418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:51.904543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:51.904702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:51.904729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:51.908269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId: src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:51.910508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:51.910640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:51.910649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:51.910666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:51.910720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:51.913695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:51.913708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:51.913710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:51.913711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:51.913716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.913719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.913722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554513730580461:6642]
2025-10-02T09:30:51.913741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:51.913744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:51.913747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:51.913749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:51.913749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:51.913750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:51.913858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.028723Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:52.034815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.034839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.034973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.035028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.035084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.035137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.035176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.035182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.035237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.035292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.035347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.035401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.035440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.035446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.035497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.035548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.035601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.035653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.035690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.035695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.035748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.035809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.035868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.035921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.035958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.035962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.036017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.036068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.036122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.036176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.036213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.036218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.036272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.036328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.036382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.036467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.036506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.036510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.036560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.036610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.036663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.036717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.036752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.036757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.036829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.036881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.036933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.036983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.037018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.037022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.037073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.037126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.037179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.037239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.037278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.037285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.037335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:52.037384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:52.037433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:52.037481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:52.037527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:52.037532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:52.037754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:52.037759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554513806105736:7829]
2025-10-02T09:30:52.037765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:52.037785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:52.037794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 902 reason: error at write: Disconnected sessionId: src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0
2025-10-02T09:30:52.037943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 902 sessionId: src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0 is DEAD
2025-10-02T09:30:52.038085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:52.038100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Write session will restart in 0.006706s
2025-10-02T09:30:52.038111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_10_3393095593970451761_v1
2025-10-02T09:30:52.038122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Write session: Do CDS request
2025-10-02T09:30:52.038129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:52.038125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:52.038155Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_10_3393095593970451761_v1
2025-10-02T09:30:52.046237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.046350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:52.046362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 903
2025-10-02T09:30:52.046485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.046513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:52.046524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:52.046528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:52.046813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 903 sessionId:  describe result for acl check
2025-10-02T09:30:52.046837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:52.046842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:52.046843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:52.046846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554518101073243:7831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:52.047226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554518101073243:7831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:52.049281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554518101073243:7831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:52.049836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:52.051444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:52.051540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:52.051547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:52.051553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:52.051578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:52.051603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554518025547998:6645]
2025-10-02T09:30:52.051715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554518101073243:7831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:52.051726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554518101073243:7831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:52.051730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554518101073243:7831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:52.051734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:52.051947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:52.052098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:52.052122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:52.052300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:52.052328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.052331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.052332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.052333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.052333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.052334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.052334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.052335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.052335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.052336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.052337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.052337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.052340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.052346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.052348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.052350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.052352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.052354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.052356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.052358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.052360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.052363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.052365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.052367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.052370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.052374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.052378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.052381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.052383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.052386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.052388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.052391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.052405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.052408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.052410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.052412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.052415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.052418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.052419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.052422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.052424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.052427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.052429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.052433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.052436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.052439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.052441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.052444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.052459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:52.059929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:52.061546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:52.061560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:52.061561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:52.061564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:52.061567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 902 [2:7556554518025547998:6645]
2025-10-02T09:30:52.061574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:52.061583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:52.061585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.061586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.061588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.061597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:52.061599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:52.061604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:52.061636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.061641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.061642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.061645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:52.061646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:52.061682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:52.061686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.061693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.061698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.061709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:52.061723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073371:7831], now have 1 active actors on pipe
2025-10-02T09:30:52.061728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073145:2446], now have 1 active actors on pipe
2025-10-02T09:30:52.061732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.061733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.061735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.061745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:52.061754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:52.061756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:52.061757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:52.061757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:52.061765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:52.061770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:52.061783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.061792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:52.061789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 902
2025-10-02T09:30:52.061805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:52.061799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 902
2025-10-02T09:30:52.061826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.061831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.061844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f257629d-75058868-2904920d-9fcf90b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:52.061850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.061853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.061854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:52.061859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.061867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:52.061877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.061987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.061992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.062000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.062064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 903 partition: 0 MaxSeqNo: 36 sessionId: src_id|f257629d-75058868-2904920d-9fcf90b8_0
2025-10-02T09:30:52.062382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39125897-4711fd44-d0ed0b76-5e1ea3b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f257629d-75058868-2904920d-9fcf90b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:52.065177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Write session: try to update token
2025-10-02T09:30:52.065194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:52.070980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:52.070994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.070999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.071025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:52.071026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:52.071168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:52.071302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:52.071425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:52.071550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:52.071716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:52.071749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:52.079467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:52.079484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.079485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:52.079486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:52.079491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.079494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.079496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554518025547993:6645]
2025-10-02T09:30:52.079517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:52.079519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:52.079521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.079522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:52.079523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:52.079524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:52.079647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.080666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId: src_id|f257629d-75058868-2904920d-9fcf90b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:52.082903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:52.138025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554518101073404:7829]
2025-10-02T09:30:52.138367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 902, pipe: [1:7556554518101073404:7829]
2025-10-02T09:30:52.199373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:52.199577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.199587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.199604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073404:7829], now have 1 active actors on pipe
2025-10-02T09:30:52.199750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:52.199800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:52.199841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554518101073404:7829]
2025-10-02T09:30:52.199865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:52.199944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 903 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f257629d-75058868-2904920d-9fcf90b8_0
2025-10-02T09:30:52.200096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 903 sessionId: src_id|f257629d-75058868-2904920d-9fcf90b8_0 is DEAD
2025-10-02T09:30:52.200212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:52.200221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Write session will restart in 0.009142s
2025-10-02T09:30:52.200237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Write session: Do CDS request
2025-10-02T09:30:52.200241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:52.210160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.210264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:52.210276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 904
2025-10-02T09:30:52.210374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.210408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:52.210416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:52.210420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:52.210814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 904 sessionId:  describe result for acl check
2025-10-02T09:30:52.210846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:52.210852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:52.210854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:52.210858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554518101073568:7843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:52.211322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554518101073568:7843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:52.212387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:52.213195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554518101073568:7843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:52.214292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:52.214383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:52.214390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:52.214396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:52.214424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:52.214458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554518025548267:6660]
2025-10-02T09:30:52.214804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:52.214978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:52.215003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:52.215182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:52.215191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554518101073568:7843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:52.215203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554518101073568:7843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:52.215205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554518101073568:7843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:52.215211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:52.215221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.215226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.215226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.215227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.215227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.215228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.215228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.215229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.215229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.215229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.215230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.215230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.215233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.215239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.215241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.215243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.215245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.215247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.215249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.215251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.215253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.215255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.215257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.215259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.215262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.215266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.215269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.215272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.215274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.215276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.215279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.215282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.215284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.215287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.215289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.215291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.215293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.215295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.215297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.215300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.215302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.215308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.215310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.215312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.215315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.215317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.215319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.215322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.215342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:52.222758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:52.224148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:52.224158Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:52.224159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:52.224162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:52.224165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 903 [2:7556554518025548267:6660]
2025-10-02T09:30:52.224172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:52.224182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:52.224183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.224185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.224186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.224196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:52.224202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:52.224206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:52.224237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.224242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.224243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.224244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:52.224246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:52.224285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:52.224290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.224296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.224302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.224313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:52.224328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073639:7843], now have 1 active actors on pipe
2025-10-02T09:30:52.224333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073409:2446], now have 1 active actors on pipe
2025-10-02T09:30:52.224337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.224339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.224340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.224347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:52.224358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:52.224360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:52.224362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:52.224363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:52.224368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:52.224370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:52.224384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.224390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:52.224394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:52.224394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 903
2025-10-02T09:30:52.224396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 903
2025-10-02T09:30:52.224431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.224438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.224456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2fec57-a43a9403-b16e6fec-45673733_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:52.224463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.224465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.224466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:52.224472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.224477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:52.224487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.224606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.224610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.224617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.224675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 904 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2fec57-a43a9403-b16e6fec-45673733_0
2025-10-02T09:30:52.224923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257629d-75058868-2904920d-9fcf90b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2fec57-a43a9403-b16e6fec-45673733_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:52.227371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Write session: try to update token
2025-10-02T09:30:52.227381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:52.237461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:52.237475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.237481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.237510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:52.237512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:52.237650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:52.237827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:52.237948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:52.238072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:52.238236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:52.238268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:52.241229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId: src_id|e2fec57-a43a9403-b16e6fec-45673733_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:52.241924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:52.241935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.241936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:52.241937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:52.241941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.241943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.241946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554518025548262:6660]
2025-10-02T09:30:52.241965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:52.241966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:52.241968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:52.241970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:52.241970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.241971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:52.242091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.243245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:52.299805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554518101073648:7829]
2025-10-02T09:30:52.299983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 903, pipe: [1:7556554518101073648:7829]
2025-10-02T09:30:52.359386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:52.359957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.359971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.359991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073648:7829], now have 1 active actors on pipe
2025-10-02T09:30:52.360230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:52.360234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554518101073648:7829]
2025-10-02T09:30:52.360263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:52.360264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:52.360266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:52.360321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 904 reason: error at write: Disconnected sessionId: src_id|e2fec57-a43a9403-b16e6fec-45673733_0
2025-10-02T09:30:52.360477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 904 sessionId: src_id|e2fec57-a43a9403-b16e6fec-45673733_0 is DEAD
2025-10-02T09:30:52.360605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:52.360614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Write session will restart in 0.009533s
2025-10-02T09:30:52.360635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Write session: Do CDS request
2025-10-02T09:30:52.360641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:52.371209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.371332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:52.371346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 905
2025-10-02T09:30:52.371458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.371489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:52.371494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:52.371497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:52.371899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 905 sessionId:  describe result for acl check
2025-10-02T09:30:52.371927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:52.371928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:52.371930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:52.371933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554518101073809:7847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:52.372403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554518101073809:7847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:52.374117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554518101073809:7847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:52.374200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:52.376308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:52.376409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554518101073809:7847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:52.376419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554518101073809:7847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:52.376421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554518101073809:7847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:52.376425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:52.376445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:52.376453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:52.376460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:52.376497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:52.376531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554518025548500:6662]
2025-10-02T09:30:52.376958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:52.377212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:52.377249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:52.377498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:52.377538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.377544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.377545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.377546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.377547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.377548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.377549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.377550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.377551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.377551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.377552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.377553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.377557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.377566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.377570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.377574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.377577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.377581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.377584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.377587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.377591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.377596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.377599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.377602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.377608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.377614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.377619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.377624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.377630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.377634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.377638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.377642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.377646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.377651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.377655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.377659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.377665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.377669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.377674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.377678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.377685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.377689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.377693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.377701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.377705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.377709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.377713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.377717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.377753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:52.385825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:52.387350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:52.387361Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:52.387362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:52.387364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:52.387368Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 904 [2:7556554518025548500:6662]
2025-10-02T09:30:52.387376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:52.387391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:52.387396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.387398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.387399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.387409Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:52.387415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:52.387420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:52.387454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.387459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.387460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.387462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:52.387463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:52.387506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:52.387511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.387519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.387526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.387538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:52.387554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073879:7847], now have 1 active actors on pipe
2025-10-02T09:30:52.387561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073650:2446], now have 1 active actors on pipe
2025-10-02T09:30:52.387566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.387568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.387570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.387580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:52.387595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:52.387598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:52.387601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:52.387603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:52.387610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:52.387617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:52.387638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.387645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:52.387647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:52.387625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 904
2025-10-02T09:30:52.387632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 904
2025-10-02T09:30:52.387664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.387669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.387693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:52.387700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.387702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.387703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:52.387709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.387718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:52.387733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.387841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.387848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.387859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.387929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 905 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0
2025-10-02T09:30:52.388207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fec57-a43a9403-b16e6fec-45673733_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:52.390602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Write session: try to update token
2025-10-02T09:30:52.390617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:52.397532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:52.397545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.397547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:52.397548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:52.397555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.397561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.397563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554518025548495:6662]
2025-10-02T09:30:52.397589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:52.397594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.397595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:52.397615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:52.397630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:52.397634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:52.397753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.402179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId: src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:52.404278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:52.460582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554518101073890:7829]
2025-10-02T09:30:52.460787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 904, pipe: [1:7556554518101073890:7829]
2025-10-02T09:30:52.528084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:52.528572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.528584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.528619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073890:7829], now have 1 active actors on pipe
2025-10-02T09:30:52.528827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:52.528861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:52.528880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554518101073890:7829]
2025-10-02T09:30:52.528898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:52.529021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 905 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0
2025-10-02T09:30:52.529151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 905 sessionId: src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0 is DEAD
2025-10-02T09:30:52.529274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:52.529278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Write session will restart in 0.006297s
2025-10-02T09:30:52.529293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Write session: Do CDS request
2025-10-02T09:30:52.529297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:52.536125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.536167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:52.536175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 906
2025-10-02T09:30:52.536270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.536290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:52.536297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:52.536299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:52.536548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 906 sessionId:  describe result for acl check
2025-10-02T09:30:52.536565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:52.536569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:52.536571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:52.536574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554518101073959:7851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:52.536923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554518101073959:7851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:52.538685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554518101073959:7851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:52.540570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:52.542091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:52.542168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554518101073959:7851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:52.542176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554518101073959:7851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:52.542178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554518101073959:7851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:52.542181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:52.542221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:52.542229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:52.542238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:52.542278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:52.542307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554518025548734:6664]
2025-10-02T09:30:52.542838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:52.543073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:52.543110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:52.543392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:52.543440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.543446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.543447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.543447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.543448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.543449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.543450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.543451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.543452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.543453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.543454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.543455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.543459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.543468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.543472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.543476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.543480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.543484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.543487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.543491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.543494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.543500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.543503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.543507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.543514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.543520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.543529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.543534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.543542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.543547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.543555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.543560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.543567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.543572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.543577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.543582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.543588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.543592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.543598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.543602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.543607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.543613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.543617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.543625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.543629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.543634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.543641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.543646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.543678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:52.551240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:52.552743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:52.552756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:52.552758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:52.552761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:52.552766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 905 [2:7556554518025548734:6664]
2025-10-02T09:30:52.552774Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:52.552791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:52.552797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.552812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.552814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.552825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:52.552833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:52.552840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:52.552879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.552886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.552888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.552890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:52.552892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:52.552938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:52.552945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.552955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.552967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.552987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:52.553005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101073892:2446], now have 1 active actors on pipe
2025-10-02T09:30:52.553011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074121:7851], now have 1 active actors on pipe
2025-10-02T09:30:52.553016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.553018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.553019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.553009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 905
2025-10-02T09:30:52.553029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:52.553042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:52.553044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:52.553018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 905
2025-10-02T09:30:52.553044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:52.553046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:52.553057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:52.553063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:52.553090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.553096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.553107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.553117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:52.553132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:52.553143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:52.553148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.553155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.553157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:52.553163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.553175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:52.553194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.553310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.553319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.553330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.553396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 906 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0
2025-10-02T09:30:52.553590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd6f89a-45de21a9-a772550e-1200ba6f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:52.555759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Write session: try to update token
2025-10-02T09:30:52.555770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:52.562450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:52.562466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.562468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:52.562470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:52.562476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.562480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.562483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554518025548728:6664]
2025-10-02T09:30:52.562511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:52.562513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:52.562517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:52.562519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:52.562520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.562522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:52.562637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.569125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId: src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:52.571191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:52.629034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554518101074133:7829]
2025-10-02T09:30:52.629263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 905, pipe: [1:7556554518101074133:7829]
2025-10-02T09:30:52.682500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:52.683063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.683075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.683092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074133:7829], now have 1 active actors on pipe
2025-10-02T09:30:52.683207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:52.683248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:52.683258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554518101074133:7829]
2025-10-02T09:30:52.683279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:52.683338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 906 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0
2025-10-02T09:30:52.683497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 906 sessionId: src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0 is DEAD
2025-10-02T09:30:52.683625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:52.683635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Write session will restart in 0.009149s
2025-10-02T09:30:52.683649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Write session: Do CDS request
2025-10-02T09:30:52.683655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:52.694174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.694276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:52.694289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 907
2025-10-02T09:30:52.694380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.694407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:52.694414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:52.694417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:52.694767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 907 sessionId:  describe result for acl check
2025-10-02T09:30:52.694791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:52.694797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:52.694798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:52.694802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554518101074342:7856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:52.694776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:52.695250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554518101074342:7856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:52.696496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:52.696588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:52.696594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:52.696600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:52.696633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:52.696646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554518101074342:7856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:52.696655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554518025548981:6667]
2025-10-02T09:30:52.697009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:52.697185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:52.697207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:52.697376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:52.697404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.697407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.697408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.697409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.697409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.697410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.697410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.697411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.697411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.697412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.697412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.697413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.697415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.697421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.697423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.697425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.697427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.697429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.697431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.697433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.697435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.697438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.697440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.697442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.697445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.697449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.697452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.697455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.697457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.697460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.697462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.697465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.697467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.697470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.697472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.697479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.697481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.697484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.697489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.697491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.697494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.697496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.697498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.697504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.697506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.697508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.697510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.697513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.697529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:52.701336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554518101074342:7856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:52.701346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554518101074342:7856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:52.701348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554518101074342:7856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:52.701353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:52.704910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:52.706310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:52.706324Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:52.706325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:52.706327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:52.706330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 906 [2:7556554518025548981:6667]
2025-10-02T09:30:52.706337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:52.706350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:52.706351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.706353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.706354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.706363Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:52.706366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:52.706369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:52.706401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.706406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.706407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.706408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:52.706410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:52.706449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:52.706453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.706459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.706464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.706475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:52.706489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074382:7856], now have 1 active actors on pipe
2025-10-02T09:30:52.706494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074147:2446], now have 1 active actors on pipe
2025-10-02T09:30:52.706497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.706499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.706500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.706507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:52.706517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:52.706520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 906
2025-10-02T09:30:52.706526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:52.706529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 906
2025-10-02T09:30:52.706528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:52.706530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:52.706534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:52.706536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:52.706544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.706549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:52.706552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:52.706559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.706564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.706587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:52.706594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.706596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.706597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:52.706602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.706610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:52.706621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.706729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.706733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.706740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.706799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 907 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0
2025-10-02T09:30:52.707045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e63e0e8-6f3c370a-5cec611-78182f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:52.709221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Write session: try to update token
2025-10-02T09:30:52.709231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:52.716349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:52.716360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.716362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:52.716363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:52.716368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.716371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.716374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554518025548975:6667]
2025-10-02T09:30:52.716397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:52.716401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.716403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:52.716403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:52.716406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:52.716408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:52.716529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.719904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId: src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:52.721932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:52.783634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554518101074394:7829]
2025-10-02T09:30:52.783816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 906, pipe: [1:7556554518101074394:7829]
2025-10-02T09:30:52.838997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:52.839861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.839877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.839911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074394:7829], now have 1 active actors on pipe
2025-10-02T09:30:52.840115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:52.840131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:52.840150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554518101074394:7829]
2025-10-02T09:30:52.840169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:52.840192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 907 reason: error at write: Disconnected sessionId: src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0
2025-10-02T09:30:52.840354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 907 sessionId: src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0 is DEAD
2025-10-02T09:30:52.840434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:52.840476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:52.840486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Write session will restart in 0.006183s
2025-10-02T09:30:52.840507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Write session: Do CDS request
2025-10-02T09:30:52.840512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:52.848251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.848305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:52.848318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 908
2025-10-02T09:30:52.848437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:52.848465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:52.848472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:52.848475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:52.848852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 908 sessionId:  describe result for acl check
2025-10-02T09:30:52.848884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:52.848888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:52.848890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:52.848893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554518101074435:7861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:52.849303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554518101074435:7861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:52.851494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554518101074435:7861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:52.853777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554518101074435:7861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:52.853786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554518101074435:7861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:52.853788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554518101074435:7861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:52.853792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:52.854623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:52.857933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:52.858043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:52.858049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:52.858055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:52.858092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:52.858135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554518025549218:6669]
2025-10-02T09:30:52.858474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:52.858691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:52.858713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:52.858949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:52.858984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.858988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.858988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.858989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.858989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.858990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.858990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.858991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.858992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.858992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.858993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.858993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.858996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.859002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.859004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.859006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.859008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.859010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.859012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.859014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.859016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.859018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.859020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.859022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.859025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.859029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:52.859032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.859035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:52.859038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.859040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:52.859042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.859045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:52.859047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.859050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:52.859052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.859054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:52.859056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.859059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:52.859064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.859067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:52.859069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.859072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:52.859074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.859077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.859082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.859085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.859087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.859090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.859110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:52.866696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:52.868981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:52.868992Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:52.868994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:52.868997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:52.869002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 907 [2:7556554518025549218:6669]
2025-10-02T09:30:52.869012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:52.869025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:52.869028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.869030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.869031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.869042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:52.869051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:52.869061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:52.869112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.869118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.869120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.869123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:52.869124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:52.869175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:52.869182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.869193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:52.869207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:52.869225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:52.869244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074628:7861], now have 1 active actors on pipe
2025-10-02T09:30:52.869252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074396:2446], now have 1 active actors on pipe
2025-10-02T09:30:52.869257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.869263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.869265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.869277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:52.869293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:52.869297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:52.869299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:52.869305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:52.869313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:52.869319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:52.869316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 907
2025-10-02T09:30:52.869333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 907
2025-10-02T09:30:52.869339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.869348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:52.869359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:52.869378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.869382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.869402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:52.869412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:52.869415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:52.869417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:52.869424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:52.869435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:52.869448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.869567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:52.869580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:52.869602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:52.869692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 908 partition: 0 MaxSeqNo: 36 sessionId: src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0
2025-10-02T09:30:52.869986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc2848e-18de1b89-38d364ff-6de5a71c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:52.872436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Write session: try to update token
2025-10-02T09:30:52.872452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:52.878984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:52.878998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:52.878999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:52.879000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:52.879005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.879008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.879010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554518025549213:6669]
2025-10-02T09:30:52.879035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:52.879039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:52.879040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:52.879040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:52.879044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:52.879046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:52.879244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:52.889131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId: src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:52.891356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:52.940339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554518101074642:7829]
2025-10-02T09:30:52.940595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 907, pipe: [1:7556554518101074642:7829]
2025-10-02T09:30:53.009677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.009959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.009974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.009991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554518101074642:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.010198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.010212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:53.010218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:53.010251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554518101074642:7829]
2025-10-02T09:30:53.010268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 908 reason: error at write: Disconnected sessionId: src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0
2025-10-02T09:30:53.010331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.010440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 908 sessionId: src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0 is DEAD
2025-10-02T09:30:53.010542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:53.010550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Write session will restart in 0.008229s
2025-10-02T09:30:53.010567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Write session: Do CDS request
2025-10-02T09:30:53.010571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.020165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.020282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.020296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 909
2025-10-02T09:30:53.020401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.020429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.020438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.020445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.020819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 909 sessionId:  describe result for acl check
2025-10-02T09:30:53.020849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.020857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.020859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.020864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396042039:7865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.021323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396042039:7865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.023218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396042039:7865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.024522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.026341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.026438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396042039:7865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.026447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396042039:7865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.026449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396042039:7865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.026454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.026477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.026486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.026494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.026533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.026568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320516752:6672]
2025-10-02T09:30:53.027142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.027392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.027428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.027716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.027760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.027765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.027766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.027767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.027768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.027769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.027770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.027771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.027772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.027773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.027774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.027775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.027780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.027790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.027793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.027797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.027801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.027805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.027808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.027812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.027816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.027819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.027823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.027827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.027832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.027838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.027844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.027853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.027861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.027880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.027888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.027893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.027899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.027907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.027915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.027920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.027927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.027932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.027940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.027944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.027952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.027961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.027969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.027977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.027985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.027991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.027999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.028008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.028044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.036284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.038144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.038160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.038162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.038166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.038171Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 908 [2:7556554522320516752:6672]
2025-10-02T09:30:53.038182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.038196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.038199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.038201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.038203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.038216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.038225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.038235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.038295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.038302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.038304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.038306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.038309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.038385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.038393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.038404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.038419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.038437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.038458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042173:7865], now have 1 active actors on pipe
2025-10-02T09:30:53.038465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396041940:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.038471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.038473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.038475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.038487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.038506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.038509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.038512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.038513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.038519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.038521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.038510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 908
2025-10-02T09:30:53.038524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 908
2025-10-02T09:30:53.038547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.038554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.038557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.038568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.038577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.038617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.038628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.038631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.038633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.038641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.038649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.038668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.038862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.038869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.038881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.038962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 909 partition: 0 MaxSeqNo: 36 sessionId: src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0
2025-10-02T09:30:53.039285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf8db8-dadd4626-a59cf3c6-be4c51ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.041590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Write session: try to update token
2025-10-02T09:30:53.041602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.048796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.048828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.048831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.048832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.048840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.048844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.048848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320516747:6672]
2025-10-02T09:30:53.048877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.048880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.048881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.048883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.048888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.048890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.049061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:53.056575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId: src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:53.058771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:53.110330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554522396042185:7829]
2025-10-02T09:30:53.110556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 908, pipe: [1:7556554522396042185:7829]
2025-10-02T09:30:53.181147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.181483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.181494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.181510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042185:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.181650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.181657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554522396042185:7829]
2025-10-02T09:30:53.181684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:53.181686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:53.181731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 909 reason: error at write: Disconnected sessionId: src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0
2025-10-02T09:30:53.181860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 909 sessionId: src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0 is DEAD
2025-10-02T09:30:53.181990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:53.181999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Write session will restart in 0.005868s
2025-10-02T09:30:53.182013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Write session: Do CDS request
2025-10-02T09:30:53.182020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.182045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.189153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.189234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.189247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 910
2025-10-02T09:30:53.189345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.189367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.189374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.189378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.189698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 910 sessionId:  describe result for acl check
2025-10-02T09:30:53.189724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.189729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.189731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.189734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396042297:7877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.190130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396042297:7877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.191929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396042297:7877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.194824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.195018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396042297:7877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.195027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396042297:7877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.195029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396042297:7877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.195033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.195117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.195244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.195252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.195260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.195299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.195326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320517029:6685]
2025-10-02T09:30:53.195865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.196027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.196060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.196329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.196370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.196375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.196376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.196377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.196378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.196378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.196379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.196380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.196381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.196382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.196383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.196384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.196388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.196397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.196401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.196404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.196407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.196411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.196414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.196417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.196420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.196424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.196431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.196435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.196439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.196446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.196452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.196457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.196464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.196469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.196476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.196481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.196489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.196495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.196500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.196509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.196515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.196519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.196525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.196530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.196534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.196540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.196544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.196550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.196554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.196563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.196571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.196575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.196607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.204429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.206007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.206019Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.206021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.206024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.206029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 909 [2:7556554522320517029:6685]
2025-10-02T09:30:53.206039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.206052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.206059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.206061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.206063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.206076Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.206085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.206096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.206141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.206147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.206148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.206151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.206153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.206205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.206211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.206221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.206236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.206254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.206274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042205:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.206281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042443:7877], now have 1 active actors on pipe
2025-10-02T09:30:53.206267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 909
2025-10-02T09:30:53.206289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 909
2025-10-02T09:30:53.206286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.206291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.206293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.206300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.206307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.206309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.206310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.206314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.206330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.206336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.206352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.206359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.206382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.206392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.206398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.206407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.206416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.206423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.206424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.206431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.206440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.206469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.206585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.206595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.206606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.206674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 910 partition: 0 MaxSeqNo: 36 sessionId: src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0
2025-10-02T09:30:53.206921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22f5c26-4356345a-10e0adcf-7a9b02c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.209114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Write session: try to update token
2025-10-02T09:30:53.209124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.216217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.216230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.216232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.216233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.216238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.216241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.216243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320517023:6685]
2025-10-02T09:30:53.216268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.216269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.216272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.216273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.216274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.216274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.216387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:53.220038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId: src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:53.222202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:53.281857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554522396042455:7829]
2025-10-02T09:30:53.282073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 909, pipe: [1:7556554522396042455:7829]
2025-10-02T09:30:53.337455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.338006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.338017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.338055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042455:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.338280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554522396042455:7829]
2025-10-02T09:30:53.338314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.338345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:53.338352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:53.338405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 910 reason: error at write: Disconnected sessionId: src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0
2025-10-02T09:30:53.338431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.338565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 910 sessionId: src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0 is DEAD
2025-10-02T09:30:53.338678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:53.338686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Write session will restart in 0.006063s
2025-10-02T09:30:53.338700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Write session: Do CDS request
2025-10-02T09:30:53.338705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.346096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.346173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.346184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 911
2025-10-02T09:30:53.346310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.346332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.346337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.346340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.346649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 911 sessionId:  describe result for acl check
2025-10-02T09:30:53.346674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.346680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.346681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.346685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396042552:7881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.347035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396042552:7881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.348589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396042552:7881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.350103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.351730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.351871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.351878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.351885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.351917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.351941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320517267:6689]
2025-10-02T09:30:53.351948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396042552:7881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.351957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396042552:7881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.351959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396042552:7881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.351962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.352286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.352450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.352473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.352649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.352677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.352681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.352682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.352683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.352683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.352684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.352684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.352685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.352685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.352686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.352686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.352687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.352690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.352696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.352698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.352700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.352702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.352704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.352707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.352708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.352711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.352713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.352715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.352717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.352720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.352725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.352729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.352732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.352734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.352736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.352738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.352741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.352744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.352746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.352748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.352751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.352753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.352756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.352758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.352761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.352763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.352766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.352768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.352771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.352773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.352776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.352778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.352781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.352811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.360605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.362045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.362056Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.362058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.362059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.362062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 910 [2:7556554522320517267:6689]
2025-10-02T09:30:53.362070Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.362079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.362081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.362082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.362084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.362092Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.362099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.362103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.362134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.362139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.362140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.362141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.362142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.362179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.362184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.362190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.362196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.362204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.362218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042456:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.362223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042693:7881], now have 1 active actors on pipe
2025-10-02T09:30:53.362227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.362228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.362229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.362236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.362246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.362240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 910
2025-10-02T09:30:53.362253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.362256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 910
2025-10-02T09:30:53.362256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.362257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.362260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.362261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.362274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.362275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.362282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.362284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.362286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.362308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe4228d3-f4a67118-596b4686-3b020559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.362314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.362316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.362318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.362322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.362331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.362342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.362442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.362447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.362462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.362535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 911 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe4228d3-f4a67118-596b4686-3b020559_0
2025-10-02T09:30:53.362744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edac1dac-7dba280d-c15a2f1f-ac8bf481_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe4228d3-f4a67118-596b4686-3b020559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.365209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Write session: try to update token
2025-10-02T09:30:53.365220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.371978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.371992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.371994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.371995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.372000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.372003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.372005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320517262:6689]
2025-10-02T09:30:53.372027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.372031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.372032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.372037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.372041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.372044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.372133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:53.376740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId: src_id|fe4228d3-f4a67118-596b4686-3b020559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:53.378715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:53.438504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554522396042704:7829]
2025-10-02T09:30:53.438703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 910, pipe: [1:7556554522396042704:7829]
2025-10-02T09:30:53.490172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.490483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.490492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.490518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042704:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.490733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.490711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554522396042704:7829]
2025-10-02T09:30:53.490775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:53.490781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:53.490791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.490828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 911 reason: error at write: Disconnected sessionId: src_id|fe4228d3-f4a67118-596b4686-3b020559_0
2025-10-02T09:30:53.490988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 911 sessionId: src_id|fe4228d3-f4a67118-596b4686-3b020559_0 is DEAD
2025-10-02T09:30:53.491146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:53.491152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Write session will restart in 0.008674s
2025-10-02T09:30:53.491168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Write session: Do CDS request
2025-10-02T09:30:53.491172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.501120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.501197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.501209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 912
2025-10-02T09:30:53.501295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.501321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.501330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.501333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.501670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 912 sessionId:  describe result for acl check
2025-10-02T09:30:53.501696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.501700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.501701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.501704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396042903:7885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.502040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396042903:7885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.502582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.503438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396042903:7885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.504186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.504336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.504343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.504349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.504379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.504402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320517507:6691]
2025-10-02T09:30:53.504744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.504918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.504941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.505115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.505148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.505152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.505152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.505153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.505153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.505154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.505154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.505155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.505156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.505156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.505157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.505157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.505160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.505166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.505168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.505170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.505171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.505173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.505175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.505177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.505180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.505182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.505184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.505186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.505189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.505193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.505196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.505199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.505201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.505204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.505206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.505208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.505211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.505213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.505216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.505218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.505221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.505224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.505226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.505228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.505232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.505234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.505236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.505239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.505241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.505244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.505247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.505249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.505266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.505433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396042903:7885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.505441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396042903:7885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.505443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396042903:7885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.505446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.512702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.514273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.514285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.514286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.514288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.514292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 911 [2:7556554522320517507:6691]
2025-10-02T09:30:53.514299Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.514310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.514315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.514317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.514318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.514328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.514334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.514339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.514375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.514379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.514381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.514383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.514384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.514421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.514426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.514432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.514438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.514446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.514459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.514463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.514464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.514469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.514476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.514477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042945:7885], now have 1 active actors on pipe
2025-10-02T09:30:53.514480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042705:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.514483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.514484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.514485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.514492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.514493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.514508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.514516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.514534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.514517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 911
2025-10-02T09:30:53.514518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 911
2025-10-02T09:30:53.514569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.514575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.514590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ea7c211-18f401c6-30983c7f-7f527752_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.514597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.514600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.514601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.514607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.514612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.514623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.514736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.514741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.514749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.514808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 912 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ea7c211-18f401c6-30983c7f-7f527752_0
2025-10-02T09:30:53.515056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4228d3-f4a67118-596b4686-3b020559_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ea7c211-18f401c6-30983c7f-7f527752_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.517350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Write session: try to update token
2025-10-02T09:30:53.517363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.525585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:53.525600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.525605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.525631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:53.525637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:53.525767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:53.525880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:53.525988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:53.526099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:53.526247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:53.526272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:53.528285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId: src_id|4ea7c211-18f401c6-30983c7f-7f527752_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:53.530275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:53.530401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.530411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.530427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:53.530487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:53.532164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.532176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.532178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.532179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.532184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.532186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.532188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320517501:6691]
2025-10-02T09:30:53.532207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.532214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.532216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.532239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.532252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.532256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.532330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:53.591081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554522396042953:7829]
2025-10-02T09:30:53.591292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 911, pipe: [1:7556554522396042953:7829]
2025-10-02T09:30:53.649839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.655713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.655730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.655842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.655891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.655941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.655990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.656027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.656033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.656081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.656128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.656178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.656225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.656263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.656273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.656332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.656386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.656439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.656497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.656541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.656548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.656607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.656657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.656727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.656816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.656855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.656860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.656914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.656960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.657010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.657056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.657092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.657097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.657174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.657247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.657300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.657368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.657404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.657408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.657458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.657504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.657553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.657600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.657645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.657650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.657700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.657747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.657795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.657844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.657879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.657884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.657944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.657989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.658035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.658088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.658135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.658141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.658191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:53.658237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:53.658285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:53.658333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:53.658369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:53.658374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:53.658401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042953:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.658554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:53.658556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554522396042953:7829]
2025-10-02T09:30:53.658565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:53.658569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.658581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 912 reason: error at write: Disconnected sessionId: src_id|4ea7c211-18f401c6-30983c7f-7f527752_0
2025-10-02T09:30:53.658713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 912 sessionId: src_id|4ea7c211-18f401c6-30983c7f-7f527752_0 is DEAD
2025-10-02T09:30:53.658826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:53.658834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Write session will restart in 0.006597s
2025-10-02T09:30:53.658849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Write session: Do CDS request
2025-10-02T09:30:53.658853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.658900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.666103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.666245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.666256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 913
2025-10-02T09:30:53.666362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.666383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.666389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.666392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.666642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 913 sessionId:  describe result for acl check
2025-10-02T09:30:53.666666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.666670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.666671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.666674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396043018:7890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.666992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396043018:7890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.668443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396043018:7890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.670363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396043018:7890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.670372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396043018:7890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.670374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396043018:7890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.670377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.671166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.672882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.672978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.672985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.672990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.673015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.673038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320517761:6694]
2025-10-02T09:30:53.673379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.673538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.673560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.673737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.673764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.673768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.673769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.673769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.673770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.673771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.673771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.673772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.673772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.673773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.673773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.673774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.673777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.673783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.673785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.673787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.673789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.673791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.673793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.673795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.673797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.673799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.673801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.673803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.673807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.673810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.673813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.673816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.673818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.673821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.673823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.673826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.673828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.673830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.673832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.673835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.673837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.673840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.673842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.673844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.673847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.673853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.673855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.673858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.673860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.673866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.673868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.673871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.673888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.681284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.682675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.682687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.682688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.682691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.682695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 912 [2:7556554522320517761:6694]
2025-10-02T09:30:53.682702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.682712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.682713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.682715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.682716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.682726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.682730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.682738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.682769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.682774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.682775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.682777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.682778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.682817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.682821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.682827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.682832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.682843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.682856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.682862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.682864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.682868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.682876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396042966:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.682877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.682879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043199:7890], now have 1 active actors on pipe
2025-10-02T09:30:53.682880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.682882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.682883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.682890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.682892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.682905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.682914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.682918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.682910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 912
2025-10-02T09:30:53.682913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 912
2025-10-02T09:30:53.682947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.682954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.682968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.682974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.682976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.682977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.682982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.682988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.683002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.683103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.683108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.683115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.683180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 913 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0
2025-10-02T09:30:53.683393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea7c211-18f401c6-30983c7f-7f527752_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.685537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Write session: try to update token
2025-10-02T09:30:53.685548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.692209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.692223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.692224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.692225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.692230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.692232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.692235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320517756:6694]
2025-10-02T09:30:53.692258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.692261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.692263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.692273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.692279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.692289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.692376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:53.697235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId: src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:53.699336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:53.758517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554522396043215:7829]
2025-10-02T09:30:53.758732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 912, pipe: [1:7556554522396043215:7829]
2025-10-02T09:30:53.812373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.812751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.812761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.812788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043215:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.812936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.813042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.813049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554522396043215:7829]
2025-10-02T09:30:53.813072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:53.813133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 913 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0
2025-10-02T09:30:53.813286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 913 sessionId: src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0 is DEAD
2025-10-02T09:30:53.813417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:53.813425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Write session will restart in 0.006047s
2025-10-02T09:30:53.813441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Write session: Do CDS request
2025-10-02T09:30:53.813445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.820115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.820250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.820260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 914
2025-10-02T09:30:53.820348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.820368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.820375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.820378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.820729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 914 sessionId:  describe result for acl check
2025-10-02T09:30:53.820759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.820766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.820768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.820772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396043269:7895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.821265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396043269:7895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.823304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396043269:7895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.825411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396043269:7895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.825423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396043269:7895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.825426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396043269:7895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.825431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.825484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.827192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.827293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.827298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.827304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.827330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.827350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320518003:6696]
2025-10-02T09:30:53.827691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.827862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.827884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.828058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.828088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.828091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.828092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.828092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.828093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.828093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.828094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.828094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.828095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.828095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.828096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.828096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.828099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.828108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.828110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.828112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.828114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.828116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.828118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.828120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.828122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.828125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.828127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.828129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.828132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.828136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.828140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.828142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.828144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.828147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.828149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.828152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.828154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.828157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.828158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.828161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.828164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.828166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.828168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.828171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.828176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.828179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.828181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.828183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.828185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.828188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.828190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.828195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.828212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.835566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.836925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.836935Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.836936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.836938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.836942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 913 [2:7556554522320518003:6696]
2025-10-02T09:30:53.836949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.836960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.836965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.836967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.836968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.836978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.836981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.836989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.837021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.837026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.837028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.837029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.837031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.837069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.837074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.837081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.837090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.837102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.837117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043458:7895], now have 1 active actors on pipe
2025-10-02T09:30:53.837123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043221:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.837126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.837128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.837129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.837136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.837147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.837152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.837155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.837156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.837159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.837161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.837175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.837184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.837191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.837208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.837213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.837180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 913
2025-10-02T09:30:53.837185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 913
2025-10-02T09:30:53.837229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.837236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.837239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.837240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.837245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.837254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.837264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.837385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.837390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.837399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.837472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 914 partition: 0 MaxSeqNo: 36 sessionId: src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0
2025-10-02T09:30:53.837732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce598f23-6e145a53-6bbeb0fb-7ea8dc50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.839975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Write session: try to update token
2025-10-02T09:30:53.839985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.847120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.847133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.847135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.847135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.847141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.847144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.847146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320517997:6696]
2025-10-02T09:30:53.847170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.847175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.847177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.847179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.847179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.847182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.847290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:53.852011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId: src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:53.854068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:53.913126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554522396043474:7829]
2025-10-02T09:30:53.913345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 913, pipe: [1:7556554522396043474:7829]
2025-10-02T09:30:53.964108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:53.964625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.964635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.964664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043474:7829], now have 1 active actors on pipe
2025-10-02T09:30:53.964829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:53.964880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:53.964895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:53.964928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554522396043474:7829]
2025-10-02T09:30:53.964948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 914 reason: error at write: Disconnected sessionId: src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0
2025-10-02T09:30:53.964953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:53.965067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 914 sessionId: src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0 is DEAD
2025-10-02T09:30:53.965230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:53.965242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Write session will restart in 0.005954s
2025-10-02T09:30:53.965260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Write session: Do CDS request
2025-10-02T09:30:53.965264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:53.972148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.972244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:53.972255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 915
2025-10-02T09:30:53.972341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:53.972362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:53.972368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:53.972371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:53.972664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 915 sessionId:  describe result for acl check
2025-10-02T09:30:53.972694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:53.972699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:53.972700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:53.972703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554522396043528:7899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:53.973073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554522396043528:7899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:53.974985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554522396043528:7899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:53.977148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554522396043528:7899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:53.977158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554522396043528:7899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:53.977160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554522396043528:7899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:53.977164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:53.977228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:53.979186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:53.979292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:53.979298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:53.979304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:53.979332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:53.979354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554522320518248:6699]
2025-10-02T09:30:53.979700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:53.979861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:53.979884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:53.980082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:53.980118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.980122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.980122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.980123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.980123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.980124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.980125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.980125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.980126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.980127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.980127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.980128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.980131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.980137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.980140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.980142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.980144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.980146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.980148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.980150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.980152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.980154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.980156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.980158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.980162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.980166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:53.980169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.980172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:53.980174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.980177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:53.980183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.980186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:53.980188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.980192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:53.980197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.980199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:53.980201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.980204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:53.980209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.980212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:53.980215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.980217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:53.980224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.980227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.980229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.980234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.980239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.980242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.980259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:53.987716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:53.989315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:53.989326Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:53.989328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:53.989330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:53.989334Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 914 [2:7556554522320518248:6699]
2025-10-02T09:30:53.989342Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:53.989352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:53.989357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.989359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.989360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.989369Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:53.989372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:53.989381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:53.989416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.989421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.989422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.989424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:53.989425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:53.989465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:53.989469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.989476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:53.989481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:53.989493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:53.989505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043713:7899], now have 1 active actors on pipe
2025-10-02T09:30:53.989510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554522396043478:2446], now have 1 active actors on pipe
2025-10-02T09:30:53.989513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.989516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.989517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.989524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:53.989535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:53.989536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:53.989538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:53.989540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:53.989546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:53.989547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:53.989562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.989567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:53.989569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:53.989541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 914
2025-10-02T09:30:53.989579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.989564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 914
2025-10-02T09:30:53.989584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.989614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a720aef-14434b02-75441691-bbd8b14b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:53.989620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:53.989623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:53.989624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:53.989629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:53.989634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:53.989647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.989736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:53.989741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:53.989748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:53.989796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 915 partition: 0 MaxSeqNo: 36 sessionId: src_id|a720aef-14434b02-75441691-bbd8b14b_0
2025-10-02T09:30:53.990063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f50515-1d25cbc9-bd1d93b8-635695a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a720aef-14434b02-75441691-bbd8b14b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:53.992173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Write session: try to update token
2025-10-02T09:30:53.992185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:53.999163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:53.999176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:53.999177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:53.999178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:53.999184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.999186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.999189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554522320518242:6699]
2025-10-02T09:30:53.999214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:53.999215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:53.999218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:53.999220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:53.999221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:53.999222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:53.999343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.002711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId: src_id|a720aef-14434b02-75441691-bbd8b14b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.005031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:54.065188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554526691011022:7829]
2025-10-02T09:30:54.065348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 914, pipe: [1:7556554526691011022:7829]
2025-10-02T09:30:54.126315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:54.126581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.126595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.126630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011022:7829], now have 1 active actors on pipe
2025-10-02T09:30:54.126854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:54.126856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554526691011022:7829]
2025-10-02T09:30:54.126880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:54.126882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:54.126926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:54.126935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 915 reason: error at write: Disconnected sessionId: src_id|a720aef-14434b02-75441691-bbd8b14b_0
2025-10-02T09:30:54.127084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 915 sessionId: src_id|a720aef-14434b02-75441691-bbd8b14b_0 is DEAD
2025-10-02T09:30:54.127226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:54.127234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Write session will restart in 0.008173s
2025-10-02T09:30:54.127252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Write session: Do CDS request
2025-10-02T09:30:54.127256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:54.136145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.136229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:54.136239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 916
2025-10-02T09:30:54.136317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.136339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:54.136345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:54.136348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:54.136637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 916 sessionId:  describe result for acl check
2025-10-02T09:30:54.136659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:54.136663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:54.136665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:54.136668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554526691011147:7903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:54.137119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554526691011147:7903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:54.139054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554526691011147:7903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:54.139756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:54.141548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:54.141664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554526691011147:7903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:54.141676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554526691011147:7903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:54.141679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554526691011147:7903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:54.141685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:54.141684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:54.141693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:54.141701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:54.141740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:54.141775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554526615485787:6701]
2025-10-02T09:30:54.142361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:54.142584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:54.142619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:54.142910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:54.142970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.142975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.142976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.142978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.142979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.142980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.142981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.142982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.142983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.142984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.142985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.142986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.142990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.143000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.143004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.143008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.143012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.143020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.143024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.143032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.143036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.143044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.143048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.143057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.143062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.143073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.143083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.143092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.143100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.143110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.143119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.143128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.143137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.143147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.143155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.143164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.143172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.143177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.143185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.143193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.143202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.143210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.143219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.143227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.143235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.143241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.143248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.143254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.143294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:54.151173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:54.152834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:54.152845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:54.152847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:54.152850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:54.152855Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 915 [2:7556554526615485787:6701]
2025-10-02T09:30:54.152866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:54.152885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:54.152891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.152893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.152895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.152908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:54.152916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:54.152921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:54.152971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.152977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.152979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.152981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:54.152983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:54.153034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:54.153041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.153051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.153062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.153078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:54.153104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011024:2446], now have 1 active actors on pipe
2025-10-02T09:30:54.153108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011264:7903], now have 1 active actors on pipe
2025-10-02T09:30:54.153113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.153115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.153116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.153129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:54.153144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:54.153145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:54.153147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:54.153148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:54.153133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 915
2025-10-02T09:30:54.153161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:54.153167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:54.153149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 915
2025-10-02T09:30:54.153198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.153206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.153217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.153227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:54.153240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:54.153253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:54.153263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.153269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.153271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:54.153278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.153289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:54.153311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.153404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.153412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.153423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.153495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 916 partition: 0 MaxSeqNo: 36 sessionId: src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0
2025-10-02T09:30:54.153748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a720aef-14434b02-75441691-bbd8b14b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:54.155904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Write session: try to update token
2025-10-02T09:30:54.155914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:54.162915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:54.162928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:54.162929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:54.162930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:54.162947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.162949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.162952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554526615485782:6701]
2025-10-02T09:30:54.162980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:54.162987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.162988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:54.162988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:54.162993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:54.162996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:54.163107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.166621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId: src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.168615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:54.226955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554526691011300:7829]
2025-10-02T09:30:54.227094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 915, pipe: [1:7556554526691011300:7829]
2025-10-02T09:30:54.283069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:54.283369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.283378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.283403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011300:7829], now have 1 active actors on pipe
2025-10-02T09:30:54.283523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:54.283550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:54.283562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554526691011300:7829]
2025-10-02T09:30:54.283564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:54.283576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:54.283610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 916 reason: error at write: Disconnected sessionId: src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0
2025-10-02T09:30:54.283750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 916 sessionId: src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0 is DEAD
2025-10-02T09:30:54.283875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:54.283881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Write session will restart in 0.005411s
2025-10-02T09:30:54.283898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Write session: Do CDS request
2025-10-02T09:30:54.283903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:54.290167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.290217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:54.290225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 917
2025-10-02T09:30:54.290362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.290381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:54.290387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:54.290390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:54.290736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 917 sessionId:  describe result for acl check
2025-10-02T09:30:54.290767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:54.290771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:54.290772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:54.290776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554526691011349:7915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:54.291126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554526691011349:7915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:54.293510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554526691011349:7915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:54.295395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:54.295434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554526691011349:7915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:54.295442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554526691011349:7915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:54.295445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554526691011349:7915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:54.295449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:54.296986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:54.297102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:54.297108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:54.297114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:54.297141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:54.297268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554526615486071:6716]
2025-10-02T09:30:54.297614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:54.297952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:54.297977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:54.298155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:54.298183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.298187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.298187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.298188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.298188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.298189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.298189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.298190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.298190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.298191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.298191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.298192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.298195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.298201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.298203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.298206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.298208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.298210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.298212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.298214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.298216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.298219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.298221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.298223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.298226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.298230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.298233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.298236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.298238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.298241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.298243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.298245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.298247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.298250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.298252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.298254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.298257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.298260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.298263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.298265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.298268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.298270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.298272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.298274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.298277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.298279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.298281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.298284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.298303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:54.305707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:54.307209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:54.307220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:54.307222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:54.307224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:54.307228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 916 [2:7556554526615486071:6716]
2025-10-02T09:30:54.307236Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:54.307246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:54.307248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.307250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.307251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.307260Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:54.307267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:54.307272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:54.307306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.307311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.307312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.307315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:54.307316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:54.307355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:54.307360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.307367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.307372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.307383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:54.307398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011542:7915], now have 1 active actors on pipe
2025-10-02T09:30:54.307403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011301:2446], now have 1 active actors on pipe
2025-10-02T09:30:54.307407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.307408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.307410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.307417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:54.307428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:54.307429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:54.307431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:54.307432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:54.307438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:54.307440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:54.307456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.307461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:54.307478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:54.307453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 916
2025-10-02T09:30:54.307482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.307484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.307455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 916
2025-10-02T09:30:54.307501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:54.307509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.307511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.307512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:54.307517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.307525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:54.307535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.307621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.307625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.307633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.307683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 917 partition: 0 MaxSeqNo: 36 sessionId: src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0
2025-10-02T09:30:54.307932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6798a7db-a9fb539c-4a6d0393-af26b104_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:54.310090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Write session: try to update token
2025-10-02T09:30:54.310104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:54.316891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:54.316904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:54.316906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:54.316907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:54.316916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.316919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.316921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554526615486065:6716]
2025-10-02T09:30:54.316950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:54.316954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.316956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:54.316959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:54.316964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:54.316968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:54.317076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.321480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId: src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.323632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:54.383653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554526691011554:7829]
2025-10-02T09:30:54.383865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 916, pipe: [1:7556554526691011554:7829]
2025-10-02T09:30:54.443156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:54.443431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.443440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.443467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011554:7829], now have 1 active actors on pipe
2025-10-02T09:30:54.443611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:54.443651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:54.443661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554526691011554:7829]
2025-10-02T09:30:54.443664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:54.443721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 917 reason: error at write: Disconnected sessionId: src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0
2025-10-02T09:30:54.443745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:54.443879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 917 sessionId: src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0 is DEAD
2025-10-02T09:30:54.443992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:54.443998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Write session will restart in 0.006343s
2025-10-02T09:30:54.444012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Write session: Do CDS request
2025-10-02T09:30:54.444016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:54.451224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.451327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:54.451339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 918
2025-10-02T09:30:54.451455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.451485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:54.451492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:54.451494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:54.451806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 918 sessionId:  describe result for acl check
2025-10-02T09:30:54.451826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:54.451827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:54.451828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:54.451831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554526691011621:7919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:54.452181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554526691011621:7919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:54.454355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554526691011621:7919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:54.456762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554526691011621:7919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:54.456774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554526691011621:7919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:54.456777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554526691011621:7919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:54.456782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:54.457188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:54.459114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:54.459260Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:54.459268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:54.459276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:54.459316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:54.459341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554526615486317:6718]
2025-10-02T09:30:54.459760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:54.459984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:54.460012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:54.460267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:54.460300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.460304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.460305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.460305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.460306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.460307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.460308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.460308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.460308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.460310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.460313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.460322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.460326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.460329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.460332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.460335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.460338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.460341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.460343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.460347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.460350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.460353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.460358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.460364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.460368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.460373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.460377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.460385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.460387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.460390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.460392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.460395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.460398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.460400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.460403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.460406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.460408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.460411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.460413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.460416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.460418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.460421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.460423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.460425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.460428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.460430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.460448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:54.468350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:54.469841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:54.469859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:54.469862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:54.469865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:54.469871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 917 [2:7556554526615486317:6718]
2025-10-02T09:30:54.469883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:54.469899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:54.469901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.469903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.469905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.469918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:54.469923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:54.469928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:54.469976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.469987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.469989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.469991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:54.469994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:54.470048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:54.470054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.470065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.470080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.470100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:54.470125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011555:2446], now have 1 active actors on pipe
2025-10-02T09:30:54.470134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011796:7919], now have 1 active actors on pipe
2025-10-02T09:30:54.470139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.470141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.470143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.470153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:54.470164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:54.470166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:54.470170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:54.470156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 917
2025-10-02T09:30:54.470172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:54.470159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 917
2025-10-02T09:30:54.470180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:54.470183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:54.470206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.470208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:54.470211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:54.470223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.470228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.470426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84408569-c20238cf-b5f396e1-75358a8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:54.470436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.470439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.470441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:54.470448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.470455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:54.470473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.470639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.470646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.470659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.470739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 918 partition: 0 MaxSeqNo: 36 sessionId: src_id|84408569-c20238cf-b5f396e1-75358a8e_0
2025-10-02T09:30:54.471007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb844f-87ca689b-c344f77c-b4f25e93_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84408569-c20238cf-b5f396e1-75358a8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:54.473253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Write session: try to update token
2025-10-02T09:30:54.473268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:54.480380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:54.480397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:54.480399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:54.480401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:54.480408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.480413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.480417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554526615486312:6718]
2025-10-02T09:30:54.480450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:54.480451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:54.480458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:54.480458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.480460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:54.480461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:54.480585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.484433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId: src_id|84408569-c20238cf-b5f396e1-75358a8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.486450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:54.543909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554526691011809:7829]
2025-10-02T09:30:54.544121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 917, pipe: [1:7556554526691011809:7829]
2025-10-02T09:30:54.601017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:54.601342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.601354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.601380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011809:7829], now have 1 active actors on pipe
2025-10-02T09:30:54.601582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:54.601599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:54.601601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554526691011809:7829]
2025-10-02T09:30:54.601630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:54.601647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 918 reason: error at write: Disconnected sessionId: src_id|84408569-c20238cf-b5f396e1-75358a8e_0
2025-10-02T09:30:54.601744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:54.601806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 918 sessionId: src_id|84408569-c20238cf-b5f396e1-75358a8e_0 is DEAD
2025-10-02T09:30:54.602104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:54.602112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Write session will restart in 0.007764s
2025-10-02T09:30:54.602139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Write session: Do CDS request
2025-10-02T09:30:54.602143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:54.611231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.611323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:54.611335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 919
2025-10-02T09:30:54.611433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.611457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:54.611460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:54.611464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:54.611778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 919 sessionId:  describe result for acl check
2025-10-02T09:30:54.611800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:54.611805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:54.611806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:54.611810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554526691011882:7923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:54.612177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554526691011882:7923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:54.614457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554526691011882:7923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:54.616710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:54.616783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554526691011882:7923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:54.616795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554526691011882:7923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:54.616799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554526691011882:7923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:54.616820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:54.618643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:54.618808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:54.618816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:54.618826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:54.618878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:54.618913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554526615486576:6721]
2025-10-02T09:30:54.619469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:54.619713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:54.619754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:54.620032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:54.620083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.620089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.620090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.620091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.620092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.620093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.620094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.620095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.620098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.620099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.620103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.620122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.620125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.620129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.620133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.620136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.620140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.620143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.620147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.620150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.620156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.620162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.620167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.620172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.620175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.620186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.620191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.620200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.620204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.620213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.620217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.620222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.620230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.620235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.620239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.620247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.620251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.620260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.620267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.620275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.620279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.620289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.620293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.620298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.620333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:54.628157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:54.629719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:54.629735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:54.629737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:54.629739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:54.629744Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 918 [2:7556554526615486576:6721]
2025-10-02T09:30:54.629754Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:54.629768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:54.629770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.629772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.629773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.629788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:54.629797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:54.629803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:54.629853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.629860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.629861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.629864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:54.629866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:54.629923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:54.629930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.629940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.629954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.629972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:54.629991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012051:7923], now have 1 active actors on pipe
2025-10-02T09:30:54.629998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691011810:2446], now have 1 active actors on pipe
2025-10-02T09:30:54.630004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.630006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.630008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.630019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:54.630030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:54.630033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:54.630036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:54.630038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:54.630014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 918
2025-10-02T09:30:54.630046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:54.630031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 918
2025-10-02T09:30:54.630048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:54.630075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.630083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.630097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.630107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:54.630111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:54.630129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:54.630139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.630142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.630148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:54.630155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.630166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:54.630186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.630301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.630308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.630319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.630402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 919 partition: 0 MaxSeqNo: 36 sessionId: src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0
2025-10-02T09:30:54.630691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84408569-c20238cf-b5f396e1-75358a8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:54.633003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Write session: try to update token
2025-10-02T09:30:54.633016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:54.639957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:54.639975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:54.639977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:54.639979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:54.639986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.639990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.639994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554526615486570:6721]
2025-10-02T09:30:54.640025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:54.640027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:54.640032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.640034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:54.640035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:54.640038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:54.640181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.643606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId: src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.645779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:54.701600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554526691012076:7829]
2025-10-02T09:30:54.701787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 918, pipe: [1:7556554526691012076:7829]
2025-10-02T09:30:54.760661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:54.761056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.761066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.761093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012076:7829], now have 1 active actors on pipe
2025-10-02T09:30:54.761227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:54.761275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554526691012076:7829]
2025-10-02T09:30:54.761282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:54.761301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:54.761349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 919 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0
2025-10-02T09:30:54.761475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 919 sessionId: src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0 is DEAD
2025-10-02T09:30:54.761643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:54.761653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Write session will restart in 0.008866s
2025-10-02T09:30:54.761672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Write session: Do CDS request
2025-10-02T09:30:54.761678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:54.771160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.771227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:54.771237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 920
2025-10-02T09:30:54.771332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.771352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:54.771358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:54.771361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:54.771641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 920 sessionId:  describe result for acl check
2025-10-02T09:30:54.771666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:54.771672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:54.771673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:54.771677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554526691012252:7928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:54.772029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554526691012252:7928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:54.773324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:54.773707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554526691012252:7928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:54.775168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:54.775265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:54.775271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:54.775276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:54.775302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:54.775324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554526615486823:6723]
2025-10-02T09:30:54.775682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:54.775687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554526691012252:7928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:54.775696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554526691012252:7928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:54.775698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554526691012252:7928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:54.775701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:54.775840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:54.775862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:54.776037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:54.776064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.776068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.776069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.776069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.776070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.776070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.776071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.776071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.776072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.776072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.776073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.776073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.776076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.776082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.776084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.776087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.776088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.776091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.776093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.776094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.776096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.776099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.776100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.776102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.776106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.776110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.776113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.776116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.776119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.776122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.776125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.776131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.776133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.776136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.776138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.776141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.776144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.776147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.776149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.776154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.776157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.776160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.776162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.776166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.776168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.776171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.776176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.776179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.776195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:54.783758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:54.785256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:54.785267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:54.785269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:54.785271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:54.785274Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 919 [2:7556554526615486823:6723]
2025-10-02T09:30:54.785284Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:54.785296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:54.785298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.785300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.785301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.785311Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:54.785313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:54.785320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:54.785355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.785360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.785361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.785363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:54.785364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:54.785405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:54.785409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.785416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.785421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.785433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:54.785449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012077:2446], now have 1 active actors on pipe
2025-10-02T09:30:54.785455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012323:7928], now have 1 active actors on pipe
2025-10-02T09:30:54.785459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.785460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.785461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.785469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:54.785481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:54.785482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:54.785484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:54.785485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:54.785492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:54.785493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:54.785493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 919
2025-10-02T09:30:54.785512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.785498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 919
2025-10-02T09:30:54.785520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:54.785521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:54.785531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.785534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.785564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:54.785569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.785571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.785573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:54.785578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.785584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:54.785592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.785683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.785689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.785698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.785750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 920 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0
2025-10-02T09:30:54.786010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ff94ba-8a55934b-35051621-6f3cfe1d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:54.788274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Write session: try to update token
2025-10-02T09:30:54.788288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:54.795021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:54.795036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:54.795038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:54.795039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:54.795046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.795049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.795053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554526615486818:6723]
2025-10-02T09:30:54.795082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:54.795091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.795093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:54.795097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:54.795098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:54.795101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:54.795230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.798955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId: src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.801107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:54.861347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554526691012341:7829]
2025-10-02T09:30:54.861555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 919, pipe: [1:7556554526691012341:7829]
2025-10-02T09:30:54.911145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:54.911346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.911355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.911380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012341:7829], now have 1 active actors on pipe
2025-10-02T09:30:54.911600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:54.911613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:54.911633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554526691012341:7829]
2025-10-02T09:30:54.911667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:54.911660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 920 reason: error at write: Disconnected sessionId: src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0
2025-10-02T09:30:54.911661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:54.911806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 920 sessionId: src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0 is DEAD
2025-10-02T09:30:54.911969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:54.911985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Write session will restart in 0.008567s
2025-10-02T09:30:54.912002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Write session: Do CDS request
2025-10-02T09:30:54.912006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:54.921100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.921179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:54.921191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 921
2025-10-02T09:30:54.921279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:54.921307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:54.921314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:54.921317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:54.921730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 921 sessionId:  describe result for acl check
2025-10-02T09:30:54.921758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:54.921764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:54.921766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:54.921771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554526691012436:7933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:54.922230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554526691012436:7933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:54.924010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554526691012436:7933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:54.925793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554526691012436:7933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:54.925803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554526691012436:7933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:54.925805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554526691012436:7933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:54.925809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:54.926139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:54.927777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:54.927873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:54.927878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:54.927884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:54.927913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:54.927936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554526615487075:6726]
2025-10-02T09:30:54.928283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:54.928453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:54.928478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:54.928694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:54.928727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.928731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.928732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.928732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.928733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.928733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.928734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.928735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.928735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.928736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.928736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.928737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.928739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.928745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.928747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.928750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.928751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.928754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.928755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.928758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.928759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.928762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.928764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.928766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.928769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.928773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:54.928776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.928779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:54.928781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.928784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:54.928786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.928789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:54.928791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.928793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:54.928795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.928798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:54.928811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.928813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:54.928815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.928818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:54.928820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.928823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:54.928825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.928828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.928831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.928833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.928839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.928842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.928858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:54.936538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:54.938380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:54.938393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:54.938395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:54.938399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:54.938404Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 920 [2:7556554526615487075:6726]
2025-10-02T09:30:54.938414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:54.938427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:54.938430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.938432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.938434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.938447Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:54.938456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:54.938464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:54.938514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.938520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.938521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.938523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:54.938526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:54.938585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:54.938591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.938602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:54.938616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:54.938635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:54.938656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012342:2446], now have 1 active actors on pipe
2025-10-02T09:30:54.938664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554526691012586:7933], now have 1 active actors on pipe
2025-10-02T09:30:54.938669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.938670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.938672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.938682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:54.938690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:54.938693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:54.938694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:54.938696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:54.938709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:54.938715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:54.938708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 920
2025-10-02T09:30:54.938717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 920
2025-10-02T09:30:54.938737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.938748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:54.938751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:54.938769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.938777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.938812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:54.938821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:54.938824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:54.938826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:54.938835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:54.938846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:54.938863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.939016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:54.939024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:54.939036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:54.939137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 921 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0
2025-10-02T09:30:54.939412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df3beb-d217c72e-99da6048-20f5be6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:54.941581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Write session: try to update token
2025-10-02T09:30:54.941594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:54.948543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:54.948559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:54.948561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:54.948562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:54.948568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.948570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.948573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554526615487070:6726]
2025-10-02T09:30:54.948596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:54.948600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:54.948603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:54.948605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:54.948610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:54.948612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:54.948717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:54.953203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId: src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:54.955600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.011886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985979895:7829]
2025-10-02T09:30:55.012119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 920, pipe: [1:7556554530985979895:7829]
2025-10-02T09:30:55.071522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:55.071874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.071886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.071917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985979895:7829], now have 1 active actors on pipe
2025-10-02T09:30:55.072134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:55.072137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:55.072139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:55.072155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:55.072188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 921 reason: error at write: Disconnected sessionId: src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0
2025-10-02T09:30:55.072188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985979895:7829]
2025-10-02T09:30:55.072342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 921 sessionId: src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0 is DEAD
2025-10-02T09:30:55.072457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:55.072467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Write session will restart in 0.007757s
2025-10-02T09:30:55.072485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Write session: Do CDS request
2025-10-02T09:30:55.072491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:55.081222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.081291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:55.081307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 922
2025-10-02T09:30:55.081459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.081489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:55.081498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:55.081502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:55.081875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 922 sessionId:  describe result for acl check
2025-10-02T09:30:55.081908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:55.081915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:55.081918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:55.081922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554530985979976:7937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:55.082424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554530985979976:7937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:55.084335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554530985979976:7937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:55.086342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:55.088281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554530985979976:7937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:55.088294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554530985979976:7937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:55.088297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554530985979976:7937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:55.088304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:55.088309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:55.088457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:55.088467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:55.088476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:55.088519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:55.088556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554530910454621:6728]
2025-10-02T09:30:55.089129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:55.089363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:55.089403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:55.089682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:55.089735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.089741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.089742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.089743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.089744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.089745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.089746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.089747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.089748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.089749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.089749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.089750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.089755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.089765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.089769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.089772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.089776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.089779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.089782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.089786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.089789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.089793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.089796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.089800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.089805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.089813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.089818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.089825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.089829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.089834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.089840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.089844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.089848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.089858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.089862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.089866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.089870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.089877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.089881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.089885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.089891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.089896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.089900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.089905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.089909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.089913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.089917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.089922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.089955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:55.097843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:55.099718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:55.099730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:55.099732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:55.099734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:55.099738Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 921 [2:7556554530910454621:6728]
2025-10-02T09:30:55.099747Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:55.099757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:55.099759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.099760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.099761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.099770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:55.099773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:55.099778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:55.099821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.099828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.099830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.099833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:55.099835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:55.099893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:55.099901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.099913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.099924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.099943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:55.099964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980142:7937], now have 1 active actors on pipe
2025-10-02T09:30:55.099973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985979896:2446], now have 1 active actors on pipe
2025-10-02T09:30:55.099979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.099982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.099984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.099998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:55.100015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:55.100015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:55.100018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:55.100005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 921
2025-10-02T09:30:55.100022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:55.100032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:55.100035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:55.100041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 921
2025-10-02T09:30:55.100070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.100078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.100089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.100099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:55.100110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:55.100129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:55.100139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.100142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.100144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:55.100152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.100162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:55.100181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.100313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.100322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.100335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.100429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 922 partition: 0 MaxSeqNo: 36 sessionId: src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0
2025-10-02T09:30:55.100720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef089a3-767faa0f-ab3e27fd-ad7ba123_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:55.103067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Write session: try to update token
2025-10-02T09:30:55.103080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:55.110070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:55.110086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:55.110088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:55.110090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:55.110098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.110101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.110105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554530910454615:6728]
2025-10-02T09:30:55.110136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:55.110137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:55.110140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:55.110142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.110143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:55.110144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:55.110285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:55.115246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId: src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:55.117411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.172136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985980155:7829]
2025-10-02T09:30:55.172364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 921, pipe: [1:7556554530985980155:7829]
2025-10-02T09:30:55.236969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:55.237204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.237216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.237245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980155:7829], now have 1 active actors on pipe
2025-10-02T09:30:55.237373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:55.237407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:55.237426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:55.237472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 922 reason: error at write: Disconnected sessionId: src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0
2025-10-02T09:30:55.237600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 922 sessionId: src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0 is DEAD
2025-10-02T09:30:55.237730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:55.237735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Write session will restart in 0.009848s
2025-10-02T09:30:55.237751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Write session: Do CDS request
2025-10-02T09:30:55.237755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:55.237836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985980155:7829]
2025-10-02T09:30:55.237867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:55.248271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.248440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:55.248455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 923
2025-10-02T09:30:55.248791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.248833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:55.248838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:55.248841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:55.249208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 923 sessionId:  describe result for acl check
2025-10-02T09:30:55.249245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:55.249251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:55.249253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:55.249257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554530985980389:7949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:55.249702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554530985980389:7949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:55.250474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:55.251352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554530985980389:7949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:55.252303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:55.252411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:55.252418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:55.252424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:55.252451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:55.252476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554530910454908:6737]
2025-10-02T09:30:55.252851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:55.253048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:55.253071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:55.253254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:55.253284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.253288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.253289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.253289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.253290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.253290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.253291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.253291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.253292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.253292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.253293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.253293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.253296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.253302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.253304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.253307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.253308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.253310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.253312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.253314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.253316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.253318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.253321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.253323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.253326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.253330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.253334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.253336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.253338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.253341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.253343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.253346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.253348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.253350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.253353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.253356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.253358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.253361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.253363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.253365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.253368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.253370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.253373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.253375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.253377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.253380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.253381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.253384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.253401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:55.253534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554530985980389:7949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:55.253545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554530985980389:7949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:55.253547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554530985980389:7949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:55.253552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:55.261185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:55.262986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:55.262995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:55.262996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:55.262998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:55.263002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 922 [2:7556554530910454908:6737]
2025-10-02T09:30:55.263009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:55.263019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:55.263021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.263022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.263024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.263032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:55.263038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:55.263043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:55.263073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.263079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.263080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.263082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:55.263083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:55.263119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:55.263125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.263136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.263150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.263161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:55.263176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980429:7949], now have 1 active actors on pipe
2025-10-02T09:30:55.263181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980170:2446], now have 1 active actors on pipe
2025-10-02T09:30:55.263185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.263187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.263188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.263197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:55.263206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:55.263206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:55.263208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:55.263209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:55.263214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:55.263215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:55.263229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.263234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:55.263224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 922
2025-10-02T09:30:55.263227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 922
2025-10-02T09:30:55.263244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:55.263252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.263254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.263269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:55.263277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.263279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.263279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:55.263285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.263290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:55.263305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.263401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.263406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.263414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.263475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 923 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0
2025-10-02T09:30:55.263731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a028c9b8-5078407b-afe90d5d-8161bdda_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:55.266004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Write session: try to update token
2025-10-02T09:30:55.266016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:55.273022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:55.273036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:55.273038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:55.273040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:55.273046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.273050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.273053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554530910454903:6737]
2025-10-02T09:30:55.273082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:55.273086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.273089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:55.273090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:55.273095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:55.273100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:55.273204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:55.277190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId: src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:55.279179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.337998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985980436:7829]
2025-10-02T09:30:55.338186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 922, pipe: [1:7556554530985980436:7829]
2025-10-02T09:30:55.391724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:55.391920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.391929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.391955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980436:7829], now have 1 active actors on pipe
2025-10-02T09:30:55.392096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:55.392143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:55.392144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:55.392156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:55.392175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985980436:7829]
2025-10-02T09:30:55.392200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 923 reason: error at write: Disconnected sessionId: src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0
2025-10-02T09:30:55.392333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 923 sessionId: src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0 is DEAD
2025-10-02T09:30:55.392443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:55.392451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Write session will restart in 0.007982s
2025-10-02T09:30:55.392466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Write session: Do CDS request
2025-10-02T09:30:55.392469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:55.401129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.401223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:55.401234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 924
2025-10-02T09:30:55.401317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.401337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:55.401343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:55.401346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:55.401680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 924 sessionId:  describe result for acl check
2025-10-02T09:30:55.401706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:55.401712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:55.401714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:55.401719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554530985980536:7953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:55.402060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554530985980536:7953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:55.403599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554530985980536:7953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:55.405361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:55.407063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:55.407172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:55.407180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:55.407171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554530985980536:7953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:55.407185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:55.407181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554530985980536:7953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:55.407183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554530985980536:7953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:55.407187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:55.407214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:55.407236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554530910455159:6745]
2025-10-02T09:30:55.407600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:55.407768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:55.407798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:55.407975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:55.408016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.408021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.408021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.408022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.408023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.408023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.408024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.408025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.408025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.408025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.408026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.408026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.408029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.408035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.408037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.408039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.408041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.408043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.408045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.408047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.408049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.408051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.408053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.408054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.408059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.408063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.408066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.408069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.408071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.408074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.408076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.408078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.408080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.408083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.408085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.408088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.408090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.408093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.408094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.408097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.408099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.408102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.408104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.408107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.408109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.408111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.408113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.408116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.408133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:55.415693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:55.417050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:55.417060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:55.417062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:55.417064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:55.417067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 923 [2:7556554530910455159:6745]
2025-10-02T09:30:55.417074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:55.417084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:55.417088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.417090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.417091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.417100Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:55.417107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:55.417112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:55.417226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.417232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.417233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.417235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:55.417237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:55.417275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:55.417280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.417286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.417291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.417303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:55.417317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980686:7953], now have 1 active actors on pipe
2025-10-02T09:30:55.417323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980438:2446], now have 1 active actors on pipe
2025-10-02T09:30:55.417326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.417327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.417328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.417336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:55.417343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:55.417351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:55.417351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:55.417354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:55.417355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:55.417355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:55.417369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.417370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:55.417372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:55.417398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.417377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 923
2025-10-02T09:30:55.417403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.417390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 923
2025-10-02T09:30:55.417421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:55.417428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.417430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.417434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:55.417440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.417448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:55.417459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.417555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.417560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.417568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.417633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 924 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0
2025-10-02T09:30:55.417873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca02688f-e72aef57-f7c62dd3-48690d56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:55.420102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Write session: try to update token
2025-10-02T09:30:55.420114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:55.426991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:55.427005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:55.427006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:55.427007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:55.427013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.427015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.427017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554530910455154:6745]
2025-10-02T09:30:55.427040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:55.427042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:55.427044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.427045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:55.427046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:55.427049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:55.427156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:55.432131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId: src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:55.434330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.492140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985980697:7829]
2025-10-02T09:30:55.492362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 923, pipe: [1:7556554530985980697:7829]
2025-10-02T09:30:55.545451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:55.545909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.545919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.545943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980697:7829], now have 1 active actors on pipe
2025-10-02T09:30:55.546090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:55.546167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985980697:7829]
2025-10-02T09:30:55.546170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:55.546194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:55.546234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 924 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0
2025-10-02T09:30:55.546397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 924 sessionId: src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0 is DEAD
2025-10-02T09:30:55.546529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:55.546538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Write session will restart in 0.009557s
2025-10-02T09:30:55.546554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Write session: Do CDS request
2025-10-02T09:30:55.546558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:55.557177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.557259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:55.557272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 925
2025-10-02T09:30:55.557361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.557383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:55.557386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:55.557389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:55.557650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 925 sessionId:  describe result for acl check
2025-10-02T09:30:55.557669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:55.557674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:55.557676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:55.557679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554530985980911:7957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:55.558015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554530985980911:7957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:55.558796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:55.559662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554530985980911:7957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:55.560494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:55.560618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:55.560623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:55.560629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:55.560660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:55.560684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554530910455410:6747]
2025-10-02T09:30:55.561045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:55.561216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:55.561240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:55.561442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:55.561477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.561481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.561481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.561482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.561482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.561483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.561484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.561484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.561485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.561485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.561486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.561486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.561489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.561495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.561497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.561499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.561501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.561503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.561505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.561507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.561509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.561511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.561513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.561515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.561519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.561523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.561526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.561539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.561541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.561544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.561548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.561551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.561553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.561556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.561560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.561562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.561567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.561570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.561572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.561578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.561580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.561583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.561585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.561588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.561590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.561592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.561594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.561598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.561616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:55.561621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554530985980911:7957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:55.561630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554530985980911:7957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:55.561632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554530985980911:7957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:55.561636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:55.569016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:55.570443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:55.570453Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:55.570455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:55.570457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:55.570461Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 924 [2:7556554530910455410:6747]
2025-10-02T09:30:55.570468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:55.570479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:55.570484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.570486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.570487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.570495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:55.570499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:55.570503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:55.570537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.570541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.570543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.570545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:55.570546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:55.570585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:55.570590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.570596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.570602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.570611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:55.570626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980950:7957], now have 1 active actors on pipe
2025-10-02T09:30:55.570631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980699:2446], now have 1 active actors on pipe
2025-10-02T09:30:55.570635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.570637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.570638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.570645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:55.570653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:55.570657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:55.570660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:55.570661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:55.570664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:55.570666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:55.570684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.570689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:55.570691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:55.570700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.570705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.570673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 924
2025-10-02T09:30:55.570674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 924
2025-10-02T09:30:55.570734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:55.570741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.570743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.570744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:55.570749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.570758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:55.570770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.570866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.570876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.570892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.570973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 925 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0
2025-10-02T09:30:55.571244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9323c8c-8a78be2-7e0d8e71-10ff8822_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:55.573391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Write session: try to update token
2025-10-02T09:30:55.573403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:55.580535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:55.580549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:55.580550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:55.580552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:55.580558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.580561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.580563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554530910455405:6747]
2025-10-02T09:30:55.580588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:55.580590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:55.580592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.580593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:55.580593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:55.580595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:55.580714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:55.583743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId: src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:55.586178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.646274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985980959:7829]
2025-10-02T09:30:55.646525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 924, pipe: [1:7556554530985980959:7829]
2025-10-02T09:30:55.709072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:55.709290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.709299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.709326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980959:7829], now have 1 active actors on pipe
2025-10-02T09:30:55.709473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:55.709534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:55.709541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:55.709549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:55.709573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985980959:7829]
2025-10-02T09:30:55.709605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 925 reason: error at write: Disconnected sessionId: src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0
2025-10-02T09:30:55.709738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 925 sessionId: src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0 is DEAD
2025-10-02T09:30:55.709872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:55.709881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Write session will restart in 0.008968s
2025-10-02T09:30:55.709898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Write session: Do CDS request
2025-10-02T09:30:55.709903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:55.720238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.720350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:55.720367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 926
2025-10-02T09:30:55.720466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.720493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:55.720503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:55.720506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:55.720835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 926 sessionId:  describe result for acl check
2025-10-02T09:30:55.720862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:55.720863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:55.720864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:55.720868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554530985981146:7962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:55.721213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554530985981146:7962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:55.722916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:55.723093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554530985981146:7962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:55.724744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:55.724858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:55.724868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:55.724874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:55.724902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:55.724929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554530910455675:6750]
2025-10-02T09:30:55.724990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554530985981146:7962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:55.725002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554530985981146:7962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:55.725005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554530985981146:7962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:55.725010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:55.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:55.725447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:55.725468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:55.725653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:55.725684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.725688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.725689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.725690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.725690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.725691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.725691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.725692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.725693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.725693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.725694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.725694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.725697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.725703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.725705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.725707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.725709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.725711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.725713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.725715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.725717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.725719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.725721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.725723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.725726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.725730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.725733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.725736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.725738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.725741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.725744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.725747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.725749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.725752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.725753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.725756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.725758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.725761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.725763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.725766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.725768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.725771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.725773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.725776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.725779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.725785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.725787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.725790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.725808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:55.733333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:55.734818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:55.734829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:55.734831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:55.734833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:55.734837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 925 [2:7556554530910455675:6750]
2025-10-02T09:30:55.734848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:55.734859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:55.734865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.734866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.734868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.734878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:55.734885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:55.734889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:55.734929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.734942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.734944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.734946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:55.734947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:55.734990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:55.734994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.735001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.735010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.735021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:55.735037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985981223:7962], now have 1 active actors on pipe
2025-10-02T09:30:55.735043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985980973:2446], now have 1 active actors on pipe
2025-10-02T09:30:55.735047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.735048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.735050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.735059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:55.735070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:55.735071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:55.735073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:55.735074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:55.735081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:55.735083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:55.735105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.735113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:55.735118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:55.735118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 925
2025-10-02T09:30:55.735119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 925
2025-10-02T09:30:55.735145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.735150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.735166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:55.735172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.735175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.735176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:55.735181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.735187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:55.735197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.735286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.735291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.735299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.735351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 926 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0
2025-10-02T09:30:55.735644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1824903-4aa20dd4-952677bf-c0968b1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:55.737901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Write session: try to update token
2025-10-02T09:30:55.737914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:55.744685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:55.744699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:55.744701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:55.744702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:55.744706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.744709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.744712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554530910455670:6750]
2025-10-02T09:30:55.744735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:55.744737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:55.744738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.744740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:55.744740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:55.744743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:55.744869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:55.748581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId: src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:55.750756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.809578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985981241:7829]
2025-10-02T09:30:55.809794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 925, pipe: [1:7556554530985981241:7829]
2025-10-02T09:30:55.864585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:55.864798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.864822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.864848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985981241:7829], now have 1 active actors on pipe
2025-10-02T09:30:55.865011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:55.865160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:55.865165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985981241:7829]
2025-10-02T09:30:55.865174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:55.865179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:55.865221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 926 reason: error at write: Disconnected sessionId: src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0
2025-10-02T09:30:55.865351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 926 sessionId: src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0 is DEAD
2025-10-02T09:30:55.865479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:55.865490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Write session will restart in 0.005919s
2025-10-02T09:30:55.865510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Write session: Do CDS request
2025-10-02T09:30:55.865515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:55.872173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.872257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:55.872268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 927
2025-10-02T09:30:55.872353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:55.872375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:55.872381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:55.872384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:55.872703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 927 sessionId:  describe result for acl check
2025-10-02T09:30:55.872728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:55.872733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:55.872735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:55.872738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554530985981289:7967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:55.873113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554530985981289:7967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:55.874984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554530985981289:7967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:55.877242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554530985981289:7967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:55.877251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554530985981289:7967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:55.877253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554530985981289:7967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:55.877258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:55.879347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:55.881211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:55.881354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:55.881361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:55.881368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:55.881402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:55.881427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554530910455930:6752]
2025-10-02T09:30:55.881785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:55.881960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:55.881984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:55.882169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:55.882199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.882203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.882203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.882204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.882205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.882205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.882206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.882206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.882207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.882207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.882208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.882209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.882211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.882218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.882220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.882222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.882224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.882226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.882228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.882230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.882232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.882234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.882236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.882238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.882242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.882247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:55.882250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.882253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:55.882255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.882257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:55.882260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.882263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:55.882265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.882268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:55.882270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.882273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:55.882275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.882278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:55.882281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.882283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:55.882286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.882288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:55.882291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.882294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.882296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.882303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.882305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.882308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.882326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:55.889951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:55.891565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:55.891576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:55.891577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:55.891579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:55.891583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 926 [2:7556554530910455930:6752]
2025-10-02T09:30:55.891592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:55.891601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:55.891606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.891608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.891609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.891625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:55.891632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:55.891636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:55.891669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.891673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.891674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.891676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:55.891677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:55.891718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:55.891723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.891729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:55.891735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:55.891743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:55.891759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985981468:7967], now have 1 active actors on pipe
2025-10-02T09:30:55.891765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985981246:2446], now have 1 active actors on pipe
2025-10-02T09:30:55.891770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.891772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.891774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.891782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:55.891790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:55.891796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:55.891799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:55.891800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:55.891801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:55.891803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:55.891820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.891827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:55.891834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:55.891826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 926
2025-10-02T09:30:55.891829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 926
2025-10-02T09:30:55.891865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.891874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.891890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:55.891894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:55.891896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:55.891898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:55.891903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:55.891919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:55.891930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.892026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:55.892031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:55.892039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:55.892102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 927 partition: 0 MaxSeqNo: 36 sessionId: src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0
2025-10-02T09:30:55.892348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bdfe1e-401d926b-db1cbd7e-6e53c7ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:55.894567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Write session: try to update token
2025-10-02T09:30:55.894577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:55.901411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:55.901425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:55.901427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:55.901428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:55.901434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.901437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.901439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554530910455925:6752]
2025-10-02T09:30:55.901465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:55.901465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:55.901468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:55.901468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:55.901470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:55.901470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:55.901588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:55.905277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId: src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:55.907325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:55.965227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554530985981508:7829]
2025-10-02T09:30:55.965483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 926, pipe: [1:7556554530985981508:7829]
2025-10-02T09:30:56.025182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:56.025607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.025623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.025658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554530985981508:7829], now have 1 active actors on pipe
2025-10-02T09:30:56.025906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:56.025944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:56.025955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:56.025959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:56.025990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554530985981508:7829]
2025-10-02T09:30:56.026028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 927 reason: error at write: Disconnected sessionId: src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0
2025-10-02T09:30:56.026170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 927 sessionId: src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0 is DEAD
2025-10-02T09:30:56.026291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:56.026300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Write session will restart in 0.005421s
2025-10-02T09:30:56.026318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Write session: Do CDS request
2025-10-02T09:30:56.026322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:56.033087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.033194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:56.033207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 928
2025-10-02T09:30:56.033289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.033311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:56.033318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:56.033321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:56.033673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 928 sessionId:  describe result for acl check
2025-10-02T09:30:56.033708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:56.033710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:56.033712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:56.033716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554535280948820:7971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:56.034211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554535280948820:7971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:56.036638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554535280948820:7971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:56.039551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554535280948820:7971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:56.039561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554535280948820:7971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:56.039563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554535280948820:7971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:56.039567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:56.042840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:56.045433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:56.045582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:56.045589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:56.045595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:56.045627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:56.045652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554535205423483:6755]
2025-10-02T09:30:56.046002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:56.046208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:56.046233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:56.046418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:56.046449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.046453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.046454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.046454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.046455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.046455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.046456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.046456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.046457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.046458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.046458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.046459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.046462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.046468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.046470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.046472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.046475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.046477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.046479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.046481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.046483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.046485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.046487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.046489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.046493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.046497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.046500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.046503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.046505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.046508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.046511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.046513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.046516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.046519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.046521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.046523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.046526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.046529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.046531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.046533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.046539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.046542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.046544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.046547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.046550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.046557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.046561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.046569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.046600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:56.054440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:56.056060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:56.056072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:56.056073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:56.056075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:56.056080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 927 [2:7556554535205423483:6755]
2025-10-02T09:30:56.056090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:56.056102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:56.056107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.056109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.056110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.056121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:56.056127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:56.056132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:56.056170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.056175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.056178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.056180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:56.056181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:56.056223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:56.056228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.056235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.056240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.056248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:56.056261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280948961:7971], now have 1 active actors on pipe
2025-10-02T09:30:56.056268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.056270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.056271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.056279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:56.056284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280948806:2446], now have 1 active actors on pipe
2025-10-02T09:30:56.056289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:56.056291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:56.056294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:56.056296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:56.056297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:56.056298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:56.056315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.056320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:56.056323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:56.056362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 927
2025-10-02T09:30:56.056362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 927
2025-10-02T09:30:56.056434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.056440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.056455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|baccce0c-a55b993a-21ade3f4-4d975312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:56.056463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.056465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.056466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:56.056471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.056477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:56.056484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.056629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.056634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.056642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.056717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 928 partition: 0 MaxSeqNo: 36 sessionId: src_id|baccce0c-a55b993a-21ade3f4-4d975312_0
2025-10-02T09:30:56.057000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff31b6-ede39163-455c7a64-d5bfccf0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|baccce0c-a55b993a-21ade3f4-4d975312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:56.059435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Write session: try to update token
2025-10-02T09:30:56.059451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:56.069764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:56.069778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.069783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.069817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:56.069823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:56.069955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:56.070074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:56.070190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:56.070308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:56.070462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:56.070491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:56.071140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId: src_id|baccce0c-a55b993a-21ade3f4-4d975312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:56.073291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:56.073482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.073498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.073526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:56.073618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:56.074747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:56.074759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.074761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:56.074762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:56.074767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.074770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.074772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554535205423478:6755]
2025-10-02T09:30:56.074794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:56.074801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:56.074802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.074803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:56.074804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:56.074807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:56.074911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:56.126019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554535280949069:7829]
2025-10-02T09:30:56.126268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 927, pipe: [1:7556554535280949069:7829]
2025-10-02T09:30:56.198881Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:56.205664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.205687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.205820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.205872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.205926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.205979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.206020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.206027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.206083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.206133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.206186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.206238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.206276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.206281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.206332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.206384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.206443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.206497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.206535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.206539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.206595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.206657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.206715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.206780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.206824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.206830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.206897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.206960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.207021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.207081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.207125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.207131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.207188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.207236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.207289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.207341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.207402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.207409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.207462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.207511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.207567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.207646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.207685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.207690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.207766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.207815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.207876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.207934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.207983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.207988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.208040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.208089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.208138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.208189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.208238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.208243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.208293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.208342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.208393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.208442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.208479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.208483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.208517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949069:7829], now have 1 active actors on pipe
2025-10-02T09:30:56.208726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:56.208734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554535280949069:7829]
2025-10-02T09:30:56.208739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:56.208753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:56.208761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 928 reason: error at write: Disconnected sessionId: src_id|baccce0c-a55b993a-21ade3f4-4d975312_0
2025-10-02T09:30:56.208946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 928 sessionId: src_id|baccce0c-a55b993a-21ade3f4-4d975312_0 is DEAD
2025-10-02T09:30:56.209099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:56.209110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Write session will restart in 0.006895s
2025-10-02T09:30:56.209134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Write session: Do CDS request
2025-10-02T09:30:56.209140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:56.209253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:56.217131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.217245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:56.217257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 929
2025-10-02T09:30:56.217375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.217397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:56.217405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:56.217407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:56.217704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 929 sessionId:  describe result for acl check
2025-10-02T09:30:56.217730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:56.217734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:56.217735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:56.217738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554535280949100:7976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:56.218097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554535280949100:7976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:56.220701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554535280949100:7976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:56.223756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554535280949100:7976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:56.223767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554535280949100:7976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:56.223768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554535280949100:7976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:56.223773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:56.226301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:56.229552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:56.229695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:56.229702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:56.229708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:56.229741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:56.229770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554535205423741:6758]
2025-10-02T09:30:56.230138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:56.230413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:56.230437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:56.230642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:56.230676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.230680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.230681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.230681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.230682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.230683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.230683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.230684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.230685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.230685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.230686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.230687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.230689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.230696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.230699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.230701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.230703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.230706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.230708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.230710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.230712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.230714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.230716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.230718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.230724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.230728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.230732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.230735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.230737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.230739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.230742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.230744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.230747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.230754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.230756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.230758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.230761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.230764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.230766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.230769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.230772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.230774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.230776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.230782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.230784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.230787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.230789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.230792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.230811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:56.238731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:56.240264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:56.240276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:56.240278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:56.240280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:56.240284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 928 [2:7556554535205423741:6758]
2025-10-02T09:30:56.240295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:56.240307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:56.240308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.240310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.240311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.240321Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:56.240324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:56.240328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:56.240365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.240370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.240371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.240373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:56.240375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:56.240416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:56.240421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.240428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.240434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.240444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:56.240458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.240462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.240464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.240468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:56.240477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:56.240488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:56.240492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:56.240499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949074:2446], now have 1 active actors on pipe
2025-10-02T09:30:56.240503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949289:7976], now have 1 active actors on pipe
2025-10-02T09:30:56.240520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.240525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:56.240537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 928
2025-10-02T09:30:56.240565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:56.240572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:56.240574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:56.240542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 928
2025-10-02T09:30:56.240578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:56.240634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.240644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.240667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c17f1940-746ee930-540c6b32-11730948_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:56.240678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.240684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.240685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:56.240694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.240707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:56.240721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.240860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.240868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.240880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.240943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 929 partition: 0 MaxSeqNo: 36 sessionId: src_id|c17f1940-746ee930-540c6b32-11730948_0
2025-10-02T09:30:56.241274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baccce0c-a55b993a-21ade3f4-4d975312_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c17f1940-746ee930-540c6b32-11730948_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:56.243948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Write session: try to update token
2025-10-02T09:30:56.243961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:56.250442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:56.250457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.250462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.250493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:56.250494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:56.250632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:56.250754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:56.250866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:56.250989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:56.251474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:56.251506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:56.256349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId: src_id|c17f1940-746ee930-540c6b32-11730948_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:56.258359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:56.258510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.258521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.258541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:56.258604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:56.259409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:56.259420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.259421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:56.259423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:56.259427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.259432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.259434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554535205423736:6758]
2025-10-02T09:30:56.259455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:56.259459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:56.259461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:56.259462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.259463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:56.259464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:56.259578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:56.308773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554535280949360:7829]
2025-10-02T09:30:56.308999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 928, pipe: [1:7556554535280949360:7829]
2025-10-02T09:30:56.390247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:56.396086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.396106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.396234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.396282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.396335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.396385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.396423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.396429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.396486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.396535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.396584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.396635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.396670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.396675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.396726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.396772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.396843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.396894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.396931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.396936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.396989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.397069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.397122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.397172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.397209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.397213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.397264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.397314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.397363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.397415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.397452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.397457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.397511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.397558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.397607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.397659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.397696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.397701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.397750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.397798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.397853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.397903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.397939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.397943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.397992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.398038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.398089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.398138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.398173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.398177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.398223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.398270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.398328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.398379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.398413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.398417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.398463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:56.398510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:56.398557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:56.398603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:56.398650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:56.398654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:56.398687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949360:7829], now have 1 active actors on pipe
2025-10-02T09:30:56.398888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554535280949360:7829]
2025-10-02T09:30:56.398901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:56.398917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:56.398918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:56.398946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 929 reason: error at write: Disconnected sessionId: src_id|c17f1940-746ee930-540c6b32-11730948_0
2025-10-02T09:30:56.399074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 929 sessionId: src_id|c17f1940-746ee930-540c6b32-11730948_0 is DEAD
2025-10-02T09:30:56.399132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:56.399200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:56.399209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Write session will restart in 0.008202s
2025-10-02T09:30:56.399230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Write session: Do CDS request
2025-10-02T09:30:56.399235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:56.408272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.408341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:56.408358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 930
2025-10-02T09:30:56.408473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.408499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:56.408508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:56.408511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:56.409014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 930 sessionId:  describe result for acl check
2025-10-02T09:30:56.409041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:56.409046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:56.409047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:56.409053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554535280949426:7987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:56.409579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554535280949426:7987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:56.411861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554535280949426:7987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:56.414199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554535280949426:7987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:56.414210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554535280949426:7987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:56.414212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554535280949426:7987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:56.414217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:56.415332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:56.417354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:56.417490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:56.417497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:56.417504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:56.417542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:56.417568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554535205424037:6772]
2025-10-02T09:30:56.417933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:56.418138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:56.418161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:56.418341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:56.418370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.418374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.418375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.418376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.418376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.418377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.418378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.418378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.418379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.418379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.418380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.418380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.418383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.418391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.418393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.418395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.418397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.418399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.418401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.418403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.418405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.418408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.418410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.418412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.418415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.418419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.418424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.418427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.418429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.418432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.418435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.418437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.418440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.418443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.418445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.418447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.418449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.418452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.418456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.418459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.418461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.418464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.418466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.418469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.418472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.418475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.418481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.418484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.418499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:56.426376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:56.427792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:56.427804Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:56.427806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:56.427808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:56.427813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 929 [2:7556554535205424037:6772]
2025-10-02T09:30:56.427821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:56.427834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:56.427836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.427838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.427839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.427849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:56.427853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:56.427858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:56.427895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.427901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.427902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.427904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:56.427906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:56.427950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:56.427955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.427962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.427968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.427978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:56.427993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.427997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.427999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.428004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:56.428012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:56.428015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:56.428019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:56.428021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:56.428027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:56.428030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:56.428039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949364:2446], now have 1 active actors on pipe
2025-10-02T09:30:56.428046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949615:7987], now have 1 active actors on pipe
2025-10-02T09:30:56.428067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.428076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:56.428087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:56.428089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 929
2025-10-02T09:30:56.428101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 929
2025-10-02T09:30:56.428123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.428130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.428146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c58075b9-db94fea0-9ddf2a44-185e643_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:56.428153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.428155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.428156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:56.428161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.428169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:56.428177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.428291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.428297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.428306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.428364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 930 partition: 0 MaxSeqNo: 36 sessionId: src_id|c58075b9-db94fea0-9ddf2a44-185e643_0
2025-10-02T09:30:56.428639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17f1940-746ee930-540c6b32-11730948_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c58075b9-db94fea0-9ddf2a44-185e643_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:56.430860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Write session: try to update token
2025-10-02T09:30:56.430872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:56.437888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:56.437902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.437905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:56.437906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:56.437916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.437920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.437925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554535205424032:6772]
2025-10-02T09:30:56.437961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:56.437967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.437969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:56.437973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:56.437978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:56.437980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:56.438107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:56.442280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId: src_id|c58075b9-db94fea0-9ddf2a44-185e643_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:56.444394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:56.499245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554535280949629:7829]
2025-10-02T09:30:56.499517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 929, pipe: [1:7556554535280949629:7829]
2025-10-02T09:30:56.564454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:56.565129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.565140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.565165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949629:7829], now have 1 active actors on pipe
2025-10-02T09:30:56.565325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:56.565399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:56.565402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554535280949629:7829]
2025-10-02T09:30:56.565420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:56.565479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 930 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c58075b9-db94fea0-9ddf2a44-185e643_0
2025-10-02T09:30:56.565607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 930 sessionId: src_id|c58075b9-db94fea0-9ddf2a44-185e643_0 is DEAD
2025-10-02T09:30:56.565755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:56.565764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Write session will restart in 0.009199s
2025-10-02T09:30:56.565781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Write session: Do CDS request
2025-10-02T09:30:56.565786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:56.576254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.576340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:56.576350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 931
2025-10-02T09:30:56.576460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.576481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:56.576487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:56.576497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:56.576991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 931 sessionId:  describe result for acl check
2025-10-02T09:30:56.577026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:56.577031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:56.577034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:56.577038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554535280949753:7993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:56.577426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554535280949753:7993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:56.579716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554535280949753:7993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:56.581506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:56.581556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554535280949753:7993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:56.581565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554535280949753:7993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:56.581567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554535280949753:7993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:56.581571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:56.584007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:56.584118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:56.584124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:56.584129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:56.584155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:56.584177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554535205424296:6774]
2025-10-02T09:30:56.584534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:56.584723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:56.584746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:56.584939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:56.584971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.584975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.584975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.584976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.584977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.584977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.584978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.584978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.584979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.584979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.584980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.584980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.584983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.584989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.584991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.584993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.584995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.584997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.584999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.585001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.585003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.585005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.585007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.585009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.585012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.585016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.585019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.585023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.585025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.585028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.585030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.585032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.585035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.585038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.585040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.585042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.585045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.585048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.585050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.585052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.585054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.585061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.585062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.585065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.585067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.585073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.585075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.585077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.585094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:56.592595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:56.594133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:56.594146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:56.594147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:56.594150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:56.594154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 930 [2:7556554535205424296:6774]
2025-10-02T09:30:56.594162Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:56.594173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:56.594175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.594177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.594178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.594187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:56.594194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:56.594199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:56.594231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.594236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.594237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.594239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:56.594241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:56.594281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:56.594286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.594293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.594298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.594310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:56.594325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949897:7993], now have 1 active actors on pipe
2025-10-02T09:30:56.594330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949634:2446], now have 1 active actors on pipe
2025-10-02T09:30:56.594334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.594336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.594338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.594346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:56.594356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:56.594359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:56.594361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:56.594363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:56.594367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:56.594369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:56.594385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.594392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:56.594400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:56.594402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 930
2025-10-02T09:30:56.594406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 930
2025-10-02T09:30:56.594447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.594452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.594468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:56.594475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.594477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.594480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:56.594485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.594493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:56.594503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.594615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.594620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.594628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.594704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 931 partition: 0 MaxSeqNo: 36 sessionId: src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0
2025-10-02T09:30:56.594964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58075b9-db94fea0-9ddf2a44-185e643_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:56.597198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Write session: try to update token
2025-10-02T09:30:56.597209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:56.604397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:56.604414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.604416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:56.604418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:56.604426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.604429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.604433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554535205424290:6774]
2025-10-02T09:30:56.604465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:56.604471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.604473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:56.604473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:56.604477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:56.604479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:56.604598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:56.607941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId: src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:56.610016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:56.665623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554535280949921:7829]
2025-10-02T09:30:56.665820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 930, pipe: [1:7556554535280949921:7829]
2025-10-02T09:30:56.724884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:56.725372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.725382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.725415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949921:7829], now have 1 active actors on pipe
2025-10-02T09:30:56.725563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:56.725662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:56.725675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:56.725686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:56.725721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 931 reason: error at write: Disconnected sessionId: src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0
2025-10-02T09:30:56.725729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554535280949921:7829]
2025-10-02T09:30:56.726013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:56.726021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Write session will restart in 0.007888s
2025-10-02T09:30:56.726035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Write session: Do CDS request
2025-10-02T09:30:56.726041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:56.725865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 931 sessionId: src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0 is DEAD
2025-10-02T09:30:56.735207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.735314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:56.735325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 932
2025-10-02T09:30:56.735408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.735428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:56.735435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:56.735438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:56.735828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 932 sessionId:  describe result for acl check
2025-10-02T09:30:56.735865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:56.735870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:56.735871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:56.735874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554535280949993:7998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:56.736242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554535280949993:7998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:56.738925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554535280949993:7998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:56.741657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554535280949993:7998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:56.741670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554535280949993:7998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:56.741673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554535280949993:7998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:56.741679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:56.742815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:56.745132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:56.745233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:56.745240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:56.745246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:56.745273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:56.745298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554535205424568:6777]
2025-10-02T09:30:56.745706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:56.745916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:56.745942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:56.746128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:56.746161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.746165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.746166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.746166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.746167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.746168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.746168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.746169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.746170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.746170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.746171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.746172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.746174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.746181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.746183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.746186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.746188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.746190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.746192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.746194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.746196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.746199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.746201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.746203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.746207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.746211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.746214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.746217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.746220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.746223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.746225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.746228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.746230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.746233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.746235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.746238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.746241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.746244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.746247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.746250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.746253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.746256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.746258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.746263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.746267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.746270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.746273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.746276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.746293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:56.754021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:56.755691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:56.755705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:56.755707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:56.755710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:56.755717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 931 [2:7556554535205424568:6777]
2025-10-02T09:30:56.755728Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:56.755742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:56.755749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.755751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.755753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.755766Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:56.755775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:56.755781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:56.755831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.755838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.755840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.755843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:56.755844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:56.755896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:56.755903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.755914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.755925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.755944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:56.755963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280950176:7998], now have 1 active actors on pipe
2025-10-02T09:30:56.755971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280949923:2446], now have 1 active actors on pipe
2025-10-02T09:30:56.755976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.755980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.755982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.755993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:56.756001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 931
2025-10-02T09:30:56.756004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:56.756007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:56.756012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:56.756013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:56.756020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:56.756022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:56.756045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.756049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:56.756053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:56.756059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 931
2025-10-02T09:30:56.756063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.756071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.756104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:56.756114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.756117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.756119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:56.756127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.756138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:56.756155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.756271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.756281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.756298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.756372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 932 partition: 0 MaxSeqNo: 36 sessionId: src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0
2025-10-02T09:30:56.756663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69b754be-620b007a-ebcce4bc-2de4b1dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:56.758875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Write session: try to update token
2025-10-02T09:30:56.758887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:56.765657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:56.765673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.765674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:56.765676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:56.765682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.765688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.765690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554535205424563:6777]
2025-10-02T09:30:56.765717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:56.765722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.765723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:56.765747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:56.765761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:56.765765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:56.765845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:56.769982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId: src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:56.772140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:56.825891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554535280950197:7829]
2025-10-02T09:30:56.826103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 931, pipe: [1:7556554535280950197:7829]
2025-10-02T09:30:56.888439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:56.888922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.888936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.888968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280950197:7829], now have 1 active actors on pipe
2025-10-02T09:30:56.889217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:56.889231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:56.889242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554535280950197:7829]
2025-10-02T09:30:56.889259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:56.889284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 932 reason: error at write: Disconnected sessionId: src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0
2025-10-02T09:30:56.889435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 932 sessionId: src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0 is DEAD
2025-10-02T09:30:56.889485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:56.889609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:56.889621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Write session will restart in 0.009098s
2025-10-02T09:30:56.889639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Write session: Do CDS request
2025-10-02T09:30:56.889644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:56.900222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.900284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:56.900296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 933
2025-10-02T09:30:56.900401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:56.900422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:56.900424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:56.900427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:56.900862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 933 sessionId:  describe result for acl check
2025-10-02T09:30:56.900884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:56.900888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:56.900889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:56.900894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554535280950370:8003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:56.901266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554535280950370:8003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:56.902863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554535280950370:8003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:56.903381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:56.905789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:56.905927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:56.905941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:56.905948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:56.905980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:56.906005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554535205424829:6780]
2025-10-02T09:30:56.906071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554535280950370:8003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:56.906085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554535280950370:8003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:56.906089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554535280950370:8003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:56.906094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:56.906378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:56.906558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:56.906582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:56.906779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:56.906814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.906818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.906818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.906819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.906819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.906820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.906820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.906821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.906822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.906822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.906823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.906823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.906826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.906833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.906835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.906837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.906839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.906842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.906843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.906845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.906847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.906850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.906851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.906853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.906857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.906862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:56.906865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.906868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:56.906870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.906873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:56.906875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.906878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:56.906881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.906884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:56.906886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.906889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:56.906891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.906894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:56.906896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.906899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:56.906901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.906904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:56.906906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.906909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.906911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.906914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.906916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.906919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.906947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:56.914657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:56.916202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:56.916214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:56.916215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:56.916218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:56.916222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 932 [2:7556554535205424829:6780]
2025-10-02T09:30:56.916229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:56.916240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:56.916242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.916244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.916245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.916255Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:56.916258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:56.916264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:56.916299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.916305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.916306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.916308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:56.916309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:56.916349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:56.916354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.916361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:56.916366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:56.916375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:56.916388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280950202:2446], now have 1 active actors on pipe
2025-10-02T09:30:56.916392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.916393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.916394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.916399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:56.916404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280950459:8003], now have 1 active actors on pipe
2025-10-02T09:30:56.916407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:56.916409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:56.916411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:56.916413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:56.916420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:56.916421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:56.916440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.916445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:56.916454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:56.916468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 932
2025-10-02T09:30:56.916492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 932
2025-10-02T09:30:56.916555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.916563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.916578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:56.916582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:56.916584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:56.916586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:56.916591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:56.916597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:56.916605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.916719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:56.916723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:56.916732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:56.916791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 933 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0
2025-10-02T09:30:56.917077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11ac4bf6-176b3a9b-df3a485c-fa0c0a81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:56.919332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Write session: try to update token
2025-10-02T09:30:56.919347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:56.926116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:56.926131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:56.926133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:56.926134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:56.926141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.926144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.926147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554535205424824:6780]
2025-10-02T09:30:56.926179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:56.926184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:56.926185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:56.926187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:56.926188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:56.926191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:56.926309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:56.930012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId: src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:56.932100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:56.989227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554535280950470:7829]
2025-10-02T09:30:56.989493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 932, pipe: [1:7556554535280950470:7829]
2025-10-02T09:30:57.041719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:57.041917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.041926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.041949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554535280950470:7829], now have 1 active actors on pipe
2025-10-02T09:30:57.042114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:57.042193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554535280950470:7829]
2025-10-02T09:30:57.042228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:57.042237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:57.042284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 933 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0
2025-10-02T09:30:57.042421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 933 sessionId: src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0 is DEAD
2025-10-02T09:30:57.042554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:57.042562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Write session will restart in 0.009829s
2025-10-02T09:30:57.042579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Write session: Do CDS request
2025-10-02T09:30:57.042583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:57.053152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.053222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:57.053234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 934
2025-10-02T09:30:57.053317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.053336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:57.053342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:57.053345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:57.053633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 934 sessionId:  describe result for acl check
2025-10-02T09:30:57.053660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:57.053665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:57.053666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:57.053669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554539575917878:8007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:57.054084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554539575917878:8007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:57.056136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554539575917878:8007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:57.058031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:57.058434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554539575917878:8007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:57.058444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554539575917878:8007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:57.058446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554539575917878:8007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:57.058445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:57.058450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:57.058546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:57.058552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:57.058558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:57.058583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:57.058607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554539500392387:6782]
2025-10-02T09:30:57.058963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:57.059147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:57.059171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:57.059355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:57.059384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.059387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.059388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.059388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.059389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.059389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.059390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.059390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.059391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.059391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.059392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.059393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.059395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.059401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.059403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.059405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.059407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.059409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.059411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.059413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.059414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.059417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.059418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.059420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.059423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.059427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.059431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.059434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.059436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.059439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.059441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.059443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.059445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.059448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.059450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.059452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.059455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.059457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.059459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.059462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.059465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.059467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.059473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.059476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.059478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.059480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.059482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.059485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.059505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:57.067027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:57.068503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:57.068514Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:57.068515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:57.068517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:57.068521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 933 [2:7556554539500392387:6782]
2025-10-02T09:30:57.068528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:57.068539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:57.068541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.068543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.068544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.068554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:57.068557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:57.068566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:57.068598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.068603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.068604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.068607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:57.068609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:57.068649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:57.068654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.068661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.068666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.068674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:57.068690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575918027:8007], now have 1 active actors on pipe
2025-10-02T09:30:57.068695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575917768:2446], now have 1 active actors on pipe
2025-10-02T09:30:57.068699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.068700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.068701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.068708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:57.068716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:57.068721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:57.068723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:57.068725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:57.068727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:57.068728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:57.068745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.068753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:57.068760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:57.068777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 933
2025-10-02T09:30:57.068816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 933
2025-10-02T09:30:57.068833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.068842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.068858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:57.068863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.068865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.068866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:57.068871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.068877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:57.068885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.069021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.069026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.069033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.069096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 934 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0
2025-10-02T09:30:57.069318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3801db-e7a6e5fa-3659288f-c553a63d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:57.071997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Write session: try to update token
2025-10-02T09:30:57.072007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:57.079448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:57.079463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.079465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:57.079466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:57.079471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.079474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.079476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554539500392382:6782]
2025-10-02T09:30:57.079502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:57.079507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.079508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:57.079521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:57.079526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:57.079530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:57.079620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:57.082533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId: src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:57.092964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:57.142313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554539575918041:7829]
2025-10-02T09:30:57.142575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 933, pipe: [1:7556554539575918041:7829]
2025-10-02T09:30:57.196797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:57.197275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.197286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.197298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575918041:7829], now have 1 active actors on pipe
2025-10-02T09:30:57.197483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554539575918041:7829]
2025-10-02T09:30:57.197492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:57.197495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:57.197510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:57.197556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 934 reason: error at write: Disconnected sessionId: src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0
2025-10-02T09:30:57.197710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 934 sessionId: src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0 is DEAD
2025-10-02T09:30:57.197836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:57.197843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Write session will restart in 0.007645s
2025-10-02T09:30:57.197857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Write session: Do CDS request
2025-10-02T09:30:57.197862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:57.197905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:57.206178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.206221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:57.206233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 935
2025-10-02T09:30:57.206365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.206387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:57.206393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:57.206396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:57.206668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 935 sessionId:  describe result for acl check
2025-10-02T09:30:57.206698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:57.206703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:57.206705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:57.206710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554539575918294:8012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:57.207078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554539575918294:8012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:57.208840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554539575918294:8012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:57.210313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:57.211000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:57.211080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554539575918294:8012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:57.211089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554539575918294:8012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:57.211091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554539575918294:8012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:57.211094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:57.211127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:57.211136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:57.211144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:57.211186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:57.211214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554539500392652:6785]
2025-10-02T09:30:57.211762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:57.211989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:57.212027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:57.212307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:57.212350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.212356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.212357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.212358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.212359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.212360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.212361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.212362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.212363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.212364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.212365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.212366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.212370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.212379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.212383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.212387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.212390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.212394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.212397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.212401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.212404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.212412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.212416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.212419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.212424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.212431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.212436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.212442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.212446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.212451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.212456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.212461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.212464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.212469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.212477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.212481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.212488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.212493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.212500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.212505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.212512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.212518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.212526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.212531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.212538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.212543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.212550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.212555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.212592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:57.220097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:57.221936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:57.221951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:57.221952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:57.221955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:57.221960Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 934 [2:7556554539500392652:6785]
2025-10-02T09:30:57.221971Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:57.221983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:57.221990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.221992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.221993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.222005Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:57.222010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:57.222016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:57.222058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.222064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.222065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.222068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:57.222070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:57.222118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:57.222125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.222136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.222147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.222166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:57.222184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575918045:2446], now have 1 active actors on pipe
2025-10-02T09:30:57.222191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575918513:8012], now have 1 active actors on pipe
2025-10-02T09:30:57.222196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.222202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.222204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.222214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:57.222229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:57.222235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:57.222238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:57.222242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:57.222245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:57.222247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:57.222252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 934
2025-10-02T09:30:57.222263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 934
2025-10-02T09:30:57.222267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.222278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:57.222283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:57.222302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.222305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.222326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:57.222335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.222339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.222341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:57.222351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.222362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:57.222372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.222495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.222501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.222509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.222587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 935 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0
2025-10-02T09:30:57.222835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5cdb2d-86a4cb88-db30d7f1-fa53579b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:57.225006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Write session: try to update token
2025-10-02T09:30:57.225016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:57.231714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:57.231729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.231731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:57.231732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:57.231738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.231741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.231745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554539500392647:6785]
2025-10-02T09:30:57.231767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:57.231771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.231772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:57.231788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:57.231797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:57.231801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:57.231897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:57.235624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId: src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:57.237568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:57.297434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554539575918537:7829]
2025-10-02T09:30:57.297579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 934, pipe: [1:7556554539575918537:7829]
2025-10-02T09:30:57.349203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:57.349409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.349419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.349445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575918537:7829], now have 1 active actors on pipe
2025-10-02T09:30:57.349780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:57.349795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:57.349821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554539575918537:7829]
2025-10-02T09:30:57.349832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:57.349895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 935 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0
2025-10-02T09:30:57.350032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 935 sessionId: src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0 is DEAD
2025-10-02T09:30:57.350163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:57.350173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Write session will restart in 0.005516s
2025-10-02T09:30:57.350190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Write session: Do CDS request
2025-10-02T09:30:57.350194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:57.357122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.357189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:57.357200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 936
2025-10-02T09:30:57.357284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.357312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:57.357318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:57.357321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:57.357975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 936 sessionId:  describe result for acl check
2025-10-02T09:30:57.357999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:57.358004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:57.358005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:57.358008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554539575918952:8023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:57.358366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554539575918952:8023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:57.359400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:57.359898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554539575918952:8023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:57.360069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:57.360169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:57.360176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:57.360181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:57.360207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:57.360230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554539500392951:6799]
2025-10-02T09:30:57.360590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:57.360787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:57.360821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:57.360993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:57.361023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.361027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.361028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.361028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.361029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.361029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.361030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.361030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.361031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.361032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.361032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.361033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.361035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.361041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.361044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.361046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.361048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.361050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.361052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.361054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.361056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.361058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.361060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.361062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.361065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.361069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.361072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.361075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.361078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.361080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.361082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.361085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.361087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.361090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.361092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.361094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.361097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.361100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.361102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.361104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.361106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.361110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.361113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.361117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.361120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.361129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.361132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.361136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.361160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:57.365277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554539575918952:8023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:57.365288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554539575918952:8023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:57.365290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554539575918952:8023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:57.365294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:57.368578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:57.369971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:57.369983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:57.369984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:57.369987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:57.369991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 935 [2:7556554539500392951:6799]
2025-10-02T09:30:57.369999Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:57.370010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:57.370012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.370014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.370015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.370024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:57.370031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:57.370036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:57.370066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.370071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.370072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.370074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:57.370075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:57.370114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:57.370119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.370126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.370131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.370142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:57.370154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.370159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.370160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.370165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:57.370174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575918548:2446], now have 1 active actors on pipe
2025-10-02T09:30:57.370174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:57.370177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:57.370179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:57.370180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:57.370187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:57.370188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:57.370191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919019:8023], now have 1 active actors on pipe
2025-10-02T09:30:57.370206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.370214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:57.370225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:57.370243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 935
2025-10-02T09:30:57.370245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 935
2025-10-02T09:30:57.370311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.370317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.370332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:57.370337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.370339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.370341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:57.370346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.370351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:57.370360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.370485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.370491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.370500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.370566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 936 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0
2025-10-02T09:30:57.370830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4dbb401-f82b298-459a2aeb-5b52ef62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:57.373251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Write session: try to update token
2025-10-02T09:30:57.373265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:57.380632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:57.380645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.380646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:57.380647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:57.380652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.380656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.380658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554539500392946:6799]
2025-10-02T09:30:57.380682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:57.380685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.380686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:57.380688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:57.380693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:57.380696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:57.380791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:57.385755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId: src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:57.387740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:57.450027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554539575919026:7829]
2025-10-02T09:30:57.450239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 935, pipe: [1:7556554539575919026:7829]
2025-10-02T09:30:57.505294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:57.505533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.505543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.505571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919026:7829], now have 1 active actors on pipe
2025-10-02T09:30:57.505764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:57.505766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:57.505776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:57.505779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:57.505817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554539575919026:7829]
2025-10-02T09:30:57.505837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 936 reason: error at write: Disconnected sessionId: src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0
2025-10-02T09:30:57.505993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 936 sessionId: src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0 is DEAD
2025-10-02T09:30:57.506116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:57.506124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Write session will restart in 0.009508s
2025-10-02T09:30:57.506139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Write session: Do CDS request
2025-10-02T09:30:57.506143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:57.516203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.516282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:57.516295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 937
2025-10-02T09:30:57.516388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.516409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:57.516415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:57.516418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:57.516693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 937 sessionId:  describe result for acl check
2025-10-02T09:30:57.516721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:57.516726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:57.516727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:57.516731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554539575919449:8027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:57.517220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554539575919449:8027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:57.518568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:57.518704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554539575919449:8027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:57.519321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:57.519467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:57.519477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:57.519486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:57.519531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:57.519568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554539500393217:6801]
2025-10-02T09:30:57.520092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:57.520364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:57.520409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:57.520634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554539575919449:8027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:57.520647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554539575919449:8027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:57.520650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554539575919449:8027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:57.520655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:57.520683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:57.520748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.520754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.520755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.520756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.520757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.520758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.520759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.520760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.520761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.520762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.520763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.520763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.520768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.520777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.520780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.520784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.520787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.520790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.520793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.520796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.520816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.520821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.520824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.520827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.520834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.520841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.520850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.520859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.520866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.520878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.520883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.520890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.520899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.520906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.520914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.520922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.520926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.520934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.520939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.520945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.520948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.520954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.520957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.520959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.520965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.520968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.520970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.520988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:57.529313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:57.531277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:57.531290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:57.531292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:57.531295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:57.531299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 936 [2:7556554539500393217:6801]
2025-10-02T09:30:57.531308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:57.531320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:57.531323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.531325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.531327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.531338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:57.531342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:57.531347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:57.531387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.531389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.531389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.531391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:57.531393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:57.531438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:57.531440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.531447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.531454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.531463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:57.531474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.531475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.531476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.531482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:57.531491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:57.531493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:57.531495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:57.531496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:57.531501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:57.531502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:57.531510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919498:8027], now have 1 active actors on pipe
2025-10-02T09:30:57.531512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919027:2446], now have 1 active actors on pipe
2025-10-02T09:30:57.531530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.531536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:57.531558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:57.531594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 936
2025-10-02T09:30:57.531594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 936
2025-10-02T09:30:57.531674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.531681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.531700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:57.531704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.531706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.531708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:57.531713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.531724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:57.531734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.531876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.531886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.531908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.531985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 937 partition: 0 MaxSeqNo: 36 sessionId: src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0
2025-10-02T09:30:57.532323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cea9d7-dae5c5bf-52cccc82-e2bec172_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:57.534892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Write session: try to update token
2025-10-02T09:30:57.534906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:57.546496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:57.546517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.546530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.546567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:57.546583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:57.546719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:57.546842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:57.546996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:57.547125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:57.547179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId: src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:57.547296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:57.547341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:57.549503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:57.549658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.549670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.549698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:57.549774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:57.551370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:57.551380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.551382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:57.551384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:57.551390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.551394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.551398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554539500393212:6801]
2025-10-02T09:30:57.551427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:57.551436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.551438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:57.551440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:57.551445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:57.551448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:57.551554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:57.606187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554539575919507:7829]
2025-10-02T09:30:57.606410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 936, pipe: [1:7556554539575919507:7829]
2025-10-02T09:30:57.674606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:57.681866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.681886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.682029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.682097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.682162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.682222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.682603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.682617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.682681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.682736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.682793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.682846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.682883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.682890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.682955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.683006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.683060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.683115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.683153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.683160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.683215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.683273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.683327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.683382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.683424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.683431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.683488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.683541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.683595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.683649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.683688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.683694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.683751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.683805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.683859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.683915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.683952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.683959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.684012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.684100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.684159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.684213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.684266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.684273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.684342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.684393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.684444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.684497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.684535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.684542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.684595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.684646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.684696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.684755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.684831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.684838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.684896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:57.684946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:57.684995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:57.685049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:57.685100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:57.685106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:57.685153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919507:7829], now have 1 active actors on pipe
2025-10-02T09:30:57.685320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554539575919507:7829]
2025-10-02T09:30:57.685332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:57.685350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:57.685352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:57.685370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 937 reason: error at write: Disconnected sessionId: src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0
2025-10-02T09:30:57.685511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 937 sessionId: src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0 is DEAD
2025-10-02T09:30:57.685655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:57.685664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Write session will restart in 0.006733s
2025-10-02T09:30:57.685680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Write session: Do CDS request
2025-10-02T09:30:57.685684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:57.685724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:57.693082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.693162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:57.693175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 938
2025-10-02T09:30:57.693254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.693275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:57.693280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:57.693283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:57.693558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 938 sessionId:  describe result for acl check
2025-10-02T09:30:57.693582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:57.693587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:57.693588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:57.693591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554539575919814:8032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:57.693931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554539575919814:8032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:57.695895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554539575919814:8032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:57.697005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:57.697499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:57.697612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:57.697617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:57.697623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:57.697652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:57.697675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554539500393495:6804]
2025-10-02T09:30:57.697851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554539575919814:8032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:57.697862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554539575919814:8032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:57.697865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554539575919814:8032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:57.697870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:57.698027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:57.698306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:57.698342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:57.698548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:57.698581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.698585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.698585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.698586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.698586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.698587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.698587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.698588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.698588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.698589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.698589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.698590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.698593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.698601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.698605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.698608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.698612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.698615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.698618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.698622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.698626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.698628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.698630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.698632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.698636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.698639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.698642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.698645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.698647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.698650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.698652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.698655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.698657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.698660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.698662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.698665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.698667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.698670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.698672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.698675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.698677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.698679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.698683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.698685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.698687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.698690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.698692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.698695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.698711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:57.707621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:57.709374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:57.709388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:57.709390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:57.709394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:57.709400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 937 [2:7556554539500393495:6804]
2025-10-02T09:30:57.709411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:57.709425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:57.709428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.709431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.709433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.709446Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:57.709451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:57.709468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:57.709518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.709525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.709527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.709531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:57.709533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:57.709590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:57.709597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.709609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.709624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.709644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:57.709665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919991:8032], now have 1 active actors on pipe
2025-10-02T09:30:57.709675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575919522:2446], now have 1 active actors on pipe
2025-10-02T09:30:57.709680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.709682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.709684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.709695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:57.709706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:57.709707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:57.709712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:57.709714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:57.709722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:57.709725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:57.709709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 937
2025-10-02T09:30:57.709750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.709742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 937
2025-10-02T09:30:57.709753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:57.709754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:57.709766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.709770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.709810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:57.709822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.709826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.709829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:57.709837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.709845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:57.709864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.710020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.710028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.710040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.710122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 938 partition: 0 MaxSeqNo: 36 sessionId: src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0
2025-10-02T09:30:57.710427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93b6205-68c14055-e6ba3bc5-72b37f49_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:57.712873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Write session: try to update token
2025-10-02T09:30:57.712889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:57.720885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:57.720903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.720906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:57.720908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:57.720917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.720921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.720925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554539500393489:6804]
2025-10-02T09:30:57.720962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:57.720961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:57.720966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:57.720968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:57.721294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.721305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:57.721443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:57.727591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId: src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:57.729682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:57.785379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554539575920009:7829]
2025-10-02T09:30:57.785574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 937, pipe: [1:7556554539575920009:7829]
2025-10-02T09:30:57.857384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:57.857604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.857612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.857625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575920009:7829], now have 1 active actors on pipe
2025-10-02T09:30:57.857839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554539575920009:7829]
2025-10-02T09:30:57.857847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:57.857851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:57.857846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:57.857866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:57.857904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 938 reason: error at write: Disconnected sessionId: src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0
2025-10-02T09:30:57.858067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 938 sessionId: src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0 is DEAD
2025-10-02T09:30:57.858176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:57.858181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Write session will restart in 0.006836s
2025-10-02T09:30:57.858198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Write session: Do CDS request
2025-10-02T09:30:57.858202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:57.866191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.866283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:57.866294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 939
2025-10-02T09:30:57.866397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:57.866424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:57.866430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:57.866433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:57.866786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 939 sessionId:  describe result for acl check
2025-10-02T09:30:57.866818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:57.866819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:57.866821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:57.866825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554539575920225:8037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:57.867290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554539575920225:8037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:57.869015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554539575920225:8037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:57.871082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:57.871243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554539575920225:8037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:57.871257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554539575920225:8037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:57.871260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554539575920225:8037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:57.871266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:57.871793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:57.871899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:57.871906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:57.871912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:57.871941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:57.871964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554539500393763:6806]
2025-10-02T09:30:57.872311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:57.872490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:57.872512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:57.872690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:57.872722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.872724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.872725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.872725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.872726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.872726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.872727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.872728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.872728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.872729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.872729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.872730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.872733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.872739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.872741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.872743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.872745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.872747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.872750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.872752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.872754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.872756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.872758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.872760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.872764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.872767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:57.872771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.872773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:57.872776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.872779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:57.872781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.872784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:57.872786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.872789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:57.872791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.872794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:57.872797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.872814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:57.872818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.872822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:57.872826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.872830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:57.872835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.872840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.872843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.872845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.872847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.872850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.872866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:57.880511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:57.882026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:57.882038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:57.882039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:57.882041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:57.882045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 938 [2:7556554539500393763:6806]
2025-10-02T09:30:57.882053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:57.882063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:57.882064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.882066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.882068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.882077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:57.882084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:57.882088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:57.882118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.882123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.882124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.882126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:57.882128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:57.882175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:57.882182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.882192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:57.882203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:57.882221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:57.882239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575920014:2446], now have 1 active actors on pipe
2025-10-02T09:30:57.882242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575920485:8037], now have 1 active actors on pipe
2025-10-02T09:30:57.882246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.882249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.882250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.882258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:57.882271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:57.882272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:57.882278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:57.882280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:57.882284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:57.882286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:57.882275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 938
2025-10-02T09:30:57.882284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 938
2025-10-02T09:30:57.882304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.882310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:57.882311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:57.882323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.882326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.882361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:57.882370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:57.882376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:57.882378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:57.882386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:57.882397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:57.882413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.882517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:57.882524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:57.882535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:57.882597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 939 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0
2025-10-02T09:30:57.882849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a49dfe6-2dec1096-4b768ff8-779be3a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:57.885071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Write session: try to update token
2025-10-02T09:30:57.885083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:57.892315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:57.892330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:57.892331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:57.892332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:57.892337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.892340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.892342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554539500393757:6806]
2025-10-02T09:30:57.892372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:57.892377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:57.892379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:57.892382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:57.892386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:57.892389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:57.892498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:57.896252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId: src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:57.898414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:57.957934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554539575920496:7829]
2025-10-02T09:30:57.958150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 938, pipe: [1:7556554539575920496:7829]
2025-10-02T09:30:58.018035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.018255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.018264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.018291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554539575920496:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.018505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.018506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.018529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:58.018534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:58.018560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554539575920496:7829]
2025-10-02T09:30:58.018658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 939 reason: error at write: Disconnected sessionId: src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0
2025-10-02T09:30:58.018793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 939 sessionId: src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0 is DEAD
2025-10-02T09:30:58.018920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:58.018928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Write session will restart in 0.006347s
2025-10-02T09:30:58.018950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Write session: Do CDS request
2025-10-02T09:30:58.018955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.026191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.026286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.026302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 940
2025-10-02T09:30:58.026398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.026421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.026427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.026431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.026752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 940 sessionId:  describe result for acl check
2025-10-02T09:30:58.026780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.026786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.026787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.026791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870888042:8041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.027214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870888042:8041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.028624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870888042:8041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.030556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870888042:8041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.030571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870888042:8041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.030574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870888042:8041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.030581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.030650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.031335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.031449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.031456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.031462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.031490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.031513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795361329:6809]
2025-10-02T09:30:58.031868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.032080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.032108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.032298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.032330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.032334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.032335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.032335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.032336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.032337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.032337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.032338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.032338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.032339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.032339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.032340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.032343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.032349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.032351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.032353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.032355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.032357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.032359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.032361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.032363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.032365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.032367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.032369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.032373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.032378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.032381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.032383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.032386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.032389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.032391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.032394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.032396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.032399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.032401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.032403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.032406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.032408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.032410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.032413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.032415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.032418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.032420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.032422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.032425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.032427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.032430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.032432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.032450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.041011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.042825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.042840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.042842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.042844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.042849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 939 [2:7556554543795361329:6809]
2025-10-02T09:30:58.042859Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.042872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.042878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.042880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.042881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.042892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.042897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.042904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.042958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.042963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.042964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.042967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.042968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.043025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.043032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.043042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.043053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.043071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.043091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870888264:8041], now have 1 active actors on pipe
2025-10-02T09:30:58.043098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870887794:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.043102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.043103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.043105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.043113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.043127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.043129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.043134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.043137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.043142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.043144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.043172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.043183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.043188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.043173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 939
2025-10-02T09:30:58.043177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 939
2025-10-02T09:30:58.043213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.043221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.043245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.043256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.043264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.043265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.043272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.043283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.043300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.043420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.043427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.043439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.043499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 940 partition: 0 MaxSeqNo: 36 sessionId: src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0
2025-10-02T09:30:58.043775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f4c201-dedeb46-8b754dd3-f3bfc06f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.046021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Write session: try to update token
2025-10-02T09:30:58.046035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.053390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.053405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.053407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.053408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.053413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.053415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.053418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795361323:6809]
2025-10-02T09:30:58.053445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.053451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.053453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.053459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.053463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.053466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.053568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.056594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId: src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.058571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:58.118683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554543870888276:7829]
2025-10-02T09:30:58.118913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 939, pipe: [1:7556554543870888276:7829]
2025-10-02T09:30:58.170673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.171104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.171118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.171148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870888276:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.171653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554543870888276:7829]
2025-10-02T09:30:58.171666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.171675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.171675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:58.171679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:58.171730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 940 reason: error at write: Disconnected sessionId: src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0
2025-10-02T09:30:58.171871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 940 sessionId: src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0 is DEAD
2025-10-02T09:30:58.171986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:58.171995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Write session will restart in 0.008243s
2025-10-02T09:30:58.172020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Write session: Do CDS request
2025-10-02T09:30:58.172025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.181257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.181306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.181317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 941
2025-10-02T09:30:58.181443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.181469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.181478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.181481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.181776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 941 sessionId:  describe result for acl check
2025-10-02T09:30:58.181801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.181805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.181806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.181809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870888679:8046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.182174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870888679:8046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.183583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870888679:8046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.183626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.184213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.184337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.184345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.184350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.184379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.184402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795361599:6811]
2025-10-02T09:30:58.184745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.184952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.184978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.185161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.185189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.185193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.185193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.185194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.185194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.185195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.185195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.185196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.185196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.185197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.185198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.185198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.185201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.185206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.185209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.185211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.185212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.185215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.185216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.185218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.185220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.185222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.185224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.185226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.185230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.185234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.185237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.185240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.185242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.185245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.185247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.185250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.185253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.185256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.185258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.185261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.185263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.185265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.185267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.185270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.185272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.185274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.185277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.185279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.185281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.185284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.185286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.185289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.185306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.185596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870888679:8046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.185606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870888679:8046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.185608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870888679:8046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.185615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.192750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.194421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.194431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.194432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.194434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.194438Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 940 [2:7556554543795361599:6811]
2025-10-02T09:30:58.194445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.194456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.194463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.194464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.194466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.194475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.194479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.194483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.194519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.194524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.194525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.194527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.194528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.194580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.194587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.194597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.194617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.194634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.194654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870888756:8046], now have 1 active actors on pipe
2025-10-02T09:30:58.194659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870888277:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.194664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.194665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.194667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.194677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.194667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 940
2025-10-02T09:30:58.194688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.194678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 940
2025-10-02T09:30:58.194697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.194700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.194702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.194705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.194707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.194733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.194740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.194750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.194759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.194776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.194783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.194789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.194796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.194798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.194806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.194817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.194838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.194964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.194971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.194982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.195040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 941 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0
2025-10-02T09:30:58.195306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f401d468-6d7f6997-c5f8ac02-89f1f9df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.197560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Write session: try to update token
2025-10-02T09:30:58.197572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.204697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.204712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.204714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.204716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.204720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.204723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.204726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795361594:6811]
2025-10-02T09:30:58.204754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.204763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.204765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.204773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.204778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.204781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.204903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.208178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId: src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.210140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:58.271781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554543870888763:7829]
2025-10-02T09:30:58.272082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 940, pipe: [1:7556554543870888763:7829]
2025-10-02T09:30:58.324243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.324582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.324592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.324618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870888763:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.324849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.324868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.324886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:58.324889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:58.324933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 941 reason: error at write: Disconnected sessionId: src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0
2025-10-02T09:30:58.325071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 941 sessionId: src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0 is DEAD
2025-10-02T09:30:58.325195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554543870888763:7829]
2025-10-02T09:30:58.325248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:58.325259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Write session will restart in 0.008386s
2025-10-02T09:30:58.325278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Write session: Do CDS request
2025-10-02T09:30:58.325284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.335189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.335274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.335287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 942
2025-10-02T09:30:58.335351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.335369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.335375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.335377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.335446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.335613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 942 sessionId:  describe result for acl check
2025-10-02T09:30:58.335632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.335636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.335637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.335641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870889218:8056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.336086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870889218:8056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.336138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.336246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.336252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.336259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.336288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.336310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795361897:6824]
2025-10-02T09:30:58.336675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.336880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.336913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.337101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.337130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.337134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.337134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.337135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.337135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.337136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.337136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.337136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.337137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.337137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.337138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.337139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.337142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.337147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.337149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.337151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.337153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.337155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.337157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.337159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.337161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.337163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.337165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.337167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.337170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.337174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.337177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.337180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.337183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.337186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.337188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.337191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.337193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.337195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.337197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.337200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.337202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.337204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.337207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.337209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.337211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.337214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.337216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.337218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.337220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.337222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.337224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.337227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.337244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.337537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870889218:8056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.342170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870889218:8056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.342180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870889218:8056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.342181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870889218:8056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.342185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.344701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.346209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.346221Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.346222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.346224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.346227Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 941 [2:7556554543795361897:6824]
2025-10-02T09:30:58.346234Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.346245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.346246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.346248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.346249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.346258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.346264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.346268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.346298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.346303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.346304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.346307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.346308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.346354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.346361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.346371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.346384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.346402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.346420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870889263:8056], now have 1 active actors on pipe
2025-10-02T09:30:58.346426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870888777:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.346431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.346433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.346434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.346442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.346455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.346456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.346458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.346460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.346466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.346474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.346494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.346503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.346493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 941
2025-10-02T09:30:58.346495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 941
2025-10-02T09:30:58.346521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.346528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.346531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.346552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40058f09-9e8824f-755ea6cd-ed834547_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.346563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.346569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.346570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.346578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.346588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.346601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.346710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.346716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.346724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.346791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 942 partition: 0 MaxSeqNo: 36 sessionId: src_id|40058f09-9e8824f-755ea6cd-ed834547_0
2025-10-02T09:30:58.347062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd12ba2-7a71be76-90b3ba42-f5fb3d64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40058f09-9e8824f-755ea6cd-ed834547_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.349329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Write session: try to update token
2025-10-02T09:30:58.349342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.355981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.355996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.355997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.355998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.356003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.356009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.356012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795361892:6824]
2025-10-02T09:30:58.356035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.356039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.356041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.356043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.356047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.356049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.356161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.360329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId: src_id|40058f09-9e8824f-755ea6cd-ed834547_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.362314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:58.425392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554543870889271:7829]
2025-10-02T09:30:58.425598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 941, pipe: [1:7556554543870889271:7829]
2025-10-02T09:30:58.476797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.477104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.477113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.477141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870889271:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.477290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.477365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554543870889271:7829]
2025-10-02T09:30:58.477372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:58.477391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.477427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 942 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40058f09-9e8824f-755ea6cd-ed834547_0
2025-10-02T09:30:58.477563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 942 sessionId: src_id|40058f09-9e8824f-755ea6cd-ed834547_0 is DEAD
2025-10-02T09:30:58.477680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:58.477687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Write session will restart in 0.009958s
2025-10-02T09:30:58.477703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Write session: Do CDS request
2025-10-02T09:30:58.477708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.487583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.488139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.488223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.488290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.488306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 943
2025-10-02T09:30:58.488337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.488344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.488350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.488379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.488386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.488403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795362175:6828]
2025-10-02T09:30:58.488405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.488411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.488414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.488687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 943 sessionId:  describe result for acl check
2025-10-02T09:30:58.488713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.488714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.488715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.488718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870889711:8061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.488771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.488982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.489007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.489112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870889711:8061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.489193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.489223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.489227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.489228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.489228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.489229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.489229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.489230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.489230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.489231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.489231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.489232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.489233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.489235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.489242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.489244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.489246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.489248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.489250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.489252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.489254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.489256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.489258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.489260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.489262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.489265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.489269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.489273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.489275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.489279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.489282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.489284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.489286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.489288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.489291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.489293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.489296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.489298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.489301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.489303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.489306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.489308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.489311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.489313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.489316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.489318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.489322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.489326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.489330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.489361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.490924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870889711:8061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.494736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870889711:8061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.494745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870889711:8061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.494748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870889711:8061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.494752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.496974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.498378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.498390Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.498391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.498394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.498397Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 942 [2:7556554543795362175:6828]
2025-10-02T09:30:58.498404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.498415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.498420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.498421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.498422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.498431Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.498437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.498441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.498475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.498481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.498482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.498484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.498485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.498605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 942
2025-10-02T09:30:58.498606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 942
2025-10-02T09:30:58.498742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.498752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.498763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.498774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.498784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.498800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870889272:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.498806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870889750:8061], now have 1 active actors on pipe
2025-10-02T09:30:58.498817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.498822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.498832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.498837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.498838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.498846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.498858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.498860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.498862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.498864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.498870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.498872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.498881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.498888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.498890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.498891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.498897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.498906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.498925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.498943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.498949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.498951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.499041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.499046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.499055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.499108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 943 partition: 0 MaxSeqNo: 36 sessionId: src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0
2025-10-02T09:30:58.499310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40058f09-9e8824f-755ea6cd-ed834547_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.501648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Write session: try to update token
2025-10-02T09:30:58.501659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.508206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:58.508223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.508228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.508255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:58.508255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:58.508399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:58.508521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:58.508638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:58.508768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:58.508950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:58.508983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:58.512561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId: src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.514570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:58.514720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.514732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.514750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:58.514823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:58.516690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.516701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.516703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.516704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.516711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.516714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.516718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795362170:6828]
2025-10-02T09:30:58.516747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.516747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.516754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.516755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.516757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.516760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.516884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.577448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554543870889758:7829]
2025-10-02T09:30:58.577619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 942, pipe: [1:7556554543870889758:7829]
2025-10-02T09:30:58.638293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.644451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.644474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.644603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.644655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.644712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.644778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.644827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.644834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.644889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.644942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.644999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.645057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.645094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.645099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.645151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.645204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.645266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.645319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.645355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.645360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.645415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.645471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.645528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.645630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.645668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.645676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.645730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.645792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.645845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.645896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.645934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.645939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.645993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.646053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.646108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.646165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.646200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.646205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.646260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.646314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.646368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.646423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.646457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.646462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.646516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.646570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.646620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.646681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.646718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.646722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.646777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.646833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.646884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.646944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.646980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.646984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.647036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:58.647090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:58.647141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:58.647196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:58.647230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:58.647235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:58.647266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870889758:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.647492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.647534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:58.647537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:58.647544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554543870889758:7829]
2025-10-02T09:30:58.647560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 943 reason: error at write: Disconnected sessionId: src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0
2025-10-02T09:30:58.647739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 943 sessionId: src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0 is DEAD
2025-10-02T09:30:58.647854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:58.647864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Write session will restart in 0.006614s
2025-10-02T09:30:58.647883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Write session: Do CDS request
2025-10-02T09:30:58.647888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.647889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.655156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.655222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.655234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 944
2025-10-02T09:30:58.655329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.655351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.655357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.655360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.655677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 944 sessionId:  describe result for acl check
2025-10-02T09:30:58.655707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.655713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.655715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.655719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870889968:8065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.656159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870889968:8065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.658244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870889968:8065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.660005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.660637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.660734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.660740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.660746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.660772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.660797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795362460:6831]
2025-10-02T09:30:58.660857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870889968:8065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.660866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870889968:8065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.660868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870889968:8065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.660872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.661156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.661309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.661332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.661512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.661541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.661545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.661546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.661546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.661547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.661547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.661548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.661549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.661549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.661550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.661551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.661551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.661554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.661561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.661563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.661565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.661567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.661569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.661571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.661573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.661575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.661577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.661580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.661582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.661586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.661589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.661593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.661595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.661598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.661600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.661602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.661605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.661607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.661610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.661612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.661615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.661617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.661620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.661622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.661625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.661627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.661631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.661633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.661635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.661638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.661644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.661646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.661649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.661665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.669079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.670537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.670549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.670550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.670552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.670555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 943 [2:7556554543795362460:6831]
2025-10-02T09:30:58.670564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.670575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.670576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.670577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.670579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.670589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.670595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.670600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.670635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.670639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.670640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.670643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.670644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.670692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.670698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.670709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.670722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.670739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.670756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870889759:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.670763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870890234:8065], now have 1 active actors on pipe
2025-10-02T09:30:58.670768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.670773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.670775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.670777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 943
2025-10-02T09:30:58.670789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.670804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.670806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.670809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.670810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.670821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.670813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 943
2025-10-02T09:30:58.670827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.670856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.670862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.670869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.670877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.670892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.670903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.670912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.670919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.670920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.670927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.670942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.670958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.671047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.671054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.671065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.671135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 944 partition: 0 MaxSeqNo: 36 sessionId: src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0
2025-10-02T09:30:58.671384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|540fc4a-cbea0396-cd767e19-c7a9c708_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.673688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Write session: try to update token
2025-10-02T09:30:58.673699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.680817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.680833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.680835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.680836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.680843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.680846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.680851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795362455:6831]
2025-10-02T09:30:58.680883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.680889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.680897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.680899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.680904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.680908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.681027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.684974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId: src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.687192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:58.716186Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:30:58.747430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554543870890259:7829]
2025-10-02T09:30:58.747640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 943, pipe: [1:7556554543870890259:7829]
2025-10-02T09:30:58.800477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.800689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.800697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.800725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870890259:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.800882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.800903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554543870890259:7829]
2025-10-02T09:30:58.800919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:58.800921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:58.800930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.800968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 944 reason: error at write: Disconnected sessionId: src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0
2025-10-02T09:30:58.801103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 944 sessionId: src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0 is DEAD
2025-10-02T09:30:58.801215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:58.801223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Write session will restart in 0.007210s
2025-10-02T09:30:58.801237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Write session: Do CDS request
2025-10-02T09:30:58.801241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.809108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.809283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.809294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 945
2025-10-02T09:30:58.809394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.809419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.809427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.809431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.809775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 945 sessionId:  describe result for acl check
2025-10-02T09:30:58.809800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.809807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.809808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.809813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870890594:8071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.810252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870890594:8071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.812081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870890594:8071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.812682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.813359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.813462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.813469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.813475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.813501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.813524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795362733:6833]
2025-10-02T09:30:58.813808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870890594:8071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.813816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870890594:8071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.813818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870890594:8071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.813823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.813858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.814043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.814073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.814255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.814285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.814289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.814290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.814290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.814291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.814292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.814292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.814293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.814293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.814294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.814294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.814295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.814298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.814304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.814306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.814308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.814310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.814312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.814314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.814316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.814318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.814320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.814322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.814324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.814328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.814332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.814335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.814338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.814340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.814343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.814345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.814348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.814350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.814356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.814358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.814361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.814366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.814369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.814371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.814374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.814379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.814382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.814385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.814387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.814389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.814393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.814398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.814400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.814418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.821942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.823355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.823369Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.823371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.823373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.823376Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 944 [2:7556554543795362733:6833]
2025-10-02T09:30:58.823385Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.823398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.823402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.823404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.823406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.823416Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.823419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.823427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.823460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.823465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.823467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.823468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.823470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.823525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.823532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.823541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.823553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.823570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.823593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870890265:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.823602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870890741:8071], now have 1 active actors on pipe
2025-10-02T09:30:58.823605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.823607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.823608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.823617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.823629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.823627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 944
2025-10-02T09:30:58.823634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.823645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 944
2025-10-02T09:30:58.823641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.823643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.823644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.823645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.823664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.823666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.823669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.823678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.823681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.823717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76407460-930beb27-89816598-12ea7d30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.823728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.823732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.823734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.823742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.823753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.823770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.823881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.823888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.823901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.823953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 945 partition: 0 MaxSeqNo: 36 sessionId: src_id|76407460-930beb27-89816598-12ea7d30_0
2025-10-02T09:30:58.824240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f40331-338dcdb0-f5b4aed3-bafa3ee0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76407460-930beb27-89816598-12ea7d30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.826552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Write session: try to update token
2025-10-02T09:30:58.826563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.833519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.833540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.833543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.833545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.833552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.833555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.833559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795362728:6833]
2025-10-02T09:30:58.833589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.833591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.833597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.833598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.833600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.833601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.833767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.838143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId: src_id|76407460-930beb27-89816598-12ea7d30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.840243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:58.901023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554543870890756:7829]
2025-10-02T09:30:58.901215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 944, pipe: [1:7556554543870890756:7829]
2025-10-02T09:30:58.955560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:58.956183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.956195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.956220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870890756:7829], now have 1 active actors on pipe
2025-10-02T09:30:58.956370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:58.956394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:58.956406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:58.956419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554543870890756:7829]
2025-10-02T09:30:58.956436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:58.956458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 945 reason: error at write: Disconnected sessionId: src_id|76407460-930beb27-89816598-12ea7d30_0
2025-10-02T09:30:58.956566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 945 sessionId: src_id|76407460-930beb27-89816598-12ea7d30_0 is DEAD
2025-10-02T09:30:58.956704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:58.956713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Write session will restart in 0.006665s
2025-10-02T09:30:58.956737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Write session: Do CDS request
2025-10-02T09:30:58.956742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:58.964130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.964219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:58.964229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 946
2025-10-02T09:30:58.964317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:58.964345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:58.964348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:58.964354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:58.964669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 946 sessionId:  describe result for acl check
2025-10-02T09:30:58.964701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:58.964707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:58.964708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:58.964713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554543870891112:8075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:58.965195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554543870891112:8075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:58.966584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554543870891112:8075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:58.966761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:58.967384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:58.967478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:58.967484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:58.967489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:58.967515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:58.967539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554543795363008:6836]
2025-10-02T09:30:58.967895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:58.968081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:58.968109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:58.968292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:58.968320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.968324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.968325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.968325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.968326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.968326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.968327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.968327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.968328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.968328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.968329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.968329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.968332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.968337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.968339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.968342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.968343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.968345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.968347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.968349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.968351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.968353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.968355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.968357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.968361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.968364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:58.968368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.968371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:58.968373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.968375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:58.968378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.968380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:58.968383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.968386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:58.968388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.968391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:58.968420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554543870891112:8075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:58.968393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.968428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554543870891112:8075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:58.968396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:58.968398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.968430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554543870891112:8075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:58.968401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:58.968433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:58.968403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.968406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:58.968407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.968410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.968412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.968415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.968417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.968420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.968436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:58.975864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:58.977288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:58.977299Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:58.977301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:58.977303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:58.977306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 945 [2:7556554543795363008:6836]
2025-10-02T09:30:58.977313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:58.977323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:58.977328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.977330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.977331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.977340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:58.977346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:58.977350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:58.977382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.977387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.977388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.977390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:58.977391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:58.977429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:58.977434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.977440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:58.977446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:58.977457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:58.977471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870891235:8075], now have 1 active actors on pipe
2025-10-02T09:30:58.977476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554543870890760:2446], now have 1 active actors on pipe
2025-10-02T09:30:58.977480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.977481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.977482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.977489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:58.977501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:58.977502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:58.977508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:58.977509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:58.977509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:58.977510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:58.977507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 945
2025-10-02T09:30:58.977526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.977531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:58.977532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:58.977529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 945
2025-10-02T09:30:58.977548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.977553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.977573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:58.977579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:58.977582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:58.977583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:58.977587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:58.977594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:58.977609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.977704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:58.977709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:58.977717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:58.977766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 946 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0
2025-10-02T09:30:58.977970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76407460-930beb27-89816598-12ea7d30_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:58.980217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Write session: try to update token
2025-10-02T09:30:58.980228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:58.986727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:58.986742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:58.986743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:58.986744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:58.986749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.986751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.986754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554543795363003:6836]
2025-10-02T09:30:58.986776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:58.986779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:58.986781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:58.986784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:58.986785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:58.986787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:58.986897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:58.991040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId: src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:58.992947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.056673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554548165858542:7829]
2025-10-02T09:30:59.056897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 945, pipe: [1:7556554548165858542:7829]
2025-10-02T09:30:59.104896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:59.105569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.105583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.105612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165858542:7829], now have 1 active actors on pipe
2025-10-02T09:30:59.105791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:59.105799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554548165858542:7829]
2025-10-02T09:30:59.105824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:59.105828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:59.105831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:59.105875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 946 reason: error at write: Disconnected sessionId: src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0
2025-10-02T09:30:59.106036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 946 sessionId: src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0 is DEAD
2025-10-02T09:30:59.106135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:59.106141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Write session will restart in 0.009868s
2025-10-02T09:30:59.106155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Write session: Do CDS request
2025-10-02T09:30:59.106160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:59.116569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:59.117063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.117154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:59.117164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 947
2025-10-02T09:30:59.117255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.117276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:59.117282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:59.117285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:59.117350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:59.117473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:59.117481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:59.117488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:59.117518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:59.117542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554548090330579:6838]
2025-10-02T09:30:59.117553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 947 sessionId:  describe result for acl check
2025-10-02T09:30:59.117578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:59.117582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:59.117583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:59.117587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554548165858987:8079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:59.117916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:59.117926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554548165858987:8079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:59.118090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:59.118115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:59.118291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:59.118323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.118327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.118327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.118328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.118328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.118329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.118329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.118330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.118330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.118331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.118332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.118332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.118335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.118341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.118343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.118345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.118347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.118349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.118351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.118352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.118354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.118356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.118358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.118360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.118364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.118368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.118371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.118373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.118376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.118378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.118380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.118383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.118385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.118388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.118390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.118392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.118395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.118398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.118400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.118403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.118405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.118408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.118411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.118415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.118417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.118420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.118422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.118424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.118445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:59.119516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554548165858987:8079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:59.123824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554548165858987:8079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:59.123834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554548165858987:8079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:59.123836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554548165858987:8079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:59.123841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:59.125980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:59.127472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:59.127485Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:59.127486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:59.127488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:59.127492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 946 [2:7556554548090330579:6838]
2025-10-02T09:30:59.127500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:59.127511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:59.127512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.127514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.127515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.127524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:59.127530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:59.127535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:59.127567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.127572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.127573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.127575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:59.127577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:59.127615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:59.127620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.127627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.127636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.127648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:59.127662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.127664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.127665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.127669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:59.127678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165859026:8079], now have 1 active actors on pipe
2025-10-02T09:30:59.127679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:59.127681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:59.127682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:59.127684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:59.127691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:59.127692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:59.127696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165858543:2446], now have 1 active actors on pipe
2025-10-02T09:30:59.127711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.127717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:59.127723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:59.127747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 946
2025-10-02T09:30:59.127748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 946
2025-10-02T09:30:59.127809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.127814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.127831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:59.127838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.127840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.127841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:59.127847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.127852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:59.127861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.127997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.128005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.128014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.128075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 947 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0
2025-10-02T09:30:59.128299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6e285c-7f0591b5-643c71d3-69ac50f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:59.130723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Write session: try to update token
2025-10-02T09:30:59.130735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:59.136941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:59.136956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.136962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.136996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:59.136995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:59.137160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:59.137285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.137412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.137540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.137711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:59.137744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:59.141485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId: src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:59.143450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.143597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.143611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.143634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:59.143698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:59.145399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:59.145412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.145414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:59.145415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:59.145421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.145425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.145427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554548090330574:6838]
2025-10-02T09:30:59.145454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:59.145456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:59.145459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:59.145461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:59.145464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.145466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:59.145588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:59.206165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554548165859036:7829]
2025-10-02T09:30:59.206385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 946, pipe: [1:7556554548165859036:7829]
2025-10-02T09:30:59.270489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:59.276904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.276924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.277049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.277097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.277145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.277195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.277395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.277403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.277453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.277501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.277550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.277600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.277635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.277639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.277697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.277752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.277803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.277850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.277888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.277894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.277971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.278020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.278067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.278115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.278163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.278168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.278217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.278263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.278310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.278357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.278402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.278407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.278456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.278500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.278549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.278600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.278647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.278652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.278700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.278756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.278817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.278864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.278897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.278901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.278958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.279006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.279054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.279101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.279136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.279141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.279189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.279234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.279282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.279327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.279359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.279364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.279407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.279450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.279494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.279539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.279572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.279576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.279606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165859036:7829], now have 1 active actors on pipe
2025-10-02T09:30:59.279748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:59.279750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:59.279760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:59.279779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 947 reason: error at write: Disconnected sessionId: src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0
2025-10-02T09:30:59.279779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554548165859036:7829]
2025-10-02T09:30:59.279947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 947 sessionId: src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0 is DEAD
2025-10-02T09:30:59.279989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:59.280072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:59.280082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Write session will restart in 0.005727s
2025-10-02T09:30:59.280100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Write session: Do CDS request
2025-10-02T09:30:59.280106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:59.287165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.287187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:59.287194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 948
2025-10-02T09:30:59.287320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.287339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:59.287344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:59.287347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:59.287656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 948 sessionId:  describe result for acl check
2025-10-02T09:30:59.287684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:59.287690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:59.287692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:59.287696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554548165859223:8084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:59.288148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554548165859223:8084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:59.290139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554548165859223:8084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:59.292081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554548165859223:8084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:59.292089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554548165859223:8084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:59.292091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554548165859223:8084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:59.292095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:59.292251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:59.293084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:59.293182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:59.293189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:59.293194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:59.293220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:59.293242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554548090330859:6841]
2025-10-02T09:30:59.293575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:59.293757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:59.293780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:59.293954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:59.293982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.293986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.293987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.293987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.293988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.293989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.293989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.293990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.293990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.293991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.293991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.293992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.293995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.294000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.294003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.294005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.294007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.294009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.294011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.294013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.294014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.294017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.294018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.294020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.294024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.294028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.294031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.294034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.294036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.294039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.294041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.294043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.294047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.294052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.294054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.294057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.294059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.294062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.294064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.294067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.294069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.294075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.294077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.294080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.294082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.294084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.294090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.294092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.294116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:59.301566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:59.303210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:59.303222Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:59.303224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:59.303227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:59.303232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 947 [2:7556554548090330859:6841]
2025-10-02T09:30:59.303241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:59.303257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:59.303258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.303260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.303262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.303270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:59.303277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:59.303281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:59.303315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.303320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.303321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.303323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:59.303325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:59.303360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:59.303365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.303372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.303377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.303388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:59.303402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165859037:2446], now have 1 active actors on pipe
2025-10-02T09:30:59.303409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165859516:8084], now have 1 active actors on pipe
2025-10-02T09:30:59.303414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.303416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.303419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.303429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:59.303440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:59.303443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:59.303446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:59.303448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:59.303452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:59.303453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:59.303468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.303474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:59.303482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:59.303464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 947
2025-10-02T09:30:59.303479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 947
2025-10-02T09:30:59.303495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.303499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.303516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:59.303522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.303524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.303526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:59.303532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.303539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:59.303548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.303639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.303645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.303654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.303720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 948 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0
2025-10-02T09:30:59.303970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c54cd4-e3ca61f1-422fa934-de96f82d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:59.306245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Write session: try to update token
2025-10-02T09:30:59.306255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:59.312758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:59.312772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.312774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:59.312776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:59.312782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.312785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.312788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554548090330854:6841]
2025-10-02T09:30:59.312828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:59.312830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:59.312832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:59.312833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.312835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:59.312835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:59.312961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:59.316930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId: src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:59.318891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.379751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554548165859551:7829]
2025-10-02T09:30:59.379905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 947, pipe: [1:7556554548165859551:7829]
2025-10-02T09:30:59.426283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:59.426490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.426498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.426524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165859551:7829], now have 1 active actors on pipe
2025-10-02T09:30:59.426668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:59.426690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554548165859551:7829]
2025-10-02T09:30:59.426715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:59.426726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:59.426793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 948 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0
2025-10-02T09:30:59.426965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 948 sessionId: src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0 is DEAD
2025-10-02T09:30:59.427107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:59.427116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Write session will restart in 0.005169s
2025-10-02T09:30:59.427135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Write session: Do CDS request
2025-10-02T09:30:59.427140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:59.433149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.433210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:59.433219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 949
2025-10-02T09:30:59.433326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.433347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:59.433353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:59.433356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:59.433692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 949 sessionId:  describe result for acl check
2025-10-02T09:30:59.433723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:59.433729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:59.433731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:59.433735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554548165859773:8095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:59.434166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554548165859773:8095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:59.435820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554548165859773:8095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:59.437668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:59.438431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:59.438530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:59.438537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:59.438543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:59.438569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:59.438593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554548090331170:6855]
2025-10-02T09:30:59.438619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554548165859773:8095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:59.438628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554548165859773:8095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:59.438630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554548165859773:8095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:59.438634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:59.438968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:59.439142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:59.439168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:59.439350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:59.439379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.439383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.439384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.439384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.439385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.439385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.439386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.439386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.439387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.439387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.439388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.439388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.439391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.439398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.439400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.439402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.439404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.439406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.439408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.439410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.439412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.439414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.439416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.439418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.439422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.439426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.439429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.439432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.439434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.439436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.439440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.439442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.439445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.439448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.439450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.439453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.439455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.439458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.439460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.439463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.439465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.439468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.439470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.439473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.439475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.439478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.439480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.439483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.439501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:59.447212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:59.448677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:59.448689Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:59.448690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:59.448693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:59.448696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 948 [2:7556554548090331170:6855]
2025-10-02T09:30:59.448703Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:59.448715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:59.448720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.448722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.448723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.448734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:59.448736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:59.448741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:59.448775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.448780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.448781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.448783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:59.448784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:59.448838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:59.448843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.448849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.448855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.448863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:59.448879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860030:8095], now have 1 active actors on pipe
2025-10-02T09:30:59.448881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165859552:2446], now have 1 active actors on pipe
2025-10-02T09:30:59.448885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.448886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.448887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.448896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:59.448903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:59.448908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:59.448910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:59.448912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:59.448915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:59.448917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:59.448911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 948
2025-10-02T09:30:59.448933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.448939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:59.448941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:59.448950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.448952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.448959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 948
2025-10-02T09:30:59.448975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a43ef461-b11b728f-2915aceb-4a040e54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:59.448983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.448985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.448986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:59.448991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.448997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:59.449009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.449105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.449110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.449118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.449159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 949 partition: 0 MaxSeqNo: 36 sessionId: src_id|a43ef461-b11b728f-2915aceb-4a040e54_0
2025-10-02T09:30:59.449417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b42ec77-ff505d12-afb0c9b1-bdc15da1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a43ef461-b11b728f-2915aceb-4a040e54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:59.451625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Write session: try to update token
2025-10-02T09:30:59.451636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:59.458620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:59.458640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.458642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:59.458644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:59.458651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.458655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.458659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554548090331165:6855]
2025-10-02T09:30:59.458688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:59.458690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:59.458692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:59.458694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:59.458695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.458697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:59.458827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:59.462361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId: src_id|a43ef461-b11b728f-2915aceb-4a040e54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:59.464392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.526689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554548165860043:7829]
2025-10-02T09:30:59.526950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 948, pipe: [1:7556554548165860043:7829]
2025-10-02T09:30:59.577718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:59.577896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.577904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.577929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860043:7829], now have 1 active actors on pipe
2025-10-02T09:30:59.578047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:59.578070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:59.578085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:59.578089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554548165860043:7829]
2025-10-02T09:30:59.578108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:59.578141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 949 reason: error at write: Disconnected sessionId: src_id|a43ef461-b11b728f-2915aceb-4a040e54_0
2025-10-02T09:30:59.578328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 949 sessionId: src_id|a43ef461-b11b728f-2915aceb-4a040e54_0 is DEAD
2025-10-02T09:30:59.578445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:59.578450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Write session will restart in 0.007417s
2025-10-02T09:30:59.578470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Write session: Do CDS request
2025-10-02T09:30:59.578474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:59.587132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.587275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:59.587289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 950
2025-10-02T09:30:59.587364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.587385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:59.587391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:59.587394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:59.587739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 950 sessionId:  describe result for acl check
2025-10-02T09:30:59.587772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:59.587777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:59.587779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:59.587783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554548165860456:8099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:59.588236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554548165860456:8099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:59.589459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:59.589670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554548165860456:8099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:59.590347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:59.590451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:59.590458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:59.590464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:59.590498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:59.590518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554548090331448:6857]
2025-10-02T09:30:59.590856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:59.591053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:59.591076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:59.591253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:59.591284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.591288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.591289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.591289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.591290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.591290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.591291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.591292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.591292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.591293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.591293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.591294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.591296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.591302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.591304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.591307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.591309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.591311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.591313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.591315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.591316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.591319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.591320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.591322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.591326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.591329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.591333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.591336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.591338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.591341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.591343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.591345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.591348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.591350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.591352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.591355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.591357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.591360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.591362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.591364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.591368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.591370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.591373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.591378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.591387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.591391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.591399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.591403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.591429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:59.591688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554548165860456:8099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:59.591699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554548165860456:8099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:59.591703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554548165860456:8099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:59.591707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:59.599113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:59.600610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:59.600621Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:59.600622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:59.600624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:59.600628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 949 [2:7556554548090331448:6857]
2025-10-02T09:30:59.600636Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:59.600647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:59.600649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.600651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.600652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.600662Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:59.600668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:59.600673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:59.600706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.600711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.600712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.600715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:59.600716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:59.600757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:59.600763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.600770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.600776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.600784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:59.600812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860044:2446], now have 1 active actors on pipe
2025-10-02T09:30:59.600822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.600823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.600824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.600834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:59.600840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860529:8099], now have 1 active actors on pipe
2025-10-02T09:30:59.600845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:59.600852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:59.600854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:59.600865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:59.600869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:59.600871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:59.600871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.600873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:59.600876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:59.600871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 949
2025-10-02T09:30:59.600900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 949
2025-10-02T09:30:59.600909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.600915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.600929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:59.600936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.600938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.600939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:59.600945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.600952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:59.600964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.601069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.601074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.601082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.601142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 950 partition: 0 MaxSeqNo: 36 sessionId: src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0
2025-10-02T09:30:59.601401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a43ef461-b11b728f-2915aceb-4a040e54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:59.603691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Write session: try to update token
2025-10-02T09:30:59.603702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:59.610182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:59.610199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.610207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.610244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:59.610243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:59.610403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:59.610535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.610668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.610807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.611008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:59.611042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:59.614545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId: src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:59.616736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.616879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.616895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.616921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:59.616991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:59.619266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:59.619278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.619280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:59.619281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:59.619287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.619291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.619293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554548090331442:6857]
2025-10-02T09:30:59.619317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:59.619325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.619326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:59.619334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:59.619346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:59.619350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:59.619454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:59.678248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554548165860549:7829]
2025-10-02T09:30:59.678444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 949, pipe: [1:7556554548165860549:7829]
2025-10-02T09:30:59.739871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:59.746342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.746360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.746490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.746544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.746598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.746656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.746695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.746701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.746757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.746809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.746866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.746925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.746978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.746984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.747039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.747094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.747148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.747201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.747243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.747248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.747306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.747366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.747422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.747479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.747520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.747525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.747598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.747656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.747737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.747792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.747831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.747837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.747918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.747973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.748030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.748087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.748128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.748133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.748190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.748245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.748305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.748363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.748408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.748412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.748470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.748529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.748587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.748644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.748681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.748685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.748742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.748798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.748874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.748934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.748975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.748983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.749041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:30:59.749094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:30:59.749149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:30:59.749204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:30:59.749255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:30:59.749257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:30:59.749294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860549:7829], now have 1 active actors on pipe
2025-10-02T09:30:59.749520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554548165860549:7829]
2025-10-02T09:30:59.749553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:59.749558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:30:59.749560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:30:59.749587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 950 reason: error at write: Disconnected sessionId: src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0
2025-10-02T09:30:59.749761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 950 sessionId: src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0 is DEAD
2025-10-02T09:30:59.749917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:30:59.749932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Write session will restart in 0.006115s
2025-10-02T09:30:59.749961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Write session: Do CDS request
2025-10-02T09:30:59.749969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:59.750108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:59.757195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.757302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:59.757317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 951
2025-10-02T09:30:59.757417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.757446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:59.757455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:59.757461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:59.757814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 951 sessionId:  describe result for acl check
2025-10-02T09:30:59.757838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:59.757842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:59.757843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:59.757846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554548165860684:8104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:59.758334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554548165860684:8104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:59.759860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554548165860684:8104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:59.762202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554548165860684:8104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:59.762216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554548165860684:8104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:59.762219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554548165860684:8104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:59.762225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:59.764853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:59.766130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:59.766271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:59.766279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:59.766287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:59.766328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:59.766362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554548090331741:6860]
2025-10-02T09:30:59.766915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:59.767180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:59.767214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:59.767474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:59.767529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.767534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.767535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.767536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.767537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.767538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.767540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.767540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.767541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.767542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.767543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.767544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.767548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.767559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.767563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.767566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.767570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.767574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.767577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.767581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.767585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.767588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.767592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.767595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.767601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.767608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.767613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.767618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.767622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.767626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.767631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.767635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.767639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.767644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.767649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.767654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.767658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.767668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.767671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.767680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.767687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.767692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.767699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.767704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.767710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.767715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.767722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.767727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.767762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:59.776031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:59.777676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:59.777692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:59.777693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:59.777697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:59.777702Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 950 [2:7556554548090331741:6860]
2025-10-02T09:30:59.777716Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:59.777731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:59.777733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.777736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.777738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.777750Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:59.777755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:59.777760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:59.777798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.777805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.777806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.777808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:59.777810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:59.777852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:59.777859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.777870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.777882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.777900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:59.777919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860554:2446], now have 1 active actors on pipe
2025-10-02T09:30:59.777926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165860982:8104], now have 1 active actors on pipe
2025-10-02T09:30:59.777931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.777937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.777938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.777947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:59.777962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:59.777964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:59.777967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:59.777969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:59.777977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:59.777979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:59.777961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 950
2025-10-02T09:30:59.777998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 950
2025-10-02T09:30:59.778001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.778007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:59.778008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:59.778018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.778026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.778058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b7e89c2-281a1036-7c079370-946eabf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:59.778065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.778068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.778070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:59.778075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.778081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:59.778092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.778223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.778233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.778245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.778312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 951 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b7e89c2-281a1036-7c079370-946eabf8_0
2025-10-02T09:30:59.778591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978f70ba-28f6958a-842c3dc9-90ad4e00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b7e89c2-281a1036-7c079370-946eabf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:59.781009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Write session: try to update token
2025-10-02T09:30:59.781020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:59.789128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:59.789146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.789148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:59.789149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:59.789155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.789159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.789165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554548090331736:6860]
2025-10-02T09:30:59.789190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:59.789195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.789196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:59.789251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:59.789272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:59.789289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:59.789323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:30:59.792501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId: src_id|3b7e89c2-281a1036-7c079370-946eabf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:59.795032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.849768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554548165861059:7829]
2025-10-02T09:30:59.849992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 950, pipe: [1:7556554548165861059:7829]
2025-10-02T09:30:59.915435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:30:59.915950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.915961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.915987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165861059:7829], now have 1 active actors on pipe
2025-10-02T09:30:59.916106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:30:59.916149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:30:59.916192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554548165861059:7829]
2025-10-02T09:30:59.916196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:59.916259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 951 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b7e89c2-281a1036-7c079370-946eabf8_0
2025-10-02T09:30:59.916418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 951 sessionId: src_id|3b7e89c2-281a1036-7c079370-946eabf8_0 is DEAD
2025-10-02T09:30:59.916557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:30:59.916566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Write session will restart in 0.006807s
2025-10-02T09:30:59.916593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Write session: Do CDS request
2025-10-02T09:30:59.916597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:30:59.924179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.924281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:30:59.924294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 952
2025-10-02T09:30:59.924372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:30:59.924397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:30:59.924405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:30:59.924409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:30:59.924694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 952 sessionId:  describe result for acl check
2025-10-02T09:30:59.924716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:30:59.924721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:30:59.924722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:30:59.924725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554548165861351:8109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:30:59.925095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554548165861351:8109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:30:59.926668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554548165861351:8109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:30:59.928383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:30:59.928456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554548165861351:8109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:30:59.928466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554548165861351:8109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:30:59.928468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554548165861351:8109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:30:59.928472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:30:59.929755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:30:59.929868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:30:59.929875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:30:59.929881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:30:59.929910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:30:59.929932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554548090332023:6863]
2025-10-02T09:30:59.930287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:30:59.930469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:30:59.930499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:30:59.930715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:30:59.930753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.930757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.930758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.930758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.930759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.930759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.930760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.930761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.930761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.930762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.930763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.930763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.930766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.930772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.930774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.930776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.930778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.930780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.930782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.930784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.930786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.930788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.930790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.930792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.930796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.930800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:30:59.930804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.930807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:30:59.930809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.930812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:30:59.930814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.930817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:30:59.930822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.930825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:30:59.930827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.930829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:30:59.930835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.930838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:30:59.930840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.930843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:30:59.930845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.930847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:30:59.930849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.930852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.930854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.930861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.930863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.930866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.930886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:30:59.938770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:30:59.940267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:30:59.940280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:30:59.940281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:30:59.940284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:30:59.940287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 951 [2:7556554548090332023:6863]
2025-10-02T09:30:59.940295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:30:59.940306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:30:59.940307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.940309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.940310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.940318Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:30:59.940321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:30:59.940325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:30:59.940366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.940372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.940373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.940375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:30:59.940376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:30:59.940416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:30:59.940421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.940427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:30:59.940432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:30:59.940444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:30:59.940458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165861061:2446], now have 1 active actors on pipe
2025-10-02T09:30:59.940464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554548165861542:8109], now have 1 active actors on pipe
2025-10-02T09:30:59.940467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.940469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.940470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.940478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:30:59.940489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:30:59.940492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:30:59.940494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:30:59.940495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:30:59.940500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:30:59.940502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:30:59.940516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.940524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:30:59.940529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:30:59.940554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 951
2025-10-02T09:30:59.940564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 951
2025-10-02T09:30:59.940616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.940623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.940646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:30:59.940655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:30:59.940661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:30:59.940663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:30:59.940673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:30:59.940684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:30:59.940699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.940848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.940854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.940862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:30:59.940930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 952 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0
2025-10-02T09:30:59.941196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7e89c2-281a1036-7c079370-946eabf8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:30:59.943618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Write session: try to update token
2025-10-02T09:30:59.943631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:30:59.954069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:30:59.954085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.954091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.954122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:30:59.954161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:30:59.954263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:30:59.954387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.954510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.954625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:30:59.954785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:30:59.954813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:30:59.955339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId: src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:30:59.957551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:30:59.957771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:30:59.957781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:30:59.957799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:30:59.957874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:30:59.958756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:30:59.958770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:30:59.958772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:30:59.958773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:30:59.958779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.958783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.958785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554548090332017:6863]
2025-10-02T09:30:59.958809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:30:59.958811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:30:59.958814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:30:59.958815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:30:59.958815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:30:59.958818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:30:59.958937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.016183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554552460828851:7829]
2025-10-02T09:31:00.016442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 951, pipe: [1:7556554552460828851:7829]
2025-10-02T09:31:00.081032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:00.087620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.087642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.087774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.087829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.087888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.087943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.087983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.087990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.088049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.088102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.088157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.088215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.088253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.088258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.088315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.088366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.088419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.088478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.088516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.088522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.088577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.088631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.088685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.088741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.088780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.088785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.088865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.088927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.088992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.089049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.089088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.089094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.089150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.089204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.089259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.089313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.089352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.089357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.089409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.089461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.089514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.089566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.089604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.089610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.089662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.089713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.089768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.089823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.089860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.089866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.089919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.089970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.090024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.090075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.090111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.090116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.090168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.090219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.090269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.090336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.090372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.090376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.090408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460828851:7829], now have 1 active actors on pipe
2025-10-02T09:31:00.090646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554552460828851:7829]
2025-10-02T09:31:00.090656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:00.090659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:00.090672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:00.090677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 952 reason: error at write: Disconnected sessionId: src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0
2025-10-02T09:31:00.090813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 952 sessionId: src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0 is DEAD
2025-10-02T09:31:00.090959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:00.090968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Write session will restart in 0.009347s
2025-10-02T09:31:00.090983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Write session: Do CDS request
2025-10-02T09:31:00.090988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:00.091084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:00.101150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.101254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:00.101267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 953
2025-10-02T09:31:00.101359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.101382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:00.101385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:00.101389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:00.101687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 953 sessionId:  describe result for acl check
2025-10-02T09:31:00.101709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:00.101710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:00.101711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:00.101714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554552460829271:8115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:00.102331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554552460829271:8115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:00.103537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:00.104082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554552460829271:8115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:00.105075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:00.105184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:00.105191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:00.105197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:00.105224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:00.105248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554552385299599:6865]
2025-10-02T09:31:00.105636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:00.105879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:00.105904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:00.106176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:00.106219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.106224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.106224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.106225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.106221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554552460829271:8115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:00.106232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.106231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554552460829271:8115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:00.106233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554552460829271:8115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:00.106233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.106237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:00.106234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.106234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.106235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.106235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.106236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.106236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.106240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.106246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.106248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.106250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.106253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.106255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.106257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.106259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.106261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.106263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.106265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.106268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.106272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.106277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.106282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.106287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.106290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.106295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.106299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.106303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.106305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.106308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.106310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.106313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.106315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.106318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.106320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.106323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.106325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.106328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.106331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.106334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.106337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.106340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.106342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.106344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.106362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:00.114272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:00.115802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:00.115814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:00.115816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:00.115819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:00.115824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 952 [2:7556554552385299599:6865]
2025-10-02T09:31:00.115832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:00.115845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:00.115851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.115853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.115854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.115865Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:00.115872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:00.115876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:00.115917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.115921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.115923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.115925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:00.115926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:00.115970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:00.115975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.115982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.115987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.115999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:00.116020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460828856:2446], now have 1 active actors on pipe
2025-10-02T09:31:00.116027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460829343:8115], now have 1 active actors on pipe
2025-10-02T09:31:00.116033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.116038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.116040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.116049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:00.116063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:00.116064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:00.116066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:00.116067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:00.116074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:00.116076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:00.116094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.116099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:00.116088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 952
2025-10-02T09:31:00.116114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:00.116120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.116089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 952
2025-10-02T09:31:00.116123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.116141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:00.116145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.116151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.116153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:00.116159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.116167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:00.116178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.116291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.116297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.116305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.116377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 953 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0
2025-10-02T09:31:00.116655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca547740-f787dc26-f0fc3978-8b415c2e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:00.119025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Write session: try to update token
2025-10-02T09:31:00.119039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:00.126011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:00.126029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.126031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:00.126032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:00.126038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.126041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.126044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554552385299594:6865]
2025-10-02T09:31:00.126069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:00.126072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.126074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:00.126081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:00.126086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:00.126090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:00.126202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.131426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId: src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:00.133574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:00.190761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554552460829359:7829]
2025-10-02T09:31:00.191023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 952, pipe: [1:7556554552460829359:7829]
2025-10-02T09:31:00.258408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:00.259037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.259052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.259068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460829359:7829], now have 1 active actors on pipe
2025-10-02T09:31:00.259280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554552460829359:7829]
2025-10-02T09:31:00.259282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:00.259306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:00.259308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:00.259351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 953 reason: error at write: Disconnected sessionId: src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0
2025-10-02T09:31:00.259399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:00.259505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 953 sessionId: src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0 is DEAD
2025-10-02T09:31:00.259630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:00.259639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Write session will restart in 0.007054s
2025-10-02T09:31:00.259653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Write session: Do CDS request
2025-10-02T09:31:00.259658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:00.268165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.268263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:00.268279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 954
2025-10-02T09:31:00.268375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.268401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:00.268409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:00.268413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:00.268856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 954 sessionId:  describe result for acl check
2025-10-02T09:31:00.268883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:00.268889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:00.268891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:00.268895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554552460829666:8120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:00.269343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554552460829666:8120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:00.271374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554552460829666:8120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:00.273295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:00.273488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554552460829666:8120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:00.273501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554552460829666:8120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:00.273504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554552460829666:8120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:00.273510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:00.273574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:00.273696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:00.273705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:00.273714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:00.273751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:00.273785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554552385299887:6868]
2025-10-02T09:31:00.274326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:00.274543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:00.274578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:00.274851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:00.274896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.274902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.274903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.274904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.274905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.274906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.274907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.274908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.274909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.274910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.274911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.274911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.274915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.274934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.274938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.274941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.274944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.274948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.274951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.274955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.274958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.274962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.274966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.274969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.274976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.274982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.274987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.274993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.275001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.275006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.275014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.275018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.275027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.275032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.275040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.275044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.275052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.275057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.275064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.275069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.275074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.275080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.275084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.275090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.275094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.275101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.275105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.275109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.275143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:00.282685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:00.284144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:00.284159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:00.284160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:00.284163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:00.284168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 953 [2:7556554552385299887:6868]
2025-10-02T09:31:00.284176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:00.284186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:00.284188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.284190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.284191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.284202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:00.284205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:00.284209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:00.284244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.284249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.284250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.284252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:00.284253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:00.284291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:00.284296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.284302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.284308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.284316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:00.284330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.284335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.284336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.284342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:00.284348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:00.284350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460829847:8120], now have 1 active actors on pipe
2025-10-02T09:31:00.284351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:00.284352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:00.284352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460829361:2446], now have 1 active actors on pipe
2025-10-02T09:31:00.284359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:00.284366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:00.284367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:00.284386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.284393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:00.284405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:00.284431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 953
2025-10-02T09:31:00.284443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 953
2025-10-02T09:31:00.284487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.284493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.284513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:00.284520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.284522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.284524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:00.284529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.284535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:00.284545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.284677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.284683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.284690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.284764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 954 partition: 0 MaxSeqNo: 36 sessionId: src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0
2025-10-02T09:31:00.285034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c08194d-c1ca616a-7ad1db5b-554c329c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:00.287204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Write session: try to update token
2025-10-02T09:31:00.287215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:00.293869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:00.293887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.293890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:00.293892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:00.293898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.293903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.293905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554552385299881:6868]
2025-10-02T09:31:00.293930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:00.293933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.293935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:00.293937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:00.293942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:00.293945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:00.294058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.297740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId: src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:00.300177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:00.359213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554552460829859:7829]
2025-10-02T09:31:00.359377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 953, pipe: [1:7556554552460829859:7829]
2025-10-02T09:31:00.415857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:00.416406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.416416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.416442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460829859:7829], now have 1 active actors on pipe
2025-10-02T09:31:00.416674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:00.416687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:00.416695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554552460829859:7829]
2025-10-02T09:31:00.416710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:00.416731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 954 reason: error at write: Disconnected sessionId: src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0
2025-10-02T09:31:00.416875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 954 sessionId: src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0 is DEAD
2025-10-02T09:31:00.416913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:00.417037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:00.417045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Write session will restart in 0.008484s
2025-10-02T09:31:00.417062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Write session: Do CDS request
2025-10-02T09:31:00.417066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:00.426228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.426325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:00.426337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 955
2025-10-02T09:31:00.426423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.426444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:00.426451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:00.426454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:00.426733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 955 sessionId:  describe result for acl check
2025-10-02T09:31:00.426761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:00.426765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:00.426766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:00.426770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554552460830276:8131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:00.427128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554552460830276:8131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:00.428904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:00.429028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554552460830276:8131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:00.429813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:00.429915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:00.429921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:00.429927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:00.429952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:00.429975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554552385300205:6882]
2025-10-02T09:31:00.430314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:00.430513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:00.430541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:00.430749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554552460830276:8131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:00.430760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554552460830276:8131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:00.430762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554552460830276:8131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:00.430766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:00.430793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:00.430839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.430845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.430846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.430847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.430848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.430848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.430849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.430850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.430851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.430852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.430853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.430853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.430857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.430866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.430869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.430872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.430875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.430879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.430882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.430886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.430889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.430893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.430896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.430901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.430906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.430912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.430922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.430937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.430941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.430947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.430951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.430955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.430962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.430969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.430971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.430974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.430976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.430978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.430980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.430982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.430986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.430989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.430991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.430994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.430996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.430999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.431001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.431003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.431022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:00.438668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:00.440153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:00.440166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:00.440169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:00.440171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:00.440175Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 954 [2:7556554552385300205:6882]
2025-10-02T09:31:00.440183Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:00.440194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:00.440200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.440202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.440203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.440212Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:00.440215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:00.440221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:00.440258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.440264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.440265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.440266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:00.440268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:00.440310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:00.440316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.440324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.440330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.440341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:00.440356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460830370:8131], now have 1 active actors on pipe
2025-10-02T09:31:00.440362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460829885:2446], now have 1 active actors on pipe
2025-10-02T09:31:00.440365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.440367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.440368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.440377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:00.440385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:00.440391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:00.440393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:00.440394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:00.440396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:00.440398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:00.440388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 954
2025-10-02T09:31:00.440394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 954
2025-10-02T09:31:00.440415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.440420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:00.440421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:00.440430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.440435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.440465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e272d36b-d811eb75-54b03a3f-df18c316_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:00.440471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.440474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.440475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:00.440480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.440488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:00.440499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.440612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.440624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.440641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.440718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 955 partition: 0 MaxSeqNo: 36 sessionId: src_id|e272d36b-d811eb75-54b03a3f-df18c316_0
2025-10-02T09:31:00.441017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7190ce18-f85f0b2a-6dac7296-1facabf9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e272d36b-d811eb75-54b03a3f-df18c316_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:00.443442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Write session: try to update token
2025-10-02T09:31:00.443455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:00.450864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:00.450889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.450891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:00.450893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:00.450903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.450909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.450915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554552385300200:6882]
2025-10-02T09:31:00.450964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:00.450968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:00.450971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:00.450972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:00.450979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.450981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:00.451181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.455497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId: src_id|e272d36b-d811eb75-54b03a3f-df18c316_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:00.457988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:00.516887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554552460830379:7829]
2025-10-02T09:31:00.517177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 954, pipe: [1:7556554552460830379:7829]
2025-10-02T09:31:00.573392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:00.573604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.573616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.573632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460830379:7829], now have 1 active actors on pipe
2025-10-02T09:31:00.573797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:00.573855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:00.573904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554552460830379:7829]
2025-10-02T09:31:00.574191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:00.574262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 955 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e272d36b-d811eb75-54b03a3f-df18c316_0
2025-10-02T09:31:00.574418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 955 sessionId: src_id|e272d36b-d811eb75-54b03a3f-df18c316_0 is DEAD
2025-10-02T09:31:00.574560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:00.574571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Write session will restart in 0.005590s
2025-10-02T09:31:00.574593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Write session: Do CDS request
2025-10-02T09:31:00.574599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:00.581242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.581329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:00.581346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 956
2025-10-02T09:31:00.581479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.581503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:00.581509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:00.581512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:00.581898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 956 sessionId:  describe result for acl check
2025-10-02T09:31:00.581928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:00.581936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:00.581937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:00.581942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554552460830482:8135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:00.582430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554552460830482:8135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:00.584364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554552460830482:8135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:00.586651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554552460830482:8135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:00.586664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554552460830482:8135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:00.586667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554552460830482:8135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:00.586673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:00.589425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:00.590353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:00.590496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:00.590508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:00.590517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:00.590561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:00.590590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554552385300490:6884]
2025-10-02T09:31:00.591157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:00.591400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:00.591439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:00.591720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:00.591771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.591780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.591780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.591781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.591782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.591783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.591784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.591785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.591786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.591787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.591788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.591788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.591793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.591803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.591806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.591810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.591814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.591817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.591820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.591824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.591827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.591831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.591834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.591838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.591843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.591850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.591856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.591860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.591864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.591869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.591872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.591877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.591881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.591885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.591889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.591894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.591898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.591903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.591906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.591911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.591915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.591919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.591923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.591929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.591933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.591937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.591941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.591945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.591983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:00.600065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:00.601695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:00.601716Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:00.601719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:00.601723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:00.601729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 955 [2:7556554552385300490:6884]
2025-10-02T09:31:00.601741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:00.601757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:00.601760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.601763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.601765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.601780Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:00.601792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:00.601798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:00.601858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.601865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.601867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.601870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:00.601872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:00.601939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:00.601947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.601959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.601974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.601995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:00.602018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460830382:2446], now have 1 active actors on pipe
2025-10-02T09:31:00.602025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460830782:8135], now have 1 active actors on pipe
2025-10-02T09:31:00.602035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.602037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.602040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.602053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:00.602069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:00.602087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:00.602094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:00.602115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:00.602122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.602123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:00.602094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 955
2025-10-02T09:31:00.602097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 955
2025-10-02T09:31:00.602125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:00.602126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:00.602131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:00.602567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.602583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.602619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:00.602631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.602634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.602637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:00.602646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.602656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:00.602675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.602810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.602818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.602831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.602900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 956 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0
2025-10-02T09:31:00.603202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272d36b-d811eb75-54b03a3f-df18c316_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:00.605560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Write session: try to update token
2025-10-02T09:31:00.605573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:00.612372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:00.612394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.612397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:00.612399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:00.612407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.612412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.612419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554552385300485:6884]
2025-10-02T09:31:00.612454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:00.612460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.612462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:00.612463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:00.612469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:00.612473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:00.612591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.617689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId: src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:00.619997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:00.674082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554552460830892:7829]
2025-10-02T09:31:00.674268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 955, pipe: [1:7556554552460830892:7829]
2025-10-02T09:31:00.739678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:00.739918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.739927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.739941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460830892:7829], now have 1 active actors on pipe
2025-10-02T09:31:00.740147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:00.740156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:00.740163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:00.740166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:00.740217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554552460830892:7829]
2025-10-02T09:31:00.740219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 956 reason: error at write: Disconnected sessionId: src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0
2025-10-02T09:31:00.740356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 956 sessionId: src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0 is DEAD
2025-10-02T09:31:00.740517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:00.740531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Write session will restart in 0.005811s
2025-10-02T09:31:00.740555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Write session: Do CDS request
2025-10-02T09:31:00.740561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:00.747185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.747256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:00.747269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 957
2025-10-02T09:31:00.747404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.747431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:00.747441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:00.747445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:00.747818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 957 sessionId:  describe result for acl check
2025-10-02T09:31:00.747853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:00.747859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:00.747861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:00.747865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554552460831107:8140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:00.748352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554552460831107:8140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:00.750107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554552460831107:8140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:00.752161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:00.752375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554552460831107:8140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:00.752385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554552460831107:8140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:00.752388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554552460831107:8140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:00.752392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:00.753132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:00.753236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:00.753244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:00.753250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:00.753278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:00.753301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554552385300787:6887]
2025-10-02T09:31:00.753663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:00.753848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:00.753872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:00.754064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:00.754097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.754101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.754101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.754102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.754102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.754103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.754104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.754104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.754105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.754105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.754106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.754106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.754109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.754116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.754118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.754121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.754123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.754125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.754127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.754129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.754131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.754134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.754136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.754138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.754142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.754146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.754150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.754153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.754156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.754159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.754162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.754165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.754167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.754170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.754172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.754174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.754177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.754180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.754182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.754185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.754187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.754189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.754192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.754194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.754198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.754201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.754207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.754210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.754227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:00.762390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:00.763876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:00.763892Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:00.763893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:00.763896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:00.763900Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 956 [2:7556554552385300787:6887]
2025-10-02T09:31:00.763909Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:00.763919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:00.763921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.763922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.763923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.763934Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:00.763937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:00.763941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:00.763973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.763978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.763979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.763982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:00.763983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:00.764022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:00.764027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.764034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.764039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.764048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:00.764063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460830894:2446], now have 1 active actors on pipe
2025-10-02T09:31:00.764069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460831382:8140], now have 1 active actors on pipe
2025-10-02T09:31:00.764074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.764077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.764078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.764085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:00.764097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:00.764103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:00.764105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:00.764107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:00.764108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:00.764110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:00.764127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.764132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:00.764134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:00.764141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 956
2025-10-02T09:31:00.764161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 956
2025-10-02T09:31:00.764172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.764177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.764193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:00.764200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.764202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.764203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:00.764208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.764216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:00.764226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.764329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.764333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.764341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.764399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 957 partition: 0 MaxSeqNo: 36 sessionId: src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0
2025-10-02T09:31:00.764674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1a95ae-691dbc5-53aee7dd-d0a4dfe2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:00.767494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Write session: try to update token
2025-10-02T09:31:00.767510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:00.773838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:00.773859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.773868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.773895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:00.773903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:00.774056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:00.774177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:00.774293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:00.774404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:00.774563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:00.774592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:00.779516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId: src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:00.781645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:00.781784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.781800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.781822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:00.781887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:00.782958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:00.782970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.782971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:00.782972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:00.782979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.782982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.782985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554552385300781:6887]
2025-10-02T09:31:00.783008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:00.783011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:00.783015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.783017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:00.783017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:00.783019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:00.783132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.840494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554552460831398:7829]
2025-10-02T09:31:00.840687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 956, pipe: [1:7556554552460831398:7829]
2025-10-02T09:31:00.902221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:00.909129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.909149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.909273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.909326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.909380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.909433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.909473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.909479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.909533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.909583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.909633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.909688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.909729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.909735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.909791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.909840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.909890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.909941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.909977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.909981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.910034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.910086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.910136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.910187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.910226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.910231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.910284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.910333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.910386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.910436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.910473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.910479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.910533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.910584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.910636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.910685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.910723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.910729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.910780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.910829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.910884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.910944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.910982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.910987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.911039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.911089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.911142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.911193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.911244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.911249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.911299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.911348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.911399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.911451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.911487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.911492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.911543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:00.911590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:00.911637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:00.911686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:00.911722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:00.911727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:00.911759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460831398:7829], now have 1 active actors on pipe
2025-10-02T09:31:00.911935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:00.911955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:00.911958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:00.911976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554552460831398:7829]
2025-10-02T09:31:00.911977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 957 reason: error at write: Disconnected sessionId: src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0
2025-10-02T09:31:00.912114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 957 sessionId: src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0 is DEAD
2025-10-02T09:31:00.912234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:00.912239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Write session will restart in 0.005144s
2025-10-02T09:31:00.912254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Write session: Do CDS request
2025-10-02T09:31:00.912259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:00.912435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:00.918243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.918294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:00.918308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 958
2025-10-02T09:31:00.918485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:00.918513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:00.918522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:00.918526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:00.918879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 958 sessionId:  describe result for acl check
2025-10-02T09:31:00.918907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:00.918909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:00.918910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:00.918915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554552460831592:8145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:00.919385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554552460831592:8145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:00.921557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554552460831592:8145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:00.923529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:00.924363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:00.924458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554552460831592:8145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:00.924467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554552460831592:8145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:00.924469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554552460831592:8145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:00.924479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:00.924473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:00.924488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:00.924497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:00.924531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:00.924559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554552385301074:6890]
2025-10-02T09:31:00.924927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:00.925104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:00.925129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:00.925324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:00.925359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.925363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.925364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.925364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.925365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.925366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.925366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.925366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.925367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.925367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.925368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.925368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.925371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.925377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.925379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.925381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.925383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.925385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.925387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.925389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.925391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.925393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.925395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.925397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.925400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.925404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:00.925407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.925410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:00.925413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.925416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:00.925419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.925424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:00.925428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.925432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:00.925435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.925440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:00.925443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.925448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:00.925451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.925456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:00.925458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.925462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:00.925464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.925466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.925468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.925471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.925475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.925480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.925512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:00.933272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:00.934893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:00.934909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:00.934911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:00.934914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:00.934942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 957 [2:7556554552385301074:6890]
2025-10-02T09:31:00.934960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:00.934977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:00.934984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.934986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.934988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.935000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:00.935008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:00.935014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:00.935056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.935062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.935064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.935067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:00.935069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:00.935119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:00.935126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.935137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:00.935151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:00.935171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:00.935189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460831403:2446], now have 1 active actors on pipe
2025-10-02T09:31:00.935197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554552460831893:8145], now have 1 active actors on pipe
2025-10-02T09:31:00.935202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.935204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.935206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.935216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:00.935230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:00.935231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:00.935238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:00.935240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:00.935244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:00.935247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:00.935246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 957
2025-10-02T09:31:00.935266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.935252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 957
2025-10-02T09:31:00.935274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:00.935275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:00.935295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.935303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.935328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:00.935337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:00.935344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:00.935346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:00.935354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:00.935364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:00.935384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.935497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:00.935504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:00.935514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:00.935599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 958 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0
2025-10-02T09:31:00.935903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af412b8-69fbb3c5-ed3b01a1-36331de3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:00.938671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Write session: try to update token
2025-10-02T09:31:00.938689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:00.945142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:00.945159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:00.945161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:00.945162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:00.945168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.945172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.945177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554552385301068:6890]
2025-10-02T09:31:00.945205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:00.945206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:00.945210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:00.945212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:00.945213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:00.945215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:00.945330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:00.952639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId: src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:00.954947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.012035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755799200:7829]
2025-10-02T09:31:01.012269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 957, pipe: [1:7556554556755799200:7829]
2025-10-02T09:31:01.071106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:01.071577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.071586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.071599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755799200:7829], now have 1 active actors on pipe
2025-10-02T09:31:01.071745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:01.071817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:01.071821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755799200:7829]
2025-10-02T09:31:01.071840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:01.071894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 958 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0
2025-10-02T09:31:01.072035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 958 sessionId: src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0 is DEAD
2025-10-02T09:31:01.072208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:01.072221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Write session will restart in 0.008111s
2025-10-02T09:31:01.072244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Write session: Do CDS request
2025-10-02T09:31:01.072249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:01.081236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.081344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:01.081356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 959
2025-10-02T09:31:01.081507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.081531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:01.081537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:01.081541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:01.081889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 959 sessionId:  describe result for acl check
2025-10-02T09:31:01.081913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:01.081918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:01.081919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:01.081922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554556755799555:8149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:01.082280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554556755799555:8149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:01.083849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554556755799555:8149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:01.085051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:01.085777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:01.085885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:01.085892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:01.085898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:01.085928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:01.085949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554556680268657:6892]
2025-10-02T09:31:01.086052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554556755799555:8149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:01.086061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554556755799555:8149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:01.086063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554556755799555:8149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:01.086067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:01.086300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:01.086490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:01.086512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:01.086685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:01.086714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.086718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.086719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.086719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.086720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.086720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.086721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.086722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.086722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.086723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.086723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.086724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.086727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.086733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.086735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.086737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.086739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.086741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.086743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.086745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.086747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.086749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.086751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.086753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.086757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.086761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.086764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.086767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.086769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.086772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.086774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.086777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.086779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.086782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.086784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.086786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.086789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.086791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.086793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.086796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.086799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.086801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.086804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.086807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.086812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.086815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.086817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.086819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.086839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:01.094718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:01.096310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:01.096329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:01.096331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:01.096334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:01.096338Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 958 [2:7556554556680268657:6892]
2025-10-02T09:31:01.096349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:01.096361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:01.096364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.096366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.096368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.096381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:01.096386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:01.096393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:01.096437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.096447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.096449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.096452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:01.096454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:01.096507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:01.096514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.096524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.096534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.096553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:01.096574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755799692:8149], now have 1 active actors on pipe
2025-10-02T09:31:01.096584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755799202:2446], now have 1 active actors on pipe
2025-10-02T09:31:01.096589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.096591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.096593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.096606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:01.096617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:01.096631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:01.096630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:01.096633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:01.096634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:01.096636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:01.096653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.096661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:01.096662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:01.096663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 958
2025-10-02T09:31:01.096663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 958
2025-10-02T09:31:01.096727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.096735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.096757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:01.096767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.096771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.096773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:01.096780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.096788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:01.096819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.096992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.096999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.097010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.097072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 959 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0
2025-10-02T09:31:01.097352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4d28ae-5215cf5f-8d636e0-e4d9f5a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:01.100027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Write session: try to update token
2025-10-02T09:31:01.100042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:01.107402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:01.107418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.107420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:01.107422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:01.107428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.107431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.107433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554556680268652:6892]
2025-10-02T09:31:01.107458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:01.107463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.107464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:01.107469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:01.107473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:01.107475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:01.107576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:01.111181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId: src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:01.113398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.171760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755799703:7829]
2025-10-02T09:31:01.172005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 958, pipe: [1:7556554556755799703:7829]
2025-10-02T09:31:01.227925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:01.228468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.228478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.228505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755799703:7829], now have 1 active actors on pipe
2025-10-02T09:31:01.228646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:01.228680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:01.228685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:01.228688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:01.228729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755799703:7829]
2025-10-02T09:31:01.228746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 959 reason: error at write: Disconnected sessionId: src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0
2025-10-02T09:31:01.228924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 959 sessionId: src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0 is DEAD
2025-10-02T09:31:01.229052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:01.229061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Write session will restart in 0.009102s
2025-10-02T09:31:01.229077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Write session: Do CDS request
2025-10-02T09:31:01.229082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:01.239154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.239232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:01.239244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 960
2025-10-02T09:31:01.239338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.239360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:01.239363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:01.239365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:01.239623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 960 sessionId:  describe result for acl check
2025-10-02T09:31:01.239643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:01.239647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:01.239648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:01.239651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554556755800162:8154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:01.239849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:01.240079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554556755800162:8154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:01.240672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:01.240767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:01.240774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:01.240780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:01.240819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:01.240841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554556680268947:6895]
2025-10-02T09:31:01.241193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:01.241320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554556755800162:8154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:01.241375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:01.241399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:01.241577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:01.241606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.241610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.241610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.241611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.241611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.241612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.241612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.241613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.241613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.241614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.241614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.241615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.241618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.241623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.241626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.241628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.241630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.241632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.241634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.241636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.241638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.241640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.241642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.241644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.241648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.241652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.241655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.241658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.241660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.241663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.241665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.241671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.241674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.241677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.241680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.241682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.241685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.241691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.241693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.241695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.241699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.241703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.241706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.241708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.241710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.241713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.241719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.241721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.241739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:01.245828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554556755800162:8154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:01.245838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554556755800162:8154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:01.245841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554556755800162:8154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:01.245852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:01.249701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:01.251037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:01.251048Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:01.251050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:01.251052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:01.251055Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 959 [2:7556554556680268947:6895]
2025-10-02T09:31:01.251062Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:01.251073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:01.251075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.251077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.251077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.251087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:01.251093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:01.251098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:01.251130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.251135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.251136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.251138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:01.251139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:01.251178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:01.251183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.251189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.251194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.251205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:01.251219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755799707:2446], now have 1 active actors on pipe
2025-10-02T09:31:01.251225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755800202:8154], now have 1 active actors on pipe
2025-10-02T09:31:01.251228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.251230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.251231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.251239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:01.251235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 959
2025-10-02T09:31:01.251250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:01.251236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 959
2025-10-02T09:31:01.251253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:01.251255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:01.251259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:01.251261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:01.251262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:01.251287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.251292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.251300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.251305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:01.251316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:01.251324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:01.251327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.251329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.251330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:01.251335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.251340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:01.251355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.251444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.251449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.251456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.251503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 960 partition: 0 MaxSeqNo: 36 sessionId: src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0
2025-10-02T09:31:01.251707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea1d50-29d877ac-4c16058-51e475b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:01.253881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Write session: try to update token
2025-10-02T09:31:01.253891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:01.261366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:01.261383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.261385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:01.261388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:01.261394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.261399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.261404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554556680268941:6895]
2025-10-02T09:31:01.261433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:01.261436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:01.261441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.261443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:01.261445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:01.261448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:01.261559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:01.264382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId: src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:01.266432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.328944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755800209:7829]
2025-10-02T09:31:01.329147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 959, pipe: [1:7556554556755800209:7829]
2025-10-02T09:31:01.379642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:01.380206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.380217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.380246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755800209:7829], now have 1 active actors on pipe
2025-10-02T09:31:01.380388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:01.380451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755800209:7829]
2025-10-02T09:31:01.380452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:01.380484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:01.380547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 960 reason: status is not ok: tablet will be restarted right now sessionId: src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0
2025-10-02T09:31:01.380703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 960 sessionId: src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0 is DEAD
2025-10-02T09:31:01.380854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:01.380863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Write session will restart in 0.007106s
2025-10-02T09:31:01.380878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Write session: Do CDS request
2025-10-02T09:31:01.380882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:01.389115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.389233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:01.389243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 961
2025-10-02T09:31:01.389325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.389344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:01.389351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:01.389354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:01.389603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 961 sessionId:  describe result for acl check
2025-10-02T09:31:01.389627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:01.389631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:01.389632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:01.389635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554556755800560:8158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:01.389955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554556755800560:8158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:01.391456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554556755800560:8158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:01.392388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:01.393526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:01.393624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:01.393631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:01.393637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:01.393664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:01.393688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554556680269249:6897]
2025-10-02T09:31:01.393701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554556755800560:8158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:01.393711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554556755800560:8158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:01.393714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554556755800560:8158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:01.393719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:01.394033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:01.394224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:01.394248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:01.394424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:01.394454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.394458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.394458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.394459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.394459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.394460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.394460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.394461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.394462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.394462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.394463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.394463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.394466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.394472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.394474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.394477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.394478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.394481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.394483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.394485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.394487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.394489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.394491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.394493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.394497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.394501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.394504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.394507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.394510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.394512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.394514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.394517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.394520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.394522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.394528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.394531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.394533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.394536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.394541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.394544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.394546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.394549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.394551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.394554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.394560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.394562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.394565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.394571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.394589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:01.402748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:01.404568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:01.404582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:01.404584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:01.404586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:01.404589Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 960 [2:7556554556680269249:6897]
2025-10-02T09:31:01.404598Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:01.404609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:01.404611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.404613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.404614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.404623Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:01.404629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:01.404636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:01.404682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.404688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.404689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.404690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:01.404692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:01.404737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:01.404742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.404750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.404756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.404764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:01.404776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.404779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.404780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.404785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:01.404793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755800211:2446], now have 1 active actors on pipe
2025-10-02T09:31:01.404795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:01.404797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755800703:8158], now have 1 active actors on pipe
2025-10-02T09:31:01.404812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:01.404813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:01.404814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:01.404821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:01.404823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:01.404846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.404853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:01.404865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:01.404861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 960
2025-10-02T09:31:01.404888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 960
2025-10-02T09:31:01.404959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.404968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.404984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:01.404992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.404994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.404996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:01.405001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.405008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:01.405016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.405132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.405138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.405149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.405216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 961 partition: 0 MaxSeqNo: 36 sessionId: src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0
2025-10-02T09:31:01.405510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520c40d0-edf301b8-7fc3b467-fbb38bd5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:01.408062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Write session: try to update token
2025-10-02T09:31:01.408073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:01.414790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:01.414810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.414815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.414850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:01.414851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:01.415013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:01.415126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:01.415242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:01.415363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:01.415806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:01.415840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:01.420769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId: src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:01.422980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.423170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.423192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.423221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:01.423288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:01.424290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:01.424308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.424310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:01.424311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:01.424319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.424322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.424325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554556680269244:6897]
2025-10-02T09:31:01.424357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:01.424357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:01.424360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:01.424362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:01.424367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.424369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:01.424501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:01.480487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755800736:7829]
2025-10-02T09:31:01.480665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 960, pipe: [1:7556554556755800736:7829]
2025-10-02T09:31:01.550505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:01.556889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.556912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.557048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.557101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.557156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.557214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.557252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.557258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.557312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.557363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.557420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.557478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.557514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.557519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.557572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.557621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.557680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.557737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.557771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.557776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.557830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.557884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.557940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.557996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.558038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.558043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.558097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.558146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.558204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.558256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.558293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.558298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.558351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.558399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.558455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.558507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.558543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.558548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.558597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.558644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.558703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.558756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.558795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.558800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.558852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.558904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.558970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.559026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.559065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.559067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.559121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.559170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.559227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.559278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.559311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.559316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.559365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:01.559409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:01.559461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:01.559517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:01.559552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:01.559556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:01.559589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755800736:7829], now have 1 active actors on pipe
2025-10-02T09:31:01.559824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755800736:7829]
2025-10-02T09:31:01.559827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:01.559865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:01.559867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:01.559887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 961 reason: error at write: Disconnected sessionId: src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0
2025-10-02T09:31:01.560023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 961 sessionId: src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0 is DEAD
2025-10-02T09:31:01.560188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:01.560198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Write session will restart in 0.009896s
2025-10-02T09:31:01.560218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Write session: Do CDS request
2025-10-02T09:31:01.560225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:01.560250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:01.571284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.571399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:01.571412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 962
2025-10-02T09:31:01.571542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.571564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:01.571568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:01.571571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:01.571849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 962 sessionId:  describe result for acl check
2025-10-02T09:31:01.571871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:01.571873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:01.571873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:01.571877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554556755801199:8171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:01.572236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554556755801199:8171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:01.572214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:01.573383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:01.573497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:01.573503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:01.573509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:01.573540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:01.573564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554556680269562:6911]
2025-10-02T09:31:01.574004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:01.574119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554556755801199:8171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:01.574173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:01.574204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:01.574393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:01.574436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.574442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.574443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.574444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.574445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.574445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.574446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.574447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.574447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.574448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.574448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.574449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.574452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.574458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.574460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.574462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.574464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.574467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.574469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.574471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.574473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.574475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.574477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.574479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.574483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.574487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.574490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.574493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.574495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.574497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.574500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.574502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.574505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.574507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.574509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.574512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.574514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.574517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.574519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.574522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.574524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.574526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.574528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.574531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.574533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.574535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.574537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.574540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.574557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:01.579036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554556755801199:8171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:01.579047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554556755801199:8171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:01.579049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554556755801199:8171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:01.579060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:01.582241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:01.583735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:01.583755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:01.583757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:01.583760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:01.583765Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 961 [2:7556554556680269562:6911]
2025-10-02T09:31:01.583781Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:01.583800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:01.583809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.583812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.583814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.583831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:01.583843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:01.583849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:01.583911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.583920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.583922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.583926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:01.583929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:01.583993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:01.584000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.584011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.584020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.584034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:01.584056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755801239:8171], now have 1 active actors on pipe
2025-10-02T09:31:01.584063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755800742:2446], now have 1 active actors on pipe
2025-10-02T09:31:01.584069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.584070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.584072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.584081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:01.584073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 961
2025-10-02T09:31:01.584091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 961
2025-10-02T09:31:01.584092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:01.584095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:01.584097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:01.584099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:01.584103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:01.584105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:01.584133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.584139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.584150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.584158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:01.584176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:01.584177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:01.584184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.584187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.584188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:01.584194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.584200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:01.584216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.584328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.584340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.584357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.584437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 962 partition: 0 MaxSeqNo: 36 sessionId: src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0
2025-10-02T09:31:01.584734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533812bf-7bba2314-3a1caf57-edeefc0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:01.587325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Write session: try to update token
2025-10-02T09:31:01.587339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:01.593947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:01.593964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.593966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:01.593967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:01.593972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.593975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.593978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554556680269557:6911]
2025-10-02T09:31:01.594005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:01.594009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.594010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:01.594015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:01.594022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:01.594025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:01.594127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:01.600198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId: src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:01.602421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.660204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755801246:7829]
2025-10-02T09:31:01.660418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 961, pipe: [1:7556554556755801246:7829]
2025-10-02T09:31:01.719029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:01.719566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.719575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.719587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755801246:7829], now have 1 active actors on pipe
2025-10-02T09:31:01.719721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:01.719769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755801246:7829]
2025-10-02T09:31:01.719777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:01.719795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:01.719832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 962 reason: status is not ok: tablet will be restarted right now sessionId: src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0
2025-10-02T09:31:01.719990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 962 sessionId: src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0 is DEAD
2025-10-02T09:31:01.720128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:01.720137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Write session will restart in 0.009859s
2025-10-02T09:31:01.720169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Write session: Do CDS request
2025-10-02T09:31:01.720173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:01.731222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.731313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:01.731324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 963
2025-10-02T09:31:01.731399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.731427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:01.731434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:01.731437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:01.731609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:01.731738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 963 sessionId:  describe result for acl check
2025-10-02T09:31:01.731767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:01.731771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:01.731772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:01.731777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554556755801720:8176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:01.732151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554556755801720:8176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:01.732556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:01.732667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:01.732673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:01.732680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:01.732707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:01.732732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554556680269865:6914]
2025-10-02T09:31:01.733106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:01.733264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:01.733290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:01.733487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:01.733518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.733522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.733523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.733524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.733524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.733525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.733525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.733526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.733526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.733527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.733527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.733528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.733531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.733538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.733540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.733542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.733544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.733546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.733548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.733551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.733553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.733555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.733557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.733559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.733563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.733567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.733571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.733574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.733576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.733579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.733582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.733585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.733587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.733590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.733592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.733595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.733597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.733600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.733602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.733606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.733609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.733611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.733614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.733617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.733619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.733622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.733625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.733627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.733646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:01.733925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554556755801720:8176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:01.738587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554556755801720:8176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:01.738597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554556755801720:8176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:01.738598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554556755801720:8176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:01.738606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:01.741319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:01.742670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:01.742683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:01.742684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:01.742686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:01.742691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 962 [2:7556554556680269865:6914]
2025-10-02T09:31:01.742698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:01.742709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:01.742713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.742715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.742717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.742726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:01.742733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:01.742739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:01.742776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.742781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.742782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.742784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:01.742786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:01.742827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:01.742832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.742839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.742844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.742853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:01.742866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.742870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.742872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.742877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:01.742884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:01.742892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:01.742894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:01.742894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:01.742897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:01.742899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:01.742910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.742912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:01.742919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755801260:2446], now have 1 active actors on pipe
2025-10-02T09:31:01.742921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:01.742935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755801758:8176], now have 1 active actors on pipe
2025-10-02T09:31:01.742966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 962
2025-10-02T09:31:01.742976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 962
2025-10-02T09:31:01.743046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.743052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.743067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:01.743074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.743076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.743078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:01.743083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.743092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:01.743100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.743235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.743239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.743246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.743307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 963 partition: 0 MaxSeqNo: 36 sessionId: src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0
2025-10-02T09:31:01.743570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147673a0-41f0ffd-829e92fe-d72b13f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:01.745902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Write session: try to update token
2025-10-02T09:31:01.745913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:01.752676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:01.752692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.752694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:01.752696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:01.752703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.752706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.752708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554556680269860:6914]
2025-10-02T09:31:01.752730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:01.752734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.752736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:01.752752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:01.752766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:01.752770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:01.752866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:01.756857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId: src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:01.758846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.819950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755801773:7829]
2025-10-02T09:31:01.820164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 962, pipe: [1:7556554556755801773:7829]
2025-10-02T09:31:01.883428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:01.884055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.884066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.884091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755801773:7829], now have 1 active actors on pipe
2025-10-02T09:31:01.884227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:01.884237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755801773:7829]
2025-10-02T09:31:01.884253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:01.884256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:01.884259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:01.884301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 963 reason: error at write: Disconnected sessionId: src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0
2025-10-02T09:31:01.884435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 963 sessionId: src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0 is DEAD
2025-10-02T09:31:01.884564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:01.884573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Write session will restart in 0.005373s
2025-10-02T09:31:01.884588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Write session: Do CDS request
2025-10-02T09:31:01.884592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:01.891137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.891198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:01.891207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 964
2025-10-02T09:31:01.891282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:01.891301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:01.891308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:01.891310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:01.891694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 964 sessionId:  describe result for acl check
2025-10-02T09:31:01.891720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:01.891721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:01.891722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:01.891725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554556755802036:8181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:01.892071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554556755802036:8181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:01.893729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554556755802036:8181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:01.895381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:01.895538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554556755802036:8181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:01.895548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554556755802036:8181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:01.895551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554556755802036:8181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:01.895555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:01.896226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:01.896324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:01.896330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:01.896336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:01.896362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:01.896384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554556680270160:6916]
2025-10-02T09:31:01.896793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:01.896983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:01.897008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:01.897182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:01.897211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.897214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.897215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.897215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.897216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.897216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.897217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.897218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.897218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.897219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.897219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.897220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.897222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.897228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.897230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.897232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.897234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.897236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.897238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.897240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.897242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.897244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.897245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.897247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.897251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.897255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:01.897259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.897261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:01.897264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.897266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:01.897269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.897271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:01.897274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.897276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:01.897278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.897281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:01.897283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.897286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:01.897288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.897291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:01.897293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.897296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:01.897298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.897300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.897302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.897306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.897308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.897310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.897327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:01.904726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:01.906189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:01.906202Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:01.906204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:01.906205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:01.906209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 963 [2:7556554556680270160:6916]
2025-10-02T09:31:01.906216Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:01.906225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:01.906226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.906228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.906229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.906238Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:01.906244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:01.906248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:01.906280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.906285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.906286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.906288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:01.906289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:01.906327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:01.906333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.906340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:01.906345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:01.906354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:01.906369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755802272:8181], now have 1 active actors on pipe
2025-10-02T09:31:01.906374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755801778:2446], now have 1 active actors on pipe
2025-10-02T09:31:01.906378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.906379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.906380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.906388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:01.906395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:01.906401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:01.906403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:01.906404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:01.906407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:01.906408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:01.906410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 963
2025-10-02T09:31:01.906412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 963
2025-10-02T09:31:01.906422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.906427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:01.906430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:01.906442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.906447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.906654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5aecfb0-e723e004-859902c8-8665da54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:01.906663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:01.906665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:01.906667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:01.906673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:01.906678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:01.906694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.906786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:01.906791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:01.906799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:01.906840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 964 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5aecfb0-e723e004-859902c8-8665da54_0
2025-10-02T09:31:01.907091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c533d342-8bab3a30-f98463ab-f2f5176a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5aecfb0-e723e004-859902c8-8665da54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:01.909290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Write session: try to update token
2025-10-02T09:31:01.909302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:01.915902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:01.915922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:01.915923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:01.915924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:01.915929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.915931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.915934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554556680270153:6916]
2025-10-02T09:31:01.915959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:01.915961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:01.915964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:01.915965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:01.915966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:01.915967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:01.916090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:01.920079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId: src_id|f5aecfb0-e723e004-859902c8-8665da54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:01.922140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:01.984303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554556755802284:7829]
2025-10-02T09:31:01.984513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 963, pipe: [1:7556554556755802284:7829]
2025-10-02T09:31:02.037953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:02.038173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.038182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.038208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554556755802284:7829], now have 1 active actors on pipe
2025-10-02T09:31:02.038423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:02.038434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:02.038448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:02.038451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:02.038482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 964 reason: error at write: Disconnected sessionId: src_id|f5aecfb0-e723e004-859902c8-8665da54_0
2025-10-02T09:31:02.038492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554556755802284:7829]
2025-10-02T09:31:02.038614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 964 sessionId: src_id|f5aecfb0-e723e004-859902c8-8665da54_0 is DEAD
2025-10-02T09:31:02.038734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:02.038743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Write session will restart in 0.009630s
2025-10-02T09:31:02.038759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Write session: Do CDS request
2025-10-02T09:31:02.038763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:02.049172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.049270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:02.049279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 965
2025-10-02T09:31:02.049367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.049387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:02.049393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:02.049396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:02.049656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 965 sessionId:  describe result for acl check
2025-10-02T09:31:02.049683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:02.049688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:02.049690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:02.049692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554561050770040:8185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:02.050081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554561050770040:8185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:02.050383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:02.051327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:02.051432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:02.051438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:02.051444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:02.051471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:02.051492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554560975237749:6919]
2025-10-02T09:31:02.051785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554561050770040:8185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:02.051894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:02.052086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:02.052109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:02.052286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:02.052316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.052318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.052318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.052319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.052320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.052320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.052321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.052321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.052322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.052322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.052323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.052323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.052326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.052332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.052334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.052336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.052338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.052340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.052342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.052344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.052346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.052348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.052350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.052352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.052355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.052359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.052362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.052365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.052367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.052370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.052372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.052374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.052376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.052379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.052381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.052384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.052386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.052389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.052391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.052394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.052396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.052398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.052401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.052403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.052406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.052408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.052410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.052413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.052437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:02.056237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554561050770040:8185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:02.056247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554561050770040:8185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:02.056249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554561050770040:8185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:02.056253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:02.059898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:02.061393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:02.061404Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:02.061405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:02.061407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:02.061410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 964 [2:7556554560975237749:6919]
2025-10-02T09:31:02.061419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:02.061428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:02.061430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.061431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.061432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.061441Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:02.061447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:02.061452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:02.061481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.061488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.061489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.061492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:02.061493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:02.061542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:02.061549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.061556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.061561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.061569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:02.061582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.061587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.061588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.061593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:02.061602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050770082:8185], now have 1 active actors on pipe
2025-10-02T09:31:02.061603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:02.061604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050769582:2446], now have 1 active actors on pipe
2025-10-02T09:31:02.061605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:02.061607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:02.061609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:02.061616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:02.061620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:02.061637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.061647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:02.061652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 964
2025-10-02T09:31:02.061661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:02.061660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 964
2025-10-02T09:31:02.061689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.061694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.061710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:02.061717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.061719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.061720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:02.061725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.061731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:02.061738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.061827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.061832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.061839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.061895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 965 partition: 0 MaxSeqNo: 36 sessionId: src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0
2025-10-02T09:31:02.062149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5aecfb0-e723e004-859902c8-8665da54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:02.065589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Write session: try to update token
2025-10-02T09:31:02.065611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:02.070527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:02.070539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.070543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.070564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:02.070579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:02.070696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:02.070811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.070936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.071054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.071205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:02.071227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:02.078878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:02.078892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.078894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:02.078906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:02.078911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.078913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.078916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554560975237743:6919]
2025-10-02T09:31:02.078944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:02.078951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.078952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:02.078967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:02.078973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:02.078976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:02.079062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:02.081309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId: src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:02.083825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:02.138425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554561050770089:7829]
2025-10-02T09:31:02.138679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 964, pipe: [1:7556554561050770089:7829]
2025-10-02T09:31:02.210113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:02.210639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.210651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.210665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050770089:7829], now have 1 active actors on pipe
2025-10-02T09:31:02.210822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:02.210834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:02.210839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:02.210878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 965 reason: error at write: Disconnected sessionId: src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0
2025-10-02T09:31:02.210878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554561050770089:7829]
2025-10-02T09:31:02.210862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:02.211043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 965 sessionId: src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0 is DEAD
2025-10-02T09:31:02.211170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:02.211179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Write session will restart in 0.007004s
2025-10-02T09:31:02.211195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Write session: Do CDS request
2025-10-02T09:31:02.211199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:02.219265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.219398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:02.219412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 966
2025-10-02T09:31:02.219534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.219563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:02.219575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:02.219578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:02.219919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 966 sessionId:  describe result for acl check
2025-10-02T09:31:02.219946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:02.219951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:02.219954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:02.219958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554561050770398:8190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:02.220542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554561050770398:8190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:02.222461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554561050770398:8190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:02.223258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:02.224362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:02.224460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:02.224463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554561050770398:8190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:02.224481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554561050770398:8190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:02.224483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554561050770398:8190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:02.224467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:02.224473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:02.224487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:02.224498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:02.224521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554560975238045:6922]
2025-10-02T09:31:02.224885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:02.225117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:02.225167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:02.225375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:02.225408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.225412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.225413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.225414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.225414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.225415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.225415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.225416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.225417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.225417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.225418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.225418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.225422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.225428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.225430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.225432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.225434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.225436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.225438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.225440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.225442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.225444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.225446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.225448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.225452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.225456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.225460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.225462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.225465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.225467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.225470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.225472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.225474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.225478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.225480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.225483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.225485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.225488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.225492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.225495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.225497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.225500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.225502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.225505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.225507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.225513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.225515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.225517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.225546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:02.233398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:02.234754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:02.234766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:02.234768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:02.234771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:02.234775Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 965 [2:7556554560975238045:6922]
2025-10-02T09:31:02.234783Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:02.234795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:02.234798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.234800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.234801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.234812Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:02.234818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:02.234823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:02.234857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.234862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.234863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.234865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:02.234866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:02.235034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:02.235040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.235047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.235052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.235061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:02.235049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 965
2025-10-02T09:31:02.235049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 965
2025-10-02T09:31:02.235077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050770591:8190], now have 1 active actors on pipe
2025-10-02T09:31:02.235083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050770093:2446], now have 1 active actors on pipe
2025-10-02T09:31:02.235087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.235088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.235090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.235095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:02.235104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:02.235106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:02.235109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:02.235111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:02.235113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:02.235115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:02.235127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.235129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.235158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.235167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:02.235176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:02.235182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.235184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.235186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:02.235186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:02.235191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.235199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:02.235223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.235324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.235329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.235337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.235400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 966 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0
2025-10-02T09:31:02.235714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e840b838-2ffb982d-c99f0ddf-1b0375f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:02.238201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Write session: try to update token
2025-10-02T09:31:02.238212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:02.245123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:02.245138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.245140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:02.245141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:02.245147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.245150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.245152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554560975238040:6922]
2025-10-02T09:31:02.245174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:02.245178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.245179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:02.245200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:02.245217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:02.245220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:02.245294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:02.250094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId: src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:02.252468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:02.310963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554561050770602:7829]
2025-10-02T09:31:02.311163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 965, pipe: [1:7556554561050770602:7829]
2025-10-02T09:31:02.363740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:02.364268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.364278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.364303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050770602:7829], now have 1 active actors on pipe
2025-10-02T09:31:02.364441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:02.364488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:02.364496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:02.364500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:02.364526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554561050770602:7829]
2025-10-02T09:31:02.364547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 966 reason: error at write: Disconnected sessionId: src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0
2025-10-02T09:31:02.364698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 966 sessionId: src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0 is DEAD
2025-10-02T09:31:02.364840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:02.364845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Write session will restart in 0.008714s
2025-10-02T09:31:02.364860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Write session: Do CDS request
2025-10-02T09:31:02.364863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:02.374188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.374484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:02.374496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 967
2025-10-02T09:31:02.374571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.374594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:02.374597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:02.374599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:02.374908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 967 sessionId:  describe result for acl check
2025-10-02T09:31:02.374947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:02.374952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:02.374953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:02.374956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554561050771064:8194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:02.375343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554561050771064:8194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:02.375668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:02.376662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:02.376764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:02.376771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:02.376777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:02.376815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:02.376837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554560975238339:6924]
2025-10-02T09:31:02.377066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554561050771064:8194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:02.377198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:02.377388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:02.377412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:02.377590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:02.377620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.377624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.377624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.377625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.377625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.377626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.377626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.377627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.377627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.377628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.377628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.377629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.377632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.377637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.377640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.377642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.377644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.377646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.377648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.377650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.377652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.377655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.377657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.377659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.377663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.377667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.377670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.377673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.377675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.377678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.377681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.377683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.377685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.377688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.377690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.377693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.377695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.377698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.377700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.377703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.377705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.377708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.377710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.377712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.377715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.377718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.377720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.377723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.377739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:02.381861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554561050771064:8194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:02.381873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554561050771064:8194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:02.381876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554561050771064:8194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:02.381883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:02.385558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:02.386994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:02.387005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:02.387006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:02.387009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:02.387013Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 966 [2:7556554560975238339:6924]
2025-10-02T09:31:02.387020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:02.387030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:02.387035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.387036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.387037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.387047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:02.387050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:02.387055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:02.387085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.387090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.387092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.387093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:02.387095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:02.387141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:02.387147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.387158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.387165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.387173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:02.387189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050771106:8194], now have 1 active actors on pipe
2025-10-02T09:31:02.387194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050770604:2446], now have 1 active actors on pipe
2025-10-02T09:31:02.387197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.387199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.387200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.387207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:02.387214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:02.387224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:02.387225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:02.387227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:02.387232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:02.387234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:02.387240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.387242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:02.387236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 966
2025-10-02T09:31:02.387237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 966
2025-10-02T09:31:02.387252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:02.387264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.387266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.387282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:02.387289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.387291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.387292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:02.387298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.387304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:02.387312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.387412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.387417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.387424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.387479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 967 partition: 0 MaxSeqNo: 36 sessionId: src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0
2025-10-02T09:31:02.387711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5db04b-73b21006-580ef2ca-cf63688a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:02.389953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Write session: try to update token
2025-10-02T09:31:02.389963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:02.396316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:02.396330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.396334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.396359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:02.396363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:02.396487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:02.396594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.396717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.396841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.396990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:02.397014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:02.400339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId: src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:02.402245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:02.402726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.402740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.402762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:02.402828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:02.404936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:02.404948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.404949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:02.404951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:02.404956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.404959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.404961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554560975238333:6924]
2025-10-02T09:31:02.404983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:02.404989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.404989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:02.404991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:02.404992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:02.404995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:02.405105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:02.464526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554561050771135:7829]
2025-10-02T09:31:02.464649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 966, pipe: [1:7556554561050771135:7829]
2025-10-02T09:31:02.524461Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:02.530880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.530904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.531037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.531090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.531145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.531198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.531236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.531241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.531299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.531350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.531404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.531461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.531500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.531505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.531561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.531613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.531669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.531722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.531758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.531763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.531816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.531870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.531923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.531975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.532014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.532019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.532074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.532124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.532177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.532233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.532269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.532274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.532332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.532386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.532441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.532504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.532541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.532546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.532598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.532646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.532697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.532748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.532794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.532815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.532874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.532924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.532975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.533026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.533063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.533068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.533119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.533169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.533225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.533276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.533324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.533328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.533377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:02.533426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:02.533476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:02.533528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:02.533574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:02.533579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:02.533612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050771135:7829], now have 1 active actors on pipe
2025-10-02T09:31:02.533786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:02.533798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:02.533800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:02.533817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 967 reason: error at write: Disconnected sessionId: src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0
2025-10-02T09:31:02.533842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554561050771135:7829]
2025-10-02T09:31:02.533984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 967 sessionId: src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0 is DEAD
2025-10-02T09:31:02.534073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:02.534081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Write session will restart in 0.008716s
2025-10-02T09:31:02.534097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Write session: Do CDS request
2025-10-02T09:31:02.534101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:02.534265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:02.544207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.544269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:02.544295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 968
2025-10-02T09:31:02.544389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.544417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:02.544425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:02.544428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:02.544751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 968 sessionId:  describe result for acl check
2025-10-02T09:31:02.544775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:02.544779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:02.544780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:02.544783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554561050771599:8205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:02.545233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554561050771599:8205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:02.545480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:02.546579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:02.546678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:02.546684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:02.546690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:02.546716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:02.546740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554560975238671:6938]
2025-10-02T09:31:02.547100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:02.547276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554561050771599:8205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:02.547290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:02.547313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:02.547486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:02.547515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.547519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.547520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.547520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.547521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.547521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.547522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.547522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.547523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.547523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.547524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.547525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.547527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.547533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.547536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.547538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.547539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.547541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.547543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.547545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.547547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.547549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.547551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.547553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.547556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.547560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.547563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.547566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.547568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.547571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.547573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.547576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.547578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.547580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.547583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.547585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.547587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.547590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.547592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.547595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.547598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.547600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.547602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.547605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.547607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.547610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.547612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.547614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.547631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:02.551459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554561050771599:8205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:02.551468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554561050771599:8205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:02.551470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554561050771599:8205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:02.551474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:02.555099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:02.556558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:02.556570Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:02.556571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:02.556574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:02.556577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 967 [2:7556554560975238671:6938]
2025-10-02T09:31:02.556584Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:02.556594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:02.556595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.556597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.556598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.556608Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:02.556614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:02.556618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:02.556649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.556654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.556655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.556657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:02.556658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:02.556697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:02.556701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.556708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.556713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.556721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:02.556740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050771137:2446], now have 1 active actors on pipe
2025-10-02T09:31:02.556746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050771641:8205], now have 1 active actors on pipe
2025-10-02T09:31:02.556750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.556751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.556752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.556759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:02.556771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:02.556775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:02.556777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:02.556779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:02.556781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:02.556782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:02.556773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 967
2025-10-02T09:31:02.556786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 967
2025-10-02T09:31:02.556818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.556829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:02.556840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:02.556840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.556842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.556864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d530b54e-695e9855-1eba060b-538a02a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:02.556872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.556874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.556875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:02.556880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.556885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:02.556893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.557004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.557009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.557016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.557073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 968 partition: 0 MaxSeqNo: 36 sessionId: src_id|d530b54e-695e9855-1eba060b-538a02a9_0
2025-10-02T09:31:02.557299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d55999-17ab77b5-a0b77dbf-5dea2954_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d530b54e-695e9855-1eba060b-538a02a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:02.559588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Write session: try to update token
2025-10-02T09:31:02.559600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:02.566402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:02.566419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.566421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:02.566422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:02.566427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.566432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.566435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554560975238665:6938]
2025-10-02T09:31:02.566459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:02.566463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.566464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:02.566465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:02.566469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:02.566471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:02.566578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:02.571361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId: src_id|d530b54e-695e9855-1eba060b-538a02a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:02.573374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:02.634016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554561050771648:7829]
2025-10-02T09:31:02.634257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 967, pipe: [1:7556554561050771648:7829]
2025-10-02T09:31:02.681182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:02.681665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.681674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.681698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050771648:7829], now have 1 active actors on pipe
2025-10-02T09:31:02.681810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:02.681849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:02.681871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:02.681893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554561050771648:7829]
2025-10-02T09:31:02.681931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 968 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d530b54e-695e9855-1eba060b-538a02a9_0
2025-10-02T09:31:02.682084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 968 sessionId: src_id|d530b54e-695e9855-1eba060b-538a02a9_0 is DEAD
2025-10-02T09:31:02.682209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:02.682218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Write session will restart in 0.005022s
2025-10-02T09:31:02.682232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Write session: Do CDS request
2025-10-02T09:31:02.682236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:02.688178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.688328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:02.688348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 969
2025-10-02T09:31:02.688484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.688514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:02.688519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:02.688524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:02.688911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 969 sessionId:  describe result for acl check
2025-10-02T09:31:02.688949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:02.688958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:02.688959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:02.688964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554561050771849:8210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:02.689405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554561050771849:8210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:02.691121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554561050771849:8210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:02.693305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554561050771849:8210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:02.693317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554561050771849:8210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:02.693319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554561050771849:8210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:02.693324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:02.693628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:02.694574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:02.694671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:02.694678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:02.694684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:02.694709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:02.694731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554560975238981:6941]
2025-10-02T09:31:02.695126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:02.695291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:02.695313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:02.695501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:02.695536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.695540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.695540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.695541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.695541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.695542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.695542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.695543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.695543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.695544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.695544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.695545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.695547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.695553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.695555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.695558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.695560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.695562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.695563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.695565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.695567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.695569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.695571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.695573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.695577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.695581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.695584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.695587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.695589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.695591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.695594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.695596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.695599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.695601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.695603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.695606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.695608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.695611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.695613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.695616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.695618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.695624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.695626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.695629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.695631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.695634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.695636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.695639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.695657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:02.703188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:02.704555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:02.704568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:02.704570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:02.704572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:02.704575Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 968 [2:7556554560975238981:6941]
2025-10-02T09:31:02.704582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:02.704591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:02.704593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.704594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.704595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.704604Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:02.704607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:02.704612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:02.704646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.704650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.704651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.704653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:02.704655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:02.704820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 968
2025-10-02T09:31:02.704903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:02.704910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.704917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.704922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.704930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:02.704945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050771661:2446], now have 1 active actors on pipe
2025-10-02T09:31:02.704950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050772159:8210], now have 1 active actors on pipe
2025-10-02T09:31:02.704943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 968
2025-10-02T09:31:02.704962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.704966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.704976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.704980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.704981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.704989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:02.705000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:02.705002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:02.705005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:02.705007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:02.705010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:02.705012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:02.705024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efa0ea80-3393417-783f1f78-8beba837_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:02.705031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.705033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.705034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:02.705040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.705048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:02.705062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.705070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:02.705076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.705081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:02.705181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.705186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.705195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.705261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 969 partition: 0 MaxSeqNo: 36 sessionId: src_id|efa0ea80-3393417-783f1f78-8beba837_0
2025-10-02T09:31:02.705565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d530b54e-695e9855-1eba060b-538a02a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|efa0ea80-3393417-783f1f78-8beba837_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:02.708127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Write session: try to update token
2025-10-02T09:31:02.708137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:02.718594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:02.718619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.718627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.718660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:02.718664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:02.718996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:02.719319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.719451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.719582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:02.719996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:02.720042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:02.723331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:02.723347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.723348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:02.723349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:02.723355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.723357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.723363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554560975238976:6941]
2025-10-02T09:31:02.723385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:02.723389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.723391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:02.723400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:02.723405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:02.723408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:02.723499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:02.723605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId: src_id|efa0ea80-3393417-783f1f78-8beba837_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:02.725947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:02.782011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554561050772176:7829]
2025-10-02T09:31:02.782317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 968, pipe: [1:7556554561050772176:7829]
2025-10-02T09:31:02.855522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:02.856109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.856122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.856139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050772176:7829], now have 1 active actors on pipe
2025-10-02T09:31:02.856315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:02.856326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:02.856335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:02.856338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:02.856368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554561050772176:7829]
2025-10-02T09:31:02.856392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 969 reason: error at write: Disconnected sessionId: src_id|efa0ea80-3393417-783f1f78-8beba837_0
2025-10-02T09:31:02.856541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 969 sessionId: src_id|efa0ea80-3393417-783f1f78-8beba837_0 is DEAD
2025-10-02T09:31:02.856677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:02.856686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Write session will restart in 0.007151s
2025-10-02T09:31:02.856708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Write session: Do CDS request
2025-10-02T09:31:02.856712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:02.865300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.865418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:02.865433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 970
2025-10-02T09:31:02.865574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:02.865606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:02.865613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:02.865617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:02.866020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 970 sessionId:  describe result for acl check
2025-10-02T09:31:02.866053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:02.866055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:02.866057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:02.866063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554561050772338:8215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:02.866590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554561050772338:8215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:02.869081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554561050772338:8215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:02.871804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554561050772338:8215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:02.871816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554561050772338:8215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:02.871819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554561050772338:8215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:02.871825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:02.874567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:02.876014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:02.876149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:02.876156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:02.876162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:02.876192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:02.876217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554560975239279:6943]
2025-10-02T09:31:02.876564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:02.876788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:02.876825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:02.877030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:02.877069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.877072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.877073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.877074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.877074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.877075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.877075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.877076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.877076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.877077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.877077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.877078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.877081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.877087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.877089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.877091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.877093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.877095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.877097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.877099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.877101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.877103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.877105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.877107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.877111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.877115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:02.877119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.877121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:02.877123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.877126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:02.877128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.877131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:02.877133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.877135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:02.877137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.877140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:02.877143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.877145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:02.877148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.877151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:02.877155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.877159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:02.877162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.877166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.877170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.877175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.877178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.877183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.877205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:02.885099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:02.887163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:02.887180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:02.887183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:02.887186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:02.887192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 969 [2:7556554560975239279:6943]
2025-10-02T09:31:02.887203Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:02.887220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:02.887223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.887225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.887227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.887240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:02.887250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:02.887255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:02.887305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.887312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.887314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.887317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:02.887319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:02.887375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:02.887383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.887394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:02.887405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:02.887420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:02.887439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050772642:8215], now have 1 active actors on pipe
2025-10-02T09:31:02.887450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050772185:2446], now have 1 active actors on pipe
2025-10-02T09:31:02.887455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.887457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.887458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.887469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:02.887480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:02.887481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:02.887483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:02.887485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:02.887495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:02.887498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:02.887520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.887507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 969
2025-10-02T09:31:02.887529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:02.887513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 969
2025-10-02T09:31:02.887532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:02.887551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.887553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.887575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6bfea3c-6728ecb0-83899040-9355af25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:02.887582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:02.887584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:02.887586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:02.887592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:02.887598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:02.887608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.887703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:02.887708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:02.887716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:02.887769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 970 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6bfea3c-6728ecb0-83899040-9355af25_0
2025-10-02T09:31:02.888112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa0ea80-3393417-783f1f78-8beba837_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6bfea3c-6728ecb0-83899040-9355af25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:02.893043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Write session: try to update token
2025-10-02T09:31:02.893056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:02.897604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:02.897621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:02.897623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:02.897624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:02.897629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.897632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.897634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554560975239274:6943]
2025-10-02T09:31:02.897659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:02.897663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:02.897664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:02.897669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:02.897673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:02.897677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:02.897810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:02.906837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId: src_id|f6bfea3c-6728ecb0-83899040-9355af25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:02.908954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:02.956582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554561050772698:7829]
2025-10-02T09:31:02.956785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 969, pipe: [1:7556554561050772698:7829]
2025-10-02T09:31:03.017480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:03.018070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.018085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.018104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554561050772698:7829], now have 1 active actors on pipe
2025-10-02T09:31:03.018349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:03.018357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:03.018364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:03.018406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:03.018430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 970 reason: error at write: Disconnected sessionId: src_id|f6bfea3c-6728ecb0-83899040-9355af25_0
2025-10-02T09:31:03.018511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554561050772698:7829]
2025-10-02T09:31:03.018603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 970 sessionId: src_id|f6bfea3c-6728ecb0-83899040-9355af25_0 is DEAD
2025-10-02T09:31:03.018746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:03.018755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Write session will restart in 0.005591s
2025-10-02T09:31:03.018784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Write session: Do CDS request
2025-10-02T09:31:03.018788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:03.025100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.025165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:03.025174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 971
2025-10-02T09:31:03.025266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.025289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:03.025295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:03.025305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:03.025667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 971 sessionId:  describe result for acl check
2025-10-02T09:31:03.025698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:03.025704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:03.025706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:03.025710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554565345740130:8219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:03.026156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554565345740130:8219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:03.027973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554565345740130:8219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:03.029680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554565345740130:8219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:03.029691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554565345740130:8219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:03.029695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554565345740130:8219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:03.029700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:03.032878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:03.033164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:03.033294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:03.033303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:03.033311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:03.033354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:03.033385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554565270206876:6946]
2025-10-02T09:31:03.033922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:03.034116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:03.034154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:03.034428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:03.034478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.034484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.034485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.034486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.034487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.034488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.034489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.034490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.034491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.034492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.034493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.034494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.034498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.034508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.034511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.034515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.034519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.034522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.034526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.034529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.034536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.034543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.034547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.034552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.034558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.034566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.034575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.034584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.034591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.034598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.034606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.034615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.034623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.034627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.034633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.034642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.034646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.034654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.034661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.034666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.034673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.034680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.034687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.034692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.034698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.034703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.034710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.034715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.034748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:03.042693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:03.044137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:03.044150Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:03.044152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:03.044155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:03.044161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 970 [2:7556554565270206876:6946]
2025-10-02T09:31:03.044172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:03.044185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:03.044192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.044195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.044197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.044209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:03.044218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:03.044227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:03.044274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.044282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.044283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.044286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:03.044288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:03.044338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:03.044344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.044355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.044368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.044384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:03.044403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345739995:2446], now have 1 active actors on pipe
2025-10-02T09:31:03.044410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345740467:8219], now have 1 active actors on pipe
2025-10-02T09:31:03.044415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.044420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.044422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.044433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:03.044423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 970
2025-10-02T09:31:03.044447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:03.044451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:03.044429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 970
2025-10-02T09:31:03.044454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:03.044455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:03.044464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:03.044471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:03.044505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.044511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.044521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.044532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:03.044543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:03.044559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:03.044568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.044574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.044576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:03.044583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.044594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:03.044614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.044725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.044733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.044745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.044838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 971 partition: 0 MaxSeqNo: 36 sessionId: src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0
2025-10-02T09:31:03.045229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bfea3c-6728ecb0-83899040-9355af25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:03.047378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Write session: try to update token
2025-10-02T09:31:03.047387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:03.054269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:03.054284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.054287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:03.054288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:03.054296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.054301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.054305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554565270206871:6946]
2025-10-02T09:31:03.054334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:03.054335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:03.054337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:03.054340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:03.054340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.054342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:03.054471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:03.058405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId: src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:03.060497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:03.118887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554565345740522:7829]
2025-10-02T09:31:03.119097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 970, pipe: [1:7556554565345740522:7829]
2025-10-02T09:31:03.179946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:03.180403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.180415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.180443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345740522:7829], now have 1 active actors on pipe
2025-10-02T09:31:03.180575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:03.180598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554565345740522:7829]
2025-10-02T09:31:03.180611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:03.180625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:03.180679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 971 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0
2025-10-02T09:31:03.180840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 971 sessionId: src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0 is DEAD
2025-10-02T09:31:03.181026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:03.181043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Write session will restart in 0.006167s
2025-10-02T09:31:03.181072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Write session: Do CDS request
2025-10-02T09:31:03.181081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:03.188335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.188389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:03.188402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 972
2025-10-02T09:31:03.188554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.188582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:03.188586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:03.188588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:03.188951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 972 sessionId:  describe result for acl check
2025-10-02T09:31:03.188987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:03.188988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:03.188989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:03.188994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554565345740745:8224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:03.189481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554565345740745:8224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:03.191114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554565345740745:8224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:03.193123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554565345740745:8224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:03.193133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554565345740745:8224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:03.193135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554565345740745:8224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:03.193139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:03.195525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:03.195899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:03.196061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:03.196069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:03.196076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:03.196108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:03.196134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554565270207178:6948]
2025-10-02T09:31:03.196481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:03.196668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:03.196693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:03.196886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:03.196927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.196933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.196934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.196935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.196936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.196937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.196938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.196938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.196939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.196940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.196941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.196942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.196945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.196955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.196959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.196963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.196966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.196969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.196972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.196976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.196979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.196983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.196987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.196990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.196997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.197004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.197013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.197017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.197025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.197029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.197034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.197037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.197039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.197042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.197044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.197046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.197048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.197051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.197053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.197055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.197059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.197063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.197065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.197068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.197070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.197073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.197075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.197081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.197098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:03.205126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:03.206886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:03.206900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:03.206903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:03.206906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:03.206911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 971 [2:7556554565270207178:6948]
2025-10-02T09:31:03.206935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:03.206946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:03.206948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.206949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.206950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.206960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:03.206963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:03.206969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:03.207003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.207009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.207010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.207012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:03.207013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:03.207053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:03.207058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.207064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.207070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.207084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:03.207102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345740525:2446], now have 1 active actors on pipe
2025-10-02T09:31:03.207109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345741027:8224], now have 1 active actors on pipe
2025-10-02T09:31:03.207114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.207116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.207118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.207128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:03.207137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:03.207139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:03.207140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:03.207141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:03.207154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:03.207159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:03.207182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.207188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:03.207203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:03.207181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 971
2025-10-02T09:31:03.207200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 971
2025-10-02T09:31:03.207232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.207240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.207260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d287b06-c57f0113-a23ba563-93b09518_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:03.207269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.207272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.207274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:03.207282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.207293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:03.207311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.207445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.207453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.207465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.207526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 972 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d287b06-c57f0113-a23ba563-93b09518_0
2025-10-02T09:31:03.207845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62ded0a-677d26dc-da2a6bc0-9ccc1cdf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d287b06-c57f0113-a23ba563-93b09518_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:03.210734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Write session: try to update token
2025-10-02T09:31:03.210754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:03.217154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:03.217168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.217170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:03.217172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:03.217179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.217182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.217185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554565270207173:6948]
2025-10-02T09:31:03.217215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:03.217219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.217221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:03.217223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:03.217228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:03.217232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:03.217341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:03.226081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId: src_id|8d287b06-c57f0113-a23ba563-93b09518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:03.228504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:03.280686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554565345741041:7829]
2025-10-02T09:31:03.280911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 971, pipe: [1:7556554565345741041:7829]
2025-10-02T09:31:03.345604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:03.346027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.346038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.346051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345741041:7829], now have 1 active actors on pipe
2025-10-02T09:31:03.346234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:03.346269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:03.346298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554565345741041:7829]
2025-10-02T09:31:03.346316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:03.346376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 972 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d287b06-c57f0113-a23ba563-93b09518_0
2025-10-02T09:31:03.346498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 972 sessionId: src_id|8d287b06-c57f0113-a23ba563-93b09518_0 is DEAD
2025-10-02T09:31:03.346647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:03.346661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Write session will restart in 0.008648s
2025-10-02T09:31:03.346684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Write session: Do CDS request
2025-10-02T09:31:03.346690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:03.356390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.356525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:03.356539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 973
2025-10-02T09:31:03.356703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.356734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:03.356742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:03.356746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:03.357140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 973 sessionId:  describe result for acl check
2025-10-02T09:31:03.357171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:03.357177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:03.357178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:03.357183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554565345741223:8228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:03.357678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554565345741223:8228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:03.359998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554565345741223:8228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:03.362107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554565345741223:8228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:03.362123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554565345741223:8228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:03.362127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554565345741223:8228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:03.362133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:03.364192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:03.365795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:03.365942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:03.365951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:03.365958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:03.365999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:03.366031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554565270207479:6951]
2025-10-02T09:31:03.366400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:03.366651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:03.366685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:03.366908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:03.366964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.366968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.366969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.366970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.366971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.366972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.366972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.366973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.366973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.366974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.366975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.366975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.366978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.366985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.366987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.366989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.366991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.366993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.366995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.366997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.366999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.367002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.367004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.367006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.367010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.367014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.367017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.367020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.367022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.367025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.367027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.367030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.367033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.367036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.367038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.367041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.367043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.367046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.367048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.367051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.367053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.367057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.367059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.367062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.367064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.367067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.367069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.367071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.367089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:03.375201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:03.376994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:03.377006Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:03.377007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:03.377009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:03.377014Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 972 [2:7556554565270207479:6951]
2025-10-02T09:31:03.377022Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:03.377033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:03.377035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.377037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.377038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.377047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:03.377050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:03.377054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:03.377102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.377110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.377112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.377115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:03.377117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:03.377167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:03.377175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.377182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.377188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.377197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:03.377209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.377211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.377212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.377217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:03.377227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345741528:8228], now have 1 active actors on pipe
2025-10-02T09:31:03.377229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:03.377231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:03.377231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:03.377232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:03.377239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:03.377240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:03.377244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345741042:2446], now have 1 active actors on pipe
2025-10-02T09:31:03.377263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.377268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:03.377275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:03.377327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 972
2025-10-02T09:31:03.377364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 972
2025-10-02T09:31:03.377431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.377437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.377454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:03.377461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.377463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.377465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:03.377470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.377477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:03.377485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.377647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.377654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.377666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.377755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 973 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0
2025-10-02T09:31:03.378052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d287b06-c57f0113-a23ba563-93b09518_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:03.380749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Write session: try to update token
2025-10-02T09:31:03.380767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:03.387604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:03.387620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.387623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:03.387625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:03.387633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.387637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.387643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554565270207474:6951]
2025-10-02T09:31:03.387678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:03.387681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:03.387683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.387685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:03.387686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:03.387691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:03.387826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:03.393151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId: src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:03.395461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:03.446582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554565345741559:7829]
2025-10-02T09:31:03.446825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 972, pipe: [1:7556554565345741559:7829]
2025-10-02T09:31:03.522495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:03.523156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.523167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.523180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345741559:7829], now have 1 active actors on pipe
2025-10-02T09:31:03.523425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:03.523438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:03.523425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:03.523443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:03.523464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554565345741559:7829]
2025-10-02T09:31:03.523493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 973 reason: error at write: Disconnected sessionId: src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0
2025-10-02T09:31:03.523647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 973 sessionId: src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0 is DEAD
2025-10-02T09:31:03.523830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:03.523842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Write session will restart in 0.007949s
2025-10-02T09:31:03.523863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Write session: Do CDS request
2025-10-02T09:31:03.523868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:03.533199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.533320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:03.533338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 974
2025-10-02T09:31:03.533443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.533472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:03.533477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:03.533481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:03.533858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 974 sessionId:  describe result for acl check
2025-10-02T09:31:03.533890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:03.533892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:03.533893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:03.533898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554565345741803:8239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:03.534701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554565345741803:8239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:03.536513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554565345741803:8239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:03.539371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554565345741803:8239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:03.539383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554565345741803:8239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:03.539386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554565345741803:8239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:03.539392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:03.540137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:03.541869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:03.542072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:03.542081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:03.542091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:03.542143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:03.542178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554565270207816:6965]
2025-10-02T09:31:03.542683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:03.543006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:03.543063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:03.543337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:03.543381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.543385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.543385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.543386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.543387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.543387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.543388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.543389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.543389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.543390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.543391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.543391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.543394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.543402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.543404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.543406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.543409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.543412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.543415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.543419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.543422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.543425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.543428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.543432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.543438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.543444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.543449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.543454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.543457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.543462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.543466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.543471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.543475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.543480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.543483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.543488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.543492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.543496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.543500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.543505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.543508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.543513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.543516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.543521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.543525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.543531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.543534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.543539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.543570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:03.551976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:03.554017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:03.554032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:03.554035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:03.554038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:03.554045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 973 [2:7556554565270207816:6965]
2025-10-02T09:31:03.554057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:03.554072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:03.554075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.554079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.554080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.554095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:03.554106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:03.554112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:03.554170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.554177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.554179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.554182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:03.554184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:03.554243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:03.554250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.554262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.554271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.554289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:03.554311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345741586:2446], now have 1 active actors on pipe
2025-10-02T09:31:03.554318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345742086:8239], now have 1 active actors on pipe
2025-10-02T09:31:03.554324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.554326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.554328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.554340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:03.554354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:03.554355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:03.554357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:03.554359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:03.554369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:03.554376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:03.554355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 973
2025-10-02T09:31:03.554357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 973
2025-10-02T09:31:03.554408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.554418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:03.554423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:03.554432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.554436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.554475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|106a6667-870f61bc-a8fe3335-c16b183e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:03.554485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.554489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.554491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:03.554501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.554515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:03.554530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.554683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.554693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.554706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.554774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 974 partition: 0 MaxSeqNo: 36 sessionId: src_id|106a6667-870f61bc-a8fe3335-c16b183e_0
2025-10-02T09:31:03.555117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2f57e-c3f15911-959cabdc-61677dd0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|106a6667-870f61bc-a8fe3335-c16b183e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:03.557693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Write session: try to update token
2025-10-02T09:31:03.557708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:03.564821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:03.564833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.564835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:03.564836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:03.564843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.564846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.564849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554565270207811:6965]
2025-10-02T09:31:03.564875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:03.564880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.564882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:03.564894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:03.564901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:03.564904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:03.565025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:03.575448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId: src_id|106a6667-870f61bc-a8fe3335-c16b183e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:03.577760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:03.623732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554565345742099:7829]
2025-10-02T09:31:03.623949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 973, pipe: [1:7556554565345742099:7829]
2025-10-02T09:31:03.687648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:03.688060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.688070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.688083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345742099:7829], now have 1 active actors on pipe
2025-10-02T09:31:03.688238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:03.688264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:03.688295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554565345742099:7829]
2025-10-02T09:31:03.688301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:03.688351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 974 reason: status is not ok: tablet will be restarted right now sessionId: src_id|106a6667-870f61bc-a8fe3335-c16b183e_0
2025-10-02T09:31:03.688479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 974 sessionId: src_id|106a6667-870f61bc-a8fe3335-c16b183e_0 is DEAD
2025-10-02T09:31:03.688667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:03.688677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Write session will restart in 0.005302s
2025-10-02T09:31:03.688696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Write session: Do CDS request
2025-10-02T09:31:03.688702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:03.695157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.695263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:03.695285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 975
2025-10-02T09:31:03.695393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.695425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:03.695434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:03.695437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:03.695781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 975 sessionId:  describe result for acl check
2025-10-02T09:31:03.695807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:03.695814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:03.695815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:03.695820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554565345742251:8244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:03.696225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554565345742251:8244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:03.698213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554565345742251:8244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:03.700527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554565345742251:8244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:03.700539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554565345742251:8244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:03.700545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554565345742251:8244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:03.700550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:03.703460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:03.704569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:03.704669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:03.704675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:03.704681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:03.704705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:03.704726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554565270208130:6968]
2025-10-02T09:31:03.705083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:03.705512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:03.705551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:03.705747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:03.705777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.705781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.705782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.705783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.705783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.705784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.705784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.705785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.705785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.705786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.705787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.705787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.705790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.705797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.705799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.705801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.705803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.705805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.705807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.705809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.705811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.705813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.705815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.705817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.705821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.705824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.705827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.705830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.705832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.705835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.705838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.705840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.705843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.705846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.705849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.705851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.705853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.705856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.705858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.705860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.705862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.705865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.705867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.705869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.705871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.705874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.705876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.705879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.705895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:03.713820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:03.715510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:03.715523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:03.715526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:03.715529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:03.715533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 974 [2:7556554565270208130:6968]
2025-10-02T09:31:03.715547Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:03.715561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:03.715566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.715568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.715570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.715582Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:03.715591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:03.715597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:03.715649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.715655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.715657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.715659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:03.715661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:03.715715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:03.715721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.715733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.715747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.715764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:03.715783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345742113:2446], now have 1 active actors on pipe
2025-10-02T09:31:03.715790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345742536:8244], now have 1 active actors on pipe
2025-10-02T09:31:03.715796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.715798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.715800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.715810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:03.715798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 974
2025-10-02T09:31:03.715833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 974
2025-10-02T09:31:03.715815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:03.715821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:03.715829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:03.715831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:03.715835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:03.715837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:03.715853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.715855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:03.715857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:03.715864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.715866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.715892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:03.715900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.715903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.715904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:03.715909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.715915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:03.715929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.716050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.716055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.716063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.716118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 975 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0
2025-10-02T09:31:03.716355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106a6667-870f61bc-a8fe3335-c16b183e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:03.718957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Write session: try to update token
2025-10-02T09:31:03.718974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:03.725984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:03.725998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.726001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:03.726003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:03.726010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.726015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.726019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554565270208125:6968]
2025-10-02T09:31:03.726051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:03.726057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:03.726061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.726062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:03.726063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:03.726065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:03.726184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:03.732435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId: src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:03.734710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:03.788573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554565345742638:7829]
2025-10-02T09:31:03.788785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 974, pipe: [1:7556554565345742638:7829]
2025-10-02T09:31:03.846279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:03.846848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.846857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.846871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345742638:7829], now have 1 active actors on pipe
2025-10-02T09:31:03.847027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:03.847056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:03.847102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:03.847140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554565345742638:7829]
2025-10-02T09:31:03.847167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 975 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0
2025-10-02T09:31:03.847327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 975 sessionId: src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0 is DEAD
2025-10-02T09:31:03.847469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:03.847478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Write session will restart in 0.005132s
2025-10-02T09:31:03.847495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Write session: Do CDS request
2025-10-02T09:31:03.847498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:03.853154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.853270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:03.853283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 976
2025-10-02T09:31:03.853394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:03.853421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:03.853430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:03.853433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:03.853765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 976 sessionId:  describe result for acl check
2025-10-02T09:31:03.853797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:03.853803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:03.853804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:03.853809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554565345742720:8249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:03.854259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554565345742720:8249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:03.855963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554565345742720:8249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:03.858215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554565345742720:8249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:03.858226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554565345742720:8249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:03.858229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554565345742720:8249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:03.858232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:03.862174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:03.863593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:03.863701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:03.863708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:03.863713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:03.863741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:03.863763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554565270208433:6970]
2025-10-02T09:31:03.864118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:03.864324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:03.864352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:03.864534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:03.864564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.864567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.864568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.864568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.864569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.864570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.864570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.864571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.864571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.864571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.864572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.864572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.864576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.864582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.864584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.864586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.864588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.864590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.864592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.864594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.864596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.864598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.864600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.864602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.864605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.864609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:03.864615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.864618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:03.864620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.864623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:03.864625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.864628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:03.864630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.864633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:03.864635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.864637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:03.864639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.864642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:03.864644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.864647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:03.864649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.864652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:03.864654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.864657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.864660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.864662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.864665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.864667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.864684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:03.872110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:03.873718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:03.873728Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:03.873729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:03.873731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:03.873735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 975 [2:7556554565270208433:6970]
2025-10-02T09:31:03.873745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:03.873755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:03.873757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.873758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.873759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.873769Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:03.873772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:03.873777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:03.873809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.873814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.873816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.873818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:03.873819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:03.873858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:03.873863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.873869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:03.873874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:03.873884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:03.873904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345743004:8249], now have 1 active actors on pipe
2025-10-02T09:31:03.873910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345742639:2446], now have 1 active actors on pipe
2025-10-02T09:31:03.873915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.873917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.873918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.873930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:03.873940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:03.873942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:03.873945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:03.873946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:03.873955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:03.873957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:03.873975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.873985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:03.873995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:03.873978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 975
2025-10-02T09:31:03.873995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 975
2025-10-02T09:31:03.874015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.874022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.874043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:03.874053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:03.874056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:03.874057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:03.874064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:03.874072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:03.874085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.874196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.874202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.874210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:03.874271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 976 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0
2025-10-02T09:31:03.874518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a22ae13-6ea66953-ab671ca0-7a1c6f1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:03.876817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Write session: try to update token
2025-10-02T09:31:03.876827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:03.883071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:03.883085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.883091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.883120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:03.883157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:03.883731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:03.884086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:03.884194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:03.884302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:03.884460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:03.884486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:03.889010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId: src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:03.891125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:03.891746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:03.891758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:03.891775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:03.891777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:03.891780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:03.891781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:03.891788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.891792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.891796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554565270208428:6970]
2025-10-02T09:31:03.891830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:03.891835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:03.891837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:03.891838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:03.891840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:03.891844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:03.892002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:03.947309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554565345743161:7829]
2025-10-02T09:31:03.947608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 975, pipe: [1:7556554565345743161:7829]
2025-10-02T09:31:04.015475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.015915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:04.015945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554565345743161:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.016055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:04.016131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554565345743161:7829]
2025-10-02T09:31:04.016140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:04.016142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:04.016157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.016206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 976 reason: error at write: Disconnected sessionId: src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0
2025-10-02T09:31:04.016345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 976 sessionId: src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0 is DEAD
2025-10-02T09:31:04.016482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:04.016491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Write session will restart in 0.008852s
2025-10-02T09:31:04.016515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Write session: Do CDS request
2025-10-02T09:31:04.016519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.026232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.026305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.026318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 977
2025-10-02T09:31:04.026427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.026453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.026461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.026465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.026794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 977 sessionId:  describe result for acl check
2025-10-02T09:31:04.026822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.026828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.026829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.026833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640710780:8253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.027289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640710780:8253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.029077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640710780:8253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.031044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.031216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640710780:8253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.031229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640710780:8253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.031231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640710780:8253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.031237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.032393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.032529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.032537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.032567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.032609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.032640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176045:6973]
2025-10-02T09:31:04.033045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.033271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.033303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.033498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.033527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.033531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.033531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.033532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.033533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.033533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.033534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.033534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.033535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.033535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.033536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.033536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.033539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.033546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.033548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.033550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.033552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.033554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.033556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.033558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.033560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.033562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.033564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.033566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.033570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.033574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.033578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.033580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.033582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.033585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.033587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.033590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.033596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.033598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.033600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.033603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.033608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.033611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.033613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.033616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.033618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.033624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.033626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.033629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.033631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.033634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.033639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.033642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.033659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.041377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.043082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.043092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.043093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.043095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.043099Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 976 [2:7556554569565176045:6973]
2025-10-02T09:31:04.043109Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.043120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.043122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.043124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.043125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.043135Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.043139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.043144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.043177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.043182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.043183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.043185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.043187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.043226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.043231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.043238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.043244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.043256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.043274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.043279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.043281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.043288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.043296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.043303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640710458:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.043305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.043308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.043310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.043322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.043329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.043333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640710969:8253], now have 1 active actors on pipe
2025-10-02T09:31:04.043362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.043371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.043375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.043357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 976
2025-10-02T09:31:04.043383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 976
2025-10-02T09:31:04.043402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.043409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.043426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.043434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.043436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.043440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.043445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.043451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.043463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.043583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.043591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.043601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.043668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 977 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0
2025-10-02T09:31:04.043931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c84feb1-60fdb86c-2d78ca3d-3640accf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.046131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Write session: try to update token
2025-10-02T09:31:04.046143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.052856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.052867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.052868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.052869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.052874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.052877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.052879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176034:6973]
2025-10-02T09:31:04.052904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.052906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.052909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.052911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.052911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.052912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.053030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.056725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId: src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.058633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:04.116250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554569640710982:7829]
2025-10-02T09:31:04.116488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 976, pipe: [1:7556554569640710982:7829]
2025-10-02T09:31:04.170796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.171225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.171236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.171261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640710982:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.171469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:04.171469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554569640710982:7829]
2025-10-02T09:31:04.171470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.171499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:04.171501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:04.171545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 977 reason: error at write: Disconnected sessionId: src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0
2025-10-02T09:31:04.171687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 977 sessionId: src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0 is DEAD
2025-10-02T09:31:04.171832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:04.171840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Write session will restart in 0.005034s
2025-10-02T09:31:04.171857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Write session: Do CDS request
2025-10-02T09:31:04.171861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.177219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.178155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.178302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.178314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 978
2025-10-02T09:31:04.178392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.178412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.178418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.178421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.178580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.178687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.178694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.178700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.178709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 978 sessionId:  describe result for acl check
2025-10-02T09:31:04.178728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.178736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.178742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.178743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.178748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640711005:8258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.178751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176100:6975]
2025-10-02T09:31:04.179114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.179153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640711005:8258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.179318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.179353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.179542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.179572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.179577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.179578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.179579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.179579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.179580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.179580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.179581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.179582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.179582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.179583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.179583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.179588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.179593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.179595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.179597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.179599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.179601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.179603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.179605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.179607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.179609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.179611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.179613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.179617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.179620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.179623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.179626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.179629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.179632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.179634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.179637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.179640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.179642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.179645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.179647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.179650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.179652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.179654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.179657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.179659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.179663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.179665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.179669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.179671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.179673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.179675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.179678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.179695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.180691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640711005:8258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.184974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640711005:8258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.184984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640711005:8258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.184986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640711005:8258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.184990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.187167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.188850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.188860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.188861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.188864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.188867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 977 [2:7556554569565176100:6975]
2025-10-02T09:31:04.188875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.188886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.188887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.188889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.188890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.188900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.188903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.188911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.188954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.188960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.188962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.188964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.188966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.189018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.189024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.189034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.189048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.189065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.189083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711044:8258], now have 1 active actors on pipe
2025-10-02T09:31:04.189090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640710983:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.189079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 977
2025-10-02T09:31:04.189092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 977
2025-10-02T09:31:04.189095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.189100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.189101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.189108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.189112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.189114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.189115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.189123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.189135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.189140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.189151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.189156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.189180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.189188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.189195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.189200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.189205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.189209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.189213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.189218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.189226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.189249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.189338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.189345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.189354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.189399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 978 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0
2025-10-02T09:31:04.189626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f111ca-1045d8bc-81b23f49-8d001a4b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.191775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Write session: try to update token
2025-10-02T09:31:04.191785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.198645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.198660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.198662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.198663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.198669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.198671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.198674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176095:6975]
2025-10-02T09:31:04.198698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.198703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.198702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.198704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.198706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.198709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.198831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.202550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId: src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.204572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:04.271397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554569640711052:7829]
2025-10-02T09:31:04.271597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 977, pipe: [1:7556554569640711052:7829]
2025-10-02T09:31:04.313026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.313250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.313259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.313286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711052:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.313459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:04.313519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554569640711052:7829]
2025-10-02T09:31:04.313528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:04.313547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.313596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 978 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0
2025-10-02T09:31:04.313744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 978 sessionId: src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0 is DEAD
2025-10-02T09:31:04.313864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:04.313873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Write session will restart in 0.006120s
2025-10-02T09:31:04.313887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Write session: Do CDS request
2025-10-02T09:31:04.313893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.319014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.320694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.320796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.320813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.320820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.320849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.320874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176159:6978]
2025-10-02T09:31:04.321133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.321220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.321219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.321231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 979
2025-10-02T09:31:04.321333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.321353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.321359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.321362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.321442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.321467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.321649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.321646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 979 sessionId:  describe result for acl check
2025-10-02T09:31:04.321668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.321669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.321670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.321673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640711075:8262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.321679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.321683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.321684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.321684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.321687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.321687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.321688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.321689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.321689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.321689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.321690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.321691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.321693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.321700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.321702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.321704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.321706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.321708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.321710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.321711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.321713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.321715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.321717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.321719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.321723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.321727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.321730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.321733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.321735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.321738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.321740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.321742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.321745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.321747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.321750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.321753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.321756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.321758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.321760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.321762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.321765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.321767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.321769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.321771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.321774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.321777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.321778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.321781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.321799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.322068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640711075:8262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.323477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640711075:8262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.327100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640711075:8262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.327109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640711075:8262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.327111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640711075:8262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.327115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.329305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.330672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.330682Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.330683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.330686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.330689Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 978 [2:7556554569565176159:6978]
2025-10-02T09:31:04.330698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.330709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.330714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.330715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.330717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.330727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.330732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.330737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.330767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.330771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.330772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.330774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.330775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.330822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.330829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.330838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.330851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.330868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.330885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711053:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.330892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711112:8262], now have 1 active actors on pipe
2025-10-02T09:31:04.330896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.330900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.330901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.330909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.330930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.330933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.330937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.330939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.330945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.330947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.330967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.330976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.330980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.330977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 978
2025-10-02T09:31:04.330983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 978
2025-10-02T09:31:04.331029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.331036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.331054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.331063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.331069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.331071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.331078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.331089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.331101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.331200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.331205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.331215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.331275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 979 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0
2025-10-02T09:31:04.331523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8d9acc-8e103eb2-adccb784-fa554284_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.333724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Write session: try to update token
2025-10-02T09:31:04.333734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.340236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:04.340251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.340257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.340283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:04.340284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:04.340446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:04.340557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.340661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.340770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.340947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:04.340976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:04.344545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId: src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.346445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:04.346572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.346584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.346601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:04.346662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:04.348770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.348783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.348784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.348786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.348790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.348794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.348797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176154:6978]
2025-10-02T09:31:04.348840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.348840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.348843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.348846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.348851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.348853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.348968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.413732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554569640711120:7829]
2025-10-02T09:31:04.413972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 978, pipe: [1:7556554569640711120:7829]
2025-10-02T09:31:04.473753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.479976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.479998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.480127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.480176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.480227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.480276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.480313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.480323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.480377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.480424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.480475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.480524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.480560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.480565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.480614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.480661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.480714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.480832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.480868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.480875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.480927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.480977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.481024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.481074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.481111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.481116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.481165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.481212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.481262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.481315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.481351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.481356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.481405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.481452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.481502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.481551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.481602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.481606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.481655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.481731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.481794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.481844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.481890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.481895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.481945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.481992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.482041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.482117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.482163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.482168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.482215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.482262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.482309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.482355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.482389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.482394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.482442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.482501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.482547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.482597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.482645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.482649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.482680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711120:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.482937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.482953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:04.482957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:04.482980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 979 reason: error at write: Disconnected sessionId: src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0
2025-10-02T09:31:04.482985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554569640711120:7829]
2025-10-02T09:31:04.483111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 979 sessionId: src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0 is DEAD
2025-10-02T09:31:04.483236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:04.483243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Write session will restart in 0.005576s
2025-10-02T09:31:04.483258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Write session: Do CDS request
2025-10-02T09:31:04.483262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.483439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:04.488181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.489615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.489756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.489765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.489773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.489819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.489848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176230:6980]
2025-10-02T09:31:04.490117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.490228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.490237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 980
2025-10-02T09:31:04.490327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.490345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.490350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.490353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.490397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.490619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 980 sessionId:  describe result for acl check
2025-10-02T09:31:04.490644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.490649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.490650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.490653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640711145:8266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.490658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.490695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.490983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.491029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.491035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.491036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.491037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.491038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.491039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.491040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.491041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.491042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.491043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.491044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.491045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.491050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.491059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.491063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.491067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.491071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.491075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.491079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.491082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.491086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.491090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.491094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.491098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.491104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.491110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.491120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.491127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.491138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.491146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.491150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.491157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.491161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.491167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.491172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.491181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.491185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.491193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.491197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.491205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.491213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.491217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.491222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.491230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.491235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.491243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.491251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.491256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.491292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.491310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640711145:8266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.492661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640711145:8266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.496847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640711145:8266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.496861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640711145:8266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.496864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640711145:8266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.496870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.499231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.500892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.500904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.500905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.500909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.500913Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 979 [2:7556554569565176230:6980]
2025-10-02T09:31:04.501003Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.501023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.501029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.501033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.501035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.501061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.501075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.501080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.501125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.501131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.501132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.501135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.501138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.501187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.501193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.501203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.501215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.501233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.501248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.501251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.501252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.501258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.501268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.501271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711121:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.501271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.501273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.501274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711181:8266], now have 1 active actors on pipe
2025-10-02T09:31:04.501281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.501291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.501295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.501319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.501330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.501327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 979
2025-10-02T09:31:04.501350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.501362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 979
2025-10-02T09:31:04.501454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.501463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.501481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.501491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.501496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.501498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.501506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.501518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.501534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.501803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.501815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.501834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.501930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 980 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0
2025-10-02T09:31:04.502263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b42e1be-358f53f0-bbdb8198-ac98ab0a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.504715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Write session: try to update token
2025-10-02T09:31:04.504729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.510997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:04.511012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.511019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.511052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:04.511056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:04.511202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:04.511327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.511454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.511582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.511783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:04.511816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:04.517450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId: src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.520149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:04.520326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.520341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.520352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.520354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.520356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.520357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.520362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.520364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.520367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176216:6980]
2025-10-02T09:31:04.520393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.520398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.520399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.520401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.520403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.520404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.520511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.583213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554569640711212:7829]
2025-10-02T09:31:04.583424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 979, pipe: [1:7556554569640711212:7829]
2025-10-02T09:31:04.643570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.644458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:04.644485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711212:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.644589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:04.644655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554569640711212:7829]
2025-10-02T09:31:04.644670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:04.644673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:04.644683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.644735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 980 reason: error at write: Disconnected sessionId: src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0
2025-10-02T09:31:04.644881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 980 sessionId: src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0 is DEAD
2025-10-02T09:31:04.645021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:04.645029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Write session will restart in 0.008330s
2025-10-02T09:31:04.645043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Write session: Do CDS request
2025-10-02T09:31:04.645049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.650040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.651618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.651733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.651740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.651745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.651773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.651802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176325:6995]
2025-10-02T09:31:04.652156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.652376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.652405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.652610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.652643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.652647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.652648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.652648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.652649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.652650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.652650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.652651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.652652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.652652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.652653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.652653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.652657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.652664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.652666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.652669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.652671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.652673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.652675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.652678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.652681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.652683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.652685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.652687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.652691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.652696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.652699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.652702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.652705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.652708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.652710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.652713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.652715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.652719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.652721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.652724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.652727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.652729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.652731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.652734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.652737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.652739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.652741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.652744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.652746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.652749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.652751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.652754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.652771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.654204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.654283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.654307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 981
2025-10-02T09:31:04.654397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.654420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.654423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.654425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.654767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 981 sessionId:  describe result for acl check
2025-10-02T09:31:04.654797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.654803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.654804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.654810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640711239:8277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.655242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640711239:8277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.656915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640711239:8277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.660492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640711239:8277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.660502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640711239:8277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.660504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640711239:8277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.660509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.660614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.661979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.661992Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.661994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.661997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.662001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 980 [2:7556554569565176325:6995]
2025-10-02T09:31:04.662009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.662025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.662026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.662028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.662029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.662039Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.662042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.662046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.662082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.662087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.662088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.662090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.662092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.662132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.662138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.662144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.662149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.662161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.662176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711273:8277], now have 1 active actors on pipe
2025-10-02T09:31:04.662182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711213:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.662187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.662189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.662191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.662201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.662212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.662217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.662219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.662220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.662228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.662234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.662225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 980
2025-10-02T09:31:04.662237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 980
2025-10-02T09:31:04.662255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.662261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.662262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.662273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.662280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.662311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3076a664-b815a26a-188f4d5d-871b89cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.662318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.662321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.662322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.662327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.662336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.662350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.662455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.662461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.662469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.662527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 981 partition: 0 MaxSeqNo: 36 sessionId: src_id|3076a664-b815a26a-188f4d5d-871b89cc_0
2025-10-02T09:31:04.662762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab53611b-9581ec5f-4279b05b-b5a2920e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3076a664-b815a26a-188f4d5d-871b89cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.665020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Write session: try to update token
2025-10-02T09:31:04.665031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.671909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.671922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.671924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.671925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.671930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.671933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.671936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176320:6995]
2025-10-02T09:31:04.671964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.671970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.671974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.671984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.671996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.672000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.672098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.676222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId: src_id|3076a664-b815a26a-188f4d5d-871b89cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.678496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:04.745020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554569640711294:7829]
2025-10-02T09:31:04.745252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 980, pipe: [1:7556554569640711294:7829]
2025-10-02T09:31:04.791180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.791487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.791495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.791520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711294:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.791659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:04.791709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:04.791712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554569640711294:7829]
2025-10-02T09:31:04.791724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.791724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:04.791771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 981 reason: error at write: Disconnected sessionId: src_id|3076a664-b815a26a-188f4d5d-871b89cc_0
2025-10-02T09:31:04.791946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 981 sessionId: src_id|3076a664-b815a26a-188f4d5d-871b89cc_0 is DEAD
2025-10-02T09:31:04.792091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:04.792099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Write session will restart in 0.005295s
2025-10-02T09:31:04.792112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Write session: Do CDS request
2025-10-02T09:31:04.792116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.796762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.798139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.798211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.798314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.798326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 982
2025-10-02T09:31:04.798337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.798347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.798355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.798399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.798418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.798434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176386:6997]
2025-10-02T09:31:04.798443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.798451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.798454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.798765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 982 sessionId:  describe result for acl check
2025-10-02T09:31:04.798792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.798797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.798798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.798801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640711323:8283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.798876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.799058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.799085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.799166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640711323:8283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.799308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.799354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.799359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.799360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.799361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.799362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.799363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.799364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.799365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.799365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.799366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.799367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.799370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.799374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.799382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.799385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.799388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.799391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.799394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.799401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.799404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.799410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.799414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.799420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.799423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.799433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.799442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.799451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.799459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.799467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.799473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.799481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.799487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.799489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.799492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.799494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.799501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.799504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.799509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.799511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.799514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.799517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.799519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.799524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.799528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.799533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.799535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.799537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.799540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.799559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.800691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640711323:8283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.804968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640711323:8283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.804978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640711323:8283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.804980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640711323:8283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.804984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.807331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.808763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.808774Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.808776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.808778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.808781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 981 [2:7556554569565176386:6997]
2025-10-02T09:31:04.808789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.808812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.808814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.808816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.808817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.808827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.808831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.808835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.808867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.808873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.808875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.808877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.808879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.808920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.808925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.808932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.808938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.808950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.808961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.808965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.808966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.808971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.808977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.808979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.808984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.808985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.808987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.808988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.808995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711362:8283], now have 1 active actors on pipe
2025-10-02T09:31:04.808997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711300:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.809014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.809023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.809029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.809051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 981
2025-10-02T09:31:04.809053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 981
2025-10-02T09:31:04.809117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.809123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.809139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e914d847-1be45550-a755917-411a1ba9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.809146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.809151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.809155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.809161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.809166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.809175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.809289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.809294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.809302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.809356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 982 partition: 0 MaxSeqNo: 36 sessionId: src_id|e914d847-1be45550-a755917-411a1ba9_0
2025-10-02T09:31:04.809546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3076a664-b815a26a-188f4d5d-871b89cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e914d847-1be45550-a755917-411a1ba9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.811757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Write session: try to update token
2025-10-02T09:31:04.811767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.818410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:04.818425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.818437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.818466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:04.818468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:04.818621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:04.818734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.818845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.818974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:04.819131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:04.819155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:04.822695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId: src_id|e914d847-1be45550-a755917-411a1ba9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.824782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:04.824940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.824952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.824971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:04.825033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:04.828512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.828528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.828530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.828532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.828540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.828544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.828549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176381:6997]
2025-10-02T09:31:04.828582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.828583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.828590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.828591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.828592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.828594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.828764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.891948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554569640711373:7829]
2025-10-02T09:31:04.892117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 981, pipe: [1:7556554569640711373:7829]
2025-10-02T09:31:04.945455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:04.951815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.951833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.951955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.952002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.952057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.952108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.952144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.952153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.952212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.952260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.952310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.952364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.952401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.952406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.952457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.952506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.952557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.952609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.952648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.952653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.952703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.952752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.952813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.952867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.952904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.952909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.952963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.953012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.953064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.953118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.953154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.953159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.953212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.953259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.953340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.953406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.953447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.953451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.953506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.953566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.953620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.953672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.953708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.953713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.953766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.953813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.953861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.953909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.953944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.953949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.954049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.954115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.954169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.954215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.954248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.954253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.954299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:04.954346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:04.954395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:04.954444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:04.954479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:04.954484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:04.954513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711373:7829], now have 1 active actors on pipe
2025-10-02T09:31:04.954667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:04.954670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:04.954673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:04.954697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 982 reason: error at write: Disconnected sessionId: src_id|e914d847-1be45550-a755917-411a1ba9_0
2025-10-02T09:31:04.954856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 982 sessionId: src_id|e914d847-1be45550-a755917-411a1ba9_0 is DEAD
2025-10-02T09:31:04.955002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:04.955010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Write session will restart in 0.006663s
2025-10-02T09:31:04.955001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554569640711373:7829]
2025-10-02T09:31:04.955029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Write session: Do CDS request
2025-10-02T09:31:04.955034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:04.955274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:04.959804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:04.961091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:04.961201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:04.961208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:04.961216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:04.961254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:04.961277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554569565176450:7000]
2025-10-02T09:31:04.961613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:04.961771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:04.961794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:04.961966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:04.961994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.961997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.962000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.962000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.962001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.962001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.962002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.962002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.962003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.962003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.962004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.962004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.962007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.962014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.962015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.962017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.962019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.962021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.962023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.962025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.962027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.962029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.962031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.962033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.962037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.962040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:04.962044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.962046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:04.962048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.962051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:04.962053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.962056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:04.962058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.962061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:04.962063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.962065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:04.962067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.962069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:04.962071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.962074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:04.962076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.962078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:04.962080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.962085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.962088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.962091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.962093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.962095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.962113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:04.962127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.962249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:04.962259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 983
2025-10-02T09:31:04.962358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:04.962377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:04.962383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:04.962386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:04.962655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 983 sessionId:  describe result for acl check
2025-10-02T09:31:04.962680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:04.962686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:04.962687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:04.962691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554569640711405:8287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:04.963034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554569640711405:8287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:04.964899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554569640711405:8287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:04.968936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554569640711405:8287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:04.968946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554569640711405:8287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:04.968948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554569640711405:8287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:04.968952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:04.969803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:04.971188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:04.971198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:04.971199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:04.971201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:04.971205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 982 [2:7556554569565176450:7000]
2025-10-02T09:31:04.971212Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:04.971222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:04.971225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.971227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.971228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.971237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:04.971243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:04.971247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:04.971279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.971284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.971285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.971286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:04.971288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:04.971325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:04.971332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.971338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:04.971343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:04.971351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:04.971362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711377:2446], now have 1 active actors on pipe
2025-10-02T09:31:04.971368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554569640711444:8287], now have 1 active actors on pipe
2025-10-02T09:31:04.971373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.971378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.971380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.971390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:04.971403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:04.971410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:04.971406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 982
2025-10-02T09:31:04.971416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 982
2025-10-02T09:31:04.971412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:04.971414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:04.971418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:04.971420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:04.971437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.971440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:04.971441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:04.971451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.971454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.971486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:04.971493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:04.971496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:04.971497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:04.971503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:04.971512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:04.971523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.971652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:04.971658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:04.971665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:04.971727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 983 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0
2025-10-02T09:31:04.971911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e914d847-1be45550-a755917-411a1ba9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:04.974108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Write session: try to update token
2025-10-02T09:31:04.974119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:04.980896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:04.980910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:04.980912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:04.980914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:04.980919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.980922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.980925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554569565176445:7000]
2025-10-02T09:31:04.980949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:04.980950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:04.980952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:04.980953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:04.980954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:04.980957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:04.981060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:04.984814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId: src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:04.986787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.055257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935678753:7829]
2025-10-02T09:31:05.055398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 982, pipe: [1:7556554573935678753:7829]
2025-10-02T09:31:05.096532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.097023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.097033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.097059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678753:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.097190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.097272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.097319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:05.097388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 983 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0
2025-10-02T09:31:05.097411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935678753:7829]
2025-10-02T09:31:05.097533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 983 sessionId: src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0 is DEAD
2025-10-02T09:31:05.097698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:05.097709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Write session will restart in 0.007316s
2025-10-02T09:31:05.097732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Write session: Do CDS request
2025-10-02T09:31:05.097738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.102664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.104010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.104118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.104125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.104131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.104158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.104184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860143809:7002]
2025-10-02T09:31:05.104535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.104719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.104744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.104933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.104965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.104969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.104970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.104971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.104971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.104972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.104973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.104973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.104974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.104974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.104975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.104976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.104978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.104985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.104988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.104990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.104992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.104994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.104996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.104999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.105001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.105003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.105005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.105007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.105011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.105015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.105019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.105022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.105024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.105027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.105029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.105032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.105034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.105040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.105043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.105046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.105049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.105055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.105063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.105067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.105075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.105084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.105091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.105094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.105096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.105098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.105100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.105105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.105122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.106159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.106257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.106268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 984
2025-10-02T09:31:05.106367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.106386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.106398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.106404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.106728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 984 sessionId:  describe result for acl check
2025-10-02T09:31:05.106754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.106758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.106760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.106763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935678784:8291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.107184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935678784:8291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.108478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935678784:8291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.112331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935678784:8291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.112342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935678784:8291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.112344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935678784:8291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.112349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.112909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:05.114264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:05.114276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:05.114277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:05.114279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:05.114283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 983 [2:7556554573860143809:7002]
2025-10-02T09:31:05.114291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:05.114302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:05.114303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.114307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.114308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.114317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:05.114324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:05.114328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:05.114362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.114367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.114368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.114369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:05.114371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:05.114409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:05.114416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.114423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.114428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.114436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:05.114448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678819:8291], now have 1 active actors on pipe
2025-10-02T09:31:05.114450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678754:2446], now have 1 active actors on pipe
2025-10-02T09:31:05.114453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.114455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.114456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.114465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:05.114475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:05.114474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 983
2025-10-02T09:31:05.114478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:05.114490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 983
2025-10-02T09:31:05.114483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:05.114484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:05.114486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:05.114488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:05.114499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.114502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:05.114509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:05.114511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.114513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.114539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74cd4530-4322edb-7c1696da-a020ff85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:05.114547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.114549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.114551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:05.114556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.114561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:05.114570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.114668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.114674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.114683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.114727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 984 partition: 0 MaxSeqNo: 36 sessionId: src_id|74cd4530-4322edb-7c1696da-a020ff85_0
2025-10-02T09:31:05.114948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee4e77cc-c70c3f3f-10c7934-d57958c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|74cd4530-4322edb-7c1696da-a020ff85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:05.117104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Write session: try to update token
2025-10-02T09:31:05.117113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:05.124223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:05.124236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:05.124237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:05.124239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:05.124244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.124247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.124249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860143804:7002]
2025-10-02T09:31:05.124273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:05.124278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.124279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:05.124279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:05.124285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:05.124287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:05.124395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:05.127491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId: src_id|74cd4530-4322edb-7c1696da-a020ff85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:05.129847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.197620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935678829:7829]
2025-10-02T09:31:05.197822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 983, pipe: [1:7556554573935678829:7829]
2025-10-02T09:31:05.255030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.255318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.255330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.255361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678829:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.255507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.255548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:05.255554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935678829:7829]
2025-10-02T09:31:05.255562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:05.255577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.255610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 984 reason: error at write: Disconnected sessionId: src_id|74cd4530-4322edb-7c1696da-a020ff85_0
2025-10-02T09:31:05.255744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 984 sessionId: src_id|74cd4530-4322edb-7c1696da-a020ff85_0 is DEAD
2025-10-02T09:31:05.255871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:05.255878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Write session will restart in 0.007574s
2025-10-02T09:31:05.255894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Write session: Do CDS request
2025-10-02T09:31:05.255898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.260775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.262385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.262493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.262499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.262505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.262531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.262557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860143875:7005]
2025-10-02T09:31:05.262906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.263077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.263100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.263279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.263308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.263312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.263313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.263313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.263314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.263315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.263315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.263316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.263316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.263317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.263317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.263318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.263323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.263330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.263332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.263334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.263336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.263338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.263340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.263342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.263344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.263346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.263348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.263350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.263354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.263359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.263362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.263365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.263367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.263369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.263372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.263374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.263377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.263379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.263381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.263383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.263385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.263388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.263390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.263393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.263395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.263398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.263400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.263403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.263405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.263408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.263410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.263412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.263430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.264222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.264340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.264352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 985
2025-10-02T09:31:05.264569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.264590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.264597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.264599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.264944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 985 sessionId:  describe result for acl check
2025-10-02T09:31:05.264970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.264974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.264975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.264978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935678860:8296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.265335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935678860:8296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.266642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935678860:8296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.270378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935678860:8296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.270388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935678860:8296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.270392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935678860:8296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.270397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.270888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:05.272287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:05.272297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:05.272299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:05.272301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:05.272306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 984 [2:7556554573860143875:7005]
2025-10-02T09:31:05.272314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:05.272326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:05.272331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.272334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.272336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.272345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:05.272351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:05.272356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:05.272389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.272393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.272394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.272395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:05.272397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:05.272435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:05.272440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.272446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.272452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.272463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:05.272478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678830:2446], now have 1 active actors on pipe
2025-10-02T09:31:05.272483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678895:8296], now have 1 active actors on pipe
2025-10-02T09:31:05.272486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.272488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.272489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.272496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:05.272505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:05.272508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:05.272510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:05.272511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:05.272516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:05.272517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:05.272514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 984
2025-10-02T09:31:05.272518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 984
2025-10-02T09:31:05.272532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.272537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:05.272539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:05.272547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.272551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.272578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:05.272584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.272586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.272587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:05.272593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.272601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:05.272613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.272705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.272710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.272717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.272763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 985 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0
2025-10-02T09:31:05.273016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd4530-4322edb-7c1696da-a020ff85_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:05.275253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Write session: try to update token
2025-10-02T09:31:05.275264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:05.281938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:05.281948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:05.281950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:05.281951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:05.281956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.281959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.281961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860143870:7005]
2025-10-02T09:31:05.281985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:05.281987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:05.281989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.281990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:05.281990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:05.281993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:05.282111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:05.286567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId: src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:05.288607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.353240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:31:05.353261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-02T09:31:05.355811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935678906:7829]
2025-10-02T09:31:05.355944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 984, pipe: [1:7556554573935678906:7829]
2025-10-02T09:31:05.400719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.401221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.401230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.401267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678906:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.401421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.401452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.401469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:05.401473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-02T09:31:05.401502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935678906:7829]
2025-10-02T09:31:05.401538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 985 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0
2025-10-02T09:31:05.401703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 985 sessionId: src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0 is DEAD
2025-10-02T09:31:05.401830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:05.401836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Write session will restart in 0.007827s
2025-10-02T09:31:05.401850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Write session: Do CDS request
2025-10-02T09:31:05.401854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.406883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.408186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.408290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.408298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.408303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.408330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.408355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860143941:7008]
2025-10-02T09:31:05.408705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.408894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.408918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.409096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.409128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.409131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.409132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.409132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.409133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.409133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.409134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.409134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.409135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.409135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.409136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.409137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.409139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.409147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.409149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.409151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.409153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.409155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.409157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.409159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.409161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.409163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.409165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.409167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.409171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.409175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.409179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.409182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.409184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.409186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.409189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.409191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.409193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.409196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.409198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.409202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.409204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.409206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.409208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.409211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.409213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.409219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.409221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.409224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.409226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.409232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.409234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.409237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.409254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.410183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.410276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.410287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 986
2025-10-02T09:31:05.410378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.410397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.410404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.410406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.410734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 986 sessionId:  describe result for acl check
2025-10-02T09:31:05.410759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.410764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.410765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.410768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935678938:8300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.411129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935678938:8300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.412571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935678938:8300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.416743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935678938:8300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.416756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935678938:8300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.416758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935678938:8300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.416762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.417227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:05.418754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:05.418766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:05.418767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:05.418769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:05.418774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 985 [2:7556554573860143941:7008]
2025-10-02T09:31:05.418781Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:05.418791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:05.418796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.418798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.418799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.418809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:05.418813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:05.418818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:05.418851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.418855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.418856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.418858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:05.418860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:05.418901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:05.418905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.418913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.418927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.418936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:05.418952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678973:8300], now have 1 active actors on pipe
2025-10-02T09:31:05.418957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678907:2446], now have 1 active actors on pipe
2025-10-02T09:31:05.418960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.418962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.418963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.418972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:05.418981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:05.418984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:05.418986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:05.418987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:05.418992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:05.418994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:05.419009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.419016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:05.419021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:05.419100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 985
2025-10-02T09:31:05.419117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 985
2025-10-02T09:31:05.419236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.419254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.419282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:05.419290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.419292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.419294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:05.419300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.419311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:05.419352Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:31:05.419372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.419480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.419486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.419494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.419498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 7 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:31:05.419522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:31:05.419547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 986 partition: 0 MaxSeqNo: 36 sessionId: src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0
2025-10-02T09:31:05.419773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c71f0f-87a999e9-ff65c8cb-92588846_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:05.421961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Write session: try to update token
2025-10-02T09:31:05.421971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:05.429144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:05.429157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:05.429159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:05.429160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:05.429165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.429168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.429171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860143936:7008]
2025-10-02T09:31:05.429197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:05.429200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:05.429202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.429203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:05.429204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:05.429206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:05.429311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:05.432588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId: src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:05.434716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.501742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935678983:7829]
2025-10-02T09:31:05.501957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 985, pipe: [1:7556554573935678983:7829]
2025-10-02T09:31:05.546236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.546452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.546461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.546486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935678983:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.546618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.546676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:05.546746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 986 reason: status is not ok: tablet will be restarted right now sessionId: src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0
2025-10-02T09:31:05.546908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 986 sessionId: src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0 is DEAD
2025-10-02T09:31:05.547038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.547048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:31:05.547049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:05.547070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Write session will restart in 0.008034s
2025-10-02T09:31:05.547068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935678983:7829]
2025-10-02T09:31:05.547084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Write session: Do CDS request
2025-10-02T09:31:05.547088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.551981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.553187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.553276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.553282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.553288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.553312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.553336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860144036:7021]
2025-10-02T09:31:05.553680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.553840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.553862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.554035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.554065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.554069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.554070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.554070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.554071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.554072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.554072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.554072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.554073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.554073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.554074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.554074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.554077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.554083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.554085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.554088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.554089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.554091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.554093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.554095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.554097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.554099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.554101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.554103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.554106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.554111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.554114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.554117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.554119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.554122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.554124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.554127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.554129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.554131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.554133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.554136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.554138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.554141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.554143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.554146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.554149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.554152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.554154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.554156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.554158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.554161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.554163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.554165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.554181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.556110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.556302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.556312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 987
2025-10-02T09:31:05.556384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.556402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.556408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.556410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.556630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 987 sessionId:  describe result for acl check
2025-10-02T09:31:05.556647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.556651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.556652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.556655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935679036:8310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.556965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935679036:8310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.558228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935679036:8310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.561420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935679036:8310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.561429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935679036:8310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.561431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935679036:8310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.561438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.561965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:05.563329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:05.563339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:05.563340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:05.563342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:05.563346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 986 [2:7556554573860144036:7021]
2025-10-02T09:31:05.563352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:05.563362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:05.563368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.563370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.563371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.563380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:05.563385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:05.563390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:05.563421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.563426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.563427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.563428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:05.563429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:05.563464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:05.563468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.563475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.563480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.563491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:05.563506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679067:8310], now have 1 active actors on pipe
2025-10-02T09:31:05.563511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679001:2446], now have 1 active actors on pipe
2025-10-02T09:31:05.563515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.563516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.563517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.563524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:05.563532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:05.563541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:05.563542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:05.563544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:05.563544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:05.563541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 986
2025-10-02T09:31:05.563545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:05.563558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.563560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:05.563564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:05.563568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 986
2025-10-02T09:31:05.563575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.563580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.563605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:05.563612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.563616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.563620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:05.563626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.563634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:05.563810Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:31:05.563828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.563949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 8 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:31:05.563961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.563967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.563976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.563972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:31:05.564031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 987 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0
2025-10-02T09:31:05.564251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36388409-d12d0812-2c4371cd-6a6b10e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:05.566477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Write session: try to update token
2025-10-02T09:31:05.566486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:05.573211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:05.573225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:05.573226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:05.573227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:05.573233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.573236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.573238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860144031:7021]
2025-10-02T09:31:05.573262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:05.573266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.573267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:05.573273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:05.573278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:05.573282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:05.573391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:05.577594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId: src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:05.579700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.647156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935679087:7829]
2025-10-02T09:31:05.647367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 986, pipe: [1:7556554573935679087:7829]
2025-10-02T09:31:05.689411Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.689701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.689711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.689735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679087:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.689859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.689886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935679087:7829]
2025-10-02T09:31:05.689908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.689926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:05.689989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 987 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0
2025-10-02T09:31:05.690141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 987 sessionId: src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0 is DEAD
2025-10-02T09:31:05.690239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:05.690248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Write session will restart in 0.008715s
2025-10-02T09:31:05.690264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Write session: Do CDS request
2025-10-02T09:31:05.690268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.694890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.696360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.696457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.696463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.696468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.696493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.696515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860144123:7027]
2025-10-02T09:31:05.696863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.697042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.697064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.697238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.697268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.697272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.697272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.697273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.697273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.697274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.697274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.697275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.697275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.697276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.697276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.697277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.697279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.697286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.697288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.697290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.697292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.697294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.697296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.697298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.697300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.697302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.697304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.697306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.697311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.697314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.697317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.697320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.697322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.697325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.697327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.697330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.697332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.697334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.697336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.697339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.697341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.697344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.697346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.697348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.697350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.697353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.697355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.697358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.697360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.697363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.697369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.697371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.697387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.700161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.700280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.700288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 988
2025-10-02T09:31:05.700369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.700387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.700394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.700396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.700652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 988 sessionId:  describe result for acl check
2025-10-02T09:31:05.700671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.700676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.700677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.700681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935679137:8316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.701036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935679137:8316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.702863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935679137:8316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.704746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:05.704905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935679137:8316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.704915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935679137:8316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.704917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935679137:8316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.704921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.706100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:05.706110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:05.706112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:05.706114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:05.706117Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 987 [2:7556554573860144123:7027]
2025-10-02T09:31:05.706124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:05.706135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:05.706136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.706138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.706139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.706147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:05.706150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:05.706154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:05.706185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.706191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.706192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.706193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:05.706195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:05.706231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:05.706236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.706242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.706248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.706256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:05.706270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679172:8316], now have 1 active actors on pipe
2025-10-02T09:31:05.706274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679104:2446], now have 1 active actors on pipe
2025-10-02T09:31:05.706277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.706279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.706280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.706287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:05.706295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:05.706298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:05.706300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:05.706301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:05.706306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:05.706307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:05.706295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 987
2025-10-02T09:31:05.706315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 987
2025-10-02T09:31:05.706321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.706326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:05.706328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:05.706338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.706343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.706370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:05.706377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.706379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.706381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:05.706386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.706391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:05.706401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.706495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.706500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.706507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.706560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 988 partition: 0 MaxSeqNo: 36 sessionId: src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0
2025-10-02T09:31:05.706776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b8110e-c635b254-6b4a185e-85df6f53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:05.709003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Write session: try to update token
2025-10-02T09:31:05.709013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:05.715911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:05.715924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:05.715926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:05.715927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:05.715941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.715944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.715946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860144118:7027]
2025-10-02T09:31:05.715969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:05.715973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.715973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:05.715975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:05.715979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:05.715981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:05.716092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:05.719829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId: src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:05.722026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.789976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935679184:7829]
2025-10-02T09:31:05.790174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 987, pipe: [1:7556554573935679184:7829]
2025-10-02T09:31:05.832025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.832616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.832630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.832662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679184:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.832857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.832887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935679184:7829]
2025-10-02T09:31:05.832917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.832919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:05.832922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:05.832977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 988 reason: error at write: Disconnected sessionId: src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0
2025-10-02T09:31:05.833142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 988 sessionId: src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0 is DEAD
2025-10-02T09:31:05.833275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:05.833283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Write session will restart in 0.005058s
2025-10-02T09:31:05.833302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Write session: Do CDS request
2025-10-02T09:31:05.833307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.838464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.839153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.839204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.839214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 989
2025-10-02T09:31:05.839322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.839344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.839350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.839353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.839708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 989 sessionId:  describe result for acl check
2025-10-02T09:31:05.839735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.839739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.839740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.839744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935679216:8321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.840088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.840200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935679216:8321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.840235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.840242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.840249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.840280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.840305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860144190:7029]
2025-10-02T09:31:05.840754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.840990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.841032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.841301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.841362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.841369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.841370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.841371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.841374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.841375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.841376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.841377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.841378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.841378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.841379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.841380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.841385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.841393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.841397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.841401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.841404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.841408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.841411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.841414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.841418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.841421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.841425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.841431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.841436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.841444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.841450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.841456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.841464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.841472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.841475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.841482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.841487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.841491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.841496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.841501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.841507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.841512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.841519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.841524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.841530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.841534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.841539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.841543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.841551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.841556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.841563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.841568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.841603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.841833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935679216:8321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.846656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935679216:8321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.846668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935679216:8321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.846671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935679216:8321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.846677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.849433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:05.851150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:05.851161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:05.851163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:05.851165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:05.851169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 988 [2:7556554573860144190:7029]
2025-10-02T09:31:05.851178Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:05.851192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:05.851194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.851196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.851197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.851207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:05.851210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:05.851214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:05.851253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.851258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.851259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.851261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:05.851262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:05.851307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:05.851313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.851324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.851334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.851349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:05.851362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679255:8321], now have 1 active actors on pipe
2025-10-02T09:31:05.851370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679185:2446], now have 1 active actors on pipe
2025-10-02T09:31:05.851375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.851377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.851378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.851390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:05.851404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:05.851405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:05.851408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:05.851410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:05.851420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:05.851422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:05.851447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.851453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:05.851455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:05.851437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 988
2025-10-02T09:31:05.851440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 988
2025-10-02T09:31:05.851471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.851479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.851507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5803b42e-faf53295-10faa0d1-46358854_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:05.851518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:05.851520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:05.851521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:05.851527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:05.851534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:05.851546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.851646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.851656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.851670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:05.851738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 989 partition: 0 MaxSeqNo: 36 sessionId: src_id|5803b42e-faf53295-10faa0d1-46358854_0
2025-10-02T09:31:05.852011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fe0593-8a9b5884-a6661d30-8e29bdd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5803b42e-faf53295-10faa0d1-46358854_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:05.854222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Write session: try to update token
2025-10-02T09:31:05.854235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:05.861805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:05.861820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:05.861821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:05.861822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:05.861828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.861831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.861833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860144185:7029]
2025-10-02T09:31:05.861858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:05.861862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.861863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:05.861870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:05.861875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:05.861879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:05.861974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:05.865810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId: src_id|5803b42e-faf53295-10faa0d1-46358854_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:05.868026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:05.932863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554573935679265:7829]
2025-10-02T09:31:05.933080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 988, pipe: [1:7556554573935679265:7829]
2025-10-02T09:31:05.982621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:05.982990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:05.983001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:05.983028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679265:7829], now have 1 active actors on pipe
2025-10-02T09:31:05.983224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:05.983228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:05.983239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554573935679265:7829]
2025-10-02T09:31:05.983261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:05.983263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:05.983315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 989 reason: error at write: Disconnected sessionId: src_id|5803b42e-faf53295-10faa0d1-46358854_0
2025-10-02T09:31:05.983480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 989 sessionId: src_id|5803b42e-faf53295-10faa0d1-46358854_0 is DEAD
2025-10-02T09:31:05.983596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:05.983605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Write session will restart in 0.009067s
2025-10-02T09:31:05.983622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Write session: Do CDS request
2025-10-02T09:31:05.983626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:05.988670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:05.990514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:05.990644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:05.990651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:05.990657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:05.990686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:05.990712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554573860144262:7032]
2025-10-02T09:31:05.991088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:05.991275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:05.991304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:05.991500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:05.991534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.991537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.991538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.991539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.991539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.991540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.991540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.991541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.991541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.991542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.991542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.991543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.991546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.991554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.991556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.991558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.991560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.991562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.991564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.991566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.991568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.991570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.991572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.991574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.991579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.991583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:05.991586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.991589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:05.991592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.991595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:05.991597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.991600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:05.991602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.991605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:05.991607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.991610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:05.991612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.991615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:05.991617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.991620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:05.991622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.991625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:05.991628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.991630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:05.991633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.991635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:05.991639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.991641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:05.991658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:05.994196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.994304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:05.994316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 990
2025-10-02T09:31:05.994409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:05.994436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:05.994444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:05.994447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:05.994748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 990 sessionId:  describe result for acl check
2025-10-02T09:31:05.994776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:05.994777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:05.994778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:05.994781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554573935679310:8325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:05.995242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554573935679310:8325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:05.997045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554573935679310:8325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:05.999350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554573935679310:8325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:05.999361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554573935679310:8325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:05.999363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554573935679310:8325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:05.999367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:05.999556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.001031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.001042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.001044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.001046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.001050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 989 [2:7556554573860144262:7032]
2025-10-02T09:31:06.001058Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.001069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.001071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.001072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.001073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.001084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.001090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.001094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.001125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.001130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.001131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.001134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.001135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.001180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.001186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.001197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.001206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.001224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.001243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679344:8325], now have 1 active actors on pipe
2025-10-02T09:31:06.001249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554573935679266:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.001253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.001254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.001255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.001263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.001271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.001274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.001276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.001278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.001283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.001283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 989
2025-10-02T09:31:06.001289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 989
2025-10-02T09:31:06.001286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.001307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.001310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.001311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.001323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.001332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.001365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.001374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.001377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.001379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.001386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.001397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.001411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.001521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.001529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.001539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.001593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 990 partition: 0 MaxSeqNo: 36 sessionId: src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0
2025-10-02T09:31:06.001838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5803b42e-faf53295-10faa0d1-46358854_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.004261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Write session: try to update token
2025-10-02T09:31:06.004276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.011253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.011266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.011268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.011269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.011275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.011278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.011280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554573860144257:7032]
2025-10-02T09:31:06.011306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.011310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.011311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.011313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.011317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.011320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.011428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.015348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId: src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.017556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:06.083375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554578230646648:7829]
2025-10-02T09:31:06.083589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 989, pipe: [1:7556554578230646648:7829]
2025-10-02T09:31:06.145829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:06.146323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.146338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.146371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646648:7829], now have 1 active actors on pipe
2025-10-02T09:31:06.146522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:06.146605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554578230646648:7829]
2025-10-02T09:31:06.146611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:06.146639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:06.146678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 990 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0
2025-10-02T09:31:06.146843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 990 sessionId: src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0 is DEAD
2025-10-02T09:31:06.146986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:06.146996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Write session will restart in 0.007423s
2025-10-02T09:31:06.147011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Write session: Do CDS request
2025-10-02T09:31:06.147016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:06.153910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:06.155279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.155347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:06.155362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 991
2025-10-02T09:31:06.155466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.155493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:06.155500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:06.155503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:06.155836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 991 sessionId:  describe result for acl check
2025-10-02T09:31:06.155867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:06.155873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:06.155874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:06.155879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554578230646681:8329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:06.155874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:06.156029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:06.156038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:06.156047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:06.156091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:06.156125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554578155111627:7034]
2025-10-02T09:31:06.156303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554578230646681:8329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:06.156643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:06.156947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:06.156987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:06.157278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:06.157334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.157339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.157340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.157341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.157343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.157344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.157345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.157346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.157347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.157348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.157349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.157350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.157355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.157364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.157368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.157371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.157375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.157378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.157381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.157385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.157389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.157393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.157396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.157399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.157406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.157413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.157418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.157423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.157427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.157432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.157437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.157442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.157446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.157451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.157455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.157460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.157465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.157469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.157473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.157478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.157482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.157487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.157491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.157495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.157504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.157509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.157513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.157521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.157555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:06.158165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554578230646681:8329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:06.162972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554578230646681:8329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:06.162985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554578230646681:8329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:06.162989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554578230646681:8329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:06.162994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:06.165856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.167471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.167488Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.167490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.167493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.167499Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 990 [2:7556554578155111627:7034]
2025-10-02T09:31:06.167512Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.167527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.167533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.167536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.167539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.167553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.167561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.167568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.167623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.167632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.167634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.167636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.167638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.167699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.167707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.167718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.167733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.167753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.167775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646720:8329], now have 1 active actors on pipe
2025-10-02T09:31:06.167782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646649:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.167787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.167793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.167795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.167808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.167827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.167845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.167846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.167848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.167849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.167851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.167845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 990
2025-10-02T09:31:06.167876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.167883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.167850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 990
2025-10-02T09:31:06.167886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.167896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.167903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.167947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.167957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.167961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.167963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.167969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.167975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.167993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.168158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.168167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.168180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.168276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 991 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0
2025-10-02T09:31:06.168585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afd9e0a-342da580-b3324344-6c6bd1bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.170963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Write session: try to update token
2025-10-02T09:31:06.170976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.178119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.178134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.178430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.178435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.178441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.178443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.178445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554578155111622:7034]
2025-10-02T09:31:06.178481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.178482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.178486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.178489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.178490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.178491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.178613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.183012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId: src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.185330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:06.246726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554578230646730:7829]
2025-10-02T09:31:06.246966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 990, pipe: [1:7556554578230646730:7829]
2025-10-02T09:31:06.305186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:06.305393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.305402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.305428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646730:7829], now have 1 active actors on pipe
2025-10-02T09:31:06.305587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:06.305653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:06.305685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554578230646730:7829]
2025-10-02T09:31:06.305688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:06.305744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 991 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0
2025-10-02T09:31:06.305870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 991 sessionId: src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0 is DEAD
2025-10-02T09:31:06.306006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:06.306017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Write session will restart in 0.009721s
2025-10-02T09:31:06.306038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Write session: Do CDS request
2025-10-02T09:31:06.306043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:06.312534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:06.314428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:06.314580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:06.314589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:06.314597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:06.314644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:06.314702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554578155111700:7037]
2025-10-02T09:31:06.315294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:06.315610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:06.315652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:06.315933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:06.315976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.315982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.315983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.315984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.315984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.315985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.315985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.315985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.315986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.315986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.315987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.315988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.315990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.315998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.316000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.316002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.316004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.316006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.316009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.316011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.316014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.316018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.316021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.316025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.316030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.316036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.316046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.316055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.316058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.316063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.316070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.316075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.316079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.316087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.316090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.316094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.316102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.316106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.316109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.316114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.316122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.316126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.316130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.316135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.316143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.316152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.316159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.316163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.316197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:06.317166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.317210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:06.317222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 992
2025-10-02T09:31:06.317331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.317349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:06.317352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:06.317355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:06.317669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 992 sessionId:  describe result for acl check
2025-10-02T09:31:06.317701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:06.317706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:06.317707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:06.317710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554578230646769:8334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:06.318094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554578230646769:8334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:06.320026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554578230646769:8334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:06.323369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554578230646769:8334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:06.323387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554578230646769:8334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:06.323390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554578230646769:8334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:06.323396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:06.323919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.325591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.325604Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.325606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.325609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.325613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 991 [2:7556554578155111700:7037]
2025-10-02T09:31:06.325621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.325631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.325633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.325635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.325636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.325645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.325648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.325654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.325695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.325702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.325703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.325706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.325708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.325761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.325767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.325773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.325779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.325786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.325802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646803:8334], now have 1 active actors on pipe
2025-10-02T09:31:06.325807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646731:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.325811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.325812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.325813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.325820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.325833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.325833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.325835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.325837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.325843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.325845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.325863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.325870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.325875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.325893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 991
2025-10-02T09:31:06.325904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 991
2025-10-02T09:31:06.325961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.325969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.325987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.325998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.326004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.326005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.326011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.326018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.326029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.326150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.326160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.326171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.326268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 992 partition: 0 MaxSeqNo: 36 sessionId: src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0
2025-10-02T09:31:06.326527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc177bd-34cec1de-a7fd8c72-75e11a89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.328902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Write session: try to update token
2025-10-02T09:31:06.328913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.335435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:06.335450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.335456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.335485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:06.335488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:06.335621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:06.335740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:06.335861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:06.335978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:06.336147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:06.336176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:06.340743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId: src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.343053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:06.343241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.343256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.343284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:06.343370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:06.344446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.344459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.344462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.344464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.344471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.344475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.344481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554578155111695:7037]
2025-10-02T09:31:06.344510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.344520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.344520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.344522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.344525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.344529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.344643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.405934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554578230646811:7829]
2025-10-02T09:31:06.406149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 991, pipe: [1:7556554578230646811:7829]
2025-10-02T09:31:06.473150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:06.479713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.479740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.479876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.479927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.479983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.480036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.480077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.480085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.480141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.480191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.480244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.480297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.480336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.480341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.480396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.480448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.480503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.480559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.480602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.480609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.480661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.480712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.480763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.480828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.480867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.480872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.480929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.480977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.481035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.481088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.481128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.481133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.481187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.481256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.481311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.481363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.481402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.481407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.481461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.481511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.481563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.481615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.481656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.481661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.481719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.481773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.481827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.481881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.481918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.481926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.481985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.482041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.482096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.482145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.482182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.482186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.482236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.482285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.482333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.482382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.482418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.482423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.482458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646811:7829], now have 1 active actors on pipe
2025-10-02T09:31:06.482681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554578230646811:7829]
2025-10-02T09:31:06.482681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:06.482719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:06.482721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:06.482747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 992 reason: error at write: Disconnected sessionId: src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0
2025-10-02T09:31:06.482902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 992 sessionId: src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0 is DEAD
2025-10-02T09:31:06.483051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:06.483059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Write session will restart in 0.007105s
2025-10-02T09:31:06.483074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Write session: Do CDS request
2025-10-02T09:31:06.483079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:06.483235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:06.490340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:06.490742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:06.490849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:06.490855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:06.490861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:06.490886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:06.490911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554578155111772:7039]
2025-10-02T09:31:06.491197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.491275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:06.491261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:06.491275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 993
2025-10-02T09:31:06.491363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.491387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:06.491391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:06.491395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:06.491764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 993 sessionId:  describe result for acl check
2025-10-02T09:31:06.491798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:06.491801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:06.491803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:06.491807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554578230646847:8338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:06.492166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:06.492194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:06.492302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554578230646847:8338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:06.492379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:06.492408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.492412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.492413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.492413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.492414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.492415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.492415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.492416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.492416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.492417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.492418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.492418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.492421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.492428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.492430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.492432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.492434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.492436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.492438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.492440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.492442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.492444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.492446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.492447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.492451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.492455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.492458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.492461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.492464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.492466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.492468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.492471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.492473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.492476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.492478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.492480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.492482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.492485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.492487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.492489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.492491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.492493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.492495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.492498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.492502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.492504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.492507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.492512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.492530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:06.494610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554578230646847:8338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:06.499801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554578230646847:8338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:06.499816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554578230646847:8338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:06.499819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554578230646847:8338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:06.499825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:06.500305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.501925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.501939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.501942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.501946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.501952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 992 [2:7556554578155111772:7039]
2025-10-02T09:31:06.501964Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.501979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.501981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.501984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.501986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.502000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.502004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.502010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.502058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.502066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.502068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.502071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.502075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.502132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.502139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.502151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.502165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.502184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.502204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646812:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.502210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646886:8338], now have 1 active actors on pipe
2025-10-02T09:31:06.502216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.502218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.502219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.502231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.502224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 992
2025-10-02T09:31:06.502235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 992
2025-10-02T09:31:06.502245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.502245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.502249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.502250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.502262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.502265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.502302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.502309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.502319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.502329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.502345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.502358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.502365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.502372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.502374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.502382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.502389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.502408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.502521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.502528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.502541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.502606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 993 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0
2025-10-02T09:31:06.502870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38af417-e706f6bd-e695cc40-a97f7f53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.505293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Write session: try to update token
2025-10-02T09:31:06.505306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.512571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.512588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.512590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.512592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.512602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.512606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.512609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554578155111767:7039]
2025-10-02T09:31:06.512644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.512649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.512651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.512653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.512657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.512659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.512793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.517014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId: src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.519164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:06.583082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554578230646916:7829]
2025-10-02T09:31:06.583318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 992, pipe: [1:7556554578230646916:7829]
2025-10-02T09:31:06.640271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:06.640678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.640688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.640719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646916:7829], now have 1 active actors on pipe
2025-10-02T09:31:06.640885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:06.640948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:06.640966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554578230646916:7829]
2025-10-02T09:31:06.640966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:06.640983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:06.641019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 993 reason: error at write: Disconnected sessionId: src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0
2025-10-02T09:31:06.641172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 993 sessionId: src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0 is DEAD
2025-10-02T09:31:06.641297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:06.641306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Write session will restart in 0.006293s
2025-10-02T09:31:06.641320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Write session: Do CDS request
2025-10-02T09:31:06.641324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:06.646398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:06.647696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:06.647800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:06.647807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:06.647813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:06.647838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:06.647865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554578155111894:7054]
2025-10-02T09:31:06.648207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.648212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:06.648416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:06.648438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:06.648471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:06.648482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 994
2025-10-02T09:31:06.648592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.648612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:06.648618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:06.648621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:06.648618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:06.648648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.648652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.648654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.648654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.648655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.648656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.648656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.648657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.648657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.648658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.648658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.648659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.648662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.648668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.648670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.648672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.648674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.648676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.648678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.648680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.648682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.648684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.648686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.648688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.648692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.648695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.648699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.648701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.648703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.648706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.648708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.648711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.648713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.648716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.648718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.648721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.648723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.648726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.648727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.648730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.648732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.648734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.648736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.648739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.648741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.648743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.648746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.648749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.648765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:06.648901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 994 sessionId:  describe result for acl check
2025-10-02T09:31:06.648922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:06.648927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:06.648928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:06.648931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554578230646964:8355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:06.649285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554578230646964:8355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:06.650611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554578230646964:8355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:06.655256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554578230646964:8355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:06.655269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554578230646964:8355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:06.655274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554578230646964:8355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:06.655280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:06.656572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.658035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.658051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.658053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.658057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.658062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 993 [2:7556554578155111894:7054]
2025-10-02T09:31:06.658077Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.658091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.658094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.658096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.658098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.658111Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.658116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.658121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.658177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.658186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.658188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.658190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.658192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.658248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.658255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.658263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.658268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.658277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.658289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647001:8355], now have 1 active actors on pipe
2025-10-02T09:31:06.658292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230646927:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.658296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.658300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.658302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.658311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.658319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.658326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.658330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.658330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.658332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.658332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.658351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.658364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.658373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.658356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 993
2025-10-02T09:31:06.658371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 993
2025-10-02T09:31:06.658396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.658402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.658420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.658429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.658432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.658435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.658443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.658454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.658469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.658595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.658602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.658613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.658692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 994 partition: 0 MaxSeqNo: 36 sessionId: src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0
2025-10-02T09:31:06.658981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c13a5-61bd8a43-5c309c7-59b3e446_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.661399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Write session: try to update token
2025-10-02T09:31:06.661410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.667676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:06.667691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.667697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.667727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:06.667728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:06.667863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:06.667991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:06.668109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:06.668221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:06.668382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:06.668409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:06.672288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId: src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.674396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:06.674545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.674556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.674577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:06.674655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:06.676307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.676320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.676321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.676323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.676328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.676331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.676334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554578155111889:7054]
2025-10-02T09:31:06.676359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.676363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.676365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.676367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.676378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.676380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.676476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.741285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554578230647021:7829]
2025-10-02T09:31:06.741514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 993, pipe: [1:7556554578230647021:7829]
2025-10-02T09:31:06.798480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:06.804950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.804966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.805090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.805139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.805196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.805252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.805290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.805297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.805349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.805397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.805457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.805510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.805545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.805550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.805600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.805648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.805705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.805760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.805796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.805804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.805855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.805904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.805956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.806008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.806043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.806048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.806098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.806147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.806200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.806252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.806290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.806295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.806347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.806395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.806444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.806503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.806555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.806561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.806609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.806658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.806713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.806767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.806803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.806808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.806858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.806905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.806965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.807020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.807056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.807060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.807109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.807159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.807205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.807260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.807292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.807297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.807345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:06.807391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:06.807448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:06.807502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:06.807552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:06.807557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:06.807588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647021:7829], now have 1 active actors on pipe
2025-10-02T09:31:06.807774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:06.807792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554578230647021:7829]
2025-10-02T09:31:06.807810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:06.807812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:06.807829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 994 reason: error at write: Disconnected sessionId: src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0
2025-10-02T09:31:06.807970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 994 sessionId: src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0 is DEAD
2025-10-02T09:31:06.808064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 149 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:31:06.808087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:06.808090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Write session will restart in 0.007907s
2025-10-02T09:31:06.808115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Write session: Do CDS request
2025-10-02T09:31:06.808119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:06.808330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:06.813482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:06.815127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:06.815246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:06.815252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:06.815258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:06.815286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:06.815310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554578155111968:7056]
2025-10-02T09:31:06.815667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:06.815866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:06.815894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:06.816087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:06.816115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.816119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.816119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.816120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.816120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.816121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.816121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.816122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.816122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.816123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.816123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.816124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.816127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.816133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.816136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.816138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.816139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.816141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.816143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.816145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.816147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.816149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.816151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.816153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.816157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.816161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.816165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.816168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.816172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.816176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.816180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.816184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.816187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.816196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.816202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.816204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.816207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.816213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.816215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.816217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.816219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.816222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.816228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.816231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.816233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.816235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.816237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.816243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.816259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:06.817135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.817174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:06.817184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 995
2025-10-02T09:31:06.817284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.817301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:06.817304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:06.817308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:06.817567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 995 sessionId:  describe result for acl check
2025-10-02T09:31:06.817587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:06.817588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:06.817589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:06.817592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554578230647068:8361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:06.817951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554578230647068:8361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:06.819789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554578230647068:8361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:06.823448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554578230647068:8361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:06.823465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554578230647068:8361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:06.823469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554578230647068:8361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:06.823486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:06.824066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.825504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.825518Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.825520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.825523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.825527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 994 [2:7556554578155111968:7056]
2025-10-02T09:31:06.825535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.825547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.825552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.825554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.825555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.825565Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.825568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.825572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.825608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.825613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.825614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.825616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.825617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.825658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.825663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.825670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.825675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.825683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.825699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647103:8361], now have 1 active actors on pipe
2025-10-02T09:31:06.825705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647027:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.825710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.825716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.825718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.825728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.825741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.825743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.825748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.825750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.825755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.825757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.825736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 994
2025-10-02T09:31:06.825774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 994
2025-10-02T09:31:06.825791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.825798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.825807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.825817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.825820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.825840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.825847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.825849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.825854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.825859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.825868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.825883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.826342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.826352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.826369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.826433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 995 partition: 0 MaxSeqNo: 36 sessionId: src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0
2025-10-02T09:31:06.826678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778edeb9-fd72ba25-a9220218-ef9c58f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.828956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Write session: try to update token
2025-10-02T09:31:06.828972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.835511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.835525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.835527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.835528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.835534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.835537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.835539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554578155111963:7056]
2025-10-02T09:31:06.835565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.835571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.835572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.835573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.835578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.835580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.835677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.841412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId: src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.843692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:06.907693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554578230647114:7829]
2025-10-02T09:31:06.907921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 994, pipe: [1:7556554578230647114:7829]
2025-10-02T09:31:06.959226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:06.959817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.959829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.959844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647114:7829], now have 1 active actors on pipe
2025-10-02T09:31:06.960097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554578230647114:7829]
2025-10-02T09:31:06.960137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:06.960192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:06.960214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:06.960228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:06.960277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 995 reason: error at write: Disconnected sessionId: src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0
2025-10-02T09:31:06.960441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 995 sessionId: src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0 is DEAD
2025-10-02T09:31:06.960565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:06.960574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Write session will restart in 0.007177s
2025-10-02T09:31:06.960588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Write session: Do CDS request
2025-10-02T09:31:06.960592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:06.965606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:06.967172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:06.967307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:06.967315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:06.967321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:06.967350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:06.967384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554578155112045:7059]
2025-10-02T09:31:06.967910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:06.968105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:06.968137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:06.968406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:06.968450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.968455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.968456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.968457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.968458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.968459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.968460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.968460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.968461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.968462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.968462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.968463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.968467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.968474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.968476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.968478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.968480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.968482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.968484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.968486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.968488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.968492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.968495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.968498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.968504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.968511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:06.968517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.968520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:06.968524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.968527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:06.968529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.968534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:06.968537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.968540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:06.968542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.968548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:06.968550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.968553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:06.968557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.968562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:06.968566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.968570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:06.968578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.968583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.968589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.968592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.968594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.968596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.968615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:06.969131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.969223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:06.969235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 996
2025-10-02T09:31:06.969324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:06.969347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:06.969355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:06.969358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:06.969701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 996 sessionId:  describe result for acl check
2025-10-02T09:31:06.969728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:06.969729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:06.969730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:06.969733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554578230647159:8365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:06.970083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554578230647159:8365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:06.971650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554578230647159:8365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:06.975536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554578230647159:8365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:06.975548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554578230647159:8365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:06.975550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554578230647159:8365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:06.975554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:06.976152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:06.977717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:06.977731Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:06.977734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:06.977736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:06.977743Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 995 [2:7556554578155112045:7059]
2025-10-02T09:31:06.977754Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:06.977767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:06.977775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.977777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.977779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.977790Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:06.977799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:06.977809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:06.977855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.977861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.977863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.977867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:06.977870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:06.977924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:06.977931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.977942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:06.977957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:06.977981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:06.977997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647191:8365], now have 1 active actors on pipe
2025-10-02T09:31:06.977994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 995
2025-10-02T09:31:06.978002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 995
2025-10-02T09:31:06.978005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554578230647118:2446], now have 1 active actors on pipe
2025-10-02T09:31:06.978010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.978011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.978013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.978019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:06.978030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:06.978031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:06.978033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:06.978034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:06.978043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:06.978046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:06.978058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.978065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.978091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.978102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:06.978109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:06.978113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:06.978118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:06.978121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:06.978123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:06.978130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:06.978137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:06.978168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.978292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:06.978299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:06.978310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:06.978368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 996 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0
2025-10-02T09:31:06.978598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1a82ba-e8552565-9d2961f0-96e23414_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:06.980797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Write session: try to update token
2025-10-02T09:31:06.980828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:06.987420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:06.987434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:06.987436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:06.987439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:06.987444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.987446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.987449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554578155112040:7059]
2025-10-02T09:31:06.987473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:06.987476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:06.987477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:06.987484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:06.987488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:06.987490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:06.987606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:06.991867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId: src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:06.994010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:07.060275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554582525614495:7829]
2025-10-02T09:31:07.060484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 995, pipe: [1:7556554582525614495:7829]
2025-10-02T09:31:07.106535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:07.107006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.107016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.107046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614495:7829], now have 1 active actors on pipe
2025-10-02T09:31:07.107197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:07.107276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:07.107278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525614495:7829]
2025-10-02T09:31:07.107296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:07.107350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 996 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0
2025-10-02T09:31:07.107502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 996 sessionId: src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0 is DEAD
2025-10-02T09:31:07.107627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:07.107636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Write session will restart in 0.007328s
2025-10-02T09:31:07.107654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Write session: Do CDS request
2025-10-02T09:31:07.107658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:07.112956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:07.114467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:07.114584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:07.114591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:07.114597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:07.114630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:07.114656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554582450079417:7061]
2025-10-02T09:31:07.115036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:07.115209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:07.115235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:07.115433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:07.115469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.115473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.115474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.115474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.115475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.115475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.115476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.115476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.115477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.115477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.115478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.115478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.115481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.115488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.115490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.115492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.115493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.115495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.115497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.115500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.115502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.115505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.115508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.115510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.115514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.115518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.115521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.115524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.115526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.115529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.115531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.115534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.115536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.115539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.115541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.115544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.115546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.115549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.115551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.115553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.115561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.115570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.115578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.115585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.115591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.115594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.115595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.115598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.115618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:07.116177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.116319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:07.116333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 997
2025-10-02T09:31:07.116444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.116467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:07.116475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:07.116478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:07.116778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 997 sessionId:  describe result for acl check
2025-10-02T09:31:07.116816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:07.116821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:07.116824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:07.116828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554582525614538:8369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:07.117245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554582525614538:8369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:07.118582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554582525614538:8369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:07.122707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554582525614538:8369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:07.122723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554582525614538:8369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:07.122726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554582525614538:8369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:07.122733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:07.123311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:07.124789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:07.124813Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:07.124815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:07.124817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:07.124823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 996 [2:7556554582450079417:7061]
2025-10-02T09:31:07.124831Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:07.124843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:07.124848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.124849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.124850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.124859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:07.124862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:07.124869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:07.124903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.124908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.124909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.124911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:07.124912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:07.124949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:07.124954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.124960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.124969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.124980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:07.124994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614574:8369], now have 1 active actors on pipe
2025-10-02T09:31:07.125001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614496:2446], now have 1 active actors on pipe
2025-10-02T09:31:07.125006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.125011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.125013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.125024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:07.125035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:07.125037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:07.125042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:07.125044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:07.125050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:07.125052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:07.125040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 996
2025-10-02T09:31:07.125044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 996
2025-10-02T09:31:07.125081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.125089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.125096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.125104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:07.125112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:07.125125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e594bba-88c5c87a-93829c13-6bf9af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:07.125132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.125134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.125138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.125143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.125151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:07.125168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.125267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.125272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.125280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.125331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 997 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e594bba-88c5c87a-93829c13-6bf9af_0
2025-10-02T09:31:07.125591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c301163-d2b634d8-c9f1d8b9-2b66182e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e594bba-88c5c87a-93829c13-6bf9af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:07.127802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Write session: try to update token
2025-10-02T09:31:07.127813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:07.134669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:07.134683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.134685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:07.134687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:07.134694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.134698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.134701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554582450079412:7061]
2025-10-02T09:31:07.134729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:07.134731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:07.134733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.134734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:07.134736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:07.134737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:07.134860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:07.138700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId: src_id|6e594bba-88c5c87a-93829c13-6bf9af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:07.140773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:07.207211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554582525614584:7829]
2025-10-02T09:31:07.207455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 996, pipe: [1:7556554582525614584:7829]
2025-10-02T09:31:07.257689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:07.258177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.258188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.258214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614584:7829], now have 1 active actors on pipe
2025-10-02T09:31:07.258323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:07.258354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:07.258356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:07.258366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:07.258392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525614584:7829]
2025-10-02T09:31:07.258411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 997 reason: error at write: Disconnected sessionId: src_id|6e594bba-88c5c87a-93829c13-6bf9af_0
2025-10-02T09:31:07.258549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 997 sessionId: src_id|6e594bba-88c5c87a-93829c13-6bf9af_0 is DEAD
2025-10-02T09:31:07.258683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:07.258691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Write session will restart in 0.005193s
2025-10-02T09:31:07.258706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Write session: Do CDS request
2025-10-02T09:31:07.258711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:07.264181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:07.265105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.265206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:07.265217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 998
2025-10-02T09:31:07.265291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.265311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:07.265317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:07.265319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:07.265606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 998 sessionId:  describe result for acl check
2025-10-02T09:31:07.265626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:07.265628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:07.265629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:07.265632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554582525614624:8374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:07.265783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:07.265884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:07.265890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:07.265896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:07.265927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:07.265954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554582450079496:7064]
2025-10-02T09:31:07.265973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554582525614624:8374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:07.266302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:07.266490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:07.266513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:07.266703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:07.266736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.266738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.266739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.266740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.266740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.266741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.266741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.266742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.266742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.266743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.266743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.266744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.266747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.266753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.266755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.266757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.266759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.266761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.266763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.266765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.266767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.266769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.266771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.266773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.266778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.266782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.266785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.266788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.266790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.266792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.266794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.266797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.266799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.266802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.266807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.266811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.266814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.266818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.266821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.266830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.266833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.266841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.266845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.266850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.266858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.266866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.266873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.266881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.266903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:07.267466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554582525614624:8374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:07.272652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554582525614624:8374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:07.272662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554582525614624:8374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:07.272664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554582525614624:8374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:07.272668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:07.274377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:07.275966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:07.275978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:07.275979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:07.275981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:07.275986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 997 [2:7556554582450079496:7064]
2025-10-02T09:31:07.275993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:07.276002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:07.276005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.276007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.276008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.276017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:07.276024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:07.276028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:07.276059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.276063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.276064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.276067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:07.276068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:07.276113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:07.276118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.276124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.276130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.276141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:07.276156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614663:8374], now have 1 active actors on pipe
2025-10-02T09:31:07.276163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614585:2446], now have 1 active actors on pipe
2025-10-02T09:31:07.276168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.276170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.276172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.276183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:07.276199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:07.276180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 997
2025-10-02T09:31:07.276202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:07.276204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:07.276206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:07.276214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:07.276191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 997
2025-10-02T09:31:07.276216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:07.276244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.276249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.276259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.276266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:07.276284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:07.276288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:07.276292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.276295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.276296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.276300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.276306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:07.276317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.276415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.276421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.276429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.276472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 998 partition: 0 MaxSeqNo: 36 sessionId: src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0
2025-10-02T09:31:07.276658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e594bba-88c5c87a-93829c13-6bf9af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:07.278799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Write session: try to update token
2025-10-02T09:31:07.278810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:07.285691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:07.285707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.285709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:07.285711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:07.285716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.285719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.285721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554582450079491:7064]
2025-10-02T09:31:07.285751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:07.285750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:07.285754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:07.285757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:07.285758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.285760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:07.285902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:07.290156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId: src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:07.292136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:07.358752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554582525614671:7829]
2025-10-02T09:31:07.358936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 997, pipe: [1:7556554582525614671:7829]
2025-10-02T09:31:07.406648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:07.406863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.406872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.406905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614671:7829], now have 1 active actors on pipe
2025-10-02T09:31:07.407067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:07.407140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525614671:7829]
2025-10-02T09:31:07.407150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:07.407165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:07.407212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 998 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0
2025-10-02T09:31:07.407375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 998 sessionId: src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0 is DEAD
2025-10-02T09:31:07.407481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:07.407490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Write session will restart in 0.007651s
2025-10-02T09:31:07.407508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Write session: Do CDS request
2025-10-02T09:31:07.407512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:07.413189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:07.414941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:07.415059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:07.415066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:07.415072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:07.415103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:07.415130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554582450079573:7066]
2025-10-02T09:31:07.415486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:07.415684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:07.415707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:07.415890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:07.415919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.415924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.415924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.415925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.415925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.415926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.415926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.415927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.415928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.415928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.415929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.415929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.415932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.415938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.415940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.415942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.415944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.415947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.415949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.415950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.415952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.415954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.415956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.415958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.415963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.415967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.415970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.415973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.415975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.415978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.415982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.415985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.415987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.415990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.415992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.415994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.415996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.415999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.416001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.416004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.416006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.416008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.416010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.416013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.416018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.416022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.416024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.416026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.416047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:07.416182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.416281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:07.416292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 999
2025-10-02T09:31:07.416372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.416392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:07.416398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:07.416401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:07.416688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 999 sessionId:  describe result for acl check
2025-10-02T09:31:07.416714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:07.416719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:07.416720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:07.416723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554582525614716:8378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:07.417118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554582525614716:8378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:07.418604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554582525614716:8378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:07.422488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554582525614716:8378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:07.422508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554582525614716:8378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:07.422512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554582525614716:8378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:07.422516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:07.423771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:07.425158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:07.425170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:07.425171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:07.425174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:07.425177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 998 [2:7556554582450079573:7066]
2025-10-02T09:31:07.425186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:07.425198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:07.425203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.425205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.425206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.425218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:07.425224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:07.425229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:07.425262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.425270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.425271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.425273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:07.425274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:07.425315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:07.425320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.425326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.425332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.425344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:07.425357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614672:2446], now have 1 active actors on pipe
2025-10-02T09:31:07.425362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614751:8378], now have 1 active actors on pipe
2025-10-02T09:31:07.425366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.425367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.425369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.425379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:07.425393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:07.425397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:07.425400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:07.425402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:07.425407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:07.425410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:07.425394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 998
2025-10-02T09:31:07.425438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.425438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 998
2025-10-02T09:31:07.425448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:07.425459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:07.425525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.425532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.425547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:07.425555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.425557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.425558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.425563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.425578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:07.425589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.425696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.425701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.425711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.425802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 999 partition: 0 MaxSeqNo: 36 sessionId: src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0
2025-10-02T09:31:07.426049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea5f1b-178ca259-b11d0586-cf6e7aeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:07.428422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Write session: try to update token
2025-10-02T09:31:07.428435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:07.435012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:07.435027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.435035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.435064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:07.435069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:07.435230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:07.435358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:07.435484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:07.435609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:07.435779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:07.435815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:07.439855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId: src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:07.441944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:07.442116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.442126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.442147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:07.442196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:07.443667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:07.443678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.443679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:07.443681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:07.443687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.443691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.443693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554582450079568:7066]
2025-10-02T09:31:07.443719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:07.443730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.443730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:07.443732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:07.443734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:07.443736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:07.443842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:07.507189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554582525614759:7829]
2025-10-02T09:31:07.507381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 998, pipe: [1:7556554582525614759:7829]
2025-10-02T09:31:07.567214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:07.573761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.573785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.573922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.573974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.574025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.574082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.574123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.574129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.574185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.574237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.574291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.574343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.574383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.574388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.574442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.574494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.574547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.574602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.574691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.574698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.574762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.574821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.574882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.574949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.574987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.574992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.575056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.575111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.575176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.575241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.575280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.575287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.575354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.575443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.575508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.575569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.575613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.575622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.575689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.575746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.575805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.575865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.575906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.575912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.575970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.576026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.576079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.576133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.576178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.576186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.576240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.576289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.576345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.576396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.576434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.576439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.576502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:07.576555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:07.576607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:07.576657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:07.576694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:07.576699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:07.576738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614759:7829], now have 1 active actors on pipe
2025-10-02T09:31:07.576944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:07.576951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525614759:7829]
2025-10-02T09:31:07.576991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:07.576994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:07.577020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 999 reason: error at write: Disconnected sessionId: src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0
2025-10-02T09:31:07.577186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 999 sessionId: src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0 is DEAD
2025-10-02T09:31:07.577310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:07.577319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Write session will restart in 0.006793s
2025-10-02T09:31:07.577341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Write session: Do CDS request
2025-10-02T09:31:07.577346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:07.577682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:07.585118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:07.585196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.585258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:07.585270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1000
2025-10-02T09:31:07.585415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.585455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:07.585464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:07.585470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:07.585836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1000 sessionId:  describe result for acl check
2025-10-02T09:31:07.585868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:07.585873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:07.585874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:07.585879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554582525614802:8382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:07.586353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554582525614802:8382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:07.587153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:07.587307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:07.587318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:07.587327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:07.587376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:07.587413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554582450079652:7068]
2025-10-02T09:31:07.587929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:07.588186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:07.588228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:07.588356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554582525614802:8382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:07.588501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:07.588560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.588567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.588568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.588569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.588570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.588571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.588571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.588572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.588573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.588574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.588575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.588576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.588581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.588590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.588593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.588597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.588600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.588603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.588606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.588610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.588613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.588617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.588620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.588622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.588630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.588637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.588642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.588647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.588651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.588656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.588659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.588664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.588668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.588677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.588681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.588686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.588693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.588698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.588701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.588708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.588711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.588720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.588723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.588729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.588736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.588741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.588748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.588753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.588784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:07.592790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554582525614802:8382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:07.592813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554582525614802:8382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:07.592815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554582525614802:8382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:07.592820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:07.596542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:07.598068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:07.598090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:07.598092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:07.598096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:07.598101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 999 [2:7556554582450079652:7068]
2025-10-02T09:31:07.598112Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:07.598125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:07.598132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.598135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.598137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.598153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:07.598162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:07.598171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:07.598223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.598230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.598232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.598234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:07.598237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:07.598369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 999
2025-10-02T09:31:07.598398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 999
2025-10-02T09:31:07.598449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:07.598457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.598470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.598485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.598504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:07.598524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614846:8382], now have 1 active actors on pipe
2025-10-02T09:31:07.598531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614760:2446], now have 1 active actors on pipe
2025-10-02T09:31:07.598545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.598551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.598569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.598577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.598579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.598591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:07.598599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:07.598601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:07.598602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:07.598602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:07.598615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:07.598622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:07.598634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:07.598644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.598651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.598653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.598661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.598668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:07.598697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.598707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:07.598713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:07.598720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.598858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.598865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.598878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.598965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1000 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0
2025-10-02T09:31:07.599255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d782f689-1de20d5a-70686bd3-7b9ad889_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:07.601784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Write session: try to update token
2025-10-02T09:31:07.601799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:07.608474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:07.608492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.608499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.608538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:07.608538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:07.608698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:07.608846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:07.608974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:07.609098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:07.609269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:07.609307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:07.614048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId: src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:07.616257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:07.617235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.617255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.617270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:07.617273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.617275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:07.617276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:07.617283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.617286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.617288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554582450079647:7068]
2025-10-02T09:31:07.617323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:07.617329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:07.617333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:07.617335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.617336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:07.617337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:07.617455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:07.677211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554582525614879:7829]
2025-10-02T09:31:07.677421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 999, pipe: [1:7556554582525614879:7829]
2025-10-02T09:31:07.683944Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 9 CurrentSessionLifetimeMs: 181209 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:31:07.738831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:07.739202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:07.739233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614879:7829], now have 1 active actors on pipe
2025-10-02T09:31:07.739329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:07.739373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525614879:7829]
2025-10-02T09:31:07.739387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:07.739415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:07.739423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:07.739494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1000 reason: error at write: Disconnected sessionId: src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0
2025-10-02T09:31:07.739640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1000 sessionId: src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0 is DEAD
2025-10-02T09:31:07.739763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:07.739777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Write session will restart in 0.009765s
2025-10-02T09:31:07.739795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Write session: Do CDS request
2025-10-02T09:31:07.739801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:07.745291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:07.746599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:07.746710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:07.746716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:07.746723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:07.746756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:07.746781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554582450079780:7083]
2025-10-02T09:31:07.747172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:07.747341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:07.747365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:07.747543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:07.747573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.747576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.747577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.747577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.747578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.747578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.747579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.747579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.747580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.747580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.747581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.747581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.747584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.747591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.747593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.747595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.747597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.747599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.747601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.747603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.747605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.747607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.747609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.747611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.747615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.747620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.747624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.747626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.747629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.747631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.747636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.747639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.747641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.747644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.747649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.747652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.747654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.747657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.747658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.747665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.747667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.747670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.747675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.747677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.747679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.747682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.747687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.747690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.747713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:07.750126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.750338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:07.750350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1001
2025-10-02T09:31:07.750445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.750471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:07.750479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:07.750484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:07.750822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1001 sessionId:  describe result for acl check
2025-10-02T09:31:07.750848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:07.750854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:07.750855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:07.750860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554582525614938:8394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:07.751309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554582525614938:8394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:07.753009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554582525614938:8394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:07.754949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554582525614938:8394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:07.754958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554582525614938:8394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:07.754960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554582525614938:8394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:07.754964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:07.755129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:07.756524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:07.756539Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:07.756540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:07.756543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:07.756547Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1000 [2:7556554582450079780:7083]
2025-10-02T09:31:07.756554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:07.756564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:07.756566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.756567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.756568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.756577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:07.756580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:07.756584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:07.756615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.756621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.756622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.756624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:07.756625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:07.756662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:07.756667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.756673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.756678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.756690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:07.756705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614973:8394], now have 1 active actors on pipe
2025-10-02T09:31:07.756711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614892:2446], now have 1 active actors on pipe
2025-10-02T09:31:07.756714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.756715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.756717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.756724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:07.756739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:07.756738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:07.756740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:07.756742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:07.756746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:07.756748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:07.756763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.756751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1000
2025-10-02T09:31:07.756764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:07.756758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1000
2025-10-02T09:31:07.756766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:07.756785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.756790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.756823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:07.756829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.756831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.756832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.756837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.756843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:07.756850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.756954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.756959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.756966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.757023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1001 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0
2025-10-02T09:31:07.757264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2550c66-f9e45531-16f3a5cd-5f23767f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:07.759566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Write session: try to update token
2025-10-02T09:31:07.759577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:07.768365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:07.768384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.768386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:07.768388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:07.768395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.768397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.768400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554582450079775:7083]
2025-10-02T09:31:07.768446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:07.768448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:07.768455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.768456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:07.768457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:07.768459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:07.768571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:07.771623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId: src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:07.774028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:07.839529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554582525614988:7829]
2025-10-02T09:31:07.839758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1000, pipe: [1:7556554582525614988:7829]
2025-10-02T09:31:07.884700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:07.885017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.885030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.885058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614988:7829], now have 1 active actors on pipe
2025-10-02T09:31:07.885259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:07.885260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:07.885273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:07.885303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:07.885315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525614988:7829]
2025-10-02T09:31:07.885327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1001 reason: error at write: Disconnected sessionId: src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0
2025-10-02T09:31:07.885333Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:31:07.885413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1001 sessionId: src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0 is DEAD
2025-10-02T09:31:07.885413Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 10 consumer shared/user session shared/user_1_10_3393095593970451761_v1 is DEAD
2025-10-02T09:31:07.885546Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554513806105713:7823] disconnected; active server actors: 1
2025-10-02T09:31:07.885560Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554513806105713:7823] client user disconnected session shared/user_1_10_3393095593970451761_v1
2025-10-02T09:31:07.885687Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:31:07.885710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:07.885719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Write session will restart in 0.005247s
2025-10-02T09:31:07.885744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Write session: Do CDS request
2025-10-02T09:31:07.885749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:07.885808Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:07.885813Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:07.885825Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005576s
2025-10-02T09:31:07.891064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:07.892127Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:31:07.892182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.892370Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:31:07.892367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:07.892379Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 11
2025-10-02T09:31:07.892381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1002
2025-10-02T09:31:07.892463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:07.892489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:07.892497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:07.892500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:07.892506Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:07.892535Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:07.892607Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 auth for : user
2025-10-02T09:31:07.892631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:07.892666Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 Handle describe topics response
2025-10-02T09:31:07.892680Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 auth is DEAD
2025-10-02T09:31:07.892692Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:31:07.892768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:07.892774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:07.892780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:07.892812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1002 sessionId:  describe result for acl check
2025-10-02T09:31:07.892818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:07.892831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:07.892842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554582450079861:7085]
2025-10-02T09:31:07.892835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:07.892836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:07.892840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554582525615038:8399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:07.892895Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:31:07.892933Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_11_5934655325634129551_v1
2025-10-02T09:31:07.892954Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554582525615039:8400] connected; active server actors: 1
2025-10-02T09:31:07.892962Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554582525615039:8400] session shared/user_1_11_5934655325634129551_v1
2025-10-02T09:31:07.892968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:31:07.892975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:31:07.892982Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_11_5934655325634129551_v1" (Sender=[1:7556554582525615034:8400], Pipe=[1:7556554582525615039:8400], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:07.892984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:31:07.892990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:31:07.892994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_11_5934655325634129551_v1" (Sender=[1:7556554582525615034:8400], Pipe=[1:7556554582525615039:8400], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:07.893007Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_11_5934655325634129551_v1" sender [1:7556554582525615034:8400] lock partition 0 for ReadingSession "shared/user_1_11_5934655325634129551_v1" (Sender=[1:7556554582525615034:8400], Pipe=[1:7556554582525615039:8400], Partitions=[], ActiveFamilyCount=1) generation 1 step 11
2025-10-02T09:31:07.893016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:31:07.893019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-02T09:31:07.893139Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 11 Session: "shared/user_1_11_5934655325634129551_v1" ClientId: "user" PipeClient { RawX1: 7556554582525615039 RawX2: 4503603922346192 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:31:07.893149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:31:07.893185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554582525615038:8399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:07.893234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:07.893426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:07.893455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:07.893689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:07.893725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.893729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.893731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.893732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.893732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.893733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.893733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.893734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.893734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.893735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.893735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.893736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.893738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.893744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.893746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.893748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.893750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.893751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.893753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.893755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.893757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.893759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.893761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.893763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.893766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.893770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:07.893773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.893776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:07.893779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.893781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:07.893783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.893786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:07.893788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.893792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:07.893794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.893796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:07.893798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.893801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:07.893803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.893806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:07.893808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.893810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:07.893812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.893815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.893817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.893820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.893822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.893824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.893849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:07.894725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554582525615038:8399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:07.899704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554582525615038:8399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:07.899715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554582525615038:8399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:07.899718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554582525615038:8399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:07.899722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:07.901404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:07.903495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:07.903507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:07.903508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:07.903510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:07.903513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1001 [2:7556554582450079861:7085]
2025-10-02T09:31:07.903520Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:07.903534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:07.903537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.903542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.903543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.903552Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:07.903559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:07.903563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:07.903600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.903605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.903605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.903607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:07.903609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:07.903644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:07.903650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.903656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:07.903662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:07.903670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:07.903682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525614992:2446], now have 1 active actors on pipe
2025-10-02T09:31:07.903684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525615081:8399], now have 1 active actors on pipe
2025-10-02T09:31:07.903685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554582525615042:8404], now have 1 active actors on pipe
2025-10-02T09:31:07.903688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.903689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.903690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.903698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:07.903706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:07.903712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:07.903714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:07.903715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:07.903717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:07.903718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:07.903738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.903744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:07.903748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:07.903767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.903771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.903786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.903790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.903793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_11_5934655325634129551_v1 on pipe: [1:7556554582525615042:8404]
2025-10-02T09:31:07.903740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1001
2025-10-02T09:31:07.903743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1001
2025-10-02T09:31:07.903808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:07.903765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1001, pipe: [1:7556554582525615042:8404]
2025-10-02T09:31:07.903815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.903818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.903819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.903822Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_11_5934655325634129551_v1:1 with generation 1001
2025-10-02T09:31:07.903824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.903829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:07.903839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.903845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.903846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:07.903857Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_11_5934655325634129551_v1
2025-10-02T09:31:07.903862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.903875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.903887Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:31:07.903955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:07.903959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:07.903967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:07.904009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1002 partition: 0 MaxSeqNo: 36 sessionId: src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0
2025-10-02T09:31:07.904217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf49a9f-84b7a8e1-98fe2434-7d5a7469_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:07.907329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:31:07.907350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:31:07.907358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:07.907364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:07.907372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:07.907377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:31:07.907383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:31:07.907462Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397467903 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:31:07.907475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:31:07.907493Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 sending to client partition status
2025-10-02T09:31:07.909511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Write session: try to update token
2025-10-02T09:31:07.909523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:07.913078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:07.913090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:07.913091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:07.913092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:07.913097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.913100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.913102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554582450079856:7085]
2025-10-02T09:31:07.913124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:07.913130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:07.913132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:07.913140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:07.913151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:07.913154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:07.913254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:07.921165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId: src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:07.923123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.034787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.035024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.035044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.035201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_11_5934655325634129551_v1
2025-10-02T09:31:08.035221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.035244Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_11_5934655325634129551_v1
2025-10-02T09:31:08.035237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.035259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:08.035261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:08.035279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554582525615042:8404]
2025-10-02T09:31:08.035305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1002 reason: error at write: Disconnected sessionId: src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0
2025-10-02T09:31:08.035448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1002 sessionId: src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0 is DEAD
2025-10-02T09:31:08.035592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:08.035605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Write session will restart in 0.006298s
2025-10-02T09:31:08.035623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Write session: Do CDS request
2025-10-02T09:31:08.035629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.041158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.042973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.043093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.043099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.043105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.043140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.043149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.043171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047244:7088]
2025-10-02T09:31:08.043213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.043224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1003
2025-10-02T09:31:08.043339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.043358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.043365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.043368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.043547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.043625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1003 sessionId:  describe result for acl check
2025-10-02T09:31:08.043645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.043650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.043651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.043655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820582430:8407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.043755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.043783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.043979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.043996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820582430:8407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.044011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.044015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.044016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.044016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.044017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.044018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.044018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.044019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.044019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.044020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.044021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.044021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.044024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.044030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.044034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.044036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.044038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.044040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.044043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.044045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.044047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.044049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.044051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.044053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.044057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.044061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.044065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.044068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.044070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.044073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.044076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.044079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.044081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.044084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.044086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.044088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.044090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.044093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.044103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.044109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.044111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.044114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.044116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.044118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.044121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.044124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.044126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.044129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.044148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.045198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820582430:8407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.049506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820582430:8407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.049517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820582430:8407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.049519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820582430:8407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.049523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.051737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.053116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.053128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.053130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.053132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.053136Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1002 [2:7556554586745047244:7088]
2025-10-02T09:31:08.053143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.053153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.053158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.053159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.053160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.053169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.053175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.053180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.053210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.053215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.053217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.053219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.053220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.053263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.053270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.053276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.053281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.053289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.053300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582469:8407], now have 1 active actors on pipe
2025-10-02T09:31:08.053302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582386:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.053307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.053308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.053309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.053317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.053325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.053329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.053331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.053332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.053336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.053338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.053351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.053358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.053362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.053365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1002
2025-10-02T09:31:08.053368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1002
2025-10-02T09:31:08.053386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.053391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.053407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.053414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.053416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.053417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.053423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.053429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.053440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.053540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.053548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.053561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.053643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1003 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0
2025-10-02T09:31:08.053862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c356f89f-28548a47-6b83e6b8-ab17ba63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.056124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Write session: try to update token
2025-10-02T09:31:08.056133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.062856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.062874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.062875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.062876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.062885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.062887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.062890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047239:7088]
2025-10-02T09:31:08.062932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.062936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.062937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.062940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.062942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.062944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.063060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.067556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId: src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.069727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.135461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554586820582477:8404]
2025-10-02T09:31:08.135701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1002, pipe: [1:7556554586820582477:8404]
2025-10-02T09:31:08.184090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.184443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.184453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.184479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582477:8404], now have 1 active actors on pipe
2025-10-02T09:31:08.184655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.184725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.184742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:08.184746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:08.184775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554586820582477:8404]
2025-10-02T09:31:08.184811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1003 reason: error at write: Disconnected sessionId: src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0
2025-10-02T09:31:08.184932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1003 sessionId: src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0 is DEAD
2025-10-02T09:31:08.185034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:08.185043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Write session will restart in 0.005471s
2025-10-02T09:31:08.185067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Write session: Do CDS request
2025-10-02T09:31:08.185070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.190830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.191210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.191327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.191348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1004
2025-10-02T09:31:08.191456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.191483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.191493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.191496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.191822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1004 sessionId:  describe result for acl check
2025-10-02T09:31:08.191849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.191850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.191851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.191855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820582525:8412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.192297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820582525:8412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.192394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.192551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.192560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.192568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.192603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.192630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047329:7091]
2025-10-02T09:31:08.192989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.193179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.193220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.193452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.193486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.193490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.193491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.193494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.193495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.193496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.193497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.193498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.193499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.193500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.193501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.193502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.193506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.193515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.193519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.193521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.193523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.193525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.193527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.193529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.193535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.193537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.193539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.193541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.193546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.193553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.193557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.193562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.193565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.193568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.193573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.193576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.193578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.193584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.193587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.193590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.193592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.193595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.193597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.193600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.193602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.193605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.193607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.193611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.193614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.193616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.193618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.193625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.193642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.193793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820582525:8412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.198609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820582525:8412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.198621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820582525:8412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.198623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820582525:8412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.198629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.201287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.202896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.202907Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.202909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.202920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.202926Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1003 [2:7556554586745047329:7091]
2025-10-02T09:31:08.202939Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.202952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.202958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.202961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.202962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.202972Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.202978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.202982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.203018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.203023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.203024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.203025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.203027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.203066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.203072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.203078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.203085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.203097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.203112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582480:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.203119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582564:8412], now have 1 active actors on pipe
2025-10-02T09:31:08.203125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.203130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.203132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.203142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.203150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1003
2025-10-02T09:31:08.203150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.203156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.203166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.203157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1003
2025-10-02T09:31:08.203167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.203167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.203169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.203201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.203205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.203213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.203222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.203226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.203241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.203253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.203260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.203261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.203268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.203277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.203299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.203415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.203421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.203430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.203489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1004 partition: 0 MaxSeqNo: 36 sessionId: src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0
2025-10-02T09:31:08.203730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b4187e9-41ef46f2-c8c62769-e74aa4c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.205957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Write session: try to update token
2025-10-02T09:31:08.205969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.212855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.212868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.212870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.212871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.212877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.212880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.212884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047324:7091]
2025-10-02T09:31:08.212916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.212921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.212923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.212924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.212925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.212927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.213040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.216856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId: src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.218908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.284967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554586820582572:8404]
2025-10-02T09:31:08.285181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1003, pipe: [1:7556554586820582572:8404]
2025-10-02T09:31:08.331385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.331603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.331613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.331640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582572:8404], now have 1 active actors on pipe
2025-10-02T09:31:08.331786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.331852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.331863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:08.331902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554586820582572:8404]
2025-10-02T09:31:08.331934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1004 reason: status is not ok: tablet will be restarted right now sessionId: src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0
2025-10-02T09:31:08.332111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1004 sessionId: src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0 is DEAD
2025-10-02T09:31:08.332243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:08.332251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Write session will restart in 0.006089s
2025-10-02T09:31:08.332267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Write session: Do CDS request
2025-10-02T09:31:08.332272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.337289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.338692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.338818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.338824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.338831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.338859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.338884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047412:7093]
2025-10-02T09:31:08.339185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.339234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.339279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.339291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1005
2025-10-02T09:31:08.339400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.339419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.339426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.339429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.339424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.339457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.339721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.339743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1005 sessionId:  describe result for acl check
2025-10-02T09:31:08.339772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.339778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.339779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.339776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.339780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.339781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.339781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.339782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.339784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.339783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.339788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820582621:8416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.339785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.339786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.339787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.339788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.339788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.339792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.339801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.339804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.339807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.339810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.339812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.339815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.339818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.339821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.339824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.339827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.339830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.339835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.339841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.339845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.339850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.339858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.339862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.339870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.339878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.339885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.339893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.339901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.339906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.339913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.339919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.339926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.339930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.339937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.339943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.339950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.339954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.339962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.339970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.339977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.339981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.340015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.340209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820582621:8416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.341637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820582621:8416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.345264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820582621:8416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.345272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820582621:8416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.345274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820582621:8416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.345279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.347459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.348798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.348823Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.348825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.348828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.348832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1004 [2:7556554586745047412:7093]
2025-10-02T09:31:08.348839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.348851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.348852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.348854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.348855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.348864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.348868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.348872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.348908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.348913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.348913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.348916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.348917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.349059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1004
2025-10-02T09:31:08.349062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1004
2025-10-02T09:31:08.349122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.349129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.349136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.349141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.349154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.349169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582573:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.349175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582658:8416], now have 1 active actors on pipe
2025-10-02T09:31:08.349184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.349189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.349197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.349201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.349203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.349211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.349222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.349224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.349226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.349227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.349232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.349234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.349244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acec348b-789fad71-1a3c433d-80b799ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.349250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.349253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.349254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.349259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.349267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.349284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.349291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.349295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.349297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.349401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.349406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.349414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.349457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1005 partition: 0 MaxSeqNo: 36 sessionId: src_id|acec348b-789fad71-1a3c433d-80b799ec_0
2025-10-02T09:31:08.349680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|969f45a2-6aaf41f9-efcd3e9-61c50a20_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|acec348b-789fad71-1a3c433d-80b799ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.351952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Write session: try to update token
2025-10-02T09:31:08.351963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.362296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:08.362311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.362317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.362346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:08.362355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:08.362486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:08.362600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:08.362725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:08.362844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:08.363020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:08.363051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:08.363321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId: src_id|acec348b-789fad71-1a3c433d-80b799ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.365323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.365434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.365443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.365463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:08.365520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:08.366702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.366713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.366714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.366716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.366721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.366723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.366725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047407:7093]
2025-10-02T09:31:08.366744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.366746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.366749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.366751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.366752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.366754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.366857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.431894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554586820582666:8404]
2025-10-02T09:31:08.432069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1004, pipe: [1:7556554586820582666:8404]
2025-10-02T09:31:08.485488Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.491871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.491890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.492043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.492096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.492149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.492221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.492258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.492262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.492314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.492362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.492411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.492463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.492499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.492505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.492559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.492609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.492659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.492710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.492744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.492749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.492812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.492858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.492909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.492961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.492998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.493003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.493056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.493118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.493170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.493220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.493266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.493272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.493326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.493375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.493426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.493478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.493514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.493526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.493581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.493629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.493681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.493732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.493777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.493782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.493832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.494014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.494192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.494244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.494343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.494349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.494399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.494446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.494503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.494562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.494598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.494603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.494651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:08.494700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:08.494752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:08.494805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:08.494841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:08.494846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:08.494878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582666:8404], now have 1 active actors on pipe
2025-10-02T09:31:08.495127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.495142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554586820582666:8404]
2025-10-02T09:31:08.495165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:08.495176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:08.495198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1005 reason: error at write: Disconnected sessionId: src_id|acec348b-789fad71-1a3c433d-80b799ec_0
2025-10-02T09:31:08.495365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1005 sessionId: src_id|acec348b-789fad71-1a3c433d-80b799ec_0 is DEAD
2025-10-02T09:31:08.495504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:08.495511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Write session will restart in 0.009044s
2025-10-02T09:31:08.495525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Write session: Do CDS request
2025-10-02T09:31:08.495529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.495697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.501277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.502800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.502943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.502951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.502958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.502997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.503029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047497:7095]
2025-10-02T09:31:08.503376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.503540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.503565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.503742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.503772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.503775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.503776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.503777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.503777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.503778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.503778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.503779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.503779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.503780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.503780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.503781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.503784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.503791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.503793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.503795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.503798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.503800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.503802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.503804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.503806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.503808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.503810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.503812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.503816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.503819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.503822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.503825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.503828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.503831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.503833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.503836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.503838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.503841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.503843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.503845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.503848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.503850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.503852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.503855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.503858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.503861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.503863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.503869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.503872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.503875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.503879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.503882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.503898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.505137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.505221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.505241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1006
2025-10-02T09:31:08.505324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.505343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.505346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.505349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.505630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1006 sessionId:  describe result for acl check
2025-10-02T09:31:08.505655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.505659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.505660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.505663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820582718:8420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.506030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820582718:8420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.507930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820582718:8420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.513466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820582718:8420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.513478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820582718:8420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.513481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820582718:8420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.513487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.513988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.515771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.515784Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.515786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.515789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.515795Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1005 [2:7556554586745047497:7095]
2025-10-02T09:31:08.515808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.515821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.515824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.515827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.515828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.515842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.515848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.515854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.515899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.515907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.515909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.515912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.515914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.515967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.515974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.515985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.515996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.516012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.516031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582752:8420], now have 1 active actors on pipe
2025-10-02T09:31:08.516035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582667:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.516040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.516042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.516044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.516053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.516065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.516071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.516074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.516075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.516078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.516081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.516105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.516112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.516114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.516089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1005
2025-10-02T09:31:08.516110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1005
2025-10-02T09:31:08.516122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.516130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.516165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.516174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.516179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.516181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.516188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.516196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.516216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.516329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.516335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.516346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.516420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1006 partition: 0 MaxSeqNo: 36 sessionId: src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0
2025-10-02T09:31:08.516650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acec348b-789fad71-1a3c433d-80b799ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.518933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Write session: try to update token
2025-10-02T09:31:08.518945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.529093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.529109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.529111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.529112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.529119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.529129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.529132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047492:7095]
2025-10-02T09:31:08.529168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.529178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.529184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.529281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.529294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.529297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.529316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.530586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId: src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.532719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.595216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554586820582761:8404]
2025-10-02T09:31:08.595365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1005, pipe: [1:7556554586820582761:8404]
2025-10-02T09:31:08.650884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.651174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.651184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.651210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582761:8404], now have 1 active actors on pipe
2025-10-02T09:31:08.651374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.651399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:08.651414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:08.651463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1006 reason: error at write: Disconnected sessionId: src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0
2025-10-02T09:31:08.651622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1006 sessionId: src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0 is DEAD
2025-10-02T09:31:08.651745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554586820582761:8404]
2025-10-02T09:31:08.651759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.651804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:08.651813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Write session will restart in 0.009387s
2025-10-02T09:31:08.651835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Write session: Do CDS request
2025-10-02T09:31:08.651840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.657575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.657866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.657986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.657993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.657999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.658031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.658053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047632:7104]
2025-10-02T09:31:08.658396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.659490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.659519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.659711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.659746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.659750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.659751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.659751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.659752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.659753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.659754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.659754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.659755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.659755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.659756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.659756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.659760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.659765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.659768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.659770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.659772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.659774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.659776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.659778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.659780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.659783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.659785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.659787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.659790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.659794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.659798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.659800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.659804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.659806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.659810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.659813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.659815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.659817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.659819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.659822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.659824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.659827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.659829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.659831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.659833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.659836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.659838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.659845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.659847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.659849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.659851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.659857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.659873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.662197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.662277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.662290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1007
2025-10-02T09:31:08.662379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.662398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.662403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.662406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.662672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1007 sessionId:  describe result for acl check
2025-10-02T09:31:08.662698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.662700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.662701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.662704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820582839:8431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.663023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820582839:8431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.664120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820582839:8431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.668480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820582839:8431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.668489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820582839:8431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.668491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820582839:8431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.668495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.669000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.670437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.670450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.670451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.670453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.670457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1006 [2:7556554586745047632:7104]
2025-10-02T09:31:08.670464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.670475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.670480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.670483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.670484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.670494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.670497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.670502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.670534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.670539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.670540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.670542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.670543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.670592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.670598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.670607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.670618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.670635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.670652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582775:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.670659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582870:8431], now have 1 active actors on pipe
2025-10-02T09:31:08.670664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.670666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.670668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.670676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.670690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.670691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.670693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.670695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.670705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.670707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.670704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1006
2025-10-02T09:31:08.670716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1006
2025-10-02T09:31:08.670727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.670733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.670734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.670752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.670758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.670785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|529e8574-46c8f68c-f1063c35-61e14fba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.670794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.670797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.670799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.670806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.670817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.670832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.670942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.670950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.670961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.671030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1007 partition: 0 MaxSeqNo: 36 sessionId: src_id|529e8574-46c8f68c-f1063c35-61e14fba_0
2025-10-02T09:31:08.671231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d9e3a-62665186-81e3de5b-c86d4952_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|529e8574-46c8f68c-f1063c35-61e14fba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.673411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Write session: try to update token
2025-10-02T09:31:08.673422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.683391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.683415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.683417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.683420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.683430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.683436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.683441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047627:7104]
2025-10-02T09:31:08.683474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.683482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.683484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.683486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.683490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.683493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.683727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.685141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId: src_id|529e8574-46c8f68c-f1063c35-61e14fba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.687083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.751906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554586820582889:8404]
2025-10-02T09:31:08.752180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1006, pipe: [1:7556554586820582889:8404]
2025-10-02T09:31:08.800702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.800912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.800921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.800949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582889:8404], now have 1 active actors on pipe
2025-10-02T09:31:08.801069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.801134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554586820582889:8404]
2025-10-02T09:31:08.801159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:08.801162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.801219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1007 reason: status is not ok: tablet will be restarted right now sessionId: src_id|529e8574-46c8f68c-f1063c35-61e14fba_0
2025-10-02T09:31:08.801365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1007 sessionId: src_id|529e8574-46c8f68c-f1063c35-61e14fba_0 is DEAD
2025-10-02T09:31:08.801489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:08.801496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Write session will restart in 0.006312s
2025-10-02T09:31:08.801513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Write session: Do CDS request
2025-10-02T09:31:08.801519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.807138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.808879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.809000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.809007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.809012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.809038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.809059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047718:7112]
2025-10-02T09:31:08.809175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.809254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.809265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1008
2025-10-02T09:31:08.809372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.809391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.809397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.809400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.809398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.809580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.809603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.809674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1008 sessionId:  describe result for acl check
2025-10-02T09:31:08.809692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.809696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.809697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.809700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820582949:8437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.809774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.809803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.809807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.809808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.809808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.809810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.809811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.809811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.809812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.809812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.809813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.809813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.809814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.809817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.809822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.809824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.809826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.809828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.809830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.809832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.809834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.809836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.809838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.809840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.809842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.809846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.809849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.809853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.809855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.809857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.809860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.809862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.809865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.809867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.809870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.809872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.809875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.809877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.809879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.809881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.809884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.809886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.809888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.809892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.809894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.809896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.809898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.809901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.809907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.809923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.810041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820582949:8437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.811705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820582949:8437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.816466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820582949:8437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.816475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820582949:8437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.816477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820582949:8437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.816481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.819006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.820513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.820524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.820525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.820527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.820531Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1007 [2:7556554586745047718:7112]
2025-10-02T09:31:08.820538Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.820547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.820552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.820555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.820556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.820565Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.820568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.820573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.820604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.820609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.820610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.820612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.820613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.820659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.820665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.820675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.820685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.820702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.820720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582898:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.820727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582985:8437], now have 1 active actors on pipe
2025-10-02T09:31:08.820732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.820737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.820738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.820746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.820759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.820760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.820762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.820765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.820774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.820776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.820763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1007
2025-10-02T09:31:08.820794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.820819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.820823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.820825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1007
2025-10-02T09:31:08.820845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.820852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.820871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f94a82f-32b62e10-e19941fa-793a727c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.820880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.820885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.820887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.820895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.820906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.820918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.821018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.821024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.821033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.821094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1008 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f94a82f-32b62e10-e19941fa-793a727c_0
2025-10-02T09:31:08.821292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529e8574-46c8f68c-f1063c35-61e14fba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f94a82f-32b62e10-e19941fa-793a727c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.823457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Write session: try to update token
2025-10-02T09:31:08.823466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.832252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.832268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.832269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.832271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.832276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.832279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.832281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047713:7112]
2025-10-02T09:31:08.832309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.832314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.832316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.832329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.832341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.832344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.832435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.834012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId: src_id|4f94a82f-32b62e10-e19941fa-793a727c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.835933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:08.901411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554586820582996:8404]
2025-10-02T09:31:08.901646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1007, pipe: [1:7556554586820582996:8404]
2025-10-02T09:31:08.949580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:08.949793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.949802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.949828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582996:8404], now have 1 active actors on pipe
2025-10-02T09:31:08.950032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:08.950042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:08.950077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554586820582996:8404]
2025-10-02T09:31:08.950084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:08.950153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f94a82f-32b62e10-e19941fa-793a727c_0
2025-10-02T09:31:08.950288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1008 sessionId: src_id|4f94a82f-32b62e10-e19941fa-793a727c_0 is DEAD
2025-10-02T09:31:08.950405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:08.950416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Write session will restart in 0.007496s
2025-10-02T09:31:08.950430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Write session: Do CDS request
2025-10-02T09:31:08.950434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:08.956521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:08.958101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:08.958218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:08.958226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:08.958232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:08.958259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:08.958283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554586745047809:7115]
2025-10-02T09:31:08.958629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:08.958871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:08.958907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:08.959122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:08.959154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.959159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.959159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.959160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.959160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.959161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.959162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.959162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.959163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.959163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.959164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.959164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.959168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.959175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.959178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.959180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.959182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.959185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.959188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.959191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.959195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.959199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.959201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.959204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.959209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.959214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:08.959219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.959232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.959223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:08.959226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.959229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:08.959232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.959236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:08.959239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.959242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:08.959245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.959249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:08.959252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.959257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:08.959260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.959264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:08.959270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.959275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:08.959281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.959284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.959286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.959293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.959295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.959297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.959297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:08.959308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1009
2025-10-02T09:31:08.959317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:08.959399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:08.959419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:08.959422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:08.959425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:08.959714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1009 sessionId:  describe result for acl check
2025-10-02T09:31:08.959739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:08.959744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:08.959745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:08.959749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554586820583055:8441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:08.960105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554586820583055:8441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:08.961656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554586820583055:8441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:08.967093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554586820583055:8441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:08.967103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554586820583055:8441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:08.967105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554586820583055:8441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:08.967110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:08.969196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:08.970829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:08.970841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:08.970842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:08.970844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:08.970848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1008 [2:7556554586745047809:7115]
2025-10-02T09:31:08.970857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:08.970868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:08.970870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.970872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.970873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.970884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:08.970890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:08.970896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:08.970949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.970954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.970955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.970957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:08.970958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:08.971009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:08.971016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.971025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:08.971038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:08.971055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:08.971076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820583086:8441], now have 1 active actors on pipe
2025-10-02T09:31:08.971083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554586820582998:2446], now have 1 active actors on pipe
2025-10-02T09:31:08.971089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.971095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.971096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.971090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1008
2025-10-02T09:31:08.971106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:08.971109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:08.971111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:08.971113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:08.971120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:08.971132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:08.971138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:08.971133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1008
2025-10-02T09:31:08.971174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.971181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.971190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.971199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:08.971210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:08.971223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:08.971233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:08.971239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:08.971241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:08.971247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:08.971258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:08.971275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.971370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:08.971376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:08.971386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:08.971440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1009 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0
2025-10-02T09:31:08.971672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f94a82f-32b62e10-e19941fa-793a727c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:08.973970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Write session: try to update token
2025-10-02T09:31:08.973983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:08.983804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:08.983824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:08.983826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:08.983828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:08.983836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.983839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.983842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554586745047804:7115]
2025-10-02T09:31:08.983872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:08.983877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:08.983881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:08.983882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:08.983884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:08.983884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:08.984009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:08.984946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId: src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:08.986965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.050404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115550389:8404]
2025-10-02T09:31:09.050678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1008, pipe: [1:7556554591115550389:8404]
2025-10-02T09:31:09.102008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:09.102219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.102230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.102256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550389:8404], now have 1 active actors on pipe
2025-10-02T09:31:09.102440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:09.102443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115550389:8404]
2025-10-02T09:31:09.102453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:09.102460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:09.102461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:09.102500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1009 reason: error at write: Disconnected sessionId: src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0
2025-10-02T09:31:09.102638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1009 sessionId: src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0 is DEAD
2025-10-02T09:31:09.102771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:09.102781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Write session will restart in 0.009575s
2025-10-02T09:31:09.102801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Write session: Do CDS request
2025-10-02T09:31:09.102807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:09.110148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:09.110480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:09.110590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:09.110597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:09.110603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:09.110629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:09.110661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554591040015194:7117]
2025-10-02T09:31:09.111034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:09.111226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:09.111254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:09.111461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:09.111502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.111508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.111509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.111510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.111511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.111513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.111517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.111518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.111519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.111520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.111521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.111522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.111526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.111537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.111541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.111544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.111551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.111554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.111562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.111565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.111569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.111577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.111580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.111587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.111593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.111600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.111610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.111614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.111621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.111624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.111626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.111629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.111631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.111634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.111636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.111639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.111641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.111645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.111647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.111653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.111655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.111658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.111660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.111663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.111665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.111669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.111674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.111676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.111695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:09.113227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.113326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:09.113338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1010
2025-10-02T09:31:09.113440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.113470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:09.113476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:09.113480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:09.113819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1010 sessionId:  describe result for acl check
2025-10-02T09:31:09.113848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:09.113849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:09.113850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:09.113854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554591115550446:8445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:09.114277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554591115550446:8445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:09.115886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554591115550446:8445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:09.121156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554591115550446:8445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:09.121167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554591115550446:8445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:09.121169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554591115550446:8445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:09.121173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:09.121738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:09.123161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:09.123174Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:09.123176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:09.123179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:09.123183Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1009 [2:7556554591040015194:7117]
2025-10-02T09:31:09.123191Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:09.123202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:09.123207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.123209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.123210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.123225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:09.123232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:09.123238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:09.123276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.123281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.123282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.123284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:09.123285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:09.123336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:09.123343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.123353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.123367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.123384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:09.123403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550391:2446], now have 1 active actors on pipe
2025-10-02T09:31:09.123408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550479:8445], now have 1 active actors on pipe
2025-10-02T09:31:09.123412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.123413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.123414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.123422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:09.123433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:09.123438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:09.123440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:09.123442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:09.123449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:09.123442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1009
2025-10-02T09:31:09.123455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:09.123468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1009
2025-10-02T09:31:09.123478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.123486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:09.123488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:09.123499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.123502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.123756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1588737d-8c71e363-58f12b74-a6a8585d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:09.123769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.123771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.123773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:09.123780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.123793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:09.123817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.123931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.123937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.123946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.124009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1010 partition: 0 MaxSeqNo: 36 sessionId: src_id|1588737d-8c71e363-58f12b74-a6a8585d_0
2025-10-02T09:31:09.124258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c9c0d6-51ee9b44-2fa86c7c-4d03d646_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1588737d-8c71e363-58f12b74-a6a8585d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:09.126593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Write session: try to update token
2025-10-02T09:31:09.126605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:09.134142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:09.134159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:09.134161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:09.134162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:09.134167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.134169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.134172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554591040015189:7117]
2025-10-02T09:31:09.134196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:09.134201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.134203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:09.134204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:09.134208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:09.134211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:09.134314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:09.137591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId: src_id|1588737d-8c71e363-58f12b74-a6a8585d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:09.139611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.202484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115550489:8404]
2025-10-02T09:31:09.202698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1009, pipe: [1:7556554591115550489:8404]
2025-10-02T09:31:09.263333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:09.263530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.263539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.263563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550489:8404], now have 1 active actors on pipe
2025-10-02T09:31:09.263674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:09.263709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115550489:8404]
2025-10-02T09:31:09.263733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:09.263748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:09.263788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1010 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1588737d-8c71e363-58f12b74-a6a8585d_0
2025-10-02T09:31:09.263946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1010 sessionId: src_id|1588737d-8c71e363-58f12b74-a6a8585d_0 is DEAD
2025-10-02T09:31:09.264075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:09.264080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Write session will restart in 0.006952s
2025-10-02T09:31:09.264097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Write session: Do CDS request
2025-10-02T09:31:09.264101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:09.269575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:09.271111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:09.271239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:09.271245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:09.271251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:09.271286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:09.271309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554591040015285:7120]
2025-10-02T09:31:09.271649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:09.271843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:09.271868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:09.272050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:09.272081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.272082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.272082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.272083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.272084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.272084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.272085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.272085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.272086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.272086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.272089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.272089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.272092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.272099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.272101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.272103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.272105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.272107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.272109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.272111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.272148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.272113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.272115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.272117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.272119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.272123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.272127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.272131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.272135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.272137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.272139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.272141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.272144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.272146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.272149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.272150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.272153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.272155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.272157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.272159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.272162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.272164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.272167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.272169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.272171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.272173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.272176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.272178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.272180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.272196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:09.272269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:09.272281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1011
2025-10-02T09:31:09.272376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.272394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:09.272401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:09.272404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:09.272719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1011 sessionId:  describe result for acl check
2025-10-02T09:31:09.272747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:09.272755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:09.272756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:09.272761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554591115550547:8450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:09.273207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554591115550547:8450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:09.274596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554591115550547:8450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:09.280090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554591115550547:8450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:09.280100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554591115550547:8450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:09.280102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554591115550547:8450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:09.280106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:09.281500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:09.282921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:09.282932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:09.282933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:09.282935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:09.282939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1010 [2:7556554591040015285:7120]
2025-10-02T09:31:09.282947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:09.282959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:09.282960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.282962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.282963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.282972Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:09.282975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:09.282979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:09.283011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.283014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.283015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.283017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:09.283018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:09.283061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:09.283066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.283074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.283080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.283089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:09.283107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550491:2446], now have 1 active actors on pipe
2025-10-02T09:31:09.283114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550581:8450], now have 1 active actors on pipe
2025-10-02T09:31:09.283120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.283121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.283123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.283128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1010
2025-10-02T09:31:09.283133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:09.283144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:09.283146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:09.283147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:09.283148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:09.283159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:09.283161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:09.283174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1010
2025-10-02T09:31:09.283184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.283191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:09.283192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:09.283208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.283211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.283233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|779ffe79-b6b310fb-594d4609-ca860505_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:09.283243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.283245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.283247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:09.283254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.283264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:09.283280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.283365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.283372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.283384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.283452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1011 partition: 0 MaxSeqNo: 36 sessionId: src_id|779ffe79-b6b310fb-594d4609-ca860505_0
2025-10-02T09:31:09.283674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1588737d-8c71e363-58f12b74-a6a8585d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|779ffe79-b6b310fb-594d4609-ca860505_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:09.285958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Write session: try to update token
2025-10-02T09:31:09.285974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:09.293528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:09.293545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:09.293547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:09.293548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:09.293553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.293556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.293558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554591040015280:7120]
2025-10-02T09:31:09.293582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:09.293584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:09.293586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.293587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:09.293588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:09.293590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:09.293699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:09.297874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId: src_id|779ffe79-b6b310fb-594d4609-ca860505_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:09.299917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.363749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115550589:8404]
2025-10-02T09:31:09.363957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1010, pipe: [1:7556554591115550589:8404]
2025-10-02T09:31:09.414623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:09.415265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.415279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.415309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550589:8404], now have 1 active actors on pipe
2025-10-02T09:31:09.415490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:09.415520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115550589:8404]
2025-10-02T09:31:09.415528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:09.415530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:09.415575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1011 reason: error at write: Disconnected sessionId: src_id|779ffe79-b6b310fb-594d4609-ca860505_0
2025-10-02T09:31:09.415615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:09.415719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1011 sessionId: src_id|779ffe79-b6b310fb-594d4609-ca860505_0 is DEAD
2025-10-02T09:31:09.415829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:09.415842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Write session will restart in 0.008679s
2025-10-02T09:31:09.415864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Write session: Do CDS request
2025-10-02T09:31:09.415870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:09.421422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:09.422770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:09.422868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:09.422874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:09.422880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:09.422905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:09.422948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554591040015375:7122]
2025-10-02T09:31:09.423339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:09.423505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:09.423530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:09.423711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:09.423741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.423745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.423746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.423746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.423748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.423749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.423750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.423750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.423750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.423751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.423751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.423752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.423755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.423761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.423763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.423765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.423767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.423769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.423771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.423772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.423774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.423776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.423778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.423780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.423784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.423788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.423791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.423794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.423796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.423798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.423800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.423803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.423806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.423808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.423810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.423814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.423816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.423818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.423820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.423823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.423825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.423829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.423834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.423837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.423839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.423842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.423844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.423846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.423867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:09.425217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.425323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:09.425334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1012
2025-10-02T09:31:09.425415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.425434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:09.425440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:09.425444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:09.425775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1012 sessionId:  describe result for acl check
2025-10-02T09:31:09.425804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:09.425810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:09.425813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:09.425817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554591115550647:8454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:09.426266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554591115550647:8454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:09.427686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554591115550647:8454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:09.432655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554591115550647:8454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:09.432665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554591115550647:8454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:09.432667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554591115550647:8454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:09.432671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:09.433195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:09.434755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:09.434766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:09.434767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:09.434769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:09.434774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1011 [2:7556554591040015375:7122]
2025-10-02T09:31:09.434783Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:09.434796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:09.434804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.434806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.434809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.434823Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:09.434828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:09.434833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:09.434867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.434872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.434873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.434874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:09.434876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:09.434927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:09.434933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.434943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.434956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.434975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:09.434989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550683:8454], now have 1 active actors on pipe
2025-10-02T09:31:09.434993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550590:2446], now have 1 active actors on pipe
2025-10-02T09:31:09.435001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.435002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.435004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.435014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:09.435026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:09.435027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:09.435032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:09.435033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:09.435039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:09.435041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:09.435020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1011
2025-10-02T09:31:09.435025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1011
2025-10-02T09:31:09.435078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.435084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.435094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.435102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:09.435109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:09.435121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:09.435128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.435130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.435131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:09.435136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.435145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:09.435160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.435240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.435245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.435254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.435317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1012 partition: 0 MaxSeqNo: 36 sessionId: src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0
2025-10-02T09:31:09.435538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|779ffe79-b6b310fb-594d4609-ca860505_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:09.437705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Write session: try to update token
2025-10-02T09:31:09.437717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:09.445421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:09.445438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:09.445440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:09.445442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:09.445449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.445452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.445456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554591040015370:7122]
2025-10-02T09:31:09.445486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:09.445490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:09.445492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.445493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:09.445499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:09.445502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:09.445624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:09.448384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId: src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:09.450527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.515822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115550690:8404]
2025-10-02T09:31:09.516060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1011, pipe: [1:7556554591115550690:8404]
2025-10-02T09:31:09.567525Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:09.567761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.567771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.567795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550690:8404], now have 1 active actors on pipe
2025-10-02T09:31:09.567945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:09.567987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:09.567998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:09.568022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:09.568045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1012 reason: error at write: Disconnected sessionId: src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0
2025-10-02T09:31:09.568056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115550690:8404]
2025-10-02T09:31:09.568196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1012 sessionId: src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0 is DEAD
2025-10-02T09:31:09.568329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:09.568338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Write session will restart in 0.006145s
2025-10-02T09:31:09.568356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Write session: Do CDS request
2025-10-02T09:31:09.568362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:09.575066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:09.575165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.575229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:09.575241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1013
2025-10-02T09:31:09.575320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.575341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:09.575348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:09.575350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:09.575644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1013 sessionId:  describe result for acl check
2025-10-02T09:31:09.575671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:09.575675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:09.575676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:09.575679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554591115550745:8458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:09.576098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554591115550745:8458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:09.576818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:09.576932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:09.576938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:09.576943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:09.576974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:09.576998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554591040015467:7124]
2025-10-02T09:31:09.577339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:09.577507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:09.577529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:09.577702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:09.577674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554591115550745:8458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:09.577730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.577734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.577735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.577735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.577736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.577737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.577737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.577738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.577738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.577739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.577739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.577740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.577743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.577748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.577751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.577753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.577755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.577757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.577759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.577761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.577763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.577765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.577767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.577769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.577772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.577776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.577779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.577783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.577785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.577788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.577790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.577792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.577794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.577797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.577802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.577805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.577807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.577810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.577812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.577814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.577819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.577822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.577825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.577831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.577833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.577836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.577838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.577840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.577859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:09.583913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554591115550745:8458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:09.583923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554591115550745:8458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:09.583925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554591115550745:8458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:09.583929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:09.587337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:09.588907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:09.588917Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:09.588919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:09.588921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:09.588925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1012 [2:7556554591040015467:7124]
2025-10-02T09:31:09.588933Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:09.588943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:09.588948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.588949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.588950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.588960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:09.588966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:09.588970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:09.589004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.589010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.589012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.589014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:09.589016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:09.589060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:09.589065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.589072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.589080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.589095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:09.589114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550784:8458], now have 1 active actors on pipe
2025-10-02T09:31:09.589121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550691:2446], now have 1 active actors on pipe
2025-10-02T09:31:09.589127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.589132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.589134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.589145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:09.589139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1012
2025-10-02T09:31:09.589147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1012
2025-10-02T09:31:09.589155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:09.589161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:09.589162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:09.589165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:09.589173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:09.589179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:09.589203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.589208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.589216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.589224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:09.589231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:09.589244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|561fb347-2a056de3-f79881fd-9b99aa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:09.589252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.589254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.589255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:09.589261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.589269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:09.589284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.589376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.589382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.589393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.589438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1013 partition: 0 MaxSeqNo: 36 sessionId: src_id|561fb347-2a056de3-f79881fd-9b99aa2_0
2025-10-02T09:31:09.589674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142efe5d-dd4c63d0-67d59503-c2c6d0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|561fb347-2a056de3-f79881fd-9b99aa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:09.591937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Write session: try to update token
2025-10-02T09:31:09.591949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:09.599592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:09.599608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:09.599610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:09.599611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:09.599616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.599618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.599620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554591040015462:7124]
2025-10-02T09:31:09.599645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:09.599649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.599649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:09.599652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:09.599652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:09.599655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:09.599766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:09.602612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId: src_id|561fb347-2a056de3-f79881fd-9b99aa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:09.604610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.668374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115550805:8404]
2025-10-02T09:31:09.668552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1012, pipe: [1:7556554591115550805:8404]
2025-10-02T09:31:09.720428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:09.720740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.720750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.720776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550805:8404], now have 1 active actors on pipe
2025-10-02T09:31:09.720935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:09.720961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:09.720965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115550805:8404]
2025-10-02T09:31:09.720975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:09.720978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:09.721020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1013 reason: error at write: Disconnected sessionId: src_id|561fb347-2a056de3-f79881fd-9b99aa2_0
2025-10-02T09:31:09.721146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1013 sessionId: src_id|561fb347-2a056de3-f79881fd-9b99aa2_0 is DEAD
2025-10-02T09:31:09.721268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:09.721277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Write session will restart in 0.005489s
2025-10-02T09:31:09.721294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Write session: Do CDS request
2025-10-02T09:31:09.721299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:09.727186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:09.728168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.728225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:09.728236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1014
2025-10-02T09:31:09.728324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.728345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:09.728351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:09.728354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:09.728652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1014 sessionId:  describe result for acl check
2025-10-02T09:31:09.728679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:09.728680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:09.728681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:09.728683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554591115550884:8470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:09.728718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:09.728838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:09.728846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:09.728851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:09.728881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:09.728904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554591040015609:7139]
2025-10-02T09:31:09.729061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554591115550884:8470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:09.729273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:09.729447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:09.729472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:09.729660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:09.729690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.729694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.729695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.729696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.729696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.729697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.729697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.729698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.729698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.729699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.729699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.729700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.729703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.729710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.729712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.729715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.729717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.729719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.729721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.729723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.729725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.729727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.729730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.729732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.729736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.729740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.729744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.729746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.729749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.729752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.729754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.729756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.729759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.729762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.729764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.729767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.729769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.729772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.729774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.729777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.729779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.729781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.729783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.729786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.729788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.729791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.729793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.729797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.729814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:09.731078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554591115550884:8470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:09.737448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554591115550884:8470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:09.737458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554591115550884:8470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:09.737460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554591115550884:8470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:09.737465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:09.739247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:09.740845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:09.740855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:09.740856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:09.740859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:09.740864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1013 [2:7556554591040015609:7139]
2025-10-02T09:31:09.740874Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:09.740891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:09.740896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.740897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.740898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.740907Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:09.740910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:09.740914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:09.740948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.740954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.740955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.740957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:09.740958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:09.740999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:09.741004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.741011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.741017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.741035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:09.741054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550925:8470], now have 1 active actors on pipe
2025-10-02T09:31:09.741061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550829:2446], now have 1 active actors on pipe
2025-10-02T09:31:09.741066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.741072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.741073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.741085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:09.741072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1013
2025-10-02T09:31:09.741086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1013
2025-10-02T09:31:09.741101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:09.741101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:09.741103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:09.741105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:09.741116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:09.741123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:09.741154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.741161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.741173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.741183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:09.741195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:09.741207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79590a4a-fd241e07-fe195998-7d129329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:09.741214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.741217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.741218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:09.741223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.741232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:09.741251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.741343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.741351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.741362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.741416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1014 partition: 0 MaxSeqNo: 36 sessionId: src_id|79590a4a-fd241e07-fe195998-7d129329_0
2025-10-02T09:31:09.741671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561fb347-2a056de3-f79881fd-9b99aa2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|79590a4a-fd241e07-fe195998-7d129329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:09.743854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Write session: try to update token
2025-10-02T09:31:09.743864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:09.751364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:09.751380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:09.751381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:09.751382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:09.751387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.751390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.751393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554591040015604:7139]
2025-10-02T09:31:09.751417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:09.751421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.751422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:09.751426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:09.751431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:09.751433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:09.751537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:09.753968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId: src_id|79590a4a-fd241e07-fe195998-7d129329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:09.755829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.820962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115550941:8404]
2025-10-02T09:31:09.821161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1013, pipe: [1:7556554591115550941:8404]
2025-10-02T09:31:09.871941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:09.872135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.872144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.872170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550941:8404], now have 1 active actors on pipe
2025-10-02T09:31:09.872292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:09.872313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115550941:8404]
2025-10-02T09:31:09.872337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:09.872344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:09.872390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1014 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79590a4a-fd241e07-fe195998-7d129329_0
2025-10-02T09:31:09.872519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1014 sessionId: src_id|79590a4a-fd241e07-fe195998-7d129329_0 is DEAD
2025-10-02T09:31:09.872665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:09.872673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Write session will restart in 0.007055s
2025-10-02T09:31:09.872688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Write session: Do CDS request
2025-10-02T09:31:09.872692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:09.878297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:09.879886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:09.880003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:09.880009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:09.880015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:09.880043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:09.880068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554591040015703:7141]
2025-10-02T09:31:09.880424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:09.880600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:09.880625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:09.880816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:09.880860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.880865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.880866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.880866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.880867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.880867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.880868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.880868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.880869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.880869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.880870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.880870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.880873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.880880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.880882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.880884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.880886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.880888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.880890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.880892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.880894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.880897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.880899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.880901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.880905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.880909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:09.880912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.880915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:09.880918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.880921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:09.880923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.880925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:09.880927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.880930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:09.880932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.880934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:09.880937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.880939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:09.880941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.880944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:09.880947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.880950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:09.880952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.880955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.880957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.880960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.880962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.880964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.880981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:09.881099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.881190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:09.881198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1015
2025-10-02T09:31:09.881290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:09.881309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:09.881315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:09.881317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:09.881574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1015 sessionId:  describe result for acl check
2025-10-02T09:31:09.881599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:09.881604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:09.881605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:09.881609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554591115551005:8475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:09.881941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554591115551005:8475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:09.883222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554591115551005:8475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:09.887479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554591115551005:8475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:09.887488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554591115551005:8475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:09.887489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554591115551005:8475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:09.887493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:09.888764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:09.890287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:09.890299Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:09.890300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:09.890302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:09.890305Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1014 [2:7556554591040015703:7141]
2025-10-02T09:31:09.890313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:09.890324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:09.890329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.890330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.890332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.890342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:09.890347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:09.890352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:09.890382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.890387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.890388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.890389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:09.890391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:09.890430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:09.890436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.890445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:09.890458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:09.890475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:09.890493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115550945:2446], now have 1 active actors on pipe
2025-10-02T09:31:09.890500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115551040:8475], now have 1 active actors on pipe
2025-10-02T09:31:09.890503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.890505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.890506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.890514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:09.890509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1014
2025-10-02T09:31:09.890514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1014
2025-10-02T09:31:09.890524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:09.890530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:09.890534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:09.890535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:09.890541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:09.890542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:09.890569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.890576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.890584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.890594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:09.890606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:09.890615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22f381b9-774b5638-76572ce6-265bd64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:09.890620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:09.890627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:09.890629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:09.890634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:09.890641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:09.890659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.890744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:09.890750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:09.890760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:09.890812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1015 partition: 0 MaxSeqNo: 36 sessionId: src_id|22f381b9-774b5638-76572ce6-265bd64_0
2025-10-02T09:31:09.890991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79590a4a-fd241e07-fe195998-7d129329_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22f381b9-774b5638-76572ce6-265bd64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:09.893152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Write session: try to update token
2025-10-02T09:31:09.893161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:09.900570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:09.900584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:09.900585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:09.900586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:09.900592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.900594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.900597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554591040015698:7141]
2025-10-02T09:31:09.900620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:09.900624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:09.900624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:09.900625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:09.900627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:09.900629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:09.900745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:09.903347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId: src_id|22f381b9-774b5638-76572ce6-265bd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:09.905263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:09.972520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554591115551048:8404]
2025-10-02T09:31:09.972709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1014, pipe: [1:7556554591115551048:8404]
2025-10-02T09:31:10.023582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.023913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.023922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.023946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554591115551048:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.024070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.024073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.024103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:10.024106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:10.024113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554591115551048:8404]
2025-10-02T09:31:10.024164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1015 reason: error at write: Disconnected sessionId: src_id|22f381b9-774b5638-76572ce6-265bd64_0
2025-10-02T09:31:10.024325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1015 sessionId: src_id|22f381b9-774b5638-76572ce6-265bd64_0 is DEAD
2025-10-02T09:31:10.024456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:10.024464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Write session will restart in 0.005046s
2025-10-02T09:31:10.024481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Write session: Do CDS request
2025-10-02T09:31:10.024485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.029944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.030071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.030160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.030169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1016
2025-10-02T09:31:10.030256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.030274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.030277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.030280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.030533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1016 sessionId:  describe result for acl check
2025-10-02T09:31:10.030557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.030559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.030560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.030563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410518402:8479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.030971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410518402:8479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.031392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.031487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.031493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.031499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.031524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.031547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983096:7144]
2025-10-02T09:31:10.031898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.032062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.032086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.032229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410518402:8479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.032263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.032293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.032297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.032298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.032298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.032299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.032299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.032300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.032300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.032301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.032301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.032302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.032302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.032305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.032311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.032313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.032315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.032317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.032319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.032321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.032323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.032325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.032327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.032329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.032332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.032335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.032339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.032343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.032346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.032348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.032350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.032353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.032355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.032371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.032373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.032375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.032378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.032380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.032383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.032385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.032388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.032390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.032393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.032395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.032398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.032400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.032403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.032405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.032408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.032426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.036468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410518402:8479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.036479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410518402:8479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.036481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410518402:8479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.036485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.040328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.041906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.041919Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.041920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.041922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.041925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1015 [2:7556554595334983096:7144]
2025-10-02T09:31:10.041933Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.041943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.041945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.041947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.041948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.041957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.041964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.041968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.042001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.042005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.042006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.042008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.042010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.042051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.042058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.042067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.042078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.042093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.042111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.042117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.042118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.042123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.042130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.042134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.042136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.042138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.042146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.042150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.042159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518441:8479], now have 1 active actors on pipe
2025-10-02T09:31:10.042165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518345:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.042180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.042189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.042183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1015
2025-10-02T09:31:10.042185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1015
2025-10-02T09:31:10.042200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.042221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.042228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.042246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.042256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.042260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.042262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.042269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.042279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.042293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.042399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.042405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.042416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.042463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1016 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0
2025-10-02T09:31:10.042676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22f381b9-774b5638-76572ce6-265bd64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.044968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Write session: try to update token
2025-10-02T09:31:10.044978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.051787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:10.051802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.051808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.051835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:10.051836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:10.051980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:10.052098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:10.052214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:10.052335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:10.052493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:10.052518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:10.055631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId: src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.057642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:10.057760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.057773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.057791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:10.057854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:10.060655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.060666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.060667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.060668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.060673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.060675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.060677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983091:7144]
2025-10-02T09:31:10.060697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.060698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.060701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.060703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.060706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.060708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.060828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.124073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554595410518449:8404]
2025-10-02T09:31:10.124254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1015, pipe: [1:7556554595410518449:8404]
2025-10-02T09:31:10.176171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.182283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.182304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.182424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.182473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.182525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.182590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.182628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.182635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.182685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.182735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.182789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.182840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.183037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.183045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.183096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.183144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.183194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.183245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.183281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.183286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.183337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.183389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.183441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.183526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.183561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.183566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.183621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.183701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.183750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.183798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.183832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.183837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.183887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.183934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.183984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.184034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.184074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.184080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.184163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.184210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.184262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.184313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.184347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.184352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.184400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.184446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.184495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.184542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.184637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.184646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.184695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.184750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.184811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.184856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.185050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.185056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.185105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.185153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.185200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.185248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.185337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.185344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.185375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518449:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.185531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:10.185539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.185544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:10.185563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1016 reason: error at write: Disconnected sessionId: src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0
2025-10-02T09:31:10.185568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554595410518449:8404]
2025-10-02T09:31:10.185693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1016 sessionId: src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0 is DEAD
2025-10-02T09:31:10.185827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:10.185836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Write session will restart in 0.009779s
2025-10-02T09:31:10.185853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Write session: Do CDS request
2025-10-02T09:31:10.185859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.185870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.192006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.193549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.193667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.193675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.193680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.193708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.193732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983194:7147]
2025-10-02T09:31:10.194095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.194273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.194305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.194487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.194516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.194520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.194520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.194521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.194522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.194522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.194523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.194523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.194524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.194524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.194525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.194526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.194530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.194537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.194539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.194541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.194543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.194545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.194547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.194549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.194551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.194553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.194555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.194557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.194561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.194564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.194568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.194574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.194576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.194579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.194584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.194587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.194589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.194592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.194597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.194600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.194601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.194604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.194607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.194613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.194615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.194617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.194622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.194625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.194629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.194634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.194636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.194639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.194655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.196165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.196254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.196265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1017
2025-10-02T09:31:10.196353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.196372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.196374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.196377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.196661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1017 sessionId:  describe result for acl check
2025-10-02T09:31:10.196692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.196700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.196701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.196705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410518514:8484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.197085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410518514:8484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.199088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410518514:8484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.202004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410518514:8484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.202013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410518514:8484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.202015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410518514:8484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.202019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.202579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.204140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.204153Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.204154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.204157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.204160Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1016 [2:7556554595334983194:7147]
2025-10-02T09:31:10.204167Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.204177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.204179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.204180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.204181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.204191Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.204193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.204198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.204232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.204237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.204238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.204241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.204243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.204284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.204289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.204299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.204312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.204326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.204344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518452:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.204352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518548:8484], now have 1 active actors on pipe
2025-10-02T09:31:10.204346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1016
2025-10-02T09:31:10.204357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1016
2025-10-02T09:31:10.204355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.204361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.204362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.204368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.204383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.204384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.204386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.204387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.204398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.204406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.204420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.204422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.204444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.204452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.204461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.204461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.204465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.204467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.204468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.204474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.204479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.204498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.204590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.204598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.204608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.204681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1017 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0
2025-10-02T09:31:10.204926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4b3be-b3c71eb4-e93343e1-ba12caa1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.207058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Write session: try to update token
2025-10-02T09:31:10.207066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.214053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.214070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.214073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.214076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.214084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.214087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.214090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983189:7147]
2025-10-02T09:31:10.214120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.214124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.214128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.214130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.214130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.214132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.214244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.217778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId: src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.219822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:10.285859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554595410518557:8404]
2025-10-02T09:31:10.286039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1016, pipe: [1:7556554595410518557:8404]
2025-10-02T09:31:10.346177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.346582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.346593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.346624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518557:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.346812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.346795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554595410518557:8404]
2025-10-02T09:31:10.346822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:10.346825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:10.346825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.346871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1017 reason: error at write: Disconnected sessionId: src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0
2025-10-02T09:31:10.347040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1017 sessionId: src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0 is DEAD
2025-10-02T09:31:10.347147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:10.347155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Write session will restart in 0.009935s
2025-10-02T09:31:10.347187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Write session: Do CDS request
2025-10-02T09:31:10.347191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.353062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.354860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.354974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.354981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.354986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.355011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.355035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983290:7149]
2025-10-02T09:31:10.355375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.355535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.355569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.355766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.355798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.355802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.355802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.355803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.355803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.355804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.355804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.355805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.355805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.355806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.355806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.355807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.355810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.355817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.355819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.355821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.355823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.355825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.355827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.355829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.355831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.355833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.355835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.355836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.355841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.355845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.355849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.355852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.355854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.355857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.355859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.355862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.355865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.355869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.355871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.355873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.355875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.355878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.355880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.355883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.355885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.355888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.355889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.355892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.355894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.355896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.355898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.355901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.355917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.358150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.358241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.358252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1018
2025-10-02T09:31:10.358363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.358382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.358389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.358392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.358667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1018 sessionId:  describe result for acl check
2025-10-02T09:31:10.358689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.358690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.358691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.358695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410518623:8488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.359063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410518623:8488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.360491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410518623:8488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.362771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410518623:8488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.362781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410518623:8488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.362784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410518623:8488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.362789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.363394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.364772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.364785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.364786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.364788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.364791Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1017 [2:7556554595334983290:7149]
2025-10-02T09:31:10.364818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.364835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.364840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.364841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.364842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.364852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.364855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.364859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.364893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.364897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.364898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.364900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.364901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.364945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.364952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.364961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.364974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.364992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.365010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518559:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.365016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518657:8488], now have 1 active actors on pipe
2025-10-02T09:31:10.365020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.365022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.365024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.365033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.365047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.365047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.365049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.365035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1017
2025-10-02T09:31:10.365051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.365040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1017
2025-10-02T09:31:10.365062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.365065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.365092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.365099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.365108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.365118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.365126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.365139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47b922e3-69587761-8b9bac17-28a44ac0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.365149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.365155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.365157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.365164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.365175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.365193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.365304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.365313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.365327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.365380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1018 partition: 0 MaxSeqNo: 36 sessionId: src_id|47b922e3-69587761-8b9bac17-28a44ac0_0
2025-10-02T09:31:10.365598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f851d14-cb98b5e8-4238edf8-869134b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47b922e3-69587761-8b9bac17-28a44ac0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.367852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Write session: try to update token
2025-10-02T09:31:10.367864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.374772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.374789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.374790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.374791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.374796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.374799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.374801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983285:7149]
2025-10-02T09:31:10.374825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.374827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.374829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.374830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.374831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.374833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.374955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.378301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId: src_id|47b922e3-69587761-8b9bac17-28a44ac0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.380271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:10.447134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554595410518665:8404]
2025-10-02T09:31:10.447293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1017, pipe: [1:7556554595410518665:8404]
2025-10-02T09:31:10.490554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.491174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.491184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.491211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518665:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.491393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.491467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.491494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554595410518665:8404]
2025-10-02T09:31:10.491507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:10.491582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1018 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47b922e3-69587761-8b9bac17-28a44ac0_0
2025-10-02T09:31:10.491713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1018 sessionId: src_id|47b922e3-69587761-8b9bac17-28a44ac0_0 is DEAD
2025-10-02T09:31:10.491832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:10.491840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Write session will restart in 0.009509s
2025-10-02T09:31:10.491853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Write session: Do CDS request
2025-10-02T09:31:10.491857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.497545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.499265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.499438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.499452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.499462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.499513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.499553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983388:7151]
2025-10-02T09:31:10.500092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.500334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.500378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.500638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.500686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.500690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.500691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.500691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.500692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.500692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.500693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.500693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.500694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.500694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.500695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.500695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.500698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.500705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.500707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.500709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.500711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.500713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.500715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.500717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.500719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.500721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.500723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.500725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.500730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.500734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.500738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.500741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.500743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.500745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.500749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.500751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.500754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.500756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.500758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.500761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.500764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.500766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.500768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.500771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.500774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.500776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.500779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.500782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.500784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.500786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.500792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.500795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.500831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.502187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.502274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.502285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1019
2025-10-02T09:31:10.502375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.502395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.502398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.502400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.502655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1019 sessionId:  describe result for acl check
2025-10-02T09:31:10.502683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.502684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.502685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.502688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410518730:8492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.503082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410518730:8492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.504351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410518730:8492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.507903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410518730:8492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.507913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410518730:8492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.507915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410518730:8492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.507920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.508504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.510127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.510141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.510143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.510146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.510150Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1018 [2:7556554595334983388:7151]
2025-10-02T09:31:10.510157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.510168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.510170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.510173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.510174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.510185Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.510189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.510193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.510228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.510235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.510236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.510238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.510239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.510280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.510284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.510292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.510297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.510309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.510323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.510328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.510329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.510334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.510345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.510348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.510351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.510353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.510356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.510358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.510380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518666:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.510388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518764:8492], now have 1 active actors on pipe
2025-10-02T09:31:10.510390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.510396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.510410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.510425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1018
2025-10-02T09:31:10.510425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1018
2025-10-02T09:31:10.510501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.510510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.510525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.510532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.510534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.510539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.510545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.510550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.510561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.510683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.510688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.510696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.510757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1019 partition: 0 MaxSeqNo: 36 sessionId: src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0
2025-10-02T09:31:10.511011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b922e3-69587761-8b9bac17-28a44ac0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.513283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Write session: try to update token
2025-10-02T09:31:10.513305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.519746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:10.519761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.519766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.519795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:10.519815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:10.519930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:10.520039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:10.520149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:10.520254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:10.520417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:10.520443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:10.523816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId: src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.525779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:10.526223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.526236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.526252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:10.526321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:10.528589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.528606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.528608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.528610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.528619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.528625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.528631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983383:7151]
2025-10-02T09:31:10.528668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.528669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.528673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.528675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.528678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.528680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.528871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.591542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554595410518772:8404]
2025-10-02T09:31:10.591770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1018, pipe: [1:7556554595410518772:8404]
2025-10-02T09:31:10.642224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.648255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.648276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.648405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.648457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.648512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.648567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.648608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.648616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.648671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.648728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.648786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.648854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.648891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.648897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.648954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.649006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.649065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.649118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.649158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.649163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.649214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.649269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.649321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.649375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.649411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.649417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.649471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.649521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.649573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.649624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.649680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.649686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.649740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.649793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.649844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.649894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.649931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.649936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.649985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.650035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.650089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.650142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.650179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.650184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.650236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.650287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.650344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.650406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.650457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.650464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.650516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.650563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.650613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.650662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.650696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.650702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.650749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:10.650798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:10.650863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:10.650923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:10.650965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:10.650973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:10.651016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518772:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.651213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:10.651217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554595410518772:8404]
2025-10-02T09:31:10.651229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:10.651236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.651252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1019 reason: error at write: Disconnected sessionId: src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0
2025-10-02T09:31:10.651429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1019 sessionId: src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0 is DEAD
2025-10-02T09:31:10.651554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:10.651563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Write session will restart in 0.006630s
2025-10-02T09:31:10.651580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Write session: Do CDS request
2025-10-02T09:31:10.651584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.651730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.658020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.659170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.659238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.659249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1020
2025-10-02T09:31:10.659319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.659339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.659346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.659348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.659630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1020 sessionId:  describe result for acl check
2025-10-02T09:31:10.659651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.659655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.659656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.659659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410518835:8496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.659981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.660014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410518835:8496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.660093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.660099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.660105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.660134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.660166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983499:7154]
2025-10-02T09:31:10.660522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.660724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.660760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.661020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.661068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.661073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.661073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.661074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.661074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.661075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.661075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.661076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.661076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.661077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.661077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.661078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.661081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.661087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.661089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.661091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.661093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.661095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.661097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.661099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.661101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.661103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.661105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.661107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.661110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.661115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.661119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.661121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.661123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.661126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.661128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.661132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.661135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.661140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.661145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.661148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.661152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.661159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.661162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.661168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.661172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.661182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.661187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.661191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.661196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.661201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.661207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.661212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.661232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.661890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410518835:8496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.666111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410518835:8496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.666121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410518835:8496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.666123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410518835:8496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.666127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.668879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.670461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.670473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.670474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.670476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.670481Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1019 [2:7556554595334983499:7154]
2025-10-02T09:31:10.670491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.670508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.670515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.670517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.670519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.670529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.670535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.670539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.670571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.670576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.670577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.670579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.670580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.670618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.670623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.670629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.670640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.670657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.670676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518774:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.670683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518874:8496], now have 1 active actors on pipe
2025-10-02T09:31:10.670688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.670692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.670693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.670687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1019
2025-10-02T09:31:10.670700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1019
2025-10-02T09:31:10.670702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.670709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.670710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.670712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.670712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.670720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.670721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.670745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.670752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.670759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.670764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.670771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.670781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3397502-ffafeddd-96a03fa-5e62b533_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.670785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.670788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.670789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.670794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.670799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.670813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.670919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.670926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.670937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.670997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1020 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3397502-ffafeddd-96a03fa-5e62b533_0
2025-10-02T09:31:10.671205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebd7b2-95ddd0f4-ce151834-6086cf8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3397502-ffafeddd-96a03fa-5e62b533_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.673419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Write session: try to update token
2025-10-02T09:31:10.673430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.680200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.680214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.680215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.680216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.680222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.680224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.680226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983494:7154]
2025-10-02T09:31:10.680248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.680250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.680254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.680254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.680255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.680256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.680376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.683836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId: src_id|b3397502-ffafeddd-96a03fa-5e62b533_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.685855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:10.751282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554595410518915:8404]
2025-10-02T09:31:10.751553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1019, pipe: [1:7556554595410518915:8404]
2025-10-02T09:31:10.797875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.798091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.798100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.798127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518915:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.798275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554595410518915:8404]
2025-10-02T09:31:10.798279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.798303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:10.798305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:10.798347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1020 reason: error at write: Disconnected sessionId: src_id|b3397502-ffafeddd-96a03fa-5e62b533_0
2025-10-02T09:31:10.798375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.798518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1020 sessionId: src_id|b3397502-ffafeddd-96a03fa-5e62b533_0 is DEAD
2025-10-02T09:31:10.798649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:10.798657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Write session will restart in 0.006644s
2025-10-02T09:31:10.798671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Write session: Do CDS request
2025-10-02T09:31:10.798675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.804350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.806020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.806117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.806122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.806128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.806135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.806160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.806184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983634:7168]
2025-10-02T09:31:10.806242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.806255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1021
2025-10-02T09:31:10.806345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.806368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.806376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.806379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.806625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.806652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1021 sessionId:  describe result for acl check
2025-10-02T09:31:10.806677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.806681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.806682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.806685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410518984:8509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.806825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.806851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.807028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410518984:8509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.807094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.807145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.807149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.807150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.807150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.807151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.807151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.807152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.807152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.807153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.807153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.807154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.807155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.807157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.807163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.807165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.807167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.807169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.807171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.807173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.807175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.807177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.807179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.807181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.807183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.807188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.807194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.807200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.807204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.807207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.807210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.807213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.807217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.807220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.807225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.807232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.807236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.807244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.807247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.807256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.807263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.807270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.807274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.807281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.807284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.807291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.807295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.807303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.807308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.807336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.808449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410518984:8509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.813075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410518984:8509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.813084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410518984:8509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.813086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410518984:8509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.813090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.815362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.816705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.816717Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.816718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.816721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.816724Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1020 [2:7556554595334983634:7168]
2025-10-02T09:31:10.816731Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.816744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.816749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.816751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.816752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.816761Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.816764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.816769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.816812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.816817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.816819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.816821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.816822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.816861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.816866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.816873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.816882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.816894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.816912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410518922:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.816919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410519022:8509], now have 1 active actors on pipe
2025-10-02T09:31:10.816924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.816929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.816931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.816923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1020
2025-10-02T09:31:10.816947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1020
2025-10-02T09:31:10.816942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.816945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.816947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.816950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.816960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.816972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.816974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.816995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.817002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.817003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.817012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.817018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.817044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.817050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.817053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.817054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.817060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.817069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.817081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.817184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.817192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.817332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.817414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1021 partition: 0 MaxSeqNo: 36 sessionId: src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0
2025-10-02T09:31:10.817620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3397502-ffafeddd-96a03fa-5e62b533_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.819884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Write session: try to update token
2025-10-02T09:31:10.819897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.826904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.826929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.826930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.826931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.826936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.826939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.826941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983629:7168]
2025-10-02T09:31:10.826964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.826971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.826972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.826973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.826974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.826978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.827087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.830554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId: src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.832752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:10.898217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554595410519033:8404]
2025-10-02T09:31:10.898395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1020, pipe: [1:7556554595410519033:8404]
2025-10-02T09:31:10.938568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:10.938758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.938767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.938793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410519033:8404], now have 1 active actors on pipe
2025-10-02T09:31:10.938924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:10.938934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554595410519033:8404]
2025-10-02T09:31:10.938953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:10.938955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:10.939025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1021 reason: error at write: Disconnected sessionId: src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0
2025-10-02T09:31:10.939113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:10.939183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1021 sessionId: src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0 is DEAD
2025-10-02T09:31:10.939331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:10.939340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Write session will restart in 0.006583s
2025-10-02T09:31:10.939357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Write session: Do CDS request
2025-10-02T09:31:10.939361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:10.944781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:10.946374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:10.946484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:10.946490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:10.946496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:10.946523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:10.946548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554595334983736:7171]
2025-10-02T09:31:10.946887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:10.947054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:10.947080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:10.947132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.947229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:10.947241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1022
2025-10-02T09:31:10.947294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:10.947334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:10.947343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.947348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.947349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.947350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.947351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.947352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.947358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:10.947366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:10.947370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:10.947353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.947354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.947356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.947358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.947359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.947360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.947364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.947373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.947376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.947379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.947382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.947384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.947387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.947390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.947393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.947396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.947398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.947401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.947407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.947413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:10.947418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.947422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:10.947425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.947429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:10.947432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.947441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:10.947448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.947452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:10.947455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.947460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:10.947463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.947470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:10.947474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.947481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:10.947488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.947495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:10.947498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.947505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.947510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.947518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.947521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.947528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.947560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:10.947695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1022 sessionId:  describe result for acl check
2025-10-02T09:31:10.947720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:10.947724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:10.947725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:10.947728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554595410519102:8513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:10.948067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554595410519102:8513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:10.949205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554595410519102:8513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:10.952966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554595410519102:8513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:10.952977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554595410519102:8513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:10.952979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554595410519102:8513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:10.952983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:10.955185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:10.956677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:10.956688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:10.956690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:10.956692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:10.956695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1021 [2:7556554595334983736:7171]
2025-10-02T09:31:10.956703Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:10.956713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:10.956718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.956720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.956721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.956731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:10.956737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:10.956742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:10.956780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.956784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.956785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.956787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:10.956788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:10.956841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:10.956846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.956853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:10.956861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:10.956879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:10.956899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410519137:8513], now have 1 active actors on pipe
2025-10-02T09:31:10.956906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554595410519035:2446], now have 1 active actors on pipe
2025-10-02T09:31:10.956911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.956903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1021
2025-10-02T09:31:10.956917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.956913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1021
2025-10-02T09:31:10.956919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.956925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:10.956934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:10.956935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:10.956936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:10.956937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:10.956947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:10.956954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:10.956964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.956969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.956993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.957001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:10.957008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:10.957012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:10.957015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:10.957018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:10.957019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:10.957024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:10.957030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:10.957052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.957178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:10.957184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:10.957192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:10.957252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1022 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0
2025-10-02T09:31:10.957467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93dab5df-267a7c17-5b451cc0-10dccf7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:10.959760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Write session: try to update token
2025-10-02T09:31:10.959772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:10.966570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:10.966586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:10.966587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:10.966589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:10.966594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.966597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.966600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554595334983731:7171]
2025-10-02T09:31:10.966627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:10.966631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:10.966632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:10.966636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:10.966640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:10.966642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:10.966790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:10.971018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId: src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:10.973312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.039027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705486440:8404]
2025-10-02T09:31:11.039242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1021, pipe: [1:7556554599705486440:8404]
2025-10-02T09:31:11.078962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.079362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.079375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.079407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486440:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.079593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.079595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:11.079599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.079610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:11.079631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705486440:8404]
2025-10-02T09:31:11.079659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1022 reason: error at write: Disconnected sessionId: src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0
2025-10-02T09:31:11.079821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1022 sessionId: src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0 is DEAD
2025-10-02T09:31:11.079949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:11.079957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Write session will restart in 0.008083s
2025-10-02T09:31:11.079973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Write session: Do CDS request
2025-10-02T09:31:11.079976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.085661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.087193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.087293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.087300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.087306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.087340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.087366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951132:7173]
2025-10-02T09:31:11.087728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.087899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.087928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.088135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.088169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.088173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.088173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.088174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.088176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.088176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.088177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.088177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.088178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.088178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.088181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.088188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.088190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.088192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.088194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.088196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.088198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.088200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.088202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.088204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.088206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.088208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.088213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.088217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.088220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.088223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.088226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.088228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.088231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.088233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.088238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.088240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.088242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.088245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.088247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.088250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.088251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.088254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.088256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.088258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.088260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.088263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.088265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.088268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.088270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.088272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.088289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.089100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.089188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.089199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1023
2025-10-02T09:31:11.089282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.089300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.089306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.089309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.089591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1023 sessionId:  describe result for acl check
2025-10-02T09:31:11.089616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.089620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.089621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.089624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705486509:8517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.089956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705486509:8517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.091665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705486509:8517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.095324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705486509:8517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.095336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705486509:8517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.095339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705486509:8517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.095345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.095886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:11.097471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:11.097483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:11.097484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:11.097486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:11.097489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1022 [2:7556554599629951132:7173]
2025-10-02T09:31:11.097497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:11.097507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:11.097515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.097517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.097517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.097527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:11.097533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:11.097537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:11.097574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.097580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.097582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.097585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:11.097587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:11.097624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:11.097630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.097636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.097642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.097653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:11.097667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486441:2446], now have 1 active actors on pipe
2025-10-02T09:31:11.097673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486544:8517], now have 1 active actors on pipe
2025-10-02T09:31:11.097676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.097677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.097678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.097686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:11.097696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:11.097692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1022
2025-10-02T09:31:11.097698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:11.097698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1022
2025-10-02T09:31:11.097702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:11.097703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:11.097706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:11.097708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:11.097722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.097724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:11.097726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:11.097740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.097746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.097762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8255e416-d3978aec-a03e1dca-d1186222_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:11.097769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.097771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.097772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:11.097778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.097783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:11.097795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.097892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.097897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.097905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.097965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1023 partition: 0 MaxSeqNo: 36 sessionId: src_id|8255e416-d3978aec-a03e1dca-d1186222_0
2025-10-02T09:31:11.098153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cad8678-bea52f98-fbc513d3-3d3fa70b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8255e416-d3978aec-a03e1dca-d1186222_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:11.100363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Write session: try to update token
2025-10-02T09:31:11.100374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:11.107159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:11.107173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:11.107174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:11.107175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:11.107180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.107183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.107185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951127:7173]
2025-10-02T09:31:11.107208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:11.107212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.107211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:11.107213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:11.107214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:11.107216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:11.107333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:11.110777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId: src_id|8255e416-d3978aec-a03e1dca-d1186222_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:11.112703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.179792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705486554:8404]
2025-10-02T09:31:11.179996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1022, pipe: [1:7556554599705486554:8404]
2025-10-02T09:31:11.222207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.222420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.222429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.222454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486554:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.222591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.222653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.222682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705486554:8404]
2025-10-02T09:31:11.222696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:11.222763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1023 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8255e416-d3978aec-a03e1dca-d1186222_0
2025-10-02T09:31:11.222922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1023 sessionId: src_id|8255e416-d3978aec-a03e1dca-d1186222_0 is DEAD
2025-10-02T09:31:11.223048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:11.223057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Write session will restart in 0.008486s
2025-10-02T09:31:11.223075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Write session: Do CDS request
2025-10-02T09:31:11.223081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.229194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.230867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.231000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.231008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.231016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.231051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.231078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951236:7176]
2025-10-02T09:31:11.231448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.231676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.231702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.231884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.231914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.231918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.231918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.231919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.231919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.231920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.231921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.231921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.231921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.231922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.231923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.231923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.231926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.231933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.231935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.231937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.231939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.231941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.231943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.231945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.231947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.231949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.231951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.231953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.231957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.231961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.231964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.231967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.231969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.231972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.231974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.231976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.231978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.231981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.231984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.231987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.231989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.231992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.231994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.231997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.231999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.232001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.232006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.232008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.232013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.232019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.232021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.232023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.232039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.232224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.232283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.232296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1024
2025-10-02T09:31:11.232378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.232396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.232402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.232405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.232681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1024 sessionId:  describe result for acl check
2025-10-02T09:31:11.232707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.232712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.232713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.232716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705486624:8522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.233076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705486624:8522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.234403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705486624:8522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.238702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705486624:8522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.238711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705486624:8522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.238713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705486624:8522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.238718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.240050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:11.241633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:11.241644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:11.241646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:11.241648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:11.241652Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1023 [2:7556554599629951236:7176]
2025-10-02T09:31:11.241659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:11.241670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:11.241671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.241673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.241674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.241683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:11.241690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:11.241695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:11.241735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.241739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.241740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.241742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:11.241744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:11.241776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:11.241781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.241788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.241793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.241802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:11.241816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486555:2446], now have 1 active actors on pipe
2025-10-02T09:31:11.241821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486659:8522], now have 1 active actors on pipe
2025-10-02T09:31:11.241825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.241826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.241827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.241835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:11.241844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:11.241850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:11.241853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:11.241854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:11.241859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:11.241845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1023
2025-10-02T09:31:11.241869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1023
2025-10-02T09:31:11.241866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:11.241886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.241896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:11.241902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:11.241912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.241917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.241947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:11.241953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.241955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.241957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:11.241962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.241970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:11.241983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.242079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.242084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.242091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.242140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1024 partition: 0 MaxSeqNo: 36 sessionId: src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0
2025-10-02T09:31:11.242375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8255e416-d3978aec-a03e1dca-d1186222_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:11.244563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Write session: try to update token
2025-10-02T09:31:11.244574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:11.251888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:11.251902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:11.251904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:11.251906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:11.251912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.251916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.251919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951231:7176]
2025-10-02T09:31:11.251947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:11.251949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:11.251952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.251953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:11.251953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:11.251955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:11.252074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:11.255682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId: src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:11.257713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.322671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705486667:8404]
2025-10-02T09:31:11.322884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1023, pipe: [1:7556554599705486667:8404]
2025-10-02T09:31:11.368990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.369361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.369371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.369398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486667:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.369551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.369582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705486667:8404]
2025-10-02T09:31:11.369602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:11.369610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.369660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1024 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0
2025-10-02T09:31:11.369826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1024 sessionId: src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0 is DEAD
2025-10-02T09:31:11.369936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:11.369944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Write session will restart in 0.009086s
2025-10-02T09:31:11.369961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Write session: Do CDS request
2025-10-02T09:31:11.369966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.376270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.377912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.378017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.378024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.378030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.378055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.378082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951339:7178]
2025-10-02T09:31:11.378425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.378591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.378610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.378813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.378849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.378853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.378854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.378855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.378855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.378856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.378856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.378857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.378857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.378858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.378858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.378859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.378862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.378868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.378871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.378872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.378874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.378876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.378878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.378880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.378882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.378884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.378886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.378888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.378892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.378895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.378898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.378902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.378904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.378914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.378917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.378920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.378922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.378925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.378927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.378929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.378932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.378938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.378940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.378942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.378945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.378948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.378953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.378956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.378958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.378961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.378966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.378969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.378986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.380128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.380259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.380270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1025
2025-10-02T09:31:11.380353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.380373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.380381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.380384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.380728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1025 sessionId:  describe result for acl check
2025-10-02T09:31:11.380755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.380760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.380761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.380764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705486738:8526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.381190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705486738:8526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.382372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705486738:8526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.386347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705486738:8526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.386361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705486738:8526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.386367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705486738:8526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.386374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.386885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:11.388258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:11.388271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:11.388273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:11.388276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:11.388281Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1024 [2:7556554599629951339:7178]
2025-10-02T09:31:11.388292Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:11.388306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:11.388311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.388314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.388315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.388325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:11.388329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:11.388334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:11.388366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.388371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.388372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.388374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:11.388375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:11.388413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:11.388418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.388426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.388431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.388439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:11.388456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486773:8526], now have 1 active actors on pipe
2025-10-02T09:31:11.388462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486668:2446], now have 1 active actors on pipe
2025-10-02T09:31:11.388467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.388469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.388470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.388481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:11.388488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:11.388490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:11.388491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:11.388494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:11.388498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1024
2025-10-02T09:31:11.388502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1024
2025-10-02T09:31:11.388505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:11.388511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:11.388541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.388547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.388557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.388564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:11.388568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:11.388578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9747306-744cf1da-8ac3b351-300447d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:11.388585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.388587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.388588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:11.388594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.388601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:11.388613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.388698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.388703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.388711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.388795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1025 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9747306-744cf1da-8ac3b351-300447d0_0
2025-10-02T09:31:11.389036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8182ddef-9a4c36f9-ec4ae033-5342f16_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9747306-744cf1da-8ac3b351-300447d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:11.391236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Write session: try to update token
2025-10-02T09:31:11.391248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:11.398378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:11.398396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:11.398398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:11.398400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:11.398406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.398409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.398411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951334:7178]
2025-10-02T09:31:11.398434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:11.398438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.398439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:11.398439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:11.398442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:11.398444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:11.398550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:11.402125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId: src_id|d9747306-744cf1da-8ac3b351-300447d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:11.404116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.469592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705486781:8404]
2025-10-02T09:31:11.469797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1024, pipe: [1:7556554599705486781:8404]
2025-10-02T09:31:11.518529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.518926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.518936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.518961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486781:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.519100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.519128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:11.519141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.519142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:11.519175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705486781:8404]
2025-10-02T09:31:11.519184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1025 reason: error at write: Disconnected sessionId: src_id|d9747306-744cf1da-8ac3b351-300447d0_0
2025-10-02T09:31:11.519235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1025 sessionId: src_id|d9747306-744cf1da-8ac3b351-300447d0_0 is DEAD
2025-10-02T09:31:11.519342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:11.519354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Write session will restart in 0.006439s
2025-10-02T09:31:11.519369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Write session: Do CDS request
2025-10-02T09:31:11.519374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.526169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.527052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.527109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.527119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1026
2025-10-02T09:31:11.527199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.527219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.527225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.527228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.527535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1026 sessionId:  describe result for acl check
2025-10-02T09:31:11.527563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.527567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.527568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.527571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705486855:8534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.527927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705486855:8534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.528108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.528246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.528256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.528264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.528308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.528340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951443:7180]
2025-10-02T09:31:11.528795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.528985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.529019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.529266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.529411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705486855:8534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.529453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.529461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.529462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.529463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.529464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.529465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.529466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.529467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.529470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.529471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.529472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.529472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.529477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.529485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.529489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.529492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.529494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.529497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.529500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.529503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.529506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.529509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.529513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.529515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.529521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.529532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.529540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.529549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.529557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.529565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.529573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.529581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.529588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.529593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.529597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.529603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.529610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.529619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.529626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.529631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.529638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.529646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.529649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.529657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.529664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.529673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.529680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.529685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.529720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.534705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705486855:8534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.534715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705486855:8534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.534717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705486855:8534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.534721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.537444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:11.538854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:11.538866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:11.538868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:11.538870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:11.538873Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1025 [2:7556554599629951443:7180]
2025-10-02T09:31:11.538883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:11.538898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:11.538902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.538904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.538905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.538925Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:11.538932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:11.538936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:11.538973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.538978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.538980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.538982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:11.538984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:11.539021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:11.539026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.539032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.539041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.539053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:11.539067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486894:8534], now have 1 active actors on pipe
2025-10-02T09:31:11.539073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486785:2446], now have 1 active actors on pipe
2025-10-02T09:31:11.539078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.539083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.539085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.539094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:11.539108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:11.539108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:11.539111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:11.539099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1025
2025-10-02T09:31:11.539112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:11.539123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:11.539125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:11.539123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1025
2025-10-02T09:31:11.539149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.539157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.539169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.539176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:11.539185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:11.539193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:11.539197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.539202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.539203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:11.539208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.539218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:11.539234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.539311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.539316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.539324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.539368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1026 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0
2025-10-02T09:31:11.539574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9747306-744cf1da-8ac3b351-300447d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:11.541816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Write session: try to update token
2025-10-02T09:31:11.541828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:11.555826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:11.555850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:11.555851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:11.555852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:11.555859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.555862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.555865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951438:7180]
2025-10-02T09:31:11.555893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:11.555898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.555899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:11.555915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:11.555921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:11.555934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:11.556016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:11.557400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId: src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:11.564653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.619103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705486902:8404]
2025-10-02T09:31:11.619316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1025, pipe: [1:7556554599705486902:8404]
2025-10-02T09:31:11.674262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.674589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.674599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.674612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486902:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.674847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:11.674850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705486902:8404]
2025-10-02T09:31:11.674866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:11.674867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.674928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1026 reason: error at write: Disconnected sessionId: src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0
2025-10-02T09:31:11.675099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1026 sessionId: src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0 is DEAD
2025-10-02T09:31:11.675121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.675235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:11.675245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Write session will restart in 0.006955s
2025-10-02T09:31:11.675267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Write session: Do CDS request
2025-10-02T09:31:11.675271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.681817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.683155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.683279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.683290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1027
2025-10-02T09:31:11.683374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.683394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.683400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.683403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.683559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.683693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.683701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.683709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.683735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1027 sessionId:  describe result for acl check
2025-10-02T09:31:11.683748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.683767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.683775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.683777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.683781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705486971:8538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.683779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951560:7183]
2025-10-02T09:31:11.684270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.684308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705486971:8538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.684479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.684510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.684763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.684818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.684823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.684824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.684825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.684826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.684827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.684828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.684829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.684830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.684831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.684832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.684833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.684837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.684847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.684851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.684854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.684857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.684861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.684866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.684869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.684872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.684877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.684879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.684882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.684889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.684894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.684901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.684907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.684915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.684923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.684931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.684936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.684943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.684947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.684954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.684959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.684966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.684973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.684980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.684984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.684992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.684995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.684998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.685000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.685006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.685009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.685011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.685014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.685031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.685503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705486971:8538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.689774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705486971:8538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.689784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705486971:8538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.689786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705486971:8538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.689790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.692439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:11.693947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:11.693960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:11.693961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:11.693963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:11.693967Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1026 [2:7556554599629951560:7183]
2025-10-02T09:31:11.693974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:11.693985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:11.693989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.693991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.693993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.694002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:11.694010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:11.694018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:11.694066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.694073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.694074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.694076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:11.694077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:11.694114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:11.694118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.694124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.694130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.694141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:11.694152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487010:8538], now have 1 active actors on pipe
2025-10-02T09:31:11.694158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705486903:2446], now have 1 active actors on pipe
2025-10-02T09:31:11.694162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.694165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.694166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.694177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:11.694189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:11.694191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:11.694191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:11.694192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:11.694204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:11.694210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:11.694186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1026
2025-10-02T09:31:11.694201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1026
2025-10-02T09:31:11.694233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.694241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.694253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.694262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:11.694268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:11.694281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:11.694288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.694290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.694292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:11.694297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.694306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:11.694323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.694416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.694421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.694429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.694483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1027 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0
2025-10-02T09:31:11.694705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2ecba9-d076fc4-b05e5801-c53c69e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:11.696991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Write session: try to update token
2025-10-02T09:31:11.697002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:11.703607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:11.703623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:11.703624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:11.703626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:11.703631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.703634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.703638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951555:7183]
2025-10-02T09:31:11.703663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:11.703662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:11.703665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:11.703667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.703668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:11.703668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:11.703831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:11.709293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId: src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:11.711439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.774741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705487056:8404]
2025-10-02T09:31:11.774891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1026, pipe: [1:7556554599705487056:8404]
2025-10-02T09:31:11.825400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.825724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.825739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.825753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487056:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.825936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.825970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:11.825970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705487056:8404]
2025-10-02T09:31:11.825988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:11.825989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.826038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1027 reason: error at write: Disconnected sessionId: src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0
2025-10-02T09:31:11.826201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1027 sessionId: src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0 is DEAD
2025-10-02T09:31:11.826316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:11.826326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Write session will restart in 0.006481s
2025-10-02T09:31:11.826345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Write session: Do CDS request
2025-10-02T09:31:11.826349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.834199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.834282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.834280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.834294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1028
2025-10-02T09:31:11.834388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.834412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.834419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.834422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.834773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1028 sessionId:  describe result for acl check
2025-10-02T09:31:11.834808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.834814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.834816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.834821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705487128:8551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.835311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705487128:8551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.836397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.836668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.836678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.836688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.836740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.836777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951703:7197]
2025-10-02T09:31:11.837013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705487128:8551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.837321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.837614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.837658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.837946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.837998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.838004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.838005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.838006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.838007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.838008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.838009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.838010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.838011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.838012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.838013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.838014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.838018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.838028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.838032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.838035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.838041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.838045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.838048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.838052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.838055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.838059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.838062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.838066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.838072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.838079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.838089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.838093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.838101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.838107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.838113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.838118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.838127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.838132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.838136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.838139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.838143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.838149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.838153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.838157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.838165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.838170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.838174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.838182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.838186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.838190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.838196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.838201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.838235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.842672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705487128:8551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.842683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705487128:8551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.842685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705487128:8551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.842690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.846204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:11.847718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:11.847736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:11.847738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:11.847741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:11.847746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1027 [2:7556554599629951703:7197]
2025-10-02T09:31:11.847757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:11.847773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:11.847780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.847783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.847785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.847798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:11.847807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:11.847813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:11.847864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.847871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.847873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.847876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:11.847878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:11.848043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1027
2025-10-02T09:31:11.848070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1027
2025-10-02T09:31:11.848120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:11.848130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.848143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.848155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.848172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:11.848195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487059:2446], now have 1 active actors on pipe
2025-10-02T09:31:11.848202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487167:8551], now have 1 active actors on pipe
2025-10-02T09:31:11.848215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.848223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.848240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.848247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.848250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.848262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:11.848276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:11.848278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:11.848284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:11.848285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:11.848291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:11.848293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:11.848306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:11.848317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:11.848324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:11.848326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:11.848334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:11.848347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:11.848377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.848388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:11.848390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:11.848401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.848540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.848550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.848565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:11.848677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1028 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0
2025-10-02T09:31:11.848990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4921f2-cb1d2e70-bac78c31-9b3a15d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:11.851385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Write session: try to update token
2025-10-02T09:31:11.851400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:11.858713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:11.858729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:11.858731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:11.858733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:11.858741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.858748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.858751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951698:7197]
2025-10-02T09:31:11.858782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:11.858786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:11.858788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.858790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:11.858791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:11.858795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:11.858918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:11.863240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId: src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:11.866191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:11.926312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554599705487177:8404]
2025-10-02T09:31:11.926533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1027, pipe: [1:7556554599705487177:8404]
2025-10-02T09:31:11.980641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:11.980964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:11.980974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:11.981001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487177:8404], now have 1 active actors on pipe
2025-10-02T09:31:11.981230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:11.981231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554599705487177:8404]
2025-10-02T09:31:11.981252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:11.981254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:11.981299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1028 reason: error at write: Disconnected sessionId: src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0
2025-10-02T09:31:11.981459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1028 sessionId: src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0 is DEAD
2025-10-02T09:31:11.981576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:11.981585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Write session will restart in 0.009499s
2025-10-02T09:31:11.981600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Write session: Do CDS request
2025-10-02T09:31:11.981614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:11.981999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:11.988364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:11.990193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:11.990332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:11.990341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:11.990349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:11.990386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:11.990416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554599629951814:7200]
2025-10-02T09:31:11.990761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:11.990944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:11.990968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:11.991254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:11.991290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.991294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.991295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.991295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.991296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.991297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.991297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.991298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.991298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.991299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.991299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.991300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.991303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.991311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.991313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.991315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.991317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.991319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.991320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.991323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.991324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.991327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.991328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.991330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.991334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.991339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:11.991342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.991345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:11.991347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.991349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:11.991352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.991354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:11.991356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.991359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:11.991361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.991364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:11.991366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.991368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:11.991370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.991373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:11.991375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.991377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:11.991379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.991382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:11.991385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.991391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:11.991393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.991396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:11.991414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:11.992169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.992284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:11.992295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1029
2025-10-02T09:31:11.992372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:11.992391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:11.992398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:11.992401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:11.992661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1029 sessionId:  describe result for acl check
2025-10-02T09:31:11.992687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:11.992691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:11.992692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:11.992695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554599705487253:8555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:11.993097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554599705487253:8555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:11.994291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554599705487253:8555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:11.998287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554599705487253:8555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:11.998299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554599705487253:8555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:11.998301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554599705487253:8555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:11.998307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:11.998834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.000196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.000208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.000210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.000212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.000215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1028 [2:7556554599629951814:7200]
2025-10-02T09:31:12.000222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.000233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.000238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.000239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.000240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.000249Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.000252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.000256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.000289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.000294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.000295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.000297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.000299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.000337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.000342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.000348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.000353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.000365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.000379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487288:8555], now have 1 active actors on pipe
2025-10-02T09:31:12.000386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554599705487179:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.000390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.000396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.000398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.000407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.000420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.000422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.000425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.000428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.000423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1028
2025-10-02T09:31:12.000428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1028
2025-10-02T09:31:12.000436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.000442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.000466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.000472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.000479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.000486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.000496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.000507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9672a4bf-cdfb0b29-34271924-358712fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.000514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.000516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.000518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.000523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.000531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.000643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.000752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.000758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.000766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.000831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1029 partition: 0 MaxSeqNo: 36 sessionId: src_id|9672a4bf-cdfb0b29-34271924-358712fb_0
2025-10-02T09:31:12.001042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2ec70-209a9260-8c98a76c-c19289e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9672a4bf-cdfb0b29-34271924-358712fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.003215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Write session: try to update token
2025-10-02T09:31:12.003227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.010136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.010156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.010158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.010160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.010171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.010176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.010179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554599629951809:7200]
2025-10-02T09:31:12.010213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.010219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.010223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.010225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.010227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.010227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.010371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.014173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId: src_id|9672a4bf-cdfb0b29-34271924-358712fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.016124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:12.081434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554604000454591:8404]
2025-10-02T09:31:12.081602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1028, pipe: [1:7556554604000454591:8404]
2025-10-02T09:31:12.127533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:12.127820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.127830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.127855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454591:8404], now have 1 active actors on pipe
2025-10-02T09:31:12.128061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554604000454591:8404]
2025-10-02T09:31:12.128084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:12.128087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:12.128090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:12.128137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1029 reason: error at write: Disconnected sessionId: src_id|9672a4bf-cdfb0b29-34271924-358712fb_0
2025-10-02T09:31:12.128240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:12.128265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1029 sessionId: src_id|9672a4bf-cdfb0b29-34271924-358712fb_0 is DEAD
2025-10-02T09:31:12.128407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:12.128416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Write session will restart in 0.006353s
2025-10-02T09:31:12.128430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Write session: Do CDS request
2025-10-02T09:31:12.128434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:12.135462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:12.136167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.136249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:12.136259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1030
2025-10-02T09:31:12.136357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.136378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:12.136384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:12.136387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:12.136668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1030 sessionId:  describe result for acl check
2025-10-02T09:31:12.136687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:12.136688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:12.136689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:12.136692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554604000454664:8559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:12.137049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554604000454664:8559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:12.137402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:12.137525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:12.137532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:12.137538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:12.137567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:12.137591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554603924919219:7202]
2025-10-02T09:31:12.137992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:12.138213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:12.138240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:12.138533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:12.138571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.138575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.138576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.138576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.138577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.138577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.138578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.138579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.138579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.138579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.138580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.138581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.138584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.138590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.138592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.138594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.138596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.138598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.138600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.138602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.138604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.138606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.138608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.138610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.138614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.138618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.138621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.138624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.138627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.138629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.138631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.138634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.138638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.138640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.138642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.138645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.138647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.138650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.138652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.138655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.138657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.138660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.138662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.138664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.138667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.138673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.138675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.138678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.138698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:12.138781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554604000454664:8559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:12.143694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554604000454664:8559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:12.143705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554604000454664:8559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:12.143708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554604000454664:8559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:12.143712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:12.146427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.147875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.147888Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.147890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.147892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.147896Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1029 [2:7556554603924919219:7202]
2025-10-02T09:31:12.147904Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.147914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.147920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.147922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.147924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.147934Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.147941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.147945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.147979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.147984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.147985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.147986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.147988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.148028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.148034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.148043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.148056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.148073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.148092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454593:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.148101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.148107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.148109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.148118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.148127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454702:8559], now have 1 active actors on pipe
2025-10-02T09:31:12.148135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.148139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.148142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.148144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.148151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.148153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.148141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1029
2025-10-02T09:31:12.148172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1029
2025-10-02T09:31:12.148170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.148176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.148179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.148187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.148194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.148224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.148231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.148234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.148236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.148242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.148248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.148263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.148384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.148392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.148403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.148459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1030 partition: 0 MaxSeqNo: 36 sessionId: src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0
2025-10-02T09:31:12.148748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9672a4bf-cdfb0b29-34271924-358712fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.150982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Write session: try to update token
2025-10-02T09:31:12.150994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.157949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.157967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.157969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.157970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.157975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.157977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.157980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554603924919214:7202]
2025-10-02T09:31:12.158005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.158009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.158009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.158010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.158012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.158014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.158131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.161606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId: src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.163567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:12.228407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554604000454712:8404]
2025-10-02T09:31:12.228635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1029, pipe: [1:7556554604000454712:8404]
2025-10-02T09:31:12.288257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:12.288881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.288899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.288940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454712:8404], now have 1 active actors on pipe
2025-10-02T09:31:12.289152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:12.289180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:12.289183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:12.289204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554604000454712:8404]
2025-10-02T09:31:12.289235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1030 reason: error at write: Disconnected sessionId: src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0
2025-10-02T09:31:12.289415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1030 sessionId: src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0 is DEAD
2025-10-02T09:31:12.289559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:12.289592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:12.289609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Write session will restart in 0.009835s
2025-10-02T09:31:12.289652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Write session: Do CDS request
2025-10-02T09:31:12.289658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:12.297541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:12.299703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:12.299845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:12.299852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:12.299858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:12.299893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:12.299921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554603924919331:7205]
2025-10-02T09:31:12.300219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.300310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:12.300306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:12.300320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1031
2025-10-02T09:31:12.300437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.300466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:12.300474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:12.300478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:12.300565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:12.300597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:12.300794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:12.300834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1031 sessionId:  describe result for acl check
2025-10-02T09:31:12.300852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.300857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.300858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.300858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.300865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:12.300859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.300860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.300871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:12.300860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.300873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:12.300861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.300878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554604000454789:8564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:12.300861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.300862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.300862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.300863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.300866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.300872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.300874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.300876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.300878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.300881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.300883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.300885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.300887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.300889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.300891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.300893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.300897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.300901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.300905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.300908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.300910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.300913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.300915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.300918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.300920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.300923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.300925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.300928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.300930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.300933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.300935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.300937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.300941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.300944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.300947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.300949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.300951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.300954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.300956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.300958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.300975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:12.301267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554604000454789:8564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:12.302752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554604000454789:8564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:12.306768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554604000454789:8564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:12.306782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554604000454789:8564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:12.306785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554604000454789:8564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:12.306791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:12.309165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.310651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.310670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.310672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.310676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.310681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1030 [2:7556554603924919331:7205]
2025-10-02T09:31:12.310694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.310709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.310712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.310714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.310716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.310729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.310738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.310743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.310793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.310801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.310803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.310806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.310808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.310869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.310877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.310889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.310899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.310926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.310948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454714:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.310956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454825:8564], now have 1 active actors on pipe
2025-10-02T09:31:12.310962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.310964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.310965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.310975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.310993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.311009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.311011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.311015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.311015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.311017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.311042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.311048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.311052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.311010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1030
2025-10-02T09:31:12.311031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1030
2025-10-02T09:31:12.311081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.311088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.311108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.311114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.311117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.311118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.311125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.311132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.311139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.311589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.311603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.311622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.311726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1031 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0
2025-10-02T09:31:12.312036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37200f9f-d3b4d94d-50f8c670-e330df41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.314313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Write session: try to update token
2025-10-02T09:31:12.314327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.321365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.321381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.321384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.321386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.321394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.321399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.321405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554603924919326:7205]
2025-10-02T09:31:12.321441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.321445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.321444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.321449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.321452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.321452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.321588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.326642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId: src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.329058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:12.389165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554604000454832:8404]
2025-10-02T09:31:12.389352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1030, pipe: [1:7556554604000454832:8404]
2025-10-02T09:31:12.448295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:12.448742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.448755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.448785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454832:8404], now have 1 active actors on pipe
2025-10-02T09:31:12.448982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:12.449029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:12.449030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:12.449047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:12.449062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554604000454832:8404]
2025-10-02T09:31:12.449100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1031 reason: error at write: Disconnected sessionId: src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0
2025-10-02T09:31:12.449282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1031 sessionId: src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0 is DEAD
2025-10-02T09:31:12.449424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:12.449435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Write session will restart in 0.006936s
2025-10-02T09:31:12.449449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Write session: Do CDS request
2025-10-02T09:31:12.449453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:12.456279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:12.457236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.457344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:12.457358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1032
2025-10-02T09:31:12.457451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.457477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:12.457485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:12.457489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:12.457852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1032 sessionId:  describe result for acl check
2025-10-02T09:31:12.457881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:12.457886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:12.457887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:12.457890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554604000454907:8568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:12.458173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:12.458250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554604000454907:8568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:12.458309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:12.458319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:12.458326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:12.458368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:12.458397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554603924919442:7207]
2025-10-02T09:31:12.458889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:12.459107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:12.459144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:12.459408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:12.459455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.459461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.459462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.459463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.459463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.459464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.459465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.459466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.459467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.459468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.459469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.459470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.459474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.459482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.459486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.459490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.459493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.459496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.459499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.459502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.459505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.459508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.459511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.459514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.459519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.459525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.459530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.459535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.459538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.459546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.459550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.459553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.459557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.459563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.459567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.459576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.459579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.459588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.459591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.459596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.459599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.459603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.459608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.459613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.459616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.459625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.459653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:12.459752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554604000454907:8568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:12.464720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554604000454907:8568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:12.464730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554604000454907:8568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:12.464734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554604000454907:8568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:12.464739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:12.467457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.469013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.469027Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.469029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.469031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.469036Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1031 [2:7556554603924919442:7207]
2025-10-02T09:31:12.469046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.469061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.469063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.469065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.469066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.469078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.469082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.469087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.469135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.469141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.469142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.469145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.469146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.469197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.469203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.469213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.469222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.469239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.469259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454834:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.469267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454946:8568], now have 1 active actors on pipe
2025-10-02T09:31:12.469271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.469273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.469275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.469285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.469296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.469299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.469304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.469306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.469311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.469313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.469307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1031
2025-10-02T09:31:12.469335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1031
2025-10-02T09:31:12.469335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.469345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.469347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.469367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.469371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.469395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.469404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.469407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.469409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.469415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.469422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.469441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.469544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.469553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.469564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.469665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1032 partition: 0 MaxSeqNo: 36 sessionId: src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0
2025-10-02T09:31:12.469939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8b5c33-9219354e-e0360361-3eca9ad0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.472239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Write session: try to update token
2025-10-02T09:31:12.472252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.479110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.479128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.479130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.479131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.479137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.479139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.479141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554603924919437:7207]
2025-10-02T09:31:12.479166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.479170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.479170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.479172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.479175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.479177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.479298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.483862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId: src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.486014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:12.549419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554604000454953:8404]
2025-10-02T09:31:12.549657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1031, pipe: [1:7556554604000454953:8404]
2025-10-02T09:31:12.598464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:12.598944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.598954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.598982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454953:8404], now have 1 active actors on pipe
2025-10-02T09:31:12.599137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:12.599151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:12.599157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554604000454953:8404]
2025-10-02T09:31:12.599174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:12.599176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:12.599219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1032 reason: error at write: Disconnected sessionId: src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0
2025-10-02T09:31:12.599347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1032 sessionId: src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0 is DEAD
2025-10-02T09:31:12.599531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:12.599546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Write session will restart in 0.007097s
2025-10-02T09:31:12.599571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Write session: Do CDS request
2025-10-02T09:31:12.599578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:12.606149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:12.606471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:12.606572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:12.606578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:12.606584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:12.606609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:12.606632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554603924919554:7209]
2025-10-02T09:31:12.606995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:12.608157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:12.608183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:12.608237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.608269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:12.608282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1033
2025-10-02T09:31:12.608375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:12.608406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.608410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.608410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.608411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.608411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.608412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.608412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.608413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.608413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.608414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.608414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.608415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.608418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.608425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.608427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.608429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.608431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.608433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.608435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.608437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.608439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.608441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.608443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.608445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.608449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.608453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.608457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.608460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.608462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.608465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.608467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.608470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.608472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.608474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.608476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.608479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.608481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.608484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.608486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.608488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.608491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.608497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.608500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.608503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.608505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.608509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.608511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.608513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.608493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.608531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:12.608540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:12.608549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:12.608553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:12.608889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1033 sessionId:  describe result for acl check
2025-10-02T09:31:12.608920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:12.608921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:12.608922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:12.608925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554604000455033:8572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:12.609272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554604000455033:8572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:12.610873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554604000455033:8572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:12.615142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554604000455033:8572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:12.615153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554604000455033:8572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:12.615155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554604000455033:8572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:12.615160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:12.616414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.617826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.617839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.617841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.617843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.617847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1032 [2:7556554603924919554:7209]
2025-10-02T09:31:12.617855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.617866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.617867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.617869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.617870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.617882Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.617889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.617895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.617948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.617954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.617956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.617958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.617961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.618015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.618020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.618028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.618033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.618042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.618058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000454954:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.618063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455068:8572], now have 1 active actors on pipe
2025-10-02T09:31:12.618067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.618068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.618069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.618077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.618088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.618092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.618095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.618096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.618099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.618101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.618088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1032
2025-10-02T09:31:12.618096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1032
2025-10-02T09:31:12.618120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.618125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.618127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.618136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.618142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.618356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.618365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.618367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.618368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.618373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.618379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.618396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.618530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.618539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.618555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.618617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1033 partition: 0 MaxSeqNo: 36 sessionId: src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0
2025-10-02T09:31:12.618926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aab30bee-33c3155a-8388ae38-c28e49ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.621110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Write session: try to update token
2025-10-02T09:31:12.621122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.627960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.627975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.627976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.627978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.627985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.627988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.627989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554603924919549:7209]
2025-10-02T09:31:12.628015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.628018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.628019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.628026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.628037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.628040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.628132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.631973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId: src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.633912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:12.699447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554604000455075:8404]
2025-10-02T09:31:12.699661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1032, pipe: [1:7556554604000455075:8404]
2025-10-02T09:31:12.750438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:12.750759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.750773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.750803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455075:8404], now have 1 active actors on pipe
2025-10-02T09:31:12.750963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:12.750959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:12.750997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554604000455075:8404]
2025-10-02T09:31:12.751008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:12.751054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1033 reason: status is not ok: tablet will be restarted right now sessionId: src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0
2025-10-02T09:31:12.751195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1033 sessionId: src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0 is DEAD
2025-10-02T09:31:12.751343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:12.751351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Write session will restart in 0.006963s
2025-10-02T09:31:12.751364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Write session: Do CDS request
2025-10-02T09:31:12.751369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:12.759155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.759218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:12.759229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1034
2025-10-02T09:31:12.759303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.759323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:12.759330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:12.759333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:12.759461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:12.759563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1034 sessionId:  describe result for acl check
2025-10-02T09:31:12.759586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:12.759593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:12.759595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:12.759599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554604000455176:8583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:12.759753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:12.759875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:12.759884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:12.759891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:12.759922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554604000455176:8583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:12.759931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:12.760147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554603924919691:7218]
2025-10-02T09:31:12.760694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:12.760926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:12.760966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:12.761143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554604000455176:8583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:12.761250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:12.761298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.761303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.761304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.761305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.761306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.761307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.761308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.761309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.761310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.761311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.761312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.761313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.761317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.761326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.761329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.761333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.761336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.761344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.761347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.761351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.761354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.761362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.761368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.761376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.761381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.761391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.761398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.761408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.761416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.761424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.761433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.761442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.761450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.761455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.761459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.761468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.761478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.761486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.761490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.761498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.761506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.761514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.761522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.761530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.761538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.761547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.761554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.761558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.761593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:12.765388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554604000455176:8583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:12.765397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554604000455176:8583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:12.765399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554604000455176:8583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:12.765403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:12.769133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.770775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.770793Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.770794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.770798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.770802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1033 [2:7556554603924919691:7218]
2025-10-02T09:31:12.770813Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.770832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.770838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.770841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.770842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.770855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.770863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.770868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.770927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.770935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.770937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.770940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.770942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.770980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.770983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.770990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.770995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.771006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.771020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.771024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.771025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.771030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.771037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.771039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455214:8583], now have 1 active actors on pipe
2025-10-02T09:31:12.771043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455101:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.771045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.771046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.771050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.771060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.771062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.771086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.771069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1033
2025-10-02T09:31:12.771088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.771095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1033
2025-10-02T09:31:12.771098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.771106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.771110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.771138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.771145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.771148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.771149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.771154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.771160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.771173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.771284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.771293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.771305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.771377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1034 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0
2025-10-02T09:31:12.771643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|432ca1cb-88dd1877-250809c7-ebd220a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.773966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Write session: try to update token
2025-10-02T09:31:12.773979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.780598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.780616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.780618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.780620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.780626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.780630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.780632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554603924919686:7218]
2025-10-02T09:31:12.780665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.780667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.780673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.780674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.780676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.780677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.780796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.784581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId: src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.786779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:12.850991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554604000455237:8404]
2025-10-02T09:31:12.851202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1033, pipe: [1:7556554604000455237:8404]
2025-10-02T09:31:12.901992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:12.902197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.902206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.902231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455237:8404], now have 1 active actors on pipe
2025-10-02T09:31:12.902398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:12.902383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:12.902397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:12.902414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:12.902439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1034 reason: error at write: Disconnected sessionId: src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0
2025-10-02T09:31:12.902447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554604000455237:8404]
2025-10-02T09:31:12.902578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1034 sessionId: src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0 is DEAD
2025-10-02T09:31:12.902681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:12.902690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Write session will restart in 0.006501s
2025-10-02T09:31:12.902713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Write session: Do CDS request
2025-10-02T09:31:12.902718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:12.909012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:12.910139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.910368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:12.910380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1035
2025-10-02T09:31:12.910460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:12.910480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:12.910485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:12.910489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:12.910823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1035 sessionId:  describe result for acl check
2025-10-02T09:31:12.910857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:12.910863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:12.910861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:12.910866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:12.910869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554604000455317:8589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:12.910972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:12.910978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:12.910984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:12.911012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:12.911035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554603924919830:7227]
2025-10-02T09:31:12.911243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554604000455317:8589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:12.911372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:12.911521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:12.911543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:12.911718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:12.911745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.911749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.911750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.911750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.911751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.911751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.911752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.911752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.911753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.911753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.911754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.911754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.911757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.911762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.911764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.911766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.911768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.911770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.911772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.911774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.911776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.911778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.911780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.911781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.911785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.911790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:12.911793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.911796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:12.911800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.911802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:12.911804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.911807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:12.911809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.911811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:12.911813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.911816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:12.911818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.911820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:12.911822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.911825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:12.911827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.911830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:12.911832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.911835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.911836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.911839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.911841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.911843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.911860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:12.912911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554604000455317:8589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:12.917616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554604000455317:8589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:12.917627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554604000455317:8589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:12.917630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554604000455317:8589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:12.917635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:12.919293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:12.920752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:12.920763Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:12.920765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:12.920767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:12.920770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1034 [2:7556554603924919830:7227]
2025-10-02T09:31:12.920778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:12.920791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:12.920795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.920797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.920798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.920821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:12.920827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:12.920832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:12.920864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.920869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.920870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.920871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:12.920873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:12.920912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:12.920917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.920923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:12.920928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:12.920939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:12.920951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.920956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.920957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.920961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:12.920969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455356:8589], now have 1 active actors on pipe
2025-10-02T09:31:12.920974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:12.920975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554604000455241:2446], now have 1 active actors on pipe
2025-10-02T09:31:12.920976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:12.920978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:12.920980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:12.920987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:12.920992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:12.921005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.921013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:12.921017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:12.921033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1034
2025-10-02T09:31:12.921033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1034
2025-10-02T09:31:12.921086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.921091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.921108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aae026-5e008908-3884a405-3fbba4fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:12.921114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:12.921117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:12.921119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:12.921123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:12.921131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:12.921142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.921229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:12.921234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:12.921241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:12.921289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1035 partition: 0 MaxSeqNo: 36 sessionId: src_id|9aae026-5e008908-3884a405-3fbba4fd_0
2025-10-02T09:31:12.921529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5058ed7-f47abd22-2a195e39-cdc4c4a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9aae026-5e008908-3884a405-3fbba4fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:12.923684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Write session: try to update token
2025-10-02T09:31:12.923695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:12.930281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:12.930299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:12.930300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:12.930301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:12.930305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.930308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.930311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554603924919824:7227]
2025-10-02T09:31:12.930332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:12.930336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:12.930337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:12.930342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:12.930346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:12.930349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:12.930439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:12.937978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId: src_id|9aae026-5e008908-3884a405-3fbba4fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:12.939936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.002531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295422660:8404]
2025-10-02T09:31:13.002725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1034, pipe: [1:7556554608295422660:8404]
2025-10-02T09:31:13.045861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.046242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.046252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.046265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422660:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.046420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:13.046473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295422660:8404]
2025-10-02T09:31:13.046491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:13.046494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:13.046497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.046591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1035 reason: error at write: Disconnected sessionId: src_id|9aae026-5e008908-3884a405-3fbba4fd_0
2025-10-02T09:31:13.046728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1035 sessionId: src_id|9aae026-5e008908-3884a405-3fbba4fd_0 is DEAD
2025-10-02T09:31:13.046862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:13.046871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Write session will restart in 0.005138s
2025-10-02T09:31:13.046887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Write session: Do CDS request
2025-10-02T09:31:13.046891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.053124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.053220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.053232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1036
2025-10-02T09:31:13.053313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.053333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.053341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.053344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.053369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.053648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1036 sessionId:  describe result for acl check
2025-10-02T09:31:13.053669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.053675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.053677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.053681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295422738:8593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.054047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295422738:8593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.055179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.055285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.055291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.055298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.055326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.055351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219887240:7229]
2025-10-02T09:31:13.055698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.055753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295422738:8593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.055869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.055892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.056084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.056272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.056278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.056279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.056279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.056280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.056281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.056281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.056282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.056283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.056283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.056284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.056285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.056288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.056294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.056296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.056299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.056301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.056303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.056305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.056307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.056309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.056312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.056315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.056317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.056322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.056326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.056330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.056333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.056335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.056337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.056339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.056342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.056344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.056346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.056348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.056351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.056358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.056360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.056362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.056365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.056368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.056371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.056373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.056376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.056381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.056383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.056385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.056388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.056408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.060455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295422738:8593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.060466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295422738:8593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.060469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295422738:8593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.060474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.064163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.065510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.065523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.065525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.065528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.065534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1035 [2:7556554608219887240:7229]
2025-10-02T09:31:13.065542Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.065555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.065559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.065561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.065562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.065571Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.065573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.065577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.065607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.065612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.065613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.065615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.065616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.065653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.065657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.065663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.065668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.065680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.065694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422777:8593], now have 1 active actors on pipe
2025-10-02T09:31:13.065699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422661:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.065703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.065704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.065705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.065712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.065722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.065716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1035
2025-10-02T09:31:13.065731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.065731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1035
2025-10-02T09:31:13.065733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.065735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.065740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.065742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.065756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.065761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.065770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.065777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.065789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.065794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.065798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.065800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.065801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.065806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.065811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.065825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.065940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.065945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.065952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.066009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1036 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0
2025-10-02T09:31:13.066199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aae026-5e008908-3884a405-3fbba4fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.068381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Write session: try to update token
2025-10-02T09:31:13.068391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.075144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.075156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.075158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.075159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.075164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.075167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.075169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887235:7229]
2025-10-02T09:31:13.075191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.075196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.075197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.075201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.075204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.075206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.075307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.079618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId: src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.081564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.146404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295422785:8404]
2025-10-02T09:31:13.146626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1035, pipe: [1:7556554608295422785:8404]
2025-10-02T09:31:13.190933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.191385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.191394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.191421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422785:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.191547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:13.191566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:13.191579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:13.191620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295422785:8404]
2025-10-02T09:31:13.191630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1036 reason: error at write: Disconnected sessionId: src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0
2025-10-02T09:31:13.191654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.191756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1036 sessionId: src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0 is DEAD
2025-10-02T09:31:13.191913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:13.191920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Write session will restart in 0.005900s
2025-10-02T09:31:13.191937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Write session: Do CDS request
2025-10-02T09:31:13.191941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.198866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.199159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.199302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.199315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1037
2025-10-02T09:31:13.199414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.199452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.199461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.199467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.199794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1037 sessionId:  describe result for acl check
2025-10-02T09:31:13.199825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.199830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.199832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.199836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295422866:8598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.200280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295422866:8598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.201071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.201201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.201206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.201213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.201243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.201266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219887358:7232]
2025-10-02T09:31:13.201611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.201757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295422866:8598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.201817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.201852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.202052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.202086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.202089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.202090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.202091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.202091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.202092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.202092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.202093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.202094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.202094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.202095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.202095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.202098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.202105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.202107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.202109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.202111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.202113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.202115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.202117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.202119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.202122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.202124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.202126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.202129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.202133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.202137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.202140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.202142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.202145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.202152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.202154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.202157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.202160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.202162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.202164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.202167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.202173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.202175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.202178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.202180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.202183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.202186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.202188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.202191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.202195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.202197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.202199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.202216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.206395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295422866:8598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.206408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295422866:8598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.206411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295422866:8598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.206418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.210395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.211847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.211859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.211861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.211864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.211869Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1036 [2:7556554608219887358:7232]
2025-10-02T09:31:13.211883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.211899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.211907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.211910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.211912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.211925Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.211932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.211937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.212238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.212244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.212246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.212248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.212250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.212298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.212303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.212310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.212316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.212329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.212346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.212350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.212352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.212357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.212365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.212366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422788:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.212367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.212368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.212370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422905:8598], now have 1 active actors on pipe
2025-10-02T09:31:13.212375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.212382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.212384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.212408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.212417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.212440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.212494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1036
2025-10-02T09:31:13.212497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1036
2025-10-02T09:31:13.212552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.212558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.212576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.212584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.212588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.212589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.212594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.212601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.212612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.212727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.212731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.212739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.212844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1037 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0
2025-10-02T09:31:13.213150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfed7826-257d49db-34b5b96e-7cb9b534_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.215594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Write session: try to update token
2025-10-02T09:31:13.215605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.226122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:13.226137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.226144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.226179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:13.226181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:13.226329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:13.226454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:13.226570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:13.226686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:13.226850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:13.226881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:13.228171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId: src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.230339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.232152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.232169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.232182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.232184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.232186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.232187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.232191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.232194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.232197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887353:7232]
2025-10-02T09:31:13.232224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.232224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.232228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.232230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.232231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.232232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.232340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.291806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295422913:8404]
2025-10-02T09:31:13.291980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1036, pipe: [1:7556554608295422913:8404]
2025-10-02T09:31:13.344501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.344775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:13.344809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422913:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.344888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:13.344929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.344959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:13.344960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295422913:8404]
2025-10-02T09:31:13.344965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:13.345012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1037 reason: error at write: Disconnected sessionId: src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0
2025-10-02T09:31:13.345119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1037 sessionId: src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0 is DEAD
2025-10-02T09:31:13.345244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:13.345250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Write session will restart in 0.005709s
2025-10-02T09:31:13.345269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Write session: Do CDS request
2025-10-02T09:31:13.345275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.351363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.352088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.352162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.352179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1038
2025-10-02T09:31:13.352255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.352275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.352280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.352283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.352530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1038 sessionId:  describe result for acl check
2025-10-02T09:31:13.352547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.352551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.352552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.352555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295422993:8602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.352904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295422993:8602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.353222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.353350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.353357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.353365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.353406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.353442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219887475:7234]
2025-10-02T09:31:13.353785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.353927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.353957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.354088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295422993:8602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.354143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.354187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.354191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.354192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.354193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.354194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.354194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.354195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.354196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.354197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.354199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.354200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.354201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.354205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.354214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.354218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.354222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.354226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.354229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.354232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.354236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.354240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.354243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.354247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.354251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.354256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.354263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.354272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.354277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.354284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.354288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.354292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.354297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.354300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.354304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.354308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.354312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.354317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.354322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.354326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.354330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.354337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.354342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.354345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.354350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.354357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.354361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.354365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.354371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.354403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.358199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295422993:8602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.358208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295422993:8602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.358210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295422993:8602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.358213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.361989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.363527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.363539Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.363540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.363542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.363546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1037 [2:7556554608219887475:7234]
2025-10-02T09:31:13.363553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.363562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.363566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.363568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.363569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.363577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.363581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.363588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.363617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.363622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.363622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.363624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.363625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.363662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.363666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.363673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.363679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.363690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.363703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295422914:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.363711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.363715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.363716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.363723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.363728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423032:8602], now have 1 active actors on pipe
2025-10-02T09:31:13.363735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.363735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1037
2025-10-02T09:31:13.363746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.363752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1037
2025-10-02T09:31:13.363747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.363749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.363750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.363750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.363768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.363770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.363778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.363778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.363780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.363801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.363808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.363811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.363812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.363816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.363821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.363831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.363936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.363943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.363951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.364001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1038 partition: 0 MaxSeqNo: 36 sessionId: src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0
2025-10-02T09:31:13.364198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f0d44c-a94e7a26-1a32d1fe-8cff1a8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.366393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Write session: try to update token
2025-10-02T09:31:13.366404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.373935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.373947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.373950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.373953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.373961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.373966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.373971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887470:7234]
2025-10-02T09:31:13.374003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.374012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.374017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.374022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.374026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.374029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.374319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.379003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId: src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.381022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.444883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295423040:8404]
2025-10-02T09:31:13.445049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1037, pipe: [1:7556554608295423040:8404]
2025-10-02T09:31:13.489333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.489614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.489625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.489660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423040:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.489885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:13.489878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295423040:8404]
2025-10-02T09:31:13.489917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.489925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:13.489988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1038 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0
2025-10-02T09:31:13.490121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1038 sessionId: src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0 is DEAD
2025-10-02T09:31:13.490267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:13.490277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Write session will restart in 0.006169s
2025-10-02T09:31:13.490303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Write session: Do CDS request
2025-10-02T09:31:13.490308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.497337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.497370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.497386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1039
2025-10-02T09:31:13.497543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.497582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.497588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.497592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.497880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1039 sessionId:  describe result for acl check
2025-10-02T09:31:13.497909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.497913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.497914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.497918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295423119:8606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.498313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295423119:8606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.498321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.500057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295423119:8606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.502491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.502648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.502657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.502665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.502707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.502714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295423119:8606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.502726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295423119:8606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.502728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295423119:8606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.502733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.502749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219887594:7236]
2025-10-02T09:31:13.503290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.503580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.503621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.503917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.503967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.503975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.503976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.503977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.503978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.503979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.503980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.503981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.503982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.503983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.503984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.503985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.503991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.504000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.504004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.504008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.504011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.504015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.504018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.504022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.504025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.504029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.504032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.504036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.504041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.504047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.504052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.504057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.504061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.504066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.504069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.504074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.504078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.504083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.504086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.504090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.504094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.504098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.504102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.504106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.504110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.504114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.504117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.504121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.504128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.504133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.504142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.504146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.504178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.512256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.513928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.513942Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.513944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.513947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.513954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1038 [2:7556554608219887594:7236]
2025-10-02T09:31:13.513970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.513986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.513988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.513992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.513994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.514008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.514022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.514028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.514092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.514098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.514101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.514104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.514106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.514289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1038
2025-10-02T09:31:13.514312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1038
2025-10-02T09:31:13.514488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.514498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.514511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.514523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.514539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.514561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423041:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.514567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423156:8606], now have 1 active actors on pipe
2025-10-02T09:31:13.514587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.514595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.514609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.514614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.514616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.514628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.514643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.514652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.514659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.514661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.514662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.514663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.514675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7455fa21-991683dd-8c388e25-9744faa3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.514681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.514688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.514689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.514696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.514704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.514736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.514744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.514753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.514757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.514881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.514888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.514898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.514964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1039 partition: 0 MaxSeqNo: 36 sessionId: src_id|7455fa21-991683dd-8c388e25-9744faa3_0
2025-10-02T09:31:13.515268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe7ce80-8e253ab7-ba156d07-39680dfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7455fa21-991683dd-8c388e25-9744faa3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.517843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Write session: try to update token
2025-10-02T09:31:13.517858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.526516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:13.526531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.526538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.526578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:13.526589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:13.526752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:13.526895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:13.527029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:13.527152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:13.527396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:13.527431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:13.531502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId: src_id|7455fa21-991683dd-8c388e25-9744faa3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.533799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.533916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.533927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.533929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.533930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.533937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.533939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.533942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887588:7236]
2025-10-02T09:31:13.533970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.533971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.533976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.533980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.533983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.533988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.533994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.533996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.534159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.589793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295423167:8404]
2025-10-02T09:31:13.590033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1038, pipe: [1:7556554608295423167:8404]
2025-10-02T09:31:13.655047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.655365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423167:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.655559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:13.655555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.655587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295423167:8404]
2025-10-02T09:31:13.655603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:13.655666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1039 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7455fa21-991683dd-8c388e25-9744faa3_0
2025-10-02T09:31:13.655842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1039 sessionId: src_id|7455fa21-991683dd-8c388e25-9744faa3_0 is DEAD
2025-10-02T09:31:13.655978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:13.655989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Write session will restart in 0.008329s
2025-10-02T09:31:13.656008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Write session: Do CDS request
2025-10-02T09:31:13.656013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.662298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.664173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.664284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.664290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.664297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.664323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.664349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219887724:7239]
2025-10-02T09:31:13.664704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.664894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.664918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.665122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.665113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.665169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.665174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.665175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.665176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.665177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.665178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.665178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.665179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.665180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.665181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.665182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.665183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.665187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.665196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.665199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.665203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.665206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.665209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.665212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.665215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.665218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.665221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.665224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.665227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.665225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.665236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1040
2025-10-02T09:31:13.665233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.665239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.665244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.665249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.665252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.665257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.665260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.665264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.665268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.665272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.665275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.665280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.665284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.665288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.665291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.665295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.665300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.665305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.665308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.665317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.665321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.665325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.665330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.665319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.665334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.665338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.665344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.665347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.665365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.665633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1040 sessionId:  describe result for acl check
2025-10-02T09:31:13.665662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.665667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.665668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.665671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295423255:8610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.666044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295423255:8610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.667462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295423255:8610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.671819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295423255:8610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.671828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295423255:8610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.671830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295423255:8610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.671834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.673042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.674615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.674626Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.674627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.674629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.674633Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1039 [2:7556554608219887724:7239]
2025-10-02T09:31:13.674640Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.674651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.674656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.674658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.674660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.674669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.674672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.674676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.674708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.674713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.674714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.674716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.674717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.674758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.674763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.674769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.674774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.674782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.674798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423290:8610], now have 1 active actors on pipe
2025-10-02T09:31:13.674804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423169:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.674808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.674811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.674812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.674819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.674829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.674831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.674833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.674835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.674839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.674841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.674824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1039
2025-10-02T09:31:13.674833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1039
2025-10-02T09:31:13.674856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.674861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.674863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.674873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.674878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.674917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.674926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.674928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.674929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.674934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.674942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.674955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.675057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.675062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.675069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.675119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1040 partition: 0 MaxSeqNo: 36 sessionId: src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0
2025-10-02T09:31:13.675410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455fa21-991683dd-8c388e25-9744faa3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.677604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Write session: try to update token
2025-10-02T09:31:13.677616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.684334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.684349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.684351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.684353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.684359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.684362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.684365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887719:7239]
2025-10-02T09:31:13.684391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.684393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.684394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.684397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.684398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.684400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.684549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.690602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId: src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.692621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.755686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295423309:8404]
2025-10-02T09:31:13.755977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1039, pipe: [1:7556554608295423309:8404]
2025-10-02T09:31:13.803152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.803434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.803442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.803454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423309:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.803574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:13.803597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.803599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:13.803602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:13.803635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295423309:8404]
2025-10-02T09:31:13.803638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1040 reason: error at write: Disconnected sessionId: src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0
2025-10-02T09:31:13.803759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1040 sessionId: src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0 is DEAD
2025-10-02T09:31:13.803853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:13.803860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Write session will restart in 0.008293s
2025-10-02T09:31:13.803876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Write session: Do CDS request
2025-10-02T09:31:13.803880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.809598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.811380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.811501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.811507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.811513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.811541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.811563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219887880:7253]
2025-10-02T09:31:13.811919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.812086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.812109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.812283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.812311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.812315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.812316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.812316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.812317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.812317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.812317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.812318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.812319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.812319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.812320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.812320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.812323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.812329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.812331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.812333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.812335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.812337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.812339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.812341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.812343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.812345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.812347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.812349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.812352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.812357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.812360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.812362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.812365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.812367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.812370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.812373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.812375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.812377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.812379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.812381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.812384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.812386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.812388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.812391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.812394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.812397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.812398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.812402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.812404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.812406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.812408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.812411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.812427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.813156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.813201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.813211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1041
2025-10-02T09:31:13.813301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.813320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.813323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.813325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.813588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1041 sessionId:  describe result for acl check
2025-10-02T09:31:13.813613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.813618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.813619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.813622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295423429:8623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.813946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295423429:8623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.815504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295423429:8623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.819453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295423429:8623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.819463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295423429:8623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.819465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295423429:8623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.819469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.819849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.821381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.821393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.821394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.821396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.821400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1040 [2:7556554608219887880:7253]
2025-10-02T09:31:13.821407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.821416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.821417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.821419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.821420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.821428Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.821431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.821435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.821467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.821473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.821474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.821476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.821477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.821514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.821518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.821524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.821530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.821538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.821552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423460:8623], now have 1 active actors on pipe
2025-10-02T09:31:13.821557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423343:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.821560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.821561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.821563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.821569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.821577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.821584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.821584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.821586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.821587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.821589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.821603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.821579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1040
2025-10-02T09:31:13.821605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.821606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.821614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.821586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1040
2025-10-02T09:31:13.821616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.821642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.821649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.821651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.821652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.821658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.821662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.821671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.821766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.821771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.821778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.821819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1041 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0
2025-10-02T09:31:13.822024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27981237-3aa94beb-f59f8dc-f8333ae5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.824239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Write session: try to update token
2025-10-02T09:31:13.824247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.831314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.831329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.831331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.831332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.831337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.831342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.831345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887875:7253]
2025-10-02T09:31:13.831368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.831370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.831372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.831374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.831374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.831376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.831492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.836603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId: src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.838703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:13.903636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554608295423471:8404]
2025-10-02T09:31:13.903846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1040, pipe: [1:7556554608295423471:8404]
2025-10-02T09:31:13.951680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:13.952060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.952068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.952080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423471:8404], now have 1 active actors on pipe
2025-10-02T09:31:13.952192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:13.952231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:13.952245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:13.952267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554608295423471:8404]
2025-10-02T09:31:13.952290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:13.952294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1041 reason: error at write: Disconnected sessionId: src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0
2025-10-02T09:31:13.952419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1041 sessionId: src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0 is DEAD
2025-10-02T09:31:13.952592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:13.952603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Write session will restart in 0.009328s
2025-10-02T09:31:13.952622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Write session: Do CDS request
2025-10-02T09:31:13.952628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:13.958957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:13.960760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:13.960972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:13.960980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:13.960988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:13.961025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:13.961063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554608219888004:7256]
2025-10-02T09:31:13.961409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:13.961573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:13.961596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:13.961775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:13.961804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.961808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.961809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.961809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.961810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.961810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.961811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.961811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.961811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.961812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.961813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.961813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.961816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.961823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.961825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.961827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.961829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.961831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.961832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.961834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.961836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.961838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.961840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.961842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.961846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.961850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:13.961854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.961857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:13.961860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.961862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:13.961864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.961867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:13.961869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.961872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:13.961874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.961877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:13.961879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.961881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:13.961885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.961887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:13.961889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.961891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:13.961894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.961897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.961899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.961901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.961903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.961905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.961923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:13.963188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.963270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:13.963282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1042
2025-10-02T09:31:13.963364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:13.963384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:13.963389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:13.963391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:13.963667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1042 sessionId:  describe result for acl check
2025-10-02T09:31:13.963694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:13.963698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:13.963699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:13.963703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554608295423563:8627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:13.964058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554608295423563:8627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:13.965514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554608295423563:8627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:13.969032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554608295423563:8627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:13.969055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554608295423563:8627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:13.969058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554608295423563:8627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:13.969064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:13.969563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:13.971007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:13.971017Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:13.971019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:13.971021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:13.971025Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1041 [2:7556554608219888004:7256]
2025-10-02T09:31:13.971034Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:13.971045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:13.971050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.971053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.971054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.971063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:13.971068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:13.971073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:13.971113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.971119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.971121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.971124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:13.971128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:13.971176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:13.971184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.971195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:13.971206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:13.971219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:13.971234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423594:8627], now have 1 active actors on pipe
2025-10-02T09:31:13.971239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554608295423476:2446], now have 1 active actors on pipe
2025-10-02T09:31:13.971243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.971244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.971246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.971256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:13.971263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:13.971273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:13.971275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:13.971264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1041
2025-10-02T09:31:13.971278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:13.971285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:13.971280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1041
2025-10-02T09:31:13.971288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:13.971292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.971293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:13.971301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:13.971304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.971307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.971332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e74fc318-e06df515-b63e82c5-b11b830e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:13.971339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:13.971342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:13.971343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:13.971349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:13.971356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:13.971370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.971489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:13.971494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:13.971502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:13.971557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1042 partition: 0 MaxSeqNo: 36 sessionId: src_id|e74fc318-e06df515-b63e82c5-b11b830e_0
2025-10-02T09:31:13.971810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c69a045-4b9f8864-48c57bdb-877531eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e74fc318-e06df515-b63e82c5-b11b830e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:13.974140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Write session: try to update token
2025-10-02T09:31:13.974153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:13.980952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:13.980965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:13.980966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:13.980967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:13.980974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.980976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.980978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554608219887999:7256]
2025-10-02T09:31:13.981002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:13.981006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:13.981007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:13.981008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:13.981012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:13.981015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:13.981112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:13.985517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId: src_id|e74fc318-e06df515-b63e82c5-b11b830e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:13.987553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.052649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554612590390897:8404]
2025-10-02T09:31:14.052888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1041, pipe: [1:7556554612590390897:8404]
2025-10-02T09:31:14.098833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:14.099236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.099245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.099271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590390897:8404], now have 1 active actors on pipe
2025-10-02T09:31:14.099412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:14.099424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:14.099427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:14.099470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1042 reason: error at write: Disconnected sessionId: src_id|e74fc318-e06df515-b63e82c5-b11b830e_0
2025-10-02T09:31:14.099473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554612590390897:8404]
2025-10-02T09:31:14.099598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1042 sessionId: src_id|e74fc318-e06df515-b63e82c5-b11b830e_0 is DEAD
2025-10-02T09:31:14.099627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:14.099728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:14.099736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Write session will restart in 0.009059s
2025-10-02T09:31:14.099753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Write session: Do CDS request
2025-10-02T09:31:14.099758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:14.105779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:14.107582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:14.107685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:14.107691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:14.107697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:14.107721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:14.107750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554612514855421:7258]
2025-10-02T09:31:14.108156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:14.108343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:14.108373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:14.108568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:14.108599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.108604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.108605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.108605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.108606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.108606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.108607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.108607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.108608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.108608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.108609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.108609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.108612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.108618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.108620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.108622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.108624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.108626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.108628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.108630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.108632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.108634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.108636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.108638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.108642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.108646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.108649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.108652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.108655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.108658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.108660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.108663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.108665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.108668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.108670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.108672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.108674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.108677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.108679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.108681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.108684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.108686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.108689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.108691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.108693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.108696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.108699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.108702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.108718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:14.110124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.110243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:14.110253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1043
2025-10-02T09:31:14.110361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.110382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:14.110390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:14.110394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:14.110727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1043 sessionId:  describe result for acl check
2025-10-02T09:31:14.110765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:14.110772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:14.110773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:14.110778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554612590390987:8631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:14.111270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554612590390987:8631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:14.112990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554612590390987:8631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:14.115607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554612590390987:8631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:14.115616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554612590390987:8631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:14.115618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554612590390987:8631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:14.115623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:14.116094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:14.117490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:14.117502Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:14.117503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:14.117505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:14.117509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1042 [2:7556554612514855421:7258]
2025-10-02T09:31:14.117518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:14.117534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:14.117540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.117542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.117544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.117553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:14.117558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:14.117562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:14.117595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.117599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.117600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.117602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:14.117603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:14.117710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1042
2025-10-02T09:31:14.117740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1042
2025-10-02T09:31:14.117815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:14.117821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.117827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.117836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.117847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:14.117861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590390898:2446], now have 1 active actors on pipe
2025-10-02T09:31:14.117867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391021:8631], now have 1 active actors on pipe
2025-10-02T09:31:14.117877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.117882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.117891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.117895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.117896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.117905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:14.117916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:14.117927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:14.117931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:14.117941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d28d127-417dd373-258abdfe-f1441e56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:14.117944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:14.117945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.117946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:14.117946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:14.117947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.117948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:14.117954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.117959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:14.117972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.117980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:14.117984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:14.117985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.118088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.118095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.118105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.118160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1043 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d28d127-417dd373-258abdfe-f1441e56_0
2025-10-02T09:31:14.118374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74fc318-e06df515-b63e82c5-b11b830e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d28d127-417dd373-258abdfe-f1441e56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:14.120623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Write session: try to update token
2025-10-02T09:31:14.120635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:14.126940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:14.126952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.126957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.126980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:14.126982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:14.127193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:14.127364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.127514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.127665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.127855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:14.127889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:14.132994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId: src_id|1d28d127-417dd373-258abdfe-f1441e56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:14.135082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.135967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.135984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.135997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:14.136002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.136003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:14.136005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:14.136009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.136011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.136016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554612514855416:7258]
2025-10-02T09:31:14.136046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:14.136049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:14.136053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.136054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:14.136055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:14.136059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:14.136157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:14.199608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554612590391031:8404]
2025-10-02T09:31:14.199816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1042, pipe: [1:7556554612590391031:8404]
2025-10-02T09:31:14.257088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:14.257662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:14.257693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391031:8404], now have 1 active actors on pipe
2025-10-02T09:31:14.257816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554612590391031:8404]
2025-10-02T09:31:14.257841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:14.257865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:14.257929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:14.257939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:14.257998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1043 reason: error at write: Disconnected sessionId: src_id|1d28d127-417dd373-258abdfe-f1441e56_0
2025-10-02T09:31:14.258116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1043 sessionId: src_id|1d28d127-417dd373-258abdfe-f1441e56_0 is DEAD
2025-10-02T09:31:14.258266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:14.258273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Write session will restart in 0.007939s
2025-10-02T09:31:14.258286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Write session: Do CDS request
2025-10-02T09:31:14.258290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:14.266961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:14.267192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.267309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:14.267321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1044
2025-10-02T09:31:14.267411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.267438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:14.267442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:14.267445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:14.267793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1044 sessionId:  describe result for acl check
2025-10-02T09:31:14.267828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:14.267830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:14.267832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:14.267836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554612590391117:8636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:14.268305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554612590391117:8636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:14.269328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:14.269465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:14.269472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:14.269479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:14.269516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:14.269546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554612514855546:7261]
2025-10-02T09:31:14.269767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554612590391117:8636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:14.269913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:14.270092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:14.270124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:14.270316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:14.270348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.270352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.270352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.270353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.270353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.270354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.270354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.270355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.270355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.270356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.270356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.270357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.270360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.270365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.270368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.270370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.270372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.270374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.270376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.270378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.270380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.270382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.270384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.270386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.270390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.270394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.270397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.270400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.270402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.270405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.270407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.270410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.270412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.270415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.270417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.270419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.270422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.270425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.270427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.270429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.270431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.270435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.270437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.270440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.270442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.270445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.270447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.270449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.270466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:14.274646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554612590391117:8636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:14.274659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554612590391117:8636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:14.274663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554612590391117:8636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:14.274668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:14.278434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:14.279933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:14.279945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:14.279947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:14.279950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:14.279954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1043 [2:7556554612514855546:7261]
2025-10-02T09:31:14.279965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:14.279978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:14.279980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.279983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.279985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.279998Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:14.280002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:14.280007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:14.280049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.280056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.280058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.280061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:14.280063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:14.280114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:14.280121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.280132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.280146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.280165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:14.280184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391032:2446], now have 1 active actors on pipe
2025-10-02T09:31:14.280190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391157:8636], now have 1 active actors on pipe
2025-10-02T09:31:14.280195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.280197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.280198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.280210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:14.280223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:14.280224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:14.280229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:14.280235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:14.280237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:14.280220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1043
2025-10-02T09:31:14.280225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1043
2025-10-02T09:31:14.280256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:14.280268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.280277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.280286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.280296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:14.280304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:14.280319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:14.280328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.280331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.280333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:14.280340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.280351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:14.280627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.280745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.280752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.280764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.280835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1044 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0
2025-10-02T09:31:14.281108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d28d127-417dd373-258abdfe-f1441e56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:14.283284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Write session: try to update token
2025-10-02T09:31:14.283294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:14.290535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:14.290551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.290553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:14.290555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:14.290562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.290573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.290577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554612514855540:7261]
2025-10-02T09:31:14.290611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:14.290616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.290618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:14.290620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:14.290625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:14.290629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:14.290869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:14.294565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId: src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:14.296795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.357825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554612590391164:8404]
2025-10-02T09:31:14.358084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1043, pipe: [1:7556554612590391164:8404]
2025-10-02T09:31:14.408605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:14.408826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.408836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.408863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391164:8404], now have 1 active actors on pipe
2025-10-02T09:31:14.409010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:14.409070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:14.409110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554612590391164:8404]
2025-10-02T09:31:14.409114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:14.409195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1044 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0
2025-10-02T09:31:14.409354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1044 sessionId: src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0 is DEAD
2025-10-02T09:31:14.409493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:14.409502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Write session will restart in 0.008510s
2025-10-02T09:31:14.409521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Write session: Do CDS request
2025-10-02T09:31:14.409525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:14.415971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:14.417808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:14.417910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:14.417917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:14.417923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:14.417948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:14.417974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554612514855669:7263]
2025-10-02T09:31:14.418311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:14.418486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:14.418508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:14.418696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:14.418729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.418733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.418733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.418734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.418735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.418735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.418736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.418736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.418736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.418737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.418738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.418738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.418741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.418747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.418749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.418751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.418753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.418755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.418757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.418759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.418761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.418764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.418765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.418767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.418771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.418775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.418779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.418781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.418784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.418790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.418792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.418802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.418807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.418810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.418812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.418815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.418817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.418820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.418821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.418824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.418826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.418829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.418831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.418836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.418839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.418841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.418843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.418846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.418865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:14.419175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.419294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:14.419308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1045
2025-10-02T09:31:14.419390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.419407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:14.419410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:14.419413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:14.419657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1045 sessionId:  describe result for acl check
2025-10-02T09:31:14.419676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:14.419677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:14.419679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:14.419682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554612590391255:8640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:14.420011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554612590391255:8640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:14.421657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554612590391255:8640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:14.425079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554612590391255:8640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:14.425090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554612590391255:8640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:14.425092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554612590391255:8640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:14.425095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:14.426321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:14.427673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:14.427683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:14.427684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:14.427686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:14.427690Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1044 [2:7556554612514855669:7263]
2025-10-02T09:31:14.427699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:14.427709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:14.427710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.427712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.427713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.427722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:14.427725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:14.427729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:14.427761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.427767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.427768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.427770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:14.427771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:14.427808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:14.427813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.427819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.427825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.427834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:14.427848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391165:2446], now have 1 active actors on pipe
2025-10-02T09:31:14.427855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391290:8640], now have 1 active actors on pipe
2025-10-02T09:31:14.427859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.427861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.427862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.427874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:14.427885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:14.427889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:14.427892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:14.427894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:14.427900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:14.427902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:14.427886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1044
2025-10-02T09:31:14.427925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.427928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:14.427928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:14.427905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1044
2025-10-02T09:31:14.427936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.427943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.427971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:14.427978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.427981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.427982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:14.427988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.427994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:14.428005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.428121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.428126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.428133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.428191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1045 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0
2025-10-02T09:31:14.428403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5493d4-3b46d28f-852ad4e8-12cd9d47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:14.430838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Write session: try to update token
2025-10-02T09:31:14.430852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:14.437405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:14.437419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.437420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:14.437421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:14.437427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.437429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.437432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554612514855664:7263]
2025-10-02T09:31:14.437459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:14.437460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:14.437463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.437464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:14.437465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:14.437467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:14.437572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:14.441683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId: src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:14.443788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.509387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554612590391298:8404]
2025-10-02T09:31:14.509642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1044, pipe: [1:7556554612590391298:8404]
2025-10-02T09:31:14.557066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:14.557275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.557284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.557312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391298:8404], now have 1 active actors on pipe
2025-10-02T09:31:14.557479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:14.557534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554612590391298:8404]
2025-10-02T09:31:14.557561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:14.557563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:14.557568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:14.557618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1045 reason: error at write: Disconnected sessionId: src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0
2025-10-02T09:31:14.557740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1045 sessionId: src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0 is DEAD
2025-10-02T09:31:14.557868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:14.557878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Write session will restart in 0.007275s
2025-10-02T09:31:14.557899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Write session: Do CDS request
2025-10-02T09:31:14.557905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:14.566159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:14.566215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.566339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:14.566354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1046
2025-10-02T09:31:14.566457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.566486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:14.566495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:14.566498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:14.566849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1046 sessionId:  describe result for acl check
2025-10-02T09:31:14.566878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:14.566884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:14.566885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:14.566890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554612590391386:8644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:14.567275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554612590391386:8644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:14.568586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:14.568748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:14.568761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:14.568769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:14.568837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:14.568834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554612590391386:8644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:14.568871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554612514855793:7265]
2025-10-02T09:31:14.569321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:14.569620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:14.569662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:14.569923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:14.569981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.569989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.569989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.569990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.569991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.569992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.569993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.569994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.569995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.569995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.569996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.569997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.570003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.570012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.570016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.570019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.570022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.570026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.570029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.570032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.570035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.570039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.570042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.570045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.570050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.570056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.570061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.570066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.570069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.570073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.570078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.570083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.570087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.570091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.570095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.570099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.570104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.570108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.570111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.570116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.570119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.570123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.570127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.570131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.570134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.570139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.570143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.570147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.570179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:14.570826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554612590391386:8644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:14.570837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554612590391386:8644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:14.570840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554612590391386:8644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:14.570845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:14.578523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:14.580100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:14.580118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:14.580121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:14.580124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:14.580130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1045 [2:7556554612514855793:7265]
2025-10-02T09:31:14.580143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:14.580159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:14.580162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.580165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.580172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.580186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:14.580195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:14.580201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:14.580258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.580265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.580269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.580274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:14.580281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:14.580348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:14.580355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.580368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.580385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.580409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:14.580425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391299:2446], now have 1 active actors on pipe
2025-10-02T09:31:14.580432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391425:8644], now have 1 active actors on pipe
2025-10-02T09:31:14.580438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.580441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.580443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.580457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:14.580472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:14.580484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:14.580486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:14.580489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:14.580492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:14.580494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:14.580466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1045
2025-10-02T09:31:14.580469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1045
2025-10-02T09:31:14.580517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.580524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:14.580526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:14.580543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.580550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.580592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|941747a0-61004c5e-ed73b136-49b95f5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:14.580602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.580605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.580607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:14.580615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.580627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:14.580644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.580775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.580783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.580794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.580881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1046 partition: 0 MaxSeqNo: 36 sessionId: src_id|941747a0-61004c5e-ed73b136-49b95f5c_0
2025-10-02T09:31:14.581191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fc1bd8-2095382f-c5f3e2d4-3c4436df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|941747a0-61004c5e-ed73b136-49b95f5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:14.583529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Write session: try to update token
2025-10-02T09:31:14.583540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:14.591313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:14.591329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.591332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:14.591333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:14.591341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.591345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.591349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554612514855788:7265]
2025-10-02T09:31:14.591387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:14.591397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.591397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:14.591402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:14.591403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:14.591405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:14.591566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:14.595417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId: src_id|941747a0-61004c5e-ed73b136-49b95f5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:14.597710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.657842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554612590391433:8404]
2025-10-02T09:31:14.658064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1045, pipe: [1:7556554612590391433:8404]
2025-10-02T09:31:14.726321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:14.726551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.726561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.726589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391433:8404], now have 1 active actors on pipe
2025-10-02T09:31:14.726730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:14.726806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:14.726813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554612590391433:8404]
2025-10-02T09:31:14.726828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:14.726874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1046 reason: status is not ok: tablet will be restarted right now sessionId: src_id|941747a0-61004c5e-ed73b136-49b95f5c_0
2025-10-02T09:31:14.727013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1046 sessionId: src_id|941747a0-61004c5e-ed73b136-49b95f5c_0 is DEAD
2025-10-02T09:31:14.727134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:14.727142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Write session will restart in 0.005517s
2025-10-02T09:31:14.727163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Write session: Do CDS request
2025-10-02T09:31:14.727169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:14.734232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.734345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:14.734359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1047
2025-10-02T09:31:14.734452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.734474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:14.734480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:14.734483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:14.734814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1047 sessionId:  describe result for acl check
2025-10-02T09:31:14.734841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:14.734846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:14.734847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:14.734850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554612590391532:8649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:14.735238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554612590391532:8649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:14.736016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:14.736641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554612590391532:8649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:14.738244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:14.738401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:14.738408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:14.738416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:14.738457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:14.738489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554612514855932:7268]
2025-10-02T09:31:14.738663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554612590391532:8649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:14.738676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554612590391532:8649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:14.738678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554612590391532:8649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:14.738685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:14.739083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:14.739304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:14.739338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:14.739625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:14.739665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.739670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.739671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.739672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.739673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.739674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.739676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.739677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.739678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.739679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.739680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.739681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.739685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.739694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.739698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.739702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.739705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.739712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.739716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.739723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.739727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.739735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.739742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.739745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.739754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.739761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.739769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.739778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.739786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.739791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.739798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.739806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.739814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.739822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.739829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.739837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.739845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.739850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.739859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.739867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.739875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.739882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.739890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.739894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.739901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.739909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.739916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.739921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.739958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:14.748037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:14.749539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:14.749549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:14.749552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:14.749556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:14.749562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1046 [2:7556554612514855932:7268]
2025-10-02T09:31:14.749576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:14.749590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:14.749593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.749596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.749598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.749610Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:14.749615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:14.749621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:14.749671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.749677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.749679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.749682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:14.749685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:14.749747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:14.749753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.749764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.749779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.749798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:14.749815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.749821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.749823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.749829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:14.749838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:14.749843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391570:8649], now have 1 active actors on pipe
2025-10-02T09:31:14.749847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:14.749848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:14.749849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:14.749861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:14.749864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:14.749869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391446:2446], now have 1 active actors on pipe
2025-10-02T09:31:14.749894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.749904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:14.749919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:14.749908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1046
2025-10-02T09:31:14.749908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1046
2025-10-02T09:31:14.749969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.749977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.749998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b203510-d1007d50-bd20898f-42de3479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:14.750007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.750010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.750012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:14.750019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.750027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:14.750037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.750143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.750150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.750160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.750237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1047 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b203510-d1007d50-bd20898f-42de3479_0
2025-10-02T09:31:14.750505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941747a0-61004c5e-ed73b136-49b95f5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b203510-d1007d50-bd20898f-42de3479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:14.752963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Write session: try to update token
2025-10-02T09:31:14.752978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:14.759658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:14.759676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.759688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.759725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:14.759735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:14.759895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:14.760031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.760394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.760505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.760661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:14.760690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:14.764568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId: src_id|9b203510-d1007d50-bd20898f-42de3479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:14.766681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.766847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.766860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.766882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:14.766960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:14.768671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:14.768685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.768686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:14.768688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:14.768693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.768695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.768698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554612514855926:7268]
2025-10-02T09:31:14.768722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:14.768727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.768728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:14.768740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:14.768751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:14.768754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:14.768873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:14.826783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554612590391604:8404]
2025-10-02T09:31:14.827021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1046, pipe: [1:7556554612590391604:8404]
2025-10-02T09:31:14.901537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:14.908266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.908287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.908424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.908488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.908551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.908607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.908649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.908655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.908716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.908774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.908845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.908912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.908954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.908959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.909023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.909078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.909134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.909191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.909235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.909242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.909308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.909659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.909717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.909769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.909807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.909812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.909868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.909947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.910036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.910098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.910148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.910154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.910212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.910264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.910319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.910372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.910412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.910417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.910472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.910522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.910619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.910701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.910747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.910754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.910817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.910874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.910956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.911014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.911060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.911064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.911118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.911197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.911254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.911308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.911346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.911351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.911404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:14.911454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:14.911507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:14.911579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:14.911617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:14.911623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:14.911659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391604:8404], now have 1 active actors on pipe
2025-10-02T09:31:14.911912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:14.911914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554612590391604:8404]
2025-10-02T09:31:14.911928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:14.911935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:14.911954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1047 reason: error at write: Disconnected sessionId: src_id|9b203510-d1007d50-bd20898f-42de3479_0
2025-10-02T09:31:14.912121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1047 sessionId: src_id|9b203510-d1007d50-bd20898f-42de3479_0 is DEAD
2025-10-02T09:31:14.912208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:14.912217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Write session will restart in 0.009643s
2025-10-02T09:31:14.912234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Write session: Do CDS request
2025-10-02T09:31:14.912240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:14.912242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:14.921860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:14.923231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.923319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:14.923335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1048
2025-10-02T09:31:14.923639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:14.923669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:14.923678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:14.923682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:14.924043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1048 sessionId:  describe result for acl check
2025-10-02T09:31:14.924056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:14.924074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:14.924081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:14.924082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:14.924087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554612590391708:8661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:14.924167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:14.924174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:14.924179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:14.924206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:14.924226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554612514856098:7283]
2025-10-02T09:31:14.924558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554612590391708:8661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:14.924575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:14.924746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:14.924768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:14.924968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:14.925012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.925017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.925018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.925019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.925020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.925021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.925022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.925023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.925024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.925025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.925026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.925027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.925032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.925041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.925045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.925048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.925051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.925055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.925058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.925062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.925065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.925069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.925072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.925076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.925080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.925087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:14.925096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.925105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:14.925116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.925121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:14.925128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.925137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:14.925143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.925152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:14.925160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.925168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:14.925176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.925185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:14.925193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.925202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:14.925209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.925218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:14.925225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.925233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.925241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.925246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.925250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.925255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.925288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:14.926189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554612590391708:8661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:14.931416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554612590391708:8661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:14.931429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554612590391708:8661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:14.931433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554612590391708:8661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:14.931440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:14.933131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:14.934604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:14.934616Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:14.934619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:14.934621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:14.934625Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1047 [2:7556554612514856098:7283]
2025-10-02T09:31:14.934633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:14.934645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:14.934647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.934648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.934649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.934659Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:14.934664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:14.934669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:14.934716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.934721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.934722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.934724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:14.934725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:14.934767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:14.934775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.934782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:14.934787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:14.934796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:14.934808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391746:8661], now have 1 active actors on pipe
2025-10-02T09:31:14.934813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.934814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.934816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.934820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:14.934827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554612590391618:2446], now have 1 active actors on pipe
2025-10-02T09:31:14.934833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:14.934833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:14.934836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:14.934837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:14.934849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:14.934851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:14.934875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.934878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:14.934882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1047
2025-10-02T09:31:14.934886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1047
2025-10-02T09:31:14.934886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:14.934936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.934943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.934960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:14.934964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:14.934967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:14.934968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:14.934975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:14.934984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:14.934996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.935329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.935335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.935344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:14.935407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1048 partition: 0 MaxSeqNo: 36 sessionId: src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0
2025-10-02T09:31:14.935661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b203510-d1007d50-bd20898f-42de3479_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:14.938010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Write session: try to update token
2025-10-02T09:31:14.938022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:14.949579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId: src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:14.950238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:14.950256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.950263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.950303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:14.950303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:14.950539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:14.950691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.950823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.950962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:14.951151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:14.951192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:14.952031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:14.952169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:14.952183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:14.952208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:14.952293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:14.953897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:14.953911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:14.953912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:14.953913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:14.953918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.953920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.953922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554612514856092:7283]
2025-10-02T09:31:14.953946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:14.953950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:14.953951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:14.953961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:14.953965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:14.953967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:14.954057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.012166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554616885359050:8404]
2025-10-02T09:31:15.012506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1047, pipe: [1:7556554616885359050:8404]
2025-10-02T09:31:15.081817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:15.088594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.088621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.088775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.088846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.088904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.088962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.089007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.089015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.089073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.089130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.089188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.089246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.089287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.089294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.089353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.089405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.089460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.089522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.089563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.089570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.089629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.089685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.089741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.089799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.089839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.089845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.089906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.089962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.090016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.090074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.090116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.090122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.090182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.090236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.090323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.090388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.090429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.090435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.090490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.090542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.090602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.090658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.090700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.090706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.090764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.090816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.090871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.090938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.090978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.090985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.091041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.091095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.091149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.091204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.091261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.091269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.091323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.091379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.091435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.091489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.091528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.091534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.091574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359050:8404], now have 1 active actors on pipe
2025-10-02T09:31:15.091747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:15.091749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554616885359050:8404]
2025-10-02T09:31:15.091771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:15.091773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:15.091792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1048 reason: error at write: Disconnected sessionId: src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0
2025-10-02T09:31:15.091920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1048 sessionId: src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0 is DEAD
2025-10-02T09:31:15.092084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:15.092092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Write session will restart in 0.007663s
2025-10-02T09:31:15.092112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Write session: Do CDS request
2025-10-02T09:31:15.092117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:15.092490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:15.100684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:15.101354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.101472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:15.101491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1049
2025-10-02T09:31:15.101571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.101591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:15.101594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:15.101597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:15.101897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1049 sessionId:  describe result for acl check
2025-10-02T09:31:15.101928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:15.101932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:15.101933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:15.101936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554616885359142:8665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:15.102312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554616885359142:8665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:15.103111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:15.103232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:15.103238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:15.103244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:15.103271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:15.103297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554616809823522:7285]
2025-10-02T09:31:15.103690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:15.103896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:15.103921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:15.104104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:15.104136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.104140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.104140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.104141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.104141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.104142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.104143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.104143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.104144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.104144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.104145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.104145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.104148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.104154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.104156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.104158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.104161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.104163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.104165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.104167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.104169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.104171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.104173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.104174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.104178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.104182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.104185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.104188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.104190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.104193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.104195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.104197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.104200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.104203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.104205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.104208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.104210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.104213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.104215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.104218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.104220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.104222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.104224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.104227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.104230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.104233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.104235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.104238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.104256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:15.104299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554616885359142:8665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:15.109633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554616885359142:8665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:15.109646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554616885359142:8665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:15.109648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554616885359142:8665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:15.109653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:15.112312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:15.113848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:15.113861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:15.113862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:15.113865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:15.113869Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1048 [2:7556554616809823522:7285]
2025-10-02T09:31:15.113879Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:15.113890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:15.113892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.113896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.113899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.113909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:15.113916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:15.113920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:15.113960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.113965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.113966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.113968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:15.113970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:15.114013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:15.114018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.114025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.114031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.114043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:15.114054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.114058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.114059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.114064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:15.114072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:15.114073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:15.114074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:15.114076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:15.114081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:15.114083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:15.114090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359182:8665], now have 1 active actors on pipe
2025-10-02T09:31:15.114096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359051:2446], now have 1 active actors on pipe
2025-10-02T09:31:15.114120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.114132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:15.114138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:15.114138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1048
2025-10-02T09:31:15.114144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1048
2025-10-02T09:31:15.114191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.114199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.114216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:15.114223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.114225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.114226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:15.114232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.114238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:15.114248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.114348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.114353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.114370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.114432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1049 partition: 0 MaxSeqNo: 36 sessionId: src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0
2025-10-02T09:31:15.114757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfa0ace-75bc8d12-f8d0dbdd-cd79e61_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:15.117392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Write session: try to update token
2025-10-02T09:31:15.117406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:15.124004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:15.124020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.124026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.124057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:15.124060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:15.124217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:15.124340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.124524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.124675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.124855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:15.124887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:15.129956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId: src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:15.132249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:15.132824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.132843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.133850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:15.133874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:15.133880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.133882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:15.133883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:15.133890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.133893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.133895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554616809823516:7285]
2025-10-02T09:31:15.133912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:15.133914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:15.133919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.133920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:15.133922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:15.133925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:15.133961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:15.134055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.191836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554616885359195:8404]
2025-10-02T09:31:15.192028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1048, pipe: [1:7556554616885359195:8404]
2025-10-02T09:31:15.260976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:15.267102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.267121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.267252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.267303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.267356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.267412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.267450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.267456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.267510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.267559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.267610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.267662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.267700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.267705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.267761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.267824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.267885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.267944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.267980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.267985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.268040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.268101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.268162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.268216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.268255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.268260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.268314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.268364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.268417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.268467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.268504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.268509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.268559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.268606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.268656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.268707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.268759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.268766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.268827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.268877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.268931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.268983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.269033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.269038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.269089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.269134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.269182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.269231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.269321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.269327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.269376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.269428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.269478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.269527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.269562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.269567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.269616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.269661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.269710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.269757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.269796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.269800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.269832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359195:8404], now have 1 active actors on pipe
2025-10-02T09:31:15.270029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:15.270032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554616885359195:8404]
2025-10-02T09:31:15.270046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:15.270050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:15.270073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1049 reason: error at write: Disconnected sessionId: src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0
2025-10-02T09:31:15.270231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1049 sessionId: src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0 is DEAD
2025-10-02T09:31:15.270348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:15.270360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Write session will restart in 0.009074s
2025-10-02T09:31:15.270380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Write session: Do CDS request
2025-10-02T09:31:15.270385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:15.270507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:15.277722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:15.280073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:15.280166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.280181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:15.280188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:15.280194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:15.280221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:15.280244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554616809823655:7288]
2025-10-02T09:31:15.280288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:15.280301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1050
2025-10-02T09:31:15.280377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.280396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:15.280402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:15.280405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:15.280597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:15.280685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1050 sessionId:  describe result for acl check
2025-10-02T09:31:15.280714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:15.280721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:15.280722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:15.280727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554616885359291:8670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:15.280791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:15.280826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:15.281004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:15.281033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.281036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.281037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.281038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.281038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.281039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.281039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.281040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.281040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.281041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.281041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.281042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.281045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.281051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.281053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.281055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.281057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.281059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.281061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.281063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.281065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.281068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.281070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.281072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.281075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.281080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.281084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.281086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.281088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.281091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.281093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.281096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.281102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.281091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554616885359291:8670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:15.281104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.281106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.281109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.281112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.281115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.281117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.281120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.281122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.281124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.281126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.281129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.281132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.281134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.281140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.281142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.281160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:15.282632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554616885359291:8670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:15.287215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554616885359291:8670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:15.287224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554616885359291:8670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:15.287225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554616885359291:8670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:15.287229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:15.289707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:15.291407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:15.291418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:15.291419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:15.291422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:15.291425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1049 [2:7556554616809823655:7288]
2025-10-02T09:31:15.291433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:15.291443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:15.291446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.291448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.291449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.291458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:15.291466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:15.291470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:15.291504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.291506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.291507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.291508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:15.291510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:15.291548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:15.291553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.291559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.291564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.291575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:15.291589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359329:8670], now have 1 active actors on pipe
2025-10-02T09:31:15.291595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359198:2446], now have 1 active actors on pipe
2025-10-02T09:31:15.291598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.291600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.291601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.291608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:15.291616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:15.291619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:15.291621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:15.291623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:15.291627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:15.291628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:15.291643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.291649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:15.291653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:15.291670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.291647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1049
2025-10-02T09:31:15.291676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.291648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1049
2025-10-02T09:31:15.291690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c02dd074-c36179a-278f233f-18a1f141_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:15.291695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.291698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.291699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:15.291704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.291710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:15.291720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.291815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.291820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.291828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.291876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1050 partition: 0 MaxSeqNo: 36 sessionId: src_id|c02dd074-c36179a-278f233f-18a1f141_0
2025-10-02T09:31:15.292113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85bc3d2c-8d971e25-933bf64b-602197a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c02dd074-c36179a-278f233f-18a1f141_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:15.294510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Write session: try to update token
2025-10-02T09:31:15.294522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:15.302098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:15.302113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.302120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.302146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:15.302151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:15.302300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:15.302431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.302554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.302678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.302845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:15.302874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:15.306072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId: src_id|c02dd074-c36179a-278f233f-18a1f141_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:15.308353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:15.308580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.308593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.308614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:15.308693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:15.312178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:15.312191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.312192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:15.312196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:15.312202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.312205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.312207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554616809823650:7288]
2025-10-02T09:31:15.312231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:15.312237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.312238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:15.312270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:15.312285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:15.312289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:15.312353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.370025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554616885359336:8404]
2025-10-02T09:31:15.370233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1049, pipe: [1:7556554616885359336:8404]
2025-10-02T09:31:15.431781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:15.437882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.437902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.438050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.438113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.438178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.438237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.438281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.438289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.438357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.438407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.438466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.438530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.438569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.438574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.438635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.438687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.438742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.438793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.438833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.438839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.438910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.438971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.439030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.439098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.439138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.439143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.439198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.439247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.439299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.439348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.439385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.439389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.439444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.439496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.439548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.439596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.439650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.439657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.439727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.439796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.439848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.439899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.439946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.439949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.440003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.440052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.440105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.440161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.440218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.440226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.440286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.440340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.440392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.440450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.440492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.440501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.440558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.440611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.440666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.440721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.440760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.440766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.440823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359336:8404], now have 1 active actors on pipe
2025-10-02T09:31:15.441064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:15.441065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554616885359336:8404]
2025-10-02T09:31:15.441079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:15.441085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:15.441104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1050 reason: error at write: Disconnected sessionId: src_id|c02dd074-c36179a-278f233f-18a1f141_0
2025-10-02T09:31:15.441253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1050 sessionId: src_id|c02dd074-c36179a-278f233f-18a1f141_0 is DEAD
2025-10-02T09:31:15.441364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:15.441369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Write session will restart in 0.009483s
2025-10-02T09:31:15.441383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Write session: Do CDS request
2025-10-02T09:31:15.441387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:15.441544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:15.449712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:15.451757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:15.451883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:15.451889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:15.451899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:15.451942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:15.451966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554616809823785:7290]
2025-10-02T09:31:15.452204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.452257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:15.452269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1051
2025-10-02T09:31:15.452312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:15.452373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.452392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:15.452398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:15.452401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:15.452490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:15.452513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:15.452652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1051 sessionId:  describe result for acl check
2025-10-02T09:31:15.452678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:15.452682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:15.452683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:15.452685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554616885359433:8674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:15.452704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:15.452735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.452739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.452740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.452740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.452741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.452741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.452742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.452742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.452743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.452743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.452743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.452744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.452747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.452754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.452756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.452758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.452760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.452762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.452764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.452765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.452767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.452769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.452771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.452773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.452777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.452781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.452784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.452787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.452789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.452792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.452794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.452797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.452799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.452811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.452814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.452817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.452819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.452822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.452824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.452826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.452829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.452831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.452834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.452837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.452840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.452842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.452844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.452847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.452863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:15.453068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554616885359433:8674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:15.454687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554616885359433:8674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:15.458895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554616885359433:8674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:15.458915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554616885359433:8674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:15.458918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554616885359433:8674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:15.458924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:15.461508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:15.462969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:15.462983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:15.462987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:15.462990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:15.462995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1050 [2:7556554616809823785:7290]
2025-10-02T09:31:15.463005Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:15.463019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:15.463025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.463028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.463030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.463041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:15.463050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:15.463056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:15.463098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.463105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.463106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.463109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:15.463111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:15.463164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:15.463170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.463180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.463189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.463207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:15.463226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359338:2446], now have 1 active actors on pipe
2025-10-02T09:31:15.463234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359470:8674], now have 1 active actors on pipe
2025-10-02T09:31:15.463238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.463240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.463242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.463256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:15.463271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:15.463279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:15.463282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:15.463284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:15.463287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:15.463290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:15.463310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.463318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:15.463319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:15.463291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1050
2025-10-02T09:31:15.463313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1050
2025-10-02T09:31:15.463338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.463345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.463370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:15.463379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.463382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.463383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:15.463390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.463401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:15.463413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.463532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.463543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.463558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.463638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1051 partition: 0 MaxSeqNo: 36 sessionId: src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0
2025-10-02T09:31:15.463886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02dd074-c36179a-278f233f-18a1f141_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:15.466425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Write session: try to update token
2025-10-02T09:31:15.466440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:15.473584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:15.473600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.473602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:15.473603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:15.473609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.473613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.473615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554616809823780:7290]
2025-10-02T09:31:15.473646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:15.473651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.473653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:15.473658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:15.473664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:15.473668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:15.473781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.478747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId: src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:15.480771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:15.541026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554616885359477:8404]
2025-10-02T09:31:15.541290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1050, pipe: [1:7556554616885359477:8404]
2025-10-02T09:31:15.598807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:15.599294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.599304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.599331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359477:8404], now have 1 active actors on pipe
2025-10-02T09:31:15.599508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:15.599523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:15.599524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:15.599571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1051 reason: error at write: Disconnected sessionId: src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0
2025-10-02T09:31:15.599575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554616885359477:8404]
2025-10-02T09:31:15.599653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:15.599698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1051 sessionId: src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0 is DEAD
2025-10-02T09:31:15.599862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:15.599877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Write session will restart in 0.007739s
2025-10-02T09:31:15.599900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Write session: Do CDS request
2025-10-02T09:31:15.599906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:15.607172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:15.608185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.608257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:15.608269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1052
2025-10-02T09:31:15.608358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.608379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:15.608385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:15.608388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:15.608664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1052 sessionId:  describe result for acl check
2025-10-02T09:31:15.608695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:15.608701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:15.608702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:15.608709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554616885359572:8678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:15.609101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554616885359572:8678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:15.609278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:15.609383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:15.609389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:15.609396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:15.609423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:15.609446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554616809823916:7292]
2025-10-02T09:31:15.609801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:15.610080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:15.610106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:15.610294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:15.610323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.610327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.610328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.610328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.610329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.610329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.610330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.610331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.610331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.610332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.610332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.610333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.610336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.610342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.610344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.610346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.610348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.610350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.610352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.610354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.610356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.610358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.610360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.610362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.610366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.610370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.610373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.610376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.610378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.610381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.610383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.610386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.610388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.610390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.610392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.610395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.610397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.610400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.610401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.610405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.610407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.610410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.610412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.610414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.610416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.610419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.610421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.610423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.610440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:15.610717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554616885359572:8678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:15.615604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554616885359572:8678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:15.615614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554616885359572:8678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:15.615616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554616885359572:8678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:15.615622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:15.618430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:15.619839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:15.619852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:15.619853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:15.619855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:15.619860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1051 [2:7556554616809823916:7292]
2025-10-02T09:31:15.619868Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:15.619880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:15.619885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.619887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.619888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.619898Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:15.619904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:15.619909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:15.619945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.619949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.619950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.619953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:15.619954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:15.619996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:15.620001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.620007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.620013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.620021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:15.620035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.620039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.620041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.620046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:15.620054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359611:8678], now have 1 active actors on pipe
2025-10-02T09:31:15.620054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:15.620056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:15.620058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:15.620060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359478:2446], now have 1 active actors on pipe
2025-10-02T09:31:15.620065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:15.620072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:15.620076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:15.620092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.620101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:15.620091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1051
2025-10-02T09:31:15.620114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:15.620097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1051
2025-10-02T09:31:15.620136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.620141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.620156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:15.620163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.620165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.620166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:15.620171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.620179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:15.620190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.620277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.620281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.620288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.620339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1052 partition: 0 MaxSeqNo: 36 sessionId: src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0
2025-10-02T09:31:15.620578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd98154-cd011d9c-79d08a5c-f9d6f0fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:15.622864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Write session: try to update token
2025-10-02T09:31:15.622876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:15.629668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:15.629683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.629691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.629722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:15.629734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:15.629858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:15.629986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.630107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.630223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:15.630385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:15.630410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:15.633937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId: src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:15.635951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:15.636194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:15.636088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.636099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.636118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:15.638556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:15.638566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.638568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:15.638569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:15.638574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.638576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.638579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554616809823911:7292]
2025-10-02T09:31:15.638601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:15.638609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.638610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:15.638612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:15.638616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:15.638620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:15.638728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.699763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554616885359618:8404]
2025-10-02T09:31:15.699942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1051, pipe: [1:7556554616885359618:8404]
2025-10-02T09:31:15.760302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:15.766306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.766322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.766447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.766497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.766550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.766601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.766641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.766648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.766701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.766749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.766799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.766852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.766889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.766894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.766952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.766999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.767049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.767100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.767136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.767141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.767190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.767238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.767284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.767334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.767369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.767374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.767427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.767474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.767523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.767572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.767607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.767612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.767664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.767711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.767786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.767834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.767871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.767876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.767927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.767994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.768062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.768110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.768145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.768150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.768202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.768250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.768300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.768363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.768400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.768406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.768453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.768524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.768606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.768654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.768698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.768703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.768748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:15.768794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:15.768852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:15.768903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:15.768939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:15.768944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:15.768975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359618:8404], now have 1 active actors on pipe
2025-10-02T09:31:15.769165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554616885359618:8404]
2025-10-02T09:31:15.769177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:15.769180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:15.769192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:15.769200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1052 reason: error at write: Disconnected sessionId: src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0
2025-10-02T09:31:15.769347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1052 sessionId: src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0 is DEAD
2025-10-02T09:31:15.769493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:15.769503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Write session will restart in 0.007012s
2025-10-02T09:31:15.769527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Write session: Do CDS request
2025-10-02T09:31:15.769533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:15.769745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:15.776657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:15.777146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.777231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:15.777251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1053
2025-10-02T09:31:15.777335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.777355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:15.777361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:15.777364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:15.777641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1053 sessionId:  describe result for acl check
2025-10-02T09:31:15.777662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:15.777666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:15.777667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:15.777670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554616885359730:8683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:15.778133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554616885359730:8683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:15.778757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:15.778858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:15.778865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:15.778871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:15.778897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:15.778930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554616809824061:7295]
2025-10-02T09:31:15.779291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:15.779485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:15.779508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:15.779632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554616885359730:8683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:15.779694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:15.779723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.779727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.779728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.779728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.779729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.779729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.779730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.779730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.779731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.779731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.779732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.779732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.779735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.779742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.779744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.779746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.779748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.779750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.779752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.779754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.779756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.779758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.779760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.779762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.779765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.779769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.779772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.779775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.779777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.779780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.779782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.779785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.779787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.779790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.779792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.779794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.779796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.779799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.779801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.779804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.779806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.779809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.779811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.779813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.779816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.779819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.779822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.779825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.779843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:15.784864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554616885359730:8683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:15.784884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554616885359730:8683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:15.784889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554616885359730:8683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:15.784893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:15.787474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:15.788958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:15.788968Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:15.788969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:15.788971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:15.788975Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1052 [2:7556554616809824061:7295]
2025-10-02T09:31:15.788982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:15.788992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:15.788997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.788999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.789000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.789009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:15.789017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:15.789021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:15.789055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.789059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.789060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.789062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:15.789063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:15.789102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:15.789107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.789113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.789122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.789133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:15.789148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359768:8683], now have 1 active actors on pipe
2025-10-02T09:31:15.789153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359631:2446], now have 1 active actors on pipe
2025-10-02T09:31:15.789157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.789159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.789160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.789167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:15.789178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:15.789186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:15.789188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:15.789190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:15.789195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:15.789199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:15.789188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1052
2025-10-02T09:31:15.789206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.789211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:15.789207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1052
2025-10-02T09:31:15.789213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:15.789367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.789374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.789395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:15.789404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.789410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.789412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:15.789417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.789426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:15.789434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.789551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.789556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.789563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.789617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1053 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0
2025-10-02T09:31:15.789868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d939a7fe-c4c5dab8-bff2ceda-c46951d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:15.792105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Write session: try to update token
2025-10-02T09:31:15.792117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:15.798881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:15.798896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.798897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:15.798898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:15.798912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.798915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.798917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554616809824056:7295]
2025-10-02T09:31:15.798941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:15.798944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.798946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:15.798948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:15.798953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:15.798957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:15.799056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.803071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId: src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:15.805301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:15.869199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554616885359803:8404]
2025-10-02T09:31:15.869379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1052, pipe: [1:7556554616885359803:8404]
2025-10-02T09:31:15.917367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:15.917915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.917925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.917951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359803:8404], now have 1 active actors on pipe
2025-10-02T09:31:15.918121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554616885359803:8404]
2025-10-02T09:31:15.918131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:15.918133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:15.918145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:15.918178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1053 reason: error at write: Disconnected sessionId: src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0
2025-10-02T09:31:15.918309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:15.918320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1053 sessionId: src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0 is DEAD
2025-10-02T09:31:15.918474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:15.918497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Write session will restart in 0.006671s
2025-10-02T09:31:15.918528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Write session: Do CDS request
2025-10-02T09:31:15.918534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:15.924915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:15.926175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.926242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:15.926254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1054
2025-10-02T09:31:15.926814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:15.926843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:15.926847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:15.926852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:15.926872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:15.926982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:15.926987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:15.926993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:15.927019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:15.927042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554616809824231:7310]
2025-10-02T09:31:15.927158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1054 sessionId:  describe result for acl check
2025-10-02T09:31:15.927184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:15.927185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:15.927186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:15.927189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554616885359900:8695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:15.927424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:15.927547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554616885359900:8695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:15.927621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:15.927644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:15.927822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:15.927852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.927856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.927856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.927857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.927857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.927858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.927859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.927859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.927859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.927860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.927861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.927861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.927864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.927870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.927872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.927875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.927877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.927879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.927881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.927883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.927885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.927887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.927889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.927891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.927894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.927898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:15.927901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.927904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:15.927907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.927909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:15.927911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.927914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:15.927916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.927919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:15.927923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.927926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:15.927932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.927935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:15.927937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.927939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:15.927942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.927944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:15.927947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.927949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.927955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.927958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.927960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.927962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.927983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:15.929060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554616885359900:8695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:15.933751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554616885359900:8695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:15.933760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554616885359900:8695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:15.933763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554616885359900:8695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:15.933767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:15.935704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:15.937080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:15.937090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:15.937092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:15.937094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:15.937097Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1053 [2:7556554616809824231:7310]
2025-10-02T09:31:15.937104Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:15.937115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:15.937118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.937120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.937121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.937130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:15.937134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:15.937139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:15.937172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.937176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.937178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.937180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:15.937181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:15.937220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:15.937225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.937231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:15.937236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:15.937244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:15.937255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359939:8695], now have 1 active actors on pipe
2025-10-02T09:31:15.937260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554616885359805:2446], now have 1 active actors on pipe
2025-10-02T09:31:15.937264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.937265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.937266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.937273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:15.937282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:15.937289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:15.937294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:15.937295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:15.937298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:15.937300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:15.937299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1053
2025-10-02T09:31:15.937325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1053
2025-10-02T09:31:15.937309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.937314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:15.937321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:15.937329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.937332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.937353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:15.937356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:15.937358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:15.937359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:15.937366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:15.937371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:15.937380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.937481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:15.937487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:15.937494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:15.937557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1054 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0
2025-10-02T09:31:15.937799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7486562-e4b61adb-35cfd890-ace8f4e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:15.940215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Write session: try to update token
2025-10-02T09:31:15.940230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:15.946584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:15.946599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:15.946600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:15.946601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:15.946605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.946608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.946610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554616809824226:7310]
2025-10-02T09:31:15.946633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:15.946635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:15.946636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:15.946637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:15.946638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:15.946641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:15.946742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:15.951572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId: src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:15.953728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.018206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180327243:8404]
2025-10-02T09:31:16.018471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1053, pipe: [1:7556554621180327243:8404]
2025-10-02T09:31:16.062377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.062896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.062914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.062942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327243:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.063066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.063092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:16.063102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:16.063112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180327243:8404]
2025-10-02T09:31:16.063128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.063145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1054 reason: error at write: Disconnected sessionId: src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0
2025-10-02T09:31:16.063295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1054 sessionId: src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0 is DEAD
2025-10-02T09:31:16.063418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:16.063427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Write session will restart in 0.008364s
2025-10-02T09:31:16.063444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Write session: Do CDS request
2025-10-02T09:31:16.063449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.070697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.072569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.072669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.072676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.072681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.072708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.072732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104791661:7312]
2025-10-02T09:31:16.073093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.073160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.073265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.073258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.073270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1055
2025-10-02T09:31:16.073287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.073376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.073395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.073401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.073403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.073468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.073499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.073503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.073503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.073504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.073504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.073505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.073506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.073506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.073506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.073507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.073508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.073508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.073511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.073517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.073520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.073522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.073524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.073526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.073528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.073530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.073532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.073534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.073536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.073538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.073542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.073546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.073549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.073552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.073555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.073557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.073560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.073563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.073565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.073568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.073570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.073573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.073575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.073578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.073580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.073583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.073587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.073593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.073595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.073600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.073605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.073608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.073610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.073613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.073629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.073674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1055 sessionId:  describe result for acl check
2025-10-02T09:31:16.073702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.073712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.073714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.073717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180327342:8699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.074060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180327342:8699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.075398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180327342:8699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.079011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180327342:8699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.079021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180327342:8699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.079023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180327342:8699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.079027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.081202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.082563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.082574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.082575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.082577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.082580Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1054 [2:7556554621104791661:7312]
2025-10-02T09:31:16.082589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.082599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.082600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.082602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.082603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.082613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.082616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.082620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.082653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.082658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.082659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.082661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.082662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.082700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.082704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.082711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.082720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.082731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.082747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327244:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.082752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327379:8699], now have 1 active actors on pipe
2025-10-02T09:31:16.082756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.082757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.082759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.082767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.082759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1054
2025-10-02T09:31:16.082771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.082773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1054
2025-10-02T09:31:16.082773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.082774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.082777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.082785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.082790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.082813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.082818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.082825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.082832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.082841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.082851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.082858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.082861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.082862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.082866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.082871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.082883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.082988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.082992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.083000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.083046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1055 partition: 0 MaxSeqNo: 36 sessionId: src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0
2025-10-02T09:31:16.083236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea30b64-20c32605-9dd667c2-43b0bf46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.085442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Write session: try to update token
2025-10-02T09:31:16.085453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:16.092250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:16.092264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.092265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:16.092266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:16.092271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.092274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.092276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104791656:7312]
2025-10-02T09:31:16.092296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:16.092300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.092301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:16.092303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:16.092306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:16.092309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:16.092411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:16.096056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId: src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:16.098147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.163098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180327388:8404]
2025-10-02T09:31:16.163292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1054, pipe: [1:7556554621180327388:8404]
2025-10-02T09:31:16.208026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.208249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.208257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.208284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327388:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.208484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:16.208498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:16.208543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1055 reason: error at write: Disconnected sessionId: src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0
2025-10-02T09:31:16.208654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180327388:8404]
2025-10-02T09:31:16.208683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.208691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1055 sessionId: src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0 is DEAD
2025-10-02T09:31:16.208750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.208831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:16.208840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Write session will restart in 0.007217s
2025-10-02T09:31:16.208864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Write session: Do CDS request
2025-10-02T09:31:16.208869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.215237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.217128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.217155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.217227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.217233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.217239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.217229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.217243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1056
2025-10-02T09:31:16.217263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.217285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104791799:7315]
2025-10-02T09:31:16.217320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.217339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.217345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.217349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.217617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1056 sessionId:  describe result for acl check
2025-10-02T09:31:16.217628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.217643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.217649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.217650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.217653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180327488:8704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.217798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.217819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.217981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180327488:8704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.217994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.218022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.218026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.218026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.218027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.218027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.218028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.218028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.218029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.218029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.218030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.218031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.218031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.218034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.218040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.218042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.218044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.218046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.218048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.218050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.218051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.218054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.218056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.218058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.218059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.218063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.218067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.218070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.218073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.218075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.218078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.218080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.218084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.218091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.218094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.218096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.218098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.218100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.218103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.218105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.218107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.218114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.218117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.218119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.218122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.218124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.218126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.218128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.218131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.218147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.219241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180327488:8704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.223413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180327488:8704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.223422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180327488:8704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.223424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180327488:8704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.223428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.225587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.227196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.227208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.227209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.227212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.227215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1055 [2:7556554621104791799:7315]
2025-10-02T09:31:16.227223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.227233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.227234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.227236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.227237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.227247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.227253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.227258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.227292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.227299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.227300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.227301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.227303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.227339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.227344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.227351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.227356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.227367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.227381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327391:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.227386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327526:8704], now have 1 active actors on pipe
2025-10-02T09:31:16.227390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.227391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.227392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.227399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.227407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.227412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.227414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.227415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.227417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.227419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.227435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.227440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.227441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.227430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1055
2025-10-02T09:31:16.227432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1055
2025-10-02T09:31:16.227462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.227467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.227484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29b840ad-251ec89c-d8799915-5fd65608_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.227492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.227494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.227495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.227500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.227508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.227518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.227614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.227618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.227627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.227687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1056 partition: 0 MaxSeqNo: 36 sessionId: src_id|29b840ad-251ec89c-d8799915-5fd65608_0
2025-10-02T09:31:16.227886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83366aeb-8909c361-6d2106a8-d0a51bdd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29b840ad-251ec89c-d8799915-5fd65608_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.230039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Write session: try to update token
2025-10-02T09:31:16.230050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:16.236854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:16.236867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.236868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:16.236869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:16.236874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.236878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.236880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104791794:7315]
2025-10-02T09:31:16.236903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:16.236907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.236911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:16.236947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:16.236968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:16.236973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:16.237028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:16.240458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId: src_id|29b840ad-251ec89c-d8799915-5fd65608_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:16.242629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.309042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180327534:8404]
2025-10-02T09:31:16.309290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1055, pipe: [1:7556554621180327534:8404]
2025-10-02T09:31:16.354304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.354524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.354534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.354562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327534:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.354748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.354790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:16.354796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.354808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:16.354827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180327534:8404]
2025-10-02T09:31:16.354855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1056 reason: error at write: Disconnected sessionId: src_id|29b840ad-251ec89c-d8799915-5fd65608_0
2025-10-02T09:31:16.354993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1056 sessionId: src_id|29b840ad-251ec89c-d8799915-5fd65608_0 is DEAD
2025-10-02T09:31:16.355134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:16.355142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Write session will restart in 0.007946s
2025-10-02T09:31:16.355160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Write session: Do CDS request
2025-10-02T09:31:16.355164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.362652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.364211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.364321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.364332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1057
2025-10-02T09:31:16.364424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.364418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.364443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.364449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.364452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.364537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.364544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.364549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.364577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.364600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104791933:7317]
2025-10-02T09:31:16.364726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1057 sessionId:  describe result for acl check
2025-10-02T09:31:16.364751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.364756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.364757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.364760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180327633:8708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.364964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.365108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180327633:8708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.365138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.365162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.365364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.365401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.365405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.365405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.365406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.365406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.365407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.365408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.365408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.365409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.365409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.365410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.365410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.365413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.365420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.365422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.365424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.365426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.365428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.365430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.365433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.365436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.365440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.365443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.365446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.365452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.365457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.365462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.365467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.365471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.365476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.365483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.365487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.365489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.365492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.365494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.365496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.365499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.365501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.365507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.365509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.365511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.365514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.365516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.365519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.365525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.365528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.365531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.365537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.365556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.366783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180327633:8708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.371062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180327633:8708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.371074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180327633:8708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.371077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180327633:8708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.371083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.373346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.374816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.374830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.374831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.374834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.374837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1056 [2:7556554621104791933:7317]
2025-10-02T09:31:16.374845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.374854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.374856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.374857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.374858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.374867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.374874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.374879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.374936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.374942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.374944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.374947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.374949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.375112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1056
2025-10-02T09:31:16.375120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1056
2025-10-02T09:31:16.375185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.375192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.375200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.375209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.375221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.375236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327535:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.375241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327671:8708], now have 1 active actors on pipe
2025-10-02T09:31:16.375253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.375258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.375269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.375273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.375275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.375284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.375295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.375305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.375307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.375309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.375315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.375317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.375319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.375323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.375325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.375326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.375332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.375338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.375357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.375364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.375370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.375374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.375500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.375504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.375513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.375577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1057 partition: 0 MaxSeqNo: 36 sessionId: src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0
2025-10-02T09:31:16.375812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b840ad-251ec89c-d8799915-5fd65608_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.378184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Write session: try to update token
2025-10-02T09:31:16.378196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:16.388794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:16.388819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.388825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.388857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:16.388861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:16.389002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:16.389124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:16.389238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:16.389356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:16.389517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:16.389546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:16.389642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId: src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:16.391899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.392031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.392046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.392067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:16.392135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:16.393401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:16.393414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.393415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:16.393416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:16.393424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.393426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.393428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104791928:7317]
2025-10-02T09:31:16.393450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:16.393451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:16.393453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:16.393454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.393455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:16.393455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:16.393587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:16.454972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180327680:8404]
2025-10-02T09:31:16.455184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1056, pipe: [1:7556554621180327680:8404]
2025-10-02T09:31:16.512554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.519215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.519234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.519364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.519414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.519468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.519519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.519558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.519569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.519624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.519674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.519727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.519783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.519822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.519827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.519883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.519933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.519984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.520037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.520075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.520080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.520133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.520184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.520234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.520289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.520330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.520335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.520389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.520438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.520489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.520543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.520581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.520586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.520640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.520689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.520739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.520795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.520846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.520852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.520904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.520956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.521010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.521080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.521120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.521125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.521181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.521231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.521282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.521336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.521389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.521394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.521449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.521515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.521565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.521614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.521651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.521656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.521710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:16.521760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:16.521811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:16.521868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:16.521912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:16.521921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:16.521958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327680:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.522186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180327680:8404]
2025-10-02T09:31:16.522189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.522226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:16.522233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:16.522256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1057 reason: error at write: Disconnected sessionId: src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0
2025-10-02T09:31:16.522367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1057 sessionId: src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0 is DEAD
2025-10-02T09:31:16.522466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:16.522475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Write session will restart in 0.005735s
2025-10-02T09:31:16.522493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Write session: Do CDS request
2025-10-02T09:31:16.522498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.522817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.529184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.529321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.529334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1058
2025-10-02T09:31:16.529430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.529458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.529467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.529474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.529819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1058 sessionId:  describe result for acl check
2025-10-02T09:31:16.529853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.529858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.529860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.529864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180327780:8714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.530234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180327780:8714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.530498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.532409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180327780:8714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.532633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.532739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.532745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.532751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.532779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.532818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104792070:7319]
2025-10-02T09:31:16.533163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.533363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.533386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.533576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.533606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.533610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.533610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.533611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.533612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.533612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.533613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.533613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.533614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.533614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.533615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.533616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.533619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.533625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.533627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.533629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.533631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.533633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.533635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.533637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.533639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.533642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.533643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.533645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.533649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.533653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.533657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.533659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.533662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.533664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.533667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.533670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.533674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.533677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.533679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.533683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.533685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.533688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.533693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.533696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.533698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.533701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.533703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.533710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.533712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.533715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.533717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.533720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.533738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.537819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180327780:8714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.537832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180327780:8714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.537835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180327780:8714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.537841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.541572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.542973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.542983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.542984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.542987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.542991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1057 [2:7556554621104792070:7319]
2025-10-02T09:31:16.542997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.543009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.543010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.543012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.543013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.543024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.543031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.543035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.543070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.543074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.543074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.543076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.543077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.543113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.543118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.543124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.543132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.543144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.543159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327684:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.543164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327821:8714], now have 1 active actors on pipe
2025-10-02T09:31:16.543168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.543169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.543170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.543177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.543185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.543191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.543194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.543196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.543197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.543199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.543206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1057
2025-10-02T09:31:16.543220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1057
2025-10-02T09:31:16.543210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.543216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.543218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.543242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.543250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.543271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.543280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.543285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.543286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.543292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.543300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.543310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.543420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.543425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.543432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.543496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1058 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0
2025-10-02T09:31:16.543739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|584cd6f3-3a1ff736-670e9b49-cc9c4786_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.545920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Write session: try to update token
2025-10-02T09:31:16.545932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:16.552862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:16.552874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.552875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:16.552877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:16.552882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.552885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.552887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104792065:7319]
2025-10-02T09:31:16.552911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:16.552913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:16.552915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.552917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:16.552917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:16.552919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:16.553032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:16.556513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId: src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:16.558564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.622385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180327830:8404]
2025-10-02T09:31:16.622606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1057, pipe: [1:7556554621180327830:8404]
2025-10-02T09:31:16.672191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.672711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.672722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.672747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327830:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.672961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.672967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180327830:8404]
2025-10-02T09:31:16.672977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.672997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:16.672999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:16.673051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1058 reason: error at write: Disconnected sessionId: src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0
2025-10-02T09:31:16.673223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1058 sessionId: src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0 is DEAD
2025-10-02T09:31:16.673369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:16.673378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Write session will restart in 0.006546s
2025-10-02T09:31:16.673396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Write session: Do CDS request
2025-10-02T09:31:16.673400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.681125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.681182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.681229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.681242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1059
2025-10-02T09:31:16.681335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.681363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.681371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.681375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.681716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1059 sessionId:  describe result for acl check
2025-10-02T09:31:16.681749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.681751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.681752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.681756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180327931:8718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.682102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180327931:8718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.683485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.683605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.683612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.683617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.683647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.683671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104792220:7322]
2025-10-02T09:31:16.683958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180327931:8718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.684024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.684231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.684255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.684442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.684476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.684481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.684482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.684482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.684483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.684483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.684484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.684484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.684485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.684485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.684486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.684486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.684489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.684495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.684497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.684499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.684501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.684503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.684505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.684507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.684509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.684511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.684513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.684515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.684519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.684522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.684526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.684528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.684530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.684533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.684535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.684538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.684540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.684543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.684545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.684547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.684550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.684552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.684554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.684557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.684560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.684563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.684565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.684568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.684570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.684573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.684575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.684577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.684595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.688758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180327931:8718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.688768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180327931:8718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.688770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180327931:8718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.688775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.692542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.693929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.693940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.693941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.693944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.693947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1058 [2:7556554621104792220:7322]
2025-10-02T09:31:16.693955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.693965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.693970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.693972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.693973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.693982Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.693988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.693993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.694033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.694038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.694039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.694041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.694043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.694081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.694087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.694093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.694098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.694107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.694122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327831:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.694129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.694130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.694131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.694139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.694143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327970:8718], now have 1 active actors on pipe
2025-10-02T09:31:16.694149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.694152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.694154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.694155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.694160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.694161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.694177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.694182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.694184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.694165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1058
2025-10-02T09:31:16.694170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1058
2025-10-02T09:31:16.694202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.694207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.694223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|930dca08-af94d3c8-1f12a583-6d063a91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.694229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.694231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.694232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.694237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.694243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.694253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.694348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.694353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.694360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.694411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1059 partition: 0 MaxSeqNo: 36 sessionId: src_id|930dca08-af94d3c8-1f12a583-6d063a91_0
2025-10-02T09:31:16.694638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fee8589-8fd8d343-f1748ec1-278589a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|930dca08-af94d3c8-1f12a583-6d063a91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.696857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Write session: try to update token
2025-10-02T09:31:16.696867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:16.704112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:16.704127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.704128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:16.704129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:16.704135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.704139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.704142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104792215:7322]
2025-10-02T09:31:16.704166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:16.704173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.704174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:16.704176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:16.704180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:16.704183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:16.704287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:16.708075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId: src_id|930dca08-af94d3c8-1f12a583-6d063a91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:16.710317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.772905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180327989:8404]
2025-10-02T09:31:16.773099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1058, pipe: [1:7556554621180327989:8404]
2025-10-02T09:31:16.821209Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.821403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.821412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.821437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327989:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.821572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.821617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.821659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180327989:8404]
2025-10-02T09:31:16.821661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:16.821774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1059 reason: status is not ok: tablet will be restarted right now sessionId: src_id|930dca08-af94d3c8-1f12a583-6d063a91_0
2025-10-02T09:31:16.821906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1059 sessionId: src_id|930dca08-af94d3c8-1f12a583-6d063a91_0 is DEAD
2025-10-02T09:31:16.822051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:16.822057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Write session will restart in 0.007246s
2025-10-02T09:31:16.822071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Write session: Do CDS request
2025-10-02T09:31:16.822076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.830244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.830336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.830349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1060
2025-10-02T09:31:16.830439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.830460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.830468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.830474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.830758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1060 sessionId:  describe result for acl check
2025-10-02T09:31:16.830784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.830788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.830789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.830793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180328096:8724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.830798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.831161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180328096:8724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.832707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180328096:8724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.833930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.834032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.834038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.834044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.834071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.834093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104792361:7324]
2025-10-02T09:31:16.834430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.834608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.834630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.834739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180328096:8724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.834748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180328096:8724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.834750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180328096:8724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.834753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.834804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.834833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.834837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.834837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.834838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.834838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.834839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.834840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.834840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.834841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.834841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.834842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.834842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.834845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.834850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.834852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.834854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.834857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.834859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.834861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.834863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.834865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.834867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.834869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.834871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.834874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.834878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.834881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.834884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.834886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.834889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.834891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.834894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.834896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.834910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.834912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.834915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.834917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.834920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.834922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.834925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.834927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.834930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.834933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.834937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.834939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.834944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.834949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.834952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.834969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.842964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.844327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.844339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.844340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.844343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.844346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1059 [2:7556554621104792361:7324]
2025-10-02T09:31:16.844354Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.844364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.844366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.844368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.844369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.844379Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.844382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.844386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.844419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.844425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.844426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.844428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.844430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.844468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.844473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.844480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.844486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.844495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.844507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180328134:8724], now have 1 active actors on pipe
2025-10-02T09:31:16.844511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.844513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.844514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.844520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.844525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180327996:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.844530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.844533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.844535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.844537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.844538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.844539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.844555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.844560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.844562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.844603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1059
2025-10-02T09:31:16.844609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1059
2025-10-02T09:31:16.844920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1060 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0
2025-10-02T09:31:16.844652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.844657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.844674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.844677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.844680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.844681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.844686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.844692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.844701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.844839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.844840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.844847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.845149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930dca08-af94d3c8-1f12a583-6d063a91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.847341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Write session: try to update token
2025-10-02T09:31:16.847351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:16.854534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:16.854548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:16.854549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:16.854551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:16.854556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.854559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.854561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104792355:7324]
2025-10-02T09:31:16.854586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:16.854589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.854589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:16.854590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:16.854592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:16.854597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:16.854717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:16.857948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId: src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:16.860044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:16.921885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554621180328167:8404]
2025-10-02T09:31:16.922128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1059, pipe: [1:7556554621180328167:8404]
2025-10-02T09:31:16.972528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:16.973115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.973125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.973151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180328167:8404], now have 1 active actors on pipe
2025-10-02T09:31:16.973287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:16.973367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554621180328167:8404]
2025-10-02T09:31:16.973378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:16.973392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:16.973433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1060 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0
2025-10-02T09:31:16.973585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1060 sessionId: src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0 is DEAD
2025-10-02T09:31:16.973723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:16.973729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Write session will restart in 0.009004s
2025-10-02T09:31:16.973745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Write session: Do CDS request
2025-10-02T09:31:16.973749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:16.982543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:16.984165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.984255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:16.984266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1061
2025-10-02T09:31:16.984368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:16.984392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:16.984399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:16.984402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:16.984696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1061 sessionId:  describe result for acl check
2025-10-02T09:31:16.984717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:16.984721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:16.984723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:16.984726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554621180328272:8735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:16.985117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554621180328272:8735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:16.985389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:16.985495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:16.985503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:16.985509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:16.985536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:16.985558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554621104792539:7339]
2025-10-02T09:31:16.985921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:16.986175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:16.986201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:16.986383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:16.986416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.986421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.986422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.986423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.986423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.986424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.986424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.986425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.986426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.986426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.986427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.986427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.986430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.986436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.986438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.986441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.986443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.986445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.986447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.986449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.986452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.986454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.986456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.986458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.986462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.986466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:16.986469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.986473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:16.986475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.986478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:16.986480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.986483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:16.986486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.986488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:16.986491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.986493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:16.986496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.986499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:16.986501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.986503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:16.986506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.986509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:16.986511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.986514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.986516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.986519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.986522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.986524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.986543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:16.987050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554621180328272:8735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:16.991714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554621180328272:8735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:16.991725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554621180328272:8735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:16.991727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554621180328272:8735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:16.991731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:16.994220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:16.995580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:16.995592Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:16.995593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:16.995595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:16.995598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1060 [2:7556554621104792539:7339]
2025-10-02T09:31:16.995605Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:16.995615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:16.995620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.995621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.995622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.995632Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:16.995638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:16.995644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:16.995682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.995689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.995690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.995692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:16.995694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:16.995741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:16.995748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:16.995754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:16.995759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:16.995770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:16.995785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180328170:2446], now have 1 active actors on pipe
2025-10-02T09:31:16.995793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:16.995794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:16.995795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:16.995801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:16.995805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554621180328311:8735], now have 1 active actors on pipe
2025-10-02T09:31:16.995813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:16.995814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:16.995817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:16.995818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:16.995820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:16.995822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:16.995836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:16.995840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:16.995843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:16.995856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1060
2025-10-02T09:31:16.995862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1060
2025-10-02T09:31:16.995915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.995921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.995935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:16.995942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:16.995944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:16.995945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:16.995950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:16.995959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:16.995969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.996100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:16.996105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:16.996113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:16.996187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1061 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0
2025-10-02T09:31:16.996390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3c7ad6-455fe9d1-8dab5b4c-455a067b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:16.998561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Write session: try to update token
2025-10-02T09:31:16.998572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.005246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.005260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.005261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.005262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.005267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:17.005269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:17.005272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554621104792533:7339]
2025-10-02T09:31:17.005293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.005297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.005298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.005307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.005310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.005313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.005412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:17.009531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId: src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.011526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.073458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554625475295614:8404]
2025-10-02T09:31:17.073726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1060, pipe: [1:7556554625475295614:8404]
2025-10-02T09:31:17.122605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:17.123172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.123182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.123209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295614:8404], now have 1 active actors on pipe
2025-10-02T09:31:17.123344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:17.123401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554625475295614:8404]
2025-10-02T09:31:17.123427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:17.123454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:17.123519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1061 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0
2025-10-02T09:31:17.123685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1061 sessionId: src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0 is DEAD
2025-10-02T09:31:17.123830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:17.123839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Write session will restart in 0.008532s
2025-10-02T09:31:17.123855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Write session: Do CDS request
2025-10-02T09:31:17.123859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:17.131911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:17.133126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.133242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:17.133253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1062
2025-10-02T09:31:17.133331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.133350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:17.133357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:17.133359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:17.133666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1062 sessionId:  describe result for acl check
2025-10-02T09:31:17.133692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:17.133694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:17.133695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:17.133698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554625475295718:8739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:17.134064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:17.134130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554625475295718:8739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:17.134166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:17.134173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:17.134179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:17.134208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:17.134230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554625399759974:7341]
2025-10-02T09:31:17.134566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:17.134768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:17.134789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:17.134973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:17.135004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.135007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.135008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.135009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.135009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.135010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.135010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.135011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.135011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.135012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.135012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.135013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.135016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.135021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.135024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.135026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.135028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.135030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.135032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.135034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.135036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.135038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.135040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.135042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.135046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.135050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.135054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.135057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.135059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.135061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.135064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.135067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.135069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.135072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.135074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.135077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.135079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.135081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.135083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.135086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.135088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.135091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.135094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.135096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.135098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.135101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.135103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.135106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.135124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:17.135781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554625475295718:8739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:17.141396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554625475295718:8739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:17.141414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554625475295718:8739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:17.141417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554625475295718:8739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:17.141424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:17.143190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:17.144605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:17.144619Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:17.144621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:17.144623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:17.144628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1061 [2:7556554625399759974:7341]
2025-10-02T09:31:17.144638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:17.144651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:17.144657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.144659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.144660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.144671Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:17.144675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:17.144679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:17.144717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.144723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.144724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.144726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:17.144728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:17.144889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:17.144896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.144904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.144909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.144918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:17.144932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295758:8739], now have 1 active actors on pipe
2025-10-02T09:31:17.144935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295616:2446], now have 1 active actors on pipe
2025-10-02T09:31:17.144940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.144913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1061
2025-10-02T09:31:17.144945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.144947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.144955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:17.144914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1061
2025-10-02T09:31:17.144964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:17.144966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:17.144972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:17.144974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:17.144980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:17.144982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:17.144996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.145003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.145034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.145047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:17.145061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:17.145065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:17.145070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.145073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.145074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:17.145078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.145085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:17.145114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.145270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.145277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.145286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.145351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1062 partition: 0 MaxSeqNo: 36 sessionId: src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0
2025-10-02T09:31:17.145663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca3c139-23492b68-8ac3641b-b48fd85f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:17.148115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Write session: try to update token
2025-10-02T09:31:17.148127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.155620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.155642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.155645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.155646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.155654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.155657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.155660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554625399759969:7341]
2025-10-02T09:31:17.155692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.155693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.155697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.155697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.155699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.155699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.155816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:17.159349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId: src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.161393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.223492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554625475295767:8404]
2025-10-02T09:31:17.223766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1061, pipe: [1:7556554625475295767:8404]
2025-10-02T09:31:17.277736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:17.278217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.278237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.278277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295767:8404], now have 1 active actors on pipe
2025-10-02T09:31:17.278499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:17.278501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554625475295767:8404]
2025-10-02T09:31:17.278504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:17.278510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:17.278534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:17.278599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1062 reason: error at write: Disconnected sessionId: src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0
2025-10-02T09:31:17.278806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1062 sessionId: src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0 is DEAD
2025-10-02T09:31:17.278973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:17.278984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Write session will restart in 0.008384s
2025-10-02T09:31:17.279007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Write session: Do CDS request
2025-10-02T09:31:17.279012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:17.287681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:17.288215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.288351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:17.288370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1063
2025-10-02T09:31:17.288504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.288532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:17.288547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:17.288551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:17.288967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1063 sessionId:  describe result for acl check
2025-10-02T09:31:17.289008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:17.289015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:17.289017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:17.289022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554625475295873:8744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:17.289498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554625475295873:8744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:17.291107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:17.291248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:17.291259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:17.291268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:17.291310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:17.291341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554625399760119:7344]
2025-10-02T09:31:17.291431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554625475295873:8744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:17.291775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:17.292082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:17.292120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:17.292392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:17.292434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.292439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.292440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.292441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.292442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.292443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.292444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.292445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.292446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.292447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.292448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.292449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.292454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.292464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.292467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.292471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.292474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.292478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.292485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.292488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.292492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.292497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.292501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.292508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.292512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.292517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.292523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.292528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.292535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.292539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.292547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.292556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.292564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.292573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.292580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.292584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.292592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.292600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.292607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.292613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.292620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.292625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.292634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.292642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.292650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.292655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.292659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.292663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.292695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:17.296988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554625475295873:8744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:17.297005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554625475295873:8744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:17.297008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554625475295873:8744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:17.297015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:17.300531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:17.302358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:17.302371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:17.302374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:17.302377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:17.302382Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1062 [2:7556554625399760119:7344]
2025-10-02T09:31:17.302394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:17.302407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:17.302409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.302412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.302414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.302426Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:17.302430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:17.302436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:17.302479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.302486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.302488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.302490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:17.302493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:17.302548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:17.302554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.302566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.302580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.302600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:17.302618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.302623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.302624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.302631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:17.302640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:17.302644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:17.302651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:17.302652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:17.302657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:17.302659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:17.302668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295912:8744], now have 1 active actors on pipe
2025-10-02T09:31:17.302676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295769:2446], now have 1 active actors on pipe
2025-10-02T09:31:17.302694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.302703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:17.302727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:17.302721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1062
2025-10-02T09:31:17.302735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1062
2025-10-02T09:31:17.302782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.302789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.302809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:17.302818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.302825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.302827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:17.302836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.302844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:17.302858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.303038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.303046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.303059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.303151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1063 partition: 0 MaxSeqNo: 36 sessionId: src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0
2025-10-02T09:31:17.303512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0b9ae54-40cec63b-1941c7aa-33a26d04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:17.305814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Write session: try to update token
2025-10-02T09:31:17.305826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.313271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.313289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.313291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.313292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.313302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.313305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.313307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554625399760113:7344]
2025-10-02T09:31:17.313336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.313340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.313342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.313356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.313361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.313363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.313480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:17.317768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId: src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.319953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.378602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554625475295919:8404]
2025-10-02T09:31:17.378931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1062, pipe: [1:7556554625475295919:8404]
2025-10-02T09:31:17.438043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:17.438268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.438277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.438305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295919:8404], now have 1 active actors on pipe
2025-10-02T09:31:17.438462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:17.438574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554625475295919:8404]
2025-10-02T09:31:17.438573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:17.438579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:17.438607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:17.438663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1063 reason: error at write: Disconnected sessionId: src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0
2025-10-02T09:31:17.438830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1063 sessionId: src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0 is DEAD
2025-10-02T09:31:17.438987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:17.438998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Write session will restart in 0.006890s
2025-10-02T09:31:17.439029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Write session: Do CDS request
2025-10-02T09:31:17.439035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:17.447307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.447348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:17.447366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1064
2025-10-02T09:31:17.447578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.447619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:17.447629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:17.447634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:17.447620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:17.448061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1064 sessionId:  describe result for acl check
2025-10-02T09:31:17.448105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:17.448113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:17.448115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:17.448122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554625475296026:8748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:17.448644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554625475296026:8748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:17.450346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554625475296026:8748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:17.450373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:17.450505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:17.450513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:17.450520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:17.450551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:17.450572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554625399760262:7346]
2025-10-02T09:31:17.450963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:17.451173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:17.451199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:17.451387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:17.451419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.451423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.451424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.451424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.451425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.451426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.451426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.451427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.451428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.451428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.451429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.451429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.451432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.451439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.451441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.451444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.451446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.451448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.451450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.451452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.451454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.451457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.451459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.451461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.451465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.451469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.451473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.451476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.451478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.451482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.451484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.451487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.451490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.451492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.451495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.451497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.451500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.451503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.451507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.451510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.451512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.451516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.451518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.451522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.451524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.451529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.451531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.451534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.451554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:17.455763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554625475296026:8748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:17.455775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554625475296026:8748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:17.455777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554625475296026:8748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:17.455781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:17.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:17.460944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:17.460957Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:17.460958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:17.460960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:17.460965Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1063 [2:7556554625399760262:7346]
2025-10-02T09:31:17.460973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:17.460984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:17.460985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.460988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.460989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.460998Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:17.461005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:17.461009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:17.461043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.461047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.461048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.461050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:17.461052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:17.461093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:17.461098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.461105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.461110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.461119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:17.461133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.461138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.461139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.461145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:17.461152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:17.461155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296065:8748], now have 1 active actors on pipe
2025-10-02T09:31:17.461159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:17.461160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:17.461162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:17.461166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:17.461167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:17.461170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475295920:2446], now have 1 active actors on pipe
2025-10-02T09:31:17.461184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.461190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:17.461198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:17.461203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1063
2025-10-02T09:31:17.461209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1063
2025-10-02T09:31:17.461239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.461245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.461262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42616a30-520918b4-cd644ba9-e4df85ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:17.461269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.461271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.461272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:17.461277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.461283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:17.461294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.461400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.461407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.461415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.461475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1064 partition: 0 MaxSeqNo: 36 sessionId: src_id|42616a30-520918b4-cd644ba9-e4df85ea_0
2025-10-02T09:31:17.461770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98df371c-f33176e2-4314cdb4-4fd0251d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42616a30-520918b4-cd644ba9-e4df85ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:17.464130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Write session: try to update token
2025-10-02T09:31:17.464144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.470947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.470960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.470961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.470963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.470967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.470970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.470973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554625399760256:7346]
2025-10-02T09:31:17.470998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.471002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.471004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.471010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.471014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.471019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.471114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:17.476176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId: src_id|42616a30-520918b4-cd644ba9-e4df85ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.478259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.538879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554625475296072:8404]
2025-10-02T09:31:17.539110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1063, pipe: [1:7556554625475296072:8404]
2025-10-02T09:31:17.593383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:17.593978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.593990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.594022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296072:8404], now have 1 active actors on pipe
2025-10-02T09:31:17.594203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:17.594225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:17.594239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:17.594247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:17.594286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554625475296072:8404]
2025-10-02T09:31:17.594294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1064 reason: error at write: Disconnected sessionId: src_id|42616a30-520918b4-cd644ba9-e4df85ea_0
2025-10-02T09:31:17.594409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1064 sessionId: src_id|42616a30-520918b4-cd644ba9-e4df85ea_0 is DEAD
2025-10-02T09:31:17.594548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:17.594558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Write session will restart in 0.006648s
2025-10-02T09:31:17.594580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Write session: Do CDS request
2025-10-02T09:31:17.594586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:17.602236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.602269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:17.602292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1065
2025-10-02T09:31:17.602410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.602430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:17.602436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:17.602439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:17.602730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1065 sessionId:  describe result for acl check
2025-10-02T09:31:17.602762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:17.602769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:17.602770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:17.602775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554625475296177:8752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:17.603306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554625475296177:8752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:17.603510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:17.605277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554625475296177:8752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:17.606230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:17.606358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:17.606366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:17.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:17.606404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:17.606429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554625399760406:7348]
2025-10-02T09:31:17.606808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:17.607023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:17.607050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:17.607248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:17.607286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.607291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.607291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.607292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.607293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.607294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.607294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.607295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.607295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.607296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.607296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.607297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.607300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.607306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.607308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.607310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.607312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.607314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.607316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.607318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.607320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.607323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.607325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.607327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.607331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.607335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.607340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.607345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.607350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.607355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.607359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.607364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.607367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.607369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.607371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.607374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.607364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554625475296177:8752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:17.607378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.607373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554625475296177:8752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:17.607386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.607388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.607376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554625475296177:8752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:17.607391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.607380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:17.607393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.607396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.607398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.607403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.607406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.607410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.607414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.607424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.607446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:17.615444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:17.616872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:17.616884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:17.616886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:17.616888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:17.616893Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1064 [2:7556554625399760406:7348]
2025-10-02T09:31:17.616915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:17.616930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:17.616935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.616938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.616940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.616952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:17.616961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:17.616968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:17.617012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.617018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.617019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.617021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:17.617022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:17.617065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:17.617070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.617077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.617083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.617094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:17.617110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.617117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.617118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.617125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:17.617134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296073:2446], now have 1 active actors on pipe
2025-10-02T09:31:17.617134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:17.617137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296216:8752], now have 1 active actors on pipe
2025-10-02T09:31:17.617137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:17.617139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:17.617142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:17.617150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:17.617151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:17.617170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.617172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:17.617175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:17.617166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1064
2025-10-02T09:31:17.617180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1064
2025-10-02T09:31:17.617204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.617209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.617224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:17.617230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.617233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.617234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:17.617241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.617249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:17.617260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.617391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.617396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.617405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.617468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1065 partition: 0 MaxSeqNo: 36 sessionId: src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0
2025-10-02T09:31:17.617747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42616a30-520918b4-cd644ba9-e4df85ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:17.620271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Write session: try to update token
2025-10-02T09:31:17.620287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.627415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.627431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.627433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.627434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.627439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.627442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.627444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554625399760400:7348]
2025-10-02T09:31:17.627475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.627481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.627482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.627483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.627488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.627494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.627596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:17.632728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId: src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.634917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.694520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554625475296226:8404]
2025-10-02T09:31:17.694736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1064, pipe: [1:7556554625475296226:8404]
2025-10-02T09:31:17.749759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:17.749970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.749979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.750005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296226:8404], now have 1 active actors on pipe
2025-10-02T09:31:17.750178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:17.750297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554625475296226:8404]
2025-10-02T09:31:17.750315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:17.750325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:17.750379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1065 reason: status is not ok: tablet will be restarted right now sessionId: src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0
2025-10-02T09:31:17.750523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1065 sessionId: src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0 is DEAD
2025-10-02T09:31:17.750657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:17.750669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Write session will restart in 0.009436s
2025-10-02T09:31:17.750691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Write session: Do CDS request
2025-10-02T09:31:17.750696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:17.760591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:17.760938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:17.761043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:17.761049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:17.761054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:17.761079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:17.761102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554625399760562:7351]
2025-10-02T09:31:17.761228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.761344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:17.761363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1066
2025-10-02T09:31:17.761452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:17.761486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.761513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:17.761523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:17.761527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:17.761618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:17.761640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:17.761818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:17.761847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.761851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.761852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.761852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.761853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.761853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.761854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.761855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.761855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.761855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.761856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.761857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.761859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.761866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.761868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.761870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.761872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.761874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.761876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1066 sessionId:  describe result for acl check
2025-10-02T09:31:17.761876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.761878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.761880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.761882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.761884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.761886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.761890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.761894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.761897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.761899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.761901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.761904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.761904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:17.761906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.761910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:17.761909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.761912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:17.761911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.761925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554625475296348:8757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:17.761914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.761916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.761918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.761920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.761923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.761925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.761928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.761930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.761933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.761935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.761938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.761940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.761942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.761945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.761949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.761979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:17.762384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554625475296348:8757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:17.764213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554625475296348:8757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:17.768278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554625475296348:8757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:17.768290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554625475296348:8757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:17.768294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554625475296348:8757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:17.768299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:17.769550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:17.771067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:17.771080Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:17.771082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:17.771085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:17.771088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1065 [2:7556554625399760562:7351]
2025-10-02T09:31:17.771098Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:17.771109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:17.771114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.771116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.771117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.771127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:17.771133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:17.771138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:17.771178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.771183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.771184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.771186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:17.771188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:17.771322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1065
2025-10-02T09:31:17.771332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1065
2025-10-02T09:31:17.771513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:17.771528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.771541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.771557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.771575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:17.771596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296239:2446], now have 1 active actors on pipe
2025-10-02T09:31:17.771604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296384:8757], now have 1 active actors on pipe
2025-10-02T09:31:17.771620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.771628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.771641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.771646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.771648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.771660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:17.771669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:17.771671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:17.771673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:17.771676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:17.771688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:17.771695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:17.771709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:17.771719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.771727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.771734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:17.771742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.771754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:17.771784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.771797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:17.771811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:17.771812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.771952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.771961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.771976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.772046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1066 partition: 0 MaxSeqNo: 36 sessionId: src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0
2025-10-02T09:31:17.772397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756fb617-6e8524dd-6dd6bfde-27f7c371_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:17.774863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Write session: try to update token
2025-10-02T09:31:17.774877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.780998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:17.781016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.781022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.781050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:17.781051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:17.781194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:17.781312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:17.781424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:17.781537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:17.781703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:17.781731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:17.786299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId: src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.788678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.789625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.789642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.789654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.789656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.789657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.789658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.789663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.789667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.789670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554625399760557:7351]
2025-10-02T09:31:17.789695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.789700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.789703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.789703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.789705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.789705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.789817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:17.850681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554625475296398:8404]
2025-10-02T09:31:17.850910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1065, pipe: [1:7556554625475296398:8404]
2025-10-02T09:31:17.903977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:17.904190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:17.904222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296398:8404], now have 1 active actors on pipe
2025-10-02T09:31:17.904309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:17.904393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:17.904434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554625475296398:8404]
2025-10-02T09:31:17.912046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:17.914183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:17.914203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:17.914223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1066 reason: error at write: Disconnected sessionId: src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0
2025-10-02T09:31:17.914339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1066 sessionId: src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0 is DEAD
2025-10-02T09:31:17.914500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:17.914507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Write session will restart in 0.007749s
2025-10-02T09:31:17.914521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Write session: Do CDS request
2025-10-02T09:31:17.914526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:17.918484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:17.918600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:17.918607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:17.918613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:17.918643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:17.918667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554625399760709:7353]
2025-10-02T09:31:17.919063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:17.919274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:17.919299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:17.919477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:17.919509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.919513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.919513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.919514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.919514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.919515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.919515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.919516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.919516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.919517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.919517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.919518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.919521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.919528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.919530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.919532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.919534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.919536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.919538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.919540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.919542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.919544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.919546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.919548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.919552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.919556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:17.919559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.919562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:17.919564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.919567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:17.919569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.919573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:17.919575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.919577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:17.919580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.919582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:17.919584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.919586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:17.919590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.919592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:17.919597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.919599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:17.919601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.919604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.919609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.919612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.919614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.919620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.919637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:17.923162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.923248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:17.923267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1067
2025-10-02T09:31:17.923405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:17.923431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:17.923441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:17.923444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:17.923815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1067 sessionId:  describe result for acl check
2025-10-02T09:31:17.923844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:17.923851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:17.923853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:17.923858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554625475296515:8762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:17.924295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554625475296515:8762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:17.926686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554625475296515:8762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:17.927272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:17.928889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:17.928900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:17.928902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:17.928904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:17.928908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1066 [2:7556554625399760709:7353]
2025-10-02T09:31:17.928914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:17.928925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:17.928927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.928929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.928930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.928939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:17.928941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:17.928945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:17.928977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.928979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.928980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.928981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:17.928983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:17.929023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:17.929028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.929034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:17.929039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:17.929047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:17.929060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.929062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.929063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.929068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:17.929076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:17.929077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296402:2446], now have 1 active actors on pipe
2025-10-02T09:31:17.929079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:17.929081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:17.929081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:17.929088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:17.929090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:17.929104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.929112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:17.929121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:17.929168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554625475296515:8762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:17.929184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554625475296515:8762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:17.929187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554625475296515:8762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:17.929193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:17.929292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1066
2025-10-02T09:31:17.929387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554625475296554:8762], now have 1 active actors on pipe
2025-10-02T09:31:17.929528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1066
2025-10-02T09:31:17.929573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.929578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.929592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f3006b4-b99469f1-4078f520-583bc569_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:17.929599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:17.929602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:17.929603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:17.929608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:17.929617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:17.929626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.929738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.929743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.929750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:17.929806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1067 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f3006b4-b99469f1-4078f520-583bc569_0
2025-10-02T09:31:17.930061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|863ded4b-136bbbcc-bad46f25-1ba28cca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f3006b4-b99469f1-4078f520-583bc569_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:17.932391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Write session: try to update token
2025-10-02T09:31:17.932401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:17.938204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:17.938221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.938227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.938251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:17.938257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:17.938384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:17.938506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:17.938615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:17.938749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:17.938983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:17.939009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:17.943425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId: src_id|8f3006b4-b99469f1-4078f520-583bc569_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:17.945875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:17.946019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:17.946041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:17.946905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:17.946928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:17.946933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:17.946934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:17.946935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:17.946940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.946942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.946944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554625399760703:7353]
2025-10-02T09:31:17.946965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:17.946967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:17.946971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:17.946972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:17.946983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:17.946986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:17.946979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:17.947081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.004829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770263875:8404]
2025-10-02T09:31:18.005099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1066, pipe: [1:7556554629770263875:8404]
2025-10-02T09:31:18.074103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:18.080597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.080620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.080755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.080822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.080876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.080927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.081102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.081109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.081163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.081212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.081267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.081509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.081547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.081553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.081617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.081665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.081717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.081769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.081805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.081809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.081861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.081913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.081963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.082018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.082055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.082060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.082112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.082159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.082212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.082266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.082302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.082307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.082359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.082407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.082459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.082548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.082585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.082590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.082641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.082691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.082744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.082795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.082832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.082837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.082890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.082946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.082996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.083051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.083087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.083092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.083139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.083187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.083239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.083291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.083328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.083334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.083384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:18.083447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:18.083502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:18.083554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:18.083590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:18.083594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:18.083628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770263875:8404], now have 1 active actors on pipe
2025-10-02T09:31:18.083907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:18.083907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:18.083912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:18.083945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1067 reason: error at write: Disconnected sessionId: src_id|8f3006b4-b99469f1-4078f520-583bc569_0
2025-10-02T09:31:18.083961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770263875:8404]
2025-10-02T09:31:18.084023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:18.084114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1067 sessionId: src_id|8f3006b4-b99469f1-4078f520-583bc569_0 is DEAD
2025-10-02T09:31:18.084290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:18.084301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Write session will restart in 0.007885s
2025-10-02T09:31:18.084322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Write session: Do CDS request
2025-10-02T09:31:18.084328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:18.093174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.093289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:18.093303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1068
2025-10-02T09:31:18.093452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.093476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:18.093484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:18.093488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:18.093833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1068 sessionId:  describe result for acl check
2025-10-02T09:31:18.093859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:18.093864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:18.093866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:18.093871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554629770263984:8773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:18.094261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:18.094309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554629770263984:8773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:18.094765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:18.094910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:18.094919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:18.094927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:18.094964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:18.095005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554629694728189:7368]
2025-10-02T09:31:18.095591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:18.096418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554629770263984:8773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:18.097460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:18.097501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:18.097796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:18.097842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.097848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.097849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.097850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.097851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.097852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.097853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.097854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.097855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.097856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.097857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.097858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.097863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.097873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.097877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.097881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.097885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.097889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.097893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.097897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.097905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.097911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.097919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.097923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.097935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.097943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.097948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.097954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.097958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.097964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.097968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.097978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.097986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.097995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.098003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.098012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.098021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.098029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.098037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.098046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.098053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.098063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.098070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.098080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.098087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.098093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.098097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.098102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.098139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:18.098421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554629770263984:8773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:18.098434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554629770263984:8773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:18.098439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554629770263984:8773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:18.098444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:18.106018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:18.107779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:18.107792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:18.107794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:18.107797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:18.107802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1067 [2:7556554629694728189:7368]
2025-10-02T09:31:18.107814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:18.107831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:18.107838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.107841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.107843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.107854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:18.107863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:18.107870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:18.107920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.107926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.107928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.107932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:18.107934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:18.107987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:18.107994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.108005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.108021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.108043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:18.108064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264025:8773], now have 1 active actors on pipe
2025-10-02T09:31:18.108072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770263876:2446], now have 1 active actors on pipe
2025-10-02T09:31:18.108078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.108084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.108086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.108097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:18.108109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:18.108111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:18.108117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:18.108119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:18.108125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:18.108128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:18.108147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.108153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:18.108158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:18.108129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1067
2025-10-02T09:31:18.108129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1067
2025-10-02T09:31:18.108176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.108184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.108213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:18.108225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.108228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.108230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:18.108237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.108244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:18.108262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.108408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.108415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.108426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.108507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1068 partition: 0 MaxSeqNo: 36 sessionId: src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0
2025-10-02T09:31:18.108876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f3006b4-b99469f1-4078f520-583bc569_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:18.111140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Write session: try to update token
2025-10-02T09:31:18.111152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:18.118312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:18.118331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:18.118333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:18.118335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:18.118343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.118348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.118351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554629694728184:7368]
2025-10-02T09:31:18.118384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:18.118384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:18.118390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:18.118392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:18.118394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.118396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:18.118526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.121880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId: src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:18.124265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:18.183963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770264035:8404]
2025-10-02T09:31:18.184237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1067, pipe: [1:7556554629770264035:8404]
2025-10-02T09:31:18.253046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:18.253515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.253528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.253558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264035:8404], now have 1 active actors on pipe
2025-10-02T09:31:18.253774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:18.253819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:18.253838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:18.253849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770264035:8404]
2025-10-02T09:31:18.253883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:18.253910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1068 reason: error at write: Disconnected sessionId: src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0
2025-10-02T09:31:18.254076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1068 sessionId: src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0 is DEAD
2025-10-02T09:31:18.254282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:18.254291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Write session will restart in 0.009645s
2025-10-02T09:31:18.254315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Write session: Do CDS request
2025-10-02T09:31:18.254320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:18.263833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:18.265199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.265317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:18.265334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1069
2025-10-02T09:31:18.265468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.265518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:18.265523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:18.265528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:18.265918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1069 sessionId:  describe result for acl check
2025-10-02T09:31:18.265955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:18.265962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:18.265964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:18.265969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554629770264148:8778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:18.266423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554629770264148:8778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:18.266796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:18.266950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:18.266960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:18.266968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:18.267016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:18.267051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554629694728340:7371]
2025-10-02T09:31:18.267514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:18.267735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:18.267766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:18.268007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:18.268049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.268056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.268057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.268058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.268058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.268059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.268059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.268060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.268061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.268061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.268062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.268063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.268066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.268073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.268076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.268078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.268081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.268083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.268085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.268088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.268090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.268092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.268095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.268097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.268102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.268107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.268112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.268116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.268119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.268122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.268124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.268127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.268130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.268133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.268136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.268139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.268142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.268145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.268147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.268150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.268153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.268156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.268158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.268162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.268165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.268168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.268171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.268175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.268195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:18.268540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554629770264148:8778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:18.273743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554629770264148:8778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:18.273756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554629770264148:8778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:18.273758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554629770264148:8778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:18.273764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:18.276597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:18.278348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:18.278363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:18.278365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:18.278368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:18.278373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1068 [2:7556554629694728340:7371]
2025-10-02T09:31:18.278384Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:18.278399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:18.278406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.278408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.278410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.278423Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:18.278427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:18.278432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:18.278474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.278481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.278483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.278486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:18.278489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:18.278546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:18.278554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.278561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.278567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.278577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:18.278599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264036:2446], now have 1 active actors on pipe
2025-10-02T09:31:18.278606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264186:8778], now have 1 active actors on pipe
2025-10-02T09:31:18.278611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.278613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.278614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.278625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:18.278637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1068
2025-10-02T09:31:18.278643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1068
2025-10-02T09:31:18.278639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:18.278642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:18.278644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:18.278646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:18.278656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:18.278658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:18.278680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.278683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:18.278685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:18.278700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.278703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.278738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:18.278749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.278752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.278753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:18.278762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.278770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:18.278782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.278909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.278917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.278928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.278992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1069 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0
2025-10-02T09:31:18.279327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbc3ec-582979fa-7a56ea8c-a6dd4e99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:18.281766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Write session: try to update token
2025-10-02T09:31:18.281781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:18.288870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:18.288886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:18.288888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:18.288890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:18.288897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.288901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.288904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554629694728334:7371]
2025-10-02T09:31:18.288933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:18.288938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.288940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:18.288941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:18.288945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:18.288948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:18.289172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.293727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId: src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:18.296168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:18.353980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770264194:8404]
2025-10-02T09:31:18.354292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1068, pipe: [1:7556554629770264194:8404]
2025-10-02T09:31:18.405325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:18.405539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.405548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.405576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264194:8404], now have 1 active actors on pipe
2025-10-02T09:31:18.405721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:18.405829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770264194:8404]
2025-10-02T09:31:18.405843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:18.405911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0
2025-10-02T09:31:18.405952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:18.406080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1069 sessionId: src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0 is DEAD
2025-10-02T09:31:18.406223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:18.406234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Write session will restart in 0.007022s
2025-10-02T09:31:18.406254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Write session: Do CDS request
2025-10-02T09:31:18.406259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:18.414244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.414369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:18.414388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1070
2025-10-02T09:31:18.414530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.414557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:18.414567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:18.414571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:18.414969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1070 sessionId:  describe result for acl check
2025-10-02T09:31:18.415004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:18.415010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:18.415012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:18.415016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554629770264305:8782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:18.415056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:18.415479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554629770264305:8782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:18.416917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554629770264305:8782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:18.417927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:18.418053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:18.418060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:18.418066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:18.418099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:18.418127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554629694728489:7373]
2025-10-02T09:31:18.418478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:18.418708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:18.418731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:18.418935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:18.418979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.418983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.418984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.418984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.418985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.418985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.418986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.418987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.418987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.418987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.418988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.418989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.418991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554629770264305:8782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:18.418992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.418998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.419001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554629770264305:8782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:18.419003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554629770264305:8782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:18.419007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:18.419000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.419002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.419004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.419006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.419008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.419010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.419012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.419014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.419016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.419018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.419022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.419026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.419029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.419032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.419034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.419038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.419040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.419042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.419045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.419047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.419049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.419051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.419053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.419056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.419058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.419061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.419063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.419066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.419068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.419070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.419072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.419075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.419078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.419081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.419099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:18.426661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:18.428077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:18.428089Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:18.428090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:18.428093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:18.428096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1069 [2:7556554629694728489:7373]
2025-10-02T09:31:18.428104Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:18.428115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:18.428117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.428119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.428120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.428129Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:18.428132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:18.428137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:18.428175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.428179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.428181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.428183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:18.428184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:18.428226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:18.428230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.428237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.428245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.428253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:18.428267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.428273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.428274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.428279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:18.428287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264342:8782], now have 1 active actors on pipe
2025-10-02T09:31:18.428288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:18.428291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:18.428293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264195:2446], now have 1 active actors on pipe
2025-10-02T09:31:18.428293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:18.428298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:18.428305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:18.428306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:18.428321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.428333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:18.428357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:18.428346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1069
2025-10-02T09:31:18.428382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1069
2025-10-02T09:31:18.428409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.428415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.428430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:18.428437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.428439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.428441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:18.428446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.428455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:18.428464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.428586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.428591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.428598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.428682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1070 partition: 0 MaxSeqNo: 36 sessionId: src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0
2025-10-02T09:31:18.428997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b6ca59-cc2ae1fa-ac493610-264b754a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:18.431909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Write session: try to update token
2025-10-02T09:31:18.431928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:18.437547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:18.437562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:18.437563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:18.437564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:18.437568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.437571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.437573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554629694728483:7373]
2025-10-02T09:31:18.437595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:18.437598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.437600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:18.437611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:18.437620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:18.437622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:18.437715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.445591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId: src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:18.447790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:18.506029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770264353:8404]
2025-10-02T09:31:18.506238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1069, pipe: [1:7556554629770264353:8404]
2025-10-02T09:31:18.557595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:18.558173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.558186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.558200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264353:8404], now have 1 active actors on pipe
2025-10-02T09:31:18.558363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:18.558365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:18.558368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:18.558405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770264353:8404]
2025-10-02T09:31:18.558410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1070 reason: error at write: Disconnected sessionId: src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0
2025-10-02T09:31:18.558548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1070 sessionId: src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0 is DEAD
2025-10-02T09:31:18.558696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:18.558708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Write session will restart in 0.009176s
2025-10-02T09:31:18.558730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Write session: Do CDS request
2025-10-02T09:31:18.558738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:18.558756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:18.565887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:18.568383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:18.568493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:18.568499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:18.568504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:18.568531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:18.568554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554629694728638:7375]
2025-10-02T09:31:18.568914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:18.569115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.569114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:18.569138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:18.569243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:18.569254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1071
2025-10-02T09:31:18.569314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:18.569344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.569348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.569349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.569349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.569350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.569351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.569351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.569352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.569352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.569353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.569354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.569354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.569357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.569364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.569366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.569368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.569370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.569372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.569374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.569376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.569378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.569376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.569381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.569383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.569385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.569389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.569396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:18.569393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.569396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.569399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.569401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.569404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.569406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.569408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.569402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:18.569405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:18.569411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.569413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.569415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.569418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.569420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.569422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.569424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.569427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.569429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.569431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.569433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.569437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.569439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.569442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.569444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.569446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.569461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:18.569679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1071 sessionId:  describe result for acl check
2025-10-02T09:31:18.569703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:18.569708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:18.569709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:18.569712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554629770264470:8786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:18.570061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554629770264470:8786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:18.571458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554629770264470:8786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:18.575696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554629770264470:8786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:18.575707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554629770264470:8786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:18.575709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554629770264470:8786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:18.575713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:18.576904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:18.578536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:18.578551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:18.578552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:18.578554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:18.578558Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1070 [2:7556554629694728638:7375]
2025-10-02T09:31:18.578564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:18.578574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:18.578577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.578579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.578580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.578588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:18.578595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:18.578599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:18.578630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.578635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.578636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.578638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:18.578639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:18.578675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:18.578678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.578684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.578692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.578703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:18.578718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264354:2446], now have 1 active actors on pipe
2025-10-02T09:31:18.578723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264505:8786], now have 1 active actors on pipe
2025-10-02T09:31:18.578728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.578729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.578730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.578737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:18.578746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:18.578749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:18.578754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:18.578755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:18.578756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:18.578757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:18.578771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.578776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:18.578777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:18.578782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1070
2025-10-02T09:31:18.578787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1070
2025-10-02T09:31:18.578849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.578855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.578872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:18.578879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.578882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.578886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:18.578892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.578907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:18.578919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.579005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.579010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.579017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.579064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1071 partition: 0 MaxSeqNo: 36 sessionId: src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0
2025-10-02T09:31:18.579555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df08ea88-ee4835df-9cacba63-c8fa4f2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:18.581967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Write session: try to update token
2025-10-02T09:31:18.581978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:18.588041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:18.588057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:18.588058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:18.588059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:18.588065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.588067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.588069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554629694728633:7375]
2025-10-02T09:31:18.588092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:18.588096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:18.588098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:18.588101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:18.588105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.588106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:18.588224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.593187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId: src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:18.595586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:18.658608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770264513:8404]
2025-10-02T09:31:18.658867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1070, pipe: [1:7556554629770264513:8404]
2025-10-02T09:31:18.706783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:18.707017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.707026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.707039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264513:8404], now have 1 active actors on pipe
2025-10-02T09:31:18.707182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:18.707258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:18.707295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:18.707310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770264513:8404]
2025-10-02T09:31:18.707366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1071 reason: status is not ok: tablet will be restarted right now sessionId: src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0
2025-10-02T09:31:18.707518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1071 sessionId: src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0 is DEAD
2025-10-02T09:31:18.707639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:18.707650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Write session will restart in 0.007213s
2025-10-02T09:31:18.707669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Write session: Do CDS request
2025-10-02T09:31:18.707674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:18.716130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:18.716205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.716298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:18.716313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1072
2025-10-02T09:31:18.716427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.716456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:18.716466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:18.716469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:18.716848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1072 sessionId:  describe result for acl check
2025-10-02T09:31:18.716879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:18.716885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:18.716887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:18.716891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554629770264627:8790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:18.717362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554629770264627:8790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:18.718732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:18.718879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:18.718887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:18.718904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:18.718946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:18.718972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554629694728801:7378]
2025-10-02T09:31:18.719022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554629770264627:8790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:18.719326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:18.719521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:18.719547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:18.719729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:18.719760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.719764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.719765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.719765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.719766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.719767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.719767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.719768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.719768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.719769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.719770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.719770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.719773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.719779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.719781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.719783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.719785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.719787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.719790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.719792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.719794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.719796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.719798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.719800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.719804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.719808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.719812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.719814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.719817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.719820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.719822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.719825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.719828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.719830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.719833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.719836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.719838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.719841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.719843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.719846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.719848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.719851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.719853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.719855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.719858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.719861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.719863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.719866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.719883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:18.724182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554629770264627:8790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:18.724194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554629770264627:8790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:18.724198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554629770264627:8790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:18.724205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:18.727834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:18.729538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:18.729551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:18.729553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:18.729555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:18.729559Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1071 [2:7556554629694728801:7378]
2025-10-02T09:31:18.729568Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:18.729579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:18.729580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.729582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.729583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.729593Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:18.729600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:18.729604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:18.729637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.729642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.729643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.729645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:18.729647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:18.729686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:18.729691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.729698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.729703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.729711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:18.729728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264514:2446], now have 1 active actors on pipe
2025-10-02T09:31:18.729734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264666:8790], now have 1 active actors on pipe
2025-10-02T09:31:18.729737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.729739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.729740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.729747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:18.729759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:18.729764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:18.729766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:18.729768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:18.729769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:18.729771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:18.729789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.729794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:18.729778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1071
2025-10-02T09:31:18.729785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1071
2025-10-02T09:31:18.729808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:18.729817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.729819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.729836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:18.729844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.729847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.729848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:18.729853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.729860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:18.729870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.729976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.729980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.729988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.730038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1072 partition: 0 MaxSeqNo: 36 sessionId: src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0
2025-10-02T09:31:18.730308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382a4ae8-699a97ef-60415eb7-bec5357e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:18.732465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Write session: try to update token
2025-10-02T09:31:18.732476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:18.739440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:18.739460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:18.739461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:18.739463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:18.739468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.739472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.739474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554629694728795:7378]
2025-10-02T09:31:18.739501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:18.739505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.739505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:18.739506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:18.739508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:18.739511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:18.739619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.742632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId: src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:18.744637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:18.807590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770264691:8404]
2025-10-02T09:31:18.807798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1071, pipe: [1:7556554629770264691:8404]
2025-10-02T09:31:18.857786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:18.857990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.858000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.858026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264691:8404], now have 1 active actors on pipe
2025-10-02T09:31:18.858167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:18.858201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:18.858231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:18.858240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770264691:8404]
2025-10-02T09:31:18.858293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1072 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0
2025-10-02T09:31:18.858431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1072 sessionId: src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0 is DEAD
2025-10-02T09:31:18.858555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:18.858563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Write session will restart in 0.005862s
2025-10-02T09:31:18.858578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Write session: Do CDS request
2025-10-02T09:31:18.858581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:18.865180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.865252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:18.865263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1073
2025-10-02T09:31:18.865362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:18.865382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:18.865385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:18.865387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:18.865756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1073 sessionId:  describe result for acl check
2025-10-02T09:31:18.865788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:18.865791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:18.865793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:18.865797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554629770264768:8796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:18.866250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554629770264768:8796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:18.868037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554629770264768:8796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:18.868165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:18.870223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:18.870326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:18.870333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:18.870339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:18.870368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:18.870390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554629694728953:7380]
2025-10-02T09:31:18.870459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554629770264768:8796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:18.870469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554629770264768:8796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:18.870470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554629770264768:8796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:18.870475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:18.870726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:18.870933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:18.870957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:18.871137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:18.871168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.871172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.871172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.871173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.871173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.871174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.871174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.871175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.871175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.871176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.871176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.871177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.871180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.871186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.871187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.871189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.871191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.871193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.871195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.871197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.871199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.871202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.871204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.871206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.871209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.871213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:18.871217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.871219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:18.871221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.871223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:18.871225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.871228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:18.871230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.871232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:18.871234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.871237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:18.871241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.871245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:18.871248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.871252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:18.871256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.871264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:18.871267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.871276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.871284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.871290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.871292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.871295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.871310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:18.878787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:18.880423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:18.880437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:18.880438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:18.880440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:18.880443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1072 [2:7556554629694728953:7380]
2025-10-02T09:31:18.880451Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:18.880461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:18.880463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.880465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.880466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.880475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:18.880478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:18.880485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:18.880519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.880524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.880525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.880527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:18.880528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:18.880565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:18.880570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.880576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:18.880581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:18.880589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:18.880601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264695:2446], now have 1 active actors on pipe
2025-10-02T09:31:18.880606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264844:8796], now have 1 active actors on pipe
2025-10-02T09:31:18.880609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.880611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.880612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.880619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:18.880627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:18.880629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:18.880631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:18.880632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:18.880639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:18.880643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:18.880659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.880668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:18.880690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:18.880678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1072
2025-10-02T09:31:18.880685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1072
2025-10-02T09:31:18.880746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.880751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.880766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:18.880772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:18.880774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:18.880775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:18.880780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:18.880787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:18.880796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.880934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:18.880940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:18.880947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:18.881000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1073 partition: 0 MaxSeqNo: 36 sessionId: src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0
2025-10-02T09:31:18.881245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3914896b-b90e2a5c-226aa07-5bc8800b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:18.883559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Write session: try to update token
2025-10-02T09:31:18.883571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:18.890027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:18.890044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:18.890046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:18.890047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:18.890053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.890055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.890057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554629694728947:7380]
2025-10-02T09:31:18.890080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:18.890082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:18.890086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:18.890086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:18.890087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:18.890088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:18.890198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:18.894783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId: src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:18.897057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:18.958623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554629770264856:8404]
2025-10-02T09:31:18.958849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1072, pipe: [1:7556554629770264856:8404]
2025-10-02T09:31:19.007700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.007887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.007896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.007921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554629770264856:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.008118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.008130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554629770264856:8404]
2025-10-02T09:31:19.008149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:19.008151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:19.008202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1073 reason: error at write: Disconnected sessionId: src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0
2025-10-02T09:31:19.008347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:19.008356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1073 sessionId: src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0 is DEAD
2025-10-02T09:31:19.008479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:19.008490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Write session will restart in 0.008273s
2025-10-02T09:31:19.008512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Write session: Do CDS request
2025-10-02T09:31:19.008516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:19.018158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.018253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:19.018264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1074
2025-10-02T09:31:19.018372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.018400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:19.018409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:19.018412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:19.018716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1074 sessionId:  describe result for acl check
2025-10-02T09:31:19.018746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:19.018751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:19.018752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:19.018757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554634065232292:8807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:19.019208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554634065232292:8807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:19.020190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:19.020478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:19.020578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:19.020585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:19.020592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:19.020621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:19.020645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554633989696439:7395]
2025-10-02T09:31:19.020779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554634065232292:8807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:19.021008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:19.021208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:19.021232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:19.021410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:19.021441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.021445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.021445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.021446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.021447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.021447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.021447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.021448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.021448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.021449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.021450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.021450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.021453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.021458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.021461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.021463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.021465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.021467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.021469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.021471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.021473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.021475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.021477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.021479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.021483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.021487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.021490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.021493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.021495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.021498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.021500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.021503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.021506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.021508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.021511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.021513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.021515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.021518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.021520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.021522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.021524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.021528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.021530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.021533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.021535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.021538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.021543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.021546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.021571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:19.025580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554634065232292:8807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:19.025594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554634065232292:8807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:19.025597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554634065232292:8807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:19.025606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:19.029313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:19.030729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:19.030742Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:19.030743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:19.030746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:19.030749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1073 [2:7556554633989696439:7395]
2025-10-02T09:31:19.030760Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:19.030770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:19.030771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.030773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.030774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.030783Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:19.030786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:19.030790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:19.030823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.030828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.030830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.030831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:19.030833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:19.030973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1073
2025-10-02T09:31:19.030985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1073
2025-10-02T09:31:19.031116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:19.031123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.031130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.031139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.031147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:19.031162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232178:2446], now have 1 active actors on pipe
2025-10-02T09:31:19.031167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232329:8807], now have 1 active actors on pipe
2025-10-02T09:31:19.031179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.031184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.031197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.031202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.031204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.031214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:19.031226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:19.031231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:19.031234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:19.031235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:19.031237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:19.031239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:19.031249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9143fa72-f4ac50f8-de737395-41990f8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:19.031255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.031257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.031258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:19.031263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.031272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:19.031294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.031301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:19.031307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:19.031307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.031405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.031411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.031419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.031462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1074 partition: 0 MaxSeqNo: 36 sessionId: src_id|9143fa72-f4ac50f8-de737395-41990f8a_0
2025-10-02T09:31:19.031717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53af3196-baa68b2a-bd54ed6-bab8373f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9143fa72-f4ac50f8-de737395-41990f8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:19.034221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Write session: try to update token
2025-10-02T09:31:19.034235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:19.045970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:19.045991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.045999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.046040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:19.046051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:19.046234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:19.046396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.046529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.046698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.046737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId: src_id|9143fa72-f4ac50f8-de737395-41990f8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:19.046920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:19.046960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:19.048870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:19.049037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.049053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.049078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:19.049139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:19.050069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:19.050081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.050083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:19.050084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:19.050088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.050090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.050093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554633989696434:7395]
2025-10-02T09:31:19.050122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:19.050132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.050131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:19.050134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:19.050137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:19.050141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:19.050246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:19.108152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554634065232336:8404]
2025-10-02T09:31:19.108511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1073, pipe: [1:7556554634065232336:8404]
2025-10-02T09:31:19.176324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.183889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.183908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.184030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.184080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.184133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.184183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.184533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.184541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.184592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.184642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.184691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.184744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.184783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.184788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.184858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.184907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.184958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.185006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.185042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.185046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.185103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.185164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.185217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.185266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.185303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.185310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.185362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.185410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.185464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.185513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.185550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.185554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.185607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.185654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.185703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.185751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.185801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.185806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.185856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.185903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.185954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.186003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.186040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.186044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.186098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.186146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.186195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.186256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.186290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.186294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.186342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.186388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.186434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.186483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.186581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.186586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.186632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.186681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.186728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.186773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.186805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.186809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.186852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232336:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.187036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:19.187050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:19.187070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1074 reason: error at write: Disconnected sessionId: src_id|9143fa72-f4ac50f8-de737395-41990f8a_0
2025-10-02T09:31:19.187169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:19.187228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1074 sessionId: src_id|9143fa72-f4ac50f8-de737395-41990f8a_0 is DEAD
2025-10-02T09:31:19.187344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:19.187349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Write session will restart in 0.009069s
2025-10-02T09:31:19.187364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Write session: Do CDS request
2025-10-02T09:31:19.187368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:19.187378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.187379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554634065232336:8404]
2025-10-02T09:31:19.194904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:19.197155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.197381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:19.197491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:19.197499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:19.197509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1075
2025-10-02T09:31:19.197497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:19.197503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:19.197531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:19.197548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554633989696593:7397]
2025-10-02T09:31:19.197586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.197604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:19.197611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:19.197614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:19.197888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:19.197955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1075 sessionId:  describe result for acl check
2025-10-02T09:31:19.197979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:19.197984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:19.197985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:19.197988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554634065232457:8812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:19.198087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:19.198113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:19.198305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:19.198324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554634065232457:8812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:19.198339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.198343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.198344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.198344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.198345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.198345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.198346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.198346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.198347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.198347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.198348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.198348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.198351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.198357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.198359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.198361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.198363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.198365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.198367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.198369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.198371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.198373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.198375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.198377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.198381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.198385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.198388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.198391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.198394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.198396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.198399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.198401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.198404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.198406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.198408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.198411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.198413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.198416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.198418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.198420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.198422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.198425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.198427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.198429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.198433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.198437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.198440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.198445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.198474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:19.199609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554634065232457:8812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:19.204030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554634065232457:8812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:19.204039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554634065232457:8812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:19.204040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554634065232457:8812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:19.204044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:19.206357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:19.207988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:19.208001Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:19.208002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:19.208004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:19.208008Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1074 [2:7556554633989696593:7397]
2025-10-02T09:31:19.208014Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:19.208025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:19.208030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.208032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.208033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.208042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:19.208045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:19.208049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:19.208084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.208088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.208090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.208091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:19.208093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:19.208130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:19.208135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.208142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.208148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.208158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:19.208172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232496:8812], now have 1 active actors on pipe
2025-10-02T09:31:19.208177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232341:2446], now have 1 active actors on pipe
2025-10-02T09:31:19.208181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.208182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.208183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.208191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:19.208201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:19.208202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:19.208208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:19.208209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:19.208210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:19.208211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:19.208204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1074
2025-10-02T09:31:19.208212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1074
2025-10-02T09:31:19.208227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.208230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:19.208232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:19.208249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.208254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.208272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:19.208279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.208281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.208282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:19.208287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.208293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:19.208302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.208397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.208404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.208414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.208473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1075 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0
2025-10-02T09:31:19.208705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9143fa72-f4ac50f8-de737395-41990f8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:19.210863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Write session: try to update token
2025-10-02T09:31:19.210874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:19.218510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:19.218527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.218528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:19.218529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:19.218535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.218538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.218541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554633989696588:7397]
2025-10-02T09:31:19.218567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:19.218571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.218573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:19.218581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:19.218586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:19.218589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:19.218686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:19.222347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId: src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:19.224780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:19.287334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554634065232504:8404]
2025-10-02T09:31:19.287605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1074, pipe: [1:7556554634065232504:8404]
2025-10-02T09:31:19.339487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.339960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.339972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.340000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232504:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.340166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:19.340221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.340239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554634065232504:8404]
2025-10-02T09:31:19.340256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:19.340308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1075 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0
2025-10-02T09:31:19.340468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1075 sessionId: src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0 is DEAD
2025-10-02T09:31:19.340587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:19.340592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Write session will restart in 0.005571s
2025-10-02T09:31:19.340607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Write session: Do CDS request
2025-10-02T09:31:19.340611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:19.347110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.347221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:19.347231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1076
2025-10-02T09:31:19.347301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.347321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:19.347324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:19.347327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:19.347659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1076 sessionId:  describe result for acl check
2025-10-02T09:31:19.347681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:19.347682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:19.347683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:19.347686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554634065232585:8816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:19.348024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554634065232585:8816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:19.349699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554634065232585:8816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:19.349757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:19.353173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:19.353296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:19.353305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:19.353311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:19.353340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:19.353364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554633989696748:7400]
2025-10-02T09:31:19.353478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554634065232585:8816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:19.353488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554634065232585:8816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:19.353490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554634065232585:8816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:19.353494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:19.353716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:19.353918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:19.353948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:19.354146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:19.354176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.354181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.354181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.354182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.354182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.354183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.354184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.354184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.354185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.354186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.354186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.354187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.354189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.354196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.354198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.354200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.354202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.354204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.354206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.354207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.354209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.354211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.354213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.354215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.354219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.354223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.354226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.354229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.354232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.354234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.354236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.354239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.354241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.354244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.354247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.354249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.354251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.354254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.354256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.354260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.354263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.354268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.354271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.354278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.354282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.354289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.354291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.354294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.354310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:19.362097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:19.363572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:19.363585Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:19.363586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:19.363588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:19.363591Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1075 [2:7556554633989696748:7400]
2025-10-02T09:31:19.363598Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:19.363608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:19.363610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.363611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.363612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.363621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:19.363623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:19.363628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:19.363658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.363663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.363664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.363666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:19.363668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:19.363841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1075
2025-10-02T09:31:19.363842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1075
2025-10-02T09:31:19.363866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:19.363874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.363880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.363887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.363897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:19.363914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232505:2446], now have 1 active actors on pipe
2025-10-02T09:31:19.363917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232657:8816], now have 1 active actors on pipe
2025-10-02T09:31:19.363928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.363934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.363936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.363948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:19.363960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:19.363964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.363966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.363970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:19.363972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:19.363977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:19.363985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:19.363987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:19.364014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:19.364024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.364027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.364028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:19.364034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.364040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:19.364044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.364050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:19.364065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:19.364066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.364184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.364191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.364199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.364269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1076 partition: 0 MaxSeqNo: 36 sessionId: src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0
2025-10-02T09:31:19.364521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5886b9a-9a2c47c2-e39f9ff3-b5a6cea9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:19.367072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Write session: try to update token
2025-10-02T09:31:19.367087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:19.373510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:19.373525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.373530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.373557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:19.373565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:19.373694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:19.373815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.373942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.374071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.374218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:19.374251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:19.378781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId: src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:19.380906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:19.381059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.381073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.381095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:19.381146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:19.382160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:19.382172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.382173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:19.382174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:19.382179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.382181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.382183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554633989696742:7400]
2025-10-02T09:31:19.382205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:19.382213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.382213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:19.382214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:19.382215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:19.382218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:19.382324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:19.440431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554634065232668:8404]
2025-10-02T09:31:19.440658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1075, pipe: [1:7556554634065232668:8404]
2025-10-02T09:31:19.503292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.509878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.509905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.510030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.510077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.510130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.510180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.510366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.510374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.510431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.510477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.510527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.510577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.510666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.510671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.510725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.510772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.510823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.510873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.510919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.510924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.510979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.511032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.511082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.511133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.511213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.511217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.511271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.511319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.511369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.511420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.511459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.511465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.511516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.511563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.511612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.511663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.511699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.511704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.511753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.511800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.511856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.511933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.511969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.511974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.512025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.512078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.512124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.512174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.512210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.512215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.512265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.512310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.512384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.512432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.512467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.512471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.512522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:19.512569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:19.512615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:19.512661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:19.512694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:19.512699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:19.512732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232668:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.512966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.512974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554634065232668:8404]
2025-10-02T09:31:19.512995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:19.512997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:19.513016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1076 reason: error at write: Disconnected sessionId: src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0
2025-10-02T09:31:19.513141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1076 sessionId: src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0 is DEAD
2025-10-02T09:31:19.513274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:19.513281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Write session will restart in 0.006895s
2025-10-02T09:31:19.513296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Write session: Do CDS request
2025-10-02T09:31:19.513300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:19.513297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:19.521154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.521245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:19.521258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1077
2025-10-02T09:31:19.521346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.521366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:19.521373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:19.521376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:19.521612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:19.521643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1077 sessionId:  describe result for acl check
2025-10-02T09:31:19.521672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:19.521676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:19.521677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:19.521681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554634065232788:8820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:19.522029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554634065232788:8820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:19.523716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554634065232788:8820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:19.524550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:19.524736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:19.524754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:19.524765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:19.524837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:19.524871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554633989696903:7402]
2025-10-02T09:31:19.525381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:19.525615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:19.525661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:19.525871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:19.525889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554634065232788:8820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:19.525905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.525900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554634065232788:8820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:19.525902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554634065232788:8820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:19.525906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:19.525910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.525910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.525911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.525911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.525912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.525913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.525913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.525914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.525914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.525915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.525915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.525918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.525924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.525926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.525929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.525931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.525933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.525935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.525937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.525939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.525941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.525943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.525945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.525948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.525952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.525956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.525958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.525960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.525963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.525965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.525968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.525970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.525973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.525975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.525978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.525980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.525982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.525985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.525988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.525990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.525992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.525995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.525997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.526000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.526002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.526004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.526008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.526025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:19.533870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:19.535666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:19.535683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:19.535685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:19.535688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:19.535692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1076 [2:7556554633989696903:7402]
2025-10-02T09:31:19.535702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:19.535718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:19.535720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.535722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.535724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.535736Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:19.535746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:19.535755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:19.535802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.535809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.535811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.535814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:19.535817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:19.535871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:19.535878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.535890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.535900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.535919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:19.535939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232826:8820], now have 1 active actors on pipe
2025-10-02T09:31:19.535946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232670:2446], now have 1 active actors on pipe
2025-10-02T09:31:19.535951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.535953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.535955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.535968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:19.535984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:19.535986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:19.535988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:19.535970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1076
2025-10-02T09:31:19.535990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:19.535972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1076
2025-10-02T09:31:19.536000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:19.536004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:19.536037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.536044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.536054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.536064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:19.536071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:19.536088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:19.536093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.536096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.536099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:19.536105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.536116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:19.536136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.536248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.536257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.536268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.536320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1077 partition: 0 MaxSeqNo: 36 sessionId: src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0
2025-10-02T09:31:19.536596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6379fb01-2098524d-f8fac9d0-d3b3b7da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:19.538814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Write session: try to update token
2025-10-02T09:31:19.538826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:19.545785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:19.545808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.545810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:19.545811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:19.545819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.545823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.545826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554633989696897:7402]
2025-10-02T09:31:19.545862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:19.545868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.545868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:19.545870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:19.545874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:19.545877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:19.546009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:19.550578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId: src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:19.552875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:19.612956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554634065232836:8404]
2025-10-02T09:31:19.613150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1076, pipe: [1:7556554634065232836:8404]
2025-10-02T09:31:19.669902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.670114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.670128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.670166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232836:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.670385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.670396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:19.670411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:19.670414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:19.670441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554634065232836:8404]
2025-10-02T09:31:19.670547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1077 reason: error at write: Disconnected sessionId: src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0
2025-10-02T09:31:19.670693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1077 sessionId: src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0 is DEAD
2025-10-02T09:31:19.670855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:19.670869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Write session will restart in 0.007262s
2025-10-02T09:31:19.670891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Write session: Do CDS request
2025-10-02T09:31:19.670906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:19.679306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.679317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:19.679327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1078
2025-10-02T09:31:19.679589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.679625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:19.679634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:19.679639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:19.679936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1078 sessionId:  describe result for acl check
2025-10-02T09:31:19.679961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:19.679965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:19.679966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:19.679969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554634065232956:8824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:19.679937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:19.680413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554634065232956:8824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:19.682275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554634065232956:8824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:19.682315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:19.682545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:19.682556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:19.682565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:19.682614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:19.682639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554633989697071:7405]
2025-10-02T09:31:19.683011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:19.683253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:19.683281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:19.683515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:19.683564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.683570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.683571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.683571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.683572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.683572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.683573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.683574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.683574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.683575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.683575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.683576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.683579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.683584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.683587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.683589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.683591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.683593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.683595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.683597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.683599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.683601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.683603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.683605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.683609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.683613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.683617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.683620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.683622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.683625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.683627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.683630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.683632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.683635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.683637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.683640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.683642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.683646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.683648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.683651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.683654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.683657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.683659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.683661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.683664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.683666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.683669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.683671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.683688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:19.687271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554634065232956:8824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:19.687281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554634065232956:8824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:19.687284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554634065232956:8824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:19.687290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:19.691540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:19.693007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:19.693021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:19.693023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:19.693025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:19.693029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1077 [2:7556554633989697071:7405]
2025-10-02T09:31:19.693038Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:19.693049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:19.693051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.693052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.693053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.693062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:19.693065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:19.693070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:19.693104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.693110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.693111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.693113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:19.693115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:19.693154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:19.693159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.693166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.693172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.693183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:19.693198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232996:8824], now have 1 active actors on pipe
2025-10-02T09:31:19.693205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065232837:2446], now have 1 active actors on pipe
2025-10-02T09:31:19.693211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.693217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.693219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.693228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:19.693237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:19.693239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:19.693242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:19.693243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:19.693255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:19.693260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:19.693260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1077
2025-10-02T09:31:19.693280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.693286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:19.693287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:19.693297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.693302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.693327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1077
2025-10-02T09:31:19.693333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:19.693343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.693345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.693347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:19.693355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.693367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:19.693383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.693536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.693543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.693554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.693638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1078 partition: 0 MaxSeqNo: 36 sessionId: src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0
2025-10-02T09:31:19.693923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839eb84d-ac2d47f5-54a6b65-1ba44fe1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:19.696321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Write session: try to update token
2025-10-02T09:31:19.696331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:19.702873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:19.702891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.702903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:19.702905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:19.702910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.702913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.702916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554633989697065:7405]
2025-10-02T09:31:19.702941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:19.702949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.702949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:19.702951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:19.702954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:19.702958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:19.703060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:19.707866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId: src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:19.710083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:19.770662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554634065233019:8404]
2025-10-02T09:31:19.770842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1077, pipe: [1:7556554634065233019:8404]
2025-10-02T09:31:19.825495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.826124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.826140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.826175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065233019:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.826374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:19.826386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:19.826397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:19.826444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1078 reason: error at write: Disconnected sessionId: src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0
2025-10-02T09:31:19.826470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554634065233019:8404]
2025-10-02T09:31:19.826516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.826583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1078 sessionId: src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0 is DEAD
2025-10-02T09:31:19.826714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:19.826719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Write session will restart in 0.006147s
2025-10-02T09:31:19.826736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Write session: Do CDS request
2025-10-02T09:31:19.826740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:19.834169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.834238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:19.834249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1079
2025-10-02T09:31:19.834322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:19.834341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:19.834347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:19.834351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:19.834726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1079 sessionId:  describe result for acl check
2025-10-02T09:31:19.834766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:19.834772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:19.834774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:19.834779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554634065233145:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:19.835247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554634065233145:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:19.836819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554634065233145:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:19.837932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:19.838344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:19.838511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:19.838520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:19.838528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:19.838572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:19.838604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554633989697229:7407]
2025-10-02T09:31:19.838697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554634065233145:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:19.838710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554634065233145:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:19.838713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554634065233145:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:19.838720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:19.839149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:19.839380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:19.839428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:19.839716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:19.839772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.839778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.839779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.839780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.839780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.839781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.839782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.839783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.839784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.839785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.839786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.839787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.839791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.839800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.839804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.839808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.839811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.839814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.839817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.839820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.839824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.839827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.839830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.839834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.839839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.839845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:19.839850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.839854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:19.839858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.839862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:19.839866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.839870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:19.839874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.839878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:19.839882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.839886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:19.839890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.839894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:19.839904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.839908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:19.839912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.839918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:19.839922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.839931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.839936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.839945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.839949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.839953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.839990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:19.847603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:19.849515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:19.849528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:19.849530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:19.849534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:19.849538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1078 [2:7556554633989697229:7407]
2025-10-02T09:31:19.849549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:19.849561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:19.849567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.849569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.849571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.849582Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:19.849591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:19.849599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:19.849639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.849643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.849645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.849647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:19.849648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:19.849688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:19.849694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.849701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:19.849707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:19.849715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:19.849727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065233028:2446], now have 1 active actors on pipe
2025-10-02T09:31:19.849729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065233183:8830], now have 1 active actors on pipe
2025-10-02T09:31:19.849733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.849735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.849736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.849744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:19.849752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:19.849759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:19.849759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:19.849761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:19.849761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:19.849763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:19.849778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.849780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:19.849782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:19.849799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1078
2025-10-02T09:31:19.849807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1078
2025-10-02T09:31:19.849868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.849876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.849894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:19.849904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:19.849907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:19.849916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:19.849925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:19.849931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:19.849943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.850123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.850136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.850155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:19.850235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1079 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0
2025-10-02T09:31:19.850508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993ae399-7075bd5f-88b72597-c44ab6e2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:19.853068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Write session: try to update token
2025-10-02T09:31:19.853083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:19.859295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:19.859314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.859320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.859349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:19.859361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:19.859490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:19.859611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.859726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.859873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:19.860034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:19.860066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:19.865225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId: src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:19.867317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:19.868582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:19.868603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:19.868618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:19.868620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:19.868622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:19.868624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:19.868631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.868635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.868638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554633989697223:7407]
2025-10-02T09:31:19.868673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:19.868679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:19.868684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:19.868686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:19.868696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:19.868700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:19.868818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:19.926815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554634065233197:8404]
2025-10-02T09:31:19.927037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1078, pipe: [1:7556554634065233197:8404]
2025-10-02T09:31:19.994544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:19.994758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:19.994796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065233197:8404], now have 1 active actors on pipe
2025-10-02T09:31:19.994911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:19.994956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554634065233197:8404]
2025-10-02T09:31:19.994973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:19.994980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:19.994986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:19.995037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1079 reason: error at write: Disconnected sessionId: src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0
2025-10-02T09:31:19.995174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1079 sessionId: src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0 is DEAD
2025-10-02T09:31:19.995350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:19.995364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Write session will restart in 0.007507s
2025-10-02T09:31:19.995386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Write session: Do CDS request
2025-10-02T09:31:19.995394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.004336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.004352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.004361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1080
2025-10-02T09:31:20.004665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.004693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.004701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.004704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.005031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1080 sessionId:  describe result for acl check
2025-10-02T09:31:20.005061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.005063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.005064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.005068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360200629:8840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.005414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.005461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360200629:8840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.007312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360200629:8840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.007765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.008023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.008033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.008043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.008096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.008128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284664698:7410]
2025-10-02T09:31:20.008645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.008935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.008971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.009219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360200629:8840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.009227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360200629:8840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.009229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360200629:8840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.009234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.009245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.009294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.009299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.009302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.009303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.009304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.009305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.009306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.009307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.009308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.009308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.009310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.009310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.009315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.009323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.009326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.009330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.009334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.009337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.009341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.009344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.009347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.009351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.009354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.009358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.009364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.009371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.009376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.009380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.009384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.009388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.009391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.009395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.009400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.009406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.009409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.009413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.009416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.009420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.009424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.009428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.009440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.009445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.009448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.009452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.009455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.009459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.009463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.009468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.009499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.018994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.019009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.019011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.019014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.019018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1079 [2:7556554638284664698:7410]
2025-10-02T09:31:20.019029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.019049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.019055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.019057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.019059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.019071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.019080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.019089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.019140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.019146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.019148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.019150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.019152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.019204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.019210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.019221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.019235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.019255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.019274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360200666:8840], now have 1 active actors on pipe
2025-10-02T09:31:20.019281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554634065233199:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.019286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.019288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.019291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.019304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.019318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.019319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.019322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.019324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.019334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.019336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.019323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1079
2025-10-02T09:31:20.019345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1079
2025-10-02T09:31:20.019356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.019363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.019364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.019376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.019383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.019424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.019433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.019437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.019438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.019445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.019455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.019473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.019597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.019606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.019617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.019686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1080 partition: 0 MaxSeqNo: 36 sessionId: src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0
2025-10-02T09:31:20.019959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6aa4e60-a6774ab8-b725e0b5-af7737ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.022233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Write session: try to update token
2025-10-02T09:31:20.022247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.029444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.029460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.029461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.029462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.029467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.029469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.029471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284664692:7410]
2025-10-02T09:31:20.029499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.029504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.029505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.029507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.029511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.029513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.029625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.034230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId: src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.036713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:20.095292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554638360200685:8404]
2025-10-02T09:31:20.095550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1079, pipe: [1:7556554638360200685:8404]
2025-10-02T09:31:20.152917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:20.153132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.153142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.153169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360200685:8404], now have 1 active actors on pipe
2025-10-02T09:31:20.153329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:20.153379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:20.153378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:20.153382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:20.153421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554638360200685:8404]
2025-10-02T09:31:20.153429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1080 reason: error at write: Disconnected sessionId: src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0
2025-10-02T09:31:20.153575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1080 sessionId: src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0 is DEAD
2025-10-02T09:31:20.153696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:20.153703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Write session will restart in 0.008235s
2025-10-02T09:31:20.153723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Write session: Do CDS request
2025-10-02T09:31:20.153728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.161548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.163165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.163250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.163258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1081
2025-10-02T09:31:20.163336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.163355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.163360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.163363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.163643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1081 sessionId:  describe result for acl check
2025-10-02T09:31:20.163668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.163673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.163674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.163677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360200809:8845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.163821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.163923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.163930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.163935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.163963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.163989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284664880:7424]
2025-10-02T09:31:20.164060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360200809:8845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.164425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.164648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.164686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.164936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.164988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.164994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.164994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.164995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.164996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.164997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.164997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.164998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.164999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.164999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.165000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.165001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.165005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.165013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.165017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.165020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.165023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.165026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.165029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.165032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.165035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.165039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.165041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.165044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.165050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.165055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.165064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.165069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.165074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.165078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.165081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.165089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.165092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.165096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.165098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.165102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.165107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.165111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.165114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.165117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.165121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.165124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.165132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.165135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.165139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.165147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.165150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.165153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.165180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.165732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360200809:8845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.171089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360200809:8845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.171098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360200809:8845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.171102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360200809:8845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.171108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.172727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.174401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.174414Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.174415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.174417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.174420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1080 [2:7556554638284664880:7424]
2025-10-02T09:31:20.174428Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.174437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.174439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.174440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.174441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.174451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.174455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.174460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.174494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.174499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.174500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.174501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.174503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.174541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.174546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.174552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.174558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.174566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.174579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360200687:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.174585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360200848:8845], now have 1 active actors on pipe
2025-10-02T09:31:20.174589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.174591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.174593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.174603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.174615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.174616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.174624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.174625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.174627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.174629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.174652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.174659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.174660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.174639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1080
2025-10-02T09:31:20.174640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1080
2025-10-02T09:31:20.174677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.174684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.174703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.174709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.174712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.174713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.174718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.174724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.174733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.174849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.174855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.174863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.174941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1081 partition: 0 MaxSeqNo: 36 sessionId: src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0
2025-10-02T09:31:20.175196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583a2a50-d52d4999-8aa05efe-10dd3aec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.177447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Write session: try to update token
2025-10-02T09:31:20.177458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.184110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.184126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.184128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.184129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.184135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.184138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.184140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284664875:7424]
2025-10-02T09:31:20.184164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.184168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.184171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.184172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.184173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.184173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.184303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.188619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId: src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.190868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:20.253477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554638360200857:8404]
2025-10-02T09:31:20.253696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1080, pipe: [1:7556554638360200857:8404]
2025-10-02T09:31:20.306092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:20.306308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.306319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.306345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360200857:8404], now have 1 active actors on pipe
2025-10-02T09:31:20.306493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:20.306615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:20.306627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:20.306637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554638360200857:8404]
2025-10-02T09:31:20.306655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:20.306678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1081 reason: error at write: Disconnected sessionId: src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0
2025-10-02T09:31:20.306836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1081 sessionId: src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0 is DEAD
2025-10-02T09:31:20.306975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:20.306983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Write session will restart in 0.006774s
2025-10-02T09:31:20.307000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Write session: Do CDS request
2025-10-02T09:31:20.307004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.315313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.315422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.315433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1082
2025-10-02T09:31:20.315548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.315579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.315584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.315588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.315935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1082 sessionId:  describe result for acl check
2025-10-02T09:31:20.315961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.315965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.315966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.315970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360200961:8850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.316408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360200961:8850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.318158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360200961:8850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.318167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.320620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.320756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.320764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.320772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.320821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.320856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284665044:7427]
2025-10-02T09:31:20.320890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360200961:8850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.320898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360200961:8850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.320900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360200961:8850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.320904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.321315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.321514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.321544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.321868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.321915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.321915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.321916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.321916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.321917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.321917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.321918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.321919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.321919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.321920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.321920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.321921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.321923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.321930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.321932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.321934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.321936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.321939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.321941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.321943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.321945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.321947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.321949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.321951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.321956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.321961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.321966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.321970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.321975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.321980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.321984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.321988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.321991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.321994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.321996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.321998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.322001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.322003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.322005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.322007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.322009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.322012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.322014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.322016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.322018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.322021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.322022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.322025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.322041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.330104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.331567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.331580Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.331581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.331584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.331588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1081 [2:7556554638284665044:7427]
2025-10-02T09:31:20.331594Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.331605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.331607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.331608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.331609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.331618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.331626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.331631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.331667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.331673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.331674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.331676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.331677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.331719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.331726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.331737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.331746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.331755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.331770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360200859:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.331776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201017:8850], now have 1 active actors on pipe
2025-10-02T09:31:20.331780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.331782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.331783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.331791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.331803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.331804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.331806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.331808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.331814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.331816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.331806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1081
2025-10-02T09:31:20.331833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.331838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.331840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.331810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1081
2025-10-02T09:31:20.331852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.331857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.331885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|328a93e-d1f183da-ba495296-6bdd3de8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.331892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.331894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.331895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.331900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.331911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.331920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.332033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.332041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.332050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.332127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1082 partition: 0 MaxSeqNo: 36 sessionId: src_id|328a93e-d1f183da-ba495296-6bdd3de8_0
2025-10-02T09:31:20.332391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309576e8-5b5d0f93-4756736a-1797a0c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|328a93e-d1f183da-ba495296-6bdd3de8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.334633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Write session: try to update token
2025-10-02T09:31:20.334645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.341494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.341510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.341511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.341513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.341518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.341521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.341525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284665038:7427]
2025-10-02T09:31:20.341548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.341552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.341552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.341554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.341556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.341558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.341662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.345751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId: src_id|328a93e-d1f183da-ba495296-6bdd3de8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.348077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:20.406576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554638360201031:8404]
2025-10-02T09:31:20.406788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1081, pipe: [1:7556554638360201031:8404]
2025-10-02T09:31:20.461430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:20.461784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.461794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.461821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201031:8404], now have 1 active actors on pipe
2025-10-02T09:31:20.461979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:20.462018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:20.462027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:20.462032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:20.462066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554638360201031:8404]
2025-10-02T09:31:20.462087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1082 reason: error at write: Disconnected sessionId: src_id|328a93e-d1f183da-ba495296-6bdd3de8_0
2025-10-02T09:31:20.462231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1082 sessionId: src_id|328a93e-d1f183da-ba495296-6bdd3de8_0 is DEAD
2025-10-02T09:31:20.462375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:20.462384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Write session will restart in 0.005607s
2025-10-02T09:31:20.462404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Write session: Do CDS request
2025-10-02T09:31:20.462410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.469086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.469219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.469228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1083
2025-10-02T09:31:20.469334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.469361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.469368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.469371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.469651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1083 sessionId:  describe result for acl check
2025-10-02T09:31:20.469671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.469672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.469673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.469676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360201176:8855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.469912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.470039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360201176:8855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.471639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360201176:8855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.472083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.472197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.472204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.472210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.472242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.472265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284665205:7429]
2025-10-02T09:31:20.472621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.472793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.472827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.473005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.473033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.473037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.473038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.473038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.473039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.473039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.473040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.473041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.473041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.473042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.473042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.473043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.473046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.473051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.473054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.473056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.473058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.473060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.473062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.473064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.473066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.473068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.473070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.473072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.473075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.473079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.473083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.473086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.473088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.473091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.473093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.473096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.473098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.473101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.473103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.473106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.473108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.473111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.473113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.473115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.473117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.473120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.473123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.473125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.473127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.473130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.473132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.473135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.473151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.473479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360201176:8855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.473489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360201176:8855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.473491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360201176:8855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.473496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.480527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.482148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.482160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.482162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.482164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.482168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1082 [2:7556554638284665205:7429]
2025-10-02T09:31:20.482173Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.482184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.482185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.482186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.482187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.482197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.482200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.482203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.482234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.482240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.482241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.482243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.482245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.482285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.482290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.482297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.482302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.482310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.482323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201053:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.482329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201215:8855], now have 1 active actors on pipe
2025-10-02T09:31:20.482332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.482334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.482335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.482342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.482353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.482354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.482356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.482358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.482362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.482363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.482378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.482383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.482392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.482406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.482410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.482426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.482433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.482435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.482436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.482441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.482446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.482455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.482373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1082
2025-10-02T09:31:20.482388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1082
2025-10-02T09:31:20.482583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.482590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.482601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.482665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1083 partition: 0 MaxSeqNo: 36 sessionId: src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0
2025-10-02T09:31:20.482909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328a93e-d1f183da-ba495296-6bdd3de8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.485086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Write session: try to update token
2025-10-02T09:31:20.485096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.491603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.491620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.491622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.491622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.491628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.491630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.491633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284665200:7429]
2025-10-02T09:31:20.491657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.491662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.491662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.491664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.491666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.491669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.491780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.495573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId: src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.497708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:20.562231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554638360201223:8404]
2025-10-02T09:31:20.562475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1082, pipe: [1:7556554638360201223:8404]
2025-10-02T09:31:20.612335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:20.612730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.612740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.612766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201223:8404], now have 1 active actors on pipe
2025-10-02T09:31:20.612929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:20.612996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:20.613028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554638360201223:8404]
2025-10-02T09:31:20.613038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:20.613099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1083 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0
2025-10-02T09:31:20.613251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1083 sessionId: src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0 is DEAD
2025-10-02T09:31:20.613403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:20.613414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Write session will restart in 0.009694s
2025-10-02T09:31:20.613436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Write session: Do CDS request
2025-10-02T09:31:20.613442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.623142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.624269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.624350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.624363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1084
2025-10-02T09:31:20.624484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.624513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.624522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.624528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.624851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1084 sessionId:  describe result for acl check
2025-10-02T09:31:20.624877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.624881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.624883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.624887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360201351:8859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.625248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360201351:8859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.625653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.625799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.625807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.625814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.625851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.625884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284665369:7431]
2025-10-02T09:31:20.626419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.626596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360201351:8859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.626603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.626636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.626919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.626970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.626976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.626977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.626978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.626978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.626980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.626981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.626982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.626982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.626983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.626984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.626985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.626990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.626998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.627002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.627006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.627009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.627013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.627017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.627020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.627023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.627027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.627031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.627034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.627040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.627046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.627051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.627057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.627061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.627066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.627070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.627074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.627082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.627087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.627094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.627099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.627105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.627109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.627115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.627119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.627125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.627130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.627133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.627140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.627144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.627152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.627156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.627162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.627191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.631360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360201351:8859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.631372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360201351:8859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.631374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360201351:8859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.631379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.635154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.636999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.637011Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.637013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.637017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.637022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1083 [2:7556554638284665369:7431]
2025-10-02T09:31:20.637035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.637049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.637052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.637055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.637057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.637070Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.637075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.637086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.637137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.637144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.637146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.637149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.637151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.637206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.637213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.637224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.637234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.637251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.637269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201225:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.637276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201388:8859], now have 1 active actors on pipe
2025-10-02T09:31:20.637281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.637282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.637284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.637295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.637308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.637307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1083
2025-10-02T09:31:20.637316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1083
2025-10-02T09:31:20.637319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.637322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.637325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.637329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.637332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.637351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.637354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.637356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.637367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.637372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.637411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f43301-dd822841-1317d161-6073675b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.637420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.637424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.637426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.637434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.637442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.637456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.637596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.637603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.637614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.637684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1084 partition: 0 MaxSeqNo: 36 sessionId: src_id|59f43301-dd822841-1317d161-6073675b_0
2025-10-02T09:31:20.637946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cf655b7-8b2b7b22-b15e85c4-f9b49bf7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59f43301-dd822841-1317d161-6073675b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.640249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Write session: try to update token
2025-10-02T09:31:20.640259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.647613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.647633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.647636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.647637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.647645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.647649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.647653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284665363:7431]
2025-10-02T09:31:20.647686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.647693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.647695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.647699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.647705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.647708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.647825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.651812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId: src_id|59f43301-dd822841-1317d161-6073675b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.653948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:20.713253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554638360201396:8404]
2025-10-02T09:31:20.713468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1083, pipe: [1:7556554638360201396:8404]
2025-10-02T09:31:20.768627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:20.769032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.769042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.769068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201396:8404], now have 1 active actors on pipe
2025-10-02T09:31:20.769249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:20.769267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:20.769275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554638360201396:8404]
2025-10-02T09:31:20.769297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:20.769299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:20.769351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1084 reason: error at write: Disconnected sessionId: src_id|59f43301-dd822841-1317d161-6073675b_0
2025-10-02T09:31:20.769510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1084 sessionId: src_id|59f43301-dd822841-1317d161-6073675b_0 is DEAD
2025-10-02T09:31:20.769671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:20.769681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Write session will restart in 0.005099s
2025-10-02T09:31:20.769695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Write session: Do CDS request
2025-10-02T09:31:20.769699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.776133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.776225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.776233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1085
2025-10-02T09:31:20.776344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.776365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.776371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.776374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.776642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1085 sessionId:  describe result for acl check
2025-10-02T09:31:20.776671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.776677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.776679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.776683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360201533:8864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.777034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360201533:8864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.777613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.778733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360201533:8864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.779932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.780035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.780041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.780047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.780073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.780095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284665544:7434]
2025-10-02T09:31:20.780438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.780603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.780627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.780735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360201533:8864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.780745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360201533:8864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.780750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360201533:8864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.780759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.780847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.781053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.781060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.781061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.781063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.781063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.781064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.781065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.781066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.781067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.781068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.781069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.781070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.781074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.781083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.781087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.781090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.781094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.781097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.781101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.781104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.781108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.781112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.781115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.781118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.781124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.781131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.781136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.781141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.781144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.781147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.781151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.781155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.781159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.781164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.781167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.781171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.781176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.781181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.781185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.781190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.781195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.781199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.781205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.781209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.781218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.781222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.781225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.781228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.781248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.789107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.790684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.790697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.790698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.790700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.790704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1084 [2:7556554638284665544:7434]
2025-10-02T09:31:20.790712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.790722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.790723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.790725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.790727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.790736Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.790740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.790744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.790777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.790782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.790782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.790784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.790786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.790822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.790827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.790833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.790838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.790850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.790864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201575:8864], now have 1 active actors on pipe
2025-10-02T09:31:20.790870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201409:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.790873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.790874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.790875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.790882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.790901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.790903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.790909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.790910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.790911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.790911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.790926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.790936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.790949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.790962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.790928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1084
2025-10-02T09:31:20.790969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.790945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1084
2025-10-02T09:31:20.790990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bf45b76-304a89a7-396e8b10-8471186c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.791000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.791003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.791005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.791012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.791021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.791032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.791134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.791139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.791146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.791205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1085 partition: 0 MaxSeqNo: 36 sessionId: src_id|2bf45b76-304a89a7-396e8b10-8471186c_0
2025-10-02T09:31:20.791447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f43301-dd822841-1317d161-6073675b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2bf45b76-304a89a7-396e8b10-8471186c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.793620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Write session: try to update token
2025-10-02T09:31:20.793630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.800747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.800764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.800766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.800767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.800773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.800776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.800778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284665539:7434]
2025-10-02T09:31:20.800814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.800818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.800821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.800828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.800841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.800844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.800961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.804479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId: src_id|2bf45b76-304a89a7-396e8b10-8471186c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.806356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:20.869412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554638360201592:8404]
2025-10-02T09:31:20.869588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1084, pipe: [1:7556554638360201592:8404]
2025-10-02T09:31:20.921517Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:20.921732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.921741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.921767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201592:8404], now have 1 active actors on pipe
2025-10-02T09:31:20.921930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:20.921950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:20.921984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554638360201592:8404]
2025-10-02T09:31:20.921996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:20.922062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1085 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2bf45b76-304a89a7-396e8b10-8471186c_0
2025-10-02T09:31:20.922222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1085 sessionId: src_id|2bf45b76-304a89a7-396e8b10-8471186c_0 is DEAD
2025-10-02T09:31:20.922361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:20.922371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Write session will restart in 0.007812s
2025-10-02T09:31:20.922389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Write session: Do CDS request
2025-10-02T09:31:20.922393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:20.931413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.931472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:20.931485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1086
2025-10-02T09:31:20.931626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:20.931655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:20.931663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:20.931667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:20.931796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:20.932043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1086 sessionId:  describe result for acl check
2025-10-02T09:31:20.932075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:20.932081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:20.932082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:20.932087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554638360201720:8869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:20.932583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554638360201720:8869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:20.934121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:20.934269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:20.934278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:20.934287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:20.934331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:20.934364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554638284665712:7436]
2025-10-02T09:31:20.934693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554638360201720:8869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:20.934926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:20.935204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:20.935242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:20.935537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:20.935590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.935597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.935598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.935599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.935600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.935601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.935602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.935603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.935604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.935605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.935606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.935606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.935611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.935621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.935625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.935628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.935632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.935636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.935639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.935643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.935646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.935650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.935654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.935657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.935663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.935670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:20.935681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.935688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:20.935692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.935698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:20.935703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.935712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:20.935719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.935724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:20.935733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.935738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:20.935746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.935751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:20.935760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.935764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:20.935772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.935777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:20.935783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.935788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.935796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.935801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.935807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.935811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.935846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:20.940220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554638360201720:8869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:20.940230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554638360201720:8869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:20.940232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554638360201720:8869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:20.940252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:20.943982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:20.945849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:20.945866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:20.945867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:20.945870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:20.945874Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1085 [2:7556554638284665712:7436]
2025-10-02T09:31:20.945884Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:20.945895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:20.945897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.945899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.945900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.945909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:20.945913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:20.945916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:20.945953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.945960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.945961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.945963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:20.945964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:20.946004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:20.946010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.946016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:20.946021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:20.946031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:20.946044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.946048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.946049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.946054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:20.946063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:20.946063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201759:8869], now have 1 active actors on pipe
2025-10-02T09:31:20.946066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554638360201593:2446], now have 1 active actors on pipe
2025-10-02T09:31:20.946070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:20.946071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:20.946075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:20.946078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:20.946079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:20.946099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.946108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:20.946118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:20.946107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1085
2025-10-02T09:31:20.946107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1085
2025-10-02T09:31:20.946149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.946155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.946175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3678edf1-2d60876f-12699475-da05aea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:20.946184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:20.946186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:20.946187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:20.946192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:20.946199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:20.946210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.946592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:20.946606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:20.946620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:20.946691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1086 partition: 0 MaxSeqNo: 36 sessionId: src_id|3678edf1-2d60876f-12699475-da05aea2_0
2025-10-02T09:31:20.947043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf45b76-304a89a7-396e8b10-8471186c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3678edf1-2d60876f-12699475-da05aea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:20.950026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Write session: try to update token
2025-10-02T09:31:20.950046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:20.955749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:20.955764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:20.955766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:20.955767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:20.955772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.955774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.955777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554638284665706:7436]
2025-10-02T09:31:20.955801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:20.955805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:20.955807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:20.955809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:20.955813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:20.955816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:20.955922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:20.963536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId: src_id|3678edf1-2d60876f-12699475-da05aea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:20.965724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.021988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655169063:8404]
2025-10-02T09:31:21.022191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1085, pipe: [1:7556554642655169063:8404]
2025-10-02T09:31:21.085827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.086049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.086057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.086070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169063:8404], now have 1 active actors on pipe
2025-10-02T09:31:21.086218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:21.086258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655169063:8404]
2025-10-02T09:31:21.086261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:21.086264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:21.086283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:21.086309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1086 reason: error at write: Disconnected sessionId: src_id|3678edf1-2d60876f-12699475-da05aea2_0
2025-10-02T09:31:21.086453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1086 sessionId: src_id|3678edf1-2d60876f-12699475-da05aea2_0 is DEAD
2025-10-02T09:31:21.086615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:21.086629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Write session will restart in 0.005475s
2025-10-02T09:31:21.086651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Write session: Do CDS request
2025-10-02T09:31:21.086657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:21.093285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.093320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:21.093331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1087
2025-10-02T09:31:21.093641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.093661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:21.093667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:21.093670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:21.093984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1087 sessionId:  describe result for acl check
2025-10-02T09:31:21.094009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:21.094010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:21.094011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:21.094014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554642655169214:8880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:21.094362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554642655169214:8880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:21.094850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:21.095707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554642655169214:8880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:21.097002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:21.097110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:21.097116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:21.097122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:21.097149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:21.097173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554642579633209:7451]
2025-10-02T09:31:21.097542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:21.097674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554642655169214:8880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:21.097682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554642655169214:8880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:21.097685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554642655169214:8880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:21.097688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:21.097708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:21.097733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:21.097912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:21.097946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.097951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.097951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.097952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.097952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.097953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.097953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.097954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.097954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.097955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.097955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.097956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.097959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.097965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.097967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.097969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.097970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.097972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.097974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.097976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.097978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.097980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.097982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.097984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.097987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.097991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.097994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.097997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.097999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.098002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.098004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.098008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.098010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.098013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.098015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.098017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.098020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.098022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.098024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.098026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.098028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.098031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.098033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.098036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.098038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.098040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.098042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.098044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.098061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:21.105701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:21.107542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:21.107556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:21.107558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:21.107561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:21.107566Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1086 [2:7556554642579633209:7451]
2025-10-02T09:31:21.107576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:21.107590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:21.107597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.107600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.107602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.107613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:21.107622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:21.107631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:21.107676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.107682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.107683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.107686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:21.107688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:21.107743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:21.107750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.107760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.107773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.107790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:21.107809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169089:2446], now have 1 active actors on pipe
2025-10-02T09:31:21.107815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169250:8880], now have 1 active actors on pipe
2025-10-02T09:31:21.107820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.107827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.107829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.107840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:21.107841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:21.107844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:21.107845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:21.107829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1086
2025-10-02T09:31:21.107854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:21.107830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1086
2025-10-02T09:31:21.107870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:21.107876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:21.107907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.107914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.107923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.107934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:21.107945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:21.107960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd121564-3b1c1512-ee336dfd-37a24553_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:21.107966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.107970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.107973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:21.107982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.107989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:21.108006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.108100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.108109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.108120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.108179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1087 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd121564-3b1c1512-ee336dfd-37a24553_0
2025-10-02T09:31:21.108460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3678edf1-2d60876f-12699475-da05aea2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd121564-3b1c1512-ee336dfd-37a24553_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:21.111019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Write session: try to update token
2025-10-02T09:31:21.111032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:21.117738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:21.117757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:21.117760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:21.117762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:21.117768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.117772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.117775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554642579633204:7451]
2025-10-02T09:31:21.117805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:21.117810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:21.117814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:21.117814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.117816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:21.117819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:21.117935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:21.123088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId: src_id|bd121564-3b1c1512-ee336dfd-37a24553_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:21.125068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.186283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655169263:8404]
2025-10-02T09:31:21.186477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1086, pipe: [1:7556554642655169263:8404]
2025-10-02T09:31:21.235841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.236244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.236254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.236267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169263:8404], now have 1 active actors on pipe
2025-10-02T09:31:21.236385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:21.236414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:21.236429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655169263:8404]
2025-10-02T09:31:21.236446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:21.236507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1087 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd121564-3b1c1512-ee336dfd-37a24553_0
2025-10-02T09:31:21.236651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1087 sessionId: src_id|bd121564-3b1c1512-ee336dfd-37a24553_0 is DEAD
2025-10-02T09:31:21.236823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:21.236835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Write session will restart in 0.008731s
2025-10-02T09:31:21.236871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Write session: Do CDS request
2025-10-02T09:31:21.236876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:21.244903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:21.246236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.246342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:21.246352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1088
2025-10-02T09:31:21.246441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.246467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:21.246475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:21.246478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:21.246839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1088 sessionId:  describe result for acl check
2025-10-02T09:31:21.246863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:21.246867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:21.246868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:21.246871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554642655169394:8885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:21.247201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:21.247224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554642655169394:8885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:21.247308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:21.247315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:21.247321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:21.247348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:21.247373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554642579633378:7454]
2025-10-02T09:31:21.247721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:21.247997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:21.248023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:21.248205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:21.248237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.248241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.248242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.248242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.248243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.248243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.248244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.248245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.248245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.248246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.248246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.248247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.248250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.248256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.248259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.248261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.248263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.248265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.248267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.248269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.248271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.248275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.248277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.248279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.248282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.248286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.248289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.248292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.248294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.248297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.248299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.248302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.248305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.248307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.248309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.248312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.248314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.248317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.248319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.248322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.248324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.248327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.248329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.248332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.248335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.248338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.248340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.248343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.248360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:21.248769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554642655169394:8885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:21.253334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554642655169394:8885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:21.253343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554642655169394:8885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:21.253345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554642655169394:8885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:21.253350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:21.255960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:21.257594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:21.257607Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:21.257608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:21.257610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:21.257614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1087 [2:7556554642579633378:7454]
2025-10-02T09:31:21.257621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:21.257631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:21.257633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.257634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.257635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.257645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:21.257647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:21.257652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:21.257687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.257692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.257693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.257696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:21.257697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:21.257735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:21.257740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.257746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.257751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.257759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:21.257772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169433:8885], now have 1 active actors on pipe
2025-10-02T09:31:21.257777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169264:2446], now have 1 active actors on pipe
2025-10-02T09:31:21.257780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.257782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.257783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.257791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:21.257799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:21.257806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:21.257809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:21.257809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:21.257810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:21.257810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:21.257820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1087
2025-10-02T09:31:21.257828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1087
2025-10-02T09:31:21.257827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.257834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:21.257837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:21.257855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.257857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.257872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:21.257876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.257879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.257880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:21.257885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.257891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:21.257903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.258011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.258016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.258023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.258094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1088 partition: 0 MaxSeqNo: 36 sessionId: src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0
2025-10-02T09:31:21.258364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd121564-3b1c1512-ee336dfd-37a24553_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:21.261052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Write session: try to update token
2025-10-02T09:31:21.261066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:21.267561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:21.267571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:21.267574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:21.267575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:21.267582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.267586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.267589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554642579633373:7454]
2025-10-02T09:31:21.267617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:21.267619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:21.267623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:21.267625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:21.267626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.267628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:21.267747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:21.273130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId: src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:21.275201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.336354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655169441:8404]
2025-10-02T09:31:21.336564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1087, pipe: [1:7556554642655169441:8404]
2025-10-02T09:31:21.386078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.386519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.386530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.386545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169441:8404], now have 1 active actors on pipe
2025-10-02T09:31:21.386696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:21.386751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:21.386754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655169441:8404]
2025-10-02T09:31:21.386761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:21.386769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:21.386817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1088 reason: error at write: Disconnected sessionId: src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0
2025-10-02T09:31:21.386959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1088 sessionId: src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0 is DEAD
2025-10-02T09:31:21.387102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:21.387113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Write session will restart in 0.006145s
2025-10-02T09:31:21.387133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Write session: Do CDS request
2025-10-02T09:31:21.387139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:21.394155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.394238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:21.394244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1089
2025-10-02T09:31:21.394314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.394333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:21.394339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:21.394342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:21.394613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1089 sessionId:  describe result for acl check
2025-10-02T09:31:21.394635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:21.394636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:21.394637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:21.394640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554642655169570:8889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:21.395000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554642655169570:8889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:21.395313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:21.396610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554642655169570:8889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:21.397401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:21.397499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:21.397505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:21.397511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:21.397537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:21.397558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554642579633546:7456]
2025-10-02T09:31:21.397893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:21.398081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:21.398105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:21.398138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554642655169570:8889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:21.398146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554642655169570:8889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:21.398148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554642655169570:8889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:21.398151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:21.398306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:21.398343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.398347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.398347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.398348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.398348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.398349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.398349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.398350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.398350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.398351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.398351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.398352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.398354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.398360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.398362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.398365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.398367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.398369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.398370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.398373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.398374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.398376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.398378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.398380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.398384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.398388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.398392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.398395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.398397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.398399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.398401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.398404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.398406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.398409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.398412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.398415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.398417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.398419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.398421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.398424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.398426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.398428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.398431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.398433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.398435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.398438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.398440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.398442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.398458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:21.405905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:21.407291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:21.407301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:21.407302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:21.407305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:21.407308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1088 [2:7556554642579633546:7456]
2025-10-02T09:31:21.407316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:21.407326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:21.407327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.407329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.407330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.407339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:21.407343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:21.407351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:21.407382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.407387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.407388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.407390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:21.407392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:21.407427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:21.407431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.407437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.407443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.407453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:21.407469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169442:2446], now have 1 active actors on pipe
2025-10-02T09:31:21.407474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169608:8889], now have 1 active actors on pipe
2025-10-02T09:31:21.407477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.407479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.407480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.407487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:21.407498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:21.407501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:21.407503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:21.407505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:21.407509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:21.407511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:21.407530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.407537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:21.407537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:21.407507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1088
2025-10-02T09:31:21.407524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1088
2025-10-02T09:31:21.407552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.407559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.407589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebe33727-33043aa2-a449dd2-802104cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:21.407597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.407599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.407600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:21.407605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.407611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:21.407620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.407952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.407959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.407969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.408027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1089 partition: 0 MaxSeqNo: 36 sessionId: src_id|ebe33727-33043aa2-a449dd2-802104cc_0
2025-10-02T09:31:21.408280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd27f3-a92affcc-d0ac33e7-58cd231e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ebe33727-33043aa2-a449dd2-802104cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:21.410608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Write session: try to update token
2025-10-02T09:31:21.410622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:21.417006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:21.417018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:21.417020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:21.417022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:21.417029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.417032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.417035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554642579633541:7456]
2025-10-02T09:31:21.417064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:21.417065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:21.417068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:21.417070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:21.417072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.417074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:21.417195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:21.422171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId: src_id|ebe33727-33043aa2-a449dd2-802104cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:21.424233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.486884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655169619:8404]
2025-10-02T09:31:21.487077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1088, pipe: [1:7556554642655169619:8404]
2025-10-02T09:31:21.534431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.534633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.534642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.534669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169619:8404], now have 1 active actors on pipe
2025-10-02T09:31:21.534848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:21.534806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:21.534817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:21.534857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655169619:8404]
2025-10-02T09:31:21.534861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1089 reason: error at write: Disconnected sessionId: src_id|ebe33727-33043aa2-a449dd2-802104cc_0
2025-10-02T09:31:21.534870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:21.535026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1089 sessionId: src_id|ebe33727-33043aa2-a449dd2-802104cc_0 is DEAD
2025-10-02T09:31:21.535201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:21.535214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Write session will restart in 0.006214s
2025-10-02T09:31:21.535242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Write session: Do CDS request
2025-10-02T09:31:21.535248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:21.542251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.542332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:21.542342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1090
2025-10-02T09:31:21.542434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.542454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:21.542460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:21.542462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:21.542742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1090 sessionId:  describe result for acl check
2025-10-02T09:31:21.542761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:21.542775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:21.542777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:21.542780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554642655169752:8895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:21.543157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554642655169752:8895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:21.543630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:21.544648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554642655169752:8895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:21.545866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:21.545993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:21.546002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:21.546008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:21.546039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:21.546062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554642579633715:7458]
2025-10-02T09:31:21.546421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:21.546587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:21.546608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554642655169752:8895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:21.546616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554642655169752:8895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:21.546611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:21.546641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554642655169752:8895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:21.546647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:21.546793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:21.546821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.546825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.546825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.546826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.546826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.546827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.546827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.546828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.546828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.546829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.546829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.546830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.546833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.546838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.546840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.546842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.546844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.546846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.546848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.546850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.546852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.546854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.546856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.546858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.546863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.546868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.546873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.546877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.546881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.546886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.546901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.546905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.546908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.546911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.546913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.546916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.546919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.546922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.546925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.546928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.546930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.546933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.546935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.546938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.546942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.546945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.546947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.546950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.546971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:21.554436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:21.556127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:21.556138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:21.556139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:21.556142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:21.556145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1089 [2:7556554642579633715:7458]
2025-10-02T09:31:21.556152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:21.556162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:21.556163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.556165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.556166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.556175Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:21.556178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:21.556182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:21.556214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.556220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.556222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.556224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:21.556225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:21.556262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:21.556267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.556274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.556280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.556288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:21.556299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.556304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.556306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.556312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:21.556319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169792:8895], now have 1 active actors on pipe
2025-10-02T09:31:21.556320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:21.556322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169624:2446], now have 1 active actors on pipe
2025-10-02T09:31:21.556322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:21.556324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:21.556327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:21.556334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:21.556337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:21.556351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.556361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:21.556364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:21.556352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1089
2025-10-02T09:31:21.556357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1089
2025-10-02T09:31:21.556390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.556397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.556421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:21.556428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.556430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.556431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:21.556437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.556445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:21.556454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.556564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.556570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.556580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.556639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1090 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0
2025-10-02T09:31:21.556902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe33727-33043aa2-a449dd2-802104cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:21.559244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Write session: try to update token
2025-10-02T09:31:21.559257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:21.566042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:21.566056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:21.566057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:21.566058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:21.566064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.566066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.566068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554642579633710:7458]
2025-10-02T09:31:21.566091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:21.566094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.566096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:21.566109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:21.566121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:21.566124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:21.566210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:21.571009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId: src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:21.573042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.634849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655169802:8404]
2025-10-02T09:31:21.635072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1089, pipe: [1:7556554642655169802:8404]
2025-10-02T09:31:21.683972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.684381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.684390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.684419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169802:8404], now have 1 active actors on pipe
2025-10-02T09:31:21.684551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:21.684600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:21.684600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655169802:8404]
2025-10-02T09:31:21.684618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:21.684667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1090 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0
2025-10-02T09:31:21.684831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1090 sessionId: src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0 is DEAD
2025-10-02T09:31:21.684979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:21.684990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Write session will restart in 0.005497s
2025-10-02T09:31:21.685010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Write session: Do CDS request
2025-10-02T09:31:21.685015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:21.691230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.691288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:21.691298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1091
2025-10-02T09:31:21.691405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.691428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:21.691432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:21.691436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:21.691680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1091 sessionId:  describe result for acl check
2025-10-02T09:31:21.691700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:21.691701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:21.691702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:21.691705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554642655169878:8899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:21.692063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554642655169878:8899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:21.693561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554642655169878:8899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:21.696298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:21.696340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554642655169878:8899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:21.696348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554642655169878:8899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:21.696350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554642655169878:8899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:21.696358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:21.696590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:21.696705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:21.696713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:21.696721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:21.696755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:21.696787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554642579633898:7461]
2025-10-02T09:31:21.697338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:21.697506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:21.697540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:21.697813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:21.697856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.697862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.697863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.697864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.697865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.697866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.697867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.697868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.697868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.697869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.697870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.697871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.697875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.697884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.697888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.697892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.697895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.697899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.697905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.697909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.697916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.697920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.697927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.697931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.697940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.697946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.697955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.697963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.697967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.697972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.697977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.697982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.697989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.697997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.698001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.698008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.698013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.698021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.698029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.698037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.698044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.698053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.698060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.698065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.698073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.698081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.698089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.698097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.698130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:21.705711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:21.707175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:21.707189Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:21.707191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:21.707194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:21.707198Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1090 [2:7556554642579633898:7461]
2025-10-02T09:31:21.707208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:21.707220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:21.707223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.707225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.707227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.707239Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:21.707248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:21.707253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:21.707294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.707301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.707303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.707305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:21.707307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:21.707424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1090
2025-10-02T09:31:21.707425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1090
2025-10-02T09:31:21.707569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:21.707578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.707588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.707600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.707620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:21.707640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169803:2446], now have 1 active actors on pipe
2025-10-02T09:31:21.707648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169970:8899], now have 1 active actors on pipe
2025-10-02T09:31:21.707662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.707669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.707681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.707686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.707688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.707699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:21.707711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:21.707712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:21.707717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:21.707718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:21.707725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:21.707727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:21.707739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:21.707749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.707754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.707755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:21.707762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.707773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:21.707795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.707806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:21.707814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:21.707819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.707932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.707940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.707951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.707998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1091 partition: 0 MaxSeqNo: 36 sessionId: src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0
2025-10-02T09:31:21.708237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d88508d-715d359a-86c0a7f2-b7f36517_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:21.710567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Write session: try to update token
2025-10-02T09:31:21.710580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:21.717271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:21.717287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:21.717288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:21.717290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:21.717296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.717300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.717303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554642579633891:7461]
2025-10-02T09:31:21.717330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:21.717330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:21.717333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:21.717336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:21.717341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.717343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:21.717458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:21.722029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId: src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:21.723991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.784852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655169997:8404]
2025-10-02T09:31:21.785066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1090, pipe: [1:7556554642655169997:8404]
2025-10-02T09:31:21.839360Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.839584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.839599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.839630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655169997:8404], now have 1 active actors on pipe
2025-10-02T09:31:21.839802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:21.839848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:21.839849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655169997:8404]
2025-10-02T09:31:21.839871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:21.839936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1091 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0
2025-10-02T09:31:21.840103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1091 sessionId: src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0 is DEAD
2025-10-02T09:31:21.840228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:21.840238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Write session will restart in 0.005711s
2025-10-02T09:31:21.840262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Write session: Do CDS request
2025-10-02T09:31:21.840267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:21.847264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.847340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:21.847352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1092
2025-10-02T09:31:21.847469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:21.847498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:21.847503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:21.847506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:21.847861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1092 sessionId:  describe result for acl check
2025-10-02T09:31:21.847896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:21.847902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:21.847903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:21.847908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554642655170060:8905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:21.848390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554642655170060:8905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:21.850477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554642655170060:8905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:21.851866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:21.854668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:21.854725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554642655170060:8905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:21.854735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554642655170060:8905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:21.854738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554642655170060:8905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:21.854747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:21.854843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:21.854852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:21.854863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:21.854931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:21.854967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554642579634068:7463]
2025-10-02T09:31:21.855531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:21.855780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:21.855823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:21.856110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:21.856165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.856171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.856172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.856173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.856174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.856175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.856176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.856177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.856178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.856179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.856180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.856181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.856185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.856195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.856198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.856202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.856205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.856208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.856212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.856216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.856219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.856227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.856231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.856239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.856245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.856255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:21.856265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.856273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:21.856283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.856288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:21.856296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.856304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:21.856313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.856319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:21.856328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.856337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:21.856345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.856349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:21.856357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.856361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:21.856369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.856374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:21.856381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.856387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.856394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.856400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.856407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.856412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.856445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:21.865068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:21.866968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:21.866980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:21.866982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:21.866985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:21.866990Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1091 [2:7556554642579634068:7463]
2025-10-02T09:31:21.867001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:21.867015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:21.867017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.867020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.867022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.867034Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:21.867039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:21.867047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:21.867102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.867108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.867110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.867112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:21.867114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:21.867169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:21.867175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.867187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:21.867202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:21.867218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:21.867241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655170170:8905], now have 1 active actors on pipe
2025-10-02T09:31:21.867248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655170002:2446], now have 1 active actors on pipe
2025-10-02T09:31:21.867254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.867262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.867264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.867260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1091
2025-10-02T09:31:21.867270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:21.867266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1091
2025-10-02T09:31:21.867287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:21.867289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:21.867289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:21.867290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:21.867302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:21.867305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:21.867338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.867346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.867357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.867364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:21.867368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:21.867385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b01f642-e1e26b6-81636863-dfa075a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:21.867394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:21.867397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:21.867399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:21.867407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:21.867414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:21.867439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.867569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.867578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.867590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:21.867679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1092 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b01f642-e1e26b6-81636863-dfa075a7_0
2025-10-02T09:31:21.867965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7166ee90-acd27cb9-4cfab97f-2cae18d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b01f642-e1e26b6-81636863-dfa075a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:21.870359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Write session: try to update token
2025-10-02T09:31:21.870373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:21.877551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:21.877562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:21.877564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:21.877565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:21.877571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.877574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.877577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554642579634063:7463]
2025-10-02T09:31:21.877603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:21.877607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:21.877609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:21.877609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:21.877616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:21.877618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:21.877733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:21.882415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId: src_id|1b01f642-e1e26b6-81636863-dfa075a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:21.884648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:21.940007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554642655170184:8404]
2025-10-02T09:31:21.940250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1091, pipe: [1:7556554642655170184:8404]
2025-10-02T09:31:21.999520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:21.999923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:21.999936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:21.999971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655170184:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.000200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554642655170184:8404]
2025-10-02T09:31:22.000206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:22.000209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:22.000224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.000259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1092 reason: error at write: Disconnected sessionId: src_id|1b01f642-e1e26b6-81636863-dfa075a7_0
2025-10-02T09:31:22.000388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1092 sessionId: src_id|1b01f642-e1e26b6-81636863-dfa075a7_0 is DEAD
2025-10-02T09:31:22.000463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:22.000550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:22.000561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Write session will restart in 0.008487s
2025-10-02T09:31:22.000582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Write session: Do CDS request
2025-10-02T09:31:22.000587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.010115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.010211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.010317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.010328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1093
2025-10-02T09:31:22.010440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.010465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.010471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.010474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.010787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1093 sessionId:  describe result for acl check
2025-10-02T09:31:22.010814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.010818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.010819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.010822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950137616:8909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.011215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950137616:8909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.012556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.012693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.012703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.012712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.012760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.012870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950137616:8909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.012951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874601538:7466]
2025-10-02T09:31:22.013492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.013729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.013755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.013944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.013974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.013978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.013979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.013979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.013980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.013981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.013981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.013982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.013982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.013983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.013983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.013984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.013987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.013993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.013995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.013997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.013999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.014001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.014003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.014005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.014007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.014010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.014012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.014014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.014018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.014022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.014026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.014029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.014031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.014034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.014036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.014038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.014041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.014044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.014046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.014048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.014051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.014054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.014056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.014059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.014062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.014065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.014067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.014070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.014072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.014075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.014078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.014080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.014102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.018254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950137616:8909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.018265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950137616:8909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.018268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950137616:8909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.018273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.021976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.023613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.023625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.023627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.023630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.023633Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1092 [2:7556554646874601538:7466]
2025-10-02T09:31:22.023641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.023652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.023657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.023659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.023660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.023669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.023672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.023676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.023710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.023715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.023716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.023717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.023719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.023756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.023761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.023768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.023773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.023784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.023799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554642655170186:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.023805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950137655:8909], now have 1 active actors on pipe
2025-10-02T09:31:22.023808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.023809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.023810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.023818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.023828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.023832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.023835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.023837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.023839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.023840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.023853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.023858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.023849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1092
2025-10-02T09:31:22.023852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1092
2025-10-02T09:31:22.023867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.023884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.023891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.023910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.023920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.023927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.023928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.023933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.023942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.023954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.024081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.024087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.024096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.024155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1093 partition: 0 MaxSeqNo: 36 sessionId: src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0
2025-10-02T09:31:22.024384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b01f642-e1e26b6-81636863-dfa075a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.026901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Write session: try to update token
2025-10-02T09:31:22.026915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.033142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:22.033156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.033162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.033195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:22.033200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:22.033334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:22.033453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:22.033568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:22.033684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:22.033847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:22.033874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:22.039118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId: src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.041417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:22.041953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.041968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.041981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.041983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.041984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.041985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.041990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.041993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.041995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874601532:7466]
2025-10-02T09:31:22.042020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.042021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.042023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.042024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.042025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.042025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.042142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.100258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554646950137675:8404]
2025-10-02T09:31:22.100413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1092, pipe: [1:7556554646950137675:8404]
2025-10-02T09:31:22.162868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:22.163080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:22.163102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950137675:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.163233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:22.163269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.163304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554646950137675:8404]
2025-10-02T09:31:22.163306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:22.163309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:22.163357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1093 reason: error at write: Disconnected sessionId: src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0
2025-10-02T09:31:22.163458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1093 sessionId: src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0 is DEAD
2025-10-02T09:31:22.163609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:22.163620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Write session will restart in 0.007415s
2025-10-02T09:31:22.163638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Write session: Do CDS request
2025-10-02T09:31:22.163647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.172196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.172257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.172267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1094
2025-10-02T09:31:22.172359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.172380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.172386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.172389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.172685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1094 sessionId:  describe result for acl check
2025-10-02T09:31:22.172710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.172714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.172715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.172718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950137820:8920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.172814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.173376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950137820:8920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.175075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950137820:8920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.175521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.175623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.175630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.175636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.175667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.175698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874601747:7480]
2025-10-02T09:31:22.176037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.176224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.176249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.176441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.176474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.176478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.176479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.176479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.176480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.176480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.176481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.176481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.176482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.176482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.176483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.176483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.176486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.176492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.176494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.176496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.176498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.176500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.176502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.176504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.176506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.176508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.176510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.176512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.176515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.176519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.176523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.176526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.176528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.176530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.176532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.176535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.176538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.176540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.176543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.176545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.176548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.176551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.176555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.176558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.176561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.176566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.176569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.176576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.176579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.176583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.176591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.176594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.176626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.177060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950137820:8920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.177068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950137820:8920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.177070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950137820:8920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.177074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.184283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.185693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.185704Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.185706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.185708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.185712Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1093 [2:7556554646874601747:7480]
2025-10-02T09:31:22.185719Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.185729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.185735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.185737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.185738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.185747Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.185753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.185757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.185788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.185794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.185795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.185797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.185798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.185835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.185840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.185846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.185851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.185859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.185875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950137860:8920], now have 1 active actors on pipe
2025-10-02T09:31:22.185881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950137686:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.185884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.185885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.185887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.185895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.185905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.185909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.185910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.185911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.185919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.185922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.185942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.185938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1093
2025-10-02T09:31:22.185954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.185947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1093
2025-10-02T09:31:22.186076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.186099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.186104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.186124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b32571-64c44d64-35c70469-7fa36d91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.186131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.186133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.186134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.186140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.186146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.186161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.186266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.186271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.186280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.186344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1094 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b32571-64c44d64-35c70469-7fa36d91_0
2025-10-02T09:31:22.186560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1382e82a-66c3dc45-cf87cf5b-8777b94_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b32571-64c44d64-35c70469-7fa36d91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.188885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Write session: try to update token
2025-10-02T09:31:22.188896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.196339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.196352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.196353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.196354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.196359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.196363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.196365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874601741:7480]
2025-10-02T09:31:22.196388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.196392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.196393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.196394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.196397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.196401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.196523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.200078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId: src_id|4b32571-64c44d64-35c70469-7fa36d91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.202141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:22.263582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554646950137869:8404]
2025-10-02T09:31:22.263758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1093, pipe: [1:7556554646950137869:8404]
2025-10-02T09:31:22.318809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:22.319153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.319163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.319190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950137869:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.319345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:22.319382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.319410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:22.319441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554646950137869:8404]
2025-10-02T09:31:22.319466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1094 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b32571-64c44d64-35c70469-7fa36d91_0
2025-10-02T09:31:22.319611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1094 sessionId: src_id|4b32571-64c44d64-35c70469-7fa36d91_0 is DEAD
2025-10-02T09:31:22.319747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:22.319757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Write session will restart in 0.008445s
2025-10-02T09:31:22.319780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Write session: Do CDS request
2025-10-02T09:31:22.319786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.329177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.329192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.329239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.329249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1095
2025-10-02T09:31:22.329341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.329361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.329367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.329370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.329697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1095 sessionId:  describe result for acl check
2025-10-02T09:31:22.329724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.329730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.329732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.329736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950138007:8925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.330136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950138007:8925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.331756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950138007:8925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.331832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.332009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.332019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.332028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.332068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.332094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874601923:7483]
2025-10-02T09:31:22.332477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.332668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.332693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.332935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.332977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.332982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.332982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.332983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.332983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.332984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.332984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.332985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.332986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.332986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.332987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.332987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.332991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.332997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.332999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.333002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.333004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.333006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.333008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.333010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.333012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.333014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.333017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.333019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.333023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.333028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.333031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.333034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.333036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.333039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.333041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.333044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.333046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.333049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.333051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.333054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.333056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.333060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.333062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.333065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.333067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.333070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.333072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.333075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.333077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.333080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.333083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.333086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.333102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.334592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950138007:8925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.334601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950138007:8925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.334603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950138007:8925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.334606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.340928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.342508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.342519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.342521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.342523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.342526Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1094 [2:7556554646874601923:7483]
2025-10-02T09:31:22.342534Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.342543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.342547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.342548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.342549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.342559Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.342561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.342566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.342595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.342600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.342601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.342603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.342604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.342642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.342649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.342658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.342671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.342688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.342703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138046:8925], now have 1 active actors on pipe
2025-10-02T09:31:22.342708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950137871:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.342712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.342713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.342714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.342722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.342733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.342734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.342736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.342737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.342744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.342745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.342734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1094
2025-10-02T09:31:22.342740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1094
2025-10-02T09:31:22.342759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.342764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.342771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.342790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.342795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.342809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|355071b6-34b36076-80b906a2-171a9ffa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.342815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.342817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.342818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.342824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.342833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.342842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.342941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.342946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.342953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.343021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1095 partition: 0 MaxSeqNo: 36 sessionId: src_id|355071b6-34b36076-80b906a2-171a9ffa_0
2025-10-02T09:31:22.343255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b32571-64c44d64-35c70469-7fa36d91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|355071b6-34b36076-80b906a2-171a9ffa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.345747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Write session: try to update token
2025-10-02T09:31:22.345760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.353224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:22.353238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.353244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.353269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:22.353275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:22.353411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:22.353528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:22.353641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:22.353776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:22.353945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:22.353972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:22.357588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId: src_id|355071b6-34b36076-80b906a2-171a9ffa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.359653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:22.359792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.359804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.359822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:22.359888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:22.362915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.362926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.362928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.362929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.362935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.362938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.362940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874601917:7483]
2025-10-02T09:31:22.362962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.362967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.362968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.362973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.362977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.362979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.363087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.419739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554646950138053:8404]
2025-10-02T09:31:22.419922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1094, pipe: [1:7556554646950138053:8404]
2025-10-02T09:31:22.478811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:22.484816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.484835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.484962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.485009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.485059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.485108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.485350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.485358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.485411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.485459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.485509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.485558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.485591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.485596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.485646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.485693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.485741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.485786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.485822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.485826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.485876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.485920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.485967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.486013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.486052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.486057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.486106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.486152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.486198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.486248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.486284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.486289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.486337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.486380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.486424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.486469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.486502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.486507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.486552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.486594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.486647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.486693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.486728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.486733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.486779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.486821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.486866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.486918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.486952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.486956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.487001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.487047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.487089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.487133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.487285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.487291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.487335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:22.487378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:22.487420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:22.487463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:22.487494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:22.487498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:22.487529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138053:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.487727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.487755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554646950138053:8404]
2025-10-02T09:31:22.487769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:22.487771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:22.487790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1095 reason: error at write: Disconnected sessionId: src_id|355071b6-34b36076-80b906a2-171a9ffa_0
2025-10-02T09:31:22.487811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:22.487928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1095 sessionId: src_id|355071b6-34b36076-80b906a2-171a9ffa_0 is DEAD
2025-10-02T09:31:22.488030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:22.488035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Write session will restart in 0.008695s
2025-10-02T09:31:22.488048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Write session: Do CDS request
2025-10-02T09:31:22.488052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.497745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.498223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.498245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.498253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1096
2025-10-02T09:31:22.498379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.498400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.498406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.498409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.498782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1096 sessionId:  describe result for acl check
2025-10-02T09:31:22.498806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.498811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.498812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.498815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950138193:8929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.499245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950138193:8929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.500405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.500513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.500519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.500525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.500555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.500579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874602098:7485]
2025-10-02T09:31:22.500936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.501125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.501128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950138193:8929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.501157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.501353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.501384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.501388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.501388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.501389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.501389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.501390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.501390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.501391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.501391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.501392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.501392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.501393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.501396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.501402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.501404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.501406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.501408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.501410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.501412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.501414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.501416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.501418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.501420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.501422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.501427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.501430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.501434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.501437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.501439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.501442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.501444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.501446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.501448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.501451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.501453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.501456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.501458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.501460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.501463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.501465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.501468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.501473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.501476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.501478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.501480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.501483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.501485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.501488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.501505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.506486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950138193:8929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.506495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950138193:8929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.506498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950138193:8929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.506507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.509241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.510723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.510735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.510736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.510739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.510742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1095 [2:7556554646874602098:7485]
2025-10-02T09:31:22.510750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.510760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.510762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.510764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.510765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.510775Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.510778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.510783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.510814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.510816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.510817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.510819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.510820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.510874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.510880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.510887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.510906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.510914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.510927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138055:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.510931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138232:8929], now have 1 active actors on pipe
2025-10-02T09:31:22.510934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.510936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.510937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.510946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.510954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.510961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.510961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.510963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.510964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.510965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.510978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.510984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.510984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.510978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1095
2025-10-02T09:31:22.510987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1095
2025-10-02T09:31:22.511155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.511162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.511177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b55907-9c30552-b9bc212-5467e5f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.511182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.511185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.511187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.511192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.511198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.511208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.511333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.511338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.511348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.511413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1096 partition: 0 MaxSeqNo: 36 sessionId: src_id|54b55907-9c30552-b9bc212-5467e5f0_0
2025-10-02T09:31:22.511676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355071b6-34b36076-80b906a2-171a9ffa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54b55907-9c30552-b9bc212-5467e5f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.514129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Write session: try to update token
2025-10-02T09:31:22.514147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.521288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.521302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.521303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.521305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.521311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.521314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.521316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874602092:7485]
2025-10-02T09:31:22.521341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.521347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.521348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.521349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.521353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.521355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.521457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.525765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId: src_id|54b55907-9c30552-b9bc212-5467e5f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.527801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:22.587680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554646950138239:8404]
2025-10-02T09:31:22.587882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1095, pipe: [1:7556554646950138239:8404]
2025-10-02T09:31:22.640724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:22.641131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.641141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.641166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138239:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.641316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:22.641400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.641433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:22.641437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554646950138239:8404]
2025-10-02T09:31:22.641496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1096 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54b55907-9c30552-b9bc212-5467e5f0_0
2025-10-02T09:31:22.641776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:22.641784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Write session will restart in 0.005255s
2025-10-02T09:31:22.641797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Write session: Do CDS request
2025-10-02T09:31:22.641801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.641624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1096 sessionId: src_id|54b55907-9c30552-b9bc212-5467e5f0_0 is DEAD
2025-10-02T09:31:22.648197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.648282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.648291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1097
2025-10-02T09:31:22.648382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.648401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.648407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.648410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.648683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1097 sessionId:  describe result for acl check
2025-10-02T09:31:22.648708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.648714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.648715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.648719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950138315:8933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.649087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950138315:8933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.650764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950138315:8933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.651200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.653381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.653492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.653500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.653509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.653548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.653573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874602274:7487]
2025-10-02T09:31:22.653625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950138315:8933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.653633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950138315:8933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.653635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950138315:8933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.653639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.653943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.654111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.654135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.654321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.654352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.654356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.654356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.654357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.654358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.654358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.654359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.654359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.654360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.654360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.654361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.654361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.654364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.654371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.654373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.654375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.654377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.654379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.654381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.654383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.654385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.654387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.654389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.654391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.654394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.654398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.654402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.654405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.654408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.654410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.654412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.654415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.654417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.654420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.654422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.654424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.654430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.654433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.654435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.654438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.654440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.654442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.654445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.654447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.654450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.654452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.654454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.654457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.654475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.662311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.663727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.663740Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.663741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.663743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.663747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1096 [2:7556554646874602274:7487]
2025-10-02T09:31:22.663753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.663763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.663764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.663766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.663767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.663777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.663779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.663784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.663815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.663820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.663821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.663823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.663825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.663865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.663870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.663876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.663882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.663892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.663905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138241:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.663911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138414:8933], now have 1 active actors on pipe
2025-10-02T09:31:22.663915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.663916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.663917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.663924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.663931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.663936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.663939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.663940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.663940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.663942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.663957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.663960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.663971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.663982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.663985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.663958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1096
2025-10-02T09:31:22.664007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.664017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.664021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.664023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.664017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1096
2025-10-02T09:31:22.664030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.664043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.664058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.664156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.664161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.664169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.664231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1097 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0
2025-10-02T09:31:22.664495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b55907-9c30552-b9bc212-5467e5f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.666850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Write session: try to update token
2025-10-02T09:31:22.666863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.673731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.673744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.673745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.673747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.673752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.673755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.673757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874602268:7487]
2025-10-02T09:31:22.673781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.673784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.673786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.673785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.673789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.673791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.673894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.678139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId: src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.680137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:22.741776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554646950138437:8404]
2025-10-02T09:31:22.741960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1096, pipe: [1:7556554646950138437:8404]
2025-10-02T09:31:22.787639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:22.788032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.788041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.788067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138437:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.788274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:22.788248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554646950138437:8404]
2025-10-02T09:31:22.788266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.788286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:22.788289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:22.788339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1097 reason: error at write: Disconnected sessionId: src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0
2025-10-02T09:31:22.788473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1097 sessionId: src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0 is DEAD
2025-10-02T09:31:22.788625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:22.788635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Write session will restart in 0.009133s
2025-10-02T09:31:22.788655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Write session: Do CDS request
2025-10-02T09:31:22.788660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.798934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.799099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.799219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.799226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1098
2025-10-02T09:31:22.799311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.799335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.799342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.799345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.799602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1098 sessionId:  describe result for acl check
2025-10-02T09:31:22.799627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.799631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.799632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.799635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950138583:8939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.799952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950138583:8939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.801590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.801691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.801698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.801704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.801730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.801755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874602463:7490]
2025-10-02T09:31:22.801734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950138583:8939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.802099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.802310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.802334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.802519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.802679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.802684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.802685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.802685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.802686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.802686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.802687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.802687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.802688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.802688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.802689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.802690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.802693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.802699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.802702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.802704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.802706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.802708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.802710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.802712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.802714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.802716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.802718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.802720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.802725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.802729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.802732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.802735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.802737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.802740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.802742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.802744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.802746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.802749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.802751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.802753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.802756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.802759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.802762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.802764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.802766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.802769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.802771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.802773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.802776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.802778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.802780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.802782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.802798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.806677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950138583:8939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.806686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950138583:8939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.806688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950138583:8939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.806692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.810306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.811774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.811787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.811789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.811791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.811794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1097 [2:7556554646874602463:7490]
2025-10-02T09:31:22.811801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.811812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.811813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.811814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.811815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.811825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.811827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.811832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.811862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.811869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.811870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.811872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.811873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.811908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.811913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.811920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.811925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.811936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.811950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138442:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.811957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.811958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.811959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.811964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.811969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138622:8939], now have 1 active actors on pipe
2025-10-02T09:31:22.811975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.811977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.811977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.811979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.811984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.811988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.812000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.812008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.812010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.812006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1097
2025-10-02T09:31:22.812036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.812044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.812020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1097
2025-10-02T09:31:22.812063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.812072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.812076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.812077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.812082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.812090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.812100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.812248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.812252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.812259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.812321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1098 partition: 0 MaxSeqNo: 36 sessionId: src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0
2025-10-02T09:31:22.812535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0a1f8-d607c8b3-63f0e85b-571cbdff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.814864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Write session: try to update token
2025-10-02T09:31:22.814876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.821205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.821220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.821222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.821223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.821227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.821229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.821231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874602457:7490]
2025-10-02T09:31:22.821253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.821256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.821257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.821257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.821260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.821263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.821359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.826163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId: src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.828160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:22.888233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554646950138632:8404]
2025-10-02T09:31:22.888441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1097, pipe: [1:7556554646950138632:8404]
2025-10-02T09:31:22.938157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:22.938488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.938499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.938525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138632:8404], now have 1 active actors on pipe
2025-10-02T09:31:22.938645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:22.938683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:22.938692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:22.938707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554646950138632:8404]
2025-10-02T09:31:22.938725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:22.938739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1098 reason: error at write: Disconnected sessionId: src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0
2025-10-02T09:31:22.938875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1098 sessionId: src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0 is DEAD
2025-10-02T09:31:22.939022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:22.939033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Write session will restart in 0.009465s
2025-10-02T09:31:22.939056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Write session: Do CDS request
2025-10-02T09:31:22.939062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:22.947575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:22.949079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.949161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:22.949170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1099
2025-10-02T09:31:22.949246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:22.949266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:22.949271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:22.949273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:22.949584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1099 sessionId:  describe result for acl check
2025-10-02T09:31:22.949608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:22.949614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:22.949615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:22.949618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554646950138774:8943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:22.949957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:22.949974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554646950138774:8943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:22.950068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:22.950075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:22.950081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:22.950221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:22.950248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554646874602642:7493]
2025-10-02T09:31:22.950611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:22.950868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:22.950905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:22.951113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:22.951146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.951150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.951151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.951151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.951152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.951152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.951153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.951153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.951154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.951154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.951155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.951156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.951159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.951165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.951168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.951170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.951172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.951174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.951176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.951178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.951180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.951184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.951185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.951188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.951193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.951197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:22.951200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.951203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:22.951205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.951207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:22.951209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.951212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:22.951215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.951217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:22.951219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.951222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:22.951225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.951228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:22.951230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.951233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:22.951236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.951242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:22.951244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.951247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.951249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.951253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.951257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.951260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.951280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:22.951823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554646950138774:8943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:22.956299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554646950138774:8943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:22.956308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554646950138774:8943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:22.956310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554646950138774:8943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:22.956314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:22.959324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:22.960730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:22.960741Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:22.960743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:22.960745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:22.960750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1098 [2:7556554646874602642:7493]
2025-10-02T09:31:22.960758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:22.960768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:22.960773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.960775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.960776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.960786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:22.960789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:22.960794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:22.960856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.960861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.960862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.960865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:22.960866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:22.960905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:22.960910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.960916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:22.960922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:22.960930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:22.960945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138633:2446], now have 1 active actors on pipe
2025-10-02T09:31:22.960951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554646950138813:8943], now have 1 active actors on pipe
2025-10-02T09:31:22.960956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.960957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.960958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.960965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:22.960976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:22.960982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:22.960985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:22.960987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:22.960987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:22.960988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:22.960991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1098
2025-10-02T09:31:22.961003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.961008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:22.960994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1098
2025-10-02T09:31:22.961011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:22.961030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.961035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.961051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:22.961058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:22.961061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:22.961062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:22.961067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:22.961075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:22.961244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.961343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:22.961348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:22.961356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:22.961406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1099 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0
2025-10-02T09:31:22.961664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1254ee4e-6cb75ee8-a98a2b2-fd770405_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:22.964015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Write session: try to update token
2025-10-02T09:31:22.964028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:22.970728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:22.970742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:22.970743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:22.970744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:22.970751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.970756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.970758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554646874602637:7493]
2025-10-02T09:31:22.970787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:22.970789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:22.970792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:22.970792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:22.970794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:22.970794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:22.970925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:22.975739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId: src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:22.977743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.038750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554651245106116:8404]
2025-10-02T09:31:23.038902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1098, pipe: [1:7556554651245106116:8404]
2025-10-02T09:31:23.085193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.085540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.085553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.085592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106116:8404], now have 1 active actors on pipe
2025-10-02T09:31:23.085764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.085781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245106116:8404]
2025-10-02T09:31:23.085788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.085805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:23.085858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1099 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0
2025-10-02T09:31:23.085992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1099 sessionId: src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0 is DEAD
2025-10-02T09:31:23.086161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:23.086172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Write session will restart in 0.007282s
2025-10-02T09:31:23.086191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Write session: Do CDS request
2025-10-02T09:31:23.086197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.094142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.094230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.094239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1100
2025-10-02T09:31:23.094326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.094345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.094351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.094353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.094655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1100 sessionId:  describe result for acl check
2025-10-02T09:31:23.094680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.094686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.094687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.094691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245106256:8947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.095170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245106256:8947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.095257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.096637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245106256:8947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.097469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.097653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.097661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.097671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.097713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.097738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169570118:7495]
2025-10-02T09:31:23.098084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.098292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.098317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.098520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.098545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245106256:8947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.098553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245106256:8947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.098553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.098555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245106256:8947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.098557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.098559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:23.098558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.098558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.098559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.098559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.098560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.098560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.098561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.098561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.098562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.098562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.098565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.098571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.098573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.098575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.098577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.098579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.098581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.098583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.098585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.098588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.098589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.098591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.098595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.098599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.098602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.098605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.098607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.098610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.098612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.098615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.098617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.098620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.098623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.098625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.098628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.098631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.098633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.098636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.098638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.098642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.098645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.098647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.098649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.098652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.098654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.098656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.098678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.106596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:23.108108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:23.108119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:23.108121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:23.108123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:23.108127Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1099 [2:7556554651169570118:7495]
2025-10-02T09:31:23.108135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:23.108144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:23.108150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.108152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.108153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.108161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:23.108167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:23.108171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:23.108203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.108207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.108208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.108209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:23.108211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:23.108248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:23.108253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.108260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.108268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.108277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:23.108291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106117:2446], now have 1 active actors on pipe
2025-10-02T09:31:23.108303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106293:8947], now have 1 active actors on pipe
2025-10-02T09:31:23.108308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.108310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.108311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.108319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:23.108329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:23.108331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:23.108333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:23.108334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:23.108353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:23.108354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:23.108340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1099
2025-10-02T09:31:23.108376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1099
2025-10-02T09:31:23.108377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.108385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:23.108392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:23.108412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.108416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.108429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:23.108436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.108437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.108438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.108444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.108451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:23.108462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.108542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.108546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.108553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.108604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1100 partition: 0 MaxSeqNo: 36 sessionId: src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0
2025-10-02T09:31:23.108859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ad6ba21-cda5ba92-34e36f89-53ee2411_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:23.111208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Write session: try to update token
2025-10-02T09:31:23.111221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:23.118338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:23.118353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:23.118357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:23.118358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:23.118365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.118368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.118371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169570112:7495]
2025-10-02T09:31:23.118401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:23.118400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:23.118405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:23.118407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:23.118410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.118412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:23.118530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:23.122722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId: src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:23.124889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.185678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554651245106328:8404]
2025-10-02T09:31:23.185838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1099, pipe: [1:7556554651245106328:8404]
2025-10-02T09:31:23.234807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.235054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.235062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.235088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106328:8404], now have 1 active actors on pipe
2025-10-02T09:31:23.235244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.235238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.235265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:23.235269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:23.235270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245106328:8404]
2025-10-02T09:31:23.235327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1100 reason: error at write: Disconnected sessionId: src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0
2025-10-02T09:31:23.235487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1100 sessionId: src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0 is DEAD
2025-10-02T09:31:23.235581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:23.235589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Write session will restart in 0.005726s
2025-10-02T09:31:23.235607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Write session: Do CDS request
2025-10-02T09:31:23.235624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.242100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.242164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.242171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1101
2025-10-02T09:31:23.242457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.242479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.242489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.242492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.242918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1101 sessionId:  describe result for acl check
2025-10-02T09:31:23.242945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.242950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.242952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.242956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245106431:8959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.243420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245106431:8959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.244869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.245152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245106431:8959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.247439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.247556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.247565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.247573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.247605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.247630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169570337:7510]
2025-10-02T09:31:23.247633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245106431:8959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.247641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245106431:8959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.247643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245106431:8959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.247647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:23.247979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.248174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.248217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.248430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.248464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.248468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.248469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.248469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.248470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.248472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.248473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.248474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.248475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.248475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.248476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.248476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.248479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.248486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.248488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.248490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.248492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.248494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.248496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.248498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.248500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.248502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.248504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.248507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.248510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.248515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.248518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.248521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.248523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.248526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.248539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.248545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.248547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.248550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.248556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.248559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.248563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.248569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.248571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.248574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.248576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.248579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.248581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.248584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.248589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.248592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.248594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.248596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.248618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.256374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:23.257957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:23.257970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:23.257971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:23.257973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:23.257976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1100 [2:7556554651169570337:7510]
2025-10-02T09:31:23.257984Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:23.257993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:23.257998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.258000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.258001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.258010Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:23.258016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:23.258020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:23.258052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.258057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.258058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.258059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:23.258061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:23.258097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:23.258103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.258109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.258115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.258126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:23.258141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106329:2446], now have 1 active actors on pipe
2025-10-02T09:31:23.258146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106506:8959], now have 1 active actors on pipe
2025-10-02T09:31:23.258150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.258151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.258152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.258160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:23.258170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:23.258176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:23.258179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:23.258180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:23.258181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:23.258183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:23.258186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1100
2025-10-02T09:31:23.258199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.258187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1100
2025-10-02T09:31:23.258205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:23.258206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:23.258221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.258226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.258244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:23.258250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.258253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.258253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.258258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.258266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:23.258282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.258396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.258402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.258410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.258460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1101 partition: 0 MaxSeqNo: 36 sessionId: src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0
2025-10-02T09:31:23.258701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df83f89a-e16916c8-d013a4e1-3a0941dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:23.261029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Write session: try to update token
2025-10-02T09:31:23.261042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:23.267642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:23.267655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:23.267656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:23.267658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:23.267663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.267666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.267668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169570331:7510]
2025-10-02T09:31:23.267690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:23.267693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.267695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:23.267698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:23.267703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:23.267705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:23.267812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:23.272384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId: src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:23.274346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.335223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554651245106518:8404]
2025-10-02T09:31:23.335437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1100, pipe: [1:7556554651245106518:8404]
2025-10-02T09:31:23.387815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.388232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.388246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.388276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106518:8404], now have 1 active actors on pipe
2025-10-02T09:31:23.388448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.388445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245106518:8404]
2025-10-02T09:31:23.388455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.388468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:23.388470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:23.388483Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:31:23.388514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1101 reason: error at write: Disconnected sessionId: src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0
2025-10-02T09:31:23.388564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1101 sessionId: src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0 is DEAD
2025-10-02T09:31:23.388643Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 11 consumer shared/user session shared/user_1_11_5934655325634129551_v1 is DEAD
2025-10-02T09:31:23.388733Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:31:23.388758Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554582525615039:8400] disconnected; active server actors: 1
2025-10-02T09:31:23.388769Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:23.388764Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554582525615039:8400] client user disconnected session shared/user_1_11_5934655325634129551_v1
2025-10-02T09:31:23.388772Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:23.388780Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.009775s
2025-10-02T09:31:23.388871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:23.388883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Write session will restart in 0.009589s
2025-10-02T09:31:23.388903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Write session: Do CDS request
2025-10-02T09:31:23.388908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.397708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.399041Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:31:23.399106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.399207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.399218Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:31:23.399221Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 12
2025-10-02T09:31:23.399228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1102
2025-10-02T09:31:23.399305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.399327Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:23.399329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.399331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.399334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.399373Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:23.399430Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 auth for : user
2025-10-02T09:31:23.399478Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 Handle describe topics response
2025-10-02T09:31:23.399493Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 auth is DEAD
2025-10-02T09:31:23.399505Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:31:23.399567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1102 sessionId:  describe result for acl check
2025-10-02T09:31:23.399585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.399590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.399590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.399593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245106665:8964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.399681Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:31:23.399730Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_12_17871095051901243003_v1
2025-10-02T09:31:23.399736Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554651245106666:8963] connected; active server actors: 1
2025-10-02T09:31:23.399744Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554651245106666:8963] session shared/user_1_12_17871095051901243003_v1
2025-10-02T09:31:23.399749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:31:23.399760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:31:23.399766Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_12_17871095051901243003_v1" (Sender=[1:7556554651245106660:8963], Pipe=[1:7556554651245106666:8963], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:23.399768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:31:23.399774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:31:23.399782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_12_17871095051901243003_v1" (Sender=[1:7556554651245106660:8963], Pipe=[1:7556554651245106666:8963], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:23.399787Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_12_17871095051901243003_v1" sender [1:7556554651245106660:8963] lock partition 0 for ReadingSession "shared/user_1_12_17871095051901243003_v1" (Sender=[1:7556554651245106660:8963], Pipe=[1:7556554651245106666:8963], Partitions=[], ActiveFamilyCount=1) generation 1 step 12
2025-10-02T09:31:23.399795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:31:23.399801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T09:31:23.399921Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 12 Session: "shared/user_1_12_17871095051901243003_v1" ClientId: "user" PipeClient { RawX1: 7556554651245106666 RawX2: 4503603922346755 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:31:23.399935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245106665:8964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.399940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:31:23.399955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.400092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.400100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.400105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.400136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.400161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169570517:7512]
2025-10-02T09:31:23.400503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.400665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.400697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.400973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.401036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.401042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.401043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.401044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.401045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.401046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.401047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.401048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.401049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.401051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.401052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.401053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.401057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.401067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.401071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.401079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.401086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.401090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.401098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.401106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.401109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.401118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.401126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.401130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.401131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245106665:8964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.401139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.401150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.401159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.401168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.401178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.401187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.401196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.401205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.401214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.401223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.401231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.401240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.401248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.401256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.401264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.401271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.401279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.401284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.401292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.401301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.401310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.401319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.401326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.401336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.401373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.406343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245106665:8964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.406352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245106665:8964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.406354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245106665:8964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.406359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:23.409054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:23.410698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:23.410710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:23.410712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:23.410714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:23.410718Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1101 [2:7556554651169570517:7512]
2025-10-02T09:31:23.410725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:23.410735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:23.410737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.410739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.410740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.410749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:23.410755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:23.410759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:23.410790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.410795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.410796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.410798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:23.410800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:23.410839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:23.410843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.410850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.410855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.410866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:23.410881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106519:2446], now have 1 active actors on pipe
2025-10-02T09:31:23.410896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106708:8964], now have 1 active actors on pipe
2025-10-02T09:31:23.410899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106670:8968], now have 1 active actors on pipe
2025-10-02T09:31:23.410903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.410905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.410906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.410916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:23.410926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:23.410916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1101
2025-10-02T09:31:23.410931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:23.410933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:23.410935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:23.410928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1101
2025-10-02T09:31:23.410938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:23.410943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1101, pipe: [1:7556554651245106670:8968]
2025-10-02T09:31:23.410939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:23.410961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.410963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.410970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.410978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:23.410987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:23.410995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.410996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.411000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_12_17871095051901243003_v1 on pipe: [1:7556554651245106670:8968]
2025-10-02T09:31:23.411019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:23.411026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.411027Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_12_17871095051901243003_v1:1 with generation 1101
2025-10-02T09:31:23.411028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.411030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.411035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.411043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:23.411057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.411063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.411063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.411071Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_12_17871095051901243003_v1
2025-10-02T09:31:23.411076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.411089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.411106Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:31:23.411176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.411181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.411189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.411238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1102 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0
2025-10-02T09:31:23.411433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93704a2-2dbf5238-63e3deb5-c23fe0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:23.413667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Write session: try to update token
2025-10-02T09:31:23.413680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:23.414507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:31:23.414526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:31:23.414532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.414533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.414534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.414537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:31:23.414542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:31:23.414619Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397483410 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:31:23.414631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:31:23.414654Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 sending to client partition status
2025-10-02T09:31:23.420605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:23.420617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:23.420619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:23.420619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:23.420628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.420631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.420633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169570511:7512]
2025-10-02T09:31:23.420655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:23.420658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.420657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:23.420659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:23.420662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:23.420664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:23.420776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:23.424203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId: src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:23.426163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.537148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.537544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.537554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.537691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_12_17871095051901243003_v1
2025-10-02T09:31:23.537704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.537723Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_12_17871095051901243003_v1
2025-10-02T09:31:23.537730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:23.537731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.537740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:23.537771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245106670:8968]
2025-10-02T09:31:23.537785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1102 reason: error at write: Disconnected sessionId: src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0
2025-10-02T09:31:23.537924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1102 sessionId: src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0 is DEAD
2025-10-02T09:31:23.538060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:23.538068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Write session will restart in 0.006964s
2025-10-02T09:31:23.538082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Write session: Do CDS request
2025-10-02T09:31:23.538086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.546142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.546271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.546279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1103
2025-10-02T09:31:23.546367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.546357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.546387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.546393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.546395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.546662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1103 sessionId:  describe result for acl check
2025-10-02T09:31:23.546686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.546690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.546691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.546696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245106861:8971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.547046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245106861:8971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.548461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.548555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.548562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.548568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.548593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.548615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169570701:7514]
2025-10-02T09:31:23.548666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245106861:8971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.548976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.549138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.549161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.549338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.549366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.549369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.549370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.549370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.549371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.549372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.549373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.549373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.549373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.549374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.549374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.549375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.549378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.549383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.549385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.549387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.549389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.549391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.549393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.549395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.549397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.549399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.549401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.549403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.549406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.549410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.549413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.549416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.549418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.549421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.549423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.549425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.549427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.549430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.549432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.549435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.549437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.549440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.549442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.549444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.549447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.549449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.549453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.549459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.549461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.549465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.549470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.549473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.549490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.553487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245106861:8971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.553496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245106861:8971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.553498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245106861:8971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.553503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:23.557228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:23.558835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:23.558848Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:23.558849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:23.558851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:23.558854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1102 [2:7556554651169570701:7514]
2025-10-02T09:31:23.558861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:23.558871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:23.558872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.558874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.558875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.558884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:23.558900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:23.558908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:23.558940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.558945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.558946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.558948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:23.558949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:23.558985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:23.558990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.558997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.559006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.559022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:23.559041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106717:2446], now have 1 active actors on pipe
2025-10-02T09:31:23.559048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106900:8971], now have 1 active actors on pipe
2025-10-02T09:31:23.559052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.559055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.559057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.559067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:23.559079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:23.559080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:23.559086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:23.559087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:23.559080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1102
2025-10-02T09:31:23.559091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:23.559093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:23.559099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1102
2025-10-02T09:31:23.559112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.559115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:23.559115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:23.559130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.559136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.559161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:23.559169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.559171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.559175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.559180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.559186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:23.559197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.559292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.559300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.559309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.559355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1103 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0
2025-10-02T09:31:23.559585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5fd6885-715feb2a-6c945169-e4dbc135_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:23.561852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Write session: try to update token
2025-10-02T09:31:23.561865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:23.568746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:23.568765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:23.568768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:23.568770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:23.568778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.568784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.568788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169570696:7514]
2025-10-02T09:31:23.568830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:23.568839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:23.568840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:23.568842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:23.568844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.568846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:23.569043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:23.572917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId: src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:23.574830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.637811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554651245106908:8968]
2025-10-02T09:31:23.638022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1102, pipe: [1:7556554651245106908:8968]
2025-10-02T09:31:23.684994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.685187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.685198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.685229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106908:8968], now have 1 active actors on pipe
2025-10-02T09:31:23.685384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:23.685403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.685395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:23.685444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245106908:8968]
2025-10-02T09:31:23.685451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1103 reason: error at write: Disconnected sessionId: src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0
2025-10-02T09:31:23.685470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.685575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1103 sessionId: src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0 is DEAD
2025-10-02T09:31:23.685731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:23.685741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Write session will restart in 0.005247s
2025-10-02T09:31:23.685761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Write session: Do CDS request
2025-10-02T09:31:23.685768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.692135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.692215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.692225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1104
2025-10-02T09:31:23.692329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.692348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.692354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.692357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.692669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1104 sessionId:  describe result for acl check
2025-10-02T09:31:23.692688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.692692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.692693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.692696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245106998:8975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.693053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245106998:8975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.694633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245106998:8975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.697552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.697705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245106998:8975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.697714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245106998:8975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.697715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245106998:8975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.697719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:23.697812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.697908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.697914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.697920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.697946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.697969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169570897:7517]
2025-10-02T09:31:23.698317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.698480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.698503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.698678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.698705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.698709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.698710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.698710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.698711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.698711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.698712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.698712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.698713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.698713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.698714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.698714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.698717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.698723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.698725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.698727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.698729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.698731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.698733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.698735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.698737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.698739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.698741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.698743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.698747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.698750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.698753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.698756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.698758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.698761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.698763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.698766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.698768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.698771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.698773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.698775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.698777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.698780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.698782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.698785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.698787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.698793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.698795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.698799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.698805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.698813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.698818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.698821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.698838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.706401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:23.707996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:23.708006Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:23.708008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:23.708009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:23.708012Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1103 [2:7556554651169570897:7517]
2025-10-02T09:31:23.708019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:23.708029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:23.708034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.708035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.708036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.708045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:23.708050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:23.708055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:23.708090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.708095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.708096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.708098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:23.708099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:23.708135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:23.708139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.708146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.708154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.708162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:23.708177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107088:8975], now have 1 active actors on pipe
2025-10-02T09:31:23.708182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245106909:2446], now have 1 active actors on pipe
2025-10-02T09:31:23.708186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.708187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.708188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.708195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:23.708206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:23.708210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:23.708212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:23.708214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:23.708218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:23.708220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:23.708212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1103
2025-10-02T09:31:23.708237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.708244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:23.708245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:23.708235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1103
2025-10-02T09:31:23.708257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.708264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.708291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:23.708297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.708299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.708301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.708305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.708310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:23.708322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.708422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.708428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.708437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.708493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1104 partition: 0 MaxSeqNo: 36 sessionId: src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0
2025-10-02T09:31:23.708695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae62406-a4fea1c9-b33ef71b-2ecf593_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:23.710828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Write session: try to update token
2025-10-02T09:31:23.710837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:23.717607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:23.717622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:23.717623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:23.717624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:23.717629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.717632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.717634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169570891:7517]
2025-10-02T09:31:23.717657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:23.717664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.717666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:23.717667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:23.717671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:23.717674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:23.717779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:23.720999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId: src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:23.722899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.785748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554651245107116:8968]
2025-10-02T09:31:23.785970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1103, pipe: [1:7556554651245107116:8968]
2025-10-02T09:31:23.832414Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.832646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.832655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.832681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107116:8968], now have 1 active actors on pipe
2025-10-02T09:31:23.832839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.832899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.832914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:23.832948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245107116:8968]
2025-10-02T09:31:23.832979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1104 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0
2025-10-02T09:31:23.833137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1104 sessionId: src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0 is DEAD
2025-10-02T09:31:23.833298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:23.833310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Write session will restart in 0.009084s
2025-10-02T09:31:23.833331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Write session: Do CDS request
2025-10-02T09:31:23.833337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.843245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.843291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.843302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1105
2025-10-02T09:31:23.843400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.843420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.843423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.843425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.843720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1105 sessionId:  describe result for acl check
2025-10-02T09:31:23.843740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.843741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.843742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.843745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245107264:8981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.844087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245107264:8981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.844272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.844518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.844633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.844640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.844647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.844678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.844701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169571079:7519]
2025-10-02T09:31:23.845065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.845222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.845248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.845439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.845472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.845476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.845477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.845477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.845478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.845478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.845479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.845479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.845480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.845480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.845481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.845481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.845484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.845491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.845493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.845495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.845497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.845498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.845500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.845502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.845504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.845506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.845508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.845510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.845514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.845518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.845521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.845524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.845526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.845529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.845531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.845534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.845536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.845538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.845540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.845543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.845545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.845548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.845550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.845552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.845555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.845557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.845563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.845566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.845568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.845571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.845574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.845577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.845554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245107264:8981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.845600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.850368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245107264:8981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.850379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245107264:8981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.850381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245107264:8981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.850386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:23.853087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:23.854707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:23.854718Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:23.854719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:23.854721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:23.854725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1104 [2:7556554651169571079:7519]
2025-10-02T09:31:23.854732Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:23.854742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:23.854748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.854749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.854751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.854759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:23.854765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:23.854770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:23.854806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.854811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.854812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.854814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:23.854816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:23.854855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:23.854861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.854871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.854893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.854906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:23.854922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107119:2446], now have 1 active actors on pipe
2025-10-02T09:31:23.854928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107304:8981], now have 1 active actors on pipe
2025-10-02T09:31:23.854932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.854934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.854935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.854943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:23.854955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:23.854958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:23.854960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:23.854960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:23.854965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:23.854943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1104
2025-10-02T09:31:23.854967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:23.854943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1104
2025-10-02T09:31:23.854994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.854999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.855006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.855011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:23.855025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:23.855031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d237565-ab11f21-8800083f-ab55d2dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:23.855035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:23.855037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:23.855039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:23.855045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:23.855053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:23.855068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.855163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.855168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.855175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:23.855217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1105 partition: 0 MaxSeqNo: 36 sessionId: src_id|d237565-ab11f21-8800083f-ab55d2dc_0
2025-10-02T09:31:23.855461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90db09c5-e1de58e6-19732ac5-695ef70c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d237565-ab11f21-8800083f-ab55d2dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:23.857845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Write session: try to update token
2025-10-02T09:31:23.857858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:23.864926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:23.864939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:23.864941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:23.864942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:23.864947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.864950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.864952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169571074:7519]
2025-10-02T09:31:23.864976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:23.864981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.864982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:23.864988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:23.864994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:23.864997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:23.865111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:23.869304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId: src_id|d237565-ab11f21-8800083f-ab55d2dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:23.871240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:23.933215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554651245107314:8968]
2025-10-02T09:31:23.933384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1104, pipe: [1:7556554651245107314:8968]
2025-10-02T09:31:23.980216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:23.980661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:23.980671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:23.980698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107314:8968], now have 1 active actors on pipe
2025-10-02T09:31:23.980858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:23.980874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:23.980921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:23.980989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1105 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d237565-ab11f21-8800083f-ab55d2dc_0
2025-10-02T09:31:23.981009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554651245107314:8968]
2025-10-02T09:31:23.981134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1105 sessionId: src_id|d237565-ab11f21-8800083f-ab55d2dc_0 is DEAD
2025-10-02T09:31:23.981261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:23.981266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Write session will restart in 0.008698s
2025-10-02T09:31:23.981284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Write session: Do CDS request
2025-10-02T09:31:23.981287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:23.990464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:23.991162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.991235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:23.991245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1106
2025-10-02T09:31:23.991324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:23.991343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:23.991349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:23.991352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:23.991623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1106 sessionId:  describe result for acl check
2025-10-02T09:31:23.991646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:23.991650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:23.991651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:23.991654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554651245107463:8985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:23.992001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554651245107463:8985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:23.992648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:23.992751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:23.992759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:23.992764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:23.992791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:23.992830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554651169571267:7522]
2025-10-02T09:31:23.993178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:23.993353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:23.993380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:23.993457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554651245107463:8985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:23.993558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:23.993587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.993591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.993592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.993592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.993593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.993593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.993594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.993594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.993595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.993595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.993596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.993596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.993599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.993605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.993607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.993609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.993611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.993613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.993615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.993617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.993619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.993621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.993623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.993625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.993628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.993632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:23.993635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.993638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:23.993641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.993644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:23.993647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.993649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:23.993651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.993654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:23.993657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.993659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:23.993662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.993664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:23.993666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.993672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:23.993674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.993677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:23.993679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.993682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:23.993684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.993687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:23.993692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.993695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:23.993710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:23.997514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554651245107463:8985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:23.997523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554651245107463:8985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:23.997525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554651245107463:8985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:23.997528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.001140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.002718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.002731Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.002733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.002736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.002740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1105 [2:7556554651169571267:7522]
2025-10-02T09:31:24.002751Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.002768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.002773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.002775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.002776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.002784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.002787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.002794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.002826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.002831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.002833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.002835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.002837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.002879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.002884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.002900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.002909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.002920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.002934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107502:8985], now have 1 active actors on pipe
2025-10-02T09:31:24.002939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554651245107316:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.002943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.002944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.002945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.002952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.002962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.002967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.002970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.002971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.002972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.002973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.002962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1105
2025-10-02T09:31:24.002965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1105
2025-10-02T09:31:24.002986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.002991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.002993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.003000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.003005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.003030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.003036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.003038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.003039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.003044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.003052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.003063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.003144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.003150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.003158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.003204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1106 partition: 0 MaxSeqNo: 36 sessionId: src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0
2025-10-02T09:31:24.003418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237565-ab11f21-8800083f-ab55d2dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.005710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Write session: try to update token
2025-10-02T09:31:24.005722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.012244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.012259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.012261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.012263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.012269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.012272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.012276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554651169571261:7522]
2025-10-02T09:31:24.012299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.012302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.012303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.012305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.012308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.012309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.012423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.016634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId: src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.018542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.081197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540074805:8968]
2025-10-02T09:31:24.081371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1105, pipe: [1:7556554655540074805:8968]
2025-10-02T09:31:24.126851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:24.127282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.127297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.127326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540074805:8968], now have 1 active actors on pipe
2025-10-02T09:31:24.127512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:24.127520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:24.127522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:24.127551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540074805:8968]
2025-10-02T09:31:24.127566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1106 reason: error at write: Disconnected sessionId: src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0
2025-10-02T09:31:24.127697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1106 sessionId: src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0 is DEAD
2025-10-02T09:31:24.127818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:24.127871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:24.127881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Write session will restart in 0.009113s
2025-10-02T09:31:24.127902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Write session: Do CDS request
2025-10-02T09:31:24.127907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:24.136510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:24.138201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.138278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:24.138289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1107
2025-10-02T09:31:24.138379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.138402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:24.138410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:24.138413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:24.138632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1107 sessionId:  describe result for acl check
2025-10-02T09:31:24.138651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:24.138655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:24.138656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:24.138659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554655540074968:8995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:24.138801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:24.138956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554655540074968:8995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:24.139014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:24.139021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:24.139028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:24.139061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:24.139085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554655464538761:7524]
2025-10-02T09:31:24.139431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:24.139599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:24.139625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:24.139796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:24.139830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.139835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.139836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.139836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.139837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.139837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.139838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.139838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.139840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.139841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.139842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.139843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.139846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.139852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.139854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.139856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.139858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.139860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.139862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.139864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.139866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.139869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.139871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.139873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.139876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.139880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.139884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.139887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.139889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.139892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.139894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.139897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.139899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.139902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.139904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.139907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.139909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.139912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.139914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.139918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.139920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.139924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.139929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.139933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.139935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.139941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.139943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.139946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.139965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:24.140347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554655540074968:8995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:24.144876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554655540074968:8995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:24.144885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554655540074968:8995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:24.144887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554655540074968:8995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:24.144891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.147528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.149056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.149065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.149066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.149068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.149071Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1106 [2:7556554655464538761:7524]
2025-10-02T09:31:24.149078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.149087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.149089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.149090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.149091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.149099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.149105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.149109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.149148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.149153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.149154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.149156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.149157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.149191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.149196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.149203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.149208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.149218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.149233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075006:8995], now have 1 active actors on pipe
2025-10-02T09:31:24.149239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540074807:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.149243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.149246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.149247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.149254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.149263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.149265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.149267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.149267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.149273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.149275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.149267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1106
2025-10-02T09:31:24.149289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.149293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.149290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1106
2025-10-02T09:31:24.149295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.149303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.149308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.149332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.149339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.149341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.149342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.149346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.149354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.149366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.149462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.149466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.149477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.149522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1107 partition: 0 MaxSeqNo: 36 sessionId: src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0
2025-10-02T09:31:24.149738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541ff504-2d052320-ceffd5e8-4fe302dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.152061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Write session: try to update token
2025-10-02T09:31:24.152074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.158723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.158736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.158737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.158738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.158743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.158745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.158746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554655464538747:7524]
2025-10-02T09:31:24.158766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.158767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.158769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.158770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.158771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.158771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.158877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.163316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId: src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.165245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.227619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540075025:8968]
2025-10-02T09:31:24.227831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1106, pipe: [1:7556554655540075025:8968]
2025-10-02T09:31:24.276207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:24.276418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.276427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.276453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075025:8968], now have 1 active actors on pipe
2025-10-02T09:31:24.276605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:24.276650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:24.276653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:24.276689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540075025:8968]
2025-10-02T09:31:24.276710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1107 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0
2025-10-02T09:31:24.276863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1107 sessionId: src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0 is DEAD
2025-10-02T09:31:24.276992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:24.277001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Write session will restart in 0.008333s
2025-10-02T09:31:24.277017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Write session: Do CDS request
2025-10-02T09:31:24.277021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:24.286108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.286498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:24.286507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1108
2025-10-02T09:31:24.286600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.286620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:24.286622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:24.286624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:24.286963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1108 sessionId:  describe result for acl check
2025-10-02T09:31:24.286987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:24.286992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:24.286993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:24.286996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554655540075173:9001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:24.287328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554655540075173:9001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:24.287863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:24.289190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554655540075173:9001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:24.290562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:24.290696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:24.290706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:24.290714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:24.290758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:24.290785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554655464538974:7539]
2025-10-02T09:31:24.291063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554655540075173:9001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:24.291071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554655540075173:9001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:24.291073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554655540075173:9001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:24.291076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.291292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:24.291481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:24.291518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:24.291716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:24.291748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.291752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.291753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.291753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.291754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.291754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.291755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.291755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.291756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.291756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.291757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.291757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.291760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.291766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.291768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.291771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.291773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.291775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.291777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.291779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.291780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.291783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.291785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.291787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.291791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.291795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.291798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.291801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.291804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.291806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.291809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.291812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.291814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.291816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.291819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.291822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.291825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.291827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.291829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.291832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.291835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.291837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.291839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.291842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.291844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.291847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.291849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.291852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.291869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:24.299355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.300910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.300919Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.300920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.300922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.300925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1107 [2:7556554655464538974:7539]
2025-10-02T09:31:24.300931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.300941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.300945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.300947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.300948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.300956Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.300962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.300967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.300995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.301000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.301001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.301003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.301004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.301040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.301045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.301051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.301060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.301078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.301096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075026:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.301103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075210:9001], now have 1 active actors on pipe
2025-10-02T09:31:24.301108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.301114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.301116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.301126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.301134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.301139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.301141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.301142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.301151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.301157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.301145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1107
2025-10-02T09:31:24.301166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1107
2025-10-02T09:31:24.301175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.301181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.301182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.301191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.301198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.301222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89364484-6e0e0706-9d8ac14-67379908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.301229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.301232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.301236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.301241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.301247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.301263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.301388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.301396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.301404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.301468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1108 partition: 0 MaxSeqNo: 36 sessionId: src_id|89364484-6e0e0706-9d8ac14-67379908_0
2025-10-02T09:31:24.301673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be266049-329bc4f2-3a2429c3-dbbc9609_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89364484-6e0e0706-9d8ac14-67379908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.303843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Write session: try to update token
2025-10-02T09:31:24.303853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.310837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.310855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.310857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.310859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.310866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.310869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.310873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554655464538968:7539]
2025-10-02T09:31:24.310907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.310915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.310916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.310918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.310920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.310922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.311053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.314119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId: src_id|89364484-6e0e0706-9d8ac14-67379908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.316000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.376607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540075222:8968]
2025-10-02T09:31:24.376767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1107, pipe: [1:7556554655540075222:8968]
2025-10-02T09:31:24.429399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:24.429796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.429807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.429833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075222:8968], now have 1 active actors on pipe
2025-10-02T09:31:24.429974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:24.430001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:24.430022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540075222:8968]
2025-10-02T09:31:24.430034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:24.430089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1108 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89364484-6e0e0706-9d8ac14-67379908_0
2025-10-02T09:31:24.430224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1108 sessionId: src_id|89364484-6e0e0706-9d8ac14-67379908_0 is DEAD
2025-10-02T09:31:24.430354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:24.430363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Write session will restart in 0.005949s
2025-10-02T09:31:24.430380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Write session: Do CDS request
2025-10-02T09:31:24.430385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:24.437129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.437213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:24.437223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1109
2025-10-02T09:31:24.437313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.437334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:24.437340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:24.437343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:24.437656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1109 sessionId:  describe result for acl check
2025-10-02T09:31:24.437679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:24.437680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:24.437681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:24.437684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554655540075348:9005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:24.438026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554655540075348:9005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:24.439443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:24.439537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554655540075348:9005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:24.441999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:24.442189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554655540075348:9005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:24.442204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:24.442213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:24.442197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554655540075348:9005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:24.442220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:24.442200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554655540075348:9005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:24.442203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.442253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:24.442277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554655464539162:7541]
2025-10-02T09:31:24.442642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:24.442825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:24.442850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:24.443045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:24.443088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.443092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.443093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.443093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.443094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.443094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.443095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.443095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.443096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.443096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.443097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.443097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.443101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.443107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.443109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.443111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.443113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.443115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.443117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.443119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.443121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.443123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.443125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.443127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.443131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.443135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.443138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.443141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.443144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.443147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.443149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.443151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.443154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.443157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.443159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.443161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.443164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.443166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.443168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.443171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.443173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.443176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.443180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.443183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.443185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.443188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.443190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.443196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.443213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:24.450929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.452312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.452324Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.452325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.452327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.452330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1108 [2:7556554655464539162:7541]
2025-10-02T09:31:24.452337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.452346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.452351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.452353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.452354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.452363Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.452368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.452373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.452402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.452406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.452407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.452409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.452411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.452462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.452466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.452473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.452479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.452490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.452504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075223:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.452509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075408:9005], now have 1 active actors on pipe
2025-10-02T09:31:24.452512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.452514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.452515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.452523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.452530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.452523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1108
2025-10-02T09:31:24.452534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1108
2025-10-02T09:31:24.452541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.452541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.452544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.452545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.452547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.452571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.452577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.452586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.452593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.452602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.452612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.452616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.452621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.452622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.452627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.452636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.452652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.452758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.452765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.452773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.452833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1109 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0
2025-10-02T09:31:24.453045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89364484-6e0e0706-9d8ac14-67379908_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.455208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Write session: try to update token
2025-10-02T09:31:24.455219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.462082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.462095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.462096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.462097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.462103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.462105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.462108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554655464539156:7541]
2025-10-02T09:31:24.462131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.462135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.462137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.462141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.462145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.462147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.462258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.465287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId: src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.467167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.530217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540075420:8968]
2025-10-02T09:31:24.530434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1108, pipe: [1:7556554655540075420:8968]
2025-10-02T09:31:24.582417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:24.582816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.582828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.582853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075420:8968], now have 1 active actors on pipe
2025-10-02T09:31:24.583045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:24.583056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:24.583063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540075420:8968]
2025-10-02T09:31:24.583090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:24.583109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1109 reason: error at write: Disconnected sessionId: src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0
2025-10-02T09:31:24.583243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1109 sessionId: src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0 is DEAD
2025-10-02T09:31:24.583346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:24.583354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Write session will restart in 0.008479s
2025-10-02T09:31:24.583367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Write session: Do CDS request
2025-10-02T09:31:24.583374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:24.583359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:24.592628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:24.593144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.593204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:24.593214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1110
2025-10-02T09:31:24.593300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.593319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:24.593325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:24.593328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:24.593597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1110 sessionId:  describe result for acl check
2025-10-02T09:31:24.593621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:24.593625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:24.593626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:24.593629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554655540075572:9009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:24.594003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554655540075572:9009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:24.594831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:24.594950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:24.594958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:24.594967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:24.595002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:24.595027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554655464539351:7543]
2025-10-02T09:31:24.595378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:24.595538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:24.595562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:24.595558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554655540075572:9009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:24.595735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:24.595765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.595768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.595769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.595769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.595770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.595770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.595771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.595771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.595772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.595772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.595773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.595773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.595776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.595782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.595784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.595786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.595788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.595790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.595792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.595794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.595796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.595798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.595800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.595802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.595806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.595810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.595813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.595816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.595818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.595820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.595822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.595825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.595827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.595830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.595832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.595834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.595836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.595839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.595841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.595844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.595846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.595849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.595851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.595853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.595856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.595859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.595862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.595865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.595882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:24.599711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554655540075572:9009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:24.599720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554655540075572:9009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:24.599723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554655540075572:9009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:24.599726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.603275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.604663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.604674Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.604676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.604678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.604681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1109 [2:7556554655464539351:7543]
2025-10-02T09:31:24.604688Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.604697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.604699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.604700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.604701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.604710Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.604713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.604717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.604748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.604753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.604754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.604755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.604757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.604888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1109
2025-10-02T09:31:24.604903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1109
2025-10-02T09:31:24.604975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.604981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.604988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.604993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.605005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.605022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075611:9009], now have 1 active actors on pipe
2025-10-02T09:31:24.605028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075421:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.605038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.605043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.605053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.605057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.605058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.605066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.605076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.605079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.605080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.605081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.605087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.605089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.605098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab048c31-1d7380f0-f689259-b9a67e27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.605105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.605107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.605108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.605113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.605119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.605134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.605144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.605150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.605151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.605237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.605242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.605249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.605293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1110 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab048c31-1d7380f0-f689259-b9a67e27_0
2025-10-02T09:31:24.605501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c5c3ef0-e90b0e80-aa10e097-b827f425_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab048c31-1d7380f0-f689259-b9a67e27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.607644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Write session: try to update token
2025-10-02T09:31:24.607654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.614780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.614796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.614798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.614799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.614804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.614807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.614809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554655464539345:7543]
2025-10-02T09:31:24.614831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.614831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.614834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.614834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.614835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.614836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.614959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.618617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId: src_id|ab048c31-1d7380f0-f689259-b9a67e27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.620577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.683295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540075619:8968]
2025-10-02T09:31:24.683492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1109, pipe: [1:7556554655540075619:8968]
2025-10-02T09:31:24.729080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:24.729290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.729299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.729325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075619:8968], now have 1 active actors on pipe
2025-10-02T09:31:24.729484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:24.729500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:24.729511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:24.729518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:24.729555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540075619:8968]
2025-10-02T09:31:24.729561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1110 reason: error at write: Disconnected sessionId: src_id|ab048c31-1d7380f0-f689259-b9a67e27_0
2025-10-02T09:31:24.729700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1110 sessionId: src_id|ab048c31-1d7380f0-f689259-b9a67e27_0 is DEAD
2025-10-02T09:31:24.729815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:24.729824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Write session will restart in 0.007062s
2025-10-02T09:31:24.729838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Write session: Do CDS request
2025-10-02T09:31:24.729842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:24.738137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.738202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:24.738210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1111
2025-10-02T09:31:24.738283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.738303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:24.738308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:24.738310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:24.738529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1111 sessionId:  describe result for acl check
2025-10-02T09:31:24.738547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:24.738552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:24.738553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:24.738556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554655540075782:9014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:24.738821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554655540075782:9014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:24.739076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:24.739737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554655540075782:9014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:24.741547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:24.741657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:24.741664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:24.741670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:24.741698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:24.741720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554655464539553:7546]
2025-10-02T09:31:24.741759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554655540075782:9014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:24.741767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554655540075782:9014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:24.741770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554655540075782:9014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:24.741774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.742061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:24.742232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:24.742257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:24.742434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:24.742466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.742470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.742470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.742471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.742471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.742472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.742473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.742473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.742474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.742474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.742475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.742475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.742478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.742486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.742488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.742490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.742492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.742494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.742496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.742498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.742500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.742502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.742504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.742508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.742511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.742515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.742518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.742520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.742522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.742525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.742527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.742529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.742532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.742534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.742537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.742539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.742542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.742545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.742547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.742551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.742554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.742557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.742562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.742564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.742567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.742569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.742575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.742591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:24.750298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.751704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.751716Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.751717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.751719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.751723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1110 [2:7556554655464539553:7546]
2025-10-02T09:31:24.751730Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.751741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.751746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.751748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.751749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.751758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.751761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.751765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.751795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.751799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.751800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.751802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.751804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.751842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.751847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.751854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.751859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.751867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.751878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075819:9014], now have 1 active actors on pipe
2025-10-02T09:31:24.751884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075620:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.751888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.751889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.751890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.751895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.751905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.751905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.751907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.751909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.751916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.751918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.751932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.751921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1110
2025-10-02T09:31:24.751936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1110
2025-10-02T09:31:24.751937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.751939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.751960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.751965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.751982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.751989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.751991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.751992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.751998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.752005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.752013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.752117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.752122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.752129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.752187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1111 partition: 0 MaxSeqNo: 36 sessionId: src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0
2025-10-02T09:31:24.752421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab048c31-1d7380f0-f689259-b9a67e27_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.754667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Write session: try to update token
2025-10-02T09:31:24.754679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.761536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.761549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.761551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.761552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.761557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.761560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.761562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554655464539546:7546]
2025-10-02T09:31:24.761585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.761590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.761591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.761591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.761595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.761598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.761704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.764926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId: src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.766844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.829741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540075836:8968]
2025-10-02T09:31:24.829945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1110, pipe: [1:7556554655540075836:8968]
2025-10-02T09:31:24.875673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:24.876048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.876061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.876090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075836:8968], now have 1 active actors on pipe
2025-10-02T09:31:24.876227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:24.876272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:24.876281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:24.876285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540075836:8968]
2025-10-02T09:31:24.876302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:24.876324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1111 reason: error at write: Disconnected sessionId: src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0
2025-10-02T09:31:24.876448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1111 sessionId: src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0 is DEAD
2025-10-02T09:31:24.876580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:24.876588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Write session will restart in 0.009575s
2025-10-02T09:31:24.876605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Write session: Do CDS request
2025-10-02T09:31:24.876610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:24.885002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:24.887163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.887215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:24.887223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1112
2025-10-02T09:31:24.887226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:24.887326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:24.887343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:24.887349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:24.887352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:24.887354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:24.887363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:24.887371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:24.887407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:24.887432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554655464539742:7548]
2025-10-02T09:31:24.887610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1112 sessionId:  describe result for acl check
2025-10-02T09:31:24.887634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:24.887639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:24.887640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:24.887643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554655540075993:9019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:24.887780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:24.887931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:24.887953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:24.887980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554655540075993:9019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:24.888284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:24.888323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.888327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.888328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.888328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.888329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.888329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.888330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.888330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.888331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.888331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.888332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.888332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.888335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.888341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.888343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.888345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.888347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.888349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.888351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.888352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.888354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.888356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.888358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.888360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.888364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.888367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:24.888371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.888373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:24.888375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.888378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:24.888380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.888383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:24.888385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.888387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:24.888389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.888392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:24.888395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.888397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:24.888399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.888402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:24.888404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.888406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:24.888408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.888412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.888415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.888419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.888422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.888428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.888456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:24.889467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554655540075993:9019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:24.893641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554655540075993:9019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:24.893649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554655540075993:9019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:24.893651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554655540075993:9019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:24.893655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:24.895872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:24.897274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:24.897286Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:24.897287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:24.897289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:24.897293Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1111 [2:7556554655464539742:7548]
2025-10-02T09:31:24.897301Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:24.897312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:24.897317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.897318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.897319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.897329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:24.897332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:24.897336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:24.897371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.897376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.897377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.897379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:24.897381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:24.897417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:24.897422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.897428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:24.897437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:24.897448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:24.897464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540076031:9019], now have 1 active actors on pipe
2025-10-02T09:31:24.897467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540075840:2446], now have 1 active actors on pipe
2025-10-02T09:31:24.897470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.897472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.897473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.897483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:24.897494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:24.897495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:24.897497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:24.897499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:24.897505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:24.897506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:24.897509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1111
2025-10-02T09:31:24.897510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1111
2025-10-02T09:31:24.897519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.897524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:24.897526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:24.897538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.897543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.897564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:24.897571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:24.897573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:24.897574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:24.897579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:24.897586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:24.897598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.897679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:24.897685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:24.897693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:24.897763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1112 partition: 0 MaxSeqNo: 36 sessionId: src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0
2025-10-02T09:31:24.897970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5615885-32c9d52e-6ec899a2-c8ebc656_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:24.900340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Write session: try to update token
2025-10-02T09:31:24.900353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:24.908044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:24.908055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:24.908057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:24.908058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:24.908063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.908066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.908068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554655464539737:7548]
2025-10-02T09:31:24.908093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:24.908094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:24.908097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:24.908101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:24.908102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:24.908102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:24.908216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:24.912015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId: src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:24.914305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:24.976696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554655540076040:8968]
2025-10-02T09:31:24.976885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1111, pipe: [1:7556554655540076040:8968]
2025-10-02T09:31:25.025589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.026106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.026118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.026145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554655540076040:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.026283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.026345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554655540076040:8968]
2025-10-02T09:31:25.026358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:25.026367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.026410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1112 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0
2025-10-02T09:31:25.026542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1112 sessionId: src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0 is DEAD
2025-10-02T09:31:25.026654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:25.026662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Write session will restart in 0.006303s
2025-10-02T09:31:25.026679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Write session: Do CDS request
2025-10-02T09:31:25.026683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.034103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.034225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.034235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1113
2025-10-02T09:31:25.034314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.034333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.034336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.034339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.034619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1113 sessionId:  describe result for acl check
2025-10-02T09:31:25.034642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.034643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.034644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.034648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835043483:9023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.035026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835043483:9023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.035951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.036497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835043483:9023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.038404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.038503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.038510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.038516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.038525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835043483:9023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.038533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835043483:9023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.038534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835043483:9023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.038543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.038538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.038565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759507233:7551]
2025-10-02T09:31:25.038910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.039073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.039096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.039272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.039302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.039306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.039307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.039307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.039308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.039308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.039309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.039309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.039310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.039310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.039311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.039311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.039314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.039320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.039322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.039324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.039326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.039328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.039330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.039332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.039334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.039336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.039338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.039340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.039343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.039347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.039350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.039353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.039356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.039358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.039361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.039365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.039367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.039370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.039372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.039375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.039377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.039379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.039385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.039388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.039390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.039393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.039398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.039401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.039403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.039406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.039408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.039410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.039427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.046767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.048294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.048306Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.048307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.048309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.048313Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1112 [2:7556554659759507233:7551]
2025-10-02T09:31:25.048319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.048329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.048330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.048332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.048333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.048341Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.048344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.048349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.048379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.048383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.048384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.048386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.048387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.048423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.048428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.048435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.048440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.048448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.048463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043337:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.048469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043526:9023], now have 1 active actors on pipe
2025-10-02T09:31:25.048473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.048474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.048475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.048483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.048492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.048495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.048496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.048499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.048507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.048513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.048529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.048535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.048515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1112
2025-10-02T09:31:25.048517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1112
2025-10-02T09:31:25.048541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.048555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.048560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.048576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.048583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.048585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.048586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.048592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.048598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.048609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.048705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.048710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.048718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.048812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1113 partition: 0 MaxSeqNo: 36 sessionId: src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0
2025-10-02T09:31:25.049025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a549a0-d05ff699-aeb26a8f-845bcb40_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.051154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Write session: try to update token
2025-10-02T09:31:25.051163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.057904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.057919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.057922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.057923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.057930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.057933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.057938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759507227:7551]
2025-10-02T09:31:25.057964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.057966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.057970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.057972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.057974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.057977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.058093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.061129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId: src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.063253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:25.126685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554659835043538:8968]
2025-10-02T09:31:25.126868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1112, pipe: [1:7556554659835043538:8968]
2025-10-02T09:31:25.176936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.177209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.177220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.177247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043538:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.177398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.177398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:25.177409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:25.177451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1113 reason: error at write: Disconnected sessionId: src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0
2025-10-02T09:31:25.177589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1113 sessionId: src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0 is DEAD
2025-10-02T09:31:25.177742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:25.177752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Write session will restart in 0.008063s
2025-10-02T09:31:25.177752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554659835043538:8968]
2025-10-02T09:31:25.177770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Write session: Do CDS request
2025-10-02T09:31:25.177769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.177781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.186713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.187137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.187219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.187232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1114
2025-10-02T09:31:25.187293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.187312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.187318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.187320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.187544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1114 sessionId:  describe result for acl check
2025-10-02T09:31:25.187562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.187566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.187567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.187570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835043709:9034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.187883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835043709:9034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.188912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.189019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835043709:9034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.189132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.189140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.189147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.189180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.189213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759507437:7559]
2025-10-02T09:31:25.189553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.189707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.189729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.189902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.189930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.189934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.189934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.189935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.189935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.189936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.189936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.189937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.189937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.189938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.189938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.189939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.189941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.189947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.189949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.189951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.189953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.189955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.189957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.189958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.189960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.189962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.189964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.189966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.189969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.189973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.189976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.189979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.189981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.189984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.189986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.189988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.189991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.189993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.189995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.189997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.189999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.190005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.190008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.190011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.190015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.190018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.190020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.190022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.190024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.190027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.190029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.190031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.190049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.193884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835043709:9034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.193892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835043709:9034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.193894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835043709:9034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.193898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.197546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.198978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.198989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.198990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.198992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.198995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1113 [2:7556554659759507437:7559]
2025-10-02T09:31:25.199002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.199012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.199013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.199015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.199017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.199025Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.199033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.199039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.199070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.199074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.199075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.199077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.199078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.199118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.199122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.199128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.199137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.199148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.199159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043757:9034], now have 1 active actors on pipe
2025-10-02T09:31:25.199164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043552:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.199167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.199168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.199169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.199176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.199185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.199187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.199189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.199190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.199195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.199197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.199188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1113
2025-10-02T09:31:25.199212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.199217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.199195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1113
2025-10-02T09:31:25.199219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.199227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.199232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.199258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3411fc46-26def4c7-86a1d507-9cee637f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.199265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.199267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.199268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.199273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.199281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.199293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.199378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.199383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.199390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.199438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1114 partition: 0 MaxSeqNo: 36 sessionId: src_id|3411fc46-26def4c7-86a1d507-9cee637f_0
2025-10-02T09:31:25.199634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d943ae-8db47d8b-ee0e63a9-f64da6af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3411fc46-26def4c7-86a1d507-9cee637f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.201781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Write session: try to update token
2025-10-02T09:31:25.201792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.208622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.208645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.208649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.208650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.208659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.208665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.208671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759507432:7559]
2025-10-02T09:31:25.208705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.208712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.208715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.208718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.208719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.208721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.208994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.212818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId: src_id|3411fc46-26def4c7-86a1d507-9cee637f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.214806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:25.277730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554659835043764:8968]
2025-10-02T09:31:25.277904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1113, pipe: [1:7556554659835043764:8968]
2025-10-02T09:31:25.327065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.327341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.327350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.327376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043764:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.327514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.327555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:25.327564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:25.327574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554659835043764:8968]
2025-10-02T09:31:25.327592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.327611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1114 reason: error at write: Disconnected sessionId: src_id|3411fc46-26def4c7-86a1d507-9cee637f_0
2025-10-02T09:31:25.327735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1114 sessionId: src_id|3411fc46-26def4c7-86a1d507-9cee637f_0 is DEAD
2025-10-02T09:31:25.327847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:25.327853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Write session will restart in 0.009216s
2025-10-02T09:31:25.327867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Write session: Do CDS request
2025-10-02T09:31:25.327871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.338138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.338503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.338513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1115
2025-10-02T09:31:25.338584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.338604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.338610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.338612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.338907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1115 sessionId:  describe result for acl check
2025-10-02T09:31:25.338931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.338936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.338937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.338940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835043921:9039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.339279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835043921:9039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.339918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.340209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.340308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.340314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.340319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.340345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.340370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759507657:7568]
2025-10-02T09:31:25.340566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835043921:9039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.340761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.340957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.340992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.341351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.341396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.341401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.341402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.341403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.341404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.341405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.341406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.341406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.341407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.341408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.341409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.341409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.341414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.341423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.341426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.341429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.341433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.341437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.341443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.341445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.341447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.341450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.341452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.341454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.341458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.341462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.341466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.341469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.341471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.341474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.341476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.341479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.341485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.341487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.341490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.341492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.341495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.341497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.341499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.341502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.341504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.341507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.341509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.341512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.341514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.341516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.341522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.341524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.341541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.345430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835043921:9039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.345439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835043921:9039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.345442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835043921:9039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.345447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.349200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.350624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.350639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.350641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.350645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.350648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1114 [2:7556554659759507657:7568]
2025-10-02T09:31:25.350655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.350667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.350673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.350674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.350676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.350685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.350688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.350696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.350728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.350732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.350734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.350737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.350738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.350778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.350782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.350789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.350795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.350806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.350821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043766:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.350826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043961:9039], now have 1 active actors on pipe
2025-10-02T09:31:25.350830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.350831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.350832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.350839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.350850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.350852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.350853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.350855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.350861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.350862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.350857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1114
2025-10-02T09:31:25.350866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1114
2025-10-02T09:31:25.350882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.350897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.350905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.350920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.350925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.350945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b544525-3237ced8-777c3408-34726de1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.350952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.350954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.350955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.350960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.350969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.350983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.351076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.351081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.351089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.351130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1115 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b544525-3237ced8-777c3408-34726de1_0
2025-10-02T09:31:25.351332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3411fc46-26def4c7-86a1d507-9cee637f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b544525-3237ced8-777c3408-34726de1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.353574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Write session: try to update token
2025-10-02T09:31:25.353585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.360328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.360350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.360353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.360355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.360363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.360368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.360374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759507652:7568]
2025-10-02T09:31:25.360405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.360414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.360416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.360417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.360424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.360426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.360667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.364490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId: src_id|7b544525-3237ced8-777c3408-34726de1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.366360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:25.427747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554659835043968:8968]
2025-10-02T09:31:25.427911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1114, pipe: [1:7556554659835043968:8968]
2025-10-02T09:31:25.473292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.473655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.473664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.473689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043968:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.473845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.473862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.473889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554659835043968:8968]
2025-10-02T09:31:25.473898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:25.473961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1115 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b544525-3237ced8-777c3408-34726de1_0
2025-10-02T09:31:25.474100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1115 sessionId: src_id|7b544525-3237ced8-777c3408-34726de1_0 is DEAD
2025-10-02T09:31:25.474232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:25.474241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Write session will restart in 0.006955s
2025-10-02T09:31:25.474257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Write session: Do CDS request
2025-10-02T09:31:25.474261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.482128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.482187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.482204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1116
2025-10-02T09:31:25.482288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.482308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.482314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.482316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.482571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1116 sessionId:  describe result for acl check
2025-10-02T09:31:25.482590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.482595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.482596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.482599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835044124:9043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.482961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835044124:9043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.483445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.484519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835044124:9043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.485963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.486067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.486073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.486078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.486107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.486131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759507852:7570]
2025-10-02T09:31:25.486407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835044124:9043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.486415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835044124:9043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.486417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835044124:9043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.486420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.486472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.486625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.486647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.486831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.486867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.486871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.486871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.486872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.486872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.486873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.486874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.486874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.486875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.486875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.486876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.486876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.486879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.486895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.486897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.486899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.486901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.486903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.486905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.486907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.486909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.486911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.486913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.486915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.486919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.486923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.486930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.486933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.486935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.486939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.486945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.486947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.486950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.486955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.486964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.486969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.486972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.486975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.486977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.486979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.486982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.486984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.486987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.486989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.486995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.486998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.487001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.487006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.487024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.494572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.496095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.496107Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.496108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.496110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.496113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1115 [2:7556554659759507852:7570]
2025-10-02T09:31:25.496120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.496130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.496131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.496133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.496134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.496143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.496146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.496150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.496182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.496188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.496189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.496191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.496192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.496229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.496233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.496240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.496245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.496254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.496268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044162:9043], now have 1 active actors on pipe
2025-10-02T09:31:25.496273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835043970:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.496276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.496277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.496278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.496285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.496295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.496296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.496298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.496299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.496305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.496307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.496296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1115
2025-10-02T09:31:25.496302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1115
2025-10-02T09:31:25.496329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.496335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.496338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.496347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.496354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.496384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6568875-c2da4787-ac145fa3-95e02971_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.496391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.496393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.496394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.496399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.496404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.496417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.496532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.496537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.496544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.496596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1116 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6568875-c2da4787-ac145fa3-95e02971_0
2025-10-02T09:31:25.496783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b544525-3237ced8-777c3408-34726de1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6568875-c2da4787-ac145fa3-95e02971_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.498927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Write session: try to update token
2025-10-02T09:31:25.498938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.505648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.505664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.505666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.505668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.505674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.505680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.505683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759507846:7570]
2025-10-02T09:31:25.505703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.505709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.505711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.505713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.505713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.505715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.505834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.509402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId: src_id|b6568875-c2da4787-ac145fa3-95e02971_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.511364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:25.574175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554659835044173:8968]
2025-10-02T09:31:25.574350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1115, pipe: [1:7556554659835044173:8968]
2025-10-02T09:31:25.619830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.620292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.620306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.620342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044173:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.620529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554659835044173:8968]
2025-10-02T09:31:25.620552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:25.620554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:25.620592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1116 reason: error at write: Disconnected sessionId: src_id|b6568875-c2da4787-ac145fa3-95e02971_0
2025-10-02T09:31:25.620725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.620732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1116 sessionId: src_id|b6568875-c2da4787-ac145fa3-95e02971_0 is DEAD
2025-10-02T09:31:25.620855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:25.620861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Write session will restart in 0.008233s
2025-10-02T09:31:25.620875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Write session: Do CDS request
2025-10-02T09:31:25.620879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.620868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.630101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.630259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.630269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1117
2025-10-02T09:31:25.630350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.630378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.630385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.630388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.630749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1117 sessionId:  describe result for acl check
2025-10-02T09:31:25.630784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.630790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.630791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.630796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835044332:9047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.631313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835044332:9047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.632684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.632984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.633108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835044332:9047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.633140Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.633149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.633156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.633192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.633222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759508048:7572]
2025-10-02T09:31:25.633598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.633786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.633812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.634011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.634052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.634058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.634059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.634060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.634061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.634062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.634062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.634063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.634063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.634064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.634065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.634065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.634068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.634074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.634076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.634079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.634081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.634083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.634085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.634087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.634089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.634091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.634093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.634095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.634100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.634104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.634108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.634110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.634113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.634116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.634118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.634121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.634126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.634129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.634131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.634134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.634136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.634139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.634141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.634144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.634146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.634149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.634154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.634158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.634160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.634164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.634166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.634169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.634189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.638299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835044332:9047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.638310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835044332:9047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.638312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835044332:9047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.638317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.642095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.643791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.643802Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.643804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.643806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.643810Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1116 [2:7556554659759508048:7572]
2025-10-02T09:31:25.643817Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.643833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.643839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.643841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.643842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.643851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.643858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.643862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.643897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.643902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.643904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.643906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.643907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.643945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.643951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.643957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.643963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.643974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.643990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044175:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.643995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044371:9047], now have 1 active actors on pipe
2025-10-02T09:31:25.643999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.644000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.644002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.644010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.644021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.644021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.644023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.644024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.644032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.644033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.644048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.644053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.644050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1116
2025-10-02T09:31:25.644069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.644061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1116
2025-10-02T09:31:25.644078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.644080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.644094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.644098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.644104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.644105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.644110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.644116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.644126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.644252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.644257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.644265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.644326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1117 partition: 0 MaxSeqNo: 36 sessionId: src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0
2025-10-02T09:31:25.644612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6568875-c2da4787-ac145fa3-95e02971_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.646982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Write session: try to update token
2025-10-02T09:31:25.646994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.658237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId: src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.659738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:25.659754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.659759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.659791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:25.659790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:25.659941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:25.660068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:25.660190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:25.660248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:25.660315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:25.660473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:25.660508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.660516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.660527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:25.660553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:25.660614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:25.662280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.662293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.662294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.662295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.662299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.662301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.662303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759508043:7572]
2025-10-02T09:31:25.662325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.662329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.662330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.662334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.662335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.662338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.662441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.720602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554659835044378:8968]
2025-10-02T09:31:25.720773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1116, pipe: [1:7556554659835044378:8968]
2025-10-02T09:31:25.777993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.783974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.783990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.784117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.784171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.784226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.784279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.784317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.784324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.784380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.784433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.784487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.784541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.784583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.784591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.784646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.784695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.784746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.784797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.784844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.784850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.784903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.784957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.785008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.785060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.785104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.785112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.785166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.785224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.785278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.785329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.785363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.785370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.785420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.785470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.785524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.785576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.785623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.785630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.785679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.785728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.785779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.785830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.785866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.785871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.785920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.785968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.786019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.786068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.786113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.786120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.786172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.786219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.786268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.786316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.786349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.786354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.786403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:25.786451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:25.786502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:25.786552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:25.786599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:25.786605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:25.786642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044378:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.786763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.786800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:25.786805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:25.786812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554659835044378:8968]
2025-10-02T09:31:25.786823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1117 reason: error at write: Disconnected sessionId: src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0
2025-10-02T09:31:25.786980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1117 sessionId: src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0 is DEAD
2025-10-02T09:31:25.787116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:25.787122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Write session will restart in 0.008087s
2025-10-02T09:31:25.787135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Write session: Do CDS request
2025-10-02T09:31:25.787140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.787283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.795890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.796119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.796342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.796351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1118
2025-10-02T09:31:25.796429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.796448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.796452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.796454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.796747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1118 sessionId:  describe result for acl check
2025-10-02T09:31:25.796774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.796779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.796781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.796784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835044556:9052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.797208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835044556:9052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.798189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.798290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.798297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.798302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.798328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.798351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759508256:7575]
2025-10-02T09:31:25.798702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.798814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835044556:9052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.798877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.798915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.799100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.799129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.799133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.799134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.799134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.799135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.799135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.799136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.799136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.799137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.799137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.799138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.799138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.799141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.799147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.799149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.799151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.799153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.799155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.799157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.799159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.799161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.799163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.799165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.799167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.799172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.799175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.799179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.799181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.799183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.799186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.799188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.799191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.799193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.799195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.799197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.799200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.799202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.799205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.799207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.799209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.799213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.799216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.799219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.799222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.799224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.799230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.799232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.799235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.799252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.803631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835044556:9052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.803642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835044556:9052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.803645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835044556:9052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.803650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.806764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.808374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.808388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.808390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.808392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.808395Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1117 [2:7556554659759508256:7575]
2025-10-02T09:31:25.808402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.808413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.808414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.808415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.808416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.808425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.808428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.808432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.808462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.808468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.808469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.808471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.808472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.808512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.808517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.808523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.808529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.808537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.808553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044596:9052], now have 1 active actors on pipe
2025-10-02T09:31:25.808559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044395:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.808563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.808564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.808565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.808572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.808580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.808580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.808582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.808584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.808587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.808590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.808584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1117
2025-10-02T09:31:25.808604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.808609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.808599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1117
2025-10-02T09:31:25.808611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.808618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.808620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.808650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.808660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.808663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.808664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.808670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.808675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.808686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.808791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.808798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.808817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.808873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1118 partition: 0 MaxSeqNo: 36 sessionId: src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0
2025-10-02T09:31:25.809111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458c5829-a773dce-1a8cce5f-2c9f8226_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.811446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Write session: try to update token
2025-10-02T09:31:25.811457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.817960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.817979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.817980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.817981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.817987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.817990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.817992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759508251:7575]
2025-10-02T09:31:25.818015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.818017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.818018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.818020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.818023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.818024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.818148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.822533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId: src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.824665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:25.887020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554659835044607:8968]
2025-10-02T09:31:25.887212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1117, pipe: [1:7556554659835044607:8968]
2025-10-02T09:31:25.933959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:25.934281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.934291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.934316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044607:8968], now have 1 active actors on pipe
2025-10-02T09:31:25.934429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:25.934476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:25.934494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:25.934514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554659835044607:8968]
2025-10-02T09:31:25.934532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:25.934540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1118 reason: error at write: Disconnected sessionId: src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0
2025-10-02T09:31:25.934665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1118 sessionId: src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0 is DEAD
2025-10-02T09:31:25.934784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:25.934791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Write session will restart in 0.007822s
2025-10-02T09:31:25.934806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Write session: Do CDS request
2025-10-02T09:31:25.934811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:25.943091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.943243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:25.943252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1119
2025-10-02T09:31:25.943336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:25.943355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:25.943361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:25.943364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:25.943697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1119 sessionId:  describe result for acl check
2025-10-02T09:31:25.943751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:25.943758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:25.943759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:25.943763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554659835044765:9057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:25.944200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554659835044765:9057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:25.944405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:25.945830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554659835044765:9057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:25.946794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:25.946913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:25.946920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:25.946926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:25.946955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:25.946978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554659759508457:7578]
2025-10-02T09:31:25.947313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:25.947494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:25.947516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:25.947691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:25.947721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.947725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.947726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.947727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.947727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.947728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.947728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.947729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.947729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.947730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.947730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.947731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.947734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.947740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.947742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.947744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.947746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.947748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.947750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.947752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.947754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.947756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.947758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.947760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.947763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.947770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554659835044765:9057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:25.947767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:25.947771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.947779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554659835044765:9057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:25.947774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:25.947776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.947781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554659835044765:9057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:25.947779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:25.947784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:25.947782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.947784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:25.947786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.947789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:25.947791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.947794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:25.947796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.947798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:25.947800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.947803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:25.947805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.947808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:25.947810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.947813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.947815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.947818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.947820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.947823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.947841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:25.955420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:25.957036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:25.957049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:25.957050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:25.957052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:25.957056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1118 [2:7556554659759508457:7578]
2025-10-02T09:31:25.957062Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:25.957073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:25.957074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.957076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.957077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.957087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:25.957089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:25.957094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:25.957131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.957138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.957140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.957143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:25.957145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:25.957186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:25.957191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.957198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:25.957203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:25.957211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:25.957224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044805:9057], now have 1 active actors on pipe
2025-10-02T09:31:25.957226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554659835044608:2446], now have 1 active actors on pipe
2025-10-02T09:31:25.957229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.957231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.957232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.957240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:25.957251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:25.957255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:25.957257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:25.957258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:25.957260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:25.957262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:25.957276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.957282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:25.957283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:25.957300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1118
2025-10-02T09:31:25.957301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1118
2025-10-02T09:31:25.957362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.957367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.957383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eafcb89a-af12155d-7358846d-80a35939_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:25.957389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:25.957393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:25.957394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:25.957400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:25.957405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:25.957417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.957521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:25.957526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:25.957533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:25.957586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1119 partition: 0 MaxSeqNo: 36 sessionId: src_id|eafcb89a-af12155d-7358846d-80a35939_0
2025-10-02T09:31:25.957840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6bb88ba-690a1554-f3378f45-c36975bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eafcb89a-af12155d-7358846d-80a35939_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:25.960237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Write session: try to update token
2025-10-02T09:31:25.960250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:25.966726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:25.966743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:25.966747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:25.966748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:25.966752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.966754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.966757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554659759508451:7578]
2025-10-02T09:31:25.966779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:25.966783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:25.966783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:25.966784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:25.966788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:25.966790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:25.966924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:25.970489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId: src_id|eafcb89a-af12155d-7358846d-80a35939_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:25.972494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.034470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130012111:8968]
2025-10-02T09:31:26.034652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1118, pipe: [1:7556554664130012111:8968]
2025-10-02T09:31:26.081389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.081595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.081609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.081638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012111:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.081790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130012111:8968]
2025-10-02T09:31:26.081809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:26.081812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:26.081814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.081860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1119 reason: error at write: Disconnected sessionId: src_id|eafcb89a-af12155d-7358846d-80a35939_0
2025-10-02T09:31:26.081889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.082001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1119 sessionId: src_id|eafcb89a-af12155d-7358846d-80a35939_0 is DEAD
2025-10-02T09:31:26.082120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:26.082127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Write session will restart in 0.008581s
2025-10-02T09:31:26.082145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Write session: Do CDS request
2025-10-02T09:31:26.082149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.091101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.092148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.092208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.092219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1120
2025-10-02T09:31:26.092307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.092336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.092342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.092344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.092607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1120 sessionId:  describe result for acl check
2025-10-02T09:31:26.092631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.092636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.092637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.092640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130012273:9061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.093010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130012273:9061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.093656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.093759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.093767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.093773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.093800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.093831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054475952:7580]
2025-10-02T09:31:26.094174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:26.094314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130012273:9061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.094353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:26.094381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:26.094561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:26.094591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.094595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.094595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.094596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.094597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.094597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.094598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.094598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.094599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.094599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.094600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.094600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.094603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.094609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.094611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.094613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.094615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.094617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.094619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.094621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.094623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.094625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.094627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.094629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.094632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.094636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.094639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.094642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.094648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.094651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.094653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.094656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.094658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.094660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.094662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.094665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.094667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.094670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.094672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.094675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.094678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.094680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.094682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.094685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.094687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.094689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.094691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.094694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.094710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:26.099511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130012273:9061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.099520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130012273:9061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.099522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130012273:9061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.099525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.102184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:26.103811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:26.103824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:26.103826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:26.103828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:26.103831Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1119 [2:7556554664054475952:7580]
2025-10-02T09:31:26.103838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:26.103848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:26.103853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.103854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.103855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.103866Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:26.103872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:26.103877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:26.103911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.103915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.103916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.103918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:26.103919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:26.103955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:26.103960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.103967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.103972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.103982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:26.103997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012112:2446], now have 1 active actors on pipe
2025-10-02T09:31:26.104005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012312:9061], now have 1 active actors on pipe
2025-10-02T09:31:26.104019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1119
2025-10-02T09:31:26.104008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.104009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.104010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.104023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1119
2025-10-02T09:31:26.104018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:26.104025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:26.104032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:26.104034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:26.104036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:26.104038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:26.104039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:26.104048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.104051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:26.104052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:26.104072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.104075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.104098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:26.104106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.104108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.104109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:26.104114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.104120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:26.104131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.104215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.104219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.104227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.104288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1120 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0
2025-10-02T09:31:26.104512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb89a-af12155d-7358846d-80a35939_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:26.106692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Write session: try to update token
2025-10-02T09:31:26.106702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:26.113641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:26.113657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:26.113658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:26.113659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:26.113665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.113669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.113672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054475946:7580]
2025-10-02T09:31:26.113694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:26.113699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:26.113700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.113702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:26.113702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:26.113705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:26.113820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:26.117073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId: src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:26.119240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.181922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130012320:8968]
2025-10-02T09:31:26.182101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1119, pipe: [1:7556554664130012320:8968]
2025-10-02T09:31:26.233724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.234044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.234055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.234079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012320:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.234192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.234218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.234253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130012320:8968]
2025-10-02T09:31:26.234274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:26.234326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0
2025-10-02T09:31:26.234457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1120 sessionId: src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0 is DEAD
2025-10-02T09:31:26.234571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:26.234580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Write session will restart in 0.008963s
2025-10-02T09:31:26.234595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Write session: Do CDS request
2025-10-02T09:31:26.234599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.244142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.244211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.244220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1121
2025-10-02T09:31:26.244313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.244333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.244338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.244342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.244699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1121 sessionId:  describe result for acl check
2025-10-02T09:31:26.244724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.244728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.244729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.244733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130012509:9073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.245412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130012509:9073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.246396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.246660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.246822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.246831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.246841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.246832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130012509:9073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.246892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.246925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054476189:7595]
2025-10-02T09:31:26.247307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:26.247488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:26.247517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:26.247727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:26.247761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.247766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.247766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.247767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.247767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.247768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.247769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.247769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.247770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.247770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.247771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.247771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.247774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.247780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.247783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.247785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.247787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.247789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.247791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.247794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.247796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.247798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.247800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.247802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.247807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.247811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.247814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.247817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.247819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.247822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.247824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.247828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.247831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.247834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.247836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.247838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.247841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.247844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.247847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.247852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.247857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.247866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.247874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.247876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.247883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.247885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.247888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.247890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.247911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:26.252372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130012509:9073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.252381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130012509:9073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.252383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130012509:9073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.252387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.256274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:26.257935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:26.257947Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:26.257948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:26.257950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:26.257953Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1120 [2:7556554664054476189:7595]
2025-10-02T09:31:26.257960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:26.257971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:26.257976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.257977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.257979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.257987Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:26.257992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:26.257997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:26.258026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.258031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.258032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.258034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:26.258036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:26.258073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:26.258078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.258085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.258095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.258113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:26.258132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012348:2446], now have 1 active actors on pipe
2025-10-02T09:31:26.258138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012546:9073], now have 1 active actors on pipe
2025-10-02T09:31:26.258141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.258143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.258145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.258153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:26.258153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1120
2025-10-02T09:31:26.258161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:26.258155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1120
2025-10-02T09:31:26.258162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:26.258169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:26.258170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:26.258173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:26.258176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:26.258193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.258199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:26.258200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:26.258211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.258213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.258240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:26.258247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.258250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.258251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:26.258255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.258263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:26.258275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.258351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.258357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.258367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.258420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1121 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0
2025-10-02T09:31:26.258619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d84567a-41b954f6-daf5fd0a-4d1a7348_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:26.260920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Write session: try to update token
2025-10-02T09:31:26.260930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:26.267814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:26.267832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:26.267834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:26.267836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:26.267841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.267846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.267852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054476184:7595]
2025-10-02T09:31:26.267875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:26.267881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.267882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:26.267883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:26.267886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:26.267888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:26.267998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:26.271320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId: src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:26.273275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.334515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130012554:8968]
2025-10-02T09:31:26.334715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1120, pipe: [1:7556554664130012554:8968]
2025-10-02T09:31:26.385578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.385977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.385987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.386012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012554:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.386145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.386190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:26.386194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130012554:8968]
2025-10-02T09:31:26.386209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.386251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1121 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0
2025-10-02T09:31:26.386386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1121 sessionId: src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0 is DEAD
2025-10-02T09:31:26.386517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:26.386526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Write session will restart in 0.007586s
2025-10-02T09:31:26.386546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Write session: Do CDS request
2025-10-02T09:31:26.386550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.395129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.395223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.395233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1122
2025-10-02T09:31:26.395304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.395324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.395339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.395345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.395606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1122 sessionId:  describe result for acl check
2025-10-02T09:31:26.395628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.395633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.395635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.395638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130012717:9077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.395919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.395969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130012717:9077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.397472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130012717:9077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.398366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.398479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.398486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.398492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.398520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.398544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054476388:7597]
2025-10-02T09:31:26.398923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:26.399116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:26.399144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:26.399343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:26.399374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.399378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.399379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.399379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.399380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.399381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.399381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.399382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.399382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.399383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.399361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130012717:9077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.399383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.399371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130012717:9077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.399384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.399373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130012717:9077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.399387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.399376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.399393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.399395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.399397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.399400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.399403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.399406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.399410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.399413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.399416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.399419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.399422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.399427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.399433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.399437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.399440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.399442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.399444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.399446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.399449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.399455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.399458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.399460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.399462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.399465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.399474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.399481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.399486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.399494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.399498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.399500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.399503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.399507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.399513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.399515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.399518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.399537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:26.407355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:26.409026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:26.409035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:26.409036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:26.409038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:26.409042Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1121 [2:7556554664054476388:7597]
2025-10-02T09:31:26.409048Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:26.409058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:26.409060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.409061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.409062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.409071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:26.409077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:26.409082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:26.409110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.409115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.409116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.409118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:26.409119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:26.409161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:26.409168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.409175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.409180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.409188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:26.409202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012756:9077], now have 1 active actors on pipe
2025-10-02T09:31:26.409204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012556:2446], now have 1 active actors on pipe
2025-10-02T09:31:26.409209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.409211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.409212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.409225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:26.409239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:26.409249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:26.409250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:26.409253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:26.409254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:26.409255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:26.409268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.409269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:26.409245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1121
2025-10-02T09:31:26.409248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1121
2025-10-02T09:31:26.409282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:26.409291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.409294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.409309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35014915-4e9cad7e-d907055f-e40c9417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:26.409316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.409318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.409319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:26.409324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.409330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:26.409340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.409443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.409450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.409459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.409523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1122 partition: 0 MaxSeqNo: 36 sessionId: src_id|35014915-4e9cad7e-d907055f-e40c9417_0
2025-10-02T09:31:26.409733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3e8f6a-7dc19acd-49e53752-976dd4f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35014915-4e9cad7e-d907055f-e40c9417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:26.411923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Write session: try to update token
2025-10-02T09:31:26.411932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:26.418851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:26.418866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:26.418867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:26.418868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:26.418874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.418877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.418879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054476382:7597]
2025-10-02T09:31:26.418915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:26.418917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:26.418919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.418920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:26.418921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:26.418923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:26.419044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:26.422285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId: src_id|35014915-4e9cad7e-d907055f-e40c9417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:26.424474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.486574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130012766:8968]
2025-10-02T09:31:26.486772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1121, pipe: [1:7556554664130012766:8968]
2025-10-02T09:31:26.534289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.534713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.534723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.534749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012766:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.534937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.534928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130012766:8968]
2025-10-02T09:31:26.534937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:26.534940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:26.534960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.534989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1122 reason: error at write: Disconnected sessionId: src_id|35014915-4e9cad7e-d907055f-e40c9417_0
2025-10-02T09:31:26.535108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1122 sessionId: src_id|35014915-4e9cad7e-d907055f-e40c9417_0 is DEAD
2025-10-02T09:31:26.535225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:26.535229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Write session will restart in 0.005128s
2025-10-02T09:31:26.535243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Write session: Do CDS request
2025-10-02T09:31:26.535247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.541074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.541120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.541129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1123
2025-10-02T09:31:26.541207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.541227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.541232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.541235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.541560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1123 sessionId:  describe result for acl check
2025-10-02T09:31:26.541583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.541587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.541588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.541591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130012839:9083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.541940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130012839:9083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.543590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130012839:9083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.547204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.547257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130012839:9083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.547265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130012839:9083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.547267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130012839:9083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.547271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.547490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.547586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.547592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.547598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.547626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.547649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054476591:7599]
2025-10-02T09:31:26.548011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:26.548178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:26.548202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:26.548379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:26.548409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.548413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.548413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.548414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.548415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.548415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.548416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.548416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.548417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.548417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.548418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.548419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.548421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.548428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.548430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.548432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.548434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.548436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.548438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.548440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.548442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.548444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.548446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.548448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.548451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.548455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.548460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.548465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.548468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.548472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.548476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.548479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.548485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.548489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.548493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.548497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.548505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.548508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.548510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.548512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.548514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.548517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.548522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.548525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.548527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.548530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.548532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.548535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.548552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:26.556043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:26.557512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:26.557524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:26.557526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:26.557528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:26.557532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1122 [2:7556554664054476591:7599]
2025-10-02T09:31:26.557541Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:26.557550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:26.557552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.557553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.557554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.557563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:26.557566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:26.557570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:26.557608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.557612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.557614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.557616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:26.557617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:26.557656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:26.557660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.557667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.557673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.557686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:26.557705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012770:2446], now have 1 active actors on pipe
2025-10-02T09:31:26.557712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012969:9083], now have 1 active actors on pipe
2025-10-02T09:31:26.557717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.557722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.557725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.557736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:26.557752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:26.557754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:26.557756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:26.557757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:26.557767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:26.557772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:26.557790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.557796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:26.557797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:26.557775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1122
2025-10-02T09:31:26.557780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1122
2025-10-02T09:31:26.557815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.557821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.557842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:26.557849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.557851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.557852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:26.557857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.557863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:26.557878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.557984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.557991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.558000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.558078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1123 partition: 0 MaxSeqNo: 36 sessionId: src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0
2025-10-02T09:31:26.558336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35014915-4e9cad7e-d907055f-e40c9417_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:26.560575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Write session: try to update token
2025-10-02T09:31:26.560599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:26.567666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:26.567682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:26.567684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:26.567685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:26.567691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.567693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.567695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054476585:7599]
2025-10-02T09:31:26.567719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:26.567719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:26.567722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:26.567724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.567724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:26.567725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:26.567845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:26.571522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId: src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:26.573618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.635043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130012982:8968]
2025-10-02T09:31:26.635235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1122, pipe: [1:7556554664130012982:8968]
2025-10-02T09:31:26.690081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.690283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.690294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.690326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012982:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.690458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.690516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130012982:8968]
2025-10-02T09:31:26.690517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:26.690538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.690575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1123 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0
2025-10-02T09:31:26.690701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1123 sessionId: src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0 is DEAD
2025-10-02T09:31:26.690827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:26.690836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Write session will restart in 0.006751s
2025-10-02T09:31:26.690853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Write session: Do CDS request
2025-10-02T09:31:26.690857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.698164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.698232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.698240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1124
2025-10-02T09:31:26.698311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.698331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.698337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.698339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.698631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1124 sessionId:  describe result for acl check
2025-10-02T09:31:26.698655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.698659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.698660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.698663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130013140:9087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.699019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130013140:9087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.700440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130013140:9087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.702561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.702640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130013140:9087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.702650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130013140:9087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.702652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130013140:9087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.702655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.702816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.702922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.702930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.702936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.702963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.702986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054476805:7602]
2025-10-02T09:31:26.703369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:26.703551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:26.703580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:26.703780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:26.703823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.703829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.703830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.703830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.703831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.703831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.703832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.703832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.703833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.703833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.703834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.703835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.703837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.703843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.703845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.703847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.703849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.703851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.703854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.703856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.703857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.703860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.703862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.703864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.703867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.703871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.703874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.703877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.703879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.703882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.703884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.703887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.703889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.703892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.703894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.703897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.703900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.703903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.703905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.703912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.703914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.703918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.703923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.703926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.703928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.703931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.703936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.703938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.703955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:26.711566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:26.713033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:26.713046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:26.713047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:26.713049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:26.713052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1123 [2:7556554664054476805:7602]
2025-10-02T09:31:26.713059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:26.713069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:26.713071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.713072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.713073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.713082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:26.713089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:26.713093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:26.713122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.713126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.713127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.713129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:26.713131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:26.713169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:26.713174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.713180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.713185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.713193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:26.713207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130012983:2446], now have 1 active actors on pipe
2025-10-02T09:31:26.713213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013182:9087], now have 1 active actors on pipe
2025-10-02T09:31:26.713216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.713217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.713218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.713227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:26.713237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:26.713238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:26.713240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:26.713241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:26.713247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:26.713249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:26.713265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.713243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1123
2025-10-02T09:31:26.713271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:26.713272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:26.713285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.713251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1123
2025-10-02T09:31:26.713288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.713314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:26.713322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.713324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.713325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:26.713330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.713335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:26.713348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.713447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.713454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.713464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.713514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1124 partition: 0 MaxSeqNo: 36 sessionId: src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0
2025-10-02T09:31:26.713719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ca3005-e3b0b1b5-5c777168-f1e7b12a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:26.715910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Write session: try to update token
2025-10-02T09:31:26.715921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:26.722833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:26.722847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:26.722849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:26.722850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:26.722855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.722857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.722861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054476799:7602]
2025-10-02T09:31:26.722893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:26.722897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:26.722900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.722901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:26.722902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:26.722904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:26.723071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:26.727174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId: src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:26.729174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.790679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130013210:8968]
2025-10-02T09:31:26.790846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1123, pipe: [1:7556554664130013210:8968]
2025-10-02T09:31:26.838776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.839177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.839187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.839217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013210:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.839352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.839411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:26.839422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:26.839447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.839476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1124 reason: error at write: Disconnected sessionId: src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0
2025-10-02T09:31:26.839479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130013210:8968]
2025-10-02T09:31:26.839615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1124 sessionId: src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0 is DEAD
2025-10-02T09:31:26.839728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:26.839736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Write session will restart in 0.009584s
2025-10-02T09:31:26.839749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Write session: Do CDS request
2025-10-02T09:31:26.839753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.849358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.850175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.850261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.850270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1125
2025-10-02T09:31:26.850358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.850377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.850383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.850386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.850655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1125 sessionId:  describe result for acl check
2025-10-02T09:31:26.850673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.850677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.850678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.850683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130013381:9093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.851030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130013381:9093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.851710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.851827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.851834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.851841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.851871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.851895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054477007:7604]
2025-10-02T09:31:26.852247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:26.852429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:26.852455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:26.852472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130013381:9093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.852640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:26.852673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.852677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.852678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.852678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.852679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.852679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.852680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.852680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.852681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.852681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.852682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.852683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.852685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.852691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.852693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.852695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.852697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.852699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.852701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.852702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.852704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.852706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.852708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.852710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.852714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.852718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:26.852721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.852724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:26.852726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.852729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:26.852731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:26.852736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.852738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:26.852741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.852743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:26.852745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.852748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:26.852750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.852753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:26.852755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.852758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:26.852760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.852762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.852764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.852768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.852770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.852772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.852813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:26.856628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130013381:9093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.856637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130013381:9093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.856638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130013381:9093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.856642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.860359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:26.861976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:26.861988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:26.861989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:26.861992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:26.861996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1124 [2:7556554664054477007:7604]
2025-10-02T09:31:26.862006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:26.862020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:26.862026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.862028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.862029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.862037Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:26.862040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:26.862044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:26.862081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.862085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.862086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.862088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:26.862090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:26.862124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:26.862128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.862135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:26.862140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:26.862150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:26.862161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013419:9093], now have 1 active actors on pipe
2025-10-02T09:31:26.862166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013215:2446], now have 1 active actors on pipe
2025-10-02T09:31:26.862170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.862171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.862173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.862181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:26.862191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:26.862194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:26.862197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:26.862198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:26.862201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:26.862202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:26.862215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.862205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1124
2025-10-02T09:31:26.862220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:26.862208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1124
2025-10-02T09:31:26.862229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:26.862236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.862239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.862261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:26.862270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:26.862273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:26.862274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:26.862282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:26.862289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:26.862298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.862379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.862384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.862392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:26.862439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1125 partition: 0 MaxSeqNo: 36 sessionId: src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0
2025-10-02T09:31:26.862621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95fbda7-299cfe8-39c1f15c-de8a98ae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:26.864922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Write session: try to update token
2025-10-02T09:31:26.864932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:26.871789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:26.871803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:26.871805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:26.871806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:26.871811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.871814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.871816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054477001:7604]
2025-10-02T09:31:26.871838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:26.871843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:26.871843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:26.871844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:26.871846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:26.871848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:26.871961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:26.875359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId: src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:26.877310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:26.939675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554664130013430:8968]
2025-10-02T09:31:26.939901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1124, pipe: [1:7556554664130013430:8968]
2025-10-02T09:31:26.985341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:26.985759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:26.985769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:26.985796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013430:8968], now have 1 active actors on pipe
2025-10-02T09:31:26.985971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:26.985982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:26.985982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554664130013430:8968]
2025-10-02T09:31:26.985998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:26.986000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:26.986043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1125 reason: error at write: Disconnected sessionId: src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0
2025-10-02T09:31:26.986185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1125 sessionId: src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0 is DEAD
2025-10-02T09:31:26.986334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:26.986343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Write session will restart in 0.007950s
2025-10-02T09:31:26.986362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Write session: Do CDS request
2025-10-02T09:31:26.986367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:26.995133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.995241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:26.995249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1126
2025-10-02T09:31:26.995326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:26.995345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:26.995352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:26.995355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:26.995621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1126 sessionId:  describe result for acl check
2025-10-02T09:31:26.995645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:26.995651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:26.995653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:26.995656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554664130013596:9097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:26.996013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554664130013596:9097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:26.997473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554664130013596:9097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:26.999246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:26.999362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554664130013596:9097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:26.999369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554664130013596:9097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:26.999373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554664130013596:9097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:26.999376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:26.999528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:26.999630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:26.999637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:26.999642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:26.999673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:26.999696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554664054477214:7607]
2025-10-02T09:31:27.000043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.000227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.000252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.000435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.000467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.000471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.000472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.000472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.000473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.000473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.000474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.000475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.000475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.000476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.000476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.000477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.000480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.000485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.000488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.000490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.000492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.000494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.000496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.000497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.000499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.000502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.000504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.000506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.000509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.000513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.000517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.000520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.000523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.000525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.000528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.000530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.000533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.000535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.000541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.000544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.000546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.000549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.000551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.000557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.000559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.000562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.000568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.000570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.000572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.000575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.000578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.000580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.000601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.008183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.009789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.009801Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.009802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.009804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.009807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1125 [2:7556554664054477214:7607]
2025-10-02T09:31:27.009816Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.009825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.009831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.009833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.009834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.009842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.009846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.009850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.009882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.009887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.009888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.009890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.009891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.009926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.009931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.009938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.009947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.009965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.009984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013634:9097], now have 1 active actors on pipe
2025-10-02T09:31:27.009991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554664130013432:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.009996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.010001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.010003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.010014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.010024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.010027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.010031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.010032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.010039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.010041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.010035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1125
2025-10-02T09:31:27.010061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.010067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.010069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1125
2025-10-02T09:31:27.010075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.010078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.010081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.010111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.010119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.010121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.010125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.010130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.010136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.010153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.010250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.010257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.010267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.010327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1126 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0
2025-10-02T09:31:27.010511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3637551e-c6e4f9ad-c330f469-3e5a1103_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.012835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Write session: try to update token
2025-10-02T09:31:27.012844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.020135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.020153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.020155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.020156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.020161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.020164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.020166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554664054477208:7607]
2025-10-02T09:31:27.020189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.020190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.020192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.020194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.020194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.020196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.020311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.023441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId: src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.025463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.086106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424980941:8968]
2025-10-02T09:31:27.086291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1125, pipe: [1:7556554668424980941:8968]
2025-10-02T09:31:27.133546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:27.133964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.133975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.134003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424980941:8968], now have 1 active actors on pipe
2025-10-02T09:31:27.134146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:27.134169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424980941:8968]
2025-10-02T09:31:27.134189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:27.134197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:27.134251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1126 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0
2025-10-02T09:31:27.134385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1126 sessionId: src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0 is DEAD
2025-10-02T09:31:27.134513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:27.134523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Write session will restart in 0.009549s
2025-10-02T09:31:27.134538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Write session: Do CDS request
2025-10-02T09:31:27.134542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:27.145082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.145173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:27.145182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1127
2025-10-02T09:31:27.145263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.145285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:27.145290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:27.145294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:27.145569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1127 sessionId:  describe result for acl check
2025-10-02T09:31:27.145590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:27.145591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:27.145592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:27.145595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554668424981117:9101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:27.145938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554668424981117:9101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:27.147234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:27.147510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:27.147545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554668424981117:9101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:27.147601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:27.147608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:27.147614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:27.147638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:27.147663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554668349444714:7609]
2025-10-02T09:31:27.148009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.148170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.148192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.148503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.148543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.148547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.148547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.148548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.148548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.148549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.148549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.148550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.148550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.148551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.148551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.148552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.148555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.148560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.148562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.148564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.148566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.148568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.148570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.148572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.148574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.148576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.148578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.148580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.148584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.148588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.148591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.148594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.148596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.148598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.148601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.148603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.148606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.148608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.148611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.148613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.148616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.148619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.148621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.148623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.148625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.148628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.148630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.148633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.148635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.148637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.148639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.148642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.148658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.152555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554668424981117:9101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:27.152566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554668424981117:9101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:27.152569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554668424981117:9101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:27.152573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:27.156245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.157887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.157899Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.157900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.157902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.157906Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1126 [2:7556554668349444714:7609]
2025-10-02T09:31:27.157912Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.157922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.157923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.157925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.157926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.157936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.157941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.157948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.157987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.157992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.157993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.157996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.157997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.158032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.158037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.158042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.158051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.158062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.158077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424980943:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.158082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981157:9101], now have 1 active actors on pipe
2025-10-02T09:31:27.158086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.158089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.158090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.158097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.158108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.158109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.158116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.158116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.158117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.158118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.158106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1126
2025-10-02T09:31:27.158131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.158136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.158115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1126
2025-10-02T09:31:27.158138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.158148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.158152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.158179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.158186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.158188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.158190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.158198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.158208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.158225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.158311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.158316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.158323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.158382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1127 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0
2025-10-02T09:31:27.158598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a8cfea-8ec307d4-ad4dd042-d3f24a12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.160893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Write session: try to update token
2025-10-02T09:31:27.160904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.167697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.167714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.167716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.167717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.167724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.167728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.167734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554668349444709:7609]
2025-10-02T09:31:27.167757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.167761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.167764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.167766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.167766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.167769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.167881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.171684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId: src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.173874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.234072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424981179:8968]
2025-10-02T09:31:27.234225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1126, pipe: [1:7556554668424981179:8968]
2025-10-02T09:31:27.285038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:27.285376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.285387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.285417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981179:8968], now have 1 active actors on pipe
2025-10-02T09:31:27.285571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:27.285584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:27.285595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:27.285601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:27.285630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424981179:8968]
2025-10-02T09:31:27.285638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1127 reason: error at write: Disconnected sessionId: src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0
2025-10-02T09:31:27.285773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1127 sessionId: src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0 is DEAD
2025-10-02T09:31:27.285868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:27.285876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Write session will restart in 0.006595s
2025-10-02T09:31:27.285890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Write session: Do CDS request
2025-10-02T09:31:27.285894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:27.293118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.293209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:27.293219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1128
2025-10-02T09:31:27.293289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.293308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:27.293314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:27.293317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:27.293841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1128 sessionId:  describe result for acl check
2025-10-02T09:31:27.293863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:27.293867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:27.293868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:27.293872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554668424981311:9113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:27.294196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554668424981311:9113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:27.296210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554668424981311:9113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:27.298917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:27.298959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554668424981311:9113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:27.298966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554668424981311:9113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:27.298968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554668424981311:9113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:27.298972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:27.299206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:27.299401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:27.299408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:27.299415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:27.299449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:27.299471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554668349444960:7624]
2025-10-02T09:31:27.299807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.299998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.300023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.300205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.300236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.300240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.300241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.300241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.300242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.300242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.300244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.300244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.300245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.300245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.300248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.300254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.300256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.300258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.300260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.300262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.300264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.300266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.300268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.300271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.300273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.300275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.300279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.300283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.300287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.300289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.300292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.300295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.300297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.300300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.300302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.300304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.300306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.300309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.300311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.300314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.300319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.300322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.300324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.300327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.300332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.300335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.300337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.300339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.300344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.300348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.300364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.307918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.309455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.309467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.309469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.309472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.309478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1127 [2:7556554668349444960:7624]
2025-10-02T09:31:27.309491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.309511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.309513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.309514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.309515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.309524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.309527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.309531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.309560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.309566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.309567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.309569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.309570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.309606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.309611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.309618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.309633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.309651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.309669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981394:9113], now have 1 active actors on pipe
2025-10-02T09:31:27.309676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981190:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.309681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.309683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.309684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.309696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.309706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.309708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.309713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.309715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.309702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1127
2025-10-02T09:31:27.309719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.309722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.309707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1127
2025-10-02T09:31:27.309738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.309746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.309747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.309756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.309761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.309790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.309797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.309799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.309800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.309805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.309813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.309827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.309918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.309925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.309935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.309973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1128 partition: 0 MaxSeqNo: 36 sessionId: src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0
2025-10-02T09:31:27.310170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d22d803-41b5b6d5-b46278b8-8e5f67cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.312421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Write session: try to update token
2025-10-02T09:31:27.312432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.319017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.319029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.319030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.319031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.319035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.319038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.319040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554668349444954:7624]
2025-10-02T09:31:27.319061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.319064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.319066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.319068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.319068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.319070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.319186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.322693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId: src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.324762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.385632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424981405:8968]
2025-10-02T09:31:27.385858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1127, pipe: [1:7556554668424981405:8968]
2025-10-02T09:31:27.432923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:27.433307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.433322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.433352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981405:8968], now have 1 active actors on pipe
2025-10-02T09:31:27.433657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:27.433690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:27.433692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:27.433723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:27.433737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1128 reason: error at write: Disconnected sessionId: src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0
2025-10-02T09:31:27.433867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1128 sessionId: src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0 is DEAD
2025-10-02T09:31:27.433930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424981405:8968]
2025-10-02T09:31:27.434007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:27.434016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Write session will restart in 0.005472s
2025-10-02T09:31:27.434034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Write session: Do CDS request
2025-10-02T09:31:27.434039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:27.440115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.440208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:27.440215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1129
2025-10-02T09:31:27.440297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.440317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:27.440323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:27.440325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:27.440694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1129 sessionId:  describe result for acl check
2025-10-02T09:31:27.440717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:27.440718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:27.440719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:27.440723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554668424981466:9117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:27.441084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554668424981466:9117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:27.442789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554668424981466:9117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:27.444389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554668424981466:9117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:27.444397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554668424981466:9117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:27.444399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554668424981466:9117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:27.444402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:27.448053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:27.448366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:27.448553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:27.448562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:27.448568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:27.448605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:27.448628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554668349445168:7626]
2025-10-02T09:31:27.448982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.449178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.449205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.449391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.449417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.449422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.449422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.449423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.449423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.449424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.449425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.449425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.449426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.449426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.449427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.449427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.449430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.449436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.449438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.449440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.449442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.449444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.449446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.449448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.449450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.449452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.449454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.449456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.449460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.449463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.449467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.449470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.449472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.449475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.449477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.449480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.449482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.449485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.449487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.449489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.449493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.449496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.449498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.449500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.449502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.449505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.449512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.449514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.449520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.449523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.449525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.449527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.449543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.457131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.458503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.458516Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.458517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.458519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.458523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1128 [2:7556554668349445168:7626]
2025-10-02T09:31:27.458528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.458539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.458543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.458545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.458546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.458555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.458561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.458566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.458598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.458602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.458605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.458607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.458608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.458643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.458648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.458654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.458663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.458680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.458698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981406:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.458705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981607:9117], now have 1 active actors on pipe
2025-10-02T09:31:27.458710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.458715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.458716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.458726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.458737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.458739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.458745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.458746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.458750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.458751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.458745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1128
2025-10-02T09:31:27.458768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.458775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.458776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.458752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1128
2025-10-02T09:31:27.458789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.458796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.459000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.459010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.459012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.459014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.459019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.459025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.459043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.459162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.459168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.459178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.459236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1129 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0
2025-10-02T09:31:27.459452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67dbe8b6-9810b3d2-7da4c06d-2b49c77f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.461615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Write session: try to update token
2025-10-02T09:31:27.461626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.468113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.468128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.468132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.468133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.468138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.468140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.468142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554668349445163:7626]
2025-10-02T09:31:27.468164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.468171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.468172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.468172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.468176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.468179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.468288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.471937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId: src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.474146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.534125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424981623:8968]
2025-10-02T09:31:27.534348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1128, pipe: [1:7556554668424981623:8968]
2025-10-02T09:31:27.581597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:27.581935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.581950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.581981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981623:8968], now have 1 active actors on pipe
2025-10-02T09:31:27.582276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:27.582281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424981623:8968]
2025-10-02T09:31:27.582296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:27.582298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:27.582339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1129 reason: error at write: Disconnected sessionId: src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0
2025-10-02T09:31:27.582467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1129 sessionId: src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0 is DEAD
2025-10-02T09:31:27.582523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:27.582592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:27.582601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Write session will restart in 0.009745s
2025-10-02T09:31:27.582616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Write session: Do CDS request
2025-10-02T09:31:27.582620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:27.592916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:27.593079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.593154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:27.593162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1130
2025-10-02T09:31:27.593239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.593269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:27.593275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:27.593278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:27.593536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1130 sessionId:  describe result for acl check
2025-10-02T09:31:27.593560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:27.593564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:27.593565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:27.593569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554668424981795:9121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:27.593902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554668424981795:9121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:27.595458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554668424981795:9121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:27.595915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:27.596068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:27.596076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:27.596084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:27.596118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:27.596140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554668349445376:7628]
2025-10-02T09:31:27.596485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.596689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.596716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.596924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.596957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.596961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.596962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.596963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.596963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.596964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.596964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.596965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.596965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.596966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.596966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.596967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.596970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.596976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.596978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.596980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.596982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.596984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.596986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.596988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.596990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.596992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.596994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.596996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.596999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.597003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.597007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.597009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.597012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.597014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.597016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.597019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.597021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.597025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.597027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.597032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.597034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.597037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.597042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.597045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.597047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.597050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.597052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.597055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.597057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.597059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.597061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.597064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.597092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.597509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554668424981795:9121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:27.597517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554668424981795:9121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:27.597518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554668424981795:9121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:27.597522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:27.604636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.606287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.606303Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.606304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.606306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.606309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1129 [2:7556554668349445376:7628]
2025-10-02T09:31:27.606316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.606327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.606332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.606334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.606336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.606345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.606348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.606355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.606390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.606394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.606395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.606397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.606399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.606436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.606440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.606448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.606460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.606477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.606496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981833:9121], now have 1 active actors on pipe
2025-10-02T09:31:27.606502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981624:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.606506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.606512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.606513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.606523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.606534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.606539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.606542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.606543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.606550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.606552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.606542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1129
2025-10-02T09:31:27.606542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1129
2025-10-02T09:31:27.606575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.606585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.606587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.606602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.606609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.606642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.606653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.606659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.606660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.606665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.606674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.606690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.606796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.606802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.606813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.606870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1130 partition: 0 MaxSeqNo: 36 sessionId: src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0
2025-10-02T09:31:27.607121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b0fa729-d69ee616-4d7e02d7-6a19b9e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.609318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Write session: try to update token
2025-10-02T09:31:27.609329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.616026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.616041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.616042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.616043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.616048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.616050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.616052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554668349445370:7628]
2025-10-02T09:31:27.616075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.616079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.616080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.616082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.616085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.616088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.616198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.619342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId: src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.621281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.682595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424981842:8968]
2025-10-02T09:31:27.682772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1129, pipe: [1:7556554668424981842:8968]
2025-10-02T09:31:27.731255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:27.731666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.731675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.731701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981842:8968], now have 1 active actors on pipe
2025-10-02T09:31:27.731809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:27.731817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424981842:8968]
2025-10-02T09:31:27.731837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:27.731841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:27.731844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:27.731903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1130 reason: error at write: Disconnected sessionId: src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0
2025-10-02T09:31:27.732072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1130 sessionId: src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0 is DEAD
2025-10-02T09:31:27.732198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:27.732206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Write session will restart in 0.008920s
2025-10-02T09:31:27.732223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Write session: Do CDS request
2025-10-02T09:31:27.732227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:27.741932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:27.742126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.742223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:27.742233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1131
2025-10-02T09:31:27.742312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.742332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:27.742339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:27.742341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:27.742618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1131 sessionId:  describe result for acl check
2025-10-02T09:31:27.742642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:27.742646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:27.742646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:27.742650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554668424982015:9125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:27.742998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554668424982015:9125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:27.744327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554668424982015:9125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:27.744552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:27.744657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:27.744664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:27.744670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:27.744697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:27.744722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554668349445596:7631]
2025-10-02T09:31:27.745082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.745266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.745297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.745478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.745507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.745511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.745511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.745512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.745512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.745513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.745513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.745514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.745514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.745515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.745516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.745516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.745520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.745526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.745528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.745531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.745533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.745535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.745537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.745539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.745540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.745543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.745544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.745546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.745550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.745554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.745557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.745560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.745562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.745564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.745566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.745569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.745571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.745574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.745576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.745582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.745584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.745587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.745593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.745595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.745601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.745603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.745605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.745608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.745613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.745616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.745618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.745620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.745641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.745914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554668424982015:9125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:27.745922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554668424982015:9125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:27.745924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554668424982015:9125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:27.745927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:27.753083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.754586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.754601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.754602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.754604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.754607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1130 [2:7556554668349445596:7631]
2025-10-02T09:31:27.754614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.754624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.754629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.754631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.754632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.754642Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.754647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.754652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.754680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.754685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.754686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.754689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.754690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.754734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.754741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.754747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.754756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.754767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.754784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424982066:9125], now have 1 active actors on pipe
2025-10-02T09:31:27.754791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424981843:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.754795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.754797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.754799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.754797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1130
2025-10-02T09:31:27.754809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.754800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1130
2025-10-02T09:31:27.754819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.754827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.754830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.754831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.754835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.754837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.754848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.754855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.754857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.754863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.754868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.754904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.754911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.754914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.754915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.754920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.754928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.754941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.755058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.755063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.755070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.755127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1131 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0
2025-10-02T09:31:27.755340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8959fcad-2392d3aa-bebc4cea-32d927c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.757598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Write session: try to update token
2025-10-02T09:31:27.757609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.764370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.764385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.764386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.764387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.764394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.764396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.764398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554668349445590:7631]
2025-10-02T09:31:27.764423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.764426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.764428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.764435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.764439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.764441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.764550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.768059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId: src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.770249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.832101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424982081:8968]
2025-10-02T09:31:27.832277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1130, pipe: [1:7556554668424982081:8968]
2025-10-02T09:31:27.878644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:27.879008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.879018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.879045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424982081:8968], now have 1 active actors on pipe
2025-10-02T09:31:27.879187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:27.879228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:27.879238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:27.879239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:27.879276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424982081:8968]
2025-10-02T09:31:27.879310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1131 reason: error at write: Disconnected sessionId: src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0
2025-10-02T09:31:27.879442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1131 sessionId: src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0 is DEAD
2025-10-02T09:31:27.879559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:27.879568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Write session will restart in 0.009739s
2025-10-02T09:31:27.879584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Write session: Do CDS request
2025-10-02T09:31:27.879589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:27.890136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.890182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:27.890189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1132
2025-10-02T09:31:27.890281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:27.890301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:27.890307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:27.890310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:27.890570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1132 sessionId:  describe result for acl check
2025-10-02T09:31:27.890588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:27.890592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:27.890593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:27.890596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554668424982257:9131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:27.890939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554668424982257:9131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:27.891850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:27.892136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:27.892231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:27.892238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:27.892244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:27.892271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:27.892293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554668349445807:7633]
2025-10-02T09:31:27.892448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554668424982257:9131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:27.892643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:27.892860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:27.892887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:27.893105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:27.893142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.893146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.893147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.893147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.893148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.893148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.893149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.893149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.893150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.893150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.893151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.893152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.893155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.893161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.893163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.893165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.893167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.893169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.893171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.893173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.893175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.893177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.893179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.893181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.893185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.893189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:27.893193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.893196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:27.893198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.893200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:27.893203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.893206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:27.893208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.893211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:27.893213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.893216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:27.893218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.893221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:27.893223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.893226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:27.893228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.893231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:27.893233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.893235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.893237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.893240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.893242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.893245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.893263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:27.897172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554668424982257:9131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:27.897181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554668424982257:9131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:27.897183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554668424982257:9131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:27.897186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:27.900842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:27.902517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:27.902528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:27.902529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:27.902531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:27.902536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1131 [2:7556554668349445807:7633]
2025-10-02T09:31:27.902544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:27.902554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:27.902560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.902561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.902562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.902571Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:27.902574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:27.902577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:27.902605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.902609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.902611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.902613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:27.902614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:27.902651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:27.902655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.902662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:27.902667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:27.902679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:27.902694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424982297:9131], now have 1 active actors on pipe
2025-10-02T09:31:27.902700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424982085:2446], now have 1 active actors on pipe
2025-10-02T09:31:27.902703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.902705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.902706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.902714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:27.902725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:27.902724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:27.902726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:27.902728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:27.902735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:27.902737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:27.902731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1131
2025-10-02T09:31:27.902731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1131
2025-10-02T09:31:27.902751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.902756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:27.902758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:27.902769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.902774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.902798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:27.902805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:27.902807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:27.902808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:27.902813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:27.902821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:27.902833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.902929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:27.902934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:27.902941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:27.902997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1132 partition: 0 MaxSeqNo: 36 sessionId: src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0
2025-10-02T09:31:27.903215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1bf9479-e101cbfc-dac30449-529f70e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:27.905461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Write session: try to update token
2025-10-02T09:31:27.905471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:27.912329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:27.912346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:27.912348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:27.912350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:27.912359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.912364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.912368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554668349445802:7633]
2025-10-02T09:31:27.912399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:27.912407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:27.912410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:27.912412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:27.912412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:27.912414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:27.912659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:27.916582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId: src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:27.918699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:27.979550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554668424982305:8968]
2025-10-02T09:31:27.979735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1131, pipe: [1:7556554668424982305:8968]
2025-10-02T09:31:28.027604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.028025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.028040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.028079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554668424982305:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.028266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:28.028269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554668424982305:8968]
2025-10-02T09:31:28.028277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:28.028285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.028319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1132 reason: error at write: Disconnected sessionId: src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0
2025-10-02T09:31:28.028464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1132 sessionId: src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0 is DEAD
2025-10-02T09:31:28.028592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:28.028600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Write session will restart in 0.009862s
2025-10-02T09:31:28.028616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Write session: Do CDS request
2025-10-02T09:31:28.028623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.028640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.039160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.039245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.039255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1133
2025-10-02T09:31:28.039337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.039357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.039363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.039366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.039644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1133 sessionId:  describe result for acl check
2025-10-02T09:31:28.039668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.039672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.039673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.039676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719949775:9135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.040052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719949775:9135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.041427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719949775:9135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.041851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.042167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.042351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.042359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.042366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.042399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.042422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644413317:7636]
2025-10-02T09:31:28.042768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.042968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.042993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.043228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.043283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.043289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.043290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.043290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.043291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.043292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.043293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.043294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.043295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.043296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.043297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.043298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.043302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.043311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.043315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.043319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.043322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.043326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.043334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.043338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.043345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.043348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.043355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.043358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.043367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.043378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.043387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.043396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.043403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.043399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719949775:9135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.043407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.043414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.043408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719949775:9135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.043410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719949775:9135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.043413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.043418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.043426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.043431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.043439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.043444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.043448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.043452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.043456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.043460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.043464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.043468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.043472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.043476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.043480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.043484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.043487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.043491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.043525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.051120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.052499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.052511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.052512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.052514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.052517Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1132 [2:7556554672644413317:7636]
2025-10-02T09:31:28.052524Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.052534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.052538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.052540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.052541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.052550Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.052556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.052560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.052593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.052598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.052599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.052601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.052602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.052647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.052653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.052663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.052677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.052694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.052712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719949813:9135], now have 1 active actors on pipe
2025-10-02T09:31:28.052719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719949602:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.052724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.052725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.052727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.052737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.052729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1132
2025-10-02T09:31:28.052733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1132
2025-10-02T09:31:28.052751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.052751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.052755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.052756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.052766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.052768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.052793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.052799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.052819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.052826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.052835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.052845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|179204bc-25a57d3d-83648019-40d0aa8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.052849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.052854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.052855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.052861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.052869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.053044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.053170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.053177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.053187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.053254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1133 partition: 0 MaxSeqNo: 36 sessionId: src_id|179204bc-25a57d3d-83648019-40d0aa8b_0
2025-10-02T09:31:28.053442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6967e6fa-ab680559-e25c9295-bc3d436a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|179204bc-25a57d3d-83648019-40d0aa8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.055647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Write session: try to update token
2025-10-02T09:31:28.055656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.062340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.062356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.062358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.062359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.062364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.062367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.062369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644413312:7636]
2025-10-02T09:31:28.062388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.062390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.062392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.062393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.062399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.062402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.062523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.066087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId: src_id|179204bc-25a57d3d-83648019-40d0aa8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.068283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:28.128538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554672719949823:8968]
2025-10-02T09:31:28.128752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1132, pipe: [1:7556554672719949823:8968]
2025-10-02T09:31:28.175661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.176035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.176044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.176070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719949823:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.176239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.176231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.176260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554672719949823:8968]
2025-10-02T09:31:28.176267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:28.176269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:28.176311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1133 reason: error at write: Disconnected sessionId: src_id|179204bc-25a57d3d-83648019-40d0aa8b_0
2025-10-02T09:31:28.176450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1133 sessionId: src_id|179204bc-25a57d3d-83648019-40d0aa8b_0 is DEAD
2025-10-02T09:31:28.176595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:28.176604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Write session will restart in 0.008045s
2025-10-02T09:31:28.176618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Write session: Do CDS request
2025-10-02T09:31:28.176623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.185126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.185220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.185230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1134
2025-10-02T09:31:28.185317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.185336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.185342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.185345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.185640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1134 sessionId:  describe result for acl check
2025-10-02T09:31:28.185666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.185670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.185671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.185673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719949978:9139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.186023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719949978:9139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.187272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719949978:9139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.187964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.190395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.190455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719949978:9139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.190464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719949978:9139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.190466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719949978:9139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.190469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.190529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.190538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.190546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.190589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.190619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644413530:7638]
2025-10-02T09:31:28.191018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.191207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.191234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.191424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.191454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.191458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.191459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.191460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.191460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.191461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.191461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.191462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.191462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.191463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.191463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.191464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.191467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.191473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.191475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.191477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.191479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.191481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.191483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.191485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.191487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.191489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.191491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.191493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.191497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.191501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.191504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.191507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.191509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.191512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.191514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.191517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.191519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.191522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.191524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.191527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.191529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.191532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.191534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.191536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.191538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.191541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.191544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.191547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.191549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.191552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.191554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.191556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.191577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.199283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.200871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.200883Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.200884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.200887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.200890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1133 [2:7556554672644413530:7638]
2025-10-02T09:31:28.200896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.200906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.200912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.200914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.200915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.200924Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.200926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.200934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.200964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.200968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.200969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.200970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.200972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.201007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.201012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.201019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.201024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.201038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.201057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719949824:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.201064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950036:9139], now have 1 active actors on pipe
2025-10-02T09:31:28.201069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.201074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.201076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.201086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.201097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.201099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.201105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.201107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.201111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.201113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.201130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.201139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.201141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.201123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1133
2025-10-02T09:31:28.201127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1133
2025-10-02T09:31:28.201161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.201168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.201194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.201204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.201207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.201208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.201215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.201221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.201242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.201340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.201347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.201355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.201417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1134 partition: 0 MaxSeqNo: 36 sessionId: src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0
2025-10-02T09:31:28.201635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|179204bc-25a57d3d-83648019-40d0aa8b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.203840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Write session: try to update token
2025-10-02T09:31:28.203850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.210642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.210660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.210662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.210664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.210670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.210675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.210678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644413524:7638]
2025-10-02T09:31:28.210704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.210711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.210712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.210713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.210717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.210719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.210824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.214357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId: src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.216599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:28.276494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554672719950069:8968]
2025-10-02T09:31:28.276616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1133, pipe: [1:7556554672719950069:8968]
2025-10-02T09:31:28.329197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.329568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.329578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.329604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950069:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.329775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.329789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554672719950069:8968]
2025-10-02T09:31:28.329794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.329822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:28.329824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:28.329867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1134 reason: error at write: Disconnected sessionId: src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0
2025-10-02T09:31:28.330020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1134 sessionId: src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0 is DEAD
2025-10-02T09:31:28.330172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:28.330181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Write session will restart in 0.005235s
2025-10-02T09:31:28.330199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Write session: Do CDS request
2025-10-02T09:31:28.330204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.336133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.336225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.336233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1135
2025-10-02T09:31:28.336299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.336318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.336323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.336326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.336660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1135 sessionId:  describe result for acl check
2025-10-02T09:31:28.336684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.336688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.336689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.336692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719950131:9151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.337061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719950131:9151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.339096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719950131:9151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.340940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719950131:9151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.340948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719950131:9151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.340949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719950131:9151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.340953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.343350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.344109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.344403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.344412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.344420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.344453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.344478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644413783:7653]
2025-10-02T09:31:28.344857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.345059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.345099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.345292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.345331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.345336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.345337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.345337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.345338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.345338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.345339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.345339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.345340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.345340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.345341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.345341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.345345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.345351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.345353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.345355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.345357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.345359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.345361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.345363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.345365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.345367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.345369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.345371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.345375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.345379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.345382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.345385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.345388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.345391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.345393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.345395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.345398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.345400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.345403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.345405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.345407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.345411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.345413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.345415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.345417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.345420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.345422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.345424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.345426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.345428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.345430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.345432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.345447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.352958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.354512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.354525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.354526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.354528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.354532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1134 [2:7556554672644413783:7653]
2025-10-02T09:31:28.354538Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.354547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.354552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.354553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.354554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.354563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.354566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.354570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.354602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.354607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.354608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.354610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.354611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.354645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.354650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.354659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.354672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.354689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.354707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950071:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.354713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950279:9151], now have 1 active actors on pipe
2025-10-02T09:31:28.354717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.354722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.354724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.354736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.354749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.354751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.354757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.354758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.354762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.354764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.354739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1134
2025-10-02T09:31:28.354785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.354744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1134
2025-10-02T09:31:28.354796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.354808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.354809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.354812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.354839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.354848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.354853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.354855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.354861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.354871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.354899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.354984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.354991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.355002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.355073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1135 partition: 0 MaxSeqNo: 36 sessionId: src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0
2025-10-02T09:31:28.355333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|494a9122-d59665c7-b92a8cc4-a38bd336_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.358108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Write session: try to update token
2025-10-02T09:31:28.358123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.363982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.363995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.363996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.363997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.364001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.364004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.364005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644413778:7653]
2025-10-02T09:31:28.364026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.364026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.364028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.364029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.364030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.364030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.364136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.370637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId: src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.372628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:28.430105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554672719950293:8968]
2025-10-02T09:31:28.430368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1134, pipe: [1:7556554672719950293:8968]
2025-10-02T09:31:28.476313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.476655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.476665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.476676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950293:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.476843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.476881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554672719950293:8968]
2025-10-02T09:31:28.476896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.476905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:28.476958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0
2025-10-02T09:31:28.477097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1135 sessionId: src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0 is DEAD
2025-10-02T09:31:28.477277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:28.477291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Write session will restart in 0.007017s
2025-10-02T09:31:28.477313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Write session: Do CDS request
2025-10-02T09:31:28.477318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.485146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.485192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.485202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1136
2025-10-02T09:31:28.485380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.485402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.485408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.485410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.485796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1136 sessionId:  describe result for acl check
2025-10-02T09:31:28.485819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.485823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.485824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.485827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719950406:9155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.486187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719950406:9155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.488018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719950406:9155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.492019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719950406:9155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.492029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719950406:9155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.492031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719950406:9155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.492035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.492033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.492372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.492476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.492484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.492490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.492518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.492703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644413998:7655]
2025-10-02T09:31:28.493070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.493277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.493304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.493493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.493521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.493525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.493526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.493527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.493527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.493528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.493528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.493529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.493530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.493530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.493531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.493531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.493534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.493540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.493543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.493545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.493547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.493549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.493551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.493553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.493555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.493557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.493559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.493561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.493565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.493569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.493573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.493577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.493579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.493582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.493584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.493587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.493589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.493593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.493595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.493597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.493599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.493602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.493603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.493606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.493608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.493611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.493613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.493616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.493618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.493620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.493626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.493629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.493646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.501298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.502696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.502711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.502713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.502715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.502718Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1135 [2:7556554672644413998:7655]
2025-10-02T09:31:28.502726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.502738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.502739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.502741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.502742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.502753Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.502760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.502764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.502794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.502799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.502800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.502802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.502803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.502839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.502844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.502850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.502858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.502874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.502901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950295:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.502908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950506:9155], now have 1 active actors on pipe
2025-10-02T09:31:28.502913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.502920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.502921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.502932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.502945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.502948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.502953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.502954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.502959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.502961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.502978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.502987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.502988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.502958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1135
2025-10-02T09:31:28.502998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.503005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.503040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.503049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.503037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1135
2025-10-02T09:31:28.503053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.503056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.503063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.503074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.503094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.503201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.503209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.503220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.503293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1136 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0
2025-10-02T09:31:28.503561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7763cc1f-d17bd93d-8132b44c-d67c61f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.505996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Write session: try to update token
2025-10-02T09:31:28.506008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.512851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.512866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.512868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.512869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.512875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.512877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.512879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644413992:7655]
2025-10-02T09:31:28.512903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.512904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.512907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.512907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.512909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.512910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.513029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.516514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId: src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.518640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:28.577058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554672719950518:8968]
2025-10-02T09:31:28.577286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1135, pipe: [1:7556554672719950518:8968]
2025-10-02T09:31:28.636985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.637330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.637342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.637378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950518:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.637561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.637583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.637610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:28.637621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554672719950518:8968]
2025-10-02T09:31:28.637667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1136 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0
2025-10-02T09:31:28.637805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1136 sessionId: src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0 is DEAD
2025-10-02T09:31:28.637967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:28.637983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Write session will restart in 0.006595s
2025-10-02T09:31:28.638014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Write session: Do CDS request
2025-10-02T09:31:28.638020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.645187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.645292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.645305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1137
2025-10-02T09:31:28.645401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.645422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.645431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.645435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.645930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1137 sessionId:  describe result for acl check
2025-10-02T09:31:28.645955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.645957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.645959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.645962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719950600:9159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.646326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719950600:9159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.648364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719950600:9159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.650145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719950600:9159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.650153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719950600:9159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.650155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719950600:9159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.650159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.653208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.653564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.653666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.653673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.653680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.653708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.653909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644414214:7657]
2025-10-02T09:31:28.654288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.654493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.654522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.654718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.654749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.654753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.654754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.654755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.654756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.654756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.654757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.654758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.654758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.654759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.654759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.654760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.654763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.654770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.654772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.654775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.654777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.654779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.654781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.654783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.654785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.654788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.654790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.654792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.654796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.654800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.654803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.654807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.654809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.654814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.654819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.654822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.654825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.654832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.654834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.654837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.654839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.654842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.654844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.654846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.654848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.654851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.654857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.654859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.654863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.654868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.654870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.654872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.654905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.662929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.664336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.664350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.664352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.664354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.664357Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1136 [2:7556554672644414214:7657]
2025-10-02T09:31:28.664365Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.664376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.664377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.664379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.664380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.664392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.664399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.664403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.664435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.664439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.664441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.664443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.664444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.664484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.664489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.664496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.664502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.664512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.664528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950520:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.664535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.664537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.664538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.664547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.664557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950731:9159], now have 1 active actors on pipe
2025-10-02T09:31:28.664562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.664564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.664564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.664565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.664571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.664573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.664587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.664593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.664601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.664584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1136
2025-10-02T09:31:28.664584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1136
2025-10-02T09:31:28.664679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.664685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.664700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9022fdef-492513f7-c404715b-a5623c76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.664708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.664710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.664711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.664717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.664724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.664733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.664876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.664882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.664890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.664947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1137 partition: 0 MaxSeqNo: 36 sessionId: src_id|9022fdef-492513f7-c404715b-a5623c76_0
2025-10-02T09:31:28.665210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f122df4-5f5a8b11-e04552ee-c3fb094a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9022fdef-492513f7-c404715b-a5623c76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.667446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Write session: try to update token
2025-10-02T09:31:28.667457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.674365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.674382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.674384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.674385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.674389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.674393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.674395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644414209:7657]
2025-10-02T09:31:28.674418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.674425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.674425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.674427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.674428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.674430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.674546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.677835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId: src_id|9022fdef-492513f7-c404715b-a5623c76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.679961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:28.737825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554672719950744:8968]
2025-10-02T09:31:28.738072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1136, pipe: [1:7556554672719950744:8968]
2025-10-02T09:31:28.789666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.789948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.789957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.789987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950744:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.790157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.790186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.790215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:28.790226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554672719950744:8968]
2025-10-02T09:31:28.790274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1137 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9022fdef-492513f7-c404715b-a5623c76_0
2025-10-02T09:31:28.790404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1137 sessionId: src_id|9022fdef-492513f7-c404715b-a5623c76_0 is DEAD
2025-10-02T09:31:28.790507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:28.790516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Write session will restart in 0.008597s
2025-10-02T09:31:28.790531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Write session: Do CDS request
2025-10-02T09:31:28.790536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.800196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.800310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.800321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1138
2025-10-02T09:31:28.800406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.800425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.800431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.800434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.800690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1138 sessionId:  describe result for acl check
2025-10-02T09:31:28.800712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.800716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.800717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.800720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719950941:9165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.801054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719950941:9165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.802783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719950941:9165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.802911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.803242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.803338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.803345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.803350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.803377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.803402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644414442:7660]
2025-10-02T09:31:28.803739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.803894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.803924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.804109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.804137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.804141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.804141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.804142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.804142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.804143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.804144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.804144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.804144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.804145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.804146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.804146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.804149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.804154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.804156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.804158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.804160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.804162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.804164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.804166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.804168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.804170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.804172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.804174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.804178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.804182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.804185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.804188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.804190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.804193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.804195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.804198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.804200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.804203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.804205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.804207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.804213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.804216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.804218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.804220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.804224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.804229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.804232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.804234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.804236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.804239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.804241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.804243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.804264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.806106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719950941:9165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.806114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719950941:9165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.806116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719950941:9165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.806119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.811712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.813323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.813336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.813337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.813339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.813342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1137 [2:7556554672644414442:7660]
2025-10-02T09:31:28.813349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.813358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.813363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.813365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.813367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.813376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.813382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.813386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.813415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.813420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.813421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.813423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.813424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.813459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.813464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.813471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.813476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.813483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.813495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950761:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.813501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950980:9165], now have 1 active actors on pipe
2025-10-02T09:31:28.813504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.813506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.813507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.813514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.813524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.813529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.813531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.813532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.813533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.813534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.813548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.813553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.813550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1137
2025-10-02T09:31:28.813568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.813553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1137
2025-10-02T09:31:28.813577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.813578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.813593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.813601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.813603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.813604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.813609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.813615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.813622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.813796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1138 partition: 0 MaxSeqNo: 36 sessionId: src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0
2025-10-02T09:31:28.813720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.813725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.813732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.814013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9022fdef-492513f7-c404715b-a5623c76_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.816194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Write session: try to update token
2025-10-02T09:31:28.816203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.822865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.822890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.822891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.822892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.822897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.822901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.822904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644414437:7660]
2025-10-02T09:31:28.822925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.822932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.822933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.822937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.822941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.822948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.823043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.827199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId: src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.829430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:28.890395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554672719950991:8968]
2025-10-02T09:31:28.890571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1137, pipe: [1:7556554672719950991:8968]
2025-10-02T09:31:28.934307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:28.934690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.934700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.934726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950991:8968], now have 1 active actors on pipe
2025-10-02T09:31:28.934858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:28.934900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554672719950991:8968]
2025-10-02T09:31:28.934913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:28.934922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:28.934975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0
2025-10-02T09:31:28.935116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1138 sessionId: src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0 is DEAD
2025-10-02T09:31:28.935235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:28.935244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Write session will restart in 0.006855s
2025-10-02T09:31:28.935264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Write session: Do CDS request
2025-10-02T09:31:28.935268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:28.943204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.943349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:28.943358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1139
2025-10-02T09:31:28.943456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:28.943475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:28.943479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:28.943481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:28.943766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1139 sessionId:  describe result for acl check
2025-10-02T09:31:28.943782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:28.943789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:28.943790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:28.943793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554672719951118:9169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:28.944125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554672719951118:9169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:28.945757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554672719951118:9169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:28.949222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:28.949332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554672719951118:9169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:28.949340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554672719951118:9169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:28.949342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554672719951118:9169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:28.949346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:28.949533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:28.949627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:28.949633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:28.949639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:28.949665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:28.949685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554672644414663:7663]
2025-10-02T09:31:28.950019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:28.950186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:28.950208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:28.950382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:28.950411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.950412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.950413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.950413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.950414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.950414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.950415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.950415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.950416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.950416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.950417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.950417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.950420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.950426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.950428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.950430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.950432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.950434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.950436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.950438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.950440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.950442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.950444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.950446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.950450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.950453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:28.950456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.950459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:28.950461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.950464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:28.950466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.950469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:28.950471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.950474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:28.950476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.950478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:28.950480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.950483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:28.950485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.950488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:28.950491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.950494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:28.950496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.950498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.950500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.950502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.950504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.950507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.950522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:28.958131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:28.959676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:28.959688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:28.959689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:28.959691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:28.959695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1138 [2:7556554672644414663:7663]
2025-10-02T09:31:28.959702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:28.959714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:28.959715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.959717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.959718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.959727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:28.959730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:28.959734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:28.959766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.959771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.959772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.959774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:28.959775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:28.959813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:28.959818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.959828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:28.959839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:28.959857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:28.959877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719950992:2446], now have 1 active actors on pipe
2025-10-02T09:31:28.959884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554672719951207:9169], now have 1 active actors on pipe
2025-10-02T09:31:28.959889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.959891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.959892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.959902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:28.959915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:28.959915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:28.959917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:28.959918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:28.959907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1138
2025-10-02T09:31:28.959930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:28.959924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1138
2025-10-02T09:31:28.959936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:28.959970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.959977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.959986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.959996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:28.960004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:28.960019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|955ff95-2ea38c5b-3996c62-890ba66c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:28.960028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:28.960034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:28.960036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:28.960044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:28.960055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:28.960080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.960176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:28.960183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:28.960194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:28.960266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1139 partition: 0 MaxSeqNo: 36 sessionId: src_id|955ff95-2ea38c5b-3996c62-890ba66c_0
2025-10-02T09:31:28.960539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df41b72-d2128ec-ea557f06-ae77cd47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|955ff95-2ea38c5b-3996c62-890ba66c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:28.963244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Write session: try to update token
2025-10-02T09:31:28.963260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:28.969493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:28.969503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:28.969504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:28.969505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:28.969726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.969734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.969736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554672644414657:7663]
2025-10-02T09:31:28.969766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:28.969767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:28.969771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:28.969774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:28.969776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:28.969778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:28.969934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:28.975254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId: src_id|955ff95-2ea38c5b-3996c62-890ba66c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:28.977329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.035303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014918515:8968]
2025-10-02T09:31:29.035547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1138, pipe: [1:7556554677014918515:8968]
2025-10-02T09:31:29.087220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.087434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.087443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.087456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918515:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.087614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.087608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014918515:8968]
2025-10-02T09:31:29.087615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.087635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:29.087637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:29.087681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1139 reason: error at write: Disconnected sessionId: src_id|955ff95-2ea38c5b-3996c62-890ba66c_0
2025-10-02T09:31:29.087820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1139 sessionId: src_id|955ff95-2ea38c5b-3996c62-890ba66c_0 is DEAD
2025-10-02T09:31:29.087987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:29.088001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Write session will restart in 0.007165s
2025-10-02T09:31:29.088024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Write session: Do CDS request
2025-10-02T09:31:29.088029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:29.096175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.096214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:29.096222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1140
2025-10-02T09:31:29.096329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.096348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:29.096354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:29.096356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:29.096603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1140 sessionId:  describe result for acl check
2025-10-02T09:31:29.096620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:29.096624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:29.096627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:29.096630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554677014918666:9173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:29.096970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554677014918666:9173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:29.098096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554677014918666:9173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:29.100678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:29.100834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554677014918666:9173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:29.100841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554677014918666:9173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:29.100843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554677014918666:9173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:29.100846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:29.100928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:29.101159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:29.101168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:29.101175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:29.101209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:29.101233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554676939382178:7665]
2025-10-02T09:31:29.101691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:29.101860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:29.101885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:29.102071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:29.102100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.102104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.102105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.102105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.102106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.102106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.102107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.102107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.102108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.102108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.102109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.102109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.102113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.102119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.102121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.102123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.102125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.102127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.102129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.102131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.102133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.102135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.102136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.102138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.102142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.102146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.102151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.102154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.102156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.102159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.102161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.102163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.102166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.102168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.102170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.102173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.102175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.102178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.102180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.102182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.102186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.102189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.102191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.102194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.102196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.102198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.102202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.102205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.102220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:29.109666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:29.111059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:29.111071Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:29.111072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:29.111075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:29.111079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1139 [2:7556554676939382178:7665]
2025-10-02T09:31:29.111086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:29.111097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:29.111098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.111099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.111100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.111110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:29.111112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:29.111117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:29.111152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.111157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.111158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.111160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:29.111161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:29.111198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:29.111203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.111209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.111215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.111226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:29.111240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918732:9173], now have 1 active actors on pipe
2025-10-02T09:31:29.111245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918516:2446], now have 1 active actors on pipe
2025-10-02T09:31:29.111249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.111252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.111253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.111261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:29.111271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:29.111274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:29.111276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:29.111277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:29.111282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:29.111283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:29.111282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1139
2025-10-02T09:31:29.111287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1139
2025-10-02T09:31:29.111300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.111305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:29.111306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:29.111316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.111321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.111354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:29.111363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.111367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.111370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:29.111377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.111385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:29.111399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.111492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.111497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.111504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.111569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1140 partition: 0 MaxSeqNo: 36 sessionId: src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0
2025-10-02T09:31:29.111821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955ff95-2ea38c5b-3996c62-890ba66c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:29.114275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Write session: try to update token
2025-10-02T09:31:29.114287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:29.120649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:29.120661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.120662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:29.120664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:29.120669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.120672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.120676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554676939382172:7665]
2025-10-02T09:31:29.120700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:29.120704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.120704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:29.120705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:29.120709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:29.120712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:29.120832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:29.124660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId: src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:29.126781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.187854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014918746:8968]
2025-10-02T09:31:29.188030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1139, pipe: [1:7556554677014918746:8968]
2025-10-02T09:31:29.233085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.233463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.233472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.233499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918746:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.233626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.233675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014918746:8968]
2025-10-02T09:31:29.233691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:29.233694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.233813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1140 reason: status is not ok: tablet will be restarted right now sessionId: src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0
2025-10-02T09:31:29.233970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1140 sessionId: src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0 is DEAD
2025-10-02T09:31:29.234104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:29.234112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Write session will restart in 0.008635s
2025-10-02T09:31:29.234130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Write session: Do CDS request
2025-10-02T09:31:29.234135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:29.244179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.244234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:29.244243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1141
2025-10-02T09:31:29.244365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.244385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:29.244390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:29.244393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:29.244645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1141 sessionId:  describe result for acl check
2025-10-02T09:31:29.244664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:29.244668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:29.244669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:29.244672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554677014918928:9178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:29.244869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:29.245042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554677014918928:9178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:29.246732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554677014918928:9178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:29.247125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:29.247228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:29.247235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:29.247241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:29.247268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:29.247290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554676939382397:7668]
2025-10-02T09:31:29.247637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:29.247814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:29.247837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:29.248015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:29.248042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.248046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.248047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.248047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.248048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.248048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.248049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.248049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.248050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.248050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.248051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.248051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.248054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.248060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.248062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.248064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.248067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.248069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.248070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.248072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.248074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.248076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.248078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.248080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.248084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.248088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.248091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.248094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.248096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.248103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.248105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.248108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.248112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.248114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.248116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.248119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.248121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.248124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.248129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.248132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.248134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.248137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.248142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.248145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.248147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.248149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.248154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.248156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.248173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:29.251056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554677014918928:9178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:29.251067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554677014918928:9178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:29.251068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554677014918928:9178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:29.251072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:29.255637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:29.257233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:29.257244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:29.257245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:29.257247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:29.257251Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1140 [2:7556554676939382397:7668]
2025-10-02T09:31:29.257258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:29.257268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:29.257269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.257272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.257273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.257282Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:29.257285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:29.257290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:29.257319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.257324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.257324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.257326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:29.257328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:29.257365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:29.257370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.257376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.257381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.257393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:29.257406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918968:9178], now have 1 active actors on pipe
2025-10-02T09:31:29.257409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918747:2446], now have 1 active actors on pipe
2025-10-02T09:31:29.257412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.257413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.257414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.257423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:29.257432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:29.257435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:29.257437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:29.257438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:29.257442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:29.257444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:29.257458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.257444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1140
2025-10-02T09:31:29.257463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:29.257464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:29.257448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1140
2025-10-02T09:31:29.257477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.257482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.257501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:29.257508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.257510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.257515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:29.257520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.257525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:29.257537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.257630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.257636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.257643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.257697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1141 partition: 0 MaxSeqNo: 36 sessionId: src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0
2025-10-02T09:31:29.257936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150efbee-e0146bd5-1b8ca74d-33f31728_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:29.260090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Write session: try to update token
2025-10-02T09:31:29.260100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:29.266967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:29.266977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.266979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:29.266980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:29.266986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.266988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.266990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554676939382391:7668]
2025-10-02T09:31:29.267011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:29.267014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.267015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:29.267025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:29.267034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:29.267038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:29.267129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:29.270421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId: src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:29.272519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.333786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014918998:8968]
2025-10-02T09:31:29.333958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1140, pipe: [1:7556554677014918998:8968]
2025-10-02T09:31:29.381264Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.381509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.381522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.381560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918998:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.381743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:29.381768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.381752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:29.381761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014918998:8968]
2025-10-02T09:31:29.381778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.381794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1141 reason: error at write: Disconnected sessionId: src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0
2025-10-02T09:31:29.381934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1141 sessionId: src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0 is DEAD
2025-10-02T09:31:29.382053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:29.382061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Write session will restart in 0.007471s
2025-10-02T09:31:29.382077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Write session: Do CDS request
2025-10-02T09:31:29.382081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:29.390143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.390411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:29.390420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1142
2025-10-02T09:31:29.390492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.390512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:29.390518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:29.390521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:29.390821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1142 sessionId:  describe result for acl check
2025-10-02T09:31:29.390847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:29.390851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:29.390852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:29.390855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554677014919179:9189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:29.391231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554677014919179:9189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:29.392062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:29.392528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554677014919179:9189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:29.394463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:29.394535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554677014919179:9189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:29.394543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554677014919179:9189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:29.394545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554677014919179:9189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:29.394549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:29.394576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:29.394582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:29.394587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:29.394615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:29.394639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554676939382654:7682]
2025-10-02T09:31:29.394994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:29.395162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:29.395185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:29.395359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:29.395386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.395390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.395391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.395391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.395392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.395393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.395393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.395394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.395394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.395395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.395395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.395396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.395399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.395404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.395407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.395410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.395412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.395414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.395416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.395417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.395419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.395423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.395424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.395426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.395429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.395433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.395436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.395439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.395443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.395445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.395448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.395451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.395453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.395455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.395457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.395459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.395462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.395464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.395466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.395472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.395475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.395477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.395480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.395482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.395484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.395487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.395489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.395492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.395510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:29.402894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:29.404387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:29.404398Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:29.404399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:29.404401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:29.404404Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1141 [2:7556554676939382654:7682]
2025-10-02T09:31:29.404410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:29.404420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:29.404421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.404423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.404424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.404432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:29.404435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:29.404439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:29.404472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.404476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.404478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.404480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:29.404481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:29.404515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:29.404520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.404526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.404531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.404539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:29.404553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919216:9189], now have 1 active actors on pipe
2025-10-02T09:31:29.404558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014918999:2446], now have 1 active actors on pipe
2025-10-02T09:31:29.404563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.404564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.404565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.404573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:29.404583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:29.404588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:29.404590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:29.404592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:29.404593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:29.404595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:29.404596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1141
2025-10-02T09:31:29.404607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.404612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:29.404601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1141
2025-10-02T09:31:29.404619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:29.404628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.404631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.404647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:29.404654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.404656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.404657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:29.404661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.404667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:29.404677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.404754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.404759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.404766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.404839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1142 partition: 0 MaxSeqNo: 36 sessionId: src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0
2025-10-02T09:31:29.405054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890a2ea5-fd308c7e-e17ff4e3-12e36ba3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:29.407244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Write session: try to update token
2025-10-02T09:31:29.407254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:29.413872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:29.413885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.413886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:29.413887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:29.413894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.413896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.413898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554676939382649:7682]
2025-10-02T09:31:29.413921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:29.413921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:29.413924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.413924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:29.413925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:29.413928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:29.414037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:29.417465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId: src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:29.419632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.481763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014919228:8968]
2025-10-02T09:31:29.481957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1141, pipe: [1:7556554677014919228:8968]
2025-10-02T09:31:29.529350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.529693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.529704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.529735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919228:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.529942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.529930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014919228:8968]
2025-10-02T09:31:29.529951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.530042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:29.530050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:29.530095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1142 reason: error at write: Disconnected sessionId: src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0
2025-10-02T09:31:29.530242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1142 sessionId: src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0 is DEAD
2025-10-02T09:31:29.530376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:29.530384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Write session will restart in 0.007983s
2025-10-02T09:31:29.530402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Write session: Do CDS request
2025-10-02T09:31:29.530406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:29.539223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.539301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:29.539310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1143
2025-10-02T09:31:29.539410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.539430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:29.539436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:29.539439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:29.539741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1143 sessionId:  describe result for acl check
2025-10-02T09:31:29.539764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:29.539768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:29.539769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:29.539772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554677014919410:9193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:29.540142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554677014919410:9193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:29.540746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:29.541598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554677014919410:9193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:29.543334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:29.543529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:29.543537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:29.543544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:29.543563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554677014919410:9193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:29.543577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:29.543571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554677014919410:9193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:29.543573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554677014919410:9193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:29.543578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:29.543606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554676939382876:7684]
2025-10-02T09:31:29.543963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:29.544139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:29.544166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:29.544343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:29.544375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.544380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.544381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.544382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.544383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.544384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.544385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.544385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.544386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.544387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.544387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.544388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.544391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.544397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.544399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.544401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.544403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.544405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.544407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.544409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.544411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.544414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.544416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.544418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.544421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.544426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.544430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.544432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.544435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.544437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.544439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.544442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.544444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.544447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.544448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.544451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.544453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.544456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.544458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.544460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.544462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.544465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.544470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.544472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.544474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.544477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.544478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.544482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.544500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:29.551911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:29.553338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:29.553351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:29.553353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:29.553355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:29.553360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1142 [2:7556554676939382876:7684]
2025-10-02T09:31:29.553371Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:29.553384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:29.553387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.553389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.553390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.553399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:29.553406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:29.553411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:29.553443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.553448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.553449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.553450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:29.553452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:29.553489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:29.553493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.553500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.553505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.553516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:29.553531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919229:2446], now have 1 active actors on pipe
2025-10-02T09:31:29.553536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919448:9193], now have 1 active actors on pipe
2025-10-02T09:31:29.553540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.553541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.553542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.553549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:29.553559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:29.553562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:29.553564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:29.553565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:29.553569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:29.553571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:29.553587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.553593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:29.553598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:29.553584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1142
2025-10-02T09:31:29.553620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1142
2025-10-02T09:31:29.553661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.553666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.553681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5337033-d7e9857c-dffd407d-9e21c681_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:29.553688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.553690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.553691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:29.553695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.553703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:29.553870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.553998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.554003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.554010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.554062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1143 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5337033-d7e9857c-dffd407d-9e21c681_0
2025-10-02T09:31:29.554304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a3db29-2ed37035-6fa044db-b0ef0d74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5337033-d7e9857c-dffd407d-9e21c681_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:29.556599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Write session: try to update token
2025-10-02T09:31:29.556609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:29.562565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:29.562577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.562583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.562607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:29.562614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:29.562739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:29.562859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:29.562982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:29.563098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:29.563328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:29.563357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:29.566858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId: src_id|e5337033-d7e9857c-dffd407d-9e21c681_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:29.568795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.568942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.568953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.568972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:29.569028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:29.571111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:29.571121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.571122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:29.571123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:29.571130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.571132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.571134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554676939382870:7684]
2025-10-02T09:31:29.571155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:29.571162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:29.571163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.571165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:29.571166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:29.571169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:29.571287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:29.630230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014919460:8968]
2025-10-02T09:31:29.630427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1142, pipe: [1:7556554677014919460:8968]
2025-10-02T09:31:29.688741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.695102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.695117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.695245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.695297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.695353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.695408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.695459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.695466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.695522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.695573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.695628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.695691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.695730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.695736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.695791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.695845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.695900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.695963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.696000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.696007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.696062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.696114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.696165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.696227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.696263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.696268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.696321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.696372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.696430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.696487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.696523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.696528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.696582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.696632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.696694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.696751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.696787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.696792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.696852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.696904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.696963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.697018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.697075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.697080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.697132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.697183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.697243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.697295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.697329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.697334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.697382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.697432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.697488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.697545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.697579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.697584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.697634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:29.697681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:29.697735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:29.697790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:29.697825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:29.697830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:29.697860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919460:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.698029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014919460:8968]
2025-10-02T09:31:29.698029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:29.698032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:29.698053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1143 reason: error at write: Disconnected sessionId: src_id|e5337033-d7e9857c-dffd407d-9e21c681_0
2025-10-02T09:31:29.698053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.698200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1143 sessionId: src_id|e5337033-d7e9857c-dffd407d-9e21c681_0 is DEAD
2025-10-02T09:31:29.698304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:29.698310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Write session will restart in 0.008184s
2025-10-02T09:31:29.698325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Write session: Do CDS request
2025-10-02T09:31:29.698329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:29.698551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.707096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.707428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:29.707437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1144
2025-10-02T09:31:29.707528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.707549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:29.707555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:29.707559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:29.707815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1144 sessionId:  describe result for acl check
2025-10-02T09:31:29.707833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:29.707837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:29.707838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:29.707840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554677014919620:9197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:29.708175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554677014919620:9197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:29.709697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554677014919620:9197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:29.712249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:29.712311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554677014919620:9197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:29.712321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554677014919620:9197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:29.712324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554677014919620:9197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:29.712329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:29.712530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:29.712632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:29.712638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:29.712644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:29.712675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:29.712701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554676939383113:7687]
2025-10-02T09:31:29.713097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:29.713315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:29.713352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:29.713547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:29.713576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.713581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.713582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.713583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.713584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.713585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.713586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.713587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.713588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.713589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.713590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.713591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.713596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.713605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.713608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.713610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.713612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.713614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.713617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.713618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.713621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.713623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.713625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.713627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.713631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.713635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.713638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.713641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.713647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.713650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.713652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.713655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.713658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.713661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.713663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.713666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.713672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.713674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.713677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.713680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.713686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.713690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.713692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.713695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.713700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.713703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.713705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.713708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.713728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:29.721491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:29.722941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:29.722951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:29.722953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:29.722955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:29.722958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1143 [2:7556554676939383113:7687]
2025-10-02T09:31:29.722966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:29.722976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:29.722977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.722979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.722980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.722989Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:29.722993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:29.722998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:29.723028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.723033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.723034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.723036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:29.723037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:29.723073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:29.723078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.723085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.723091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.723099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:29.723111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919462:2446], now have 1 active actors on pipe
2025-10-02T09:31:29.723116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919684:9197], now have 1 active actors on pipe
2025-10-02T09:31:29.723120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.723121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.723123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.723131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:29.723140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:29.723148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:29.723150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:29.723151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:29.723151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:29.723152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:29.723169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.723174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:29.723164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1143
2025-10-02T09:31:29.723175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1143
2025-10-02T09:31:29.723185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:29.723239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.723249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.723269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:29.723280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.723286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.723288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:29.723294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.723304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:29.723317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.723462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.723469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.723482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.723555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1144 partition: 0 MaxSeqNo: 36 sessionId: src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0
2025-10-02T09:31:29.723768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5337033-d7e9857c-dffd407d-9e21c681_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:29.726017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Write session: try to update token
2025-10-02T09:31:29.726028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:29.733206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:29.733222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.733224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:29.733226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:29.733235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.733239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.733242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554676939383107:7687]
2025-10-02T09:31:29.733279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:29.733280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:29.733284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:29.733284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.733286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:29.733286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:29.733420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:29.737150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId: src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:29.739435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.798160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014919716:8968]
2025-10-02T09:31:29.798307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1143, pipe: [1:7556554677014919716:8968]
2025-10-02T09:31:29.847060Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.847768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.847778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.847803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919716:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.847926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.847936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014919716:8968]
2025-10-02T09:31:29.847951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.847959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:29.848011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0
2025-10-02T09:31:29.848155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1144 sessionId: src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0 is DEAD
2025-10-02T09:31:29.848306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:29.848315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Write session will restart in 0.006226s
2025-10-02T09:31:29.848333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Write session: Do CDS request
2025-10-02T09:31:29.848337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:29.855168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.855242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:29.855252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1145
2025-10-02T09:31:29.855355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:29.855376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:29.855382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:29.855385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:29.855674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1145 sessionId:  describe result for acl check
2025-10-02T09:31:29.855697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:29.855702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:29.855703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:29.855706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554677014919821:9203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:29.856046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554677014919821:9203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:29.857740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554677014919821:9203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:29.861144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:29.861318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554677014919821:9203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:29.861326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554677014919821:9203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:29.861328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554677014919821:9203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:29.861332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:29.861376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:29.861467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:29.861473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:29.861479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:29.861504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:29.861526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554676939383337:7689]
2025-10-02T09:31:29.861863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:29.862026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:29.862050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:29.862216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:29.862246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.862250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.862251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.862251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.862252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.862252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.862253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.862253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.862254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.862254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.862255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.862255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.862258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.862264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.862266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.862268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.862270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.862272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.862274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.862276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.862278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.862280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.862282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.862284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.862287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.862292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:29.862295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.862298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:29.862300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.862302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:29.862304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.862307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:29.862309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.862312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:29.862314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.862316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:29.862318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.862321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:29.862323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.862325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:29.862328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.862331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:29.862333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.862335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.862337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.862340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.862342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.862345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.862361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:29.869935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:29.871429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:29.871440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:29.871441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:29.871443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:29.871446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1144 [2:7556554676939383337:7689]
2025-10-02T09:31:29.871454Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:29.871464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:29.871469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.871470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.871471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.871481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:29.871485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:29.871492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:29.871522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.871527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.871528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.871530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:29.871531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:29.871565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:29.871570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.871577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:29.871582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:29.871590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:29.871604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919943:9203], now have 1 active actors on pipe
2025-10-02T09:31:29.871609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919719:2446], now have 1 active actors on pipe
2025-10-02T09:31:29.871613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.871615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.871616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.871623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:29.871633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:29.871638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:29.871640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:29.871641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:29.871643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:29.871645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:29.871641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1144
2025-10-02T09:31:29.871644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1144
2025-10-02T09:31:29.871658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.871663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:29.871666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:29.871680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.871684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.871703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:29.871709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:29.871712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:29.871713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:29.871718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:29.871726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:29.871740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.871824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.871832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.871841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:29.871912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1145 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0
2025-10-02T09:31:29.872118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96ff7d5-90fe34ce-fee5f70-babf3eb9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:29.874347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Write session: try to update token
2025-10-02T09:31:29.874357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:29.881098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:29.881111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:29.881113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:29.881114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:29.881119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.881123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.881125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554676939383331:7689]
2025-10-02T09:31:29.881147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:29.881149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:29.881151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:29.881158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:29.881162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:29.881164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:29.881268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:29.884549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId: src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:29.886551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:29.948187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554677014919954:8968]
2025-10-02T09:31:29.948381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1144, pipe: [1:7556554677014919954:8968]
2025-10-02T09:31:29.997519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:29.997724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:29.997733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:29.997761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919954:8968], now have 1 active actors on pipe
2025-10-02T09:31:29.998304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:29.998349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:29.998353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554677014919954:8968]
2025-10-02T09:31:29.998367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:29.998410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0
2025-10-02T09:31:29.998543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1145 sessionId: src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0 is DEAD
2025-10-02T09:31:29.998654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:29.998659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Write session will restart in 0.006340s
2025-10-02T09:31:29.998674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Write session: Do CDS request
2025-10-02T09:31:29.998678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.006145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.006240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.006251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1146
2025-10-02T09:31:30.006350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.006371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.006378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.006381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.006752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1146 sessionId:  describe result for acl check
2025-10-02T09:31:30.006785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.006786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.006788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.006792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309887357:9207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.007258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309887357:9207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.008756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309887357:9207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.012678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.012728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309887357:9207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.012739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309887357:9207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.012741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309887357:9207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.012747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.012944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.013047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.013054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.013060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.013089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.013112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234350860:7692]
2025-10-02T09:31:30.013458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.013631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.013653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.013833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.013861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.013865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.013865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.013866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.013867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.013867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.013879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.013879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.013880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.013880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.013881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.013881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.013884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.013891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.013893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.013895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.013897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.013900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.013902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.013904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.013905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.013908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.013910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.013912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.013915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.013920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.013923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.013926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.013932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.013935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.013937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.013940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.013946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.013948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.013951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.013953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.013956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.013959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.013964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.013967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.013970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.013976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.013978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.013980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.013985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.013988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.013990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.013993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.014011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.021668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.023287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.023297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.023298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.023300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.023303Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1145 [2:7556554681234350860:7692]
2025-10-02T09:31:30.023310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.023321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.023326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.023328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.023329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.023339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.023343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.023347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.023379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.023384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.023385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.023386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.023388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.023429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.023435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.023441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.023447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.023459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.023473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.023477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.023478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.023484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.023491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.023493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.023495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.023495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.023502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.023507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.023515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887474:9207], now have 1 active actors on pipe
2025-10-02T09:31:30.023521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554677014919956:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.023537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.023546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.023568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.023558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1145
2025-10-02T09:31:30.023580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1145
2025-10-02T09:31:30.023595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.023602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.023621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcf00a39-73606c6e-48697a15-ae565709_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.023629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.023636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.023638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.023645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.023654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.023667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.023799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.023803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.023811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.023869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1146 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcf00a39-73606c6e-48697a15-ae565709_0
2025-10-02T09:31:30.024130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac85f0ce-eca33d21-83c7569f-b8ee8d84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcf00a39-73606c6e-48697a15-ae565709_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.026487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Write session: try to update token
2025-10-02T09:31:30.026501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.032918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:30.032931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.032937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.032968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:30.032981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:30.033109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:30.033231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:30.033354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:30.033469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:30.033624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:30.033650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:30.037100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId: src_id|fcf00a39-73606c6e-48697a15-ae565709_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.039194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:30.039329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.039341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.039364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:30.039430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:30.041736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.041745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.041746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.041747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.041753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.041757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.041760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234350854:7692]
2025-10-02T09:31:30.041781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.041786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.041787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.041792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.041796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.041798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.041900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.098717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554681309887485:8968]
2025-10-02T09:31:30.098926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1145, pipe: [1:7556554681309887485:8968]
2025-10-02T09:31:30.161761Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:30.168013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.168033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.168163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.168215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.168284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.168337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.168511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.168520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.168576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.168627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.168679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.168818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.168861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.168868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.168927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.168976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.169029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.169082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.169120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.169126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.169179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.169233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.169287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.169340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.169376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.169381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.169446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.169497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.169549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.169600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.169636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.169640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.169695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.169746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.169802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.169858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.169893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.169898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.169947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.169998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.170053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.170104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.170140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.170144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.170195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.170244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.170293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.170347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.170382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.170387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.170436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.170485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.170536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.170588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.170624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.170628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.170678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.170727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.170776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.170827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.170861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.170865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.170902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887485:8968], now have 1 active actors on pipe
2025-10-02T09:31:30.171076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:30.171087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:30.171098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554681309887485:8968]
2025-10-02T09:31:30.171105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1146 reason: error at write: Disconnected sessionId: src_id|fcf00a39-73606c6e-48697a15-ae565709_0
2025-10-02T09:31:30.171112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:30.171188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:30.171258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1146 sessionId: src_id|fcf00a39-73606c6e-48697a15-ae565709_0 is DEAD
2025-10-02T09:31:30.171401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:30.171410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Write session will restart in 0.008154s
2025-10-02T09:31:30.171425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Write session: Do CDS request
2025-10-02T09:31:30.171429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.180148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.180218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.180227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1147
2025-10-02T09:31:30.180322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.180342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.180348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.180352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.180604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1147 sessionId:  describe result for acl check
2025-10-02T09:31:30.180630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.180635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.180637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.180641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309887676:9211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.181028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309887676:9211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.182888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309887676:9211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.184383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.184643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.184733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.184739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.184745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.184770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.184792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234351088:7694]
2025-10-02T09:31:30.185093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309887676:9211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.185102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309887676:9211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.185105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309887676:9211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.185110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.185146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.185296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.185318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.185492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.185521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.185525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.185525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.185526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.185527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.185527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.185528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.185528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.185529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.185529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.185530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.185530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.185533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.185539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.185541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.185543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.185545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.185547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.185549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.185551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.185553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.185556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.185558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.185560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.185563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.185567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.185570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.185573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.185575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.185578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.185580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.185582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.185585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.185587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.185589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.185592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.185594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.185597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.185599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.185602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.185604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.185606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.185608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.185611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.185615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.185618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.185620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.185623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.185641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.193132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.194669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.194681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.194682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.194684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.194688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1146 [2:7556554681234351088:7694]
2025-10-02T09:31:30.194695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.194705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.194709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.194711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.194712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.194722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.194725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.194733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.194764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.194768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.194769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.194771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.194772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.194810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.194814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.194822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.194830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.194842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.194856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887714:9211], now have 1 active actors on pipe
2025-10-02T09:31:30.194861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887491:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.194866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.194870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.194871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.194886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.194895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.194900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.194904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.194906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.194908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.194909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.194900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1146
2025-10-02T09:31:30.194921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.194926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.194911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1146
2025-10-02T09:31:30.194930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.194943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.194948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.194971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.194977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.194979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.194980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.194985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.194994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.195010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.195088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.195093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.195101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.195156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1147 partition: 0 MaxSeqNo: 36 sessionId: src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0
2025-10-02T09:31:30.195386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf00a39-73606c6e-48697a15-ae565709_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.197598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Write session: try to update token
2025-10-02T09:31:30.197609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.204657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.204673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.204674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.204676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.204682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.204685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.204688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234351082:7694]
2025-10-02T09:31:30.204712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.204716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.204717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.204719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.204722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.204725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.204854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.208053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId: src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.210047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:30.271286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554681309887728:8968]
2025-10-02T09:31:30.271497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1146, pipe: [1:7556554681309887728:8968]
2025-10-02T09:31:30.325192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:30.325451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.325460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.325486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887728:8968], now have 1 active actors on pipe
2025-10-02T09:31:30.325581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:30.325655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:30.325730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1147 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0
2025-10-02T09:31:30.325896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1147 sessionId: src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0 is DEAD
2025-10-02T09:31:30.326018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:30.326031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Write session will restart in 0.006792s
2025-10-02T09:31:30.326045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Write session: Do CDS request
2025-10-02T09:31:30.326049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.326047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554681309887728:8968]
2025-10-02T09:31:30.326063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:30.334148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.334228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.334239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1148
2025-10-02T09:31:30.334332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.334352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.334357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.334359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.334672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1148 sessionId:  describe result for acl check
2025-10-02T09:31:30.334691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.334696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.334697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.334701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309887889:9223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.335023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309887889:9223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.336604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309887889:9223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.337080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.339540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.339644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.339757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.339749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309887889:9223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.339767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.339757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309887889:9223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.339759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309887889:9223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.339763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.339801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.339824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234351354:7703]
2025-10-02T09:31:30.340173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.340344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.340367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.340543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.340572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.340576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.340576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.340577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.340577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.340578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.340579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.340579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.340580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.340580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.340581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.340581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.340584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.340590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.340592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.340594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.340596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.340598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.340600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.340602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.340604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.340606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.340608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.340609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.340614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.340618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.340621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.340624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.340626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.340629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.340631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.340634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.340636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.340638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.340640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.340643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.340645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.340648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.340650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.340653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.340655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.340657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.340659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.340662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.340665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.340668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.340670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.340673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.340689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.348296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.349625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.349635Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.349636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.349638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.349642Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1147 [2:7556554681234351354:7703]
2025-10-02T09:31:30.349649Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.349659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.349661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.349662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.349663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.349672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.349675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.349684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.349715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.349720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.349722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.349724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.349725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.349761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.349766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.349772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.349778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.349786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.349800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.349804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.349805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.349809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.349817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887976:9223], now have 1 active actors on pipe
2025-10-02T09:31:30.349818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.349819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887743:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.349820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.349822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.349824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.349831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.349833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.349846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.349855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.349852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1147
2025-10-02T09:31:30.349871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.349867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1147
2025-10-02T09:31:30.350035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.350051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.350067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.350074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.350076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.350077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.350082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.350088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.350098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.350211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.350216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.350223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.350274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1148 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0
2025-10-02T09:31:30.350510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6812f2f-e22540e8-c4298d15-cb469d1e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.352923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Write session: try to update token
2025-10-02T09:31:30.352934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.360388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.360403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.360405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.360406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.360411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.360415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.360417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234351349:7703]
2025-10-02T09:31:30.360442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.360445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.360446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.360462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.360471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.360474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.360549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.364415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId: src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.366528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:30.426394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554681309887987:8968]
2025-10-02T09:31:30.426616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1147, pipe: [1:7556554681309887987:8968]
2025-10-02T09:31:30.477998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:30.478376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.478389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.478418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887987:8968], now have 1 active actors on pipe
2025-10-02T09:31:30.478574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:30.478592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:30.478596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:30.478601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:30.478640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554681309887987:8968]
2025-10-02T09:31:30.478662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1148 reason: error at write: Disconnected sessionId: src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0
2025-10-02T09:31:30.478834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1148 sessionId: src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0 is DEAD
2025-10-02T09:31:30.478939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:30.478945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Write session will restart in 0.009510s
2025-10-02T09:31:30.478964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Write session: Do CDS request
2025-10-02T09:31:30.478969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.489077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.489229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.489241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1149
2025-10-02T09:31:30.489353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.489381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.489390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.489394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.489640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.489746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1149 sessionId:  describe result for acl check
2025-10-02T09:31:30.489776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.489782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.489784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.489788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309888178:9227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.490215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309888178:9227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.491848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309888178:9227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.492418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.492528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.492535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.492540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.492570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.492763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234351582:7711]
2025-10-02T09:31:30.493132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.493318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.493343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.493523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.493551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.493557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.493557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.493558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.493558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.493559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.493559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.493560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.493560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.493561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.493561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.493562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.493564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.493570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.493572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.493574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.493576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.493578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.493581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.493582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.493584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.493586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.493588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.493590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.493594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.493598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.493601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.493604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.493607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.493609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.493612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.493615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.493617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.493619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.493621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.493624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.493626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.493628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.493631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.493633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.493636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.493639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.493642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.493644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.493646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.493649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.493651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.493654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.493670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.493809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309888178:9227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.493819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309888178:9227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.493822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309888178:9227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.493827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.501258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.502598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.502607Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.502609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.502611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.502614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1148 [2:7556554681234351582:7711]
2025-10-02T09:31:30.502621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.502632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.502633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.502635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.502636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.502645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.502648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.502652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.502683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.502688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.502689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.502691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.502693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.502730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.502735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.502742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.502751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.502762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.502776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309887989:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.502782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888218:9227], now have 1 active actors on pipe
2025-10-02T09:31:30.502785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.502786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.502787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.502795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.502806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.502811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.502813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.502815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.502816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.502818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.502831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.502836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.502838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.502843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1148
2025-10-02T09:31:30.502849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1148
2025-10-02T09:31:30.502918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.502923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.502938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8222df53-6c8c317a-988c982e-82b3ff45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.502945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.502947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.502948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.502953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.502961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.502971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.503088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.503094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.503101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.503162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1149 partition: 0 MaxSeqNo: 36 sessionId: src_id|8222df53-6c8c317a-988c982e-82b3ff45_0
2025-10-02T09:31:30.503383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d23e39c-6489fae2-3562160d-5e3d3ebb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8222df53-6c8c317a-988c982e-82b3ff45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.505744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Write session: try to update token
2025-10-02T09:31:30.505755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.512287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:30.512301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.512306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.512336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:30.512349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:30.512492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:30.512606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:30.512727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:30.512858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:30.513010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:30.513037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:30.516537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId: src_id|8222df53-6c8c317a-988c982e-82b3ff45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.518617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:30.518763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.518774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.518793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:30.518853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:30.521817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.521830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.521832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.521833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.521839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.521842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.521844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234351575:7711]
2025-10-02T09:31:30.521866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.521870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.521871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.521873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.521873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.521875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.521981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.578979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554681309888225:8968]
2025-10-02T09:31:30.579169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1148, pipe: [1:7556554681309888225:8968]
2025-10-02T09:31:30.638850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:30.645321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.645340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.645473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.645524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.645579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.645632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.645927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.645935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.645991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.646042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.646097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.646156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.646193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.646198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.646251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.646302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.646356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.646410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.646448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.646454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.646504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.646555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.646608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.646661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.646698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.646703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.646756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.646806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.646861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.646923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.646960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.646964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.647017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.647067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.647121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.647175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.647212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.647216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.647266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.647316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.647369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.647422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.647591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.647598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.647648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.647701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.647752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.647803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.647836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.647843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.647892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.647945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.647997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.648045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.648078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.648083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.648130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:30.648180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:30.648231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:30.648283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:30.648317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:30.648323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:30.648353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888225:8968], now have 1 active actors on pipe
2025-10-02T09:31:30.648605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554681309888225:8968]
2025-10-02T09:31:30.648617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:30.648634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:30.648636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:30.648653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1149 reason: error at write: Disconnected sessionId: src_id|8222df53-6c8c317a-988c982e-82b3ff45_0
2025-10-02T09:31:30.648678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:30.648863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1149 sessionId: src_id|8222df53-6c8c317a-988c982e-82b3ff45_0 is DEAD
2025-10-02T09:31:30.648967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:30.648973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Write session will restart in 0.009485s
2025-10-02T09:31:30.648987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Write session: Do CDS request
2025-10-02T09:31:30.648991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.659157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.659264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.659277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1150
2025-10-02T09:31:30.659366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.659392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.659400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.659403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.659701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1150 sessionId:  describe result for acl check
2025-10-02T09:31:30.659721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.659726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.659727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.659730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309888416:9231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.660109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309888416:9231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.660930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.661723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309888416:9231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.663489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.663594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.663602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.663609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.663636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.663658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234351811:7713]
2025-10-02T09:31:30.663774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309888416:9231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.663783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309888416:9231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.663786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309888416:9231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.663790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.664008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.664225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.664250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.664452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.664486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.664490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.664491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.664491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.664492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.664492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.664493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.664494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.664495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.664495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.664496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.664496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.664499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.664505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.664507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.664509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.664511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.664513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.664515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.664517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.664519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.664521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.664523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.664525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.664529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.664533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.664537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.664541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.664543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.664546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.664548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.664550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.664552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.664559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.664561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.664563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.664566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.664571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.664573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.664576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.664578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.664581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.664586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.664588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.664591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.664593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.664595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.664598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.664614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.672216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.673679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.673690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.673692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.673694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.673697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1149 [2:7556554681234351811:7713]
2025-10-02T09:31:30.673704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.673713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.673715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.673716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.673717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.673726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.673729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.673733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.673764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.673769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.673770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.673771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.673773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.673809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.673814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.673821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.673826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.673834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.673847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.673851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.673852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.673856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.673864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.673868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.673870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.673871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.673874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.673875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.673881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888227:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.673896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888453:9231], now have 1 active actors on pipe
2025-10-02T09:31:30.673901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.673905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.673927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.673923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1149
2025-10-02T09:31:30.673938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1149
2025-10-02T09:31:30.674001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.674007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.674022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.674028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.674031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.674032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.674037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.674045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.674055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.674179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.674184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.674191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.674247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1150 partition: 0 MaxSeqNo: 36 sessionId: src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0
2025-10-02T09:31:30.674477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8222df53-6c8c317a-988c982e-82b3ff45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.676663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Write session: try to update token
2025-10-02T09:31:30.676673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.683826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.683840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.683842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.683843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.683849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.683852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.683855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234351806:7713]
2025-10-02T09:31:30.683880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.683884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.683885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.683910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.683918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.683923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.683998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.687231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId: src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.689181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:30.748944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554681309888476:8968]
2025-10-02T09:31:30.749061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1149, pipe: [1:7556554681309888476:8968]
2025-10-02T09:31:30.800580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:30.800886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.800895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.800921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888476:8968], now have 1 active actors on pipe
2025-10-02T09:31:30.801100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:30.801104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:30.801141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554681309888476:8968]
2025-10-02T09:31:30.801145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:30.801201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0
2025-10-02T09:31:30.801351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1150 sessionId: src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0 is DEAD
2025-10-02T09:31:30.801463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:30.801471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Write session will restart in 0.006323s
2025-10-02T09:31:30.801485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Write session: Do CDS request
2025-10-02T09:31:30.801488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.809099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.809178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.809189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1151
2025-10-02T09:31:30.809304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.809331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.809339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.809342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.809708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1151 sessionId:  describe result for acl check
2025-10-02T09:31:30.809738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.809744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.809745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.809750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309888600:9237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.810195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309888600:9237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.812000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309888600:9237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.815133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.815296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309888600:9237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.815306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309888600:9237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.815309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309888600:9237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.815313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.815413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.815517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.815524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.815530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.815560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.815670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234352053:7716]
2025-10-02T09:31:30.816010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.816177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.816202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.816380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.816409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.816413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.816413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.816414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.816414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.816415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.816416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.816416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.816417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.816417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.816418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.816419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.816421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.816427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.816430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.816432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.816434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.816436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.816438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.816440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.816442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.816445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.816447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.816449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.816454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.816457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.816461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.816464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.816466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.816469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.816471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.816474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.816476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.816478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.816481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.816483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.816485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.816488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.816491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.816494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.816496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.816498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.816500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.816503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.816505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.816508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.816510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.816513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.816529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.824080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.825470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.825482Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.825484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.825486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.825489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1150 [2:7556554681234352053:7716]
2025-10-02T09:31:30.825495Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.825506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.825510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.825512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.825513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.825523Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.825526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.825534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.825566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.825571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.825572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.825574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.825576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.825614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.825619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.825625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.825630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.825639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.825654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888711:9237], now have 1 active actors on pipe
2025-10-02T09:31:30.825659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888484:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.825663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.825664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.825666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.825676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.825688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.825690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.825696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.825698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.825701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.825703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.825719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.825726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.825707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1150
2025-10-02T09:31:30.825724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1150
2025-10-02T09:31:30.825733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.825744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.825751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.825777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.825787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.825790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.825792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.825797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.825806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.825822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.825928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.825933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.825940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.826003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1151 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0
2025-10-02T09:31:30.826246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d451-c7269da5-dc3745d1-cbb9b801_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.828446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Write session: try to update token
2025-10-02T09:31:30.828457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.835132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.835147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.835149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.835151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.835157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.835160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.835163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234352047:7716]
2025-10-02T09:31:30.835183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.835187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.835189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.835201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.835206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.835208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.835321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.839109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId: src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.841077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:30.901542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554681309888725:8968]
2025-10-02T09:31:30.901733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1150, pipe: [1:7556554681309888725:8968]
2025-10-02T09:31:30.949910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:30.950277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.950287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.950312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888725:8968], now have 1 active actors on pipe
2025-10-02T09:31:30.950429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:30.950462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:30.950474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:30.950486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:30.950522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554681309888725:8968]
2025-10-02T09:31:30.950527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1151 reason: error at write: Disconnected sessionId: src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0
2025-10-02T09:31:30.950676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1151 sessionId: src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0 is DEAD
2025-10-02T09:31:30.950800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:30.950809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Write session will restart in 0.009829s
2025-10-02T09:31:30.950851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Write session: Do CDS request
2025-10-02T09:31:30.950856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:30.960868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:30.961118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.961179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:30.961188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1152
2025-10-02T09:31:30.961280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:30.961301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:30.961307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:30.961310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:30.961609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1152 sessionId:  describe result for acl check
2025-10-02T09:31:30.961634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:30.961638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:30.961639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:30.961642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554681309888923:9241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:30.961973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554681309888923:9241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:30.963318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:30.963400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554681309888923:9241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:30.963562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:30.963571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:30.963580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:30.963624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:30.963647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554681234352285:7719]
2025-10-02T09:31:30.964007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:30.964170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:30.964194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:30.964373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:30.964402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.964406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.964406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.964407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.964408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.964408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.964409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.964409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.964410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.964410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.964411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.964412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.964414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.964420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.964422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.964425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.964427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.964428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.964430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.964432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.964434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.964437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.964439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.964440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.964444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.964449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:30.964452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.964455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:30.964457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.964460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:30.964462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.964465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:30.964471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.964473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:30.964476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.964478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:30.964480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.964483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:30.964485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.964488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:30.964493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.964496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:30.964498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.964501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.964503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.964506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.964512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.964514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.964532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:30.968417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554681309888923:9241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:30.968427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554681309888923:9241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:30.968428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554681309888923:9241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:30.968433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:30.972029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:30.973392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:30.973403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:30.973404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:30.973406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:30.973409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1151 [2:7556554681234352285:7719]
2025-10-02T09:31:30.973416Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:30.973426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:30.973431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.973433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.973434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.973442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:30.973447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:30.973451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:30.973479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.973484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.973485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.973487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:30.973489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:30.973526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:30.973530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.973537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:30.973542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:30.973552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:30.973566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888729:2446], now have 1 active actors on pipe
2025-10-02T09:31:30.973572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554681309888959:9241], now have 1 active actors on pipe
2025-10-02T09:31:30.973577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.973579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.973581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.973591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:30.973602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1151
2025-10-02T09:31:30.973626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1151
2025-10-02T09:31:30.973604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:30.973604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:30.973613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:30.973615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:30.973617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:30.973619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:30.973635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.973638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:30.973639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:30.973655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.973658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.973681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:30.973687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:30.973689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:30.973690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:30.973696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:30.973701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:30.973712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.973807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:30.973812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:30.973821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:30.973878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1152 partition: 0 MaxSeqNo: 36 sessionId: src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0
2025-10-02T09:31:30.974092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b68b41d-85f4b9d1-2b2b6508-9338837c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:30.976431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Write session: try to update token
2025-10-02T09:31:30.976443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:30.983881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:30.983895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:30.983898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:30.983899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:30.983904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.983907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.983909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554681234352279:7719]
2025-10-02T09:31:30.983931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:30.983935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:30.983936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:30.983936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:30.983939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:30.983941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:30.984069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:30.987739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId: src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:30.989605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.050531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604856262:8968]
2025-10-02T09:31:31.050703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1151, pipe: [1:7556554685604856262:8968]
2025-10-02T09:31:31.099899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:31.100293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.100302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.100327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856262:8968], now have 1 active actors on pipe
2025-10-02T09:31:31.100455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:31.100530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604856262:8968]
2025-10-02T09:31:31.100530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:31.100560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:31.100620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0
2025-10-02T09:31:31.100771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1152 sessionId: src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0 is DEAD
2025-10-02T09:31:31.100909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:31.100919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Write session will restart in 0.008363s
2025-10-02T09:31:31.100933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Write session: Do CDS request
2025-10-02T09:31:31.100937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:31.110130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.110264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:31.110275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1153
2025-10-02T09:31:31.110357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.110381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:31.110389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:31.110392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:31.110723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1153 sessionId:  describe result for acl check
2025-10-02T09:31:31.110756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:31.110761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:31.110762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:31.110767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554685604856455:9245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:31.111213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554685604856455:9245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:31.111214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:31.113022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554685604856455:9245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:31.114010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:31.114108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:31.114115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:31.114121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:31.114147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:31.114170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554685529319813:7721]
2025-10-02T09:31:31.114521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:31.114691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:31.114726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:31.114925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:31.114929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554685604856455:9245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:31.114939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554685604856455:9245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:31.114941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554685604856455:9245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:31.114955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.114945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:31.114959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.114960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.114960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.114961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.114961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.114962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.114962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.114963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.114963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.114964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.114964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.114967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.114973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.114975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.114977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.114979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.114981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.114983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.114985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.114987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.114989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.114991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.114993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.114996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.115000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.115003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.115006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.115010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.115012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.115014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.115017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.115019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.115022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.115023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.115026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.115028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.115031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.115033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.115035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.115037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.115040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.115042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.115044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.115046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.115049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.115051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.115053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.115070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:31.122472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:31.124060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:31.124072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:31.124073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:31.124075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:31.124078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1152 [2:7556554685529319813:7721]
2025-10-02T09:31:31.124086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:31.124096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:31.124101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.124103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.124104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.124112Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:31.124115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:31.124121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:31.124154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.124159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.124160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.124162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:31.124163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:31.124198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:31.124202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.124210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.124215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.124224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:31.124237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856263:2446], now have 1 active actors on pipe
2025-10-02T09:31:31.124242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856494:9245], now have 1 active actors on pipe
2025-10-02T09:31:31.124246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.124248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.124249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.124257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:31.124267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:31.124272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:31.124274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:31.124275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:31.124276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:31.124277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:31.124264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1152
2025-10-02T09:31:31.124290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.124295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:31.124297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1152
2025-10-02T09:31:31.124302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:31.124314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.124316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.124331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b847114-fd5a40ad-267e7854-8c78872f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:31.124338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.124340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.124341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:31.124346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.124351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:31.124361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.124437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.124444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.124454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.124511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1153 partition: 0 MaxSeqNo: 36 sessionId: src_id|b847114-fd5a40ad-267e7854-8c78872f_0
2025-10-02T09:31:31.124744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce74c2e-d8a96e3-4dc4cac9-1a2003f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b847114-fd5a40ad-267e7854-8c78872f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:31.126953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Write session: try to update token
2025-10-02T09:31:31.126964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:31.133619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:31.133632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.133633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:31.133634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:31.133639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.133642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.133644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554685529319807:7721]
2025-10-02T09:31:31.133666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:31.133670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.133671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:31.133680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:31.133687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:31.133690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:31.133774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:31.137750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId: src_id|b847114-fd5a40ad-267e7854-8c78872f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:31.139692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.200539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604856506:8968]
2025-10-02T09:31:31.200714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1152, pipe: [1:7556554685604856506:8968]
2025-10-02T09:31:31.249665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:31.250076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.250086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.250113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856506:8968], now have 1 active actors on pipe
2025-10-02T09:31:31.250234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:31.250270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:31.250301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604856506:8968]
2025-10-02T09:31:31.250307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:31.250360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1153 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b847114-fd5a40ad-267e7854-8c78872f_0
2025-10-02T09:31:31.250524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1153 sessionId: src_id|b847114-fd5a40ad-267e7854-8c78872f_0 is DEAD
2025-10-02T09:31:31.250625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:31.250634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Write session will restart in 0.009804s
2025-10-02T09:31:31.250654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Write session: Do CDS request
2025-10-02T09:31:31.250658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:31.260834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:31.261137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.261199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:31.261208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1154
2025-10-02T09:31:31.261307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.261326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:31.261333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:31.261335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:31.261646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1154 sessionId:  describe result for acl check
2025-10-02T09:31:31.261678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:31.261684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:31.261685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:31.261689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554685604856702:9250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:31.262122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554685604856702:9250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:31.263534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554685604856702:9250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:31.263802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:31.263904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:31.263910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:31.263916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:31.263945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:31.263969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554685529320048:7724]
2025-10-02T09:31:31.264302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:31.264458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:31.264480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:31.264652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:31.264682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.264686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.264686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.264687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.264687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.264688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.264688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.264689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.264689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.264690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.264690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.264691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.264693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.264699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.264701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.264703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.264705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.264707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.264709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.264711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.264713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.264715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.264717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.264719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.264723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.264727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.264730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.264733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.264735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.264737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.264739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.264742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.264745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.264748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.264749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.264752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.264754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.264756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.264760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.264762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.264765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.264767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.264769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.264772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.264774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.264777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.264779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.264781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.264798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:31.268638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554685604856702:9250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:31.268648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554685604856702:9250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:31.268650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554685604856702:9250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:31.268654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:31.272330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:31.273828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:31.273839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:31.273840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:31.273842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:31.273845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1153 [2:7556554685529320048:7724]
2025-10-02T09:31:31.273852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:31.273861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:31.273863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.273865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.273866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.273875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:31.273879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:31.273884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:31.273913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.273919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.273920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.273922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:31.273923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:31.273961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:31.273967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.273973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.273979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.273989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:31.274005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856741:9250], now have 1 active actors on pipe
2025-10-02T09:31:31.274011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856507:2446], now have 1 active actors on pipe
2025-10-02T09:31:31.274014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.274015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.274018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.274025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:31.274036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:31.274039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:31.274041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:31.274042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:31.274048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:31.274050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:31.274044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1153
2025-10-02T09:31:31.274063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.274057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1153
2025-10-02T09:31:31.274068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:31.274075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:31.274078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.274081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.274104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:31.274111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.274113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.274115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:31.274120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.274126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:31.274135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.274227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.274234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.274244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.274300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1154 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0
2025-10-02T09:31:31.274509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847114-fd5a40ad-267e7854-8c78872f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:31.276710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Write session: try to update token
2025-10-02T09:31:31.276719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:31.283757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:31.283771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.283772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:31.283773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:31.283779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.283781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.283783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554685529320042:7724]
2025-10-02T09:31:31.283805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:31.283809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.283810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:31.283820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:31.283827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:31.283830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:31.283919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:31.287216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId: src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:31.289095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.350565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604856763:8968]
2025-10-02T09:31:31.350719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1153, pipe: [1:7556554685604856763:8968]
2025-10-02T09:31:31.401430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:31.401777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.401787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.401813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856763:8968], now have 1 active actors on pipe
2025-10-02T09:31:31.402019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:31.402008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:31.402013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604856763:8968]
2025-10-02T09:31:31.402031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:31.402033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:31.402077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1154 reason: error at write: Disconnected sessionId: src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0
2025-10-02T09:31:31.402221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1154 sessionId: src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0 is DEAD
2025-10-02T09:31:31.402346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:31.402351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Write session will restart in 0.005259s
2025-10-02T09:31:31.402365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Write session: Do CDS request
2025-10-02T09:31:31.402369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:31.408094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.408333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:31.408341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1155
2025-10-02T09:31:31.408411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.408430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:31.408436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:31.408438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:31.408875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1155 sessionId:  describe result for acl check
2025-10-02T09:31:31.408906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:31.408911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:31.408913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:31.408917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554685604856841:9261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:31.409350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554685604856841:9261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:31.411153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554685604856841:9261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:31.412907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554685604856841:9261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:31.412917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554685604856841:9261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:31.412921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554685604856841:9261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:31.412925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:31.415724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:31.416016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:31.416111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:31.416118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:31.416124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:31.416152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:31.416311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554685529320319:7738]
2025-10-02T09:31:31.416658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:31.416830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:31.416856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:31.417038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:31.417068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.417072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.417073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.417073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.417074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.417074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.417075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.417075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.417076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.417076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.417077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.417077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.417080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.417086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.417088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.417090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.417092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.417094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.417096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.417098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.417100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.417102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.417104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.417106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.417111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.417115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.417118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.417121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.417123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.417126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.417128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.417131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.417133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.417136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.417139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.417142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.417144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.417147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.417149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.417151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.417153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.417156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.417158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.417160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.417163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.417165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.417167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.417174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.417191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:31.424717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:31.426077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:31.426089Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:31.426090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:31.426092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:31.426096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1154 [2:7556554685529320319:7738]
2025-10-02T09:31:31.426103Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:31.426112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:31.426114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.426116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.426117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.426126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:31.426132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:31.426137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:31.426167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.426171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.426172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.426174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:31.426175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:31.426213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:31.426217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.426223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.426228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.426240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:31.426253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604856773:2446], now have 1 active actors on pipe
2025-10-02T09:31:31.426259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857001:9261], now have 1 active actors on pipe
2025-10-02T09:31:31.426263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.426267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.426269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.426278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:31.426291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:31.426294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:31.426298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:31.426299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:31.426304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:31.426305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:31.426318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.426323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:31.426325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:31.426307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1154
2025-10-02T09:31:31.426322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1154
2025-10-02T09:31:31.426339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.426344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.426362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:31.426369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.426371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.426372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:31.426377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.426386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:31.426394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.426497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.426504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.426515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.426579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1155 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0
2025-10-02T09:31:31.426790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d82e97d-9daf7145-3a6b189f-6a2a03a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:31.428950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Write session: try to update token
2025-10-02T09:31:31.428961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:31.435598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:31.435612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.435614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:31.435615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:31.435620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.435622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.435625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554685529320314:7738]
2025-10-02T09:31:31.435646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:31.435650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.435652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:31.435659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:31.435664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:31.435675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:31.435766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:31.439015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId: src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:31.440923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.502109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604857016:8968]
2025-10-02T09:31:31.502254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1154, pipe: [1:7556554685604857016:8968]
2025-10-02T09:31:31.552919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:31.553367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.553377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.553404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857016:8968], now have 1 active actors on pipe
2025-10-02T09:31:31.553547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:31.553609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604857016:8968]
2025-10-02T09:31:31.553625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:31.553636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:31.553686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0
2025-10-02T09:31:31.553817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1155 sessionId: src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0 is DEAD
2025-10-02T09:31:31.553974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:31.553983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Write session will restart in 0.005565s
2025-10-02T09:31:31.554012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Write session: Do CDS request
2025-10-02T09:31:31.554017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:31.560111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.560205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:31.560212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1156
2025-10-02T09:31:31.560305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.560324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:31.560331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:31.560333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:31.560597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1156 sessionId:  describe result for acl check
2025-10-02T09:31:31.560615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:31.560619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:31.560620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:31.560623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554685604857094:9267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:31.560999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554685604857094:9267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:31.562732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554685604857094:9267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:31.564341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554685604857094:9267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:31.564349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554685604857094:9267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:31.564351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554685604857094:9267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:31.564355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:31.567006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:31.567315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:31.567411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:31.567418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:31.567424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:31.567452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:31.567476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554685529320554:7740]
2025-10-02T09:31:31.567831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:31.567989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:31.568012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:31.568194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:31.568224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.568228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.568229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.568229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.568230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.568230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.568231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.568231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.568232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.568232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.568233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.568233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.568236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.568243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.568245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.568247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.568249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.568251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.568253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.568255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.568257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.568259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.568261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.568263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.568267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.568271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.568274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.568277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.568279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.568282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.568284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.568286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.568289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.568291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.568294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.568296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.568298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.568301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.568303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.568305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.568308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.568310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.568313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.568315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.568317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.568320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.568322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.568325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.568341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:31.575821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:31.577400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:31.577409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:31.577410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:31.577412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:31.577415Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1155 [2:7556554685529320554:7740]
2025-10-02T09:31:31.577422Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:31.577431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:31.577433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.577434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.577435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.577443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:31.577450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:31.577454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:31.577486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.577490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.577491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.577493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:31.577494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:31.577529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:31.577534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.577541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.577546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.577554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:31.577569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857249:9267], now have 1 active actors on pipe
2025-10-02T09:31:31.577574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857020:2446], now have 1 active actors on pipe
2025-10-02T09:31:31.577578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.577579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.577580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.577588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:31.577595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:31.577602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:31.577604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:31.577604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:31.577605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:31.577605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:31.577619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.577624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:31.577625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:31.577629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1155
2025-10-02T09:31:31.577656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.577631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1155
2025-10-02T09:31:31.577660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.577673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:31.577679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.577681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.577682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:31.577687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.577692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:31.577701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.577818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.577825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.577837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.577890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1156 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0
2025-10-02T09:31:31.578092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba9297-b1f76c83-86b9f5a1-763535de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:31.580226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Write session: try to update token
2025-10-02T09:31:31.580236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:31.587173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:31.587186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.587188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:31.587189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:31.587194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.587196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.587199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554685529320549:7740]
2025-10-02T09:31:31.587222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:31.587227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.587228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:31.587234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:31.587238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:31.587241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:31.587350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:31.590724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId: src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:31.592680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.653668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604857273:8968]
2025-10-02T09:31:31.653869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1155, pipe: [1:7556554685604857273:8968]
2025-10-02T09:31:31.705943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:31.706364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.706373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.706399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857273:8968], now have 1 active actors on pipe
2025-10-02T09:31:31.706516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:31.706573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:31.706575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604857273:8968]
2025-10-02T09:31:31.706593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:31.706636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1156 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0
2025-10-02T09:31:31.706764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1156 sessionId: src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0 is DEAD
2025-10-02T09:31:31.706910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:31.706919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Write session will restart in 0.008687s
2025-10-02T09:31:31.706935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Write session: Do CDS request
2025-10-02T09:31:31.706940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:31.716146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.716236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:31.716248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1157
2025-10-02T09:31:31.716337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.716364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:31.716372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:31.716375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:31.716710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1157 sessionId:  describe result for acl check
2025-10-02T09:31:31.716739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:31.716745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:31.716746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:31.716752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554685604857436:9271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:31.717222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554685604857436:9271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:31.718576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554685604857436:9271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:31.721743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554685604857436:9271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:31.721753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554685604857436:9271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:31.721756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554685604857436:9271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:31.721761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:31.721721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:31.721987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:31.722093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:31.722100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:31.722106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:31.722135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:31.722159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554685529320803:7743]
2025-10-02T09:31:31.722505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:31.722692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:31.722717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:31.722916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:31.722950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.722954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.722954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.722955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.722956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.722956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.722957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.722957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.722957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.722958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.722958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.722959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.722962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.722968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.722970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.722972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.722974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.722976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.722978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.722980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.722982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.722985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.722987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.722989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.722994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.722998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.723001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.723004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.723006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.723009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.723011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.723014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.723016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.723019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.723021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.723024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.723026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.723029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.723031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.723034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.723037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.723040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.723042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.723045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.723049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.723052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.723054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.723057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.723075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:31.730678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:31.732247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:31.732260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:31.732262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:31.732265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:31.732269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1156 [2:7556554685529320803:7743]
2025-10-02T09:31:31.732277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:31.732288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:31.732295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.732297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.732298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.732307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:31.732311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:31.732315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:31.732347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.732352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.732353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.732355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:31.732356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:31.732396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:31.732401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.732408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.732413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.732421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:31.732441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857507:9271], now have 1 active actors on pipe
2025-10-02T09:31:31.732450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.732452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.732454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.732464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:31.732475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857274:2446], now have 1 active actors on pipe
2025-10-02T09:31:31.732475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:31.732477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:31.732478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:31.732486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:31.732499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:31.732504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:31.732506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1156
2025-10-02T09:31:31.732526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1156
2025-10-02T09:31:31.732522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.732529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:31.732530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:31.732540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.732543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.732580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:31.732587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.732589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.732591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:31.732596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.732603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:31.732614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.732728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.732734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.732745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.732797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1157 partition: 0 MaxSeqNo: 36 sessionId: src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0
2025-10-02T09:31:31.733059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8efa5a5-bb66cd07-5d5f918c-e18b4d81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:31.735263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Write session: try to update token
2025-10-02T09:31:31.735274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:31.742532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:31.742550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.742551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:31.742552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:31.742557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.742562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.742565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554685529320797:7743]
2025-10-02T09:31:31.742589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:31.742590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:31.742593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.742594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:31.742594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:31.742596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:31.742705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:31.746154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId: src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:31.748070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.806741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604857538:8968]
2025-10-02T09:31:31.806916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1156, pipe: [1:7556554685604857538:8968]
2025-10-02T09:31:31.858649Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:31.859137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.859147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.859173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857538:8968], now have 1 active actors on pipe
2025-10-02T09:31:31.859307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:31.859370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604857538:8968]
2025-10-02T09:31:31.859374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:31.859399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:31.859457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0
2025-10-02T09:31:31.859599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1157 sessionId: src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0 is DEAD
2025-10-02T09:31:31.859717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:31.859726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Write session will restart in 0.007604s
2025-10-02T09:31:31.859744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Write session: Do CDS request
2025-10-02T09:31:31.859749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:31.868114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.868206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:31.868216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1158
2025-10-02T09:31:31.868300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:31.868325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:31.868334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:31.868337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:31.868716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1158 sessionId:  describe result for acl check
2025-10-02T09:31:31.868748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:31.868754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:31.868755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:31.868760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554685604857678:9277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:31.869234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554685604857678:9277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:31.870924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554685604857678:9277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:31.871404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:31.873868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:31.873978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:31.873984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:31.873990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:31.874017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:31.874018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554685604857678:9277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:31.874028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554685604857678:9277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:31.874030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554685604857678:9277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:31.874034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:31.874040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554685529321039:7745]
2025-10-02T09:31:31.874379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:31.874553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:31.874576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:31.874750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:31.874778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.874782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.874783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.874783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.874784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.874785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.874785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.874786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.874786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.874787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.874787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.874787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.874791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.874797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.874799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.874801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.874803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.874806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.874808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.874810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.874812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.874814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.874816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.874818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.874821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.874825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:31.874829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.874831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:31.874833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.874836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:31.874838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.874841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:31.874843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.874846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:31.874848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.874850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:31.874852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.874855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:31.874858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.874860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:31.874862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.874865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:31.874867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.874870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.874879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.874882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.874884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.874886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.874902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:31.882519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:31.884076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:31.884086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:31.884088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:31.884089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:31.884093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1157 [2:7556554685529321039:7745]
2025-10-02T09:31:31.884099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:31.884109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:31.884110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.884112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.884113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.884122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:31.884124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:31.884132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:31.884162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.884167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.884168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.884170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:31.884171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:31.884205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:31.884210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.884217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:31.884226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:31.884235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:31.884246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.884251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.884252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.884256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:31.884264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857776:9277], now have 1 active actors on pipe
2025-10-02T09:31:31.884267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:31.884270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857539:2446], now have 1 active actors on pipe
2025-10-02T09:31:31.884270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:31.884271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:31.884275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:31.884282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:31.884285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:31.884297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.884306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:31.884316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:31.884296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1157
2025-10-02T09:31:31.884303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1157
2025-10-02T09:31:31.884333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.884338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.884353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:31.884360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:31.884363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:31.884364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:31.884369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:31.884377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:31.884384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.884487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.884492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.884500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:31.884549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1158 partition: 0 MaxSeqNo: 36 sessionId: src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0
2025-10-02T09:31:31.884762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a9694-ced84090-dffc8abc-5bd53e3e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:31.887293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Write session: try to update token
2025-10-02T09:31:31.887306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:31.894460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:31.894474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.894480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.894504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:31.894550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:31.894634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:31.894744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:31.894852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:31.894971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:31.895132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:31.895157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:31.898790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId: src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:31.900691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:31.900829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:31.900850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:31.900868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:31.900927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:31.903215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:31.903226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:31.903227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:31.903228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:31.903234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.903237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.903240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554685529321034:7745]
2025-10-02T09:31:31.903262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:31.903266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:31.903268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:31.903269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:31.903271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:31.903272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:31.903378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:31.959313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554685604857788:8968]
2025-10-02T09:31:31.959473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1157, pipe: [1:7556554685604857788:8968]
2025-10-02T09:31:32.021977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.028033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.028051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.028176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.028226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.028275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.028324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.028362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.028369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.028423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.028473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.028523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.028575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.028613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.028618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.028668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.028717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.028771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.028835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.028878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.028889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.028952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.029009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.029056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.029116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.029154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.029159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.029214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.029263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.029315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.029366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.029402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.029407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.029458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.029503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.029552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.029601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.029644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.029651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.029707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.029755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.029806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.029856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.029892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.029898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.029952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.029998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.030046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.030093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.030127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.030132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.030182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.030231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.030277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.030325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.030359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.030364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.030415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:32.030460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:32.030508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:32.030556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:32.030591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:32.030596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:32.030629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554685604857788:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.030834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554685604857788:8968]
2025-10-02T09:31:32.030850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:32.030853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:32.030858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.030884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1158 reason: error at write: Disconnected sessionId: src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0
2025-10-02T09:31:32.031050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1158 sessionId: src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0 is DEAD
2025-10-02T09:31:32.031159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:32.031168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Write session will restart in 0.008761s
2025-10-02T09:31:32.031183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Write session: Do CDS request
2025-10-02T09:31:32.031188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.031281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:32.041120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.041217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.041227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1159
2025-10-02T09:31:32.041609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.041631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.041637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.041639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.041918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1159 sessionId:  describe result for acl check
2025-10-02T09:31:32.041946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.041953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.041955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.041959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899825285:9281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.042130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.042323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899825285:9281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.043942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899825285:9281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.044958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.045053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.045060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.045065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.045090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.045114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824288575:7748]
2025-10-02T09:31:32.045453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.045629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.045651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.045687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899825285:9281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.045695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899825285:9281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.045697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899825285:9281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.045700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.045830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.045859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.045863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.045864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.045864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.045865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.045866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.045866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.045867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.045867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.045868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.045868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.045869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.045871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.045877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.045879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.045882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.045884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.045886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.045888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.045890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.045892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.045894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.045896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.045898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.045902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.045906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.045909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.045912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.045914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.045917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.045919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.045921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.045923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.045926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.045928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.045931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.045933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.045936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.045938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.045941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.045943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.045946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.045948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.045951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.045953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.045956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.045958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.045960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.045977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.053494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.055011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.055020Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.055021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.055023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.055026Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1158 [2:7556554689824288575:7748]
2025-10-02T09:31:32.055034Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.055044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.055045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.055047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.055048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.055057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.055060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.055065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.055095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.055100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.055101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.055103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.055104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.055141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.055146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.055152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.055158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.055166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.055180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825323:9281], now have 1 active actors on pipe
2025-10-02T09:31:32.055186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825085:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.055189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.055190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.055192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.055199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.055208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.055212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.055214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.055215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.055216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.055218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.055232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.055237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.055238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.055223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1158
2025-10-02T09:31:32.055234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1158
2025-10-02T09:31:32.055246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.055248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.055270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.055277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.055279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.055280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.055285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.055290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.055304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.055389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.055394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.055401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.055454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1159 partition: 0 MaxSeqNo: 36 sessionId: src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0
2025-10-02T09:31:32.055645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164f00e9-9206c2c9-34dc46c1-104c17e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.057859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Write session: try to update token
2025-10-02T09:31:32.057871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.064688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.064702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.064705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.064707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.064715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.064718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.064721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824288569:7748]
2025-10-02T09:31:32.064750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.064752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.064753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.064756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.064757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.064759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.064892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.068323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId: src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.070254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:32.130842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554689899825333:8968]
2025-10-02T09:31:32.131041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1158, pipe: [1:7556554689899825333:8968]
2025-10-02T09:31:32.184685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.185139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.185149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.185174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825333:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.185313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:32.185340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554689899825333:8968]
2025-10-02T09:31:32.185357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:32.185359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:32.185361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.185419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1159 reason: error at write: Disconnected sessionId: src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0
2025-10-02T09:31:32.185564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1159 sessionId: src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0 is DEAD
2025-10-02T09:31:32.185724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:32.185734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Write session will restart in 0.006425s
2025-10-02T09:31:32.185753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Write session: Do CDS request
2025-10-02T09:31:32.185757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.193145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.193244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.193255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1160
2025-10-02T09:31:32.193349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.193376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.193385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.193392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.193695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1160 sessionId:  describe result for acl check
2025-10-02T09:31:32.193719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.193723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.193724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.193727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899825459:9286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.194070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899825459:9286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.196105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899825459:9286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.196653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.199411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.199507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.199514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.199520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.199545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.199566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824288816:7750]
2025-10-02T09:31:32.199610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899825459:9286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.199619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899825459:9286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.199621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899825459:9286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.199629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.199911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.200078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.200100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.200293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.200330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.200336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.200336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.200337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.200337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.200338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.200338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.200339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.200339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.200340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.200340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.200341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.200344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.200350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.200352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.200354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.200356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.200358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.200360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.200362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.200364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.200367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.200368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.200371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.200375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.200379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.200382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.200385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.200387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.200390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.200392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.200395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.200397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.200400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.200402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.200405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.200407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.200410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.200412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.200414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.200416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.200419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.200421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.200424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.200426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.200429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.200431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.200434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.200452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.207971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.209429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.209439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.209441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.209443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.209446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1159 [2:7556554689824288816:7750]
2025-10-02T09:31:32.209453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.209463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.209465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.209466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.209467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.209476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.209482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.209487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.209520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.209527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.209528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.209530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.209533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.209578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.209583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.209590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.209594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.209602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.209617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825334:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.209622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825572:9286], now have 1 active actors on pipe
2025-10-02T09:31:32.209626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.209627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.209628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.209635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.209643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.209651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.209653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.209654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.209654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.209656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.209668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.209671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.209658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1159
2025-10-02T09:31:32.209666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1159
2025-10-02T09:31:32.209680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.209690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.209692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.209709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.209714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.209716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.209717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.209723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.209729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.209736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.209838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.209843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.209850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.209901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1160 partition: 0 MaxSeqNo: 36 sessionId: src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0
2025-10-02T09:31:32.210106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4406f42a-49f9c95a-fb84dd43-b0651c0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.212276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Write session: try to update token
2025-10-02T09:31:32.212286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.219097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.219111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.219114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.219116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.219124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.219127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.219131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824288807:7750]
2025-10-02T09:31:32.219159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.219160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.219164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.219166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.219167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.219170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.219295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.223051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId: src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.225019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:32.285477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554689899825583:8968]
2025-10-02T09:31:32.285893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1159, pipe: [1:7556554689899825583:8968]
2025-10-02T09:31:32.335958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.336456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.336465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.336490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825583:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.336629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:32.336679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554689899825583:8968]
2025-10-02T09:31:32.336687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.336706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:32.336709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:32.336759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1160 reason: error at write: Disconnected sessionId: src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0
2025-10-02T09:31:32.336930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1160 sessionId: src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0 is DEAD
2025-10-02T09:31:32.337108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:32.337117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Write session will restart in 0.005085s
2025-10-02T09:31:32.337131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Write session: Do CDS request
2025-10-02T09:31:32.337136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.343105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.343202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.343213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1161
2025-10-02T09:31:32.343306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.343331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.343339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.343343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.343656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1161 sessionId:  describe result for acl check
2025-10-02T09:31:32.343680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.343685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.343687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.343691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899825645:9290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.344139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899825645:9290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.345965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899825645:9290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.347744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899825645:9290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.347751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899825645:9290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.347753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899825645:9290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.347756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.350991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.351279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.351371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.351377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.351383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.351409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.351429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824289056:7753]
2025-10-02T09:31:32.351774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.351936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.351959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.352132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.352164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.352168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.352168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.352169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.352169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.352170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.352170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.352171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.352171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.352172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.352172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.352173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.352176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.352183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.352185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.352187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.352189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.352191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.352193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.352195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.352197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.352199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.352201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.352203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.352207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.352211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.352214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.352217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.352219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.352222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.352224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.352226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.352229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.352231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.352233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.352236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.352238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.352240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.352242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.352245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.352247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.352249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.352251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.352254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.352256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.352259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.352265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.352268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.352286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.359834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.361370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.361381Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.361382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.361384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.361387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1160 [2:7556554689824289056:7753]
2025-10-02T09:31:32.361396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.361405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.361406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.361408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.361409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.361420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.361429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.361436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.361473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.361479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.361480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.361481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.361483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.361518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.361523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.361529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.361535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.361543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.361554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825585:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.361558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825818:9290], now have 1 active actors on pipe
2025-10-02T09:31:32.361561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.361562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.361563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.361572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.361579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.361585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.361587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.361588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.361589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.361589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.361602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.361604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.361605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.361627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1160
2025-10-02T09:31:32.361649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1160
2025-10-02T09:31:32.361669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.361675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.361689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.361692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.361694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.361695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.361700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.361707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.361718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.361839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.361844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.361851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.361927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1161 partition: 0 MaxSeqNo: 36 sessionId: src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0
2025-10-02T09:31:32.362136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd7fd9b-70ba4b6d-7579088d-b18f8f68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.364354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Write session: try to update token
2025-10-02T09:31:32.364364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.371242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.371255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.371257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.371261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.371267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.371270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.371273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824289051:7753]
2025-10-02T09:31:32.371304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.371312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.371314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.371315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.371319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.371321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.371442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.375031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId: src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.377042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:32.437024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554689899825855:8968]
2025-10-02T09:31:32.437198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1160, pipe: [1:7556554689899825855:8968]
2025-10-02T09:31:32.485329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.485696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.485706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.485731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825855:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.485886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:32.485919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:32.485931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:32.485941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.485977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1161 reason: error at write: Disconnected sessionId: src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0
2025-10-02T09:31:32.485982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554689899825855:8968]
2025-10-02T09:31:32.486138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1161 sessionId: src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0 is DEAD
2025-10-02T09:31:32.486261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:32.486269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Write session will restart in 0.005071s
2025-10-02T09:31:32.486287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Write session: Do CDS request
2025-10-02T09:31:32.486291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.492083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.492146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.492156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1162
2025-10-02T09:31:32.492268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.492293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.492300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.492303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.492632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1162 sessionId:  describe result for acl check
2025-10-02T09:31:32.492663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.492669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.492671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.492675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899825899:9301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.493156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899825899:9301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.495456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899825899:9301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.497884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899825899:9301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.497895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899825899:9301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.497897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899825899:9301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.497901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.500522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.500792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.500895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.500902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.500907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.500933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.500957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824289333:7767]
2025-10-02T09:31:32.501297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.501455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.501477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.501650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.501680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.501684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.501685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.501685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.501686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.501686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.501687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.501687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.501688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.501688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.501689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.501689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.501692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.501698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.501700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.501702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.501704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.501706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.501708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.501710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.501712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.501714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.501716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.501718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.501722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.501726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.501729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.501732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.501734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.501737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.501739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.501742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.501744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.501746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.501749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.501751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.501754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.501756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.501760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.501762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.501766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.501769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.501771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.501774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.501776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.501779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.501782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.501785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.501802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.509197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.510610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.510620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.510622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.510623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.510626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1161 [2:7556554689824289333:7767]
2025-10-02T09:31:32.510633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.510641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.510643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.510644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.510645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.510654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.510656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.510661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.510689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.510695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.510696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.510697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.510699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.510734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.510738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.510745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.510750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.510758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.510773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826093:9301], now have 1 active actors on pipe
2025-10-02T09:31:32.510779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.510780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.510781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.510787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.510791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899825857:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.510798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.510799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.510803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.510804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.510805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.510806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.510820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.510825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.510835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.510842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.510844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.510823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1161
2025-10-02T09:31:32.510826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1161
2025-10-02T09:31:32.510860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86a13320-22afad32-21af29ca-91ef204e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.510868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.510881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.510882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.510887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.510892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.510901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.510989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.510993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.511000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.511053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1162 partition: 0 MaxSeqNo: 36 sessionId: src_id|86a13320-22afad32-21af29ca-91ef204e_0
2025-10-02T09:31:32.511251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|259ce9ae-12fd8d09-a35f831d-dc519fbc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86a13320-22afad32-21af29ca-91ef204e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.513742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Write session: try to update token
2025-10-02T09:31:32.513754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.521074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:32.521088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.521094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.521122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:32.521123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:32.521533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:32.521653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:32.521767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:32.521877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:32.522034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:32.522063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:32.527661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId: src_id|86a13320-22afad32-21af29ca-91ef204e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.529662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:32.529816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.529832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.529844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.529846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.529848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.529849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.529855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.529857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.529860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824289328:7767]
2025-10-02T09:31:32.529882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.529887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.529890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.529890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.529892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.529892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.530002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.586026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554689899826106:8968]
2025-10-02T09:31:32.586233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1161, pipe: [1:7556554689899826106:8968]
2025-10-02T09:31:32.646636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.647186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:32.647213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826106:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.647328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:32.647432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554689899826106:8968]
2025-10-02T09:31:32.647555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.656131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:32.656145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:32.656163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1162 reason: error at write: Disconnected sessionId: src_id|86a13320-22afad32-21af29ca-91ef204e_0
2025-10-02T09:31:32.656277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1162 sessionId: src_id|86a13320-22afad32-21af29ca-91ef204e_0 is DEAD
2025-10-02T09:31:32.656379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:32.656389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Write session will restart in 0.006436s
2025-10-02T09:31:32.656404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Write session: Do CDS request
2025-10-02T09:31:32.656409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.664153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.664164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.664173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1163
2025-10-02T09:31:32.664286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.664307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.664313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.664316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.664634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1163 sessionId:  describe result for acl check
2025-10-02T09:31:32.664668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.664674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.664675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.664679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899826313:9305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.664822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.665137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.665178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899826313:9305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.665223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.665230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.665236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.665262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.665285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824289574:7769]
2025-10-02T09:31:32.665627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.665807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.665829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.666008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.666038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.666042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.666042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.666043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.666044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.666044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.666044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.666045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.666045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.666046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.666047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.666047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.666050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.666055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.666057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.666060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.666062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.666064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.666066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.666068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.666070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.666073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.666075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.666077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.666080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.666084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.666087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.666090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.666092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.666094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.666097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.666099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.666102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.666104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.666107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.666109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.666111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.666114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.666116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.666119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.666121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.666124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.666126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.666129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.666131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.666134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.666136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.666138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.666156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.666915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899826313:9305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.672007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899826313:9305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.672017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899826313:9305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.672020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899826313:9305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.672024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.673703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.675024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.675033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.675034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.675037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.675040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1162 [2:7556554689824289574:7769]
2025-10-02T09:31:32.675047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.675056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.675058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.675059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.675060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.675069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.675073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.675077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.675105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.675111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.675112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.675113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.675115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.675150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.675154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.675161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.675166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.675174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.675187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.675190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.675191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.675196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.675204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.675205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.675208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.675209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.675214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.675216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.675222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826352:9305], now have 1 active actors on pipe
2025-10-02T09:31:32.675224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826108:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.675237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.675245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.675255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1162
2025-10-02T09:31:32.675263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.675316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1162
2025-10-02T09:31:32.675340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.675346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.675359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.675366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.675369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.675370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.675376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.675385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.675394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.675499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.675504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.675512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.675565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1163 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0
2025-10-02T09:31:32.675765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a13320-22afad32-21af29ca-91ef204e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.677963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Write session: try to update token
2025-10-02T09:31:32.677974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.684655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.684670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.684672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.684673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.684678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.684680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.684683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824289569:7769]
2025-10-02T09:31:32.684703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.684707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.684708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.684712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.684716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.684719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.684828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.689605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId: src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.691611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:32.747804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554689899826359:8968]
2025-10-02T09:31:32.747989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1162, pipe: [1:7556554689899826359:8968]
2025-10-02T09:31:32.800471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.800642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.800650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.800672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826359:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.800781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:32.800779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554689899826359:8968]
2025-10-02T09:31:32.800780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:32.800783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:32.800812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.800838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1163 reason: error at write: Disconnected sessionId: src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0
2025-10-02T09:31:32.800971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1163 sessionId: src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0 is DEAD
2025-10-02T09:31:32.801079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:32.801087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Write session will restart in 0.005983s
2025-10-02T09:31:32.801104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Write session: Do CDS request
2025-10-02T09:31:32.801108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.808097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.808164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.808170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1164
2025-10-02T09:31:32.808266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.808304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.808313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.808316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.808741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1164 sessionId:  describe result for acl check
2025-10-02T09:31:32.808765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.808771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.808773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.808776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899826513:9311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.809223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899826513:9311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.810912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899826513:9311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.814164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.814317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899826513:9311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.814326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899826513:9311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.814328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899826513:9311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.814332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.814406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.814493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.814500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.814506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.814533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.814564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824289829:7772]
2025-10-02T09:31:32.814930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.815098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.815122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.815296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.815324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.815327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.815328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.815329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.815329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.815330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.815330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.815331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.815331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.815332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.815332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.815333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.815336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.815341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.815343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.815345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.815347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.815349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.815351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.815353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.815355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.815357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.815359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.815361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.815364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.815368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.815371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.815374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.815376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.815379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.815381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.815383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.815385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.815388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.815390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.815392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.815394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.815397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.815399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.815402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.815404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.815406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.815408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.815411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.815413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.815415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.815417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.815420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.815436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.823013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.824640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.824650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.824651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.824653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.824656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1163 [2:7556554689824289829:7772]
2025-10-02T09:31:32.824664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.824673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.824675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.824677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.824678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.824688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.824690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.824695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.824727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.824733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.824734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.824736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.824737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.824780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.824786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.824795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.824817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.824836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.824853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826380:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.824859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826619:9311], now have 1 active actors on pipe
2025-10-02T09:31:32.824862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.824863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.824864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.824872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.824879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.824887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.824889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.824890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.824878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1163
2025-10-02T09:31:32.824881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1163
2025-10-02T09:31:32.824890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.824891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.824922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.824927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.824934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.824939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.824951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.824959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea95db11-9ed95b50-62b66222-5efa5241_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.824963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.824965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.824966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.824972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.824980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.824991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.825081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.825086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.825094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.825135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1164 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea95db11-9ed95b50-62b66222-5efa5241_0
2025-10-02T09:31:32.825357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ead22af-9380ef9f-cbfaabcb-ab916122_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea95db11-9ed95b50-62b66222-5efa5241_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.827624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Write session: try to update token
2025-10-02T09:31:32.827638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.834243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.834258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.834261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.834262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.834269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.834271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.834273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824289823:7772]
2025-10-02T09:31:32.834296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.834299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.834300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.834302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.834302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.834304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.834412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.838089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId: src_id|ea95db11-9ed95b50-62b66222-5efa5241_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.840001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:32.900894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554689899826633:8968]
2025-10-02T09:31:32.901057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1163, pipe: [1:7556554689899826633:8968]
2025-10-02T09:31:32.948448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:32.948651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.948659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.948684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826633:8968], now have 1 active actors on pipe
2025-10-02T09:31:32.948834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:32.948870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:32.948908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554689899826633:8968]
2025-10-02T09:31:32.948989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:32.949043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1164 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea95db11-9ed95b50-62b66222-5efa5241_0
2025-10-02T09:31:32.949172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1164 sessionId: src_id|ea95db11-9ed95b50-62b66222-5efa5241_0 is DEAD
2025-10-02T09:31:32.949297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:32.949303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Write session will restart in 0.007427s
2025-10-02T09:31:32.949317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Write session: Do CDS request
2025-10-02T09:31:32.949322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:32.958143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.958235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:32.958243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1165
2025-10-02T09:31:32.958333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:32.958354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:32.958360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:32.958362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:32.958629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1165 sessionId:  describe result for acl check
2025-10-02T09:31:32.958653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:32.958657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:32.958658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:32.958661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554689899826802:9315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:32.959012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554689899826802:9315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:32.960648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554689899826802:9315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:32.963350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:32.963497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554689899826802:9315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:32.963507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554689899826802:9315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:32.963508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554689899826802:9315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:32.963512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:32.963659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:32.963750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:32.963757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:32.963762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:32.963787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:32.963811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554689824290075:7775]
2025-10-02T09:31:32.964158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:32.964312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:32.964335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:32.964509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:32.964539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.964543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.964543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.964544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.964545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.964545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.964546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.964547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.964547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.964548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.964548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.964549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.964551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.964558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.964560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.964562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.964564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.964566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.964568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.964570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.964572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.964574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.964576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.964578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.964582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.964586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:32.964589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.964592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:32.964595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.964597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:32.964600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.964603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:32.964606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.964608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:32.964610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.964613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:32.964615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.964618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:32.964620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.964622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:32.964624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.964627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:32.964629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.964631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.964634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.964636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.964638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.964640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.964657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:32.972232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:32.973570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:32.973582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:32.973583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:32.973585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:32.973589Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1164 [2:7556554689824290075:7775]
2025-10-02T09:31:32.973596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:32.973605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:32.973606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.973608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.973609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.973618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:32.973621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:32.973625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:32.973656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.973661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.973662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.973664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:32.973665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:32.973700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:32.973705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.973711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:32.973717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:32.973725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:32.973738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826876:9315], now have 1 active actors on pipe
2025-10-02T09:31:32.973743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554689899826634:2446], now have 1 active actors on pipe
2025-10-02T09:31:32.973747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.973749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.973750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.973758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:32.973766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:32.973772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:32.973775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:32.973776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:32.973777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:32.973779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:32.973776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1164
2025-10-02T09:31:32.973791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1164
2025-10-02T09:31:32.973793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.973799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:32.973800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:32.973810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.973812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.973838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:32.973845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:32.973847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:32.973848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:32.973853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:32.973857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:32.973866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.973958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:32.973963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:32.973970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:32.974020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1165 partition: 0 MaxSeqNo: 36 sessionId: src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0
2025-10-02T09:31:32.974268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea95db11-9ed95b50-62b66222-5efa5241_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:32.976420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Write session: try to update token
2025-10-02T09:31:32.976431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:32.983523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:32.983537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:32.983538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:32.983540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:32.983545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.983548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.983550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554689824290069:7775]
2025-10-02T09:31:32.983572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:32.983575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:32.983576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:32.983613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:32.983633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:32.983639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:32.983685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:32.986694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId: src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:32.988552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.048863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194794183:8968]
2025-10-02T09:31:33.049018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1164, pipe: [1:7556554694194794183:8968]
2025-10-02T09:31:33.098172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:33.098369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.098377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.098404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794183:8968], now have 1 active actors on pipe
2025-10-02T09:31:33.098597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194794183:8968]
2025-10-02T09:31:33.098609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:33.098612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:33.098632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:33.098657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1165 reason: error at write: Disconnected sessionId: src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0
2025-10-02T09:31:33.098774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:33.098788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1165 sessionId: src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0 is DEAD
2025-10-02T09:31:33.098932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:33.098941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Write session will restart in 0.005186s
2025-10-02T09:31:33.098963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Write session: Do CDS request
2025-10-02T09:31:33.098969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:33.105064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.105168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:33.105178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1166
2025-10-02T09:31:33.105275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.105302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:33.105310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:33.105313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:33.105682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1166 sessionId:  describe result for acl check
2025-10-02T09:31:33.105708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:33.105712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:33.105713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:33.105717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554694194794257:9319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:33.106063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554694194794257:9319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:33.108010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554694194794257:9319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:33.110127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554694194794257:9319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:33.110135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554694194794257:9319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:33.110137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554694194794257:9319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:33.110141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:33.113035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:33.113311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:33.113401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:33.113407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:33.113413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:33.113437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:33.113459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554694119257616:7777]
2025-10-02T09:31:33.113799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:33.113955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:33.113978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:33.114173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:33.114209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.114213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.114213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.114214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.114214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.114215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.114216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.114216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.114216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.114217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.114217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.114218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.114220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.114227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.114229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.114231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.114233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.114235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.114237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.114239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.114241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.114243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.114245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.114247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.114251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.114255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.114258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.114261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.114264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.114267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.114269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.114272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.114274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.114277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.114279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.114281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.114284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.114287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.114289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.114291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.114293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.114296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.114298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.114301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.114303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.114306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.114308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.114311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.114326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:33.121895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:33.123311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:33.123321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:33.123323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:33.123326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:33.123330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1165 [2:7556554694119257616:7777]
2025-10-02T09:31:33.123337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:33.123348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:33.123349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.123351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.123352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.123361Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:33.123368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:33.123373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:33.123406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.123411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.123412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.123415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:33.123416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:33.123455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:33.123461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.123467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.123473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.123482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:33.123497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794184:2446], now have 1 active actors on pipe
2025-10-02T09:31:33.123504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794422:9319], now have 1 active actors on pipe
2025-10-02T09:31:33.123507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.123509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.123510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.123517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:33.123528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:33.123532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:33.123535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:33.123536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:33.123539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:33.123541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:33.123561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.123568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:33.123547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1165
2025-10-02T09:31:33.123549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1165
2025-10-02T09:31:33.123576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:33.123874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.123883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.123906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:33.123915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.123917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.123918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:33.123924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.123931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:33.123941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.124064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.124069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.124076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.124135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1166 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0
2025-10-02T09:31:33.124386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22a8ea2-d74d6722-de373902-6704a2a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:33.126610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Write session: try to update token
2025-10-02T09:31:33.126622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:33.133446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:33.133461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:33.133462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:33.133463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:33.133468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.133471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.133474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554694119257611:7777]
2025-10-02T09:31:33.133500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:33.133501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:33.133506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:33.133506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.133508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:33.133509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:33.133627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:33.137272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId: src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:33.139184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.198865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194794440:8968]
2025-10-02T09:31:33.199025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1165, pipe: [1:7556554694194794440:8968]
2025-10-02T09:31:33.251483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:33.251694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.251703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.251729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794440:8968], now have 1 active actors on pipe
2025-10-02T09:31:33.251867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:33.251912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:33.251946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:33.251956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194794440:8968]
2025-10-02T09:31:33.252012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1166 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0
2025-10-02T09:31:33.252154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1166 sessionId: src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0 is DEAD
2025-10-02T09:31:33.252311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:33.252322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Write session will restart in 0.005287s
2025-10-02T09:31:33.252338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Write session: Do CDS request
2025-10-02T09:31:33.252342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:33.258133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.258204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:33.258213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1167
2025-10-02T09:31:33.258318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.258345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:33.258352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:33.258355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:33.258690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1167 sessionId:  describe result for acl check
2025-10-02T09:31:33.258715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:33.258720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:33.258722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:33.258726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554694194794513:9324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:33.259180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554694194794513:9324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:33.261229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554694194794513:9324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:33.263216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554694194794513:9324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:33.263225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554694194794513:9324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:33.263227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554694194794513:9324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:33.263231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:33.263324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:33.265981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:33.266131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:33.266138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:33.266145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:33.266175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:33.266195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554694119257864:7780]
2025-10-02T09:31:33.266538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:33.266696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:33.266718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:33.266899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:33.266927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.266931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.266932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.266932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.266933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.266933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.266934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.266934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.266935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.266935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.266936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.266936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.266939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.266945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.266947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.266949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.266951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.266953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.266955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.266957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.266959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.266961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.266963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.266965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.266968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.266972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.266975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.266978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.266980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.266982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.266984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.266987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.266989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.266992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.266994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.266997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.266999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.267002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.267004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.267007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.267009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.267012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.267014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.267016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.267018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.267021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.267023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.267025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.267042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:33.274606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:33.276033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:33.276044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:33.276045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:33.276047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:33.276050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1166 [2:7556554694119257864:7780]
2025-10-02T09:31:33.276283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:33.276306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:33.276312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.276315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.276317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.276329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:33.276333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:33.276338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:33.276383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.276390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.276391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.276394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:33.276396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:33.276446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:33.276453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.276463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.276472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.276491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:33.276512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794441:2446], now have 1 active actors on pipe
2025-10-02T09:31:33.276520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794682:9324], now have 1 active actors on pipe
2025-10-02T09:31:33.276525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.276531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.276532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.276511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1166
2025-10-02T09:31:33.276512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1166
2025-10-02T09:31:33.276540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:33.276546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:33.276548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:33.276549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:33.276555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:33.276568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:33.276575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:33.276591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.276598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.276626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.276637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:33.276645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:33.276648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:33.276652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.276654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.276655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:33.276660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.276665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:33.276687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.276792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.276797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.276816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.276881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1167 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0
2025-10-02T09:31:33.277090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5bf2c6c-1e615c09-298dba60-e319bba6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:33.279451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Write session: try to update token
2025-10-02T09:31:33.279462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:33.287249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:33.287260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:33.287262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:33.287263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:33.287268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.287271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.287273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554694119257857:7780]
2025-10-02T09:31:33.287302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:33.287304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:33.287306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:33.287308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.287308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:33.287309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:33.287418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:33.290813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId: src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:33.292682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.351964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194794696:8968]
2025-10-02T09:31:33.352132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1166, pipe: [1:7556554694194794696:8968]
2025-10-02T09:31:33.399374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:33.399779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.399788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.399814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794696:8968], now have 1 active actors on pipe
2025-10-02T09:31:33.399938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:33.399988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:33.400004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:33.400027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194794696:8968]
2025-10-02T09:31:33.400064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1167 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0
2025-10-02T09:31:33.400197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1167 sessionId: src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0 is DEAD
2025-10-02T09:31:33.400332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:33.400340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Write session will restart in 0.008903s
2025-10-02T09:31:33.400358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Write session: Do CDS request
2025-10-02T09:31:33.400362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:33.410113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.410192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:33.410202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1168
2025-10-02T09:31:33.410295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.410319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:33.410326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:33.410329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:33.410559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1168 sessionId:  describe result for acl check
2025-10-02T09:31:33.410578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:33.410583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:33.410584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:33.410587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554694194794916:9334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:33.410838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554694194794916:9334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:33.411659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:33.412342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554694194794916:9334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:33.414543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:33.414672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:33.414679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:33.414685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:33.414716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:33.414738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554694119258123:7782]
2025-10-02T09:31:33.414754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554694194794916:9334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:33.414763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554694194794916:9334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:33.414766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554694194794916:9334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:33.414770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:33.415084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:33.415295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:33.415318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:33.415491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:33.415519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.415523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.415523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.415524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.415524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.415525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.415526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.415526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.415527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.415527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.415528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.415528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.415531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.415537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.415539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.415541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.415543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.415545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.415547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.415549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.415551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.415553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.415556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.415558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.415561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.415565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.415569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.415573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.415575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.415577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.415579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.415582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.415584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.415586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.415588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.415591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.415593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.415595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.415599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.415602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.415606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.415609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.415611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.415613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.415616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.415618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.415622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.415624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.415641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:33.423069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:33.424539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:33.424550Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:33.424551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:33.424553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:33.424558Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1167 [2:7556554694119258123:7782]
2025-10-02T09:31:33.424564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:33.424574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:33.424576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.424577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.424578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.424587Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:33.424589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:33.424594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:33.424624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.424629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.424630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.424632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:33.424633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:33.424669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:33.424674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.424682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.424687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.424695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:33.424707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794957:9334], now have 1 active actors on pipe
2025-10-02T09:31:33.424713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794697:2446], now have 1 active actors on pipe
2025-10-02T09:31:33.424716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.424718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.424719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.424727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:33.424738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:33.424740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:33.424742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:33.424744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:33.424745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:33.424747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:33.424761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.424766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:33.424758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1167
2025-10-02T09:31:33.424774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:33.424780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1167
2025-10-02T09:31:33.424783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.424785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.424815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38bf4492-4d301c94-3f21829a-de37c29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:33.424822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.424824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.424825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:33.424830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.424836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:33.424845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.424954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.424959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.424966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.425021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1168 partition: 0 MaxSeqNo: 36 sessionId: src_id|38bf4492-4d301c94-3f21829a-de37c29_0
2025-10-02T09:31:33.425230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cda3286-7d9714bc-5668ea0f-4e9197f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38bf4492-4d301c94-3f21829a-de37c29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:33.427638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Write session: try to update token
2025-10-02T09:31:33.427650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:33.435129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:33.435146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:33.435147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:33.435148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:33.435154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.435157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.435159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554694119258117:7782]
2025-10-02T09:31:33.435182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:33.435186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.435188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:33.435191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:33.435194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:33.435196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:33.435300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:33.439159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId: src_id|38bf4492-4d301c94-3f21829a-de37c29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:33.441125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.499928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194794978:8968]
2025-10-02T09:31:33.500060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1167, pipe: [1:7556554694194794978:8968]
2025-10-02T09:31:33.552986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:33.553516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.553526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.553552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794978:8968], now have 1 active actors on pipe
2025-10-02T09:31:33.553695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:33.553732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:33.553743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:33.553789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1168 reason: error at write: Disconnected sessionId: src_id|38bf4492-4d301c94-3f21829a-de37c29_0
2025-10-02T09:31:33.553934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1168 sessionId: src_id|38bf4492-4d301c94-3f21829a-de37c29_0 is DEAD
2025-10-02T09:31:33.554049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:33.554061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Write session will restart in 0.006536s
2025-10-02T09:31:33.554075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Write session: Do CDS request
2025-10-02T09:31:33.554079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:33.554118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:33.554163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194794978:8968]
2025-10-02T09:31:33.561128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.561289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:33.561296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1169
2025-10-02T09:31:33.561368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.561388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:33.561394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:33.561397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:33.561766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1169 sessionId:  describe result for acl check
2025-10-02T09:31:33.561797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:33.561803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:33.561804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:33.561808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554694194795087:9339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:33.562260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554694194795087:9339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:33.564136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554694194795087:9339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:33.567788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:33.567851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554694194795087:9339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:33.567861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554694194795087:9339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:33.567864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554694194795087:9339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:33.567868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:33.568049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:33.568185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:33.568191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:33.568197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:33.568225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:33.568250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554694119258395:7796]
2025-10-02T09:31:33.568604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:33.568777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:33.568820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:33.569039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:33.569075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.569079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.569080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.569080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.569081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.569081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.569082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.569082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.569083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.569084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.569084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.569085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.569087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.569093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.569096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.569098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.569100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.569102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.569103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.569105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.569107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.569109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.569111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.569113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.569117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.569121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.569124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.569128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.569130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.569132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.569134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.569137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.569139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.569142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.569144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.569146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.569149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.569152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.569154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.569156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.569158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.569161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.569163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.569165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.569167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.569169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.569171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.569174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.569191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:33.576542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:33.578176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:33.578186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:33.578187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:33.578190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:33.578193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1168 [2:7556554694119258395:7796]
2025-10-02T09:31:33.578200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:33.578210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:33.578212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.578213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.578214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.578223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:33.578228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:33.578232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:33.578260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.578265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.578266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.578268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:33.578269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:33.578306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:33.578311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.578319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.578324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.578334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:33.578348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194794979:2446], now have 1 active actors on pipe
2025-10-02T09:31:33.578354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795223:9339], now have 1 active actors on pipe
2025-10-02T09:31:33.578357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.578359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.578360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.578368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:33.578377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:33.578381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:33.578383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:33.578384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:33.578388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:33.578389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:33.578402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.578390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1168
2025-10-02T09:31:33.578401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1168
2025-10-02T09:31:33.578408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:33.578409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:33.578423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.578429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.578448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|800658b6-242034c9-6ea63a29-ee34eee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:33.578455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.578458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.578459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:33.578464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.578472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:33.578482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.578571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.578578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.578585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.578639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1169 partition: 0 MaxSeqNo: 36 sessionId: src_id|800658b6-242034c9-6ea63a29-ee34eee7_0
2025-10-02T09:31:33.578894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38bf4492-4d301c94-3f21829a-de37c29_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|800658b6-242034c9-6ea63a29-ee34eee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:33.581117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Write session: try to update token
2025-10-02T09:31:33.581128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:33.587598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:33.587613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:33.587615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:33.587616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:33.587620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.587623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.587626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554694119258389:7796]
2025-10-02T09:31:33.587648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:33.587650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.587652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:33.587678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:33.587705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:33.587714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:33.587760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:33.592209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId: src_id|800658b6-242034c9-6ea63a29-ee34eee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:33.594161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.654569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194795236:8968]
2025-10-02T09:31:33.654793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1168, pipe: [1:7556554694194795236:8968]
2025-10-02T09:31:33.709481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:33.709931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.709941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.709965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795236:8968], now have 1 active actors on pipe
2025-10-02T09:31:33.710087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:33.710150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194795236:8968]
2025-10-02T09:31:33.710167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:33.710176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:33.710228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1169 reason: status is not ok: tablet will be restarted right now sessionId: src_id|800658b6-242034c9-6ea63a29-ee34eee7_0
2025-10-02T09:31:33.710344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1169 sessionId: src_id|800658b6-242034c9-6ea63a29-ee34eee7_0 is DEAD
2025-10-02T09:31:33.710463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:33.710469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Write session will restart in 0.009073s
2025-10-02T09:31:33.710487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Write session: Do CDS request
2025-10-02T09:31:33.710491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:33.720121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.720242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:33.720254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1170
2025-10-02T09:31:33.720359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.720382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:33.720388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:33.720391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:33.720754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1170 sessionId:  describe result for acl check
2025-10-02T09:31:33.720785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:33.720793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:33.720795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:33.720812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554694194795445:9343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:33.721175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554694194795445:9343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:33.722245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:33.722717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554694194795445:9343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:33.724784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:33.724898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:33.724905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:33.724911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:33.724938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:33.724949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554694194795445:9343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:33.724957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554694194795445:9343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:33.724960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554694194795445:9343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:33.724960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554694119258655:7799]
2025-10-02T09:31:33.724963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:33.725346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:33.725535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:33.725564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:33.725778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:33.725809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.725813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.725814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.725814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.725815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.725815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.725816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.725816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.725817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.725817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.725818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.725818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.725821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.725827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.725829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.725831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.725833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.725835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.725837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.725839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.725841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.725843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.725845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.725847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.725850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.725855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.725858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.725861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.725864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.725868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.725870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.725873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.725875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.725877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.725879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.725882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.725884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.725887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.725888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.725891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.725893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.725896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.725898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.725900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.725902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.725905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.725907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.725910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.725927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:33.733626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:33.735063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:33.735075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:33.735077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:33.735079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:33.735083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1169 [2:7556554694119258655:7799]
2025-10-02T09:31:33.735091Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:33.735102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:33.735107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.735109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.735110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.735120Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:33.735122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:33.735127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:33.735158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.735163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.735164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.735166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:33.735167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:33.735211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:33.735217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.735227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.735241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.735253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:33.735269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795237:2446], now have 1 active actors on pipe
2025-10-02T09:31:33.735275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795483:9343], now have 1 active actors on pipe
2025-10-02T09:31:33.735279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.735280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.735281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.735289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:33.735301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:33.735303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:33.735305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:33.735306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:33.735312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:33.735293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1169
2025-10-02T09:31:33.735313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:33.735311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1169
2025-10-02T09:31:33.735341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.735351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:33.735354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:33.735363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.735368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.735394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:33.735400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.735403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.735404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:33.735409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.735418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:33.735430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.735536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.735541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.735549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.735607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1170 partition: 0 MaxSeqNo: 36 sessionId: src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0
2025-10-02T09:31:33.735844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800658b6-242034c9-6ea63a29-ee34eee7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:33.738056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Write session: try to update token
2025-10-02T09:31:33.738069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:33.744906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:33.744920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:33.744921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:33.744923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:33.744928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.744931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.744933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554694119258650:7799]
2025-10-02T09:31:33.744956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:33.744959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.744961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:33.744962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:33.744968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:33.744970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:33.745079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:33.748535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId: src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:33.750464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.810198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194795514:8968]
2025-10-02T09:31:33.810364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1169, pipe: [1:7556554694194795514:8968]
2025-10-02T09:31:33.865147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:33.865348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.865357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.865381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795514:8968], now have 1 active actors on pipe
2025-10-02T09:31:33.865513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:33.865544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:33.865567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194795514:8968]
2025-10-02T09:31:33.865581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:33.865680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0
2025-10-02T09:31:33.865827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1170 sessionId: src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0 is DEAD
2025-10-02T09:31:33.865956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:33.865960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Write session will restart in 0.009325s
2025-10-02T09:31:33.865984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Write session: Do CDS request
2025-10-02T09:31:33.865988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:33.876111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.876195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:33.876206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1171
2025-10-02T09:31:33.876310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:33.876330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:33.876336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:33.876339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:33.876647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1171 sessionId:  describe result for acl check
2025-10-02T09:31:33.876673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:33.876677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:33.876678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:33.876681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554694194795728:9349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:33.877136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554694194795728:9349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:33.878706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554694194795728:9349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:33.879853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:33.880076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:33.880168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:33.880175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:33.880181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:33.880193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554694194795728:9349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:33.880201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554694194795728:9349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:33.880203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554694194795728:9349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:33.880206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:33.880206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:33.880228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554694119258905:7801]
2025-10-02T09:31:33.880561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:33.880720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:33.880742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:33.880929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:33.880958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.880962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.880963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.880963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.880964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.880964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.880966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.880966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.880967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.880967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.880970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.880976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.880978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.880980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.880982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.880984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.880985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.880987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.880989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.880991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.880993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.880995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.880998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.881002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:33.881005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.881008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:33.881011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.881013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:33.881016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.881018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:33.881021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.881023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:33.881025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.881028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:33.881030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.881032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:33.881034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.881037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:33.881040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.881043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:33.881045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.881047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.881049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.881052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.881054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.881056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.881075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:33.888442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:33.889981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:33.889992Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:33.889993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:33.889995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:33.889998Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1170 [2:7556554694119258905:7801]
2025-10-02T09:31:33.890005Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:33.890014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:33.890017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.890019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.890020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.890029Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:33.890035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:33.890039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:33.890069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.890074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.890075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.890077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:33.890078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:33.890113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:33.890118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.890124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:33.890131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:33.890139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:33.890154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795765:9349], now have 1 active actors on pipe
2025-10-02T09:31:33.890159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795518:2446], now have 1 active actors on pipe
2025-10-02T09:31:33.890163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.890164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.890165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.890172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:33.890182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:33.890186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:33.890188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:33.890189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:33.890191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:33.890192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:33.890192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1170
2025-10-02T09:31:33.890204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.890209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:33.890207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1170
2025-10-02T09:31:33.890211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:33.890225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.890228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.890247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90d5c417-6af83039-6c9ffc5e-66815320_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:33.890254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:33.890256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:33.890257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:33.890262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:33.890268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:33.890282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.890368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:33.890377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:33.890387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:33.890445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1171 partition: 0 MaxSeqNo: 36 sessionId: src_id|90d5c417-6af83039-6c9ffc5e-66815320_0
2025-10-02T09:31:33.890648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e817f3b1-ec127d7f-632c6022-42ebac6f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90d5c417-6af83039-6c9ffc5e-66815320_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:33.893007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Write session: try to update token
2025-10-02T09:31:33.893020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:33.900504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:33.900518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:33.900519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:33.900520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:33.900525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.900530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.900532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554694119258900:7801]
2025-10-02T09:31:33.900555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:33.900558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:33.900560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:33.900564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:33.900567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:33.900569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:33.900678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:33.904480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId: src_id|90d5c417-6af83039-6c9ffc5e-66815320_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:33.906393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:33.965867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554694194795777:8968]
2025-10-02T09:31:33.966040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1170, pipe: [1:7556554694194795777:8968]
2025-10-02T09:31:34.017495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:34.017883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.017894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.017922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554694194795777:8968], now have 1 active actors on pipe
2025-10-02T09:31:34.018067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:34.018095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:34.018105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:34.018112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:34.018149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1171 reason: error at write: Disconnected sessionId: src_id|90d5c417-6af83039-6c9ffc5e-66815320_0
2025-10-02T09:31:34.018152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554694194795777:8968]
2025-10-02T09:31:34.018291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1171 sessionId: src_id|90d5c417-6af83039-6c9ffc5e-66815320_0 is DEAD
2025-10-02T09:31:34.018421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:34.018430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Write session will restart in 0.006286s
2025-10-02T09:31:34.018446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Write session: Do CDS request
2025-10-02T09:31:34.018450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:34.026132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.026201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:34.026210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1172
2025-10-02T09:31:34.026283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.026304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:34.026310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:34.026312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:34.026648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1172 sessionId:  describe result for acl check
2025-10-02T09:31:34.026681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:34.026687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:34.026689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:34.026693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554698489763172:9353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:34.027185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554698489763172:9353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:34.029134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554698489763172:9353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:34.033292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:34.033473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554698489763172:9353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:34.033485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554698489763172:9353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:34.033487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554698489763172:9353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:34.033493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:34.033557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:34.033652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:34.033659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:34.033664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:34.033689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:34.033713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554698414226454:7804]
2025-10-02T09:31:34.034064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:34.034219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:34.034242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:34.034421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:34.034449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.034453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.034454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.034454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.034455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.034455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.034456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.034456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.034457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.034457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.034458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.034459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.034462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.034468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.034470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.034472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.034474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.034476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.034478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.034480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.034482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.034485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.034487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.034489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.034493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.034497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.034500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.034503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.034505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.034508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.034510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.034513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.034515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.034518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.034520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.034523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.034525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.034528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.034530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.034532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.034534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.034537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.034539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.034542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.034544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.034547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.034549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.034552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.034567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:34.042126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:34.043817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:34.043830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:34.043831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:34.043833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:34.043837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1171 [2:7556554698414226454:7804]
2025-10-02T09:31:34.043846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:34.043859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:34.043861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.043862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.043863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.043872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:34.043878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:34.043883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:34.043920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.043925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.043926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.043928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:34.043929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:34.043967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:34.043972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.043979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.043984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.043992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:34.044009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.044013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.044014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.044021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:34.044030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:34.044032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:34.044039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:34.044039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:34.044040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:34.044041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:34.044047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763074:2446], now have 1 active actors on pipe
2025-10-02T09:31:34.044049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763322:9353], now have 1 active actors on pipe
2025-10-02T09:31:34.044062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.044064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:34.044067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:34.044095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1171
2025-10-02T09:31:34.044097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1171
2025-10-02T09:31:34.044163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.044169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.044184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:34.044191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.044193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.044194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:34.044201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.044209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:34.044216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.044348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.044353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.044362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.044418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1172 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0
2025-10-02T09:31:34.044653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d5c417-6af83039-6c9ffc5e-66815320_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:34.046998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Write session: try to update token
2025-10-02T09:31:34.047009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:34.053274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:34.053289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.053295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.053322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:34.053328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:34.053455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:34.053567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.053679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.053789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.053942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:34.053967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:34.057543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId: src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:34.059461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:34.059609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.059620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.059638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:34.059704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:34.061829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:34.061842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.061843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:34.061844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:34.061849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.061852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.061854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554698414226448:7804]
2025-10-02T09:31:34.061874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:34.061880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:34.061881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.061883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:34.061883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:34.061885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:34.061992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:34.118430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554698489763334:8968]
2025-10-02T09:31:34.118625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1171, pipe: [1:7556554698489763334:8968]
2025-10-02T09:31:34.175686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:34.181874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.181894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.182015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.182065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.182116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.182168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.182205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.182215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.182270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.182316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.182366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.182417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.182452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.182457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.182506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.182554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.182605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.182652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.182687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.182692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.182742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.182789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.182838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.182899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.182935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.182940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.182991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.183038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.183087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.183135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.183171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.183176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.183226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.183273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.183322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.183372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.183406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.183411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.183457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.183507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.183555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.183604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.183644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.183649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.183697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.183744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.183791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.183838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.183870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.183875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.183921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.183966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.184012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.184059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.184108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.184113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.184159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.184202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.184248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.184295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.184329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.184334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.184362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763334:8968], now have 1 active actors on pipe
2025-10-02T09:31:34.184536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:34.184548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:34.184559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554698489763334:8968]
2025-10-02T09:31:34.184568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1172 reason: error at write: Disconnected sessionId: src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0
2025-10-02T09:31:34.184576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:34.184916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:34.185082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1172 sessionId: src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0 is DEAD
2025-10-02T09:31:34.185176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:34.185193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Write session will restart in 0.008703s
2025-10-02T09:31:34.185207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Write session: Do CDS request
2025-10-02T09:31:34.185212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:34.195119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.195238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:34.195248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1173
2025-10-02T09:31:34.195328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.195349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:34.195356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:34.195358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:34.195638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1173 sessionId:  describe result for acl check
2025-10-02T09:31:34.195662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:34.195666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:34.195667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:34.195670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554698489763549:9358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:34.196042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554698489763549:9358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:34.196643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:34.197918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554698489763549:9358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:34.199367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:34.199483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:34.199489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:34.199496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:34.199527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:34.199549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554698414226707:7806]
2025-10-02T09:31:34.199707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554698489763549:9358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:34.199718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554698489763549:9358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:34.199720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554698489763549:9358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:34.199724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:34.199892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:34.200056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:34.200080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:34.200257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:34.200285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.200289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.200290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.200290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.200291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.200292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.200292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.200293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.200294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.200294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.200295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.200295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.200298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.200304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.200306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.200308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.200310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.200312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.200314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.200316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.200318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.200320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.200322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.200324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.200328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.200332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.200335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.200338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.200340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.200343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.200346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.200348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.200351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.200354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.200356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.200358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.200361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.200364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.200367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.200370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.200372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.200374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.200382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.200385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.200387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.200389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.200391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.200394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.200411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:34.208007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:34.209332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:34.209342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:34.209343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:34.209346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:34.209349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1172 [2:7556554698414226707:7806]
2025-10-02T09:31:34.209355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:34.209365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:34.209371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.209372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.209373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.209382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:34.209385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:34.209389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:34.209418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.209423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.209424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.209426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:34.209427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:34.209464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:34.209469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.209476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.209481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.209492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:34.209507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763335:2446], now have 1 active actors on pipe
2025-10-02T09:31:34.209512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763587:9358], now have 1 active actors on pipe
2025-10-02T09:31:34.209516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.209519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.209520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.209528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:34.209538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:34.209540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:34.209542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:34.209543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:34.209548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:34.209550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:34.209542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1172
2025-10-02T09:31:34.209562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1172
2025-10-02T09:31:34.209563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.209568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:34.209569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:34.209580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.209585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.209609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:34.209616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.209618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.209619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:34.209624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.209632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:34.209644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.209739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.209744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.209751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.209804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1173 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0
2025-10-02T09:31:34.210011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e053526-d3984a38-ef7c01d9-7f7b8b39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:34.212173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Write session: try to update token
2025-10-02T09:31:34.212185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:34.218882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:34.218897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.218898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:34.218900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:34.218905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.218907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.218910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554698414226700:7806]
2025-10-02T09:31:34.218935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:34.218940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:34.218941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.218942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:34.218943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:34.218946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:34.219070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:34.222754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId: src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:34.224852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:34.284870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554698489763599:8968]
2025-10-02T09:31:34.285077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1172, pipe: [1:7556554698489763599:8968]
2025-10-02T09:31:34.338826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:34.339484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.339495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.339522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763599:8968], now have 1 active actors on pipe
2025-10-02T09:31:34.339754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:34.339740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:34.339742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:34.339745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:34.339787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554698489763599:8968]
2025-10-02T09:31:34.339815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1173 reason: error at write: Disconnected sessionId: src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0
2025-10-02T09:31:34.339997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1173 sessionId: src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0 is DEAD
2025-10-02T09:31:34.340095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:34.340103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Write session will restart in 0.008891s
2025-10-02T09:31:34.340118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Write session: Do CDS request
2025-10-02T09:31:34.340122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:34.350158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.350322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:34.350337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1174
2025-10-02T09:31:34.350458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.350490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:34.350499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:34.350508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:34.350845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1174 sessionId:  describe result for acl check
2025-10-02T09:31:34.350878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:34.350883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:34.350884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:34.350887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554698489763812:9362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:34.351250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554698489763812:9362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:34.351795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:34.353113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554698489763812:9362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:34.354499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:34.354641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:34.354651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:34.354661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:34.354697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:34.354722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554698414226960:7809]
2025-10-02T09:31:34.355109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:34.355298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:34.355323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:34.355411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554698489763812:9362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:34.355422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554698489763812:9362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:34.355425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554698489763812:9362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:34.355429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:34.355519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:34.355553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.355557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.355557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.355558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.355558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.355559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.355559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.355560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.355561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.355561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.355562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.355563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.355566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.355572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.355574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.355576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.355578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.355580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.355583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.355584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.355586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.355589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.355591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.355594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.355598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.355602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.355605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.355608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.355611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.355613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.355617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.355619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.355622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.355624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.355627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.355629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.355632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.355634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.355636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.355639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.355642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.355644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.355647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.355649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.355653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.355655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.355658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.355661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.355679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:34.363437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:34.365289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:34.365300Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:34.365301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:34.365304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:34.365307Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1173 [2:7556554698414226960:7809]
2025-10-02T09:31:34.365317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:34.365328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:34.365330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.365332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.365333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.365342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:34.365344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:34.365349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:34.365382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.365387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.365388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.365390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:34.365392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:34.365430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:34.365435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.365441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.365447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.365457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:34.365470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763852:9362], now have 1 active actors on pipe
2025-10-02T09:31:34.365475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763600:2446], now have 1 active actors on pipe
2025-10-02T09:31:34.365479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.365480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.365482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.365489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:34.365497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:34.365504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:34.365506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:34.365507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:34.365508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:34.365509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:34.365526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.365531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:34.365532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:34.365546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1173
2025-10-02T09:31:34.365552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1173
2025-10-02T09:31:34.365610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.365616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.365633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:34.365639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.365641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.365642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:34.365647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.365653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:34.365662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.365768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.365775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.365785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.365838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1174 partition: 0 MaxSeqNo: 36 sessionId: src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0
2025-10-02T09:31:34.366091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f625c31-15cba5dc-d2e14828-a40bc891_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:34.368525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Write session: try to update token
2025-10-02T09:31:34.368537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:34.376341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:34.376355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.376356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:34.376358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:34.376363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.376366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.376368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554698414226955:7809]
2025-10-02T09:31:34.376399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:34.376399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:34.376402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:34.376403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.376405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:34.376406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:34.376519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:34.380608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId: src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:34.382820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:34.439965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554698489763875:8968]
2025-10-02T09:31:34.440204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1173, pipe: [1:7556554698489763875:8968]
2025-10-02T09:31:34.505694Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:34.505903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.505913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.505939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763875:8968], now have 1 active actors on pipe
2025-10-02T09:31:34.506134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:34.506135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:34.506146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:34.506179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554698489763875:8968]
2025-10-02T09:31:34.506195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1174 reason: error at write: Disconnected sessionId: src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0
2025-10-02T09:31:34.506330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1174 sessionId: src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0 is DEAD
2025-10-02T09:31:34.506437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:34.506446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Write session will restart in 0.005838s
2025-10-02T09:31:34.506460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Write session: Do CDS request
2025-10-02T09:31:34.506468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:34.506697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:34.513164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.513251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:34.513261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1175
2025-10-02T09:31:34.513343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.513364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:34.513370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:34.513373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:34.513636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1175 sessionId:  describe result for acl check
2025-10-02T09:31:34.513662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:34.513669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:34.513670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:34.513673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554698489763956:9373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:34.514063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554698489763956:9373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:34.516481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554698489763956:9373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:34.518321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554698489763956:9373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:34.518336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554698489763956:9373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:34.518340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554698489763956:9373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:34.518347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:34.521863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:34.522180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:34.522286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:34.522292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:34.522298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:34.522324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:34.522351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554698414227251:7823]
2025-10-02T09:31:34.522748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:34.522938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:34.522963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:34.523167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:34.523198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.523202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.523203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.523203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.523204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.523205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.523205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.523206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.523207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.523207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.523208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.523209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.523211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.523218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.523220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.523223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.523225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.523227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.523229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.523231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.523233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.523236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.523238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.523240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.523243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.523247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.523251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.523254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.523256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.523260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.523262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.523265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.523267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.523270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.523272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.523275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.523277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.523280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.523282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.523285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.523288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.523291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.523294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.523300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.523303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.523307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.523309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.523312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.523333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:34.531241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:34.533093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:34.533104Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:34.533105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:34.533108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:34.533112Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1174 [2:7556554698414227251:7823]
2025-10-02T09:31:34.533122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:34.533134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:34.533136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.533137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.533138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.533149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:34.533152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:34.533157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:34.533194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.533200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.533201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.533204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:34.533206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:34.533253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:34.533258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.533266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.533271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.533279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:34.533292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.533297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.533298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.533304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:34.533311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764134:9373], now have 1 active actors on pipe
2025-10-02T09:31:34.533312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:34.533314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489763885:2446], now have 1 active actors on pipe
2025-10-02T09:31:34.533314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:34.533316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:34.533319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:34.533326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:34.533328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:34.533345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.533353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:34.533363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:34.533372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1174
2025-10-02T09:31:34.533374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1174
2025-10-02T09:31:34.533402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.533408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.533425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:34.533432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.533435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.533436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:34.533441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.533448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:34.533457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.533556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.533561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.533569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.533632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1175 partition: 0 MaxSeqNo: 36 sessionId: src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0
2025-10-02T09:31:34.533912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dc4d7b2-c7cc7ef6-aa552034-10a7d8ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:34.536454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Write session: try to update token
2025-10-02T09:31:34.536468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:34.543012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:34.543026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.543032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.543062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:34.543066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:34.543208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:34.543329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.543452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.543577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.543821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:34.543853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:34.547946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId: src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:34.550122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:34.550269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.550285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.550308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:34.550365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:34.551796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:34.551807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.551809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:34.551810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:34.551815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.551818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.551820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554698414227246:7823]
2025-10-02T09:31:34.551842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:34.551846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.551845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:34.551847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:34.551848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:34.551850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:34.551955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:34.606378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554698489764148:8968]
2025-10-02T09:31:34.606587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1174, pipe: [1:7556554698489764148:8968]
2025-10-02T09:31:34.675967Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:34.682406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.682426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.682555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.682604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.682656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.682709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.682763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.682770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.682828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.682889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.682940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.682993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.683030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.683034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.683085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.683134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.683184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.683240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.683278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.683283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.683335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.683385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.683435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.683486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.683521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.683526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.683577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.683624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.683678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.683731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.683769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.683775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.683828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.683876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.683982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.684047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.684084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.684089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.684138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.684185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.684240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.684294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.684330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.684334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.684384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.684431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.684477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.684526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.684561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.684565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.684617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.684662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.684711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.684760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.684793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.684798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.684859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:34.684917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:34.684973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:34.685021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:34.685068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:34.685073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:34.685105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764148:8968], now have 1 active actors on pipe
2025-10-02T09:31:34.685291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554698489764148:8968]
2025-10-02T09:31:34.685306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:34.685309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:34.685315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:34.685328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1175 reason: error at write: Disconnected sessionId: src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0
2025-10-02T09:31:34.685469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1175 sessionId: src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0 is DEAD
2025-10-02T09:31:34.685628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:34.685633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Write session will restart in 0.009362s
2025-10-02T09:31:34.685648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Write session: Do CDS request
2025-10-02T09:31:34.685652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:34.685890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:34.696179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.696285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:34.696294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1176
2025-10-02T09:31:34.696368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.696389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:34.696396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:34.696398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:34.696681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1176 sessionId:  describe result for acl check
2025-10-02T09:31:34.696705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:34.696710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:34.696711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:34.696714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554698489764364:9377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:34.697077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554698489764364:9377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:34.697713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:34.698883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554698489764364:9377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:34.700483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:34.700586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:34.700593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:34.700599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:34.700625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:34.700650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554698414227517:7826]
2025-10-02T09:31:34.700919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554698489764364:9377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:34.700928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554698489764364:9377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:34.700930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554698489764364:9377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:34.700933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:34.701014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:34.701162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:34.701187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:34.701375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:34.701404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.701408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.701408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.701409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.701410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.701410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.701411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.701411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.701412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.701412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.701413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.701414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.701416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.701423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.701425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.701427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.701429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.701431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.701433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.701435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.701437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.701439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.701442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.701444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.701448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.701452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.701455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.701458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.701460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.701463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.701465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.701468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.701470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.701472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.701474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.701477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.701480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.701483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.701485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.701488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.701490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.701494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.701496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.701498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.701501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.701508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.701510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.701513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.701530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:34.709265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:34.710628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:34.710639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:34.710640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:34.710643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:34.710646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1175 [2:7556554698414227517:7826]
2025-10-02T09:31:34.710655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:34.710667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:34.710672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.710674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.710675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.710685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:34.710691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:34.710696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:34.710729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.710733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.710734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.710736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:34.710737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:34.710888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1175
2025-10-02T09:31:34.710891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1175
2025-10-02T09:31:34.711127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:34.711134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.711140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.711146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.711166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:34.711190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764402:9377], now have 1 active actors on pipe
2025-10-02T09:31:34.711193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764150:2446], now have 1 active actors on pipe
2025-10-02T09:31:34.711204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.711207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.711220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.711224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.711226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.711234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:34.711246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:34.711253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:34.711255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:34.711257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:34.711257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:34.711259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:34.711269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:34.711276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.711278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.711279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:34.711284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.711293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:34.711318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.711327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:34.711335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.711341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:34.711465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.711471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.711478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.711528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1176 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0
2025-10-02T09:31:34.711762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88bdaf7-f574c407-3d39efcd-fdfad604_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:34.714169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Write session: try to update token
2025-10-02T09:31:34.714183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:34.722084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:34.722099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.722101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:34.722102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:34.722108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.722111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.722116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554698414227512:7826]
2025-10-02T09:31:34.722140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:34.722143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.722144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:34.722164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:34.722177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:34.722181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:34.722254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:34.726295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId: src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:34.728425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:34.785581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554698489764429:8968]
2025-10-02T09:31:34.785981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1175, pipe: [1:7556554698489764429:8968]
2025-10-02T09:31:34.843398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:34.843848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.843857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.843882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764429:8968], now have 1 active actors on pipe
2025-10-02T09:31:34.844248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:34.844260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:34.844260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554698489764429:8968]
2025-10-02T09:31:34.844275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:34.844323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1176 reason: error at write: Disconnected sessionId: src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0
2025-10-02T09:31:34.844362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:34.844463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1176 sessionId: src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0 is DEAD
2025-10-02T09:31:34.844586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:34.844595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Write session will restart in 0.008585s
2025-10-02T09:31:34.844612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Write session: Do CDS request
2025-10-02T09:31:34.844617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:34.854171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.854307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:34.854314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1177
2025-10-02T09:31:34.854407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:34.854428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:34.854435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:34.854439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:34.854715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1177 sessionId:  describe result for acl check
2025-10-02T09:31:34.854739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:34.854744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:34.854746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:34.854748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554698489764637:9383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:34.855106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554698489764637:9383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:34.856281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:34.856610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554698489764637:9383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:34.858931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:34.859028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:34.859034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:34.859040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:34.859065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:34.859088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554698414227773:7828]
2025-10-02T09:31:34.859114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554698489764637:9383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:34.859122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554698489764637:9383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:34.859123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554698489764637:9383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:34.859127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:34.859429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:34.859598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:34.859621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:34.859794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:34.859823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.859827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.859828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.859828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.859829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.859830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.859830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.859831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.859831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.859832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.859833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.859833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.859836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.859841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.859844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.859846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.859848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.859850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.859852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.859854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.859856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.859858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.859860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.859861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.859865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.859868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:34.859872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.859875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:34.859877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.859879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:34.859881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.859884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:34.859886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.859889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:34.859895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.859898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:34.859900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.859903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:34.859908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.859911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:34.859913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.859916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:34.859918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.859922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.859924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.859927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.859929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.859931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.859951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:34.867419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:34.868857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:34.868868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:34.868870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:34.868871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:34.868875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1176 [2:7556554698414227773:7828]
2025-10-02T09:31:34.868883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:34.868894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:34.868899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.868900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.868902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.868911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:34.868913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:34.868922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:34.868956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.868961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.868962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.868963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:34.868965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:34.869005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:34.869010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.869021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:34.869028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:34.869037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:34.869050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764685:9383], now have 1 active actors on pipe
2025-10-02T09:31:34.869054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764432:2446], now have 1 active actors on pipe
2025-10-02T09:31:34.869057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.869058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.869059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.869067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:34.869075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:34.869079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:34.869081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:34.869082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:34.869084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:34.869085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:34.869102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.869107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:34.869100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1176
2025-10-02T09:31:34.869101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1176
2025-10-02T09:31:34.869120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:34.869127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.869129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.869146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:34.869153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:34.869156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:34.869157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:34.869162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:34.869168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:34.869179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.869268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.869272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.869280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:34.869339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1177 partition: 0 MaxSeqNo: 36 sessionId: src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0
2025-10-02T09:31:34.869632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b523db8-c8b43d16-8b68ba4f-7692882c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:34.872108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Write session: try to update token
2025-10-02T09:31:34.872120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:34.879426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:34.879442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.879447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.879475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:34.879481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:34.879609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:34.879721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.879832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.879939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:34.880089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:34.880114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:34.883948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId: src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:34.886028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:34.886589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:34.886602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:34.886624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:34.886687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:34.888252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:34.888264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:34.888265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:34.888266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:34.888271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.888273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.888275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554698414227768:7828]
2025-10-02T09:31:34.888295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:34.888296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:34.888298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:34.888301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:34.888303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:34.888304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:34.888412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:34.944297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554698489764700:8968]
2025-10-02T09:31:34.944509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1176, pipe: [1:7556554698489764700:8968]
2025-10-02T09:31:35.009674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.015785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.015805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.015931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.015982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.016036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.016091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.016129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.016136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.016187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.016239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.016290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.016342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.016379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.016384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.016435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.016483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.016536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.016588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.016622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.016627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.016677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.016726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.016777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.016843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.016880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.016885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.016937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.016986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.017039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.017090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.017129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.017134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.017186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.017234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.017283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.017336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.017372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.017377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.017432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.017480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.017530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.017582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.017618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.017623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.017670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.017719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.017767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.017816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.017850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.017856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.017906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.017954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.018004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.018061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.018101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.018106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.018153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:35.018200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:35.018249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:35.018298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:35.018334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:35.018338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:35.018371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554698489764700:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.018580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.018593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:35.018597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:35.018624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554698489764700:8968]
2025-10-02T09:31:35.018637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1177 reason: error at write: Disconnected sessionId: src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0
2025-10-02T09:31:35.018810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1177 sessionId: src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0 is DEAD
2025-10-02T09:31:35.018947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:35.018953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Write session will restart in 0.007096s
2025-10-02T09:31:35.018968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Write session: Do CDS request
2025-10-02T09:31:35.018973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.019201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.027165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.027263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.027274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1178
2025-10-02T09:31:35.027366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.027393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.027401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.027404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.027777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1178 sessionId:  describe result for acl check
2025-10-02T09:31:35.027805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.027810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.027812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.027816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784732131:9387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.028255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784732131:9387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.030498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784732131:9387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.033559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.033702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784732131:9387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.033714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784732131:9387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.033717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784732131:9387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.033722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.033846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.033949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.033956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.033962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.033989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.034017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709195329:7831]
2025-10-02T09:31:35.034368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.034535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.034562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.034763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.034857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.034863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.034864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.034864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.034865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.034865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.034876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.034877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.034877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.034878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.034879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.034879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.034883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.034890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.034892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.034894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.034896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.034899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.034901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.034903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.034905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.034907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.034909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.034911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.034916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.034919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.034923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.034926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.034928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.034933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.034936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.034941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.034949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.034953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.034956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.034962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.034965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.034972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.034975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.034980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.034988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.034993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.034999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.035003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.035007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.035013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.035016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.035023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.035045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.042774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.044159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.044173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.044174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.044176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.044180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1177 [2:7556554702709195329:7831]
2025-10-02T09:31:35.044188Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.044198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.044200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.044202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.044203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.044212Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.044220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.044226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.044259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.044264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.044266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.044268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.044270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.044313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.044320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.044330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.044340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.044356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.044375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784731997:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.044382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732252:9387], now have 1 active actors on pipe
2025-10-02T09:31:35.044386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.044388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.044389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.044398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.044407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.044413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.044418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.044420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.044421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.044421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.044417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1177
2025-10-02T09:31:35.044421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1177
2025-10-02T09:31:35.044439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.044443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.044444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.044463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.044470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.044495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fae886e9-1af83383-a830257c-1aec0ace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.044504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.044507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.044509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.044516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.044524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.044539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.044658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.044665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.044676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.044751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1178 partition: 0 MaxSeqNo: 36 sessionId: src_id|fae886e9-1af83383-a830257c-1aec0ace_0
2025-10-02T09:31:35.045027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd408d8-facd4ff0-e5bd0a2a-2a44cac2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fae886e9-1af83383-a830257c-1aec0ace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.047310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Write session: try to update token
2025-10-02T09:31:35.047324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.054088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.054103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.054105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.054106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.054112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.054114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.054119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709195323:7831]
2025-10-02T09:31:35.054143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.054147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.054149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.054151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.054154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.054159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.054261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.058211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId: src_id|fae886e9-1af83383-a830257c-1aec0ace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.060491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:35.118911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554702784732264:8968]
2025-10-02T09:31:35.119132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1177, pipe: [1:7556554702784732264:8968]
2025-10-02T09:31:35.174532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.175203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.175213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.175241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732264:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.175440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554702784732264:8968]
2025-10-02T09:31:35.175446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:35.175449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:35.175469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.175500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1178 reason: error at write: Disconnected sessionId: src_id|fae886e9-1af83383-a830257c-1aec0ace_0
2025-10-02T09:31:35.175634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.175667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1178 sessionId: src_id|fae886e9-1af83383-a830257c-1aec0ace_0 is DEAD
2025-10-02T09:31:35.175790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:35.175796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Write session will restart in 0.005469s
2025-10-02T09:31:35.175810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Write session: Do CDS request
2025-10-02T09:31:35.175815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.182124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.182260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.182270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1179
2025-10-02T09:31:35.182363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.182389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.182397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.182400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.182698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1179 sessionId:  describe result for acl check
2025-10-02T09:31:35.182723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.182728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.182729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.182731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784732337:9391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.183107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784732337:9391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.185344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784732337:9391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.187320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784732337:9391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.187328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784732337:9391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.187330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784732337:9391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.187334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.190415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.190705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.190813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.190820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.190826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.190851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.190885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709195587:7833]
2025-10-02T09:31:35.191230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.191387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.191414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.191603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.191634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.191638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.191639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.191639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.191640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.191641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.191641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.191642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.191642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.191643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.191643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.191644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.191646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.191653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.191655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.191658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.191660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.191662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.191664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.191666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.191668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.191670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.191672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.191674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.191678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.191682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.191685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.191688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.191690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.191693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.191695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.191698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.191701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.191703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.191705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.191708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.191710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.191714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.191716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.191719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.191721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.191725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.191728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.191731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.191733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.191736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.191740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.191742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.191760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.199186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.200547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.200558Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.200559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.200561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.200565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1178 [2:7556554702709195587:7833]
2025-10-02T09:31:35.200573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.200584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.200589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.200590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.200591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.200600Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.200603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.200609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.200641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.200646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.200647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.200649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.200650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.200695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.200702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.200712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.200721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.200738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.200757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732265:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.200762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732518:9391], now have 1 active actors on pipe
2025-10-02T09:31:35.200766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.200767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.200769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.200776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.200787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.200789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.200791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.200792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.200798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.200811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.200826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.200834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.200845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.200828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1178
2025-10-02T09:31:35.200843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1178
2025-10-02T09:31:35.200901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.200909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.200927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.200937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.200941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.200944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.200950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.200961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.200970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.201081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.201087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.201096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.201158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1179 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0
2025-10-02T09:31:35.201441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae886e9-1af83383-a830257c-1aec0ace_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.203806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Write session: try to update token
2025-10-02T09:31:35.203818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.210986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.211001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.211002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.211004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.211008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.211011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.211013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709195582:7833]
2025-10-02T09:31:35.211035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.211038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.211040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.211042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.211045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.211049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.211147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.214961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId: src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.217184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:35.275573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554702784732534:8968]
2025-10-02T09:31:35.275750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1178, pipe: [1:7556554702784732534:8968]
2025-10-02T09:31:35.323048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.323224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.323234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.323258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732534:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.323456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:35.323464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554702784732534:8968]
2025-10-02T09:31:35.323466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:35.323488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.323511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1179 reason: error at write: Disconnected sessionId: src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0
2025-10-02T09:31:35.323650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1179 sessionId: src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0 is DEAD
2025-10-02T09:31:35.323677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.323776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:35.323785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Write session will restart in 0.009598s
2025-10-02T09:31:35.323808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Write session: Do CDS request
2025-10-02T09:31:35.323814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.334128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.334193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.334203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1180
2025-10-02T09:31:35.334289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.334309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.334315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.334318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.334622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1180 sessionId:  describe result for acl check
2025-10-02T09:31:35.334651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.334656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.334657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.334661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784732753:9396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.335075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784732753:9396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.336311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784732753:9396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.338701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.338756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784732753:9396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.338763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784732753:9396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.338767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784732753:9396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.338770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.339021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.339121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.339128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.339134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.339162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.339186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709195848:7836]
2025-10-02T09:31:35.339534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.339780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.339807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.339987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.340019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.340023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.340024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.340025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.340025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.340026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.340026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.340027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.340027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.340028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.340028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.340029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.340032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.340038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.340040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.340042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.340044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.340046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.340048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.340050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.340052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.340055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.340057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.340059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.340064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.340068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.340071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.340074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.340076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.340078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.340080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.340083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.340085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.340088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.340090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.340092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.340094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.340097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.340099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.340101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.340103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.340106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.340108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.340110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.340112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.340117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.340119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.340122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.340139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.347740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.349097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.349108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.349109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.349111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.349114Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1179 [2:7556554702709195848:7836]
2025-10-02T09:31:35.349121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.349130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.349131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.349133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.349134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.349143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.349146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.349150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.349183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.349188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.349189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.349192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.349193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.349233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.349240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.349249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.349258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.349276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.349294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732793:9396], now have 1 active actors on pipe
2025-10-02T09:31:35.349301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732535:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.349306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.349307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.349308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.349316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.349330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.349331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.349337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.349321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1179
2025-10-02T09:31:35.349340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1179
2025-10-02T09:31:35.349339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.349343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.349346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.349361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.349368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.349369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.349379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.349386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.349417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.349427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.349430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.349431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.349437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.349446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.349460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.349557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.349563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.349573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.349627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1180 partition: 0 MaxSeqNo: 36 sessionId: src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0
2025-10-02T09:31:35.349831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb0f893-d614f762-b2ca8811-ac626fcd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.352012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Write session: try to update token
2025-10-02T09:31:35.352022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.353351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:31:35.353363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-02T09:31:35.353497Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:31:35.353626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 9 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:31:35.353648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:31:35.359128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.359143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.359144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.359145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.359151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.359153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.359155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709195842:7836]
2025-10-02T09:31:35.359179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.359183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.359184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.359185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.359187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.359189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.359295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.362380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId: src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.364357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:35.423506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554702784732808:8968]
2025-10-02T09:31:35.423688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1179, pipe: [1:7556554702784732808:8968]
2025-10-02T09:31:35.474357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.474909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.474919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.474943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732808:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.475051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.475128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.475150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:31:35.475179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554702784732808:8968]
2025-10-02T09:31:35.475198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:35.475254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1180 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0
2025-10-02T09:31:35.475415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1180 sessionId: src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0 is DEAD
2025-10-02T09:31:35.475530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:35.475539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Write session will restart in 0.007180s
2025-10-02T09:31:35.475553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Write session: Do CDS request
2025-10-02T09:31:35.475558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.484112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.484202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.484216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1181
2025-10-02T09:31:35.484303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.484327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.484334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.484338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.484739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1181 sessionId:  describe result for acl check
2025-10-02T09:31:35.484764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.484770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.484771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.484776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784732964:9406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.485158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784732964:9406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.486962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784732964:9406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.490897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.491072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784732964:9406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.491081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784732964:9406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.491083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784732964:9406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.491087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.491173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.491259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.491265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.491271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.491295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.491316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709196144:7845]
2025-10-02T09:31:35.491649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.491802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.491825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.491997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.492023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.492026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.492027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.492028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.492028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.492029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.492029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.492030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.492030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.492030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.492031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.492031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.492034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.492040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.492042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.492044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.492046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.492048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.492050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.492052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.492053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.492055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.492057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.492059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.492062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.492066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.492069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.492072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.492074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.492076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.492078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.492081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.492083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.492086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.492088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.492090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.492092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.492095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.492097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.492100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.492104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.492108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.492110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.492113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.492116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.492120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.492122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.492125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.492141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.499477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.500951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.500960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.500962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.500963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.500967Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1180 [2:7556554702709196144:7845]
2025-10-02T09:31:35.500973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.500982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.500983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.500985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.500985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.500993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.500996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.501000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.501029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.501034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.501035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.501037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.501038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.501075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.501080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.501086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.501091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.501100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.501113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784732825:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.501119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733091:9406], now have 1 active actors on pipe
2025-10-02T09:31:35.501123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.501124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.501125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.501132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.501142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.501145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.501147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.501148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.501151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.501152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.501143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1180
2025-10-02T09:31:35.501152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1180
2025-10-02T09:31:35.501164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.501169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.501171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.501192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.501198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.501237Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:31:35.501256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.501263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.501265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.501266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.501271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.501276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.501287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.501359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 10 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:31:35.501377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:31:35.501388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.501393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.501400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.501452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1181 partition: 0 MaxSeqNo: 36 sessionId: src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0
2025-10-02T09:31:35.501659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66a2bc-efc72a9d-65a0bd4f-a6799293_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.503820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Write session: try to update token
2025-10-02T09:31:35.503830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.510614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.510628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.510629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.510630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.510635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.510637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.510640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709196138:7845]
2025-10-02T09:31:35.510661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.510664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.510666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.510668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.510671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.510673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.510781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.514223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId: src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.516310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:35.575085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554702784733106:8968]
2025-10-02T09:31:35.575270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1180, pipe: [1:7556554702784733106:8968]
2025-10-02T09:31:35.625523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.626050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.626060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.626086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733106:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.626262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.626275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:35.626286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:35.626326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554702784733106:8968]
2025-10-02T09:31:35.626327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1181 reason: error at write: Disconnected sessionId: src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0
2025-10-02T09:31:35.626348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.626465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1181 sessionId: src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0 is DEAD
2025-10-02T09:31:35.626608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:35.626618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Write session will restart in 0.008246s
2025-10-02T09:31:35.626635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Write session: Do CDS request
2025-10-02T09:31:35.626639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.636108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.636186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.636196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1182
2025-10-02T09:31:35.636294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.636314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.636320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.636324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.636697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1182 sessionId:  describe result for acl check
2025-10-02T09:31:35.636727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.636733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.636734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.636739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784733247:9411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.637213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784733247:9411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.638979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784733247:9411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.643314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784733247:9411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.643323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784733247:9411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.643325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784733247:9411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.643329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.643327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.643647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.643764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.643770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.643777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.643803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.643826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709196406:7854]
2025-10-02T09:31:35.644184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.644376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.644402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.644588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.644618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.644622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.644623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.644623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.644624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.644624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.644625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.644625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.644626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.644626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.644627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.644627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.644630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.644638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.644640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.644642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.644644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.644646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.644648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.644650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.644652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.644655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.644657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.644659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.644662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.644666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.644670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.644673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.644675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.644678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.644680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.644682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.644686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.644689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.644691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.644693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.644695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.644698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.644700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.644703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.644705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.644708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.644714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.644716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.644720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.644723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.644725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.644727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.644745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.652371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.653774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.653786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.653788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.653790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.653793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1181 [2:7556554702709196406:7854]
2025-10-02T09:31:35.653800Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.653809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.653811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.653812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.653813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.653822Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.653824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.653833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.653864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.653869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.653870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.653872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.653873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.653909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.653914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.653924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.653933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.653951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.653970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733367:9411], now have 1 active actors on pipe
2025-10-02T09:31:35.653978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733110:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.653983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.653987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.653990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.654002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.654003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1181
2025-10-02T09:31:35.654013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.654016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.654020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.654021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.654027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.654029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.654035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1181
2025-10-02T09:31:35.654055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.654074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.654083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.654091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.654099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.654116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.654123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.654125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.654126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.654132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.654139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.654154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.654286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.654293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.654304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.654361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1182 partition: 0 MaxSeqNo: 36 sessionId: src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0
2025-10-02T09:31:35.654616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209f2c4c-6009bfea-28d27e37-b2d98649_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.656836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Write session: try to update token
2025-10-02T09:31:35.656846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.663624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.663640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.663641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.663642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.663647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.663650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.663653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709196400:7854]
2025-10-02T09:31:35.663675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.663677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.663681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.663683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.663683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.663685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.663809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.667154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId: src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.669134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:35.726616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554702784733380:8968]
2025-10-02T09:31:35.726826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1181, pipe: [1:7556554702784733380:8968]
2025-10-02T09:31:35.781214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.781803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.781813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.781839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733380:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.781965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.782044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554702784733380:8968]
2025-10-02T09:31:35.782059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.782068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:35.782116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1182 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0
2025-10-02T09:31:35.782258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1182 sessionId: src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0 is DEAD
2025-10-02T09:31:35.782411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:35.782421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Write session will restart in 0.007272s
2025-10-02T09:31:35.782436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Write session: Do CDS request
2025-10-02T09:31:35.782441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.791128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.791199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.791206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1183
2025-10-02T09:31:35.791294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.791313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.791319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.791321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.791646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1183 sessionId:  describe result for acl check
2025-10-02T09:31:35.791677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.791682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.791683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.791686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784733521:9416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.792034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784733521:9416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.793977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784733521:9416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.795354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.798240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.798326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784733521:9416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.798334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784733521:9416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.798336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784733521:9416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.798340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.798360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.798368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.798374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.798403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.798427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709196679:7857]
2025-10-02T09:31:35.798771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.798949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.798981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.799174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.799204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.799208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.799209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.799209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.799210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.799210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.799211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.799212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.799212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.799213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.799213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.799214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.799217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.799223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.799225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.799227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.799229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.799231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.799233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.799235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.799237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.799239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.799241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.799243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.799247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.799251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.799255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.799258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.799260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.799263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.799265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.799268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.799270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.799273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.799275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.799278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.799281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.799284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.799286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.799289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.799291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.799294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.799296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.799299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.799305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.799308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.799310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.799312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.799329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.806932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.808349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.808360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.808361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.808363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.808367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1182 [2:7556554702709196679:7857]
2025-10-02T09:31:35.808374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.808383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.808389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.808390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.808391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.808401Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.808403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.808408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.808439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.808444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.808445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.808447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.808448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.808484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.808489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.808496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.808501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.808509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.808524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733655:9416], now have 1 active actors on pipe
2025-10-02T09:31:35.808530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733393:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.808533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.808535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.808536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.808543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.808553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.808555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.808557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.808560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.808561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.808563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.808564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1182
2025-10-02T09:31:35.808576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.808568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1182
2025-10-02T09:31:35.808581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.808583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.808596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.808601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.808618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.808625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.808628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.808629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.808635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.808643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.808655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.808757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.808765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.808775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.808852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1183 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0
2025-10-02T09:31:35.809041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4716af-80ccd945-57fdb8d3-f4831a97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.811220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Write session: try to update token
2025-10-02T09:31:35.811229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.818452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.818466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.818467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.818468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.818473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.818476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.818479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709196674:7857]
2025-10-02T09:31:35.818500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.818504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.818507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.818507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.818511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.818513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.818622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.821937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId: src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.823933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:35.882282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554702784733672:8968]
2025-10-02T09:31:35.882450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1182, pipe: [1:7556554702784733672:8968]
2025-10-02T09:31:35.933875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:35.934074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.934089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.934119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733672:8968], now have 1 active actors on pipe
2025-10-02T09:31:35.934233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:35.934244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:35.934273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:35.934292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1183 reason: error at write: Disconnected sessionId: src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0
2025-10-02T09:31:35.934307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554702784733672:8968]
2025-10-02T09:31:35.934439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1183 sessionId: src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0 is DEAD
2025-10-02T09:31:35.934571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:35.934580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Write session will restart in 0.009718s
2025-10-02T09:31:35.934579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:35.934595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Write session: Do CDS request
2025-10-02T09:31:35.934607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:35.945090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.945402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:35.945413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1184
2025-10-02T09:31:35.945518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:35.945544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:35.945552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:35.945557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:35.945830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1184 sessionId:  describe result for acl check
2025-10-02T09:31:35.945848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:35.945852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:35.945853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:35.945856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554702784733896:9421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:35.946210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554702784733896:9421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:35.946609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:35.947831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554702784733896:9421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:35.949153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:35.949250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:35.949257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:35.949263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:35.949289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:35.949313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554702709196944:7860]
2025-10-02T09:31:35.949652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:35.949684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554702784733896:9421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:35.949694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554702784733896:9421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:35.949697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554702784733896:9421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:35.949701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:35.949809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:35.949832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:35.950033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:35.950068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.950072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.950073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.950073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.950074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.950074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.950075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.950075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.950076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.950076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.950077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.950077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.950080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.950086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.950088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.950091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.950093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.950095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.950097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.950099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.950101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.950103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.950105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.950107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.950111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.950115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:35.950119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.950121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:35.950124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.950126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:35.950128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.950131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:35.950135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.950138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:35.950140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.950142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:35.950146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.950149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:35.950151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.950157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:35.950160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.950162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:35.950165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.950167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.950170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.950173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.950175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.950177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.950193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:35.957856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:35.959441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:35.959452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:35.959453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:35.959455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:35.959459Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1183 [2:7556554702709196944:7860]
2025-10-02T09:31:35.959466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:35.959477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:35.959479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.959481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.959482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.959492Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:35.959498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:35.959502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:35.959532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.959537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.959538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.959540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:35.959542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:35.959581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:35.959586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.959593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:35.959598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:35.959608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:35.959623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733935:9421], now have 1 active actors on pipe
2025-10-02T09:31:35.959629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554702784733673:2446], now have 1 active actors on pipe
2025-10-02T09:31:35.959632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.959634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.959635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.959642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:35.959652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:35.959655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:35.959657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:35.959658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:35.959662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:35.959664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:35.959682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.959668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1183
2025-10-02T09:31:35.959688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:35.959689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:35.959670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1183
2025-10-02T09:31:35.959707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.959712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.959731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:35.959737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:35.959740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:35.959741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:35.959746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:35.959751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:35.959766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.959865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:35.959870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:35.959880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:35.959936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1184 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0
2025-10-02T09:31:35.960166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b62ea48-7d743c4c-9242c726-9b829ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:35.963037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Write session: try to update token
2025-10-02T09:31:35.963051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:35.969314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:35.969330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:35.969332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:35.969333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:35.969339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.969343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.969346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554702709196939:7860]
2025-10-02T09:31:35.969368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:35.969371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:35.969373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:35.969374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:35.969379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:35.969381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:35.969500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:35.975003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId: src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:35.977161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.034352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079701241:8968]
2025-10-02T09:31:36.034588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1183, pipe: [1:7556554707079701241:8968]
2025-10-02T09:31:36.087766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:36.088268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.088279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.088292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701241:8968], now have 1 active actors on pipe
2025-10-02T09:31:36.088437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:36.088514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:36.088534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079701241:8968]
2025-10-02T09:31:36.088551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:36.088606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0
2025-10-02T09:31:36.088745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1184 sessionId: src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0 is DEAD
2025-10-02T09:31:36.088874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:36.088885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Write session will restart in 0.009495s
2025-10-02T09:31:36.088901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Write session: Do CDS request
2025-10-02T09:31:36.088905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:36.099119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.099235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:36.099245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1185
2025-10-02T09:31:36.099334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.099354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:36.099361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:36.099364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:36.099654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1185 sessionId:  describe result for acl check
2025-10-02T09:31:36.099679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:36.099684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:36.099685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:36.099688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554707079701455:9425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:36.100030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554707079701455:9425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:36.101222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:36.101382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554707079701455:9425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:36.104207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:36.104306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:36.104313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:36.104319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:36.104346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:36.104370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554707004164504:7862]
2025-10-02T09:31:36.104397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554707079701455:9425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:36.104404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554707079701455:9425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:36.104406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554707079701455:9425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:36.104409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:36.104738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:36.104924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:36.104948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:36.105135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:36.105167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.105171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.105171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.105172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.105173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.105173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.105174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.105174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.105175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.105175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.105176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.105176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.105179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.105185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.105187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.105189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.105191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.105194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.105196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.105198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.105200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.105202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.105204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.105206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.105209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.105213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.105217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.105220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.105223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.105226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.105228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.105231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.105233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.105236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.105238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.105240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.105243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.105245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.105247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.105250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.105254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.105256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.105259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.105261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.105263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.105266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.105272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.105275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.105294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:36.112855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:36.114512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:36.114524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:36.114526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:36.114528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:36.114532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1184 [2:7556554707004164504:7862]
2025-10-02T09:31:36.114541Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:36.114551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:36.114557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.114558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.114559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.114568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:36.114571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:36.114575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:36.114613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.114619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.114621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.114623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:36.114626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:36.114667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:36.114673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.114680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.114686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.114696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:36.114712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701502:9425], now have 1 active actors on pipe
2025-10-02T09:31:36.114717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701242:2446], now have 1 active actors on pipe
2025-10-02T09:31:36.114721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.114722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.114723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.114730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:36.114742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:36.114746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:36.114748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:36.114749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:36.114753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:36.114755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:36.114769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.114774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:36.114761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1184
2025-10-02T09:31:36.114780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:36.114765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1184
2025-10-02T09:31:36.114794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.114799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.114817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:36.114824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.114827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.114828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:36.114834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.114839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:36.114849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.114967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.114972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.114982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.115043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1185 partition: 0 MaxSeqNo: 36 sessionId: src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0
2025-10-02T09:31:36.115278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c70bd93-76cc28cd-17e50f2c-f2b606af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:36.117503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Write session: try to update token
2025-10-02T09:31:36.117515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:36.124466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:36.124482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.124485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:36.124486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:36.124491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.124494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.124496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554707004164499:7862]
2025-10-02T09:31:36.124520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:36.124524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.124526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:36.124529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:36.124533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:36.124536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:36.124646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:36.128331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId: src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:36.130485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.188446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079701515:8968]
2025-10-02T09:31:36.188641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1184, pipe: [1:7556554707079701515:8968]
2025-10-02T09:31:36.244875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:36.245321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.245331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.245357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701515:8968], now have 1 active actors on pipe
2025-10-02T09:31:36.245479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:36.245526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:36.245535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:36.245554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079701515:8968]
2025-10-02T09:31:36.245585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1185 reason: error at write: Disconnected sessionId: src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0
2025-10-02T09:31:36.245586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:36.245730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1185 sessionId: src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0 is DEAD
2025-10-02T09:31:36.245860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:36.245869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Write session will restart in 0.007024s
2025-10-02T09:31:36.245887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Write session: Do CDS request
2025-10-02T09:31:36.245892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:36.254124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.254216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:36.254224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1186
2025-10-02T09:31:36.254296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.254316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:36.254322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:36.254325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:36.254675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1186 sessionId:  describe result for acl check
2025-10-02T09:31:36.254708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:36.254714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:36.254715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:36.254719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554707079701648:9430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:36.255198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554707079701648:9430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:36.257182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554707079701648:9430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:36.260850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:36.261025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554707079701648:9430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:36.261034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554707079701648:9430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:36.261036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554707079701648:9430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:36.261040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:36.261100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:36.261194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:36.261200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:36.261206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:36.261230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:36.261254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554707004164772:7865]
2025-10-02T09:31:36.261608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:36.261768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:36.261791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:36.261975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:36.262006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.262010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.262010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.262011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.262011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.262012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.262012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.262013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.262014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.262014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.262015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.262015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.262018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.262024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.262026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.262028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.262030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.262032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.262034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.262036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.262038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.262041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.262043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.262045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.262048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.262052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.262056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.262061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.262065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.262069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.262077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.262082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.262090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.262095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.262101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.262104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.262106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.262109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.262111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.262113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.262119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.262122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.262124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.262126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.262128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.262131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.262134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.262137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.262153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:36.269599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:36.270994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:36.271004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:36.271005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:36.271007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:36.271009Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1185 [2:7556554707004164772:7865]
2025-10-02T09:31:36.271016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:36.271025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:36.271027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.271028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.271029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.271037Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:36.271040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:36.271045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:36.271073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.271077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.271078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.271080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:36.271081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:36.271115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:36.271120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.271126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.271131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.271141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:36.271154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701779:9430], now have 1 active actors on pipe
2025-10-02T09:31:36.271160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701518:2446], now have 1 active actors on pipe
2025-10-02T09:31:36.271163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.271164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.271165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.271173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:36.271180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:36.271186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:36.271187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:36.271188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:36.271193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:36.271194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:36.271200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.271202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:36.271204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:36.271209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1185
2025-10-02T09:31:36.271227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1185
2025-10-02T09:31:36.271234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.271239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.271254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:36.271260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.271262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.271263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:36.271268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.271274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:36.271281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.271392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.271399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.271408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.271463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1186 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0
2025-10-02T09:31:36.271662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbf383-f90d54f2-5e3e95a8-9df486c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:36.273901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Write session: try to update token
2025-10-02T09:31:36.273911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:36.280764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:36.280780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.280786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.280815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:36.280827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:36.280972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:36.281082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:36.281197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:36.281306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:36.281449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:36.281473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:36.284080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId: src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:36.285981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.286527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.286538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.286556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:36.286605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:36.289128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:36.289139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.289141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:36.289142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:36.289147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.289149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.289151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554707004164766:7865]
2025-10-02T09:31:36.289168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:36.289170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:36.289172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:36.289172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:36.289176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.289177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:36.289286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:36.345623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079701792:8968]
2025-10-02T09:31:36.345769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1185, pipe: [1:7556554707079701792:8968]
2025-10-02T09:31:36.401531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:36.407504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.407522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.407647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.407698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.407755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.407809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.407843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.407849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.407901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.407948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.407999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.408058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.408094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.408099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.408149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.408193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.408242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.408288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.408322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.408327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.408376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.408424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.408474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.408520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.408555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.408563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.408615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.408659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.408704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.408752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.408786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.408790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.408847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.408909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.408955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.409002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.409041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.409046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.409098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.409148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.409197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.409244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.409277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.409284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.409330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.409376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.409422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.409468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.409500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.409504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.409548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.409597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.409646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.409692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.409724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.409728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.409775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.409820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.409869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.409918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.409951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.409956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.409986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701792:8968], now have 1 active actors on pipe
2025-10-02T09:31:36.410166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079701792:8968]
2025-10-02T09:31:36.410186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:36.410198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:36.410201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:36.410220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1186 reason: error at write: Disconnected sessionId: src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0
2025-10-02T09:31:36.410365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1186 sessionId: src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0 is DEAD
2025-10-02T09:31:36.410501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:36.410509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Write session will restart in 0.007932s
2025-10-02T09:31:36.410524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Write session: Do CDS request
2025-10-02T09:31:36.410528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:36.410690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:36.419111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.419185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:36.419193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1187
2025-10-02T09:31:36.419270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.419292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:36.419299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:36.419301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:36.419581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1187 sessionId:  describe result for acl check
2025-10-02T09:31:36.419603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:36.419607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:36.419608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:36.419611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554707079701935:9434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:36.419938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554707079701935:9434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:36.421808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554707079701935:9434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:36.423055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:36.425442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:36.425508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554707079701935:9434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:36.425515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554707079701935:9434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:36.425517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554707079701935:9434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:36.425520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:36.425586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:36.425596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:36.425605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:36.425651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:36.425686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554707004165038:7867]
2025-10-02T09:31:36.426221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:36.426407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:36.426447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:36.426730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:36.426779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.426785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.426786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.426787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.426788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.426789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.426790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.426791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.426792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.426792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.426793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.426794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.426799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.426808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.426812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.426816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.426819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.426823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.426826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.426835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.426839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.426845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.426848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.426854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.426860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.426877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.426887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.426894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.426898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.426907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.426913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.426918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.426922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.426927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.426931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.426937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.426941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.426948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.426952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.426959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.426966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.426970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.426980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.426986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.426990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.426994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.427000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.427005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.427038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:36.434634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:36.436178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:36.436193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:36.436194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:36.436197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:36.436201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1186 [2:7556554707004165038:7867]
2025-10-02T09:31:36.436211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:36.436225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:36.436232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.436234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.436236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.436247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:36.436256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:36.436261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:36.436304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.436311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.436313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.436315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:36.436317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:36.436364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:36.436371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.436382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.436397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.436417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:36.436434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079701793:2446], now have 1 active actors on pipe
2025-10-02T09:31:36.436442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702056:9434], now have 1 active actors on pipe
2025-10-02T09:31:36.436447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.436453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.436454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.436443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1186
2025-10-02T09:31:36.436442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1186
2025-10-02T09:31:36.436461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:36.436469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:36.436471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:36.436472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:36.436478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:36.436493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:36.436500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:36.436518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.436525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.436547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.436558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:36.436565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:36.436574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:36.436584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.436588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.436590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:36.436597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.436608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:36.436635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.436738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.436747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.436761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.436833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1187 partition: 0 MaxSeqNo: 36 sessionId: src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0
2025-10-02T09:31:36.437038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1298c4-795151f6-b485ba63-1cbf2c24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:36.439229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Write session: try to update token
2025-10-02T09:31:36.439239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:36.446024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:36.446039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.446040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:36.446041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:36.446045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.446048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.446050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554707004165033:7867]
2025-10-02T09:31:36.446072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:36.446072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:36.446075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:36.446077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.446077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:36.446078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:36.446186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:36.450359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId: src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:36.452313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.510483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079702081:8968]
2025-10-02T09:31:36.510650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1186, pipe: [1:7556554707079702081:8968]
2025-10-02T09:31:36.566719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:36.566942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.566952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.566977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702081:8968], now have 1 active actors on pipe
2025-10-02T09:31:36.567122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:36.567142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079702081:8968]
2025-10-02T09:31:36.567161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:36.567164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:36.567164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:36.567223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1187 reason: error at write: Disconnected sessionId: src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0
2025-10-02T09:31:36.567348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1187 sessionId: src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0 is DEAD
2025-10-02T09:31:36.567458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:36.567466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Write session will restart in 0.005622s
2025-10-02T09:31:36.567485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Write session: Do CDS request
2025-10-02T09:31:36.567489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:36.574087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.574169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:36.574177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1188
2025-10-02T09:31:36.574270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.574292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:36.574298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:36.574301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:36.574589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1188 sessionId:  describe result for acl check
2025-10-02T09:31:36.574611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:36.574616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:36.574617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:36.574620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554707079702167:9447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:36.574984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554707079702167:9447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:36.576888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554707079702167:9447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:36.578948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554707079702167:9447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:36.578956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554707079702167:9447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:36.578958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554707079702167:9447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:36.578961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:36.582203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:36.582438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:36.582534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:36.582542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:36.582547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:36.582572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:36.582594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554707004165341:7881]
2025-10-02T09:31:36.582968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:36.583128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:36.583152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:36.583333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:36.583362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.583366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.583366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.583367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.583367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.583368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.583368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.583369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.583369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.583370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.583370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.583371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.583374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.583380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.583382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.583384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.583386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.583388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.583390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.583392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.583394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.583396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.583398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.583400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.583403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.583407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.583410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.583413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.583415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.583418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.583420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.583422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.583425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.583427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.583429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.583431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.583434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.583436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.583438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.583440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.583443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.583445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.583447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.583450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.583452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.583455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.583458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.583460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.583477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:36.591010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:36.592575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:36.592588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:36.592589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:36.592591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:36.592594Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1187 [2:7556554707004165341:7881]
2025-10-02T09:31:36.592601Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:36.592610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:36.592611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.592613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.592614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.592623Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:36.592630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:36.592635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:36.592663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.592668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.592669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.592671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:36.592673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:36.592710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:36.592715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.592722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.592727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.592736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:36.592751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702356:9447], now have 1 active actors on pipe
2025-10-02T09:31:36.592757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702095:2446], now have 1 active actors on pipe
2025-10-02T09:31:36.592760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.592762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.592763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.592770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:36.592780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:36.592782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:36.592784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:36.592785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:36.592791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:36.592792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:36.592818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.592823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:36.592825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:36.592811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1187
2025-10-02T09:31:36.592813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1187
2025-10-02T09:31:36.592839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.592844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.592871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:36.592878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.592880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.592881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:36.592888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.592897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:36.592918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.593012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.593017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.593025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.593082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1188 partition: 0 MaxSeqNo: 36 sessionId: src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0
2025-10-02T09:31:36.593279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98916818-6ecc4f18-a2f33f5-857d9b97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:36.595732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Write session: try to update token
2025-10-02T09:31:36.595744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:36.604230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:36.604248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.604250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:36.604252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:36.604259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.604263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.604266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554707004165336:7881]
2025-10-02T09:31:36.604292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:36.604295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:36.604296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:36.604298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:36.604301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.604303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:36.604427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:36.612190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId: src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:36.614280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.667171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079702370:8968]
2025-10-02T09:31:36.667361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1187, pipe: [1:7556554707079702370:8968]
2025-10-02T09:31:36.718928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:36.719363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.719372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.719383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702370:8968], now have 1 active actors on pipe
2025-10-02T09:31:36.719506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:36.719571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079702370:8968]
2025-10-02T09:31:36.719592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:36.719690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:36.719743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0
2025-10-02T09:31:36.719871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1188 sessionId: src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0 is DEAD
2025-10-02T09:31:36.720008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:36.720018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Write session will restart in 0.008325s
2025-10-02T09:31:36.720032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Write session: Do CDS request
2025-10-02T09:31:36.720036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:36.729078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.729204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:36.729214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1189
2025-10-02T09:31:36.729288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.729310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:36.729316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:36.729319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:36.729594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1189 sessionId:  describe result for acl check
2025-10-02T09:31:36.729619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:36.729623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:36.729625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:36.729628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554707079702538:9451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:36.729979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554707079702538:9451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:36.731530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554707079702538:9451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:36.734621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:36.734779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554707079702538:9451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:36.734789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554707079702538:9451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:36.734791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554707079702538:9451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:36.734794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:36.734876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:36.734969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:36.734976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:36.734982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:36.735008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:36.735031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554707004165620:7884]
2025-10-02T09:31:36.735394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:36.735573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:36.735596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:36.735787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:36.735820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.735824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.735824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.735825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.735826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.735826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.735827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.735827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.735828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.735828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.735829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.735829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.735832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.735838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.735841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.735843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.735845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.735847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.735849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.735851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.735853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.735855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.735857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.735859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.735863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.735867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.735871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.735874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.735877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.735880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.735882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.735885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.735887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.735890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.735892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.735898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.735901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.735903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.735905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.735908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.735910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.735913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.735918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.735921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.735923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.735926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.735928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.735930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.735948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:36.743408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:36.745041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:36.745053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:36.745055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:36.745058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:36.745062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1188 [2:7556554707004165620:7884]
2025-10-02T09:31:36.745073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:36.745090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:36.745097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.745099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.745101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.745112Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:36.745119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:36.745123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:36.745155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.745160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.745161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.745163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:36.745164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:36.745201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:36.745206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.745214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.745219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.745228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:36.745240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702637:9451], now have 1 active actors on pipe
2025-10-02T09:31:36.745245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702372:2446], now have 1 active actors on pipe
2025-10-02T09:31:36.745249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.745251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.745252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.745259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:36.745267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:36.745270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:36.745273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:36.745274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:36.745278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:36.745279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:36.745292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.745297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:36.745298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:36.745302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1188
2025-10-02T09:31:36.745303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1188
2025-10-02T09:31:36.745335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.745340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.745356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3a889d0-ab802d39-276b4303-f1c0148_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:36.745363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.745364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.745365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:36.745371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.745376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:36.745384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.745481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.745486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.745494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.745546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1189 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3a889d0-ab802d39-276b4303-f1c0148_0
2025-10-02T09:31:36.745782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150b0c19-a3509eab-412b4cc6-6a0c8e7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3a889d0-ab802d39-276b4303-f1c0148_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:36.748279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Write session: try to update token
2025-10-02T09:31:36.748291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:36.758595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:36.758607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.758614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.758641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:36.758644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:36.758776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:36.758901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:36.759017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:36.759128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:36.759295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:36.759325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:36.760053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId: src_id|f3a889d0-ab802d39-276b4303-f1c0148_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:36.762083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.762169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.762178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.762991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:36.763010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:36.763011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.763012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:36.763013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:36.763018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.763020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.763022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554707004165614:7884]
2025-10-02T09:31:36.763029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:36.763035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:36.763036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:36.763037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:36.763039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.763041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:36.763050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:36.763141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:36.819737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079702665:8968]
2025-10-02T09:31:36.819897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1188, pipe: [1:7556554707079702665:8968]
2025-10-02T09:31:36.878449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:36.884591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.884609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.884733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.884786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.884848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.884901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.884944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.884951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.885003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.885052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.885102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.885154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.885193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.885200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.885251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.885296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.885345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.885391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.885426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.885431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.885479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.885525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.885575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.885623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.885657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.885662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.885713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.885768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.885820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.885868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.885902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.885907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.885956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.886001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.886048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.886094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.886127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.886132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.886177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.886224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.886274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.886321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.886357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.886362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.886411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.886457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.886502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.886547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.886579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.886584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.886625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.886670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.886716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.886763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.886796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.886800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.886846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:36.886902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:36.886948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:36.886993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:36.887026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:36.887031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:36.887060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702665:8968], now have 1 active actors on pipe
2025-10-02T09:31:36.887459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:36.887476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079702665:8968]
2025-10-02T09:31:36.887497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:36.887499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:36.887517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1189 reason: error at write: Disconnected sessionId: src_id|f3a889d0-ab802d39-276b4303-f1c0148_0
2025-10-02T09:31:36.887669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1189 sessionId: src_id|f3a889d0-ab802d39-276b4303-f1c0148_0 is DEAD
2025-10-02T09:31:36.887675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:36.887784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:36.887794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Write session will restart in 0.005485s
2025-10-02T09:31:36.887809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Write session: Do CDS request
2025-10-02T09:31:36.887813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:36.894127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.894215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:36.894224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1190
2025-10-02T09:31:36.894301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:36.894321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:36.894327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:36.894331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:36.894708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1190 sessionId:  describe result for acl check
2025-10-02T09:31:36.894737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:36.894741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:36.894742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:36.894746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554707079702710:9457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:36.895115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554707079702710:9457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:36.897213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554707079702710:9457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:36.899862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554707079702710:9457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:36.899870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554707079702710:9457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:36.899872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554707079702710:9457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:36.899876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:36.901878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:36.904643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:36.904746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:36.904753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:36.904759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:36.904787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:36.904821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554707004165888:7886]
2025-10-02T09:31:36.905180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:36.905352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:36.905376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:36.905554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:36.905582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.905586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.905587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.905587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.905588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.905588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.905589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.905589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.905590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.905590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.905591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.905591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.905594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.905600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.905602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.905604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.905606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.905608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.905610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.905612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.905614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.905616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.905618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.905620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.905625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.905628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:36.905631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.905634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:36.905636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.905639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:36.905641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.905644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:36.905646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.905648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:36.905650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.905653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:36.905655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.905661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:36.905663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.905665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:36.905667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.905671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:36.905673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.905675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.905678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.905681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.905683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.905685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.905702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:36.913216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:36.914506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:36.914517Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:36.914518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:36.914520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:36.914523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1189 [2:7556554707004165888:7886]
2025-10-02T09:31:36.914529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:36.914539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:36.914544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.914546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.914547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.914557Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:36.914561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:36.914565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:36.914594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.914598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.914599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.914601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:36.914603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:36.914639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:36.914644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.914650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:36.914655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:36.914663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:36.914678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702899:9457], now have 1 active actors on pipe
2025-10-02T09:31:36.914683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702670:2446], now have 1 active actors on pipe
2025-10-02T09:31:36.914687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.914688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.914690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.914697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:36.914707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:36.914709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:36.914711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:36.914712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:36.914715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:36.914716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:36.914730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.914734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:36.914735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:36.914746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1189
2025-10-02T09:31:36.914769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.914774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.914767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1189
2025-10-02T09:31:36.914788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:36.914795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:36.914797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:36.914798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:36.914803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:36.914809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:36.914816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.914925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:36.914930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:36.914939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:36.915005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1190 partition: 0 MaxSeqNo: 36 sessionId: src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0
2025-10-02T09:31:36.915222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a889d0-ab802d39-276b4303-f1c0148_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:36.917640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Write session: try to update token
2025-10-02T09:31:36.917652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:36.925169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:36.925185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:36.925187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:36.925189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:36.925196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.925199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.925204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554707004165883:7886]
2025-10-02T09:31:36.925230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:36.925236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:36.925238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:36.925241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:36.925246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:36.925248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:36.925344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:36.928789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId: src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:36.930780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:36.987695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554707079702947:8968]
2025-10-02T09:31:36.988064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1189, pipe: [1:7556554707079702947:8968]
2025-10-02T09:31:37.038825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.039023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.039031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.039055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554707079702947:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.039223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:37.039229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.039238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:37.039275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554707079702947:8968]
2025-10-02T09:31:37.039287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1190 reason: error at write: Disconnected sessionId: src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0
2025-10-02T09:31:37.039426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1190 sessionId: src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0 is DEAD
2025-10-02T09:31:37.039540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:37.039549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Write session will restart in 0.008147s
2025-10-02T09:31:37.039563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Write session: Do CDS request
2025-10-02T09:31:37.039579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.039749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.049098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.049222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.049233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1191
2025-10-02T09:31:37.049317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.049342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.049350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.049353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.049735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1191 sessionId:  describe result for acl check
2025-10-02T09:31:37.049761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.049765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.049766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.049769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374670391:9461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.050111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374670391:9461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.052026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374670391:9461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.055865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.055981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374670391:9461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.055988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374670391:9461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.055991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374670391:9461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.055995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.056122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.056211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.056217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.056222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.056251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.056281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299133455:7889]
2025-10-02T09:31:37.056616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.056821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.056844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.057019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.057048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.057052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.057053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.057053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.057054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.057055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.057055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.057056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.057056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.057057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.057057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.057058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.057060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.057066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.057068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.057070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.057072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.057074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.057076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.057078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.057080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.057082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.057084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.057086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.057089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.057093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.057097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.057100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.057102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.057105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.057107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.057110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.057112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.057114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.057117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.057119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.057121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.057124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.057126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.057129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.057131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.057134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.057136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.057139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.057141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.057144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.057146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.057149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.057165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.064502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.065892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.065902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.065903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.065905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.065908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1190 [2:7556554711299133455:7889]
2025-10-02T09:31:37.065919Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.065932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.065939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.065941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.065943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.065953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.065958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.065962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.065993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.065998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.065999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.066001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.066002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.066039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.066052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.066059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.066064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.066074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.066089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670245:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.066094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670511:9461], now have 1 active actors on pipe
2025-10-02T09:31:37.066098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.066099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.066100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.066109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.066120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.066122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.066125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.066127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.066128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.066129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.066122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1190
2025-10-02T09:31:37.066132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1190
2025-10-02T09:31:37.066143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.066147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.066149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.066163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.066168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.066185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.066191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.066193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.066194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.066199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.066205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.066222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.066326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.066331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.066338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.066400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1191 partition: 0 MaxSeqNo: 36 sessionId: src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0
2025-10-02T09:31:37.066586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbb6d0-7ecf2384-e162b799-34428cbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.068751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Write session: try to update token
2025-10-02T09:31:37.068761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.075567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.075584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.075585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.075587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.075594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.075600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.075603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299133449:7889]
2025-10-02T09:31:37.075629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.075631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.075635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.075637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.075637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.075640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.075761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.079104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId: src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.081160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:37.139247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554711374670523:8968]
2025-10-02T09:31:37.139427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1190, pipe: [1:7556554711374670523:8968]
2025-10-02T09:31:37.187385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.188019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.188029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.188054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670523:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.188223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:37.188233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:37.188299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1191 reason: error at write: Disconnected sessionId: src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0
2025-10-02T09:31:37.188346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.188419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554711374670523:8968]
2025-10-02T09:31:37.188426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1191 sessionId: src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0 is DEAD
2025-10-02T09:31:37.188449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.188587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:37.188595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Write session will restart in 0.009656s
2025-10-02T09:31:37.188609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Write session: Do CDS request
2025-10-02T09:31:37.188613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.199132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.199188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.199196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1192
2025-10-02T09:31:37.199282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.199301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.199307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.199310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.199623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1192 sessionId:  describe result for acl check
2025-10-02T09:31:37.199647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.199652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.199653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.199656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374670753:9466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.199995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374670753:9466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.201145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.201621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374670753:9466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.203757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.203856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.203864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.203870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.203897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.203907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374670753:9466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.203915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374670753:9466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.203919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299133725:7891]
2025-10-02T09:31:37.203917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374670753:9466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.203921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.204261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.204421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.204443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.204621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.204650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.204654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.204654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.204655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.204655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.204656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.204656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.204657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.204657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.204658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.204658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.204658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.204661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.204667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.204669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.204671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.204673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.204675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.204677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.204679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.204681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.204684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.204686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.204688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.204691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.204695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.204698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.204701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.204703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.204706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.204708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.204711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.204713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.204715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.204717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.204720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.204722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.204725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.204727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.204729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.204733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.204736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.204738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.204740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.204742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.204746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.204748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.204750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.204768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.212297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.213656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.213666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.213667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.213669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.213672Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1191 [2:7556554711299133725:7891]
2025-10-02T09:31:37.213679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.213689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.213694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.213696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.213697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.213706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.213708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.213713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.213743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.213748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.213749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.213751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.213752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.213787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.213804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.213809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.213815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.213825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.213838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670794:9466], now have 1 active actors on pipe
2025-10-02T09:31:37.213844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670525:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.213847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.213849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.213850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.213859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.213860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1191
2025-10-02T09:31:37.213864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1191
2025-10-02T09:31:37.213870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.213874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.213876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.213877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.213881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.213882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.213895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.213899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.213910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.213915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.213916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.213937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.213945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.213947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.213948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.213953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.213958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.213966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.214066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.214071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.214079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.214136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1192 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0
2025-10-02T09:31:37.214324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bffd4df8-8e7476e8-56db7a1d-255d6f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.216658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Write session: try to update token
2025-10-02T09:31:37.216668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.224234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.224249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.224250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.224251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.224255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.224257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.224259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299133720:7891]
2025-10-02T09:31:37.224280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.224283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.224284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.224285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.224289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.224291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.224397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.228247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId: src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.230181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:37.288745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554711374670805:8968]
2025-10-02T09:31:37.288944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1191, pipe: [1:7556554711374670805:8968]
2025-10-02T09:31:37.334023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.334207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.334215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.334241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670805:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.334377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:37.334383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.334391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:37.334428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554711374670805:8968]
2025-10-02T09:31:37.334443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1192 reason: error at write: Disconnected sessionId: src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0
2025-10-02T09:31:37.334525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.334600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1192 sessionId: src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0 is DEAD
2025-10-02T09:31:37.334727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:37.334737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Write session will restart in 0.006031s
2025-10-02T09:31:37.334753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Write session: Do CDS request
2025-10-02T09:31:37.334757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.342127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.342216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.342228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1193
2025-10-02T09:31:37.342333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.342361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.342371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.342374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.342744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1193 sessionId:  describe result for acl check
2025-10-02T09:31:37.342775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.342780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.342782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.342786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374670906:9470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.343274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374670906:9470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.345442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374670906:9470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.349612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.349729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374670906:9470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.349741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374670906:9470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.349744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374670906:9470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.349748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.349886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.349976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.349983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.349988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.350012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.350033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299133997:7894]
2025-10-02T09:31:37.350382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.350539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.350562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.350735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.350763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.350767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.350768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.350768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.350769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.350769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.350770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.350770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.350771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.350771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.350772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.350772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.350775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.350781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.350783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.350785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.350787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.350789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.350791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.350793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.350794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.350797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.350799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.350800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.350804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.350808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.350811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.350814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.350816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.350818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.350821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.350824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.350826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.350828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.350830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.350834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.350836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.350839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.350841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.350843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.350845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.350847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.350849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.350852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.350854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.350856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.350858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.350861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.350888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.358343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.359698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.359711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.359712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.359714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.359717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1192 [2:7556554711299133997:7894]
2025-10-02T09:31:37.359724Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.359734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.359737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.359739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.359740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.359749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.359755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.359760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.359787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.359791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.359793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.359795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.359796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.359836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.359841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.359847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.359852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.359862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.359876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374670806:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.359881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671076:9470], now have 1 active actors on pipe
2025-10-02T09:31:37.359885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.359887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.359889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.359898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.359912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.359914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.359916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.359918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.359929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.359917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1192
2025-10-02T09:31:37.359921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1192
2025-10-02T09:31:37.359934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.359947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.359951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.359953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.359961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.359967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.359994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.360001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.360004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.360005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.360010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.360017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.360028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.360140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.360147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.360157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.360252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1193 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0
2025-10-02T09:31:37.360485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b0290-cb27b4f7-ff79da10-a51e74bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.362676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Write session: try to update token
2025-10-02T09:31:37.362687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.369696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.369709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.369710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.369711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.369716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.369719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.369721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299133991:7894]
2025-10-02T09:31:37.369742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.369745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.369746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.369749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.369753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.369757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.369869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.373054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId: src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.375237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:37.434675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554711374671087:8968]
2025-10-02T09:31:37.434854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1192, pipe: [1:7556554711374671087:8968]
2025-10-02T09:31:37.481566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.482166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.482177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.482202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671087:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.482371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.482412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.482421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554711374671087:8968]
2025-10-02T09:31:37.482439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:37.482498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1193 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0
2025-10-02T09:31:37.482628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1193 sessionId: src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0 is DEAD
2025-10-02T09:31:37.482744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:37.482753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Write session will restart in 0.008979s
2025-10-02T09:31:37.482767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Write session: Do CDS request
2025-10-02T09:31:37.482771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.493079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.493199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.493210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1194
2025-10-02T09:31:37.493300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.493324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.493332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.493335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.493617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1194 sessionId:  describe result for acl check
2025-10-02T09:31:37.493639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.493643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.493644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.493647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374671294:9474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.494001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374671294:9474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.495497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374671294:9474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.497890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.498033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374671294:9474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.498043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374671294:9474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.498046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374671294:9474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.498051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.498133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.498226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.498232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.498238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.498262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.498285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299134269:7896]
2025-10-02T09:31:37.498618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.498770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.498791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.498973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.499003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.499006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.499007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.499008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.499008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.499009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.499009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.499009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.499010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.499010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.499011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.499011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.499014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.499020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.499022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.499025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.499027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.499029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.499031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.499032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.499035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.499037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.499039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.499041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.499044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.499048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.499051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.499054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.499056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.499059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.499061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.499063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.499066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.499068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.499070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.499073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.499075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.499077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.499079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.499082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.499086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.499091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.499094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.499099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.499102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.499106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.499109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.499113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.499133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.506379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.507757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.507769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.507770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.507772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.507775Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1193 [2:7556554711299134269:7896]
2025-10-02T09:31:37.507783Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.507795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.507798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.507800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.507801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.507813Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.507821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.507825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.507854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.507859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.507860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.507862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.507864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.507900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.507905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.507911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.507916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.507924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.507938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671088:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.507943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671358:9474], now have 1 active actors on pipe
2025-10-02T09:31:37.507946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.507948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.507949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.507956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.507966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.507968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.507970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.507971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.507962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1193
2025-10-02T09:31:37.507974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.507976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.507968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1193
2025-10-02T09:31:37.507988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.507993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.507994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.508005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.508010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.508035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.508041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.508044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.508045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.508050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.508056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.508064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.508150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.508155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.508162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.508216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1194 partition: 0 MaxSeqNo: 36 sessionId: src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0
2025-10-02T09:31:37.508421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca4a846-5fb08c0a-aec4a208-8c3748c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.510578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Write session: try to update token
2025-10-02T09:31:37.510588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.517326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.517341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.517343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.517344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.517349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.517351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.517354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299134263:7896]
2025-10-02T09:31:37.517376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.517378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.517380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.517380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.517384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.517387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.517508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.521873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId: src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.523893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:37.582643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554711374671392:8968]
2025-10-02T09:31:37.582811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1193, pipe: [1:7556554711374671392:8968]
2025-10-02T09:31:37.629449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.629660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.629669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.629695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671392:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.629839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.629898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.629907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554711374671392:8968]
2025-10-02T09:31:37.629924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:37.629978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1194 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0
2025-10-02T09:31:37.630121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1194 sessionId: src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0 is DEAD
2025-10-02T09:31:37.630252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:37.630260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Write session will restart in 0.005170s
2025-10-02T09:31:37.630274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Write session: Do CDS request
2025-10-02T09:31:37.630277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.636097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.636226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.636237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1195
2025-10-02T09:31:37.636334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.636359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.636366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.636369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.636673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1195 sessionId:  describe result for acl check
2025-10-02T09:31:37.636704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.636710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.636711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.636715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374671431:9485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.637150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374671431:9485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.639885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374671431:9485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.642531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374671431:9485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.642538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374671431:9485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.642540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374671431:9485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.642544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.646392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.646663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.646756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.646762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.646768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.646793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.646817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299134579:7910]
2025-10-02T09:31:37.647170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.647331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.647354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.647570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.647604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.647608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.647609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.647610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.647610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.647611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.647611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.647612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.647612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.647613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.647613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.647614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.647617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.647623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.647625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.647627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.647629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.647631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.647633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.647635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.647637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.647639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.647641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.647643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.647647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.647652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.647655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.647658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.647660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.647663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.647665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.647667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.647669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.647672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.647674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.647677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.647679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.647682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.647684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.647687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.647689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.647691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.647694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.647696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.647698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.647701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.647703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.647706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.647723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.655158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.656685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.656695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.656696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.656698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.656701Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1194 [2:7556554711299134579:7910]
2025-10-02T09:31:37.656710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.656720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.656721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.656723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.656724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.656733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.656740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.656744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.656773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.656778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.656779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.656780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.656782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.656827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.656832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.656838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.656843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.656851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.656866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671661:9485], now have 1 active actors on pipe
2025-10-02T09:31:37.656871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671393:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.656875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.656876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.656877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.656886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.656896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.656897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.656899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.656900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.656906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.656907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.656920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.656911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1194
2025-10-02T09:31:37.656924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.656927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.656998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1194
2025-10-02T09:31:37.657024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.657030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.657044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.657053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.657061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.657062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.657069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.657079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.657093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.657235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.657240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.657247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.657301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1195 partition: 0 MaxSeqNo: 36 sessionId: src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0
2025-10-02T09:31:37.657553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b700eb4-41bf9e28-66a67848-90a3781c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.659977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Write session: try to update token
2025-10-02T09:31:37.659989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.667045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:37.667060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.667064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.667093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:37.667093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:37.667238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:37.667360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:37.667470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:37.667581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:37.667745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:37.667771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:37.671776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId: src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.673975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:37.674100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.674108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.674124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:37.674187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:37.675629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.675641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.675643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.675644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.675649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.675651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.675655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299134574:7910]
2025-10-02T09:31:37.675674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.675676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.675679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.675680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.675681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.675682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.675788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.730070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554711374671676:8968]
2025-10-02T09:31:37.730230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1194, pipe: [1:7556554711374671676:8968]
2025-10-02T09:31:37.786944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.792603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.792623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.792737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.792784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.792848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.792897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.792934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.792941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.792993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.793041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.793089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.793142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.793177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.793182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.793230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.793278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.793326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.793373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.793408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.793412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.793459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.793509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.793555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.793605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.793639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.793644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.793693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.793741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.793793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.793844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.793886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.793895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.793949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.793992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.794068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.794116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.794149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.794154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.794200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.794247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.794293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.794339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.794372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.794378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.794425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.794472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.794531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.794587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.794617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.794622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.794669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.794711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.794758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.794804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.794836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.794841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.794893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:37.794937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:37.794985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:37.795034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:37.795067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:37.795073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:37.795103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671676:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.795288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554711374671676:8968]
2025-10-02T09:31:37.795306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:37.795308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:37.795311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.795325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1195 reason: error at write: Disconnected sessionId: src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0
2025-10-02T09:31:37.795460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1195 sessionId: src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0 is DEAD
2025-10-02T09:31:37.795591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:37.795600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Write session will restart in 0.006257s
2025-10-02T09:31:37.795614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Write session: Do CDS request
2025-10-02T09:31:37.795618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.795771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.803114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.803156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.803162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1196
2025-10-02T09:31:37.803274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.803294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.803299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.803301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.803559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1196 sessionId:  describe result for acl check
2025-10-02T09:31:37.803582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.803586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.803587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.803590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374671778:9491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.803909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374671778:9491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.805748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374671778:9491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.807715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374671778:9491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.807723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374671778:9491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.807725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374671778:9491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.807728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.808914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.811390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.811494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.811500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.811505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.811533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.811555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299134866:7913]
2025-10-02T09:31:37.811886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.812045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.812067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.812237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.812263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.812267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.812267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.812268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.812268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.812269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.812269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.812270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.812270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.812271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.812271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.812271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.812274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.812280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.812282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.812284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.812286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.812288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.812290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.812292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.812294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.812296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.812298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.812300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.812304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.812308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.812311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.812314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.812316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.812319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.812321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.812324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.812326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.812328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.812330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.812333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.812335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.812339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.812341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.812344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.812350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.812352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.812354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.812357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.812362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.812365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.812367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.812369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.812385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.819695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.821144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.821155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.821156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.821158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.821161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1195 [2:7556554711299134866:7913]
2025-10-02T09:31:37.821167Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.821177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.821178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.821180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.821181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.821189Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.821193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.821197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.821224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.821229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.821230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.821232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.821233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.821268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.821273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.821279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.821284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.821295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.821308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671965:9491], now have 1 active actors on pipe
2025-10-02T09:31:37.821315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671692:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.821319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.821321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.821322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.821331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.821342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.821345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.821350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.821351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.821357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.821358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.821346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1195
2025-10-02T09:31:37.821351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1195
2025-10-02T09:31:37.821371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.821376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.821377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.821384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.821387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.821412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bb2e455-da89224a-1b8f5304-7673e442_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.821419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.821421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.821422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.821427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.821433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.821442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.821537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.821542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.821549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.821590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1196 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bb2e455-da89224a-1b8f5304-7673e442_0
2025-10-02T09:31:37.821759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd0b278-33c50960-159b7c5c-35f045f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bb2e455-da89224a-1b8f5304-7673e442_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.823934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Write session: try to update token
2025-10-02T09:31:37.823944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.830615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.830630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.830631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.830632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.830637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.830640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.830643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299134861:7913]
2025-10-02T09:31:37.830663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.830666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.830666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.830667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.830669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.830672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.830827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.834214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId: src_id|9bb2e455-da89224a-1b8f5304-7673e442_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.836129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:37.895443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554711374671983:8968]
2025-10-02T09:31:37.895575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1195, pipe: [1:7556554711374671983:8968]
2025-10-02T09:31:37.939522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:37.940053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.940063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.940086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671983:8968], now have 1 active actors on pipe
2025-10-02T09:31:37.940202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:37.940233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:37.940256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554711374671983:8968]
2025-10-02T09:31:37.940261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:37.940308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bb2e455-da89224a-1b8f5304-7673e442_0
2025-10-02T09:31:37.940438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1196 sessionId: src_id|9bb2e455-da89224a-1b8f5304-7673e442_0 is DEAD
2025-10-02T09:31:37.940563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:37.940572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Write session will restart in 0.006227s
2025-10-02T09:31:37.940589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Write session: Do CDS request
2025-10-02T09:31:37.940593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:37.948086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.948194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:37.948204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1197
2025-10-02T09:31:37.948298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:37.948318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:37.948324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:37.948326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:37.948666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1197 sessionId:  describe result for acl check
2025-10-02T09:31:37.948689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:37.948694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:37.948695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:37.948697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554711374672072:9495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:37.949052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554711374672072:9495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:37.951261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554711374672072:9495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:37.953150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554711374672072:9495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:37.953158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554711374672072:9495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:37.953160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554711374672072:9495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:37.953164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:37.956228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:37.956467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:37.956555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:37.956562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:37.956567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:37.956592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:37.956614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554711299135144:7916]
2025-10-02T09:31:37.956967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:37.957123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:37.957145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:37.957316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:37.957344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.957348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.957349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.957349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.957350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.957350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.957351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.957351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.957352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.957352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.957353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.957353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.957356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.957362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.957364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.957367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.957369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.957371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.957373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.957375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.957377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.957379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.957381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.957383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.957386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.957390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:37.957394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.957396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:37.957399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.957401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:37.957403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.957406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:37.957411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.957413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:37.957417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.957420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:37.957422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.957424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:37.957429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.957432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:37.957434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.957436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:37.957438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.957441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.957443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.957445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.957447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.957450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.957466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:37.964748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:37.966115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:37.966127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:37.966129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:37.966131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:37.966134Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1196 [2:7556554711299135144:7916]
2025-10-02T09:31:37.966141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:37.966151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:37.966152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.966154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.966155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.966164Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:37.966167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:37.966171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:37.966203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.966208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.966209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.966210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:37.966212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:37.966246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:37.966251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.966257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:37.966263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:37.966274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:37.966288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374672255:9495], now have 1 active actors on pipe
2025-10-02T09:31:37.966293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554711374671984:2446], now have 1 active actors on pipe
2025-10-02T09:31:37.966297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.966298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.966300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.966307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:37.966318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:37.966320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:37.966322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:37.966323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:37.966328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:37.966330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:37.966329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1196
2025-10-02T09:31:37.966344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.966337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1196
2025-10-02T09:31:37.966349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:37.966350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:37.966366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.966371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.966388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec87f522-dc565684-249c96c5-3d766136_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:37.966394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:37.966396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:37.966397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:37.966401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:37.966407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:37.966421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.966511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:37.966515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:37.966523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:37.966587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1197 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec87f522-dc565684-249c96c5-3d766136_0
2025-10-02T09:31:37.966835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb2e455-da89224a-1b8f5304-7673e442_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec87f522-dc565684-249c96c5-3d766136_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:37.969030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Write session: try to update token
2025-10-02T09:31:37.969040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:37.975528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:37.975542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:37.975543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:37.975544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:37.975549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.975552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.975554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554711299135139:7916]
2025-10-02T09:31:37.975576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:37.975577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:37.975579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:37.975580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:37.975581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:37.975582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:37.975694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:37.979738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId: src_id|ec87f522-dc565684-249c96c5-3d766136_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:37.981760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.040358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554715669639565:8968]
2025-10-02T09:31:38.040520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1196, pipe: [1:7556554715669639565:8968]
2025-10-02T09:31:38.083884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.084513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.084522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.084546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669639565:8968], now have 1 active actors on pipe
2025-10-02T09:31:38.084662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.084693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:38.084701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669639565:8968]
2025-10-02T09:31:38.084702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:38.084714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.084743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1197 reason: error at write: Disconnected sessionId: src_id|ec87f522-dc565684-249c96c5-3d766136_0
2025-10-02T09:31:38.084929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1197 sessionId: src_id|ec87f522-dc565684-249c96c5-3d766136_0 is DEAD
2025-10-02T09:31:38.085039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:38.085048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Write session will restart in 0.008260s
2025-10-02T09:31:38.085061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Write session: Do CDS request
2025-10-02T09:31:38.085065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.094104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.094228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.094239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1198
2025-10-02T09:31:38.094326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.094349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.094355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.094358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.094662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1198 sessionId:  describe result for acl check
2025-10-02T09:31:38.094685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.094690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.094691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.094694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669639729:9499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.095071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669639729:9499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.096687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669639729:9499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.099865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:38.100005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669639729:9499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:38.100013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669639729:9499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:38.100014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669639729:9499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:38.100018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:38.100091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:38.100178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:38.100184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:38.100189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:38.100215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:38.100238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554715594102717:7918]
2025-10-02T09:31:38.100572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:38.100732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:38.100754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:38.100936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:38.100964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.100968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.100969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.100969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.100970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.100970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.100971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.100971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.100972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.100972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.100973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.100973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.100976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.100982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.100984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.100986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.100988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.100990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.100992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.100994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.100996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.100998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.101000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.101002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.101005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.101009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.101013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.101016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.101018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.101021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.101023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.101026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.101028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.101030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.101032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.101035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.101037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.101039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.101041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.101044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.101046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.101049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.101051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.101054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.101056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.101058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.101060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.101079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:38.108434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:38.109832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:38.109842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:38.109844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:38.109845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:38.109848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1197 [2:7556554715594102717:7918]
2025-10-02T09:31:38.109856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:38.109865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:38.109867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.109868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.109869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.109878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:38.109885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:38.109889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:38.109914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.109919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.109920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.109922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:38.109923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:38.109959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:38.109964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.109970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.109975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.109983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:38.109998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669639566:2446], now have 1 active actors on pipe
2025-10-02T09:31:38.110003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669639840:9499], now have 1 active actors on pipe
2025-10-02T09:31:38.110007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.110008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.110009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.110017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:38.110025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:38.110028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:38.110031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:38.110032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:38.110036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:38.110037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:38.110038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1197
2025-10-02T09:31:38.110051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.110043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1197
2025-10-02T09:31:38.110056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:38.110057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:38.110066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.110071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.110100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:38.110106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.110108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.110109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.110114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.110120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:38.110129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.110220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.110224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.110231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.110285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1198 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0
2025-10-02T09:31:38.110491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec87f522-dc565684-249c96c5-3d766136_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:38.112660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Write session: try to update token
2025-10-02T09:31:38.112671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:38.119187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:38.119200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.119202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:38.119203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:38.119207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.119210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.119212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594102711:7918]
2025-10-02T09:31:38.119234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:38.119236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:38.119237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.119238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:38.119239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:38.119241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:38.119350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:38.122920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId: src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:38.124921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.184742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554715669639852:8968]
2025-10-02T09:31:38.184924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1197, pipe: [1:7556554715669639852:8968]
2025-10-02T09:31:38.228402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.228973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.228982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.229004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669639852:8968], now have 1 active actors on pipe
2025-10-02T09:31:38.229124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.229153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.229162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669639852:8968]
2025-10-02T09:31:38.229180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:38.229228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0
2025-10-02T09:31:38.229363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1198 sessionId: src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0 is DEAD
2025-10-02T09:31:38.229490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:38.229499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Write session will restart in 0.006388s
2025-10-02T09:31:38.229514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Write session: Do CDS request
2025-10-02T09:31:38.229518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.237100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.237194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.237202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1199
2025-10-02T09:31:38.237290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.237312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.237318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.237320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.237593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1199 sessionId:  describe result for acl check
2025-10-02T09:31:38.237616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.237621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.237622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.237626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669639972:9504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.237985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669639972:9504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.239843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669639972:9504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.244110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:38.244225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669639972:9504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:38.244235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669639972:9504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:38.244238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669639972:9504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:38.244242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:38.244376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:38.244470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:38.244476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:38.244482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:38.244507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:38.244530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554715594102997:7921]
2025-10-02T09:31:38.244877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:38.245029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:38.245051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:38.245224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:38.245251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.245254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.245255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.245255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.245256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.245256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.245257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.245257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.245258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.245258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.245259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.245259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.245262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.245268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.245270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.245272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.245274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.245276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.245278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.245280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.245282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.245284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.245286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.245288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.245291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.245295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.245298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.245300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.245303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.245305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.245308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.245311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.245313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.245315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.245317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.245320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.245322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.245325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.245327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.245329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.245332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.245334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.245336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.245339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.245341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.245344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.245346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.245348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.245365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:38.252627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:38.254026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:38.254037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:38.254038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:38.254040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:38.254043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1198 [2:7556554715594102997:7921]
2025-10-02T09:31:38.254050Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:38.254059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:38.254060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.254061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.254062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.254071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:38.254075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:38.254080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:38.254107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.254112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.254112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.254114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:38.254116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:38.254150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:38.254154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.254160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.254165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.254177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:38.254189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640130:9504], now have 1 active actors on pipe
2025-10-02T09:31:38.254194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669639855:2446], now have 1 active actors on pipe
2025-10-02T09:31:38.254198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.254199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.254200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.254208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:38.254218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:38.254223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:38.254226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:38.254228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:38.254231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:38.254233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:38.254241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.254242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:38.254234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1198
2025-10-02T09:31:38.254248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:38.254251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1198
2025-10-02T09:31:38.254271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.254277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.254291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:38.254297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.254299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.254301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.254306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.254313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:38.254321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.254418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.254423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.254430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.254486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1199 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0
2025-10-02T09:31:38.254693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8672b5a-2f82c88d-c468f488-c6cbb0bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:38.256861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Write session: try to update token
2025-10-02T09:31:38.256871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:38.263258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:38.263271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.263272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:38.263273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:38.263277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.263279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.263281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594102991:7921]
2025-10-02T09:31:38.263301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:38.263304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.263305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:38.263305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:38.263308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:38.263310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:38.263409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:38.267163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId: src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:38.269157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.329143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554715669640141:8968]
2025-10-02T09:31:38.329337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1198, pipe: [1:7556554715669640141:8968]
2025-10-02T09:31:38.371317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.371855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.371864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.371888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640141:8968], now have 1 active actors on pipe
2025-10-02T09:31:38.372290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:38.372299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:38.372312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669640141:8968]
2025-10-02T09:31:38.372337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1199 reason: error at write: Disconnected sessionId: src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0
2025-10-02T09:31:38.372337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.372480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1199 sessionId: src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0 is DEAD
2025-10-02T09:31:38.372584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.372602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:38.372612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Write session will restart in 0.008911s
2025-10-02T09:31:38.372634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Write session: Do CDS request
2025-10-02T09:31:38.372640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.382045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.382138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.382151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1200
2025-10-02T09:31:38.382240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.382261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.382267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.382270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.382583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1200 sessionId:  describe result for acl check
2025-10-02T09:31:38.382609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.382613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.382614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.382617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669640308:9508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.382971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669640308:9508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.384447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669640308:9508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.387698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:38.387867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669640308:9508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:38.387876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669640308:9508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:38.387878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669640308:9508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:38.387882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:38.387928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:38.388014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:38.388020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:38.388026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:38.388050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:38.388072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554715594103276:7923]
2025-10-02T09:31:38.388407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:38.388559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:38.388582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:38.388753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:38.388780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.388784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.388784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.388785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.388785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.388786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.388786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.388787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.388787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.388787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.388788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.388788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.388791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.388797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.388799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.388815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.388817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.388819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.388821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.388822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.388824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.388826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.388828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.388830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.388834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.388837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.388840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.388843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.388845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.388848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.388850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.388853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.388855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.388858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.388859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.388862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.388864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.388867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.388869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.388871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.388874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.388876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.388878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.388881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.388883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.388885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.388887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.388890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.388904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:38.396138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:38.397498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:38.397507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:38.397508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:38.397510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:38.397513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1199 [2:7556554715594103276:7923]
2025-10-02T09:31:38.397519Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:38.397528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:38.397529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.397531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.397532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.397540Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:38.397543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:38.397547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:38.397580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.397585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.397586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.397588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:38.397589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:38.397622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:38.397627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.397633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.397638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.397646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:38.397660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640143:2446], now have 1 active actors on pipe
2025-10-02T09:31:38.397666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640419:9508], now have 1 active actors on pipe
2025-10-02T09:31:38.397669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.397671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.397672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.397679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:38.397689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:38.397691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:38.397693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:38.397694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:38.397696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:38.397698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:38.397711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.397701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1199
2025-10-02T09:31:38.397714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:38.397705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1199
2025-10-02T09:31:38.397715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:38.397729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.397734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.397752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:38.397759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.397761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.397762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.397766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.397771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:38.397786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.397878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.397883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.397890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.397950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1200 partition: 0 MaxSeqNo: 36 sessionId: src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0
2025-10-02T09:31:38.398150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fbb7ae-bb3c983d-606a7b36-770750cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:38.400288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Write session: try to update token
2025-10-02T09:31:38.400297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:38.406730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:38.406743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.406744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:38.406745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:38.406750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.406754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.406756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594103270:7923]
2025-10-02T09:31:38.406777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:38.406777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:38.406780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:38.406780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.406781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:38.406782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:38.406907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:38.410518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId: src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:38.412451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.472497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554715669640430:8968]
2025-10-02T09:31:38.472691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1199, pipe: [1:7556554715669640430:8968]
2025-10-02T09:31:38.480086Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:31:38.517685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.517888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.517903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.517940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640430:8968], now have 1 active actors on pipe
2025-10-02T09:31:38.518168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:38.518173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669640430:8968]
2025-10-02T09:31:38.518180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:38.518213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.518239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1200 reason: error at write: Disconnected sessionId: src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0
2025-10-02T09:31:38.518381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1200 sessionId: src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0 is DEAD
2025-10-02T09:31:38.518457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.518500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:38.518510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Write session will restart in 0.008892s
2025-10-02T09:31:38.518525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Write session: Do CDS request
2025-10-02T09:31:38.518528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.528078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.528182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.528190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1201
2025-10-02T09:31:38.528269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.528288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.528295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.528297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.528597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1201 sessionId:  describe result for acl check
2025-10-02T09:31:38.528617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.528621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.528621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.528624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669640610:9512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.529029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669640610:9512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.530703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669640610:9512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.533260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:38.533432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669640610:9512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:38.533441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669640610:9512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:38.533443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669640610:9512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:38.533447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:38.533499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:38.533585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:38.533592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:38.533597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:38.533623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:38.533644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554715594103554:7925]
2025-10-02T09:31:38.533979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:38.534125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:38.534146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:38.534313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:38.534339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.534343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.534343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.534344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.534344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.534345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.534345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.534346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.534346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.534347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.534347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.534348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.534350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.534357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.534359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.534361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.534363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.534365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.534367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.534369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.534371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.534373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.534375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.534377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.534381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.534384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.534387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.534390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.534392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.534395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.534397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.534400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.534402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.534404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.534407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.534409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.534411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.534414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.534416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.534419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.534421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.534424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.534426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.534428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.534434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.534437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.534439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.534442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.534458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:38.541744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:38.543104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:38.543113Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:38.543114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:38.543116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:38.543120Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1200 [2:7556554715594103554:7925]
2025-10-02T09:31:38.543127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:38.543136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:38.543138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.543139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.543140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.543149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:38.543151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:38.543156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:38.543185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.543190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.543191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.543193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:38.543194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:38.543228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:38.543232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.543238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.543243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.543251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:38.543265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640432:2446], now have 1 active actors on pipe
2025-10-02T09:31:38.543270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640709:9512], now have 1 active actors on pipe
2025-10-02T09:31:38.543274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.543275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.543276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.543284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:38.543294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:38.543299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:38.543301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:38.543303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:38.543307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:38.543293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1200
2025-10-02T09:31:38.543314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1200
2025-10-02T09:31:38.543309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:38.543315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.543317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:38.543327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:38.543335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.543337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.543351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:38.543358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.543360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.543361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.543366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.543373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:38.543380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.543454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.543459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.543466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.543529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1201 partition: 0 MaxSeqNo: 36 sessionId: src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0
2025-10-02T09:31:38.543708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91624781-7bf37042-8a1d3e23-1cf0a466_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:38.546003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Write session: try to update token
2025-10-02T09:31:38.546014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:38.556455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId: src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:38.557083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:38.557097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.557102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.557128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:38.557165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:38.557269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:38.557391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:38.557509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:38.557624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:38.557921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:38.557948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:38.558423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.558565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.558573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.558590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:38.558648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:38.561150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:38.561163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.561164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:38.561165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:38.561169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.561171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.561174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594103548:7925]
2025-10-02T09:31:38.561193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:38.561200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.561201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:38.561221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:38.561239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:38.561243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:38.561305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:38.618563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554715669640742:8968]
2025-10-02T09:31:38.618745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1200, pipe: [1:7556554715669640742:8968]
2025-10-02T09:31:38.671507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.677523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.677544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.677665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.677713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.677765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.677815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.678263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.678272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.678323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.678372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.678420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.678470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.678505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.678510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.678560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.678620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.678670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.678718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.678752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.678757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.678807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.678855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.678909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.678956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.678990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.678995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.679045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.679093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.679142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.679190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.679225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.679230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.679281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.679328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.679376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.679424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.679461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.679466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.679513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.679556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.679606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.679656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.679689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.679694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.679743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.679789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.679834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.679879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.679913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.679917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.679962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.680005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.680052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.680098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.680133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.680137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.680182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.680225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.680271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.680321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.680354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.680359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.680388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640742:8968], now have 1 active actors on pipe
2025-10-02T09:31:38.680513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:38.680524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:38.680534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669640742:8968]
2025-10-02T09:31:38.680541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1201 reason: error at write: Disconnected sessionId: src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0
2025-10-02T09:31:38.680554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.680575Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:31:38.680630Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 12 consumer shared/user session shared/user_1_12_17871095051901243003_v1 is DEAD
2025-10-02T09:31:38.680669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1201 sessionId: src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0 is DEAD
2025-10-02T09:31:38.680718Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554651245106666:8963] disconnected; active server actors: 1
2025-10-02T09:31:38.680725Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554651245106666:8963] client user disconnected session shared/user_1_12_17871095051901243003_v1
2025-10-02T09:31:38.680785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:38.680794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Write session will restart in 0.009345s
2025-10-02T09:31:38.680820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Write session: Do CDS request
2025-10-02T09:31:38.680825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.680843Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:31:38.680874Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:38.680877Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:38.680885Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006990s
2025-10-02T09:31:38.681154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.688970Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:31:38.689102Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:31:38.689109Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 13
2025-10-02T09:31:38.689224Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 13 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:38.689264Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:38.689328Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 auth for : user
2025-10-02T09:31:38.689448Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 Handle describe topics response
2025-10-02T09:31:38.689476Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 auth is DEAD
2025-10-02T09:31:38.689479Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:31:38.689626Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:31:38.689690Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_13_6300436207510454890_v1
2025-10-02T09:31:38.689841Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554715669640875:9523] connected; active server actors: 1
2025-10-02T09:31:38.689850Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554715669640875:9523] session shared/user_1_13_6300436207510454890_v1
2025-10-02T09:31:38.689854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:31:38.689859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:31:38.689867Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_13_6300436207510454890_v1" (Sender=[1:7556554715669640853:9523], Pipe=[1:7556554715669640875:9523], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:38.689869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:31:38.689874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:31:38.689879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_13_6300436207510454890_v1" (Sender=[1:7556554715669640853:9523], Pipe=[1:7556554715669640875:9523], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:38.689884Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_13_6300436207510454890_v1" sender [1:7556554715669640853:9523] lock partition 0 for ReadingSession "shared/user_1_13_6300436207510454890_v1" (Sender=[1:7556554715669640853:9523], Pipe=[1:7556554715669640875:9523], Partitions=[], ActiveFamilyCount=1) generation 1 step 13
2025-10-02T09:31:38.689891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:31:38.689896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000021s
2025-10-02T09:31:38.690005Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 13 Session: "shared/user_1_13_6300436207510454890_v1" ClientId: "user" PipeClient { RawX1: 7556554715669640875 RawX2: 4503603922347315 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:31:38.690019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:31:38.691050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.691384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.691390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1202
2025-10-02T09:31:38.691462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.691478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.691483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.691485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.691751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1202 sessionId:  describe result for acl check
2025-10-02T09:31:38.691778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.691784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.691786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.691790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669640992:9527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.692111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669640992:9527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.692955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:38.693485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669640992:9527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.695568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:38.695661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:38.695667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:38.695672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:38.695671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669640992:9527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:38.695679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669640992:9527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:38.695680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669640992:9527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:38.695683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:38.695700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:38.695721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554715594103883:7940]
2025-10-02T09:31:38.696051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:38.696210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:38.696232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:38.696402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:38.696430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.696434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.696434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.696435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.696435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.696436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.696436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.696436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.696437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.696437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.696438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.696438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.696441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.696447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.696449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.696451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.696452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.696454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.696456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.696458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.696460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.696462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.696464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.696466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.696470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.696473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.696476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.696479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.696481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.696484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.696486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.696489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.696491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.696493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.696495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.696498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.696500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.696503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.696505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.696507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.696509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.696512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.696514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.696517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.696519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.696522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.696524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.696526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.696543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:38.703849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:38.705177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:38.705187Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:38.705188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:38.705190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:38.705193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1201 [2:7556554715594103883:7940]
2025-10-02T09:31:38.705200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:38.705209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:38.705210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.705212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.705213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.705221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:38.705223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:38.705227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:38.705257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.705262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.705263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.705265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:38.705266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:38.705300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:38.705304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.705310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.705315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.705323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:38.705337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640892:9526], now have 1 active actors on pipe
2025-10-02T09:31:38.705342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669640744:2446], now have 1 active actors on pipe
2025-10-02T09:31:38.705343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669641028:9527], now have 1 active actors on pipe
2025-10-02T09:31:38.705347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.705348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.705349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.705356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:38.705363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:38.705371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:38.705372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:38.705356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1201
2025-10-02T09:31:38.705373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1201, pipe: [1:7556554715669640892:9526]
2025-10-02T09:31:38.705373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:38.705375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:38.705376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1201
2025-10-02T09:31:38.705376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:38.705386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.705388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:38.705395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:38.705399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.705401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.705407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_13_6300436207510454890_v1 on pipe: [1:7556554715669640892:9526]
2025-10-02T09:31:38.705424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.705428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.705431Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_13_6300436207510454890_v1:1 with generation 1201
2025-10-02T09:31:38.705438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.705441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.705442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.705449Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_13_6300436207510454890_v1
2025-10-02T09:31:38.705452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.705467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:38.705473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:31:38.705477Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:31:38.708727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:31:38.708739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:31:38.708743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.708744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.708745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.708749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.708754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:38.708758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:31:38.708763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:31:38.708772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.708834Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397498704 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:31:38.708844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:31:38.708856Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 sending to client partition status
2025-10-02T09:31:38.708907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.708912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.708919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.708962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1202 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0
2025-10-02T09:31:38.709116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a6b80d-a14392a5-99681a69-19c3eafe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:38.711279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Write session: try to update token
2025-10-02T09:31:38.711288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:38.714312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:38.714325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.714326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:38.714328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:38.714333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.714335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.714338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594103878:7940]
2025-10-02T09:31:38.714358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:38.714359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:38.714361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.714361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:38.714362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:38.714363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:38.714465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:38.721800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId: src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:38.723698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.824701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.824899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.824908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.825055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_13_6300436207510454890_v1
2025-10-02T09:31:38.825067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.825083Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_13_6300436207510454890_v1
2025-10-02T09:31:38.825064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.825097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:38.825099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669640892:9526]
2025-10-02T09:31:38.825100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:38.825150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1202 reason: error at write: Disconnected sessionId: src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0
2025-10-02T09:31:38.825311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1202 sessionId: src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0 is DEAD
2025-10-02T09:31:38.825428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:38.825442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Write session will restart in 0.009336s
2025-10-02T09:31:38.825458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Write session: Do CDS request
2025-10-02T09:31:38.825462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.836106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.836173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.836181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1203
2025-10-02T09:31:38.836265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.836284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.836290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.836293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.836594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1203 sessionId:  describe result for acl check
2025-10-02T09:31:38.836625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.836630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.836632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.836636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669641277:9533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.837099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669641277:9533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.838195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:38.838378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669641277:9533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.840709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:38.840797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:38.840815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:38.840824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:38.840855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:38.840879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554715594104167:7942]
2025-10-02T09:31:38.840923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669641277:9533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:38.840932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669641277:9533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:38.840934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669641277:9533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:38.840937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:38.841213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:38.841369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:38.841391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:38.841565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:38.841594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.841598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.841598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.841599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.841599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.841600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.841600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.841601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.841601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.841602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.841602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.841603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.841606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.841611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.841613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.841615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.841617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.841619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.841621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.841623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.841625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.841627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.841629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.841631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.841634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.841638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:38.841641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.841644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:38.841646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.841648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:38.841651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.841653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:38.841656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.841658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:38.841660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.841662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:38.841664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.841667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:38.841669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.841671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:38.841673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.841676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:38.841678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.841681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.841682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.841685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.841687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.841690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.841706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:38.849049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:38.850340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:38.850350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:38.850351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:38.850353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:38.850356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1202 [2:7556554715594104167:7942]
2025-10-02T09:31:38.850363Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:38.850371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:38.850373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.850374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.850375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.850384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:38.850388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:38.850394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:38.850427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.850431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.850432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.850433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:38.850435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:38.850472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:38.850477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.850482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:38.850487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:38.850495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:38.850506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669641060:2446], now have 1 active actors on pipe
2025-10-02T09:31:38.850511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669641339:9533], now have 1 active actors on pipe
2025-10-02T09:31:38.850514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.850515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.850516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.850526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:38.850534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:38.850545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:38.850546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:38.850545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1202
2025-10-02T09:31:38.850551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:38.850558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.850558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:38.850559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:38.850560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:38.850565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:38.850584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1202
2025-10-02T09:31:38.850622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.850627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.850641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b444bd96-62d4b001-2888a3c8-e107691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:38.850647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:38.850648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:38.850650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:38.850654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:38.850659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:38.850666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.850761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.850765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.850772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:38.850817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1203 partition: 0 MaxSeqNo: 36 sessionId: src_id|b444bd96-62d4b001-2888a3c8-e107691_0
2025-10-02T09:31:38.851016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27a144-6bf53f14-2a1d9389-be55bc4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b444bd96-62d4b001-2888a3c8-e107691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:38.853257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Write session: try to update token
2025-10-02T09:31:38.853266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:38.859423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:38.859436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.859440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.859462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:38.859465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:38.859593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:38.859707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:38.859815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:38.859929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:38.860079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:38.860100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:38.863176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId: src_id|b444bd96-62d4b001-2888a3c8-e107691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:38.865016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:38.865172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.865180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.865195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:38.865284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:38.867867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:38.867877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:38.867879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:38.867880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:38.867884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.867886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.867889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594104162:7942]
2025-10-02T09:31:38.867908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:38.867909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:38.867911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:38.867912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:38.867913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:38.867914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:38.868021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:38.925094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554715669641354:9526]
2025-10-02T09:31:38.925276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1202, pipe: [1:7556554715669641354:9526]
2025-10-02T09:31:38.977481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:38.983683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:38.983702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:38.983821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.983869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.983918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.983969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.984005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.984012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.984065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.984114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.984164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.984214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.984248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.984253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.984302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.984348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.984398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.984447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.984486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.984491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.984540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.984588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.984636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.984682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.984719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.984724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.984774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.984837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.984888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.984934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.984967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.984972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.985022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.985068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.985115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.985163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.985197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.985202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.985248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.985295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.985344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.985393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.985427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.985432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.985480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.985526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.985571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.985616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.985649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.985654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.985698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.985740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.985787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.985834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.985868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.985872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.985918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:38.985966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:38.986014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:38.986063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:38.986173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:38.986179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:38.986207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669641354:9526], now have 1 active actors on pipe
2025-10-02T09:31:38.986419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:38.986431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:38.986434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:38.986456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1203 reason: error at write: Disconnected sessionId: src_id|b444bd96-62d4b001-2888a3c8-e107691_0
2025-10-02T09:31:38.986462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554715669641354:9526]
2025-10-02T09:31:38.986608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1203 sessionId: src_id|b444bd96-62d4b001-2888a3c8-e107691_0 is DEAD
2025-10-02T09:31:38.986693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:38.986701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Write session will restart in 0.007642s
2025-10-02T09:31:38.986714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Write session: Do CDS request
2025-10-02T09:31:38.986717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:38.986837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:38.995110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.995141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:38.995147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1204
2025-10-02T09:31:38.995273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:38.995291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:38.995297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:38.995299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:38.995604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1204 sessionId:  describe result for acl check
2025-10-02T09:31:38.995634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:38.995640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:38.995641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:38.995645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554715669641462:9537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:38.996082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554715669641462:9537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:38.998161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554715669641462:9537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:38.999965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.002499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.002585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554715669641462:9537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.002593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554715669641462:9537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.002595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554715669641462:9537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.002598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.002594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.002601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.002606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.002633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.002654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889071748:7945]
2025-10-02T09:31:39.002997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.003164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.003188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.003362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.003389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.003393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.003393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.003394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.003394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.003395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.003395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.003396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.003396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.003397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.003397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.003398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.003401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.003407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.003409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.003411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.003413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.003415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.003417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.003419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.003420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.003422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.003424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.003426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.003429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.003433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.003436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.003439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.003441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.003443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.003445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.003448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.003450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.003452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.003454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.003457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.003459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.003461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.003463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.003466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.003468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.003471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.003474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.003477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.003480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.003482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.003484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.003487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.003503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.010819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.012136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.012146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.012147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.012149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.012153Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1203 [2:7556554719889071748:7945]
2025-10-02T09:31:39.012159Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.012169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.012174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.012175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.012177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.012185Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.012189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.012193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.012221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.012226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.012228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.012230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.012231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.012265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.012269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.012275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.012280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.012291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.012305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964608931:9537], now have 1 active actors on pipe
2025-10-02T09:31:39.012310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554715669641355:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.012313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.012314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.012315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.012322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.012332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.012338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.012340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.012341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.012342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.012342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.012330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1203
2025-10-02T09:31:39.012353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1203
2025-10-02T09:31:39.012354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.012359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.012361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.012368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.012371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.012393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.012399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.012401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.012402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.012407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.012411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.012423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.012504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.012509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.012516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.012560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1204 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0
2025-10-02T09:31:39.012730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b444bd96-62d4b001-2888a3c8-e107691_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.014923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Write session: try to update token
2025-10-02T09:31:39.014933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.021492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.021505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.021507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.021508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.021513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.021515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.021517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554715594104447:7945]
2025-10-02T09:31:39.021539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.021542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.021545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.021546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.021547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.021547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.021667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.024922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId: src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.026732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:39.086379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554719964608943:9526]
2025-10-02T09:31:39.086574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1203, pipe: [1:7556554719964608943:9526]
2025-10-02T09:31:39.131216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:39.131719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.131732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.131761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964608943:9526], now have 1 active actors on pipe
2025-10-02T09:31:39.131941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554719964608943:9526]
2025-10-02T09:31:39.131969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:39.131969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:39.131971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:39.132014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1204 reason: error at write: Disconnected sessionId: src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0
2025-10-02T09:31:39.132156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1204 sessionId: src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0 is DEAD
2025-10-02T09:31:39.132286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:39.132295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Write session will restart in 0.008095s
2025-10-02T09:31:39.132293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:39.132319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Write session: Do CDS request
2025-10-02T09:31:39.132323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:39.141149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.141238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:39.141247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1205
2025-10-02T09:31:39.141349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.141369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:39.141375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:39.141378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:39.141693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1205 sessionId:  describe result for acl check
2025-10-02T09:31:39.141724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:39.141729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:39.141731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:39.141735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554719964609083:9541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:39.142191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554719964609083:9541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:39.144133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554719964609083:9541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:39.145220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.147829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.147925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.147930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.147936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.147960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.147984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889072032:7947]
2025-10-02T09:31:39.148018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554719964609083:9541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.148026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554719964609083:9541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.148030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554719964609083:9541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.148033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.148323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.148491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.148513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.148690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.148718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.148722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.148723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.148723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.148724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.148724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.148725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.148725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.148726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.148726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.148727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.148727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.148730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.148736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.148738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.148740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.148742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.148744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.148746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.148748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.148750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.148752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.148754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.148756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.148759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.148763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.148766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.148769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.148771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.148774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.148776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.148778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.148780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.148783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.148785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.148788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.148790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.148793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.148798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.148812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.148815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.148817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.148819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.148822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.148827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.148830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.148832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.148835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.148852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.156199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.157621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.157632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.157633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.157635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.157638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1204 [2:7556554719889072032:7947]
2025-10-02T09:31:39.157646Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.157655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.157658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.157659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.157660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.157669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.157675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.157679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.157707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.157712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.157713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.157715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.157716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.157751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.157755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.157761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.157767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.157778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.157792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609225:9541], now have 1 active actors on pipe
2025-10-02T09:31:39.157797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964608944:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.157800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.157801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.157802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.157808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.157817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.157822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.157824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.157825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.157826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.157828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.157824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1204
2025-10-02T09:31:39.157829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1204
2025-10-02T09:31:39.157841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.157845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.157847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.157856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.157860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.157884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbb7ea74-47272531-ed200392-9a5da405_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.157891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.157893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.157894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.157898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.157905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.157913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.157995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.158000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.158007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.158054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1205 partition: 0 MaxSeqNo: 36 sessionId: src_id|cbb7ea74-47272531-ed200392-9a5da405_0
2025-10-02T09:31:39.158251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1ac95f-445f3ed8-f0e10449-c8356810_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cbb7ea74-47272531-ed200392-9a5da405_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.160413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Write session: try to update token
2025-10-02T09:31:39.160421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.167035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.167047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.167048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.167049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.167055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.167057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.167060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554719889072027:7947]
2025-10-02T09:31:39.167080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.167083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.167083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.167084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.167086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.167088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.167198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.171455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId: src_id|cbb7ea74-47272531-ed200392-9a5da405_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.173525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:39.232279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554719964609239:9526]
2025-10-02T09:31:39.232695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1204, pipe: [1:7556554719964609239:9526]
2025-10-02T09:31:39.279730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:39.280368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.280378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.280404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609239:9526], now have 1 active actors on pipe
2025-10-02T09:31:39.280538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:39.280595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:39.280606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:39.280625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554719964609239:9526]
2025-10-02T09:31:39.280642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:39.280649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1205 reason: error at write: Disconnected sessionId: src_id|cbb7ea74-47272531-ed200392-9a5da405_0
2025-10-02T09:31:39.280779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1205 sessionId: src_id|cbb7ea74-47272531-ed200392-9a5da405_0 is DEAD
2025-10-02T09:31:39.280937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:39.280947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Write session will restart in 0.005767s
2025-10-02T09:31:39.280966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Write session: Do CDS request
2025-10-02T09:31:39.280970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:39.288132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.288204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:39.288211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1206
2025-10-02T09:31:39.288299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.288319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:39.288325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:39.288327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:39.288598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1206 sessionId:  describe result for acl check
2025-10-02T09:31:39.288617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:39.288621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:39.288622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:39.288625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554719964609325:9546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:39.288982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554719964609325:9546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:39.291086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554719964609325:9546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:39.293025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554719964609325:9546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.293032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554719964609325:9546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.293034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554719964609325:9546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.293037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.296561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.296828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.296921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.296928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.296934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.296958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.296981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889072320:7950]
2025-10-02T09:31:39.297317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.297478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.297501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.297673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.297702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.297706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.297707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.297707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.297708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.297709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.297709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.297710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.297710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.297711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.297711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.297712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.297714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.297720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.297722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.297725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.297727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.297729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.297731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.297733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.297735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.297737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.297739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.297741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.297744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.297748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.297751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.297754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.297757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.297759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.297761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.297764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.297766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.297769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.297771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.297774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.297776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.297779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.297781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.297783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.297785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.297788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.297790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.297793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.297796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.297798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.297800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.297802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.297818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.305250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.306626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.306638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.306640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.306642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.306645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1205 [2:7556554719889072320:7950]
2025-10-02T09:31:39.306653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.306663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.306665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.306666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.306667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.306676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.306679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.306684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.306715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.306721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.306722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.306724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.306726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.306846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1205
2025-10-02T09:31:39.306852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1205
2025-10-02T09:31:39.307038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.307045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.307051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.307058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.307066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.307081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609240:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.307087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609519:9546], now have 1 active actors on pipe
2025-10-02T09:31:39.307100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.307105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.307116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.307121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.307122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.307130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.307141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.307146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.307149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.307150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.307151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.307153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.307164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e459062-64238bec-bc91cef8-732d3b47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.307171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.307174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.307175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.307180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.307186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.307204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.307211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.307217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.307218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.307336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.307347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.307363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.307415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1206 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e459062-64238bec-bc91cef8-732d3b47_0
2025-10-02T09:31:39.307651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb7ea74-47272531-ed200392-9a5da405_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e459062-64238bec-bc91cef8-732d3b47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.309889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Write session: try to update token
2025-10-02T09:31:39.309900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.316864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:39.316880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.316887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.316918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:39.316922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:39.317084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:39.317215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:39.317346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:39.317479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:39.317653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:39.317685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:39.320831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId: src_id|7e459062-64238bec-bc91cef8-732d3b47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.322771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:39.322919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.322934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.322958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:39.323027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:39.325585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.325596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.325598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.325598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.325604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.325607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.325612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554719889072315:7950]
2025-10-02T09:31:39.325632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.325640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.325641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.325645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.325649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.325653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.325746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.380754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554719964609534:9526]
2025-10-02T09:31:39.380892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1205, pipe: [1:7556554719964609534:9526]
2025-10-02T09:31:39.440590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:39.446680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.446700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.446822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.446880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.446932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.446982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.447018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.447024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.447074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.447121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.447170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.447218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.447253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.447258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.447317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.447362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.447412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.447461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.447499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.447504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.447553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.447600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.447648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.447696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.447731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.447736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.447785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.447830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.447879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.447926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.447961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.447966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.448016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.448061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.448107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.448155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.448192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.448197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.448243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.448287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.448335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.448380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.448413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.448418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.448466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.448512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.448557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.448604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.448638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.448642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.448688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.448731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.448776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.448839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.448886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.448892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.448936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:39.448981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:39.449025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:39.449069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:39.449104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:39.449108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:39.449137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609534:9526], now have 1 active actors on pipe
2025-10-02T09:31:39.449322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:39.449334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:39.449344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554719964609534:9526]
2025-10-02T09:31:39.449353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1206 reason: error at write: Disconnected sessionId: src_id|7e459062-64238bec-bc91cef8-732d3b47_0
2025-10-02T09:31:39.449359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:39.449481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1206 sessionId: src_id|7e459062-64238bec-bc91cef8-732d3b47_0 is DEAD
2025-10-02T09:31:39.449606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:39.449614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Write session will restart in 0.006147s
2025-10-02T09:31:39.449630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Write session: Do CDS request
2025-10-02T09:31:39.449634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:39.449708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:39.457067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.457154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:39.457160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1207
2025-10-02T09:31:39.457247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.457265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:39.457270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:39.457273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:39.457577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1207 sessionId:  describe result for acl check
2025-10-02T09:31:39.457606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:39.457612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:39.457613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:39.457616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554719964609616:9550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:39.457992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554719964609616:9550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:39.459915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554719964609616:9550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:39.462186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554719964609616:9550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.462195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554719964609616:9550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.462197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554719964609616:9550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.462200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.465978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.466252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.466344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.466350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.466356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.466381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.466405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889072606:7952]
2025-10-02T09:31:39.466743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.466902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.466925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.467099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.467127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.467131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.467132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.467132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.467133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.467133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.467134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.467134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.467135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.467135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.467136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.467136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.467139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.467145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.467147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.467149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.467151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.467153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.467155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.467158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.467160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.467162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.467164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.467166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.467169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.467173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.467176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.467179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.467182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.467185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.467187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.467189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.467192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.467194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.467197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.467199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.467201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.467204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.467208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.467211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.467213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.467216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.467217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.467220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.467224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.467227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.467229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.467232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.467248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.474723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.476036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.476048Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.476049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.476051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.476054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1206 [2:7556554719889072606:7952]
2025-10-02T09:31:39.476062Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.476073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.476079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.476080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.476081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.476091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.476097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.476101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.476349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.476355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.476356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.476358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.476359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.476394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.476400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.476406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.476411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.476422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.476437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609816:9550], now have 1 active actors on pipe
2025-10-02T09:31:39.476442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609535:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.476446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.476447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.476448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.476455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.476466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.476471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.476475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.476475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.476476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.476477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.476491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.476496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.476485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1206
2025-10-02T09:31:39.476504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.476507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1206
2025-10-02T09:31:39.476553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.476558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.476571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36fe9014-b996ae4f-4018e906-42114ee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.476578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.476580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.476582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.476586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.476594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.476602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.476697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.476702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.476712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.476764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1207 partition: 0 MaxSeqNo: 36 sessionId: src_id|36fe9014-b996ae4f-4018e906-42114ee8_0
2025-10-02T09:31:39.477006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e459062-64238bec-bc91cef8-732d3b47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|36fe9014-b996ae4f-4018e906-42114ee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.479187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Write session: try to update token
2025-10-02T09:31:39.479198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.485957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.485973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.485975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.485977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.485983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.485987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.485990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554719889072601:7952]
2025-10-02T09:31:39.486015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.486018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.486023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.486023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.486025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.486026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.486145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.489619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId: src_id|36fe9014-b996ae4f-4018e906-42114ee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.491470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:39.549727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554719964609831:9526]
2025-10-02T09:31:39.549862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1206, pipe: [1:7556554719964609831:9526]
2025-10-02T09:31:39.600221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:39.600559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.600568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.600588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609831:9526], now have 1 active actors on pipe
2025-10-02T09:31:39.600684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:39.600688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:39.600690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:39.600698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:39.600712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554719964609831:9526]
2025-10-02T09:31:39.600730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1207 reason: error at write: Disconnected sessionId: src_id|36fe9014-b996ae4f-4018e906-42114ee8_0
2025-10-02T09:31:39.600864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1207 sessionId: src_id|36fe9014-b996ae4f-4018e906-42114ee8_0 is DEAD
2025-10-02T09:31:39.600992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:39.601000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Write session will restart in 0.005416s
2025-10-02T09:31:39.601017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Write session: Do CDS request
2025-10-02T09:31:39.601020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:39.607094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.607193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:39.607199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1208
2025-10-02T09:31:39.607263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.607280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:39.607286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:39.607288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:39.607575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1208 sessionId:  describe result for acl check
2025-10-02T09:31:39.607598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:39.607602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:39.607603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:39.607605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554719964609923:9561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:39.607925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554719964609923:9561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:39.609765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554719964609923:9561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:39.611850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554719964609923:9561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.611859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554719964609923:9561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.611860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554719964609923:9561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.611864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.613489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.616152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.616249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.616255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.616261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.616288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.616312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889072929:7966]
2025-10-02T09:31:39.616655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.616825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.616848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.617024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.617051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.617054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.617055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.617056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.617056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.617057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.617057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.617058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.617058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.617059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.617059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.617060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.617063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.617069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.617071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.617073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.617075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.617077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.617079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.617081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.617083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.617085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.617087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.617089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.617092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.617096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.617099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.617102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.617105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.617108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.617110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.617112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.617115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.617117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.617119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.617122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.617124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.617126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.617128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.617131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.617133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.617135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.617141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.617144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.617146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.617148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.617150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.617153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.617170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.624672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.626328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.626337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.626339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.626341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.626344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1207 [2:7556554719889072929:7966]
2025-10-02T09:31:39.626351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.626360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.626362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.626363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.626365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.626374Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.626381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.626385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.626416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.626421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.626422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.626423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.626425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.626461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.626466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.626473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.626479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.626490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.626504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964609857:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.626510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610109:9561], now have 1 active actors on pipe
2025-10-02T09:31:39.626514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.626515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.626515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.626523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.626533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.626542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.626543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.626544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.626550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.626551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.626558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.626560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.626551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1207
2025-10-02T09:31:39.626569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.626582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.626583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.626553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1207
2025-10-02T09:31:39.626598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|706965fa-a222bd8-a29a864d-8c69d390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.626605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.626607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.626608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.626614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.626622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.626632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.626728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.626734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.626743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.626802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1208 partition: 0 MaxSeqNo: 36 sessionId: src_id|706965fa-a222bd8-a29a864d-8c69d390_0
2025-10-02T09:31:39.627028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36fe9014-b996ae4f-4018e906-42114ee8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|706965fa-a222bd8-a29a864d-8c69d390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.629294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Write session: try to update token
2025-10-02T09:31:39.629305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.636208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.636225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.636227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.636229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.636235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.636239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.636242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554719889072924:7966]
2025-10-02T09:31:39.636271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.636272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.636275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.636278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.636281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.636282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.636413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.639716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId: src_id|706965fa-a222bd8-a29a864d-8c69d390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.641653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:39.700756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554719964610151:9526]
2025-10-02T09:31:39.700913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1207, pipe: [1:7556554719964610151:9526]
2025-10-02T09:31:39.753591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:39.753781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.753790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.753815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610151:9526], now have 1 active actors on pipe
2025-10-02T09:31:39.753952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:39.754015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:39.754029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554719964610151:9526]
2025-10-02T09:31:39.754048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:39.754116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1208 reason: status is not ok: tablet will be restarted right now sessionId: src_id|706965fa-a222bd8-a29a864d-8c69d390_0
2025-10-02T09:31:39.754249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1208 sessionId: src_id|706965fa-a222bd8-a29a864d-8c69d390_0 is DEAD
2025-10-02T09:31:39.754398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:39.754408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Write session will restart in 0.009291s
2025-10-02T09:31:39.754428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Write session: Do CDS request
2025-10-02T09:31:39.754433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:39.765101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.765179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:39.765187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1209
2025-10-02T09:31:39.765280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.765319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:39.765327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:39.765330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:39.765652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1209 sessionId:  describe result for acl check
2025-10-02T09:31:39.765681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:39.765683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:39.765684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:39.765688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554719964610356:9565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:39.766057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554719964610356:9565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:39.767434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554719964610356:9565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:39.767898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.770549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.770652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.770658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.770664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.770670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554719964610356:9565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.770678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554719964610356:9565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.770680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554719964610356:9565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.770683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.770691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.770714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889073229:7969]
2025-10-02T09:31:39.771051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.771212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.771234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.771406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.771435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.771439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.771439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.771440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.771440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.771441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.771441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.771442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.771443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.771443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.771444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.771444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.771447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.771453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.771455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.771457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.771459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.771461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.771463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.771465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.771467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.771469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.771471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.771473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.771476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.771481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.771485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.771488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.771490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.771492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.771495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.771497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.771499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.771502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.771505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.771508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.771510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.771516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.771519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.771521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.771524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.771526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.771528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.771530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.771532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.771535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.771537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.771539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.771556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.778967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.780485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.780496Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.780497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.780499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.780502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1208 [2:7556554719889073229:7969]
2025-10-02T09:31:39.780508Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.780517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.780522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.780523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.780524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.780533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.780535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.780539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.780569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.780574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.780575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.780577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.780578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.780615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.780619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.780626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.780632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.780641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.780656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610454:9565], now have 1 active actors on pipe
2025-10-02T09:31:39.780661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610155:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.780665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.780666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.780667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.780674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.780681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.780688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.780692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.780692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.780693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.780694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.780690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1208
2025-10-02T09:31:39.780706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.780711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.780713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.780716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1208
2025-10-02T09:31:39.780727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.780731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.780750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.780757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.780759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.780760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.780765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.780771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.780785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.780899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.780905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.780916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.780976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1209 partition: 0 MaxSeqNo: 36 sessionId: src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0
2025-10-02T09:31:39.781206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706965fa-a222bd8-a29a864d-8c69d390_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.783573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Write session: try to update token
2025-10-02T09:31:39.783585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.789947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.789962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.789964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.789965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.789972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.789975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.789978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554719889073224:7969]
2025-10-02T09:31:39.790004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.790007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.790012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.790013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.790014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.790016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.790146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.795213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId: src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.797288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:39.854352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554719964610473:9526]
2025-10-02T09:31:39.854504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1208, pipe: [1:7556554719964610473:9526]
2025-10-02T09:31:39.900895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:39.901382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.901391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.901415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610473:9526], now have 1 active actors on pipe
2025-10-02T09:31:39.901551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:39.901584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:39.901619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:39.901622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554719964610473:9526]
2025-10-02T09:31:39.901671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0
2025-10-02T09:31:39.901792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1209 sessionId: src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0 is DEAD
2025-10-02T09:31:39.901963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:39.901972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Write session will restart in 0.008805s
2025-10-02T09:31:39.902006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Write session: Do CDS request
2025-10-02T09:31:39.902011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:39.912103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.912185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:39.912192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1210
2025-10-02T09:31:39.912262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:39.912280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:39.912286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:39.912289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:39.912629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1210 sessionId:  describe result for acl check
2025-10-02T09:31:39.912660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:39.912665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:39.912667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:39.912672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554719964610669:9571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:39.913141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554719964610669:9571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:39.914660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554719964610669:9571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:39.917770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:39.917911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554719964610669:9571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:39.917921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554719964610669:9571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:39.917923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554719964610669:9571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:39.917926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:39.918037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:39.918126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:39.918133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:39.918139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:39.918164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:39.918187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554719889073519:7971]
2025-10-02T09:31:39.918517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:39.918671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:39.918693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:39.918877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:39.918907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.918911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.918911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.918912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.918912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.918913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.918913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.918914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.918914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.918915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.918915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.918916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.918919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.918925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.918927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.918929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.918931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.918933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.918935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.918937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.918938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.918940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.918942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.918944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.918947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.918951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:39.918954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.918957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:39.918959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.918962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:39.918963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.918966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:39.918969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.918971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:39.918973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.918976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:39.918978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.918981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:39.918982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.918985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:39.918987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.918991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:39.918993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.918995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.918997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.918999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.919001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.919003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.919019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:39.926297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:39.927751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:39.927761Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:39.927762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:39.927764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:39.927768Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1209 [2:7556554719889073519:7971]
2025-10-02T09:31:39.927775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:39.927785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:39.927790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.927791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.927792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.927801Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:39.927804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:39.927808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:39.927839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.927844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.927845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.927847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:39.927848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:39.927881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:39.927886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.927893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:39.927898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:39.927906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:39.927920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610763:9571], now have 1 active actors on pipe
2025-10-02T09:31:39.927926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554719964610477:2446], now have 1 active actors on pipe
2025-10-02T09:31:39.927930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.927931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.927932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.927940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:39.927947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:39.927955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:39.927955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:39.927957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:39.927958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:39.927959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:39.927960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1209
2025-10-02T09:31:39.927973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.927975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:39.927978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:39.927988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.927981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1209
2025-10-02T09:31:39.927990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.928008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:39.928015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:39.928017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:39.928018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:39.928022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:39.928027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:39.928036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.928124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:39.928131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:39.928142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:39.928191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1210 partition: 0 MaxSeqNo: 36 sessionId: src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0
2025-10-02T09:31:39.928391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|885a96cc-1c50fe00-ae4b9b56-3b76c0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:39.930783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Write session: try to update token
2025-10-02T09:31:39.930796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:39.937107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:39.937121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:39.937122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:39.937124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:39.937130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.937133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.937138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554719889073513:7971]
2025-10-02T09:31:39.937163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:39.937165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:39.937167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:39.937169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:39.937169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:39.937171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:39.937281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:39.942300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId: src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:39.944156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.001822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259578070:9526]
2025-10-02T09:31:40.002002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1209, pipe: [1:7556554724259578070:9526]
2025-10-02T09:31:40.051913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.052356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.052367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.052393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578070:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.052555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259578070:9526]
2025-10-02T09:31:40.052578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:40.052580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.052582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:40.052638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1210 reason: error at write: Disconnected sessionId: src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0
2025-10-02T09:31:40.052845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1210 sessionId: src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0 is DEAD
2025-10-02T09:31:40.052960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:40.052972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Write session will restart in 0.008035s
2025-10-02T09:31:40.052994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Write session: Do CDS request
2025-10-02T09:31:40.053000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.053044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.062116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.062232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.062240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1211
2025-10-02T09:31:40.062330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.062350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.062356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.062359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.062646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1211 sessionId:  describe result for acl check
2025-10-02T09:31:40.062673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.062677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.062678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.062681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259578210:9575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.063139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259578210:9575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.065332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259578210:9575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.069831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259578210:9575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.069841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259578210:9575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.069843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259578210:9575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.069846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.069847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.070125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.070222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.070229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.070235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.070260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.070282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184041107:7974]
2025-10-02T09:31:40.070623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.070783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.070806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.070992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.071021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.071025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.071025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.071026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.071027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.071027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.071028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.071028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.071029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.071029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.071030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.071030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.071033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.071040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.071042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.071044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.071046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.071048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.071050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.071052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.071054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.071056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.071058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.071060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.071063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.071067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.071070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.071073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.071076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.071078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.071080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.071083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.071086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.071088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.071091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.071093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.071096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.071098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.071100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.071103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.071105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.071107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.071111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.071113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.071115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.071118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.071120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.071122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.071139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.078648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.080193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.080205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.080206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.080208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.080211Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1210 [2:7556554724184041107:7974]
2025-10-02T09:31:40.080219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.080230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.080231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.080233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.080234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.080243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.080249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.080253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.080281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.080286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.080287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.080289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.080290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.080328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.080333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.080340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.080345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.080355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.080370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578358:9575], now have 1 active actors on pipe
2025-10-02T09:31:40.080376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578072:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.080379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.080380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.080381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.080389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.080397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.080402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.080404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.080405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.080407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.080398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1210
2025-10-02T09:31:40.080409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.080424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.080429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.080430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.080438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.080443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.080448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1210
2025-10-02T09:31:40.080467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.080474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.080476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.080477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.080481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.080486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.080501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.080589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.080594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.080601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.080657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1211 partition: 0 MaxSeqNo: 36 sessionId: src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0
2025-10-02T09:31:40.080879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e79cb4-9adbf2a4-ad19295-a05dc36a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.083076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Write session: try to update token
2025-10-02T09:31:40.083086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.089864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.089880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.089882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.089884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.089890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.089894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.089897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184041101:7974]
2025-10-02T09:31:40.089919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.089926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.089929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.089931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.089933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.089935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.090056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:40.093859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId: src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.095709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.152867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259578370:9526]
2025-10-02T09:31:40.153046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1210, pipe: [1:7556554724259578370:9526]
2025-10-02T09:31:40.202460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.202835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.202844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.202882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578370:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.202992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.203033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259578370:9526]
2025-10-02T09:31:40.203051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.203056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:40.203107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0
2025-10-02T09:31:40.203221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1211 sessionId: src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0 is DEAD
2025-10-02T09:31:40.203336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:40.203344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Write session will restart in 0.008334s
2025-10-02T09:31:40.203360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Write session: Do CDS request
2025-10-02T09:31:40.203364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.212091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.212176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.212188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1212
2025-10-02T09:31:40.212285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.212305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.212311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.212314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.212581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1212 sessionId:  describe result for acl check
2025-10-02T09:31:40.212602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.212606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.212607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.212610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259578489:9580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.212972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259578489:9580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.215316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259578489:9580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.217201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259578489:9580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.217209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259578489:9580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.217211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259578489:9580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.217214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.220363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.220666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.220756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.220763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.220769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.220795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.220828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184041400:7977]
2025-10-02T09:31:40.221167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.221326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.221349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.221518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.221545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.221549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.221550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.221550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.221551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.221551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.221552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.221552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.221553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.221553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.221554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.221554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.221557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.221563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.221565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.221567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.221569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.221571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.221573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.221575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.221577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.221580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.221582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.221584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.221588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.221592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.221595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.221598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.221600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.221603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.221605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.221608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.221610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.221612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.221614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.221617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.221619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.221622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.221624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.221627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.221629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.221632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.221634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.221637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.221639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.221641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.221643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.221646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.221663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.228988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.230492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.230503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.230505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.230507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.230510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1211 [2:7556554724184041400:7977]
2025-10-02T09:31:40.230516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.230525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.230526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.230527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.230528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.230537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.230540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.230544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.230572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.230573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.230574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.230576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.230577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.230614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.230617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.230623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.230628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.230636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.230649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578660:9580], now have 1 active actors on pipe
2025-10-02T09:31:40.230655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578374:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.230659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.230660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.230661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.230670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.230677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.230681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.230683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.230684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.230675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1211
2025-10-02T09:31:40.230684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.230683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1211
2025-10-02T09:31:40.230686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.230699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.230701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.230702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.230710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.230712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.230740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.230747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.230749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.230750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.230755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.230760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.230768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.230852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.230865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.230872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.230922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1212 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0
2025-10-02T09:31:40.231124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcaf7fe9-1183827a-eae92e24-1aab0a62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.233320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Write session: try to update token
2025-10-02T09:31:40.233330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.239848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.239863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.239864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.239865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.239870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.239872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.239874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184041395:7977]
2025-10-02T09:31:40.239895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.239898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.239900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.239901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.239903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.239905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.240045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:40.244183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId: src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.246102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.303392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259578673:9526]
2025-10-02T09:31:40.303605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1211, pipe: [1:7556554724259578673:9526]
2025-10-02T09:31:40.351002Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.351536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.351550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.351581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578673:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.351769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.351760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259578673:9526]
2025-10-02T09:31:40.351779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:40.351782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:40.351782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.351854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1212 reason: error at write: Disconnected sessionId: src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0
2025-10-02T09:31:40.352002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1212 sessionId: src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0 is DEAD
2025-10-02T09:31:40.352114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:40.352123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Write session will restart in 0.006984s
2025-10-02T09:31:40.352140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Write session: Do CDS request
2025-10-02T09:31:40.352146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.360138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.360209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.360221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1213
2025-10-02T09:31:40.360306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.360326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.360333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.360336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.360612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1213 sessionId:  describe result for acl check
2025-10-02T09:31:40.360641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.360645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.360646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.360649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259578763:9584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.361063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259578763:9584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.362963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259578763:9584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.364837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259578763:9584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.364847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259578763:9584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.364849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259578763:9584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.364852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.366336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.369058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.369270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.369278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.369285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.369319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.369344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184041690:7979]
2025-10-02T09:31:40.369683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.369846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.369869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.370048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.370076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.370076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.370077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.370077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.370078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.370079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.370079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.370080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.370080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.370081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.370082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.370082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.370085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.370091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.370093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.370095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.370097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.370100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.370102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.370103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.370105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.370108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.370110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.370111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.370115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.370119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.370122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.370125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.370128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.370130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.370132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.370136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.370138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.370141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.370143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.370145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.370147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.370150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.370152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.370154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.370156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.370159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.370162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.370164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.370166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.370169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.370171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.370174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.370189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.377747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.380242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.380254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.380256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.380259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.380262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1212 [2:7556554724184041690:7979]
2025-10-02T09:31:40.380269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.380278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.380280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.380282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.380283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.380291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.380293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.380297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.380327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.380328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.380329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.380331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.380332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.380369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.380373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.380379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.380384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.380392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.380403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578961:9584], now have 1 active actors on pipe
2025-10-02T09:31:40.380406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578675:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.380409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.380411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.380412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.380420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.380427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.380434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.380435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.380436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.380437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.380439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.380449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.380454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.380443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1212
2025-10-02T09:31:40.380462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.380459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1212
2025-10-02T09:31:40.380472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.380473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.380496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.380504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.380506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.380507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.380511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.380516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.380525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.380613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.380618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.380625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.380668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1213 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0
2025-10-02T09:31:40.380890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1cd9ef6-c60143c-8da94b69-ad832779_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.385712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Write session: try to update token
2025-10-02T09:31:40.385723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.389778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.389791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.389792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.389793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.389797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.389799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.389801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184041685:7979]
2025-10-02T09:31:40.389823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.389826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.389827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.389837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.389840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.389842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.390056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:40.400918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId: src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.402874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.451873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259578975:9526]
2025-10-02T09:31:40.452045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1212, pipe: [1:7556554724259578975:9526]
2025-10-02T09:31:40.501806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.502165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.502175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.502188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578975:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.502321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.502337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259578975:9526]
2025-10-02T09:31:40.502360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.502372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:40.502442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0
2025-10-02T09:31:40.502609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1213 sessionId: src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0 is DEAD
2025-10-02T09:31:40.502705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:40.502713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Write session will restart in 0.005364s
2025-10-02T09:31:40.502730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Write session: Do CDS request
2025-10-02T09:31:40.502734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.509040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.509120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.509128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1214
2025-10-02T09:31:40.509222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.509243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.509249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.509251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.509561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1214 sessionId:  describe result for acl check
2025-10-02T09:31:40.509581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.509586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.509588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.509590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259579036:9588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.509928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259579036:9588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.511704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259579036:9588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.513888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259579036:9588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.513895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259579036:9588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.513897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259579036:9588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.513900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.519424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.519748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.519845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.519852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.519857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.519883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.519907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184041983:7981]
2025-10-02T09:31:40.520259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.520413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.520436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.520616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.520644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.520648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.520648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.520649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.520649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.520650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.520650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.520651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.520652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.520652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.520653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.520653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.520656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.520662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.520664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.520667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.520669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.520671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.520673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.520675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.520677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.520679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.520681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.520683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.520688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.520691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.520695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.520698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.520700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.520703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.520705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.520707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.520709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.520712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.520714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.520717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.520718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.520721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.520723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.520727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.520729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.520732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.520733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.520736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.520738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.520741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.520743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.520745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.520761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.528531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.530112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.530123Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.530125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.530126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.530130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1213 [2:7556554724184041983:7981]
2025-10-02T09:31:40.530137Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.530146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.530147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.530149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.530150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.530159Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.530162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.530166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.530194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.530196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.530197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.530198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.530200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.530241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.530247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.530253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.530258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.530266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.530279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579208:9588], now have 1 active actors on pipe
2025-10-02T09:31:40.530281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259578976:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.530284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.530285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.530287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.530295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.530302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.530309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.530310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.530313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.530314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.530315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.530328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.530329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.530332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.530343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1213
2025-10-02T09:31:40.530363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1213
2025-10-02T09:31:40.530389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.530395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.530410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.530413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.530415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.530416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.530421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.530426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.530433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.530536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.530541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.530548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.530600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1214 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0
2025-10-02T09:31:40.530829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1e8324-8caf9a52-839e3914-52474aa7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.533037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Write session: try to update token
2025-10-02T09:31:40.533048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.540058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.540073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.540075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.540076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.540082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.540084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.540086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184041978:7981]
2025-10-02T09:31:40.540108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.540110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.540111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.540112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.540113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.540115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.540262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:40.546363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId: src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.548337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.602383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259579291:9526]
2025-10-02T09:31:40.602510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1213, pipe: [1:7556554724259579291:9526]
2025-10-02T09:31:40.654463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.654677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.654686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.654699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579291:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.654917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.654935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259579291:9526]
2025-10-02T09:31:40.654935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.654953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:40.654958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:40.655002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1214 reason: error at write: Disconnected sessionId: src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0
2025-10-02T09:31:40.655143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1214 sessionId: src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0 is DEAD
2025-10-02T09:31:40.655267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:40.655278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Write session will restart in 0.005832s
2025-10-02T09:31:40.655293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Write session: Do CDS request
2025-10-02T09:31:40.655297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.662129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.662204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.662215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1215
2025-10-02T09:31:40.662306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.662327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.662333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.662336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.662681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1215 sessionId:  describe result for acl check
2025-10-02T09:31:40.662711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.662716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.662717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.662721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259579376:9599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.663164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259579376:9599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.665394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259579376:9599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.667589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259579376:9599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.667599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259579376:9599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.667603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259579376:9599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.667607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.671521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.671797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.671896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.671903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.671909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.671933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.671951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184042313:7995]
2025-10-02T09:31:40.672286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.672439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.672462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.672636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.672664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.672668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.672669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.672669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.672670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.672670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.672671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.672671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.672672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.672672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.672673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.672673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.672676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.672682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.672684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.672686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.672688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.672690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.672692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.672694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.672696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.672698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.672700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.672702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.672705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.672709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.672712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.672715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.672718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.672720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.672722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.672725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.672727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.672730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.672732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.672734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.672736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.672739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.672741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.672745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.672747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.672750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.672752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.672754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.672756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.672759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.672761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.672763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.672780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.680436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.681995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.682006Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.682008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.682010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.682013Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1214 [2:7556554724184042313:7995]
2025-10-02T09:31:40.682019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.682029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.682030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.682032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.682033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.682042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.682045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.682049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.682079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.682080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.682081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.682083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.682084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.682119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.682124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.682130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.682135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.682143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.682155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579301:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.682157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579589:9599], now have 1 active actors on pipe
2025-10-02T09:31:40.682161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.682162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.682165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.682172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.682179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.682187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.682189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.682190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.682191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.682191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.682204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.682206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.682208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.682198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1214
2025-10-02T09:31:40.682225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1214
2025-10-02T09:31:40.682249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.682255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.682267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.682272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.682274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.682275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.682280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.682285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.682292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.682390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.682395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.682403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.682451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1215 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0
2025-10-02T09:31:40.682657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7fc9bd7-8aba3553-86830c8d-f10c44ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.684903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Write session: try to update token
2025-10-02T09:31:40.684913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.691835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.691851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.691852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.691853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.691859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.691861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.691863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184042308:7995]
2025-10-02T09:31:40.691886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.691889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.691891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.691890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.691894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.691897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.692006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:40.695010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId: src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.696956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.754974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259579604:9526]
2025-10-02T09:31:40.755133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1214, pipe: [1:7556554724259579604:9526]
2025-10-02T09:31:40.802573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.802762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.802772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.802796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579604:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.802957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.802984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.803021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:40.803029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259579604:9526]
2025-10-02T09:31:40.803074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1215 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0
2025-10-02T09:31:40.803210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1215 sessionId: src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0 is DEAD
2025-10-02T09:31:40.803349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:40.803358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Write session will restart in 0.005198s
2025-10-02T09:31:40.803376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Write session: Do CDS request
2025-10-02T09:31:40.803380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.809106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.809200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.809214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1216
2025-10-02T09:31:40.809300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.809321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.809327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.809330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.809582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1216 sessionId:  describe result for acl check
2025-10-02T09:31:40.809605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.809606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.809607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.809609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259579663:9605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.809935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259579663:9605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.811733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259579663:9605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.814257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259579663:9605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.814266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259579663:9605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.814267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259579663:9605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.814271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.819884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.820159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.820384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.820392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.820399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.820432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.820457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184042620:7998]
2025-10-02T09:31:40.820794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.820964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.820987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.821160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.821189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.821193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.821194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.821195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.821195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.821196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.821196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.821197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.821197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.821198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.821198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.821199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.821201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.821207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.821209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.821211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.821213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.821215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.821217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.821219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.821220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.821222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.821224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.821226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.821229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.821233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.821237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.821240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.821242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.821245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.821247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.821250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.821252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.821254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.821256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.821260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.821262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.821265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.821267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.821269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.821271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.821274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.821276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.821278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.821280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.821283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.821285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.821287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.821304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.828747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.830125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.830140Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.830141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.830143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.830147Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1215 [2:7556554724184042620:7998]
2025-10-02T09:31:40.830154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.830164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.830166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.830167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.830168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.830178Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.830180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.830184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.830226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.830232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.830233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.830234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.830236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.830272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.830277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.830283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.830288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.830297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.830312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579620:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.830317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579825:9605], now have 1 active actors on pipe
2025-10-02T09:31:40.830321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.830322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.830324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.830331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.830339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.830344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.830347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.830348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.830351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.830353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.830362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.830364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.830365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.830347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1215
2025-10-02T09:31:40.830354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1215
2025-10-02T09:31:40.830380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.830386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.830404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.830411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.830413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.830414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.830419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.830424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.830435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.830534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.830539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.830546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.830598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1216 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0
2025-10-02T09:31:40.830829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ed6c26-d98714c5-d935ae2a-e05b7f94_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.833398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Write session: try to update token
2025-10-02T09:31:40.833408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.839466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.839481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.839483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.839484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.839488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.839491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.839495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184042615:7998]
2025-10-02T09:31:40.839516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.839519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.839520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.839520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.839524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.839526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.839626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:40.845041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId: src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.846964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.902945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554724259579929:9526]
2025-10-02T09:31:40.903111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1215, pipe: [1:7556554724259579929:9526]
2025-10-02T09:31:40.950924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:40.951313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.951323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.951336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579929:9526], now have 1 active actors on pipe
2025-10-02T09:31:40.951449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554724259579929:9526]
2025-10-02T09:31:40.951448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:40.951469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:40.951478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:40.951481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:40.951527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1216 reason: error at write: Disconnected sessionId: src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0
2025-10-02T09:31:40.951678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1216 sessionId: src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0 is DEAD
2025-10-02T09:31:40.951786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:40.951794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Write session will restart in 0.005421s
2025-10-02T09:31:40.951810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Write session: Do CDS request
2025-10-02T09:31:40.951814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:40.958119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.958211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:40.958218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1217
2025-10-02T09:31:40.958279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:40.958299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:40.958305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:40.958307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:40.958560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1217 sessionId:  describe result for acl check
2025-10-02T09:31:40.958583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:40.958587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:40.958588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:40.958591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554724259580000:9609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:40.958934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554724259580000:9609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:40.960491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554724259580000:9609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:40.962542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554724259580000:9609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:40.962550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554724259580000:9609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:40.962552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554724259580000:9609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:40.962555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:40.967638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:40.967909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:40.968108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:40.968116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:40.968122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:40.968153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:40.968175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554724184042918:8001]
2025-10-02T09:31:40.968520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:40.968680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:40.968702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:40.968885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:40.968917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.968917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.968918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.968919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.968919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.968920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.968920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.968921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.968921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.968923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.968925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.968932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.968934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.968936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.968938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.968940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.968942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.968943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.968945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.968948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.968950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.968951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.968956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.968960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:40.968963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.968966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:40.968968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.968971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:40.968973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.968975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:40.968978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.968980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:40.968982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.968985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:40.968987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.968989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:40.968992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.968994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:40.968998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.969000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:40.969002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.969005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.969007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.969010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.969011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.969014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.969032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:40.976531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:40.978135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:40.978146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:40.978148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:40.978150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:40.978154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1216 [2:7556554724184042918:8001]
2025-10-02T09:31:40.978161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:40.978170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:40.978172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.978173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.978174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.978183Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:40.978189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:40.978194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:40.978224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.978229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.978230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.978232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:40.978234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:40.978271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:40.978276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.978282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:40.978287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:40.978297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:40.978311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259580166:9609], now have 1 active actors on pipe
2025-10-02T09:31:40.978316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554724259579933:2446], now have 1 active actors on pipe
2025-10-02T09:31:40.978320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.978322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.978323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.978330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:40.978340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:40.978343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:40.978345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:40.978346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:40.978350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:40.978352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:40.978367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.978374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:40.978379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:40.978371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1216
2025-10-02T09:31:40.978379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1216
2025-10-02T09:31:40.978410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.978415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.978431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:40.978438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:40.978440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:40.978441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:40.978446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:40.978454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:40.978462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.978554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.978558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.978566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:40.978623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1217 partition: 0 MaxSeqNo: 36 sessionId: src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0
2025-10-02T09:31:40.978850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f896606-6f3c9c15-8b95cdc9-90376f9f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:40.981104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Write session: try to update token
2025-10-02T09:31:40.981115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:40.987389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:40.987403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.987407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.987429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:40.987432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:40.987596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:40.987712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:40.987822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:40.987940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:40.988093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:40.988118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:40.991050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId: src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:40.992920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:40.993026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:40.993035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:40.993050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:40.993105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:40.995765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:40.995776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:40.995780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:40.995781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:40.995785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.995787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.995789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554724184042913:8001]
2025-10-02T09:31:40.995809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:40.995809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:40.995814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:40.995816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:40.995816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:40.995817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:40.995925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.051418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554547530:9526]
2025-10-02T09:31:41.051559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1216, pipe: [1:7556554728554547530:9526]
2025-10-02T09:31:41.104984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:41.111075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.111095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.111217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.111266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.111317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.111369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.111406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.111414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.111470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.111518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.111568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.111621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.111722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.111731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.111783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.111830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.111881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.111930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.111967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.111972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.112048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.112120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.112168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.112219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.112255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.112260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.112312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.112362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.112410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.112465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.112513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.112518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.112566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.112639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.112686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.112734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.112767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.112771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.112859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.112927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.113005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.113054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.113094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.113099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.113167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.113233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.113303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.113377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.113422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.113426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.113475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.113540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.113586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.113631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.113663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.113668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.113742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.113816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.113862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.113909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.113943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.113948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.113978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554547530:9526], now have 1 active actors on pipe
2025-10-02T09:31:41.114166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:41.114179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:41.114191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554547530:9526]
2025-10-02T09:31:41.114200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1217 reason: error at write: Disconnected sessionId: src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0
2025-10-02T09:31:41.114212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:41.114338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1217 sessionId: src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0 is DEAD
2025-10-02T09:31:41.114453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:41.114462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Write session will restart in 0.009979s
2025-10-02T09:31:41.114476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Write session: Do CDS request
2025-10-02T09:31:41.114480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:41.114600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:41.125134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.125214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:41.125224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1218
2025-10-02T09:31:41.125299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.125320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:41.125326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:41.125329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:41.125616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1218 sessionId:  describe result for acl check
2025-10-02T09:31:41.125635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:41.125640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:41.125641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:41.125644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554728554547747:9613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:41.125987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554728554547747:9613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:41.127811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554728554547747:9613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:41.130480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:41.130657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554728554547747:9613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:41.130666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554728554547747:9613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:41.130668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554728554547747:9613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:41.130671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:41.130718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:41.130818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:41.130824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:41.130830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:41.130865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:41.130889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554728479010512:8003]
2025-10-02T09:31:41.131227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:41.131391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:41.131414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:41.131589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:41.131617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.131621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.131621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.131622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.131622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.131623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.131624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.131624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.131625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.131625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.131626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.131626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.131629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.131634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.131636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.131638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.131640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.131642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.131644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.131646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.131648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.131650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.131652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.131654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.131657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.131661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.131664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.131667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.131669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.131672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.131674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.131676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.131682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.131685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.131688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.131691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.131693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.131695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.131698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.131701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.131703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.131708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.131710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.131712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.131714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.131716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.131718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.131721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.131739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:41.139080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:41.140357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:41.140367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:41.140368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:41.140370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:41.140374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1217 [2:7556554728479010512:8003]
2025-10-02T09:31:41.140380Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:41.140390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:41.140392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.140393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.140394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.140404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:41.140409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:41.140413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:41.140443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.140448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.140449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.140451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:41.140452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:41.140489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:41.140494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.140500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.140505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.140516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:41.140530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554547826:9613], now have 1 active actors on pipe
2025-10-02T09:31:41.140536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554547531:2446], now have 1 active actors on pipe
2025-10-02T09:31:41.140540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.140544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.140545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.140552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:41.140561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:41.140565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:41.140567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:41.140568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:41.140571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:41.140573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:41.140566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1217
2025-10-02T09:31:41.140569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1217
2025-10-02T09:31:41.140586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.140591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:41.140593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:41.140600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.140605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.140631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:41.140637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.140640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.140641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:41.140646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.140654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:41.140667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.140754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.140758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.140766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.140826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1218 partition: 0 MaxSeqNo: 36 sessionId: src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0
2025-10-02T09:31:41.141015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60428de5-cb5eaa9-1d7c65c7-2c9ce864_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:41.143226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Write session: try to update token
2025-10-02T09:31:41.143236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:41.150028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:41.150044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.150046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:41.150047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:41.150053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.150058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.150062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554728479010506:8003]
2025-10-02T09:31:41.150089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:41.150093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.150094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:41.150095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:41.150097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:41.150100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:41.150215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.153840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId: src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:41.155793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:41.214236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554547841:9526]
2025-10-02T09:31:41.214374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1217, pipe: [1:7556554728554547841:9526]
2025-10-02T09:31:41.261809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:41.262154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.262163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.262189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554547841:9526], now have 1 active actors on pipe
2025-10-02T09:31:41.262308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:41.262351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:41.262363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:41.262366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554547841:9526]
2025-10-02T09:31:41.262379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:41.262408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1218 reason: error at write: Disconnected sessionId: src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0
2025-10-02T09:31:41.262546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1218 sessionId: src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0 is DEAD
2025-10-02T09:31:41.262687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:41.262696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Write session will restart in 0.005491s
2025-10-02T09:31:41.262711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Write session: Do CDS request
2025-10-02T09:31:41.262714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:41.269149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.269198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:41.269208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1219
2025-10-02T09:31:41.269282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.269301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:41.269307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:41.269310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:41.269586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1219 sessionId:  describe result for acl check
2025-10-02T09:31:41.269610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:41.269616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:41.269617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:41.269620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554728554547889:9618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:41.269946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554728554547889:9618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:41.271925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554728554547889:9618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:41.274445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554728554547889:9618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:41.274454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554728554547889:9618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:41.274456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554728554547889:9618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:41.274459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:41.279675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:41.279948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:41.280049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:41.280056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:41.280061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:41.280088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:41.280108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554728479010812:8006]
2025-10-02T09:31:41.280442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:41.280590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:41.280612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:41.280783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:41.280823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.280827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.280827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.280828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.280828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.280829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.280829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.280830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.280830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.280831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.280831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.280832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.280835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.280841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.280843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.280845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.280847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.280849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.280851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.280853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.280855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.280856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.280858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.280860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.280864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.280868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.280871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.280874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.280875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.280878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.280880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.280882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.280885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.280887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.280890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.280892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.280895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.280898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.280900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.280902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.280904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.280907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.280909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.280912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.280914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.280917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.280919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.280922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.280939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:41.288262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:41.289848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:41.289858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:41.289859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:41.289861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:41.289864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1218 [2:7556554728479010812:8006]
2025-10-02T09:31:41.289873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:41.289882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:41.289884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.289885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.289886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.289895Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:41.289898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:41.289902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:41.289932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.289933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.289934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.289936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:41.289938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:41.289973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:41.289978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.289984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.289989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.289997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:41.290008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548069:9618], now have 1 active actors on pipe
2025-10-02T09:31:41.290010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554547842:2446], now have 1 active actors on pipe
2025-10-02T09:31:41.290014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.290015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.290016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.290023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:41.290030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:41.290036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:41.290038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:41.290039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:41.290040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:41.290042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:41.290054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.290056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:41.290057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:41.290060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1218
2025-10-02T09:31:41.290062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1218
2025-10-02T09:31:41.290083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.290088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.290102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:41.290105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.290107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.290108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:41.290113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.290118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:41.290125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.290221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.290228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.290238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.290287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1219 partition: 0 MaxSeqNo: 36 sessionId: src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0
2025-10-02T09:31:41.290491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b61ff-ef586d60-6e1bf3e2-2408cc12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:41.292844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Write session: try to update token
2025-10-02T09:31:41.292853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:41.299001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:41.299014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.299019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.299045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:41.299053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:41.299185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:41.299302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:41.299417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:41.299542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:41.299843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:41.299877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:41.303251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId: src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:41.305169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:41.305375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.305387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.305407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:41.305462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:41.307285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:41.307297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.307299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:41.307300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:41.307306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.307308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.307310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554728479010807:8006]
2025-10-02T09:31:41.307330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:41.307337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.307337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:41.307338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:41.307340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:41.307342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:41.307463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.362710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554548149:9526]
2025-10-02T09:31:41.362888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1218, pipe: [1:7556554728554548149:9526]
2025-10-02T09:31:41.418928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:41.424990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.425006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.425125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.425177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.425230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.425280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.425316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.425323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.425374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.425422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.425471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.425521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.425781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.425788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.425838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.425885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.425935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.425984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.426019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.426023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.426074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.426122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.426170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.426217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.426252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.426256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.426307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.426352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.426398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.426447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.426482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.426486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.426535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.426581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.426631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.426674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.426712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.426716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.426762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.426806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.426854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.426907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.426940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.426945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.426991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.427036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.427082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.427129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.427162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.427167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.427231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.427275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.427359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.427407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.427440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.427444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.427488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.427533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.427578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.427624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.427657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.427663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.427692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548149:9526], now have 1 active actors on pipe
2025-10-02T09:31:41.427887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:41.427898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:41.427906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554548149:9526]
2025-10-02T09:31:41.427916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1219 reason: error at write: Disconnected sessionId: src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0
2025-10-02T09:31:41.427920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:41.428046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1219 sessionId: src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0 is DEAD
2025-10-02T09:31:41.428169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:41.428176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Write session will restart in 0.009337s
2025-10-02T09:31:41.428191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Write session: Do CDS request
2025-10-02T09:31:41.428195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:41.428179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:41.438106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.438174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:41.438184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1220
2025-10-02T09:31:41.438268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.438289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:41.438295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:41.438298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:41.438587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1220 sessionId:  describe result for acl check
2025-10-02T09:31:41.438625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:41.438634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:41.438635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:41.438638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554728554548317:9622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:41.439003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554728554548317:9622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:41.441061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554728554548317:9622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:41.444723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:41.444840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554728554548317:9622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:41.444848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554728554548317:9622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:41.444850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554728554548317:9622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:41.444854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:41.444982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:41.445073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:41.445080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:41.445086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:41.445112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:41.445137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554728479011111:8008]
2025-10-02T09:31:41.445469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:41.445629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:41.445652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:41.445821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:41.445847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.445852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.445852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.445853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.445853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.445854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.445854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.445855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.445855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.445856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.445856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.445857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.445859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.445865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.445867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.445869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.445871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.445873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.445875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.445877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.445879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.445881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.445883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.445885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.445889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.445893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.445896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.445899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.445901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.445904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.445906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.445909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.445911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.445914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.445916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.445918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.445920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.445923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.445925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.445928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.445930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.445934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.445935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.445938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.445940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.445942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.445946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.445949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.445965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:41.453284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:41.454799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:41.454809Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:41.454810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:41.454812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:41.454815Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1219 [2:7556554728479011111:8008]
2025-10-02T09:31:41.454822Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:41.454831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:41.454832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.454834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.454835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.454843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:41.454845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:41.454849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:41.454887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.454888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.454889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.454891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:41.454892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:41.454928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:41.454933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.454939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.454944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.454952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:41.454964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548150:2446], now have 1 active actors on pipe
2025-10-02T09:31:41.454967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548447:9622], now have 1 active actors on pipe
2025-10-02T09:31:41.454971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.454972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.454973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.454980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:41.454987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:41.454992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:41.454994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:41.454994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:41.454995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:41.454996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:41.455011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.455014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:41.455016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:41.455012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1219
2025-10-02T09:31:41.455040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.455047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.455059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:41.455052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1219
2025-10-02T09:31:41.455063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.455065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.455066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:41.455071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.455075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:41.455084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.455196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.455206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.455222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.455278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1220 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0
2025-10-02T09:31:41.455467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa7cfbe-579ee04a-114e35b3-db9b6b70_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:41.457737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Write session: try to update token
2025-10-02T09:31:41.457747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:41.464245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:41.464264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.464270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.464303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:41.464313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:41.464449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:41.464584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:41.464709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:41.464851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:41.465031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:41.465060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:41.467696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId: src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:41.469589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:41.469807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.469821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.469844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:41.469895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:41.472435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:41.472446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.472448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:41.472449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:41.472453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.472456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.472460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554728479011105:8008]
2025-10-02T09:31:41.472480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:41.472484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.472484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:41.472485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:41.472488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:41.472490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:41.472592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.528082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554548463:9526]
2025-10-02T09:31:41.528261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1219, pipe: [1:7556554728554548463:9526]
2025-10-02T09:31:41.583168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:41.589162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.589181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.589306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.589354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.589407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.589457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.589495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.589502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.589551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.589597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.589648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.589699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.589734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.589739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.589789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.589836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.589884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.589932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.589968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.589972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.590022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.590068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.590114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.590162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.590197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.590201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.590251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.590297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.590345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.590392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.590443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.590448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.590498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.590544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.590594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.590641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.590674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.590679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.590725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.590771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.590818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.590876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.590911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.590917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.590964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.591009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.591056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.591101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.591134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.591139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.591186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.591230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.591274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.591319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.591352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.591356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.591401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:41.591444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:41.591488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:41.591532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:41.591565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:41.591569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:41.591600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548463:9526], now have 1 active actors on pipe
2025-10-02T09:31:41.591796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:41.591815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554548463:9526]
2025-10-02T09:31:41.591835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:41.591837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:41.591863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1220 reason: error at write: Disconnected sessionId: src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0
2025-10-02T09:31:41.592008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1220 sessionId: src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0 is DEAD
2025-10-02T09:31:41.592124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:41.592132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Write session will restart in 0.005974s
2025-10-02T09:31:41.592147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Write session: Do CDS request
2025-10-02T09:31:41.592151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:41.592277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:41.599140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.599211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:41.599220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1221
2025-10-02T09:31:41.599314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.599344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:41.599350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:41.599353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:41.599663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1221 sessionId:  describe result for acl check
2025-10-02T09:31:41.599686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:41.599691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:41.599692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:41.599695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554728554548537:9628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:41.600038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554728554548537:9628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:41.602404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554728554548537:9628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:41.604365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554728554548537:9628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:41.604375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554728554548537:9628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:41.604377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554728554548537:9628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:41.604390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:41.608747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:41.609040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:41.609132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:41.609138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:41.609143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:41.609168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:41.609193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554728479011411:8010]
2025-10-02T09:31:41.609533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:41.609690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:41.609713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:41.609888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:41.609916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.609920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.609920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.609921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.609921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.609922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.609922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.609923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.609923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.609924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.609924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.609925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.609928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.609934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.609936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.609938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.609940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.609942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.609944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.609947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.609949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.609951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.609953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.609955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.609958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.609962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.609966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.609969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.609971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.609974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.609976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.609979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.609981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.609984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.609986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.609988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.609990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.609993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.609996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.609998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.610001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.610003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.610006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.610008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.610010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.610013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.610015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.610018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.610034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:41.617540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:41.618946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:41.618956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:41.618957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:41.618959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:41.618963Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1220 [2:7556554728479011411:8010]
2025-10-02T09:31:41.618970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:41.618979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:41.618981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.618982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.618983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.618993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:41.618995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:41.618999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:41.619030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.619031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.619032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.619034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:41.619035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:41.619071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:41.619076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.619082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.619087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.619095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:41.619106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548741:9628], now have 1 active actors on pipe
2025-10-02T09:31:41.619108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548464:2446], now have 1 active actors on pipe
2025-10-02T09:31:41.619111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.619113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.619114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.619121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:41.619128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:41.619133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:41.619135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:41.619135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:41.619136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:41.619136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:41.619150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.619157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:41.619161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:41.619156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1220
2025-10-02T09:31:41.619157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1220
2025-10-02T09:31:41.619178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.619183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.619196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48f557e1-45724e26-10c70892-5523f7de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:41.619199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.619202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.619203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:41.619208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.619213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:41.619221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.619311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.619317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.619326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.619375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1221 partition: 0 MaxSeqNo: 36 sessionId: src_id|48f557e1-45724e26-10c70892-5523f7de_0
2025-10-02T09:31:41.619580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5417eda-1e0092bf-cab4d0b8-443535dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48f557e1-45724e26-10c70892-5523f7de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:41.621823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Write session: try to update token
2025-10-02T09:31:41.621834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:41.628278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:41.628293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.628294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:41.628296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:41.628301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.628303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.628307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554728479011406:8010]
2025-10-02T09:31:41.628330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:41.628334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.628335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:41.628337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:41.628340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:41.628343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:41.628484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.632208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId: src_id|48f557e1-45724e26-10c70892-5523f7de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:41.634150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:41.691918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554548795:9526]
2025-10-02T09:31:41.692065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1220, pipe: [1:7556554728554548795:9526]
2025-10-02T09:31:41.741502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:41.741746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.741756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.741784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548795:9526], now have 1 active actors on pipe
2025-10-02T09:31:41.741937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:41.741941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554548795:9526]
2025-10-02T09:31:41.741959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:41.741961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:41.741962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:41.742005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1221 reason: error at write: Disconnected sessionId: src_id|48f557e1-45724e26-10c70892-5523f7de_0
2025-10-02T09:31:41.742153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1221 sessionId: src_id|48f557e1-45724e26-10c70892-5523f7de_0 is DEAD
2025-10-02T09:31:41.742278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:41.742286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Write session will restart in 0.009878s
2025-10-02T09:31:41.742326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Write session: Do CDS request
2025-10-02T09:31:41.742332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:41.753129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.753454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:41.753463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1222
2025-10-02T09:31:41.753549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.753571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:41.753577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:41.753580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:41.753877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1222 sessionId:  describe result for acl check
2025-10-02T09:31:41.753902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:41.753908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:41.753909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:41.753914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554728554548968:9639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:41.754276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554728554548968:9639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:41.756163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554728554548968:9639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:41.760235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:41.760330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554728554548968:9639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:41.760339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554728554548968:9639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:41.760341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554728554548968:9639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:41.760345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:41.760503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:41.760673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:41.760680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:41.760687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:41.760718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:41.760739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554728479011760:8025]
2025-10-02T09:31:41.761093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:41.761264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:41.761287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:41.761461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:41.761490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.761491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.761491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.761492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.761492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.761493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.761493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.761494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.761494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.761495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.761495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.761496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.761499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.761505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.761507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.761509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.761510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.761512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.761514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.761516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.761518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.761520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.761522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.761524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.761527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.761532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.761535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.761538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.761541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.761543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.761545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.761548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.761550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.761552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.761555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.761557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.761559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.761562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.761564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.761567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.761569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.761571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.761573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.761577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.761579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.761581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.761583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.761586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.761602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:41.768882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:41.770253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:41.770264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:41.770265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:41.770267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:41.770270Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1221 [2:7556554728479011760:8025]
2025-10-02T09:31:41.770277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:41.770287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:41.770288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.770290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.770291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.770299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:41.770303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:41.770307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:41.770336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.770337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.770338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.770340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:41.770341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:41.770378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:41.770384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.770390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.770395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.770403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:41.770415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554548796:2446], now have 1 active actors on pipe
2025-10-02T09:31:41.770423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554549094:9639], now have 1 active actors on pipe
2025-10-02T09:31:41.770427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.770428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.770429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.770436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:41.770444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:41.770451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:41.770453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:41.770439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1221
2025-10-02T09:31:41.770448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1221
2025-10-02T09:31:41.770457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:41.770465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:41.770467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:41.770477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.770479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.770486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.770493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:41.770505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:41.770509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:41.770512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.770515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.770516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:41.770521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.770526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:41.770538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.770622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.770627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.770634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.770679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1222 partition: 0 MaxSeqNo: 36 sessionId: src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0
2025-10-02T09:31:41.770876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f557e1-45724e26-10c70892-5523f7de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:41.773129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Write session: try to update token
2025-10-02T09:31:41.773138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:41.779660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:41.779674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.779675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:41.779676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:41.779681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.779684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.779686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554728479011754:8025]
2025-10-02T09:31:41.779707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:41.779710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.779711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:41.779712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:41.779715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:41.779717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:41.779822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.783548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId: src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:41.785477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:41.841945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554549122:9526]
2025-10-02T09:31:41.842101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1221, pipe: [1:7556554728554549122:9526]
2025-10-02T09:31:41.893167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:41.893366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.893374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.893400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554549122:9526], now have 1 active actors on pipe
2025-10-02T09:31:41.893538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:41.893573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554549122:9526]
2025-10-02T09:31:41.893582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:41.893598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:41.893659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1222 reason: status is not ok: tablet will be restarted right now sessionId: src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0
2025-10-02T09:31:41.893793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1222 sessionId: src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0 is DEAD
2025-10-02T09:31:41.893911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:41.893920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Write session will restart in 0.009638s
2025-10-02T09:31:41.893936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Write session: Do CDS request
2025-10-02T09:31:41.893940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:41.904137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.904316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:41.904328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1223
2025-10-02T09:31:41.904399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:41.904420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:41.904426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:41.904429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:41.904750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1223 sessionId:  describe result for acl check
2025-10-02T09:31:41.904776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:41.904781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:41.904782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:41.904785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554728554549287:9645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:41.905182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554728554549287:9645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:41.907211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554728554549287:9645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:41.911199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:41.911241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554728554549287:9645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:41.911249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554728554549287:9645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:41.911251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554728554549287:9645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:41.911256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:41.911430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:41.911526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:41.911533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:41.911539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:41.911564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:41.911584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554728479012062:8027]
2025-10-02T09:31:41.911924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:41.912073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:41.912095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:41.912263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:41.912294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.912296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.912296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.912297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.912298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.912298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.912299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.912299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.912300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.912300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.912301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.912301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.912304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.912309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.912312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.912314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.912315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.912317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.912320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.912322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.912323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.912326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.912328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.912330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.912333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.912337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:41.912341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.912344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:41.912346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.912348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:41.912350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.912353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:41.912355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.912357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:41.912359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.912362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:41.912364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.912367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:41.912369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.912372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:41.912374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.912376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:41.912378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.912381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.912383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.912385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.912387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.912390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.912406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:41.919813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:41.921502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:41.921513Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:41.921514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:41.921516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:41.921520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1222 [2:7556554728479012062:8027]
2025-10-02T09:31:41.921526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:41.921537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:41.921538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.921540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.921541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.921549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:41.921553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:41.921557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:41.921587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.921588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.921589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.921590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:41.921591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:41.921628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:41.921631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.921638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:41.921643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:41.921651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:41.921664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554549127:2446], now have 1 active actors on pipe
2025-10-02T09:31:41.921670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554549426:9645], now have 1 active actors on pipe
2025-10-02T09:31:41.921673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.921674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.921675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.921682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:41.921690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:41.921694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:41.921696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:41.921697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:41.921698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:41.921699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:41.921713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.921717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:41.921718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:41.921718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1222
2025-10-02T09:31:41.921722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1222
2025-10-02T09:31:41.921738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.921743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.921757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:41.921762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:41.921764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:41.921765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:41.921770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:41.921776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:41.921782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.921864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:41.921870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:41.921879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:41.921931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1223 partition: 0 MaxSeqNo: 36 sessionId: src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0
2025-10-02T09:31:41.922111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793e4182-8fddc7cf-e436e2ee-8ac5f94c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:41.924377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Write session: try to update token
2025-10-02T09:31:41.924387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:41.931018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:41.931034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:41.931036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:41.931037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:41.931044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.931048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.931051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554728479012056:8027]
2025-10-02T09:31:41.931079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:41.931081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:41.931082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:41.931084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:41.931086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:41.931088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:41.931210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:41.934921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId: src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:41.936833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:41.993508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554728554549437:9526]
2025-10-02T09:31:41.993697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1222, pipe: [1:7556554728554549437:9526]
2025-10-02T09:31:42.044080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.044297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.044305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.044332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554728554549437:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.044477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.044516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554728554549437:9526]
2025-10-02T09:31:42.044535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.044537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:42.044592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1223 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0
2025-10-02T09:31:42.044729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1223 sessionId: src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0 is DEAD
2025-10-02T09:31:42.044857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:42.044866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Write session will restart in 0.008787s
2025-10-02T09:31:42.044883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Write session: Do CDS request
2025-10-02T09:31:42.044889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.054109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.054188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.054194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1224
2025-10-02T09:31:42.054281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.054301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.054304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.054310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.054626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1224 sessionId:  describe result for acl check
2025-10-02T09:31:42.054653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.054659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.054660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.054664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849516856:9649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.055045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849516856:9649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.056530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849516856:9649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.058498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849516856:9649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.058506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849516856:9649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.058508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849516856:9649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.058512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.062323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.062583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.062683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.062690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.062696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.062721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.062743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773979663:8030]
2025-10-02T09:31:42.063091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.063240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.063263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.063431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.063461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.063465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.063466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.063466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.063467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.063467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.063468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.063468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.063468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.063469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.063469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.063470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.063473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.063479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.063481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.063483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.063485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.063487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.063489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.063491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.063493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.063495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.063497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.063498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.063502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.063506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.063510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.063512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.063515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.063517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.063520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.063523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.063525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.063528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.063530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.063532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.063534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.063537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.063539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.063541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.063544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.063546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.063548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.063551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.063553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.063556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.063558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.063560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.063578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.070973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.072538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.072549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.072550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.072552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.072555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1223 [2:7556554732773979663:8030]
2025-10-02T09:31:42.072562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.072572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.072574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.072575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.072576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.072585Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.072588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.072592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.072622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.072623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.072624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.072626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.072627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.072662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.072664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.072670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.072675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.072688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.072699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849516735:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.072703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517032:9649], now have 1 active actors on pipe
2025-10-02T09:31:42.072706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.072708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.072709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.072718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.072725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.072729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.072731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.072733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.072736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.072737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.072752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.072753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.072755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.072776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1223
2025-10-02T09:31:42.072784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1223
2025-10-02T09:31:42.072794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.072812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.072826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49302e65-c07f4937-88f682f8-898133d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.072830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.072831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.072833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.072838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.072843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.072850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.072940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.072944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.072952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.073005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1224 partition: 0 MaxSeqNo: 36 sessionId: src_id|49302e65-c07f4937-88f682f8-898133d7_0
2025-10-02T09:31:42.073228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2076cf0a-6dc51dc7-babf3d05-f945d62f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49302e65-c07f4937-88f682f8-898133d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.075465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Write session: try to update token
2025-10-02T09:31:42.075474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.082341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.082359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.082361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.082362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.082368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.082372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.082375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773979658:8030]
2025-10-02T09:31:42.082400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.082403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.082405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.082405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.082409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.082412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.082545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.085894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId: src_id|49302e65-c07f4937-88f682f8-898133d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.087820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:42.144554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554732849517046:9526]
2025-10-02T09:31:42.144821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1223, pipe: [1:7556554732849517046:9526]
2025-10-02T09:31:42.195078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.195553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.195563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.195589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517046:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.195727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.195752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554732849517046:9526]
2025-10-02T09:31:42.195768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.195774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:42.195827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49302e65-c07f4937-88f682f8-898133d7_0
2025-10-02T09:31:42.195960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1224 sessionId: src_id|49302e65-c07f4937-88f682f8-898133d7_0 is DEAD
2025-10-02T09:31:42.196094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:42.196102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Write session will restart in 0.008769s
2025-10-02T09:31:42.196117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Write session: Do CDS request
2025-10-02T09:31:42.196121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.206139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.206218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.206228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1225
2025-10-02T09:31:42.206307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.206326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.206333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.206335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.206670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1225 sessionId:  describe result for acl check
2025-10-02T09:31:42.206696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.206701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.206702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.206705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849517202:9654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.207082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849517202:9654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.208903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849517202:9654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.210699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.213499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.213562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849517202:9654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.213571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849517202:9654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.213574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849517202:9654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.213578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.213931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.213939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.213945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.213995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.214016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773979976:8032]
2025-10-02T09:31:42.214362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.214516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.214541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.214714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.214740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.214744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.214744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.214745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.214746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.214746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.214747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.214747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.214748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.214748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.214749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.214749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.214752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.214758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.214760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.214762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.214764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.214766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.214768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.214770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.214772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.214774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.214776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.214778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.214782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.214785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.214789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.214791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.214794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.214796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.214798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.214801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.214803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.214806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.214808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.214811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.214813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.214816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.214818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.214820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.214824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.214827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.214829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.214831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.214833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.214835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.214837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.214840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.214863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.222171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.223498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.223508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.223509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.223511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.223515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1224 [2:7556554732773979976:8032]
2025-10-02T09:31:42.223522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.223532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.223533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.223535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.223536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.223545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.223548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.223552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.223582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.223583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.223584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.223585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.223587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.223622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.223628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.223634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.223639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.223647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.223658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517050:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.223661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517352:9654], now have 1 active actors on pipe
2025-10-02T09:31:42.223664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.223665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.223666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.223673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.223680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.223687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.223688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.223688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.223690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.223691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.223702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.223703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.223714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.223703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1224
2025-10-02T09:31:42.223707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1224
2025-10-02T09:31:42.223725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.223731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.223744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.223748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.223750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.223752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.223756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.223761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.223769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.223857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.223864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.223874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.223926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1225 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0
2025-10-02T09:31:42.224137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49302e65-c07f4937-88f682f8-898133d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.226456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Write session: try to update token
2025-10-02T09:31:42.226467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.232728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:42.232744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.232751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.232779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:42.232781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:42.232946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:42.233142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:42.233274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:42.233404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:42.233576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:42.233607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:42.236949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId: src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.238839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:42.238969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.238983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.239005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:42.239059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:42.241133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.241144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.241145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.241147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.241151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.241154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.241156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773979961:8032]
2025-10-02T09:31:42.241175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.241178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.241179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.241180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.241182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.241186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.241286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.296094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554732849517365:9526]
2025-10-02T09:31:42.296263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1224, pipe: [1:7556554732849517365:9526]
2025-10-02T09:31:42.352047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.358273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.358294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.358418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.358464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.358516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.358566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.358604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.358610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.358661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.358707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.358759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.358808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.358844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.358849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.358909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.358955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.359006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.359055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.359091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.359096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.359146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.359195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.359242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.359292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.359326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.359331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.359381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.359427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.359475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.359521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.359557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.359561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.359609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.359654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.359700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.359746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.359781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.359786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.359831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.359874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.359923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.359971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.360005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.360010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.360057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.360102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.360146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.360197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.360235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.360239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.360286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.360331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.360378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.360424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.360525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.360530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.360576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:42.360619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:42.360662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:42.360706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:42.360817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:42.360822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:42.360851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517365:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.361014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.361042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554732849517365:9526]
2025-10-02T09:31:42.361053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:42.361058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:42.361078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1225 reason: error at write: Disconnected sessionId: src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0
2025-10-02T09:31:42.361215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1225 sessionId: src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0 is DEAD
2025-10-02T09:31:42.361356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:42.361366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Write session will restart in 0.009712s
2025-10-02T09:31:42.361383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Write session: Do CDS request
2025-10-02T09:31:42.361387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.361461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.366241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.367388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.367486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.367492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.367497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.367523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.367547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773980033:8035]
2025-10-02T09:31:42.367888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.368048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.368070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.368247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.368277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.368281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.368281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.368282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.368282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.368283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.368284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.368284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.368285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.368285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.368286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.368286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.368289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.368295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.368297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.368300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.368301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.368304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.368306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.368308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.368309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.368312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.368313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.368315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.368319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.368323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.368326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.368329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.368335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.368338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.368340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.368344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.368349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.368352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.368354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.368356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.368360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.368362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.368364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.368367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.368369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.368371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.368376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.368379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.368381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.368384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.368385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.368388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.368408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.372159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.372202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.372214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1226
2025-10-02T09:31:42.372290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.372308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.372314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.372317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.372576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1226 sessionId:  describe result for acl check
2025-10-02T09:31:42.372601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.372605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.372606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.372609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849517391:9658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.372962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849517391:9658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.374712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849517391:9658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.375762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.376284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849517391:9658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.376292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849517391:9658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.376294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849517391:9658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.376299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.377101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.377113Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.377115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.377117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.377122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1225 [2:7556554732773980033:8035]
2025-10-02T09:31:42.377129Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.377138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.377144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.377145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.377147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.377157Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.377164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.377168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.377195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.377200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.377201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.377202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.377203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.377239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.377244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.377250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.377255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.377266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.377279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517426:9658], now have 1 active actors on pipe
2025-10-02T09:31:42.377284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517367:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.377287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.377288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.377289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.377296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.377307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.377307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.377309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.377310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.377316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.377318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.377306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1225
2025-10-02T09:31:42.377309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1225
2025-10-02T09:31:42.377332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.377336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.377338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.377348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.377352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.377375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3df326bd-3f76971f-513db7df-614bb881_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.377382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.377385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.377389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.377394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.377402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.377414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.377501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.377506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.377513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.377566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1226 partition: 0 MaxSeqNo: 36 sessionId: src_id|3df326bd-3f76971f-513db7df-614bb881_0
2025-10-02T09:31:42.377727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e0126c-acb2ca72-f271c311-6f8be109_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3df326bd-3f76971f-513db7df-614bb881_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.379934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Write session: try to update token
2025-10-02T09:31:42.379948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.386601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.386617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.386619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.386621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.386628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.386633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.386639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773980028:8035]
2025-10-02T09:31:42.386666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.386668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.386672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.386674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.386675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.386676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.386789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.390384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId: src_id|3df326bd-3f76971f-513db7df-614bb881_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.392295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:42.460959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554732849517433:9526]
2025-10-02T09:31:42.461153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1225, pipe: [1:7556554732849517433:9526]
2025-10-02T09:31:42.498095Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.498383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.498392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.498418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517433:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.498555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.498598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:42.498609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:42.498623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.498657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1226 reason: error at write: Disconnected sessionId: src_id|3df326bd-3f76971f-513db7df-614bb881_0
2025-10-02T09:31:42.498702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554732849517433:9526]
2025-10-02T09:31:42.498783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1226 sessionId: src_id|3df326bd-3f76971f-513db7df-614bb881_0 is DEAD
2025-10-02T09:31:42.498911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:42.498920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Write session will restart in 0.007402s
2025-10-02T09:31:42.498934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Write session: Do CDS request
2025-10-02T09:31:42.498938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.503277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.504298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.504396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.504404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.504410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.504435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.504456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773980091:8037]
2025-10-02T09:31:42.505076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.505247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.505269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.505539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.505569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.505573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.505575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.505575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.505576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.505577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.505577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.505578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.505579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.505579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.505580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.505580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.505583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.505590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.505592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.505594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.505596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.505598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.505600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.505602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.505605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.505607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.505609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.505611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.505615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.505619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.505622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.505625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.505627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.505630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.505632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.505634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.505637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.505641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.505644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.505647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.505650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.505652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.505654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.505657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.505659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.505662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.505664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.505667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.505669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.505672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.505674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.505677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.505694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.507102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.507193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.507202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1227
2025-10-02T09:31:42.507287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.507306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.507312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.507315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.507575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1227 sessionId:  describe result for acl check
2025-10-02T09:31:42.507597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.507602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.507603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.507606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849517458:9662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.507948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849517458:9662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.509427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849517458:9662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.512458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849517458:9662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.512466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849517458:9662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.512468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849517458:9662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.512471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.513029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.514283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.514295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.514296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.514298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.514301Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1226 [2:7556554732773980091:8037]
2025-10-02T09:31:42.514309Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.514318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.514319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.514325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.514326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.514336Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.514338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.514343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.514372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.514374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.514375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.514377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.514378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.514415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.514420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.514426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.514431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.514439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.514450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517434:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.514454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517493:9662], now have 1 active actors on pipe
2025-10-02T09:31:42.514458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.514459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.514460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.514468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.514476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.514480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.514476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1226
2025-10-02T09:31:42.514481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1226
2025-10-02T09:31:42.514482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.514483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.514486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.514487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.514501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.514502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.514504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.514514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.514515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.514540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75e67407-de460456-17f73217-f170ca14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.514547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.514549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.514551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.514556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.514561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.514570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.514656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.514661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.514668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.514705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1227 partition: 0 MaxSeqNo: 36 sessionId: src_id|75e67407-de460456-17f73217-f170ca14_0
2025-10-02T09:31:42.514895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df326bd-3f76971f-513db7df-614bb881_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75e67407-de460456-17f73217-f170ca14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.517171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Write session: try to update token
2025-10-02T09:31:42.517182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.523842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.523859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.523861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.523863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.523871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.523875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.523878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773980086:8037]
2025-10-02T09:31:42.523907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.523910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.523912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.523913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.523915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.523915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.524044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.527524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId: src_id|75e67407-de460456-17f73217-f170ca14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.529510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:42.598687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554732849517501:9526]
2025-10-02T09:31:42.598867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1226, pipe: [1:7556554732849517501:9526]
2025-10-02T09:31:42.634185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.634384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.634392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.634418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517501:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.634551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.634576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554732849517501:9526]
2025-10-02T09:31:42.634597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.634600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:42.634652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75e67407-de460456-17f73217-f170ca14_0
2025-10-02T09:31:42.634796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1227 sessionId: src_id|75e67407-de460456-17f73217-f170ca14_0 is DEAD
2025-10-02T09:31:42.634924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:42.634933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Write session will restart in 0.006878s
2025-10-02T09:31:42.634949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Write session: Do CDS request
2025-10-02T09:31:42.634953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.639472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.640443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.640543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.640550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.640556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.640583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.640607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773980150:8039]
2025-10-02T09:31:42.640967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.641161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.641183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.641364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.641395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.641399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.641400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.641400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.641401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.641401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.641402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.641402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.641403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.641403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.641404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.641405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.641408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.641415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.641417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.641419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.641421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.641423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.641425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.641427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.641430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.641434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.641436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.641438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.641442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.641446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.641450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.641453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.641454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.641457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.641459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.641462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.641464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.641467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.641469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.641472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.641475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.641478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.641480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.641482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.641485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.641488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.641489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.641492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.641496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.641498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.641501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.641504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.641522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.643164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.643295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.643306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1228
2025-10-02T09:31:42.643385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.643404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.643410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.643413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.643694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1228 sessionId:  describe result for acl check
2025-10-02T09:31:42.643720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.643725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.643726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.643729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849517527:9666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.644079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849517527:9666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.645625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849517527:9666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.648346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849517527:9666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.648353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849517527:9666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.648355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849517527:9666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.648359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.648926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.650209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.650221Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.650224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.650229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.650233Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1227 [2:7556554732773980150:8039]
2025-10-02T09:31:42.650240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.650251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.650252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.650254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.650255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.650265Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.650268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.650272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.650303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.650305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.650306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.650307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.650308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.650346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.650351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.650357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.650363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.650370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.650381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517562:9666], now have 1 active actors on pipe
2025-10-02T09:31:42.650384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517502:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.650387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.650388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.650390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.650398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.650406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.650411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.650413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.650414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.650416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1227
2025-10-02T09:31:42.650420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.650420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1227
2025-10-02T09:31:42.650421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.650429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.650431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.650440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.650448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.650453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.650470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f830cdcd-e0e69506-aa679524-24dd3def_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.650480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.650482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.650483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.650488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.650493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.650503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.650599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.650604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.650611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.650668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1228 partition: 0 MaxSeqNo: 36 sessionId: src_id|f830cdcd-e0e69506-aa679524-24dd3def_0
2025-10-02T09:31:42.650848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e67407-de460456-17f73217-f170ca14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f830cdcd-e0e69506-aa679524-24dd3def_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.653076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Write session: try to update token
2025-10-02T09:31:42.653086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.660065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.660087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.660089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.660092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.660099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.660104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.660107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773980145:8039]
2025-10-02T09:31:42.660144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.660154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.660155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.660158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.660161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.660164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.660326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.664350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId: src_id|f830cdcd-e0e69506-aa679524-24dd3def_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.666356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:42.734878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554732849517592:9526]
2025-10-02T09:31:42.735034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1227, pipe: [1:7556554732849517592:9526]
2025-10-02T09:31:42.771987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.772183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.772194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.772218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517592:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.772336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.772631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:42.772640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Write session will restart in 0.005909s
2025-10-02T09:31:42.772655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Write session: Do CDS request
2025-10-02T09:31:42.772329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.772659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.772346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:42.772348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:42.772358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554732849517592:9526]
2025-10-02T09:31:42.772387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1228 reason: error at write: Disconnected sessionId: src_id|f830cdcd-e0e69506-aa679524-24dd3def_0
2025-10-02T09:31:42.772516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1228 sessionId: src_id|f830cdcd-e0e69506-aa679524-24dd3def_0 is DEAD
2025-10-02T09:31:42.777041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.778010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.778113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.778121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.778126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.778154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.778176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773980258:8054]
2025-10-02T09:31:42.778509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.778667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.778690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.778869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.778897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.778901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.778901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.778902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.778902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.778904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.778904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.778905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.778905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.778906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.778907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.778907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.778910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.778917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.778919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.778922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.778924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.778926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.778928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.778930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.778932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.778935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.778937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.778939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.778942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.778947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.778950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.778953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.778955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.778958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.778960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.778963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.778966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.778968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.778970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.778973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.778975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.778978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.778980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.778984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.778986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.778989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.778991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.778994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.778996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.778999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.779001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.779004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.779020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.779119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.779178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.779185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1229
2025-10-02T09:31:42.779262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.779280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.779286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.779288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.779530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1229 sessionId:  describe result for acl check
2025-10-02T09:31:42.779551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.779555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.779556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.779559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849517631:9678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.779853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849517631:9678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.781165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849517631:9678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.785177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849517631:9678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.785185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849517631:9678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.785187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849517631:9678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.785191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.786321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.787977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.787988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.787989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.787991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.787994Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1228 [2:7556554732773980258:8054]
2025-10-02T09:31:42.788001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.788011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.788012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.788013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.788014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.788023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.788025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.788029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.788059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.788062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.788065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.788066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.788068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.788103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.788107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.788114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.788120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.788127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.788138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517666:9678], now have 1 active actors on pipe
2025-10-02T09:31:42.788143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517605:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.788146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.788147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.788149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.788156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.788163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.788168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.788170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.788164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1228
2025-10-02T09:31:42.788181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1228
2025-10-02T09:31:42.788171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.788173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.788174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.788188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.788190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.788191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.788199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.788200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.788222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3501f171-1837336a-43c053ca-a8cd8962_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.788229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.788231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.788233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.788239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.788244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.788253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.788346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.788351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.788359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.788409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1229 partition: 0 MaxSeqNo: 36 sessionId: src_id|3501f171-1837336a-43c053ca-a8cd8962_0
2025-10-02T09:31:42.788570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cdcd-e0e69506-aa679524-24dd3def_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3501f171-1837336a-43c053ca-a8cd8962_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.790720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Write session: try to update token
2025-10-02T09:31:42.790731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.797377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.797393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.797395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.797396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.797402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.797406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.797409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773980253:8054]
2025-10-02T09:31:42.797437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.797440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.797440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.797442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.797443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.797445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.797568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.800691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId: src_id|3501f171-1837336a-43c053ca-a8cd8962_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.802550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:42.872596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554732849517682:9526]
2025-10-02T09:31:42.872768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1228, pipe: [1:7556554732849517682:9526]
2025-10-02T09:31:42.908065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:42.908557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.908567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.908590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517682:9526], now have 1 active actors on pipe
2025-10-02T09:31:42.908708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:42.908740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554732849517682:9526]
2025-10-02T09:31:42.908759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:42.908760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:42.908829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3501f171-1837336a-43c053ca-a8cd8962_0
2025-10-02T09:31:42.908965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1229 sessionId: src_id|3501f171-1837336a-43c053ca-a8cd8962_0 is DEAD
2025-10-02T09:31:42.909076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:42.909085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Write session will restart in 0.009965s
2025-10-02T09:31:42.909097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Write session: Do CDS request
2025-10-02T09:31:42.909101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:42.913352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:42.914449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:42.914545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:42.914552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:42.914557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:42.914583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:42.914608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554732773980319:8056]
2025-10-02T09:31:42.914963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:42.915123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:42.915146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:42.915317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:42.915346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.915350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.915351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.915351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.915352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.915352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.915353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.915354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.915355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.915355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.915356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.915356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.915360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.915367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.915369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.915371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.915373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.915376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.915378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.915380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.915382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.915384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.915386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.915388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.915391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.915396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:42.915399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.915402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:42.915405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.915408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:42.915410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.915413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:42.915415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.915418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:42.915420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.915423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:42.915427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.915430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:42.915432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.915434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:42.915437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.915440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:42.915442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.915444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.915447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.915450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.915452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.915456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.915472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:42.920115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.920197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:42.920204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1230
2025-10-02T09:31:42.920274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:42.920292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:42.920298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:42.920300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:42.920555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1230 sessionId:  describe result for acl check
2025-10-02T09:31:42.920577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:42.920582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:42.920583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:42.920586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554732849517711:9683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:42.920938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554732849517711:9683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:42.922045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554732849517711:9683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:42.922747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:42.923664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554732849517711:9683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:42.923672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554732849517711:9683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:42.923674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554732849517711:9683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:42.923677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:42.924040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:42.924052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:42.924053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:42.924055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:42.924058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1229 [2:7556554732773980319:8056]
2025-10-02T09:31:42.924065Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:42.924075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:42.924077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.924078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.924079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.924088Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:42.924090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:42.924094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:42.924125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.924130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.924131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.924133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:42.924134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:42.924168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:42.924174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.924180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:42.924185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:42.924193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:42.924206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517683:2446], now have 1 active actors on pipe
2025-10-02T09:31:42.924210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554732849517745:9683], now have 1 active actors on pipe
2025-10-02T09:31:42.924213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.924214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.924216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.924223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:42.924230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:42.924235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:42.924237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:42.924233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1229
2025-10-02T09:31:42.924238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:42.924240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:42.924237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1229
2025-10-02T09:31:42.924242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:42.924256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.924257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:42.924258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:42.924269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.924273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.924297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aefd42de-47218753-c9ca3ab-7e38991c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:42.924304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:42.924306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:42.924308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:42.924315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:42.924320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:42.924329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.924419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:42.924423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:42.924430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:42.924502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1230 partition: 0 MaxSeqNo: 36 sessionId: src_id|aefd42de-47218753-c9ca3ab-7e38991c_0
2025-10-02T09:31:42.924658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3501f171-1837336a-43c053ca-a8cd8962_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aefd42de-47218753-c9ca3ab-7e38991c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:42.926815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Write session: try to update token
2025-10-02T09:31:42.926827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:42.933475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:42.933490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:42.933492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:42.933493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:42.933500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.933503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.933506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554732773980314:8056]
2025-10-02T09:31:42.933533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:42.933538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:42.933537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:42.933540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:42.933540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:42.933542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:42.933661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:42.937013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId: src_id|aefd42de-47218753-c9ca3ab-7e38991c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:42.938880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.008822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485048:9526]
2025-10-02T09:31:43.009056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1229, pipe: [1:7556554737144485048:9526]
2025-10-02T09:31:43.044533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.044812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.044821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.044844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485048:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.044978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.045062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.045078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485048:9526]
2025-10-02T09:31:43.045095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:43.045142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aefd42de-47218753-c9ca3ab-7e38991c_0
2025-10-02T09:31:43.045263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1230 sessionId: src_id|aefd42de-47218753-c9ca3ab-7e38991c_0 is DEAD
2025-10-02T09:31:43.045379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:43.045388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Write session will restart in 0.005288s
2025-10-02T09:31:43.045406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Write session: Do CDS request
2025-10-02T09:31:43.045410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.050191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.051145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.051226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.051234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1231
2025-10-02T09:31:43.051308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.051329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.051349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.051355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.051358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.051405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.051412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.051418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.051443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.051466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068947678:8059]
2025-10-02T09:31:43.051604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1231 sessionId:  describe result for acl check
2025-10-02T09:31:43.051624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.051628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.051629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.051631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485074:9687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.051836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.051975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485074:9687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.051987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.052009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.052179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.052209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.052213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.052214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.052216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.052216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.052217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.052217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.052218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.052218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.052219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.052220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.052220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.052223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.052228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.052230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.052232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.052234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.052236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.052238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.052240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.052242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.052244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.052247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.052249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.052253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.052256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.052259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.052262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.052264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.052266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.052268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.052271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.052273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.052276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.052280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.052282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.052287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.052289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.052291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.052294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.052296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.052299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.052300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.052303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.052305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.052308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.052310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.052312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.052329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.053186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485074:9687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.057533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485074:9687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.057542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485074:9687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.057544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485074:9687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.057547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.059659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.060953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.060963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.060967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.060969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.060973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1230 [2:7556554737068947678:8059]
2025-10-02T09:31:43.060980Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.060990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.060992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.060993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.060994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.061004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.061006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.061010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.061044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.061049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.061050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.061052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.061053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.061087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.061091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.061097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.061102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.061110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.061123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485050:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.061128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485113:9687], now have 1 active actors on pipe
2025-10-02T09:31:43.061131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.061133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.061134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.061142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.061149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.061153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.061155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.061156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.061158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.061160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.061173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.061158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1230
2025-10-02T09:31:43.061175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.061162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1230
2025-10-02T09:31:43.061176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.061191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.061196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.061213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.061220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.061223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.061224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.061229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.061234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.061246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.061353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.061363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.061378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.061432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1231 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0
2025-10-02T09:31:43.061625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefd42de-47218753-c9ca3ab-7e38991c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.063734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Write session: try to update token
2025-10-02T09:31:43.063742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.070308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.070330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.070332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.070333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.070340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.070344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.070346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068947672:8059]
2025-10-02T09:31:43.070372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.070374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.070377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.070377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.070379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.070380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.070484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.074084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId: src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.075995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.144996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485120:9526]
2025-10-02T09:31:43.145200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1230, pipe: [1:7556554737144485120:9526]
2025-10-02T09:31:43.182637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.182859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.182867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.182893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485120:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.183073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.183065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.183102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485120:9526]
2025-10-02T09:31:43.183108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:43.183111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:43.183159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1231 reason: error at write: Disconnected sessionId: src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0
2025-10-02T09:31:43.183293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1231 sessionId: src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0 is DEAD
2025-10-02T09:31:43.183467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:43.183479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Write session will restart in 0.006764s
2025-10-02T09:31:43.183499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Write session: Do CDS request
2025-10-02T09:31:43.183504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.187770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.188865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.188958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.188964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.188970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.188997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.189023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068947741:8061]
2025-10-02T09:31:43.189364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.189670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.189692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.189869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.189901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.189904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.189905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.189906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.189908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.189909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.189909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.189910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.189910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.189910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.189911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.189911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.189914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.189921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.189923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.189925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.189927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.189929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.189931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.189933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.189935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.189937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.189939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.189941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.189945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.189949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.189952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.189955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.189960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.189963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.189965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.189972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.189974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.189977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.189979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.189984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.189986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.189988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.189993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.189996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.189998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.190001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.190003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.190005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.190007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.190010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.190012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.190014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.190031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.191202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.191302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.191311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1232
2025-10-02T09:31:43.191389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.191408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.191413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.191416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.191684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1232 sessionId:  describe result for acl check
2025-10-02T09:31:43.191706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.191711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.191712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.191717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485150:9691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.192087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485150:9691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.193412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485150:9691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.196830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485150:9691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.196842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485150:9691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.196845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485150:9691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.196850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.197375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.198759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.198771Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.198772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.198775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.198778Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1231 [2:7556554737068947741:8061]
2025-10-02T09:31:43.198785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.198795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.198800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.198803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.198804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.198813Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.198820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.198825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.198865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.198870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.198871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.198872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.198874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.198912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.198917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.198923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.198928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.198939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.198953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485187:9691], now have 1 active actors on pipe
2025-10-02T09:31:43.198959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485122:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.198962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.198963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.198964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.198973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.198983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.198984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.198988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.198989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.198993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.198994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.198984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1231
2025-10-02T09:31:43.199007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.199012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.199013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.198985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1231
2025-10-02T09:31:43.199027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.199034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.199067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60cd2321-5cd40182-a94ef686-d0460350_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.199074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.199077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.199081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.199086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.199094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.199106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.199186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.199191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.199198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.199239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1232 partition: 0 MaxSeqNo: 36 sessionId: src_id|60cd2321-5cd40182-a94ef686-d0460350_0
2025-10-02T09:31:43.199461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d19f8a2-2f80b7cc-82ff4bbf-c81bac03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60cd2321-5cd40182-a94ef686-d0460350_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.201859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Write session: try to update token
2025-10-02T09:31:43.201876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.208348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.208364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.208366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.208367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.208373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.208377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.208382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068947736:8061]
2025-10-02T09:31:43.208411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.208415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.208419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.208421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.208421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.208423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.208537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.213651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId: src_id|60cd2321-5cd40182-a94ef686-d0460350_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.215575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.283237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485194:9526]
2025-10-02T09:31:43.283415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1231, pipe: [1:7556554737144485194:9526]
2025-10-02T09:31:43.319431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.319649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.319659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.319685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485194:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.319824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.319823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.319856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485194:9526]
2025-10-02T09:31:43.319856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:43.319859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:43.319915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1232 reason: error at write: Disconnected sessionId: src_id|60cd2321-5cd40182-a94ef686-d0460350_0
2025-10-02T09:31:43.320193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:43.320202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Write session will restart in 0.005995s
2025-10-02T09:31:43.320217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Write session: Do CDS request
2025-10-02T09:31:43.320222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.320056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1232 sessionId: src_id|60cd2321-5cd40182-a94ef686-d0460350_0 is DEAD
2025-10-02T09:31:43.324627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.325688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.325787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.325794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.325800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.325824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.325850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068947807:8064]
2025-10-02T09:31:43.326193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.326354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.326376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.326554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.326584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.326588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.326589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.326591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.326592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.326592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.326592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.326593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.326593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.326594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.326595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.326595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.326598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.326605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.326607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.326609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.326611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.326613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.326615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.326617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.326619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.326622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.326624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.326626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.326629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.326634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.326636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.326640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.326642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.326644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.326646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.326649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.326651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.326654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.326657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.326660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.326662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.326665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.326667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.326669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.326671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.326674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.326676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.326679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.326681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.326684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.326686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.326689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.326705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.327105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.327176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.327183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1233
2025-10-02T09:31:43.327256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.327275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.327281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.327285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.327530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1233 sessionId:  describe result for acl check
2025-10-02T09:31:43.327551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.327552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.327553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.327556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485225:9696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.327886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485225:9696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.329138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485225:9696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.332998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485225:9696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.333007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485225:9696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.333009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485225:9696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.333013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.334230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.335548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.335560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.335561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.335563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.335567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1232 [2:7556554737068947807:8064]
2025-10-02T09:31:43.335574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.335585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.335586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.335587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.335589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.335599Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.335606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.335610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.335642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.335646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.335647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.335649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.335650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.335686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.335691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.335698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.335703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.335716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.335727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485195:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.335733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485260:9696], now have 1 active actors on pipe
2025-10-02T09:31:43.335737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.335738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.335739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.335729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1232
2025-10-02T09:31:43.335744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.335738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1232
2025-10-02T09:31:43.335751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.335757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.335758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.335759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.335760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.335760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.335783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.335789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.335796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.335804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.335816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.335821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.335824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.335826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.335827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.335833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.335838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.335855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.335944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.335949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.335957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.335998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1233 partition: 0 MaxSeqNo: 36 sessionId: src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0
2025-10-02T09:31:43.336178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd2321-5cd40182-a94ef686-d0460350_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.338317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Write session: try to update token
2025-10-02T09:31:43.338326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.345312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.345330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.345332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.345333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.345340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.345343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.345347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068947802:8064]
2025-10-02T09:31:43.345378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.345385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.345387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.345388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.345389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.345391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.345513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.348384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId: src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.350315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.419938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485268:9526]
2025-10-02T09:31:43.420141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1232, pipe: [1:7556554737144485268:9526]
2025-10-02T09:31:43.456334Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.456593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.456602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.456627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485268:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.456746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.456755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:43.456767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:43.456789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.456825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1233 reason: error at write: Disconnected sessionId: src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0
2025-10-02T09:31:43.456836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485268:9526]
2025-10-02T09:31:43.456954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1233 sessionId: src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0 is DEAD
2025-10-02T09:31:43.457079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:43.457088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Write session will restart in 0.008507s
2025-10-02T09:31:43.457106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Write session: Do CDS request
2025-10-02T09:31:43.457110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.462090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.463234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.463336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.463343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.463349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.463375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.463398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068947872:8066]
2025-10-02T09:31:43.463731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.463888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.463913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.464100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.464132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.464136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.464137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.464137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.464138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.464139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.464139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.464140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.464140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.464141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.464142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.464142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.464145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.464151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.464154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.464156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.464158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.464160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.464162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.464163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.464165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.464168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.464170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.464172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.464175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.464179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.464182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.464185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.464188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.464192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.464194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.464197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.464203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.464206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.464211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.464214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.464216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.464218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.464220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.464223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.464225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.464227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.464229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.464232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.464234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.464236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.464238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.464241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.464257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.466107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.466166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.466174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1234
2025-10-02T09:31:43.466260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.466278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.466284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.466286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.466524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1234 sessionId:  describe result for acl check
2025-10-02T09:31:43.466551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.466557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.466558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.466561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485300:9700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.466904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485300:9700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.468425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485300:9700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.471029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485300:9700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.471039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485300:9700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.471044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485300:9700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.471063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.471575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.472905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.472918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.472919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.472921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.472924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1233 [2:7556554737068947872:8066]
2025-10-02T09:31:43.472932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.472943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.472944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.472946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.472947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.472958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.472963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.472967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.472995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.473000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.473001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.473002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.473004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.473042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.473047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.473053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.473061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.473072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.473086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485335:9700], now have 1 active actors on pipe
2025-10-02T09:31:43.473091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485269:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.473095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.473096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.473098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.473107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.473108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1233
2025-10-02T09:31:43.473117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.473115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1233
2025-10-02T09:31:43.473121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.473123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.473124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.473127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.473128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.473149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.473154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.473161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.473168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.473176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.473189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65d451a8-993b7e39-ad2043bc-860cd461_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.473196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.473198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.473199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.473203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.473212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.473225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.473313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.473318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.473325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.473369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1234 partition: 0 MaxSeqNo: 36 sessionId: src_id|65d451a8-993b7e39-ad2043bc-860cd461_0
2025-10-02T09:31:43.473528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31237962-1ca59c58-d2e883d8-78a6a9f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65d451a8-993b7e39-ad2043bc-860cd461_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.475637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Write session: try to update token
2025-10-02T09:31:43.475645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.482371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.482388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.482390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.482392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.482399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.482403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.482406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068947867:8066]
2025-10-02T09:31:43.482433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.482436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.482440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.482442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.482443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.482446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.482563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.485780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId: src_id|65d451a8-993b7e39-ad2043bc-860cd461_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.487674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.557146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485343:9526]
2025-10-02T09:31:43.557274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1233, pipe: [1:7556554737144485343:9526]
2025-10-02T09:31:43.593179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.593455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.593464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.593490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485343:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.593626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.593702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:43.593705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485343:9526]
2025-10-02T09:31:43.593720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.593766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1234 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65d451a8-993b7e39-ad2043bc-860cd461_0
2025-10-02T09:31:43.593898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1234 sessionId: src_id|65d451a8-993b7e39-ad2043bc-860cd461_0 is DEAD
2025-10-02T09:31:43.594026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:43.594032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Write session will restart in 0.005216s
2025-10-02T09:31:43.594046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Write session: Do CDS request
2025-10-02T09:31:43.594050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.598619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.599766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.599871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.599878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.599883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.599909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.599936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068947938:8068]
2025-10-02T09:31:43.600094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.600201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.600210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1235
2025-10-02T09:31:43.600266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.600284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.600290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.600293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.600275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.600442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.600465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.600521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1235 sessionId:  describe result for acl check
2025-10-02T09:31:43.600541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.600545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.600546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.600549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485374:9704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.600638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.600667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.600671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.600672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.600672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.600673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.600673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.600674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.600675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.600676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.600676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.600677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.600677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.600680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.600686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.600688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.600690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.600692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.600694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.600696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.600698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.600700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.600702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.600704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.600706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.600711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.600715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.600718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.600722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.600724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.600726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.600728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.600731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.600733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.600736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.600738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.600741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.600743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.600746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.600748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.600754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.600756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.600760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.600762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.600764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.600766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.600769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.600771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.600773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.600791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.600916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485374:9704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.601976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485374:9704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.606005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485374:9704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.606013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485374:9704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.606015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485374:9704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.606019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.608139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.609456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.609468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.609469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.609471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.609474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1234 [2:7556554737068947938:8068]
2025-10-02T09:31:43.609481Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.609493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.609499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.609500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.609501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.609510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.609513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.609519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.609548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.609552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.609554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.609555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.609557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.609592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.609596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.609602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.609607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.609618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.609632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485411:9704], now have 1 active actors on pipe
2025-10-02T09:31:43.609637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485344:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.609641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.609642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.609643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.609652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.609663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.609664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.609666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.609668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.609661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1234
2025-10-02T09:31:43.609673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.609666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1234
2025-10-02T09:31:43.609675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.609689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.609694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.609696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.609703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.609708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.609732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.609738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.609740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.609741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.609746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.609754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.609764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.609854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.609859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.609866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.609912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1235 partition: 0 MaxSeqNo: 36 sessionId: src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0
2025-10-02T09:31:43.610088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d451a8-993b7e39-ad2043bc-860cd461_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.612284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Write session: try to update token
2025-10-02T09:31:43.612292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.618964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.618980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.618982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.618985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.618995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.618998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.619004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068947933:8068]
2025-10-02T09:31:43.619029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.619029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.619034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.619036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.619039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.619042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.619160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.622896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId: src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.624705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.693836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485432:9526]
2025-10-02T09:31:43.693968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1234, pipe: [1:7556554737144485432:9526]
2025-10-02T09:31:43.732536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.732698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.732706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.732728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485432:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.732847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.732886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:43.732897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:43.732903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.732931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485432:9526]
2025-10-02T09:31:43.732936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1235 reason: error at write: Disconnected sessionId: src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0
2025-10-02T09:31:43.733063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1235 sessionId: src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0 is DEAD
2025-10-02T09:31:43.733194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:43.733202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Write session will restart in 0.007807s
2025-10-02T09:31:43.733220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Write session: Do CDS request
2025-10-02T09:31:43.733224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.737800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.738830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.738937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.738944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.738950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.738977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.739000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068948053:8083]
2025-10-02T09:31:43.739369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.739528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.739550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.739728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.739759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.739763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.739764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.739764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.739765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.739766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.739766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.739767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.739768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.739768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.739769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.739770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.739772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.739779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.739781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.739784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.739786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.739788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.739790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.739792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.739794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.739797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.739799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.739801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.739805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.739809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.739813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.739815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.739818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.739821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.739823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.739825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.739828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.739830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.739832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.739835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.739837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.739840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.739842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.739845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.739849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.739852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.739854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.739857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.739859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.739862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.739865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.739868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.739885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.742100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.742181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.742190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1236
2025-10-02T09:31:43.742255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.742272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.742278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.742280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.742520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1236 sessionId:  describe result for acl check
2025-10-02T09:31:43.742537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.742542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.742542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.742545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485475:9715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.742879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485475:9715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.744328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485475:9715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.746888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485475:9715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.746896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485475:9715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.746899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485475:9715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.746902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.747422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.748694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.748707Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.748708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.748712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.748716Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1235 [2:7556554737068948053:8083]
2025-10-02T09:31:43.748723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.748737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.748738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.748740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.748741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.748750Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.748754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.748758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.748791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.748796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.748797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.748799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.748812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.748894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.748900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.748906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.748913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.748917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1235
2025-10-02T09:31:43.748924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.748931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1235
2025-10-02T09:31:43.748938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485509:9715], now have 1 active actors on pipe
2025-10-02T09:31:43.748943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485442:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.748947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.748949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.748951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.748955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.748962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.748965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.748970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.748971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.748973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.748974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.748984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.748989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.749011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.749018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.749022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.749026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.749030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.749033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.749034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.749039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.749047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.749067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.749141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.749146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.749154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.749199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1236 partition: 0 MaxSeqNo: 36 sessionId: src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0
2025-10-02T09:31:43.749378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c932a5-78d3d4b5-f0f884f-39b831f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.751541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Write session: try to update token
2025-10-02T09:31:43.751551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.758479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.758497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.758498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.758500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.758506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.758509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.758515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068948048:8083]
2025-10-02T09:31:43.758542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.758544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.758547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.758550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.758551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.758553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.758676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.761481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId: src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.763332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.833109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485536:9526]
2025-10-02T09:31:43.833284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1235, pipe: [1:7556554737144485536:9526]
2025-10-02T09:31:43.870082Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:43.870296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.870304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.870328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485536:9526], now have 1 active actors on pipe
2025-10-02T09:31:43.870449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:43.870475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:43.870484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:43.870490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:43.870520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485536:9526]
2025-10-02T09:31:43.870524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1236 reason: error at write: Disconnected sessionId: src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0
2025-10-02T09:31:43.870653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1236 sessionId: src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0 is DEAD
2025-10-02T09:31:43.870769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:43.870776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Write session will restart in 0.007288s
2025-10-02T09:31:43.870789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Write session: Do CDS request
2025-10-02T09:31:43.870793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:43.875947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:43.877043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:43.877141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:43.877147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:43.877153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:43.877178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:43.877202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554737068948119:8085]
2025-10-02T09:31:43.877548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:43.877705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:43.877726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:43.877899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:43.877927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.877931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.877931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.877932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.877932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.877933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.877933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.877934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.877935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.877935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.877936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.877936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.877939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.877946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.877949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.877951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.877953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.877955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.877957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.877959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.877961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.877963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.877965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.877967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.877971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.877975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:43.877977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.877980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:43.877982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.877985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:43.877987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.877990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:43.877992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.877995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:43.877997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.878000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:43.878002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.878005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:43.878007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.878009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:43.878013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.878017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:43.878019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.878021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.878023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.878026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.878028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.878031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.878048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:43.879095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.879179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:43.879188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1237
2025-10-02T09:31:43.879274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:43.879300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:43.879306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:43.879309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:43.879605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1237 sessionId:  describe result for acl check
2025-10-02T09:31:43.879633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:43.879639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:43.879641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:43.879645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554737144485575:9721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:43.880072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554737144485575:9721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:43.881660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554737144485575:9721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:43.884896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554737144485575:9721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:43.884906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554737144485575:9721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:43.884910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554737144485575:9721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:43.884915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:43.885370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:43.886657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:43.886668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:43.886669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:43.886671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:43.886675Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1236 [2:7556554737068948119:8085]
2025-10-02T09:31:43.886684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:43.886693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:43.886698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.886700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.886702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.886711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:43.886716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:43.886720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:43.886754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.886759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.886760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.886761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:43.886763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:43.886799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:43.886803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.886809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:43.886814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:43.886825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:43.886840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485610:9721], now have 1 active actors on pipe
2025-10-02T09:31:43.886845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485541:2446], now have 1 active actors on pipe
2025-10-02T09:31:43.886848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.886850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.886859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.886867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:43.886877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:43.886880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:43.886882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:43.886883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:43.886876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1236
2025-10-02T09:31:43.886887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:43.886888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:43.886880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1236
2025-10-02T09:31:43.886902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.886909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:43.886911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:43.886919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.886921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.886944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1053ad10-3be26253-391d8693-3cb95a3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:43.886951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:43.886953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:43.886954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:43.886958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:43.886963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:43.886971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.887062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:43.887067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:43.887074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:43.887115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1237 partition: 0 MaxSeqNo: 36 sessionId: src_id|1053ad10-3be26253-391d8693-3cb95a3a_0
2025-10-02T09:31:43.887286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75fe4819-aa07f9e0-d9ac001a-9ae8e48f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1053ad10-3be26253-391d8693-3cb95a3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:43.889461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Write session: try to update token
2025-10-02T09:31:43.889471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:43.896099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:43.896118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:43.896120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:43.896122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:43.896131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.896134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.896138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554737068948114:8085]
2025-10-02T09:31:43.896165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:43.896170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:43.896173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:43.896174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:43.896175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:43.896176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:43.896310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:43.899476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId: src_id|1053ad10-3be26253-391d8693-3cb95a3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:43.901342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:43.970841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554737144485617:9526]
2025-10-02T09:31:43.971035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1236, pipe: [1:7556554737144485617:9526]
2025-10-02T09:31:44.008262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.008522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.008531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.008556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554737144485617:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.008698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.008708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554737144485617:9526]
2025-10-02T09:31:44.008728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.008761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:44.008849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1237 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1053ad10-3be26253-391d8693-3cb95a3a_0
2025-10-02T09:31:44.009000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1237 sessionId: src_id|1053ad10-3be26253-391d8693-3cb95a3a_0 is DEAD
2025-10-02T09:31:44.009106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:44.009115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Write session will restart in 0.005349s
2025-10-02T09:31:44.009128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Write session: Do CDS request
2025-10-02T09:31:44.009133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.014312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.015111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.015180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.015189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1238
2025-10-02T09:31:44.015274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.015293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.015299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.015303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.015579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.015638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1238 sessionId:  describe result for acl check
2025-10-02T09:31:44.015664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.015669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.015669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.015676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.015671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.015676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439452945:9725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.015682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.015710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.015734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915486:8088]
2025-10-02T09:31:44.016123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439452945:9725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.016154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.016337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.016360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.016535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.016567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.016571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.016572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.016572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.016573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.016573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.016574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.016574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.016575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.016576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.016576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.016577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.016580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.016586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.016588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.016590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.016592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.016594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.016596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.016598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.016600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.016602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.016604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.016606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.016611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.016615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.016618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.016621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.016623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.016626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.016628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.016632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.016635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.016638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.016643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.016647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.016650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.016658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.016663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.016667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.016671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.016679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.016693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.016700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.016703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.016709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.016711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.016713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.016731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.017349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439452945:9725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.022560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439452945:9725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.022569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439452945:9725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.022571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439452945:9725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.022575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.024267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.025576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.025588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.025589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.025591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.025594Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1237 [2:7556554741363915486:8088]
2025-10-02T09:31:44.025602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.025613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.025618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.025620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.025621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.025631Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.025635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.025639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.025668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.025672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.025673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.025675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.025676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.025710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.025715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.025721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.025726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.025738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.025751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439452985:9725], now have 1 active actors on pipe
2025-10-02T09:31:44.025757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439452914:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.025760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.025762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.025763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.025770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.025779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.025784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.025787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.025788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.025790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.025792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.025783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1237
2025-10-02T09:31:44.025803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1237
2025-10-02T09:31:44.025805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.025811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.025813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.025820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.025825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.025849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9b254da-43604a6c-7cde3bae-4671542f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.025856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.025858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.025859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.025864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.025873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.025884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.025977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.025981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.025988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.026046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1238 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9b254da-43604a6c-7cde3bae-4671542f_0
2025-10-02T09:31:44.026223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1053ad10-3be26253-391d8693-3cb95a3a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9b254da-43604a6c-7cde3bae-4671542f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.028438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Write session: try to update token
2025-10-02T09:31:44.028447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.035237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.035251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.035253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.035255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.035261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.035265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.035268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915481:8088]
2025-10-02T09:31:44.035298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.035308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.035310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.035319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.035329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.035331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.035495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.038458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId: src_id|e9b254da-43604a6c-7cde3bae-4671542f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.040266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.109088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439452992:9526]
2025-10-02T09:31:44.109264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1237, pipe: [1:7556554741439452992:9526]
2025-10-02T09:31:44.146315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.146576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.146586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.146612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439452992:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.146742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.146768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439452992:9526]
2025-10-02T09:31:44.146785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.146801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:44.146870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1238 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9b254da-43604a6c-7cde3bae-4671542f_0
2025-10-02T09:31:44.147003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1238 sessionId: src_id|e9b254da-43604a6c-7cde3bae-4671542f_0 is DEAD
2025-10-02T09:31:44.147129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:44.147137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Write session will restart in 0.008848s
2025-10-02T09:31:44.147155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Write session: Do CDS request
2025-10-02T09:31:44.147159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.151788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.152047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.152160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.152166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.152173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.152202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.152227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915556:8090]
2025-10-02T09:31:44.152571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.153049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.153072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.153243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.153272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.153276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.153276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.153277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.153277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.153278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.153278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.153279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.153280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.153280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.153281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.153281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.153284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.153291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.153293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.153295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.153297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.153299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.153301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.153303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.153305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.153307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.153309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.153311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.153315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.153319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.153322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.153325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.153327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.153330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.153332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.153335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.153337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.153339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.153342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.153345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.153347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.153349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.153351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.153354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.153359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.153362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.153364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.153367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.153372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.153375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.153377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.153379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.153396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.157073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.157157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.157167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1239
2025-10-02T09:31:44.157248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.157265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.157268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.157270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.157594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1239 sessionId:  describe result for acl check
2025-10-02T09:31:44.157621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.157626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.157627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.157631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453029:9729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.158012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453029:9729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.159578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453029:9729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.160714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.161173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453029:9729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.161181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453029:9729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.161183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453029:9729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.161186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.162084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.162098Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.162099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.162102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.162105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1238 [2:7556554741363915556:8090]
2025-10-02T09:31:44.162113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.162122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.162123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.162125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.162126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.162134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.162137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.162141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.162172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.162177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.162178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.162180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.162181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.162217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.162222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.162228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.162236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.162247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.162260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439452993:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.162265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453064:9729], now have 1 active actors on pipe
2025-10-02T09:31:44.162269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.162270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.162271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.162278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.162288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.162292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.162293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.162294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.162297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.162300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.162300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1238
2025-10-02T09:31:44.162308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1238
2025-10-02T09:31:44.162315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.162320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.162322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.162329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.162333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.162358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.162366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.162368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.162372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.162376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.162381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.162394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.162498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.162502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.162511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.162563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1239 partition: 0 MaxSeqNo: 36 sessionId: src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0
2025-10-02T09:31:44.162702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b254da-43604a6c-7cde3bae-4671542f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.164797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Write session: try to update token
2025-10-02T09:31:44.164827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.171579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.171591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.171593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.171596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.171602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.171606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.171610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915551:8090]
2025-10-02T09:31:44.171635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.171639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.171643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.171644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.171645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.171646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.171767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.174802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId: src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.176625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.246810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439453074:9526]
2025-10-02T09:31:44.246960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1238, pipe: [1:7556554741439453074:9526]
2025-10-02T09:31:44.280977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.281185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.281194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.281219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453074:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.281361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.281362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.281392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439453074:9526]
2025-10-02T09:31:44.281397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:44.281401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:44.281455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1239 reason: error at write: Disconnected sessionId: src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0
2025-10-02T09:31:44.281598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1239 sessionId: src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0 is DEAD
2025-10-02T09:31:44.281722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:44.281729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Write session will restart in 0.009216s
2025-10-02T09:31:44.281744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Write session: Do CDS request
2025-10-02T09:31:44.281747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.286681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.287847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.287970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.287980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.287986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.288014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.288039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915629:8093]
2025-10-02T09:31:44.288377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.288540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.288561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.288736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.288764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.288768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.288769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.288769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.288770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.288771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.288771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.288772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.288772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.288773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.288774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.288774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.288777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.288785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.288787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.288789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.288791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.288793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.288795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.288797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.288810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.288813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.288815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.288816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.288820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.288824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.288827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.288830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.288833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.288835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.288838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.288840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.288843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.288845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.288848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.288851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.288853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.288855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.288857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.288860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.288862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.288865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.288867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.288870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.288872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.288879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.288881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.288883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.288900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.292078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.292177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.292186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1240
2025-10-02T09:31:44.292282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.292301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.292306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.292309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.292609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1240 sessionId:  describe result for acl check
2025-10-02T09:31:44.292634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.292640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.292641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.292645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453112:9734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.293099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453112:9734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.294284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453112:9734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.295801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453112:9734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.295809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453112:9734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.295811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453112:9734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.295814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.296242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.297590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.297600Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.297601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.297603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.297607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1239 [2:7556554741363915629:8093]
2025-10-02T09:31:44.297616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.297626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.297631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.297633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.297634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.297643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.297646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.297651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.297682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.297686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.297687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.297689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.297692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.297730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.297734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.297741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.297746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.297757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.297772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453147:9734], now have 1 active actors on pipe
2025-10-02T09:31:44.297777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453075:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.297781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.297782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.297783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.297790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.297800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.297803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.297805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.297806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.297810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.297812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.297806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1239
2025-10-02T09:31:44.297815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1239
2025-10-02T09:31:44.297827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.297832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.297833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.297841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.297846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.297872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.297878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.297880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.297881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.297886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.297894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.297907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.297996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.298001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.298008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.298073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1240 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0
2025-10-02T09:31:44.298224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d960b2c3-4cf2d72a-af2427a0-ceada6dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.300382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Write session: try to update token
2025-10-02T09:31:44.300391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.307318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.307333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.307335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.307338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.307345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.307348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.307352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915624:8093]
2025-10-02T09:31:44.307379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.307383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.307382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.307385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.307385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.307388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.307520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.310537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId: src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.312402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.381492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439453155:9526]
2025-10-02T09:31:44.381682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1239, pipe: [1:7556554741439453155:9526]
2025-10-02T09:31:44.419306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.419497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.419505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.419529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453155:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.419669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.419688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:44.419696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:44.419743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1240 reason: error at write: Disconnected sessionId: src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0
2025-10-02T09:31:44.419881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1240 sessionId: src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0 is DEAD
2025-10-02T09:31:44.419884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.419920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439453155:9526]
2025-10-02T09:31:44.419996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:44.420005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Write session will restart in 0.007162s
2025-10-02T09:31:44.420019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Write session: Do CDS request
2025-10-02T09:31:44.420024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.425238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.426483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.426579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.426585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.426590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.426616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.426638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915701:8095]
2025-10-02T09:31:44.426984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.427161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.427183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.427354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.427383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.427387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.427387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.427388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.427390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.427391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.427391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.427392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.427392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.427393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.427393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.427394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.427397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.427403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.427405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.427407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.427409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.427411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.427413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.427415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.427417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.427419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.427421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.427423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.427427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.427430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.427433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.427436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.427439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.427442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.427444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.427447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.427449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.427452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.427454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.427458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.427460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.427463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.427465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.427469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.427473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.427476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.427478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.427480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.427482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.427485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.427488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.427491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.427507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.428097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.428169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.428177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1241
2025-10-02T09:31:44.428277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.428296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.428302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.428304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.428582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1241 sessionId:  describe result for acl check
2025-10-02T09:31:44.428609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.428615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.428616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.428620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453194:9738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.429053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453194:9738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.430415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453194:9738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.434321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453194:9738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.434331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453194:9738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.434333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453194:9738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.434337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.434886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.436156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.436166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.436167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.436169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.436172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1240 [2:7556554741363915701:8095]
2025-10-02T09:31:44.436179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.436191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.436196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.436197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.436198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.436207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.436210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.436216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.436249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.436254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.436255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.436257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.436260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.436296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.436300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.436307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.436312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.436320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.436334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453156:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.436339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453229:9738], now have 1 active actors on pipe
2025-10-02T09:31:44.436343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.436344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.436345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.436352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.436363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.436363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1240
2025-10-02T09:31:44.436371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.436365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1240
2025-10-02T09:31:44.436376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.436378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.436381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.436383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.436391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.436393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.436395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.436408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.436413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.436430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.436437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.436441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.436443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.436448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.436454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.436469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.436556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.436560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.436567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.436618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1241 partition: 0 MaxSeqNo: 36 sessionId: src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0
2025-10-02T09:31:44.436788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2e3da-7d8373a2-1a542333-d5a2dcf0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.439025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Write session: try to update token
2025-10-02T09:31:44.439036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.445614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.445630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.445632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.445634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.445644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.445647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.445650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915696:8095]
2025-10-02T09:31:44.445677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.445679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.445680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.445682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.445684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.445686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.445801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.449473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId: src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.451364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.520210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439453237:9526]
2025-10-02T09:31:44.520387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1240, pipe: [1:7556554741439453237:9526]
2025-10-02T09:31:44.557603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.557856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.557865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.557890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453237:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.558007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.558055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:44.558065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:44.558074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.558108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439453237:9526]
2025-10-02T09:31:44.558110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1241 reason: error at write: Disconnected sessionId: src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0
2025-10-02T09:31:44.558240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1241 sessionId: src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0 is DEAD
2025-10-02T09:31:44.558379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:44.558388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Write session will restart in 0.008601s
2025-10-02T09:31:44.558407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Write session: Do CDS request
2025-10-02T09:31:44.558411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.563392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.564504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.564600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.564606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.564611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.564637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.564665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915774:8097]
2025-10-02T09:31:44.565022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.565189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.565212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.565387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.565418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.565421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.565422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.565423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.565423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.565424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.565424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.565425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.565426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.565426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.565427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.565427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.565430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.565437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.565439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.565441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.565443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.565445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.565446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.565448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.565450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.565453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.565455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.565457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.565461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.565465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.565468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.565471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.565473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.565475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.565477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.565480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.565483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.565486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.565488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.565491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.565493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.565495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.565497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.565500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.565502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.565505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.565507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.565509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.565512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.565518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.565520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.565523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.565540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.568090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.568175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.568184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1242
2025-10-02T09:31:44.568248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.568268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.568270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.568273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.568558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1242 sessionId:  describe result for acl check
2025-10-02T09:31:44.568584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.568588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.568589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.568592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453277:9742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.569000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453277:9742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.570313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453277:9742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.572418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453277:9742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.572427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453277:9742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.572430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453277:9742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.572435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.573001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.574393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.574405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.574409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.574411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.574414Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1241 [2:7556554741363915774:8097]
2025-10-02T09:31:44.574422Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.574436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.574441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.574442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.574443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.574452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.574458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.574462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.574495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.574500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.574501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.574503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.574504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.574539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.574544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.574550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.574556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.574564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.574577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453312:9742], now have 1 active actors on pipe
2025-10-02T09:31:44.574583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453238:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.574586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.574587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.574589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.574596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.574608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.574609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.574612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.574613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.574619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.574620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.574614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1241
2025-10-02T09:31:44.574617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1241
2025-10-02T09:31:44.574637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.574642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.574644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.574651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.574656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.574680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.574686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.574688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.574689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.574694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.574703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.574717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.574811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.574815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.574822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.574869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1242 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0
2025-10-02T09:31:44.575050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d238bf25-610fd0b8-83e3fe00-266536ba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.577319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Write session: try to update token
2025-10-02T09:31:44.577330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.583891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.583902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.583904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.583906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.583911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.583913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.583915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915769:8097]
2025-10-02T09:31:44.583940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.583942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.583945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.583945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.583946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.583947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.584064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.587666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId: src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.589542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.658472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439453319:9526]
2025-10-02T09:31:44.658703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1241, pipe: [1:7556554741439453319:9526]
2025-10-02T09:31:44.697028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.697219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.697228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.697252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453319:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.697367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.697401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:44.697410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:44.697430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439453319:9526]
2025-10-02T09:31:44.697444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.697454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1242 reason: error at write: Disconnected sessionId: src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0
2025-10-02T09:31:44.697570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1242 sessionId: src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0 is DEAD
2025-10-02T09:31:44.697707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:44.697716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Write session will restart in 0.007225s
2025-10-02T09:31:44.697729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Write session: Do CDS request
2025-10-02T09:31:44.697732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.702665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.703763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.703865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.703871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.703876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.703901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.703924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915858:8100]
2025-10-02T09:31:44.704262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.704421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.704443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.704616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.704645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.704649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.704649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.704650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.704651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.704651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.704652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.704652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.704653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.704655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.704656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.704656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.704659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.704666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.704668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.704670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.704672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.704674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.704676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.704678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.704680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.704683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.704684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.704687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.704690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.704693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.704697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.704699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.704701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.704704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.704706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.704709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.704711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.704713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.704715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.704718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.704721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.704723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.704725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.704728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.704730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.704733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.704737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.704739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.704742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.704744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.704749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.704753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.704769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.706114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.706179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.706189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1243
2025-10-02T09:31:44.706279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.706296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.706299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.706302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.706615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1243 sessionId:  describe result for acl check
2025-10-02T09:31:44.706644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.706650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.706653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.706657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453361:9746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.707033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453361:9746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.708458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453361:9746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.711634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453361:9746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.711643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453361:9746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.711646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453361:9746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.711650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.712229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.713687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.713697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.713698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.713700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.713703Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1242 [2:7556554741363915858:8100]
2025-10-02T09:31:44.713710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.713720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.713725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.713727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.713728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.713738Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.713741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.713748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.713779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.713784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.713785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.713787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.713789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.713826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.713830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.713836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.713842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.713849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.713863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453321:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.713868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453396:9746], now have 1 active actors on pipe
2025-10-02T09:31:44.713872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.713873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.713875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.713883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.713876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1242
2025-10-02T09:31:44.713879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1242
2025-10-02T09:31:44.713893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.713896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.713898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.713899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.713904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.713905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.713930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.713934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.713941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.713950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.713959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.713969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|204724a2-fba920a3-aae219c2-895a4a0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.713972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.713978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.713979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.713984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.713992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.714003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.714086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.714091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.714098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.714148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1243 partition: 0 MaxSeqNo: 36 sessionId: src_id|204724a2-fba920a3-aae219c2-895a4a0b_0
2025-10-02T09:31:44.714315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3145112-7fb7f3e7-b4e92498-61db8cb4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|204724a2-fba920a3-aae219c2-895a4a0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.716444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Write session: try to update token
2025-10-02T09:31:44.716453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.723674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.723688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.723690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.723691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.723696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.723699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.723701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915853:8100]
2025-10-02T09:31:44.723725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.723725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.723728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.723731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.723732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.723733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.723846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.727033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId: src_id|204724a2-fba920a3-aae219c2-895a4a0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.729173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.797724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439453442:9526]
2025-10-02T09:31:44.797877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1242, pipe: [1:7556554741439453442:9526]
2025-10-02T09:31:44.836105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.836323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.836331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.836356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453442:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.836526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.836550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:44.836561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:44.836570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439453442:9526]
2025-10-02T09:31:44.836589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.836611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1243 reason: error at write: Disconnected sessionId: src_id|204724a2-fba920a3-aae219c2-895a4a0b_0
2025-10-02T09:31:44.836744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1243 sessionId: src_id|204724a2-fba920a3-aae219c2-895a4a0b_0 is DEAD
2025-10-02T09:31:44.836881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:44.836890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Write session will restart in 0.008332s
2025-10-02T09:31:44.836905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Write session: Do CDS request
2025-10-02T09:31:44.836909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.842105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.843155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.843255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.843261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.843267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.843298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.843321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363915968:8114]
2025-10-02T09:31:44.843657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.843809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.843831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.844006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.844036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.844040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.844040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.844041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.844042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.844042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.844043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.844043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.844044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.844044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.844045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.844046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.844049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.844056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.844058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.844060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.844062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.844064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.844066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.844068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.844071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.844073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.844075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.844077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.844080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.844084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.844087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.844090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.844093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.844096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.844098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.844101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.844103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.844106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.844108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.844110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.844113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.844115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.844117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.844120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.844122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.844125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.844127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.844130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.844132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.844136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.844138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.844141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.844158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.846090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.846188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.846197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1244
2025-10-02T09:31:44.846290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.846318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.846324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.846327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.846572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1244 sessionId:  describe result for acl check
2025-10-02T09:31:44.846596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.846600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.846601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.846604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453488:9759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.846972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453488:9759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.848307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453488:9759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.851021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453488:9759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.851031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453488:9759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.851033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453488:9759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.851037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.851641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.853013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.853024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.853026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.853029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.853033Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1243 [2:7556554741363915968:8114]
2025-10-02T09:31:44.853041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.853053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.853058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.853060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.853061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.853070Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.853075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.853079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.853112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.853116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.853118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.853119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.853121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.853163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.853168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.853175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.853180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.853187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.853202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453523:9759], now have 1 active actors on pipe
2025-10-02T09:31:44.853207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453447:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.853211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.853212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.853213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.853221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.853233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.853236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.853239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.853240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.853231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1243
2025-10-02T09:31:44.853243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.853237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1243
2025-10-02T09:31:44.853245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.853259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.853264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.853266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.853273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.853278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.853306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c52b20ba-65e742c1-43367f30-99e2183f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.853313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.853315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.853317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.853322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.853330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.853402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.853502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.853507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.853515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.853584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1244 partition: 0 MaxSeqNo: 36 sessionId: src_id|c52b20ba-65e742c1-43367f30-99e2183f_0
2025-10-02T09:31:44.853754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204724a2-fba920a3-aae219c2-895a4a0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c52b20ba-65e742c1-43367f30-99e2183f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.855936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Write session: try to update token
2025-10-02T09:31:44.855945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:44.862722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:44.862735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:44.862738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:44.862739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:44.862745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.862747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.862749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363915963:8114]
2025-10-02T09:31:44.862770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:44.862774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.862776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:44.862789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:44.862793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:44.862795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:44.862903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:44.866298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId: src_id|c52b20ba-65e742c1-43367f30-99e2183f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:44.868154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:44.936484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554741439453534:9526]
2025-10-02T09:31:44.936703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1243, pipe: [1:7556554741439453534:9526]
2025-10-02T09:31:44.975302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:44.975857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.975871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.975902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453534:9526], now have 1 active actors on pipe
2025-10-02T09:31:44.976109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554741439453534:9526]
2025-10-02T09:31:44.976127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:44.976132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:44.976131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:44.976137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:44.976195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1244 reason: error at write: Disconnected sessionId: src_id|c52b20ba-65e742c1-43367f30-99e2183f_0
2025-10-02T09:31:44.976362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1244 sessionId: src_id|c52b20ba-65e742c1-43367f30-99e2183f_0 is DEAD
2025-10-02T09:31:44.976537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:44.976546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Write session will restart in 0.009354s
2025-10-02T09:31:44.976577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Write session: Do CDS request
2025-10-02T09:31:44.976582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:44.981383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:44.982580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:44.982699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:44.982706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:44.982712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:44.982736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:44.982761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554741363916045:8117]
2025-10-02T09:31:44.983206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:44.983389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:44.983411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:44.983634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:44.983663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.983667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.983667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.983668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.983669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.983669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.983670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.983670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.983671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.983672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.983673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.983673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.983676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.983683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.983686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.983688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.983690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.983692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.983694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.983696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.983698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.983700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.983702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.983704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.983707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.983711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:44.983714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.983717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:44.983720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.983723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:44.983725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.983728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:44.983730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.983732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:44.983734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.983737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:44.983739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.983742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:44.983744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.983746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:44.983749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.983751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:44.983755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.983758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.983760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.983763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.983765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.983768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.983789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:44.987148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.987242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:44.987261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1245
2025-10-02T09:31:44.987337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:44.987356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:44.987363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:44.987365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:44.987704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1245 sessionId:  describe result for acl check
2025-10-02T09:31:44.987730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:44.987732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:44.987733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:44.987736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554741439453578:9763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:44.988097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554741439453578:9763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:44.989703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554741439453578:9763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:44.991337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:44.991681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554741439453578:9763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:44.991691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554741439453578:9763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:44.991694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554741439453578:9763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:44.991700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:44.993099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:44.993108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:44.993109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:44.993111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:44.993115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1244 [2:7556554741363916045:8117]
2025-10-02T09:31:44.993121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:44.993131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:44.993132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.993133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.993135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.993144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:44.993146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:44.993151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:44.993180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.993186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.993187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.993189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:44.993190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:44.993227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:44.993231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:44.993238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:44.993243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:44.993253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:44.993266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453612:9763], now have 1 active actors on pipe
2025-10-02T09:31:44.993271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554741439453535:2446], now have 1 active actors on pipe
2025-10-02T09:31:44.993275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:44.993276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:44.993277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:44.993287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:44.993295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:44.993301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:44.993302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:44.993296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1244
2025-10-02T09:31:44.993303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:44.993297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1244
2025-10-02T09:31:44.993304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:44.993305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:44.993320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:44.993323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:44.993324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:44.993334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.993335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.993359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:44.993366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:44.993368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:44.993369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:44.993373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:44.993378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:44.993390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.993487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:44.993492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:44.993499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:44.993544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1245 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0
2025-10-02T09:31:44.993729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52b20ba-65e742c1-43367f30-99e2183f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:44.998928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Write session: try to update token
2025-10-02T09:31:44.998938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.002715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.002726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.002727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.002729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.002735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:45.002737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:45.002740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554741363916040:8117]
2025-10-02T09:31:45.002762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.002765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.002767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.002768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.002771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.002776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.003005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.011463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId: src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.013467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.076260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734420916:9526]
2025-10-02T09:31:45.076467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1244, pipe: [1:7556554745734420916:9526]
2025-10-02T09:31:45.120281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.120535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.120545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.120558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734420916:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.120699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.120723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:45.120733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:45.120753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734420916:9526]
2025-10-02T09:31:45.120776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.120778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1245 reason: error at write: Disconnected sessionId: src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0
2025-10-02T09:31:45.120932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1245 sessionId: src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0 is DEAD
2025-10-02T09:31:45.121067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:45.121075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Write session will restart in 0.006326s
2025-10-02T09:31:45.121090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Write session: Do CDS request
2025-10-02T09:31:45.121094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.126199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.127360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.127478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.127485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.127491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.127518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.127542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883417:8119]
2025-10-02T09:31:45.127881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.128046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.128068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.128089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.128186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.128195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1246
2025-10-02T09:31:45.128259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.128284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.128290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.128294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.128294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.128295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.128302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.128296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.128308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.128310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.128296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.128297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.128297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.128298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.128298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.128299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.128300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.128302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.128309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.128312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.128314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.128316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.128318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.128320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.128322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.128324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.128326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.128328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.128330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.128334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.128338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.128341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.128344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.128346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.128349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.128351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.128355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.128357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.128360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.128362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.128365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.128367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.128369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.128371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.128374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.128376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.128380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.128382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.128384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.128387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.128389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.128392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.128394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.128410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.128570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1246 sessionId:  describe result for acl check
2025-10-02T09:31:45.128593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.128597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.128598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.128601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734420960:9767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.128998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734420960:9767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.130387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734420960:9767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.134659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734420960:9767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.134669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734420960:9767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.134671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734420960:9767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.134676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.135942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.137349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.137360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.137363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.137365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.137369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1245 [2:7556554745658883417:8119]
2025-10-02T09:31:45.137377Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.137387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.137392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.137394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.137396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.137405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.137410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.137414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.137444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.137449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.137450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.137452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.137453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.137491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.137495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.137502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.137508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.137519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.137533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734420995:9767], now have 1 active actors on pipe
2025-10-02T09:31:45.137538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734420917:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.137576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.137580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.137582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.137590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.137580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1245
2025-10-02T09:31:45.137601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.137585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1245
2025-10-02T09:31:45.137608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.137613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.137613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.137615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.137616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.137651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.137656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.137666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.137674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.137683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.137691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.137696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.137702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.137703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.137709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.137717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.137731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.137812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.137817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.137825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.137866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1246 partition: 0 MaxSeqNo: 36 sessionId: src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0
2025-10-02T09:31:45.138071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7407231-d7b95148-f087d037-c8d7c0b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.140213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Write session: try to update token
2025-10-02T09:31:45.140225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.147087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.147100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.147102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.147103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.147107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.147110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.147112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883412:8119]
2025-10-02T09:31:45.147135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.147140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.147141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.147143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.147144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.147145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.147261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.151095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId: src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.153280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.220639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734421010:9526]
2025-10-02T09:31:45.220819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1245, pipe: [1:7556554745734421010:9526]
2025-10-02T09:31:45.261714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.261983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.261992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.262023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421010:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.262179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.262237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734421010:9526]
2025-10-02T09:31:45.262284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.262306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:45.262317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:45.262357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1246 reason: error at write: Disconnected sessionId: src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0
2025-10-02T09:31:45.262486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1246 sessionId: src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0 is DEAD
2025-10-02T09:31:45.262599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:45.262608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Write session will restart in 0.005776s
2025-10-02T09:31:45.262638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Write session: Do CDS request
2025-10-02T09:31:45.262643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.267463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.268503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.268609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.268616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.268621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.268647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.268671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883499:8122]
2025-10-02T09:31:45.269027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.269071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.269190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.269180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.269190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1247
2025-10-02T09:31:45.269212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.269297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.269315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.269322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.269324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.269389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.269418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.269422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.269423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.269423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.269424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.269424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.269425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.269425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.269427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.269428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.269428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.269429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.269432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.269439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.269441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.269443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.269445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.269447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.269449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.269451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.269453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.269455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.269457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.269459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.269463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.269467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.269470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.269473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.269475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.269478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.269480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.269482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.269485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.269487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.269489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.269492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.269494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.269497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.269499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.269502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.269508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.269510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.269514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.269517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.269519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.269523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.269525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.269528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.269546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.269571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1247 sessionId:  describe result for acl check
2025-10-02T09:31:45.269595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.269599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.269602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.269616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734421053:9772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.269986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734421053:9772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.271183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734421053:9772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.274745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734421053:9772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.274754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734421053:9772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.274756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734421053:9772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.274760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.276996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.278373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.278384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.278385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.278387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.278391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1246 [2:7556554745658883499:8122]
2025-10-02T09:31:45.278398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.278408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.278411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.278413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.278414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.278424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.278428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.278434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.278466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.278471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.278472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.278474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.278475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.278511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.278517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.278523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.278528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.278540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.278553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421090:9772], now have 1 active actors on pipe
2025-10-02T09:31:45.278558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421011:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.278562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.278563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.278564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.278571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.278579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.278584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.278585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.278587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.278590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.278591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.278594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1246
2025-10-02T09:31:45.278596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1246
2025-10-02T09:31:45.278608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.278612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.278614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.278624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.278629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.278653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b64b5d7-83546860-72febc72-eb3eac37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.278660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.278662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.278663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.278668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.278676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.278685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.278783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.278788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.278795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.278840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1247 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b64b5d7-83546860-72febc72-eb3eac37_0
2025-10-02T09:31:45.279074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7af92fb2-4230bfe9-9d37815e-6064fc2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b64b5d7-83546860-72febc72-eb3eac37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.281264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Write session: try to update token
2025-10-02T09:31:45.281276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.288192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.288203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.288205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.288206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.288211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.288214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.288216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883494:8122]
2025-10-02T09:31:45.288237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.288243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.288245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.288246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.288249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.288251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.288363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.292277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId: src_id|1b64b5d7-83546860-72febc72-eb3eac37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.294278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.362445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734421098:9526]
2025-10-02T09:31:45.362568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1246, pipe: [1:7556554745734421098:9526]
2025-10-02T09:31:45.403453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.403667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.403675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.403700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421098:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.403857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.403895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734421098:9526]
2025-10-02T09:31:45.403917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:45.403920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.403970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b64b5d7-83546860-72febc72-eb3eac37_0
2025-10-02T09:31:45.404110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1247 sessionId: src_id|1b64b5d7-83546860-72febc72-eb3eac37_0 is DEAD
2025-10-02T09:31:45.404222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:45.404231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Write session will restart in 0.007139s
2025-10-02T09:31:45.404245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Write session: Do CDS request
2025-10-02T09:31:45.404249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.409469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.410565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.410662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.410669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.410674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.410698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.410723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883579:8124]
2025-10-02T09:31:45.411076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.411237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.411259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.411433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.411464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.411468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.411469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.411469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.411470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.411470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.411471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.411471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.411472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.411472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.411473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.411473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.411476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.411482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.411484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.411486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.411488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.411490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.411492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.411496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.411498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.411500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.411502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.411504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.411508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.411512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.411515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.411519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.411521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.411523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.411525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.411528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.411532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.411535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.411538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.411541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.411543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.411545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.411549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.411551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.411553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.411556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.411558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.411561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.411564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.411567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.411569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.411572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.411591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.412136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.412224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.412235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1248
2025-10-02T09:31:45.412322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.412341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.412347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.412350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.412615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1248 sessionId:  describe result for acl check
2025-10-02T09:31:45.412637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.412642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.412643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.412646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734421143:9776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.412999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734421143:9776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.414492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734421143:9776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.418425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734421143:9776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.418436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734421143:9776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.418438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734421143:9776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.418442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.419041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.420413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.420423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.420424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.420427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.420430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1247 [2:7556554745658883579:8124]
2025-10-02T09:31:45.420437Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.420451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.420457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.420458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.420459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.420468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.420471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.420475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.420507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.420512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.420513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.420515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.420517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.420556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.420561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.420567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.420572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.420584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.420598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421178:9776], now have 1 active actors on pipe
2025-10-02T09:31:45.420604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421099:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.420608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.420609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.420611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.420618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.420629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.420632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.420634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.420635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.420639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.420641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.420629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1247
2025-10-02T09:31:45.420635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1247
2025-10-02T09:31:45.420656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.420661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.420662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.420675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.420681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.420708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80b20450-32d18cec-5116c88e-eb8f0385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.420715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.420717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.420718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.420722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.420728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.420738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.420859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.420864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.420872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.420950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1248 partition: 0 MaxSeqNo: 36 sessionId: src_id|80b20450-32d18cec-5116c88e-eb8f0385_0
2025-10-02T09:31:45.421145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b64b5d7-83546860-72febc72-eb3eac37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80b20450-32d18cec-5116c88e-eb8f0385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.423395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Write session: try to update token
2025-10-02T09:31:45.423405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.430164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.430177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.430178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.430179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.430185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.430187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.430192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883574:8124]
2025-10-02T09:31:45.430215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.430219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.430219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.430220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.430222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.430227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.430365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.433774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId: src_id|80b20450-32d18cec-5116c88e-eb8f0385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.435735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.504290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734421185:9526]
2025-10-02T09:31:45.504494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1247, pipe: [1:7556554745734421185:9526]
2025-10-02T09:31:45.545976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.546263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.546272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.546297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421185:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.546435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.546469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:45.546475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.546482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:45.546507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734421185:9526]
2025-10-02T09:31:45.546567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1248 reason: error at write: Disconnected sessionId: src_id|80b20450-32d18cec-5116c88e-eb8f0385_0
2025-10-02T09:31:45.546701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1248 sessionId: src_id|80b20450-32d18cec-5116c88e-eb8f0385_0 is DEAD
2025-10-02T09:31:45.546857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:45.546866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Write session will restart in 0.005399s
2025-10-02T09:31:45.546882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Write session: Do CDS request
2025-10-02T09:31:45.546886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.551844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.552919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.553026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.553033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.553039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.553065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.553074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.553087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883659:8126]
2025-10-02T09:31:45.553177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.553187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1249
2025-10-02T09:31:45.553279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.553301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.553307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.553310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.553439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.553575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1249 sessionId:  describe result for acl check
2025-10-02T09:31:45.553598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.553603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.553604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.553606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734421231:9780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.553619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.553642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.553824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.553855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.553859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.553860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.553860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.553861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.553862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.553862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.553863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.553863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.553864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.553864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.553865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.553869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.553875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.553877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.553879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.553881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.553883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.553885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.553887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.553889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.553891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.553893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.553895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.553899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.553903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.553907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.553910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.553912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.553915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.553917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.553920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.553922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.553925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.553927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.553946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.553952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.553955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.553957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.553960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.553962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.553954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734421231:9780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.553965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.553970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.553973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.553975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.553978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.553983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.553986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.554003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.555323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734421231:9780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.559392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734421231:9780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.559401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734421231:9780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.559404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734421231:9780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.559408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.561638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.563036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.563046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.563048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.563050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.563054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1248 [2:7556554745658883659:8126]
2025-10-02T09:31:45.563063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.563077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.563082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.563084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.563085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.563095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.563102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.563107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.563141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.563145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.563146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.563148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.563150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.563181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.563186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.563192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.563197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.563208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.563223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421268:9780], now have 1 active actors on pipe
2025-10-02T09:31:45.563228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421187:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.563231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.563232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.563233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.563241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.563252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.563253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.563245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1248
2025-10-02T09:31:45.563255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.563255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1248
2025-10-02T09:31:45.563256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.563261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.563263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.563289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.563294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.563301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.563308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.563315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.563325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.563340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.563346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.563347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.563352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.563359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.563373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.563456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.563461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.563468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.563517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1249 partition: 0 MaxSeqNo: 36 sessionId: src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0
2025-10-02T09:31:45.563706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b20450-32d18cec-5116c88e-eb8f0385_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.565929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Write session: try to update token
2025-10-02T09:31:45.565941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.572823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.572834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.572836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.572839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.572844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.572847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.572849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883654:8126]
2025-10-02T09:31:45.572871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.572874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.572875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.572882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.572893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.572896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.572989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.576404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId: src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.578328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.646618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734421275:9526]
2025-10-02T09:31:45.646749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1248, pipe: [1:7556554745734421275:9526]
2025-10-02T09:31:45.689634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.689844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.689852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.689877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421275:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.690036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.690023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:45.690036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:45.690054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.690085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1249 reason: error at write: Disconnected sessionId: src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0
2025-10-02T09:31:45.690088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734421275:9526]
2025-10-02T09:31:45.690219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1249 sessionId: src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0 is DEAD
2025-10-02T09:31:45.690323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:45.690330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Write session will restart in 0.009834s
2025-10-02T09:31:45.690349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Write session: Do CDS request
2025-10-02T09:31:45.690353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.695716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.696821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.696922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.696928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.696934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.696961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.696986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883752:8128]
2025-10-02T09:31:45.697328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.697500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.697522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.697706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.697737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.697741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.697742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.697743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.697743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.697744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.697744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.697745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.697746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.697746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.697747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.697749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.697752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.697758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.697760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.697762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.697764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.697766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.697768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.697770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.697773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.697775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.697777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.697779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.697783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.697787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.697790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.697793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.697798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.697801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.697803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.697806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.697808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.697811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.697816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.697819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.697821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.697825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.697830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.697833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.697836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.697839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.697841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.697844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.697849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.697851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.697853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.697856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.697875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.701120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.701227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.701237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1250
2025-10-02T09:31:45.701321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.701340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.701346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.701348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.701600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1250 sessionId:  describe result for acl check
2025-10-02T09:31:45.701624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.701628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.701629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.701632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734421324:9784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.701947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734421324:9784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.703206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734421324:9784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.704929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734421324:9784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.704939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734421324:9784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.704941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734421324:9784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.704944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.705519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.707048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.707057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.707058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.707060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.707064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1249 [2:7556554745658883752:8128]
2025-10-02T09:31:45.707074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.707084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.707089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.707090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.707091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.707100Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.707106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.707111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.707140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.707145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.707148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.707150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.707151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.707188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.707192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.707199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.707205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.707213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.707227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421359:9784], now have 1 active actors on pipe
2025-10-02T09:31:45.707233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421277:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.707237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.707238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.707239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.707247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.707258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.707260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.707262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.707263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.707269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.707270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.707260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1249
2025-10-02T09:31:45.707262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1249
2025-10-02T09:31:45.707285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.707290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.707291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.707301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.707306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.707337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.707343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.707347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.707350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.707356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.707362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.707375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.707462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.707466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.707473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.707516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1250 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0
2025-10-02T09:31:45.707709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15a06a9-cc9ca5a6-5c2734ab-9090ad92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.709946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Write session: try to update token
2025-10-02T09:31:45.709957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.716725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.716738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.716742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.716743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.716747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.716750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.716752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883746:8128]
2025-10-02T09:31:45.716773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.716779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.716780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.716811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.716826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.716833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.716915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.720409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId: src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.722593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.789964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734421403:9526]
2025-10-02T09:31:45.790106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1249, pipe: [1:7556554745734421403:9526]
2025-10-02T09:31:45.833873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.834119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.834128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.834155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421403:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.834293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.834324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:45.834336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:45.834369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.834386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1250 reason: error at write: Disconnected sessionId: src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0
2025-10-02T09:31:45.834412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734421403:9526]
2025-10-02T09:31:45.834531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1250 sessionId: src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0 is DEAD
2025-10-02T09:31:45.834667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:45.834676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Write session will restart in 0.006718s
2025-10-02T09:31:45.834690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Write session: Do CDS request
2025-10-02T09:31:45.834694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.839487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.840575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.840679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.840685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.840690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.840715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.840742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883869:8143]
2025-10-02T09:31:45.841099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.841266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.841289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.841465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.841494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.841498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.841499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.841500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.841500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.841501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.841501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.841502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.841502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.841503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.841503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.841504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.841507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.841513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.841515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.841518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.841520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.841523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.841525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.841527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.841529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.841531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.841533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.841535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.841539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.841543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.841546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.841549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.841552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.841555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.841557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.841560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.841562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.841565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.841567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.841569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.841572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.841574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.841576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.841579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.841581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.841583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.841585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.841588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.841591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.841594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.841597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.841599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.841617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.842106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.842189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.842198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1251
2025-10-02T09:31:45.842284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.842302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.842308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.842311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.842580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1251 sessionId:  describe result for acl check
2025-10-02T09:31:45.842603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.842607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.842609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.842612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734421456:9797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.842976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734421456:9797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.844581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734421456:9797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.848573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734421456:9797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.848585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734421456:9797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.848588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734421456:9797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.848592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.849133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.850613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.850623Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.850625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.850627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.850630Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1250 [2:7556554745658883869:8143]
2025-10-02T09:31:45.850638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.850649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.850650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.850652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.850653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.850662Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.850669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.850674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.850707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.850711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.850712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.850714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.850715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.850751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.850756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.850762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.850767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.850778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.850792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421408:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.850797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421491:9797], now have 1 active actors on pipe
2025-10-02T09:31:45.850801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.850803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.850804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.850812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.850822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.850826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.850828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.850829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.850832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.850822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1250
2025-10-02T09:31:45.850834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.850832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1250
2025-10-02T09:31:45.850859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.850868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.850873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.850880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.850882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.850904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d92875ff-54614-c8460f97-4f358435_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.850912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.850915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.850917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.850921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.850926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.850940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.851032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.851038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.851045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.851091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1251 partition: 0 MaxSeqNo: 36 sessionId: src_id|d92875ff-54614-c8460f97-4f358435_0
2025-10-02T09:31:45.851291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0b639a-1604cb19-3b68834-3d4e43c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d92875ff-54614-c8460f97-4f358435_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.853461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Write session: try to update token
2025-10-02T09:31:45.853470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:45.860234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:45.860247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:45.860248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:45.860249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:45.860256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.860259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.860261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883864:8143]
2025-10-02T09:31:45.860282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:45.860287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.860288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:45.860291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:45.860292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:45.860294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:45.860408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:45.863814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId: src_id|d92875ff-54614-c8460f97-4f358435_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:45.865780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:45.934370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554745734421502:9526]
2025-10-02T09:31:45.934548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1250, pipe: [1:7556554745734421502:9526]
2025-10-02T09:31:45.973863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:45.974104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.974111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.974138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421502:9526], now have 1 active actors on pipe
2025-10-02T09:31:45.974278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:45.974342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554745734421502:9526]
2025-10-02T09:31:45.974359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:45.974368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:45.974419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1251 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d92875ff-54614-c8460f97-4f358435_0
2025-10-02T09:31:45.974561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1251 sessionId: src_id|d92875ff-54614-c8460f97-4f358435_0 is DEAD
2025-10-02T09:31:45.974699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:45.974707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Write session will restart in 0.009072s
2025-10-02T09:31:45.974721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Write session: Do CDS request
2025-10-02T09:31:45.974729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:45.979653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:45.980723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:45.980844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:45.980850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:45.980856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:45.980885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:45.980908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554745658883954:8146]
2025-10-02T09:31:45.981249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:45.981427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:45.981448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:45.981636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:45.981668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.981671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.981672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.981673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.981673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.981674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.981674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.981675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.981675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.981676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.981676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.981677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.981680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.981686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.981689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.981692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.981693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.981696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.981698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.981700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.981702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.981704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.981706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.981708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.981713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.981716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:45.981720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.981723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:45.981725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.981727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:45.981733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.981736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:45.981739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.981741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:45.981743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.981746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:45.981748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.981751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:45.981755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.981757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:45.981760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.981763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:45.981765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.981770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.981772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.981776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.981778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.981781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.981799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:45.985084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.985181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:45.985191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1252
2025-10-02T09:31:45.985279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:45.985298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:45.985304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:45.985306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:45.985570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1252 sessionId:  describe result for acl check
2025-10-02T09:31:45.985594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:45.985598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:45.985601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:45.985604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554745734421552:9801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:45.985941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554745734421552:9801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:45.987433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554745734421552:9801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:45.988978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554745734421552:9801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:45.988987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554745734421552:9801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:45.988989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554745734421552:9801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:45.988993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:45.989212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:45.990621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:45.990633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:45.990634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:45.990636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:45.990639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1251 [2:7556554745658883954:8146]
2025-10-02T09:31:45.990647Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:45.990657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:45.990662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.990663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.990664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.990673Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:45.990676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:45.990680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:45.990711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.990715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.990717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.990719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:45.990720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:45.990799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:45.990804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:45.990810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:45.990813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1251
2025-10-02T09:31:45.990815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1251
2025-10-02T09:31:45.990816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:45.990831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:45.990843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421587:9801], now have 1 active actors on pipe
2025-10-02T09:31:45.990845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554745734421503:2446], now have 1 active actors on pipe
2025-10-02T09:31:45.990863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:45.990868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:45.990869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:45.990878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:45.990888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.990889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:45.990891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:45.990892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:45.990893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.990903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:45.990911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:45.990915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:45.990937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:45.990943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:45.990946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:45.990947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:45.990952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:45.990957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:45.990963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:45.990968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:45.990976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:45.990985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.991108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:45.991113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:45.991120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:45.991168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1252 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0
2025-10-02T09:31:45.991330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92875ff-54614-c8460f97-4f358435_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:45.993515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Write session: try to update token
2025-10-02T09:31:45.993525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.000303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.000318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.000319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.000320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.000327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:46.000330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:46.000332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554745658883948:8146]
2025-10-02T09:31:46.000353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.000356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.000357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.000358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.000361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.000363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.000475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.004185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId: src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.006135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.074666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029388891:9526]
2025-10-02T09:31:46.074859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1251, pipe: [1:7556554750029388891:9526]
2025-10-02T09:31:46.116479Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.116709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.116718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.116744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029388891:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.116915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:46.116927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:46.116953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.116952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.116970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1252 reason: error at write: Disconnected sessionId: src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0
2025-10-02T09:31:46.116990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029388891:9526]
2025-10-02T09:31:46.117089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1252 sessionId: src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0 is DEAD
2025-10-02T09:31:46.117212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:46.117221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Write session will restart in 0.007774s
2025-10-02T09:31:46.117236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Write session: Do CDS request
2025-10-02T09:31:46.117241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.122561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.123721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.123832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.123838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.123844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.123871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.123896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851333:8148]
2025-10-02T09:31:46.124237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.124408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.124432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.124607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.124638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.124641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.124642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.124643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.124643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.124644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.124644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.124645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.124646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.124646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.124646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.124647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.124650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.124657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.124658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.124661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.124662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.124664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.124666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.124668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.124670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.124672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.124674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.124676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.124680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.124684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.124687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.124690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.124692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.124694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.124696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.124699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.124701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.124704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.124706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.124708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.124710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.124713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.124715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.124718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.124720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.124723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.124727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.124731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.124739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.124744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.124751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.124756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.124785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.126127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.126205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.126214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1253
2025-10-02T09:31:46.126284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.126301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.126304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.126306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.126606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1253 sessionId:  describe result for acl check
2025-10-02T09:31:46.126631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.126636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.126638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.126642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029388942:9805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.127045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029388942:9805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.128238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029388942:9805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.131740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029388942:9805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.131749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029388942:9805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.131751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029388942:9805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.131755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.132278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.133712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.133724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.133725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.133727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.133731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1252 [2:7556554749953851333:8148]
2025-10-02T09:31:46.133739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.133749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.133754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.133757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.133759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.133767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.133773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.133777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.133808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.133813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.133814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.133816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.133817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.133854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.133859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.133866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.133874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.133885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.133900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029388977:9805], now have 1 active actors on pipe
2025-10-02T09:31:46.133905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029388892:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.133909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.133910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.133910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.133917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.133925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.133931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.133933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.133934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.133936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.133937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.133932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1252
2025-10-02T09:31:46.133951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.133932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1252
2025-10-02T09:31:46.133954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.133955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.133965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.133970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.133994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.134002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.134004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.134005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.134010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.134016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.134025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.134115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.134120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.134127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.134166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1253 partition: 0 MaxSeqNo: 36 sessionId: src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0
2025-10-02T09:31:46.134343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff547ff6-6e6a1c3-54366807-448ffa7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:46.136476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Write session: try to update token
2025-10-02T09:31:46.136485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.143364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.143376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.143377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.143379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.143383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.143386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.143388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851328:8148]
2025-10-02T09:31:46.143411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.143414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.143416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.143417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.143421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.143423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.143563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.146641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId: src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.148562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.216992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029388987:9526]
2025-10-02T09:31:46.217162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1252, pipe: [1:7556554750029388987:9526]
2025-10-02T09:31:46.258173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.258407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.258421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.258452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029388987:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.258610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.258620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.258651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:46.258653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:46.258664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029388987:9526]
2025-10-02T09:31:46.258701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1253 reason: error at write: Disconnected sessionId: src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0
2025-10-02T09:31:46.258866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1253 sessionId: src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0 is DEAD
2025-10-02T09:31:46.258987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:46.258995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Write session will restart in 0.008581s
2025-10-02T09:31:46.259009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Write session: Do CDS request
2025-10-02T09:31:46.259013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.264125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.265257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.265352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.265358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.265364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.265387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.265413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851420:8151]
2025-10-02T09:31:46.265762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.265922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.265945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.266133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.266165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.266168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.266169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.266170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.266170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.266171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.266173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.266174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.266174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.266175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.266175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.266175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.266178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.266185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.266187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.266189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.266191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.266193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.266195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.266197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.266199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.266201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.266203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.266205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.266209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.266213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.266216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.266219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.266221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.266223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.266228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.266231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.266234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.266236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.266241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.266244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.266247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.266253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.266255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.266258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.266261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.266266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.266268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.266271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.266276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.266278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.266280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.266283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.266300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.268126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.268204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.268214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1254
2025-10-02T09:31:46.268287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.268304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.268312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.268314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.268575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1254 sessionId:  describe result for acl check
2025-10-02T09:31:46.268597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.268602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.268603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.268605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029389039:9810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.269049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029389039:9810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.270531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029389039:9810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.273137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029389039:9810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.273146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029389039:9810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.273148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029389039:9810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.273151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.273678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.275135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.275146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.275147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.275149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.275153Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1253 [2:7556554749953851420:8151]
2025-10-02T09:31:46.275161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.275171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.275176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.275178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.275180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.275190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.275192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.275196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.275226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.275230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.275231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.275233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.275234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.275272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.275277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.275283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.275289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.275297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.275311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389074:9810], now have 1 active actors on pipe
2025-10-02T09:31:46.275317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029388988:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.275321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.275322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.275323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.275330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.275337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.275346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.275347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.275332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1253
2025-10-02T09:31:46.275336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1253
2025-10-02T09:31:46.275354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.275360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.275362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.275371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.275374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.275381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.275390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.275394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.275407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.275415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.275418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.275421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.275426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.275433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.275445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.275527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.275533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.275540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.275618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1254 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0
2025-10-02T09:31:46.275795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a704a9e7-9cfb463d-5fbfb509-1b5a432c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:46.277999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Write session: try to update token
2025-10-02T09:31:46.278017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.284936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.284948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.284949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.284950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.284955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.284958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.284961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851415:8151]
2025-10-02T09:31:46.284982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.284988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.284991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.284991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.284992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.284994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.285111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.288662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId: src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.290815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.358810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029389082:9526]
2025-10-02T09:31:46.358998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1253, pipe: [1:7556554750029389082:9526]
2025-10-02T09:31:46.400585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.400824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.400835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.400862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389082:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.401012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.401018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.401051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029389082:9526]
2025-10-02T09:31:46.401052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:46.401115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1254 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0
2025-10-02T09:31:46.401247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1254 sessionId: src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0 is DEAD
2025-10-02T09:31:46.401365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:46.401374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Write session will restart in 0.007547s
2025-10-02T09:31:46.401391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Write session: Do CDS request
2025-10-02T09:31:46.401395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.406417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.407550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.407652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.407659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.407665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.407688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.407715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851506:8153]
2025-10-02T09:31:46.408056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.408217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.408238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.408413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.408443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.408447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.408448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.408448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.408449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.408451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.408451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.408452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.408452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.408453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.408453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.408454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.408457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.408463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.408465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.408467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.408469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.408471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.408473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.408475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.408477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.408479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.408481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.408483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.408486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.408490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.408493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.408496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.408498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.408500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.408502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.408505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.408507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.408510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.408512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.408515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.408518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.408521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.408523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.408525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.408528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.408533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.408535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.408538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.408540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.408546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.408550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.408553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.408570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.410123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.410210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.410220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1255
2025-10-02T09:31:46.410295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.410315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.410321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.410324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.410576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1255 sessionId:  describe result for acl check
2025-10-02T09:31:46.410599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.410603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.410604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.410607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029389135:9814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.410957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029389135:9814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.412400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029389135:9814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.415415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029389135:9814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.415424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029389135:9814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.415425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029389135:9814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.415429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.416001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.417489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.417500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.417502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.417505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.417508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1254 [2:7556554749953851506:8153]
2025-10-02T09:31:46.417517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.417527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.417532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.417534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.417535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.417545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.417551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.417556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.417593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.417598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.417598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.417600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.417601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.417637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.417641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.417648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.417653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.417664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.417677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.417682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.417683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.417687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.417695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.417703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.417706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.417706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.417707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.417708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.417716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389083:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.417718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389170:9814], now have 1 active actors on pipe
2025-10-02T09:31:46.417732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.417738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.417745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.417745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1254
2025-10-02T09:31:46.417748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1254
2025-10-02T09:31:46.417796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.417801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.417814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e818a385-f53e47f8-6ad56327-d5041f43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.417820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.417824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.417825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.417830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.417834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.417845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.417958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.417962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.417969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.418027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1255 partition: 0 MaxSeqNo: 36 sessionId: src_id|e818a385-f53e47f8-6ad56327-d5041f43_0
2025-10-02T09:31:46.418230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5a7f1a-b5a09f44-f12d416b-62973917_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e818a385-f53e47f8-6ad56327-d5041f43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:46.420406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Write session: try to update token
2025-10-02T09:31:46.420416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.427256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.427277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.427279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.427281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.427287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.427291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.427294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851501:8153]
2025-10-02T09:31:46.427326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.427335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.427337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.427343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.427352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.427370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.427475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.430904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId: src_id|e818a385-f53e47f8-6ad56327-d5041f43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.433057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.501162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029389177:9526]
2025-10-02T09:31:46.501414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1254, pipe: [1:7556554750029389177:9526]
2025-10-02T09:31:46.547442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.547733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.547745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.547773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389177:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.547961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.547975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029389177:9526]
2025-10-02T09:31:46.547995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:46.547997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:46.547994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.548050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1255 reason: error at write: Disconnected sessionId: src_id|e818a385-f53e47f8-6ad56327-d5041f43_0
2025-10-02T09:31:46.548214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1255 sessionId: src_id|e818a385-f53e47f8-6ad56327-d5041f43_0 is DEAD
2025-10-02T09:31:46.548302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:46.548311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Write session will restart in 0.005086s
2025-10-02T09:31:46.548325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Write session: Do CDS request
2025-10-02T09:31:46.548329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.553871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.554417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.554489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.554498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1256
2025-10-02T09:31:46.554564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.554584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.554590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.554593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.554880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1256 sessionId:  describe result for acl check
2025-10-02T09:31:46.554905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.554909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.554910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.554913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029389231:9820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.555265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029389231:9820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.555282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.555396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.555403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.555409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.555441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.555471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851593:8155]
2025-10-02T09:31:46.555834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.556010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.556035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.556226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.556259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.556263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.556264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.556264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.556265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.556266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.556266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.556267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.556268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.556268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.556269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.556270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.556272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.556280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.556282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.556284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.556286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.556289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.556291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.556293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.556295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.556297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.556299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.556301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.556304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.556308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.556312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.556315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.556317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.556320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.556322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.556325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.556327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.556330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.556333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.556335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.556338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.556340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.556343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.556346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.556348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.556350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.556353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.556356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.556359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.556361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.556364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.556366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.556384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.556774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029389231:9820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.561262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029389231:9820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.561270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029389231:9820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.561272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029389231:9820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.561275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.563949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.565470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.565481Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.565483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.565485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.565489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1255 [2:7556554749953851593:8155]
2025-10-02T09:31:46.565496Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.565509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.565514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.565516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.565517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.565526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.565532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.565537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.565570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.565575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.565576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.565578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.565580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.565617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.565622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.565628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.565633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.565645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.565658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.565662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.565663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.565668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.565674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.565677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389182:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.565681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.565681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389270:9820], now have 1 active actors on pipe
2025-10-02T09:31:46.565682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.565687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.565699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.565705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.565719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.565710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1255
2025-10-02T09:31:46.565724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.565711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1255
2025-10-02T09:31:46.565735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.565745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.565746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.565764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|185985d7-e5d449cf-e500932f-22824781_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.565771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.565773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.565774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.565780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.565789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.565796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.565878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.565883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.565891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.565943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1256 partition: 0 MaxSeqNo: 36 sessionId: src_id|185985d7-e5d449cf-e500932f-22824781_0
2025-10-02T09:31:46.566160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e818a385-f53e47f8-6ad56327-d5041f43_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|185985d7-e5d449cf-e500932f-22824781_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:46.568447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Write session: try to update token
2025-10-02T09:31:46.568460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.575254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.575268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.575270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.575271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.575276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.575279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.575281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851588:8155]
2025-10-02T09:31:46.575304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.575306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.575308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.575309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.575310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.575311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.575433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.579288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId: src_id|185985d7-e5d449cf-e500932f-22824781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.581242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.648092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029389277:9526]
2025-10-02T09:31:46.648215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1255, pipe: [1:7556554750029389277:9526]
2025-10-02T09:31:46.691773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.691982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.691991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.692017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389277:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.692171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.692173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.692206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029389277:9526]
2025-10-02T09:31:46.692205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:46.692208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:46.692256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1256 reason: error at write: Disconnected sessionId: src_id|185985d7-e5d449cf-e500932f-22824781_0
2025-10-02T09:31:46.692402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1256 sessionId: src_id|185985d7-e5d449cf-e500932f-22824781_0 is DEAD
2025-10-02T09:31:46.692518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:46.692526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Write session will restart in 0.008594s
2025-10-02T09:31:46.692544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Write session: Do CDS request
2025-10-02T09:31:46.692548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.697666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.698746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.698904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.698912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.698919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.698952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.698976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851693:8157]
2025-10-02T09:31:46.699354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.699511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.699534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.699727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.699760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.699764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.699764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.699765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.699765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.699766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.699767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.699767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.699768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.699768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.699769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.699769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.699772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.699778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.699780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.699782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.699784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.699786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.699788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.699790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.699792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.699794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.699796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.699798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.699802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.699806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.699809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.699812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.699816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.699820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.699825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.699829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.699833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.699837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.699841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.699848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.699850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.699853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.699859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.699862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.699864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.699867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.699872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.699875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.699877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.699880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.699885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.699888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.699905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.702148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.702223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.702234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1257
2025-10-02T09:31:46.702312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.702332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.702339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.702341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.702616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1257 sessionId:  describe result for acl check
2025-10-02T09:31:46.702639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.702643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.702645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.702647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029389333:9824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.702971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029389333:9824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.704150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029389333:9824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.706992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029389333:9824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.707000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029389333:9824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.707002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029389333:9824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.707005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.707562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.709021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.709034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.709036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.709039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.709044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1256 [2:7556554749953851693:8157]
2025-10-02T09:31:46.709054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.709069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.709075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.709077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.709078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.709089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.709096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.709100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.709132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.709137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.709138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.709140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.709142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.709204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.709209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.709217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.709223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.709236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.709251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389368:9824], now have 1 active actors on pipe
2025-10-02T09:31:46.709257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389279:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.709260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.709261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.709262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.709255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1256
2025-10-02T09:31:46.709273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.709258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1256
2025-10-02T09:31:46.709283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.709288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.709290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.709291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.709299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.709305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.709323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.709331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.709338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.709405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.709412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.709429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.709436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.709438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.709440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.709445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.709454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.709465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.709560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.709569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.709580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.709646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1257 partition: 0 MaxSeqNo: 36 sessionId: src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0
2025-10-02T09:31:46.709841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185985d7-e5d449cf-e500932f-22824781_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:46.712084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Write session: try to update token
2025-10-02T09:31:46.712095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.719045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.719061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.719062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.719063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.719069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.719071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.719074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851688:8157]
2025-10-02T09:31:46.719095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.719098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.719099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.719100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.719104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.719106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.719214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.722595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId: src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.724502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.792474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029389402:9526]
2025-10-02T09:31:46.792632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1256, pipe: [1:7556554750029389402:9526]
2025-10-02T09:31:46.837648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.837915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.837924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.837951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389402:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.838084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.838134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029389402:9526]
2025-10-02T09:31:46.838156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.838162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:46.838222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0
2025-10-02T09:31:46.838369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1257 sessionId: src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0 is DEAD
2025-10-02T09:31:46.838508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:46.838517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Write session will restart in 0.008621s
2025-10-02T09:31:46.838532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Write session: Do CDS request
2025-10-02T09:31:46.838536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.843622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.844823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.844949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.844956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.844962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.844992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.845016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851817:8172]
2025-10-02T09:31:46.845368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.845533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.845555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.845735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.845783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.845789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.845790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.845792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.845793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.845793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.845794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.845795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.845796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.845797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.845797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.845798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.845801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.845808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.845810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.845812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.845814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.845816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.845818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.845820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.845822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.845824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.845826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.845828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.845833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.845837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.845840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.845843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.845845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.845848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.845850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.845852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.845855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.845858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.845865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.845868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.845870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.845873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.845875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.845878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.845880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.845883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.845885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.845890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.845893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.845896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.845898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.845901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.845919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.848227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.848535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.848545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1258
2025-10-02T09:31:46.848646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.848667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.848671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.848674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.848954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1258 sessionId:  describe result for acl check
2025-10-02T09:31:46.848981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.848987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.848988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.848992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029389470:9837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.849342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029389470:9837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.850734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029389470:9837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.852926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029389470:9837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.852935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029389470:9837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.852937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029389470:9837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.852941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.853489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.854887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.854897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.854899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.854901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.854904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1257 [2:7556554749953851817:8172]
2025-10-02T09:31:46.854912Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.854923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.854926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.854928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.854929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.854938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.854944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.854948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.854977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.854982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.854983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.854985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.854986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.855024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.855029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.855035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.855041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.855049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.855060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389415:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.855063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389504:9837], now have 1 active actors on pipe
2025-10-02T09:31:46.855066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.855069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.855070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.855077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.855084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.855093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.855094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.855096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.855097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.855097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.855110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.855113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.855101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1257
2025-10-02T09:31:46.855105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1257
2025-10-02T09:31:46.855122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.855156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.855162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.855177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.855184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.855186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.855187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.855192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.855197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.855207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.855294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.855299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.855307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.855361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1258 partition: 0 MaxSeqNo: 36 sessionId: src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0
2025-10-02T09:31:46.855544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f1c3a0-34c0875d-e272a06a-3f8b5fc6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:46.857691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Write session: try to update token
2025-10-02T09:31:46.857701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:46.864334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:46.864347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:46.864349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:46.864350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:46.864355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.864358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.864360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851812:8172]
2025-10-02T09:31:46.864380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:46.864383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.864384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:46.864384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:46.864387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:46.864389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:46.864500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:46.867915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId: src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:46.870041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:46.938398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554750029389516:9526]
2025-10-02T09:31:46.938577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1257, pipe: [1:7556554750029389516:9526]
2025-10-02T09:31:46.981769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:46.981992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.982004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.982031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389516:9526], now have 1 active actors on pipe
2025-10-02T09:31:46.982151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:46.982176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554750029389516:9526]
2025-10-02T09:31:46.982202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:46.982208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:46.982253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1258 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0
2025-10-02T09:31:46.982387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1258 sessionId: src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0 is DEAD
2025-10-02T09:31:46.982516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:46.982525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Write session will restart in 0.008524s
2025-10-02T09:31:46.982542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Write session: Do CDS request
2025-10-02T09:31:46.982546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:46.987372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:46.988629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:46.988725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:46.988732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:46.988737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:46.988761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:46.988785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554749953851910:8175]
2025-10-02T09:31:46.989146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:46.989312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:46.989334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:46.989513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:46.989542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.989546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.989547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.989547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.989548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.989548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.989549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.989549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.989550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.989551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.989551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.989552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.989555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.989561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.989564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.989566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.989568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.989570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.989572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.989574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.989576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.989578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.989580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.989582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.989586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.989590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:46.989593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.989596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:46.989600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.989602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:46.989604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.989607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:46.989610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.989613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:46.989615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.989617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:46.989620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.989623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:46.989625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.989628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:46.989630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.989633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:46.989638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.989641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.989643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.989646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.989651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.989653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.989671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:46.992160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.992321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:46.992331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1259
2025-10-02T09:31:46.992402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:46.992419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:46.992425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:46.992428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:46.992704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1259 sessionId:  describe result for acl check
2025-10-02T09:31:46.992722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:46.992727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:46.992728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:46.992731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554750029389573:9841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:46.993071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554750029389573:9841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:46.994646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554750029389573:9841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:46.996620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554750029389573:9841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:46.996630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554750029389573:9841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:46.996632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554750029389573:9841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:46.996636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:46.997129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:46.998564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:46.998575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:46.998577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:46.998579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:46.998582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1258 [2:7556554749953851910:8175]
2025-10-02T09:31:46.998589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:46.998600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:46.998601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.998603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.998604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.998613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:46.998619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:46.998623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:46.998655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.998660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.998661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.998663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:46.998664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:46.998700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:46.998705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:46.998712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:46.998717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:46.998727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:46.998741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389517:2446], now have 1 active actors on pipe
2025-10-02T09:31:46.998746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554750029389608:9841], now have 1 active actors on pipe
2025-10-02T09:31:46.998750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:46.998752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:46.998753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:46.998760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:46.998751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1258
2025-10-02T09:31:46.998768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1258
2025-10-02T09:31:46.998768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:46.998771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:46.998774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:46.998775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:46.998778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:46.998780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:46.998799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:46.998806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:46.998811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:46.998814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.998816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.998838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:46.998855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:46.998860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:46.998861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:46.998866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:46.998873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:46.998886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.998963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:46.998969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:46.998976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:46.999013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1259 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0
2025-10-02T09:31:46.999194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3a3d00-283bf8d2-e6d7c93a-e3aff603_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.001358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Write session: try to update token
2025-10-02T09:31:47.001369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.008377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.008393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.008395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.008396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.008401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:47.008404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:47.008407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554749953851905:8175]
2025-10-02T09:31:47.008430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.008433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.008435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.008437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.008442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.008444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.008545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.011488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId: src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.013389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.082274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324356913:9526]
2025-10-02T09:31:47.082475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1258, pipe: [1:7556554754324356913:9526]
2025-10-02T09:31:47.123076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.123352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.123362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.123386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324356913:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.123527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.123561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324356913:9526]
2025-10-02T09:31:47.123586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.123608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:47.123689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1259 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0
2025-10-02T09:31:47.123881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1259 sessionId: src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0 is DEAD
2025-10-02T09:31:47.123978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:47.123987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Write session will restart in 0.005213s
2025-10-02T09:31:47.124000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Write session: Do CDS request
2025-10-02T09:31:47.124005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.128630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.129713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.129812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.129819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.129824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.129848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.129874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819296:8177]
2025-10-02T09:31:47.130102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.130182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.130190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1260
2025-10-02T09:31:47.130222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.130263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.130280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.130286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.130289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.130413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.130437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.130550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1260 sessionId:  describe result for acl check
2025-10-02T09:31:47.130571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.130575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.130577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.130580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324356969:9845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.130612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.130642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.130646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.130646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.130647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.130647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.130648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.130649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.130649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.130650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.130652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.130654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.130662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.130665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.130667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.130669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.130671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.130673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.130675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.130677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.130679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.130681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.130683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.130687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.130691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.130694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.130697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.130701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.130703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.130705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.130708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.130714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.130717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.130719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.130722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.130727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.130730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.130732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.130736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.130741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.130744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.130746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.130749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.130753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.130755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.130759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.130762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.130780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.130936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324356969:9845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.132390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324356969:9845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.137154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324356969:9845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.137164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324356969:9845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.137166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324356969:9845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.137169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.138345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.139764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.139775Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.139777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.139779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.139782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1259 [2:7556554754248819296:8177]
2025-10-02T09:31:47.139790Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.139799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.139803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.139804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.139805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.139814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.139820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.139825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.139860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.139864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.139865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.139867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.139868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.139906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.139911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.139918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.139923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.139935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.139949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324356914:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.139954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357005:9845], now have 1 active actors on pipe
2025-10-02T09:31:47.139957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.139959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.139960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.139964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1259
2025-10-02T09:31:47.139967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.139979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.139982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.139984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.139986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.139986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.139987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.140007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.140014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.140019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.140008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1259
2025-10-02T09:31:47.140031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.140036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.140051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.140059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.140061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.140062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.140067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.140074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.140082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.140171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.140176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.140183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.140231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1260 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0
2025-10-02T09:31:47.140409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1a964d-6f5310de-54533ae5-6d99be3d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.142704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Write session: try to update token
2025-10-02T09:31:47.142714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.149522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.149539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.149541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.149542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.149546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.149549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.149551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819291:8177]
2025-10-02T09:31:47.149572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.149575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.149578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.149579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.149581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.149581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.149695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.153505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId: src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.155427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.223603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324357016:9526]
2025-10-02T09:31:47.223791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1259, pipe: [1:7556554754324357016:9526]
2025-10-02T09:31:47.264871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.265096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.265105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.265133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357016:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.265280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.265314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:47.265325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:47.265371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1260 reason: error at write: Disconnected sessionId: src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0
2025-10-02T09:31:47.265484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.265522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1260 sessionId: src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0 is DEAD
2025-10-02T09:31:47.265542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324357016:9526]
2025-10-02T09:31:47.265647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:47.265656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Write session will restart in 0.006560s
2025-10-02T09:31:47.265672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Write session: Do CDS request
2025-10-02T09:31:47.265676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.270520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.271741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.271841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.271847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.271853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.271879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.271902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819391:8180]
2025-10-02T09:31:47.272248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.272422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.272444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.272630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.272660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.272664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.272665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.272667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.272667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.272668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.272668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.272669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.272669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.272670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.272670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.272671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.272674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.272681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.272683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.272685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.272687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.272689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.272691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.272693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.272695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.272697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.272699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.272701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.272704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.272708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.272711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.272714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.272716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.272719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.272721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.272723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.272725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.272728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.272732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.272734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.272736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.272739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.272741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.272744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.272746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.272749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.272751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.272753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.272755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.272757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.272760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.272767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.272784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.273059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.273180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.273189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1261
2025-10-02T09:31:47.273260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.273277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.273283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.273286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.273627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1261 sessionId:  describe result for acl check
2025-10-02T09:31:47.273660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.273666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.273667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.273672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324357075:9850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.274169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324357075:9850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.275739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324357075:9850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.279622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324357075:9850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.279631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324357075:9850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.279634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324357075:9850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.279637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.280141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.281571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.281582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.281583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.281585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.281588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1260 [2:7556554754248819391:8180]
2025-10-02T09:31:47.281596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.281605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.281606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.281608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.281610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.281618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.281624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.281628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.281660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.281665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.281666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.281668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.281669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.281706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.281710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.281718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.281723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.281732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.281748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357017:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.281754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357108:9850], now have 1 active actors on pipe
2025-10-02T09:31:47.281758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.281760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.281761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.281769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.281779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.281781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.281784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.281785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.281788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.281789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.281784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1260
2025-10-02T09:31:47.281803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.281808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.281809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.281836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1260
2025-10-02T09:31:47.281870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.281875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.281888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.281895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.281898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.281902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.281907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.281912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.281920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.282015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.282021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.282029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.282084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1261 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0
2025-10-02T09:31:47.282262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fbd3ed-c2a0f07-8e2103fc-49133416_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.284708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Write session: try to update token
2025-10-02T09:31:47.284722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.295103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:47.295114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.295120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.295147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:47.295160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:47.295287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:47.295297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId: src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.295405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:47.295521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:47.295682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:47.295838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:47.295863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:47.297187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.297305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.297313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.297328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:47.297381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:47.299096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.299107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.299111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.299112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.299116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.299119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.299121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819386:8180]
2025-10-02T09:31:47.299140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.299146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.299147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.299148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.299149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.299151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.299257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.365906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324357117:9526]
2025-10-02T09:31:47.366034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1260, pipe: [1:7556554754324357117:9526]
2025-10-02T09:31:47.410124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.416093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.416113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.416244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.416293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.416347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.416400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.416779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.416789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.416858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.416906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.416957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.417008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.417047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.417054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.417106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.417153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.417204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.417255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.417291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.417296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.417349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.417398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.417445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.417494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.417531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.417536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.417587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.417636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.417685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.417756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.417792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.417797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.417874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.417926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.417977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.418028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.418064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.418069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.418119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.418167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.418219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.418266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.418347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.418351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.418400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.418447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.418494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.418572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.418606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.418611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.418659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.418704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.418752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.418797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.418833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.418837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.418893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:47.418941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:47.418988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:47.419034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:47.419083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:47.419088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:47.419120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357117:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.419311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:47.419322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:47.419340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1261 reason: error at write: Disconnected sessionId: src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0
2025-10-02T09:31:47.419352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.419405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324357117:9526]
2025-10-02T09:31:47.419457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.419475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1261 sessionId: src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0 is DEAD
2025-10-02T09:31:47.419587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:47.419596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Write session will restart in 0.007323s
2025-10-02T09:31:47.419610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Write session: Do CDS request
2025-10-02T09:31:47.419614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.425604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.426711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.426808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.426814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.426820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.426857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.426883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819483:8182]
2025-10-02T09:31:47.427236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.427388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.427411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.427591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.427619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.427623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.427624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.427624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.427625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.427625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.427626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.427626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.427627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.427628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.427628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.427629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.427632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.427639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.427641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.427645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.427647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.427650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.427651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.427654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.427656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.427658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.427660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.427662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.427666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.427670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.427673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.427676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.427678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.427682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.427684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.427687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.427692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.427695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.427697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.427700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.427703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.427706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.427708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.427711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.427716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.427719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.427721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.427724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.427729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.427732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.427735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.427737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.427757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.428132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.428239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.428248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1262
2025-10-02T09:31:47.428332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.428351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.428354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.428356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.428692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1262 sessionId:  describe result for acl check
2025-10-02T09:31:47.428710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.428715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.428716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.428719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324357177:9854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.429093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324357177:9854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.430696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324357177:9854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.434920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324357177:9854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.434931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324357177:9854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.434933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324357177:9854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.434936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.435423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.436832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.436842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.436843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.436845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.436849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1261 [2:7556554754248819483:8182]
2025-10-02T09:31:47.436856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.436866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.436867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.436869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.436870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.436879Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.436882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.436886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.436917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.436923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.436924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.436926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.436927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.436965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.436969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.436976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.436981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.436990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.437005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357118:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.437010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357212:9854], now have 1 active actors on pipe
2025-10-02T09:31:47.437014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.437015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.437016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.437023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.437033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.437035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.437037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.437038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.437043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.437048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.437038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1261
2025-10-02T09:31:47.437063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.437068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.437069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.437078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.437068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1261
2025-10-02T09:31:47.437081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.437107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f79909bc-76dc1060-1faebfa8-26a38530_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.437113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.437116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.437116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.437122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.437127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.437137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.437228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.437233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.437240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.437287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1262 partition: 0 MaxSeqNo: 36 sessionId: src_id|f79909bc-76dc1060-1faebfa8-26a38530_0
2025-10-02T09:31:47.437489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae095230-6f85eaa4-dc19b0c6-c2e1cd0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f79909bc-76dc1060-1faebfa8-26a38530_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.439630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Write session: try to update token
2025-10-02T09:31:47.439655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.446499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.446514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.446516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.446517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.446523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.446526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.446529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819478:8182]
2025-10-02T09:31:47.446550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.446553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.446555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.446559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.446563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.446565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.446673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.450159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId: src_id|f79909bc-76dc1060-1faebfa8-26a38530_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.452093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.519532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324357219:9526]
2025-10-02T09:31:47.519733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1261, pipe: [1:7556554754324357219:9526]
2025-10-02T09:31:47.561131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.561388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.561399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.561424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357219:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.561604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:47.561616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:47.561657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324357219:9526]
2025-10-02T09:31:47.561664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1262 reason: error at write: Disconnected sessionId: src_id|f79909bc-76dc1060-1faebfa8-26a38530_0
2025-10-02T09:31:47.561678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.561695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.561793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1262 sessionId: src_id|f79909bc-76dc1060-1faebfa8-26a38530_0 is DEAD
2025-10-02T09:31:47.561920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:47.561928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Write session will restart in 0.007481s
2025-10-02T09:31:47.561942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Write session: Do CDS request
2025-10-02T09:31:47.561947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.567235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.568350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.568446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.568453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.568458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.568488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.568513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819577:8184]
2025-10-02T09:31:47.568873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.569050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.569072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.569248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.569275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.569279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.569280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.569280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.569281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.569281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.569282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.569283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.569283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.569284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.569284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.569285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.569287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.569294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.569296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.569298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.569301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.569303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.569305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.569307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.569309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.569311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.569313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.569315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.569319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.569323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.569326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.569329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.569331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.569334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.569336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.569339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.569341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.569345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.569347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.569350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.569351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.569354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.569356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.569358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.569361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.569363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.569365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.569368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.569370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.569372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.569374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.569377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.569394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.570122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.570229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.570240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1263
2025-10-02T09:31:47.570343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.570360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.570366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.570369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.570674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1263 sessionId:  describe result for acl check
2025-10-02T09:31:47.570695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.570699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.570700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.570703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324357281:9858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.571090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324357281:9858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.572684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324357281:9858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.576224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324357281:9858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.576234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324357281:9858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.576237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324357281:9858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.576240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.576715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.578129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.578141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.578142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.578144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.578147Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1262 [2:7556554754248819577:8184]
2025-10-02T09:31:47.578156Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.578167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.578171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.578173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.578174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.578183Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.578189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.578193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.578224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.578230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.578231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.578233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.578234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.578270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.578275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.578281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.578286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.578294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.578308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357221:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.578314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357315:9858], now have 1 active actors on pipe
2025-10-02T09:31:47.578318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.578322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.578324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.578331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.578332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1262
2025-10-02T09:31:47.578341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.578343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.578345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.578346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.578352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.578354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.578369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.578373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.578375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.578381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1262
2025-10-02T09:31:47.578393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.578398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.578412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6d9ed97-828415d-86d75acb-2eff8217_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.578419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.578421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.578425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.578430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.578439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.578450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.578530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.578535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.578542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.578597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1263 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6d9ed97-828415d-86d75acb-2eff8217_0
2025-10-02T09:31:47.578769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79909bc-76dc1060-1faebfa8-26a38530_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6d9ed97-828415d-86d75acb-2eff8217_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.580909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Write session: try to update token
2025-10-02T09:31:47.580918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.587572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.587587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.587590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.587591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.587595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.587598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.587600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819572:8184]
2025-10-02T09:31:47.587622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.587629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.587630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.587630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.587634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.587636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.587747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.591271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId: src_id|d6d9ed97-828415d-86d75acb-2eff8217_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.593226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.661858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324357323:9526]
2025-10-02T09:31:47.662024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1262, pipe: [1:7556554754324357323:9526]
2025-10-02T09:31:47.699914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.700112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.700120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.700143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357323:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.700249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.700257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.700293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:47.700316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324357323:9526]
2025-10-02T09:31:47.700338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1263 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6d9ed97-828415d-86d75acb-2eff8217_0
2025-10-02T09:31:47.700466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1263 sessionId: src_id|d6d9ed97-828415d-86d75acb-2eff8217_0 is DEAD
2025-10-02T09:31:47.700581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:47.700590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Write session will restart in 0.009251s
2025-10-02T09:31:47.700606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Write session: Do CDS request
2025-10-02T09:31:47.700611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.705952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.707155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.707302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.707309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.707315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.707345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.707367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819684:8187]
2025-10-02T09:31:47.707704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.707861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.707883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.708079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.708109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.708112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.708113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.708114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.708115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.708115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.708116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.708116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.708117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.708118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.708118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.708119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.708121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.708128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.708130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.708133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.708135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.708137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.708139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.708141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.708143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.708146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.708147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.708149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.708154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.708158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.708161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.708163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.708165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.708168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.708170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.708172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.708174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.708177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.708179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.708181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.708183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.708186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.708188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.708191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.708193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.708199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.708201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.708203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.708205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.708208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.708211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.708213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.708232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.711191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.711320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.711329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1264
2025-10-02T09:31:47.711408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.711430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.711436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.711439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.711707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1264 sessionId:  describe result for acl check
2025-10-02T09:31:47.711725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.711730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.711731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.711733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324357386:9862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.712058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324357386:9862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.713455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324357386:9862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.715462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324357386:9862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.715471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324357386:9862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.715473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324357386:9862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.715476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.715616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.717028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.717038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.717039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.717041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.717044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1263 [2:7556554754248819684:8187]
2025-10-02T09:31:47.717052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.717061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.717064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.717066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.717067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.717076Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.717082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.717086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.717116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.717121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.717122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.717124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.717125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.717161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.717166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.717172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.717177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.717188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.717203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357325:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.717208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357420:9862], now have 1 active actors on pipe
2025-10-02T09:31:47.717212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.717214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.717215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.717222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.717231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.717234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.717236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.717237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.717234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1263
2025-10-02T09:31:47.717241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.717243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.717256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.717260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.717262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.717281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1263
2025-10-02T09:31:47.717298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.717303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.717318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.717324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.717326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.717327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.717331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.717339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.717350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.717454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.717458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.717466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.717517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1264 partition: 0 MaxSeqNo: 36 sessionId: src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0
2025-10-02T09:31:47.717686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9ed97-828415d-86d75acb-2eff8217_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.719789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Write session: try to update token
2025-10-02T09:31:47.719799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.726469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.726487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.726488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.726489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.726496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.726498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.726500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819679:8187]
2025-10-02T09:31:47.726523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.726527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.726529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.726530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.726530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.726532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.726648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.729804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId: src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.731762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.800815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324357443:9526]
2025-10-02T09:31:47.800933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1263, pipe: [1:7556554754324357443:9526]
2025-10-02T09:31:47.837943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.838150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.838159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.838183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357443:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.838290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.838317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.838350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324357443:9526]
2025-10-02T09:31:47.838365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:47.838413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1264 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0
2025-10-02T09:31:47.838544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1264 sessionId: src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0 is DEAD
2025-10-02T09:31:47.838667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:47.838676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Write session will restart in 0.009467s
2025-10-02T09:31:47.838689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Write session: Do CDS request
2025-10-02T09:31:47.838694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.843621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.844762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.844876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.844883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.844889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.844916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.844936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819814:8199]
2025-10-02T09:31:47.845271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.845429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.845452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.845623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.845651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.845654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.845655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.845656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.845656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.845657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.845657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.845658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.845658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.845658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.845659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.845659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.845662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.845668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.845670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.845673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.845675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.845677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.845679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.845681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.845683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.845686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.845688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.845690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.845693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.845697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.845700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.845703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.845704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.845707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.845709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.845712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.845714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.845717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.845719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.845721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.845725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.845727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.845729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.845732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.845734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.845736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.845738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.845741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.845743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.845752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.845755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.845759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.845777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.849129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.849215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.849225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1265
2025-10-02T09:31:47.849296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.849313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.849318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.849321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.849586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1265 sessionId:  describe result for acl check
2025-10-02T09:31:47.849604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.849609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.849610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.849612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324357533:9875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.849911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324357533:9875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.851309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324357533:9875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.853186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.853302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324357533:9875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.853312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324357533:9875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.853313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324357533:9875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.853317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.854594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.854605Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.854607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.854609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.854613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1264 [2:7556554754248819814:8199]
2025-10-02T09:31:47.854621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.854630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.854631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.854633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.854634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.854643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.854646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.854650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.854683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.854687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.854688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.854690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.854692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.854728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.854733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.854739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.854745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.854755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.854768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357459:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.854773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357565:9875], now have 1 active actors on pipe
2025-10-02T09:31:47.854777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.854778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.854779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.854786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.854793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.854799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.854801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.854802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.854805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.854790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1264
2025-10-02T09:31:47.854808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.854821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.854826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.854828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.854858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.854863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.854834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1264
2025-10-02T09:31:47.854876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.854885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.854888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.854889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.854894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.854899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.854906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.855003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.855008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.855014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.855064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1265 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0
2025-10-02T09:31:47.855239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15cc95b-67a4bac3-ee860335-8edd7743_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.857463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Write session: try to update token
2025-10-02T09:31:47.857472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:47.864229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:47.864246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:47.864247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:47.864250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:47.864257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.864260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.864263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819809:8199]
2025-10-02T09:31:47.864286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:47.864289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:47.864291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:47.864298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:47.864302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.864303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:47.864410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:47.868673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId: src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:47.870581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:47.938327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554754324357576:9526]
2025-10-02T09:31:47.938505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1264, pipe: [1:7556554754324357576:9526]
2025-10-02T09:31:47.974632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:47.974885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.974894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.974920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357576:9526], now have 1 active actors on pipe
2025-10-02T09:31:47.975049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:47.975079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:47.975113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554754324357576:9526]
2025-10-02T09:31:47.975131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:47.975199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1265 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0
2025-10-02T09:31:47.975370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1265 sessionId: src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0 is DEAD
2025-10-02T09:31:47.975481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:47.975488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Write session will restart in 0.009988s
2025-10-02T09:31:47.975502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Write session: Do CDS request
2025-10-02T09:31:47.975506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:47.980761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:47.981940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:47.982079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:47.982087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:47.982093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:47.982125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:47.982149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554754248819912:8204]
2025-10-02T09:31:47.982493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:47.982677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:47.982698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:47.982882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:47.982912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.982916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.982916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.982917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.982918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.982918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.982919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.982920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.982920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.982922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.982922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.982923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.982926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.982932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.982935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.982937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.982938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.982941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.982942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.982944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.982946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.982949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.982951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.982953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.982957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.982961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:47.982964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.982967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:47.982970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.982972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:47.982975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.982977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:47.982979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.982982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:47.982984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.982987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:47.982990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.982992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:47.982994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.982997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:47.982999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.983002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:47.983004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.983006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.983009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.983013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.983015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.983018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.983033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:47.986113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.986209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:47.986218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1266
2025-10-02T09:31:47.986286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:47.986304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:47.986309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:47.986311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:47.986916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1266 sessionId:  describe result for acl check
2025-10-02T09:31:47.986935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:47.986939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:47.986940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:47.986943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554754324357641:9879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:47.987285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554754324357641:9879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:47.988951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554754324357641:9879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:47.990452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:47.990915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554754324357641:9879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:47.990925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554754324357641:9879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:47.990928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554754324357641:9879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:47.990932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:47.991857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:47.991868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:47.991870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:47.991873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:47.991877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1265 [2:7556554754248819912:8204]
2025-10-02T09:31:47.991884Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:47.991894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:47.991899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.991901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.991902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.991912Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:47.991915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:47.991920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:47.991949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.991953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.991954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.991956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:47.991958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:47.991994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:47.991998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:47.992005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:47.992010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:47.992017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:47.992032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357674:9879], now have 1 active actors on pipe
2025-10-02T09:31:47.992037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554754324357577:2446], now have 1 active actors on pipe
2025-10-02T09:31:47.992041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:47.992042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:47.992043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:47.992051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:47.992044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1265
2025-10-02T09:31:47.992059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1265
2025-10-02T09:31:47.992061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:47.992062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:47.992064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:47.992065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:47.992071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:47.992073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:47.992097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.992102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.992111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:47.992118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:47.992134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:47.992136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:47.992140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:47.992143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:47.992144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:47.992149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:47.992153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:47.992168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.992262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:47.992266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:47.992274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:47.992322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1266 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0
2025-10-02T09:31:47.992511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d89da-cec5abf8-f75ef608-7f29ad78_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:47.994693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Write session: try to update token
2025-10-02T09:31:47.994704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.001387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.001400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.001402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.001403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.001410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:48.001412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:48.001415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554754248819907:8204]
2025-10-02T09:31:48.001441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.001442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.001446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.001448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.001450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.001452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.001587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.004980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId: src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.006875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.075036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619324979:9526]
2025-10-02T09:31:48.075217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1265, pipe: [1:7556554758619324979:9526]
2025-10-02T09:31:48.111225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.111446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.111454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.111480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619324979:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.111635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.111629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:48.111638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:48.111678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.111680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1266 reason: error at write: Disconnected sessionId: src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0
2025-10-02T09:31:48.111725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619324979:9526]
2025-10-02T09:31:48.111813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1266 sessionId: src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0 is DEAD
2025-10-02T09:31:48.111935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:48.111944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Write session will restart in 0.008587s
2025-10-02T09:31:48.111960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Write session: Do CDS request
2025-10-02T09:31:48.111963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:48.118007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:48.119177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:48.119274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:48.119280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:48.119286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:48.119311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:48.119333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554758543787305:8206]
2025-10-02T09:31:48.119675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:48.119847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:48.119868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:48.120043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:48.120072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.120076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.120077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.120077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.120078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.120078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.120079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.120079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.120080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.120080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.120081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.120081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.120084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.120091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.120093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.120095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.120097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.120099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.120101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.120103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.120105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.120108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.120109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.120111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.120116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.120120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.120124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.120127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.120129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.120132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.120134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.120136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.120138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.120141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.120143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.120146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.120148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.120150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.120153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.120155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.120157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.120160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.120163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.120166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.120168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.120170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.120172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.120175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.120190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:48.121153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.121245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:48.121253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1267
2025-10-02T09:31:48.121324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.121346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:48.121352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:48.121354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:48.121664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1267 sessionId:  describe result for acl check
2025-10-02T09:31:48.121695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:48.121701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:48.121702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:48.121706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554758619325044:9883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:48.122126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554758619325044:9883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:48.123572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554758619325044:9883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:48.126996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554758619325044:9883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:48.127005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554758619325044:9883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:48.127007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554758619325044:9883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:48.127011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:48.127550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:48.128965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:48.128976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:48.128977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:48.128979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:48.128982Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1266 [2:7556554758543787305:8206]
2025-10-02T09:31:48.128990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:48.129000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:48.129005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.129007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.129008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.129017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:48.129021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:48.129025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:48.129055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.129059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.129060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.129062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:48.129063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:48.129099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:48.129105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.129112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.129117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.129124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:48.129139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325079:9883], now have 1 active actors on pipe
2025-10-02T09:31:48.129145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619324980:2446], now have 1 active actors on pipe
2025-10-02T09:31:48.129149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.129150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.129151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.129160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:48.129170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:48.129164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1266
2025-10-02T09:31:48.129180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:48.129179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:48.129181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:48.129183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:48.129184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:48.129195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1266
2025-10-02T09:31:48.129207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.129212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.129219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.129226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:48.129238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:48.129245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:48.129249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.129251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.129252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:48.129257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.129263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:48.129275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.129371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.129376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.129384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.129430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1267 partition: 0 MaxSeqNo: 36 sessionId: src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0
2025-10-02T09:31:48.129629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d16fc76-4ae3d411-e60bfd7f-63f5cd10_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:48.132144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Write session: try to update token
2025-10-02T09:31:48.132159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.138422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.138436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.138437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.138438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.138443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.138448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.138450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554758543787300:8206]
2025-10-02T09:31:48.138471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.138475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.138477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.138477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.138480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.138482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.138592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.143642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId: src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.145610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.211749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619325089:9526]
2025-10-02T09:31:48.211945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1266, pipe: [1:7556554758619325089:9526]
2025-10-02T09:31:48.256620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.256899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.256908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.256937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325089:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.257093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.257170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619325089:9526]
2025-10-02T09:31:48.257200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:48.257209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.257263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0
2025-10-02T09:31:48.257412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1267 sessionId: src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0 is DEAD
2025-10-02T09:31:48.257526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:48.257536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Write session will restart in 0.005973s
2025-10-02T09:31:48.257561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Write session: Do CDS request
2025-10-02T09:31:48.257565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:48.263765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:48.264141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.264252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:48.264262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1268
2025-10-02T09:31:48.264370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.264389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:48.264393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:48.264396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:48.264700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1268 sessionId:  describe result for acl check
2025-10-02T09:31:48.264724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:48.264729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:48.264730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:48.264733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554758619325151:9888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:48.265092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:48.265134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554758619325151:9888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:48.265205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:48.265211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:48.265218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:48.265243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:48.265281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554758543787405:8209]
2025-10-02T09:31:48.265628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:48.265790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:48.265814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:48.265993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:48.266024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.266028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.266029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.266029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.266030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.266030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.266031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.266031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.266032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.266032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.266033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.266034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.266036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.266043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.266045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.266047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.266049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.266051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.266053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.266055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.266057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.266059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.266062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.266064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.266067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.266071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.266075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.266077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.266080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.266083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.266085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.266087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.266090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.266093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.266095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.266098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.266101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.266104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.266106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.266110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.266112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.266114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.266117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.266123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.266125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.266128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.266134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.266136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.266156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:48.266558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554758619325151:9888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:48.272255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554758619325151:9888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:48.272265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554758619325151:9888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:48.272267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554758619325151:9888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:48.272271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:48.275387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:48.276832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:48.276842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:48.276845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:48.276847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:48.276851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1267 [2:7556554758543787405:8209]
2025-10-02T09:31:48.276857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:48.276867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:48.276872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.276874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.276875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.276883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:48.276889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:48.276894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:48.276924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.276928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.276929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.276931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:48.276933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:48.276971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:48.276976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.276983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.276991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.276999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:48.277013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325090:2446], now have 1 active actors on pipe
2025-10-02T09:31:48.277019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325190:9888], now have 1 active actors on pipe
2025-10-02T09:31:48.277022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.277023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.277025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.277034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:48.277042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:48.277047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:48.277050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:48.277051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:48.277052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:48.277053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:48.277048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1267
2025-10-02T09:31:48.277070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.277074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:48.277077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:48.277098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1267
2025-10-02T09:31:48.277150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.277155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.277168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:48.277175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.277177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.277178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:48.277183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.277191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:48.277201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.277301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.277307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.277314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.277367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1268 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0
2025-10-02T09:31:48.277581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1275fdc-d3e0f604-c5a748e1-74a6d867_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:48.279708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Write session: try to update token
2025-10-02T09:31:48.279718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.288707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.288724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.288725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.288729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.288734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.288737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.288739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554758543787400:8209]
2025-10-02T09:31:48.288765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.288769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.288770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.288772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.288775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.288778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.288905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.290099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId: src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.292096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.357191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619325197:9526]
2025-10-02T09:31:48.357401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1267, pipe: [1:7556554758619325197:9526]
2025-10-02T09:31:48.401917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.402152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.402159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.402186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325197:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.402299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.402325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:48.402339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:48.402370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619325197:9526]
2025-10-02T09:31:48.402384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1268 reason: error at write: Disconnected sessionId: src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0
2025-10-02T09:31:48.402389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.402546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1268 sessionId: src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0 is DEAD
2025-10-02T09:31:48.402661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:48.402669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Write session will restart in 0.007962s
2025-10-02T09:31:48.402687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Write session: Do CDS request
2025-10-02T09:31:48.402691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:48.407855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:48.409021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:48.409121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:48.409128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:48.409133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:48.409158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:48.409180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554758543787504:8211]
2025-10-02T09:31:48.409520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:48.409671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:48.409693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:48.409879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:48.409912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.409916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.409917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.409917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.409918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.409919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.409919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.409920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.409920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.409921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.409921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.409922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.409924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.409931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.409933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.409935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.409937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.409939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.409941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.409943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.409945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.409947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.409949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.409951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.409955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.409959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.409962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.409965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.409967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.409970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.409972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.409974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.409977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.409979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.409981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.409984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.409986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.409989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.409991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.409993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.409995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.409998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.410000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.410003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.410005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.410008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.410010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.410013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.410030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:48.411108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.411195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:48.411204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1269
2025-10-02T09:31:48.411276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.411293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:48.411301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:48.411303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:48.411618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1269 sessionId:  describe result for acl check
2025-10-02T09:31:48.411652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:48.411658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:48.411660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:48.411664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554758619325265:9892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:48.412170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554758619325265:9892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:48.413447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554758619325265:9892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:48.417762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554758619325265:9892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:48.417771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554758619325265:9892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:48.417774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554758619325265:9892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:48.417778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:48.419143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:48.420554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:48.420564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:48.420565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:48.420567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:48.420570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1268 [2:7556554758543787504:8211]
2025-10-02T09:31:48.420577Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:48.420586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:48.420591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.420593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.420594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.420603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:48.420605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:48.420609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:48.420657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.420662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.420663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.420664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:48.420666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:48.420702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:48.420707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.420713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.420718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.420726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:48.420740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325299:9892], now have 1 active actors on pipe
2025-10-02T09:31:48.420746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325199:2446], now have 1 active actors on pipe
2025-10-02T09:31:48.420749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.420750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.420751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.420758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:48.420770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:48.420771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:48.420773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:48.420774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:48.420780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:48.420782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:48.420797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.420815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:48.420785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1268
2025-10-02T09:31:48.420823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:48.420831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.420833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.420829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1268
2025-10-02T09:31:48.420852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:48.420860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.420862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.420863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:48.420868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.420876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:48.420891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.420986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.420991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.420998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.421058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1269 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0
2025-10-02T09:31:48.421253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4c048d-c656f9f-a2d59cf6-25a1d23c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:48.423352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Write session: try to update token
2025-10-02T09:31:48.423361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.432597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.432614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.432615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.432619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.432624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.432627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.432629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554758543787499:8211]
2025-10-02T09:31:48.432652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.432656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.432657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.432658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.432662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.432664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.432767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.433477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId: src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.435402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.502579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619325307:9526]
2025-10-02T09:31:48.502797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1268, pipe: [1:7556554758619325307:9526]
2025-10-02T09:31:48.548337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.548572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.548581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.548609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325307:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.548736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.548840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:48.548856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.548904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619325307:9526]
2025-10-02T09:31:48.548910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1269 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0
2025-10-02T09:31:48.549041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1269 sessionId: src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0 is DEAD
2025-10-02T09:31:48.549197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:48.549205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Write session will restart in 0.009646s
2025-10-02T09:31:48.549220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Write session: Do CDS request
2025-10-02T09:31:48.549223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:48.554674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:48.555991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:48.556091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:48.556098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:48.556104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:48.556128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:48.556152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554758543787604:8213]
2025-10-02T09:31:48.556496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:48.556659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:48.556681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:48.556870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:48.556901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.556905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.556906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.556906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.556907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.556907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.556908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.556908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.556909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.556909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.556910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.556910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.556913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.556920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.556922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.556925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.556927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.556929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.556931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.556933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.556935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.556937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.556939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.556941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.556945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.556949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.556952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.556955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.556957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.556960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.556962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.556965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.556967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.556970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.556972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.556975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.556977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.556980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.556982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.556985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.556987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.556989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.556991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.556994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.556996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.556999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.557001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.557004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.557022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:48.560158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.560259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:48.560267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1270
2025-10-02T09:31:48.560340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.560359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:48.560362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:48.560366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:48.560693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1270 sessionId:  describe result for acl check
2025-10-02T09:31:48.560730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:48.560737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:48.560739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:48.560743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554758619325377:9896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:48.561249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554758619325377:9896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:48.562919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554758619325377:9896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:48.565798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554758619325377:9896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:48.565809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554758619325377:9896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:48.565811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554758619325377:9896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:48.565814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:48.566352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:48.567795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:48.567809Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:48.567811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:48.567813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:48.567816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1269 [2:7556554758543787604:8213]
2025-10-02T09:31:48.567823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:48.567834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:48.567835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.567837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.567838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.567847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:48.567850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:48.567854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:48.567885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.567891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.567892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.567894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:48.567896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:48.567933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:48.567938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.567945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.567951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.567960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:48.567975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325309:2446], now have 1 active actors on pipe
2025-10-02T09:31:48.567980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325414:9896], now have 1 active actors on pipe
2025-10-02T09:31:48.567984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.567985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.567986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.567994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:48.568005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:48.568008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:48.568010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:48.568011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:48.568016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:48.568019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:48.568012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1269
2025-10-02T09:31:48.568042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.568048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:48.568049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:48.568050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1269
2025-10-02T09:31:48.568073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.568081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.568102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:48.568112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.568114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.568116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:48.568123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.568134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:48.568145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.568257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.568262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.568270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.568319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1270 partition: 0 MaxSeqNo: 36 sessionId: src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0
2025-10-02T09:31:48.568509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4c97f3-103fe3e6-11b5c82e-9bd9d288_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:48.570709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Write session: try to update token
2025-10-02T09:31:48.570718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.579895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.579911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.579913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.579914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.579921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.579924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.579926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554758543787599:8213]
2025-10-02T09:31:48.579951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.579955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.579956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.579956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.579960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.579962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.580076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.581177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId: src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.583146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.648996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619325426:9526]
2025-10-02T09:31:48.649256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1269, pipe: [1:7556554758619325426:9526]
2025-10-02T09:31:48.693315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.693590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.693599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.693623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325426:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.693773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.693790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:48.693803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:48.693848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619325426:9526]
2025-10-02T09:31:48.693852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1270 reason: error at write: Disconnected sessionId: src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0
2025-10-02T09:31:48.693868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.693982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1270 sessionId: src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0 is DEAD
2025-10-02T09:31:48.694123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:48.694131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Write session will restart in 0.006027s
2025-10-02T09:31:48.694145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Write session: Do CDS request
2025-10-02T09:31:48.694149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:48.699812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:48.701001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:48.701111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.701109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:48.701116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:48.701122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:48.701148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:48.701171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554758543787717:8215]
2025-10-02T09:31:48.701194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:48.701203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1271
2025-10-02T09:31:48.701277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.701297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:48.701305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:48.701308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:48.701558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:48.701656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1271 sessionId:  describe result for acl check
2025-10-02T09:31:48.701686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:48.701692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:48.701695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:48.701699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554758619325495:9900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:48.701740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:48.701776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:48.701961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:48.701992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.701996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.701999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.701999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.702000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.702001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.702001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.702002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.702002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.702003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.702003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.702004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.702007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.702013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.702015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.702017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.702019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.702021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.702023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.702025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.702027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.702030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.702034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.702037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.702041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.702044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.702047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.702049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.702052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.702054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.702057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.702059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.702063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.702069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.702072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.702074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.702079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.702081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.702083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.702085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.702088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.702093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.702095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.702097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.702100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.702103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.702106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.702111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554758619325495:9900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:48.702122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:48.703479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554758619325495:9900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:48.708945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554758619325495:9900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:48.708955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554758619325495:9900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:48.708957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554758619325495:9900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:48.708961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:48.711498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:48.712937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:48.712947Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:48.712949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:48.712951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:48.712954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1270 [2:7556554758543787717:8215]
2025-10-02T09:31:48.712962Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:48.712972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:48.712978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.712980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.712981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.712989Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:48.712996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:48.713000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:48.713029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.713034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.713035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.713036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:48.713038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:48.713076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:48.713081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.713087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.713092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.713103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:48.713118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325532:9900], now have 1 active actors on pipe
2025-10-02T09:31:48.713124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325428:2446], now have 1 active actors on pipe
2025-10-02T09:31:48.713127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.713128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.713129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.713137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:48.713149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:48.713150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:48.713152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:48.713153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:48.713144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1270
2025-10-02T09:31:48.713166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:48.713171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:48.713199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.713191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1270
2025-10-02T09:31:48.713207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.713216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.713223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:48.713228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:48.713240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:48.713247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.713250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.713254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:48.713259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.713267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:48.713283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.713367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.713371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.713379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.713426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1271 partition: 0 MaxSeqNo: 36 sessionId: src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0
2025-10-02T09:31:48.713619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fc6058-6cc3bace-8e82fbf9-8e04c720_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:48.715770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Write session: try to update token
2025-10-02T09:31:48.715780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.725462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.725478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.725479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.725480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.725486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.725489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.725494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554758543787711:8215]
2025-10-02T09:31:48.725527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.725528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.725531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.725535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.725536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.725537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.725659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.726460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId: src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.728563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.793899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619325543:9526]
2025-10-02T09:31:48.794070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1270, pipe: [1:7556554758619325543:9526]
2025-10-02T09:31:48.838329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.838526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.838536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.838562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325543:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.838674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.838691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:48.838704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:48.838736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619325543:9526]
2025-10-02T09:31:48.838744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1271 reason: error at write: Disconnected sessionId: src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0
2025-10-02T09:31:48.838755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.838892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1271 sessionId: src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0 is DEAD
2025-10-02T09:31:48.839035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:48.839048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Write session will restart in 0.008205s
2025-10-02T09:31:48.839064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Write session: Do CDS request
2025-10-02T09:31:48.839068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:48.844640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:48.845858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:48.845957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:48.845964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:48.845970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:48.845994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:48.846016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554758543787831:8224]
2025-10-02T09:31:48.846378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:48.846534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:48.846558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:48.846735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:48.846765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.846768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.846769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.846769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.846770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.846770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.846771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.846772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.846772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.846772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.846773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.846774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.846776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.846782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.846784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.846786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.846788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.846790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.846792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.846794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.846796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.846798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.846800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.846802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.846805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.846809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:48.846812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.846815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:48.846817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.846820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:48.846822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.846825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:48.846827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.846829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:48.846831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.846834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:48.846836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.846839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:48.846841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.846852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:48.846854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.846857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:48.846859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.846862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.846866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.846869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.846872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.846874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.846891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:48.848141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.848286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:48.848301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1272
2025-10-02T09:31:48.848412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:48.848437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:48.848445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:48.848448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:48.848721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1272 sessionId:  describe result for acl check
2025-10-02T09:31:48.848747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:48.848748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:48.848749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:48.848753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554758619325640:9912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:48.849150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554758619325640:9912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:48.850841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554758619325640:9912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:48.854964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554758619325640:9912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:48.854977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554758619325640:9912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:48.854980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554758619325640:9912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:48.854986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:48.855418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:48.856964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:48.856976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:48.856977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:48.856978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:48.856982Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1271 [2:7556554758543787831:8224]
2025-10-02T09:31:48.856988Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:48.856998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:48.856999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.857001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.857002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.857011Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:48.857017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:48.857021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:48.857053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.857057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.857058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.857060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:48.857061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:48.857098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:48.857102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.857109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:48.857114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:48.857122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:48.857136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325674:9912], now have 1 active actors on pipe
2025-10-02T09:31:48.857142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325558:2446], now have 1 active actors on pipe
2025-10-02T09:31:48.857145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.857147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.857148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.857156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:48.857164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:48.857165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:48.857171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:48.857172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:48.857172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:48.857173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:48.857188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.857190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:48.857191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:48.857261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1271
2025-10-02T09:31:48.857296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1271
2025-10-02T09:31:48.857312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.857319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.857332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:48.857338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:48.857343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:48.857344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:48.857350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:48.857355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:48.857362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.857488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.857493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.857499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:48.857576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1272 partition: 0 MaxSeqNo: 36 sessionId: src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0
2025-10-02T09:31:48.857853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b980449d-3a3837e4-83ec9e9a-c4cf3357_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:48.860159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Write session: try to update token
2025-10-02T09:31:48.860168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:48.871031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId: src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:48.871833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:48.871850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.871856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.871884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:48.871887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:48.872031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:48.872151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:48.872274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:48.872392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:48.872602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:48.872629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:48.872998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:48.873105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.873115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.873130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:48.873183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:48.876228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:48.876240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:48.876242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:48.876243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:48.876248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.876251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.876252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554758543787826:8224]
2025-10-02T09:31:48.876274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:48.876280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:48.876280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:48.876282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:48.876283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:48.876285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:48.876386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:48.938790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554758619325695:9526]
2025-10-02T09:31:48.938997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1271, pipe: [1:7556554758619325695:9526]
2025-10-02T09:31:48.989757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:48.995811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:48.995832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:48.995953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.996004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.996057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.996109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.996299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.996308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.996361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.996411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.996461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.996519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.996554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.996560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.996611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.996660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.996709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.996761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.996796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.996818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.996883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.996931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.996981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.997029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.997065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.997070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.997123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.997172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.997224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.997278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.997314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.997319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.997369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.997419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.997469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.997518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.997551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.997558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.997603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.997651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.997700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.997754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.997803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.997809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.997859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.997907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.997952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.997999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.998034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.998038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.998085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.998132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.998179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.998225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.998275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.998280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.998325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:48.998373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:48.998420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:48.998468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:48.998503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:48.998507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:48.998538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325695:9526], now have 1 active actors on pipe
2025-10-02T09:31:48.998765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:48.998778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:48.998791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554758619325695:9526]
2025-10-02T09:31:48.998797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1272 reason: error at write: Disconnected sessionId: src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0
2025-10-02T09:31:48.998820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:48.998938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1272 sessionId: src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0 is DEAD
2025-10-02T09:31:48.999024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:48.999064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:48.999073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Write session will restart in 0.009646s
2025-10-02T09:31:48.999088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Write session: Do CDS request
2025-10-02T09:31:48.999093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.005111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.006327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.006423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.006430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.006435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.006459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.006482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755256:8233]
2025-10-02T09:31:49.006827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.006999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.007021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.007196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.007224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.007228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.007228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.007229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.007229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.007230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.007231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.007231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.007232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.007232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.007233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.007233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.007236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.007242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.007244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.007246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.007248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.007250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.007252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.007254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.007256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.007258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.007260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.007262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.007266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.007269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.007272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.007275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.007277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.007280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.007282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.007284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.007286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.007289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.007292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.007295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.007297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.007299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.007302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.007305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.007310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.007313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.007316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.007321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.007323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.007326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.007328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.007331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.007350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.010156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.010222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.010232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1273
2025-10-02T09:31:49.010308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.010326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.010332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.010335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.010611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1273 sessionId:  describe result for acl check
2025-10-02T09:31:49.010629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.010632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.010633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.010636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293063:9917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.011031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293063:9917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.012928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293063:9917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.015250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293063:9917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.015260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293063:9917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.015262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293063:9917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.015266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.015746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.017133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.017145Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.017146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.017149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.017154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1272 [2:7556554762838755256:8233]
2025-10-02T09:31:49.017162Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.017172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.017174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.017175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.017176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.017186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.017191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.017195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.017225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.017229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.017231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.017233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.017234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.017271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.017276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.017282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.017288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.017296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.017310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554758619325696:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.017315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293096:9917], now have 1 active actors on pipe
2025-10-02T09:31:49.017319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.017320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.017322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.017330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.017341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.017341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.017343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.017339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1272
2025-10-02T09:31:49.017344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.017351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.017352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.017367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.017371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.017373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.017391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1272
2025-10-02T09:31:49.017429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.017434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.017448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.017455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.017457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.017458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.017464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.017472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.017479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.017568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.017573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.017580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.017677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1273 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0
2025-10-02T09:31:49.017867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bccf6d7-b8c75fe4-a931f832-fc32b30b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.020116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Write session: try to update token
2025-10-02T09:31:49.020129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.027649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.027667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.027670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.027671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.027678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.027682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.027684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755251:8233]
2025-10-02T09:31:49.027707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.027713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.027716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.027717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.027719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.027719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.027831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.031227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId: src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.033350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.099069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293105:9526]
2025-10-02T09:31:49.099299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1272, pipe: [1:7556554762914293105:9526]
2025-10-02T09:31:49.140653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:49.141000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.141010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.141036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293105:9526], now have 1 active actors on pipe
2025-10-02T09:31:49.141183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:49.141271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293105:9526]
2025-10-02T09:31:49.141296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:49.141314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:49.141380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0
2025-10-02T09:31:49.141552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1273 sessionId: src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0 is DEAD
2025-10-02T09:31:49.141687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:49.141696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Write session will restart in 0.008959s
2025-10-02T09:31:49.141716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Write session: Do CDS request
2025-10-02T09:31:49.141720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.147119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.148300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.148395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.148402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.148407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.148432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.148455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755361:8235]
2025-10-02T09:31:49.148799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.148983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.149006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.149192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.149223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.149227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.149228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.149228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.149229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.149229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.149230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.149230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.149231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.149231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.149232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.149233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.149235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.149242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.149244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.149246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.149248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.149250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.149252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.149254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.149256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.149258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.149260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.149262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.149265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.149269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.149272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.149274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.149276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.149279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.149281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.149283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.149286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.149288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.149290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.149293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.149295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.149298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.149300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.149302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.149305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.149310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.149313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.149315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.149317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.149321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.149323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.149328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.149345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.151158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.151233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.151242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1274
2025-10-02T09:31:49.151345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.151365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.151372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.151374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.151712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1274 sessionId:  describe result for acl check
2025-10-02T09:31:49.151744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.151749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.151751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.151756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293177:9921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.152240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293177:9921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.153805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293177:9921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.157318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293177:9921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.157329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293177:9921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.157331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293177:9921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.157335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.157834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.159194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.159206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.159207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.159209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.159213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1273 [2:7556554762838755361:8235]
2025-10-02T09:31:49.159219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.159232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.159237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.159239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.159240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.159249Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.159257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.159265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.159297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.159302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.159303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.159305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.159306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.159342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.159347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.159353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.159361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.159372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.159387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293106:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.159392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293211:9921], now have 1 active actors on pipe
2025-10-02T09:31:49.159396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.159397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.159398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.159405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.159415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.159418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.159405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1273
2025-10-02T09:31:49.159421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.159422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.159422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1273
2025-10-02T09:31:49.159426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.159427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.159446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.159454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.159457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.159462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.159464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.159486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.159493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.159495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.159499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.159504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.159512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.159523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.159594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.159599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.159606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.159646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1274 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0
2025-10-02T09:31:49.159833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7897bc-94d7a2b4-d51f2b57-affe2f2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.162336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Write session: try to update token
2025-10-02T09:31:49.162348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.169594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.169610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.169611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.169613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.169617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.169620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.169622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755356:8235]
2025-10-02T09:31:49.169645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.169650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.169653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.169654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.169655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.169656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.169759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.173760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId: src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.175767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.241375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293222:9526]
2025-10-02T09:31:49.241583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1273, pipe: [1:7556554762914293222:9526]
2025-10-02T09:31:49.286091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:49.286411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.286425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.286456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293222:9526], now have 1 active actors on pipe
2025-10-02T09:31:49.286620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293222:9526]
2025-10-02T09:31:49.286644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:49.286668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:49.286672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:49.286727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1274 reason: error at write: Disconnected sessionId: src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0
2025-10-02T09:31:49.286930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1274 sessionId: src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0 is DEAD
2025-10-02T09:31:49.286974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:49.287034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:49.287040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Write session will restart in 0.009277s
2025-10-02T09:31:49.287054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Write session: Do CDS request
2025-10-02T09:31:49.287057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.292427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.293680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.293784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.293790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.293796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.293820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.293843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755469:8238]
2025-10-02T09:31:49.294188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.294354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.294376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.294557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.294588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.294592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.294592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.294593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.294593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.294594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.294594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.294595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.294595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.294596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.294596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.294597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.294600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.294607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.294609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.294611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.294613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.294615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.294617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.294619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.294621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.294623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.294625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.294627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.294631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.294635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.294638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.294641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.294643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.294645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.294648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.294651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.294653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.294657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.294659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.294662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.294664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.294666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.294669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.294671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.294674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.294680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.294682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.294685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.294690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.294693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.294695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.294699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.294717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.297098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.297212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.297222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1275
2025-10-02T09:31:49.297308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.297329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.297335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.297338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.297698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1275 sessionId:  describe result for acl check
2025-10-02T09:31:49.297731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.297737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.297739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.297743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293295:9926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.298224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293295:9926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.299681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293295:9926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.303416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293295:9926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.303426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293295:9926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.303428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293295:9926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.303432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.303936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.305329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.305341Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.305342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.305344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.305348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1274 [2:7556554762838755469:8238]
2025-10-02T09:31:49.305356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.305367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.305372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.305374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.305375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.305384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.305387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.305391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.305424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.305429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.305430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.305432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.305434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.305473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.305478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.305485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.305490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.305502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.305517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293330:9926], now have 1 active actors on pipe
2025-10-02T09:31:49.305522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293223:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.305526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.305533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.305534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.305541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.305552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.305553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.305555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.305557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.305563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.305565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.305562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1274
2025-10-02T09:31:49.305570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1274
2025-10-02T09:31:49.305580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.305585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.305588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.305600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.305607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.305687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.305694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.305697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.305698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.305703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.305707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.305723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.305834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.305839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.305847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.305903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1275 partition: 0 MaxSeqNo: 36 sessionId: src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0
2025-10-02T09:31:49.306140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0cc326-f95a6be9-396395e2-6115ea5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.308335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Write session: try to update token
2025-10-02T09:31:49.308348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.315512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.315530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.315531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.315532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.315538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.315540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.315545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755464:8238]
2025-10-02T09:31:49.315569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.315572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.315573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.315574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.315575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.315578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.315688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.318579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId: src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.320602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.386789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293338:9526]
2025-10-02T09:31:49.386969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1274, pipe: [1:7556554762914293338:9526]
2025-10-02T09:31:49.428552Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:49.428763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.428777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.428813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293338:9526], now have 1 active actors on pipe
2025-10-02T09:31:49.428995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:49.429020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:49.429033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:49.429045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:49.429083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293338:9526]
2025-10-02T09:31:49.429084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1275 reason: error at write: Disconnected sessionId: src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0
2025-10-02T09:31:49.429248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1275 sessionId: src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0 is DEAD
2025-10-02T09:31:49.429372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:49.429379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Write session will restart in 0.006391s
2025-10-02T09:31:49.429396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Write session: Do CDS request
2025-10-02T09:31:49.429400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.434939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.436080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.436176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.436182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.436188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.436212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.436235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755576:8240]
2025-10-02T09:31:49.436574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.436735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.436756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.436947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.436980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.436984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.436984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.436985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.436985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.436986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.436986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.436987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.436987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.436988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.436988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.436989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.436991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.436998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.437000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.437002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.437004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.437006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.437008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.437010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.437012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.437014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.437016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.437018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.437021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.437025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.437028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.437031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.437033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.437035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.437037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.437040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.437042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.437045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.437047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.437049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.437052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.437054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.437056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.437059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.437061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.437063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.437065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.437068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.437071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.437073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.437075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.437078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.437091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.437096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.437187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.437198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1276
2025-10-02T09:31:49.437279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.437302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.437310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.437313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.437565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1276 sessionId:  describe result for acl check
2025-10-02T09:31:49.437583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.437587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.437588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.437592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293412:9930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.437928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293412:9930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.439372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293412:9930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.444459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293412:9930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.444469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293412:9930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.444471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293412:9930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.444474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.445634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.447072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.447082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.447083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.447085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.447089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1275 [2:7556554762838755576:8240]
2025-10-02T09:31:49.447099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.447115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.447122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.447125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.447126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.447138Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.447146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.447155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.447191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.447196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.447197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.447199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.447200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.447234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.447241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.447247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.447252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.447260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.447271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293447:9930], now have 1 active actors on pipe
2025-10-02T09:31:49.447274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293339:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.447277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.447279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.447280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.447287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.447297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.447297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.447299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.447300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.447307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.447309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.447322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.447323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.447325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.447368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1275
2025-10-02T09:31:49.447373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1275
2025-10-02T09:31:49.447403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.447409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.447423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3711708c-d7f10884-f27ce240-4c1b7727_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.447429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.447432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.447434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.447438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.447446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.447454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.447569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.447574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.447582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.447636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1276 partition: 0 MaxSeqNo: 36 sessionId: src_id|3711708c-d7f10884-f27ce240-4c1b7727_0
2025-10-02T09:31:49.447839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd96921-6e9b927d-2bce5d9b-26316ba9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3711708c-d7f10884-f27ce240-4c1b7727_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.450034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Write session: try to update token
2025-10-02T09:31:49.450045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.456668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.456686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.456687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.456689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.456694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.456697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.456699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755571:8240]
2025-10-02T09:31:49.456721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.456725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.456727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.456728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.456730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.456732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.456858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.460297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId: src_id|3711708c-d7f10884-f27ce240-4c1b7727_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.462248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.529108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293455:9526]
2025-10-02T09:31:49.529250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1275, pipe: [1:7556554762914293455:9526]
2025-10-02T09:31:49.568702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:49.568932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.568942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.568968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293455:9526], now have 1 active actors on pipe
2025-10-02T09:31:49.569132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:49.569142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:49.569175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:49.569177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:49.569184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1276 reason: error at write: Disconnected sessionId: src_id|3711708c-d7f10884-f27ce240-4c1b7727_0
2025-10-02T09:31:49.569218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293455:9526]
2025-10-02T09:31:49.569311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1276 sessionId: src_id|3711708c-d7f10884-f27ce240-4c1b7727_0 is DEAD
2025-10-02T09:31:49.569445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:49.569452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Write session will restart in 0.006941s
2025-10-02T09:31:49.569467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Write session: Do CDS request
2025-10-02T09:31:49.569471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.575067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.576122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.576218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.576224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.576230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.576253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.576276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755684:8242]
2025-10-02T09:31:49.576611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.576785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.576817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.576991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.577019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.577023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.577024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.577024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.577025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.577025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.577026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.577027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.577027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.577028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.577028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.577029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.577032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.577039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.577041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.577043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.577045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.577047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.577049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.577051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.577053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.577055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.577057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.577059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.577063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.577067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.577070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.577073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.577075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.577079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.577082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.577086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.577089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.577094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.577097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.577101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.577107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.577105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.577108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.577111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.577114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.577118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.577121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.577124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.577128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.577132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.577138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.577141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.577151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.577181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.577234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.577247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1277
2025-10-02T09:31:49.577347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.577370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.577378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.577381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.577653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1277 sessionId:  describe result for acl check
2025-10-02T09:31:49.577671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.577672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.577673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.577676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293530:9934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.578024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293530:9934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.579767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293530:9934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.584196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293530:9934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.584206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293530:9934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.584207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293530:9934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.584211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.585376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.586721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.586732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.586733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.586736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.586739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1276 [2:7556554762838755684:8242]
2025-10-02T09:31:49.586748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.586758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.586763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.586765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.586766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.586775Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.586779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.586783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.586818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.586825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.586826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.586827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.586829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.586924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.586929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.586935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.586940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.586952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.586954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1276
2025-10-02T09:31:49.586965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293564:9934], now have 1 active actors on pipe
2025-10-02T09:31:49.586970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293456:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.586974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.586976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.586977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.586981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.586989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.586997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.587001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.586983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1276
2025-10-02T09:31:49.587004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.587007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.587008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.587027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.587032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.587039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.587046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.587058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.587066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a14f3ef8-e112923f-986878d0-d68bea48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.587069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.587071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.587072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.587079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.587085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.587096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.587197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.587202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.587210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.587289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1277 partition: 0 MaxSeqNo: 36 sessionId: src_id|a14f3ef8-e112923f-986878d0-d68bea48_0
2025-10-02T09:31:49.587508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3711708c-d7f10884-f27ce240-4c1b7727_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a14f3ef8-e112923f-986878d0-d68bea48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.589697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Write session: try to update token
2025-10-02T09:31:49.589707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.596493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.596509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.596510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.596513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.596518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.596520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.596522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755679:8242]
2025-10-02T09:31:49.596547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.596547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.596550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.596551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.596551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.596553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.596674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.600338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId: src_id|a14f3ef8-e112923f-986878d0-d68bea48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.602322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.669433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293572:9526]
2025-10-02T09:31:49.669635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1276, pipe: [1:7556554762914293572:9526]
2025-10-02T09:31:49.714049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:49.714291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.714306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.714333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293572:9526], now have 1 active actors on pipe
2025-10-02T09:31:49.714515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:49.714502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:49.714516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:49.714522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:49.714555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293572:9526]
2025-10-02T09:31:49.714571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1277 reason: error at write: Disconnected sessionId: src_id|a14f3ef8-e112923f-986878d0-d68bea48_0
2025-10-02T09:31:49.714739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1277 sessionId: src_id|a14f3ef8-e112923f-986878d0-d68bea48_0 is DEAD
2025-10-02T09:31:49.714922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:49.714930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Write session will restart in 0.005092s
2025-10-02T09:31:49.714945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Write session: Do CDS request
2025-10-02T09:31:49.714951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.720464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.721178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.721283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.721296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1278
2025-10-02T09:31:49.721372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.721393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.721397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.721399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.721707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.721718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1278 sessionId:  describe result for acl check
2025-10-02T09:31:49.721739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.721743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.721744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.721747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293647:9938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.721803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.721810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.721815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.721839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.721862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755806:8245]
2025-10-02T09:31:49.722086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293647:9938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.722205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.722396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.722417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.722592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.722620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.722624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.722625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.722625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.722626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.722626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.722627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.722628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.722628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.722629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.722630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.722630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.722633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.722639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.722641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.722643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.722645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.722647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.722649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.722651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.722653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.722655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.722657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.722659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.722663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.722667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.722670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.722673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.722675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.722678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.722680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.722682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.722685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.722687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.722689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.722692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.722696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.722700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.722702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.722705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.722707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.722710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.722712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.722714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.722717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.722719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.722721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.722724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.722741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.723566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293647:9938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.729432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293647:9938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.729441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293647:9938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.729443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293647:9938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.729447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.731123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.732558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.732571Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.732573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.732575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.732579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1277 [2:7556554762838755806:8245]
2025-10-02T09:31:49.732589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.732604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.732609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.732610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.732611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.732622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.732628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.732633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.732668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.732672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.732674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.732676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.732677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.732715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.732719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.732726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.732734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.732742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.732756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293686:9938], now have 1 active actors on pipe
2025-10-02T09:31:49.732762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293576:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.732766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.732767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.732768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.732775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.732783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.732792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.732794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.732795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.732796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.732797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.732814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1277
2025-10-02T09:31:49.732829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.732819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1277
2025-10-02T09:31:49.732836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.732838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.732858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.732865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.732889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c83266-55659608-fd6779d2-7661ae73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.732895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.732897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.732899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.732905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.732910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.732920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.733028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.733033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.733040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.733107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1278 partition: 0 MaxSeqNo: 36 sessionId: src_id|69c83266-55659608-fd6779d2-7661ae73_0
2025-10-02T09:31:49.733346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a14f3ef8-e112923f-986878d0-d68bea48_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69c83266-55659608-fd6779d2-7661ae73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.735579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Write session: try to update token
2025-10-02T09:31:49.735592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.742620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.742638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.742639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.742641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.742646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.742649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.742652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755801:8245]
2025-10-02T09:31:49.742678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.742683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.742685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.742686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.742689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.742691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.742801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.746133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId: src_id|69c83266-55659608-fd6779d2-7661ae73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.748123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.814828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293715:9526]
2025-10-02T09:31:49.815015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1277, pipe: [1:7556554762914293715:9526]
2025-10-02T09:31:49.863419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:49.863624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.863634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.863657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293715:9526], now have 1 active actors on pipe
2025-10-02T09:31:49.863785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:49.863775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:49.863788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:49.863789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293715:9526]
2025-10-02T09:31:49.863803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:49.863829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1278 reason: error at write: Disconnected sessionId: src_id|69c83266-55659608-fd6779d2-7661ae73_0
2025-10-02T09:31:49.863972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1278 sessionId: src_id|69c83266-55659608-fd6779d2-7661ae73_0 is DEAD
2025-10-02T09:31:49.864116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:49.864122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Write session will restart in 0.006887s
2025-10-02T09:31:49.864139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Write session: Do CDS request
2025-10-02T09:31:49.864143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:49.870177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:49.871651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:49.871746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:49.871753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:49.871758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:49.871783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:49.871805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554762838755929:8253]
2025-10-02T09:31:49.872120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.872150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:49.872203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:49.872214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1279
2025-10-02T09:31:49.872290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:49.872312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:49.872319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:49.872322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:49.872338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:49.872360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:49.872544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:49.872551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1279 sessionId:  describe result for acl check
2025-10-02T09:31:49.872569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:49.872574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.872573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:49.872574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:49.872578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.872577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554762914293798:9946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:49.872579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.872579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.872580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.872580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.872581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.872581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.872582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.872582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.872583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.872583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.872586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.872592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.872594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.872596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.872598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.872600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.872602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.872604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.872606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.872608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.872610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.872613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.872616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.872620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:49.872623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.872626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:49.872628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.872630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:49.872633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.872635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:49.872638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.872641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:49.872643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.872646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:49.872648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.872651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:49.872653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.872656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:49.872658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.872661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:49.872663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.872666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.872668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.872670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.872673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.872676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.872694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:49.872844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554762914293798:9946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:49.873985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554762914293798:9946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:49.878043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554762914293798:9946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:49.878053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554762914293798:9946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:49.878054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554762914293798:9946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:49.878058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:49.880265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:49.881718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:49.881730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:49.881731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:49.881734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:49.881737Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1278 [2:7556554762838755929:8253]
2025-10-02T09:31:49.881744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:49.881754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:49.881755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.881757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.881758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.881767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:49.881774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:49.881779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:49.881811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.881816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.881817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.881819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:49.881821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:49.881860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:49.881867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.881874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:49.881879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:49.881886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:49.881897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.881898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.881899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.881904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:49.881911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:49.881919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:49.881920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:49.881920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:49.881923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:49.881924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:49.881945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293717:2446], now have 1 active actors on pipe
2025-10-02T09:31:49.881951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293843:9946], now have 1 active actors on pipe
2025-10-02T09:31:49.881952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.881957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:49.881966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:49.882028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1278
2025-10-02T09:31:49.882045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1278
2025-10-02T09:31:49.882086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.882092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.882107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:49.882113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:49.882115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:49.882116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:49.882122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:49.882128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:49.882137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.882250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.882254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.882262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:49.882326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1279 partition: 0 MaxSeqNo: 36 sessionId: src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0
2025-10-02T09:31:49.882560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c83266-55659608-fd6779d2-7661ae73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:49.885113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Write session: try to update token
2025-10-02T09:31:49.885127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:49.891211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:49.891227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.891232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.891258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:49.891260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:49.891393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:49.891510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:49.891626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:49.891738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:49.891898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:49.891924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:49.897712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId: src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:49.899754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:49.899909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:49.899928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:49.899940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:49.899943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:49.899944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:49.899947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:49.899951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.899953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.899955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554762838755924:8253]
2025-10-02T09:31:49.899978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:49.899982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:49.899986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:49.899988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:49.899990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:49.899993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:49.900093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:49.963818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554762914293860:9526]
2025-10-02T09:31:49.964009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1278, pipe: [1:7556554762914293860:9526]
2025-10-02T09:31:50.015416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.015660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:50.015683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554762914293860:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.015775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:50.015819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.015847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:50.015851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:50.015856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554762914293860:9526]
2025-10-02T09:31:50.015898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1279 reason: error at write: Disconnected sessionId: src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0
2025-10-02T09:31:50.016010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1279 sessionId: src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0 is DEAD
2025-10-02T09:31:50.016132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:50.016144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Write session will restart in 0.007666s
2025-10-02T09:31:50.016164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Write session: Do CDS request
2025-10-02T09:31:50.016170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.021692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.022935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.023035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.023042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.023048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.023074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.023098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133723359:8262]
2025-10-02T09:31:50.023449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.023628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.023651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.023829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.023860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.023864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.023864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.023865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.023866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.023866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.023867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.023867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.023868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.023868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.023869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.023869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.023872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.023879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.023881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.023883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.023885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.023887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.023889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.023891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.023893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.023895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.023896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.023898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.023902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.023906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.023909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.023912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.023914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.023917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.023919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.023922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.023924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.023926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.023928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.023931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.023933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.023936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.023938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.023940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.023942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.023945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.023947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.023950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.023952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.023955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.023960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.023963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.023982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.025126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.025249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.025258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1280
2025-10-02T09:31:50.025327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.025345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.025348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.025351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.025623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1280 sessionId:  describe result for acl check
2025-10-02T09:31:50.025650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.025651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.025652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.025655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209261234:9955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.026009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209261234:9955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.028038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209261234:9955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.030976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209261234:9955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.030986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209261234:9955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.030987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209261234:9955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.030991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.031506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.032895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.032906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.032907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.032909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.032912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1279 [2:7556554767133723359:8262]
2025-10-02T09:31:50.032919Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.032928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.032933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.032934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.032935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.032944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.032947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.032951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.032986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.032991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.032992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.032994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.032995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.033041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.033045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.033052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.033057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.033069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.033083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261157:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.033088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261270:9955], now have 1 active actors on pipe
2025-10-02T09:31:50.033092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.033094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.033095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.033102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.033110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.033116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.033119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.033120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.033120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.033122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.033136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.033142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.033142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.033109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1279
2025-10-02T09:31:50.033114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1279
2025-10-02T09:31:50.033159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.033163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.033183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.033190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.033193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.033194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.033199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.033205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.033220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.033315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.033320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.033328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.033398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1280 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0
2025-10-02T09:31:50.033652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c6fbdd5-ded143b3-fae4eeb7-9dffe458_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.036202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Write session: try to update token
2025-10-02T09:31:50.036215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.042790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.042807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.042809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.042810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.042815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.042818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.042821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133723354:8262]
2025-10-02T09:31:50.042854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.042861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.042863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.042868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.042880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.042882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.042968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.046757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId: src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.048774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.115859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209261277:9526]
2025-10-02T09:31:50.116040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1279, pipe: [1:7556554767209261277:9526]
2025-10-02T09:31:50.156836Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.157048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.157057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.157082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261277:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.157228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:50.157239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:50.157246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.157252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:50.157291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209261277:9526]
2025-10-02T09:31:50.157307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1280 reason: error at write: Disconnected sessionId: src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0
2025-10-02T09:31:50.157471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1280 sessionId: src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0 is DEAD
2025-10-02T09:31:50.157601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:50.157610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Write session will restart in 0.008204s
2025-10-02T09:31:50.157627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Write session: Do CDS request
2025-10-02T09:31:50.157631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.163473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.164707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.164818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.164824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.164830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.164855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.164880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133723471:8264]
2025-10-02T09:31:50.165220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.165385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.165408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.165586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.165617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.165621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.165621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.165622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.165622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.165623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.165624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.165624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.165625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.165625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.165625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.165626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.165629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.165636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.165638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.165640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.165642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.165644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.165646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.165648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.165650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.165653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.165655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.165657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.165661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.165665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.165668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.165671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.165673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.165676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.165678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.165680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.165682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.165685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.165687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.165689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.165692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.165694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.165696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.165699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.165701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.165707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.165709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.165712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.165717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.165720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.165722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.165728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.165744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.167190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.167278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.167288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1281
2025-10-02T09:31:50.167384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.167402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.167405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.167407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.167658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1281 sessionId:  describe result for acl check
2025-10-02T09:31:50.167681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.167684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.167685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.167688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209261356:9959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.168014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209261356:9959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.169617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209261356:9959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.172549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209261356:9959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.172560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209261356:9959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.172562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209261356:9959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.172566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.173145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.174554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.174566Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.174567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.174569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.174572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1280 [2:7556554767133723471:8264]
2025-10-02T09:31:50.174581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.174593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.174598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.174599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.174600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.174610Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.174613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.174621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.174650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.174654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.174655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.174657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.174658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.174694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.174699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.174705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.174710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.174718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.174731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261278:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.174737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261391:9959], now have 1 active actors on pipe
2025-10-02T09:31:50.174740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.174741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.174742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.174749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.174756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.174763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.174764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.174768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.174768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.174769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.174782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.174787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.174781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1280
2025-10-02T09:31:50.174783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1280
2025-10-02T09:31:50.174801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.174825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.174830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.174852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.174859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.174861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.174862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.174868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.174876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.174883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.174986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.174991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.174998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.175060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1281 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0
2025-10-02T09:31:50.175256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4fcccb7-ee2720c0-7584e0ca-254de201_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.177695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Write session: try to update token
2025-10-02T09:31:50.177706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.184314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.184330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.184331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.184332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.184336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.184340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.184342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133723466:8264]
2025-10-02T09:31:50.184366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.184368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.184372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.184372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.184374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.184374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.184503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.188036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId: src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.189939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.257695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209261401:9526]
2025-10-02T09:31:50.257893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1280, pipe: [1:7556554767209261401:9526]
2025-10-02T09:31:50.300385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.300625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.300635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.300663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261401:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.300819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:50.300876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.300884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209261401:9526]
2025-10-02T09:31:50.300904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:50.300964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1281 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0
2025-10-02T09:31:50.301114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1281 sessionId: src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0 is DEAD
2025-10-02T09:31:50.301228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:50.301237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Write session will restart in 0.009831s
2025-10-02T09:31:50.301252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Write session: Do CDS request
2025-10-02T09:31:50.301258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.306945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.308246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.308343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.308349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.308356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.308381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.308406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133723586:8267]
2025-10-02T09:31:50.308762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.308954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.308978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.309167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.309196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.309200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.309200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.309201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.309201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.309202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.309202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.309203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.309203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.309204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.309204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.309205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.309208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.309215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.309217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.309219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.309221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.309223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.309225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.309227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.309229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.309231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.309233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.309235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.309239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.309243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.309246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.309249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.309251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.309259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.309264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.309267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.309269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.309272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.309274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.309277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.309279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.309282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.309285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.309288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.309293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.309296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.309298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.309300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.309303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.309306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.309310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.309313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.309331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.312205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.312301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.312309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1282
2025-10-02T09:31:50.312388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.312406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.312410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.312412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.312702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1282 sessionId:  describe result for acl check
2025-10-02T09:31:50.312725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.312730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.312731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.312734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209261482:9964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.313090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209261482:9964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.314340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209261482:9964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.316378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209261482:9964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.316387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209261482:9964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.316389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209261482:9964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.316392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.316950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.318413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.318425Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.318427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.318429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.318433Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1281 [2:7556554767133723586:8267]
2025-10-02T09:31:50.318441Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.318451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.318457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.318459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.318460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.318471Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.318477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.318482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.318517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.318521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.318522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.318524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.318525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.318562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.318567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.318573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.318579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.318590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.318605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261515:9964], now have 1 active actors on pipe
2025-10-02T09:31:50.318614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261402:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.318617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.318619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.318620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.318626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1281
2025-10-02T09:31:50.318627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.318637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1281
2025-10-02T09:31:50.318634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.318642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.318642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.318643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.318644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.318645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.318659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.318661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.318669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.318671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.318673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.318697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.318705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.318707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.318708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.318713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.318721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.318731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.318820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.318825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.318833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.318889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1282 partition: 0 MaxSeqNo: 36 sessionId: src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0
2025-10-02T09:31:50.319088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5f7524-d468f3b4-e67b24af-afcbd696_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.321650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Write session: try to update token
2025-10-02T09:31:50.321665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.328265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.328282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.328283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.328284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.328290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.328293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.328295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133723581:8267]
2025-10-02T09:31:50.328318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.328322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.328325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.328325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.328328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.328330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.328431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.333617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId: src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.335635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.401060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209261526:9526]
2025-10-02T09:31:50.401263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1281, pipe: [1:7556554767209261526:9526]
2025-10-02T09:31:50.440276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.440573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.440582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.440595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261526:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.440736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:50.440771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209261526:9526]
2025-10-02T09:31:50.440793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:50.440792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.440852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0
2025-10-02T09:31:50.440981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1282 sessionId: src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0 is DEAD
2025-10-02T09:31:50.441094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:50.441102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Write session will restart in 0.006547s
2025-10-02T09:31:50.441120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Write session: Do CDS request
2025-10-02T09:31:50.441124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.446690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.448001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.448103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.448111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.448131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.448116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.448143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.448163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133723700:8269]
2025-10-02T09:31:50.448218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.448229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1283
2025-10-02T09:31:50.448310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.448328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.448334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.448336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.448505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.448587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1283 sessionId:  describe result for acl check
2025-10-02T09:31:50.448611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.448616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.448618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.448622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209261605:9968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.448681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.448703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.448888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.448919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.448923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.448923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.448924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.448924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.448925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.448925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.448926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.448926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.448927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.448927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.448928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.448931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.448937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.448939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.448941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.448943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.448945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.448946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.448948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.448950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.448952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.448954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.448956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.448960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.448964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.448967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.448970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.448972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.448975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.448977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.448980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.448982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.448984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.448987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.448989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.448992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.448994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.448996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.448999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.449001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.449007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.449009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.449012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.449014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.449017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.449019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.449021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.449020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209261605:9968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.449040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.450545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209261605:9968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.454342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209261605:9968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.454350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209261605:9968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.454352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209261605:9968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.454356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.456533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.457999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.458011Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.458013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.458015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.458018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1282 [2:7556554767133723700:8269]
2025-10-02T09:31:50.458026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.458038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.458043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.458044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.458045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.458055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.458061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.458066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.458094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.458098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.458099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.458101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.458103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.458142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.458147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.458153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.458158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.458169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.458183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261642:9968], now have 1 active actors on pipe
2025-10-02T09:31:50.458188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261527:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.458192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.458193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.458194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.458201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.458208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.458214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.458216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.458217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.458219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.458221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.458236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.458240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.458246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.458233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1282
2025-10-02T09:31:50.458234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1282
2025-10-02T09:31:50.458258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.458264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.458279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8efc478d-47e521b7-564178d4-1324d902_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.458286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.458288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.458292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.458296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.458302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.458310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.458386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.458391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.458398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.458448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1283 partition: 0 MaxSeqNo: 36 sessionId: src_id|8efc478d-47e521b7-564178d4-1324d902_0
2025-10-02T09:31:50.458636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2009a60c-9fd428e3-55f3e31-5c838dd5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8efc478d-47e521b7-564178d4-1324d902_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.460908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Write session: try to update token
2025-10-02T09:31:50.460918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.467163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:50.467180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.467185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.467210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:50.467215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:50.467365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:50.467504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:50.467629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:50.467742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:50.467897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:50.467920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:50.471261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId: src_id|8efc478d-47e521b7-564178d4-1324d902_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.473169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.473289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.473299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.473316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:50.473373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:50.475573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.475589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.475590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.475593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.475598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.475600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.475603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133723695:8269]
2025-10-02T09:31:50.475622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.475627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.475629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.475630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.475630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.475635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.475735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.540859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209261650:9526]
2025-10-02T09:31:50.541398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1282, pipe: [1:7556554767209261650:9526]
2025-10-02T09:31:50.591565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.597658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.597681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.597803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.597853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.597911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.597960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.598289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.598298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.598353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.598402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.598452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.598504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.598541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.598547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.598597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.598647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.598700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.598749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.598785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.598790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.598852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.598904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.598953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.599004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.599042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.599047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.599103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.599151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.599204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.599252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.599287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.599292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.599372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.599421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.599470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.599518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.599555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.599560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.599610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.599656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.599714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.599781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.599826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.599833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.599892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.599951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.600006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.600056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.600090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.600095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.600141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.600185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.600232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.600284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.600331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.600336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.600404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:50.600451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:50.600497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:50.600548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:50.600583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:50.600588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:50.600621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261650:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.600812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209261650:9526]
2025-10-02T09:31:50.600813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:50.600817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:50.600833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.600835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1283 reason: error at write: Disconnected sessionId: src_id|8efc478d-47e521b7-564178d4-1324d902_0
2025-10-02T09:31:50.600973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1283 sessionId: src_id|8efc478d-47e521b7-564178d4-1324d902_0 is DEAD
2025-10-02T09:31:50.600985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:50.601109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:50.601119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Write session will restart in 0.008722s
2025-10-02T09:31:50.601150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Write session: Do CDS request
2025-10-02T09:31:50.601156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.607100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.608378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.608483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.608489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.608495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.608522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.608544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133723815:8271]
2025-10-02T09:31:50.608904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.609066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.609088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.609278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.609313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.609317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.609317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.609318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.609319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.609319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.609320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.609320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.609321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.609321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.609322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.609322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.609325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.609332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.609334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.609336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.609338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.609340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.609342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.609344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.609346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.609348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.609350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.609351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.609356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.609359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.609363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.609365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.609367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.609370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.609372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.609374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.609376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.609379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.609381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.609383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.609385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.609388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.609390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.609392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.609394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.609397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.609400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.609403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.609405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.609407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.609410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.609413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.609430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.611212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.611251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.611260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1284
2025-10-02T09:31:50.611360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.611378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.611385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.611388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.611736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1284 sessionId:  describe result for acl check
2025-10-02T09:31:50.611765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.611771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.611772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.611776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209261732:9972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.612215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209261732:9972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.613852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209261732:9972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.616249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209261732:9972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.616259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209261732:9972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.616261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209261732:9972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.616266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.616795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.618338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.618350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.618351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.618353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.618356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1283 [2:7556554767133723815:8271]
2025-10-02T09:31:50.618365Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.618375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.618380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.618381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.618382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.618391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.618395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.618400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.618431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.618436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.618437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.618439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.618441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.618481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.618486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.618493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.618498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.618506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.618521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261767:9972], now have 1 active actors on pipe
2025-10-02T09:31:50.618527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261651:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.618530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.618531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.618533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.618541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.618550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.618560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.618562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.618549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1283
2025-10-02T09:31:50.618553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1283
2025-10-02T09:31:50.618574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.618585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.618585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.618587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.618587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.618596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.618601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.618609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.618613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.618618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.618620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.618621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.618626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.618630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.618647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.618741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.618746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.618753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.618808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1284 partition: 0 MaxSeqNo: 36 sessionId: src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0
2025-10-02T09:31:50.619054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efc478d-47e521b7-564178d4-1324d902_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.621420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Write session: try to update token
2025-10-02T09:31:50.621435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.628084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.628102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.628103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.628105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.628110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.628112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.628115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133723810:8271]
2025-10-02T09:31:50.628135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.628137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.628138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.628141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.628141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.628144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.628247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.632907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId: src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.634803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.701079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209261775:9526]
2025-10-02T09:31:50.701239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1283, pipe: [1:7556554767209261775:9526]
2025-10-02T09:31:50.744430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.744647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.744657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.744686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261775:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.744890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:50.744903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:50.744920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.744952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209261775:9526]
2025-10-02T09:31:50.744970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1284 reason: error at write: Disconnected sessionId: src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0
2025-10-02T09:31:50.745105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1284 sessionId: src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0 is DEAD
2025-10-02T09:31:50.745225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:50.745234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Write session will restart in 0.009687s
2025-10-02T09:31:50.745250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Write session: Do CDS request
2025-10-02T09:31:50.745267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.745421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:50.750922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.752269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.752368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.752374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.752380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.752405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.752430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133723943:8274]
2025-10-02T09:31:50.752774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.752976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.752999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.753182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.753214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.753218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.753218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.753219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.753219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.753220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.753221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.753221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.753222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.753222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.753223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.753223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.753226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.753233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.753235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.753237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.753239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.753241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.753243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.753245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.753247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.753249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.753251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.753254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.753257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.753261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.753264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.753267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.753269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.753272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.753274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.753276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.753279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.753281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.753283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.753286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.753288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.753291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.753293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.753296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.753298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.753301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.753302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.753305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.753307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.753313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.753316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.753318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.753335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.756157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.756239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.756250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1285
2025-10-02T09:31:50.756328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.756347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.756353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.756356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.756608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1285 sessionId:  describe result for acl check
2025-10-02T09:31:50.756634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.756639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.756640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.756643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209261859:9976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.757005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209261859:9976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.758266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209261859:9976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.760314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209261859:9976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.760325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209261859:9976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.760327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209261859:9976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.760331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.760927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.762291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.762308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.762310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.762313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.762318Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1284 [2:7556554767133723943:8274]
2025-10-02T09:31:50.762329Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.762348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.762354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.762357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.762359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.762371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.762379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.762384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.762429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.762435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.762438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.762439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.762441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.762481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.762488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.762495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.762500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.762509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.762521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261776:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.762523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261893:9976], now have 1 active actors on pipe
2025-10-02T09:31:50.762527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.762528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.762529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.762536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.762544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.762546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.762548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.762551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.762552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.762554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.762572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.762580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.762581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.762580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1284
2025-10-02T09:31:50.762586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1284
2025-10-02T09:31:50.762603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.762608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.762624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.762631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.762633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.762634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.762640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.762646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.762653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.762747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.762754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.762765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.762836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1285 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0
2025-10-02T09:31:50.763025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debc4453-a0cb6e81-39296e8f-bddb817d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.765275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Write session: try to update token
2025-10-02T09:31:50.765288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.771845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.771861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.771864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.771865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.771870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.771873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.771875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133723938:8274]
2025-10-02T09:31:50.771899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.771903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.771904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.771903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.771910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.771912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.772011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.776261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId: src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.778242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.844951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209261920:9526]
2025-10-02T09:31:50.845122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1284, pipe: [1:7556554767209261920:9526]
2025-10-02T09:31:50.885520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:50.885848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.885860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.885892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261920:9526], now have 1 active actors on pipe
2025-10-02T09:31:50.886016Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:50.886020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:50.886056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209261920:9526]
2025-10-02T09:31:50.886066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:50.886127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1285 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0
2025-10-02T09:31:50.886277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1285 sessionId: src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0 is DEAD
2025-10-02T09:31:50.886402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:50.886411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Write session will restart in 0.007340s
2025-10-02T09:31:50.886425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Write session: Do CDS request
2025-10-02T09:31:50.886429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:50.892574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:50.893759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:50.893867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:50.893874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:50.893880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:50.893908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:50.893931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554767133724073:8276]
2025-10-02T09:31:50.894272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:50.894432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:50.894454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:50.894634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:50.894663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.894667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.894668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.894668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.894669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.894669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.894670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.894671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.894671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.894672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.894672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.894673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.894676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.894683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.894685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.894687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.894689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.894691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.894693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.894695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.894697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.894699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.894701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.894703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.894707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.894711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:50.894714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.894717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:50.894720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.894722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:50.894725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.894727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:50.894729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.894732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:50.894734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.894737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:50.894739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.894742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:50.894744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.894746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:50.894749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.894752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:50.894754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.894757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.894759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.894761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.894763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.894766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.894782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:50.895150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.895240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:50.895252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1286
2025-10-02T09:31:50.895358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:50.895376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:50.895379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:50.895381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:50.895641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1286 sessionId:  describe result for acl check
2025-10-02T09:31:50.895663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:50.895667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:50.895668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:50.895671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554767209262007:9982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:50.895983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554767209262007:9982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:50.897607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554767209262007:9982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:50.901696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554767209262007:9982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:50.901706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554767209262007:9982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:50.901708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554767209262007:9982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:50.901711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:50.902187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:50.903645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:50.903656Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:50.903657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:50.903659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:50.903662Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1285 [2:7556554767133724073:8276]
2025-10-02T09:31:50.903669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:50.903679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:50.903682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.903684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.903686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.903695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:50.903702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:50.903706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:50.903735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.903739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.903740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.903742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:50.903743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:50.903780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:50.903785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.903792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:50.903797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:50.903805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:50.903817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209262042:9982], now have 1 active actors on pipe
2025-10-02T09:31:50.903822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209261924:2446], now have 1 active actors on pipe
2025-10-02T09:31:50.903826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.903827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.903828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.903837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:50.903848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:50.903857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:50.903859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:50.903860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:50.903848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1285
2025-10-02T09:31:50.903866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:50.903870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1285
2025-10-02T09:31:50.903867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:50.903875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.903877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:50.903886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:50.903892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.903894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.903916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:50.903923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:50.903925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:50.903926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:50.903931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:50.903936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:50.903946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.904045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:50.904050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:50.904056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:50.904137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1286 partition: 0 MaxSeqNo: 36 sessionId: src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0
2025-10-02T09:31:50.904343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb63b48d-9f9d3b31-77009559-12aa9f8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:50.906664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Write session: try to update token
2025-10-02T09:31:50.906674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:50.913412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:50.913428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:50.913430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:50.913431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:50.913435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.913437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.913439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554767133724068:8276]
2025-10-02T09:31:50.913461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:50.913465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:50.913467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:50.913468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:50.913472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:50.913475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:50.913582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:50.917437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId: src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:50.919398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:50.986288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554767209262071:9526]
2025-10-02T09:31:50.986508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1285, pipe: [1:7556554767209262071:9526]
2025-10-02T09:31:51.030073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.030280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.030297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.030326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554767209262071:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.030449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.030480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554767209262071:9526]
2025-10-02T09:31:51.030484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:51.030487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:51.030508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.030549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1286 reason: error at write: Disconnected sessionId: src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0
2025-10-02T09:31:51.030721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1286 sessionId: src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0 is DEAD
2025-10-02T09:31:51.030845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:51.030856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Write session will restart in 0.007721s
2025-10-02T09:31:51.030871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Write session: Do CDS request
2025-10-02T09:31:51.030874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.036693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.037924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.038026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.038033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.038039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.038065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.038091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428691512:8291]
2025-10-02T09:31:51.038437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.038623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.038647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.038827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.038865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.038869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.038869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.038870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.038870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.038871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.038871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.038872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.038872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.038873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.038873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.038874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.038877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.038883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.038885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.038888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.038890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.038891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.038893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.038896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.038898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.038900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.038902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.038904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.038908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.038912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.038916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.038919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.038922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.038925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.038927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.038930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.038932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.038935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.038937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.038940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.038942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.038945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.038947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.038950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.038952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.038955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.038957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.038961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.038963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.038965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.038968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.038970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.038987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.039125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.039231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.039245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1287
2025-10-02T09:31:51.039339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.039362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.039370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.039373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.039665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1287 sessionId:  describe result for acl check
2025-10-02T09:31:51.039691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.039696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.039697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.039701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504229453:9993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.040046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504229453:9993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.041543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504229453:9993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.045917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504229453:9993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.045927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504229453:9993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.045929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504229453:9993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.045935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.046418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.047919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.047932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.047933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.047936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.047939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1286 [2:7556554771428691512:8291]
2025-10-02T09:31:51.047948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.047959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.047964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.047965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.047967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.047976Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.047979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.047983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.048016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.048021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.048022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.048024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.048025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.048065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.048070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.048077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.048082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.048092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.048106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229487:9993], now have 1 active actors on pipe
2025-10-02T09:31:51.048111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229369:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.048114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.048115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.048116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.048124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.048134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.048135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.048138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.048139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.048144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.048146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.048161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1286
2025-10-02T09:31:51.048172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1286
2025-10-02T09:31:51.048163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.048170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.048185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.048192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.048196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.048212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e81ac3-967f3e81-55728286-5bff3366_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.048219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.048221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.048222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.048227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.048232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.048240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.048351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.048356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.048365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.048430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1287 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8e81ac3-967f3e81-55728286-5bff3366_0
2025-10-02T09:31:51.048690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e956801a-8dae92eb-77d8450b-dc0b3712_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8e81ac3-967f3e81-55728286-5bff3366_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.051096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Write session: try to update token
2025-10-02T09:31:51.051109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.061728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:51.061745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.061752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.061784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:51.061798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:51.061949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:51.062074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:51.062191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:51.062199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId: src_id|a8e81ac3-967f3e81-55728286-5bff3366_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.062313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:51.062486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:51.062515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:51.064163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:51.064301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.064311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.064329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:51.064390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:51.065824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.065838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.065839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.065840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.065845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.065847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.065849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428691506:8291]
2025-10-02T09:31:51.065871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.065872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.065876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.065877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.065881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.065885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.065986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.130678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554771504229495:9526]
2025-10-02T09:31:51.130887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1286, pipe: [1:7556554771504229495:9526]
2025-10-02T09:31:51.184123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.190064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.190092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.190225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.190276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.190331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.190385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.190428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.190435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.190488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.190538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.190592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.190646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.190683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.190690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.190743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.190791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.190848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.190898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.190938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.190943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.190994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.191043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.191092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.191140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.191176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.191181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.191233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.191284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.191333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.191383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.191420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.191427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.191478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.191524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.191575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.191625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.191663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.191667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.191719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.191764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.191814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.191861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.191897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.191902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.191955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.192006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.192055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.192102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.192136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.192141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.192187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.192231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.192280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.192328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.192363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.192368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.192418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:51.192465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:51.192513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:51.192558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:51.192610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:51.192615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:51.192646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229495:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.192816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554771504229495:9526]
2025-10-02T09:31:51.192830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:51.192833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:51.192837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.192854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1287 reason: error at write: Disconnected sessionId: src_id|a8e81ac3-967f3e81-55728286-5bff3366_0
2025-10-02T09:31:51.193001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1287 sessionId: src_id|a8e81ac3-967f3e81-55728286-5bff3366_0 is DEAD
2025-10-02T09:31:51.193113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:51.193124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Write session will restart in 0.009402s
2025-10-02T09:31:51.193143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Write session: Do CDS request
2025-10-02T09:31:51.193148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.193321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.199597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.201026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.201127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.201133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.201139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.201163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.201186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428691631:8293]
2025-10-02T09:31:51.201537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.201736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.201758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.201934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.201962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.201966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.201966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.201967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.201967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.201968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.201969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.201969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.201970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.201970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.201971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.201972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.201974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.201981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.201983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.201986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.201988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.201990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.201992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.201993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.201995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.201998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.202000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.202002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.202006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.202009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.202013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.202015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.202017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.202023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.202025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.202028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.202031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.202034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.202036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.202038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.202041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.202043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.202049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.202052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.202054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.202060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.202062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.202064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.202070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.202073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.202075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.202077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.202094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.203203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.203278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.203290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1288
2025-10-02T09:31:51.203379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.203398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.203404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.203407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.203678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1288 sessionId:  describe result for acl check
2025-10-02T09:31:51.203697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.203701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.203703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.203705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504229584:9998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.204047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504229584:9998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.205547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504229584:9998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.208970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504229584:9998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.208980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504229584:9998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.208982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504229584:9998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.208986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.209552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.211037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.211051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.211053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.211055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.211058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1287 [2:7556554771428691631:8293]
2025-10-02T09:31:51.211068Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.211077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.211079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.211081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.211082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.211091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.211094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.211098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.211131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.211136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.211137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.211139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.211140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.211179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.211184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.211190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.211195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.211203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.211217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229619:9998], now have 1 active actors on pipe
2025-10-02T09:31:51.211222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229497:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.211226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.211227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.211229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.211236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.211244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.211248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.211250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.211251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.211254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.211256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.211270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.211275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.211273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1287
2025-10-02T09:31:51.211278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1287
2025-10-02T09:31:51.211290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.211294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.211296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.211313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.211320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.211322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.211324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.211329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.211337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.211345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.211420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.211424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.211432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.211484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1288 partition: 0 MaxSeqNo: 36 sessionId: src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0
2025-10-02T09:31:51.211676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e81ac3-967f3e81-55728286-5bff3366_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.213863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Write session: try to update token
2025-10-02T09:31:51.213878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.220565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.220578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.220579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.220580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.220585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.220588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.220591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428691626:8293]
2025-10-02T09:31:51.220614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.220618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.220620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.220626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.220631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.220634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.220738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.224433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId: src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.226423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:51.292984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554771504229626:9526]
2025-10-02T09:31:51.293183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1287, pipe: [1:7556554771504229626:9526]
2025-10-02T09:31:51.338274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.338535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.338545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.338569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229626:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.338720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.338775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554771504229626:9526]
2025-10-02T09:31:51.338787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:51.338799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.338863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0
2025-10-02T09:31:51.339017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1288 sessionId: src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0 is DEAD
2025-10-02T09:31:51.339165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:51.339175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Write session will restart in 0.005629s
2025-10-02T09:31:51.339190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Write session: Do CDS request
2025-10-02T09:31:51.339194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.345113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.346097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.346213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.346222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1289
2025-10-02T09:31:51.346297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.346316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.346322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.346325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.346455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.346550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.346556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.346562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.346588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.346591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1289 sessionId:  describe result for acl check
2025-10-02T09:31:51.346612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428691752:8296]
2025-10-02T09:31:51.346611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.346615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.346618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.346621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504229710:10002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.346963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.346967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504229710:10002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.347125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.347148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.347323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.347351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.347355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.347356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.347356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.347357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.347357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.347358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.347359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.347359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.347359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.347360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.347360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.347363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.347369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.347371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.347373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.347375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.347377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.347379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.347381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.347383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.347385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.347387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.347389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.347393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.347397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.347400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.347403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.347405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.347408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.347411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.347413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.347416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.347419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.347421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.347423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.347426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.347428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.347430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.347434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.347436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.347438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.347444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.347446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.347449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.347451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.347453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.347456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.347473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.348728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504229710:10002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.352673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504229710:10002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.352685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504229710:10002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.352687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504229710:10002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.352692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.354868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.356250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.356261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.356262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.356265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.356268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1288 [2:7556554771428691752:8296]
2025-10-02T09:31:51.356275Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.356285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.356287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.356289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.356290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.356299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.356305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.356309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.356342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.356347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.356348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.356350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.356351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.356389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.356394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.356401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.356406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.356416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.356430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229749:10002], now have 1 active actors on pipe
2025-10-02T09:31:51.356435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229627:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.356439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.356440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.356442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.356449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.356458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.356458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.356460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.356461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.356467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.356468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.356472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1288
2025-10-02T09:31:51.356483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.356488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.356487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1288
2025-10-02T09:31:51.356490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.356505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.356510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.356528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.356535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.356537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.356538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.356543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.356549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.356559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.356640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.356646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.356653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.356702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1289 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0
2025-10-02T09:31:51.356919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09c1d28-9b116740-433c2b3b-fecefbc4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.359235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Write session: try to update token
2025-10-02T09:31:51.359245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.365793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.365805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.365809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.365810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.365816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.365818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.365821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428691747:8296]
2025-10-02T09:31:51.365843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.365849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.365850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.365855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.365860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.365864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.365961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.369890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId: src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.371944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:51.438904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554771504229756:9526]
2025-10-02T09:31:51.439087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1288, pipe: [1:7556554771504229756:9526]
2025-10-02T09:31:51.481728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.482085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.482096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.482126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229756:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.482318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.482332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:51.482335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:51.482361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554771504229756:9526]
2025-10-02T09:31:51.482374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1289 reason: error at write: Disconnected sessionId: src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0
2025-10-02T09:31:51.482485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1289 sessionId: src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0 is DEAD
2025-10-02T09:31:51.482571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:51.482577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Write session will restart in 0.006112s
2025-10-02T09:31:51.482595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Write session: Do CDS request
2025-10-02T09:31:51.482604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.482575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.489152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.490216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.490379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.490397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1290
2025-10-02T09:31:51.490457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.490529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.490553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.490559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.490565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.490562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.490578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.490590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.490582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.490611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428691873:8298]
2025-10-02T09:31:51.490966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.490969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1290 sessionId:  describe result for acl check
2025-10-02T09:31:51.491006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.491014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.491015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.491020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504229840:10006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.491129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.491151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.491326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.491353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.491357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.491358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.491358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.491359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.491359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.491360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.491361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.491361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.491362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.491362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.491363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.491365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.491371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.491373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.491375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.491377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.491379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.491381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.491383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.491385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.491387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.491389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.491391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.491395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.491398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.491402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.491404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.491408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.491411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.491413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.491416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.491418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.491420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.491423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.491425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.491427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.491430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.491432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.491434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.491436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.491439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.491441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.491444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.491446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.491449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.491451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.491455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.491474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.491550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504229840:10006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.493290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504229840:10006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.497736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504229840:10006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.497748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504229840:10006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.497751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504229840:10006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.497757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.498895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.500281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.500291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.500293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.500295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.500298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1289 [2:7556554771428691873:8298]
2025-10-02T09:31:51.500306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.500315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.500317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.500319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.500320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.500329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.500334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.500338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.500368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.500373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.500375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.500376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.500378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.500415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.500420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.500427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.500432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.500442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.500457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229879:10006], now have 1 active actors on pipe
2025-10-02T09:31:51.500462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229757:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.500467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.500468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.500469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.500477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.500488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.500489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.500491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.500492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.500498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.500500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.500490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1289
2025-10-02T09:31:51.500515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.500501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1289
2025-10-02T09:31:51.500520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.500521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.500533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.500538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.500562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.500568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.500570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.500572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.500577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.500584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.500595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.500685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.500689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.500697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.500742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1290 partition: 0 MaxSeqNo: 36 sessionId: src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0
2025-10-02T09:31:51.500961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dda0abf-fd2dec5b-9575c424-23f32dda_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.503137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Write session: try to update token
2025-10-02T09:31:51.503147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.509905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.509918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.509919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.509921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.509926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.509928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.509931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428691868:8298]
2025-10-02T09:31:51.509951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.509955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.509957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.509964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.509970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.509973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.510066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.514508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId: src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.516593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:51.582242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554771504229890:9526]
2025-10-02T09:31:51.582418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1289, pipe: [1:7556554771504229890:9526]
2025-10-02T09:31:51.624162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.624504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.624514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.624539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229890:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.624678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.624744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.624744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:51.624748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:51.624791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554771504229890:9526]
2025-10-02T09:31:51.624818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1290 reason: error at write: Disconnected sessionId: src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0
2025-10-02T09:31:51.624969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1290 sessionId: src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0 is DEAD
2025-10-02T09:31:51.625085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:51.625095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Write session will restart in 0.009292s
2025-10-02T09:31:51.625108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Write session: Do CDS request
2025-10-02T09:31:51.625112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.631664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.632837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.632935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.632941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.632947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.632972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.632997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428691995:8300]
2025-10-02T09:31:51.633339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.633550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.633572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.633752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.633803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.633808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.633808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.633809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.633809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.633810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.633811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.633811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.633812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.633812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.633813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.633814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.633816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.633823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.633825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.633828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.633830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.633832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.633834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.633835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.633837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.633840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.633842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.633844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.633849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.633853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.633857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.633859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.633862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.633864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.633867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.633870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.633872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.633875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.633877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.633879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.633882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.633884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.633886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.633889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.633891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.633894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.633896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.633899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.633901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.633904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.633906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.633909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.633927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.635265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.635406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.635417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1291
2025-10-02T09:31:51.635546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.635571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.635579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.635582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.635912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1291 sessionId:  describe result for acl check
2025-10-02T09:31:51.635936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.635941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.635942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.635945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504229979:10012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.636330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504229979:10012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.638091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504229979:10012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.640725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504229979:10012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.640736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504229979:10012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.640739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504229979:10012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.640743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.641321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.642747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.642760Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.642761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.642763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.642766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1290 [2:7556554771428691995:8300]
2025-10-02T09:31:51.642773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.642783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.642789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.642790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.642792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.642800Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.642803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.642809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.642848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.642853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.642854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.642856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.642857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.642891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.642896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.642902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.642907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.642915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.642928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.642931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.642934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.642938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.642948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.642952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.642954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.642955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.642958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.642959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.642965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504229891:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.642967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230014:10012], now have 1 active actors on pipe
2025-10-02T09:31:51.642979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.642985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.643007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.643012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1290
2025-10-02T09:31:51.643018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1290
2025-10-02T09:31:51.643050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.643053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.643067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.643074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.643077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.643078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.643082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.643088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.643098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.643242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.643247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.643254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.643322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1291 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0
2025-10-02T09:31:51.643554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d55a08-e78d3c78-fd1b675b-33d4e85d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.646325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Write session: try to update token
2025-10-02T09:31:51.646340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.652110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.652124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.652125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.652126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.652130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.652133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.652137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428691990:8300]
2025-10-02T09:31:51.652159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.652163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.652164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.652174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.652180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.652184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.652276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.664839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId: src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.674977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:51.725118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554771504230022:9526]
2025-10-02T09:31:51.725338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1290, pipe: [1:7556554771504230022:9526]
2025-10-02T09:31:51.762759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.763037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.763046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.763059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230022:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.763251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:51.763258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554771504230022:9526]
2025-10-02T09:31:51.763262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:51.763275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.763277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.763309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1291 reason: error at write: Disconnected sessionId: src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0
2025-10-02T09:31:51.763472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1291 sessionId: src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0 is DEAD
2025-10-02T09:31:51.763664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:51.763675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Write session will restart in 0.005247s
2025-10-02T09:31:51.763711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Write session: Do CDS request
2025-10-02T09:31:51.763717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.770222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.770330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.770339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1292
2025-10-02T09:31:51.770428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.770447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.770453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.770456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.770446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.770721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1292 sessionId:  describe result for acl check
2025-10-02T09:31:51.770736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.770743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.770747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.770748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.770753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504230109:10016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.770828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.770834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.770847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.770871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.770903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428692130:8303]
2025-10-02T09:31:51.771173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504230109:10016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.771232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.771913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.771935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.772110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.772146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.772150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.772151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.772151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.772152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.772152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.772153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.772153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.772154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.772154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.772155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.772155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.772158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.772164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.772166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.772168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.772170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.772172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.772173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.772175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.772177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.772179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.772181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.772183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.772187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.772191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.772194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.772197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.772199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.772202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.772204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.772206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.772209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.772211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.772213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.772215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.772218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.772220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.772222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.772225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.772227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.772229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.772232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.772234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.772237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.772239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.772241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.772243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.772261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.772613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504230109:10016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.777038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504230109:10016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.777047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504230109:10016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.777048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504230109:10016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.777052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.779708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.781069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.781078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.781079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.781081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.781084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1291 [2:7556554771428692130:8303]
2025-10-02T09:31:51.781090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.781099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.781100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.781102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.781103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.781110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.781115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.781118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.781148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.781153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.781154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.781156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.781158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.781192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.781197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.781203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.781208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.781218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.781231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.781235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.781236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.781245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.781252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230024:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.781258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230148:10016], now have 1 active actors on pipe
2025-10-02T09:31:51.781257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.781260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.781261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.781262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.781270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.781271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.781284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.781293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.781286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1291
2025-10-02T09:31:51.781290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1291
2025-10-02T09:31:51.781298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.781316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.781320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.781334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.781341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.781343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.781344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.781349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.781355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.781361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.781485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.781490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.781498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.781563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1292 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0
2025-10-02T09:31:51.781759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b45513e-7d3fad87-2f6f47fc-dc444d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.784248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Write session: try to update token
2025-10-02T09:31:51.784259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.792244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.792254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.792256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.792257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.792261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.792266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.792268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428692125:8303]
2025-10-02T09:31:51.792291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.792296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.792297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.792306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.792310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.792313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.792413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.795716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId: src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.798337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:51.863324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554771504230175:9526]
2025-10-02T09:31:51.863560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1291, pipe: [1:7556554771504230175:9526]
2025-10-02T09:31:51.904397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:51.904664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.904672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.904685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230175:9526], now have 1 active actors on pipe
2025-10-02T09:31:51.904836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:51.904885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:51.904889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554771504230175:9526]
2025-10-02T09:31:51.904906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:51.904908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:51.904950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1292 reason: error at write: Disconnected sessionId: src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0
2025-10-02T09:31:51.905085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1292 sessionId: src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0 is DEAD
2025-10-02T09:31:51.905213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:51.905221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Write session will restart in 0.007947s
2025-10-02T09:31:51.905237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Write session: Do CDS request
2025-10-02T09:31:51.905243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:51.913001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:51.914124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.914247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:51.914261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1293
2025-10-02T09:31:51.914339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:51.914358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:51.914364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:51.914368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:51.914648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1293 sessionId:  describe result for acl check
2025-10-02T09:31:51.914676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:51.914680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:51.914682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:51.914685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554771504230265:10022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:51.915070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554771504230265:10022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:51.915579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:51.915703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:51.915709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:51.915715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:51.915741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:51.915768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554771428692258:8305]
2025-10-02T09:31:51.916107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:51.916259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:51.916281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:51.916424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554771504230265:10022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:51.916468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:51.916495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.916499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.916500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.916500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.916501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.916501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.916502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.916502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.916503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.916503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.916504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.916504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.916507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.916513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.916515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.916517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.916519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.916521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.916523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.916524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.916526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.916528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.916530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.916532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.916535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.916539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:51.916542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.916545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:51.916547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.916549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:51.916551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.916554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:51.916556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.916559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:51.916561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.916563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:51.916565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.916568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:51.916570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.916572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:51.916574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.916577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:51.916579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.916581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.916583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.916585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.916587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.916590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.916606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:51.920397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554771504230265:10022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:51.920406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554771504230265:10022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:51.920411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554771504230265:10022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:51.920414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:51.924006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:51.925904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:51.925913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:51.925915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:51.925918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:51.925921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1292 [2:7556554771428692258:8305]
2025-10-02T09:31:51.925930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:51.925939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:51.925941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.925944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.925945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.925954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:51.925958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:51.925963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:51.925993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.925998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.925999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.926001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:51.926002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:51.926040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:51.926045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.926052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:51.926057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:51.926065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:51.926078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.926082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.926083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.926087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:51.926095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:51.926097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230304:10022], now have 1 active actors on pipe
2025-10-02T09:31:51.926099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554771504230179:2446], now have 1 active actors on pipe
2025-10-02T09:31:51.926101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:51.926102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:51.926103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:51.926110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:51.926111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:51.926125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.926133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:51.926139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:51.926158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1292
2025-10-02T09:31:51.926161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1292
2025-10-02T09:31:51.926206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.926211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.926225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78c5b182-d4897749-edb2353f-536ac14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:51.926232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:51.926234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:51.926235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:51.926240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:51.926245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:51.926255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.926354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:51.926358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:51.926365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:51.926417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1293 partition: 0 MaxSeqNo: 36 sessionId: src_id|78c5b182-d4897749-edb2353f-536ac14_0
2025-10-02T09:31:51.926642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9410308-ff729068-aae49f1b-9ce5dcf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78c5b182-d4897749-edb2353f-536ac14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:51.929285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Write session: try to update token
2025-10-02T09:31:51.929304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:51.937518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:51.937529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.937534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.937558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:51.937559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:51.937690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:51.937945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:51.938197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:51.938449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:51.938663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:51.938689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:51.944185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId: src_id|78c5b182-d4897749-edb2353f-536ac14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:51.944366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:51.944379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:51.944381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:51.944382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:51.944387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.944390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.944392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554771428692249:8305]
2025-10-02T09:31:51.944415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:51.944420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:51.944422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:51.944451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:51.944459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:51.944461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:51.944525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:51.946141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.005161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799197629:9526]
2025-10-02T09:31:52.005375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1292, pipe: [1:7556554775799197629:9526]
2025-10-02T09:31:52.056616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.057382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.057392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.057405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197629:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.057541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.057603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:52.057613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799197629:9526]
2025-10-02T09:31:52.057632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.057667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1293 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78c5b182-d4897749-edb2353f-536ac14_0
2025-10-02T09:31:52.057817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1293 sessionId: src_id|78c5b182-d4897749-edb2353f-536ac14_0 is DEAD
2025-10-02T09:31:52.058000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:52.058011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Write session will restart in 0.006398s
2025-10-02T09:31:52.058050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Write session: Do CDS request
2025-10-02T09:31:52.058055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.064191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.065182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.065228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.065237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1294
2025-10-02T09:31:52.065327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.065348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.065354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.065357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.065564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.065615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1294 sessionId:  describe result for acl check
2025-10-02T09:31:52.065637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.065640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.065641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.065644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799197718:10033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.065674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.065679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.065685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.065711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.065737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723659713:8320]
2025-10-02T09:31:52.065988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799197718:10033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.066093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.066257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.066283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.066462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.066490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.066494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.066495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.066495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.066496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.066496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.066497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.066497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.066498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.066498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.066499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.066499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.066502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.066508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.066510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.066512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.066514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.066516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.066518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.066520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.066521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.066524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.066525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.066527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.066531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.066535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.066539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.066542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.066544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.066547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.066549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.066554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.066556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.066559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.066563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.066565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.066567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.066573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.066575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.066579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.066587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.066595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.066598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.066605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.066608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.066616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.066620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.066627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.066656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.067772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799197718:10033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.071873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799197718:10033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.071884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799197718:10033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.071886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799197718:10033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.071889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.074008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.075440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.075450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.075451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.075454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.075457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1293 [2:7556554775723659713:8320]
2025-10-02T09:31:52.075465Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.075475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.075480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.075482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.075483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.075491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.075497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.075501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.075533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.075538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.075539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.075540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.075542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.075575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.075579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.075585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.075591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.075599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.075613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197757:10033], now have 1 active actors on pipe
2025-10-02T09:31:52.075620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.075621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.075622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.075628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.075635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197631:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.075638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.075639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.075644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.075645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.075646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.075647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.075660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.075668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.075668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1293
2025-10-02T09:31:52.075675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1293
2025-10-02T09:31:52.075681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.075688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.075690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.075707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.075711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.075715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.075717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.075722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.075726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.075734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.075814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.075819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.075826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.075883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1294 partition: 0 MaxSeqNo: 36 sessionId: src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0
2025-10-02T09:31:52.076103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c5b182-d4897749-edb2353f-536ac14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.078554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Write session: try to update token
2025-10-02T09:31:52.078566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.084702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.084714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.084715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.084716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.084719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.084721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.084723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723659708:8320]
2025-10-02T09:31:52.084744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.084747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.084748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.084755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.084760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.084764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.084867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.090871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId: src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.092872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.157759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799197764:9526]
2025-10-02T09:31:52.157967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1293, pipe: [1:7556554775799197764:9526]
2025-10-02T09:31:52.195807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.196064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.196071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.196084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197764:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.196212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.196216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:52.196220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:52.196264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799197764:9526]
2025-10-02T09:31:52.196284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1294 reason: error at write: Disconnected sessionId: src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0
2025-10-02T09:31:52.196407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.196470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1294 sessionId: src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0 is DEAD
2025-10-02T09:31:52.196615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:52.196627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Write session will restart in 0.006901s
2025-10-02T09:31:52.196647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Write session: Do CDS request
2025-10-02T09:31:52.196653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.202884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.204063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.204169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.204175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.204181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.204206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.204214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.204230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723659838:8322]
2025-10-02T09:31:52.204298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.204309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1295
2025-10-02T09:31:52.204391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.204410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.204417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.204419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.204571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.204736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.204744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1295 sessionId:  describe result for acl check
2025-10-02T09:31:52.204759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.204775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.204780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.204782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.204786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799197858:10038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.204945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.204973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.204977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.204977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.204978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.204978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.204979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.204980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.204980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.204981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.204981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.204982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.204982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.204985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.204991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.204993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.204995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.204997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.204999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.205001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.205003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.205005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.205007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.205010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.205011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.205016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.205020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.205023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.205026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.205028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.205030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.205032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.205035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.205037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.205040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.205042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.205044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.205046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.205049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.205051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.205054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.205057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.205060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.205062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.205064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.205066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.205069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.205071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.205074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.205090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.205159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799197858:10038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.206723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799197858:10038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.210781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799197858:10038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.210792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799197858:10038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.210794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799197858:10038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.210799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.212435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.213885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.213894Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.213895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.213897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.213900Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1294 [2:7556554775723659838:8322]
2025-10-02T09:31:52.213907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.213916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.213918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.213919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.213920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.213928Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.213935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.213938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.213969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.213974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.213974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.213976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.213977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.214013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.214018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.214024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.214029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.214037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.214049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197895:10038], now have 1 active actors on pipe
2025-10-02T09:31:52.214055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197767:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.214058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.214059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.214060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.214069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.214078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.214083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.214069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1294
2025-10-02T09:31:52.214085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.214074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1294
2025-10-02T09:31:52.214087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.214087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.214088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.214107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.214112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.214122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.214129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.214141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.214144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|418139eb-789fcdd4-43d1d802-524d973c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.214148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.214149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.214150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.214155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.214160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.214170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.214274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.214280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.214288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.214335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1295 partition: 0 MaxSeqNo: 36 sessionId: src_id|418139eb-789fcdd4-43d1d802-524d973c_0
2025-10-02T09:31:52.214554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63139e5-9f6f8e67-b676d39a-81cb891e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|418139eb-789fcdd4-43d1d802-524d973c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.217054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Write session: try to update token
2025-10-02T09:31:52.217066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.223206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.223218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.223219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.223220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.223224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.223228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.223231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723659833:8322]
2025-10-02T09:31:52.223252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.223258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.223259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.223264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.223268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.223271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.223362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.229172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId: src_id|418139eb-789fcdd4-43d1d802-524d973c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.231082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.296496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799197902:9526]
2025-10-02T09:31:52.296732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1294, pipe: [1:7556554775799197902:9526]
2025-10-02T09:31:52.332976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.333212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.333221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.333232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197902:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.333364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.333384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.333421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799197902:9526]
2025-10-02T09:31:52.333425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:52.333437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:52.333492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1295 reason: error at write: Disconnected sessionId: src_id|418139eb-789fcdd4-43d1d802-524d973c_0
2025-10-02T09:31:52.333667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1295 sessionId: src_id|418139eb-789fcdd4-43d1d802-524d973c_0 is DEAD
2025-10-02T09:31:52.333818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:52.333829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Write session will restart in 0.007779s
2025-10-02T09:31:52.333850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Write session: Do CDS request
2025-10-02T09:31:52.333856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.339808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.341078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.341174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.341179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.341184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.341210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.341233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723659966:8325]
2025-10-02T09:31:52.341572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.341729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.341750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.341929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.341958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.341962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.341963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.341963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.341964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.341964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.341965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.341965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.341966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.341966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.341967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.341967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.341970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.341977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.341980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.341981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.341984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.341986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.341987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.341989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.341991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.341994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.341995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.341997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.342002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.342006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.342009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.342012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.342014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.342017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.342019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.342022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.342024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.342027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.342028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.342031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.342034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.342036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.342039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.342043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.342045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.342048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.342053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.342055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.342058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.342060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.342065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.342067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.342087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.342124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.342185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.342192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1296
2025-10-02T09:31:52.342265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.342283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.342288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.342290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.342601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1296 sessionId:  describe result for acl check
2025-10-02T09:31:52.342626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.342630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.342632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.342635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799197997:10042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.342979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799197997:10042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.344467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799197997:10042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.348449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799197997:10042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.348460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799197997:10042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.348463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799197997:10042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.348469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.349678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.351075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.351085Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.351086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.351089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.351092Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1295 [2:7556554775723659966:8325]
2025-10-02T09:31:52.351099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.351108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.351113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.351115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.351116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.351124Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.351127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.351131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.351167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.351171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.351172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.351174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.351175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.351212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.351217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.351224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.351232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.351241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.351255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799197903:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.351257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198032:10042], now have 1 active actors on pipe
2025-10-02T09:31:52.351260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.351262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.351263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.351271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.351281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.351285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.351287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.351288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.351291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.351292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.351285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1295
2025-10-02T09:31:52.351285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1295
2025-10-02T09:31:52.351308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.351312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.351314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.351325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.351329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.351352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.351359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.351362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.351363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.351368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.351374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.351386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.351478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.351483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.351491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.351534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1296 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0
2025-10-02T09:31:52.351745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|418139eb-789fcdd4-43d1d802-524d973c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.354285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Write session: try to update token
2025-10-02T09:31:52.354299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.360787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.360815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.360816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.360817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.360822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.360824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.360826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723659961:8325]
2025-10-02T09:31:52.360847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.360851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.360851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.360852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.360855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.360857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.360962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.366425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId: src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.368385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.433702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799198039:9526]
2025-10-02T09:31:52.433962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1295, pipe: [1:7556554775799198039:9526]
2025-10-02T09:31:52.471904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.472182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.472191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.472217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198039:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.472433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:52.472435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799198039:9526]
2025-10-02T09:31:52.472445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:52.472452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.472493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1296 reason: error at write: Disconnected sessionId: src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0
2025-10-02T09:31:52.472647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1296 sessionId: src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0 is DEAD
2025-10-02T09:31:52.472793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:52.472829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Write session will restart in 0.008559s
2025-10-02T09:31:52.472851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Write session: Do CDS request
2025-10-02T09:31:52.472860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.472960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.479383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.480629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.480781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.480788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.480794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.480839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.480861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723660094:8327]
2025-10-02T09:31:52.481204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.481384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.481408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.481589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.481617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.481621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.481622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.481622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.481623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.481623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.481623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.481624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.481624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.481625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.481626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.481626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.481629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.481636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.481638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.481640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.481642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.481644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.481646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.481648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.481650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.481653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.481654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.481656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.481660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.481664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.481667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.481670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.481672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.481675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.481680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.481683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.481685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.481688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.481690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.481695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.481699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.481702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.481704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.481706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.481709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.481712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.481717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.481719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.481736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.481742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.481744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.481747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.481766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.482205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.482271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.482281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1297
2025-10-02T09:31:52.482361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.482380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.482386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.482389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.482650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1297 sessionId:  describe result for acl check
2025-10-02T09:31:52.482672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.482677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.482678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.482681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799198134:10046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.483051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799198134:10046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.484200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799198134:10046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.487997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799198134:10046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.488009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799198134:10046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.488011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799198134:10046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.488016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.489162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.490530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.490542Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.490543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.490545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.490548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1296 [2:7556554775723660094:8327]
2025-10-02T09:31:52.490556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.490566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.490568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.490569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.490570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.490579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.490582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.490586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.490616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.490621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.490622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.490624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.490625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.490659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.490664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.490670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.490676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.490693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.490711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198040:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.490718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198169:10046], now have 1 active actors on pipe
2025-10-02T09:31:52.490723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.490725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.490727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.490736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.490746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.490751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.490753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.490754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.490760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.490763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.490783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.490790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.490766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1296
2025-10-02T09:31:52.490791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.490767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1296
2025-10-02T09:31:52.490806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.490812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.490863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2695973e-12fb191d-5e930adb-8b1d099c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.490872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.490874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.490876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.490883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.490894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.490914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.491015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.491022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.491029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.491091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1297 partition: 0 MaxSeqNo: 36 sessionId: src_id|2695973e-12fb191d-5e930adb-8b1d099c_0
2025-10-02T09:31:52.491336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e1e0ff-d5ceae9-36dfc25e-268a18cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2695973e-12fb191d-5e930adb-8b1d099c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.493849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Write session: try to update token
2025-10-02T09:31:52.493863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.500263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.500275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.500276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.500277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.500282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.500285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.500288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723660089:8327]
2025-10-02T09:31:52.500310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.500313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.500315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.500315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.500319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.500321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.500422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.506004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId: src_id|2695973e-12fb191d-5e930adb-8b1d099c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.507971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.572477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799198177:9526]
2025-10-02T09:31:52.572720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1296, pipe: [1:7556554775799198177:9526]
2025-10-02T09:31:52.613124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.613397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.613407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.613420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198177:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.613570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.613646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.613652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799198177:9526]
2025-10-02T09:31:52.613683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:52.613746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1297 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2695973e-12fb191d-5e930adb-8b1d099c_0
2025-10-02T09:31:52.613898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1297 sessionId: src_id|2695973e-12fb191d-5e930adb-8b1d099c_0 is DEAD
2025-10-02T09:31:52.614052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:52.614062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Write session will restart in 0.007472s
2025-10-02T09:31:52.614082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Write session: Do CDS request
2025-10-02T09:31:52.614087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.620732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.622185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.622234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.622276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.622287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1298
2025-10-02T09:31:52.622303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.622310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.622316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.622345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.622367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723660223:8329]
2025-10-02T09:31:52.622402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.622421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.622428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.622430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.622712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1298 sessionId:  describe result for acl check
2025-10-02T09:31:52.622731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.622735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.622736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.622733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.622739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799198269:10050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.622924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.622959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.623111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799198269:10050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.623142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.623170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.623174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.623175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.623175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.623176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.623176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.623177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.623177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.623178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.623178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.623179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.623179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.623182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.623188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.623190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.623192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.623194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.623196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.623198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.623200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.623202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.623204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.623206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.623208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.623211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.623216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.623219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.623222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.623224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.623226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.623228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.623231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.623235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.623239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.623244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.623248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.623254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.623259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.623263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.623266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.623272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.623276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.623281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.623285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.623289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.623297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.623301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.623307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.623328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.624532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799198269:10050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.628581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799198269:10050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.628592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799198269:10050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.628595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799198269:10050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.628599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.630734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.632138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.632147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.632148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.632151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.632156Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1297 [2:7556554775723660223:8329]
2025-10-02T09:31:52.632163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.632172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.632173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.632175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.632176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.632184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.632188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.632192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.632221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.632226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.632227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.632229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.632230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.632264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.632268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.632275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.632284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.632301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.632321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198178:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.632327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198308:10050], now have 1 active actors on pipe
2025-10-02T09:31:52.632332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.632335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.632337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.632346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.632358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.632359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.632360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.632361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.632372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.632376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.632364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1297
2025-10-02T09:31:52.632364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1297
2025-10-02T09:31:52.632401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.632407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.632414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.632419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.632424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.632436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.632444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.632445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.632446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.632452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.632459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.632476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.632561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.632567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.632577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.632621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1298 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0
2025-10-02T09:31:52.632867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2695973e-12fb191d-5e930adb-8b1d099c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.635344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Write session: try to update token
2025-10-02T09:31:52.635355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.641666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.641677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.641678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.641679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.641685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.641687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.641689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723660218:8329]
2025-10-02T09:31:52.641710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.641713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.641715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.641721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.641730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.641733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.641819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.647357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId: src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.649364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.713748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799198316:9526]
2025-10-02T09:31:52.713930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1297, pipe: [1:7556554775799198316:9526]
2025-10-02T09:31:52.753294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.753556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.753565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.753577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198316:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.753723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.753798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.753813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799198316:9526]
2025-10-02T09:31:52.753832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:52.753891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0
2025-10-02T09:31:52.754037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1298 sessionId: src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0 is DEAD
2025-10-02T09:31:52.754189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:52.754199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Write session will restart in 0.007025s
2025-10-02T09:31:52.754219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Write session: Do CDS request
2025-10-02T09:31:52.754224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.760864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.762132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.762123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.762203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.762213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1299
2025-10-02T09:31:52.762231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.762237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.762243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.762269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.762290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.762293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723660365:8332]
2025-10-02T09:31:52.762308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.762314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.762316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.762586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1299 sessionId:  describe result for acl check
2025-10-02T09:31:52.762604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.762609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.762610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.762613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799198409:10054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.762665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.762858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.762884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.762966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799198409:10054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.763067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.763099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.763105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.763105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.763106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.763107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.763108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.763109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.763109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.763110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.763111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.763112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.763113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.763117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.763125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.763129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.763132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.763135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.763138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.763141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.763144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.763148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.763151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.763154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.763157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.763163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.763173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.763176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.763179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.763183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.763186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.763188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.763191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.763193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.763198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.763200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.763203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.763205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.763207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.763211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.763213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.763217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.763220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.763222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.763224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.763226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.763229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.763234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.763237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.763253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.764249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799198409:10054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.768624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799198409:10054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.768632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799198409:10054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.768635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799198409:10054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.768639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.770893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.772296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.772307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.772308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.772310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.772313Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1298 [2:7556554775723660365:8332]
2025-10-02T09:31:52.772322Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.772332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.772337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.772339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.772340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.772349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.772352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.772356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.772387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.772392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.772393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.772395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.772396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.772433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.772438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.772446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.772457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.772475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.772494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198448:10054], now have 1 active actors on pipe
2025-10-02T09:31:52.772501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198317:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.772505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.772511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.772512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.772523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.772535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.772536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.772541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.772542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.772548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.772550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.772537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1298
2025-10-02T09:31:52.772541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1298
2025-10-02T09:31:52.772565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.772572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.772573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.772584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.772589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.772613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.772620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.772623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.772624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.772631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.772639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.772648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.772744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.772751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.772760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.772827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1299 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0
2025-10-02T09:31:52.773073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5cec-706f2cc1-a770dd9f-aee459a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.775588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Write session: try to update token
2025-10-02T09:31:52.775601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.782048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.782060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.782062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.782063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.782068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.782070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.782072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723660360:8332]
2025-10-02T09:31:52.782097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.782100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.782101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.782102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.782105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.782107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.782216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.787627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId: src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.789531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.854037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799198473:9526]
2025-10-02T09:31:52.854237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1298, pipe: [1:7556554775799198473:9526]
2025-10-02T09:31:52.892695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:52.892950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.892959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.892971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198473:9526], now have 1 active actors on pipe
2025-10-02T09:31:52.893112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:52.893129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:52.893138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:52.893161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:52.893180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1299 reason: error at write: Disconnected sessionId: src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0
2025-10-02T09:31:52.893194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799198473:9526]
2025-10-02T09:31:52.893306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1299 sessionId: src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0 is DEAD
2025-10-02T09:31:52.893454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:52.893465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Write session will restart in 0.008442s
2025-10-02T09:31:52.893487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Write session: Do CDS request
2025-10-02T09:31:52.893492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:52.899932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:52.901238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:52.901332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:52.901338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:52.901343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:52.901367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:52.901391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554775723660496:8334]
2025-10-02T09:31:52.901742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:52.901941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:52.901962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:52.902137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:52.902173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.902177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.902178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.902179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.902179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.902179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.902180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.902181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.902181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.902182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.902182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.902183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.902185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.902192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.902194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.902196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.902197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.902200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.902201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.902203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.902205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.902207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.902209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.902211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.902214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.902218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:52.902221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.902224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:52.902226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.902228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:52.902230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.902233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:52.902235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.902238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:52.902240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.902242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:52.902245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.902247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:52.902249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.902252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:52.902254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.902257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:52.902259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.902261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.902263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.902266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.902269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.902271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.902288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:52.903112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.903211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:52.903219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1300
2025-10-02T09:31:52.903314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:52.903331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:52.903333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:52.903336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:52.903660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1300 sessionId:  describe result for acl check
2025-10-02T09:31:52.903687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:52.903688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:52.903689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:52.903692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554775799198574:10060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:52.904094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554775799198574:10060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:52.905591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554775799198574:10060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:52.909226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554775799198574:10060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:52.909237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554775799198574:10060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:52.909240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554775799198574:10060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:52.909243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:52.909740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:52.911159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:52.911170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:52.911171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:52.911173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:52.911177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1299 [2:7556554775723660496:8334]
2025-10-02T09:31:52.911184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:52.911193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:52.911194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.911195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.911196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.911205Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:52.911211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:52.911216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:52.911246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.911250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.911251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.911253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:52.911255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:52.911291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:52.911296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.911302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:52.911308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:52.911316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:52.911329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198477:2446], now have 1 active actors on pipe
2025-10-02T09:31:52.911334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198609:10060], now have 1 active actors on pipe
2025-10-02T09:31:52.911338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.911339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.911341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.911348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:52.911358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:52.911362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:52.911364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:52.911365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:52.911368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:52.911370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:52.911384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.911392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:52.911393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1299
2025-10-02T09:31:52.911406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:52.911399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1299
2025-10-02T09:31:52.911430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.911435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.911450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:52.911457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:52.911460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:52.911461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:52.911466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:52.911472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:52.911481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.911574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:52.911579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:52.911586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:52.911641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1300 partition: 0 MaxSeqNo: 36 sessionId: src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0
2025-10-02T09:31:52.911868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcce755e-8c4e9ab5-f498296a-c8bcd5e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:52.914409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Write session: try to update token
2025-10-02T09:31:52.914422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:52.920999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:52.921011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:52.921013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:52.921014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:52.921019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.921022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.921024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554775723660491:8334]
2025-10-02T09:31:52.921046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:52.921050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:52.921051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:52.921053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:52.921058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:52.921061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:52.921206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:52.926529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId: src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:52.928504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:52.993300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554775799198638:9526]
2025-10-02T09:31:52.993420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1299, pipe: [1:7556554775799198638:9526]
2025-10-02T09:31:53.036349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.036630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.036638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.036661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554775799198638:9526], now have 1 active actors on pipe
2025-10-02T09:31:53.036777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.036824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.036831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:53.036867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554775799198638:9526]
2025-10-02T09:31:53.036883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0
2025-10-02T09:31:53.037023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1300 sessionId: src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0 is DEAD
2025-10-02T09:31:53.037171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:53.037183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Write session will restart in 0.008781s
2025-10-02T09:31:53.037203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Write session: Do CDS request
2025-10-02T09:31:53.037208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.043470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.044709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.044842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.044848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.044854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.044884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.044906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018627962:8349]
2025-10-02T09:31:53.045244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.045414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.045435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.045612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.045641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.045645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.045646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.045646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.045646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.045647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.045648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.045648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.045649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.045649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.045650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.045650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.045653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.045660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.045662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.045664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.045666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.045667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.045670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.045671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.045673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.045676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.045678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.045680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.045685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.045689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.045692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.045695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.045697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.045700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.045702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.045705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.045707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.045713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.045715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.045718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.045720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.045723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.045725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.045728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.045730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.045733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.045735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.045738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.045740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.045742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.045744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.045748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.045763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.047234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.047660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.047669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1301
2025-10-02T09:31:53.047761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.047779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.047785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.047788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.048066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1301 sessionId:  describe result for acl check
2025-10-02T09:31:53.048096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.048102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.048104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.048109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166034:10071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.048446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166034:10071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.050086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166034:10071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.052694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166034:10071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.052703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166034:10071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.052705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166034:10071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.052709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.053122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.054549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.054559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.054560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.054562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.054566Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1300 [2:7556554780018627962:8349]
2025-10-02T09:31:53.054572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.054582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.054587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.054589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.054590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.054598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.054601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.054605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.054632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.054636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.054637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.054639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.054640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.054674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.054679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.054685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.054690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.054699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.054713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166069:10071], now have 1 active actors on pipe
2025-10-02T09:31:53.054718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094165936:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.054722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.054723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.054724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.054731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.054738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.054742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.054744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.054745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.054749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.054750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.054764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.054750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1300
2025-10-02T09:31:53.054755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1300
2025-10-02T09:31:53.054769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.054770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.054780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.054782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.054844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.054851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.054853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.054854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.054859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.054865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.054878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.054976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.054981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.054988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.055036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1301 partition: 0 MaxSeqNo: 36 sessionId: src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0
2025-10-02T09:31:53.055257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca25e1d-9eff6aa1-eae33bfb-76bac0c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.057771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Write session: try to update token
2025-10-02T09:31:53.057784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.063915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.063930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.063931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.063932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.063937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.063939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.063941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018627957:8349]
2025-10-02T09:31:53.063961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.063965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.063966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.063978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.063984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.063992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.064101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.069651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId: src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.071557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.137194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554780094166076:9526]
2025-10-02T09:31:53.137380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1300, pipe: [1:7556554780094166076:9526]
2025-10-02T09:31:53.175344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.175567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.175575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.175587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166076:9526], now have 1 active actors on pipe
2025-10-02T09:31:53.175727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.175724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:53.175736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:53.175758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166076:9526]
2025-10-02T09:31:53.175773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.175779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1301 reason: error at write: Disconnected sessionId: src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0
2025-10-02T09:31:53.175792Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:31:53.175855Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 13 consumer shared/user session shared/user_1_13_6300436207510454890_v1 is DEAD
2025-10-02T09:31:53.175905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1301 sessionId: src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0 is DEAD
2025-10-02T09:31:53.175949Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554715669640875:9523] disconnected; active server actors: 1
2025-10-02T09:31:53.175955Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554715669640875:9523] client user disconnected session shared/user_1_13_6300436207510454890_v1
2025-10-02T09:31:53.176091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:53.176100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Write session will restart in 0.007458s
2025-10-02T09:31:53.176099Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:31:53.176120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Write session: Do CDS request
2025-10-02T09:31:53.176125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.176172Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:53.176175Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:31:53.176183Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005883s
2025-10-02T09:31:53.182656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.183085Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:31:53.183210Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:31:53.183219Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 14
2025-10-02T09:31:53.183326Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 14 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:53.183360Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:31:53.183418Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 auth for : user
2025-10-02T09:31:53.183556Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 Handle describe topics response
2025-10-02T09:31:53.183574Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 auth is DEAD
2025-10-02T09:31:53.183575Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:31:53.183729Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:31:53.183774Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_14_9023785720857643224_v1
2025-10-02T09:31:53.183786Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554780094166174:10075] connected; active server actors: 1
2025-10-02T09:31:53.183795Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554780094166174:10075] session shared/user_1_14_9023785720857643224_v1
2025-10-02T09:31:53.183800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:31:53.183809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:31:53.183813Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_14_9023785720857643224_v1" (Sender=[1:7556554780094166171:10075], Pipe=[1:7556554780094166174:10075], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:53.183818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:31:53.183825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:31:53.183830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_14_9023785720857643224_v1" (Sender=[1:7556554780094166171:10075], Pipe=[1:7556554780094166174:10075], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:31:53.183837Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_14_9023785720857643224_v1" sender [1:7556554780094166171:10075] lock partition 0 for ReadingSession "shared/user_1_14_9023785720857643224_v1" (Sender=[1:7556554780094166171:10075], Pipe=[1:7556554780094166174:10075], Partitions=[], ActiveFamilyCount=1) generation 1 step 14
2025-10-02T09:31:53.183846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:31:53.183849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T09:31:53.183987Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 14 Session: "shared/user_1_14_9023785720857643224_v1" ClientId: "user" PipeClient { RawX1: 7556554780094166174 RawX2: 4503603922347867 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:31:53.184006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:31:53.184029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.184110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.184109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.184115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1302
2025-10-02T09:31:53.184152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.184159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.184165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.184194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.184215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018628094:8351]
2025-10-02T09:31:53.184240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.184259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.184266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.184269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.184452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1302 sessionId:  describe result for acl check
2025-10-02T09:31:53.184469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.184473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.184474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.184477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166181:10079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.184547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.184697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.184718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.184840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166181:10079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.184904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.184933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.184936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.184937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.184938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.184938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.184939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.184939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.184940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.184940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.184941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.184941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.184942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.184945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.184951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.184953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.184955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.184957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.184960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.184962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.184963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.184965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.184967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.184969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.184971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.184975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.184978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.184982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.184984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.184987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.184989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.184992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.184995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.184997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.185000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.185005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.185008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.185010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.185013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.185015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.185017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.185020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.185022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.185026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.185029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.185031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.185034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.185036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.185039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.185054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.186175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166181:10079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.190304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166181:10079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.190313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166181:10079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.190315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166181:10079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.190319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.192444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.193820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.193831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.193832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.193834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.193838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1301 [2:7556554780018628094:8351]
2025-10-02T09:31:53.193845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.193855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.193857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.193859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.193860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.193869Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.193872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.193876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.193906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.193911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.193912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.193913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.193914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.193953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.193957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.193963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.193968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.193976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.193990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166078:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.193994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166177:10078], now have 1 active actors on pipe
2025-10-02T09:31:53.193995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166219:10079], now have 1 active actors on pipe
2025-10-02T09:31:53.193999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.194000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.194001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.194008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.194015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.194020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.194022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.194023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.194025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.194026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.194018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1301
2025-10-02T09:31:53.194029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1301, pipe: [1:7556554780094166177:10078]
2025-10-02T09:31:53.194038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1301
2025-10-02T09:31:53.194039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.194044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.194045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.194061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.194065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.194072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_14_9023785720857643224_v1 on pipe: [1:7556554780094166177:10078]
2025-10-02T09:31:53.194088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.194092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.194099Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_14_9023785720857643224_v1:1 with generation 1301
2025-10-02T09:31:53.194103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.194106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.194107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.194116Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_14_9023785720857643224_v1
2025-10-02T09:31:53.194118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.194133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d325ed67-fa301d6b-9d10949b-6358169e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.194139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:31:53.194145Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:31:53.197485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:31:53.197498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:31:53.197501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.197503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.197504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.197508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.197513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.197516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:31:53.197522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:31:53.197531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.197605Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397513193 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:31:53.197615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:31:53.197630Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 sending to client partition status
2025-10-02T09:31:53.197689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.197694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.197702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.197747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1302 partition: 0 MaxSeqNo: 36 sessionId: src_id|d325ed67-fa301d6b-9d10949b-6358169e_0
2025-10-02T09:31:53.197948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683d0ac7-1bdcfcf4-1dc6522f-d69001f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d325ed67-fa301d6b-9d10949b-6358169e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.200468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Write session: try to update token
2025-10-02T09:31:53.200480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.203196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.203208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.203209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.203211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.203217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.203219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.203221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018628088:8351]
2025-10-02T09:31:53.203242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.203245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.203246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.203250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.203254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.203257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.203352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.212783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId: src_id|d325ed67-fa301d6b-9d10949b-6358169e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.214754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.314215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.314464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.314472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.314688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_14_9023785720857643224_v1
2025-10-02T09:31:53.314707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.314728Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_14_9023785720857643224_v1
2025-10-02T09:31:53.314715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166177:10078]
2025-10-02T09:31:53.314718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:53.314720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:53.314738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.314770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1302 reason: error at write: Disconnected sessionId: src_id|d325ed67-fa301d6b-9d10949b-6358169e_0
2025-10-02T09:31:53.314916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1302 sessionId: src_id|d325ed67-fa301d6b-9d10949b-6358169e_0 is DEAD
2025-10-02T09:31:53.315075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:53.315089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Write session will restart in 0.008388s
2025-10-02T09:31:53.315109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Write session: Do CDS request
2025-10-02T09:31:53.315114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.322007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.323505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.323631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.323638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.323645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.323673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.323694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018628233:8354]
2025-10-02T09:31:53.324038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.324230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.324225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.324248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.324278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.324287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1303
2025-10-02T09:31:53.324410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.324428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.324434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.324427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.324436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.324455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.324459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.324459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.324460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.324460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.324461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.324461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.324462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.324463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.324463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.324464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.324464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.324467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.324474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.324476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.324478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.324480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.324482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.324484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.324486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.324488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.324491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.324493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.324495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.324499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.324503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.324506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.324508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.324511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.324513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.324515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.324518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.324520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.324523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.324526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.324529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.324531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.324534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.324536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.324538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.324541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.324543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.324546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.324548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.324550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.324556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.324558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.324561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.324577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.324703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1303 sessionId:  describe result for acl check
2025-10-02T09:31:53.324727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.324732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.324733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.324736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166329:10084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.325091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166329:10084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.326413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166329:10084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.329939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166329:10084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.329948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166329:10084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.329950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166329:10084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.329954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.332148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.333496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.333507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.333508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.333510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.333514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1302 [2:7556554780018628233:8354]
2025-10-02T09:31:53.333520Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.333529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.333531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.333532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.333533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.333542Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.333548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.333552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.333583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.333588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.333589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.333591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.333592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.333625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.333630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.333637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.333642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.333652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.333666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166229:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.333672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166363:10084], now have 1 active actors on pipe
2025-10-02T09:31:53.333676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.333677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.333678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.333685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.333695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.333705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.333706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.333708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.333710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.333710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.333723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.333728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.333729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.333714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1302
2025-10-02T09:31:53.333746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.333716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1302
2025-10-02T09:31:53.333751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.333768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.333774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.333776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.333777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.333782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.333788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.333802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.333898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.333903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.333910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.333964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1303 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0
2025-10-02T09:31:53.334202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d325ed67-fa301d6b-9d10949b-6358169e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.336694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Write session: try to update token
2025-10-02T09:31:53.336708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.342898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.342906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.342907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.342908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.342913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.342916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.342918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018628228:8354]
2025-10-02T09:31:53.342939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.342948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.342948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.342949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.342951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.342954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.343069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.348510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId: src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.350423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.414698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554780094166371:10078]
2025-10-02T09:31:53.414947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1302, pipe: [1:7556554780094166371:10078]
2025-10-02T09:31:53.455407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.455765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.455774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.455786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166371:10078], now have 1 active actors on pipe
2025-10-02T09:31:53.455923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.455981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.456006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166371:10078]
2025-10-02T09:31:53.456018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:53.456073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0
2025-10-02T09:31:53.456210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1303 sessionId: src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0 is DEAD
2025-10-02T09:31:53.456360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:53.456372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Write session will restart in 0.008530s
2025-10-02T09:31:53.456392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Write session: Do CDS request
2025-10-02T09:31:53.456397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.463093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.464532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.464627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.464633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.464638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.464663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.464685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018628367:8356]
2025-10-02T09:31:53.465033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.465209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.465238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.465414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.465443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.465444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.465444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.465445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.465445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.465446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.465447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.465447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.465448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.465448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.465449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.465449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.465452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.465459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.465461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.465463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.465465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.465467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.465469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.465470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.465472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.465474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.465476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.465478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.465482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.465486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.465490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.465493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.465495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.465497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.465499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.465502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.465504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.465506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.465509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.465511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.465513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.465516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.465518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.465521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.465524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.465527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.465529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.465531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.465533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.465535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.465537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.465540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.465556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.466208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.466271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.466279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1304
2025-10-02T09:31:53.466378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.466396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.466398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.466401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.466655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1304 sessionId:  describe result for acl check
2025-10-02T09:31:53.466678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.466683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.466684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.466687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166473:10088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.467045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166473:10088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.468273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166473:10088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.471706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166473:10088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.471716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166473:10088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.471717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166473:10088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.471721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.472888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.474276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.474286Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.474287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.474289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.474292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1303 [2:7556554780018628367:8356]
2025-10-02T09:31:53.474299Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.474309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.474312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.474313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.474314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.474323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.474325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.474329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.474359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.474364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.474365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.474367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.474368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.474403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.474408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.474414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.474419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.474429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.474442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166372:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.474448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166508:10088], now have 1 active actors on pipe
2025-10-02T09:31:53.474452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.474453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.474454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.474462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.474472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.474472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.474467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1303
2025-10-02T09:31:53.474474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.474476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1303
2025-10-02T09:31:53.474475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.474480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.474482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.474504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.474509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.474516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.474521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.474525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.474537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62edb3bf-7e20ae80-17ac3717-10956900_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.474544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.474546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.474547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.474551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.474556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.474568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.474657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.474662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.474669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.474721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1304 partition: 0 MaxSeqNo: 36 sessionId: src_id|62edb3bf-7e20ae80-17ac3717-10956900_0
2025-10-02T09:31:53.474960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c496f-32ea39f3-bea5f60d-7e23704_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62edb3bf-7e20ae80-17ac3717-10956900_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.477482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Write session: try to update token
2025-10-02T09:31:53.477497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.483596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.483608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.483609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.483610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.483616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.483619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.483620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018628362:8356]
2025-10-02T09:31:53.483641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.483643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.483644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.483645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.483646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.483648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.483749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.489399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId: src_id|62edb3bf-7e20ae80-17ac3717-10956900_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.491396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.556009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554780094166516:10078]
2025-10-02T09:31:53.556174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1303, pipe: [1:7556554780094166516:10078]
2025-10-02T09:31:53.595215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.595477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.595485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.595497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166516:10078], now have 1 active actors on pipe
2025-10-02T09:31:53.595616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.595657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.595682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166516:10078]
2025-10-02T09:31:53.595698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:53.595759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62edb3bf-7e20ae80-17ac3717-10956900_0
2025-10-02T09:31:53.595905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1304 sessionId: src_id|62edb3bf-7e20ae80-17ac3717-10956900_0 is DEAD
2025-10-02T09:31:53.596061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:53.596071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Write session will restart in 0.005082s
2025-10-02T09:31:53.596096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Write session: Do CDS request
2025-10-02T09:31:53.596101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.602134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.602244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.602257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1305
2025-10-02T09:31:53.602342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.602361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.602367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.602370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.602630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1305 sessionId:  describe result for acl check
2025-10-02T09:31:53.602649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.602654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.602655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.602658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166612:10092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.603016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166612:10092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.603278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.604550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166612:10092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.604559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.604649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.604655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.604661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.604683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.604707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018628503:8358]
2025-10-02T09:31:53.605052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.605221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.605244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.605412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.605440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.605444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.605445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.605445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.605446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.605446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.605447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.605447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.605448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.605448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.605449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.605449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.605452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.605458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.605460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.605462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.605464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.605466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.605468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.605470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.605472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.605474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.605476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.605478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.605481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.605485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.605488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.605491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.605493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.605496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.605498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.605501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.605503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.605505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.605507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.605510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.605512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.605515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.605518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.605521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.605523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.605526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.605529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.605531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.605534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.605538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.605540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.605542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.605558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.609427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166612:10092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.609439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166612:10092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.609442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166612:10092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.609447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.612978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.614375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.614385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.614386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.614389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.614392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1304 [2:7556554780018628503:8358]
2025-10-02T09:31:53.614398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.614408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.614409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.614411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.614412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.614420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.614425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.614429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.614459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.614464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.614466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.614467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.614469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.614505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.614510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.614516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.614521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.614529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.614544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166654:10092], now have 1 active actors on pipe
2025-10-02T09:31:53.614550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166517:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.614554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.614555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.614556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.614563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.614574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.614579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.614581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.614581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.614582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.614582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.614595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.614600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.614595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1304
2025-10-02T09:31:53.614595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1304
2025-10-02T09:31:53.614618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.614622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.614624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.614637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.614643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.614645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.614646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.614651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.614658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.614667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.614761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.614766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.614773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.614830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1305 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0
2025-10-02T09:31:53.615054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62edb3bf-7e20ae80-17ac3717-10956900_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.617549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Write session: try to update token
2025-10-02T09:31:53.617562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.623725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.623738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.623739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.623740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.623745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.623747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.623749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018628498:8358]
2025-10-02T09:31:53.623767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.623770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.623771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.623773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.623776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.623778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.623879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.629270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId: src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.631263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.695775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554780094166662:10078]
2025-10-02T09:31:53.695954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1304, pipe: [1:7556554780094166662:10078]
2025-10-02T09:31:53.735635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.735832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.735840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.735853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166662:10078], now have 1 active actors on pipe
2025-10-02T09:31:53.735992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166662:10078]
2025-10-02T09:31:53.736011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.736031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:53.736033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:53.736083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1305 reason: error at write: Disconnected sessionId: src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0
2025-10-02T09:31:53.736226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1305 sessionId: src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0 is DEAD
2025-10-02T09:31:53.736337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.736366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:53.736376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Write session will restart in 0.009331s
2025-10-02T09:31:53.736397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Write session: Do CDS request
2025-10-02T09:31:53.736403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.743129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.744377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.744474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.744480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.744486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.744511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.744534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018628652:8361]
2025-10-02T09:31:53.744897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.745077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.745108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.745283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.745309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.745313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.745313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.745314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.745314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.745315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.745316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.745316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.745316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.745317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.745317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.745318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.745320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.745327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.745330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.745332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.745334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.745336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.745338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.745340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.745342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.745345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.745347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.745349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.745352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.745357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.745360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.745363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.745365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.745367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.745369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.745372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.745374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.745377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.745380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.745382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.745385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.745387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.745389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.745392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.745394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.745397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.745399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.745401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.745407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.745410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.745413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.745416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.745432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.747264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.747291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.747303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1306
2025-10-02T09:31:53.747401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.747419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.747426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.747428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.747699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1306 sessionId:  describe result for acl check
2025-10-02T09:31:53.747718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.747723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.747724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.747726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166767:10096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.748061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166767:10096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.749686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166767:10096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.752222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166767:10096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.752230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166767:10096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.752232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166767:10096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.752235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.752789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.754137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.754148Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.754149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.754151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.754155Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1305 [2:7556554780018628652:8361]
2025-10-02T09:31:53.754162Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.754172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.754174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.754175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.754176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.754185Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.754192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.754196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.754223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.754227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.754228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.754230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.754231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.754341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1305
2025-10-02T09:31:53.754343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1305
2025-10-02T09:31:53.754349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.754354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.754361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.754366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.754378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.754393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166663:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.754398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166801:10096], now have 1 active actors on pipe
2025-10-02T09:31:53.754409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.754414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.754424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.754429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.754430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.754437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.754448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.754450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.754456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.754457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.754457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.754458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.754466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.754471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.754473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.754474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.754479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.754484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.754503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.754510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.754514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.754516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.754612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.754617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.754625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.754671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1306 partition: 0 MaxSeqNo: 36 sessionId: src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0
2025-10-02T09:31:53.754895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f721d1-8b7cc31a-23374e65-897c6d51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.757407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Write session: try to update token
2025-10-02T09:31:53.757420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.763958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.763973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.763974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.763976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.763982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.763985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.763988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018628647:8361]
2025-10-02T09:31:53.764015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.764015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.764019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.764019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.764021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.764021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.764140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.769505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId: src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.771462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.836063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554780094166825:10078]
2025-10-02T09:31:53.836264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1305, pipe: [1:7556554780094166825:10078]
2025-10-02T09:31:53.876285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:53.876544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.876553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.876565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166825:10078], now have 1 active actors on pipe
2025-10-02T09:31:53.876730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:53.876761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:53.876763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:53.876782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:53.876794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166825:10078]
2025-10-02T09:31:53.876818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1306 reason: error at write: Disconnected sessionId: src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0
2025-10-02T09:31:53.876941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1306 sessionId: src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0 is DEAD
2025-10-02T09:31:53.877085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:53.877095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Write session will restart in 0.009678s
2025-10-02T09:31:53.877116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Write session: Do CDS request
2025-10-02T09:31:53.877121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:53.883988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:53.885282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:53.885398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:53.885405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:53.885411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:53.885439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:53.885463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554780018628790:8363]
2025-10-02T09:31:53.885800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:53.885974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:53.885999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:53.886177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:53.886209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.886213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.886213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.886214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.886214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.886215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.886215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.886216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.886217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.886217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.886217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.886218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.886221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.886228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.886230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.886232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.886234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.886236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.886238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.886239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.886241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.886243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.886245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.886247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.886251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.886255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:53.886258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.886261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:53.886263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.886266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:53.886268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.886271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:53.886273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.886276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:53.886278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.886280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:53.886282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.886285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:53.886287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.886289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:53.886291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.886294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:53.886296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.886299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.886301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.886305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.886307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.886309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.886327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:53.888114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.888208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:53.888220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1307
2025-10-02T09:31:53.888310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:53.888331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:53.888333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:53.888336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:53.888571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1307 sessionId:  describe result for acl check
2025-10-02T09:31:53.888597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:53.888602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:53.888603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:53.888606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554780094166935:10102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:53.888960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554780094166935:10102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:53.890121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554780094166935:10102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:53.893175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554780094166935:10102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:53.893184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554780094166935:10102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:53.893186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554780094166935:10102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:53.893189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:53.893748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:53.895175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:53.895186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:53.895187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:53.895189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:53.895192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1306 [2:7556554780018628790:8363]
2025-10-02T09:31:53.895199Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:53.895209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:53.895211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.895212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.895213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.895222Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:53.895225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:53.895229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:53.895259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.895265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.895266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.895267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:53.895269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:53.895303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:53.895308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.895315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:53.895320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:53.895338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:53.895355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166830:2446], now have 1 active actors on pipe
2025-10-02T09:31:53.895362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166969:10102], now have 1 active actors on pipe
2025-10-02T09:31:53.895366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.895368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.895370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.895380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:53.895394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:53.895396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:53.895398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:53.895400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:53.895408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:53.895410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:53.895408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1306
2025-10-02T09:31:53.895411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1306
2025-10-02T09:31:53.895428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.895434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:53.895435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:53.895450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.895455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.895473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:53.895480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:53.895482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:53.895483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:53.895488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:53.895493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:53.895505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.895602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:53.895609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:53.895619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:53.895685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1307 partition: 0 MaxSeqNo: 36 sessionId: src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0
2025-10-02T09:31:53.895890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e12352-2e1b6da9-20fb960-934ee1b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:53.898393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Write session: try to update token
2025-10-02T09:31:53.898407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:53.904613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:53.904626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:53.904627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:53.904628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:53.904635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.904637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.904639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554780018628785:8363]
2025-10-02T09:31:53.904662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:53.904662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:53.904665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:53.904666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:53.904666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:53.904668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:53.904772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:53.911859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId: src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:53.913804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:53.976885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554780094166976:10078]
2025-10-02T09:31:53.977090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1306, pipe: [1:7556554780094166976:10078]
2025-10-02T09:31:54.017514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.017707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.017718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.017732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554780094166976:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.017852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.017878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.017909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:54.017953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1307 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0
2025-10-02T09:31:54.018088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1307 sessionId: src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0 is DEAD
2025-10-02T09:31:54.018195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554780094166976:10078]
2025-10-02T09:31:54.018267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:54.018277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Write session will restart in 0.005249s
2025-10-02T09:31:54.018298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Write session: Do CDS request
2025-10-02T09:31:54.018303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.024174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.024271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.024282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1308
2025-10-02T09:31:54.024367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.024385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.024390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.024393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.024653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1308 sessionId:  describe result for acl check
2025-10-02T09:31:54.024676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.024680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.024681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.024684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389134397:10113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.025047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389134397:10113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.025230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.026470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389134397:10113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.026481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.026652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.026662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.026671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.026711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.026742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313596261:8378]
2025-10-02T09:31:54.027121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.027301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.027326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.027506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.027536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.027540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.027541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.027541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.027542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.027542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.027543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.027543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.027544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.027544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.027544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.027545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.027548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.027554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.027557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.027559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.027561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.027563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.027565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.027567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.027569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.027571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.027573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.027575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.027578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.027582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.027585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.027588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.027590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.027592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.027595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.027598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.027600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.027602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.027604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.027607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.027609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.027611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.027613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.027616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.027618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.027621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.027623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.027626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.027628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.027631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.027632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.027635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.027652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.031429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389134397:10113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.031438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389134397:10113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.031440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389134397:10113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.031443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.035009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.036523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.036532Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.036534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.036536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.036539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1307 [2:7556554784313596261:8378]
2025-10-02T09:31:54.036546Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.036557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.036558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.036560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.036561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.036570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.036572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.036577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.036606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.036612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.036613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.036614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.036616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.036669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.036675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.036686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.036698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.036717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.036736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134436:10113], now have 1 active actors on pipe
2025-10-02T09:31:54.036742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134298:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.036746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.036748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.036750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.036760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.036770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.036773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.036753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1307
2025-10-02T09:31:54.036757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1307
2025-10-02T09:31:54.036775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.036776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.036784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.036786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.036820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.036821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.036830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.036838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.036849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.036854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90ed698f-f2342918-f7658c1-5ab63f18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.036858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.036860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.036861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.036867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.036873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.036887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.036993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.036999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.037008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.037062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1308 partition: 0 MaxSeqNo: 36 sessionId: src_id|90ed698f-f2342918-f7658c1-5ab63f18_0
2025-10-02T09:31:54.037285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dc8fd7-603ff797-fd369a99-3af82a81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90ed698f-f2342918-f7658c1-5ab63f18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.039770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Write session: try to update token
2025-10-02T09:31:54.039784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.046067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.046080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.046082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.046083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.046090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.046092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.046094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313596256:8378]
2025-10-02T09:31:54.046116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.046120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.046120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.046123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.046124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.046128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.046250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.052328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId: src_id|90ed698f-f2342918-f7658c1-5ab63f18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.054330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.118172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389134443:10078]
2025-10-02T09:31:54.118405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1307, pipe: [1:7556554784389134443:10078]
2025-10-02T09:31:54.157752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.158018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.158027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.158040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134443:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.158178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.158234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:54.158244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:54.158284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1308 reason: error at write: Disconnected sessionId: src_id|90ed698f-f2342918-f7658c1-5ab63f18_0
2025-10-02T09:31:54.158310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389134443:10078]
2025-10-02T09:31:54.158335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.158417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1308 sessionId: src_id|90ed698f-f2342918-f7658c1-5ab63f18_0 is DEAD
2025-10-02T09:31:54.158589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:54.158599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Write session will restart in 0.008624s
2025-10-02T09:31:54.158620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Write session: Do CDS request
2025-10-02T09:31:54.158624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.165624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.167082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.167193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.167199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.167204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.167232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.167252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313596401:8380]
2025-10-02T09:31:54.167590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.167777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.167801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.167982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.168009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.168013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.168014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.168014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.168015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.168015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.168016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.168016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.168017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.168017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.168018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.168018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.168021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.168027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.168030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.168032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.168033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.168035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.168037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.168039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.168041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.168043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.168045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.168047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.168051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.168054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.168057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.168060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.168062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.168065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.168067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.168070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.168072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.168075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.168078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.168080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.168083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.168086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.168087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.168090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.168092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.168095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.168101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.168104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.168106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.168108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.168110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.168113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.168131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.168191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.168259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.168270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1309
2025-10-02T09:31:54.168365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.168385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.168391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.168394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.168649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1309 sessionId:  describe result for acl check
2025-10-02T09:31:54.168671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.168676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.168677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.168679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389134550:10117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.169046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389134550:10117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.170380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389134550:10117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.174332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389134550:10117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.174340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389134550:10117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.174342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389134550:10117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.174345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.175555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.176948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.176961Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.176963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.176965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.176970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1308 [2:7556554784313596401:8380]
2025-10-02T09:31:54.176980Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.176993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.176999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.177001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.177003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.177014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.177018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.177023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.177052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.177057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.177058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.177059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.177061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.177095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.177100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.177106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.177111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.177125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.177142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134444:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.177148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134585:10117], now have 1 active actors on pipe
2025-10-02T09:31:54.177153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.177155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.177157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.177166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.177179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.177180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.177182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.177183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.177193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.177195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.177182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1308
2025-10-02T09:31:54.177188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1308
2025-10-02T09:31:54.177212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.177218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.177218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.177231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.177237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.177268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.177277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.177279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.177282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.177289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.177299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.177311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.177405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.177412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.177423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.177490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1309 partition: 0 MaxSeqNo: 36 sessionId: src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0
2025-10-02T09:31:54.177724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ed698f-f2342918-f7658c1-5ab63f18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.180221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Write session: try to update token
2025-10-02T09:31:54.180234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.186511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.186524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.186526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.186527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.186531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.186534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.186536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313596396:8380]
2025-10-02T09:31:54.186559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.186560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.186563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.186563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.186564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.186565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.186692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.192419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId: src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.194380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.258468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389134595:10078]
2025-10-02T09:31:54.258712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1308, pipe: [1:7556554784389134595:10078]
2025-10-02T09:31:54.299707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.299929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.299938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.299951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134595:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.300109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.300113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.300146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:54.300145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389134595:10078]
2025-10-02T09:31:54.300194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1309 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0
2025-10-02T09:31:54.300322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1309 sessionId: src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0 is DEAD
2025-10-02T09:31:54.300452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:54.300462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Write session will restart in 0.005132s
2025-10-02T09:31:54.300480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Write session: Do CDS request
2025-10-02T09:31:54.300484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.306195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.306233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.306241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1310
2025-10-02T09:31:54.306321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.306340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.306343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.306345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.306660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1310 sessionId:  describe result for acl check
2025-10-02T09:31:54.306690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.306697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.306700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.306704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389134683:10122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.307165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389134683:10122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.307881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.308476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389134683:10122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.309299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.309405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.309411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.309417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.309445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.309520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313596544:8383]
2025-10-02T09:31:54.309953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.310027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389134683:10122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.310036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389134683:10122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.310038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389134683:10122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.310043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.310156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.310188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.310389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.310422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.310425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.310426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.310426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.310427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.310428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.310428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.310429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.310429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.310430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.310430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.310431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.310433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.310439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.310442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.310444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.310446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.310448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.310450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.310451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.310453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.310456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.310458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.310459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.310463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.310467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.310470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.310473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.310475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.310478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.310481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.310483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.310486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.310488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.310490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.310492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.310495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.310497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.310499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.310501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.310503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.310506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.310508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.310510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.310512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.310515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.310517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.310519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.310536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.318159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.319531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.319540Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.319542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.319543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.319546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1309 [2:7556554784313596544:8383]
2025-10-02T09:31:54.319553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.319561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.319562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.319564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.319565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.319573Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.319577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.319581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.319610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.319615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.319616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.319618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.319619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.319654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.319659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.319665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.319673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.319690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.319709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134735:10122], now have 1 active actors on pipe
2025-10-02T09:31:54.319715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134596:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.319719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.319721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.319723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.319732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.319745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.319746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.319749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.319750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.319758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.319760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.319778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.319785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.319786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.319769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1309
2025-10-02T09:31:54.319796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1309
2025-10-02T09:31:54.319819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.319825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.319845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f378765-1ed023a6-23432547-fea6d385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.319854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.319857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.319862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.319870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.319880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.319889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.319986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.319991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.319999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.320053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1310 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f378765-1ed023a6-23432547-fea6d385_0
2025-10-02T09:31:54.320276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd2d1ff-8d0c5785-f40e7004-6cf191fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f378765-1ed023a6-23432547-fea6d385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.322765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Write session: try to update token
2025-10-02T09:31:54.322778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.329368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.329380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.329381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.329382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.329386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.329388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.329391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313596539:8383]
2025-10-02T09:31:54.329413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.329416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.329417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.329421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.329425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.329427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.329536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.334503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId: src_id|8f378765-1ed023a6-23432547-fea6d385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.336379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.400288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389134746:10078]
2025-10-02T09:31:54.400504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1309, pipe: [1:7556554784389134746:10078]
2025-10-02T09:31:54.439868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.440087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.440095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.440121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134746:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.440283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.440301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.440323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:54.440326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:54.440337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389134746:10078]
2025-10-02T09:31:54.440374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1310 reason: error at write: Disconnected sessionId: src_id|8f378765-1ed023a6-23432547-fea6d385_0
2025-10-02T09:31:54.440509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1310 sessionId: src_id|8f378765-1ed023a6-23432547-fea6d385_0 is DEAD
2025-10-02T09:31:54.440654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:54.440664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Write session will restart in 0.008046s
2025-10-02T09:31:54.440689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Write session: Do CDS request
2025-10-02T09:31:54.440696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.447792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.449112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.449225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.449232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.449237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.449264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.449285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313596686:8385]
2025-10-02T09:31:54.449750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.449954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.449998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.450199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.450212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.450244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.450248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.450249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.450250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.450250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.450251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.450258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.450266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1311
2025-10-02T09:31:54.450252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.450253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.450255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.450255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.450256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.450256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.450260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.450267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.450270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.450272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.450274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.450276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.450278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.450280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.450282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.450284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.450286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.450288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.450292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.450297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.450301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.450304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.450306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.450310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.450312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.450315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.450317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.450320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.450322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.450325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.450327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.450330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.450333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.450336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.450354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.450340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.450343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.450345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.450347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.450351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.450353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.450355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.450372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.450377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.450380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.450358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.450376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.450626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1311 sessionId:  describe result for acl check
2025-10-02T09:31:54.450650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.450655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.450656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.450659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389134855:10126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.451039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389134855:10126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.452284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389134855:10126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.456779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389134855:10126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.456791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389134855:10126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.456794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389134855:10126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.456812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.458028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.459466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.459478Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.459480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.459482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.459485Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1310 [2:7556554784313596686:8385]
2025-10-02T09:31:54.459494Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.459503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.459508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.459510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.459511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.459521Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.459524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.459528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.459561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.459566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.459567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.459569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.459570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.459603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.459607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.459617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.459630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.459648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.459666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134747:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.459672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134890:10126], now have 1 active actors on pipe
2025-10-02T09:31:54.459676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.459678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.459679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.459691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.459702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.459704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.459699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1310
2025-10-02T09:31:54.459708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.459709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.459715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.459718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.459720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1310
2025-10-02T09:31:54.459737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.459743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.459744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.459753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.459759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.459785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.459792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.459794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.459796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.459801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.459808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.459824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.459926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.459933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.459943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.460000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1311 partition: 0 MaxSeqNo: 36 sessionId: src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0
2025-10-02T09:31:54.460217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f378765-1ed023a6-23432547-fea6d385_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.462704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Write session: try to update token
2025-10-02T09:31:54.462718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.469395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.469409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.469410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.469411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.469416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.469419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.469421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313596681:8385]
2025-10-02T09:31:54.469444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.469447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.469448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.469453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.469456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.469458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.469572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.474600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId: src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.476506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.540587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389134898:10078]
2025-10-02T09:31:54.540781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1310, pipe: [1:7556554784389134898:10078]
2025-10-02T09:31:54.583417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.583678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.583687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.583712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134898:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.583916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.583940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.583943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389134898:10078]
2025-10-02T09:31:54.583963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:54.584019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0
2025-10-02T09:31:54.584165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1311 sessionId: src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0 is DEAD
2025-10-02T09:31:54.584322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:54.584332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Write session will restart in 0.007004s
2025-10-02T09:31:54.584352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Write session: Do CDS request
2025-10-02T09:31:54.584358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.591218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.592224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.592295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.592305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1312
2025-10-02T09:31:54.592398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.592421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.592429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.592432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.592485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.592607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.592614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.592620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.592651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.592675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313596829:8387]
2025-10-02T09:31:54.592696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1312 sessionId:  describe result for acl check
2025-10-02T09:31:54.592722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.592723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.592724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.592726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389135004:10130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.593065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.593107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389135004:10130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.593275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.593304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.593504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.593542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.593547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.593547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.593548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.593549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.593549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.593550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.593550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.593551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.593551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.593552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.593552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.593555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.593561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.593563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.593565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.593567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.593569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.593571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.593573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.593575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.593577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.593579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.593580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.593584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.593588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.593591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.593593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.593596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.593599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.593601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.593604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.593606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.593608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.593610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.593613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.593615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.593618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.593620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.593622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.593625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.593627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.593630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.593632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.593636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.593638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.593640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.593643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.593661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.594617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389135004:10130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.598869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389135004:10130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.598877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389135004:10130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.598879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389135004:10130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.598883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.601124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.602644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.602656Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.602657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.602659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.602663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1311 [2:7556554784313596829:8387]
2025-10-02T09:31:54.602671Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.602680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.602685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.602687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.602688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.602697Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.602700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.602704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.602749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.602754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.602755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.602757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.602758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.602792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.602796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.602803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.602808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.602818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.602830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135043:10130], now have 1 active actors on pipe
2025-10-02T09:31:54.602843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389134899:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.602847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.602848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.602850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.602858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.602868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.602877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.602878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.602879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.602880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.602881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.602878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1311
2025-10-02T09:31:54.602892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.602897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.602904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.602891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1311
2025-10-02T09:31:54.602912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.602918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.602938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.602948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.602950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.602951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.602956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.602962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.602973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.603068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.603075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.603084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.603140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1312 partition: 0 MaxSeqNo: 36 sessionId: src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0
2025-10-02T09:31:54.603355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e80d7c-3e2b4a94-6f06850e-b00549b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.605881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Write session: try to update token
2025-10-02T09:31:54.605895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.612107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.612117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.612119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.612120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.612125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.612128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.612131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313596824:8387]
2025-10-02T09:31:54.612154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.612157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.612157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.612158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.612161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.612163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.612269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.617708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId: src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.619616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.683926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389135051:10078]
2025-10-02T09:31:54.684112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1311, pipe: [1:7556554784389135051:10078]
2025-10-02T09:31:54.728891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.729146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.729154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.729167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135051:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.729289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.729333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389135051:10078]
2025-10-02T09:31:54.729359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:54.729362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.729418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1312 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0
2025-10-02T09:31:54.729562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1312 sessionId: src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0 is DEAD
2025-10-02T09:31:54.729713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:54.729724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Write session will restart in 0.008864s
2025-10-02T09:31:54.729749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Write session: Do CDS request
2025-10-02T09:31:54.729754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.736368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.737816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.737916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.737922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.737927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.737954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.737978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313596985:8390]
2025-10-02T09:31:54.738333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.738503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.738527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.738701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.738730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.738733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.738734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.738735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.738735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.738736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.738736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.738737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.738737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.738738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.738738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.738739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.738741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.738748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.738750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.738752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.738754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.738756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.738758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.738760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.738762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.738764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.738766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.738768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.738773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.738777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.738780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.738783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.738785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.738788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.738790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.738792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.738796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.738798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.738801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.738803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.738805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.738808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.738810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.738813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.738815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.738817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.738819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.738822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.738824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.738827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.738829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.738840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.738859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.739130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.739223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.739233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1313
2025-10-02T09:31:54.739318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.739335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.739341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.739344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.739588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1313 sessionId:  describe result for acl check
2025-10-02T09:31:54.739612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.739617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.739618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.739621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389135162:10134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.739974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389135162:10134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.741084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389135162:10134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.745445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389135162:10134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.745453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389135162:10134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.745455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389135162:10134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.745459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.746655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.748125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.748137Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.748138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.748140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.748143Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1312 [2:7556554784313596985:8390]
2025-10-02T09:31:54.748151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.748160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.748163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.748165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.748166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.748176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.748183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.748187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.748218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.748223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.748224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.748226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.748227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.748264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.748269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.748275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.748281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.748292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.748307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135197:10134], now have 1 active actors on pipe
2025-10-02T09:31:54.748312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135052:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.748315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.748316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.748318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.748326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.748334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.748341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.748344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.748345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.748354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.748360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.748360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.748361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.748365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.748342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1312
2025-10-02T09:31:54.748344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1312
2025-10-02T09:31:54.748380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.748385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.748403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.748410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.748413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.748413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.748419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.748427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.748434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.748526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.748531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.748538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.748598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1313 partition: 0 MaxSeqNo: 36 sessionId: src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0
2025-10-02T09:31:54.748832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c441d235-d16b4de3-fd4d9af1-b366146b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.751316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Write session: try to update token
2025-10-02T09:31:54.751329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.758059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.758073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.758075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.758076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.758081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.758083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.758086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313596980:8390]
2025-10-02T09:31:54.758111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.758113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.758115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.758116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.758116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.758118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.758226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.763262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId: src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.765259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.829375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389135221:10078]
2025-10-02T09:31:54.829564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1312, pipe: [1:7556554784389135221:10078]
2025-10-02T09:31:54.874070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:54.874264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.874273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.874298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135221:10078], now have 1 active actors on pipe
2025-10-02T09:31:54.874467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:54.874467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:54.874470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:54.874516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389135221:10078]
2025-10-02T09:31:54.874525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1313 reason: error at write: Disconnected sessionId: src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0
2025-10-02T09:31:54.874656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1313 sessionId: src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0 is DEAD
2025-10-02T09:31:54.874824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:54.874842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Write session will restart in 0.005565s
2025-10-02T09:31:54.874863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Write session: Do CDS request
2025-10-02T09:31:54.874868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:54.875205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:54.881118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.881220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:54.881229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1314
2025-10-02T09:31:54.881300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:54.881318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:54.881324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:54.881326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:54.881568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1314 sessionId:  describe result for acl check
2025-10-02T09:31:54.881585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:54.881590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:54.881591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:54.881594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554784389135332:10140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:54.881593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:54.881932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554784389135332:10140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:54.882862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:54.882968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:54.882975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:54.882980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:54.883006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:54.883031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554784313597130:8392]
2025-10-02T09:31:54.883365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:54.883541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:54.883563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:54.883614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554784389135332:10140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:54.883737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:54.883764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.883768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.883768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.883769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.883769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.883770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.883771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.883771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.883772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.883772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.883773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.883773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.883776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.883781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.883783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.883785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.883787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.883789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.883791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.883793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.883795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.883797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.883799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.883801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.883804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.883808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:54.883811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.883814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:54.883816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.883819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:54.883821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.883823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:54.883826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.883828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:54.883830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.883833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:54.883835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.883838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:54.883840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.883843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:54.883846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.883848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:54.883850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.883853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.883859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.883862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.883864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.883866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.883883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:54.888596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554784389135332:10140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:54.888604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554784389135332:10140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:54.888606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554784389135332:10140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:54.888610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:54.891259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:54.892676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:54.892686Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:54.892687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:54.892689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:54.892693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1313 [2:7556554784313597130:8392]
2025-10-02T09:31:54.892743Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:54.892755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:54.892759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.892761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.892762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.892771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:54.892777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:54.892781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:54.892827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.892832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.892833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.892835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:54.892836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:54.892871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:54.892876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.892882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:54.892887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:54.892895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:54.892910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135226:2446], now have 1 active actors on pipe
2025-10-02T09:31:54.892916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135372:10140], now have 1 active actors on pipe
2025-10-02T09:31:54.892919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.892921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.892922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.892930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:54.892941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:54.892947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:54.892949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:54.892950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:54.892951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:54.892952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:54.892967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.892972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:54.892975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:54.892953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1313
2025-10-02T09:31:54.892965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1313
2025-10-02T09:31:54.892988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.892993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.893010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:54.893016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:54.893019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:54.893020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:54.893025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:54.893033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:54.893045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.893127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:54.893132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:54.893140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:54.893193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1314 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0
2025-10-02T09:31:54.893434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832c1277-b6fc597-a3f72e81-6fea3cf3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:54.895896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Write session: try to update token
2025-10-02T09:31:54.895909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:54.902109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:54.902122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:54.902123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:54.902125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:54.902130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.902132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.902134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554784313597125:8392]
2025-10-02T09:31:54.902156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:54.902157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:54.902159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:54.902160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:54.902162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:54.902165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:54.902267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:54.907976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId: src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:54.909899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:54.974761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554784389135379:10078]
2025-10-02T09:31:54.974976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1313, pipe: [1:7556554784389135379:10078]
2025-10-02T09:31:55.015470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.015817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.015827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.015839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554784389135379:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.015958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.015971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.016005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:55.016009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554784389135379:10078]
2025-10-02T09:31:55.016059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1314 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0
2025-10-02T09:31:55.016213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1314 sessionId: src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0 is DEAD
2025-10-02T09:31:55.016325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:55.016330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Write session will restart in 0.009108s
2025-10-02T09:31:55.016346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Write session: Do CDS request
2025-10-02T09:31:55.016351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.024798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.025100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.025192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.025198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.025204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.025229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.025249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608564601:8401]
2025-10-02T09:31:55.025596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.025760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.025783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.025962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.025988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.025992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.025993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.025993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.025994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.025994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.025995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.025995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.025996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.025996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.025997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.025998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.026000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.026007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.026009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.026011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.026013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.026015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.026017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.026019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.026021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.026024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.026026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.026028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.026032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.026035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.026038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.026041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.026043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.026046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.026048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.026051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.026053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.026056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.026058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.026060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.026063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.026065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.026067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.026070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.026072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.026075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.026077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.026079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.026081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.026084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.026086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.026089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.026106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.026224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.026289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.026300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1315
2025-10-02T09:31:55.026380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.026397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.026403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.026405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.026637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1315 sessionId:  describe result for acl check
2025-10-02T09:31:55.026657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.026661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.026662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.026666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684102805:10150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.026955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684102805:10150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.028173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684102805:10150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.032950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684102805:10150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.032961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684102805:10150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.032963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684102805:10150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.032967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.033715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.035185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.035195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.035196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.035198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.035201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1314 [2:7556554788608564601:8401]
2025-10-02T09:31:55.035208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.035218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.035222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.035223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.035224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.035233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.035239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.035244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.035277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.035281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.035282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.035284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.035285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.035322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.035326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.035333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.035338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.035345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.035360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684102677:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.035365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684102836:10150], now have 1 active actors on pipe
2025-10-02T09:31:55.035369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.035370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.035371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.035377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.035385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.035386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.035388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.035389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.035392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.035393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.035384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1314
2025-10-02T09:31:55.035408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1314
2025-10-02T09:31:55.035407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.035413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.035416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.035434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.035437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.035453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.035467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.035473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.035474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.035479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.035484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.035491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.035574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.035579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.035586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.035648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1315 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0
2025-10-02T09:31:55.035887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0709ff-3ac4b04c-565c1797-f2095bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.038406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Write session: try to update token
2025-10-02T09:31:55.038422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.044862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.044873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.044874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.044876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.044883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.044886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.044889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608564596:8401]
2025-10-02T09:31:55.044918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.044923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.044925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.044925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.044930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.044934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.045046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.050828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId: src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.052761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.116072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684102853:10078]
2025-10-02T09:31:55.116285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1314, pipe: [1:7556554788684102853:10078]
2025-10-02T09:31:55.160371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.160635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.160644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.160657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684102853:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.160823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.160839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.160854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684102853:10078]
2025-10-02T09:31:55.160906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:55.160976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0
2025-10-02T09:31:55.161130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1315 sessionId: src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0 is DEAD
2025-10-02T09:31:55.161281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:55.161292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Write session will restart in 0.007009s
2025-10-02T09:31:55.161314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Write session: Do CDS request
2025-10-02T09:31:55.161318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.167845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.169124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.169151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.169214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.169224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1316
2025-10-02T09:31:55.169297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.169297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.169304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.169310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.169315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.169321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.169324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.169341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.169363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608564755:8409]
2025-10-02T09:31:55.169581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1316 sessionId:  describe result for acl check
2025-10-02T09:31:55.169605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.169610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.169611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.169614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684102963:10155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.169706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.169896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.169921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.169997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684102963:10155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.170094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.170122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.170126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.170127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.170127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.170128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.170128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.170129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.170129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.170130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.170130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.170131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.170131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.170135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.170141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.170143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.170145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.170147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.170149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.170151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.170153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.170155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.170157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.170159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.170161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.170166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.170169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.170173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.170175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.170177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.170180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.170182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.170184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.170187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.170189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.170191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.170194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.170196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.170199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.170201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.170204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.170206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.170208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.170211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.170213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.170215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.170218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.170221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.170224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.170242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.171509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684102963:10155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.175714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684102963:10155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.175724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684102963:10155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.175726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684102963:10155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.175730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.177969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.179367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.179378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.179379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.179381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.179385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1315 [2:7556554788608564755:8409]
2025-10-02T09:31:55.179391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.179401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.179407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.179409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.179410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.179419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.179425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.179430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.179461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.179466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.179467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.179469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.179470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.179504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.179508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.179515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.179523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.179531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.179545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103001:10155], now have 1 active actors on pipe
2025-10-02T09:31:55.179550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684102854:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.179554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.179555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.179556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.179563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.179572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.179572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1315
2025-10-02T09:31:55.179579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.179582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.179581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1315
2025-10-02T09:31:55.179584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.179586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.179588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.179597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.179600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.179601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.179619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.179625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.179644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.179651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.179653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.179654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.179658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.179666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.179677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.179769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.179774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.179781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.179832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1316 partition: 0 MaxSeqNo: 36 sessionId: src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0
2025-10-02T09:31:55.180062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4dd3373-fa535d9f-1e038edc-27b9e152_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.182655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Write session: try to update token
2025-10-02T09:31:55.182670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.189255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.189268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.189270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.189271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.189276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.189279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.189282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608564750:8409]
2025-10-02T09:31:55.189303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.189304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.189306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.189307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.189308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.189309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.189425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.195477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId: src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.197508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.260957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684103012:10078]
2025-10-02T09:31:55.261117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1315, pipe: [1:7556554788684103012:10078]
2025-10-02T09:31:55.302854Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.303098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.303107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.303119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103012:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.303242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.303257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684103012:10078]
2025-10-02T09:31:55.303280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.303296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:55.303366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0
2025-10-02T09:31:55.303521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1316 sessionId: src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0 is DEAD
2025-10-02T09:31:55.303670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:55.303683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Write session will restart in 0.008378s
2025-10-02T09:31:55.303702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Write session: Do CDS request
2025-10-02T09:31:55.303707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.310441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.311771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.311915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.311924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.311932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.311967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.311990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608564905:8412]
2025-10-02T09:31:55.312335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.312758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.312787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.312988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.313018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.313022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.313022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.313023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.313024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.313024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.313025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.313025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.313025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.313026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.313026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.313027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.313030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.313037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.313039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.313041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.313043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.313045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.313047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.313049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.313051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.313053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.313055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.313057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.313061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.313065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.313068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.313071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.313073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.313076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.313078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.313080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.313082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.313085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.313087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.313090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.313092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.313095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.313097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.313099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.313102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.313104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.313106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.313109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.313112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.313115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.313117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.313120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.313136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.313217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.313280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.313289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1317
2025-10-02T09:31:55.313378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.313402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.313412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.313419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.313679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1317 sessionId:  describe result for acl check
2025-10-02T09:31:55.313703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.313707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.313708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.313711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684103127:10160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.314045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684103127:10160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.315669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684103127:10160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.320000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684103127:10160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.320010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684103127:10160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.320012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684103127:10160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.320016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.320538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.321983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.321993Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.321994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.321996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.322000Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1316 [2:7556554788608564905:8412]
2025-10-02T09:31:55.322006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.322016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.322019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.322020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.322021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.322030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.322037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.322042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.322071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.322075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.322076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.322078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.322079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.322170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.322174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.322180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.322186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.322198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.322212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103162:10160], now have 1 active actors on pipe
2025-10-02T09:31:55.322217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103013:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.322196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1316
2025-10-02T09:31:55.322221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.322198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1316
2025-10-02T09:31:55.322222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.322223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.322228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.322236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.322237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.322240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.322242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.322243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.322245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.322256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.322261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.322281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.322288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.322294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.322297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.322301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.322303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.322304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.322309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.322314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.322332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.322430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.322435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.322443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.322487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1317 partition: 0 MaxSeqNo: 36 sessionId: src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0
2025-10-02T09:31:55.322693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b194e8-9db378db-d9e99b7f-24218e1c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.324889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Write session: try to update token
2025-10-02T09:31:55.324900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.331952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.331966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.331967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.331968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.331973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.331975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.331978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608564900:8412]
2025-10-02T09:31:55.331999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.332003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.332004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.332009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.332013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.332017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.332116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.335325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId: src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.337356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.403306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684103170:10078]
2025-10-02T09:31:55.403477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1316, pipe: [1:7556554788684103170:10078]
2025-10-02T09:31:55.445021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.445309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.445318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.445343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103170:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.445490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.445541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684103170:10078]
2025-10-02T09:31:55.445564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.445571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:55.445636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1317 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0
2025-10-02T09:31:55.445795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1317 sessionId: src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0 is DEAD
2025-10-02T09:31:55.445912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:55.445921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Write session will restart in 0.009362s
2025-10-02T09:31:55.445939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Write session: Do CDS request
2025-10-02T09:31:55.445942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.452928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.454236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.454345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.454351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.454356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.454383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.454415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608565054:8414]
2025-10-02T09:31:55.454760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.454940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.454963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.455141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.455237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.455243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.455243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.455244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.455244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.455245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.455246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.455246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.455247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.455247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.455248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.455248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.455251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.455258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.455260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.455262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.455264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.455266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.455268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.455270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.455272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.455275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.455277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.455279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.455284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.455288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.455291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.455294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.455296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.455299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.455302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.455305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.455307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.455310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.455312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.455316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.455318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.455321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.455323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.455325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.455327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.455330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.455332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.455335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.455339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.455345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.455348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.455350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.455366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.456222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.456333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.456345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1318
2025-10-02T09:31:55.456443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.456468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.456476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.456480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.456838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1318 sessionId:  describe result for acl check
2025-10-02T09:31:55.456872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.456878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.456879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.456884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684103286:10164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.457366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684103286:10164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.459152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684103286:10164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.462326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684103286:10164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.462336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684103286:10164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.462338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684103286:10164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.462342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.462851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.464246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.464257Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.464258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.464260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.464263Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1317 [2:7556554788608565054:8414]
2025-10-02T09:31:55.464270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.464280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.464283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.464284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.464285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.464295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.464302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.464306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.464342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.464347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.464348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.464349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.464350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.464390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.464394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.464401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.464406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.464414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.464426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103171:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.464429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103321:10164], now have 1 active actors on pipe
2025-10-02T09:31:55.464434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.464435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.464437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.464445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.464451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.464451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1317
2025-10-02T09:31:55.464459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.464459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.464461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.464469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1317
2025-10-02T09:31:55.464462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.464463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.464483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.464484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.464486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.464496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.464501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.464526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.464533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.464536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.464537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.464542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.464547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.464557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.464647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.464652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.464659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.464711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1318 partition: 0 MaxSeqNo: 36 sessionId: src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0
2025-10-02T09:31:55.464980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49713b4d-29bfa767-7caf4ffc-369b9791_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.467576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Write session: try to update token
2025-10-02T09:31:55.467588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.473917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.473932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.473933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.473934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.473942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.473944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.473946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608565049:8414]
2025-10-02T09:31:55.473969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.473973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.473974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.473979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.473983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.473986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.474089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.480490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId: src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.482492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.545621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684103329:10078]
2025-10-02T09:31:55.545757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1317, pipe: [1:7556554788684103329:10078]
2025-10-02T09:31:55.587970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.588225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.588235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.588248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103329:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.588390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.588428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.588464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:55.588470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684103329:10078]
2025-10-02T09:31:55.588521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0
2025-10-02T09:31:55.588661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1318 sessionId: src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0 is DEAD
2025-10-02T09:31:55.588835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:55.588847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Write session will restart in 0.009156s
2025-10-02T09:31:55.588867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Write session: Do CDS request
2025-10-02T09:31:55.588873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.595877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.597138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.597238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.597244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.597250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.597277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.597308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608565204:8416]
2025-10-02T09:31:55.597655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.597821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.597844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.598021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.598049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.598052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.598053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.598053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.598054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.598054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.598055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.598055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.598056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.598057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.598057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.598058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.598060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.598067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.598069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.598071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.598073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.598075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.598077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.598079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.598081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.598083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.598085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.598087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.598091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.598095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.598099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.598102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.598104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.598107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.598109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.598111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.598113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.598116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.598118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.598121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.598123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.598125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.598128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.598130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.598132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.598135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.598137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.598140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.598142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.598145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.598147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.598150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.598166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.599238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.599329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.599339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1319
2025-10-02T09:31:55.599413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.599430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.599433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.599436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.599688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1319 sessionId:  describe result for acl check
2025-10-02T09:31:55.599715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.599721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.599722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.599725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684103446:10168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.600071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684103446:10168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.601260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684103446:10168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.605045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684103446:10168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.605056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684103446:10168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.605059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684103446:10168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.605063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.605568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.607023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.607039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.607041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.607044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.607048Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1318 [2:7556554788608565204:8416]
2025-10-02T09:31:55.607060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.607070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.607075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.607077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.607078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.607087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.607093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.607098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.607130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.607135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.607136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.607137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.607139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.607176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.607181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.607187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.607193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.607204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.607218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103330:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.607220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103481:10168], now have 1 active actors on pipe
2025-10-02T09:31:55.607224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.607225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.607227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.607236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.607246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.607250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.607253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.607254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.607254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.607256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.607250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1318
2025-10-02T09:31:55.607256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1318
2025-10-02T09:31:55.607272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.607276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.607279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.607293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.607298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.607315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.607323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.607325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.607326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.607331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.607337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.607346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.607437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.607442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.607449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.607502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1319 partition: 0 MaxSeqNo: 36 sessionId: src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0
2025-10-02T09:31:55.607733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb376d1-a1224a54-d20bef16-9d9d85c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.610320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Write session: try to update token
2025-10-02T09:31:55.610334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.616475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.616488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.616489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.616490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.616495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.616498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.616500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608565199:8416]
2025-10-02T09:31:55.616522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.616525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.616526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.616527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.616530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.616532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.616629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.622824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId: src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.624753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.688475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684103489:10078]
2025-10-02T09:31:55.688649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1318, pipe: [1:7556554788684103489:10078]
2025-10-02T09:31:55.731661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.731928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.731939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.731954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103489:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.732133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.732174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.732166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:55.732169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:55.732172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684103489:10078]
2025-10-02T09:31:55.732221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1319 reason: error at write: Disconnected sessionId: src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0
2025-10-02T09:31:55.732365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1319 sessionId: src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0 is DEAD
2025-10-02T09:31:55.732485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:55.732494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Write session will restart in 0.006844s
2025-10-02T09:31:55.732511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Write session: Do CDS request
2025-10-02T09:31:55.732514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.739928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.740215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.740274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.740283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1320
2025-10-02T09:31:55.740374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.740395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.740401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.740404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.740683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1320 sessionId:  describe result for acl check
2025-10-02T09:31:55.740705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.740709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.740710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.740713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684103603:10172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.741071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684103603:10172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.741273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.741366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.741372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.741377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.741402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.741424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608565367:8419]
2025-10-02T09:31:55.741768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.741961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.741984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.742160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.742188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.742192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.742192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.742193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.742193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.742194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.742195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.742195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.742195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.742196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.742196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.742197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.742200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.742206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.742208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.742210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.742212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.742214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.742216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.742218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.742220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.742222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.742224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.742226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.742230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.742234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.742237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.742240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.742242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.742245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.742247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.742250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.742252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.742254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.742256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.742259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.742262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.742264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.742268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.742271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.742273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.742276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.742278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.742281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.742283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.742286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.742289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.742293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.742311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.742730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684103603:10172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.747150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684103603:10172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.747162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684103603:10172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.747165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684103603:10172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.747170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.749796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.751178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.751188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.751190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.751192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.751196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1319 [2:7556554788608565367:8419]
2025-10-02T09:31:55.751203Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.751213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.751215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.751216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.751217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.751227Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.751231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.751236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.751267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.751272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.751273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.751275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.751277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.751312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.751317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.751323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.751329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.751339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.751353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103490:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.751358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103642:10172], now have 1 active actors on pipe
2025-10-02T09:31:55.751362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.751363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.751364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.751372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.751382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.751385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.751387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.751388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.751391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.751393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.751391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1319
2025-10-02T09:31:55.751397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1319
2025-10-02T09:31:55.751407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.751415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.751416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.751427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.751429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.751452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.751459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.751461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.751462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.751468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.751473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.751482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.751593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.751597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.751605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.751666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1320 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0
2025-10-02T09:31:55.751902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcca196-7b05f6fc-876e2b61-80f14bc0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.754503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Write session: try to update token
2025-10-02T09:31:55.754515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.761043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.761057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.761058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.761059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.761064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.761066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.761068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608565362:8419]
2025-10-02T09:31:55.761088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.761092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.761094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.761097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.761100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.761104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.761200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.766948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId: src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.768919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.832347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684103668:10078]
2025-10-02T09:31:55.832516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1319, pipe: [1:7556554788684103668:10078]
2025-10-02T09:31:55.873905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:55.874110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.874119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.874131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103668:10078], now have 1 active actors on pipe
2025-10-02T09:31:55.874258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:55.874272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:55.874289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:55.874292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:55.874308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684103668:10078]
2025-10-02T09:31:55.874340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1320 reason: error at write: Disconnected sessionId: src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0
2025-10-02T09:31:55.874475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1320 sessionId: src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0 is DEAD
2025-10-02T09:31:55.874628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:55.874638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Write session will restart in 0.006885s
2025-10-02T09:31:55.874658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Write session: Do CDS request
2025-10-02T09:31:55.874663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:55.881993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:55.882207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.882285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:55.882296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1321
2025-10-02T09:31:55.882372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:55.882390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:55.882397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:55.882399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:55.882657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1321 sessionId:  describe result for acl check
2025-10-02T09:31:55.882681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:55.882685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:55.882686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:55.882689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554788684103787:10178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:55.883059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554788684103787:10178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:55.883300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:55.883397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:55.883403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:55.883409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:55.883432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:55.883454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554788608565519:8421]
2025-10-02T09:31:55.883794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:55.883962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:55.883985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:55.884168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:55.884197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.884201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.884202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.884202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.884203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.884203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.884204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.884204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.884205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.884205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.884206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.884207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.884209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.884215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.884217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.884219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.884221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.884223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.884225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.884227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.884230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.884232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.884233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.884235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.884239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.884243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:55.884246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.884249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:55.884251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.884254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:55.884256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.884259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:55.884261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.884263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:55.884265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.884268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:55.884271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.884274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:55.884276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.884279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:55.884281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.884283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:55.884285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.884288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.884290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.884293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.884295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.884297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.884313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:55.884439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554788684103787:10178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:55.889258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554788684103787:10178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:55.889267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554788684103787:10178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:55.889269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554788684103787:10178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:55.889273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:55.891992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:55.893393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:55.893403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:55.893405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:55.893407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:55.893410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1320 [2:7556554788608565519:8421]
2025-10-02T09:31:55.893418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:55.893427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:55.893432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.893434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.893435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.893443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:55.893446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:55.893456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:55.893491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.893495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.893496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.893498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:55.893500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:55.893601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1320
2025-10-02T09:31:55.893608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1320
2025-10-02T09:31:55.893616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:55.893621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.893628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:55.893633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:55.893645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:55.893660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103673:2446], now have 1 active actors on pipe
2025-10-02T09:31:55.893665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103826:10178], now have 1 active actors on pipe
2025-10-02T09:31:55.893676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.893681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.893691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.893696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.893697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.893705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:55.893716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:55.893718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:55.893720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:55.893722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:55.893727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:55.893729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:55.893741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:55.893749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:55.893756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:55.893758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:55.893764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:55.893776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:55.893801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.893811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:55.893818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:55.893822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.893928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:55.893933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:55.893942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:55.893996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1321 partition: 0 MaxSeqNo: 36 sessionId: src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0
2025-10-02T09:31:55.894223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b2ae138-2e29adec-b7253d2-bfa70f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:55.896847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Write session: try to update token
2025-10-02T09:31:55.896858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:55.903404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:55.903419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:55.903421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:55.903422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:55.903428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.903431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.903433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554788608565514:8421]
2025-10-02T09:31:55.903454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:55.903457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:55.903458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:55.903470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:55.903474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:55.903480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:55.903564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:55.909532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId: src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:55.911552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:55.974728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554788684103833:10078]
2025-10-02T09:31:55.974968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1320, pipe: [1:7556554788684103833:10078]
2025-10-02T09:31:56.017346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.017617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.017626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.017639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554788684103833:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.017767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:56.017815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:56.017826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:56.017871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1321 reason: error at write: Disconnected sessionId: src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0
2025-10-02T09:31:56.017938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554788684103833:10078]
2025-10-02T09:31:56.017970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.018009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1321 sessionId: src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0 is DEAD
2025-10-02T09:31:56.018164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:56.018175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Write session will restart in 0.008310s
2025-10-02T09:31:56.018200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Write session: Do CDS request
2025-10-02T09:31:56.018205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.025447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.026743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.026869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.026876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.026882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.026912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.026934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903532982:8424]
2025-10-02T09:31:56.027143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.027260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.027269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1322
2025-10-02T09:31:56.027283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.027345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.027367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.027376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.027379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.027452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.027474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.027611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1322 sessionId:  describe result for acl check
2025-10-02T09:31:56.027632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.027633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.027634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.027638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979071248:10182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.027652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.027679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.027683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.027684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.027684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.027685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.027685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.027686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.027686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.027687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.027688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.027688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.027689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.027692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.027698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.027700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.027702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.027704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.027706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.027710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.027713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.027714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.027717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.027719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.027721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.027725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.027729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.027732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.027735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.027737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.027740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.027742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.027745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.027750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.027752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.027754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.027757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.027759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.027763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.027768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.027771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.027774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.027776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.027778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.027781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.027783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.027786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.027788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.027790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.027809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.027938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979071248:10182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.029364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979071248:10182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.034063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979071248:10182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.034074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979071248:10182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.034076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979071248:10182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.034081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.035266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.036752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.036765Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.036766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.036769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.036772Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1321 [2:7556554792903532982:8424]
2025-10-02T09:31:56.036779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.036788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.036790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.036796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.036797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.036823Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.036829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.036833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.036864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.036869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.036870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.036872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.036873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.036914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.036919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.036926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.036934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.036942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.036956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071285:10182], now have 1 active actors on pipe
2025-10-02T09:31:56.036961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071131:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.036965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.036966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.036967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.036974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.036984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.036988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.036990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.036991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.036994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.036996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.037013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.037018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.037020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.036998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1321
2025-10-02T09:31:56.037003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1321
2025-10-02T09:31:56.037034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.037039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.037057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|982b966c-77482abd-3f47e8d5-6bd07441_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.037064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.037066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.037067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.037072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.037079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.037092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.037189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.037194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.037203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.037275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1322 partition: 0 MaxSeqNo: 36 sessionId: src_id|982b966c-77482abd-3f47e8d5-6bd07441_0
2025-10-02T09:31:56.037517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68571628-abdccde9-efaeb5f7-48fd72a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|982b966c-77482abd-3f47e8d5-6bd07441_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.040160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Write session: try to update token
2025-10-02T09:31:56.040173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.046726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.046740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.046741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.046743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.046748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.046750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.046752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903532968:8424]
2025-10-02T09:31:56.046781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.046785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.046784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.046788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.046789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.046790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.046943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.053038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId: src_id|982b966c-77482abd-3f47e8d5-6bd07441_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.055193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.118038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979071314:10078]
2025-10-02T09:31:56.118214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1321, pipe: [1:7556554792979071314:10078]
2025-10-02T09:31:56.160980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.161270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.161280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.161293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071314:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.161434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:56.161446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979071314:10078]
2025-10-02T09:31:56.161462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.161469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:56.161521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|982b966c-77482abd-3f47e8d5-6bd07441_0
2025-10-02T09:31:56.161654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1322 sessionId: src_id|982b966c-77482abd-3f47e8d5-6bd07441_0 is DEAD
2025-10-02T09:31:56.161824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:56.161834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Write session will restart in 0.006156s
2025-10-02T09:31:56.161854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Write session: Do CDS request
2025-10-02T09:31:56.161860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.168427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.169162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.169217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.169226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1323
2025-10-02T09:31:56.169315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.169334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.169341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.169343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.169617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1323 sessionId:  describe result for acl check
2025-10-02T09:31:56.169644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.169650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.169652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.169656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979071439:10193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.169856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.169991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.169999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.170019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.170064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.170100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903533160:8438]
2025-10-02T09:31:56.170114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979071439:10193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.170513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.170674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.170699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.170924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.170958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.170962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.170963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.170963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.170964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.170964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.170965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.170965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.170966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.170966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.170967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.170967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.170970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.170975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.170977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.170979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.170981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.170983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.170985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.170987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.170989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.170993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.170996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.170999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.171004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.171011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.171015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.171019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.171022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.171026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.171029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.171034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.171038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.171042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.171050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.171054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.171061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.171064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.171070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.171072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.171074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.171077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.171079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.171081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.171083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.171087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.171091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.171093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.171110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.171733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979071439:10193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.176858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979071439:10193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.176868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979071439:10193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.176870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979071439:10193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.176874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.178519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.180000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.180011Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.180012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.180014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.180017Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1322 [2:7556554792903533160:8438]
2025-10-02T09:31:56.180025Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.180035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.180036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.180038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.180039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.180048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.180055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.180060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.180088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.180093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.180094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.180096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.180098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.180141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.180146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.180153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.180158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.180166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.180183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071315:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.180190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071478:10193], now have 1 active actors on pipe
2025-10-02T09:31:56.180195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.180199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.180202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.180199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1322
2025-10-02T09:31:56.180212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.180223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.180226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.180230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.180231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.180238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.180226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1322
2025-10-02T09:31:56.180240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.180270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.180278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.180284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.180292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.180299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.180309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.180316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.180319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.180320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.180326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.180333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.180345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.180444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.180449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.180456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.180505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1323 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0
2025-10-02T09:31:56.180740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|982b966c-77482abd-3f47e8d5-6bd07441_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.183391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Write session: try to update token
2025-10-02T09:31:56.183405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.189670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.189683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.189684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.189685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.189691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.189694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.189696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903533155:8438]
2025-10-02T09:31:56.189719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.189721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.189721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.189723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.189724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.189726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.189828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.195897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId: src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.197949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.261413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979071488:10078]
2025-10-02T09:31:56.261593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1322, pipe: [1:7556554792979071488:10078]
2025-10-02T09:31:56.302713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.303012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.303021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.303032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071488:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.303147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:56.303191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979071488:10078]
2025-10-02T09:31:56.303213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:56.303222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.303259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1323 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0
2025-10-02T09:31:56.303386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1323 sessionId: src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0 is DEAD
2025-10-02T09:31:56.303539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:56.303548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Write session will restart in 0.009181s
2025-10-02T09:31:56.303567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Write session: Do CDS request
2025-10-02T09:31:56.303572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.310318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.311609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.311734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.311741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.311746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.311776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.311804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903533316:8441]
2025-10-02T09:31:56.312140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.312302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.312324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.312499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.312527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.312531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.312531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.312532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.312533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.312533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.312534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.312534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.312535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.312535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.312536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.312536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.312539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.312546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.312548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.312550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.312552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.312554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.312556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.312558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.312560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.312562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.312564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.312565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.312569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.312573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.312576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.312579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.312581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.312583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.312586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.312588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.312590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.312593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.312595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.312598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.312600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.312603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.312608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.312611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.312613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.312616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.312621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.312623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.312626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.312628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.312633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.312636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.312653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.314242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.314269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.314280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1324
2025-10-02T09:31:56.314374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.314391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.314395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.314402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.314646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1324 sessionId:  describe result for acl check
2025-10-02T09:31:56.314671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.314677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.314679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.314682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979071612:10198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.315033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979071612:10198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.316536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979071612:10198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.319509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979071612:10198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.319524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979071612:10198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.319527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979071612:10198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.319534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.320092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.321637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.321648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.321649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.321651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.321655Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1323 [2:7556554792903533316:8441]
2025-10-02T09:31:56.321662Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.321672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.321675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.321676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.321677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.321687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.321693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.321697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.321730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.321734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.321735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.321737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.321738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.321774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.321778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.321784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.321790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.321797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.321812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071489:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.321817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071646:10198], now have 1 active actors on pipe
2025-10-02T09:31:56.321820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.321822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.321823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.321833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.321843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.321849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.321849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.321851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.321842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1323
2025-10-02T09:31:56.321859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.321865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.321889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.321884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1323
2025-10-02T09:31:56.321895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.321903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.321916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.321922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.321939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.321947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.321949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.321953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.321960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.321968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.321978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.322066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.322071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.322078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.322128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1324 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0
2025-10-02T09:31:56.322358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cdc005-7bccbfdc-7381b76c-45111662_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.325031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Write session: try to update token
2025-10-02T09:31:56.325044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.331289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.331303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.331304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.331305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.331311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.331313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.331315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903533311:8441]
2025-10-02T09:31:56.331337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.331340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.331344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.331347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.331352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.331357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.331467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.337905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId: src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.339852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.403240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979071654:10078]
2025-10-02T09:31:56.403403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1323, pipe: [1:7556554792979071654:10078]
2025-10-02T09:31:56.444169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.444407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.444415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.444428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071654:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.444579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:56.444612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:56.444621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:56.444650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.444666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1324 reason: error at write: Disconnected sessionId: src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0
2025-10-02T09:31:56.444692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979071654:10078]
2025-10-02T09:31:56.444787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1324 sessionId: src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0 is DEAD
2025-10-02T09:31:56.444942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:56.444950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Write session will restart in 0.006291s
2025-10-02T09:31:56.444970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Write session: Do CDS request
2025-10-02T09:31:56.444975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.452174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.452236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.452245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1325
2025-10-02T09:31:56.452331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.452351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.452359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.452362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.452345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.452616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1325 sessionId:  describe result for acl check
2025-10-02T09:31:56.452641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.452644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.452646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.452650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979071773:10202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.453053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979071773:10202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.453776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.453871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.453878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.453884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.453910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.453933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903533472:8443]
2025-10-02T09:31:56.454275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.454318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979071773:10202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.454431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.454454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.454629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.454659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.454662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.454663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.454664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.454664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.454665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.454665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.454666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.454667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.454667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.454667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.454668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.454671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.454677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.454679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.454681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.454683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.454685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.454687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.454689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.454691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.454693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.454695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.454697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.454701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.454704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.454708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.454710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.454714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.454716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.454718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.454721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.454723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.454726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.454728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.454730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.454733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.454735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.454737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.454740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.454742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.454745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.454747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.454749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.454752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.454754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.454757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.454759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.454777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.458630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979071773:10202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.458640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979071773:10202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.458642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979071773:10202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.458646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.462260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.463650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.463662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.463664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.463666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.463670Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1324 [2:7556554792903533472:8443]
2025-10-02T09:31:56.463677Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.463687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.463692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.463694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.463695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.463704Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.463707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.463711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.463743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.463749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.463750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.463752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.463754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.463794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.463799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.463806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.463811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.463821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.463836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071655:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.463841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071812:10202], now have 1 active actors on pipe
2025-10-02T09:31:56.463845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.463846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.463847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.463854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.463861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.463868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.463868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.463870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.463874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.463876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.463882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1324
2025-10-02T09:31:56.463892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1324
2025-10-02T09:31:56.463887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.463888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.463899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.463910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.463912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.463926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38962ad5-8ff55356-beeda79d-11be6a25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.463934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.463936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.463938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.463943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.463948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.463958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.464041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.464045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.464053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.464116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1325 partition: 0 MaxSeqNo: 36 sessionId: src_id|38962ad5-8ff55356-beeda79d-11be6a25_0
2025-10-02T09:31:56.464348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e106da3-9afe31f2-1a8e8085-7155151e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38962ad5-8ff55356-beeda79d-11be6a25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.467058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Write session: try to update token
2025-10-02T09:31:56.467071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.472925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:56.472936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.472941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.472968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:56.472982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:56.473101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:56.473216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:56.473327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:56.473440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:56.473653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:56.473678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:56.479351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId: src_id|38962ad5-8ff55356-beeda79d-11be6a25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.481898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.482322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.482340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.482352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.482354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.482355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.482356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.482361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.482364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.482366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903533467:8443]
2025-10-02T09:31:56.482389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.482391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.482395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.482397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.482399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.482402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.482514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.545050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979071823:10078]
2025-10-02T09:31:56.545218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1324, pipe: [1:7556554792979071823:10078]
2025-10-02T09:31:56.596083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.596354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:56.596379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071823:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.596483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:56.596500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.596533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979071823:10078]
2025-10-02T09:31:56.596553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:56.596559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:56.596608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1325 reason: error at write: Disconnected sessionId: src_id|38962ad5-8ff55356-beeda79d-11be6a25_0
2025-10-02T09:31:56.596713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1325 sessionId: src_id|38962ad5-8ff55356-beeda79d-11be6a25_0 is DEAD
2025-10-02T09:31:56.596867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:56.596877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Write session will restart in 0.006269s
2025-10-02T09:31:56.596901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Write session: Do CDS request
2025-10-02T09:31:56.596907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.603905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.604193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.604267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.604276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1326
2025-10-02T09:31:56.604361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.604379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.604385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.604387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.604648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1326 sessionId:  describe result for acl check
2025-10-02T09:31:56.604668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.604672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.604673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.604676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979071943:10208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.605029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979071943:10208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.605195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.605287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.605293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.605299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.605323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.605346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903533629:8445]
2025-10-02T09:31:56.605692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.605866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.605887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.606070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.606099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.606103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.606103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.606104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.606105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.606105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.606106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.606107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.606107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.606108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.606109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.606109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.606112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.606118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.606120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.606123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.606124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.606127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.606129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.606131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.606133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.606135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.606137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.606139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.606143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.606146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.606150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.606153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.606156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.606158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.606160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.606163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.606165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.606168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.606173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.606176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.606178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.606182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.606184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.606187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.606189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.606191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.606197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.606199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.606201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.606204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.606206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.606210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.606226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.606290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979071943:10208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.611032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979071943:10208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.611041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979071943:10208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.611043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979071943:10208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.611047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.613695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.615064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.615075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.615076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.615079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.615083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1325 [2:7556554792903533629:8445]
2025-10-02T09:31:56.615093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.615107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.615112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.615113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.615114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.615124Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.615130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.615135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.615167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.615172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.615173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.615174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.615176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.615214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.615219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.615226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.615231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.615243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.615258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071982:10208], now have 1 active actors on pipe
2025-10-02T09:31:56.615263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071824:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.615266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.615268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.615269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.615276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.615286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.615290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.615292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.615294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.615297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.615298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.615299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1325
2025-10-02T09:31:56.615304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1325
2025-10-02T09:31:56.615314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.615319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.615321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.615329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.615334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.615361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.615367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.615370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.615371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.615377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.615385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.615397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.615482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.615487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.615495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.615547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1326 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0
2025-10-02T09:31:56.615807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38962ad5-8ff55356-beeda79d-11be6a25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.618403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Write session: try to update token
2025-10-02T09:31:56.618415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.624589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.624602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.624604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.624605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.624610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.624612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.624615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903533624:8445]
2025-10-02T09:31:56.624635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.624641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.624642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.624645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.624648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.624650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.624748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.630706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId: src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.632662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.696618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979071990:10078]
2025-10-02T09:31:56.696843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1325, pipe: [1:7556554792979071990:10078]
2025-10-02T09:31:56.739906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.740128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.740137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.740150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071990:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.740272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:56.740323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:56.740332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:56.740341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979071990:10078]
2025-10-02T09:31:56.740355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.740376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1326 reason: error at write: Disconnected sessionId: src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0
2025-10-02T09:31:56.740513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1326 sessionId: src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0 is DEAD
2025-10-02T09:31:56.740652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:56.740662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Write session will restart in 0.009528s
2025-10-02T09:31:56.740686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Write session: Do CDS request
2025-10-02T09:31:56.740691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.748171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.749511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.749605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.749611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.749617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.749644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.749668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903533799:8448]
2025-10-02T09:31:56.750009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.750165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.750187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.750369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.750395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.750398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.750399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.750399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.750400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.750401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.750401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.750402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.750402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.750403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.750403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.750404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.750406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.750413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.750415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.750417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.750419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.750421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.750423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.750425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.750427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.750429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.750431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.750433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.750437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.750440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.750443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.750447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.750450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.750452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.750454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.750457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.750459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.750462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.750464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.750467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.750469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.750472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.750474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.750476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.750478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.750481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.750484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.750487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.750492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.750494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.750496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.750499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.750515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.751199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.751249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.751257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1327
2025-10-02T09:31:56.751328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.751347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.751354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.751357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.751687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1327 sessionId:  describe result for acl check
2025-10-02T09:31:56.751712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.751717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.751718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.751721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979072115:10212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.752060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979072115:10212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.753237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979072115:10212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.756755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979072115:10212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.756764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979072115:10212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.756765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979072115:10212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.756769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.757981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.759335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.759346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.759348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.759350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.759353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1326 [2:7556554792903533799:8448]
2025-10-02T09:31:56.759360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.759370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.759372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.759373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.759374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.759383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.759386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.759390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.759422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.759427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.759428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.759430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.759432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.759467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.759472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.759478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.759484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.759495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.759510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979071991:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.759515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979072150:10212], now have 1 active actors on pipe
2025-10-02T09:31:56.759520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.759521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.759522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.759531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.759542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1326
2025-10-02T09:31:56.759547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1326
2025-10-02T09:31:56.759541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.759543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.759545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.759547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.759551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.759553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.759566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.759568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.759577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.759578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.759582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.759609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.759616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.759618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.759619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.759624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.759633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.759645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.759849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.759854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.759863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.759930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1327 partition: 0 MaxSeqNo: 36 sessionId: src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0
2025-10-02T09:31:56.760150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d8c5165-137b071c-81cbcabd-82c7ce1c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.762760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Write session: try to update token
2025-10-02T09:31:56.762773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.768794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.768819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.768820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.768821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.768826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.768829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.768832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903533794:8448]
2025-10-02T09:31:56.768851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.768855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.768856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.768856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.768859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.768861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.768959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.775351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId: src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.777355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.840477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979072176:10078]
2025-10-02T09:31:56.840659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1326, pipe: [1:7556554792979072176:10078]
2025-10-02T09:31:56.881272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:56.881474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.881482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.881495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979072176:10078], now have 1 active actors on pipe
2025-10-02T09:31:56.881629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:56.881638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:56.881645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:56.881659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:56.881679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1327 reason: error at write: Disconnected sessionId: src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0
2025-10-02T09:31:56.881695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979072176:10078]
2025-10-02T09:31:56.881822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1327 sessionId: src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0 is DEAD
2025-10-02T09:31:56.881987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:56.881997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Write session will restart in 0.009439s
2025-10-02T09:31:56.882016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Write session: Do CDS request
2025-10-02T09:31:56.882022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:56.889050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:56.890362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:56.890461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:56.890467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:56.890472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:56.890497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:56.890520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554792903533958:8450]
2025-10-02T09:31:56.890872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:56.891035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:56.891057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:56.891229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:56.891257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.891261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.891262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.891263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.891263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.891264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.891264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.891265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.891265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.891266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.891266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.891267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.891269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.891276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.891278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.891280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.891282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.891284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.891286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.891288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.891290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.891292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.891294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.891296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.891300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.891304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:56.891307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.891310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:56.891312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.891314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:56.891316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.891319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:56.891321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.891324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:56.891326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.891328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:56.891331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.891337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:56.891339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.891342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:56.891347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.891349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:56.891351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.891354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.891356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.891362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.891364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.891367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.891385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:56.892246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.892309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:56.892317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1328
2025-10-02T09:31:56.892409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:56.892426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:56.892433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:56.892435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:56.892698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1328 sessionId:  describe result for acl check
2025-10-02T09:31:56.892722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:56.892727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:56.892728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:56.892731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554792979072306:10218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:56.893074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554792979072306:10218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:56.894593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554792979072306:10218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:56.898216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554792979072306:10218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:56.898226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554792979072306:10218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:56.898228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554792979072306:10218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:56.898231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:56.898721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:56.900049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:56.900060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:56.900061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:56.900063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:56.900068Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1327 [2:7556554792903533958:8450]
2025-10-02T09:31:56.900074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:56.900084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:56.900085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.900087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.900088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.900096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:56.900103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:56.900108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:56.900137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.900141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.900142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.900144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:56.900145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:56.900180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:56.900184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.900190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:56.900195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:56.900206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:56.900219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979072341:10218], now have 1 active actors on pipe
2025-10-02T09:31:56.900225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979072181:2446], now have 1 active actors on pipe
2025-10-02T09:31:56.900228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.900230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.900231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.900238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:56.900245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:56.900246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:56.900248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:56.900249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:56.900256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:56.900257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:56.900255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1327
2025-10-02T09:31:56.900258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1327
2025-10-02T09:31:56.900271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.900275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:56.900277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:56.900287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.900291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.900315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|819529c9-57ed9a90-1e738584-c018a4cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:56.900322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:56.900324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:56.900325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:56.900330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:56.900338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:56.900349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.900448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:56.900452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:56.900460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:56.900519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1328 partition: 0 MaxSeqNo: 36 sessionId: src_id|819529c9-57ed9a90-1e738584-c018a4cc_0
2025-10-02T09:31:56.900751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75dce13-7fdab361-fd2cd3cd-1224b8a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|819529c9-57ed9a90-1e738584-c018a4cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:56.903362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Write session: try to update token
2025-10-02T09:31:56.903376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:56.909535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:56.909548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:56.909549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:56.909550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:56.909555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.909558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.909560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554792903533953:8450]
2025-10-02T09:31:56.909580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:56.909585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:56.909587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:56.909588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:56.909592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:56.909594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:56.909694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:56.916505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId: src_id|819529c9-57ed9a90-1e738584-c018a4cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:56.918574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:56.981810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554792979072348:10078]
2025-10-02T09:31:56.982005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1327, pipe: [1:7556554792979072348:10078]
2025-10-02T09:31:57.022965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.023341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.023351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.023363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554792979072348:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.023506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.023534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:57.023546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:57.023554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.023586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554792979072348:10078]
2025-10-02T09:31:57.023592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1328 reason: error at write: Disconnected sessionId: src_id|819529c9-57ed9a90-1e738584-c018a4cc_0
2025-10-02T09:31:57.023724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1328 sessionId: src_id|819529c9-57ed9a90-1e738584-c018a4cc_0 is DEAD
2025-10-02T09:31:57.023888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:57.023900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Write session will restart in 0.008374s
2025-10-02T09:31:57.023921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Write session: Do CDS request
2025-10-02T09:31:57.023927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.031213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.032574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.032672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.032678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.032684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.032708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.032730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198501414:8453]
2025-10-02T09:31:57.033091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.033160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.033253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.033233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.033244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1329
2025-10-02T09:31:57.033275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.033318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.033337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.033343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.033345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.033451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.033479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.033483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.033484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.033485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.033485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.033486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.033486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.033487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.033487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.033488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.033488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.033489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.033491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.033498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.033500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.033502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.033504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.033506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.033508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.033510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.033511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.033513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.033515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.033517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.033521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.033524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.033528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.033531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.033533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.033536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.033538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.033541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.033543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.033546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.033548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.033551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.033556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.033559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.033562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.033565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.033570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.033573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.033575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.033578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.033583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.033585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.033587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.033590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.033610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.033641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1329 sessionId:  describe result for acl check
2025-10-02T09:31:57.033659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.033664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.033664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.033667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274039770:10222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.034012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274039770:10222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.035368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274039770:10222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.038810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274039770:10222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.038819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274039770:10222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.038821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274039770:10222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.038824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.041025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.042361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.042372Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.042373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.042376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.042379Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1328 [2:7556554797198501414:8453]
2025-10-02T09:31:57.042386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.042395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.042396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.042398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.042399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.042408Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.042411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.042418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.042452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.042456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.042458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.042459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.042461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.042513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.042518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.042524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.042530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.042541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.042556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274039646:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.042561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274039807:10222], now have 1 active actors on pipe
2025-10-02T09:31:57.042565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.042566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.042568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.042573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.042563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1328
2025-10-02T09:31:57.042581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.042576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1328
2025-10-02T09:31:57.042589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.042591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.042593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.042596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.042598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.042617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.042625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.042632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.042637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.042648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.042653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.042657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.042659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.042659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.042664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.042670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.042686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.042782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.042787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.042794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.042843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1329 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0
2025-10-02T09:31:57.043081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|819529c9-57ed9a90-1e738584-c018a4cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.045732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Write session: try to update token
2025-10-02T09:31:57.045747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.052062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.052076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.052077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.052078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.052083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.052086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.052088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198501409:8453]
2025-10-02T09:31:57.052110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.052110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.052113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.052113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.052114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.052115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.052219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.058819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId: src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.060857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.123634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274039836:10078]
2025-10-02T09:31:57.123838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1328, pipe: [1:7556554797274039836:10078]
2025-10-02T09:31:57.167032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.167257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.167266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.167278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274039836:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.167435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.167482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.167490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:57.167523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274039836:10078]
2025-10-02T09:31:57.167555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1329 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0
2025-10-02T09:31:57.167709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1329 sessionId: src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0 is DEAD
2025-10-02T09:31:57.167860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:57.167871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Write session will restart in 0.008504s
2025-10-02T09:31:57.167896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Write session: Do CDS request
2025-10-02T09:31:57.167902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.174775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.176091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.176194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.176201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.176207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.176231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.176256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198501611:8467]
2025-10-02T09:31:57.176597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.176761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.176782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.176969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.176997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.177001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.177002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.177002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.177003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.177003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.177004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.177004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.177005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.177005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.177006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.177007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.177009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.177016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.177018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.177020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.177022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.177024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.177025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.177027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.177029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.177031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.177033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.177035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.177039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.177043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.177046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.177049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.177052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.177054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.177056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.177059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.177061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.177063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.177065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.177068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.177070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.177072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.177074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.177077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.177079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.177081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.177083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.177085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.177088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.177090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.177096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.177099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.177114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.177232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.177282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.177294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1330
2025-10-02T09:31:57.177377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.177395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.177402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.177404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.177660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1330 sessionId:  describe result for acl check
2025-10-02T09:31:57.177683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.177687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.177689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.177692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274039964:10233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.178042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274039964:10233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.179353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274039964:10233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.183272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274039964:10233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.183281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274039964:10233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.183283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274039964:10233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.183287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.184441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.185793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.185805Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.185806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.185808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.185811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1329 [2:7556554797198501611:8467]
2025-10-02T09:31:57.185819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.185828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.185833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.185835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.185836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.185846Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.185850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.185854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.185887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.185892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.185893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.185895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.185896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.185940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.185945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.185951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.185956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.185967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.185982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040000:10233], now have 1 active actors on pipe
2025-10-02T09:31:57.185987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274039837:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.185990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.185991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.185993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.186000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.186008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.186013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.186015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.186016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.186016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.186018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.186003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1329
2025-10-02T09:31:57.186005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1329
2025-10-02T09:31:57.186030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.186035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.186037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.186044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.186049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.186075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.186082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.186084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.186085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.186090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.186098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.186110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.186211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.186215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.186223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.186271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1330 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0
2025-10-02T09:31:57.186493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee94f4c-a7cdb47c-11591641-ef867424_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.189122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Write session: try to update token
2025-10-02T09:31:57.189135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.195462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.195477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.195478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.195479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.195484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.195486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.195489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198501606:8467]
2025-10-02T09:31:57.195511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.195514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.195516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.195518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.195521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.195525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.195617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.202483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId: src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.204533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.267490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274040009:10078]
2025-10-02T09:31:57.267680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1329, pipe: [1:7556554797274040009:10078]
2025-10-02T09:31:57.310260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.310479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.310488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.310500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040009:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.310644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.310653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.310658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274040009:10078]
2025-10-02T09:31:57.310679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:57.310681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:57.310728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1330 reason: error at write: Disconnected sessionId: src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0
2025-10-02T09:31:57.310875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1330 sessionId: src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0 is DEAD
2025-10-02T09:31:57.311019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:57.311027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Write session will restart in 0.005723s
2025-10-02T09:31:57.311047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Write session: Do CDS request
2025-10-02T09:31:57.311052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.318160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.318170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.318271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.318283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1331
2025-10-02T09:31:57.318375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.318399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.318406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.318409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.318698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1331 sessionId:  describe result for acl check
2025-10-02T09:31:57.318723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.318727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.318728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.318731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274040134:10238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.319082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274040134:10238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.319493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.319582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.319588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.319594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.319618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.319638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198501775:8470]
2025-10-02T09:31:57.319976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.320137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.320159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.320332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.320360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.320364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.320365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.320365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.320366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.320366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.320367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.320367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.320368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.320369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.320369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.320370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.320372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.320378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.320380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.320382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.320384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.320386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.320388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.320390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.320392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.320394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.320396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.320398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.320401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.320405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.320408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.320411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.320413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.320415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.320417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.320420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.320422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.320424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.320427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.320429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.320431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.320434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.320436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.320439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.320442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.320445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.320447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.320449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.320451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.320454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.320456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.320458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.320476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.320618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274040134:10238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.325272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274040134:10238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.325281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274040134:10238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.325283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274040134:10238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.325298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.327976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.329311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.329323Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.329324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.329326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.329330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1330 [2:7556554797198501775:8470]
2025-10-02T09:31:57.329338Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.329348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.329350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.329351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.329352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.329361Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.329364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.329368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.329399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.329404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.329405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.329408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.329410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.329447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.329452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.329458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.329463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.329471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.329487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040173:10238], now have 1 active actors on pipe
2025-10-02T09:31:57.329493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040010:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.329497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.329498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.329499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.329506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.329513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.329522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.329524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.329523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.329526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.329527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.329523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1330
2025-10-02T09:31:57.329538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.329541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.329526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1330
2025-10-02T09:31:57.329551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.329570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.329575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.329591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.329599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.329601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.329602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.329607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.329613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.329621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.329720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.329724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.329732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.329788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1331 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0
2025-10-02T09:31:57.330055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e25de2f-8bc678fc-dda506c1-52042f98_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.332714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Write session: try to update token
2025-10-02T09:31:57.332727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.338977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.338990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.338992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.338993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.338997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.338999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.339001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198501770:8470]
2025-10-02T09:31:57.339022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.339025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.339026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.339032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.339036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.339039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.339127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.345411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId: src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.347398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.410860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274040181:10078]
2025-10-02T09:31:57.411058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1330, pipe: [1:7556554797274040181:10078]
2025-10-02T09:31:57.455621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.455838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.455847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.455860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040181:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.456008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.456048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:57.456058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:57.456077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274040181:10078]
2025-10-02T09:31:57.456091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.456107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1331 reason: error at write: Disconnected sessionId: src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0
2025-10-02T09:31:57.456253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1331 sessionId: src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0 is DEAD
2025-10-02T09:31:57.456407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:57.456417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Write session will restart in 0.007619s
2025-10-02T09:31:57.456440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Write session: Do CDS request
2025-10-02T09:31:57.456446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.463712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.465063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.465160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.465167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.465172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.465198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.465209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.465223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198501938:8472]
2025-10-02T09:31:57.465235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.465245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1332
2025-10-02T09:31:57.465345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.465363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.465369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.465371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.465568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.465635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1332 sessionId:  describe result for acl check
2025-10-02T09:31:57.465659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.465663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.465665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.465668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274040308:5264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.465739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.465760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.465933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.465959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.465963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.465963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.465964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.465965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.465965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.465966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.465966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.465967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.465967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.465968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.465968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.465971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.465977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.465979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.465981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.465983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.465985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.465987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.465989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.465991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.465993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.465995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.465997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.466000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.466004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.466003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274040308:5264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.466007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.466010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.466012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.466015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.466017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.466020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.466022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.466024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.466027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.466030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.466032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.466034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.466038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.466041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.466043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.466046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.466048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.466051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.466053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.466056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.466059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.466062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.466079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.467495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274040308:5264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.471296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274040308:5264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.471304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274040308:5264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.471306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274040308:5264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.471309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.473469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.474921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.474931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.474932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.474934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.474938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1331 [2:7556554797198501938:8472]
2025-10-02T09:31:57.474944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.474953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.474954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.474956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.474957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.474966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.474970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.474975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.475007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.475012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.475013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.475015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.475016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.475050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.475054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.475061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.475066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.475077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.475091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040346:5264], now have 1 active actors on pipe
2025-10-02T09:31:57.475095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040182:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.475098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.475099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.475100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.475109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.475116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.475124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.475125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.475119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1331
2025-10-02T09:31:57.475132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.475131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1331
2025-10-02T09:31:57.475135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.475137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.475138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.475139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.475141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.475153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.475157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.475175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.475182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.475185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.475186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.475191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.475196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.475209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.475313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.475317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.475325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.475387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1332 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0
2025-10-02T09:31:57.475588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5b107-5e3b1378-4adfea1c-8a429dad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.477826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Write session: try to update token
2025-10-02T09:31:57.477837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.484377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.484394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.484396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.484397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.484402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.484405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.484407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198501933:8472]
2025-10-02T09:31:57.484430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.484432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.484435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.484437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.484438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.484439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.484565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.488075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId: src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.489969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.556268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274040354:10078]
2025-10-02T09:31:57.556432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1331, pipe: [1:7556554797274040354:10078]
2025-10-02T09:31:57.598266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.598541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.598550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.598575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040354:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.598710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.598766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274040354:10078]
2025-10-02T09:31:57.598777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:57.598787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.598838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0
2025-10-02T09:31:57.598970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1332 sessionId: src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0 is DEAD
2025-10-02T09:31:57.599144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:57.599153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Write session will restart in 0.007427s
2025-10-02T09:31:57.599173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Write session: Do CDS request
2025-10-02T09:31:57.599178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.606446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.607132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.607227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.607236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1333
2025-10-02T09:31:57.607316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.607335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.607341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.607343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.607662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1333 sessionId:  describe result for acl check
2025-10-02T09:31:57.607683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.607687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.607688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.607691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274040481:5257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.607824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.607923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.607930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.607937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.607967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.607992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198502102:8474]
2025-10-02T09:31:57.608064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274040481:5257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.608332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.608521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.608548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.608747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.608777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.608781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.608782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.608783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.608783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.608784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.608784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.608785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.608785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.608786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.608786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.608787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.608789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.608795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.608797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.608810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.608812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.608814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.608816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.608818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.608820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.608822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.608824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.608826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.608831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.608835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.608838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.608841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.608843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.608845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.608847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.608850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.608852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.608855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.608857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.608860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.608862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.608865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.608867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.608869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.608872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.608875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.608877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.608880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.608882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.608885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.608887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.608889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.608906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.609368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274040481:5257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.613898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274040481:5257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.613908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274040481:5257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.613910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274040481:5257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.613914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.616651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.618149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.618162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.618164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.618167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.618171Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1332 [2:7556554797198502102:8474]
2025-10-02T09:31:57.618181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.618192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.618194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.618195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.618196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.618205Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.618215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.618220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.618250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.618255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.618256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.618258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.618259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.618295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.618300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.618307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.618312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.618321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.618335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040520:5257], now have 1 active actors on pipe
2025-10-02T09:31:57.618341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040355:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.618344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.618345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.618346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.618354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.618362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.618371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.618372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.618372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.618374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.618376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.618366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1332
2025-10-02T09:31:57.618372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1332
2025-10-02T09:31:57.618387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.618390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.618392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.618399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.618401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.618428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.618435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.618437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.618438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.618443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.618448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.618457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.618567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.618575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.618583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.618645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1333 partition: 0 MaxSeqNo: 36 sessionId: src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0
2025-10-02T09:31:57.618905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e39aece-bfe8e747-5363a21d-eddb191e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.621533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Write session: try to update token
2025-10-02T09:31:57.621546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.628218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.628239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.628242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.628244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.628254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.628259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.628265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198502097:8474]
2025-10-02T09:31:57.628307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.628315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.628316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.628319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.628321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.628323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.628508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.634160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId: src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.636140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.699120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274040528:10078]
2025-10-02T09:31:57.699317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1332, pipe: [1:7556554797274040528:10078]
2025-10-02T09:31:57.744431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.744657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.744667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.744680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040528:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.744797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.744824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:57.744838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:57.744844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274040528:10078]
2025-10-02T09:31:57.744860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.744889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1333 reason: error at write: Disconnected sessionId: src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0
2025-10-02T09:31:57.745049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1333 sessionId: src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0 is DEAD
2025-10-02T09:31:57.745206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:57.745216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Write session will restart in 0.008045s
2025-10-02T09:31:57.745240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Write session: Do CDS request
2025-10-02T09:31:57.745245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.752544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.753980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.754127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.754134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.754140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.754168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.754190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198502279:8477]
2025-10-02T09:31:57.754196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.754252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.754260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1334
2025-10-02T09:31:57.754334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.754352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.754358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.754360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.754546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.754621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1334 sessionId:  describe result for acl check
2025-10-02T09:31:57.754639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.754644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.754645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.754647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274040658:5249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.754705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.754731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.754936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.754968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.754972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.754973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.754973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.754974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.754974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.754975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.754975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.754976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.754976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.754977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.754977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.754980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.754986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.754988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.754990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274040658:5249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.754990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.754992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.754995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.754996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.754998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.755001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.755003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.755005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.755007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.755011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.755015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.755018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.755021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.755023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.755026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.755028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.755030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.755034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.755037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.755039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.755041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.755043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.755045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.755047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.755050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.755052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.755054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.755056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.755058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.755060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.755063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.755065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.755067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.755083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.756233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274040658:5249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.760249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274040658:5249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.760260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274040658:5249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.760262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274040658:5249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.760266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.762414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.763796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.763807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.763808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.763810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.763813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1333 [2:7556554797198502279:8477]
2025-10-02T09:31:57.763820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.763830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.763832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.763833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.763834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.763842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.763849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.763853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.763883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.763888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.763889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.763891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.763893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.763926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.763931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.763937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.763942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.763953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.763967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040529:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.763972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040695:5249], now have 1 active actors on pipe
2025-10-02T09:31:57.763975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.763976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.763978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.763985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.763992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.764001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.764003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.764004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.763997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1333
2025-10-02T09:31:57.764004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.764002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1333
2025-10-02T09:31:57.764005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.764017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.764018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.764027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.764039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.764041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.764053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.764060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.764063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.764066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.764070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.764076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.764089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.764208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.764217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.764228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.764286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1334 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0
2025-10-02T09:31:57.764516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15abd41f-e99c5257-b8d935bf-6eb3fed7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.766967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Write session: try to update token
2025-10-02T09:31:57.766981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.773278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.773291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.773292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.773294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.773300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.773303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.773307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198502274:8477]
2025-10-02T09:31:57.773332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.773335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.773338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.773339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.773340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.773341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.773444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.779131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId: src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.781065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.845031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274040721:10078]
2025-10-02T09:31:57.845183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1333, pipe: [1:7556554797274040721:10078]
2025-10-02T09:31:57.884066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:57.884287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.884295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.884307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040721:10078], now have 1 active actors on pipe
2025-10-02T09:31:57.884430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:57.884426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:57.884438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274040721:10078]
2025-10-02T09:31:57.884454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:57.884457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:57.884516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1334 reason: error at write: Disconnected sessionId: src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0
2025-10-02T09:31:57.884655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1334 sessionId: src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0 is DEAD
2025-10-02T09:31:57.884825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:57.884835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Write session will restart in 0.006466s
2025-10-02T09:31:57.884855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Write session: Do CDS request
2025-10-02T09:31:57.884861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:57.892113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.892208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:57.892216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1335
2025-10-02T09:31:57.892307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:57.892328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:57.892330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:57.892332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:57.892615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:57.892669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1335 sessionId:  describe result for acl check
2025-10-02T09:31:57.892699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:57.892700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:57.892701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:57.892704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554797274040854:5247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:57.893077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554797274040854:5247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:57.893996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:57.894132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:57.894142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:57.894151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:57.894190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:57.894212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554797198502445:8479]
2025-10-02T09:31:57.894546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:57.894580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554797274040854:5247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:57.894699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:57.894722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:57.894907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:57.894936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.894940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.894940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.894941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.894941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.894942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.894942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.894943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.894943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.894944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.894945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.894945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.894948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.894953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.894955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.894958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.894959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.894961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.894963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.894965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.894967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.894969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.894971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.894973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.894977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.894981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:57.894984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.894987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:57.894989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.894992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:57.894994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.894996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:57.894999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.895001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:57.895003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.895006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:57.895008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.895010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:57.895014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.895017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:57.895019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.895021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:57.895023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.895026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.895028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.895031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.895033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.895035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.895052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:57.899775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554797274040854:5247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:57.899786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554797274040854:5247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:57.899789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554797274040854:5247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:57.899793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:57.902406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:57.903810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:57.903822Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:57.903823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:57.903825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:57.903828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1334 [2:7556554797198502445:8479]
2025-10-02T09:31:57.903835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:57.903844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:57.903849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.903851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.903852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.903864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:57.903871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:57.903877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:57.903909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.903914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.903915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.903917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:57.903918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:57.903953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:57.903958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.903965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:57.903970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:57.903981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:57.903994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040893:5247], now have 1 active actors on pipe
2025-10-02T09:31:57.903999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040726:2446], now have 1 active actors on pipe
2025-10-02T09:31:57.904003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.904008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.904009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.904016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:57.904027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:57.904029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:57.904031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:57.904032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:57.904037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:57.904039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:57.904025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1334
2025-10-02T09:31:57.904029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1334
2025-10-02T09:31:57.904052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.904055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:57.904057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:57.904066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.904071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.904096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:57.904102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:57.904139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:57.904143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:57.904149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:57.904157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:57.904172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.904261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:57.904266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:57.904273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:57.904329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1335 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0
2025-10-02T09:31:57.904538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5d0fae-e8e71024-92fc51d6-d8e923be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:57.906965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Write session: try to update token
2025-10-02T09:31:57.906978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:57.913308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:57.913323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:57.913324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:57.913325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:57.913330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.913332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.913334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554797198502440:8479]
2025-10-02T09:31:57.913350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:57.913352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:57.913354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:57.913354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:57.913358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:57.913360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:57.913481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:57.918471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId: src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:57.920401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:57.984827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554797274040900:10078]
2025-10-02T09:31:57.985011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1334, pipe: [1:7556554797274040900:10078]
2025-10-02T09:31:58.024917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.025139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.025149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.025178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554797274040900:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.025301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.025352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554797274040900:10078]
2025-10-02T09:31:58.025369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:58.025371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.025431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0
2025-10-02T09:31:58.025558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1335 sessionId: src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0 is DEAD
2025-10-02T09:31:58.025690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:58.025699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Write session will restart in 0.006449s
2025-10-02T09:31:58.025716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Write session: Do CDS request
2025-10-02T09:31:58.025721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.033120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.033188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.033200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1336
2025-10-02T09:31:58.033274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.033294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.033300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.033303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.033523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.033570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1336 sessionId:  describe result for acl check
2025-10-02T09:31:58.033591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.033596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.033597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.033601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569008326:5236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.033960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569008326:5236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.035025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.035136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.035142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.035147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.035175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.035199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493469909:8482]
2025-10-02T09:31:58.035308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569008326:5236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.035549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.035704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.035728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.035903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.035931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.035935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.035936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.035936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.035937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.035937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.035938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.035939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.035939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.035940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.035940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.035941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.035943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.035951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.035955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.035958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.035961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.035965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.035967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.035971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.035974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.035978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.035981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.035984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.035988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.035991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.035995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.035998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.036002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.036004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.036007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.036011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.036014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.036020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.036022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.036025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.036027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.036029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.036035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.036037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.036040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.036043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.036048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.036051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.036054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.036060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.036062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.036064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.036081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.039853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569008326:5236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.039861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569008326:5236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.039863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569008326:5236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.039867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.043489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.044920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.044929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.044930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.044931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.044934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1335 [2:7556554801493469909:8482]
2025-10-02T09:31:58.044940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.044949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.044950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.044951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.044952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.044961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.044964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.044968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.044997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.045002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.045003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.045004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.045006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.045041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.045045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.045051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.045060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.045071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.045085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008365:5236], now have 1 active actors on pipe
2025-10-02T09:31:58.045090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008198:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.045094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.045095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.045097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.045104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.045111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.045115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.045116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.045118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.045118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.045119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.045131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.045122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1335
2025-10-02T09:31:58.045136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.045125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1335
2025-10-02T09:31:58.045137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.045149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.045151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.045172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.045183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.045186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.045188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.045194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.045201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.045213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.045304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.045312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.045322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.045380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1336 partition: 0 MaxSeqNo: 36 sessionId: src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0
2025-10-02T09:31:58.045581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f2d694-2b203d4f-6bfa0522-a07ec23a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.047707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Write session: try to update token
2025-10-02T09:31:58.047717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.054491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.054513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.054515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.054517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.054526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.054530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.054535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493469903:8482]
2025-10-02T09:31:58.054562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.054572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.054573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.054574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.054580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.054582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.054810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.058431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId: src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.060277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.125584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569008385:10078]
2025-10-02T09:31:58.125753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1335, pipe: [1:7556554801569008385:10078]
2025-10-02T09:31:58.167469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.167668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.167677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.167702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008385:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.167819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.167886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:58.167891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569008385:10078]
2025-10-02T09:31:58.167907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.167951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1336 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0
2025-10-02T09:31:58.168094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1336 sessionId: src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0 is DEAD
2025-10-02T09:31:58.168193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:58.168203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Write session will restart in 0.009933s
2025-10-02T09:31:58.168224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Write session: Do CDS request
2025-10-02T09:31:58.168228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.175504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.176892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.176992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.176999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.177005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.177031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.177054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493470113:8496]
2025-10-02T09:31:58.177396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.177554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.177574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.177755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.177783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.177787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.177788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.177788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.177789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.177789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.177790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.177790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.177791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.177791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.177792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.177792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.177795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.177802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.177804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.177806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.177808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.177810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.177812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.177814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.177816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.177818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.177820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.177822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.177826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.177830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.177833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.177836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.177838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.177840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.177842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.177845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.177847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.177850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.177852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.177855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.177857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.177859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.177861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.177864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.177866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.177869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.177871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.177873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.177877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.177880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.177882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.177885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.177903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.179131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.179234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.179245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1337
2025-10-02T09:31:58.179322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.179340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.179346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.179349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.179575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1337 sessionId:  describe result for acl check
2025-10-02T09:31:58.179595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.179598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.179598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.179601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569008530:5224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.180000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569008530:5224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.181413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569008530:5224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.184692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569008530:5224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.184700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569008530:5224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.184702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569008530:5224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.184705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.185279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.186660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.186670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.186671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.186673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.186678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1336 [2:7556554801493470113:8496]
2025-10-02T09:31:58.186686Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.186695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.186700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.186701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.186703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.186712Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.186714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.186720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.186755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.186764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.186765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.186767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.186768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.186803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.186809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.186815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.186821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.186840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.186852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008565:5224], now have 1 active actors on pipe
2025-10-02T09:31:58.186859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008395:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.186864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.186866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.186859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1336
2025-10-02T09:31:58.186862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1336
2025-10-02T09:31:58.186868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.186874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.186883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.186886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.186889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.186890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.186894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.186896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.186923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.186930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.186939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.186945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.186956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.186970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.186976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.186979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.186980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.186985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.186994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.187009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.187101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.187105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.187113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.187168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1337 partition: 0 MaxSeqNo: 36 sessionId: src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0
2025-10-02T09:31:58.187355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d6597b-766c45ab-e77c26d7-56f4671d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.189489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Write session: try to update token
2025-10-02T09:31:58.189498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.196120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.196133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.196134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.196135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.196140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.196143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.196145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493470108:8496]
2025-10-02T09:31:58.196166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.196169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.196169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.196172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.196174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.196175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.196790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.203126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId: src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.205129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.267944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569008574:10078]
2025-10-02T09:31:58.268135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1336, pipe: [1:7556554801569008574:10078]
2025-10-02T09:31:58.309434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.309704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.309713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.309726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008574:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.309854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.309908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569008574:10078]
2025-10-02T09:31:58.309946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:58.310009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0
2025-10-02T09:31:58.310101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.310167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1337 sessionId: src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0 is DEAD
2025-10-02T09:31:58.310257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:58.310264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Write session will restart in 0.009281s
2025-10-02T09:31:58.310278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Write session: Do CDS request
2025-10-02T09:31:58.310282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.317861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.319253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.319362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.319369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.319374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.319402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.319426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493470284:8499]
2025-10-02T09:31:58.319774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.319944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.320141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.320163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.320171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.320176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.320177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.320178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.320178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.320179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.320180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.320181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.320182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.320183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.320183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.320184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.320188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.320197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.320200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.320202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.320205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.320208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.320211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.320214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.320217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.320220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.320222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.320225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.320231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.320237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.320246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.320255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.320263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.320270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.320272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.320275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.320280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.320284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.320287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.320295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.320302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.320286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.320307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.320297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1338
2025-10-02T09:31:58.320310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.320317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.320324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.320328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.320335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.320339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.320347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.320356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.320363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.320371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.320373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.320392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.320392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.320399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.320402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.320655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1338 sessionId:  describe result for acl check
2025-10-02T09:31:58.320677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.320683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.320684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.320687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569008710:5214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.321029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569008710:5214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.322523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569008710:5214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.326485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569008710:5214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.326494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569008710:5214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.326496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569008710:5214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.326499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.327726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.329213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.329225Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.329226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.329228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.329232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1337 [2:7556554801493470284:8499]
2025-10-02T09:31:58.329240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.329249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.329250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.329252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.329253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.329263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.329270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.329274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.329304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.329308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.329309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.329311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.329312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.329352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.329357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.329363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.329368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.329379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.329390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008745:5214], now have 1 active actors on pipe
2025-10-02T09:31:58.329395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008575:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.329400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.329403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.329405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.329414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.329428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.329433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.329436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.329437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.329431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1337
2025-10-02T09:31:58.329443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.329448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.329449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1337
2025-10-02T09:31:58.329473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.329480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.329489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.329499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.329505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.329517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9650304f-3db04bb2-709b0701-fdde06c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.329523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.329525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.329526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.329532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.329541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.329557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.329645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.329650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.329657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.329715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1338 partition: 0 MaxSeqNo: 36 sessionId: src_id|9650304f-3db04bb2-709b0701-fdde06c3_0
2025-10-02T09:31:58.329923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b963c5aa-44ea9942-1227c30c-dbb5fa05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9650304f-3db04bb2-709b0701-fdde06c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.332258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Write session: try to update token
2025-10-02T09:31:58.332270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.339856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.339869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.339871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.339872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.339877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.339879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.339882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493470279:8499]
2025-10-02T09:31:58.339903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.339903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.339906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.339909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.339910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.339911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.340018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.343843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId: src_id|9650304f-3db04bb2-709b0701-fdde06c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.345937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.410282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569008753:10078]
2025-10-02T09:31:58.410483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1337, pipe: [1:7556554801569008753:10078]
2025-10-02T09:31:58.451165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.451410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.451418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.451443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008753:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.451624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:58.451638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:58.451647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.451688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1338 reason: error at write: Disconnected sessionId: src_id|9650304f-3db04bb2-709b0701-fdde06c3_0
2025-10-02T09:31:58.451690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569008753:10078]
2025-10-02T09:31:58.451845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1338 sessionId: src_id|9650304f-3db04bb2-709b0701-fdde06c3_0 is DEAD
2025-10-02T09:31:58.451950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:58.451959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Write session will restart in 0.009983s
2025-10-02T09:31:58.451973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Write session: Do CDS request
2025-10-02T09:31:58.451977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.452067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.459699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.461034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.461161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.461168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.461175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.461203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.461227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493470454:8501]
2025-10-02T09:31:58.461579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.461732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.461754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.461929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.461967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.461972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.461973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.461974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.461974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.461975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.461975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.461976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.461976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.461977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.461978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.461978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.461981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.461988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.461990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.461992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.461994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.461996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.461998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.462000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.462002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.462004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.462006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.462008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.462011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.462015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.462018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.462021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.462023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.462026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.462028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.462030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.462032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.462035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.462037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.462039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.462042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.462044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.462046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.462049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.462054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.462057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.462058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.462061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.462063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.462067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.462069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.462072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.462091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.463126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.463212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.463222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1339
2025-10-02T09:31:58.463301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.463319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.463325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.463328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.463597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1339 sessionId:  describe result for acl check
2025-10-02T09:31:58.463622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.463626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.463627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.463631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569008891:5202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.463959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569008891:5202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.465391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569008891:5202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.468903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569008891:5202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.468918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569008891:5202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.468922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569008891:5202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.468928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.469431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.470784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.470796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.470797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.470799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.470802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1338 [2:7556554801493470454:8501]
2025-10-02T09:31:58.470809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.470818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.470824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.470833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.470834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.470843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.470849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.470854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.470888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.470893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.470894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.470896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.470897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.470931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.470936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.470942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.470948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.470959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.470971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.470976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.470978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.470983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.470992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008925:5202], now have 1 active actors on pipe
2025-10-02T09:31:58.470992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.470994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.470996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.470999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008754:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.471006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.471016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.471022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.471016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1338
2025-10-02T09:31:58.471040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.471038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1338
2025-10-02T09:31:58.471046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.471048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.471056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.471062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.471092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.471100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.471102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.471103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.471108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.471116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.471126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.471227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.471232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.471239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.471297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1339 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0
2025-10-02T09:31:58.471481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9650304f-3db04bb2-709b0701-fdde06c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.473725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Write session: try to update token
2025-10-02T09:31:58.473737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.480196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.480211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.480212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.480214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.480218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.480221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.480223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493470449:8501]
2025-10-02T09:31:58.480246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.480249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.480250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.480250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.480252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.480255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.480393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.484662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId: src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.486526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.551579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569008933:10078]
2025-10-02T09:31:58.551724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1338, pipe: [1:7556554801569008933:10078]
2025-10-02T09:31:58.591939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.592230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.592240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.592266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008933:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.592455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:58.592456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569008933:10078]
2025-10-02T09:31:58.592468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:58.592473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.592519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1339 reason: error at write: Disconnected sessionId: src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0
2025-10-02T09:31:58.592607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.592656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1339 sessionId: src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0 is DEAD
2025-10-02T09:31:58.592812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:58.592818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Write session will restart in 0.007651s
2025-10-02T09:31:58.592835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Write session: Do CDS request
2025-10-02T09:31:58.592839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.600681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.601201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.601232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.601242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1340
2025-10-02T09:31:58.601355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.601375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.601381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.601384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.601641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1340 sessionId:  describe result for acl check
2025-10-02T09:31:58.601665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.601670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.601671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.601674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569009067:5210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.602010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569009067:5210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.602226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.602385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.602393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.602402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.602440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.602462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493470625:8503]
2025-10-02T09:31:58.602878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.603052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.603088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.603142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569009067:5210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.603331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.603372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.603376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.603377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.603377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.603378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.603378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.603379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.603379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.603380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.603380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.603381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.603381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.603384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.603390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.603392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.603394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.603396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.603398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.603400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.603402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.603403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.603405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.603407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.603409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.603413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.603417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.603420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.603423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.603425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.603428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.603430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.603433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.603435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.603438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.603440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.603442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.603445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.603447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.603449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.603452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.603454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.603457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.603459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.603461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.603465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.603467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.603469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.603472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.603488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.607232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569009067:5210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.607241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569009067:5210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.607243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569009067:5210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.607247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.610803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.612215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.612226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.612228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.612230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.612233Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1339 [2:7556554801493470625:8503]
2025-10-02T09:31:58.612241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.612250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.612255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.612257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.612258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.612266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.612272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.612276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.612304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.612309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.612310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.612311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.612313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.612348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.612352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.612359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.612364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.612376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.612389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009106:5210], now have 1 active actors on pipe
2025-10-02T09:31:58.612394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569008934:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.612398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.612399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.612401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.612411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.612423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.612424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.612431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.612432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.612435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.612437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.612435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1339
2025-10-02T09:31:58.612448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1339
2025-10-02T09:31:58.612453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.612460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.612461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.612473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.612480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.612509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.612516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.612518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.612519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.612524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.612533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.612543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.612630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.612635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.612642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.612696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1340 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0
2025-10-02T09:31:58.612919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8841e1-2068437d-8b6a6f63-5e2f1b5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.615274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Write session: try to update token
2025-10-02T09:31:58.615286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.623036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.623051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.623054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.623055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.623062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.623065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.623068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493470620:8503]
2025-10-02T09:31:58.623096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.623097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.623103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.623105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.623106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.623108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.623226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.626537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId: src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.628446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.692373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569009114:10078]
2025-10-02T09:31:58.692536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1339, pipe: [1:7556554801569009114:10078]
2025-10-02T09:31:58.735906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.736137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.736146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.736172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009114:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.736303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.736344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:58.736357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:58.736360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569009114:10078]
2025-10-02T09:31:58.736385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.736408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1340 reason: error at write: Disconnected sessionId: src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0
2025-10-02T09:31:58.736574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1340 sessionId: src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0 is DEAD
2025-10-02T09:31:58.736744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:58.736753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Write session will restart in 0.007296s
2025-10-02T09:31:58.736766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Write session: Do CDS request
2025-10-02T09:31:58.736770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.744851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.745109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.745219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.745230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1341
2025-10-02T09:31:58.745326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.745346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.745352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.745354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.745620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1341 sessionId:  describe result for acl check
2025-10-02T09:31:58.745644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.745648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.745650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.745652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569009249:5198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.745979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569009249:5198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.746352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.746508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.746515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.746521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.746553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.746574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493470809:8506]
2025-10-02T09:31:58.746980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.747166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.747194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.747425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.747480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.747486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.747486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.747496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.747496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.747497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.747498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.747499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.747500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.747500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.747501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.747502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.747506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.747515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.747518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.747521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.747524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.747527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.747530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.747532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.747535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.747538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.747541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.747544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.747549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.747558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.747566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.747571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.747581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.747586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.747589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.747593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.747596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.747600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.747604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.747609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.747612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.747616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.747620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.747624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.747627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.747631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.747635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.747639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.747642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.747651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.747656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.747623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569009249:5198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.747660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.747695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.752456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569009249:5198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.752467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569009249:5198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.752469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569009249:5198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.752473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.755077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.756487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.756498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.756500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.756502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.756506Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1340 [2:7556554801493470809:8506]
2025-10-02T09:31:58.756512Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.756523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.756528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.756529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.756530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.756539Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.756542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.756546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.756578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.756583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.756584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.756585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.756587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.756627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.756633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.756641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.756652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.756669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.756686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009288:5198], now have 1 active actors on pipe
2025-10-02T09:31:58.756693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009115:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.756697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.756698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.756699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.756706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.756709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1340
2025-10-02T09:31:58.756719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.756714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1340
2025-10-02T09:31:58.756722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.756724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.756725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.756735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.756742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.756768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.756774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.756783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.756791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.756810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.756824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.756832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.756834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.756836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.756842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.756848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.756865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.756967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.756973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.756984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.757041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1341 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0
2025-10-02T09:31:58.757262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba487c4-a40f08a6-b27bd6de-7973cd4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.759620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Write session: try to update token
2025-10-02T09:31:58.759632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.767227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.767241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.767242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.767243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.767248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.767250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.767252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493470804:8506]
2025-10-02T09:31:58.767274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.767277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.767276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.767278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.767280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.767282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.767431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.771091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId: src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.773023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.836254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569009312:10078]
2025-10-02T09:31:58.836431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1340, pipe: [1:7556554801569009312:10078]
2025-10-02T09:31:58.879505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:58.879730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.879741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.879774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009312:10078], now have 1 active actors on pipe
2025-10-02T09:31:58.879936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:58.879940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:58.879952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:58.879955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569009312:10078]
2025-10-02T09:31:58.879970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:58.879995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1341 reason: error at write: Disconnected sessionId: src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0
2025-10-02T09:31:58.880119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1341 sessionId: src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0 is DEAD
2025-10-02T09:31:58.880254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:58.880265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Write session will restart in 0.008314s
2025-10-02T09:31:58.880288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Write session: Do CDS request
2025-10-02T09:31:58.880294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:58.888385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:58.889187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.889229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:58.889240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1342
2025-10-02T09:31:58.889324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:58.889344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:58.889350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:58.889352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:58.889684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1342 sessionId:  describe result for acl check
2025-10-02T09:31:58.889710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:58.889715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:58.889716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:58.889719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554801569009452:5196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:58.889905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:58.890000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:58.890006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:58.890012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:58.890038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:58.890061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554801493470982:8508]
2025-10-02T09:31:58.890054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554801569009452:5196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:58.890397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:58.890562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:58.890589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:58.890778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:58.890812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.890816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.890816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.890817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.890818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.890818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.890819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.890819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.890820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.890820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.890821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.890821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.890824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.890840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.890842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.890844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.890846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.890848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.890850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.890852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.890854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.890856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.890858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.890860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.890864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.890868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:58.890871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.890874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:58.890876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.890879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:58.890881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.890884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:58.890886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.890888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:58.890890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.890893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:58.890898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.890901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:58.890904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.890907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:58.890909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.890912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:58.890914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.890920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.890922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.890925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.890927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.890933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.890949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:58.891365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554801569009452:5196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:58.895736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554801569009452:5196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:58.895745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554801569009452:5196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:58.895746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554801569009452:5196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:58.895750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:58.898295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:58.899638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:58.899648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:58.899649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:58.899651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:58.899654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1341 [2:7556554801493470982:8508]
2025-10-02T09:31:58.899660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:58.899669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:58.899674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.899676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.899677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.899686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:58.899692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:58.899696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:58.899723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.899728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.899729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.899730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:58.899732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:58.899775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:58.899780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.899790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:58.899803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:58.899820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:58.899835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009317:2446], now have 1 active actors on pipe
2025-10-02T09:31:58.899841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009491:5196], now have 1 active actors on pipe
2025-10-02T09:31:58.899844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.899846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.899847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.899848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1341
2025-10-02T09:31:58.899855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:58.899850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1341
2025-10-02T09:31:58.899869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:58.899881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:58.899887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:58.899889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:58.899891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:58.899892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:58.899909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.899916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.899927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.899936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:58.899946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:58.899957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:58.899965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:58.899971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:58.899973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:58.899980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:58.899990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:58.900010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.900111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:58.900121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:58.900131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:58.900191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1342 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0
2025-10-02T09:31:58.900382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9625959-b4623128-d5c6610c-4cef8bf3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:58.902717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Write session: try to update token
2025-10-02T09:31:58.902729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:58.910502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:58.910519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:58.910520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:58.910521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:58.910528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.910531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.910533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554801493470977:8508]
2025-10-02T09:31:58.910556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:58.910560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:58.910561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:58.910572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:58.910576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:58.910580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:58.910678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:58.914125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId: src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:58.916018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:58.980146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554801569009498:10078]
2025-10-02T09:31:58.980341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1341, pipe: [1:7556554801569009498:10078]
2025-10-02T09:31:59.021776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.022048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.022059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.022091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554801569009498:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.022253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.022252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.022271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554801569009498:10078]
2025-10-02T09:31:59.022282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:59.022284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:59.022326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1342 reason: error at write: Disconnected sessionId: src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0
2025-10-02T09:31:59.022462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1342 sessionId: src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0 is DEAD
2025-10-02T09:31:59.022585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:59.022594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Write session will restart in 0.009783s
2025-10-02T09:31:59.022608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Write session: Do CDS request
2025-10-02T09:31:59.022612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.030561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.032218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.032323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.032329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.032335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.032359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.032381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788438452:8511]
2025-10-02T09:31:59.032727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.032901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.032927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.033104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.033134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.033141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.033144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.033145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.033146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.033146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.033147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.033147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.033148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.033148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.033149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.033149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.033150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.033153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.033159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.033161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.033163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.033165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.033167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.033169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.033171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.033173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.033175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.033177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.033179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.033183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.033186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.033190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.033193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.033195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.033198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.033200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.033203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.033205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.033207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.033209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.033212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.033214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.033217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.033219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.033223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.033233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1343
2025-10-02T09:31:59.033221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.033224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.033226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.033228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.033231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.033233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.033237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.033239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.033241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.033257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.033302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.033322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.033328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.033331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.033572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1343 sessionId:  describe result for acl check
2025-10-02T09:31:59.033595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.033600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.033601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.033605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863976936:5192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.033944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863976936:5192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.035225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863976936:5192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.039374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863976936:5192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.039382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863976936:5192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.039386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863976936:5192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.039389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.040583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.041972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.041983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.041985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.041987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.041990Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1342 [2:7556554805788438452:8511]
2025-10-02T09:31:59.041997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.042007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.042012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.042014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.042015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.042025Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.042027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.042032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.042061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.042066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.042067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.042069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.042070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.042104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.042109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.042115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.042122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.042132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.042146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863976971:5192], now have 1 active actors on pipe
2025-10-02T09:31:59.042153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863976796:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.042156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.042158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.042160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.042169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.042180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.042183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.042171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1342
2025-10-02T09:31:59.042187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.042191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1342
2025-10-02T09:31:59.042189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.042193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.042196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.042219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.042226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.042237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.042246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.042254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.042262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.042265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.042267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.042268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.042273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.042282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.042294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.042378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.042383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.042391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.042437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1343 partition: 0 MaxSeqNo: 36 sessionId: src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0
2025-10-02T09:31:59.042634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a819ab5-731391d5-c04059ec-17ae1e3f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.044906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Write session: try to update token
2025-10-02T09:31:59.044916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.051388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.051403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.051405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.051406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.051410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.051413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.051415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788438447:8511]
2025-10-02T09:31:59.051434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.051436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.051436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.051438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.051439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.051440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.051546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.055235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId: src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.057102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.122474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863976978:10078]
2025-10-02T09:31:59.122657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1342, pipe: [1:7556554805863976978:10078]
2025-10-02T09:31:59.161784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.162011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.162019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.162042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863976978:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.162148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.162163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.162184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:59.162187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:59.162201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863976978:10078]
2025-10-02T09:31:59.162228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1343 reason: error at write: Disconnected sessionId: src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0
2025-10-02T09:31:59.162387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1343 sessionId: src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0 is DEAD
2025-10-02T09:31:59.162513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:59.162517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Write session will restart in 0.005281s
2025-10-02T09:31:59.162530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Write session: Do CDS request
2025-10-02T09:31:59.162534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.169113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.169198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.169206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1344
2025-10-02T09:31:59.169438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.169459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.169466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.169469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.169786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1344 sessionId:  describe result for acl check
2025-10-02T09:31:59.169811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.169816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.169817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.169820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863977135:5173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.170131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863977135:5173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.170647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.171533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863977135:5173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.172269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.172374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.172381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.172386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.172413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.172433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788438663:8525]
2025-10-02T09:31:59.172769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.172944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.172969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.173146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.173174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.173178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.173178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.173179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.173179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.173180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.173180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.173181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.173181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.173182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.173182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.173183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.173186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.173192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.173194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.173196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.173198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.173200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.173202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.173204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.173206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.173208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.173210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.173212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.173215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.173219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.173222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.173225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.173227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.173229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.173232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.173235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.173237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.173239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.173241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.173244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.173248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.173250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.173252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.173255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.173258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.173261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.173263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.173266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.173268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.173271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.173273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.173275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.173292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.173497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863977135:5173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.173505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863977135:5173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.173507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863977135:5173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.173511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.180693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.182106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.182117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.182118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.182120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.182124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1343 [2:7556554805788438663:8525]
2025-10-02T09:31:59.182131Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.182140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.182146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.182148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.182149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.182158Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.182161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.182165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.182195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.182199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.182201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.182203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.182204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.182240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.182245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.182251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.182256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.182267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.182280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.182284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.182285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.182289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.182296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977176:5173], now have 1 active actors on pipe
2025-10-02T09:31:59.182296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.182298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.182299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.182302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977001:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.182306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.182313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.182314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.182326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.182334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.182335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1343
2025-10-02T09:31:59.182344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.182354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1343
2025-10-02T09:31:59.182369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.182374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.182390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52f6f44-7e746863-9194009f-50a80725_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.182396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.182398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.182399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.182403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.182410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.182419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.182504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.182509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.182517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.182569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1344 partition: 0 MaxSeqNo: 36 sessionId: src_id|52f6f44-7e746863-9194009f-50a80725_0
2025-10-02T09:31:59.182739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46c83725-a7232f73-337e7c4e-bcbf0ce2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52f6f44-7e746863-9194009f-50a80725_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.185002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Write session: try to update token
2025-10-02T09:31:59.185012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.191198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:31:59.191213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.191218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.191240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:31:59.191247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:31:59.191366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:31:59.191476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:59.191591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:59.191704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:31:59.191851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:31:59.191873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:31:59.195012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId: src_id|52f6f44-7e746863-9194009f-50a80725_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.196887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.197012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.197020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.197035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:31:59.197089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:59.199718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.199732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.199734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.199735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.199739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.199742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.199744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788438658:8525]
2025-10-02T09:31:59.199764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.199766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.199770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.199771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.199773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.199776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.199879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.262238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863977187:10078]
2025-10-02T09:31:59.262407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1343, pipe: [1:7556554805863977187:10078]
2025-10-02T09:31:59.310923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.316747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.316766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.316905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.316959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.317018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.317071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.317108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.317114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.317167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.317214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.317263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.317311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.317345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.317350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.317401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.317445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.317494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.317544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.317648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.317654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.317703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.317874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.317922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.317993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.318030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.318036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.318085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.318132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.318183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.318231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.318265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.318270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.318319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.318365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.318412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.318460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.318497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.318501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.318548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.318594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.318646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.318693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.318732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.318737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.318786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.318841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.318890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.318936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.318969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.318974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.319018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.319069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.319120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.319175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.319216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.319220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.319267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:31:59.319312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:31:59.319360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:31:59.319408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:31:59.319452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:31:59.319457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:31:59.319485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977187:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.319687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863977187:10078]
2025-10-02T09:31:59.319691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:59.319694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:59.319709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.319717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1344 reason: error at write: Disconnected sessionId: src_id|52f6f44-7e746863-9194009f-50a80725_0
2025-10-02T09:31:59.319893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1344 sessionId: src_id|52f6f44-7e746863-9194009f-50a80725_0 is DEAD
2025-10-02T09:31:59.319952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.319982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:59.319990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Write session will restart in 0.005034s
2025-10-02T09:31:59.320005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Write session: Do CDS request
2025-10-02T09:31:59.320009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.326068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.326172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.326178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1345
2025-10-02T09:31:59.326272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.326293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.326298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.326300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.326609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1345 sessionId:  describe result for acl check
2025-10-02T09:31:59.326633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.326637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.326638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.326642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863977254:5165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.326985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863977254:5165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.328972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.329028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863977254:5165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.330359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.330455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.330461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.330467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.330492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.330516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788438841:8528]
2025-10-02T09:31:59.330618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863977254:5165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.330626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863977254:5165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.330628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863977254:5165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.330631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.330874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.331037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.331067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.331240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.331267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.331271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.331271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.331272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.331272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.331273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.331273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.331274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.331274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.331275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.331275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.331276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.331278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.331284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.331286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.331288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.331290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.331292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.331294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.331296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.331298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.331300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.331302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.331304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.331307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.331311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.331314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.331317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.331319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.331322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.331324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.331327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.331329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.331332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.331334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.331337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.331339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.331342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.331344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.331346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.331349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.331351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.331353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.331356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.331358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.331361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.331363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.331365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.331394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.338763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.340069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.340081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.340083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.340084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.340088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1344 [2:7556554805788438841:8528]
2025-10-02T09:31:59.340096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.340110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.340117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.340120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.340122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.340133Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.340136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.340140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.340172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.340177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.340178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.340180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.340181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.340217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.340222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.340228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.340235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.340244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.340257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977360:5165], now have 1 active actors on pipe
2025-10-02T09:31:59.340263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977188:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.340266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.340267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.340268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.340277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.340287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.340290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.340292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.340293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.340298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.340299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.340296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1344
2025-10-02T09:31:59.340297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1344
2025-10-02T09:31:59.340316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.340321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.340323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.340330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.340334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.340356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e282130-bb7574e6-a3467d14-469cce3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.340363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.340366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.340367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.340373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.340381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.340393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.340479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.340489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.340504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.340566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1345 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e282130-bb7574e6-a3467d14-469cce3d_0
2025-10-02T09:31:59.340762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52f6f44-7e746863-9194009f-50a80725_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e282130-bb7574e6-a3467d14-469cce3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.342917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Write session: try to update token
2025-10-02T09:31:59.342930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.349532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.349546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.349548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.349549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.349554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.349556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.349559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788438836:8528]
2025-10-02T09:31:59.349581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.349587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.349588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.349589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.349593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.349595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.349697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.353119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId: src_id|9e282130-bb7574e6-a3467d14-469cce3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.355000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.419958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863977373:10078]
2025-10-02T09:31:59.420137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1344, pipe: [1:7556554805863977373:10078]
2025-10-02T09:31:59.458518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.458911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.458921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.458947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977373:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.459116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.459124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863977373:10078]
2025-10-02T09:31:59.459138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.459143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:59.459145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:59.459191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1345 reason: error at write: Disconnected sessionId: src_id|9e282130-bb7574e6-a3467d14-469cce3d_0
2025-10-02T09:31:59.459325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1345 sessionId: src_id|9e282130-bb7574e6-a3467d14-469cce3d_0 is DEAD
2025-10-02T09:31:59.459449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:59.459454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Write session will restart in 0.008786s
2025-10-02T09:31:59.459468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Write session: Do CDS request
2025-10-02T09:31:59.459472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.467571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.469057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.469087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.469159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.469166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.469172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.469178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.469186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1346
2025-10-02T09:31:59.469198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.469221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788439018:8530]
2025-10-02T09:31:59.469253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.469273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.469279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.469282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.469537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1346 sessionId:  describe result for acl check
2025-10-02T09:31:59.469563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.469569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.469570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.469573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863977513:5162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.469629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.469789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.469817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.469902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863977513:5162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.469995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.470024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.470028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.470029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.470030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.470030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.470031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.470031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.470032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.470032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.470033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.470033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.470034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.470037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.470043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.470045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.470047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.470049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.470051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.470053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.470055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.470057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.470059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.470061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.470063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.470066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.470070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.470073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.470076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.470079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.470082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.470086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.470090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.470092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.470095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.470097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.470101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.470103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.470106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.470108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.470110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.470113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.470115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.470117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.470120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.470125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.470128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.470130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.470132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.470148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.471430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863977513:5162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.475350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863977513:5162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.475359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863977513:5162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.475360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863977513:5162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.475366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.477493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.478919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.478931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.478932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.478935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.478939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1345 [2:7556554805788439018:8530]
2025-10-02T09:31:59.478947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.478959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.478965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.478966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.478967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.478976Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.478979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.478983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.479010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.479015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.479016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.479018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.479019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.479063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.479071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.479082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.479094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.479111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.479127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977374:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.479133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977552:5162], now have 1 active actors on pipe
2025-10-02T09:31:59.479137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.479140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.479143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.479120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1345
2025-10-02T09:31:59.479149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.479121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1345
2025-10-02T09:31:59.479156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.479158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.479159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.479160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.479173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.479175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.479190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.479195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.479212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.479220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.479229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.479229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.479232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.479234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.479235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.479240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.479245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.479260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.479361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.479368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.479377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.479437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1346 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0
2025-10-02T09:31:59.479623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e282130-bb7574e6-a3467d14-469cce3d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.482009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Write session: try to update token
2025-10-02T09:31:59.482025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.488617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.488631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.488632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.488634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.488638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.488641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.488643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788439013:8530]
2025-10-02T09:31:59.488667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.488674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.488675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.488680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.488684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.488688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.488790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.492199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId: src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.494088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.559209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863977560:10078]
2025-10-02T09:31:59.559375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1345, pipe: [1:7556554805863977560:10078]
2025-10-02T09:31:59.599130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.599362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.599379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.599410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977560:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.599650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863977560:10078]
2025-10-02T09:31:59.599655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.599676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:59.599678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:59.599724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1346 reason: error at write: Disconnected sessionId: src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0
2025-10-02T09:31:59.599859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1346 sessionId: src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0 is DEAD
2025-10-02T09:31:59.599881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.599966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:59.599971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Write session will restart in 0.009778s
2025-10-02T09:31:59.599988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Write session: Do CDS request
2025-10-02T09:31:59.599992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.608010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.609446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.609558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.609566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.609571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.609597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.609619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788439196:8532]
2025-10-02T09:31:59.610226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.610382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.610408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.610652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.610687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.610691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.610692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.610692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.610693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.610693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.610694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.610694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.610695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.610695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.610696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.610696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.610699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.610706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.610708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.610710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.610712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.610714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.610716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.610718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.610720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.610722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.610724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.610726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.610731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.610735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.610738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.610741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.610743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.610745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.610747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.610750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.610752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.610755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.610757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.610759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.610762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.610764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.610766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.610769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.610771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.610773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.610775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.610778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.610780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.610782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.610784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.610787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.610802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.611139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.611197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.611208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1347
2025-10-02T09:31:59.611295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.611313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.611319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.611322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.611563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1347 sessionId:  describe result for acl check
2025-10-02T09:31:59.611581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.611585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.611586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.611589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863977706:5156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.611920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863977706:5156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.613318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863977706:5156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.617776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863977706:5156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.617784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863977706:5156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.617786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863977706:5156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.617790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.618291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.619600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.619611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.619613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.619615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.619618Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1346 [2:7556554805788439196:8532]
2025-10-02T09:31:59.619624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.619635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.619638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.619639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.619640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.619649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.619652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.619656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.619687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.619691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.619692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.619694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.619695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.619731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.619735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.619741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.619746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.619754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.619766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977740:5156], now have 1 active actors on pipe
2025-10-02T09:31:59.619772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977561:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.619776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.619777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.619778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.619785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.619793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.619799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.619801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.619802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.619803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.619800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1346
2025-10-02T09:31:59.619805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.619804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1346
2025-10-02T09:31:59.619817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.619823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.619824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.619836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.619839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.619857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fa61c62-af72c600-6991ed8e-1d977771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.619864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.619867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.619868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.619872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.619877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.619886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.619974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.619979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.619987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.620040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1347 partition: 0 MaxSeqNo: 36 sessionId: src_id|2fa61c62-af72c600-6991ed8e-1d977771_0
2025-10-02T09:31:59.620225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3dd62b-577e49d6-f7112d33-47d9ee93_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2fa61c62-af72c600-6991ed8e-1d977771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.622377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Write session: try to update token
2025-10-02T09:31:59.622387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.629015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.629029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.629031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.629032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.629036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.629039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.629041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788439191:8532]
2025-10-02T09:31:59.629062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.629065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.629066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.629067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.629070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.629073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.629174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.632404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId: src_id|2fa61c62-af72c600-6991ed8e-1d977771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.634293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.699983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863977749:10078]
2025-10-02T09:31:59.700126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1346, pipe: [1:7556554805863977749:10078]
2025-10-02T09:31:59.746539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.746940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.746949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.746972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977749:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.747094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.747150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863977749:10078]
2025-10-02T09:31:59.747156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:31:59.747176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.747218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1347 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2fa61c62-af72c600-6991ed8e-1d977771_0
2025-10-02T09:31:59.747357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1347 sessionId: src_id|2fa61c62-af72c600-6991ed8e-1d977771_0 is DEAD
2025-10-02T09:31:59.747475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:31:59.747481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Write session will restart in 0.005743s
2025-10-02T09:31:59.747496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Write session: Do CDS request
2025-10-02T09:31:59.747500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.754107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.754193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.754202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1348
2025-10-02T09:31:59.754305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.754331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.754337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.754339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.754650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1348 sessionId:  describe result for acl check
2025-10-02T09:31:59.754674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.754678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.754679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.754682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863977875:5145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.755034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863977875:5145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.756036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.756726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863977875:5145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.757465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.757566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.757573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.757579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.757607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.757629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788439388:8535]
2025-10-02T09:31:59.757966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.758146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.758171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.758359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.758403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.758408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.758409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.758410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.758411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.758411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.758412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.758413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.758414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.758415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.758415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.758416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.758420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.758428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.758432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.758435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.758438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.758441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.758444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.758448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.758451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.758455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.758463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.758466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.758471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.758480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.758485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.758492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.758496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.758499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.758501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.758504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.758507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.758509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.758511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.758514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.758517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.758524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.758527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.758531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.758535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.758539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.758544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.758548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.758551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.758555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.758560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.758564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.758592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.758713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863977875:5145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.758723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863977875:5145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.758724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863977875:5145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.758728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.765968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.767273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.767285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.767286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.767288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.767291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1347 [2:7556554805788439388:8535]
2025-10-02T09:31:59.767298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.767307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.767309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.767310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.767311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.767320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.767326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.767330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.767361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.767365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.767366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.767368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.767370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.767405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.767410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.767415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.767422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.767435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.767454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977932:5145], now have 1 active actors on pipe
2025-10-02T09:31:59.767460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977753:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.767466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.767472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.767473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.767483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.767492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.767494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.767497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.767498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.767506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.767512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.767527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.767533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.767535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.767517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1347
2025-10-02T09:31:59.767518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1347
2025-10-02T09:31:59.767557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.767564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.767582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|828aa469-79f24fe8-b92ddcf-20755084_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.767591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.767595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.767597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.767603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.767610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.767622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.767741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.767747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.767755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.767817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1348 partition: 0 MaxSeqNo: 36 sessionId: src_id|828aa469-79f24fe8-b92ddcf-20755084_0
2025-10-02T09:31:59.768005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fa61c62-af72c600-6991ed8e-1d977771_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|828aa469-79f24fe8-b92ddcf-20755084_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.770135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Write session: try to update token
2025-10-02T09:31:59.770146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.776726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.776741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.776742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.776743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.776748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.776750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.776752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788439383:8535]
2025-10-02T09:31:59.776774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.776779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.776780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.776781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.776784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.776786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.776933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.780359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId: src_id|828aa469-79f24fe8-b92ddcf-20755084_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.782382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.847452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863977960:10078]
2025-10-02T09:31:59.847645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1347, pipe: [1:7556554805863977960:10078]
2025-10-02T09:31:59.887639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:31:59.887984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.887994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.888018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977960:10078], now have 1 active actors on pipe
2025-10-02T09:31:59.888186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:31:59.888190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:31:59.888202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:31:59.888203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863977960:10078]
2025-10-02T09:31:59.888215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:31:59.888248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1348 reason: error at write: Disconnected sessionId: src_id|828aa469-79f24fe8-b92ddcf-20755084_0
2025-10-02T09:31:59.888369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1348 sessionId: src_id|828aa469-79f24fe8-b92ddcf-20755084_0 is DEAD
2025-10-02T09:31:59.888494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:31:59.888499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Write session will restart in 0.007698s
2025-10-02T09:31:59.888515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Write session: Do CDS request
2025-10-02T09:31:59.888519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:31:59.896549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:31:59.897118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.897206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:31:59.897216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1349
2025-10-02T09:31:59.897288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:31:59.897312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:31:59.897320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:31:59.897323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:31:59.897619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1349 sessionId:  describe result for acl check
2025-10-02T09:31:59.897644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:31:59.897656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:31:59.897660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:31:59.897664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554805863978107:5137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:31:59.897993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554805863978107:5137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:31:59.898028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:31:59.898121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:31:59.898128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:31:59.898134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:31:59.898159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:31:59.898182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554805788439568:8537]
2025-10-02T09:31:59.898517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:31:59.898732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:31:59.898774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:31:59.898983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:31:59.899014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.899018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.899019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.899019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.899020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.899021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.899021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.899022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.899023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.899023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.899024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.899024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.899029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.899035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.899037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.899039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.899041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.899043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.899045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.899048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.899050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.899052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.899054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.899057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.899061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.899068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:31:59.899075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.899079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:31:59.899084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.899088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:31:59.899093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.899096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:31:59.899101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.899110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:31:59.899113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.899119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:31:59.899123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.899129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:31:59.899132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.899137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:31:59.899142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.899150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:31:59.899153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.899162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.899166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.899170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.899173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.899176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.899191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:31:59.899557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554805863978107:5137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:31:59.904149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554805863978107:5137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:31:59.904158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554805863978107:5137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:31:59.904159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554805863978107:5137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:31:59.904163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:31:59.906902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:31:59.908193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:31:59.908204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:31:59.908205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:31:59.908208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:31:59.908211Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1348 [2:7556554805788439568:8537]
2025-10-02T09:31:59.908218Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:31:59.908228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:31:59.908233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.908235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.908236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.908245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:31:59.908250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:31:59.908254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:31:59.908283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.908289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.908290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.908291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:31:59.908293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:31:59.908333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:31:59.908339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.908349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:31:59.908361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:31:59.908378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:31:59.908395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863978146:5137], now have 1 active actors on pipe
2025-10-02T09:31:59.908400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863977965:2446], now have 1 active actors on pipe
2025-10-02T09:31:59.908404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.908406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.908407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.908407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1348
2025-10-02T09:31:59.908411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1348
2025-10-02T09:31:59.908417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:31:59.908430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:31:59.908432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:31:59.908437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:31:59.908438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:31:59.908444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:31:59.908446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:31:59.908485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.908491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.908498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.908505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:31:59.908514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:31:59.908523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:31:59.908532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:31:59.908536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:31:59.908541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:31:59.908548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:31:59.908554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:31:59.908573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.908645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:31:59.908652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:31:59.908662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:31:59.908713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1349 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0
2025-10-02T09:31:59.908889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|828aa469-79f24fe8-b92ddcf-20755084_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:31:59.911120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Write session: try to update token
2025-10-02T09:31:59.911130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:31:59.917974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:31:59.917987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:31:59.917989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:31:59.917990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:31:59.917993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.917996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.917998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554805788439563:8537]
2025-10-02T09:31:59.918020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:31:59.918022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:31:59.918025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:31:59.918026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:31:59.918027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:31:59.918028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:31:59.918164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:31:59.921221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId: src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:31:59.923070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:31:59.988284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554805863978153:10078]
2025-10-02T09:31:59.988491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1348, pipe: [1:7556554805863978153:10078]
2025-10-02T09:32:00.028986Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.029466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.029476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.029501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554805863978153:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.029684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.029669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:00.029679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:00.029692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554805863978153:10078]
2025-10-02T09:32:00.029709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.029735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1349 reason: error at write: Disconnected sessionId: src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0
2025-10-02T09:32:00.029869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1349 sessionId: src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0 is DEAD
2025-10-02T09:32:00.029991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:00.030000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Write session will restart in 0.008015s
2025-10-02T09:32:00.030014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Write session: Do CDS request
2025-10-02T09:32:00.030018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.038640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.039089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.039200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.039210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1350
2025-10-02T09:32:00.039286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.039314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.039321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.039324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.039589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1350 sessionId:  describe result for acl check
2025-10-02T09:32:00.039617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.039621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.039623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.039626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158945594:5134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.039985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158945594:5134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.040298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.040435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.040442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.040448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.040479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.040512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083407045:8540]
2025-10-02T09:32:00.041007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.041209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.041244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.041409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158945594:5134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.041508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.041552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.041557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.041558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.041558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.041559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.041560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.041561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.041562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.041563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.041563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.041564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.041565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.041569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.041578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.041581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.041584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.041588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.041591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.041594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.041597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.041600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.041603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.041609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.041612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.041617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.041626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.041634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.041643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.041648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.041657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.041661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.041670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.041674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.041678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.041682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.041686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.041694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.041699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.041702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.041707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.041711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.041715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.041719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.041724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.041728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.041732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.041734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.041737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.041753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.046798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158945594:5134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.046810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158945594:5134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.046812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158945594:5134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.046816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.049597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.050944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.050954Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.050956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.050958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.050962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1349 [2:7556554810083407045:8540]
2025-10-02T09:32:00.050969Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.050979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.050982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.050984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.050985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.050994Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.051000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.051005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.051116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.051121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.051122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.051124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.051126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.051162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.051167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.051173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.051178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.051187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.051199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945633:5134], now have 1 active actors on pipe
2025-10-02T09:32:00.051206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945451:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.051209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.051211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.051212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.051219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.051227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.051230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.051232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.051233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.051237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.051239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.051241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1349
2025-10-02T09:32:00.051252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.051242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1349
2025-10-02T09:32:00.051255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.051256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.051271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.051276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.051297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.051303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.051305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.051306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.051312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.051317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.051330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.051451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.051456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.051463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.051528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1350 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0
2025-10-02T09:32:00.051756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb36aed1-92ce93e5-c3769cb3-5265e2e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.053951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Write session: try to update token
2025-10-02T09:32:00.053961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.061150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.061165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.061167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.061169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.061174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.061177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.061179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083407040:8540]
2025-10-02T09:32:00.061201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.061205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.061207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.061206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.061210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.061212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.061325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.064655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId: src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.066566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:00.130084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554810158945642:10078]
2025-10-02T09:32:00.130268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1349, pipe: [1:7556554810158945642:10078]
2025-10-02T09:32:00.178058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.178219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.178228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.178252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945642:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.178359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554810158945642:10078]
2025-10-02T09:32:00.178385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:00.178386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:00.178417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.178435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1350 reason: error at write: Disconnected sessionId: src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0
2025-10-02T09:32:00.178576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1350 sessionId: src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0 is DEAD
2025-10-02T09:32:00.178673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:00.178680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Write session will restart in 0.005498s
2025-10-02T09:32:00.178693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Write session: Do CDS request
2025-10-02T09:32:00.178697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.178697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.185031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.185142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.185154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1351
2025-10-02T09:32:00.185321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.185342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.185348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.185350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.185702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1351 sessionId:  describe result for acl check
2025-10-02T09:32:00.185727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.185731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.185732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.185734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158945769:5117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.186031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158945769:5117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.187160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158945769:5117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.187594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.189282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.189412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.189420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.189427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.189426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158945769:5117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.189437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158945769:5117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.189439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158945769:5117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.189442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.189466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.189497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083407272:8556]
2025-10-02T09:32:00.189907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.190086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.190111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.190294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.190323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.190326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.190327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.190328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.190328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.190329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.190329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.190330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.190330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.190330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.190331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.190331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.190334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.190340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.190342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.190344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.190346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.190348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.190350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.190352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.190354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.190356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.190358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.190360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.190363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.190367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.190370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.190373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.190375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.190378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.190380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.190383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.190385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.190387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.190389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.190392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.190394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.190397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.190398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.190401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.190403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.190406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.190408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.190410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.190413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.190415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.190417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.190420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.190436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.197988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.199456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.199469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.199469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.199471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.199475Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1350 [2:7556554810083407272:8556]
2025-10-02T09:32:00.199482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.199493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.199494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.199496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.199497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.199506Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.199512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.199517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.199552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.199556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.199557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.199559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.199561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.199596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.199601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.199607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.199614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.199628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.199648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945848:5117], now have 1 active actors on pipe
2025-10-02T09:32:00.199655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945663:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.199661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.199663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.199665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.199674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.199688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.199688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.199690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.199691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.199702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.199704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.199693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1350
2025-10-02T09:32:00.199709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1350
2025-10-02T09:32:00.199735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.199742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.199751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.199761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.199769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.199782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.199791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.199794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.199796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.199802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.199810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.199905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.200037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.200044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.200053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.200118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1351 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0
2025-10-02T09:32:00.200338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9e2c1f-ae5abf5-cd125fbd-ec5934d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.202601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Write session: try to update token
2025-10-02T09:32:00.202612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.209809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.209826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.209827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.209829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.209834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.209837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.209839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083407267:8556]
2025-10-02T09:32:00.209864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.209868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.209869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.209879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.209883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.209887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.209979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.213685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId: src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.215791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:00.278574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554810158945862:10078]
2025-10-02T09:32:00.278763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1350, pipe: [1:7556554810158945862:10078]
2025-10-02T09:32:00.330093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.330366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.330376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.330405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945862:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.330568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.330595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.330596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554810158945862:10078]
2025-10-02T09:32:00.330617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:00.330670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0
2025-10-02T09:32:00.330852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1351 sessionId: src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0 is DEAD
2025-10-02T09:32:00.330972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:00.330981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Write session will restart in 0.009238s
2025-10-02T09:32:00.330999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Write session: Do CDS request
2025-10-02T09:32:00.331004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.339368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.340906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.341016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.341024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.341032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.341054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.341071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.341108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083407457:8561]
2025-10-02T09:32:00.341196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.341205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1352
2025-10-02T09:32:00.341302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.341319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.341327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.341329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.341474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.341606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1352 sessionId:  describe result for acl check
2025-10-02T09:32:00.341630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.341636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.341637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.341640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158946011:5104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.341664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.341692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.341886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.341916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.341920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.341921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.341921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.341922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.341922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.341923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.341923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.341924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.341924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.341925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.341926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.341929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.341935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.341937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.341939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.341941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.341943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.341945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.341947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.341949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.341951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.341953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.341955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.341959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.341963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.341966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.341968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.341971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.341973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.341975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.341978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.341980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.341982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.341984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.341979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158946011:5104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.341987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.341993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.341996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.341998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.342000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.342002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.342005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.342008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.342010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.342016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.342020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.342025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.342029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.342060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.343500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158946011:5104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.347320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158946011:5104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.347331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158946011:5104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.347333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158946011:5104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.347337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.349484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.350843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.350856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.350858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.350861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.350866Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1351 [2:7556554810083407457:8561]
2025-10-02T09:32:00.350877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.350889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.350895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.350898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.350899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.350910Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.350915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.350921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.350958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.350963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.350965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.350966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.350968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.351091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1351
2025-10-02T09:32:00.351102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1351
2025-10-02T09:32:00.351105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.351112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.351122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.351134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.351152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.351169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946048:5104], now have 1 active actors on pipe
2025-10-02T09:32:00.351174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158945863:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.351185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.351190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.351200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.351204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.351205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.351213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.351225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.351230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.351232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.351233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.351236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.351238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.351248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.351255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.351257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.351259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.351264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.351273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.351291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.351299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.351304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.351307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.351396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.351401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.351409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.351460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1352 partition: 0 MaxSeqNo: 36 sessionId: src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0
2025-10-02T09:32:00.351674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd77b31f-1633fc01-90a488c3-3b2b7e6d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.353847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Write session: try to update token
2025-10-02T09:32:00.353857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.360732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.360747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.360749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.360750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.360754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.360757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.360760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083407452:8561]
2025-10-02T09:32:00.360781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.360785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.360786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.360788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.360791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.360793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.360910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.364081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId: src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.366136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:00.430650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554810158946056:10078]
2025-10-02T09:32:00.430882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1351, pipe: [1:7556554810158946056:10078]
2025-10-02T09:32:00.475488Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.475697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.475707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.475733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946056:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.475914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.475936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.475938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:00.475941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:00.475985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1352 reason: error at write: Disconnected sessionId: src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0
2025-10-02T09:32:00.476000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554810158946056:10078]
2025-10-02T09:32:00.476127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1352 sessionId: src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0 is DEAD
2025-10-02T09:32:00.476255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:00.476260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Write session will restart in 0.005479s
2025-10-02T09:32:00.476275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Write session: Do CDS request
2025-10-02T09:32:00.476279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.483087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.483191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.483201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1353
2025-10-02T09:32:00.483295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.483319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.483325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.483328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.483601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1353 sessionId:  describe result for acl check
2025-10-02T09:32:00.483627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.483628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.483629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.483633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158946168:5103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.483969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158946168:5103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.485247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.485330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158946168:5103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.486748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.486867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.486875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.486884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.486924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.486957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083407640:8563]
2025-10-02T09:32:00.487310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.487335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158946168:5103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.487345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158946168:5103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.487347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158946168:5103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.487350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.487496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.487520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.487697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.487724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.487728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.487729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.487729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.487730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.487730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.487731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.487731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.487732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.487732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.487733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.487733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.487736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.487742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.487744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.487746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.487748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.487750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.487752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.487754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.487756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.487758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.487760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.487762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.487766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.487769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.487772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.487775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.487777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.487780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.487782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.487784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.487786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.487789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.487791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.487794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.487798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.487800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.487802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.487805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.487807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.487809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.487811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.487814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.487818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.487820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.487822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.487825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.487843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.495258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.496650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.496663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.496664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.496666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.496669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1352 [2:7556554810083407640:8563]
2025-10-02T09:32:00.496677Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.496687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.496690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.496694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.496695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.496707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.496716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.496722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.496767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.496773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.496774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.496778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.496779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.496838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.496845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.496855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.496865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.496891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.496911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946238:5103], now have 1 active actors on pipe
2025-10-02T09:32:00.496918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946057:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.496923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.496925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.496927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.496939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.496954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.496936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1352
2025-10-02T09:32:00.496962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1352
2025-10-02T09:32:00.496955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.496958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.496959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.496971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.496974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.497003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.497011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.497020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.497030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.497038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.497049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|256805fc-18d72dff-28470bbb-670a113a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.497053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.497055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.497056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.497062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.497070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.497083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.497191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.497196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.497204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.497259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1353 partition: 0 MaxSeqNo: 36 sessionId: src_id|256805fc-18d72dff-28470bbb-670a113a_0
2025-10-02T09:32:00.497502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21355116-458f91e1-2a1fc20d-8aa5e97a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|256805fc-18d72dff-28470bbb-670a113a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.499688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Write session: try to update token
2025-10-02T09:32:00.499699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.506417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.506433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.506435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.506436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.506441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.506444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.506446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083407635:8563]
2025-10-02T09:32:00.506468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.506471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.506473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.506473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.506476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.506478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.506578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.511151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId: src_id|256805fc-18d72dff-28470bbb-670a113a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.513128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:00.576051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554810158946250:10078]
2025-10-02T09:32:00.576277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1352, pipe: [1:7556554810158946250:10078]
2025-10-02T09:32:00.625662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.625988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.625998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.626024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946250:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.626168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.626223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:00.626233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554810158946250:10078]
2025-10-02T09:32:00.626235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:00.626248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.626280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1353 reason: error at write: Disconnected sessionId: src_id|256805fc-18d72dff-28470bbb-670a113a_0
2025-10-02T09:32:00.626428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1353 sessionId: src_id|256805fc-18d72dff-28470bbb-670a113a_0 is DEAD
2025-10-02T09:32:00.626572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:00.626581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Write session will restart in 0.007417s
2025-10-02T09:32:00.626599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Write session: Do CDS request
2025-10-02T09:32:00.626603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.635116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.635189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.635201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1354
2025-10-02T09:32:00.635284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.635309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.635318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.635325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.635322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.635595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1354 sessionId:  describe result for acl check
2025-10-02T09:32:00.635619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.635623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.635625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.635628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158946398:5094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.635962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158946398:5094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.636919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.637019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.637026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.637032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.637057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.637085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083407825:8565]
2025-10-02T09:32:00.637424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.637440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158946398:5094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.637598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.637622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.637797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.637825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.637829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.637829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.637830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.637830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.637831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.637831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.637832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.637832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.637833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.637833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.637834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.637836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.637842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.637844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.637846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.637848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.637850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.637852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.637854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.637856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.637858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.637860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.637862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.637865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.637869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.637872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.637875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.637878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.637880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.637882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.637885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.637887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.637891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.637893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.637896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.637898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.637901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.637903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.637905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.637908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.637910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.637912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.637914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.637917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.637919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.637921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.637924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.637952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.641877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158946398:5094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.641886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158946398:5094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.641888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158946398:5094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.641891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.645612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.647239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.647252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.647254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.647258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.647263Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1353 [2:7556554810083407825:8565]
2025-10-02T09:32:00.647274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.647289Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.647291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.647294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.647295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.647311Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.647320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.647326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.647383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.647388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.647389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.647391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.647393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.647432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.647438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.647444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.647449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.647461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.647473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.647479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.647480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.647487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.647494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.647496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.647497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.647498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946437:5094], now have 1 active actors on pipe
2025-10-02T09:32:00.647502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946251:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.647508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.647519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.647526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.647546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.647555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.647547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1353
2025-10-02T09:32:00.647562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.647551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1353
2025-10-02T09:32:00.647581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.647586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.647604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.647611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.647613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.647614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.647619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.647624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.647632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.647733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.647739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.647750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.647807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1354 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0
2025-10-02T09:32:00.648044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256805fc-18d72dff-28470bbb-670a113a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.650316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Write session: try to update token
2025-10-02T09:32:00.650327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.660992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId: src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.661133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:00.661148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.661157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.661185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:00.661187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:00.661328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:00.661448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:00.661569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:00.661691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:00.661839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:00.661869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:00.662993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:00.663204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.663213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.663230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:00.663287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:00.665997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.666009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.666011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.666012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.666018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.666020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.666022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083407820:8565]
2025-10-02T09:32:00.666041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.666046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.666047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.666060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.666077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.666081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.666153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.726587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554810158946445:10078]
2025-10-02T09:32:00.726787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1353, pipe: [1:7556554810158946445:10078]
2025-10-02T09:32:00.782956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.789319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.789340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.789466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.789515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.789565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.789616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.789999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.790011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.790067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.790115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.790167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.790221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.790259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.790265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.790316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.790367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.790423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.790474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.790528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.790533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.790583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.790632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.790701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.790764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.790800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.790805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.790877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.790936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.790988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.791047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.791084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.791088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.791151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.791197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.791243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.791292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.791341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.791346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.791397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.791445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.791495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.791545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.791580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.791586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.791637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.791685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.791732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.791783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.791833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.791839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.791885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.791932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.791979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.792026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.792061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.792065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.792111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:00.792158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:00.792203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:00.792249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:00.792283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:00.792288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:00.792319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946445:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.792552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554810158946445:10078]
2025-10-02T09:32:00.792608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:00.792617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:00.792629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.792638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1354 reason: error at write: Disconnected sessionId: src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0
2025-10-02T09:32:00.792697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.792820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1354 sessionId: src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0 is DEAD
2025-10-02T09:32:00.792923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:00.792932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Write session will restart in 0.007196s
2025-10-02T09:32:00.792946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Write session: Do CDS request
2025-10-02T09:32:00.792950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.801057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.801185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.801196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1355
2025-10-02T09:32:00.801281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.801306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.801314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.801317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.801646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1355 sessionId:  describe result for acl check
2025-10-02T09:32:00.801673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.801678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.801680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.801684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158946596:5090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.801777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.802100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158946596:5090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.803243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.803359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.803367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.803375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.803406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.803430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083408023:8568]
2025-10-02T09:32:00.804069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.804228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.804243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158946596:5090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.804252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.804542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.804576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.804580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.804581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.804581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.804582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.804582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.804583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.804583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.804584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.804584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.804585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.804586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.804588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.804595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.804597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.804599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.804601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.804603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.804605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.804607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.804609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.804612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.804614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.804616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.804620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.804626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.804631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.804636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.804638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.804643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.804646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.804650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.804653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.804660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.804665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.804668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.804671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.804675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.804677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.804680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.804682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.804686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.804688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.804692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.804694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.804697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.804699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.804701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.804718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.809641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158946596:5090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.809650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158946596:5090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.809652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158946596:5090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.809656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.812345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.813823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.813837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.813839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.813841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.813847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1354 [2:7556554810083408023:8568]
2025-10-02T09:32:00.813856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.813868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.813874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.813876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.813877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.813887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.813893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.813897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.813927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.813932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.813933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.813934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.813936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.813972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.813977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.813983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.813988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.813996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.814012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946636:5090], now have 1 active actors on pipe
2025-10-02T09:32:00.814018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946446:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.814021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.814023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.814024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.814031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.814041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.814044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.814046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.814048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.814051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.814040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1354
2025-10-02T09:32:00.814040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1354
2025-10-02T09:32:00.814053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.814065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.814068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.814070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.814080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.814085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.814112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.814122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.814125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.814128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.814133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.814140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.814152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.814244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.814249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.814257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.814311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1355 partition: 0 MaxSeqNo: 36 sessionId: src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0
2025-10-02T09:32:00.814517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3cd40e-8456cf4f-6dbdae7e-95c5e746_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.816706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Write session: try to update token
2025-10-02T09:32:00.816717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.823807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.823824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.823826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.823828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.823834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.823840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.823842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083408018:8568]
2025-10-02T09:32:00.823868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.823871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.823872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.823879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.823884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.823887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.824230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.828163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId: src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.830179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:00.892963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554810158946661:10078]
2025-10-02T09:32:00.893154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1354, pipe: [1:7556554810158946661:10078]
2025-10-02T09:32:00.939882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:00.940143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.940153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.940177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946661:10078], now have 1 active actors on pipe
2025-10-02T09:32:00.940338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:00.940335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554810158946661:10078]
2025-10-02T09:32:00.940358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:00.940360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:00.940383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:00.940410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1355 reason: error at write: Disconnected sessionId: src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0
2025-10-02T09:32:00.940575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1355 sessionId: src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0 is DEAD
2025-10-02T09:32:00.940709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:00.940714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Write session will restart in 0.007697s
2025-10-02T09:32:00.940728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Write session: Do CDS request
2025-10-02T09:32:00.940731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:00.948681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:00.949077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.949196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:00.949209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1356
2025-10-02T09:32:00.949293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:00.949318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:00.949325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:00.949328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:00.949632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1356 sessionId:  describe result for acl check
2025-10-02T09:32:00.949657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:00.949662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:00.949663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:00.949667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554810158946811:5087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:00.950101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554810158946811:5087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:00.950250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:00.950356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:00.950363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:00.950369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:00.950395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:00.950415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554810083408212:8570]
2025-10-02T09:32:00.950762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:00.951047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:00.951079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:00.951267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:00.951307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.951313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.951314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.951315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.951316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.951316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.951317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.951318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.951319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.951319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.951320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.951321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.951325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.951333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.951337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.951340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.951343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.951346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.951349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.951352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.951355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.951359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.951362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.951365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.951370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.951376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:00.951380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.951383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:00.951385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.951388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:00.951390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.951393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:00.951395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.951398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:00.951400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.951403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:00.951405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.951408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:00.951410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.951412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:00.951415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.951418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:00.951420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.951422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.951424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.951427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.951429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.951432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.951449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:00.951882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554810158946811:5087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:00.956401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554810158946811:5087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:00.956412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554810158946811:5087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:00.956414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554810158946811:5087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:00.956419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:00.958968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:00.960308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:00.960321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:00.960322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:00.960324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:00.960328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1355 [2:7556554810083408212:8570]
2025-10-02T09:32:00.960336Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:00.960345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:00.960350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.960353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.960353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.960363Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:00.960367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:00.960372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:00.960405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.960410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.960411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.960412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:00.960414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:00.960453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:00.960458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.960464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:00.960470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:00.960479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:00.960493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946850:5087], now have 1 active actors on pipe
2025-10-02T09:32:00.960498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554810158946662:2446], now have 1 active actors on pipe
2025-10-02T09:32:00.960502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.960503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.960504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.960511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:00.960521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:00.960523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:00.960514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1355
2025-10-02T09:32:00.960525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:00.960524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1355
2025-10-02T09:32:00.960526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:00.960529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:00.960530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:00.960547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.960552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:00.960554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:00.960565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.960571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.960603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:00.960613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:00.960616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:00.960619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:00.960627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:00.960638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:00.960665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.960759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:00.960765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:00.960773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:00.960841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1356 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0
2025-10-02T09:32:00.961050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45413e5-921c9118-5a67b9c1-cbb2f245_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:00.963228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Write session: try to update token
2025-10-02T09:32:00.963237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:00.970144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:00.970160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:00.970162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:00.970163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:00.970168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.970170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.970172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554810083408207:8570]
2025-10-02T09:32:00.970198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:00.970201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:00.970203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:00.970212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:00.970217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:00.970226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:00.970314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:00.974470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId: src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:00.976490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.040423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453914154:10078]
2025-10-02T09:32:01.040603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1355, pipe: [1:7556554814453914154:10078]
2025-10-02T09:32:01.086478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.086665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.086674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.086698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914154:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.086851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.086902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453914154:10078]
2025-10-02T09:32:01.086926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.086927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:01.086982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1356 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0
2025-10-02T09:32:01.087131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1356 sessionId: src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0 is DEAD
2025-10-02T09:32:01.087265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:01.087271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Write session will restart in 0.008889s
2025-10-02T09:32:01.087286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Write session: Do CDS request
2025-10-02T09:32:01.087290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.095845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.097087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.097211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.097224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1357
2025-10-02T09:32:01.097321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.097347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.097354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.097357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.097346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.097454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.097461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.097467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.097494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.097517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378375696:8573]
2025-10-02T09:32:01.097658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1357 sessionId:  describe result for acl check
2025-10-02T09:32:01.097685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.097690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.097691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.097694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453914305:5079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.097877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.098046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453914305:5079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.098051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.098075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.098269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.098303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.098307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.098308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.098308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.098309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.098309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.098311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.098311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.098312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.098312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.098315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.098320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.098323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.098325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.098327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.098329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.098331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.098333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.098335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.098337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.098339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.098341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.098344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.098348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.098352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.098354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.098357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.098360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.098362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.098365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.098367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.098370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.098372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.098374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.098376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.098380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.098382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.098384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.098387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.098389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.098391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.098393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.098395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.098398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.098400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.098402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.098422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.099761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453914305:5079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.103751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453914305:5079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.103759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453914305:5079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.103762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453914305:5079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.103765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:01.105943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:01.107456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:01.107470Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:01.107471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:01.107474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:01.107479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1356 [2:7556554814378375696:8573]
2025-10-02T09:32:01.107486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:01.107496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:01.107501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.107502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.107504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.107512Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:01.107515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:01.107520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:01.107550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.107555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.107556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.107558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:01.107559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:01.107595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:01.107600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.107608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.107613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.107621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:01.107632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914344:5079], now have 1 active actors on pipe
2025-10-02T09:32:01.107637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914155:2446], now have 1 active actors on pipe
2025-10-02T09:32:01.107641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.107642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.107643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.107650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:01.107657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:01.107664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:01.107666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:01.107668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:01.107665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1356
2025-10-02T09:32:01.107669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:01.107666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1356
2025-10-02T09:32:01.107670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:01.107682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.107684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:01.107696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:01.107697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.107699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.107719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43322800-e43b7410-158fec70-b3251d24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:01.107726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.107728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.107730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:01.107734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.107738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:01.107747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.107847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.107854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.107863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.107927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1357 partition: 0 MaxSeqNo: 36 sessionId: src_id|43322800-e43b7410-158fec70-b3251d24_0
2025-10-02T09:32:01.108120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba246c10-34598664-f0cddf6d-50a9eafe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43322800-e43b7410-158fec70-b3251d24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:01.110304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Write session: try to update token
2025-10-02T09:32:01.110314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:01.117543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:01.117560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:01.117561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:01.117562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:01.117568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.117570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.117573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378375691:8573]
2025-10-02T09:32:01.117599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:01.117604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.117605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:01.117608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:01.117612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:01.117617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:01.117738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:01.121236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId: src_id|43322800-e43b7410-158fec70-b3251d24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:01.123298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.186854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453914364:10078]
2025-10-02T09:32:01.186991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1356, pipe: [1:7556554814453914364:10078]
2025-10-02T09:32:01.235306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.235621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.235631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.235656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914364:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.235810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.235817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:01.235831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:01.235882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1357 reason: error at write: Disconnected sessionId: src_id|43322800-e43b7410-158fec70-b3251d24_0
2025-10-02T09:32:01.235922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.235964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453914364:10078]
2025-10-02T09:32:01.236325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1357 sessionId: src_id|43322800-e43b7410-158fec70-b3251d24_0 is DEAD
2025-10-02T09:32:01.236494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:01.236502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Write session will restart in 0.008616s
2025-10-02T09:32:01.236521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Write session: Do CDS request
2025-10-02T09:32:01.236525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.244890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.246149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.246341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.246412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.246422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1358
2025-10-02T09:32:01.246445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.246452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.246459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.246483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.246504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.246510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378375924:8588]
2025-10-02T09:32:01.246522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.246528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.246531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.246829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1358 sessionId:  describe result for acl check
2025-10-02T09:32:01.246856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.246861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.246862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.246866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453914528:5063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.246901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.247090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.247119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.247205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453914528:5063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.247334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.247367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.247372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.247372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.247373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.247373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.247374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.247374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.247375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.247375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.247376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.247376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.247377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.247380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.247386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.247388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.247390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.247392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.247394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.247396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.247398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.247400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.247402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.247404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.247406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.247410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.247414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.247417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.247420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.247424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.247427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.247429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.247432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.247434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.247437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.247440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.247442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.247445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.247447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.247450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.247455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.247458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.247460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.247462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.247465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.247467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.247470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.247472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.247474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.247491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.248679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453914528:5063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.252817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453914528:5063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.252826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453914528:5063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.252828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453914528:5063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.252832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:01.255008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:01.256524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:01.256536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:01.256537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:01.256540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:01.256543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1357 [2:7556554814378375924:8588]
2025-10-02T09:32:01.256550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:01.256560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:01.256563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.256564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.256565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.256574Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:01.256582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:01.256586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:01.256617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.256622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.256623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.256625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:01.256626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:01.256663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:01.256668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.256675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.256680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.256695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:01.256711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914377:2446], now have 1 active actors on pipe
2025-10-02T09:32:01.256716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914565:5063], now have 1 active actors on pipe
2025-10-02T09:32:01.256720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.256721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.256723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.256730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:01.256738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:01.256743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:01.256745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:01.256746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:01.256747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:01.256749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:01.256762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.256767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:01.256771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:01.256759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1357
2025-10-02T09:32:01.256765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1357
2025-10-02T09:32:01.256787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.256792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.256822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:01.256829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.256831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.256832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:01.256837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.256842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:01.256853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.256949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.256959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.256970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.257031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1358 partition: 0 MaxSeqNo: 36 sessionId: src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0
2025-10-02T09:32:01.257235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43322800-e43b7410-158fec70-b3251d24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:01.259414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Write session: try to update token
2025-10-02T09:32:01.259426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:01.266298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:01.266314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:01.266315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:01.266316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:01.266321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.266323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.266325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378375919:8588]
2025-10-02T09:32:01.266346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:01.266350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.266351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:01.266351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:01.266355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:01.266360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:01.266459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:01.269839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId: src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:01.271776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.336362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453914574:10078]
2025-10-02T09:32:01.336514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1357, pipe: [1:7556554814453914574:10078]
2025-10-02T09:32:01.386545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.386853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.386863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.386889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914574:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.387023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.387042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453914574:10078]
2025-10-02T09:32:01.387059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.387064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:01.387111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1358 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0
2025-10-02T09:32:01.387236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1358 sessionId: src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0 is DEAD
2025-10-02T09:32:01.387371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:01.387377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Write session will restart in 0.008286s
2025-10-02T09:32:01.387390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Write session: Do CDS request
2025-10-02T09:32:01.387394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.396042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.396095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.396246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.396258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1359
2025-10-02T09:32:01.396362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.396388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.396397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.396400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.396687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1359 sessionId:  describe result for acl check
2025-10-02T09:32:01.396711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.396715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.396716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.396719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453914728:5058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.397078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453914728:5058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.397608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.397705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.397712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.397717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.397742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.397766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378376114:8590]
2025-10-02T09:32:01.398124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.398279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.398301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.398490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.398522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.398526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.398526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.398527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.398527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.398528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.398529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.398529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.398530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.398530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.398530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.398531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.398534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.398540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.398542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.398544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.398546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.398548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.398550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.398552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.398554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.398556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.398558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.398560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.398563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.398570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.398575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.398580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.398584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.398589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.398593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.398597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.398601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.398603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.398605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.398608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.398610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.398613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.398616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.398619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.398621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.398624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.398626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.398628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.398635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.398637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.398640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.398643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.398660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.398784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453914728:5058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.403443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453914728:5058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.403453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453914728:5058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.403455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453914728:5058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.403459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:01.406093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:01.407585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:01.407598Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:01.407599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:01.407601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:01.407605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1358 [2:7556554814378376114:8590]
2025-10-02T09:32:01.407612Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:01.407621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:01.407623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.407624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.407625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.407635Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:01.407642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:01.407646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:01.407677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.407682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.407683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.407684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:01.407686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:01.407723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:01.407728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.407735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.407740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.407750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:01.407764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914576:2446], now have 1 active actors on pipe
2025-10-02T09:32:01.407769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914767:5058], now have 1 active actors on pipe
2025-10-02T09:32:01.407773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.407774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.407776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.407784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:01.407796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:01.407799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:01.407805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:01.407806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:01.407811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:01.407813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:01.407800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1358
2025-10-02T09:32:01.407807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1358
2025-10-02T09:32:01.407833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.407841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:01.407846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:01.407850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.407852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.407873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f2070-8f0a3931-c3841626-7517390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:01.407880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.407883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.407884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:01.407889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.407896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:01.407908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.408009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.408014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.408022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.408081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1359 partition: 0 MaxSeqNo: 36 sessionId: src_id|59f2070-8f0a3931-c3841626-7517390_0
2025-10-02T09:32:01.408286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57b5ed9-d53ba4fd-4f8782a7-8e54b276_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59f2070-8f0a3931-c3841626-7517390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:01.410453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Write session: try to update token
2025-10-02T09:32:01.410463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:01.417204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:01.417223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:01.417224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:01.417226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:01.417231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.417233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.417236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378376109:8590]
2025-10-02T09:32:01.417257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:01.417261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.417262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:01.417262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:01.417265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:01.417270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:01.417381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:01.420748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId: src_id|59f2070-8f0a3931-c3841626-7517390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:01.422739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.487401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453914774:10078]
2025-10-02T09:32:01.487634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1358, pipe: [1:7556554814453914774:10078]
2025-10-02T09:32:01.535869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.536166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.536174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.536199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914774:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.536314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.536364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:01.536370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453914774:10078]
2025-10-02T09:32:01.536379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:01.536382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.536432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1359 reason: error at write: Disconnected sessionId: src_id|59f2070-8f0a3931-c3841626-7517390_0
2025-10-02T09:32:01.536543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1359 sessionId: src_id|59f2070-8f0a3931-c3841626-7517390_0 is DEAD
2025-10-02T09:32:01.536635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:01.536641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Write session will restart in 0.005008s
2025-10-02T09:32:01.536658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Write session: Do CDS request
2025-10-02T09:32:01.536661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.542105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.542197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.542208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1360
2025-10-02T09:32:01.542293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.542326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.542335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.542341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.542701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1360 sessionId:  describe result for acl check
2025-10-02T09:32:01.542726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.542731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.542733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.542738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453914848:5045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.543180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453914848:5045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.545200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453914848:5045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.545628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.547188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.547291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.547297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.547303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.547329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.547352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378376305:8592]
2025-10-02T09:32:01.547411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453914848:5045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.547421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453914848:5045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.547423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453914848:5045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.547426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:01.547687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.547850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.547874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.548053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.548080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.548085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.548085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.548086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.548086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.548087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.548087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.548088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.548088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.548089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.548089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.548090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.548093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.548099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.548101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.548103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.548105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.548107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.548109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.548111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.548113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.548115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.548117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.548119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.548123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.548127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.548130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.548133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.548135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.548137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.548139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.548142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.548144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.548147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.548149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.548151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.548153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.548156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.548158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.548161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.548163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.548166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.548168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.548170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.548172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.548175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.548177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.548180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.548197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.555777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:01.557147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:01.557160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:01.557161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:01.557163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:01.557167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1359 [2:7556554814378376305:8592]
2025-10-02T09:32:01.557173Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:01.557182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:01.557185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.557187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.557188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.557197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:01.557203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:01.557207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:01.557235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.557240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.557241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.557243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:01.557244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:01.557279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:01.557285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.557291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.557297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.557314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:01.557333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914779:2446], now have 1 active actors on pipe
2025-10-02T09:32:01.557340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914966:5045], now have 1 active actors on pipe
2025-10-02T09:32:01.557344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.557346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.557347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.557355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:01.557366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:01.557368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:01.557370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:01.557371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:01.557377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:01.557379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:01.557367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1359
2025-10-02T09:32:01.557392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.557397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:01.557399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:01.557398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1359
2025-10-02T09:32:01.557407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.557412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.557439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca35ef-93c82050-91654533-72fefa99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:01.557446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.557448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.557449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:01.557454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.557464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:01.557476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.557598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.557603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.557611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.557666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1360 partition: 0 MaxSeqNo: 36 sessionId: src_id|eca35ef-93c82050-91654533-72fefa99_0
2025-10-02T09:32:01.557904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f2070-8f0a3931-c3841626-7517390_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eca35ef-93c82050-91654533-72fefa99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:01.560246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Write session: try to update token
2025-10-02T09:32:01.560258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:01.568057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:01.568073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:01.568074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:01.568075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:01.568081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.568085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.568087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378376300:8592]
2025-10-02T09:32:01.568110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:01.568114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.568116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:01.568119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:01.568122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:01.568124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:01.568232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:01.571871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId: src_id|eca35ef-93c82050-91654533-72fefa99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:01.573828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.636396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453914978:10078]
2025-10-02T09:32:01.636619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1359, pipe: [1:7556554814453914978:10078]
2025-10-02T09:32:01.685745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.686187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.686197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.686222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914978:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.686370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.686419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.686440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453914978:10078]
2025-10-02T09:32:01.686457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:01.686522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eca35ef-93c82050-91654533-72fefa99_0
2025-10-02T09:32:01.686689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1360 sessionId: src_id|eca35ef-93c82050-91654533-72fefa99_0 is DEAD
2025-10-02T09:32:01.686877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:01.686887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Write session will restart in 0.008543s
2025-10-02T09:32:01.686908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Write session: Do CDS request
2025-10-02T09:32:01.686913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.696200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.696220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.696315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.696329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1361
2025-10-02T09:32:01.696432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.696458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.696466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.696470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.696771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1361 sessionId:  describe result for acl check
2025-10-02T09:32:01.696795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.696809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.696810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.696813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453915133:5042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.697161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453915133:5042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.697781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.697876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.697883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.697889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.697914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.697936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378376497:8594]
2025-10-02T09:32:01.698289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.698464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.698487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.698663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.698693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.698685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453915133:5042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.698697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.698698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.698698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.698699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.698700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.698700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.698701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.698701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.698702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.698702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.698703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.698706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.698711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.698713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.698715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.698717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.698720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.698721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.698723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.698725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.698727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.698729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.698731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.698735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.698739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.698743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.698745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.698747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.698750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.698753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.698756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.698758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.698761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.698763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.698767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.698769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.698771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.698773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.698776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.698778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.698781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.698783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.698785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.698787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.698790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.698792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.698794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.698811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.702644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453915133:5042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.702654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453915133:5042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.702658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453915133:5042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.702663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:01.706244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:01.707812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:01.707825Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:01.707826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:01.707828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:01.707832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1360 [2:7556554814378376497:8594]
2025-10-02T09:32:01.707838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:01.707848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:01.707850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.707851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.707852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.707862Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:01.707868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:01.707872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:01.707905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.707910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.707911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.707913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:01.707914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:01.707949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:01.707953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.707960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.707965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.707975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:01.707988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.707992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.707993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.707998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:01.708004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:01.708006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453914979:2446], now have 1 active actors on pipe
2025-10-02T09:32:01.708009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915173:5042], now have 1 active actors on pipe
2025-10-02T09:32:01.708013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:01.708014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:01.708015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:01.708026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:01.708028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:01.708047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.708058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:01.708069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:01.708054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1360
2025-10-02T09:32:01.708058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1360
2025-10-02T09:32:01.708091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.708098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.708118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:01.708135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.708142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.708143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:01.708150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.708156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:01.708168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.708273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.708280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.708289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.708350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1361 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0
2025-10-02T09:32:01.708662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca35ef-93c82050-91654533-72fefa99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:01.710954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Write session: try to update token
2025-10-02T09:32:01.710968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:01.717708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:01.717727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:01.717729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:01.717730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:01.717736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.717738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.717741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378376491:8594]
2025-10-02T09:32:01.717767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:01.717772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.717774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:01.717777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:01.717781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:01.717783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:01.717884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:01.722863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId: src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:01.724870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.786404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453915180:10078]
2025-10-02T09:32:01.786603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1360, pipe: [1:7556554814453915180:10078]
2025-10-02T09:32:01.834256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.834468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.834477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.834503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915180:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.834690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.834690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:01.834693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:01.834735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453915180:10078]
2025-10-02T09:32:01.834745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1361 reason: error at write: Disconnected sessionId: src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0
2025-10-02T09:32:01.834793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.834901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1361 sessionId: src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0 is DEAD
2025-10-02T09:32:01.835024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:01.835029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Write session will restart in 0.008811s
2025-10-02T09:32:01.835046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Write session: Do CDS request
2025-10-02T09:32:01.835050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.844616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.845154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.845261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.845272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1362
2025-10-02T09:32:01.845346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.845366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.845372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.845375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.845686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1362 sessionId:  describe result for acl check
2025-10-02T09:32:01.845713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.845717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.845718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.845721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453915355:5032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.846059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453915355:5032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.846158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.846257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.846264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.846270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.846296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.846317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378376701:8597]
2025-10-02T09:32:01.846661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.846835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.846858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.847047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.847081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.847085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.847086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.847087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.847087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.847088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.847088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.847089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.847089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.847090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.847090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.847090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.847093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.847099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.847101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.847104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.847106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.847108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.847110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.847114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.847117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.847121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.847124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.847127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.847133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.847139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.847146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.847151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.847159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.847164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.847172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.847176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.847184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.847186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.847188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.847191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.847195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.847198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.847200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.847202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.847204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.847207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.847209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.847213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.847218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.847226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.847229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.847236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.847265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.847726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453915355:5032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.853113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453915355:5032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.853123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453915355:5032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.853125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453915355:5032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.853130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:01.854811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:01.856169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:01.856183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:01.856185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:01.856188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:01.856192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1361 [2:7556554814378376701:8597]
2025-10-02T09:32:01.856199Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:01.856210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:01.856212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.856213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.856214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.856223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:01.856226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:01.856230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:01.856261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.856266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.856267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.856269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:01.856270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:01.856350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:01.856355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.856362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.856367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.856378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:01.856374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1361
2025-10-02T09:32:01.856377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1361
2025-10-02T09:32:01.856392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915394:5032], now have 1 active actors on pipe
2025-10-02T09:32:01.856397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915200:2446], now have 1 active actors on pipe
2025-10-02T09:32:01.856400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.856401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.856403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.856408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:01.856415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:01.856415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:01.856417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:01.856418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:01.856426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:01.856428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:01.856453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.856458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.856465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.856473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:01.856480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:01.856490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:01.856494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:01.856496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:01.856497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:01.856502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:01.856511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:01.856525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.856611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.856616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.856624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:01.856679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1362 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0
2025-10-02T09:32:01.856902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6778cd-318a34d0-eb0af229-bae795e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:01.859053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Write session: try to update token
2025-10-02T09:32:01.859063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:01.865874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:01.865889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:01.865891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:01.865892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:01.865897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.865900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.865903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378376696:8597]
2025-10-02T09:32:01.865924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:01.865927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.865928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:01.865929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:01.865931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:01.865934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:01.866042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:01.869514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId: src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:01.871392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:01.934905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554814453915405:10078]
2025-10-02T09:32:01.935113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1361, pipe: [1:7556554814453915405:10078]
2025-10-02T09:32:01.983146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:01.983593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:01.983604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:01.983631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915405:10078], now have 1 active actors on pipe
2025-10-02T09:32:01.983767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:01.983815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:01.983836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554814453915405:10078]
2025-10-02T09:32:01.983853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:01.983911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0
2025-10-02T09:32:01.984056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1362 sessionId: src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0 is DEAD
2025-10-02T09:32:01.984212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:01.984221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Write session will restart in 0.006776s
2025-10-02T09:32:01.984236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Write session: Do CDS request
2025-10-02T09:32:01.984240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:01.992167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.992297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:01.992305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1363
2025-10-02T09:32:01.992392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:01.992410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:01.992413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:01.992417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:01.992679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1363 sessionId:  describe result for acl check
2025-10-02T09:32:01.992704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:01.992705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:01.992707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:01.992710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554814453915560:5029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:01.993055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554814453915560:5029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:01.993159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:01.994531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:01.994625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:01.994632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:01.994638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:01.994664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:01.994686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554814378376896:8600]
2025-10-02T09:32:01.994733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554814453915560:5029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:01.995031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:01.995194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:01.995216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:01.995389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:01.995421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.995425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.995425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.995426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.995426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.995427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.995427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.995428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.995428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.995429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.995429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.995430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.995432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.995438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.995440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.995442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.995444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.995446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.995448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.995450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.995452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.995455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.995457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.995458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.995462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.995466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:01.995469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.995472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:01.995474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.995477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:01.995479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.995481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:01.995483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.995486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:01.995488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.995490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:01.995493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.995495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:01.995497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.995500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:01.995502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.995505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:01.995507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.995509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:01.995513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.995516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:01.995518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.995520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:01.995536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:01.999348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554814453915560:5029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:01.999360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554814453915560:5029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:01.999362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554814453915560:5029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:01.999366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.002913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.004332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.004343Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.004345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.004346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.004350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1362 [2:7556554814378376896:8600]
2025-10-02T09:32:02.004356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.004366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.004371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.004373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.004374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.004383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.004388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.004393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.004423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.004428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.004429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.004431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.004432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.004541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.004546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.004553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.004542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1362
2025-10-02T09:32:02.004558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.004549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1362
2025-10-02T09:32:02.004569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.004582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915601:5029], now have 1 active actors on pipe
2025-10-02T09:32:02.004587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554814453915406:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.004598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.004603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.004612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.004616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.004617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.004625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.004634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.004637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.004639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.004640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.004645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.004647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.004655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.004663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.004667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.004670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.004677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.004687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.004707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.004717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.004724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.004727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.004815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.004820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.004829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.004879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1363 partition: 0 MaxSeqNo: 36 sessionId: src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0
2025-10-02T09:32:02.005087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba9b6ef-3fc982ca-d2d7e616-ca05d5bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.007292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Write session: try to update token
2025-10-02T09:32:02.007302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.013679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:02.013692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.013697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.013720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:02.013722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:02.013865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:02.013980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:02.014094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:02.014209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:02.014362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:02.014387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:02.017778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId: src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.019815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.019939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.019952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.019971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:02.020025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:02.022165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.022177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.022179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.022180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.022186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.022189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.022191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554814378376891:8600]
2025-10-02T09:32:02.022212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.022212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.022215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.022217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.022217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.022221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.022330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.083883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748882905:10078]
2025-10-02T09:32:02.084097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1362, pipe: [1:7556554818748882905:10078]
2025-10-02T09:32:02.138755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:02.144691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.144712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.144848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.144899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.144950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.145003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.145041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.145047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.145101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.145155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.145205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.145258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.145297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.145302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.145353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.145401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.145450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.145502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.145537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.145541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.145590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.145639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.145686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.145734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.145769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.145774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.145823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.145871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.145919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.145968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.146002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.146006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.146056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.146103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.146151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.146206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.146246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.146255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.146303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.146347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.146393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.146441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.146474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.146479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.146526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.146573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.146620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.146666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.146700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.146706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.146752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.146798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.146853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.146901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.146934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.146940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.146985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.147033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.147081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.147126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.147161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.147166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.147197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748882905:10078], now have 1 active actors on pipe
2025-10-02T09:32:02.147383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748882905:10078]
2025-10-02T09:32:02.147392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:02.147396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:02.147404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:02.147417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1363 reason: error at write: Disconnected sessionId: src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0
2025-10-02T09:32:02.147575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1363 sessionId: src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0 is DEAD
2025-10-02T09:32:02.147670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:02.147701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:02.147713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Write session will restart in 0.005427s
2025-10-02T09:32:02.147732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Write session: Do CDS request
2025-10-02T09:32:02.147737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:02.154176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.154213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:02.154220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1364
2025-10-02T09:32:02.154346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.154366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:02.154373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:02.154376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:02.154804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1364 sessionId:  describe result for acl check
2025-10-02T09:32:02.154835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:02.154836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:02.154838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:02.154841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554818748883005:5014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:02.155170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554818748883005:5014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:02.156722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:02.156759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554818748883005:5014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:02.158205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:02.158315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:02.158322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:02.158328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:02.158357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:02.158381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554818673344387:8602]
2025-10-02T09:32:02.158424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554818748883005:5014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:02.158433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554818748883005:5014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:02.158435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554818748883005:5014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:02.158438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.158715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:02.158877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:02.158900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:02.159076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:02.159102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.159106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.159106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.159107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.159107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.159108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.159108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.159109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.159109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.159109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.159110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.159111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.159113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.159119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.159121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.159123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.159125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.159127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.159129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.159131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.159133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.159135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.159136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.159138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.159142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.159145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.159149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.159152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.159154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.159157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.159159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.159161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.159164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.159166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.159168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.159171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.159173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.159175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.159177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.159180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.159186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.159189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.159191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.159193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.159196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.159199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.159201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.159204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.159222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:02.166707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.168231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.168243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.168245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.168246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.168250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1363 [2:7556554818673344387:8602]
2025-10-02T09:32:02.168257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.168267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.168269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.168270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.168271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.168280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.168285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.168289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.168319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.168324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.168325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.168327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.168328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.168363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.168367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.168374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.168379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.168388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.168398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.168402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.168404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.168409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.168414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.168416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.168417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748882906:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.168417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.168419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883097:5014], now have 1 active actors on pipe
2025-10-02T09:32:02.168424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.168431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.168433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.168446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.168453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.168466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.168462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1363
2025-10-02T09:32:02.168485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.168491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.168467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1363
2025-10-02T09:32:02.168505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|321293ce-2a07525-6e9a4d71-25d0298b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.168512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.168514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.168515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.168520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.168527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.168537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.168625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.168630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.168637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.168696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1364 partition: 0 MaxSeqNo: 36 sessionId: src_id|321293ce-2a07525-6e9a4d71-25d0298b_0
2025-10-02T09:32:02.168925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2023bc24-cb37ac97-71da24a4-b1081c0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|321293ce-2a07525-6e9a4d71-25d0298b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.171090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Write session: try to update token
2025-10-02T09:32:02.171100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.177742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.177758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.177760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.177762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.177767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.177769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.177772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554818673344382:8602]
2025-10-02T09:32:02.177795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.177798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.177799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.177800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.177800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.177802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.177905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.181523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId: src_id|321293ce-2a07525-6e9a4d71-25d0298b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.183511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.247724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748883134:10078]
2025-10-02T09:32:02.247858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1363, pipe: [1:7556554818748883134:10078]
2025-10-02T09:32:02.294569Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:02.294878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.294890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.294917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883134:10078], now have 1 active actors on pipe
2025-10-02T09:32:02.295084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:02.295120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:02.295122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748883134:10078]
2025-10-02T09:32:02.295139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:02.295196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|321293ce-2a07525-6e9a4d71-25d0298b_0
2025-10-02T09:32:02.295334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1364 sessionId: src_id|321293ce-2a07525-6e9a4d71-25d0298b_0 is DEAD
2025-10-02T09:32:02.295478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:02.295487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Write session will restart in 0.008854s
2025-10-02T09:32:02.295506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Write session: Do CDS request
2025-10-02T09:32:02.295511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:02.303531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:02.305079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:02.305106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.305196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:02.305205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:02.305214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:02.305250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:02.305276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554818673344621:8617]
2025-10-02T09:32:02.305262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:02.305275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1365
2025-10-02T09:32:02.305385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.305408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:02.305417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:02.305421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:02.305637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:02.305724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1365 sessionId:  describe result for acl check
2025-10-02T09:32:02.305748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:02.305752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:02.305753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:02.305756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554818748883295:5011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:02.305801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:02.305824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:02.306012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:02.306044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.306049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.306049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.306049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.306050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.306051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.306051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.306052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.306052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.306053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.306053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.306053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.306056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.306062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.306064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.306066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.306068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.306070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.306072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.306074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.306076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.306078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.306080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.306082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.306085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.306089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.306092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.306095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.306089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554818748883295:5011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:02.306097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.306099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.306102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.306104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.306108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.306110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.306112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.306119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.306121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.306123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.306125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.306128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.306131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.306133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.306135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.306138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.306140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.306143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.306145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.306147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.306166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:02.307809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554818748883295:5011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:02.311446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554818748883295:5011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:02.311455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554818748883295:5011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:02.311457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554818748883295:5011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:02.311460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.313638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.314996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.315009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.315011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.315014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.315019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1364 [2:7556554818673344621:8617]
2025-10-02T09:32:02.315028Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.315039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.315045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.315047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.315048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.315057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.315059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.315063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.315092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.315097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.315098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.315099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.315101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.315201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1364
2025-10-02T09:32:02.315260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.315243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1364
2025-10-02T09:32:02.315268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.315276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.315281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.315291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.315304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883135:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.315311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883331:5011], now have 1 active actors on pipe
2025-10-02T09:32:02.315322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.315328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.315337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.315341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.315343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.315350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.315361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.315362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.315364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.315365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.315371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.315373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.315382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.315387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.315389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.315390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.315395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.315401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.315413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.315421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.315425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.315428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.315540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.315546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.315554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.315615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1365 partition: 0 MaxSeqNo: 36 sessionId: src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0
2025-10-02T09:32:02.315823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321293ce-2a07525-6e9a4d71-25d0298b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.318071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Write session: try to update token
2025-10-02T09:32:02.318081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.324493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:02.324509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.324514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.324540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:02.324675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:02.324774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:02.324794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:02.324928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:02.325049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:02.325201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:02.325227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:02.329153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId: src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.331162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.331300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.331312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.331331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:02.331389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:02.333143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.333154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.333156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.333157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.333163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.333165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.333167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554818673344616:8617]
2025-10-02T09:32:02.333188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.333192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.333194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.333194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.333197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.333201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.333300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.395172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748883340:10078]
2025-10-02T09:32:02.395331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1364, pipe: [1:7556554818748883340:10078]
2025-10-02T09:32:02.444873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:02.450933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.450954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.451076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.451125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.451178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.451228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.451265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.451272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.451323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.451370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.451420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.451471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.451509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.451514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.451563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.451609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.451658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.451705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.451739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.451744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.451793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.451844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.451893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.451943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.451978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.451983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.452035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.452083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.452132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.452179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.452213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.452218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.452265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.452311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.452359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.452408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.452447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.452452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.452500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.452548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.452598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.452647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.452680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.452684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.452735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.452781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.452843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.452892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.452938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.452943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.452988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.453034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.453081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.453128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.453159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.453165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.453208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:02.453252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:02.453297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:02.453344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:02.453377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:02.453382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:02.453411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883340:10078], now have 1 active actors on pipe
2025-10-02T09:32:02.453618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748883340:10078]
2025-10-02T09:32:02.453642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:02.453888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:02.453897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:02.453914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1365 reason: error at write: Disconnected sessionId: src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0
2025-10-02T09:32:02.453993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:02.454061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1365 sessionId: src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0 is DEAD
2025-10-02T09:32:02.454192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:02.454201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Write session will restart in 0.008197s
2025-10-02T09:32:02.454216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Write session: Do CDS request
2025-10-02T09:32:02.454220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:02.462528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:02.463116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.463243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:02.463251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1366
2025-10-02T09:32:02.463330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.463349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:02.463355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:02.463357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:02.463630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1366 sessionId:  describe result for acl check
2025-10-02T09:32:02.463649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:02.463653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:02.463655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:02.463658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554818748883500:5008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:02.463912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:02.463992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554818748883500:5008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:02.464010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:02.464016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:02.464021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:02.464047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:02.464070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554818673344818:8619]
2025-10-02T09:32:02.464410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:02.464548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:02.464570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:02.464743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:02.464770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.464774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.464775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.464775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.464776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.464776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.464777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.464777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.464778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.464778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.464779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.464779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.464782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.464787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.464789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.464792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.464794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.464796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.464797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.464812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.464814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.464816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.464818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.464820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.464824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.464827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.464830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.464833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.464835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.464838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.464840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.464842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.464845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.464847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.464849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.464852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.464854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.464857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.464858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.464861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.464863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.464866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.464868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.464870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.464872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.464876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.464878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.464881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.464897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:02.465594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554818748883500:5008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:02.469696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554818748883500:5008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:02.469705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554818748883500:5008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:02.469707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554818748883500:5008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:02.469722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.472247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.473640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.473652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.473653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.473655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.473658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1365 [2:7556554818673344818:8619]
2025-10-02T09:32:02.473664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.473673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.473675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.473676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.473677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.473684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.473687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.473691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.473718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.473723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.473725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.473726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.473728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.473762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.473768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.473774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.473779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.473790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.473803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883341:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.473809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883539:5008], now have 1 active actors on pipe
2025-10-02T09:32:02.473813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.473817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.473818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.473825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.473835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.473837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.473839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.473841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.473845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.473836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1365
2025-10-02T09:32:02.473846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.473839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1365
2025-10-02T09:32:02.473859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.473863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.473864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.473874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.473879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.473903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.473910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.473912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.473917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.473922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.473930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.473942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.474016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.474020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.474027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.474078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1366 partition: 0 MaxSeqNo: 36 sessionId: src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0
2025-10-02T09:32:02.474269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cef38ca9-4da58fbb-63dbfab9-c83c449b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.476414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Write session: try to update token
2025-10-02T09:32:02.476423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.483117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.483134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.483136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.483137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.483142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.483145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.483147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554818673344813:8619]
2025-10-02T09:32:02.483168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.483172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.483173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.483177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.483180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.483182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.483282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.487405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId: src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.489383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.553910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748883547:10078]
2025-10-02T09:32:02.554084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1365, pipe: [1:7556554818748883547:10078]
2025-10-02T09:32:02.596288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:02.596654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.596664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.596688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883547:10078], now have 1 active actors on pipe
2025-10-02T09:32:02.596840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:02.596866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748883547:10078]
2025-10-02T09:32:02.596890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:02.596895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:02.596946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0
2025-10-02T09:32:02.597095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1366 sessionId: src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0 is DEAD
2025-10-02T09:32:02.597247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:02.597254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Write session will restart in 0.008615s
2025-10-02T09:32:02.597268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Write session: Do CDS request
2025-10-02T09:32:02.597272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:02.606351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:02.607109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.607197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:02.607206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1367
2025-10-02T09:32:02.607281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.607300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:02.607306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:02.607309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:02.607603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1367 sessionId:  describe result for acl check
2025-10-02T09:32:02.607630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:02.607634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:02.607636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:02.607638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554818748883708:5001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:02.607979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554818748883708:5001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:02.607994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:02.608092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:02.608099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:02.608106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:02.608131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:02.608155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554818673345016:8621]
2025-10-02T09:32:02.608503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:02.608681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:02.608703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:02.608924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:02.608963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.608967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.608967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.608968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.608969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.608969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.608970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.608970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.608971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.608971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.608972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.608972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.608975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.608981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.608983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.608988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.608990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.608992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.608994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.608996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.608998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.609000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.609002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.609006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.609010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.609013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.609016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.609018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.609021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.609023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.609026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.609028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.609032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.609034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.609037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.609039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.609041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.609044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.609046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.609048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.609051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.609053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.609055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.609057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.609060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.609062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.609065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.609085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:02.609510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554818748883708:5001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:02.614002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554818748883708:5001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:02.614012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554818748883708:5001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:02.614014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554818748883708:5001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:02.614020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.616704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.618106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.618119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.618121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.618123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.618127Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1366 [2:7556554818673345016:8621]
2025-10-02T09:32:02.618134Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.618144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.618146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.618148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.618149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.618158Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.618161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.618165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.618200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.618205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.618206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.618208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.618209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.618247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.618254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.618261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.618266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.618275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.618286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883747:5001], now have 1 active actors on pipe
2025-10-02T09:32:02.618289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883548:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.618292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.618294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.618295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.618302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.618311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.618317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.618320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.618321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.618321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.618323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.618340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.618346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.618358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.618340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1366
2025-10-02T09:32:02.618340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1366
2025-10-02T09:32:02.618372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.618380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.618397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a106b7-20d9fc99-a23eb321-682e4781_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.618404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.618406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.618407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.618412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.618419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.618426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.618524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.618530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.618537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.618592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1367 partition: 0 MaxSeqNo: 36 sessionId: src_id|31a106b7-20d9fc99-a23eb321-682e4781_0
2025-10-02T09:32:02.618839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77acefcc-945a8fc3-b6d653e6-158956c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31a106b7-20d9fc99-a23eb321-682e4781_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.621011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Write session: try to update token
2025-10-02T09:32:02.621023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.627955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.627985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.627988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.627990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.628000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.628005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.628011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554818673345011:8621]
2025-10-02T09:32:02.628046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.628053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.628056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.628058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.628058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.628060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.628302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.632133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId: src_id|31a106b7-20d9fc99-a23eb321-682e4781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.634147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.697257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748883755:10078]
2025-10-02T09:32:02.697446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1366, pipe: [1:7556554818748883755:10078]
2025-10-02T09:32:02.744971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:02.745395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.745404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.745431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883755:10078], now have 1 active actors on pipe
2025-10-02T09:32:02.745569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:02.745620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748883755:10078]
2025-10-02T09:32:02.745634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:02.745646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:02.745695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1367 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31a106b7-20d9fc99-a23eb321-682e4781_0
2025-10-02T09:32:02.745829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1367 sessionId: src_id|31a106b7-20d9fc99-a23eb321-682e4781_0 is DEAD
2025-10-02T09:32:02.745973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:02.745981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Write session will restart in 0.008966s
2025-10-02T09:32:02.745998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Write session: Do CDS request
2025-10-02T09:32:02.746002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:02.754686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:02.756166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.756214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:02.756249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:02.756258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1368
2025-10-02T09:32:02.756341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:02.756350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:02.756358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.756358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:02.756376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:02.756385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:02.756391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:02.756396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:02.756419Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554818673345227:8624]
2025-10-02T09:32:02.756650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1368 sessionId:  describe result for acl check
2025-10-02T09:32:02.756668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:02.756672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:02.756674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:02.756676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554818748883917:4993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:02.756758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:02.756943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:02.756966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:02.757027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554818748883917:4993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:02.757142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:02.757172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.757176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.757176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.757177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.757177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.757178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.757179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.757179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.757180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.757180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.757181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.757181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.757184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.757190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.757192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.757194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.757196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.757198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.757200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.757202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.757204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.757206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.757208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.757210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.757213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.757217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.757220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.757223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.757225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.757227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.757230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.757232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.757235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.757238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.757240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.757242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.757244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.757247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.757249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.757252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.757254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.757256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.757260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.757263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.757267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.757269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.757271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.757277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.757294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:02.758563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554818748883917:4993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:02.762512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554818748883917:4993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:02.762524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554818748883917:4993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:02.762526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554818748883917:4993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:02.762542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.764662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.766069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.766081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.766082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.766084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.766087Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1367 [2:7556554818673345227:8624]
2025-10-02T09:32:02.766093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.766103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.766104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.766106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.766107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.766115Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.766118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.766122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.766151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.766157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.766158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.766160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.766161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.766194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.766199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.766205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.766211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.766218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.766232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883956:4993], now have 1 active actors on pipe
2025-10-02T09:32:02.766237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883756:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.766241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.766242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.766243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.766250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.766258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.766267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.766268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.766270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.766277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.766268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1367
2025-10-02T09:32:02.766279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.766269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1367
2025-10-02T09:32:02.766282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.766283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.766290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.766296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.766300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.766320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be500306-7ce92dcd-9ef647f6-9855f514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.766327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.766329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.766330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.766335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.766341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.766350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.766469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.766477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.766484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.766544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1368 partition: 0 MaxSeqNo: 36 sessionId: src_id|be500306-7ce92dcd-9ef647f6-9855f514_0
2025-10-02T09:32:02.766739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a106b7-20d9fc99-a23eb321-682e4781_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be500306-7ce92dcd-9ef647f6-9855f514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.768982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Write session: try to update token
2025-10-02T09:32:02.768992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.775468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.775484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.775485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.775486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.775490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.775492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.775495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554818673345222:8624]
2025-10-02T09:32:02.775518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.775524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.775526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.775532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.775536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.775538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.775645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.779335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId: src_id|be500306-7ce92dcd-9ef647f6-9855f514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.781231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.845728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748883982:10078]
2025-10-02T09:32:02.845886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1367, pipe: [1:7556554818748883982:10078]
2025-10-02T09:32:02.889168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:02.889362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.889371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.889395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883982:10078], now have 1 active actors on pipe
2025-10-02T09:32:02.889512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:02.889536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748883982:10078]
2025-10-02T09:32:02.889552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:02.889558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:02.889612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1368 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be500306-7ce92dcd-9ef647f6-9855f514_0
2025-10-02T09:32:02.889744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1368 sessionId: src_id|be500306-7ce92dcd-9ef647f6-9855f514_0 is DEAD
2025-10-02T09:32:02.890054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:02.890063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Write session will restart in 0.009730s
2025-10-02T09:32:02.890078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Write session: Do CDS request
2025-10-02T09:32:02.890081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:02.898828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:02.900311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:02.900410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:02.900417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:02.900423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:02.900454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:02.900481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554818673345427:8626]
2025-10-02T09:32:02.900842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:02.901016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:02.901040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:02.901083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.901199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:02.901209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1369
2025-10-02T09:32:02.901270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:02.901289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:02.901308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:02.901314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:02.901317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:02.901320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.901324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.901325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.901326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.901326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.901327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.901327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.901328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.901328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.901329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.901329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.901330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.901333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.901339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.901341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.901343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.901345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.901347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.901349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.901351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.901353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.901355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.901357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.901359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.901363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.901367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:02.901370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.901373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:02.901375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.901377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:02.901379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.901382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:02.901384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.901387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:02.901389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.901392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:02.901394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.901396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:02.901398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.901401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:02.901403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.901406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:02.901408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.901410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.901412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.901417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.901419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.901425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.901442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:02.901576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1369 sessionId:  describe result for acl check
2025-10-02T09:32:02.901607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:02.901613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:02.901614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:02.901619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554818748884154:4985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:02.901968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554818748884154:4985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:02.903404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554818748884154:4985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:02.907668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554818748884154:4985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:02.907679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554818748884154:4985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:02.907681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554818748884154:4985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:02.907687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:02.908867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:02.910315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:02.910327Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:02.910328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:02.910330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:02.910333Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1368 [2:7556554818673345427:8626]
2025-10-02T09:32:02.910341Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:02.910349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:02.910352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.910354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.910355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.910363Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:02.910370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:02.910375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:02.910405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.910410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.910411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.910413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:02.910414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:02.910459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:02.910464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.910471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:02.910476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:02.910484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:02.910495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748884188:4985], now have 1 active actors on pipe
2025-10-02T09:32:02.910500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748883987:2446], now have 1 active actors on pipe
2025-10-02T09:32:02.910503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.910505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.910506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.910514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:02.910524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:02.910529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:02.910531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:02.910532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:02.910533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:02.910534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:02.910528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1368
2025-10-02T09:32:02.910536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1368
2025-10-02T09:32:02.910546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.910551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:02.910553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:02.910564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.910569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.910587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:02.910594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:02.910596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:02.910597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:02.910602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:02.910610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:02.910621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.910713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:02.910718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:02.910726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:02.910781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1369 partition: 0 MaxSeqNo: 36 sessionId: src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0
2025-10-02T09:32:02.910982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be500306-7ce92dcd-9ef647f6-9855f514_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:02.913079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Write session: try to update token
2025-10-02T09:32:02.913088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:02.919835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:02.919861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:02.919863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:02.919866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:02.919874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.919879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.919884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554818673345422:8626]
2025-10-02T09:32:02.919916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:02.919919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:02.919926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:02.919926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:02.919929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:02.919929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:02.920163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:02.923923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId: src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:02.925895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:02.989608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554818748884195:10078]
2025-10-02T09:32:02.989812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1368, pipe: [1:7556554818748884195:10078]
2025-10-02T09:32:03.034731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.034938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.034946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.034973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554818748884195:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.035090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.035100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:03.035114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:03.035121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554818748884195:10078]
2025-10-02T09:32:03.035136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.035159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1369 reason: error at write: Disconnected sessionId: src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0
2025-10-02T09:32:03.035285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1369 sessionId: src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0 is DEAD
2025-10-02T09:32:03.035405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:03.035413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Write session will restart in 0.006095s
2025-10-02T09:32:03.035432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Write session: Do CDS request
2025-10-02T09:32:03.035436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.042111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.042191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.042200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1370
2025-10-02T09:32:03.042292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.042314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.042322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.042325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.042618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1370 sessionId:  describe result for acl check
2025-10-02T09:32:03.042646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.042650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.042652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.042654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043851578:4978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.043009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043851578:4978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.044693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043851578:4978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.045281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.046910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.047013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.047020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.047025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.047019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043851578:4978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.047029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043851578:4978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.047030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043851578:4978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.047034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.047053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.047074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968312927:8629]
2025-10-02T09:32:03.047440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.047609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.047632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.047804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.047837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.047843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.047844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.047845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.047845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.047846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.047847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.047848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.047849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.047850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.047850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.047851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.047855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.047864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.047868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.047870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.047872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.047874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.047876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.047878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.047880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.047882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.047884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.047886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.047889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.047893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.047896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.047899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.047901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.047904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.047906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.047908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.047911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.047914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.047918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.047920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.047923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.047926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.047928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.047930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.047933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.047936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.047938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.047940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.047943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.047945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.047947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.047950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.047968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.055407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.056824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.056832Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.056833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.056835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.056838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1369 [2:7556554822968312927:8629]
2025-10-02T09:32:03.056846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.056854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.056855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.056857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.056858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.056867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.056870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.056877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.056907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.056911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.056912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.056914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.056916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.056951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.056955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.056961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.056966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.056977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.056991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851493:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.056996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851690:4978], now have 1 active actors on pipe
2025-10-02T09:32:03.056999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.057000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.057002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.057010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.057019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.057027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.057029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.057031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.057034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.057038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.057042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.057044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.057041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1369
2025-10-02T09:32:03.057042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1369
2025-10-02T09:32:03.057058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.057084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.057089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.057102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63f22ed7-70ddb041-71809c0c-885599b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.057109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.057111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.057112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.057117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.057125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.057132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.057245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.057249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.057256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.057308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1370 partition: 0 MaxSeqNo: 36 sessionId: src_id|63f22ed7-70ddb041-71809c0c-885599b3_0
2025-10-02T09:32:03.057481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b59e7619-d1d708a7-14b5f2b3-7bddc1c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63f22ed7-70ddb041-71809c0c-885599b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.059624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Write session: try to update token
2025-10-02T09:32:03.059635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.066152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.066164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.066165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.066166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.066171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.066173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.066175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968312921:8629]
2025-10-02T09:32:03.066198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.066201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.066202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.066204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.066204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.066206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.066397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.070351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId: src_id|63f22ed7-70ddb041-71809c0c-885599b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.072272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:03.135536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554823043851702:10078]
2025-10-02T09:32:03.135756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1369, pipe: [1:7556554823043851702:10078]
2025-10-02T09:32:03.180595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.180904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.180912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.180937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851702:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.181074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.181103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:03.181112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.181116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:03.181149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554823043851702:10078]
2025-10-02T09:32:03.181159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1370 reason: error at write: Disconnected sessionId: src_id|63f22ed7-70ddb041-71809c0c-885599b3_0
2025-10-02T09:32:03.181284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1370 sessionId: src_id|63f22ed7-70ddb041-71809c0c-885599b3_0 is DEAD
2025-10-02T09:32:03.181413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:03.181421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Write session will restart in 0.008147s
2025-10-02T09:32:03.181436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Write session: Do CDS request
2025-10-02T09:32:03.181440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.190105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.190203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.190213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1371
2025-10-02T09:32:03.190290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.190309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.190315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.190318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.190626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1371 sessionId:  describe result for acl check
2025-10-02T09:32:03.190654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.190658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.190660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.190663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043851867:4974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.190761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.191034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043851867:4974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.192155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043851867:4974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.192270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.192360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.192367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.192372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.192396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.192419Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968313127:8631]
2025-10-02T09:32:03.192764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.192971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.192994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.193166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.193196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.193200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.193201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.193201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.193202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.193202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.193203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.193203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.193204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.193204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.193205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.193205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.193208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.193214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.193216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.193218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.193220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.193222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.193224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.193226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.193227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.193230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.193232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.193234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.193237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.193241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.193244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.193247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.193249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.193252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.193254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.193257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.193259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.193262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.193264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.193266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.193268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.193271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.193273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.193276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.193278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.193281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.193283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.193285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.193287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.193290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.193292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.193294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.193310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.197127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043851867:4974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.197141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043851867:4974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.197144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043851867:4974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.197149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.200700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.202090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.202100Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.202101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.202103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.202106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1370 [2:7556554822968313127:8631]
2025-10-02T09:32:03.202113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.202121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.202126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.202128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.202129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.202138Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.202144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.202148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.202177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.202183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.202184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.202185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.202187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.202222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.202227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.202232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.202239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.202250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.202264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851703:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.202269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851907:4974], now have 1 active actors on pipe
2025-10-02T09:32:03.202273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.202274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.202275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.202284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.202298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.202298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.202292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1370
2025-10-02T09:32:03.202300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.202302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1370
2025-10-02T09:32:03.202302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.202313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.202314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.202328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.202333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.202335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.202343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.202347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.202374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b37f6610-32de0603-b687a841-1f8bf1db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.202380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.202382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.202383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.202388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.202394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.202406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.202518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.202523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.202530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.202612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1371 partition: 0 MaxSeqNo: 36 sessionId: src_id|b37f6610-32de0603-b687a841-1f8bf1db_0
2025-10-02T09:32:03.202827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f22ed7-70ddb041-71809c0c-885599b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b37f6610-32de0603-b687a841-1f8bf1db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.205091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Write session: try to update token
2025-10-02T09:32:03.205100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.211598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.211609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.211611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.211612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.211616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.211619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.211621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968313122:8631]
2025-10-02T09:32:03.211642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.211646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.211647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.211647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.211650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.211654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.211751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.215685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId: src_id|b37f6610-32de0603-b687a841-1f8bf1db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.217939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:03.281441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554823043851938:10078]
2025-10-02T09:32:03.281607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1370, pipe: [1:7556554823043851938:10078]
2025-10-02T09:32:03.324510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.324971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.324981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.325007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851938:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.325162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.325206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:03.325206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.325219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:03.325248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554823043851938:10078]
2025-10-02T09:32:03.325265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1371 reason: error at write: Disconnected sessionId: src_id|b37f6610-32de0603-b687a841-1f8bf1db_0
2025-10-02T09:32:03.325401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1371 sessionId: src_id|b37f6610-32de0603-b687a841-1f8bf1db_0 is DEAD
2025-10-02T09:32:03.325551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:03.325559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Write session will restart in 0.005652s
2025-10-02T09:32:03.325575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Write session: Do CDS request
2025-10-02T09:32:03.325580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.332103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.332289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.332301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1372
2025-10-02T09:32:03.332398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.332423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.332432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.332435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.332738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1372 sessionId:  describe result for acl check
2025-10-02T09:32:03.332758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.332762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.332764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.332767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043852046:4955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.333216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043852046:4955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.334778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.334927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043852046:4955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.336279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.336393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.336401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.336407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.336439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.336463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968313367:8646]
2025-10-02T09:32:03.336732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043852046:4955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.336741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043852046:4955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.336743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043852046:4955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.336747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.336797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.336939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.336962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.337246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.337283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.337287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.337287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.337288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.337288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.337289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.337289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.337290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.337290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.337291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.337292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.337292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.337295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.337300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.337302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.337305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.337307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.337309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.337311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.337312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.337314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.337316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.337318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.337320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.337324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.337328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.337332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.337334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.337336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.337339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.337341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.337344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.337346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.337348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.337350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.337353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.337355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.337357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.337359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.337362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.337364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.337366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.337368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.337371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.337373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.337375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.337377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.337380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.337401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.344687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.346039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.346051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.346052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.346054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.346058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1371 [2:7556554822968313367:8646]
2025-10-02T09:32:03.346068Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.346079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.346086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.346088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.346090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.346100Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.346106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.346111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.346140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.346144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.346145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.346147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.346148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.346184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.346189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.346195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.346203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.346214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.346228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043851939:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.346233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852139:4955], now have 1 active actors on pipe
2025-10-02T09:32:03.346237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.346239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.346240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.346247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.346257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.346260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.346262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.346263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.346267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.346269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.346262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1371
2025-10-02T09:32:03.346273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1371
2025-10-02T09:32:03.346282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.346286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.346288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.346302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.346307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.346324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93672e4c-5557f337-d0c3336f-340f4329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.346330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.346332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.346333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.346338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.346346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.346357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.346454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.346458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.346466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.346522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1372 partition: 0 MaxSeqNo: 36 sessionId: src_id|93672e4c-5557f337-d0c3336f-340f4329_0
2025-10-02T09:32:03.346741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37f6610-32de0603-b687a841-1f8bf1db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93672e4c-5557f337-d0c3336f-340f4329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.348891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Write session: try to update token
2025-10-02T09:32:03.348901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.355572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.355585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.355586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.355588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.355595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.355598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.355601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968313362:8646]
2025-10-02T09:32:03.355628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.355635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.355639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.355641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.355642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.355644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.355762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.359291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId: src_id|93672e4c-5557f337-d0c3336f-340f4329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.361205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:03.425317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554823043852151:10078]
2025-10-02T09:32:03.425501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1371, pipe: [1:7556554823043852151:10078]
2025-10-02T09:32:03.468941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.469335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.469349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.469382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852151:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.469539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.469558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.469574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:03.469577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:03.469596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554823043852151:10078]
2025-10-02T09:32:03.469629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1372 reason: error at write: Disconnected sessionId: src_id|93672e4c-5557f337-d0c3336f-340f4329_0
2025-10-02T09:32:03.469764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1372 sessionId: src_id|93672e4c-5557f337-d0c3336f-340f4329_0 is DEAD
2025-10-02T09:32:03.469887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:03.469896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Write session will restart in 0.008238s
2025-10-02T09:32:03.469913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Write session: Do CDS request
2025-10-02T09:32:03.469917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.479169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.479239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.479247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1373
2025-10-02T09:32:03.479238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.479343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.479364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.479370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.479373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.479644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1373 sessionId:  describe result for acl check
2025-10-02T09:32:03.479670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.479674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.479675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.479678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043852318:4945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.480159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043852318:4945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.480727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.480839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.480847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.480855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.480895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.480920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968313571:8648]
2025-10-02T09:32:03.481292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.481435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043852318:4945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.481447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.481470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.481656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.481688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.481692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.481692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.481693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.481693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.481694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.481694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.481695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.481695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.481696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.481696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.481697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.481700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.481705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.481708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.481710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.481711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.481713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.481715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.481717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.481719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.481721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.481723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.481725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.481729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.481732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.481736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.481738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.481740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.481743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.481745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.481748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.481750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.481752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.481755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.481757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.481760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.481764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.481766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.481768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.481770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.481773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.481776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.481778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.481783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.481785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.481789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.481791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.481808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.485566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043852318:4945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.485575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043852318:4945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.485577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043852318:4945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.485581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.489166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.490522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.490534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.490536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.490538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.490542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1372 [2:7556554822968313571:8648]
2025-10-02T09:32:03.490552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.490568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.490569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.490571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.490572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.490580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.490584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.490588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.490617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.490621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.490622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.490624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.490625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.490659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.490663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.490669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.490674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.490685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.490698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852152:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.490703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852357:4945], now have 1 active actors on pipe
2025-10-02T09:32:03.490707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.490708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.490710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.490716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.490725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.490732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.490735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.490735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.490736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.490736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.490731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1372
2025-10-02T09:32:03.490736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1372
2025-10-02T09:32:03.490749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.490754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.490756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.490768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.490773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.490790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.490799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.490805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.490807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.490813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.490825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.490842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.490968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.490974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.490984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.491047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1373 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0
2025-10-02T09:32:03.491229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93672e4c-5557f337-d0c3336f-340f4329_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.493358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Write session: try to update token
2025-10-02T09:32:03.493368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.500307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.500322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.500324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.500326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.500334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.500338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.500341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968313566:8648]
2025-10-02T09:32:03.500372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.500373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.500377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.500380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.500384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.500387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.500510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.504210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId: src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.506118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:03.569696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554823043852365:10078]
2025-10-02T09:32:03.569872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1372, pipe: [1:7556554823043852365:10078]
2025-10-02T09:32:03.613287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.613705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.613715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.613741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852365:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.613879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.613929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.613947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554823043852365:10078]
2025-10-02T09:32:03.613964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:03.614016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0
2025-10-02T09:32:03.614152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1373 sessionId: src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0 is DEAD
2025-10-02T09:32:03.614335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:03.614343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Write session will restart in 0.007963s
2025-10-02T09:32:03.614357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Write session: Do CDS request
2025-10-02T09:32:03.614361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.623161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.623269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.623283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1374
2025-10-02T09:32:03.623389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.623433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.623441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.623449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.623757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.623784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1374 sessionId:  describe result for acl check
2025-10-02T09:32:03.623817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.623823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.623824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.623829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043852532:4942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.624309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043852532:4942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.625436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.625549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.625557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.625566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.625608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.625637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968313776:8650]
2025-10-02T09:32:03.625986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.626111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043852532:4942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.626171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.626198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.626385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.626416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.626420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.626421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.626421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.626422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.626423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.626423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.626424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.626424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.626425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.626425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.626426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.626429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.626435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.626437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.626439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.626441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.626443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.626445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.626447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.626449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.626451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.626453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.626455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.626458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.626462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.626465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.626468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.626470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.626473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.626475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.626478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.626480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.626483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.626485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.626489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.626493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.626502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.626505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.626513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.626520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.626528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.626536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.626540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.626546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.626550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.626552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.626554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.626575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.630413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043852532:4942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.630424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043852532:4942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.630426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043852532:4942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.630430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.633982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.635320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.635331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.635332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.635334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.635337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1373 [2:7556554822968313776:8650]
2025-10-02T09:32:03.635345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.635356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.635361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.635363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.635364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.635373Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.635376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.635380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.635412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.635417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.635418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.635420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.635421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.635467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.635474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.635483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.635496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.635513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.635534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852572:4942], now have 1 active actors on pipe
2025-10-02T09:32:03.635537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852366:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.635542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.635544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.635545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.635554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.635565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.635571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.635573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.635575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.635565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1373
2025-10-02T09:32:03.635571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1373
2025-10-02T09:32:03.635581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.635587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.635611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.635618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.635630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.635638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.635649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.635662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d573074-8efc5668-9a623a6a-11776ecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.635668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.635674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.635676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.635682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.635693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.635710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.635827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.635833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.635844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.635925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1374 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d573074-8efc5668-9a623a6a-11776ecd_0
2025-10-02T09:32:03.636196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba69e9ab-fba0b591-c3ba01a-21baf842_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d573074-8efc5668-9a623a6a-11776ecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.638323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Write session: try to update token
2025-10-02T09:32:03.638333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.644835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.644845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.644846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.644847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.644852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.644856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.644858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968313771:8650]
2025-10-02T09:32:03.644882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.644888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.644890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.644897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.644900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.644906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.645036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.649200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId: src_id|7d573074-8efc5668-9a623a6a-11776ecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.651288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:03.714104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554823043852580:10078]
2025-10-02T09:32:03.714301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1373, pipe: [1:7556554823043852580:10078]
2025-10-02T09:32:03.758772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.759062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.759071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.759096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852580:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.759255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.759309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:03.759316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554823043852580:10078]
2025-10-02T09:32:03.759335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.759383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d573074-8efc5668-9a623a6a-11776ecd_0
2025-10-02T09:32:03.759547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1374 sessionId: src_id|7d573074-8efc5668-9a623a6a-11776ecd_0 is DEAD
2025-10-02T09:32:03.759702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:03.759712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Write session will restart in 0.005764s
2025-10-02T09:32:03.759734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Write session: Do CDS request
2025-10-02T09:32:03.759740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.766230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.766349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.766359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1375
2025-10-02T09:32:03.766444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.766465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.766471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.766474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.766826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1375 sessionId:  describe result for acl check
2025-10-02T09:32:03.766848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.766853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.766854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.766857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043852681:4929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.767196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043852681:4929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.768887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043852681:4929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.769268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.770666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.770761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.770767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.770772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.770797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.770828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968313994:8653]
2025-10-02T09:32:03.770849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043852681:4929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.770857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043852681:4929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.770859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043852681:4929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.770865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.771166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.771321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.771343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.771519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.771547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.771551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.771552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.771552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.771553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.771553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.771554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.771555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.771555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.771556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.771556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.771557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.771559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.771565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.771567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.771569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.771571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.771573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.771575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.771577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.771579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.771581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.771583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.771585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.771589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.771592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.771596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.771599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.771601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.771603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.771605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.771608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.771611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.771614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.771616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.771619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.771622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.771625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.771627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.771630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.771632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.771634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.771636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.771639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.771645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.771647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.771649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.771652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.771668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.779041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.780403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.780413Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.780414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.780417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.780420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1374 [2:7556554822968313994:8653]
2025-10-02T09:32:03.780427Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.780436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.780441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.780443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.780444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.780452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.780455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.780459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.780488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.780492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.780493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.780495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.780497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.780531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.780536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.780543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.780560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.780573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.780585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852784:4929], now have 1 active actors on pipe
2025-10-02T09:32:03.780587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852581:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.780590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.780592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.780593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.780601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.780609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.780608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1374
2025-10-02T09:32:03.780616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.780608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1374
2025-10-02T09:32:03.780616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.780618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.780620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.780621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.780635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.780637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.780639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.780649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.780655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.780720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f911423-9d259148-f3c8b7dd-848d59f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.780726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.780728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.780730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.780735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.780740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.780755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.780870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.780875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.780882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.780953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1375 partition: 0 MaxSeqNo: 36 sessionId: src_id|f911423-9d259148-f3c8b7dd-848d59f1_0
2025-10-02T09:32:03.781219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d573074-8efc5668-9a623a6a-11776ecd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f911423-9d259148-f3c8b7dd-848d59f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.783951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Write session: try to update token
2025-10-02T09:32:03.783965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.789723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.789734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.789735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.789736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.789740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.789742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.789744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968313989:8653]
2025-10-02T09:32:03.789765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.789768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.789767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.789769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.789770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.789772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.789872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.796430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId: src_id|f911423-9d259148-f3c8b7dd-848d59f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.798409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:03.859472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554823043852815:10078]
2025-10-02T09:32:03.859619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1374, pipe: [1:7556554823043852815:10078]
2025-10-02T09:32:03.901204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:03.901616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.901626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.901638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852815:10078], now have 1 active actors on pipe
2025-10-02T09:32:03.901756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:03.901792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:03.901797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:03.901802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:03.901837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554823043852815:10078]
2025-10-02T09:32:03.901845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1375 reason: error at write: Disconnected sessionId: src_id|f911423-9d259148-f3c8b7dd-848d59f1_0
2025-10-02T09:32:03.901969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1375 sessionId: src_id|f911423-9d259148-f3c8b7dd-848d59f1_0 is DEAD
2025-10-02T09:32:03.902171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:03.902187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Write session will restart in 0.008405s
2025-10-02T09:32:03.902209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Write session: Do CDS request
2025-10-02T09:32:03.902215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:03.911109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:03.911274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.911267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:03.911276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1376
2025-10-02T09:32:03.911502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:03.911522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:03.911528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:03.911530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:03.911812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1376 sessionId:  describe result for acl check
2025-10-02T09:32:03.911835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:03.911841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:03.911842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:03.911845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554823043852988:4928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:03.912190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554823043852988:4928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:03.912604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:03.912693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:03.912700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:03.912705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:03.912729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:03.912750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554822968314201:8655]
2025-10-02T09:32:03.913093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:03.913280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:03.913302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:03.913473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:03.913501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.913505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.913505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.913506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.913507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.913507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.913508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.913508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.913509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.913509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.913510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.913510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.913513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.913519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.913521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.913523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.913525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.913527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.913529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.913531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.913533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.913536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.913538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.913540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.913543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.913547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:03.913550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.913553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:03.913555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.913558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:03.913560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.913562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:03.913565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.913567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:03.913569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.913572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:03.913574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.913577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:03.913579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.913581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:03.913584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.913588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:03.913593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.913596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.913598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.913600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.913602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.913608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.913604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554823043852988:4928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:03.913625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:03.918493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554823043852988:4928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:03.918503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554823043852988:4928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:03.918505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554823043852988:4928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:03.918513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:03.921213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:03.922598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:03.922608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:03.922609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:03.922611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:03.922616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1375 [2:7556554822968314201:8655]
2025-10-02T09:32:03.922624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:03.922634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:03.922635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.922637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.922638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.922648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:03.922651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:03.922656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:03.922687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.922693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.922694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.922696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:03.922697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:03.922731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:03.922736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.922743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:03.922751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:03.922763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:03.922776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.922780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.922782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.922786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:03.922794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043852819:2446], now have 1 active actors on pipe
2025-10-02T09:32:03.922796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:03.922799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:03.922800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554823043853027:4928], now have 1 active actors on pipe
2025-10-02T09:32:03.922801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:03.922805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:03.922812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:03.922826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:03.922844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.922838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1375
2025-10-02T09:32:03.922852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:03.922841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1375
2025-10-02T09:32:03.922867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:03.922876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.922878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.922893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54c763d-7623484a-cb1ff3dd-143f866f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:03.922900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:03.922902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:03.922904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:03.922909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:03.922917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:03.922927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.923023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:03.923028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:03.923035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:03.923083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1376 partition: 0 MaxSeqNo: 36 sessionId: src_id|54c763d-7623484a-cb1ff3dd-143f866f_0
2025-10-02T09:32:03.923309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f911423-9d259148-f3c8b7dd-848d59f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54c763d-7623484a-cb1ff3dd-143f866f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:03.925732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Write session: try to update token
2025-10-02T09:32:03.925745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:03.932549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:03.932562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:03.932564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:03.932565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:03.932571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.932573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.932575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554822968314196:8655]
2025-10-02T09:32:03.932596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:03.932599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:03.932600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:03.932616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:03.932629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:03.932632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:03.932766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:03.936474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId: src_id|54c763d-7623484a-cb1ff3dd-143f866f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:03.938666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.001846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338820330:10078]
2025-10-02T09:32:04.002043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1375, pipe: [1:7556554827338820330:10078]
2025-10-02T09:32:04.049480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.049672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.049680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.049706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820330:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.049844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.049881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338820330:10078]
2025-10-02T09:32:04.049887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:04.049911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.049941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54c763d-7623484a-cb1ff3dd-143f866f_0
2025-10-02T09:32:04.050088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1376 sessionId: src_id|54c763d-7623484a-cb1ff3dd-143f866f_0 is DEAD
2025-10-02T09:32:04.050215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:04.050224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Write session will restart in 0.008763s
2025-10-02T09:32:04.050242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Write session: Do CDS request
2025-10-02T09:32:04.050246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.059333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.060200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.060335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.060347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1377
2025-10-02T09:32:04.060444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.060465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.060472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.060474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.060768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1377 sessionId:  describe result for acl check
2025-10-02T09:32:04.060793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.060809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.060811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.060814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338820502:4923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.060848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.060943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.060950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.060956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.060980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.061003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263281707:8658]
2025-10-02T09:32:04.061155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338820502:4923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.061345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.061507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.061529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.061703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.061731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.061735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.061735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.061736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.061736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.061737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.061737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.061738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.061738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.061739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.061739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.061740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.061743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.061748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.061750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.061753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.061754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.061756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.061758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.061760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.061762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.061764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.061766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.061768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.061772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.061775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.061778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.061781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.061783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.061786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.061788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.061794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.061797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.061800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.061802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.061804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.061807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.061809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.061812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.061815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.061820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.061823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.061825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.061828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.061830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.061832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.061834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.061837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.061855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.062611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338820502:4923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.067662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338820502:4923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.067672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338820502:4923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.067674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338820502:4923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.067678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.069341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.070830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.070839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.070841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.070843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.070847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1376 [2:7556554827263281707:8658]
2025-10-02T09:32:04.070855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.070865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.070866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.070868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.070869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.070878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.070884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.070889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.070921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.070926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.070927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.070929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.070930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.070972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.070976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.070983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.070988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.070999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.071014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820541:4923], now have 1 active actors on pipe
2025-10-02T09:32:04.071019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820332:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.071023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.071024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.071025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.071033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.071045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.071045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.071048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.071049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.071055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.071046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1376
2025-10-02T09:32:04.071057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.071046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1376
2025-10-02T09:32:04.071073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.071077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.071079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.071090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.071094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.071271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|498498a4-46b537df-56378677-9f9b042d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.071279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.071281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.071282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.071288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.071294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.071310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.071418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.071424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.071432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.071489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1377 partition: 0 MaxSeqNo: 36 sessionId: src_id|498498a4-46b537df-56378677-9f9b042d_0
2025-10-02T09:32:04.071804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c763d-7623484a-cb1ff3dd-143f866f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|498498a4-46b537df-56378677-9f9b042d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.073939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Write session: try to update token
2025-10-02T09:32:04.073952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.080630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.080644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.080646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.080647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.080652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.080656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.080658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263281702:8658]
2025-10-02T09:32:04.080681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.080682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.080684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.080685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.080685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.080687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.080819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.084598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId: src_id|498498a4-46b537df-56378677-9f9b042d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.086851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.149803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338820548:10078]
2025-10-02T09:32:04.150023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1376, pipe: [1:7556554827338820548:10078]
2025-10-02T09:32:04.198383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.198588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.198597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.198620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820548:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.198765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.198809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338820548:10078]
2025-10-02T09:32:04.198811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:04.198839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.198894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1377 reason: status is not ok: tablet will be restarted right now sessionId: src_id|498498a4-46b537df-56378677-9f9b042d_0
2025-10-02T09:32:04.199103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1377 sessionId: src_id|498498a4-46b537df-56378677-9f9b042d_0 is DEAD
2025-10-02T09:32:04.199222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:04.199228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Write session will restart in 0.009224s
2025-10-02T09:32:04.199242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Write session: Do CDS request
2025-10-02T09:32:04.199246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.207859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.209205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.209294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.209305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1378
2025-10-02T09:32:04.209379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.209386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.209407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.209413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.209416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.209487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.209493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.209500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.209526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.209551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263281916:8660]
2025-10-02T09:32:04.209691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1378 sessionId:  describe result for acl check
2025-10-02T09:32:04.209716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.209720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.209721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.209724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338820723:4914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.209898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.210068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.210064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338820723:4914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.210091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.210263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.210291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.210296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.210296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.210297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.210297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.210298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.210298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.210299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.210299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.210300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.210300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.210301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.210304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.210309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.210311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.210314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.210316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.210318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.210319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.210321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.210323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.210325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.210327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.210329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.210333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.210337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.210340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.210343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.210345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.210348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.210350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.210353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.210355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.210358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.210360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.210362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.210364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.210367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.210369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.210372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.210374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.210377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.210379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.210381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.210384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.210386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.210388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.210391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.210408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.211582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338820723:4914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.215654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338820723:4914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.215664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338820723:4914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.215666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338820723:4914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.215670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.217856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.219420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.219431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.219432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.219435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.219439Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1377 [2:7556554827263281916:8660]
2025-10-02T09:32:04.219450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.219462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.219464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.219466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.219467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.219477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.219483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.219488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.219522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.219527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.219529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.219531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.219532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.219570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.219576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.219583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.219588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.219596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.219609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820550:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.219615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820762:4914], now have 1 active actors on pipe
2025-10-02T09:32:04.219618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.219619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.219621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.219628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.219639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.219643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.219647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.219648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.219649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.219651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.219649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1377
2025-10-02T09:32:04.219649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1377
2025-10-02T09:32:04.219665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.219670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.219671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.219687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.219693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.219714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.219722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.219724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.219725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.219730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.219736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.219745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.219832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.219837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.219845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.219893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1378 partition: 0 MaxSeqNo: 36 sessionId: src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0
2025-10-02T09:32:04.220140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498498a4-46b537df-56378677-9f9b042d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.222350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Write session: try to update token
2025-10-02T09:32:04.222363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.229131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.229144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.229145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.229146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.229151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.229155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.229157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263281911:8660]
2025-10-02T09:32:04.229178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.229181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.229182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.229183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.229185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.229187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.229287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.232984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId: src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.235223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.298781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338820791:10078]
2025-10-02T09:32:04.298916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1377, pipe: [1:7556554827338820791:10078]
2025-10-02T09:32:04.340684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.340999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.341008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.341032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820791:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.341137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.341146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338820791:10078]
2025-10-02T09:32:04.341153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.341171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:04.341223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1378 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0
2025-10-02T09:32:04.341370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1378 sessionId: src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0 is DEAD
2025-10-02T09:32:04.341539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:04.341554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Write session will restart in 0.009977s
2025-10-02T09:32:04.341576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Write session: Do CDS request
2025-10-02T09:32:04.341581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.352040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.352291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.352299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.352357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.352365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1379
2025-10-02T09:32:04.352394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.352401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.352406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.352431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.352448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.352455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263282163:8675]
2025-10-02T09:32:04.352465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.352470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.352473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.352736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1379 sessionId:  describe result for acl check
2025-10-02T09:32:04.352762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.352766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.352767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.352770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338820965:4893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.352797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.352968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.352991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.353127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338820965:4893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.353173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.353201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.353205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.353206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.353206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.353207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.353207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.353208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.353208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.353209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.353209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.353210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.353210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.353213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.353219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.353222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.353224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.353226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.353228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.353230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.353233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.353235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.353237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.353239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.353241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.353245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.353249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.353253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.353256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.353259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.353262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.353264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.353267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.353269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.353271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.353273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.353276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.353278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.353281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.353286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.353289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.353291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.353294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.353297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.353300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.353302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.353304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.353310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.353312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.353329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.354581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338820965:4893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.358667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338820965:4893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.358676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338820965:4893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.358678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338820965:4893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.358682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.361003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.362532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.362541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.362543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.362545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.362548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1378 [2:7556554827263282163:8675]
2025-10-02T09:32:04.362558Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.362567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.362573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.362574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.362575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.362583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.362589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.362594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.362621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.362626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.362627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.362628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.362629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.362663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.362667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.362674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.362680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.362688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.362702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821004:4893], now have 1 active actors on pipe
2025-10-02T09:32:04.362707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338820792:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.362712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.362713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.362714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.362721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.362732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.362734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.362737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.362738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.362742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.362744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.362748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1378
2025-10-02T09:32:04.362757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.362762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.362749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1378
2025-10-02T09:32:04.362769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.362783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.362788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.362804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.362810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.362812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.362813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.362827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.362832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.362842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.362945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.362951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.362959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.363017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1379 partition: 0 MaxSeqNo: 36 sessionId: src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0
2025-10-02T09:32:04.363295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c941fb2f-dbbbac7c-507a2a48-a538e66e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.366132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Write session: try to update token
2025-10-02T09:32:04.366151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.372111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.372122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.372123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.372124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.372128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.372130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.372132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263282158:8675]
2025-10-02T09:32:04.372154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.372157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.372160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.372166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.372175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.372177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.372270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.379024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId: src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.381002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.441131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338821011:10078]
2025-10-02T09:32:04.441308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1378, pipe: [1:7556554827338821011:10078]
2025-10-02T09:32:04.485438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.485709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.485718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.485731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821011:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.485904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.485906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.485913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338821011:10078]
2025-10-02T09:32:04.485934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:04.485936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:04.485984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1379 reason: error at write: Disconnected sessionId: src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0
2025-10-02T09:32:04.486125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1379 sessionId: src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0 is DEAD
2025-10-02T09:32:04.486302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:04.486319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Write session will restart in 0.009586s
2025-10-02T09:32:04.486346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Write session: Do CDS request
2025-10-02T09:32:04.486352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.495413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.497234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.497305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.497300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.497311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1380
2025-10-02T09:32:04.497411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.497417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.497423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.497454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.497484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263282373:8677]
2025-10-02T09:32:04.497509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.497533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.497542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.497546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.497807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1380 sessionId:  describe result for acl check
2025-10-02T09:32:04.497830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.497836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.497834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.497835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.497838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338821186:4889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.498021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.498044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.498177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338821186:4889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.498226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.498254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.498258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.498258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.498259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.498260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.498260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.498261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.498261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.498262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.498262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.498263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.498263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.498266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.498272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.498274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.498276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.498278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.498280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.498282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.498284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.498286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.498288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.498290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.498292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.498296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.498299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.498303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.498306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.498308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.498311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.498313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.498315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.498319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.498322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.498324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.498326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.498328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.498331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.498336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.498339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.498342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.498348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.498350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.498352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.498354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.498357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.498362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.498365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.498382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.499356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338821186:4889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.503839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338821186:4889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.503849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338821186:4889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.503851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338821186:4889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.503857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.506003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.507520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.507530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.507531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.507534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.507538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1379 [2:7556554827263282373:8677]
2025-10-02T09:32:04.507545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.507553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.507558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.507560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.507561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.507569Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.507572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.507578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.507611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.507615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.507617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.507619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.507620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.507733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.507715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1379
2025-10-02T09:32:04.507738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.507722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1379
2025-10-02T09:32:04.507745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.507751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.507761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.507776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821012:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.507782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821224:4889], now have 1 active actors on pipe
2025-10-02T09:32:04.507791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.507796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.507808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.507812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.507813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.507821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.507832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.507836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.507838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.507839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.507839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.507841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.507850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.507856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.507859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.507860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.507864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.507871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.507889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.507896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.507904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.507905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.507999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.508004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.508012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.508057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1380 partition: 0 MaxSeqNo: 36 sessionId: src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0
2025-10-02T09:32:04.508319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec76286-cc0f8a82-ecc3bd60-2d8da8cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.511143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Write session: try to update token
2025-10-02T09:32:04.511158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.516962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:04.516972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.516976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.516997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:04.517005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:04.517137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:04.517256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:04.517376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:04.517500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:04.517662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:04.517685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:04.525391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId: src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.525547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.525562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.525563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.525564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.525569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.525573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.525576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263282368:8677]
2025-10-02T09:32:04.525600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.525601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.525603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.525604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.525605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.525606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.525724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.527588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.586028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338821232:10078]
2025-10-02T09:32:04.586242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1379, pipe: [1:7556554827338821232:10078]
2025-10-02T09:32:04.643338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.643571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.643580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.643593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821232:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.643780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:04.643789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:04.643813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338821232:10078]
2025-10-02T09:32:04.643810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.643827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1380 reason: error at write: Disconnected sessionId: src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0
2025-10-02T09:32:04.643831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.643969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1380 sessionId: src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0 is DEAD
2025-10-02T09:32:04.644099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:04.644114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Write session will restart in 0.009480s
2025-10-02T09:32:04.644137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Write session: Do CDS request
2025-10-02T09:32:04.644142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.654225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.654269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.654307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.654316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1381
2025-10-02T09:32:04.654482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.654505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.654508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.654514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.654789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1381 sessionId:  describe result for acl check
2025-10-02T09:32:04.654823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.654829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.654831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.654834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338821407:4882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.655184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338821407:4882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.655826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.655923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.655930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.655936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.655962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.655984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263282586:8679]
2025-10-02T09:32:04.656331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.656493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.656494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338821407:4882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.656515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.656689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.656716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.656720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.656721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.656722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.656722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.656723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.656723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.656724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.656724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.656725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.656725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.656726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.656729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.656735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.656737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.656739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.656741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.656743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.656745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.656747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.656749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.656751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.656753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.656755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.656758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.656762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.656766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.656769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.656771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.656774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.656776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.656779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.656781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.656784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.656786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.656788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.656791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.656793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.656795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.656798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.656811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.656814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.656816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.656819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.656821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.656824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.656826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.656829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.656845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.660715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338821407:4882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.660727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338821407:4882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.660730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338821407:4882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.660734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.664291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.665726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.665737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.665739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.665742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.665746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1380 [2:7556554827263282586:8679]
2025-10-02T09:32:04.665753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.665765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.665770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.665771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.665773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.665782Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.665788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.665792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.665826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.665831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.665832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.665834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.665836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.665873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.665878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.665884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.665893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.665901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.665916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821446:4882], now have 1 active actors on pipe
2025-10-02T09:32:04.665921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821233:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.665926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.665927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.665928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.665936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.665946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.665948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.665951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.665952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.665968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.665973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.665959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1380
2025-10-02T09:32:04.665962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1380
2025-10-02T09:32:04.665998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.666003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.666013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.666020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.666028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.666038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e788bdc-fd3285f-75548184-3ef05add_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.666045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.666048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.666052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.666057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.666062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.666074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.666162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.666167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.666175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.666226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1381 partition: 0 MaxSeqNo: 36 sessionId: src_id|e788bdc-fd3285f-75548184-3ef05add_0
2025-10-02T09:32:04.666550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73abdef-d26ccf31-8cdef232-83c5dfb1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e788bdc-fd3285f-75548184-3ef05add_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.669266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Write session: try to update token
2025-10-02T09:32:04.669283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.675154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.675167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.675168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.675169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.675173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.675176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.675178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263282580:8679]
2025-10-02T09:32:04.675200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.675202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.675205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.675207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.675208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.675209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.675314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.683159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId: src_id|e788bdc-fd3285f-75548184-3ef05add_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.685266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.743704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338821454:10078]
2025-10-02T09:32:04.743939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1380, pipe: [1:7556554827338821454:10078]
2025-10-02T09:32:04.794792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.795013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.795022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.795034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821454:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.795208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.795253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338821454:10078]
2025-10-02T09:32:04.795269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:04.795277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.795326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1381 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e788bdc-fd3285f-75548184-3ef05add_0
2025-10-02T09:32:04.795465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1381 sessionId: src_id|e788bdc-fd3285f-75548184-3ef05add_0 is DEAD
2025-10-02T09:32:04.795612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:04.795626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Write session will restart in 0.009855s
2025-10-02T09:32:04.795651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Write session: Do CDS request
2025-10-02T09:32:04.795657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.804944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.806257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.806370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.806380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1382
2025-10-02T09:32:04.806449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.806500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.806519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.806525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.806528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.806549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.806555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.806561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.806588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.806609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263282810:8682]
2025-10-02T09:32:04.806796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1382 sessionId:  describe result for acl check
2025-10-02T09:32:04.806826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.806830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.806831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.806834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338821634:4870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.806974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.807132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.807154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.807177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338821634:4870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.807330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.807358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.807362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.807362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.807363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.807363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.807364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.807364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.807365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.807365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.807366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.807366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.807367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.807369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.807375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.807378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.807380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.807381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.807383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.807385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.807387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.807389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.807391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.807393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.807396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.807401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.807407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.807411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.807415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.807423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.807428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.807435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.807437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.807440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.807446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.807448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.807450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.807455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.807457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.807461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.807463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.807465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.807468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.807474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.807476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.807478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.807481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.807483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.807486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.807504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.808630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338821634:4870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.812951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338821634:4870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.812963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338821634:4870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.812966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338821634:4870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.812971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.815045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.816588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.816599Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.816600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.816603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.816606Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1381 [2:7556554827263282810:8682]
2025-10-02T09:32:04.816614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.816625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.816630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.816632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.816633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.816643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.816649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.816654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.816689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.816694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.816695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.816697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.816698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.816735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.816739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.816745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.816750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.816758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.816770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821672:4870], now have 1 active actors on pipe
2025-10-02T09:32:04.816775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821455:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.816778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.816780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.816781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.816789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.816797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.816812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.816816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.816817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.816820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.816822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.816838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.816828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1381
2025-10-02T09:32:04.816828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1381
2025-10-02T09:32:04.816843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.816844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.816864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.816870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.816886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.816893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.816895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.816896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.816901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.816908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.816915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.817021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.817028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.817037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.817094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1382 partition: 0 MaxSeqNo: 36 sessionId: src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0
2025-10-02T09:32:04.817378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e788bdc-fd3285f-75548184-3ef05add_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.820159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Write session: try to update token
2025-10-02T09:32:04.820176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.826432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.826447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.826448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.826449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.826455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.826458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.826460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263282805:8682]
2025-10-02T09:32:04.826484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.826486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.826488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.826489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.826492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.826495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.826614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.833915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId: src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.836060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:04.895262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554827338821697:10078]
2025-10-02T09:32:04.895449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1381, pipe: [1:7556554827338821697:10078]
2025-10-02T09:32:04.942302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:04.942731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.942741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.942754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821697:10078], now have 1 active actors on pipe
2025-10-02T09:32:04.942907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:04.942942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554827338821697:10078]
2025-10-02T09:32:04.942957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:04.942961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:04.942966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:04.943010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1382 reason: error at write: Disconnected sessionId: src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0
2025-10-02T09:32:04.943163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1382 sessionId: src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0 is DEAD
2025-10-02T09:32:04.943311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:04.943326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Write session will restart in 0.007477s
2025-10-02T09:32:04.943348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Write session: Do CDS request
2025-10-02T09:32:04.943355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:04.952200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.952310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:04.952325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1383
2025-10-02T09:32:04.952455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:04.952478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:04.952486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:04.952489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:04.952857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1383 sessionId:  describe result for acl check
2025-10-02T09:32:04.952884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:04.952888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:04.952889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:04.952893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554827338821847:4867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:04.953269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554827338821847:4867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:04.954414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:04.954680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554827338821847:4867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:04.956028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:04.956139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:04.956147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:04.956153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:04.956183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:04.956209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554827263283027:8684]
2025-10-02T09:32:04.956517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554827338821847:4867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:04.956527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554827338821847:4867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:04.956528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554827338821847:4867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:04.956532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:04.956553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:04.956699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:04.956721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:04.956909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:04.956939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.956943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.956943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.956944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.956945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.956945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.956946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.956946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.956947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.956947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.956948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.956948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.956951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.956958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.956960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.956961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.956963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.956965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.956967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.956969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.956971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.956973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.956975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.956977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.956980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.956985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:04.956988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.956991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:04.956993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.956997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:04.956999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.957002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:04.957004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.957007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:04.957009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.957011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:04.957017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.957019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:04.957021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.957024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:04.957026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.957028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:04.957030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.957033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.957035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.957037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.957039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.957042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.957061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:04.964463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:04.966007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:04.966018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:04.966019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:04.966021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:04.966025Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1382 [2:7556554827263283027:8684]
2025-10-02T09:32:04.966032Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:04.966041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:04.966046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.966048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.966049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.966058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:04.966064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:04.966068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:04.966100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.966105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.966106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.966108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:04.966109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:04.966145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:04.966150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.966156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:04.966161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:04.966172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:04.966188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821909:4867], now have 1 active actors on pipe
2025-10-02T09:32:04.966191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554827338821698:2446], now have 1 active actors on pipe
2025-10-02T09:32:04.966196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.966199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.966200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.966209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:04.966216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:04.966222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:04.966224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:04.966225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:04.966226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:04.966228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:04.966242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.966247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:04.966233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1382
2025-10-02T09:32:04.966237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1382
2025-10-02T09:32:04.966248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:04.966261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.966264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.966284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:04.966291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:04.966294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:04.966295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:04.966300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:04.966308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:04.966319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.966408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:04.966413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:04.966420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:04.966479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1383 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0
2025-10-02T09:32:04.966759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430e4fd-b669d767-7f9b3804-19ef1811_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:04.969560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Write session: try to update token
2025-10-02T09:32:04.969575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:04.975597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:04.975608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:04.975610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:04.975611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:04.975615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.975618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.975621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554827263283021:8684]
2025-10-02T09:32:04.975642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:04.975645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:04.975646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:04.975647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:04.975648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:04.975651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:04.975764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:04.983568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId: src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:04.985882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.043229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633789217:10078]
2025-10-02T09:32:05.043385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1382, pipe: [1:7556554831633789217:10078]
2025-10-02T09:32:05.090457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.090676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.090684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.090697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789217:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.090878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.090941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:05.090942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633789217:10078]
2025-10-02T09:32:05.090956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.091013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0
2025-10-02T09:32:05.091157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1383 sessionId: src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0 is DEAD
2025-10-02T09:32:05.091358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:05.091373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Write session will restart in 0.008837s
2025-10-02T09:32:05.091398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Write session: Do CDS request
2025-10-02T09:32:05.091404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:05.100839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:05.101265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.101356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:05.101367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1384
2025-10-02T09:32:05.101490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.101512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:05.101518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:05.101521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:05.101824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1384 sessionId:  describe result for acl check
2025-10-02T09:32:05.101851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:05.101857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:05.101858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:05.101862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554831633789395:4863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:05.102204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554831633789395:4863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:05.102563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:05.102828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:05.102840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:05.102851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:05.102910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:05.102944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554831558250538:8687]
2025-10-02T09:32:05.103423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:05.103603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:05.103629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554831633789395:4863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:05.103640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:05.103901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:05.103963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.103970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.103970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.103971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.103972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.103973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.103974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.103975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.103976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.103977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.103978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.103979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.103983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.103992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.103995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.103998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.104001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.104005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.104008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.104011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.104017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.104020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.104027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.104030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.104039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.104049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.104057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.104066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.104070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.104074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.104079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.104085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.104093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.104098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.104105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.104109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.104117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.104125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.104130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.104139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.104146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.104151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.104158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.104162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.104169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.104174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.104180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.104184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.104215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:05.108142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554831633789395:4863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:05.108151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554831633789395:4863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:05.108154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554831633789395:4863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:05.108158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:05.111837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:05.113205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:05.113215Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:05.113216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:05.113219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:05.113222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1383 [2:7556554831558250538:8687]
2025-10-02T09:32:05.113320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:05.113334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:05.113335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.113337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.113338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.113347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:05.113354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:05.113358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:05.113390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.113396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.113397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.113399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:05.113400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:05.113441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:05.113445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.113452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.113457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.113466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:05.113481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789218:2446], now have 1 active actors on pipe
2025-10-02T09:32:05.113486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789434:4863], now have 1 active actors on pipe
2025-10-02T09:32:05.113490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.113493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.113494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.113504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:05.113516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:05.113518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:05.113523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:05.113524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:05.113529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:05.113531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:05.113533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1383
2025-10-02T09:32:05.113548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1383
2025-10-02T09:32:05.113550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.113556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:05.113558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:05.113574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.113581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.113602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e58a996e-648528d9-f34d90af-fe64a990_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:05.113609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.113612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.113613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:05.113618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.113627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:05.113640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.113738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.113743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.113751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.113809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1384 partition: 0 MaxSeqNo: 36 sessionId: src_id|e58a996e-648528d9-f34d90af-fe64a990_0
2025-10-02T09:32:05.114066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb08d091-bb547ce1-b83c177f-4ef5ae33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e58a996e-648528d9-f34d90af-fe64a990_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:05.117445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Write session: try to update token
2025-10-02T09:32:05.117464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:05.123240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:05.123254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.123255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:05.123257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:05.123262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.123265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.123267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554831558250532:8687]
2025-10-02T09:32:05.123291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:05.123295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:05.123296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.123297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:05.123297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:05.123301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:05.123407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:05.130083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId: src_id|e58a996e-648528d9-f34d90af-fe64a990_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:05.132405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.191218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633789441:10078]
2025-10-02T09:32:05.191421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1383, pipe: [1:7556554831633789441:10078]
2025-10-02T09:32:05.246652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.246923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.246933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.246946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789441:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.247096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.247124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.247143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633789441:10078]
2025-10-02T09:32:05.247162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:05.247252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1384 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e58a996e-648528d9-f34d90af-fe64a990_0
2025-10-02T09:32:05.247399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1384 sessionId: src_id|e58a996e-648528d9-f34d90af-fe64a990_0 is DEAD
2025-10-02T09:32:05.247536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:05.247547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Write session will restart in 0.007848s
2025-10-02T09:32:05.247566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Write session: Do CDS request
2025-10-02T09:32:05.247572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:05.256185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.256278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:05.256291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1385
2025-10-02T09:32:05.256397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.256424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:05.256436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:05.256439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:05.256764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1385 sessionId:  describe result for acl check
2025-10-02T09:32:05.256793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:05.256799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:05.256811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:05.256816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554831633789622:4857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:05.256960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:05.257258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554831633789622:4857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:05.258693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554831633789622:4857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:05.258689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:05.258900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:05.258911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:05.258921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:05.258977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:05.259010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554831558250756:8690]
2025-10-02T09:32:05.259510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:05.259696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:05.259723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:05.259984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:05.260017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.260021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.260022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.260023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.260023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.260024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.260024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.260025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.260025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.260026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.260027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.260027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.260031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.260037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.260039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.260041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.260043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.260045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.260047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.260049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.260051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.260053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.260055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.260057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.260061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.260065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.260068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.260071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.260073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.260076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.260079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.260082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.260084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.260087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.260089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.260092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.260094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.260096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.260098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.260101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.260104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.260107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.260109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.260112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.260114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.260117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.260119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.260121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.260138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:05.264017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554831633789622:4857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:05.264026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554831633789622:4857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:05.264027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554831633789622:4857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:05.264032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:05.267710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:05.269123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:05.269133Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:05.269135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:05.269137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:05.269140Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1384 [2:7556554831558250756:8690]
2025-10-02T09:32:05.269148Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:05.269159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:05.269165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.269166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.269167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.269175Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:05.269178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:05.269183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:05.269215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.269219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.269220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.269222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:05.269223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:05.269260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:05.269265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.269271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.269276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.269287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:05.269304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789662:4857], now have 1 active actors on pipe
2025-10-02T09:32:05.269310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789445:2446], now have 1 active actors on pipe
2025-10-02T09:32:05.269316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.269319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.269321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.269331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:05.269333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1384
2025-10-02T09:32:05.269345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:05.269345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:05.269347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:05.269348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:05.269349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1384
2025-10-02T09:32:05.269360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:05.269362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:05.269390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.269396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.269406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.269414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:05.269425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:05.269433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:05.269439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.269444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.269445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:05.269450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.269459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:05.269472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.269580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.269586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.269593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.269653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1385 partition: 0 MaxSeqNo: 36 sessionId: src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0
2025-10-02T09:32:05.269930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58a996e-648528d9-f34d90af-fe64a990_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:05.272385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Write session: try to update token
2025-10-02T09:32:05.272402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:05.278935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:05.278948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.278950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:05.278951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:05.278957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.278959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.278962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554831558250750:8690]
2025-10-02T09:32:05.278986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:05.278988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:05.278989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.278991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:05.278991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:05.278993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:05.279093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:05.284216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId: src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:05.286426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.347373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633789694:10078]
2025-10-02T09:32:05.347563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1384, pipe: [1:7556554831633789694:10078]
2025-10-02T09:32:05.353508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:32:05.353534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-02T09:32:05.397693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.397959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.397968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.397979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789694:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.398159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.398236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.398241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:05.398258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-02T09:32:05.398288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633789694:10078]
2025-10-02T09:32:05.398298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0
2025-10-02T09:32:05.398420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1385 sessionId: src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0 is DEAD
2025-10-02T09:32:05.398547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:05.398560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Write session will restart in 0.007411s
2025-10-02T09:32:05.398574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Write session: Do CDS request
2025-10-02T09:32:05.398577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:05.407183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.407377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:05.407391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1386
2025-10-02T09:32:05.407508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.407536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:05.407544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:05.407548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:05.407875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1386 sessionId:  describe result for acl check
2025-10-02T09:32:05.407903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:05.407909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:05.407910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:05.407915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554831633789873:4837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:05.408034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:05.408376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554831633789873:4837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:05.409577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:05.409683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:05.409689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:05.409695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:05.409724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:05.409748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554831558251009:8705]
2025-10-02T09:32:05.409951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554831633789873:4837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:05.410234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:05.410441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:05.410482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:05.410741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:05.410798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.410804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.410805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.410805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.410806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.410806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.410807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.410807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.410808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.410809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.410809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.410810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.410813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.410827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.410829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.410831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.410833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.410836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.410838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.410840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.410842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.410844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.410846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.410848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.410852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.410856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.410860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.410862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.410865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.410867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.410869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.410872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.410874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.410876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.410878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.410881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.410883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.410886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.410888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.410891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.410894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.410896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.410898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.410901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.410903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.410906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.410908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.410910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.410926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:05.414808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554831633789873:4837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:05.414825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554831633789873:4837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:05.414828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554831633789873:4837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:05.414846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:05.418474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:05.419921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:05.419933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:05.419934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:05.419936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:05.419939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1385 [2:7556554831558251009:8705]
2025-10-02T09:32:05.419946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:05.419956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:05.419962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.419964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.419965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.419974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:05.419977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:05.419981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:05.420013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.420018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.420019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.420020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:05.420022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:05.420059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:05.420064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.420070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.420079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.420090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:05.420105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789913:4837], now have 1 active actors on pipe
2025-10-02T09:32:05.420111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789695:2446], now have 1 active actors on pipe
2025-10-02T09:32:05.420116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.420117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.420119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.420128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:05.420138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:05.420146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:05.420149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:05.420150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:05.420155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:05.420157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:05.420167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.420173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:05.420177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:05.420157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1385
2025-10-02T09:32:05.420172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1385
2025-10-02T09:32:05.420208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.420216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.420253Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:32:05.420279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:05.420286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.420289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.420290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:05.420296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.420302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:05.420308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.420425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.420432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.420405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 11 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:32:05.420435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:32:05.420444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.420501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1386 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0
2025-10-02T09:32:05.420748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9ee2a-913c6377-2d4c3a47-5d6cdfd3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:05.423571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Write session: try to update token
2025-10-02T09:32:05.423587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:05.429551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:05.429561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.429563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:05.429564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:05.429568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.429570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.429573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554831558251004:8705]
2025-10-02T09:32:05.429594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:05.429597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.429601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:05.429602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:05.429605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:05.429607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:05.429706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:05.437048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId: src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:05.439430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.498437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633789923:10078]
2025-10-02T09:32:05.498665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1385, pipe: [1:7556554831633789923:10078]
2025-10-02T09:32:05.549342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.549613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.549622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.549635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789923:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.549788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.549830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:05.549900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1386 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0
2025-10-02T09:32:05.550061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633789923:10078]
2025-10-02T09:32:05.550064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1386 sessionId: src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0 is DEAD
2025-10-02T09:32:05.550083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.550095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:32:05.550231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:05.550244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Write session will restart in 0.005835s
2025-10-02T09:32:05.550266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Write session: Do CDS request
2025-10-02T09:32:05.550271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:05.557228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.557304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:05.557317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1387
2025-10-02T09:32:05.557497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.557523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:05.557533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:05.557536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:05.557970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1387 sessionId:  describe result for acl check
2025-10-02T09:32:05.557994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:05.558000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:05.558002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:05.558006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554831633790062:4832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:05.558451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554831633790062:4832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:05.559814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554831633790062:4832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:05.561384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:05.561656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:05.561700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554831633790062:4832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:05.561708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554831633790062:4832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:05.561710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554831633790062:4832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:05.561714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:05.561801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:05.561811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:05.561820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:05.561868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:05.561897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554831558251229:8708]
2025-10-02T09:32:05.562241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:05.562403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:05.562427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:05.562604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:05.562634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.562638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.562639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.562639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.562640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.562641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.562641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.562642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.562642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.562643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.562643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.562644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.562647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.562653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.562655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.562657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.562659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.562661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.562663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.562665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.562667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.562669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.562671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.562673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.562677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.562681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.562684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.562687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.562689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.562692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.562694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.562697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.562699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.562702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.562704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.562707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.562709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.562712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.562714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.562717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.562719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.562722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.562724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.562730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.562734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.562736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.562742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.562744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.562762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:05.571088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:05.572635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:05.572646Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:05.572647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:05.572650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:05.572654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1386 [2:7556554831558251229:8708]
2025-10-02T09:32:05.572662Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:05.572672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:05.572673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.572675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.572676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.572687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:05.572694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:05.572699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:05.572733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.572738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.572740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.572741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:05.572743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:05.572785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:05.572791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.572797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.572819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.572829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:05.572844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.572848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.572850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.572855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:05.572862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:05.572863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790142:4832], now have 1 active actors on pipe
2025-10-02T09:32:05.572866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633789928:2446], now have 1 active actors on pipe
2025-10-02T09:32:05.572870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:05.572871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:05.572872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:05.572885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:05.572892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:05.572913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.572924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:05.572934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:05.572931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1386
2025-10-02T09:32:05.572934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1386
2025-10-02T09:32:05.572968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.572977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.573004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:05.573011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.573014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.573015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:05.573021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.573030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:05.573061Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:32:05.573081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.573200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 12 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:32:05.573221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:32:05.573222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.573234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.573252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.573313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1387 partition: 0 MaxSeqNo: 36 sessionId: src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0
2025-10-02T09:32:05.573623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bdb1345-e8995783-f90f3e75-2fdf923f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:05.576445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Write session: try to update token
2025-10-02T09:32:05.576462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:05.582872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:05.582883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.582888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.582910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:05.582912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:05.583041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:05.583193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:05.583303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:05.583415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:05.583657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:05.583682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:05.590438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId: src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:05.592008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:05.592024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.592026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:05.592028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:05.592035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.592038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.592042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554831558251224:8708]
2025-10-02T09:32:05.592071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:05.592072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:05.592076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:05.592078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:05.592081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.592083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:05.592261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:05.593337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.650505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633790156:10078]
2025-10-02T09:32:05.650809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1386, pipe: [1:7556554831633790156:10078]
2025-10-02T09:32:05.706243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.706615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.706624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.706638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790156:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.706772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.706789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:05.706805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:05.706862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1387 reason: error at write: Disconnected sessionId: src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0
2025-10-02T09:32:05.706910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.706946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633790156:10078]
2025-10-02T09:32:05.707022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1387 sessionId: src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0 is DEAD
2025-10-02T09:32:05.707174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:05.707189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Write session will restart in 0.008592s
2025-10-02T09:32:05.707214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Write session: Do CDS request
2025-10-02T09:32:05.707220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:05.716925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:05.717234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.717328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:05.717340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1388
2025-10-02T09:32:05.717467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.717490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:05.717493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:05.717496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:05.717804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1388 sessionId:  describe result for acl check
2025-10-02T09:32:05.717832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:05.717837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:05.717838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:05.717841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554831633790342:4825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:05.718202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554831633790342:4825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:05.718350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:05.718443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:05.718449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:05.718455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:05.718480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:05.718502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554831558251448:8711]
2025-10-02T09:32:05.718869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:05.719032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:05.719054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:05.719234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:05.719264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.719267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.719268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.719269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.719269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.719270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.719270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.719271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.719271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.719272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.719272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.719273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.719275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.719281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.719283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.719286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.719287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.719290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.719292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.719293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.719295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.719298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.719299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.719301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.719305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.719309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.719312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.719315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.719317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.719320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.719323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.719326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.719328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.719331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.719333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.719335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.719337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.719340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.719342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.719344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.719346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.719349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.719351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.719353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.719355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.719362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.719364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.719366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.719382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:05.719479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554831633790342:4825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:05.724281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554831633790342:4825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:05.724290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554831633790342:4825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:05.724292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554831633790342:4825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:05.724296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:05.727028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:05.728553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:05.728564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:05.728565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:05.728567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:05.728571Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1387 [2:7556554831558251448:8711]
2025-10-02T09:32:05.728578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:05.728589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:05.728591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.728592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.728593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.728603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:05.728605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:05.728610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:05.728641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.728647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.728648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.728650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:05.728651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:05.728700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:05.728705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.728711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.728717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.728728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:05.728742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790161:2446], now have 1 active actors on pipe
2025-10-02T09:32:05.728747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790381:4825], now have 1 active actors on pipe
2025-10-02T09:32:05.728751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.728753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.728754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.728762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:05.728770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:05.728775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:05.728777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:05.728778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:05.728780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:05.728781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:05.728776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1387
2025-10-02T09:32:05.728813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.728779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1387
2025-10-02T09:32:05.728821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:05.728827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:05.728832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.728834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.728859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54eb19ce-18219f6f-8f0ff643-67581324_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:05.728868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.728872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.728873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:05.728878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.728887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:05.728900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.728996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.729001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.729008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.729055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1388 partition: 0 MaxSeqNo: 36 sessionId: src_id|54eb19ce-18219f6f-8f0ff643-67581324_0
2025-10-02T09:32:05.729338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88c2d12-41cbed97-df8c6d3a-bab415dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54eb19ce-18219f6f-8f0ff643-67581324_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:05.732071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Write session: try to update token
2025-10-02T09:32:05.732086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:05.738023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:05.738034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.738036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:05.738037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:05.738041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.738044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.738046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554831558251443:8711]
2025-10-02T09:32:05.738066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:05.738068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:05.738069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.738070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:05.738071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:05.738072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:05.738178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:05.746240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId: src_id|54eb19ce-18219f6f-8f0ff643-67581324_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:05.748372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.807132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633790391:10078]
2025-10-02T09:32:05.807334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1387, pipe: [1:7556554831633790391:10078]
2025-10-02T09:32:05.852380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.852596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.852604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.852617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790391:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.852742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.852781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633790391:10078]
2025-10-02T09:32:05.852796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:05.852817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.852868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1388 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54eb19ce-18219f6f-8f0ff643-67581324_0
2025-10-02T09:32:05.853012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1388 sessionId: src_id|54eb19ce-18219f6f-8f0ff643-67581324_0 is DEAD
2025-10-02T09:32:05.853174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:05.853187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Write session will restart in 0.005763s
2025-10-02T09:32:05.853210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Write session: Do CDS request
2025-10-02T09:32:05.853216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:05.860238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.860314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:05.860325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1389
2025-10-02T09:32:05.860450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:05.860471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:05.860477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:05.860480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:05.860772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1389 sessionId:  describe result for acl check
2025-10-02T09:32:05.860812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:05.860814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:05.860815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:05.860818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554831633790510:4815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:05.861171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554831633790510:4815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:05.862861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554831633790510:4815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:05.863160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:05.864741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:05.864839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554831633790510:4815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:05.864849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554831633790510:4815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:05.864851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554831633790510:4815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:05.864854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:05.864855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:05.864861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:05.864867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:05.864896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:05.864917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554831558251680:8714]
2025-10-02T09:32:05.865347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:05.865558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:05.865580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:05.865755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:05.865785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.865789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.865790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.865790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.865791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.865791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.865792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.865792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.865793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.865793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.865793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.865794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.865796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.865802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.865804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.865806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.865808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.865810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.865812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.865814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.865816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.865818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.865820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.865822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.865825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.865830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:05.865833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.865836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:05.865838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.865841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:05.865843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.865845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:05.865848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.865850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:05.865852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.865855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:05.865857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.865859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:05.865863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.865865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:05.865868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.865870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:05.865873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.865875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.865878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.865880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.865882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.865885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.865906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:05.873334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:05.874915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:05.874926Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:05.874927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:05.874929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:05.874933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1388 [2:7556554831558251680:8714]
2025-10-02T09:32:05.874940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:05.874950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:05.874951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.874953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.874954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.874963Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:05.874966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:05.874970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:05.875003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.875008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.875009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.875011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:05.875012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:05.875049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:05.875054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.875060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:05.875065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:05.875077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:05.875090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.875095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.875096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.875100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:05.875109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790624:4815], now have 1 active actors on pipe
2025-10-02T09:32:05.875108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:05.875111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:05.875112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:05.875116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790407:2446], now have 1 active actors on pipe
2025-10-02T09:32:05.875119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:05.875125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:05.875127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:05.875142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.875149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:05.875163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:05.875163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1388
2025-10-02T09:32:05.875163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1388
2025-10-02T09:32:05.875198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.875204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.875220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:05.875226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:05.875229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:05.875230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:05.875235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:05.875241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:05.875251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.875360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.875373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.875383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:05.875446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1389 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0
2025-10-02T09:32:05.875717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54eb19ce-18219f6f-8f0ff643-67581324_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:05.878484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Write session: try to update token
2025-10-02T09:32:05.878501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:05.884252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:05.884260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:05.884261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:05.884263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:05.884266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.884269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.884271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554831558251674:8714]
2025-10-02T09:32:05.884291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:05.884294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:05.884295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:05.884298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:05.884300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:05.884303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:05.884400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:05.891687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId: src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:05.893820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:05.953062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554831633790638:10078]
2025-10-02T09:32:05.953218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1388, pipe: [1:7556554831633790638:10078]
2025-10-02T09:32:05.998542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:05.998773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:05.998783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:05.998795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790638:10078], now have 1 active actors on pipe
2025-10-02T09:32:05.998995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:05.999011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:05.999020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554831633790638:10078]
2025-10-02T09:32:05.999025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:05.999035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:05.999077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1389 reason: error at write: Disconnected sessionId: src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0
2025-10-02T09:32:05.999223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1389 sessionId: src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0 is DEAD
2025-10-02T09:32:05.999379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:05.999394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Write session will restart in 0.009234s
2025-10-02T09:32:05.999440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Write session: Do CDS request
2025-10-02T09:32:05.999446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.010204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.010296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.010307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1390
2025-10-02T09:32:06.010391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.010431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.010452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.010458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.010461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.010726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1390 sessionId:  describe result for acl check
2025-10-02T09:32:06.010751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.010755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.010756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.010759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928758119:4803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.011131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928758119:4803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.011943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.012132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.012140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.012147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.012183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.012208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853219199:8717]
2025-10-02T09:32:06.012284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928758119:4803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.012839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.013004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.013027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.013308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.013335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.013339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.013340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.013340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.013341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.013342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.013342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.013343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.013343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.013344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.013345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.013345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.013348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.013355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.013357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.013359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.013361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.013363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.013365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.013367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.013369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.013372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.013374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.013376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.013380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.013384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.013387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.013390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.013394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.013400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.013402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.013405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.013410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.013413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.013416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.013419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.013421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.013424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.013427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.013429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.013432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.013435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.013437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.013440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.013442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.013445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.013448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.013450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.013468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.013791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928758119:4803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.013799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928758119:4803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.013801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928758119:4803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.013804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.020896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.022337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.022348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.022349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.022351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.022354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1389 [2:7556554835853219199:8717]
2025-10-02T09:32:06.022362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.022371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.022373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.022374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.022375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.022384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.022387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.022392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.022425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.022430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.022431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.022433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.022435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.022472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.022476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.022483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.022488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.022499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.022513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554831633790639:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.022519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758158:4803], now have 1 active actors on pipe
2025-10-02T09:32:06.022522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.022523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.022525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.022531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.022542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.022545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.022547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.022548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.022551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.022553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.022567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.022573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.022575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.022556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1389
2025-10-02T09:32:06.022558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1389
2025-10-02T09:32:06.022584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.022589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.022617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.022623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.022626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.022627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.022633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.022641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.022650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.022734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.022738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.022745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.022802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1390 partition: 0 MaxSeqNo: 36 sessionId: src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0
2025-10-02T09:32:06.023071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a59b0-3ea7b816-b3131c4e-902eab10_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.025577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Write session: try to update token
2025-10-02T09:32:06.025593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.032104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.032120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.032123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.032125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.032133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.032137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.032140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853219193:8717]
2025-10-02T09:32:06.032172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.032181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.032181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.032185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.032186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.032190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.032307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.037940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId: src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.040111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.098986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928758165:10078]
2025-10-02T09:32:06.099181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1389, pipe: [1:7556554835928758165:10078]
2025-10-02T09:32:06.147105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:06.147462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.147471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.147485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758165:10078], now have 1 active actors on pipe
2025-10-02T09:32:06.147627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:06.147678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928758165:10078]
2025-10-02T09:32:06.147678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:06.147706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:06.147760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0
2025-10-02T09:32:06.147894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1390 sessionId: src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0 is DEAD
2025-10-02T09:32:06.148063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:06.148078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Write session will restart in 0.005819s
2025-10-02T09:32:06.148101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Write session: Do CDS request
2025-10-02T09:32:06.148106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.155143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.155321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.155334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1391
2025-10-02T09:32:06.155449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.155468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.155475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.155478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.155815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1391 sessionId:  describe result for acl check
2025-10-02T09:32:06.155842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.155846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.155847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.155850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928758275:4804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.156199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928758275:4804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.158006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928758275:4804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.158393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.159945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.160041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.160050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.160056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.160082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.160104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853219420:8719]
2025-10-02T09:32:06.160112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928758275:4804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.160121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928758275:4804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.160123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928758275:4804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.160127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.160448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.160607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.160631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.160819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.160848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.160851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.160852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.160852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.160853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.160854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.160854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.160855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.160855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.160856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.160856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.160857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.160859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.160865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.160867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.160869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.160871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.160874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.160876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.160878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.160880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.160882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.160884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.160886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.160889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.160894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.160897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.160900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.160902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.160905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.160907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.160910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.160912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.160916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.160918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.160921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.160923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.160926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.160928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.160931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.160933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.160935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.160937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.160940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.160942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.160944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.160947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.160949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.160967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.168603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.170152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.170165Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.170167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.170169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.170173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1390 [2:7556554835853219420:8719]
2025-10-02T09:32:06.170180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.170190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.170194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.170196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.170197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.170207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.170214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.170218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.170254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.170259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.170260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.170262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.170263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.170302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.170307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.170313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.170319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.170327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.170343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758385:4804], now have 1 active actors on pipe
2025-10-02T09:32:06.170349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758166:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.170353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.170354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.170355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.170362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.170372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.170378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.170380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.170382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.170383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.170384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.170399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.170404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.170406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.170391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1390
2025-10-02T09:32:06.170393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1390
2025-10-02T09:32:06.170427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.170432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.170450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b190325-345171f8-c06036ce-2129cb62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.170456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.170459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.170460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.170620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.170630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.170641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.170777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.170782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.170790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.170875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1391 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b190325-345171f8-c06036ce-2129cb62_0
2025-10-02T09:32:06.171158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df20c8ca-6d2427b6-59b160c6-20896e87_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b190325-345171f8-c06036ce-2129cb62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.173840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Write session: try to update token
2025-10-02T09:32:06.173854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.179807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.179819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.179820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.179822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.179826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.179829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.179831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853219414:8719]
2025-10-02T09:32:06.179852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.179858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.179857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.179860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.179860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.179864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.179971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.187124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId: src_id|9b190325-345171f8-c06036ce-2129cb62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.189246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.247982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928758399:10078]
2025-10-02T09:32:06.248158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1390, pipe: [1:7556554835928758399:10078]
2025-10-02T09:32:06.295324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:06.295550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.295559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.295572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758399:10078], now have 1 active actors on pipe
2025-10-02T09:32:06.295735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:06.295753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:06.295766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:06.295771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928758399:10078]
2025-10-02T09:32:06.295789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:06.295812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1391 reason: error at write: Disconnected sessionId: src_id|9b190325-345171f8-c06036ce-2129cb62_0
2025-10-02T09:32:06.295951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1391 sessionId: src_id|9b190325-345171f8-c06036ce-2129cb62_0 is DEAD
2025-10-02T09:32:06.296136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:06.296155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Write session will restart in 0.009619s
2025-10-02T09:32:06.296188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Write session: Do CDS request
2025-10-02T09:32:06.296196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.305819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.307257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.307301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.307357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.307366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1392
2025-10-02T09:32:06.307357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.307364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.307370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.307394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.307419Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853219644:8722]
2025-10-02T09:32:06.307552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.307571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.307574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.307576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.307759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.307834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1392 sessionId:  describe result for acl check
2025-10-02T09:32:06.307858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.307862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.307863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.307866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928758588:4793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.307936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.307962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.308146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.308174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.308178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.308178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.308179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.308179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.308180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.308180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.308181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.308181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.308182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.308182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.308183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.308186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.308192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.308194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.308196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.308198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.308200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.308202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.308204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.308206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.308208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.308210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.308212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.308215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.308220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.308223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.308226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.308228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.308231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.308233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.308235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.308232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928758588:4793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.308237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.308240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.308242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.308245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.308248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.308250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.308252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.308255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.308261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.308263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.308265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.308268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.308270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.308281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.308285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.308318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.309693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928758588:4793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.313558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928758588:4793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.313570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928758588:4793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.313572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928758588:4793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.313575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.315824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.317270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.317284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.317285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.317288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.317291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1391 [2:7556554835853219644:8722]
2025-10-02T09:32:06.317298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.317308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.317311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.317313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.317314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.317323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.317330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.317334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.317368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.317373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.317374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.317376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.317378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.317415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.317420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.317428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.317433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.317444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.317460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758627:4793], now have 1 active actors on pipe
2025-10-02T09:32:06.317467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758400:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.317473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.317478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.317481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.317491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.317505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.317506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.317508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.317509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.317520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.317526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.317511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1391
2025-10-02T09:32:06.317533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1391
2025-10-02T09:32:06.317552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.317559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.317568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.317577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.317585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.317601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.317609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.317614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.317616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.317621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.317629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.317645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.317751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.317756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.317764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.317819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1392 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0
2025-10-02T09:32:06.318099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b190325-345171f8-c06036ce-2129cb62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.320797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Write session: try to update token
2025-10-02T09:32:06.320840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.326800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.326824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.326825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.326826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.326832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.326834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.326836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853219639:8722]
2025-10-02T09:32:06.326857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.326861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.326864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.326864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.326865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.326866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.326972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.334364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId: src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.336751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.395954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928758654:10078]
2025-10-02T09:32:06.396140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1391, pipe: [1:7556554835928758654:10078]
2025-10-02T09:32:06.442584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:06.442914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.442925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.442937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758654:10078], now have 1 active actors on pipe
2025-10-02T09:32:06.443114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:06.443105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:06.443133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928758654:10078]
2025-10-02T09:32:06.443143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:06.443196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1392 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0
2025-10-02T09:32:06.443331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1392 sessionId: src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0 is DEAD
2025-10-02T09:32:06.443835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:06.443849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Write session will restart in 0.006955s
2025-10-02T09:32:06.443871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Write session: Do CDS request
2025-10-02T09:32:06.443876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.452343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.452396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.452407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1393
2025-10-02T09:32:06.452593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.452615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.452625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.452631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.452965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1393 sessionId:  describe result for acl check
2025-10-02T09:32:06.452996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.453000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.453001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.453005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928758838:4778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.453378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928758838:4778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.454778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.455022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928758838:4778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.456607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.456722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.456728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.456733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.456759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.456782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853219905:8736]
2025-10-02T09:32:06.456840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928758838:4778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.456848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928758838:4778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.456851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928758838:4778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.456855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.457136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.457298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.457321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.457494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.457525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.457529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.457530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.457531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.457531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.457532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.457532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.457533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.457533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.457534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.457534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.457535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.457538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.457544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.457546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.457548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.457550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.457552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.457554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.457556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.457558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.457560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.457562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.457564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.457567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.457571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.457574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.457577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.457579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.457582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.457584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.457587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.457589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.457591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.457593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.457596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.457598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.457601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.457602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.457605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.457607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.457611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.457612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.457618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.457620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.457623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.457626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.457629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.457644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.465107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.467786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.467796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.467797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.467800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.467803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1392 [2:7556554835853219905:8736]
2025-10-02T09:32:06.467812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.467822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.467823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.467825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.467826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.467836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.467842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.467846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.467880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.467884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.467885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.467888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.467890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.467930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.467935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.467942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.467947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.467959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.467973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758655:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.467980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758876:4778], now have 1 active actors on pipe
2025-10-02T09:32:06.467983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.467984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.467985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.467994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.468001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.468011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.468011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.468014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.468015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.468005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1392
2025-10-02T09:32:06.468017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.468012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1392
2025-10-02T09:32:06.468033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.468034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.468037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.468048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.468053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.468078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7782455e-f7d61b88-271db15b-92cadf12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.468084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.468087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.468089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.468094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.468100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.468114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.468210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.468215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.468222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.468278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1393 partition: 0 MaxSeqNo: 36 sessionId: src_id|7782455e-f7d61b88-271db15b-92cadf12_0
2025-10-02T09:32:06.468557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c01b2b-a03ecb98-abedf103-540b54ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7782455e-f7d61b88-271db15b-92cadf12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.474753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Write session: try to update token
2025-10-02T09:32:06.474769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.477183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.477195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.477197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.477198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.477201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.477203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.477205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853219899:8736]
2025-10-02T09:32:06.477225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.477228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.477233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.477234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.477245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.477253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.477338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.504043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId: src_id|7782455e-f7d61b88-271db15b-92cadf12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.506236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.543405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928758895:10078]
2025-10-02T09:32:06.543549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1392, pipe: [1:7556554835928758895:10078]
2025-10-02T09:32:06.590920Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:06.591143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.591154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.591167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758895:10078], now have 1 active actors on pipe
2025-10-02T09:32:06.591315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:06.591321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:06.591334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:06.591335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928758895:10078]
2025-10-02T09:32:06.591348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:06.591382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1393 reason: error at write: Disconnected sessionId: src_id|7782455e-f7d61b88-271db15b-92cadf12_0
2025-10-02T09:32:06.591478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1393 sessionId: src_id|7782455e-f7d61b88-271db15b-92cadf12_0 is DEAD
2025-10-02T09:32:06.591640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:06.591654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Write session will restart in 0.007177s
2025-10-02T09:32:06.591678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Write session: Do CDS request
2025-10-02T09:32:06.591683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.600139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.600206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.600216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1394
2025-10-02T09:32:06.600307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.600327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.600332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.600336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.600625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1394 sessionId:  describe result for acl check
2025-10-02T09:32:06.600651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.600652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.600653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.600656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928759056:4770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.601010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928759056:4770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.602175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.602724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928759056:4770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.603666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.603758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.603764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.603770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.603794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.603817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853220130:8738]
2025-10-02T09:32:06.604150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.604302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.604323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.604492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.604520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.604524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.604524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.604525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.604525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.604526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.604526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.604527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.604527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.604528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.604529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.604529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.604532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.604537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.604540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.604542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.604544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.604546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.604548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.604550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.604552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.604554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.604556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.604558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.604561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.604564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.604578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.604584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.604587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.604590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.604593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.604597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.604599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.604604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.604606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.604611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.604613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.604616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.604618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.604621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.604623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.604625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.604627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.604630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.604632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.604634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.604636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.604639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.604655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.604681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928759056:4770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.604692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928759056:4770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.604694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928759056:4770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.604702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.612010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.613494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.613508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.613510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.613512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.613518Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1393 [2:7556554835853220130:8738]
2025-10-02T09:32:06.613528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.613543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.613545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.613551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.613553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.613564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.613570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.613574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.613603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.613608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.613609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.613610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.613612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.613652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.613657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.613663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.613668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.613680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.613695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928758899:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.613700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759123:4770], now have 1 active actors on pipe
2025-10-02T09:32:06.613703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.613705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.613706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.613713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.613723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.613726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.613728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.613730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.613733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.613716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1393
2025-10-02T09:32:06.613734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.613717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1393
2025-10-02T09:32:06.613748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.613753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.613755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.613764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.613769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.613791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.613797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.613799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.613800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.613805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.613813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.613825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.613909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.613914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.613921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.613970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1394 partition: 0 MaxSeqNo: 36 sessionId: src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0
2025-10-02T09:32:06.614185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7782455e-f7d61b88-271db15b-92cadf12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.616940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Write session: try to update token
2025-10-02T09:32:06.616956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.622975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.622988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.622989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.622991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.622995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.622998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.623000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853220124:8738]
2025-10-02T09:32:06.623020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.623024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.623025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.623030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.623034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.623037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.623189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.631533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId: src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.633477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.691361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928759133:10078]
2025-10-02T09:32:06.691523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1393, pipe: [1:7556554835928759133:10078]
2025-10-02T09:32:06.738915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:06.739218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.739230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.739247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759133:10078], now have 1 active actors on pipe
2025-10-02T09:32:06.739356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:06.739408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:06.739420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:06.739423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:06.739462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928759133:10078]
2025-10-02T09:32:06.739462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1394 reason: error at write: Disconnected sessionId: src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0
2025-10-02T09:32:06.739585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1394 sessionId: src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0 is DEAD
2025-10-02T09:32:06.739750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:06.739764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Write session will restart in 0.009886s
2025-10-02T09:32:06.739787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Write session: Do CDS request
2025-10-02T09:32:06.739792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.750386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.751175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.751262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.751272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1395
2025-10-02T09:32:06.751364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.751386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.751392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.751395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.751656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1395 sessionId:  describe result for acl check
2025-10-02T09:32:06.751679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.751684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.751685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.751687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928759323:4767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.751904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.752020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928759323:4767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.752022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.752029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.752035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.752064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.752089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853220368:8741]
2025-10-02T09:32:06.752431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.752581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.752603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.752779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.752817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.752821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.752822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.752822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.752823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.752824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.752824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.752825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.752825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.752826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.752826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.752827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.752829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.752835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.752837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.752839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.752841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.752843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.752845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.752847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.752849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.752852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.752854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.752856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.752860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.752864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.752867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.752869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.752873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.752875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.752878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.752880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.752883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.752886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.752888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.752891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.752893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.752895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.752897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.752900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.752905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.752907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.752909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.752912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.752916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.752918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.752920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.752923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.752942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.753112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928759323:4767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.757696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928759323:4767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.757705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928759323:4767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.757707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928759323:4767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.757711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.760401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.761941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.761952Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.761953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.761956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.761959Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1394 [2:7556554835853220368:8741]
2025-10-02T09:32:06.761967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.761977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.761982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.761983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.761985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.761994Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.762001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.762005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.762036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.762041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.762042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.762044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.762046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.762087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.762091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.762098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.762103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.762115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.762131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759134:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.762136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759361:4767], now have 1 active actors on pipe
2025-10-02T09:32:06.762140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.762141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.762143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.762152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.762161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.762164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.762166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.762168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.762172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.762173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.762163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1394
2025-10-02T09:32:06.762167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1394
2025-10-02T09:32:06.762187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.762192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.762195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.762207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.762213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.762233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f63a52-b2314339-81c626f9-bf2cc051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.762240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.762242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.762243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.762248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.762256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.762268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.762357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.762362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.762370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.762421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1395 partition: 0 MaxSeqNo: 36 sessionId: src_id|28f63a52-b2314339-81c626f9-bf2cc051_0
2025-10-02T09:32:06.762680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd5d1de-1aa8e16e-d49a681b-dfab7e9e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28f63a52-b2314339-81c626f9-bf2cc051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.765375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Write session: try to update token
2025-10-02T09:32:06.765393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.771382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.771394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.771396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.771397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.771401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.771404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.771406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853220362:8741]
2025-10-02T09:32:06.771426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.771429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.771431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.771435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.771440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.771443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.771538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.780174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId: src_id|28f63a52-b2314339-81c626f9-bf2cc051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.782365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.839831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928759385:10078]
2025-10-02T09:32:06.839962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1394, pipe: [1:7556554835928759385:10078]
2025-10-02T09:32:06.886903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:06.887203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.887215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.887230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759385:10078], now have 1 active actors on pipe
2025-10-02T09:32:06.887346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:06.887346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928759385:10078]
2025-10-02T09:32:06.887359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:06.887368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:06.887370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:06.887413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1395 reason: error at write: Disconnected sessionId: src_id|28f63a52-b2314339-81c626f9-bf2cc051_0
2025-10-02T09:32:06.887563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1395 sessionId: src_id|28f63a52-b2314339-81c626f9-bf2cc051_0 is DEAD
2025-10-02T09:32:06.887713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 125 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:32:06.887748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:06.887751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Write session will restart in 0.006933s
2025-10-02T09:32:06.887773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Write session: Do CDS request
2025-10-02T09:32:06.887780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:06.896225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.896278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:06.896287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1396
2025-10-02T09:32:06.896404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:06.896425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:06.896428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:06.896431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:06.896708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1396 sessionId:  describe result for acl check
2025-10-02T09:32:06.896726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:06.896731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:06.896732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:06.896735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554835928759566:4757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:06.897083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554835928759566:4757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:06.897814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:06.898684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554835928759566:4757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:06.899356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:06.899479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:06.899485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:06.899491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:06.899520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:06.899546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554835853220595:8743]
2025-10-02T09:32:06.899881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:06.900047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:06.900069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:06.900240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:06.900267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.900271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.900271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.900272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.900272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.900273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.900273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.900274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.900274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.900275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.900275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.900276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.900279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.900285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.900287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.900289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.900291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.900293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.900294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.900296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.900298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.900301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.900302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.900304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.900308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.900311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:06.900314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.900317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:06.900319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.900322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:06.900324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.900327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:06.900329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.900331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:06.900333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.900336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:06.900338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.900341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:06.900343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.900346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:06.900348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.900350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:06.900353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.900356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.900358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.900360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.900362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.900364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.900381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:06.900602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554835928759566:4757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:06.900614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554835928759566:4757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:06.900616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554835928759566:4757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:06.900620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:06.907803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:06.909302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:06.909313Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:06.909314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:06.909316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:06.909320Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1395 [2:7556554835853220595:8743]
2025-10-02T09:32:06.909326Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:06.909335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:06.909340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.909342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.909343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.909352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:06.909358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:06.909362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:06.909393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.909397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.909398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.909400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:06.909401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:06.909438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:06.909443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.909450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:06.909455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:06.909466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:06.909481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759618:4757], now have 1 active actors on pipe
2025-10-02T09:32:06.909486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759390:2446], now have 1 active actors on pipe
2025-10-02T09:32:06.909490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.909491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.909492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.909502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:06.909513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:06.909514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:06.909516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:06.909517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:06.909524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:06.909525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:06.909513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1395
2025-10-02T09:32:06.909524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1395
2025-10-02T09:32:06.909541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.909546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:06.909548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:06.909556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.909561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.909720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:06.909729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:06.909731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:06.909732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:06.909738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:06.909744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:06.909761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.909870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:06.909875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:06.909883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:06.909938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1396 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0
2025-10-02T09:32:06.910203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f63a52-b2314339-81c626f9-bf2cc051_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:06.912989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Write session: try to update token
2025-10-02T09:32:06.913003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:06.918719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:06.918732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:06.918733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:06.918734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:06.918745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.918748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.918752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554835853220589:8743]
2025-10-02T09:32:06.918772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:06.918775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:06.918777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:06.918778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:06.918779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:06.918779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:06.918892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:06.927175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId: src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:06.929279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:06.987310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554835928759625:10078]
2025-10-02T09:32:06.987509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1395, pipe: [1:7556554835928759625:10078]
2025-10-02T09:32:07.031257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.031476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.031485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.031498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554835928759625:10078], now have 1 active actors on pipe
2025-10-02T09:32:07.031663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554835928759625:10078]
2025-10-02T09:32:07.031684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.031687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:07.031689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:07.031729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1396 reason: error at write: Disconnected sessionId: src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0
2025-10-02T09:32:07.031766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.031868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1396 sessionId: src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0 is DEAD
2025-10-02T09:32:07.032010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:07.032025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Write session will restart in 0.007683s
2025-10-02T09:32:07.032048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Write session: Do CDS request
2025-10-02T09:32:07.032053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.041189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.041301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.041309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1397
2025-10-02T09:32:07.041434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.041454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.041461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.041464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.041744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1397 sessionId:  describe result for acl check
2025-10-02T09:32:07.041772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.041777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.041778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.041781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223727110:4751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.042143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223727110:4751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.042530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.043568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223727110:4751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.044158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.044280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.044286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.044293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.044321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.044345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148188122:8746]
2025-10-02T09:32:07.044688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.044864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.044890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.045073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.045102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.045106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.045107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.045107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.045108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.045108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.045109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.045109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.045110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.045110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.045111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.045111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.045114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.045120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.045122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.045124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.045126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.045128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.045130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.045132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.045134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.045136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.045138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.045140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.045144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.045148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.045151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.045154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.045157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.045162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.045166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.045170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.045173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.045178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.045182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.045186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.045194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.045198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.045206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.045210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.045217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.045221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.045228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.045232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.045241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.045249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.045256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.045260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.045291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.045532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223727110:4751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.045542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223727110:4751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.045544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223727110:4751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.045547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.052907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.054425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.054438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.054440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.054442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.054445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1396 [2:7556554840148188122:8746]
2025-10-02T09:32:07.054452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.054462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.054463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.054464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.054465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.054474Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.054478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.054482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.054511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.054517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.054518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.054519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.054521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.054558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.054563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.054569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.054575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.054584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.054600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727152:4751], now have 1 active actors on pipe
2025-10-02T09:32:07.054605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223726923:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.054609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.054610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.054611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.054620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.054627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.054633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.054635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.054636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.054638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.054639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.054632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1396
2025-10-02T09:32:07.054637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1396
2025-10-02T09:32:07.054654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.054659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.054662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.054669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.054672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.054694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1752a127-ee10d431-18fd9294-db012248_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.054701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.054703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.054704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.054709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.054713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.054722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.054821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.054826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.054834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.054888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1397 partition: 0 MaxSeqNo: 36 sessionId: src_id|1752a127-ee10d431-18fd9294-db012248_0
2025-10-02T09:32:07.055168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a483e-d0edf2f3-c082e318-bd2898c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1752a127-ee10d431-18fd9294-db012248_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.057934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Write session: try to update token
2025-10-02T09:32:07.057950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.064046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.064058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.064059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.064061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.064065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.064067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.064070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148188116:8746]
2025-10-02T09:32:07.064092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.064093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.064095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.064095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.064096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.064097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.064226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.071195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId: src_id|1752a127-ee10d431-18fd9294-db012248_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.073312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:07.131692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554840223727159:10078]
2025-10-02T09:32:07.131947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1396, pipe: [1:7556554840223727159:10078]
2025-10-02T09:32:07.173843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.174071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.174080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.174093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727159:10078], now have 1 active actors on pipe
2025-10-02T09:32:07.174249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.174244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:07.174255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:07.174278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554840223727159:10078]
2025-10-02T09:32:07.174294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1397 reason: error at write: Disconnected sessionId: src_id|1752a127-ee10d431-18fd9294-db012248_0
2025-10-02T09:32:07.174295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.174421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1397 sessionId: src_id|1752a127-ee10d431-18fd9294-db012248_0 is DEAD
2025-10-02T09:32:07.174574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:07.174587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Write session will restart in 0.005565s
2025-10-02T09:32:07.174608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Write session: Do CDS request
2025-10-02T09:32:07.174614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.181171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.181238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.181246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1398
2025-10-02T09:32:07.181372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.181392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.181398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.181401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.181726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1398 sessionId:  describe result for acl check
2025-10-02T09:32:07.181752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.181758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.181759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.181762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223727208:4742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.182113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223727208:4742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.184507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223727208:4742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.186797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223727208:4742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.186806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223727208:4742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.186807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223727208:4742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.186818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.188028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.189921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.190039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.190046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.190051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.190080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.190102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148188351:8748]
2025-10-02T09:32:07.190437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.190621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.190645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.190832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.190860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.190863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.190864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.190864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.190865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.190865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.190866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.190867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.190867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.190867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.190868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.190869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.190871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.190877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.190880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.190882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.190883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.190886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.190887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.190889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.190891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.190893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.190895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.190897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.190901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.190905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.190907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.190910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.190912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.190915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.190917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.190920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.190922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.190924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.190926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.190929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.190931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.190934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.190936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.190939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.190944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.190947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.190949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.190952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.190956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.190958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.190962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.190964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.190979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.198380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.199899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.199910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.199911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.199913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.199916Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1397 [2:7556554840148188351:8748]
2025-10-02T09:32:07.199924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.199933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.199934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.199936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.199937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.199946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.199949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.199953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.199982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.199987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.199988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.199990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.199991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.200026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.200031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.200038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.200043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.200054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.200070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727382:4742], now have 1 active actors on pipe
2025-10-02T09:32:07.200077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727161:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.200081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.200087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.200089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.200098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.200109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.200111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.200116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.200117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.200122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.200124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.200142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.200149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.200124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1397
2025-10-02T09:32:07.200150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.200125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1397
2025-10-02T09:32:07.200160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.200162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.200188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90fdcc60-7658dca8-56492427-12a188bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.200195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.200197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.200198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.200204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.200211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.200226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.200342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.200349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.200358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.200426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1398 partition: 0 MaxSeqNo: 36 sessionId: src_id|90fdcc60-7658dca8-56492427-12a188bc_0
2025-10-02T09:32:07.200649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1752a127-ee10d431-18fd9294-db012248_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90fdcc60-7658dca8-56492427-12a188bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.203413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Write session: try to update token
2025-10-02T09:32:07.203425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.209538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.209551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.209553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.209554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.209559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.209562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.209564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148188346:8748]
2025-10-02T09:32:07.209587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.209590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.209592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.209595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.209599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.209601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.209704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.216895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId: src_id|90fdcc60-7658dca8-56492427-12a188bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.219019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:07.274550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554840223727400:10078]
2025-10-02T09:32:07.274783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1397, pipe: [1:7556554840223727400:10078]
2025-10-02T09:32:07.323057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.323426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.323436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.323448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727400:10078], now have 1 active actors on pipe
2025-10-02T09:32:07.323586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.323661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554840223727400:10078]
2025-10-02T09:32:07.323668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.323691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:07.323744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1398 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90fdcc60-7658dca8-56492427-12a188bc_0
2025-10-02T09:32:07.323884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1398 sessionId: src_id|90fdcc60-7658dca8-56492427-12a188bc_0 is DEAD
2025-10-02T09:32:07.324026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:07.324036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Write session will restart in 0.007347s
2025-10-02T09:32:07.324060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Write session: Do CDS request
2025-10-02T09:32:07.324066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.332083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.332192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.332204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1399
2025-10-02T09:32:07.332280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.332298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.332305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.332308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.332698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1399 sessionId:  describe result for acl check
2025-10-02T09:32:07.332723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.332728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.332729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.332732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223727482:4739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.333099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223727482:4739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.335577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223727482:4739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.337367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.337412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223727482:4739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.337420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223727482:4739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.337422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223727482:4739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.337426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.339354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.339473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.339479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.339485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.339512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.339535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148188582:8751]
2025-10-02T09:32:07.339876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.340401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.340440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.340650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.340691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.340696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.340697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.340698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.340699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.340699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.340700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.340701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.340702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.340703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.340704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.340705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.340709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.340719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.340721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.340723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.340725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.340727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.340729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.340731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.340732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.340735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.340736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.340738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.340742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.340746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.340750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.340753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.340755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.340757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.340759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.340762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.340764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.340766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.340768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.340771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.340773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.340776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.340778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.340781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.340785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.340792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.340794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.340797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.340799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.340812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.340814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.340817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.340833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.349355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.350865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.350877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.350879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.350881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.350885Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1398 [2:7556554840148188582:8751]
2025-10-02T09:32:07.350893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.350903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.350909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.350911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.350913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.350923Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.350926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.350935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.351076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.351083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.351084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.351086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.351088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.351129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.351134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.351142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.351149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.351159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.351176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727401:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.351182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727626:4739], now have 1 active actors on pipe
2025-10-02T09:32:07.351186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.351188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.351189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.351197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.351209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.351213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.351215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.351216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.351222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.351224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.351239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.351245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.351247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.351228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1398
2025-10-02T09:32:07.351255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1398
2025-10-02T09:32:07.351278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.351286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.351302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|181929e8-6ab74525-d712dfda-a394ac8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.351311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.351313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.351314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.351320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.351330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.351342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.351463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.351468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.351477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.351548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1399 partition: 0 MaxSeqNo: 36 sessionId: src_id|181929e8-6ab74525-d712dfda-a394ac8a_0
2025-10-02T09:32:07.351822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fdcc60-7658dca8-56492427-12a188bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|181929e8-6ab74525-d712dfda-a394ac8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.354064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Write session: try to update token
2025-10-02T09:32:07.354074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.361092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.361106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.361108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.361109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.361114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.361117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.361119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148188576:8751]
2025-10-02T09:32:07.361146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.361150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.361150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.361151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.361153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.361155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.361267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.365057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId: src_id|181929e8-6ab74525-d712dfda-a394ac8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.367202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:07.424058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554840223727662:10078]
2025-10-02T09:32:07.424308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1398, pipe: [1:7556554840223727662:10078]
2025-10-02T09:32:07.476778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.477035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.477044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.477070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727662:10078], now have 1 active actors on pipe
2025-10-02T09:32:07.477223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.477286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.477287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554840223727662:10078]
2025-10-02T09:32:07.477305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:07.477647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1399 reason: status is not ok: tablet will be restarted right now sessionId: src_id|181929e8-6ab74525-d712dfda-a394ac8a_0
2025-10-02T09:32:07.477795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1399 sessionId: src_id|181929e8-6ab74525-d712dfda-a394ac8a_0 is DEAD
2025-10-02T09:32:07.478120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:07.478126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Write session will restart in 0.009779s
2025-10-02T09:32:07.478139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Write session: Do CDS request
2025-10-02T09:32:07.478143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.489105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.489231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.489241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1400
2025-10-02T09:32:07.489381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.489402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.489408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.489411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.489689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1400 sessionId:  describe result for acl check
2025-10-02T09:32:07.489709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.489714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.489714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.489718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223727845:4725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.490082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223727845:4725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.491300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.491781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223727845:4725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.492968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.493076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.493083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.493088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.493115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.493136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148188847:8765]
2025-10-02T09:32:07.493562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.493766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.493771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223727845:4725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.493792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.493784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223727845:4725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.493787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223727845:4725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.493792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.494033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.494067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.494071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.494071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.494072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.494072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.494073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.494073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.494074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.494074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.494075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.494075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.494076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.494078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.494084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.494087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.494089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.494091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.494093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.494095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.494096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.494098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.494101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.494102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.494104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.494108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.494113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.494116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.494119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.494121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.494124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.494125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.494128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.494130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.494133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.494135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.494137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.494140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.494143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.494144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.494147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.494149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.494151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.494153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.494156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.494159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.494161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.494163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.494166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.494181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.501562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.502872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.502882Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.502883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.502886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.502889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1399 [2:7556554840148188847:8765]
2025-10-02T09:32:07.502895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.502905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.502910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.502911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.502912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.502921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.502927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.502931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.502963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.502967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.502968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.502970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.502971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.503007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.503011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.503017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.503023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.503034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.503050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727893:4725], now have 1 active actors on pipe
2025-10-02T09:32:07.503057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727663:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.503061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.503066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.503068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.503077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.503089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.503090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.503092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.503093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.503105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.503111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.503127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.503136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.503143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.503119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1399
2025-10-02T09:32:07.503134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1399
2025-10-02T09:32:07.503163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.503170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.503188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.503195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.503197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.503202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.503207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.503214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.503226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.503334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.503342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.503350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.503420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1400 partition: 0 MaxSeqNo: 36 sessionId: src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0
2025-10-02T09:32:07.503622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181929e8-6ab74525-d712dfda-a394ac8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.506186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Write session: try to update token
2025-10-02T09:32:07.506197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.512527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.512543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.512544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.512545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.512550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.512552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.512554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148188842:8765]
2025-10-02T09:32:07.512575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.512578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.512579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.512590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.512600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.512602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.512712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.518346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId: src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.520574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:07.577652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554840223727903:10078]
2025-10-02T09:32:07.577908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1399, pipe: [1:7556554840223727903:10078]
2025-10-02T09:32:07.625656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.626204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.626213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.626226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727903:10078], now have 1 active actors on pipe
2025-10-02T09:32:07.626364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.626433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554840223727903:10078]
2025-10-02T09:32:07.626463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:07.626467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.626516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1400 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0
2025-10-02T09:32:07.626660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1400 sessionId: src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0 is DEAD
2025-10-02T09:32:07.626853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:07.626870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Write session will restart in 0.005265s
2025-10-02T09:32:07.626897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Write session: Do CDS request
2025-10-02T09:32:07.626903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.633156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.633223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.633233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1401
2025-10-02T09:32:07.633414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.633441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.633449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.633452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.633905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1401 sessionId:  describe result for acl check
2025-10-02T09:32:07.633959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.633968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.633971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.633977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223727992:4719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.634533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223727992:4719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.636392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223727992:4719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.638138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.640572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.640700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.640709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.640716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.640750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.640773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148189078:8767]
2025-10-02T09:32:07.640882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223727992:4719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.640896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223727992:4719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.640898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223727992:4719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.640904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.641138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.641344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.641369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.641548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.641577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.641581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.641581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.641582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.641583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.641583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.641584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.641584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.641585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.641585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.641586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.641586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.641589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.641595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.641597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.641599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.641602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.641604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.641606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.641608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.641609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.641612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.641614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.641616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.641619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.641623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.641626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.641629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.641631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.641634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.641636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.641639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.641641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.641643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.641645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.641648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.641650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.641653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.641655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.641658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.641660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.641666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.641669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.641671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.641677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.641680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.641682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.641685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.641705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.649262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.650618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.650631Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.650632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.650635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.650640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1400 [2:7556554840148189078:8767]
2025-10-02T09:32:07.650649Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.650660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.650666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.650668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.650669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.650679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.650685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.650690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.650726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.650731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.650732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.650734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.650736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.650777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.650784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.650791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.650796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.650805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.650826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.650828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.650829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.650833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.650841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.650846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.650848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.650848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.650850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.650850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.650871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728133:4719], now have 1 active actors on pipe
2025-10-02T09:32:07.650895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223727904:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.650902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.650908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.650924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1400
2025-10-02T09:32:07.650932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.650925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1400
2025-10-02T09:32:07.650962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.650968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.650985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.650993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.650996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.650998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.651004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.651013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.651027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.651161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.651168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.651178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.651254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1401 partition: 0 MaxSeqNo: 36 sessionId: src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0
2025-10-02T09:32:07.651541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9e0111-bde6dc1c-76062cee-e1210cf4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.654432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Write session: try to update token
2025-10-02T09:32:07.654448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.664674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:07.664687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.664693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.664721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:07.664727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:07.664882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:07.664995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:07.665126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:07.665237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:07.665472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:07.665498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:07.668119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId: src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.668829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.668838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.668840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.668841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.668845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.668847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.668850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148189072:8767]
2025-10-02T09:32:07.668868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.668868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.668871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.668873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.668875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.668876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.668982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.670420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:07.726640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554840223728145:10078]
2025-10-02T09:32:07.726816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1400, pipe: [1:7556554840223728145:10078]
2025-10-02T09:32:07.745964Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 13 CurrentSessionLifetimeMs: 241271 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:32:07.781483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.781925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.781934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.781946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728145:10078], now have 1 active actors on pipe
2025-10-02T09:32:07.782092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.782132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554840223728145:10078]
2025-10-02T09:32:07.782137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.782157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:07.782164Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:32:07.782208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1401 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0
2025-10-02T09:32:07.782391Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:32:07.782254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1401 sessionId: src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0 is DEAD
2025-10-02T09:32:07.782306Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 14 consumer shared/user session shared/user_1_14_9023785720857643224_v1 is DEAD
2025-10-02T09:32:07.782442Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554780094166174:10075] disconnected; active server actors: 1
2025-10-02T09:32:07.782448Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554780094166174:10075] client user disconnected session shared/user_1_14_9023785720857643224_v1
2025-10-02T09:32:07.782570Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:07.782585Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:07.782597Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007718s
2025-10-02T09:32:07.782649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:07.782661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Write session will restart in 0.007223s
2025-10-02T09:32:07.782683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Write session: Do CDS request
2025-10-02T09:32:07.782689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.791183Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:32:07.791222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.791312Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:32:07.791316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.791318Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 15
2025-10-02T09:32:07.791321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1402
2025-10-02T09:32:07.791430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.791450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.791453Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 15 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:07.791456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.791459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.791484Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:07.791562Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 auth for : user
2025-10-02T09:32:07.791661Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 Handle describe topics response
2025-10-02T09:32:07.791676Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 auth is DEAD
2025-10-02T09:32:07.791689Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:32:07.791782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1402 sessionId:  describe result for acl check
2025-10-02T09:32:07.791801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.791805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.791806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.791809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223728238:4714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.791856Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:32:07.791901Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_15_8464715990875101492_v1
2025-10-02T09:32:07.792047Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554840223728240:4715] connected; active server actors: 1
2025-10-02T09:32:07.792107Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554840223728240:4715] session shared/user_1_15_8464715990875101492_v1
2025-10-02T09:32:07.792117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:32:07.792128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:32:07.792136Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_15_8464715990875101492_v1" (Sender=[1:7556554840223728225:4715], Pipe=[1:7556554840223728240:4715], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:07.792138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:32:07.792144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:32:07.792144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223728238:4714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.792152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_15_8464715990875101492_v1" (Sender=[1:7556554840223728225:4715], Pipe=[1:7556554840223728240:4715], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:07.792158Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_15_8464715990875101492_v1" sender [1:7556554840223728225:4715] lock partition 0 for ReadingSession "shared/user_1_15_8464715990875101492_v1" (Sender=[1:7556554840223728225:4715], Pipe=[1:7556554840223728240:4715], Partitions=[], ActiveFamilyCount=1) generation 1 step 15
2025-10-02T09:32:07.792165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:32:07.792171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T09:32:07.792281Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 15 Session: "shared/user_1_15_8464715990875101492_v1" ClientId: "user" PipeClient { RawX1: 7556554840223728240 RawX2: 4503603922342507 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:32:07.792296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:32:07.794705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223728238:4714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.796647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223728238:4714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.796659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223728238:4714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.796662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223728238:4714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.796666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.796986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.798788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.798913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.798919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.798925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.798955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.798976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148189324:8770]
2025-10-02T09:32:07.799313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.799515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.799538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.799715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.799742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.799746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.799746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.799747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.799747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.799748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.799749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.799749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.799750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.799750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.799751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.799751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.799754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.799760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.799762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.799764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.799766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.799768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.799770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.799772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.799774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.799776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.799778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.799780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.799784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.799788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.799791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.799794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.799796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.799799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.799802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.799805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.799807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.799810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.799812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.799814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.799816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.799819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.799821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.799824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.799826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.799829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.799831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.799834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.799836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.799838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.799840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.799843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.799859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.807308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.808701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.808712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.808713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.808715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.808718Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1401 [2:7556554840148189324:8770]
2025-10-02T09:32:07.808727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.808737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.808742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.808744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.808745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.808753Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.808756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.808760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.808790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.808794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.808796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.808797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.808798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.808845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.808849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.808856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.808864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.808875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.808890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728255:4709], now have 1 active actors on pipe
2025-10-02T09:32:07.808896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728382:4714], now have 1 active actors on pipe
2025-10-02T09:32:07.808899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728146:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.808903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.808908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.808910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.808918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.808930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.808932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.808937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.808938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.808944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.808945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.808962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.808968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.808945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1401
2025-10-02T09:32:07.808969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.808945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1401, pipe: [1:7556554840223728255:4709]
2025-10-02T09:32:07.808977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.808980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.808964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1401
2025-10-02T09:32:07.808992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.808998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.809001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_15_8464715990875101492_v1 on pipe: [1:7556554840223728255:4709]
2025-10-02T09:32:07.809027Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_15_8464715990875101492_v1:1 with generation 1401
2025-10-02T09:32:07.809028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77a58654-a5230f2b-8fdbad3-32528a19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.809032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.809035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.809036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.809040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.809045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.809050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.809052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.809053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.809061Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_15_8464715990875101492_v1
2025-10-02T09:32:07.809067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.809090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.809101Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:32:07.809180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.809187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.809197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.809267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1402 partition: 0 MaxSeqNo: 36 sessionId: src_id|77a58654-a5230f2b-8fdbad3-32528a19_0
2025-10-02T09:32:07.809478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcc3023-3cd1f893-fc3235a-5297cfaf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77a58654-a5230f2b-8fdbad3-32528a19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.812195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Write session: try to update token
2025-10-02T09:32:07.812212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.812448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:32:07.812463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:32:07.812466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.812468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.812468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.812471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:32:07.812475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:32:07.812557Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397527809 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:32:07.812567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:32:07.812584Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 sending to client partition status
2025-10-02T09:32:07.818020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.818032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.818033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.818034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.818037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.818040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.818042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148189319:8770]
2025-10-02T09:32:07.818061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.818065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.818065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.818066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.818067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.818070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.818190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.825094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId: src_id|77a58654-a5230f2b-8fdbad3-32528a19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.827228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:07.926612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:07.926974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.926983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.927134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_15_8464715990875101492_v1
2025-10-02T09:32:07.927150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:07.927167Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_15_8464715990875101492_v1
2025-10-02T09:32:07.927175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554840223728255:4709]
2025-10-02T09:32:07.927188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:07.927191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:07.927199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:07.927236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1402 reason: error at write: Disconnected sessionId: src_id|77a58654-a5230f2b-8fdbad3-32528a19_0
2025-10-02T09:32:07.927370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1402 sessionId: src_id|77a58654-a5230f2b-8fdbad3-32528a19_0 is DEAD
2025-10-02T09:32:07.927497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:07.927509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Write session will restart in 0.009675s
2025-10-02T09:32:07.927532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Write session: Do CDS request
2025-10-02T09:32:07.927537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:07.938133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.938254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:07.938266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1403
2025-10-02T09:32:07.938378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:07.938399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:07.938405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:07.938409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:07.938733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1403 sessionId:  describe result for acl check
2025-10-02T09:32:07.938759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:07.938765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:07.938766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:07.938770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554840223728564:4702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:07.939157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554840223728564:4702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:07.940776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554840223728564:4702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:07.941341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:07.943022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:07.943150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:07.943158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:07.943165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:07.943204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:07.943234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554840148189558:8772]
2025-10-02T09:32:07.943241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554840223728564:4702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:07.943252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554840223728564:4702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:07.943254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554840223728564:4702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:07.943258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:07.943570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:07.943793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:07.943823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:07.944010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:07.944036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.944039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.944040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.944040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.944041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.944042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.944042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.944043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.944043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.944044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.944045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.944045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.944048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.944054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.944056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.944058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.944060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.944062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.944064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.944066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.944068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.944071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.944073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.944075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.944078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.944083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:07.944086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.944089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:07.944091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.944094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:07.944096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.944098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:07.944101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.944104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:07.944110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.944112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:07.944114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.944117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:07.944119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.944125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:07.944127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.944129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:07.944131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.944134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.944136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.944139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.944141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.944144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.944160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:07.951711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:07.953107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:07.953119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:07.953120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:07.953123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:07.953125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1402 [2:7556554840148189558:8772]
2025-10-02T09:32:07.953133Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:07.953144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:07.953149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.953150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.953151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.953160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:07.953167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:07.953171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:07.953200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.953205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.953206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.953208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:07.953209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:07.953247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:07.953251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.953257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:07.953263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:07.953274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:07.953287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728418:2446], now have 1 active actors on pipe
2025-10-02T09:32:07.953293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554840223728649:4702], now have 1 active actors on pipe
2025-10-02T09:32:07.953297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.953299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.953300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.953309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:07.953321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:07.953322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:07.953328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:07.953329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:07.953333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:07.953335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:07.953352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.953362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:07.953366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:07.953374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1402
2025-10-02T09:32:07.953374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1402
2025-10-02T09:32:07.953541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.953549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.953569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|915c9f44-cf484781-6a42045f-e6b56762_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:07.953577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:07.953582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:07.953584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:07.953588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:07.953594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:07.953605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.953744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:07.953748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:07.953756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:07.953822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1403 partition: 0 MaxSeqNo: 36 sessionId: src_id|915c9f44-cf484781-6a42045f-e6b56762_0
2025-10-02T09:32:07.954026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a58654-a5230f2b-8fdbad3-32528a19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|915c9f44-cf484781-6a42045f-e6b56762_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:07.956488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Write session: try to update token
2025-10-02T09:32:07.956497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:07.962541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:07.962555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:07.962557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:07.962557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:07.962561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.962564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.962566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554840148189553:8772]
2025-10-02T09:32:07.962586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:07.962591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:07.962592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:07.962594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:07.962598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:07.962602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:07.962695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:07.967195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId: src_id|915c9f44-cf484781-6a42045f-e6b56762_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:07.969165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.027163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518695957:4709]
2025-10-02T09:32:08.027373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1402, pipe: [1:7556554844518695957:4709]
2025-10-02T09:32:08.072087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.072289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.072297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.072320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518695957:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.072473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.072514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:08.072524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:08.072541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518695957:4709]
2025-10-02T09:32:08.072556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.072567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1403 reason: error at write: Disconnected sessionId: src_id|915c9f44-cf484781-6a42045f-e6b56762_0
2025-10-02T09:32:08.072694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1403 sessionId: src_id|915c9f44-cf484781-6a42045f-e6b56762_0 is DEAD
2025-10-02T09:32:08.072828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:08.072837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Write session will restart in 0.007696s
2025-10-02T09:32:08.072852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Write session: Do CDS request
2025-10-02T09:32:08.072855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.081112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.081193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.081203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1404
2025-10-02T09:32:08.081294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.081313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.081320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.081323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.081584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1404 sessionId:  describe result for acl check
2025-10-02T09:32:08.081609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.081614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.081616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.081618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518696022:4693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.081981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518696022:4693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.084086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518696022:4693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.086157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518696022:4693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.086166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518696022:4693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.086168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518696022:4693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.086172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.087390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.089954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.090061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.090067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.090073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.090100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.090122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443157091:8775]
2025-10-02T09:32:08.090457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.090650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.090674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.090868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.090896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.090900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.090901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.090902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.090902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.090903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.090903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.090904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.090904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.090905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.090905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.090906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.090908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.090914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.090916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.090918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.090920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.090922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.090924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.090926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.090928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.090930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.090932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.090934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.090938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.090942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.090945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.090948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.090950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.090953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.090955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.090958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.090960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.090963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.090965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.090967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.090970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.090973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.090975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.090977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.090979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.090982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.090984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.090987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.090989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.090991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.090995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.090997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.091014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.098509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.100002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.100014Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.100015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.100017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.100020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1403 [2:7556554844443157091:8775]
2025-10-02T09:32:08.100027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.100036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.100039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.100041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.100041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.100049Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.100052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.100057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.100085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.100090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.100091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.100093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.100094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.100129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.100134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.100140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.100145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.100153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.100166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.100170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.100171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.100175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.100181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.100183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.100184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696183:4693], now have 1 active actors on pipe
2025-10-02T09:32:08.100185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.100188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.100197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.100202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.100207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518695958:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.100220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.100229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.100237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.100254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1403
2025-10-02T09:32:08.100262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1403
2025-10-02T09:32:08.100313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.100320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.100340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.100350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.100354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.100356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.100362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.100368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.100381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.100505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.100510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.100518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.100584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1404 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0
2025-10-02T09:32:08.100773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915c9f44-cf484781-6a42045f-e6b56762_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.103453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Write session: try to update token
2025-10-02T09:32:08.103466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.113712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:08.113727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.113732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.113757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:08.113763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:08.113892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:08.114006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:08.114115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:08.114224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:08.114375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:08.114400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:08.115262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId: src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:08.117163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.117257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.117266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.118051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.118062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.118063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.118065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.118069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.118072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.118074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443157086:8775]
2025-10-02T09:32:08.118093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.118094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:08.118101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.118103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.118104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.118106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.118107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.118160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:08.118214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:08.172576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518696201:4709]
2025-10-02T09:32:08.172823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1403, pipe: [1:7556554844518696201:4709]
2025-10-02T09:32:08.227867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.233816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.233838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.233959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.234008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.234062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.234112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.234151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.234157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.234209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.234258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.234307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.234360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.234399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.234405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.234454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.234500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.234548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.234596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.234630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.234635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.234683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.234760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.234844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.234896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.234991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.234997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.235048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.235094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.235144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.235196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.235235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.235240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.235287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.235334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.235381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.235433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.235471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.235476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.235554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.235599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.235649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.235720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.235762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.235766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.235829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.235876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.235921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.235969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.236001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.236005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.236070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.236115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.236163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.236210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.236260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.236265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.236310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:08.236354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:08.236464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:08.236513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:08.236546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:08.236550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:08.236576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696201:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.236761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:08.236774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:08.236778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518696201:4709]
2025-10-02T09:32:08.236793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1404 reason: error at write: Disconnected sessionId: src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0
2025-10-02T09:32:08.236797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.236941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1404 sessionId: src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0 is DEAD
2025-10-02T09:32:08.237065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:08.237074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Write session will restart in 0.009128s
2025-10-02T09:32:08.237090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Write session: Do CDS request
2025-10-02T09:32:08.237095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.237200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.247162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.247274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.247283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1405
2025-10-02T09:32:08.247378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.247397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.247402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.247406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.247772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1405 sessionId:  describe result for acl check
2025-10-02T09:32:08.247797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.247804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.247805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.247808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518696347:4688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.248150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518696347:4688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.250445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518696347:4688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.250612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.252587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.252717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.252725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.252732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.252765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.252795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443157327:8778]
2025-10-02T09:32:08.252821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518696347:4688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.252830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518696347:4688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.252832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518696347:4688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.252836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.253151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.253371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.253402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.253592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.253619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.253623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.253624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.253624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.253625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.253625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.253626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.253626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.253627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.253628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.253628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.253629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.253632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.253637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.253639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.253642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.253644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.253646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.253647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.253649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.253651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.253653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.253655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.253657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.253661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.253665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.253668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.253671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.253674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.253677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.253679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.253682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.253685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.253687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.253689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.253692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.253696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.253699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.253701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.253707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.253709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.253712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.253714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.253718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.253720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.253723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.253728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.253731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.253747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.261154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.262447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.262459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.262460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.262462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.262466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1404 [2:7556554844443157327:8778]
2025-10-02T09:32:08.262474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.262487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.262492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.262493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.262494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.262504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.262510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.262514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.262546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.262551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.262552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.262553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.262555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.262591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.262596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.262602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.262607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.262621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.262639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696205:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.262651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696438:4688], now have 1 active actors on pipe
2025-10-02T09:32:08.262655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.262657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.262659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.262668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.262679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.262681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.262683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.262684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.262675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1404
2025-10-02T09:32:08.262682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1404
2025-10-02T09:32:08.262691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.262697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.262722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.262730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.262735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.262739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.262744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.262766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.262773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.262775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.262777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.262781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.262790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.262801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.262909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.262916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.262926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.262993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1405 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0
2025-10-02T09:32:08.263208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7daa2cd-7f17f35e-64c9043c-1b378ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.265713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Write session: try to update token
2025-10-02T09:32:08.265728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.272048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.272062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.272063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.272064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.272069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.272072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.272074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443157322:8778]
2025-10-02T09:32:08.272095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.272098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.272100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.272103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.272106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.272108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.272202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:08.278125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId: src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:08.280069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.336930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518696449:4709]
2025-10-02T09:32:08.337165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1404, pipe: [1:7556554844518696449:4709]
2025-10-02T09:32:08.382961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.383223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.383233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.383244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696449:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.383410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:08.383423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:08.383459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1405 reason: error at write: Disconnected sessionId: src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0
2025-10-02T09:32:08.383593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1405 sessionId: src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0 is DEAD
2025-10-02T09:32:08.383615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.383714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518696449:4709]
2025-10-02T09:32:08.383732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:08.383728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.383750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Write session will restart in 0.007980s
2025-10-02T09:32:08.383769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Write session: Do CDS request
2025-10-02T09:32:08.383776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.393321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.393426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.393437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1406
2025-10-02T09:32:08.393549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.393569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.393575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.393577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.393816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1406 sessionId:  describe result for acl check
2025-10-02T09:32:08.393834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.393838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.393839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.393842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518696660:4675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.394180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518696660:4675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.394467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.395786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518696660:4675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.397234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.397352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.397359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.397367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.397402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.397430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443157592:8786]
2025-10-02T09:32:08.397811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518696660:4675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.397821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518696660:4675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.397823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518696660:4675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.397826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.397883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.398072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.398098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.398278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.398305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.398309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.398309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.398310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.398310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.398311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.398311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.398312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.398312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.398313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.398313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.398313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.398316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.398322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.398324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.398326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.398328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.398330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.398332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.398334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.398336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.398338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.398339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.398341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.398345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.398351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.398356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.398360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.398363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.398367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.398371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.398375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.398378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.398382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.398389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.398393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.398401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.398405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.398408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.398416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.398419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.398426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.398432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.398438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.398443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.398446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.398448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.398450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.398470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.405846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.407327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.407339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.407340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.407342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.407346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1405 [2:7556554844443157592:8786]
2025-10-02T09:32:08.407352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.407361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.407366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.407368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.407369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.407377Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.407380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.407384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.407416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.407421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.407422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.407424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.407425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.407460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.407465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.407472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.407477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.407488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.407503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696464:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.407510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696701:4675], now have 1 active actors on pipe
2025-10-02T09:32:08.407515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.407518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.407520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.407529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.407541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.407542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.407549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.407550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.407552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.407555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.407571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.407577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.407581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.407570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1405
2025-10-02T09:32:08.407595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1405
2025-10-02T09:32:08.407619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.407626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.407643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.407652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.407655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.407656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.407662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.407672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.407684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.407794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.407802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.407810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.407886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1406 partition: 0 MaxSeqNo: 36 sessionId: src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0
2025-10-02T09:32:08.408144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec12d0b1-732b2396-e80ebb9e-9be2d1e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.410995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Write session: try to update token
2025-10-02T09:32:08.411011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.416658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.416671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.416672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.416673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.416677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.416679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.416681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443157570:8786]
2025-10-02T09:32:08.416702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.416707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.416707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.416709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.416710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.416712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.416828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:08.424215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId: src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:08.426337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.483880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518696718:4709]
2025-10-02T09:32:08.484113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1405, pipe: [1:7556554844518696718:4709]
2025-10-02T09:32:08.526668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.526937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.526946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.526958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696718:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.527167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:08.527170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518696718:4709]
2025-10-02T09:32:08.527183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:08.527191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.527233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1406 reason: error at write: Disconnected sessionId: src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0
2025-10-02T09:32:08.527375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1406 sessionId: src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0 is DEAD
2025-10-02T09:32:08.527460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.527532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:08.527547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Write session will restart in 0.007742s
2025-10-02T09:32:08.527572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Write session: Do CDS request
2025-10-02T09:32:08.527577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.536322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.536347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.536357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1407
2025-10-02T09:32:08.536591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.536613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.536619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.536622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.536930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1407 sessionId:  describe result for acl check
2025-10-02T09:32:08.536956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.536961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.536962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.536964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518696879:4665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.537305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518696879:4665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.538798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518696879:4665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.539185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.541534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.541619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518696879:4665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.541629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518696879:4665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.541631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518696879:4665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.541635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.541646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.541653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.541659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.541687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.541710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443157836:8794]
2025-10-02T09:32:08.542058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.542249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.542275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.542459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.542490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.542494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.542495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.542495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.542496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.542496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.542497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.542497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.542498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.542498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.542499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.542499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.542502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.542508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.542510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.542512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.542514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.542516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.542518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.542520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.542522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.542524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.542526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.542528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.542531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.542535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.542538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.542541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.542544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.542546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.542548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.542551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.542554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.542557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.542559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.542561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.542564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.542566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.542568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.542571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.542573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.542576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.542578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.542581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.542585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.542591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.542593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.542596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.542613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.550143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.551481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.551495Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.551496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.551498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.551502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1406 [2:7556554844443157836:8794]
2025-10-02T09:32:08.551509Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.551520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.551525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.551527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.551528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.551537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.551540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.551544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.551574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.551579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.551580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.551582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.551584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.551620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.551625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.551632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.551637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.551648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.551665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696720:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.551672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696955:4665], now have 1 active actors on pipe
2025-10-02T09:32:08.551677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.551682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.551684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.551693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.551703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.551705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.551707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.551708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.551718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.551723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.551716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1406
2025-10-02T09:32:08.551723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1406
2025-10-02T09:32:08.551737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.551744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.551744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.551757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.551762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.551787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.551794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.551797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.551798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.551803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.551811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.551821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.551926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.551932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.551941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.552024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1407 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0
2025-10-02T09:32:08.552245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963f37c2-2f41349e-d42d43e5-e85532f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.554687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Write session: try to update token
2025-10-02T09:32:08.554698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.561423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.561439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.561440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.561441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.561445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.561448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.561450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443157831:8794]
2025-10-02T09:32:08.561473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.561477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.561480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.561485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.561489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.561492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.561594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:08.565511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId: src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:08.567410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.627459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518696966:4709]
2025-10-02T09:32:08.627730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1406, pipe: [1:7556554844518696966:4709]
2025-10-02T09:32:08.675807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.676218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.676230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.676255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696966:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.676421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518696966:4709]
2025-10-02T09:32:08.676441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.676447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:08.676449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:08.676433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.676492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1407 reason: error at write: Disconnected sessionId: src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0
2025-10-02T09:32:08.676636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1407 sessionId: src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0 is DEAD
2025-10-02T09:32:08.676748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:08.676759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Write session will restart in 0.007725s
2025-10-02T09:32:08.676777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Write session: Do CDS request
2025-10-02T09:32:08.676783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.685176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.685434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.685444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1408
2025-10-02T09:32:08.685512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.685532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.685539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.685541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.685865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1408 sessionId:  describe result for acl check
2025-10-02T09:32:08.685893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.685899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.685900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.685903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518697140:4659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.686250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518697140:4659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.687452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.687497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518697140:4659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.689352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.689469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.689477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.689483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.689513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.689525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518697140:4659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.689533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518697140:4659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.689535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443158075:8796]
2025-10-02T09:32:08.689535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518697140:4659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.689538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.689880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.690050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.690075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.690256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.690284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.690288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.690289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.690289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.690290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.690290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.690291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.690291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.690292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.690292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.690293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.690293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.690296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.690302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.690304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.690306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.690308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.690310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.690312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.690314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.690317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.690319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.690321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.690323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.690327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.690331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.690334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.690337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.690339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.690342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.690344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.690347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.690349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.690352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.690354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.690358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.690360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.690366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.690368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.690371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.690373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.690379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.690381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.690384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.690386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.690388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.690392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.690395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.690412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.698230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.699532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.699545Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.699546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.699548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.699551Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1407 [2:7556554844443158075:8796]
2025-10-02T09:32:08.699558Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.699568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.699569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.699571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.699572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.699580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.699587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.699591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.699620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.699625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.699626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.699628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.699629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.699664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.699669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.699675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.699681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.699691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.699707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697204:4659], now have 1 active actors on pipe
2025-10-02T09:32:08.699714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518696968:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.699719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.699722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.699723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.699732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.699745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.699746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.699753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.699754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.699745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1407
2025-10-02T09:32:08.699746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1407
2025-10-02T09:32:08.699758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.699760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.699775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.699780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.699782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.699793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.699798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.699822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.699829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.699831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.699832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.699837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.699844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.699855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.699946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.699953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.699963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.700028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1408 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0
2025-10-02T09:32:08.700293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b69c960-d4fcd168-bdaebddb-8c45955_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.703059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Write session: try to update token
2025-10-02T09:32:08.703076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.709072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.709086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.709087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.709088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.709091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.709095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.709097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443158069:8796]
2025-10-02T09:32:08.709117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.709119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.709121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.709124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.709128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.709131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.709228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:08.715908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId: src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:08.717845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.776743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518697215:4709]
2025-10-02T09:32:08.776950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1407, pipe: [1:7556554844518697215:4709]
2025-10-02T09:32:08.821914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.822316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.822325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.822337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697215:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.822456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.822471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:08.822479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.822481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:08.822505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518697215:4709]
2025-10-02T09:32:08.822521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1408 reason: error at write: Disconnected sessionId: src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0
2025-10-02T09:32:08.822656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1408 sessionId: src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0 is DEAD
2025-10-02T09:32:08.822830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:08.822845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Write session will restart in 0.006695s
2025-10-02T09:32:08.822871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Write session: Do CDS request
2025-10-02T09:32:08.822878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.830246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.830319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.830328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1409
2025-10-02T09:32:08.830445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.830465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.830471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.830474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.830873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1409 sessionId:  describe result for acl check
2025-10-02T09:32:08.830900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.830904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.830906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.830908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518697346:4654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.831269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518697346:4654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.833059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518697346:4654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.833636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.835320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.835393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518697346:4654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.835403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518697346:4654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.835405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518697346:4654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.835408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.835446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.835452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.835458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.835486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.835510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443158327:8799]
2025-10-02T09:32:08.835849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.836010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.836035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.836221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.836252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.836256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.836257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.836258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.836258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.836259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.836259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.836260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.836260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.836261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.836261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.836262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.836265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.836270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.836272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.836274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.836276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.836278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.836280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.836282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.836284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.836286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.836288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.836290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.836294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.836298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.836301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.836304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.836306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.836309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.836311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.836313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.836316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.836318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.836320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.836326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.836329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.836331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.836333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.836336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.836341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.836344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.836347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.836350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.836355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.836357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.836359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.836362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.836381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.843758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.845346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.845355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.845356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.845358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.845362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1408 [2:7556554844443158327:8799]
2025-10-02T09:32:08.845369Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.845379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.845380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.845382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.845383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.845391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.845398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.845402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.845431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.845435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.845437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.845438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.845440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.845475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.845480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.845486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.845493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.845511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.845530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697459:4654], now have 1 active actors on pipe
2025-10-02T09:32:08.845537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697223:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.845542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.845548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.845549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.845555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.845535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1408
2025-10-02T09:32:08.845543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1408
2025-10-02T09:32:08.845567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.845569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.845573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.845574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.845578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.845580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.845589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.845591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.845611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.845619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.845630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.845632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.845636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.845638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.845639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.845644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.845650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.845670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.845758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.845765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.845777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.845841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1409 partition: 0 MaxSeqNo: 36 sessionId: src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0
2025-10-02T09:32:08.846125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d762b6c-8b918412-8c4ae3ff-8d956522_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.848878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Write session: try to update token
2025-10-02T09:32:08.848892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.854788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.854798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.854799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.854800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.854804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.854806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.854816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443158322:8799]
2025-10-02T09:32:08.854835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.854840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.854842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.854842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.854844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.854845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.854949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:08.861585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId: src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:08.863513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:08.922653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554844518697486:4709]
2025-10-02T09:32:08.922853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1408, pipe: [1:7556554844518697486:4709]
2025-10-02T09:32:08.966311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:08.966532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.966541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.966554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697486:4709], now have 1 active actors on pipe
2025-10-02T09:32:08.966698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:08.966757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:08.966761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554844518697486:4709]
2025-10-02T09:32:08.966777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:08.966831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1409 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0
2025-10-02T09:32:08.966970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1409 sessionId: src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0 is DEAD
2025-10-02T09:32:08.967137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:08.967153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Write session will restart in 0.007449s
2025-10-02T09:32:08.967176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Write session: Do CDS request
2025-10-02T09:32:08.967181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:08.975163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.975263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:08.975274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1410
2025-10-02T09:32:08.975371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:08.975400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:08.975409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:08.975419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:08.975871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1410 sessionId:  describe result for acl check
2025-10-02T09:32:08.975898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:08.975899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:08.975900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:08.975903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554844518697628:4649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:08.976268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554844518697628:4649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:08.977808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554844518697628:4649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:08.978289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:08.980040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:08.980118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554844518697628:4649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:08.980128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554844518697628:4649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:08.980129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554844518697628:4649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:08.980132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:08.980152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:08.980159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:08.980164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:08.980192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:08.980214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554844443158570:8802]
2025-10-02T09:32:08.980553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:08.980761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:08.980784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:08.980976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:08.981006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.981010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.981010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.981011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.981011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.981012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.981012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.981013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.981013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.981014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.981014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.981015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.981018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.981023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.981025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.981027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.981029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.981031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.981033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.981035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.981037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.981039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.981041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.981043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.981046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.981050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:08.981054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.981056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:08.981058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.981061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:08.981063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.981066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:08.981069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.981071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:08.981073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.981077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:08.981082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.981085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:08.981088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.981091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:08.981093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.981096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:08.981098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.981104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.981106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.981109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.981111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.981116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.981133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:08.988701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:08.990222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:08.990231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:08.990232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:08.990234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:08.990238Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1409 [2:7556554844443158570:8802]
2025-10-02T09:32:08.990246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:08.990255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:08.990257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.990258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.990259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.990267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:08.990270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:08.990274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:08.990303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.990308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.990309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.990311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:08.990312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:08.990348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:08.990353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.990359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:08.990364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:08.990375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:08.990388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697725:4649], now have 1 active actors on pipe
2025-10-02T09:32:08.990395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554844518697487:2446], now have 1 active actors on pipe
2025-10-02T09:32:08.990399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.990404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.990406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.990418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:08.990430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:08.990431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:08.990436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:08.990437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:08.990442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:08.990444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:08.990433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1409
2025-10-02T09:32:08.990440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1409
2025-10-02T09:32:08.990459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.990466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:08.990467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:08.990476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.990481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.990508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7188ac32-840d1fd9-678e1530-193cfd00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:08.990515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:08.990517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:08.990519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:08.990524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:08.990529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:08.990539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.990641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:08.990647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:08.990657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:08.990724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1410 partition: 0 MaxSeqNo: 36 sessionId: src_id|7188ac32-840d1fd9-678e1530-193cfd00_0
2025-10-02T09:32:08.990977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeed1420-bf3c8a4a-da2eae65-cda23969_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7188ac32-840d1fd9-678e1530-193cfd00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:08.993842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Write session: try to update token
2025-10-02T09:32:08.993857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:08.999559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:08.999571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:08.999573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:08.999573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:08.999577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.999579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.999581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554844443158564:8802]
2025-10-02T09:32:08.999600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:08.999603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:08.999604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:08.999606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:08.999609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:08.999611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:08.999704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.007331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId: src_id|7188ac32-840d1fd9-678e1530-193cfd00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.009401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.067045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813665033:4709]
2025-10-02T09:32:09.067230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1409, pipe: [1:7556554848813665033:4709]
2025-10-02T09:32:09.109851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:09.110075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.110084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.110096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665033:4709], now have 1 active actors on pipe
2025-10-02T09:32:09.110252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:09.110333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813665033:4709]
2025-10-02T09:32:09.110346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:09.110358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:09.110409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1410 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7188ac32-840d1fd9-678e1530-193cfd00_0
2025-10-02T09:32:09.110534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1410 sessionId: src_id|7188ac32-840d1fd9-678e1530-193cfd00_0 is DEAD
2025-10-02T09:32:09.110679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:09.110694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Write session will restart in 0.006890s
2025-10-02T09:32:09.110717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Write session: Do CDS request
2025-10-02T09:32:09.110723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:09.118174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.118265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:09.118273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1411
2025-10-02T09:32:09.118386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.118406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:09.118411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:09.118413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:09.118713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1411 sessionId:  describe result for acl check
2025-10-02T09:32:09.118739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:09.118744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:09.118745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:09.118749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554848813665094:4645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:09.119113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554848813665094:4645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:09.121508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554848813665094:4645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:09.123964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554848813665094:4645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:09.123973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554848813665094:4645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:09.123975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554848813665094:4645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:09.123978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:09.125147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:09.127161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:09.127272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:09.127278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:09.127284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:09.127311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:09.127351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554848738126109:8804]
2025-10-02T09:32:09.127700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:09.127899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:09.127925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:09.128111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:09.128141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.128146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.128146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.128147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.128147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.128148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.128148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.128149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.128149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.128150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.128150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.128150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.128153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.128159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.128161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.128163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.128165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.128167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.128169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.128171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.128173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.128175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.128177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.128179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.128183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.128187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.128190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.128193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.128195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.128197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.128200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.128202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.128206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.128208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.128211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.128213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.128215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.128218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.128224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.128226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.128228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.128231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.128233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.128235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.128237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.128240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.128242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.128244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.128262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:09.135843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:09.137425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:09.137433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:09.137434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:09.137436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:09.137439Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1410 [2:7556554848738126109:8804]
2025-10-02T09:32:09.137445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:09.137453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:09.137455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.137456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.137457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.137465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:09.137467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:09.137471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:09.137502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.137507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.137508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.137509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:09.137511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:09.137547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:09.137553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.137559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.137564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.137574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:09.137588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665034:2446], now have 1 active actors on pipe
2025-10-02T09:32:09.137594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665266:4645], now have 1 active actors on pipe
2025-10-02T09:32:09.137599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.137604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.137606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.137615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:09.137629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:09.137628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:09.137630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:09.137632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:09.137643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:09.137646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:09.137647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1410
2025-10-02T09:32:09.137658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1410
2025-10-02T09:32:09.137661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.137668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:09.137670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:09.137687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.137690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.137709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6181e28c-c509cee2-e554064-77525476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:09.137716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.137718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.137719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:09.137726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.137732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:09.137750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.137872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.137878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.137887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.137950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1411 partition: 0 MaxSeqNo: 36 sessionId: src_id|6181e28c-c509cee2-e554064-77525476_0
2025-10-02T09:32:09.138220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7188ac32-840d1fd9-678e1530-193cfd00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6181e28c-c509cee2-e554064-77525476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:09.141076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Write session: try to update token
2025-10-02T09:32:09.141090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:09.146725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:09.146737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:09.146738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:09.146739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:09.146742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.146744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.146746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554848738126104:8804]
2025-10-02T09:32:09.146765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:09.146768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.146769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:09.146773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:09.146777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:09.146782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:09.146886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.154830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId: src_id|6181e28c-c509cee2-e554064-77525476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.156964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.210391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813665287:4709]
2025-10-02T09:32:09.210610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1410, pipe: [1:7556554848813665287:4709]
2025-10-02T09:32:09.258160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:09.258368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.258377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.258389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665287:4709], now have 1 active actors on pipe
2025-10-02T09:32:09.258536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:09.258548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813665287:4709]
2025-10-02T09:32:09.258568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:09.258572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:09.258574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:09.258646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1411 reason: error at write: Disconnected sessionId: src_id|6181e28c-c509cee2-e554064-77525476_0
2025-10-02T09:32:09.258800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1411 sessionId: src_id|6181e28c-c509cee2-e554064-77525476_0 is DEAD
2025-10-02T09:32:09.258964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:09.258978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Write session will restart in 0.006666s
2025-10-02T09:32:09.259003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Write session: Do CDS request
2025-10-02T09:32:09.259008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:09.267156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.267297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:09.267304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1412
2025-10-02T09:32:09.267413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.267433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:09.267439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:09.267441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:09.267770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1412 sessionId:  describe result for acl check
2025-10-02T09:32:09.267797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:09.267801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:09.267802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:09.267806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554848813665363:4632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:09.268159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554848813665363:4632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:09.270124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554848813665363:4632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:09.272438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554848813665363:4632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:09.272445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554848813665363:4632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:09.272447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554848813665363:4632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:09.272450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:09.273377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:09.275318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:09.275424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:09.275431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:09.275437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:09.275464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:09.275486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554848738126354:8807]
2025-10-02T09:32:09.275823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:09.276011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:09.276035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:09.276213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:09.276325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.276330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.276330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.276331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.276331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.276332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.276332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.276333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.276334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.276334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.276335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.276335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.276338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.276344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.276346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.276348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.276350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.276352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.276354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.276356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.276358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.276360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.276362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.276364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.276369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.276373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.276376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.276379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.276381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.276384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.276386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.276388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.276394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.276396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.276399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.276405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.276407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.276409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.276411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.276414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.276416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.276418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.276422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.276424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.276426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.276432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.276434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.276436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.276453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:09.283818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:09.285162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:09.285172Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:09.285173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:09.285175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:09.285178Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1411 [2:7556554848738126354:8807]
2025-10-02T09:32:09.285185Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:09.285195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:09.285198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.285200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.285201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.285209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:09.285212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:09.285220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:09.285248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.285252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.285254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.285255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:09.285257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:09.285291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:09.285295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.285301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.285306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.285317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:09.285332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665525:4632], now have 1 active actors on pipe
2025-10-02T09:32:09.285337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665288:2446], now have 1 active actors on pipe
2025-10-02T09:32:09.285342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.285345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.285348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.285357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:09.285368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:09.285371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:09.285374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:09.285376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:09.285384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:09.285386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:09.285397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1411
2025-10-02T09:32:09.285398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1411
2025-10-02T09:32:09.285400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.285406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:09.285419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:09.285426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.285432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.285455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:09.285464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.285471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.285472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:09.285479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.285486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:09.285499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.285597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.285603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.285611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.285687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1412 partition: 0 MaxSeqNo: 36 sessionId: src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0
2025-10-02T09:32:09.285949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6181e28c-c509cee2-e554064-77525476_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:09.288689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Write session: try to update token
2025-10-02T09:32:09.288710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:09.294467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:09.294478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:09.294479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:09.294480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:09.294483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.294488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.294489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554848738126349:8807]
2025-10-02T09:32:09.294507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:09.294513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:09.294514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.294515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:09.294517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:09.294520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:09.294617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.301895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId: src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.303925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.358877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813665540:4709]
2025-10-02T09:32:09.359174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1411, pipe: [1:7556554848813665540:4709]
2025-10-02T09:32:09.406310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:09.406539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.406551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.406562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665540:4709], now have 1 active actors on pipe
2025-10-02T09:32:09.406692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813665540:4709]
2025-10-02T09:32:09.406715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:09.406718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:09.406706Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:09.406798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1412 reason: error at write: Disconnected sessionId: src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0
2025-10-02T09:32:09.406953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1412 sessionId: src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0 is DEAD
2025-10-02T09:32:09.407073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:09.407091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:09.407099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Write session will restart in 0.009302s
2025-10-02T09:32:09.407115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Write session: Do CDS request
2025-10-02T09:32:09.407120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:09.417097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.417219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:09.417229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1413
2025-10-02T09:32:09.417325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.417345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:09.417352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:09.417354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:09.417609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1413 sessionId:  describe result for acl check
2025-10-02T09:32:09.417625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:09.417629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:09.417630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:09.417633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554848813665753:4624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:09.417926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554848813665753:4624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:09.418756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:09.419173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554848813665753:4624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:09.420510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:09.420626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:09.420632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:09.420638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:09.420668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:09.420689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554848738126610:8815]
2025-10-02T09:32:09.421141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:09.421231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554848813665753:4624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:09.421241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554848813665753:4624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:09.421242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554848813665753:4624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:09.421246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:09.421346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:09.421372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:09.421551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:09.421581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.421584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.421585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.421586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.421586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.421586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.421587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.421588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.421588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.421588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.421589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.421589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.421592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.421598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.421600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.421603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.421604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.421606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.421608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.421610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.421612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.421614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.421616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.421618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.421621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.421625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.421628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.421631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.421633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.421636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.421638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.421641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.421643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.421646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.421648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.421650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.421652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.421655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.421657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.421660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.421662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.421664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.421666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.421669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.421671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.421674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.421676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.421678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.421696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:09.429033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:09.430379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:09.430389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:09.430390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:09.430392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:09.430395Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1412 [2:7556554848738126610:8815]
2025-10-02T09:32:09.430401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:09.430411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:09.430413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.430414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.430415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.430424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:09.430426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:09.430430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:09.430459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.430464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.430465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.430467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:09.430468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:09.430501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:09.430505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.430511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.430516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.430524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:09.430536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.430541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.430542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.430550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:09.430557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:09.430568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:09.430569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:09.430582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.430582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:09.430584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:09.430585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:09.430588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:09.430589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:09.430659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665554:2446], now have 1 active actors on pipe
2025-10-02T09:32:09.430666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665795:4624], now have 1 active actors on pipe
2025-10-02T09:32:09.430689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1412
2025-10-02T09:32:09.430727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1412
2025-10-02T09:32:09.430763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.430770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.430789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f549ad94-1a735aef-88d89f0e-f608da47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:09.430796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.430799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.430801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:09.430806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.430821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:09.430831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.430943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.430947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.430954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.431010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1413 partition: 0 MaxSeqNo: 36 sessionId: src_id|f549ad94-1a735aef-88d89f0e-f608da47_0
2025-10-02T09:32:09.431262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ddbcc8-bc1b12ab-2c10780f-bcfc3840_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f549ad94-1a735aef-88d89f0e-f608da47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:09.434012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Write session: try to update token
2025-10-02T09:32:09.434030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:09.439684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:09.439695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:09.439696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:09.439698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:09.439701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.439703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.439706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554848738126605:8815]
2025-10-02T09:32:09.439726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:09.439729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.439731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:09.439731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:09.439734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:09.439736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:09.439849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.447954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId: src_id|f549ad94-1a735aef-88d89f0e-f608da47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.450045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.506853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813665814:4709]
2025-10-02T09:32:09.507034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1412, pipe: [1:7556554848813665814:4709]
2025-10-02T09:32:09.550525Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:09.550812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.550821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.550833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665814:4709], now have 1 active actors on pipe
2025-10-02T09:32:09.550970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:09.550964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:09.550972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:09.550972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813665814:4709]
2025-10-02T09:32:09.550986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:09.551014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1413 reason: error at write: Disconnected sessionId: src_id|f549ad94-1a735aef-88d89f0e-f608da47_0
2025-10-02T09:32:09.551146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1413 sessionId: src_id|f549ad94-1a735aef-88d89f0e-f608da47_0 is DEAD
2025-10-02T09:32:09.551298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:09.551312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Write session will restart in 0.007715s
2025-10-02T09:32:09.551340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Write session: Do CDS request
2025-10-02T09:32:09.551346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:09.560194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.560275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:09.560287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1414
2025-10-02T09:32:09.560418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.560439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:09.560445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:09.560448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:09.560874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1414 sessionId:  describe result for acl check
2025-10-02T09:32:09.560904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:09.560908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:09.560909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:09.560912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554848813665896:4612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:09.561275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554848813665896:4612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:09.563720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554848813665896:4612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:09.566326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554848813665896:4612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:09.566336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554848813665896:4612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:09.566338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554848813665896:4612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:09.566341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:09.567177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:09.568986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:09.569104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:09.569110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:09.569116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:09.569145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:09.569168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554848738126879:8823]
2025-10-02T09:32:09.569503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:09.569696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:09.569722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:09.569903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:09.569931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.569934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.569935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.569936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.569936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.569936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.569937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.569937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.569938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.569938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.569939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.569939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.569942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.569948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.569950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.569952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.569954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.569956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.569958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.569960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.569962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.569964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.569965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.569967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.569971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.569975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.569978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.569981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.569983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.569985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.569987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.569990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.569992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.569995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.569996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.569999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.570001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.570004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.570006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.570008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.570010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.570014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.570016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.570018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.570020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.570023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.570025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.570027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.570043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:09.577550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:09.578978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:09.578988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:09.578989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:09.578991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:09.578994Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1413 [2:7556554848738126879:8823]
2025-10-02T09:32:09.579001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:09.579011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:09.579012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.579014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.579015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.579024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:09.579030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:09.579034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:09.579062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.579067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.579068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.579070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:09.579071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:09.579106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:09.579110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.579117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.579124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.579132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:09.579149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666070:4612], now have 1 active actors on pipe
2025-10-02T09:32:09.579155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813665816:2446], now have 1 active actors on pipe
2025-10-02T09:32:09.579160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.579161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.579163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.579174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:09.579185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:09.579187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:09.579191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:09.579192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:09.579199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:09.579201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:09.579199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1413
2025-10-02T09:32:09.579219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.579225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:09.579202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1413
2025-10-02T09:32:09.579226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:09.579239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.579245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.579271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:09.579278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.579280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.579281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:09.579286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.579293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:09.579305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.579403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.579410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.579420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.579497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1414 partition: 0 MaxSeqNo: 36 sessionId: src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0
2025-10-02T09:32:09.579754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f549ad94-1a735aef-88d89f0e-f608da47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:09.582466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Write session: try to update token
2025-10-02T09:32:09.582480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:09.588298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:09.588310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:09.588311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:09.588312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:09.588315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.588317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.588320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554848738126874:8823]
2025-10-02T09:32:09.588339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:09.588342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.588343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:09.588343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:09.588345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:09.588347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:09.588450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.595318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId: src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.597510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.651247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813666085:4709]
2025-10-02T09:32:09.651492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1413, pipe: [1:7556554848813666085:4709]
2025-10-02T09:32:09.703572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:09.703862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.703870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.703883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666085:4709], now have 1 active actors on pipe
2025-10-02T09:32:09.704027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:09.704024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813666085:4709]
2025-10-02T09:32:09.704043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:09.704045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:09.704048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:09.704101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1414 reason: error at write: Disconnected sessionId: src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0
2025-10-02T09:32:09.704233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1414 sessionId: src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0 is DEAD
2025-10-02T09:32:09.704376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:09.704389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Write session will restart in 0.005807s
2025-10-02T09:32:09.704410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Write session: Do CDS request
2025-10-02T09:32:09.704415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:09.711102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.711232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:09.711242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1415
2025-10-02T09:32:09.711359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.711381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:09.711388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:09.711391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:09.711705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1415 sessionId:  describe result for acl check
2025-10-02T09:32:09.711731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:09.711735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:09.711736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:09.711739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554848813666137:4601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:09.712094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554848813666137:4601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:09.714207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554848813666137:4601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:09.717246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554848813666137:4601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:09.717255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554848813666137:4601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:09.717256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554848813666137:4601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:09.717260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:09.718856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:09.721218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:09.721362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:09.721369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:09.721375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:09.721406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:09.721429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554848738127125:8825]
2025-10-02T09:32:09.721846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:09.722045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:09.722070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:09.722269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:09.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.722303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.722304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.722304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.722305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.722305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.722306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.722307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.722307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.722307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.722308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.722308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.722312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.722317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.722320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.722322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.722324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.722326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.722328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.722330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.722332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.722335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.722336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.722338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.722343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.722347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.722350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.722353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.722355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.722358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.722360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.722363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.722365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.722367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.722369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.722372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.722374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.722376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.722378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.722381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.722383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.722386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.722388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.722391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.722393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.722396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.722398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.722400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.722419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:09.729949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:09.731474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:09.731484Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:09.731486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:09.731488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:09.731492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1414 [2:7556554848738127125:8825]
2025-10-02T09:32:09.731498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:09.731508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:09.731514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.731515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.731516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.731526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:09.731529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:09.731536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:09.731564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.731568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.731569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.731571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:09.731572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:09.731610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:09.731614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.731621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.731626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.731634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:09.731649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666310:4601], now have 1 active actors on pipe
2025-10-02T09:32:09.731655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666089:2446], now have 1 active actors on pipe
2025-10-02T09:32:09.731660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.731664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.731666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.731676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:09.731688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:09.731689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:09.731694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:09.731695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:09.731700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:09.731703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:09.731719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.731725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:09.731730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:09.731715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1414
2025-10-02T09:32:09.731724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1414
2025-10-02T09:32:09.731745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.731751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.731770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:09.731777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.731779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.731780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:09.731786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.731796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:09.731810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.731920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.731928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.731936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.732008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1415 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0
2025-10-02T09:32:09.732270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee1cd21-5c7767da-e2a4fcac-94c6e043_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:09.735089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Write session: try to update token
2025-10-02T09:32:09.735105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:09.741011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:09.741022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:09.741023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:09.741024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:09.741028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.741030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.741032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554848738127119:8825]
2025-10-02T09:32:09.741054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:09.741057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.741058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:09.741059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:09.741061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:09.741063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:09.741165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.748908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId: src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.751192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.804328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813666349:4709]
2025-10-02T09:32:09.804589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1414, pipe: [1:7556554848813666349:4709]
2025-10-02T09:32:09.853172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:09.853485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.853493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.853505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666349:4709], now have 1 active actors on pipe
2025-10-02T09:32:09.853620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:09.853643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:09.853656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:09.853662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:09.853690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813666349:4709]
2025-10-02T09:32:09.853700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1415 reason: error at write: Disconnected sessionId: src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0
2025-10-02T09:32:09.853829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1415 sessionId: src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0 is DEAD
2025-10-02T09:32:09.853988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:09.854001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Write session will restart in 0.009489s
2025-10-02T09:32:09.854027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Write session: Do CDS request
2025-10-02T09:32:09.854033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:09.864169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.864252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:09.864260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1416
2025-10-02T09:32:09.864384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:09.864405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:09.864411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:09.864414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:09.864752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1416 sessionId:  describe result for acl check
2025-10-02T09:32:09.864779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:09.864784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:09.864786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:09.864789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554848813666494:4593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:09.865138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554848813666494:4593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:09.867316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554848813666494:4593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:09.868740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:09.870779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:09.870868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554848813666494:4593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:09.870878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554848813666494:4593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:09.870880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554848813666494:4593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:09.870884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:09.870913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:09.870919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:09.870926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:09.870955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:09.870979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554848738127382:8828]
2025-10-02T09:32:09.871328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:09.871529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:09.871557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:09.871748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:09.871778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.871782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.871782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.871783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.871784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.871784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.871785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.871785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.871786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.871786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.871787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.871788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.871791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.871797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.871799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.871801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.871803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.871805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.871807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.871809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.871812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.871814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.871816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.871818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.871821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.871825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:09.871828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.871831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:09.871833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.871836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:09.871838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.871841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:09.871843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.871849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:09.871852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.871855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:09.871857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.871860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:09.871862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.871865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:09.871868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.871871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:09.871873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.871876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.871878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.871881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.871883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.871886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.871902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:09.879508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:09.880995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:09.881005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:09.881006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:09.881008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:09.881011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1415 [2:7556554848738127382:8828]
2025-10-02T09:32:09.881019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:09.881028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:09.881029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.881031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.881032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.881041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:09.881045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:09.881051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:09.881080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.881085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.881086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.881088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:09.881089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:09.881128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:09.881133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.881139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:09.881144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:09.881156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:09.881167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666367:2446], now have 1 active actors on pipe
2025-10-02T09:32:09.881172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666614:4593], now have 1 active actors on pipe
2025-10-02T09:32:09.881176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.881178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.881179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.881186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:09.881196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:09.881200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:09.881202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:09.881203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:09.881206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:09.881208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:09.881225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.881230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:09.881232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:09.881225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1415
2025-10-02T09:32:09.881237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1415
2025-10-02T09:32:09.881252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.881257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.881275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8105eec2-eb59dce-db64060b-182aee67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:09.881283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:09.881286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:09.881292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:09.881299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:09.881309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:09.881320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.881427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:09.881432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:09.881440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:09.881510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1416 partition: 0 MaxSeqNo: 36 sessionId: src_id|8105eec2-eb59dce-db64060b-182aee67_0
2025-10-02T09:32:09.881760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a01cb53-d64c601d-edcce78f-7aba02e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8105eec2-eb59dce-db64060b-182aee67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:09.884571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Write session: try to update token
2025-10-02T09:32:09.884584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:09.890302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:09.890313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:09.890315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:09.890316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:09.890320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.890323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.890325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554848738127377:8828]
2025-10-02T09:32:09.890344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:09.890348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:09.890349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:09.890350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:09.890351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:09.890352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:09.890458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:09.898371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId: src_id|8105eec2-eb59dce-db64060b-182aee67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:09.900561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:09.953826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554848813666628:4709]
2025-10-02T09:32:09.954023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1415, pipe: [1:7556554848813666628:4709]
2025-10-02T09:32:10.000638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.001011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.001020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.001032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554848813666628:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.001195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554848813666628:4709]
2025-10-02T09:32:10.001203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.001219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:10.001221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:10.001262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1416 reason: error at write: Disconnected sessionId: src_id|8105eec2-eb59dce-db64060b-182aee67_0
2025-10-02T09:32:10.001313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.001408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1416 sessionId: src_id|8105eec2-eb59dce-db64060b-182aee67_0 is DEAD
2025-10-02T09:32:10.001617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:10.001632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Write session will restart in 0.009311s
2025-10-02T09:32:10.001654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Write session: Do CDS request
2025-10-02T09:32:10.001659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.012189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.012273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.012284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1417
2025-10-02T09:32:10.012394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.012416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.012419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.012421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.012797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1417 sessionId:  describe result for acl check
2025-10-02T09:32:10.012837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.012841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.012843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.012846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108634079:4588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.013198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108634079:4588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.014968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108634079:4588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.015669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.018089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.018226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.018233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.018239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.018272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.018294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033094928:8831]
2025-10-02T09:32:10.018313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108634079:4588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.018323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108634079:4588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.018325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108634079:4588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.018328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.018631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.018829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.018861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.019044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.019073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.019076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.019077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.019077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.019078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.019078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.019079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.019079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.019080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.019080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.019081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.019081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.019084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.019090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.019092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.019094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.019096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.019098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.019100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.019102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.019104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.019106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.019108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.019109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.019113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.019117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.019120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.019122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.019125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.019127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.019129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.019132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.019134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.019137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.019139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.019141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.019143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.019146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.019148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.019150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.019153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.019155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.019158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.019160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.019163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.019165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.019167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.019170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.019187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.026671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.028159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.028170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.028171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.028173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.028176Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1416 [2:7556554853033094928:8831]
2025-10-02T09:32:10.028184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.028194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.028195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.028197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.028198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.028207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.028213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.028218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.028248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.028253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.028254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.028256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.028257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.028292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.028296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.028302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.028308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.028318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.028330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634171:4588], now have 1 active actors on pipe
2025-10-02T09:32:10.028337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108633925:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.028341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.028347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.028349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.028360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.028373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.028373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.028375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.028377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.028388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.028393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.028408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.028414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.028395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1416
2025-10-02T09:32:10.028405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1416
2025-10-02T09:32:10.028415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.028430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.028434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.028458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.028483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.028485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.028487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.028494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.028504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.028521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.028625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.028630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.028638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.028712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1417 partition: 0 MaxSeqNo: 36 sessionId: src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0
2025-10-02T09:32:10.028985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8105eec2-eb59dce-db64060b-182aee67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.031714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Write session: try to update token
2025-10-02T09:32:10.031727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.037721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.037733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.037734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.037735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.037738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.037741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.037743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033094923:8831]
2025-10-02T09:32:10.037762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.037765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.037766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.037767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.037770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.037772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.037883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.043856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId: src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.045914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:10.101293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554853108634182:4709]
2025-10-02T09:32:10.101544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1416, pipe: [1:7556554853108634182:4709]
2025-10-02T09:32:10.150765Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.151074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.151083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.151095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634182:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.151210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.151259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554853108634182:4709]
2025-10-02T09:32:10.151281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.151282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:10.151366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1417 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0
2025-10-02T09:32:10.151509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1417 sessionId: src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0 is DEAD
2025-10-02T09:32:10.151667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:10.151679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Write session will restart in 0.005352s
2025-10-02T09:32:10.151705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Write session: Do CDS request
2025-10-02T09:32:10.151711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.158166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.158275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.158284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1418
2025-10-02T09:32:10.158405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.158424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.158430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.158433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.158726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1418 sessionId:  describe result for acl check
2025-10-02T09:32:10.158751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.158756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.158757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.158760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108634227:4577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.159147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108634227:4577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.161266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108634227:4577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.163553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108634227:4577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.163563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108634227:4577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.163564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108634227:4577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.163568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.166315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.168549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.168661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.168668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.168673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.168699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.168721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033095178:8833]
2025-10-02T09:32:10.169072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.169271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.169297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.169476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.169505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.169508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.169509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.169510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.169510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.169511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.169511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.169512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.169512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.169512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.169513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.169514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.169516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.169522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.169524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.169526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.169528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.169530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.169532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.169534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.169536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.169538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.169540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.169541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.169545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.169549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.169552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.169555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.169557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.169560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.169562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.169564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.169566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.169569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.169571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.169574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.169576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.169578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.169580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.169583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.169585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.169588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.169590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.169593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.169595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.169598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.169600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.169602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.169618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.176981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.178396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.178407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.178408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.178410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.178413Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1417 [2:7556554853033095178:8833]
2025-10-02T09:32:10.178420Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.178430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.178435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.178436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.178437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.178446Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.178451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.178457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.178487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.178491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.178492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.178495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.178496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.178531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.178535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.178541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.178546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.178557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.178575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634183:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.178581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634368:4577], now have 1 active actors on pipe
2025-10-02T09:32:10.178585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.178590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.178592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.178601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.178614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.178615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.178616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.178617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.178626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.178628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.178609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1417
2025-10-02T09:32:10.178632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1417
2025-10-02T09:32:10.178646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.178652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.178653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.178662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.178668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.178700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f408806-139717f8-2122ed8d-6129b90e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.178709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.178715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.178717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.178722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.178731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.178745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.178858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.178865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.178873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.178943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1418 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f408806-139717f8-2122ed8d-6129b90e_0
2025-10-02T09:32:10.179202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94658fc-5efd9f4c-c413f2b6-efe37c54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f408806-139717f8-2122ed8d-6129b90e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.181930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Write session: try to update token
2025-10-02T09:32:10.181947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.187802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.187814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.187815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.187816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.187819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.187821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.187823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033095173:8833]
2025-10-02T09:32:10.187840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.187844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.187846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.187846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.187848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.187848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.187950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.194977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId: src_id|9f408806-139717f8-2122ed8d-6129b90e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.197147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:10.251290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554853108634443:4709]
2025-10-02T09:32:10.251493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1417, pipe: [1:7556554853108634443:4709]
2025-10-02T09:32:10.298388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.298698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.298707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.298719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634443:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.298874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.298898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:10.298907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:10.298917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554853108634443:4709]
2025-10-02T09:32:10.298935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.298948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1418 reason: error at write: Disconnected sessionId: src_id|9f408806-139717f8-2122ed8d-6129b90e_0
2025-10-02T09:32:10.299087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1418 sessionId: src_id|9f408806-139717f8-2122ed8d-6129b90e_0 is DEAD
2025-10-02T09:32:10.299237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:10.299250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Write session will restart in 0.008542s
2025-10-02T09:32:10.299272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Write session: Do CDS request
2025-10-02T09:32:10.299276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.309119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.309225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.309233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1419
2025-10-02T09:32:10.309314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.309339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.309347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.309350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.309724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1419 sessionId:  describe result for acl check
2025-10-02T09:32:10.309748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.309753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.309754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.309756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108634546:4575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.310108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108634546:4575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.312305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108634546:4575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.314515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.314645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108634546:4575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.314654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108634546:4575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.314656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108634546:4575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.314660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.316620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.316724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.316730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.316737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.316763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.316788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033095430:8836]
2025-10-02T09:32:10.317138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.317354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.317396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.317610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.317642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.317646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.317647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.317648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.317648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.317650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.317651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.317652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.317652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.317653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.317654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.317654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.317658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.317664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.317667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.317669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.317672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.317674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.317676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.317678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.317681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.317683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.317685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.317687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.317702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.317707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.317710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.317713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.317715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.317718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.317721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.317726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.317728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.317731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.317735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.317737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.317739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.317743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.317745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.317748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.317751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.317754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.317757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.317760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.317762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.317765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.317767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.317770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.317786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.325121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.326545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.326555Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.326556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.326559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.326562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1418 [2:7556554853033095430:8836]
2025-10-02T09:32:10.326570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.326580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.326583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.326585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.326586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.326595Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.326601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.326605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.326634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.326638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.326639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.326641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.326642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.326676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.326681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.326687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.326692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.326703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.326718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634691:4575], now have 1 active actors on pipe
2025-10-02T09:32:10.326725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634444:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.326729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.326732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.326734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.326745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.326756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.326757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.326758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.326759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.326768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.326770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.326789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.326795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.326781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1418
2025-10-02T09:32:10.326790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1418
2025-10-02T09:32:10.326800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.326823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.326831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.326854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|228b475c-b2a0f140-87bc645d-267fdb78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.326863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.326865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.326869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.326875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.326883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.326893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.327013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.327018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.327027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.327087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1419 partition: 0 MaxSeqNo: 36 sessionId: src_id|228b475c-b2a0f140-87bc645d-267fdb78_0
2025-10-02T09:32:10.327324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f408806-139717f8-2122ed8d-6129b90e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|228b475c-b2a0f140-87bc645d-267fdb78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.330134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Write session: try to update token
2025-10-02T09:32:10.330152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.335790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.335801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.335802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.335803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.335807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.335809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.335811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033095424:8836]
2025-10-02T09:32:10.335831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.335835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.335837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.335838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.335839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.335840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.335975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.344472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId: src_id|228b475c-b2a0f140-87bc645d-267fdb78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.346614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:10.399266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554853108634703:4709]
2025-10-02T09:32:10.399479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1418, pipe: [1:7556554853108634703:4709]
2025-10-02T09:32:10.445751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.446030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.446039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.446051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634703:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.446158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.446244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554853108634703:4709]
2025-10-02T09:32:10.446268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.446289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:10.446332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1419 reason: status is not ok: tablet will be restarted right now sessionId: src_id|228b475c-b2a0f140-87bc645d-267fdb78_0
2025-10-02T09:32:10.446473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1419 sessionId: src_id|228b475c-b2a0f140-87bc645d-267fdb78_0 is DEAD
2025-10-02T09:32:10.446633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:10.446646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Write session will restart in 0.009169s
2025-10-02T09:32:10.446671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Write session: Do CDS request
2025-10-02T09:32:10.446677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.457161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.457292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.457302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1420
2025-10-02T09:32:10.457414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.457433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.457438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.457440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.457814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1420 sessionId:  describe result for acl check
2025-10-02T09:32:10.457837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.457842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.457842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.457845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108634863:4552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.458129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108634863:4552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.459656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108634863:4552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.461058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.462964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.463097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.463105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.463113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.463149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.463176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033095716:8844]
2025-10-02T09:32:10.463294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108634863:4552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.463304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108634863:4552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.463306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108634863:4552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.463309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.463564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.463765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.463788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.463965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.463992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.463995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.463996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.463996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.463997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.463997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.463998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.463998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.463999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.463999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.464000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.464000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.464003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.464009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.464011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.464013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.464015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.464017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.464019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.464021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.464023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.464025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.464027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.464029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.464032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.464036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.464039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.464042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.464044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.464046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.464048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.464051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.464053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.464056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.464058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.464064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.464066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.464069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.464071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.464074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.464076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.464078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.464080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.464083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.464087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.464089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.464091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.464094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.464110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.471497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.472889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.472897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.472898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.472901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.472904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1419 [2:7556554853033095716:8844]
2025-10-02T09:32:10.472911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.472919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.472921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.472922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.472923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.472931Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.472937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.472941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.472969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.472973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.472974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.472976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.472977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.473012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.473016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.473023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.473030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.473038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.473054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634717:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.473061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634974:4552], now have 1 active actors on pipe
2025-10-02T09:32:10.473065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.473067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.473068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.473077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.473090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.473092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.473095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.473096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.473105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.473107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.473108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1419
2025-10-02T09:32:10.473109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1419
2025-10-02T09:32:10.473127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.473133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.473134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.473149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.473155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.473303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|300f450a-8eb27377-f0360771-71430377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.473313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.473315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.473316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.473322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.473327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.473344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.473485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.473490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.473497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.473563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1420 partition: 0 MaxSeqNo: 36 sessionId: src_id|300f450a-8eb27377-f0360771-71430377_0
2025-10-02T09:32:10.473809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|228b475c-b2a0f140-87bc645d-267fdb78_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|300f450a-8eb27377-f0360771-71430377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.476621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Write session: try to update token
2025-10-02T09:32:10.476634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.482122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.482134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.482135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.482136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.482140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.482142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.482144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033095711:8844]
2025-10-02T09:32:10.482163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.482165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.482167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.482174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.482184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.482186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.482268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.492127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId: src_id|300f450a-8eb27377-f0360771-71430377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.494326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:10.546218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554853108634986:4709]
2025-10-02T09:32:10.546511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1419, pipe: [1:7556554853108634986:4709]
2025-10-02T09:32:10.592722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.592942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.592951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.592963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634986:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.593097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.593152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554853108634986:4709]
2025-10-02T09:32:10.593176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:10.593197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.593231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1420 reason: status is not ok: tablet will be restarted right now sessionId: src_id|300f450a-8eb27377-f0360771-71430377_0
2025-10-02T09:32:10.593379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1420 sessionId: src_id|300f450a-8eb27377-f0360771-71430377_0 is DEAD
2025-10-02T09:32:10.593530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:10.593545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Write session will restart in 0.007556s
2025-10-02T09:32:10.593572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Write session: Do CDS request
2025-10-02T09:32:10.593578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.602139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.602249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.602259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1421
2025-10-02T09:32:10.602365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.602388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.602396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.602398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.602928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1421 sessionId:  describe result for acl check
2025-10-02T09:32:10.602965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.602973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.602974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.602978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108635063:4553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.603397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108635063:4553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.605930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108635063:4553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.608225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108635063:4553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.608240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108635063:4553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.608242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108635063:4553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.608246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.609336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.611788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.611901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.611907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.611913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.611938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.611961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033095969:8852]
2025-10-02T09:32:10.612309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.612511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.612535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.612715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.612744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.612748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.612748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.612749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.612749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.612750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.612750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.612751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.612751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.612752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.612752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.612753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.612755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.612762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.612764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.612766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.612768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.612770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.612772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.612774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.612776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.612778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.612780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.612782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.612785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.612789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.612792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.612794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.612797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.612799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.612812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.612814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.612817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.612819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.612821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.612824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.612826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.612828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.612830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.612833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.612836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.612838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.612840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.612843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.612845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.612848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.612850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.612857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.612875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.620295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.621789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.621800Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.621801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.621803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.621807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1420 [2:7556554853033095969:8852]
2025-10-02T09:32:10.621814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.621822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.621824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.621825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.621826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.621835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.621841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.621846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.621876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.621881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.621881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.621883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.621885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.621920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.621925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.621931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.621936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.621944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.621960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635233:4553], now have 1 active actors on pipe
2025-10-02T09:32:10.621966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108634987:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.621971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.621974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.621976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.621986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.621998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.622001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.622003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.622004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.622012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.622015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.622030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.622039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.622018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1420
2025-10-02T09:32:10.622043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.622065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.622072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.622090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.622098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.622102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.622105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.622112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.622102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1420
2025-10-02T09:32:10.622118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.622133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.622272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.622277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.622285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.622351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1421 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0
2025-10-02T09:32:10.622622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f450a-8eb27377-f0360771-71430377_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.625477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Write session: try to update token
2025-10-02T09:32:10.625492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.634970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:10.634978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.634983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.635005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:10.635012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:10.635132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:10.635241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:10.635344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:10.635455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:10.635603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:10.635628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:10.639083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId: src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.639369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.639379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.639380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.639381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.639385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.639387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.639389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033095964:8852]
2025-10-02T09:32:10.639406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.639409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.639409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.639410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.639411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.639413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.639517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.641434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:10.693148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554853108635248:4709]
2025-10-02T09:32:10.693391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1420, pipe: [1:7556554853108635248:4709]
2025-10-02T09:32:10.751751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.752188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.752197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.752210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635248:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.752342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.752355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554853108635248:4709]
2025-10-02T09:32:10.752380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:10.752381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:10.752385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.752426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1421 reason: error at write: Disconnected sessionId: src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0
2025-10-02T09:32:10.752575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1421 sessionId: src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0 is DEAD
2025-10-02T09:32:10.752729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:10.752739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Write session will restart in 0.008329s
2025-10-02T09:32:10.752763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Write session: Do CDS request
2025-10-02T09:32:10.752770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.762137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.762245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.762255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1422
2025-10-02T09:32:10.762378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.762399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.762405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.762408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.762784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1422 sessionId:  describe result for acl check
2025-10-02T09:32:10.762831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.762838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.762839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.762843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108635345:4548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.763256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108635345:4548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.765887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108635345:4548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.767842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108635345:4548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.767854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108635345:4548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.767857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108635345:4548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.767862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.767920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.770028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.770139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.770145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.770150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.770177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.770199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033096234:8855]
2025-10-02T09:32:10.770541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.770733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.770756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.770945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.770974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.770978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.770979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.770979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.770980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.770980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.770981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.770981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.770982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.770982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.770983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.770983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.770986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.770993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.770995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.770997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.770999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.771001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.771003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.771005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.771007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.771009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.771011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.771013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.771016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.771020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.771023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.771026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.771028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.771031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.771033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.771036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.771039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.771046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.771048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.771051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.771053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.771056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.771058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.771060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.771063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.771066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.771068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.771070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.771072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.771075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.771079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.771081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.771098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.778496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.780022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.780033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.780034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.780036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.780038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1421 [2:7556554853033096234:8855]
2025-10-02T09:32:10.780046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.780056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.780059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.780060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.780061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.780070Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.780074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.780079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.780107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.780112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.780113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.780115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.780116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.780151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.780156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.780162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.780168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.780175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.780190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635249:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.780196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635498:4548], now have 1 active actors on pipe
2025-10-02T09:32:10.780201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.780202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.780204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.780214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.780226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.780227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.780233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.780234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.780238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.780241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.780240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1421
2025-10-02T09:32:10.780256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.780262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.780263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.780270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1421
2025-10-02T09:32:10.780296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.780303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.780318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.780328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.780333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.780334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.780342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.780352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.780363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.780496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.780501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.780510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.780581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1422 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0
2025-10-02T09:32:10.780852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9311f18-1a565fd4-2def78b1-ae161d0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.783669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Write session: try to update token
2025-10-02T09:32:10.783683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.789364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.789375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.789376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.789377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.789380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.789382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.789384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033096228:8855]
2025-10-02T09:32:10.789402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.789405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.789406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.789408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.789412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.789413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.789514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.796958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId: src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.799070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:10.852369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554853108635528:4709]
2025-10-02T09:32:10.852546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1421, pipe: [1:7556554853108635528:4709]
2025-10-02T09:32:10.899542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:10.899755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.899764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.899777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635528:4709], now have 1 active actors on pipe
2025-10-02T09:32:10.899944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:10.899982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:10.899985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554853108635528:4709]
2025-10-02T09:32:10.899991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:10.900033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1422 reason: error at write: Disconnected sessionId: src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0
2025-10-02T09:32:10.900180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1422 sessionId: src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0 is DEAD
2025-10-02T09:32:10.900258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:10.900341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:10.900355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Write session will restart in 0.005826s
2025-10-02T09:32:10.900376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Write session: Do CDS request
2025-10-02T09:32:10.900381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:10.907193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.907258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:10.907266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1423
2025-10-02T09:32:10.907405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:10.907426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:10.907432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:10.907435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:10.907873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1423 sessionId:  describe result for acl check
2025-10-02T09:32:10.907915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:10.907922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:10.907924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:10.907928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554853108635589:4538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:10.908349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554853108635589:4538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:10.910476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554853108635589:4538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:10.912909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554853108635589:4538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:10.912922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554853108635589:4538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:10.912925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554853108635589:4538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:10.912931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:10.914043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:10.916703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:10.916809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:10.916816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:10.916821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:10.916848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:10.916871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554853033096488:8857]
2025-10-02T09:32:10.917214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:10.917401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:10.917422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:10.917594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:10.917623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.917627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.917628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.917628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.917629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.917629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.917630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.917630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.917631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.917631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.917632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.917632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.917635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.917642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.917644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.917646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.917648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.917650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.917652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.917654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.917656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.917658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.917660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.917662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.917666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.917670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:10.917673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.917676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:10.917678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.917681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:10.917683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.917685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:10.917688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.917690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:10.917692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.917695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:10.917697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.917700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:10.917702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.917704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:10.917708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.917710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:10.917713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.917715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.917718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.917720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.917725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.917727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.917743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:10.925123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:10.926591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:10.926600Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:10.926601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:10.926603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:10.926606Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1422 [2:7556554853033096488:8857]
2025-10-02T09:32:10.926613Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:10.926622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:10.926623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.926625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.926626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.926635Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:10.926641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:10.926646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:10.926675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.926679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.926681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.926683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:10.926684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:10.926719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:10.926723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.926729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:10.926734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:10.926745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:10.926758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.926762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.926763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.926768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:10.926773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:10.926778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635772:4538], now have 1 active actors on pipe
2025-10-02T09:32:10.926780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:10.926781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:10.926782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554853108635532:2446], now have 1 active actors on pipe
2025-10-02T09:32:10.926785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:10.926792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:10.926793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:10.926817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.926826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:10.926834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:10.926853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1422
2025-10-02T09:32:10.926857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1422
2025-10-02T09:32:10.926904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.926910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.926926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:10.926933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:10.926935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:10.926936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:10.926941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:10.926948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:10.926957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.927095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:10.927100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:10.927107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:10.927172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1423 partition: 0 MaxSeqNo: 36 sessionId: src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0
2025-10-02T09:32:10.927442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a348ab9-b6f44c36-a7ae9587-ba5af7b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:10.930175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Write session: try to update token
2025-10-02T09:32:10.930189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:10.935739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:10.935751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.935756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.935780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:10.935781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:10.935910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:10.936022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:10.936129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:10.936234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:10.936394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:10.936417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:10.943359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId: src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:10.944402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:10.944413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:10.944415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:10.944416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:10.944420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.944422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.944424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554853033096483:8857]
2025-10-02T09:32:10.944443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:10.944443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:10.944445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:10.944446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:10.944447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:10.944448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:10.944567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:10.945634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.000384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403603090:4709]
2025-10-02T09:32:11.000653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1422, pipe: [1:7556554857403603090:4709]
2025-10-02T09:32:11.054683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.054985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.054995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.055007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603090:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.055134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:11.055171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403603090:4709]
2025-10-02T09:32:11.055180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.055185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.055206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.055262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1423 reason: error at write: Disconnected sessionId: src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0
2025-10-02T09:32:11.055420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1423 sessionId: src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0 is DEAD
2025-10-02T09:32:11.055571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.055584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Write session will restart in 0.006587s
2025-10-02T09:32:11.055609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Write session: Do CDS request
2025-10-02T09:32:11.055614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.063145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.063255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.063266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1424
2025-10-02T09:32:11.063391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.063421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.063432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.063435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.063845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1424 sessionId:  describe result for acl check
2025-10-02T09:32:11.063871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.063877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.063880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.063883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403603157:4529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.064336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403603157:4529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.066870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403603157:4529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.068897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403603157:4529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.068909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403603157:4529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.068911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403603157:4529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.068916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.069418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.071808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.071904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.071910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.071916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.071942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.071964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328064042:8860]
2025-10-02T09:32:11.072317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.072503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.072527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.072703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.072731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.072734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.072735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.072736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.072736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.072737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.072737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.072738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.072739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.072739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.072739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.072740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.072742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.072749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.072751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.072753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.072755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.072757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.072759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.072761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.072763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.072765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.072767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.072769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.072773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.072776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.072780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.072783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.072785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.072787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.072789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.072792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.072794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.072797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.072810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.072813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.072815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.072817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.072821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.072823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.072826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.072829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.072833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.072836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.072838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.072840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.072842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.072845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.072861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.080252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.081752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.081764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.081765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.081767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.081770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1423 [2:7556554857328064042:8860]
2025-10-02T09:32:11.081778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.081788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.081790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.081791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.081792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.081801Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.081804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.081808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.081842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.081846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.081847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.081849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.081851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.081887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.081891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.081898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.081906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.081915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.081929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603342:4529], now have 1 active actors on pipe
2025-10-02T09:32:11.081934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603092:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.081937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.081938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.081939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.081947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.081956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.081960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.081962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.081963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.081966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.081968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.081980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.081985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.081987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.081995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1423
2025-10-02T09:32:11.081998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1423
2025-10-02T09:32:11.082056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.082061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.082077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.082083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.082085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.082087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.082092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.082100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.082109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.082251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.082256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.082265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.082343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1424 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0
2025-10-02T09:32:11.082608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a3e117-3b71299d-9f0b0334-d02a394e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.085377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Write session: try to update token
2025-10-02T09:32:11.085396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:11.091102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:11.091114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.091115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:11.091116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:11.091120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.091123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.091125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328064036:8860]
2025-10-02T09:32:11.091144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:11.091147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.091148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:11.091150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:11.091153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:11.091155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:11.091253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:11.098756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId: src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:11.101019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.155507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403603355:4709]
2025-10-02T09:32:11.155750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1423, pipe: [1:7556554857403603355:4709]
2025-10-02T09:32:11.202847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.203194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.203204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.203216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603355:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.203339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:11.203398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.203406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.203448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403603355:4709]
2025-10-02T09:32:11.203454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1424 reason: error at write: Disconnected sessionId: src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0
2025-10-02T09:32:11.203469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.203606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1424 sessionId: src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0 is DEAD
2025-10-02T09:32:11.203771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.203786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Write session will restart in 0.007273s
2025-10-02T09:32:11.203807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Write session: Do CDS request
2025-10-02T09:32:11.203812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.212193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.212282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.212291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1425
2025-10-02T09:32:11.212400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.212420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.212426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.212429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.212753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1425 sessionId:  describe result for acl check
2025-10-02T09:32:11.212786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.212796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.212797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.212814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403603427:4526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.213253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403603427:4526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.215550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403603427:4526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.218133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403603427:4526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.218144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403603427:4526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.218146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403603427:4526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.218151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.218936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.221387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.221558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.221565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.221572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.221602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.221626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328064297:8862]
2025-10-02T09:32:11.221971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.222145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.222166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.222342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.222369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.222373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.222373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.222374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.222374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.222375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.222375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.222376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.222377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.222377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.222378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.222378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.222381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.222388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.222390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.222392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.222395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.222397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.222399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.222401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.222403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.222405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.222407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.222409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.222412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.222416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.222419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.222422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.222424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.222427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.222429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.222432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.222434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.222436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.222439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.222441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.222444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.222446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.222448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.222452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.222454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.222457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.222459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.222461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.222463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.222466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.222473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.222475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.222493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.230080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.231450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.231460Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.231461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.231463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.231467Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1424 [2:7556554857328064297:8862]
2025-10-02T09:32:11.231473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.231483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.231484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.231486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.231487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.231496Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.231500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.231504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.231533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.231539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.231541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.231542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.231544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.231577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.231583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.231589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.231594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.231602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.231616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603357:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.231622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603609:4526], now have 1 active actors on pipe
2025-10-02T09:32:11.231625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.231626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.231627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.231635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.231645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.231648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.231651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.231652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.231654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.231655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.231668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.231673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.231674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.231689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1424
2025-10-02T09:32:11.231692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1424
2025-10-02T09:32:11.231716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.231722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.231737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.231744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.231745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.231746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.231751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.231759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.231766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.231893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.231900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.231912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.231997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1425 partition: 0 MaxSeqNo: 36 sessionId: src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0
2025-10-02T09:32:11.232277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc438457-e44c8c10-3d188ecd-78a956e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.235009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Write session: try to update token
2025-10-02T09:32:11.235024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:11.240765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:11.240777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.240782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.240815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:11.240820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:11.240950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:11.241061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.241168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.241276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.241468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:11.241509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:11.248385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId: src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:11.249354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:11.249365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.249366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:11.249368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:11.249372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.249374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.249376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328064291:8862]
2025-10-02T09:32:11.249394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:11.249398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.249399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:11.249408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:11.249417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:11.249419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:11.249516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:11.250743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.303478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403603623:4709]
2025-10-02T09:32:11.303721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1424, pipe: [1:7556554857403603623:4709]
2025-10-02T09:32:11.358720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.358990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.358998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.359011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603623:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.359161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:11.359162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.359202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403603623:4709]
2025-10-02T09:32:11.359225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.359244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.359321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1425 reason: error at write: Disconnected sessionId: src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0
2025-10-02T09:32:11.359493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1425 sessionId: src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0 is DEAD
2025-10-02T09:32:11.359624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.359638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Write session will restart in 0.005205s
2025-10-02T09:32:11.359663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Write session: Do CDS request
2025-10-02T09:32:11.359669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.366164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.366275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.366287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1426
2025-10-02T09:32:11.366429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.366457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.366465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.366468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.366854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1426 sessionId:  describe result for acl check
2025-10-02T09:32:11.366890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.366897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.366898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.366903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403603672:4515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.367343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403603672:4515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.369899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403603672:4515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.372684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403603672:4515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.372698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403603672:4515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.372701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403603672:4515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.372707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.374045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.376361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.376505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.376512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.376518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.376547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.376569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328064555:8865]
2025-10-02T09:32:11.377056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.377262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.377287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.377469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.377497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.377501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.377502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.377502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.377503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.377503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.377504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.377504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.377505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.377505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.377506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.377506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.377509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.377516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.377518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.377520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.377522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.377524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.377526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.377528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.377530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.377532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.377534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.377536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.377539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.377543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.377546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.377549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.377551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.377553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.377555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.377558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.377560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.377563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.377565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.377567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.377571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.377573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.377575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.377582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.377584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.377588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.377590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.377592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.377594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.377597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.377601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.377603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.377621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.385026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.386476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.386486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.386489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.386492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1425 [2:7556554857328064555:8865]
2025-10-02T09:32:11.386498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.386508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.386509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.386511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.386512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.386521Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.386527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.386531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.386559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.386563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.386564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.386566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.386568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.386605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.386610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.386616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.386621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.386632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.386646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603625:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.386651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603859:4515], now have 1 active actors on pipe
2025-10-02T09:32:11.386655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.386656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.386657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.386664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.386671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.386677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.386679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.386680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.386681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.386683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.386695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.386700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.386701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.386716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1425
2025-10-02T09:32:11.386716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1425
2025-10-02T09:32:11.386774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.386779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.386793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.386800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.386802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.386816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.386822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.386828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.386843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.387008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.387013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.387022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.387105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1426 partition: 0 MaxSeqNo: 36 sessionId: src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0
2025-10-02T09:32:11.387403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25d6ec5-eab2f66b-ff14ecf0-713e47bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.390221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Write session: try to update token
2025-10-02T09:32:11.390236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:11.395557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:11.395568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.395574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.395596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:11.395599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:11.395731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:11.395842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.395953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.396137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.396286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:11.396308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:11.403441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId: src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:11.403927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:11.403937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.403938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:11.403939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:11.403942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.403944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.403948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328064550:8865]
2025-10-02T09:32:11.403966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:11.403970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.403971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:11.403996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:11.404004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:11.404006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:11.404086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:11.405834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.459079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403603903:4709]
2025-10-02T09:32:11.459265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1425, pipe: [1:7556554857403603903:4709]
2025-10-02T09:32:11.515890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.516158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.516167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.516179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603903:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.516348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:11.516390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403603903:4709]
2025-10-02T09:32:11.516393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.516396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.516419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.516442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1426 reason: error at write: Disconnected sessionId: src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0
2025-10-02T09:32:11.516571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1426 sessionId: src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0 is DEAD
2025-10-02T09:32:11.516716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.516730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Write session will restart in 0.006008s
2025-10-02T09:32:11.516750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Write session: Do CDS request
2025-10-02T09:32:11.516756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.524146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.524249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.524261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1427
2025-10-02T09:32:11.524391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.524417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.524424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.524427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.524760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1427 sessionId:  describe result for acl check
2025-10-02T09:32:11.524788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.524789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.524790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.524793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403603994:4501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.525449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403603994:4501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.527507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403603994:4501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.529552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.529789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403603994:4501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.529798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403603994:4501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.529800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403603994:4501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.529803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.531489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.531597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.531603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.531609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.531636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.531658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328064849:8879]
2025-10-02T09:32:11.532027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.532222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.532261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.532460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.532489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.532490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.532490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.532491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.532501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.532502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.532502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.532503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.532503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.532504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.532504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.532505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.532508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.532513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.532515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.532517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.532519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.532521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.532523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.532525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.532527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.532529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.532531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.532533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.532537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.532541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.532544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.532546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.532549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.532551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.532553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.532556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.532558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.532561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.532563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.532566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.532568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.532571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.532573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.532575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.532578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.532581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.532583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.532585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.532587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.532589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.532591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.532594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.532609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.540023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.541524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.541534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.541535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.541537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.541541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1426 [2:7556554857328064849:8879]
2025-10-02T09:32:11.541548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.541558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.541564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.541565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.541566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.541575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.541578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.541582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.541611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.541616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.541617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.541619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.541620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.541656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.541661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.541667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.541673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.541681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.541693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.541699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.541701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.541709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.541717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.541722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.541723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604170:4501], now have 1 active actors on pipe
2025-10-02T09:32:11.541724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.541726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403603915:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.541731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.541740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.541745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.541757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.541766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.541775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.541757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1426
2025-10-02T09:32:11.541759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1426
2025-10-02T09:32:11.541794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.541800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.541813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b89ee42-f55e864e-642496f-add00c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.541819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.541822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.541823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.541828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.541834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.541842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.541949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.541957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.541968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.542040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1427 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b89ee42-f55e864e-642496f-add00c9_0
2025-10-02T09:32:11.542249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0f6e3-2fa15c1e-ec93d55a-e5ede899_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b89ee42-f55e864e-642496f-add00c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.544666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Write session: try to update token
2025-10-02T09:32:11.544675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:11.550714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:11.550729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.550735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.550764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:11.550767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:11.550926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:11.551046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.551162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.551273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:11.551434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:11.551460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:11.556627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId: src_id|8b89ee42-f55e864e-642496f-add00c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:11.558706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.559044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.559058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.559069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:11.559074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.559075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:11.559076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:11.559082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.559084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.559086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328064843:8879]
2025-10-02T09:32:11.559105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:11.559110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:11.559113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:11.559113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.559115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:11.559115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:11.559217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:11.616833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403604187:4709]
2025-10-02T09:32:11.617022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1426, pipe: [1:7556554857403604187:4709]
2025-10-02T09:32:11.671558Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.671816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:11.671842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604187:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.671938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:11.671954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.671986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403604187:4709]
2025-10-02T09:32:11.672006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.672012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.672063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1427 reason: error at write: Disconnected sessionId: src_id|8b89ee42-f55e864e-642496f-add00c9_0
2025-10-02T09:32:11.672173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1427 sessionId: src_id|8b89ee42-f55e864e-642496f-add00c9_0 is DEAD
2025-10-02T09:32:11.672292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.672302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Write session will restart in 0.007846s
2025-10-02T09:32:11.672316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Write session: Do CDS request
2025-10-02T09:32:11.672323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.681247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.681291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.681300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1428
2025-10-02T09:32:11.681445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.681469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.681477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.681484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.681809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1428 sessionId:  describe result for acl check
2025-10-02T09:32:11.681836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.681841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.681842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.681845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403604337:4488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.682187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403604337:4488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.683892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403604337:4488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.684362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.686104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.686197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.686205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.686210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.686236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.686259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328065107:8881]
2025-10-02T09:32:11.686350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403604337:4488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.686359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403604337:4488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.686361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403604337:4488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.686365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.686589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.686753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.686775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.686953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.686983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.686987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.686988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.686988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.686989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.686989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.686990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.686990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.686991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.686991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.686991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.686992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.686995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.687001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.687003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.687005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.687007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.687009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.687011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.687013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.687015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.687017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.687019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.687020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.687024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.687028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.687031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.687034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.687036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.687038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.687040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.687043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.687045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.687047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.687049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.687052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.687054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.687057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.687063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.687065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.687067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.687072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.687079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.687083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.687087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.687094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.687097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.687105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.687121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.694434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.696010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.696021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.696022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.696024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.696027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1427 [2:7556554857328065107:8881]
2025-10-02T09:32:11.696035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.696044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.696049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.696051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.696053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.696065Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.696072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.696078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.696114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.696119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.696120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.696122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.696123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.696159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.696164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.696170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.696175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.696186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.696200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604188:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.696205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604445:4488], now have 1 active actors on pipe
2025-10-02T09:32:11.696209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.696211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.696212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.696219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.696229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.696237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.696240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.696241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.696245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.696246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.696254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.696256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.696238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1427
2025-10-02T09:32:11.696258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.696242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1427
2025-10-02T09:32:11.696271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.696276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.696293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.696300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.696302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.696303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.696308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.696313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.696326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.696439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.696446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.696454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.696512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1428 partition: 0 MaxSeqNo: 36 sessionId: src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0
2025-10-02T09:32:11.696761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b89ee42-f55e864e-642496f-add00c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.699538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Write session: try to update token
2025-10-02T09:32:11.699553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:11.705264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:11.705276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.705277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:11.705278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:11.705282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.705284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.705286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328065102:8881]
2025-10-02T09:32:11.705304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:11.705306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.705307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:11.705313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:11.705316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:11.705318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:11.705413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:11.713368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId: src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:11.715476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.771935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403604456:4709]
2025-10-02T09:32:11.772134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1427, pipe: [1:7556554857403604456:4709]
2025-10-02T09:32:11.817203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.817540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.817549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.817561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604456:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.817709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.817722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403604456:4709]
2025-10-02T09:32:11.817739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.817741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.817779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1428 reason: error at write: Disconnected sessionId: src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0
2025-10-02T09:32:11.817922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1428 sessionId: src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0 is DEAD
2025-10-02T09:32:11.818078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.818091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Write session will restart in 0.005380s
2025-10-02T09:32:11.818113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Write session: Do CDS request
2025-10-02T09:32:11.818120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.818124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:11.824185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.824285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.824293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1429
2025-10-02T09:32:11.824410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.824430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.824436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.824438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.824699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1429 sessionId:  describe result for acl check
2025-10-02T09:32:11.824722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.824726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.824727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.824730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403604496:4484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.825082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403604496:4484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.827757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403604496:4484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.830317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403604496:4484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.830327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403604496:4484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.830329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403604496:4484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.830333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.833734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.836347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.836508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.836515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.836521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.836553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.836573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328065380:8884]
2025-10-02T09:32:11.836935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.837127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.837151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.837343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.837381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.837385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.837386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.837386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.837387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.837388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.837388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.837389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.837389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.837390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.837390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.837391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.837400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.837402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.837404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.837406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.837408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.837410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.837412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.837414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.837416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.837418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.837420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.837424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.837428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.837431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.837434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.837437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.837439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.837441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.837444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.837446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.837449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.837451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.837453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.837457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.837459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.837462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.837465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.837467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.837470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.837473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.837475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.837477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.837480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.837482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.837484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.837500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.844997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.846408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.846420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.846421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.846423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.846426Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1428 [2:7556554857328065380:8884]
2025-10-02T09:32:11.846433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.846443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.846444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.846446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.846447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.846456Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.846462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.846467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.846496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.846500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.846501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.846503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.846504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.846538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.846542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.846549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.846554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.846562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.846576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604639:4484], now have 1 active actors on pipe
2025-10-02T09:32:11.846581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604462:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.846585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.846586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.846587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.846592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.846599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.846605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.846607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.846607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.846608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.846609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.846621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.846625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.846630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.846616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1428
2025-10-02T09:32:11.846627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1428
2025-10-02T09:32:11.846642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.846647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.846665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.846671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.846673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.846674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.846679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.846684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.846691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.846838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.846843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.846853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.846924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1429 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0
2025-10-02T09:32:11.847171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fa9607-a77f5e2a-29ccb10-c50d9ff6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.849668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Write session: try to update token
2025-10-02T09:32:11.849681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:11.855755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:11.855768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:11.855769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:11.855770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:11.855774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.855777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.855779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328065375:8884]
2025-10-02T09:32:11.855798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:11.855801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.855802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:11.855804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:11.855807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:11.855809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:11.855908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:11.861474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId: src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:11.863572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:11.917858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554857403604746:4709]
2025-10-02T09:32:11.918063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1428, pipe: [1:7556554857403604746:4709]
2025-10-02T09:32:11.966724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:11.966954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.966964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.966976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604746:4709], now have 1 active actors on pipe
2025-10-02T09:32:11.967091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:11.967120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554857403604746:4709]
2025-10-02T09:32:11.967143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:11.967144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:11.967146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:11.967194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1429 reason: error at write: Disconnected sessionId: src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0
2025-10-02T09:32:11.967331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1429 sessionId: src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0 is DEAD
2025-10-02T09:32:11.967502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:11.967514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Write session will restart in 0.009671s
2025-10-02T09:32:11.967539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Write session: Do CDS request
2025-10-02T09:32:11.967546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:11.978188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.978252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:11.978260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1430
2025-10-02T09:32:11.978406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:11.978428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:11.978434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:11.978437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:11.978734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1430 sessionId:  describe result for acl check
2025-10-02T09:32:11.978761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:11.978766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:11.978767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:11.978770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554857403604881:4482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:11.979117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554857403604881:4482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:11.981061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554857403604881:4482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:11.982358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:11.984354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:11.984468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554857403604881:4482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:11.984477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554857403604881:4482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:11.984481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554857403604881:4482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:11.984484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:11.984503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:11.984511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:11.984517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:11.984548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:11.984570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554857328065642:8887]
2025-10-02T09:32:11.984925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:11.985120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:11.985145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:11.985319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:11.985350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.985353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.985354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.985355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.985355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.985356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.985356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.985357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.985357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.985358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.985358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.985359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.985362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.985368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.985370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.985372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.985374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.985376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.985377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.985379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.985381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.985383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.985385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.985387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.985390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.985395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:11.985398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.985401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:11.985403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.985406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:11.985408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.985411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:11.985413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.985415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:11.985417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.985420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:11.985422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.985425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:11.985426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.985430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:11.985432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.985435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:11.985437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.985439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.985442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.985444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.985450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.985452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.985469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:11.992832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:11.994321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:11.994330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:11.994331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:11.994333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:11.994336Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1429 [2:7556554857328065642:8887]
2025-10-02T09:32:11.994342Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:11.994353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:11.994355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.994356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.994357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.994366Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:11.994372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:11.994377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:11.994404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.994409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.994410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.994412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:11.994413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:11.994446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:11.994452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:11.994458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:11.994463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:11.994474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:11.994489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403604750:2446], now have 1 active actors on pipe
2025-10-02T09:32:11.994495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554857403605005:4482], now have 1 active actors on pipe
2025-10-02T09:32:11.994500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:11.994506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:11.994508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:11.994518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:11.994530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:11.994530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:11.994532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:11.994533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:11.994541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:11.994542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:11.994542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1429
2025-10-02T09:32:11.994554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:11.994559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:11.994547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1429
2025-10-02T09:32:11.994560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:11.994568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.994573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.994598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:11.994605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:11.994608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:11.994612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:11.994617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:11.994622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:11.994633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.994715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:11.994719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:11.994726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:11.994789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1430 partition: 0 MaxSeqNo: 36 sessionId: src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0
2025-10-02T09:32:11.995017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2ecf89-1d4f1d93-60a22fce-60decda4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:11.997723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Write session: try to update token
2025-10-02T09:32:11.997737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.003685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.003694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.003696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.003696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.003701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:12.003703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:12.003705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554857328065637:8887]
2025-10-02T09:32:12.003723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.003725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.003726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.003727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.003728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.003730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.003876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.010866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId: src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.013006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:12.067357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554861698572313:4709]
2025-10-02T09:32:12.067550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1429, pipe: [1:7556554861698572313:4709]
2025-10-02T09:32:12.113749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:12.114056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.114064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.114076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572313:4709], now have 1 active actors on pipe
2025-10-02T09:32:12.114213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:12.114235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:12.114259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554861698572313:4709]
2025-10-02T09:32:12.114268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:12.114318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1430 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0
2025-10-02T09:32:12.114446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1430 sessionId: src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0 is DEAD
2025-10-02T09:32:12.114577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:12.114592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Write session will restart in 0.009633s
2025-10-02T09:32:12.114614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Write session: Do CDS request
2025-10-02T09:32:12.114619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:12.125147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.125252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:12.125261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1431
2025-10-02T09:32:12.125362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.125384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:12.125391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:12.125394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:12.125697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1431 sessionId:  describe result for acl check
2025-10-02T09:32:12.125723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:12.125727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:12.125728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:12.125731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554861698572438:4468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:12.126067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554861698572438:4468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:12.128027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554861698572438:4468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:12.129838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554861698572438:4468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:12.129847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554861698572438:4468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:12.129848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554861698572438:4468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:12.129852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:12.129839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:12.131733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:12.131858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:12.131865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:12.131874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:12.131916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:12.131944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554861623033201:8889]
2025-10-02T09:32:12.132473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:12.132689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:12.132722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:12.132996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:12.133035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.133040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.133041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.133042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.133043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.133044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.133046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.133047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.133048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.133048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.133049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.133053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.133062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.133066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.133069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.133085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.133092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.133096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.133103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.133106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.133114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.133119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.133123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.133132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.133138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.133146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.133155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.133162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.133168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.133175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.133183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.133191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.133198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.133202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.133210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.133214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.133222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.133229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.133237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.133244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.133252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.133260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.133267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.133274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.133278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.133285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.133293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.133329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:12.140723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:12.142188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:12.142198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:12.142199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:12.142201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:12.142204Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1430 [2:7556554861623033201:8889]
2025-10-02T09:32:12.142210Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:12.142220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:12.142221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.142223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.142224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.142233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:12.142236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:12.142243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:12.142272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.142276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.142277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.142279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:12.142280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:12.142314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:12.142319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.142326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.142331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.142339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:12.142354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572314:2446], now have 1 active actors on pipe
2025-10-02T09:32:12.142359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572573:4468], now have 1 active actors on pipe
2025-10-02T09:32:12.142362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.142363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.142364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.142371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:12.142381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:12.142384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:12.142386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:12.142387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:12.142396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:12.142399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:12.142416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.142423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:12.142429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:12.142425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1430
2025-10-02T09:32:12.142427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1430
2025-10-02T09:32:12.142483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.142489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.142502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:12.142505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.142509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.142510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:12.142515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.142520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:12.142529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.142636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.142642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.142653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.142715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1431 partition: 0 MaxSeqNo: 36 sessionId: src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0
2025-10-02T09:32:12.142934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15cb2ba-e11ca76a-b45477f7-1e51a808_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:12.145351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Write session: try to update token
2025-10-02T09:32:12.145364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.151659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.151673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.151675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.151676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.151683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.151686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.151691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554861623033195:8889]
2025-10-02T09:32:12.151717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.151717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.151720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.151722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.151725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.151726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.151840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.157429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId: src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.159473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:12.214298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554861698572588:4709]
2025-10-02T09:32:12.214522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1430, pipe: [1:7556554861698572588:4709]
2025-10-02T09:32:12.279780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:12.280112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.280124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.280136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572588:4709], now have 1 active actors on pipe
2025-10-02T09:32:12.280274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:12.280317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554861698572588:4709]
2025-10-02T09:32:12.280330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:12.280342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:12.280390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0
2025-10-02T09:32:12.280518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1431 sessionId: src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0 is DEAD
2025-10-02T09:32:12.280645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:12.280654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Write session will restart in 0.007822s
2025-10-02T09:32:12.280671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Write session: Do CDS request
2025-10-02T09:32:12.280676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:12.289163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.289321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:12.289328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1432
2025-10-02T09:32:12.289440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.289459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:12.289462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:12.289464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:12.289756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1432 sessionId:  describe result for acl check
2025-10-02T09:32:12.289783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:12.289788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:12.289789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:12.289792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554861698572660:4466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:12.290159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554861698572660:4466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:12.292227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554861698572660:4466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:12.294521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554861698572660:4466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:12.294528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554861698572660:4466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:12.294530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554861698572660:4466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:12.294533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:12.296442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:12.298228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:12.298351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:12.298358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:12.298366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:12.298400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:12.298426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554861623033466:8892]
2025-10-02T09:32:12.298963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:12.299175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:12.299206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:12.299464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:12.299505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.299510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.299511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.299512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.299513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.299514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.299515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.299516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.299517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.299517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.299518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.299519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.299523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.299532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.299535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.299539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.299542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.299546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.299549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.299552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.299556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.299559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.299565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.299568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.299573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.299583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.299589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.299593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.299601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.299605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.299610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.299614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.299621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.299626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.299631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.299635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.299643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.299647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.299652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.299657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.299661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.299666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.299671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.299675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.299680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.299688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.299693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.299701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.299732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:12.307174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:12.308735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:12.308747Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:12.308749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:12.308752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:12.308756Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1431 [2:7556554861623033466:8892]
2025-10-02T09:32:12.308765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:12.308780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:12.308782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.308784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.308785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.308796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:12.308816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:12.308824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:12.308862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.308868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.308869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.308872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:12.308874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:12.308915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:12.308921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.308932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.308944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.308963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:12.308981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572815:4466], now have 1 active actors on pipe
2025-10-02T09:32:12.308988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572589:2446], now have 1 active actors on pipe
2025-10-02T09:32:12.308992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.308997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.308998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.309009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:12.308998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1431
2025-10-02T09:32:12.309010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1431
2025-10-02T09:32:12.309020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:12.309021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:12.309027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:12.309028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:12.309033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:12.309035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:12.309060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.309067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.309079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.309088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:12.309095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:12.309106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a11beb27-173a7ee-132a165a-38963bbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:12.309115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.309117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.309121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:12.309128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.309134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:12.309150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.309264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.309272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.309282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.309356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1432 partition: 0 MaxSeqNo: 36 sessionId: src_id|a11beb27-173a7ee-132a165a-38963bbe_0
2025-10-02T09:32:12.309546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a261a0c4-f359bdb4-433e9bf7-901ae965_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a11beb27-173a7ee-132a165a-38963bbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:12.311688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Write session: try to update token
2025-10-02T09:32:12.311697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.318307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.318321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.318323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.318325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.318331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.318335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.318338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554861623033461:8892]
2025-10-02T09:32:12.318362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.318362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.318364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.318366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.318367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.318368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.318488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.322110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId: src_id|a11beb27-173a7ee-132a165a-38963bbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.323992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:12.380703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554861698572861:4709]
2025-10-02T09:32:12.380952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1431, pipe: [1:7556554861698572861:4709]
2025-10-02T09:32:12.441423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:12.441612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.441621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.441648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572861:4709], now have 1 active actors on pipe
2025-10-02T09:32:12.441870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:12.441889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554861698572861:4709]
2025-10-02T09:32:12.441907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:12.441909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:12.441945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:12.441949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1432 reason: error at write: Disconnected sessionId: src_id|a11beb27-173a7ee-132a165a-38963bbe_0
2025-10-02T09:32:12.442079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1432 sessionId: src_id|a11beb27-173a7ee-132a165a-38963bbe_0 is DEAD
2025-10-02T09:32:12.442207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:12.442215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Write session will restart in 0.005975s
2025-10-02T09:32:12.442228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Write session: Do CDS request
2025-10-02T09:32:12.442232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:12.449105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.449189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:12.449196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1433
2025-10-02T09:32:12.449271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.449290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:12.449296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:12.449299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:12.449645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1433 sessionId:  describe result for acl check
2025-10-02T09:32:12.449673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:12.449678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:12.449678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:12.449682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554861698572908:4460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:12.450065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554861698572908:4460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:12.452564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554861698572908:4460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:12.455433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554861698572908:4460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:12.455441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554861698572908:4460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:12.455443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554861698572908:4460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:12.455446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:12.457981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:12.459804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:12.459947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:12.459954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:12.459960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:12.459989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:12.460011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554861623033730:8894]
2025-10-02T09:32:12.460366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:12.460762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:12.460789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:12.460996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:12.461031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.461035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.461035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.461036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.461036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.461037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.461038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.461038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.461039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.461039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.461040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.461040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.461043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.461049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.461051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.461053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.461055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.461057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.461058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.461060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.461062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.461064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.461066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.461068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.461071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.461075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.461079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.461082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.461084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.461086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.461088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.461091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.461095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.461099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.461103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.461110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.461115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.461123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.461125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.461128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.461130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.461133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.461135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.461138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.461140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.461143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.461145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.461147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.461162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:12.468580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:12.470024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:12.470035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:12.470036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:12.470038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:12.470041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1432 [2:7556554861623033730:8894]
2025-10-02T09:32:12.470047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:12.470056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:12.470057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.470059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.470061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.470072Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:12.470080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:12.470085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:12.470112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.470118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.470119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.470120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:12.470122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:12.470155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:12.470159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.470166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.470171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.470180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:12.470193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698572862:2446], now have 1 active actors on pipe
2025-10-02T09:32:12.470198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573067:4460], now have 1 active actors on pipe
2025-10-02T09:32:12.470202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.470204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.470205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.470213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:12.470223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:12.470229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:12.470230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:12.470231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:12.470237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:12.470239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:12.470243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.470244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:12.470246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:12.470260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1432
2025-10-02T09:32:12.470262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1432
2025-10-02T09:32:12.470286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.470291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.470304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6ecd657-e89b18e3-81991935-d5912728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:12.470311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.470314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.470315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:12.470322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.470332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:12.470342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.470481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.470488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.470497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.470561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1433 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6ecd657-e89b18e3-81991935-d5912728_0
2025-10-02T09:32:12.470787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11beb27-173a7ee-132a165a-38963bbe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6ecd657-e89b18e3-81991935-d5912728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:12.473530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Write session: try to update token
2025-10-02T09:32:12.473546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.479248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.479261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.479262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.479263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.479267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.479269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.479271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554861623033725:8894]
2025-10-02T09:32:12.479289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.479292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.479293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.479294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.479297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.479299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.479393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.486473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId: src_id|b6ecd657-e89b18e3-81991935-d5912728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.488552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:12.542002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554861698573157:4709]
2025-10-02T09:32:12.542257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1432, pipe: [1:7556554861698573157:4709]
2025-10-02T09:32:12.591788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:12.592138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.592147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.592160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573157:4709], now have 1 active actors on pipe
2025-10-02T09:32:12.592319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554861698573157:4709]
2025-10-02T09:32:12.592328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:12.592353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:12.592355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:12.592404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1433 reason: error at write: Disconnected sessionId: src_id|b6ecd657-e89b18e3-81991935-d5912728_0
2025-10-02T09:32:12.592532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1433 sessionId: src_id|b6ecd657-e89b18e3-81991935-d5912728_0 is DEAD
2025-10-02T09:32:12.592617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:12.592679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:12.592692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Write session will restart in 0.008587s
2025-10-02T09:32:12.592716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Write session: Do CDS request
2025-10-02T09:32:12.592722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:12.602125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.602229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:12.602236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1434
2025-10-02T09:32:12.602354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.602373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:12.602379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:12.602382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:12.602665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1434 sessionId:  describe result for acl check
2025-10-02T09:32:12.602691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:12.602695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:12.602696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:12.602699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554861698573258:4446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:12.603062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554861698573258:4446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:12.605232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554861698573258:4446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:12.607434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554861698573258:4446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:12.607452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554861698573258:4446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:12.607454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554861698573258:4446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:12.607458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:12.609713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:12.609993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:12.610111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:12.610119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:12.610127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:12.610163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:12.610192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554861623034031:8908]
2025-10-02T09:32:12.610716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:12.610921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:12.610954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:12.611220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:12.611346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.611351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.611353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.611353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.611354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.611355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.611356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.611357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.611358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.611358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.611360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.611361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.611365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.611373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.611377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.611381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.611384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.611388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.611391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.611394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.611398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.611402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.611406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.611411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.611416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.611424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.611430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.611434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.611438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.611444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.611447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.611453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.611457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.611463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.611466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.611475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.611479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.611485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.611489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.611497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.611500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.611508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.611513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.611521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.611525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.611532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.611536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.611540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.611580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:12.618988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:12.620412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:12.620424Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:12.620426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:12.620429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:12.620434Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1433 [2:7556554861623034031:8908]
2025-10-02T09:32:12.620444Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:12.620459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:12.620465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.620467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.620468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.620480Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:12.620487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:12.620492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:12.620534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.620541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.620542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.620545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:12.620547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:12.620592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:12.620599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.620610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.620624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.620644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:12.620661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573418:4446], now have 1 active actors on pipe
2025-10-02T09:32:12.620668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573158:2446], now have 1 active actors on pipe
2025-10-02T09:32:12.620674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.620677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.620679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.620688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:12.620681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1433
2025-10-02T09:32:12.620686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1433
2025-10-02T09:32:12.620698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:12.620699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:12.620701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:12.620702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:12.620714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:12.620717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:12.620738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.620746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:12.620751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:12.620757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.620764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.620941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:12.620952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.620954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.620956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:12.620963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.620970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:12.620990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.621132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.621140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.621151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.621221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1434 partition: 0 MaxSeqNo: 36 sessionId: src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0
2025-10-02T09:32:12.621483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecd657-e89b18e3-81991935-d5912728_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:12.624144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Write session: try to update token
2025-10-02T09:32:12.624160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.629990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.630001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.630004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.630005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.630011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.630014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.630017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554861623034026:8908]
2025-10-02T09:32:12.630039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.630040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.630045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.630047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.630048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.630049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.630209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.638181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId: src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.640291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:12.692498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554861698573432:4709]
2025-10-02T09:32:12.692715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1433, pipe: [1:7556554861698573432:4709]
2025-10-02T09:32:12.755213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:12.755576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.755589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.755602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573432:4709], now have 1 active actors on pipe
2025-10-02T09:32:12.755763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:12.755782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:12.755772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:12.755804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554861698573432:4709]
2025-10-02T09:32:12.755815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1434 reason: error at write: Disconnected sessionId: src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0
2025-10-02T09:32:12.755828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:12.755946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1434 sessionId: src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0 is DEAD
2025-10-02T09:32:12.756080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:12.756092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Write session will restart in 0.006938s
2025-10-02T09:32:12.756112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Write session: Do CDS request
2025-10-02T09:32:12.756118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:12.764137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.764259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:12.764266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1435
2025-10-02T09:32:12.764361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.764380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:12.764386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:12.764389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:12.764668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1435 sessionId:  describe result for acl check
2025-10-02T09:32:12.764693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:12.764697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:12.764698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:12.764701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554861698573501:4440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:12.765053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554861698573501:4440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:12.767316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554861698573501:4440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:12.769481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554861698573501:4440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:12.769490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554861698573501:4440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:12.769492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554861698573501:4440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:12.769495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:12.771639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:12.774044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:12.774203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:12.774212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:12.774220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:12.774262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:12.774292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554861623034309:8911]
2025-10-02T09:32:12.774829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:12.775028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:12.775059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:12.775319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:12.775358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.775363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.775364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.775365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.775366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.775367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.775368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.775369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.775370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.775371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.775372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.775373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.775377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.775386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.775389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.775393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.775396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.775400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.775403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.775407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.775410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.775414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.775417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.775421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.775430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.775437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.775442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.775449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.775452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.775458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.775462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.775471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.775475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.775483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.775487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.775493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.775496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.775501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.775509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.775513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.775521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.775526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.775532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.775537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.775542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.775547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.775554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.775558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.775594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:12.783061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:12.784601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:12.784613Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:12.784614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:12.784617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:12.784621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1434 [2:7556554861623034309:8911]
2025-10-02T09:32:12.784632Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:12.784643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:12.784647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.784649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.784651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.784662Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:12.784670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:12.784674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:12.784711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.784717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.784718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.784721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:12.784722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:12.784768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:12.784774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.784784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.784798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.784830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:12.784846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573655:4440], now have 1 active actors on pipe
2025-10-02T09:32:12.784852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573433:2446], now have 1 active actors on pipe
2025-10-02T09:32:12.784856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.784859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.784860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.784870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:12.784882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:12.784883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:12.784889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:12.784890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:12.784895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:12.784897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:12.784889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1434
2025-10-02T09:32:12.784890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1434
2025-10-02T09:32:12.784914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.784921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:12.784922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:12.784936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.784942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.784965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3600df29-8fe0b038-200e597e-446833fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:12.784973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.784976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.784980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:12.784985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.784991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:12.785011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.785117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.785125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.785135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.785213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1435 partition: 0 MaxSeqNo: 36 sessionId: src_id|3600df29-8fe0b038-200e597e-446833fa_0
2025-10-02T09:32:12.785431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d303ed90-8d7e9c34-8c9ad6e-7bbdadcb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3600df29-8fe0b038-200e597e-446833fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:12.788101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Write session: try to update token
2025-10-02T09:32:12.788115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.793939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.793950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.793951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.793952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.793956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.793957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.793959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554861623034304:8911]
2025-10-02T09:32:12.793978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.793980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.793981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.793981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.793984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.793986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.794083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.800472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId: src_id|3600df29-8fe0b038-200e597e-446833fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.802701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:12.855824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554861698573725:4709]
2025-10-02T09:32:12.856052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1434, pipe: [1:7556554861698573725:4709]
2025-10-02T09:32:12.918341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:12.918715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.918725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.918740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573725:4709], now have 1 active actors on pipe
2025-10-02T09:32:12.918894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:12.918905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554861698573725:4709]
2025-10-02T09:32:12.918924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:12.918927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:12.918940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:12.918970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1435 reason: error at write: Disconnected sessionId: src_id|3600df29-8fe0b038-200e597e-446833fa_0
2025-10-02T09:32:12.919122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1435 sessionId: src_id|3600df29-8fe0b038-200e597e-446833fa_0 is DEAD
2025-10-02T09:32:12.919274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:12.919287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Write session will restart in 0.009482s
2025-10-02T09:32:12.919328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Write session: Do CDS request
2025-10-02T09:32:12.919333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:12.930175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.930274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:12.930281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1436
2025-10-02T09:32:12.930400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:12.930420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:12.930426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:12.930428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:12.930909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1436 sessionId:  describe result for acl check
2025-10-02T09:32:12.930941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:12.930946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:12.930948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:12.930952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554861698573876:4432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:12.931300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554861698573876:4432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:12.932846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554861698573876:4432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:12.934367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:12.936768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:12.936871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554861698573876:4432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:12.936882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554861698573876:4432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:12.936884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554861698573876:4432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:12.936887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:12.936964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:12.936971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:12.936978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:12.937016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:12.937043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554861623034575:8913]
2025-10-02T09:32:12.937407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:12.937604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:12.937631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:12.937880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:12.937917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.937922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.937923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.937924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.937925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.937926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.937927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.937928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.937929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.937930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.937931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.937932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.937936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.937945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.937947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.937949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.937951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.937953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.937955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.937958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.937962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.937965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.937968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.937972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.937977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.937983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:12.937992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.937996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:12.938004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.938009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:12.938016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.938020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:12.938029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.938035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:12.938039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.938047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:12.938051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.938057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:12.938061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.938067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:12.938071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.938080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:12.938083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.938089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.938093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.938098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.938101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.938106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.938141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:12.945590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:12.947051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:12.947060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:12.947061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:12.947063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:12.947066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1435 [2:7556554861623034575:8913]
2025-10-02T09:32:12.947073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:12.947081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:12.947083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.947084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.947085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.947093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:12.947099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:12.947104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:12.947131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.947135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.947136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.947138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:12.947139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:12.947173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:12.947178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.947184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:12.947193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:12.947201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:12.947215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573729:2446], now have 1 active actors on pipe
2025-10-02T09:32:12.947219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554861698573993:4432], now have 1 active actors on pipe
2025-10-02T09:32:12.947222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.947223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.947225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.947232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:12.947239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:12.947245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:12.947247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:12.947248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:12.947249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:12.947251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:12.947262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.947267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:12.947269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:12.947273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1435
2025-10-02T09:32:12.947277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1435
2025-10-02T09:32:12.947297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.947302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.947316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:12.947324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:12.947326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:12.947327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:12.947331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:12.947335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:12.947342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.947795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:12.947808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:12.947821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:12.947894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1436 partition: 0 MaxSeqNo: 36 sessionId: src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0
2025-10-02T09:32:12.948136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3600df29-8fe0b038-200e597e-446833fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:12.950859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Write session: try to update token
2025-10-02T09:32:12.950873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:12.956425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:12.956435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:12.956436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:12.956437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:12.956441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.956443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.956445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554861623034570:8913]
2025-10-02T09:32:12.956464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:12.956467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:12.956467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:12.956468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:12.956470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:12.956472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:12.956569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:12.963750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId: src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:12.965872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.019159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993541301:4709]
2025-10-02T09:32:13.019424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1435, pipe: [1:7556554865993541301:4709]
2025-10-02T09:32:13.066041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.066244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.066253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.066263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541301:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.066380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.066420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993541301:4709]
2025-10-02T09:32:13.066438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.066448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:13.066451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:13.066491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1436 reason: error at write: Disconnected sessionId: src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0
2025-10-02T09:32:13.066631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1436 sessionId: src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0 is DEAD
2025-10-02T09:32:13.066778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:13.066790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Write session will restart in 0.006678s
2025-10-02T09:32:13.066824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Write session: Do CDS request
2025-10-02T09:32:13.066830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.074148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.074235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.074243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1437
2025-10-02T09:32:13.074367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.074387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.074393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.074398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.074639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1437 sessionId:  describe result for acl check
2025-10-02T09:32:13.074658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.074663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.074664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.074667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993541357:4422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.075008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993541357:4422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.076658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993541357:4422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.079535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993541357:4422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.079544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993541357:4422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.079546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993541357:4422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.079549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.082229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.084599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.084699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.084705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.084711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.084740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.084771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918002142:8916]
2025-10-02T09:32:13.085120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.085300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.085325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.085500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.085529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.085533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.085534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.085534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.085534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.085535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.085535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.085536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.085536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.085537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.085537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.085538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.085541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.085547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.085549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.085551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.085553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.085555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.085557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.085559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.085561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.085563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.085565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.085567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.085571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.085574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.085577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.085580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.085583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.085585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.085587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.085591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.085593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.085595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.085597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.085600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.085602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.085605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.085607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.085609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.085612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.085618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.085620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.085624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.085626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.085629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.085631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.085633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.085650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:13.093017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:13.094385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:13.094395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:13.094396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:13.094398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:13.094401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1436 [2:7556554865918002142:8916]
2025-10-02T09:32:13.094408Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:13.094417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:13.094422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.094424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.094425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.094434Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:13.094437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:13.094441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:13.094468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.094473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.094474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.094476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:13.094477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:13.094617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1436
2025-10-02T09:32:13.094636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1436
2025-10-02T09:32:13.094679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:13.094685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.094692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.094699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.094708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:13.094720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541500:4422], now have 1 active actors on pipe
2025-10-02T09:32:13.094725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541302:2446], now have 1 active actors on pipe
2025-10-02T09:32:13.094735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.094740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.094752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.094757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.094758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.094766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:13.094777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:13.094778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:13.094780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:13.094782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:13.094788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:13.094790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:13.094799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|387742c1-8017fecd-63131c32-2dbe6414_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:13.094816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.094818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.094819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:13.094824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.094830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:13.094847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.094855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:13.094861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.094863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:13.094962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.094967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.094978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.095033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1437 partition: 0 MaxSeqNo: 36 sessionId: src_id|387742c1-8017fecd-63131c32-2dbe6414_0
2025-10-02T09:32:13.095313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe71f29-eb3ae673-d17f8e3e-869832d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|387742c1-8017fecd-63131c32-2dbe6414_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:13.098002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Write session: try to update token
2025-10-02T09:32:13.098018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:13.103948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:13.103960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.103962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:13.103964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:13.103969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.103972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.103975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918002137:8916]
2025-10-02T09:32:13.103996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:13.103998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:13.104001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.104002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:13.104005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:13.104007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:13.104106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:13.110710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId: src_id|387742c1-8017fecd-63131c32-2dbe6414_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:13.112902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.166636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993541578:4709]
2025-10-02T09:32:13.166922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1436, pipe: [1:7556554865993541578:4709]
2025-10-02T09:32:13.213402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.213617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.213625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.213637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541578:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.213771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.213829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:13.213838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:13.213857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993541578:4709]
2025-10-02T09:32:13.213872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.213882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1437 reason: error at write: Disconnected sessionId: src_id|387742c1-8017fecd-63131c32-2dbe6414_0
2025-10-02T09:32:13.214019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1437 sessionId: src_id|387742c1-8017fecd-63131c32-2dbe6414_0 is DEAD
2025-10-02T09:32:13.214176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:13.214190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Write session will restart in 0.009561s
2025-10-02T09:32:13.214228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Write session: Do CDS request
2025-10-02T09:32:13.214233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.225168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.225271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.225280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1438
2025-10-02T09:32:13.225403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.225423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.225429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.225432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.225705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1438 sessionId:  describe result for acl check
2025-10-02T09:32:13.225730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.225735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.225736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.225739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993541721:4418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.226083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993541721:4418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.227822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993541721:4418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.229526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.229600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993541721:4418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.229608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993541721:4418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.229611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993541721:4418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.229614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.231518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.231608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.231614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.231620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.231644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.231667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918002412:8918]
2025-10-02T09:32:13.232007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.232182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.232205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.232379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.232407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.232411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.232412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.232412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.232413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.232413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.232414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.232414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.232415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.232415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.232416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.232417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.232419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.232425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.232427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.232430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.232432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.232434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.232436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.232438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.232440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.232442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.232444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.232446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.232450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.232454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.232457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.232460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.232462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.232464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.232466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.232469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.232471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.232474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.232475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.232478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.232480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.232483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.232485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.232488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.232490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.232492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.232494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.232497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.232499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.232501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.232503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.232507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.232524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:13.239843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:13.241213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:13.241224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:13.241225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:13.241227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:13.241230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1437 [2:7556554865918002412:8918]
2025-10-02T09:32:13.241238Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:13.241247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:13.241252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.241253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.241254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.241263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:13.241267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:13.241271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:13.241298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.241303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.241304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.241306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:13.241307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:13.241342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:13.241347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.241354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.241359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.241367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:13.241377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541582:2446], now have 1 active actors on pipe
2025-10-02T09:32:13.241383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541847:4418], now have 1 active actors on pipe
2025-10-02T09:32:13.241387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.241388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.241389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.241396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:13.241404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:13.241414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:13.241418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:13.241421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1437
2025-10-02T09:32:13.241428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1437
2025-10-02T09:32:13.241431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.241435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:13.241436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:13.241439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:13.241440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:13.241444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:13.241459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.241461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.241474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:13.241480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.241483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.241484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:13.241488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.241493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:13.241500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.241593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.241598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.241605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.241671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1438 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0
2025-10-02T09:32:13.241904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|387742c1-8017fecd-63131c32-2dbe6414_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:13.244546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Write session: try to update token
2025-10-02T09:32:13.244559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:13.250640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:13.250651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.250652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:13.250653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:13.250657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.250659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.250661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918002406:8918]
2025-10-02T09:32:13.250680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:13.250681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:13.250682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.250683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:13.250683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:13.250685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:13.250790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:13.257588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId: src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:13.259614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.314081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993541859:4709]
2025-10-02T09:32:13.314289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1437, pipe: [1:7556554865993541859:4709]
2025-10-02T09:32:13.359832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.360032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.360040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.360052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541859:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.360233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.360261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:13.360268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993541859:4709]
2025-10-02T09:32:13.360271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:13.360315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1438 reason: error at write: Disconnected sessionId: src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0
2025-10-02T09:32:13.360459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1438 sessionId: src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0 is DEAD
2025-10-02T09:32:13.360481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.360605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:13.360623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Write session will restart in 0.006882s
2025-10-02T09:32:13.360651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Write session: Do CDS request
2025-10-02T09:32:13.360658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.368181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.368229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.368238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1439
2025-10-02T09:32:13.368374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.368395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.368402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.368404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.368692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1439 sessionId:  describe result for acl check
2025-10-02T09:32:13.368714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.368717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.368718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.368722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993541912:4399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.369100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993541912:4399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.371461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993541912:4399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.374673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993541912:4399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.374681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993541912:4399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.374684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993541912:4399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.374687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.377101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.379587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.379725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.379731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.379737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.379765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.379789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918002681:8921]
2025-10-02T09:32:13.380126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.380332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.380354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.380528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.380556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.380560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.380561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.380561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.380562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.380562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.380563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.380563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.380564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.380564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.380565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.380565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.380568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.380574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.380576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.380578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.380580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.380582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.380584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.380586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.380588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.380590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.380592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.380594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.380598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.380602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.380605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.380608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.380610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.380613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.380615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.380617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.380619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.380622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.380624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.380626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.380628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.380631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.380633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.380635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.380637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.380640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.380642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.380644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.380646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.380649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.380651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.380654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.380670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:13.388018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:13.389542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:13.389553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:13.389554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:13.389556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:13.389559Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1438 [2:7556554865918002681:8921]
2025-10-02T09:32:13.389566Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:13.389576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:13.389577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.389579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.389580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.389589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:13.389595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:13.389599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:13.389627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.389632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.389632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.389634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:13.389636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:13.389670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:13.389675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.389681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.389686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.389695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:13.389706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542082:4399], now have 1 active actors on pipe
2025-10-02T09:32:13.389711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993541861:2446], now have 1 active actors on pipe
2025-10-02T09:32:13.389715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.389716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.389717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.389725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:13.389732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:13.389741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:13.389741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:13.389743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:13.389744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:13.389745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:13.389755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.389760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:13.389762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:13.389783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1438
2025-10-02T09:32:13.389807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1438
2025-10-02T09:32:13.389839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.389845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.389861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:13.389864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.389868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.389869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:13.389873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.389879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:13.389887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.390015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.390020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.390027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.390088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1439 partition: 0 MaxSeqNo: 36 sessionId: src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0
2025-10-02T09:32:13.390352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ddccf25-6f01de91-34d2a1a9-ef223520_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:13.393113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Write session: try to update token
2025-10-02T09:32:13.393131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:13.398813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:13.398823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.398824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:13.398826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:13.398829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.398832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.398834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918002676:8921]
2025-10-02T09:32:13.398852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:13.398855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.398856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:13.398865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:13.398875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:13.398878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:13.399022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:13.406067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId: src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:13.408144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.460527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993542139:4709]
2025-10-02T09:32:13.460758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1438, pipe: [1:7556554865993542139:4709]
2025-10-02T09:32:13.509093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.509391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.509401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.509414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542139:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.509542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.509655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993542139:4709]
2025-10-02T09:32:13.509685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:13.509742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1439 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0
2025-10-02T09:32:13.509903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1439 sessionId: src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0 is DEAD
2025-10-02T09:32:13.510039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:13.510053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Write session will restart in 0.006860s
2025-10-02T09:32:13.510075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Write session: Do CDS request
2025-10-02T09:32:13.510081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.510081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.518136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.518239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.518251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1440
2025-10-02T09:32:13.518382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.518409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.518416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.518420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.518908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1440 sessionId:  describe result for acl check
2025-10-02T09:32:13.518930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.518934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.518936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.518939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993542222:4395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.519347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993542222:4395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.521840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993542222:4395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.524528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993542222:4395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.524555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993542222:4395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.524559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993542222:4395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.524567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.529193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.529493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.529670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.529677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.529684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.529715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.529740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918002965:8927]
2025-10-02T09:32:13.530097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.530291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.530314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.530489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.530519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.530523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.530524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.530524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.530525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.530525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.530526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.530527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.530527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.530528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.530528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.530529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.530531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.530538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.530540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.530542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.530545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.530547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.530549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.530551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.530553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.530556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.530558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.530560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.530564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.530568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.530571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.530573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.530575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.530578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.530580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.530584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.530586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.530589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.530591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.530593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.530596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.530598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.530600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.530603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.530605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.530607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.530610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.530612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.530614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.530617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.530619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.530622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.530639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:13.538130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:13.539443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:13.539454Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:13.539455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:13.539457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:13.539461Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1439 [2:7556554865918002965:8927]
2025-10-02T09:32:13.539468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:13.539478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:13.539483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.539484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.539485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.539494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:13.539500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:13.539504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:13.539534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.539538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.539539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.539541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:13.539542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:13.539578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:13.539583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.539590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.539595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.539603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:13.539618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542144:2446], now have 1 active actors on pipe
2025-10-02T09:32:13.539623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542377:4395], now have 1 active actors on pipe
2025-10-02T09:32:13.539627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.539628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.539629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.539636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:13.539643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:13.539652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:13.539654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:13.539656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:13.539656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:13.539658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:13.539671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.539674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:13.539676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:13.539664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1439
2025-10-02T09:32:13.539685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1439
2025-10-02T09:32:13.539701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.539706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.539719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:13.539725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.539728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.539730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:13.539734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.539739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:13.539747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.539870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.539875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.539882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.539948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1440 partition: 0 MaxSeqNo: 36 sessionId: src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0
2025-10-02T09:32:13.540251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedf9939-5f0158d0-12cb2629-d814aef4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:13.542958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Write session: try to update token
2025-10-02T09:32:13.542973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:13.548732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:13.548745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.548746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:13.548747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:13.548751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.548754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.548756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918002960:8927]
2025-10-02T09:32:13.548773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:13.548776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.548778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:13.548779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:13.548782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:13.548784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:13.548895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:13.555786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId: src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:13.557864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.610036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993542441:4709]
2025-10-02T09:32:13.610237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1439, pipe: [1:7556554865993542441:4709]
2025-10-02T09:32:13.660187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.660762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.660771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.660784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542441:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.660914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.660982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993542441:4709]
2025-10-02T09:32:13.660992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:13.661008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.661052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1440 reason: status is not ok: tablet will be restarted right now sessionId: src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0
2025-10-02T09:32:13.661205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1440 sessionId: src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0 is DEAD
2025-10-02T09:32:13.661333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:13.661348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Write session will restart in 0.009483s
2025-10-02T09:32:13.661370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Write session: Do CDS request
2025-10-02T09:32:13.661376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.672156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.672268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.672276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1441
2025-10-02T09:32:13.672405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.672425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.672431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.672434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.672867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1441 sessionId:  describe result for acl check
2025-10-02T09:32:13.672893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.672898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.672899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.672902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993542570:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.673254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993542570:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.675325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993542570:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.677461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.677716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993542570:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.677725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993542570:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.677727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993542570:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.677730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.679475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.679575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.679581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.679587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.679613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.679636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918003260:8937]
2025-10-02T09:32:13.679970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.680376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.680399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.680575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.680603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.680607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.680608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.680608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.680609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.680609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.680610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.680610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.680611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.680611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.680612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.680612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.680615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.680621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.680623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.680625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.680627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.680629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.680631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.680633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.680635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.680637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.680639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.680641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.680644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.680648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.680652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.680654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.680657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.680659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.680661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.680664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.680666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.680669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.680671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.680673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.680680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.680683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.680686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.680688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.680690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.680693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.680694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.680697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.680702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.680705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.680706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.680709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.680725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:13.688190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:13.689702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:13.689718Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:13.689720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:13.689723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:13.689727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1440 [2:7556554865918003260:8937]
2025-10-02T09:32:13.689736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:13.689749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:13.689754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.689756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.689757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.689766Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:13.689769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:13.689773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:13.689804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.689809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.689810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.689812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:13.689814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:13.689850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:13.689854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.689860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.689866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.689874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:13.689888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542442:2446], now have 1 active actors on pipe
2025-10-02T09:32:13.689893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542711:4381], now have 1 active actors on pipe
2025-10-02T09:32:13.689897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.689899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.689900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.689904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:13.689912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:13.689914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:13.689916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:13.689918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:13.689924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:13.689927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:13.689944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.689954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:13.689970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:13.689950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1440
2025-10-02T09:32:13.689960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1440
2025-10-02T09:32:13.690003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.690010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.690027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f016b80-8a195a5f-480076e4-218391e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:13.690034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.690036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.690038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:13.690043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.690048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:13.690055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.690169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.690174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.690181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.690258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1441 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f016b80-8a195a5f-480076e4-218391e4_0
2025-10-02T09:32:13.690525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|736bc8fe-f5f35c92-372d5aa-86f26aa2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f016b80-8a195a5f-480076e4-218391e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:13.693264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Write session: try to update token
2025-10-02T09:32:13.693279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:13.699062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:13.699074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.699077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:13.699078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:13.699083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.699086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.699089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918003254:8937]
2025-10-02T09:32:13.699108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:13.699115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.699115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:13.699116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:13.699118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:13.699120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:13.699219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:13.706940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId: src_id|7f016b80-8a195a5f-480076e4-218391e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:13.709051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.761051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993542723:4709]
2025-10-02T09:32:13.761264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1440, pipe: [1:7556554865993542723:4709]
2025-10-02T09:32:13.812374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.812577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.812586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.812598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542723:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.812754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.812862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993542723:4709]
2025-10-02T09:32:13.812883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.812885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:13.812933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1441 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f016b80-8a195a5f-480076e4-218391e4_0
2025-10-02T09:32:13.813072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1441 sessionId: src_id|7f016b80-8a195a5f-480076e4-218391e4_0 is DEAD
2025-10-02T09:32:13.813242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:13.813256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Write session will restart in 0.006304s
2025-10-02T09:32:13.813282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Write session: Do CDS request
2025-10-02T09:32:13.813287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.820191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.820267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.820278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1442
2025-10-02T09:32:13.820402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.820421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.820426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.820429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.820775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1442 sessionId:  describe result for acl check
2025-10-02T09:32:13.820814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.820820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.820822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.820825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993542774:4376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.821151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993542774:4376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.823982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993542774:4376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.826385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993542774:4376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.826395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993542774:4376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.826396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993542774:4376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.826400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.829956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.832638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.832744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.832751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.832757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.832782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.832818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918003545:8940]
2025-10-02T09:32:13.833156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.833359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.833381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.833563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.833595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.833600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.833600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.833601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.833601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.833602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.833602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.833603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.833603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.833603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.833604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.833604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.833607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.833613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.833615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.833617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.833619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.833621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.833623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.833625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.833627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.833629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.833631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.833633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.833636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.833640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.833646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.833648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.833651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.833653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.833655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.833657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.833660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.833662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.833664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.833666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.833669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.833671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.833673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.833675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.833677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.833680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.833683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.833685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.833687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.833689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.833691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.833709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:13.841169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:13.842531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:13.842543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:13.842544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:13.842546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:13.842549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1441 [2:7556554865918003545:8940]
2025-10-02T09:32:13.842557Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:13.842567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:13.842572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.842573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.842574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.842583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:13.842586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:13.842590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:13.842620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.842625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.842626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.842628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:13.842629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:13.842778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1441
2025-10-02T09:32:13.842782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1441
2025-10-02T09:32:13.842850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:13.842859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.842869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.842879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.842893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:13.842911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542916:4376], now have 1 active actors on pipe
2025-10-02T09:32:13.842918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993542727:2446], now have 1 active actors on pipe
2025-10-02T09:32:13.842929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.842934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.842946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.842950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.842951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.842960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:13.842971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:13.842975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:13.842976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:13.842977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:13.842983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:13.842984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:13.842992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:13.843000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:13.843002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:13.843008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:13.843014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:13.843022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:13.843043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.843050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:13.843056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.843059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:13.843162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.843167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.843175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:13.843230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1442 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0
2025-10-02T09:32:13.843482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f016b80-8a195a5f-480076e4-218391e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:13.846221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Write session: try to update token
2025-10-02T09:32:13.846236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:13.856128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:13.856140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.856144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.856166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:13.856174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:13.856306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:13.856422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:13.856536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:13.856653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:13.856842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:13.856869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:13.860277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:13.860288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:13.860289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:13.860290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:13.860294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.860296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.860298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918003540:8940]
2025-10-02T09:32:13.860315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:13.860317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:13.860319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:13.860320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.860321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:13.860322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:13.860430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:13.861672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId: src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:13.863823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:13.913120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554865993543028:4709]
2025-10-02T09:32:13.913292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1441, pipe: [1:7556554865993543028:4709]
2025-10-02T09:32:13.975070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:13.975376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:13.975384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:13.975398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993543028:4709], now have 1 active actors on pipe
2025-10-02T09:32:13.975553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:13.975581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:13.975594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:13.975605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554865993543028:4709]
2025-10-02T09:32:13.975622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:13.975647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1442 reason: error at write: Disconnected sessionId: src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0
2025-10-02T09:32:13.975806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1442 sessionId: src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0 is DEAD
2025-10-02T09:32:13.975922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:13.975935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Write session will restart in 0.007849s
2025-10-02T09:32:13.975956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Write session: Do CDS request
2025-10-02T09:32:13.975961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:13.985170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.985329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:13.985338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1443
2025-10-02T09:32:13.985454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:13.985475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:13.985480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:13.985483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:13.985748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1443 sessionId:  describe result for acl check
2025-10-02T09:32:13.985774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:13.985778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:13.985779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:13.985782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554865993543125:4368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:13.986128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554865993543125:4368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:13.988562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554865993543125:4368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:13.991218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554865993543125:4368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:13.991227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554865993543125:4368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:13.991229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554865993543125:4368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:13.991233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:13.992097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:13.994484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:13.994580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:13.994586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:13.994592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:13.994618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:13.994642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554865918003821:8943]
2025-10-02T09:32:13.994996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:13.995438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:13.995460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:13.995637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:13.995666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.995670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.995671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.995671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.995672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.995672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.995673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.995673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.995674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.995675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.995675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.995676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.995678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.995684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.995686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.995688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.995690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.995693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.995695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.995697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.995699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.995702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.995704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.995706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.995710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.995714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:13.995717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.995720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:13.995723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.995726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:13.995728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.995731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:13.995733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.995735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:13.995737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.995740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:13.995742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.995745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:13.995747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.995749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:13.995752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.995755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:13.995760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.995763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:13.995765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.995768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:13.995773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.995775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:13.995793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.003556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.004867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.004877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.004878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.004880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.004884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1442 [2:7556554865918003821:8943]
2025-10-02T09:32:14.004891Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.004901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.004906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.004908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.004909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.004918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.004921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.004925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.004955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.004960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.004961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.004963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.004964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.004999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.005004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.005010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.005016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.005024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.005037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993543297:4368], now have 1 active actors on pipe
2025-10-02T09:32:14.005043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554865993543032:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.005047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.005048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.005050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.005058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.005066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.005075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.005076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.005078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.005084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.005086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.005090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.005092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.005094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.005099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1442
2025-10-02T09:32:14.005110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1442
2025-10-02T09:32:14.005233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.005239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.005254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5de876b-395f8242-a1fff992-d5e94659_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.005257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.005263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.005264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.005270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.005275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.005281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.005423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.005431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.005439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.005506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1443 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5de876b-395f8242-a1fff992-d5e94659_0
2025-10-02T09:32:14.005752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b2b05e-f576b144-8ccc52cc-b82093ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5de876b-395f8242-a1fff992-d5e94659_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.008427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Write session: try to update token
2025-10-02T09:32:14.008439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.014435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.014450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.014452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.014453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.014458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.014463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.014467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554865918003816:8943]
2025-10-02T09:32:14.014487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.014493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.014492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.014494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.014495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.014497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.014594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.021636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId: src_id|f5de876b-395f8242-a1fff992-d5e94659_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.023674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.075929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288510608:4709]
2025-10-02T09:32:14.076111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1442, pipe: [1:7556554870288510608:4709]
2025-10-02T09:32:14.123102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:14.123540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.123550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.123561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288510608:4709], now have 1 active actors on pipe
2025-10-02T09:32:14.123682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:14.123739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:14.123745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:14.123748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:14.123784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288510608:4709]
2025-10-02T09:32:14.123797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1443 reason: error at write: Disconnected sessionId: src_id|f5de876b-395f8242-a1fff992-d5e94659_0
2025-10-02T09:32:14.123922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1443 sessionId: src_id|f5de876b-395f8242-a1fff992-d5e94659_0 is DEAD
2025-10-02T09:32:14.124074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:14.124088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Write session will restart in 0.005377s
2025-10-02T09:32:14.124113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Write session: Do CDS request
2025-10-02T09:32:14.124118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:14.130151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.130239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:14.130247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1444
2025-10-02T09:32:14.130358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.130378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:14.130384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:14.130387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:14.130747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1444 sessionId:  describe result for acl check
2025-10-02T09:32:14.130769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:14.130770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:14.130771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:14.130774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554870288510641:4366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:14.131137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554870288510641:4366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:14.133348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554870288510641:4366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:14.136428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554870288510641:4366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:14.136437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554870288510641:4366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:14.136439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554870288510641:4366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:14.136443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:14.140582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:14.143199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:14.143292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:14.143299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:14.143305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:14.143329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:14.143353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554870212971392:8945]
2025-10-02T09:32:14.143701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:14.143921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:14.143946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:14.144118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:14.144146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.144150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.144151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.144151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.144152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.144152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.144153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.144153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.144154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.144154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.144155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.144155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.144158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.144165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.144167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.144169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.144170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.144172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.144174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.144176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.144178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.144180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.144182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.144184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.144188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.144192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.144195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.144198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.144200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.144203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.144205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.144208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.144210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.144213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.144215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.144217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.144220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.144222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.144224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.144227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.144233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.144236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.144239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.144242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.144247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.144251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.144253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.144255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.144276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.151836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.153174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.153185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.153186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.153188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.153192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1443 [2:7556554870212971392:8945]
2025-10-02T09:32:14.153198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.153206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.153208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.153209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.153210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.153220Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.153226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.153230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.153260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.153264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.153265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.153267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.153269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.153303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.153308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.153314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.153319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.153327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.153338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288510782:4366], now have 1 active actors on pipe
2025-10-02T09:32:14.153343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288510610:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.153347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.153348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.153349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.153356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.153365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.153372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.153375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.153375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.153376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.153377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.153389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.153394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.153396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.153404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1443
2025-10-02T09:32:14.153407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1443
2025-10-02T09:32:14.153466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.153472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.153487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.153494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.153496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.153497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.153502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.153506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.153513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.153637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.153643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.153651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.153720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1444 partition: 0 MaxSeqNo: 36 sessionId: src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0
2025-10-02T09:32:14.153989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5de876b-395f8242-a1fff992-d5e94659_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.156696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Write session: try to update token
2025-10-02T09:32:14.156712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.162470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.162489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.162490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.162492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.162497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.162501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.162504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554870212971387:8945]
2025-10-02T09:32:14.162529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.162530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.162533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.162534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.162537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.162541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.162637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.169758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId: src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.171855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.223898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288510896:4709]
2025-10-02T09:32:14.224317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1443, pipe: [1:7556554870288510896:4709]
2025-10-02T09:32:14.272540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:14.273002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.273012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.273024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288510896:4709], now have 1 active actors on pipe
2025-10-02T09:32:14.273230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:14.273235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288510896:4709]
2025-10-02T09:32:14.273244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:14.273261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:14.273294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1444 reason: error at write: Disconnected sessionId: src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0
2025-10-02T09:32:14.273426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1444 sessionId: src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0 is DEAD
2025-10-02T09:32:14.273563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:14.273577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Write session will restart in 0.007508s
2025-10-02T09:32:14.273597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Write session: Do CDS request
2025-10-02T09:32:14.273602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:14.273876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:14.282100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.282213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:14.282225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1445
2025-10-02T09:32:14.282355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.282375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:14.282382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:14.282385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:14.282668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1445 sessionId:  describe result for acl check
2025-10-02T09:32:14.282688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:14.282692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:14.282693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:14.282696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554870288510968:4356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:14.283117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554870288510968:4356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:14.285419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554870288510968:4356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:14.288226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554870288510968:4356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:14.288234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554870288510968:4356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:14.288238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554870288510968:4356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:14.288242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:14.290243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:14.292537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:14.292632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:14.292638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:14.292644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:14.292670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:14.292695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554870212971670:8948]
2025-10-02T09:32:14.293051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:14.293269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:14.293292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:14.293462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:14.293491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.293495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.293495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.293496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.293496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.293497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.293497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.293498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.293499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.293499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.293499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.293500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.293503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.293509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.293511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.293514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.293516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.293518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.293520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.293522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.293524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.293526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.293528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.293529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.293533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.293537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.293540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.293543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.293544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.293547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.293549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.293551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.293553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.293556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.293558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.293560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.293563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.293565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.293568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.293570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.293573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.293575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.293577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.293580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.293582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.293584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.293586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.293589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.293606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.301047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.302623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.302633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.302634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.302636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.302640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1444 [2:7556554870212971670:8948]
2025-10-02T09:32:14.302647Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.302657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.302658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.302660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.302661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.302670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.302673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.302677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.302703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.302709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.302710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.302712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.302713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.302749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.302754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.302761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.302766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.302774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.302788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288510897:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.302794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511130:4356], now have 1 active actors on pipe
2025-10-02T09:32:14.302797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.302807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.302809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.302817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.302825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.302835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.302836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.302837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.302838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.302839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.302852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.302857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.302864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.302856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1444
2025-10-02T09:32:14.302855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1444
2025-10-02T09:32:14.302878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.302882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.302898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.302904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.302906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.302907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.302912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.302917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.302924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.303038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.303042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.303049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.303119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1445 partition: 0 MaxSeqNo: 36 sessionId: src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0
2025-10-02T09:32:14.303419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df72a17-e9452afc-b3d53b35-81e4d265_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.306124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Write session: try to update token
2025-10-02T09:32:14.306139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.311876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.311891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.311894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.311895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.311901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.311904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.311907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554870212971665:8948]
2025-10-02T09:32:14.311928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.311931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.311931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.311932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.311934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.311936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.312042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.319179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId: src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.321313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.373406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288511182:4709]
2025-10-02T09:32:14.373645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1444, pipe: [1:7556554870288511182:4709]
2025-10-02T09:32:14.421090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:14.421291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.421300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.421312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511182:4709], now have 1 active actors on pipe
2025-10-02T09:32:14.421427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:14.421481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:14.421504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288511182:4709]
2025-10-02T09:32:14.421515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:14.421567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0
2025-10-02T09:32:14.421700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1445 sessionId: src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0 is DEAD
2025-10-02T09:32:14.421857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:14.421872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Write session will restart in 0.008055s
2025-10-02T09:32:14.421894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Write session: Do CDS request
2025-10-02T09:32:14.421901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:14.431174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.431266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:14.431274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1446
2025-10-02T09:32:14.431391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.431413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:14.431421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:14.431425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:14.431736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1446 sessionId:  describe result for acl check
2025-10-02T09:32:14.431759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:14.431763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:14.431765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:14.431767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554870288511273:4351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:14.432113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554870288511273:4351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:14.434624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554870288511273:4351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:14.437208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554870288511273:4351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:14.437216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554870288511273:4351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:14.437218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554870288511273:4351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:14.437222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:14.438639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:14.440706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:14.440832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:14.440839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:14.440846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:14.440875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:14.440897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554870212971947:8950]
2025-10-02T09:32:14.441233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:14.441431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:14.441453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:14.441622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:14.441651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.441655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.441655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.441656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.441656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.441657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.441657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.441658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.441658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.441659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.441659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.441660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.441663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.441669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.441671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.441674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.441675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.441677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.441679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.441681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.441683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.441685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.441687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.441689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.441693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.441696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.441700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.441703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.441705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.441708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.441710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.441712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.441714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.441717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.441719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.441722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.441724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.441727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.441729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.441731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.441735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.441737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.441739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.441742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.441744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.441746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.441748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.441751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.441768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.449163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.450509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.450520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.450521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.450523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.450527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1445 [2:7556554870212971947:8950]
2025-10-02T09:32:14.450533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.450543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.450544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.450545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.450546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.450556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.450558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.450562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.450592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.450597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.450598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.450600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.450601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.450637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.450642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.450648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.450653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.450665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.450675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511183:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.450680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511444:4351], now have 1 active actors on pipe
2025-10-02T09:32:14.450684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.450685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.450686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.450693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.450700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.450707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.450710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.450712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.450712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.450714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.450725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.450726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.450728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.450733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1445
2025-10-02T09:32:14.450736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1445
2025-10-02T09:32:14.450758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.450763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.450782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.450786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.450788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.450789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.450794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.450808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.450815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.450931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.450936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.450943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.451016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1446 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0
2025-10-02T09:32:14.451255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897acf76-81c8fea8-2608d3d3-d50acd03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.453951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Write session: try to update token
2025-10-02T09:32:14.453965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.459849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.459861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.459862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.459863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.459867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.459870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.459872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554870212971942:8950]
2025-10-02T09:32:14.459892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.459895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.459896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.459897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.459899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.459901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.460067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.466426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId: src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.468549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.521876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288511469:4709]
2025-10-02T09:32:14.522062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1445, pipe: [1:7556554870288511469:4709]
2025-10-02T09:32:14.569984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:14.570319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.570332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.570346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511469:4709], now have 1 active actors on pipe
2025-10-02T09:32:14.570447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:14.570482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:14.570497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288511469:4709]
2025-10-02T09:32:14.570509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:14.570517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:14.570556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1446 reason: error at write: Disconnected sessionId: src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0
2025-10-02T09:32:14.570688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1446 sessionId: src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0 is DEAD
2025-10-02T09:32:14.570843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:14.570857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Write session will restart in 0.009224s
2025-10-02T09:32:14.570878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Write session: Do CDS request
2025-10-02T09:32:14.570884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:14.581140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.581433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:14.581445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1447
2025-10-02T09:32:14.581565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.581585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:14.581589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:14.581591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:14.581877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1447 sessionId:  describe result for acl check
2025-10-02T09:32:14.581902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:14.581906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:14.581907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:14.581910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554870288511678:4331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:14.582211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554870288511678:4331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:14.583551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554870288511678:4331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:14.583886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:14.585921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:14.586048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:14.586055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:14.586061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:14.586090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:14.586111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554870212972259:8958]
2025-10-02T09:32:14.586268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554870288511678:4331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:14.586277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554870288511678:4331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:14.586279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554870288511678:4331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:14.586282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:14.586444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:14.586944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:14.586968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:14.587147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:14.587175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.587179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.587180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.587180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.587181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.587181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.587182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.587182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.587183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.587183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.587184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.587185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.587187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.587193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.587195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.587197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.587199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.587202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.587203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.587205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.587207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.587209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.587211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.587213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.587217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.587221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.587224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.587227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.587229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.587231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.587233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.587236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.587238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.587241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.587243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.587245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.587247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.587250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.587252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.587254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.587256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.587259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.587261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.587264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.587267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.587270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.587272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.587274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.587290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.594667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.596221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.596232Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.596233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.596235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.596240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1446 [2:7556554870212972259:8958]
2025-10-02T09:32:14.596247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.596257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.596260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.596261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.596262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.596270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.596273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.596277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.596308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.596313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.596314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.596315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.596317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.596351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.596356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.596362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.596367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.596375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.596389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511766:4331], now have 1 active actors on pipe
2025-10-02T09:32:14.596395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511483:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.596398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.596399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.596400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.596407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.596415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.596423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.596425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.596425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.596427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.596427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.596440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.596448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.596441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1446
2025-10-02T09:32:14.596457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.596470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1446
2025-10-02T09:32:14.596502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.596508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.596523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.596530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.596532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.596533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.596538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.596544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.596553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.596672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.596677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.596684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.596752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1447 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0
2025-10-02T09:32:14.597004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bed6a3-da555f79-fa437a78-94997d2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.599703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Write session: try to update token
2025-10-02T09:32:14.599715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.605541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.605553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.605554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.605554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.605558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.605560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.605562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554870212972254:8958]
2025-10-02T09:32:14.605580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.605582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.605583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.605587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.605589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.605591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.605692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.612635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId: src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.614736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.670900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288511778:4709]
2025-10-02T09:32:14.671143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1446, pipe: [1:7556554870288511778:4709]
2025-10-02T09:32:14.718811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:14.719165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.719175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.719186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511778:4709], now have 1 active actors on pipe
2025-10-02T09:32:14.719375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:14.719412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:14.719418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288511778:4709]
2025-10-02T09:32:14.719426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:14.719433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:14.719477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1447 reason: error at write: Disconnected sessionId: src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0
2025-10-02T09:32:14.719619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1447 sessionId: src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0 is DEAD
2025-10-02T09:32:14.719774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:14.719788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Write session will restart in 0.008196s
2025-10-02T09:32:14.719817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Write session: Do CDS request
2025-10-02T09:32:14.719822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:14.729217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.729316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:14.729326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1448
2025-10-02T09:32:14.729443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.729463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:14.729468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:14.729471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:14.729786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1448 sessionId:  describe result for acl check
2025-10-02T09:32:14.729811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:14.729815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:14.729816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:14.729820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554870288511852:4324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:14.730154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554870288511852:4324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:14.732141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554870288511852:4324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:14.734506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554870288511852:4324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:14.734514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554870288511852:4324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:14.734517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554870288511852:4324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:14.734520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:14.737749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:14.740831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:14.740942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:14.740948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:14.740954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:14.740982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:14.741003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554870212972550:8966]
2025-10-02T09:32:14.741420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:14.741878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:14.741903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:14.742079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:14.742108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.742112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.742112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.742113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.742114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.742114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.742115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.742115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.742116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.742116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.742117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.742117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.742120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.742126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.742128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.742130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.742132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.742134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.742136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.742138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.742140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.742142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.742144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.742146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.742150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.742154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.742157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.742160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.742162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.742165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.742167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.742169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.742172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.742174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.742176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.742180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.742182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.742185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.742187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.742190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.742192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.742195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.742197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.742199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.742201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.742204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.742206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.742208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.742226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.749633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.751001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.751012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.751013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.751015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.751017Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1447 [2:7556554870212972550:8966]
2025-10-02T09:32:14.751024Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.751033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.751034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.751035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.751036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.751045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.751051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.751055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.751083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.751087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.751088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.751090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.751091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.751124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.751130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.751136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.751141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.751151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.751162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511980:4324], now have 1 active actors on pipe
2025-10-02T09:32:14.751167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288511780:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.751171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.751173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.751174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.751181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.751192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.751194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.751197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.751198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.751202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.751204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.751219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.751228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.751232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.751227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1447
2025-10-02T09:32:14.751229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1447
2025-10-02T09:32:14.751262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.751267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.751282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.751289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.751291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.751292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.751297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.751301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.751311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.751429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.751433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.751440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.751502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1448 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0
2025-10-02T09:32:14.751772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885e5a-639619a-6fb7e335-5fc5a79a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.754510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Write session: try to update token
2025-10-02T09:32:14.754524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.760147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:14.760163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.760169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.760192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:14.760194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:14.760322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:14.760445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:14.760577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:14.760711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:14.760885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:14.760907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:14.767300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId: src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.768504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.768516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.768517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.768518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.768524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.768526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.768528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554870212972544:8966]
2025-10-02T09:32:14.768544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.768546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.768547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.768549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.768549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.768550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.768657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.769453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.819341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288512076:4709]
2025-10-02T09:32:14.819497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1447, pipe: [1:7556554870288512076:4709]
2025-10-02T09:32:14.877972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:14.878303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.878312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.878325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288512076:4709], now have 1 active actors on pipe
2025-10-02T09:32:14.878450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:14.878491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:14.878503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288512076:4709]
2025-10-02T09:32:14.878503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:14.878517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:14.878553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1448 reason: error at write: Disconnected sessionId: src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0
2025-10-02T09:32:14.878685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1448 sessionId: src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0 is DEAD
2025-10-02T09:32:14.878849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:14.878863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Write session will restart in 0.009388s
2025-10-02T09:32:14.878885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Write session: Do CDS request
2025-10-02T09:32:14.878891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:14.889283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.889296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:14.889307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1449
2025-10-02T09:32:14.889491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:14.889511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:14.889517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:14.889520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:14.889882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1449 sessionId:  describe result for acl check
2025-10-02T09:32:14.889908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:14.889913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:14.889914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:14.889917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554870288512199:4322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:14.890240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554870288512199:4322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:14.891688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554870288512199:4322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:14.894415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554870288512199:4322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:14.894423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554870288512199:4322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:14.894424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554870288512199:4322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:14.894427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:14.895837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:14.898284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:14.898381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:14.898388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:14.898394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:14.898420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:14.898551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554870212972828:8969]
2025-10-02T09:32:14.898898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:14.899097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:14.899122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:14.899295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:14.899323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.899327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.899328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.899329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.899329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.899330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.899330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.899331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.899331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.899332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.899332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.899333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.899336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.899342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.899344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.899346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.899348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.899350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.899352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.899354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.899356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.899358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.899360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.899362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.899365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.899369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:14.899372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.899375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:14.899378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.899380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:14.899382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.899385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:14.899387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.899390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:14.899392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.899395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:14.899397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.899400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:14.899402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.899404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:14.899407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.899410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:14.899412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.899417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.899419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.899421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.899423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.899426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.899444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:14.906855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:14.908153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:14.908164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:14.908165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:14.908167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:14.908171Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1448 [2:7556554870212972828:8969]
2025-10-02T09:32:14.908178Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:14.908187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:14.908192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.908194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.908195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.908204Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:14.908207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:14.908211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:14.908237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.908242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.908243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.908245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:14.908246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:14.908279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:14.908284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.908290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:14.908295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:14.908303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:14.908317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288512354:4322], now have 1 active actors on pipe
2025-10-02T09:32:14.908323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288512090:2446], now have 1 active actors on pipe
2025-10-02T09:32:14.908326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.908327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.908329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.908336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:14.908346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:14.908352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:14.908354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:14.908355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:14.908356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:14.908356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:14.908369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.908373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:14.908375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:14.908384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1448
2025-10-02T09:32:14.908386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1448
2025-10-02T09:32:14.908436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.908441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.908454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:14.908457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:14.908460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:14.908461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:14.908466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:14.908471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:14.908482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.908691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:14.908697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:14.908706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:14.908781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1449 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0
2025-10-02T09:32:14.908998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8d3b82-6fecb4ce-28a1a975-8876fa11_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:14.911422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Write session: try to update token
2025-10-02T09:32:14.911432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:14.917711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:14.917725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:14.917726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:14.917727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:14.917732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.917735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.917737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554870212972823:8969]
2025-10-02T09:32:14.917759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:14.917761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:14.917763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:14.917762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:14.917766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:14.917768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:14.917870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:14.923196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId: src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:14.925113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:14.978603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554870288512381:4709]
2025-10-02T09:32:14.978818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1448, pipe: [1:7556554870288512381:4709]
2025-10-02T09:32:15.030601Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.030951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.030961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.030973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554870288512381:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.031167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554870288512381:4709]
2025-10-02T09:32:15.031171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:15.031174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:15.031202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.031224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1449 reason: error at write: Disconnected sessionId: src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0
2025-10-02T09:32:15.031369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1449 sessionId: src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0 is DEAD
2025-10-02T09:32:15.031466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.031489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:15.031498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Write session will restart in 0.008552s
2025-10-02T09:32:15.031518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Write session: Do CDS request
2025-10-02T09:32:15.031522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.041102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.041204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.041215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1450
2025-10-02T09:32:15.041302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.041322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.041329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.041331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.041688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1450 sessionId:  describe result for acl check
2025-10-02T09:32:15.041715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.041719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.041720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.041723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583479768:4318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.042064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583479768:4318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.044465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583479768:4318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.047100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583479768:4318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.047108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583479768:4318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.047110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583479768:4318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.047113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.048991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.051807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.051966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.051974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.051980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.052012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.052036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507940406:8972]
2025-10-02T09:32:15.052379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.052571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.052593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.052768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.052795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.052812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.052813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.052814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.052815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.052816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.052817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.052818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.052819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.052820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.052822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.052823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.052827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.052834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.052836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.052838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.052840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.052842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.052844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.052846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.052848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.052850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.052852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.052854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.052859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.052864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.052868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.052870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.052872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.052875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.052878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.052881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.052883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.052886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.052888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.052891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.052893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.052897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.052899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.052901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.052904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.052907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.052909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.052913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.052915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.052917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.052919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.052922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.052939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:15.060410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:15.061918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:15.061931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:15.061932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:15.061934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:15.061937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1449 [2:7556554874507940406:8972]
2025-10-02T09:32:15.061945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:15.061955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:15.061957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.061959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.061960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.061968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:15.061973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:15.061977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:15.062007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.062013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.062014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.062015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:15.062017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:15.062054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:15.062059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.062066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.062071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.062079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:15.062094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583479679:2446], now have 1 active actors on pipe
2025-10-02T09:32:15.062099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583479934:4318], now have 1 active actors on pipe
2025-10-02T09:32:15.062102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.062104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.062104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.062112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:15.062123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:15.062132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:15.062133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:15.062135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:15.062141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:15.062142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:15.062148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.062150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:15.062151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:15.062162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1449
2025-10-02T09:32:15.062161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1449
2025-10-02T09:32:15.062186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.062192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.062207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:15.062211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.062215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.062216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:15.062220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.062226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:15.062236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.062356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.062361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.062369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.062435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1450 partition: 0 MaxSeqNo: 36 sessionId: src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0
2025-10-02T09:32:15.062727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a2aec7-f5fa6c2d-c397f2a5-3daff466_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:15.065588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Write session: try to update token
2025-10-02T09:32:15.065606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:15.071361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:15.071373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.071374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:15.071377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:15.071381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.071384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.071386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507940401:8972]
2025-10-02T09:32:15.071406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:15.071408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:15.071409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.071410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:15.071411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:15.071413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:15.071518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:15.077933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId: src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:15.079962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:15.131188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554874583479968:4709]
2025-10-02T09:32:15.131442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1449, pipe: [1:7556554874583479968:4709]
2025-10-02T09:32:15.188414Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.188764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.188774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.188811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583479968:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.189006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.189029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554874583479968:4709]
2025-10-02T09:32:15.189049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:15.189050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:15.189093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1450 reason: error at write: Disconnected sessionId: src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0
2025-10-02T09:32:15.189244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1450 sessionId: src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0 is DEAD
2025-10-02T09:32:15.189405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:15.189419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Write session will restart in 0.006357s
2025-10-02T09:32:15.189442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Write session: Do CDS request
2025-10-02T09:32:15.189447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.189498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.197170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.197221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.197231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1451
2025-10-02T09:32:15.197383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.197403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.197409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.197411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.197708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1451 sessionId:  describe result for acl check
2025-10-02T09:32:15.197733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.197737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.197738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.197741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583480028:4312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.198120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583480028:4312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.200221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583480028:4312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.203183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583480028:4312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.203193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583480028:4312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.203194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583480028:4312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.203198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.204068Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:32:15.206896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.207228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.207318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.207325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.207331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.207355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.207380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507940691:8974]
2025-10-02T09:32:15.207718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.209397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.209422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.209606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.209635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.209639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.209639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.209640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.209640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.209641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.209641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.209642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.209642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.209643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.209643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.209644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.209647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.209653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.209655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.209657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.209659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.209661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.209663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.209664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.209666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.209669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.209671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.209673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.209676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.209681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.209684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.209687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.209690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.209692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.209694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.209697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.209699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.209701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.209703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.209706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.209709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.209711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.209713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.209716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.209717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.209720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.209722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.209724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.209726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.209729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.209731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.209733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.209749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:15.217286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:15.219023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:15.219034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:15.219035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:15.219037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:15.219040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1450 [2:7556554874507940691:8974]
2025-10-02T09:32:15.219047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:15.219058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:15.219059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.219061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.219062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.219071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:15.219077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:15.219081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:15.219109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.219113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.219114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.219116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:15.219118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:15.219154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:15.219159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.219167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.219172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.219184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:15.219200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480163:4312], now have 1 active actors on pipe
2025-10-02T09:32:15.219206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583479974:2446], now have 1 active actors on pipe
2025-10-02T09:32:15.219210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.219211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.219212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.219220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:15.219231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:15.219239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:15.219243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:15.219250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:15.219257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.219258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:15.219260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:15.219261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:15.219266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:15.219277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1450
2025-10-02T09:32:15.219316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1450
2025-10-02T09:32:15.219345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.219351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.219367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:15.219375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.219377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.219378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:15.219383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.219389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:15.219399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.219544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.219548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.219557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.219622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1451 partition: 0 MaxSeqNo: 36 sessionId: src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0
2025-10-02T09:32:15.219904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc851e0-c712c01-b9a6e7a3-cc87c658_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:15.222723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Write session: try to update token
2025-10-02T09:32:15.222739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:15.228574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:15.228587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.228588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:15.228589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:15.228594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.228597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.228599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507940686:8974]
2025-10-02T09:32:15.228619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:15.228623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.228624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:15.228626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:15.228629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:15.228632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:15.228752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:15.236166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId: src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:15.238247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:15.289402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554874583480267:4709]
2025-10-02T09:32:15.289642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1450, pipe: [1:7556554874583480267:4709]
2025-10-02T09:32:15.346898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.347251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.347261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.347274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480267:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.347398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.347453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:15.347469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:15.347474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.347513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554874583480267:4709]
2025-10-02T09:32:15.347514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1451 reason: error at write: Disconnected sessionId: src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0
2025-10-02T09:32:15.347646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1451 sessionId: src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0 is DEAD
2025-10-02T09:32:15.347820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:15.347837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Write session will restart in 0.008959s
2025-10-02T09:32:15.347871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Write session: Do CDS request
2025-10-02T09:32:15.347879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.358267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.358346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.358354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1452
2025-10-02T09:32:15.358516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.358536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.358542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.358545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.358933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1452 sessionId:  describe result for acl check
2025-10-02T09:32:15.358960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.358964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.358965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.358968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583480379:4308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.359311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583480379:4308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.361767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583480379:4308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.363960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583480379:4308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.363968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583480379:4308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.363970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583480379:4308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.363973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.364596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.366509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.366607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.366613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.366619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.366646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.366720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507940976:8977]
2025-10-02T09:32:15.367071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.367517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.367542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.367721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.367749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.367753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.367754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.367754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.367755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.367755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.367755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.367756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.367756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.367757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.367757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.367758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.367761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.367767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.367769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.367771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.367773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.367775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.367777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.367779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.367781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.367784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.367786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.367788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.367792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.367796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.367800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.367803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.367805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.367808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.367810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.367812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.367814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.367817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.367821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.367824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.367826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.367828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.367831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.367833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.367835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.367838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.367841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.367843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.367849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.367854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.367856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.367873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:15.375402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:15.376947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:15.376959Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:15.376960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:15.376962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:15.376966Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1451 [2:7556554874507940976:8977]
2025-10-02T09:32:15.376973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:15.376983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:15.376985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.376986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.376987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.376997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:15.377001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:15.377006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:15.377042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.377047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.377048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.377050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:15.377051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:15.377088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:15.377093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.377100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.377105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.377113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:15.377128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480547:4308], now have 1 active actors on pipe
2025-10-02T09:32:15.377133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480268:2446], now have 1 active actors on pipe
2025-10-02T09:32:15.377137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.377138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.377139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.377146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:15.377157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:15.377159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:15.377163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:15.377164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:15.377168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:15.377170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:15.377185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.377194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:15.377184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1451
2025-10-02T09:32:15.377187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1451
2025-10-02T09:32:15.377209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:15.377249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.377255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.377270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:15.377276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.377279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.377280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:15.377285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.377290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:15.377297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.377434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.377439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.377447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.377501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1452 partition: 0 MaxSeqNo: 36 sessionId: src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0
2025-10-02T09:32:15.377824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3827598d-8d7106f8-4fcee8c6-775d5990_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:15.380711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Write session: try to update token
2025-10-02T09:32:15.380729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:15.386228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:15.386243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.386249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.386274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:15.386278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:15.386405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:15.386519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:15.386629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:15.386739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:15.386902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:15.386925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:15.394594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:15.394606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.394608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:15.394609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:15.394614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.394617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.394620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507940971:8977]
2025-10-02T09:32:15.394643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:15.394646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:15.394651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.394651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:15.394652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:15.394654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:15.394666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId: src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:15.394759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:15.396877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:15.447597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554874583480560:4709]
2025-10-02T09:32:15.447792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1451, pipe: [1:7556554874583480560:4709]
2025-10-02T09:32:15.508998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.509365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.509374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.509387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480560:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.509515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.509567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554874583480560:4709]
2025-10-02T09:32:15.509591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:15.509591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.509643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0
2025-10-02T09:32:15.509776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1452 sessionId: src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0 is DEAD
2025-10-02T09:32:15.509946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:15.509961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Write session will restart in 0.009725s
2025-10-02T09:32:15.510000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Write session: Do CDS request
2025-10-02T09:32:15.510005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.521213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.521302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.521314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1453
2025-10-02T09:32:15.521451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.521477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.521484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.521486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.521757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1453 sessionId:  describe result for acl check
2025-10-02T09:32:15.521787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.521789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.521790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.521794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583480772:4298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.522158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583480772:4298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.523539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.523863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583480772:4298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.525723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.525833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.525839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.525845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.525860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583480772:4298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.525869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583480772:4298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.525871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583480772:4298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.525873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.525874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.525898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507941258:8979]
2025-10-02T09:32:15.526247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.526438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.526461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.526657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.526690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.526693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.526694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.526694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.526695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.526696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.526696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.526697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.526697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.526698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.526698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.526699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.526702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.526708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.526711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.526712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.526714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.526716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.526718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.526720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.526722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.526724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.526726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.526728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.526731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.526735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.526738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.526741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.526743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.526746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.526748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.526750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.526753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.526755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.526757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.526760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.526762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.526764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.526768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.526770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.526772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.526775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.526777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.526780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.526784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.526787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.526789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.526791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.526817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:15.534481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:15.536008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:15.536021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:15.536023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:15.536025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:15.536029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1452 [2:7556554874507941258:8979]
2025-10-02T09:32:15.536037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:15.536049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:15.536055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.536056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.536058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.536067Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:15.536070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:15.536075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:15.536107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.536112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.536113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.536115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:15.536117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:15.536156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:15.536161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.536168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.536174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.536182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:15.536197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480843:4298], now have 1 active actors on pipe
2025-10-02T09:32:15.536202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480561:2446], now have 1 active actors on pipe
2025-10-02T09:32:15.536206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.536208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.536209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.536216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:15.536227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:15.536229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:15.536231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:15.536232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:15.536237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:15.536239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:15.536255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.536260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:15.536266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:15.536276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.536249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1452
2025-10-02T09:32:15.536278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.536252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1452
2025-10-02T09:32:15.536300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:15.536308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.536310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.536311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:15.536316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.536321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:15.536330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.536487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.536491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.536499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.536604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1453 partition: 0 MaxSeqNo: 36 sessionId: src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0
2025-10-02T09:32:15.536992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3710f3d9-6e7674ed-2ba9e26b-66abe448_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:15.539833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Write session: try to update token
2025-10-02T09:32:15.539847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:15.545945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:15.545959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.545961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:15.545962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:15.545967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.545969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.545971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507941253:8979]
2025-10-02T09:32:15.545992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:15.545995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.545997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:15.546005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:15.546009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:15.546012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:15.546104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:15.554266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId: src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:15.556526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:15.609894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554874583480876:4709]
2025-10-02T09:32:15.610087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1452, pipe: [1:7556554874583480876:4709]
2025-10-02T09:32:15.664460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.664919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.664929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.664941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480876:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.665164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.665184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:15.665195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554874583480876:4709]
2025-10-02T09:32:15.665200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:15.665217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.665257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1453 reason: error at write: Disconnected sessionId: src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0
2025-10-02T09:32:15.665403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1453 sessionId: src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0 is DEAD
2025-10-02T09:32:15.665633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:15.665649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Write session will restart in 0.007655s
2025-10-02T09:32:15.665695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Write session: Do CDS request
2025-10-02T09:32:15.665701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.674376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.674447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.674458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1454
2025-10-02T09:32:15.674580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.674600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.674606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.674609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.675043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1454 sessionId:  describe result for acl check
2025-10-02T09:32:15.675070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.675074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.675075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.675078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583480939:4277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.675417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583480939:4277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.678394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583480939:4277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.681911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583480939:4277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.681920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583480939:4277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.681922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583480939:4277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.681925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.684256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.686527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.686716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.686725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.686731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.686766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.686788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507941580:8993]
2025-10-02T09:32:15.687183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.687424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.687449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.687653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.687682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.687685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.687686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.687686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.687687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.687687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.687688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.687688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.687689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.687689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.687690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.687690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.687693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.687699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.687701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.687703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.687705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.687707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.687709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.687711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.687713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.687715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.687717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.687719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.687724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.687727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.687731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.687734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.687736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.687739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.687741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.687743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.687745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.687748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.687750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.687752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.687754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.687757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.687759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.687762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.687765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.687768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.687770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.687772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.687778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.687781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.687783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.687786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.687805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:15.695583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:15.697411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:15.697423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:15.697424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:15.697426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:15.697430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1453 [2:7556554874507941580:8993]
2025-10-02T09:32:15.697437Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:15.697447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:15.697453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.697455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.697456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.697465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:15.697467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:15.697475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:15.697504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.697509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.697510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.697512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:15.697513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:15.697549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:15.697554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.697561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.697566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.697578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:15.697593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481111:4277], now have 1 active actors on pipe
2025-10-02T09:32:15.697598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583480877:2446], now have 1 active actors on pipe
2025-10-02T09:32:15.697602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.697606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.697607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.697615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:15.697624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:15.697635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:15.697635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:15.697637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:15.697638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:15.697639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:15.697652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.697654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:15.697649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1453
2025-10-02T09:32:15.697661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:15.697671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.697673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.697667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1453
2025-10-02T09:32:15.697692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:15.697699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.697701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.697704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:15.697709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.697716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:15.697726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.697866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.697870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.697878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.697943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1454 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0
2025-10-02T09:32:15.698236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793b177-cef1fec4-9bbc6d29-aae43e9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:15.705270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Write session: try to update token
2025-10-02T09:32:15.705291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:15.706960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:15.706971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.706973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:15.706974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:15.706977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.706981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.706982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507941575:8993]
2025-10-02T09:32:15.707001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:15.707004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.707005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:15.707007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:15.707011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:15.707012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:15.707110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:15.722323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId: src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:15.724313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:15.765532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554874583481171:4709]
2025-10-02T09:32:15.765750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1453, pipe: [1:7556554874583481171:4709]
2025-10-02T09:32:15.823127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.823445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.823454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.823467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481171:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.823694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.823697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:15.823701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:15.823734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554874583481171:4709]
2025-10-02T09:32:15.823779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1454 reason: error at write: Disconnected sessionId: src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0
2025-10-02T09:32:15.823826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.823956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1454 sessionId: src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0 is DEAD
2025-10-02T09:32:15.824130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:15.824144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Write session will restart in 0.005607s
2025-10-02T09:32:15.824169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Write session: Do CDS request
2025-10-02T09:32:15.824175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.831286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.831322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.831331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1455
2025-10-02T09:32:15.831546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.831567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.831574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.831576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.831856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1455 sessionId:  describe result for acl check
2025-10-02T09:32:15.831874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.831879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.831880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.831883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583481231:4275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.832241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583481231:4275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.834126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583481231:4275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.836818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583481231:4275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.836828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583481231:4275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.836830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583481231:4275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.836833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.840856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.843758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.843870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.843877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.843882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.843911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.843935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507941878:8996]
2025-10-02T09:32:15.844276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.844439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.844461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.844642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.844671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.844675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.844676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.844676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.844677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.844677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.844678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.844678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.844679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.844679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.844680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.844680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.844683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.844689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.844691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.844693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.844695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.844697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.844699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.844701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.844703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.844706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.844708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.844710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.844714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.844718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.844722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.844725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.844727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.844729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.844731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.844734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.844736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.844739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.844741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.844744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.844747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.844750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.844752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.844754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.844756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.844759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.844761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.844764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.844768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.844773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.844776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.844780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.844818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:15.852199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:15.853795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:15.853808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:15.853809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:15.853811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:15.853814Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1454 [2:7556554874507941878:8996]
2025-10-02T09:32:15.853822Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:15.853832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:15.853834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.853835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.853836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.853845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:15.853847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:15.853852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:15.853882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.853888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.853889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.853891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:15.853892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:15.853928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:15.853933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.853939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.853944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.853955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:15.853967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481352:4275], now have 1 active actors on pipe
2025-10-02T09:32:15.853972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481179:2446], now have 1 active actors on pipe
2025-10-02T09:32:15.853976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.853977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.853978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.853986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:15.853993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:15.853998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:15.854000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:15.854002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:15.854006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:15.854007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:15.854015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.854017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:15.854018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:15.854022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1454
2025-10-02T09:32:15.854035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1454
2025-10-02T09:32:15.854051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.854057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.854070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:15.854074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:15.854076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:15.854077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:15.854082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:15.854087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:15.854095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.854247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.854252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.854259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:15.854321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1455 partition: 0 MaxSeqNo: 36 sessionId: src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0
2025-10-02T09:32:15.854608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee11013-4348dcc6-3428dc9a-1483e746_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:15.857598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Write session: try to update token
2025-10-02T09:32:15.857617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:15.863246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:15.863259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:15.863260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:15.863261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:15.863265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.863267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.863269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507941873:8996]
2025-10-02T09:32:15.863288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:15.863291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.863293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:15.863334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:15.863343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:15.863345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:15.863468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:15.872215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId: src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:15.874401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:15.923743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554874583481489:4709]
2025-10-02T09:32:15.924024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1454, pipe: [1:7556554874583481489:4709]
2025-10-02T09:32:15.976640Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:15.977082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:15.977092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:15.977104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481489:4709], now have 1 active actors on pipe
2025-10-02T09:32:15.977221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:15.977297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:15.977308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:15.977309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:15.977342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554874583481489:4709]
2025-10-02T09:32:15.977353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1455 reason: error at write: Disconnected sessionId: src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0
2025-10-02T09:32:15.977504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1455 sessionId: src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0 is DEAD
2025-10-02T09:32:15.977680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:15.977695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Write session will restart in 0.005821s
2025-10-02T09:32:15.977716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Write session: Do CDS request
2025-10-02T09:32:15.977723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:15.984163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.984268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:15.984277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1456
2025-10-02T09:32:15.984397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:15.984417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:15.984424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:15.984426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:15.984817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1456 sessionId:  describe result for acl check
2025-10-02T09:32:15.984841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:15.984845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:15.984846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:15.984850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554874583481523:4263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:15.985199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554874583481523:4263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:15.987787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554874583481523:4263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:15.991030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554874583481523:4263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:15.991038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554874583481523:4263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:15.991040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554874583481523:4263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:15.991044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:15.995840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:15.998250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:15.998417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:15.998425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:15.998431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:15.998463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:15.998485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554874507942166:8999]
2025-10-02T09:32:15.998830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:15.999208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:15.999231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:15.999405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:15.999433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.999437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.999437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.999438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.999438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.999439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.999439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.999440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.999440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.999441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.999441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.999442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.999445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.999450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.999452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.999455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.999456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.999458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.999460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.999462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.999464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.999466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.999468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.999469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.999473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.999477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:15.999480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.999483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:15.999485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.999487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:15.999489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.999492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:15.999494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.999497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:15.999499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.999501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:15.999503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.999506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:15.999508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.999510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:15.999512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.999516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:15.999517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.999520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:15.999522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.999525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:15.999527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.999529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:15.999549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.007023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.008497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.008509Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.008510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.008512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.008516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1455 [2:7556554874507942166:8999]
2025-10-02T09:32:16.008523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.008534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.008540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.008542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.008543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.008552Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.008555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.008559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.008591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.008595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.008596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.008599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.008600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.008639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.008644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.008650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.008655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.008664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.008676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481490:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.008681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554874583481663:4263], now have 1 active actors on pipe
2025-10-02T09:32:16.008684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.008686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.008687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.008695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.008705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.008712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.008714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.008715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.008716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.008717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.008731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.008735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.008736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.008742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1455
2025-10-02T09:32:16.008763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1455
2025-10-02T09:32:16.008782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.008787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.008819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.008827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.008830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.008831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.008836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.008844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.008851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.008969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.008975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.008985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.009062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1456 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0
2025-10-02T09:32:16.009350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25a2f3a5-b6f50cbc-d7360b8d-83d1946_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.012139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Write session: try to update token
2025-10-02T09:32:16.012158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.017936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.017949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.017950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.017951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.017955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.017958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.017961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554874507942161:8999]
2025-10-02T09:32:16.017979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.017982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.017983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.017985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.017988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.017991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.018113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.025309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId: src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.027455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.077349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878449082:4709]
2025-10-02T09:32:16.077607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1455, pipe: [1:7556554878878449082:4709]
2025-10-02T09:32:16.128971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:16.129286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.129295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.129307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449082:4709], now have 1 active actors on pipe
2025-10-02T09:32:16.129492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878449082:4709]
2025-10-02T09:32:16.129510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:16.129521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:16.129523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:16.129589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1456 reason: error at write: Disconnected sessionId: src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0
2025-10-02T09:32:16.129652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:16.129721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1456 sessionId: src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0 is DEAD
2025-10-02T09:32:16.129880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:16.129892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Write session will restart in 0.008591s
2025-10-02T09:32:16.129916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Write session: Do CDS request
2025-10-02T09:32:16.129922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:16.139202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.139363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:16.139371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1457
2025-10-02T09:32:16.139475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.139494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:16.139500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:16.139502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:16.139805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1457 sessionId:  describe result for acl check
2025-10-02T09:32:16.139832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:16.139837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:16.139838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:16.139841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554878878449157:4259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:16.140189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554878878449157:4259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:16.142839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554878878449157:4259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:16.145562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554878878449157:4259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:16.145572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554878878449157:4259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:16.145574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554878878449157:4259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:16.145578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:16.148395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:16.150727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:16.150859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:16.150867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:16.150876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:16.150913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:16.150945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554878802909750:9001]
2025-10-02T09:32:16.151301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:16.151714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:16.151751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:16.152003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:16.152043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.152048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.152048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.152049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.152049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.152050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.152050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.152051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.152051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.152052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.152052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.152053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.152056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.152062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.152064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.152066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.152068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.152070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.152072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.152074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.152075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.152078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.152079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.152081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.152085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.152090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.152093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.152096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.152099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.152102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.152104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.152107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.152110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.152113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.152115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.152117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.152120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.152122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.152124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.152127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.152129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.152131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.152134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.152136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.152139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.152141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.152144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.152146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.152164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.159621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.161170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.161180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.161182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.161184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.161188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1456 [2:7556554878802909750:9001]
2025-10-02T09:32:16.161198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.161211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.161213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.161215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.161219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.161231Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.161240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.161246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.161286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.161293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.161294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.161297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.161299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.161349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.161355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.161366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.161376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.161386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.161403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449308:4259], now have 1 active actors on pipe
2025-10-02T09:32:16.161410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449083:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.161415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.161419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.161421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.161431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.161445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.161447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.161449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.161451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.161461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.161466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.161463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1456
2025-10-02T09:32:16.161484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.161490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.161464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1456
2025-10-02T09:32:16.161500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.161515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.161519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.161534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.161541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.161543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.161544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.161549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.161555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.161565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.161695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.161702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.161713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.161791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1457 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0
2025-10-02T09:32:16.162072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1a183d-9ee2d0ca-6068b4ab-a208434a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.164784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Write session: try to update token
2025-10-02T09:32:16.164819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.170605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.170617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.170619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.170620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.170623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.170626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.170628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554878802909745:9001]
2025-10-02T09:32:16.170646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.170649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.170650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.170651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.170652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.170654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.170764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.179112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId: src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.181137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.229419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878449382:4709]
2025-10-02T09:32:16.229655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1456, pipe: [1:7556554878878449382:4709]
2025-10-02T09:32:16.281763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:16.282077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.282086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.282099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449382:4709], now have 1 active actors on pipe
2025-10-02T09:32:16.282237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:16.282264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878449382:4709]
2025-10-02T09:32:16.282284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:16.282295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:16.282298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:16.282355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1457 reason: error at write: Disconnected sessionId: src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0
2025-10-02T09:32:16.282493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1457 sessionId: src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0 is DEAD
2025-10-02T09:32:16.282643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:16.282653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Write session will restart in 0.007661s
2025-10-02T09:32:16.282669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Write session: Do CDS request
2025-10-02T09:32:16.282673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:16.291240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.291424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:16.291435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1458
2025-10-02T09:32:16.291507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.291527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:16.291533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:16.291535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:16.291850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1458 sessionId:  describe result for acl check
2025-10-02T09:32:16.291876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:16.291881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:16.291882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:16.291885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554878878449446:4252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:16.292231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554878878449446:4252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:16.294568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554878878449446:4252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:16.297655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554878878449446:4252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:16.297662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554878878449446:4252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:16.297664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554878878449446:4252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:16.297667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:16.301010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:16.304081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:16.304176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:16.304183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:16.304188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:16.304214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:16.304357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554878802910041:9004]
2025-10-02T09:32:16.304699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:16.304926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:16.304952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:16.305129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:16.305159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.305162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.305163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.305164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.305164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.305165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.305165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.305166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.305166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.305167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.305167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.305168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.305171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.305177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.305179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.305181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.305183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.305185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.305187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.305189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.305191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.305194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.305196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.305197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.305201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.305205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.305208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.305211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.305213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.305215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.305218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.305220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.305222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.305225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.305227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.305230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.305234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.305236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.305239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.305241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.305244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.305248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.305251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.305254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.305256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.305262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.305264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.305266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.305284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.312657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.313972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.313984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.313986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.313988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.313991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1457 [2:7556554878802910041:9004]
2025-10-02T09:32:16.313998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.314007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.314010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.314012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.314013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.314022Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.314025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.314031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.314058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.314063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.314064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.314066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.314068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.314103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.314108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.314114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.314119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.314126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.314140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449589:4252], now have 1 active actors on pipe
2025-10-02T09:32:16.314144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449383:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.314148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.314149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.314150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.314159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.314168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.314173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.314176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.314178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.314179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.314181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.314193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.314197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.314198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.314194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1457
2025-10-02T09:32:16.314208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1457
2025-10-02T09:32:16.314214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.314219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.314237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.314243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.314246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.314247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.314252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.314257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.314265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.314406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.314418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.314433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.314513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1458 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0
2025-10-02T09:32:16.314726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c569ecc-4ccac35f-f2fd1b2d-d7ef56eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.317087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Write session: try to update token
2025-10-02T09:32:16.317097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.323428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.323443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.323445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.323446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.323450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.323453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.323455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554878802910036:9004]
2025-10-02T09:32:16.323477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.323482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.323482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.323483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.323485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.323487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.323637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.327487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId: src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.329388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.382488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878449681:4709]
2025-10-02T09:32:16.382739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1457, pipe: [1:7556554878878449681:4709]
2025-10-02T09:32:16.433001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:16.433313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.433323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.433348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449681:4709], now have 1 active actors on pipe
2025-10-02T09:32:16.433474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:16.433560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:16.433567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:16.433586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:16.433605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1458 reason: error at write: Disconnected sessionId: src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0
2025-10-02T09:32:16.433618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878449681:4709]
2025-10-02T09:32:16.433733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1458 sessionId: src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0 is DEAD
2025-10-02T09:32:16.433849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:16.433858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Write session will restart in 0.006353s
2025-10-02T09:32:16.433874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Write session: Do CDS request
2025-10-02T09:32:16.433878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:16.441142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.441308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:16.441319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1459
2025-10-02T09:32:16.441430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.441450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:16.441456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:16.441458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:16.441758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1459 sessionId:  describe result for acl check
2025-10-02T09:32:16.441777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:16.441781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:16.441783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:16.441786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554878878449722:4248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:16.442132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554878878449722:4248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:16.444546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554878878449722:4248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:16.447105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554878878449722:4248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:16.447114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554878878449722:4248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:16.447116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554878878449722:4248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:16.447119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:16.451920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:16.454270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:16.454390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:16.454397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:16.454403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:16.454430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:16.454453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554878802910331:9006]
2025-10-02T09:32:16.454803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:16.455023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:16.455048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:16.455334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:16.455370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.455374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.455375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.455375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.455376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.455377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.455377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.455378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.455378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.455379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.455379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.455379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.455382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.455388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.455390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.455392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.455394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.455396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.455398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.455400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.455402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.455404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.455406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.455408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.455412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.455416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.455419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.455422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.455424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.455426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.455428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.455431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.455433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.455435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.455437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.455440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.455442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.455444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.455446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.455449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.455451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.455453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.455456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.455459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.455461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.455464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.455466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.455469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.455487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.462996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.464327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.464341Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.464343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.464346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.464351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1458 [2:7556554878802910331:9006]
2025-10-02T09:32:16.464486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.464499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.464501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.464502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.464503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.464512Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.464515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.464519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.464549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.464554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.464555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.464557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.464558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.464593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.464598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.464604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.464609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.464617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.464630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449682:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.464633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449848:4248], now have 1 active actors on pipe
2025-10-02T09:32:16.464637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.464638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.464640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.464649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.464658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.464665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.464667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.464668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.464672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.464674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.464690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.464700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.464696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1458
2025-10-02T09:32:16.464715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.464715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1458
2025-10-02T09:32:16.464768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.464776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.464794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.464815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.464818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.464819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.464826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.464833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.464846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.464975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.464980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.464988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.465057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1459 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0
2025-10-02T09:32:16.465298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae5b988-f914efdf-1e84379d-1b1ee06_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.467425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Write session: try to update token
2025-10-02T09:32:16.467434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.473960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.473976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.473977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.473978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.473982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.473985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.473987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554878802910326:9006]
2025-10-02T09:32:16.474009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.474013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.474013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.474015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.474016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.474018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.474126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.478816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId: src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.480751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.533524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878449985:4709]
2025-10-02T09:32:16.533705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1458, pipe: [1:7556554878878449985:4709]
2025-10-02T09:32:16.587266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:16.587602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.587611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.587636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449985:4709], now have 1 active actors on pipe
2025-10-02T09:32:16.587781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:16.587848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:16.587860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878449985:4709]
2025-10-02T09:32:16.587879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:16.587933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0
2025-10-02T09:32:16.588061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1459 sessionId: src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0 is DEAD
2025-10-02T09:32:16.588173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:16.588182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Write session will restart in 0.009363s
2025-10-02T09:32:16.588197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Write session: Do CDS request
2025-10-02T09:32:16.588201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:16.598197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.598315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:16.598324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1460
2025-10-02T09:32:16.598413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.598432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:16.598435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:16.598439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:16.598908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1460 sessionId:  describe result for acl check
2025-10-02T09:32:16.598935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:16.598939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:16.598940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:16.598943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554878878450078:4240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:16.599281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554878878450078:4240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:16.601984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554878878450078:4240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:16.604351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554878878450078:4240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:16.604361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554878878450078:4240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:16.604363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554878878450078:4240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:16.604367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:16.606016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:16.608476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:16.608662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:16.608671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:16.608678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:16.608712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:16.608734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554878802910635:9008]
2025-10-02T09:32:16.609144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:16.609352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:16.609377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:16.609568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:16.609601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.609605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.609606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.609606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.609607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.609608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.609608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.609609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.609609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.609610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.609610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.609611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.609614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.609621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.609623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.609625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.609628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.609630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.609632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.609634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.609636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.609638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.609640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.609642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.609645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.609649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.609653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.609656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.609658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.609661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.609663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.609666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.609668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.609671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.609673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.609675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.609678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.609680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.609683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.609685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.609690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.609692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.609694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.609697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.609699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.609702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.609704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.609707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.609724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.617307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.618750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.618762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.618764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.618767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.618771Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1459 [2:7556554878802910635:9008]
2025-10-02T09:32:16.618778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.618788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.618789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.618790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.618791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.618808Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.618812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.618816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.618844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.618845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.618845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.618847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.618848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.618882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.618887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.618894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.618899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.618907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.618918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878449986:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.618921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450251:4240], now have 1 active actors on pipe
2025-10-02T09:32:16.618924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.618925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.618926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.618934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.618941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.618948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.618950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.618951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.618952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.618953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.618963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.618964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.618966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.618992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1459
2025-10-02T09:32:16.619016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1459
2025-10-02T09:32:16.619041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.619047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.619062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.619065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.619067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.619068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.619073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.619078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.619086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.619203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.619207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.619214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.619285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1460 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0
2025-10-02T09:32:16.619551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2603dbb-bbc6ce44-2645f4c0-261c7d1f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.622383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Write session: try to update token
2025-10-02T09:32:16.622398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.628200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.628210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.628211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.628212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.628216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.628218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.628219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554878802910621:9008]
2025-10-02T09:32:16.628238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.628241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.628242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.628244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.628247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.628249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.628345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.635746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId: src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.637862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.688144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878450308:4709]
2025-10-02T09:32:16.688356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1459, pipe: [1:7556554878878450308:4709]
2025-10-02T09:32:16.742838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:16.743089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.743098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.743110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450308:4709], now have 1 active actors on pipe
2025-10-02T09:32:16.743227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:16.743264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:16.743299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:16.743351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1460 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0
2025-10-02T09:32:16.743481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1460 sessionId: src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0 is DEAD
2025-10-02T09:32:16.743635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:16.743650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Write session will restart in 0.006523s
2025-10-02T09:32:16.743672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Write session: Do CDS request
2025-10-02T09:32:16.743678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:16.743680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878450308:4709]
2025-10-02T09:32:16.751195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.751301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:16.751308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1461
2025-10-02T09:32:16.751415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.751433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:16.751439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:16.751442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:16.751726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1461 sessionId:  describe result for acl check
2025-10-02T09:32:16.751748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:16.751752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:16.751753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:16.751756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554878878450365:4225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:16.752054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554878878450365:4225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:16.754595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554878878450365:4225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:16.758056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554878878450365:4225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:16.758065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554878878450365:4225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:16.758067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554878878450365:4225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:16.758070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:16.761107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:16.763997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:16.764099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:16.764106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:16.764112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:16.764140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:16.764170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554878802910963:9023]
2025-10-02T09:32:16.764518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:16.764739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:16.764763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:16.764970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:16.765005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.765009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.765009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.765010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.765010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.765011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.765011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.765012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.765013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.765013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.765014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.765014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.765017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.765023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.765025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.765027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.765029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.765031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.765033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.765035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.765037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.765039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.765041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.765043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.765046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.765050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.765054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.765056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.765059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.765062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.765064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.765066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.765069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.765071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.765075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.765077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.765080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.765082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.765084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.765087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.765089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.765091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.765096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.765098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.765100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.765103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.765105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.765107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.765134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.772481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.773932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.773944Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.773945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.773947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.773950Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1460 [2:7556554878802910963:9023]
2025-10-02T09:32:16.773956Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.773966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.773967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.773968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.773970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.773978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.773980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.773989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.774015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.774019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.774020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.774022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.774023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.774059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.774063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.774070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.774075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.774085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.774099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450309:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.774104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450528:4225], now have 1 active actors on pipe
2025-10-02T09:32:16.774108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.774109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.774110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.774117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.774127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.774132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.774135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.774137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.774142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.774144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.774159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.774166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.774173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.774177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1460
2025-10-02T09:32:16.774191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1460
2025-10-02T09:32:16.774282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.774288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.774304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.774310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.774312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.774314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.774319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.774325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.774333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.774464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.774468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.774476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.774539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1461 partition: 0 MaxSeqNo: 36 sessionId: src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0
2025-10-02T09:32:16.774823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab2730d-ab3068c1-91a39e78-4eeb6ada_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.777554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Write session: try to update token
2025-10-02T09:32:16.777568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.783326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.783339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.783340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.783342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.783347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.783352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.783354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554878802910958:9023]
2025-10-02T09:32:16.783377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.783379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.783382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.783385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.783388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.783392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.783492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.790479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId: src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.792601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.843796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878450614:4709]
2025-10-02T09:32:16.843978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1460, pipe: [1:7556554878878450614:4709]
2025-10-02T09:32:16.896817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:16.897109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.897118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.897130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450614:4709], now have 1 active actors on pipe
2025-10-02T09:32:16.897270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:16.897302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:16.897340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878450614:4709]
2025-10-02T09:32:16.897567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:16.897622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1461 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0
2025-10-02T09:32:16.897759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1461 sessionId: src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0 is DEAD
2025-10-02T09:32:16.897934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:16.897949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Write session will restart in 0.007614s
2025-10-02T09:32:16.897969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Write session: Do CDS request
2025-10-02T09:32:16.897975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:16.906214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.906325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:16.906331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1462
2025-10-02T09:32:16.906441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:16.906464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:16.906473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:16.906478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:16.906770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1462 sessionId:  describe result for acl check
2025-10-02T09:32:16.906793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:16.906804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:16.906805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:16.906808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554878878450704:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:16.907132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554878878450704:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:16.909554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554878878450704:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:16.912474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554878878450704:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:16.912485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554878878450704:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:16.912486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554878878450704:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:16.912489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:16.915116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:16.917413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:16.917560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:16.917567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:16.917573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:16.917602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:16.917624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554878802911256:9025]
2025-10-02T09:32:16.917962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:16.918343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:16.918369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:16.918547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:16.918574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.918578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.918579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.918579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.918580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.918581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.918581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.918582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.918582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.918582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.918583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.918583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.918587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.918593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.918595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.918597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.918599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.918601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.918603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.918605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.918607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.918610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.918612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.918614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.918618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.918622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:16.918625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.918628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:16.918630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.918633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:16.918637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.918639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:16.918641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.918646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:16.918648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.918650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:16.918652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.918657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:16.918659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.918661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:16.918663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.918666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:16.918668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.918673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.918675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.918678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.918680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.918683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.918702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:16.926154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:16.927609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:16.927622Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:16.927623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:16.927625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:16.927628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1461 [2:7556554878802911256:9025]
2025-10-02T09:32:16.927635Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:16.927644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:16.927645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.927647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.927648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.927657Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:16.927659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:16.927663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:16.927691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.927697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.927698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.927699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:16.927701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:16.927735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:16.927740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.927746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:16.927751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:16.927759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:16.927774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450862:4218], now have 1 active actors on pipe
2025-10-02T09:32:16.927781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450631:2446], now have 1 active actors on pipe
2025-10-02T09:32:16.927785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.927789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.927790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.927800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:16.927812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:16.927813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:16.927820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:16.927821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:16.927823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:16.927825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:16.927827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1461
2025-10-02T09:32:16.927837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1461
2025-10-02T09:32:16.927844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.927848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:16.927849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:16.927858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.927865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.927890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:16.927897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:16.927899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:16.927900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:16.927905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:16.927911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:16.927923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.928020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:16.928026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:16.928035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:16.928108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1462 partition: 0 MaxSeqNo: 36 sessionId: src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0
2025-10-02T09:32:16.928402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b967e5cb-171b7d55-7ca6a881-b8ffca19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:16.930914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Write session: try to update token
2025-10-02T09:32:16.930925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:16.937080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:16.937094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:16.937096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:16.937097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:16.937101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.937104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.937106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554878802911251:9025]
2025-10-02T09:32:16.937127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:16.937130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:16.937132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:16.937134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:16.937135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:16.937135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:16.937246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:16.942658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId: src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:16.944841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:16.997431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554878878450932:4709]
2025-10-02T09:32:16.997660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1461, pipe: [1:7556554878878450932:4709]
2025-10-02T09:32:17.048061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.048434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.048444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.048456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554878878450932:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.048569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:17.048648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:17.048651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554878878450932:4709]
2025-10-02T09:32:17.048667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:17.048667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.048712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1462 reason: error at write: Disconnected sessionId: src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0
2025-10-02T09:32:17.048855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1462 sessionId: src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0 is DEAD
2025-10-02T09:32:17.049004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:17.049018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Write session will restart in 0.008054s
2025-10-02T09:32:17.049043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Write session: Do CDS request
2025-10-02T09:32:17.049049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.058185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.058402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.058414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1463
2025-10-02T09:32:17.058505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.058529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.058538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.058541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.058925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1463 sessionId:  describe result for acl check
2025-10-02T09:32:17.058949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.058953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.058954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.058957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173418310:4212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.059292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173418310:4212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.061673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173418310:4212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.064869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173418310:4212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.064879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173418310:4212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.064881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173418310:4212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.064885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:17.067059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:17.069484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:17.069663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:17.069671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:17.069678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:17.069711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:17.069733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554883097878848:9028]
2025-10-02T09:32:17.070076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:17.070275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:17.070300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:17.070484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:17.070513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.070516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.070517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.070518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.070518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.070519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.070519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.070520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.070520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.070521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.070521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.070522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.070525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.070531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.070533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.070535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.070537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.070539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.070541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.070543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.070545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.070547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.070549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.070551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.070555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.070559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.070562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.070565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.070567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.070570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.070572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.070575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.070577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.070580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.070583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.070585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.070587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.070590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.070592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.070595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.070597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.070599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.070602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.070604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.070606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.070609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.070611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.070614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.070630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:17.078046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:17.079498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:17.079509Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:17.079510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:17.079512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:17.079516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1462 [2:7556554883097878848:9028]
2025-10-02T09:32:17.079522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:17.079531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:17.079536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.079537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.079538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.079547Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:17.079550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:17.079554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:17.079583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.079588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.079589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.079591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:17.079592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:17.079627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:17.079632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.079638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.079644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.079655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:17.079670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418230:2446], now have 1 active actors on pipe
2025-10-02T09:32:17.079677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418484:4212], now have 1 active actors on pipe
2025-10-02T09:32:17.079682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.079683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.079685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.079695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:17.079707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:17.079708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:17.079714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:17.079715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:17.079721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:17.079723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:17.079741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.079751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:17.079755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:17.079750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1462
2025-10-02T09:32:17.079753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1462
2025-10-02T09:32:17.079782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.079790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.079806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:17.079815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.079820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.079821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:17.079828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.079836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:17.079848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.079994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.079999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.080008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.080093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1463 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0
2025-10-02T09:32:17.080327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d505c2f-1ce6f376-5aac7d50-aa30e38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:17.082540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Write session: try to update token
2025-10-02T09:32:17.082551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:17.089079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:17.089094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.089096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:17.089097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:17.089101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.089104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.089106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554883097878843:9028]
2025-10-02T09:32:17.089127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:17.089130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.089131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:17.089132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:17.089134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:17.089137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:17.089265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:17.093325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId: src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:17.095516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:17.148965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554883173418532:4709]
2025-10-02T09:32:17.149188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1462, pipe: [1:7556554883173418532:4709]
2025-10-02T09:32:17.198914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.199185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.199194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.199217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418532:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.199328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:17.199362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554883173418532:4709]
2025-10-02T09:32:17.199382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:17.199384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:17.199402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.199428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1463 reason: error at write: Disconnected sessionId: src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0
2025-10-02T09:32:17.199560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1463 sessionId: src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0 is DEAD
2025-10-02T09:32:17.199729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:17.199744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Write session will restart in 0.008702s
2025-10-02T09:32:17.199765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Write session: Do CDS request
2025-10-02T09:32:17.199771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.209272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.209391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.209402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1464
2025-10-02T09:32:17.209506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.209526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.209532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.209535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.209882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1464 sessionId:  describe result for acl check
2025-10-02T09:32:17.209910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.209917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.209918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.209921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173418612:4194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.210354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173418612:4194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.212631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173418612:4194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.215558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173418612:4194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.215569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173418612:4194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.215571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173418612:4194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.215575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:17.217923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:17.220228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:17.220340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:17.220346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:17.220352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:17.220381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:17.220402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554883097879143:9030]
2025-10-02T09:32:17.220747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:17.220981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:17.221004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:17.221182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:17.221211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.221215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.221216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.221216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.221217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.221217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.221218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.221218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.221219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.221220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.221220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.221221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.221223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.221230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.221232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.221234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.221236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.221238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.221240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.221242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.221244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.221246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.221248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.221250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.221253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.221257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.221261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.221263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.221265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.221268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.221270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.221273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.221275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.221278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.221280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.221283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.221288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.221291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.221293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.221295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.221297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.221300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.221306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.221309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.221312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.221318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.221320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.221322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.221340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:17.228757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:17.230260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:17.230272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:17.230273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:17.230275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:17.230278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1463 [2:7556554883097879143:9030]
2025-10-02T09:32:17.230285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:17.230295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:17.230302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.230304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.230305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.230317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:17.230325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:17.230333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:17.230362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.230369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.230369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.230371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:17.230372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:17.230408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:17.230413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.230419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.230424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.230432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:17.230447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418774:4194], now have 1 active actors on pipe
2025-10-02T09:32:17.230452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418534:2446], now have 1 active actors on pipe
2025-10-02T09:32:17.230456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.230458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.230459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.230467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:17.230474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:17.230480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:17.230481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:17.230483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:17.230483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:17.230484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:17.230498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.230503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:17.230504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:17.230511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1463
2025-10-02T09:32:17.230519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1463
2025-10-02T09:32:17.230576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.230582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.230595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:17.230602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.230604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.230605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:17.230609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.230614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:17.230624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.230729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.230734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.230741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.230820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1464 partition: 0 MaxSeqNo: 36 sessionId: src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0
2025-10-02T09:32:17.231060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e553e2-9fc24d7e-26afbf90-9cacd5ae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:17.233272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Write session: try to update token
2025-10-02T09:32:17.233283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:17.239664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:17.239679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.239680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:17.239681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:17.239685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.239688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.239690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554883097879138:9030]
2025-10-02T09:32:17.239710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:17.239713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.239714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:17.239717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:17.239722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:17.239725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:17.239822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:17.243727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId: src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:17.245909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:17.299494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554883173418839:4709]
2025-10-02T09:32:17.299737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1463, pipe: [1:7556554883173418839:4709]
2025-10-02T09:32:17.350181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.350471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.350480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.350504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418839:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.350627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:17.350675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554883173418839:4709]
2025-10-02T09:32:17.350692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.350703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:17.350761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1464 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0
2025-10-02T09:32:17.350905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1464 sessionId: src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0 is DEAD
2025-10-02T09:32:17.351025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:17.351034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Write session will restart in 0.009091s
2025-10-02T09:32:17.351051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Write session: Do CDS request
2025-10-02T09:32:17.351055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.361136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.361378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.361385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1465
2025-10-02T09:32:17.361470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.361490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.361497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.361499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.361802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1465 sessionId:  describe result for acl check
2025-10-02T09:32:17.361828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.361832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.361833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.361836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173418937:4201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.362175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173418937:4201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.364614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173418937:4201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.366417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173418937:4201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.366426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173418937:4201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.366427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173418937:4201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.366430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:17.368900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:17.371453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:17.371554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:17.371561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:17.371567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:17.371598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:17.371618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554883097879441:9033]
2025-10-02T09:32:17.371962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:17.372145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:17.372174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:17.372350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:17.372381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.372386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.372386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.372387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.372387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.372388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.372389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.372389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.372390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.372390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.372391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.372391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.372394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.372400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.372402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.372404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.372406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.372408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.372410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.372412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.372414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.372417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.372419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.372421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.372426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.372431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.372434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.372436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.372438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.372441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.372443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.372446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.372450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.372453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.372455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.372457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.372459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.372462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.372464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.372467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.372468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.372471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.372473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.372476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.372477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.372481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.372483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.372486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.372501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:17.379881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:17.381442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:17.381452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:17.381453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:17.381455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:17.381458Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1464 [2:7556554883097879441:9033]
2025-10-02T09:32:17.381464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:17.381473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:17.381478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.381479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.381480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.381489Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:17.381494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:17.381498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:17.381525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.381529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.381530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.381532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:17.381533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:17.381567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:17.381572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.381578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.381583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.381593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:17.381606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419089:4201], now have 1 active actors on pipe
2025-10-02T09:32:17.381611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173418840:2446], now have 1 active actors on pipe
2025-10-02T09:32:17.381615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.381616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.381617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.381625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:17.381632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:17.381636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:17.381638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:17.381639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:17.381643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:17.381644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:17.381656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.381662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:17.381662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:17.381664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1464
2025-10-02T09:32:17.381667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1464
2025-10-02T09:32:17.381697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.381702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.381717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:17.381724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.381726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.381727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:17.381731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.381739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:17.381749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.381858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.381863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.381871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.381946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1465 partition: 0 MaxSeqNo: 36 sessionId: src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0
2025-10-02T09:32:17.382169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b3ca12-69b5d394-a635f1b5-1637dc25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:17.384497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Write session: try to update token
2025-10-02T09:32:17.384507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:17.395009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:17.395024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.395029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.395053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:17.395058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:17.395189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:17.395315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:17.395432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:17.395549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:17.395706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:17.395738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:17.397113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId: src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:17.399270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:17.399477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.399494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.399506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:17.399508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.399509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:17.399510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:17.399514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.399516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.399518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554883097879436:9033]
2025-10-02T09:32:17.399539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:17.399542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:17.399545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.399547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:17.399549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:17.399553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:17.399652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:17.451040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554883173419149:4709]
2025-10-02T09:32:17.451284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1464, pipe: [1:7556554883173419149:4709]
2025-10-02T09:32:17.510058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.510333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:17.510356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419149:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.510452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:17.510497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554883173419149:4709]
2025-10-02T09:32:17.510517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:17.510520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.510522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:17.510567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1465 reason: error at write: Disconnected sessionId: src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0
2025-10-02T09:32:17.510674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1465 sessionId: src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0 is DEAD
2025-10-02T09:32:17.510818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:17.510827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Write session will restart in 0.005359s
2025-10-02T09:32:17.510843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Write session: Do CDS request
2025-10-02T09:32:17.510848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.517226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.517237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1466
2025-10-02T09:32:17.517264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.517437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.517456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.517463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.517466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.517795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1466 sessionId:  describe result for acl check
2025-10-02T09:32:17.517819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.517823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.517824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.517827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173419177:4193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.518232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173419177:4193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.520347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173419177:4193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.522837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173419177:4193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.522863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173419177:4193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.522868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173419177:4193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.522871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:17.528952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:17.531491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:17.531593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:17.531600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:17.531605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:17.531630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:17.531651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554883097879737:9035]
2025-10-02T09:32:17.531996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:17.532336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:17.532363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:17.532548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:17.532577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.532581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.532582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.532582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.532583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.532584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.532584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.532585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.532585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.532586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.532586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.532587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.532589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.532596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.532598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.532600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.532602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.532604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.532606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.532608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.532610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.532612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.532614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.532616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.532619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.532623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.532626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.532629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.532631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.532634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.532636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.532640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.532642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.532645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.532646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.532649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.532652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.532655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.532656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.532659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.532661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.532663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.532665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.532668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.532670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.532672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.532674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.532677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.532692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:17.540114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:17.541658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:17.541669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:17.541670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:17.541672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:17.541674Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1465 [2:7556554883097879737:9035]
2025-10-02T09:32:17.541682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:17.541692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:17.541694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.541695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.541696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.541704Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:17.541710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:17.541714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:17.541742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.541747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.541747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.541750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:17.541751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:17.541784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:17.541788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.541794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.541801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.541809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:17.541823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419150:2446], now have 1 active actors on pipe
2025-10-02T09:32:17.541828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419294:4193], now have 1 active actors on pipe
2025-10-02T09:32:17.541831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.541832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.541833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.541840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:17.541850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:17.541857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:17.541858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:17.541859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:17.541864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:17.541865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:17.541871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.541873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:17.541874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:17.541916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1465
2025-10-02T09:32:17.541920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1465
2025-10-02T09:32:17.541967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.541974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.541989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:17.541996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.541999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.542000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:17.542005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.542013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:17.542023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.542158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.542164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.542173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.542236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1466 partition: 0 MaxSeqNo: 36 sessionId: src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0
2025-10-02T09:32:17.542454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d7aceb-632e005f-be4e1ed9-f9459fe7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:17.544672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Write session: try to update token
2025-10-02T09:32:17.544682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:17.551071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:17.551088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.551089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:17.551091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:17.551095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.551098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.551100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554883097879732:9035]
2025-10-02T09:32:17.551121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:17.551126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:17.551128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.551129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:17.551130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:17.551132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:17.551246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:17.555421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId: src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:17.557356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:17.610787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554883173419457:4709]
2025-10-02T09:32:17.611047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1465, pipe: [1:7556554883173419457:4709]
2025-10-02T09:32:17.665006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.665314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.665324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.665347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419457:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.665452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:17.665493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.665503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554883173419457:4709]
2025-10-02T09:32:17.665518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:17.665561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1466 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0
2025-10-02T09:32:17.665697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1466 sessionId: src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0 is DEAD
2025-10-02T09:32:17.665825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:17.665834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Write session will restart in 0.006661s
2025-10-02T09:32:17.665851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Write session: Do CDS request
2025-10-02T09:32:17.665856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.673099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.673198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.673208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1467
2025-10-02T09:32:17.673280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.673298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.673304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.673306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.673608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1467 sessionId:  describe result for acl check
2025-10-02T09:32:17.673632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.673638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.673640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.673644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173419530:4177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.674043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173419530:4177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.675794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173419530:4177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.678589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173419530:4177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.678600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173419530:4177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.678603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173419530:4177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.678608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:17.683044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:17.683487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:17.683623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:17.683629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:17.683635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:17.683663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:17.683682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554883097880071:9049]
2025-10-02T09:32:17.684030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:17.685482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:17.685516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:17.685702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:17.685730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.685734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.685735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.685735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.685736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.685737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.685737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.685738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.685738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.685738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.685739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.685739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.685742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.685748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.685750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.685752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.685754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.685756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.685758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.685760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.685762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.685764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.685766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.685768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.685771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.685775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.685778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.685781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.685783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.685786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.685788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.685791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.685793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.685795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.685798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.685800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.685803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.685805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.685807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.685810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.685812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.685816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.685818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.685820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.685822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.685825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.685827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.685830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.685846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:17.693321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:17.694766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:17.694777Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:17.694778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:17.694780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:17.694783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1466 [2:7556554883097880071:9049]
2025-10-02T09:32:17.694790Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:17.694807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:17.694808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.694810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.694811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.694819Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:17.694826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:17.694831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:17.694857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.694862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.694863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.694865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:17.694866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:17.694903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:17.694909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.694916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.694921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.694929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:17.694939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419483:2446], now have 1 active actors on pipe
2025-10-02T09:32:17.694941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419655:4177], now have 1 active actors on pipe
2025-10-02T09:32:17.694945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.694946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.694947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.694955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:17.694964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:17.694967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:17.694969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:17.694970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:17.694974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:17.694975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:17.694987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.694992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:17.694993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:17.695006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1466
2025-10-02T09:32:17.695019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1466
2025-10-02T09:32:17.695149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.695156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.695170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:17.695177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.695179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.695180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:17.695185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.695193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:17.695200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.695352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.695358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.695366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.695440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1467 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0
2025-10-02T09:32:17.695648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7700f0c2-79f7494a-b51ed266-d411f3ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:17.697861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Write session: try to update token
2025-10-02T09:32:17.697871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:17.704262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:17.704281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.704282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:17.704283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:17.704287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.704289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.704293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554883097880066:9049]
2025-10-02T09:32:17.704315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:17.704319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.704319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:17.704320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:17.704321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:17.704324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:17.704424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:17.709802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId: src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:17.711851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:17.765411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554883173419787:4709]
2025-10-02T09:32:17.765633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1466, pipe: [1:7556554883173419787:4709]
2025-10-02T09:32:17.815974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.816248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.816259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.816272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419787:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.816440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:17.816451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:17.816525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554883173419787:4709]
2025-10-02T09:32:17.816553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.816643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1467 reason: error at write: Disconnected sessionId: src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0
2025-10-02T09:32:17.816743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:17.816779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1467 sessionId: src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0 is DEAD
2025-10-02T09:32:17.816908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:17.816918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Write session will restart in 0.009652s
2025-10-02T09:32:17.816932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Write session: Do CDS request
2025-10-02T09:32:17.816936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.827220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.827224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.827233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1468
2025-10-02T09:32:17.827380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.827400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.827405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.827409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.827666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1468 sessionId:  describe result for acl check
2025-10-02T09:32:17.827691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.827696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.827697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.827700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173419894:4160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.828032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173419894:4160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.830072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173419894:4160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.832710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173419894:4160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.832721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173419894:4160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.832723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173419894:4160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.832728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:17.834450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:17.836343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:17.836536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:17.836545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:17.836555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:17.836593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:17.836616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554883097880382:9052]
2025-10-02T09:32:17.836968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:17.837157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:17.837183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:17.837373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:17.837405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.837409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.837410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.837410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.837411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.837412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.837412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.837412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.837413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.837413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.837414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.837415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.837417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.837423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.837425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.837427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.837429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.837431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.837433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.837435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.837436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.837439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.837440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.837442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.837445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.837449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:17.837453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.837455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:17.837457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.837460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:17.837462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.837465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:17.837468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.837471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:17.837473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.837475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:17.837477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.837480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:17.837482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.837484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:17.837487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.837494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:17.837496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.837498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.837500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.837503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.837508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.837510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.837527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:17.844874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:17.846303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:17.846313Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:17.846314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:17.846316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:17.846319Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1467 [2:7556554883097880382:9052]
2025-10-02T09:32:17.846325Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:17.846334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:17.846339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.846340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.846341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.846349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:17.846354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:17.846358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:17.846385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.846390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.846391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.846392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:17.846394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:17.846427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:17.846432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.846438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:17.846443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:17.846454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:17.846469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173419791:2446], now have 1 active actors on pipe
2025-10-02T09:32:17.846474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173420065:4160], now have 1 active actors on pipe
2025-10-02T09:32:17.846477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.846478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.846480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.846487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:17.846495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:17.846500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:17.846502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:17.846503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:17.846505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:17.846506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:17.846518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.846523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:17.846525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:17.846526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1467
2025-10-02T09:32:17.846528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1467
2025-10-02T09:32:17.846564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.846569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.846581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|733e2f5a-24523864-63a55df5-e7219493_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:17.846588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:17.846590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:17.846593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:17.846598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:17.846603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:17.846613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.846737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.846744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.846753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:17.846841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1468 partition: 0 MaxSeqNo: 36 sessionId: src_id|733e2f5a-24523864-63a55df5-e7219493_0
2025-10-02T09:32:17.847035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed7525f-5452b93c-cb7374b3-19409e00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|733e2f5a-24523864-63a55df5-e7219493_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:17.849390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Write session: try to update token
2025-10-02T09:32:17.849401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:17.855451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:17.855468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.855475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.855499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:17.855502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:17.855627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:17.855743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:17.855852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:17.855991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:17.856143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:17.856167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:17.860241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId: src_id|733e2f5a-24523864-63a55df5-e7219493_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:17.862132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:17.862261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.862272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.862290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:17.862353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:17.863879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:17.863892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:17.863895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:17.863897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:17.863902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.863905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.863907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554883097880376:9052]
2025-10-02T09:32:17.863927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:17.863930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:17.863930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:17.863931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:17.863932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:17.863935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:17.864027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:17.916451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554883173420116:4709]
2025-10-02T09:32:17.916661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1467, pipe: [1:7556554883173420116:4709]
2025-10-02T09:32:17.974127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:17.980019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:17.980039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:17.980178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.980229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.980288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.980343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.980388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.980396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.980450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.980509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.980565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.980624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.980669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.980675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.980728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.980781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.980850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.980905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.980943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.980950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.981002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.981057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.981114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.981172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.981210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.981217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.981274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.981328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.981384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.981441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.981477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.981483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.981569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.981648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.981702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.981752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.981787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.981793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.981842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.981891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.981943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.981993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.982027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.982033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.982080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.982130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.982203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.982252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.982284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.982289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.982333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.982382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.982440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.982490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.982525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.982530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.982576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:17.982620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:17.982673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:17.982724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:17.982757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:17.982762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:17.982803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173420116:4709], now have 1 active actors on pipe
2025-10-02T09:32:17.983050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:17.983082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554883173420116:4709]
2025-10-02T09:32:17.983093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:17.983103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:17.983123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1468 reason: error at write: Disconnected sessionId: src_id|733e2f5a-24523864-63a55df5-e7219493_0
2025-10-02T09:32:17.983266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1468 sessionId: src_id|733e2f5a-24523864-63a55df5-e7219493_0 is DEAD
2025-10-02T09:32:17.983391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:17.983400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Write session will restart in 0.007161s
2025-10-02T09:32:17.983415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Write session: Do CDS request
2025-10-02T09:32:17.983420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:17.983454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:17.991256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.991359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:17.991366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1469
2025-10-02T09:32:17.991446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:17.991466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:17.991471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:17.991473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:17.991943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1469 sessionId:  describe result for acl check
2025-10-02T09:32:17.991966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:17.991971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:17.991972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:17.991974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554883173420169:4163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:17.992330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554883173420169:4163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:17.994665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554883173420169:4163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:17.997529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554883173420169:4163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:17.997537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554883173420169:4163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:17.997539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554883173420169:4163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:17.997542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.003436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.003729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.003826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.003832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.003837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.003861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.003885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392847980:9055]
2025-10-02T09:32:18.004229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.004416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.004443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.004628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.004656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.004660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.004660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.004661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.004661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.004662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.004662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.004663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.004663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.004664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.004664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.004665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.004668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.004673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.004675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.004677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.004679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.004681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.004683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.004685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.004687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.004689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.004691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.004693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.004696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.004700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.004703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.004705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.004707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.004710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.004712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.004714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.004716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.004719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.004721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.004723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.004725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.004727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.004729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.004732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.004734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.004737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.004741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.004744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.004746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.004748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.004750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.004752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.004767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.012135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.013635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.013646Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.013647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.013649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.013652Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1468 [2:7556554887392847980:9055]
2025-10-02T09:32:18.013659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.013668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.013672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.013674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.013676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.013686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.013695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.013704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.013730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.013735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.013736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.013738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.013739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.013775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.013780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.013786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.013792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.013803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.013815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173420311:4163], now have 1 active actors on pipe
2025-10-02T09:32:18.013820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554883173420117:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.013824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.013825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.013826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.013833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.013843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.013846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.013848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.013849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.013853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.013855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.013868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.013875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.013882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.013875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1468
2025-10-02T09:32:18.013878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1468
2025-10-02T09:32:18.013899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.013906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.013924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9618871-d363a2df-70d5a45e-259fb941_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.013930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.013932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.013934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.013938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.013946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.013956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.014076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.014083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.014092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.014162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1469 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9618871-d363a2df-70d5a45e-259fb941_0
2025-10-02T09:32:18.014412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733e2f5a-24523864-63a55df5-e7219493_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9618871-d363a2df-70d5a45e-259fb941_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.017245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Write session: try to update token
2025-10-02T09:32:18.017261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.022957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.022969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.022970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.022971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.022975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.022976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.022980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392847975:9055]
2025-10-02T09:32:18.022998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.023002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.023003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.023004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.023005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.023008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.023107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.031064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId: src_id|a9618871-d363a2df-70d5a45e-259fb941_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.033135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:18.083356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554887468387722:4709]
2025-10-02T09:32:18.083563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1468, pipe: [1:7556554887468387722:4709]
2025-10-02T09:32:18.137315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:18.137731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.137741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.137753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468387722:4709], now have 1 active actors on pipe
2025-10-02T09:32:18.137870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:18.137946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554887468387722:4709]
2025-10-02T09:32:18.137966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:18.137966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:18.138008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1469 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9618871-d363a2df-70d5a45e-259fb941_0
2025-10-02T09:32:18.138126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1469 sessionId: src_id|a9618871-d363a2df-70d5a45e-259fb941_0 is DEAD
2025-10-02T09:32:18.138288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:18.138297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Write session will restart in 0.009475s
2025-10-02T09:32:18.138311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Write session: Do CDS request
2025-10-02T09:32:18.138315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:18.149208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.149283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:18.149294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1470
2025-10-02T09:32:18.149384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.149404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:18.149410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:18.149413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:18.149753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1470 sessionId:  describe result for acl check
2025-10-02T09:32:18.149773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:18.149777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:18.149778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:18.149781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554887468387842:4159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:18.150114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554887468387842:4159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:18.152453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554887468387842:4159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:18.154696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554887468387842:4159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:18.154704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554887468387842:4159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:18.154706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554887468387842:4159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:18.154709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.155670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.158592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.158688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.158695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.158700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.158724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.158746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392848280:9057]
2025-10-02T09:32:18.159116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.159336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.159363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.159548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.159578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.159582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.159583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.159583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.159584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.159584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.159585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.159585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.159586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.159586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.159587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.159587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.159590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.159599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.159602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.159605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.159608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.159611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.159615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.159618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.159622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.159626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.159629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.159636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.159639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.159646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.159649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.159655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.159658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.159660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.159666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.159668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.159670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.159673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.159676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.159679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.159681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.159685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.159687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.159690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.159695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.159698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.159700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.159703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.159709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.159712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.159716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.159718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.159736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.167181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.168558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.168571Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.168572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.168574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.168577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1469 [2:7556554887392848280:9057]
2025-10-02T09:32:18.168584Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.168593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.168594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.168595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.168596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.168604Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.168609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.168613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.168641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.168646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.168647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.168649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.168650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.168683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.168688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.168695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.168700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.168707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.168721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468387723:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.168727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388018:4159], now have 1 active actors on pipe
2025-10-02T09:32:18.168730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.168731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.168732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.168739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.168750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.168752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.168754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.168755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.168765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.168769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.168784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.168792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.168797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.168784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1469
2025-10-02T09:32:18.168793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1469
2025-10-02T09:32:18.168972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.168980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.168993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.169001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.169003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.169007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.169173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.169184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.169191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.169336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.169344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.169353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.169423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1470 partition: 0 MaxSeqNo: 36 sessionId: src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0
2025-10-02T09:32:18.169619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9618871-d363a2df-70d5a45e-259fb941_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.171970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Write session: try to update token
2025-10-02T09:32:18.171979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.178089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.178103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.178104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.178105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.178110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.178112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.178114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392848275:9057]
2025-10-02T09:32:18.178133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.178140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.178142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.178143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.178143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.178145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.178252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.183615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId: src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.185700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:18.237978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554887468388035:4709]
2025-10-02T09:32:18.238192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1469, pipe: [1:7556554887468388035:4709]
2025-10-02T09:32:18.288681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:18.288904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.288914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.288926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388035:4709], now have 1 active actors on pipe
2025-10-02T09:32:18.289117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554887468388035:4709]
2025-10-02T09:32:18.289138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:18.289143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:18.289146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:18.289191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1470 reason: error at write: Disconnected sessionId: src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0
2025-10-02T09:32:18.289292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:18.289325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1470 sessionId: src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0 is DEAD
2025-10-02T09:32:18.289476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:18.289492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Write session will restart in 0.006539s
2025-10-02T09:32:18.289518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Write session: Do CDS request
2025-10-02T09:32:18.289524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:18.297180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.297280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:18.297287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1471
2025-10-02T09:32:18.297393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.297413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:18.297419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:18.297422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:18.297763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1471 sessionId:  describe result for acl check
2025-10-02T09:32:18.297787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:18.297792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:18.297793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:18.297796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554887468388088:4152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:18.298139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554887468388088:4152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:18.300642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554887468388088:4152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:18.303469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554887468388088:4152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:18.303478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554887468388088:4152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:18.303480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554887468388088:4152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:18.303483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.308024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.310446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.310549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.310555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.310560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.310584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.310606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392848584:9060]
2025-10-02T09:32:18.310960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.311155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.311183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.311371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.311400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.311404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.311404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.311405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.311405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.311406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.311406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.311407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.311407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.311408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.311409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.311409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.311412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.311418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.311420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.311422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.311424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.311426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.311428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.311430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.311432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.311434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.311436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.311438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.311441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.311445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.311449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.311451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.311453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.311456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.311459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.311462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.311464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.311467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.311469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.311472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.311475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.311477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.311479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.311482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.311484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.311487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.311489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.311491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.311493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.311496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.311498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.311500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.311515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.318943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.320473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.320483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.320484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.320486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.320491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1470 [2:7556554887392848584:9060]
2025-10-02T09:32:18.320496Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.320506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.320507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.320508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.320509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.320516Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.320521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.320525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.320550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.320556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.320557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.320559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.320562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.320605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.320609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.320616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.320621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.320630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.320644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388228:4152], now have 1 active actors on pipe
2025-10-02T09:32:18.320649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388036:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.320652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.320653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.320654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.320661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.320668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.320674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.320676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.320676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.320678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.320679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.320691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.320693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.320694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.320705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1470
2025-10-02T09:32:18.320719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1470
2025-10-02T09:32:18.320730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.320735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.320750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.320756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.320757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.320758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.320763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.320768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.320777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.320915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.320923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.320932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.320998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1471 partition: 0 MaxSeqNo: 36 sessionId: src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0
2025-10-02T09:32:18.321273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943d64af-3b2e5242-58dd3864-f58b9d79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.324041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Write session: try to update token
2025-10-02T09:32:18.324055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.329597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:18.329609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.329614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.329633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:18.329637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:18.329760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:18.329875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:18.329981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:18.330100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:18.330256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:18.330279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:18.337294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId: src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.337960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.337973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.337975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.337976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.337981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.337984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.337987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392848579:9060]
2025-10-02T09:32:18.338006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.338010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.338014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.338015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.338016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.338017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.338131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.339503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:18.389025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554887468388358:4709]
2025-10-02T09:32:18.389226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1470, pipe: [1:7556554887468388358:4709]
2025-10-02T09:32:18.447286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:18.447662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.447673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.447687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388358:4709], now have 1 active actors on pipe
2025-10-02T09:32:18.447827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:18.447884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554887468388358:4709]
2025-10-02T09:32:18.447902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:18.447914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:18.447916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:18.447959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1471 reason: error at write: Disconnected sessionId: src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0
2025-10-02T09:32:18.448090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1471 sessionId: src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0 is DEAD
2025-10-02T09:32:18.448264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:18.448277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Write session will restart in 0.008528s
2025-10-02T09:32:18.448301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Write session: Do CDS request
2025-10-02T09:32:18.448307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:18.458203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.458278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:18.458286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1472
2025-10-02T09:32:18.458399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.458417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:18.458423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:18.458426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:18.458716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1472 sessionId:  describe result for acl check
2025-10-02T09:32:18.458734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:18.458739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:18.458740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:18.458742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554887468388446:4144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:18.459082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554887468388446:4144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:18.461469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554887468388446:4144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:18.464089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554887468388446:4144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:18.464098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554887468388446:4144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:18.464100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554887468388446:4144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:18.464103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.466564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.469499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.469603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.469610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.469616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.469642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.469663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392848887:9062]
2025-10-02T09:32:18.470012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.470211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.470237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.470426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.470458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.470462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.470463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.470464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.470464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.470464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.470465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.470466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.470466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.470466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.470467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.470467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.470470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.470476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.470478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.470480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.470482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.470484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.470486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.470488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.470490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.470492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.470494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.470495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.470499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.470503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.470506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.470509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.470511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.470513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.470515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.470518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.470520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.470523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.470525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.470527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.470529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.470532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.470534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.470536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.470538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.470541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.470543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.470545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.470548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.470550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.470553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.470556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.470573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.477971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.479375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.479387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.479388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.479391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.479394Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1471 [2:7556554887392848887:9062]
2025-10-02T09:32:18.479400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.479408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.479411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.479413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.479414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.479422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.479426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.479431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.479458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.479462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.479463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.479465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.479466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.479499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.479504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.479510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.479515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.479523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.479537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388599:4144], now have 1 active actors on pipe
2025-10-02T09:32:18.479541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388359:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.479544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.479546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.479547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.479554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.479565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.479566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.479567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.479569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.479573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.479574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.479587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.479590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.479591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.479592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1471
2025-10-02T09:32:18.479616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1471
2025-10-02T09:32:18.479622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.479629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.479646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.479653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.479655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.479656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.479660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.479665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.479673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.479795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.479801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.479810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.479881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1472 partition: 0 MaxSeqNo: 36 sessionId: src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0
2025-10-02T09:32:18.480109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28bbca9c-7730fbd4-a89611a-a707d4fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.482546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Write session: try to update token
2025-10-02T09:32:18.482557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.488713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.488724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.488725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.488726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.488730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.488733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.488735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392848882:9062]
2025-10-02T09:32:18.488754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.488757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.488758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.488760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.488762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.488764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.488891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.493357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId: src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.495237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:18.548260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554887468388672:4709]
2025-10-02T09:32:18.548452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1471, pipe: [1:7556554887468388672:4709]
2025-10-02T09:32:18.598213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:18.598721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.598734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.598762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388672:4709], now have 1 active actors on pipe
2025-10-02T09:32:18.598944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554887468388672:4709]
2025-10-02T09:32:18.598957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:18.598960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:18.598960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:18.599000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1472 reason: error at write: Disconnected sessionId: src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0
2025-10-02T09:32:18.599136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1472 sessionId: src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0 is DEAD
2025-10-02T09:32:18.599209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:18.599263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:18.599271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Write session will restart in 0.008970s
2025-10-02T09:32:18.599287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Write session: Do CDS request
2025-10-02T09:32:18.599291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:18.609172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.609256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:18.609264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1473
2025-10-02T09:32:18.609355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.609375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:18.609381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:18.609384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:18.609661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1473 sessionId:  describe result for acl check
2025-10-02T09:32:18.609696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:18.609700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:18.609701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:18.609704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554887468388768:4138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:18.610046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554887468388768:4138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:18.612646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554887468388768:4138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:18.615134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554887468388768:4138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:18.615142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554887468388768:4138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:18.615143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554887468388768:4138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:18.615146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.617075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.619524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.619615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.619621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.619627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.619652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.619675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392849191:9064]
2025-10-02T09:32:18.620016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.620196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.620218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.620493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.620530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.620534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.620534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.620535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.620536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.620536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.620536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.620537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.620537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.620538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.620538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.620539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.620542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.620548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.620550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.620552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.620554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.620556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.620558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.620560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.620562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.620564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.620566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.620568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.620572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.620576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.620579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.620581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.620583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.620586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.620588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.620590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.620593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.620596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.620598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.620600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.620602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.620605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.620608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.620610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.620614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.620617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.620619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.620622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.620624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.620626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.620628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.620631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.620649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.628028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.629633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.629645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.629647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.629650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.629653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1472 [2:7556554887392849191:9064]
2025-10-02T09:32:18.629660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.629673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.629676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.629678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.629678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.629688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.629692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.629696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.629723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.629728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.629729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.629730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.629732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.629767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.629772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.629779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.629784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.629792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.629806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388673:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.629811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468388942:4138], now have 1 active actors on pipe
2025-10-02T09:32:18.629815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.629817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.629818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.629824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.629834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.629837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.629839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.629840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.629842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.629844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.629856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.629864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.629870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.629857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1472
2025-10-02T09:32:18.629886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1472
2025-10-02T09:32:18.629908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.629913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.629927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.629930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.629932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.629933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.629938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.629944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.629952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.630054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.630059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.630067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.630140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1473 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0
2025-10-02T09:32:18.630376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e4fdb0-32780ef4-e1ddae1d-25f9946e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.633228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Write session: try to update token
2025-10-02T09:32:18.633244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.638883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.638891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.638892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.638893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.638896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.638898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.638900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392849186:9064]
2025-10-02T09:32:18.638917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.638920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.638921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.638923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.638927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.638929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.639026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.646724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId: src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.648827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:18.699283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554887468389007:4709]
2025-10-02T09:32:18.699444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1472, pipe: [1:7556554887468389007:4709]
2025-10-02T09:32:18.750256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:18.750552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.750560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.750572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468389007:4709], now have 1 active actors on pipe
2025-10-02T09:32:18.750681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:18.750735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:18.750747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:18.750766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554887468389007:4709]
2025-10-02T09:32:18.750779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:18.750800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1473 reason: error at write: Disconnected sessionId: src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0
2025-10-02T09:32:18.750928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1473 sessionId: src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0 is DEAD
2025-10-02T09:32:18.751077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:18.751090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Write session will restart in 0.005057s
2025-10-02T09:32:18.751113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Write session: Do CDS request
2025-10-02T09:32:18.751118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:18.757152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.757223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:18.757231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1474
2025-10-02T09:32:18.757338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.757363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:18.757370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:18.757373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:18.757732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1474 sessionId:  describe result for acl check
2025-10-02T09:32:18.757756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:18.757761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:18.757763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:18.757767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554887468389041:4122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:18.758158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554887468389041:4122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:18.760744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554887468389041:4122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:18.763556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554887468389041:4122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:18.763564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554887468389041:4122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:18.763566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554887468389041:4122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:18.763570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.768658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.771519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.771781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.771789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.771795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.771824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.771846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392849552:9079]
2025-10-02T09:32:18.772184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.772388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.772410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.772590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.772619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.772623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.772624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.772625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.772625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.772626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.772626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.772627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.772627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.772628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.772628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.772629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.772632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.772638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.772640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.772642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.772644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.772646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.772648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.772650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.772652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.772654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.772656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.772658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.772661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.772665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.772668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.772670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.772672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.772675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.772677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.772680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.772682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.772685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.772687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.772689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.772691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.772694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.772696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.772698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.772700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.772703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.772705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.772708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.772710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.772712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.772714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.772717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.772733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.780057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.781607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.781617Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.781618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.781620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.781624Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1473 [2:7556554887392849552:9079]
2025-10-02T09:32:18.781630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.781639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.781645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.781646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.781647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.781655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.781658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.781663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.781695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.781700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.781701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.781703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.781704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.781738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.781742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.781748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.781754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.781764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.781778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468389178:4122], now have 1 active actors on pipe
2025-10-02T09:32:18.781783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468389009:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.781787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.781788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.781789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.781797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.781804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.781808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.781810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.781811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.781811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.781813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.781824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.781826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.781827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.781855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1473
2025-10-02T09:32:18.781861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1473
2025-10-02T09:32:18.781906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.781912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.781926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.781932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.781934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.781935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.781940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.781945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.781952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.782070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.782074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.782082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.782154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1474 partition: 0 MaxSeqNo: 36 sessionId: src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0
2025-10-02T09:32:18.782382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e02b6-3425cabf-cb2b336d-36d77ec0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.784834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Write session: try to update token
2025-10-02T09:32:18.784844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.791050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.791061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.791063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.791064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.791069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.791071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.791073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392849538:9079]
2025-10-02T09:32:18.791092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.791095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.791097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.791098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.791101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.791103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.791205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.796216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId: src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.798226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:18.850857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554887468389330:4709]
2025-10-02T09:32:18.851073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1473, pipe: [1:7556554887468389330:4709]
2025-10-02T09:32:18.900851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:18.901035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.901043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.901068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468389330:4709], now have 1 active actors on pipe
2025-10-02T09:32:18.901180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:18.901262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:18.901264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554887468389330:4709]
2025-10-02T09:32:18.901276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:18.901278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:18.901325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1474 reason: error at write: Disconnected sessionId: src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0
2025-10-02T09:32:18.901483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1474 sessionId: src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0 is DEAD
2025-10-02T09:32:18.901600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:18.901610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Write session will restart in 0.005985s
2025-10-02T09:32:18.901625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Write session: Do CDS request
2025-10-02T09:32:18.901629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:18.907203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:18.908138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.908299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:18.908308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1475
2025-10-02T09:32:18.908406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:18.908432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:18.908441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:18.908444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:18.908494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:18.908586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:18.908593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:18.908599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:18.908625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:18.908650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554887392849608:9081]
2025-10-02T09:32:18.908747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1475 sessionId:  describe result for acl check
2025-10-02T09:32:18.908772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:18.908776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:18.908777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:18.908780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554887468389367:4113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:18.909024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:18.909128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554887468389367:4113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:18.909206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:18.909232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:18.909408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:18.909436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.909440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.909441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.909441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.909442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.909442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.909443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.909444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.909444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.909445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.909445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.909446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.909448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.909454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.909456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.909458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.909460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.909462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.909464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.909466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.909468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.909470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.909472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.909474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.909479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.909483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:18.909486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.909489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:18.909492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.909495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:18.909497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.909500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:18.909502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.909504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:18.909507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.909509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:18.909512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.909517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:18.909522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.909526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:18.909530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.909534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:18.909537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.909542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.909549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.909554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.909556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.909559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.909578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:18.910685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554887468389367:4113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:18.914881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554887468389367:4113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:18.914888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554887468389367:4113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:18.914890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554887468389367:4113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:18.914894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:18.917022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:18.918357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:18.918368Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:18.918369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:18.918371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:18.918374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1474 [2:7556554887392849608:9081]
2025-10-02T09:32:18.918384Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:18.918398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:18.918405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.918409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.918410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.918419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:18.918422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:18.918426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:18.918456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.918463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.918463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.918465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:18.918466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:18.918505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:18.918510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.918515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:18.918520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:18.918529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:18.918542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468389405:4113], now have 1 active actors on pipe
2025-10-02T09:32:18.918547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554887468389347:2446], now have 1 active actors on pipe
2025-10-02T09:32:18.918550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.918551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.918552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.918559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:18.918568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:18.918570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:18.918572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:18.918573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:18.918578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:18.918580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:18.918581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1474
2025-10-02T09:32:18.918583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1474
2025-10-02T09:32:18.918593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.918599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:18.918599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:18.918615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.918619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.918637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:18.918644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:18.918646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:18.918647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:18.918652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:18.918658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:18.918666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.918814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:18.918819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:18.918827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:18.918907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1475 partition: 0 MaxSeqNo: 36 sessionId: src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0
2025-10-02T09:32:18.919100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f33e46-f07813d1-f2ca2e25-74bc214f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:18.921242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Write session: try to update token
2025-10-02T09:32:18.921251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:18.927762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:18.927773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:18.927774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:18.927776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:18.927781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.927784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.927786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554887392849603:9081]
2025-10-02T09:32:18.927806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:18.927810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:18.927811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:18.927814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:18.927819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:18.927821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:18.927927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:18.932060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId: src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:18.933955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.001401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763356709:4709]
2025-10-02T09:32:19.001737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1474, pipe: [1:7556554891763356709:4709]
2025-10-02T09:32:19.037332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.037514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.037522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.037547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356709:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.037664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.037691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763356709:4709]
2025-10-02T09:32:19.037712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.037716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:19.037775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1475 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0
2025-10-02T09:32:19.037908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1475 sessionId: src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0 is DEAD
2025-10-02T09:32:19.038014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:19.038022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Write session will restart in 0.006066s
2025-10-02T09:32:19.038036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Write session: Do CDS request
2025-10-02T09:32:19.038040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.043662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.045086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.045204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.045211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.045216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.045246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.045244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.045273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687816963:9084]
2025-10-02T09:32:19.045324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.045334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1476
2025-10-02T09:32:19.045443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.045462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.045468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.045471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.045616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.045783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1476 sessionId:  describe result for acl check
2025-10-02T09:32:19.045810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.045817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.045823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.045824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.045828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763356733:4110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.045834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.046013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.046043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.046046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.046047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.046047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.046048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.046049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.046049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.046050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.046050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.046051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.046051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.046052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.046055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.046060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.046062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.046064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.046066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.046068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.046070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.046072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.046074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.046076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.046078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.046080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.046084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.046088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.046091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.046094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.046097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.046099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.046101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.046105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.046107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.046110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.046112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.046115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.046117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.046120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.046122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.046125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.046128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.046133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.046135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.046137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.046139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.046142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.046145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.046148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.046164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.046282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763356733:4110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.047931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763356733:4110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.052435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763356733:4110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.052445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763356733:4110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.052446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763356733:4110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.052450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.053646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.055117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.055127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.055128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.055130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.055134Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1475 [2:7556554891687816963:9084]
2025-10-02T09:32:19.055141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.055156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.055160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.055162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.055162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.055171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.055173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.055177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.055210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.055215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.055216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.055218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.055219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.055254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.055258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.055265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.055270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.055281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.055295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356770:4110], now have 1 active actors on pipe
2025-10-02T09:32:19.055301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356711:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.055304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.055305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.055306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.055314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.055324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.055327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.055329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.055330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.055334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.055336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.055350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.055350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1475
2025-10-02T09:32:19.055358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.055351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1475
2025-10-02T09:32:19.055374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.055382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.055384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.055400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9841a9-cf2cc10-12195f7b-44235273_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.055408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.055411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.055414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.055419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.055423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.055430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.055536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.055540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.055547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.055620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1476 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc9841a9-cf2cc10-12195f7b-44235273_0
2025-10-02T09:32:19.055837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6052ceaa-fe112c44-e7018b0-ef4775e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc9841a9-cf2cc10-12195f7b-44235273_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.058693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Write session: try to update token
2025-10-02T09:32:19.058707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.064276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:19.064289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.064294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.064318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:19.064326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:19.064469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:19.064590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:19.064715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:19.064878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:19.065029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:19.065052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:19.071290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId: src_id|fc9841a9-cf2cc10-12195f7b-44235273_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.072674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.072684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.072685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.072686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.072690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.072695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.072697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687816958:9084]
2025-10-02T09:32:19.072718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.072720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.072722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.072724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.072725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.072726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.072850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.073263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.138106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763356777:4709]
2025-10-02T09:32:19.138339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1475, pipe: [1:7556554891763356777:4709]
2025-10-02T09:32:19.180356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.180574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.180583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.180594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356777:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.180842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.180884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763356777:4709]
2025-10-02T09:32:19.180886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.180910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:19.180970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1476 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc9841a9-cf2cc10-12195f7b-44235273_0
2025-10-02T09:32:19.181125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1476 sessionId: src_id|fc9841a9-cf2cc10-12195f7b-44235273_0 is DEAD
2025-10-02T09:32:19.181294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:19.181310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Write session will restart in 0.005670s
2025-10-02T09:32:19.181336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Write session: Do CDS request
2025-10-02T09:32:19.181342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.186450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.187729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.187824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.187830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.187837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.187864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.187888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687817020:9086]
2025-10-02T09:32:19.188200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.188232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.188255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.188264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1477
2025-10-02T09:32:19.188419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.188441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.188451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.188477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.188485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.188488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.188617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.188647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.188650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.188651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.188652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.188653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.188653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.188654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.188654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.188655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.188656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.188657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.188657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.188661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.188668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.188670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.188672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.188674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.188676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.188678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.188682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.188684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.188686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.188688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.188690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.188693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.188697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.188701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.188703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.188706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.188708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.188711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.188713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.188715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.188718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.188723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.188726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.188728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.188730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.188736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.188739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.188741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.188744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.188746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.188749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.188752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.188754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.188758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.188761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.188771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1477 sessionId:  describe result for acl check
2025-10-02T09:32:19.188778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.188794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.188811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.188812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.188815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763356801:4098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.189141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763356801:4098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.190821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763356801:4098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.195027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763356801:4098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.195035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763356801:4098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.195037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763356801:4098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.195041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.196255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.197621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.197632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.197634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.197636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.197640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1476 [2:7556554891687817020:9086]
2025-10-02T09:32:19.197646Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.197656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.197661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.197662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.197663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.197672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.197674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.197682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.197712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.197716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.197718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.197719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.197720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.197756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.197761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.197768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.197773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.197784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.197799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356838:4098], now have 1 active actors on pipe
2025-10-02T09:32:19.197804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356778:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.197808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.197809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.197810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.197817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.197827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.197829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.197830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.197831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.197836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.197838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.197843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1476
2025-10-02T09:32:19.197847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1476
2025-10-02T09:32:19.197853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.197857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.197870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.197908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.197914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.197931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.197938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.197940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.197941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.197946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.197954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.197964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.198092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.198096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.198103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.198186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1477 partition: 0 MaxSeqNo: 36 sessionId: src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0
2025-10-02T09:32:19.198383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9841a9-cf2cc10-12195f7b-44235273_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.200847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Write session: try to update token
2025-10-02T09:32:19.200857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.207141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.207153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.207155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.207156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.207161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.207163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.207166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687817015:9086]
2025-10-02T09:32:19.207192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.207195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.207197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.207198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.207201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.207203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.207299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.212288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId: src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.214302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.280931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763356848:4709]
2025-10-02T09:32:19.281147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1476, pipe: [1:7556554891763356848:4709]
2025-10-02T09:32:19.316041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.316249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.316259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.316282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356848:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.316405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.316450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:19.316460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:19.316467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.316494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763356848:4709]
2025-10-02T09:32:19.316507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1477 reason: error at write: Disconnected sessionId: src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0
2025-10-02T09:32:19.316640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1477 sessionId: src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0 is DEAD
2025-10-02T09:32:19.316754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:19.316763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Write session will restart in 0.005714s
2025-10-02T09:32:19.316779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Write session: Do CDS request
2025-10-02T09:32:19.316784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.321919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.323174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.323287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.323296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1478
2025-10-02T09:32:19.323300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.323393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.323397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.323404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.323409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.323419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.323426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.323429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.323435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.323461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687817081:9089]
2025-10-02T09:32:19.323725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1478 sessionId:  describe result for acl check
2025-10-02T09:32:19.323749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.323753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.323754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.323757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763356871:4092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.323802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.323982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.324004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.324091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763356871:4092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.324178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.324207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.324210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.324211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.324211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.324212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.324212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.324213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.324214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.324215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.324215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.324216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.324217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.324220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.324225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.324227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.324229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.324232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.324234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.324236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.324238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.324240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.324242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.324244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.324247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.324250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.324254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.324257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.324260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.324262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.324265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.324267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.324269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.324272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.324278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.324280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.324283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.324286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.324291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.324294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.324296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.324302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.324305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.324307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.324310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.324315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.324317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.324319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.324323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.324343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.325385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763356871:4092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.329611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763356871:4092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.329619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763356871:4092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.329621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763356871:4092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.329625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.331794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.333131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.333141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.333142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.333144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.333148Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1477 [2:7556554891687817081:9089]
2025-10-02T09:32:19.333158Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.333168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.333169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.333171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.333172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.333181Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.333187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.333191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.333221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.333226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.333227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.333229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.333231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.333266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.333271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.333277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.333282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.333293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.333307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356849:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.333314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356915:4092], now have 1 active actors on pipe
2025-10-02T09:32:19.333318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.333322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.333324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.333331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.333343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.333344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.333347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.333348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.333353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.333354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.333368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.333376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.333378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.333369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1477
2025-10-02T09:32:19.333370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1477
2025-10-02T09:32:19.333395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.333400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.333413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f59a7b9-5920223b-569c9567-511e02e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.333420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.333422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.333423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.333428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.333435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.333445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.333553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.333559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.333566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.333649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1478 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f59a7b9-5920223b-569c9567-511e02e1_0
2025-10-02T09:32:19.333889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12cbfa-cf4df626-b8c724d2-8a998661_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f59a7b9-5920223b-569c9567-511e02e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.336054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Write session: try to update token
2025-10-02T09:32:19.336063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.342531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.342542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.342543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.342544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.342549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.342551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.342553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687817076:9089]
2025-10-02T09:32:19.342575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.342575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.342578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.342578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.342579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.342581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.342680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.346667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId: src_id|5f59a7b9-5920223b-569c9567-511e02e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.348653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.416616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763356926:4709]
2025-10-02T09:32:19.416835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1477, pipe: [1:7556554891763356926:4709]
2025-10-02T09:32:19.452143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.452438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.452450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.452478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356926:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.452647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.452658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763356926:4709]
2025-10-02T09:32:19.452673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:19.452674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:19.452717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1478 reason: error at write: Disconnected sessionId: src_id|5f59a7b9-5920223b-569c9567-511e02e1_0
2025-10-02T09:32:19.452877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1478 sessionId: src_id|5f59a7b9-5920223b-569c9567-511e02e1_0 is DEAD
2025-10-02T09:32:19.452986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:19.452995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Write session will restart in 0.006170s
2025-10-02T09:32:19.453011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Write session: Do CDS request
2025-10-02T09:32:19.453016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.453017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.458207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.459415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.459509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.459515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.459520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.459545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.459569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687817141:9091]
2025-10-02T09:32:19.459906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.460084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.460100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.460106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.460280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.460310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.460314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.460314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.460315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.460316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.460316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.460317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.460317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.460318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.460320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.460321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.460321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.460324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.460330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.460332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.460335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.460336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.460329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.460338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.460340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.460342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.460338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1479
2025-10-02T09:32:19.460344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.460347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.460349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.460351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.460355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.460359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.460362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.460365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.460367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.460369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.460371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.460374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.460388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.460391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.460394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.460396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.460398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.460401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.460403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.460406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.460410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.460412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.460418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.460420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.460423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.460429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.460432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.460422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.460434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.460444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.460451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.460454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.460455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.460723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1479 sessionId:  describe result for acl check
2025-10-02T09:32:19.460747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.460752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.460753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.460756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763356954:4086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.461117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763356954:4086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.462673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763356954:4086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.466650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763356954:4086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.466659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763356954:4086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.466661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763356954:4086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.466664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.467870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.469233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.469244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.469246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.469248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.469252Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1478 [2:7556554891687817141:9091]
2025-10-02T09:32:19.469259Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.469270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.469274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.469275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.469276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.469286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.469292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.469296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.469363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.469367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.469368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.469370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.469371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.469406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.469409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.469415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.469420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.469431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.469444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356927:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.469450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356988:4086], now have 1 active actors on pipe
2025-10-02T09:32:19.469453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.469454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.469455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.469463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.469470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.469474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.469476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.469477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.469477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.469479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.469494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.469499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.469501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.469496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1478
2025-10-02T09:32:19.469503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1478
2025-10-02T09:32:19.469537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.469542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.469557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d31764e-172383dd-99d842ef-74a3fc59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.469564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.469566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.469567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.469572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.469581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.469590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.469713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.469718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.469725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.469804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1479 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d31764e-172383dd-99d842ef-74a3fc59_0
2025-10-02T09:32:19.469983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f59a7b9-5920223b-569c9567-511e02e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d31764e-172383dd-99d842ef-74a3fc59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.472255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Write session: try to update token
2025-10-02T09:32:19.472264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.478536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:19.478551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.478557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.478580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:19.478580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:19.478708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:19.478832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:19.478971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:19.479096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:19.479256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:19.479281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:19.482820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId: src_id|6d31764e-172383dd-99d842ef-74a3fc59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.484710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.484830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.484842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.484859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:19.484932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:19.486841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.486850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.486851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.486852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.486858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.486860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.486862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687817136:9091]
2025-10-02T09:32:19.486881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.486884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.486886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.486885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.486888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.486890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.486994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.552830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763356997:4709]
2025-10-02T09:32:19.553005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1478, pipe: [1:7556554891763356997:4709]
2025-10-02T09:32:19.595724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.601332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.601347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.601469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.601519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.601568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.601622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.601657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.601663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.601713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.601761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.601810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.601863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.601897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.601902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.601953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.602003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.602054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.602101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.602134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.602141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.602190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.602240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.602289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.602336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.602370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.602375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.602423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.602469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.602517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.602563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.602597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.602603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.602649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.602694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.602743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.602802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.602851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.602858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.602903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.602948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.602996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.603047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.603082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.603086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.603134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.603181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.603226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.603272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.603375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.603381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.603425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.603470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.603518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.603568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.603600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.603604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.603650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:19.603695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:19.603738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:19.603787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:19.603820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:19.603825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:19.603853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356997:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.604019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763356997:4709]
2025-10-02T09:32:19.604024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.604046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:19.604048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:19.604067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1479 reason: error at write: Disconnected sessionId: src_id|6d31764e-172383dd-99d842ef-74a3fc59_0
2025-10-02T09:32:19.604198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1479 sessionId: src_id|6d31764e-172383dd-99d842ef-74a3fc59_0 is DEAD
2025-10-02T09:32:19.604341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:19.604352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Write session will restart in 0.006162s
2025-10-02T09:32:19.604368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Write session: Do CDS request
2025-10-02T09:32:19.604372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.604381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.609984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.611150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.611212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.611222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1480
2025-10-02T09:32:19.611303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.611328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.611338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.611343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.611512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.611622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.611629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.611635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.611662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.611686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687817202:9093]
2025-10-02T09:32:19.611628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1480 sessionId:  describe result for acl check
2025-10-02T09:32:19.611650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.611652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.611652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.611655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763357022:4083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.611979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763357022:4083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.612026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.612217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.612239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.612411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.612438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.612442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.612442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.612443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.612444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.612444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.612445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.612445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.612446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.612446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.612447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.612447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.612451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.612456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.612459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.612461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.612469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.612472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.612474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.612476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.612478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.612480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.612482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.612484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.612488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.612492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.612499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.612502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.612504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.612506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.612508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.612512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.612516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.612518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.612520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.612523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.612527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.612529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.612531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.612533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.612535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.612538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.612541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.612544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.612546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.612549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.612551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.612556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.612573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.614028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763357022:4083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.618782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763357022:4083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.618799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763357022:4083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.618800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763357022:4083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.618804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.619978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.621320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.621331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.621333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.621336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.621339Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1479 [2:7556554891687817202:9093]
2025-10-02T09:32:19.621346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.621355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.621360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.621361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.621362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.621371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.621373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.621377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.621408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.621412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.621414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.621415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.621416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.621450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.621455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.621462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.621467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.621478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.621491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763356998:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.621496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357060:4083], now have 1 active actors on pipe
2025-10-02T09:32:19.621500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.621502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.621506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.621514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.621524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.621526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.621529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.621530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.621534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.621536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.621549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.621554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.621549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1479
2025-10-02T09:32:19.621559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.621557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1479
2025-10-02T09:32:19.621590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.621594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.621608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.621614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.621616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.621617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.621622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.621627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.621637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.621752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.621757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.621764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.621836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1480 partition: 0 MaxSeqNo: 36 sessionId: src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0
2025-10-02T09:32:19.622093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d31764e-172383dd-99d842ef-74a3fc59_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.624250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Write session: try to update token
2025-10-02T09:32:19.624259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.630783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.630805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.630808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.630809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.630816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.630822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.630826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687817197:9093]
2025-10-02T09:32:19.630851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.630855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.630858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.630860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.630861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.630862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.630987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.635107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId: src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.636983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.704339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763357084:4709]
2025-10-02T09:32:19.704499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1479, pipe: [1:7556554891763357084:4709]
2025-10-02T09:32:19.744647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.744822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.744835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.744860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357084:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.744959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.745044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:19.745058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:19.745064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763357084:4709]
2025-10-02T09:32:19.745080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.745101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1480 reason: error at write: Disconnected sessionId: src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0
2025-10-02T09:32:19.745229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1480 sessionId: src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0 is DEAD
2025-10-02T09:32:19.745363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:19.745368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Write session will restart in 0.008162s
2025-10-02T09:32:19.745383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Write session: Do CDS request
2025-10-02T09:32:19.745387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.750740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.752038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.752129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.752135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.752141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.752165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.752189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687817314:9108]
2025-10-02T09:32:19.752519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.752705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.752726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.752919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.752952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.752956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.752957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.752957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.752958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.752959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.752959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.752960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.752960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.752961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.752961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.752962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.752965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.752971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.752973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.752975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.752978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.752980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.752981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.752983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.752985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.752987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.752989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.752991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.752995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.752999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.753004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.753006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.753008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.753011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.753014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.753017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.753019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.753022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.753024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.753026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.753028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.753031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.753033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.753035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.753037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.753040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.753042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.753044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.753046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.753049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.753051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.753053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.753071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.754074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.754170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.754176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1481
2025-10-02T09:32:19.754254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.754271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.754277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.754279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.754516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1481 sessionId:  describe result for acl check
2025-10-02T09:32:19.754540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.754544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.754545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.754548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763357125:4072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.754853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763357125:4072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.756285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763357125:4072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.759910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763357125:4072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.759920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763357125:4072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.759922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763357125:4072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.759926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.760446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.761831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.761842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.761843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.761845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.761848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1480 [2:7556554891687817314:9108]
2025-10-02T09:32:19.761855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.761865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.761870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.761873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.761875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.761884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.761887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.761894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.761922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.761926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.761927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.761929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.761930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.761964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.761969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.761976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.761981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.761992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.762006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357160:4072], now have 1 active actors on pipe
2025-10-02T09:32:19.762011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357096:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.762016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.762021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.762022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.762029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.762039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.762041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.762042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.762043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.762049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.762050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.762043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1480
2025-10-02T09:32:19.762047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1480
2025-10-02T09:32:19.762063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.762070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.762070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.762086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.762090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.762109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.762116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.762119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.762122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.762127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.762131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.762140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.762243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.762248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.762254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.762319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1481 partition: 0 MaxSeqNo: 36 sessionId: src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0
2025-10-02T09:32:19.762495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|393eb3f2-ffd4ee3a-cd6adc5c-46b5aeda_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.764739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Write session: try to update token
2025-10-02T09:32:19.764749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.771396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.771407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.771409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.771410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.771414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.771416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.771421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687817309:9108]
2025-10-02T09:32:19.771444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.771445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.771448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.771448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.771449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.771450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.771556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.775515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId: src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.777408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.845150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763357176:4709]
2025-10-02T09:32:19.845389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1480, pipe: [1:7556554891763357176:4709]
2025-10-02T09:32:19.883399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:19.883647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.883655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.883679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357176:4709], now have 1 active actors on pipe
2025-10-02T09:32:19.883795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:19.883801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:19.883810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763357176:4709]
2025-10-02T09:32:19.883813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:19.883821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:19.883859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1481 reason: error at write: Disconnected sessionId: src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0
2025-10-02T09:32:19.883997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1481 sessionId: src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0 is DEAD
2025-10-02T09:32:19.884122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:19.884130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Write session will restart in 0.009353s
2025-10-02T09:32:19.884149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Write session: Do CDS request
2025-10-02T09:32:19.884153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:19.889454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:19.890773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:19.890888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:19.890895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:19.890901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:19.890928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:19.890953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554891687817378:9110]
2025-10-02T09:32:19.891292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:19.891477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:19.891500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:19.891675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:19.891703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.891707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.891708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.891708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.891709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.891709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.891710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.891710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.891711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.891711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.891712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.891713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.891715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.891722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.891724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.891726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.891728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.891730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.891732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.891734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.891737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.891740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.891742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.891744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.891748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.891754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:19.891758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.891760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:19.891763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.891766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:19.891768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.891771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:19.891774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.891776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:19.891778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.891781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:19.891783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.891786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:19.891788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.891791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:19.891793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.891795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:19.891799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.891802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.891804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.891806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.891808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.891811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.891828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:19.894137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.894218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:19.894231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1482
2025-10-02T09:32:19.894307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:19.894325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:19.894331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:19.894333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:19.894592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1482 sessionId:  describe result for acl check
2025-10-02T09:32:19.894618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:19.894622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:19.894623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:19.894626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554891763357222:4061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:19.894963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554891763357222:4061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:19.896216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554891763357222:4061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:19.898709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554891763357222:4061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:19.898718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554891763357222:4061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:19.898720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554891763357222:4061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:19.898724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:19.899298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:19.900666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:19.900677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:19.900678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:19.900681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:19.900684Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1481 [2:7556554891687817378:9110]
2025-10-02T09:32:19.900692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:19.900701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:19.900703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.900704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.900705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.900715Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:19.900717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:19.900722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:19.900754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.900759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.900760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.900762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:19.900764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:19.900815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:19.900821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.900831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:19.900841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:19.900849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:19.900864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357192:2446], now have 1 active actors on pipe
2025-10-02T09:32:19.900869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357257:4061], now have 1 active actors on pipe
2025-10-02T09:32:19.900873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.900874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.900875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.900883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:19.900897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:19.900897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:19.900899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:19.900901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:19.900907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:19.900909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:19.900926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.900934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:19.900923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1481
2025-10-02T09:32:19.900928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1481
2025-10-02T09:32:19.900948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:19.900965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.900970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.900984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:19.900992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:19.900997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:19.900999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:19.901004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:19.901012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:19.901022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.901125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:19.901129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:19.901137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:19.901207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1482 partition: 0 MaxSeqNo: 36 sessionId: src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0
2025-10-02T09:32:19.901388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f9b825-fb26e823-b7a43ee-c3cfab23_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:19.903632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Write session: try to update token
2025-10-02T09:32:19.903642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:19.910211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:19.910225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:19.910227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:19.910228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:19.910232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.910235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.910237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554891687817373:9110]
2025-10-02T09:32:19.910259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:19.910260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:19.910262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:19.910263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:19.910265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:19.910265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:19.910374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:19.914602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId: src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:19.916566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:19.983908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554891763357264:4709]
2025-10-02T09:32:19.984144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1481, pipe: [1:7556554891763357264:4709]
2025-10-02T09:32:20.021177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.021392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.021401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.021426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554891763357264:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.021565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.021631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554891763357264:4709]
2025-10-02T09:32:20.021645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.021656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:20.021708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1482 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0
2025-10-02T09:32:20.021854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1482 sessionId: src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0 is DEAD
2025-10-02T09:32:20.021998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:20.022007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Write session will restart in 0.005477s
2025-10-02T09:32:20.022022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Write session: Do CDS request
2025-10-02T09:32:20.022027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.027946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.028154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.028225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.028233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1483
2025-10-02T09:32:20.028307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.028325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.028331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.028334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.028602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1483 sessionId:  describe result for acl check
2025-10-02T09:32:20.028621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.028625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.028626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.028629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058324589:4056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.028986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058324589:4056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.029237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.029330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.029337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.029342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.029369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.029392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982784739:9113]
2025-10-02T09:32:20.029730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.029929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.029952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.030125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.030155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.030159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.030161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.030161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.030162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.030162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.030163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.030163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.030164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.030164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.030165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.030166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.030168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.030174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.030176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.030178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.030180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.030182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.030184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.030186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.030188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.030191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.030193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.030195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.030199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.030203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.030207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.030210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.030212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.030214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.030217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.030219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.030222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.030224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.030227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.030229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.030232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.030234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.030236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.030239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.030242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.030244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.030246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.030249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.030251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.030254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.030255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.030259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.030276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.030342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058324589:4056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.035022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058324589:4056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.035030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058324589:4056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.035032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058324589:4056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.035035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.037687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.039044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.039055Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.039056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.039060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.039063Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1482 [2:7556554895982784739:9113]
2025-10-02T09:32:20.039072Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.039083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.039088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.039089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.039091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.039100Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.039103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.039106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.039135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.039139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.039140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.039142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.039144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.039178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.039182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.039188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.039193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.039202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.039212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324562:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.039218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324628:4056], now have 1 active actors on pipe
2025-10-02T09:32:20.039222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.039223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.039224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.039231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.039243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.039244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.039246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.039247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.039252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.039254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.039269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.039276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.039282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.039273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1482
2025-10-02T09:32:20.039277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1482
2025-10-02T09:32:20.039301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.039307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.039320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.039327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.039329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.039330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.039335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.039343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.039352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.039454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.039458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.039465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.039529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1483 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0
2025-10-02T09:32:20.039717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da53d57-bf504c7b-29745ebe-47c3c2ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.042040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Write session: try to update token
2025-10-02T09:32:20.042051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.052732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:20.052744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.052749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.052774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:20.052778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:20.052925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:20.053042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:20.053157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:20.053282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:20.053336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId: src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.053449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:20.053478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:20.055228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.055344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.055351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.055366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:20.055434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:20.057160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.057174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.057176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.057177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.057183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.057187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.057189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982784734:9113]
2025-10-02T09:32:20.057210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.057211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.057214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.057216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.057218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.057220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.057324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.121618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058324635:4709]
2025-10-02T09:32:20.121840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1482, pipe: [1:7556554896058324635:4709]
2025-10-02T09:32:20.166042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.171909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.171928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.172045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.172096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.172150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.172200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.172238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.172244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.172295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.172345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.172394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.172450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.172485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.172490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.172539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.172589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.172640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.172688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.172722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.172727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.172775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.172842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.172894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.172942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.172977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.172982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.173033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.173079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.173129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.173176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.173210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.173215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.173266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.173312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.173362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.173411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.173451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.173456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.173501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.173546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.173597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.173650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.173683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.173690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.173737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.173783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.173831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.173876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.173910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.173914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.173960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.174006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.174053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.174098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.174133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.174138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.174188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:20.174232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:20.174278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:20.174325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:20.174356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:20.174361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:20.174389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324635:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.174546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.174577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:20.174579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:20.174584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058324635:4709]
2025-10-02T09:32:20.174600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1483 reason: error at write: Disconnected sessionId: src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0
2025-10-02T09:32:20.174744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1483 sessionId: src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0 is DEAD
2025-10-02T09:32:20.174878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:20.174883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Write session will restart in 0.008057s
2025-10-02T09:32:20.174901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Write session: Do CDS request
2025-10-02T09:32:20.174905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.175005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.180518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.181724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.181835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.181842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.181851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.181895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.181929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982784805:9115]
2025-10-02T09:32:20.182354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.182564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.182603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.182881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.182941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.182946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.182948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.182949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.182950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.182951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.182952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.182953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.182954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.182955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.182959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.182960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.182965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.182973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.182977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.182981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.182984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.182987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.182994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.182998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.183004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.183008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.183015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.183018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.183028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.183037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.183045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.183051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.183057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.183062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.183068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.183072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.183079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.183083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.183090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.183094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.183101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.183106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.183112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.183116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.183121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.183127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.183134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.183140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.183146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.183150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.183157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.183165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.183196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.184127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.184296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.184303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1484
2025-10-02T09:32:20.184410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.184429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.184435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.184437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.184680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1484 sessionId:  describe result for acl check
2025-10-02T09:32:20.184701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.184705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.184706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.184709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058324669:4053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.185057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058324669:4053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.186953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058324669:4053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.190015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058324669:4053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.190022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058324669:4053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.190025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058324669:4053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.190028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.190616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.192120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.192132Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.192134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.192137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.192141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1483 [2:7556554895982784805:9115]
2025-10-02T09:32:20.192151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.192162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.192168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.192171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.192173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.192184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.192188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.192198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.192237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.192243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.192244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.192246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.192248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.192290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.192296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.192304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.192316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.192332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.192348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324704:4053], now have 1 active actors on pipe
2025-10-02T09:32:20.192354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324637:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.192359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.192355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1483
2025-10-02T09:32:20.192364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.192365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.192355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1483
2025-10-02T09:32:20.192371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.192383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.192386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.192390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.192391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.192396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.192398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.192410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.192417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.192441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.192453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.192464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.192465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|842c2b4f-e60564cc-50876335-bcdc7846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.192470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.192473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.192475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.192482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.192487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.192510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.192624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.192630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.192641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.192703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1484 partition: 0 MaxSeqNo: 36 sessionId: src_id|842c2b4f-e60564cc-50876335-bcdc7846_0
2025-10-02T09:32:20.192871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e29f3-9e9e1d15-df235858-975de1d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|842c2b4f-e60564cc-50876335-bcdc7846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.195077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Write session: try to update token
2025-10-02T09:32:20.195086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.201919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.201937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.201939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.201941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.201947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.201951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.201954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982784800:9115]
2025-10-02T09:32:20.201984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.201987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.201989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.201992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.201998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.202004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.202140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.205741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId: src_id|842c2b4f-e60564cc-50876335-bcdc7846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.207771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.274727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058324713:4709]
2025-10-02T09:32:20.274957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1483, pipe: [1:7556554896058324713:4709]
2025-10-02T09:32:20.334039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.334269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.334278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.334305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324713:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.334452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.334510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058324713:4709]
2025-10-02T09:32:20.334534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.334547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:20.334643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1484 reason: status is not ok: tablet will be restarted right now sessionId: src_id|842c2b4f-e60564cc-50876335-bcdc7846_0
2025-10-02T09:32:20.334867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1484 sessionId: src_id|842c2b4f-e60564cc-50876335-bcdc7846_0 is DEAD
2025-10-02T09:32:20.335029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:20.335037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Write session will restart in 0.007229s
2025-10-02T09:32:20.335052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Write session: Do CDS request
2025-10-02T09:32:20.335056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.340767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.342234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.342329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.342336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.342342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.342365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.342394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982784874:9118]
2025-10-02T09:32:20.342735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.342927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.342950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.343126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.343147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.343155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.343159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.343159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.343160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.343161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.343161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.343162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.343163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.343163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.343164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.343165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.343166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.343169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.343175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.343177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.343180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.343181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.343184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.343185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.343187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.343189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.343192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.343194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.343196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.343200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.343204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.343207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.343210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.343213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.343215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.343217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.343220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.343222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.343225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.343227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.343230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.343234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.343236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.343239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.343243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.343248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.343251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.343253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.343256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.343259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.343262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.343264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.343267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.343264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.343276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1485
2025-10-02T09:32:20.343285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.343384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.343402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.343409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.343411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.343757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1485 sessionId:  describe result for acl check
2025-10-02T09:32:20.343794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.343801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.343803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.343807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058324751:4047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.344238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058324751:4047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.345891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058324751:4047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.350250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058324751:4047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.350264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058324751:4047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.350267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058324751:4047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.350273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.350676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.352024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.352034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.352036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.352038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.352041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1484 [2:7556554895982784874:9118]
2025-10-02T09:32:20.352049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.352059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.352066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.352067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.352068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.352077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.352080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.352084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.352116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.352121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.352122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.352123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.352125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.352160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.352165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.352172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.352177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.352188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.352203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324715:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.352208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324786:4047], now have 1 active actors on pipe
2025-10-02T09:32:20.352212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.352213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.352215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.352223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.352234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.352235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.352237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.352238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.352244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.352246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.352246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1484
2025-10-02T09:32:20.352260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.352265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.352266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1484
2025-10-02T09:32:20.352273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.352285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.352289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.352305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.352311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.352313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.352314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.352321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.352329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.352338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.352451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.352456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.352463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.352528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1485 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0
2025-10-02T09:32:20.352742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842c2b4f-e60564cc-50876335-bcdc7846_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.355002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Write session: try to update token
2025-10-02T09:32:20.355013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.361464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.361477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.361478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.361479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.361502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.361504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.361506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982784869:9118]
2025-10-02T09:32:20.361529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.361534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.361536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.361537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.361537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.361540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.361651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.367030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId: src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.369136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.434466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058324793:4709]
2025-10-02T09:32:20.434735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1484, pipe: [1:7556554896058324793:4709]
2025-10-02T09:32:20.472637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.472909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.472918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.472930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324793:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.473073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.473103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:20.473111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:20.473157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1485 reason: error at write: Disconnected sessionId: src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0
2025-10-02T09:32:20.473182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058324793:4709]
2025-10-02T09:32:20.473227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.473290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1485 sessionId: src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0 is DEAD
2025-10-02T09:32:20.473401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:20.473410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Write session will restart in 0.006207s
2025-10-02T09:32:20.473426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Write session: Do CDS request
2025-10-02T09:32:20.473430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.479009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.480139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.480296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.480305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1486
2025-10-02T09:32:20.480348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.480400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.480417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.480423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.480425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.480440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.480446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.480451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.480477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.480500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982784942:9120]
2025-10-02T09:32:20.480701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1486 sessionId:  describe result for acl check
2025-10-02T09:32:20.480725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.480730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.480731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.480735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058324824:4042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.480848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.481035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.481057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.481090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058324824:4042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.481232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.481260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.481263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.481264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.481265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.481265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.481266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.481266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.481267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.481268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.481269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.481269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.481270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.481272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.481279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.481281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.481283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.481285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.481287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.481290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.481292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.481294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.481297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.481299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.481301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.481305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.481308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.481312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.481314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.481316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.481319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.481323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.481326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.481328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.481331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.481334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.481337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.481339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.481342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.481344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.481350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.481352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.481354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.481356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.481359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.481361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.481364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.481369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.481371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.481388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.482463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058324824:4042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.486596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058324824:4042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.486606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058324824:4042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.486608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058324824:4042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.486611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.488710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.490004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.490018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.490020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.490022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.490026Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1485 [2:7556554895982784942:9120]
2025-10-02T09:32:20.490032Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.490044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.490047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.490048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.490049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.490058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.490060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.490069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.490099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.490103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.490104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.490106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.490107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.490144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.490148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.490155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.490160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.490168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.490181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324863:4042], now have 1 active actors on pipe
2025-10-02T09:32:20.490187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324794:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.490190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.490191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.490193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.490202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.490212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.490213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.490215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.490216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.490222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.490224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.490236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.490228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1485
2025-10-02T09:32:20.490245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.490231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1485
2025-10-02T09:32:20.490247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.490264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.490268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.490285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.490292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.490294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.490295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.490300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.490305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.490311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.490411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.490416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.490423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.490486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1486 partition: 0 MaxSeqNo: 36 sessionId: src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0
2025-10-02T09:32:20.490676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffdcf70-117acff7-358bff2d-8bea9e9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.492928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Write session: try to update token
2025-10-02T09:32:20.492938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.499377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.499390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.499391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.499392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.499396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.499398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.499400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982784937:9120]
2025-10-02T09:32:20.499421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.499424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.499426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.499429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.499429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.499430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.499605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.506385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId: src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.508423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.573223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058324871:4709]
2025-10-02T09:32:20.573421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1485, pipe: [1:7556554896058324871:4709]
2025-10-02T09:32:20.611169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.611388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.611396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.611408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324871:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.611525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.611569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:20.611577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:20.611590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058324871:4709]
2025-10-02T09:32:20.611607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.611621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1486 reason: error at write: Disconnected sessionId: src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0
2025-10-02T09:32:20.611746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1486 sessionId: src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0 is DEAD
2025-10-02T09:32:20.611896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:20.611905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Write session will restart in 0.008029s
2025-10-02T09:32:20.611923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Write session: Do CDS request
2025-10-02T09:32:20.611927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.617748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.618987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.619090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.619096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.619101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.619128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.619152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982785011:9122]
2025-10-02T09:32:20.619503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.619681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.619704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.619884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.619913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.619917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.619917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.619918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.619919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.619919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.619920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.619920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.619921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.619921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.619922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.619923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.619925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.619932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.619934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.619937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.619939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.619941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.619943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.619945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.619947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.619950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.619952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.619954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.619958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.619961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.619964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.619967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.619969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.619972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.619974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.619977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.619980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.619983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.619985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.619988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.619991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.619993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.619995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.619998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.620000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.620002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.620004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.620007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.620009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.620011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.620013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.620016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.620033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.621154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.621231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.621240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1487
2025-10-02T09:32:20.621339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.621357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.621364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.621366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.621648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1487 sessionId:  describe result for acl check
2025-10-02T09:32:20.621675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.621680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.621681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.621684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058324907:4033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.622029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058324907:4033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.623302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058324907:4033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.627062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058324907:4033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.627073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058324907:4033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.627074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058324907:4033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.627078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.627577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.628946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.628957Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.628961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.628963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.628967Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1486 [2:7556554895982785011:9122]
2025-10-02T09:32:20.628973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.628984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.628985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.628987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.628988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.628997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.629000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.629004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.629035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.629040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.629042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.629044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.629045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.629123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.629128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.629134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.629139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.629152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.629166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324942:4033], now have 1 active actors on pipe
2025-10-02T09:32:20.629172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324872:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.629176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.629177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.629178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.629186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.629174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1486
2025-10-02T09:32:20.629178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1486
2025-10-02T09:32:20.629193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.629201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.629203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.629204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.629208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.629209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.629226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.629231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.629241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.629249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.629261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.629268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.629271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.629273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.629274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.629281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.629289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.629302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.629429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.629434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.629441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.629506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1487 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0
2025-10-02T09:32:20.629688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd44c65-6cd7217c-6aba7484-fbedf825_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.631904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Write session: try to update token
2025-10-02T09:32:20.631915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.638561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.638576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.638577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.638578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.638582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.638586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.638588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982785006:9122]
2025-10-02T09:32:20.638608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.638610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.638611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.638616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.638619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.638621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.638748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.643814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId: src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.645875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.711989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058324950:4709]
2025-10-02T09:32:20.712251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1486, pipe: [1:7556554896058324950:4709]
2025-10-02T09:32:20.753430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.753611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.753618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.753640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324950:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.753746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.753786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:20.753799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:20.753805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.753838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1487 reason: error at write: Disconnected sessionId: src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0
2025-10-02T09:32:20.753846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058324950:4709]
2025-10-02T09:32:20.753980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1487 sessionId: src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0 is DEAD
2025-10-02T09:32:20.754104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:20.754109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Write session will restart in 0.005634s
2025-10-02T09:32:20.754124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Write session: Do CDS request
2025-10-02T09:32:20.754127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.759683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.761024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.761142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.761145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.761153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.761159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.761188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.761212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982785129:9137]
2025-10-02T09:32:20.761262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.761273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1488
2025-10-02T09:32:20.761374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.761393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.761398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.761401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.761548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.761672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1488 sessionId:  describe result for acl check
2025-10-02T09:32:20.761691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.761696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.761697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.761700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058325010:4018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.761728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.761750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.761923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.761955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.761959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.761959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.761960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.761961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.761962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.761963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.761963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.761964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.761965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.761965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.761966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.761969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.761975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.761977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.761979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.761981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.761984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.761986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.761988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.761990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.761992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.761994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.761996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.761999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.762003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.762006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.762009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.762011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.762014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.762020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.762024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.762029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.762031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.762034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.762037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.762042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.762044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.762046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.762049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.762035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058325010:4018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.762053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.762055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.762057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.762060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.762063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.762066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.762068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.762070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.762089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.763690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058325010:4018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.769091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058325010:4018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.769106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058325010:4018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.769109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058325010:4018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.769114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.769486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.770846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.770855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.770857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.770859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.770862Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1487 [2:7556554895982785129:9137]
2025-10-02T09:32:20.770869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.770879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.770880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.770882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.770883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.770892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.770899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.770903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.770933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.770937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.770938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.770940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.770941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.770977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.770981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.770988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.770993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.771004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.771017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058324976:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.771022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058325044:4018], now have 1 active actors on pipe
2025-10-02T09:32:20.771026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.771031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.771032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.771039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.771050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.771052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.771054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.771055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.771060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.771061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.771061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1487
2025-10-02T09:32:20.771074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.771079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.771080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.771065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1487
2025-10-02T09:32:20.771095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.771100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.771118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee040712-11cdb65e-64bc6327-102082f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.771125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.771131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.771132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.771137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.771146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.771160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.771256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.771261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.771268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.771335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1488 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee040712-11cdb65e-64bc6327-102082f1_0
2025-10-02T09:32:20.771522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce40f0-d60050bc-ce0a15ad-d84c7a0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee040712-11cdb65e-64bc6327-102082f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.773725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Write session: try to update token
2025-10-02T09:32:20.773736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.780226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.780239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.780241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.780242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.780246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.780249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.780252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982785124:9137]
2025-10-02T09:32:20.780272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.780275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.780278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.780281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.780284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.780288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.780384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.784326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId: src_id|ee040712-11cdb65e-64bc6327-102082f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.786304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.853806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058325059:4709]
2025-10-02T09:32:20.854056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1487, pipe: [1:7556554896058325059:4709]
2025-10-02T09:32:20.891684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:20.891904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.891912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.891936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058325059:4709], now have 1 active actors on pipe
2025-10-02T09:32:20.892077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:20.892120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058325059:4709]
2025-10-02T09:32:20.892152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:20.892211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1488 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee040712-11cdb65e-64bc6327-102082f1_0
2025-10-02T09:32:20.892265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:20.892361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1488 sessionId: src_id|ee040712-11cdb65e-64bc6327-102082f1_0 is DEAD
2025-10-02T09:32:20.892460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:20.892469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Write session will restart in 0.008848s
2025-10-02T09:32:20.892486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Write session: Do CDS request
2025-10-02T09:32:20.892491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:20.898098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:20.899507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:20.899609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:20.899615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:20.899620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:20.899644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:20.899669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554895982785201:9139]
2025-10-02T09:32:20.900019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:20.900221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:20.900247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:20.900440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:20.900472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.900476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.900477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.900477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.900478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.900478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.900479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.900479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.900480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.900482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.900482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.900483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.900486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.900492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.900494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.900496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.900498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.900500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.900502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.900504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.900507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.900509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.900511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.900513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.900516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.900521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:20.900524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.900527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:20.900529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.900532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:20.900537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.900540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:20.900542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.900545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:20.900550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.900553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:20.900555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.900561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:20.900564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.900567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:20.900572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.900575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:20.900580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.900583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.900586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.900591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.900593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.900596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.900611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:20.902233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.902285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:20.902296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1489
2025-10-02T09:32:20.902441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:20.902462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:20.902468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:20.902471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:20.902750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1489 sessionId:  describe result for acl check
2025-10-02T09:32:20.902769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:20.902773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:20.902775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:20.902777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554896058325123:4012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:20.903112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554896058325123:4012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:20.904341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554896058325123:4012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:20.907453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554896058325123:4012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:20.907461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554896058325123:4012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:20.907465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554896058325123:4012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:20.907469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:20.907991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:20.909330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:20.909341Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:20.909342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:20.909344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:20.909349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1488 [2:7556554895982785201:9139]
2025-10-02T09:32:20.909355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:20.909365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:20.909366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.909368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.909369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.909378Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:20.909381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:20.909385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:20.909414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.909420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.909420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.909422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:20.909424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:20.909460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:20.909465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.909472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:20.909477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:20.909487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:20.909501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058325075:2446], now have 1 active actors on pipe
2025-10-02T09:32:20.909506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058325157:4012], now have 1 active actors on pipe
2025-10-02T09:32:20.909510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.909511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.909512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.909519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:20.909531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:20.909535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:20.909536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:20.909537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:20.909541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:20.909542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:20.909558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.909564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:20.909565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:20.909555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1488
2025-10-02T09:32:20.909574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1488
2025-10-02T09:32:20.909627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.909633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.909654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|937f67ed-80985d94-31c902db-738724cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:20.909660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:20.909662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:20.909663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:20.909669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:20.909677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:20.909687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.909818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:20.909826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:20.909834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:20.909918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1489 partition: 0 MaxSeqNo: 36 sessionId: src_id|937f67ed-80985d94-31c902db-738724cd_0
2025-10-02T09:32:20.910222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee040712-11cdb65e-64bc6327-102082f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|937f67ed-80985d94-31c902db-738724cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:20.913018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Write session: try to update token
2025-10-02T09:32:20.913033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:20.918646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:20.918657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:20.918658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:20.918659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:20.918662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.918664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.918666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554895982785196:9139]
2025-10-02T09:32:20.918685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:20.918687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:20.918689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:20.918690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:20.918691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:20.918692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:20.918804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:20.926271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId: src_id|937f67ed-80985d94-31c902db-738724cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:20.928440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:20.992059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554896058325164:4709]
2025-10-02T09:32:20.992272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1488, pipe: [1:7556554896058325164:4709]
2025-10-02T09:32:21.032115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.032356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.032364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.032377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554896058325164:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.032551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554896058325164:4709]
2025-10-02T09:32:21.032574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.032573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:21.032576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:21.032622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1489 reason: error at write: Disconnected sessionId: src_id|937f67ed-80985d94-31c902db-738724cd_0
2025-10-02T09:32:21.032768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1489 sessionId: src_id|937f67ed-80985d94-31c902db-738724cd_0 is DEAD
2025-10-02T09:32:21.032955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:21.032970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Write session will restart in 0.008994s
2025-10-02T09:32:21.032993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Write session: Do CDS request
2025-10-02T09:32:21.032999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.033869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.038878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.040398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.040506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.040512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.040518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.040543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.040568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277752568:9142]
2025-10-02T09:32:21.040937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.041160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.041187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.041369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.041400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.041403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.041404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.041404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.041405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.041406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.041406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.041407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.041407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.041408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.041408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.041409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.041411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.041418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.041420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.041422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.041424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.041426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.041428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.041430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.041432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.041434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.041436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.041438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.041442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.041446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.041450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.041452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.041458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.041461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.041464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.041470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.041473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.041479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.041481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.041484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.041487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.041493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.041495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.041497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.041502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.041505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.041507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.041509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.041514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.041517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.041519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.041521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.041541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.043236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.043377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.043387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1490
2025-10-02T09:32:21.043508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.043527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.043533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.043536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.043835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1490 sessionId:  describe result for acl check
2025-10-02T09:32:21.043859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.043863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.043864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.043868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353292500:4008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.044226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353292500:4008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.045784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353292500:4008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.048587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353292500:4008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.048596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353292500:4008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.048598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353292500:4008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.048602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.049162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.050536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.050553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.050555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.050558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.050563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1489 [2:7556554900277752568:9142]
2025-10-02T09:32:21.050574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.050591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.050593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.050594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.050595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.050605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.050612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.050616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.050646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.050651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.050652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.050653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.050655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.050695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.050700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.050706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.050711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.050719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.050730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292535:4008], now have 1 active actors on pipe
2025-10-02T09:32:21.050736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292462:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.050739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.050742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.050743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.050751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.050763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.050764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.050766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.050767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.050774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.050776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.050801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.050796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1489
2025-10-02T09:32:21.050799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1489
2025-10-02T09:32:21.050812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.050821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.050842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.050847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.050864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.050874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.050880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.050882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.050889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.050898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.050908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.051047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.051055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.051066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.051138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1490 partition: 0 MaxSeqNo: 36 sessionId: src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0
2025-10-02T09:32:21.051376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|937f67ed-80985d94-31c902db-738724cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.054176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Write session: try to update token
2025-10-02T09:32:21.054191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.060106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:21.060119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.060125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.060152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:21.060153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:21.060305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:21.060432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:21.060552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:21.060669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:21.060921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:21.060949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:21.067883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId: src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.068765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.068779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.068781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.068782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.068787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.068790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.068792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277752563:9142]
2025-10-02T09:32:21.068818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.068822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.068825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.068836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.068845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.068846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.068989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.070114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:21.132853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554900353292543:4709]
2025-10-02T09:32:21.133094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1489, pipe: [1:7556554900353292543:4709]
2025-10-02T09:32:21.185037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.185316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.185325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.185338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292543:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.185521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.185574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.185612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:21.185613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554900353292543:4709]
2025-10-02T09:32:21.185672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0
2025-10-02T09:32:21.185815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1490 sessionId: src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0 is DEAD
2025-10-02T09:32:21.185963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:21.185977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Write session will restart in 0.006913s
2025-10-02T09:32:21.186015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Write session: Do CDS request
2025-10-02T09:32:21.186021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.191927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.193302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.193405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.193413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.193418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.193445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.193471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277752641:9144]
2025-10-02T09:32:21.193827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.194021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.194048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.194114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.194242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.194226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.194234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1491
2025-10-02T09:32:21.194274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.194278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.194279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.194279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.194280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.194281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.194281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.194282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.194282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.194283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.194283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.194284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.194286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.194293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.194295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.194297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.194299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.194301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.194302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.194304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.194306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.194309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.194311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.194313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.194318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.194322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.194325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.194328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.194331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.194333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.194335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.194338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.194341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.194344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.194346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.194348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.194346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.194351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.194354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.194356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.194358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.194360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.194363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.194365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.194368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.194364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.194370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.194372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.194374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.194369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.194377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.194372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.194395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.194641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1491 sessionId:  describe result for acl check
2025-10-02T09:32:21.194666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.194670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.194671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.194675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353292584:3996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.195035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353292584:3996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.196728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353292584:3996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.200679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353292584:3996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.200690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353292584:3996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.200693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353292584:3996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.200697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.201921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.203310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.203322Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.203323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.203327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.203330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1490 [2:7556554900277752641:9144]
2025-10-02T09:32:21.203343Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.203355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.203360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.203361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.203362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.203375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.203383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.203389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.203428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.203432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.203433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.203435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.203436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.203476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.203481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.203487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.203492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.203500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.203514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292545:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.203519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292619:3996], now have 1 active actors on pipe
2025-10-02T09:32:21.203523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.203525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.203526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.203534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.203545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.203555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.203555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.203557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.203558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.203558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.203572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.203577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.203563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1490
2025-10-02T09:32:21.203570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1490
2025-10-02T09:32:21.203578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.203599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.203604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.203620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fec05181-a50d5b02-aca6f165-d7880740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.203628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.203634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.203639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.203647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.203657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.203669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.203794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.203801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.203810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.203876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1491 partition: 0 MaxSeqNo: 36 sessionId: src_id|fec05181-a50d5b02-aca6f165-d7880740_0
2025-10-02T09:32:21.204149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1890a110-cd99dfe-f9b52924-8e3dcf00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fec05181-a50d5b02-aca6f165-d7880740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.206571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Write session: try to update token
2025-10-02T09:32:21.206583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.213059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.213075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.213078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.213079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.213084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.213086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.213090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277752636:9144]
2025-10-02T09:32:21.213118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.213119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.213124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.213126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.213127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.213129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.213236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.217594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId: src_id|fec05181-a50d5b02-aca6f165-d7880740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.219584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:21.285923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554900353292628:4709]
2025-10-02T09:32:21.286162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1490, pipe: [1:7556554900353292628:4709]
2025-10-02T09:32:21.332499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.332785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.332795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.332830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292628:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.333010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.333062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554900353292628:4709]
2025-10-02T09:32:21.333082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.333090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:21.333092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:21.333139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1491 reason: error at write: Disconnected sessionId: src_id|fec05181-a50d5b02-aca6f165-d7880740_0
2025-10-02T09:32:21.333302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1491 sessionId: src_id|fec05181-a50d5b02-aca6f165-d7880740_0 is DEAD
2025-10-02T09:32:21.333419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:21.333428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Write session will restart in 0.007650s
2025-10-02T09:32:21.333443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Write session: Do CDS request
2025-10-02T09:32:21.333448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.339444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.340987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.341089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.341095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.341102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.341134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.341161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277752717:9147]
2025-10-02T09:32:21.341569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.341773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.341800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.341994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.342027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.342031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.342032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.342032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.342033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.342033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.342034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.342035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.342035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.342036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.342037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.342037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.342041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.342047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.342049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.342051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.342053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.342056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.342058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.342060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.342062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.342064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.342066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.342068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.342072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.342076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.342079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.342082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.342084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.342087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.342089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.342092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.342098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.342100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.342103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.342106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.342108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.342111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.342113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.342116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.342124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.342133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.342140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.342141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.342148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.342150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.342153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.342158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.342162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.342179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.342212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.342220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1492
2025-10-02T09:32:21.342291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.342307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.342311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.342313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.342573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1492 sessionId:  describe result for acl check
2025-10-02T09:32:21.342597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.342601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.342602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.342605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353292670:3990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.342990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353292670:3990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.344728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353292670:3990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.349141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353292670:3990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.349151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353292670:3990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.349153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353292670:3990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.349157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.349611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.351037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.351049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.351051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.351053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.351056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1491 [2:7556554900277752717:9147]
2025-10-02T09:32:21.351064Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.351075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.351080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.351082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.351084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.351093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.351099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.351104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.351142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.351147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.351148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.351150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.351151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.351187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.351191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.351198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.351203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.351213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.351227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292629:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.351232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292705:3990], now have 1 active actors on pipe
2025-10-02T09:32:21.351235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.351236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.351238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.351245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.351256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.351259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.351261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.351262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.351266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.351268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.351270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1491
2025-10-02T09:32:21.351278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1491
2025-10-02T09:32:21.351285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.351290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.351292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.351307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.351311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.351329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50b34669-c912983f-6635cdb8-60dba421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.351336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.351338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.351340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.351345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.351353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.351365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.351482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.351486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.351494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.351561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1492 partition: 0 MaxSeqNo: 36 sessionId: src_id|50b34669-c912983f-6635cdb8-60dba421_0
2025-10-02T09:32:21.351773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fec05181-a50d5b02-aca6f165-d7880740_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50b34669-c912983f-6635cdb8-60dba421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.353989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Write session: try to update token
2025-10-02T09:32:21.354000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.360725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.360735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.360737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.360740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.360744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.360747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.360750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277752712:9147]
2025-10-02T09:32:21.360776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.360784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.360784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.360787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.360787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.360790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.360916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.364864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId: src_id|50b34669-c912983f-6635cdb8-60dba421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.366824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:21.433407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554900353292712:4709]
2025-10-02T09:32:21.433697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1491, pipe: [1:7556554900353292712:4709]
2025-10-02T09:32:21.477945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.478190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.478200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.478227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292712:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.478408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.478478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.478481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:21.478485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:21.478523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554900353292712:4709]
2025-10-02T09:32:21.478540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1492 reason: error at write: Disconnected sessionId: src_id|50b34669-c912983f-6635cdb8-60dba421_0
2025-10-02T09:32:21.478673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1492 sessionId: src_id|50b34669-c912983f-6635cdb8-60dba421_0 is DEAD
2025-10-02T09:32:21.478733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:21.478742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Write session will restart in 0.007687s
2025-10-02T09:32:21.478758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Write session: Do CDS request
2025-10-02T09:32:21.478762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.485151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.486783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.486891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.486897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.486903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.486929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.486952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277752792:9149]
2025-10-02T09:32:21.487149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.487222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.487236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1493
2025-10-02T09:32:21.487314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.487348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.487371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.487379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.487382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.487520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.487548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.487707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1493 sessionId:  describe result for acl check
2025-10-02T09:32:21.487726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.487729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.487735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.487737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.487741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353292752:3982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.487755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.487758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.487759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.487760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.487760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.487761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.487761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.487762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.487762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.487763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.487764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.487764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.487768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.487774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.487777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.487779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.487781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.487783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.487787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.487790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.487794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.487800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.487803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.487807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.487812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.487817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.487820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.487823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.487825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.487827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.487834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.487836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.487838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.487841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.487843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.487846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.487852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.487854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.487857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.487859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.487862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.487865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.487866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.487869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.487871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.487874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.487876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.487879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.487897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.488185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353292752:3982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.489691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353292752:3982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.494246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353292752:3982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.494258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353292752:3982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.494260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353292752:3982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.494265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.495422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.496835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.496844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.496845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.496851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.496854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1492 [2:7556554900277752792:9149]
2025-10-02T09:32:21.496861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.496875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.496880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.496882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.496883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.496892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.496895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.496899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.496933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.496938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.496939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.496941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.496943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.496980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.496985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.496991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.496997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.497006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.497024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292713:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.497030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292789:3982], now have 1 active actors on pipe
2025-10-02T09:32:21.497035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.497040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.497041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.497052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.497063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.497064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.497066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.497067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.497073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.497075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.497089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.497098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.497088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1492
2025-10-02T09:32:21.497107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.497088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1492
2025-10-02T09:32:21.497133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.497138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.497151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.497158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.497160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.497161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.497166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.497174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.497183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.497294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.497299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.497306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.497392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1493 partition: 0 MaxSeqNo: 36 sessionId: src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0
2025-10-02T09:32:21.497597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b34669-c912983f-6635cdb8-60dba421_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.499814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Write session: try to update token
2025-10-02T09:32:21.499823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.506388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:21.506412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.506421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.506450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:21.506456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:21.507156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:21.507279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:21.507390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:21.507507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:21.507744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:21.507775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:21.511404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId: src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.513440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:21.513643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.513655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.513674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:21.513751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:21.514840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.514850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.514853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.514854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.514860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.514862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.514865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277752787:9149]
2025-10-02T09:32:21.514886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.514892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.514893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.514894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.514895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.514897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.515000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.578815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554900353292800:4709]
2025-10-02T09:32:21.579050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1492, pipe: [1:7556554900353292800:4709]
2025-10-02T09:32:21.634214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.640213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.640236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.640358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.640411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.640463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.640519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.640561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.640568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.640621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.640672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.640720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.640769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.640819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.640824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.640875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.640922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.640974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.641025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.641061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.641067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.641116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.641164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.641212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.641266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.641302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.641308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.641359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.641410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.641462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.641514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.641642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.641648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.641700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.641750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.641800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.641848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.641885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.641891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.641940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.641987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.642038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.642089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.642183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.642187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.642239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.642289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.642339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.642387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.642421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.642425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.642473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.642521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.642570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.642617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.642667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.642672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.642719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:21.642763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:21.642815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:21.642862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:21.642897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:21.642901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:21.642932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292800:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.643173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:21.643174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554900353292800:4709]
2025-10-02T09:32:21.643187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:21.643196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.643208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1493 reason: error at write: Disconnected sessionId: src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0
2025-10-02T09:32:21.643351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1493 sessionId: src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0 is DEAD
2025-10-02T09:32:21.643577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.643647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:21.643662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Write session will restart in 0.006174s
2025-10-02T09:32:21.643684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Write session: Do CDS request
2025-10-02T09:32:21.643690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.650300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.651182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.651269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.651282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1494
2025-10-02T09:32:21.651697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.651720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.651727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.651731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.651953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.652063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.652069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.652076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.652103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.652101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1494 sessionId:  describe result for acl check
2025-10-02T09:32:21.652128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277752868:9151]
2025-10-02T09:32:21.652129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.652134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.652135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.652138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353292839:3980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.652481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.652643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353292839:3980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.652682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.652704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.652897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.652929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.652933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.652934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.652934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.652935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.652935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.652936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.652937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.652938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.652938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.652939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.652939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.652942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.652948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.652950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.652952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.652954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.652956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.652958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.652960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.652962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.652965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.652967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.652968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.652972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.652976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.652979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.652982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.652985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.652988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.652990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.652993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.652995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.652998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.653000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.653002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.653004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.653007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.653009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.653011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.653015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.653021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.653024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.653026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.653028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.653031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.653036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.653038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.653056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.654467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353292839:3980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.658529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353292839:3980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.658543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353292839:3980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.658546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353292839:3980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.658553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.660738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.662123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.662137Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.662139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.662141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.662145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1493 [2:7556554900277752868:9151]
2025-10-02T09:32:21.662153Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.662165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.662171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.662173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.662174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.662186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.662190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.662195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.662229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.662234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.662235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.662237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.662240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.662286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.662291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.662297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.662304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.662316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.662331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292801:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.662337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292878:3980], now have 1 active actors on pipe
2025-10-02T09:32:21.662341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.662344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.662345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.662353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.662364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.662367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.662369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.662370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.662375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.662377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.662394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.662399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.662382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1493
2025-10-02T09:32:21.662394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1493
2025-10-02T09:32:21.662407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.662421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.662426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.662445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.662451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.662453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.662454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.662460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.662465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.662477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.662600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.662605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.662613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.662681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1494 partition: 0 MaxSeqNo: 36 sessionId: src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0
2025-10-02T09:32:21.662971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb7645c-8b538518-ea37d195-5ca6bd4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.665150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Write session: try to update token
2025-10-02T09:32:21.665162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.671866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.671881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.671883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.671884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.671889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.671891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.671896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277752863:9151]
2025-10-02T09:32:21.671920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.671926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.671928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.671929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.671930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.671932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.672039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.677955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId: src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.679984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:21.743120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554900353292886:4709]
2025-10-02T09:32:21.743303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1493, pipe: [1:7556554900353292886:4709]
2025-10-02T09:32:21.790225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.790513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.790523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.790536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292886:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.790656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.790679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554900353292886:4709]
2025-10-02T09:32:21.790704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.790708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:21.790759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0
2025-10-02T09:32:21.790921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1494 sessionId: src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0 is DEAD
2025-10-02T09:32:21.791051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:21.791060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Write session will restart in 0.006507s
2025-10-02T09:32:21.791075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Write session: Do CDS request
2025-10-02T09:32:21.791081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.797310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.798181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.798322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.798331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1495
2025-10-02T09:32:21.798436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.798457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.798463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.798465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.798842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.798844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1495 sessionId:  describe result for acl check
2025-10-02T09:32:21.798888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.798895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.798896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.798902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353292951:3961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.798948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.798956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.798962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.798988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.799016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277752994:9166]
2025-10-02T09:32:21.799343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353292951:3961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.799365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.799580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.799603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.799777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.799808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.799812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.799813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.799813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.799814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.799815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.799815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.799816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.799817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.799818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.799818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.799819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.799822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.799828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.799832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.799834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.799836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.799838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.799840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.799842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.799844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.799846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.799848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.799850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.799855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.799858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.799862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.799865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.799867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.799870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.799872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.799874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.799877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.799880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.799882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.799887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.799889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.799894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.799896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.799899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.799905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.799908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.799910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.799912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.799914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.799917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.799919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.799922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.799939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.801376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353292951:3961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.806780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353292951:3961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.806800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353292951:3961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.806803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353292951:3961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.806809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.807471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.808947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.808957Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.808959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.808961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.808966Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1494 [2:7556554900277752994:9166]
2025-10-02T09:32:21.808974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.808985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.808990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.808992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.808993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.809002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.809007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.809011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.809042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.809046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.809047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.809049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.809050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.809088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.809093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.809100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.809105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.809116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.809132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292990:3961], now have 1 active actors on pipe
2025-10-02T09:32:21.809137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353292912:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.809141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.809142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.809143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.809152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.809159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.809165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.809167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.809168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.809170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.809171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.809186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.809191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.809193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.809260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1494
2025-10-02T09:32:21.809275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1494
2025-10-02T09:32:21.809345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.809352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.809370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.809377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.809379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.809380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.809385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.809390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.809402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.809525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.809529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.809537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.809600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1495 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0
2025-10-02T09:32:21.809867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26aa46e3-77fa3a8f-899fbfa3-7b9b083a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.812761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Write session: try to update token
2025-10-02T09:32:21.812780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.818567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.818582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.818585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.818586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.818591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.818594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.818596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277752989:9166]
2025-10-02T09:32:21.818618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.818621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.818624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.818625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.818626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.818627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.818742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.826117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId: src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.828022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:21.890584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554900353293017:4709]
2025-10-02T09:32:21.890755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1494, pipe: [1:7556554900353293017:4709]
2025-10-02T09:32:21.935990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:21.936293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.936301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.936316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353293017:4709], now have 1 active actors on pipe
2025-10-02T09:32:21.936470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:21.936521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554900353293017:4709]
2025-10-02T09:32:21.936545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:21.936555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:21.936630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1495 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0
2025-10-02T09:32:21.937009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:21.937031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Write session will restart in 0.007960s
2025-10-02T09:32:21.936994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1495 sessionId: src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0 is DEAD
2025-10-02T09:32:21.937052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Write session: Do CDS request
2025-10-02T09:32:21.937058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:21.943278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:21.944745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:21.944862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:21.944869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:21.944875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:21.944905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:21.944930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554900277753072:9168]
2025-10-02T09:32:21.945340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:21.945546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:21.945610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:21.945789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:21.945820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.945824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.945824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.945825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.945825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.945826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.945826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.945827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.945827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.945828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.945829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.945829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.945832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.945839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.945842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.945844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.945847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.945849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.945851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.945853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.945855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.945858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.945860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.945862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.945866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.945870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:21.945873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.945876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:21.945879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.945881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:21.945883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.945886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:21.945888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.945891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:21.945893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.945896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:21.945898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.945900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:21.945902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.945904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:21.945907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.945910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:21.945912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.945914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.945919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.945922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.945924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.945927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.945943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:21.946174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.946246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:21.946254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1496
2025-10-02T09:32:21.946377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:21.946397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:21.946403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:21.946405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:21.946797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1496 sessionId:  describe result for acl check
2025-10-02T09:32:21.946837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:21.946844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:21.946845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:21.946849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554900353293063:3954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:21.947286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554900353293063:3954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:21.949227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554900353293063:3954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:21.953061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554900353293063:3954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:21.953075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554900353293063:3954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:21.953078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554900353293063:3954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:21.953083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:21.953462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:21.954818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:21.954829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:21.954830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:21.954832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:21.954836Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1495 [2:7556554900277753072:9168]
2025-10-02T09:32:21.954845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:21.954855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:21.954860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.954861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.954862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.954872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:21.954874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:21.954879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:21.954907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.954912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.954913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.954915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:21.954916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:21.954953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:21.954957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.954965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:21.954974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:21.954983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:21.954997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353293098:3954], now have 1 active actors on pipe
2025-10-02T09:32:21.955002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554900353293018:2446], now have 1 active actors on pipe
2025-10-02T09:32:21.955005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.955006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.955007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.955014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:21.955025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:21.955027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:21.955029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:21.955030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:21.955035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:21.955036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:21.955033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1495
2025-10-02T09:32:21.955050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.955045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1495
2025-10-02T09:32:21.955054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:21.955057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:21.955064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.955067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.955090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:21.955097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:21.955100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:21.955101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:21.955105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:21.955113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:21.955125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.955230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:21.955235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:21.955243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:21.955312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1496 partition: 0 MaxSeqNo: 36 sessionId: src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0
2025-10-02T09:32:21.955523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd0101d-8cd2b75b-db7986d1-fc34e9b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:21.957903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Write session: try to update token
2025-10-02T09:32:21.957914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:21.964355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:21.964368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:21.964370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:21.964371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:21.964377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.964380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.964382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554900277753067:9168]
2025-10-02T09:32:21.964403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:21.964405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:21.964407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:21.964408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:21.964408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:21.964410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:21.964532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:21.968841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId: src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:21.971125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.036511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554904648260402:4709]
2025-10-02T09:32:22.036758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1495, pipe: [1:7556554904648260402:4709]
2025-10-02T09:32:22.077877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.078072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.078081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.078105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260402:4709], now have 1 active actors on pipe
2025-10-02T09:32:22.078294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.078329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:22.078335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:22.078351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260402:4709]
2025-10-02T09:32:22.078398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1496 reason: error at write: Disconnected sessionId: src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0
2025-10-02T09:32:22.078550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1496 sessionId: src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0 is DEAD
2025-10-02T09:32:22.078683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:22.078692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Write session will restart in 0.005579s
2025-10-02T09:32:22.078707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Write session: Do CDS request
2025-10-02T09:32:22.078712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.078732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:22.084884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.085075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.085156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.085166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1497
2025-10-02T09:32:22.085232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.085249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.085255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.085258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.085597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1497 sessionId:  describe result for acl check
2025-10-02T09:32:22.085635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.085646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.085648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.085652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648260444:3950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.086084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648260444:3950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.086340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.086431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.086437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.086443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.086466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.086490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720449:9171]
2025-10-02T09:32:22.086837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.087031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.087056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.087236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.087264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.087267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.087268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.087269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.087269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.087270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.087270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.087271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.087272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.087272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.087273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.087274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.087276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.087283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.087285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.087287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.087289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.087291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.087293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.087297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.087300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.087302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.087304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.087307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.087311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.087314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.087317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.087319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.087325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.087328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.087330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.087336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.087339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.087341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.087343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.087351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.087356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.087363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.087367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.087374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.087379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.087387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.087395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.087402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.087404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.087408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.087410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.087427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.087800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648260444:3950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.092289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648260444:3950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.092303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648260444:3950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.092305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648260444:3950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.092311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.094833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.096127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.096139Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.096140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.096143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.096147Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1496 [2:7556554904572720449:9171]
2025-10-02T09:32:22.096154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.096164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.096168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.096170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.096171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.096181Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.096184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.096188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.096217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.096221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.096222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.096224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.096225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.096263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.096268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.096274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.096279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.096287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.096301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260483:3950], now have 1 active actors on pipe
2025-10-02T09:32:22.096306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260403:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.096309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.096310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.096311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.096318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.096328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.096332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.096334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.096335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.096338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.096339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.096352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.096356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.096349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1496
2025-10-02T09:32:22.096360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1496
2025-10-02T09:32:22.096370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.096379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.096380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.096394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e947885-a90b7a87-a843d027-260197cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.096401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.096403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.096404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.096409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.096416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.096426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.096527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.096532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.096539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.096605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1497 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e947885-a90b7a87-a843d027-260197cc_0
2025-10-02T09:32:22.096835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d5f3e2-e87b6eb2-5d47f142-220ae615_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e947885-a90b7a87-a843d027-260197cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.099607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Write session: try to update token
2025-10-02T09:32:22.099621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.105449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.105461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.105464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.105464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.105469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.105471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.105473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720444:9171]
2025-10-02T09:32:22.105491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.105495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.105496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.105496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.105499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.105501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.105607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.112645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId: src_id|1e947885-a90b7a87-a843d027-260197cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.114723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.178323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554904648260491:4709]
2025-10-02T09:32:22.178530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1496, pipe: [1:7556554904648260491:4709]
2025-10-02T09:32:22.216463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.216749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.216759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.216771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260491:4709], now have 1 active actors on pipe
2025-10-02T09:32:22.216986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:22.216978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:22.216990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:22.217027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.217033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1497 reason: error at write: Disconnected sessionId: src_id|1e947885-a90b7a87-a843d027-260197cc_0
2025-10-02T09:32:22.217089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260491:4709]
2025-10-02T09:32:22.217169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1497 sessionId: src_id|1e947885-a90b7a87-a843d027-260197cc_0 is DEAD
2025-10-02T09:32:22.217320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:22.217332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Write session will restart in 0.006450s
2025-10-02T09:32:22.217366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Write session: Do CDS request
2025-10-02T09:32:22.217372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.223170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.224484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.224582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.224588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.224594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.224618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.224644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720529:9173]
2025-10-02T09:32:22.225022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.225159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.225233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.225259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.225272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.225280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1498
2025-10-02T09:32:22.225388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.225406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.225412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.225415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.225440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.225470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.225474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.225474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.225475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.225475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.225476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.225477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.225477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.225478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.225478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.225479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.225479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.225482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.225489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.225491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.225493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.225495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.225497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.225499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.225501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.225504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.225506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.225508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.225510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.225515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.225520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.225523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.225526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.225528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.225531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.225533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.225535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.225538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.225544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.225546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.225549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.225551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.225554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.225556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.225559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.225562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.225565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.225567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.225570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.225572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.225575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.225578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.225581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.225597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.225762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1498 sessionId:  describe result for acl check
2025-10-02T09:32:22.225798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.225805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.225806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.225810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648260540:3937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.226249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648260540:3937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.227969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648260540:3937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.231857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648260540:3937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.231869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648260540:3937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.231872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648260540:3937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.231878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.233007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.234410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.234422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.234423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.234425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.234429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1497 [2:7556554904572720529:9173]
2025-10-02T09:32:22.234438Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.234447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.234450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.234451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.234453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.234462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.234468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.234473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.234501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.234506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.234506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.234508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.234509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.234544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.234549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.234555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.234560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.234571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.234586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260494:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.234591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260575:3937], now have 1 active actors on pipe
2025-10-02T09:32:22.234595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.234596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.234597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.234606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.234617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.234620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.234622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.234623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.234625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.234626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.234641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.234647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.234648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.234645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1497
2025-10-02T09:32:22.234651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1497
2025-10-02T09:32:22.234670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.234676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.234690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.234696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.234698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.234699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.234703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.234710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.234718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.234838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.234843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.234851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.234920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1498 partition: 0 MaxSeqNo: 36 sessionId: src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0
2025-10-02T09:32:22.235162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e947885-a90b7a87-a843d027-260197cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.237962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Write session: try to update token
2025-10-02T09:32:22.237977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.247754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:22.247765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.247769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.247791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:22.247797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:22.247922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:22.248045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.248159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.248279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.248437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:22.248463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:22.251054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId: src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.252080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.252092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.252096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.252097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.252100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.252102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.252105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720523:9173]
2025-10-02T09:32:22.252124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.252125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.252128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.252130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.252130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.252132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.252246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.253258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.317090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554904648260582:4709]
2025-10-02T09:32:22.317382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1497, pipe: [1:7556554904648260582:4709]
2025-10-02T09:32:22.363390Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.363633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.363643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.363656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260582:4709], now have 1 active actors on pipe
2025-10-02T09:32:22.363838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:22.363854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260582:4709]
2025-10-02T09:32:22.363882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:22.363907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.363936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1498 reason: status is not ok: tablet will be restarted right now sessionId: src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0
2025-10-02T09:32:22.364076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1498 sessionId: src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0 is DEAD
2025-10-02T09:32:22.364186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:22.364192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Write session will restart in 0.007954s
2025-10-02T09:32:22.364208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Write session: Do CDS request
2025-10-02T09:32:22.364211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.370097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.371532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.371627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.371632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.371638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.371662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.371687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720610:9176]
2025-10-02T09:32:22.372025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.372205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.372228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.372403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.372434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.372439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.372439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.372440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.372440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.372441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.372442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.372442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.372442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.372443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.372444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.372444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.372447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.372454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.372456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.372458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.372460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.372462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.372464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.372466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.372468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.372471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.372473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.372475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.372479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.372484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.372487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.372490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.372492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.372495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.372497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.372501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.372503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.372506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.372508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.372510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.372512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.372515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.372518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.372520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.372522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.372525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.372526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.372529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.372531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.372533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.372535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.372538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.372555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.373223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.373355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.373367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1499
2025-10-02T09:32:22.373482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.373503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.373509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.373512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.373853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1499 sessionId:  describe result for acl check
2025-10-02T09:32:22.373897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.373899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.373900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.373908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648260631:3934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.374369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648260631:3934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.375966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648260631:3934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.379576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648260631:3934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.379591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648260631:3934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.379593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648260631:3934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.379598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.379964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.381289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.381301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.381302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.381304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.381308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1498 [2:7556554904572720610:9176]
2025-10-02T09:32:22.381314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.381327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.381328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.381330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.381331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.381340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.381347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.381352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.381381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.381387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.381388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.381390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.381391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.381434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.381439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.381445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.381450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.381458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.381468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260584:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.381471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260665:3934], now have 1 active actors on pipe
2025-10-02T09:32:22.381478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.381480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.381481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.381488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.381498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.381500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.381502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.381503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.381509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.381511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.381506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1498
2025-10-02T09:32:22.381526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.381530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.381532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.381545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1498
2025-10-02T09:32:22.381586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.381591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.381604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37954a24-31456f43-3541fc6f-69444842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.381610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.381614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.381619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.381623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.381631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.381641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.381758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.381762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.381769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.381833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1499 partition: 0 MaxSeqNo: 36 sessionId: src_id|37954a24-31456f43-3541fc6f-69444842_0
2025-10-02T09:32:22.382099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|197cdd78-f192bf3-6b4c4fa6-74f584e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37954a24-31456f43-3541fc6f-69444842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.384893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Write session: try to update token
2025-10-02T09:32:22.384907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.390450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:22.390460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.390463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.390483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:22.390484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:22.390620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:22.390755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.390884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.391033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.391191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:22.391213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:22.398297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId: src_id|37954a24-31456f43-3541fc6f-69444842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.398917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.398928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.398929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.398930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.398936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.398938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.398940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720605:9176]
2025-10-02T09:32:22.398956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.398962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.398963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.398964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.398964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.398967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.399074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.400465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.464055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554904648260673:4709]
2025-10-02T09:32:22.464301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1498, pipe: [1:7556554904648260673:4709]
2025-10-02T09:32:22.509393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.509691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.509701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.509714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260673:4709], now have 1 active actors on pipe
2025-10-02T09:32:22.509855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:22.509859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260673:4709]
2025-10-02T09:32:22.509884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.509917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:22.510022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1499 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37954a24-31456f43-3541fc6f-69444842_0
2025-10-02T09:32:22.510176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1499 sessionId: src_id|37954a24-31456f43-3541fc6f-69444842_0 is DEAD
2025-10-02T09:32:22.510321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:22.510332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Write session will restart in 0.009131s
2025-10-02T09:32:22.510350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Write session: Do CDS request
2025-10-02T09:32:22.510354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.516162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.517511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.517610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.517617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.517623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.517648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.517673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720692:9178]
2025-10-02T09:32:22.518040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.518232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.518255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.518438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.518466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.518469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.518470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.518470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.518471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.518472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.518472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.518473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.518473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.518474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.518474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.518475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.518478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.518485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.518487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.518489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.518491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.518494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.518496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.518498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.518500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.518502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.518504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.518506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.518510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.518514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.518517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.518520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.518522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.518525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.518527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.518530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.518532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.518535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.518537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.518540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.518541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.518544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.518546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.518549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.518552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.518555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.518557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.518559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.518562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.518565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.518566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.518569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.518585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.520174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.520333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.520349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1500
2025-10-02T09:32:22.520479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.520502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.520510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.520513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.520924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1500 sessionId:  describe result for acl check
2025-10-02T09:32:22.520965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.520971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.520972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.520976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648260723:3928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.521417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648260723:3928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.523085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648260723:3928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.525597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648260723:3928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.525611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648260723:3928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.525615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648260723:3928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.525622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.526011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.527441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.527453Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.527455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.527457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.527460Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1499 [2:7556554904572720692:9178]
2025-10-02T09:32:22.527470Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.527481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.527486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.527488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.527489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.527498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.527515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.527520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.527553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.527557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.527558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.527560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.527561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.527599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.527603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.527609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.527615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.527626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.527641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260758:3928], now have 1 active actors on pipe
2025-10-02T09:32:22.527647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260675:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.527651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.527652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.527653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.527660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.527670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.527674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.527676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.527677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.527680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.527683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.527696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.527701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.527696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1499
2025-10-02T09:32:22.527710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1499
2025-10-02T09:32:22.527714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.527720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.527722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.527740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66043400-6ef448aa-3270d217-1f046287_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.527743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.527750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.527750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.527755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.527763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.527773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.527868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.527872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.527879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.527952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1500 partition: 0 MaxSeqNo: 36 sessionId: src_id|66043400-6ef448aa-3270d217-1f046287_0
2025-10-02T09:32:22.528172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37954a24-31456f43-3541fc6f-69444842_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66043400-6ef448aa-3270d217-1f046287_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.530670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Write session: try to update token
2025-10-02T09:32:22.530683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.536787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:22.536814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.536819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.536844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:22.536847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:22.536979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:22.537093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.537203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.537315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:22.537471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:22.537495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:22.542938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId: src_id|66043400-6ef448aa-3270d217-1f046287_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.545029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.545309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.545325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.545335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.545337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.545338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.545339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.545345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.545348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.545350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720687:9178]
2025-10-02T09:32:22.545372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.545374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.545377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.545381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.545381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.545383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.545487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.609956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554904648260765:4709]
2025-10-02T09:32:22.610185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1499, pipe: [1:7556554904648260765:4709]
2025-10-02T09:32:22.655455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.655665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:22.655689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260765:4709], now have 1 active actors on pipe
2025-10-02T09:32:22.655809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:22.655867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.655888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:22.655895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:22.655921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260765:4709]
2025-10-02T09:32:22.655946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1500 reason: error at write: Disconnected sessionId: src_id|66043400-6ef448aa-3270d217-1f046287_0
2025-10-02T09:32:22.656077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1500 sessionId: src_id|66043400-6ef448aa-3270d217-1f046287_0 is DEAD
2025-10-02T09:32:22.656204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:22.656214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Write session will restart in 0.008392s
2025-10-02T09:32:22.656230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Write session: Do CDS request
2025-10-02T09:32:22.656234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.662435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.663839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.663940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.663946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.663951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.663977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.664003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720775:9180]
2025-10-02T09:32:22.664617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.664812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.664838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.665112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.665141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.665145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.665154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.665145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.665146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.665148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.665149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.665150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.665151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.665151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.665152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.665153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.665153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.665156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.665163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.665165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.665168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.665170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.665172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.665174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.665176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.665178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.665180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.665182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.665184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.665188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.665192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.665196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.665199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.665201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.665204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.665206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.665210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.665212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.665215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.665217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.665221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.665223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.665226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.665229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.665232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.665235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.665238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.665240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.665243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.665246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.665249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.665251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.665253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.665272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.665261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.665270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1501
2025-10-02T09:32:22.665390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.665408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.665411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.665415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.665756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1501 sessionId:  describe result for acl check
2025-10-02T09:32:22.665794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.665799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.665801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.665805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648260815:3925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.666250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648260815:3925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.667802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648260815:3925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.672260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648260815:3925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.672272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648260815:3925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.672274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648260815:3925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.672280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.672700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.674102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.674114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.674116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.674119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.674123Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1500 [2:7556554904572720775:9180]
2025-10-02T09:32:22.674130Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.674141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.674146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.674149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.674150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.674160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.674163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.674167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.674199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.674204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.674205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.674207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.674208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.674244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.674248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.674255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.674260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.674272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.674287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260766:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.674293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260850:3925], now have 1 active actors on pipe
2025-10-02T09:32:22.674296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.674301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.674303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.674311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.674321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.674324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.674326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.674327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.674331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.674332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.674348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.674353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.674358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.674342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1500
2025-10-02T09:32:22.674350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1500
2025-10-02T09:32:22.674373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.674378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.674394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.674402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.674405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.674406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.674410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.674419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.674425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.674525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.674529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.674537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.674616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1501 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0
2025-10-02T09:32:22.674838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66043400-6ef448aa-3270d217-1f046287_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.677019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Write session: try to update token
2025-10-02T09:32:22.677030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.683766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.683781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.683783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.683785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.683795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.683799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.683802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720770:9180]
2025-10-02T09:32:22.683828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.683836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.683837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.683853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.683866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.683868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.683955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.687517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId: src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.689486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.755867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554904648260858:4709]
2025-10-02T09:32:22.756066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1500, pipe: [1:7556554904648260858:4709]
2025-10-02T09:32:22.797378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.797631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.797640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.797663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260858:4709], now have 1 active actors on pipe
2025-10-02T09:32:22.797772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:22.797827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.797862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260858:4709]
2025-10-02T09:32:22.797874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:22.797924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1501 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0
2025-10-02T09:32:22.798056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1501 sessionId: src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0 is DEAD
2025-10-02T09:32:22.798181Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:32:22.798204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:22.798218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Write session will restart in 0.007190s
2025-10-02T09:32:22.798242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Write session: Do CDS request
2025-10-02T09:32:22.798249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.798252Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 15 consumer shared/user session shared/user_1_15_8464715990875101492_v1 is DEAD
2025-10-02T09:32:22.798360Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554840223728240:4715] disconnected; active server actors: 1
2025-10-02T09:32:22.798370Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554840223728240:4715] client user disconnected session shared/user_1_15_8464715990875101492_v1
2025-10-02T09:32:22.798400Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:32:22.798520Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:22.798524Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:22.798535Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.009802s
2025-10-02T09:32:22.804722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.806197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.806237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.806302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.806308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.806314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.806340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.806339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.806363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720900:9189]
2025-10-02T09:32:22.806350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1502
2025-10-02T09:32:22.806417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.806435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.806442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.806445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.806678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1502 sessionId:  describe result for acl check
2025-10-02T09:32:22.806700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.806698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.806704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.806705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.806709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648260924:3912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.806886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.806908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.807023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648260924:3912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.807081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.807109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.807113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.807113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.807114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.807116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.807116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.807117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.807118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.807118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.807119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.807119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.807120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.807123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.807128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.807131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.807133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.807135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.807137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.807139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.807141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.807143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.807145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.807147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.807149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.807152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.807156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.807160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.807163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.807165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.807168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.807170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.807173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.807175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.807177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.807179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.807183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.807185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.807187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.807190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.807192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.807194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.807197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.807198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.807201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.807203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.807205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.807207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.807210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.807226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.808277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648260924:3912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.809036Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:32:22.809105Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:32:22.809116Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 16
2025-10-02T09:32:22.809207Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 16 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:22.809237Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:22.809298Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 auth for : user
2025-10-02T09:32:22.809369Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 Handle describe topics response
2025-10-02T09:32:22.809383Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 auth is DEAD
2025-10-02T09:32:22.809393Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:32:22.809556Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:32:22.809644Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_16_1128256471930200876_v1
2025-10-02T09:32:22.809650Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554904648260964:3898] connected; active server actors: 1
2025-10-02T09:32:22.809677Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554904648260964:3898] session shared/user_1_16_1128256471930200876_v1
2025-10-02T09:32:22.809685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:32:22.809695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:32:22.809700Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_16_1128256471930200876_v1" (Sender=[1:7556554904648260961:3898], Pipe=[1:7556554904648260964:3898], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:22.809704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:32:22.809716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:32:22.809725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_16_1128256471930200876_v1" (Sender=[1:7556554904648260961:3898], Pipe=[1:7556554904648260964:3898], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:22.809735Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_16_1128256471930200876_v1" sender [1:7556554904648260961:3898] lock partition 0 for ReadingSession "shared/user_1_16_1128256471930200876_v1" (Sender=[1:7556554904648260961:3898], Pipe=[1:7556554904648260964:3898], Partitions=[], ActiveFamilyCount=1) generation 1 step 16
2025-10-02T09:32:22.809750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:32:22.809757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000035s
2025-10-02T09:32:22.809964Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 16 Session: "shared/user_1_16_1128256471930200876_v1" ClientId: "user" PipeClient { RawX1: 7556554904648260964 RawX2: 4503603922341690 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:32:22.809983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:32:22.813088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648260924:3912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.813097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648260924:3912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.813100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648260924:3912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.813105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.814634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.816035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.816049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.816050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.816052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.816055Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1501 [2:7556554904572720900:9189]
2025-10-02T09:32:22.816062Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.816071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.816076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.816077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.816079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.816089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.816095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.816099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.816129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.816133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.816134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.816136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.816137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.816172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.816176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.816183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.816188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.816200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.816213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260974:3912], now have 1 active actors on pipe
2025-10-02T09:32:22.816218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260970:3893], now have 1 active actors on pipe
2025-10-02T09:32:22.816219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648260872:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.816223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.816224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.816225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.816232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.816243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.816244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.816246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.816248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.816254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.816255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.816267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.816272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.816258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1501, pipe: [1:7556554904648260970:3893]
2025-10-02T09:32:22.816260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1501
2025-10-02T09:32:22.816274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1501
2025-10-02T09:32:22.816283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.816287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.816290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.816295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_16_1128256471930200876_v1 on pipe: [1:7556554904648260970:3893]
2025-10-02T09:32:22.816310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.816315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.816318Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_16_1128256471930200876_v1:1 with generation 1501
2025-10-02T09:32:22.816323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.816330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.816331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.816339Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_16_1128256471930200876_v1
2025-10-02T09:32:22.816343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.816363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.816368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:32:22.816371Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:32:22.819767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:32:22.819784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:32:22.819788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.819790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.819792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.819797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.819805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.819808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:32:22.819814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:32:22.819823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.819910Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397542815 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:32:22.819922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:32:22.819942Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 sending to client partition status
2025-10-02T09:32:22.819969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.819976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.819985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.820054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1502 partition: 0 MaxSeqNo: 36 sessionId: src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0
2025-10-02T09:32:22.820290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3fe924-23f85662-cacbc79e-d6ec3b73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.823147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Write session: try to update token
2025-10-02T09:32:22.823162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.825332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.825344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.825345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.825346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.825351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.825353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.825355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720894:9189]
2025-10-02T09:32:22.825374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.825377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.825380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.825380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.825381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.825382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.825484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.836685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId: src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.838793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:22.934679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:22.934896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.934906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.935050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_16_1128256471930200876_v1
2025-10-02T09:32:22.935065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:22.935081Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_16_1128256471930200876_v1
2025-10-02T09:32:22.935097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:22.935137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:22.935156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554904648260970:3893]
2025-10-02T09:32:22.935199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1502 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0
2025-10-02T09:32:22.935342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1502 sessionId: src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0 is DEAD
2025-10-02T09:32:22.935497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:22.935508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Write session will restart in 0.009901s
2025-10-02T09:32:22.935534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Write session: Do CDS request
2025-10-02T09:32:22.935541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:22.941719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:22.943151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:22.943269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:22.943276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:22.943282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:22.943310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:22.943336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554904572720995:9197]
2025-10-02T09:32:22.943690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:22.943912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:22.943939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:22.944132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:22.944162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.944166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.944167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.944167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.944168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.944169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.944170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.944170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.944171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.944171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.944172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.944172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.944175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.944183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.944185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.944187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.944189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.944191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.944193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.944195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.944197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.944199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.944202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.944205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.944208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.944212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:22.944215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.944218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:22.944222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.944225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:22.944227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.944230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:22.944232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.944235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:22.944237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.944239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:22.944241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.944244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:22.944246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.944249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:22.944251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.944254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:22.944255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.944258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.944260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.944263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.944271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.944275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.944300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:22.946177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.946264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:22.946275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1503
2025-10-02T09:32:22.946383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:22.946403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:22.946410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:22.946413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:22.946759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1503 sessionId:  describe result for acl check
2025-10-02T09:32:22.946811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:22.946817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:22.946818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:22.946823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554904648261051:3888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:22.947252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554904648261051:3888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:22.949124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554904648261051:3888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:22.951268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554904648261051:3888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:22.951280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554904648261051:3888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:22.951283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554904648261051:3888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:22.951288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:22.951870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:22.953201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:22.953213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:22.953215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:22.953217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:22.953220Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1502 [2:7556554904572720995:9197]
2025-10-02T09:32:22.953231Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:22.953243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:22.953245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.953246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.953247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.953255Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:22.953258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:22.953264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:22.953294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.953299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.953300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.953302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:22.953303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:22.953341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:22.953345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.953352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:22.953357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:22.953369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:22.953383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648261000:2446], now have 1 active actors on pipe
2025-10-02T09:32:22.953389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554904648261086:3888], now have 1 active actors on pipe
2025-10-02T09:32:22.953392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.953393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.953394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.953403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:22.953414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:22.953416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:22.953418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:22.953419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:22.953424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:22.953426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:22.953439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.953444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:22.953430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1502
2025-10-02T09:32:22.953450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:22.953460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.953462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.953437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1502
2025-10-02T09:32:22.953479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7875127e-10b787fe-aa511ee8-70546bf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:22.953487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:22.953489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:22.953491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:22.953496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:22.953504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:22.953514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.953616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:22.953621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:22.953629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:22.953703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1503 partition: 0 MaxSeqNo: 36 sessionId: src_id|7875127e-10b787fe-aa511ee8-70546bf9_0
2025-10-02T09:32:22.953938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76dee7b-a712bc9d-ba7f7b35-65709142_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7875127e-10b787fe-aa511ee8-70546bf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:22.956599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Write session: try to update token
2025-10-02T09:32:22.956613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:22.962592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:22.962602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:22.962604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:22.962606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:22.962610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.962613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.962615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554904572720990:9197]
2025-10-02T09:32:22.962634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:22.962637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:22.962638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:22.962640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:22.962641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:22.962643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:22.962870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:22.969355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId: src_id|7875127e-10b787fe-aa511ee8-70546bf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:22.972251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.035417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943228390:3893]
2025-10-02T09:32:23.035652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1502, pipe: [1:7556554908943228390:3893]
2025-10-02T09:32:23.072522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.072718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.072728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.072745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228390:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.072955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943228390:3893]
2025-10-02T09:32:23.072987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:23.072989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:23.072991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.073043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1503 reason: error at write: Disconnected sessionId: src_id|7875127e-10b787fe-aa511ee8-70546bf9_0
2025-10-02T09:32:23.073181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1503 sessionId: src_id|7875127e-10b787fe-aa511ee8-70546bf9_0 is DEAD
2025-10-02T09:32:23.073225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.073333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:23.073345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Write session will restart in 0.005085s
2025-10-02T09:32:23.073368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Write session: Do CDS request
2025-10-02T09:32:23.073375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.079147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.079228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.079238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1504
2025-10-02T09:32:23.079348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.079369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.079376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.079379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.079726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1504 sessionId:  describe result for acl check
2025-10-02T09:32:23.079766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.079771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.079773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.079778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943228438:3885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.079958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.080214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943228438:3885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.081467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.081563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.081569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.081576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.081601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.081624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688379:9200]
2025-10-02T09:32:23.082180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943228438:3885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.082241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.082415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.082438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.082624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.082656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.082660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.082661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.082661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.082662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.082663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.082663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.082664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.082664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.082665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.082665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.082667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.082670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.082676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.082678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.082680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.082682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.082683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.082685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.082687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.082689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.082692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.082694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.082696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.082700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.082703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.082707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.082709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.082711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.082714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.082716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.082719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.082721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.082723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.082726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.082728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.082730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.082733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.082735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.082738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.082740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.082743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.082745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.082751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.082753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.082756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.082760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.082763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.082780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.086736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943228438:3885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.086748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943228438:3885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.086751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943228438:3885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.086757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.090253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.091628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.091640Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.091641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.091644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.091647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1503 [2:7556554908867688379:9200]
2025-10-02T09:32:23.091656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.091666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.091671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.091672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.091674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.091683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.091686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.091693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.091723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.091728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.091729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.091731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.091733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.091766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.091771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.091777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.091782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.091793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.091805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.091809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.091810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.091814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.091821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228391:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.091822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.091825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.091826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.091827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228478:3885], now have 1 active actors on pipe
2025-10-02T09:32:23.091831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.091839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.091843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.091855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.091862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.091881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.091883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1503
2025-10-02T09:32:23.091893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1503
2025-10-02T09:32:23.091933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.091938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.091954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b94982-d4130221-e467f862-ef035dd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.091960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.091962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.091964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.091968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.091977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.091987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.092120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.092124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.092132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.092204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1504 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1b94982-d4130221-e467f862-ef035dd9_0
2025-10-02T09:32:23.092454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7875127e-10b787fe-aa511ee8-70546bf9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1b94982-d4130221-e467f862-ef035dd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.095148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Write session: try to update token
2025-10-02T09:32:23.095163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.100864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:23.100873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.100877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.100898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:23.100906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:23.101026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:23.101150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:23.101269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:23.101395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:23.101582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:23.101609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:23.108321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId: src_id|a1b94982-d4130221-e467f862-ef035dd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.109331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.109342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.109343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.109344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.109349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.109351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.109353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688374:9200]
2025-10-02T09:32:23.109372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.109375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.109376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.109382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.109386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.109388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.109486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.110522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.173175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943228485:3893]
2025-10-02T09:32:23.173441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1503, pipe: [1:7556554908943228485:3893]
2025-10-02T09:32:23.218166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.218451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.218460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.218474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228485:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.218637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.218670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943228485:3893]
2025-10-02T09:32:23.218693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:23.218717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.218748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1504 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1b94982-d4130221-e467f862-ef035dd9_0
2025-10-02T09:32:23.218890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1504 sessionId: src_id|a1b94982-d4130221-e467f862-ef035dd9_0 is DEAD
2025-10-02T09:32:23.219040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:23.219051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Write session will restart in 0.007273s
2025-10-02T09:32:23.219076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Write session: Do CDS request
2025-10-02T09:32:23.219082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.225256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.226847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.226943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.226949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.226955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.226979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.227004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688466:9202]
2025-10-02T09:32:23.227133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.227247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.227256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1505
2025-10-02T09:32:23.227344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.227358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.227376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.227383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.227386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.227535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.227557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.227637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1505 sessionId:  describe result for acl check
2025-10-02T09:32:23.227655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.227660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.227662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.227664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943228540:3879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.227728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.227757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.227761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.227761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.227762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.227763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.227763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.227766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.227766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.227767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.227768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.227768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.227769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.227772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.227778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.227780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.227782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.227784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.227786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.227788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.227790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.227792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.227795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.227797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.227799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.227802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.227806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.227809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.227812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.227814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.227820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.227823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.227825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.227828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.227834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.227837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.227840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.227842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.227846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.227851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.227854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.227856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.227858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.227860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.227866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.227868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.227871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.227873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.227878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.227895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.228012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943228540:3879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.229493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943228540:3879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.234188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943228540:3879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.234200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943228540:3879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.234203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943228540:3879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.234258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.235342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.236636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.236646Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.236648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.236650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.236653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1504 [2:7556554908867688466:9202]
2025-10-02T09:32:23.236660Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.236670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.236675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.236676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.236677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.236686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.236688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.236693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.236725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.236730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.236731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.236732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.236734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.236772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.236777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.236783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.236789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.236812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.236827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228489:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.236833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228577:3879], now have 1 active actors on pipe
2025-10-02T09:32:23.236836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.236837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.236839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.236845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.236856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.236865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.236868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.236869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.236872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.236874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.236882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.236884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.236889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.236875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1504
2025-10-02T09:32:23.236887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1504
2025-10-02T09:32:23.236936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.236942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.236961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.236968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.236975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.236976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.236981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.236991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.237001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.237112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.237117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.237124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.237201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1505 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0
2025-10-02T09:32:23.237451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b94982-d4130221-e467f862-ef035dd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.240051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Write session: try to update token
2025-10-02T09:32:23.240064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.245913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.245925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.245926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.245927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.245930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.245932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.245934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688461:9202]
2025-10-02T09:32:23.245952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.245957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.245958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.245958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.245961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.245963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.246065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.252756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId: src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.254844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.319076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943228584:3893]
2025-10-02T09:32:23.319291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1504, pipe: [1:7556554908943228584:3893]
2025-10-02T09:32:23.353412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.353646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.353655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.353666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228584:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.353803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.353813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:23.353823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:23.353865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1505 reason: error at write: Disconnected sessionId: src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0
2025-10-02T09:32:23.353865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.353909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943228584:3893]
2025-10-02T09:32:23.353984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1505 sessionId: src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0 is DEAD
2025-10-02T09:32:23.354118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:23.354130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Write session will restart in 0.007309s
2025-10-02T09:32:23.354150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Write session: Do CDS request
2025-10-02T09:32:23.354155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.360640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.362144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.362237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.362243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.362249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.362273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.362274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.362299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688554:9205]
2025-10-02T09:32:23.362311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.362321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1506
2025-10-02T09:32:23.362530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.362549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.362552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.362554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.362639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.362830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.362838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1506 sessionId:  describe result for acl check
2025-10-02T09:32:23.362853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.362857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.362858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.362860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.362863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943228638:3865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.363031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.363061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.363065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.363065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.363066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.363067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.363068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.363068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.363069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.363070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.363070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.363070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.363072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.363074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.363081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.363085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.363087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.363090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.363092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.363094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.363096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.363098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.363100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.363103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.363105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.363109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.363113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.363117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.363119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.363122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.363124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.363126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.363129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.363135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.363138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.363140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.363143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.363148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.363151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.363153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.363156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.363160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.363163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.363168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.363172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.363175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.363178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.363180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.363183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.363204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.363200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943228638:3865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.364614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943228638:3865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.368568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943228638:3865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.368580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943228638:3865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.368583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943228638:3865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.368588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.370655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.371998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.372009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.372010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.372013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.372016Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1505 [2:7556554908867688554:9205]
2025-10-02T09:32:23.372024Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.372035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.372040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.372041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.372042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.372051Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.372057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.372062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.372093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.372097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.372099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.372101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.372102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.372141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.372146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.372152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.372157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.372168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.372183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228675:3865], now have 1 active actors on pipe
2025-10-02T09:32:23.372189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228586:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.372192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.372194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.372195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.372203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.372213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.372216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.372217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.372218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.372223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.372225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.372238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.372243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.372247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.372229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1505
2025-10-02T09:32:23.372243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1505
2025-10-02T09:32:23.372258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.372264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.372285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.372292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.372294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.372298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.372303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.372311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.372326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.372455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.372460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.372468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.372539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1506 partition: 0 MaxSeqNo: 36 sessionId: src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0
2025-10-02T09:32:23.372737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a799e1-57b45c11-6454407e-ffb4a74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.375127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Write session: try to update token
2025-10-02T09:32:23.375139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.381461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.381476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.381478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.381479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.381485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.381487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.381489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688549:9205]
2025-10-02T09:32:23.381509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.381512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.381513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.381520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.381524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.381527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.381641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.386766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId: src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.388816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.454247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943228682:3893]
2025-10-02T09:32:23.454453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1505, pipe: [1:7556554908943228682:3893]
2025-10-02T09:32:23.489119Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.489341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.489350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.489361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228682:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.489498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.489547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:23.489558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:23.489593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943228682:3893]
2025-10-02T09:32:23.489602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1506 reason: error at write: Disconnected sessionId: src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0
2025-10-02T09:32:23.489628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.489721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1506 sessionId: src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0 is DEAD
2025-10-02T09:32:23.489882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:23.489893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Write session will restart in 0.009802s
2025-10-02T09:32:23.489914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Write session: Do CDS request
2025-10-02T09:32:23.489920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.496605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.498296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.498417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.498424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.498432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.498462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.498487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688643:9207]
2025-10-02T09:32:23.498835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.499026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.499049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.499223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.499252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.499256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.499257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.499257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.499258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.499258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.499259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.499260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.499260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.499261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.499262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.499263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.499266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.499272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.499274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.499276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.499278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.499280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.499282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.499284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.499286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.499288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.499290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.499291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.499295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.499299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.499302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.499305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.499307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.499309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.499311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.499314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.499317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.499319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.499322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.499324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.499326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.499329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.499331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.499334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.499337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.499340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.499342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.499345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.499347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.499349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.499355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.499358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.499376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.501244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.501278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.501291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1507
2025-10-02T09:32:23.501468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.501488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.501495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.501497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.501776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1507 sessionId:  describe result for acl check
2025-10-02T09:32:23.501797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.501804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.501805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.501808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943228739:3868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.502157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943228739:3868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.503955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943228739:3868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.506264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943228739:3868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.506275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943228739:3868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.506277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943228739:3868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.506283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.506727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.508026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.508037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.508038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.508040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.508044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1506 [2:7556554908867688643:9207]
2025-10-02T09:32:23.508051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.508061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.508067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.508068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.508069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.508078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.508081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.508085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.508115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.508120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.508122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.508124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.508125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.508160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.508165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.508172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.508177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.508185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.508199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228773:3868], now have 1 active actors on pipe
2025-10-02T09:32:23.508204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228683:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.508208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.508209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.508211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.508218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.508229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.508231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.508233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.508235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.508240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.508241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.508235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1506
2025-10-02T09:32:23.508241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1506
2025-10-02T09:32:23.508255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.508260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.508262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.508272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.508277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.508302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.508309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.508311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.508313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.508318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.508326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.508336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.508433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.508437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.508445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.508503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1507 partition: 0 MaxSeqNo: 36 sessionId: src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0
2025-10-02T09:32:23.508693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43033eb-c1720043-1ea1bf14-d8c7db18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.510838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Write session: try to update token
2025-10-02T09:32:23.510849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.517455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.517469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.517472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.517473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.517477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.517480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.517482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688638:9207]
2025-10-02T09:32:23.517503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.517509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.517509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.517511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.517512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.517514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.517618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.523091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId: src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.525188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.589929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943228781:3893]
2025-10-02T09:32:23.590133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1506, pipe: [1:7556554908943228781:3893]
2025-10-02T09:32:23.626863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.627104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.627112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.627124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228781:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.627253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.627312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:23.627323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:23.627372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1507 reason: error at write: Disconnected sessionId: src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0
2025-10-02T09:32:23.627371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943228781:3893]
2025-10-02T09:32:23.627394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.627499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1507 sessionId: src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0 is DEAD
2025-10-02T09:32:23.627628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:23.627637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Write session will restart in 0.009211s
2025-10-02T09:32:23.627669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Write session: Do CDS request
2025-10-02T09:32:23.627674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.634142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.635531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.635638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.635644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.635650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.635677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.635701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688733:9209]
2025-10-02T09:32:23.636144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.636334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.636355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.636528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.636558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.636562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.636563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.636563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.636564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.636564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.636565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.636566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.636566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.636568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.636569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.636569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.636572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.636579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.636580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.636582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.636584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.636586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.636588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.636590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.636592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.636594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.636596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.636598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.636602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.636605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.636608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.636611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.636613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.636616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.636618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.636620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.636623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.636625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.636627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.636630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.636632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.636634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.636636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.636639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.636642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.636644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.636647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.636650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.636652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.636654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.636656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.636659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.636676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.638213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.638295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.638304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1508
2025-10-02T09:32:23.638410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.638430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.638435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.638438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.638780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1508 sessionId:  describe result for acl check
2025-10-02T09:32:23.638832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.638839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.638841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.638845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943228838:3861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.639293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943228838:3861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.641195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943228838:3861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.643609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943228838:3861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.643621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943228838:3861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.643624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943228838:3861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.643629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.644076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.645433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.645445Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.645446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.645448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.645451Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1507 [2:7556554908867688733:9209]
2025-10-02T09:32:23.645486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.645499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.645502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.645503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.645504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.645515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.645522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.645527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.645560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.645564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.645565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.645567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.645568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.645604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.645609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.645615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.645620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.645628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.645643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228782:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.645648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228873:3861], now have 1 active actors on pipe
2025-10-02T09:32:23.645652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.645653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.645654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.645661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.645672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.645675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.645678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.645679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.645681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.645683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.645696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.645701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.645705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.645696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1507
2025-10-02T09:32:23.645737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1507
2025-10-02T09:32:23.645775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.645781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.645795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.645802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.645806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.645807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.645812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.645819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.645830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.645963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.645968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.645975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.646040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1508 partition: 0 MaxSeqNo: 36 sessionId: src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0
2025-10-02T09:32:23.646273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad24a69-82fc7035-ce633fe7-67521dcc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.649056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Write session: try to update token
2025-10-02T09:32:23.649071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.654820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.654831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.654832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.654833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.654837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.654840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.654842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688728:9209]
2025-10-02T09:32:23.654861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.654863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.654863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.654864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.654866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.654868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.654969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.662224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId: src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.664347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.727646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943228881:3893]
2025-10-02T09:32:23.727822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1507, pipe: [1:7556554908943228881:3893]
2025-10-02T09:32:23.763381Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.763617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.763625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.763637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228881:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.763781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.763795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943228881:3893]
2025-10-02T09:32:23.763818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:23.763837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.763865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1508 reason: status is not ok: tablet will be restarted right now sessionId: src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0
2025-10-02T09:32:23.763988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1508 sessionId: src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0 is DEAD
2025-10-02T09:32:23.764139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:23.764151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Write session will restart in 0.009248s
2025-10-02T09:32:23.764169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Write session: Do CDS request
2025-10-02T09:32:23.764176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.770252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.771594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.771689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.771695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.771701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.771724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.771749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688836:9212]
2025-10-02T09:32:23.772082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.772266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.772287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.772459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.772486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.772489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.772491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.772492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.772492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.772493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.772493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.772494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.772494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.772495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.772495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.772496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.772499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.772506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.772508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.772510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.772512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.772514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.772516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.772518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.772520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.772522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.772524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.772526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.772529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.772533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.772536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.772539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.772542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.772545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.772548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.772550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.772552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.772556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.772558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.772561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.772563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.772565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.772567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.772570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.772575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.772579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.772581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.772583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.772585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.772588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.772590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.772592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.772610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.774155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.774260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.774270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1509
2025-10-02T09:32:23.774375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.774395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.774401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.774403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.774751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1509 sessionId:  describe result for acl check
2025-10-02T09:32:23.774797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.774804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.774808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.774813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943228939:3857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.775299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943228939:3857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.776675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943228939:3857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.779481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943228939:3857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.779493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943228939:3857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.779495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943228939:3857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.779499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.779960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.781329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.781340Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.781341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.781343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.781347Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1508 [2:7556554908867688836:9212]
2025-10-02T09:32:23.781353Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.781363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.781365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.781367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.781368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.781376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.781382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.781386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.781417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.781422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.781423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.781425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.781426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.781460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.781465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.781471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.781477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.781486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.781500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228974:3857], now have 1 active actors on pipe
2025-10-02T09:32:23.781506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943228882:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.781509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.781510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.781512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.781519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.781527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.781535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.781539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.781542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.781545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.781547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.781538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1508
2025-10-02T09:32:23.781548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1508
2025-10-02T09:32:23.781570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.781576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.781578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.781594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.781598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.781616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.781622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.781626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.781628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.781632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.781641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.781655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.781746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.781751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.781758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.781812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1509 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0
2025-10-02T09:32:23.782040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b1c1e-89c727ba-24a48ca8-eae04846_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.784714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Write session: try to update token
2025-10-02T09:32:23.784726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.790529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.790541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.790542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.790543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.790546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.790548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.790550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688831:9212]
2025-10-02T09:32:23.790568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.790571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.790572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.790579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.790590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.790593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.790768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.797616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId: src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.799748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:23.863828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554908943229011:3893]
2025-10-02T09:32:23.863980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1508, pipe: [1:7556554908943229011:3893]
2025-10-02T09:32:23.899907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:23.900108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.900116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.900128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943229011:3893], now have 1 active actors on pipe
2025-10-02T09:32:23.900269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:23.900286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:23.900298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:23.900321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:23.900340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1509 reason: error at write: Disconnected sessionId: src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0
2025-10-02T09:32:23.900370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554908943229011:3893]
2025-10-02T09:32:23.900485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1509 sessionId: src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0 is DEAD
2025-10-02T09:32:23.900641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:23.900653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Write session will restart in 0.006509s
2025-10-02T09:32:23.900672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Write session: Do CDS request
2025-10-02T09:32:23.900678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:23.906418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:23.907697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:23.907795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:23.907802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:23.907807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:23.907831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:23.907866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554908867688964:9226]
2025-10-02T09:32:23.908163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.908226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:23.908261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:23.908271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1510
2025-10-02T09:32:23.908412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:23.908426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:23.908432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:23.908438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:23.908440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:23.908449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:23.908624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:23.908651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.908655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.908656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.908656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.908657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.908658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.908658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.908659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.908659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.908660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.908660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.908662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.908665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.908672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.908674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.908676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.908678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.908680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.908682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.908684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.908686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.908688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.908690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.908692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.908695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.908699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:23.908702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.908705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:23.908707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.908710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:23.908712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.908715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:23.908720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.908722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:23.908724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.908727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:23.908729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.908733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:23.908722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1510 sessionId:  describe result for acl check
2025-10-02T09:32:23.908735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.908738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:23.908741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.908747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:23.908741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:23.908749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.908745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:23.908747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:23.908752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.908754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.908757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.908750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554908943229081:3840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:23.908759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.908762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.908779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:23.909096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554908943229081:3840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:23.910330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554908943229081:3840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:23.915505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554908943229081:3840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:23.915521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554908943229081:3840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:23.915524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554908943229081:3840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:23.915530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:23.916192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:23.917544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:23.917556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:23.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:23.917559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:23.917563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1509 [2:7556554908867688964:9226]
2025-10-02T09:32:23.917570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:23.917579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:23.917585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.917586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.917587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.917596Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:23.917603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:23.917607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:23.917641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.917646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.917648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.917650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:23.917651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:23.917690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:23.917695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.917702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:23.917707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:23.917719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:23.917734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943229118:3840], now have 1 active actors on pipe
2025-10-02T09:32:23.917740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554908943229025:2446], now have 1 active actors on pipe
2025-10-02T09:32:23.917744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.917747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.917748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.917757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:23.917766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:23.917777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:23.917776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:23.917779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:23.917780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:23.917781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:23.917795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.917777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1509
2025-10-02T09:32:23.917799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:23.917802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:23.917790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1509
2025-10-02T09:32:23.917815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.917820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.917840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:23.917846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:23.917849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:23.917850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:23.917855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:23.917863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:23.917879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.917998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:23.918002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:23.918011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:23.918079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1510 partition: 0 MaxSeqNo: 36 sessionId: src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0
2025-10-02T09:32:23.918343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba090d9-6bb2bda-ea8b48ab-67f2c0c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:23.921054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Write session: try to update token
2025-10-02T09:32:23.921068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:23.926995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:23.927008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:23.927009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:23.927011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:23.927015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.927016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.927018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554908867688959:9226]
2025-10-02T09:32:23.927037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:23.927042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:23.927043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:23.927047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:23.927050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:23.927053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:23.927157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:23.933941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId: src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:23.936046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.000555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238196421:3893]
2025-10-02T09:32:24.000722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1509, pipe: [1:7556554913238196421:3893]
2025-10-02T09:32:24.035621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.035893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.035901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.035913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196421:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.036053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.036070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:24.036078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:24.036120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1510 reason: error at write: Disconnected sessionId: src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0
2025-10-02T09:32:24.036141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.036208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238196421:3893]
2025-10-02T09:32:24.036233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1510 sessionId: src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0 is DEAD
2025-10-02T09:32:24.036353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:24.036367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Write session will restart in 0.009190s
2025-10-02T09:32:24.036392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Write session: Do CDS request
2025-10-02T09:32:24.036397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.042110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.043503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.043601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.043607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.043613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.043638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.043676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656353:9229]
2025-10-02T09:32:24.044020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.044202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.044226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.044403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.044432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.044436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.044437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.044437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.044438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.044438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.044439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.044439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.044440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.044440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.044441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.044442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.044444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.044451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.044453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.044455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.044459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.044461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.044463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.044465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.044467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.044469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.044471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.044473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.044477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.044480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.044483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.044486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.044488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.044491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.044493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.044496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.044498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.044501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.044503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.044506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.044508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.044510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.044512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.044515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.044517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.044520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.044522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.044525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.044532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.044535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.044540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.044543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.044560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.046177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.046312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.046324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1511
2025-10-02T09:32:24.046452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.046472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.046478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.046481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.046845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1511 sessionId:  describe result for acl check
2025-10-02T09:32:24.046885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.046892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.046893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.046898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238196482:3830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.047433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238196482:3830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.049188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238196482:3830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.051377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238196482:3830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.051389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238196482:3830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.051392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238196482:3830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.051397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.051890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.053267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.053278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.053280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.053282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.053286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1510 [2:7556554913162656353:9229]
2025-10-02T09:32:24.053293Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.053301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.053306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.053308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.053309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.053317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.053323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.053328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.053361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.053366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.053367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.053369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.053370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.053404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.053408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.053414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.053419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.053430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.053444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196423:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.053449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196517:3830], now have 1 active actors on pipe
2025-10-02T09:32:24.053453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.053454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.053455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.053462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.053472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.053479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.053483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.053484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.053488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.053490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.053498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.053505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.053514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.053503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1510
2025-10-02T09:32:24.053504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1510
2025-10-02T09:32:24.053531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.053536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.053550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.053557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.053560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.053564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.053569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.053577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.053586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.053692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.053696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.053704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.053765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1511 partition: 0 MaxSeqNo: 36 sessionId: src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0
2025-10-02T09:32:24.053990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fefe23-ee76b8f9-8572f275-3270c5ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.056615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Write session: try to update token
2025-10-02T09:32:24.056626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.062466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.062476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.062477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.062478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.062481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.062483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.062487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656348:9229]
2025-10-02T09:32:24.062506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.062512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.062513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.062515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.062519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.062522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.062619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.070887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId: src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.072958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.136208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238196524:3893]
2025-10-02T09:32:24.136359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1510, pipe: [1:7556554913238196524:3893]
2025-10-02T09:32:24.169994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.170210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.170219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.170230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196524:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.170358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.170386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.170422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238196524:3893]
2025-10-02T09:32:24.170448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:24.170586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0
2025-10-02T09:32:24.170746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1511 sessionId: src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0 is DEAD
2025-10-02T09:32:24.171035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:24.171051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Write session will restart in 0.008971s
2025-10-02T09:32:24.171072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Write session: Do CDS request
2025-10-02T09:32:24.171078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.176869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.178215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.178309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.178315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.178320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.178345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.178371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656447:9231]
2025-10-02T09:32:24.178709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.178893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.178915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.179090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.179121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.179125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.179125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.179126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.179126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.179127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.179128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.179128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.179129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.179129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.179130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.179130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.179134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.179141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.179143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.179147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.179149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.179151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.179153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.179155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.179157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.179159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.179161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.179165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.179170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.179173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.179176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.179178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.179181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.179183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.179186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.179188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.179191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.179193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.179199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.179201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.179204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.179209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.179212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.179214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.179220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.179222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.179224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.179229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.179232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.179234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.179237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.179256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.181168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.181289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.181303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1512
2025-10-02T09:32:24.181420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.181439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.181445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.181448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.181806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1512 sessionId:  describe result for acl check
2025-10-02T09:32:24.181845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.181852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.181853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.181858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238196587:3827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.182293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238196587:3827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.183796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238196587:3827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.186100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238196587:3827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.186114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238196587:3827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.186116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238196587:3827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.186121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.186577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.187968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.187980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.187981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.187983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.187987Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1511 [2:7556554913162656447:9231]
2025-10-02T09:32:24.187993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.188001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.188006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.188008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.188009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.188018Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.188021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.188027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.188058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.188063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.188064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.188066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.188067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.188128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.188133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.188140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.188145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.188154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.188168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196525:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.188173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196621:3827], now have 1 active actors on pipe
2025-10-02T09:32:24.188177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.188180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.188182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.188190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.188200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.188206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.188209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.188192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1511
2025-10-02T09:32:24.188210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.188211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.188208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1511
2025-10-02T09:32:24.188212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.188225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.188230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.188237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.188242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.188244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.188264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.188271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.188273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.188274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.188280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.188288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.188299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.188400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.188405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.188413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.188471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1512 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0
2025-10-02T09:32:24.188694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78866b7-7cf41c22-45f6d03a-2709058f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.191343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Write session: try to update token
2025-10-02T09:32:24.191358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.197428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.197440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.197441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.197442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.197446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.197448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.197450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656442:9231]
2025-10-02T09:32:24.197469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.197474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.197475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.197478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.197481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.197483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.197583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.203958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId: src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.206074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.270353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238196630:3893]
2025-10-02T09:32:24.270504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1511, pipe: [1:7556554913238196630:3893]
2025-10-02T09:32:24.306011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.306288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.306301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.306314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196630:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.306458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238196630:3893]
2025-10-02T09:32:24.306474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.306530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:24.306551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:24.306620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1512 reason: error at write: Disconnected sessionId: src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0
2025-10-02T09:32:24.306773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1512 sessionId: src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0 is DEAD
2025-10-02T09:32:24.306821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.307114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:24.307128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Write session will restart in 0.008302s
2025-10-02T09:32:24.307149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Write session: Do CDS request
2025-10-02T09:32:24.307154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.312295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.313552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.313649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.313655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.313660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.313685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.313711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656544:9234]
2025-10-02T09:32:24.314049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.314228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.314250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.314424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.314453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.314458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.314458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.314459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.314459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.314460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.314460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.314461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.314462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.314462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.314463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.314463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.314466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.314473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.314475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.314477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.314479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.314481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.314483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.314485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.314487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.314489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.314491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.314493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.314497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.314500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.314503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.314507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.314510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.314512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.314514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.314516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.314519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.314522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.314523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.314526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.314528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.314531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.314533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.314536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.314538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.314540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.314542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.314545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.314548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.314554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.314556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.314559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.314576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.316064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.316180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.316192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1513
2025-10-02T09:32:24.316295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.316314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.316319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.316322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.316639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1513 sessionId:  describe result for acl check
2025-10-02T09:32:24.316674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.316680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.316682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.316686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238196692:3820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.317150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238196692:3820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.318475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238196692:3820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.321433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238196692:3820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.321445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238196692:3820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.321447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238196692:3820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.321452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.321927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.323265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.323276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.323277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.323279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.323283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1512 [2:7556554913162656544:9234]
2025-10-02T09:32:24.323290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.323300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.323304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.323306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.323308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.323316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.323320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.323324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.323352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.323356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.323357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.323359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.323360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.323418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.323423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.323429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.323435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.323447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.323461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196727:3820], now have 1 active actors on pipe
2025-10-02T09:32:24.323465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196631:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.323469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.323470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.323471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.323466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1512
2025-10-02T09:32:24.323478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.323473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1512
2025-10-02T09:32:24.323489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.323493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.323495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.323497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.323500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.323502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.323522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.323527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.323536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.323544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.323562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.323563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.323569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.323571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.323572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.323577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.323582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.323596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.323696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.323701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.323709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.323763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1513 partition: 0 MaxSeqNo: 36 sessionId: src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0
2025-10-02T09:32:24.324029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3012ae8-ce24ab69-45d81672-fbbeec9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.326800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Write session: try to update token
2025-10-02T09:32:24.326814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.332542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.332552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.332553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.332555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.332558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.332560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.332562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656539:9234]
2025-10-02T09:32:24.332580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.332583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.332585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.332591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.332602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.332605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.332689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.339600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId: src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.341717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.406563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238196735:3893]
2025-10-02T09:32:24.406695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1512, pipe: [1:7556554913238196735:3893]
2025-10-02T09:32:24.440126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.440336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.440344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.440356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196735:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.440492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:24.440498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:24.440543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1513 reason: error at write: Disconnected sessionId: src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0
2025-10-02T09:32:24.440572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238196735:3893]
2025-10-02T09:32:24.440617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.440681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1513 sessionId: src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0 is DEAD
2025-10-02T09:32:24.440732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.440928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:24.440942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Write session will restart in 0.005687s
2025-10-02T09:32:24.440966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Write session: Do CDS request
2025-10-02T09:32:24.440972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.446656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.447930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.448027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.448033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.448039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.448063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.448089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656640:9236]
2025-10-02T09:32:24.448185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.448280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.448291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1514
2025-10-02T09:32:24.448406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.448424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.448430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.448433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.448521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.448703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.448738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.448767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1514 sessionId:  describe result for acl check
2025-10-02T09:32:24.448826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.448835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.448837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.448843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238196796:3811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.448945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.448980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.448984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.448984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.448985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.448986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.448986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.448987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.448987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.448988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.448988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.448989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.448989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.448992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.448999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.449001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.449003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.449005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.449007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.449009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.449011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.449013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.449016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.449018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.449020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.449024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.449028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.449032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.449035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.449038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.449044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.449046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.449049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.449051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.449054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.449056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.449059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.449063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.449066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.449068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.449070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.449073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.449078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.449080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.449083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.449087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.449090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.449092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.449094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.449112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.449293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238196796:3811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.451061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238196796:3811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.455995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238196796:3811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.456008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238196796:3811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.456010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238196796:3811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.456016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.456431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.457844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.457857Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.457858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.457860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.457863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1513 [2:7556554913162656640:9236]
2025-10-02T09:32:24.457871Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.457880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.457886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.457887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.457888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.457898Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.457900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.457907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.457940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.457944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.457945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.457946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.457948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.457984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.457988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.457995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.458000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.458011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.458025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196833:3811], now have 1 active actors on pipe
2025-10-02T09:32:24.458030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196736:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.458033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.458035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.458036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.458044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.458055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.458057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.458059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.458060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.458065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.458067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.458080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.458086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.458090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.458088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1513
2025-10-02T09:32:24.458091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1513
2025-10-02T09:32:24.458119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.458124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.458139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|562530ad-35fc898-c21db7f7-170b42b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.458145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.458148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.458149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.458153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.458162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.458172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.458255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.458260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.458267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.458312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1514 partition: 0 MaxSeqNo: 36 sessionId: src_id|562530ad-35fc898-c21db7f7-170b42b4_0
2025-10-02T09:32:24.458548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd2b349-5acbbb81-abee071d-3175cbde_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|562530ad-35fc898-c21db7f7-170b42b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.461166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Write session: try to update token
2025-10-02T09:32:24.461179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.467037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:24.467049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.467052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.467072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:24.467077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:24.467313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:24.467475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:24.467590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:24.467700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:24.467844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:24.467868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:24.474397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId: src_id|562530ad-35fc898-c21db7f7-170b42b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.475461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.475472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.475473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.475474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.475479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.475482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.475485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656635:9236]
2025-10-02T09:32:24.475502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.475507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.475507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.475508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.475510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.475512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.475613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.476643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.540710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238196841:3893]
2025-10-02T09:32:24.540900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1513, pipe: [1:7556554913238196841:3893]
2025-10-02T09:32:24.584238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.584450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.584458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.584470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196841:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.584614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.584654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:24.584666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:24.584710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1514 reason: error at write: Disconnected sessionId: src_id|562530ad-35fc898-c21db7f7-170b42b4_0
2025-10-02T09:32:24.584713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.584771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238196841:3893]
2025-10-02T09:32:24.584855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1514 sessionId: src_id|562530ad-35fc898-c21db7f7-170b42b4_0 is DEAD
2025-10-02T09:32:24.585011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:24.585026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Write session will restart in 0.008078s
2025-10-02T09:32:24.585048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Write session: Do CDS request
2025-10-02T09:32:24.585054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.591054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.592392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.592512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.592519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.592525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.592555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.592578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656737:9238]
2025-10-02T09:32:24.592955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.593137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.593166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.593340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.593370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.593374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.593375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.593376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.593376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.593377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.593377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.593378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.593379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.593379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.593380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.593380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.593384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.593396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.593399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.593403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.593407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.593410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.593412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.593414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.593416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.593419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.593421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.593423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.593427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.593430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.593433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.593436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.593438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.593441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.593442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.593445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.593447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.593450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.593452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.593454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.593456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.593459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.593461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.593463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.593468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.593470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.593472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.593475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.593478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.593485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.593487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.593490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.593507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.594169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.594298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.594309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1515
2025-10-02T09:32:24.594412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.594430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.594436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.594440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.594870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1515 sessionId:  describe result for acl check
2025-10-02T09:32:24.594917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.594926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.594927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.594932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238196905:3802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.595460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238196905:3802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.597020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238196905:3802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.600454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238196905:3802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.600466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238196905:3802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.600469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238196905:3802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.600473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.601036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.602435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.602447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.602449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.602451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.602454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1514 [2:7556554913162656737:9238]
2025-10-02T09:32:24.602462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.602472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.602477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.602479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.602480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.602489Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.602494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.602497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.602530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.602534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.602535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.602537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.602538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.602574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.602578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.602584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.602589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.602598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.602618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196940:3802], now have 1 active actors on pipe
2025-10-02T09:32:24.602625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196842:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.602629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.602634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.602634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.602642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.602652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.602658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.602648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1514
2025-10-02T09:32:24.602660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.602663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1514
2025-10-02T09:32:24.602662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.602662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.602664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.602679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.602685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.602687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.602694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.602699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.602723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.602730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.602732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.602733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.602737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.602746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.602761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.602892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.602898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.602906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.602964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1515 partition: 0 MaxSeqNo: 36 sessionId: src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0
2025-10-02T09:32:24.603206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|562530ad-35fc898-c21db7f7-170b42b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.605985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Write session: try to update token
2025-10-02T09:32:24.605997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.611785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.611798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.611799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.611800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.611803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.611805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.611807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656732:9238]
2025-10-02T09:32:24.611831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.611832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.611837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.611839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.611838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.611840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.611944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.619403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId: src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.621493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.685079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238196948:3893]
2025-10-02T09:32:24.685261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1514, pipe: [1:7556554913238196948:3893]
2025-10-02T09:32:24.724083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.724342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.724355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.724368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196948:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.724511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.724551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:24.724557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:24.724569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238196948:3893]
2025-10-02T09:32:24.724607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1515 reason: error at write: Disconnected sessionId: src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0
2025-10-02T09:32:24.724743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1515 sessionId: src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0 is DEAD
2025-10-02T09:32:24.724888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:24.724887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.724904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Write session will restart in 0.006914s
2025-10-02T09:32:24.724936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Write session: Do CDS request
2025-10-02T09:32:24.724942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.730672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.731898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.731993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.731999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.732005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.732030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.732053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656835:9240]
2025-10-02T09:32:24.732659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.732834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.732859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.733036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.733066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.733070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.733071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.733071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.733072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.733072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.733073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.733073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.733074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.733074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.733075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.733075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.733078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.733085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.733087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.733089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.733091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.733093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.733095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.733097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.733099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.733101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.733103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.733105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.733109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.733113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.733116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.733119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.733121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.733124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.733126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.733129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.733131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.733133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.733135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.733139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.733144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.733147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.733149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.733151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.733156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.733158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.733160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.733163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.733167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.733170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.733172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.733175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.733193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.733222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.733357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.733369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1516
2025-10-02T09:32:24.733477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.733496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.733502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.733504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.733890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1516 sessionId:  describe result for acl check
2025-10-02T09:32:24.733937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.733944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.733946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.733950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238197013:3799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.734398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238197013:3799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.735742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238197013:3799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.740162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238197013:3799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.740176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238197013:3799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.740179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238197013:3799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.740188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.740592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.742017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.742028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.742029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.742031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.742036Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1515 [2:7556554913162656835:9240]
2025-10-02T09:32:24.742043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.742052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.742057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.742058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.742059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.742067Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.742071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.742074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.742103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.742107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.742108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.742110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.742111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.742154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.742159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.742165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.742172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.742183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.742197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238197048:3799], now have 1 active actors on pipe
2025-10-02T09:32:24.742202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238196949:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.742205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.742206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.742207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.742215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.742212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1515
2025-10-02T09:32:24.742225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.742227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.742228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.742229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.742236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.742238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.742239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1515
2025-10-02T09:32:24.742259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.742263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.742272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.742279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.742284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.742295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.742302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.742304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.742308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.742313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.742317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.742332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.742422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.742427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.742435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.742488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1516 partition: 0 MaxSeqNo: 36 sessionId: src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0
2025-10-02T09:32:24.742712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ccf824-42c5a4d9-c5ade315-12b7fde9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.745360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Write session: try to update token
2025-10-02T09:32:24.745373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.751683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.751691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.751692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.751694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.751698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.751701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.751703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656830:9240]
2025-10-02T09:32:24.751721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.751724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.751726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.751727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.751730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.751732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.751899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.758227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId: src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.760366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.824848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238197060:3893]
2025-10-02T09:32:24.825043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1515, pipe: [1:7556554913238197060:3893]
2025-10-02T09:32:24.864642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:24.864888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.864897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.864908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238197060:3893], now have 1 active actors on pipe
2025-10-02T09:32:24.865007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:24.865037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238197060:3893]
2025-10-02T09:32:24.865059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:24.865061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:24.865102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1516 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0
2025-10-02T09:32:24.865237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1516 sessionId: src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0 is DEAD
2025-10-02T09:32:24.865407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:24.865421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Write session will restart in 0.005774s
2025-10-02T09:32:24.865444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Write session: Do CDS request
2025-10-02T09:32:24.865450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:24.870861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:24.872089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:24.872161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.872192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:24.872198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:24.872204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:24.872229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:24.872252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554913162656981:9255]
2025-10-02T09:32:24.872329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:24.872339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1517
2025-10-02T09:32:24.872446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:24.872463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:24.872469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:24.872471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:24.872610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:24.872776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:24.872824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:24.872819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1517 sessionId:  describe result for acl check
2025-10-02T09:32:24.872864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:24.872872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:24.872874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:24.872881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554913238197162:3774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:24.873039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:24.873073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.873077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.873077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.873078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.873078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.873079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.873079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.873080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.873081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.873081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.873082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.873082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.873085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.873093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.873095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.873097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.873099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.873101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.873103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.873105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.873107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.873109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.873111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.873113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.873116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.873120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:24.873124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.873126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:24.873128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.873131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:24.873134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.873136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:24.873139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.873141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:24.873143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.873146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:24.873148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.873150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:24.873152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.873154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:24.873157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.873160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:24.873166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.873168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.873172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.873174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.873176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.873179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.873181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554913238197162:3774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:24.873198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:24.874282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554913238197162:3774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:24.878995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554913238197162:3774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:24.879010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554913238197162:3774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:24.879012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554913238197162:3774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:24.879017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:24.880481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:24.881893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:24.881903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:24.881904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:24.881906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:24.881910Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1516 [2:7556554913162656981:9255]
2025-10-02T09:32:24.881916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:24.881926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:24.881928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.881929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.881931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.881939Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:24.881945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:24.881949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:24.881978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.881982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.881984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.881985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:24.881988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:24.882023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:24.882027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.882034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:24.882040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:24.882051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:24.882065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238197087:2446], now have 1 active actors on pipe
2025-10-02T09:32:24.882070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238197195:3774], now have 1 active actors on pipe
2025-10-02T09:32:24.882074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.882075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.882077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.882084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:24.882092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:24.882097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:24.882099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:24.882100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:24.882102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:24.882104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:24.882097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1516
2025-10-02T09:32:24.882111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1516
2025-10-02T09:32:24.882117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.882121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:24.882123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:24.882138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.882142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.882160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:24.882167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:24.882168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:24.882169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:24.882175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:24.882183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:24.882197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.882301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:24.882306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:24.882314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:24.882367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1517 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0
2025-10-02T09:32:24.882620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e582ec1a-520756f7-3191a3e6-4a70dfa1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:24.885195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Write session: try to update token
2025-10-02T09:32:24.885211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:24.891191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:24.891204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:24.891206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:24.891206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:24.891213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.891215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.891218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554913162656976:9255]
2025-10-02T09:32:24.891237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:24.891240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:24.891241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:24.891243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:24.891246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:24.891248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:24.891345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:24.896513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId: src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:24.898404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:24.965156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554913238197205:3893]
2025-10-02T09:32:24.965347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1516, pipe: [1:7556554913238197205:3893]
2025-10-02T09:32:25.004502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.004737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.004746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.004771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554913238197205:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.004915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.004909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554913238197205:3893]
2025-10-02T09:32:25.004933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:25.004935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:25.004980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1517 reason: error at write: Disconnected sessionId: src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0
2025-10-02T09:32:25.004982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.005107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1517 sessionId: src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0 is DEAD
2025-10-02T09:32:25.005227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:25.005238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Write session will restart in 0.008642s
2025-10-02T09:32:25.005254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Write session: Do CDS request
2025-10-02T09:32:25.005258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.011944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.013320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.013427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.013433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.013438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.013464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.013488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457624379:9258]
2025-10-02T09:32:25.013835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.014030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.014053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.014230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.014258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.014262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.014263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.014263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.014264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.014264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.014265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.014265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.014266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.014266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.014267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.014267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.014270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.014276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.014278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.014280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.014282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.014284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.014286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.014288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.014290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.014292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.014294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.014296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.014300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.014305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.014308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.014311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.014313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.014315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.014321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.014324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.014327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.014333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.014335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.014337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.014340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.014342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.014347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.014350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.014352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.014355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.014357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.014360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.014365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.014368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.014370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.014373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.014393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.015210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.015289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.015300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1518
2025-10-02T09:32:25.015405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.015424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.015430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.015433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.015793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1518 sessionId:  describe result for acl check
2025-10-02T09:32:25.015836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.015847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.015850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.015855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533164569:3769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.016273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533164569:3769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.017948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533164569:3769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.021331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533164569:3769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.021346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533164569:3769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.021379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533164569:3769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.021393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.021796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.023147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.023157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.023157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.023160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.023163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1517 [2:7556554917457624379:9258]
2025-10-02T09:32:25.023170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.023179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.023184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.023186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.023187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.023195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.023201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.023204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.023235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.023240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.023241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.023243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.023244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.023279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.023283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.023289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.023294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.023303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.023319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164603:3769], now have 1 active actors on pipe
2025-10-02T09:32:25.023324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164502:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.023327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.023329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.023330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.023335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.023345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.023349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.023351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.023352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.023355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.023357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.023371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.023375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.023361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1517
2025-10-02T09:32:25.023379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.023370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1517
2025-10-02T09:32:25.023393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.023399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.023417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.023423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.023427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.023429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.023434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.023441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.023450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.023556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.023561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.023569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.023651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1518 partition: 0 MaxSeqNo: 36 sessionId: src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0
2025-10-02T09:32:25.023865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b8a27-a0a2a2a1-a47cef62-a394d935_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.026667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Write session: try to update token
2025-10-02T09:32:25.026684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.032483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.032493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.032494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.032495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.032499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.032501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.032503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457624374:9258]
2025-10-02T09:32:25.032521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.032523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.032526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.032525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.032528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.032530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.032649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.039269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId: src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.041238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.104940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533164610:3893]
2025-10-02T09:32:25.105183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1517, pipe: [1:7556554917533164610:3893]
2025-10-02T09:32:25.145480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.145694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.145703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.145715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164610:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.145855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.145918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:25.145931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:25.145961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.145985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1518 reason: error at write: Disconnected sessionId: src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0
2025-10-02T09:32:25.146022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533164610:3893]
2025-10-02T09:32:25.146161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1518 sessionId: src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0 is DEAD
2025-10-02T09:32:25.146287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:25.146301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Write session will restart in 0.008733s
2025-10-02T09:32:25.146326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Write session: Do CDS request
2025-10-02T09:32:25.146332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.153264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.154941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.155037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.155044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.155049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.155074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.155100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457624479:9260]
2025-10-02T09:32:25.155443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.155628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.155650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.155827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.155854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.155858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.155859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.155859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.155860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.155860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.155860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.155861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.155861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.155862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.155862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.155863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.155866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.155872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.155874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.155877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.155879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.155881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.155883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.155885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.155887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.155889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.155891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.155893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.155897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.155901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.155904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.155907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.155909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.155912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.155914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.155917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.155919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.155922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.155925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.155928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.155930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.155933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.155935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.155938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.155942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.155945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.155947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.155950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.155952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.155955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.155960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.155963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.155980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.156173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.156269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.156279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1519
2025-10-02T09:32:25.156397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.156415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.156421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.156425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.156695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1519 sessionId:  describe result for acl check
2025-10-02T09:32:25.156714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.156717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.156718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.156721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533164678:3762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.157077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533164678:3762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.158658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533164678:3762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.163151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533164678:3762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.163166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533164678:3762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.163169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533164678:3762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.163174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.163590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.164994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.165004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.165005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.165008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.165011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1518 [2:7556554917457624479:9260]
2025-10-02T09:32:25.165020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.165030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.165031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.165033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.165034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.165043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.165050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.165055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.165121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.165126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.165127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.165129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.165130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.165168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.165172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.165179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.165184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.165196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.165210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164611:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.165215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164713:3762], now have 1 active actors on pipe
2025-10-02T09:32:25.165219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.165220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.165221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.165229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.165239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.165242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.165244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.165245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.165250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.165252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.165266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.165272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.165278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.165290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1518
2025-10-02T09:32:25.165295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1518
2025-10-02T09:32:25.165360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.165365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.165382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c56f232-38df1053-75f93329-14a8ca58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.165390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.165392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.165394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.165398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.165407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.165418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.165546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.165551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.165558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.165628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1519 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c56f232-38df1053-75f93329-14a8ca58_0
2025-10-02T09:32:25.165877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d532fef6-eaf6e4ef-295bb08a-cb9854b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c56f232-38df1053-75f93329-14a8ca58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.168641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Write session: try to update token
2025-10-02T09:32:25.168654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.174511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.174523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.174526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.174527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.174532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.174534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.174536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457624474:9260]
2025-10-02T09:32:25.174555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.174561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.174562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.174564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.174568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.174571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.174685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.181669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId: src_id|6c56f232-38df1053-75f93329-14a8ca58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.183766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.246237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533164723:3893]
2025-10-02T09:32:25.246422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1518, pipe: [1:7556554917533164723:3893]
2025-10-02T09:32:25.286819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.287116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.287125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.287138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164723:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.287283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.287341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:25.287355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:25.287383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.287409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1519 reason: error at write: Disconnected sessionId: src_id|6c56f232-38df1053-75f93329-14a8ca58_0
2025-10-02T09:32:25.287455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533164723:3893]
2025-10-02T09:32:25.287574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1519 sessionId: src_id|6c56f232-38df1053-75f93329-14a8ca58_0 is DEAD
2025-10-02T09:32:25.287746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:25.287761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Write session will restart in 0.007723s
2025-10-02T09:32:25.287782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Write session: Do CDS request
2025-10-02T09:32:25.287788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.294931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.296172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.296276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.296287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1520
2025-10-02T09:32:25.296404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.296424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.296430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.296433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.296479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.296577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.296584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.296590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.296616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.296640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457624583:9263]
2025-10-02T09:32:25.296721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1520 sessionId:  describe result for acl check
2025-10-02T09:32:25.296739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.296744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.296745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.296748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533164788:3750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.297006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.297106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533164788:3750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.297208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.297232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.297407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.297443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.297448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.297449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.297449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.297450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.297450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.297451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.297451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.297452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.297452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.297452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.297453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.297456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.297462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.297464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.297466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.297468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.297470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.297472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.297473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.297475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.297478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.297479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.297481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.297485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.297489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.297493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.297496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.297498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.297501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.297503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.297505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.297508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.297511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.297513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.297516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.297518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.297522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.297524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.297527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.297530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.297532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.297534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.297537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.297540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.297543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.297545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.297547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.297565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.299045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533164788:3750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.302849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533164788:3750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.302862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533164788:3750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.302864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533164788:3750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.302868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.304946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.306344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.306355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.306356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.306358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.306361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1519 [2:7556554917457624583:9263]
2025-10-02T09:32:25.306370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.306380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.306386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.306389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.306391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.306403Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.306411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.306416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.306449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.306453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.306454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.306456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.306457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.306492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.306497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.306503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.306510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.306518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.306532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164724:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.306537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164826:3750], now have 1 active actors on pipe
2025-10-02T09:32:25.306541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.306542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.306543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.306552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.306562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.306567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.306569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.306570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.306571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.306573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.306587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.306592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.306586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1519
2025-10-02T09:32:25.306601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1519
2025-10-02T09:32:25.306606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.306612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.306614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.306628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52b04db0-314573f9-27fee533-57ba434e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.306635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.306637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.306639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.306647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.306657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.306670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.306791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.306796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.306803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.306868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1520 partition: 0 MaxSeqNo: 36 sessionId: src_id|52b04db0-314573f9-27fee533-57ba434e_0
2025-10-02T09:32:25.307099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c56f232-38df1053-75f93329-14a8ca58_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52b04db0-314573f9-27fee533-57ba434e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.309882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Write session: try to update token
2025-10-02T09:32:25.309896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.315631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.315640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.315641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.315642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.315645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.315649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.315651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457624578:9263]
2025-10-02T09:32:25.315669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.315673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.315675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.315675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.315676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.315677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.315785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.322762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId: src_id|52b04db0-314573f9-27fee533-57ba434e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.324964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.387546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533164835:3893]
2025-10-02T09:32:25.387785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1519, pipe: [1:7556554917533164835:3893]
2025-10-02T09:32:25.425637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.425927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.425936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.425949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164835:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.426067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.426105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:25.426115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:25.426154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.426160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1520 reason: error at write: Disconnected sessionId: src_id|52b04db0-314573f9-27fee533-57ba434e_0
2025-10-02T09:32:25.426215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533164835:3893]
2025-10-02T09:32:25.426286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1520 sessionId: src_id|52b04db0-314573f9-27fee533-57ba434e_0 is DEAD
2025-10-02T09:32:25.426434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:25.426449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Write session will restart in 0.009913s
2025-10-02T09:32:25.426468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Write session: Do CDS request
2025-10-02T09:32:25.426473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.433048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.434798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.434893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.434901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.434906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.434930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.434950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457624686:9265]
2025-10-02T09:32:25.435289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.435481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.435502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.435673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.435702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.435705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.435706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.435707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.435707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.435708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.435708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.435709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.435709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.435710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.435710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.435711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.435713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.435721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.435723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.435725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.435727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.435729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.435731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.435733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.435734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.435737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.435739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.435741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.435744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.435748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.435752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.435754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.435756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.435759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.435761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.435764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.435766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.435769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.435772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.435774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.435777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.435779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.435782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.435785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.435788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.435790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.435793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.435797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.435799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.435802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.435807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.435810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.435828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.437170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.437217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.437227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1521
2025-10-02T09:32:25.437380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.437399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.437405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.437407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.437672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1521 sessionId:  describe result for acl check
2025-10-02T09:32:25.437690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.437695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.437696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.437699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533164905:3742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.438058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533164905:3742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.439829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533164905:3742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.442773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533164905:3742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.442794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533164905:3742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.442796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533164905:3742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.442802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.443241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.444597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.444608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.444609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.444611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.444614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1520 [2:7556554917457624686:9265]
2025-10-02T09:32:25.444621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.444630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.444633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.444635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.444636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.444645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.444651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.444656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.444687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.444691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.444693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.444694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.444696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.444730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.444734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.444741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.444748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.444759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.444772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164836:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.444777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164940:3742], now have 1 active actors on pipe
2025-10-02T09:32:25.444781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.444782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.444783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.444790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.444813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.444815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.444819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.444820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.444827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.444829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.444845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.444842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1520
2025-10-02T09:32:25.444855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.444843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1520
2025-10-02T09:32:25.444860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.444890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.444895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.444910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.444916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.444918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.444919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.444924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.444932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.444942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.445066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.445071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.445080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.445145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1521 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0
2025-10-02T09:32:25.445400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b04db0-314573f9-27fee533-57ba434e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.448154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Write session: try to update token
2025-10-02T09:32:25.448168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.453725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:25.453735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.453739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.453759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:25.453762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:25.453886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:25.453998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:25.454108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:25.454227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:25.454375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:25.454397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:25.461284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId: src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.462073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.462084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.462085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.462086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.462092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.462094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.462097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457624681:9265]
2025-10-02T09:32:25.462114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.462116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.462119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.462121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.462121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.462122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.462224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.463524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.526291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533164948:3893]
2025-10-02T09:32:25.526530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1520, pipe: [1:7556554917533164948:3893]
2025-10-02T09:32:25.570017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.570218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.570227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.570239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164948:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.570380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.570422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533164948:3893]
2025-10-02T09:32:25.570449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:25.570461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.570497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1521 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0
2025-10-02T09:32:25.570628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1521 sessionId: src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0 is DEAD
2025-10-02T09:32:25.570777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:25.570798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Write session will restart in 0.006201s
2025-10-02T09:32:25.570824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Write session: Do CDS request
2025-10-02T09:32:25.570829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.577323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.578129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.578231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.578239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1522
2025-10-02T09:32:25.578346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.578365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.578371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.578374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.578710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1522 sessionId:  describe result for acl check
2025-10-02T09:32:25.578751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.578758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.578760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.578764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533165015:3740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.579004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.579092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.579099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.579104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.579128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.579193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457624790:9267]
2025-10-02T09:32:25.579206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533165015:3740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.579549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.579757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.579780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.579962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.579993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.579997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.579998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.579999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.580001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.580001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.580002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.580003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.580003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.580004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.580004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.580005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.580007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.580014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.580016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.580018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.580020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.580022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.580024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.580026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.580028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.580030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.580032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.580034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.580037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.580041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.580045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.580047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.580049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.580051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.580053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.580056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.580059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.580061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.580065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.580068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.580070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.580073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.580076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.580079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.580081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.580083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.580085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.580088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.580090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.580093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.580095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.580097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.580114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.580570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533165015:3740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.584960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533165015:3740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.584973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533165015:3740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.584976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533165015:3740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.584981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.587477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.588776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.588787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.588788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.588790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.588793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1521 [2:7556554917457624790:9267]
2025-10-02T09:32:25.588815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.588825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.588830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.588832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.588833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.588842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.588845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.588851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.588879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.588884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.588885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.588887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.588888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.588921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.588926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.588932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.588940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.588956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.588970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165054:3740], now have 1 active actors on pipe
2025-10-02T09:32:25.588975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533164949:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.588979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.588980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.588982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.588989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.589000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.589003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.589005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.589006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.589010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.589011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.589024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.589029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.589018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1521
2025-10-02T09:32:25.589034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.589022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1521
2025-10-02T09:32:25.589047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.589052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.589071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|909512be-d6ccd4f4-130638d4-360f03dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.589078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.589080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.589081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.589086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.589094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.589104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.589208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.589213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.589220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.589283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1522 partition: 0 MaxSeqNo: 36 sessionId: src_id|909512be-d6ccd4f4-130638d4-360f03dc_0
2025-10-02T09:32:25.589516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc72700-3a64f50c-b3c9e120-1f45eb6f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|909512be-d6ccd4f4-130638d4-360f03dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.592168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Write session: try to update token
2025-10-02T09:32:25.592181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.598062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.598072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.598073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.598074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.598078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.598080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.598083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457624785:9267]
2025-10-02T09:32:25.598101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.598106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.598108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.598109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.598109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.598111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.598215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.605296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId: src_id|909512be-d6ccd4f4-130638d4-360f03dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.607391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.670708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533165061:3893]
2025-10-02T09:32:25.670985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1521, pipe: [1:7556554917533165061:3893]
2025-10-02T09:32:25.707078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.707308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.707316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.707329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165061:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.707444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.707482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.707515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:25.707555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533165061:3893]
2025-10-02T09:32:25.707573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|909512be-d6ccd4f4-130638d4-360f03dc_0
2025-10-02T09:32:25.707708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1522 sessionId: src_id|909512be-d6ccd4f4-130638d4-360f03dc_0 is DEAD
2025-10-02T09:32:25.707835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:25.707845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Write session will restart in 0.009972s
2025-10-02T09:32:25.707860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Write session: Do CDS request
2025-10-02T09:32:25.707864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.714876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.716542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.716649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.716656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.716662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.716689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.716725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457624893:9269]
2025-10-02T09:32:25.717084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.717291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.717314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.717488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.717517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.717521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.717522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.717522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.717523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.717524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.717524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.717525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.717525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.717526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.717526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.717527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.717530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.717536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.717539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.717541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.717543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.717545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.717547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.717548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.717551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.717553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.717555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.717556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.717560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.717564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.717567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.717570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.717573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.717575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.717577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.717580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.717583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.717585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.717588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.717590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.717593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.717595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.717597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.717600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.717602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.717606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.717610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.717612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.717616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.717622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.717624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.717627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.717643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.719249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.719332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.719343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1523
2025-10-02T09:32:25.719453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.719473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.719479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.719481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.719836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1523 sessionId:  describe result for acl check
2025-10-02T09:32:25.719873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.719881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.719882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.719887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533165135:3737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.720321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533165135:3737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.721924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533165135:3737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.725580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533165135:3737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.725594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533165135:3737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.725596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533165135:3737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.725602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.726062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.727537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.727547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.727549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.727551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.727554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1522 [2:7556554917457624893:9269]
2025-10-02T09:32:25.727560Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.727570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.727572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.727573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.727574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.727583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.727589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.727594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.727626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.727630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.727631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.727633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.727635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.727670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.727675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.727682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.727688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.727699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.727713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165169:3737], now have 1 active actors on pipe
2025-10-02T09:32:25.727719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165063:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.727722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.727727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.727728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.727735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.727746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.727748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.727750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.727751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.727756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.727759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.727773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.727761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1522
2025-10-02T09:32:25.727778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.727780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.727773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1522
2025-10-02T09:32:25.727793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.727798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.727817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.727824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.727826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.727830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.727835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.727840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.727856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.727944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.727948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.727956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.728031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1523 partition: 0 MaxSeqNo: 36 sessionId: src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0
2025-10-02T09:32:25.728199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909512be-d6ccd4f4-130638d4-360f03dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.730680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Write session: try to update token
2025-10-02T09:32:25.730690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.737950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.737962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.737963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.737965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.737971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.737973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.737975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457624888:9269]
2025-10-02T09:32:25.737995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.738000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.738001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.738003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.738003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.738005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.738117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.741694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId: src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.743546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.807905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533165179:3893]
2025-10-02T09:32:25.808074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1522, pipe: [1:7556554917533165179:3893]
2025-10-02T09:32:25.846289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.846500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.846509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.846534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165179:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.846647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.846666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.846699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:25.846732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533165179:3893]
2025-10-02T09:32:25.846757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1523 reason: status is not ok: tablet will be restarted right now sessionId: src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0
2025-10-02T09:32:25.846889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1523 sessionId: src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0 is DEAD
2025-10-02T09:32:25.847000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:25.847005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Write session will restart in 0.009678s
2025-10-02T09:32:25.847019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Write session: Do CDS request
2025-10-02T09:32:25.847024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.853181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.854474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.854579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.854587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.854594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.854626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.854651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457625011:9272]
2025-10-02T09:32:25.855014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.855175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.855196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.855370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.855397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.855401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.855401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.855402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.855402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.855403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.855403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.855404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.855404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.855405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.855405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.855406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.855409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.855416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.855418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.855420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.855422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.855424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.855426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.855427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.855429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.855432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.855433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.855435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.855439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.855442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.855446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.855449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.855451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.855454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.855456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.855458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.855460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.855463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.855465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.855467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.855471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.855474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.855477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.855479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.855485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.855487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.855489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.855492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.855494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.855499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.855501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.855503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.855523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.857137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.857231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.857240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1524
2025-10-02T09:32:25.857369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.857387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.857393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.857396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.857767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1524 sessionId:  describe result for acl check
2025-10-02T09:32:25.857805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.857812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.857813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.857818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533165257:3732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.858281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533165257:3732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.859608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533165257:3732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:25.863241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533165257:3732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:25.863253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533165257:3732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:25.863256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533165257:3732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:25.863261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:25.863721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:25.865167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:25.865179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:25.865180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:25.865182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:25.865186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1523 [2:7556554917457625011:9272]
2025-10-02T09:32:25.865193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:25.865202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:25.865203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.865206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.865207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.865214Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:25.865217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:25.865221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:25.865250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.865256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.865257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.865259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:25.865260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:25.865296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:25.865300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.865307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.865312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.865320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:25.865334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165291:3732], now have 1 active actors on pipe
2025-10-02T09:32:25.865339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165184:2446], now have 1 active actors on pipe
2025-10-02T09:32:25.865343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.865344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.865345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.865352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:25.865360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:25.865361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:25.865362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:25.865364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:25.865372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:25.865373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:25.865388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.865393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:25.865394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:25.865381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1523
2025-10-02T09:32:25.865408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.865409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1523
2025-10-02T09:32:25.865413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.865432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:25.865439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:25.865441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:25.865442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:25.865447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:25.865452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:25.865463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.865541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.865546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.865553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:25.865601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1524 partition: 0 MaxSeqNo: 36 sessionId: src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0
2025-10-02T09:32:25.865781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869b2609-5cc23d5e-90b7ed14-928b6d30_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:25.868013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Write session: try to update token
2025-10-02T09:32:25.868024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:25.875662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:25.875676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:25.875678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:25.875679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:25.875685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.875687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.875691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457625006:9272]
2025-10-02T09:32:25.875713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:25.875715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:25.875718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:25.875720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:25.875720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.875721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:25.875844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:25.878738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId: src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:25.881176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:25.946668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554917533165336:3893]
2025-10-02T09:32:25.946852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1523, pipe: [1:7556554917533165336:3893]
2025-10-02T09:32:25.984828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:25.985104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:25.985113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:25.985138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165336:3893], now have 1 active actors on pipe
2025-10-02T09:32:25.985288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:25.985355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554917533165336:3893]
2025-10-02T09:32:25.985385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:25.985403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:25.985507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1524 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0
2025-10-02T09:32:25.985662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1524 sessionId: src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0 is DEAD
2025-10-02T09:32:25.985797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:25.985806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Write session will restart in 0.007491s
2025-10-02T09:32:25.985830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Write session: Do CDS request
2025-10-02T09:32:25.985834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:25.992508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:25.994016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:25.994118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:25.994124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:25.994130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:25.994141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.994156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:25.994183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554917457625157:9287]
2025-10-02T09:32:25.994347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:25.994359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1525
2025-10-02T09:32:25.994441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:25.994461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:25.994467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:25.994470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:25.994535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:25.994736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:25.994758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:25.994932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1525 sessionId:  describe result for acl check
2025-10-02T09:32:25.994949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:25.994979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.994973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:25.994980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:25.994983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.994984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.994984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.994981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:25.994985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.994986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554917533165407:3704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:25.994985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.994986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.994986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.994987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.994987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.994988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.994989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.994992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.994998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.995000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.995002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.995004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.995007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.995008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.995010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.995012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.995015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.995017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.995019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.995022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.995026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:25.995029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.995032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:25.995035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.995038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:25.995040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.995043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:25.995046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.995048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:25.995050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.995053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:25.995055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.995059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:25.995061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.995064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:25.995066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.995069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:25.995071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.995074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:25.995076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.995078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:25.995080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.995083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:25.995099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:25.995418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554917533165407:3704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:25.996980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554917533165407:3704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.001167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554917533165407:3704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.001180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554917533165407:3704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.001182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554917533165407:3704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.001186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.003212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.004532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.004542Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.004543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.004545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.004549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1524 [2:7556554917457625157:9287]
2025-10-02T09:32:26.004555Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.004565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.004566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.004568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.004569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.004578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.004584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.004589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.004616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.004621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.004622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.004624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.004625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.004660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.004664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.004670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.004675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.004683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.004697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132739:3704], now have 1 active actors on pipe
2025-10-02T09:32:26.004702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554917533165337:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.004705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.004707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.004708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.004716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.004725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.004729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.004731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.004733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.004733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.004735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.004747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.004752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.004754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.004760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1524
2025-10-02T09:32:26.004770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1524
2025-10-02T09:32:26.004846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.004852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.004867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe629670-c984b343-3acf4c23-4b5b287b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.004872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.004874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.004876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.004881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.004888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.004896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.005015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.005020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.005028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.005099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1525 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe629670-c984b343-3acf4c23-4b5b287b_0
2025-10-02T09:32:26.005289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2baa940-2ca8f8b1-7a6f2de7-9853eba6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe629670-c984b343-3acf4c23-4b5b287b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.007434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Write session: try to update token
2025-10-02T09:32:26.007444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.014114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.014126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.014127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.014129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.014134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.014136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.014140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554917457625151:9287]
2025-10-02T09:32:26.014160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.014167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.014168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.014169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.014171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.014173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.014302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.017992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId: src_id|fe629670-c984b343-3acf4c23-4b5b287b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.019858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.085417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828132748:3893]
2025-10-02T09:32:26.085664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1524, pipe: [1:7556554921828132748:3893]
2025-10-02T09:32:26.123994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.124274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.124284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.124309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132748:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.124511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.124553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828132748:3893]
2025-10-02T09:32:26.124575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:26.124596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:26.124668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1525 reason: error at write: Disconnected sessionId: src_id|fe629670-c984b343-3acf4c23-4b5b287b_0
2025-10-02T09:32:26.124834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1525 sessionId: src_id|fe629670-c984b343-3acf4c23-4b5b287b_0 is DEAD
2025-10-02T09:32:26.124947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:26.124961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Write session will restart in 0.006416s
2025-10-02T09:32:26.124981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Write session: Do CDS request
2025-10-02T09:32:26.124986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.125030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.131054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.132168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.132244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.132258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1526
2025-10-02T09:32:26.132353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.132361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.132375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.132383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.132386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.132458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.132467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.132472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.132497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.132514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752592561:9289]
2025-10-02T09:32:26.132754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1526 sessionId:  describe result for acl check
2025-10-02T09:32:26.132795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.132816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.132821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.132827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828132819:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.132878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.133067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.133241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.133271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.133274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.133275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.133275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.133276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.133277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.133277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.133278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.133278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.133279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.133279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.133280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.133283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.133289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.133291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828132819:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.133292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.133294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.133296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.133298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.133300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.133302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.133304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.133306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.133308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.133310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.133314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.133317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.133321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.133324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.133326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.133329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.133331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.133333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.133336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.133338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.133340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.133343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.133345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.133348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.133350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.133353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.133355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.133357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.133359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.133362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.133364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.133370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.133372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.133375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.133391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.135039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828132819:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.139632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828132819:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.139646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828132819:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.139648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828132819:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.139653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.140774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.142142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.142153Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.142154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.142156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.142161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1525 [2:7556554921752592561:9289]
2025-10-02T09:32:26.142168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.142177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.142182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.142184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.142185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.142194Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.142196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.142202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.142228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.142233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.142234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.142235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.142236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.142272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.142276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.142282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.142288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.142297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.142312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132749:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.142317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132858:3707], now have 1 active actors on pipe
2025-10-02T09:32:26.142320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.142321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.142323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.142330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.142340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.142347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.142349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.142350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.142350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.142352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.142347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1525
2025-10-02T09:32:26.142362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1525
2025-10-02T09:32:26.142365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.142370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.142372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.142386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.142391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.142411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.142417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.142419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.142420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.142425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.142432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.142440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.142540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.142547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.142557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.142622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1526 partition: 0 MaxSeqNo: 36 sessionId: src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0
2025-10-02T09:32:26.142843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe629670-c984b343-3acf4c23-4b5b287b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.145587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Write session: try to update token
2025-10-02T09:32:26.145603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.151397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.151407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.151408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.151409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.151412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.151414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.151416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752592556:9289]
2025-10-02T09:32:26.151435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.151439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.151440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.151440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.151443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.151445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.151546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.159133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId: src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.161236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.224662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828132868:3893]
2025-10-02T09:32:26.224809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1525, pipe: [1:7556554921828132868:3893]
2025-10-02T09:32:26.262614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.262835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.262844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.262857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132868:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.262976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.263014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828132868:3893]
2025-10-02T09:32:26.263043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:26.263066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.263106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0
2025-10-02T09:32:26.263268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1526 sessionId: src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0 is DEAD
2025-10-02T09:32:26.263393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:26.263403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Write session will restart in 0.007118s
2025-10-02T09:32:26.263420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Write session: Do CDS request
2025-10-02T09:32:26.263425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.269846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.271160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.271276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.271278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.271289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1527
2025-10-02T09:32:26.271368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.271375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.271381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.271399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.271406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.271418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.271424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.271427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.271428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752592672:9292]
2025-10-02T09:32:26.271761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1527 sessionId:  describe result for acl check
2025-10-02T09:32:26.271770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.271796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.271805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.271806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.271811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828132940:3697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.271934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.271956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.272131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.272158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.272163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.272163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.272164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.272164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.272165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.272165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.272166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.272166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.272167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.272167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.272168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.272170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.272177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.272179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.272181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.272183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.272185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.272187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.272189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.272191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.272193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.272195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.272197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.272201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.272205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.272209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.272211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.272214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.272216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.272219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.272222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.272224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.272226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.272228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.272231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.272233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.272236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.272241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.272244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.272246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.272249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.272251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.272253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.272255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.272246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828132940:3697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.272257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.272263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.272265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.272282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.273786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828132940:3697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.278505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828132940:3697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.278517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828132940:3697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.278520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828132940:3697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.278525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.279654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.281029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.281039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.281040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.281043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.281046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1526 [2:7556554921752592672:9292]
2025-10-02T09:32:26.281052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.281063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.281068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.281070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.281071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.281081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.281084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.281088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.281117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.281121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.281123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.281124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.281126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.281163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.281168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.281175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.281180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.281191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.281206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132979:3697], now have 1 active actors on pipe
2025-10-02T09:32:26.281211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132869:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.281214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.281216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.281216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.281225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.281234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.281244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.281244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.281246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.281251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.281253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.281259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.281265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.281271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.281258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1526
2025-10-02T09:32:26.281258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1526
2025-10-02T09:32:26.281286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.281292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.281309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc867760-f6552944-4f88b61f-6afef02e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.281315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.281317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.281318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.281325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.281332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.281342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.281441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.281446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.281454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.281515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1527 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc867760-f6552944-4f88b61f-6afef02e_0
2025-10-02T09:32:26.281757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240d51f1-3f123aec-bd529af0-8dce3d45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc867760-f6552944-4f88b61f-6afef02e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.284485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Write session: try to update token
2025-10-02T09:32:26.284503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.290408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.290421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.290422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.290423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.290428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.290431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.290433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752592667:9292]
2025-10-02T09:32:26.290451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.290455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.290456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.290458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.290461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.290463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.290567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.297463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId: src_id|bc867760-f6552944-4f88b61f-6afef02e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.299581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.363421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828132988:3893]
2025-10-02T09:32:26.363609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1526, pipe: [1:7556554921828132988:3893]
2025-10-02T09:32:26.405307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.405631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.405640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.405653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132988:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.405783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.405845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:26.405863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:26.405903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828132988:3893]
2025-10-02T09:32:26.405921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1527 reason: error at write: Disconnected sessionId: src_id|bc867760-f6552944-4f88b61f-6afef02e_0
2025-10-02T09:32:26.405948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.406100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1527 sessionId: src_id|bc867760-f6552944-4f88b61f-6afef02e_0 is DEAD
2025-10-02T09:32:26.406246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:26.406259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Write session will restart in 0.008988s
2025-10-02T09:32:26.406279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Write session: Do CDS request
2025-10-02T09:32:26.406285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.412743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.414048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.414148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.414155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.414161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.414187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.414213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752592782:9294]
2025-10-02T09:32:26.414567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.414732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.414755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.414963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.414998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.415002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.415002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.415003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.415004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.415004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.415005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.415005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.415006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.415006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.415007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.415007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.415010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.415017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.415019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.415021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.415023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.415025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.415027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.415029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.415031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.415033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.415035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.415037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.415042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.415045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.415049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.415052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.415054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.415057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.415059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.415062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.415064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.415067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.415069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.415071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.415074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.415077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.415080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.415083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.415086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.415088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.415090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.415093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.415095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.415098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.415100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.415102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.415121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.416254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.416408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.416421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1528
2025-10-02T09:32:26.416550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.416571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.416576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.416579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.416890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1528 sessionId:  describe result for acl check
2025-10-02T09:32:26.416922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.416926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.416928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.416934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828133065:3101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.417298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828133065:3101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.418594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828133065:3101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.422180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828133065:3101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.422192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828133065:3101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.422195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828133065:3101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.422201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.422726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.424078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.424091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.424092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.424094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.424098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1527 [2:7556554921752592782:9294]
2025-10-02T09:32:26.424105Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.424116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.424119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.424120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.424122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.424131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.424138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.424142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.424172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.424177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.424178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.424180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.424183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.424224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.424229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.424235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.424241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.424249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.424265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133100:3101], now have 1 active actors on pipe
2025-10-02T09:32:26.424270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828132989:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.424275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.424280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.424282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.424289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.424299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.424291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1527
2025-10-02T09:32:26.424305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.424295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1527
2025-10-02T09:32:26.424307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.424307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.424309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.424309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.424323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.424325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.424328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.424336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.424341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.424367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9722a01a-a268429d-f351f3c0-c173c586_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.424373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.424375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.424377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.424382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.424390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.424400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.424525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.424530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.424538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.424595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1528 partition: 0 MaxSeqNo: 36 sessionId: src_id|9722a01a-a268429d-f351f3c0-c173c586_0
2025-10-02T09:32:26.424834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc867760-f6552944-4f88b61f-6afef02e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9722a01a-a268429d-f351f3c0-c173c586_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.427226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Write session: try to update token
2025-10-02T09:32:26.427238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.433760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.433774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.433776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.433777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.433786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.433789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.433791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752592777:9294]
2025-10-02T09:32:26.433814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.433818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.433817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.433821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.433821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.433823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.433949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.438273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId: src_id|9722a01a-a268429d-f351f3c0-c173c586_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.440272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.506288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828133107:3893]
2025-10-02T09:32:26.506476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1527, pipe: [1:7556554921828133107:3893]
2025-10-02T09:32:26.551495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.551791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.551800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.551827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133107:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.551983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.552002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828133107:3893]
2025-10-02T09:32:26.552012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:26.552015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:26.552020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.552072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1528 reason: error at write: Disconnected sessionId: src_id|9722a01a-a268429d-f351f3c0-c173c586_0
2025-10-02T09:32:26.552200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1528 sessionId: src_id|9722a01a-a268429d-f351f3c0-c173c586_0 is DEAD
2025-10-02T09:32:26.552333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:26.552343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Write session will restart in 0.007822s
2025-10-02T09:32:26.552358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Write session: Do CDS request
2025-10-02T09:32:26.552363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.558651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.559942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.560039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.560045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.560052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.560085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.560116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752592892:9296]
2025-10-02T09:32:26.560461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.560625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.560647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.560843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.560878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.560884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.560884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.560885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.560885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.560886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.560887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.560887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.560888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.560888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.560889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.560889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.560892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.560899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.560901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.560903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.560905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.560907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.560909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.560911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.560913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.560916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.560918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.560919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.560924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.560928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.560931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.560934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.560936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.560939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.560940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.560943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.560945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.560948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.560950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.560953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.560955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.560957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.560959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.560962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.560964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.560967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.560969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.560972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.560976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.560979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.560981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.560987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.561003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.561145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.561230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.561240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1529
2025-10-02T09:32:26.561338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.561356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.561359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.561361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.561617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1529 sessionId:  describe result for acl check
2025-10-02T09:32:26.561645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.561650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.561652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.561656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828133189:3683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.562019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828133189:3683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.563442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828133189:3683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.567263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828133189:3683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.567273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828133189:3683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.567276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828133189:3683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.567282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.568486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.569844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.569855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.569857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.569859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.569862Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1528 [2:7556554921752592892:9296]
2025-10-02T09:32:26.569870Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.569880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.569882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.569884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.569885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.569894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.569898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.569902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.569939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.569944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.569945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.569947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.569949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.569988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.569993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.569999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.570005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.570012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.570028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133112:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.570034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133224:3683], now have 1 active actors on pipe
2025-10-02T09:32:26.570038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.570040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.570041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.570050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.570057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.570067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.570068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.570069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.570071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.570073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.570083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.570089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.570097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.570082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1528
2025-10-02T09:32:26.570086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1528
2025-10-02T09:32:26.570116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.570121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.570137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.570143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.570146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.570147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.570152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.570158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.570167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.570265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.570270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.570277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.570332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1529 partition: 0 MaxSeqNo: 36 sessionId: src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0
2025-10-02T09:32:26.570565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9722a01a-a268429d-f351f3c0-c173c586_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.572716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Write session: try to update token
2025-10-02T09:32:26.572726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.579449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.579463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.579465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.579466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.579472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.579475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.579477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752592887:9296]
2025-10-02T09:32:26.579500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.579503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.579505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.579506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.579509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.579512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.579620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.583577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId: src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.585481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.652215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828133231:3893]
2025-10-02T09:32:26.652412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1528, pipe: [1:7556554921828133231:3893]
2025-10-02T09:32:26.688864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.689057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.689066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.689091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133231:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.689242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.689270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.689299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828133231:3893]
2025-10-02T09:32:26.689302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:26.689305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:26.689355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1529 reason: error at write: Disconnected sessionId: src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0
2025-10-02T09:32:26.689487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1529 sessionId: src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0 is DEAD
2025-10-02T09:32:26.689604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:26.689610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Write session will restart in 0.008984s
2025-10-02T09:32:26.689628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Write session: Do CDS request
2025-10-02T09:32:26.689632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.696155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.697576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.697669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.697675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.697681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.697705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.697736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752593003:9298]
2025-10-02T09:32:26.698073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.698235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.698256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.698431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.698459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.698463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.698463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.698464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.698464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.698465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.698465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.698466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.698466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.698467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.698467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.698468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.698471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.698477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.698480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.698482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.698484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.698486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.698487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.698490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.698491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.698494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.698495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.698497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.698501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.698504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.698508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.698510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.698512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.698515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.698517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.698520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.698522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.698525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.698527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.698529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.698531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.698535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.698537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.698539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.698541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.698544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.698546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.698549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.698551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.698553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.698556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.698558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.698574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.699124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.699218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.699226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1530
2025-10-02T09:32:26.699313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.699332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.699335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.699337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.699583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1530 sessionId:  describe result for acl check
2025-10-02T09:32:26.699601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.699605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.699606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.699611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828133311:3674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.699956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828133311:3674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.701194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828133311:3674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.704684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828133311:3674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.704694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828133311:3674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.704697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828133311:3674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.704702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.705905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.707207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.707219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.707220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.707222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.707225Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1529 [2:7556554921752593003:9298]
2025-10-02T09:32:26.707233Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.707241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.707246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.707248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.707249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.707257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.707264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.707268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.707300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.707304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.707306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.707307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.707309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.707343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.707348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.707354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.707359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.707368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.707382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133233:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.707387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133346:3674], now have 1 active actors on pipe
2025-10-02T09:32:26.707391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.707392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.707393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.707400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.707408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.707413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.707415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.707416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.707417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.707419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.707410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1529
2025-10-02T09:32:26.707411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1529
2025-10-02T09:32:26.707431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.707436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.707438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.707454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.707459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.707476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.707482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.707485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.707486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.707492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.707500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.707511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.707612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.707617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.707624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.707674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1530 partition: 0 MaxSeqNo: 36 sessionId: src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0
2025-10-02T09:32:26.707859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcac4e8a-71593ac2-2df5cb49-13718cea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.710021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Write session: try to update token
2025-10-02T09:32:26.710031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.716650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.716663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.716665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.716666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.716671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.716675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.716677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752592998:9298]
2025-10-02T09:32:26.716699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.716702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.716702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.716704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.716705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.716707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.716858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.720589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId: src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.722534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.789406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828133353:3893]
2025-10-02T09:32:26.789939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1529, pipe: [1:7556554921828133353:3893]
2025-10-02T09:32:26.826446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.826701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.826711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.826732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133353:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.826854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.826845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828133353:3893]
2025-10-02T09:32:26.826851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.826863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:26.826865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:26.826903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1530 reason: error at write: Disconnected sessionId: src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0
2025-10-02T09:32:26.827039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1530 sessionId: src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0 is DEAD
2025-10-02T09:32:26.827171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:26.827178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Write session will restart in 0.008328s
2025-10-02T09:32:26.827192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Write session: Do CDS request
2025-10-02T09:32:26.827196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.833579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.834972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.835087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.835094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.835099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.835127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.835149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752593129:9301]
2025-10-02T09:32:26.835488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.835653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.835675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.835861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.835889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.835893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.835894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.835894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.835895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.835895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.835896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.835897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.835898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.835898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.835899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.835899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.835902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.835908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.835910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.835913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.835914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.835917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.835918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.835920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.835922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.835924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.835926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.835928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.835931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.835935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.835939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.835941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.835944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.835946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.835948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.835951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.835953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.835955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.835957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.835960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.835962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.835965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.835966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.835969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.835971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.835974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.835976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.835978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.835980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.835983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.835985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.835988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.836006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.836123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.836192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.836204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1531
2025-10-02T09:32:26.836269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.836286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.836292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.836295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.836562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1531 sessionId:  describe result for acl check
2025-10-02T09:32:26.836589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.836594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.836595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.836598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828133440:3672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.836945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828133440:3672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.838389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828133440:3672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.842277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828133440:3672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.842286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828133440:3672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.842288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828133440:3672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.842292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.843502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.844794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.844821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.844825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.844828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.844831Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1530 [2:7556554921752593129:9301]
2025-10-02T09:32:26.844838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.844851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.844854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.844856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.844857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.844866Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.844872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.844878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.844908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.844913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.844914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.844915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.844917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.844952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.844956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.844962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.844968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.844979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.844993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133474:3672], now have 1 active actors on pipe
2025-10-02T09:32:26.844998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133361:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.845002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.845003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.845004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.845013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.845023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.845025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.845027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.845029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.845031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.845033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.845027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1530
2025-10-02T09:32:26.845046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.845051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.845053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1530
2025-10-02T09:32:26.845059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.845060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.845062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.845130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.845138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.845139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.845140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.845145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.845150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.845165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.845251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.845255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.845264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.845321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1531 partition: 0 MaxSeqNo: 36 sessionId: src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0
2025-10-02T09:32:26.845509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee6dfcf-53d45f17-ebb6aae-d953ca2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.847634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Write session: try to update token
2025-10-02T09:32:26.847644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.854294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.854307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.854308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.854309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.854314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.854316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.854318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752593124:9301]
2025-10-02T09:32:26.854339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.854342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.854346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.854349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.854352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.854355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.854472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.858197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId: src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.860103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:26.927122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554921828133519:3893]
2025-10-02T09:32:26.927242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1530, pipe: [1:7556554921828133519:3893]
2025-10-02T09:32:26.965070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:26.965277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.965286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.965310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133519:3893], now have 1 active actors on pipe
2025-10-02T09:32:26.965427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:26.965455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554921828133519:3893]
2025-10-02T09:32:26.965473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:26.965475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:26.965534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0
2025-10-02T09:32:26.965679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1531 sessionId: src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0 is DEAD
2025-10-02T09:32:26.965817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:26.965826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Write session will restart in 0.009077s
2025-10-02T09:32:26.965841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Write session: Do CDS request
2025-10-02T09:32:26.965844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:26.972627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:26.973924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:26.974019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:26.974024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:26.974030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:26.974054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:26.974076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554921752593280:9316]
2025-10-02T09:32:26.974430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:26.974589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:26.974610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:26.974800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:26.974833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.974838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.974838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.974839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.974839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.974840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.974840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.974841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.974841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.974842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.974842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.974843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.974846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.974853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.974855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.974857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.974859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.974861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.974863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.974865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.974867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.974869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.974871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.974873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.974877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.974881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:26.974884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.974887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:26.974889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.974892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:26.974894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.974897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:26.974899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.974902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:26.974904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.974907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:26.974909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.974912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:26.974914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.974917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:26.974919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.974922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:26.974924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.974926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.974929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.974932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.974934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.974936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.974953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:26.976128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.976395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:26.976405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1532
2025-10-02T09:32:26.976504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:26.976523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:26.976529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:26.976532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:26.976785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1532 sessionId:  describe result for acl check
2025-10-02T09:32:26.976832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:26.976838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:26.976840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:26.976844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554921828133600:3658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:26.977186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554921828133600:3658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:26.978697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554921828133600:3658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:26.981841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554921828133600:3658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:26.981852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554921828133600:3658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:26.981855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554921828133600:3658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:26.981860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:26.982402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:26.983804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:26.983815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:26.983816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:26.983819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:26.983822Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1531 [2:7556554921752593280:9316]
2025-10-02T09:32:26.983829Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:26.983838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:26.983839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.983841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.983842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.983851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:26.983854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:26.983859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:26.983887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.983892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.983893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.983895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:26.983896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:26.983939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:26.983946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.983955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:26.983962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:26.983970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:26.983985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133520:2446], now have 1 active actors on pipe
2025-10-02T09:32:26.983990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554921828133634:3658], now have 1 active actors on pipe
2025-10-02T09:32:26.983994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.983996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.983997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.984004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:26.984013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:26.984018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:26.984020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:26.984021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:26.984024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:26.984025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:26.984015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1531
2025-10-02T09:32:26.984018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1531
2025-10-02T09:32:26.984040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.984045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:26.984047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:26.984057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.984062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.984086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:26.984094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:26.984096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:26.984097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:26.984103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:26.984108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:26.984119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.984213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:26.984220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:26.984230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:26.984291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1532 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0
2025-10-02T09:32:26.984488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eceb093-fc441ad9-59f901ad-10849ff6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:26.986618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Write session: try to update token
2025-10-02T09:32:26.986627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:26.993459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:26.993481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:26.993483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:26.993485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:26.993494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.993499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.993505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554921752593275:9316]
2025-10-02T09:32:26.993540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:26.993544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:26.993549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:26.993551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:26.993551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:26.993554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:26.993791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:26.997509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId: src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:26.999399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.065373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123100939:3893]
2025-10-02T09:32:27.065511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1531, pipe: [1:7556554926123100939:3893]
2025-10-02T09:32:27.104079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.104272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.104281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.104305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123100939:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.104444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.104473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123100939:3893]
2025-10-02T09:32:27.104484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.104498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.104651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1532 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0
2025-10-02T09:32:27.104777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1532 sessionId: src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0 is DEAD
2025-10-02T09:32:27.104911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.104920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Write session will restart in 0.005479s
2025-10-02T09:32:27.104937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Write session: Do CDS request
2025-10-02T09:32:27.104941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.111112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.111141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.111169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.111178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1533
2025-10-02T09:32:27.111264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.111283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.111287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.111289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.111558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1533 sessionId:  describe result for acl check
2025-10-02T09:32:27.111584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.111589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.111590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.111593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101017:3653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.112129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101017:3653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.112492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.112589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.112595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.112601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.112625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.112648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047560690:9318]
2025-10-02T09:32:27.113019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.113196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.113222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.113403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.113430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.113434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.113435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.113435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.113436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.113436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.113437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.113437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.113438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.113438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.113439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.113440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.113442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.113447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.113449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.113452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.113456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.113459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.113463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.113466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.113469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.113473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.113476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.113479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.113483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.113487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.113490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.113493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.113495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.113498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.113502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.113504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.113506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.113509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.113511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.113514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.113516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.113519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.113520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.113523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.113525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.113527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.113530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.113532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.113534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.113513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101017:3653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.113538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.113541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.113543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.113560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.118412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101017:3653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.118426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101017:3653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.118429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101017:3653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.118435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.121009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.122414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.122425Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.122427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.122429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.122432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1532 [2:7556554926047560690:9318]
2025-10-02T09:32:27.122438Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.122447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.122450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.122452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.122453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.122461Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.122465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.122469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.122498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.122503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.122504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.122506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.122507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.122542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.122547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.122553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.122558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.122567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.122581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101056:3653], now have 1 active actors on pipe
2025-10-02T09:32:27.122586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123100940:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.122590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.122592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.122592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.122600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.122610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.122612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.122617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.122618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.122619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.122620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.122608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1532
2025-10-02T09:32:27.122624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1532
2025-10-02T09:32:27.122633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.122638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.122640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.122648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.122652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.122682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.122694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.122697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.122700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.122706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.122714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.122727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.122843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.122850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.122859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.122916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1533 partition: 0 MaxSeqNo: 36 sessionId: src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0
2025-10-02T09:32:27.123115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6bf399-d7ed6486-49e722e4-7f6f9c22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.125249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Write session: try to update token
2025-10-02T09:32:27.125259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.131875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.131891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.131893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.131894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.131900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.131903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.131907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047560685:9318]
2025-10-02T09:32:27.131928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.131937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.131937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.131938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.131941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.131943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.132052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.135667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId: src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.137515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.204630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123101064:3893]
2025-10-02T09:32:27.204812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1532, pipe: [1:7556554926123101064:3893]
2025-10-02T09:32:27.241643Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.241856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.241865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.241890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101064:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.242023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.242034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123101064:3893]
2025-10-02T09:32:27.242054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.242096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.242211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1533 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0
2025-10-02T09:32:27.242376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1533 sessionId: src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0 is DEAD
2025-10-02T09:32:27.242519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.242526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Write session will restart in 0.006060s
2025-10-02T09:32:27.242542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Write session: Do CDS request
2025-10-02T09:32:27.242546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.248842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.249108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.249211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.249221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1534
2025-10-02T09:32:27.249296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.249316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.249322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.249325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.249655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1534 sessionId:  describe result for acl check
2025-10-02T09:32:27.249694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.249701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.249702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.249707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101145:3646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.250115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.250146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101145:3646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.250220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.250227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.250233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.250259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.250281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047560807:9321]
2025-10-02T09:32:27.250642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.250834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.250860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.251038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.251066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.251070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.251071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.251071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.251072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.251073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.251073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.251074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.251074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.251075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.251075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.251076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.251078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.251085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.251087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.251089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.251091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.251093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.251095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.251097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.251099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.251101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.251103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.251105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.251108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.251112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.251115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.251118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.251120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.251123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.251125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.251128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.251130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.251133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.251135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.251138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.251140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.251143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.251145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.251148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.251150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.251153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.251157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.251163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.251165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.251168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.251174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.251178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.251208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.251639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101145:3646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.256122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101145:3646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.256135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101145:3646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.256140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101145:3646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.256146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.258630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.260081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.260091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.260092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.260094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.260097Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1533 [2:7556554926047560807:9321]
2025-10-02T09:32:27.260105Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.260113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.260119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.260121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.260122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.260130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.260133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.260138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.260170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.260174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.260175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.260177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.260178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.260211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.260215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.260221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.260226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.260238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.260250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.260254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.260255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.260260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.260266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.260268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.260269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.260272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101184:3646], now have 1 active actors on pipe
2025-10-02T09:32:27.260275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101067:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.260279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.260289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.260293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.260307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.260312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.260295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1533
2025-10-02T09:32:27.260317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1533
2025-10-02T09:32:27.260320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.260321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.260322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.260343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.260351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.260357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.260358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.260362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.260370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.260382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.260472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.260480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.260489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.260555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1534 partition: 0 MaxSeqNo: 36 sessionId: src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0
2025-10-02T09:32:27.260762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c15e69-d41b8c12-5ec1473a-e613b551_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.262925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Write session: try to update token
2025-10-02T09:32:27.262935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.269492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.269505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.269506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.269507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.269511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.269514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.269516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047560802:9321]
2025-10-02T09:32:27.269537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.269540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.269541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.269551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.269562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.269566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.269662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.273432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId: src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.275314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.342381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123101191:3893]
2025-10-02T09:32:27.342546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1533, pipe: [1:7556554926123101191:3893]
2025-10-02T09:32:27.379755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.380029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.380039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.380063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101191:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.380196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.380300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.380314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123101191:3893]
2025-10-02T09:32:27.380347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.380362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1534 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0
2025-10-02T09:32:27.380484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1534 sessionId: src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0 is DEAD
2025-10-02T09:32:27.380613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.380619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Write session will restart in 0.009316s
2025-10-02T09:32:27.380637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Write session: Do CDS request
2025-10-02T09:32:27.380641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.387455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.388749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.388865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.388871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.388878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.388907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.388930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047560922:9323]
2025-10-02T09:32:27.389268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.389428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.389450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.389626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.389655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.389659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.389659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.389660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.389660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.389661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.389661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.389662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.389662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.389663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.389663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.389664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.389666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.389673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.389675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.389678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.389680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.389682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.389684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.389686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.389688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.389690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.389692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.389694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.389697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.389701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.389704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.389707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.389709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.389712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.389714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.389716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.389718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.389721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.389723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.389726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.389728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.389731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.389733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.389736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.389738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.389745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.389747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.389750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.389756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.389758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.389760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.389763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.389779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.391134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.391231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.391239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1535
2025-10-02T09:32:27.391307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.391323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.391329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.391332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.391713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1535 sessionId:  describe result for acl check
2025-10-02T09:32:27.391758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.391765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.391767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.391771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101276:3638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.392217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101276:3638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.393552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101276:3638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.396656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101276:3638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.396668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101276:3638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.396670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101276:3638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.396675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.397161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.398456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.398466Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.398468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.398470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.398474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1534 [2:7556554926047560922:9323]
2025-10-02T09:32:27.398480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.398489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.398493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.398495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.398496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.398505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.398507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.398512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.398540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.398545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.398546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.398548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.398549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.398585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.398591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.398597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.398602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.398613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.398626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101311:3638], now have 1 active actors on pipe
2025-10-02T09:32:27.398631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101193:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.398635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.398636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.398637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.398645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.398655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.398656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.398658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.398660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.398665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.398667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.398657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1534
2025-10-02T09:32:27.398674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1534
2025-10-02T09:32:27.398680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.398685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.398687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.398695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.398700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.398772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.398789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.398794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.398795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.398800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.398809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.398824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.398914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.398918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.398926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.398981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1535 partition: 0 MaxSeqNo: 36 sessionId: src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0
2025-10-02T09:32:27.399142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3d129-33ae2cf9-4c86a56e-5dffe815_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.401351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Write session: try to update token
2025-10-02T09:32:27.401361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.407957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.407968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.407970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.407970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.407974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.407978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.407980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047560917:9323]
2025-10-02T09:32:27.408000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.408003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.408005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.408029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.408041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.408045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.408117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.412433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId: src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.414306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.480616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123101318:3893]
2025-10-02T09:32:27.480777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1534, pipe: [1:7556554926123101318:3893]
2025-10-02T09:32:27.519070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.519259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.519267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.519294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101318:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.519412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.519425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123101318:3893]
2025-10-02T09:32:27.519443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.519493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.519599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1535 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0
2025-10-02T09:32:27.519767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1535 sessionId: src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0 is DEAD
2025-10-02T09:32:27.519894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.519902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Write session will restart in 0.006298s
2025-10-02T09:32:27.519918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Write session: Do CDS request
2025-10-02T09:32:27.519922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.526497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.527157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.527228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.527238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1536
2025-10-02T09:32:27.527539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.527561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.527567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.527570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.527915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.527918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1536 sessionId:  describe result for acl check
2025-10-02T09:32:27.527949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.527956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.527958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.527962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101400:3626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.528044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.528052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.528059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.528091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.528116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047561039:9325]
2025-10-02T09:32:27.528387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101400:3626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.528465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.528671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.528714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.528948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.528979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.528984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.528984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.528985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.528985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.528986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.528986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.528987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.528987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.528988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.528989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.528989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.528992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.528999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.529001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.529003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.529005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.529007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.529009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.529011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.529013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.529016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.529018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.529020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.529023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.529028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.529031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.529034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.529036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.529039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.529041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.529043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.529045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.529048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.529050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.529053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.529055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.529058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.529060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.529063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.529065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.529068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.529070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.529072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.529074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.529077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.529079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.529082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.529099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.529778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101400:3626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.534880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101400:3626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.534893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101400:3626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.534896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101400:3626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.534900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.536556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.537936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.537947Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.537948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.537950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.537954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1535 [2:7556554926047561039:9325]
2025-10-02T09:32:27.537960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.537970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.537971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.537973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.537974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.537984Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.537989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.537993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.538019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.538024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.538025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.538027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.538029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.538065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.538070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.538075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.538081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.538089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.538101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101439:3626], now have 1 active actors on pipe
2025-10-02T09:32:27.538106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101320:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.538110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.538111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.538112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.538120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.538126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.538132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.538135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.538135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.538137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.538137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.538131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1535
2025-10-02T09:32:27.538139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1535
2025-10-02T09:32:27.538151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.538156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.538166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.538170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.538172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.538191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.538198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.538200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.538201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.538207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.538211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.538220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.538321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.538326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.538332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.538383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1536 partition: 0 MaxSeqNo: 36 sessionId: src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0
2025-10-02T09:32:27.538602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92689fb-cdaea3b8-422a1b6b-2487e9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.540749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Write session: try to update token
2025-10-02T09:32:27.540759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.547391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.547404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.547406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.547408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.547414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.547417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.547419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047561034:9325]
2025-10-02T09:32:27.547439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.547442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.547443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.547452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.547456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.547459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.547556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.551801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId: src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.553671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.619371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123101446:3893]
2025-10-02T09:32:27.619541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1535, pipe: [1:7556554926123101446:3893]
2025-10-02T09:32:27.658164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.658455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.658465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.658489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101446:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.658646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.658699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.658743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123101446:3893]
2025-10-02T09:32:27.658749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.658857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1536 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0
2025-10-02T09:32:27.659035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1536 sessionId: src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0 is DEAD
2025-10-02T09:32:27.659184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.659191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Write session will restart in 0.008589s
2025-10-02T09:32:27.659206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Write session: Do CDS request
2025-10-02T09:32:27.659210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.665997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.667389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.667498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.667506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.667512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.667539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.667562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047561157:9327]
2025-10-02T09:32:27.667908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.668080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.668108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.668297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.668334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.668339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.668339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.668340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.668340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.668341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.668341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.668342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.668342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.668343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.668343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.668344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.668347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.668354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.668356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.668358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.668360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.668362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.668364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.668366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.668368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.668370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.668372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.668374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.668377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.668382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.668384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.668387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.668390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.668392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.668394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.668397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.668399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.668401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.668404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.668406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.668408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.668411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.668413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.668416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.668418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.668420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.668422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.668425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.668427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.668429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.668432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.668434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.668450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.669126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.669238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.669250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1537
2025-10-02T09:32:27.669360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.669380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.669386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.669388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.669731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1537 sessionId:  describe result for acl check
2025-10-02T09:32:27.669768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.669775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.669776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.669781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101532:3625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.670212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101532:3625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.671490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101532:3625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.675341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101532:3625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.675353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101532:3625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.675358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101532:3625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.675362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.675839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.677285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.677295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.677296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.677298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.677302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1536 [2:7556554926047561157:9327]
2025-10-02T09:32:27.677310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.677320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.677322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.677323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.677324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.677333Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.677338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.677343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.677371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.677376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.677377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.677378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.677379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.677415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.677420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.677426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.677431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.677439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.677453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101447:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.677458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101567:3625], now have 1 active actors on pipe
2025-10-02T09:32:27.677461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.677462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.677463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.677472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.677480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.677484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.677487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.677488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.677488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.677490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.677490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1536
2025-10-02T09:32:27.677505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.677503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1536
2025-10-02T09:32:27.677510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.677512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.677526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.677531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.677546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|636852fe-4c6019ea-6072c286-c2edb330_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.677552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.677555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.677556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.677561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.677567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.677576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.677669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.677677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.677688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.677749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1537 partition: 0 MaxSeqNo: 36 sessionId: src_id|636852fe-4c6019ea-6072c286-c2edb330_0
2025-10-02T09:32:27.677942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f3e809-c0dffb8f-ff2b3fad-9048a6f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|636852fe-4c6019ea-6072c286-c2edb330_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.680141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Write session: try to update token
2025-10-02T09:32:27.680152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.687060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.687073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.687074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.687075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.687080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.687083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.687085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047561152:9327]
2025-10-02T09:32:27.687106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.687110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.687111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.687117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.687120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.687122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.687221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.690685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId: src_id|636852fe-4c6019ea-6072c286-c2edb330_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.692548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.759135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123101575:3893]
2025-10-02T09:32:27.759305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1536, pipe: [1:7556554926123101575:3893]
2025-10-02T09:32:27.798595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.798836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.798845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.798870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101575:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.799013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.799049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123101575:3893]
2025-10-02T09:32:27.799071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.799096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.799124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1537 reason: status is not ok: tablet will be restarted right now sessionId: src_id|636852fe-4c6019ea-6072c286-c2edb330_0
2025-10-02T09:32:27.799244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1537 sessionId: src_id|636852fe-4c6019ea-6072c286-c2edb330_0 is DEAD
2025-10-02T09:32:27.799353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.799363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Write session will restart in 0.005737s
2025-10-02T09:32:27.799381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Write session: Do CDS request
2025-10-02T09:32:27.799386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.806115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.806224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.806234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1538
2025-10-02T09:32:27.806325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.806345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.806351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.806353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.806511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.806729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1538 sessionId:  describe result for acl check
2025-10-02T09:32:27.806770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.806783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.806784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.806789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101658:3610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.807222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101658:3610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.807977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.808080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.808086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.808091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.808116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.808140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047561288:9330]
2025-10-02T09:32:27.808497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.808656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.808678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.808723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101658:3610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.808882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.808920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.808924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.808925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.808925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.808926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.808926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.808927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.808927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.808928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.808928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.808929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.808929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.808932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.808939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.808941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.808943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.808945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.808947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.808948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.808950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.808952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.808954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.808956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.808958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.808962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.808965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.808969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.808972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.808974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.808977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.808979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.808981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.808983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.808986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.808988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.808990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.808994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.808997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.808999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.809002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.809004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.809006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.809008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.809011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.809013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.809016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.809022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.809025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.809041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.813857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101658:3610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.813868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101658:3610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.813873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101658:3610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.813879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.816421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.817823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.817835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.817836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.817839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.817842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1537 [2:7556554926047561288:9330]
2025-10-02T09:32:27.817849Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.817858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.817860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.817861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.817862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.817870Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.817876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.817882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.817909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.817913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.817914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.817916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.817917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.817953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.817958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.817966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.817975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.817992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.818010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101700:3610], now have 1 active actors on pipe
2025-10-02T09:32:27.818015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101576:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.818018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.818019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.818020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.818030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.818040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.818029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1537
2025-10-02T09:32:27.818041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1537
2025-10-02T09:32:27.818047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.818048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.818050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.818054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.818055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.818071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.818076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.818085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.818093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.818106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.818108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|482c83c1-1934897d-b260860e-355c18bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.818111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.818113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.818114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.818118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.818124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.818135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.818224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.818231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.818240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.818291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1538 partition: 0 MaxSeqNo: 36 sessionId: src_id|482c83c1-1934897d-b260860e-355c18bf_0
2025-10-02T09:32:27.818488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|636852fe-4c6019ea-6072c286-c2edb330_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|482c83c1-1934897d-b260860e-355c18bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.820617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Write session: try to update token
2025-10-02T09:32:27.820627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.827977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.827993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.827996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.827997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.828005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.828008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.828012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047561283:9330]
2025-10-02T09:32:27.828044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.828045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.828048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.828050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.828054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.828056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.828216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.831724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId: src_id|482c83c1-1934897d-b260860e-355c18bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.833620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:27.899412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554926123101727:3893]
2025-10-02T09:32:27.899550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1537, pipe: [1:7556554926123101727:3893]
2025-10-02T09:32:27.940749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:27.940983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.940993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.941018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101727:3893], now have 1 active actors on pipe
2025-10-02T09:32:27.941138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:27.941340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554926123101727:3893]
2025-10-02T09:32:27.941385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:27.941461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1538 reason: status is not ok: tablet will be restarted right now sessionId: src_id|482c83c1-1934897d-b260860e-355c18bf_0
2025-10-02T09:32:27.941615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1538 sessionId: src_id|482c83c1-1934897d-b260860e-355c18bf_0 is DEAD
2025-10-02T09:32:27.941742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:27.941747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Write session will restart in 0.005788s
2025-10-02T09:32:27.941761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Write session: Do CDS request
2025-10-02T09:32:27.941765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:27.941778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:27.947957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:27.948091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.948383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:27.948397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1539
2025-10-02T09:32:27.948491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:27.948516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:27.948519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:27.948522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:27.948896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1539 sessionId:  describe result for acl check
2025-10-02T09:32:27.948934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:27.948941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:27.948943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:27.948947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554926123101836:3603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:27.949289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:27.949329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554926123101836:3603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:27.949391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:27.949397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:27.949403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:27.949427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:27.949449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554926047561446:9338]
2025-10-02T09:32:27.949796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:27.949959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:27.949985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:27.950178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:27.950209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.950213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.950213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.950214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.950214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.950215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.950215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.950216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.950217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.950217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.950217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.950218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.950221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.950227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.950229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.950231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.950233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.950235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.950237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.950239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.950241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.950243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.950245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.950246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.950250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.950254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:27.950257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.950260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:27.950262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.950264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:27.950266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.950269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:27.950272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.950274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:27.950277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.950279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:27.950281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.950284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:27.950286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.950289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:27.950291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.950293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:27.950295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.950297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.950303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.950306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.950307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.950310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.950327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:27.950345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554926123101836:3603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:27.955309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554926123101836:3603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:27.955322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554926123101836:3603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:27.955326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554926123101836:3603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:27.955331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:27.957811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:27.959109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:27.959119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:27.959121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:27.959123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:27.959128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1538 [2:7556554926047561446:9338]
2025-10-02T09:32:27.959166Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:27.959179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:27.959183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.959184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.959185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.959195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:27.959198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:27.959202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:27.959237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.959241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.959243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.959245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:27.959246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:27.959284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:27.959289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.959295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:27.959300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:27.959308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:27.959323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101741:2446], now have 1 active actors on pipe
2025-10-02T09:32:27.959328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554926123101871:3603], now have 1 active actors on pipe
2025-10-02T09:32:27.959332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.959333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.959334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.959342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:27.959352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:27.959361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:27.959362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:27.959365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:27.959365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:27.959366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:27.959381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.959386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:27.959389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:27.959400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.959405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.959378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1538
2025-10-02T09:32:27.959387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1538
2025-10-02T09:32:27.959485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:27.959492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:27.959494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:27.959495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:27.959500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:27.959505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:27.959518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.959627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:27.959632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:27.959639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:27.959698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1539 partition: 0 MaxSeqNo: 36 sessionId: src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0
2025-10-02T09:32:27.959917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|482c83c1-1934897d-b260860e-355c18bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:27.962170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Write session: try to update token
2025-10-02T09:32:27.962182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:27.968649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:27.968661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:27.968665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:27.968666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:27.968672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.968674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.968676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554926047561441:9338]
2025-10-02T09:32:27.968698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:27.968705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:27.968707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:27.968709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:27.968712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:27.968716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:27.968834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:27.973315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId: src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:27.975255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.041243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069175:3893]
2025-10-02T09:32:28.041436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1538, pipe: [1:7556554930418069175:3893]
2025-10-02T09:32:28.078745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.079002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.079012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.079037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069175:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.079200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.079323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.079356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:28.079377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069175:3893]
2025-10-02T09:32:28.079407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1539 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0
2025-10-02T09:32:28.079547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1539 sessionId: src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0 is DEAD
2025-10-02T09:32:28.079712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:28.079726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Write session will restart in 0.005173s
2025-10-02T09:32:28.079743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Write session: Do CDS request
2025-10-02T09:32:28.079748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.086097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.086189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.086200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1540
2025-10-02T09:32:28.086320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.086341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.086347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.086349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.086422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.086708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1540 sessionId:  describe result for acl check
2025-10-02T09:32:28.086743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.086748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.086749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.086753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418069260:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.087237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418069260:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.087735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.087857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.087864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.087870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.087900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.087925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342528864:9347]
2025-10-02T09:32:28.088264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.088439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.088464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.088647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.088675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.088679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.088680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.088680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.088681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.088681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.088682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.088682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.088683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.088684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.088684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.088685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.088687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.088693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.088696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.088698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.088700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.088702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.088703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.088705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.088707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.088709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.088711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.088713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.088717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.088722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.088725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.088728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.088730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.088732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.088735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.088737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.088739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.088742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.088744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.088747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.088749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.088752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.088757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.088760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.088762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.088765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.088770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.088773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.088775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.088778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.088783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.088786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.088778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418069260:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.088813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.093607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418069260:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.093618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418069260:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.093621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418069260:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.093625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.096137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.097555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.097564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.097566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.097568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.097571Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1539 [2:7556554930342528864:9347]
2025-10-02T09:32:28.097578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.097587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.097591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.097593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.097594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.097601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.097604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.097608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.097636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.097641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.097642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.097643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.097645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.097680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.097685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.097691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.097696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.097708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.097722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069176:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.097727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069299:3600], now have 1 active actors on pipe
2025-10-02T09:32:28.097731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.097735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.097736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.097745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.097755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.097759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.097761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.097762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.097765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.097767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.097779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.097784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.097785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.097758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1539
2025-10-02T09:32:28.097773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1539
2025-10-02T09:32:28.097799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.097804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.097822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.097829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.097831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.097832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.097836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.097841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.097853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.097946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.097952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.097961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.098017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1540 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0
2025-10-02T09:32:28.098227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df79291-a2a5bbf4-a5a17b35-19dbb353_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.100483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Write session: try to update token
2025-10-02T09:32:28.100493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.107184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.107198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.107199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.107200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.107205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.107208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.107210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342528859:9347]
2025-10-02T09:32:28.107232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.107235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.107236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.107241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.107244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.107246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.107347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.111338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId: src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.113249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.179498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069306:3893]
2025-10-02T09:32:28.180025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1539, pipe: [1:7556554930418069306:3893]
2025-10-02T09:32:28.219236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.219473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.219483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.219507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069306:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.219645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.219677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.219707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:28.219753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069306:3893]
2025-10-02T09:32:28.219758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1540 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0
2025-10-02T09:32:28.219886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1540 sessionId: src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0 is DEAD
2025-10-02T09:32:28.220015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:28.220026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Write session will restart in 0.005112s
2025-10-02T09:32:28.220046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Write session: Do CDS request
2025-10-02T09:32:28.220050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.226139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.226197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.226209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1541
2025-10-02T09:32:28.226329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.226350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.226352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.226355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.226690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1541 sessionId:  describe result for acl check
2025-10-02T09:32:28.226725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.226733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.226735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.226738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418069394:3592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.226798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.227194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418069394:3592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.228142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.228258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.228265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.228271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.228300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.228323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342528987:9349]
2025-10-02T09:32:28.228665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418069394:3592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.228940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.229087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.229109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.229378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.229406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.229411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.229411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.229412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.229413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.229413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.229414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.229414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.229415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.229415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.229416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.229416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.229419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.229426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.229428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.229430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.229432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.229434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.229436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.229438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.229440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.229443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.229445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.229447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.229450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.229454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.229458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.229461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.229464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.229466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.229472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.229475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.229477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.229480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.229482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.229485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.229487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.229489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.229494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.229497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.229499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.229502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.229504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.229510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.229514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.229520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.229523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.229525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.229545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.233334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418069394:3592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.233345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418069394:3592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.233347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418069394:3592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.233352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.236938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.238324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.238336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.238338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.238342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.238346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1540 [2:7556554930342528987:9349]
2025-10-02T09:32:28.238359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.238373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.238377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.238379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.238382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.238391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.238397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.238402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.238433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.238437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.238438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.238440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.238441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.238474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.238479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.238486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.238491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.238503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.238516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069434:3592], now have 1 active actors on pipe
2025-10-02T09:32:28.238522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069310:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.238525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.238526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.238527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.238534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.238544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.238548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.238550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.238551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.238555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.238556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.238549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1540
2025-10-02T09:32:28.238570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.238561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1540
2025-10-02T09:32:28.238575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.238577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.238585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.238589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.238615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.238623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.238628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.238629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.238634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.238642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.238653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.238731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.238736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.238743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.238807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1541 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0
2025-10-02T09:32:28.239007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ebc7c8-25adeeb4-250e17d7-375b7799_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.241233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Write session: try to update token
2025-10-02T09:32:28.241243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.247825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.247840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.247841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.247842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.247847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.247849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.247852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342528981:9349]
2025-10-02T09:32:28.247874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.247877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.247878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.247882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.247886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.247889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.247989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.251913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId: src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.253765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.319791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069441:3893]
2025-10-02T09:32:28.319961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1540, pipe: [1:7556554930418069441:3893]
2025-10-02T09:32:28.356378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.356601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.356609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.356633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069441:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.356760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.356784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:28.356794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:28.356863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1541 reason: error at write: Disconnected sessionId: src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0
2025-10-02T09:32:28.356863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.356919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069441:3893]
2025-10-02T09:32:28.356993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1541 sessionId: src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0 is DEAD
2025-10-02T09:32:28.357108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:28.357118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Write session will restart in 0.006617s
2025-10-02T09:32:28.357134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Write session: Do CDS request
2025-10-02T09:32:28.357138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.363433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.364647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.364778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.364785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.364790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.364835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.364857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342529112:9352]
2025-10-02T09:32:28.365139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.365202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.365220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.365231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1542
2025-10-02T09:32:28.365368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.365387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.365387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.365395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.365409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.365397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.365580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.365610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.365614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.365614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.365615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.365615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.365616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.365617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.365617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.365618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.365618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.365619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.365619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.365622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.365628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.365630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.365632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.365634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.365636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.365638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.365640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.365642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.365644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.365646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.365648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.365652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.365656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.365659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.365662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.365664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.365666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.365668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.365671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.365675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.365678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.365680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.365684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.365686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.365689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.365691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.365694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.365697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.365700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.365703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.365706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.365708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.365711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.365713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.365716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.365733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.365774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1542 sessionId:  describe result for acl check
2025-10-02T09:32:28.365807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.365812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.365820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.365824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418069531:3587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.366270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418069531:3587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.367829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418069531:3587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.371897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418069531:3587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.371907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418069531:3587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.371909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418069531:3587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.371915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.373117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.374450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.374461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.374462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.374464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.374467Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1541 [2:7556554930342529112:9352]
2025-10-02T09:32:28.374475Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.374484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.374489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.374491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.374492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.374500Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.374503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.374508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.374537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.374541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.374542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.374544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.374545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.374579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.374584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.374590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.374596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.374605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.374620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069443:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.374625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069568:3587], now have 1 active actors on pipe
2025-10-02T09:32:28.374629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.374630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.374631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.374638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.374647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.374650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.374652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.374653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.374658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.374659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.374673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.374655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1541
2025-10-02T09:32:28.374676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1541
2025-10-02T09:32:28.374678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.374679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.374700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.374704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.374720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.374726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.374728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.374729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.374734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.374740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.374747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.374845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.374849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.374857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.374912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1542 partition: 0 MaxSeqNo: 36 sessionId: src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0
2025-10-02T09:32:28.375095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1487bf-9db0d7f4-45b8db32-2ebc66f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.377288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Write session: try to update token
2025-10-02T09:32:28.377299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.384475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.384491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.384493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.384495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.384502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.384506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.384510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342529107:9352]
2025-10-02T09:32:28.384537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.384541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.384545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.384545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.384547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.384548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.384664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.387915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId: src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.389829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.457006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069575:3893]
2025-10-02T09:32:28.457153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1541, pipe: [1:7556554930418069575:3893]
2025-10-02T09:32:28.492385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.492609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.492617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.492641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069575:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.492785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.492829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:28.492836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:28.492876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.492879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1542 reason: error at write: Disconnected sessionId: src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0
2025-10-02T09:32:28.492924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069575:3893]
2025-10-02T09:32:28.492997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1542 sessionId: src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0 is DEAD
2025-10-02T09:32:28.493135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:28.493145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Write session will restart in 0.007302s
2025-10-02T09:32:28.493163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Write session: Do CDS request
2025-10-02T09:32:28.493168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.499856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.501139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.501136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.501190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.501202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1543
2025-10-02T09:32:28.501240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.501247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.501252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.501273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.501293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.501279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.501296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.501298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.501303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342529237:9354]
2025-10-02T09:32:28.501643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.501663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1543 sessionId:  describe result for acl check
2025-10-02T09:32:28.501696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.501701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.501703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.501708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418069663:3583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.501801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.501823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.501998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.502027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.502031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.502031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.502032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.502033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.502033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.502034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.502034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.502035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.502035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.502036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.502036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.502039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.502046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.502048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.502050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.502052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.502054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.502056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.502058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.502060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.502062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.502064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.502066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.502069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.502074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.502077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.502080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.502082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.502084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.502086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.502089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.502091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.502094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.502096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.502098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.502101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.502103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.502105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.502107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.502110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.502112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.502115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.502117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.502119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.502122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.502126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.502128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.502146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.502140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418069663:3583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.503579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418069663:3583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.507471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418069663:3583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.507481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418069663:3583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.507484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418069663:3583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.507489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.509670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.511058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.511069Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.511070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.511072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.511076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1542 [2:7556554930342529237:9354]
2025-10-02T09:32:28.511082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.511092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.511094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.511096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.511097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.511105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.511112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.511117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.511147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.511152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.511153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.511154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.511156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.511190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.511195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.511201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.511206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.511217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.511236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069576:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.511243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069702:3583], now have 1 active actors on pipe
2025-10-02T09:32:28.511248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.511250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.511251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.511262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.511274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.511275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.511281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.511282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.511282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.511284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.511298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.511303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.511308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.511299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1542
2025-10-02T09:32:28.511314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1542
2025-10-02T09:32:28.511341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.511346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.511359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d61595-9982a8a7-da9548c3-43c982ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.511365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.511367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.511369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.511374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.511381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.511390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.511494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.511499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.511507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.511564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1543 partition: 0 MaxSeqNo: 36 sessionId: src_id|40d61595-9982a8a7-da9548c3-43c982ea_0
2025-10-02T09:32:28.511754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40d0161-d4f6be8b-c281f837-45ad2c84_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40d61595-9982a8a7-da9548c3-43c982ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.513853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Write session: try to update token
2025-10-02T09:32:28.513865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.520881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.520891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.520893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.520894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.520899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.520901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.520903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342529232:9354]
2025-10-02T09:32:28.520927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.520931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.520932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.520947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.520950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.520952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.521050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.524156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId: src_id|40d61595-9982a8a7-da9548c3-43c982ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.526048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.593194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069710:3893]
2025-10-02T09:32:28.593359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1542, pipe: [1:7556554930418069710:3893]
2025-10-02T09:32:28.631647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.631892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.631900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.631925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069710:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.632054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.632288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:28.632296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:28.632334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1543 reason: error at write: Disconnected sessionId: src_id|40d61595-9982a8a7-da9548c3-43c982ea_0
2025-10-02T09:32:28.632344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.632409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069710:3893]
2025-10-02T09:32:28.632459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1543 sessionId: src_id|40d61595-9982a8a7-da9548c3-43c982ea_0 is DEAD
2025-10-02T09:32:28.632576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:28.632585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Write session will restart in 0.006292s
2025-10-02T09:32:28.632602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Write session: Do CDS request
2025-10-02T09:32:28.632605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.639319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.640143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.640232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.640243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1544
2025-10-02T09:32:28.640362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.640383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.640390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.640392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.640653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.640748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.640754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.640748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1544 sessionId:  describe result for acl check
2025-10-02T09:32:28.640760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.640783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.640785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.640788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.640819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342529363:9356]
2025-10-02T09:32:28.640789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.640793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418069799:3573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.641158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.641241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418069799:3573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.641311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.641334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.641508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.641536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.641540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.641541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.641541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.641542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.641542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.641543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.641543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.641544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.641544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.641545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.641545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.641548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.641554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.641556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.641558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.641560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.641562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.641564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.641566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.641568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.641570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.641572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.641574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.641578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.641582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.641585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.641588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.641590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.641593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.641595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.641598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.641601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.641604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.641606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.641609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.641613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.641615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.641617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.641620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.641625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.641628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.641630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.641632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.641634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.641637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.641642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.641644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.641662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.642761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418069799:3573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.647062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418069799:3573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.647074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418069799:3573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.647077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418069799:3573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.647083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.649150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.650459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.650470Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.650472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.650474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.650477Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1543 [2:7556554930342529363:9356]
2025-10-02T09:32:28.650484Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.650494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.650497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.650499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.650500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.650510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.650516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.650520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.650550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.650555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.650556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.650558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.650559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.650645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.650651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.650657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.650663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.650673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.650661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1543
2025-10-02T09:32:28.650689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069711:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.650694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069838:3573], now have 1 active actors on pipe
2025-10-02T09:32:28.650682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1543
2025-10-02T09:32:28.650698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.650700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.650702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.650707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.650714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.650716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.650717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.650718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.650725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.650727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.650737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.650742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.650763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.650771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.650792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.650795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.650799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.650801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.650803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.650808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.650813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.650835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.650935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.650940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.650947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.650993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1544 partition: 0 MaxSeqNo: 36 sessionId: src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0
2025-10-02T09:32:28.651172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d61595-9982a8a7-da9548c3-43c982ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.653302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Write session: try to update token
2025-10-02T09:32:28.653313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.660613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.660626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.660627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.660628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.660633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.660636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.660638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342529358:9356]
2025-10-02T09:32:28.660660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.660664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.660666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.660675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.660679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.660681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.660780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.663871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId: src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.665785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.732454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069846:3893]
2025-10-02T09:32:28.732602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1543, pipe: [1:7556554930418069846:3893]
2025-10-02T09:32:28.770290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.770527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.770536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.770559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069846:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.770687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.770737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069846:3893]
2025-10-02T09:32:28.770762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:28.770769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.770821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1544 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0
2025-10-02T09:32:28.770944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1544 sessionId: src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0 is DEAD
2025-10-02T09:32:28.771058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:28.771069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Write session will restart in 0.007843s
2025-10-02T09:32:28.771083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Write session: Do CDS request
2025-10-02T09:32:28.771087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.778289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.779652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.779746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.779753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.779760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.779793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.779822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342529502:9359]
2025-10-02T09:32:28.780117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.780156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.780215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.780225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1545
2025-10-02T09:32:28.780319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.780338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.780340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.780341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.780342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.780363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.780535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.780561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.780565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.780566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.780566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.780567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.780567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.780568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.780569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.780569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.780570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.780570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.780571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.780573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.780579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.780581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.780584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.780586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.780588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.780590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.780592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.780594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.780596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.780598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.780600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.780603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.780607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.780610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.780613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.780616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.780619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.780621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.780624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.780626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.780629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.780631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.780634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.780636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.780638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.780641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.780643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.780646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.780649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.780651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.780653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.780655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.780658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.780660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.780664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.780682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.780669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1545 sessionId:  describe result for acl check
2025-10-02T09:32:28.780708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.780713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.780715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.780719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418069938:3570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.781156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418069938:3570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.782500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418069938:3570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.786979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418069938:3570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.786992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418069938:3570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.786995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418069938:3570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.787000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.788113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.789515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.789526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.789528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.789530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.789533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1544 [2:7556554930342529502:9359]
2025-10-02T09:32:28.789540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.789549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.789550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.789552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.789553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.789561Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.789566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.789569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.789600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.789605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.789606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.789608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.789610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.789643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.789648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.789654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.789660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.789667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.789680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.789685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.789686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.789691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.789698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069847:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.789699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.789702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.789703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069975:3570], now have 1 active actors on pipe
2025-10-02T09:32:28.789704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.789708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.789715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.789717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.789732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.789737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.789741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.789729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1544
2025-10-02T09:32:28.789742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1544
2025-10-02T09:32:28.789762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.789767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.789781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.789788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.789790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.789791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.789796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.789802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.789813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.789922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.789926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.789934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.789990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1545 partition: 0 MaxSeqNo: 36 sessionId: src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0
2025-10-02T09:32:28.790144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4286f0-96f8ca5b-e6ed9040-870d2374_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.792454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Write session: try to update token
2025-10-02T09:32:28.792466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.798754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:28.798769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.798785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.798813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:28.798813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:28.798949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:28.799063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:28.799215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:28.799342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:28.799505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:28.799530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:28.803043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId: src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.804916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:28.805303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.805312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.805329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:28.805398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:28.807083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.807098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.807101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.807103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.807108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.807112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.807115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342529497:9359]
2025-10-02T09:32:28.807135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.807139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.807140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.807149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.807154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.807156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.807264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.870675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554930418069988:3893]
2025-10-02T09:32:28.870854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1544, pipe: [1:7556554930418069988:3893]
2025-10-02T09:32:28.918761Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:28.924525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.924541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.924652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.924706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.924764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.924824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.924977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.924985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.925036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.925084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.925137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.925186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.925226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.925234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.925285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.925330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.925380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.925428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.925697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.925704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.925757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.925806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.925854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.925903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.925937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.925942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.926000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.926050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.926098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.926146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.926178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.926183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.926238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.926292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.926340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.926388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.926422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.926426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.926475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.926531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.926583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.926633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.926674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.926678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.926726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.926789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.926838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.926886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.926918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.926923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.926970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.927027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.927081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.927128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.927161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.927166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.927214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:28.927264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:28.927308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:28.927353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:28.927386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:28.927390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:28.927420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418069988:3893], now have 1 active actors on pipe
2025-10-02T09:32:28.927584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:28.927598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:28.927615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1545 reason: error at write: Disconnected sessionId: src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0
2025-10-02T09:32:28.927633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:28.927686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554930418069988:3893]
2025-10-02T09:32:28.927738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:28.927824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1545 sessionId: src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0 is DEAD
2025-10-02T09:32:28.927959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:28.927970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Write session will restart in 0.007545s
2025-10-02T09:32:28.927987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Write session: Do CDS request
2025-10-02T09:32:28.927992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:28.934760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:28.936106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:28.936134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.936201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:28.936191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:28.936208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:28.936216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:28.936201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1546
2025-10-02T09:32:28.936248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:28.936274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554930342529629:9361]
2025-10-02T09:32:28.936327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:28.936347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:28.936352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:28.936355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:28.936620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:28.936718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1546 sessionId:  describe result for acl check
2025-10-02T09:32:28.936752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:28.936757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:28.936759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:28.936763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554930418070096:3563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:28.936790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:28.936834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:28.937033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:28.937064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.937068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.937069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.937069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.937070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.937070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.937071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.937071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.937072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.937072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.937073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.937073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.937076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.937083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.937085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.937087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.937089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.937091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.937093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.937095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.937097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.937099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.937101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.937103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.937107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.937111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:28.937114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.937117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:28.937119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.937122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:28.937124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.937126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:28.937130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.937133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:28.937135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.937137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:28.937139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.937142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:28.937144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.937147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:28.937149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.937152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:28.937154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.937156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.937158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.937161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.937163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.937166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.937182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:28.937241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554930418070096:3563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:28.938663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554930418070096:3563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:28.943357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554930418070096:3563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:28.943367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554930418070096:3563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:28.943370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554930418070096:3563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:28.943374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:28.944528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:28.945957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:28.945970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:28.945971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:28.945973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:28.945976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1545 [2:7556554930342529629:9361]
2025-10-02T09:32:28.945983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:28.945992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:28.945997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.945998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.945999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.946008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:28.946011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:28.946015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:28.946043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.946048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.946049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.946051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:28.946052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:28.946088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:28.946093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.946100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:28.946105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:28.946113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:28.946127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418070133:3563], now have 1 active actors on pipe
2025-10-02T09:32:28.946132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554930418070004:2446], now have 1 active actors on pipe
2025-10-02T09:32:28.946135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.946137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.946138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.946146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:28.946157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:28.946160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:28.946162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:28.946163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:28.946167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:28.946169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:28.946155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1545
2025-10-02T09:32:28.946181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.946187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:28.946188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:28.946183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1545
2025-10-02T09:32:28.946210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.946216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.946232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:28.946239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:28.946242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:28.946243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:28.946247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:28.946255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:28.946261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.946335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:28.946340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:28.946347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:28.946404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1546 partition: 0 MaxSeqNo: 36 sessionId: src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0
2025-10-02T09:32:28.946582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137bc738-c72d9131-6a9b43e2-fa548e0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:28.948833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Write session: try to update token
2025-10-02T09:32:28.948844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:28.955400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:28.955413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:28.955415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:28.955417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:28.955421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.955424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.955426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554930342529624:9361]
2025-10-02T09:32:28.955449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:28.955453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:28.955454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:28.955457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:28.955461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:28.955464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:28.955560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:28.959513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId: src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:28.961921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.027861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713037459:3893]
2025-10-02T09:32:29.028008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1545, pipe: [1:7556554934713037459:3893]
2025-10-02T09:32:29.064279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.064622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.064630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.064653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037459:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.064769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.064792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713037459:3893]
2025-10-02T09:32:29.064826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:29.064859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.064876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0
2025-10-02T09:32:29.064993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1546 sessionId: src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0 is DEAD
2025-10-02T09:32:29.065098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:29.065108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Write session will restart in 0.007947s
2025-10-02T09:32:29.065123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Write session: Do CDS request
2025-10-02T09:32:29.065127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.072249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.073549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.073652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.073659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.073665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.073694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.073724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497092:9376]
2025-10-02T09:32:29.074086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.074115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.074201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.074213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1547
2025-10-02T09:32:29.074267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.074290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.074285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.074305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.074311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.074313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.074488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.074521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.074525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.074526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.074526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.074527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.074527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.074528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.074528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.074529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.074529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.074530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.074530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.074533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.074540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.074542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.074544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.074546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.074547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.074549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.074551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.074553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.074555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.074557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.074559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.074563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.074567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.074570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.074573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.074576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.074579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.074581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.074584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.074586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.074588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.074591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.074593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.074595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.074598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.074600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.074603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.074605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.074608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.074610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.074613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.074617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.074620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.074622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.074624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.074641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.074686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1547 sessionId:  describe result for acl check
2025-10-02T09:32:29.074725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.074730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.074732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.074737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713037553:3547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.075202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713037553:3547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.077201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713037553:3547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.080939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713037553:3547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.080952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713037553:3547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.080954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713037553:3547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.080960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.082025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.083387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.083399Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.083400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.083403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.083407Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1546 [2:7556554934637497092:9376]
2025-10-02T09:32:29.083415Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.083427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.083434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.083436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.083437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.083445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.083448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.083452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.083482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.083488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.083489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.083491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.083492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.083529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.083534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.083540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.083545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.083553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.083565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037589:3547], now have 1 active actors on pipe
2025-10-02T09:32:29.083571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037460:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.083574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.083575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.083576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.083583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.083590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.083596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.083597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.083599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.083603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.083604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.083611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.083598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1546
2025-10-02T09:32:29.083612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.083616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.083614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1546
2025-10-02T09:32:29.083630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.083636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.083653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7003be03-62c16ed-a2a81801-500f5ab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.083659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.083661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.083663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.083670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.083680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.083691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.083774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.083779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.083787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.083837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1547 partition: 0 MaxSeqNo: 36 sessionId: src_id|7003be03-62c16ed-a2a81801-500f5ab9_0
2025-10-02T09:32:29.084015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ee0df0-a3311144-c46eb127-a359e8b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7003be03-62c16ed-a2a81801-500f5ab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.086098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Write session: try to update token
2025-10-02T09:32:29.086108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.092888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.092899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.092900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.092901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.092906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.092909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.092911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497087:9376]
2025-10-02T09:32:29.092933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.092937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.092938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.092948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.092958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.092960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.093058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.096251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId: src_id|7003be03-62c16ed-a2a81801-500f5ab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.098141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.165087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713037597:3893]
2025-10-02T09:32:29.165230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1546, pipe: [1:7556554934713037597:3893]
2025-10-02T09:32:29.200835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.201128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.201136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.201159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037597:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.201293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.201308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:29.201316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:29.201352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1547 reason: error at write: Disconnected sessionId: src_id|7003be03-62c16ed-a2a81801-500f5ab9_0
2025-10-02T09:32:29.201359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.201402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713037597:3893]
2025-10-02T09:32:29.201476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1547 sessionId: src_id|7003be03-62c16ed-a2a81801-500f5ab9_0 is DEAD
2025-10-02T09:32:29.201592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:29.201602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Write session will restart in 0.009357s
2025-10-02T09:32:29.201616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Write session: Do CDS request
2025-10-02T09:32:29.201620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.208784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.210085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.210181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.210187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.210193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.210218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.210241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497221:9378]
2025-10-02T09:32:29.210588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.210746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.210768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.210954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.210983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.210986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.210987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.210987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.210988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.210988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.210989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.210989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.210990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.210990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.210991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.210991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.210994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.211001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.211003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.211005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.211007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.211009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.211011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.211013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.211015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.211018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.211019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.211021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.211025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.211029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.211033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.211035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.211037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.211040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.211042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.211045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.211047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.211049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.211052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.211058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.211060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.211062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.211064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.211067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.211069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.211072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.211074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.211076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.211082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.211085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.211087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.211090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.211106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.212118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.212216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.212227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1548
2025-10-02T09:32:29.212356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.212374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.212377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.212380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.212738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1548 sessionId:  describe result for acl check
2025-10-02T09:32:29.212774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.212779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.212781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.212785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713037697:3540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.213248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713037697:3540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.214649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713037697:3540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.217937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713037697:3540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.217948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713037697:3540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.217953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713037697:3540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.217959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.218471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.219792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.219802Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.219803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.219805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.219809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1547 [2:7556554934637497221:9378]
2025-10-02T09:32:29.219816Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.219825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.219826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.219828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.219829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.219838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.219841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.219847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.219875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.219880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.219881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.219883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.219884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.219918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.219922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.219929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.219934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.219944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.219958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037732:3540], now have 1 active actors on pipe
2025-10-02T09:32:29.219963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037599:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.219967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.219969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.219970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.219977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.219988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.219989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.219991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.219992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.219998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.220000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.219990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1547
2025-10-02T09:32:29.220005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1547
2025-10-02T09:32:29.220021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.220026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.220027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.220036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.220041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.220066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.220073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.220075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.220076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.220081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.220087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.220098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.220177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.220182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.220190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.220240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1548 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0
2025-10-02T09:32:29.220446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7003be03-62c16ed-a2a81801-500f5ab9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.222673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Write session: try to update token
2025-10-02T09:32:29.222685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.229292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.229306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.229307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.229308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.229314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.229317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.229319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497216:9378]
2025-10-02T09:32:29.229341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.229342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.229345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.229346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.229347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.229348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.229483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.233335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId: src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.235165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.301798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713037739:3893]
2025-10-02T09:32:29.301951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1547, pipe: [1:7556554934713037739:3893]
2025-10-02T09:32:29.337823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.338133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.338142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.338167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037739:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.338287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.338329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:29.338338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:29.338380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1548 reason: error at write: Disconnected sessionId: src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0
2025-10-02T09:32:29.338384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713037739:3893]
2025-10-02T09:32:29.338413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.338498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1548 sessionId: src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0 is DEAD
2025-10-02T09:32:29.338622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:29.338632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Write session will restart in 0.009409s
2025-10-02T09:32:29.338650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Write session: Do CDS request
2025-10-02T09:32:29.338654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.345674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.347001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.347100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.347107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.347112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.347137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.347161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497354:9381]
2025-10-02T09:32:29.347494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.347647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.347668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.347841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.347869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.347872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.347873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.347873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.347874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.347874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.347875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.347875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.347876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.347876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.347877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.347877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.347880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.347887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.347890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.347892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.347894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.347896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.347898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.347900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.347902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.347904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.347906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.347908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.347912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.347915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.347919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.347922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.347925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.347927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.347929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.347932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.347935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.347938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.347941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.347943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.347945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.347950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.347956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.347959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.347961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.347963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.347965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.347968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.347970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.347976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.347993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.349123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.349202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.349214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1549
2025-10-02T09:32:29.349307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.349325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.349329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.349331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.349594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1549 sessionId:  describe result for acl check
2025-10-02T09:32:29.349621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.349623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.349624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.349627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713037837:3530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.349989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713037837:3530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.351282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713037837:3530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.354837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713037837:3530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.354848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713037837:3530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.354852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713037837:3530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.354856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.355364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.356674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.356686Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.356687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.356689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.356693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1548 [2:7556554934637497354:9381]
2025-10-02T09:32:29.356699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.356708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.356712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.356713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.356715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.356724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.356726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.356730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.356759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.356764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.356765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.356767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.356768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.356819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.356826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.356834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.356843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.356851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.356865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037740:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.356871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037872:3530], now have 1 active actors on pipe
2025-10-02T09:32:29.356875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.356876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.356877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.356885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.356896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.356884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1548
2025-10-02T09:32:29.356905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.356888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1548
2025-10-02T09:32:29.356912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.356914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.356915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.356917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.356939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.356945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.356952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.356959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.356971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.356976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17857127-41382aa-84d9cb8-4ab7f235_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.356980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.356982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.356983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.356988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.356993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.357056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.357147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.357152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.357159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.357209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1549 partition: 0 MaxSeqNo: 36 sessionId: src_id|17857127-41382aa-84d9cb8-4ab7f235_0
2025-10-02T09:32:29.357389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6f0323-12036d24-87f20398-6eb1ad27_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17857127-41382aa-84d9cb8-4ab7f235_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.359467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Write session: try to update token
2025-10-02T09:32:29.359477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.366140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.366153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.366155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.366156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.366161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.366163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.366165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497349:9381]
2025-10-02T09:32:29.366186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.366192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.366195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.366238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.366249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.366251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.366316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.369575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId: src_id|17857127-41382aa-84d9cb8-4ab7f235_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.371378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.438724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713037880:3893]
2025-10-02T09:32:29.438941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1548, pipe: [1:7556554934713037880:3893]
2025-10-02T09:32:29.474724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.474928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.474937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.474961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037880:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.475078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.475104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713037880:3893]
2025-10-02T09:32:29.475125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.475125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:29.475179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17857127-41382aa-84d9cb8-4ab7f235_0
2025-10-02T09:32:29.475329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1549 sessionId: src_id|17857127-41382aa-84d9cb8-4ab7f235_0 is DEAD
2025-10-02T09:32:29.475436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:29.475446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Write session will restart in 0.008631s
2025-10-02T09:32:29.475460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Write session: Do CDS request
2025-10-02T09:32:29.475464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.482316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.483675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.483771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.483777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.483783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.483808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.483833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497486:9383]
2025-10-02T09:32:29.484173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.484330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.484352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.484525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.484553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.484556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.484557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.484558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.484558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.484559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.484559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.484560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.484560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.484561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.484561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.484562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.484564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.484571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.484573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.484575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.484577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.484579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.484581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.484583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.484585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.484587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.484589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.484591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.484596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.484600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.484603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.484606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.484608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.484610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.484612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.484615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.484617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.484620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.484622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.484625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.484629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.484631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.484633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.484636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.484638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.484641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.484643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.484646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.484652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.484654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.484657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.484659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.484676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.485157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.485208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.485218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1550
2025-10-02T09:32:29.485316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.485342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.485350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.485352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.485660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1550 sessionId:  describe result for acl check
2025-10-02T09:32:29.485685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.485691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.485692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.485695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713037979:3527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.486067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713037979:3527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.487460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713037979:3527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.491471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713037979:3527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.491482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713037979:3527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.491484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713037979:3527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.491488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.492025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.493376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.493387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.493388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.493390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.493393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1549 [2:7556554934637497486:9383]
2025-10-02T09:32:29.493400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.493410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.493415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.493417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.493418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.493427Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.493430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.493434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.493463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.493467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.493468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.493470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.493471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.493505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.493509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.493515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.493520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.493531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.493545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713037881:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.493550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038014:3527], now have 1 active actors on pipe
2025-10-02T09:32:29.493553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.493554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.493555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.493563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.493573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.493576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.493578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.493579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.493584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.493585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.493600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.493608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.493610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.493604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1549
2025-10-02T09:32:29.493606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1549
2025-10-02T09:32:29.493630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.493635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.493650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57c1e58c-1a191aed-6de70638-b621d64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.493656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.493658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.493659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.493664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.493672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.493682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.493766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.493771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.493778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.493830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1550 partition: 0 MaxSeqNo: 36 sessionId: src_id|57c1e58c-1a191aed-6de70638-b621d64a_0
2025-10-02T09:32:29.494009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17857127-41382aa-84d9cb8-4ab7f235_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|57c1e58c-1a191aed-6de70638-b621d64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.496076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Write session: try to update token
2025-10-02T09:32:29.496085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.502866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.502881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.502883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.502884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.502891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.502893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.502895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497481:9383]
2025-10-02T09:32:29.502917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.502920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.502921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.502935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.502939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.502941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.503035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.506321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId: src_id|57c1e58c-1a191aed-6de70638-b621d64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.508177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.575212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713038022:3893]
2025-10-02T09:32:29.575374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1549, pipe: [1:7556554934713038022:3893]
2025-10-02T09:32:29.612886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.613188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.613201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.613240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038022:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.613419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:29.613429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:29.613432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713038022:3893]
2025-10-02T09:32:29.613448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.613471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1550 reason: error at write: Disconnected sessionId: src_id|57c1e58c-1a191aed-6de70638-b621d64a_0
2025-10-02T09:32:29.613598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1550 sessionId: src_id|57c1e58c-1a191aed-6de70638-b621d64a_0 is DEAD
2025-10-02T09:32:29.613681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.613743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:29.613755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Write session will restart in 0.009013s
2025-10-02T09:32:29.613779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Write session: Do CDS request
2025-10-02T09:32:29.613785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.620506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.620826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.620920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.620927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.620932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.620956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.620979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497619:9385]
2025-10-02T09:32:29.621319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.621476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.621498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.621672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.621700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.621704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.621705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.621705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.621706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.621706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.621707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.621707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.621707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.621708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.621708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.621709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.621712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.621718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.621720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.621722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.621724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.621726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.621728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.621730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.621731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.621734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.621736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.621737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.621741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.621745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.621748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.621751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.621753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.621756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.621758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.621760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.621762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.621765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.621767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.621770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.621773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.621775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.621778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.621780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.621782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.621785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.621786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.621789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.621791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.621793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.621796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.621798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.621814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.624158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.624227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.624237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1551
2025-10-02T09:32:29.624332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.624352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.624355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.624358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.624606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1551 sessionId:  describe result for acl check
2025-10-02T09:32:29.624625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.624626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.624628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.624631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713038123:3524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.625010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713038123:3524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.626202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713038123:3524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.628590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713038123:3524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.628602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713038123:3524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.628604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713038123:3524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.628609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.629191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.630563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.630574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.630575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.630578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.630582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1550 [2:7556554934637497619:9385]
2025-10-02T09:32:29.630588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.630597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.630602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.630604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.630605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.630614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.630619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.630623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.630652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.630657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.630658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.630659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.630661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.630697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.630701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.630708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.630713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.630724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.630737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038023:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.630742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038158:3524], now have 1 active actors on pipe
2025-10-02T09:32:29.630745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.630746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.630747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.630754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.630760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.630768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.630780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.630781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.630782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.630783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.630769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1550
2025-10-02T09:32:29.630770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1550
2025-10-02T09:32:29.630799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.630804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.630806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.630815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.630820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.630843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fde02165-f90413e6-963f479b-b93d155d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.630850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.630852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.630853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.630858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.630864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.630874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.630976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.630981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.630989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.631041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1551 partition: 0 MaxSeqNo: 36 sessionId: src_id|fde02165-f90413e6-963f479b-b93d155d_0
2025-10-02T09:32:29.631235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1e58c-1a191aed-6de70638-b621d64a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fde02165-f90413e6-963f479b-b93d155d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.634008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Write session: try to update token
2025-10-02T09:32:29.634022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.641258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.641269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.641270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.641271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.641275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.641277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.641279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497614:9385]
2025-10-02T09:32:29.641296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.641301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.641302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.641302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.641305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.641307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.641426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.646178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId: src_id|fde02165-f90413e6-963f479b-b93d155d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.651424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.713435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713038170:3893]
2025-10-02T09:32:29.713594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1550, pipe: [1:7556554934713038170:3893]
2025-10-02T09:32:29.755182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.755421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.755430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.755442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038170:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.755561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.755621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713038170:3893]
2025-10-02T09:32:29.755626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.755645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:29.755696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fde02165-f90413e6-963f479b-b93d155d_0
2025-10-02T09:32:29.755826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1551 sessionId: src_id|fde02165-f90413e6-963f479b-b93d155d_0 is DEAD
2025-10-02T09:32:29.755988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:29.755999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Write session will restart in 0.009559s
2025-10-02T09:32:29.756019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Write session: Do CDS request
2025-10-02T09:32:29.756025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.762357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.762659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.762753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.762759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.762765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.762799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.762823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497753:9387]
2025-10-02T09:32:29.763164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.763310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.763331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.763502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.763530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.763534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.763535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.763535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.763536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.763536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.763537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.763537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.763538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.763538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.763539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.763539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.763542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.763548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.763551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.763553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.763555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.763557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.763559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.763561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.763563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.763565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.763567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.763569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.763572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.763576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.763579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.763582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.763584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.763587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.763589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.763592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.763594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.763596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.763599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.763601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.763603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.763606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.763608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.763610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.763612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.763615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.763617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.763619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.763621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.763625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.763627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.763630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.763647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.766159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.766236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.766246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1552
2025-10-02T09:32:29.766317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.766336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.766341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.766344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.766581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1552 sessionId:  describe result for acl check
2025-10-02T09:32:29.766604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.766610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.766611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.766615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713038352:3517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.766917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713038352:3517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.767821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713038352:3517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.770438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713038352:3517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.770448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713038352:3517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.770450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713038352:3517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.770453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.770983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.772497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.772507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.772508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.772510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.772513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1551 [2:7556554934637497753:9387]
2025-10-02T09:32:29.772520Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.772528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.772530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.772531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.772532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.772541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.772547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.772551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.772580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.772584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.772585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.772587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.772588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.772625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.772630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.772636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.772641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.772649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.772663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038388:3517], now have 1 active actors on pipe
2025-10-02T09:32:29.772669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038173:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.772672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.772673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.772674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.772681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.772692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.772695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.772697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.772699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.772701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.772703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.772694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1551
2025-10-02T09:32:29.772695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1551
2025-10-02T09:32:29.772717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.772722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.772725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.772734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.772739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.772763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.772770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.772772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.772776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.772782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.772789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.772815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.772900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.772905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.772912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.772963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1552 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0
2025-10-02T09:32:29.773174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde02165-f90413e6-963f479b-b93d155d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.775910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Write session: try to update token
2025-10-02T09:32:29.775923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.781694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.781705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.781706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.781707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.781711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.781713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.781715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497748:9387]
2025-10-02T09:32:29.781733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.781735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.781736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.781738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.781738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.781740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.781842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.788853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId: src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.790947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.855764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713038403:3893]
2025-10-02T09:32:29.855929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1551, pipe: [1:7556554934713038403:3893]
2025-10-02T09:32:29.892634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:29.892847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.892861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.892874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038403:3893], now have 1 active actors on pipe
2025-10-02T09:32:29.893009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713038403:3893]
2025-10-02T09:32:29.893017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:29.893021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:29.893029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:29.893063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1552 reason: error at write: Disconnected sessionId: src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0
2025-10-02T09:32:29.893197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1552 sessionId: src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0 is DEAD
2025-10-02T09:32:29.893302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:29.893312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Write session will restart in 0.006748s
2025-10-02T09:32:29.893326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Write session: Do CDS request
2025-10-02T09:32:29.893329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:29.893420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:29.899502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:29.899911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:29.900006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:29.900013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:29.900019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:29.900043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:29.900066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554934637497900:9390]
2025-10-02T09:32:29.900662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:29.900820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:29.900848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:29.901027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:29.901056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.901060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.901061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.901061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.901062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.901062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.901063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.901063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.901064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.901064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.901065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.901065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.901068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.901074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.901077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.901079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.901081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.901083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.901085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.901087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.901089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.901091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.901093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.901095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.901099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.901103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:29.901106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.901109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:29.901111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.901142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.901113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:29.901116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.901119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:29.901121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.901124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:29.901126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.901128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:29.901130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.901133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:29.901135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.901138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:29.901141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.901144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:29.901146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.901148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.901150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.901154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.901156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.901158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.901175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:29.901260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:29.901268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1553
2025-10-02T09:32:29.901380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:29.901403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:29.901414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:29.901417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:29.901670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1553 sessionId:  describe result for acl check
2025-10-02T09:32:29.901696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:29.901697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:29.901698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:29.901701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554934713038597:3507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:29.902020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554934713038597:3507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:29.903148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554934713038597:3507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:29.907242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554934713038597:3507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:29.907251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554934713038597:3507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:29.907253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554934713038597:3507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:29.907256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:29.908444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:29.909763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:29.909775Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:29.909776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:29.909778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:29.909781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1552 [2:7556554934637497900:9390]
2025-10-02T09:32:29.909788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:29.909798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:29.909799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.909801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.909802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.909811Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:29.909813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:29.909817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:29.909849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.909854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.909855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.909856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:29.909857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:29.909891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:29.909895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.909901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:29.909906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:29.909914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:29.909928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038632:3507], now have 1 active actors on pipe
2025-10-02T09:32:29.909933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038419:2446], now have 1 active actors on pipe
2025-10-02T09:32:29.909936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.909937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.909938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.909945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:29.909955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:29.909959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:29.909961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:29.909963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:29.909966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:29.909967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:29.909980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.909985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:29.909987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:29.909970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1552
2025-10-02T09:32:29.909975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1552
2025-10-02T09:32:29.909998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.910003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.910021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:29.910028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:29.910030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:29.910034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:29.910040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:29.910048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:29.910060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.910139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:29.910144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:29.910151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:29.910197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1553 partition: 0 MaxSeqNo: 36 sessionId: src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0
2025-10-02T09:32:29.910373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2bdc865-7368d683-c868eea2-bb3e40d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:29.912765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Write session: try to update token
2025-10-02T09:32:29.912776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:29.919190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:29.919204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:29.919206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:29.919207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:29.919212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.919214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.919217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554934637497895:9390]
2025-10-02T09:32:29.919239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:29.919242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:29.919242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:29.919243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:29.919246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:29.919249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:29.919356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:29.924615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId: src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:29.926713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:29.993012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554934713038652:3893]
2025-10-02T09:32:29.993218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1552, pipe: [1:7556554934713038652:3893]
2025-10-02T09:32:30.031397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.031710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.031719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.031732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554934713038652:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.031865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.031910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.031946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554934713038652:3893]
2025-10-02T09:32:30.031976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:30.032073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1553 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0
2025-10-02T09:32:30.032264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1553 sessionId: src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0 is DEAD
2025-10-02T09:32:30.032401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:30.032411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Write session will restart in 0.007569s
2025-10-02T09:32:30.032432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Write session: Do CDS request
2025-10-02T09:32:30.032436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.038322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.038698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.038809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.038815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.038822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.038848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.038872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932465369:9405]
2025-10-02T09:32:30.039228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.039393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.039417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.039590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.039617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.039621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.039622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.039622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.039623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.039623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.039624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.039625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.039625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.039626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.039626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.039627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.039629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.039636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.039638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.039640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.039642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.039644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.039646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.039648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.039650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.039652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.039654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.039656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.039659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.039664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.039667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.039670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.039672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.039675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.039677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.039680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.039682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.039686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.039688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.039690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.039693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.039695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.039697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.039700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.039702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.039705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.039707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.039709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.039711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.039714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.039719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.039722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.039739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.041130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.041280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.041290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1554
2025-10-02T09:32:30.041627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.041650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.041659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.041663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.042005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1554 sessionId:  describe result for acl check
2025-10-02T09:32:30.042041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.042046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.042047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.042052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008006138:3493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.042505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008006138:3493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.044285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008006138:3493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.046671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008006138:3493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.046680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008006138:3493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.046683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008006138:3493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.046688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.047067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.048379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.048391Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.048393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.048395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.048398Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1553 [2:7556554938932465369:9405]
2025-10-02T09:32:30.048406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.048417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.048418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.048420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.048421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.048430Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.048436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.048440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.048469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.048474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.048475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.048477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.048479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.048514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.048519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.048525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.048534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.048542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.048555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006173:3493], now have 1 active actors on pipe
2025-10-02T09:32:30.048560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008005959:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.048564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.048565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.048566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.048574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.048586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.048592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.048597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.048599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.048599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.048588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1553
2025-10-02T09:32:30.048601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.048603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1553
2025-10-02T09:32:30.048614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.048620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.048621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.048631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.048636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.048662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.048669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.048671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.048672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.048677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.048686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.048694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.048789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.048794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.048813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.048871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1554 partition: 0 MaxSeqNo: 36 sessionId: src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0
2025-10-02T09:32:30.049079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7f168-2543d1d3-ca2ea28d-79904ef8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.051169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Write session: try to update token
2025-10-02T09:32:30.051179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.057881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.057895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.057896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.057897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.057902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.057904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.057907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932465364:9405]
2025-10-02T09:32:30.057926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.057930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.057931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.057962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.057978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.057983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.058044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.061899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId: src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.064305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.132268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008006183:3893]
2025-10-02T09:32:30.132452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1553, pipe: [1:7556554939008006183:3893]
2025-10-02T09:32:30.175010Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.175363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.175372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.175396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006183:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.175514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.175534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008006183:3893]
2025-10-02T09:32:30.175554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.175599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:30.175688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0
2025-10-02T09:32:30.175857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1554 sessionId: src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0 is DEAD
2025-10-02T09:32:30.176000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:30.176012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Write session will restart in 0.009271s
2025-10-02T09:32:30.176027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Write session: Do CDS request
2025-10-02T09:32:30.176032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.181879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.182320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.182414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.182421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.182429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.182456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.182480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932465508:9407]
2025-10-02T09:32:30.182837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.183007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.183035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.183228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.183258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.183262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.183263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.183263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.183264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.183264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.183265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.183265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.183266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.183266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.183267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.183268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.183270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.183277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.183279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.183281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.183283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.183285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.183287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.183289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.183291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.183293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.183295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.183297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.183301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.183305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.183308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.183310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.183313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.183315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.183318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.183320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.183322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.183325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.183326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.183329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.183331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.183334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.183336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.183338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.183342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.183344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.183346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.183349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.183350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.183353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.183355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.183358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.183375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.186174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.186255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.186268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1555
2025-10-02T09:32:30.186370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.186390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.186394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.186396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.186707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1555 sessionId:  describe result for acl check
2025-10-02T09:32:30.186733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.186740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.186741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.186744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008006369:3480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.187167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008006369:3480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.188619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008006369:3480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.190535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008006369:3480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.190546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008006369:3480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.190549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008006369:3480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.190555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.190729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.192160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.192174Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.192176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.192178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.192182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1554 [2:7556554938932465508:9407]
2025-10-02T09:32:30.192193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.192203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.192206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.192207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.192208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.192217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.192222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.192226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.192257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.192262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.192263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.192265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.192266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.192298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.192303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.192310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.192315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.192325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.192339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006188:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.192345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006404:3480], now have 1 active actors on pipe
2025-10-02T09:32:30.192349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.192350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.192351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.192358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.192367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.192371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.192373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.192374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.192376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.192377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.192367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1554
2025-10-02T09:32:30.192379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1554
2025-10-02T09:32:30.192393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.192399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.192400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.192413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.192420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.192446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.192453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.192456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.192457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.192462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.192468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.192479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.192569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.192574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.192581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.192643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1555 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0
2025-10-02T09:32:30.192834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aeeb194-e0e1a8ad-515d7ea5-c59852_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.194970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Write session: try to update token
2025-10-02T09:32:30.194979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.202226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.202240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.202241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.202242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.202247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.202250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.202252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932465503:9407]
2025-10-02T09:32:30.202275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.202279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.202280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.202292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.202295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.202298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.202394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.205583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId: src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.207837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.275609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008006414:3893]
2025-10-02T09:32:30.275794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1554, pipe: [1:7556554939008006414:3893]
2025-10-02T09:32:30.317704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.317916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.317926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.317951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006414:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.318109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.318137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.318166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:30.318168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:30.318211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008006414:3893]
2025-10-02T09:32:30.318213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1555 reason: error at write: Disconnected sessionId: src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0
2025-10-02T09:32:30.318439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1555 sessionId: src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0 is DEAD
2025-10-02T09:32:30.318565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:30.318576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Write session will restart in 0.009217s
2025-10-02T09:32:30.318591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Write session: Do CDS request
2025-10-02T09:32:30.318596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.325825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.326367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.326461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.326467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.326473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.326497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.326519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932465648:9410]
2025-10-02T09:32:30.326870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.327025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.327047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.327230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.327259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.327263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.327263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.327264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.327264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.327265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.327266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.327267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.327267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.327268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.327269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.327270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.327274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.327283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.327287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.327290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.327293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.327295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.327298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.327301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.327304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.327307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.327311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.327314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.327319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.327324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.327327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.327334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.327336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.327339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.327344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.327347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.327350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.327356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.327358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.327360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.327364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.327369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.327372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.327374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.327377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.327379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.327384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.327387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.327389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.327392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.327397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.327399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.327417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.329117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.329223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.329231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1556
2025-10-02T09:32:30.329300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.329320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.329330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.329334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.329599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1556 sessionId:  describe result for acl check
2025-10-02T09:32:30.329619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.329626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.329627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.329630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008006603:3478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.329983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008006603:3478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.331446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008006603:3478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.334327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008006603:3478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.334337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008006603:3478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.334339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008006603:3478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.334344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.334839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.336144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.336155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.336157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.336159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.336162Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1555 [2:7556554938932465648:9410]
2025-10-02T09:32:30.336169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.336180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.336185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.336187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.336188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.336196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.336199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.336203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.336231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.336237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.336238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.336239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.336241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.336277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.336282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.336288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.336293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.336304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.336318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006638:3478], now have 1 active actors on pipe
2025-10-02T09:32:30.336323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006415:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.336327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.336328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.336329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.336337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.336347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.336350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.336352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.336353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.336358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.336360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.336356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1555
2025-10-02T09:32:30.336373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.336377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1555
2025-10-02T09:32:30.336378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.336379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.336388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.336393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.336418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.336425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.336427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.336428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.336433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.336441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.336452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.336550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.336555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.336562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.336607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1556 partition: 0 MaxSeqNo: 36 sessionId: src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0
2025-10-02T09:32:30.336819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b1d44b-6199664f-d5621d90-3bd8d1da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.338920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Write session: try to update token
2025-10-02T09:32:30.338929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.345690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.345705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.345707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.345708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.345713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.345715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.345717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932465643:9410]
2025-10-02T09:32:30.345737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.345740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.345742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.345755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.345759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.345762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.345852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.349309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId: src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.351450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.418487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008006646:3893]
2025-10-02T09:32:30.418686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1555, pipe: [1:7556554939008006646:3893]
2025-10-02T09:32:30.456470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.456684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.456693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.456718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006646:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.456899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.456932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:30.456941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:30.456988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1556 reason: error at write: Disconnected sessionId: src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0
2025-10-02T09:32:30.456997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008006646:3893]
2025-10-02T09:32:30.457038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.457126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1556 sessionId: src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0 is DEAD
2025-10-02T09:32:30.457250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:30.457258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Write session will restart in 0.006249s
2025-10-02T09:32:30.457278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Write session: Do CDS request
2025-10-02T09:32:30.457282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.464042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.464145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.464251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.464261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1557
2025-10-02T09:32:30.464390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.464411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.464418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.464421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.464503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.464617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.464624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.464630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.464658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.464683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932465787:9412]
2025-10-02T09:32:30.464782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1557 sessionId:  describe result for acl check
2025-10-02T09:32:30.464830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.464836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.464838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.464844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008006825:3472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.465038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.465203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.465227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.465299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008006825:3472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.465411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.465442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.465446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.465447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.465447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.465448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.465448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.465449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.465449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.465450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.465450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.465451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.465451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.465454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.465460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.465462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.465464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.465466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.465468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.465470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.465472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.465474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.465476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.465477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.465479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.465483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.465487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.465490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.465493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.465495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.465498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.465500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.465502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.465505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.465507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.465509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.465512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.465514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.465517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.465519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.465522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.465524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.465526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.465529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.465532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.465535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.465538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.465540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.465542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.465559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.467093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008006825:3472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.471799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008006825:3472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.471810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008006825:3472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.471813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008006825:3472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.471862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.472903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.474277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.474287Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.474288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.474291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.474294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1556 [2:7556554938932465787:9412]
2025-10-02T09:32:30.474300Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.474309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.474313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.474315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.474317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.474325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.474331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.474335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.474365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.474369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.474370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.474372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.474373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.474411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.474415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.474422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.474428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.474437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.474450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006864:3472], now have 1 active actors on pipe
2025-10-02T09:32:30.474456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006647:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.474459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.474461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.474462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.474469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.474477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.474481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.474482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.474483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.474487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.474489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.474502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.474506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.474497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1556
2025-10-02T09:32:30.474505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1556
2025-10-02T09:32:30.474514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.474524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.474526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.474544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.474551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.474554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.474555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.474560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.474567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.474575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.474666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.474671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.474678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.474732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1557 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0
2025-10-02T09:32:30.474916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69ef1a32-6a58cc4-923b011c-e5e0be4d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.477021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Write session: try to update token
2025-10-02T09:32:30.477030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.484042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.484064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.484067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.484069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.484076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.484081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.484086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932465782:9412]
2025-10-02T09:32:30.484121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.484128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.484131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.484135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.484138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.484140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.484369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.487811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId: src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.489639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.557208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008006872:3893]
2025-10-02T09:32:30.557387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1556, pipe: [1:7556554939008006872:3893]
2025-10-02T09:32:30.596283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.596488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.596496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.596521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006872:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.596702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.596736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:30.596738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:30.596781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008006872:3893]
2025-10-02T09:32:30.596784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1557 reason: error at write: Disconnected sessionId: src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0
2025-10-02T09:32:30.596916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1557 sessionId: src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0 is DEAD
2025-10-02T09:32:30.597048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:30.597057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Write session will restart in 0.009798s
2025-10-02T09:32:30.597073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Write session: Do CDS request
2025-10-02T09:32:30.597078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.597268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.603586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.604090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.604189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.604196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.604201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.604228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.604252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932465927:9414]
2025-10-02T09:32:30.604593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.604764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.604786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.604979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.605074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.605079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.605080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.605081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.605081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.605082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.605083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.605083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.605084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.605084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.605085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.605085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.605089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.605095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.605097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.605100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.605102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.605103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.605105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.605107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.605109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.605111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.605113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.605115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.605119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.605123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.605126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.605129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.605131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.605133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.605135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.605138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.605140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.605143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.605145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.605148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.605151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.605153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.605155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.605158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.605160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.605163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.605165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.605167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.605169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.605172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.605173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.605176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.605196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.608122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.608194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.608204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1558
2025-10-02T09:32:30.608277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.608295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.608298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.608301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.608711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1558 sessionId:  describe result for acl check
2025-10-02T09:32:30.608749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.608754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.608755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.608759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008007057:3467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.609293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008007057:3467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.610942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008007057:3467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.612526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.612917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008007057:3467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.612928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008007057:3467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.612931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008007057:3467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.612938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.613877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.613889Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.613890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.613892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.613896Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1557 [2:7556554938932465927:9414]
2025-10-02T09:32:30.613903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.613913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.613915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.613917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.613917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.613926Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.613931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.613935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.613963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.613968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.613969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.613970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.613972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.614007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.614012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.614018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.614023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.614030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.614044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008006873:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.614050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007091:3467], now have 1 active actors on pipe
2025-10-02T09:32:30.614053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.614055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.614056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.614063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.614073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.614076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.614078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.614079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.614083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.614084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.614079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1557
2025-10-02T09:32:30.614096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1557
2025-10-02T09:32:30.614098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.614103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.614104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.614119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.614124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.614142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.614149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.614151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.614152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.614156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.614163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.614171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.614263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.614268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.614276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.614331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1558 partition: 0 MaxSeqNo: 36 sessionId: src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0
2025-10-02T09:32:30.614493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc37b464-74f83cb-cc6ac31-2fb1c6df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.616590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Write session: try to update token
2025-10-02T09:32:30.616601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.624195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.624220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.624223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.624225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.624238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.624244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.624249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932465922:9414]
2025-10-02T09:32:30.624290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.624289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.624293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.624295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.624305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.624308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.624569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.628116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId: src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.630113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.696987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008007099:3893]
2025-10-02T09:32:30.697118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1557, pipe: [1:7556554939008007099:3893]
2025-10-02T09:32:30.736683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.736925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.736935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.736961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007099:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.737099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.737156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008007099:3893]
2025-10-02T09:32:30.737179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.737201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:30.737295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1558 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0
2025-10-02T09:32:30.737459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1558 sessionId: src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0 is DEAD
2025-10-02T09:32:30.737598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:30.737608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Write session will restart in 0.009296s
2025-10-02T09:32:30.737626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Write session: Do CDS request
2025-10-02T09:32:30.737631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.743576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.744009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.744127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.744135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.744141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.744171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.744196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932466068:9416]
2025-10-02T09:32:30.744532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.744674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.744697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.744890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.744924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.744928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.744929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.744929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.744930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.744930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.744931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.744931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.744932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.744932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.744933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.744933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.744936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.744942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.744945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.744947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.744949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.744951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.744952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.744954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.744956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.744959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.744961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.744962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.744966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.744970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.744974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.744976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.744978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.744981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.744983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.744986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.744988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.744990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.744992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.744995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.744997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.744999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.745003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.745005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.745008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.745010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.745012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.745014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.745016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.745019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.745021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.745028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.745043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.748176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.748260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.748271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1559
2025-10-02T09:32:30.748369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.748390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.748393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.748396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.748769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1559 sessionId:  describe result for acl check
2025-10-02T09:32:30.748821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.748828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.748830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.748836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008007285:3462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.749304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008007285:3462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.750704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008007285:3462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.752344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.752645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008007285:3462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.752654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008007285:3462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.752656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008007285:3462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.752661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.753774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.753785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.753786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.753788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.753791Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1558 [2:7556554938932466068:9416]
2025-10-02T09:32:30.753798Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.753808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.753813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.753815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.753816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.753825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.753831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.753836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.753865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.753870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.753871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.753873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.753874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.753909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.753914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.753921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.753926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.753937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.753951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007100:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.753956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007319:3462], now have 1 active actors on pipe
2025-10-02T09:32:30.753959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.753961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.753962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.753969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.753966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1558
2025-10-02T09:32:30.753986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1558
2025-10-02T09:32:30.753977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.753979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.753984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.753985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.753986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.753988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.754005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.754006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.754008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.754014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.754019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.754042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.754049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.754051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.754054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.754059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.754067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.754078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.754174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.754179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.754187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.754244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1559 partition: 0 MaxSeqNo: 36 sessionId: src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0
2025-10-02T09:32:30.754420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16473b3d-86c07215-ecc3d1ae-a91ba476_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.756529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Write session: try to update token
2025-10-02T09:32:30.756537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.763487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.763503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.763505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.763506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.763515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.763519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.763523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932466063:9416]
2025-10-02T09:32:30.763548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.763549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.763553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.763554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.763556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.763556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.763669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.767297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId: src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.769214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.837271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008007331:3893]
2025-10-02T09:32:30.837403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1558, pipe: [1:7556554939008007331:3893]
2025-10-02T09:32:30.876578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:30.876810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.876821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.876846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007331:3893], now have 1 active actors on pipe
2025-10-02T09:32:30.876961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:30.876959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:30.876970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:30.876986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008007331:3893]
2025-10-02T09:32:30.877004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:30.877011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1559 reason: error at write: Disconnected sessionId: src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0
2025-10-02T09:32:30.877142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1559 sessionId: src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0 is DEAD
2025-10-02T09:32:30.877284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:30.877294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Write session will restart in 0.005103s
2025-10-02T09:32:30.877309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Write session: Do CDS request
2025-10-02T09:32:30.877313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:30.883118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.883213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:30.883222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1560
2025-10-02T09:32:30.883298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:30.883318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:30.883326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:30.883328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:30.883574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:30.883641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1560 sessionId:  describe result for acl check
2025-10-02T09:32:30.883672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:30.883676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:30.883678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:30.883682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554939008007525:3454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:30.884051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:30.884056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554939008007525:3454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:30.884156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:30.884163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:30.884168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:30.884195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:30.884219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554938932466222:9419]
2025-10-02T09:32:30.884568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:30.884735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:30.884757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:30.884948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:30.884981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.884985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.884986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.884987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.884987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.884988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.884988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.884989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.884989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.884990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.884990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.884991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.884994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.885000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.885003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.885005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.885007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.885009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.885011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.885013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.885015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.885017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.885019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.885021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.885024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.885028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:30.885032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.885035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:30.885037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.885040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:30.885042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.885045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:30.885047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.885049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:30.885055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.885057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:30.885060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.885062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:30.885067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.885070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:30.885072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.885075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:30.885081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.885083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.885085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.885088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.885094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.885096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.885116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:30.885215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554939008007525:3454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:30.889905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554939008007525:3454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:30.889914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554939008007525:3454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:30.889916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554939008007525:3454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:30.889921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:30.892478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:30.893862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:30.893876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:30.893877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:30.893879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:30.893882Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1559 [2:7556554938932466222:9419]
2025-10-02T09:32:30.893888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:30.893897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:30.893899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.893901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.893902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.893911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:30.893914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:30.893918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:30.893946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.893951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.893952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.893954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:30.893956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:30.893991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:30.893996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.894003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:30.894008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:30.894016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:30.894029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.894034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.894035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.894040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:30.894046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:30.894048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007345:2446], now have 1 active actors on pipe
2025-10-02T09:32:30.894051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007568:3454], now have 1 active actors on pipe
2025-10-02T09:32:30.894054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:30.894055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:30.894055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:30.894062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:30.894064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:30.894076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.894085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:30.894085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:30.894082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1559
2025-10-02T09:32:30.894101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1559
2025-10-02T09:32:30.894137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.894142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.894155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:30.894162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:30.894164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:30.894165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:30.894170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:30.894175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:30.894184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.894280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.894285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.894292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:30.894344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1560 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0
2025-10-02T09:32:30.894509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28897719-fea3aa2c-a0fbc55f-cb04747b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:30.896728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Write session: try to update token
2025-10-02T09:32:30.896738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:30.903566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:30.903588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.903597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.903624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:30.903633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:30.903796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:30.904045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:30.904272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:30.904502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:30.904830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:30.904880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:30.907639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId: src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:30.909502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:30.909797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:30.909813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:30.909832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:30.909892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:30.911286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:30.911298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:30.911299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:30.911300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:30.911306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.911309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.911311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554938932466217:9419]
2025-10-02T09:32:30.911330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:30.911332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:30.911335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:30.911336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:30.911337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:30.911337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:30.911440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:30.977059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554939008007575:3893]
2025-10-02T09:32:30.977230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1559, pipe: [1:7556554939008007575:3893]
2025-10-02T09:32:31.023869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.029720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.029738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.029855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.029906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.029955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.030006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.030223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.030231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.030282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.030330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.030383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.030437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.030473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.030478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.030530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.030576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.030626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.030675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.030709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.030714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.030766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.030831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.030882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.030930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.031031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.031037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.031087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.031135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.031186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.031235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.031270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.031274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.031328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.031375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.031424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.031475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.031510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.031515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.031563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.031616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.031666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.031716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.031752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.031756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.031805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.031850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.031897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.031945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.031980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.031986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.032033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.032080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.032128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.032180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.032214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.032219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.032266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:31.032311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:31.032359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:31.032407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:31.032441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:31.032446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:31.032476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554939008007575:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.032584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:31.032595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:31.032616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1560 reason: error at write: Disconnected sessionId: src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0
2025-10-02T09:32:31.032764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1560 sessionId: src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0 is DEAD
2025-10-02T09:32:31.032907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:31.032918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Write session will restart in 0.007349s
2025-10-02T09:32:31.032903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.032934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Write session: Do CDS request
2025-10-02T09:32:31.032938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.032931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.032965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554939008007575:3893]
2025-10-02T09:32:31.038786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.039319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.039422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.039429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.039434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.039460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.039483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227433700:9434]
2025-10-02T09:32:31.039816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.039968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.039991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.040174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.040206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.040210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.040211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.040211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.040212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.040212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.040213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.040213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.040214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.040214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.040215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.040215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.040218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.040224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.040226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.040228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.040230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.040233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.040236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.040239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.040242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.040246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.040248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.040251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.040256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.040261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.040270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.040274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.040280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.040285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.040290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.040293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.040298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.040302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.040308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.040313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.040319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.040324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.040332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.040337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.040345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.040349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.040354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.040359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.040366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.040371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.040378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.040382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.040409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.041122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.041262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.041272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1561
2025-10-02T09:32:31.041351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.041370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.041377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.041379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.042095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1561 sessionId:  describe result for acl check
2025-10-02T09:32:31.042117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.042118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.042119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.042122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302975084:3437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.042429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302975084:3437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.043804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302975084:3437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.047534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302975084:3437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.047543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302975084:3437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.047546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302975084:3437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.047551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.047694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.049123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.049136Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.049138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.049141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.049145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1560 [2:7556554943227433700:9434]
2025-10-02T09:32:31.049153Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.049163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.049167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.049168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.049169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.049178Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.049184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.049188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.049218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.049223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.049224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.049225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.049227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.049259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.049263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.049270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.049276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.049284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.049299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302974898:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.049303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975115:3437], now have 1 active actors on pipe
2025-10-02T09:32:31.049306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.049308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.049309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.049316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.049326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.049330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.049332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.049333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.049336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.049339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.049328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1560
2025-10-02T09:32:31.049349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1560
2025-10-02T09:32:31.049352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.049357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.049358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.049373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.049378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.049395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.049401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.049403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.049404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.049409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.049414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.049428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.049508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.049513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.049520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.049572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1561 partition: 0 MaxSeqNo: 36 sessionId: src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0
2025-10-02T09:32:31.049739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f03f51-21f7cd49-2c135d90-1f76b661_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.051841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Write session: try to update token
2025-10-02T09:32:31.051850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.058490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.058506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.058508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.058510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.058516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.058519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.058525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227433695:9434]
2025-10-02T09:32:31.058546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.058549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.058550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.058575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.058588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.058591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.058667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.062397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId: src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.064250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.133222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302975122:3893]
2025-10-02T09:32:31.133414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1560, pipe: [1:7556554943302975122:3893]
2025-10-02T09:32:31.168474Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.168657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.168666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.168691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975122:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.168823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.168849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.168883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:31.168907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302975122:3893]
2025-10-02T09:32:31.168941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1561 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0
2025-10-02T09:32:31.169079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1561 sessionId: src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0 is DEAD
2025-10-02T09:32:31.169190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:31.169200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Write session will restart in 0.008281s
2025-10-02T09:32:31.169214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Write session: Do CDS request
2025-10-02T09:32:31.169218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.175180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.175658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.175751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.175758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.175764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.175787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.175810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227433842:9436]
2025-10-02T09:32:31.176150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.176307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.176330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.176510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.176539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.176543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.176544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.176544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.176545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.176545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.176546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.176546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.176547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.176547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.176547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.176548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.176551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.176558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.176560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.176562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.176564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.176566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.176568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.176570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.176572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.176574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.176576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.176578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.176581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.176585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.176588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.176591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.176594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.176596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.176598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.176601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.176603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.176606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.176608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.176610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.176613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.176616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.176618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.176621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.176623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.176625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.176628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.176630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.176632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.176635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.176637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.176640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.176658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.178138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.178231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.178240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1562
2025-10-02T09:32:31.178363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.178382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.178390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.178392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.178663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1562 sessionId:  describe result for acl check
2025-10-02T09:32:31.178682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.178690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.178691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.178693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302975310:3432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.179051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302975310:3432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.181041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302975310:3432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.183488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302975310:3432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.183498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302975310:3432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.183501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302975310:3432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.183506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.183951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.185425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.185436Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.185437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.185439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.185443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1561 [2:7556554943227433842:9436]
2025-10-02T09:32:31.185449Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.185458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.185464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.185465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.185467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.185476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.185479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.185483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.185514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.185518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.185520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.185522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.185523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.185558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.185563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.185569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.185575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.185586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.185599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975345:3432], now have 1 active actors on pipe
2025-10-02T09:32:31.185604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975123:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.185608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.185612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.185614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.185621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.185631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.185634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.185635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.185637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.185641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.185643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.185630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1561
2025-10-02T09:32:31.185647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1561
2025-10-02T09:32:31.185657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.185662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.185663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.185671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.185676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.185702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.185709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.185711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.185712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.185716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.185724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.185738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.185819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.185824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.185832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.185884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1562 partition: 0 MaxSeqNo: 36 sessionId: src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0
2025-10-02T09:32:31.186047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c2c835-8173d6f4-bd57efac-78b53f2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.188149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Write session: try to update token
2025-10-02T09:32:31.188161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.194762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.194780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.194782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.194784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.194792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.194796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.194798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227433837:9436]
2025-10-02T09:32:31.194823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.194826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.194827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.194829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.194833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.194835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.195052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.198929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId: src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.200723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.268896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302975356:3893]
2025-10-02T09:32:31.269093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1561, pipe: [1:7556554943302975356:3893]
2025-10-02T09:32:31.309214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.309422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.309431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.309456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975356:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.309597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.309637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:31.309659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:31.309688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302975356:3893]
2025-10-02T09:32:31.309722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.309722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1562 reason: error at write: Disconnected sessionId: src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0
2025-10-02T09:32:31.309860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1562 sessionId: src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0 is DEAD
2025-10-02T09:32:31.309996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:31.310007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Write session will restart in 0.009555s
2025-10-02T09:32:31.310022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Write session: Do CDS request
2025-10-02T09:32:31.310027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.316132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.316592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.316698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.316705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.316711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.316737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.316845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227433988:9439]
2025-10-02T09:32:31.317196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.317368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.317394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.317576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.317603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.317607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.317608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.317608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.317609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.317610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.317610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.317611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.317611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.317612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.317613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.317613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.317616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.317623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.317625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.317627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.317629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.317631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.317633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.317635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.317637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.317639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.317641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.317643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.317647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.317651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.317655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.317658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.317660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.317662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.317664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.317667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.317670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.317672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.317674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.317677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.317679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.317682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.317684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.317691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.317693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.317699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.317701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.317704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.317709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.317712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.317714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.317717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.317737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.320147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.320257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.320268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1563
2025-10-02T09:32:31.320424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.320464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.320474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.320478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.320861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1563 sessionId:  describe result for acl check
2025-10-02T09:32:31.320896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.320901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.320902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.320906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302975545:3426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.321354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302975545:3426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.323235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302975545:3426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.325103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302975545:3426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.325111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302975545:3426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.325114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302975545:3426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.325118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.325102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.326491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.326503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.326505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.326507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.326510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1562 [2:7556554943227433988:9439]
2025-10-02T09:32:31.326517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.326526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.326527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.326529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.326530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.326539Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.326545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.326550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.326580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.326585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.326587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.326588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.326590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.326626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.326631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.326637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.326642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.326653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.326669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975579:3426], now have 1 active actors on pipe
2025-10-02T09:32:31.326674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975357:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.326678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.326681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.326683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.326690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.326701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.326702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.326704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.326696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1562
2025-10-02T09:32:31.326708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1562
2025-10-02T09:32:31.326705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.326711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.326713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.326734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.326739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.326746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.326754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.326766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.326782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72165358-72f0f4f3-e4eff121-f52d0826_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.326786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.326788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.326789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.326794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.326803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.326820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.326910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.326915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.326922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.326980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1563 partition: 0 MaxSeqNo: 36 sessionId: src_id|72165358-72f0f4f3-e4eff121-f52d0826_0
2025-10-02T09:32:31.327171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb145bc6-13df2c3e-7275ab98-3ee4c7b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72165358-72f0f4f3-e4eff121-f52d0826_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.329324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Write session: try to update token
2025-10-02T09:32:31.329335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.336072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.336087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.336088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.336089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.336096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.336099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.336101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227433983:9439]
2025-10-02T09:32:31.336122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.336130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.336130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.336131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.336134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.336138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.336495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.341355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId: src_id|72165358-72f0f4f3-e4eff121-f52d0826_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.343502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.409694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302975588:3893]
2025-10-02T09:32:31.409864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1562, pipe: [1:7556554943302975588:3893]
2025-10-02T09:32:31.449167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.449418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.449427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.449439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975588:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.449585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.449606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:31.449615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:31.449660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1563 reason: error at write: Disconnected sessionId: src_id|72165358-72f0f4f3-e4eff121-f52d0826_0
2025-10-02T09:32:31.449679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.449730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302975588:3893]
2025-10-02T09:32:31.449800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1563 sessionId: src_id|72165358-72f0f4f3-e4eff121-f52d0826_0 is DEAD
2025-10-02T09:32:31.449942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:31.449951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Write session will restart in 0.007252s
2025-10-02T09:32:31.449970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Write session: Do CDS request
2025-10-02T09:32:31.449975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.456636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.457185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.457281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.457288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.457293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.457318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.457402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227434134:9441]
2025-10-02T09:32:31.457744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.457904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.457928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.458104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.458126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.458133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.458137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.458138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.458138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.458139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.458139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.458140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.458140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.458140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.458141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.458142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.458142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.458145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.458153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.458156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.458160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.458162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.458166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.458169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.458172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.458175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.458178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.458181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.458183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.458189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.458195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.458200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.458204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.458207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.458210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.458213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.458217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.458220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.458225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.458229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.458233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.458243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.458247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.458249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.458252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.458254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.458256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.458260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.458262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.458264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.458267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.458269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.458271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.458288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.458266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.458276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1564
2025-10-02T09:32:31.458428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.458448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.458456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.458458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.458816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1564 sessionId:  describe result for acl check
2025-10-02T09:32:31.458850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.458854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.458856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.458860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302975778:3421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.459284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302975778:3421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.460894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302975778:3421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.465183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302975778:3421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.465193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302975778:3421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.465196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302975778:3421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.465202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.465611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.467018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.467030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.467031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.467033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.467036Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1563 [2:7556554943227434134:9441]
2025-10-02T09:32:31.467043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.467053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.467055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.467057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.467058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.467066Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.467072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.467077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.467107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.467112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.467113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.467114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.467115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.467149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.467154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.467161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.467166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.467174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.467187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975813:3421], now have 1 active actors on pipe
2025-10-02T09:32:31.467193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975589:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.467197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.467198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.467198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.467206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.467216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.467218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.467220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.467221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.467223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.467225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.467227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1563
2025-10-02T09:32:31.467241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1563
2025-10-02T09:32:31.467237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.467243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.467244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.467252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.467254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.467279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.467285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.467287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.467288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.467293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.467298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.467308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.467389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.467394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.467401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.467466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1564 partition: 0 MaxSeqNo: 36 sessionId: src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0
2025-10-02T09:32:31.467650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72165358-72f0f4f3-e4eff121-f52d0826_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.469836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Write session: try to update token
2025-10-02T09:32:31.469847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.476358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.476372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.476373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.476374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.476378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.476381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.476383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227434129:9441]
2025-10-02T09:32:31.476404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.476408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.476408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.476409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.476411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.476414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.476528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.481586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId: src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.483508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.549992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302975824:3893]
2025-10-02T09:32:31.550173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1563, pipe: [1:7556554943302975824:3893]
2025-10-02T09:32:31.589812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.590044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.590054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.590078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975824:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.590243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.590270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:31.590280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:31.590319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.590329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1564 reason: error at write: Disconnected sessionId: src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0
2025-10-02T09:32:31.590372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302975824:3893]
2025-10-02T09:32:31.590464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1564 sessionId: src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0 is DEAD
2025-10-02T09:32:31.590591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:31.590602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Write session will restart in 0.007182s
2025-10-02T09:32:31.590617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Write session: Do CDS request
2025-10-02T09:32:31.590622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.597832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.598503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.598606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.598614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.598621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.598652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.598678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227434281:9443]
2025-10-02T09:32:31.599042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.599143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.599210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.599220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1565
2025-10-02T09:32:31.599231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.599254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.599289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.599308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.599314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.599316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.599446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.599480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.599483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.599484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.599484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.599485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.599486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.599486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.599487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.599487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.599488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.599488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.599489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.599492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.599498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.599500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.599503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.599504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.599507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.599508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.599510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.599512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.599514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.599516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.599518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.599522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.599526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.599529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.599532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.599534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.599537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.599539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.599542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.599544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.599547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.599549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.599552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.599554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.599556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.599558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.599561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.599564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.599567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.599569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.599573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.599576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.599579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.599581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.599584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.599602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.599609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1565 sessionId:  describe result for acl check
2025-10-02T09:32:31.599628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.599629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.599631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.599634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302976013:3411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.599976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302976013:3411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.601647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302976013:3411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.606411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302976013:3411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.606420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302976013:3411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.606423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302976013:3411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.606429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.607647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.609120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.609133Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.609135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.609137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.609141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1564 [2:7556554943227434281:9443]
2025-10-02T09:32:31.609150Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.609162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.609164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.609166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.609167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.609176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.609179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.609183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.609214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.609220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.609221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.609223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.609224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.609258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.609263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.609270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.609275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.609283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.609297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302975825:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.609302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976050:3411], now have 1 active actors on pipe
2025-10-02T09:32:31.609306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.609307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.609308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.609317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.609327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.609331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.609333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.609335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.609322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1564
2025-10-02T09:32:31.609337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.609339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.609356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.609362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.609352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1564
2025-10-02T09:32:31.609363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.609380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.609387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.609406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1579d562-c275fed9-42f7a287-fec60519_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.609414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.609416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.609417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.609422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.609430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.609442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.609545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.609551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.609558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.609614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1565 partition: 0 MaxSeqNo: 36 sessionId: src_id|1579d562-c275fed9-42f7a287-fec60519_0
2025-10-02T09:32:31.609790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f555d4-35efd0ff-41a2ae7f-e4071581_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1579d562-c275fed9-42f7a287-fec60519_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.611909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Write session: try to update token
2025-10-02T09:32:31.611919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.619790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.619806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.619807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.619808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.619813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.619816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.619818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227434276:9443]
2025-10-02T09:32:31.619838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.619842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.619843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.619847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.619851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.619853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.619961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.622285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId: src_id|1579d562-c275fed9-42f7a287-fec60519_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.624193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.690773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302976058:3893]
2025-10-02T09:32:31.690949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1564, pipe: [1:7556554943302976058:3893]
2025-10-02T09:32:31.734184Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.734411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.734420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.734446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976058:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.734590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.734618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302976058:3893]
2025-10-02T09:32:31.734641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:31.734643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:31.734678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.734693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1565 reason: error at write: Disconnected sessionId: src_id|1579d562-c275fed9-42f7a287-fec60519_0
2025-10-02T09:32:31.734845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1565 sessionId: src_id|1579d562-c275fed9-42f7a287-fec60519_0 is DEAD
2025-10-02T09:32:31.734966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:31.734976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Write session will restart in 0.005608s
2025-10-02T09:32:31.734990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Write session: Do CDS request
2025-10-02T09:32:31.734994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.741150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.741411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.741421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1566
2025-10-02T09:32:31.741441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.741496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.741517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.741524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.741526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.741886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1566 sessionId:  describe result for acl check
2025-10-02T09:32:31.741895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.741922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.741927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.741928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.741936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302976246:3406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.741999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.742006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.742012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.742042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.742065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227434429:9445]
2025-10-02T09:32:31.742388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302976246:3406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.742410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.742566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.742593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.742791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.742822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.742826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.742827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.742828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.742828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.742829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.742829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.742830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.742830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.742831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.742831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.742832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.742835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.742841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.742843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.742846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.742848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.742849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.742851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.742853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.742856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.742858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.742860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.742862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.742865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.742869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.742873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.742876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.742878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.742881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.742883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.742886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.742888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.742891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.742893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.742895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.742898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.742900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.742903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.742905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.742907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.742910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.742912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.742915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.742917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.742920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.742922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.742925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.742951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.744022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302976246:3406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.748952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302976246:3406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.748963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302976246:3406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.748965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302976246:3406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.748971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.751253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.752649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.752659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.752661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.752663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.752666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1565 [2:7556554943227434429:9445]
2025-10-02T09:32:31.752674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.752683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.752688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.752689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.752690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.752699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.752705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.752709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.752740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.752745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.752746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.752747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.752749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.752782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.752786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.752792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.752814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.752834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.752849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976059:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.752855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976285:3406], now have 1 active actors on pipe
2025-10-02T09:32:31.752859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.752860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.752862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.752871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.752858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1565
2025-10-02T09:32:31.752876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.752878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.752879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.752882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.752889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.752894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.752889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1565
2025-10-02T09:32:31.752912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.752918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.752923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.752927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.752929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.752951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80e3e091-7bca262a-57fc731c-44d02276_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.752957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.752960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.752961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.752965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.752974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.752985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.753081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.753086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.753093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.753148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1566 partition: 0 MaxSeqNo: 36 sessionId: src_id|80e3e091-7bca262a-57fc731c-44d02276_0
2025-10-02T09:32:31.753321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1579d562-c275fed9-42f7a287-fec60519_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80e3e091-7bca262a-57fc731c-44d02276_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.755442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Write session: try to update token
2025-10-02T09:32:31.755451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.763409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.763423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.763424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.763426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.763431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.763434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.763437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227434424:9445]
2025-10-02T09:32:31.763464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.763468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.763471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.763473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.763474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.763476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.763585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.765900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId: src_id|80e3e091-7bca262a-57fc731c-44d02276_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.767765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.834658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302976299:3893]
2025-10-02T09:32:31.834793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1565, pipe: [1:7556554943302976299:3893]
2025-10-02T09:32:31.877412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:31.877635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.877644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.877669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976299:3893], now have 1 active actors on pipe
2025-10-02T09:32:31.877780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:31.877756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:31.877787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:31.877789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:31.877829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1566 reason: error at write: Disconnected sessionId: src_id|80e3e091-7bca262a-57fc731c-44d02276_0
2025-10-02T09:32:31.877944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302976299:3893]
2025-10-02T09:32:31.877959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1566 sessionId: src_id|80e3e091-7bca262a-57fc731c-44d02276_0 is DEAD
2025-10-02T09:32:31.878080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:31.878090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Write session will restart in 0.005891s
2025-10-02T09:32:31.878109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Write session: Do CDS request
2025-10-02T09:32:31.878114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:31.885205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:31.885231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.885274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:31.885283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1567
2025-10-02T09:32:31.885416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:31.885438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:31.885445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:31.885447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:31.885707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1567 sessionId:  describe result for acl check
2025-10-02T09:32:31.885726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:31.885732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:31.885733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:31.885737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554943302976501:3395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:31.885757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:31.885862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:31.885871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:31.885880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:31.885922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:31.885957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554943227434591:9448]
2025-10-02T09:32:31.886077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554943302976501:3395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:31.886402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:31.886680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:31.886708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:31.886926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:31.886962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.886966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.886967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.886967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.886968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.886968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.886969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.886970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.886970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.886971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.886971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.886972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.886975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.886981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.886983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.886985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.886987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.886989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.886991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.886993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.886995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.886997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.886999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.887001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.887004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.887008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:31.887012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.887015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:31.887017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.887020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:31.887022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.887025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:31.887027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.887030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:31.887032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.887035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:31.887038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.887040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:31.887042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.887045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:31.887049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.887052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:31.887055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.887057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.887059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.887062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.887067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.887070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.887088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:31.887328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554943302976501:3395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:31.892481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554943302976501:3395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:31.892492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554943302976501:3395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:31.892495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554943302976501:3395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:31.892501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:31.895354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:31.896734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:31.896746Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:31.896747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:31.896749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:31.896752Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1566 [2:7556554943227434591:9448]
2025-10-02T09:32:31.896759Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:31.896768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:31.896770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.896771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.896772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.896781Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:31.896787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:31.896792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:31.896836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.896841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.896843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.896844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:31.896846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:31.896883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:31.896888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.896895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:31.896900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:31.896909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:31.896923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976313:2446], now have 1 active actors on pipe
2025-10-02T09:32:31.896929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976543:3395], now have 1 active actors on pipe
2025-10-02T09:32:31.896932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.896934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.896935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.896942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:31.896953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:31.896954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:31.896956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:31.896957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:31.896964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:31.896965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:31.896954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1566
2025-10-02T09:32:31.896978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.896983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:31.896985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:31.897003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1566
2025-10-02T09:32:31.897039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.897045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.897058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ececaaca-28759d06-cffaaf58-1393a496_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:31.897065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:31.897068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:31.897073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:31.897081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:31.897092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:31.897105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.897217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.897222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.897229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:31.897279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1567 partition: 0 MaxSeqNo: 36 sessionId: src_id|ececaaca-28759d06-cffaaf58-1393a496_0
2025-10-02T09:32:31.897463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e3e091-7bca262a-57fc731c-44d02276_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ececaaca-28759d06-cffaaf58-1393a496_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:31.899738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Write session: try to update token
2025-10-02T09:32:31.899747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:31.906819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:31.906832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.906837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.906863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:31.906866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:31.906996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:31.907108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:31.907217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:31.907320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:31.907466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:31.907489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:31.910082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId: src_id|ececaaca-28759d06-cffaaf58-1393a496_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:31.912003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:31.912244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:31.912255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:31.912271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:31.912328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:31.915303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:31.915316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:31.915317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:31.915319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:31.915323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.915326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.915328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554943227434586:9448]
2025-10-02T09:32:31.915347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:31.915349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:31.915352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:31.915354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:31.915355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:31.915356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:31.915475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:31.978024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554943302976550:3893]
2025-10-02T09:32:31.978198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1566, pipe: [1:7556554943302976550:3893]
2025-10-02T09:32:32.028913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.034953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.034973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.035076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.035123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.035174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.035225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.035262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.035269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.035320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.035367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.035420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.035471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.035506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.035511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.035561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.035609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.035658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.035711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.035747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.035752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.035802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.035849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.035902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.035953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.035987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.035992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.036044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.036093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.036145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.036195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.036231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.036235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.036284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.036331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.036394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.036447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.036485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.036490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.036538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.036584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.036639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.036693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.036738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.036744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.036793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.036853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.036909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.036955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.036990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.036995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.037044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.037090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.037138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.037185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.037220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.037225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.037270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.037320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.037371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.037429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.037463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.037468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.037497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554943302976550:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.037669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.037707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:32.037710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:32.037732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1567 reason: error at write: Disconnected sessionId: src_id|ececaaca-28759d06-cffaaf58-1393a496_0
2025-10-02T09:32:32.037891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1567 sessionId: src_id|ececaaca-28759d06-cffaaf58-1393a496_0 is DEAD
2025-10-02T09:32:32.038014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:32.038023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Write session will restart in 0.005719s
2025-10-02T09:32:32.038039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Write session: Do CDS request
2025-10-02T09:32:32.038042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.038095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.038133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554943302976550:3893]
2025-10-02T09:32:32.045113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.045235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.045254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1568
2025-10-02T09:32:32.045371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.045394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.045401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.045404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.045674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1568 sessionId:  describe result for acl check
2025-10-02T09:32:32.045695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.045700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.045701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.045704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597944047:3384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.046071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597944047:3384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.046446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.047042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.047147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.047154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.047159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.047188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.047213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522402052:9457]
2025-10-02T09:32:32.047560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.047751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.047770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597944047:3384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.047778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.047966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.047996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.048000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.048000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.048001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.048001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.048002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.048002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.048003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.048003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.048004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.048005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.048005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.048008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.048013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.048016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.048018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.048020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.048022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.048024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.048026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.048028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.048030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.048032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.048034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.048038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.048042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.048045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.048048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.048050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.048053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.048055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.048058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.048060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.048063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.048065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.048068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.048070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.048073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.048075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.048078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.048080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.048084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.048086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.048089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.048091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.048094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.048097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.048099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.048127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.052129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597944047:3384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.052140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597944047:3384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.052142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597944047:3384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.052147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.055810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.057186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.057197Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.057198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.057200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.057204Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1567 [2:7556554947522402052:9457]
2025-10-02T09:32:32.057211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.057220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.057221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.057223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.057224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.057232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.057239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.057243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.057271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.057276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.057277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.057279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.057280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.057316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.057322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.057331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.057345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.057362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.057377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597943861:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.057384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.057385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.057387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.057395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.057404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944088:3384], now have 1 active actors on pipe
2025-10-02T09:32:32.057411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.057411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.057414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.057415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.057421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.057423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.057424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1567
2025-10-02T09:32:32.057437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.057442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.057443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.057455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1567
2025-10-02T09:32:32.057517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.057523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.057537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.057543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.057545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.057546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.057552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.057561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.057571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.057709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.057716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.057725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.057797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1568 partition: 0 MaxSeqNo: 36 sessionId: src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0
2025-10-02T09:32:32.058044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ececaaca-28759d06-cffaaf58-1393a496_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.060191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Write session: try to update token
2025-10-02T09:32:32.060200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.067036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.067051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.067053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.067054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.067061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.067064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.067066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522402047:9457]
2025-10-02T09:32:32.067095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.067098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.067099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.067103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.067109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.067111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.067214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.070983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId: src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.072885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.138279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597944105:3893]
2025-10-02T09:32:32.138488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1567, pipe: [1:7556554947597944105:3893]
2025-10-02T09:32:32.178005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.178262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.178271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.178295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944105:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.178473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.178503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:32.178503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.178508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:32.178509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597944105:3893]
2025-10-02T09:32:32.178578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1568 reason: error at write: Disconnected sessionId: src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0
2025-10-02T09:32:32.178734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1568 sessionId: src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0 is DEAD
2025-10-02T09:32:32.178880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:32.178891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Write session will restart in 0.009312s
2025-10-02T09:32:32.178910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Write session: Do CDS request
2025-10-02T09:32:32.178914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.186342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.187100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.187201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.187207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.187213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.187238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.187262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522402225:9465]
2025-10-02T09:32:32.187701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.187899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.187921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.188092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.188122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.188126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.188126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.188127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.188127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.188128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.188128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.188129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.188129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.188130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.188130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.188131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.188133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.188140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.188142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.188144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.188146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.188148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.188150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.188152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.188154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.188156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.188158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.188160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.188163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.188167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.188170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.188173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.188175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.188178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.188180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.188183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.188185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.188188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.188190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.188192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.188194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.188197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.188199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.188202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.188204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.188207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.188209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.188212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.188214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.188216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.188219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.188222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.188238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.189122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.189216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.189225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1569
2025-10-02T09:32:32.189309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.189329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.189336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.189339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.189686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1569 sessionId:  describe result for acl check
2025-10-02T09:32:32.189719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.189724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.189725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.189730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597944301:3380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.190169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597944301:3380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.191501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597944301:3380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.195219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597944301:3380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.195229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597944301:3380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.195232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597944301:3380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.195237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.195831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.197145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.197157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.197159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.197160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.197164Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1568 [2:7556554947522402225:9465]
2025-10-02T09:32:32.197170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.197179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.197180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.197182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.197183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.197191Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.197194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.197198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.197227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.197232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.197233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.197235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.197237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.197276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.197281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.197287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.197292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.197303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.197316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.197321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.197322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.197327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.197334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944106:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.197338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.197340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944336:3380], now have 1 active actors on pipe
2025-10-02T09:32:32.197341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.197343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.197345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.197352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.197354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.197369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.197378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.197393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.197387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1568
2025-10-02T09:32:32.197420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.197425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.197438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.197444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.197446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.197447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.197431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1568
2025-10-02T09:32:32.197452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.197459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.197468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.197579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.197585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.197592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.197658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1569 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0
2025-10-02T09:32:32.197834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372f7e3b-206996ca-b6ab0c11-1a1d5447_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.200073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Write session: try to update token
2025-10-02T09:32:32.200083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.206685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:32.206700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.206705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.206731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:32.206739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:32.206871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:32.207079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:32.207197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:32.207302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:32.207458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:32.207482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:32.210932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId: src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.212857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.212966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.212974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.212991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:32.213053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:32.215643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.215657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.215658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.215659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.215665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.215667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.215669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522402220:9465]
2025-10-02T09:32:32.215691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.215698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.215698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.215699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.215705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.215707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.215803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.278565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597944345:3893]
2025-10-02T09:32:32.278826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1568, pipe: [1:7556554947597944345:3893]
2025-10-02T09:32:32.325543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.331553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.331572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.331694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.331741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.331792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.331840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.331876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.331882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.331934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.331983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.332030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.332084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.332120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.332124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.332173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.332218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.332266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.332315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.332350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.332355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.332400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.332449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.332494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.332541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.332578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.332582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.332631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.332680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.332729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.332776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.332823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.332828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.332876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.332921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.332970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.333021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.333059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.333063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.333108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.333153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.333207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.333256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.333290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.333295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.333341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.333387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.333432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.333480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.333513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.333518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.333564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.333608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.333652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.333697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.333728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.333733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.333778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:32.333828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:32.333873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:32.333919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:32.333951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:32.333956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:32.333982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944345:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.334173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597944345:3893]
2025-10-02T09:32:32.334193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.334214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:32.334223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:32.334379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1569 reason: error at write: Disconnected sessionId: src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0
2025-10-02T09:32:32.334553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1569 sessionId: src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0 is DEAD
2025-10-02T09:32:32.334604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.334694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:32.334704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Write session will restart in 0.009575s
2025-10-02T09:32:32.334720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Write session: Do CDS request
2025-10-02T09:32:32.334725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.342797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.343383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.343477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.343484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.343490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.343515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.343540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522402379:9468]
2025-10-02T09:32:32.343876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.344061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.344082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.344255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.344282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.344285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.344286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.344287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.344287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.344288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.344288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.344289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.344289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.344290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.344290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.344291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.344293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.344300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.344302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.344304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.344306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.344308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.344310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.344312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.344314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.344316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.344318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.344320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.344324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.344328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.344331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.344334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.344336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.344339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.344341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.344343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.344346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.344349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.344351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.344354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.344356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.344359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.344361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.344364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.344368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.344371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.344373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.344376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.344378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.344382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.344386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.344388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.344406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.345124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.345223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.345231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1570
2025-10-02T09:32:32.345306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.345326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.345333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.345336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.345643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1570 sessionId:  describe result for acl check
2025-10-02T09:32:32.345665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.345667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.345668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.345670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597944542:3370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.345999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597944542:3370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.347885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597944542:3370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.351354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597944542:3370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.351364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597944542:3370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.351366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597944542:3370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.351372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.351977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.353337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.353348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.353348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.353350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.353353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1569 [2:7556554947522402379:9468]
2025-10-02T09:32:32.353360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.353369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.353370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.353372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.353373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.353382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.353388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.353392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.353421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.353425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.353426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.353428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.353429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.353466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.353471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.353477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.353483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.353494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.353506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.353510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.353512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.353517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.353525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944576:3370], now have 1 active actors on pipe
2025-10-02T09:32:32.353528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.353531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.353532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.353533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.353540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.353541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.353545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944346:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.353557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.353565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.353574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1569
2025-10-02T09:32:32.353585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1569
2025-10-02T09:32:32.353582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.353623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.353628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.353643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f296224b-fafb429a-cffcb041-da355756_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.353650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.353652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.353653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.353659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.353667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.353677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.353788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.353793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.353801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.353864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1570 partition: 0 MaxSeqNo: 36 sessionId: src_id|f296224b-fafb429a-cffcb041-da355756_0
2025-10-02T09:32:32.354029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7de8acc-8362acd8-ee5bfd61-4ceb4b2c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f296224b-fafb429a-cffcb041-da355756_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.356182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Write session: try to update token
2025-10-02T09:32:32.356192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.363340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.363355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.363357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.363358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.363362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.363365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.363368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522402374:9468]
2025-10-02T09:32:32.363391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.363398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.363399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.363402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.363407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.363409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.363513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.366869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId: src_id|f296224b-fafb429a-cffcb041-da355756_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.368794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.434229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597944584:3893]
2025-10-02T09:32:32.434474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1569, pipe: [1:7556554947597944584:3893]
2025-10-02T09:32:32.477273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.477587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.477598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.477623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944584:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.477817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:32.477860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.477828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:32.477863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597944584:3893]
2025-10-02T09:32:32.477873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1570 reason: error at write: Disconnected sessionId: src_id|f296224b-fafb429a-cffcb041-da355756_0
2025-10-02T09:32:32.477886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.478018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1570 sessionId: src_id|f296224b-fafb429a-cffcb041-da355756_0 is DEAD
2025-10-02T09:32:32.478166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:32.478176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Write session will restart in 0.009328s
2025-10-02T09:32:32.478197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Write session: Do CDS request
2025-10-02T09:32:32.478201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.486217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.486980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.487077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.487083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.487089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.487114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.487139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522402531:9470]
2025-10-02T09:32:32.487471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.487651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.487673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.487845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.487875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.487879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.487880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.487881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.487881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.487882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.487882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.487883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.487883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.487884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.487884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.487885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.487887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.487894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.487896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.487898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.487900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.487903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.487904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.487906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.487909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.487911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.487913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.487914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.487918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.487923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.487926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.487929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.487931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.487933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.487935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.487938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.487940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.487944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.487946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.487949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.487951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.487954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.487956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.487962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.487964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.487967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.487969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.487984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.487986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.487989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.487991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.487994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.488015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.488144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.488230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.488240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1571
2025-10-02T09:32:32.488307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.488326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.488329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.488331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.488674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1571 sessionId:  describe result for acl check
2025-10-02T09:32:32.488709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.488715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.488716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.488720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597944781:3365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.489160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597944781:3365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.490441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597944781:3365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.494663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597944781:3365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.494674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597944781:3365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.494698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597944781:3365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.494708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.495913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.497324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.497336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.497338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.497340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.497343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1570 [2:7556554947522402531:9470]
2025-10-02T09:32:32.497351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.497360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.497362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.497363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.497364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.497373Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.497380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.497384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.497412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.497417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.497418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.497420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.497421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.497460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.497464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.497470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.497476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.497487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.497501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944816:3365], now have 1 active actors on pipe
2025-10-02T09:32:32.497506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944585:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.497510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.497512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.497513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.497522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.497533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.497543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.497542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.497545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.497543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1570
2025-10-02T09:32:32.497547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.497547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.497560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.497563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.497565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.497591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1570
2025-10-02T09:32:32.497623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.497629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.497643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.497650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.497652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.497653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.497657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.497665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.497675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.497789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.497797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.497805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.497867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1571 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0
2025-10-02T09:32:32.498045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296224b-fafb429a-cffcb041-da355756_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.500194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Write session: try to update token
2025-10-02T09:32:32.500203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.507256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.507271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.507272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.507273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.507278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.507280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.507283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522402526:9470]
2025-10-02T09:32:32.507306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.507309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.507310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.507317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.507322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.507328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.507431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.510860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId: src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.512822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.578093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597944824:3893]
2025-10-02T09:32:32.578278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1570, pipe: [1:7556554947597944824:3893]
2025-10-02T09:32:32.619135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.619500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.619509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.619535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944824:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.619740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597944824:3893]
2025-10-02T09:32:32.619760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.619769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.619785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:32.619792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:32.619867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1571 reason: error at write: Disconnected sessionId: src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0
2025-10-02T09:32:32.620049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1571 sessionId: src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0 is DEAD
2025-10-02T09:32:32.620193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:32.620203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Write session will restart in 0.006381s
2025-10-02T09:32:32.620218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Write session: Do CDS request
2025-10-02T09:32:32.620223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.627229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.627228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.627318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.627327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1572
2025-10-02T09:32:32.627426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.627448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.627456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.627459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.627756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1572 sessionId:  describe result for acl check
2025-10-02T09:32:32.627779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.627786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.627788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.627792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597945018:3366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.627832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.627943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.627950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.627956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.627983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.628007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522402685:9472]
2025-10-02T09:32:32.628150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597945018:3366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.628340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.628494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.628515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.628684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.628713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.628716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.628717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.628717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.628718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.628718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.628719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.628719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.628720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.628721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.628721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.628722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.628725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.628730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.628732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.628734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.628736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.628738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.628740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.628742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.628744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.628746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.628748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.628750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.628753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.628758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.628762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.628765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.628767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.628770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.628772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.628774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.628776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.628779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.628781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.628784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.628786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.628789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.628791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.628793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.628795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.628798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.628813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.628816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.628818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.628821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.628823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.628826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.628842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.629618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597945018:3366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.633835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597945018:3366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.633844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597945018:3366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.633845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597945018:3366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.633849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.636617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.638042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.638054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.638055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.638057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.638061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1571 [2:7556554947522402685:9472]
2025-10-02T09:32:32.638067Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.638077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.638078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.638080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.638081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.638091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.638093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.638097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.638128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.638133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.638134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.638136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.638138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.638175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.638180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.638186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.638191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.638199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.638214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945057:3366], now have 1 active actors on pipe
2025-10-02T09:32:32.638219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597944825:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.638223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.638224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.638225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.638233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.638242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.638245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.638247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.638248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.638250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.638252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.638264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.638251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1571
2025-10-02T09:32:32.638269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.638270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.638264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1571
2025-10-02T09:32:32.638287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.638292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.638313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.638320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.638322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.638323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.638328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.638333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.638346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.638424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.638429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.638436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.638483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1572 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0
2025-10-02T09:32:32.638718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab98cd5d-f2be6994-80e824e2-e2ecaea9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.641516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Write session: try to update token
2025-10-02T09:32:32.641531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.647847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.647859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.647860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.647861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.647864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.647866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.647868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522402680:9472]
2025-10-02T09:32:32.647886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.647889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.647890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.647893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.647897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.647899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.647999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.654557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId: src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.657298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.719925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597945065:3893]
2025-10-02T09:32:32.720109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1571, pipe: [1:7556554947597945065:3893]
2025-10-02T09:32:32.759495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.759764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.759773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.759785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945065:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.759921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.759953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:32.759955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.759966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:32.759992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597945065:3893]
2025-10-02T09:32:32.760025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1572 reason: error at write: Disconnected sessionId: src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0
2025-10-02T09:32:32.760179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1572 sessionId: src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0 is DEAD
2025-10-02T09:32:32.760330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:32.760342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Write session will restart in 0.007838s
2025-10-02T09:32:32.760367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Write session: Do CDS request
2025-10-02T09:32:32.760373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.767502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.768178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.768330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.768338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.768344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.768378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.768402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522402850:9474]
2025-10-02T09:32:32.768759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.768948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.768981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.769145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.769176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.769203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.769207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.769207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.769208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.769208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.769209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.769209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.769210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.769210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.769211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.769211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.769212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.769215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.769221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.769223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.769225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.769227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.769229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.769231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.769233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.769235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.769237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.769239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.769241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.769245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.769248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.769251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.769254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.769256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.769259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.769260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.769263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.769265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.769268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.769270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.769272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.769274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.769276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.769278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.769261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.769270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1573
2025-10-02T09:32:32.769281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.769283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.769285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.769287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.769290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.769292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.769294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.769296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.769299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.769314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.769384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.769404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.769411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.769414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.769698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1573 sessionId:  describe result for acl check
2025-10-02T09:32:32.769723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.769724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.769726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.769729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597945264:3362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.770004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597945264:3362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.771201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597945264:3362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.775787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597945264:3362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.775796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597945264:3362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.775798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597945264:3362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.775801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.777119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.778569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.778580Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.778581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.778583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.778586Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1572 [2:7556554947522402850:9474]
2025-10-02T09:32:32.778592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.778601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.778603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.778604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.778605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.778613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.778620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.778623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.778652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.778656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.778657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.778659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.778660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.778692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.778696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.778702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.778707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.778717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.778730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945299:3362], now have 1 active actors on pipe
2025-10-02T09:32:32.778735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945066:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.778739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.778740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.778742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.778750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.778760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.778747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1572
2025-10-02T09:32:32.778762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.778764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.778749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1572
2025-10-02T09:32:32.778765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.778777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.778778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.778800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.778805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.778812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.778818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.778832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.778833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.778837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.778839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.778840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.778845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.778850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.778861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.778951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.778956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.778963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.779013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1573 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0
2025-10-02T09:32:32.779245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c11f765-936ecbc6-d3d43a31-73d42c68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.781974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Write session: try to update token
2025-10-02T09:32:32.781989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.788327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.788338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.788339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.788341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.788344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.788347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.788349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522402835:9474]
2025-10-02T09:32:32.788367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.788369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.788370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.788374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.788383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.788385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.788474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.795193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId: src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.797251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.860175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597945314:3893]
2025-10-02T09:32:32.860367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1572, pipe: [1:7556554947597945314:3893]
2025-10-02T09:32:32.897415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:32.897610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.897618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.897631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945314:3893], now have 1 active actors on pipe
2025-10-02T09:32:32.897744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:32.897780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597945314:3893]
2025-10-02T09:32:32.897800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:32.897836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:32.897894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0
2025-10-02T09:32:32.898022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1573 sessionId: src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0 is DEAD
2025-10-02T09:32:32.898176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:32.898187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Write session will restart in 0.008969s
2025-10-02T09:32:32.898208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Write session: Do CDS request
2025-10-02T09:32:32.898214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:32.905339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:32.905915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:32.906023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:32.906031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:32.906037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:32.906062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:32.906088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554947522403008:9477]
2025-10-02T09:32:32.906417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:32.906576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:32.906673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:32.906866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:32.906896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.906901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.906901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.906902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.906902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.906903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.906904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.906904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.906905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.906905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.906906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.906907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.906910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.906916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.906918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.906920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.906922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.906925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.906927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.906929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.906931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.906933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.906935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.906937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.906941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.906945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:32.906948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.906951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:32.906953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.906956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:32.906958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.906960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:32.906964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.906967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:32.906969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.906971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:32.906974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.906977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:32.906979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.906982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:32.906984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.906986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:32.906988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.906991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.906997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.907000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.907002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.907004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.907020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:32.908188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.908297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:32.908305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1574
2025-10-02T09:32:32.908396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:32.908414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:32.908417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:32.908419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:32.908677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1574 sessionId:  describe result for acl check
2025-10-02T09:32:32.908703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:32.908710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:32.908711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:32.908714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554947597945529:3358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:32.909075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554947597945529:3358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:32.910126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554947597945529:3358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:32.914160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554947597945529:3358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:32.914169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554947597945529:3358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:32.914171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554947597945529:3358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:32.914174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:32.914763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:32.916071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:32.916081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:32.916083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:32.916085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:32.916088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1573 [2:7556554947522403008:9477]
2025-10-02T09:32:32.916095Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:32.916104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:32.916106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.916108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.916109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.916117Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:32.916123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:32.916127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:32.916159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.916164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.916165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.916166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:32.916168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:32.916201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:32.916206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.916212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:32.916217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:32.916225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:32.916239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945564:3358], now have 1 active actors on pipe
2025-10-02T09:32:32.916245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945330:2446], now have 1 active actors on pipe
2025-10-02T09:32:32.916248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.916249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.916250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.916256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:32.916266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:32.916267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:32.916274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:32.916275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:32.916275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:32.916277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:32.916290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.916292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:32.916294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:32.916277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1573
2025-10-02T09:32:32.916278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1573
2025-10-02T09:32:32.916307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.916312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.916376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:32.916384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:32.916386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:32.916387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:32.916392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:32.916397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:32.916413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.916574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:32.916579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:32.916587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:32.916642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1574 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0
2025-10-02T09:32:32.916892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ebcfc4-ae43150-b682ffcb-d617404e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:32.919679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Write session: try to update token
2025-10-02T09:32:32.919698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:32.925807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:32.925819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:32.925820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:32.925821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:32.925824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.925826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.925828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554947522403003:9477]
2025-10-02T09:32:32.925845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:32.925850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:32.925851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:32.925852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:32.925852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:32.925854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:32.925960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:32.932260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId: src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:32.934158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:32.997924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554947597945571:3893]
2025-10-02T09:32:32.998100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1573, pipe: [1:7556554947597945571:3893]
2025-10-02T09:32:33.034927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.035183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.035193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.035205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554947597945571:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.035330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.035337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554947597945571:3893]
2025-10-02T09:32:33.035342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:33.035345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:33.035359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.035395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1574 reason: error at write: Disconnected sessionId: src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0
2025-10-02T09:32:33.035522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1574 sessionId: src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0 is DEAD
2025-10-02T09:32:33.035692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:33.035704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Write session will restart in 0.007165s
2025-10-02T09:32:33.035726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Write session: Do CDS request
2025-10-02T09:32:33.035732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.042716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.043268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.043364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.043371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.043376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.043401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.043424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817370464:9480]
2025-10-02T09:32:33.043760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.043915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.043938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.044146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.044160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.044195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.044199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.044199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.044200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.044200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.044201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.044201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.044202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.044202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.044203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.044203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.044204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.044207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.044213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.044215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.044217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.044219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.044221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.044223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.044225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.044227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.044249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.044256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1575
2025-10-02T09:32:33.044229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.044230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.044232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.044236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.044240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.044243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.044246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.044248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.044250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.044252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.044255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.044258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.044261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.044263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.044265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.044268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.044270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.044272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.044275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.044277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.044280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.044281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.044284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.044286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.044289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.044291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.044293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.044310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.044371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.044390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.044393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.044395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.044648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1575 sessionId:  describe result for acl check
2025-10-02T09:32:33.044670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.044675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.044676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.044679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892913068:3345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.045030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892913068:3345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.046345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892913068:3345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.050794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892913068:3345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.050802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892913068:3345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.050804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892913068:3345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.050807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.052097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.053454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.053465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.053466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.053468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.053471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1574 [2:7556554951817370464:9480]
2025-10-02T09:32:33.053477Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.053487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.053488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.053489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.053490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.053499Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.053501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.053505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.053533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.053539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.053539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.053541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.053543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.053575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.053580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.053586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.053591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.053599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.053613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913103:3345], now have 1 active actors on pipe
2025-10-02T09:32:33.053618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892912869:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.053621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.053622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.053624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.053631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.053638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.053643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.053645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.053646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.053646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.053646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1574
2025-10-02T09:32:33.053648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.053649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1574
2025-10-02T09:32:33.053660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.053661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.053663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.053676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.053681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.053701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6079b072-9644adb1-19680be1-550c3a82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.053707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.053709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.053710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.053715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.053719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.053730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.053811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.053816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.053823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.053873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1575 partition: 0 MaxSeqNo: 36 sessionId: src_id|6079b072-9644adb1-19680be1-550c3a82_0
2025-10-02T09:32:33.054090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae0ac5d-1e75bc47-83bde02c-7492ce6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6079b072-9644adb1-19680be1-550c3a82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.056839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Write session: try to update token
2025-10-02T09:32:33.056854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.063079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.063092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.063093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.063094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.063097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.063099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.063100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817370458:9480]
2025-10-02T09:32:33.063118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.063120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.063121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.063122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.063124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.063127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.063224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.069509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId: src_id|6079b072-9644adb1-19680be1-550c3a82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.071434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.135667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892913132:3893]
2025-10-02T09:32:33.135844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1574, pipe: [1:7556554951892913132:3893]
2025-10-02T09:32:33.173404Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.173674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.173683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.173696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913132:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.173814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.173853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:33.173853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.173883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892913132:3893]
2025-10-02T09:32:33.173918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6079b072-9644adb1-19680be1-550c3a82_0
2025-10-02T09:32:33.174051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1575 sessionId: src_id|6079b072-9644adb1-19680be1-550c3a82_0 is DEAD
2025-10-02T09:32:33.174210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:33.174224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Write session will restart in 0.006037s
2025-10-02T09:32:33.174249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Write session: Do CDS request
2025-10-02T09:32:33.174254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.180687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.181149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.181241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.181248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1576
2025-10-02T09:32:33.181338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.181356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.181376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.181382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.181385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.181435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.181442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.181448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.181475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.181497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817370657:9494]
2025-10-02T09:32:33.181633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1576 sessionId:  describe result for acl check
2025-10-02T09:32:33.181651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.181655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.181656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.181660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892913330:3336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.181832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.181998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.182004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892913330:3336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.182021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.182191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.182220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.182223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.182224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.182225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.182225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.182226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.182226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.182227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.182227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.182228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.182228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.182229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.182231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.182237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.182240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.182242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.182244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.182246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.182247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.182249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.182251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.182253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.182255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.182257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.182260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.182264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.182267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.182270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.182272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.182275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.182277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.182280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.182282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.182284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.182286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.182289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.182291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.182294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.182296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.182298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.182300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.182304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.182306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.182308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.182310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.182312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.182314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.182320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.182337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.183654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892913330:3336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.187752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892913330:3336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.187759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892913330:3336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.187761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892913330:3336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.187764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.190097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.191454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.191466Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.191467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.191469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.191472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1575 [2:7556554951817370657:9494]
2025-10-02T09:32:33.191478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.191487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.191488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.191489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.191490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.191499Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.191501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.191509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.191538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.191543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.191545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.191546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.191548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.191582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.191587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.191593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.191598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.191606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.191620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913369:3336], now have 1 active actors on pipe
2025-10-02T09:32:33.191623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913133:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.191627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.191628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.191629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.191636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.191642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.191648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.191649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.191650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.191651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.191651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.191664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.191668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.191659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1575
2025-10-02T09:32:33.191659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1575
2025-10-02T09:32:33.191679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.191689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.191692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.191706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a745447-1740c993-b20cbe44-ef41109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.191712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.191714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.191716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.191720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.191725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.191732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.191819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.191823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.191830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.191884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1576 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a745447-1740c993-b20cbe44-ef41109_0
2025-10-02T09:32:33.192097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6079b072-9644adb1-19680be1-550c3a82_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a745447-1740c993-b20cbe44-ef41109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.194866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Write session: try to update token
2025-10-02T09:32:33.194881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.201174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.201185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.201186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.201187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.201190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.201192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.201195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817370652:9494]
2025-10-02T09:32:33.201212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.201215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.201215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.201216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.201218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.201219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.201322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.207066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId: src_id|8a745447-1740c993-b20cbe44-ef41109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.209028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.273885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892913379:3893]
2025-10-02T09:32:33.274057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1575, pipe: [1:7556554951892913379:3893]
2025-10-02T09:32:33.311492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.311749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.311757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.311770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913379:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.311915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.311939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.311952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892913379:3893]
2025-10-02T09:32:33.311972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:33.312030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1576 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a745447-1740c993-b20cbe44-ef41109_0
2025-10-02T09:32:33.312165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1576 sessionId: src_id|8a745447-1740c993-b20cbe44-ef41109_0 is DEAD
2025-10-02T09:32:33.312335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:33.312347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Write session will restart in 0.007247s
2025-10-02T09:32:33.312369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Write session: Do CDS request
2025-10-02T09:32:33.312375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.319159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.319761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.319857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.319863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.319869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.319893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.319919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817370817:9497]
2025-10-02T09:32:33.320228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.320257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.320297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.320305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1577
2025-10-02T09:32:33.320414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.320435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.320445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.320464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.320469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.320480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.320608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.320636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.320640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.320640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.320641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.320641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.320642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.320643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.320643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.320644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.320644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.320645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.320645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.320648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.320655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.320657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.320659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.320661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.320662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.320664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.320666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.320668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.320670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.320672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.320674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.320678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.320681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.320686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.320688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.320691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.320693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.320696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.320698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.320702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.320704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.320710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.320713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.320715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.320718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.320723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.320725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.320728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.320731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.320733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.320735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.320738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.320743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.320745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.320748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.320735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1577 sessionId:  describe result for acl check
2025-10-02T09:32:33.320755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.320756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.320757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.320764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.320759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892913580:3330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.321138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892913580:3330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.322359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892913580:3330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.326251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892913580:3330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.326259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892913580:3330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.326261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892913580:3330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.326265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.328581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.329975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.329986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.329988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.329989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.329992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1576 [2:7556554951817370817:9497]
2025-10-02T09:32:33.329999Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.330008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.330013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.330015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.330016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.330025Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.330031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.330035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.330068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.330073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.330074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.330076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.330077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.330111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.330116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.330122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.330127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.330138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.330151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913380:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.330157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913617:3330], now have 1 active actors on pipe
2025-10-02T09:32:33.330160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.330162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.330163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.330170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.330178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.330184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.330186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.330187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.330188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.330190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.330203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.330207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.330213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.330203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1576
2025-10-02T09:32:33.330232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.330237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.330215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1576
2025-10-02T09:32:33.330250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.330257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.330259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.330260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.330265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.330270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.330276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.330366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.330371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.330377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.330430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1577 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0
2025-10-02T09:32:33.330702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a745447-1740c993-b20cbe44-ef41109_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.333456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Write session: try to update token
2025-10-02T09:32:33.333470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.339502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:33.339513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.339517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.339535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:33.339536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:33.339661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:33.339769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:33.339876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:33.339987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:33.340131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:33.340152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:33.346866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId: src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.347888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.347900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.347901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.347902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.347906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.347907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.347909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817370812:9497]
2025-10-02T09:32:33.347926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.347929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.347929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.347930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.347931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.347934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.348033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.348964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.412128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892913625:3893]
2025-10-02T09:32:33.412291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1576, pipe: [1:7556554951892913625:3893]
2025-10-02T09:32:33.456766Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.457043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.457052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.457065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913625:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.457262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.457266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892913625:3893]
2025-10-02T09:32:33.457267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.457288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:33.457290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:33.457335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1577 reason: error at write: Disconnected sessionId: src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0
2025-10-02T09:32:33.457481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1577 sessionId: src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0 is DEAD
2025-10-02T09:32:33.457631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:33.457646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Write session will restart in 0.008545s
2025-10-02T09:32:33.457668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Write session: Do CDS request
2025-10-02T09:32:33.457673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.464758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.465419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.465511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.465518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.465523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.465547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.465570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817370977:9499]
2025-10-02T09:32:33.465905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.466057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.466079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.466249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.466277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.466282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.466282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.466283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.466283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.466284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.466284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.466285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.466285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.466286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.466286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.466287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.466290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.466297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.466299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.466301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.466303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.466305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.466307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.466309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.466311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.466314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.466316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.466318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.466322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.466326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.466329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.466331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.466333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.466336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.466338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.466340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.466343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.466345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.466347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.466350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.466352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.466355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.466357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.466360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.466362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.466365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.466368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.466373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.466376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.466378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.466380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.466383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.466400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.467223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.467285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.467292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1578
2025-10-02T09:32:33.467437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.467459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.467467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.467469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.467738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1578 sessionId:  describe result for acl check
2025-10-02T09:32:33.467761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.467765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.467766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.467769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892913829:3325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.468116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892913829:3325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.469362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892913829:3325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.473517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892913829:3325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.473523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892913829:3325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.473525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892913829:3325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.473528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.474162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.475589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.475598Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.475599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.475601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.475605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1577 [2:7556554951817370977:9499]
2025-10-02T09:32:33.475612Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.475620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.475622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.475623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.475624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.475632Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.475639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.475643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.475672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.475676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.475677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.475679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.475680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.475712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.475716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.475723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.475730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.475738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.475751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913626:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.475756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913863:3325], now have 1 active actors on pipe
2025-10-02T09:32:33.475759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.475760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.475761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.475768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.475778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.475778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.475780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.475781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.475787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.475788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.475801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.475787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1577
2025-10-02T09:32:33.475805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.475807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.475829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1577
2025-10-02T09:32:33.475858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.475863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.475876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.475883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.475885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.475887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.475891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.475897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.475904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.476005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.476009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.476016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.476075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1578 partition: 0 MaxSeqNo: 36 sessionId: src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0
2025-10-02T09:32:33.476337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e94dd6e-4658317d-59ce9f05-d87740c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.478782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Write session: try to update token
2025-10-02T09:32:33.478795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.485378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.485391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.485392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.485393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.485396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.485398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.485400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817370972:9499]
2025-10-02T09:32:33.485418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.485422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.485421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.485424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.485425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.485427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.485523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.491776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId: src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.493966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.557554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892913872:3893]
2025-10-02T09:32:33.557756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1577, pipe: [1:7556554951892913872:3893]
2025-10-02T09:32:33.596295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.596615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.596624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.596635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913872:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.596767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.596828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892913872:3893]
2025-10-02T09:32:33.596839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.596856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:33.596921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1578 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0
2025-10-02T09:32:33.597061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1578 sessionId: src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0 is DEAD
2025-10-02T09:32:33.597168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:33.597174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Write session will restart in 0.007565s
2025-10-02T09:32:33.597204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Write session: Do CDS request
2025-10-02T09:32:33.597208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.604762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.605453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.605550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.605556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.605562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.605586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.605609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817371138:9501]
2025-10-02T09:32:33.605958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.606122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.606144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.606192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.606317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.606329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.606343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.606338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1579
2025-10-02T09:32:33.606347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.606348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.606348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.606349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.606350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.606350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.606351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.606351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.606352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.606352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.606353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.606356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.606362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.606365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.606367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.606369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.606371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.606375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.606377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.606379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.606381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.606383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.606387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.606391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.606394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.606397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.606399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.606402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.606405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.606408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.606410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.606412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.606414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.606417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.606419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.606422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.606424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.606426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.606429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.606432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.606435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.606437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.606440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.606442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.606444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.606446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.606449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.606462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.606468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.606474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.606477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.606747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1579 sessionId:  describe result for acl check
2025-10-02T09:32:33.606776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.606780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.606781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.606785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892914077:3310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.607130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892914077:3310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.608554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892914077:3310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.612912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892914077:3310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.612920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892914077:3310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.612922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892914077:3310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.612926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.614247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.615603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.615614Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.615615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.615617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.615620Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1578 [2:7556554951817371138:9501]
2025-10-02T09:32:33.615626Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.615636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.615637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.615638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.615639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.615647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.615650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.615654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.615683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.615688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.615690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.615691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.615693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.615727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.615732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.615738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.615743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.615751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.615764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892913873:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.615769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914112:3310], now have 1 active actors on pipe
2025-10-02T09:32:33.615773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.615775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.615776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.615783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.615790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.615792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.615794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.615795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.615801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.615802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.615803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1578
2025-10-02T09:32:33.615804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1578
2025-10-02T09:32:33.615816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.615820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.615822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.615832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.615837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.615862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.615868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.615870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.615872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.615877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.615885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.615896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.615987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.615992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.615999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.616051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1579 partition: 0 MaxSeqNo: 36 sessionId: src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0
2025-10-02T09:32:33.616239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b001f451-4f1dfae8-f73df8d0-67fe07f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.618465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Write session: try to update token
2025-10-02T09:32:33.618474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.625502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.625516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.625517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.625518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.625523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.625526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.625530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817371133:9501]
2025-10-02T09:32:33.625551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.625554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.625555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.625560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.625563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.625566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.625671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.628891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId: src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.630785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.696792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892914120:3893]
2025-10-02T09:32:33.696962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1578, pipe: [1:7556554951892914120:3893]
2025-10-02T09:32:33.738743Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.738959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.738968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.738993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914120:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.739171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.739190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.739195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:33.739199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:33.739237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892914120:3893]
2025-10-02T09:32:33.739253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1579 reason: error at write: Disconnected sessionId: src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0
2025-10-02T09:32:33.739399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1579 sessionId: src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0 is DEAD
2025-10-02T09:32:33.739532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:33.739537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Write session will restart in 0.007390s
2025-10-02T09:32:33.739553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Write session: Do CDS request
2025-10-02T09:32:33.739566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.747355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.748097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.748178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.748220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.748226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.748232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.748262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.748284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817371300:9503]
2025-10-02T09:32:33.748288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.748296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1580
2025-10-02T09:32:33.748400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.748425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.748433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.748436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.748709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1580 sessionId:  describe result for acl check
2025-10-02T09:32:33.748733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.748737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.748739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.748742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892914322:3309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.748740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.748921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.748946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.749107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892914322:3309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.749125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.749154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.749158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.749159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.749159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.749160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.749160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.749161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.749161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.749162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.749162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.749163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.749163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.749166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.749172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.749174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.749176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.749178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.749180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.749182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.749184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.749186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.749189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.749191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.749193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.749196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.749200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.749203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.749206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.749208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.749211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.749213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.749215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.749217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.749220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.749222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.749225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.749227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.749230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.749232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.749235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.749237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.749240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.749242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.749245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.749247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.749250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.749252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.749256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.749273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.750394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892914322:3309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.754831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892914322:3309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.754839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892914322:3309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.754841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892914322:3309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.754844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.757180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.758553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.758564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.758565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.758567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.758570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1579 [2:7556554951817371300:9503]
2025-10-02T09:32:33.758578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.758588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.758593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.758594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.758595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.758605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.758607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.758611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.758639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.758644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.758645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.758647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.758648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.758687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.758692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.758698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.758704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.758711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.758726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914361:3309], now have 1 active actors on pipe
2025-10-02T09:32:33.758731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914121:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.758734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.758736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.758737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.758745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.758752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.758758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.758760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.758761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.758755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1579
2025-10-02T09:32:33.758762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.758760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1579
2025-10-02T09:32:33.758774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.758788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.758794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.758796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.758804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.758809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.758835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.758842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.758845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.758846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.758851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.758856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.758868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.758973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.758979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.758986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.759041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1580 partition: 0 MaxSeqNo: 36 sessionId: src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0
2025-10-02T09:32:33.759239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ce13d1-598e4ef1-8ba83e94-c75d26fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.762127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Write session: try to update token
2025-10-02T09:32:33.762145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.768449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.768460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.768461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.768462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.768465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.768467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.768469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817371295:9503]
2025-10-02T09:32:33.768487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.768489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.768489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.768490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.768491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.768494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.768594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.774723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId: src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.776673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.839122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892914375:3893]
2025-10-02T09:32:33.839244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1579, pipe: [1:7556554951892914375:3893]
2025-10-02T09:32:33.879226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:33.879575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.879585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.879597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914375:3893], now have 1 active actors on pipe
2025-10-02T09:32:33.879716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:33.879735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892914375:3893]
2025-10-02T09:32:33.879760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:33.879817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1580 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0
2025-10-02T09:32:33.879957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1580 sessionId: src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0 is DEAD
2025-10-02T09:32:33.879999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:33.880138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:33.880152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Write session will restart in 0.008631s
2025-10-02T09:32:33.880178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Write session: Do CDS request
2025-10-02T09:32:33.880183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:33.887173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:33.887847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:33.887942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:33.887949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:33.887954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:33.887980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:33.888002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554951817371476:9506]
2025-10-02T09:32:33.888338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:33.888498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:33.888519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:33.888691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:33.888718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.888722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.888723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.888723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.888724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.888724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.888725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.888725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.888726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.888726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.888727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.888728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.888730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.888738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.888740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.888742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.888744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.888746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.888748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.888750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.888752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.888754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.888756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.888758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.888761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.888765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:33.888768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.888771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:33.888773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.888775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:33.888777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.888780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:33.888782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.888785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:33.888787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.888789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:33.888791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.888794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:33.888797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.888812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:33.888816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.888821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:33.888828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.888833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.888840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.888844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.888850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.888853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.888871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:33.890149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.890205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:33.890212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1581
2025-10-02T09:32:33.890299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:33.890316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:33.890321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:33.890324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:33.890546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1581 sessionId:  describe result for acl check
2025-10-02T09:32:33.890565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:33.890570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:33.890571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:33.890575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554951892914598:3302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:33.890875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554951892914598:3302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:33.892039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554951892914598:3302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:33.896020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554951892914598:3302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:33.896028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554951892914598:3302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:33.896031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554951892914598:3302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:33.896034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:33.896670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:33.898037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:33.898049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:33.898050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:33.898052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:33.898056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1580 [2:7556554951817371476:9506]
2025-10-02T09:32:33.898063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:33.898072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:33.898076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.898077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.898078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.898087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:33.898091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:33.898095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:33.898122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.898127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.898128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.898130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:33.898131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:33.898167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:33.898172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.898178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:33.898183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:33.898192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:33.898205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914379:2446], now have 1 active actors on pipe
2025-10-02T09:32:33.898209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914632:3302], now have 1 active actors on pipe
2025-10-02T09:32:33.898213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.898214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.898215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.898222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:33.898229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:33.898235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:33.898236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:33.898237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:33.898243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:33.898244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:33.898250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.898255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:33.898264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:33.898253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1580
2025-10-02T09:32:33.898261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1580
2025-10-02T09:32:33.898278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.898284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.898299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:33.898306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:33.898308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:33.898309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:33.898314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:33.898319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:33.898326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.898418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:33.898423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:33.898431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:33.898490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1581 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0
2025-10-02T09:32:33.898675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94a3338-dc8c04a0-232058f7-aabf2734_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:33.901531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Write session: try to update token
2025-10-02T09:32:33.901546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:33.907801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:33.907813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.907817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.907837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:33.907837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:33.907965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:33.908074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:33.908185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:33.908297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:33.908449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:33.908469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:33.914881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId: src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:33.916608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:33.916620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:33.916621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:33.916621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:33.916626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.916628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.916630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554951817371471:9506]
2025-10-02T09:32:33.916648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:33.916650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:33.916652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:33.916653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:33.916654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:33.916656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:33.916756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:33.916991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:33.979943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554951892914639:3893]
2025-10-02T09:32:33.980111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1580, pipe: [1:7556554951892914639:3893]
2025-10-02T09:32:34.026989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.027234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.027243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.027255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554951892914639:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.027402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.027419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554951892914639:3893]
2025-10-02T09:32:34.027425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.027441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:34.027443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:34.027495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1581 reason: error at write: Disconnected sessionId: src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0
2025-10-02T09:32:34.027640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1581 sessionId: src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0 is DEAD
2025-10-02T09:32:34.027813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:34.027830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Write session will restart in 0.005209s
2025-10-02T09:32:34.027856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Write session: Do CDS request
2025-10-02T09:32:34.027862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.034132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.034206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.034214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1582
2025-10-02T09:32:34.034357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.034378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.034384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.034386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.034669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1582 sessionId:  describe result for acl check
2025-10-02T09:32:34.034691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.034696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.034697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.034700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187882137:3299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.035092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187882137:3299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.035140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.035886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.035993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.036000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.036006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.036035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.036057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112338937:9509]
2025-10-02T09:32:34.036393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.036538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.036561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.036565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187882137:3299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.036734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.036763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.036767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.036768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.036768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.036769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.036769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.036770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.036770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.036771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.036771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.036771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.036772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.036775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.036781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.036783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.036785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.036787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.036789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.036791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.036793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.036795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.036797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.036813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.036816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.036821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.036827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.036831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.036836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.036839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.036842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.036844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.036847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.036849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.036852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.036854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.036857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.036859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.036862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.036864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.036866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.036868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.036871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.036873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.036876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.036878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.036881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.036883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.036885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.036902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.040913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187882137:3299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.040922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187882137:3299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.040924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187882137:3299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.040928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.044787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.046150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.046161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.046163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.046165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.046168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1581 [2:7556554956112338937:9509]
2025-10-02T09:32:34.046175Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.046184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.046185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.046187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.046188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.046197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.046204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.046208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.046238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.046243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.046244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.046246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.046248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.046282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.046287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.046293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.046299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.046307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.046320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882184:3299], now have 1 active actors on pipe
2025-10-02T09:32:34.046326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187881937:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.046329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.046330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.046332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.046338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.046345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.046350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.046352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.046353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.046355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.046357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.046356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1581
2025-10-02T09:32:34.046372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.046376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.046378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.046376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1581
2025-10-02T09:32:34.046386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.046391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.046415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.046421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.046423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.046425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.046429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.046438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.046451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.046533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.046538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.046546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.046605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1582 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0
2025-10-02T09:32:34.046821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e6d9808-ba27e6d4-48ca095b-17c009fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.049659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Write session: try to update token
2025-10-02T09:32:34.049674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.055989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.056001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.056002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.056003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.056006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.056009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.056010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112338931:9509]
2025-10-02T09:32:34.056030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.056032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.056033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.056033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.056036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.056038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.056144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.063604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId: src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.065655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.127382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187882217:3893]
2025-10-02T09:32:34.127524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1581, pipe: [1:7556554956187882217:3893]
2025-10-02T09:32:34.166543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.166840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.166849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.166862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882217:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.166995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.167022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.167044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187882217:3893]
2025-10-02T09:32:34.167052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:34.167101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0
2025-10-02T09:32:34.167233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1582 sessionId: src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0 is DEAD
2025-10-02T09:32:34.167356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:34.167364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Write session will restart in 0.006136s
2025-10-02T09:32:34.167379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Write session: Do CDS request
2025-10-02T09:32:34.167383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.174175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.174203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.174209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1583
2025-10-02T09:32:34.174413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.174434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.174439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.174442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.174488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.174715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1583 sessionId:  describe result for acl check
2025-10-02T09:32:34.174739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.174744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.174745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.174748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187882422:3281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.175101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187882422:3281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.175336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.175426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.175433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.175438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.175462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.175485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112339137:9523]
2025-10-02T09:32:34.175941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.176094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.176117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.176290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.176321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.176325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.176326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.176326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.176327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.176327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.176328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.176328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.176329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.176329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.176330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.176330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.176333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.176339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.176341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.176343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.176345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.176347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.176349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.176351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.176353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.176355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.176356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.176358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.176362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.176365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.176368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.176371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.176374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.176376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.176379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.176381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.176383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.176386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.176388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.176390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.176392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.176395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.176397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.176400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.176402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.176404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.176407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.176410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.176412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.176414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.176416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.176418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.176434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.176610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187882422:3281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.181344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187882422:3281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.181351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187882422:3281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.181353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187882422:3281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.181357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.184214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.185529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.185541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.185542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.185544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.185548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1582 [2:7556554956112339137:9523]
2025-10-02T09:32:34.185555Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.185564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.185566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.185567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.185568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.185577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.185584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.185588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.185616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.185621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.185622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.185624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.185625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.185723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.185728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.185734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.185739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.185734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1582
2025-10-02T09:32:34.185748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.185749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1582
2025-10-02T09:32:34.185763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882461:3281], now have 1 active actors on pipe
2025-10-02T09:32:34.185768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882218:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.185772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.185774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.185775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.185783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.185793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.185794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.185801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.185801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.185802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.185804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.185823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.185828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.185837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.185844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.185853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.185863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7dd2062-42c820ef-24566c69-4fad0626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.185869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.185872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.185877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.185881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.185887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.185904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.185988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.185994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.186004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.186058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1583 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7dd2062-42c820ef-24566c69-4fad0626_0
2025-10-02T09:32:34.186252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a431a69-fdd2c63e-1c79d230-e7b7f499_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7dd2062-42c820ef-24566c69-4fad0626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.188673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Write session: try to update token
2025-10-02T09:32:34.188682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.195508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.195522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.195523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.195525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.195530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.195532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.195533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112339132:9523]
2025-10-02T09:32:34.195553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.195557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.195557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.195558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.195560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.195562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.195667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.199110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId: src_id|f7dd2062-42c820ef-24566c69-4fad0626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.200985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.267159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187882471:3893]
2025-10-02T09:32:34.267319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1582, pipe: [1:7556554956187882471:3893]
2025-10-02T09:32:34.305980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.306218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.306228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.306253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882471:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.306388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.306405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.306435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:34.306486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1583 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7dd2062-42c820ef-24566c69-4fad0626_0
2025-10-02T09:32:34.306530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187882471:3893]
2025-10-02T09:32:34.306718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1583 sessionId: src_id|f7dd2062-42c820ef-24566c69-4fad0626_0 is DEAD
2025-10-02T09:32:34.306848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:34.306857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Write session will restart in 0.008415s
2025-10-02T09:32:34.306875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Write session: Do CDS request
2025-10-02T09:32:34.306879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.313481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.314166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.314262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.314269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.314275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.314300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.314324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112339304:9526]
2025-10-02T09:32:34.314662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.314828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.314851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.315025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.315053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.315057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.315058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.315059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.315059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.315060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.315060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.315061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.315061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.315062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.315062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.315063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.315065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.315072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.315074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.315076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.315078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.315080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.315082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.315084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.315086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.315089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.315091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.315093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.315097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.315101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.315105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.315108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.315110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.315112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.315115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.315117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.315120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.315122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.315127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.315130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.315132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.315135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.315137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.315140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.315145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.315148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.315150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.315153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.315159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.315162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.315167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.315170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.315186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.316191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.316296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.316303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1584
2025-10-02T09:32:34.316380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.316397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.316403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.316405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.316714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1584 sessionId:  describe result for acl check
2025-10-02T09:32:34.316742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.316748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.316749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.316753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187882681:3269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.317253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187882681:3269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.318807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187882681:3269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.322426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187882681:3269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.322434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187882681:3269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.322436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187882681:3269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.322440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.322997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.324368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.324380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.324382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.324384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.324387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1583 [2:7556554956112339304:9526]
2025-10-02T09:32:34.324394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.324403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.324408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.324410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.324411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.324420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.324423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.324428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.324460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.324465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.324466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.324468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.324470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.324507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.324511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.324517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.324522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.324532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.324547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882716:3269], now have 1 active actors on pipe
2025-10-02T09:32:34.324552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882472:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.324556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.324557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.324559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.324567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.324577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.324571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1583
2025-10-02T09:32:34.324579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.324576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1583
2025-10-02T09:32:34.324581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.324582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.324587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.324588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.324610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.324614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.324622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.324629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.324638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.324649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.324656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.324658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.324659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.324664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.324672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.324687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.324771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.324775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.324783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.324846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1584 partition: 0 MaxSeqNo: 36 sessionId: src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0
2025-10-02T09:32:34.325119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dd2062-42c820ef-24566c69-4fad0626_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.327896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Write session: try to update token
2025-10-02T09:32:34.327915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.334223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.334235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.334236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.334237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.334240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.334244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.334245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112339299:9526]
2025-10-02T09:32:34.334264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.334264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.334266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.334266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.334267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.334268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.334372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.340278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId: src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.342237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.406437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187882724:3893]
2025-10-02T09:32:34.406602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1583, pipe: [1:7556554956187882724:3893]
2025-10-02T09:32:34.445372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.445663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.445672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.445684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882724:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.445797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.445814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:34.445822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:34.445832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.445862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187882724:3893]
2025-10-02T09:32:34.445866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1584 reason: error at write: Disconnected sessionId: src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0
2025-10-02T09:32:34.446005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1584 sessionId: src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0 is DEAD
2025-10-02T09:32:34.446184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:34.446201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Write session will restart in 0.005907s
2025-10-02T09:32:34.446223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Write session: Do CDS request
2025-10-02T09:32:34.446229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.453172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.453270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.453281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1585
2025-10-02T09:32:34.453375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.453394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.453400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.453403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.453521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.453686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1585 sessionId:  describe result for acl check
2025-10-02T09:32:34.453710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.453716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.453718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.453721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187882931:3268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.454066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187882931:3268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.454231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.454322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.454328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.454334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.454357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.454379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112339471:9528]
2025-10-02T09:32:34.454711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.454876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.454898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.455072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.455100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.455104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.455105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.455105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.455106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.455106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.455107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.455107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.455107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.455108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.455109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.455109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.455112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.455118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.455120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.455122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.455124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.455126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.455128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.455130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.455132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.455135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.455137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.455139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.455142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.455146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.455150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.455152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.455154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.455157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.455159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.455162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.455164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.455167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.455169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.455171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.455174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.455176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.455178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.455181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.455183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.455186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.455188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.455190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.455193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.455197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.455200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.455202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.455220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.455407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187882931:3268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.460217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187882931:3268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.460226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187882931:3268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.460229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187882931:3268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.460234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.463030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.464427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.464438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.464439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.464441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.464444Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1584 [2:7556554956112339471:9528]
2025-10-02T09:32:34.464450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.464459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.464460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.464462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.464463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.464471Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.464476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.464480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.464512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.464517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.464518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.464520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.464521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.464554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.464558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.464565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.464570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.464577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.464591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882970:3268], now have 1 active actors on pipe
2025-10-02T09:32:34.464597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882725:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.464601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.464603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.464604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.464611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.464621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.464623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.464625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.464626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.464630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.464631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.464627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1584
2025-10-02T09:32:34.464629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1584
2025-10-02T09:32:34.464644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.464647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.464649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.464660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.464663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.464681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.464688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.464690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.464691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.464696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.464703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.464713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.464790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.464795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.464811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.464872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1585 partition: 0 MaxSeqNo: 36 sessionId: src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0
2025-10-02T09:32:34.465097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f68cf1-7aba025a-a4259a8c-326c8c07_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.467925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Write session: try to update token
2025-10-02T09:32:34.467938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.474125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.474137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.474138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.474139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.474142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.474144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.474146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112339466:9528]
2025-10-02T09:32:34.474163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.474166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.474169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.474170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.474170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.474172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.474278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.481237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId: src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.483299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.546199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187882978:3893]
2025-10-02T09:32:34.546344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1584, pipe: [1:7556554956187882978:3893]
2025-10-02T09:32:34.585014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.585222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.585231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.585243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882978:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.585378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.585426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:34.585433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.585435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:34.585464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187882978:3893]
2025-10-02T09:32:34.585479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1585 reason: error at write: Disconnected sessionId: src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0
2025-10-02T09:32:34.585609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1585 sessionId: src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0 is DEAD
2025-10-02T09:32:34.585779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:34.585803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Write session will restart in 0.009620s
2025-10-02T09:32:34.585831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Write session: Do CDS request
2025-10-02T09:32:34.585836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.593302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.594012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.594118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.594125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.594130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.594155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.594179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112339639:9530]
2025-10-02T09:32:34.594511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.594663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.594684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.594870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.594899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.594903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.594903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.594904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.594904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.594905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.594905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.594906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.594906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.594907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.594907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.594908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.594911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.594917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.594919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.594921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.594923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.594925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.594927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.594929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.594931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.594933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.594935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.594937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.594941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.594945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.594948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.594951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.594953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.594955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.594957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.594960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.594962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.594965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.594967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.594969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.594972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.594974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.594977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.594979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.594983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.594985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.594988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.594992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.594994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.594996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.594998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.595000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.595016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.596185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.596312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.596319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1586
2025-10-02T09:32:34.596444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.596461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.596467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.596469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.596793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1586 sessionId:  describe result for acl check
2025-10-02T09:32:34.596834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.596840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.596842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.596846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187883190:3263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.597319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187883190:3263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.598835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187883190:3263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.602214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187883190:3263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.602223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187883190:3263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.602225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187883190:3263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.602228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.602858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.604236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.604247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.604248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.604250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.604253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1585 [2:7556554956112339639:9530]
2025-10-02T09:32:34.604259Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.604267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.604269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.604270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.604271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.604281Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.604287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.604290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.604319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.604324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.604325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.604327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.604328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.604362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.604367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.604373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.604378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.604389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.604404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883224:3263], now have 1 active actors on pipe
2025-10-02T09:32:34.604410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187882979:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.604413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.604414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.604415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.604423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.604432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.604421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1585
2025-10-02T09:32:34.604423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1585
2025-10-02T09:32:34.604439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.604440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.604442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.604443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.604445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.604455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.604456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.604460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.604465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.604467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.604488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.604495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.604497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.604498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.604503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.604508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.604520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.604609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.604614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.604621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.604674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1586 partition: 0 MaxSeqNo: 36 sessionId: src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0
2025-10-02T09:32:34.604917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95cf8ec7-34e6ae66-f8ead612-aab88491_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.607774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Write session: try to update token
2025-10-02T09:32:34.607789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.614193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.614204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.614205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.614206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.614210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.614212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.614214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112339634:9530]
2025-10-02T09:32:34.614232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.614232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.614236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.614238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.614238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.614239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.614339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.621289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId: src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.623381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.685479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187883232:3893]
2025-10-02T09:32:34.685653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1585, pipe: [1:7556554956187883232:3893]
2025-10-02T09:32:34.727032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.727321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.727330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.727342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883232:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.727460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.727492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187883232:3893]
2025-10-02T09:32:34.727504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.727514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:34.727569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1586 reason: status is not ok: tablet will be restarted right now sessionId: src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0
2025-10-02T09:32:34.727709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1586 sessionId: src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0 is DEAD
2025-10-02T09:32:34.727877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:34.727894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Write session will restart in 0.008456s
2025-10-02T09:32:34.727916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Write session: Do CDS request
2025-10-02T09:32:34.727921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.736046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.736871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.736987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.736994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.737000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.737027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.737054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112339809:9532]
2025-10-02T09:32:34.737231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.737347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.737355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1587
2025-10-02T09:32:34.737407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.737493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.737511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.737513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.737516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.737574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.737596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.737779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1587 sessionId:  describe result for acl check
2025-10-02T09:32:34.737802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.737806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.737807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.737810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187883443:3258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.737846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.737884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.737888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.737889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.737889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.737890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.737890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.737891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.737891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.737893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.737893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.737896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.737903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.737905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.737907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.737909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.737911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.737913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.737915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.737917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.737919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.737921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.737923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.737927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.737931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.737934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.737937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.737939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.737942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.737944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.737947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.737949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.737951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.737954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.737956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.737959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.737962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.737964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.737967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.737969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.737972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.737974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.737976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.737978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.737981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.737983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.737985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.738002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.738168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187883443:3258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.739531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187883443:3258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.743529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187883443:3258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.743537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187883443:3258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.743538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187883443:3258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.743542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.745956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.747318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.747329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.747331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.747333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.747336Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1586 [2:7556554956112339809:9532]
2025-10-02T09:32:34.747343Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.747354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.747355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.747356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.747357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.747367Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.747373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.747378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.747413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.747418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.747419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.747421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.747422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.747457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.747462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.747468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.747474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.747485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.747499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883480:3258], now have 1 active actors on pipe
2025-10-02T09:32:34.747505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883234:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.747508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.747513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.747514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.747522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.747532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.747536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.747539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.747541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.747543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.747530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1586
2025-10-02T09:32:34.747544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.747531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1586
2025-10-02T09:32:34.747558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.747563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.747565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.747574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.747579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.747602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.747609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.747611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.747612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.747617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.747625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.747637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.747724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.747729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.747736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.747803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1587 partition: 0 MaxSeqNo: 36 sessionId: src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0
2025-10-02T09:32:34.748059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896fe743-77cc05ea-f77db332-4c5f9ec6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.750726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Write session: try to update token
2025-10-02T09:32:34.750743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.757178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.757190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.757191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.757192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.757195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.757197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.757199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112339803:9532]
2025-10-02T09:32:34.757217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.757220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.757223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.757223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.757224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.757226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.757333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.763469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId: src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.765530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.827836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187883491:3893]
2025-10-02T09:32:34.827991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1586, pipe: [1:7556554956187883491:3893]
2025-10-02T09:32:34.867255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:34.867517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.867526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.867538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883491:3893], now have 1 active actors on pipe
2025-10-02T09:32:34.867686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:34.867742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:34.867742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:34.867776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187883491:3893]
2025-10-02T09:32:34.867803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1587 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0
2025-10-02T09:32:34.867939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1587 sessionId: src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0 is DEAD
2025-10-02T09:32:34.868101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:34.868117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Write session will restart in 0.006515s
2025-10-02T09:32:34.868137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Write session: Do CDS request
2025-10-02T09:32:34.868143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:34.875149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.875241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:34.875248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1588
2025-10-02T09:32:34.875363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:34.875383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:34.875389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:34.875392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:34.875642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1588 sessionId:  describe result for acl check
2025-10-02T09:32:34.875665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:34.875669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:34.875672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:34.875675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554956187883700:3243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:34.876041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554956187883700:3243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:34.876144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:34.876882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:34.876979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:34.876985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:34.877056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:34.877093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:34.877117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554956112339991:9535]
2025-10-02T09:32:34.877425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554956187883700:3243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:34.877523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:34.877671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:34.877693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:34.877882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:34.877911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.877914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.877915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.877915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.877916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.877916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.877917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.877918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.877918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.877919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.877919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.877920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.877923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.877928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.877930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.877933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.877935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.877937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.877939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.877941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.877943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.877945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.877947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.877949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.877952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.877956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:34.877959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.877962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:34.877964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.877967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:34.877969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.877973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:34.877975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.877977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:34.877980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.877982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:34.877985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.877991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:34.877993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.877996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:34.877999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.878005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:34.878007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.878010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.878015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.878018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.878020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.878023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.878039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:34.882003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554956187883700:3243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:34.882012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554956187883700:3243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:34.882014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554956187883700:3243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:34.882017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:34.885876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:34.887224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:34.887234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:34.887235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:34.887237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:34.887241Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1587 [2:7556554956112339991:9535]
2025-10-02T09:32:34.887247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:34.887256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:34.887259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.887261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.887262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.887270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:34.887273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:34.887277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:34.887305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.887311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.887312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.887314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:34.887316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:34.887349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:34.887354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.887359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:34.887365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:34.887373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:34.887384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883493:2446], now have 1 active actors on pipe
2025-10-02T09:32:34.887389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883751:3243], now have 1 active actors on pipe
2025-10-02T09:32:34.887393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.887394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.887395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.887402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:34.887409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:34.887415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:34.887417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:34.887418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:34.887420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:34.887422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:34.887427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1587
2025-10-02T09:32:34.887434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.887433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1587
2025-10-02T09:32:34.887439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:34.887440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:34.887468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.887473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.887489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:34.887495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:34.887497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:34.887499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:34.887503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:34.887510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:34.887518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.887612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:34.887617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:34.887624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:34.887681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1588 partition: 0 MaxSeqNo: 36 sessionId: src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0
2025-10-02T09:32:34.887929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726a356-ec91cc3c-454f6a62-58b9fc14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:34.890793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Write session: try to update token
2025-10-02T09:32:34.890810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:34.896910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:34.896920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.896923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.896945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:34.896948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:34.897070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:34.897174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:34.897280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:34.897387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:34.897538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:34.897559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:34.903969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId: src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:34.905358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:34.905369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:34.905370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:34.905371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:34.905374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.905376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.905378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554956112339986:9535]
2025-10-02T09:32:34.905394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:34.905396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:34.905397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:34.905398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:34.905401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:34.905403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:34.905501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:34.906078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:34.968092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554956187883764:3893]
2025-10-02T09:32:34.968265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1587, pipe: [1:7556554956187883764:3893]
2025-10-02T09:32:35.016253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.016507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.016515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.016529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554956187883764:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.016666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.016685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:35.016694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:35.016710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554956187883764:3893]
2025-10-02T09:32:35.016726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.016739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1588 reason: error at write: Disconnected sessionId: src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0
2025-10-02T09:32:35.016885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1588 sessionId: src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0 is DEAD
2025-10-02T09:32:35.017037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:35.017052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Write session will restart in 0.008399s
2025-10-02T09:32:35.017077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Write session: Do CDS request
2025-10-02T09:32:35.017083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.025047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.025894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.025998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.026005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.026010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.026036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.026059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407307459:9538]
2025-10-02T09:32:35.026173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.026294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.026302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1589
2025-10-02T09:32:35.026392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.026437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.026457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.026460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.026462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.026558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.026581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.026715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1589 sessionId:  describe result for acl check
2025-10-02T09:32:35.026737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.026751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.026752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.026755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482851273:3239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.026761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.026802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.026806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.026807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.026807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.026808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.026808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.026809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.026809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.026810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.026810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.026811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.026811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.026814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.026821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.026823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.026825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.026827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.026829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.026831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.026833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.026835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.026837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.026839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.026840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.026845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.026849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.026852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.026855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.026857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.026860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.026863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.026866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.026869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.026872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.026874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.026876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.026879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.026881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.026883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.026886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.026888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.026890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.026892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.026894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.026896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.026899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.026901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.026903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.026920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.027109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482851273:3239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.028399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482851273:3239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.032453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482851273:3239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.032463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482851273:3239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.032466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482851273:3239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.032471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.034733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.036123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.036135Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.036136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.036138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.036141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1588 [2:7556554960407307459:9538]
2025-10-02T09:32:35.036147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.036156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.036157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.036159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.036160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.036168Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.036174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.036179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.036207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.036212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.036213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.036215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.036216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.036250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.036255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.036261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.036266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.036277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.036292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851310:3239], now have 1 active actors on pipe
2025-10-02T09:32:35.036297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851061:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.036301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.036303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.036304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.036311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.036320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.036328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.036319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1588
2025-10-02T09:32:35.036329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.036331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.036324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1588
2025-10-02T09:32:35.036332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.036334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.036343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.036345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.036347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.036361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.036364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.036383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.036389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.036391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.036392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.036397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.036402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.036417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.036512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.036517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.036524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.036580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1589 partition: 0 MaxSeqNo: 36 sessionId: src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0
2025-10-02T09:32:35.036837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26cff8f-37fe5e2c-af500961-3e8b1dd4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.039673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Write session: try to update token
2025-10-02T09:32:35.039688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.045839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.045851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.045852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.045852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.045856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.045858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.045860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407307454:9538]
2025-10-02T09:32:35.045878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.045880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.045882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.045884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.045885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.045886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.045986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.053070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId: src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.055111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.117103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482851318:3893]
2025-10-02T09:32:35.117259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1588, pipe: [1:7556554960482851318:3893]
2025-10-02T09:32:35.154343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.154543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.154552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.154563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851318:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.154668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.154690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:35.154696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482851318:3893]
2025-10-02T09:32:35.154700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:35.154708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.154735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1589 reason: error at write: Disconnected sessionId: src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0
2025-10-02T09:32:35.154879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1589 sessionId: src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0 is DEAD
2025-10-02T09:32:35.155036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:35.155049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Write session will restart in 0.006761s
2025-10-02T09:32:35.155071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Write session: Do CDS request
2025-10-02T09:32:35.155076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.162117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.162851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.162954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.162961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.162967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.162992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.163016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407307666:9552]
2025-10-02T09:32:35.163163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.163289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.163296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1590
2025-10-02T09:32:35.163417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.163434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.163439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.163442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.163502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.163656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.163677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.163691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1590 sessionId:  describe result for acl check
2025-10-02T09:32:35.163717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.163721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.163722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.163724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482851554:3218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.163844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.163872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.163875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.163876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.163876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.163877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.163878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.163878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.163879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.163879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.163880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.163880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.163881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.163883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.163889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.163891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.163893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.163895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.163897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.163899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.163901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.163903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.163905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.163907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.163909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.163912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.163915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.163919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.163921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.163923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.163926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.163929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.163931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.163933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.163936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.163938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.163940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.163942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.163944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.163951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.163953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.163956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.163958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.163961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.163963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.163965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.163968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.163973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.163975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.163992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.164041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482851554:3218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.165863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482851554:3218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.170105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482851554:3218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.170115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482851554:3218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.170118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482851554:3218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.170122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.171869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.173326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.173337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.173338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.173340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.173344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1589 [2:7556554960407307666:9552]
2025-10-02T09:32:35.173349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.173358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.173359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.173361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.173362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.173370Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.173373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.173377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.173407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.173412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.173413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.173415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.173416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.173450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.173455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.173461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.173466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.173474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.173488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851591:3218], now have 1 active actors on pipe
2025-10-02T09:32:35.173494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851341:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.173498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.173499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.173500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.173507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.173514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.173517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1589
2025-10-02T09:32:35.173519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.173522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.173523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.173528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.173525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1589
2025-10-02T09:32:35.173529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.173535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.173537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.173543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.173553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.173555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.173570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.173578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.173580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.173581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.173586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.173591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.173598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.173685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.173689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.173697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.173748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1590 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0
2025-10-02T09:32:35.173975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b944e470-d0d729ae-3e91d2e5-e67a8d10_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.176785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Write session: try to update token
2025-10-02T09:32:35.176816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.183040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.183051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.183052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.183052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.183056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.183058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.183059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407307661:9552]
2025-10-02T09:32:35.183077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.183079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.183080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.183083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.183085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.183088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.183183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.189875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId: src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.191910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.254804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482851601:3893]
2025-10-02T09:32:35.254966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1589, pipe: [1:7556554960482851601:3893]
2025-10-02T09:32:35.290911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.291121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.291129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.291141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851601:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.291279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.291304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482851601:3893]
2025-10-02T09:32:35.291318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:35.291324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:35.291327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.291376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1590 reason: error at write: Disconnected sessionId: src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0
2025-10-02T09:32:35.291507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1590 sessionId: src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0 is DEAD
2025-10-02T09:32:35.291644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:35.291655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Write session will restart in 0.008047s
2025-10-02T09:32:35.291677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Write session: Do CDS request
2025-10-02T09:32:35.291683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.299379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.300394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.300492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.300498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.300503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.300528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.300551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407307841:9555]
2025-10-02T09:32:35.300897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.301069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.301091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.301122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.301216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.301224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1591
2025-10-02T09:32:35.301264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.301292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.301296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.301296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.301297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.301297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.301298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.301298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.301299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.301300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.301300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.301301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.301301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.301304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.301311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.301313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.301315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.301317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.301318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.301320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.301322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.301324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.301326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.301328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.301330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.301349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.301334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.301338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.301342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.301344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.301347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.301368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.301349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.301376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.301351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.301354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.301356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.301358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.301379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.301360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.301363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.301365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.301368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.301370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.301372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.301375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.301378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.301380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.301384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.301386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.301388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.301390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.301393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.301411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.301676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1591 sessionId:  describe result for acl check
2025-10-02T09:32:35.301705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.301711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.301712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.301728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482851818:3221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.302201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482851818:3221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.304125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482851818:3221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.307926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482851818:3221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.307937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482851818:3221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.307940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482851818:3221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.307944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.309255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.310608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.310620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.310621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.310623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.310626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1590 [2:7556554960407307841:9555]
2025-10-02T09:32:35.310633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.310642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.310647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.310649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.310649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.310658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.310663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.310667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.310695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.310699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.310701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.310702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.310704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.310738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.310743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.310750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.310755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.310770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.310784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851602:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.310789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851853:3221], now have 1 active actors on pipe
2025-10-02T09:32:35.310793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.310794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.310795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.310803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.310811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.310817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.310820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.310822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.310822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.310824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.310808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1590
2025-10-02T09:32:35.310837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.310817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1590
2025-10-02T09:32:35.310842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.310843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.310853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.310857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.310880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec5d888-10a003cb-b47eef4-9021e545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.310887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.310889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.310890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.310894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.310900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.310908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.311003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.311008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.311014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.311067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1591 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ec5d888-10a003cb-b47eef4-9021e545_0
2025-10-02T09:32:35.311299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a1d03b-7220f5fa-6b05f9fe-e0233ed0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ec5d888-10a003cb-b47eef4-9021e545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.313993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Write session: try to update token
2025-10-02T09:32:35.314008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.320782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.320796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.320797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.320811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.320815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.320817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.320823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407307836:9555]
2025-10-02T09:32:35.320843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.320843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.320846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.320848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.320851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.320852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.320966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.332990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId: src_id|8ec5d888-10a003cb-b47eef4-9021e545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.335042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.353606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:32:35.353620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-02T09:32:35.391514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482851863:3893]
2025-10-02T09:32:35.391682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1590, pipe: [1:7556554960482851863:3893]
2025-10-02T09:32:35.432135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.432434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.432444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.432466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851863:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.432646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.432654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:35.432657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:35.432663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-02T09:32:35.432690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482851863:3893]
2025-10-02T09:32:35.432703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1591 reason: error at write: Disconnected sessionId: src_id|8ec5d888-10a003cb-b47eef4-9021e545_0
2025-10-02T09:32:35.432870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1591 sessionId: src_id|8ec5d888-10a003cb-b47eef4-9021e545_0 is DEAD
2025-10-02T09:32:35.433032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:35.433048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Write session will restart in 0.005222s
2025-10-02T09:32:35.433073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Write session: Do CDS request
2025-10-02T09:32:35.433078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.433207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.439193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.439273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.439280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1592
2025-10-02T09:32:35.439397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.439415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.439421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.439423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.439726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1592 sessionId:  describe result for acl check
2025-10-02T09:32:35.439747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.439752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.439752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.439755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482852063:3215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.440133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482852063:3215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.440790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.441686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.441760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482852063:3215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.441790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.441796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.441802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.441829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.441852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407308016:9558]
2025-10-02T09:32:35.442205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.442373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.442396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.442573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.442602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.442607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.442607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.442608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.442608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.442609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.442609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.442610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.442610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.442611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.442611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.442612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.442614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.442620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.442622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.442624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.442626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.442628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.442630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.442632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.442634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.442636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.442638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.442640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.442643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.442647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.442658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.442662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.442667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.442671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.442673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.442675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.442679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.442682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.442684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.442690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.442692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.442695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.442697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.442700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.442702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.442705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.442707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.442712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.442715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.442717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.442719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.442722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.442738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.447727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482852063:3215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.447738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482852063:3215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.447742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482852063:3215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.447747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.452310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.453799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.453812Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.453813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.453815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.453818Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1591 [2:7556554960407308016:9558]
2025-10-02T09:32:35.453827Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.453836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.453841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.453843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.453845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.453854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.453859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.453863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.453895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.453900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.453901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.453903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.453904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.453947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.453953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.453963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.453972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.453987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.454001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482851864:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.454006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852116:3215], now have 1 active actors on pipe
2025-10-02T09:32:35.454010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.454011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.454011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.454020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.454014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1591
2025-10-02T09:32:35.454023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1591
2025-10-02T09:32:35.454027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.454034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.454038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.454038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.454039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.454039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.454072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.454076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.454083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.454089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.454101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.454127Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:32:35.454147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.454154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.454156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.454157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.454162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.454167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.454179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.454236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 13 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:32:35.454258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:32:35.454260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.454265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.454273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.454319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1592 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0
2025-10-02T09:32:35.454598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec5d888-10a003cb-b47eef4-9021e545_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.457096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Write session: try to update token
2025-10-02T09:32:35.457108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.465876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.465891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.465892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.465893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.465899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.465901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.465903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407308011:9558]
2025-10-02T09:32:35.465924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.465927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.465928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.465930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.465933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.465935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.466036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.467985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId: src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.469789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.532850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482852127:3893]
2025-10-02T09:32:35.533068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1591, pipe: [1:7556554960482852127:3893]
2025-10-02T09:32:35.576950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.577162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.577170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.577195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852127:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.577343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.577373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:35.577378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482852127:3893]
2025-10-02T09:32:35.577382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:35.577423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.577431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1592 reason: error at write: Disconnected sessionId: src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0
2025-10-02T09:32:35.577550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1592 sessionId: src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0 is DEAD
2025-10-02T09:32:35.577646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:35.577651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Write session will restart in 0.009236s
2025-10-02T09:32:35.577665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Write session: Do CDS request
2025-10-02T09:32:35.577670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.585351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.586184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.586301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.586308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.586314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.586339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.586433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407308192:9561]
2025-10-02T09:32:35.586811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.587001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.587026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.587202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.587231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.587235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.587236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.587236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.587237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.587238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.587238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.587239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.587239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.587240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.587240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.587241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.587244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.587251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.587253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.587255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.587257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.587259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.587261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.587263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.587265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.587267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.587269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.587271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.587275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.587278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.587281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.587284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.587286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.587289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.587291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.587294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.587296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.587299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.587302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.587304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.587307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.587309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.587311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.587314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.587317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.587322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.587324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.587327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.587329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.587332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.587335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.587338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.587354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.588097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.588214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.588222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1593
2025-10-02T09:32:35.588318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.588337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.588343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.588346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.588654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1593 sessionId:  describe result for acl check
2025-10-02T09:32:35.588681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.588686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.588688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.588692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482852349:3212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.589167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482852349:3212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.590541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482852349:3212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.595405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482852349:3212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.595414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482852349:3212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.595416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482852349:3212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.595420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.596549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.598014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.598025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.598026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.598028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.598032Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1592 [2:7556554960407308192:9561]
2025-10-02T09:32:35.598040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.598048Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.598050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.598052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.598052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.598061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.598064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.598067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.598096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.598101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.598102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.598104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.598105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.598141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.598145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.598152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.598157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.598165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.598179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852384:3212], now have 1 active actors on pipe
2025-10-02T09:32:35.598184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852131:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.598187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.598188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.598189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.598197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.598204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.598215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.598214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.598216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.598217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.598219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.598233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.598239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.598230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1592
2025-10-02T09:32:35.598232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1592
2025-10-02T09:32:35.598260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.598263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.598265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.598280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.598288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.598290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.598291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.598296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.598301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.598309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.598389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.598394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.598401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.598447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1593 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0
2025-10-02T09:32:35.598639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff33c5a0-23d0d865-744fbb3-cc0bbfae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.601367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Write session: try to update token
2025-10-02T09:32:35.601383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.607787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:35.607800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.607804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.607822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:35.607825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:35.607948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:35.608062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:35.608169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:35.608279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:35.608433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:35.608456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:35.614744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId: src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.616840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.616988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.616996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.617019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:35.617075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:35.618514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.618525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.618526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.618527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.618531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.618534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.618535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407308187:9561]
2025-10-02T09:32:35.618555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.618557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.618560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.618561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.618562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.618563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.618665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.677717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482852392:3893]
2025-10-02T09:32:35.677929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1592, pipe: [1:7556554960482852392:3893]
2025-10-02T09:32:35.731066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.737059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.737081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.737210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.737258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.737308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.737358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.737442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.737451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.737501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.737550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.737598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.737647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.737682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.737687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.737737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.737784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.737835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.737885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.737921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.737925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.737979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.738239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.738286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.738335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.738374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.738378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.738429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.738475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.738521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.738571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.738608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.738613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.738664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.738713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.738773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.738825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.738860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.738865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.738918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.738963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.739016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.739066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.739104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.739114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.739166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.739212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.739263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.739313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.739350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.739354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.739401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.739446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.739494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.739541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.739579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.739583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.739631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:35.739675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:35.739722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:35.739769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:35.739805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:35.739810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:35.739840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852392:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.739990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.740096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482852392:3893]
2025-10-02T09:32:35.740125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:35.740140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:35.740159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1593 reason: error at write: Disconnected sessionId: src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0
2025-10-02T09:32:35.740205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.740317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1593 sessionId: src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0 is DEAD
2025-10-02T09:32:35.740482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:35.740496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Write session will restart in 0.007429s
2025-10-02T09:32:35.740519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Write session: Do CDS request
2025-10-02T09:32:35.740525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.748938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.749141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.749262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.749270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1594
2025-10-02T09:32:35.749361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.749380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.749386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.749389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.749673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1594 sessionId:  describe result for acl check
2025-10-02T09:32:35.749697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.749701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.749702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.749705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482852608:3206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.749755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.749849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.749856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.749861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.749886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.749908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407308368:9563]
2025-10-02T09:32:35.750053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482852608:3206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.750244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.750412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.750435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.750604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.750631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.750634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.750635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.750636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.750636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.750637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.750637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.750638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.750638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.750639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.750639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.750640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.750643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.750649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.750651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.750653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.750655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.750657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.750658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.750660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.750662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.750664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.750666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.750668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.750671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.750675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.750678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.750681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.750683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.750686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.750688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.750691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.750693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.750695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.750697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.750700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.750702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.750705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.750708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.750710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.750712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.750715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.750717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.750720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.750722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.750726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.750728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.750731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.750747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.751729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482852608:3206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.755827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482852608:3206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.755835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482852608:3206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.755837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482852608:3206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.755841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.758562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.760122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.760133Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.760134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.760136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.760139Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1593 [2:7556554960407308368:9563]
2025-10-02T09:32:35.760145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.760155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.760160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.760161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.760162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.760172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.760177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.760182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.760210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.760216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.760217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.760219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.760220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.760256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.760262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.760268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.760273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.760281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.760295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852393:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.760301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852647:3206], now have 1 active actors on pipe
2025-10-02T09:32:35.760304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.760307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.760308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.760317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.760327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.760331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.760333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.760334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.760336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1593
2025-10-02T09:32:35.760338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.760339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.760336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1593
2025-10-02T09:32:35.760353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.760354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.760356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.760371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.760372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.760389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.760397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.760399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.760404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.760409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.760414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.760423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.760516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.760521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.760529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.760589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1594 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0
2025-10-02T09:32:35.760815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee620bb0-5eaabbf-d3945aa3-6391d9b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.763457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Write session: try to update token
2025-10-02T09:32:35.763470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.770186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.770198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.770199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.770200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.770205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.770207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.770209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407308363:9563]
2025-10-02T09:32:35.770227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.770230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.770231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.770235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.770237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.770239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.770336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.776383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId: src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.778501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.840014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482852660:3893]
2025-10-02T09:32:35.840157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1593, pipe: [1:7556554960482852660:3893]
2025-10-02T09:32:35.881086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:35.881293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.881301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.881327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852660:3893], now have 1 active actors on pipe
2025-10-02T09:32:35.881469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:35.881527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482852660:3893]
2025-10-02T09:32:35.881538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:35.881549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:35.881646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0
2025-10-02T09:32:35.881794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1594 sessionId: src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0 is DEAD
2025-10-02T09:32:35.881947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:35.881962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Write session will restart in 0.005232s
2025-10-02T09:32:35.881985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Write session: Do CDS request
2025-10-02T09:32:35.881990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:35.888176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.888271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:35.888279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1595
2025-10-02T09:32:35.888385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:35.888406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:35.888409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:35.888411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:35.888661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1595 sessionId:  describe result for acl check
2025-10-02T09:32:35.888686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:35.888690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:35.888692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:35.888695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554960482852852:3188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:35.888990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554960482852852:3188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:35.890168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:35.890390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554960482852852:3188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:35.891067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:35.891164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:35.891171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:35.891177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:35.891202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:35.891226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554960407308557:9566]
2025-10-02T09:32:35.891573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:35.891752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:35.891774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:35.891942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:35.891970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.891974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.891975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.891975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.891976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.891976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.891977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.891977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.891978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.891978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.891979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.891979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.891982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.891987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.891989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.891991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.891993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.891995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.891997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.891999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.892001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.892003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.892005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.892007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.892011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.892014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:35.892018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.892021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:35.892022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.892025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:35.892027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.892030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:35.892032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.892035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:35.892037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.892039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:35.892041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.892044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:35.892046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.892049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:35.892052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.892055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:35.892057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.892059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.892061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.892064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.892066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.892086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554960482852852:3188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:35.892069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.892093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554960482852852:3188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:35.892085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:35.892096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554960482852852:3188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:35.892099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:35.899455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:35.900821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:35.900830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:35.900832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:35.900834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:35.900837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1594 [2:7556554960407308557:9566]
2025-10-02T09:32:35.900844Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:35.900854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:35.900855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.900857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.900858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.900867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:35.900873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:35.900878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:35.900908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.900912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.900913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.900915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:35.900917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:35.900954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:35.900959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.900964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:35.900970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:35.900980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:35.900994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852661:2446], now have 1 active actors on pipe
2025-10-02T09:32:35.900999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852927:3188], now have 1 active actors on pipe
2025-10-02T09:32:35.901003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.901005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.901006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.901013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:35.901019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:35.901028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:35.901025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1594
2025-10-02T09:32:35.901029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:35.901035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1594
2025-10-02T09:32:35.901031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:35.901033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:35.901033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:35.901048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.901049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:35.901051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:35.901060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.901062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.901082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|981a043e-5979fec7-e672a50e-5d0ce868_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:35.901089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:35.901091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:35.901092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:35.901096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:35.901105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:35.901113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.901226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:35.901231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:35.901238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:35.901293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1595 partition: 0 MaxSeqNo: 36 sessionId: src_id|981a043e-5979fec7-e672a50e-5d0ce868_0
2025-10-02T09:32:35.901542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f9729a4-453f3e69-b1c75a5b-c40519b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|981a043e-5979fec7-e672a50e-5d0ce868_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:35.903922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Write session: try to update token
2025-10-02T09:32:35.903932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:35.911727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:35.911742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:35.911743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:35.911744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:35.911749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.911752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.911754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554960407308552:9566]
2025-10-02T09:32:35.911775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:35.911778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:35.911780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:35.911786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:35.911790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:35.911793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:35.911899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:35.915933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId: src_id|981a043e-5979fec7-e672a50e-5d0ce868_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:35.918522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:35.981868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554960482852938:3893]
2025-10-02T09:32:35.982095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1594, pipe: [1:7556554960482852938:3893]
2025-10-02T09:32:36.020570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.020958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.020966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.020991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554960482852938:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.021158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.021163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554960482852938:3893]
2025-10-02T09:32:36.021191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.021194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.021262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1595 reason: error at write: Disconnected sessionId: src_id|981a043e-5979fec7-e672a50e-5d0ce868_0
2025-10-02T09:32:36.021280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.021454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1595 sessionId: src_id|981a043e-5979fec7-e672a50e-5d0ce868_0 is DEAD
2025-10-02T09:32:36.021586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.021590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Write session will restart in 0.007967s
2025-10-02T09:32:36.021609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Write session: Do CDS request
2025-10-02T09:32:36.021613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.029875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.030157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.030261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.030275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1596
2025-10-02T09:32:36.030460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.030487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.030496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.030500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.030854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1596 sessionId:  describe result for acl check
2025-10-02T09:32:36.030883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.030888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.030889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.030892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777820453:3191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.030888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.030983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.030989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.030995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.031022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.031046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702276032:9569]
2025-10-02T09:32:36.031277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777820453:3191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.031386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.031561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.031583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.031764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.031795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.031799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.031799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.031800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.031800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.031801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.031801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.031802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.031803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.031803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.031804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.031804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.031807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.031813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.031815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.031817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.031819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.031821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.031823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.031825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.031827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.031830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.031831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.031833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.031837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.031840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.031844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.031847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.031849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.031852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.031854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.031857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.031859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.031861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.031863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.031866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.031868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.031871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.031873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.031876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.031878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.031881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.031883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.031886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.031888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.031891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.031893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.031895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.031913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.033183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777820453:3191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.037348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777820453:3191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.037358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777820453:3191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.037361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777820453:3191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.037366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.039534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.040932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.040942Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.040943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.040945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.040948Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1595 [2:7556554964702276032:9569]
2025-10-02T09:32:36.040955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.040964Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.040965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.040967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.040968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.040977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.040979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.040984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.041014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.041020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.041021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.041024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.041025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.041061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.041066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.041072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.041077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.041085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.041099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820491:3191], now have 1 active actors on pipe
2025-10-02T09:32:36.041105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820236:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.041108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.041109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.041110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.041118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.041125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.041131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.041134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.041134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.041135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.041137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.041149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.041154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.041156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.041155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1595
2025-10-02T09:32:36.041166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1595
2025-10-02T09:32:36.041190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.041195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.041209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.041215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.041217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.041218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.041222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.041227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.041238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.041369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.041374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.041381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.041450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1596 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0
2025-10-02T09:32:36.041710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|981a043e-5979fec7-e672a50e-5d0ce868_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.043911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Write session: try to update token
2025-10-02T09:32:36.043920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.050595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:36.050613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.050618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.050643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:36.050645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:36.050800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:36.050928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:36.051041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:36.051155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:36.051321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:36.051351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:36.054981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId: src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.057570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:36.057708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.057717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.057733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:36.057809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:36.061705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.061717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.061719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.061720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.061727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.061730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.061734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702276027:9569]
2025-10-02T09:32:36.061758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.061761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.061766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.061768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.061768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.061770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.061893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.121130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554964777820499:3893]
2025-10-02T09:32:36.121309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1595, pipe: [1:7556554964777820499:3893]
2025-10-02T09:32:36.173587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.179796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.179814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.179936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.179986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.180036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.180087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.180128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.180134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.180188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.180245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.180299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.180350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.180384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.180389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.180439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.180492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.180542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.180591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.180627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.180632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.180681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.180742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.180792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.180856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.180895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.180900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.180953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.181005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.181054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.181105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.181141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.181145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.181196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.181250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.181302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.181352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.181387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.181392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.181440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.181491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.181548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.181599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.181632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.181638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.181688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.181740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.181790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.181836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.181876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.181882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.181928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.181976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.182029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.182078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.182113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.182118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.182166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:36.182217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:36.182267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:36.182314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:36.182362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:36.182367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:36.182395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820499:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.182563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.182575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.182594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1596 reason: error at write: Disconnected sessionId: src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0
2025-10-02T09:32:36.182729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1596 sessionId: src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0 is DEAD
2025-10-02T09:32:36.182885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.182903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Write session will restart in 0.009307s
2025-10-02T09:32:36.182880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.182891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777820499:3893]
2025-10-02T09:32:36.182926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Write session: Do CDS request
2025-10-02T09:32:36.182932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.183081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.191554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.192332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.192448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.192454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.192460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.192494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.192521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702276247:9583]
2025-10-02T09:32:36.192891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.193071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.193095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.193152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.193209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.193217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1597
2025-10-02T09:32:36.193286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.193318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.193322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.193323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.193323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.193324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.193324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.193325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.193325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.193326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.193326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.193327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.193327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.193330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.193337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.193339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.193341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.193343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.193345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.193347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.193348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.193350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.193352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.193354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.193356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.193360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.193363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.193371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.193367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.193370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.193372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.193374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.193378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.193380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.193383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.193386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.193389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.193387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.193394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.193390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.193397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.193392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.193395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.193397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.193399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.193402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.193404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.193406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.193409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.193411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.193413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.193415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.193418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.193435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.193660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1597 sessionId:  describe result for acl check
2025-10-02T09:32:36.193683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.193687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.193688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.193692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777820748:3178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.194026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777820748:3178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.195354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777820748:3178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.200156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777820748:3178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.200164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777820748:3178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.200166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777820748:3178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.200169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.200894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.202266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.202278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.202279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.202281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.202285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1596 [2:7556554964702276247:9583]
2025-10-02T09:32:36.202291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.202302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.202306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.202308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.202310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.202319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.202326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.202331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.202365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.202370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.202371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.202373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.202374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.202410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.202414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.202420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.202428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.202439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.202455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820780:3178], now have 1 active actors on pipe
2025-10-02T09:32:36.202462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820526:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.202466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.202472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.202473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.202483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.202494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.202494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.202496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.202496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1596
2025-10-02T09:32:36.202497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.202503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.202505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.202497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1596
2025-10-02T09:32:36.202519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.202524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.202526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.202535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.202540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.202563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.202570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.202572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.202573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.202578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.202587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.202598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.202699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.202707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.202721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.202787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1597 partition: 0 MaxSeqNo: 36 sessionId: src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0
2025-10-02T09:32:36.203001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb37e6-3f621986-709d3acf-e5a2ce79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.205729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Write session: try to update token
2025-10-02T09:32:36.205745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.211979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.211993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.211994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.211995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.211999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.212001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.212003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702276242:9583]
2025-10-02T09:32:36.212023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.212026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.212028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.212034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.212037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.212041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.212144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.218751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId: src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.221210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:36.282905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554964777820790:3893]
2025-10-02T09:32:36.283070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1596, pipe: [1:7556554964777820790:3893]
2025-10-02T09:32:36.325796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.326215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.326226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.326251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820790:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.326401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.326429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.326437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.326438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.326475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777820790:3893]
2025-10-02T09:32:36.326484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1597 reason: error at write: Disconnected sessionId: src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0
2025-10-02T09:32:36.326622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1597 sessionId: src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0 is DEAD
2025-10-02T09:32:36.326773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.326787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Write session will restart in 0.007854s
2025-10-02T09:32:36.326813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Write session: Do CDS request
2025-10-02T09:32:36.326819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.334411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.335233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.335343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.335350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.335356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.335383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.335409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702276429:9586]
2025-10-02T09:32:36.335759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.335945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.335973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.336168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.336190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.336201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.336205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.336205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.336206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.336206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.336207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.336208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.336208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.336209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.336209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.336210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.336210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.336213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.336220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.336222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.336224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.336226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.336228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.336230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.336231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.336233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.336235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.336237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.336239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.336243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.336247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.336251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.336253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.336255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.336258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.336261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.336264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.336266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.336269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.336272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.336274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.336276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.336279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.336281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.336284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.336287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.336293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.336295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.336298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.336281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.336300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.336289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1598
2025-10-02T09:32:36.336303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.336305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.336307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.336323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.336400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.336419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.336424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.336427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.336740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1598 sessionId:  describe result for acl check
2025-10-02T09:32:36.336763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.336768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.336770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.336773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777821013:3172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.337252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777821013:3172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.338622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777821013:3172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.342653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777821013:3172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.342661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777821013:3172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.342664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777821013:3172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.342667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.343881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.345241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.345254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.345255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.345257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.345260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1597 [2:7556554964702276429:9586]
2025-10-02T09:32:36.345267Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.345276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.345277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.345279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.345280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.345288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.345291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.345295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.345333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.345340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.345342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.345343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.345344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.345382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.345386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.345392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.345398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.345409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.345419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821049:3172], now have 1 active actors on pipe
2025-10-02T09:32:36.345424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777820791:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.345428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.345429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.345431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.345438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.345445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.345441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1597
2025-10-02T09:32:36.345448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.345445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1597
2025-10-02T09:32:36.345452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.345452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.345453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.345454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.345466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.345468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.345469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.345478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.345480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.345500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|426bc832-10e5a8d0-361addd-3003f7b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.345507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.345509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.345511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.345516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.345521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.345530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.345621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.345627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.345635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.345687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1598 partition: 0 MaxSeqNo: 36 sessionId: src_id|426bc832-10e5a8d0-361addd-3003f7b6_0
2025-10-02T09:32:36.345925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7455370c-f5db975e-3609e0c9-1e4d8add_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|426bc832-10e5a8d0-361addd-3003f7b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.348635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Write session: try to update token
2025-10-02T09:32:36.348649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.354987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.354998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.354999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.355000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.355003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.355007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.355009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702276423:9586]
2025-10-02T09:32:36.355027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.355030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.355030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.355032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.355032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.355034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.355148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.361482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId: src_id|426bc832-10e5a8d0-361addd-3003f7b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.363825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:36.426791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554964777821056:3893]
2025-10-02T09:32:36.426968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1597, pipe: [1:7556554964777821056:3893]
2025-10-02T09:32:36.465599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.465814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.465823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.465848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821056:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.465991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.466028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.466036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.466049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777821056:3893]
2025-10-02T09:32:36.466063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.466084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1598 reason: error at write: Disconnected sessionId: src_id|426bc832-10e5a8d0-361addd-3003f7b6_0
2025-10-02T09:32:36.466222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1598 sessionId: src_id|426bc832-10e5a8d0-361addd-3003f7b6_0 is DEAD
2025-10-02T09:32:36.466391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.466405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Write session will restart in 0.009539s
2025-10-02T09:32:36.466427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Write session: Do CDS request
2025-10-02T09:32:36.466432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.473889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.474755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.474861Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.474868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.474874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.474899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.474922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702276612:9588]
2025-10-02T09:32:36.475270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.475463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.475486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.475664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.475693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.475696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.475697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.475698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.475698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.475699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.475699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.475700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.475700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.475701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.475701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.475702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.475705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.475712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.475714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.475716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.475718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.475720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.475722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.475723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.475725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.475727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.475729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.475731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.475736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.475740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.475743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.475746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.475748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.475751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.475753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.475755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.475757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.475760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.475762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.475765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.475767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.475770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.475772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.475774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.475776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.475779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.475782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.475785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.475787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.475789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.475792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.475795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.475812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.477124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.477218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.477228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1599
2025-10-02T09:32:36.477350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.477375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.477382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.477385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.477732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1599 sessionId:  describe result for acl check
2025-10-02T09:32:36.477755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.477760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.477761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.477764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777821281:3167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.478134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777821281:3167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.479410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777821281:3167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.482945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777821281:3167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.482952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777821281:3167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.482954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777821281:3167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.482958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.483491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.484939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.484950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.484952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.484954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.484957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1598 [2:7556554964702276612:9588]
2025-10-02T09:32:36.484965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.484975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.484976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.484978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.484980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.484988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.484991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.484995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.485026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.485032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.485033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.485035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.485037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.485114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.485119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.485126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.485131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.485139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.485144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1598
2025-10-02T09:32:36.485145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1598
2025-10-02T09:32:36.485154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821315:3167], now have 1 active actors on pipe
2025-10-02T09:32:36.485160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821057:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.485163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.485165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.485166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.485172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.485179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.485180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.485182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.485183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.485190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.485192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.485206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.485211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.485230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.485237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.485246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.485253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.485253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.485255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.485256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.485261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.485267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.485367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.485457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.485462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.485470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.485530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1599 partition: 0 MaxSeqNo: 36 sessionId: src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0
2025-10-02T09:32:36.485729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426bc832-10e5a8d0-361addd-3003f7b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.488378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Write session: try to update token
2025-10-02T09:32:36.488391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.494818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.494827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.494828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.494829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.494833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.494835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.494838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702276606:9588]
2025-10-02T09:32:36.494858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.494858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.494860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.494861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.494862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.494863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.494993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.501283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId: src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.503659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:36.566050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554964777821326:3893]
2025-10-02T09:32:36.566234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1598, pipe: [1:7556554964777821326:3893]
2025-10-02T09:32:36.607361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.607565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.607574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.607599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821326:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.607734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.607797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.607806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.607808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.607837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777821326:3893]
2025-10-02T09:32:36.607853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1599 reason: error at write: Disconnected sessionId: src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0
2025-10-02T09:32:36.607989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1599 sessionId: src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0 is DEAD
2025-10-02T09:32:36.608130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.608144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Write session will restart in 0.008641s
2025-10-02T09:32:36.608166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Write session: Do CDS request
2025-10-02T09:32:36.608172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.615725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.616626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.616729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.616735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.616741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.616766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.616788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702276794:9590]
2025-10-02T09:32:36.617188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.617350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.617373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.617549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.617580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.617584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.617584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.617585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.617585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.617586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.617586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.617587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.617587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.617588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.617589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.617589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.617592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.617599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.617601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.617603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.617605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.617607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.617609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.617611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.617613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.617615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.617617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.617619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.617623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.617627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.617630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.617632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.617635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.617637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.617639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.617642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.617644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.617647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.617649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.617652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.617654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.617658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.617660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.617662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.617665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.617667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.617670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.617672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.617675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.617678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.617679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.617682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.617700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.618146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.618284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.618292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1600
2025-10-02T09:32:36.618412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.618432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.618438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.618442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.618710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1600 sessionId:  describe result for acl check
2025-10-02T09:32:36.618740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.618766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.618771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.618774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777821552:3157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.619105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777821552:3157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.620709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777821552:3157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.624607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777821552:3157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.624616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777821552:3157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.624617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777821552:3157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.624621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.625166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.626536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.626547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.626548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.626550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.626553Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1599 [2:7556554964702276794:9590]
2025-10-02T09:32:36.626560Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.626570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.626571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.626572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.626574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.626583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.626591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.626595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.626630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.626634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.626636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.626637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.626639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.626674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.626678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.626685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.626690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.626701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.626715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821587:3157], now have 1 active actors on pipe
2025-10-02T09:32:36.626719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821327:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.626723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.626724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.626725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.626733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.626742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.626743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.626748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.626740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1599
2025-10-02T09:32:36.626749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.626748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1599
2025-10-02T09:32:36.626750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.626752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.626777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.626782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.626784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.626794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.626799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.626824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2db22786-47d58320-5a51000c-f9418601_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.626831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.626833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.626834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.626839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.626847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.626859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.626945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.626950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.626957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.627015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1600 partition: 0 MaxSeqNo: 36 sessionId: src_id|2db22786-47d58320-5a51000c-f9418601_0
2025-10-02T09:32:36.627272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dafd3ad-6e318da3-6afbafcb-126c984c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2db22786-47d58320-5a51000c-f9418601_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.629975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Write session: try to update token
2025-10-02T09:32:36.629989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.636233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.636244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.636245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.636246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.636249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.636252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.636254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702276789:9590]
2025-10-02T09:32:36.636273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.636276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.636277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.636278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.636281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.636283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.636392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.642624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId: src_id|2db22786-47d58320-5a51000c-f9418601_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.645043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:36.707867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554964777821595:3893]
2025-10-02T09:32:36.708033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1599, pipe: [1:7556554964777821595:3893]
2025-10-02T09:32:36.747188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.747595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.747603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.747629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821595:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.747761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.747788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.747796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.747822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777821595:3893]
2025-10-02T09:32:36.747843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.747844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1600 reason: error at write: Disconnected sessionId: src_id|2db22786-47d58320-5a51000c-f9418601_0
2025-10-02T09:32:36.747979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1600 sessionId: src_id|2db22786-47d58320-5a51000c-f9418601_0 is DEAD
2025-10-02T09:32:36.748147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.748158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Write session will restart in 0.008275s
2025-10-02T09:32:36.748182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Write session: Do CDS request
2025-10-02T09:32:36.748189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.756032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.756886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.756987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.756993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.756999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.757025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.757049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702276977:9592]
2025-10-02T09:32:36.757273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.757301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.757309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1601
2025-10-02T09:32:36.757392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.757490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.757509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.757515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.757517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.757570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.757591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.757770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1601 sessionId:  describe result for acl check
2025-10-02T09:32:36.757792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.757796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.757803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.757797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.757800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777821820:3151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.757835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.757839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.757839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.757840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.757840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.757841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.757841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.757842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.757842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.757843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.757843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.757844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.757847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.757854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.757856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.757858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.757860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.757862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.757864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.757866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.757868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.757870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.757872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.757874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.757878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.757882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.757885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.757888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.757890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.757893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.757895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.757899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.757901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.757907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.757909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.757912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.757914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.757917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.757919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.757921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.757923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.757926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.757928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.757930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.757933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.757938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.757940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.757943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.757961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.758159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777821820:3151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.759554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777821820:3151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.763285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777821820:3151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.763293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777821820:3151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.763294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777821820:3151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.763298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.765604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.767086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.767097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.767098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.767100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.767104Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1600 [2:7556554964702276977:9592]
2025-10-02T09:32:36.767109Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.767117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.767122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.767124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.767125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.767133Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.767137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.767142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.767174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.767178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.767180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.767181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.767183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.767216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.767220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.767226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.767235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.767246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.767259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821856:3151], now have 1 active actors on pipe
2025-10-02T09:32:36.767265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821596:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.767269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.767271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.767272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.767280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.767284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1600
2025-10-02T09:32:36.767290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.767291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1600
2025-10-02T09:32:36.767296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.767298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.767299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.767300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.767302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.767315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.767320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.767321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.767330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.767335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.767363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.767370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.767372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.767373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.767379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.767385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.767397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.767477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.767481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.767489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.767546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1601 partition: 0 MaxSeqNo: 36 sessionId: src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0
2025-10-02T09:32:36.767814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db22786-47d58320-5a51000c-f9418601_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.770462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Write session: try to update token
2025-10-02T09:32:36.770474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.776944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.776954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.776955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.776956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.776959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.776961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.776962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702276972:9592]
2025-10-02T09:32:36.776982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.776985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.776988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.776989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.776990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.776992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.777104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.782748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId: src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.785090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:36.848142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554964777821870:3893]
2025-10-02T09:32:36.848291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1600, pipe: [1:7556554964777821870:3893]
2025-10-02T09:32:36.886709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:36.886997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.887006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.887018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821870:3893], now have 1 active actors on pipe
2025-10-02T09:32:36.887127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:36.887121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777821870:3893]
2025-10-02T09:32:36.887139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:36.887145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:36.887147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:36.887155Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:32:36.887185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1601 reason: error at write: Disconnected sessionId: src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0
2025-10-02T09:32:36.887233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1601 sessionId: src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0 is DEAD
2025-10-02T09:32:36.887307Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 16 consumer shared/user session shared/user_1_16_1128256471930200876_v1 is DEAD
2025-10-02T09:32:36.887377Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554904648260964:3898] disconnected; active server actors: 1
2025-10-02T09:32:36.887385Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554904648260964:3898] client user disconnected session shared/user_1_16_1128256471930200876_v1
2025-10-02T09:32:36.887414Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:32:36.887466Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:36.887468Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:36.887477Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008547s
2025-10-02T09:32:36.887591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:36.887605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Write session will restart in 0.006421s
2025-10-02T09:32:36.887625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Write session: Do CDS request
2025-10-02T09:32:36.887631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:36.895146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.895253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:36.895269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1602
2025-10-02T09:32:36.895363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:36.895387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:36.895394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:36.895397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:36.895409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:36.895741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1602 sessionId:  describe result for acl check
2025-10-02T09:32:36.895767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:36.895772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:36.895773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:36.895778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554964777822109:3134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:36.896181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554964777822109:3134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:36.896289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:36.896393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:36.896399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:36.896405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:36.896431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:36.896456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554964702277173:9595]
2025-10-02T09:32:36.896792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:36.896987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:36.897014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:36.897031Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:32:36.897183Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:32:36.897189Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 17
2025-10-02T09:32:36.897212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:36.897244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.897248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.897248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.897249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.897249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.897250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.897251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.897251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.897251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.897252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.897253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.897253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.897256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.897262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.897264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.897267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.897269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.897271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.897272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.897274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.897276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.897278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.897280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.897282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.897286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.897291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:36.897295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.897297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:36.897299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.897302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:36.897304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.897307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:36.897310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.897299Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 17 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:36.897312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:36.897316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.897319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:36.897321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.897324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:36.897326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.897328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:36.897331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.897334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:36.897329Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:36.897336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.897338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.897341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.897343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.897345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.897348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.897365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:36.897383Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 auth for : user
2025-10-02T09:32:36.897461Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 Handle describe topics response
2025-10-02T09:32:36.897478Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 auth is DEAD
2025-10-02T09:32:36.897486Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:32:36.897647Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:32:36.897699Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554964777822135:3128] connected; active server actors: 1
2025-10-02T09:32:36.897708Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556554964777822135:3128] session shared/user_1_17_3895905754289346605_v1
2025-10-02T09:32:36.897712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:32:36.897717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:32:36.897721Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_17_3895905754289346605_v1" (Sender=[1:7556554964777822128:3128], Pipe=[1:7556554964777822135:3128], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:36.897724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:32:36.897729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:32:36.897734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_17_3895905754289346605_v1" (Sender=[1:7556554964777822128:3128], Pipe=[1:7556554964777822135:3128], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:36.897739Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_17_3895905754289346605_v1" sender [1:7556554964777822128:3128] lock partition 0 for ReadingSession "shared/user_1_17_3895905754289346605_v1" (Sender=[1:7556554964777822128:3128], Pipe=[1:7556554964777822135:3128], Partitions=[], ActiveFamilyCount=1) generation 1 step 17
2025-10-02T09:32:36.897749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:32:36.897752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000020s
2025-10-02T09:32:36.897761Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_17_3895905754289346605_v1
2025-10-02T09:32:36.897815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554964777822109:3134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:36.898006Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 17 Session: "shared/user_1_17_3895905754289346605_v1" ClientId: "user" PipeClient { RawX1: 7556554964777822135 RawX2: 4503603922340920 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:32:36.898023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:32:36.902150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554964777822109:3134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:36.902160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554964777822109:3134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:36.902162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554964777822109:3134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:36.902167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:36.904864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:36.906275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:36.906284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:36.906285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:36.906288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:36.906291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1601 [2:7556554964702277173:9595]
2025-10-02T09:32:36.906298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:36.906307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:36.906308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.906310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.906311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.906319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:36.906324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:36.906328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:36.906398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.906404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.906405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.906406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:36.906408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:36.906446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:36.906451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.906457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:36.906462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:36.906471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:36.906485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777821883:2446], now have 1 active actors on pipe
2025-10-02T09:32:36.906490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777822140:3127], now have 1 active actors on pipe
2025-10-02T09:32:36.906492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554964777822154:3134], now have 1 active actors on pipe
2025-10-02T09:32:36.906496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.906497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.906498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.906504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:36.906514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:36.906515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:36.906518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:36.906519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:36.906525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:36.906526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:36.906539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.906544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:36.906546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:36.906525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1601, pipe: [1:7556554964777822140:3127]
2025-10-02T09:32:36.906525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1601
2025-10-02T09:32:36.906550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1601
2025-10-02T09:32:36.906557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.906562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.906568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_17_3895905754289346605_v1 on pipe: [1:7556554964777822140:3127]
2025-10-02T09:32:36.906589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.906593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.906599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.906602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.906603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.906603Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_17_3895905754289346605_v1:1 with generation 1601
2025-10-02T09:32:36.906611Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_17_3895905754289346605_v1
2025-10-02T09:32:36.906616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.906633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:36.906639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:32:36.906641Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:32:36.908405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:32:36.908418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:32:36.908421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:36.908424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:36.908425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:36.908429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:36.908435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:36.908438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:32:36.908443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:32:36.908453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.908531Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397556905 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:32:36.908544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:32:36.908560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:36.908565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:36.908572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:36.908566Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 sending to client partition status
2025-10-02T09:32:36.908627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1602 partition: 0 MaxSeqNo: 36 sessionId: src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0
2025-10-02T09:32:36.908897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eccd3b1c-60279644-70ae52d4-da4474d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:36.911611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Write session: try to update token
2025-10-02T09:32:36.911623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:36.916764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:36.916774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:36.916775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:36.916776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:36.916780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.916782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.916784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554964702277168:9595]
2025-10-02T09:32:36.916815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:36.916817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:36.916818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:36.916819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:36.916820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:36.916822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:36.916929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:36.924525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId: src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:36.926805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.027446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.027650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.027659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.027802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_17_3895905754289346605_v1
2025-10-02T09:32:37.027814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.027833Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_17_3895905754289346605_v1
2025-10-02T09:32:37.027839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.027866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:37.027871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:37.027881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554964777822140:3127]
2025-10-02T09:32:37.027942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1602 reason: error at write: Disconnected sessionId: src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0
2025-10-02T09:32:37.028110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1602 sessionId: src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0 is DEAD
2025-10-02T09:32:37.028267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:37.028281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Write session will restart in 0.007947s
2025-10-02T09:32:37.028302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Write session: Do CDS request
2025-10-02T09:32:37.028307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.036394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.037167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.037251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.037264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1603
2025-10-02T09:32:37.037342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.037356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.037381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.037389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.037393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.037442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.037448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.037454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.037479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.037501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997244658:9598]
2025-10-02T09:32:37.037711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1603 sessionId:  describe result for acl check
2025-10-02T09:32:37.037738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.037742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.037743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.037746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072789684:3125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.037908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.038069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.038091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.038098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072789684:3125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.038277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.038305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.038310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.038310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.038311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.038311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.038312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.038312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.038313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.038313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.038314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.038314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.038315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.038318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.038324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.038326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.038329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.038331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.038333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.038335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.038337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.038338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.038341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.038343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.038345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.038348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.038352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.038355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.038358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.038360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.038363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.038365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.038367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.038370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.038372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.038374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.038377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.038379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.038382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.038384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.038387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.038389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.038392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.038394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.038397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.038399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.038402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.038404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.038406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.038421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.039658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072789684:3125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.043719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072789684:3125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.043729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072789684:3125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.043731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072789684:3125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.043744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.046020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.047409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.047419Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.047421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.047423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.047427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1602 [2:7556554968997244658:9598]
2025-10-02T09:32:37.047435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.047445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.047447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.047448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.047449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.047459Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.047463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.047467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.047502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.047507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.047508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.047510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.047511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.047550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.047555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.047561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.047567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.047578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.047592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072789723:3125], now have 1 active actors on pipe
2025-10-02T09:32:37.047597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072789460:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.047600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.047602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.047603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.047611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.047621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.047627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.047630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.047631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.047632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.047633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.047634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1602
2025-10-02T09:32:37.047649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.047654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.047652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1602
2025-10-02T09:32:37.047658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.047763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.047769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.047789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.047795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.047798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.047799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.047804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.047814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.047824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.047948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.047952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.047961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.048028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1603 partition: 0 MaxSeqNo: 36 sessionId: src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0
2025-10-02T09:32:37.048247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25d63e4d-fc2afa03-523494e5-ae97f06d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.050980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Write session: try to update token
2025-10-02T09:32:37.050992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.056815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.056823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.056824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.056825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.056829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.056832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.056834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997244653:9598]
2025-10-02T09:32:37.056853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.056853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.056856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.056856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.056857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.056858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.057010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.063446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId: src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.065767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.128265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072789730:3127]
2025-10-02T09:32:37.128482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1602, pipe: [1:7556554969072789730:3127]
2025-10-02T09:32:37.166240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.166449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.166458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.166471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072789730:3127], now have 1 active actors on pipe
2025-10-02T09:32:37.166593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.166682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072789730:3127]
2025-10-02T09:32:37.166691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:37.166713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.166749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1603 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0
2025-10-02T09:32:37.166890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1603 sessionId: src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0 is DEAD
2025-10-02T09:32:37.167035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:37.167051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Write session will restart in 0.007187s
2025-10-02T09:32:37.167072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Write session: Do CDS request
2025-10-02T09:32:37.167078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.175162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.175272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.175283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1604
2025-10-02T09:32:37.175373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.175397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.175406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.175409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.175484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.175702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1604 sessionId:  describe result for acl check
2025-10-02T09:32:37.175732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.175738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.175740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.175744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072789961:3114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.176165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072789961:3114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.176463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.176562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.176568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.176573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.176598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.176621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997244847:9600]
2025-10-02T09:32:37.176973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.177123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.177145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.177316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.177345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.177349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.177350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.177350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.177351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.177351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.177352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.177353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.177353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.177354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.177355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.177355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.177358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.177364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.177366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.177368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.177370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.177372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.177374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.177376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.177378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.177380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.177382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.177384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.177387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.177391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.177395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.177398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.177401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.177404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.177406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.177408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.177410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.177413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.177415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.177418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.177420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.177422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.177424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.177427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.177429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.177431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.177437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.177439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.177442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.177444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.177446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.177452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.177469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.177771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072789961:3114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.182199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072789961:3114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.182207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072789961:3114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.182209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072789961:3114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.182213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.184918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.186413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.186424Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.186425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.186427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.186431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1603 [2:7556554968997244847:9600]
2025-10-02T09:32:37.186437Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.186446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.186448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.186450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.186451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.186460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.186466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.186470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.186499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.186504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.186506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.186508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.186509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.186545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.186549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.186555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.186561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.186572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.186586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790008:3114], now have 1 active actors on pipe
2025-10-02T09:32:37.186591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072789731:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.186595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.186596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.186598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.186604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.186611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.186622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.186626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.186619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1603
2025-10-02T09:32:37.186637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1603
2025-10-02T09:32:37.186640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.186644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.186662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.186666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.186680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.186683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.186687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.186688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.186689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.186690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.186690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.186694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.186695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.186699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.186707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.186809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.186814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.186821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.186872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1604 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0
2025-10-02T09:32:37.187117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5463b698-7b292eff-a85b83c4-48fb1d3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.189768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Write session: try to update token
2025-10-02T09:32:37.189782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.195882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.195893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.195895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.195895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.195899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.195901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.195903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997244842:9600]
2025-10-02T09:32:37.195923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.195928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.195929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.195930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.195931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.195933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.196041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.202873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId: src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.205051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.266977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072790027:3127]
2025-10-02T09:32:37.267141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1603, pipe: [1:7556554969072790027:3127]
2025-10-02T09:32:37.306667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.307029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.307039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.307050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790027:3127], now have 1 active actors on pipe
2025-10-02T09:32:37.307175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.307212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.307233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072790027:3127]
2025-10-02T09:32:37.307247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:37.307300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1604 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0
2025-10-02T09:32:37.307444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1604 sessionId: src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0 is DEAD
2025-10-02T09:32:37.307584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:37.307595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Write session will restart in 0.009433s
2025-10-02T09:32:37.307615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Write session: Do CDS request
2025-10-02T09:32:37.307620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.315478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.316513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.316618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.316625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.316631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.316659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.316682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997245067:9615]
2025-10-02T09:32:37.317096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.317272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.317297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.317478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.317508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.317512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.317512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.317513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.317513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.317514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.317514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.317515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.317515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.317516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.317517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.317517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.317520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.317527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.317529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.317531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.317533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.317535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.317537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.317539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.317541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.317543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.317545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.317547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.317552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.317555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.317559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.317562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.317563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.317566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.317568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.317571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.317573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.317576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.317578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.317580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.317582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.317585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.317591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.317594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.317596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.317599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.317604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.317607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.317609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.317611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.317616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.317619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.317637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.318115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.318212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.318222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1605
2025-10-02T09:32:37.318339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.318358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.318361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.318364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.318644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1605 sessionId:  describe result for acl check
2025-10-02T09:32:37.318667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.318671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.318673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.318676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072790258:3103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.319082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072790258:3103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.320698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072790258:3103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.324477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072790258:3103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.324485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072790258:3103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.324486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072790258:3103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.324490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.325008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.326473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.326485Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.326486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.326488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.326491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1604 [2:7556554968997245067:9615]
2025-10-02T09:32:37.326498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.326508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.326512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.326514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.326515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.326524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.326527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.326531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.326564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.326568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.326569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.326571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.326572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.326607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.326612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.326618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.326627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.326637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.326652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790028:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.326657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790293:3103], now have 1 active actors on pipe
2025-10-02T09:32:37.326660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.326662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.326664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.326671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.326679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.326682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.326685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.326686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.326689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.326690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.326695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1604
2025-10-02T09:32:37.326703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.326697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1604
2025-10-02T09:32:37.326708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.326712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.326726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.326731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.326747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.326755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.326768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.326772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.326777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.326782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.326792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.326882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.326887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.326894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.326945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1605 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0
2025-10-02T09:32:37.327163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eb1238-2684c1cc-44413a10-5662bf19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.329819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Write session: try to update token
2025-10-02T09:32:37.329833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.335897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.335907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.335908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.335909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.335913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.335916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.335919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997245062:9615]
2025-10-02T09:32:37.335937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.335938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.335939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.335940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.335941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.335941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.336128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.343108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId: src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.345202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.407261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072790301:3127]
2025-10-02T09:32:37.407444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1604, pipe: [1:7556554969072790301:3127]
2025-10-02T09:32:37.444846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.445093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.445103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.445115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790301:3127], now have 1 active actors on pipe
2025-10-02T09:32:37.445223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.445243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072790301:3127]
2025-10-02T09:32:37.445254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:37.445257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.445256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:37.445295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1605 reason: error at write: Disconnected sessionId: src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0
2025-10-02T09:32:37.445447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1605 sessionId: src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0 is DEAD
2025-10-02T09:32:37.445662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:37.445677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Write session will restart in 0.006019s
2025-10-02T09:32:37.445704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Write session: Do CDS request
2025-10-02T09:32:37.445709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.453213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.453313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.453322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1606
2025-10-02T09:32:37.453451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.453471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.453476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.453479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.453576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.453769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1606 sessionId:  describe result for acl check
2025-10-02T09:32:37.453795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.453801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.453802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.453806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072790529:3089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.454151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072790529:3089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.454536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.454649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.454656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.454662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.454689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.454711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997245254:9617]
2025-10-02T09:32:37.455059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.455206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.455230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.455404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.455432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.455436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.455437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.455437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.455438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.455438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.455439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.455439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.455440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.455440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.455441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.455442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.455445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.455450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.455453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.455455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.455457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.455459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.455461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.455463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.455465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.455467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.455469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.455471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.455474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.455478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.455481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.455483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.455485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.455488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.455490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.455493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.455495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.455498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.455500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.455503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.455505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.455508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.455511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.455514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.455516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.455519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.455521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.455523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.455526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.455532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.455534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.455537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.455554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.455739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072790529:3089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.460415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072790529:3089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.460423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072790529:3089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.460428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072790529:3089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.460431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.463118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.464645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.464656Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.464657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.464660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.464663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1605 [2:7556554968997245254:9617]
2025-10-02T09:32:37.464670Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.464679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.464683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.464684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.464686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.464695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.464702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.464708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.464739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.464744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.464745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.464746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.464748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.464783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.464788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.464795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.464816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.464835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.464852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790568:3089], now have 1 active actors on pipe
2025-10-02T09:32:37.464857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790302:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.464861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.464862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.464863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.464873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.464884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.464886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.464888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.464889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.464894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.464896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.464888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1605
2025-10-02T09:32:37.464901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1605
2025-10-02T09:32:37.464911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.464916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.464917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.464926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.464931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.464960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.464967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.464969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.464970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.464975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.464984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.464997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.465092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.465097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.465106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.465169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1606 partition: 0 MaxSeqNo: 36 sessionId: src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0
2025-10-02T09:32:37.465437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebf6a9c-b3b3dcf8-e4433252-e82c192c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.468115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Write session: try to update token
2025-10-02T09:32:37.468128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.474614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.474626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.474627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.474628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.474632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.474634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.474636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997245249:9617]
2025-10-02T09:32:37.474657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.474659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.474660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.474661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.474662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.474664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.474789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.479930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId: src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.481866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.545516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072790576:3127]
2025-10-02T09:32:37.545639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1605, pipe: [1:7556554969072790576:3127]
2025-10-02T09:32:37.585077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.585329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.585338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.585363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790576:3127], now have 1 active actors on pipe
2025-10-02T09:32:37.585514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.585526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072790576:3127]
2025-10-02T09:32:37.585534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:37.585536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:37.585546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.585583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1606 reason: error at write: Disconnected sessionId: src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0
2025-10-02T09:32:37.585710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1606 sessionId: src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0 is DEAD
2025-10-02T09:32:37.585885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:37.585899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Write session will restart in 0.008475s
2025-10-02T09:32:37.585921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Write session: Do CDS request
2025-10-02T09:32:37.585926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.593684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.594552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.594650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.594657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.594662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.594686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.594710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997245443:9619]
2025-10-02T09:32:37.595111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.595149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.595248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.595256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1607
2025-10-02T09:32:37.595272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.595295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.595353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.595372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.595377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.595380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.595470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.595499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.595503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.595504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.595504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.595505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.595506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.595506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.595507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.595507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.595508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.595509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.595509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.595512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.595519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.595521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.595523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.595525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.595527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.595529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.595530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.595532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.595535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.595536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.595538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.595542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.595546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.595549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.595552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.595554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.595557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.595559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.595561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.595564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.595566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.595568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.595571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.595573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.595577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.595582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.595585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.595587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.595590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.595592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.595594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.595601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.595603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.595606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.595608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.595625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.595643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1607 sessionId:  describe result for acl check
2025-10-02T09:32:37.595664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.595668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.595669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.595671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072790806:3085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.596033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072790806:3085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.597538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072790806:3085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.601819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072790806:3085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.601826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072790806:3085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.601828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072790806:3085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.601832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.603093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.604608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.604620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.604621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.604623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.604627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1606 [2:7556554968997245443:9619]
2025-10-02T09:32:37.604635Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.604644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.604645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.604647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.604648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.604658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.604660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.604664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.604698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.604703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.604705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.604707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.604708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.604744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.604748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.604755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.604761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.604769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.604783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790843:3085], now have 1 active actors on pipe
2025-10-02T09:32:37.604788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790577:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.604791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.604792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.604793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.604815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.604818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.604820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.604821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.604825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.604834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.604838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.604853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.604857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.604859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.604843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1606
2025-10-02T09:32:37.604864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1606
2025-10-02T09:32:37.604867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.604872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.604896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.604903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.604905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.604906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.604912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.604920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.604934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.605042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.605047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.605054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.605111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1607 partition: 0 MaxSeqNo: 36 sessionId: src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0
2025-10-02T09:32:37.605348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725a2411-f250c145-7169cdb0-4e5d60fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.607982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Write session: try to update token
2025-10-02T09:32:37.607998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.614300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.614312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.614313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.614314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.614318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.614320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.614322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997245437:9619]
2025-10-02T09:32:37.614340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.614343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.614344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.614346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.614348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.614350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.614458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.620046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId: src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.621955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.685784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072790851:3127]
2025-10-02T09:32:37.686166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1606, pipe: [1:7556554969072790851:3127]
2025-10-02T09:32:37.726988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.727280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.727288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.727300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790851:3127], now have 1 active actors on pipe
2025-10-02T09:32:37.727440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.727474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:37.727484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:37.727496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072790851:3127]
2025-10-02T09:32:37.727511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.727529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1607 reason: error at write: Disconnected sessionId: src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0
2025-10-02T09:32:37.727658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1607 sessionId: src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0 is DEAD
2025-10-02T09:32:37.727809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:37.727823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Write session will restart in 0.007828s
2025-10-02T09:32:37.727844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Write session: Do CDS request
2025-10-02T09:32:37.727850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.735838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.736884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.736985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.736992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.736997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.737024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.737050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997245632:9621]
2025-10-02T09:32:37.737204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.737387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.737378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.737386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1608
2025-10-02T09:32:37.737509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.737528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.737534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.737536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.737556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.737579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.737754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.737783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.737787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.737787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.737788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.737788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.737789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.737790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.737790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.737791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.737791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.737792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.737803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1608 sessionId:  describe result for acl check
2025-10-02T09:32:37.737792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.737795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.737802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.737828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.737804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.737829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.737830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.737806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.737834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072791083:3082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.737808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.737810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.737812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.737814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.737816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.737818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.737820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.737822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.737826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.737831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.737834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.737837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.737839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.737842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.737844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.737847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.737849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.737852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.737854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.737856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.737859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.737861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.737863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.737866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.737869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.737871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.737876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.737878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.737882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.737884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.737904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.738178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072791083:3082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.739367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072791083:3082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.743163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072791083:3082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.743171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072791083:3082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.743173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072791083:3082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.743177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.745395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.747052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.747061Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.747062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.747064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.747067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1607 [2:7556554968997245632:9621]
2025-10-02T09:32:37.747073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.747083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.747084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.747086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.747087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.747095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.747097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.747102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.747134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.747138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.747139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.747141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.747142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.747176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.747181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.747187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.747193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.747204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.747218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072791120:3082], now have 1 active actors on pipe
2025-10-02T09:32:37.747223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072790852:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.747227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.747229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.747230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.747239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.747247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.747235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1607
2025-10-02T09:32:37.747254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.747245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1607
2025-10-02T09:32:37.747256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.747257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.747257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.747259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.747281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.747286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.747296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.747303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.747315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.747323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.747327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.747329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.747333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.747338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.747346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.747361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.747441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.747446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.747454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.747508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1608 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0
2025-10-02T09:32:37.747750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b75f0ad1-9b9ad89c-c8833cb9-247eec07_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.750407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Write session: try to update token
2025-10-02T09:32:37.750421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.757172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.757182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.757184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.757186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.757191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.757194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.757197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997245627:9621]
2025-10-02T09:32:37.757221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.757224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.757225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.757226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.757227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.757228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.757349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.762578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId: src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.764482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.827627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072791130:3127]
2025-10-02T09:32:37.827804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1607, pipe: [1:7556554969072791130:3127]
2025-10-02T09:32:37.869296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:37.869542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.869551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.869577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072791130:3127], now have 1 active actors on pipe
2025-10-02T09:32:37.869735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:37.869714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072791130:3127]
2025-10-02T09:32:37.869725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:37.869735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:37.869737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:37.869781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1608 reason: error at write: Disconnected sessionId: src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0
2025-10-02T09:32:37.869926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1608 sessionId: src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0 is DEAD
2025-10-02T09:32:37.870036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:37.870044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Write session will restart in 0.005565s
2025-10-02T09:32:37.870073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Write session: Do CDS request
2025-10-02T09:32:37.870077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:37.876304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.876393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:37.876403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1609
2025-10-02T09:32:37.876509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:37.876535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:37.876542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:37.876545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:37.876882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1609 sessionId:  describe result for acl check
2025-10-02T09:32:37.876907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:37.876909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:37.876911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:37.876914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554969072791312:3077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:37.877316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554969072791312:3077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:37.878677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554969072791312:3077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:37.878780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:37.879652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:37.879775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:37.879790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:37.879797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:37.879825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:37.879848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554968997245834:9624]
2025-10-02T09:32:37.880206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:37.880371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:37.880396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:37.880573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:37.880601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.880605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.880605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.880606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.880606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.880607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.880607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.880608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.880608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.880609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.880609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.880610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.880613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.880619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.880621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.880623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.880625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.880627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.880629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.880631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.880633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.880635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.880637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.880638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.880642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.880646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:37.880649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.880652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:37.880654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.880657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:37.880659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.880662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:37.880664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.880667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:37.880669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.880671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:37.880665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554969072791312:3077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:37.880674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.880672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554969072791312:3077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:37.880676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:37.880674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554969072791312:3077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:37.880678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.880678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:37.880680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:37.880683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.880686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:37.880688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.880690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.880692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.880695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.880697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.880699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.880715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:37.888129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:37.889646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:37.889657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:37.889658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:37.889660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:37.889663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1608 [2:7556554968997245834:9624]
2025-10-02T09:32:37.889669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:37.889679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:37.889680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.889682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.889683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.889692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:37.889695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:37.889700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:37.889731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.889736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.889737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.889739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:37.889740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:37.889778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:37.889782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.889788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:37.889793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:37.889801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:37.889815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072791136:2446], now have 1 active actors on pipe
2025-10-02T09:32:37.889822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072791401:3077], now have 1 active actors on pipe
2025-10-02T09:32:37.889825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.889826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.889827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.889835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:37.889845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:37.889847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:37.889849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:37.889850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:37.889855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:37.889856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:37.889870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.889875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:37.889883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:37.889867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1608
2025-10-02T09:32:37.889878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1608
2025-10-02T09:32:37.889920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.889926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.889943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:37.889950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:37.889952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:37.889953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:37.889958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:37.889966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:37.889976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.890067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:37.890072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:37.890079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:37.890130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1609 partition: 0 MaxSeqNo: 36 sessionId: src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0
2025-10-02T09:32:37.890398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a31ef77-faeb81e6-a2d4560a-e930a5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:37.893145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Write session: try to update token
2025-10-02T09:32:37.893161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:37.899198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:37.899211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:37.899212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:37.899213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:37.899217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.899220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.899222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554968997245829:9624]
2025-10-02T09:32:37.899243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:37.899246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:37.899247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:37.899249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:37.899252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:37.899254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:37.899356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:37.906282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId: src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:37.908364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:37.969948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554969072791427:3127]
2025-10-02T09:32:37.970131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1608, pipe: [1:7556554969072791427:3127]
2025-10-02T09:32:38.011934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.012166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.012175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.012187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554969072791427:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.012356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554969072791427:3127]
2025-10-02T09:32:38.012372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.012383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:38.012385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:38.012430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1609 reason: error at write: Disconnected sessionId: src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0
2025-10-02T09:32:38.012541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.012574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1609 sessionId: src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0 is DEAD
2025-10-02T09:32:38.012760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:38.012777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Write session will restart in 0.009296s
2025-10-02T09:32:38.012814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Write session: Do CDS request
2025-10-02T09:32:38.012821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.021695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.022786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.022885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.022891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.022897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.022922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.022943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292213322:9627]
2025-10-02T09:32:38.023210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.023316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.023359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.023364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1610
2025-10-02T09:32:38.023491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.023494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.023511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.023517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.023519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.023515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.023694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.023723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.023728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.023728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.023729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.023729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.023730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.023730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.023731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.023731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.023732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.023732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.023733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.023735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.023743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.023745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.023747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.023749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.023751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.023753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.023755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.023757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.023759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.023761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.023763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.023766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.023770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.023773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.023776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.023778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.023781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.023772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1610 sessionId:  describe result for acl check
2025-10-02T09:32:38.023783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.023786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.023788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.023791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.023793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.023799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.023801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.023804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.023806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.023796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.023800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.023808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.023801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.023804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367758958:3066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.023812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.023814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.023816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.023819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.023822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.023825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.023827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.023829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.023845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.024155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367758958:3066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.025586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367758958:3066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.029173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367758958:3066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.029181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367758958:3066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.029183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367758958:3066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.029188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.031335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.032821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.032829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.032830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.032832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.032835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1609 [2:7556554973292213322:9627]
2025-10-02T09:32:38.032843Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.032853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.032854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.032856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.032857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.032866Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.032874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.032878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.032909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.032914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.032915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.032917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.032918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.032956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.032961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.032967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.032972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.032979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.032995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367758725:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.033001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367758995:3066], now have 1 active actors on pipe
2025-10-02T09:32:38.033004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.033009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.033010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.033019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.033029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.033033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.033036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.033038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.033039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.033040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.033024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1609
2025-10-02T09:32:38.033053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.033041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1609
2025-10-02T09:32:38.033058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.033060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.033073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.033076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.033101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.033107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.033109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.033111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.033116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.033124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.033137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.033226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.033233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.033243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.033300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1610 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0
2025-10-02T09:32:38.033552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de3e3b1-b0e54e8d-e7201c39-40a32035_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.036325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Write session: try to update token
2025-10-02T09:32:38.036342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.042444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.042454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.042455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.042456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.042460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.042462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.042464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292213317:9627]
2025-10-02T09:32:38.042484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.042486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.042488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.042489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.042490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.042491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.042598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.048859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId: src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.050754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.112301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367759002:3127]
2025-10-02T09:32:38.112494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1609, pipe: [1:7556554973367759002:3127]
2025-10-02T09:32:38.155396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.155686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.155695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.155708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759002:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.155859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.155876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:38.155884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:38.155894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.155925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1610 reason: error at write: Disconnected sessionId: src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0
2025-10-02T09:32:38.155925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367759002:3127]
2025-10-02T09:32:38.156069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1610 sessionId: src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0 is DEAD
2025-10-02T09:32:38.156215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:38.156230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Write session will restart in 0.009973s
2025-10-02T09:32:38.156258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Write session: Do CDS request
2025-10-02T09:32:38.156263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.165649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.166772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.166885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.166892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.166898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.166926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.166950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292213514:9629]
2025-10-02T09:32:38.167210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.167296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.167303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.167310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1611
2025-10-02T09:32:38.167419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.167435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.167441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.167443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.167495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.167519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.167696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1611 sessionId:  describe result for acl check
2025-10-02T09:32:38.167698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.167719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.167723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.167724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.167727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.167727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367759238:3053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.167730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.167731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.167731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.167732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.167732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.167733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.167733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.167734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.167734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.167735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.167735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.167738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.167745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.167747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.167750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.167751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.167753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.167755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.167758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.167760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.167762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.167764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.167766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.167771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.167775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.167778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.167781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.167784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.167786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.167788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.167791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.167793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.167796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.167798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.167801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.167803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.167805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.167807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.167810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.167812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.167816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.167818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.167821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.167823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.167825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.167827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.167830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.167847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.168062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367759238:3053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.169479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367759238:3053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.173122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367759238:3053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.173127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367759238:3053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.173129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367759238:3053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.173132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.175312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.176837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.176846Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.176847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.176849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.176853Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1610 [2:7556554973292213514:9629]
2025-10-02T09:32:38.176862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.176872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.176873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.176875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.176876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.176885Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.176888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.176892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.176927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.176932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.176934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.176936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.176937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.176977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.176982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.176988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.176994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.177002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.177017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759274:3053], now have 1 active actors on pipe
2025-10-02T09:32:38.177023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759003:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.177027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.177028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.177030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.177037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.177047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.177051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.177053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.177054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.177057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.177059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.177060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1610
2025-10-02T09:32:38.177066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1610
2025-10-02T09:32:38.177073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.177078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.177080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.177091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.177093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.177119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.177126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.177128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.177130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.177135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.177143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.177155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.177253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.177258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.177265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.177314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1611 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0
2025-10-02T09:32:38.177558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd3e8493-7cbc0e7d-9d79a974-fa104678_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.180337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Write session: try to update token
2025-10-02T09:32:38.180351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.186691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.186703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.186704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.186705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.186708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.186711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.186715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292213509:9629]
2025-10-02T09:32:38.186735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.186741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.186742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.186748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.186755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.186764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.186865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.213487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId: src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.221100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.256161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367759306:3127]
2025-10-02T09:32:38.256354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1610, pipe: [1:7556554973367759306:3127]
2025-10-02T09:32:38.301752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.302118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.302127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.302139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759306:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.302287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.302304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367759306:3127]
2025-10-02T09:32:38.302312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:38.302315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:38.302324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.302363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1611 reason: error at write: Disconnected sessionId: src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0
2025-10-02T09:32:38.302520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1611 sessionId: src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0 is DEAD
2025-10-02T09:32:38.302782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:38.302796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Write session will restart in 0.005834s
2025-10-02T09:32:38.302818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Write session: Do CDS request
2025-10-02T09:32:38.302824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.309197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.309536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.309543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1612
2025-10-02T09:32:38.309656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.309678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.309683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.309686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.309966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1612 sessionId:  describe result for acl check
2025-10-02T09:32:38.309986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.309990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.309991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.309993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367759511:3040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.310319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367759511:3040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.311345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.311962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367759511:3040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.312241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.312375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.312382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.312388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.312417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.312441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292213746:9644]
2025-10-02T09:32:38.312777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.312955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.312978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.313151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.313179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.313183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.313183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.313184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.313185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.313185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.313186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.313186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.313187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.313187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.313188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.313188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.313192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.313198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.313200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.313202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.313204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.313206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.313208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.313210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.313212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.313214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.313216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.313218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.313221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.313225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.313228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.313232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.313234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.313238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.313240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.313243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.313245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.313249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.313251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.313254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.313260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.313263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.313265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.313267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.313269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.313272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.313274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.313277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.313279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.313282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.313283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.313286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.313302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.317162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367759511:3040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.317170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367759511:3040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.317174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367759511:3040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.317177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.320865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.322371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.322381Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.322382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.322384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.322388Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1611 [2:7556554973292213746:9644]
2025-10-02T09:32:38.322396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.322407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.322408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.322410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.322411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.322422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.322425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.322429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.322462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.322468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.322469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.322471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.322472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.322510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.322515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.322522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.322527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.322535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.322546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759579:3040], now have 1 active actors on pipe
2025-10-02T09:32:38.322548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759307:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.322552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.322554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.322555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.322565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.322577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.322578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.322580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.322581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.322587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.322588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.322603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.322608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.322588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1611
2025-10-02T09:32:38.322610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.322595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1611
2025-10-02T09:32:38.322625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.322630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.322657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.322663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.322666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.322667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.322672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.322677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.322689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.322794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.322799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.322807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.322858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1612 partition: 0 MaxSeqNo: 36 sessionId: src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0
2025-10-02T09:32:38.323129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3db182e-6138b66f-c64f0b91-a7d13c8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.325939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Write session: try to update token
2025-10-02T09:32:38.325954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.333659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.333670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.333671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.333672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.333677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.333680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.333682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292213741:9644]
2025-10-02T09:32:38.333703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.333706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.333708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.333709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.333712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.333714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.333818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.338907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId: src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.341781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.402609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367759587:3127]
2025-10-02T09:32:38.402774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1611, pipe: [1:7556554973367759587:3127]
2025-10-02T09:32:38.445802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.446115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.446123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.446136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759587:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.446302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.446343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:38.446353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:38.446411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1612 reason: error at write: Disconnected sessionId: src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0
2025-10-02T09:32:38.446435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367759587:3127]
2025-10-02T09:32:38.446458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.446581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1612 sessionId: src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0 is DEAD
2025-10-02T09:32:38.446726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:38.446738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Write session will restart in 0.007239s
2025-10-02T09:32:38.446770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Write session: Do CDS request
2025-10-02T09:32:38.446776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.455088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.455225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.455377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.455385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1613
2025-10-02T09:32:38.455483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.455504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.455510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.455513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.455772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1613 sessionId:  describe result for acl check
2025-10-02T09:32:38.455791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.455795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.455796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.455799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367759822:3037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.455979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.456075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.456081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.456087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.456112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.456135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292213941:9646]
2025-10-02T09:32:38.456171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367759822:3037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.456591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.456755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.456777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.456971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.457000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.457004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.457004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.457005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.457005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.457006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.457007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.457007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.457008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.457009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.457009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.457010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.457013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.457019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.457021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.457023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.457025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.457027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.457031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.457033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.457035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.457036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.457038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.457040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.457044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.457048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.457051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.457054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.457056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.457059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.457061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.457063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.457065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.457068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.457070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.457072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.457074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.457077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.457079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.457081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.457083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.457086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.457089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.457091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.457093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.457096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.457101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.457103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.457121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.457717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367759822:3037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.461823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367759822:3037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.461831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367759822:3037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.461833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367759822:3037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.461836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.464476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.466018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.466028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.466029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.466031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.466034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1612 [2:7556554973292213941:9646]
2025-10-02T09:32:38.466042Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.466050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.466055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.466057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.466058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.466067Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.466074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.466078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.466108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.466112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.466113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.466115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.466117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.466153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.466157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.466164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.466169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.466180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.466194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759588:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.466199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759861:3037], now have 1 active actors on pipe
2025-10-02T09:32:38.466203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.466204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.466205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.466212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.466222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.466224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.466226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.466227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.466232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.466234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.466228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1612
2025-10-02T09:32:38.466233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1612
2025-10-02T09:32:38.466246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.466251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.466252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.466262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.466267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.466293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1449ec7e-66535bab-8b2427c-e355d584_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.466300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.466302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.466303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.466308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.466316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.466328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.466411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.466416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.466424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.466481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1613 partition: 0 MaxSeqNo: 36 sessionId: src_id|1449ec7e-66535bab-8b2427c-e355d584_0
2025-10-02T09:32:38.466719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbcf926f-ee84042d-6144a9c8-c050f382_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1449ec7e-66535bab-8b2427c-e355d584_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.469528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Write session: try to update token
2025-10-02T09:32:38.469546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.475368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.475379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.475380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.475381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.475384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.475387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.475389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292213936:9646]
2025-10-02T09:32:38.475408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.475414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.475415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.475415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.475418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.475421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.475523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.482899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId: src_id|1449ec7e-66535bab-8b2427c-e355d584_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.485086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.546494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367759869:3127]
2025-10-02T09:32:38.546707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1612, pipe: [1:7556554973367759869:3127]
2025-10-02T09:32:38.590111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.590463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.590472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.590485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759869:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.590656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.590705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.590708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:38.590744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367759869:3127]
2025-10-02T09:32:38.590789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1449ec7e-66535bab-8b2427c-e355d584_0
2025-10-02T09:32:38.590941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1613 sessionId: src_id|1449ec7e-66535bab-8b2427c-e355d584_0 is DEAD
2025-10-02T09:32:38.591108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:38.591123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Write session will restart in 0.009307s
2025-10-02T09:32:38.591145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Write session: Do CDS request
2025-10-02T09:32:38.591151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.598964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.599972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.600073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.600079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.600085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.600112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.600135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292214137:9648]
2025-10-02T09:32:38.600548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.600712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.600734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.600933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.600968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.600972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.600973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.600973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.600974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.600975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.600975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.600976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.600976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.600977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.600977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.600978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.600980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.600988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.600990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.600992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.600994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.600996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.600998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.601000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.601002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.601004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.601006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.601008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.601013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.601017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.601020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.601023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.601025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.601027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.601030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.601033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.601035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.601038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.601040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.601042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.601045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.601047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.601050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.601052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.601055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.601057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.601059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.601062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.601065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.601068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.601070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.601074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.601091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.601226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.601336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.601345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1614
2025-10-02T09:32:38.601471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.601490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.601493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.601496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.601793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1614 sessionId:  describe result for acl check
2025-10-02T09:32:38.601818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.601824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.601825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.601828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367760109:3027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.602225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367760109:3027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.603739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367760109:3027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.608027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367760109:3027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.608035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367760109:3027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.608037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367760109:3027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.608040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.608583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.610202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.610212Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.610213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.610215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.610219Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1613 [2:7556554973292214137:9648]
2025-10-02T09:32:38.610225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.610236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.610237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.610239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.610240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.610248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.610253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.610257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.610286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.610291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.610292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.610294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.610296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.610333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.610337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.610344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.610349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.610357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.610371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760144:3027], now have 1 active actors on pipe
2025-10-02T09:32:38.610377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367759870:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.610381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.610382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.610383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.610391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.610401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.610401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.610403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.610404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.610412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.610413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.610404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1613
2025-10-02T09:32:38.610404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1613
2025-10-02T09:32:38.610431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.610435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.610437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.610446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.610450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.610478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.610486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.610488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.610489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.610494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.610501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.610511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.610586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.610591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.610599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.610649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1614 partition: 0 MaxSeqNo: 36 sessionId: src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0
2025-10-02T09:32:38.610892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1449ec7e-66535bab-8b2427c-e355d584_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.613563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Write session: try to update token
2025-10-02T09:32:38.613578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.619706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.619717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.619718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.619719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.619723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.619726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.619728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292214132:9648]
2025-10-02T09:32:38.619748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.619750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.619753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.619753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.619754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.619755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.619864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.626251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId: src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.628453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.690843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367760152:3127]
2025-10-02T09:32:38.691026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1613, pipe: [1:7556554973367760152:3127]
2025-10-02T09:32:38.736547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.736834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.736844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.736858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760152:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.737008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.737041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:38.737050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.737051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:38.737082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367760152:3127]
2025-10-02T09:32:38.737096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1614 reason: error at write: Disconnected sessionId: src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0
2025-10-02T09:32:38.737228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1614 sessionId: src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0 is DEAD
2025-10-02T09:32:38.737400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:38.737426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Write session will restart in 0.005729s
2025-10-02T09:32:38.737449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Write session: Do CDS request
2025-10-02T09:32:38.737455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.744155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.744305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.744315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1615
2025-10-02T09:32:38.744445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.744473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.744481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.744485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.744779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1615 sessionId:  describe result for acl check
2025-10-02T09:32:38.744815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.744819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.744820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.744823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367760386:3025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.745177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367760386:3025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.745518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.746492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.746525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367760386:3025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.746584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.746590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.746595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.746619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.746642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292214334:9650]
2025-10-02T09:32:38.746983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.747165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.747187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.747356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.747386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.747390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.747391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.747391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.747392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.747392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.747393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.747394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.747394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.747395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.747395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.747395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.747398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.747404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.747406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.747408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.747410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.747412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.747414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.747416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.747418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.747420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.747422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.747424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.747427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.747431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.747434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.747437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.747439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.747442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.747445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.747447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.747449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.747453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.747455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.747457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.747460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.747462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.747465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.747467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.747469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.747472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.747474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.747477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.747479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.747482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.747487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.747490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.747508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.751333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367760386:3025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.751341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367760386:3025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.751343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367760386:3025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.751347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.755008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.756632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.756643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.756644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.756646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.756650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1614 [2:7556554973292214334:9650]
2025-10-02T09:32:38.756659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.756670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.756671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.756672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.756674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.756683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.756685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.756690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.756726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.756732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.756733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.756735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.756736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.756780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.756785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.756791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.756797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.756821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.756835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.756839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.756840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.756845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.756852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760153:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.756852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.756855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.756857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.756858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760428:3025], now have 1 active actors on pipe
2025-10-02T09:32:38.756863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.756871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.756873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.756890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.756898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.756908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.756897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1614
2025-10-02T09:32:38.756907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1614
2025-10-02T09:32:38.756936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.756942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.756956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60859fad-41fc09fe-46200768-6e05ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.756965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.756969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.756970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.756976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.756984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.756996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.757103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.757108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.757115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.757179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1615 partition: 0 MaxSeqNo: 36 sessionId: src_id|60859fad-41fc09fe-46200768-6e05ca_0
2025-10-02T09:32:38.757426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47fee80-a3d7b8c8-ab1913cd-7e63bc63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60859fad-41fc09fe-46200768-6e05ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.760092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Write session: try to update token
2025-10-02T09:32:38.760106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.766420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.766432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.766433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.766434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.766439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.766442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.766444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292214329:9650]
2025-10-02T09:32:38.766465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.766471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.766473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.766473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.766476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.766479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.766580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.772528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId: src_id|60859fad-41fc09fe-46200768-6e05ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.775233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.837284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367760442:3127]
2025-10-02T09:32:38.837448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1614, pipe: [1:7556554973367760442:3127]
2025-10-02T09:32:38.884297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:38.884643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.884655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.884668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760442:3127], now have 1 active actors on pipe
2025-10-02T09:32:38.884891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367760442:3127]
2025-10-02T09:32:38.884918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:38.884921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:38.884926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:38.884971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:38.884994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1615 reason: error at write: Disconnected sessionId: src_id|60859fad-41fc09fe-46200768-6e05ca_0
2025-10-02T09:32:38.885173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1615 sessionId: src_id|60859fad-41fc09fe-46200768-6e05ca_0 is DEAD
2025-10-02T09:32:38.885363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:38.885379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Write session will restart in 0.006542s
2025-10-02T09:32:38.885408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Write session: Do CDS request
2025-10-02T09:32:38.885415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:38.893206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.893375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:38.893386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1616
2025-10-02T09:32:38.893486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:38.893506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:38.893513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:38.893515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:38.893829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1616 sessionId:  describe result for acl check
2025-10-02T09:32:38.893849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:38.893853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:38.893854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:38.893858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554973367760679:3020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:38.894183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554973367760679:3020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:38.895034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:38.895511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554973367760679:3020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:38.896522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:38.896632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:38.896638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:38.896644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:38.896671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:38.896700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554973292214543:9653]
2025-10-02T09:32:38.897055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554973367760679:3020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:38.897063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554973367760679:3020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:38.897065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554973367760679:3020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:38.897069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:38.897071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:38.897220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:38.897244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:38.897426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:38.897455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.897459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.897459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.897460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.897461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.897461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.897462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.897462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.897463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.897463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.897464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.897464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.897467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.897474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.897476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.897478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.897480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.897482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.897484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.897486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.897488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.897490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.897492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.897494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.897498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.897501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:38.897505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.897507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:38.897510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.897514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:38.897517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.897523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:38.897526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.897528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:38.897531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.897533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:38.897538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.897541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:38.897543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.897546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:38.897550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.897556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:38.897558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.897561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.897565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.897567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.897570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.897572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.897592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:38.905064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:38.907023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:38.907033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:38.907034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:38.907036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:38.907039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1615 [2:7556554973292214543:9653]
2025-10-02T09:32:38.907046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:38.907057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:38.907062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.907063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.907064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.907073Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:38.907079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:38.907084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:38.907123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.907127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.907128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.907130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:38.907131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:38.907171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:38.907176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.907182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:38.907191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:38.907202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:38.907215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.907220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.907222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.907227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:38.907234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:38.907236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760444:2446], now have 1 active actors on pipe
2025-10-02T09:32:38.907238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760731:3020], now have 1 active actors on pipe
2025-10-02T09:32:38.907241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:38.907242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:38.907245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:38.907249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:38.907251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:38.907266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.907276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:38.907285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:38.907278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1615
2025-10-02T09:32:38.907280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1615
2025-10-02T09:32:38.907309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.907314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.907329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:38.907333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:38.907335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:38.907336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:38.907342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:38.907349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:38.907359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.907463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:38.907468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:38.907475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:38.907541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1616 partition: 0 MaxSeqNo: 36 sessionId: src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0
2025-10-02T09:32:38.907801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60859fad-41fc09fe-46200768-6e05ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:38.910493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Write session: try to update token
2025-10-02T09:32:38.910509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:38.916604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:38.916615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:38.916616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:38.916617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:38.916621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.916624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.916626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554973292214537:9653]
2025-10-02T09:32:38.916646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:38.916649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:38.916650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:38.916651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:38.916655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:38.916657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:38.916944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:38.939147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId: src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:38.941532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:38.985259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554973367760742:3127]
2025-10-02T09:32:38.985444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1615, pipe: [1:7556554973367760742:3127]
2025-10-02T09:32:39.030782Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.031103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.031112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.031125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554973367760742:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.031253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.031327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.031344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554973367760742:3127]
2025-10-02T09:32:39.031360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:39.031431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0
2025-10-02T09:32:39.031580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1616 sessionId: src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0 is DEAD
2025-10-02T09:32:39.031728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:39.031744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Write session will restart in 0.009478s
2025-10-02T09:32:39.031764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Write session: Do CDS request
2025-10-02T09:32:39.031771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.040316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.041305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.041408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.041415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.041421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.041446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.041469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587182039:9656]
2025-10-02T09:32:39.041823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.041993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.042015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.042197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.042227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.042234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.042231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.042231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.042232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.042232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.042233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.042233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.042234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.042234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.042235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.042236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.042236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.042239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.042245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.042248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.042250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.042252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.042254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.042256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.042258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.042260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.042262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.042264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.042266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.042269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.042273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.042276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.042279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.042281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.042284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.042286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.042288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.042291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.042293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.042295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.042298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.042300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.042303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.042304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.042307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.042309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.042312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.042314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.042319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.042322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.042324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.042326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.042329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.042345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.042346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.042355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1617
2025-10-02T09:32:39.042488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.042509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.042515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.042518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.042805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1617 sessionId:  describe result for acl check
2025-10-02T09:32:39.042828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.042832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.042833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.042836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662728282:3017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.043182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662728282:3017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.044447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662728282:3017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.048584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662728282:3017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.048592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662728282:3017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.048594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662728282:3017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.048597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.049857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.051369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.051380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.051381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.051383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.051386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1616 [2:7556554977587182039:9656]
2025-10-02T09:32:39.051392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.051402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.051403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.051404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.051405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.051413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.051416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.051421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.051453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.051457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.051459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.051460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.051462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.051570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1616
2025-10-02T09:32:39.051577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1616
2025-10-02T09:32:39.051586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.051592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.051598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.051604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.051616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.051630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728040:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.051635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728317:3017], now have 1 active actors on pipe
2025-10-02T09:32:39.051647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.051651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.051661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.051665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.051666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.051674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.051684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.051685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.051686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.051687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.051695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.051697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.051706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80c1c77b-af285173-8806ec7c-4460c329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.051713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.051715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.051716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.051720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.051728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.051746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.051754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.051758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.051762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.051856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.051861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.051868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.051922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1617 partition: 0 MaxSeqNo: 36 sessionId: src_id|80c1c77b-af285173-8806ec7c-4460c329_0
2025-10-02T09:32:39.052169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a438f76f-bc0a71cb-3ab35cfd-4630bf61_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80c1c77b-af285173-8806ec7c-4460c329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.054863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Write session: try to update token
2025-10-02T09:32:39.054876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.060916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.060925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.060927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.060928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.060932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.060934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.060936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587182034:9656]
2025-10-02T09:32:39.060956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.060958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.060959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.060960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.060962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.060965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.061113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.070962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId: src_id|80c1c77b-af285173-8806ec7c-4460c329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.073079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:39.131696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554977662728324:3127]
2025-10-02T09:32:39.131901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1616, pipe: [1:7556554977662728324:3127]
2025-10-02T09:32:39.177775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.177986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.177995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.178007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728324:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.178138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.178169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554977662728324:3127]
2025-10-02T09:32:39.178183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.178192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:39.178249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1617 reason: status is not ok: tablet will be restarted right now sessionId: src_id|80c1c77b-af285173-8806ec7c-4460c329_0
2025-10-02T09:32:39.178422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1617 sessionId: src_id|80c1c77b-af285173-8806ec7c-4460c329_0 is DEAD
2025-10-02T09:32:39.178517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:39.178526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Write session will restart in 0.006353s
2025-10-02T09:32:39.178545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Write session: Do CDS request
2025-10-02T09:32:39.178549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.186280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.186347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.186359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1618
2025-10-02T09:32:39.186508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.186535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.186543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.186546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.186892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1618 sessionId:  describe result for acl check
2025-10-02T09:32:39.186917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.186922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.186924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.186928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662728562:3009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.187397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662728562:3009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.187642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.188675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.188776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.188782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.188788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.188828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.188852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587182239:9658]
2025-10-02T09:32:39.189100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662728562:3009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.189202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.189395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.189418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.189598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.189627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.189631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.189632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.189632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.189633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.189634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.189634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.189635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.189635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.189636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.189636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.189637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.189640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.189645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.189647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.189650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.189652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.189654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.189656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.189658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.189660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.189662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.189664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.189666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.189671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.189674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.189678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.189680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.189683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.189686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.189688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.189691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.189693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.189696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.189698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.189704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.189707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.189709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.189712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.189715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.189717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.189720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.189722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.189725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.189727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.189734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.189736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.189739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.189759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.193717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662728562:3009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.193726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662728562:3009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.193728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662728562:3009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.193732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.197465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.199133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.199143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.199144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.199146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.199150Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1617 [2:7556554977587182239:9658]
2025-10-02T09:32:39.199158Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.199169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.199170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.199172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.199173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.199183Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.199189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.199194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.199230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.199235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.199236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.199239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.199240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.199281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.199286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.199293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.199298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.199306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.199321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728326:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.199327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728604:3009], now have 1 active actors on pipe
2025-10-02T09:32:39.199330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.199333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.199334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.199341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.199354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.199360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.199362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.199364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.199364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.199366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.199370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1617
2025-10-02T09:32:39.199370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1617
2025-10-02T09:32:39.199382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.199388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.199389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.199405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.199410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.199428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.199436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.199438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.199439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.199444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.199452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.199462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.199569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.199575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.199582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.199648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1618 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0
2025-10-02T09:32:39.199930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1c77b-af285173-8806ec7c-4460c329_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.202814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Write session: try to update token
2025-10-02T09:32:39.202834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.208866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.208875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.208876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.208877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.208882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.208885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.208887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587182234:9658]
2025-10-02T09:32:39.208908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.208911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.208912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.208916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.208919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.208921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.209035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.221185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId: src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.223410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:39.278109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554977662728635:3127]
2025-10-02T09:32:39.278280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1617, pipe: [1:7556554977662728635:3127]
2025-10-02T09:32:39.321725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.322155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.322166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.322179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728635:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.322353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:39.322361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:39.322377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554977662728635:3127]
2025-10-02T09:32:39.322392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.322404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1618 reason: error at write: Disconnected sessionId: src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0
2025-10-02T09:32:39.322539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1618 sessionId: src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0 is DEAD
2025-10-02T09:32:39.322544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.322723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:39.322738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Write session will restart in 0.005497s
2025-10-02T09:32:39.322769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Write session: Do CDS request
2025-10-02T09:32:39.322775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.329158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.329411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.329421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1619
2025-10-02T09:32:39.329557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.329585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.329593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.329596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.329945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1619 sessionId:  describe result for acl check
2025-10-02T09:32:39.329972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.329977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.329979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.329983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662728853:2992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.330436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662728853:2992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.331287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.332140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662728853:2992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.332353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.332475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.332482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.332488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.332516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.332540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587182478:9673]
2025-10-02T09:32:39.332903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.333095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.333117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.333301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.333331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.333335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.333335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.333336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.333337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.333337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.333338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.333338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.333339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.333339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.333340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.333340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.333343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.333349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.333351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.333353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.333355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.333357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.333359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.333361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.333363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.333365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.333367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.333369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.333372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.333376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.333380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.333383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.333386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.333388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.333390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.333393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.333395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.333397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.333399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.333402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.333404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.333406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.333409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.333411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.333413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.333416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.333419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.333422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.333424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.333426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.333432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.333434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.333452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.333727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662728853:2992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.333735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662728853:2992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.333737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662728853:2992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.333926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.340868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.342453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.342462Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.342463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.342465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.342469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1618 [2:7556554977587182478:9673]
2025-10-02T09:32:39.342476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.342486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.342491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.342492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.342493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.342504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.342506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.342512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.342546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.342550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.342552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.342554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.342555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.342591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.342596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.342602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.342607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.342619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.342633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728915:2992], now have 1 active actors on pipe
2025-10-02T09:32:39.342639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728636:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.342643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.342644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.342646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.342654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.342665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.342673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.342675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.342677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.342680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.342682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.342678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1618
2025-10-02T09:32:39.342692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1618
2025-10-02T09:32:39.342691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.342696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.342699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.342717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.342722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.342741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.342747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.342749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.342750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.342762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.342768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.342780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.342896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.342901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.342909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.342975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1619 partition: 0 MaxSeqNo: 36 sessionId: src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0
2025-10-02T09:32:39.343242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e3c6ca-4d83e1d9-c04c3556-f629a7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.346114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Write session: try to update token
2025-10-02T09:32:39.346129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.351932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.351942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.351943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.351944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.351948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.351951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.351953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587182473:9673]
2025-10-02T09:32:39.351973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.351974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.351977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.351979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.351980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.351981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.352094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.362284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId: src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.364409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:39.422517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554977662728923:3127]
2025-10-02T09:32:39.422697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1618, pipe: [1:7556554977662728923:3127]
2025-10-02T09:32:39.463917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.464262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.464271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.464283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728923:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.464405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.464493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554977662728923:3127]
2025-10-02T09:32:39.464503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.464517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:39.464572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1619 reason: status is not ok: tablet will be restarted right now sessionId: src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0
2025-10-02T09:32:39.464708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1619 sessionId: src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0 is DEAD
2025-10-02T09:32:39.464872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:39.464888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Write session will restart in 0.005124s
2025-10-02T09:32:39.464912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Write session: Do CDS request
2025-10-02T09:32:39.464918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.471251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.471367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.471378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1620
2025-10-02T09:32:39.471491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.471517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.471524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.471527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.471851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1620 sessionId:  describe result for acl check
2025-10-02T09:32:39.471880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.471886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.471888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.471892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662729114:2987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.472363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662729114:2987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.473541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.473647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662729114:2987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.474603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.474697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.474703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.474709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.474733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.474763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587182680:9675]
2025-10-02T09:32:39.475118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.475295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.475317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.475491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.475520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.475524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.475524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.475525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.475525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.475526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.475526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.475527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.475527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.475528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.475528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.475529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.475531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.475537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.475539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.475541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.475543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.475545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.475547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.475549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.475545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662729114:2987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.475551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.475554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.475556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.475558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.475552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662729114:2987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.475561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.475554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662729114:2987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.475565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.475557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.475568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.475571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.475573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.475575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.475577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.475580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.475582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.475585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.475587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.475589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.475592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.475594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.475596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.475599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.475601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.475604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.475606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.475609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.475611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.475613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.475615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.475618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.475634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.483071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.484710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.484719Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.484720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.484722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.484727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1619 [2:7556554977587182680:9675]
2025-10-02T09:32:39.484733Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.484742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.484745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.484747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.484748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.484758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.484761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.484769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.484817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.484821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.484822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.484824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.484826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.484865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.484869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.484876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.484881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.484891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.484905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729201:2987], now have 1 active actors on pipe
2025-10-02T09:32:39.484910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662728924:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.484915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.484917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.484918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.484925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.484932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.484943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.484942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.484945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.484947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.484948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.484962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.484970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.484973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.484954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1619
2025-10-02T09:32:39.484958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1619
2025-10-02T09:32:39.484992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.484997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.485015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.485022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.485024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.485026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.485030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.485038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.485050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.485153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.485158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.485166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.485234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1620 partition: 0 MaxSeqNo: 36 sessionId: src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0
2025-10-02T09:32:39.485555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|328e0379-4665c901-ce3dd8bd-e64d9900_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.488284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Write session: try to update token
2025-10-02T09:32:39.488303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.494098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.494108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.494109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.494110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.494114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.494117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.494119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587182675:9675]
2025-10-02T09:32:39.494142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.494142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.494145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.494145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.494146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.494147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.494284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.501995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId: src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.504172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:39.564834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554977662729212:3127]
2025-10-02T09:32:39.564990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1619, pipe: [1:7556554977662729212:3127]
2025-10-02T09:32:39.608551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.608784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.608797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.608828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729212:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.609038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554977662729212:3127]
2025-10-02T09:32:39.609052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:39.609056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:39.609059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.609102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1620 reason: error at write: Disconnected sessionId: src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0
2025-10-02T09:32:39.609236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1620 sessionId: src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0 is DEAD
2025-10-02T09:32:39.609333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.609398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:39.609413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Write session will restart in 0.005094s
2025-10-02T09:32:39.609434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Write session: Do CDS request
2025-10-02T09:32:39.609439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.615146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.615263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.615273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1621
2025-10-02T09:32:39.615393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.615420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.615428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.615431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.615859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1621 sessionId:  describe result for acl check
2025-10-02T09:32:39.615885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.615891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.615893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.615897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662729386:2981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.616349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662729386:2981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.617934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.618014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662729386:2981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.619030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.619121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.619128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.619133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.619159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.619183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587182883:9677]
2025-10-02T09:32:39.619520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.619698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.619721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.619906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.619935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.619938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.619939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.619939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.619940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.619940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.619941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.619941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.619942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.619942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.619943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.619943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.619946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.619952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.619954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.619956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.619951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662729386:2981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.619959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.619959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662729386:2981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.619961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.619961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662729386:2981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.619963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.619964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.619964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.619966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.619969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.619970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.619973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.619976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.619980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.619983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.619986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.619988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.619991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.619993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.619996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.619998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.620001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.620003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.620005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.620007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.620010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.620012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.620015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.620017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.620020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.620022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.620025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.620027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.620029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.620031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.620034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.620050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.627560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.629049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.629060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.629061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.629063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.629067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1620 [2:7556554977587182883:9677]
2025-10-02T09:32:39.629074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.629084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.629090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.629092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.629092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.629101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.629105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.629110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.629141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.629146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.629147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.629149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.629150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.629194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.629198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.629205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.629210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.629221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.629237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729213:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.629242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729491:2981], now have 1 active actors on pipe
2025-10-02T09:32:39.629246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.629247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.629248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.629255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.629266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.629273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.629275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.629277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.629277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.629278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.629293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.629299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.629307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.629291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1620
2025-10-02T09:32:39.629299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1620
2025-10-02T09:32:39.629331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.629347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.629370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.629378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.629381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.629384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.629390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.629401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.629414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.629532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.629537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.629549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.629617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1621 partition: 0 MaxSeqNo: 36 sessionId: src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0
2025-10-02T09:32:39.629901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3781bf5c-2f2aa599-7e01ea8b-2284eff9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.632599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Write session: try to update token
2025-10-02T09:32:39.632614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.638688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:39.638698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.638702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.638723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:39.638724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:39.638873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:39.638987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:39.639100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:39.639234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:39.639399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:39.639422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:39.645162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId: src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.646790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.646800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.646801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.646802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.646807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.646809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.646811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587182878:9677]
2025-10-02T09:32:39.646830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.646835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.646836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.646862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.646877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.646881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.646979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.647428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:39.709213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554977662729504:3127]
2025-10-02T09:32:39.709379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1620, pipe: [1:7556554977662729504:3127]
2025-10-02T09:32:39.762162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.762504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.762514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.762527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729504:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.762674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.762657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.762677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:39.762680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:39.762690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554977662729504:3127]
2025-10-02T09:32:39.762731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1621 reason: error at write: Disconnected sessionId: src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0
2025-10-02T09:32:39.762885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1621 sessionId: src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0 is DEAD
2025-10-02T09:32:39.763056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:39.763070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Write session will restart in 0.009099s
2025-10-02T09:32:39.763095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Write session: Do CDS request
2025-10-02T09:32:39.763101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.771767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.772792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.772901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.772908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.772913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.772938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.772962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587183088:9679]
2025-10-02T09:32:39.773161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.773305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.773496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.773521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.773701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.773728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.773732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.773733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.773733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.773734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.773734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.773735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.773735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.773736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.773736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.773737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.773737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.773740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.773747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.773749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.773751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.773753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.773755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.773757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.773759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.773761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.773763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.773765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.773767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.773771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.773775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.773778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.773781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.773783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.773786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.773788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.773791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.773794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.773800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.773802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.773806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.773808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.773811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.773813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.773815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.773818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.773820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.773822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.773828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.773830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.773832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.773834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.773837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.773853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.773851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.773860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1622
2025-10-02T09:32:39.773986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.774004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.774007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.774011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.774320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1622 sessionId:  describe result for acl check
2025-10-02T09:32:39.774347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.774353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.774354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.774359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662729756:2968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.774912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662729756:2968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.776101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662729756:2968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.780153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662729756:2968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.780161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662729756:2968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.780162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662729756:2968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.780166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.781406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.782959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.782968Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.782969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.782971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.782974Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1621 [2:7556554977587183088:9679]
2025-10-02T09:32:39.782981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.782991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.782993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.782994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.782995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.783004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.783010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.783014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.783045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.783049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.783050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.783052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.783053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.783090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.783094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.783101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.783106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.783116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.783131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729507:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.783136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729790:2968], now have 1 active actors on pipe
2025-10-02T09:32:39.783140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.783141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.783142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.783150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.783161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.783166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.783168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.783169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.783165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1621
2025-10-02T09:32:39.783174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.783176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.783183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.783166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1621
2025-10-02T09:32:39.783184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.783194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.783205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.783208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.783225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.783232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.783234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.783235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.783240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.783248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.783255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.783371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.783378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.783385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.783449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1622 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0
2025-10-02T09:32:39.783732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33f796a-2c4a1008-6cdabfa3-6b5d732a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.786416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Write session: try to update token
2025-10-02T09:32:39.786434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.792370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.792382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.792383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.792384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.792387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.792390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.792392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587183083:9679]
2025-10-02T09:32:39.792412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.792417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.792419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.792420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.792421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.792423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.792569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.799169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId: src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.801386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:39.862835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554977662729805:3127]
2025-10-02T09:32:39.863020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1621, pipe: [1:7556554977662729805:3127]
2025-10-02T09:32:39.908224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:39.908451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.908464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.908478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729805:3127], now have 1 active actors on pipe
2025-10-02T09:32:39.908648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554977662729805:3127]
2025-10-02T09:32:39.908648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:39.908673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:39.908675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:39.908718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1622 reason: error at write: Disconnected sessionId: src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0
2025-10-02T09:32:39.908824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:39.908872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1622 sessionId: src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0 is DEAD
2025-10-02T09:32:39.909058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:39.909072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Write session will restart in 0.009894s
2025-10-02T09:32:39.909094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Write session: Do CDS request
2025-10-02T09:32:39.909100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:39.917912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:39.918982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:39.919087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:39.919093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:39.919099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:39.919125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:39.919149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554977587183305:9682]
2025-10-02T09:32:39.919495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:39.919669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:39.919710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:39.919932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:39.919964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.919968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.919968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.919969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.919970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.919970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.919971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.919972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.919972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.919973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.919973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.919974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.919978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.919985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.919987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.919989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.919991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.919994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.919996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.919998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.920000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.920003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.920005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.920007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.920011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.920016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:39.920020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.920023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:39.920025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.920028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:39.920031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.920034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:39.920037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.920040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:39.920042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.920045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:39.920047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.920050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:39.920052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.920054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:39.920057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.920060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:39.920062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.920065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.920067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.920074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.920076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.920079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.920097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:39.920194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.920328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:39.920339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1623
2025-10-02T09:32:39.920482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:39.920501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:39.920508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:39.920511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:39.920855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1623 sessionId:  describe result for acl check
2025-10-02T09:32:39.920876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:39.920880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:39.920881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:39.920885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554977662730070:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:39.921232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554977662730070:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:39.922698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554977662730070:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:39.927077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554977662730070:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:39.927086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554977662730070:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:39.927089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554977662730070:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:39.927093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:39.927588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:39.929166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:39.929177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:39.929178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:39.929180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:39.929183Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1622 [2:7556554977587183305:9682]
2025-10-02T09:32:39.929190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:39.929201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:39.929206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.929208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.929209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.929219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:39.929225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:39.929230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:39.929265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.929269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.929270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.929272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:39.929273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:39.929312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:39.929318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.929325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:39.929331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:39.929339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:39.929350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.929355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.929356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.929361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:39.929367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:39.929369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662730104:2957], now have 1 active actors on pipe
2025-10-02T09:32:39.929372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554977662729821:2446], now have 1 active actors on pipe
2025-10-02T09:32:39.929374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:39.929375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:39.929377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:39.929384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:39.929386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:39.929404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.929412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:39.929421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:39.929419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1622
2025-10-02T09:32:39.929421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1622
2025-10-02T09:32:39.929454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.929459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.929473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:39.929480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:39.929482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:39.929484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:39.929490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:39.929498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:39.929508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.929615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:39.929621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:39.929628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:39.929689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1623 partition: 0 MaxSeqNo: 36 sessionId: src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0
2025-10-02T09:32:39.929952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1f6d7-c48fc234-2e776f3-e1029a42_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:39.932832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Write session: try to update token
2025-10-02T09:32:39.932847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:39.939040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:39.939051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.939056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.939078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:39.939082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:39.939218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:39.939344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:39.939457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:39.939571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:39.939743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:39.939768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:39.945672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId: src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:39.947737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:39.947753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:39.947755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:39.947757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:39.947765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.947769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.947772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554977587183300:9682]
2025-10-02T09:32:39.947803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:39.947805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:39.947811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:39.947811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:39.947813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:39.947815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:39.947998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:39.948602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.008764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957697407:3127]
2025-10-02T09:32:40.009012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1622, pipe: [1:7556554981957697407:3127]
2025-10-02T09:32:40.060721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.061092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.061103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.061117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957697407:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.061273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.061311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.061356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957697407:3127]
2025-10-02T09:32:40.061373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:40.061432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0
2025-10-02T09:32:40.061579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1623 sessionId: src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0 is DEAD
2025-10-02T09:32:40.061738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:40.061755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Write session will restart in 0.008003s
2025-10-02T09:32:40.061781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Write session: Do CDS request
2025-10-02T09:32:40.061787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.070330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.071199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.071345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.071354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1624
2025-10-02T09:32:40.071392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.071468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.071488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.071494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.071497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.071517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.071523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.071529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.071561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.071585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882150809:9685]
2025-10-02T09:32:40.071799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1624 sessionId:  describe result for acl check
2025-10-02T09:32:40.071824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.071828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.071830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.071834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957697654:2960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.071954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.072116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.072137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.072219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957697654:2960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.072317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.072349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.072353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.072353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.072354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.072355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.072355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.072356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.072357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.072357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.072358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.072358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.072359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.072362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.072368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.072370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.072372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.072374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.072376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.072378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.072380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.072382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.072384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.072386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.072388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.072392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.072396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.072399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.072402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.072405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.072407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.072411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.072418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.072420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.072423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.072425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.072428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.072434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.072436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.072439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.072441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.072444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.072446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.072450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.072453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.072455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.072459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.072461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.072464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.072483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.073582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957697654:2960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.077910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957697654:2960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.077918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957697654:2960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.077920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957697654:2960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.077923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.080176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.081830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.081841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.081842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.081845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.081848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1623 [2:7556554981882150809:9685]
2025-10-02T09:32:40.081855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.081866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.081871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.081873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.081874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.081883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.081885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.081890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.081931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.081936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.081937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.081939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.081940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.081976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.081980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.081987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.081992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.082000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.082011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957697409:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.082016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957697693:2960], now have 1 active actors on pipe
2025-10-02T09:32:40.082020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.082022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.082023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.082031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.082038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.082040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.082042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.082043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.082048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.082050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.082065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.082070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.082074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.082061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1623
2025-10-02T09:32:40.082072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1623
2025-10-02T09:32:40.082092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.082097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.082113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.082120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.082123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.082124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.082129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.082137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.082147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.082229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.082234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.082242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.082292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1624 partition: 0 MaxSeqNo: 36 sessionId: src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0
2025-10-02T09:32:40.082553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2896e3e9-b384c79e-b97641ad-4e4949c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.085279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Write session: try to update token
2025-10-02T09:32:40.085295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.091495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.091508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.091509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.091511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.091516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.091520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.091523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882150804:9685]
2025-10-02T09:32:40.091545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.091550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.091553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.091554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.091555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.091556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.091714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.097569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId: src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.099763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.161310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957697700:3127]
2025-10-02T09:32:40.161479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1623, pipe: [1:7556554981957697700:3127]
2025-10-02T09:32:40.203618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.203960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.203969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.203981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957697700:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.204127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.204185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:40.204196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:40.204206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957697700:3127]
2025-10-02T09:32:40.204221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.204243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1624 reason: error at write: Disconnected sessionId: src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0
2025-10-02T09:32:40.204380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1624 sessionId: src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0 is DEAD
2025-10-02T09:32:40.204554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:40.204569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Write session will restart in 0.005243s
2025-10-02T09:32:40.204619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Write session: Do CDS request
2025-10-02T09:32:40.204626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.211161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.211298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.211303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1625
2025-10-02T09:32:40.211413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.211433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.211435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.211438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.211723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1625 sessionId:  describe result for acl check
2025-10-02T09:32:40.211749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.211755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.211756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.211759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957697903:2950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.212114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957697903:2950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.213375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957697903:2950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.213417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.214396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.214493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.214499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.214505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.214531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.214561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882151014:9687]
2025-10-02T09:32:40.214922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.214970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957697903:2950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.214978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957697903:2950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.214980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957697903:2950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.214983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.215074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.215097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.215275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.215305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.215309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.215309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.215310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.215310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.215311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.215311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.215312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.215312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.215313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.215314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.215314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.215317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.215323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.215325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.215327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.215329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.215331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.215333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.215335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.215337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.215339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.215341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.215342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.215346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.215350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.215353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.215356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.215358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.215361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.215363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.215366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.215368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.215371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.215373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.215375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.215378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.215381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.215383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.215385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.215387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.215391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.215393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.215395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.215397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.215400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.215402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.215406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.215424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.222839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.224463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.224473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.224474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.224476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.224479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1624 [2:7556554981882151014:9687]
2025-10-02T09:32:40.224486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.224497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.224499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.224500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.224502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.224511Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.224514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.224519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.224558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.224562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.224563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.224565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.224566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.224604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.224609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.224616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.224623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.224631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.224646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957697984:2950], now have 1 active actors on pipe
2025-10-02T09:32:40.224652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957697702:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.224655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.224657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.224658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.224664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.224673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.224674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.224676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.224677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.224681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.224683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.224664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1624
2025-10-02T09:32:40.224686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1624
2025-10-02T09:32:40.224698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.224703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.224704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.224714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.224720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.224747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|802499ce-7a26f81-4859c28b-5589eb27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.224758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.224760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.224762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.224766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.224772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.224782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.224877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.224883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.224890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.224943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1625 partition: 0 MaxSeqNo: 36 sessionId: src_id|802499ce-7a26f81-4859c28b-5589eb27_0
2025-10-02T09:32:40.225220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f52c0-bf6f773c-426903d4-2b4174d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|802499ce-7a26f81-4859c28b-5589eb27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.228124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Write session: try to update token
2025-10-02T09:32:40.228140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.234045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.234062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.234064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.234066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.234072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.234075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.234078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882151009:9687]
2025-10-02T09:32:40.234101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.234104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.234105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.234107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.234110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.234112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.234236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.241990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId: src_id|802499ce-7a26f81-4859c28b-5589eb27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.244207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.304151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957698018:3127]
2025-10-02T09:32:40.304286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1624, pipe: [1:7556554981957698018:3127]
2025-10-02T09:32:40.347944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.348361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.348370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.348383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698018:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.348527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.348566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.348582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:40.348606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957698018:3127]
2025-10-02T09:32:40.348641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1625 reason: status is not ok: tablet will be restarted right now sessionId: src_id|802499ce-7a26f81-4859c28b-5589eb27_0
2025-10-02T09:32:40.348792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1625 sessionId: src_id|802499ce-7a26f81-4859c28b-5589eb27_0 is DEAD
2025-10-02T09:32:40.348966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:40.348982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Write session will restart in 0.008267s
2025-10-02T09:32:40.349007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Write session: Do CDS request
2025-10-02T09:32:40.349012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.358226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.358215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.358305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.358311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1626
2025-10-02T09:32:40.358442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.358464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.358470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.358473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.358739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1626 sessionId:  describe result for acl check
2025-10-02T09:32:40.358770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.358775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.358775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.358778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957698268:2936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.359121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957698268:2936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.359308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.359460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.359467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.359473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.359509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.359531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882151260:9702]
2025-10-02T09:32:40.359889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.360068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.360092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.360269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.360297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.360301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.360301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.360302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.360302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.360303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.360303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.360304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.360304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.360305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.360305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.360306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.360308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.360314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.360316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.360318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.360320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.360322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.360324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.360326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.360328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.360330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.360332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.360334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.360338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.360342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.360345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.360348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.360350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.360353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.360355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.360358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.360360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.360363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.360365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.360368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.360370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.360372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.360374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.360376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.360378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.360381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.360383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.360385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.360388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.360391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.360393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.360395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.360413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.360608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957698268:2936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.365153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957698268:2936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.365161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957698268:2936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.365163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957698268:2936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.365167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.367803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.369262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.369272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.369273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.369275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.369279Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1625 [2:7556554981882151260:9702]
2025-10-02T09:32:40.369287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.369298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.369303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.369305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.369306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.369315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.369321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.369326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.369359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.369364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.369366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.369368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.369369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.369483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.369488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.369495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.369500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.369491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1625
2025-10-02T09:32:40.369510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.369493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1625
2025-10-02T09:32:40.369524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698021:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.369529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698307:2936], now have 1 active actors on pipe
2025-10-02T09:32:40.369533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.369534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.369535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.369543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.369552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.369558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.369559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.369559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.369561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.369572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.369583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.369588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.369609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ea24394-72bd315d-6893a0d8-f00db730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.369617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.369619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.369620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.369625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.369633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.369640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.369644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.369652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.369660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.369747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.369752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.369760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.369806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1626 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ea24394-72bd315d-6893a0d8-f00db730_0
2025-10-02T09:32:40.370067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|802499ce-7a26f81-4859c28b-5589eb27_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ea24394-72bd315d-6893a0d8-f00db730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.372875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Write session: try to update token
2025-10-02T09:32:40.372891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.378891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.378904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.378906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.378908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.378916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.378919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.378922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882151255:9702]
2025-10-02T09:32:40.378948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.378951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.378954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.378956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.378956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.378958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.379114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.385840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId: src_id|7ea24394-72bd315d-6893a0d8-f00db730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.387942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.448559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957698314:3127]
2025-10-02T09:32:40.448732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1625, pipe: [1:7556554981957698314:3127]
2025-10-02T09:32:40.492679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.492978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.492987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.493001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698314:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.493147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.493197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.493218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:40.493264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957698314:3127]
2025-10-02T09:32:40.493276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ea24394-72bd315d-6893a0d8-f00db730_0
2025-10-02T09:32:40.493652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1626 sessionId: src_id|7ea24394-72bd315d-6893a0d8-f00db730_0 is DEAD
2025-10-02T09:32:40.493808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:40.493824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Write session will restart in 0.006548s
2025-10-02T09:32:40.493850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Write session: Do CDS request
2025-10-02T09:32:40.493856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.501196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.501305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.501311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1627
2025-10-02T09:32:40.501400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.501420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.501427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.501429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.501689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1627 sessionId:  describe result for acl check
2025-10-02T09:32:40.501712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.501713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.501714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.501719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957698558:2929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.502090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957698558:2929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.502655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.503741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.503763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957698558:2929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.503836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.503842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.503848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.503873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.503898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882151469:9704]
2025-10-02T09:32:40.504238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.504393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.504415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.504589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.504617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.504621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.504622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.504622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.504623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.504623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.504623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.504624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.504624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.504625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.504625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.504626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.504629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.504635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.504637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.504639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.504641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.504642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.504644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.504646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.504648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.504650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.504652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.504654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.504657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.504661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.504665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.504668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.504671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.504673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.504676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.504679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.504681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.504685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.504687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.504690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.504692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.504694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.504697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.504701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.504703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.504705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.504707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.504710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.504712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.504714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.504716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.504719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.504736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.508559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957698558:2929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.508567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957698558:2929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.508569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957698558:2929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.508572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.512183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.513700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.513709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.513710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.513712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.513715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1626 [2:7556554981882151469:9704]
2025-10-02T09:32:40.513722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.513733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.513734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.513735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.513736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.513745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.513751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.513756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.513787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.513791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.513792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.513794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.513795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.513837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.513842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.513848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.513853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.513862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.513877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698315:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.513882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698602:2929], now have 1 active actors on pipe
2025-10-02T09:32:40.513886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.513888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.513889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.513897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.513907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.513909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.513911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.513912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.513916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.513917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.513902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1626
2025-10-02T09:32:40.513935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.513941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.513946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.513974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1626
2025-10-02T09:32:40.513988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.513993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.514006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|845af253-17597b51-447cb9c4-618a44e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.514012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.514014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.514015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.514021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.514027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.514036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.514140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.514147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.514156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.514209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1627 partition: 0 MaxSeqNo: 36 sessionId: src_id|845af253-17597b51-447cb9c4-618a44e7_0
2025-10-02T09:32:40.514461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea24394-72bd315d-6893a0d8-f00db730_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|845af253-17597b51-447cb9c4-618a44e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.517270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Write session: try to update token
2025-10-02T09:32:40.517285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.522883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:40.522894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.522900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.522921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:40.522927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:40.523110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:40.523245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:40.523377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:40.523505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:40.523676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:40.523702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:40.530403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId: src_id|845af253-17597b51-447cb9c4-618a44e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.531765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.531779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.531780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.531781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.531787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.531789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.531791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882151464:9704]
2025-10-02T09:32:40.531813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.531819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.531819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.531820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.531824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.531829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.532052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.532692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.593469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957698610:3127]
2025-10-02T09:32:40.593659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1626, pipe: [1:7556554981957698610:3127]
2025-10-02T09:32:40.643149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.643529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.643537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.643554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698610:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.643796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.643777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:40.643789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:40.643803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957698610:3127]
2025-10-02T09:32:40.643823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.643847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1627 reason: error at write: Disconnected sessionId: src_id|845af253-17597b51-447cb9c4-618a44e7_0
2025-10-02T09:32:40.644032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1627 sessionId: src_id|845af253-17597b51-447cb9c4-618a44e7_0 is DEAD
2025-10-02T09:32:40.644236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:40.644252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Write session will restart in 0.008902s
2025-10-02T09:32:40.644301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Write session: Do CDS request
2025-10-02T09:32:40.644307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.654126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.654289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.654373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.654387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1628
2025-10-02T09:32:40.654532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.654568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.654579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.654583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.654918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1628 sessionId:  describe result for acl check
2025-10-02T09:32:40.654942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.654947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.654948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.654951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957698860:2917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.655356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957698860:2917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.655536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.655647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.655654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.655660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.655695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.655804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882151680:9706]
2025-10-02T09:32:40.656198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.656398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.656428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.656638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.656688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.656692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.656693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.656694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.656694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.656695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.656696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.656696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.656697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.656698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.656698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.656699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.656702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.656708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.656711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.656713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.656716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.656718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.656720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.656723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.656725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.656729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.656731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.656733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.656739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.656743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.656747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.656750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.656753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.656756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.656759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.656762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.656764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.656767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.656769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.656773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.656776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.656780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.656783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.656786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.656792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.656796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.656798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.656813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.656816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.656819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.656824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.656828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.656847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.657118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957698860:2917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.662360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957698860:2917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.662369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957698860:2917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.662373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957698860:2917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.662377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.664984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.666793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.666803Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.666805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.666807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.666811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1627 [2:7556554981882151680:9706]
2025-10-02T09:32:40.666818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.666829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.666831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.666833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.666834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.666843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.666849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.666854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.666891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.666896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.666897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.666899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.666901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.666949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.666954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.666960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.666966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.666977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.666992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698611:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.666997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698898:2917], now have 1 active actors on pipe
2025-10-02T09:32:40.667001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.667003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.667004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.667011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.667021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.667026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.667028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.667030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.667032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.667034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.667040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1627
2025-10-02T09:32:40.667040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1627
2025-10-02T09:32:40.667051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.667059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.667061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.667077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.667078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.667096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee900463-56819025-597e6697-23b7a514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.667101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.667103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.667104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.667109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.667116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.667125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.667224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.667229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.667237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.667282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1628 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee900463-56819025-597e6697-23b7a514_0
2025-10-02T09:32:40.667565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845af253-17597b51-447cb9c4-618a44e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee900463-56819025-597e6697-23b7a514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.670319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Write session: try to update token
2025-10-02T09:32:40.670336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.676414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.676427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.676429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.676430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.676438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.676441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.676444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882151674:9706]
2025-10-02T09:32:40.676469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.676470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.676473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.676475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.676478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.676480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.676827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.688873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId: src_id|ee900463-56819025-597e6697-23b7a514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.690938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.743969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957698907:3127]
2025-10-02T09:32:40.744130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1627, pipe: [1:7556554981957698907:3127]
2025-10-02T09:32:40.790093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.790439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.790447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.790460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698907:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.790606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.790662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:40.790664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957698907:3127]
2025-10-02T09:32:40.790679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.790722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1628 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee900463-56819025-597e6697-23b7a514_0
2025-10-02T09:32:40.790883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1628 sessionId: src_id|ee900463-56819025-597e6697-23b7a514_0 is DEAD
2025-10-02T09:32:40.791052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:40.791066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Write session will restart in 0.005155s
2025-10-02T09:32:40.791093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Write session: Do CDS request
2025-10-02T09:32:40.791098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.797218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.797278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.797286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1629
2025-10-02T09:32:40.797417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.797436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.797442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.797445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.797747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1629 sessionId:  describe result for acl check
2025-10-02T09:32:40.797775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.797779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.797781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.797783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957699043:2915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.798137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957699043:2915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.800023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957699043:2915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.800919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.801915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.802081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.802088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.802095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.802111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957699043:2915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.802119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957699043:2915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.802122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957699043:2915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.802125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.802132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.802157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882151902:9709]
2025-10-02T09:32:40.802490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.802655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.802677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.802864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.802892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.802896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.802896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.802897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.802897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.802898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.802898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.802899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.802899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.802900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.802901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.802901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.802904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.802909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.802911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.802914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.802915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.802918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.802919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.802921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.802923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.802925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.802927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.802929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.802932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.802936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.802939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.802942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.802944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.802947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.802949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.802952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.802954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.802957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.802959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.802962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.802964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.802966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.802968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.802971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.802973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.802976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.802978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.802980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.802982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.802986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.802988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.802990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.803006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.810388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.812094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.812103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.812104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.812106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.812109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1628 [2:7556554981882151902:9709]
2025-10-02T09:32:40.812116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.812126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.812128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.812129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.812130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.812139Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.812145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.812149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.812181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.812186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.812187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.812189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.812190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.812225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.812230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.812236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.812242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.812253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.812269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957698908:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.812275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957699192:2915], now have 1 active actors on pipe
2025-10-02T09:32:40.812278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.812279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.812281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.812288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.812295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.812299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.812301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.812303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.812305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.812307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.812298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1628
2025-10-02T09:32:40.812321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.812302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1628
2025-10-02T09:32:40.812322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.812333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.812334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.812335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.812360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.812367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.812369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.812370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.812374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.812382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.812394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.812486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.812491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.812498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.812556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1629 partition: 0 MaxSeqNo: 36 sessionId: src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0
2025-10-02T09:32:40.812861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee900463-56819025-597e6697-23b7a514_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.815704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Write session: try to update token
2025-10-02T09:32:40.815719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.821503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.821515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.821517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.821519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.821524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.821527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.821531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882151897:9709]
2025-10-02T09:32:40.821556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.821558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.821561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.821563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.821564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.821566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.821681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.828844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId: src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.830988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:40.890920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554981957699210:3127]
2025-10-02T09:32:40.891167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1628, pipe: [1:7556554981957699210:3127]
2025-10-02T09:32:40.933603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:40.933887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.933897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.933909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957699210:3127], now have 1 active actors on pipe
2025-10-02T09:32:40.934057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:40.934074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:40.934109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:40.934164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1629 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0
2025-10-02T09:32:40.934169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554981957699210:3127]
2025-10-02T09:32:40.934286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1629 sessionId: src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0 is DEAD
2025-10-02T09:32:40.934421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:40.934437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Write session will restart in 0.006791s
2025-10-02T09:32:40.934461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Write session: Do CDS request
2025-10-02T09:32:40.934466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:40.942182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.942360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:40.942367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1630
2025-10-02T09:32:40.942484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:40.942505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:40.942510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:40.942512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:40.942893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1630 sessionId:  describe result for acl check
2025-10-02T09:32:40.942917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:40.942922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:40.942923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:40.942926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554981957699474:2910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:40.943282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554981957699474:2910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:40.943584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:40.944533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554981957699474:2910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:40.944791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:40.944914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:40.944921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:40.944927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:40.944956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:40.944983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554981882152114:9711]
2025-10-02T09:32:40.945325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:40.945484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:40.945506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:40.945683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:40.945712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.945716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.945716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.945717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.945718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.945718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.945719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.945719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.945720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.945720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.945721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.945721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.945724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.945730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.945732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.945734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.945736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.945738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.945740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.945742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.945743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.945746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.945748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.945749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.945753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.945758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:40.945761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.945764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:40.945766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.945768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:40.945771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.945773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:40.945777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.945780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:40.945782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.945785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:40.945787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.945790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:40.945792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.945795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:40.945797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.945799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:40.945801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.945804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.945807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.945814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.945816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.945819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.945835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:40.949645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554981957699474:2910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:40.949653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554981957699474:2910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:40.949657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554981957699474:2910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:40.949661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:40.953297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:40.954829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:40.954838Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:40.954839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:40.954841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:40.954844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1629 [2:7556554981882152114:9711]
2025-10-02T09:32:40.954852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:40.954862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:40.954864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.954865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.954866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.954876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:40.954879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:40.954883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:40.954913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.954918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.954919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.954921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:40.954922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:40.954959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:40.954964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.954969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:40.954974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:40.954983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:40.954996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957699516:2910], now have 1 active actors on pipe
2025-10-02T09:32:40.955001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554981957699226:2446], now have 1 active actors on pipe
2025-10-02T09:32:40.955005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.955010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.955011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.955019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:40.955026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:40.955036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:40.955021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1629
2025-10-02T09:32:40.955036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:40.955044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1629
2025-10-02T09:32:40.955039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:40.955040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:40.955040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:40.955062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.955067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.955077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.955084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:40.955096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:40.955103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13a57b0-964f6a87-4b280128-f8623add_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:40.955107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:40.955109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:40.955110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:40.955115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:40.955124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:40.955138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.955228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:40.955232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:40.955240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:40.955287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1630 partition: 0 MaxSeqNo: 36 sessionId: src_id|13a57b0-964f6a87-4b280128-f8623add_0
2025-10-02T09:32:40.955550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9b903e-5b2644c0-722d296f-848f6e4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13a57b0-964f6a87-4b280128-f8623add_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:40.958359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Write session: try to update token
2025-10-02T09:32:40.958375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:40.964295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:40.964305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:40.964307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:40.964309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:40.964313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.964316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.964319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554981882152109:9711]
2025-10-02T09:32:40.964340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:40.964345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:40.964347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:40.964348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:40.964350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:40.964350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:40.964484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:40.972496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId: src_id|13a57b0-964f6a87-4b280128-f8623add_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:40.974675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.034277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252666820:3127]
2025-10-02T09:32:41.034456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1629, pipe: [1:7556554986252666820:3127]
2025-10-02T09:32:41.076537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.076900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.076909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.076923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252666820:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.077048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.077095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252666820:3127]
2025-10-02T09:32:41.077103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.077120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:41.077171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1630 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13a57b0-964f6a87-4b280128-f8623add_0
2025-10-02T09:32:41.077310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1630 sessionId: src_id|13a57b0-964f6a87-4b280128-f8623add_0 is DEAD
2025-10-02T09:32:41.077462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:41.077476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Write session will restart in 0.006910s
2025-10-02T09:32:41.077502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Write session: Do CDS request
2025-10-02T09:32:41.077507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.085157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.085247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.085255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1631
2025-10-02T09:32:41.085393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.085413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.085418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.085421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.085681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1631 sessionId:  describe result for acl check
2025-10-02T09:32:41.085699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.085703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.085705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.085709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252667066:2901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.086067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252667066:2901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.086878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.087459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252667066:2901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.087960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.088077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.088084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.088090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.088121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.088144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177119625:9714]
2025-10-02T09:32:41.088480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.088654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.088676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.088861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.088891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.088895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.088896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.088896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.088897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.088897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.088898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.088899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.088899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.088899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.088900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.088900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.088903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.088909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.088911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.088914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.088916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.088918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.088920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.088921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.088923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.088927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.088929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.088931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.088934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.088938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.088941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.088944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.088947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.088950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.088952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.088955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.088957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.088960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.088962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.088965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.088967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.088973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.088975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.088978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.088983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.088986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.088988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.088991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.088993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.088995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.088998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.089002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.089020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.089442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252667066:2901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.089452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252667066:2901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.089455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252667066:2901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.089459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.096436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.097943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.097953Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.097954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.097956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.097959Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1630 [2:7556554986177119625:9714]
2025-10-02T09:32:41.097966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.097976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.097980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.097982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.097983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.097992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.097997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.098001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.098031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.098035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.098036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.098038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.098039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.098081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.098085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.098092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.098097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.098108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.098122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667112:2901], now have 1 active actors on pipe
2025-10-02T09:32:41.098127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252666821:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.098130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.098131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.098132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.098139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.098150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.098152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.098154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.098155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.098160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.098161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.098159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1630
2025-10-02T09:32:41.098174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.098174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1630
2025-10-02T09:32:41.098179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.098181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.098189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.098193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.098218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.098224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.098227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.098228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.098232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.098237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.098246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.098331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.098336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.098343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.098395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1631 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0
2025-10-02T09:32:41.098674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a57b0-964f6a87-4b280128-f8623add_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.101403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Write session: try to update token
2025-10-02T09:32:41.101418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.107555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.107570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.107572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.107573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.107579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.107583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.107588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177119620:9714]
2025-10-02T09:32:41.107611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.107614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.107614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.107616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.107618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.107619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.107750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.114852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId: src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.117020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.177137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252667119:3127]
2025-10-02T09:32:41.177324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1630, pipe: [1:7556554986252667119:3127]
2025-10-02T09:32:41.223603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.223881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.223890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.223903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667119:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.224045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.224064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252667119:3127]
2025-10-02T09:32:41.224082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.224084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:41.224087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:41.224144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1631 reason: error at write: Disconnected sessionId: src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0
2025-10-02T09:32:41.224291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1631 sessionId: src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0 is DEAD
2025-10-02T09:32:41.224457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:41.224472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Write session will restart in 0.005471s
2025-10-02T09:32:41.224495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Write session: Do CDS request
2025-10-02T09:32:41.224500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.231230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.231320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.231327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1632
2025-10-02T09:32:41.231442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.231462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.231468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.231470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.231738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1632 sessionId:  describe result for acl check
2025-10-02T09:32:41.231760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.231765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.231766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.231768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252667296:2896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.232145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252667296:2896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.234064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252667296:2896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.234310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.235458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.235632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.235642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.235649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.235689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.235712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177119840:9716]
2025-10-02T09:32:41.235833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252667296:2896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.235841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252667296:2896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.235843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252667296:2896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.235847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.236050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.236249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.236273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.236443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.236470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.236474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.236475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.236475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.236476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.236476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.236477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.236477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.236478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.236478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.236479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.236479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.236482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.236488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.236491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.236493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.236495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.236497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.236499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.236500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.236502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.236504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.236506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.236508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.236511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.236515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.236519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.236522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.236524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.236526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.236528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.236531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.236534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.236536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.236538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.236541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.236543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.236545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.236547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.236550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.236553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.236556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.236559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.236561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.236563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.236566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.236569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.236571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.236587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.243964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.245628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.245637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.245638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.245641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.245644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1631 [2:7556554986177119840:9716]
2025-10-02T09:32:41.245650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.245659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.245661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.245662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.245664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.245673Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.245679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.245684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.245714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.245719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.245720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.245722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.245723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.245761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.245766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.245772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.245778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.245789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.245804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667411:2896], now have 1 active actors on pipe
2025-10-02T09:32:41.245809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667123:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.245813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.245818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.245819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.245827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.245837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.245838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.245840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.245841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.245847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.245832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1631
2025-10-02T09:32:41.245849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.245845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1631
2025-10-02T09:32:41.245867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.245872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.245877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.245881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.245882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.245905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d317d857-3446a916-32fc87a2-70d50d6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.245911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.245914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.245915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.245919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.245927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.245939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.246023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.246028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.246035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.246087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1632 partition: 0 MaxSeqNo: 36 sessionId: src_id|d317d857-3446a916-32fc87a2-70d50d6b_0
2025-10-02T09:32:41.246359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba38172-2ae28e81-7a24ac53-2455b012_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d317d857-3446a916-32fc87a2-70d50d6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.249245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Write session: try to update token
2025-10-02T09:32:41.249260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.255103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.255115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.255116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.255118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.255124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.255127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.255130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177119833:9716]
2025-10-02T09:32:41.255151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.255155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.255158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.255159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.255160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.255161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.255288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.262197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId: src_id|d317d857-3446a916-32fc87a2-70d50d6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.264316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.324073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252667444:3127]
2025-10-02T09:32:41.324203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1631, pipe: [1:7556554986252667444:3127]
2025-10-02T09:32:41.370406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.370732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.370741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.370762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667444:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.370922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.370962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:41.370964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:41.371010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1632 reason: error at write: Disconnected sessionId: src_id|d317d857-3446a916-32fc87a2-70d50d6b_0
2025-10-02T09:32:41.371098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252667444:3127]
2025-10-02T09:32:41.371155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1632 sessionId: src_id|d317d857-3446a916-32fc87a2-70d50d6b_0 is DEAD
2025-10-02T09:32:41.371267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:41.371275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Write session will restart in 0.006984s
2025-10-02T09:32:41.371291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Write session: Do CDS request
2025-10-02T09:32:41.371295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.371769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.379240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.379271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.379278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1633
2025-10-02T09:32:41.379433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.379454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.379460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.379463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.379720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1633 sessionId:  describe result for acl check
2025-10-02T09:32:41.379743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.379747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.379748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.379752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252667697:2882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.380122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252667697:2882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.380372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.381527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.381668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.381675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.381681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.381711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.381735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177120090:9731]
2025-10-02T09:32:41.381807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252667697:2882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.382071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.382231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.382253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.382429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.382459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.382463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.382464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.382464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.382465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.382466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.382466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.382467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.382467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.382468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.382468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.382469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.382471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.382477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.382479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.382481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.382483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.382485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.382487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.382489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.382491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.382493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.382495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.382497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.382501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.382506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.382510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.382513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.382515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.382518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.382520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.382523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.382526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.382528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.382530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.382533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.382535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.382538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.382540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.382542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.382548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.382551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.382554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.382559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.382561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.382564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.382567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.382570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.382585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.386367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252667697:2882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.386374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252667697:2882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.386376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252667697:2882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.386379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.390000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.391538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.391548Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.391549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.391551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.391555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1632 [2:7556554986177120090:9731]
2025-10-02T09:32:41.391562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.391571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.391576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.391578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.391579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.391587Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.391593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.391597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.391628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.391632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.391633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.391635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.391636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.391678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.391683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.391690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.391695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.391706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.391720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667738:2882], now have 1 active actors on pipe
2025-10-02T09:32:41.391725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667446:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.391729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.391733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.391735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.391742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.391750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.391754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.391756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.391757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.391760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.391762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.391753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1632
2025-10-02T09:32:41.391754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1632
2025-10-02T09:32:41.391775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.391780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.391781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.391790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.391795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.391823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|333371a7-78294470-75d7a6c0-7b47690e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.391830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.391832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.391833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.391838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.391843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.391856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.391936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.391941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.391949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.392010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1633 partition: 0 MaxSeqNo: 36 sessionId: src_id|333371a7-78294470-75d7a6c0-7b47690e_0
2025-10-02T09:32:41.392272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d317d857-3446a916-32fc87a2-70d50d6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|333371a7-78294470-75d7a6c0-7b47690e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.394998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Write session: try to update token
2025-10-02T09:32:41.395014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.401017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.401029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.401031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.401032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.401037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.401040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.401043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177120085:9731]
2025-10-02T09:32:41.401062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.401065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.401066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.401067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.401071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.401073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.401241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.407158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId: src_id|333371a7-78294470-75d7a6c0-7b47690e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.409356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.471024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252667746:3127]
2025-10-02T09:32:41.471218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1632, pipe: [1:7556554986252667746:3127]
2025-10-02T09:32:41.513773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.514122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.514131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.514144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667746:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.514309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:41.514318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:41.514367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1633 reason: error at write: Disconnected sessionId: src_id|333371a7-78294470-75d7a6c0-7b47690e_0
2025-10-02T09:32:41.514460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.514498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252667746:3127]
2025-10-02T09:32:41.514509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1633 sessionId: src_id|333371a7-78294470-75d7a6c0-7b47690e_0 is DEAD
2025-10-02T09:32:41.514624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:41.514633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Write session will restart in 0.009702s
2025-10-02T09:32:41.514648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Write session: Do CDS request
2025-10-02T09:32:41.514655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.515279Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.524209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.525248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.525291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.525357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.525364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.525370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.525397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.525423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177120307:9733]
2025-10-02T09:32:41.525414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.525423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1634
2025-10-02T09:32:41.525546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.525565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.525571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.525574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.525772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.525837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1634 sessionId:  describe result for acl check
2025-10-02T09:32:41.525861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.525866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.525867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.525870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252668004:2872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.525929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.525951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.526126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.526156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.526160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.526161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.526161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.526162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.526162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.526163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.526163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.526164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.526164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.526165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.526165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.526168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.526174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.526177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.526179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.526180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.526182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.526184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.526186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.526188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.526191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.526193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.526195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.526199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.526202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.526206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.526209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.526211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.526213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.526216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.526218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.526220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.526223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.526225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.526228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.526230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.526233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.526235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.526237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.526240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.526242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.526236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252668004:2872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.526244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.526247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.526249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.526253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.526255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.526257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.526274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.527719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252668004:2872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.531576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252668004:2872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.531585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252668004:2872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.531588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252668004:2872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.531592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.533754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.535530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.535541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.535542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.535544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.535548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1633 [2:7556554986177120307:9733]
2025-10-02T09:32:41.535556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.535566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.535567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.535569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.535570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.535580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.535585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.535589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.535621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.535626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.535627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.535629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.535630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.535670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.535675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.535682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.535687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.535695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.535709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.535713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.535714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.535718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.535725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.535727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.535727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252667748:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.535729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.535730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668041:2872], now have 1 active actors on pipe
2025-10-02T09:32:41.535734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.535742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.535745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.535762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.535770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.535781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.535793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1633
2025-10-02T09:32:41.535810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1633
2025-10-02T09:32:41.535869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.535875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.535897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.535904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.535907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.535908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.535914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.535922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.535929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.536025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.536031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.536040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.536094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1634 partition: 0 MaxSeqNo: 36 sessionId: src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0
2025-10-02T09:32:41.536367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333371a7-78294470-75d7a6c0-7b47690e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.539138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Write session: try to update token
2025-10-02T09:32:41.539153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.544878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:41.544890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.544895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.544920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:41.544923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:41.545657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:41.545810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:41.545949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:41.546085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:41.546275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:41.546306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:41.553451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.553462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.553463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.553464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.553468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.553470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.553473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177120302:9733]
2025-10-02T09:32:41.553492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.553494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.553496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.553499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.553500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.553501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.553620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.554090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId: src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.556273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.614892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252668051:3127]
2025-10-02T09:32:41.615082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1633, pipe: [1:7556554986252668051:3127]
2025-10-02T09:32:41.665398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.665607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.665616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.665629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668051:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.665782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252668051:3127]
2025-10-02T09:32:41.665803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.665803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.665807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:41.665810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:41.665859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1634 reason: error at write: Disconnected sessionId: src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0
2025-10-02T09:32:41.666005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1634 sessionId: src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0 is DEAD
2025-10-02T09:32:41.666195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:41.666211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Write session will restart in 0.007648s
2025-10-02T09:32:41.666258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Write session: Do CDS request
2025-10-02T09:32:41.666264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.675195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.675276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.675285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1635
2025-10-02T09:32:41.675430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.675449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.675455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.675458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.675721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1635 sessionId:  describe result for acl check
2025-10-02T09:32:41.675749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.675754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.675755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.675759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252668307:2868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.675886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.676113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252668307:2868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.677028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.677139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.677146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.677152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.677182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.677210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177120523:9735]
2025-10-02T09:32:41.677544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.677681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252668307:2868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.677695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.677715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.677888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.677916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.677920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.677921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.677921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.677922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.677922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.677923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.677923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.677924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.677924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.677925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.677925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.677928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.677934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.677936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.677938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.677940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.677942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.677944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.677946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.677948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.677950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.677952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.677954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.677957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.677961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.677964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.677967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.677969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.677972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.677974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.677976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.677979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.677981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.677983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.677986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.677988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.677991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.677993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.677998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.678000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.678002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.678005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.678007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.678010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.678012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.678016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.678019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.678035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.681841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252668307:2868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.681849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252668307:2868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.681851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252668307:2868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.681855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.685461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.686992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.687002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.687003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.687005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.687008Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1634 [2:7556554986177120523:9735]
2025-10-02T09:32:41.687016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.687026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.687031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.687033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.687034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.687043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.687048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.687052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.687084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.687089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.687090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.687092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.687093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.687131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.687135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.687141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.687146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.687154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.687168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668348:2868], now have 1 active actors on pipe
2025-10-02T09:32:41.687173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668052:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.687177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.687178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.687179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.687188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.687198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.687199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.687201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.687202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.687209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.687210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.687224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.687229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.687231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.687208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1634
2025-10-02T09:32:41.687238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.687213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1634
2025-10-02T09:32:41.687242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.687348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.687356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.687358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.687359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.687365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.687370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.687384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.687474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.687480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.687491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.687545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1635 partition: 0 MaxSeqNo: 36 sessionId: src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0
2025-10-02T09:32:41.687756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b31d54-f356610a-c7f21ad2-7e37feff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.690294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Write session: try to update token
2025-10-02T09:32:41.690304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.696650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.696666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.696668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.696670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.696677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.696680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.696684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177120518:9735]
2025-10-02T09:32:41.696712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.696712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.696715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.696717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.696722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.696724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.696872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.703065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId: src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.705215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.765914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252668355:3127]
2025-10-02T09:32:41.766075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1634, pipe: [1:7556554986252668355:3127]
2025-10-02T09:32:41.811185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.811531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.811544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.811559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668355:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.811734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.811760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252668355:3127]
2025-10-02T09:32:41.811770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:41.811772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:41.811840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1635 reason: error at write: Disconnected sessionId: src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0
2025-10-02T09:32:41.811986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1635 sessionId: src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0 is DEAD
2025-10-02T09:32:41.812094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:41.812103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Write session will restart in 0.008296s
2025-10-02T09:32:41.812121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Write session: Do CDS request
2025-10-02T09:32:41.812140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.812277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.821201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.821340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.821450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.821460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1636
2025-10-02T09:32:41.821552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.821572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.821579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.821582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.821842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1636 sessionId:  describe result for acl check
2025-10-02T09:32:41.821865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.821869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.821870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.821873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252668616:2863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.822269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252668616:2863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.822381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.822476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.822482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.822488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.822513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.822547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177120754:9738]
2025-10-02T09:32:41.822896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.823057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.823081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.823265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.823294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.823297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.823298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.823299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.823299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.823300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.823300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.823301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.823301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.823302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.823302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.823303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.823305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.823311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.823313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.823315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.823317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.823320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.823322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.823323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.823326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.823328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.823330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.823332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.823335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.823339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.823342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.823345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.823347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.823350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.823352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.823355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.823360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.823363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.823365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.823367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.823372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.823377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.823380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.823382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.823389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.823392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.823394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.823398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.823403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.823406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.823408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.823410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.823426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.823602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252668616:2863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.828233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252668616:2863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.828244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252668616:2863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.828246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252668616:2863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.828251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.830856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.832394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.832404Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.832405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.832408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.832411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1635 [2:7556554986177120754:9738]
2025-10-02T09:32:41.832419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.832429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.832430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.832432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.832433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.832443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.832448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.832453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.832484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.832489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.832490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.832492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.832493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.832528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.832533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.832540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.832545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.832556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.832572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668655:2863], now have 1 active actors on pipe
2025-10-02T09:32:41.832577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668356:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.832581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.832582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.832583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.832590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.832600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1635
2025-10-02T09:32:41.832603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1635
2025-10-02T09:32:41.832600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.832604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.832606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.832607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.832610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.832612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.832626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.832628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.832629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.832638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.832642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.832670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.832676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.832679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.832680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.832685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.832693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.832702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.832788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.832793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.832813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.832893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1636 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0
2025-10-02T09:32:41.833143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4334a6b3-52cd3643-a90c9701-1fbc4768_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.836011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Write session: try to update token
2025-10-02T09:32:41.836027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.841832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.841844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.841846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.841847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.841853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.841856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.841860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177120749:9738]
2025-10-02T09:32:41.841882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.841886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.841890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.841891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.841893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.841894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.842055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.848887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId: src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.851050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:41.911846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554986252668680:3127]
2025-10-02T09:32:41.911996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1635, pipe: [1:7556554986252668680:3127]
2025-10-02T09:32:41.955514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:41.955713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.955721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.955732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668680:3127], now have 1 active actors on pipe
2025-10-02T09:32:41.955885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:41.955887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:41.955912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554986252668680:3127]
2025-10-02T09:32:41.955918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:41.955920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:41.955966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1636 reason: error at write: Disconnected sessionId: src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0
2025-10-02T09:32:41.956090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1636 sessionId: src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0 is DEAD
2025-10-02T09:32:41.956204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:41.956218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Write session will restart in 0.007940s
2025-10-02T09:32:41.956251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Write session: Do CDS request
2025-10-02T09:32:41.956257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:41.965164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.965286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:41.965294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1637
2025-10-02T09:32:41.965409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:41.965430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:41.965435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:41.965438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:41.965649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:41.965694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1637 sessionId:  describe result for acl check
2025-10-02T09:32:41.965714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:41.965718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:41.965719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:41.965722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554986252668942:2851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:41.966052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554986252668942:2851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:41.966822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:41.966922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:41.966928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:41.966934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:41.966960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:41.966984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554986177120973:9740]
2025-10-02T09:32:41.967327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:41.967486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:41.967507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:41.967608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554986252668942:2851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:41.967681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:41.967711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.967715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.967716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.967716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.967717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.967717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.967718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.967719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.967719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.967720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.967720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.967721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.967723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.967729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.967731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.967733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.967735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.967737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.967739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.967741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.967743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.967745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.967747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.967749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.967752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.967757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:41.967760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.967763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:41.967765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.967768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:41.967770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.967773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:41.967775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.967777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:41.967780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.967782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:41.967784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.967787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:41.967790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.967793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:41.967795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.967798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:41.967800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.967803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.967805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.967807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.967813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.967816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.967833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:41.972596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554986252668942:2851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:41.972605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554986252668942:2851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:41.972607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554986252668942:2851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:41.972611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:41.975262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:41.976902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:41.976911Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:41.976912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:41.976914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:41.976918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1636 [2:7556554986177120973:9740]
2025-10-02T09:32:41.976925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:41.976935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:41.976941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.976943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.976944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.976953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:41.976957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:41.976964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:41.976996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.977001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.977001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.977004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:41.977005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:41.977043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:41.977048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.977054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:41.977059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:41.977070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:41.977084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668979:2851], now have 1 active actors on pipe
2025-10-02T09:32:41.977089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554986252668685:2446], now have 1 active actors on pipe
2025-10-02T09:32:41.977093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.977096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.977097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.977104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:41.977114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:41.977116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:41.977118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:41.977119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:41.977125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:41.977126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:41.977139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1636
2025-10-02T09:32:41.977142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1636
2025-10-02T09:32:41.977142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.977149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:41.977159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:41.977168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.977170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.977186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fcee0aa-b3c133cc-18728484-503ab595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:41.977191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:41.977197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:41.977198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:41.977203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:41.977208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:41.977215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.977332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:41.977338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:41.977347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:41.977413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1637 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fcee0aa-b3c133cc-18728484-503ab595_0
2025-10-02T09:32:41.977657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1233437-e7bd8a51-3fb792c4-beca7726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fcee0aa-b3c133cc-18728484-503ab595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:41.980108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Write session: try to update token
2025-10-02T09:32:41.980119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:41.986538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:41.986554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:41.986557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:41.986559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:41.986566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.986570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.986573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554986177120968:9740]
2025-10-02T09:32:41.986603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:41.986604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:41.986608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:41.986610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:41.986613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:41.986615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:41.986743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:41.992219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId: src_id|5fcee0aa-b3c133cc-18728484-503ab595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:41.994445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.056231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547636283:3127]
2025-10-02T09:32:42.056408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1636, pipe: [1:7556554990547636283:3127]
2025-10-02T09:32:42.098248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.098565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.098574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.098586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636283:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.098731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.098794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:42.098798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.098828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547636283:3127]
2025-10-02T09:32:42.098857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5fcee0aa-b3c133cc-18728484-503ab595_0
2025-10-02T09:32:42.099008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1637 sessionId: src_id|5fcee0aa-b3c133cc-18728484-503ab595_0 is DEAD
2025-10-02T09:32:42.099128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:42.099136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Write session will restart in 0.008167s
2025-10-02T09:32:42.099156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Write session: Do CDS request
2025-10-02T09:32:42.099160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.108222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.108320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.108330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1638
2025-10-02T09:32:42.108419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.108449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.108468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.108474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.108477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.108741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1638 sessionId:  describe result for acl check
2025-10-02T09:32:42.108764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.108768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.108769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.108772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547636543:2846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.109127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547636543:2846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.109561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.109660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.109668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.109675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.109710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.109735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472088491:9743]
2025-10-02T09:32:42.110073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.110228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.110250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.110299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547636543:2846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.110423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.110452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.110456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.110456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.110457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.110457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.110458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.110458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.110459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.110460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.110460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.110461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.110461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.110464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.110469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.110471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.110473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.110476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.110478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.110480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.110482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.110484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.110486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.110488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.110489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.110493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.110496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.110500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.110503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.110505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.110508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.110510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.110513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.110515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.110517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.110520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.110524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.110527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.110529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.110532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.110534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.110537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.110539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.110542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.110544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.110546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.110550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.110552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.110569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.114350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547636543:2846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.114359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547636543:2846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.114361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547636543:2846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.114364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.117950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.119386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.119396Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.119397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.119399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.119402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1637 [2:7556554990472088491:9743]
2025-10-02T09:32:42.119410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.119419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.119421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.119422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.119423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.119433Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.119437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.119441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.119478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.119483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.119484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.119487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.119488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.119523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.119528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.119535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.119540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.119549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.119563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636284:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.119568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636582:2846], now have 1 active actors on pipe
2025-10-02T09:32:42.119572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.119574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.119575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.119582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.119591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.119594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.119596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.119597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.119600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.119602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.119615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.119620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.119608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1637
2025-10-02T09:32:42.119622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.119614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1637
2025-10-02T09:32:42.119640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.119646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.119661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54d7c589-322ddd07-9ef198be-9900ed93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.119667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.119671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.119672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.119677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.119685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.119691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.119784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.119789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.119797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.119849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1638 partition: 0 MaxSeqNo: 36 sessionId: src_id|54d7c589-322ddd07-9ef198be-9900ed93_0
2025-10-02T09:32:42.120089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcee0aa-b3c133cc-18728484-503ab595_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54d7c589-322ddd07-9ef198be-9900ed93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.122856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Write session: try to update token
2025-10-02T09:32:42.122872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.128788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.128815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.128816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.128818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.128822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.128826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.128830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472088486:9743]
2025-10-02T09:32:42.128852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.128854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.128857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.128859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.128860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.128863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.129028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.134969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId: src_id|54d7c589-322ddd07-9ef198be-9900ed93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.137144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.199071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547636590:3127]
2025-10-02T09:32:42.199241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1637, pipe: [1:7556554990547636590:3127]
2025-10-02T09:32:42.238997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.239206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.239215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.239227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636590:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.239343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.239424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.239426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547636590:3127]
2025-10-02T09:32:42.239441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:42.239493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1638 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54d7c589-322ddd07-9ef198be-9900ed93_0
2025-10-02T09:32:42.239626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1638 sessionId: src_id|54d7c589-322ddd07-9ef198be-9900ed93_0 is DEAD
2025-10-02T09:32:42.239778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:42.239793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Write session will restart in 0.009010s
2025-10-02T09:32:42.239813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Write session: Do CDS request
2025-10-02T09:32:42.239818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.249384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.250191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.250244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.250253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1639
2025-10-02T09:32:42.250401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.250420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.250425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.250427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.250651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.250703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1639 sessionId:  describe result for acl check
2025-10-02T09:32:42.250726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.250730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.250731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.250734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547636853:2836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.250760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.250767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.250773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.250800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.250823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472088712:9745]
2025-10-02T09:32:42.251074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547636853:2836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.251161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.251308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.251331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.251583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.251619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.251623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.251623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.251624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.251624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.251625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.251625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.251626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.251627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.251627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.251627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.251628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.251631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.251637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.251639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.251641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.251643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.251645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.251647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.251649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.251651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.251653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.251655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.251657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.251661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.251665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.251669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.251672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.251674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.251676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.251678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.251681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.251683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.251686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.251688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.251690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.251693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.251696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.251698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.251700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.251702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.251705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.251707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.251710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.251711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.251714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.251716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.251719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.251735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.252613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547636853:2836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.256010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547636853:2836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.256018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547636853:2836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.256020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547636853:2836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.256023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.259164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.260604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.260615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.260616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.260618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.260622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1638 [2:7556554990472088712:9745]
2025-10-02T09:32:42.260629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.260639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.260643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.260645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.260646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.260655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.260661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.260666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.260697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.260702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.260703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.260705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.260707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.260751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.260756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.260762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.260767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.260779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.260793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636593:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.260799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636891:2836], now have 1 active actors on pipe
2025-10-02T09:32:42.260814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.260819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.260820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.260831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.260842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.260854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.260830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1638
2025-10-02T09:32:42.260854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.260837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1638
2025-10-02T09:32:42.260858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.260858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.260859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.260880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.260886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.260895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.260902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.260910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.260918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.260922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.260927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.260928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.260933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.260938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.260951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.261054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.261059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.261067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.261120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1639 partition: 0 MaxSeqNo: 36 sessionId: src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0
2025-10-02T09:32:42.261341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d7c589-322ddd07-9ef198be-9900ed93_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.263879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Write session: try to update token
2025-10-02T09:32:42.263891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.270280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.270297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.270298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.270300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.270306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.270310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.270313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472088707:9745]
2025-10-02T09:32:42.270341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.270343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.270348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.270349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.270350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.270353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.270528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.276099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId: src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.278184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.339383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547636912:3127]
2025-10-02T09:32:42.339637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1638, pipe: [1:7556554990547636912:3127]
2025-10-02T09:32:42.384129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.384409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.384417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.384442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636912:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.384581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.384620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.384670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547636912:3127]
2025-10-02T09:32:42.385016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:42.385065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0
2025-10-02T09:32:42.385198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1639 sessionId: src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0 is DEAD
2025-10-02T09:32:42.385352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:42.385361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Write session will restart in 0.009933s
2025-10-02T09:32:42.385376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Write session: Do CDS request
2025-10-02T09:32:42.385381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.394165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.395351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.395545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.395552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.395559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.395596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.395621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472088970:9760]
2025-10-02T09:32:42.395965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.396154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.396183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.396178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.396241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.396248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1640
2025-10-02T09:32:42.396357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.396359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.396377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.396383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.396386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.396384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.396389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.396389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.396390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.396390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.396391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.396391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.396392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.396393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.396393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.396396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.396403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.396405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.396407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.396409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.396412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.396413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.396415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.396417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.396419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.396421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.396423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.396428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.396431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.396435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.396438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.396440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.396442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.396444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.396448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.396450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.396453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.396455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.396458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.396460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.396463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.396465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.396467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.396470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.396472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.396474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.396477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.396479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.396481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.396484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.396486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.396503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.396625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1640 sessionId:  describe result for acl check
2025-10-02T09:32:42.396642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.396646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.396647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.396649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547637189:2826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.396989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547637189:2826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.398850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547637189:2826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.402704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547637189:2826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.402711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547637189:2826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.402713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547637189:2826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.402716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.403936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.405387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.405398Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.405399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.405402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.405405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1639 [2:7556554990472088970:9760]
2025-10-02T09:32:42.405412Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.405423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.405424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.405426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.405427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.405436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.405438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.405443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.405472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.405478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.405479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.405481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.405482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.405515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.405520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.405526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.405531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.405541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.405554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637223:2826], now have 1 active actors on pipe
2025-10-02T09:32:42.405560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547636923:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.405564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.405566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.405568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.405575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.405583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.405585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1639
2025-10-02T09:32:42.405587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.405587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1639
2025-10-02T09:32:42.405590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.405592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.405594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.405596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.405604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.405606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.405607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.405621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.405626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.405643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.405649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.405651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.405652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.405657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.405662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.405673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.405761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.405766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.405774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.405825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1640 partition: 0 MaxSeqNo: 36 sessionId: src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0
2025-10-02T09:32:42.405997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce9f79b-feb6bab-e71f83e8-c20371cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.408152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Write session: try to update token
2025-10-02T09:32:42.408161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.414885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.414899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.414901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.414902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.414909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.414913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.414916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472088965:9760]
2025-10-02T09:32:42.414941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.414945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.414950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.414952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.414958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.414960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.415113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.419674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId: src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.421735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.484773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547637230:3127]
2025-10-02T09:32:42.484959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1639, pipe: [1:7556554990547637230:3127]
2025-10-02T09:32:42.526611Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.526905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.526914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.526940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637230:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.527079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.527083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:42.527090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:42.527115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547637230:3127]
2025-10-02T09:32:42.527131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.527135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1640 reason: error at write: Disconnected sessionId: src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0
2025-10-02T09:32:42.527269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1640 sessionId: src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0 is DEAD
2025-10-02T09:32:42.527405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:42.527415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Write session will restart in 0.006097s
2025-10-02T09:32:42.527433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Write session: Do CDS request
2025-10-02T09:32:42.527438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.534161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.534300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.534307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1641
2025-10-02T09:32:42.534422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.534441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.534447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.534450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.534940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1641 sessionId:  describe result for acl check
2025-10-02T09:32:42.534965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.534969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.534970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.534973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547637425:2815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.535314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547637425:2815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.536944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547637425:2815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.537137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.538289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.538394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.538401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.538408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.538435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.538458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472089193:9762]
2025-10-02T09:32:42.538820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.538864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547637425:2815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.538872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547637425:2815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.538874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547637425:2815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.538878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.538972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.538995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.539170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.539320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.539325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.539326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.539326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.539327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.539327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.539328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.539328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.539329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.539329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.539330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.539330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.539334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.539340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.539342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.539344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.539346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.539348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.539350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.539351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.539353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.539356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.539358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.539360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.539364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.539368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.539373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.539376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.539378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.539381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.539386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.539389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.539391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.539394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.539399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.539401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.539403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.539406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.539407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.539410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.539412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.539418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.539420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.539422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.539424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.539427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.539431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.539434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.539451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.546905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.548374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.548385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.548386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.548388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.548391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1640 [2:7556554990472089193:9762]
2025-10-02T09:32:42.548399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.548410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.548415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.548416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.548417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.548427Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.548430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.548434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.548469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.548474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.548475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.548477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.548478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.548516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.548521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.548528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.548533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.548541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.548555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637531:2815], now have 1 active actors on pipe
2025-10-02T09:32:42.548561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637232:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.548564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.548566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.548567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.548575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.548584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.548589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.548591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.548593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.548594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.548596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.548592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1640
2025-10-02T09:32:42.548597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1640
2025-10-02T09:32:42.548612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.548617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.548618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.548628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.548630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.548656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62e50a0c-154a6273-251410dc-2328f975_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.548662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.548664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.548665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.548671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.548678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.548687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.548793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.548797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.548817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.548887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1641 partition: 0 MaxSeqNo: 36 sessionId: src_id|62e50a0c-154a6273-251410dc-2328f975_0
2025-10-02T09:32:42.549105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d04699c8-dc54ee2f-26b54325-2dc5dd92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62e50a0c-154a6273-251410dc-2328f975_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.551268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Write session: try to update token
2025-10-02T09:32:42.551279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.557936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.557949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.557951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.557952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.557957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.557959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.557961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472089188:9762]
2025-10-02T09:32:42.557982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.557985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.557987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.557987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.557990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.557992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.558100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.562696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId: src_id|62e50a0c-154a6273-251410dc-2328f975_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.564751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.627129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547637540:3127]
2025-10-02T09:32:42.627325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1640, pipe: [1:7556554990547637540:3127]
2025-10-02T09:32:42.670200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.670628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.670637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.670665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637540:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.670815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.670841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:42.670854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:42.670862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547637540:3127]
2025-10-02T09:32:42.670877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.670907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1641 reason: error at write: Disconnected sessionId: src_id|62e50a0c-154a6273-251410dc-2328f975_0
2025-10-02T09:32:42.671049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1641 sessionId: src_id|62e50a0c-154a6273-251410dc-2328f975_0 is DEAD
2025-10-02T09:32:42.671183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:42.671191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Write session will restart in 0.008059s
2025-10-02T09:32:42.671206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Write session: Do CDS request
2025-10-02T09:32:42.671210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.680161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.680219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.680228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1642
2025-10-02T09:32:42.680305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.680325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.680331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.680334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.680389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.680592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1642 sessionId:  describe result for acl check
2025-10-02T09:32:42.680626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.680630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.680631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.680635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547637803:2809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.680984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547637803:2809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.681958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.682076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.682085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.682094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.682126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.682154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472089417:9764]
2025-10-02T09:32:42.682303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547637803:2809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.682564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.682723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.682756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.682948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.682982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.682986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.682987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.682987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.682988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.682988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.682989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.682989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.682990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.682991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.682991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.682992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.682995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.683000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.683003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.683005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.683006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.683008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.683010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.683012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.683014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.683016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.683018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.683020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.683024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.683027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.683030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.683033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.683035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.683038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.683041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.683047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.683049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.683052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.683054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.683057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.683059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.683062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.683064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.683067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.683071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.683074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.683077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.683079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.683082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.683084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.683086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.683111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.686869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547637803:2809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.686876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547637803:2809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.686878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547637803:2809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.686882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.690515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.692141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.692152Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.692153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.692156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.692159Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1641 [2:7556554990472089417:9764]
2025-10-02T09:32:42.692165Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.692174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.692179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.692181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.692182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.692190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.692193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.692197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.692229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.692233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.692234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.692236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.692237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.692273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.692278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.692285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.692290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.692301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.692318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637541:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.692325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637844:2809], now have 1 active actors on pipe
2025-10-02T09:32:42.692330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.692335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.692337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.692348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.692360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1641
2025-10-02T09:32:42.692361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1641
2025-10-02T09:32:42.692358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.692360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.692366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.692367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.692368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.692369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.692383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.692385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.692387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.692401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.692406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.692424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.692431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.692433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.692434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.692439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.692444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.692455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.692553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.692558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.692565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.692623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1642 partition: 0 MaxSeqNo: 36 sessionId: src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0
2025-10-02T09:32:42.692923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e50a0c-154a6273-251410dc-2328f975_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.695093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Write session: try to update token
2025-10-02T09:32:42.695104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.701654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.701667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.701669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.701670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.701676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.701678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.701680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472089412:9764]
2025-10-02T09:32:42.701703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.701703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.701708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.701710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.701711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.701714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.701872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.706657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId: src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.708742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.770970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547637851:3127]
2025-10-02T09:32:42.771143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1641, pipe: [1:7556554990547637851:3127]
2025-10-02T09:32:42.815505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.815848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.815857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.815882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637851:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.816074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.816077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547637851:3127]
2025-10-02T09:32:42.816093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:42.816095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:42.816135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1642 reason: error at write: Disconnected sessionId: src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0
2025-10-02T09:32:42.816269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1642 sessionId: src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0 is DEAD
2025-10-02T09:32:42.816287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.816391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:42.816401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Write session will restart in 0.009427s
2025-10-02T09:32:42.816430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Write session: Do CDS request
2025-10-02T09:32:42.816434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.826331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.827128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.827195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.827203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1643
2025-10-02T09:32:42.827300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.827320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.827326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.827329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.827473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.827565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1643 sessionId:  describe result for acl check
2025-10-02T09:32:42.827582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.827586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.827588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.827590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547638119:2804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.827582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.827590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.827596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.827623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.827646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472089654:9767]
2025-10-02T09:32:42.827925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547638119:2804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.828019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.828183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.828210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.828488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.828539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.828544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.828544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.828545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.828545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.828546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.828546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.828547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.828548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.828548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.828549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.828549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.828552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.828558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.828560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.828562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.828564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.828566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.828568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.828570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.828572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.828574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.828576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.828578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.828582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.828586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.828589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.828592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.828594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.828597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.828599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.828602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.828604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.828607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.828609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.828612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.828614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.828617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.828619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.828622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.828625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.828628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.828631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.828633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.828635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.828638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.828640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.828643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.828658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.829223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547638119:2804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.833542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547638119:2804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.833550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547638119:2804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.833553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547638119:2804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.833556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.836223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.837810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.837822Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.837823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.837825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.837828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1642 [2:7556554990472089654:9767]
2025-10-02T09:32:42.837835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.837845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.837850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.837852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.837853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.837860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.837864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.837869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.837900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.837905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.837906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.837908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.837909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.838015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1642
2025-10-02T09:32:42.838021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1642
2025-10-02T09:32:42.838040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.838046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.838053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.838059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.838067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.838082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547638160:2804], now have 1 active actors on pipe
2025-10-02T09:32:42.838087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547637855:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.838098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.838103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.838112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.838116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.838117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.838125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.838136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.838137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.838139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.838140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.838146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.838148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.838158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.838165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.838167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.838168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.838174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.838180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.838197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.838204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.838209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.838211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.838295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.838300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.838308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.838358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1643 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0
2025-10-02T09:32:42.838551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3573bd3d-a8933e57-7974e1cf-b4cdaaf7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.840719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Write session: try to update token
2025-10-02T09:32:42.840728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.847467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.847482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.847484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.847485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.847490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.847493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.847497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472089649:9767]
2025-10-02T09:32:42.847518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.847521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.847522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.847524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.847529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.847531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.847627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.852408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId: src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.854579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:42.916406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554990547638183:3127]
2025-10-02T09:32:42.916555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1642, pipe: [1:7556554990547638183:3127]
2025-10-02T09:32:42.960302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:42.960593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.960604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.960632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547638183:3127], now have 1 active actors on pipe
2025-10-02T09:32:42.960776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:42.960824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554990547638183:3127]
2025-10-02T09:32:42.960839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:42.960846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:42.960902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1643 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0
2025-10-02T09:32:42.961045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1643 sessionId: src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0 is DEAD
2025-10-02T09:32:42.961165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:42.961174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Write session will restart in 0.008218s
2025-10-02T09:32:42.961190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Write session: Do CDS request
2025-10-02T09:32:42.961195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:42.970129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.970242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:42.970251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1644
2025-10-02T09:32:42.970332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:42.970351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:42.970357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:42.970359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:42.970624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1644 sessionId:  describe result for acl check
2025-10-02T09:32:42.970647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:42.970652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:42.970652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:42.970655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554990547638450:2800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:42.971002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554990547638450:2800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:42.970994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:42.972301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:42.972484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:42.972492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:42.972499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:42.972535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:42.972557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554990472089880:9769]
2025-10-02T09:32:42.972574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554990547638450:2800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:42.972926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:42.973097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:42.973125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:42.973320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:42.973351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.973355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.973356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.973356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.973357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.973357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.973358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.973358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.973359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.973359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.973360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.973360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.973363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.973369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.973371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.973373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.973375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.973377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.973379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.973381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.973383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.973386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.973388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.973390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.973393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.973399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:42.973404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.973408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:42.973412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.973420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:42.973427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.973430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:42.973432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.973438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:42.973441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.973446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:42.973449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.973452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:42.973454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.973456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:42.973462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.973464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:42.973467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.973469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.973476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.973479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.973484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.973486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.973503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:42.977400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554990547638450:2800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:42.977410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554990547638450:2800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:42.977412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554990547638450:2800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:42.977416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:42.980994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:42.982582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:42.982593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:42.982594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:42.982596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:42.982599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1643 [2:7556554990472089880:9769]
2025-10-02T09:32:42.982606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:42.982617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:42.982619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.982622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.982623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.982636Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:42.982645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:42.982651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:42.982686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.982690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.982692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.982694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:42.982695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:42.982736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:42.982741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.982756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:42.982761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:42.982773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:42.982787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547638488:2800], now have 1 active actors on pipe
2025-10-02T09:32:42.982792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554990547638187:2446], now have 1 active actors on pipe
2025-10-02T09:32:42.982796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.982797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.982799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.982806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:42.982816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:42.982822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:42.982825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:42.982818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1643
2025-10-02T09:32:42.982827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:42.982829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:42.982831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:42.982841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.982825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1643
2025-10-02T09:32:42.982843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:42.982845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:42.982852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.982854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.982881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c06bde3d-77194616-be67be7c-40ff5419_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:42.982891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:42.982894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:42.982896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:42.982902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:42.982911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:42.982921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.983019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:42.983026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:42.983035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:42.983093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1644 partition: 0 MaxSeqNo: 36 sessionId: src_id|c06bde3d-77194616-be67be7c-40ff5419_0
2025-10-02T09:32:42.983324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac79f19b-1fbc6be8-c50358d5-f674d006_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c06bde3d-77194616-be67be7c-40ff5419_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:42.985736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Write session: try to update token
2025-10-02T09:32:42.985748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:42.992188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:42.992204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:42.992206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:42.992207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:42.992212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.992215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.992219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554990472089875:9769]
2025-10-02T09:32:42.992240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:42.992243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:42.992243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:42.992244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:42.992246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:42.992248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:42.992420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:42.997335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId: src_id|c06bde3d-77194616-be67be7c-40ff5419_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:42.999549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.060788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842605792:3127]
2025-10-02T09:32:43.060986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1643, pipe: [1:7556554994842605792:3127]
2025-10-02T09:32:43.104684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.104915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.104924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.104953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842605792:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.105103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.105144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.105163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842605792:3127]
2025-10-02T09:32:43.105179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:43.105241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c06bde3d-77194616-be67be7c-40ff5419_0
2025-10-02T09:32:43.105377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1644 sessionId: src_id|c06bde3d-77194616-be67be7c-40ff5419_0 is DEAD
2025-10-02T09:32:43.105501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:43.105510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Write session will restart in 0.006327s
2025-10-02T09:32:43.105530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Write session: Do CDS request
2025-10-02T09:32:43.105535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.113199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.113328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.113336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1645
2025-10-02T09:32:43.113420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.113439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.113445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.113447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.113834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1645 sessionId:  describe result for acl check
2025-10-02T09:32:43.113860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.113864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.113865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.113869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842606036:2784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.114263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842606036:2784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.115073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.116024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842606036:2784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.116454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.116550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.116557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.116563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.116588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.116613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767057405:9772]
2025-10-02T09:32:43.116971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.117136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.117159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.117335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.117363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.117368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.117368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.117369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.117369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.117370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.117370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.117381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.117383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.117385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.117387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.117389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.117391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.117393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.117395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.117397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.117399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.117401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.117404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.117409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.117412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.117415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.117417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.117420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.117422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.117424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.117426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.117429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.117431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.117434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.117436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.117439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.117444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.117447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.117449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.117452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.117454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.117458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.117460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.117463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.117468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.117471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.117487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.118921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842606036:2784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.118930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842606036:2784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.118932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842606036:2784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.118936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.124972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.126551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.126562Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.126564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.126566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.126570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1644 [2:7556554994767057405:9772]
2025-10-02T09:32:43.126579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.126589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.126590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.126592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.126593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.126602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.126608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.126612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.126646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.126650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.126651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.126653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.126654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.126691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.126696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.126702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.126707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.126719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.126730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606098:2784], now have 1 active actors on pipe
2025-10-02T09:32:43.126735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842605793:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.126739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.126740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.126741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.126760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.126765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.126767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.126768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.126771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.126778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.126783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.126799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.126788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1644
2025-10-02T09:32:43.126794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1644
2025-10-02T09:32:43.126804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.126805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.126818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.126820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.126840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.126846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.126849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.126850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.126855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.126860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.126872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.126958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.126963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.126970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.127028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1645 partition: 0 MaxSeqNo: 36 sessionId: src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0
2025-10-02T09:32:43.127286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06bde3d-77194616-be67be7c-40ff5419_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.130018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Write session: try to update token
2025-10-02T09:32:43.130036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:43.136014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:43.136029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:43.136031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:43.136033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:43.136040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.136043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.136046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767057400:9772]
2025-10-02T09:32:43.136069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:43.136075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:43.136077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:43.136078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.136079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:43.136080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:43.136201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:43.142440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId: src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:43.144568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.205154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842606106:3127]
2025-10-02T09:32:43.205340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1644, pipe: [1:7556554994842606106:3127]
2025-10-02T09:32:43.251811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.252034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.252044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.252056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606106:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.252183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.252237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:43.252250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842606106:3127]
2025-10-02T09:32:43.252265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.252298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1645 reason: status is not ok: tablet will be restarted right now sessionId: src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0
2025-10-02T09:32:43.252437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1645 sessionId: src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0 is DEAD
2025-10-02T09:32:43.252583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:43.252604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Write session will restart in 0.006145s
2025-10-02T09:32:43.252626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Write session: Do CDS request
2025-10-02T09:32:43.252631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.260174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.260285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.260293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1646
2025-10-02T09:32:43.260405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.260425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.260431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.260434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.260708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1646 sessionId:  describe result for acl check
2025-10-02T09:32:43.260731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.260736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.260737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.260739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842606321:2787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.261115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842606321:2787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.262370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842606321:2787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.262556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.263804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.263907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.263915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.263921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.263947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.263969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767057635:9774]
2025-10-02T09:32:43.264012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842606321:2787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.264019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842606321:2787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.264021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842606321:2787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.264024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.264307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.264472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.264494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.264668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.264697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.264701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.264702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.264703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.264703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.264704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.264704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.264705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.264705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.264706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.264706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.264707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.264709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.264716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.264718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.264720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.264722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.264724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.264727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.264728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.264731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.264733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.264735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.264737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.264740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.264744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.264747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.264750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.264752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.264754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.264756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.264759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.264761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.264764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.264766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.264769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.264771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.264773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.264776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.264778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.264780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.264783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.264785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.264788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.264790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.264792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.264796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.264798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.264827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.272237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.273759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.273771Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.273773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.273775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.273779Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1645 [2:7556554994767057635:9774]
2025-10-02T09:32:43.273787Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.273797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.273807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.273809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.273811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.273821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.273826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.273830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.273867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.273873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.273874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.273876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.273877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.273979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.273984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.273991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.273996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.274007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.274005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1645
2025-10-02T09:32:43.274023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606411:2787], now have 1 active actors on pipe
2025-10-02T09:32:43.274029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606109:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.274033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.274007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1645
2025-10-02T09:32:43.274034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.274035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.274040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.274046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.274048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.274048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.274049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.274055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.274057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.274068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.274073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.274095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.274103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.274110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.274113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.274116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.274120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.274121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.274126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.274131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.274154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.274251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.274256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.274263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.274308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1646 partition: 0 MaxSeqNo: 36 sessionId: src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0
2025-10-02T09:32:43.274577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709ad9a-1bcb48bc-b8d533a2-54e13838_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.277312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Write session: try to update token
2025-10-02T09:32:43.277328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:43.283336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:43.283350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:43.283352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:43.283353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:43.283359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.283362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.283366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767057630:9774]
2025-10-02T09:32:43.283390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:43.283391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:43.283395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.283397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:43.283399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:43.283401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:43.283546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:43.289956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId: src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:43.292385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.352594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842606436:3127]
2025-10-02T09:32:43.352727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1645, pipe: [1:7556554994842606436:3127]
2025-10-02T09:32:43.398219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.398443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.398462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.398478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606436:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.398604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.398649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:43.398659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:43.398666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842606436:3127]
2025-10-02T09:32:43.398680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.398703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1646 reason: error at write: Disconnected sessionId: src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0
2025-10-02T09:32:43.398859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1646 sessionId: src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0 is DEAD
2025-10-02T09:32:43.399032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:43.399047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Write session will restart in 0.006119s
2025-10-02T09:32:43.399069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Write session: Do CDS request
2025-10-02T09:32:43.399074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.406169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.406275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.406283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1647
2025-10-02T09:32:43.406394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.406413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.406419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.406422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.406676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1647 sessionId:  describe result for acl check
2025-10-02T09:32:43.406698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.406702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.406703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.406706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842606650:2772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.407052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842606650:2772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.408571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842606650:2772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.408826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.410180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.410292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.410299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.410306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.410335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.410357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767057900:9789]
2025-10-02T09:32:43.410468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842606650:2772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.410475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842606650:2772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.410477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842606650:2772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.410480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.410690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.410851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.410872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.411043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.411069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.411073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.411074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.411074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.411075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.411075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.411076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.411076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.411077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.411077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.411078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.411078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.411081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.411086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.411089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.411091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.411092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.411094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.411096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.411098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.411100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.411103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.411106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.411107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.411111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.411115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.411118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.411121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.411123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.411126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.411128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.411130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.411132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.411135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.411137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.411140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.411142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.411144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.411146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.411149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.411152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.411154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.411156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.411159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.411161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.411164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.411166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.411168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.411183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.418593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.420127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.420138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.420139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.420141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.420144Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1646 [2:7556554994767057900:9789]
2025-10-02T09:32:43.420150Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.420159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.420161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.420162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.420163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.420172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.420174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.420179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.420213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.420219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.420220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.420221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.420223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.420259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.420263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.420270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.420275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.420283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.420296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606446:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.420301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606749:2772], now have 1 active actors on pipe
2025-10-02T09:32:43.420304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.420305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.420306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.420313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.420320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.420329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.420331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.420332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.420334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.420336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.420344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.420332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1646
2025-10-02T09:32:43.420341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1646
2025-10-02T09:32:43.420345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.420350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.420367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.420372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.420386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31c44c99-2758ffa3-37568e81-cdf20780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.420394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.420397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.420398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.420403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.420408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.420415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.420527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.420534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.420543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.420603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1647 partition: 0 MaxSeqNo: 36 sessionId: src_id|31c44c99-2758ffa3-37568e81-cdf20780_0
2025-10-02T09:32:43.420835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b19af6-5454bdd7-6942c0a6-3eb5f43e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31c44c99-2758ffa3-37568e81-cdf20780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.423533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Write session: try to update token
2025-10-02T09:32:43.423547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:43.429775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:43.429788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:43.429790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:43.429791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:43.429796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.429798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.429800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767057895:9789]
2025-10-02T09:32:43.429821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:43.429824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.429824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:43.429827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:43.429828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:43.429829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:43.429942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:43.437329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId: src_id|31c44c99-2758ffa3-37568e81-cdf20780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:43.439521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.499042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842606760:3127]
2025-10-02T09:32:43.499213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1646, pipe: [1:7556554994842606760:3127]
2025-10-02T09:32:43.541658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.541884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.541893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.541905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606760:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.542050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.542093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842606760:3127]
2025-10-02T09:32:43.542101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.542113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:43.542161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1647 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31c44c99-2758ffa3-37568e81-cdf20780_0
2025-10-02T09:32:43.542298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1647 sessionId: src_id|31c44c99-2758ffa3-37568e81-cdf20780_0 is DEAD
2025-10-02T09:32:43.542470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:43.542486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Write session will restart in 0.007833s
2025-10-02T09:32:43.542512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Write session: Do CDS request
2025-10-02T09:32:43.542517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.551166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.551279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.551286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1648
2025-10-02T09:32:43.551419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.551440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.551446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.551448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.551718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1648 sessionId:  describe result for acl check
2025-10-02T09:32:43.551736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.551741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.551744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.551746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842607029:2764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.552115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842607029:2764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.552243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.553545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.553648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.553655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.553662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.553690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.553712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767058128:9791]
2025-10-02T09:32:43.553804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842607029:2764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.554112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.554293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.554321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.554523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.554568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.554573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.554574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.554574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.554575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.554576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.554576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.554577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.554577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.554578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.554579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.554579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.554582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.554589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.554591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.554594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.554596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.554598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.554601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.554603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.554605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.554608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.554610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.554612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.554616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.554621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.554624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.554627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.554629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.554633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.554638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.554641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.554644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.554647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.554653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.554656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.554659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.554662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.554668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.554671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.554675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.554678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.554683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.554686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.554689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.554692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.554697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.554700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.554718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.559116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842607029:2764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.559126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842607029:2764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.559128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842607029:2764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.559132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.563031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.564601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.564612Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.564614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.564616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.564619Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1647 [2:7556554994767058128:9791]
2025-10-02T09:32:43.564626Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.564635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.564640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.564642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.564643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.564651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.564657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.564661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.564690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.564695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.564696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.564698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.564699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.564741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.564745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.564752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.564758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.564772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.564791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607070:2764], now have 1 active actors on pipe
2025-10-02T09:32:43.564797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842606762:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.564812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.564813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.564814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.564797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1647
2025-10-02T09:32:43.564819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1647
2025-10-02T09:32:43.564819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.564826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.564833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.564835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.564835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.564838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.564839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.564856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.564861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.564870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.564878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.564891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.564893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da2fb843-6af306c5-79f657fe-d4501078_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.564896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.564899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.564900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.564905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.564910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.564922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.565016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.565024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.565036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.565110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1648 partition: 0 MaxSeqNo: 36 sessionId: src_id|da2fb843-6af306c5-79f657fe-d4501078_0
2025-10-02T09:32:43.565376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c44c99-2758ffa3-37568e81-cdf20780_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da2fb843-6af306c5-79f657fe-d4501078_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.568057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Write session: try to update token
2025-10-02T09:32:43.568070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:43.574235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:43.574248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:43.574249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:43.574251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:43.574254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.574257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.574259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767058123:9791]
2025-10-02T09:32:43.574279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:43.574282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.574281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:43.574283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:43.574284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:43.574286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:43.574393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:43.581845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId: src_id|da2fb843-6af306c5-79f657fe-d4501078_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:43.583895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.642408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842607077:3127]
2025-10-02T09:32:43.642606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1647, pipe: [1:7556554994842607077:3127]
2025-10-02T09:32:43.683648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.683862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.683870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.683883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607077:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.684015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.684047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842607077:3127]
2025-10-02T09:32:43.684062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.684067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:43.684119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1648 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da2fb843-6af306c5-79f657fe-d4501078_0
2025-10-02T09:32:43.684258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1648 sessionId: src_id|da2fb843-6af306c5-79f657fe-d4501078_0 is DEAD
2025-10-02T09:32:43.684401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:43.684410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Write session will restart in 0.005783s
2025-10-02T09:32:43.684425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Write session: Do CDS request
2025-10-02T09:32:43.684430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.691223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.691297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.691305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1649
2025-10-02T09:32:43.691399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.691421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.691429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.691433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.691833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1649 sessionId:  describe result for acl check
2025-10-02T09:32:43.691857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.691862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.691865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.691868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842607274:2761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.692243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842607274:2761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.693707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842607274:2761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.694297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.695496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.695591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.695597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.695604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.695629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.695651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767058359:9793]
2025-10-02T09:32:43.695718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842607274:2761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.695726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842607274:2761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.695728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842607274:2761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.695731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.695999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.696148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.696171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.696346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.696374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.696378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.696379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.696380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.696380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.696381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.696381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.696381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.696382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.696382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.696383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.696384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.696386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.696392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.696394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.696396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.696398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.696400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.696402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.696404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.696406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.696408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.696410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.696412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.696416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.696420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.696423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.696426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.696428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.696431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.696433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.696436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.696438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.696441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.696443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.696446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.696448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.696450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.696452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.696455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.696461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.696464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.696466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.696469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.696472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.696474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.696479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.696481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.696497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.703964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.705649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.705660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.705662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.705664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.705667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1648 [2:7556554994767058359:9793]
2025-10-02T09:32:43.705674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.705684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.705685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.705687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.705688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.705696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.705699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.705704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.705733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.705739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.705740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.705742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.705743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.705779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.705784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.705790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.705796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.705808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.705822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607079:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.705827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607384:2761], now have 1 active actors on pipe
2025-10-02T09:32:43.705832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.705833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.705834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.705842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.705852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.705855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.705857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.705858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.705863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.705865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.705879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.705884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.705888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.705879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1648
2025-10-02T09:32:43.705882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1648
2025-10-02T09:32:43.705905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.705910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.705925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.705932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.705934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.705936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.705941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.705946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.705953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.706051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.706056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.706063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.706121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1649 partition: 0 MaxSeqNo: 36 sessionId: src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0
2025-10-02T09:32:43.706384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da2fb843-6af306c5-79f657fe-d4501078_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.709082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Write session: try to update token
2025-10-02T09:32:43.709095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:43.716625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:43.716640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:43.716641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:43.716643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:43.716647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.716650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.716652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767058354:9793]
2025-10-02T09:32:43.716674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:43.716678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.716680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:43.716685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:43.716696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:43.716698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:43.716889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:43.722212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId: src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:43.724339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.784225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842607395:3127]
2025-10-02T09:32:43.784362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1648, pipe: [1:7556554994842607395:3127]
2025-10-02T09:32:43.828022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.828324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.828334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.828359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607395:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.828495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.828535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:43.828539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842607395:3127]
2025-10-02T09:32:43.828545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:43.828554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.828588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1649 reason: error at write: Disconnected sessionId: src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0
2025-10-02T09:32:43.828717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1649 sessionId: src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0 is DEAD
2025-10-02T09:32:43.828855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:43.828864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Write session will restart in 0.008347s
2025-10-02T09:32:43.828883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Write session: Do CDS request
2025-10-02T09:32:43.828887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.838135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.838455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.838464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1650
2025-10-02T09:32:43.838541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.838559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.838565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.838567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.838702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.838832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1650 sessionId:  describe result for acl check
2025-10-02T09:32:43.838852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.838856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.838857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.838860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842607673:2751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.839175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842607673:2751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.839984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.840120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.840128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.840134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.840163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.840183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767058604:9796]
2025-10-02T09:32:43.840353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842607673:2751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.840514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.840654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.840676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.840861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.840890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.840894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.840894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.840895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.840896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.840896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.840897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.840897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.840898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.840898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.840899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.840899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.840902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.840908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.840910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.840912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.840914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.840916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.840918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.840920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.840922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.840924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.840926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.840928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.840931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.840935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.840938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.840941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.840943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.840945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.840947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.840953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.840955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.840958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.840960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.840962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.840965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.840968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.840971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.840974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.840976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.840979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.840985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.840988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.840990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.840992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.840995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.840998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.841018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.844830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842607673:2751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.844838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842607673:2751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.844840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842607673:2751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.844843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.848412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.849999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.850008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.850009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.850011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.850014Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1649 [2:7556554994767058604:9796]
2025-10-02T09:32:43.850020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.850029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.850030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.850031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.850032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.850041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.850046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.850051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.850079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.850084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.850085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.850087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.850088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.850122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.850126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.850133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.850138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.850149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.850162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607713:2751], now have 1 active actors on pipe
2025-10-02T09:32:43.850167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607399:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.850171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.850172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.850174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.850183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.850191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.850193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.850193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1649
2025-10-02T09:32:43.850201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1649
2025-10-02T09:32:43.850198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.850200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.850200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.850202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.850215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.850216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.850220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.850229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.850231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.850250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b921509-728edf86-bf381c69-e7d63a3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.850255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.850257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.850258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.850262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.850268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.850277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.850359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.850364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.850370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.850420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1650 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b921509-728edf86-bf381c69-e7d63a3f_0
2025-10-02T09:32:43.850589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf7873f-39734c7e-ed789d4f-f0d50b0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b921509-728edf86-bf381c69-e7d63a3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.852747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Write session: try to update token
2025-10-02T09:32:43.852756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:43.859411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:43.859423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:43.859424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:43.859426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:43.859430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.859432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.859435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767058598:9796]
2025-10-02T09:32:43.859454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:43.859457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:43.859458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.859459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:43.859460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:43.859462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:43.859571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:43.865121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId: src_id|1b921509-728edf86-bf381c69-e7d63a3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:43.867261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:43.928608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554994842607736:3127]
2025-10-02T09:32:43.928766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1649, pipe: [1:7556554994842607736:3127]
2025-10-02T09:32:43.969824Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:43.970047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.970056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.970068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607736:3127], now have 1 active actors on pipe
2025-10-02T09:32:43.970186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:43.970245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554994842607736:3127]
2025-10-02T09:32:43.970259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:43.970262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:43.970316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1650 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b921509-728edf86-bf381c69-e7d63a3f_0
2025-10-02T09:32:43.970457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1650 sessionId: src_id|1b921509-728edf86-bf381c69-e7d63a3f_0 is DEAD
2025-10-02T09:32:43.970594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:43.970604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Write session will restart in 0.007427s
2025-10-02T09:32:43.970620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Write session: Do CDS request
2025-10-02T09:32:43.970624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:43.979168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.979213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:43.979220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1651
2025-10-02T09:32:43.979346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:43.979365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:43.979372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:43.979374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:43.979635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1651 sessionId:  describe result for acl check
2025-10-02T09:32:43.979666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:43.979670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:43.979671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:43.979674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554994842607975:2742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:43.980010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554994842607975:2742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:43.981179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554994842607975:2742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:43.982517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:43.982831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:43.982923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:43.982929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:43.982935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:43.982959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:43.982983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554994767058839:9798]
2025-10-02T09:32:43.983198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554994842607975:2742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:43.983206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554994842607975:2742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:43.983207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554994842607975:2742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:43.983211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:43.983326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:43.983492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:43.983514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:43.983685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:43.983712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.983717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.983717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.983718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.983718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.983719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.983719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.983720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.983720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.983721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.983721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.983722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.983725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.983730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.983732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.983734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.983736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.983738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.983740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.983742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.983744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.983746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.983748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.983750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.983753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.983757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:43.983760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.983763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:43.983765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.983768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:43.983770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.983773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:43.983775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.983777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:43.983780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.983782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:43.983784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.983787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:43.983789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.983791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:43.983794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.983797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:43.983799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.983801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.983803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.983806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.983808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.983810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.983826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:43.991218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:43.992827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:43.992836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:43.992837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:43.992839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:43.992843Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1650 [2:7556554994767058839:9798]
2025-10-02T09:32:43.992850Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:43.992859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:43.992861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.992862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.992863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.992872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:43.992875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:43.992879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:43.992918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.992923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.992924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.992925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:43.992927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:43.992969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:43.992974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:43.992981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:43.992986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:43.992997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:43.993012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842607737:2446], now have 1 active actors on pipe
2025-10-02T09:32:43.993017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554994842608044:2742], now have 1 active actors on pipe
2025-10-02T09:32:43.993021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:43.993022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:43.993022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:43.993029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:43.993037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:43.993047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:43.993047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:43.993049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:43.993051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:43.993052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:43.993067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:43.993068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:43.993071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1650
2025-10-02T09:32:43.993064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1650
2025-10-02T09:32:43.993083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:43.993089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.993091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.993107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:43.993110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:43.993112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:43.993113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:43.993119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:43.993124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:43.993132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.993224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:43.993230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:43.993237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:43.993292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1651 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0
2025-10-02T09:32:43.993514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b921509-728edf86-bf381c69-e7d63a3f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:43.995675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Write session: try to update token
2025-10-02T09:32:43.995686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.002350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.002365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.002367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.002368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.002373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:44.002376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:44.002378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554994767058834:9798]
2025-10-02T09:32:44.002400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.002405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.002405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.002408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.002408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.002410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.002541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.008429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId: src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.010525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.070429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137575352:3127]
2025-10-02T09:32:44.070560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1650, pipe: [1:7556554999137575352:3127]
2025-10-02T09:32:44.114123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.114349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.114358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.114370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575352:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.114502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.114532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.114562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:44.114617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0
2025-10-02T09:32:44.114774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1651 sessionId: src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0 is DEAD
2025-10-02T09:32:44.114876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137575352:3127]
2025-10-02T09:32:44.114892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:44.114905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Write session will restart in 0.006967s
2025-10-02T09:32:44.114929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Write session: Do CDS request
2025-10-02T09:32:44.114934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.123220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.123291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.123298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1652
2025-10-02T09:32:44.123423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.123442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.123448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.123451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.123721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1652 sessionId:  describe result for acl check
2025-10-02T09:32:44.123746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.123750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.123751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.123755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137575564:2739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.124095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137575564:2739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.125725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137575564:2739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.125947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.127306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.127399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.127406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.127411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.127435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.127456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062026369:9801]
2025-10-02T09:32:44.127579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137575564:2739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.127586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137575564:2739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.127588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137575564:2739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.127591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.127789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.127955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.127976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.128145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.128173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.128177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.128177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.128178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.128178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.128179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.128179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.128180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.128180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.128181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.128181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.128182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.128184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.128191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.128193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.128195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.128197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.128199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.128201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.128203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.128205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.128207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.128209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.128211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.128214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.128218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.128221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.128225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.128228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.128231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.128233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.128236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.128238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.128244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.128247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.128249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.128251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.128255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.128260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.128263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.128266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.128269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.128274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.128276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.128278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.128281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.128286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.128288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.128304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:44.135948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:44.137435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:44.137446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:44.137447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:44.137449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:44.137453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1651 [2:7556554999062026369:9801]
2025-10-02T09:32:44.137460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:44.137470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:44.137475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.137477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.137478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.137487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:44.137490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:44.137494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:44.137527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.137532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.137533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.137534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:44.137535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:44.137569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:44.137574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.137580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.137585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.137596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:44.137610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575661:2739], now have 1 active actors on pipe
2025-10-02T09:32:44.137615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575353:2446], now have 1 active actors on pipe
2025-10-02T09:32:44.137619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.137620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.137622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.137629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:44.137636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:44.137647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:44.137646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:44.137648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:44.137649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:44.137650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:44.137644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1651
2025-10-02T09:32:44.137649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1651
2025-10-02T09:32:44.137662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.137667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:44.137669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:44.137685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.137690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.137709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:44.137715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.137717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.137718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:44.137723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.137731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:44.137740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.137833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.137838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.137845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.137902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1652 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0
2025-10-02T09:32:44.138143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e53e86-897abbb3-64311fb7-3da741fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:44.140794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Write session: try to update token
2025-10-02T09:32:44.140827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.146741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.146761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.146762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.146763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.146767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.146770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.146772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062026363:9801]
2025-10-02T09:32:44.146792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.146795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.146796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.146799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.146802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.146803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.146937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.153275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId: src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.155357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.214812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137575673:3127]
2025-10-02T09:32:44.214994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1651, pipe: [1:7556554999137575673:3127]
2025-10-02T09:32:44.257853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.258180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.258189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.258201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575673:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.258317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.258362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.258386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137575673:3127]
2025-10-02T09:32:44.258389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:44.258437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1652 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0
2025-10-02T09:32:44.258579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1652 sessionId: src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0 is DEAD
2025-10-02T09:32:44.258733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:44.258756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Write session will restart in 0.007448s
2025-10-02T09:32:44.258781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Write session: Do CDS request
2025-10-02T09:32:44.258787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.267184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.267252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.267259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1653
2025-10-02T09:32:44.267379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.267397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.267403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.267405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.267674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1653 sessionId:  describe result for acl check
2025-10-02T09:32:44.267694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.267698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.267699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.267702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137575920:2726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.268048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137575920:2726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.269122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.269488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137575920:2726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.270446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.270537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.270543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.270549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.270573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.270606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062026606:9803]
2025-10-02T09:32:44.270947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.271122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.271144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.271315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.271343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.271347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.271347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.271348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.271348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.271349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.271349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.271350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.271350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.271351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.271351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.271352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.271355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.271360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.271362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.271364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.271366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.271368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.271370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.271372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.271374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.271376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.271378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.271380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.271383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.271387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.271390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.271393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.271395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.271398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.271400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.271403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.271405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.271407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.271409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.271412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.271414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.271417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.271419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.271421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.271423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.271426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.271428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.271430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.271433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.271436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.271438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.271440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.271457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:44.271454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137575920:2726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.271462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137575920:2726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.271464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137575920:2726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.271468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.278834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:44.280339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:44.280350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:44.280351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:44.280353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:44.280356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1652 [2:7556554999062026606:9803]
2025-10-02T09:32:44.280362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:44.280371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:44.280374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.280376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.280377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.280385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:44.280388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:44.280391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:44.280421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.280426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.280427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.280429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:44.280430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:44.280471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:44.280476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.280482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.280487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.280496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:44.280509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575987:2726], now have 1 active actors on pipe
2025-10-02T09:32:44.280514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575676:2446], now have 1 active actors on pipe
2025-10-02T09:32:44.280518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.280520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.280522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.280529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:44.280536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:44.280545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:44.280547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:44.280546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:44.280549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:44.280550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:44.280541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1652
2025-10-02T09:32:44.280542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1652
2025-10-02T09:32:44.280561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.280564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:44.280566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:44.280579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.280584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.280601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68db4ad-185b03e8-5415c51b-817459a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:44.280608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.280610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.280611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:44.280616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.280624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:44.280632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.280721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.280726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.280733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.280787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1653 partition: 0 MaxSeqNo: 36 sessionId: src_id|d68db4ad-185b03e8-5415c51b-817459a2_0
2025-10-02T09:32:44.281033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad76fee-a6d6a5be-17dfe8bb-682d694b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d68db4ad-185b03e8-5415c51b-817459a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:44.283804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Write session: try to update token
2025-10-02T09:32:44.283820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.289573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.289585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.289585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.289586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.289590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.289592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.289594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062026600:9803]
2025-10-02T09:32:44.289612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.289615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.289616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.289618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.289621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.289623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.289725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.296429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId: src_id|d68db4ad-185b03e8-5415c51b-817459a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.298464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.358685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137575997:3127]
2025-10-02T09:32:44.358890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1652, pipe: [1:7556554999137575997:3127]
2025-10-02T09:32:44.398939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.399200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.399209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.399220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137575997:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.399310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.399366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137575997:3127]
2025-10-02T09:32:44.399368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:44.399383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.399412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1653 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d68db4ad-185b03e8-5415c51b-817459a2_0
2025-10-02T09:32:44.399556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1653 sessionId: src_id|d68db4ad-185b03e8-5415c51b-817459a2_0 is DEAD
2025-10-02T09:32:44.399696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:44.399712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Write session will restart in 0.008369s
2025-10-02T09:32:44.399733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Write session: Do CDS request
2025-10-02T09:32:44.399739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.409166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.409219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.409226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1654
2025-10-02T09:32:44.409363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.409383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.409390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.409393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.409636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1654 sessionId:  describe result for acl check
2025-10-02T09:32:44.409657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.409661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.409662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.409665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137576296:2715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.409864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.409958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137576296:2715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.411030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137576296:2715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.411499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.411590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.411597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.411602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.411626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.411648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062026878:9818]
2025-10-02T09:32:44.411978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.412146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.412169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.412434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.412469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.412473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.412474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.412474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.412475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.412475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.412475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.412476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.412476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.412477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.412477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.412478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.412480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.412486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.412488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.412490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.412492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.412494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.412496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.412498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.412500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.412502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.412504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.412506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.412510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.412513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.412517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.412520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.412522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.412524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.412526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.412529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.412531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.412534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.412536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.412539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.412542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.412545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.412547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.412549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.412551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.412554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.412556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.412558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.412560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.412563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.412565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.412567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.412584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:44.413015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137576296:2715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.413022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137576296:2715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.413025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137576296:2715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.413028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.420003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:44.421368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:44.421378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:44.421379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:44.421381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:44.421384Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1653 [2:7556554999062026878:9818]
2025-10-02T09:32:44.421391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:44.421400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:44.421401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.421403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.421404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.421412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:44.421414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:44.421418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:44.421449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.421454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.421456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.421457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:44.421459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:44.421492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:44.421496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.421503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.421508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.421518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:44.421532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576333:2715], now have 1 active actors on pipe
2025-10-02T09:32:44.421537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576023:2446], now have 1 active actors on pipe
2025-10-02T09:32:44.421541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.421543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.421544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.421552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:44.421559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:44.421567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:44.421568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:44.421570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:44.421564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1653
2025-10-02T09:32:44.421572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:44.421566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1653
2025-10-02T09:32:44.421572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:44.421584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.421586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:44.421588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:44.421600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.421605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.421623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:44.421630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.421632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.421633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:44.421638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.421642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:44.421655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.421742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.421747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.421754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.421807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1654 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0
2025-10-02T09:32:44.422024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68db4ad-185b03e8-5415c51b-817459a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:44.424661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Write session: try to update token
2025-10-02T09:32:44.424674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.430674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.430692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.430693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.430695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.430700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.430702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.430704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062026873:9818]
2025-10-02T09:32:44.430723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.430729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.430730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.430731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.430735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.430737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.430892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.437002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId: src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.439162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.499499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137576340:3127]
2025-10-02T09:32:44.499672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1653, pipe: [1:7556554999137576340:3127]
2025-10-02T09:32:44.541273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.541559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.541569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.541582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576340:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.541723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.541745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.541760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137576340:3127]
2025-10-02T09:32:44.541776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:44.541832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1654 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0
2025-10-02T09:32:44.541970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1654 sessionId: src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0 is DEAD
2025-10-02T09:32:44.542132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:44.542146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Write session will restart in 0.006426s
2025-10-02T09:32:44.542171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Write session: Do CDS request
2025-10-02T09:32:44.542177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.549239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.549450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.549457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1655
2025-10-02T09:32:44.549564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.549585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.549591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.549593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.549872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1655 sessionId:  describe result for acl check
2025-10-02T09:32:44.549892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.549896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.549897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.549899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137576533:2713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.550256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137576533:2713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.551916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137576533:2713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.553033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.554233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.554407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137576533:2713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.554414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137576533:2713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.554416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137576533:2713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.554420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.554422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.554430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.554437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.554477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.554506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062027113:9820]
2025-10-02T09:32:44.554868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.555056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.555084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.555281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.555313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.555316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.555317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.555317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.555318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.555318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.555319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.555320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.555320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.555321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.555321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.555322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.555324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.555331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.555333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.555335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.555337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.555339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.555340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.555342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.555344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.555346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.555348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.555350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.555353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.555357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.555360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.555363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.555366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.555368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.555370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.555374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.555376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.555379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.555381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.555383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.555385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.555388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.555390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.555392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.555395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.555397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.555399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.555402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.555404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.555406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.555408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.555411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.555426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:44.562764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:44.564254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:44.564266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:44.564267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:44.564269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:44.564273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1654 [2:7556554999062027113:9820]
2025-10-02T09:32:44.564279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:44.564288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:44.564292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.564294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.564295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.564303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:44.564306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:44.564314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:44.564341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.564345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.564346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.564348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:44.564350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:44.564385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:44.564390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.564397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.564402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.564410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:44.564422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576653:2713], now have 1 active actors on pipe
2025-10-02T09:32:44.564427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576342:2446], now have 1 active actors on pipe
2025-10-02T09:32:44.564430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.564432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.564434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.564442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:44.564452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:44.564450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1654
2025-10-02T09:32:44.564451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1654
2025-10-02T09:32:44.564468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:44.564472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:44.564473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:44.564474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:44.564476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:44.564493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.564497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.564507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.564514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:44.564529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:44.564531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:44.564535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.564538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.564539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:44.564544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.564549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:44.564560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.564665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.564672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.564681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.564732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1655 partition: 0 MaxSeqNo: 36 sessionId: src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0
2025-10-02T09:32:44.564956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f0d63f1-786a5b5-3265bc26-48dd6538_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:44.567711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Write session: try to update token
2025-10-02T09:32:44.567727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.573670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.573683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.573685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.573687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.573691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.573692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.573694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062027107:9820]
2025-10-02T09:32:44.573714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.573716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.573717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.573717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.573720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.573723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.573855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.580527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId: src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.582687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.641827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137576673:3127]
2025-10-02T09:32:44.642002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1654, pipe: [1:7556554999137576673:3127]
2025-10-02T09:32:44.685072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.685377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.685386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.685398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576673:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.685532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.685564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.685589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137576673:3127]
2025-10-02T09:32:44.685592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:44.685649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0
2025-10-02T09:32:44.685767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1655 sessionId: src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0 is DEAD
2025-10-02T09:32:44.685897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:44.685912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Write session will restart in 0.008349s
2025-10-02T09:32:44.685934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Write session: Do CDS request
2025-10-02T09:32:44.685940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.695179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.695359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.695368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1656
2025-10-02T09:32:44.695485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.695506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.695512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.695514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.695795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1656 sessionId:  describe result for acl check
2025-10-02T09:32:44.695820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.695825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.695826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.695831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137576937:2707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.696177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137576937:2707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.697041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.697498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137576937:2707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.698535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.698639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.698646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.698653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.698680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.698704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062027351:9822]
2025-10-02T09:32:44.698997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137576937:2707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.699004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137576937:2707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.699006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137576937:2707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.699010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.699065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.699233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.699260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.699455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.699490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.699495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.699495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.699496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.699496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.699497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.699497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.699498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.699498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.699499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.699500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.699500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.699503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.699509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.699511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.699513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.699515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.699517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.699519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.699521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.699523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.699525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.699527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.699529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.699533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.699537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.699540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.699543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.699545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.699548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.699550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.699553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.699555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.699558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.699560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.699563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.699565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.699568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.699571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.699574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.699580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.699584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.699586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.699592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.699594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.699596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.699598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.699601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.699630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:44.707005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:44.708556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:44.708569Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:44.708571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:44.708574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:44.708578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1655 [2:7556554999062027351:9822]
2025-10-02T09:32:44.708587Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:44.708602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:44.708607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.708608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.708609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.708618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:44.708624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:44.708628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:44.708662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.708666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.708667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.708669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:44.708671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:44.708711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:44.708716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.708722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.708728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.708739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:44.708752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576987:2707], now have 1 active actors on pipe
2025-10-02T09:32:44.708758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137576675:2446], now have 1 active actors on pipe
2025-10-02T09:32:44.708761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.708762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.708763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.708771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:44.708778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:44.708788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:44.708789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:44.708791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:44.708793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:44.708795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:44.708822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.708827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:44.708831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:44.708833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1655
2025-10-02T09:32:44.708846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1655
2025-10-02T09:32:44.708926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.708933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.708949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:44.708953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.708955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.708956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:44.708962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.708967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:44.708977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.709112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.709118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.709126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.709188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1656 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0
2025-10-02T09:32:44.709445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd7def3-1c72b97f-3c7bf833-8033de7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:44.712210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Write session: try to update token
2025-10-02T09:32:44.712224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.717970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:44.717984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.717990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.718015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:44.718015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:44.718159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:44.718273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:44.718391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:44.718500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:44.718669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:44.718693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:44.724644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId: src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.726469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.726482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.726484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.726486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.726491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.726494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.726499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062027345:9822]
2025-10-02T09:32:44.726523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.726525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.726528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.726529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.726530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.726532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.726640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.727132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.785692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137577000:3127]
2025-10-02T09:32:44.785830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1655, pipe: [1:7556554999137577000:3127]
2025-10-02T09:32:44.837715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.838121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.838133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.838146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137577000:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.838273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.838327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:44.838335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:44.838342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137577000:3127]
2025-10-02T09:32:44.838356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.838375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1656 reason: error at write: Disconnected sessionId: src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0
2025-10-02T09:32:44.838495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1656 sessionId: src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0 is DEAD
2025-10-02T09:32:44.838644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:44.838658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Write session will restart in 0.008885s
2025-10-02T09:32:44.838681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Write session: Do CDS request
2025-10-02T09:32:44.838687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.848255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.848265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.848272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1657
2025-10-02T09:32:44.848434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.848454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.848460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.848462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.848724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1657 sessionId:  describe result for acl check
2025-10-02T09:32:44.848747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.848751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.848752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.848755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137577283:2702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.849104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137577283:2702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.849379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.850564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137577283:2702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.850789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.850888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.850894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.850901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.850934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.850956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062027602:9825]
2025-10-02T09:32:44.851300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.851473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.851500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.851684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.851718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.851723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.851723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.851724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.851724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.851725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.851725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.851726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.851726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.851727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.851727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.851728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.851731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.851736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.851738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.851740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.851742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.851744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.851746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.851748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.851750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.851752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.851754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.851756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.851759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.851763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.851767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.851770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.851772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.851774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.851776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.851779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.851781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.851784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.851786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.851788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.851791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.851794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.851796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.851798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.851800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.851803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.851805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.851809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.851811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.851814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.851817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.851820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.851837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:44.852083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137577283:2702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.852091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137577283:2702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.852093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137577283:2702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.852096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.859193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:44.860581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:44.860594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:44.860595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:44.860597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:44.860600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1656 [2:7556554999062027602:9825]
2025-10-02T09:32:44.860606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:44.860615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:44.860620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.860622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.860623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.860632Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:44.860636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:44.860645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:44.860679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.860684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.860685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.860687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:44.860688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:44.860738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:44.860742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.860749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.860754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.860762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:44.860772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137577325:2702], now have 1 active actors on pipe
2025-10-02T09:32:44.860774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137577008:2446], now have 1 active actors on pipe
2025-10-02T09:32:44.860777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.860779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.860780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.860788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:44.860795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:44.860811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:44.860814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:44.860815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:44.860816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:44.860815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1656
2025-10-02T09:32:44.860818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:44.860819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1656
2025-10-02T09:32:44.860831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.860833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:44.860834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:44.860886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.860894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.860928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:44.860934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:44.860937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:44.860938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:44.860944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:44.860949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:44.860958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.861049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.861056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.861065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:44.861120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1657 partition: 0 MaxSeqNo: 36 sessionId: src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0
2025-10-02T09:32:44.861352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd3288f-bf2044fd-14d2aace-1280358a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:44.863860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Write session: try to update token
2025-10-02T09:32:44.863871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:44.870072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:44.870089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:44.870090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:44.870092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:44.870096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.870100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.870103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062027596:9825]
2025-10-02T09:32:44.870127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:44.870128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:44.870132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.870134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:44.870135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:44.870138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:44.870241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:44.875395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId: src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:44.877436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:44.938278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556554999137577348:3127]
2025-10-02T09:32:44.938443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1656, pipe: [1:7556554999137577348:3127]
2025-10-02T09:32:44.981621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:44.982078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:44.982089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:44.982114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137577348:3127], now have 1 active actors on pipe
2025-10-02T09:32:44.982279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:44.982288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:44.982324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:44.982339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1657 reason: error at write: Disconnected sessionId: src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0
2025-10-02T09:32:44.982361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556554999137577348:3127]
2025-10-02T09:32:44.982455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:44.982475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1657 sessionId: src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0 is DEAD
2025-10-02T09:32:44.982656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:44.982672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Write session will restart in 0.008265s
2025-10-02T09:32:44.982693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Write session: Do CDS request
2025-10-02T09:32:44.982700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:44.992156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.992213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:44.992220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1658
2025-10-02T09:32:44.992312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:44.992331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:44.992337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:44.992340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:44.992604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1658 sessionId:  describe result for acl check
2025-10-02T09:32:44.992627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:44.992633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:44.992634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:44.992637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556554999137577603:2692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:44.992986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556554999137577603:2692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:44.994115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:44.994467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556554999137577603:2692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:44.995468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:44.995562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:44.995569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:44.995575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:44.995601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:44.995623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556554999062027844:9828]
2025-10-02T09:32:44.995925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556554999137577603:2692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:44.995933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556554999137577603:2692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:44.995934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556554999137577603:2692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:44.995938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:44.996003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:44.996174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:44.996197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:44.996373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:44.996401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.996405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.996405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.996406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.996407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.996407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.996408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.996408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.996409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.996409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.996410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.996410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.996413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.996419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.996421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.996423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.996424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.996426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.996428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.996430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.996432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.996434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.996436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.996438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.996442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.996445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:44.996449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.996452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:44.996454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.996457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:44.996459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.996462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:44.996464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.996466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:44.996468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.996471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:44.996473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.996476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:44.996478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.996480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:44.996482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.996485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:44.996487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.996489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:44.996491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.996498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:44.996501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.996503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:44.996520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.003919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.005452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.005464Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.005465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.005467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.005470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1657 [2:7556554999062027844:9828]
2025-10-02T09:32:45.005479Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.005492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.005497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.005499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.005500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.005508Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.005515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.005520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.005555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.005560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.005561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.005563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.005564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.005606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.005611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.005617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.005622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.005630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.005644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137577663:2692], now have 1 active actors on pipe
2025-10-02T09:32:45.005650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556554999137577349:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.005653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.005655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.005656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.005663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.005671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.005681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.005681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.005683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.005689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.005683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1657
2025-10-02T09:32:45.005690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.005696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.005684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1657
2025-10-02T09:32:45.005698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.005700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.005720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.005722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.005735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.005743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.005745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.005746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.005752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.005759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.005767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.005855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.005859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.005867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.005931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1658 partition: 0 MaxSeqNo: 36 sessionId: src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0
2025-10-02T09:32:45.006175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeea1332-2e42c4b-a883ca98-7b87a25c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.008946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Write session: try to update token
2025-10-02T09:32:45.008962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.014847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.014859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.014860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.014861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.014864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.014867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.014869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556554999062027838:9828]
2025-10-02T09:32:45.014889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.014892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.014892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.014893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.014895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.014897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.014996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.020972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId: src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.023234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.082668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432544971:3127]
2025-10-02T09:32:45.082830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1657, pipe: [1:7556555003432544971:3127]
2025-10-02T09:32:45.125267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.125611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.125620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.125632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432544971:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.125786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432544971:3127]
2025-10-02T09:32:45.125806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.125816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:45.125819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:45.125885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1658 reason: error at write: Disconnected sessionId: src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0
2025-10-02T09:32:45.125929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.126025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1658 sessionId: src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0 is DEAD
2025-10-02T09:32:45.126203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:45.126218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Write session will restart in 0.008926s
2025-10-02T09:32:45.126241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Write session: Do CDS request
2025-10-02T09:32:45.126246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.136173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.136211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.136217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1659
2025-10-02T09:32:45.136404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.136423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.136429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.136432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.136693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1659 sessionId:  describe result for acl check
2025-10-02T09:32:45.136724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.136728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.136729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.136732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432545249:2680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.137083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432545249:2680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:45.137546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:45.138451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432545249:2680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:45.138851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:45.138951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:45.138958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:45.138964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:45.138989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:45.139012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555003356995381:9830]
2025-10-02T09:32:45.139352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:45.139540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:45.139564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:45.139734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:45.139764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.139768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.139769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.139769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.139770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.139770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.139771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.139772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.139772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.139773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.139773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.139774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.139777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.139782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.139784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.139786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.139788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.139790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.139792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.139794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.139796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.139798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.139800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.139802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.139806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.139810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.139813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.139816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.139818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.139821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.139823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.139825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.139828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.139830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.139832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.139835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.139837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.139840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.139842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.139844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.139847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.139849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.139851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.139854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.139856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.139859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.139862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.139864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.139881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.141782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432545249:2680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:45.141791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432545249:2680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:45.141793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432545249:2680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:45.141796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:45.147263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.148687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.148699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.148700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.148702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.148705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1658 [2:7556555003356995381:9830]
2025-10-02T09:32:45.148712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.148721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.148726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.148727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.148728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.148737Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.148740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.148744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.148773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.148777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.148779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.148780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.148782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.148832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.148837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.148844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.148849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.148857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.148869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545291:2680], now have 1 active actors on pipe
2025-10-02T09:32:45.148874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432544972:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.148878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.148879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.148880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.148888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.148896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.148903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.148908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.148910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.148912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.148914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.148921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.148925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.148926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.148922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1658
2025-10-02T09:32:45.148944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1658
2025-10-02T09:32:45.149006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.149011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.149028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.149035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.149038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.149039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.149044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.149049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.149056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.149177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.149181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.149188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.149245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1659 partition: 0 MaxSeqNo: 36 sessionId: src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0
2025-10-02T09:32:45.149462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fabedb7c-8cf4895e-4655938d-a0ba8ea0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.151943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Write session: try to update token
2025-10-02T09:32:45.151953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.158095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.158109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.158111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.158112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.158117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.158119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.158122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555003356995375:9830]
2025-10-02T09:32:45.158142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.158148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.158149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.158156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.158166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.158168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.158281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.164092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId: src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.166376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.226008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432545306:3127]
2025-10-02T09:32:45.226202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1658, pipe: [1:7556555003432545306:3127]
2025-10-02T09:32:45.270621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.270838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.270848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.270860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545306:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.270996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.271037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432545306:3127]
2025-10-02T09:32:45.271051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:45.271058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.271120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1659 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0
2025-10-02T09:32:45.271263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1659 sessionId: src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0 is DEAD
2025-10-02T09:32:45.271400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:45.271408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Write session will restart in 0.008585s
2025-10-02T09:32:45.271425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Write session: Do CDS request
2025-10-02T09:32:45.271430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.281252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.281275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.281284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1660
2025-10-02T09:32:45.281489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.281516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.281525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.281532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.281825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1660 sessionId:  describe result for acl check
2025-10-02T09:32:45.281850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.281855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.281856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.281859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432545586:2682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.282203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432545586:2682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:45.282332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:45.283493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:45.283588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:45.283594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:45.283599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:45.283625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:45.283648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555003356995627:9833]
2025-10-02T09:32:45.283711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432545586:2682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:45.283980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:45.284153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:45.284174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:45.284356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:45.284384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.284388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.284389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.284390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.284390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.284391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.284391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.284391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.284392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.284392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.284393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.284393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.284396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.284401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.284403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.284405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.284407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.284409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.284411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.284413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.284415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.284417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.284419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.284421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.284424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.284428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.284431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.284434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.284436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.284438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.284441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.284443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.284446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.284448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.284451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.284453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.284455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.284458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.284460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.284463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.284465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.284468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.284470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.284473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.284476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.284479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.284481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.284483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.284502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.288274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432545586:2682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:45.288283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432545586:2682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:45.288284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432545586:2682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:45.288287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:45.291916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.293493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.293503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.293505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.293506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.293510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1659 [2:7556555003356995627:9833]
2025-10-02T09:32:45.293516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.293525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.293529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.293531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.293532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.293540Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.293546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.293550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.293581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.293585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.293586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.293588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.293589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.293625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.293630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.293636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.293641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.293652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.293665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545627:2682], now have 1 active actors on pipe
2025-10-02T09:32:45.293670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545307:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.293673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.293675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.293676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.293684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.293693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.293699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.293701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.293702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.293703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.293704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.293718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.293722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.293710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1659
2025-10-02T09:32:45.293725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1659
2025-10-02T09:32:45.293731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.293741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.293743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.293758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.293764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.293766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.293767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.293772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.293776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.293786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.293884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.293889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.293897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.293962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1660 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0
2025-10-02T09:32:45.294166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55021ed-5b3b8c09-4c02cbce-82a91d41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.296362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Write session: try to update token
2025-10-02T09:32:45.296372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.302844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.302856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.302858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.302858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.302863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.302865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.302867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555003356995621:9833]
2025-10-02T09:32:45.302887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.302890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.302891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.302898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.302902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.302904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.302992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.308328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId: src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.310621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.371422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432545635:3127]
2025-10-02T09:32:45.371573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1659, pipe: [1:7556555003432545635:3127]
2025-10-02T09:32:45.412400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.412593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.412601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.412613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545635:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.412729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.412779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432545635:3127]
2025-10-02T09:32:45.412815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:45.412863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1660 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0
2025-10-02T09:32:45.412988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1660 sessionId: src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0 is DEAD
2025-10-02T09:32:45.413109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:45.413114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Write session will restart in 0.009540s
2025-10-02T09:32:45.413102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.413129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Write session: Do CDS request
2025-10-02T09:32:45.413134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.423229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.423262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.423271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1661
2025-10-02T09:32:45.423587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.423614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.423619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.423622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.423826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1661 sessionId:  describe result for acl check
2025-10-02T09:32:45.423844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.423848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.423849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.423852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432545931:2670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.424166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432545931:2670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:45.424930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:45.425231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432545931:2670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:45.426373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:45.426466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:45.426472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:45.426478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:45.426503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:45.426523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555003356995906:9841]
2025-10-02T09:32:45.426878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:45.427055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:45.427079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:45.427126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432545931:2670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:45.427135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432545931:2670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:45.427137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432545931:2670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:45.427141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:45.427252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:45.427279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.427283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.427283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.427284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.427284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.427285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.427285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.427286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.427287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.427287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.427288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.427288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.427291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.427297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.427299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.427301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.427303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.427305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.427308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.427309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.427311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.427314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.427316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.427318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.427321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.427325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.427328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.427331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.427333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.427336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.427338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.427341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.427343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.427346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.427348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.427354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.427356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.427359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.427361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.427364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.427369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.427372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.427374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.427377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.427379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.427381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.427384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.427386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.427404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.435067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.436702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.436714Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.436715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.436716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.436720Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1660 [2:7556555003356995906:9841]
2025-10-02T09:32:45.436727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.436736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.436740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.436741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.436742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.436752Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.436755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.436759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.436792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.436797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.436798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.436814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.436816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.436857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.436862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.436869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.436874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.436882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.436896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545649:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.436902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545977:2670], now have 1 active actors on pipe
2025-10-02T09:32:45.436905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.436907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.436908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.436915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.436926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.436934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.436937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.436939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.436943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.436944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.436955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.436960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.436967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.436946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1660
2025-10-02T09:32:45.436980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.436958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1660
2025-10-02T09:32:45.436985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.437000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.437003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.437009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.437010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.437014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.437019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.437029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.437128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.437133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.437140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.437195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1661 partition: 0 MaxSeqNo: 36 sessionId: src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0
2025-10-02T09:32:45.437432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e45dc11-47ac358a-3d959ce4-1d7bb7a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.440094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Write session: try to update token
2025-10-02T09:32:45.440109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.446539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.446551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.446553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.446554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.446557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.446560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.446561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555003356995901:9841]
2025-10-02T09:32:45.446581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.446584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.446584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.446585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.446587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.446589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.446690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.452350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId: src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.454459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.512737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432545986:3127]
2025-10-02T09:32:45.512901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1660, pipe: [1:7556555003432545986:3127]
2025-10-02T09:32:45.558961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.559276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.559287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.559300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545986:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.559507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.559541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:45.559544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:45.559563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432545986:3127]
2025-10-02T09:32:45.559601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1661 reason: error at write: Disconnected sessionId: src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0
2025-10-02T09:32:45.559754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1661 sessionId: src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0 is DEAD
2025-10-02T09:32:45.559887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:45.559901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Write session will restart in 0.006793s
2025-10-02T09:32:45.559923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Write session: Do CDS request
2025-10-02T09:32:45.559932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.560673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.568170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.568276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.568283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1662
2025-10-02T09:32:45.568402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.568423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.568430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.568432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.568738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1662 sessionId:  describe result for acl check
2025-10-02T09:32:45.568765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.568770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.568771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.568774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432546206:2665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.569175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432546206:2665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:45.570569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432546206:2665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:45.570941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:45.572231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:45.572427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:45.572437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:45.572444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:45.572478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:45.572503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555003356996150:9849]
2025-10-02T09:32:45.572516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432546206:2665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:45.572527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432546206:2665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:45.572530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432546206:2665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:45.572534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:45.572860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:45.573041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:45.573066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:45.573243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:45.573273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.573277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.573278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.573278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.573279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.573279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.573280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.573280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.573281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.573281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.573282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.573282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.573285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.573291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.573293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.573295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.573297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.573299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.573301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.573303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.573305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.573307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.573309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.573311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.573314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.573319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.573322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.573325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.573327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.573330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.573332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.573335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.573337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.573340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.573343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.573346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.573348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.573352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.573354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.573357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.573360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.573363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.573364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.573367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.573369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.573372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.573374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.573376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.573392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.580850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.582333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.582344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.582345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.582347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.582351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1661 [2:7556555003356996150:9849]
2025-10-02T09:32:45.582357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.582367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.582369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.582370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.582371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.582380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.582386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.582390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.582419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.582424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.582425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.582427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.582428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.582464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.582470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.582476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.582481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.582489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.582500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546306:2665], now have 1 active actors on pipe
2025-10-02T09:32:45.582507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432545988:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.582510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.582511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.582512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.582520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.582527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.582532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.582534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.582534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.582536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.582536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.582549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.582554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.582555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.582544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1661
2025-10-02T09:32:45.582563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1661
2025-10-02T09:32:45.582567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.582572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.582590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.582597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.582599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.582600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.582605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.582610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.582618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.582688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.582693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.582700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.582757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1662 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0
2025-10-02T09:32:45.582973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811a7f97-2f8af4c1-a77fd92-39b898ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.585411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Write session: try to update token
2025-10-02T09:32:45.585422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.591686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.591701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.591702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.591703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.591708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.591711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.591713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555003356996144:9849]
2025-10-02T09:32:45.591732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.591735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.591736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.591738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.591742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.591744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.591855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.597578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId: src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.599673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.659691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432546317:3127]
2025-10-02T09:32:45.659896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1661, pipe: [1:7556555003432546317:3127]
2025-10-02T09:32:45.701476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.701783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.701792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.701804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546317:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.701917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.701936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:45.701947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:45.701961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432546317:3127]
2025-10-02T09:32:45.701978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.701992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1662 reason: error at write: Disconnected sessionId: src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0
2025-10-02T09:32:45.702145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1662 sessionId: src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0 is DEAD
2025-10-02T09:32:45.702273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:45.702278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Write session will restart in 0.007954s
2025-10-02T09:32:45.702293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Write session: Do CDS request
2025-10-02T09:32:45.702297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.711189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.711298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.711306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1663
2025-10-02T09:32:45.711418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.711440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.711446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.711449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.711789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1663 sessionId:  describe result for acl check
2025-10-02T09:32:45.711820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.711826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.711828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.711832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432546600:2659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.712293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432546600:2659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:45.712616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:45.713788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432546600:2659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:45.713944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:45.714043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:45.714049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:45.714055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:45.714081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:45.714106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555003356996395:9851]
2025-10-02T09:32:45.714457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:45.714633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:45.714656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:45.714842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:45.714873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.714879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.714880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.714881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.714881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.714882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.714883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.714883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.714884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.714884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.714885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.714885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.714888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.714894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.714896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.714898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.714901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.714903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.714905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.714907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.714908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.714911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.714913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.714915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.714918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.714922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.714926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.714929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.714931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.714934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.714936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.714939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.714941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.714944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.714946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.714949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.714951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.714954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.714956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.714959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.714961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.714964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.714966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.714969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.714971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.714973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.714976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.714979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.714997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.715328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432546600:2659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:45.715336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432546600:2659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:45.715338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432546600:2659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:45.715342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:45.722786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.724518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.724530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.724532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.724534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.724537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1662 [2:7556555003356996395:9851]
2025-10-02T09:32:45.724545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.724554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.724556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.724557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.724558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.724567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.724570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.724574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.724604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.724608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.724609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.724611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.724612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.724664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.724671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.724678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.724684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.724693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.724704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546642:2659], now have 1 active actors on pipe
2025-10-02T09:32:45.724708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546319:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.724712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.724713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.724715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.724723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.724734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.724740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.724742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.724740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1662
2025-10-02T09:32:45.724747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1662
2025-10-02T09:32:45.724743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.724750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.724752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.724758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.724760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.724766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.724780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.724782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.724799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.724820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.724822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.724823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.724828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.724833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.724841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.724935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.724941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.724949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.724999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1663 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0
2025-10-02T09:32:45.725232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3d948a0-772fedae-2bb2acfd-769b225c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.727451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Write session: try to update token
2025-10-02T09:32:45.727462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.734665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.734681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.734682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.734684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.734690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.734693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.734695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555003356996389:9851]
2025-10-02T09:32:45.734717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.734720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.734722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.734721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.734725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.734727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.734852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.739371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId: src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.741570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.802028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432546649:3127]
2025-10-02T09:32:45.802230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1662, pipe: [1:7556555003432546649:3127]
2025-10-02T09:32:45.846065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.846243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.846251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.846276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546649:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.846391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.846431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.846459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432546649:3127]
2025-10-02T09:32:45.846463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:45.846572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1663 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0
2025-10-02T09:32:45.846699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1663 sessionId: src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0 is DEAD
2025-10-02T09:32:45.846826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:45.846831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Write session will restart in 0.006314s
2025-10-02T09:32:45.846849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Write session: Do CDS request
2025-10-02T09:32:45.846854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.854082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.854190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.854200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1664
2025-10-02T09:32:45.854297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.854317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.854323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.854326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.854709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1664 sessionId:  describe result for acl check
2025-10-02T09:32:45.854738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.854751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.854752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.854757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432546868:2651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.855218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432546868:2651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:45.856780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432546868:2651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:45.857213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:45.858460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:45.858561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:45.858568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:45.858573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:45.858600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:45.858653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555003356996652:9854]
2025-10-02T09:32:45.858678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432546868:2651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:45.858687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432546868:2651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:45.858689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432546868:2651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:45.858692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:45.859004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:45.859167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:45.859190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:45.859363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:45.859392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.859396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.859396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.859397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.859397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.859398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.859398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.859399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.859399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.859400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.859400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.859401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.859404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.859409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.859411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.859413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.859415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.859417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.859419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.859421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.859423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.859427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.859429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.859431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.859434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.859438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:45.859441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.859444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:45.859446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.859449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:45.859451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.859453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:45.859456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.859458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:45.859460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.859467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:45.859469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.859472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:45.859474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.859477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:45.859481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.859485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:45.859487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.859489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.859492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.859495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.859496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.859499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.859514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:45.867000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:45.868590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:45.868601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:45.868602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:45.868604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:45.868607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1663 [2:7556555003356996652:9854]
2025-10-02T09:32:45.868614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:45.868624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:45.868625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.868627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.868628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.868637Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:45.868640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:45.868644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:45.868674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.868679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.868680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.868682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:45.868684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:45.868719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:45.868726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.868732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:45.868737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:45.868745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:45.868757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546978:2651], now have 1 active actors on pipe
2025-10-02T09:32:45.868762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432546657:2446], now have 1 active actors on pipe
2025-10-02T09:32:45.868765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.868767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.868768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.868775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:45.868782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:45.868791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:45.868786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1663
2025-10-02T09:32:45.868792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:45.868792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1663
2025-10-02T09:32:45.868794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:45.868811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:45.868812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:45.868820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.868822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:45.868831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:45.868836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.868838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.868857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:45.868864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:45.868867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:45.868868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:45.868873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:45.868877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:45.868887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.868964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.868970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.868978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:45.869026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1664 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0
2025-10-02T09:32:45.869258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277bc5-f698b2d6-38db95d8-673d35ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:45.872011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Write session: try to update token
2025-10-02T09:32:45.872026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:45.877922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:45.877934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:45.877935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:45.877936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:45.877940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.877943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.877944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555003356996646:9854]
2025-10-02T09:32:45.877964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:45.877966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:45.877968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:45.877970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:45.877970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:45.877971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:45.878077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:45.885095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId: src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:45.887224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:45.946397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555003432547004:3127]
2025-10-02T09:32:45.946577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1663, pipe: [1:7556555003432547004:3127]
2025-10-02T09:32:45.990312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:45.990673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:45.990686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:45.990699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432547004:3127], now have 1 active actors on pipe
2025-10-02T09:32:45.990840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:45.990892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555003432547004:3127]
2025-10-02T09:32:45.990929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:45.990937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:45.990981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1664 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0
2025-10-02T09:32:45.991116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1664 sessionId: src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0 is DEAD
2025-10-02T09:32:45.991289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:45.991304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Write session will restart in 0.005263s
2025-10-02T09:32:45.991325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Write session: Do CDS request
2025-10-02T09:32:45.991331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:45.997136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.997194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:45.997203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1665
2025-10-02T09:32:45.997291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:45.997309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:45.997315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:45.997318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:45.997631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1665 sessionId:  describe result for acl check
2025-10-02T09:32:45.997660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:45.997666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:45.997668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:45.997671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555003432547112:2641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:45.998121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555003432547112:2641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.000081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555003432547112:2641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.002147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555003432547112:2641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.002159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555003432547112:2641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.002161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555003432547112:2641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.002166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.002350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.003680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.003855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.003863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.003869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.003899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.003925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651964198:9857]
2025-10-02T09:32:46.004382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.004541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.004571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.004749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.004780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.004786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.004787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.004787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.004788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.004789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.004789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.004790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.004790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.004791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.004791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.004792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.004795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.004811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.004813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.004815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.004817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.004819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.004821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.004823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.004826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.004828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.004830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.004831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.004835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.004839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.004842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.004845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.004847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.004850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.004853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.004856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.004858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.004861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.004863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.004866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.004868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.004870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.004872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.004875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.004877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.004880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.004882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.004885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.004888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.004891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.004893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.004896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.004913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.012497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.014023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.014034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.014035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.014037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.014041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1664 [2:7556555007651964198:9857]
2025-10-02T09:32:46.014047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.014056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.014057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.014059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.014060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.014068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.014075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.014079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.014110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.014115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.014116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.014117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.014119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.014161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.014167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.014174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.014179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.014187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.014197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555003432547005:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.014203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727514620:2641], now have 1 active actors on pipe
2025-10-02T09:32:46.014207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.014209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.014210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.014217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.014224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.014232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.014235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.014235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.014237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.014237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.014250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.014255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.014244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1664
2025-10-02T09:32:46.014248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1664
2025-10-02T09:32:46.014264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.014285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.014290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.014304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c24882d-a681a63f-e0817ad8-2f658924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.014311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.014313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.014314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.014320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.014325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.014335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.014442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.014447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.014454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.014508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1665 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c24882d-a681a63f-e0817ad8-2f658924_0
2025-10-02T09:32:46.014725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea508855-b635f2f6-3cc428d3-c13225fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c24882d-a681a63f-e0817ad8-2f658924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.017276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Write session: try to update token
2025-10-02T09:32:46.017286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.023501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:46.023516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.023522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.023545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:46.023546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:46.023723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:46.023842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:46.023953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:46.024101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:46.024261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:46.024285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:46.028860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId: src_id|7c24882d-a681a63f-e0817ad8-2f658924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.030828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.030936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.030944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.030959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:46.031017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:46.032630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.032643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.032645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.032646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.032650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.032653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.032655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651964191:9857]
2025-10-02T09:32:46.032679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.032680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.032683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.032686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.032686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.032688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.032816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.091309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727514634:3127]
2025-10-02T09:32:46.091507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1664, pipe: [1:7556555007727514634:3127]
2025-10-02T09:32:46.143911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:46.149967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.149986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.150114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.150162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.150215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.150270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.150308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.150315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.150367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.150417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.150465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.150516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.150554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.150559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.150611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.150657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.150708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.150768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.150808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.150813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.150862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.150910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.150959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.151009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.151051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.151056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.151141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.151190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.151240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.151290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.151330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.151335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.151385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.151437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.151489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.151538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.151588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.151593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.151641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.151687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.151735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.151786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.151821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.151826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.151873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.151918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.151970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.152024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.152058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.152063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.152109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.152156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.152205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.152252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.152301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.152306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.152353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:46.152399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:46.152446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:46.152491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:46.152535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:46.152540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:46.152570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727514634:3127], now have 1 active actors on pipe
2025-10-02T09:32:46.152739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:46.152772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:46.152775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:46.152777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727514634:3127]
2025-10-02T09:32:46.152810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1665 reason: error at write: Disconnected sessionId: src_id|7c24882d-a681a63f-e0817ad8-2f658924_0
2025-10-02T09:32:46.152959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1665 sessionId: src_id|7c24882d-a681a63f-e0817ad8-2f658924_0 is DEAD
2025-10-02T09:32:46.153083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:46.153088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Write session will restart in 0.005725s
2025-10-02T09:32:46.153108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Write session: Do CDS request
2025-10-02T09:32:46.153112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:46.153181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:46.160138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:46.160144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1666
2025-10-02T09:32:46.160158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.160398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.160418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:46.160423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:46.160425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:46.160899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1666 sessionId:  describe result for acl check
2025-10-02T09:32:46.160927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:46.160933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:46.160935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:46.160938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555007727514819:2631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:46.161384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555007727514819:2631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.163548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555007727514819:2631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.163897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.165225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.165349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.165356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.165363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.165390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.165416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651964444:9859]
2025-10-02T09:32:46.165427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555007727514819:2631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.165436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555007727514819:2631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.165438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555007727514819:2631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.165441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.165754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.165910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.165932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.166105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.166133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.166137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.166137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.166138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.166139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.166139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.166139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.166140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.166140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.166141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.166142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.166142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.166145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.166150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.166153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.166155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.166156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.166158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.166160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.166162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.166164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.166166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.166168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.166170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.166173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.166178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.166181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.166184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.166186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.166188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.166191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.166193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.166195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.166198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.166200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.166202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.166204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.166207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.166209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.166212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.166214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.166217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.166219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.166222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.166227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.166230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.166231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.166234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.166252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.173705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.175286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.175297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.175299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.175300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.175304Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1665 [2:7556555007651964444:9859]
2025-10-02T09:32:46.175311Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.175321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.175324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.175325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.175326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.175335Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.175341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.175345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.175376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.175380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.175381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.175383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.175384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.175421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.175426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.175432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.175437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.175445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.175456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727514957:2631], now have 1 active actors on pipe
2025-10-02T09:32:46.175461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727514635:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.175464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.175466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.175467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.175475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.175483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.175489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.175491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.175493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.175493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.175494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.175489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1665
2025-10-02T09:32:46.175501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1665
2025-10-02T09:32:46.175508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.175511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.175519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.175524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.175527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.175546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3465635c-d8927de8-549f14fc-8aa63f21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.175553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.175555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.175556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.175561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.175566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.175575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.175659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.175664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.175671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.175722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1666 partition: 0 MaxSeqNo: 36 sessionId: src_id|3465635c-d8927de8-549f14fc-8aa63f21_0
2025-10-02T09:32:46.175917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c24882d-a681a63f-e0817ad8-2f658924_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3465635c-d8927de8-549f14fc-8aa63f21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.178074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Write session: try to update token
2025-10-02T09:32:46.178085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.184742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.184753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.184754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.184756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.184760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.184763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.184765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651964438:9859]
2025-10-02T09:32:46.184784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.184786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.184787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.184789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.184789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.184790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.184958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.189601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId: src_id|3465635c-d8927de8-549f14fc-8aa63f21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.191605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.253091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727514971:3127]
2025-10-02T09:32:46.253287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1665, pipe: [1:7556555007727514971:3127]
2025-10-02T09:32:46.297104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:46.297437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.297447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.297472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727514971:3127], now have 1 active actors on pipe
2025-10-02T09:32:46.297608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:46.297618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727514971:3127]
2025-10-02T09:32:46.297637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:46.297655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:46.297727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1666 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3465635c-d8927de8-549f14fc-8aa63f21_0
2025-10-02T09:32:46.297900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1666 sessionId: src_id|3465635c-d8927de8-549f14fc-8aa63f21_0 is DEAD
2025-10-02T09:32:46.298055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:46.298068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Write session will restart in 0.008301s
2025-10-02T09:32:46.298091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Write session: Do CDS request
2025-10-02T09:32:46.298097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:46.307182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.307273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:46.307282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1667
2025-10-02T09:32:46.307429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.307450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:46.307455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:46.307458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:46.307733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1667 sessionId:  describe result for acl check
2025-10-02T09:32:46.307752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:46.307757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:46.307758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:46.307761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555007727515240:2630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:46.308100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555007727515240:2630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.308941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.309262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555007727515240:2630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.310253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.310348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.310355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.310361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.310385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.310409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651964695:9862]
2025-10-02T09:32:46.310754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.310756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555007727515240:2630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.310766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555007727515240:2630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.310768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555007727515240:2630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.310771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.310920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.310942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.311114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.311142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.311146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.311146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.311147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.311147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.311148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.311148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.311149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.311149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.311150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.311150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.311151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.311154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.311159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.311161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.311163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.311165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.311167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.311169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.311171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.311173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.311175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.311177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.311179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.311183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.311186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.311189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.311192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.311194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.311197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.311199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.311201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.311205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.311207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.311209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.311212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.311214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.311216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.311218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.311221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.311223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.311225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.311227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.311230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.311232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.311235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.311237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.311241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.311257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.318702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.320262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.320273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.320274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.320277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.320280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1666 [2:7556555007651964695:9862]
2025-10-02T09:32:46.320287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.320296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.320297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.320299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.320300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.320309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.320316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.320320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.320352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.320357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.320358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.320360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.320361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.320397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.320402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.320408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.320413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.320421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.320433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727514972:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.320439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515295:2630], now have 1 active actors on pipe
2025-10-02T09:32:46.320442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.320443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.320444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.320451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.320458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.320467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.320469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.320469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.320462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1666
2025-10-02T09:32:46.320475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1666
2025-10-02T09:32:46.320470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.320471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.320484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.320485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.320487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.320501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.320503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.320521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.320527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.320530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.320531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.320536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.320540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.320549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.320642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.320647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.320654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.320707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1667 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0
2025-10-02T09:32:46.320933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3465635c-d8927de8-549f14fc-8aa63f21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.323111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Write session: try to update token
2025-10-02T09:32:46.323121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.329790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.329804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.329806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.329807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.329811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.329814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.329816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651964689:9862]
2025-10-02T09:32:46.329837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.329838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.329839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.329841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.329842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.329844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.329954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.335327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId: src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.337380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.397994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727515307:3127]
2025-10-02T09:32:46.398185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1666, pipe: [1:7556555007727515307:3127]
2025-10-02T09:32:46.442663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:46.442981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.442991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.443003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515307:3127], now have 1 active actors on pipe
2025-10-02T09:32:46.443113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:46.443168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:46.443208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:46.443267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0
2025-10-02T09:32:46.443422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1667 sessionId: src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0 is DEAD
2025-10-02T09:32:46.443535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:46.443546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Write session will restart in 0.008634s
2025-10-02T09:32:46.443561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Write session: Do CDS request
2025-10-02T09:32:46.443566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:46.443566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727515307:3127]
2025-10-02T09:32:46.453136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.453214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:46.453224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1668
2025-10-02T09:32:46.453298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.453316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:46.453321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:46.453324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:46.453580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1668 sessionId:  describe result for acl check
2025-10-02T09:32:46.453605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:46.453609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:46.453610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:46.453613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555007727515619:2601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:46.453910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555007727515619:2601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.454345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.454932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555007727515619:2601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.455666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.455756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.455762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.455767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.455792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.455835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651964982:9870]
2025-10-02T09:32:46.456177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.456334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.456357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.456533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.456560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.456564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.456565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.456566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.456566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.456566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.456567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.456567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.456568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.456568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.456569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.456570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.456572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.456578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.456580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.456582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.456584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.456586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.456588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.456590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.456592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.456594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.456596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.456598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.456602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.456606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.456609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.456611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.456614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.456616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.456618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.456621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.456623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.456626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.456628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.456630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.456632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.456634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.456636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.456639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.456641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.456643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.456645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.456648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.456650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.456652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.456654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.456657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.456672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.456795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555007727515619:2601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.456813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555007727515619:2601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.456815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555007727515619:2601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.456819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.464234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.465823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.465835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.465836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.465838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.465842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1667 [2:7556555007651964982:9870]
2025-10-02T09:32:46.465848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.465858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.465864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.465866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.465867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.465876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.465879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.465884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.465919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.465924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.465925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.465927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.465928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.465967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.465972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.465978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.465983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.465991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.466002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.466005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.466006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.466011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.466018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.466019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515658:2601], now have 1 active actors on pipe
2025-10-02T09:32:46.466020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.466021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.466021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515321:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.466026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.466033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.466035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.466048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.466053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.466064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.466064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1667
2025-10-02T09:32:46.466073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1667
2025-10-02T09:32:46.466111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.466116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.466132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.466138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.466140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.466141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.466146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.466153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.466164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.466254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.466259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.466265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.466315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1668 partition: 0 MaxSeqNo: 36 sessionId: src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0
2025-10-02T09:32:46.466509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6790ff6-c074976f-cd6197c6-62cdb008_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.468734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Write session: try to update token
2025-10-02T09:32:46.468745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.475899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.475915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.475917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.475918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.475922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.475924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.475926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651964976:9870]
2025-10-02T09:32:46.475947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.475953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.475954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.475958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.475961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.475965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.476067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.480581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId: src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.482710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.543898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727515669:3127]
2025-10-02T09:32:46.544073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1667, pipe: [1:7556555007727515669:3127]
2025-10-02T09:32:46.588961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:46.589292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.589302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.589329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515669:3127], now have 1 active actors on pipe
2025-10-02T09:32:46.589462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:46.589472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727515669:3127]
2025-10-02T09:32:46.589506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:46.589508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:46.589550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1668 reason: error at write: Disconnected sessionId: src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0
2025-10-02T09:32:46.589555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:46.589690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1668 sessionId: src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0 is DEAD
2025-10-02T09:32:46.589812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:46.589817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Write session will restart in 0.007563s
2025-10-02T09:32:46.589836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Write session: Do CDS request
2025-10-02T09:32:46.589841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:46.598097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.598305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:46.598314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1669
2025-10-02T09:32:46.598408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.598428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:46.598433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:46.598436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:46.598699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1669 sessionId:  describe result for acl check
2025-10-02T09:32:46.598718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:46.598722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:46.598723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:46.598726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555007727515900:2598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:46.599068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555007727515900:2598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.600654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555007727515900:2598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.602147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.602399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.602488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.602494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.602500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.602523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.602544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651965233:9878]
2025-10-02T09:32:46.602599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555007727515900:2598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.602607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555007727515900:2598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.602609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555007727515900:2598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.602613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.602890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.603051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.603074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.603246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.603274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.603278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.603279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.603279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.603280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.603280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.603281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.603282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.603282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.603283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.603283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.603284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.603287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.603292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.603296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.603298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.603300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.603302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.603304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.603306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.603309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.603311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.603313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.603316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.603320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.603324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.603327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.603329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.603332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.603334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.603336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.603340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.603343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.603345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.603348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.603350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.603353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.603355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.603358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.603361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.603364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.603366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.603368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.603371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.603376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.603379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.603381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.603402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.610737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.612181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.612193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.612194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.612196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.612200Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1668 [2:7556555007651965233:9878]
2025-10-02T09:32:46.612206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.612216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.612220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.612222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.612223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.612232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.612235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.612239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.612270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.612275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.612276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.612278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.612279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.612314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.612319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.612325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.612330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.612338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.612352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515995:2598], now have 1 active actors on pipe
2025-10-02T09:32:46.612357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727515670:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.612360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.612362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.612363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.612370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.612377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.612386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.612387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.612389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.612395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.612397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.612402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.612388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1668
2025-10-02T09:32:46.612404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.612409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.612398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1668
2025-10-02T09:32:46.612422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.612424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.612441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.612449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.612451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.612452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.612458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.612463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.612473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.612600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.612603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.612610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.612669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1669 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0
2025-10-02T09:32:46.612887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65018411-87db1f81-c27d4392-ef8a0ce2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.615061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Write session: try to update token
2025-10-02T09:32:46.615071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.621696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.621709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.621710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.621711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.621716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.621719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.621721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651965228:9878]
2025-10-02T09:32:46.621742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.621745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.621746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.621747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.621751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.621753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.622417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.627662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId: src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.629830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.689811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727516008:3127]
2025-10-02T09:32:46.689975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1668, pipe: [1:7556555007727516008:3127]
2025-10-02T09:32:46.734774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:46.735173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.735183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.735195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516008:3127], now have 1 active actors on pipe
2025-10-02T09:32:46.735336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:46.735386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727516008:3127]
2025-10-02T09:32:46.735418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:46.735421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:46.735490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1669 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0
2025-10-02T09:32:46.735649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1669 sessionId: src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0 is DEAD
2025-10-02T09:32:46.735789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:46.735798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Write session will restart in 0.006854s
2025-10-02T09:32:46.735812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Write session: Do CDS request
2025-10-02T09:32:46.735816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:46.743144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.743238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:46.743244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1670
2025-10-02T09:32:46.743339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.743358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:46.743364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:46.743367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:46.743746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1670 sessionId:  describe result for acl check
2025-10-02T09:32:46.743775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:46.743782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:46.743783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:46.743787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555007727516190:2595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:46.744250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555007727516190:2595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.745770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555007727516190:2595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.747205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.748552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.748650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.748657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.748663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.748658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555007727516190:2595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.748666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555007727516190:2595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.748668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555007727516190:2595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.748671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.748687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.748711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651965485:9880]
2025-10-02T09:32:46.749061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.749240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.749262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.749438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.749467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.749471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.749472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.749472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.749473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.749473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.749474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.749474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.749475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.749475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.749476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.749477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.749479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.749485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.749487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.749490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.749492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.749494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.749496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.749497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.749499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.749503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.749505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.749506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.749510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.749514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.749517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.749520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.749522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.749525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.749527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.749530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.749533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.749536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.749538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.749541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.749543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.749546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.749548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.749551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.749555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.749557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.749559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.749562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.749565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.749567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.749572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.749575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.749590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.757000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.758551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.758561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.758561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.758563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.758567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1669 [2:7556555007651965485:9880]
2025-10-02T09:32:46.758574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.758582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.758585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.758587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.758588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.758597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.758603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.758607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.758635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.758640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.758641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.758642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.758644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.758685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.758689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.758695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.758701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.758709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.758723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516009:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.758728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516334:2595], now have 1 active actors on pipe
2025-10-02T09:32:46.758732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.758733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.758735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.758751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.758758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.758760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.758763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.758764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.758769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.758770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.758783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.758792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.758789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1669
2025-10-02T09:32:46.758799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.758794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1669
2025-10-02T09:32:46.758823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.758828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.758842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.758849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.758851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.758852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.758857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.758862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.758869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.758961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.758966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.758973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.759026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1670 partition: 0 MaxSeqNo: 36 sessionId: src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0
2025-10-02T09:32:46.759248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9204413-6502062e-4ca9a5f9-6eec7ad3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.761512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Write session: try to update token
2025-10-02T09:32:46.761521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.772161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:46.772175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.772180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.772206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:46.772217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:46.772346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:46.772466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:46.772578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:46.772691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:46.772870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:46.772896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:46.776375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.776386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.776387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.776388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.776393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.776396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.776399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651965479:9880]
2025-10-02T09:32:46.776418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.776425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.776425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.776426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.776428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.776430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.776536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.777130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId: src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.779222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.835730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727516351:3127]
2025-10-02T09:32:46.835856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1669, pipe: [1:7556555007727516351:3127]
2025-10-02T09:32:46.888778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:46.889088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.889097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.889110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516351:3127], now have 1 active actors on pipe
2025-10-02T09:32:46.889275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:46.889280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:46.889288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:46.889291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:46.889328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727516351:3127]
2025-10-02T09:32:46.889343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1670 reason: error at write: Disconnected sessionId: src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0
2025-10-02T09:32:46.889493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1670 sessionId: src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0 is DEAD
2025-10-02T09:32:46.889635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:46.889643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Write session will restart in 0.007591s
2025-10-02T09:32:46.889661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Write session: Do CDS request
2025-10-02T09:32:46.889664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:46.898138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.898208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:46.898218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1671
2025-10-02T09:32:46.898313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:46.898336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:46.898342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:46.898344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:46.898704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1671 sessionId:  describe result for acl check
2025-10-02T09:32:46.898724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:46.898729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:46.898730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:46.898732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555007727516594:2590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:46.899084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555007727516594:2590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:46.900574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:46.900624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555007727516594:2590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:46.901831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:46.901937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:46.901943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:46.901949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:46.901976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:46.901997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555007651965750:9883]
2025-10-02T09:32:46.902112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555007727516594:2590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:46.902121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555007727516594:2590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:46.902123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555007727516594:2590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:46.902127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:46.902330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:46.902483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:46.902507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:46.902676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:46.902704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.902707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.902708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.902709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.902709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.902710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.902710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.902711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.902711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.902712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.902712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.902713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.902716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.902721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.902723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.902725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.902727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.902729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.902731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.902733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.902735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.902737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.902739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.902750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.902753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.902757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:46.902761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.902764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:46.902766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.902769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:46.902771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.902773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:46.902776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.902778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:46.902780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.902783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:46.902785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.902787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:46.902790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.902792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:46.902794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.902797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:46.902800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.902802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.902804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.902807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.902809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.902811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.902828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:46.910212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:46.911732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:46.911743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:46.911744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:46.911746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:46.911750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1670 [2:7556555007651965750:9883]
2025-10-02T09:32:46.911757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:46.911766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:46.911771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.911773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.911774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.911782Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:46.911784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:46.911789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:46.911817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.911822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.911823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.911824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:46.911826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:46.911861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:46.911865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.911871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:46.911876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:46.911884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:46.911898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516695:2590], now have 1 active actors on pipe
2025-10-02T09:32:46.911903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516353:2446], now have 1 active actors on pipe
2025-10-02T09:32:46.911907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.911908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.911909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.911916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:46.911924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:46.911931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:46.911933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:46.911934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:46.911935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:46.911935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:46.911928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1670
2025-10-02T09:32:46.911948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.911949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:46.911952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:46.911935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1670
2025-10-02T09:32:46.911969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.911974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.911989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:46.911995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:46.911997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:46.911998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:46.912003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:46.912008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:46.912015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.912107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:46.912112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:46.912119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:46.912171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1671 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0
2025-10-02T09:32:46.912352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81701036-9e5bbbf1-676c2b04-fff0b0fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:46.914532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Write session: try to update token
2025-10-02T09:32:46.914542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:46.921316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:46.921328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:46.921330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:46.921331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:46.921336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.921338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.921340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555007651965744:9883]
2025-10-02T09:32:46.921360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:46.921363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:46.921365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:46.921366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:46.921369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:46.921372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:46.921524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:46.926302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId: src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:46.928385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:46.989354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555007727516706:3127]
2025-10-02T09:32:46.989565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1670, pipe: [1:7556555007727516706:3127]
2025-10-02T09:32:47.033735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.034021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.034030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.034054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555007727516706:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.034164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.034213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555007727516706:3127]
2025-10-02T09:32:47.034229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.034234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:47.034286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1671 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0
2025-10-02T09:32:47.034414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1671 sessionId: src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0 is DEAD
2025-10-02T09:32:47.034558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:47.034568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Write session will restart in 0.005401s
2025-10-02T09:32:47.034584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Write session: Do CDS request
2025-10-02T09:32:47.034589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.041124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.041198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.041206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1672
2025-10-02T09:32:47.041299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.041318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.041324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.041326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.041726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1672 sessionId:  describe result for acl check
2025-10-02T09:32:47.041754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.041760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.041761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.041765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022484170:2585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.042220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022484170:2585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.043849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022484170:2585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.045449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.045647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022484170:2585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.045655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022484170:2585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.045657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022484170:2585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.045661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.046817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.046912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.046918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.046923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.046948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.046969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946933303:9886]
2025-10-02T09:32:47.047299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.047456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.047477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.047650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.047678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.047681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.047682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.047683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.047683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.047683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.047684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.047685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.047685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.047686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.047686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.047687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.047689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.047695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.047697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.047700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.047701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.047703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.047705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.047707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.047709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.047712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.047713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.047715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.047719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.047722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.047726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.047728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.047731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.047733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.047735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.047738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.047740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.047742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.047744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.047747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.047749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.047752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.047755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.047757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.047763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.047765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.047767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.047770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.047772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.047777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.047779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.047782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.047798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.055115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.056581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.056591Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.056592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.056594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.056597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1671 [2:7556555011946933303:9886]
2025-10-02T09:32:47.056604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.056614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.056616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.056617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.056618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.056627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.056630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.056636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.056667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.056672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.056673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.056674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.056676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.056709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.056713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.056719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.056724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.056733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.056745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.056748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.056749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.056753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.056760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.056761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.056761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.056763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.056768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.056769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.056776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484331:2585], now have 1 active actors on pipe
2025-10-02T09:32:47.056778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484004:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.056789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.056797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.056808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.056819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1671
2025-10-02T09:32:47.056831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1671
2025-10-02T09:32:47.056863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.056869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.056887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb69e9b1-876b042e-fba015c3-69856052_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.056895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.056897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.056898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.056903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.056908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.056916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.057024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.057031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.057039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.057090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1672 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb69e9b1-876b042e-fba015c3-69856052_0
2025-10-02T09:32:47.057363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a3928f-ef286e17-6a4b2b9c-8692d274_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb69e9b1-876b042e-fba015c3-69856052_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.059528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Write session: try to update token
2025-10-02T09:32:47.059537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.065999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.066011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.066012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.066013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.066017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.066020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.066023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946933296:9886]
2025-10-02T09:32:47.066039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.066042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.066044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.066044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.066047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.066049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.066170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.070757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId: src_id|eb69e9b1-876b042e-fba015c3-69856052_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.072773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:47.134238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555012022484343:3127]
2025-10-02T09:32:47.134429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1671, pipe: [1:7556555012022484343:3127]
2025-10-02T09:32:47.175436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.175608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.175617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.175642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484343:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.175796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555012022484343:3127]
2025-10-02T09:32:47.175819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:47.175821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:47.175826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.175882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1672 reason: error at write: Disconnected sessionId: src_id|eb69e9b1-876b042e-fba015c3-69856052_0
2025-10-02T09:32:47.176002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1672 sessionId: src_id|eb69e9b1-876b042e-fba015c3-69856052_0 is DEAD
2025-10-02T09:32:47.176109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:47.176114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Write session will restart in 0.008581s
2025-10-02T09:32:47.176128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Write session: Do CDS request
2025-10-02T09:32:47.176137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.176359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.186124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.186210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.186229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1673
2025-10-02T09:32:47.186319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.186339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.186345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.186347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.186615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1673 sessionId:  describe result for acl check
2025-10-02T09:32:47.186638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.186643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.186644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.186646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022484635:2574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.187019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022484635:2574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.187319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.188520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.188555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022484635:2574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.188611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.188617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.188623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.188647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.188671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946933556:9888]
2025-10-02T09:32:47.189026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.189191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.189213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.189388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.189417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.189421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.189422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.189422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.189423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.189423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.189424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.189424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.189425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.189425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.189426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.189426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.189429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.189435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.189437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.189439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.189441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.189443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.189445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.189447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.189449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.189451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.189453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.189455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.189459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.189462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.189465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.189468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.189470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.189473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.189476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.189479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.189482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.189484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.189486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.189489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.189491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.189494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.189496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.189499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.189501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.189504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.189506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.189509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.189511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.189514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.189516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.189518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.189537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.193403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022484635:2574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.193412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022484635:2574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.193413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022484635:2574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.193417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.197051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.198534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.198543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.198545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.198547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.198550Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1672 [2:7556555011946933556:9888]
2025-10-02T09:32:47.198556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.198565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.198567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.198568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.198569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.198578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.198584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.198589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.198620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.198625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.198626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.198628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.198629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.198664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.198669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.198675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.198681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.198692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.198706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484678:2574], now have 1 active actors on pipe
2025-10-02T09:32:47.198711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484344:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.198715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.198717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.198718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.198726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.198736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.198738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.198746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.198748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.198733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1672
2025-10-02T09:32:47.198754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1672
2025-10-02T09:32:47.198755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.198760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.198782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.198787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.198794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.198802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.198810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.198822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db218dab-6b95e230-7264236e-76db4fd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.198829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.198831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.198832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.198836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.198844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.198982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.199089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.199094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.199102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.199150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1673 partition: 0 MaxSeqNo: 36 sessionId: src_id|db218dab-6b95e230-7264236e-76db4fd3_0
2025-10-02T09:32:47.199351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb69e9b1-876b042e-fba015c3-69856052_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db218dab-6b95e230-7264236e-76db4fd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.201579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Write session: try to update token
2025-10-02T09:32:47.201589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.208037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.208047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.208049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.208050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.208054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.208057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.208061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946933550:9888]
2025-10-02T09:32:47.208080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.208083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.208085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.208090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.208095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.208097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.208189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.213771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId: src_id|db218dab-6b95e230-7264236e-76db4fd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.215939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:47.276061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555012022484687:3127]
2025-10-02T09:32:47.276230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1672, pipe: [1:7556555012022484687:3127]
2025-10-02T09:32:47.319333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.319673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.319681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.319707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484687:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.319865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.319898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555012022484687:3127]
2025-10-02T09:32:47.319921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:47.319923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:47.319924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.319968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1673 reason: error at write: Disconnected sessionId: src_id|db218dab-6b95e230-7264236e-76db4fd3_0
2025-10-02T09:32:47.320105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1673 sessionId: src_id|db218dab-6b95e230-7264236e-76db4fd3_0 is DEAD
2025-10-02T09:32:47.320255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:47.320264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Write session will restart in 0.009804s
2025-10-02T09:32:47.320279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Write session: Do CDS request
2025-10-02T09:32:47.320283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.331133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.331216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.331225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1674
2025-10-02T09:32:47.331317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.331336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.331342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.331344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.331607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1674 sessionId:  describe result for acl check
2025-10-02T09:32:47.331632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.331637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.331638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.331641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022484981:2570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.331984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022484981:2570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.332481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.333294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022484981:2570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.333739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.333836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.333842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.333847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.333872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.333892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946933813:9891]
2025-10-02T09:32:47.334225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.334378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.334399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.334571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.334598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.334601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.334602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.334602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.334603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.334603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.334604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.334605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.334605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.334605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.334606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.334606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.334609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.334615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.334617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.334619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.334621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.334623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.334625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.334626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.334628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.334631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.334633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.334635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.334639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.334643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.334646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.334649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.334651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.334653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.334655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.334658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.334660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.334663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.334665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.334667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.334669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.334672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.334674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.334677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.334679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.334681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.334684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.334686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.334688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.334691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.334693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.334695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.334710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.334771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022484981:2570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.334779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022484981:2570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.334781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022484981:2570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.334785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.342014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.343616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.343627Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.343628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.343630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.343633Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1673 [2:7556555011946933813:9891]
2025-10-02T09:32:47.343641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.343650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.343655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.343657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.343658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.343666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.343669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.343673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.343701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.343705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.343706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.343708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.343709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.343744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.343748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.343754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.343759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.343770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.343784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022484688:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.343790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485022:2570], now have 1 active actors on pipe
2025-10-02T09:32:47.343794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.343796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.343797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.343804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.343811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.343816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.343818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.343808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1673
2025-10-02T09:32:47.343819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.343818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1673
2025-10-02T09:32:47.343821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.343823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.343838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.343842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.343843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.343852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.343857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.343881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.343888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.343890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.343891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.343895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.343903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.343912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.343990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.343995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.344002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.344038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1674 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0
2025-10-02T09:32:47.344225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db218dab-6b95e230-7264236e-76db4fd3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.346365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Write session: try to update token
2025-10-02T09:32:47.346374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.353290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.353302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.353303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.353304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.353311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.353313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.353315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946933808:9891]
2025-10-02T09:32:47.353335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.353339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.353340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.353340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.353343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.353345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.353463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.358403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId: src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.360502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:47.419943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555012022485030:3127]
2025-10-02T09:32:47.420107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1673, pipe: [1:7556555012022485030:3127]
2025-10-02T09:32:47.462370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.462608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.462617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.462640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485030:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.462757Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.462784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:47.462792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:47.462832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1674 reason: error at write: Disconnected sessionId: src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0
2025-10-02T09:32:47.462978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1674 sessionId: src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0 is DEAD
2025-10-02T09:32:47.463105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:47.463113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Write session will restart in 0.005291s
2025-10-02T09:32:47.463128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Write session: Do CDS request
2025-10-02T09:32:47.463099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.463132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.463126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555012022485030:3127]
2025-10-02T09:32:47.469163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.469237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.469247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1675
2025-10-02T09:32:47.469331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.469355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.469362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.469365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.469584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1675 sessionId:  describe result for acl check
2025-10-02T09:32:47.469606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.469607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.469608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.469611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022485188:2559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.469906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022485188:2559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.472024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022485188:2559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.473870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.474075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022485188:2559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.474084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022485188:2559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.474086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022485188:2559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.474089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.475197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.475328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.475335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.475341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.475370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.475390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946934084:9899]
2025-10-02T09:32:47.475724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.475889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.475911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.476083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.476110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.476114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.476114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.476115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.476115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.476116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.476116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.476117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.476117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.476118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.476118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.476119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.476122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.476127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.476129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.476131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.476133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.476135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.476137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.476139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.476141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.476144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.476146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.476148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.476151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.476155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.476158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.476160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.476162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.476165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.476167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.476170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.476172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.476174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.476176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.476178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.476180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.476183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.476185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.476187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.476189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.476192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.476194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.476197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.476199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.476202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.476203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.476206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.476222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.483689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.485266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.485276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.485277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.485279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.485282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1674 [2:7556555011946934084:9899]
2025-10-02T09:32:47.485289Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.485299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.485304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.485306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.485306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.485316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.485319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.485323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.485352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.485357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.485358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.485360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.485361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.485397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.485402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.485408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.485414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.485425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.485438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485044:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.485445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.485447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.485448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.485454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.485460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485373:2559], now have 1 active actors on pipe
2025-10-02T09:32:47.485465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.485467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.485468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.485468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.485475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.485476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.485470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1674
2025-10-02T09:32:47.485493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1674
2025-10-02T09:32:47.485492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.485499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.485500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.485516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.485518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.485537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.485541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.485543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.485544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.485549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.485554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.485563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.485647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.485652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.485658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.485708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1675 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0
2025-10-02T09:32:47.485937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f34de2a-20031fc8-d5ce658a-66edbe03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.488117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Write session: try to update token
2025-10-02T09:32:47.488127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.495492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.495504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.495505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.495507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.495511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.495516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.495518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946934078:9899]
2025-10-02T09:32:47.495540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.495544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.495545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.495548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.495551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.495555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.495663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.500866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId: src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.503033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:47.563297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555012022485395:3127]
2025-10-02T09:32:47.563464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1674, pipe: [1:7556555012022485395:3127]
2025-10-02T09:32:47.606402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.606593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.606601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.606626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485395:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.606846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555012022485395:3127]
2025-10-02T09:32:47.606860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.606870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:47.606872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:47.606915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1675 reason: error at write: Disconnected sessionId: src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0
2025-10-02T09:32:47.607045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1675 sessionId: src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0 is DEAD
2025-10-02T09:32:47.607039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.607203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:47.607212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Write session will restart in 0.006359s
2025-10-02T09:32:47.607231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Write session: Do CDS request
2025-10-02T09:32:47.607235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.614134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.614201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.614210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1676
2025-10-02T09:32:47.614302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.614323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.614328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.614331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.614631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1676 sessionId:  describe result for acl check
2025-10-02T09:32:47.614654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.614659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.614660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.614663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022485545:2551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.615027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022485545:2551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.616860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022485545:2551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.618998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.619024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022485545:2551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.619035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022485545:2551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.619038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022485545:2551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.619043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.620425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.620523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.620529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.620535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.620560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.620591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946934365:9907]
2025-10-02T09:32:47.620952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.621117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.621139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.621319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.621349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.621353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.621354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.621354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.621355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.621355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.621356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.621356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.621357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.621357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.621358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.621359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.621361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.621368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.621370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.621372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.621374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.621376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.621378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.621380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.621382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.621384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.621386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.621388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.621391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.621395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.621399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.621402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.621404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.621407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.621410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.621413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.621415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.621418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.621420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.621423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.621425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.621428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.621430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.621433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.621436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.621440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.621442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.621445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.621447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.621449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.621451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.621454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.621471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.629097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.630715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.630725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.630726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.630727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.630730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1675 [2:7556555011946934365:9907]
2025-10-02T09:32:47.630738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.630754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.630756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.630757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.630758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.630767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.630774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.630778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.630807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.630811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.630812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.630814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.630815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.630855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.630859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.630865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.630870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.630879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.630890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485727:2551], now have 1 active actors on pipe
2025-10-02T09:32:47.630895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485396:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.630899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.630900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.630901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.630908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.630915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.630923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.630925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.630926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.630926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.630927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.630940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.630945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.630946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.630941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1675
2025-10-02T09:32:47.631012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1675
2025-10-02T09:32:47.631041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.631046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.631060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.631063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.631065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.631066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.631071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.631078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.631089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.631187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.631191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.631199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.631243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1676 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0
2025-10-02T09:32:47.631439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7effda8-ea80b20-72b336cf-b7d1a17_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.633753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Write session: try to update token
2025-10-02T09:32:47.633763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.639925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:47.639937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.639942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.639964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:47.639966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:47.640094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:47.640203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:47.640336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:47.640445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:47.640606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:47.640629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:47.644936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId: src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.646895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:47.646992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.646999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.647014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:47.647066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:47.648384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.648394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.648396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.648397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.648402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.648404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.648407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946934359:9907]
2025-10-02T09:32:47.648424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.648426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.648426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.648429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.648429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.648430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.648547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.707155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555012022485740:3127]
2025-10-02T09:32:47.707298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1675, pipe: [1:7556555012022485740:3127]
2025-10-02T09:32:47.759556Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.765678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.765693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.765812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.765862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.765911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.765959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.766001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.766008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.766059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.766105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.766158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.766209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.766246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.766250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.766300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.766348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.766398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.766446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.766481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.766486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.766532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.766581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.766628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.766679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.766715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.766723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.766780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.766828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.766881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.766933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.766972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.766977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.767029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.767080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.767138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.767186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.767223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.767228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.767274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.767320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.767369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.767417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.767450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.767456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.767505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.767572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.767620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.767666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.767703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.767708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.767752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.767798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.767846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.767891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.767923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.767927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.767973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:47.768022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:47.768068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:47.768120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:47.768172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:47.768177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:47.768206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485740:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.768402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.768437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555012022485740:3127]
2025-10-02T09:32:47.768486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:47.768493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:47.768515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1676 reason: error at write: Disconnected sessionId: src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0
2025-10-02T09:32:47.768659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1676 sessionId: src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0 is DEAD
2025-10-02T09:32:47.768752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.768791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:47.768796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Write session will restart in 0.009609s
2025-10-02T09:32:47.768823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Write session: Do CDS request
2025-10-02T09:32:47.768829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.779079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.779191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.779199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1677
2025-10-02T09:32:47.779289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.779309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.779315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.779317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.779566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1677 sessionId:  describe result for acl check
2025-10-02T09:32:47.779585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.779590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.779592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.779595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022486036:2538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.779977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022486036:2538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.780566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.781706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022486036:2538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.781767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.781859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.781866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.781871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.781896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.781921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946934623:9909]
2025-10-02T09:32:47.782261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.782418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.782443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.782615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.782643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.782647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.782647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.782648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.782648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.782649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.782649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.782650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.782650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.782651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.782652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.782652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.782655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.782661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.782663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.782665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.782667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.782669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.782671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.782673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.782675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.782677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.782679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.782681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.782685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.782688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.782691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.782694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.782697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.782699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.782702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.782705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.782707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.782710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.782712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.782714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.782716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.782719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.782721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.782724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.782726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.782730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.782732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.782735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.782737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.782750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.782756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.782758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.782775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.786113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022486036:2538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.786124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022486036:2538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.786127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022486036:2538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.786132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.790211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.791865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.791877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.791878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.791880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.791884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1676 [2:7556555011946934623:9909]
2025-10-02T09:32:47.791892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.791901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.791906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.791908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.791909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.791918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.791920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.791924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.791952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.791957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.791958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.791960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.791962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.791998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.792002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.792009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.792016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.792024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.792040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022486078:2538], now have 1 active actors on pipe
2025-10-02T09:32:47.792043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022485741:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.792046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.792047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.792048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.792056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.792064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.792068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.792070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.792071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.792071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.792072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.792086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.792073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1676
2025-10-02T09:32:47.792088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.792074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1676
2025-10-02T09:32:47.792089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.792101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.792107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.792131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.792140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.792143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.792144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.792151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.792156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.792169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.792248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.792253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.792260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.792310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1677 partition: 0 MaxSeqNo: 36 sessionId: src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0
2025-10-02T09:32:47.792500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c49b605-3635dda1-b4108a95-3b94f5c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.794702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Write session: try to update token
2025-10-02T09:32:47.794713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.801345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.801360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.801362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.801364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.801369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.801371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.801375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946934618:9909]
2025-10-02T09:32:47.801396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.801399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.801400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.801401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.801404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.801406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.801507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.806019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId: src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.807988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:47.868435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555012022486091:3127]
2025-10-02T09:32:47.868550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1676, pipe: [1:7556555012022486091:3127]
2025-10-02T09:32:47.913176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:47.913547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.913556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.913579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022486091:3127], now have 1 active actors on pipe
2025-10-02T09:32:47.913695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:47.913730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:47.913735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555012022486091:3127]
2025-10-02T09:32:47.913740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:47.913747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:47.913786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1677 reason: error at write: Disconnected sessionId: src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0
2025-10-02T09:32:47.913932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1677 sessionId: src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0 is DEAD
2025-10-02T09:32:47.914069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:47.914078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Write session will restart in 0.008748s
2025-10-02T09:32:47.914097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Write session: Do CDS request
2025-10-02T09:32:47.914101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:47.924154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.924213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:47.924226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1678
2025-10-02T09:32:47.924329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:47.924348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:47.924352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:47.924355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:47.924615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1678 sessionId:  describe result for acl check
2025-10-02T09:32:47.924636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:47.924639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:47.924640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:47.924642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555012022486405:2527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:47.924841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:47.924983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555012022486405:2527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:47.926155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555012022486405:2527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:47.926191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:47.926291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:47.926299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:47.926305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:47.926334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:47.926356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555011946934895:9912]
2025-10-02T09:32:47.926691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:47.926857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:47.926881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:47.927055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:47.927084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.927088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.927088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.927089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.927089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.927090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.927090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.927091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.927091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.927092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.927092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.927093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.927096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.927101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.927103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.927105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.927107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.927109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.927111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.927113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.927115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.927117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.927119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.927121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.927125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.927129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:47.927132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.927135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:47.927137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.927139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:47.927142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.927144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:47.927147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.927149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:47.927151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.927154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:47.927156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.927159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:47.927161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.927163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:47.927165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.927168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:47.927170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.927173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.927176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.927179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.927181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.927184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.927200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:47.929112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555012022486405:2527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:47.929122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555012022486405:2527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:47.929124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555012022486405:2527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:47.929128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:47.934638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:47.936119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:47.936131Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:47.936133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:47.936135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:47.936137Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1677 [2:7556555011946934895:9912]
2025-10-02T09:32:47.936144Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:47.936154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:47.936155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.936157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.936158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.936166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:47.936169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:47.936177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:47.936208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.936213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.936214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.936216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:47.936217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:47.936252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:47.936257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.936263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:47.936268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:47.936275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:47.936290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022486107:2446], now have 1 active actors on pipe
2025-10-02T09:32:47.936295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555012022486445:2527], now have 1 active actors on pipe
2025-10-02T09:32:47.936299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.936300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.936301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.936307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:47.936314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:47.936320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:47.936323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:47.936325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:47.936325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:47.936326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:47.936334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1677
2025-10-02T09:32:47.936336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1677
2025-10-02T09:32:47.936337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.936344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:47.936349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:47.936365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.936368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.936382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1314b9a1-67c48b69-69686f5e-1941cac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:47.936388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:47.936390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:47.936391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:47.936395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:47.936403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:47.936410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.936514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:47.936523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:47.936533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:47.936595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1678 partition: 0 MaxSeqNo: 36 sessionId: src_id|1314b9a1-67c48b69-69686f5e-1941cac_0
2025-10-02T09:32:47.936783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65831f5f-d401ee0a-c3e5db80-5eeb644d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1314b9a1-67c48b69-69686f5e-1941cac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:47.938952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Write session: try to update token
2025-10-02T09:32:47.938962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:47.945547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:47.945559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:47.945560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:47.945561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:47.945566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.945569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.945571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555011946934889:9912]
2025-10-02T09:32:47.945592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:47.945594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:47.945595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:47.945596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:47.945597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:47.945599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:47.945723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:47.950218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId: src_id|1314b9a1-67c48b69-69686f5e-1941cac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:47.952197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.013873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317453748:3127]
2025-10-02T09:32:48.014018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1677, pipe: [1:7556555016317453748:3127]
2025-10-02T09:32:48.056745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.057315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.057327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.057358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317453748:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.057478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.057510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.057538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317453748:3127]
2025-10-02T09:32:48.057550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:48.057611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1678 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1314b9a1-67c48b69-69686f5e-1941cac_0
2025-10-02T09:32:48.057750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1678 sessionId: src_id|1314b9a1-67c48b69-69686f5e-1941cac_0 is DEAD
2025-10-02T09:32:48.057884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:48.057901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Write session will restart in 0.007688s
2025-10-02T09:32:48.057916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Write session: Do CDS request
2025-10-02T09:32:48.057920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.066158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.066234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.066242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1679
2025-10-02T09:32:48.066334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.066353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.066359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.066362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.066688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1679 sessionId:  describe result for acl check
2025-10-02T09:32:48.066709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.066714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.066715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.066718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317453980:2528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.067087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317453980:2528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.068657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317453980:2528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.069255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.070467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.070562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.070569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.070576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.070594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317453980:2528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.070606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317453980:2528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.070608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317453980:2528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.070613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.070608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.070633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241902454:9915]
2025-10-02T09:32:48.071009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.071175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.071200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.071397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.071430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.071433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.071434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.071434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.071435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.071435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.071436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.071436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.071437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.071437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.071438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.071439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.071441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.071447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.071449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.071451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.071453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.071455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.071457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.071458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.071461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.071463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.071465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.071467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.071471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.071475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.071478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.071481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.071483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.071486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.071488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.071491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.071493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.071495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.071497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.071501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.071503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.071505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.071508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.071510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.071512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.071515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.071517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.071519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.071522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.071524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.071527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.071529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.071550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.078998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.080548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.080561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.080563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.080565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.080569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1678 [2:7556555016241902454:9915]
2025-10-02T09:32:48.080579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.080596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.080602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.080604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.080605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.080615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.080621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.080625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.080655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.080659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.080660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.080662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.080664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.080700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.080705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.080711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.080716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.080724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.080735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317453750:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.080740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454085:2528], now have 1 active actors on pipe
2025-10-02T09:32:48.080745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.080746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.080747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.080755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.080762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.080766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.080768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.080770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.080773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.080775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.080769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1678
2025-10-02T09:32:48.080772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1678
2025-10-02T09:32:48.080787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.080790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.080792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.080812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.080815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.080849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.080857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.080858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.080859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.080864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.080869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.080879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.080978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.080985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.080994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.081046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1679 partition: 0 MaxSeqNo: 36 sessionId: src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0
2025-10-02T09:32:48.081244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1314b9a1-67c48b69-69686f5e-1941cac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.083415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Write session: try to update token
2025-10-02T09:32:48.083425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.090057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.090068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.090069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.090070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.090075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.090077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.090079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241902449:9915]
2025-10-02T09:32:48.090104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.090108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.090110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.090114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.090114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.090116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.090230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.095633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId: src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.097625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.157719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317454096:3127]
2025-10-02T09:32:48.157885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1678, pipe: [1:7556555016317454096:3127]
2025-10-02T09:32:48.199950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.200430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.200439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.200451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454096:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.200570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.200602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.200629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:48.200650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317454096:3127]
2025-10-02T09:32:48.200685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1679 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0
2025-10-02T09:32:48.200848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1679 sessionId: src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0 is DEAD
2025-10-02T09:32:48.200942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:48.200947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Write session will restart in 0.008288s
2025-10-02T09:32:48.200980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Write session: Do CDS request
2025-10-02T09:32:48.200985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.210136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.210286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.210297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1680
2025-10-02T09:32:48.210371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.210392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.210398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.210401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.210647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1680 sessionId:  describe result for acl check
2025-10-02T09:32:48.210669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.210673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.210674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.210676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317454346:2522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.211016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317454346:2522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.212342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317454346:2522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.212537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.213776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.213879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.213885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.213891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.213916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.213943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241902716:9917]
2025-10-02T09:32:48.213942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317454346:2522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.213950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317454346:2522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.213952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317454346:2522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.213955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.214398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.214556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.214580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.214783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.214816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.214821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.214822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.214823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.214823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.214824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.214824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.214825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.214825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.214826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.214826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.214827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.214829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.214835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.214837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.214839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.214841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.214843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.214845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.214847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.214849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.214851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.214853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.214855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.214858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.214862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.214865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.214868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.214870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.214873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.214875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.214878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.214880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.214883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.214885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.214887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.214891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.214894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.214896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.214900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.214905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.214908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.214910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.214912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.214915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.214921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.214922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.214925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.214942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.222420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.223926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.223940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.223942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.223944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.223949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1679 [2:7556555016241902716:9917]
2025-10-02T09:32:48.223958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.223971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.223976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.223978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.223979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.223988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.223991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.223995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.224025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.224030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.224031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.224032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.224034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.224074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.224078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.224085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.224090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.224098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.224109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454434:2522], now have 1 active actors on pipe
2025-10-02T09:32:48.224115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454098:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.224118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.224119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.224120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.224127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.224134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.224140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.224142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.224142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.224143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.224144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.224157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.224162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.224170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.224157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1679
2025-10-02T09:32:48.224161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1679
2025-10-02T09:32:48.224183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.224190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.224210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7237cf-a1a85b95-3925224d-b66591a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.224216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.224218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.224220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.224224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.224229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.224237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.224329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.224336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.224345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.224401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1680 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7237cf-a1a85b95-3925224d-b66591a_0
2025-10-02T09:32:48.224619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc5ff83-6a37e292-418c4049-bf7b2363_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7237cf-a1a85b95-3925224d-b66591a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.226785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Write session: try to update token
2025-10-02T09:32:48.226796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.233456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.233469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.233471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.233473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.233480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.233484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.233488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241902711:9917]
2025-10-02T09:32:48.233514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.233517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.233522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.233522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.233524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.233525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.233650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.237687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId: src_id|e7237cf-a1a85b95-3925224d-b66591a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.239717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.300574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317454447:3127]
2025-10-02T09:32:48.300749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1679, pipe: [1:7556555016317454447:3127]
2025-10-02T09:32:48.344074Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.344324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.344334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.344359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454447:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.344498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.344516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317454447:3127]
2025-10-02T09:32:48.344534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:48.344537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.344537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:48.344576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1680 reason: error at write: Disconnected sessionId: src_id|e7237cf-a1a85b95-3925224d-b66591a_0
2025-10-02T09:32:48.344691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1680 sessionId: src_id|e7237cf-a1a85b95-3925224d-b66591a_0 is DEAD
2025-10-02T09:32:48.344783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:48.344792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Write session will restart in 0.008568s
2025-10-02T09:32:48.344829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Write session: Do CDS request
2025-10-02T09:32:48.344834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.354131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.354199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.354206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1681
2025-10-02T09:32:48.354303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.354323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.354329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.354331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.354659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1681 sessionId:  describe result for acl check
2025-10-02T09:32:48.354682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.354686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.354689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.354692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317454702:2514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.355039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317454702:2514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.356265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317454702:2514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.356444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.357899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.357999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.358006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.358012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.358038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.358062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241902980:9920]
2025-10-02T09:32:48.358229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317454702:2514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.358237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317454702:2514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.358239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317454702:2514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.358242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.358398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.358554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.358576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.358759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.358788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.358792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.358793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.358793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.358794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.358794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.358795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.358795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.358796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.358796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.358797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.358798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.358800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.358806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.358808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.358810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.358812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.358814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.358816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.358818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.358820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.358823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.358825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.358826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.358831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.358835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.358838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.358841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.358843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.358846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.358848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.358850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.358854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.358856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.358858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.358861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.358863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.358865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.358867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.358870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.358872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.358874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.358876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.358879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.358884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.358887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.358889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.358892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.358908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.366351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.368023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.368034Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.368035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.368037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.368041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1680 [2:7556555016241902980:9920]
2025-10-02T09:32:48.368047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.368055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.368057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.368058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.368059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.368068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.368070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.368075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.368103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.368108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.368109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.368111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.368113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.368149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.368155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.368161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.368166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.368175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.368186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454786:2514], now have 1 active actors on pipe
2025-10-02T09:32:48.368192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454448:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.368195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.368197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.368198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.368205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.368216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.368218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.368221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.368222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.368227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.368213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1680
2025-10-02T09:32:48.368219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1680
2025-10-02T09:32:48.368228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.368241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.368246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.368247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.368255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.368259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.368284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b414b17-32016df7-231874ff-88a68dba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.368291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.368293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.368294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.368300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.368308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.368318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.368402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.368407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.368414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.368466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1681 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b414b17-32016df7-231874ff-88a68dba_0
2025-10-02T09:32:48.368660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7237cf-a1a85b95-3925224d-b66591a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b414b17-32016df7-231874ff-88a68dba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.370849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Write session: try to update token
2025-10-02T09:32:48.370860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.377823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.377834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.377836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.377837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.377842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.377844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.377847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241902974:9920]
2025-10-02T09:32:48.377867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.377870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.377872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.377873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.377876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.377878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.377983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.382912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId: src_id|4b414b17-32016df7-231874ff-88a68dba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.384995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.444437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317454797:3127]
2025-10-02T09:32:48.444607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1680, pipe: [1:7556555016317454797:3127]
2025-10-02T09:32:48.488557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.488725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.488734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.488759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454797:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.488876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.488905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.488943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317454797:3127]
2025-10-02T09:32:48.488957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:48.489012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1681 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b414b17-32016df7-231874ff-88a68dba_0
2025-10-02T09:32:48.489160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1681 sessionId: src_id|4b414b17-32016df7-231874ff-88a68dba_0 is DEAD
2025-10-02T09:32:48.489253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:48.489257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Write session will restart in 0.007005s
2025-10-02T09:32:48.489277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Write session: Do CDS request
2025-10-02T09:32:48.489281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.498111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.498208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.498220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1682
2025-10-02T09:32:48.498283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.498301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.498305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.498308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.498579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1682 sessionId:  describe result for acl check
2025-10-02T09:32:48.498598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.498603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.498604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.498607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317455044:2500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.498950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317455044:2500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.500636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317455044:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.500797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.502129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.502226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.502233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.502238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.502268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.502296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241903256:9928]
2025-10-02T09:32:48.502646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.502677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317455044:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.502686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317455044:2500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.502687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317455044:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.502690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.502817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.502844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.503045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.503077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.503081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.503081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.503082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.503082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.503083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.503083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.503084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.503084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.503085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.503085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.503086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.503088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.503094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.503096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.503098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.503100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.503102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.503104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.503106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.503108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.503110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.503112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.503113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.503117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.503120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.503124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.503126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.503129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.503131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.503134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.503136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.503139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.503141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.503143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.503146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.503148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.503151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.503153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.503156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.503159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.503161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.503163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.503166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.503168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.503171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.503177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.503179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.503198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.510656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.512155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.512168Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.512169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.512172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.512176Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1681 [2:7556555016241903256:9928]
2025-10-02T09:32:48.512185Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.512203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.512209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.512211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.512213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.512223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.512229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.512233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.512262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.512267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.512268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.512269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.512271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.512306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.512310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.512317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.512322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.512331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.512344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317454811:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.512350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455150:2500], now have 1 active actors on pipe
2025-10-02T09:32:48.512354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.512355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.512356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.512363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.512370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.512376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.512377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.512379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.512383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.512384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.512394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.512396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.512398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.512389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1681
2025-10-02T09:32:48.512398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1681
2025-10-02T09:32:48.512414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.512420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.512438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.512447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.512450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.512452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.512458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.512465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.512472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.512566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.512573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.512581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.512635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1682 partition: 0 MaxSeqNo: 36 sessionId: src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0
2025-10-02T09:32:48.512886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b414b17-32016df7-231874ff-88a68dba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.515003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Write session: try to update token
2025-10-02T09:32:48.515013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.521691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.521704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.521705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.521706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.521711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.521714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.521716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241903250:9928]
2025-10-02T09:32:48.521739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.521743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.521744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.521752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.521756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.521759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.521870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.526538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId: src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.528595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.588855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317455170:3127]
2025-10-02T09:32:48.589028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1681, pipe: [1:7556555016317455170:3127]
2025-10-02T09:32:48.633055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.633559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.633572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.633599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455170:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.633780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.633800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317455170:3127]
2025-10-02T09:32:48.633817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:48.633818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:48.633862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1682 reason: error at write: Disconnected sessionId: src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0
2025-10-02T09:32:48.633993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1682 sessionId: src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0 is DEAD
2025-10-02T09:32:48.634034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.634124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:48.634132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Write session will restart in 0.007304s
2025-10-02T09:32:48.634147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Write session: Do CDS request
2025-10-02T09:32:48.634152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.642101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.642184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.642191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1683
2025-10-02T09:32:48.642260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.642278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.642284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.642286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.642583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1683 sessionId:  describe result for acl check
2025-10-02T09:32:48.642609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.642614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.642615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.642618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317455373:2483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.642970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317455373:2483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.645059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317455373:2483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.645823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.647107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.647216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.647224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.647230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.647266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.647279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317455373:2483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.647287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317455373:2483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.647289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317455373:2483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.647294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.647297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241903544:9936]
2025-10-02T09:32:48.647652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.647812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.647838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.648016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.648046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.648050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.648051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.648051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.648052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.648052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.648053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.648053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.648054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.648054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.648055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.648056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.648059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.648065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.648067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.648069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.648071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.648073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.648075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.648077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.648079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.648081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.648083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.648085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.648089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.648093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.648096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.648099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.648101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.648104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.648106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.648109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.648111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.648113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.648115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.648118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.648120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.648123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.648125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.648128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.648132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.648134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.648136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.648139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.648141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.648144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.648146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.648148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.648164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.655615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.657390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.657401Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.657402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.657404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.657407Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1682 [2:7556555016241903544:9936]
2025-10-02T09:32:48.657532Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.657545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.657547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.657548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.657549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.657558Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.657562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.657566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.657600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.657605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.657606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.657608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.657609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.657647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.657652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.657658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.657664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.657672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.657687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455510:2483], now have 1 active actors on pipe
2025-10-02T09:32:48.657692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455171:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.657696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.657697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.657698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.657707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.657718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.657718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.657724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.657725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.657726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.657728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.657742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.657747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.657725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1682
2025-10-02T09:32:48.657748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.657757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.657759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.657781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.657788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.657790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.657791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.657796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.657802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.657813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.657883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1682
2025-10-02T09:32:48.657919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.657923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.657935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.657982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1683 partition: 0 MaxSeqNo: 36 sessionId: src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0
2025-10-02T09:32:48.658197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63838e03-1933f969-8b9d3fa8-7a271b48_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.660352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Write session: try to update token
2025-10-02T09:32:48.660362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.667132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.667147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.667149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.667151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.667158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.667161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.667163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241903539:9936]
2025-10-02T09:32:48.667186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.667186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.667189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.667189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.667190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.667192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.667555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.672722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId: src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.674818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.733743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317455522:3127]
2025-10-02T09:32:48.733925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1682, pipe: [1:7556555016317455522:3127]
2025-10-02T09:32:48.778358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.778574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.778584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.778596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455522:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.778749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.778764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:48.778772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:48.778793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.778818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1683 reason: error at write: Disconnected sessionId: src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0
2025-10-02T09:32:48.778825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317455522:3127]
2025-10-02T09:32:48.778951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1683 sessionId: src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0 is DEAD
2025-10-02T09:32:48.779066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:48.779075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Write session will restart in 0.009285s
2025-10-02T09:32:48.779091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Write session: Do CDS request
2025-10-02T09:32:48.779096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.789109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.789264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.789274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1684
2025-10-02T09:32:48.789374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.789394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.789401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.789404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.789664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1684 sessionId:  describe result for acl check
2025-10-02T09:32:48.789689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.789693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.789694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.789697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317455825:2486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.790048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317455825:2486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.790441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.791417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317455825:2486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.791783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.791893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.791900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.791906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.791933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.791954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241903822:9938]
2025-10-02T09:32:48.792299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.792456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.792479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.792669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.792700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.792704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.792704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.792705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.792705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.792706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.792706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.792707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.792708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.792708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.792709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.792709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.792712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.792717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.792719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.792721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.792723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.792725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.792727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.792729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.792731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.792733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.792735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.792737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.792741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.792745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.792748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.792751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.792753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.792756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.792758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.792760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.792762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.792765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.792767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.792769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.792773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.792776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.792778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.792781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.792783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.792785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.792791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.792794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.792796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.792798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.792811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.792813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.792830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.792941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317455825:2486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.792949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317455825:2486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.792951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317455825:2486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.792954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.800225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.801820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.801829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.801830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.801832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.801835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1683 [2:7556555016241903822:9938]
2025-10-02T09:32:48.801841Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.801851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.801856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.801858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.801859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.801868Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.801871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.801879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.801918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.801922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.801923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.801925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.801926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.801960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.801965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.801971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.801976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.801988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.802002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455523:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.802007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455867:2486], now have 1 active actors on pipe
2025-10-02T09:32:48.802011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.802012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.802013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.802020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.802030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.802033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.802035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.802035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.802040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.802042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.802041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1683
2025-10-02T09:32:48.802054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.802052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1683
2025-10-02T09:32:48.802059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.802060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.802076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.802081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.802097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.802104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.802106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.802107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.802113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.802121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.802136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.802226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.802231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.802239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.802291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1684 partition: 0 MaxSeqNo: 36 sessionId: src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0
2025-10-02T09:32:48.802491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeb1e12-aafa460c-e41e7a28-a4ba26ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.804656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Write session: try to update token
2025-10-02T09:32:48.804666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.811199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.811211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.811212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.811213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.811218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.811220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.811222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241903804:9938]
2025-10-02T09:32:48.811241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.811244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.811245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.811245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.811248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.811250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.811353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.817717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId: src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.819784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:48.879145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555016317455880:3127]
2025-10-02T09:32:48.879291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1683, pipe: [1:7556555016317455880:3127]
2025-10-02T09:32:48.922321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:48.922752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.922762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.922774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455880:3127], now have 1 active actors on pipe
2025-10-02T09:32:48.922900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:48.922935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:48.922958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555016317455880:3127]
2025-10-02T09:32:48.922966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:48.923015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1684 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0
2025-10-02T09:32:48.923149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1684 sessionId: src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0 is DEAD
2025-10-02T09:32:48.923281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:48.923290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Write session will restart in 0.008073s
2025-10-02T09:32:48.923309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Write session: Do CDS request
2025-10-02T09:32:48.923313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:48.932095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.932179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:48.932187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1685
2025-10-02T09:32:48.932273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:48.932292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:48.932297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:48.932299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:48.932552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1685 sessionId:  describe result for acl check
2025-10-02T09:32:48.932579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:48.932585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:48.932587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:48.932590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555016317456136:2473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:48.932923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555016317456136:2473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:48.934360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555016317456136:2473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:48.934759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:48.936281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:48.936381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:48.936389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:48.936397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:48.936434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:48.936453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555016317456136:2473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:48.936459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555016241904089:9941]
2025-10-02T09:32:48.936461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555016317456136:2473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:48.936464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555016317456136:2473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:48.936468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:48.936824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:48.936983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:48.937006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:48.937180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:48.937209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.937213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.937213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.937214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.937214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.937215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.937216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.937216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.937216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.937217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.937218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.937218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.937221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.937227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.937229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.937231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.937233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.937234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.937236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.937238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.937240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.937244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.937246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.937248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.937251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.937255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:48.937258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.937261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:48.937263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.937266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:48.937268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.937271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:48.937273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.937275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:48.937277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.937280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:48.937282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.937285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:48.937287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.937291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:48.937296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.937298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:48.937300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.937303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.937306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.937312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.937315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.937318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.937334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:48.945661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:48.947151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:48.947161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:48.947162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:48.947165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:48.947168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1684 [2:7556555016241904089:9941]
2025-10-02T09:32:48.947175Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:48.947184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:48.947186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.947187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.947189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.947197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:48.947203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:48.947208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:48.947237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.947241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.947243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.947245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:48.947246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:48.947289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:48.947296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.947305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:48.947317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:48.947333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:48.947352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317456237:2473], now have 1 active actors on pipe
2025-10-02T09:32:48.947359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555016317455896:2446], now have 1 active actors on pipe
2025-10-02T09:32:48.947362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.947364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.947365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.947369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:48.947356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1684
2025-10-02T09:32:48.947371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1684
2025-10-02T09:32:48.947377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:48.947384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:48.947387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:48.947389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:48.947392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:48.947393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:48.947411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.947417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.947424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.947432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:48.947444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:48.947450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:48.947455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:48.947457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:48.947462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:48.947467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:48.947475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:48.947489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.947576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:48.947582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:48.947589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:48.947640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1685 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0
2025-10-02T09:32:48.947826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d29152-c30aa970-fbd1f035-5e86b9d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:48.949972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Write session: try to update token
2025-10-02T09:32:48.949982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:48.958209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:48.958224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:48.958225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:48.958226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:48.958231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.958234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.958236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555016241904084:9941]
2025-10-02T09:32:48.958261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:48.958264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:48.958265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:48.958270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:48.958274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:48.958276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:48.958389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:48.961170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId: src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:48.963159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.023004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612423544:3127]
2025-10-02T09:32:49.023184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1684, pipe: [1:7556555020612423544:3127]
2025-10-02T09:32:49.068051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.068623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.068633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.068660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612423544:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.068793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:49.068995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612423544:3127]
2025-10-02T09:32:49.069016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.069024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:49.069077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1685 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0
2025-10-02T09:32:49.069202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1685 sessionId: src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0 is DEAD
2025-10-02T09:32:49.069338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:49.069348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Write session will restart in 0.007461s
2025-10-02T09:32:49.069362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Write session: Do CDS request
2025-10-02T09:32:49.069367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.078123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.078173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.078181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1686
2025-10-02T09:32:49.078289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.078309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.078315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.078317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.078567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1686 sessionId:  describe result for acl check
2025-10-02T09:32:49.078588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.078593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.078594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.078596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612423777:2465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.078951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612423777:2465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.080377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612423777:2465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.081037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.082396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.082513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.082520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.082526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.082558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.082588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536871655:9944]
2025-10-02T09:32:49.082612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612423777:2465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.082622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612423777:2465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.082624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612423777:2465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.082629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.082934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.083092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.083116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.083292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.083322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.083325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.083326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.083327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.083327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.083328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.083328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.083329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.083329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.083330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.083330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.083331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.083334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.083339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.083342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.083344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.083346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.083347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.083349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.083351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.083353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.083355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.083357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.083359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.083363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.083367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.083371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.083373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.083376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.083379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.083381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.083384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.083386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.083388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.083390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.083393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.083395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.083397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.083399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.083402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.083404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.083406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.083408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.083411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.083413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.083415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.083417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.083420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.083437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.091582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.093198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.093209Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.093211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.093213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.093215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1685 [2:7556555020536871655:9944]
2025-10-02T09:32:49.093222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.093230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.093233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.093235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.093236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.093245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.093249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.093253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.093281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.093286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.093287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.093289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.093290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.093325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.093329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.093336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.093341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.093349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.093362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612423888:2465], now have 1 active actors on pipe
2025-10-02T09:32:49.093369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612423546:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.093372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.093373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.093375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.093383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.093393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.093395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.093400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.093401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.093402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.093402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.093414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.093419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.093420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.093415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1685
2025-10-02T09:32:49.093417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1685
2025-10-02T09:32:49.093461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.093466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.093479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.093484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.093486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.093487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.093492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.093497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.093504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.093592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.093599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.093607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.093664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1686 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0
2025-10-02T09:32:49.093830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee1ebdf-a31c9d1a-8282784a-236082e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.095946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Write session: try to update token
2025-10-02T09:32:49.095956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.103213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.103223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.103225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.103226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.103230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.103233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.103235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536871650:9944]
2025-10-02T09:32:49.103255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.103258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.103259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.103260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.103261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.103263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.103371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.107775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId: src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.109794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.168924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612423899:3127]
2025-10-02T09:32:49.169108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1685, pipe: [1:7556555020612423899:3127]
2025-10-02T09:32:49.214158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.214552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.214564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.214594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612423899:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.214744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:49.214785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612423899:3127]
2025-10-02T09:32:49.214806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.214810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:49.214868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1686 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0
2025-10-02T09:32:49.215013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1686 sessionId: src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0 is DEAD
2025-10-02T09:32:49.215128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:49.215137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Write session will restart in 0.009797s
2025-10-02T09:32:49.215156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Write session: Do CDS request
2025-10-02T09:32:49.215161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.226116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.226098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.226199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.226211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1687
2025-10-02T09:32:49.226297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.226323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.226330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.226333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.226613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1687 sessionId:  describe result for acl check
2025-10-02T09:32:49.226632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.226636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.226637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.226641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612424212:2456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.227029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612424212:2456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.227463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.227564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.227571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.227578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.227605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.227626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536871924:9946]
2025-10-02T09:32:49.227973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.228127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.228150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.228338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.228370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.228375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.228375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.228376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.228376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.228377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.228377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.228378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.228378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.228379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.228379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.228380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.228383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.228388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.228392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.228394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.228396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.228398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.228400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.228402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.228404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.228406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.228408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.228411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.228415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.228419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.228422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.228424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.228426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.228428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.228431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.228434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.228436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.228438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.228441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.228443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.228445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.228447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.228450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.228452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.228455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.228457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.228459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.228461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.228464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.228466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.228469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.228485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.228703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612424212:2456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.233312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612424212:2456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.233322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612424212:2456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.233325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612424212:2456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.233329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.235970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.237698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.237709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.237710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.237712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.237715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1686 [2:7556555020536871924:9946]
2025-10-02T09:32:49.237722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.237732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.237733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.237735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.237736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.237746Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.237752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.237756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.237792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.237798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.237800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.237803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.237805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.237925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1686
2025-10-02T09:32:49.237926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1686
2025-10-02T09:32:49.237960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.237966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.237973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.237980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.237988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.238000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612423901:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.238006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424250:2456], now have 1 active actors on pipe
2025-10-02T09:32:49.238017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.238022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.238033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.238040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.238042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.238052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.238062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.238065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.238069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.238070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.238073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.238074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.238083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.238087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.238090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.238091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.238096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.238102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.238120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.238128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.238132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.238135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.238215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.238220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.238227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.238278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1687 partition: 0 MaxSeqNo: 36 sessionId: src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0
2025-10-02T09:32:49.238471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae258b3b-f30fb347-2a6b77d5-b69aae89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.240607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Write session: try to update token
2025-10-02T09:32:49.240618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.247329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.247339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.247340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.247342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.247345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.247348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.247350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536871918:9946]
2025-10-02T09:32:49.247371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.247372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.247374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.247375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.247375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.247377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.247484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.251650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId: src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.253652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.314841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612424257:3127]
2025-10-02T09:32:49.315027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1686, pipe: [1:7556555020612424257:3127]
2025-10-02T09:32:49.356966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.357287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.357296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.357323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424257:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.357450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:49.357487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612424257:3127]
2025-10-02T09:32:49.357502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.357516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:49.357575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1687 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0
2025-10-02T09:32:49.357730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1687 sessionId: src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0 is DEAD
2025-10-02T09:32:49.357875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:49.357880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Write session will restart in 0.006088s
2025-10-02T09:32:49.357895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Write session: Do CDS request
2025-10-02T09:32:49.357899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.365144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.365214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.365224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1688
2025-10-02T09:32:49.365322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.365351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.365358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.365361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.365621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1688 sessionId:  describe result for acl check
2025-10-02T09:32:49.365643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.365647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.365649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.365652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612424419:2450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.365998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612424419:2450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.367668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612424419:2450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.369444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612424419:2450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.369451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612424419:2450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.369455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612424419:2450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.369458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.369943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.371154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.371265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.371272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.371278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.371305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.371328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536872197:9949]
2025-10-02T09:32:49.371664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.371823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.371846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.372020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.372049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.372053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.372053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.372054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.372054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.372055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.372055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.372056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.372056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.372057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.372057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.372058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.372061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.372067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.372069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.372071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.372073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.372075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.372077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.372079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.372081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.372083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.372085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.372087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.372090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.372094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.372097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.372100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.372102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.372104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.372106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.372109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.372111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.372114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.372115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.372118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.372120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.372123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.372125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.372127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.372129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.372132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.372134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.372136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.372140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.372143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.372144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.372147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.372164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.379606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.381323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.381334Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.381335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.381337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.381341Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1687 [2:7556555020536872197:9949]
2025-10-02T09:32:49.381347Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.381356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.381361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.381362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.381363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.381372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.381375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.381378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.381417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.381422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.381423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.381425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.381426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.381460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.381464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.381470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.381475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.381486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.381501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424601:2450], now have 1 active actors on pipe
2025-10-02T09:32:49.381506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424258:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.381510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.381511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.381512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.381519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.381528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.381532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.381534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.381535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.381538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.381539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.381553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.381556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.381557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.381535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1687
2025-10-02T09:32:49.381537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1687
2025-10-02T09:32:49.381567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.381572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.381597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.381604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.381606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.381607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.381612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.381617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.381629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.381711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.381716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.381724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.381772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1688 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0
2025-10-02T09:32:49.381956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc67611-69800393-4bb1144c-8e5f3f21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.384096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Write session: try to update token
2025-10-02T09:32:49.384105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.390749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.390762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.390763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.390764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.390769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.390771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.390773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536872192:9949]
2025-10-02T09:32:49.390793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.390796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.390796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.390797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.390799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.390801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.390921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.395595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId: src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.397615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.457686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612424614:3127]
2025-10-02T09:32:49.457846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1687, pipe: [1:7556555020612424614:3127]
2025-10-02T09:32:49.500820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.501027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.501035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.501061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424614:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.501186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:49.501202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:49.501212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:49.501242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.501256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1688 reason: error at write: Disconnected sessionId: src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0
2025-10-02T09:32:49.501278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612424614:3127]
2025-10-02T09:32:49.501391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1688 sessionId: src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0 is DEAD
2025-10-02T09:32:49.501482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:49.501488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Write session will restart in 0.006524s
2025-10-02T09:32:49.501519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Write session: Do CDS request
2025-10-02T09:32:49.501523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.509200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.509275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.509284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1689
2025-10-02T09:32:49.509425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.509443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.509449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.509452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.509676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1689 sessionId:  describe result for acl check
2025-10-02T09:32:49.509698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.509699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.509700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.509703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612424786:2426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.509958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612424786:2426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.511512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612424786:2426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.513441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612424786:2426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.513449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612424786:2426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.513451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612424786:2426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.513454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.514479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.515919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.516028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.516036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.516044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.516078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.516107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536872480:9951]
2025-10-02T09:32:49.516448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.516619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.516644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.516835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.516866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.516870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.516871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.516871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.516872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.516872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.516873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.516873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.516874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.516874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.516875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.516875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.516878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.516883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.516886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.516888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.516889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.516891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.516893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.516895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.516897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.516899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.516901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.516903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.516907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.516911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.516914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.516917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.516919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.516921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.516923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.516926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.516928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.516931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.516933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.516936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.516938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.516941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.516943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.516945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.516948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.516950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.516952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.516955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.516958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.516961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.516963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.516966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.516987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.524356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.525887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.525897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.525899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.525901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.525904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1688 [2:7556555020536872480:9951]
2025-10-02T09:32:49.525911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.525919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.525921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.525922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.525923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.525932Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.525937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.525942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.525973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.525977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.525978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.525980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.525981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.526018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.526023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.526029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.526038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.526049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.526063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424969:2426], now have 1 active actors on pipe
2025-10-02T09:32:49.526068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424615:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.526072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.526074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.526075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.526082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.526090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.526095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.526097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.526098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.526101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.526102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.526115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.526100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1688
2025-10-02T09:32:49.526120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.526116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1688
2025-10-02T09:32:49.526122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.526129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.526131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.526155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.526161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.526163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.526164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.526169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.526177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.526189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.526286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.526294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.526304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.526362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1689 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0
2025-10-02T09:32:49.526620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a457503-1b08f14d-e3d8cfd4-dee1f65f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.528836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Write session: try to update token
2025-10-02T09:32:49.528845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.535485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.535500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.535502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.535503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.535509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.535512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.535515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536872475:9951]
2025-10-02T09:32:49.535545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.535545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.535549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.535551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.535554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.535555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.535669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.540994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId: src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.543087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.601572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612424994:3127]
2025-10-02T09:32:49.601744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1688, pipe: [1:7556555020612424994:3127]
2025-10-02T09:32:49.647280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.647520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.647529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.647542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424994:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.647768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:49.647766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:49.647775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:49.647789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612424994:3127]
2025-10-02T09:32:49.647805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.647821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1689 reason: error at write: Disconnected sessionId: src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0
2025-10-02T09:32:49.647956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1689 sessionId: src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0 is DEAD
2025-10-02T09:32:49.648079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:49.648085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Write session will restart in 0.008649s
2025-10-02T09:32:49.648106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Write session: Do CDS request
2025-10-02T09:32:49.648112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.658203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.658289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.658296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1690
2025-10-02T09:32:49.658387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.658407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.658413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.658415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.658837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1690 sessionId:  describe result for acl check
2025-10-02T09:32:49.658881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.658889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.658891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.658899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612425269:2420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.659426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612425269:2420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.660572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.661132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612425269:2420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.662046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.662151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.662158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.662164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.662191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.662214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536872773:9965]
2025-10-02T09:32:49.662594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.662809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.662840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.662900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612425269:2420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.662911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612425269:2420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.662914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612425269:2420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.662919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.663049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.663083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.663087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.663088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.663089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.663089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.663090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.663091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.663091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.663092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.663092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.663093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.663093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.663097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.663103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.663105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.663108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.663110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.663112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.663114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.663116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.663119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.663121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.663123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.663125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.663129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.663133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.663137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.663140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.663142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.663145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.663148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.663150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.663153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.663156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.663158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.663161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.663164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.663167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.663169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.663172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.663179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.663182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.663184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.663187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.663190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.663192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.663194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.663197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.663216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.671002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.672670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.672681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.672682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.672684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.672687Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1689 [2:7556555020536872773:9965]
2025-10-02T09:32:49.672695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.672704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.672707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.672708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.672709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.672719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.672725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.672732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.672770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.672774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.672775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.672777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.672778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.672829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.672834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.672840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.672845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.672853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.672867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612425343:2420], now have 1 active actors on pipe
2025-10-02T09:32:49.672872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612424995:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.672876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.672877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.672878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.672885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.672893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.672895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.672897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.672898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.672902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.672903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.672904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1689
2025-10-02T09:32:49.672917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.672906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1689
2025-10-02T09:32:49.672922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.672924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.672936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.672938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.672956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.672963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.672965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.672966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.672971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.672977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.672988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.673081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.673088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.673097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.673150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1690 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0
2025-10-02T09:32:49.673352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5fd3f14-8e1b2ccf-35300613-9cd57599_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.675566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Write session: try to update token
2025-10-02T09:32:49.675576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.682150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.682165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.682167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.682168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.682174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.682176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.682178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536872768:9965]
2025-10-02T09:32:49.682202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.682203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.682205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.682207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.682208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.682210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.682320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.687262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId: src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.689296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.747988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612425357:3127]
2025-10-02T09:32:49.748133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1689, pipe: [1:7556555020612425357:3127]
2025-10-02T09:32:49.796948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.797249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.797258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.797281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612425357:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.797387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:49.797416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:49.797427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:49.797446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612425357:3127]
2025-10-02T09:32:49.797462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.797488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1690 reason: error at write: Disconnected sessionId: src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0
2025-10-02T09:32:49.797623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1690 sessionId: src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0 is DEAD
2025-10-02T09:32:49.797753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:49.797762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Write session will restart in 0.005068s
2025-10-02T09:32:49.797776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Write session: Do CDS request
2025-10-02T09:32:49.797780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.804104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.804223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.804232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1691
2025-10-02T09:32:49.804324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.804343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.804349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.804352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.804623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1691 sessionId:  describe result for acl check
2025-10-02T09:32:49.804643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.804648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.804649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.804652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612425499:2413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.805004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612425499:2413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.806637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612425499:2413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.808862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612425499:2413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.808872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612425499:2413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.808875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612425499:2413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.808880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.809605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.810879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.810987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.810994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.811001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.811030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.811053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536873060:9968]
2025-10-02T09:32:49.811399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.811787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.811815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.812050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.812084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.812089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.812089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.812090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.812090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.812091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.812091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.812091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.812092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.812093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.812093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.812094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.812097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.812102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.812104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.812106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.812108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.812110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.812112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.812114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.812116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.812120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.812121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.812123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.812128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.812132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.812135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.812138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.812141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.812144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.812146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.812149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.812151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.812154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.812156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.812159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.812161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.812163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.812165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.812168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.812170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.812173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.812175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.812177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.812179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.812182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.812184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.812187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.812207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.819678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.821404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.821414Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.821415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.821417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.821420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1690 [2:7556555020536873060:9968]
2025-10-02T09:32:49.821426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.821436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.821440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.821441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.821442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.821451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.821455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.821466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.821498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.821503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.821504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.821506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.821507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.821542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.821546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.821553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.821558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.821566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.821580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612425703:2413], now have 1 active actors on pipe
2025-10-02T09:32:49.821586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612425359:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.821589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.821590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.821591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.821599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.821605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.821610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.821612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.821613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.821616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.821617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.821629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.821634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.821635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.821640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1690
2025-10-02T09:32:49.821666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.821671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.821673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1690
2025-10-02T09:32:49.821683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70ab9d44-bc88b95a-611c260a-3432559b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.821688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.821690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.821692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.821696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.821701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.821711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.821800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.821807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.821816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.821868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1691 partition: 0 MaxSeqNo: 36 sessionId: src_id|70ab9d44-bc88b95a-611c260a-3432559b_0
2025-10-02T09:32:49.822056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcb7e5b2-5be65036-e4eff6d5-2f65f4a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70ab9d44-bc88b95a-611c260a-3432559b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.824388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Write session: try to update token
2025-10-02T09:32:49.824397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.830731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:49.830750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.830754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.830775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:49.830778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:49.830986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:49.831101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:49.831219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:49.831335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:49.831536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:49.831561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:49.836558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId: src_id|70ab9d44-bc88b95a-611c260a-3432559b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.838552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:49.839278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.839292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.839303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.839308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.839310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.839311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.839315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.839317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.839319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536873055:9968]
2025-10-02T09:32:49.839341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.839344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.839348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.839349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.839349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.839352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.839468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.897491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555020612425728:3127]
2025-10-02T09:32:49.897649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1690, pipe: [1:7556555020612425728:3127]
2025-10-02T09:32:49.950369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:49.950761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:49.950786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612425728:3127], now have 1 active actors on pipe
2025-10-02T09:32:49.950876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:49.950903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:49.950934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555020612425728:3127]
2025-10-02T09:32:49.950989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:49.951000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:49.951063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1691 reason: error at write: Disconnected sessionId: src_id|70ab9d44-bc88b95a-611c260a-3432559b_0
2025-10-02T09:32:49.951179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1691 sessionId: src_id|70ab9d44-bc88b95a-611c260a-3432559b_0 is DEAD
2025-10-02T09:32:49.951311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:49.951320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Write session will restart in 0.009353s
2025-10-02T09:32:49.951334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Write session: Do CDS request
2025-10-02T09:32:49.951341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:49.962172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.962273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:49.962288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1692
2025-10-02T09:32:49.962411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:49.962440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:49.962450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:49.962454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:49.962679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:49.962811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1692 sessionId:  describe result for acl check
2025-10-02T09:32:49.962839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:49.962847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:49.962848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:49.962853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555020612426058:2405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:49.963309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555020612426058:2405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:49.964094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:49.964198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:49.964204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:49.964210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:49.964235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:49.964258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555020536873333:9970]
2025-10-02T09:32:49.964644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:49.964808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:49.964840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:49.965034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:49.965070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.965078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.965078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.965079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.965080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.965081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.965082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.965083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.965084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.965085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.965085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.965086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.965090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.965099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.965103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.965107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.965110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.965112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.965114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.965116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.965118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.965121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.965123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.965125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.965129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.965133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:49.965136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.965139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:49.965141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.965144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:49.965146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.965148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:49.965150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.965153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:49.965155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.965157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:49.965159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.965162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:49.965164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.965167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:49.965169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.965172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:49.965174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.965176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.965178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.965181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.965183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.965186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.965203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:49.965208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555020612426058:2405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:49.969916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555020612426058:2405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:49.969925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555020612426058:2405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:49.969927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555020612426058:2405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:49.969932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:49.972571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:49.974192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:49.974202Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:49.974204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:49.974206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:49.974209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1691 [2:7556555020536873333:9970]
2025-10-02T09:32:49.974215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:49.974223Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:49.974225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.974226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.974227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.974235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:49.974239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:49.974243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:49.974272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.974277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.974278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.974280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:49.974282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:49.974326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:49.974331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.974338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:49.974343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:49.974354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:49.974366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612426093:2405], now have 1 active actors on pipe
2025-10-02T09:32:49.974371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555020612425744:2446], now have 1 active actors on pipe
2025-10-02T09:32:49.974374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.974375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.974376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.974383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:49.974392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:49.974397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:49.974399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:49.974401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:49.974402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:49.974404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:49.974405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1691
2025-10-02T09:32:49.974417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.974408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1691
2025-10-02T09:32:49.974422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:49.974424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:49.974443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.974450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.974471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:49.974480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:49.974482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:49.974487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:49.974492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:49.974497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:49.974630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.974767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:49.974774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:49.974784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:49.974852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1692 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0
2025-10-02T09:32:49.975129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ab9d44-bc88b95a-611c260a-3432559b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:49.977858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Write session: try to update token
2025-10-02T09:32:49.977873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:49.983433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:49.983446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:49.983447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:49.983448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:49.983451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.983453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.983455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555020536873328:9970]
2025-10-02T09:32:49.983473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:49.983474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:49.983476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:49.983477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:49.983478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:49.983478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:49.983591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:49.990165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId: src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:49.992277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.051122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907393397:3127]
2025-10-02T09:32:50.051323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1691, pipe: [1:7556555024907393397:3127]
2025-10-02T09:32:50.095262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.095476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.095485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.095497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907393397:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.095634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.095645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.095668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907393397:3127]
2025-10-02T09:32:50.095677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:50.095732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1692 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0
2025-10-02T09:32:50.095860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1692 sessionId: src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0 is DEAD
2025-10-02T09:32:50.096025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:50.096041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Write session will restart in 0.006187s
2025-10-02T09:32:50.096061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Write session: Do CDS request
2025-10-02T09:32:50.096066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.103170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.103286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.103301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1693
2025-10-02T09:32:50.103402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.103428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.103436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.103440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.103805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1693 sessionId:  describe result for acl check
2025-10-02T09:32:50.103835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.103841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.103843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.103846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907393568:2397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.104274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907393568:2397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.106302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907393568:2397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.108160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.108352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907393568:2397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.108361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907393568:2397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.108362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907393568:2397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.108367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.109585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.109683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.109689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.109694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.109723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.109751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831840907:9973]
2025-10-02T09:32:50.110104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.110273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.110296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.110472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.110512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.110517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.110517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.110518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.110519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.110519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.110520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.110520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.110521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.110521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.110525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.110532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.110534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.110536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.110538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.110540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.110542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.110543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.110546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.110548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.110549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.110551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.110555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.110559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.110562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.110565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.110567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.110569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.110571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.110574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.110576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.110579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.110581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.110584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.110586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.110589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.110592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.110594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.110596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.110599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.110603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.110606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.110608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.110610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.110612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.110615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.110633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.118059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.119731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.119743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.119744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.119746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.119750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1692 [2:7556555024831840907:9973]
2025-10-02T09:32:50.119758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.119769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.119773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.119775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.119776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.119784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.119787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.119791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.119826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.119830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.119831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.119833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.119834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.119868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.119872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.119880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.119885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.119894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.119909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907393746:2397], now have 1 active actors on pipe
2025-10-02T09:32:50.119912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907393398:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.119916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.119917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.119918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.119925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.119932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.119939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.119941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.119942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.119942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.119943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.119959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.119965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.119966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.119969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1692
2025-10-02T09:32:50.119986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1692
2025-10-02T09:32:50.120048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.120055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.120069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f225f38-33847683-d3d413d1-ed54fd59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.120076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.120078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.120079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.120085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.120093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.120103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.120228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.120233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.120241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.120305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1693 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f225f38-33847683-d3d413d1-ed54fd59_0
2025-10-02T09:32:50.120567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d373547-cbc17b83-7b02c8cd-d87658d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f225f38-33847683-d3d413d1-ed54fd59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.122967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Write session: try to update token
2025-10-02T09:32:50.122978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:50.129133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:50.129147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:50.129148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:50.129150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:50.129154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.129157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.129159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831840901:9973]
2025-10-02T09:32:50.129183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:50.129191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.129193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:50.129206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:50.129215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:50.129217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:50.129314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:50.135235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId: src_id|9f225f38-33847683-d3d413d1-ed54fd59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:50.137575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.195996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907393759:3127]
2025-10-02T09:32:50.196158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1692, pipe: [1:7556555024907393759:3127]
2025-10-02T09:32:50.239663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.239892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.239901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.239913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907393759:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.240071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.240075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907393759:3127]
2025-10-02T09:32:50.240098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:50.240101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:50.240163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1693 reason: error at write: Disconnected sessionId: src_id|9f225f38-33847683-d3d413d1-ed54fd59_0
2025-10-02T09:32:50.240254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.240333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1693 sessionId: src_id|9f225f38-33847683-d3d413d1-ed54fd59_0 is DEAD
2025-10-02T09:32:50.240473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:50.240481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Write session will restart in 0.007501s
2025-10-02T09:32:50.240515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Write session: Do CDS request
2025-10-02T09:32:50.240520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.249154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.249242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.249253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1694
2025-10-02T09:32:50.249360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.249385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.249393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.249396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.249731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1694 sessionId:  describe result for acl check
2025-10-02T09:32:50.249758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.249763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.249764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.249767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907394000:2388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.250136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907394000:2388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.251986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907394000:2388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.252292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.253717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.253814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.253820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.253827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.253856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.253881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831841182:9975]
2025-10-02T09:32:50.253994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907394000:2388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.254006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907394000:2388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.254012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907394000:2388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.254017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.254238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.254396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.254423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.254601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.254643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.254648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.254648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.254649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.254649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.254650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.254651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.254651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.254652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.254652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.254653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.254653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.254656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.254662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.254664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.254666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.254668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.254670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.254672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.254674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.254676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.254679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.254681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.254683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.254686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.254690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.254693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.254696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.254698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.254701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.254704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.254707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.254710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.254713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.254715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.254718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.254720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.254723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.254725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.254728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.254730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.254733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.254744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.254747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.254750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.254752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.254756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.254758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.254776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.262239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.263709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.263721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.263722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.263724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.263728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1693 [2:7556555024831841182:9975]
2025-10-02T09:32:50.263734Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.263743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.263749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.263750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.263752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.263760Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.263764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.263768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.263800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.263805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.263806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.263808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.263809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.263854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.263861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.263869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.263874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.263882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.263893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907393762:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.263899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394112:2388], now have 1 active actors on pipe
2025-10-02T09:32:50.263903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.263904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.263905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.263912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.263920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.263925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.263927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.263928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.263932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.263933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.263930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1693
2025-10-02T09:32:50.263936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1693
2025-10-02T09:32:50.263946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.263952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.263958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.263972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.263977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.263993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.263999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.264002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.264003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.264008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.264013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.264023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.264144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.264152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.264162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.264222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1694 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0
2025-10-02T09:32:50.264455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f225f38-33847683-d3d413d1-ed54fd59_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.266560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Write session: try to update token
2025-10-02T09:32:50.266570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:50.273094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:50.273107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:50.273109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:50.273110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:50.273115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.273118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.273120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831841177:9975]
2025-10-02T09:32:50.273146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:50.273153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.273153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:50.273155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:50.273156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:50.273158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:50.273263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:50.277551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId: src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:50.279781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.340368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907394126:3127]
2025-10-02T09:32:50.340494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1693, pipe: [1:7556555024907394126:3127]
2025-10-02T09:32:50.385106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.385646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.385656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.385680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394126:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.385796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.385874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:50.385886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:50.385901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907394126:3127]
2025-10-02T09:32:50.385915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.385932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1694 reason: error at write: Disconnected sessionId: src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0
2025-10-02T09:32:50.386061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1694 sessionId: src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0 is DEAD
2025-10-02T09:32:50.386196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:50.386204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Write session will restart in 0.005064s
2025-10-02T09:32:50.386219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Write session: Do CDS request
2025-10-02T09:32:50.386224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.392171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.392319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.392327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1695
2025-10-02T09:32:50.392432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.392453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.392459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.392462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.392710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1695 sessionId:  describe result for acl check
2025-10-02T09:32:50.392732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.392736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.392737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.392739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907394237:2380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.393094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907394237:2380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.394806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907394237:2380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.396725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907394237:2380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.396733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907394237:2380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.396735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907394237:2380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.396739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.398351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.399717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.399815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.399821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.399827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.399852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.399872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831841462:9978]
2025-10-02T09:32:50.400210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.400372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.400395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.400576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.400609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.400614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.400615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.400615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.400616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.400616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.400617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.400617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.400618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.400618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.400619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.400619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.400622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.400628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.400630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.400632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.400634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.400636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.400638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.400640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.400642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.400645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.400647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.400649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.400652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.400656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.400660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.400662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.400664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.400667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.400669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.400672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.400674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.400676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.400678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.400681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.400683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.400686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.400688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.400691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.400693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.400695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.400697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.400700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.400702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.400705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.400707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.400709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.400727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.408076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.409542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.409554Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.409555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.409557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.409560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1694 [2:7556555024831841462:9978]
2025-10-02T09:32:50.409567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.409576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.409579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.409581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.409582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.409591Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.409597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.409603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.409632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.409636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.409637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.409639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.409640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.409676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.409680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.409686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.409691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.409699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.409710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394439:2380], now have 1 active actors on pipe
2025-10-02T09:32:50.409715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394127:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.409718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.409720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.409721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.409728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.409735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.409739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.409740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.409741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.409745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.409746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.409759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.409762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.409763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.409750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1694
2025-10-02T09:32:50.409757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1694
2025-10-02T09:32:50.409777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.409782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.409799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|250e3301-1232cf05-57fd1523-cc21d69e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.409805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.409808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.409809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.409814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.409818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.409827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.409911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.409918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.409926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.409978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1695 partition: 0 MaxSeqNo: 36 sessionId: src_id|250e3301-1232cf05-57fd1523-cc21d69e_0
2025-10-02T09:32:50.410191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a731c0e-5307b14b-efea0f65-5ab19967_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|250e3301-1232cf05-57fd1523-cc21d69e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.412274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Write session: try to update token
2025-10-02T09:32:50.412284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:50.418875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:50.418888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:50.418890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:50.418891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:50.418896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.418898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.418901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831841457:9978]
2025-10-02T09:32:50.418922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:50.418925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.418926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:50.418932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:50.418936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:50.418938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:50.419054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:50.423976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId: src_id|250e3301-1232cf05-57fd1523-cc21d69e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:50.426073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.485788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907394489:3127]
2025-10-02T09:32:50.485961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1694, pipe: [1:7556555024907394489:3127]
2025-10-02T09:32:50.529890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.530322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.530335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.530363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394489:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.530502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.530535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.530541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:50.530545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:50.530568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907394489:3127]
2025-10-02T09:32:50.530600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1695 reason: error at write: Disconnected sessionId: src_id|250e3301-1232cf05-57fd1523-cc21d69e_0
2025-10-02T09:32:50.530749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1695 sessionId: src_id|250e3301-1232cf05-57fd1523-cc21d69e_0 is DEAD
2025-10-02T09:32:50.530877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:50.530886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Write session will restart in 0.008360s
2025-10-02T09:32:50.530905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Write session: Do CDS request
2025-10-02T09:32:50.530910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.540226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.540362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.540370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1696
2025-10-02T09:32:50.540455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.540473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.540479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.540482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.540688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1696 sessionId:  describe result for acl check
2025-10-02T09:32:50.540707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.540711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.540713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.540716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907394762:2369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.541009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907394762:2369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.542397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907394762:2369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.542625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.544100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.544241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.544249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.544256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.544288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.544312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831841752:9980]
2025-10-02T09:32:50.544320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907394762:2369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.544329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907394762:2369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.544331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907394762:2369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.544334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.544663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.544832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.544854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.545047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.545081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.545085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.545085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.545086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.545086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.545087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.545087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.545088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.545088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.545089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.545089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.545090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.545093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.545099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.545101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.545103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.545105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.545108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.545110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.545112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.545114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.545116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.545118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.545120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.545124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.545127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.545131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.545134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.545136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.545139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.545141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.545143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.545146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.545148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.545150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.545153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.545155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.545158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.545160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.545167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.545170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.545172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.545174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.545176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.545179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.545181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.545185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.545187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.545216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.552583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.554088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.554099Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.554100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.554102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.554105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1695 [2:7556555024831841752:9980]
2025-10-02T09:32:50.554113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.554122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.554126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.554128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.554129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.554137Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.554139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.554146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.554185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.554192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.554193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.554195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.554197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.554233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.554238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.554244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.554249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.554257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.554273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394855:2369], now have 1 active actors on pipe
2025-10-02T09:32:50.554278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394491:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.554281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.554282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.554283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.554290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.554298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.554302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.554305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.554306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.554309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.554310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.554323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.554328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.554330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.554329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1695
2025-10-02T09:32:50.554348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1695
2025-10-02T09:32:50.554359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.554364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.554380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.554387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.554389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.554390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.554395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.554399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.554412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.554502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.554508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.554514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.554571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1696 partition: 0 MaxSeqNo: 36 sessionId: src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0
2025-10-02T09:32:50.554810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250e3301-1232cf05-57fd1523-cc21d69e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.556981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Write session: try to update token
2025-10-02T09:32:50.556992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:50.564258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:50.564278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:50.564280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:50.564281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:50.564287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.564291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.564294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831841746:9980]
2025-10-02T09:32:50.564322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:50.564330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:50.564332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:50.564335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:50.564340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.564342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:50.564488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:50.568874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId: src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:50.570906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.630697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907394876:3127]
2025-10-02T09:32:50.630900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1695, pipe: [1:7556555024907394876:3127]
2025-10-02T09:32:50.675907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.676568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.676578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.676590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394876:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.676697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.676705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907394876:3127]
2025-10-02T09:32:50.676724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.676740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:50.676797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1696 reason: status is not ok: tablet will be restarted right now sessionId: src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0
2025-10-02T09:32:50.676952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1696 sessionId: src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0 is DEAD
2025-10-02T09:32:50.677087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:50.677096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Write session will restart in 0.007809s
2025-10-02T09:32:50.677110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Write session: Do CDS request
2025-10-02T09:32:50.677114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.686168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.686240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.686249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1697
2025-10-02T09:32:50.686340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.686361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.686367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.686370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.686669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1697 sessionId:  describe result for acl check
2025-10-02T09:32:50.686688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.686692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.686693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.686697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907395107:2357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.687045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907395107:2357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.688825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907395107:2357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.689566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.690961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.691059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.691065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.691071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.691103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.691130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831842053:9994]
2025-10-02T09:32:50.691136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907395107:2357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.691144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907395107:2357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.691146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907395107:2357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.691149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.691488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.691660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.691687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.691880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.691911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.691915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.691916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.691917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.691917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.691918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.691918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.691919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.691919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.691920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.691920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.691921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.691924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.691930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.691932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.691934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.691936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.691938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.691940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.691942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.691944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.691946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.691948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.691949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.691953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.691957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.691961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.691964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.691966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.691968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.691971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.691973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.691976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.691978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.691980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.691983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.691986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.691991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.691993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.691996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.692002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.692004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.692007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.692010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.692015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.692018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.692020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.692023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.692040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.699428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.700944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.700955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.700956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.700958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.700962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1696 [2:7556555024831842053:9994]
2025-10-02T09:32:50.700968Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.700978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.700983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.700984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.700985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.700994Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.700996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.701004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.701035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.701039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.701040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.701042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.701043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.701084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.701091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.701101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.701111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.701119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.701132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395231:2357], now have 1 active actors on pipe
2025-10-02T09:32:50.701137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907394878:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.701140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.701142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.701143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.701151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.701161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.701163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.701165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.701166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.701172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.701174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.701172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1696
2025-10-02T09:32:50.701179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1696
2025-10-02T09:32:50.701187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.701192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.701193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.701208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.701213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.701231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.701237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.701239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.701240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.701246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.701252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.701265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.701533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.701541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.701551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.701610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1697 partition: 0 MaxSeqNo: 36 sessionId: src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0
2025-10-02T09:32:50.701832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c701d3-7a4a234-7ac974be-6fe76e20_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.703949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Write session: try to update token
2025-10-02T09:32:50.703960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:50.710355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:50.710367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:50.710369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:50.710370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:50.710375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.710377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.710379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831842048:9994]
2025-10-02T09:32:50.710400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:50.710403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.710404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:50.710404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:50.710408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:50.710410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:50.710514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:50.715168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId: src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:50.717566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.776616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907395242:3127]
2025-10-02T09:32:50.776822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1696, pipe: [1:7556555024907395242:3127]
2025-10-02T09:32:50.823826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.824011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.824020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.824045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395242:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.824327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907395242:3127]
2025-10-02T09:32:50.824358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:50.824359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:50.824390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.824399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1697 reason: error at write: Disconnected sessionId: src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0
2025-10-02T09:32:50.824421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.824535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1697 sessionId: src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0 is DEAD
2025-10-02T09:32:50.824685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:50.824696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Write session will restart in 0.008565s
2025-10-02T09:32:50.824720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Write session: Do CDS request
2025-10-02T09:32:50.824725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.834128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.834268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.834278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1698
2025-10-02T09:32:50.834374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.834396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.834402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.834405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.834757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1698 sessionId:  describe result for acl check
2025-10-02T09:32:50.834780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.834785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.834786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.834789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907395500:2353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.835142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907395500:2353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.836491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907395500:2353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.837058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.838310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.838403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.838410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.838415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.838439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.838462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831842344:9997]
2025-10-02T09:32:50.838515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907395500:2353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.838522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907395500:2353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.838524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907395500:2353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.838527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.838828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.838984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.839007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.839188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.839221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.839225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.839226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.839226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.839227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.839227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.839228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.839228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.839229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.839229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.839230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.839230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.839233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.839238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.839240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.839242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.839244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.839246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.839248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.839250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.839252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.839255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.839257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.839259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.839262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.839266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.839269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.839272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.839274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.839276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.839278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.839281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.839283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.839285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.839287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.839290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.839293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.839295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.839297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.839300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.839302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.839304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.839307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.839311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.839314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.839319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.839322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.839330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.839354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.846847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.848393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.848405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.848406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.848408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.848411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1697 [2:7556555024831842344:9997]
2025-10-02T09:32:50.848417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.848427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.848432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.848433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.848434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.848442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.848445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.848451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.848481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.848485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.848486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.848489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.848491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.848525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.848531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.848541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.848550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.848565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.848579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395604:2353], now have 1 active actors on pipe
2025-10-02T09:32:50.848585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395246:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.848588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.848589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.848590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.848598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.848604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.848608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.848611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.848612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.848612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.848613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.848612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1697
2025-10-02T09:32:50.848617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1697
2025-10-02T09:32:50.848626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.848631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.848634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.848644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.848646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.848788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.848811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.848815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.848816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.848823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.848831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.848847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.848955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.848962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.848971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.849021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1698 partition: 0 MaxSeqNo: 36 sessionId: src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0
2025-10-02T09:32:50.849272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de6b71ba-302d9770-6da6efbf-51d659c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.851387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Write session: try to update token
2025-10-02T09:32:50.851398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:50.857934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:50.857948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:50.857949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:50.857951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:50.857956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.857959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.857962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831842339:9997]
2025-10-02T09:32:50.857983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:50.857986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.857987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:50.857992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:50.857995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:50.857998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:50.858101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:50.862990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId: src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:50.865186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:50.924588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555024907395631:3127]
2025-10-02T09:32:50.924769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1697, pipe: [1:7556555024907395631:3127]
2025-10-02T09:32:50.970169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:50.970351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.970359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.970387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395631:3127], now have 1 active actors on pipe
2025-10-02T09:32:50.970535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:50.970574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:50.970574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555024907395631:3127]
2025-10-02T09:32:50.970588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:50.970640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1698 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0
2025-10-02T09:32:50.970779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1698 sessionId: src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0 is DEAD
2025-10-02T09:32:50.970935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:50.970945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Write session will restart in 0.005553s
2025-10-02T09:32:50.970965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Write session: Do CDS request
2025-10-02T09:32:50.970971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:50.977214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.977234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:50.977246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1699
2025-10-02T09:32:50.977462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:50.977489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:50.977497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:50.977503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:50.977874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1699 sessionId:  describe result for acl check
2025-10-02T09:32:50.977903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:50.977908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:50.977909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:50.977914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555024907395719:2331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:50.978339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555024907395719:2331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:50.980144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555024907395719:2331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:50.982494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555024907395719:2331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:50.982502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555024907395719:2331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:50.982504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555024907395719:2331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:50.982507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:50.984313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:50.985796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:50.985900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:50.985906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:50.985912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:50.985936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:50.985960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555024831842628:9999]
2025-10-02T09:32:50.986319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:50.986476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:50.986501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:50.986681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:50.986711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.986715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.986716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.986716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.986717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.986717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.986718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.986719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.986719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.986720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.986720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.986721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.986724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.986730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.986732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.986742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.986745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.986747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.986749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.986751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.986753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.986755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.986757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.986759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.986763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.986769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:50.986774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.986779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:50.986782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.986787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:50.986791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.986793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:50.986797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.986800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:50.986802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.986805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:50.986807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.986810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:50.986812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.986814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:50.986816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.986819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:50.986822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.986825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.986829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.986832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.986834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.986836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.986854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:50.994784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:50.996335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:50.996347Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:50.996349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:50.996351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:50.996354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1698 [2:7556555024831842628:9999]
2025-10-02T09:32:50.996362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:50.996371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:50.996373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.996374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.996375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.996383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:50.996386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:50.996390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:50.996420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.996425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.996426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.996428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:50.996429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:50.996464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:50.996469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:50.996475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:50.996480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:50.996491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:50.996510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395941:2331], now have 1 active actors on pipe
2025-10-02T09:32:50.996517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555024907395632:2446], now have 1 active actors on pipe
2025-10-02T09:32:50.996521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:50.996524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:50.996525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:50.996534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:50.996544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:50.996546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:50.996548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:50.996549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:50.996554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:50.996556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:50.996554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1698
2025-10-02T09:32:50.996556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1698
2025-10-02T09:32:50.996570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:50.996575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:50.996576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:50.996586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.996591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.996616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:50.996623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:50.996625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:50.996626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:50.996631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:50.996636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:50.996650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.996741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:50.996748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:50.996759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:50.996827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1699 partition: 0 MaxSeqNo: 36 sessionId: src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0
2025-10-02T09:32:50.997112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f35660-8351eb88-8ca420c0-e4c35d2e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:50.999347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Write session: try to update token
2025-10-02T09:32:50.999357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.007151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.007164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.007165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.007167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.007171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:51.007174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:51.007176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555024831842623:9999]
2025-10-02T09:32:51.007198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.007198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.007202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.007203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.007203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.007205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.007319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.010854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId: src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.013002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.070503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555029202363302:3127]
2025-10-02T09:32:51.070695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1698, pipe: [1:7556555029202363302:3127]
2025-10-02T09:32:51.119509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:51.119730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.119741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.119766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202363302:3127], now have 1 active actors on pipe
2025-10-02T09:32:51.119919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:51.119959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:51.119995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202363302:3127]
2025-10-02T09:32:51.120015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:51.120020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1699 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0
2025-10-02T09:32:51.120139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1699 sessionId: src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0 is DEAD
2025-10-02T09:32:51.120250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:51.120255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Write session will restart in 0.005480s
2025-10-02T09:32:51.120274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Write session: Do CDS request
2025-10-02T09:32:51.120278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:51.127170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.127222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:51.127230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1700
2025-10-02T09:32:51.127304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.127324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:51.127328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:51.127331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:51.127643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1700 sessionId:  describe result for acl check
2025-10-02T09:32:51.127669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:51.127673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:51.127675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:51.127678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555029202363473:2335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:51.128022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555029202363473:2335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:51.129613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555029202363473:2335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:51.131395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555029202363473:2335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:51.131403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555029202363473:2335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:51.131405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555029202363473:2335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:51.131409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:51.132252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:51.133749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:51.133845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:51.133852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:51.133858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:51.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:51.133903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555029126810206:10002]
2025-10-02T09:32:51.134273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:51.134446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:51.134470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:51.134666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:51.134697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.134701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.134702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.134702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.134703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.134704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.134704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.134705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.134705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.134706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.134706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.134707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.134709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.134715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.134717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.134719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.134721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.134724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.134726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.134728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.134730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.134741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.134744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.134747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.134752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.134758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.134763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.134766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.134768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.134771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.134777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.134780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.134782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.134785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.134790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.134793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.134796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.134798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.134800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.134806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.134808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.134811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.134816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.134819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.134821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.134824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.134829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.134832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.134849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:51.142292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:51.144060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:51.144071Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:51.144072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:51.144073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:51.144078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1699 [2:7556555029126810206:10002]
2025-10-02T09:32:51.144084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:51.144093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:51.144098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.144100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.144100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.144108Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:51.144115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:51.144119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:51.144153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.144158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.144159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.144161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:51.144162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:51.144198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:51.144202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.144212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.144221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.144239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:51.144255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202363656:2335], now have 1 active actors on pipe
2025-10-02T09:32:51.144261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202363303:2446], now have 1 active actors on pipe
2025-10-02T09:32:51.144264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.144265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.144266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.144275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:51.144282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:51.144287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:51.144288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:51.144289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:51.144290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:51.144292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:51.144278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1699
2025-10-02T09:32:51.144290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1699
2025-10-02T09:32:51.144306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.144311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:51.144312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:51.144320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.144322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.144345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:51.144351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.144353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.144354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.144358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.144363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:51.144373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.144473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.144483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.144494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.144549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1700 partition: 0 MaxSeqNo: 36 sessionId: src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0
2025-10-02T09:32:51.144751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55757c0e-f61313c4-7d93b0ce-6c3c64b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:51.147002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Write session: try to update token
2025-10-02T09:32:51.147012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.153507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.153521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.153522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.153523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.153527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.153530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.153533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555029126810201:10002]
2025-10-02T09:32:51.153552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.153555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.153556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.153558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.153561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.153564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.153673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.159787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId: src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.161832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.219993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555029202363671:3127]
2025-10-02T09:32:51.220187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1699, pipe: [1:7556555029202363671:3127]
2025-10-02T09:32:51.263795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:51.264176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.264187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.264199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202363671:3127], now have 1 active actors on pipe
2025-10-02T09:32:51.264315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:51.264361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202363671:3127]
2025-10-02T09:32:51.264374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:51.264380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:51.264436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1700 reason: status is not ok: tablet will be restarted right now sessionId: src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0
2025-10-02T09:32:51.264570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1700 sessionId: src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0 is DEAD
2025-10-02T09:32:51.264685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:51.264693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Write session will restart in 0.008695s
2025-10-02T09:32:51.264707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Write session: Do CDS request
2025-10-02T09:32:51.264712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:51.274248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:51.274270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.274256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1701
2025-10-02T09:32:51.274515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.274536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:51.274542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:51.274545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:51.274794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1701 sessionId:  describe result for acl check
2025-10-02T09:32:51.274816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:51.274820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:51.274822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:51.274825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555029202363946:2326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:51.275156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555029202363946:2326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:51.276617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:51.276737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555029202363946:2326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:51.278089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:51.278186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:51.278193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:51.278199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:51.278225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:51.278247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555029126810491:10005]
2025-10-02T09:32:51.278591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:51.278720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555029202363946:2326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:51.278727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555029202363946:2326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:51.278729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555029202363946:2326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:51.278742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:51.278753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:51.278777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:51.278954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:51.278983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.278987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.278988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.278989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.278989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.278990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.278990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.278991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.278991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.278992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.278992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.278993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.278996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.279002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.279004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.279006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.279008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.279010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.279012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.279014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.279015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.279018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.279020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.279022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.279025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.279029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.279032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.279036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.279038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.279041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.279043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.279045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.279048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.279050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.279052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.279055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.279061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.279064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.279066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.279069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.279073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.279075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.279077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.279080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.279086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.279089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.279091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.279093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.279112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:51.286742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:51.288264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:51.288274Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:51.288276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:51.288278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:51.288281Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1700 [2:7556555029126810491:10005]
2025-10-02T09:32:51.288288Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:51.288298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:51.288299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.288301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.288302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.288311Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:51.288317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:51.288321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:51.288350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.288355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.288357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.288358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:51.288360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:51.288477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1700
2025-10-02T09:32:51.288526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:51.288531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.288526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1700
2025-10-02T09:32:51.288538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.288544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.288553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:51.288564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364033:2326], now have 1 active actors on pipe
2025-10-02T09:32:51.288570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202363674:2446], now have 1 active actors on pipe
2025-10-02T09:32:51.288579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.288581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.288592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.288597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.288598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.288606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:51.288615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:51.288619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:51.288621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:51.288622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:51.288625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:51.288627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:51.288635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:51.288643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.288645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.288646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.288652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.288660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:51.288675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.288682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:51.288687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.288690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:51.288776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.288781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.288790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.288853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1701 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0
2025-10-02T09:32:51.289107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|893fb86f-6d7057ab-3ca33b86-c478885a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:51.291865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Write session: try to update token
2025-10-02T09:32:51.291881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.302065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:51.302076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.302080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.302103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:51.302110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:51.302240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:51.302357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:51.302471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:51.302588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:51.302769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:51.302795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:51.304439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId: src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.306191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.306205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.306206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.306207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.306211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.306213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.306216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555029126810486:10005]
2025-10-02T09:32:51.306235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.306235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.306237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.306240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.306241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.306242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.306357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.306585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.364383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555029202364043:3127]
2025-10-02T09:32:51.364546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1700, pipe: [1:7556555029202364043:3127]
2025-10-02T09:32:51.417807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:51.418111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.418120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.418135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364043:3127], now have 1 active actors on pipe
2025-10-02T09:32:51.418296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:51.418286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:51.418298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:51.418312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202364043:3127]
2025-10-02T09:32:51.418328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:51.418348Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:32:51.418354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1701 reason: error at write: Disconnected sessionId: src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0
2025-10-02T09:32:51.418419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1701 sessionId: src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0 is DEAD
2025-10-02T09:32:51.418431Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 17 consumer shared/user session shared/user_1_17_3895905754289346605_v1 is DEAD
2025-10-02T09:32:51.418498Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554964777822135:3128] disconnected; active server actors: 1
2025-10-02T09:32:51.418503Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556554964777822135:3128] client user disconnected session shared/user_1_17_3895905754289346605_v1
2025-10-02T09:32:51.418725Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:32:51.418727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:51.418762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Write session will restart in 0.007611s
2025-10-02T09:32:51.418783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Write session: Do CDS request
2025-10-02T09:32:51.418790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:51.418869Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:51.418874Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:32:51.418891Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.009886s
2025-10-02T09:32:51.427194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.427281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:51.427290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1702
2025-10-02T09:32:51.427412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.427438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:51.427446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:51.427450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:51.427769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1702 sessionId:  describe result for acl check
2025-10-02T09:32:51.427792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:51.427797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:51.427798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:51.427800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555029202364264:8302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:51.428144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555029202364264:8302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:51.429032Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:32:51.429139Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:32:51.429147Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 18
2025-10-02T09:32:51.429230Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 18 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:51.429261Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:32:51.429296Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 auth for : user
2025-10-02T09:32:51.429438Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 Handle describe topics response
2025-10-02T09:32:51.429452Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 auth is DEAD
2025-10-02T09:32:51.429461Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:32:51.429624Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:32:51.429677Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555029202364356:8295] connected; active server actors: 1
2025-10-02T09:32:51.429720Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_18_6572321245995679513_v1
2025-10-02T09:32:51.429736Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555029202364356:8295] session shared/user_1_18_6572321245995679513_v1
2025-10-02T09:32:51.429748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:32:51.429755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:32:51.429763Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_18_6572321245995679513_v1" (Sender=[1:7556555029202364326:8295], Pipe=[1:7556555029202364356:8295], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:51.429766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:32:51.429778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:32:51.429789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_18_6572321245995679513_v1" (Sender=[1:7556555029202364326:8295], Pipe=[1:7556555029202364356:8295], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:32:51.429800Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_18_6572321245995679513_v1" sender [1:7556555029202364326:8295] lock partition 0 for ReadingSession "shared/user_1_18_6572321245995679513_v1" (Sender=[1:7556555029202364326:8295], Pipe=[1:7556555029202364356:8295], Partitions=[], ActiveFamilyCount=1) generation 1 step 18
2025-10-02T09:32:51.429810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:32:51.429817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-10-02T09:32:51.429983Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 18 Session: "shared/user_1_18_6572321245995679513_v1" ClientId: "user" PipeClient { RawX1: 7556555029202364356 RawX2: 4503603922346087 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:32:51.430003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:32:51.430211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555029202364264:8302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:51.431574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:51.432988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:51.433079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555029202364264:8302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:51.433086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555029202364264:8302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:51.433088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555029202364264:8302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:51.433091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:51.433103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:51.433110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:51.433116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:51.433143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:51.433165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555029126810776:10007]
2025-10-02T09:32:51.433501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:51.433891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:51.433932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:51.434127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:51.434161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.434167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.434167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.434168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.434169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.434170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.434171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.434172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.434173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.434173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.434174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.434175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.434180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.434188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.434192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.434195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.434198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.434202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.434204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.434206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.434208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.434210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.434211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.434213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.434218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.434221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.434229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.434232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.434236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.434238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.434241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.434244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.434246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.434249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.434251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.434253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.434255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.434258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.434264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.434266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.434269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.434271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.434276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.434279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.434283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.434287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.434289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.434292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.434311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:51.441726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:51.443395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:51.443406Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:51.443407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:51.443409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:51.443412Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1701 [2:7556555029126810776:10007]
2025-10-02T09:32:51.443418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:51.443427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:51.443432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.443433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.443434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.443442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:51.443449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:51.443453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:51.443483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.443487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.443488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.443490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:51.443491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:51.443527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:51.443531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.443537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.443542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.443550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:51.443565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364371:8287], now have 1 active actors on pipe
2025-10-02T09:32:51.443570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364408:8302], now have 1 active actors on pipe
2025-10-02T09:32:51.443574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.443575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.443576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.443584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:51.443588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364044:2446], now have 1 active actors on pipe
2025-10-02T09:32:51.443592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:51.443597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:51.443599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:51.443600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:51.443602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:51.443604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:51.443616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.443621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:51.443613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1701, pipe: [1:7556555029202364371:8287]
2025-10-02T09:32:51.443632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:51.443617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1701
2025-10-02T09:32:51.443636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.443634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1701
2025-10-02T09:32:51.443637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.443644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_18_6572321245995679513_v1 on pipe: [1:7556555029202364371:8287]
2025-10-02T09:32:51.443665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.443669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.443676Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_18_6572321245995679513_v1:1 with generation 1701
2025-10-02T09:32:51.443678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.443681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.443682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.443691Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_18_6572321245995679513_v1
2025-10-02T09:32:51.443696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.443715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b7a170a-e232137c-54a7a440-712761fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:51.443722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:32:51.443724Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:32:51.447039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:32:51.447051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:32:51.447055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.447057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.447058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.447063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.447068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:51.447074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:32:51.447079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:32:51.447089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.447156Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397571443 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:32:51.447168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:32:51.447183Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 sending to client partition status
2025-10-02T09:32:51.447202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.447208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.447214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.447264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1702 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b7a170a-e232137c-54a7a440-712761fc_0
2025-10-02T09:32:51.447504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a260caa-dcabf075-3bfb3df5-b5474c28_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b7a170a-e232137c-54a7a440-712761fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:51.450233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Write session: try to update token
2025-10-02T09:32:51.450249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.452597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.452607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.452608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.452609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.452613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.452615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.452617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555029126810771:10007]
2025-10-02T09:32:51.452636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.452638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.452641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.452640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.452642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.452642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.452759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.462846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId: src_id|2b7a170a-e232137c-54a7a440-712761fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.464955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.562972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:51.563255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.563264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.563369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_18_6572321245995679513_v1
2025-10-02T09:32:51.563378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:51.563400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202364371:8287]
2025-10-02T09:32:51.563420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:51.563469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1702 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b7a170a-e232137c-54a7a440-712761fc_0
2025-10-02T09:32:51.563591Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_18_6572321245995679513_v1
2025-10-02T09:32:51.563594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1702 sessionId: src_id|2b7a170a-e232137c-54a7a440-712761fc_0 is DEAD
2025-10-02T09:32:51.563711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:51.563735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:51.563751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Write session will restart in 0.007163s
2025-10-02T09:32:51.563778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Write session: Do CDS request
2025-10-02T09:32:51.563784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:51.572131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.572246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:51.572255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1703
2025-10-02T09:32:51.572375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.572395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:51.572401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:51.572404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:51.572639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1703 sessionId:  describe result for acl check
2025-10-02T09:32:51.572657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:51.572659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:51.572660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:51.572663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555029202364633:8266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:51.572978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555029202364633:8266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:51.575174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555029202364633:8266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:51.577308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555029202364633:8266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:51.577316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555029202364633:8266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:51.577284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:51.577317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555029202364633:8266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:51.577321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:51.578716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:51.578824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:51.578831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:51.578836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:51.578863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:51.578884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555029126811077:10015]
2025-10-02T09:32:51.579224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:51.579389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:51.579410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:51.579577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:51.579605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.579608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.579609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.579609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.579610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.579611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.579611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.579612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.579612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.579613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.579613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.579613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.579616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.579622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.579624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.579626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.579628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.579630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.579632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.579634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.579636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.579638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.579640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.579642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.579645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.579649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.579652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.579655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.579657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.579660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.579662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.579664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.579666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.579669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.579672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.579675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.579677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.579680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.579682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.579685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.579687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.579689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.579691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.579693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.579695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.579698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.579700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.579702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.579719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:51.587163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:51.588814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:51.588824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:51.588825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:51.588827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:51.588830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1702 [2:7556555029126811077:10015]
2025-10-02T09:32:51.588837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:51.588845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:51.588847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.588848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.588849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.588858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:51.588861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:51.588869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:51.588900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.588906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.588908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.588910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:51.588912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:51.588958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:51.588964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.588970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.588975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.588985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:51.589000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364794:8266], now have 1 active actors on pipe
2025-10-02T09:32:51.589005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364438:2446], now have 1 active actors on pipe
2025-10-02T09:32:51.589008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.589010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.589011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.589018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:51.589026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:51.589032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:51.589034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:51.589035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:51.589036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:51.589038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:51.589052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.589057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:51.589046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1702
2025-10-02T09:32:51.589048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1702
2025-10-02T09:32:51.589062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:51.589078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.589083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.589099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:51.589105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.589107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.589108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.589114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.589121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:51.589128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.589226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.589232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.589242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.589296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1703 partition: 0 MaxSeqNo: 36 sessionId: src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0
2025-10-02T09:32:51.589549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7a170a-e232137c-54a7a440-712761fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:51.592247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Write session: try to update token
2025-10-02T09:32:51.592261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.598124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.598136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.598137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.598138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.598142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.598145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.598146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555029126811071:10015]
2025-10-02T09:32:51.598165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.598166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.598169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.598171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.598171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.598172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.598353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.604418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId: src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.606479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.663413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555029202364817:8287]
2025-10-02T09:32:51.663613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1702, pipe: [1:7556555029202364817:8287]
2025-10-02T09:32:51.709715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:51.710033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.710043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.710056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364817:8287], now have 1 active actors on pipe
2025-10-02T09:32:51.710190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:51.710202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:51.710238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202364817:8287]
2025-10-02T09:32:51.710240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:51.710306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0
2025-10-02T09:32:51.710476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1703 sessionId: src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0 is DEAD
2025-10-02T09:32:51.710632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:51.710647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Write session will restart in 0.006659s
2025-10-02T09:32:51.710668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Write session: Do CDS request
2025-10-02T09:32:51.710673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:51.718151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.718214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:51.718224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1704
2025-10-02T09:32:51.718370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.718398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:51.718406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:51.718410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:51.718693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1704 sessionId:  describe result for acl check
2025-10-02T09:32:51.718715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:51.718719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:51.718720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:51.718723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555029202364996:8269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:51.719067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555029202364996:8269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:51.721307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555029202364996:8269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:51.723622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555029202364996:8269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:51.723629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555029202364996:8269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:51.723631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555029202364996:8269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:51.723634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:51.723754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:51.725403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:51.725502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:51.725509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:51.725514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:51.725540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:51.725565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555029126811386:10023]
2025-10-02T09:32:51.725899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:51.726065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:51.726086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:51.726258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:51.726286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.726289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.726290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.726291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.726291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.726292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.726292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.726293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.726293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.726294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.726294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.726295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.726298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.726303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.726305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.726307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.726309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.726311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.726313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.726315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.726317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.726319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.726321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.726323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.726327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.726331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.726334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.726337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.726339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.726342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.726344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.726347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.726349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.726352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.726354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.726356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.726359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.726362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.726364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.726367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.726369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.726371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.726373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.726376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.726378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.726381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.726383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.726386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.726403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:51.733873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:51.735512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:51.735523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:51.735525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:51.735527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:51.735531Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1703 [2:7556555029126811386:10023]
2025-10-02T09:32:51.735539Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:51.735553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:51.735558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.735559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.735560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.735570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:51.735575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:51.735579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:51.735614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.735619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.735620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.735622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:51.735624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:51.735755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1703
2025-10-02T09:32:51.735759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1703
2025-10-02T09:32:51.735859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:51.735865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.735872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.735877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.735885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:51.735902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202364819:2446], now have 1 active actors on pipe
2025-10-02T09:32:51.735907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202365178:8269], now have 1 active actors on pipe
2025-10-02T09:32:51.735917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.735922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.735935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.735939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.735940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.735949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:51.735959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:51.735961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:51.735963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:51.735964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:51.735970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:51.735972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:51.735982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:51.735989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.735992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.735993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.735998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.736004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:51.736024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.736031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:51.736037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.736041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:51.736132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.736138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.736146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.736199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1704 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0
2025-10-02T09:32:51.736470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723b1bfb-b4474b2c-8bc1a66e-3f759aaf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:51.739155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Write session: try to update token
2025-10-02T09:32:51.739172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.745068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:51.745080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.745085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.745107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:51.745110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:51.745555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:51.745939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:51.746312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:51.746745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:51.747316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:51.747347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:51.753401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId: src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.753504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.753517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.753518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.753519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.753522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.753524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.753526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555029126811380:10023]
2025-10-02T09:32:51.753546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.753546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.753549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.753550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.753553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.753556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.753667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.755628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.810336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555029202365190:8287]
2025-10-02T09:32:51.810520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1703, pipe: [1:7556555029202365190:8287]
2025-10-02T09:32:51.864533Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:51.864848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.864859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.864873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202365190:8287], now have 1 active actors on pipe
2025-10-02T09:32:51.865006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:51.865042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:51.865059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202365190:8287]
2025-10-02T09:32:51.865074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:51.865130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1704 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0
2025-10-02T09:32:51.865287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1704 sessionId: src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0 is DEAD
2025-10-02T09:32:51.865441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:51.865454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Write session will restart in 0.008722s
2025-10-02T09:32:51.865478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Write session: Do CDS request
2025-10-02T09:32:51.865484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:51.875145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.875252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:51.875262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1705
2025-10-02T09:32:51.875415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:51.875442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:51.875449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:51.875453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:51.875763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1705 sessionId:  describe result for acl check
2025-10-02T09:32:51.875788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:51.875794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:51.875796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:51.875800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555029202365463:8253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:51.876249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555029202365463:8253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:51.877796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555029202365463:8253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:51.878006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:51.879420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:51.879533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:51.879540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:51.879546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:51.879576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:51.879600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555029126811684:10026]
2025-10-02T09:32:51.879781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555029202365463:8253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:51.879790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555029202365463:8253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:51.879792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555029202365463:8253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:51.879795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:51.879947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:51.880118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:51.880142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:51.880326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:51.880357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.880361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.880361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.880362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.880363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.880363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.880364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.880364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.880365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.880365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.880366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.880366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.880369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.880375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.880377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.880379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.880381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.880383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.880385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.880387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.880388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.880390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.880392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.880394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.880398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.880402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:51.880405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.880408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:51.880410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.880413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:51.880415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.880420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:51.880422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.880425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:51.880427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.880429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:51.880431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.880434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:51.880435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.880443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:51.880445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.880447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:51.880449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.880452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.880454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.880461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.880464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.880469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.880494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:51.888513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:51.890181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:51.890193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:51.890195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:51.890198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:51.890202Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1704 [2:7556555029126811684:10026]
2025-10-02T09:32:51.890211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:51.890224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:51.890229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.890231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.890232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.890240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:51.890243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:51.890250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:51.890282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.890286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.890287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.890289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:51.890290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:51.890327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:51.890333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.890339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:51.890344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:51.890352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:51.890366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202365560:8253], now have 1 active actors on pipe
2025-10-02T09:32:51.890371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202365199:2446], now have 1 active actors on pipe
2025-10-02T09:32:51.890375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.890376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.890377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.890383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:51.890393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:51.890396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:51.890398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:51.890399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:51.890403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:51.890404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:51.890406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1704
2025-10-02T09:32:51.890418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.890410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1704
2025-10-02T09:32:51.890423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:51.890424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:51.890442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.890448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.890467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:51.890477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:51.890482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:51.890483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:51.890488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:51.890496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:51.890507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.890616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:51.890621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:51.890628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:51.890682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1705 partition: 0 MaxSeqNo: 36 sessionId: src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0
2025-10-02T09:32:51.890938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b2d8e1-acc6ab11-3e2fd70d-236d9f01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:51.893626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Write session: try to update token
2025-10-02T09:32:51.893641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:51.900656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:51.900668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:51.900669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:51.900670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:51.900676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.900678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.900680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555029126811679:10026]
2025-10-02T09:32:51.900698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:51.900699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:51.900702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:51.900704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:51.900704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:51.900705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:51.900829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:51.907070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId: src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:51.909765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:51.964951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555029202365586:8287]
2025-10-02T09:32:51.965133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1704, pipe: [1:7556555029202365586:8287]
2025-10-02T09:32:52.013912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.014122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.014133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.014145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555029202365586:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.014257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.014249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555029202365586:8287]
2025-10-02T09:32:52.014270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.014272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.014299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.014320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1705 reason: error at write: Disconnected sessionId: src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0
2025-10-02T09:32:52.014486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1705 sessionId: src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0 is DEAD
2025-10-02T09:32:52.014612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.014621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Write session will restart in 0.005902s
2025-10-02T09:32:52.014635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Write session: Do CDS request
2025-10-02T09:32:52.014639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.021154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.021265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.021274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1706
2025-10-02T09:32:52.021393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.021413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.021418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.021421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.021737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1706 sessionId:  describe result for acl check
2025-10-02T09:32:52.021763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.021765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.021767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.021771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497333000:8252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.022129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497333000:8252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.024275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497333000:8252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.026544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497333000:8252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.026552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497333000:8252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.026555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497333000:8252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.026560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.028388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.029925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.030021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.030028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.030034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.030059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.030086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421779270:10029]
2025-10-02T09:32:52.030425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.030584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.030606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.030789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.030820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.030824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.030824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.030825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.030825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.030826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.030826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.030827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.030828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.030828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.030829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.030829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.030832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.030838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.030840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.030842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.030844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.030846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.030848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.030850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.030852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.030854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.030856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.030858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.030862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.030866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.030869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.030872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.030875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.030877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.030879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.030882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.030884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.030886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.030888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.030891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.030893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.030895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.030897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.030901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.030904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.030912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.030916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.030923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.030928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.030932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.030936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.030943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.030958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.039382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.041052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.041063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.041064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.041066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.041069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1705 [2:7556555033421779270:10029]
2025-10-02T09:32:52.041076Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.041089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.041093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.041095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.041095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.041104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.041110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.041115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.041146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.041150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.041151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.041153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.041154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.041191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.041195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.041202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.041207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.041215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.041229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497333203:8252], now have 1 active actors on pipe
2025-10-02T09:32:52.041234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497332884:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.041239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.041240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.041241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.041249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.041258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.041259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.041261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.041263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.041265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.041266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.041280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.041266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1705
2025-10-02T09:32:52.041285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.041269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1705
2025-10-02T09:32:52.041286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.041294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.041296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.041321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|666260bc-acffbfc3-46a5411d-80880f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.041328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.041331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.041332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.041337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.041341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.041350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.041443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.041448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.041456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.041510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1706 partition: 0 MaxSeqNo: 36 sessionId: src_id|666260bc-acffbfc3-46a5411d-80880f22_0
2025-10-02T09:32:52.041726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4d9182-a2ab3329-d29a0063-96c01bfa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|666260bc-acffbfc3-46a5411d-80880f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.044133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Write session: try to update token
2025-10-02T09:32:52.044144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.051981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.051997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.051998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.051999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.052005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.052008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.052010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421779265:10029]
2025-10-02T09:32:52.052037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.052041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.052040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.052044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.052046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.052048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.052161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.056394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId: src_id|666260bc-acffbfc3-46a5411d-80880f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.058664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:52.114470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555033497333257:8287]
2025-10-02T09:32:52.114647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1705, pipe: [1:7556555033497333257:8287]
2025-10-02T09:32:52.164565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.164785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.164795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.164837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497333257:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.165034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.165043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.165078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555033497333257:8287]
2025-10-02T09:32:52.165085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1706 reason: error at write: Disconnected sessionId: src_id|666260bc-acffbfc3-46a5411d-80880f22_0
2025-10-02T09:32:52.165096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.165153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.165233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1706 sessionId: src_id|666260bc-acffbfc3-46a5411d-80880f22_0 is DEAD
2025-10-02T09:32:52.165400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.165413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Write session will restart in 0.009768s
2025-10-02T09:32:52.165436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Write session: Do CDS request
2025-10-02T09:32:52.165442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.176195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.176295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.176304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1707
2025-10-02T09:32:52.176425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.176445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.176452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.176454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.176738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1707 sessionId:  describe result for acl check
2025-10-02T09:32:52.176764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.176766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.176769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.176773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497333534:8247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.177119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497333534:8247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.178498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497333534:8247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.178898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.180553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.180655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.180662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.180667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.180693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.180680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497333534:8247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.180687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497333534:8247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.180690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497333534:8247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.180694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.180717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421779558:10031]
2025-10-02T09:32:52.181076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.181254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.181281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.181471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.181508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.181513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.181514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.181515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.181516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.181517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.181518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.181519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.181519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.181520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.181520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.181521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.181524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.181529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.181531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.181533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.181535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.181537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.181539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.181541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.181543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.181546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.181548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.181549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.181553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.181557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.181560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.181563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.181566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.181569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.181571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.181574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.181576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.181579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.181581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.181584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.181587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.181590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.181594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.181596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.181598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.181601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.181603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.181606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.181610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.181613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.181614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.181617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.181633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.189833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.191473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.191486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.191487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.191489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.191492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1706 [2:7556555033421779558:10031]
2025-10-02T09:32:52.191498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.191507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.191509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.191510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.191511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.191520Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.191523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.191528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.191557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.191563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.191564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.191566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.191567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.191605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.191611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.191617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.191623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.191634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.191648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497333258:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.191654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497333622:8247], now have 1 active actors on pipe
2025-10-02T09:32:52.191658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.191659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.191660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.191670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.191678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.191668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1706
2025-10-02T09:32:52.191685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.191676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1706
2025-10-02T09:32:52.191685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.191688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.191689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.191690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.191711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.191716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.191724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.191731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.191741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.191751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.191756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.191763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.191764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.191769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.191774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.191791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.191892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.191899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.191908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.191975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1707 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0
2025-10-02T09:32:52.192178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666260bc-acffbfc3-46a5411d-80880f22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.194452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Write session: try to update token
2025-10-02T09:32:52.194464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.202667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.202684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.202686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.202687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.202693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.202695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.202698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421779553:10031]
2025-10-02T09:32:52.202719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.202725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.202726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.202727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.202730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.202740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.202856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.206320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId: src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.208539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:52.264980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555033497333635:8287]
2025-10-02T09:32:52.265164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1706, pipe: [1:7556555033497333635:8287]
2025-10-02T09:32:52.312034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.312419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.312430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.312456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497333635:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.312673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.312693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.312696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.312719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555033497333635:8287]
2025-10-02T09:32:52.312751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1707 reason: error at write: Disconnected sessionId: src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0
2025-10-02T09:32:52.312912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1707 sessionId: src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0 is DEAD
2025-10-02T09:32:52.313036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.313047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Write session will restart in 0.009258s
2025-10-02T09:32:52.313067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Write session: Do CDS request
2025-10-02T09:32:52.313081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.313899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.323245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.323332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.323343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1708
2025-10-02T09:32:52.323449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.323475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.323483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.323486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.323812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1708 sessionId:  describe result for acl check
2025-10-02T09:32:52.323835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.323837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.323839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.323842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497333907:8240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.324180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497333907:8240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.325831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497333907:8240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.325909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.327404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.327505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.327512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.327518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.327545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.327568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421779849:10034]
2025-10-02T09:32:52.327784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497333907:8240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.327792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497333907:8240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.327795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497333907:8240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.327805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.327905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.328061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.328166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.328345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.328373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.328377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.328378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.328378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.328379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.328379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.328380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.328380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.328381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.328381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.328382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.328382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.328385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.328391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.328393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.328395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.328397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.328399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.328401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.328403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.328404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.328407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.328409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.328411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.328414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.328419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.328422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.328425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.328427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.328430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.328432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.328435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.328437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.328439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.328441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.328444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.328446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.328449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.328451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.328453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.328455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.328462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.328465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.328467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.328469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.328472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.328475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.328477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.328496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.336929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.338381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.338393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.338394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.338396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.338399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1707 [2:7556555033421779849:10034]
2025-10-02T09:32:52.338407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.338420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.338425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.338427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.338428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.338436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.338443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.338447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.338475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.338480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.338481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.338483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.338484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.338518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.338523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.338530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.338535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.338543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.338557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334000:8240], now have 1 active actors on pipe
2025-10-02T09:32:52.338563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497333636:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.338566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.338567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.338568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.338576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.338584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.338589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.338592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.338593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.338594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.338595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.338609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.338610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.338607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1707
2025-10-02T09:32:52.338609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1707
2025-10-02T09:32:52.338632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.338753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.338759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.338774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2152f0c-875b605-9e2de22c-3136d691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.338778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.338780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.338781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.338787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.338792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.338801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.338906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.338912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.338919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.338969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1708 partition: 0 MaxSeqNo: 36 sessionId: src_id|2152f0c-875b605-9e2de22c-3136d691_0
2025-10-02T09:32:52.339190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4f0083-4876eb8f-ef57a763-ba00cb17_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2152f0c-875b605-9e2de22c-3136d691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.341871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Write session: try to update token
2025-10-02T09:32:52.341885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.348490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.348508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.348510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.348511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.348518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.348522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.348526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421779844:10034]
2025-10-02T09:32:52.348554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.348557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.348562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.348563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.348564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.348568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.348725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.354226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId: src_id|2152f0c-875b605-9e2de22c-3136d691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.356203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:52.412958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555033497334012:8287]
2025-10-02T09:32:52.413126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1707, pipe: [1:7556555033497334012:8287]
2025-10-02T09:32:52.458173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.458477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.458487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.458500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334012:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.458666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555033497334012:8287]
2025-10-02T09:32:52.458687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.458700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.458703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.458788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1708 reason: error at write: Disconnected sessionId: src_id|2152f0c-875b605-9e2de22c-3136d691_0
2025-10-02T09:32:52.458847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.458926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1708 sessionId: src_id|2152f0c-875b605-9e2de22c-3136d691_0 is DEAD
2025-10-02T09:32:52.459052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.459062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Write session will restart in 0.007441s
2025-10-02T09:32:52.459085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Write session: Do CDS request
2025-10-02T09:32:52.459090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.467197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.467247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.467256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1709
2025-10-02T09:32:52.467351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.467370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.467376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.467379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.467629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1709 sessionId:  describe result for acl check
2025-10-02T09:32:52.467654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.467659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.467661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.467665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497334206:8234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.468005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497334206:8234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.469975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497334206:8234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.471625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497334206:8234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.471633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497334206:8234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.471635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497334206:8234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.471640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.473537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.473794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.473889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.473896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.473902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.473928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.473953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421780141:10036]
2025-10-02T09:32:52.474292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.474444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.474467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.474638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.474665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.474669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.474670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.474670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.474671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.474671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.474672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.474672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.474673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.474673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.474674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.474674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.474677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.474683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.474685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.474687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.474689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.474691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.474693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.474695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.474697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.474699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.474701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.474703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.474706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.474710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.474714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.474717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.474719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.474722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.474724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.474727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.474729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.474742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.474745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.474748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.474750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.474755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.474757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.474759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.474765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.474768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.474771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.474773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.474778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.474781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.474784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.474786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.474805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.483170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.484790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.484814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.484815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.484817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.484820Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1708 [2:7556555033421780141:10036]
2025-10-02T09:32:52.484826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.484836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.484838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.484839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.484840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.484849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.484855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.484860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.484890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.484894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.484895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.484897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.484898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.484934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.484938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.484945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.484953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.484964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.484974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334375:8234], now have 1 active actors on pipe
2025-10-02T09:32:52.484979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334013:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.484983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.484984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.484985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.484992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.484999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.485009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.485012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.484997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1708
2025-10-02T09:32:52.485014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.485014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.485003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1708
2025-10-02T09:32:52.485015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.485034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.485039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.485049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.485056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.485066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.485074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.485077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.485080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.485081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.485086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.485094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.485108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.485188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.485193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.485200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.485245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1709 partition: 0 MaxSeqNo: 36 sessionId: src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0
2025-10-02T09:32:52.485442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2152f0c-875b605-9e2de22c-3136d691_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.487850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Write session: try to update token
2025-10-02T09:32:52.487858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.495289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.495303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.495304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.495305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.495309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.495312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.495314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421780136:10036]
2025-10-02T09:32:52.495335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.495339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.495340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.495343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.495347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.495349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.495460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.498942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId: src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.500947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:52.558874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555033497334390:8287]
2025-10-02T09:32:52.559019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1708, pipe: [1:7556555033497334390:8287]
2025-10-02T09:32:52.605748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.605917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.605927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.605952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334390:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.606114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.606127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.606174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1709 reason: error at write: Disconnected sessionId: src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0
2025-10-02T09:32:52.606324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1709 sessionId: src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0 is DEAD
2025-10-02T09:32:52.606466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.606477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Write session will restart in 0.006428s
2025-10-02T09:32:52.606502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Write session: Do CDS request
2025-10-02T09:32:52.606507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.606539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.606568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555033497334390:8287]
2025-10-02T09:32:52.606661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.614141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.614220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.614230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1710
2025-10-02T09:32:52.614317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.614341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.614348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.614351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.614763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1710 sessionId:  describe result for acl check
2025-10-02T09:32:52.614789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.614795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.614796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.614799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497334586:8222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.615342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497334586:8222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.616767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497334586:8222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.619149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497334586:8222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.619156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497334586:8222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.619160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497334586:8222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.619164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.619636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.621190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.621288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.621295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.621300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.621327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.621348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421780469:10044]
2025-10-02T09:32:52.621714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.621899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.621923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.622096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.622123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.622127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.622127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.622128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.622128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.622129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.622129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.622130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.622130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.622131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.622131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.622132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.622134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.622140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.622142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.622144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.622146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.622148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.622150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.622152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.622154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.622156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.622158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.622160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.622163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.622167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.622170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.622173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.622175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.622177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.622179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.622182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.622184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.622187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.622189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.622192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.622194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.622196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.622198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.622201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.622206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.622209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.622214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.622216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.622220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.622222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.622228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.622230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.622246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.630283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.631879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.631891Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.631892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.631894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.631898Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1709 [2:7556555033421780469:10044]
2025-10-02T09:32:52.631905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.631914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.631919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.631920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.631922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.631930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.631933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.631936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.631964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.631969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.631970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.631972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.631973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.632006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.632011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.632018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.632023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.632030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.632041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334775:8222], now have 1 active actors on pipe
2025-10-02T09:32:52.632045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334404:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.632048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.632050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.632051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.632058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.632066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.632070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.632072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.632073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.632077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.632068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1709
2025-10-02T09:32:52.632078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.632091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.632093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.632101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.632080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1709
2025-10-02T09:32:52.632109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.632113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.632234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.632242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.632246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.632247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.632252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.632261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.632274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.632375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.632380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.632388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.632437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1710 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0
2025-10-02T09:32:52.632640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74b2d4d2-2f21925d-d241adbe-5b3320a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.634901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Write session: try to update token
2025-10-02T09:32:52.634912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.642766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.642784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.642787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.642790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.642799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.642802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.642806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421780464:10044]
2025-10-02T09:32:52.642831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.642836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.642839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.642840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.642841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.642843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.642968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.646910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId: src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.648935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:52.706843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555033497334790:8287]
2025-10-02T09:32:52.707006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1709, pipe: [1:7556555033497334790:8287]
2025-10-02T09:32:52.754689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.755015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.755025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.755051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334790:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.755231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.755257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.755267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.755281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.755317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555033497334790:8287]
2025-10-02T09:32:52.755322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1710 reason: error at write: Disconnected sessionId: src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0
2025-10-02T09:32:52.755500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1710 sessionId: src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0 is DEAD
2025-10-02T09:32:52.755933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.755942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Write session will restart in 0.005225s
2025-10-02T09:32:52.755962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Write session: Do CDS request
2025-10-02T09:32:52.755967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.762122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.762228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.762238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1711
2025-10-02T09:32:52.762316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.762341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.762349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.762352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.762701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1711 sessionId:  describe result for acl check
2025-10-02T09:32:52.762728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.762738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.762740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.762743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497334941:8216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.763152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497334941:8216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.765165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497334941:8216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.767304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497334941:8216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.767312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497334941:8216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.767314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497334941:8216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.767317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.768367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.769868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.770031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.770039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.770046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.770076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.770104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421780762:10052]
2025-10-02T09:32:52.770444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.770609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.770632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.770815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.770843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.770847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.770847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.770848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.770848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.770849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.770849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.770850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.770850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.770851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.770851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.770852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.770855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.770861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.770863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.770865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.770867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.770869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.770870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.770872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.770874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.770876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.770878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.770880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.770884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.770887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.770891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.770893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.770895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.770898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.770900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.770903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.770905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.770907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.770909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.770912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.770914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.770917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.770919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.770921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.770925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.770928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.770930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.770933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.770935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.770937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.770939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.770942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.770957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.779298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.780950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.780960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.780961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.780963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.780966Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1710 [2:7556555033421780762:10052]
2025-10-02T09:32:52.780974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.780983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.780988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.780989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.780990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.780999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.781001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.781006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.781032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.781037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.781038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.781041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.781042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.781080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.781084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.781091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.781096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.781107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.781121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497335153:8216], now have 1 active actors on pipe
2025-10-02T09:32:52.781126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497334791:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.781129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.781131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.781132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.781139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.781146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.781151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.781155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.781156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.781141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1710
2025-10-02T09:32:52.781156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.781145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1710
2025-10-02T09:32:52.781158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.781170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.781171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.781173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.781182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.781187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.781211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.781217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.781220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.781221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.781226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.781231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.781240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.781319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.781324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.781330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.781377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1711 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0
2025-10-02T09:32:52.781561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f29bfb8-a6ad8646-73f4863c-cd199c05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.783803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Write session: try to update token
2025-10-02T09:32:52.783813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.791663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.791677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.791678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.791679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.791684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.791686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.791689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421780757:10052]
2025-10-02T09:32:52.791709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.791711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.791711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.791714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.791716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.791718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.791839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.795441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId: src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.797432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:52.855315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555033497335175:8287]
2025-10-02T09:32:52.855457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1710, pipe: [1:7556555033497335175:8287]
2025-10-02T09:32:52.902092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:52.902399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.902409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.902435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497335175:8287], now have 1 active actors on pipe
2025-10-02T09:32:52.902587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:52.902591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:52.902594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555033497335175:8287]
2025-10-02T09:32:52.902601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:52.902606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:52.902648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1711 reason: error at write: Disconnected sessionId: src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0
2025-10-02T09:32:52.902788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1711 sessionId: src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0 is DEAD
2025-10-02T09:32:52.902914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:52.902925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Write session will restart in 0.009421s
2025-10-02T09:32:52.902944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Write session: Do CDS request
2025-10-02T09:32:52.902949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:52.913189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.913231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:52.913242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1712
2025-10-02T09:32:52.913344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:52.913369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:52.913378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:52.913381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:52.913619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1712 sessionId:  describe result for acl check
2025-10-02T09:32:52.913640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:52.913645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:52.913646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:52.913649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555033497335445:8194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:52.913889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555033497335445:8194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:52.915267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555033497335445:8194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:52.916390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:52.917775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:52.917879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:52.917887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:52.917896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:52.917930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:52.917954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555033421781067:10055]
2025-10-02T09:32:52.917962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555033497335445:8194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:52.917969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555033497335445:8194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:52.917971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555033497335445:8194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:52.917974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:52.918299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:52.918454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:52.918477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:52.918652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:52.918681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.918685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.918685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.918686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.918687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.918687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.918688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.918688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.918689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.918690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.918690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.918691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.918694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.918699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.918701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.918704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.918706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.918708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.918710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.918712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.918713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.918716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.918717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.918719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.918723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.918727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:52.918730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.918744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:52.918746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.918749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:52.918751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.918753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:52.918755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.918758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:52.918760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.918762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:52.918764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.918767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:52.918769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.918771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:52.918774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.918777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:52.918780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.918782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.918784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.918787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.918789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.918791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.918809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:52.926314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:52.927955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:52.927967Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:52.927968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:52.927970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:52.927973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1711 [2:7556555033421781067:10055]
2025-10-02T09:32:52.927982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:52.927994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:52.927996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.927998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.928000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.928010Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:52.928014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:52.928018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:52.928049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.928054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.928055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.928057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:52.928059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:52.928097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:52.928101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.928108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:52.928113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:52.928121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:52.928136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497335179:2446], now have 1 active actors on pipe
2025-10-02T09:32:52.928141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555033497335559:8194], now have 1 active actors on pipe
2025-10-02T09:32:52.928144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.928145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.928146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.928153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:52.928161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:52.928167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:52.928169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:52.928170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:52.928171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:52.928173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:52.928186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.928189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:52.928180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1711
2025-10-02T09:32:52.928180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1711
2025-10-02T09:32:52.928193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:52.928209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.928211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.928227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66999323-f31f59d5-fb48a095-14da380b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:52.928234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:52.928237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:52.928239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:52.928245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:52.928253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:52.928263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.928370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:52.928374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:52.928382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:52.928432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1712 partition: 0 MaxSeqNo: 36 sessionId: src_id|66999323-f31f59d5-fb48a095-14da380b_0
2025-10-02T09:32:52.928627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce42a702-4aa6111-b38ce51f-12f4b27f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66999323-f31f59d5-fb48a095-14da380b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:52.930779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Write session: try to update token
2025-10-02T09:32:52.930788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:52.937398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:52.937411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:52.937413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:52.937414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:52.937418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.937422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.937424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555033421781062:10055]
2025-10-02T09:32:52.937445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:52.937451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:52.937452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:52.937452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:52.937456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:52.937458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:52.937561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:52.943333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId: src_id|66999323-f31f59d5-fb48a095-14da380b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:52.945357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.002799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792302866:8287]
2025-10-02T09:32:53.002974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1711, pipe: [1:7556555037792302866:8287]
2025-10-02T09:32:53.048619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.049015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.049025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.049037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792302866:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.049158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.049215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.049244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:53.049250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792302866:8287]
2025-10-02T09:32:53.049297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1712 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66999323-f31f59d5-fb48a095-14da380b_0
2025-10-02T09:32:53.049426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1712 sessionId: src_id|66999323-f31f59d5-fb48a095-14da380b_0 is DEAD
2025-10-02T09:32:53.049925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:53.049935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Write session will restart in 0.005431s
2025-10-02T09:32:53.049968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Write session: Do CDS request
2025-10-02T09:32:53.049973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.056159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.056225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.056235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1713
2025-10-02T09:32:53.056313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.056339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.056348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.056351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.056672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1713 sessionId:  describe result for acl check
2025-10-02T09:32:53.056694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.056698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.056699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.056702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792302997:8196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.057059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792302997:8196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.058878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792302997:8196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.061284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792302997:8196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.061292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792302997:8196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.061293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792302997:8196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.061297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.064297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.064550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.064705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.064712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.064719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.064753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.064776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716748661:10058]
2025-10-02T09:32:53.065137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.065302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.065326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.065498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.065526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.065530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.065530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.065531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.065532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.065532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.065533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.065533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.065534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.065534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.065535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.065535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.065538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.065544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.065546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.065548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.065550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.065552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.065554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.065556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.065558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.065560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.065562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.065564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.065567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.065571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.065575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.065577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.065579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.065582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.065584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.065587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.065589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.065592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.065594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.065597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.065599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.065602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.065604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.065607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.065612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.065614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.065619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.065622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.065624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.065627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.065629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.065631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.065650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.073084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.074580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.074593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.074594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.074596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.074599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1712 [2:7556555037716748661:10058]
2025-10-02T09:32:53.074606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.074616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.074618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.074619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.074620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.074629Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.074632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.074641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.074669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.074674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.074675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.074677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.074678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.074714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.074719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.074725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.074745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.074756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.074770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792302868:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.074775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303206:8196], now have 1 active actors on pipe
2025-10-02T09:32:53.074778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.074780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.074781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.074789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.074797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.074803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.074805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.074806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.074808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.074810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.074798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1712
2025-10-02T09:32:53.074812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1712
2025-10-02T09:32:53.074824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.074828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.074830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.074840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.074842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.074970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.074978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.074980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.074981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.074986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.074992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.075009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.075124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.075129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.075137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.075186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1713 partition: 0 MaxSeqNo: 36 sessionId: src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0
2025-10-02T09:32:53.075372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66999323-f31f59d5-fb48a095-14da380b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.077619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Write session: try to update token
2025-10-02T09:32:53.077628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.084473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.084492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.084494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.084496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.084506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.084512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.084516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716748656:10058]
2025-10-02T09:32:53.084551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.084559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.084562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.084563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.084563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.084566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.084724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.089745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId: src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.091735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.149213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792303248:8287]
2025-10-02T09:32:53.149396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1712, pipe: [1:7556555037792303248:8287]
2025-10-02T09:32:53.194067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.194403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.194412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.194424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303248:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.194559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.194553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792303248:8287]
2025-10-02T09:32:53.194570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.194577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:53.194580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:53.194627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1713 reason: error at write: Disconnected sessionId: src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0
2025-10-02T09:32:53.194761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1713 sessionId: src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0 is DEAD
2025-10-02T09:32:53.194886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:53.194895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Write session will restart in 0.006387s
2025-10-02T09:32:53.194910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Write session: Do CDS request
2025-10-02T09:32:53.194915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.202180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.202244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.202254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1714
2025-10-02T09:32:53.202351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.202377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.202385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.202388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.202679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1714 sessionId:  describe result for acl check
2025-10-02T09:32:53.202703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.202709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.202710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.202714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792303414:8193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.203075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792303414:8193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.204859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792303414:8193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.207034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792303414:8193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.207041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792303414:8193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.207042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792303414:8193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.207046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.207842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.209470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.209579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.209586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.209591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.209619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.209644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716748957:10060]
2025-10-02T09:32:53.209989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.210150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.210173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.210348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.210377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.210381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.210382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.210382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.210383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.210384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.210384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.210385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.210385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.210386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.210386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.210387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.210390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.210397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.210399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.210401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.210402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.210405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.210406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.210408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.210410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.210413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.210415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.210417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.210421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.210424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.210428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.210431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.210437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.210440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.210442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.210444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.210446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.210449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.210454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.210457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.210459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.210461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.210467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.210469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.210471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.210478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.210480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.210484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.210490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.210493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.210498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.210501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.210517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.217926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.219590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.219603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.219604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.219606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.219610Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1713 [2:7556555037716748957:10060]
2025-10-02T09:32:53.219617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.219627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.219629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.219631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.219631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.219640Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.219646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.219650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.219679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.219684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.219685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.219687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.219688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.219725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.219730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.219736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.219741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.219752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.219766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303616:8193], now have 1 active actors on pipe
2025-10-02T09:32:53.219771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303250:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.219775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.219776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.219777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.219785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.219792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.219798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.219800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.219801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.219803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.219805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.219806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1713
2025-10-02T09:32:53.219808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1713
2025-10-02T09:32:53.219818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.219823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.219825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.219840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.219842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.219860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68048949-cac63f49-e0da4523-8760bb7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.219867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.219869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.219870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.219875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.219880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.219890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.219978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.219983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.219991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.220045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1714 partition: 0 MaxSeqNo: 36 sessionId: src_id|68048949-cac63f49-e0da4523-8760bb7f_0
2025-10-02T09:32:53.220240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e84c4d-d6cd444d-66887eee-e96b09d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68048949-cac63f49-e0da4523-8760bb7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.222421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Write session: try to update token
2025-10-02T09:32:53.222432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.229005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.229020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.229022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.229022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.229028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.229030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.229033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716748951:10060]
2025-10-02T09:32:53.229052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.229056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.229057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.229103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.229125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.229130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.229170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.233683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId: src_id|68048949-cac63f49-e0da4523-8760bb7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.235671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.287150Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:32:53.294613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792303633:8287]
2025-10-02T09:32:53.294794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1713, pipe: [1:7556555037792303633:8287]
2025-10-02T09:32:53.339364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.339671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.339681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.339707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303633:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.339883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:53.339890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:53.339909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.339914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.339930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1714 reason: error at write: Disconnected sessionId: src_id|68048949-cac63f49-e0da4523-8760bb7f_0
2025-10-02T09:32:53.339949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792303633:8287]
2025-10-02T09:32:53.340050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1714 sessionId: src_id|68048949-cac63f49-e0da4523-8760bb7f_0 is DEAD
2025-10-02T09:32:53.340201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:53.340212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Write session will restart in 0.005321s
2025-10-02T09:32:53.340230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Write session: Do CDS request
2025-10-02T09:32:53.340236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.346160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.346167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.346176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1715
2025-10-02T09:32:53.346323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.346350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.346357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.346360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.346639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1715 sessionId:  describe result for acl check
2025-10-02T09:32:53.346662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.346666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.346667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.346670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792303713:8188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.347018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792303713:8188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.348544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792303713:8188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.350565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792303713:8188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.350572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792303713:8188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.350574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792303713:8188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.350577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.353950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.355446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.355635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.355644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.355651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.355688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.355710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716749255:10063]
2025-10-02T09:32:53.356045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.356252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.356274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.356449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.356476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.356480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.356480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.356481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.356481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.356482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.356483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.356483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.356484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.356484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.356485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.356485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.356488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.356494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.356496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.356498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.356499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.356501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.356503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.356505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.356507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.356509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.356511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.356513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.356518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.356522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.356525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.356528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.356530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.356533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.356535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.356537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.356541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.356544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.356546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.356549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.356551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.356554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.356555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.356558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.356560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.356563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.356565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.356567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.356569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.356572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.356576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.356579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.356594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.363971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.365570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.365582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.365583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.365585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.365588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1714 [2:7556555037716749255:10063]
2025-10-02T09:32:53.365595Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.365603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.365606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.365608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.365609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.365618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.365621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.365626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.365655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.365661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.365662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.365663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.365664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.365699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.365704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.365710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.365715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.365725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.365737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.365742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.365743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.365748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.365755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.365757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303634:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.365758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.365760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792303900:8188], now have 1 active actors on pipe
2025-10-02T09:32:53.365761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.365766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.365776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.365782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.365798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.365807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.365805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1714
2025-10-02T09:32:53.365805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1714
2025-10-02T09:32:53.365821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.365847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.365855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.365870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.365876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.365878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.365879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.365884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.365889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.365897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.366009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.366015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.366022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.366081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1715 partition: 0 MaxSeqNo: 36 sessionId: src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0
2025-10-02T09:32:53.366267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68048949-cac63f49-e0da4523-8760bb7f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.368382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Write session: try to update token
2025-10-02T09:32:53.368392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.375045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.375058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.375060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.375061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.375065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.375067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.375070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716749250:10063]
2025-10-02T09:32:53.375088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.375088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.375091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.375092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.375092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.375096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.375719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.380543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId: src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.383058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.440048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792304017:8287]
2025-10-02T09:32:53.440271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1714, pipe: [1:7556555037792304017:8287]
2025-10-02T09:32:53.486250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.486486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.486496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.486508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304017:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.486672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.486714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:53.486724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:53.486740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792304017:8287]
2025-10-02T09:32:53.486756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.486779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1715 reason: error at write: Disconnected sessionId: src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0
2025-10-02T09:32:53.486918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1715 sessionId: src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0 is DEAD
2025-10-02T09:32:53.487038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:53.487048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Write session will restart in 0.007559s
2025-10-02T09:32:53.487066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Write session: Do CDS request
2025-10-02T09:32:53.487070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.495154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.495210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.495218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1716
2025-10-02T09:32:53.495324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.495345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.495351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.495353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.495666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1716 sessionId:  describe result for acl check
2025-10-02T09:32:53.495689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.495693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.495694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.495697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792304211:8180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.496061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792304211:8180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.497339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792304211:8180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.499337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792304211:8180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.499344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792304211:8180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.499346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792304211:8180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.499350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.500210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.501741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.501914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.501922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.501928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.501970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.501993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716749552:10065]
2025-10-02T09:32:53.502329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.502494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.502518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.502695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.502723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.502727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.502727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.502728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.502728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.502738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.502739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.502740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.502741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.502741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.502742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.502742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.502745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.502751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.502753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.502755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.502757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.502759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.502761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.502763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.502765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.502767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.502768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.502770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.502775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.502779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.502782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.502784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.502787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.502789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.502791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.502794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.502796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.502799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.502801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.502803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.502805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.502808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.502810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.502813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.502815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.502818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.502820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.502823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.502827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.502830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.502832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.502835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.502851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.510278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.511921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.511933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.511934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.511937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.511940Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1715 [2:7556555037716749552:10065]
2025-10-02T09:32:53.511946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.511956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.511957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.511959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.511960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.511969Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.511972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.511976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.512007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.512012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.512013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.512016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.512017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.512053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.512058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.512064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.512069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.512079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.512094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304386:8180], now have 1 active actors on pipe
2025-10-02T09:32:53.512099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304018:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.512103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.512104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.512105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.512112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.512119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.512121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.512123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.512125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.512128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.512129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.512142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.512144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.512145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.512127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1715
2025-10-02T09:32:53.512132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1715
2025-10-02T09:32:53.512154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.512159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.512192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.512201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.512204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.512205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.512212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.512223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.512232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.512323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.512330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.512340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.512396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1716 partition: 0 MaxSeqNo: 36 sessionId: src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0
2025-10-02T09:32:53.512597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0674c11-4da6485c-7af264bd-6d7f33b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.514743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Write session: try to update token
2025-10-02T09:32:53.514754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.521377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.521395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.521396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.521398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.521407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.521411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.521413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716749547:10065]
2025-10-02T09:32:53.521436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.521442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.521444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.521444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.521447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.521450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.521558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.525922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId: src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.527903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.586975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792304402:8287]
2025-10-02T09:32:53.587198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1715, pipe: [1:7556555037792304402:8287]
2025-10-02T09:32:53.632658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.632942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.632953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.632977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304402:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.633111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.633130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:53.633139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:53.633175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1716 reason: error at write: Disconnected sessionId: src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0
2025-10-02T09:32:53.633307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1716 sessionId: src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0 is DEAD
2025-10-02T09:32:53.633433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:53.633446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Write session will restart in 0.005824s
2025-10-02T09:32:53.633460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Write session: Do CDS request
2025-10-02T09:32:53.633464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.633513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792304402:8287]
2025-10-02T09:32:53.633528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.640195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.640272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.640279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1717
2025-10-02T09:32:53.640364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.640382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.640387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.640390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.640650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1717 sessionId:  describe result for acl check
2025-10-02T09:32:53.640671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.640675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.640676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.640679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792304545:8166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.641009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792304545:8166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.642818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792304545:8166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.644828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792304545:8166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.644837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792304545:8166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.644839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792304545:8166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.644842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.648697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.648979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.649087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.649095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.649101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.649128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.649150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716749864:10073]
2025-10-02T09:32:53.649503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.649671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.649695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.649877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.649909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.649914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.649915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.649916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.649917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.649918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.649919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.649920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.649921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.649921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.649922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.649923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.649927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.649936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.649938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.649940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.649942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.649944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.649946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.649948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.649950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.649952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.649954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.649956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.649960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.649964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.649967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.649970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.649972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.649978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.649981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.649983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.649985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.649988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.649992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.649994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.649997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.650002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.650005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.650011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.650013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.650016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.650022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.650025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.650031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.650033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.650035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.650038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.650056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.657679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.659278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.659293Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.659294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.659297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.659300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1716 [2:7556555037716749864:10073]
2025-10-02T09:32:53.659308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.659320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.659321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.659323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.659324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.659334Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.659337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.659342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.659378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.659387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.659388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.659390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.659391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.659440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.659447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.659454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.659460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.659468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.659484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304416:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.659490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304726:8166], now have 1 active actors on pipe
2025-10-02T09:32:53.659494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.659495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.659496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.659504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.659515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.659521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.659523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.659524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.659526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.659527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.659548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.659554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.659562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.659561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1716
2025-10-02T09:32:53.659570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1716
2025-10-02T09:32:53.659618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.659624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.659641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.659652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.659660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.659662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.659671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.659679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.659688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.659792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.659797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.659805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.659865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1717 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0
2025-10-02T09:32:53.660131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc474e-2a40bde7-a9640b-7aa3bc98_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.662424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Write session: try to update token
2025-10-02T09:32:53.662437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.669540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.669561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.669563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.669565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.669574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.669579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.669584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716749859:10073]
2025-10-02T09:32:53.669621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.669625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.669632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.669633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.669635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.669635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.669807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.675624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId: src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.677736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.733414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792304809:8287]
2025-10-02T09:32:53.733629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1716, pipe: [1:7556555037792304809:8287]
2025-10-02T09:32:53.783047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.783389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.783400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.783412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304809:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.783558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.783574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:53.783583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:53.783599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792304809:8287]
2025-10-02T09:32:53.783612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.783629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1717 reason: error at write: Disconnected sessionId: src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0
2025-10-02T09:32:53.783761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1717 sessionId: src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0 is DEAD
2025-10-02T09:32:53.784233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:53.784242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Write session will restart in 0.007698s
2025-10-02T09:32:53.784262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Write session: Do CDS request
2025-10-02T09:32:53.784268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.793060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.793123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.793129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1718
2025-10-02T09:32:53.793214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.793233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.793239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.793241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.793517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1718 sessionId:  describe result for acl check
2025-10-02T09:32:53.793541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.793547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.793547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.793550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792305023:8159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.793896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792305023:8159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.795468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792305023:8159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.797208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792305023:8159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.797217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792305023:8159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.797220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792305023:8159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.797224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.797436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.799104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.799225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.799233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.799239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.799271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.799294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716750199:10081]
2025-10-02T09:32:53.799641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.799806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.799832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.800020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.800053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.800057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.800058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.800059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.800059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.800060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.800060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.800061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.800062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.800062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.800063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.800063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.800066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.800071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.800074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.800076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.800078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.800080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.800082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.800084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.800086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.800088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.800090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.800092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.800095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.800099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.800102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.800105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.800107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.800109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.800112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.800114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.800117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.800119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.800121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.800125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.800128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.800130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.800132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.800134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.800137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.800139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.800141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.800144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.800147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.800149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.800152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.800154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.800171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.807570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.809230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.809242Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.809243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.809245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.809248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1717 [2:7556555037716750199:10081]
2025-10-02T09:32:53.809254Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.809265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.809266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.809268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.809269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.809278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.809281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.809284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.809316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.809321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.809322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.809324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.809325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.809362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.809367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.809373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.809379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.809387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.809401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792304810:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.809406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792305183:8159], now have 1 active actors on pipe
2025-10-02T09:32:53.809410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.809411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.809412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.809420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.809427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.809433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.809435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.809436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.809438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.809439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.809452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.809443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1717
2025-10-02T09:32:53.809457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.809451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1717
2025-10-02T09:32:53.809459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.809477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.809482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.809498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.809505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.809508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.809509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.809514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.809520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.809527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.809624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.809629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.809637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.809691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1718 partition: 0 MaxSeqNo: 36 sessionId: src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0
2025-10-02T09:32:53.809880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8825d-c4c09864-396837d1-c1c0b6cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.812038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Write session: try to update token
2025-10-02T09:32:53.812047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.818671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.818686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.818687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.818688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.818692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.818695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.818697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716750182:10081]
2025-10-02T09:32:53.818717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.818719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.818720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.818774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.818796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.818800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.818864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.823336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId: src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.825385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:53.883938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555037792305201:8287]
2025-10-02T09:32:53.884076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1717, pipe: [1:7556555037792305201:8287]
2025-10-02T09:32:53.930554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:53.930835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.930845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.930868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792305201:8287], now have 1 active actors on pipe
2025-10-02T09:32:53.931000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:53.931038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:53.931038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:53.931041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:53.931070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555037792305201:8287]
2025-10-02T09:32:53.931086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1718 reason: error at write: Disconnected sessionId: src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0
2025-10-02T09:32:53.931219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1718 sessionId: src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0 is DEAD
2025-10-02T09:32:53.931350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:53.931358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Write session will restart in 0.009920s
2025-10-02T09:32:53.931372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Write session: Do CDS request
2025-10-02T09:32:53.931376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:53.942243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.942302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:53.942312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1719
2025-10-02T09:32:53.942405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:53.942426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:53.942431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:53.942434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:53.942724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1719 sessionId:  describe result for acl check
2025-10-02T09:32:53.942759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:53.942764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:53.942765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:53.942768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555037792305520:8151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:53.943094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555037792305520:8151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:53.944383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:53.944655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555037792305520:8151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:53.946037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:53.946141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:53.946149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:53.946158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:53.946189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:53.946213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555037716750499:10084]
2025-10-02T09:32:53.946221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555037792305520:8151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:53.946228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555037792305520:8151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:53.946230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555037792305520:8151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:53.946233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:53.946626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:53.946808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:53.946837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:53.947025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:53.947064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.947070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.947071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.947072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.947073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.947074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.947075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.947075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.947076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.947077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.947078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.947079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.947083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.947089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.947091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.947093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.947095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.947097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.947099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.947101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.947103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.947105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.947107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.947109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.947112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.947117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:53.947120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.947123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:53.947125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.947128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:53.947130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.947133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:53.947135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.947138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:53.947140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.947142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:53.947145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.947149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:53.947152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.947157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:53.947165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.947170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:53.947178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.947183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.947190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.947194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.947201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.947203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.947220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:53.955688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:53.957340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:53.957353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:53.957354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:53.957356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:53.957359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1718 [2:7556555037716750499:10084]
2025-10-02T09:32:53.957366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:53.957375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:53.957377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.957378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.957379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.957388Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:53.957392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:53.957397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:53.957436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.957442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.957443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.957445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:53.957446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:53.957484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:53.957489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.957495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:53.957501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:53.957508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:53.957520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792305217:2446], now have 1 active actors on pipe
2025-10-02T09:32:53.957526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555037792305592:8151], now have 1 active actors on pipe
2025-10-02T09:32:53.957529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.957530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.957531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.957538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:53.957546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:53.957552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:53.957554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:53.957555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:53.957557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:53.957558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:53.957573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.957578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:53.957567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1718
2025-10-02T09:32:53.957571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1718
2025-10-02T09:32:53.957587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:53.957729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.957735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.957749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|555f7763-c630c342-5583b146-d8f9badf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:53.957756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:53.957759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:53.957760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:53.957765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:53.957771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:53.957782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.957887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:53.957892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:53.957899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:53.957951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1719 partition: 0 MaxSeqNo: 36 sessionId: src_id|555f7763-c630c342-5583b146-d8f9badf_0
2025-10-02T09:32:53.958135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc2857-c487e94e-8b66e2e4-d6d328e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|555f7763-c630c342-5583b146-d8f9badf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:53.960325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Write session: try to update token
2025-10-02T09:32:53.960336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:53.968343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:53.968358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:53.968360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:53.968361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:53.968366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.968372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.968375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555037716750494:10084]
2025-10-02T09:32:53.968401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:53.968408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:53.968409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:53.968415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:53.968421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:53.968430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:53.968575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:53.972246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId: src_id|555f7763-c630c342-5583b146-d8f9badf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:53.974283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.031383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087272900:8287]
2025-10-02T09:32:54.031531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1718, pipe: [1:7556555042087272900:8287]
2025-10-02T09:32:54.081818Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.082132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.082141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.082166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087272900:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.082309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.082336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.082366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087272900:8287]
2025-10-02T09:32:54.082366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:54.082475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1719 reason: status is not ok: tablet will be restarted right now sessionId: src_id|555f7763-c630c342-5583b146-d8f9badf_0
2025-10-02T09:32:54.082613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1719 sessionId: src_id|555f7763-c630c342-5583b146-d8f9badf_0 is DEAD
2025-10-02T09:32:54.082749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:54.082758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Write session will restart in 0.009278s
2025-10-02T09:32:54.082776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Write session: Do CDS request
2025-10-02T09:32:54.082781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.093132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.093251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.093259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1720
2025-10-02T09:32:54.093344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.093365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.093371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.093375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.093635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1720 sessionId:  describe result for acl check
2025-10-02T09:32:54.093658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.093663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.093665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.093668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087273181:8147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.094005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087273181:8147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.095312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087273181:8147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.095822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.097392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.097503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.097510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.097516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.097545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.097565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011718099:10087]
2025-10-02T09:32:54.097564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087273181:8147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.097571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087273181:8147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.097573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087273181:8147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.097576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.097912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.098082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.098112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.098339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.098374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.098379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.098379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.098380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.098381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.098381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.098381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.098382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.098382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.098383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.098383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.098384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.098387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.098392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.098394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.098396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.098398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.098400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.098402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.098404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.098406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.098408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.098409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.098411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.098415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.098419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.098422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.098424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.098426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.098429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.098431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.098434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.098436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.098439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.098441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.098445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.098449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.098453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.098457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.098466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.098473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.098475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.098482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.098484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.098486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.098493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.098495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.098497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.098514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.106577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.108291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.108302Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.108303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.108305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.108308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1719 [2:7556555042011718099:10087]
2025-10-02T09:32:54.108314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.108323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.108324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.108326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.108331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.108343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.108346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.108350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.108380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.108384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.108385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.108387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.108388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.108424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.108429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.108439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.108452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.108472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.108487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087272901:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.108493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273276:8147], now have 1 active actors on pipe
2025-10-02T09:32:54.108497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.108498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.108499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.108504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.108493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1719
2025-10-02T09:32:54.108514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.108500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1719
2025-10-02T09:32:54.108519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.108520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.108522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.108525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.108526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.108548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.108553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.108560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.108568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.108581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.108586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.108589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.108591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.108592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.108597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.108601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.108617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.108715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.108723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.108732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.108793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1720 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0
2025-10-02T09:32:54.108988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555f7763-c630c342-5583b146-d8f9badf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.111112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Write session: try to update token
2025-10-02T09:32:54.111122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.118671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.118687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.118689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.118690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.118694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.118697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.118699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011718094:10087]
2025-10-02T09:32:54.118720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.118739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.118741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.118782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.118803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.118811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.118863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.121919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId: src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.123908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.182414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087273289:8287]
2025-10-02T09:32:54.182537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1719, pipe: [1:7556555042087273289:8287]
2025-10-02T09:32:54.227757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.228120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.228130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.228156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273289:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.228291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.228313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087273289:8287]
2025-10-02T09:32:54.228322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.228332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:54.228379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1720 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0
2025-10-02T09:32:54.228515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1720 sessionId: src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0 is DEAD
2025-10-02T09:32:54.228634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:54.228643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Write session will restart in 0.006573s
2025-10-02T09:32:54.228657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Write session: Do CDS request
2025-10-02T09:32:54.228661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.236112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.236204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.236215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1721
2025-10-02T09:32:54.236301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.236322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.236327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.236341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.236631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1721 sessionId:  describe result for acl check
2025-10-02T09:32:54.236655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.236659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.236660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.236663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087273451:8138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.237026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087273451:8138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.239055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087273451:8138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.241277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087273451:8138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.241286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087273451:8138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.241287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087273451:8138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.241291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.242267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.243842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.243939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.243946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.243951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.243976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.243996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011718403:10089]
2025-10-02T09:32:54.244330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.244500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.244525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.244692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.244719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.244723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.244724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.244724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.244725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.244725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.244726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.244726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.244727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.244727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.244728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.244728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.244731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.244738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.244740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.244742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.244744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.244746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.244748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.244750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.244752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.244754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.244756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.244758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.244761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.244765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.244768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.244771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.244773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.244776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.244778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.244781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.244783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.244786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.244789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.244792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.244794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.244797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.244811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.244815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.244817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.244820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.244822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.244825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.244827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.244830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.244832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.244834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.244850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.252312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.253894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.253906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.253908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.253910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.253914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1720 [2:7556555042011718403:10089]
2025-10-02T09:32:54.253922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.253934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.253941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.253943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.253945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.253954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.253960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.253965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.253993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.253998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.253999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.254000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.254002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.254035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.254040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.254046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.254051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.254059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.254070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273292:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.254075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273666:8138], now have 1 active actors on pipe
2025-10-02T09:32:54.254079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.254080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.254081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.254088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.254096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.254103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.254106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.254106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.254107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.254108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.254108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1720
2025-10-02T09:32:54.254115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1720
2025-10-02T09:32:54.254121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.254126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.254127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.254139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.254141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.254158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.254165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.254167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.254168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.254173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.254178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.254188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.254267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.254272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.254279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.254330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1721 partition: 0 MaxSeqNo: 36 sessionId: src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0
2025-10-02T09:32:54.254489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef96297-cbd2129f-81b4a47f-8058e0aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.256749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Write session: try to update token
2025-10-02T09:32:54.256758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.263799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.263817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.263819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.263820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.263827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.263831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.263838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011718398:10089]
2025-10-02T09:32:54.263865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.263872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.263875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.263876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.263877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.263878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.264045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.269444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId: src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.271515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.328348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087273680:8287]
2025-10-02T09:32:54.328541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1720, pipe: [1:7556555042087273680:8287]
2025-10-02T09:32:54.373121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.373486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.373496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.373508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273680:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.373643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.373677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.373710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:54.373722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087273680:8287]
2025-10-02T09:32:54.373764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1721 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0
2025-10-02T09:32:54.373905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1721 sessionId: src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0 is DEAD
2025-10-02T09:32:54.374039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:54.374048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Write session will restart in 0.005101s
2025-10-02T09:32:54.374067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Write session: Do CDS request
2025-10-02T09:32:54.374071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.380175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.380186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.380195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1722
2025-10-02T09:32:54.380335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.380355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.380360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.380363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.380626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1722 sessionId:  describe result for acl check
2025-10-02T09:32:54.380650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.380655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.380656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.380659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087273767:8120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.381010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087273767:8120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.382905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087273767:8120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.385310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087273767:8120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.385318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087273767:8120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.385320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087273767:8120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.385323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.388443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.389874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.389968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.389975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.389981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.390006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.390029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011718709:10092]
2025-10-02T09:32:54.390365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.390522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.390544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.390804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.390841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.390845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.390845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.390846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.390846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.390847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.390847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.390848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.390848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.390848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.390849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.390849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.390852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.390858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.390860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.390862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.390864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.390865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.390867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.390869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.390871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.390873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.390875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.390877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.390880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.390885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.390888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.390891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.390893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.390895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.390897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.390900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.390902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.390905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.390907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.390910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.390912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.390914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.390917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.390920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.390922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.390924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.390926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.390928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.390931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.390933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.390939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.390941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.390957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.398456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.399907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.399920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.399921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.399923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.399926Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1721 [2:7556555042011718709:10092]
2025-10-02T09:32:54.399932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.399941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.399948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.399949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.399950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.399959Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.399966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.399970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.399998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.400003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.400004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.400005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.400006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.400041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.400046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.400052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.400057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.400065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.400078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273963:8120], now have 1 active actors on pipe
2025-10-02T09:32:54.400083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087273682:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.400087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.400088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.400089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.400096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.400104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.400110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.400112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.400113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.400115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.400116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.400118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1721
2025-10-02T09:32:54.400128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.400133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.400119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1721
2025-10-02T09:32:54.400135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.400149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.400155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.400171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|191da1e3-48e56b69-5e7e012a-447044bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.400177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.400179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.400181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.400185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.400190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.400203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.400292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.400296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.400303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.400356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1722 partition: 0 MaxSeqNo: 36 sessionId: src_id|191da1e3-48e56b69-5e7e012a-447044bf_0
2025-10-02T09:32:54.400526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba8f612-b6e783b6-6f4ff7d5-7cb5eb7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|191da1e3-48e56b69-5e7e012a-447044bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.402760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Write session: try to update token
2025-10-02T09:32:54.402769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.409376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.409390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.409391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.409392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.409396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.409398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.409401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011718704:10092]
2025-10-02T09:32:54.409420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.409423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.409425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.409426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.409429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.409431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.409543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.414072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId: src_id|191da1e3-48e56b69-5e7e012a-447044bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.416077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.473753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087274071:8287]
2025-10-02T09:32:54.473920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1721, pipe: [1:7556555042087274071:8287]
2025-10-02T09:32:54.518709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.518991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.519002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.519032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274071:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.519151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.519178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087274071:8287]
2025-10-02T09:32:54.519197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.519210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:54.519265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1722 reason: status is not ok: tablet will be restarted right now sessionId: src_id|191da1e3-48e56b69-5e7e012a-447044bf_0
2025-10-02T09:32:54.519396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1722 sessionId: src_id|191da1e3-48e56b69-5e7e012a-447044bf_0 is DEAD
2025-10-02T09:32:54.519529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:54.519538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Write session will restart in 0.009149s
2025-10-02T09:32:54.519552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Write session: Do CDS request
2025-10-02T09:32:54.519557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.530151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.530239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.530248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1723
2025-10-02T09:32:54.530328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.530348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.530354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.530356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.530640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1723 sessionId:  describe result for acl check
2025-10-02T09:32:54.530662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.530666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.530667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.530671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087274335:8122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.531138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087274335:8122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.532711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087274335:8122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.533579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.535145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.535334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.535343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.535353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087274335:8122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.535361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087274335:8122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.535363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087274335:8122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.535367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.535504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.535547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.535572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011719017:10094]
2025-10-02T09:32:54.535907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.536052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.536074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.536252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.536279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.536282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.536283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.536284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.536284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.536285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.536285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.536286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.536286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.536287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.536287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.536288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.536290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.536297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.536299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.536301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.536303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.536305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.536307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.536309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.536311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.536313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.536315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.536316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.536320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.536324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.536327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.536329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.536331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.536334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.536336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.536339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.536341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.536344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.536346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.536349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.536351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.536353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.536356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.536358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.536360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.536363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.536365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.536368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.536370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.536374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.536377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.536379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.536396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.544149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.545666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.545677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.545678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.545680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.545683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1722 [2:7556555042011719017:10094]
2025-10-02T09:32:54.545689Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.545699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.545700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.545702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.545703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.545711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.545718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.545722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.545752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.545757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.545758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.545759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.545761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.545796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.545801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.545807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.545812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.545823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.545838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274453:8122], now have 1 active actors on pipe
2025-10-02T09:32:54.545843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274073:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.545846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.545848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.545849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.545857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.545865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.545868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.545870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.545871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.545875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.545877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.545890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.545894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.545896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.545876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1722
2025-10-02T09:32:54.545885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1722
2025-10-02T09:32:54.545906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.545910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.545935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6261da31-a1999675-fda0c655-8f82a38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.545942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.545944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.545945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.545951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.545959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.545971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.546048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.546053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.546060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.546110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1723 partition: 0 MaxSeqNo: 36 sessionId: src_id|6261da31-a1999675-fda0c655-8f82a38_0
2025-10-02T09:32:54.546309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|191da1e3-48e56b69-5e7e012a-447044bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6261da31-a1999675-fda0c655-8f82a38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.548463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Write session: try to update token
2025-10-02T09:32:54.548473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.555468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.555482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.555483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.555484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.555488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.555490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.555493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011719012:10094]
2025-10-02T09:32:54.555514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.555516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.555519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.555521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.555523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.555523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.555632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.559659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId: src_id|6261da31-a1999675-fda0c655-8f82a38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.561616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.619165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087274466:8287]
2025-10-02T09:32:54.619327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1722, pipe: [1:7556555042087274466:8287]
2025-10-02T09:32:54.668277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.668515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.668531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.668562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274466:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.668727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087274466:8287]
2025-10-02T09:32:54.668750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:54.668751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:54.668791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1723 reason: error at write: Disconnected sessionId: src_id|6261da31-a1999675-fda0c655-8f82a38_0
2025-10-02T09:32:54.668794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.668930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1723 sessionId: src_id|6261da31-a1999675-fda0c655-8f82a38_0 is DEAD
2025-10-02T09:32:54.669042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.669056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:54.669065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Write session will restart in 0.009520s
2025-10-02T09:32:54.669085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Write session: Do CDS request
2025-10-02T09:32:54.669090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.674207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.675297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.675445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.675456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.675465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.675508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.675538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011719091:10102]
2025-10-02T09:32:54.676073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.676277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.676321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.676608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.676661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.676666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.676668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.676669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.676670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.676671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.676672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.676673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.676674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.676675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.676677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.676679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.676684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.676692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.676695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.676699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.676702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.676708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.676711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.676716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.676719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.676722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.676726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.676729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.676734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.676745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.676755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.676762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.676768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.676772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.676777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.676782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.676790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.676795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.676818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.676827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.676835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.676842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.676846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.676852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.676860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.676868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.676879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.676885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.676893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.676898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.676906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.676915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.676951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.679094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.679171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.679177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1724
2025-10-02T09:32:54.679250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.679266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.679271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.679274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.679488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1724 sessionId:  describe result for acl check
2025-10-02T09:32:54.679504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.679508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.679509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.679512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087274505:8110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.679839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087274505:8110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.680915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087274505:8110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.683895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087274505:8110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.683903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087274505:8110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.683904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087274505:8110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.683908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.684659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.686250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.686265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.686266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.686269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.686273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1723 [2:7556555042011719091:10102]
2025-10-02T09:32:54.686281Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.686293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.686299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.686301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.686302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.686313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.686321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.686330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.686371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.686377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.686379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.686381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.686382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.686428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.686434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.686444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.686457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.686473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.686491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274480:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.686498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274549:8110], now have 1 active actors on pipe
2025-10-02T09:32:54.686504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.686506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.686507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.686512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.686496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1723
2025-10-02T09:32:54.686504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1723
2025-10-02T09:32:54.686518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.686521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.686526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.686527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.686532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.686534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.686546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.686553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.686577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.686586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.686594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.686597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.686601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.686605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.686606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.686611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.686616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.686640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.686744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.686753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.686764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.686814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1724 partition: 0 MaxSeqNo: 36 sessionId: src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0
2025-10-02T09:32:54.686972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6261da31-a1999675-fda0c655-8f82a38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.689205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Write session: try to update token
2025-10-02T09:32:54.689214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.695945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.695962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.695964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.695965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.695969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.695972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.695973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011719086:10102]
2025-10-02T09:32:54.695996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.695999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.695999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.696001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.696001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.696003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.696106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.700651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId: src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.702743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.768664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087274556:8287]
2025-10-02T09:32:54.768879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1723, pipe: [1:7556555042087274556:8287]
2025-10-02T09:32:54.809037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.809279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.809291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.809319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274556:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.809434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.809460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087274556:8287]
2025-10-02T09:32:54.809481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:54.809490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.809531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1724 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0
2025-10-02T09:32:54.809667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1724 sessionId: src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0 is DEAD
2025-10-02T09:32:54.809802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:54.809812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Write session will restart in 0.005422s
2025-10-02T09:32:54.809831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Write session: Do CDS request
2025-10-02T09:32:54.809836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.814142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.815192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.815286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.815294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.815299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.815325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.815352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011719183:10111]
2025-10-02T09:32:54.815906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.816067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.816089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.816111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.816182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.816190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1725
2025-10-02T09:32:54.816277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.816275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.816294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.816303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.816302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.816305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.816307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.816308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.816309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.816309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.816310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.816310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.816311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.816312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.816312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.816313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.816313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.816316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.816323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.816325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.816327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.816329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.816331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.816333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.816335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.816338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.816341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.816342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.816345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.816349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.816352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.816355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.816358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.816360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.816363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.816365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.816368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.816370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.816373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.816379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.816381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.816384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.816386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.816389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.816391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.816394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.816399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.816401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.816403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.816405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.816408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.816410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.816412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.816430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.816566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1725 sessionId:  describe result for acl check
2025-10-02T09:32:54.816589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.816593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.816594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.816597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087274581:8099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.816921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087274581:8099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.818084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087274581:8099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.821755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087274581:8099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.821762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087274581:8099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.821764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087274581:8099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.821767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.824092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.825513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.825525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.825527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.825531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.825534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1724 [2:7556555042011719183:10111]
2025-10-02T09:32:54.825540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.825551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.825555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.825557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.825558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.825567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.825570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.825575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.825606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.825610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.825611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.825613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.825615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.825650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.825655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.825661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.825666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.825677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.825688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274557:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.825693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274619:8099], now have 1 active actors on pipe
2025-10-02T09:32:54.825696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.825698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.825699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.825706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.825713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.825720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.825721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.825723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.825724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.825725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.825738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.825743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.825744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.825727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1724
2025-10-02T09:32:54.825729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1724
2025-10-02T09:32:54.825758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.825762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.825779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93144eb2-2975f63-4c04de0d-a289309d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.825785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.825787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.825788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.825792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.825800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.825808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.825893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.825898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.825906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.825958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1725 partition: 0 MaxSeqNo: 36 sessionId: src_id|93144eb2-2975f63-4c04de0d-a289309d_0
2025-10-02T09:32:54.826134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a70df1-6f3b6542-a7f1d776-a4581f4f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93144eb2-2975f63-4c04de0d-a289309d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.828374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Write session: try to update token
2025-10-02T09:32:54.828383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.835350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.835366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.835367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.835368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.835373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.835377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.835379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011719178:10111]
2025-10-02T09:32:54.835403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.835406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.835407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.835407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.835410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.835413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.836080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.841677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId: src_id|93144eb2-2975f63-4c04de0d-a289309d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.843698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:54.909474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555042087274632:8287]
2025-10-02T09:32:54.909644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1724, pipe: [1:7556555042087274632:8287]
2025-10-02T09:32:54.945892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:54.946182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.946192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.946205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274632:8287], now have 1 active actors on pipe
2025-10-02T09:32:54.946354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:54.946371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555042087274632:8287]
2025-10-02T09:32:54.946390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:54.946393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:54.946395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:54.946440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1725 reason: error at write: Disconnected sessionId: src_id|93144eb2-2975f63-4c04de0d-a289309d_0
2025-10-02T09:32:54.946573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1725 sessionId: src_id|93144eb2-2975f63-4c04de0d-a289309d_0 is DEAD
2025-10-02T09:32:54.946700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:54.946709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Write session will restart in 0.006562s
2025-10-02T09:32:54.946723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Write session: Do CDS request
2025-10-02T09:32:54.946734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:54.951017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:54.952120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:54.952220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:54.952227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:54.952233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:54.952259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:54.952286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555042011719241:10113]
2025-10-02T09:32:54.952625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:54.952787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:54.952823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:54.953002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:54.953033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.953037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.953038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.953038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.953039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.953040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.953041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.953041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.953042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.953042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.953044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.953045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.953048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.953055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.953057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.953059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.953061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.953064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.953066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.953068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.953070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.953073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.953075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.953077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.953081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.953085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:54.953088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.953091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:54.953093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.953096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:54.953098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.953100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:54.953102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.953105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:54.953107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.953109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:54.953111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.953114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:54.953116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.953119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:54.953123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.953126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:54.953128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.953130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.953133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.953137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.953139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.953141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.953160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:54.954141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.954216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:54.954225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1726
2025-10-02T09:32:54.954311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:54.954329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:54.954335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:54.954338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:54.954606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1726 sessionId:  describe result for acl check
2025-10-02T09:32:54.954627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:54.954632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:54.954633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:54.954636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555042087274673:8096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:54.954976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555042087274673:8096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:54.956351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555042087274673:8096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:54.960016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555042087274673:8096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:54.960025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555042087274673:8096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:54.960027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555042087274673:8096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:54.960031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:54.960578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:54.962046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:54.962058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:54.962059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:54.962061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:54.962064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1725 [2:7556555042011719241:10113]
2025-10-02T09:32:54.962070Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:54.962080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:54.962085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.962087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.962087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.962097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:54.962104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:54.962108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:54.962138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.962144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.962145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.962147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:54.962148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:54.962187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:54.962192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.962198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:54.962203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:54.962211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:54.962226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274645:2446], now have 1 active actors on pipe
2025-10-02T09:32:54.962231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555042087274705:8096], now have 1 active actors on pipe
2025-10-02T09:32:54.962234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.962235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.962236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.962245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:54.962255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:54.962261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:54.962263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:54.962265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:54.962265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:54.962266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:54.962261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1725
2025-10-02T09:32:54.962267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1725
2025-10-02T09:32:54.962279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.962284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:54.962286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:54.962295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.962300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.962323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:54.962329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:54.962331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:54.962332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:54.962337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:54.962345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:54.962358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.962469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:54.962475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:54.962482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:54.962546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1726 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0
2025-10-02T09:32:54.962742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93144eb2-2975f63-4c04de0d-a289309d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:54.964951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Write session: try to update token
2025-10-02T09:32:54.964961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:54.971551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:54.971563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:54.971566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:54.971567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:54.971573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.971576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.971578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555042011719236:10113]
2025-10-02T09:32:54.971601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:54.971604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:54.971605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:54.971606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:54.971609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:54.971611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:54.971758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:54.976197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId: src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:54.978213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.046682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242009:8287]
2025-10-02T09:32:55.046837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1725, pipe: [1:7556555046382242009:8287]
2025-10-02T09:32:55.081418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.081700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.081711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.081744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242009:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.081930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:55.081929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.081956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:55.081959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:55.081971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242009:8287]
2025-10-02T09:32:55.082003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1726 reason: error at write: Disconnected sessionId: src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0
2025-10-02T09:32:55.082129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1726 sessionId: src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0 is DEAD
2025-10-02T09:32:55.082251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:55.082260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Write session will restart in 0.007835s
2025-10-02T09:32:55.082287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Write session: Do CDS request
2025-10-02T09:32:55.082291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.086738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.087734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.087831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.087837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.087842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.087868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.087897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306686598:10116]
2025-10-02T09:32:55.088245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.088405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.088426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.088598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.088626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.088630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.088631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.088632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.088634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.088634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.088635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.088636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.088636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.088637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.088638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.088638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.088641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.088647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.088649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.088652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.088654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.088656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.088658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.088660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.088662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.088664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.088666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.088668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.088672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.088677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.088680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.088682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.088684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.088687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.088689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.088692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.088695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.088698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.088700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.088703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.088705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.088708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.088710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.088713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.088715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.088718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.088720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.088722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.088726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.088728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.088730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.088733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.088749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.091156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.091225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.091235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1727
2025-10-02T09:32:55.091315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.091335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.091341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.091344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.091587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1727 sessionId:  describe result for acl check
2025-10-02T09:32:55.091608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.091612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.091613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.091616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242036:8086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.091952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242036:8086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.093094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242036:8086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.095642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242036:8086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.095650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242036:8086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.095652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242036:8086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.095655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.096206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.097603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.097614Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.097615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.097618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.097621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1726 [2:7556555046306686598:10116]
2025-10-02T09:32:55.097628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.097638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.097643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.097644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.097645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.097654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.097656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.097661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.097698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.097702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.097704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.097706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.097707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.097755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.097759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.097766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.097771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.097783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.097797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242071:8086], now have 1 active actors on pipe
2025-10-02T09:32:55.097803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242010:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.097807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.097808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.097810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.097817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.097816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1726
2025-10-02T09:32:55.097827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.097833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.097819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1726
2025-10-02T09:32:55.097835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.097836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.097838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.097839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.097852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.097856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.097862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.097866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.097868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.097891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70f461d6-ba98340-799ae499-39a9b310_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.097897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.097899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.097900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.097907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.097916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.097928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.098005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.098009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.098016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.098062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1727 partition: 0 MaxSeqNo: 36 sessionId: src_id|70f461d6-ba98340-799ae499-39a9b310_0
2025-10-02T09:32:55.098220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cea6cb-69e0760e-353e0079-4c8ff1c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70f461d6-ba98340-799ae499-39a9b310_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.100381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Write session: try to update token
2025-10-02T09:32:55.100390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.107232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.107244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.107245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.107247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.107250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.107254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.107256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306686593:10116]
2025-10-02T09:32:55.107276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.107279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.107280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.107282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.107285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.107288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.107509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.111805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId: src_id|70f461d6-ba98340-799ae499-39a9b310_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.113833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.182364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242079:8287]
2025-10-02T09:32:55.182542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1726, pipe: [1:7556555046382242079:8287]
2025-10-02T09:32:55.218003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.218197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.218206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.218231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242079:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.218361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:55.218401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.218409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:55.218446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242079:8287]
2025-10-02T09:32:55.218471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1727 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70f461d6-ba98340-799ae499-39a9b310_0
2025-10-02T09:32:55.218612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1727 sessionId: src_id|70f461d6-ba98340-799ae499-39a9b310_0 is DEAD
2025-10-02T09:32:55.218747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:55.218756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Write session will restart in 0.006249s
2025-10-02T09:32:55.218771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Write session: Do CDS request
2025-10-02T09:32:55.218775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.223335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.224298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.224406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.224412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.224418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.224448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.224473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306686658:10118]
2025-10-02T09:32:55.224828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.224990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.225013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.225187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.225215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.225219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.225220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.225221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.225222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.225222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.225223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.225224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.225224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.225225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.225225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.225226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.225229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.225236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.225238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.225240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.225242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.225245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.225247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.225249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.225251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.225253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.225255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.225257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.225261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.225264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.225268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.225271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.225273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.225275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.225277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.225280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.225282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.225285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.225287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.225292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.225297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.225300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.225302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.225305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.225307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.225310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.225315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.225318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.225320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.225322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.225327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.225330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.225347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.226116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.226199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.226207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1728
2025-10-02T09:32:55.226288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.226307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.226313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.226316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.226588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1728 sessionId:  describe result for acl check
2025-10-02T09:32:55.226612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.226618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.226620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.226624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242107:8081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.226980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242107:8081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.228236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242107:8081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.232312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242107:8081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.232322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242107:8081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.232324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242107:8081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.232328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.232901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.234285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.234296Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.234297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.234299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.234302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1727 [2:7556555046306686658:10118]
2025-10-02T09:32:55.234312Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.234322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.234327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.234329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.234330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.234338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.234344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.234349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.234384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.234388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.234389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.234391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.234394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.234428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.234433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.234439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.234444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.234452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.234465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242144:8081], now have 1 active actors on pipe
2025-10-02T09:32:55.234470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242080:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.234474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.234475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.234476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.234484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.234494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.234496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.234498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.234500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.234489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1727
2025-10-02T09:32:55.234502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.234492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1727
2025-10-02T09:32:55.234504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.234516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.234519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.234521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.234529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.234530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.234552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.234559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.234561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.234562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.234568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.234573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.234590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.234662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.234667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.234674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.234719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1728 partition: 0 MaxSeqNo: 36 sessionId: src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0
2025-10-02T09:32:55.234905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f461d6-ba98340-799ae499-39a9b310_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.237068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Write session: try to update token
2025-10-02T09:32:55.237078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.243915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.243926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.243928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.243929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.243936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.243938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.243940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306686653:10118]
2025-10-02T09:32:55.243963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.243963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.243966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.243966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.243968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.243968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.244073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.248126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId: src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.250106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.318553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242151:8287]
2025-10-02T09:32:55.318751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1727, pipe: [1:7556555046382242151:8287]
2025-10-02T09:32:55.352588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.352789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.352798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.352835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242151:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.353002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:55.353029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:55.353036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.353039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:55.353064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242151:8287]
2025-10-02T09:32:55.353093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1728 reason: error at write: Disconnected sessionId: src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0
2025-10-02T09:32:55.353249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1728 sessionId: src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0 is DEAD
2025-10-02T09:32:55.353363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:55.353371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Write session will restart in 0.007349s
2025-10-02T09:32:55.353386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Write session: Do CDS request
2025-10-02T09:32:55.353391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.357622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.358590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.358686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.358693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.358698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.358724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.358757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306686720:10121]
2025-10-02T09:32:55.359100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.359260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.359281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.359454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.359482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.359487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.359487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.359488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.359489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.359489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.359490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.359491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.359491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.359492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.359492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.359493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.359496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.359503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.359505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.359509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.359511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.359513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.359515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.359517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.359519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.359521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.359523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.359525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.359528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.359532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.359535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.359539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.359546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.359551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.359558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.359562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.359569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.359574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.359581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.359585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.359592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.359596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.359604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.359611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.359615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.359620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.359622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.359626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.359631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.359634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.359637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.359640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.359675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.362114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.362179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.362187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1729
2025-10-02T09:32:55.362276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.362294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.362300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.362303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.362554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1729 sessionId:  describe result for acl check
2025-10-02T09:32:55.362576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.362581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.362582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.362586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242181:8073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.362945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242181:8073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.364462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242181:8073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.366669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242181:8073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.366676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242181:8073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.366678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242181:8073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.366682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.367318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.368905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.368913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.368915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.368917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.368920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1728 [2:7556555046306686720:10121]
2025-10-02T09:32:55.368928Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.368939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.368944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.368947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.368948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.368957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.368960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.368965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.368998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.369002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.369003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.369005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.369006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.369042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.369047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.369053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.369058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.369068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.369081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242153:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.369086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242216:8073], now have 1 active actors on pipe
2025-10-02T09:32:55.369091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.369095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.369096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.369103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.369113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.369116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.369117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.369118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.369111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1728
2025-10-02T09:32:55.369123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.369114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1728
2025-10-02T09:32:55.369125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.369146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.369154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.369159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.369162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.369163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.369188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.369196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.369198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.369199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.369207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.369213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.369225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.369317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.369321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.369329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.369385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1729 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0
2025-10-02T09:32:55.369551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfe9d1db-a7eabb89-24f79c2-856cc02f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.371700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Write session: try to update token
2025-10-02T09:32:55.371709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.378922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.378934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.378935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.378938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.378943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.378945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.378948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306686715:10121]
2025-10-02T09:32:55.378971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.378975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.378976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.378978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.378982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.378988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.379095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.383243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId: src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.385269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.453213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242223:8287]
2025-10-02T09:32:55.453411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1728, pipe: [1:7556555046382242223:8287]
2025-10-02T09:32:55.487789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.488012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.488023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.488049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242223:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.488224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:55.488230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:55.488266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1729 reason: error at write: Disconnected sessionId: src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0
2025-10-02T09:32:55.488289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242223:8287]
2025-10-02T09:32:55.488317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.488387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1729 sessionId: src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0 is DEAD
2025-10-02T09:32:55.488527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:55.488536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Write session will restart in 0.007285s
2025-10-02T09:32:55.488552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Write session: Do CDS request
2025-10-02T09:32:55.488571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.488605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:55.492658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.493644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.493740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.493746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.493752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.493776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.493801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306686782:10123]
2025-10-02T09:32:55.494164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.494322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.494346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.494520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.494549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.494553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.494555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.494556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.494556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.494557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.494557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.494558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.494558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.494559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.494559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.494560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.494563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.494570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.494572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.494574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.494576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.494578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.494580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.494582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.494584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.494586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.494588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.494590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.494593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.494597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.494600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.494604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.494606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.494610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.494612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.494614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.494617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.494620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.494625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.494628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.494630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.494633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.494636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.494639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.494645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.494648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.494653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.494656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.494658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.494664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.494666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.494668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.494684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.497097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.497212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.497221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1730
2025-10-02T09:32:55.497287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.497305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.497310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.497313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.497577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1730 sessionId:  describe result for acl check
2025-10-02T09:32:55.497599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.497604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.497605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.497607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242253:8068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.497939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242253:8068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.499078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242253:8068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.501672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242253:8068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.501681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242253:8068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.501683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242253:8068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.501687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.502206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.503622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.503633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.503634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.503637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.503641Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1729 [2:7556555046306686782:10123]
2025-10-02T09:32:55.503650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.503663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.503664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.503666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.503667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.503677Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.503683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.503687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.503720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.503725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.503726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.503728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.503729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.503766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.503771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.503777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.503782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.503790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.503803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242288:8068], now have 1 active actors on pipe
2025-10-02T09:32:55.503809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242224:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.503813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.503814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.503816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.503823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.503820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1729
2025-10-02T09:32:55.503821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1729
2025-10-02T09:32:55.503834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.503839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.503841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.503842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.503844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.503846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.503872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.503880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.503892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.503902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.503913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.503925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.503931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.503933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.503934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.503939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.503945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.503961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.504049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.504054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.504062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.504101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1730 partition: 0 MaxSeqNo: 36 sessionId: src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0
2025-10-02T09:32:55.504283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd246ded-d25eed71-7ac9adaa-9d501a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.506414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Write session: try to update token
2025-10-02T09:32:55.506425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.513062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.513073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.513075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.513076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.513081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.513083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.513087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306686777:10123]
2025-10-02T09:32:55.513107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.513110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.513113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.513113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.513116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.513119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.513236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.518050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId: src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.520095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.588391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242296:8287]
2025-10-02T09:32:55.588566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1729, pipe: [1:7556555046382242296:8287]
2025-10-02T09:32:55.622101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.622291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.622300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.622324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242296:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.622471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:55.622503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:55.622507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242296:8287]
2025-10-02T09:32:55.622513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:55.622519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.622564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1730 reason: error at write: Disconnected sessionId: src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0
2025-10-02T09:32:55.622684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1730 sessionId: src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0 is DEAD
2025-10-02T09:32:55.622810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:55.622819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Write session will restart in 0.006531s
2025-10-02T09:32:55.622838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Write session: Do CDS request
2025-10-02T09:32:55.622844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.627111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.628117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.628217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.628223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.628228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.628253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.628278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306686845:10125]
2025-10-02T09:32:55.628621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.628778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.628799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.628983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.629012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.629016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.629017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.629018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.629018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.629019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.629020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.629020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.629021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.629021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.629022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.629022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.629025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.629032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.629034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.629036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.629038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.629040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.629042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.629044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.629046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.629049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.629051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.629053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.629057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.629062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.629065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.629068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.629070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.629073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.629075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.629078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.629081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.629085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.629087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.629090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.629092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.629094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.629096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.629099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.629101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.629104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.629106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.629108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.629110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.629113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.629115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.629117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.629134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.630203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.630313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.630321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1731
2025-10-02T09:32:55.630402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.630421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.630427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.630430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.630697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1731 sessionId:  describe result for acl check
2025-10-02T09:32:55.630720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.630732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.630734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.630739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242327:8060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.631079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242327:8060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.632199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242327:8060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.635965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242327:8060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.635974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242327:8060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.635976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242327:8060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.635980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.636513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.638098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.638109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.638110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.638112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.638116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1730 [2:7556555046306686845:10125]
2025-10-02T09:32:55.638127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.638139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.638144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.638145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.638146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.638155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.638159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.638166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.638198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.638202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.638203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.638205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.638206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.638241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.638245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.638252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.638257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.638265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.638279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242362:8060], now have 1 active actors on pipe
2025-10-02T09:32:55.638284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242297:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.638287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.638289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.638289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.638299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.638309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.638315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.638317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.638319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.638319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.638321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.638336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.638340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.638330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1730
2025-10-02T09:32:55.638332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1730
2025-10-02T09:32:55.638357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.638359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.638361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.638376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.638383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.638389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.638390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.638395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.638403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.638414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.638499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.638505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.638513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.638568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1731 partition: 0 MaxSeqNo: 36 sessionId: src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0
2025-10-02T09:32:55.638797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f596dc78-f7b7187c-d64bb40a-aeecfdda_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.641528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Write session: try to update token
2025-10-02T09:32:55.641545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.651892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:55.651903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.651907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.651930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:55.651939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:55.652076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:55.652199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:55.652318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:55.652444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:55.652600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:55.652623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:55.653873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId: src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.655945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.655957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.655958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.655959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.655965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.655968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.655969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306686840:10125]
2025-10-02T09:32:55.655988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.655989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.655991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.655992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.655992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.655994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.656044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.656104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.722515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242392:8287]
2025-10-02T09:32:55.722638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1730, pipe: [1:7556555046382242392:8287]
2025-10-02T09:32:55.767257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.767509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.767518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.767532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242392:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.767690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:55.767709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:55.767719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:55.767750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242392:8287]
2025-10-02T09:32:55.767765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.767772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1731 reason: error at write: Disconnected sessionId: src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0
2025-10-02T09:32:55.767918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1731 sessionId: src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0 is DEAD
2025-10-02T09:32:55.768100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:55.768114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Write session will restart in 0.006873s
2025-10-02T09:32:55.768135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Write session: Do CDS request
2025-10-02T09:32:55.768142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.772661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.773642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.773738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.773744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.773750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.773774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.773799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306686946:10139]
2025-10-02T09:32:55.774140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.774300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.774322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.774498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.774528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.774532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.774533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.774534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.774534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.774535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.774536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.774536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.774537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.774537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.774538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.774539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.774541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.774548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.774550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.774552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.774554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.774557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.774559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.774561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.774563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.774565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.774567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.774569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.774573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.774577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.774580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.774583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.774586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.774588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.774590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.774594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.774596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.774599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.774602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.774605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.774607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.774609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.774612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.774614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.774616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.774619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.774621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.774623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.774625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.774628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.774642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.774647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.774664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.776131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.776209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.776216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1732
2025-10-02T09:32:55.776314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.776331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.776337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.776339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.776610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1732 sessionId:  describe result for acl check
2025-10-02T09:32:55.776632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.776637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.776638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.776641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242424:8034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.777010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242424:8034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.778342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242424:8034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.781600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242424:8034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.781608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242424:8034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.781610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242424:8034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.781614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.782119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.783593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.783603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.783604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.783606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.783610Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1731 [2:7556555046306686946:10139]
2025-10-02T09:32:55.783617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.783627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.783632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.783634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.783634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.783643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.783646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.783650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.783683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.783687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.783688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.783690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.783692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.783729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.783733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.783740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.783745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.783753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.783767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242393:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.783772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242459:8034], now have 1 active actors on pipe
2025-10-02T09:32:55.783775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.783776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.783778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.783784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.783794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.783797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.783797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1731
2025-10-02T09:32:55.783799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.783798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1731
2025-10-02T09:32:55.783800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.783804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.783805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.783819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.783820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.783822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.783852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.783857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.783871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.783878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.783880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.783881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.783886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.783891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.783901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.783995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.784000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.784007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.784058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1732 partition: 0 MaxSeqNo: 36 sessionId: src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0
2025-10-02T09:32:55.784224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a42f06-ef9844f2-53c4305a-baf0c086_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.786768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Write session: try to update token
2025-10-02T09:32:55.786778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.792719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:55.792731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.792735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.792758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:55.792760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:55.792902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:55.793015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:55.793126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:55.793241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:55.793404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:55.793427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:55.798241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId: src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.800216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:55.801014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.801027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.801038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.801039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.801043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.801044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.801049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.801051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.801053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306686941:10139]
2025-10-02T09:32:55.801077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.801077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.801080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.801081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.801084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.801087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.801190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.867936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555046382242474:8287]
2025-10-02T09:32:55.868096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1731, pipe: [1:7556555046382242474:8287]
2025-10-02T09:32:55.910087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:55.910291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:55.910312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242474:8287], now have 1 active actors on pipe
2025-10-02T09:32:55.910371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:55.910463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555046382242474:8287]
2025-10-02T09:32:55.910482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:55.915533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:55.916568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:55.916668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:55.916674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:55.916681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:55.916706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:55.916732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555046306687024:10142]
2025-10-02T09:32:55.917093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:55.917257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:55.917290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:55.917474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:55.917504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.917507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.917508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.917509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.917509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.917510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.917511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.917511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.917512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.917513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.917515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.917516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.917518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.917524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.917526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.917528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.917530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.917532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.917534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.917536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.917538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.917540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.917542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.917544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.917548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.917551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:55.917555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:55.917560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.917562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:55.917564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.917567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:55.917569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.917572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:55.917575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.917580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:55.917582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.917585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:55.917587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.917590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:55.917596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.917599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:55.917601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.917604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.917606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.917608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.917611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.917614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.917631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:55.918190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:55.918198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:55.918210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1732 reason: error at write: Disconnected sessionId: src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0
2025-10-02T09:32:55.918315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1732 sessionId: src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0 is DEAD
2025-10-02T09:32:55.918453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:55.918463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Write session will restart in 0.007519s
2025-10-02T09:32:55.918478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Write session: Do CDS request
2025-10-02T09:32:55.918483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:55.925252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:55.926707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:55.926717Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:55.926718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:55.926721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:55.926734Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1732 [2:7556555046306687024:10142]
2025-10-02T09:32:55.926744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:55.926760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:55.926763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.926765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.926765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.926774Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:55.926778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:55.926782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:55.926819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.926824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.926824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.926826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:55.926828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:55.926868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:55.926872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.926878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:55.926883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:55.926891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:55.926905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242478:2446], now have 1 active actors on pipe
2025-10-02T09:32:55.926912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.926913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.926914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.926921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:55.926930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:55.926934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:55.926937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:55.926938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:55.926939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:55.926940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:55.926935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1732
2025-10-02T09:32:55.926955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.926960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:55.926961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:55.927152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.927210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:55.927216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1733
2025-10-02T09:32:55.927291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:55.927309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:55.927314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:55.927316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:55.927567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1733 sessionId:  describe result for acl check
2025-10-02T09:32:55.927594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:55.927600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:55.927601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:55.927606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555046382242525:8023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:55.927897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555046382242525:8023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:55.929368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555046382242525:8023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:55.933848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555046382242525:8023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:55.933857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555046382242525:8023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:55.933859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555046382242525:8023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:55.933866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:55.933980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555046382242561:8023], now have 1 active actors on pipe
2025-10-02T09:32:55.934047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1732
2025-10-02T09:32:55.934086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.934095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.934114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:55.934123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:55.934127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:55.934128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:55.934134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:55.934141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:55.934152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.934241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:55.934247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:55.934256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:55.934300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1733 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0
2025-10-02T09:32:55.934468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1983c8-a7e13b8d-23e1e511-f99f538d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:55.936345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:55.936355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:55.936357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:55.936358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:55.936362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.936365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.936368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555046306687019:10142]
2025-10-02T09:32:55.936392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:55.936399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:55.936401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:55.936402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:55.936404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:55.936407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:55.936514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:55.936719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Write session: try to update token
2025-10-02T09:32:55.936728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:55.948185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId: src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:55.950182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.010779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677209860:8287]
2025-10-02T09:32:56.010981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1732, pipe: [1:7556555050677209860:8287]
2025-10-02T09:32:56.047535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.047787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.047796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.047809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677209860:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.047953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677209860:8287]
2025-10-02T09:32:56.047975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.047977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.047981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.047999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.048019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1733 reason: error at write: Disconnected sessionId: src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0
2025-10-02T09:32:56.048150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1733 sessionId: src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0 is DEAD
2025-10-02T09:32:56.048277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.048286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Write session will restart in 0.005945s
2025-10-02T09:32:56.048300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Write session: Do CDS request
2025-10-02T09:32:56.048304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.052966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.054046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.054150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.054156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.054162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.054190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.054214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654389:10145]
2025-10-02T09:32:56.054556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.054759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.054785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.054967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.054997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.055001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.055002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.055002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.055003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.055004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.055005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.055006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.055006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.055007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.055007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.055008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.055011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.055017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.055020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.055022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.055024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.055026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.055028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.055030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.055032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.055035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.055036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.055038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.055043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.055047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.055051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.055054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.055056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.055062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.055064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.055067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.055069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.055071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.055073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.055079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.055082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.055085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.055091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.055093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.055099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.055101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.055105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.055111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.055113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.055116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.055118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.055121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.055137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.055140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.055187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.055195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1734
2025-10-02T09:32:56.055285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.055302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.055307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.055309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.055580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1734 sessionId:  describe result for acl check
2025-10-02T09:32:56.055606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.055613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.055614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.055618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677209895:8016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.055982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677209895:8016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.057254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677209895:8016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.061508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677209895:8016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.061516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677209895:8016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.061518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677209895:8016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.061521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.062718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.064181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.064192Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.064193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.064195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.064199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1733 [2:7556555050601654389:10145]
2025-10-02T09:32:56.064206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.064216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.064218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.064219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.064221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.064229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.064233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.064238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.064270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.064275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.064276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.064278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.064280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.064326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.064332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.064342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.064353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.064369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.064388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677209930:8016], now have 1 active actors on pipe
2025-10-02T09:32:56.064393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677209862:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.064397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.064399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.064400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.064410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.064405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1733
2025-10-02T09:32:56.064406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1733
2025-10-02T09:32:56.064422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.064423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.064429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.064431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.064435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.064437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.064461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.064468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.064480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.064487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.064497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.064507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86bf678-42887ee8-828e518c-f8526e54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.064512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.064518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.064520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.064526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.064535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.064554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.064645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.064651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.064661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.064719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1734 partition: 0 MaxSeqNo: 36 sessionId: src_id|86bf678-42887ee8-828e518c-f8526e54_0
2025-10-02T09:32:56.064894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b77ab3-6971b055-cd6bb9-1d05ad3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86bf678-42887ee8-828e518c-f8526e54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.067110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Write session: try to update token
2025-10-02T09:32:56.067120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.073650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.073665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.073666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.073667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.073671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.073674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.073676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654384:10145]
2025-10-02T09:32:56.073705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.073710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.073712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.073715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.073718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.073721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.073838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.078586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId: src_id|86bf678-42887ee8-828e518c-f8526e54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.080604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.148002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677209937:8287]
2025-10-02T09:32:56.148218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1733, pipe: [1:7556555050677209937:8287]
2025-10-02T09:32:56.183974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.184181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.184190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.184213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677209937:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.184377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.184404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677209937:8287]
2025-10-02T09:32:56.184426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.184434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.184430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.184489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1734 reason: error at write: Disconnected sessionId: src_id|86bf678-42887ee8-828e518c-f8526e54_0
2025-10-02T09:32:56.184636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1734 sessionId: src_id|86bf678-42887ee8-828e518c-f8526e54_0 is DEAD
2025-10-02T09:32:56.184756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.184765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Write session will restart in 0.008133s
2025-10-02T09:32:56.184781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Write session: Do CDS request
2025-10-02T09:32:56.184786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.189682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.190734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.190848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.190855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.190861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.190891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.190916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654455:10147]
2025-10-02T09:32:56.191261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.191462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.191490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.191675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.191705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.191709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.191709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.191710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.191710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.191711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.191712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.191713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.191713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.191714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.191715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.191715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.191718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.191725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.191727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.191729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.191731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.191733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.191735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.191737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.191739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.191743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.191744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.191746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.191750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.191754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.191757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.191760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.191762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.191764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.191767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.191770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.191772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.191774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.191777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.191780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.191783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.191785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.191787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.191790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.191794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.191796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.191799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.191802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.191805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.191808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.191809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.191812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.191829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.194118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.194208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.194215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1735
2025-10-02T09:32:56.194287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.194311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.194320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.194323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.194619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1735 sessionId:  describe result for acl check
2025-10-02T09:32:56.194651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.194656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.194657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.194660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677209973:8014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.195062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677209973:8014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.196478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677209973:8014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.198773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677209973:8014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.198781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677209973:8014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.198783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677209973:8014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.198787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.199227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.200669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.200680Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.200682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.200684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.200688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1734 [2:7556555050601654455:10147]
2025-10-02T09:32:56.200695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.200704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.200706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.200707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.200708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.200717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.200721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.200725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.200757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.200762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.200764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.200766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.200767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.200820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.200826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.200836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.200844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.200862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.200877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210008:8014], now have 1 active actors on pipe
2025-10-02T09:32:56.200883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677209939:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.200889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.200890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.200892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.200888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1734
2025-10-02T09:32:56.200905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.200910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1734
2025-10-02T09:32:56.200919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.200921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.200924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.200926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.200935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.200937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.200962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.200968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.200980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.200987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.201002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.201007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.201012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.201014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.201016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.201022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.201031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.201052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.201132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.201138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.201148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.201188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1735 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0
2025-10-02T09:32:56.201347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86bf678-42887ee8-828e518c-f8526e54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.203569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Write session: try to update token
2025-10-02T09:32:56.203578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.210237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.210250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.210253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.210254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.210259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.210261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.210263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654450:10147]
2025-10-02T09:32:56.210291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.210296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.210302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.210307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.210318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.210322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.210414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.216193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId: src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.218353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.284699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677210017:8287]
2025-10-02T09:32:56.284919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1734, pipe: [1:7556555050677210017:8287]
2025-10-02T09:32:56.321584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.321867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.321877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.321890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210017:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.322083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.322104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.322106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.322107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.322117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677210017:8287]
2025-10-02T09:32:56.322164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1735 reason: error at write: Disconnected sessionId: src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0
2025-10-02T09:32:56.322316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1735 sessionId: src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0 is DEAD
2025-10-02T09:32:56.322425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.322433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Write session will restart in 0.005673s
2025-10-02T09:32:56.322451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Write session: Do CDS request
2025-10-02T09:32:56.322455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.327468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.328422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.328528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.328534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.328540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.328566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.328591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654526:10150]
2025-10-02T09:32:56.328955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.329150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.329166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.329177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.329320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.329329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1736
2025-10-02T09:32:56.329363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.329395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.329399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.329399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.329400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.329400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.329401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.329401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.329402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.329402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.329403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.329411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.329403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.329404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.329407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.329429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.329413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.329416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.329435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.329438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.329418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.329420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.329422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.329424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.329426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.329428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.329430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.329432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.329434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.329438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.329442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.329445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.329449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.329452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.329455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.329457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.329460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.329463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.329465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.329467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.329470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.329472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.329475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.329477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.329479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.329483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.329485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.329487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.329490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.329492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.329495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.329498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.329500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.329518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.329691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1736 sessionId:  describe result for acl check
2025-10-02T09:32:56.329711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.329716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.329717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.329720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677210053:8003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.330075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677210053:8003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.331728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677210053:8003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.335684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677210053:8003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.335692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677210053:8003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.335695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677210053:8003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.335699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.336907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.338494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.338505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.338506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.338510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.338513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1735 [2:7556555050601654526:10150]
2025-10-02T09:32:56.338522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.338537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.338541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.338543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.338544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.338553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.338556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.338563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.338595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.338600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.338602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.338603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.338605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.338649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.338655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.338665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.338678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.338695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.338712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210088:8003], now have 1 active actors on pipe
2025-10-02T09:32:56.338719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210018:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.338723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.338732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.338733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.338741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.338751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.338747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1735
2025-10-02T09:32:56.338758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.338755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1735
2025-10-02T09:32:56.338759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.338761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.338766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.338768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.338793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.338800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.338809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.338818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.338828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.338845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.338853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.338860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.338861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.338870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.338880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.338898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.338984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.338991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.339001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.339054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1736 partition: 0 MaxSeqNo: 36 sessionId: src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0
2025-10-02T09:32:56.339280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2c0a8-98e6634a-991de0dd-a3035a12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.341937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Write session: try to update token
2025-10-02T09:32:56.341952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.347856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.347867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.347870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.347871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.347874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.347876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.347878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654521:10150]
2025-10-02T09:32:56.347901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.347909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.347911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.347916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.347926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.347929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.348031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.357588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId: src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.359747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.422441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677210096:8287]
2025-10-02T09:32:56.422649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1735, pipe: [1:7556555050677210096:8287]
2025-10-02T09:32:56.457917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.458203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.458212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.458225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210096:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.458389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.458397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.458425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.458436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677210096:8287]
2025-10-02T09:32:56.458441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1736 reason: error at write: Disconnected sessionId: src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0
2025-10-02T09:32:56.458457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.458590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1736 sessionId: src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0 is DEAD
2025-10-02T09:32:56.458771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.458784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Write session will restart in 0.008326s
2025-10-02T09:32:56.458806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Write session: Do CDS request
2025-10-02T09:32:56.458811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.463606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.464651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.464759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.464765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.464772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.464810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.464835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654596:10152]
2025-10-02T09:32:56.465181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.465379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.465407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.465591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.465621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.465626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.465627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.465627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.465628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.465629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.465629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.465630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.465630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.465631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.465632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.465632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.465635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.465642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.465644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.465647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.465648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.465651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.465653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.465655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.465657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.465659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.465661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.465663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.465668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.465672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.465676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.465682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.465685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.465689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.465692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.465698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.465701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.465704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.465706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.465710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.465713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.465718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.465720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.465723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.465729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.465731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.465736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.465739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.465741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.465744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.465746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.465748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.465766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.468139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.468264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.468274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1737
2025-10-02T09:32:56.468358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.468376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.468382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.468384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.468663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1737 sessionId:  describe result for acl check
2025-10-02T09:32:56.468686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.468690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.468691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.468694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677210133:7998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.469052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677210133:7998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.470394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677210133:7998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.472612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677210133:7998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.472619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677210133:7998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.472621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677210133:7998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.472628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.473201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.474721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.474741Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.474742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.474744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.474748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1736 [2:7556555050601654596:10152]
2025-10-02T09:32:56.474755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.474765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.474771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.474773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.474774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.474784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.474786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.474792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.474824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.474829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.474830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.474831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.474832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.474880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.474886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.474895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.474904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.474917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.474936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210097:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.474942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210168:7998], now have 1 active actors on pipe
2025-10-02T09:32:56.474946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.474948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.474949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.474957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.474967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1736
2025-10-02T09:32:56.474971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.474966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1736
2025-10-02T09:32:56.474972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.474974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.474975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.474987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.474989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.475015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.475022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.475031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.475039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.475049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.475060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|578c5c9d-9c05be56-73015632-c306f3f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.475067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.475071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.475077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.475083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.475093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.475113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.475232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.475239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.475248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.475303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1737 partition: 0 MaxSeqNo: 36 sessionId: src_id|578c5c9d-9c05be56-73015632-c306f3f3_0
2025-10-02T09:32:56.475503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04b4e0f-e7dada0e-f302a719-82d8e0e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|578c5c9d-9c05be56-73015632-c306f3f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.478144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Write session: try to update token
2025-10-02T09:32:56.478158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.484039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.484050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.484051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.484052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.484057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.484060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.484062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654591:10152]
2025-10-02T09:32:56.484084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.484089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.484091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.484103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.484114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.484118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.484202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.490451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId: src_id|578c5c9d-9c05be56-73015632-c306f3f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.492557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.558618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677210179:8287]
2025-10-02T09:32:56.558808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1736, pipe: [1:7556555050677210179:8287]
2025-10-02T09:32:56.593408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.593692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.593702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.593713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210179:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.593917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.593909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677210179:8287]
2025-10-02T09:32:56.593927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.593929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.593931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.593976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1737 reason: error at write: Disconnected sessionId: src_id|578c5c9d-9c05be56-73015632-c306f3f3_0
2025-10-02T09:32:56.594084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1737 sessionId: src_id|578c5c9d-9c05be56-73015632-c306f3f3_0 is DEAD
2025-10-02T09:32:56.594191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.594199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Write session will restart in 0.006034s
2025-10-02T09:32:56.594213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Write session: Do CDS request
2025-10-02T09:32:56.594218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.599523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.600552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.600657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.600664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.600670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.600696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.600730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654667:10154]
2025-10-02T09:32:56.601093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.601198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.601221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.601230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1738
2025-10-02T09:32:56.601303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.601330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.601475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.601494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.601501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.601503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.601521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.601553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.601557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.601557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.601558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.601559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.601559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.601560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.601560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.601561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.601561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.601562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.601562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.601565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.601572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.601574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.601576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.601578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.601580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.601582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.601586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.601588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.601590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.601592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.601594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.601598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.601602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.601606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.601609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.601611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.601614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.601616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.601619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.601622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.601624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.601626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.601629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.601631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.601634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.601636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.601639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.601641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.601644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.601648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.601650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.601652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.601656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.601658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.601661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.601679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.601751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1738 sessionId:  describe result for acl check
2025-10-02T09:32:56.601773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.601777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.601778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.601781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677210215:7995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.602118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677210215:7995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.603480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677210215:7995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.607054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677210215:7995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.607062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677210215:7995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.607064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677210215:7995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.607067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.609244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.610712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.610723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.610732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.610734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.610737Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1737 [2:7556555050601654667:10154]
2025-10-02T09:32:56.610745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.610753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.610755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.610756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.610757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.610767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.610773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.610777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.610808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.610813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.610815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.610817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.610818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.610862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.610868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.610878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.610892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.610908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.610926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210252:7995], now have 1 active actors on pipe
2025-10-02T09:32:56.610932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210180:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.610935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.610938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.610940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.610948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.610961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.610952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1737
2025-10-02T09:32:56.610964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.610965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1737
2025-10-02T09:32:56.610966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.610968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.610975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.610978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.611007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.611013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.611022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.611030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.611042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.611050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.611057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.611063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.611065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.611072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.611080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.611098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.611184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.611190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.611202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.611247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1738 partition: 0 MaxSeqNo: 36 sessionId: src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0
2025-10-02T09:32:56.611445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|578c5c9d-9c05be56-73015632-c306f3f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.613917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Write session: try to update token
2025-10-02T09:32:56.613928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.620384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.620397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.620398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.620401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.620404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.620407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.620411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654662:10154]
2025-10-02T09:32:56.620436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.620440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.620441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.620456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.620466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.620470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.620563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.625375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId: src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.627369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.694302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677210260:8287]
2025-10-02T09:32:56.694498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1737, pipe: [1:7556555050677210260:8287]
2025-10-02T09:32:56.730288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.730537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.730547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.730572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210260:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.730791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.730795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677210260:8287]
2025-10-02T09:32:56.730819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.730821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.730868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1738 reason: error at write: Disconnected sessionId: src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0
2025-10-02T09:32:56.730997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1738 sessionId: src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0 is DEAD
2025-10-02T09:32:56.731106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.731123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Write session will restart in 0.008665s
2025-10-02T09:32:56.731139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Write session: Do CDS request
2025-10-02T09:32:56.731148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.731142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.736100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.737162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.737289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.737296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.737302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.737332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.737360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654754:10162]
2025-10-02T09:32:56.737709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.737924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.737952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.738137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.738181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.738185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.738186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.738187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.738187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.738188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.738189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.738189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.738190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.738191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.738192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.738192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.738196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.738202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.738204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.738206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.738208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.738210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.738212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.738214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.738216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.738219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.738221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.738223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.738226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.738230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.738233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.738236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.738241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.738244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.738246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.738249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.738252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.738255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.738257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.738260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.738262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.738265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.738268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.738270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.738273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.738275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.738277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.738280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.738283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.738285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.738291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.738294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.738310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.741160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.741257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.741270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1739
2025-10-02T09:32:56.741380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.741405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.741412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.741415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.741699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1739 sessionId:  describe result for acl check
2025-10-02T09:32:56.741722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.741727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.741727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.741730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677210323:7978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.742056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677210323:7978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.743277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677210323:7978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.745584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677210323:7978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.745594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677210323:7978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.745597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677210323:7978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.745602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.745899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.747369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.747381Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.747383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.747385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.747388Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1738 [2:7556555050601654754:10162]
2025-10-02T09:32:56.747396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.747408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.747409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.747411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.747412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.747422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.747429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.747434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.747468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.747474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.747475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.747477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.747479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.747525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.747530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.747536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.747541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.747549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.747563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210355:7978], now have 1 active actors on pipe
2025-10-02T09:32:56.747568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210274:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.747572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.747573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.747575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.747582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.747578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1738
2025-10-02T09:32:56.747593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.747598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.747587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1738
2025-10-02T09:32:56.747600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.747601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.747603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.747605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.747633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.747638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.747648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.747656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.747668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.747676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49252e18-d58f100b-95380512-5c2d41e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.747680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.747685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.747687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.747691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.747700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.747717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.747804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.747810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.747818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.747882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1739 partition: 0 MaxSeqNo: 36 sessionId: src_id|49252e18-d58f100b-95380512-5c2d41e4_0
2025-10-02T09:32:56.748135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c59de4-2fe99fc9-70e84059-921cc0f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49252e18-d58f100b-95380512-5c2d41e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.750437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Write session: try to update token
2025-10-02T09:32:56.750448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.757038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.757049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.757051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.757052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.757057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.757060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.757062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654749:10162]
2025-10-02T09:32:56.757084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.757087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.757088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.757089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.757091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.757093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.757240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.762405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId: src_id|49252e18-d58f100b-95380512-5c2d41e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.764570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.831008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677210365:8287]
2025-10-02T09:32:56.831177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1738, pipe: [1:7556555050677210365:8287]
2025-10-02T09:32:56.869091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:56.869297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.869305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.869318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210365:8287], now have 1 active actors on pipe
2025-10-02T09:32:56.869470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:56.869494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:56.869500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677210365:8287]
2025-10-02T09:32:56.869506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:56.869514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:56.869557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1739 reason: error at write: Disconnected sessionId: src_id|49252e18-d58f100b-95380512-5c2d41e4_0
2025-10-02T09:32:56.869720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1739 sessionId: src_id|49252e18-d58f100b-95380512-5c2d41e4_0 is DEAD
2025-10-02T09:32:56.869846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:56.869855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Write session will restart in 0.009958s
2025-10-02T09:32:56.869870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Write session: Do CDS request
2025-10-02T09:32:56.869874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:56.874264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:56.875296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:56.875398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:56.875403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:56.875409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:56.875435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:56.875461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555050601654859:10171]
2025-10-02T09:32:56.875817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:56.875990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:56.876025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:56.876210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:56.876240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.876245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.876246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.876247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.876248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.876249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.876250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.876251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.876252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.876253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.876254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.876255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.876259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.876270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.876273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.876276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.876278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.876283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.876285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.876287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.876289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.876292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.876293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.876295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.876302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.876306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:56.876313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.876316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:56.876322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.876325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:56.876330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.876333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:56.876335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.876338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:56.876339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.876342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:56.876344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.876347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:56.876349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.876354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:56.876357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.876359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:56.876365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.876368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.876373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.876376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.876378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.876383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.876401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:56.881142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.881233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:56.881243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1740
2025-10-02T09:32:56.881320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:56.881339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:56.881345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:56.881348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:56.881814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1740 sessionId:  describe result for acl check
2025-10-02T09:32:56.881833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:56.881837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:56.881838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:56.881841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555050677210412:7974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:56.882183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555050677210412:7974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:56.883677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555050677210412:7974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:56.883754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:56.885205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:56.885219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:56.885221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:56.885224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:56.885228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1739 [2:7556555050601654859:10171]
2025-10-02T09:32:56.885239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:56.885250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:56.885255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.885257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.885259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.885267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:56.885270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:56.885276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:56.885307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.885311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.885312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.885314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:56.885315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:56.885351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:56.885355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.885362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:56.885367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:56.885378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:56.885392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210372:2446], now have 1 active actors on pipe
2025-10-02T09:32:56.885399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.885401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.885402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.885409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:56.885420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:56.885423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:56.885425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:56.885427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:56.885430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:56.885432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:56.885414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1739
2025-10-02T09:32:56.885449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.885456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:56.885461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:56.885673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555050677210412:7974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:56.885681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555050677210412:7974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:56.885683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555050677210412:7974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:56.885687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:56.885808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210448:7974], now have 1 active actors on pipe
2025-10-02T09:32:56.885819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1739
2025-10-02T09:32:56.885843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.885848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.885862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:56.885869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:56.885871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:56.885872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:56.885878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:56.885887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:56.885896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.886003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:56.886009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:56.886017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:56.886067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1740 partition: 0 MaxSeqNo: 36 sessionId: src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0
2025-10-02T09:32:56.886231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49252e18-d58f100b-95380512-5c2d41e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:56.888438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Write session: try to update token
2025-10-02T09:32:56.888447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:56.894648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:56.894660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:56.894661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:56.894662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:56.894667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.894669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.894671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555050601654854:10171]
2025-10-02T09:32:56.894692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:56.894694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:56.894695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:56.894697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:56.894698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:56.894700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:56.894824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:56.899957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId: src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:56.902051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:56.969752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555050677210468:8287]
2025-10-02T09:32:56.969889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1739, pipe: [1:7556555050677210468:8287]
2025-10-02T09:32:57.005541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.005822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.005832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.005844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555050677210468:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.005963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.006023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:57.006033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:57.006091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1740 reason: error at write: Disconnected sessionId: src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0
2025-10-02T09:32:57.006149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555050677210468:8287]
2025-10-02T09:32:57.006170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.006251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1740 sessionId: src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0 is DEAD
2025-10-02T09:32:57.006369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:57.006377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Write session will restart in 0.009439s
2025-10-02T09:32:57.006394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Write session: Do CDS request
2025-10-02T09:32:57.006399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.011264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.012296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.012400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.012408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.012414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.012442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.012472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622231:10174]
2025-10-02T09:32:57.012838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.013015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.013042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.013241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.013272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.013276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.013277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.013277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.013278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.013278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.013279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.013280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.013280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.013281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.013282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.013282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.013286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.013293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.013295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.013297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.013299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.013301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.013303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.013305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.013308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.013310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.013312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.013314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.013318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.013322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.013325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.013328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.013330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.013333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.013335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.013338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.013340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.013343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.013346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.013349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.013351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.013354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.013357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.013359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.013361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.013364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.013370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.013373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.013375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.013378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.013380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.013383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.013400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.017108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.017200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.017210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1741
2025-10-02T09:32:57.017297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.017317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.017323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.017326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.017590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1741 sessionId:  describe result for acl check
2025-10-02T09:32:57.017615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.017619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.017620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.017623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972177806:7966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.017975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972177806:7966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.019427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972177806:7966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.020730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.021287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972177806:7966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.021296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972177806:7966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.021297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972177806:7966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.021302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.022165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.022179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.022182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.022185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.022189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1740 [2:7556555054896622231:10174]
2025-10-02T09:32:57.022197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.022205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.022207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.022208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.022209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.022217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.022223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.022226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.022366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1740
2025-10-02T09:32:57.022371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1740
2025-10-02T09:32:57.022256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.022260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.022261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.022263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.022264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.022340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.022342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.022348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.022354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.022362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.022373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177765:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.022374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177841:7966], now have 1 active actors on pipe
2025-10-02T09:32:57.022378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.022379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.022380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.022385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.022391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.022392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.022393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.022394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.022399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.022401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.022412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.022414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.022433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.022440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.022449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.022454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|310424ab-dd510b11-e3aad358-edfd2845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.022458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.022460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.022461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.022466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.022471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.022489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.022579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.022586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.022595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.022647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1741 partition: 0 MaxSeqNo: 36 sessionId: src_id|310424ab-dd510b11-e3aad358-edfd2845_0
2025-10-02T09:32:57.022825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3532f9e6-9e2a8a6c-c6a17280-bea55bfd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|310424ab-dd510b11-e3aad358-edfd2845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.024962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Write session: try to update token
2025-10-02T09:32:57.024970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.031591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.031603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.031604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.031605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.031609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.031612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.031614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622226:10174]
2025-10-02T09:32:57.031635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.031639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.031641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.031642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.031643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.031644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.031746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.036447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId: src_id|310424ab-dd510b11-e3aad358-edfd2845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.038443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.106456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972177848:8287]
2025-10-02T09:32:57.106612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1740, pipe: [1:7556555054972177848:8287]
2025-10-02T09:32:57.140688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.140950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.140962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.140992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177848:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.141116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.141154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.141183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972177848:8287]
2025-10-02T09:32:57.141194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:57.141250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|310424ab-dd510b11-e3aad358-edfd2845_0
2025-10-02T09:32:57.141392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1741 sessionId: src_id|310424ab-dd510b11-e3aad358-edfd2845_0 is DEAD
2025-10-02T09:32:57.141518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:57.141527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Write session will restart in 0.009015s
2025-10-02T09:32:57.141542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Write session: Do CDS request
2025-10-02T09:32:57.141546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.146391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.147433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.147553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.147559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.147565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.147593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.147625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622306:10176]
2025-10-02T09:32:57.147979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.148158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.148180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.148358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.148399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.148404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.148405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.148405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.148406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.148406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.148407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.148408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.148408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.148409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.148409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.148410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.148413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.148420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.148422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.148424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.148426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.148429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.148430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.148432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.148434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.148436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.148438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.148440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.148444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.148448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.148452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.148454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.148458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.148460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.148462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.148465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.148467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.148470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.148472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.148474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.148477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.148479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.148481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.148484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.148487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.148489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.148493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.148495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.148497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.148500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.148502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.148504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.148523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.151136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.151466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.151475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1742
2025-10-02T09:32:57.151835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.151853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.151859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.151862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.152137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1742 sessionId:  describe result for acl check
2025-10-02T09:32:57.152162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.152166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.152167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.152170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972177890:7959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.152495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972177890:7959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.153950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972177890:7959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.155894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.155936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972177890:7959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.155943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972177890:7959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.155944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972177890:7959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.155948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.157325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.157337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.157339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.157343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.157347Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1741 [2:7556555054896622306:10176]
2025-10-02T09:32:57.157357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.157369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.157373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.157376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.157377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.157385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.157391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.157395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.157423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.157427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.157428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.157430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.157432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.157473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.157478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.157486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.157491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.157502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.157515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177924:7959], now have 1 active actors on pipe
2025-10-02T09:32:57.157521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177849:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.157524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.157525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.157526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.157531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1741
2025-10-02T09:32:57.157538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1741
2025-10-02T09:32:57.157535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.157547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.157549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.157552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.157553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.157554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.157556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.157575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.157577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.157586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.157592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.157603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.157617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.157624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.157626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.157627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.157632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.157637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.157677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.157770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.157777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.157785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.157848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1742 partition: 0 MaxSeqNo: 36 sessionId: src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0
2025-10-02T09:32:57.158017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310424ab-dd510b11-e3aad358-edfd2845_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.160235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Write session: try to update token
2025-10-02T09:32:57.160246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.166668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.166678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.166679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.166680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.166684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.166686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.166688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622301:10176]
2025-10-02T09:32:57.166710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.166713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.166714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.166714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.166717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.166719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.166831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.171302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId: src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.173318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.241109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972177935:8287]
2025-10-02T09:32:57.241272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1741, pipe: [1:7556555054972177935:8287]
2025-10-02T09:32:57.277739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.277961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.277971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.277995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177935:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.278116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.278146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972177935:8287]
2025-10-02T09:32:57.278164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.278171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:57.278230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1742 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0
2025-10-02T09:32:57.278398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1742 sessionId: src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0 is DEAD
2025-10-02T09:32:57.278538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:57.278546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Write session will restart in 0.005365s
2025-10-02T09:32:57.278561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Write session: Do CDS request
2025-10-02T09:32:57.278566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.282988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.284027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.284137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.284143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.284149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.284176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.284201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622384:10179]
2025-10-02T09:32:57.284556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.284724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.284751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.284955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.284990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.284994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.284994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.284995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.284995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.284996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.284997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.284997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.284998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.284998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.284999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.284999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.285002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.285010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.285012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.285014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.285016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.285018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.285020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.285021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.285023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.285025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.285027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.285029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.285034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.285037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.285041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.285044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.285046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.285049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.285052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.285055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.285057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.285060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.285063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.285065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.285067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.285070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.285072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.285075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.285078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.285084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.285091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.285095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.285105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.285103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.285112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.285116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.285118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.285135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.285205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.285215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1743
2025-10-02T09:32:57.285313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.285337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.285343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.285345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.285607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1743 sessionId:  describe result for acl check
2025-10-02T09:32:57.285629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.285633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.285634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.285637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972177978:7951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.285983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972177978:7951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.287565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972177978:7951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.291986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972177978:7951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.291994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972177978:7951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.291996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972177978:7951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.292000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.292576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.293982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.293994Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.293995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.293997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.294001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1742 [2:7556555054896622384:10179]
2025-10-02T09:32:57.294009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.294020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.294024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.294026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.294027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.294036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.294040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.294044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.294084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.294088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.294090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.294091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.294095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.294147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.294153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.294163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.294177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.294194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.294212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178013:7951], now have 1 active actors on pipe
2025-10-02T09:32:57.294219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972177936:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.294224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.294212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1742
2025-10-02T09:32:57.294230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.294213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1742
2025-10-02T09:32:57.294232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.294239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.294246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.294249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.294253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.294255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.294260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.294263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.294275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.294283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.294308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.294316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.294330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.294331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.294339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.294342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.294343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.294350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.294360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.294391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.294482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.294488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.294499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.294546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1743 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0
2025-10-02T09:32:57.294743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98daf342-7d5cec42-f478f918-f0c7b8c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.296968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Write session: try to update token
2025-10-02T09:32:57.296978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.303501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.303513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.303515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.303516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.303522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.303524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.303528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622379:10179]
2025-10-02T09:32:57.303553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.303561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.303562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.303571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.303575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.303579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.303673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.308152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId: src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.310101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.378339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972178021:8287]
2025-10-02T09:32:57.378809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1742, pipe: [1:7556555054972178021:8287]
2025-10-02T09:32:57.415011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.415285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.415294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.415320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178021:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.415479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:57.415505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.415489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:57.415509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.415539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972178021:8287]
2025-10-02T09:32:57.415541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1743 reason: error at write: Disconnected sessionId: src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0
2025-10-02T09:32:57.415716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1743 sessionId: src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0 is DEAD
2025-10-02T09:32:57.415833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:57.415841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Write session will restart in 0.006431s
2025-10-02T09:32:57.415861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Write session: Do CDS request
2025-10-02T09:32:57.415865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.420790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.421859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.421963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.421969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.421975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.422003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.422029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622461:10181]
2025-10-02T09:32:57.422374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.422582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.422608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.422807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.422840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.422844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.422845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.422846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.422846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.422847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.422847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.422848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.422848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.422849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.422850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.422850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.422853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.422860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.422862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.422865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.422867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.422869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.422871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.422873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.422875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.422879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.422881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.422883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.422887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.422891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.422894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.422897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.422899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.422906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.422910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.422913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.422915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.422919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.422921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.422924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.422927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.422929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.422932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.422935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.422937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.422943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.422945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.422948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.422950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.422953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.422958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.422961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.422980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.423098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.423179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.423188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1744
2025-10-02T09:32:57.423276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.423294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.423300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.423303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.423570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1744 sessionId:  describe result for acl check
2025-10-02T09:32:57.423592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.423597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.423598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.423601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972178065:7944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.423945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972178065:7944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.425392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972178065:7944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.429364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972178065:7944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.429373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972178065:7944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.429375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972178065:7944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.429378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.430763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.432230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.432240Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.432243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.432246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.432250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1743 [2:7556555054896622461:10181]
2025-10-02T09:32:57.432257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.432269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.432273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.432275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.432276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.432284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.432287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.432291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.432325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.432329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.432330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.432332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.432333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.432378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.432384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.432395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.432408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.432425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.432442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178100:7944], now have 1 active actors on pipe
2025-10-02T09:32:57.432447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178022:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.432451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.432453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.432454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.432465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.432464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1743
2025-10-02T09:32:57.432467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1743
2025-10-02T09:32:57.432478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.432480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.432482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.432484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.432494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.432498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.432524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.432530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.432540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.432548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.432559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.432570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d834849-a7c8ed27-135e167b-2b538e66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.432578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.432582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.432584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.432591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.432602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.432622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.432710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.432717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.432727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.432794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1744 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d834849-a7c8ed27-135e167b-2b538e66_0
2025-10-02T09:32:57.432987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6bbb5c-124b31fb-288521a3-ab45f8b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d834849-a7c8ed27-135e167b-2b538e66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.435257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Write session: try to update token
2025-10-02T09:32:57.435266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.441848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.441860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.441863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.441864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.441867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.441869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.441871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622456:10181]
2025-10-02T09:32:57.441897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.441905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.441906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.441917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.441928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.441932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.442020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.446936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId: src_id|5d834849-a7c8ed27-135e167b-2b538e66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.448986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.515556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972178107:8287]
2025-10-02T09:32:57.515765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1743, pipe: [1:7556555054972178107:8287]
2025-10-02T09:32:57.550649Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.550924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.550933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.550957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178107:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.551143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.551126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:57.551136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972178107:8287]
2025-10-02T09:32:57.551137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:57.551148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.551196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1744 reason: error at write: Disconnected sessionId: src_id|5d834849-a7c8ed27-135e167b-2b538e66_0
2025-10-02T09:32:57.551343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1744 sessionId: src_id|5d834849-a7c8ed27-135e167b-2b538e66_0 is DEAD
2025-10-02T09:32:57.551470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:57.551478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Write session will restart in 0.009753s
2025-10-02T09:32:57.551493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Write session: Do CDS request
2025-10-02T09:32:57.551497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.556333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.557403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.557508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.557514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.557520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.557547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.557574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622539:10183]
2025-10-02T09:32:57.557920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.558116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.558142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.558325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.558354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.558358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.558359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.558359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.558360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.558360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.558361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.558361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.558362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.558362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.558363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.558363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.558366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.558373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.558375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.558377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.558379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.558381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.558383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.558385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.558387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.558389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.558391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.558394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.558398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.558402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.558405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.558408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.558410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.558413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.558415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.558418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.558421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.558423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.558425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.558428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.558432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.558435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.558438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.558441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.558447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.558450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.558452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.558455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.558457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.558461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.558464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.558470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.558487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.562113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.562211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.562219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1745
2025-10-02T09:32:57.562298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.562315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.562321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.562323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.562603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1745 sessionId:  describe result for acl check
2025-10-02T09:32:57.562627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.562631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.562632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.562634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972178153:7935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.563008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972178153:7935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.564575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972178153:7935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.565961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.566607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972178153:7935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.566615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972178153:7935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.566617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972178153:7935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.566620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.567405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.567418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.567419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.567421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.567424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1744 [2:7556555054896622539:10183]
2025-10-02T09:32:57.567433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.567444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.567450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.567451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.567452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.567462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.567466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.567470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.567500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.567505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.567506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.567508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.567509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.567601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.567608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.567616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.567622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.567636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.567634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1744
2025-10-02T09:32:57.567636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1744
2025-10-02T09:32:57.567654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178187:7935], now have 1 active actors on pipe
2025-10-02T09:32:57.567661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178109:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.567665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.567669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.567670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.567677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.567682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.567684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.567685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.567690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.567702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.567708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.567719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.567726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.567747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.567755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.567766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.567768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aa68d11-182069ac-85014380-35dba394_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.567773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.567776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.567777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.567783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.567790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.567815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.567922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.567929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.567940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.567991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1745 partition: 0 MaxSeqNo: 36 sessionId: src_id|3aa68d11-182069ac-85014380-35dba394_0
2025-10-02T09:32:57.568147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d834849-a7c8ed27-135e167b-2b538e66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3aa68d11-182069ac-85014380-35dba394_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.570399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Write session: try to update token
2025-10-02T09:32:57.570409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.577057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.577072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.577073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.577074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.577078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.577080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.577082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622534:10183]
2025-10-02T09:32:57.577106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.577109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.577114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.577125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.577130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.577133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.577225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.582247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId: src_id|3aa68d11-182069ac-85014380-35dba394_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.584259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.651232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972178195:8287]
2025-10-02T09:32:57.651456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1744, pipe: [1:7556555054972178195:8287]
2025-10-02T09:32:57.686863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.687086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.687095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.687118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178195:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.687315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.687337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.687351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:57.687357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:57.687362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972178195:8287]
2025-10-02T09:32:57.687406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1745 reason: error at write: Disconnected sessionId: src_id|3aa68d11-182069ac-85014380-35dba394_0
2025-10-02T09:32:57.687565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1745 sessionId: src_id|3aa68d11-182069ac-85014380-35dba394_0 is DEAD
2025-10-02T09:32:57.687715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:57.687723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Write session will restart in 0.007708s
2025-10-02T09:32:57.687737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Write session: Do CDS request
2025-10-02T09:32:57.687742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.692678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.693713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.693816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.693823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.693828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.693855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.693882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622616:10185]
2025-10-02T09:32:57.694221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.694419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.694445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.694627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.694658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.694662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.694663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.694663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.694664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.694665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.694666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.694667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.694668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.694668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.694669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.694669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.694672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.694679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.694681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.694683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.694685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.694687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.694688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.694690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.694692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.694694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.694696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.694698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.694702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.694706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.694710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.694713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.694715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.694718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.694720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.694733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.694740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.694742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.694745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.694747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.694749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.694753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.694758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.694760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.694763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.694766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.694771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.694774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.694776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.694780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.694782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.694785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.694805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.696143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.696207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.696217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1746
2025-10-02T09:32:57.696303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.696321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.696327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.696330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.696593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1746 sessionId:  describe result for acl check
2025-10-02T09:32:57.696615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.696620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.696621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.696624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972178242:7930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.696993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972178242:7930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.698185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972178242:7930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.701584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972178242:7930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.701592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972178242:7930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.701594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972178242:7930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.701597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.702313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.703770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.703781Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.703782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.703784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.703788Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1745 [2:7556555054896622616:10185]
2025-10-02T09:32:57.703795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.703805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.703810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.703811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.703815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.703824Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.703830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.703834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.703865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.703870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.703871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.703873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.703874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.703919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.703924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.703934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.703947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.703963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.703981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178197:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.703987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178276:7930], now have 1 active actors on pipe
2025-10-02T09:32:57.703991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.703997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.703998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.703994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1745
2025-10-02T09:32:57.704000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1745
2025-10-02T09:32:57.704009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.704024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.704025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.704027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.704028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.704040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.704045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.704073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.704079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.704086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.704095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.704106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.704121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.704131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.704137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.704138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.704145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.704152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.704170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.704267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.704274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.704284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.704346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1746 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0
2025-10-02T09:32:57.704511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa68d11-182069ac-85014380-35dba394_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.706806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Write session: try to update token
2025-10-02T09:32:57.706820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.713320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.713332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.713335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.713336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.713339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.713342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.713344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622611:10185]
2025-10-02T09:32:57.713369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.713372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.713374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.713386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.713391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.713394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.713484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.718223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId: src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.720243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.787414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972178306:8287]
2025-10-02T09:32:57.787592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1745, pipe: [1:7556555054972178306:8287]
2025-10-02T09:32:57.826495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.826756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.826765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.826790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178306:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.826984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.826971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972178306:8287]
2025-10-02T09:32:57.826983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:57.826986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:57.826995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.827028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1746 reason: error at write: Disconnected sessionId: src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0
2025-10-02T09:32:57.827155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1746 sessionId: src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0 is DEAD
2025-10-02T09:32:57.827263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:57.827270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Write session will restart in 0.005425s
2025-10-02T09:32:57.827287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Write session: Do CDS request
2025-10-02T09:32:57.827291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.832407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.833498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.833673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.833688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.833701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.833767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.833813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622744:10200]
2025-10-02T09:32:57.834125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.834173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.834181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1747
2025-10-02T09:32:57.834214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.834263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.834281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.834289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.834292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.834427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.834461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.834546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1747 sessionId:  describe result for acl check
2025-10-02T09:32:57.834566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.834571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.834572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.834575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972178354:7917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.834645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.834676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.834680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.834680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.834681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.834681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.834682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.834682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.834683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.834683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.834685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.834686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.834686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.834689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.834695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.834697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.834699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.834701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.834703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.834705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.834707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.834709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.834711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.834713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.834715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.834718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.834731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.834734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.834737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.834739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.834742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.834744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.834747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.834749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.834752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.834754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.834756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.834759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.834762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.834764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.834766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.834769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.834772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.834775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.834777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.834779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.834782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.834784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.834786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.834801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.835200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972178354:7917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.836443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972178354:7917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.840171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972178354:7917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.840179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972178354:7917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.840181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972178354:7917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.840185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.842307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.843839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.843850Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.843851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.843853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.843856Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1746 [2:7556555054896622744:10200]
2025-10-02T09:32:57.843864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.843874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.843879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.843881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.843882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.843892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.843898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.843902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.843935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.843940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.843941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.843942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.843944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.843989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.843995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.844006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.844015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.844031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.844049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178395:7917], now have 1 active actors on pipe
2025-10-02T09:32:57.844056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178310:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.844061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.844066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.844067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.844078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.844076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1746
2025-10-02T09:32:57.844091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.844083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1746
2025-10-02T09:32:57.844092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.844094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.844096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.844106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.844112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.844137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.844146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.844158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.844167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.844177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.844191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.844199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.844205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.844207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.844213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.844223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.844242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.844340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.844347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.844358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.844420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1747 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0
2025-10-02T09:32:57.844592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d03d830-6db34b1e-d3019f0e-2f34ab45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.846841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Write session: try to update token
2025-10-02T09:32:57.846850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.853480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.853493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.853495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.853496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.853500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.853502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.853506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622739:10200]
2025-10-02T09:32:57.853531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.853539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.853541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.853551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.853562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.853567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.853657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:57.858682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId: src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.860726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.927188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555054972178418:8287]
2025-10-02T09:32:57.927350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1746, pipe: [1:7556555054972178418:8287]
2025-10-02T09:32:57.964394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:57.964690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.964700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.964713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178418:8287], now have 1 active actors on pipe
2025-10-02T09:32:57.964940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555054972178418:8287]
2025-10-02T09:32:57.964961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:57.964962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:57.964966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:57.965047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1747 reason: error at write: Disconnected sessionId: src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0
2025-10-02T09:32:57.965117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:57.965219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1747 sessionId: src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0 is DEAD
2025-10-02T09:32:57.965358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:57.965369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Write session will restart in 0.005614s
2025-10-02T09:32:57.965390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Write session: Do CDS request
2025-10-02T09:32:57.965397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:57.970007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:57.971055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:57.971190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:57.971198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:57.971204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:57.971237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:57.971295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555054896622825:10202]
2025-10-02T09:32:57.971644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:57.971858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:57.971887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:57.972073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:57.972103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.972107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.972107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.972109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.972110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.972110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.972111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.972111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.972112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.972112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.972113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.972113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.972116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.972122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.972125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.972127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.972129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.972131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.972133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.972135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.972136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.972139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.972141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.972143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.972148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.972152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:57.972155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.972159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.972158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:57.972161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.972164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:57.972166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.972169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:57.972171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.972174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:57.972177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.972179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:57.972182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.972184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:57.972186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.972189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:57.972192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.972194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:57.972196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.972198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.972202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.972204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.972206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.972208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.972228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:57.972212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:57.972222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1748
2025-10-02T09:32:57.972306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:57.972329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:57.972338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:57.972341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:57.972723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1748 sessionId:  describe result for acl check
2025-10-02T09:32:57.972745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:57.972750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:57.972751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:57.972754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555054972178466:7907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:57.973104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555054972178466:7907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:57.974738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555054972178466:7907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:57.979182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555054972178466:7907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:57.979192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555054972178466:7907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:57.979195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555054972178466:7907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:57.979201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:57.979835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:57.981263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:57.981275Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:57.981277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:57.981279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:57.981283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1747 [2:7556555054896622825:10202]
2025-10-02T09:32:57.981291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:57.981301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:57.981307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.981309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.981312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.981322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:57.981328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:57.981333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:57.981371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.981376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.981377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.981379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:57.981382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:57.981469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:57.981475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.981486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:57.981500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:57.981519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:57.981507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1747
2025-10-02T09:32:57.981512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1747
2025-10-02T09:32:57.981539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178419:2446], now have 1 active actors on pipe
2025-10-02T09:32:57.981545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555054972178500:7907], now have 1 active actors on pipe
2025-10-02T09:32:57.981550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.981555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.981557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.981564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:57.981576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:57.981577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:57.981583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:57.981584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:57.981588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:57.981591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:57.981604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.981611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.981636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.981645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:57.981658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:57.981662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:57.981668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:57.981671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:57.981672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:57.981679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:57.981692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:57.981723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.981814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.981821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.981831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:57.981879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1748 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0
2025-10-02T09:32:57.982128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8cc4a99-656f1db8-9a3b3faf-5b510ffb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:57.984321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Write session: try to update token
2025-10-02T09:32:57.984331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:57.995062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:32:57.995075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.995081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.995114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:32:57.995133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:32:57.995265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:32:57.995381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:57.995502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:57.995613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:32:57.995785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:32:57.995810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:32:57.996147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId: src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:57.998241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:57.998377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:57.998387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:57.998403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:32:57.998454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:57.999514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:57.999525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:57.999527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:57.999528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:57.999532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.999534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.999536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555054896622820:10202]
2025-10-02T09:32:57.999561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:57.999572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:57.999574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:57.999579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:57.999591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:57.999595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:57.999692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.064936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267145805:8287]
2025-10-02T09:32:58.065115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1747, pipe: [1:7556555059267145805:8287]
2025-10-02T09:32:58.110079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.116272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.116293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.116420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.116472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.116526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.116579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.117016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.117026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.117080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.117131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.117187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.117241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.117283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.117288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.117341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.117391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.117446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.117499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.117533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.117538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.117592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.117651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.117715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.117771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.117806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.117811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.117864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.117914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.117968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.118020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.118059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.118063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.118114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.118164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.118217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.118269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.118305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.118310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.118362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.118412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.118466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.118518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.118555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.118559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.118613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.118663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.118737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.118794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.118834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.118839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.118890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.118940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.118992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.119044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.119079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.119084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.119135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:32:58.119186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:32:58.119239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:32:58.119295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:32:58.119329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:32:58.119334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:32:58.119364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145805:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.119539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.119570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267145805:8287]
2025-10-02T09:32:58.119574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:58.119576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:58.119596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1748 reason: error at write: Disconnected sessionId: src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0
2025-10-02T09:32:58.119737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1748 sessionId: src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0 is DEAD
2025-10-02T09:32:58.119771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.119870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:58.119875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Write session will restart in 0.006255s
2025-10-02T09:32:58.119889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Write session: Do CDS request
2025-10-02T09:32:58.119894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.125317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.126482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.126584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.126590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.126595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.126622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.126648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590205:10205]
2025-10-02T09:32:58.127000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.127124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.127183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.127191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1749
2025-10-02T09:32:58.127216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.127243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.127274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.127292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.127295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.127297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.127428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.127455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.127459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.127460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.127461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.127461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.127462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.127462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.127463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.127463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.127464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.127466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.127466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.127469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.127476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.127478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.127480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.127482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.127484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.127486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.127488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.127490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.127492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.127494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.127496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.127500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.127503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.127506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.127509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.127511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.127514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.127516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.127519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.127522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.127524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.127526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.127529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.127532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.127534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.127539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.127541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.127535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1749 sessionId:  describe result for acl check
2025-10-02T09:32:58.127543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.127546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.127548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.127552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.127554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.127557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.127553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.127557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.127558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.127561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267145852:7899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.127559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.127562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.127578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.127895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267145852:7899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.129659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267145852:7899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.133713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267145852:7899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.133722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267145852:7899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.133723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267145852:7899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.133727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.135070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.136479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.136490Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.136491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.136493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.136496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1748 [2:7556555059191590205:10205]
2025-10-02T09:32:58.136503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.136513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.136519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.136520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.136521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.136531Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.136534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.136537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.136567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.136573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.136573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.136575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.136576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.136620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.136622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.136630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.136640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.136653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.136666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145889:7899], now have 1 active actors on pipe
2025-10-02T09:32:58.136668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145806:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.136673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.136674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.136677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.136686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.136698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.136698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.136700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.136702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.136712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.136717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.136710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1748
2025-10-02T09:32:58.136711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1748
2025-10-02T09:32:58.136733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.136739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.136741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.136748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.136754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.136784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.136794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.136796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.136798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.136815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.136824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.136841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.136939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.136945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.136957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.137015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1749 partition: 0 MaxSeqNo: 36 sessionId: src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0
2025-10-02T09:32:58.137173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c7db7c-e5f7d33d-245b528c-2867aa1e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.139340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Write session: try to update token
2025-10-02T09:32:58.139349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.146191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.146205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.146207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.146209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.146213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.146215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.146217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590200:10205]
2025-10-02T09:32:58.146239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.146242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.146245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.146245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.146246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.146247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.146404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.150751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId: src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.152788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:58.219544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267145897:8287]
2025-10-02T09:32:58.219692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1748, pipe: [1:7556555059267145897:8287]
2025-10-02T09:32:58.256997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.257218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.257227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.257252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145897:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.257387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.257414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:58.257423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:58.257445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267145897:8287]
2025-10-02T09:32:58.257464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.257466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1749 reason: error at write: Disconnected sessionId: src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0
2025-10-02T09:32:58.257589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1749 sessionId: src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0 is DEAD
2025-10-02T09:32:58.257720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:58.257724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Write session will restart in 0.006485s
2025-10-02T09:32:58.257743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Write session: Do CDS request
2025-10-02T09:32:58.257747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.262763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.263906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.264006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.264012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.264018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.264053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.264076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590288:10207]
2025-10-02T09:32:58.264427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.264653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.264695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.265021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.265056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.265060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.265061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.265061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.265062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.265063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.265063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.265064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.265065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.265066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.265067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.265068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.265071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.265079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.265081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.265084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.265086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.265088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.265090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.265092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.265094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.265096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.265098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.265100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.265105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.265109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.265113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.265117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.265116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.265120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.265123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.265125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.265128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.265131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.265134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.265137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.265140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.265142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.265145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.265147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.265151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.265154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.265157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.265162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.265165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.265168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.265174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.265176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.265179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.265200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.265203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.265210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1750
2025-10-02T09:32:58.265297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.265315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.265320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.265322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.265565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1750 sessionId:  describe result for acl check
2025-10-02T09:32:58.265588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.265593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.265594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.265597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267145949:7898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.265940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267145949:7898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.267506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267145949:7898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.271308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267145949:7898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.271316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267145949:7898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.271318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267145949:7898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.271321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.272666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.274113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.274125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.274126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.274128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.274131Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1749 [2:7556555059191590288:10207]
2025-10-02T09:32:58.274139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.274150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.274155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.274156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.274157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.274166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.274172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.274176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.274205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.274209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.274210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.274212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.274213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.274250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.274254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.274261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.274271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.274288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.274303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145984:7898], now have 1 active actors on pipe
2025-10-02T09:32:58.274309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145900:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.274313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.274314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.274315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.274322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.274312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1749
2025-10-02T09:32:58.274322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1749
2025-10-02T09:32:58.274333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.274333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.274339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.274340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.274340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.274342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.274364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.274370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.274378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.274385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.274395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.274402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.274406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.274412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.274413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.274418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.274426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.274440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.274524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.274530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.274539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.274599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1750 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0
2025-10-02T09:32:58.274759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624b9aa-ff8bdd26-a7c53fbf-239d8674_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.276895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Write session: try to update token
2025-10-02T09:32:58.276903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.283759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.283772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.283773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.283774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.283781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.283787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.283789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590283:10207]
2025-10-02T09:32:58.283810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.283812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.283815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.283815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.283817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.283817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.283924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.288054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId: src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.290112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:58.357780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267145992:8287]
2025-10-02T09:32:58.357928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1749, pipe: [1:7556555059267145992:8287]
2025-10-02T09:32:58.393559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.393771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.393783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.393812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145992:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.393945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267145992:8287]
2025-10-02T09:32:58.393973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:58.393975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.393976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:58.394017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1750 reason: error at write: Disconnected sessionId: src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0
2025-10-02T09:32:58.394152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1750 sessionId: src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0 is DEAD
2025-10-02T09:32:58.394278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:58.394287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Write session will restart in 0.007596s
2025-10-02T09:32:58.394302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Write session: Do CDS request
2025-10-02T09:32:58.394307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.394341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.398990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.400164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.400263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.400269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.400274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.400314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.400337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590374:10210]
2025-10-02T09:32:58.400678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.400846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.400869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.401043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.401072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.401077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.401077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.401078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.401078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.401079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.401080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.401080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.401081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.401081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.401082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.401082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.401085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.401091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.401093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.401096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.401098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.401100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.401102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.401104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.401106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.401108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.401110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.401112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.401116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.401120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.401123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.401125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.401128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.401130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.401132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.401135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.401138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.401141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.401143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.401146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.401148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.401151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.401154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.401156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.401158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.401161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.401163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.401166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.401168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.401172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.401177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.401180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.401197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.403104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.403179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.403188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1751
2025-10-02T09:32:58.403293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.403310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.403317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.403319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.403631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1751 sessionId:  describe result for acl check
2025-10-02T09:32:58.403653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.403658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.403659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.403662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267146043:7887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.404007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267146043:7887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.405253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267146043:7887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.408157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267146043:7887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.408165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267146043:7887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.408167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267146043:7887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.408170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.408854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.410308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.410321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.410322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.410324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.410327Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1750 [2:7556555059191590374:10210]
2025-10-02T09:32:58.410335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.410344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.410349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.410351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.410352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.410360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.410366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.410370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.410403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.410407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.410408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.410410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.410412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.410446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.410451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.410457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.410462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.410474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.410487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146078:7887], now have 1 active actors on pipe
2025-10-02T09:32:58.410492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267145993:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.410496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.410500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.410502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.410509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.410521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.410522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.410524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.410525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.410523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1750
2025-10-02T09:32:58.410531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.410525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1750
2025-10-02T09:32:58.410533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.410547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.410549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.410551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.410558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.410562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.410586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.410592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.410595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.410599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.410604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.410611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.410624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.410707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.410712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.410719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.410793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1751 partition: 0 MaxSeqNo: 36 sessionId: src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0
2025-10-02T09:32:58.410944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f84ec80-17865b68-79e9c486-2c9a6ced_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.413139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Write session: try to update token
2025-10-02T09:32:58.413148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.420194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.420209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.420210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.420212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.420217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.420219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.420222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590369:10210]
2025-10-02T09:32:58.420245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.420247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.420248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.420250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.420252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.420254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.420374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.424359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId: src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.426348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:58.493976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267146085:8287]
2025-10-02T09:32:58.494161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1750, pipe: [1:7556555059267146085:8287]
2025-10-02T09:32:58.530404Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.530611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.530621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.530647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146085:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.530812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.530855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:58.530857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.530866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:58.530886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267146085:8287]
2025-10-02T09:32:58.530920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1751 reason: error at write: Disconnected sessionId: src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0
2025-10-02T09:32:58.531079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1751 sessionId: src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0 is DEAD
2025-10-02T09:32:58.531210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:58.531215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Write session will restart in 0.007403s
2025-10-02T09:32:58.531233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Write session: Do CDS request
2025-10-02T09:32:58.531238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.536354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.537574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.537674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.537680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.537686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.537711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.537737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590457:10212]
2025-10-02T09:32:58.538190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.538360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.538384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.538583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.538616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.538620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.538621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.538623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.538624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.538624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.538625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.538626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.538626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.538627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.538627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.538628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.538631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.538637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.538639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.538641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.538643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.538645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.538647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.538649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.538651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.538653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.538654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.538656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.538660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.538664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.538668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.538671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.538674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.538677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.538679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.538681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.538687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.538689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.538692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.538695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.538697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.538700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.538702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.538704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.538707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.538710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.538712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.538714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.538717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.538720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.538731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.538734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.538754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.539128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.539213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.539222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1752
2025-10-02T09:32:58.539309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.539326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.539332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.539334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.539591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1752 sessionId:  describe result for acl check
2025-10-02T09:32:58.539613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.539617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.539618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.539620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267146138:7884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.539958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267146138:7884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.541575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267146138:7884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.545623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267146138:7884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.545632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267146138:7884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.545634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267146138:7884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.545638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.546347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.547850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.547861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.547863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.547864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.547868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1751 [2:7556555059191590457:10212]
2025-10-02T09:32:58.547875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.547885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.547888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.547890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.547891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.547900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.547907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.547911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.547941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.547945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.547946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.547948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.547949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.547986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.547991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.548001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.548012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.548024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.548038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146173:7884], now have 1 active actors on pipe
2025-10-02T09:32:58.548043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146087:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.548046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.548048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.548049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.548056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.548055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1751
2025-10-02T09:32:58.548056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1751
2025-10-02T09:32:58.548066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.548071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.548073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.548074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.548076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.548078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.548098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.548103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.548112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.548119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.548132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.548139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.548143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.548145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.548146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.548151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.548160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.548174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.548258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.548267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.548276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.548332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1752 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0
2025-10-02T09:32:58.548513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47339a2b-c08654cd-c8765a79-36f9fabc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.550774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Write session: try to update token
2025-10-02T09:32:58.550784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.557642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.557656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.557658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.557659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.557663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.557665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.557667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590452:10212]
2025-10-02T09:32:58.557688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.557693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.557695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.557696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.557696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.557698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.557809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.562409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId: src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.564408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:58.631203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267146180:8287]
2025-10-02T09:32:58.631392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1751, pipe: [1:7556555059267146180:8287]
2025-10-02T09:32:58.666869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.667088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.667097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.667122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146180:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.667341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.667368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.667374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:58.667377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:58.667380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267146180:8287]
2025-10-02T09:32:58.667422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1752 reason: error at write: Disconnected sessionId: src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0
2025-10-02T09:32:58.667545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1752 sessionId: src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0 is DEAD
2025-10-02T09:32:58.667697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:58.667705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Write session will restart in 0.006665s
2025-10-02T09:32:58.667719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Write session: Do CDS request
2025-10-02T09:32:58.667723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.672650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.673754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.673848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.673854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.673860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.673881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.673906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590543:10214]
2025-10-02T09:32:58.674244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.674407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.674430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.674604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.674632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.674636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.674636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.674637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.674637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.674638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.674638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.674639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.674639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.674640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.674640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.674641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.674643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.674650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.674652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.674656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.674658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.674660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.674661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.674663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.674665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.674667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.674669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.674671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.674675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.674678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.674682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.674684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.674687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.674690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.674692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.674695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.674697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.674700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.674702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.674704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.674706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.674709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.674714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.674717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.674719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.674731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.674737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.674740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.674742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.674745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.674747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.674750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.674769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.675103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.675200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.675209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1753
2025-10-02T09:32:58.675293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.675310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.675316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.675318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.675568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1753 sessionId:  describe result for acl check
2025-10-02T09:32:58.675590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.675594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.675595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.675598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267146233:7878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.675950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267146233:7878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.677160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267146233:7878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.681638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267146233:7878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.681646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267146233:7878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.681650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267146233:7878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.681653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.682295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.683734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.683745Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.683747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.683748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.683751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1752 [2:7556555059191590543:10214]
2025-10-02T09:32:58.683759Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.683768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.683773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.683775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.683776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.683784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.683787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.683794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.683829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.683834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.683835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.683837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.683838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.683875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.683880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.683886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.683891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.683899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.683911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.683915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.683916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.683921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.683927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.683928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146181:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.683931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146268:7878], now have 1 active actors on pipe
2025-10-02T09:32:58.683934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.683935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.683936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.683943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.683944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.683947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1752
2025-10-02T09:32:58.683956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1752
2025-10-02T09:32:58.683957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.683965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.683970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.684008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.684013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.684027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.684033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.684037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.684043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.684047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.684052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.684062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.684165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.684170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.684177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.684231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1753 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0
2025-10-02T09:32:58.684409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ac5f4e-242824b1-2c3a35b-8880459_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.686695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Write session: try to update token
2025-10-02T09:32:58.686706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.693414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.693427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.693428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.693429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.693433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.693435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.693437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590538:10214]
2025-10-02T09:32:58.693457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.693463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.693465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.693466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.693469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.693471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.693570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.698081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId: src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.700030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:58.767395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267146276:8287]
2025-10-02T09:32:58.767619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1752, pipe: [1:7556555059267146276:8287]
2025-10-02T09:32:58.804069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.804282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.804290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.804312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146276:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.804419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.804451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.804454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267146276:8287]
2025-10-02T09:32:58.804467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:58.804513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1753 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0
2025-10-02T09:32:58.804647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1753 sessionId: src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0 is DEAD
2025-10-02T09:32:58.804792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:58.804796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Write session will restart in 0.005921s
2025-10-02T09:32:58.804823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Write session: Do CDS request
2025-10-02T09:32:58.804827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.809340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.810450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.810564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.810570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.810577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.810605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.810626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590678:10228]
2025-10-02T09:32:58.811003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.811172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.811195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.811371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.811398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.811402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.811403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.811403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.811404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.811404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.811405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.811405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.811406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.811406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.811407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.811407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.811410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.811416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.811418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.811420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.811422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.811424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.811425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.811427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.811429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.811431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.811433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.811435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.811438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.811442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.811445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.811448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.811450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.811453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.811455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.811458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.811460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.811463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.811465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.811468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.811470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.811472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.811475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.811477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.811482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.811485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.811487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.811490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.811495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.811497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.811499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.811502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.811517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.812096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.812217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.812225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1754
2025-10-02T09:32:58.812309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.812328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.812333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.812336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.812582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1754 sessionId:  describe result for acl check
2025-10-02T09:32:58.812601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.812605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.812606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.812609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267146355:7859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.812915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267146355:7859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.814245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267146355:7859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.818247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267146355:7859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.818256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267146355:7859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.818258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267146355:7859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.818264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.819047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.820557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.820568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.820570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.820572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.820575Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1753 [2:7556555059191590678:10228]
2025-10-02T09:32:58.820582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.820591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.820595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.820597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.820598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.820608Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.820614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.820619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.820646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.820652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.820652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.820654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.820656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.820692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.820696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.820702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.820707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.820719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.820732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146387:7859], now have 1 active actors on pipe
2025-10-02T09:32:58.820734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146302:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.820737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.820740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.820741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.820749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.820755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.820761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.820763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.820764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.820765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.820767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.820765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1753
2025-10-02T09:32:58.820765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1753
2025-10-02T09:32:58.820779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.820784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.820785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.820797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.820814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.820837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e24a7132-b2bab628-d3473fa6-498ea275_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.820844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.820846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.820847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.820852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.820857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.820870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.820969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.820973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.820981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.821038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1754 partition: 0 MaxSeqNo: 36 sessionId: src_id|e24a7132-b2bab628-d3473fa6-498ea275_0
2025-10-02T09:32:58.821224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce7eeb2-e1e87378-6f1d027a-af76725d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e24a7132-b2bab628-d3473fa6-498ea275_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.823465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Write session: try to update token
2025-10-02T09:32:58.823476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.830318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.830333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.830335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.830336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.830340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.830343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.830347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590673:10228]
2025-10-02T09:32:58.830369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.830371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.830372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.830373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.830375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.830377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.830489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.835206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId: src_id|e24a7132-b2bab628-d3473fa6-498ea275_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.837308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:58.904578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555059267146403:8287]
2025-10-02T09:32:58.904751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1753, pipe: [1:7556555059267146403:8287]
2025-10-02T09:32:58.941406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:58.941660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.941674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.941702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146403:8287], now have 1 active actors on pipe
2025-10-02T09:32:58.941874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:58.941877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:58.941880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:58.941909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555059267146403:8287]
2025-10-02T09:32:58.941923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1754 reason: error at write: Disconnected sessionId: src_id|e24a7132-b2bab628-d3473fa6-498ea275_0
2025-10-02T09:32:58.942062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1754 sessionId: src_id|e24a7132-b2bab628-d3473fa6-498ea275_0 is DEAD
2025-10-02T09:32:58.942176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:58.942181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Write session will restart in 0.006801s
2025-10-02T09:32:58.942197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Write session: Do CDS request
2025-10-02T09:32:58.942208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:58.942183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:58.947685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:58.948831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:58.948940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:58.948947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:58.948953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:58.948980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:58.949004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555059191590766:10231]
2025-10-02T09:32:58.949334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:58.949498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:58.949519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:58.949689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:58.949718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.949722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.949723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.949723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.949724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.949725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.949726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.949726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.949727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.949727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.949728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.949728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.949731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.949737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.949739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.949742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.949744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.949746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.949747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.949749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.949751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.949753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.949755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.949757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.949761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.949764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:58.949768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.949771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:58.949773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.949775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:58.949777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.949780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:58.949782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.949784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:58.949786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.949790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:58.949792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.949794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:58.949796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.949799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:58.949801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.949803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:58.949806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.949808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.949810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.949813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.949815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.949817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.949835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:58.950100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.950218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:58.950226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1755
2025-10-02T09:32:58.950293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:58.950310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:58.950316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:58.950319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:58.950579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1755 sessionId:  describe result for acl check
2025-10-02T09:32:58.950602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:58.950603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:58.950604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:58.950607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555059267146473:7849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:58.950950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555059267146473:7849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:58.952534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555059267146473:7849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:58.956655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555059267146473:7849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:58.956663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555059267146473:7849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:58.956665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555059267146473:7849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:58.956668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:58.957387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:58.958795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:58.958806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:58.958807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:58.958809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:58.958813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1754 [2:7556555059191590766:10231]
2025-10-02T09:32:58.958819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:58.958829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:58.958834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.958835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.958836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.958845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:58.958848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:58.958852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:58.958886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.958890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.958892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.958894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:58.958895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:58.958939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:58.958945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.958952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:58.958960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:58.958972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:58.958985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146505:7849], now have 1 active actors on pipe
2025-10-02T09:32:58.958991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555059267146416:2446], now have 1 active actors on pipe
2025-10-02T09:32:58.958995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.958996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.958997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.959003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:58.959014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:58.959018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:58.959008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1754
2025-10-02T09:32:58.959019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:58.959008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1754
2025-10-02T09:32:58.959021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:58.959024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:58.959025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:58.959039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.959044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:58.959045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:58.959054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.959060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.959116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:58.959123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:58.959125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:58.959126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:58.959131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:58.959140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:58.959156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.959243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:58.959249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:58.959256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:58.959324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1755 partition: 0 MaxSeqNo: 36 sessionId: src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0
2025-10-02T09:32:58.959516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24a7132-b2bab628-d3473fa6-498ea275_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:58.961676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Write session: try to update token
2025-10-02T09:32:58.961685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:58.968559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:58.968576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:58.968577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:58.968578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:58.968583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.968586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.968588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555059191590761:10231]
2025-10-02T09:32:58.968608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:58.968612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:58.968614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:58.968615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:58.968617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:58.968620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:58.968754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:58.973255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId: src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:58.975291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.041830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562113809:8287]
2025-10-02T09:32:59.042034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1754, pipe: [1:7556555063562113809:8287]
2025-10-02T09:32:59.079267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.079480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.079489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.079512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562113809:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.079637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.079667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562113809:8287]
2025-10-02T09:32:59.079686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.079695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:59.079755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1755 reason: status is not ok: tablet will be restarted right now sessionId: src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0
2025-10-02T09:32:59.079886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1755 sessionId: src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0 is DEAD
2025-10-02T09:32:59.080007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:59.080012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Write session will restart in 0.007591s
2025-10-02T09:32:59.080026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Write session: Do CDS request
2025-10-02T09:32:59.080031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.085244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.086345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.086442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.086448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.086454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.086478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.086504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558153:10234]
2025-10-02T09:32:59.086853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.087017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.087040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.087213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.087241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.087245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.087246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.087246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.087247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.087247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.087248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.087250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.087251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.087252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.087252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.087253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.087282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.087291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.087297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.087299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.087301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.087303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.087305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.087307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.087310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.087312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.087314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.087319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.087324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.087327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.087332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.087334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.087336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.087338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.087341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.087343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.087347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.087349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.087352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.087354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.087357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.087360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.087363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.087365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.087367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.087369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.087372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.087376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.087378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.087380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.087382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.087397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.088114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.088217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.088233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1756
2025-10-02T09:32:59.088308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.088327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.088333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.088336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.088589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1756 sessionId:  describe result for acl check
2025-10-02T09:32:59.088611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.088615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.088616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.088619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562113865:7846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.088967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562113865:7846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.090264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562113865:7846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.094264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562113865:7846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.094273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562113865:7846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.094275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562113865:7846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.094279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.094953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.096319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.096330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.096332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.096334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.096337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1755 [2:7556555063486558153:10234]
2025-10-02T09:32:59.096343Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.096352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.096357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.096359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.096360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.096369Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.096375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.096384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.096420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.096425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.096425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.096427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.096428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.096463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.096468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.096474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.096479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.096491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.096503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562113810:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.096509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562113900:7846], now have 1 active actors on pipe
2025-10-02T09:32:59.096513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.096514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.096515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.096523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.096533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.096537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.096539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.096540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.096528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1755
2025-10-02T09:32:59.096535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1755
2025-10-02T09:32:59.096542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.096543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.096555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.096561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.096562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.096569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.096573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.096618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.096627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.096629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.096630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.096635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.096643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.096655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.096743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.096749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.096756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.096824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1756 partition: 0 MaxSeqNo: 36 sessionId: src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0
2025-10-02T09:32:59.096996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738aaea2-e7282c9c-ed8f56d1-14adce90_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.099198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Write session: try to update token
2025-10-02T09:32:59.099207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.106070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.106083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.106085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.106086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.106093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.106098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.106101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558148:10234]
2025-10-02T09:32:59.106126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.106128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.106132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.106134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.106135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.106136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.106268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.110517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId: src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.112487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.180059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562113907:8287]
2025-10-02T09:32:59.180231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1755, pipe: [1:7556555063562113907:8287]
2025-10-02T09:32:59.214599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.214848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.214857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.214883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562113907:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.215044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.215015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.215049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562113907:8287]
2025-10-02T09:32:59.215058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:59.215061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:59.215108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1756 reason: error at write: Disconnected sessionId: src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0
2025-10-02T09:32:59.215253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1756 sessionId: src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0 is DEAD
2025-10-02T09:32:59.215401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:59.215412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Write session will restart in 0.008751s
2025-10-02T09:32:59.215428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Write session: Do CDS request
2025-10-02T09:32:59.215432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.220826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.221960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.222057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.222065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.222070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.222095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.222115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558243:10236]
2025-10-02T09:32:59.222454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.222623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.222647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.222837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.222866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.222870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.222870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.222871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.222872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.222872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.222873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.222873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.222874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.222874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.222875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.222877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.222880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.222887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.222889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.222891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.222893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.222895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.222897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.222899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.222901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.222903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.222905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.222907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.222911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.222915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.222918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.222920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.222922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.222925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.222927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.222930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.222932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.222935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.222937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.222940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.222942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.222944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.222946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.222949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.222953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.222956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.222958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.222961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.222963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.222966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.222968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.222970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.222988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.225095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.225215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.225222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1757
2025-10-02T09:32:59.225298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.225315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.225320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.225323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.225572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1757 sessionId:  describe result for acl check
2025-10-02T09:32:59.225595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.225600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.225601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.225604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562113965:7840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.225950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562113965:7840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.227478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562113965:7840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.229861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562113965:7840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.229870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562113965:7840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.229871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562113965:7840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.229875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.230509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.231915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.231927Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.231929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.231931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.231934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1756 [2:7556555063486558243:10236]
2025-10-02T09:32:59.231940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.231950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.231955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.231956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.231957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.231965Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.231968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.231972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.232011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.232017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.232020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.232023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.232024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.232067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.232074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.232084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.232093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.232102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.232115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562113909:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.232121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114000:7840], now have 1 active actors on pipe
2025-10-02T09:32:59.232124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.232126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.232127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.232135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.232145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.232136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1756
2025-10-02T09:32:59.232140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1756
2025-10-02T09:32:59.232153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.232152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.232154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.232157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.232157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.232180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.232185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.232192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.232199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.232212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.232215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.232219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.232221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.232222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.232227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.232232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.232242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.232365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.232371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.232379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.232433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1757 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0
2025-10-02T09:32:59.232595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3646295d-1073b9b4-b97f16f-c8d3ad3a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.234765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Write session: try to update token
2025-10-02T09:32:59.234774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.242236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.242258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.242263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.242267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.242274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.242278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.242282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558238:10236]
2025-10-02T09:32:59.242312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.242318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.242320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.242322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.242323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.242325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.242463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.246507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId: src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.248582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.315231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562114009:8287]
2025-10-02T09:32:59.315410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1756, pipe: [1:7556555063562114009:8287]
2025-10-02T09:32:59.351123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.351352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.351365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.351392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114009:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.351521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.351553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562114009:8287]
2025-10-02T09:32:59.351556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:59.351557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:59.351611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1757 reason: error at write: Disconnected sessionId: src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0
2025-10-02T09:32:59.351742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1757 sessionId: src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0 is DEAD
2025-10-02T09:32:59.351836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.351871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:59.351880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Write session will restart in 0.008595s
2025-10-02T09:32:59.351898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Write session: Do CDS request
2025-10-02T09:32:59.351901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.356966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.358063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.358170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.358177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.358182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.358207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.358232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558334:10239]
2025-10-02T09:32:59.358567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.358742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.358764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.358940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.358969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.358973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.358974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.358975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.358977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.358977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.358978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.358978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.358979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.358979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.358980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.358980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.358983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.358989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.358991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.358993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.358995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.358997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.358999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.359001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.359002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.359004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.359006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.359008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.359012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.359016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.359019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.359022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.359024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.359026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.359028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.359031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.359033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.359036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.359038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.359042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.359044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.359047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.359052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.359054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.359056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.359063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.359065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.359067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.359070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.359072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.359077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.359079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.359096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.361097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.361211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.361220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1758
2025-10-02T09:32:59.361288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.361310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.361317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.361320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.361582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1758 sessionId:  describe result for acl check
2025-10-02T09:32:59.361607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.361611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.361612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.361615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562114068:7830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.361949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562114068:7830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.363176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562114068:7830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.365932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562114068:7830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.365940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562114068:7830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.365942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562114068:7830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.365945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.366599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.368023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.368036Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.368037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.368039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.368042Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1757 [2:7556555063486558334:10239]
2025-10-02T09:32:59.368049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.368059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.368060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.368062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.368063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.368072Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.368079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.368083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.368115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.368120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.368121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.368122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.368124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.368159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.368164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.368170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.368175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.368183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.368196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114107:7830], now have 1 active actors on pipe
2025-10-02T09:32:59.368203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114010:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.368207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.368208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.368209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.368216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.368226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.368229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.368231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.368232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.368236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.368237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.368229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1757
2025-10-02T09:32:59.368230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1757
2025-10-02T09:32:59.368251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.368256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.368257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.368264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.368269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.368294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ca199ca-53030210-17611d56-d7e1aacc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.368301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.368303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.368304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.368310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.368316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.368328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.368419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.368423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.368431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.368489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1758 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ca199ca-53030210-17611d56-d7e1aacc_0
2025-10-02T09:32:59.368650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc0f26e-6e9b60f3-3e06eca8-353d7859_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ca199ca-53030210-17611d56-d7e1aacc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.370829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Write session: try to update token
2025-10-02T09:32:59.370840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.377789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.377802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.377803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.377804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.377808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.377811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.377813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558329:10239]
2025-10-02T09:32:59.377833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.377839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.377840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.377842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.377845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.377847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.377964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.381949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId: src_id|5ca199ca-53030210-17611d56-d7e1aacc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.384014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.451937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562114114:8287]
2025-10-02T09:32:59.452132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1757, pipe: [1:7556555063562114114:8287]
2025-10-02T09:32:59.486848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.487143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.487156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.487181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114114:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.487301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.487335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.487363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562114114:8287]
2025-10-02T09:32:59.487365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:59.487418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1758 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ca199ca-53030210-17611d56-d7e1aacc_0
2025-10-02T09:32:59.487549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1758 sessionId: src_id|5ca199ca-53030210-17611d56-d7e1aacc_0 is DEAD
2025-10-02T09:32:59.487677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:59.487681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Write session will restart in 0.009643s
2025-10-02T09:32:59.487695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Write session: Do CDS request
2025-10-02T09:32:59.487699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.492748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.493970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.494071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.494077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.494083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.494109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.494133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558426:5656]
2025-10-02T09:32:59.494473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.494634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.494665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.494852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.494883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.494887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.494889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.494890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.494890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.494891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.494891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.494892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.494892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.494893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.494894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.494894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.494897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.494904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.494906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.494908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.494910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.494912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.494914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.494915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.494917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.494919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.494921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.494923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.494927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.494931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.494934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.494936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.494939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.494941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.494944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.494946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.494948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.494952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.494954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.494957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.494959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.494962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.494963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.494966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.494968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.494971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.494974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.494976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.494979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.494982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.494984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.494987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.495002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.498116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.498190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.498198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1759
2025-10-02T09:32:59.498285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.498308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.498314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.498316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.498568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1759 sessionId:  describe result for acl check
2025-10-02T09:32:59.498591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.498595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.498596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.498599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562114173:7258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.498944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562114173:7258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.500378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562114173:7258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.501907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562114173:7258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.501915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562114173:7258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.501919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562114173:7258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.501923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.502563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.503982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.503995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.503996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.503998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.504001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1758 [2:7556555063486558426:5656]
2025-10-02T09:32:59.504008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.504018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.504024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.504025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.504026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.504035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.504038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.504042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.504076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.504080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.504081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.504083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.504084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.504128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.504134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.504143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.504154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.504166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.504181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114115:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.504188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114208:7258], now have 1 active actors on pipe
2025-10-02T09:32:59.504192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.504196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.504198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.504190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1758
2025-10-02T09:32:59.504192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1758
2025-10-02T09:32:59.504204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.504214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.504217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.504219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.504220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.504225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.504227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.504250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.504255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.504262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.504268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.504277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.504287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6326ec34-265443bf-91c370c3-eaacca5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.504291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.504293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.504296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.504302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.504308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.504325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.504419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.504426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.504435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.504496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1759 partition: 0 MaxSeqNo: 36 sessionId: src_id|6326ec34-265443bf-91c370c3-eaacca5f_0
2025-10-02T09:32:59.504687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca199ca-53030210-17611d56-d7e1aacc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6326ec34-265443bf-91c370c3-eaacca5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.506886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Write session: try to update token
2025-10-02T09:32:59.506897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.513791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.513807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.513808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.513809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.513814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.513817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.513820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558421:5656]
2025-10-02T09:32:59.513844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.513848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.513850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.513851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.513852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.513853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.513977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.518551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId: src_id|6326ec34-265443bf-91c370c3-eaacca5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.520651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.587622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562114217:8287]
2025-10-02T09:32:59.587837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1758, pipe: [1:7556555063562114217:8287]
2025-10-02T09:32:59.623151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.623402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.623412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.623438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114217:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.623561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.623591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562114217:8287]
2025-10-02T09:32:59.623612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:59.623624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.623663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1759 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6326ec34-265443bf-91c370c3-eaacca5f_0
2025-10-02T09:32:59.623797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1759 sessionId: src_id|6326ec34-265443bf-91c370c3-eaacca5f_0 is DEAD
2025-10-02T09:32:59.623924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:59.623933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Write session will restart in 0.005786s
2025-10-02T09:32:59.623947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Write session: Do CDS request
2025-10-02T09:32:59.623952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.629280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.630420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.630518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.630525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.630530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.630554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.630579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558519:5644]
2025-10-02T09:32:59.630940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.631106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.631111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.631133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.631199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.631207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1760
2025-10-02T09:32:59.631309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.631296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.631317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.631320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.631322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.631339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.631342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.631343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.631343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.631344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.631345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.631345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.631346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.631346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.631347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.631347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.631348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.631351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.631358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.631360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.631362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.631364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.631366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.631368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.631371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.631373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.631375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.631377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.631379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.631383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.631387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.631390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.631393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.631395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.631398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.631400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.631404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.631406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.631409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.631411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.631413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.631415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.631418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.631420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.631423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.631425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.631427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.631429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.631431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.631434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.631441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.631443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.631445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.631463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.631580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1760 sessionId:  describe result for acl check
2025-10-02T09:32:59.631607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.631639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.631643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.631646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562114277:7815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.631982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562114277:7815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.633534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562114277:7815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.637718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562114277:7815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.637726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562114277:7815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.637728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562114277:7815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.637732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.639048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.640442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.640453Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.640454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.640455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.640459Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1759 [2:7556555063486558519:5644]
2025-10-02T09:32:59.640467Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.640477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.640482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.640483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.640484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.640493Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.640496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.640501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.640531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.640536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.640537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.640539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.640540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.640575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.640580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.640586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.640592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.640600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.640613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114312:7815], now have 1 active actors on pipe
2025-10-02T09:32:59.640618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114218:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.640622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.640624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.640625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.640632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.640642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.640645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.640647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.640648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.640651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.640652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.640653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1759
2025-10-02T09:32:59.640667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.640656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1759
2025-10-02T09:32:59.640672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.640673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.640683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.640688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.640711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.640718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.640720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.640721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.640727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.640735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.640746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.640846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.640853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.640863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.640922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1760 partition: 0 MaxSeqNo: 36 sessionId: src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0
2025-10-02T09:32:59.641093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6326ec34-265443bf-91c370c3-eaacca5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.643286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Write session: try to update token
2025-10-02T09:32:59.643295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.650144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.650156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.650157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.650158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.650163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.650166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.650168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558514:5644]
2025-10-02T09:32:59.650188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.650191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.650192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.650193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.650196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.650198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.650297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.654700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId: src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.656745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.723808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562114322:8287]
2025-10-02T09:32:59.723934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1759, pipe: [1:7556555063562114322:8287]
2025-10-02T09:32:59.762920Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.763140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.763149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.763175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114322:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.763299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.763337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562114322:8287]
2025-10-02T09:32:59.763349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:32:59.763357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.763404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1760 reason: status is not ok: tablet will be restarted right now sessionId: src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0
2025-10-02T09:32:59.763532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1760 sessionId: src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0 is DEAD
2025-10-02T09:32:59.763686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:32:59.763694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Write session will restart in 0.006140s
2025-10-02T09:32:59.763710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Write session: Do CDS request
2025-10-02T09:32:59.763714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.769085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.770383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.770480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.770487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.770493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.770517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.770543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558614:5653]
2025-10-02T09:32:59.770896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.771060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.771081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.771124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.771191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.771199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1761
2025-10-02T09:32:59.771255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.771277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.771285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.771289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.771290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.771290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.771291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.771291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.771292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.771296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.771292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.771302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.771293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.771293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.771304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.771294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.771294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.771297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.771304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.771306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.771308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.771310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.771312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.771314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.771316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.771318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.771320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.771322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.771324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.771328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.771332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.771335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.771338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.771341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.771343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.771345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.771348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.771351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.771353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.771355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.771358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.771360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.771363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.771368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.771370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.771374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.771376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.771379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.771382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.771385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.771388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.771390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.771394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.771411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.771562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1761 sessionId:  describe result for acl check
2025-10-02T09:32:59.771584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.771588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.771589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.771592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562114387:7809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.771936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562114387:7809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.773292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562114387:7809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.777595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562114387:7809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.777602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562114387:7809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.777604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562114387:7809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.777609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.778946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.780367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.780378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.780379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.780381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.780386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1760 [2:7556555063486558614:5653]
2025-10-02T09:32:59.780392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.780401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.780405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.780407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.780408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.780417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.780423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.780427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.780455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.780460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.780461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.780462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.780464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.780499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.780504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.780510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.780515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.780523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.780536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114326:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.780541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114422:7809], now have 1 active actors on pipe
2025-10-02T09:32:59.780544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.780546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.780547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.780554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.780563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.780565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.780567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.780569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.780573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.780564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1760
2025-10-02T09:32:59.780575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.780568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1760
2025-10-02T09:32:59.780589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.780594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.780595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.780605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.780610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.780633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.780640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.780642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.780643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.780648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.780655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.780664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.780755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.780760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.780770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.780829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1761 partition: 0 MaxSeqNo: 36 sessionId: src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0
2025-10-02T09:32:59.781004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288ce489-bd88a7f9-46942615-8f0f3b57_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.783171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Write session: try to update token
2025-10-02T09:32:59.783180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.790098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.790114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.790115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.790116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.790120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.790123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.790125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558609:5653]
2025-10-02T09:32:59.790144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.790147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.790149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.790149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.790153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.790157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.790254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.794472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId: src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.796525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:32:59.863584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555063562114458:8287]
2025-10-02T09:32:59.863756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1760, pipe: [1:7556555063562114458:8287]
2025-10-02T09:32:59.901346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:32:59.901533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.901542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.901565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114458:8287], now have 1 active actors on pipe
2025-10-02T09:32:59.901699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:32:59.901705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:32:59.901714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:32:59.901721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:32:59.901746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555063562114458:8287]
2025-10-02T09:32:59.901761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1761 reason: error at write: Disconnected sessionId: src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0
2025-10-02T09:32:59.901884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1761 sessionId: src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0 is DEAD
2025-10-02T09:32:59.902016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:32:59.902020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Write session will restart in 0.008161s
2025-10-02T09:32:59.902035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Write session: Do CDS request
2025-10-02T09:32:59.902039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:32:59.907282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:32:59.908440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:32:59.908561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:32:59.908567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:32:59.908573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:32:59.908600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:32:59.908626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555063486558757:5616]
2025-10-02T09:32:59.908997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:32:59.909173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:32:59.909198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:32:59.909377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:32:59.909408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.909412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.909413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.909413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.909414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.909414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.909415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.909415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.909416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.909416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.909417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.909417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.909420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.909426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.909428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.909430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.909432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.909435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.909437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.909439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.909441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.909443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.909445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.909447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.909452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.909456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:32:59.909458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.909461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:32:59.909463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.909466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:32:59.909469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.909472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:32:59.909475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.909478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:32:59.909480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.909482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:32:59.909484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.909487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:32:59.909490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.909493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:32:59.909495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.909497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:32:59.909499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.909502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.909505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.909509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.909517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.909521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.909552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:32:59.911133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.911222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:32:59.911230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1762
2025-10-02T09:32:59.911322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:32:59.911342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:32:59.911348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:32:59.911350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:32:59.911607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1762 sessionId:  describe result for acl check
2025-10-02T09:32:59.911629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:32:59.911634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:32:59.911635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:32:59.911638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555063562114524:7787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:32:59.911990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555063562114524:7787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:32:59.913613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555063562114524:7787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:32:59.916495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555063562114524:7787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:32:59.916505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555063562114524:7787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:32:59.916508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555063562114524:7787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:32:59.916518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:32:59.917161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:32:59.918636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:32:59.918648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:32:59.918649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:32:59.918651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:32:59.918654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1761 [2:7556555063486558757:5616]
2025-10-02T09:32:59.918661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:32:59.918671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:32:59.918677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.918679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.918680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.918689Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:32:59.918695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:32:59.918699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:32:59.918738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.918744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.918745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.918747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:32:59.918750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:32:59.918787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:32:59.918791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.918798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:32:59.918802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:32:59.918811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:32:59.918824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114559:7787], now have 1 active actors on pipe
2025-10-02T09:32:59.918829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555063562114463:2446], now have 1 active actors on pipe
2025-10-02T09:32:59.918833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.918834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.918835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.918843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:32:59.918852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:32:59.918857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:32:59.918859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:32:59.918860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:32:59.918861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:32:59.918862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:32:59.918866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1761
2025-10-02T09:32:59.918876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.918871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1761
2025-10-02T09:32:59.918882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:32:59.918890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:32:59.918897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.918899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.918916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e56454c6-69300099-40d60ac6-20de7ab1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:32:59.918923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:32:59.918927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:32:59.918929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:32:59.918934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:32:59.918939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:32:59.918954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.919069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:32:59.919073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:32:59.919080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:32:59.919141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1762 partition: 0 MaxSeqNo: 36 sessionId: src_id|e56454c6-69300099-40d60ac6-20de7ab1_0
2025-10-02T09:32:59.919335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dca88f0b-2e73f908-777adc3b-b47716f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e56454c6-69300099-40d60ac6-20de7ab1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:32:59.921546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Write session: try to update token
2025-10-02T09:32:59.921556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:32:59.928307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:32:59.928320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:32:59.928321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:32:59.928322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:32:59.928327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.928330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.928332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555063486558752:5616]
2025-10-02T09:32:59.928353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:32:59.928356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:32:59.928357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:32:59.928358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:32:59.928360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:32:59.928362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:32:59.928459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:32:59.933001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId: src_id|e56454c6-69300099-40d60ac6-20de7ab1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:32:59.935099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.001821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857081874:8287]
2025-10-02T09:33:00.002014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1761, pipe: [1:7556555067857081874:8287]
2025-10-02T09:33:00.041410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.041674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.041683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.041709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857081874:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.041849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.041884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:00.041897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:00.041911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857081874:8287]
2025-10-02T09:33:00.041926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.041944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1762 reason: error at write: Disconnected sessionId: src_id|e56454c6-69300099-40d60ac6-20de7ab1_0
2025-10-02T09:33:00.042092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1762 sessionId: src_id|e56454c6-69300099-40d60ac6-20de7ab1_0 is DEAD
2025-10-02T09:33:00.042240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:00.042249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Write session will restart in 0.009951s
2025-10-02T09:33:00.042265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Write session: Do CDS request
2025-10-02T09:33:00.042270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.047714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.049044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.049153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.049160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.049166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.049195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.049222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526149:5625]
2025-10-02T09:33:00.049584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.049763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.049788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.049975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.050006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.050010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.050011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.050011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.050013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.050014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.050015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.050016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.050016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.050017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.050017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.050018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.050021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.050028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.050030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.050033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.050035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.050037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.050039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.050041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.050044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.050046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.050048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.050050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.050054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.050059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.050062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.050065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.050068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.050071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.050073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.050076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.050078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.050081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.050083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.050087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.050091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.050095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.050097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.050100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.050102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.050105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.050107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.050110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.050112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.050115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.050117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.050120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.050137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.053147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.053262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.053273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1763
2025-10-02T09:33:00.053371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.053391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.053397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.053400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.053676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1763 sessionId:  describe result for acl check
2025-10-02T09:33:00.053700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.053705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.053706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.053709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857081939:7786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.054073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857081939:7786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.055433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857081939:7786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.057451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857081939:7786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.057461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857081939:7786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.057463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857081939:7786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.057469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.058052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.059486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.059498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.059499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.059501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.059504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1762 [2:7556555067781526149:5625]
2025-10-02T09:33:00.059511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.059522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.059527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.059530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.059532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.059540Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.059543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.059548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.059580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.059584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.059585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.059587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.059589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.059626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.059631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.059637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.059642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.059653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.059668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857081973:7786], now have 1 active actors on pipe
2025-10-02T09:33:00.059673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857081876:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.059677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.059678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.059679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.059688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.059699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.059700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.059695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1762
2025-10-02T09:33:00.059702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.059698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1762
2025-10-02T09:33:00.059703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.059709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.059711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.059724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.059730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.059730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.059741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.059746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.059771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.059777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.059780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.059781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.059786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.059792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.059801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.059904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.059910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.059919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.059982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1763 partition: 0 MaxSeqNo: 36 sessionId: src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0
2025-10-02T09:33:00.060142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56454c6-69300099-40d60ac6-20de7ab1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.062342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Write session: try to update token
2025-10-02T09:33:00.062352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.069479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.069495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.069496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.069497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.069502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.069505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.069507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526144:5625]
2025-10-02T09:33:00.069528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.069531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.069532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.069533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.069534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.069536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.069637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.073703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId: src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.075804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.142107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857081980:8287]
2025-10-02T09:33:00.142279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1762, pipe: [1:7556555067857081980:8287]
2025-10-02T09:33:00.182236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.182441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.182450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.182472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857081980:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.182592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.182609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857081980:8287]
2025-10-02T09:33:00.182630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.182634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:00.182637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:00.182681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1763 reason: error at write: Disconnected sessionId: src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0
2025-10-02T09:33:00.182818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1763 sessionId: src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0 is DEAD
2025-10-02T09:33:00.182956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:00.182966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Write session will restart in 0.009395s
2025-10-02T09:33:00.182985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Write session: Do CDS request
2025-10-02T09:33:00.182990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.188525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.189740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.189840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.189846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.189852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.189876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.189901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526251:5621]
2025-10-02T09:33:00.190271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.190428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.190449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.190642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.190672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.190676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.190677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.190677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.190678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.190678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.190679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.190679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.190680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.190680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.190681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.190681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.190684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.190691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.190693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.190695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.190697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.190699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.190701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.190703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.190705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.190707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.190709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.190711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.190716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.190729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.190732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.190735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.190737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.190740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.190742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.190745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.190747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.190750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.190751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.190754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.190756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.190759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.190761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.190764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.190766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.190770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.190772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.190774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.190776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.190779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.190781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.190783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.190801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.193098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.193184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.193192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1764
2025-10-02T09:33:00.193264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.193282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.193288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.193291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.193540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1764 sessionId:  describe result for acl check
2025-10-02T09:33:00.193562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.193566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.193567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.193571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857082048:7778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.193904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857082048:7778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.195180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857082048:7778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.197719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857082048:7778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.197726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857082048:7778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.197728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857082048:7778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.197732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.198367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.199795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.199807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.199808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.199810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.199813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1763 [2:7556555067781526251:5621]
2025-10-02T09:33:00.199821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.199831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.199836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.199837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.199838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.199847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.199851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.199855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.199887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.199892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.199893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.199895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.199896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.199932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.199937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.199943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.199948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.199958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.199972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082084:7778], now have 1 active actors on pipe
2025-10-02T09:33:00.199977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857081985:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.199980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.199981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.199982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.199990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.200000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.200002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.200004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.199994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1763
2025-10-02T09:33:00.200005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.199996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1763
2025-10-02T09:33:00.200009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.200011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.200024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.200028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.200029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.200037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.200042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.200068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.200075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.200077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.200078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.200083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.200091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.200100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.200196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.200202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.200213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.200277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1764 partition: 0 MaxSeqNo: 36 sessionId: src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0
2025-10-02T09:33:00.200443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47e02b66-9d439bf6-97ce86b3-778805bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.202619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Write session: try to update token
2025-10-02T09:33:00.202628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.209599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.209613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.209616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.209617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.209621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.209624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.209626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526246:5621]
2025-10-02T09:33:00.209647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.209650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.209651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.209655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.209659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.209662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.209754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.216352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId: src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.218626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.282903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857082094:8287]
2025-10-02T09:33:00.283071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1763, pipe: [1:7556555067857082094:8287]
2025-10-02T09:33:00.319991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.320336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.320348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.320364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082094:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.320499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.320491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857082094:8287]
2025-10-02T09:33:00.320513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.320514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:00.320519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:00.320578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1764 reason: error at write: Disconnected sessionId: src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0
2025-10-02T09:33:00.320712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1764 sessionId: src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0 is DEAD
2025-10-02T09:33:00.320836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:00.320844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Write session will restart in 0.008569s
2025-10-02T09:33:00.320860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Write session: Do CDS request
2025-10-02T09:33:00.320865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.326221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.327443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.327543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.327550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.327555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.327582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.327608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526351:5620]
2025-10-02T09:33:00.327950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.328110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.328132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.328310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.328337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.328341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.328342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.328342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.328343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.328343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.328344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.328344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.328345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.328345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.328346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.328346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.328349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.328356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.328358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.328360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.328362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.328364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.328366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.328367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.328369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.328371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.328374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.328375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.328381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.328385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.328388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.328391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.328394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.328396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.328398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.328401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.328403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.328406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.328408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.328410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.328415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.328418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.328420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.328422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.328428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.328431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.328433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.328435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.328438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.328440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.328442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.328445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.328475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.330146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.330222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.330232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1765
2025-10-02T09:33:00.330309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.330327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.330335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.330338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.330637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1765 sessionId:  describe result for acl check
2025-10-02T09:33:00.330664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.330670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.330672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.330676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857082159:7771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.331081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857082159:7771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.332401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857082159:7771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.335397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857082159:7771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.335405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857082159:7771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.335407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857082159:7771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.335411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.336053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.337482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.337495Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.337496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.337498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.337501Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1764 [2:7556555067781526351:5620]
2025-10-02T09:33:00.337509Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.337519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.337521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.337522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.337523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.337532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.337539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.337543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.337572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.337578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.337579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.337581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.337582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.337617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.337622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.337629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.337635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.337644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.337658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082095:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.337664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082194:7771], now have 1 active actors on pipe
2025-10-02T09:33:00.337668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.337669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.337670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.337677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.337688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.337689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.337691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.337692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.337698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.337699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.337690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1764
2025-10-02T09:33:00.337701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1764
2025-10-02T09:33:00.337713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.337718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.337720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.337730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.337735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.337760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2059507-70367d5e-aec6daec-8c016a31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.337767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.337769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.337770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.337774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.337780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.337789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.337887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.337896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.337906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.337970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1765 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2059507-70367d5e-aec6daec-8c016a31_0
2025-10-02T09:33:00.338142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437dbb71-609cb738-fe3ef7f8-cb143170_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2059507-70367d5e-aec6daec-8c016a31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.340313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Write session: try to update token
2025-10-02T09:33:00.340322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.347580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.347597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.347600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.347603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.347611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.347617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.347621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526346:5620]
2025-10-02T09:33:00.347653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.347662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.347663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.347667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.347673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.347675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.347814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.353528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId: src_id|e2059507-70367d5e-aec6daec-8c016a31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.355547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.420640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857082202:8287]
2025-10-02T09:33:00.420830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1764, pipe: [1:7556555067857082202:8287]
2025-10-02T09:33:00.458329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.458548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.458557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.458570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082202:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.458692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.458704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:00.458715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:00.458746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857082202:8287]
2025-10-02T09:33:00.458762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.458778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1765 reason: error at write: Disconnected sessionId: src_id|e2059507-70367d5e-aec6daec-8c016a31_0
2025-10-02T09:33:00.458930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1765 sessionId: src_id|e2059507-70367d5e-aec6daec-8c016a31_0 is DEAD
2025-10-02T09:33:00.459359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:00.459368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Write session will restart in 0.006090s
2025-10-02T09:33:00.459386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Write session: Do CDS request
2025-10-02T09:33:00.459391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.464724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.465911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.466031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.466038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.466044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.466076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.466102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526450:5614]
2025-10-02T09:33:00.466221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.466330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.466341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1766
2025-10-02T09:33:00.466444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.466448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.466466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.466472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.466475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.466615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.466637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.466759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1766 sessionId:  describe result for acl check
2025-10-02T09:33:00.466783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.466789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.466791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.466795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857082266:7768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.466866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.466914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.466920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.466921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.466922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.466923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.466924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.466925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.466926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.466927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.466928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.466929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.466930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.466932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.466938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.466940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.466943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.466944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.466946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.466948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.466950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.466952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.466954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.466956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.466958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.466962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.466968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.466971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.466974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.466976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.466979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.466981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.466984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.466986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.466989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.466991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.466994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.466996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.467001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.467003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.467006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.467012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.467015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.467017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.467020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.467024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.467027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.467029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.467037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.467071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.467170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857082266:7768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.468644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857082266:7768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.473315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857082266:7768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.473327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857082266:7768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.473330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857082266:7768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.473334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.474627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.476063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.476075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.476076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.476078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.476081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1765 [2:7556555067781526450:5614]
2025-10-02T09:33:00.476088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.476097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.476098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.476099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.476101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.476109Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.476115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.476118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.476149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.476154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.476154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.476156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.476158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.476193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.476198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.476204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.476209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.476220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.476233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082203:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.476238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082303:7768], now have 1 active actors on pipe
2025-10-02T09:33:00.476242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.476243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.476244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.476251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.476258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.476265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.476267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.476268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.476269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.476270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.476266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1765
2025-10-02T09:33:00.476268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1765
2025-10-02T09:33:00.476284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.476285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.476287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.476296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.476298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.476320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.476327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.476329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.476330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.476335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.476339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.476348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.476436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.476442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.476449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.476503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1766 partition: 0 MaxSeqNo: 36 sessionId: src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0
2025-10-02T09:33:00.476716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2059507-70367d5e-aec6daec-8c016a31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.479467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Write session: try to update token
2025-10-02T09:33:00.479482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.485590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.485601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.485602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.485603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.485606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.485608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.485610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526445:5614]
2025-10-02T09:33:00.485627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.485630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.485631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.485631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.485633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.485636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.485739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.491858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId: src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.493951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.558875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857082311:8287]
2025-10-02T09:33:00.559029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1765, pipe: [1:7556555067857082311:8287]
2025-10-02T09:33:00.597866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.598076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.598086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.598098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082311:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.598224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.598271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857082311:8287]
2025-10-02T09:33:00.598278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.598298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:00.598356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1766 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0
2025-10-02T09:33:00.598500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1766 sessionId: src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0 is DEAD
2025-10-02T09:33:00.598665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:00.598679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Write session will restart in 0.006169s
2025-10-02T09:33:00.598700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Write session: Do CDS request
2025-10-02T09:33:00.598706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.604547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.605833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.605932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.605940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.605946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.605971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.605995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526550:5608]
2025-10-02T09:33:00.606183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.606248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.606257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1767
2025-10-02T09:33:00.606331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.606374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.606392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.606398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.606400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.606490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.606512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.606668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1767 sessionId:  describe result for acl check
2025-10-02T09:33:00.606685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.606689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.606693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.606694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.606697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857082376:7763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.606713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.606723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.606724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.606725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.606726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.606727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.606728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.606729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.606729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.606730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.606730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.606731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.606733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.606740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.606742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.606744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.606746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.606748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.606750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.606752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.606754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.606756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.606758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.606760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.606765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.606771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.606776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.606780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.606784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.606788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.606791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.606796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.606803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.606806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.606808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.606810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.606814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.606817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.606819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.606821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.606824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.606826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.606828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.606835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.606837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.606840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.606842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.606844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.606861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.607074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857082376:7763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.608383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857082376:7763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.612115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857082376:7763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.612123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857082376:7763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.612125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857082376:7763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.612128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.614384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.615821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.615834Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.615835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.615837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.615842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1766 [2:7556555067781526550:5608]
2025-10-02T09:33:00.615849Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.615859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.615864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.615866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.615867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.615876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.615881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.615885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.615919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.615925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.615926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.615929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.615930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.615982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.615988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.615994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.615999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.616010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.616021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082413:7763], now have 1 active actors on pipe
2025-10-02T09:33:00.616027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082312:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.616030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.616032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.616034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.616041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.616051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.616053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.616047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1766
2025-10-02T09:33:00.616055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.616056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.616051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1766
2025-10-02T09:33:00.616061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.616063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.616080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.616085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.616086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.616093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.616098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.616120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.616126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.616128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.616130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.616134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.616142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.616154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.616253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.616258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.616265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.616321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1767 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0
2025-10-02T09:33:00.616583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87444b5-776efa34-36fe3fbb-e86f97c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.619415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Write session: try to update token
2025-10-02T09:33:00.619431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.625500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.625512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.625513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.625514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.625518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.625520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.625524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526545:5608]
2025-10-02T09:33:00.625543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.625545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.625546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.625547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.625547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.625550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.625652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.631977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId: src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.634118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.698662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857082420:8287]
2025-10-02T09:33:00.698811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1766, pipe: [1:7556555067857082420:8287]
2025-10-02T09:33:00.736754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.736996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.737006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.737018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082420:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.737198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.737224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857082420:8287]
2025-10-02T09:33:00.737239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:00.737241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:00.737288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1767 reason: error at write: Disconnected sessionId: src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0
2025-10-02T09:33:00.737320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.737434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1767 sessionId: src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0 is DEAD
2025-10-02T09:33:00.737612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:00.737629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Write session will restart in 0.007729s
2025-10-02T09:33:00.737652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Write session: Do CDS request
2025-10-02T09:33:00.737659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.742917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.744119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.744216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.744222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.744228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.744251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.744280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526651:5597]
2025-10-02T09:33:00.744617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.744780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.744810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.744989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.745017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.745021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.745021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.745022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.745022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.745023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.745023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.745024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.745024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.745025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.745025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.745026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.745029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.745035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.745037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.745039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.745041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.745043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.745045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.745047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.745049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.745051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.745053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.745055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.745058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.745062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.745066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.745069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.745071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.745074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.745076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.745079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.745081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.745084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.745086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.745088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.745091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.745093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.745096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.745099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.745101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.745103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.745106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.745109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.745111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.745114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.745116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.745118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.745135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.746178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.746249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.746260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1768
2025-10-02T09:33:00.746355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.746374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.746380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.746382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.746647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1768 sessionId:  describe result for acl check
2025-10-02T09:33:00.746671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.746676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.746677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.746679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857082489:7756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.747048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857082489:7756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.748711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857082489:7756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.752060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857082489:7756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.752071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857082489:7756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.752074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857082489:7756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.752079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.752680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.754162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.754173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.754174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.754176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.754179Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1767 [2:7556555067781526651:5597]
2025-10-02T09:33:00.754186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.754196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.754200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.754202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.754203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.754212Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.754215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.754219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.754251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.754256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.754257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.754259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.754260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.754299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.754303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.754310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.754315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.754325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.754338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082422:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.754343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082524:7756], now have 1 active actors on pipe
2025-10-02T09:33:00.754347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.754348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.754349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.754357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.754368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.754370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.754372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.754373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.754378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.754379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.754378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1767
2025-10-02T09:33:00.754381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1767
2025-10-02T09:33:00.754394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.754399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.754400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.754408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.754413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.754439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.754445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.754447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.754448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.754454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.754461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.754472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.754558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.754563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.754571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.754619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1768 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0
2025-10-02T09:33:00.754877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cf224a-33b3d4e5-baea4e6b-d3bc9360_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.757615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Write session: try to update token
2025-10-02T09:33:00.757629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.763788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.763800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.763802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.763802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.763806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.763808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.763810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526646:5597]
2025-10-02T09:33:00.763828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.763835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.763835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.763837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.763838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.763839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.763950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.770374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId: src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.772518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.837428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857082547:8287]
2025-10-02T09:33:00.837587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1767, pipe: [1:7556555067857082547:8287]
2025-10-02T09:33:00.876560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:00.876797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.876818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.876830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082547:8287], now have 1 active actors on pipe
2025-10-02T09:33:00.876976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857082547:8287]
2025-10-02T09:33:00.876992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:00.877000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:00.877002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:00.877044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1768 reason: error at write: Disconnected sessionId: src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0
2025-10-02T09:33:00.877186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1768 sessionId: src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0 is DEAD
2025-10-02T09:33:00.877353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:00.877367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Write session will restart in 0.008611s
2025-10-02T09:33:00.877389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Write session: Do CDS request
2025-10-02T09:33:00.877399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:00.877552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:00.882603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:00.883747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:00.883848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:00.883854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:00.883860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:00.883884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:00.883907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555067781526801:5582]
2025-10-02T09:33:00.884255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:00.884414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:00.884437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:00.884614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:00.884642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.884646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.884646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.884647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.884647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.884648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.884649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.884649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.884649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.884650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.884650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.884651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.884654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.884660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.884662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.884664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.884666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.884668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.884670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.884672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.884674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.884676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.884678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.884680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.884684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.884688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:00.884692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.884694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:00.884696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.884699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:00.884701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.884704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:00.884706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.884708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:00.884712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.884714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:00.884717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.884719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:00.884721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.884725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:00.884727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.884731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:00.884734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.884737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.884739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.884742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.884744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.884746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.884763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:00.887194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.887450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:00.887459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1769
2025-10-02T09:33:00.887613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:00.887635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:00.887640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:00.887643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:00.887902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1769 sessionId:  describe result for acl check
2025-10-02T09:33:00.887926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:00.887930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:00.887931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:00.887934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555067857082628:7736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:00.888260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555067857082628:7736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:00.889400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555067857082628:7736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:00.891669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555067857082628:7736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:00.891679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555067857082628:7736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:00.891681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555067857082628:7736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:00.891684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:00.892292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:00.893725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:00.893736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:00.893738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:00.893739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:00.893742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1768 [2:7556555067781526801:5582]
2025-10-02T09:33:00.893750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:00.893761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:00.893767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.893768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.893769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.893777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:00.893782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:00.893786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:00.893816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.893820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.893821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.893823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:00.893824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:00.893860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:00.893865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.893872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:00.893877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:00.893888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:00.893901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082663:7736], now have 1 active actors on pipe
2025-10-02T09:33:00.893906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082560:2446], now have 1 active actors on pipe
2025-10-02T09:33:00.893910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.893911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.893913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.893919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:00.893929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:00.893931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:00.893933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:00.893934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:00.893929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1768
2025-10-02T09:33:00.893939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:00.893941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:00.893931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1768
2025-10-02T09:33:00.893954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.893959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:00.893961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:00.893970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.893975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.894037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:00.894044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:00.894047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:00.894048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:00.894053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:00.894061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:00.894073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.894168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:00.894174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:00.894181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:00.894242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1769 partition: 0 MaxSeqNo: 36 sessionId: src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0
2025-10-02T09:33:00.894485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4f7140-7b5cf51e-64b0a4ec-b6de5428_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:00.897354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Write session: try to update token
2025-10-02T09:33:00.897371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:00.903559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:00.903572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:00.903573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:00.903574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:00.903578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.903580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.903582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555067781526796:5582]
2025-10-02T09:33:00.903601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:00.903603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:00.903606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:00.903608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:00.903608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:00.903609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:00.903720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:00.910011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId: src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:00.912033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:00.977178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555067857082685:8287]
2025-10-02T09:33:00.977352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1768, pipe: [1:7556555067857082685:8287]
2025-10-02T09:33:01.014829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.015165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.015175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.015188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555067857082685:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.015400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.015409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.015429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.015456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1769 reason: error at write: Disconnected sessionId: src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0
2025-10-02T09:33:01.015470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555067857082685:8287]
2025-10-02T09:33:01.015552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.015588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1769 sessionId: src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0 is DEAD
2025-10-02T09:33:01.015726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.015735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Write session will restart in 0.006649s
2025-10-02T09:33:01.015750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Write session: Do CDS request
2025-10-02T09:33:01.015755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.020824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.022126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.022234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.022240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.022247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.022274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.022299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494201:5564]
2025-10-02T09:33:01.022645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.022826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.022851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.023033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.023067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.023073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.023074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.023075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.023076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.023077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.023078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.023078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.023079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.023080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.023081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.023081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.023086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.023095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.023098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.023101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.023103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.023106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.023109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.023112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.023115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.023118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.023121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.023124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.023130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.023140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.023149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.023157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.023169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.023165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.023173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.023177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.023182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.023185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.023188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.023190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.023193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.023196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.023199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.023202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.023205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.023208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.023211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.023214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.023218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.023223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.023226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.023230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.023238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.023240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.023249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1770
2025-10-02T09:33:01.023270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.023343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.023361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.023365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.023368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.023610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1770 sessionId:  describe result for acl check
2025-10-02T09:33:01.023634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.023639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.023640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.023643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050051:7729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.023979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050051:7729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.025225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050051:7729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.028546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050051:7729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.028554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050051:7729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.028556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050051:7729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.028559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.030897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.032398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.032411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.032412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.032414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.032417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1769 [2:7556555072076494201:5564]
2025-10-02T09:33:01.032423Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.032432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.032433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.032434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.032435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.032444Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.032447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.032452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.032484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.032489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.032490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.032492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.032493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.032530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.032535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.032542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.032547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.032556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.032571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152049982:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.032575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050090:7729], now have 1 active actors on pipe
2025-10-02T09:33:01.032579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.032582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.032583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.032590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.032594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1769
2025-10-02T09:33:01.032598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.032594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1769
2025-10-02T09:33:01.032604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.032607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.032608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.032609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.032609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.032623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.032626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.032631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.032638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.032641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.032662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.032668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.032671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.032673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.032678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.032683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.032692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.032789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.032794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.032812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.032852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1770 partition: 0 MaxSeqNo: 36 sessionId: src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0
2025-10-02T09:33:01.033087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10084c23-1c56de0a-78dec9a2-45ebf9a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.035789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Write session: try to update token
2025-10-02T09:33:01.035805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.041985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.041997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.041998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.041999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.042003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.042007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.042010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494196:5564]
2025-10-02T09:33:01.042029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.042033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.042034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.042038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.042042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.042045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.042139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.048017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId: src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.050055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.115422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050098:8287]
2025-10-02T09:33:01.115618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1769, pipe: [1:7556555072152050098:8287]
2025-10-02T09:33:01.151724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.151968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.151977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.151989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050098:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.152147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.152156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.152166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.152194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050098:8287]
2025-10-02T09:33:01.152213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1770 reason: error at write: Disconnected sessionId: src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0
2025-10-02T09:33:01.152216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.152341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1770 sessionId: src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0 is DEAD
2025-10-02T09:33:01.152516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.152530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Write session will restart in 0.008890s
2025-10-02T09:33:01.152551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Write session: Do CDS request
2025-10-02T09:33:01.152557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.158282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.159428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.159534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.159541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.159547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.159573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.159597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494304:5575]
2025-10-02T09:33:01.159932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.160092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.160116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.160312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.160341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.160345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.160346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.160346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.160347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.160347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.160348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.160348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.160349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.160349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.160350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.160351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.160353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.160360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.160362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.160364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.160366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.160368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.160370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.160372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.160375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.160377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.160379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.160381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.160384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.160389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.160392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.160395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.160397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.160400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.160402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.160404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.160408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.160410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.160412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.160415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.160417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.160419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.160422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.160425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.160427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.160429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.160431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.160435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.160437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.160440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.160442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.160444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.160461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.162172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.162222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.162230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1771
2025-10-02T09:33:01.162400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.162417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.162423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.162426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.162668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1771 sessionId:  describe result for acl check
2025-10-02T09:33:01.162688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.162692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.162693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.162695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050169:7721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.163030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050169:7721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.164349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050169:7721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.167328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050169:7721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.167338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050169:7721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.167340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050169:7721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.167344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.167990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.169393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.169403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.169405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.169407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.169411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1770 [2:7556555072076494304:5575]
2025-10-02T09:33:01.169418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.169428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.169433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.169434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.169435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.169443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.169446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.169450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.169479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.169484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.169485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.169487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.169488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.169527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.169532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.169538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.169544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.169553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.169565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050099:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.169571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050205:7721], now have 1 active actors on pipe
2025-10-02T09:33:01.169574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.169575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.169576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.169584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.169596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.169596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.169598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.169599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.169606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.169608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.169603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1770
2025-10-02T09:33:01.169603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1770
2025-10-02T09:33:01.169620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.169625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.169626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.169638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.169643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.169669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.169676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.169678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.169679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.169684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.169692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.169702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.169791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.169796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.169804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.169849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1771 partition: 0 MaxSeqNo: 36 sessionId: src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0
2025-10-02T09:33:01.170060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab14b79-627ef3fb-6460f6e9-a568d139_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.172549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Write session: try to update token
2025-10-02T09:33:01.172560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.179270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.179283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.179285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.179286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.179291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.179293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.179297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494299:5575]
2025-10-02T09:33:01.179318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.179321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.179324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.179326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.179326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.179357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.179466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.184270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId: src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.186294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.252124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050215:8287]
2025-10-02T09:33:01.252299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1770, pipe: [1:7556555072152050215:8287]
2025-10-02T09:33:01.289670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.289897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.289908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.289942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050215:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.290080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.290068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.290099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050215:8287]
2025-10-02T09:33:01.290104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.290106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.290154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1771 reason: error at write: Disconnected sessionId: src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0
2025-10-02T09:33:01.290312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1771 sessionId: src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0 is DEAD
2025-10-02T09:33:01.290444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.290454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Write session will restart in 0.008578s
2025-10-02T09:33:01.290487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Write session: Do CDS request
2025-10-02T09:33:01.290492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.296157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.297538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.297657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.297664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.297671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.297701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.297727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494411:5573]
2025-10-02T09:33:01.298069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.298230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.298253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.298487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.298528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.298533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.298533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.298534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.298534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.298535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.298535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.298536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.298536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.298537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.298538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.298538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.298541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.298547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.298549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.298551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.298554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.298556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.298558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.298560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.298562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.298564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.298566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.298568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.298572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.298576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.298580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.298583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.298586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.298588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.298592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.298595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.298597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.298600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.298601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.298604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.298606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.298609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.298611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.298613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.298616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.298618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.298620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.298623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.298625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.298627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.298629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.298633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.298661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.300137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.300195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.300203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1772
2025-10-02T09:33:01.300289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.300307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.300312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.300315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.300569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1772 sessionId:  describe result for acl check
2025-10-02T09:33:01.300590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.300594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.300595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.300598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050287:7714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.300963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050287:7714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.302224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050287:7714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.305586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050287:7714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.305597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050287:7714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.305600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050287:7714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.305605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.306190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.307638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.307650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.307651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.307653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.307656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1771 [2:7556555072076494411:5573]
2025-10-02T09:33:01.307662Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.307671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.307676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.307678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.307679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.307689Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.307691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.307695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.307724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.307728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.307729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.307731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.307732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.307768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.307774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.307781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.307790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.307801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.307815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050322:7714], now have 1 active actors on pipe
2025-10-02T09:33:01.307819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050216:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.307823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.307824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.307824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.307832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.307827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1771
2025-10-02T09:33:01.307836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1771
2025-10-02T09:33:01.307841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.307845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.307846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.307847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.307851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.307853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.307873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.307878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.307887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.307895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.307913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.307917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.307919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.307921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.307922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.307927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.307932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.307947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.308023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.308029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.308036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.308077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1772 partition: 0 MaxSeqNo: 36 sessionId: src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0
2025-10-02T09:33:01.308282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ba87c9-2ef834fa-31c5f30b-ebb3e65b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.311042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Write session: try to update token
2025-10-02T09:33:01.311058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.317252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.317263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.317264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.317265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.317268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.317270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.317272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494406:5573]
2025-10-02T09:33:01.317291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.317294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.317297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.317297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.317298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.317299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.317404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.323027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId: src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.325088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.390358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050330:8287]
2025-10-02T09:33:01.390526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1771, pipe: [1:7556555072152050330:8287]
2025-10-02T09:33:01.431059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.431345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.431355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.431369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050330:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.431557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.431580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.431584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.431608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050330:8287]
2025-10-02T09:33:01.431657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1772 reason: error at write: Disconnected sessionId: src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0
2025-10-02T09:33:01.431705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.431828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1772 sessionId: src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0 is DEAD
2025-10-02T09:33:01.432004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.432018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Write session will restart in 0.006592s
2025-10-02T09:33:01.432040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Write session: Do CDS request
2025-10-02T09:33:01.432045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.437430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.438653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.438760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.438767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.438773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.438800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.438825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494517:5571]
2025-10-02T09:33:01.439156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.439165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.439218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.439230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1773
2025-10-02T09:33:01.439331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.439328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.439348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.439354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.439353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.439357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.439565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.439601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.439605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.439605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.439606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.439606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.439607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.439607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.439608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.439608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.439609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.439609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.439610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.439613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.439619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.439621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.439623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.439625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.439627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.439629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.439631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.439633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.439636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.439637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.439639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.439644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.439649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.439652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.439655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.439657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.439660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.439662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.439665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.439670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.439673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.439675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.439677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.439679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.439673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1773 sessionId:  describe result for acl check
2025-10-02T09:33:01.439685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.439687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.439689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.439691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.439694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.439696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.439698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.439701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.439703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.439693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.439705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.439698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.439708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.439699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.439702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050401:7701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.439724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.440068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050401:7701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.441430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050401:7701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.445942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050401:7701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.445950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050401:7701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.445952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050401:7701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.445955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.447294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.448749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.448760Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.448761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.448763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.448766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1772 [2:7556555072076494517:5571]
2025-10-02T09:33:01.448773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.448783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.448788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.448790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.448791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.448798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.448816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.448824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.448853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.448858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.448859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.448860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.448861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.448897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.448902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.448908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.448913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.448924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.448938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050438:7701], now have 1 active actors on pipe
2025-10-02T09:33:01.448944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050331:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.448947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.448948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.448949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.448956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.448963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.448968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.448970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.448971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.448973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.448974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.448975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1772
2025-10-02T09:33:01.448978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1772
2025-10-02T09:33:01.448988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.448994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.448995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.449003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.449004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.449028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.449035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.449037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.449038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.449042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.449051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.449098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.449191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.449196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.449204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.449261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1773 partition: 0 MaxSeqNo: 36 sessionId: src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0
2025-10-02T09:33:01.449493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38343d8c-25d7cc5a-174f03bb-5a333202_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.452219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Write session: try to update token
2025-10-02T09:33:01.452238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.458373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.458386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.458388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.458389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.458394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.458397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.458400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494512:5571]
2025-10-02T09:33:01.458424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.458427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.458428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.458430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.458431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.458435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.458546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.465955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId: src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.468216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.531686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050445:8287]
2025-10-02T09:33:01.531811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1772, pipe: [1:7556555072152050445:8287]
2025-10-02T09:33:01.569984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.570236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.570245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.570258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050445:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.570404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.570438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.570448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.570448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.570481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050445:8287]
2025-10-02T09:33:01.570496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1773 reason: error at write: Disconnected sessionId: src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0
2025-10-02T09:33:01.570599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1773 sessionId: src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0 is DEAD
2025-10-02T09:33:01.570697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.570706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Write session will restart in 0.009440s
2025-10-02T09:33:01.570727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Write session: Do CDS request
2025-10-02T09:33:01.570732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.576226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.577408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.577510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.577516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.577522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.577549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.577573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494624:5569]
2025-10-02T09:33:01.577951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.578112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.578135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.578316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.578345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.578349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.578350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.578350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.578351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.578351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.578352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.578352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.578353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.578354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.578354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.578355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.578357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.578364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.578367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.578369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.578371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.578373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.578375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.578377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.578379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.578381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.578383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.578385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.578389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.578394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.578397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.578400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.578402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.578406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.578408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.578411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.578413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.578416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.578420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.578422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.578424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.578428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.578430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.578432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.578438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.578441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.578443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.578446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.578449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.578452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.578455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.578458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.578475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.581102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.581237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.581255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1774
2025-10-02T09:33:01.581377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.581404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.581413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.581417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.581724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1774 sessionId:  describe result for acl check
2025-10-02T09:33:01.581752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.581757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.581758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.581761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050523:7692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.582104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050523:7692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.583899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050523:7692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.585788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050523:7692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.585796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050523:7692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.585800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050523:7692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.585804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.586154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.587686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.587699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.587700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.587702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.587705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1773 [2:7556555072076494624:5569]
2025-10-02T09:33:01.587712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.587723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.587728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.587729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.587730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.587740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.587747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.587751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.587780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.587785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.587786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.587788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.587789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.587827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.587832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.587838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.587844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.587855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.587869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050558:7692], now have 1 active actors on pipe
2025-10-02T09:33:01.587874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050450:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.587878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.587879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.587880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.587888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.587895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.587901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.587903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.587904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.587907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.587909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.587901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1773
2025-10-02T09:33:01.587913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1773
2025-10-02T09:33:01.587922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.587927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.587929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.587937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.587939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.587965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.587972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.587975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.587976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.587980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.587988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.588001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.588115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.588119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.588126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.588190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1774 partition: 0 MaxSeqNo: 36 sessionId: src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0
2025-10-02T09:33:01.588457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edf7bfc8-7c697a2e-bbcbad27-b0eac590_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.590908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Write session: try to update token
2025-10-02T09:33:01.590919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.597514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.597531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.597532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.597533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.597537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.597540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.597542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494619:5569]
2025-10-02T09:33:01.597561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.597564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.597565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.597567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.597570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.597572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.597678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.603178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId: src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.605380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.670471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050565:8287]
2025-10-02T09:33:01.670698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1773, pipe: [1:7556555072152050565:8287]
2025-10-02T09:33:01.711280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.711557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.711566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.711580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050565:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.711702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.711723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.711767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:01.711783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050565:8287]
2025-10-02T09:33:01.711827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1774 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0
2025-10-02T09:33:01.711962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1774 sessionId: src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0 is DEAD
2025-10-02T09:33:01.712114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:01.712125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Write session will restart in 0.009825s
2025-10-02T09:33:01.712149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Write session: Do CDS request
2025-10-02T09:33:01.712153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.717410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.718673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.718808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.718817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.718823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.718854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.718875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494732:5567]
2025-10-02T09:33:01.719260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.719448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.719472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.719650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.719679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.719683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.719683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.719684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.719685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.719686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.719686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.719687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.719687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.719688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.719688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.719689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.719692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.719699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.719701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.719703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.719705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.719707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.719709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.719711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.719713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.719715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.719717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.719719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.719724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.719728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.719731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.719734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.719737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.719741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.719744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.719747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.719749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.719751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.719754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.719756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.719758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.719761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.719763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.719765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.719768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.719770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.719772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.719775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.719778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.719781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.719783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.719785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.719801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.723220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.723291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.723305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1775
2025-10-02T09:33:01.723441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.723465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.723474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.723477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.723825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1775 sessionId:  describe result for acl check
2025-10-02T09:33:01.723861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.723867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.723868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.723871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050642:7681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.724309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050642:7681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.725879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050642:7681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.727483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.727826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050642:7681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.727839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050642:7681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.727843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050642:7681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.727848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.729012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.729022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.729024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.729026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.729029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1774 [2:7556555072076494732:5567]
2025-10-02T09:33:01.729038Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.729050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.729055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.729056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.729058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.729069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.729075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.729079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.729115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.729120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.729121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.729123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.729124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.729165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.729170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.729177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.729182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.729193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.729209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050567:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.729216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050676:7681], now have 1 active actors on pipe
2025-10-02T09:33:01.729221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.729226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.729228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.729238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.729242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1774
2025-10-02T09:33:01.729249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1774
2025-10-02T09:33:01.729248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.729252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.729257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.729258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.729262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.729264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.729280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.729285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.729287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.729302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.729308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.729364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f97bc496-3264500d-2f4f466b-d2821b31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.729371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.729374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.729375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.729380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.729386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.729401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.729504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.729511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.729519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.729578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1775 partition: 0 MaxSeqNo: 36 sessionId: src_id|f97bc496-3264500d-2f4f466b-d2821b31_0
2025-10-02T09:33:01.729861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c407ac84-13390dfb-fc87f065-e83a0a87_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f97bc496-3264500d-2f4f466b-d2821b31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.732051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Write session: try to update token
2025-10-02T09:33:01.732062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.738626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.738642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.738643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.738644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.738649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.738652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.738657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494727:5567]
2025-10-02T09:33:01.738678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.738686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.738686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.738689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.738691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.738693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.738820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.743517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId: src_id|f97bc496-3264500d-2f4f466b-d2821b31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.745822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.811879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050684:8287]
2025-10-02T09:33:01.812091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1774, pipe: [1:7556555072152050684:8287]
2025-10-02T09:33:01.852932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.853183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.853193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.853216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050684:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.853325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.853304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050684:8287]
2025-10-02T09:33:01.853333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.853335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.853345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.853383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1775 reason: error at write: Disconnected sessionId: src_id|f97bc496-3264500d-2f4f466b-d2821b31_0
2025-10-02T09:33:01.853528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1775 sessionId: src_id|f97bc496-3264500d-2f4f466b-d2821b31_0 is DEAD
2025-10-02T09:33:01.853641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.853649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Write session will restart in 0.005234s
2025-10-02T09:33:01.853664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Write session: Do CDS request
2025-10-02T09:33:01.853667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.858976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:01.860050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:01.860212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.860206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:01.860213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:01.860219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:01.860249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:01.860272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555072076494866:5562]
2025-10-02T09:33:01.860552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:01.860563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1776
2025-10-02T09:33:01.860653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:01.860674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:01.860683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:01.860686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:01.860678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:01.860877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:01.860915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:01.860938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1776 sessionId:  describe result for acl check
2025-10-02T09:33:01.860965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:01.860973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:01.860975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:01.860979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555072152050778:7674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:01.861183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:01.861236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.861241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.861242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.861243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.861244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.861245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.861246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.861247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.861248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.861249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.861250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.861251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.861256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.861265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.861269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.861273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.861276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.861279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.861282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.861285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.861290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.861293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.861297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.861303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.861308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.861316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:01.861322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.861327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:01.861336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.861347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:01.861354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.861345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555072152050778:7674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:01.861358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:01.861362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.861366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:01.861369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.861375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:01.861378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.861382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:01.861385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.861391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:01.861395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.861403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:01.861406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.861413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.861417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.861422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.861426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.861430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.861459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:01.862800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555072152050778:7674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:01.866775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555072152050778:7674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:01.866785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555072152050778:7674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:01.866786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555072152050778:7674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:01.866790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:01.869012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:01.870553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:01.870565Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:01.870567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:01.870569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:01.870572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1775 [2:7556555072076494866:5562]
2025-10-02T09:33:01.870580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:01.870589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:01.870595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.870596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.870598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.870609Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:01.870613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:01.870618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:01.870654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.870659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.870660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.870662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:01.870663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:01.870700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:01.870705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.870711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:01.870727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:01.870741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:01.870758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050813:7674], now have 1 active actors on pipe
2025-10-02T09:33:01.870767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050692:2446], now have 1 active actors on pipe
2025-10-02T09:33:01.870771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.870776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.870777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.870787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:01.870798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:01.870800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:01.870807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:01.870808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:01.870811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:01.870814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:01.870811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1775
2025-10-02T09:33:01.870832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.870833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1775
2025-10-02T09:33:01.870839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:01.870840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:01.870849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.870853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.870910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:01.870918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:01.870920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:01.870921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:01.870926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:01.870932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:01.870945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.871045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.871050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.871057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:01.871121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1776 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0
2025-10-02T09:33:01.871347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f97bc496-3264500d-2f4f466b-d2821b31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:01.873489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Write session: try to update token
2025-10-02T09:33:01.873498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:01.880224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:01.880242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:01.880243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:01.880245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:01.880250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.880252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.880254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494861:5562]
2025-10-02T09:33:01.880276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:01.880276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:01.880281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:01.880282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:01.880283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:01.880283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:01.880408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:01.885088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId: src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:01.887183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:01.953571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555072152050846:8287]
2025-10-02T09:33:01.953726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1775, pipe: [1:7556555072152050846:8287]
2025-10-02T09:33:01.993353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:01.993656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:01.993669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:01.993704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050846:8287], now have 1 active actors on pipe
2025-10-02T09:33:01.993864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:01.993887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:01.993900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:01.993901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555072152050846:8287]
2025-10-02T09:33:01.993916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:01.993948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1776 reason: error at write: Disconnected sessionId: src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0
2025-10-02T09:33:01.994107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1776 sessionId: src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0 is DEAD
2025-10-02T09:33:01.994240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:01.994254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Write session will restart in 0.007521s
2025-10-02T09:33:01.994295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Write session: Do CDS request
2025-10-02T09:33:01.994319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:01.999600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.000855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.000952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.000959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.000964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.000989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.001013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462296:5539]
2025-10-02T09:33:02.001355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.001516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.001537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.001710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.001740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.001744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.001745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.001746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.001747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.001748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.001749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.001750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.001751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.001752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.001753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.001753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.001757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.001766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.001770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.001773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.001775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.001777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.001779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.001781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.001783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.001785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.001787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.001789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.001793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.001797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.001801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.001808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.001810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.001813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.001818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.001821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.001823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.001826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.001831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.001835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.001837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.001840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.001842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.001845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.001847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.001850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.001852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.001854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.001856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.001859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.001861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.001864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.001879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.003160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.003394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.003404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1777
2025-10-02T09:33:02.003493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.003513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.003519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.003522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.003787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1777 sessionId:  describe result for acl check
2025-10-02T09:33:02.003810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.003815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.003816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.003818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018219:7666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.004147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018219:7666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.005596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018219:7666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.008798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018219:7666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.008821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018219:7666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.008823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018219:7666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.008831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.009370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.010827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.010840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.010842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.010844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.010847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1776 [2:7556555076371462296:5539]
2025-10-02T09:33:02.010854Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.010864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.010866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.010868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.010869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.010877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.010883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.010888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.010918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.010924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.010925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.010928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.010930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.010974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.010980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.010986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.010991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.011003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.011017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555072152050847:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.011022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018253:7666], now have 1 active actors on pipe
2025-10-02T09:33:02.011026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.011027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.011028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.011036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.011047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.011050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.011052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.011035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1776
2025-10-02T09:33:02.011038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1776
2025-10-02T09:33:02.011053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.011058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.011059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.011082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.011087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.011095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.011101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.011113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.011117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.011121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.011123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.011126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.011130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.011136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.011150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.011233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.011238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.011246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.011294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1777 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0
2025-10-02T09:33:02.011486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce1508b6-fdce7392-7ad43f19-bfc5d6e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.013639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Write session: try to update token
2025-10-02T09:33:02.013649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.020762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.020780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.020783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.020785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.020792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.020796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.020813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555072076494995:5539]
2025-10-02T09:33:02.020841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.020842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.020848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.020850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.020850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.020852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.020981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.025798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId: src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.028057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.093863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447018262:8287]
2025-10-02T09:33:02.094059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1776, pipe: [1:7556555076447018262:8287]
2025-10-02T09:33:02.135305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.135626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.135635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.135662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018262:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.135787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.135826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.135859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447018262:8287]
2025-10-02T09:33:02.135864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:02.135918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1777 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0
2025-10-02T09:33:02.136059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1777 sessionId: src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0 is DEAD
2025-10-02T09:33:02.136254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:02.136269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Write session will restart in 0.006322s
2025-10-02T09:33:02.136292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Write session: Do CDS request
2025-10-02T09:33:02.136298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.141893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.143117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.143176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.143206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.143218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.143216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1778
2025-10-02T09:33:02.143225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.143230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.143257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.143287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462407:5543]
2025-10-02T09:33:02.143388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.143406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.143412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.143415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.143636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.143683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1778 sessionId:  describe result for acl check
2025-10-02T09:33:02.143706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.143710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.143711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.143714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018336:7658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.143801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.143826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.144002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.144031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.144035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.144036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.144036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.144037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.144038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.144039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.144040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.144041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.144042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.144042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018336:7658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.144043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.144044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.144048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.144057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.144061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.144067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.144069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.144071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.144073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.144075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.144077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.144079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.144081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.144084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.144088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.144093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.144096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.144099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.144101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.144105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.144107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.144110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.144112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.144114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.144116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.144118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.144120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.144127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.144129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.144132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.144135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.144138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.144140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.144143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.144146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.144149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.144151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.144154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.144170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.145453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018336:7658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.149501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018336:7658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.149510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018336:7658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.149512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018336:7658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.149515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.151724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.153190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.153200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.153201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.153203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.153206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1777 [2:7556555076371462407:5543]
2025-10-02T09:33:02.153213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.153223Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.153225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.153226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.153228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.153236Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.153243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.153247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.153284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.153291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.153292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.153294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.153296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.153333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.153337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.153344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.153349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.153358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.153371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018375:7658], now have 1 active actors on pipe
2025-10-02T09:33:02.153377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018263:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.153380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.153382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.153383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.153390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.153397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.153407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.153407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.153409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.153411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.153413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.153426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.153428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.153411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1777
2025-10-02T09:33:02.153432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1777
2025-10-02T09:33:02.153435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.153441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.153443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.153460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b336ec88-9434de21-5f6fe60e-e011d824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.153467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.153469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.153470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.153475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.153481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.153491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.153571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.153576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.153584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.153638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1778 partition: 0 MaxSeqNo: 36 sessionId: src_id|b336ec88-9434de21-5f6fe60e-e011d824_0
2025-10-02T09:33:02.153834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c74770-46117e1f-ce8f0dcf-fd1f57ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b336ec88-9434de21-5f6fe60e-e011d824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.155974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Write session: try to update token
2025-10-02T09:33:02.155985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.163284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.163305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.163308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.163310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.163317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.163324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.163332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371462402:5543]
2025-10-02T09:33:02.163365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.163365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.163367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.163370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.163375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.163377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.163502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.167702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId: src_id|b336ec88-9434de21-5f6fe60e-e011d824_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.169808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.236194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447018385:8287]
2025-10-02T09:33:02.236366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1777, pipe: [1:7556555076447018385:8287]
2025-10-02T09:33:02.275560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.275806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.275815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.275839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018385:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.275955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.275991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:02.276003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:02.276019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447018385:8287]
2025-10-02T09:33:02.276048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.276050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1778 reason: error at write: Disconnected sessionId: src_id|b336ec88-9434de21-5f6fe60e-e011d824_0
2025-10-02T09:33:02.276192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1778 sessionId: src_id|b336ec88-9434de21-5f6fe60e-e011d824_0 is DEAD
2025-10-02T09:33:02.276355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:02.276369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Write session will restart in 0.007305s
2025-10-02T09:33:02.276390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Write session: Do CDS request
2025-10-02T09:33:02.276396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.282188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.283381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.283483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.283489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.283494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.283519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.283542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462521:5534]
2025-10-02T09:33:02.283899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.284084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.284113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.284295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.284324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.284329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.284330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.284331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.284332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.284333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.284333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.284334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.284335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.284336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.284337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.284338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.284342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.284352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.284355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.284360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.284362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.284364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.284366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.284368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.284370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.284372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.284374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.284375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.284379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.284383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.284386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.284389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.284391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.284393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.284395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.284398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.284400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.284403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.284405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.284408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.284410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.284413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.284415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.284418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.284424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.284426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.284429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.284431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.284435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.284437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.284442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.284446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.284462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.285160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.285198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.285208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1779
2025-10-02T09:33:02.285408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.285428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.285431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.285438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.285736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1779 sessionId:  describe result for acl check
2025-10-02T09:33:02.285769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.285774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.285775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.285778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018464:7652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.286130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018464:7652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.287812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018464:7652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.291308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018464:7652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.291317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018464:7652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.291319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018464:7652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.291322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.291863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.293267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.293278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.293279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.293281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.293284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1778 [2:7556555076371462521:5534]
2025-10-02T09:33:02.293349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.293361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.293363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.293364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.293366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.293374Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.293377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.293381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.293411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.293417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.293418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.293419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.293421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.293454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.293459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.293466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.293471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.293482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.293492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018499:7652], now have 1 active actors on pipe
2025-10-02T09:33:02.293497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018386:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.293500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.293501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.293502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.293509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.293517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.293521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.293523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.293524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.293524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.293525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.293539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.293540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.293542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.293525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1778
2025-10-02T09:33:02.293530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1778
2025-10-02T09:33:02.293555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.293562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.293584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.293592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.293594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.293595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.293600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.293605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.293622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.293736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.293743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.293751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.293818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1779 partition: 0 MaxSeqNo: 36 sessionId: src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0
2025-10-02T09:33:02.294017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b336ec88-9434de21-5f6fe60e-e011d824_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.296133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Write session: try to update token
2025-10-02T09:33:02.296142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.303305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.303323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.303329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.303332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.303340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.303343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.303347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371462516:5534]
2025-10-02T09:33:02.303374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.303383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.303385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.303385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.303391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.303402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.303542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.307432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId: src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.309532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.375961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447018507:8287]
2025-10-02T09:33:02.376118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1778, pipe: [1:7556555076447018507:8287]
2025-10-02T09:33:02.414383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.414660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.414668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.414693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018507:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.414828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.415239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:02.415249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Write session will restart in 0.005244s
2025-10-02T09:33:02.415265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Write session: Do CDS request
2025-10-02T09:33:02.415270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.414926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447018507:8287]
2025-10-02T09:33:02.414932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:02.414954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.414986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0
2025-10-02T09:33:02.415121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1779 sessionId: src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0 is DEAD
2025-10-02T09:33:02.421194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.421257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.421307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.421315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1780
2025-10-02T09:33:02.421403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.421431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.421437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.421439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.421702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1780 sessionId:  describe result for acl check
2025-10-02T09:33:02.421724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.421729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.421730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.421734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018582:7642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.422139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018582:7642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.422507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.422614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.422621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.422627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.422655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.422677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462634:5529]
2025-10-02T09:33:02.423025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.423180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.423201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.423373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.423402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.423406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.423406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.423407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.423408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.423408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.423409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.423409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.423410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.423410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.423411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.423412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.423414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.423420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.423422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.423424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.423426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.423428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.423430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.423432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.423434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.423436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.423438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.423440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.423445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.423449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.423452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.423455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.423457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.423459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.423465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.423467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.423470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.423462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018582:7642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.423473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.423478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.423480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.423483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.423486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.423488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.423490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.423493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.423495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.423497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.423504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.423505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.423508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.423510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.423515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.423532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.428333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018582:7642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.428343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018582:7642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.428346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018582:7642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.428351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.430955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.432424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.432433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.432434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.432436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.432439Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1779 [2:7556555076371462634:5529]
2025-10-02T09:33:02.432445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.432456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.432457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.432458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.432459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.432468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.432471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.432475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.432504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.432509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.432510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.432512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.432514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.432550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.432554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.432560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.432566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.432577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.432590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018622:7642], now have 1 active actors on pipe
2025-10-02T09:33:02.432595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018508:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.432599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.432600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.432601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.432609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.432618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.432622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.432624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.432625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.432627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.432628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.432620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1779
2025-10-02T09:33:02.432640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.432645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.432625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1779
2025-10-02T09:33:02.432646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.432654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.432658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.432682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f634be01-fcc4dd43-abe2a04d-19604799_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.432689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.432691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.432693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.432697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.432705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.432715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.432796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.432810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.432821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.432880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1780 partition: 0 MaxSeqNo: 36 sessionId: src_id|f634be01-fcc4dd43-abe2a04d-19604799_0
2025-10-02T09:33:02.433079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|938296cb-9e70a15c-3a90a7bc-780e0115_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f634be01-fcc4dd43-abe2a04d-19604799_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.435218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Write session: try to update token
2025-10-02T09:33:02.435228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.441751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.441765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.441766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.441769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.441773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.441777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.441778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371462629:5529]
2025-10-02T09:33:02.441801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.441804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.441805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.441805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.441807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.441809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.441924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.446401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId: src_id|f634be01-fcc4dd43-abe2a04d-19604799_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.448542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.515242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447018629:8287]
2025-10-02T09:33:02.515425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1779, pipe: [1:7556555076447018629:8287]
2025-10-02T09:33:02.551472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.551696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.551705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.551729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018629:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.551865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.551866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:02.551878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:02.551887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447018629:8287]
2025-10-02T09:33:02.551902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.551925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1780 reason: error at write: Disconnected sessionId: src_id|f634be01-fcc4dd43-abe2a04d-19604799_0
2025-10-02T09:33:02.552065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1780 sessionId: src_id|f634be01-fcc4dd43-abe2a04d-19604799_0 is DEAD
2025-10-02T09:33:02.552219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:02.552227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Write session will restart in 0.009553s
2025-10-02T09:33:02.552242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Write session: Do CDS request
2025-10-02T09:33:02.552247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.557494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.558665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.558784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.558790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.558796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.558824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.558847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462748:5526]
2025-10-02T09:33:02.559187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.559348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.559371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.559544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.559572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.559575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.559576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.559576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.559577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.559577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.559578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.559578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.559579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.559579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.559580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.559580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.559583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.559590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.559592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.559594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.559596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.559598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.559600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.559602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.559604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.559606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.559608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.559610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.559615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.559619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.559622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.559625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.559628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.559631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.559633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.559636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.559638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.559641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.559643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.559645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.559648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.559650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.559652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.559656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.559658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.559661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.559663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.559665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.559668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.559671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.559675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.559677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.559694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.563202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.563311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.563321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1781
2025-10-02T09:33:02.563405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.563431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.563438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.563441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.563703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1781 sessionId:  describe result for acl check
2025-10-02T09:33:02.563724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.563729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.563730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.563733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018712:7635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.564075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018712:7635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.565248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018712:7635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.566765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018712:7635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.566773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018712:7635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.566775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018712:7635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.566781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.567164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.568578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.568588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.568590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.568591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.568595Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1780 [2:7556555076371462748:5526]
2025-10-02T09:33:02.568602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.568611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.568613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.568614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.568616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.568625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.568633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.568637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.568669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.568674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.568675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.568677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.568678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.568714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.568718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.568724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.568729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.568737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.568750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018746:7635], now have 1 active actors on pipe
2025-10-02T09:33:02.568755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018631:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.568759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.568760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.568761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.568768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.568778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.568780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.568783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.568784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.568787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.568788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.568786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1780
2025-10-02T09:33:02.568790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1780
2025-10-02T09:33:02.568817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.568822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.568828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.568832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.568835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.568856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.568863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.568865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.568866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.568870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.568879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.568890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.568974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.568979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.568986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.569033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1781 partition: 0 MaxSeqNo: 36 sessionId: src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0
2025-10-02T09:33:02.569254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f634be01-fcc4dd43-abe2a04d-19604799_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.571954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Write session: try to update token
2025-10-02T09:33:02.571969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.577905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.577916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.577917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.577918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.577923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.577925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.577926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371462743:5526]
2025-10-02T09:33:02.577947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.577947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.577949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.577952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.577952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.577953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.578062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.584910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId: src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.586924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.651953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447018753:8287]
2025-10-02T09:33:02.652150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1780, pipe: [1:7556555076447018753:8287]
2025-10-02T09:33:02.689757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.690003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.690012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.690024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018753:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.690141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.690145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:02.690156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:02.690183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447018753:8287]
2025-10-02T09:33:02.690198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.690205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1781 reason: error at write: Disconnected sessionId: src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0
2025-10-02T09:33:02.690349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1781 sessionId: src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0 is DEAD
2025-10-02T09:33:02.690533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:02.690545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Write session will restart in 0.006357s
2025-10-02T09:33:02.690569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Write session: Do CDS request
2025-10-02T09:33:02.690575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.696110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.697342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.697438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.697445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.697450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.697475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.697497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462862:5512]
2025-10-02T09:33:02.697836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.697988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.698011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.698119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.698185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.698213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.698217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.698218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.698218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.698219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.698220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.698220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.698221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.698221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.698222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.698230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1782
2025-10-02T09:33:02.698222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.698223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.698223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.698226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.698233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.698235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.698237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.698239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.698241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.698243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.698245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.698247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.698249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.698252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.698254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.698258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.698262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.698265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.698268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.698271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.698273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.698275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.698278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.698280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.698282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.698285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.698287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.698289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.698291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.698293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.698296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.698298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.698300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.698302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.698305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.698307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.698310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.698316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.698318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.698328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.698333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.698346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.698352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.698355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.698649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1782 sessionId:  describe result for acl check
2025-10-02T09:33:02.698673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.698674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.698675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.698678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018835:7627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.699039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018835:7627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.700344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018835:7627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.704648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018835:7627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.704656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018835:7627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.704658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018835:7627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.704662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.705849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.707260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.707272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.707274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.707277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.707280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1781 [2:7556555076371462862:5512]
2025-10-02T09:33:02.707286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.707295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.707296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.707298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.707299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.707307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.707310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.707313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.707342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.707347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.707348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.707349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.707351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.707385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.707390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.707396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.707401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.707408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.707422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018754:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.707427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018871:7627], now have 1 active actors on pipe
2025-10-02T09:33:02.707430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.707432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.707433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.707443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.707450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.707457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.707459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.707460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.707460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.707461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.707452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1781
2025-10-02T09:33:02.707477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.707460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1781
2025-10-02T09:33:02.707481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.707483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.707491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.707493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.707517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.707524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.707525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.707526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.707531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.707536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.707546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.707637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.707642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.707649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.707696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1782 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0
2025-10-02T09:33:02.707920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcca33-a88e1260-d5f169ff-4f91d712_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.710541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Write session: try to update token
2025-10-02T09:33:02.710555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.716503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.716514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.716515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.716516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.716519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.716522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.716525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371462857:5512]
2025-10-02T09:33:02.716545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.716547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.716548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.716550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.716553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.716555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.716668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.723720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId: src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.725825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.790167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447018878:8287]
2025-10-02T09:33:02.790357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1781, pipe: [1:7556555076447018878:8287]
2025-10-02T09:33:02.828091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.828327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.828336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.828348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018878:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.828512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.828537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.828569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:02.828572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447018878:8287]
2025-10-02T09:33:02.828630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1782 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0
2025-10-02T09:33:02.828774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1782 sessionId: src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0 is DEAD
2025-10-02T09:33:02.828956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:02.828972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Write session will restart in 0.006767s
2025-10-02T09:33:02.828994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Write session: Do CDS request
2025-10-02T09:33:02.828999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.834630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.835850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.835942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.835949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.835954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.835979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.836003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371462989:5510]
2025-10-02T09:33:02.836336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.836518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.836539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.836710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.836736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.836740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.836741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.836742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.836742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.836743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.836744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.836745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.836745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.836746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.836746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.836747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.836750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.836755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.836758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.836761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.836763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.836765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.836767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.836769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.836771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.836773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.836775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.836776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.836780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.836783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.836787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.836789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.836791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.836794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.836796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.836798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.836811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.836813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.836815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.836818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.836820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.836823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.836825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.836827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.836830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.836832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.836834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.836837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.836839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.836841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.836843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.836846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.836862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.837184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.837267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.837275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1783
2025-10-02T09:33:02.837394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.837411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.837414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.837416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.837640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1783 sessionId:  describe result for acl check
2025-10-02T09:33:02.837658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.837662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.837663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.837666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447018964:7626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.837940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447018964:7626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.838904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447018964:7626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.843032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447018964:7626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.843040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447018964:7626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.843043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447018964:7626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.843046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.844226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.845734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.845744Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.845745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.845747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.845750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1782 [2:7556555076371462989:5510]
2025-10-02T09:33:02.845757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.845766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.845767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.845769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.845770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.845777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.845783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.845787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.845816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.845821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.845822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.845824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.845825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.845862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.845867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.845873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.845878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.845886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.845897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447018882:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.845902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447019003:7626], now have 1 active actors on pipe
2025-10-02T09:33:02.845905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.845906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.845907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.845914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.845922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.845925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.845927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.845929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.845932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.845923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1782
2025-10-02T09:33:02.845934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.845947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.845929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1782
2025-10-02T09:33:02.845949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.845950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.845960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.845961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.845982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc8c726e-a730e947-e00053a7-43cab70e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.845989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.845991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.845992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.845997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.846002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.846013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.846113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.846118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.846126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.846167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1783 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc8c726e-a730e947-e00053a7-43cab70e_0
2025-10-02T09:33:02.846398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ee1cc62-6ac6c60-55ac8714-bda5fde6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc8c726e-a730e947-e00053a7-43cab70e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.849052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Write session: try to update token
2025-10-02T09:33:02.849066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.854939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.854949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.854950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.854951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.854956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.854959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.854961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371462984:5510]
2025-10-02T09:33:02.854979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.854981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.854982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.854982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.854985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.854986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.855082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:02.861623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId: src_id|bc8c726e-a730e947-e00053a7-43cab70e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:02.863747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:02.928910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555076447019048:8287]
2025-10-02T09:33:02.929034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1782, pipe: [1:7556555076447019048:8287]
2025-10-02T09:33:02.968851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:02.969117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.969126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.969138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447019048:8287], now have 1 active actors on pipe
2025-10-02T09:33:02.969284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:02.969284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555076447019048:8287]
2025-10-02T09:33:02.969306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:02.969311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:02.969313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:02.969366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1783 reason: error at write: Disconnected sessionId: src_id|bc8c726e-a730e947-e00053a7-43cab70e_0
2025-10-02T09:33:02.969514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1783 sessionId: src_id|bc8c726e-a730e947-e00053a7-43cab70e_0 is DEAD
2025-10-02T09:33:02.969685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:02.969699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Write session will restart in 0.006461s
2025-10-02T09:33:02.969720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Write session: Do CDS request
2025-10-02T09:33:02.969726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:02.975507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:02.976739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:02.976867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:02.976873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:02.976879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:02.976908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:02.976931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555076371463143:5489]
2025-10-02T09:33:02.977157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.977266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:02.977402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:02.977410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1784
2025-10-02T09:33:02.977437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:02.977459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:02.977498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:02.977517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:02.977522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:02.977525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:02.977636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:02.977665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.977669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.977669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.977670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.977671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.977671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.977672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.977672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.977673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.977673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.977674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.977674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.977677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.977684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.977686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.977688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.977690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.977692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.977694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.977696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.977698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.977700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.977702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.977704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.977707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.977711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:02.977714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.977717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:02.977719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.977722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:02.977725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.977727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:02.977730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.977732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:02.977734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.977737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:02.977739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.977742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:02.977744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.977746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:02.977748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.977751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:02.977753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.977756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.977760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.977762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.977764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.977766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.977783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:02.977783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1784 sessionId:  describe result for acl check
2025-10-02T09:33:02.977810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:02.977816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:02.977817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:02.977821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555076447019130:7608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:02.978175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555076447019130:7608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:02.979472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555076447019130:7608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:02.982994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555076447019130:7608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:02.983002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555076447019130:7608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:02.983004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555076447019130:7608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:02.983008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:02.985099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:02.986560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:02.986571Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:02.986572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:02.986574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:02.986577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1783 [2:7556555076371463143:5489]
2025-10-02T09:33:02.986584Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:02.986594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:02.986599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.986600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.986602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.986611Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:02.986616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:02.986620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:02.986650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.986655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.986656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.986658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:02.986659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:02.986697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:02.986702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.986708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:02.986724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:02.986735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:02.986751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447019167:7608], now have 1 active actors on pipe
2025-10-02T09:33:02.986753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555076447019049:2446], now have 1 active actors on pipe
2025-10-02T09:33:02.986757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.986758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.986759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.986767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:02.986777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:02.986780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:02.986782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:02.986783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:02.986787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:02.986790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:02.986784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1783
2025-10-02T09:33:02.986787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1783
2025-10-02T09:33:02.986805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.986810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:02.986812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:02.986819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.986823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.986850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:02.986857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:02.986861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:02.986862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:02.986866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:02.986874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:02.986886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.986971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:02.986976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:02.986984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:02.987032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1784 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0
2025-10-02T09:33:02.987259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c726e-a730e947-e00053a7-43cab70e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:02.989940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Write session: try to update token
2025-10-02T09:33:02.989955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:02.995843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:02.995854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:02.995855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:02.995857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:02.995861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.995863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.995864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555076371463138:5489]
2025-10-02T09:33:02.995883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:02.995886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:02.995888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:02.995890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:02.995891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:02.995893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:02.996015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.001802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId: src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.003813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.069213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741986471:8287]
2025-10-02T09:33:03.069383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1783, pipe: [1:7556555080741986471:8287]
2025-10-02T09:33:03.104954Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.105174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.105183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.105195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986471:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.105340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.105358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741986471:8287]
2025-10-02T09:33:03.105369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.105381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:03.105435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1784 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0
2025-10-02T09:33:03.105555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1784 sessionId: src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0 is DEAD
2025-10-02T09:33:03.105716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:03.105731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Write session will restart in 0.007112s
2025-10-02T09:33:03.105770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Write session: Do CDS request
2025-10-02T09:33:03.105776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.111353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.112660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.112761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.112767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.112772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.112797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.112835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666430559:5479]
2025-10-02T09:33:03.113168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.113339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.113361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.113532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.113559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.113563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.113563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.113564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.113564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.113565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.113565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.113566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.113566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.113567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.113567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.113568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.113570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.113577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.113579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.113581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.113583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.113585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.113587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.113589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.113591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.113593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.113595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.113597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.113601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.113605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.113608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.113611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.113613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.113616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.113618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.113621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.113623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.113625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.113627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.113630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.113632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.113634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.113636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.113639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.113641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.113644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.113645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.113648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.113650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.113653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.113655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.113658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.113678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.114168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.114261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.114270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1785
2025-10-02T09:33:03.114380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.114397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.114401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.114404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.114655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1785 sessionId:  describe result for acl check
2025-10-02T09:33:03.114677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.114681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.114682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.114685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741986556:7605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.115042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741986556:7605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.116629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741986556:7605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.120483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741986556:7605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.120491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741986556:7605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.120493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741986556:7605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.120497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.121023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.122479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.122489Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.122490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.122492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.122495Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1784 [2:7556555080666430559:5479]
2025-10-02T09:33:03.122503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.122516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.122518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.122519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.122520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.122529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.122532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.122536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.122567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.122571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.122573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.122575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.122576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.122612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.122617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.122623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.122628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.122637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.122657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986591:7605], now have 1 active actors on pipe
2025-10-02T09:33:03.122659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986472:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.122663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.122664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.122665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.122672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.122679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.122686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.122688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.122689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.122689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.122690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.122704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.122706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1784
2025-10-02T09:33:03.122707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.122708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.122726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1784
2025-10-02T09:33:03.122742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.122746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.122761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|383a02f3-fed91c66-4ab95881-58c820e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.122768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.122771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.122772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.122778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.122783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.122791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.122882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.122887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.122894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.122951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1785 partition: 0 MaxSeqNo: 36 sessionId: src_id|383a02f3-fed91c66-4ab95881-58c820e9_0
2025-10-02T09:33:03.123205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b7f5e4-b72c6917-805d1ec6-2cd2caae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|383a02f3-fed91c66-4ab95881-58c820e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.125938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Write session: try to update token
2025-10-02T09:33:03.125958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.131669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.131678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.131680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.131682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.131686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.131688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.131690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666430554:5479]
2025-10-02T09:33:03.131706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.131709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.131710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.131710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.131713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.131715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.131834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.138138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId: src_id|383a02f3-fed91c66-4ab95881-58c820e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.140264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.205404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741986599:8287]
2025-10-02T09:33:03.205529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1784, pipe: [1:7556555080741986599:8287]
2025-10-02T09:33:03.240655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.240908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.240917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.240930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986599:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.241072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.241072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741986599:8287]
2025-10-02T09:33:03.241084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:03.241086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:03.241092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.241155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1785 reason: error at write: Disconnected sessionId: src_id|383a02f3-fed91c66-4ab95881-58c820e9_0
2025-10-02T09:33:03.241291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1785 sessionId: src_id|383a02f3-fed91c66-4ab95881-58c820e9_0 is DEAD
2025-10-02T09:33:03.241436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:03.241450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Write session will restart in 0.006400s
2025-10-02T09:33:03.241472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Write session: Do CDS request
2025-10-02T09:33:03.241478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.246891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.248099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.248194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.248201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.248207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.248232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.248253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666430678:5477]
2025-10-02T09:33:03.248588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.248756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.248778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.248966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.248996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.248999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.249000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.249001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.249001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.249002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.249002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.249003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.249003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.249004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.249004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.249005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.249007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.249014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.249016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.249018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.249020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.249022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.249024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.249026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.249028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.249030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.249032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.249034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.249038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.249041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.249044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.249047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.249050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.249052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.249055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.249057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.249059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.249062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.249064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.249066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.249069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.249073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.249075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.249078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.249080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.249086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.249088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.249091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.249096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.249099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.249101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.249104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.249119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.249155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.249237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.249244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1786
2025-10-02T09:33:03.249330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.249349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.249352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.249355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.249601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1786 sessionId:  describe result for acl check
2025-10-02T09:33:03.249619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.249623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.249624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.249627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741986687:7595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.249949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741986687:7595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.251306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741986687:7595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.255239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741986687:7595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.255247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741986687:7595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.255249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741986687:7595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.255253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.256462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.257876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.257887Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.257888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.257890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.257894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1785 [2:7556555080666430678:5477]
2025-10-02T09:33:03.257901Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.257911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.257915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.257917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.257918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.257927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.257931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.257937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.257966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.257971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.257972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.257974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.257975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.258011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.258015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.258022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.258028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.258039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.258053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986602:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.258058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986722:7595], now have 1 active actors on pipe
2025-10-02T09:33:03.258062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.258063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.258064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.258071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.258078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.258085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.258087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.258088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.258088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.258089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.258095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1785
2025-10-02T09:33:03.258101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.258106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1785
2025-10-02T09:33:03.258106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.258109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.258127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.258132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.258146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.258152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.258154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.258155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.258161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.258168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.258175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.258272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.258276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.258284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.258348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1786 partition: 0 MaxSeqNo: 36 sessionId: src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0
2025-10-02T09:33:03.258580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383a02f3-fed91c66-4ab95881-58c820e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.261266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Write session: try to update token
2025-10-02T09:33:03.261280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.267104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.267114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.267115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.267116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.267119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.267123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.267125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666430673:5477]
2025-10-02T09:33:03.267143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.267146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.267146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.267147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.267148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.267152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.267257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.273450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId: src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.275514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.341088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741986729:8287]
2025-10-02T09:33:03.341256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1785, pipe: [1:7556555080741986729:8287]
2025-10-02T09:33:03.374927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.375151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.375159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.375170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986729:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.375294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.375313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741986729:8287]
2025-10-02T09:33:03.375331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:03.375341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.375380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1786 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0
2025-10-02T09:33:03.375508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1786 sessionId: src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0 is DEAD
2025-10-02T09:33:03.375674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:03.375690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Write session will restart in 0.005608s
2025-10-02T09:33:03.375710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Write session: Do CDS request
2025-10-02T09:33:03.375716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.382105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.382154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.382256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.382265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1787
2025-10-02T09:33:03.382384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.382405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.382410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.382413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.382678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1787 sessionId:  describe result for acl check
2025-10-02T09:33:03.382701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.382705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.382706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.382709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741986813:7592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.383092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741986813:7592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.383327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.383419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.383426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.383432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.383456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.383478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666430800:5466]
2025-10-02T09:33:03.383812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.383988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.384009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.384178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.384205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.384209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.384210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.384210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.384211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.384211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.384212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.384212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.384213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.384214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.384214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.384215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.384217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.384223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.384226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.384228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.384230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.384232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.384234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.384236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.384238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.384240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.384242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.384244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.384248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.384251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.384255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.384258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.384260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.384263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.384265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.384267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.384270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.384272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.384274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.384276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.384278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.384281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.384283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.384286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.384288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.384291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.384293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.384296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.384298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.384300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.384302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.384305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.384325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.384448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741986813:7592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.389045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741986813:7592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.389054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741986813:7592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.389057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741986813:7592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.389060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.391671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.393127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.393138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.393139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.393141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.393144Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1786 [2:7556555080666430800:5466]
2025-10-02T09:33:03.393151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.393160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.393165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.393166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.393167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.393176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.393179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.393184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.393213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.393217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.393218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.393220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.393222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.393260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.393267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.393273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.393278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.393286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.393299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986731:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.393301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986852:7592], now have 1 active actors on pipe
2025-10-02T09:33:03.393304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.393306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.393307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.393315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.393322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.393329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.393328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.393330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.393331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.393332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.393343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.393347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1786
2025-10-02T09:33:03.393348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.393349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.393360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1786
2025-10-02T09:33:03.393373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.393379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.393392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.393395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.393397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.393399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.393404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.393410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.393418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.393521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.393526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.393533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.393589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1787 partition: 0 MaxSeqNo: 36 sessionId: src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0
2025-10-02T09:33:03.393828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18033ae-40f9cb87-2729426a-7efaddc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.396453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Write session: try to update token
2025-10-02T09:33:03.396464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.406609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:03.406622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.406626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.406653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:03.406669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:03.406804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:03.406930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:03.407046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:03.407163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:03.407318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:03.407343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:03.408629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId: src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.410644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.410651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.410663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.410664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.410666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.410670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.410672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.410676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666430795:5466]
2025-10-02T09:33:03.410693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.410695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.410697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.410698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.410698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.410775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.410807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.475233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741986859:8287]
2025-10-02T09:33:03.475401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1786, pipe: [1:7556555080741986859:8287]
2025-10-02T09:33:03.519305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.519636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.519644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.519657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986859:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.519862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.519860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741986859:8287]
2025-10-02T09:33:03.519881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:03.519883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:03.519889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.519925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1787 reason: error at write: Disconnected sessionId: src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0
2025-10-02T09:33:03.520049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1787 sessionId: src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0 is DEAD
2025-10-02T09:33:03.520169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:03.520181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Write session will restart in 0.008699s
2025-10-02T09:33:03.520199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Write session: Do CDS request
2025-10-02T09:33:03.520203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.526224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.527456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.527557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.527564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.527569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.527595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.527620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666430920:5454]
2025-10-02T09:33:03.527963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.528134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.528157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.528330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.528357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.528361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.528362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.528362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.528363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.528363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.528364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.528364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.528365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.528365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.528366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.528366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.528369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.528376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.528378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.528380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.528382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.528384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.528386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.528388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.528390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.528392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.528394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.528396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.528401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.528404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.528408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.528411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.528413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.528415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.528418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.528420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.528422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.528425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.528427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.528430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.528432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.528434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.528436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.528439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.528441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.528445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.528447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.528452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.528454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.528456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.528458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.528461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.528478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.530159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.530233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.530242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1788
2025-10-02T09:33:03.530331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.530347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.530353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.530356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.530616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1788 sessionId:  describe result for acl check
2025-10-02T09:33:03.530640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.530644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.530645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.530648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741986947:7586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.530997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741986947:7586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.532352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741986947:7586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.535305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741986947:7586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.535314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741986947:7586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.535316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741986947:7586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.535320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.535890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.537333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.537344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.537346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.537348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.537351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1787 [2:7556555080666430920:5454]
2025-10-02T09:33:03.537358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.537370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.537374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.537376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.537377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.537386Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.537391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.537395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.537424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.537428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.537430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.537432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.537433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.537471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.537477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.537483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.537488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.537499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.537514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986982:7586], now have 1 active actors on pipe
2025-10-02T09:33:03.537520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986860:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.537524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.537525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.537526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.537533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.537545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.537548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.537550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.537551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.537555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.537557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.537538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1787
2025-10-02T09:33:03.537548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1787
2025-10-02T09:33:03.537571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.537576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.537577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.537585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.537587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.537611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19139ba-c18b73da-de10f288-731f6d78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.537617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.537619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.537620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.537625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.537633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.537642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.537772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.537777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.537784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.537827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1788 partition: 0 MaxSeqNo: 36 sessionId: src_id|19139ba-c18b73da-de10f288-731f6d78_0
2025-10-02T09:33:03.538025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9084e-7c8572c2-41ed3902-da139d68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19139ba-c18b73da-de10f288-731f6d78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.540527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Write session: try to update token
2025-10-02T09:33:03.540538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.546876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.546889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.546893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.546894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.546899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.546902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.546904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666430915:5454]
2025-10-02T09:33:03.546926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.546930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.546933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.546933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.546934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.546936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.547041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.552297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId: src_id|19139ba-c18b73da-de10f288-731f6d78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.554315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.620128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741986990:8287]
2025-10-02T09:33:03.620298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1787, pipe: [1:7556555080741986990:8287]
2025-10-02T09:33:03.655678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.655903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.655912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.655924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986990:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.656092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:03.656104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:03.656125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.656154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1788 reason: error at write: Disconnected sessionId: src_id|19139ba-c18b73da-de10f288-731f6d78_0
2025-10-02T09:33:03.656156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741986990:8287]
2025-10-02T09:33:03.656288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1788 sessionId: src_id|19139ba-c18b73da-de10f288-731f6d78_0 is DEAD
2025-10-02T09:33:03.656305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.656419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:03.656430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Write session will restart in 0.009509s
2025-10-02T09:33:03.656446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Write session: Do CDS request
2025-10-02T09:33:03.656450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.663221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.664570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.664671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.664686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.664693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.664718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.664744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666431041:5449]
2025-10-02T09:33:03.665105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.665297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.665319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.665498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.665528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.665532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.665533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.665534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.665534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.665535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.665535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.665536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.665536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.665537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.665537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.665538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.665541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.665548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.665550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.665552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.665554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.665557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.665558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.665560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.665562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.665565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.665567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.665569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.665573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.665577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.665580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.665583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.665587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.665589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.665592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.665594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.665597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.665599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.665601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.665604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.665609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.665612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.665614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.665616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.665619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.665621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.665624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.665626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.665629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.665634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.665636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.665639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.665655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.667238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.667326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.667335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1789
2025-10-02T09:33:03.667439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.667456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.667459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.667462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.667726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1789 sessionId:  describe result for acl check
2025-10-02T09:33:03.667750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.667755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.667756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.667759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741987079:7578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.668104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741987079:7578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.669686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741987079:7578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.672625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741987079:7578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.672634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741987079:7578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.672635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741987079:7578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.672639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.673273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.674637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.674648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.674650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.674652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.674657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1788 [2:7556555080666431041:5449]
2025-10-02T09:33:03.674664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.674675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.674680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.674681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.674682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.674691Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.674694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.674699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.674739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.674744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.674745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.674747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.674748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.674798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.674802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.674809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.674814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.674822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.674834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987114:7578], now have 1 active actors on pipe
2025-10-02T09:33:03.674838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741986991:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.674841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.674843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.674844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.674852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.674860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.674864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.674867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.674867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.674870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.674872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.674870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1788
2025-10-02T09:33:03.674876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1788
2025-10-02T09:33:03.674888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.674893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.674895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.674911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.674916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.674933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.674940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.674942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.674943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.674948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.674953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.674962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.675037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.675042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.675049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.675091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1789 partition: 0 MaxSeqNo: 36 sessionId: src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0
2025-10-02T09:33:03.675305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19139ba-c18b73da-de10f288-731f6d78_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.677556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Write session: try to update token
2025-10-02T09:33:03.677569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.684216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.684229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.684231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.684232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.684237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.684239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.684242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666431036:5449]
2025-10-02T09:33:03.684265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.684266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.684268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.684269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.684269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.684271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.684489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.689321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId: src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.691291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.756315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741987122:8287]
2025-10-02T09:33:03.756502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1788, pipe: [1:7556555080741987122:8287]
2025-10-02T09:33:03.796042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.796254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.796262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.796287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987122:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.796494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:03.796505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:03.796515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.796550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1789 reason: error at write: Disconnected sessionId: src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0
2025-10-02T09:33:03.796553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741987122:8287]
2025-10-02T09:33:03.796644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.796681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1789 sessionId: src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0 is DEAD
2025-10-02T09:33:03.796828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:03.796839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Write session will restart in 0.006279s
2025-10-02T09:33:03.796854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Write session: Do CDS request
2025-10-02T09:33:03.796858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.803081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.804121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.804220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.804228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1790
2025-10-02T09:33:03.804315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.804334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.804339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.804341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.804512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.804592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1790 sessionId:  describe result for acl check
2025-10-02T09:33:03.804615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.804619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.804605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.804620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.804624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741987208:7576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.804614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.804619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.804644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.804664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666431164:5447]
2025-10-02T09:33:03.804978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741987208:7576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.805027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.805214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.805236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.805409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.805438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.805441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.805442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.805443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.805443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.805444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.805444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.805445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.805445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.805446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.805446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.805447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.805449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.805455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.805457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.805459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.805461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.805463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.805465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.805467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.805469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.805472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.805474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.805475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.805479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.805483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.805486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.805489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.805491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.805494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.805496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.805498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.805500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.805503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.805505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.805508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.805510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.805513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.805515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.805517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.805520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.805522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.805525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.805527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.805529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.805532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.805534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.805537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.805554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.806340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741987208:7576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.810261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741987208:7576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.810268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741987208:7576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.810270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741987208:7576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.810273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.812929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.814400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.814410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.814412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.814414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.814417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1789 [2:7556555080666431164:5447]
2025-10-02T09:33:03.814424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.814433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.814434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.814436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.814437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.814447Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.814455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.814458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.814491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.814496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.814497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.814498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.814500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.814535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.814540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.814546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.814551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.814562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.814576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987123:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.814581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987246:7576], now have 1 active actors on pipe
2025-10-02T09:33:03.814584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.814585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.814586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.814594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.814601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.814607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.814609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.814610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.814612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.814613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.814621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1789
2025-10-02T09:33:03.814626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1789
2025-10-02T09:33:03.814630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.814639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.814641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.814659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.814662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.814676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.814683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.814685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.814686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.814692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.814700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.814708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.814830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.814835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.814842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.814902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1790 partition: 0 MaxSeqNo: 36 sessionId: src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0
2025-10-02T09:33:03.815118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f9ebb4-b7311073-a2fc0423-7aa7a1f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.817916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Write session: try to update token
2025-10-02T09:33:03.817934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.823900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.823912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.823913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.823915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.823920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.823924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.823926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666431159:5447]
2025-10-02T09:33:03.823946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.823952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.823953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.823953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.823956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.823958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.824059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.830978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId: src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.833154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:03.896607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555080741987262:8287]
2025-10-02T09:33:03.896781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1789, pipe: [1:7556555080741987262:8287]
2025-10-02T09:33:03.936492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:03.937150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.937160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.937172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987262:8287], now have 1 active actors on pipe
2025-10-02T09:33:03.937278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:03.937333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555080741987262:8287]
2025-10-02T09:33:03.937352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:03.937394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0
2025-10-02T09:33:03.937540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1790 sessionId: src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0 is DEAD
2025-10-02T09:33:03.937678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:03.937706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:03.937720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Write session will restart in 0.009082s
2025-10-02T09:33:03.937746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Write session: Do CDS request
2025-10-02T09:33:03.937751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:03.944032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:03.945406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:03.945508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:03.945514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:03.945519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:03.945547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:03.945571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555080666431337:5424]
2025-10-02T09:33:03.945904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:03.946087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:03.946108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:03.946288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:03.946314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.946318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.946319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.946319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.946320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.946320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.946321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.946321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.946322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.946322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.946323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.946323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.946326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.946332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.946334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.946336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.946338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.946340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.946342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.946344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.946346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.946348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.946350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.946352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.946356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.946360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:03.946363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.946366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:03.946368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.946370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:03.946373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.946375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:03.946378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.946381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:03.946383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.946385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:03.946387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.946390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:03.946392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.946394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:03.946397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.946399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:03.946401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.946404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.946407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.946411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.946413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.946415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.946432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:03.948138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.948224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:03.948234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1791
2025-10-02T09:33:03.948330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:03.948348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:03.948354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:03.948357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:03.948620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1791 sessionId:  describe result for acl check
2025-10-02T09:33:03.948639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:03.948644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:03.948644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:03.948647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555080741987393:7560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:03.948974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555080741987393:7560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:03.949959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555080741987393:7560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:03.953401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555080741987393:7560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:03.953411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555080741987393:7560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:03.953414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555080741987393:7560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:03.953419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:03.953789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:03.955226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:03.955235Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:03.955236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:03.955238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:03.955241Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1790 [2:7556555080666431337:5424]
2025-10-02T09:33:03.955248Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:03.955257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:03.955259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.955260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.955261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.955270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:03.955273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:03.955277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:03.955306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.955311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.955312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.955314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:03.955315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:03.955351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:03.955356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.955362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:03.955367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:03.955378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:03.955389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987424:7560], now have 1 active actors on pipe
2025-10-02T09:33:03.955394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555080741987291:2446], now have 1 active actors on pipe
2025-10-02T09:33:03.955397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.955398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.955399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.955407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:03.955414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:03.955423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:03.955424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:03.955425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:03.955427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:03.955428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:03.955423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1790
2025-10-02T09:33:03.955432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1790
2025-10-02T09:33:03.955438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.955443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:03.955446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:03.955464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.955469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.955485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:03.955491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:03.955493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:03.955494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:03.955499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:03.955504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:03.955510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.955593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:03.955598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:03.955605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:03.955652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1791 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0
2025-10-02T09:33:03.955861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c307bb-45faf6d0-d2679b35-3fbc8dcd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:03.958563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Write session: try to update token
2025-10-02T09:33:03.958576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:03.964436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:03.964446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:03.964447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:03.964448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:03.964453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.964455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.964457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555080666431332:5424]
2025-10-02T09:33:03.964476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:03.964479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:03.964480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:03.964483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:03.964488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:03.964491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:03.964613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:03.970503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId: src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:03.972575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.037412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036954727:8287]
2025-10-02T09:33:04.037566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1790, pipe: [1:7556555085036954727:8287]
2025-10-02T09:33:04.074917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.075158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.075167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.075178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036954727:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.075387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:04.075397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:04.075404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.075439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036954727:8287]
2025-10-02T09:33:04.075462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1791 reason: error at write: Disconnected sessionId: src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0
2025-10-02T09:33:04.075513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.075595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1791 sessionId: src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0 is DEAD
2025-10-02T09:33:04.075763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:04.075779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Write session will restart in 0.006470s
2025-10-02T09:33:04.075800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Write session: Do CDS request
2025-10-02T09:33:04.075806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.082905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.083159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.083208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.083216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1792
2025-10-02T09:33:04.083329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.083350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.083356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.083359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.083630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1792 sessionId:  describe result for acl check
2025-10-02T09:33:04.083654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.083660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.083661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.083665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036954816:7550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.084099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036954816:7550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.084274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.084401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.084409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.084415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.084446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.084467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961398759:5407]
2025-10-02T09:33:04.084831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.085001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.085024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.085199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.085228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.085229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.085229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.085230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.085230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.085231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.085231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.085232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.085232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.085233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.085233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.085234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.085237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.085242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.085244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.085247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.085249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.085251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.085253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.085254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.085256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.085258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.085260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.085262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.085266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.085270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.085273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.085276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.085278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.085280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.085282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.085285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.085287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.085290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.085292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.085295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.085297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.085299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.085302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.085304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.085306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.085309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.085311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.085314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.085316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.085320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.085322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.085325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.085341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.085431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036954816:7550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.090057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036954816:7550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.090067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036954816:7550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.090069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036954816:7550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.090077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.092651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.094095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.094105Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.094106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.094107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.094111Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1791 [2:7556555084961398759:5407]
2025-10-02T09:33:04.094117Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.094127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.094131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.094133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.094134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.094143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.094148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.094152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.094182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.094186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.094187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.094189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.094191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.094227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.094231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.094238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.094243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.094254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.094264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036954855:7550], now have 1 active actors on pipe
2025-10-02T09:33:04.094271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.094272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.094273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.094279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.094283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036954729:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.094287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.094290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.094292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.094294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.094298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.094301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.094296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1791
2025-10-02T09:33:04.094313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.094297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1791
2025-10-02T09:33:04.094318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.094320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.094335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.094338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.094385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.094392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.094394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.094395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.094400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.094406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.094418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.094512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.094517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.094525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.094579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1792 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0
2025-10-02T09:33:04.094775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e678e-539aef73-d2c7268a-f09a45e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.097147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Write session: try to update token
2025-10-02T09:33:04.097156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.103632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.103645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.103648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.103649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.103653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.103655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.103658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961398754:5407]
2025-10-02T09:33:04.103678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.103682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.103684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.103687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.103690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.103692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.103832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.108742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId: src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.110849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.175652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036954862:8287]
2025-10-02T09:33:04.175836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1791, pipe: [1:7556555085036954862:8287]
2025-10-02T09:33:04.216514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.216735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.216744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.216769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036954862:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.216930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.216958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.216992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:04.216994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036954862:8287]
2025-10-02T09:33:04.217045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0
2025-10-02T09:33:04.217185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1792 sessionId: src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0 is DEAD
2025-10-02T09:33:04.217320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:04.217330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Write session will restart in 0.008555s
2025-10-02T09:33:04.217349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Write session: Do CDS request
2025-10-02T09:33:04.217354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.224420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.225820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.225928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.225934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.225939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.225965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.225988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961398885:5410]
2025-10-02T09:33:04.226341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.226529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.226552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.226763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.226799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.226803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.226804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.226804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.226805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.226805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.226806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.226806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.226807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.226808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.226808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.226809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.226811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.226818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.226820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.226823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.226825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.226827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.226829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.226831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.226833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.226835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.226837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.226839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.226843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.226847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.226850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.226853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.226856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.226858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.226860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.226863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.226866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.226868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.226871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.226873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.226876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.226878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.226880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.226883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.226889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.226892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.226894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.226897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.226899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.226902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.226904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.226907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.226927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.227120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.227221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.227230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1793
2025-10-02T09:33:04.227322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.227341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.227346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.227349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.227600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1793 sessionId:  describe result for acl check
2025-10-02T09:33:04.227619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.227623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.227625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.227628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036954956:7546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.227974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036954956:7546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.229337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036954956:7546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.233191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036954956:7546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.233202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036954956:7546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.233204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036954956:7546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.233209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.234396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.235918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.235919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.235921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.235925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1792 [2:7556555084961398885:5410]
2025-10-02T09:33:04.235931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.235941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.235942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.235944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.235945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.235954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.235957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.235961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.235998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.236002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.236003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.236004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.236005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.236043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.236050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.236056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.236061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.236068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.236079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036954993:7546], now have 1 active actors on pipe
2025-10-02T09:33:04.236087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.236088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.236089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.236093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.236101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.236102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.236105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.236107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.236111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.236113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.236116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036954864:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.236128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.236134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.236136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.236115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1792
2025-10-02T09:33:04.236124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1792
2025-10-02T09:33:04.236147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.236152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.236172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54faa5a6-587e6481-87277ff6-e605986c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.236180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.236182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.236183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.236188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.236192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.236205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.236292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.236298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.236309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.236367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1793 partition: 0 MaxSeqNo: 36 sessionId: src_id|54faa5a6-587e6481-87277ff6-e605986c_0
2025-10-02T09:33:04.236549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee925c6b-1c270b5c-6e59499c-d46f791d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54faa5a6-587e6481-87277ff6-e605986c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.238746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Write session: try to update token
2025-10-02T09:33:04.238757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.245546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.245560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.245561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.245562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.245567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.245570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.245572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961398880:5410]
2025-10-02T09:33:04.245593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.245599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.245600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.245602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.245603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.245604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.245737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.250153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId: src_id|54faa5a6-587e6481-87277ff6-e605986c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.252171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.316955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036955000:8287]
2025-10-02T09:33:04.317120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1792, pipe: [1:7556555085036955000:8287]
2025-10-02T09:33:04.354957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.355234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.355243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.355269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955000:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.355403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.355457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.355478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036955000:8287]
2025-10-02T09:33:04.355492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:04.355542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1793 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54faa5a6-587e6481-87277ff6-e605986c_0
2025-10-02T09:33:04.355685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1793 sessionId: src_id|54faa5a6-587e6481-87277ff6-e605986c_0 is DEAD
2025-10-02T09:33:04.355820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:04.355829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Write session will restart in 0.008222s
2025-10-02T09:33:04.355846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Write session: Do CDS request
2025-10-02T09:33:04.355850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.363207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.364540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.364645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.364652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.364658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.364683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.364716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961399013:5403]
2025-10-02T09:33:04.365069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.365135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.365221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.365233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1794
2025-10-02T09:33:04.365275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.365297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.365321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.365339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.365344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.365347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.365472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.365501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.365504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.365505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.365506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.365507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.365507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.365507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.365508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.365509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.365509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.365510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.365510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.365513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.365520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.365522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.365524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.365526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.365528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.365530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.365532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.365534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.365536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.365538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.365540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.365545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.365549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.365552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.365555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.365557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.365559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.365561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.365564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.365566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.365569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.365571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.365575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.365577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.365579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.365581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.365584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.365588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.365593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.365600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.365604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.365610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.365612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1794 sessionId:  describe result for acl check
2025-10-02T09:33:04.365614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.365631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.365625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.365627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.365646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.365636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.365637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.365640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036955092:7541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.365995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036955092:7541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.367510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036955092:7541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.371865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036955092:7541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.371875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036955092:7541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.371878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036955092:7541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.371883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.373031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.374518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.374528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.374529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.374531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.374534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1793 [2:7556555084961399013:5403]
2025-10-02T09:33:04.374541Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.374550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.374551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.374552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.374554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.374562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.374565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.374569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.374598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.374603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.374605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.374606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.374608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.374645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.374650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.374656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.374662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.374673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.374685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.374690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.374691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.374696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.374704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.374705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955001:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.374718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.374719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.374720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.374728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.374730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.374733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955130:7541], now have 1 active actors on pipe
2025-10-02T09:33:04.374745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.374754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.374755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1793
2025-10-02T09:33:04.374758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1793
2025-10-02T09:33:04.374787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.374825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.374831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.374845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.374851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.374854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.374855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.374860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.374865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.374871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.374972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.374977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.374983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.375038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1794 partition: 0 MaxSeqNo: 36 sessionId: src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0
2025-10-02T09:33:04.375221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54faa5a6-587e6481-87277ff6-e605986c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.377356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Write session: try to update token
2025-10-02T09:33:04.377366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.383958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.383971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.383973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.383974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.383979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.383981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.383983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961399008:5403]
2025-10-02T09:33:04.384003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.384006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.384008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.384020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.384024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.384028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.384122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.388822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId: src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.390887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.455718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036955137:8287]
2025-10-02T09:33:04.455915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1793, pipe: [1:7556555085036955137:8287]
2025-10-02T09:33:04.495950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.496192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.496201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.496227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955137:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.496393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.496403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:04.496411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:04.496467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036955137:8287]
2025-10-02T09:33:04.496468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1794 reason: error at write: Disconnected sessionId: src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0
2025-10-02T09:33:04.496491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.496627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1794 sessionId: src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0 is DEAD
2025-10-02T09:33:04.496758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:04.496767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Write session will restart in 0.006110s
2025-10-02T09:33:04.496781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Write session: Do CDS request
2025-10-02T09:33:04.496786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.503797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.504097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.504218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.504229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1795
2025-10-02T09:33:04.504331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.504352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.504358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.504361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.504652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1795 sessionId:  describe result for acl check
2025-10-02T09:33:04.504672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.504676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.504679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.504682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036955228:7535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.505065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036955228:7535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.505210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.505307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.505314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.505319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.505344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.505376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961399140:5397]
2025-10-02T09:33:04.505737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.505914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.505998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.506189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.506218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.506222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.506223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.506223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.506224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.506224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.506225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.506225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.506226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.506226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.506227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.506227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.506231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.506236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.506238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.506241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.506243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.506245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.506247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.506249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.506251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.506253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.506255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.506257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.506260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.506264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.506268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.506271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.506273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.506276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.506278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.506281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.506283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.506286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.506288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.506291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.506293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.506296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.506286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036955228:7535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.506298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.506301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.506303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.506306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.506308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.506311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.506315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.506317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.506319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.506322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.506339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.511095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036955228:7535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.511106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036955228:7535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.511109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036955228:7535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.511114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.513690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.515138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.515147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.515148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.515151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.515154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1794 [2:7556555084961399140:5397]
2025-10-02T09:33:04.515160Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.515171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.515176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.515178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.515179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.515192Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.515199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.515203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.515233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.515238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.515239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.515241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.515242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.515282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.515286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.515293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.515298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.515306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.515318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955267:7535], now have 1 active actors on pipe
2025-10-02T09:33:04.515322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.515323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.515324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.515330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.515336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.515338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.515341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.515344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955138:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.515348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.515351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1794
2025-10-02T09:33:04.515360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.515356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1794
2025-10-02T09:33:04.515366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.515379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.515384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.515387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.515394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.515397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.515420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.515427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.515429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.515430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.515435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.515440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.515450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.515550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.515555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.515562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.515604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1795 partition: 0 MaxSeqNo: 36 sessionId: src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0
2025-10-02T09:33:04.515800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af46aef7-8417fb9e-aeb2f9b0-b85e8ebb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.518115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Write session: try to update token
2025-10-02T09:33:04.518127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.524591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.524606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.524607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.524608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.524613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.524615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.524618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961399135:5397]
2025-10-02T09:33:04.524638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.524641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.524642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.524647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.524651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.524655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.524781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.530076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId: src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.532210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.596513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036955275:8287]
2025-10-02T09:33:04.596757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1794, pipe: [1:7556555085036955275:8287]
2025-10-02T09:33:04.638315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.638564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.638575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.638589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955275:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.638765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.638830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.638847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:04.638878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036955275:8287]
2025-10-02T09:33:04.638917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0
2025-10-02T09:33:04.639071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1795 sessionId: src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0 is DEAD
2025-10-02T09:33:04.639204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:04.639213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Write session will restart in 0.006111s
2025-10-02T09:33:04.639231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Write session: Do CDS request
2025-10-02T09:33:04.639236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.646114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.646196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.646205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1796
2025-10-02T09:33:04.646291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.646313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.646317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.646319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.646513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.646578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1796 sessionId:  describe result for acl check
2025-10-02T09:33:04.646599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.646601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.646602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.646605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036955366:7525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.646991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036955366:7525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.648104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.648224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.648231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.648237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.648267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.648292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961399269:5392]
2025-10-02T09:33:04.648638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.648730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036955366:7525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.648997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.649024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.649221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.649255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.649259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.649260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.649260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.649261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.649261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.649262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.649263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.649263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.649264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.649264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.649265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.649268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.649274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.649276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.649279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.649281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.649283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.649285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.649287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.649289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.649291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.649293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.649295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.649299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.649303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.649306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.649309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.649311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.649314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.649317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.649320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.649324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.649326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.649328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.649331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.649333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.649336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.649342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.649344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.649347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.649350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.649356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.649359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.649361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.649367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.649369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.649371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.649389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.653395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036955366:7525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.653404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036955366:7525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.653407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036955366:7525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.653411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.657025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.658542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.658553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.658554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.658556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.658560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1795 [2:7556555084961399269:5392]
2025-10-02T09:33:04.658567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.658578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.658580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.658582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.658583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.658592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.658597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.658601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.658635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.658641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.658642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.658645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.658646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.658689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.658695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.658701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.658707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.658728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.658747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955276:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.658754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955406:7525], now have 1 active actors on pipe
2025-10-02T09:33:04.658759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.658761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.658763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.658773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.658787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.658789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.658791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.658792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.658801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.658804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.658792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1795
2025-10-02T09:33:04.658823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.658830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.658832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.658807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1795
2025-10-02T09:33:04.658846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.658851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.658879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54425850-80c3af57-e5f5f793-2032bf75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.658886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.658888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.658889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.658894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.658900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.658912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.659017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.659023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.659030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.659081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1796 partition: 0 MaxSeqNo: 36 sessionId: src_id|54425850-80c3af57-e5f5f793-2032bf75_0
2025-10-02T09:33:04.659323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43441ad1-42dafae4-6c40b9b3-9a2f4c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54425850-80c3af57-e5f5f793-2032bf75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.661512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Write session: try to update token
2025-10-02T09:33:04.661524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.668380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.668396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.668397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.668398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.668403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.668405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.668408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961399264:5392]
2025-10-02T09:33:04.668431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.668437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.668438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.668440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.668444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.668447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.668571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.674199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId: src_id|54425850-80c3af57-e5f5f793-2032bf75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.676357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.738858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036955414:8287]
2025-10-02T09:33:04.739081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1795, pipe: [1:7556555085036955414:8287]
2025-10-02T09:33:04.782577Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.782859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.782867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.782879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955414:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.783033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.783102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.783132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:04.783144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036955414:8287]
2025-10-02T09:33:04.783197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1796 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54425850-80c3af57-e5f5f793-2032bf75_0
2025-10-02T09:33:04.783342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1796 sessionId: src_id|54425850-80c3af57-e5f5f793-2032bf75_0 is DEAD
2025-10-02T09:33:04.783526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:04.783541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Write session will restart in 0.009335s
2025-10-02T09:33:04.783564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Write session: Do CDS request
2025-10-02T09:33:04.783570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.790369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.791644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.791742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.791749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.791754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.791781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.791806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961399399:5394]
2025-10-02T09:33:04.792423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.792598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.792622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.792933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.792969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.792973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.792974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.792974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.792975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.792975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.792976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.792977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.792977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.792977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.792978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.792978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.792981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.792989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.792991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.792993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.792995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.792997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.792999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.793001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.793002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.793005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.793007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.793008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.793013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.793017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.793020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.793023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.793025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.793028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.793030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.793033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.793035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.793037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.793039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.793042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.793044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.793047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.793049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.793051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.793055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.793061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.793064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.793069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.793077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.793081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.793087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.793089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.793105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.794187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.794227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.794237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1797
2025-10-02T09:33:04.794428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.794447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.794452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.794455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.794752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1797 sessionId:  describe result for acl check
2025-10-02T09:33:04.794773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.794777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.794778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.794781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036955512:7524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.795142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036955512:7524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.796552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036955512:7524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.800030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036955512:7524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.800042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036955512:7524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.800045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036955512:7524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.800050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.800560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.802079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.802091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.802093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.802095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.802098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1796 [2:7556555084961399399:5394]
2025-10-02T09:33:04.802177Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.802191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.802193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.802194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.802195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.802203Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.802206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.802210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.802242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.802247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.802248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.802251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.802252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.802290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.802295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.802301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.802306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.802314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.802329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.802333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.802334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.802340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.802348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955546:7524], now have 1 active actors on pipe
2025-10-02T09:33:04.802348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.802350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955415:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.802350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.802352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.802355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.802362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.802363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.802378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.802388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.802383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1796
2025-10-02T09:33:04.802388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1796
2025-10-02T09:33:04.802413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.802417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.802419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.802433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.802436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.802438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.802439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.802444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.802449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.802458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.802564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.802569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.802576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.802626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1797 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0
2025-10-02T09:33:04.802859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54425850-80c3af57-e5f5f793-2032bf75_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.805604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Write session: try to update token
2025-10-02T09:33:04.805620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.811582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.811594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.811595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.811596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.811599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.811601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.811603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961399394:5394]
2025-10-02T09:33:04.811622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.811625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.811626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.811633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.811636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.811639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.811733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.817849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId: src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.820038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:04.883397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555085036955559:8287]
2025-10-02T09:33:04.883609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1796, pipe: [1:7556555085036955559:8287]
2025-10-02T09:33:04.924576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:04.924900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.924909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.924922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955559:8287], now have 1 active actors on pipe
2025-10-02T09:33:04.925128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:04.925137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:04.925137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:04.925141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:04.925185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555085036955559:8287]
2025-10-02T09:33:04.925194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1797 reason: error at write: Disconnected sessionId: src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0
2025-10-02T09:33:04.925359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1797 sessionId: src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0 is DEAD
2025-10-02T09:33:04.925475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:04.925484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Write session will restart in 0.009177s
2025-10-02T09:33:04.925503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Write session: Do CDS request
2025-10-02T09:33:04.925507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:04.932636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:04.934163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:04.934270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:04.934277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:04.934283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:04.934310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:04.934335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555084961399542:5381]
2025-10-02T09:33:04.934734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:04.934925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:04.934953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:04.935145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:04.935178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.935181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.935182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.935182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.935183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.935184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.935184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.935185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.935195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.935185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.935186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.935187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.935187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.935190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.935197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.935199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.935201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.935204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.935208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.935211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.935214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.935218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.935221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.935225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.935229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.935234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.935238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:04.935242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.935244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:04.935247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.935249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:04.935251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.935254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:04.935256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.935259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:04.935261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.935264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:04.935267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.935269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:04.935273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.935276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:04.935278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.935283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:04.935288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.935291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.935293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.935296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.935301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.935304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.935292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:04.935302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1798
2025-10-02T09:33:04.935323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:04.935433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:04.935453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:04.935460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:04.935462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:04.935729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1798 sessionId:  describe result for acl check
2025-10-02T09:33:04.935750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:04.935754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:04.935755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:04.935758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555085036955660:7512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:04.936118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555085036955660:7512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:04.937483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555085036955660:7512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:04.941809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555085036955660:7512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:04.941821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555085036955660:7512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:04.941824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555085036955660:7512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:04.941829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:04.943048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:04.944574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:04.944585Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:04.944587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:04.944589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:04.944592Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1797 [2:7556555084961399542:5381]
2025-10-02T09:33:04.944599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:04.944610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:04.944612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.944613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.944614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.944624Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:04.944631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:04.944636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:04.944668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.944673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.944674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.944675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:04.944677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:04.944726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:04.944731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.944738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:04.944744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:04.944752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:04.944767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955563:2446], now have 1 active actors on pipe
2025-10-02T09:33:04.944773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555085036955710:7512], now have 1 active actors on pipe
2025-10-02T09:33:04.944777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.944778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.944779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.944787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:04.944796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:04.944818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:04.944821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:04.944822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:04.944823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:04.944825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:04.944837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.944843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:04.944845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:04.944891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1797
2025-10-02T09:33:04.944924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1797
2025-10-02T09:33:04.944947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.944955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.944971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:04.944979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:04.944981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:04.944982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:04.944987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:04.944995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:04.945005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.945166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:04.945171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:04.945179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:04.945258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1798 partition: 0 MaxSeqNo: 36 sessionId: src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0
2025-10-02T09:33:04.945532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c3f3148-3889162c-bb2d7e03-35a4b07a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:04.948237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Write session: try to update token
2025-10-02T09:33:04.948253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:04.954228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:04.954239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.954243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.954263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:04.954279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:04.954468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:04.954634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:04.954815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:04.954979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:04.955136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:04.955162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:04.961059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId: src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:04.963105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:04.963118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:04.963120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:04.963122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:04.963128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.963132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.963134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555084961399537:5381]
2025-10-02T09:33:04.963161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:04.963162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:04.963166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:04.963168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:04.963169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:04.963170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:04.963279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:04.963485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.025560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555089331923032:8287]
2025-10-02T09:33:05.025714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1797, pipe: [1:7556555089331923032:8287]
2025-10-02T09:33:05.076602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.076855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.076865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.076879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923032:8287], now have 1 active actors on pipe
2025-10-02T09:33:05.077037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.077103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.077114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:05.077117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:05.077146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923032:8287]
2025-10-02T09:33:05.077181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1798 reason: error at write: Disconnected sessionId: src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0
2025-10-02T09:33:05.077349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1798 sessionId: src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0 is DEAD
2025-10-02T09:33:05.077504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:05.077518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Write session will restart in 0.008551s
2025-10-02T09:33:05.077539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Write session: Do CDS request
2025-10-02T09:33:05.077545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.084022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.085224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.085331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.085338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.085343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.085368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.085442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367008:5355]
2025-10-02T09:33:05.085806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.085990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.086026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.086212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.086240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.086244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.086245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.086245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.086246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.086247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.086248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.086249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.086250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.086251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.086252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.086253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.086257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.086266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.086270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.086274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.086276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.086278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.086280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.086282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.086284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.086286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.086288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.086290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.086299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.086303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.086308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.086310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.086314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.086317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.086319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.086322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.086326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.086328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.086330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.086333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.086336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.086339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.086342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.086345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.086347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.086351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.086353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.086356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.086358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.086361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.086363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.086367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.086383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.087155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.087257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.087268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1799
2025-10-02T09:33:05.087532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.087552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.087558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.087561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.087823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1799 sessionId:  describe result for acl check
2025-10-02T09:33:05.087843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.087847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.087848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.087852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331923132:7500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.088205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331923132:7500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.089485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331923132:7500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.093228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331923132:7500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.093238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331923132:7500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.093241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331923132:7500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.093246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.093725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.095116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.095127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.095129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.095131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.095134Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1798 [2:7556555089256367008:5355]
2025-10-02T09:33:05.095141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.095150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.095155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.095157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.095158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.095167Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.095173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.095178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.095207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.095212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.095213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.095215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.095216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.095288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.095293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.095300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.095306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.095314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.095327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923034:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.095332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923167:7500], now have 1 active actors on pipe
2025-10-02T09:33:05.095329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1798
2025-10-02T09:33:05.095335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.095330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1798
2025-10-02T09:33:05.095336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.095337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.095342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.095349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.095356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.095361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.095371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.095384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.095385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.095386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.095387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.095394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.095399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.095412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d33ab6b0-979eb146-391cfd48-5272c239_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.095414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.095419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.095421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.095422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.095427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.095432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.095443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.095540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.095545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.095552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.095594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1799 partition: 0 MaxSeqNo: 36 sessionId: src_id|d33ab6b0-979eb146-391cfd48-5272c239_0
2025-10-02T09:33:05.095780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b007a5bb-7b96981f-d09ce4e7-63f7556e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d33ab6b0-979eb146-391cfd48-5272c239_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.098218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Write session: try to update token
2025-10-02T09:33:05.098230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.104647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.104661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.104662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.104663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.104668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.104673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.104675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367003:5355]
2025-10-02T09:33:05.104702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.104706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.104709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.104710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.104711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.104712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.104835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.109812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId: src_id|d33ab6b0-979eb146-391cfd48-5272c239_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.111859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.177108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555089331923174:8287]
2025-10-02T09:33:05.177271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1798, pipe: [1:7556555089331923174:8287]
2025-10-02T09:33:05.214566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.214800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.214809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.214834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923174:8287], now have 1 active actors on pipe
2025-10-02T09:33:05.214972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.214982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923174:8287]
2025-10-02T09:33:05.215008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.215009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:05.215015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:05.215067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1799 reason: error at write: Disconnected sessionId: src_id|d33ab6b0-979eb146-391cfd48-5272c239_0
2025-10-02T09:33:05.215219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1799 sessionId: src_id|d33ab6b0-979eb146-391cfd48-5272c239_0 is DEAD
2025-10-02T09:33:05.215367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:05.215375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Write session will restart in 0.005279s
2025-10-02T09:33:05.215391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Write session: Do CDS request
2025-10-02T09:33:05.215395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.221225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.221291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.221300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1800
2025-10-02T09:33:05.221425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.221444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.221449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.221452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.221709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1800 sessionId:  describe result for acl check
2025-10-02T09:33:05.221730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.221734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.221735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.221739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331923268:7494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.222110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331923268:7494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.222340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.223652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.223662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331923268:7494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.223746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.223752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.223758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.223784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.223808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367141:5353]
2025-10-02T09:33:05.224155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.224325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.224348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.224524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.224556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.224560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.224561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.224561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.224562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.224563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.224563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.224564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.224564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.224565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.224565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.224565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.224568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.224574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.224576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.224578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.224580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.224582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.224583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.224585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.224588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.224590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.224591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.224593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.224598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.224601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.224604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.224607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.224610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.224612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.224614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.224617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.224620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.224622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.224624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.224627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.224629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.224632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.224634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.224636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.224638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.224641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.224644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.224646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.224650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.224653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.224655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.224657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.224675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.228502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331923268:7494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.228515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331923268:7494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.228518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331923268:7494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.228524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.232089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.233595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.233606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.233607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.233609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.233612Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1799 [2:7556555089256367141:5353]
2025-10-02T09:33:05.233619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.233628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.233633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.233635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.233636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.233644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.233647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.233651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.233681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.233686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.233686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.233688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.233689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.233726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.233730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.233736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.233741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.233749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.233764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923176:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.233769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923310:7494], now have 1 active actors on pipe
2025-10-02T09:33:05.233773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.233774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.233775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.233780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.233786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.233789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.233792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.233793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.233794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.233796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.233789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1799
2025-10-02T09:33:05.233791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1799
2025-10-02T09:33:05.233810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.233816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.233820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.233836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.233841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.233856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1221ca82-1c28df36-a91e4877-33294532_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.233862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.233864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.233865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.233870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.233875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.233882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.233971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.233975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.233982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.234056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1800 partition: 0 MaxSeqNo: 36 sessionId: src_id|1221ca82-1c28df36-a91e4877-33294532_0
2025-10-02T09:33:05.234278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33ab6b0-979eb146-391cfd48-5272c239_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1221ca82-1c28df36-a91e4877-33294532_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.237025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Write session: try to update token
2025-10-02T09:33:05.237039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.243081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.243093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.243094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.243094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.243098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.243100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.243102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367136:5353]
2025-10-02T09:33:05.243121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.243124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.243125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.243139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.243148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.243151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.243236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.248713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId: src_id|1221ca82-1c28df36-a91e4877-33294532_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.250735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.315354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555089331923319:8287]
2025-10-02T09:33:05.315520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1799, pipe: [1:7556555089331923319:8287]
2025-10-02T09:33:05.353269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.353467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.353476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.353488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923319:8287], now have 1 active actors on pipe
2025-10-02T09:33:05.353635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.353691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923319:8287]
2025-10-02T09:33:05.353717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:05.353728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.353745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:33:05.353750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-02T09:33:05.353780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1800 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1221ca82-1c28df36-a91e4877-33294532_0
2025-10-02T09:33:05.353915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1800 sessionId: src_id|1221ca82-1c28df36-a91e4877-33294532_0 is DEAD
2025-10-02T09:33:05.354066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:05.354081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Write session will restart in 0.009697s
2025-10-02T09:33:05.354103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Write session: Do CDS request
2025-10-02T09:33:05.354109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.361147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.362427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.362573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.362583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.362591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.362636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.362669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367276:5347]
2025-10-02T09:33:05.363178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.363389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.363429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.363688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.363756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.363763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.363763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.363764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.363765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.363766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.363767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.363768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.363769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.363770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.363771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.363771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.363776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.363785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.363788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.363791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.363794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.363796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.363799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.363802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.363805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.363808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.363810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.363813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.363819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.363826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.363832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.363836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.363845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.363849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.363854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.363858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.363863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.363867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.363871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.363875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.363879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.363884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.363887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.363891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.363899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.363903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.363906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.363912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.363916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.363921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.363924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.363930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.363960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.365175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.365229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.365239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1801
2025-10-02T09:33:05.365384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.365403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.365411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.365413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.365724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1801 sessionId:  describe result for acl check
2025-10-02T09:33:05.365745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.365748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.365751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.365753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331923424:7488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.366118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331923424:7488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.367558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331923424:7488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.370814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331923424:7488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.370824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331923424:7488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.370829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331923424:7488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.370833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.371324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.372701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.372713Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.372714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.372716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.372719Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1800 [2:7556555089256367276:5347]
2025-10-02T09:33:05.372726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.372736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.372741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.372743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.372744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.372752Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.372756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.372760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.372790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.372794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.372796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.372797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.372799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.372850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.372854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.372860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.372866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.372873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.372884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923458:7488], now have 1 active actors on pipe
2025-10-02T09:33:05.372890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923323:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.372893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.372894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.372895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.372900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.372908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.372909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.372910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.372912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.372917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.372918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.372932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.372920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1800
2025-10-02T09:33:05.372937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.372930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1800
2025-10-02T09:33:05.372956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.372960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.372962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.372991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.372997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.373000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.373001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.373005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.373010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.373035Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:33:05.373053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.373160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.373166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 14 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:33:05.373165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.373172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.373186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:33:05.373211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1801 partition: 0 MaxSeqNo: 36 sessionId: src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0
2025-10-02T09:33:05.373408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1221ca82-1c28df36-a91e4877-33294532_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.375832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Write session: try to update token
2025-10-02T09:33:05.375843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.381980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.381995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.381996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.381997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.382002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.382005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.382007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367271:5347]
2025-10-02T09:33:05.382028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.382031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.382032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.382039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.382043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.382047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.382135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.387110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId: src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.389134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.453587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555089331923468:8287]
2025-10-02T09:33:05.453779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1800, pipe: [1:7556555089331923468:8287]
2025-10-02T09:33:05.494547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.494873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.494883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.494908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923468:8287], now have 1 active actors on pipe
2025-10-02T09:33:05.495047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.495115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923468:8287]
2025-10-02T09:33:05.495137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:05.495137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.495148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:33:05.495165Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:33:05.495201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1801 reason: status is not ok: tablet will be restarted right now sessionId: src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0
2025-10-02T09:33:05.495250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1801 sessionId: src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0 is DEAD
2025-10-02T09:33:05.495260Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 18 consumer shared/user session shared/user_1_18_6572321245995679513_v1 is DEAD
2025-10-02T09:33:05.495354Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555029202364356:8295] disconnected; active server actors: 1
2025-10-02T09:33:05.495361Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555029202364356:8295] client user disconnected session shared/user_1_18_6572321245995679513_v1
2025-10-02T09:33:05.495461Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:33:05.495477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:05.495485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Write session will restart in 0.009495s
2025-10-02T09:33:05.495501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Write session: Do CDS request
2025-10-02T09:33:05.495506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.495570Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:05.495574Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:05.495579Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005763s
2025-10-02T09:33:05.502065Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:33:05.502180Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:33:05.502189Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 19
2025-10-02T09:33:05.502282Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 19 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:05.502316Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:05.502293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.502371Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 auth for : user
2025-10-02T09:33:05.502499Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 Handle describe topics response
2025-10-02T09:33:05.502517Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 auth is DEAD
2025-10-02T09:33:05.502519Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:33:05.502667Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:33:05.502729Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_19_4218884145141638320_v1
2025-10-02T09:33:05.502731Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555089331923570:7480] connected; active server actors: 1
2025-10-02T09:33:05.502738Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555089331923570:7480] session shared/user_1_19_4218884145141638320_v1
2025-10-02T09:33:05.502743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:33:05.502758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:33:05.502765Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_19_4218884145141638320_v1" (Sender=[1:7556555089331923566:7480], Pipe=[1:7556555089331923570:7480], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:05.502768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:33:05.502774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:33:05.502783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_19_4218884145141638320_v1" (Sender=[1:7556555089331923566:7480], Pipe=[1:7556555089331923570:7480], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:05.502789Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_19_4218884145141638320_v1" sender [1:7556555089331923566:7480] lock partition 0 for ReadingSession "shared/user_1_19_4218884145141638320_v1" (Sender=[1:7556555089331923566:7480], Pipe=[1:7556555089331923570:7480], Partitions=[], ActiveFamilyCount=1) generation 1 step 19
2025-10-02T09:33:05.502799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:33:05.502803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000024s
2025-10-02T09:33:05.502928Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 19 Session: "shared/user_1_19_4218884145141638320_v1" ClientId: "user" PipeClient { RawX1: 7556555089331923570 RawX2: 4503603922345272 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:33:05.502942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:33:05.503679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.503773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.503780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.503785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.503811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.503834Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367412:5343]
2025-10-02T09:33:05.504172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.504335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.504360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.504533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.504562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.504566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.504566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.504567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.504567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.504568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.504569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.504569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.504570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.504570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.504571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.504571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.504574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.504581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.504583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.504585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.504587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.504589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.504591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.504593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.504595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.504598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.504600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.504602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.504605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.504609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.504612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.504615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.504617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.504620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.504622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.504624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.504627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.504630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.504632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.504635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.504637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.504639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.504642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.504645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.504647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.504650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.504656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.504659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.504661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.504664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.504666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.504669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.504688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.506173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.506251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.506259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1802
2025-10-02T09:33:05.506342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.506362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.506368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.506371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.506648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1802 sessionId:  describe result for acl check
2025-10-02T09:33:05.506670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.506675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.506676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.506678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331923582:7477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.507119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331923582:7477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.509082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331923582:7477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.511835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331923582:7477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.511846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331923582:7477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.511849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331923582:7477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.511854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.512299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.513795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.513808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.513809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.513811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.513815Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1801 [2:7556555089256367412:5343]
2025-10-02T09:33:05.513821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.513830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.513832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.513833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.513834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.513843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.513851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.513855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.513887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.513891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.513892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.513894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.513895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.513935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.513940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.513946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.513952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.513960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.513977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923573:7474], now have 1 active actors on pipe
2025-10-02T09:33:05.513982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923472:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.513983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923616:7477], now have 1 active actors on pipe
2025-10-02T09:33:05.513987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.513988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.513989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.514007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1801, pipe: [1:7556555089331923573:7474]
2025-10-02T09:33:05.513995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.514002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.514005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.514008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.514024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1801
2025-10-02T09:33:05.514009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.514032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1801
2025-10-02T09:33:05.514010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.514011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.514025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.514027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.514038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.514041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.514043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.514047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_19_4218884145141638320_v1 on pipe: [1:7556555089331923573:7474]
2025-10-02T09:33:05.514071Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_19_4218884145141638320_v1:1 with generation 1801
2025-10-02T09:33:05.514080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.514082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.514087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.514090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.514091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.514099Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_19_4218884145141638320_v1
2025-10-02T09:33:05.514104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.514136Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:33:05.514157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.514163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:33:05.514165Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:33:05.514243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 15 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:33:05.514262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:33:05.516633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:33:05.516650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:33:05.516654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.516656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.516657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.516662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.516669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.516671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:33:05.516676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:33:05.516686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.516750Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397585513 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:33:05.516762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:33:05.516777Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 sending to client partition status
2025-10-02T09:33:05.516843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.516849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.516857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.516904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1802 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0
2025-10-02T09:33:05.517142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|159f6d97-f27fb50d-f4d31218-d4967e74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.519925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Write session: try to update token
2025-10-02T09:33:05.519938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.523464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.523476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.523477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.523478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.523482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.523486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.523488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367406:5343]
2025-10-02T09:33:05.523507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.523510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.523511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.523522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.523526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.523532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.523616Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.532388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId: src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.534497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.634415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.634662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.634670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.634848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_19_4218884145141638320_v1
2025-10-02T09:33:05.634862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.634880Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_19_4218884145141638320_v1
2025-10-02T09:33:05.634912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:05.634928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923573:7474]
2025-10-02T09:33:05.634942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.634975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1802 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0
2025-10-02T09:33:05.635126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1802 sessionId: src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0 is DEAD
2025-10-02T09:33:05.635238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:05.635246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Write session will restart in 0.007431s
2025-10-02T09:33:05.635264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Write session: Do CDS request
2025-10-02T09:33:05.635268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.642129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.643376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.643476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.643483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.643488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.643512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.643536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367551:5329]
2025-10-02T09:33:05.643881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.644049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.644071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.644177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.644246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.644275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.644279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.644279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.644280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.644280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.644281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.644282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.644282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.644282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.644283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.644283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.644284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.644287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.644294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.644296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.644298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.644300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.644302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.644303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.644305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.644307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.644311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.644314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.644317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.644310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.644317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1803
2025-10-02T09:33:05.644322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.644328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.644333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.644337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.644341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.644346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.644350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.644354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.644356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.644359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.644361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.644364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.644368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.644372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.644374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.644376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.644378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.644381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.644384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.644387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.644389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.644392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.644398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.644400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.644418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.644418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.644437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.644442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.644444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.644690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1803 sessionId:  describe result for acl check
2025-10-02T09:33:05.644712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.644713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.644713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.644716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331923732:7466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.645074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331923732:7466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.646511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331923732:7466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.650635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331923732:7466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.650643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331923732:7466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.650647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331923732:7466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.650651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.651888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.653333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.653346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.653347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.653350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.653354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1802 [2:7556555089256367551:5329]
2025-10-02T09:33:05.653361Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.653371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.653375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.653376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.653378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.653387Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.653394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.653398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.653429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.653434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.653435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.653437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.653438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.653488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.653493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.653500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.653506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.653515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.653530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923767:7466], now have 1 active actors on pipe
2025-10-02T09:33:05.653535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923630:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.653539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.653540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.653541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.653551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.653559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.653570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.653572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.653555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1802
2025-10-02T09:33:05.653576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.653563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1802
2025-10-02T09:33:05.653584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.653585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.653588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.653589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.653611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.653611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.653617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.653631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.653637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.653640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.653642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.653648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.653656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.653667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.653772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.653777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.653785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.653842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1803 partition: 0 MaxSeqNo: 36 sessionId: src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0
2025-10-02T09:33:05.654098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ea9e32-c84149fd-e401d472-dd11577f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.656836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Write session: try to update token
2025-10-02T09:33:05.656851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.662778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:05.662790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.662794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.662819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:05.662824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:05.662951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:05.663062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:05.663170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:05.663279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:05.663441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:05.663469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:05.669359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId: src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.671535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.671548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.671550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.671551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.671556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.671558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.671560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367546:5329]
2025-10-02T09:33:05.671580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.671584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.671586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.671586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.671589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.671592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.671704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.671818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.735212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555089331923775:7474]
2025-10-02T09:33:05.735397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1802, pipe: [1:7556555089331923775:7474]
2025-10-02T09:33:05.786678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.786971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.786981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.786993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923775:7474], now have 1 active actors on pipe
2025-10-02T09:33:05.787202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.787241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923775:7474]
2025-10-02T09:33:05.787279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:05.787281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:05.787331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1803 reason: error at write: Disconnected sessionId: src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0
2025-10-02T09:33:05.787446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.787471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1803 sessionId: src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0 is DEAD
2025-10-02T09:33:05.787623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:05.787637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Write session will restart in 0.007071s
2025-10-02T09:33:05.787659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Write session: Do CDS request
2025-10-02T09:33:05.787665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.794536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.795811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.795921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.795927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.795933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.795960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.795985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367689:5337]
2025-10-02T09:33:05.796144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.796201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.796211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1804
2025-10-02T09:33:05.796307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.796327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.796333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.796336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.796420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.796592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1804 sessionId:  describe result for acl check
2025-10-02T09:33:05.796612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.796611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.796616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.796618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.796620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331923877:7459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.796647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.796904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.796956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.796961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.796962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.796963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.796964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.796965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.796966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.796967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.796967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.796968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.796969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.796970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.796972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.796978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.796981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.796983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.796985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.796987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.796989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.796991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.796993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.796996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.796998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.797000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.797004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.797005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331923877:7459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.797008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.797012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.797015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.797017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.797020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.797022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.797025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.797028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.797030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.797032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.797035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.797038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.797041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.797043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.797046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.797048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.797051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.797054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.797056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.797061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.797063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.797066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.797068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.797088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.798576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331923877:7459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.802538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331923877:7459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.802549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331923877:7459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.802552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331923877:7459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.802556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.804772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.806223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.806234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.806236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.806238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.806241Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1803 [2:7556555089256367689:5337]
2025-10-02T09:33:05.806248Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.806259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.806260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.806262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.806263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.806271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.806278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.806282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.806312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.806317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.806318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.806320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.806321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.806427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.806433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.806439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.806445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.806454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.806442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1803
2025-10-02T09:33:05.806465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923776:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.806471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923913:7459], now have 1 active actors on pipe
2025-10-02T09:33:05.806475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.806477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.806443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1803
2025-10-02T09:33:05.806478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.806482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.806489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.806490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.806496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.806498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.806499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.806500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.806513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.806518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.806537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.806545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.806554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.806554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.806558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.806560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.806561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.806566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.806571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.806586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.806696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.806702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.806718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.806761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1804 partition: 0 MaxSeqNo: 36 sessionId: src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0
2025-10-02T09:33:05.806980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4113a5b0-d1e6aa1c-c96ee5c3-35dce910_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.809715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Write session: try to update token
2025-10-02T09:33:05.809730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.816005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.816016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.816017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.816018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.816021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.816023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.816027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367684:5337]
2025-10-02T09:33:05.816047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.816050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.816051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.816056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.816061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.816065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.816222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.822081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId: src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.824163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:05.887257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555089331923926:7474]
2025-10-02T09:33:05.887402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1803, pipe: [1:7556555089331923926:7474]
2025-10-02T09:33:05.929499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:05.929857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.929870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.929884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923926:7474], now have 1 active actors on pipe
2025-10-02T09:33:05.930026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:05.930107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:05.930109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555089331923926:7474]
2025-10-02T09:33:05.930129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:05.930186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1804 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0
2025-10-02T09:33:05.930330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1804 sessionId: src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0 is DEAD
2025-10-02T09:33:05.930706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:05.930732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Write session will restart in 0.009719s
2025-10-02T09:33:05.930753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Write session: Do CDS request
2025-10-02T09:33:05.930760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:05.937459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:05.938760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:05.938886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:05.938894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:05.938899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:05.938933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:05.938965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555089256367838:5330]
2025-10-02T09:33:05.939304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:05.939495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:05.939557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:05.939771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:05.939808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.939813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.939814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.939815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.939816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.939817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.939818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.939819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.939820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.939821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.939824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.939824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.939830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.939838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.939841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.939844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.939847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.939852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.939855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.939858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.939861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.939864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.939867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.939872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.939877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.939884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:05.939891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.939895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:05.939903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.939907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:05.939912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.939916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:05.939921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.939925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:05.939929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.939933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:05.939940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.939944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:05.939949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.939953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:05.939957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.939963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:05.939970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.939974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.939983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.939987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.939994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.939998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.940029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:05.941143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.941222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:05.941234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1805
2025-10-02T09:33:05.941331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:05.941360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:05.941369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:05.941376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:05.941630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1805 sessionId:  describe result for acl check
2025-10-02T09:33:05.941651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:05.941655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:05.941656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:05.941659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555089331924047:7454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:05.941907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555089331924047:7454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:05.943253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555089331924047:7454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:05.946904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555089331924047:7454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:05.946914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555089331924047:7454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:05.946915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555089331924047:7454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:05.946924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:05.947472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:05.948937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:05.948949Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:05.948951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:05.948954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:05.948958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1804 [2:7556555089256367838:5330]
2025-10-02T09:33:05.948968Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:05.948980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:05.948983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.948985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.948986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.948995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:05.948999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:05.949004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:05.949038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.949044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.949045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.949046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:05.949048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:05.949085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:05.949090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.949096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:05.949102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:05.949109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:05.949121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.949125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.949126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.949131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:05.949136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:05.949138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331924081:7454], now have 1 active actors on pipe
2025-10-02T09:33:05.949142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555089331923930:2446], now have 1 active actors on pipe
2025-10-02T09:33:05.949143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:05.949144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:05.949145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:05.949152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:05.949154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:05.949168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.949177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:05.949174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1804
2025-10-02T09:33:05.949193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1804
2025-10-02T09:33:05.949200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.949205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.949203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:05.949219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:05.949227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:05.949229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:05.949230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:05.949235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:05.949240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:05.949250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.949349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:05.949353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:05.949360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:05.949401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1805 partition: 0 MaxSeqNo: 36 sessionId: src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0
2025-10-02T09:33:05.949588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7149de68-1ac34119-2f6777c1-6f7516c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:05.952328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Write session: try to update token
2025-10-02T09:33:05.952342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:05.958289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:05.958302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:05.958304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:05.958305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:05.958308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.958311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.958314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555089256367833:5330]
2025-10-02T09:33:05.958333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:05.958337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:05.958338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:05.958340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:05.958341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:05.958343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:05.958453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:05.964254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId: src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:05.966579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.030111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626891407:7474]
2025-10-02T09:33:06.030272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1804, pipe: [1:7556555093626891407:7474]
2025-10-02T09:33:06.069789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.070103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.070113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.070126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891407:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.070272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.070299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:06.070312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:06.070325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.070355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626891407:7474]
2025-10-02T09:33:06.070368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1805 reason: error at write: Disconnected sessionId: src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0
2025-10-02T09:33:06.070496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1805 sessionId: src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0 is DEAD
2025-10-02T09:33:06.070655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:06.070669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Write session will restart in 0.009896s
2025-10-02T09:33:06.070693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Write session: Do CDS request
2025-10-02T09:33:06.070699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.077561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.078916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.079034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.079041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.079046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.079075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.079100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551335311:5313]
2025-10-02T09:33:06.079447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.079625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.079654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.079919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.079957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.079962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.079962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.079963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.079963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.079964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.079964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.079965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.079965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.079966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.079966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.079967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.079970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.079976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.079978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.079980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.079982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.079984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.079987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.079989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.079991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.079993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.079995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.079997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.080002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.080006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.080009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.080012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.080014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.080016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.080018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.080021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.080024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.080027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.080029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.080033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.080035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.080037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.080039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.080042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.080044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.080047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.080049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.080051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.080054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.080056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.080058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.080060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.080078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.081204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.081271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.081281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1806
2025-10-02T09:33:06.081430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.081449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.081455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.081458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.081710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1806 sessionId:  describe result for acl check
2025-10-02T09:33:06.081732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.081736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.081737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.081740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626891514:7436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.082080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626891514:7436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.083736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626891514:7436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.087008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626891514:7436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.087017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626891514:7436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.087020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626891514:7436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.087024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.087512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.088978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.088989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.088990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.088992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.088995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1805 [2:7556555093551335311:5313]
2025-10-02T09:33:06.089002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.089013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.089019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.089021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.089022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.089031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.089033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.089041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.089071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.089077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.089078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.089080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.089081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.089122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.089128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.089134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.089140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.089147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.089162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891409:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.089166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891549:7436], now have 1 active actors on pipe
2025-10-02T09:33:06.089169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.089170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.089172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.089179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.089186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.089190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.089192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.089194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.089197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.089198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.089213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.089203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1805
2025-10-02T09:33:06.089216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.089207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1805
2025-10-02T09:33:06.089236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.089235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.089241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.089255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.089260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.089263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.089264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.089269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.089274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.089281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.089578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.089592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.089606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.089672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1806 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0
2025-10-02T09:33:06.089876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12ddf08-8ae69cd9-cde5cbf6-6814cf61_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.092294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Write session: try to update token
2025-10-02T09:33:06.092304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.098459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.098472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.098473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.098474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.098479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.098481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.098483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551335306:5313]
2025-10-02T09:33:06.098506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.098510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.098511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.098515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.098519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.098522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.098671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.104712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId: src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.107042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.170409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626891556:7474]
2025-10-02T09:33:06.170598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1805, pipe: [1:7556555093626891556:7474]
2025-10-02T09:33:06.207815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.208042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.208050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.208062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891556:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.208181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.208254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626891556:7474]
2025-10-02T09:33:06.208258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.208279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:06.208333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1806 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0
2025-10-02T09:33:06.208465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1806 sessionId: src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0 is DEAD
2025-10-02T09:33:06.208625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:06.208640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Write session will restart in 0.006714s
2025-10-02T09:33:06.208661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Write session: Do CDS request
2025-10-02T09:33:06.208667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.216170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.216230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.216240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1807
2025-10-02T09:33:06.216398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.216418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.216424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.216427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.216711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1807 sessionId:  describe result for acl check
2025-10-02T09:33:06.216692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.216733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.216738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.216739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.216742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626891659:7432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.217109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626891659:7432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.218274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.218446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.218454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.218461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.218469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626891659:7432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.218502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.218527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551335452:5311]
2025-10-02T09:33:06.218875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.219086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.219114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.219294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.219322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.219326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.219327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.219327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.219328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.219328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.219329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.219329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.219330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.219330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.219331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.219331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.219334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.219340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.219342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.219344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.219346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.219348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.219350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.219352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.219354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.219356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.219358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.219360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.219363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.219367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.219370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.219373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.219375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.219377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.219380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.219382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.219385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.219388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.219390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.219393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.219395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.219398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.219399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.219402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.219405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.219408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.219410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.219413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.219415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.219417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.219419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.219422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.219440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.223317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626891659:7432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.223326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626891659:7432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.223328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626891659:7432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.223333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.226857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.228458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.228471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.228472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.228474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.228477Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1806 [2:7556555093551335452:5311]
2025-10-02T09:33:06.228484Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.228494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.228497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.228498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.228499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.228508Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.228511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.228516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.228545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.228550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.228552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.228554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.228555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.228594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.228599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.228606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.228611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.228619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.228629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.228633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.228635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.228640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.228647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.228650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891698:7432], now have 1 active actors on pipe
2025-10-02T09:33:06.228652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891558:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.228656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.228657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.228658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.228664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.228666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.228680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.228691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.228684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1806
2025-10-02T09:33:06.228690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1806
2025-10-02T09:33:06.228723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.228786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.228793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.228872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.228882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.228884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.228886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.228891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.228897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.228909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.229044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.229051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.229060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.229118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1807 partition: 0 MaxSeqNo: 36 sessionId: src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0
2025-10-02T09:33:06.229357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7470dfc-41d23b84-36ccdfc7-441d6674_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.231521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Write session: try to update token
2025-10-02T09:33:06.231530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.238117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.238131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.238132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.238133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.238138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.238140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.238143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551335447:5311]
2025-10-02T09:33:06.238167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.238170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.238171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.238173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.238177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.238180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.238276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.243022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId: src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.245556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.308637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626891708:7474]
2025-10-02T09:33:06.308837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1806, pipe: [1:7556555093626891708:7474]
2025-10-02T09:33:06.348157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.348358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.348367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.348389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891708:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.348504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.348589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626891708:7474]
2025-10-02T09:33:06.348606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.348609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:06.348672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1807 reason: status is not ok: tablet will be restarted right now sessionId: src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0
2025-10-02T09:33:06.348799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1807 sessionId: src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0 is DEAD
2025-10-02T09:33:06.348928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:06.348940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Write session will restart in 0.009035s
2025-10-02T09:33:06.348964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Write session: Do CDS request
2025-10-02T09:33:06.348969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.356534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.357833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.357930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.357937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.357942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.357967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.357991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551335593:5309]
2025-10-02T09:33:06.358336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.358501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.358524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.358720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.358752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.358756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.358757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.358757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.358758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.358758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.358759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.358759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.358760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.358760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.358761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.358762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.358764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.358771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.358773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.358775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.358777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.358779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.358781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.358783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.358785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.358787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.358789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.358791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.358795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.358799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.358803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.358806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.358808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.358810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.358812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.358815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.358817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.358820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.358822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.358824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.358827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.358830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.358832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.358834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.358837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.358839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.358841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.358844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.358846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.358849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.358852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.358854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.358872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.359204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.359213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.359222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1808
2025-10-02T09:33:06.359429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.359447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.359453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.359456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.359723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1808 sessionId:  describe result for acl check
2025-10-02T09:33:06.359746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.359752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.359754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.359757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626891817:7423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.360121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626891817:7423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.361740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626891817:7423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.365919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626891817:7423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.365929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626891817:7423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.365932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626891817:7423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.365936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.366462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.367966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.367977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.367978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.367980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.367983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1807 [2:7556555093551335593:5309]
2025-10-02T09:33:06.367993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.368001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.368002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.368004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.368005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.368014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.368017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.368021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.368053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.368058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.368059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.368061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.368062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.368099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.368104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.368111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.368116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.368124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.368136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891710:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.368142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891852:7423], now have 1 active actors on pipe
2025-10-02T09:33:06.368145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.368147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.368149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.368154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.368161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.368163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.368166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.368167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.368168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.368170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.368185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.368191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.368186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1807
2025-10-02T09:33:06.368190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1807
2025-10-02T09:33:06.368220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.368230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.368232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.368245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8115582f-578c856d-ab34ba48-bea4a3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.368249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.368251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.368252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.368257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.368263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.368269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.368371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.368376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.368384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.368445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1808 partition: 0 MaxSeqNo: 36 sessionId: src_id|8115582f-578c856d-ab34ba48-bea4a3b_0
2025-10-02T09:33:06.368633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866b9b4f-69cb5a44-485dce87-8dc6206_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8115582f-578c856d-ab34ba48-bea4a3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.370804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Write session: try to update token
2025-10-02T09:33:06.370814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.377644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.377658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.377659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.377660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.377667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.377669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.377671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551335588:5309]
2025-10-02T09:33:06.377694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.377697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.377699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.377702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.377706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.377711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.377803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.382289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId: src_id|8115582f-578c856d-ab34ba48-bea4a3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.384276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.448939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626891859:7474]
2025-10-02T09:33:06.449161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1807, pipe: [1:7556555093626891859:7474]
2025-10-02T09:33:06.492202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.492454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.492461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.492486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891859:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.492664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.492678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.492715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626891859:7474]
2025-10-02T09:33:06.492720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:06.492727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:06.492771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1808 reason: error at write: Disconnected sessionId: src_id|8115582f-578c856d-ab34ba48-bea4a3b_0
2025-10-02T09:33:06.492887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1808 sessionId: src_id|8115582f-578c856d-ab34ba48-bea4a3b_0 is DEAD
2025-10-02T09:33:06.492998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:06.493006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Write session will restart in 0.006424s
2025-10-02T09:33:06.493021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Write session: Do CDS request
2025-10-02T09:33:06.493025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.499999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.500069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.500148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.500157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1809
2025-10-02T09:33:06.500242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.500262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.500268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.500271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.500531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1809 sessionId:  describe result for acl check
2025-10-02T09:33:06.500554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.500558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.500559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.500562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626891964:7418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.500922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626891964:7418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.501400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.501496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.501502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.501508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.501533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.501555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551335735:5306]
2025-10-02T09:33:06.501887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.502073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.502097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.502283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.502316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.502320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.502321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.502321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.502322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.502322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.502323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.502324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.502324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.502325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.502325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.502326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.502328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.502335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.502337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.502339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.502341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.502343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.502345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.502347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.502349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.502351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.502353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.502355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.502359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.502363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.502366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.502369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.502371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.502374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.502375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.502378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.502381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.502383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.502386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.502388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.502390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.502393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.502395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.502397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.502399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.502403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.502404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.502407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.502409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.502412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.502415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.502418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.502434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.502507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626891964:7418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.507164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626891964:7418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.507173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626891964:7418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.507175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626891964:7418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.507179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.509838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.511340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.511353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.511354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.511356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.511359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1808 [2:7556555093551335735:5306]
2025-10-02T09:33:06.511366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.511376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.511377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.511379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.511380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.511389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.511395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.511399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.511428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.511432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.511434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.511436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.511437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.511475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.511479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.511486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.511491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.511500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.511513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892003:7418], now have 1 active actors on pipe
2025-10-02T09:33:06.511520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.511521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.511522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.511530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.511534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626891860:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.511538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.511542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.511545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.511546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.511549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.511551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.511566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.511569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.511564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1808
2025-10-02T09:33:06.511567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1808
2025-10-02T09:33:06.511593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.511593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.511598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.511615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.511621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.511624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.511625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.511629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.511634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.511641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.511732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.511737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.511744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.511796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1809 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0
2025-10-02T09:33:06.511994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8115582f-578c856d-ab34ba48-bea4a3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.514158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Write session: try to update token
2025-10-02T09:33:06.514169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.520898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.520913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.520914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.520916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.520921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.520925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.520929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551335730:5306]
2025-10-02T09:33:06.520950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.520954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.520955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.520961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.520965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.520969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.521091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.526042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId: src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.528257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.592782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626892020:7474]
2025-10-02T09:33:06.592975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1808, pipe: [1:7556555093626892020:7474]
2025-10-02T09:33:06.631886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.632186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.632194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.632219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892020:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.632365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.632439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626892020:7474]
2025-10-02T09:33:06.632457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:06.632467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.632526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1809 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0
2025-10-02T09:33:06.632631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1809 sessionId: src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0 is DEAD
2025-10-02T09:33:06.632746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:06.632754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Write session will restart in 0.009511s
2025-10-02T09:33:06.632770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Write session: Do CDS request
2025-10-02T09:33:06.632774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.639844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.641243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.641354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.641361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.641367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.641393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.641418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551335878:5300]
2025-10-02T09:33:06.641763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.641937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.641960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.642138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.642168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.642172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.642172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.642173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.642173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.642174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.642174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.642175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.642176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.642176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.642176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.642177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.642180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.642187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.642189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.642191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.642194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.642196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.642198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.642200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.642202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.642204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.642206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.642208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.642212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.642216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.642219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.642222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.642225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.642227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.642229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.642232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.642234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.642237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.642239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.642242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.642246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.642252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.642256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.642264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.642270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.642279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.642282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.642285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.642287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.642290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.642293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.642296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.642313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.643147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.643178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.643186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1810
2025-10-02T09:33:06.643293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.643312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.643318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.643320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.643572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1810 sessionId:  describe result for acl check
2025-10-02T09:33:06.643594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.643598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.643599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.643602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626892130:7407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.643943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626892130:7407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.645385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626892130:7407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.649295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626892130:7407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.649304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626892130:7407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.649306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626892130:7407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.649310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.649851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.651353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.651366Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.651367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.651369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.651372Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1809 [2:7556555093551335878:5300]
2025-10-02T09:33:06.651378Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.651388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.651394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.651395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.651397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.651405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.651408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.651412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.651443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.651448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.651449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.651451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.651452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.651487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.651492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.651499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.651504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.651512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.651526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892021:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.651532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892165:7407], now have 1 active actors on pipe
2025-10-02T09:33:06.651536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.651537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.651538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.651545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.651552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.651559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.651562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.651563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.651565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.651566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.651577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.651579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.651567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1809
2025-10-02T09:33:06.651587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.651569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1809
2025-10-02T09:33:06.651601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.651609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.651634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.651641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.651644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.651645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.651650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.651656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.651663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.651744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.651749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.651756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.651805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1810 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0
2025-10-02T09:33:06.651956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec8f649-8d0ae1d5-ffdfcb2c-b8276d8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.654135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Write session: try to update token
2025-10-02T09:33:06.654143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.660727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.660740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.660741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.660742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.660749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.660751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.660752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551335873:5300]
2025-10-02T09:33:06.660774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.660776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.660777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.660784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.660788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.660792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.660897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.665580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId: src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.667765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.732573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626892173:7474]
2025-10-02T09:33:06.732744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1809, pipe: [1:7556555093626892173:7474]
2025-10-02T09:33:06.771475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.771719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.771728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.771754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892173:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.771908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.771936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.771972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626892173:7474]
2025-10-02T09:33:06.771974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:06.772029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1810 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0
2025-10-02T09:33:06.772153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1810 sessionId: src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0 is DEAD
2025-10-02T09:33:06.772300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:06.772309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Write session will restart in 0.007989s
2025-10-02T09:33:06.772330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Write session: Do CDS request
2025-10-02T09:33:06.772335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.780103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.781113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.781208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.781216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1811
2025-10-02T09:33:06.781310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.781330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.781335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.781338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.781390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.781491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.781497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.781503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.781529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.781555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551336022:5298]
2025-10-02T09:33:06.781625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1811 sessionId:  describe result for acl check
2025-10-02T09:33:06.781648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.781653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.781654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.781657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626892280:7401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.781893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.781999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626892280:7401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.782064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.782137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.782315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.782345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.782349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.782349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.782350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.782350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.782351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.782352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.782352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.782353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.782353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.782354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.782354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.782358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.782367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.782370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.782374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.782377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.782381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.782384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.782387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.782391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.782395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.782398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.782399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.782404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.782408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.782413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.782419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.782421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.782424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.782426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.782432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.782435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.782437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.782441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.782443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.782447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.782450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.782452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.782454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.782457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.782459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.782461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.782464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.782468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.782471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.782473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.782475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.782493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.783538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626892280:7401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.788001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626892280:7401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.788010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626892280:7401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.788012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626892280:7401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.788016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.790227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.791787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.791798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.791799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.791802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.791805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1810 [2:7556555093551336022:5298]
2025-10-02T09:33:06.791814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.791824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.791829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.791832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.791833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.791843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.791850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.791854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.791887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.791892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.791893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.791895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.791898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.791949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.791954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.791961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.791966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.791975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.791989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892319:7401], now have 1 active actors on pipe
2025-10-02T09:33:06.791994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892174:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.791998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.791999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.792000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.792007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.792015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.792026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.792026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.792029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.792030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.792031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.792037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1810
2025-10-02T09:33:06.792048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.792052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.792037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1810
2025-10-02T09:33:06.792067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.792068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.792072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.792093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.792101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.792104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.792105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.792110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.792116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.792128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.792215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.792220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.792228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.792286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1811 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0
2025-10-02T09:33:06.792515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b2d62c0-33dc6c5e-1eb7c41c-b68056d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.794690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Write session: try to update token
2025-10-02T09:33:06.794701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.801350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.801366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.801368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.801369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.801379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.801381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.801384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551336017:5298]
2025-10-02T09:33:06.801415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.801418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.801419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.801427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.801434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.801441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.801531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.806396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId: src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.808507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:06.872349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555093626892332:7474]
2025-10-02T09:33:06.872552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1810, pipe: [1:7556555093626892332:7474]
2025-10-02T09:33:06.914498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:06.914704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.914722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.914746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892332:7474], now have 1 active actors on pipe
2025-10-02T09:33:06.914891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:06.914945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555093626892332:7474]
2025-10-02T09:33:06.914972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:06.914974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:06.914979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:06.915053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1811 reason: error at write: Disconnected sessionId: src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0
2025-10-02T09:33:06.915182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1811 sessionId: src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0 is DEAD
2025-10-02T09:33:06.915290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 122 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:33:06.915314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:06.915316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Write session will restart in 0.006316s
2025-10-02T09:33:06.915332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Write session: Do CDS request
2025-10-02T09:33:06.915336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:06.922081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.922163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:06.922171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1812
2025-10-02T09:33:06.922244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:06.922262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:06.922268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:06.922271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:06.922554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1812 sessionId:  describe result for acl check
2025-10-02T09:33:06.922571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:06.922576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:06.922577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:06.922580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555093626892440:7391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:06.922932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555093626892440:7391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:06.923448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:06.924491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555093626892440:7391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:06.924951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:06.925051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:06.925057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:06.925063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:06.925089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:06.925172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555093551336179:5288]
2025-10-02T09:33:06.925512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:06.925724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:06.925749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:06.925937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:06.925969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.925973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.925974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.925974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.925975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.925975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.925976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.925976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.925977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.925977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.925978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.925979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.925982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.925988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.925990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.925992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.925994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.925996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.925998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.926000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.926002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.926004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.926006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.926008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.926012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.926016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:06.926018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.926021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:06.926023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.926026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:06.926028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.926031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:06.926033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.926036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:06.926039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.926042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:06.926044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.926046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:06.926048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.926051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:06.926053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.926056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:06.926058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.926061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.926063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.926066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.926068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.926070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.926087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:06.926504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555093626892440:7391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:06.926512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555093626892440:7391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:06.926514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555093626892440:7391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:06.926517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:06.933449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:06.934879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:06.934890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:06.934892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:06.934893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:06.934897Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1811 [2:7556555093551336179:5288]
2025-10-02T09:33:06.934948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:06.934960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:06.934962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.934963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.934964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.934973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:06.934978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:06.934984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:06.935013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.935017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.935018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.935020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:06.935021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:06.935058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:06.935063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.935069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:06.935075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:06.935082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:06.935095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.935100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.935101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.935106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:06.935114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892481:7391], now have 1 active actors on pipe
2025-10-02T09:33:06.935116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:06.935119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:06.935120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555093626892336:2446], now have 1 active actors on pipe
2025-10-02T09:33:06.935120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:06.935125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:06.935133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:06.935134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:06.935148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.935153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:06.935143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1811
2025-10-02T09:33:06.935152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1811
2025-10-02T09:33:06.935176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.935175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:06.935181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.935194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:06.935201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:06.935203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:06.935204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:06.935209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:06.935215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:06.935222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.935323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:06.935342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:06.935359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:06.935427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1812 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0
2025-10-02T09:33:06.935625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1ea1a-7640e8cf-c5cb0121-5dfb81bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:06.937858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Write session: try to update token
2025-10-02T09:33:06.937869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:06.944338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:06.944353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:06.944354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:06.944355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:06.944359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.944361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.944363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555093551336174:5288]
2025-10-02T09:33:06.944385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:06.944388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:06.944389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:06.944391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:06.944395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:06.944397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:06.944499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:06.949153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId: src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:06.951145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.015178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921859811:7474]
2025-10-02T09:33:07.015331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1811, pipe: [1:7556555097921859811:7474]
2025-10-02T09:33:07.053755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.053968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.053978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.054002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921859811:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.054173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:07.054202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921859811:7474]
2025-10-02T09:33:07.054214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.054228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:07.054284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1812 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0
2025-10-02T09:33:07.054432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1812 sessionId: src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0 is DEAD
2025-10-02T09:33:07.054543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:07.054551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Write session will restart in 0.007177s
2025-10-02T09:33:07.054569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Write session: Do CDS request
2025-10-02T09:33:07.054573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.061598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.062940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.063047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.063055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.063061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.063090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.063113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846303659:5250]
2025-10-02T09:33:07.063187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.063193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.063202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1813
2025-10-02T09:33:07.063334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.063352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.063357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.063360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.063460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.063630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1813 sessionId:  describe result for acl check
2025-10-02T09:33:07.063630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.063654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.063653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.063658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.063659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.063661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921859931:7373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.063848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.063883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.063887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.063887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.063888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.063888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.063889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.063889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.063890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.063890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.063891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.063891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.063892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.063894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.063900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.063902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.063904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.063906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.063908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.063910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.063912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.063914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.063916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.063918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.063920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.063925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.063929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.063932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.063935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.063937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.063940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.063942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.063945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.063947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.063949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.063951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.063954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.063956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.063959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.063961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.063963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.063966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.063969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.063971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.063974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.063978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.063980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.063982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.063985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.063977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921859931:7373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.064000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.065402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921859931:7373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.069396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921859931:7373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.069407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921859931:7373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.069409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921859931:7373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.069415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.071418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.072855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.072865Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.072866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.072868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.072871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1812 [2:7556555097846303659:5250]
2025-10-02T09:33:07.072877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.072887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.072888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.072890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.072891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.072899Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.072902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.072906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.072933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.072938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.072939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.072942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.072944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.072981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.072986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.072993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.072998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.073011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.073029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921859968:7373], now have 1 active actors on pipe
2025-10-02T09:33:07.073036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921859821:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.073040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.073041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.073043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.073051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.073060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.073065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.073068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.073069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.073073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.073075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.073082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.073077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1812
2025-10-02T09:33:07.073089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.073078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1812
2025-10-02T09:33:07.073096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.073167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.073173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.073193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6edb72c-a795710b-467062bd-8a309e69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.073199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.073201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.073202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.073208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.073213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.073221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.073311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.073316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.073323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.073373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1813 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6edb72c-a795710b-467062bd-8a309e69_0
2025-10-02T09:33:07.073553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e4a2f7-b52b5a3a-a51d6a8c-9fa85d78_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6edb72c-a795710b-467062bd-8a309e69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.075701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Write session: try to update token
2025-10-02T09:33:07.075710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.082192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.082206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.082208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.082210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.082217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.082220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.082223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846303654:5250]
2025-10-02T09:33:07.082251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.082251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.082255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.082258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.082259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.082261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.082362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.087114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId: src_id|f6edb72c-a795710b-467062bd-8a309e69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.089432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.154485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921859975:7474]
2025-10-02T09:33:07.154678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1812, pipe: [1:7556555097921859975:7474]
2025-10-02T09:33:07.190775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.190974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.190982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.191008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921859975:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.191196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921859975:7474]
2025-10-02T09:33:07.191203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:07.191216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:07.191217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:07.191234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.191261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1813 reason: error at write: Disconnected sessionId: src_id|f6edb72c-a795710b-467062bd-8a309e69_0
2025-10-02T09:33:07.191401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1813 sessionId: src_id|f6edb72c-a795710b-467062bd-8a309e69_0 is DEAD
2025-10-02T09:33:07.191486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:07.191493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Write session will restart in 0.008285s
2025-10-02T09:33:07.191507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Write session: Do CDS request
2025-10-02T09:33:07.191511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.198990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.200350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.200447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.200453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.200459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.200485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.200509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846303805:5258]
2025-10-02T09:33:07.200861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.201036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.201057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.201121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.201198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.201206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1814
2025-10-02T09:33:07.201227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.201256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.201260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.201260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.201261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.201261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.201262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.201262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.201263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.201263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.201264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.201264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.201265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.201267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.201274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.201276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.201278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.201280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.201282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.201284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.201286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.201287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.201289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.201291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.201293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.201297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.201301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.201303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.201305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.201307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.201309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.201312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.201321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.201327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.201330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.201314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.201317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.201319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.201322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.201324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.201326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.201329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.201332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.201334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.201336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.201339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.201342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.201344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.201347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.201350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.201355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.201358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.201362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.201391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.201622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1814 sessionId:  describe result for acl check
2025-10-02T09:33:07.201645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.201650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.201651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.201655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921860090:7369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.201986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921860090:7369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.203429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921860090:7369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.207537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921860090:7369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.207548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921860090:7369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.207551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921860090:7369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.207555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.208772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.210219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.210230Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.210231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.210233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.210236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1813 [2:7556555097846303805:5258]
2025-10-02T09:33:07.210245Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.210255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.210256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.210258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.210259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.210267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.210271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.210275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.210380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.210386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.210387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.210388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.210390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.210428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.210433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.210439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.210445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.210453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.210464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860125:7369], now have 1 active actors on pipe
2025-10-02T09:33:07.210471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.210473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.210474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.210481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.210486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921859977:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.210493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.210494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.210496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.210498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.210501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.210502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.210515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.210525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.210527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.210518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1813
2025-10-02T09:33:07.210546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1813
2025-10-02T09:33:07.210591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.210596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.210609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.210613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.210616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.210617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.210622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.210631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.210638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.210794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.210798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.210805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.210882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1814 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0
2025-10-02T09:33:07.211088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6edb72c-a795710b-467062bd-8a309e69_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.213374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Write session: try to update token
2025-10-02T09:33:07.213384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.219455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:07.219470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.219475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.219498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:07.219503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:07.219644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:07.219757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.219875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.219984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.220137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:07.220162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:07.225016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId: src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.227071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.227836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.227850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.227860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.227862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.227863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.227864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.227870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.227872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.227874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846303800:5258]
2025-10-02T09:33:07.227897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.227901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.227902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.227904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.227908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.227912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.228004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.291165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921860134:7474]
2025-10-02T09:33:07.291337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1813, pipe: [1:7556555097921860134:7474]
2025-10-02T09:33:07.336998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.337234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:07.337258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860134:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.337343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:07.337378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.337405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921860134:7474]
2025-10-02T09:33:07.337408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:07.337410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:07.337458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1814 reason: error at write: Disconnected sessionId: src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0
2025-10-02T09:33:07.337577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1814 sessionId: src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0 is DEAD
2025-10-02T09:33:07.337698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:07.337706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Write session will restart in 0.009615s
2025-10-02T09:33:07.337720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Write session: Do CDS request
2025-10-02T09:33:07.337725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.345628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.347068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.347177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.347183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.347189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.347216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.347239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846303954:5251]
2025-10-02T09:33:07.347600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.348120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.348202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.348210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1815
2025-10-02T09:33:07.348298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.348315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.348321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.348323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.348680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1815 sessionId:  describe result for acl check
2025-10-02T09:33:07.348711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.348718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.348720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.348726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921860262:7355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.349136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921860262:7355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.350493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921860262:7355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.350549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.350580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.350788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.350824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.350828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.350829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.350829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.350830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.350830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.350831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.350831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.350832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.350832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.350833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.350833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.350836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.350842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.350844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.350846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.350848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.350850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.350852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.350854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.350856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.350858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.350860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.350862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.350866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.350870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.350873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.350876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.350878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.350881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.350883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.350886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.350889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.350892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.350894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.350897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.350900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.350902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.350906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.350909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.350911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.350914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.350916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.350919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.350921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.350923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.350926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.350929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.350946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.355048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921860262:7355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.355056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921860262:7355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.355058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921860262:7355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.355061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.369332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.371036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.371046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.371047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.371049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.371053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1814 [2:7556555097846303954:5251]
2025-10-02T09:33:07.371060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.371070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.371072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.371074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.371075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.371084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.371089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.371093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.371127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.371132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.371133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.371135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.371137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.371179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.371184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.371190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.371196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.371204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.371219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860302:7355], now have 1 active actors on pipe
2025-10-02T09:33:07.371227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860135:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.371234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.371240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.371242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.371253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.371265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.371269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.371271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.371273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.371275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.371277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.371292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.371301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.371307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.371294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1814
2025-10-02T09:33:07.371300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1814
2025-10-02T09:33:07.371322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.371327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.371348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.371355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.371357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.371358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.371363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.371370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.371379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.371471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.371476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.371485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.371532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1815 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0
2025-10-02T09:33:07.371764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b425375-2da3c3da-c4d8b6f4-19cd8b4e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.374069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Write session: try to update token
2025-10-02T09:33:07.374079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.380753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.380768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.380769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.380771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.380775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.380780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.380782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846303949:5251]
2025-10-02T09:33:07.380816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.380819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.380820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.380821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.380825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.380827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.380929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.386215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId: src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.388398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.437613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921860311:7474]
2025-10-02T09:33:07.437809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1814, pipe: [1:7556555097921860311:7474]
2025-10-02T09:33:07.493560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.493841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.493849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.493862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860311:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.494121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921860311:7474]
2025-10-02T09:33:07.494125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.494146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:07.494148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:07.494194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1815 reason: error at write: Disconnected sessionId: src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0
2025-10-02T09:33:07.494328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1815 sessionId: src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0 is DEAD
2025-10-02T09:33:07.494672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:07.494682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Write session will restart in 0.005002s
2025-10-02T09:33:07.494696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Write session: Do CDS request
2025-10-02T09:33:07.494711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.494732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:07.501106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.501192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.501200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1816
2025-10-02T09:33:07.501288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.501309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.501312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.501315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.501588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1816 sessionId:  describe result for acl check
2025-10-02T09:33:07.501614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.501615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.501618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.501621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921860420:7352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.501961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921860420:7352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.502470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.503491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921860420:7352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.503851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.503955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.503961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.503966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.503993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.504017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846304103:5255]
2025-10-02T09:33:07.504394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.504580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.504615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.504810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.504842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.504846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.504847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.504847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.504848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.504849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.504849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.504850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.504851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.504852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.504853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.504854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.504858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.504866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.504870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.504873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.504876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.504882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.504886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.504889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.504892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.504898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.504900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.504902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.504905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.504909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.504914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.504917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.504919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.504922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.504925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.504928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.504930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.504933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.504935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.504939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.504941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.504944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.504946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.504949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.504955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.504958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.504960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.504962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.504965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.504968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.504970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.504972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.504989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.504998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921860420:7352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.505006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921860420:7352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.505008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921860420:7352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.505011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.512413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.513900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.513911Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.513912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.513915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.513918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1815 [2:7556555097846304103:5255]
2025-10-02T09:33:07.513925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.513935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.513936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.513937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.513938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.513947Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.513955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.513959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.513990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.513994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.513995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.513997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.513999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.514119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.514125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.514131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.514119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1815
2025-10-02T09:33:07.514130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1815
2025-10-02T09:33:07.514137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.514147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.514162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860459:7352], now have 1 active actors on pipe
2025-10-02T09:33:07.514167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860312:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.514178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.514182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.514193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.514197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.514198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.514207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.514216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.514219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.514221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.514222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.514225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.514227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.514235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10934af0-e123a100-3338cf84-d6ea928b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.514242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.514244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.514245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.514250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.514257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.514272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.514280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.514286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.514288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.514393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.514398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.514407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.514455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1816 partition: 0 MaxSeqNo: 36 sessionId: src_id|10934af0-e123a100-3338cf84-d6ea928b_0
2025-10-02T09:33:07.514644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5322fca-d1d2fa81-4d02a7c0-94e23b8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10934af0-e123a100-3338cf84-d6ea928b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.516823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Write session: try to update token
2025-10-02T09:33:07.516833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.523560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.523577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.523578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.523579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.523584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.523587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.523589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846304098:5255]
2025-10-02T09:33:07.523611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.523614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.523613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.523615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.523616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.523619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.523713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.528542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId: src_id|10934af0-e123a100-3338cf84-d6ea928b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.530685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.594277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921860470:7474]
2025-10-02T09:33:07.594436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1815, pipe: [1:7556555097921860470:7474]
2025-10-02T09:33:07.634059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.634266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.634275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.634299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860470:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.634516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921860470:7474]
2025-10-02T09:33:07.634519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:07.634523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:07.634546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.634578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1816 reason: error at write: Disconnected sessionId: src_id|10934af0-e123a100-3338cf84-d6ea928b_0
2025-10-02T09:33:07.634720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1816 sessionId: src_id|10934af0-e123a100-3338cf84-d6ea928b_0 is DEAD
2025-10-02T09:33:07.634772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:07.634854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:07.634863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Write session will restart in 0.008070s
2025-10-02T09:33:07.634877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Write session: Do CDS request
2025-10-02T09:33:07.634882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.642235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.643531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.643643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.643649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.643655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.643682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.643707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846304253:5252]
2025-10-02T09:33:07.644060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.644129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.644189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.644200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1817
2025-10-02T09:33:07.644233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.644257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.644289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.644308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.644315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.644317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.644462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.644496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.644500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.644501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.644501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.644502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.644502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.644503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.644504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.644504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.644505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.644505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.644506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.644508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.644515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.644517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.644519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.644521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.644523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.644525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.644527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.644529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.644531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.644533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.644535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.644539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.644543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.644546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.644549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.644552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.644555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.644557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.644560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.644562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.644565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.644567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.644570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.644572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.644574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.644576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.644579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.644582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.644584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.644588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.644591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.644599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.644605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.644607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.644610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.644629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.644654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1817 sessionId:  describe result for acl check
2025-10-02T09:33:07.644678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.644681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.644683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.644686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921860585:7341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.645061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921860585:7341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.646327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921860585:7341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.650010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921860585:7341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.650019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921860585:7341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.650021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921860585:7341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.650025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.652247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.653801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.653813Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.653815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.653817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.653821Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1816 [2:7556555097846304253:5252]
2025-10-02T09:33:07.653827Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.653836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.653838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.653840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.653841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.653852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.653861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.653866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.653897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.653903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.653904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.653906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.653907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.653946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.653951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.653958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.653963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.653971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.653984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860621:7341], now have 1 active actors on pipe
2025-10-02T09:33:07.653990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.653992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.653993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.654001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.654006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860471:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.654010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.654013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.654016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.654018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.654021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.654023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.654037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.654039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.654030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1816
2025-10-02T09:33:07.654050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.654050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1816
2025-10-02T09:33:07.654057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.654059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.654075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.654081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.654084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.654085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.654090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.654095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.654106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.654207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.654215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.654223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.654285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1817 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0
2025-10-02T09:33:07.654472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10934af0-e123a100-3338cf84-d6ea928b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.656790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Write session: try to update token
2025-10-02T09:33:07.656812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.667826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:07.667842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.667847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.667877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:07.667891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:07.668025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:07.668148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.668273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.668392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.668574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:07.668601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:07.668900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId: src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.671138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.671301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.671312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.672119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.672130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.672131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.672132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.672136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.672139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.672142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846304248:5252]
2025-10-02T09:33:07.672162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:07.672164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.672167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.672169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.672178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.672181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.672183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.672221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:07.672295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.734573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921860630:7474]
2025-10-02T09:33:07.734780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1816, pipe: [1:7556555097921860630:7474]
2025-10-02T09:33:07.788554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.794869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.794894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.795018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.795068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.795122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.795181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.795218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.795224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.795277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.795326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.795378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.795440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.795479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.795484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.795535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.795584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.795635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.795693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.795733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.795738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.795790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.795840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.795892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.795945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.795980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.795985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.796055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.796103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.796173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.796225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.796263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.796268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.796318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.796367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.796422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.796478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.796513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.796519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.796569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.796618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.796674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.796782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.796830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.796835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.796890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.796947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.796995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.797046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.797080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.797085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.797134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.797183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.797233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.797283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.797316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.797320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.797367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:07.797412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:07.797469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:07.797518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:07.797567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:07.797572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:07.797605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860630:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.797783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.797822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921860630:7474]
2025-10-02T09:33:07.797823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:07.797824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:07.797842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1817 reason: error at write: Disconnected sessionId: src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0
2025-10-02T09:33:07.797989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1817 sessionId: src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0 is DEAD
2025-10-02T09:33:07.798123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:07.798133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Write session will restart in 0.007874s
2025-10-02T09:33:07.798147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Write session: Do CDS request
2025-10-02T09:33:07.798152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.798220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:07.805914Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 18 CurrentSessionLifetimeMs: 301331 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:33:07.806218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.807079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.807155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.807162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1818
2025-10-02T09:33:07.807225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.807244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.807251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.807254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.807508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1818 sessionId:  describe result for acl check
2025-10-02T09:33:07.807531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.807535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.807537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.807539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921860744:7340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.807545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.807644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.807650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.807656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.807692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.807715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846304404:5247]
2025-10-02T09:33:07.807873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921860744:7340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.808061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.808275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.808313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.808517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.808547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.808551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.808552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.808552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.808553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.808553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.808554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.808554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.808555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.808555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.808556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.808556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.808560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.808565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.808567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.808569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.808571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.808573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.808575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.808577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.808579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.808581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.808583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.808585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.808589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.808593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.808596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.808599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.808600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.808603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.808605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.808608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.808610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.808612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.808615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.808617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.808620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.808622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.808624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.808631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.808633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.808635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.808639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.808641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.808643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.808646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.808648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.808651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.808670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.809698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921860744:7340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.814339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921860744:7340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.814350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921860744:7340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.814352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921860744:7340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.814357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.816132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.817521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.817532Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.817533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.817535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.817539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1817 [2:7556555097846304404:5247]
2025-10-02T09:33:07.817546Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.817557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.817558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.817559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.817560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.817571Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.817574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.817578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.817608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.817613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.817615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.817616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.817618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.817657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.817662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.817668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.817673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.817681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.817692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860631:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.817697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860783:7340], now have 1 active actors on pipe
2025-10-02T09:33:07.817701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.817703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.817704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.817711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.817720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.817724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.817727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.817728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.817730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.817732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.817749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.817755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.817752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1817
2025-10-02T09:33:07.817762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1817
2025-10-02T09:33:07.817763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.817799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.817804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.817816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.817823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.817825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.817826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.817831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.817838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.817844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.817939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.817944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.817951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.818010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1818 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0
2025-10-02T09:33:07.818219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b275c7-1185e96a-e2e94eb3-6cf1e34e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.820539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Write session: try to update token
2025-10-02T09:33:07.820552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.831030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:07.831045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.831051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.831079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:07.831100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:07.831216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:07.831335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.831445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.831556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:07.831711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:07.831737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:07.832899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId: src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.835159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:07.836029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.836044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.836055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.836057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.836059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.836060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.836064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.836067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.836069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846304399:5247]
2025-10-02T09:33:07.836095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.836096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.836100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.836103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.836104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.836105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.836205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.897886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555097921860798:7474]
2025-10-02T09:33:07.898073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1817, pipe: [1:7556555097921860798:7474]
2025-10-02T09:33:07.946885Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:07.947121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:07.947142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860798:7474], now have 1 active actors on pipe
2025-10-02T09:33:07.947193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:07.947297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555097921860798:7474]
2025-10-02T09:33:07.947317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:07.955280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:07.955289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:07.955304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1818 reason: error at write: Disconnected sessionId: src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0
2025-10-02T09:33:07.955408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1818 sessionId: src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0 is DEAD
2025-10-02T09:33:07.955535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:07.955545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Write session will restart in 0.009752s
2025-10-02T09:33:07.955560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Write session: Do CDS request
2025-10-02T09:33:07.955564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:07.959795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:07.961539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:07.961643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:07.961649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:07.961656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:07.961680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:07.961705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555097846304569:5241]
2025-10-02T09:33:07.962047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:07.962243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:07.962266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:07.962442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:07.962471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.962475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.962476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.962477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.962477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.962478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.962478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.962479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.962479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.962480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.962480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.962481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.962484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.962490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.962492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.962494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.962496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.962499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.962501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.962503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.962505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.962507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.962509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.962511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.962515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.962519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:07.962522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.962524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:07.962527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.962529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:07.962532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.962534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:07.962537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.962539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:07.962541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.962544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:07.962546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.962549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:07.962552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.962554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:07.962557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.962559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:07.962562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.962564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.962570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.962573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.962575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.962578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.962596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:07.966107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.966191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:07.966198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1819
2025-10-02T09:33:07.966285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:07.966303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:07.966308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:07.966311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:07.966563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1819 sessionId:  describe result for acl check
2025-10-02T09:33:07.966586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:07.966590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:07.966591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:07.966594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555097921860936:7331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:07.966931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555097921860936:7331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:07.968328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555097921860936:7331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:07.969973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:07.970439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555097921860936:7331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:07.970447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555097921860936:7331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:07.970449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555097921860936:7331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:07.970453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:07.971417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:07.971429Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:07.971430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:07.971432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:07.971436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1818 [2:7556555097846304569:5241]
2025-10-02T09:33:07.971442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:07.971452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:07.971455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.971456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.971457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.971466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:07.971469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:07.971475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:07.971510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.971514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.971515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.971517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:07.971518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:07.971557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:07.971561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.971568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:07.971573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:07.971581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:07.971595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860814:2446], now have 1 active actors on pipe
2025-10-02T09:33:07.971599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555097921860967:7331], now have 1 active actors on pipe
2025-10-02T09:33:07.971602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.971603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.971604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.971612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:07.971622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:07.971629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:07.971632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:07.971632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:07.971633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:07.971634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:07.971627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1818
2025-10-02T09:33:07.971635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1818
2025-10-02T09:33:07.971648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.971652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:07.971672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.971671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:07.971677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.971691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:07.971698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:07.971700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:07.971701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:07.971706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:07.971714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:07.971722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.971825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:07.971830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:07.971837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:07.971888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1819 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0
2025-10-02T09:33:07.972030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad8ad289-2c569103-a894b0a5-1d358ae4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:07.974145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Write session: try to update token
2025-10-02T09:33:07.974154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:07.981137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:07.981152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:07.981153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:07.981154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:07.981158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.981161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.981163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555097846304563:5241]
2025-10-02T09:33:07.981187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:07.981190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:07.981191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:07.981199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:07.981203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:07.981207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:07.981306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:07.985483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId: src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:07.987621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.047386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216828284:7474]
2025-10-02T09:33:08.047570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1818, pipe: [1:7556555102216828284:7474]
2025-10-02T09:33:08.090632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.090906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.090921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.090948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828284:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.091143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.091145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:08.091149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:08.091185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216828284:7474]
2025-10-02T09:33:08.091191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1819 reason: error at write: Disconnected sessionId: src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0
2025-10-02T09:33:08.091335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.091324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1819 sessionId: src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0 is DEAD
2025-10-02T09:33:08.091445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:08.091452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Write session will restart in 0.006142s
2025-10-02T09:33:08.091471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Write session: Do CDS request
2025-10-02T09:33:08.091475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.098113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.098212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.098220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1820
2025-10-02T09:33:08.098317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.098337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.098343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.098346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.098610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1820 sessionId:  describe result for acl check
2025-10-02T09:33:08.098634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.098638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.098639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.098642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216828406:7314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.099047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216828406:7314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.099267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.100567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216828406:7314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.100770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.100873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.100879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.100884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.100910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.100963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141272054:5225]
2025-10-02T09:33:08.101294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.101462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.101488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.101662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.101691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.101695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.101696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.101696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.101697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.101698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.101698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.101699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.101699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.101700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.101700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.101701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.101703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.101709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.101711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.101713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.101715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.101718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.101719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.101721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.101724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.101726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.101728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.101729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.101734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.101737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.101741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.101744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.101746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.101749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.101751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.101754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.101757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.101760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.101764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.101766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.101768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.101771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.101773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.101776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.101779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.101782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.101784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.101786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.101789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.101791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.101793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.101796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.101814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.105702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216828406:7314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.105712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216828406:7314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.105713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216828406:7314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.105717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.109198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.110660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.110670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.110671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.110673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.110676Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1819 [2:7556555102141272054:5225]
2025-10-02T09:33:08.110683Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.110692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.110693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.110695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.110696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.110714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.110721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.110725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.110753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.110757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.110759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.110760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.110762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.110799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.110804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.110810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.110816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.110824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.110837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828448:7314], now have 1 active actors on pipe
2025-10-02T09:33:08.110843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828294:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.110847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.110849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.110850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.110857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.110864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.110870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.110862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1819
2025-10-02T09:33:08.110872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.110873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.110874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.110876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.110877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1819
2025-10-02T09:33:08.110890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.110894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.110895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.110912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.110917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.110933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42140b57-87c52beb-37527d22-8efb61c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.110940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.110943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.110944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.110949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.110956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.110966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.111061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.111066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.111073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.111129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1820 partition: 0 MaxSeqNo: 36 sessionId: src_id|42140b57-87c52beb-37527d22-8efb61c1_0
2025-10-02T09:33:08.111301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ca0e8f-52171cf7-52b900a9-baac00ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42140b57-87c52beb-37527d22-8efb61c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.113456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Write session: try to update token
2025-10-02T09:33:08.113467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.120042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.120056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.120057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.120058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.120063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.120065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.120067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272049:5225]
2025-10-02T09:33:08.120086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.120087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.120088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.120089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.120091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.120092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.120303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.124662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId: src_id|42140b57-87c52beb-37527d22-8efb61c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.126716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.191253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216828456:7474]
2025-10-02T09:33:08.191443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1819, pipe: [1:7556555102216828456:7474]
2025-10-02T09:33:08.229147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.229386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.229394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.229418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828456:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.229537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.229594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.229621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:08.229633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216828456:7474]
2025-10-02T09:33:08.229675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1820 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42140b57-87c52beb-37527d22-8efb61c1_0
2025-10-02T09:33:08.229814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1820 sessionId: src_id|42140b57-87c52beb-37527d22-8efb61c1_0 is DEAD
2025-10-02T09:33:08.229935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:08.229944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Write session will restart in 0.005569s
2025-10-02T09:33:08.229959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Write session: Do CDS request
2025-10-02T09:33:08.229963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.236107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.236231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.236240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1821
2025-10-02T09:33:08.236331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.236355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.236361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.236364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.236624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1821 sessionId:  describe result for acl check
2025-10-02T09:33:08.236643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.236647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.236648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.236651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216828583:7306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.236837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.237014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216828583:7306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.238148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.238241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.238248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.238253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.238278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.238303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141272208:5222]
2025-10-02T09:33:08.238350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216828583:7306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.238913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.239086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.239110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.239310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.239339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.239343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.239343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.239344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.239344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.239345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.239346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.239346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.239347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.239347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.239348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.239348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.239351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.239357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.239359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.239361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.239363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.239365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.239367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.239369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.239371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.239373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.239375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.239377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.239381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.239385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.239388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.239391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.239393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.239396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.239398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.239400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.239403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.239413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.239416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.239418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.239421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.239423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.239426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.239428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.239431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.239433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.239435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.239438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.239440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.239443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.239445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.239448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.239465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.243264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216828583:7306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.243275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216828583:7306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.243277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216828583:7306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.243281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.246846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.248259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.248271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.248272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.248274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.248277Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1820 [2:7556555102141272208:5222]
2025-10-02T09:33:08.248285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.248294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.248297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.248299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.248300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.248310Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.248316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.248321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.248353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.248357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.248359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.248360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.248362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.248398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.248403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.248409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.248414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.248424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.248438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828457:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.248443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828622:7306], now have 1 active actors on pipe
2025-10-02T09:33:08.248447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.248448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.248449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.248460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.248468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.248470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.248459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1820
2025-10-02T09:33:08.248470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.248460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1820
2025-10-02T09:33:08.248471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.248478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.248479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.248493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.248498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.248499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.248510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.248515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.248538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.248545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.248547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.248548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.248553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.248562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.248572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.248675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.248679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.248687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.248741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1821 partition: 0 MaxSeqNo: 36 sessionId: src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0
2025-10-02T09:33:08.248959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42140b57-87c52beb-37527d22-8efb61c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.251129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Write session: try to update token
2025-10-02T09:33:08.251139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.257739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.257753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.257754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.257755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.257759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.257762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.257764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272203:5222]
2025-10-02T09:33:08.257786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.257789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.257790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.257797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.257803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.257806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.257925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.262168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId: src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.264254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.330021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216828629:7474]
2025-10-02T09:33:08.330201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1820, pipe: [1:7556555102216828629:7474]
2025-10-02T09:33:08.366292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.366672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.366680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.366715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828629:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.366997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216828629:7474]
2025-10-02T09:33:08.367012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.367017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:08.367019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:08.367037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.367058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1821 reason: error at write: Disconnected sessionId: src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0
2025-10-02T09:33:08.367190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1821 sessionId: src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0 is DEAD
2025-10-02T09:33:08.367306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:08.367315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Write session will restart in 0.008096s
2025-10-02T09:33:08.367329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Write session: Do CDS request
2025-10-02T09:33:08.367343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.375067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.376112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.376217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.376225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1822
2025-10-02T09:33:08.376298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.376320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.376322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.376325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.376384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.376485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.376491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.376497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.376523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.376548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141272362:5214]
2025-10-02T09:33:08.376639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1822 sessionId:  describe result for acl check
2025-10-02T09:33:08.376658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.376662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.376665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.376667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216828748:7301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.377065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216828748:7301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.377167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.377331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.377354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.377552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.377583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.377587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.377588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.377588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.377589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.377590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.377590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.377591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.377591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.377592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.377592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.377593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.377596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.377602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.377604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.377606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.377608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.377610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.377612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.377614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.377616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.377618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.377620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.377622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.377626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.377630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.377634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.377636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.377638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.377641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.377644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.377646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.377649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.377653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.377655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.377658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.377660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.377663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.377665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.377667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.377670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.377672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.377674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.377677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.377679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.377681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.377683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.377686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.377704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.378476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216828748:7301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.382509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216828748:7301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.382518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216828748:7301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.382520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216828748:7301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.382525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.385210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.386624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.386636Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.386637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.386639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.386643Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1821 [2:7556555102141272362:5214]
2025-10-02T09:33:08.386650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.386660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.386663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.386665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.386666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.386675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.386677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.386684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.386725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.386730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.386731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.386732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.386734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.386774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.386779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.386785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.386791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.386800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.386812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828631:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.386819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.386820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.386821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.386829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.386834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828787:7301], now have 1 active actors on pipe
2025-10-02T09:33:08.386840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.386839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.386841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.386842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.386847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.386848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.386851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1821
2025-10-02T09:33:08.386863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.386858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1821
2025-10-02T09:33:08.386868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.386870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.386880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.386885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.386908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fa9cb68-7211c874-6104bf83-b677b931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.386915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.386917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.386918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.386923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.386930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.386941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.387043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.387048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.387055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.387106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1822 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fa9cb68-7211c874-6104bf83-b677b931_0
2025-10-02T09:33:08.387322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|149fc53b-cf955903-c75fda4d-a937c7ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fa9cb68-7211c874-6104bf83-b677b931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.389479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Write session: try to update token
2025-10-02T09:33:08.389488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.396115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.396130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.396131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.396132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.396137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.396140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.396143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272357:5214]
2025-10-02T09:33:08.396164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.396165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.396167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.396168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.396169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.396171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.396321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.400705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId: src_id|7fa9cb68-7211c874-6104bf83-b677b931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.402850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.467250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216828794:7474]
2025-10-02T09:33:08.467469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1821, pipe: [1:7556555102216828794:7474]
2025-10-02T09:33:08.509724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.510067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.510076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.510101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828794:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.510225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.510282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.510320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216828794:7474]
2025-10-02T09:33:08.510383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:08.510445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1822 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fa9cb68-7211c874-6104bf83-b677b931_0
2025-10-02T09:33:08.510587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1822 sessionId: src_id|7fa9cb68-7211c874-6104bf83-b677b931_0 is DEAD
2025-10-02T09:33:08.510721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:08.510730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Write session will restart in 0.005363s
2025-10-02T09:33:08.510750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Write session: Do CDS request
2025-10-02T09:33:08.510754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.517108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.517192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.517199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1823
2025-10-02T09:33:08.517265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.517284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.517289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.517292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.517593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1823 sessionId:  describe result for acl check
2025-10-02T09:33:08.517620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.517625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.517628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.517631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216828911:7297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.518009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216828911:7297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.518330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.519410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216828911:7297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.519940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.520045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.520052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.520057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.520083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.520107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141272517:5211]
2025-10-02T09:33:08.520447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.520629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.520652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.520835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.520864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.520868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.520869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.520869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.520870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.520872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.520872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.520873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.520873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.520874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.520876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.520882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.520884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.520886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.520888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.520890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.520892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.520894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.520898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.520900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.520902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.520906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.520910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.520913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.520916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.520918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.520921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.520923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.520925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.520928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.520931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.520933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.520935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.520937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.520940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.520942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.520949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.520951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.520954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.520959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.520961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.520967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.520970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.520972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.520974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.520991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.521361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216828911:7297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.521370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216828911:7297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.521371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216828911:7297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.521375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.528399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.529897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.529909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.529910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.529912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.529916Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1822 [2:7556555102141272517:5211]
2025-10-02T09:33:08.529922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.529932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.529933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.529935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.529936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.529945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.529952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.529956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.529987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.529992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.529993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.529995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.529996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.530033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.530038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.530044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.530049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.530061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.530074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828952:7297], now have 1 active actors on pipe
2025-10-02T09:33:08.530079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828796:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.530083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.530084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.530086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.530094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.530104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.530106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.530108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.530109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.530114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.530116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.530108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1822
2025-10-02T09:33:08.530119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1822
2025-10-02T09:33:08.530130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.530135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.530137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.530145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.530147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.530172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.530178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.530181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.530182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.530187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.530193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.530202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.530304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.530309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.530317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.530359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1823 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0
2025-10-02T09:33:08.530569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9cb68-7211c874-6104bf83-b677b931_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.532878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Write session: try to update token
2025-10-02T09:33:08.532888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.539758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.539773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.539774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.539775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.539780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.539783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.539786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272512:5211]
2025-10-02T09:33:08.539807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.539811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.539812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.539814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.539815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.539818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.539924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.544561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId: src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.546776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.610598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216828960:7474]
2025-10-02T09:33:08.610811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1822, pipe: [1:7556555102216828960:7474]
2025-10-02T09:33:08.651086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.651515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.651525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.651552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828960:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.651698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.651965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:08.651986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216828960:7474]
2025-10-02T09:33:08.652001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.652031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1823 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0
2025-10-02T09:33:08.652169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1823 sessionId: src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0 is DEAD
2025-10-02T09:33:08.652298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:08.652307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Write session will restart in 0.009417s
2025-10-02T09:33:08.652322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Write session: Do CDS request
2025-10-02T09:33:08.652326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.660503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.661802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.661902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.661909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.661915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.661940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.661964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141272673:5209]
2025-10-02T09:33:08.662316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.662484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.662507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.662685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.662724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.662727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.662728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.662729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.662729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.662730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.662730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.662731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.662731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.662732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.662732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.662733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.662735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.662742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.662744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.662746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.662748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.662750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.662752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.662754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.662756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.662758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.662760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.662762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.662766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.662770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.662774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.662777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.662780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.662782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.662784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.662787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.662790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.662792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.662794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.662797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.662801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.662803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.662805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.662808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.662810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.662813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.662815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.662818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.662820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.662824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.662826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.662828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.662845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.663166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.663252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.663262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1824
2025-10-02T09:33:08.663335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.663353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.663358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.663360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.663612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1824 sessionId:  describe result for acl check
2025-10-02T09:33:08.663637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.663641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.663642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.663645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216829084:7291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.664024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216829084:7291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.665321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216829084:7291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.669178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216829084:7291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.669186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216829084:7291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.669189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216829084:7291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.669193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.670390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.672072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.672082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.672084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.672086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.672089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1823 [2:7556555102141272673:5209]
2025-10-02T09:33:08.672096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.672106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.672108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.672109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.672110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.672119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.672127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.672131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.672162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.672166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.672167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.672169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.672170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.672214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.672219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.672226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.672231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.672239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.672254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216828961:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.672259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829119:7291], now have 1 active actors on pipe
2025-10-02T09:33:08.672262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.672264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.672266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.672273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.672282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.672292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.672295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.672276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1823
2025-10-02T09:33:08.672288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1823
2025-10-02T09:33:08.672300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.672315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.672316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.672322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.672324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.672331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.672338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.672352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.672360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d372678-bdbef280-2dfb9c03-c44c263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.672364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.672366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.672367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.672372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.672379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.672391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.672479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.672484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.672492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.672534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1824 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d372678-bdbef280-2dfb9c03-c44c263_0
2025-10-02T09:33:08.672731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b9d9b7a-715d21c3-7f65024e-9a08cb1e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d372678-bdbef280-2dfb9c03-c44c263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.674972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Write session: try to update token
2025-10-02T09:33:08.674985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.681641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.681657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.681658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.681659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.681664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.681666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.681669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272668:5209]
2025-10-02T09:33:08.681692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.681696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.681697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.681702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.681705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.681708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.681804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.687315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId: src_id|7d372678-bdbef280-2dfb9c03-c44c263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.689474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.751918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216829127:7474]
2025-10-02T09:33:08.752132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1823, pipe: [1:7556555102216829127:7474]
2025-10-02T09:33:08.791861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.792087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.792097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.792108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829127:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.792240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.792275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.792303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216829127:7474]
2025-10-02T09:33:08.792310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:08.792363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1824 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d372678-bdbef280-2dfb9c03-c44c263_0
2025-10-02T09:33:08.792500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1824 sessionId: src_id|7d372678-bdbef280-2dfb9c03-c44c263_0 is DEAD
2025-10-02T09:33:08.792639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:08.792651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Write session will restart in 0.006926s
2025-10-02T09:33:08.792673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Write session: Do CDS request
2025-10-02T09:33:08.792678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.800116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.800182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.800191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1825
2025-10-02T09:33:08.800261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.800285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.800293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.800296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.800506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.800607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1825 sessionId:  describe result for acl check
2025-10-02T09:33:08.800636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.800642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.800643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.800647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216829247:7287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.801043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216829247:7287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.801872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.801971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.801977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.801983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.802008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.802034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141272830:5197]
2025-10-02T09:33:08.802367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.802543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.802567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.802578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216829247:7287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.802747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.802777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.802781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.802781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.802782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.802782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.802783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.802783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.802784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.802784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.802785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.802785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.802786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.802789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.802794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.802797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.802799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.802801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.802803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.802805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.802807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.802809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.802811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.802813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.802814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.802818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.802822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.802825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.802828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.802831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.802834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.802837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.802839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.802842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.802844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.802847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.802849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.802852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.802854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.802856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.802861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.802863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.802866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.802868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.802871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.802873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.802876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.802878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.802882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.802899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.807846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216829247:7287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.807854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216829247:7287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.807856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216829247:7287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.807860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.810587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.812230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.812242Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.812243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.812245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.812248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1824 [2:7556555102141272830:5197]
2025-10-02T09:33:08.812255Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.812264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.812266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.812267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.812268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.812277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.812284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.812288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.812315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.812320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.812321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.812322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.812324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.812359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.812364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.812370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.812376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.812385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.812399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.812403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.812404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.812413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.812422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829128:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.812422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.812424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.812426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.812426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829287:7287], now have 1 active actors on pipe
2025-10-02T09:33:08.812431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.812438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.812439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.812453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.812458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.812443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1824
2025-10-02T09:33:08.812444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1824
2025-10-02T09:33:08.812475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.812478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.812480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.812495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.812499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.812501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.812502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.812508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.812517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.812526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.812613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.812618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.812625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.812678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1825 partition: 0 MaxSeqNo: 36 sessionId: src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0
2025-10-02T09:33:08.812870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d372678-bdbef280-2dfb9c03-c44c263_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.815021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Write session: try to update token
2025-10-02T09:33:08.815031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.822091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.822107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.822108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.822109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.822114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.822116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.822118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272825:5197]
2025-10-02T09:33:08.822141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.822144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.822147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.822148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.822149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.822150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.822285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.826377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId: src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.828451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:08.892702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555102216829302:7474]
2025-10-02T09:33:08.892863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1824, pipe: [1:7556555102216829302:7474]
2025-10-02T09:33:08.931031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:08.931227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.931238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.931261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829302:7474], now have 1 active actors on pipe
2025-10-02T09:33:08.931415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:08.931427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555102216829302:7474]
2025-10-02T09:33:08.931437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:08.931440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:08.931448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:08.931491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1825 reason: error at write: Disconnected sessionId: src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0
2025-10-02T09:33:08.931644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1825 sessionId: src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0 is DEAD
2025-10-02T09:33:08.931767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:08.931776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Write session will restart in 0.009661s
2025-10-02T09:33:08.931790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Write session: Do CDS request
2025-10-02T09:33:08.931795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:08.939176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:08.940677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:08.940774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:08.940781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:08.940786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:08.940823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:08.940847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555102141273000:5205]
2025-10-02T09:33:08.941241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:08.941433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:08.941459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:08.941637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:08.941670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.941674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.941674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.941675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.941676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.941676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.941677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.941677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.941678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.941678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.941679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.941680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.941682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.941689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.941691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.941693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.941695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.941697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.941699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.941702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.941704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.941706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.941708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.941709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.941713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.941718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:08.941722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.941724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:08.941726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.941729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:08.941731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.941734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:08.941736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.941739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:08.941741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.941743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:08.941746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.941748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:08.941751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.941753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:08.941755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.941758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:08.941760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.941763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.941765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.941767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.941773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.941776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.941793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:08.942126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.942216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:08.942226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1826
2025-10-02T09:33:08.942323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:08.942341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:08.942347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:08.942350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:08.942673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1826 sessionId:  describe result for acl check
2025-10-02T09:33:08.942696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:08.942700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:08.942701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:08.942715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555102216829431:7276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:08.943093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555102216829431:7276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:08.944223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555102216829431:7276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:08.948747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555102216829431:7276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:08.948755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555102216829431:7276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:08.948757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555102216829431:7276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:08.948761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:08.949276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:08.950820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:08.950831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:08.950832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:08.950834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:08.950837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1825 [2:7556555102141273000:5205]
2025-10-02T09:33:08.950844Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:08.950854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:08.950855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.950857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.950858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.950867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:08.950870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:08.950875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:08.950906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.950912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.950913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.950915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:08.950916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:08.950955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:08.950960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.950966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:08.950971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:08.950979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:08.950989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.950994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.950995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.951000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:08.951007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:08.951008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:08.951014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:08.951016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:08.951016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:08.951017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:08.951024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829306:2446], now have 1 active actors on pipe
2025-10-02T09:33:08.951026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555102216829478:7276], now have 1 active actors on pipe
2025-10-02T09:33:08.951041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.951047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:08.951063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:08.951063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1825
2025-10-02T09:33:08.951073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1825
2025-10-02T09:33:08.951112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.951117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.951133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:08.951139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:08.951141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:08.951143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:08.951148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:08.951153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:08.951166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.951263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:08.951268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:08.951276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:08.951336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1826 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0
2025-10-02T09:33:08.951523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94d7d-7bcc2b3d-145e717e-16f63c99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:08.953673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Write session: try to update token
2025-10-02T09:33:08.953682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:08.961762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:08.961777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:08.961778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:08.961779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:08.961783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.961786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.961788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555102141272995:5205]
2025-10-02T09:33:08.961811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:08.961815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:08.961814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:08.961816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:08.961818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:08.961820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:08.961926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:08.966894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId: src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:08.968970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.031470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511796782:7474]
2025-10-02T09:33:09.031659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1825, pipe: [1:7556555106511796782:7474]
2025-10-02T09:33:09.072058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.072293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.072303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.072327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511796782:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.072438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.072585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511796782:7474]
2025-10-02T09:33:09.072610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:09.072661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1826 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0
2025-10-02T09:33:09.072814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1826 sessionId: src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0 is DEAD
2025-10-02T09:33:09.072926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:09.072935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Write session will restart in 0.008073s
2025-10-02T09:33:09.072948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Write session: Do CDS request
2025-10-02T09:33:09.072933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.072952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.080785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.082151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.082227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.082252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.082258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.082264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.082290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.082311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436240475:5186]
2025-10-02T09:33:09.082316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.082324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1827
2025-10-02T09:33:09.082402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.082419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.082425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.082427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.082652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1827 sessionId:  describe result for acl check
2025-10-02T09:33:09.082669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.082673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.082676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.082679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511796922:7254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.082737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.082926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.082950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.083054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511796922:7254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.083141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.083168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.083172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.083172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.083173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.083173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.083174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.083174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.083175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.083175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.083176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.083176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.083177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.083180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.083185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.083188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.083190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.083192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.083194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.083196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.083197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.083200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.083202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.083203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.083205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.083208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.083213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.083216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.083218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.083221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.083223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.083225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.083228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.083230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.083233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.083235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.083238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.083240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.083243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.083245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.083247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.083249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.083252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.083254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.083258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.083260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.083263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.083269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.083271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.083288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.084719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511796922:7254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.089341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511796922:7254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.089350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511796922:7254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.089352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511796922:7254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.089355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.091021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.092528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.092540Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.092541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.092544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.092547Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1826 [2:7556555106436240475:5186]
2025-10-02T09:33:09.092553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.092563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.092566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.092567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.092568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.092577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.092579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.092583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.092615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.092620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.092622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.092624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.092625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.092659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.092665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.092672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.092677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.092689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.092700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511796964:7254], now have 1 active actors on pipe
2025-10-02T09:33:09.092705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511796796:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.092708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.092709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.092710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.092717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.092725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.092731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.092733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.092734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.092736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.092737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.092727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1826
2025-10-02T09:33:09.092732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1826
2025-10-02T09:33:09.092753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.092758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.092759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.092774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.092778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.092797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.092817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.092822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.092823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.092828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.092833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.092845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.092924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.092929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.092936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.092988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1827 partition: 0 MaxSeqNo: 36 sessionId: src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0
2025-10-02T09:33:09.093192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e95004-84c50eb8-bebb64dc-90bf5cfe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.095330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Write session: try to update token
2025-10-02T09:33:09.095339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.102357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.102372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.102373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.102374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.102379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.102381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.102383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436240466:5186]
2025-10-02T09:33:09.102404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.102407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.102408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.102409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.102413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.102415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.102524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.108095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId: src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.110248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.172780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511796972:7474]
2025-10-02T09:33:09.172976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1826, pipe: [1:7556555106511796972:7474]
2025-10-02T09:33:09.211562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.211770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.211779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.211804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511796972:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.211937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.211994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:09.212004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:09.212040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511796972:7474]
2025-10-02T09:33:09.212051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1827 reason: error at write: Disconnected sessionId: src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0
2025-10-02T09:33:09.212070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.212190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1827 sessionId: src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0 is DEAD
2025-10-02T09:33:09.212315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:09.212325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Write session will restart in 0.009542s
2025-10-02T09:33:09.212343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Write session: Do CDS request
2025-10-02T09:33:09.212347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.220211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.221558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.221678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.221685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.221691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.221718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.221745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436240654:5178]
2025-10-02T09:33:09.222078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.222236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.222258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.222431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.222461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.222465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.222465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.222466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.222466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.222467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.222467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.222468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.222468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.222469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.222469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.222470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.222472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.222479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.222482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.222484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.222486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.222488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.222490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.222492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.222494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.222496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.222498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.222500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.222504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.222508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.222511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.222514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.222516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.222519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.222521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.222524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.222527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.222529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.222531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.222534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.222536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.222538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.222540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.222543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.222545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.222548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.222551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.222553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.222556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.222558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.222560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.222563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.222579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.223117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.223200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.223210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1828
2025-10-02T09:33:09.223303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.223322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.223328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.223331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.223602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1828 sessionId:  describe result for acl check
2025-10-02T09:33:09.223625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.223631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.223632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.223635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511797102:7251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.224003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511797102:7251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.225337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511797102:7251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.229048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511797102:7251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.229058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511797102:7251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.229061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511797102:7251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.229067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.230254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.231865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.231876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.231877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.231879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.231883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1827 [2:7556555106436240654:5178]
2025-10-02T09:33:09.231889Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.231898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.231899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.231901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.231902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.231911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.231917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.231921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.231950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.231954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.231955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.231957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.231958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.231993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.231999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.232005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.232010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.232021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.232035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511796974:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.232040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797136:7251], now have 1 active actors on pipe
2025-10-02T09:33:09.232043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.232044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.232045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.232053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.232062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.232064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.232070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.232065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1827
2025-10-02T09:33:09.232071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.232067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1827
2025-10-02T09:33:09.232071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.232072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.232087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.232089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.232091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.232102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.232107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.232130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.232136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.232138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.232140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.232145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.232153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.232162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.232251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.232256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.232263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.232315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1828 partition: 0 MaxSeqNo: 36 sessionId: src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0
2025-10-02T09:33:09.232480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f8c959-761c5af1-eb2b4ccc-848590db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.234583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Write session: try to update token
2025-10-02T09:33:09.234593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.241684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.241699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.241700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.241701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.241705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.241708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.241710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436240648:5178]
2025-10-02T09:33:09.241730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.241734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.241735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.241736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.241738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.241740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.241854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.245758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId: src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.247841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.312032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511797145:7474]
2025-10-02T09:33:09.312201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1827, pipe: [1:7556555106511797145:7474]
2025-10-02T09:33:09.349781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.350064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.350073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.350097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797145:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.350234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.350292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.350321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511797145:7474]
2025-10-02T09:33:09.350331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:09.350396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1828 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0
2025-10-02T09:33:09.350555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1828 sessionId: src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0 is DEAD
2025-10-02T09:33:09.350689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:09.350699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Write session will restart in 0.009698s
2025-10-02T09:33:09.350721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Write session: Do CDS request
2025-10-02T09:33:09.350725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.358606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.360008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.360116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.360123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.360129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.360155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.360178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436240817:5171]
2025-10-02T09:33:09.360514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.360691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.360713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.360898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.360932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.360936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.360936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.360937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.360938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.360938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.360939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.360939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.360940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.360941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.360941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.360942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.360944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.360951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.360953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.360955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.360957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.360959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.360961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.360963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.360964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.360967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.360968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.360970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.360974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.360978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.360981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.360984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.360986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.360988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.360991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.360994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.360996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.360999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.361001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.361004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.361006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.361008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.361010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.361013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.361015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.361018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.361022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.361024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.361027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.361030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.361032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.361036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.361058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.361055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.361173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.361184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1829
2025-10-02T09:33:09.361276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.361294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.361300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.361303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.361577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1829 sessionId:  describe result for acl check
2025-10-02T09:33:09.361600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.361604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.361605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.361608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511797275:7233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.361964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511797275:7233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.363600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511797275:7233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.368227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511797275:7233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.368235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511797275:7233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.368237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511797275:7233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.368241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.368844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.370251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.370264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.370266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.370268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.370271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1828 [2:7556555106436240817:5171]
2025-10-02T09:33:09.370281Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.370292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.370297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.370299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.370300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.370308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.370312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.370316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.370351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.370356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.370357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.370359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.370360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.370399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.370403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.370410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.370415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.370424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.370438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797309:7233], now have 1 active actors on pipe
2025-10-02T09:33:09.370443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797147:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.370447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.370448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.370450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.370457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.370468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.370470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.370472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.370473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.370479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.370480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.370486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1828
2025-10-02T09:33:09.370487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1828
2025-10-02T09:33:09.370497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.370503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.370504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.370518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.370522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.370543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.370550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.370552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.370553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.370558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.370564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.370574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.370667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.370672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.370679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.370753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1829 partition: 0 MaxSeqNo: 36 sessionId: src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0
2025-10-02T09:33:09.370928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96f9e62-ceffe43-5b6d0cb2-f7983ef4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.373103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Write session: try to update token
2025-10-02T09:33:09.373114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.380143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.380157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.380159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.380160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.380164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.380167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.380169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436240812:5171]
2025-10-02T09:33:09.380192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.380196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.380197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.380200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.380202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.380201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.380365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.384468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId: src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.386765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.450267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511797317:7474]
2025-10-02T09:33:09.450441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1828, pipe: [1:7556555106511797317:7474]
2025-10-02T09:33:09.488646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.489026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.489036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.489060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797317:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.489205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.489250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.489290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511797317:7474]
2025-10-02T09:33:09.489293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:09.489353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1829 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0
2025-10-02T09:33:09.489486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1829 sessionId: src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0 is DEAD
2025-10-02T09:33:09.489621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:09.489631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Write session will restart in 0.005393s
2025-10-02T09:33:09.489651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Write session: Do CDS request
2025-10-02T09:33:09.489656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.496120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.496199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.496210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1830
2025-10-02T09:33:09.496301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.496329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.496336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.496339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.496654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1830 sessionId:  describe result for acl check
2025-10-02T09:33:09.496678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.496682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.496683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.496686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511797440:7239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.497064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511797440:7239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.497559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.498437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511797440:7239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.499039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.499129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.499135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.499140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.499165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.499186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436240980:5175]
2025-10-02T09:33:09.499517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.499686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.499710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.499882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.499913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.499917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.499917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.499918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.499918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.499919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.499919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.499920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.499920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.499921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.499928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.499928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.499931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.499937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.499940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.499942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.499944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.499946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.499948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.499950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.499952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.499954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.499956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.499958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.499961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.499965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.499968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.499971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.499974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.499977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.499979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.499982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.499985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.499987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.499990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.499993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.499995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.500002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.500004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.500007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.500009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.500012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.500014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.500017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.500019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.500022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.500024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.500027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.500046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.500298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511797440:7239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.500307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511797440:7239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.500309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511797440:7239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.500312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.507739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.509284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.509295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.509296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.509297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.509301Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1829 [2:7556555106436240980:5175]
2025-10-02T09:33:09.509310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.509320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.509325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.509327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.509328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.509336Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.509340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.509347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.509378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.509382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.509383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.509385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.509386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.509423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.509428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.509434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.509439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.509447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.509460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.509464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.509465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.509471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.509477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.509479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797481:7239], now have 1 active actors on pipe
2025-10-02T09:33:09.509483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.509484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.509485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.509490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.509491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.509495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797318:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.509508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.509517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.509516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1829
2025-10-02T09:33:09.509517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1829
2025-10-02T09:33:09.509544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.509549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.509549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.509562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5959156-4e62af0d-4835314e-a755efdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.509568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.509570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.509571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.509579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.509587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.509597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.509697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.509702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.509709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.509761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1830 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5959156-4e62af0d-4835314e-a755efdc_0
2025-10-02T09:33:09.509963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff186fd-fa2bf5cf-4372f705-3ddf9e30_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5959156-4e62af0d-4835314e-a755efdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.512065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Write session: try to update token
2025-10-02T09:33:09.512074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.519294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.519311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.519313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.519315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.519321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.519325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.519328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436240975:5175]
2025-10-02T09:33:09.519353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.519359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.519362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.519364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.519364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.519366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.519493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.523328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId: src_id|a5959156-4e62af0d-4835314e-a755efdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.525422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.589536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511797490:7474]
2025-10-02T09:33:09.589689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1829, pipe: [1:7556555106511797490:7474]
2025-10-02T09:33:09.628627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.628846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.628857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.628883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797490:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.629005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.629083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:09.629099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.629149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1830 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5959156-4e62af0d-4835314e-a755efdc_0
2025-10-02T09:33:09.629246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511797490:7474]
2025-10-02T09:33:09.629281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1830 sessionId: src_id|a5959156-4e62af0d-4835314e-a755efdc_0 is DEAD
2025-10-02T09:33:09.629394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:09.629403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Write session will restart in 0.009694s
2025-10-02T09:33:09.629417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Write session: Do CDS request
2025-10-02T09:33:09.629421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.637567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.639192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.639293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.639299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.639304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.639330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.639352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436241144:5172]
2025-10-02T09:33:09.639682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.639847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.639870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.640046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.640074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.640078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.640078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.640079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.640080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.640080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.640081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.640081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.640082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.640082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.640083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.640083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.640086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.640093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.640095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.640098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.640099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.640101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.640103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.640105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.640107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.640110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.640112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.640114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.640119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.640123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.640126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.640133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.640129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.640131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.640134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.640136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.640139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.640141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.640144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.640146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.640148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.640150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.640153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.640155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.640158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.640160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.640163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.640165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.640168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.640170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.640173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.640175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.640177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.640195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.640223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.640232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1831
2025-10-02T09:33:09.640326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.640343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.640346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.640349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.640625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1831 sessionId:  describe result for acl check
2025-10-02T09:33:09.640649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.640653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.640654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.640657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511797621:7232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.641046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511797621:7232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.642661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511797621:7232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.646651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511797621:7232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.646659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511797621:7232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.646661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511797621:7232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.646665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.647901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.649371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.649382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.649383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.649385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.649389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1830 [2:7556555106436241144:5172]
2025-10-02T09:33:09.649396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.649405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.649411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.649412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.649413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.649422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.649424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.649429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.649462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.649468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.649469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.649471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.649472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.649508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.649512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.649518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.649523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.649531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.649544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.649548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.649549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.649555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.649561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.649563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797656:7232], now have 1 active actors on pipe
2025-10-02T09:33:09.649567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797491:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.649569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.649570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.649570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.649577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.649579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.649592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.649597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.649591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1830
2025-10-02T09:33:09.649597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1830
2025-10-02T09:33:09.649609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.649626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.649631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.649646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.649653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.649655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.649656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.649661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.649667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.649675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.649757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.649762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.649770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.649815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1831 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0
2025-10-02T09:33:09.649970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5959156-4e62af0d-4835314e-a755efdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.652074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Write session: try to update token
2025-10-02T09:33:09.652082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.659247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.659259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.659260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.659261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.659266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.659269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.659271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436241139:5172]
2025-10-02T09:33:09.659292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.659295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.659296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.659297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.659301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.659303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.659474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.663052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId: src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.665176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.729305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511797666:7474]
2025-10-02T09:33:09.729454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1830, pipe: [1:7556555106511797666:7474]
2025-10-02T09:33:09.771009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.771382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.771391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.771414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797666:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.771551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.771582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511797666:7474]
2025-10-02T09:33:09.771605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.771609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:09.771680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1831 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0
2025-10-02T09:33:09.771832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1831 sessionId: src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0 is DEAD
2025-10-02T09:33:09.771955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:09.771963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Write session will restart in 0.009953s
2025-10-02T09:33:09.771978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Write session: Do CDS request
2025-10-02T09:33:09.771982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.779765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.781457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.781592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.781600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.781607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.781641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.781665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436241310:5164]
2025-10-02T09:33:09.782020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.782187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.782209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.782386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.782416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.782420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.782421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.782421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.782422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.782422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.782423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.782423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.782424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.782425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.782425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.782426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.782428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.782435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.782437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.782439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.782441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.782443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.782445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.782447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.782449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.782452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.782454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.782456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.782460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.782464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.782467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.782470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.782472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.782475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.782477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.782480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.782482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.782485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.782487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.782490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.782492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.782495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.782498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.782501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.782503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.782506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.782508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.782511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.782513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.782516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.782518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.782520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.782537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.783133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.783199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.783210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1832
2025-10-02T09:33:09.783304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.783325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.783331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.783333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.783590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1832 sessionId:  describe result for acl check
2025-10-02T09:33:09.783616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.783621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.783622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.783626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511797802:7226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.783981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511797802:7226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.785460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511797802:7226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.789753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511797802:7226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.789761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511797802:7226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.789763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511797802:7226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.789766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.790243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.791719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.791731Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.791733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.791735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.791739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1831 [2:7556555106436241310:5164]
2025-10-02T09:33:09.791746Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.791756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.791759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.791761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.791762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.791771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.791777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.791782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.791812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.791817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.791818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.791820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.791821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.791864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.791869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.791875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.791881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.791889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.791903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797669:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.791908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797836:7226], now have 1 active actors on pipe
2025-10-02T09:33:09.791912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.791914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.791915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.791922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.791929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.791935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.791937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.791938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.791939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.791940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.791931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1831
2025-10-02T09:33:09.791954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.791936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1831
2025-10-02T09:33:09.791959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.791961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.791975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.791980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.792001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.792007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.792010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.792011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.792016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.792023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.792035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.792123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.792128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.792136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.792195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1832 partition: 0 MaxSeqNo: 36 sessionId: src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0
2025-10-02T09:33:09.792377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed42718-9e3f25f1-8caab1d1-bfcec58_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.794554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Write session: try to update token
2025-10-02T09:33:09.794565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.801314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.801330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.801332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.801334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.801340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.801344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.801347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436241305:5164]
2025-10-02T09:33:09.801365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.801369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.801371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.801373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.801378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.801380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.801501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.805915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId: src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.807909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:09.871637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555106511797851:7474]
2025-10-02T09:33:09.871798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1831, pipe: [1:7556555106511797851:7474]
2025-10-02T09:33:09.910188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:09.910407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.910417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.910447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797851:7474], now have 1 active actors on pipe
2025-10-02T09:33:09.910565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:09.910578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:09.910598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:09.910601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:09.910619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555106511797851:7474]
2025-10-02T09:33:09.910650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1832 reason: error at write: Disconnected sessionId: src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0
2025-10-02T09:33:09.910788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1832 sessionId: src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0 is DEAD
2025-10-02T09:33:09.910902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:09.910910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Write session will restart in 0.007218s
2025-10-02T09:33:09.910927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Write session: Do CDS request
2025-10-02T09:33:09.910932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:09.919091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.919195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:09.919205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1833
2025-10-02T09:33:09.919290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:09.919312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:09.919318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:09.919321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:09.919313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:09.919567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1833 sessionId:  describe result for acl check
2025-10-02T09:33:09.919591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:09.919595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:09.919596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:09.919599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555106511797982:7219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:09.919960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555106511797982:7219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:09.920741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:09.920867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:09.920875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:09.920883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:09.920926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:09.920952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555106436241488:5159]
2025-10-02T09:33:09.921141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555106511797982:7219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:09.921299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:09.921451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:09.921483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:09.921672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:09.921715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.921720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.921721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.921722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.921723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.921724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.921725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.921726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.921727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.921728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.921729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.921730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.921734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.921744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.921748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.921751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.921755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.921759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.921762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.921766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.921769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.921773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.921776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.921780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.921785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.921793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:09.921799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.921805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:09.921809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.921814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:09.921819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.921824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:09.921828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.921834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:09.921837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.921842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:09.921846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.921855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:09.921859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.921863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:09.921868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.921876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:09.921879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.921884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.921889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.921895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.921899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.921912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.921948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:09.925755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555106511797982:7219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:09.925766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555106511797982:7219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:09.925768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555106511797982:7219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:09.925771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:09.929353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:09.930786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:09.930798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:09.930800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:09.930803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:09.930807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1832 [2:7556555106436241488:5159]
2025-10-02T09:33:09.930816Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:09.930829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:09.930832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.930834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.930836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.930846Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:09.930850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:09.930856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:09.930889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.930896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.930898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.930901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:09.930902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:09.930948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:09.930953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.930964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:09.930975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:09.930993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:09.931010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511797855:2446], now have 1 active actors on pipe
2025-10-02T09:33:09.931017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555106511798022:7219], now have 1 active actors on pipe
2025-10-02T09:33:09.931013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1832
2025-10-02T09:33:09.931021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1832
2025-10-02T09:33:09.931021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.931023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.931025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.931030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:09.931039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:09.931041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:09.931041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:09.931042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:09.931053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:09.931057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:09.931084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.931091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.931100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.931110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:09.931116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:09.931130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:09.931138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:09.931141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:09.931143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:09.931149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:09.931159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:09.931178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.931268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:09.931273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:09.931283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:09.931329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1833 partition: 0 MaxSeqNo: 36 sessionId: src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0
2025-10-02T09:33:09.931494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291ca9e8-3d1292b7-c6c6dca-5ecf424d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:09.933636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Write session: try to update token
2025-10-02T09:33:09.933645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:09.940297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:09.940311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:09.940312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:09.940314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:09.940319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.940323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.940326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555106436241483:5159]
2025-10-02T09:33:09.940353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:09.940353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:09.940357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:09.940357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:09.940359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:09.940359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:09.940530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:09.944997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId: src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:09.947067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.010904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806765337:7474]
2025-10-02T09:33:10.011076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1832, pipe: [1:7556555110806765337:7474]
2025-10-02T09:33:10.050814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.051254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.051265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.051296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765337:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.051454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.051535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.051537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806765337:7474]
2025-10-02T09:33:10.051561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:10.051615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1833 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0
2025-10-02T09:33:10.051746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1833 sessionId: src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0 is DEAD
2025-10-02T09:33:10.051890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:10.051900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Write session will restart in 0.006369s
2025-10-02T09:33:10.051915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Write session: Do CDS request
2025-10-02T09:33:10.051919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.059122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.059190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.059198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1834
2025-10-02T09:33:10.059282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.059301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.059306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.059309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.059585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1834 sessionId:  describe result for acl check
2025-10-02T09:33:10.059609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.059613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.059614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.059618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806765466:7214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.059933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.059966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806765466:7214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.061436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806765466:7214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.061831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.061926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.061933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.061938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.061963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.061985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731208952:5142]
2025-10-02T09:33:10.062315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.062485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.062508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.062677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.062716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.062720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.062721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.062721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.062722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.062723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.062723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.062724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.062724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.062725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.062725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.062726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.062729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.062734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.062737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.062739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.062741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.062743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.062745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.062747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.062749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.062751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.062753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.062755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.062758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.062762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.062766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.062769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.062771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.062773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.062776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.062778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.062780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.062785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.062787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.062789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.062792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.062794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.062796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.062799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.062801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.062803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.062805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.062808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.062810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.062813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.062815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.062817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.062834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.062950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806765466:7214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.062959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806765466:7214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.062961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806765466:7214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.062964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.070503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.072037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.072048Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.072049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.072051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.072054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1833 [2:7556555110731208952:5142]
2025-10-02T09:33:10.072062Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.072071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.072072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.072074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.072075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.072083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.072086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.072090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.072126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.072131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.072132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.072134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.072135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.072171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.072176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.072182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.072188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.072198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.072210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765339:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.072216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765506:7214], now have 1 active actors on pipe
2025-10-02T09:33:10.072219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.072220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.072221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.072229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.072238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.072235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1833
2025-10-02T09:33:10.072236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1833
2025-10-02T09:33:10.072248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.072251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.072254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.072257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.072258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.072269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.072274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.072275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.072285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.072290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.072316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.072323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.072325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.072326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.072332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.072337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.072350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.072440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.072445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.072453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.072505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1834 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0
2025-10-02T09:33:10.072676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b98a0-8eeee70d-32cbf3b2-a21d000f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.074851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Write session: try to update token
2025-10-02T09:33:10.074859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.081910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.081927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.081928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.081930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.081940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.081943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.081946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731208947:5142]
2025-10-02T09:33:10.081973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.081975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.081976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.081979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.081980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.081982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.082122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.086759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId: src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.088825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.151708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806765536:7474]
2025-10-02T09:33:10.151859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1833, pipe: [1:7556555110806765536:7474]
2025-10-02T09:33:10.191848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.192071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.192082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.192112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765536:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.192238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.192310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.192322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:10.192347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806765536:7474]
2025-10-02T09:33:10.192380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0
2025-10-02T09:33:10.192516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1834 sessionId: src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0 is DEAD
2025-10-02T09:33:10.192630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:10.192640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Write session will restart in 0.009768s
2025-10-02T09:33:10.192659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Write session: Do CDS request
2025-10-02T09:33:10.192664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.200727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.202100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.202209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.202217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.202225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.202264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.202294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731209155:5137]
2025-10-02T09:33:10.202641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.202815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.202849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.203050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.203094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.203099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.203100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.203101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.203102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.203103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.203104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.203105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.203106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.203125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.203107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.203108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.203108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.203113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.203123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.203127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.203131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.203134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.203138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.203141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.203145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.203148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.203152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.203156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.203160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.203166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.203172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.203177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.203182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.203187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.203192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.203196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.203201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.203206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.203211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.203200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.203208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1835
2025-10-02T09:33:10.203215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.203221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.203225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.203230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.203234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.203240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.203244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.203249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.203254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.203259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.203263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.203269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.203273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.203278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.203283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.203301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.203307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.203309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.203311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.203558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1835 sessionId:  describe result for acl check
2025-10-02T09:33:10.203583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.203588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.203589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.203592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806765672:7190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.203939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806765672:7190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.205308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806765672:7190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.209797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806765672:7190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.209806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806765672:7190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.209809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806765672:7190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.209813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.211023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.212726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.212739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.212741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.212743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.212746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1834 [2:7556555110731209155:5137]
2025-10-02T09:33:10.212753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.212763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.212765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.212767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.212768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.212777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.212783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.212788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.212834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.212839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.212840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.212842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.212843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.212882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.212887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.212895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.212904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.212920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.212938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765707:7190], now have 1 active actors on pipe
2025-10-02T09:33:10.212945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765538:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.212950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.212952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.212958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.212969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.212974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1834
2025-10-02T09:33:10.212980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.212983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.212987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.212978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1834
2025-10-02T09:33:10.212989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.212994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.212996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.213016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.213023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.213024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.213035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.213042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.213077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffbdb9b2-65365331-c8971526-31fd3409_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.213086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.213090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.213094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.213099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.213105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.213121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.213202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.213209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.213219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.213283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1835 partition: 0 MaxSeqNo: 36 sessionId: src_id|ffbdb9b2-65365331-c8971526-31fd3409_0
2025-10-02T09:33:10.213490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0e5fe7-597f0f92-ca47bf71-a6c6e926_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ffbdb9b2-65365331-c8971526-31fd3409_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.215597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Write session: try to update token
2025-10-02T09:33:10.215606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.222850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.222867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.222868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.222869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.222874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.222876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.222879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731209150:5137]
2025-10-02T09:33:10.222900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.222902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.222903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.222905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.222908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.222909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.223029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.226364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId: src_id|ffbdb9b2-65365331-c8971526-31fd3409_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.228460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.292499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806765716:7474]
2025-10-02T09:33:10.292711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1834, pipe: [1:7556555110806765716:7474]
2025-10-02T09:33:10.332295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.332503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.332518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.332546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765716:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.332883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806765716:7474]
2025-10-02T09:33:10.332900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:10.332902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:10.332928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.332953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1835 reason: error at write: Disconnected sessionId: src_id|ffbdb9b2-65365331-c8971526-31fd3409_0
2025-10-02T09:33:10.332974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.333084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1835 sessionId: src_id|ffbdb9b2-65365331-c8971526-31fd3409_0 is DEAD
2025-10-02T09:33:10.333232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:10.333241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Write session will restart in 0.006034s
2025-10-02T09:33:10.333259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Write session: Do CDS request
2025-10-02T09:33:10.333263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.340196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.340295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.340303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1836
2025-10-02T09:33:10.340387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.340407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.340412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.340415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.340675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1836 sessionId:  describe result for acl check
2025-10-02T09:33:10.340697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.340702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.340703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.340705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806765817:7185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.341054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806765817:7185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.342139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.342552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806765817:7185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.343632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.343755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.343764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.343773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.343816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.343849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731209326:5130]
2025-10-02T09:33:10.344038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806765817:7185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.344046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806765817:7185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.344048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806765817:7185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.344051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.344338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.344514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.344545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.344755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.344796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.344810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.344810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.344811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.344812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.344812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.344813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.344813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.344814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.344814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.344815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.344815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.344818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.344824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.344826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.344828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.344830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.344832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.344834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.344836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.344838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.344840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.344842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.344844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.344848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.344852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.344856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.344859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.344861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.344864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.344866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.344869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.344871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.344873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.344876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.344879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.344881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.344883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.344886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.344888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.344896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.344898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.344900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.344903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.344906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.344909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.344912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.344915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.344932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.352637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.354166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.354177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.354179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.354180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.354183Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1835 [2:7556555110731209326:5130]
2025-10-02T09:33:10.354190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.354200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.354205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.354207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.354208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.354217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.354222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.354226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.354257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.354262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.354263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.354265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.354266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.354302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.354307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.354317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.354328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.354345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.354362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765882:7185], now have 1 active actors on pipe
2025-10-02T09:33:10.354369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765717:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.354373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.354376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.354379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.354389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.354402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.354402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.354404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.354405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.354400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1835
2025-10-02T09:33:10.354416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.354404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1835
2025-10-02T09:33:10.354419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.354438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.354446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.354451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.354458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.354460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.354481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.354488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.354491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.354492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.354497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.354505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.354517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.354636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.354643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.354653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.354720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1836 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0
2025-10-02T09:33:10.354914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbdb9b2-65365331-c8971526-31fd3409_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.357129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Write session: try to update token
2025-10-02T09:33:10.357141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.364091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.364107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.364108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.364109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.364114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.364116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.364118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731209321:5130]
2025-10-02T09:33:10.364141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.364142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.364144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.364145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.364146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.364147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.364260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.368214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId: src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.370199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.432794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806765895:7474]
2025-10-02T09:33:10.433005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1835, pipe: [1:7556555110806765895:7474]
2025-10-02T09:33:10.473367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.473576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.473584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.473609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765895:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.473732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.473830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806765895:7474]
2025-10-02T09:33:10.473850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:10.473853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.473900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1836 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0
2025-10-02T09:33:10.474026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1836 sessionId: src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0 is DEAD
2025-10-02T09:33:10.474197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:10.474210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Write session will restart in 0.005762s
2025-10-02T09:33:10.474231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Write session: Do CDS request
2025-10-02T09:33:10.474237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.481157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.481208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.481216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1837
2025-10-02T09:33:10.481384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.481403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.481409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.481412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.481695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1837 sessionId:  describe result for acl check
2025-10-02T09:33:10.481712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.481716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.481717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.481720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806766015:7177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.482085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806766015:7177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.483010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.483365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806766015:7177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.484496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.484631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.484640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.484648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.484690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.484720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731209496:5128]
2025-10-02T09:33:10.484859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806766015:7177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.484867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806766015:7177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.484870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806766015:7177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.484873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.485205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.485389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.485423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.485687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.485732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.485737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.485738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.485739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.485740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.485741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.485742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.485743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.485744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.485745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.485746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.485747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.485751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.485760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.485763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.485767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.485769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.485771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.485773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.485775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.485777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.485779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.485781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.485783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.485787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.485790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.485793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.485796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.485799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.485801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.485803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.485806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.485808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.485815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.485817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.485820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.485822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.485825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.485827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.485830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.485832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.485835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.485837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.485839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.485842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.485848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.485850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.485853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.485870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.493617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.495171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.495183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.495184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.495186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.495189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1836 [2:7556555110731209496:5128]
2025-10-02T09:33:10.495196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.495206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.495207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.495208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.495210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.495219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.495222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.495226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.495255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.495260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.495261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.495263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.495265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.495300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.495305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.495312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.495320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.495333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.495352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766062:7177], now have 1 active actors on pipe
2025-10-02T09:33:10.495358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806765896:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.495363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.495366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.495368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.495378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.495389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.495392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.495397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.495398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.495403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.495394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1836
2025-10-02T09:33:10.495405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.495398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1836
2025-10-02T09:33:10.495424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.495431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.495432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.495445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.495451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.495483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.495493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.495495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.495497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.495503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.495510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.495525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.495613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.495620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.495631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.495693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1837 partition: 0 MaxSeqNo: 36 sessionId: src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0
2025-10-02T09:33:10.495873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5b9228-29e0628e-1bc57da-f628ffae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.498098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Write session: try to update token
2025-10-02T09:33:10.498109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.505101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.505115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.505116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.505117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.505122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.505125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.505127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731209491:5128]
2025-10-02T09:33:10.505148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.505150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.505153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.505153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.505155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.505155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.505352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.509347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId: src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.511305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.574103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806766075:7474]
2025-10-02T09:33:10.574293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1836, pipe: [1:7556555110806766075:7474]
2025-10-02T09:33:10.614863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.615165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.615175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.615200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766075:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.615330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.615464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806766075:7474]
2025-10-02T09:33:10.615485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.615497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:10.615562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1837 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0
2025-10-02T09:33:10.615698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1837 sessionId: src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0 is DEAD
2025-10-02T09:33:10.615869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:10.615883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Write session will restart in 0.005791s
2025-10-02T09:33:10.615908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Write session: Do CDS request
2025-10-02T09:33:10.615913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.623124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.623182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.623192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1838
2025-10-02T09:33:10.623278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.623299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.623304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.623307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.623617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1838 sessionId:  describe result for acl check
2025-10-02T09:33:10.623638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.623643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.623644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.623646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806766206:7162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.623991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806766206:7162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.624486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.625176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806766206:7162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.625867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.626026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.626033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.626040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.626072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.626098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731209667:5127]
2025-10-02T09:33:10.626487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.626657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.626683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806766206:7162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.626690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806766206:7162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.626692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806766206:7162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.626696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.626691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.626962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.627005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.627010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.627010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.627011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.627011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.627012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.627013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.627013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.627014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.627014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.627015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.627016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.627018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.627024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.627026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.627028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.627030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.627032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.627034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.627036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.627038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.627041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.627043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.627045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.627048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.627052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.627055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.627058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.627061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.627063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.627066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.627068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.627071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.627074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.627076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.627079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.627081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.627084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.627086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.627089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.627092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.627095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.627097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.627100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.627102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.627105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.627107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.627109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.627125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.634888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.636427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.636439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.636440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.636442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.636445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1837 [2:7556555110731209667:5127]
2025-10-02T09:33:10.636453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.636462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.636467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.636469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.636470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.636479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.636482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.636488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.636517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.636522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.636523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.636525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.636526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.636562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.636566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.636573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.636578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.636586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.636602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.636608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.636610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.636619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.636625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.636627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.636628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.636633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766076:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.636638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766245:7162], now have 1 active actors on pipe
2025-10-02T09:33:10.636645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.636657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.636662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.636679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.636679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1837
2025-10-02T09:33:10.636691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.636697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.636692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1837
2025-10-02T09:33:10.636781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.636791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.636823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4e113c7-67220a4c-c50629e5-cea2595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.636833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.636837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.636841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.636848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.636858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.636869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.637011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.637017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.637025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.637078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1838 partition: 0 MaxSeqNo: 36 sessionId: src_id|f4e113c7-67220a4c-c50629e5-cea2595_0
2025-10-02T09:33:10.637268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c3a16f-a3ac4671-f3d1d983-26a2fd9e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f4e113c7-67220a4c-c50629e5-cea2595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.639414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Write session: try to update token
2025-10-02T09:33:10.639424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.646329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.646345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.646346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.646347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.646352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.646355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.646359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731209662:5127]
2025-10-02T09:33:10.646381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.646385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.646386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.646387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.646395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.646398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.646518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.650968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId: src_id|f4e113c7-67220a4c-c50629e5-cea2595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.652971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.715419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806766256:7474]
2025-10-02T09:33:10.715668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1837, pipe: [1:7556555110806766256:7474]
2025-10-02T09:33:10.757245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.757547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.757556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.757581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766256:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.757757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806766256:7474]
2025-10-02T09:33:10.757774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:10.757776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:10.757779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.757817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.757824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1838 reason: error at write: Disconnected sessionId: src_id|f4e113c7-67220a4c-c50629e5-cea2595_0
2025-10-02T09:33:10.757963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1838 sessionId: src_id|f4e113c7-67220a4c-c50629e5-cea2595_0 is DEAD
2025-10-02T09:33:10.758128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:10.758141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Write session will restart in 0.008954s
2025-10-02T09:33:10.758162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Write session: Do CDS request
2025-10-02T09:33:10.758167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.766901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.768136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.768217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.768227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1839
2025-10-02T09:33:10.768305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.768324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.768330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.768333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.768482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.768568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1839 sessionId:  describe result for acl check
2025-10-02T09:33:10.768590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.768597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.768603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.768589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.768593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.768594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.768597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806766391:7160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.768631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.768654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731209839:5125]
2025-10-02T09:33:10.768954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806766391:7160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.769014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.769208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.769244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.769452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.769487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.769491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.769492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.769492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.769493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.769493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.769494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.769506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.769506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.769507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.769507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.769508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.769511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.769517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.769519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.769521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.769523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.769525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.769527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.769529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.769531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.769534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.769536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.769538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.769543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.769546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.769549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.769552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.769554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.769557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.769559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.769566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.769569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.769572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.769574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.769577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.769581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.769583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.769586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.769588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.769590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.769594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.769598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.769600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.769602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.769605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.769607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.769609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.769625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.770532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806766391:7160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.775105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806766391:7160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.775114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806766391:7160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.775116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806766391:7160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.775119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.777387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.778865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.778877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.778878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.778880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.778884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1838 [2:7556555110731209839:5125]
2025-10-02T09:33:10.778891Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.778901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.778906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.778907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.778908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.778916Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.778919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.778924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.778953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.778958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.778959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.778960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.778962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.778998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.779003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.779009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.779014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.779025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.779041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766430:7160], now have 1 active actors on pipe
2025-10-02T09:33:10.779048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766257:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.779054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.779057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.779059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.779065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.779070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.779072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.779073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.779079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.779091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.779096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.779102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1838
2025-10-02T09:33:10.779105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1838
2025-10-02T09:33:10.779114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.779121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.779122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.779138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.779144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.779171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.779182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.779186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.779189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.779195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.779206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.779221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.779334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.779341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.779352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.779424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1839 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0
2025-10-02T09:33:10.779628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e113c7-67220a4c-c50629e5-cea2595_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.782384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Write session: try to update token
2025-10-02T09:33:10.782400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.788684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.788697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.788698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.788699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.788703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.788706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.788709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731209834:5125]
2025-10-02T09:33:10.788729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.788734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.788735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.788736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.788737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.788739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.788867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.794637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId: src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.796642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:10.857751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555110806766443:7474]
2025-10-02T09:33:10.857999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1838, pipe: [1:7556555110806766443:7474]
2025-10-02T09:33:10.903079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:10.903402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.903411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.903424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766443:7474], now have 1 active actors on pipe
2025-10-02T09:33:10.903597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:10.903609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:10.903640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555110806766443:7474]
2025-10-02T09:33:10.903650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:10.903709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0
2025-10-02T09:33:10.903859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1839 sessionId: src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0 is DEAD
2025-10-02T09:33:10.903990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:10.904000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Write session will restart in 0.007886s
2025-10-02T09:33:10.904015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Write session: Do CDS request
2025-10-02T09:33:10.904019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:10.911957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:10.913226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.913329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:10.913338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1840
2025-10-02T09:33:10.913424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:10.913438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:10.913443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:10.913448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:10.913451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:10.913573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:10.913580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:10.913587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:10.913617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:10.913643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555110731210023:5121]
2025-10-02T09:33:10.913716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1840 sessionId:  describe result for acl check
2025-10-02T09:33:10.913740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:10.913744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:10.913745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:10.913748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555110806766582:7152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:10.913988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:10.914098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555110806766582:7152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:10.914173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:10.914198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:10.914401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:10.914438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.914443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.914443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.914444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.914444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.914445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.914445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.914446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.914446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.914447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.914447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.914448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.914451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.914457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.914459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.914461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.914463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.914465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.914467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.914469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.914471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.914473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.914475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.914477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.914481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.914485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:10.914488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.914491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:10.914493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.914496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:10.914499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.914502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:10.914504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.914507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:10.914509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.914512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:10.914514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.914517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:10.914520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.914523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:10.914525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.914528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:10.914530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.914533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.914535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.914538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.914540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.914543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.914566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:10.915440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555110806766582:7152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:10.920073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555110806766582:7152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:10.920082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555110806766582:7152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:10.920084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555110806766582:7152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:10.920088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:10.922352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:10.924012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:10.924024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:10.924025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:10.924027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:10.924030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1839 [2:7556555110731210023:5121]
2025-10-02T09:33:10.924040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:10.924051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:10.924057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.924058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.924059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.924069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:10.924072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:10.924076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:10.924110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.924115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.924116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.924118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:10.924119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:10.924154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:10.924159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.924165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:10.924175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:10.924192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:10.924211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766444:2446], now have 1 active actors on pipe
2025-10-02T09:33:10.924218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555110806766621:7152], now have 1 active actors on pipe
2025-10-02T09:33:10.924223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.924225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.924228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.924239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:10.924249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:10.924251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:10.924257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:10.924258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:10.924263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:10.924265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:10.924257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1839
2025-10-02T09:33:10.924272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1839
2025-10-02T09:33:10.924284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.924290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:10.924291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:10.924304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.924310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.924335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:10.924343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:10.924345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:10.924346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:10.924352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:10.924360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:10.924373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.924471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:10.924478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:10.924488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:10.924541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1840 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0
2025-10-02T09:33:10.924713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa6e51b3-99223efb-779b5c7c-ec0d2730_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:10.927141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Write session: try to update token
2025-10-02T09:33:10.927152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:10.934143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:10.934159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:10.934160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:10.934161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:10.934166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.934169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.934171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555110731210018:5121]
2025-10-02T09:33:10.934194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:10.934199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:10.934200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:10.934202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:10.934209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:10.934212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:10.934324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:10.938655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId: src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:10.940819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.003676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101733936:7474]
2025-10-02T09:33:11.003897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1839, pipe: [1:7556555115101733936:7474]
2025-10-02T09:33:11.045598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.045870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.045880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.045907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101733936:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.046049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101733936:7474]
2025-10-02T09:33:11.046068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.046072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.046090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:11.046099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:11.046146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1840 reason: error at write: Disconnected sessionId: src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0
2025-10-02T09:33:11.046272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1840 sessionId: src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0 is DEAD
2025-10-02T09:33:11.046436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:11.046451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Write session will restart in 0.006980s
2025-10-02T09:33:11.046476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Write session: Do CDS request
2025-10-02T09:33:11.046482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.054170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.054209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.054216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1841
2025-10-02T09:33:11.054357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.054381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.054388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.054391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.054641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1841 sessionId:  describe result for acl check
2025-10-02T09:33:11.054662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.054666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.054667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.054670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101734073:7147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.054864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.055016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101734073:7147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.056254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101734073:7147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.056504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.056626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.056633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.056639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.056667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.056691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026177494:5120]
2025-10-02T09:33:11.057081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.057255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.057282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.057490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.057538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.057544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.057544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.057545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.057546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.057547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.057548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.057549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.057550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.057551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.057552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.057553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.057557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.057563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.057565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.057567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.057569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.057571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.057573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.057575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.057577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.057579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.057581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.057583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.057586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.057591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.057595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.057598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.057600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.057603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.057606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.057610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.057617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.057621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.057624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.057628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.057632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.057638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.057641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.057646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.057651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.057655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.057663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.057667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.057672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.057676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.057681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.057686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.057712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.057788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101734073:7147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.057795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101734073:7147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.057797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101734073:7147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.057800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.065420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.066901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.066913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.066914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.066915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.066919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1840 [2:7556555115026177494:5120]
2025-10-02T09:33:11.066927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.066937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.066939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.066940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.066941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.066951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.066957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.066961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.066994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.066998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.066999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.067001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.067002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.067039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.067043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.067053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.067062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.067078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.067096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101733938:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.067102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734112:7147], now have 1 active actors on pipe
2025-10-02T09:33:11.067106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.067108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.067110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.067122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.067135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.067136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.067138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.067139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.067150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.067153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.067139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1840
2025-10-02T09:33:11.067148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1840
2025-10-02T09:33:11.067170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.067176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.067177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.067189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.067194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.067218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.067225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.067228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.067229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.067234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.067240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.067251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.067354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.067360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.067371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.067434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1841 partition: 0 MaxSeqNo: 36 sessionId: src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0
2025-10-02T09:33:11.067613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cae0a76-a418aff-8b7ea9bf-f691f575_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.069721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Write session: try to update token
2025-10-02T09:33:11.069731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.076771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.076787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.076788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.076789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.076796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.076798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.076812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026177489:5120]
2025-10-02T09:33:11.076837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.076839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.076843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.076845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.076847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.076847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.076966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.080862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId: src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.082831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.146154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101734142:7474]
2025-10-02T09:33:11.146315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1840, pipe: [1:7556555115101734142:7474]
2025-10-02T09:33:11.187094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.187364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.187373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.187398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734142:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.187535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.187569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.187599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:11.187609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101734142:7474]
2025-10-02T09:33:11.187648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1841 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0
2025-10-02T09:33:11.187781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1841 sessionId: src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0 is DEAD
2025-10-02T09:33:11.187916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:11.187924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Write session will restart in 0.007331s
2025-10-02T09:33:11.187939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Write session: Do CDS request
2025-10-02T09:33:11.187943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.196016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.196075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.196161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.196171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1842
2025-10-02T09:33:11.196255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.196274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.196280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.196282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.196534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1842 sessionId:  describe result for acl check
2025-10-02T09:33:11.196558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.196564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.196565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.196568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101734282:7129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.196916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101734282:7129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.197523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.197645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.197652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.197658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.197688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.197712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026177705:5097]
2025-10-02T09:33:11.198114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.198235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101734282:7129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.198289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.198316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.198577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.198613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.198618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.198618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.198619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.198619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.198620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.198620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.198621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.198621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.198622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.198622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.198623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.198625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.198631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.198633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.198635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.198637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.198639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.198641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.198643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.198645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.198647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.198649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.198651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.198654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.198659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.198663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.198666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.198668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.198671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.198673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.198676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.198678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.198680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.198683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.198685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.198687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.198690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.198692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.198695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.198697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.198712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.198714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.198717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.198720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.198722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.198724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.198727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.198745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.202723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101734282:7129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.202732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101734282:7129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.202734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101734282:7129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.202738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.206473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.207997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.208008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.208010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.208012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.208015Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1841 [2:7556555115026177705:5097]
2025-10-02T09:33:11.208021Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.208031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.208036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.208038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.208039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.208048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.208051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.208057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.208086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.208090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.208091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.208093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.208094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.208130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.208136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.208145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.208154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.208171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.208186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734321:7129], now have 1 active actors on pipe
2025-10-02T09:33:11.208193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734145:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.208197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.208199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.208200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.208210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.208222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.208218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1841
2025-10-02T09:33:11.208219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1841
2025-10-02T09:33:11.208223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.208230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.208231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.208234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.208236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.208253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.208256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.208257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.208270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.208278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.208310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54a7d49-1244e967-13c13577-3f8a084e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.208319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.208322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.208324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.208330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.208340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.208356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.208465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.208473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.208485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.208529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1842 partition: 0 MaxSeqNo: 36 sessionId: src_id|54a7d49-1244e967-13c13577-3f8a084e_0
2025-10-02T09:33:11.208699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99f3ee3-9961fd1d-54935842-4fb04d03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54a7d49-1244e967-13c13577-3f8a084e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.210983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Write session: try to update token
2025-10-02T09:33:11.210994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.218615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.218632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.218634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.218635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.218641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.218643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.218646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026177700:5097]
2025-10-02T09:33:11.218671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.218676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.218676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.218677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.218679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.218682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.218813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.222721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId: src_id|54a7d49-1244e967-13c13577-3f8a084e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.224826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.287834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101734334:7474]
2025-10-02T09:33:11.288053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1841, pipe: [1:7556555115101734334:7474]
2025-10-02T09:33:11.332358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.332681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.332690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.332719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734334:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.332916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:11.332926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:11.332934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101734334:7474]
2025-10-02T09:33:11.332950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.332947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.332978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1842 reason: error at write: Disconnected sessionId: src_id|54a7d49-1244e967-13c13577-3f8a084e_0
2025-10-02T09:33:11.333108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1842 sessionId: src_id|54a7d49-1244e967-13c13577-3f8a084e_0 is DEAD
2025-10-02T09:33:11.333243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:11.333253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Write session will restart in 0.006796s
2025-10-02T09:33:11.333272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Write session: Do CDS request
2025-10-02T09:33:11.333278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.341123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.341220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.341230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1843
2025-10-02T09:33:11.341307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.341328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.341331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.341334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.341595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1843 sessionId:  describe result for acl check
2025-10-02T09:33:11.341577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.341619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.341625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.341626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.341631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101734473:7122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.341982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101734473:7122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.343124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.343286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.343293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.343301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.343351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.343381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026177883:5096]
2025-10-02T09:33:11.343565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101734473:7122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.343900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.344082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.344115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.344318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.344352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.344356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.344356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.344357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.344357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.344358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.344358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.344359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.344359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.344360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.344360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.344361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.344363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.344369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.344371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.344373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.344375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.344377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.344379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.344381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.344383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.344385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.344387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.344389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.344392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.344396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.344399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.344402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.344404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.344407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.344409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.344412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.344414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.344417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.344419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.344422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.344424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.344427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.344429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.344432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.344434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.344437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.344439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.344441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.344444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.344447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.344450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.344453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.344468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.348423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101734473:7122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.348431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101734473:7122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.348433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101734473:7122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.348436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.352219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.353730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.353742Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.353743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.353745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.353748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1842 [2:7556555115026177883:5096]
2025-10-02T09:33:11.353755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.353765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.353768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.353770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.353771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.353780Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.353784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.353788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.353818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.353823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.353823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.353825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.353826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.353863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.353869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.353876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.353885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.353901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.353921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734335:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.353927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734514:7122], now have 1 active actors on pipe
2025-10-02T09:33:11.353932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.353934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.353940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.353950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.353961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.353963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.353969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.353970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.353963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1842
2025-10-02T09:33:11.353965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1842
2025-10-02T09:33:11.353974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.353976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.353992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.353999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.354000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.354010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.354015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.354042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c75dc313-b371f5cf-553a5836-660f1cee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.354049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.354052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.354053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.354058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.354064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.354079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.354165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.354172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.354182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.354246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1843 partition: 0 MaxSeqNo: 36 sessionId: src_id|c75dc313-b371f5cf-553a5836-660f1cee_0
2025-10-02T09:33:11.354425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a7d49-1244e967-13c13577-3f8a084e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c75dc313-b371f5cf-553a5836-660f1cee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.356542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Write session: try to update token
2025-10-02T09:33:11.356553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.363687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.363702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.363703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.363704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.363709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.363712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.363714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026177878:5096]
2025-10-02T09:33:11.363735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.363738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.363740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.363742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.363745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.363748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.363863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.367490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId: src_id|c75dc313-b371f5cf-553a5836-660f1cee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.369451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.433243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101734521:7474]
2025-10-02T09:33:11.433472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1842, pipe: [1:7556555115101734521:7474]
2025-10-02T09:33:11.472396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.472706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.472716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.472740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734521:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.472881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.472949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101734521:7474]
2025-10-02T09:33:11.472968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.472977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:11.473038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c75dc313-b371f5cf-553a5836-660f1cee_0
2025-10-02T09:33:11.473175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1843 sessionId: src_id|c75dc313-b371f5cf-553a5836-660f1cee_0 is DEAD
2025-10-02T09:33:11.473293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:11.473303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Write session will restart in 0.007771s
2025-10-02T09:33:11.473320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Write session: Do CDS request
2025-10-02T09:33:11.473324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.481421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.482114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.482186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.482193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1844
2025-10-02T09:33:11.482273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.482293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.482299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.482302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.482567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1844 sessionId:  describe result for acl check
2025-10-02T09:33:11.482590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.482594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.482596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.482599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101734661:7118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.482965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101734661:7118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.483065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.483198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.483206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.483214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.483247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.483271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026178060:5094]
2025-10-02T09:33:11.483697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.483891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.483924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.484166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.484210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.484216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.484216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.484217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.484218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.484219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.484220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.484221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.484222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.484223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.484224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.484225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.484229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.484236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.484238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.484240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.484242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.484245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.484248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.484252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.484255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.484259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.484262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.484265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.484270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.484278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.484283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.484270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101734661:7118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.484288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.484295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.484300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.484308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.484312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.484320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.484324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.484331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.484336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.484343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.484347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.484353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.484357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.484365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.484370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.484375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.484379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.484387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.484392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.484397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.484401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.484427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.488203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101734661:7118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.488215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101734661:7118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.488217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101734661:7118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.488220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.491860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.493401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.493413Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.493414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.493417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.493420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1843 [2:7556555115026178060:5094]
2025-10-02T09:33:11.493426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.493436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.493439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.493440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.493442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.493451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.493457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.493462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.493490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.493495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.493496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.493498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.493499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.493534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.493538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.493545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.493554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.493569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.493586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734522:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.493593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734699:7118], now have 1 active actors on pipe
2025-10-02T09:33:11.493599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.493602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.493604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.493617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.493629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.493637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.493643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.493645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.493632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1843
2025-10-02T09:33:11.493646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.493648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.493641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1843
2025-10-02T09:33:11.493662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.493664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.493665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.493682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.493688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.493706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.493713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.493715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.493716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.493720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.493726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.493738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.493835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.493841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.493851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.493911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1844 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0
2025-10-02T09:33:11.494097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c75dc313-b371f5cf-553a5836-660f1cee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.496218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Write session: try to update token
2025-10-02T09:33:11.496227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.502928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.502944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.502945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.502946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.502952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.502955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.502957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026178055:5094]
2025-10-02T09:33:11.502977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.502980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.502983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.502983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.502986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.502988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.503139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.507298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId: src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.509294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.573017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101734714:7474]
2025-10-02T09:33:11.573198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1843, pipe: [1:7556555115101734714:7474]
2025-10-02T09:33:11.614806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.615006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.615013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.615038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734714:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.615231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.615243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.615271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:11.615275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101734714:7474]
2025-10-02T09:33:11.615347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1844 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0
2025-10-02T09:33:11.615480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1844 sessionId: src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0 is DEAD
2025-10-02T09:33:11.615569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:11.615578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Write session will restart in 0.005905s
2025-10-02T09:33:11.615593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Write session: Do CDS request
2025-10-02T09:33:11.615597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.622104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.622185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.622194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1845
2025-10-02T09:33:11.622281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.622302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.622315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.622320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.622634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1845 sessionId:  describe result for acl check
2025-10-02T09:33:11.622659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.622663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.622664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.622668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101734839:7103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.623032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101734839:7103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.623961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.624613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101734839:7103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.625490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.625598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.625604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.625610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.625637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.625661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026178238:5084]
2025-10-02T09:33:11.626093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101734839:7103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.626101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101734839:7103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.626103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101734839:7103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.626107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.626107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.626285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.626319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.626506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.626535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.626539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.626540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.626540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.626541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.626541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.626542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.626542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.626543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.626543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.626544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.626544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.626547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.626553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.626555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.626557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.626559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.626561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.626563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.626565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.626567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.626569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.626571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.626573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.626577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.626582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.626585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.626588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.626590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.626593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.626595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.626598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.626601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.626604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.626606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.626608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.626611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.626613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.626615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.626618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.626620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.626623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.626627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.626629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.626631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.626634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.626636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.626639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.626659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.634452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.635903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.635916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.635918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.635919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.635923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1844 [2:7556555115026178238:5084]
2025-10-02T09:33:11.635932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.635941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.635946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.635947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.635948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.635958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.635961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.635965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.635996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.636001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.636002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.636003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.636005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.636042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.636047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.636054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.636063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.636076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.636095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734889:7103], now have 1 active actors on pipe
2025-10-02T09:33:11.636102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734715:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.636107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.636111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.636114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.636124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.636136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.636137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.636143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.636144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.636148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.636139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1844
2025-10-02T09:33:11.636156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1844
2025-10-02T09:33:11.636150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.636169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.636171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.636172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.636186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.636191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.636311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.636323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.636326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.636328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.636334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.636344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.636360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.636471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.636476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.636485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.636540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1845 partition: 0 MaxSeqNo: 36 sessionId: src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0
2025-10-02T09:33:11.636725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f349ed-da01db42-20d8d06-6b09df5a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.638984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Write session: try to update token
2025-10-02T09:33:11.638995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.645795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.645813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.645815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.645817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.645823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.645827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.645830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026178233:5084]
2025-10-02T09:33:11.645858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.645860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.645862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.645864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.645865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.645867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.645998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.650660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId: src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.652744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.715363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101734902:7474]
2025-10-02T09:33:11.715771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1844, pipe: [1:7556555115101734902:7474]
2025-10-02T09:33:11.756784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.757033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.757044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.757076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734902:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.757194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.757201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:11.757212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:11.757227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.757259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101734902:7474]
2025-10-02T09:33:11.757259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1845 reason: error at write: Disconnected sessionId: src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0
2025-10-02T09:33:11.757389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1845 sessionId: src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0 is DEAD
2025-10-02T09:33:11.757509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:11.757518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Write session will restart in 0.009584s
2025-10-02T09:33:11.757536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Write session: Do CDS request
2025-10-02T09:33:11.757541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.766122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.767585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.767692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.767700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.767707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.767743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.767786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026178418:5082]
2025-10-02T09:33:11.768139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.768136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.768197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.768208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1846
2025-10-02T09:33:11.768298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.768318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.768321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.768324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.768343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.768375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.768565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.768582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1846 sessionId:  describe result for acl check
2025-10-02T09:33:11.768607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.768612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.768606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.768613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.768611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.768613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.768612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.768615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.768616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101735046:7098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.768615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.768616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.768617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.768618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.768619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.768620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.768621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.768625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.768636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.768640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.768644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.768648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.768651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.768655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.768659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.768663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.768667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.768670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.768674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.768679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.768686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.768692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.768697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.768702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.768707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.768711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.768716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.768720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.768726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.768730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.768734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.768744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.768749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.768753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.768759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.768763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.768768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.768772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.768778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.768782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.768787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.768792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.768797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.768838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.769000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101735046:7098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.770494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101735046:7098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.774074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101735046:7098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.774083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101735046:7098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.774085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101735046:7098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.774088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.776253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.777816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.777829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.777831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.777834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.777838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1845 [2:7556555115026178418:5082]
2025-10-02T09:33:11.777848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.777860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.777862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.777864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.777867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.777879Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.777883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.777888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.777926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.777933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.777934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.777937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.777939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.777985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.777990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.778000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.778011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.778031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.778049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101734903:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.778054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101735083:7098], now have 1 active actors on pipe
2025-10-02T09:33:11.778060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.778062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.778064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.778056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1845
2025-10-02T09:33:11.778071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.778058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1845
2025-10-02T09:33:11.778083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.778086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.778091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.778092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.778098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.778101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.778131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.778138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.778149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.778159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.778166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.778179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86b5a96f-928b949e-e843fca-df19508b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.778188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.778191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.778196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.778203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.778210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.778226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.778324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.778329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.778339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.778395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1846 partition: 0 MaxSeqNo: 36 sessionId: src_id|86b5a96f-928b949e-e843fca-df19508b_0
2025-10-02T09:33:11.778587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a43514-344a8fb9-c80b7913-b32e3df3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86b5a96f-928b949e-e843fca-df19508b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.780873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Write session: try to update token
2025-10-02T09:33:11.780882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.787452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.787469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.787471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.787473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.787481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.787484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.787487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026178413:5082]
2025-10-02T09:33:11.787509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.787513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.787515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.787516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.787522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.787524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.787635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.792309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId: src_id|86b5a96f-928b949e-e843fca-df19508b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.794338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.857173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101735096:7474]
2025-10-02T09:33:11.857304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1845, pipe: [1:7556555115101735096:7474]
2025-10-02T09:33:11.896724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:11.896954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.896964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.896994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101735096:7474], now have 1 active actors on pipe
2025-10-02T09:33:11.897118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:11.897147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101735096:7474]
2025-10-02T09:33:11.897169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:11.897178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:11.897262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1846 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86b5a96f-928b949e-e843fca-df19508b_0
2025-10-02T09:33:11.897401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1846 sessionId: src_id|86b5a96f-928b949e-e843fca-df19508b_0 is DEAD
2025-10-02T09:33:11.897532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:11.897541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Write session will restart in 0.005084s
2025-10-02T09:33:11.897556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Write session: Do CDS request
2025-10-02T09:33:11.897560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:11.903096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.903170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:11.903178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1847
2025-10-02T09:33:11.903270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:11.903290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:11.903293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:11.903296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:11.903615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1847 sessionId:  describe result for acl check
2025-10-02T09:33:11.903640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:11.903645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:11.903645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:11.903648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555115101735153:7092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:11.903997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555115101735153:7092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:11.905869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555115101735153:7092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:11.906514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:11.907933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:11.908085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:11.908094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:11.908102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:11.908120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555115101735153:7092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:11.908128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555115101735153:7092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:11.908131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555115101735153:7092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:11.908134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:11.908145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:11.908174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555115026178609:5065]
2025-10-02T09:33:11.908565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:11.908731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:11.908763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:11.908960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:11.909005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.909010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.909010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.909011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.909012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.909013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.909014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.909015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.909016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.909017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.909018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.909019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.909024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.909033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.909038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.909042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.909046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.909049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.909052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.909056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.909059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.909063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.909067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.909071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.909077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.909083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:11.909090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.909096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:11.909103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.909108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:11.909112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.909116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:11.909120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.909125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:11.909129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.909135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:11.909140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.909145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:11.909149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.909154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:11.909159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.909164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:11.909168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.909173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.909177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.909182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.909186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.909190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.909222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:11.916612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:11.918137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:11.918150Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:11.918152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:11.918155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:11.918159Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1846 [2:7556555115026178609:5065]
2025-10-02T09:33:11.918168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:11.918181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:11.918184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.918186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.918188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.918200Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:11.918208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:11.918213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:11.918252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.918259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.918260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.918262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:11.918264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:11.918310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:11.918315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.918325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:11.918336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:11.918354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:11.918372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101735097:2446], now have 1 active actors on pipe
2025-10-02T09:33:11.918379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101735276:7092], now have 1 active actors on pipe
2025-10-02T09:33:11.918383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.918385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.918387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.918381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1846
2025-10-02T09:33:11.918398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:11.918382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1846
2025-10-02T09:33:11.918406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:11.918408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:11.918409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:11.918411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:11.918423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:11.918429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:11.918454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.918460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.918473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.918482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:11.918488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:11.918503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:11.918511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:11.918514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:11.918516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:11.918523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:11.918529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:11.918549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.918634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:11.918640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:11.918649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:11.918714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1847 partition: 0 MaxSeqNo: 36 sessionId: src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0
2025-10-02T09:33:11.918907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86b5a96f-928b949e-e843fca-df19508b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:11.921066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Write session: try to update token
2025-10-02T09:33:11.921077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:11.927756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:11.927767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:11.927768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:11.927770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:11.927774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.927778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.927780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555115026178604:5065]
2025-10-02T09:33:11.927803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:11.927804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:11.927806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:11.927807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:11.927807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:11.927810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:11.927922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:11.932250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId: src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:11.934225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:11.997474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555115101735300:7474]
2025-10-02T09:33:11.997678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1846, pipe: [1:7556555115101735300:7474]
2025-10-02T09:33:12.040169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.040446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.040455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.040480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555115101735300:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.040624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.040640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.040670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:12.040683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555115101735300:7474]
2025-10-02T09:33:12.040724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1847 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0
2025-10-02T09:33:12.040861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1847 sessionId: src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0 is DEAD
2025-10-02T09:33:12.041008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:12.041017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Write session will restart in 0.006817s
2025-10-02T09:33:12.041035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Write session: Do CDS request
2025-10-02T09:33:12.041040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.049107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.049187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.049196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1848
2025-10-02T09:33:12.049274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.049294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.049299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.049302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.049573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1848 sessionId:  describe result for acl check
2025-10-02T09:33:12.049597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.049602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.049603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.049606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396702739:7081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.049945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396702739:7081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.049956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.051137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396702739:7081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.051447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.051549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.051556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.051562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.051589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.051612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321146087:5062]
2025-10-02T09:33:12.051941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.052102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.052125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.052292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.052321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.052325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.052325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.052326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.052326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.052327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.052327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.052328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.052328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.052329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.052329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.052330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.052332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.052338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.052340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.052342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.052344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.052346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.052348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.052350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.052352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.052354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.052356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.052358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.052361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.052365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.052368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.052371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.052374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.052377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.052379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.052381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.052384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.052386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.052388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.052391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.052393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.052396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.052400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.052402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.052404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.052408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.052410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.052412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.052415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.052417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.052421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.052423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.052439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.056227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396702739:7081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.056236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396702739:7081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.056239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396702739:7081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.056243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.059854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.061411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.061422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.061423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.061425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.061428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1847 [2:7556555119321146087:5062]
2025-10-02T09:33:12.061435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.061444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.061446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.061447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.061448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.061457Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.061461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.061465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.061494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.061499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.061500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.061503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.061504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.061538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.061542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.061549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.061554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.061564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.061578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396702780:7081], now have 1 active actors on pipe
2025-10-02T09:33:12.061583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396702598:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.061587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.061588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.061589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.061597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.061607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.061608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.061610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.061611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.061617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.061608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1847
2025-10-02T09:33:12.061618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1847
2025-10-02T09:33:12.061618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.061632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.061637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.061638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.061648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.061653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.061677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78b4772f-8c1db39b-912e500f-c764c65b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.061684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.061686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.061687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.061691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.061696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.061708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.061790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.061795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.061802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.061848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1848 partition: 0 MaxSeqNo: 36 sessionId: src_id|78b4772f-8c1db39b-912e500f-c764c65b_0
2025-10-02T09:33:12.062024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39210eff-1115644d-3c4a09de-2a4f8b30_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78b4772f-8c1db39b-912e500f-c764c65b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.064272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Write session: try to update token
2025-10-02T09:33:12.064282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.070977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.070991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.070992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.070993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.070998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.071001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.071005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321146082:5062]
2025-10-02T09:33:12.071027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.071027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.071029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.071030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.071030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.071034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.071170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.075806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId: src_id|78b4772f-8c1db39b-912e500f-c764c65b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.077782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:12.140837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555119396702787:7474]
2025-10-02T09:33:12.141019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1847, pipe: [1:7556555119396702787:7474]
2025-10-02T09:33:12.180380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.180612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.180620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.180642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396702787:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.180740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.180744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555119396702787:7474]
2025-10-02T09:33:12.180752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.180763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:12.180764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:12.180797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1848 reason: error at write: Disconnected sessionId: src_id|78b4772f-8c1db39b-912e500f-c764c65b_0
2025-10-02T09:33:12.180944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1848 sessionId: src_id|78b4772f-8c1db39b-912e500f-c764c65b_0 is DEAD
2025-10-02T09:33:12.181067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:12.181072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Write session will restart in 0.009665s
2025-10-02T09:33:12.181086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Write session: Do CDS request
2025-10-02T09:33:12.181090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.189446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.190896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.191005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.191011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.191017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.191044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.191066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321146305:5046]
2025-10-02T09:33:12.191405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.191576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.191598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.191849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.191885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.191889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.191890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.191890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.191891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.191891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.191892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.191892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.191893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.191893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.191894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.191894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.191897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.191902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.191905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.191907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.191908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.191910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.191912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.191914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.191916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.191919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.191921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.191923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.191926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.191930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.191934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.191936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.191938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.191941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.191943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.191946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.191948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.191950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.191952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.191955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.191957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.191960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.191962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.191964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.191966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.191969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.191971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.191973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.191975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.191978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.191981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.191983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.191998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.192127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.192181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.192191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1849
2025-10-02T09:33:12.192304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.192325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.192330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.192332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.192572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1849 sessionId:  describe result for acl check
2025-10-02T09:33:12.192595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.192599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.192600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.192602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396702963:7068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.192916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396702963:7068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.194299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396702963:7068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.198671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396702963:7068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.198679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396702963:7068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.198682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396702963:7068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.198687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.199463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.200893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.200902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.200903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.200905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.200908Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1848 [2:7556555119321146305:5046]
2025-10-02T09:33:12.200915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.200924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.200925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.200927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.200928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.200936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.200939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.200943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.200969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.200974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.200975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.200977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.200979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.201014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.201019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.201025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.201030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.201037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.201047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396702994:7068], now have 1 active actors on pipe
2025-10-02T09:33:12.201053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396702813:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.201056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.201057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.201058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.201065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.201072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.201077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.201080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.201081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.201085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.201086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.201094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.201099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.201106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.201094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1848
2025-10-02T09:33:12.201095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1848
2025-10-02T09:33:12.201126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.201131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.201146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.201152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.201154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.201155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.201161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.201165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.201173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.201255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.201260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.201267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.201323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1849 partition: 0 MaxSeqNo: 36 sessionId: src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0
2025-10-02T09:33:12.201497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b4772f-8c1db39b-912e500f-c764c65b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.203742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Write session: try to update token
2025-10-02T09:33:12.203751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.210148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:12.210166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.210172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.210198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:12.210205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:12.210336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:12.210453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:12.210603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:12.210751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:12.210911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:12.210938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:12.215080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId: src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.217082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:12.217211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.217225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.217243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:12.217294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:12.218542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.218555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.218556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.218558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.218562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.218565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.218568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321146300:5046]
2025-10-02T09:33:12.218589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.218598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.218600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.218601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.218606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.218609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.218721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.281114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555119396703003:7474]
2025-10-02T09:33:12.281259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1848, pipe: [1:7556555119396703003:7474]
2025-10-02T09:33:12.328298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.334015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.334035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.334157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.334206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.334258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.334307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.334459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.334466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.334517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.334566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.334614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.334663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.334705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.334710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.334760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.334805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.334853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.334900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.334933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.334938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.334985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.335174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.335224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.335273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.335306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.335311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.335361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.335410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.335455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.335503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.335539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.335544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.335594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.335639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.335687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.335733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.335769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.335773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.335819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.335865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.335917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.335966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.336000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.336004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.336050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.336094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.336139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.336188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.336235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.336239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.336284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.336328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.336374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.336423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.336466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.336471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.336515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:12.336565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:12.336612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:12.336694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:12.336734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:12.336739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:12.336767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703003:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.336994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.336994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:12.336997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:12.337016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1849 reason: error at write: Disconnected sessionId: src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0
2025-10-02T09:33:12.337033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555119396703003:7474]
2025-10-02T09:33:12.337086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.337159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1849 sessionId: src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0 is DEAD
2025-10-02T09:33:12.337284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:12.337291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Write session will restart in 0.005602s
2025-10-02T09:33:12.337306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Write session: Do CDS request
2025-10-02T09:33:12.337311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.344089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.344165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.344173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1850
2025-10-02T09:33:12.344255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.344273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.344275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.344278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.344529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1850 sessionId:  describe result for acl check
2025-10-02T09:33:12.344593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.344598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.344601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.344603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396703110:7058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.344954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396703110:7058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.346086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.346771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396703110:7058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.347466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.347608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.347625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.347631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.347661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.347693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321146490:5043]
2025-10-02T09:33:12.348039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.348215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.348243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.348424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.348464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.348469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.348469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.348470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.348470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.348471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.348471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.348472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.348472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.348473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.348473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.348474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.348477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.348482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.348485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.348487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.348489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.348491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.348492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.348494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.348497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.348499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.348501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.348502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.348506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.348509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.348504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396703110:7058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.348513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396703110:7058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.348513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.348515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.348515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396703110:7058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.348518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.348519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.348521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.348523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.348527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.348529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.348532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.348534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.348536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.348539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.348542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.348544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.348546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.348549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.348551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.348554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.348556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.348559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.348562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.348564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.348566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.348583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.355972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.357621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.357634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.357635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.357637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.357641Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1849 [2:7556555119321146490:5043]
2025-10-02T09:33:12.357650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.357662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.357669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.357671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.357673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.357684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.357688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.357693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.357725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.357730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.357731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.357733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.357734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.357771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.357777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.357784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.357789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.357797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.357809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.357812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.357813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.357818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.357825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.357825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.357827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.357830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.357833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.357834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.357840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703004:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.357842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703186:7058], now have 1 active actors on pipe
2025-10-02T09:33:12.357854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.357862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.357880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.357869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1849
2025-10-02T09:33:12.357873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1849
2025-10-02T09:33:12.357950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.357959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.357974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.357982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.357984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.357985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.357991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.357996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.358004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.358129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.358135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.358144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.358198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1850 partition: 0 MaxSeqNo: 36 sessionId: src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0
2025-10-02T09:33:12.358399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3743309a-1a58927a-5d1f71ce-475d89e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.360586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Write session: try to update token
2025-10-02T09:33:12.360595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.367241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.367256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.367258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.367259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.367263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.367266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.367268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321146485:5043]
2025-10-02T09:33:12.367288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.367292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.367293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.367298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.367302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.367309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.367405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.371810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId: src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.373803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:12.437278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555119396703197:7474]
2025-10-02T09:33:12.437465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1849, pipe: [1:7556555119396703197:7474]
2025-10-02T09:33:12.478725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.479036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.479046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.479071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703197:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.479216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.479232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:12.479241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:12.479256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555119396703197:7474]
2025-10-02T09:33:12.479271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.479285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1850 reason: error at write: Disconnected sessionId: src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0
2025-10-02T09:33:12.479409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1850 sessionId: src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0 is DEAD
2025-10-02T09:33:12.479538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:12.479546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Write session will restart in 0.005907s
2025-10-02T09:33:12.479560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Write session: Do CDS request
2025-10-02T09:33:12.479563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.486190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.486326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.486334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1851
2025-10-02T09:33:12.486402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.486422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.486429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.486432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.486733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1851 sessionId:  describe result for acl check
2025-10-02T09:33:12.486759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.486764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.486765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.486768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396703308:7054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.487118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396703308:7054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.488219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.488281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396703308:7054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.489708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.489815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.489822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.489828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.489856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.489881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321146674:5042]
2025-10-02T09:33:12.489936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396703308:7054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.489944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396703308:7054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.489946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396703308:7054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.489949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.490228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.490390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.490414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.490598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.490633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.490637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.490638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.490638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.490639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.490639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.490640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.490640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.490641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.490641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.490642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.490643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.490645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.490651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.490653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.490655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.490657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.490659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.490661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.490663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.490665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.490667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.490669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.490671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.490675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.490679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.490682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.490685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.490687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.490690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.490692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.490695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.490707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.490710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.490712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.490714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.490717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.490719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.490721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.490724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.490726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.490728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.490731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.490733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.490735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.490738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.490740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.490742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.490759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.498283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.499727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.499742Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.499744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.499747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.499751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1850 [2:7556555119321146674:5042]
2025-10-02T09:33:12.499760Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.499771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.499777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.499778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.499779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.499787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.499790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.499795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.499827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.499832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.499833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.499835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.499836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.499874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.499878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.499885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.499890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.499898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.499908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703378:7054], now have 1 active actors on pipe
2025-10-02T09:33:12.499913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703198:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.499917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.499918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.499921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.499928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.499935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.499937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1850
2025-10-02T09:33:12.499944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.499945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1850
2025-10-02T09:33:12.499944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.499947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.499948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.499949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.499963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.499965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.499967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.499975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.499977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.500007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.500017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.500019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.500021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.500026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.500031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.500045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.500130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.500138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.500147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.500211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1851 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0
2025-10-02T09:33:12.500399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04ca441-ed6be7bc-fd499c43-39ed7d0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.502590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Write session: try to update token
2025-10-02T09:33:12.502600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.509353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.509369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.509370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.509371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.509376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.509379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.509381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321146669:5042]
2025-10-02T09:33:12.509402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.509406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.509407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.509417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.509420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.509423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.509531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.514077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId: src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.516109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:12.579615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555119396703391:7474]
2025-10-02T09:33:12.579778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1850, pipe: [1:7556555119396703391:7474]
2025-10-02T09:33:12.620656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.621130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.621139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.621164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703391:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.621321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.621346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555119396703391:7474]
2025-10-02T09:33:12.621361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:12.621364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:12.621370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.621411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1851 reason: error at write: Disconnected sessionId: src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0
2025-10-02T09:33:12.621535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1851 sessionId: src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0 is DEAD
2025-10-02T09:33:12.621685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:12.621695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Write session will restart in 0.005749s
2025-10-02T09:33:12.621714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Write session: Do CDS request
2025-10-02T09:33:12.621719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.628078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.628172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.628182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1852
2025-10-02T09:33:12.628269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.628290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.628296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.628298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.628558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1852 sessionId:  describe result for acl check
2025-10-02T09:33:12.628577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.628582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.628583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.628585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396703497:7041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.628945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396703497:7041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.630152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396703497:7041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.630204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.631532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.631633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.631640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.631646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.631673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.631698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321146859:5038]
2025-10-02T09:33:12.632045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.632162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396703497:7041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.632171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396703497:7041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.632173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396703497:7041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.632176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.632200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.632223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.632413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.632450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.632454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.632455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.632455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.632456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.632457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.632457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.632458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.632458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.632459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.632459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.632459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.632462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.632467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.632469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.632471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.632473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.632475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.632477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.632479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.632481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.632483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.632485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.632487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.632491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.632494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.632497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.632500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.632503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.632505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.632507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.632510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.632512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.632515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.632518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.632521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.632523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.632526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.632528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.632531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.632533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.632536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.632538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.632541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.632543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.632545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.632547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.632550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.632569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.640168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.641847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.641859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.641860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.641862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.641865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1851 [2:7556555119321146859:5038]
2025-10-02T09:33:12.641872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.641881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.641883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.641884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.641885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.641894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.641900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.641904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.641936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.641941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.641942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.641944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.641945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.641977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.641982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.641989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.641994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.642002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.642012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703392:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.642015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703574:7041], now have 1 active actors on pipe
2025-10-02T09:33:12.642020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.642021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.642022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.642029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.642036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.642042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.642044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.642046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.642046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.642047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.642064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.642070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.642060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1851
2025-10-02T09:33:12.642071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1851
2025-10-02T09:33:12.642083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.642098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.642104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.642119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2beba358-1335da2-a12029dc-83565346_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.642126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.642128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.642129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.642134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.642140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.642147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.642242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.642249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.642258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.642314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1852 partition: 0 MaxSeqNo: 36 sessionId: src_id|2beba358-1335da2-a12029dc-83565346_0
2025-10-02T09:33:12.642512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7c4d0f-ebffb1c3-68c45df5-282c622e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2beba358-1335da2-a12029dc-83565346_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.644643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Write session: try to update token
2025-10-02T09:33:12.644653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.651258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.651276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.651278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.651279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.651284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.651286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.651289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321146854:5038]
2025-10-02T09:33:12.651310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.651317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.651319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.651326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.651330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.651332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.651424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.656157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId: src_id|2beba358-1335da2-a12029dc-83565346_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.658371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:12.721440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555119396703586:7474]
2025-10-02T09:33:12.721630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1851, pipe: [1:7556555119396703586:7474]
2025-10-02T09:33:12.761650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.761858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.761867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.761893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703586:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.762079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.762103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.762106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555119396703586:7474]
2025-10-02T09:33:12.762116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:12.762118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:12.762168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1852 reason: error at write: Disconnected sessionId: src_id|2beba358-1335da2-a12029dc-83565346_0
2025-10-02T09:33:12.762297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1852 sessionId: src_id|2beba358-1335da2-a12029dc-83565346_0 is DEAD
2025-10-02T09:33:12.762441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:12.762450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Write session will restart in 0.005950s
2025-10-02T09:33:12.762472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Write session: Do CDS request
2025-10-02T09:33:12.762478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.769106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.769195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.769204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1853
2025-10-02T09:33:12.769273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.769293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.769301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.769304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.769632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1853 sessionId:  describe result for acl check
2025-10-02T09:33:12.769657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.769661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.769662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.769665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396703722:7040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.770013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396703722:7040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.770719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.771505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396703722:7040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.772198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.772290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.772297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.772303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.772328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.772350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321147045:5033]
2025-10-02T09:33:12.772679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.772827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.772849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.772992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396703722:7040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.773001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396703722:7040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.773003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396703722:7040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.773007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.773016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.773044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.773048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.773048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.773049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.773050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.773050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.773051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.773051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.773052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.773052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.773052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.773053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.773056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.773062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.773064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.773066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.773068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.773070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.773072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.773074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.773076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.773078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.773080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.773082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.773086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.773089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.773093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.773095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.773097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.773100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.773102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.773105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.773107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.773110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.773112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.773115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.773117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.773120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.773122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.773125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.773127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.773130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.773132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.773135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.773137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.773141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.773143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.773145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.773163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.780439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.781862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.781874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.781875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.781877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.781881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1852 [2:7556555119321147045:5033]
2025-10-02T09:33:12.781889Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.781899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.781901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.781903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.781905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.781913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.781921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.781925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.781954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.781959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.781960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.781962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.781963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.781999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.782004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.782010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.782016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.782024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.782034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703771:7040], now have 1 active actors on pipe
2025-10-02T09:33:12.782040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703587:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.782043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.782044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.782045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.782053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.782060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.782067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.782067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.782070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.782071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.782072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.782085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.782087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.782083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1852
2025-10-02T09:33:12.782094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1852
2025-10-02T09:33:12.782117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.782118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.782120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.782134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.782138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.782140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.782141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.782147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.782152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.782160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.782252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.782256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.782263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.782320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1853 partition: 0 MaxSeqNo: 36 sessionId: src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0
2025-10-02T09:33:12.782495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2beba358-1335da2-a12029dc-83565346_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.784644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Write session: try to update token
2025-10-02T09:33:12.784654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.791192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.791203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.791205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.791206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.791210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.791213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.791215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321147040:5033]
2025-10-02T09:33:12.791235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.791239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.791240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.791244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.791248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.791251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.791343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.796136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId: src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.798194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:12.862226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555119396703787:7474]
2025-10-02T09:33:12.862385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1852, pipe: [1:7556555119396703787:7474]
2025-10-02T09:33:12.899639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:12.900025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.900034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.900057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703787:7474], now have 1 active actors on pipe
2025-10-02T09:33:12.900170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:12.900173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555119396703787:7474]
2025-10-02T09:33:12.900200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:12.900209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:12.900241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:12.900261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1853 reason: error at write: Disconnected sessionId: src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0
2025-10-02T09:33:12.900388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1853 sessionId: src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0 is DEAD
2025-10-02T09:33:12.900512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:12.900523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Write session will restart in 0.008866s
2025-10-02T09:33:12.900541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Write session: Do CDS request
2025-10-02T09:33:12.900547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:12.909336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:12.910113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.910181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:12.910190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1854
2025-10-02T09:33:12.910269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:12.910289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:12.910295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:12.910297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:12.910549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1854 sessionId:  describe result for acl check
2025-10-02T09:33:12.910573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:12.910578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:12.910579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:12.910582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555119396703940:7033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:12.910809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:12.910900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:12.910906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:12.910912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:12.910930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555119396703940:7033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:12.910938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:12.910960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555119321147243:5025]
2025-10-02T09:33:12.911286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:12.911454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:12.911475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:12.911645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:12.911674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.911678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.911679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.911679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.911680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.911680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.911681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.911681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.911682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.911682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.911683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.911683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.911686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.911692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.911694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.911696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.911698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.911700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.911702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.911704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.911706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.911709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.911711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.911713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.911716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.911720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:12.911723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.911725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:12.911727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.911730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:12.911732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.911734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:12.911737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.911740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:12.911741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.911744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:12.911746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.911749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:12.911751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.911753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:12.911755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.911758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:12.911760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.911763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.911766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.911769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.911772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.911775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.911792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:12.912205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555119396703940:7033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:12.916491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555119396703940:7033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:12.916500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555119396703940:7033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:12.916502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555119396703940:7033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:12.916505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:12.919130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:12.920715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:12.920725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:12.920726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:12.920728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:12.920731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1853 [2:7556555119321147243:5025]
2025-10-02T09:33:12.920738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:12.920746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:12.920749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.920751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.920752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.920760Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:12.920765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:12.920769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:12.920797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.920813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.920817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.920819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:12.920820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:12.920853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:12.920858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.920863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:12.920868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:12.920876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:12.920886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703788:2446], now have 1 active actors on pipe
2025-10-02T09:33:12.920893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.920894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.920895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.920899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:12.920904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555119396703979:7033], now have 1 active actors on pipe
2025-10-02T09:33:12.920908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:12.920907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:12.920910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:12.920912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:12.920915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:12.920917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:12.920930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.920934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:12.920936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:12.920941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1853
2025-10-02T09:33:12.920950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1853
2025-10-02T09:33:12.920995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.921000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.921014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3beac061-5772da35-ef6cb21b-d17db2df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:12.921021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:12.921023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:12.921024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:12.921030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:12.921035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:12.921041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.921139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:12.921144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:12.921151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:12.921202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1854 partition: 0 MaxSeqNo: 36 sessionId: src_id|3beac061-5772da35-ef6cb21b-d17db2df_0
2025-10-02T09:33:12.921391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1fc6-92351fc9-167988f8-6a09d46a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3beac061-5772da35-ef6cb21b-d17db2df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:12.923620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Write session: try to update token
2025-10-02T09:33:12.923630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:12.929968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:12.929979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:12.929980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:12.929981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:12.929986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.929989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.929991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555119321147238:5025]
2025-10-02T09:33:12.930010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:12.930013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:12.930014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:12.930015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:12.930019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:12.930022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:12.930125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:12.935017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId: src_id|3beac061-5772da35-ef6cb21b-d17db2df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:12.936974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.000479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691671294:7474]
2025-10-02T09:33:13.000682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1853, pipe: [1:7556555123691671294:7474]
2025-10-02T09:33:13.039247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.039520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.039529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.039554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671294:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.039700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.039758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691671294:7474]
2025-10-02T09:33:13.039767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.039781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:13.039843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1854 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3beac061-5772da35-ef6cb21b-d17db2df_0
2025-10-02T09:33:13.039970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1854 sessionId: src_id|3beac061-5772da35-ef6cb21b-d17db2df_0 is DEAD
2025-10-02T09:33:13.040105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:13.040114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Write session will restart in 0.009258s
2025-10-02T09:33:13.040129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Write session: Do CDS request
2025-10-02T09:33:13.040134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.048627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.050074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.050167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.050180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.050186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.050193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.050219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.050244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616114728:5015]
2025-10-02T09:33:13.050233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.050243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1855
2025-10-02T09:33:13.050327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.050346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.050352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.050355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.050584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.050609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1855 sessionId:  describe result for acl check
2025-10-02T09:33:13.050634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.050640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.050642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.050644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691671446:7024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.050754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.050776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.050953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.050974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691671446:7024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.050982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.050986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.050986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.050987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.050987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.050988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.050988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.050989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.050989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.050990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.050991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.050991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.050994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.051000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.051002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.051004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.051006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.051008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.051010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.051012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.051014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.051016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.051018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.051020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.051024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.051027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.051031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.051034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.051036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.051039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.051041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.051044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.051046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.051049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.051052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.051054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.051056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.051059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.051061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.051064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.051067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.051070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.051072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.051074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.051077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.051079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.051081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.051084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.051100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.052579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691671446:7024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.056271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691671446:7024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.056279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691671446:7024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.056281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691671446:7024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.056284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.058432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.060167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.060176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.060177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.060179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.060182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1854 [2:7556555123616114728:5015]
2025-10-02T09:33:13.060189Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.060197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.060199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.060200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.060201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.060210Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.060216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.060220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.060251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.060255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.060256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.060258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.060260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.060294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.060299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.060305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.060310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.060318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.060331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671485:7024], now have 1 active actors on pipe
2025-10-02T09:33:13.060337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671296:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.060340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.060341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.060342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.060350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.060358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.060366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.060366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.060363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1854
2025-10-02T09:33:13.060368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.060378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1854
2025-10-02T09:33:13.060369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.060370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.060382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.060383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.060392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.060400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.060402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.060419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|360ecc77-9a72228a-4dacceff-95f2c747_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.060426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.060428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.060429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.060435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.060440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.060447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.060534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.060540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.060546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.060610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1855 partition: 0 MaxSeqNo: 36 sessionId: src_id|360ecc77-9a72228a-4dacceff-95f2c747_0
2025-10-02T09:33:13.060820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3beac061-5772da35-ef6cb21b-d17db2df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|360ecc77-9a72228a-4dacceff-95f2c747_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.062964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Write session: try to update token
2025-10-02T09:33:13.062974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.069444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.069456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.069457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.069458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.069462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.069465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.069469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616114723:5015]
2025-10-02T09:33:13.069488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.069491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.069492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.069501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.069504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.069507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.069598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.073958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId: src_id|360ecc77-9a72228a-4dacceff-95f2c747_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.076023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.139750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691671492:7474]
2025-10-02T09:33:13.139917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1854, pipe: [1:7556555123691671492:7474]
2025-10-02T09:33:13.177508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.177707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.177716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.177738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671492:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.177874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.177870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691671492:7474]
2025-10-02T09:33:13.177879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:13.177882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:13.177896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.177944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1855 reason: error at write: Disconnected sessionId: src_id|360ecc77-9a72228a-4dacceff-95f2c747_0
2025-10-02T09:33:13.178078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1855 sessionId: src_id|360ecc77-9a72228a-4dacceff-95f2c747_0 is DEAD
2025-10-02T09:33:13.178219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:13.178230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Write session will restart in 0.005399s
2025-10-02T09:33:13.178252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Write session: Do CDS request
2025-10-02T09:33:13.178258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.184137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.184190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.184200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1856
2025-10-02T09:33:13.184299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.184319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.184325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.184327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.184590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1856 sessionId:  describe result for acl check
2025-10-02T09:33:13.184610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.184614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.184615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.184618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691671589:7010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.184887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691671589:7010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.186409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691671589:7010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.186891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.188320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.188428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.188434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.188440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.188468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.188490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616114931:5014]
2025-10-02T09:33:13.188517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691671589:7010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.188525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691671589:7010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.188527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691671589:7010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.188531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.188957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.189123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.189150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.189335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.189363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.189367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.189367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.189368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.189368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.189369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.189370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.189370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.189371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.189371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.189372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.189372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.189375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.189381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.189383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.189386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.189388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.189390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.189392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.189394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.189396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.189398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.189400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.189402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.189405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.189409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.189413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.189416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.189419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.189422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.189424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.189426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.189429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.189431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.189433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.189436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.189438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.189441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.189443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.189445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.189448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.189451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.189456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.189459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.189461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.189464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.189466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.189469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.189485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.196844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.198405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.198416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.198417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.198419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.198422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1855 [2:7556555123616114931:5014]
2025-10-02T09:33:13.198431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.198440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.198442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.198444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.198445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.198454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.198459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.198463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.198494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.198498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.198499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.198501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.198502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.198538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.198543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.198549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.198554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.198562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.198572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671691:7010], now have 1 active actors on pipe
2025-10-02T09:33:13.198577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671493:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.198580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.198582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.198582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.198590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.198596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.198603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.198605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.198606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.198607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.198608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.198621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.198625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.198627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.198614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1855
2025-10-02T09:33:13.198639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.198646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.198632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1855
2025-10-02T09:33:13.198670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eed86430-329c8bba-d07ac723-99759cd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.198681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.198685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.198687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.198692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.198709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.198729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.198827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.198832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.198840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.198893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1856 partition: 0 MaxSeqNo: 36 sessionId: src_id|eed86430-329c8bba-d07ac723-99759cd4_0
2025-10-02T09:33:13.199097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360ecc77-9a72228a-4dacceff-95f2c747_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eed86430-329c8bba-d07ac723-99759cd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.201247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Write session: try to update token
2025-10-02T09:33:13.201258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.207746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.207761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.207762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.207763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.207767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.207770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.207771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616114926:5014]
2025-10-02T09:33:13.207793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.207795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.207796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.207799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.207803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.207805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.207898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.212982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId: src_id|eed86430-329c8bba-d07ac723-99759cd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.215082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.277967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691671715:7474]
2025-10-02T09:33:13.278101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1855, pipe: [1:7556555123691671715:7474]
2025-10-02T09:33:13.316311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.316919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.316928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.316941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671715:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.317105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:13.317114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:13.317142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691671715:7474]
2025-10-02T09:33:13.317161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1856 reason: error at write: Disconnected sessionId: src_id|eed86430-329c8bba-d07ac723-99759cd4_0
2025-10-02T09:33:13.317161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.317296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.317298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1856 sessionId: src_id|eed86430-329c8bba-d07ac723-99759cd4_0 is DEAD
2025-10-02T09:33:13.317425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:13.317433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Write session will restart in 0.009047s
2025-10-02T09:33:13.317448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Write session: Do CDS request
2025-10-02T09:33:13.317452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.326057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.327068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.327172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.327181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1857
2025-10-02T09:33:13.327256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.327280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.327290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.327297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.327428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.327534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.327540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.327546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.327539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1857 sessionId:  describe result for acl check
2025-10-02T09:33:13.327561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.327565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.327572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.327566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.327569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691671868:7001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.327596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616115146:4990]
2025-10-02T09:33:13.327907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691671868:7001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.327934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.328103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.328126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.328295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.328323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.328327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.328327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.328328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.328329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.328329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.328330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.328330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.328331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.328331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.328332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.328332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.328335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.328340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.328343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.328345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.328347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.328349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.328350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.328353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.328355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.328357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.328359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.328361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.328364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.328368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.328371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.328374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.328376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.328378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.328381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.328384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.328387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.328390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.328392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.328395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.328397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.328399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.328402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.328404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.328406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.328409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.328413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.328416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.328418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.328420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.328423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.328425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.328442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.329024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691671868:7001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.333144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691671868:7001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.333152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691671868:7001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.333154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691671868:7001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.333157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.335764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.337284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.337294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.337295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.337297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.337300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1856 [2:7556555123616115146:4990]
2025-10-02T09:33:13.337309Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.337317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.337320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.337322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.337323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.337331Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.337334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.337338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.337369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.337374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.337375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.337377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.337378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.337413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.337417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.337423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.337428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.337436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.337450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671906:7001], now have 1 active actors on pipe
2025-10-02T09:33:13.337455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671716:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.337459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.337460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.337461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.337468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.337477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.337481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.337483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.337484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.337486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.337487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.337499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.337492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1856
2025-10-02T09:33:13.337504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.337506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.337499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1856
2025-10-02T09:33:13.337517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.337522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.337541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.337548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.337550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.337551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.337556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.337562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.337577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.337672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.337676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.337684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.337737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1857 partition: 0 MaxSeqNo: 36 sessionId: src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0
2025-10-02T09:33:13.337926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed86430-329c8bba-d07ac723-99759cd4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.340058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Write session: try to update token
2025-10-02T09:33:13.340067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.346502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.346514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.346515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.346517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.346520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.346523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.346525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616115141:4990]
2025-10-02T09:33:13.346544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.346547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.346548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.346553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.346556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.346559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.346657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.351435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId: src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.353459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.417243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691671915:7474]
2025-10-02T09:33:13.417412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1856, pipe: [1:7556555123691671915:7474]
2025-10-02T09:33:13.456190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.456382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.456389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.456414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671915:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.456561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.456592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:13.456601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:13.456622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.456643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1857 reason: error at write: Disconnected sessionId: src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0
2025-10-02T09:33:13.456658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691671915:7474]
2025-10-02T09:33:13.456782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1857 sessionId: src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0 is DEAD
2025-10-02T09:33:13.456936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:13.456945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Write session will restart in 0.006720s
2025-10-02T09:33:13.456962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Write session: Do CDS request
2025-10-02T09:33:13.456966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.464128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.464209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.464218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1858
2025-10-02T09:33:13.464292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.464311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.464317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.464319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.464691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1858 sessionId:  describe result for acl check
2025-10-02T09:33:13.464715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.464720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.464721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.464724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691672066:6994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.465101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691672066:6994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.465443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.466339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691672066:6994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.466911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.467000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.467006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.467013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.467039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.467062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616115337:4988]
2025-10-02T09:33:13.467395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.467552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.467573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.467742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.467770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.467774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.467774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.467775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.467775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.467776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.467776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.467777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.467777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.467778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.467779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.467779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.467782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.467788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.467790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.467792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.467794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.467796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.467797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.467799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.467801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.467803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.467805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.467807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.467811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.467814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.467817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.467820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.467822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.467825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.467827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.467829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.467831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.467834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.467836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.467839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.467843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.467849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.467851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.467854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.467856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.467859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.467861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.467863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.467865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.467868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.467871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.467873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.467891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.468267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691672066:6994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.468274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691672066:6994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.468276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691672066:6994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.468279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.475207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.476702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.476711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.476712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.476714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.476717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1857 [2:7556555123616115337:4988]
2025-10-02T09:33:13.476724Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.476733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.476735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.476737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.476738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.476747Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.476751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.476756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.476791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.476795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.476796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.476798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.476814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.476849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.476854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.476860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.476865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.476873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.476884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672107:6994], now have 1 active actors on pipe
2025-10-02T09:33:13.476890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691671916:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.476893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.476895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.476896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.476902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.476912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.476917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.476920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.476921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.476922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.476923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.476938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.476914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1857
2025-10-02T09:33:13.476942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.476915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1857
2025-10-02T09:33:13.476944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.476954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.476956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.476979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20744433-46731e7d-7afe4266-73d5555f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.476987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.476989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.476990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.476995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.477003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.477011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.477089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.477093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.477101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.477139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1858 partition: 0 MaxSeqNo: 36 sessionId: src_id|20744433-46731e7d-7afe4266-73d5555f_0
2025-10-02T09:33:13.477325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db40c99-491bbf31-a80c3d2-8304ee6e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20744433-46731e7d-7afe4266-73d5555f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.479506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Write session: try to update token
2025-10-02T09:33:13.479515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.486072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.486084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.486085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.486086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.486090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.486093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.486095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616115332:4988]
2025-10-02T09:33:13.486114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.486117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.486118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.486122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.486128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.486130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.486229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.490784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId: src_id|20744433-46731e7d-7afe4266-73d5555f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.492764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.557035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691672116:7474]
2025-10-02T09:33:13.557457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1857, pipe: [1:7556555123691672116:7474]
2025-10-02T09:33:13.596401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.596677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.596686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.596710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672116:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.596838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.596894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:13.596917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:13.596924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691672116:7474]
2025-10-02T09:33:13.596939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.596974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1858 reason: error at write: Disconnected sessionId: src_id|20744433-46731e7d-7afe4266-73d5555f_0
2025-10-02T09:33:13.597131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1858 sessionId: src_id|20744433-46731e7d-7afe4266-73d5555f_0 is DEAD
2025-10-02T09:33:13.597254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:13.597262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Write session will restart in 0.005247s
2025-10-02T09:33:13.597276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Write session: Do CDS request
2025-10-02T09:33:13.597281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.603119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.603200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.603210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1859
2025-10-02T09:33:13.603300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.603327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.603336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.603340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.603610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1859 sessionId:  describe result for acl check
2025-10-02T09:33:13.603634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.603640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.603641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.603644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691672186:6986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.603997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691672186:6986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.605931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691672186:6986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.606613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.607997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.608091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.608097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.608103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.608128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.608168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616115529:4983]
2025-10-02T09:33:13.608197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691672186:6986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.608205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691672186:6986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.608209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691672186:6986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.608212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.608509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.608665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.608688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.608877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.608909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.608913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.608913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.608914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.608914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.608915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.608916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.608916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.608917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.608917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.608918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.608918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.608921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.608927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.608929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.608931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.608933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.608935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.608937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.608939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.608940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.608943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.608945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.608947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.608951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.608955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.608958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.608961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.608965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.608968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.608970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.608973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.608976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.608978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.608980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.608983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.608988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.608990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.608993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.608995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.608998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.609000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.609002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.609006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.609009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.609011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.609015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.609034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.616491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.618084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.618095Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.618096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.618098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.618101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1858 [2:7556555123616115529:4983]
2025-10-02T09:33:13.618108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.618118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.618123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.618124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.618125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.618134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.618137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.618141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.618173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.618177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.618179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.618180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.618182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.618219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.618223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.618229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.618235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.618243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.618254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.618257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.618258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.618262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.618269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672117:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.618270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.618272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.618273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672305:6986], now have 1 active actors on pipe
2025-10-02T09:33:13.618274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.618277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.618284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.618287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.618301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.618309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.618325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.618315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1858
2025-10-02T09:33:13.618317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1858
2025-10-02T09:33:13.618351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.618356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.618371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.618379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.618382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.618383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.618388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.618394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.618402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.618494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.618499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.618507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.618566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1859 partition: 0 MaxSeqNo: 36 sessionId: src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0
2025-10-02T09:33:13.618770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20744433-46731e7d-7afe4266-73d5555f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.621262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Write session: try to update token
2025-10-02T09:33:13.621274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.627298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:13.627309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.627313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.627337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:13.627347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:13.627479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:13.627596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:13.627717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:13.627835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:13.627991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:13.628014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:13.632555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId: src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.634624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.634734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.634744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.634761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:13.634806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:13.635602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.635612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.635613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.635614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.635619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.635622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.635627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616115524:4983]
2025-10-02T09:33:13.635648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.635654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.635655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.635656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.635657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.635662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.635765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.696790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691672318:7474]
2025-10-02T09:33:13.696969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1858, pipe: [1:7556555123691672318:7474]
2025-10-02T09:33:13.748496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.754710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.754727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.754849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.754898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.754949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.755000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.755330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.755339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.755392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.755442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.755492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.755545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.755690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.755695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.755748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.755793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.755847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.755899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.755934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.755943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.755994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.756044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.756091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.756139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.756174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.756179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.756227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.756274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.756322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.756373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.756408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.756414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.756464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.756510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.756561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.756612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.756646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.756651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.756698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.756744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.756793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.756859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.756892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.756897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.756946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.756995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.757043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.757088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.757122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.757127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.757172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.757232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.757289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.757337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.757370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.757374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.757420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.757475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.757532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.757582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.757620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.757625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.757653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672318:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.757808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:13.757819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:13.757836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.757838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1859 reason: error at write: Disconnected sessionId: src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0
2025-10-02T09:33:13.757869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691672318:7474]
2025-10-02T09:33:13.757936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.757964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1859 sessionId: src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0 is DEAD
2025-10-02T09:33:13.758087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:13.758098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Write session will restart in 0.008351s
2025-10-02T09:33:13.758115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Write session: Do CDS request
2025-10-02T09:33:13.758119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.767040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.767235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.767334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.767342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1860
2025-10-02T09:33:13.767428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.767447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.767451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.767453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.767703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1860 sessionId:  describe result for acl check
2025-10-02T09:33:13.767724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.767728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.767731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.767734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691672474:6979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.768063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691672474:6979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.768429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.768517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.768523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.768528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.768552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.768576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616115722:4981]
2025-10-02T09:33:13.768916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.769094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.769116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.769287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.769313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.769316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.769317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.769317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.769318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.769318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.769319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.769319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.769320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.769320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.769321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.769321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.769324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.769330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.769332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.769334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.769336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.769338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.769340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.769342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.769344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.769346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.769348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.769349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.769353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.769357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.769360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.769363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.769365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.769368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.769370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.769373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.769375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.769378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.769380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.769383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.769385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.769387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.769389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.769392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.769394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.769397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.769399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.769401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.769404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.769408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.769410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.769413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.769429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.769756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691672474:6979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.774156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691672474:6979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.774164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691672474:6979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.774166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691672474:6979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.774170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.776772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.778249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.778260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.778261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.778263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.778266Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1859 [2:7556555123616115722:4981]
2025-10-02T09:33:13.778273Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.778283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.778284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.778286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.778287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.778296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.778299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.778303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.778331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.778336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.778337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.778338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.778340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.778374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.778378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.778384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.778390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.778397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.778407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672512:6979], now have 1 active actors on pipe
2025-10-02T09:33:13.778412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672319:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.778416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.778417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.778418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.778425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.778433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.778437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.778440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.778441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.778442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.778443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.778455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.778460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.778466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.778456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1859
2025-10-02T09:33:13.778459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1859
2025-10-02T09:33:13.778483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.778490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.778510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b699565f-ba93c20c-4b61426a-bac496e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.778518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.778521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.778523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.778632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.778643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.778650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.778771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.778776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.778783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.778836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1860 partition: 0 MaxSeqNo: 36 sessionId: src_id|b699565f-ba93c20c-4b61426a-bac496e0_0
2025-10-02T09:33:13.779039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a7a58d-9862e5b1-b0836a59-5cdfcc65_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b699565f-ba93c20c-4b61426a-bac496e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.781433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Write session: try to update token
2025-10-02T09:33:13.781443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.787331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:13.787342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.787347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.787368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:13.787373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:13.787503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:13.787620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:13.787736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:13.787847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:13.788005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:13.788029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:13.792734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId: src_id|b699565f-ba93c20c-4b61426a-bac496e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.794768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:13.794895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.794903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.794928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:13.794970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:13.795702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.795712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.795713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.795714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.795719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.795722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.795724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616115717:4981]
2025-10-02T09:33:13.795744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.795749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.795752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.795753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.795753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.795756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.795862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.858064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555123691672528:7474]
2025-10-02T09:33:13.858242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1859, pipe: [1:7556555123691672528:7474]
2025-10-02T09:33:13.905142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:13.911092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.911108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.911227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.911275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.911334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.911389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.911428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.911434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.911488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.911535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.911583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.911635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.911803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.911808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.911857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.911909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.911960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.912009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.912043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.912049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.912099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.912147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.912194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.912246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.912282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.912287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.912337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.912386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.912437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.912487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.912521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.912525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.912573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.912619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.912666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.912718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.912753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.912757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.912819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.912868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.912920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.912967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.913001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.913007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.913056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.913105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.913156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.913204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.913238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.913242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.913290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.913335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.913384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.913432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.913469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.913474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.913518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:13.913562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:13.913607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:13.913653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:13.913687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:13.913691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:13.913720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672528:7474], now have 1 active actors on pipe
2025-10-02T09:33:13.913867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:13.913875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:13.913876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:13.913894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1860 reason: error at write: Disconnected sessionId: src_id|b699565f-ba93c20c-4b61426a-bac496e0_0
2025-10-02T09:33:13.913905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555123691672528:7474]
2025-10-02T09:33:13.914035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1860 sessionId: src_id|b699565f-ba93c20c-4b61426a-bac496e0_0 is DEAD
2025-10-02T09:33:13.914168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:13.914176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Write session will restart in 0.007302s
2025-10-02T09:33:13.914163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:13.914192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Write session: Do CDS request
2025-10-02T09:33:13.914197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:13.922176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.922266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:13.922275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1861
2025-10-02T09:33:13.922360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:13.922381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:13.922384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:13.922386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:13.922651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1861 sessionId:  describe result for acl check
2025-10-02T09:33:13.922672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:13.922677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:13.922678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:13.922681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555123691672687:6970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:13.922755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:13.923035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555123691672687:6970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:13.924229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:13.924359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:13.924366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:13.924371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:13.924400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:13.924422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555123616115928:4973]
2025-10-02T09:33:13.924759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:13.924836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555123691672687:6970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:13.924913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:13.924935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:13.925107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:13.925138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.925141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.925142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.925143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.925143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.925144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.925144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.925145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.925145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.925146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.925146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.925147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.925150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.925155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.925158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.925160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.925162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.925164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.925166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.925168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.925170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.925173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.925174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.925176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.925180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.925184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:13.925187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.925189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:13.925191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.925194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:13.925196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.925198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:13.925201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.925204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:13.925209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.925212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:13.925214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.925216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:13.925218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.925221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:13.925225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.925230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:13.925232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.925235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.925237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.925240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.925242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.925245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.925262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:13.929022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555123691672687:6970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:13.929030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555123691672687:6970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:13.929032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555123691672687:6970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:13.929036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:13.932608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:13.934013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:13.934022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:13.934024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:13.934026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:13.934029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1860 [2:7556555123616115928:4973]
2025-10-02T09:33:13.934036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:13.934045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:13.934047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.934049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.934050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.934058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:13.934061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:13.934065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:13.934200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.934206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.934207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.934209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:13.934210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:13.934245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:13.934249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.934256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:13.934261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:13.934269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:13.934283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672532:2446], now have 1 active actors on pipe
2025-10-02T09:33:13.934288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555123691672727:6970], now have 1 active actors on pipe
2025-10-02T09:33:13.934292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.934293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.934294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.934301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:13.934312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:13.934322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1860
2025-10-02T09:33:13.934328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1860
2025-10-02T09:33:13.934314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:13.934316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:13.934318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:13.934322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:13.934323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:13.934337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.934339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:13.934340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:13.934356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.934358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.934375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf369b68-104e33ad-767afde-6d002d01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:13.934381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:13.934384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:13.934385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:13.934389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:13.934396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:13.934406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.934487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:13.934492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:13.934499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:13.934551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1861 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf369b68-104e33ad-767afde-6d002d01_0
2025-10-02T09:33:13.934755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b699565f-ba93c20c-4b61426a-bac496e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf369b68-104e33ad-767afde-6d002d01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:13.937025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Write session: try to update token
2025-10-02T09:33:13.937038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:13.943505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:13.943519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:13.943520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:13.943521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:13.943526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.943529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.943533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555123616115922:4973]
2025-10-02T09:33:13.943555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:13.943558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:13.943559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:13.943567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:13.943571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:13.943573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:13.943673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:13.948671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId: src_id|cf369b68-104e33ad-767afde-6d002d01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:13.950775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.014238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986640042:7474]
2025-10-02T09:33:14.014415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1860, pipe: [1:7556555127986640042:7474]
2025-10-02T09:33:14.054077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.054369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.054379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.054406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640042:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.054552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.054568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.054601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:14.054604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986640042:7474]
2025-10-02T09:33:14.054669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1861 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf369b68-104e33ad-767afde-6d002d01_0
2025-10-02T09:33:14.054788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1861 sessionId: src_id|cf369b68-104e33ad-767afde-6d002d01_0 is DEAD
2025-10-02T09:33:14.054919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:14.054926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Write session will restart in 0.008073s
2025-10-02T09:33:14.054941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Write session: Do CDS request
2025-10-02T09:33:14.054945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.063828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.064223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.064305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.064314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1862
2025-10-02T09:33:14.064413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.064432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.064438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.064440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.064687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1862 sessionId:  describe result for acl check
2025-10-02T09:33:14.064711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.064715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.064716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.064719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986640201:6967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.065064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986640201:6967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.065409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.065502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.065509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.065515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.065539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.065563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911083420:4960]
2025-10-02T09:33:14.065892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.066074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.066096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.066268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.066297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.066301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.066302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.066302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.066299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986640201:6967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.066303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.066303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.066305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.066306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.066306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.066309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.066314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.066316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.066318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.066320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.066322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.066324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.066326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.066328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.066330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.066332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.066334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.066338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.066341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.066344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.066347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.066349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.066352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.066354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.066357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.066359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.066363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.066366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.066368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.066370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.066373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.066375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.066377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.066379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.066382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.066388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.066390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.066393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.066396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.066398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.066400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.066418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.070106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986640201:6967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.070115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986640201:6967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.070117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986640201:6967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.070120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.073681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.075267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.075277Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.075278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.075280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.075284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1861 [2:7556555127911083420:4960]
2025-10-02T09:33:14.075291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.075299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.075302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.075304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.075305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.075314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.075320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.075323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.075354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.075358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.075360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.075362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.075363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.075401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.075406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.075412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.075417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.075427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.075441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640044:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.075446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640240:6967], now have 1 active actors on pipe
2025-10-02T09:33:14.075450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.075451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.075452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.075459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.075468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.075475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.075477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.075478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.075479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.075479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.075481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1861
2025-10-02T09:33:14.075492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.075484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1861
2025-10-02T09:33:14.075497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.075498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.075512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.075517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.075534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.075541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.075543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.075544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.075550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.075557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.075568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.075660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.075665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.075672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.075733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1862 partition: 0 MaxSeqNo: 36 sessionId: src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0
2025-10-02T09:33:14.075954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf369b68-104e33ad-767afde-6d002d01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.078236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Write session: try to update token
2025-10-02T09:33:14.078248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.084598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.084608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.084609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.084610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.084614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.084617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.084619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911083415:4960]
2025-10-02T09:33:14.084637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.084640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.084642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.084650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.084655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.084658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.084762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.089876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId: src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.091937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.154517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986640247:7474]
2025-10-02T09:33:14.154669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1861, pipe: [1:7556555127986640247:7474]
2025-10-02T09:33:14.192843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.193138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.193149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.193163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640247:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.193296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.193304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986640247:7474]
2025-10-02T09:33:14.193321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.193332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:14.193344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:14.193388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1862 reason: error at write: Disconnected sessionId: src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0
2025-10-02T09:33:14.193523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1862 sessionId: src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0 is DEAD
2025-10-02T09:33:14.193646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:14.193652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Write session will restart in 0.007430s
2025-10-02T09:33:14.193670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Write session: Do CDS request
2025-10-02T09:33:14.193674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.202125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.202198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.202207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1863
2025-10-02T09:33:14.202282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.202302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.202310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.202312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.202602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1863 sessionId:  describe result for acl check
2025-10-02T09:33:14.202630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.202635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.202636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.202639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986640404:6957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.203006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986640404:6957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.203340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.204564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986640404:6957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.204921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.205013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.205020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.205026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.205052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.205075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911083615:4961]
2025-10-02T09:33:14.205410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.205565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.205587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.205789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.205837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.205843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.205844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.205845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.205846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.205847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.205848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.205849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.205850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.205851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.205852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.205852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.205857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.205865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.205869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.205872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.205875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.205879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.205882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.205885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.205889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.205892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.205897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.205901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.205906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.205911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.205920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.205925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.205932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.205937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.205945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.205950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.205957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.205961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.205967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.205972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.205978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.205982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.205989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.205994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.206000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.206005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.206011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.206015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.206022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.206030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.206034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.206040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.206039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986640404:6957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.206049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986640404:6957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.206051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986640404:6957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.206055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.206071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.213584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.215176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.215193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.215195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.215198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.215203Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1862 [2:7556555127911083615:4961]
2025-10-02T09:33:14.215213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.215231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.215237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.215239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.215241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.215253Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.215261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.215267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.215309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.215316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.215318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.215320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.215322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.215371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.215378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.215387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.215397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.215415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.215434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640444:6957], now have 1 active actors on pipe
2025-10-02T09:33:14.215440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640249:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.215445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.215451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.215452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.215465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.215460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1862
2025-10-02T09:33:14.215479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.215483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.215486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.215487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.215494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.215489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1862
2025-10-02T09:33:14.215496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.215522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.215532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.215537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.215543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.215549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.215582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.215591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.215595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.215596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.215603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.215614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.215630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.215737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.215744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.215754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.215821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1863 partition: 0 MaxSeqNo: 36 sessionId: src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0
2025-10-02T09:33:14.216037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdfec8b-491b8c89-766aa084-b745ddd5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.218282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Write session: try to update token
2025-10-02T09:33:14.218293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.224924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.224939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.224941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.224943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.224949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.224952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.224956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911083610:4961]
2025-10-02T09:33:14.224986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.224990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.224992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.224992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.224997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.225001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.225113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.229975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId: src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.232048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.293280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986640477:7474]
2025-10-02T09:33:14.293471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1862, pipe: [1:7556555127986640477:7474]
2025-10-02T09:33:14.338429Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.338670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.338681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.338720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640477:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.338890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.339013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:14.339021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986640477:7474]
2025-10-02T09:33:14.339046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.339077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1863 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0
2025-10-02T09:33:14.339225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1863 sessionId: src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0 is DEAD
2025-10-02T09:33:14.339370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:14.339382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Write session will restart in 0.005648s
2025-10-02T09:33:14.339402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Write session: Do CDS request
2025-10-02T09:33:14.339409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.346146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.346275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.346285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1864
2025-10-02T09:33:14.346386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.346407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.346413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.346416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.346689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1864 sessionId:  describe result for acl check
2025-10-02T09:33:14.346718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.346723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.346724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.346727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986640573:6934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.347079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986640573:6934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.348675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986640573:6934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.349287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.350751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.350848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.350854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.350860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.350886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.350911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911083851:4941]
2025-10-02T09:33:14.350922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986640573:6934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.350930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986640573:6934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.350932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986640573:6934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.350936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.351242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.351398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.351421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.351593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.351621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.351624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.351625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.351625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.351626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.351626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.351627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.351628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.351628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.351629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.351629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.351630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.351633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.351638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.351640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.351642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.351644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.351646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.351648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.351649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.351651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.351654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.351655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.351657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.351660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.351664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.351668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.351670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.351673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.351675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.351677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.351680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.351682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.351685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.351688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.351690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.351693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.351696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.351698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.351701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.351703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.351706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.351708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.351710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.351713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.351716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.351718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.351721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.351738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.359068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.360433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.360442Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.360443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.360445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.360448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1863 [2:7556555127911083851:4941]
2025-10-02T09:33:14.360455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.360465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.360468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.360469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.360470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.360480Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.360485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.360490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.360519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.360523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.360524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.360526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.360527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.360562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.360567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.360573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.360578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.360586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.360596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640672:6934], now have 1 active actors on pipe
2025-10-02T09:33:14.360601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640478:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.360605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.360606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.360607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.360614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.360620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.360628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.360629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.360631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.360632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.360633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.360644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.360649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.360653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.360648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1863
2025-10-02T09:33:14.360660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1863
2025-10-02T09:33:14.360671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.360677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.360692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.360700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.360702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.360703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.360708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.360713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.360723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.360814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.360818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.360826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.360893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1864 partition: 0 MaxSeqNo: 36 sessionId: src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0
2025-10-02T09:33:14.361119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4f68a8-2941b6ff-508fb7d-c4783673_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.363392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Write session: try to update token
2025-10-02T09:33:14.363404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.369695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.369706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.369707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.369708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.369712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.369714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.369716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911083845:4941]
2025-10-02T09:33:14.369735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.369737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.369739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.369741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.369748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.369751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.369839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.374905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId: src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.376930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.439192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986640684:7474]
2025-10-02T09:33:14.439334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1863, pipe: [1:7556555127986640684:7474]
2025-10-02T09:33:14.478372Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.478920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.478931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.478960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640684:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.479075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986640684:7474]
2025-10-02T09:33:14.479079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.479093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.479099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:14.479109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:14.479155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1864 reason: error at write: Disconnected sessionId: src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0
2025-10-02T09:33:14.479282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1864 sessionId: src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0 is DEAD
2025-10-02T09:33:14.479444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:14.479456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Write session will restart in 0.008603s
2025-10-02T09:33:14.479481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Write session: Do CDS request
2025-10-02T09:33:14.479488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.488982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.489176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.489206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.489214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1865
2025-10-02T09:33:14.489408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.489428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.489436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.489438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.489693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1865 sessionId:  describe result for acl check
2025-10-02T09:33:14.489715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.489719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.489720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.489723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986640845:6929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.490068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986640845:6929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.490432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.490527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.490533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.490538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.490564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.490588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911084048:4935]
2025-10-02T09:33:14.490952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.491094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.491116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.491226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986640845:6929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.491287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.491316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.491319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.491320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.491321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.491321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.491322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.491322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.491323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.491323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.491324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.491324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.491325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.491328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.491334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.491336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.491338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.491340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.491342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.491344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.491346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.491347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.491349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.491351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.491353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.491356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.491360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.491363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.491366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.491368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.491371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.491373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.491376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.491378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.491385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.491387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.491390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.491392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.491396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.491400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.491402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.491405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.491407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.491409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.491412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.491420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.491426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.491428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.491430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.491450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.495175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986640845:6929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.495183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986640845:6929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.495185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986640845:6929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.495189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.498765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.500271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.500279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.500280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.500282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.500285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1864 [2:7556555127911084048:4935]
2025-10-02T09:33:14.500292Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.500300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.500303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.500305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.500306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.500314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.500318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.500322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.500350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.500355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.500356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.500358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.500359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.500394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.500399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.500406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.500411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.500421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.500434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640884:6929], now have 1 active actors on pipe
2025-10-02T09:33:14.500439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640685:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.500442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.500444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.500445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.500451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.500460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.500468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.500468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.500470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.500471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.500472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.500477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1864
2025-10-02T09:33:14.500486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.500478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1864
2025-10-02T09:33:14.500490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.500493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.500506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.500510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.500526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43343884-563e00c8-270cd842-7d656ecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.500532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.500534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.500535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.500540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.500548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.500561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.500638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.500642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.500649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.500703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1865 partition: 0 MaxSeqNo: 36 sessionId: src_id|43343884-563e00c8-270cd842-7d656ecc_0
2025-10-02T09:33:14.500914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fcf375-4e8c2dc2-49daa7c-867f7f31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43343884-563e00c8-270cd842-7d656ecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.503148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Write session: try to update token
2025-10-02T09:33:14.503159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.509538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.509550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.509551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.509552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.509558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.509560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.509562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911084043:4935]
2025-10-02T09:33:14.509582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.509586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.509588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.509589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.509592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.509594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.509692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.514623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId: src_id|43343884-563e00c8-270cd842-7d656ecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.516702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.578975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986640892:7474]
2025-10-02T09:33:14.579129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1864, pipe: [1:7556555127986640892:7474]
2025-10-02T09:33:14.619859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.620160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.620170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.620200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640892:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.620352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:14.620364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:14.620387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986640892:7474]
2025-10-02T09:33:14.620399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.620405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.620409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1865 reason: error at write: Disconnected sessionId: src_id|43343884-563e00c8-270cd842-7d656ecc_0
2025-10-02T09:33:14.620536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1865 sessionId: src_id|43343884-563e00c8-270cd842-7d656ecc_0 is DEAD
2025-10-02T09:33:14.620686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:14.620693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Write session will restart in 0.008680s
2025-10-02T09:33:14.620708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Write session: Do CDS request
2025-10-02T09:33:14.620712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.629742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.630130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.630212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.630221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1866
2025-10-02T09:33:14.630306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.630326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.630332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.630334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.630600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1866 sessionId:  describe result for acl check
2025-10-02T09:33:14.630623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.630628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.630629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.630633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986641054:6919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.631010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986641054:6919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.631283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.631373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.631379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.631385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.631410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.631435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911084247:4939]
2025-10-02T09:33:14.631763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.631949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.631972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.632143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.632174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.632178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.632178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.632179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.632179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.632180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.632180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.632181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.632181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.632182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.632182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.632183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.632186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.632192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.632194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.632196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.632198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.632201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.632202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.632205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.632207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.632209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.632211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.632213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.632216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.632220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.632223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.632226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.632228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.632231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.632233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.632236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.632238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.632240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.632243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.632245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.632247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.632250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.632252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.632254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.632258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.632260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.632264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.632267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.632269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.632273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.632278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.632281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.632298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.632553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986641054:6919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.637030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986641054:6919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.637040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986641054:6919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.637043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986641054:6919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.637048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.639635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.641039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.641047Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.641049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.641050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.641053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1865 [2:7556555127911084247:4939]
2025-10-02T09:33:14.641061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.641070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.641073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.641075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.641076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.641085Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.641087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.641091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.641119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.641124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.641125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.641128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.641129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.641164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.641169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.641175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.641180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.641188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.641202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986640893:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.641207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641093:6919], now have 1 active actors on pipe
2025-10-02T09:33:14.641211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.641212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.641213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.641220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.641230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.641234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.641236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.641237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.641239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.641240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.641246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1865
2025-10-02T09:33:14.641248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1865
2025-10-02T09:33:14.641254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.641259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.641260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.641273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.641277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.641293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.641300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.641302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.641303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.641308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.641312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.641323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.641409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.641413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.641421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.641481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1866 partition: 0 MaxSeqNo: 36 sessionId: src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0
2025-10-02T09:33:14.641668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43343884-563e00c8-270cd842-7d656ecc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.643899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Write session: try to update token
2025-10-02T09:33:14.643912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.650415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.650427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.650429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.650430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.650434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.650437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.650439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911084242:4939]
2025-10-02T09:33:14.650462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.650465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.650467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.650473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.650477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.650479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.650580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.655737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId: src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.657873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.720284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986641101:7474]
2025-10-02T09:33:14.720428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1865, pipe: [1:7556555127986641101:7474]
2025-10-02T09:33:14.762279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.762491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.762501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.762516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641101:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.762633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.762661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.762691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986641101:7474]
2025-10-02T09:33:14.762713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:14.762881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1866 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0
2025-10-02T09:33:14.763021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1866 sessionId: src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0 is DEAD
2025-10-02T09:33:14.763172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:14.763186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Write session will restart in 0.007828s
2025-10-02T09:33:14.763207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Write session: Do CDS request
2025-10-02T09:33:14.763213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.772151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.772269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.772279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1867
2025-10-02T09:33:14.772365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.772390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.772397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.772400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.772474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.772671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1867 sessionId:  describe result for acl check
2025-10-02T09:33:14.772695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.772699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.772700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.772702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986641264:6912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.773071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986641264:6912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.773991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.774110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.774118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.774125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.774159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.774188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911084447:4937]
2025-10-02T09:33:14.774473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986641264:6912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.774522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.774702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.774725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.774896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.774924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.774928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.774928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.774929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.774929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.774930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.774930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.774931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.774931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.774932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.774932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.774933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.774936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.774942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.774944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.774946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.774948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.774950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.774952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.774954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.774956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.774959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.774961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.774963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.774966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.774970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.774973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.774976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.774978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.774981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.774983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.774985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.774988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.774990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.774992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.774995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.774997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.775000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.775002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.775005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.775007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.775010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.775012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.775014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.775016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.775019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.775021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.775023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.775049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.778821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986641264:6912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.778829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986641264:6912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.778831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986641264:6912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.778834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.782404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.783850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.783859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.783860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.783862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.783865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1866 [2:7556555127911084447:4937]
2025-10-02T09:33:14.783873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.783882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.783889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.783890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.783891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.783900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.783902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.783908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.783940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.783944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.783946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.783948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.783949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.783986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.783991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.783998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.784003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.784011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.784026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641303:6912], now have 1 active actors on pipe
2025-10-02T09:33:14.784031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641102:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.784035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.784036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.784037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.784045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.784054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.784060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.784063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.784064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.784050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1866
2025-10-02T09:33:14.784064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.784066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.784051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1866
2025-10-02T09:33:14.784078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.784083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.784085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.784092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.784097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.784123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd177d40-be9d0630-62de9828-ea587dc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.784129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.784131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.784132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.784224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.784233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.784247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.784343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.784347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.784356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.784429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1867 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd177d40-be9d0630-62de9828-ea587dc1_0
2025-10-02T09:33:14.784671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98ff36fa-df11ce70-2b0b27e0-1c3ccec0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd177d40-be9d0630-62de9828-ea587dc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.787430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Write session: try to update token
2025-10-02T09:33:14.787447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.793107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.793116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.793117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.793118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.793122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.793125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.793127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911084442:4937]
2025-10-02T09:33:14.793145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.793148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.793149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.793150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.793153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.793156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.793253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.799791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId: src_id|cd177d40-be9d0630-62de9828-ea587dc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.801818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:14.862613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555127986641320:7474]
2025-10-02T09:33:14.862761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1866, pipe: [1:7556555127986641320:7474]
2025-10-02T09:33:14.902475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:14.902685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.902703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.902719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641320:7474], now have 1 active actors on pipe
2025-10-02T09:33:14.902867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:14.902906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555127986641320:7474]
2025-10-02T09:33:14.902912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:14.902937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:14.902998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd177d40-be9d0630-62de9828-ea587dc1_0
2025-10-02T09:33:14.903157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1867 sessionId: src_id|cd177d40-be9d0630-62de9828-ea587dc1_0 is DEAD
2025-10-02T09:33:14.903324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:14.903340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Write session will restart in 0.008096s
2025-10-02T09:33:14.903365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Write session: Do CDS request
2025-10-02T09:33:14.903370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:14.912158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.912249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:14.912259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1868
2025-10-02T09:33:14.912343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:14.912369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:14.912377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:14.912381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:14.912458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:14.912653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1868 sessionId:  describe result for acl check
2025-10-02T09:33:14.912677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:14.912681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:14.912682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:14.912685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555127986641487:6898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:14.913044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555127986641487:6898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:14.914117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:14.914207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:14.914213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:14.914219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:14.914243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:14.914268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555127911084659:4921]
2025-10-02T09:33:14.914330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555127986641487:6898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:14.914597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:14.914780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:14.914802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:14.915010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:14.915044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.915048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.915049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.915049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.915050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.915050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.915051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.915051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.915052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.915052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.915053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.915053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.915056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.915062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.915064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.915066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.915068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.915070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.915072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.915074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.915076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.915078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.915080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.915082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.915085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.915089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:14.915092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.915095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:14.915098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.915101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:14.915103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.915106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:14.915108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.915110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:14.915112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.915115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:14.915117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.915120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:14.915122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.915125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:14.915127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.915130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:14.915132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.915135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.915137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.915140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.915143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.915147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.915164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:14.918933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555127986641487:6898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:14.918941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555127986641487:6898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:14.918943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555127986641487:6898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:14.918947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:14.922537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:14.924184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:14.924194Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:14.924195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:14.924197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:14.924200Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1867 [2:7556555127911084659:4921]
2025-10-02T09:33:14.924207Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:14.924217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:14.924218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.924219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.924220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.924228Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:14.924231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:14.924235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:14.924264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.924269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.924270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.924272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:14.924273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:14.924308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:14.924312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.924318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:14.924323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:14.924335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:14.924347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641321:2446], now have 1 active actors on pipe
2025-10-02T09:33:14.924353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555127986641526:6898], now have 1 active actors on pipe
2025-10-02T09:33:14.924357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.924358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.924360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.924366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:14.924375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:14.924382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:14.924385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:14.924385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:14.924386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:14.924386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:14.924400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.924404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:14.924394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1867
2025-10-02T09:33:14.924400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1867
2025-10-02T09:33:14.924422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:14.924429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.924432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.924451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec001ed5-16a5619b-3928bc93-190434cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:14.924459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:14.924462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:14.924465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:14.924472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:14.924481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:14.924492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.924595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:14.924600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:14.924607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:14.924665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1868 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec001ed5-16a5619b-3928bc93-190434cf_0
2025-10-02T09:33:14.924913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd177d40-be9d0630-62de9828-ea587dc1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec001ed5-16a5619b-3928bc93-190434cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:14.927575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Write session: try to update token
2025-10-02T09:33:14.927588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:14.933386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:14.933396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:14.933397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:14.933398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:14.933402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.933405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.933406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555127911084654:4921]
2025-10-02T09:33:14.933425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:14.933427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:14.933429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:14.933430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:14.933431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:14.933433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:14.933533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:14.939492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId: src_id|ec001ed5-16a5619b-3928bc93-190434cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:14.941618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.002899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281608841:7474]
2025-10-02T09:33:15.003087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1867, pipe: [1:7556555132281608841:7474]
2025-10-02T09:33:15.044602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.044856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.044866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.044881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281608841:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.045083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.045187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.045214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281608841:7474]
2025-10-02T09:33:15.045228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:15.045294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1868 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ec001ed5-16a5619b-3928bc93-190434cf_0
2025-10-02T09:33:15.045449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1868 sessionId: src_id|ec001ed5-16a5619b-3928bc93-190434cf_0 is DEAD
2025-10-02T09:33:15.045562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:15.045569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Write session will restart in 0.006895s
2025-10-02T09:33:15.045583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Write session: Do CDS request
2025-10-02T09:33:15.045587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.053091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.053215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.053226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1869
2025-10-02T09:33:15.053344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.053372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.053381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.053388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.053686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1869 sessionId:  describe result for acl check
2025-10-02T09:33:15.053709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.053714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.053715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.053718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281608989:6893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.054062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281608989:6893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.055057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.055693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281608989:6893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.056584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.056699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.056707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.056714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.056743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.056769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206052158:4908]
2025-10-02T09:33:15.057161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.057337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.057360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.057519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281608989:6893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.057526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281608989:6893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.057528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281608989:6893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.057531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.057536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.057565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.057569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.057569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.057570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.057570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.057571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.057571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.057572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.057573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.057573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.057574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.057574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.057577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.057583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.057585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.057587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.057589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.057591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.057593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.057595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.057597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.057599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.057602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.057603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.057607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.057611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.057614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.057617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.057619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.057621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.057623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.057626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.057629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.057631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.057633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.057636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.057638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.057641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.057643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.057650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.057652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.057657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.057660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.057665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.057670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.057674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.057678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.057686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.057716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.065255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.066858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.066867Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.066868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.066870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.066874Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1868 [2:7556555132206052158:4908]
2025-10-02T09:33:15.066880Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.066891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.066892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.066894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.066895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.066905Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.066907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.066912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.066947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.066956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.066957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.066959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.066960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.066995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.067000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.067006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.067012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.067020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.067034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609044:6893], now have 1 active actors on pipe
2025-10-02T09:33:15.067040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281608843:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.067043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.067045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.067046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.067054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.067065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.067070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.067073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.067074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.067075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.067077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.067092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.067097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.067089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1868
2025-10-02T09:33:15.067105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.067093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1868
2025-10-02T09:33:15.067118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.067123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.067137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.067144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.067146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.067147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.067152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.067161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.067168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.067269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.067274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.067281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.067340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1869 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0
2025-10-02T09:33:15.067568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec001ed5-16a5619b-3928bc93-190434cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.070190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Write session: try to update token
2025-10-02T09:33:15.070201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.076103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:15.076117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.076123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.076147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:15.076152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:15.076278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:15.076398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.076517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.076636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.076830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:15.076858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:15.082494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId: src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.084342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.084353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.084354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.084356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.084360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.084362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.084368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206052153:4908]
2025-10-02T09:33:15.084387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.084390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.084391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.084393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.084397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.084400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.084505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.084630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.145249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281609053:7474]
2025-10-02T09:33:15.145415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1868, pipe: [1:7556555132281609053:7474]
2025-10-02T09:33:15.197663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.197917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.197928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.197941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609053:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.198058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.198063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:15.198066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:15.198092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281609053:7474]
2025-10-02T09:33:15.198116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1869 reason: error at write: Disconnected sessionId: src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0
2025-10-02T09:33:15.198259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1869 sessionId: src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0 is DEAD
2025-10-02T09:33:15.198335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.198392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:15.198398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Write session will restart in 0.005726s
2025-10-02T09:33:15.198418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Write session: Do CDS request
2025-10-02T09:33:15.198423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.205141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.205259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.205270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1870
2025-10-02T09:33:15.205396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.205423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.205430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.205433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.205728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1870 sessionId:  describe result for acl check
2025-10-02T09:33:15.205753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.205757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.205758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.205761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281609192:6889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.206115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281609192:6889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.207178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.207709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281609192:6889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.208610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.208706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.208712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.208718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.208744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.208768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206052365:4917]
2025-10-02T09:33:15.209118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.209284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.209307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.209483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.209514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.209518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.209518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.209519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.209520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.209520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.209521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.209521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.209522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.209522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.209523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.209523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.209526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.209532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.209534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.209536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.209538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.209540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.209542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.209544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.209546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.209549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.209551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.209552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.209556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.209560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.209563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.209566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.209568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.209571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.209573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.209576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.209569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281609192:6889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.209579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.209577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281609192:6889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.209581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.209579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281609192:6889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.209583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.209586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.209588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.209583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.209591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.209594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.209596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.209599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.209602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.209604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.209606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.209610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.209614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.209616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.209618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.209634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.217020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.218551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.218561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.218563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.218566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.218569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1869 [2:7556555132206052365:4917]
2025-10-02T09:33:15.218577Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.218587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.218593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.218594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.218596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.218605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.218608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.218613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.218646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.218651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.218653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.218655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.218656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.218706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.218711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.218719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.218724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.218733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.218746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609261:6889], now have 1 active actors on pipe
2025-10-02T09:33:15.218750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609060:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.218753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.218755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.218756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.218765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.218774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.218785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.218787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.218791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.218796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.218797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.218803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.218805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.218807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.218798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1869
2025-10-02T09:33:15.218798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1869
2025-10-02T09:33:15.218825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.218830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.218846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.218853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.218856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.218857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.218862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.218868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.218876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.218969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.218974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.218981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.219038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1870 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0
2025-10-02T09:33:15.219308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a765fef-9f461946-ae6b0eaf-762a5776_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.222070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Write session: try to update token
2025-10-02T09:33:15.222088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.227957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:15.227967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.227971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.227995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:15.227998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:15.228138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:15.228263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.228386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.228501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.228671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:15.228697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:15.234893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId: src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.236616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.236627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.236628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.236629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.236634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.236637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.236640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206052360:4917]
2025-10-02T09:33:15.236660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.236662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.236663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.236664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.236666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.236670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.236778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.237145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.298349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281609295:7474]
2025-10-02T09:33:15.298788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1869, pipe: [1:7556555132281609295:7474]
2025-10-02T09:33:15.348180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.348508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.348516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.348529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609295:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.348655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.348665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281609295:7474]
2025-10-02T09:33:15.348685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.348698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:15.348701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:15.348752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1870 reason: error at write: Disconnected sessionId: src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0
2025-10-02T09:33:15.348898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1870 sessionId: src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0 is DEAD
2025-10-02T09:33:15.349066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:15.349081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Write session will restart in 0.009789s
2025-10-02T09:33:15.349102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Write session: Do CDS request
2025-10-02T09:33:15.349108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.357611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.359016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.359116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.359123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.359129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.359154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.359177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206052606:4876]
2025-10-02T09:33:15.359522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.359691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.359714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.359892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.359923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.359927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.359928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.359928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.359929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.359930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.359930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.359931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.359931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.359932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.359932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.359933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.359936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.359942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.359944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.359946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.359948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.359950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.359952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.359954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.359956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.359958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.359960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.359962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.359966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.359970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.359973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.359976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.359979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.359981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.359983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.359986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.359988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.359991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.359993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.359996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.359998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.360001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.360003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.360006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.360009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.360012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.360014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.360017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.360019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.360022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.360024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.360026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.360042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.360129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.360265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.360276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1871
2025-10-02T09:33:15.360701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.360722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.360728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.360731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.360973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1871 sessionId:  describe result for acl check
2025-10-02T09:33:15.360992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.360995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.360996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.360999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281609468:6875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.361336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281609468:6875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.362756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281609468:6875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.366870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281609468:6875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.366881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281609468:6875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.366882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281609468:6875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.366886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.367452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.369056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.369066Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.369068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.369070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.369073Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1870 [2:7556555132206052606:4876]
2025-10-02T09:33:15.369080Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.369091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.369094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.369096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.369097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.369106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.369109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.369113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.369144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.369149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.369150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.369152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.369153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.369194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.369199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.369204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.369210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.369217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.369233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609502:6875], now have 1 active actors on pipe
2025-10-02T09:33:15.369239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609296:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.369243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.369244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.369245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.369252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.369263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.369265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.369267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.369269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.369274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.369275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.369266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1870
2025-10-02T09:33:15.369275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1870
2025-10-02T09:33:15.369290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.369295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.369297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.369305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.369310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.369337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58fbbbad-13d394be-930cb193-c3984808_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.369344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.369347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.369348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.369354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.369362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.369372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.369459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.369463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.369472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.369535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1871 partition: 0 MaxSeqNo: 36 sessionId: src_id|58fbbbad-13d394be-930cb193-c3984808_0
2025-10-02T09:33:15.369789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0b3d223-74fb5c6b-be98412a-f40cece9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58fbbbad-13d394be-930cb193-c3984808_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.372525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Write session: try to update token
2025-10-02T09:33:15.372540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.378375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.378387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.378388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.378389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.378393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.378395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.378397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206052601:4876]
2025-10-02T09:33:15.378416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.378419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.378422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.378425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.378426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.378428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.378545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.384919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId: src_id|58fbbbad-13d394be-930cb193-c3984808_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.387149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.448873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281609509:7474]
2025-10-02T09:33:15.449060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1870, pipe: [1:7556555132281609509:7474]
2025-10-02T09:33:15.489000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.489317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.489326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.489339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609509:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.489465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.489509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281609509:7474]
2025-10-02T09:33:15.489513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:15.489534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.489566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1871 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58fbbbad-13d394be-930cb193-c3984808_0
2025-10-02T09:33:15.489703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1871 sessionId: src_id|58fbbbad-13d394be-930cb193-c3984808_0 is DEAD
2025-10-02T09:33:15.489863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:15.489877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Write session will restart in 0.006714s
2025-10-02T09:33:15.489903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Write session: Do CDS request
2025-10-02T09:33:15.489909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.497133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.497256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.497266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1872
2025-10-02T09:33:15.497378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.497408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.497416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.497419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.497692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1872 sessionId:  describe result for acl check
2025-10-02T09:33:15.497714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.497719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.497720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.497723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281609664:6866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.498078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281609664:6866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.498851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.499492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281609664:6866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.500291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.500382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.500388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.500394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.500419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.500439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206052811:4874]
2025-10-02T09:33:15.500774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.500953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.500976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.501151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.501180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.501183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.501184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.501184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.501185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.501186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.501186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.501187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.501187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.501188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.501188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.501189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.501191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.501197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.501199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.501201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.501203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.501205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.501207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.501209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.501211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.501213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.501215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.501217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.501220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.501224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.501227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.501230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.501232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.501235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.501237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.501239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.501241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.501244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.501246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.501249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.501251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.501253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.501256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.501258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.501261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.501263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.501265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.501268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.501270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.501273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.501275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.501278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.501293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.501424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281609664:6866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.501431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281609664:6866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.501433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281609664:6866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.501436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.508638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.510266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.510276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.510278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.510280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.510283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1871 [2:7556555132206052811:4874]
2025-10-02T09:33:15.510291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.510301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.510306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.510307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.510308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.510317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.510320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.510325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.510357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.510362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.510363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.510364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.510366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.510403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.510408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.510414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.510419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.510427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.510441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609715:6866], now have 1 active actors on pipe
2025-10-02T09:33:15.510446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609510:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.510450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.510452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.510453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.510461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.510472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.510473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.510475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.510476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.510482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.510483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.510478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1871
2025-10-02T09:33:15.510497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.510482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1871
2025-10-02T09:33:15.510501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.510503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.510513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.510518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.510541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.510549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.510551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.510552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.510557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.510565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.510575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.510659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.510664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.510671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.510729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1872 partition: 0 MaxSeqNo: 36 sessionId: src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0
2025-10-02T09:33:15.510946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fbbbad-13d394be-930cb193-c3984808_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.513687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Write session: try to update token
2025-10-02T09:33:15.513706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.519517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.519528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.519529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.519530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.519534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.519536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.519538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206052805:4874]
2025-10-02T09:33:15.519557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.519558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.519560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.519560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.519561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.519564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.519669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.526289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId: src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.528605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.589679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281609724:7474]
2025-10-02T09:33:15.589847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1871, pipe: [1:7556555132281609724:7474]
2025-10-02T09:33:15.631219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.631579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.631590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.631604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609724:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.631812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281609724:7474]
2025-10-02T09:33:15.631883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:15.631889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:15.631919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.631939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1872 reason: error at write: Disconnected sessionId: src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0
2025-10-02T09:33:15.632050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.632100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1872 sessionId: src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0 is DEAD
2025-10-02T09:33:15.632263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:15.632277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Write session will restart in 0.005853s
2025-10-02T09:33:15.632299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Write session: Do CDS request
2025-10-02T09:33:15.632305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.639191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.639276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.639287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1873
2025-10-02T09:33:15.639412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.639440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.639449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.639452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.639806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1873 sessionId:  describe result for acl check
2025-10-02T09:33:15.639829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.639834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.639835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.639838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281609862:6864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.640195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281609862:6864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.641387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.641877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281609862:6864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.642853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.642966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.642973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.642979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.643007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.643029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206053016:4869]
2025-10-02T09:33:15.643358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.643579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.643603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.643768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281609862:6864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.643775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281609862:6864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.643777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281609862:6864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.643780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.643808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.643812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.643813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.643813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.643814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.643814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.643815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.643816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.643816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.643816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.643817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.643817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.643820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.643826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.643828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.643830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.643832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.643834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.643837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.643839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.643841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.643844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.643846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.643848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.643853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.643857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.643860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.643863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.643865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.643868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.643870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.643873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.643875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.643878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.643880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.643882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.643884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.643887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.643889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.643892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.643895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.643898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.643900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.643902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.643904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.643907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.643909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.643911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.643929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.651271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.652786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.652795Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.652796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.652798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.652815Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1872 [2:7556555132206053016:4869]
2025-10-02T09:33:15.652821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.652831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.652833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.652834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.652835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.652844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.652847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.652851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.652879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.652884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.652885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.652887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.652888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.652924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.652929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.652935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.652941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.652949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.652961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609725:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.652965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609930:6864], now have 1 active actors on pipe
2025-10-02T09:33:15.652968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.652969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.652970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.652978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.652985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.652990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.652992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.652992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.652993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.652994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.653008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.653011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.653012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.653011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1872
2025-10-02T09:33:15.653042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.653048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.653060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.653060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1872
2025-10-02T09:33:15.653063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.653066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.653067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.653071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.653076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.653086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.653220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.653225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.653232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.653294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1873 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0
2025-10-02T09:33:15.653483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab844e5-ec72bb1-b33e0b63-d008ead6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.656002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Write session: try to update token
2025-10-02T09:33:15.656012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.662446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.662458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.662459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.662461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.662465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.662470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.662472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206053011:4869]
2025-10-02T09:33:15.662492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.662495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.662496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.662498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.662502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.662505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.662605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.668755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId: src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.671381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.732004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281609940:7474]
2025-10-02T09:33:15.732188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1872, pipe: [1:7556555132281609940:7474]
2025-10-02T09:33:15.772084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.772345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.772353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.772365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609940:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.772490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.772534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.772566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281609940:7474]
2025-10-02T09:33:15.772566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:15.772636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0
2025-10-02T09:33:15.772822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1873 sessionId: src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0 is DEAD
2025-10-02T09:33:15.772965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:15.772973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Write session will restart in 0.007988s
2025-10-02T09:33:15.772994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Write session: Do CDS request
2025-10-02T09:33:15.772999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.782204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.782320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.782331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1874
2025-10-02T09:33:15.782367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.782436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.782463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.782471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.782474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.782806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1874 sessionId:  describe result for acl check
2025-10-02T09:33:15.782833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.782838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.782839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.782843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281610110:6858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.783196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281610110:6858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.784110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.784245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.784252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.784258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.784288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.784311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206053223:4865]
2025-10-02T09:33:15.784647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.784766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281610110:6858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.784866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.784891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.785066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.785096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.785100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.785101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.785101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.785102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.785102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.785103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.785103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.785104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.785104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.785105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.785105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.785108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.785114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.785116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.785118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.785120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.785122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.785124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.785126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.785128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.785131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.785133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.785135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.785139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.785143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.785147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.785150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.785152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.785155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.785157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.785162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.785164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.785167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.785169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.785172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.785174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.785177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.785182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.785185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.785187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.785190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.785193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.785196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.785198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.785201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.785203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.785206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.785223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.789010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281610110:6858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.789018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281610110:6858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.789020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281610110:6858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.789024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.792615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.794230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.794240Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.794242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.794244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.794247Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1873 [2:7556555132206053223:4865]
2025-10-02T09:33:15.794254Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.794265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.794267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.794268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.794269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.794279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.794282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.794286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.794316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.794321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.794323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.794325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.794326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.794363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.794368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.794375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.794380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.794388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.794403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281610149:6858], now have 1 active actors on pipe
2025-10-02T09:33:15.794405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281609941:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.794409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.794410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.794412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.794420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.794428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.794431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.794433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.794434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.794437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.794439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.794453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.794456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.794458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.794486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1873
2025-10-02T09:33:15.794486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1873
2025-10-02T09:33:15.794536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.794542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.794558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.794563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.794565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.794566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.794571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.794577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.794585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.794703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.794708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.794716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.794779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1874 partition: 0 MaxSeqNo: 36 sessionId: src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0
2025-10-02T09:33:15.795013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a3bf5fd-e6888297-5b5f2170-64213f52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.797830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Write session: try to update token
2025-10-02T09:33:15.797849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.803483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:15.803494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.803498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.803519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:15.803519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:15.803653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:15.803776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.803889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.804009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:15.804179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:15.804201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:15.810559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId: src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.811831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.811841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.811842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.811843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.811848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.811850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.811852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206053218:4865]
2025-10-02T09:33:15.811870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.811870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.811874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.811875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.811876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.811877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.811992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.812796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:15.872793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555132281610164:7474]
2025-10-02T09:33:15.872946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1873, pipe: [1:7556555132281610164:7474]
2025-10-02T09:33:15.922264Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:15.922639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.922648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.922662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281610164:7474], now have 1 active actors on pipe
2025-10-02T09:33:15.922812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555132281610164:7474]
2025-10-02T09:33:15.922823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:15.922830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:15.922832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:15.922837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:15.922875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1874 reason: error at write: Disconnected sessionId: src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0
2025-10-02T09:33:15.923011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1874 sessionId: src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0 is DEAD
2025-10-02T09:33:15.923151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:15.923158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Write session will restart in 0.006617s
2025-10-02T09:33:15.923177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Write session: Do CDS request
2025-10-02T09:33:15.923182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:15.931216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.931311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:15.931321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1875
2025-10-02T09:33:15.931437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:15.931459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:15.931465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:15.931467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:15.931808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1875 sessionId:  describe result for acl check
2025-10-02T09:33:15.931840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:15.931845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:15.931847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:15.931851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555132281610337:6851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:15.931839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:15.932265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555132281610337:6851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:15.933467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:15.933561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:15.933568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:15.933574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:15.933599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:15.933625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555132206053443:4863]
2025-10-02T09:33:15.933688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555132281610337:6851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:15.933961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:15.934135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:15.934157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:15.934430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:15.934469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.934473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.934474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.934474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.934475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.934475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.934476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.934476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.934477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.934477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.934478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.934478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.934481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.934487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.934489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.934491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.934493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.934495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.934497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.934499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.934501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.934504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.934506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.934508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.934511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.934515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:15.934518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.934521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:15.934523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.934526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:15.934528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.934531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:15.934533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.934535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:15.934537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.934541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:15.934543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.934546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:15.934548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.934550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:15.934553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.934556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:15.934558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.934561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.934563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.934566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.934568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.934570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.934585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:15.938355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555132281610337:6851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:15.938363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555132281610337:6851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:15.938365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555132281610337:6851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:15.938369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:15.941967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:15.943507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:15.943517Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:15.943518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:15.943520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:15.943523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1874 [2:7556555132206053443:4863]
2025-10-02T09:33:15.943530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:15.943541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:15.943542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.943544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.943545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.943554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:15.943557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:15.943561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:15.943592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.943597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.943598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.943600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:15.943602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:15.943636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:15.943641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.943647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:15.943652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:15.943660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:15.943675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281610377:6851], now have 1 active actors on pipe
2025-10-02T09:33:15.943679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555132281610168:2446], now have 1 active actors on pipe
2025-10-02T09:33:15.943683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.943684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.943686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.943693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:15.943700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:15.943708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:15.943709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:15.943710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:15.943714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:15.943716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:15.943718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1874
2025-10-02T09:33:15.943724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.943720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1874
2025-10-02T09:33:15.943726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:15.943737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:15.943744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.943747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.943762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|811fcec6-e2d15c2a-6ede293a-88367736_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:15.943769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:15.943771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:15.943772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:15.943777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:15.943783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:15.943791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.943881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:15.943886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:15.943893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:15.943949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1875 partition: 0 MaxSeqNo: 36 sessionId: src_id|811fcec6-e2d15c2a-6ede293a-88367736_0
2025-10-02T09:33:15.944143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918e4f1f-28f098c2-5860e7ac-f88220e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|811fcec6-e2d15c2a-6ede293a-88367736_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:15.946618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Write session: try to update token
2025-10-02T09:33:15.946629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:15.952945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:15.952955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:15.952957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:15.952958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:15.952962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.952965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.952967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555132206053438:4863]
2025-10-02T09:33:15.952987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:15.952990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:15.952992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:15.952994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:15.952996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:15.952998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:15.953100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:15.958870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId: src_id|811fcec6-e2d15c2a-6ede293a-88367736_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:15.960968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.022800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576577693:7474]
2025-10-02T09:33:16.022950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1874, pipe: [1:7556555136576577693:7474]
2025-10-02T09:33:16.063354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.063764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.063773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.063786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576577693:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.063930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.063970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576577693:7474]
2025-10-02T09:33:16.063977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.064001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:16.064060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1875 reason: status is not ok: tablet will be restarted right now sessionId: src_id|811fcec6-e2d15c2a-6ede293a-88367736_0
2025-10-02T09:33:16.064210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1875 sessionId: src_id|811fcec6-e2d15c2a-6ede293a-88367736_0 is DEAD
2025-10-02T09:33:16.064352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:16.064368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Write session will restart in 0.008763s
2025-10-02T09:33:16.064389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Write session: Do CDS request
2025-10-02T09:33:16.064394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.073299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.074164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.074272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.074282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1876
2025-10-02T09:33:16.074384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.074405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.074411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.074414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.074709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1876 sessionId:  describe result for acl check
2025-10-02T09:33:16.074734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.074738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.074739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.074742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576577865:6845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.074876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.074971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.074977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.074983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.075009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.075034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501020950:4856]
2025-10-02T09:33:16.075107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576577865:6845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.075369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.075550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.075571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.075742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.075770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.075774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.075775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.075775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.075776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.075776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.075777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.075777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.075778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.075778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.075779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.075779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.075782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.075788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.075790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.075792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.075794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.075796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.075798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.075800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.075802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.075804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.075806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.075808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.075813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.075817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.075820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.075823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.075825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.075828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.075830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.075832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.075835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.075837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.075839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.075842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.075847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.075849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.075852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.075854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.075856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.075858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.075862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.075864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.075867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.075869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.075871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.075887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.076463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576577865:6845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.081537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576577865:6845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.081547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576577865:6845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.081549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576577865:6845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.081552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.083245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.084832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.084841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.084842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.084844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.084847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1875 [2:7556555136501020950:4856]
2025-10-02T09:33:16.084855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.084864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.084866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.084867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.084868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.084877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.084880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.084884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.084913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.084918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.084919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.084921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.084922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.084956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.084961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.084967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.084973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.084980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.084992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576577904:6845], now have 1 active actors on pipe
2025-10-02T09:33:16.084998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576577694:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.085002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.085003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.085004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.085012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.085019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.085027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.085028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.085031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.085031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.085032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.085046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.085047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.085041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1875
2025-10-02T09:33:16.085055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.085076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1875
2025-10-02T09:33:16.085108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.085113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.085127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.085130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.085132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.085133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.085140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.085145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.085152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.085262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.085267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.085274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.085326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1876 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0
2025-10-02T09:33:16.085523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811fcec6-e2d15c2a-6ede293a-88367736_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.087876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Write session: try to update token
2025-10-02T09:33:16.087886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.094468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:16.094480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.094484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.094504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:16.094508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:16.094656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:16.094793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:16.094919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:16.095042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:16.095218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:16.095242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:16.099439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId: src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.101462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.101648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.101657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.101673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:16.101725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:16.102517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.102528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.102529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.102530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.102535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.102538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.102540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501020945:4856]
2025-10-02T09:33:16.102557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.102559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.102560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.102562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.102562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.102564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.102679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.164134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576577911:7474]
2025-10-02T09:33:16.164310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1875, pipe: [1:7556555136576577911:7474]
2025-10-02T09:33:16.211502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.217488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.217503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.217625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.217674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.217726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.217783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.217823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.217829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.217880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.217929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.217984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.218039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.218073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.218077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.218128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.218176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.218225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.218276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.218313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.218318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.218368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.218418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.218474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.218526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.218560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.218564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.218618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.218673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.218735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.218788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.218828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.218833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.218883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.218931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.218981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.219034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.219068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.219075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.219126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.219178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.219229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.219283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.219317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.219322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.219372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.219419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.219465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.219517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.219549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.219553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.219599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.219646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.219696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.219745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.219777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.219782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.219832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:16.219878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:16.219926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:16.219974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:16.220011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:16.220016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:16.220046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576577911:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.220244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:16.220257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:16.220273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576577911:7474]
2025-10-02T09:33:16.220284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1876 reason: error at write: Disconnected sessionId: src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0
2025-10-02T09:33:16.220296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.220463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1876 sessionId: src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0 is DEAD
2025-10-02T09:33:16.220638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:16.220655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Write session will restart in 0.008045s
2025-10-02T09:33:16.220626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.220678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Write session: Do CDS request
2025-10-02T09:33:16.220684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.229478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.230201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.230217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.230226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1877
2025-10-02T09:33:16.230417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.230443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.230449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.230452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.230726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1877 sessionId:  describe result for acl check
2025-10-02T09:33:16.230750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.230754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.230755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.230759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576578085:6832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.230914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.231008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.231014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.231020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.231044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.231065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501021160:4860]
2025-10-02T09:33:16.231128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576578085:6832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.231399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.231575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.231597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.231767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.231796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.231799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.231800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.231801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.231801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.231802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.231802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.231803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.231803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.231804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.231804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.231805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.231808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.231814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.231816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.231818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.231820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.231822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.231824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.231826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.231828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.231830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.231832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.231834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.231837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.231841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.231844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.231847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.231849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.231852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.231854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.231856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.231858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.231862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.231864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.231866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.231869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.231871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.231873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.231876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.231878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.231882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.231884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.231886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.231888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.231891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.231893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.231896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.231914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.232777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576578085:6832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.237587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576578085:6832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.237596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576578085:6832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.237598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576578085:6832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.237602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.239298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.240760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.240769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.240771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.240773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.240776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1876 [2:7556555136501021160:4860]
2025-10-02T09:33:16.240785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.240795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.240796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.240798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.240799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.240823Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.240828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.240832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.240862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.240866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.240867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.240869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.240871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.241002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1876
2025-10-02T09:33:16.241011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.241005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1876
2025-10-02T09:33:16.241016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.241022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.241028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.241040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.241053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578124:6832], now have 1 active actors on pipe
2025-10-02T09:33:16.241058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576577913:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.241066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.241071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.241082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.241086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.241088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.241095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.241104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.241107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.241109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.241110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.241112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.241114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.241123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.241127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.241132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.241134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.241138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.241143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.241160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.241167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.241173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.241175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.241257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.241262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.241270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.241315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1877 partition: 0 MaxSeqNo: 36 sessionId: src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0
2025-10-02T09:33:16.241499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e5e7bb-c471f01f-2ef41092-76bc635c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.243783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Write session: try to update token
2025-10-02T09:33:16.243794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.250261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:16.250271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.250275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.250299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:16.250300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:16.250437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:16.250554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:16.250668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:16.250957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:16.251185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:16.251211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:16.258676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.258686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.258688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.258699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.258704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.258706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.258708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501021155:4860]
2025-10-02T09:33:16.258730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.258730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.258733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.258736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.258736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.258737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.258849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.260977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId: src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.262985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.320292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576578155:7474]
2025-10-02T09:33:16.320451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1876, pipe: [1:7556555136576578155:7474]
2025-10-02T09:33:16.368437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.368794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.368811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.368824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578155:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.368960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.368969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576578155:7474]
2025-10-02T09:33:16.368989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.368994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:16.368998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:16.369049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1877 reason: error at write: Disconnected sessionId: src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0
2025-10-02T09:33:16.369198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1877 sessionId: src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0 is DEAD
2025-10-02T09:33:16.369288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:16.369297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Write session will restart in 0.006612s
2025-10-02T09:33:16.369313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Write session: Do CDS request
2025-10-02T09:33:16.369318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.377170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.377257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.377266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1878
2025-10-02T09:33:16.377343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.377362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.377368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.377371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.377661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1878 sessionId:  describe result for acl check
2025-10-02T09:33:16.377687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.377691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.377692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.377695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576578313:6815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.378031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576578313:6815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.378928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.379768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576578313:6815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.380563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.380662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.380668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.380674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.380699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.380724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501021409:4827]
2025-10-02T09:33:16.381076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.381295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.381335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.381542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.381616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576578313:6815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.381624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576578313:6815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.381626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576578313:6815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.381629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.381644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.381649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.381649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.381650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.381651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.381651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.381652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.381652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.381653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.381654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.381654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.381655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.381658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.381664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.381666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.381668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.381670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.381673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.381675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.381677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.381679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.381682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.381684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.381686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.381690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.381695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.381698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.381701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.381703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.381706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.381708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.381711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.381713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.381716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.381718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.381721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.381724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.381727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.381733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.381735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.381737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.381740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.381743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.381746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.381748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.381752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.381757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.381760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.381777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.389182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.391185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.391196Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.391197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.391199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.391202Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1877 [2:7556555136501021409:4827]
2025-10-02T09:33:16.391210Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.391220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.391221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.391223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.391224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.391233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.391236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.391240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.391271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.391276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.391278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.391279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.391281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.391315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.391320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.391327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.391332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.391340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.391354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578366:6815], now have 1 active actors on pipe
2025-10-02T09:33:16.391359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578157:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.391363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.391364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.391365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.391372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.391380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.391385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.391386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.391388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.391390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.391391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.391406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.391411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.391413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.391390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1877
2025-10-02T09:33:16.391404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1877
2025-10-02T09:33:16.391425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.391430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.391457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.391463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.391465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.391466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.391471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.391479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.391488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.391571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.391576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.391584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.391628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1878 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0
2025-10-02T09:33:16.391874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a65aa6c8-1207f302-f392e13-5e05abcf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.400411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.400422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.400423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.400424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.400427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.400430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.400432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501021404:4827]
2025-10-02T09:33:16.400450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.400452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.400453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.400453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.400456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.400458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.400560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.405105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Write session: try to update token
2025-10-02T09:33:16.405125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.419395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId: src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.421540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.469290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576578376:7474]
2025-10-02T09:33:16.469464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1877, pipe: [1:7556555136576578376:7474]
2025-10-02T09:33:16.512034Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.512260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.512270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.512282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578376:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.512496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.512496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.512509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576578376:7474]
2025-10-02T09:33:16.512530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:16.512583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1878 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0
2025-10-02T09:33:16.512719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1878 sessionId: src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0 is DEAD
2025-10-02T09:33:16.512894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:16.512910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Write session will restart in 0.007779s
2025-10-02T09:33:16.512953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Write session: Do CDS request
2025-10-02T09:33:16.512959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.522030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.522181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.522261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.522271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1879
2025-10-02T09:33:16.522356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.522376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.522383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.522385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.522655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1879 sessionId:  describe result for acl check
2025-10-02T09:33:16.522678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.522682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.522684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.522687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576578551:6811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.523077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576578551:6811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.523567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.523675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.523682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.523688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.523717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.523739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501021620:4831]
2025-10-02T09:33:16.524121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.524279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.524304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.524486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.524516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.524520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.524520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.524521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.524522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.524522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.524523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.524523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.524524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.524527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576578551:6811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.524524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.524525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.524525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.524528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.524534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.524536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.524538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.524540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.524542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.524544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.524546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.524548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.524550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.524552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.524554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.524558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.524561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.524564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.524567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.524569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.524572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.524574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.524577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.524579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.524582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.524584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.524587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.524589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.524592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.524594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.524596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.524599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.524601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.524604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.524608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.524610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.524613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.524615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.524617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.524634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.529531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576578551:6811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.529540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576578551:6811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.529542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576578551:6811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.529545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.532136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.533800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.533817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.533819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.533821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.533824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1878 [2:7556555136501021620:4831]
2025-10-02T09:33:16.533832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.533845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.533847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.533849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.533849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.533858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.533862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.533866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.533900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.533905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.533906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.533908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.533909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.533948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.533953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.533960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.533965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.533975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.533990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578591:6811], now have 1 active actors on pipe
2025-10-02T09:33:16.533996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578377:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.534000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.534001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.534002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.534011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.534020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.534022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.534024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.534015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1878
2025-10-02T09:33:16.534025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.534030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.534032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.534047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.534052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.534053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.534041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1878
2025-10-02T09:33:16.534062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.534069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.534103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e882661-374d433a-dc541d3f-1fa41d37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.534115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.534121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.534122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.534127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.534134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.534149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.534255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.534260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.534268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.534346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1879 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e882661-374d433a-dc541d3f-1fa41d37_0
2025-10-02T09:33:16.534646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f97d15-b700465d-53afdc43-f11aee4a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e882661-374d433a-dc541d3f-1fa41d37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.537304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Write session: try to update token
2025-10-02T09:33:16.537320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.543493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.543505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.543507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.543508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.543513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.543516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.543518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501021615:4831]
2025-10-02T09:33:16.543541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.543540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.543543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.543544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.543546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.543546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.543691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.550968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId: src_id|6e882661-374d433a-dc541d3f-1fa41d37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.553159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.612651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576578601:7474]
2025-10-02T09:33:16.612847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1878, pipe: [1:7556555136576578601:7474]
2025-10-02T09:33:16.655378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.655601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.655610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.655622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578601:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.655783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.655825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576578601:7474]
2025-10-02T09:33:16.655832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:16.655834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:16.655851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.655884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1879 reason: error at write: Disconnected sessionId: src_id|6e882661-374d433a-dc541d3f-1fa41d37_0
2025-10-02T09:33:16.656016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1879 sessionId: src_id|6e882661-374d433a-dc541d3f-1fa41d37_0 is DEAD
2025-10-02T09:33:16.656172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:16.656185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Write session will restart in 0.006998s
2025-10-02T09:33:16.656209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Write session: Do CDS request
2025-10-02T09:33:16.656215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.664174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.664297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.664310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1880
2025-10-02T09:33:16.664413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.664434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.664440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.664443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.664720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1880 sessionId:  describe result for acl check
2025-10-02T09:33:16.664744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.664748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.664749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.664752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576578775:6796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.665106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576578775:6796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.665280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.666848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.666924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576578775:6796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.666944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.666950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.666956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.666980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.667004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501021832:4828]
2025-10-02T09:33:16.667343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.667512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.667535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.667706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.667736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.667740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.667740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.667741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.667742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.667742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.667743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.667743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.667744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.667744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.667745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.667745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.667748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.667754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.667756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.667758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.667760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.667762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.667764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.667766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.667768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.667770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.667772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.667774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.667778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.667782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.667785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.667788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.667791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.667794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.667796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.667799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.667801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.667804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.667806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.667808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.667811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.667814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.667816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.667819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.667821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.667826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.667828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.667830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.667833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.667836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.667838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.667842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.667859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.671674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576578775:6796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.671683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576578775:6796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.671684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576578775:6796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.671688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.675283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.676643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.676652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.676654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.676656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.676660Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1879 [2:7556555136501021832:4828]
2025-10-02T09:33:16.676667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.676677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.676682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.676684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.676685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.676694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.676698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.676701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.676736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.676740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.676741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.676743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.676744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.676783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.676787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.676792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.676798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.676820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.676831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578815:6796], now have 1 active actors on pipe
2025-10-02T09:33:16.676833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578602:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.676836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.676837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.676837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.676845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.676851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.676858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.676858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.676860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.676860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.676861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.676873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.676875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.676863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1879
2025-10-02T09:33:16.676872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1879
2025-10-02T09:33:16.676884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.676889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.676891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.676910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.676917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.676919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.676921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.676926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.676933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.676942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.677022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.677026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.677033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.677083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1880 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0
2025-10-02T09:33:16.677329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e882661-374d433a-dc541d3f-1fa41d37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.679916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Write session: try to update token
2025-10-02T09:33:16.679932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.685875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.685885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.685886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.685887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.685891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.685893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.685895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501021827:4828]
2025-10-02T09:33:16.685913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.685916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.685917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.685921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.685924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.685926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.686054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.693233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId: src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.695257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.756005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576578824:7474]
2025-10-02T09:33:16.756178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1879, pipe: [1:7556555136576578824:7474]
2025-10-02T09:33:16.797286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.797748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.797758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.797771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578824:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.797911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.797941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576578824:7474]
2025-10-02T09:33:16.797961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.797967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:16.798019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0
2025-10-02T09:33:16.798158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1880 sessionId: src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0 is DEAD
2025-10-02T09:33:16.798319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:16.798334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Write session will restart in 0.008853s
2025-10-02T09:33:16.798359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Write session: Do CDS request
2025-10-02T09:33:16.798365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.807546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.808194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.808283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.808291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1881
2025-10-02T09:33:16.808428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.808448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.808454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.808456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.808726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1881 sessionId:  describe result for acl check
2025-10-02T09:33:16.808749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.808754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.808755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.808758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576579001:6791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.809083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.809118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576579001:6791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.809184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.809191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.809196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.809223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.809246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501022046:4819]
2025-10-02T09:33:16.809589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.809749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.809772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.809947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.809978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.809982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.809982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.809983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.809984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.809984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.809985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.809985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.809986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.809986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.809987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.809987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.809990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.809996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.809998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.810000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.810002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.810004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.810006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.810008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.810010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.810012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.810014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.810016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.810019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.810023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.810027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.810030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.810032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.810035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.810038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.810041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.810043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.810046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.810048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.810051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.810061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.810063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.810066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.810068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.810071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.810073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.810075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.810078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.810080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.810083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.810085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.810088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.810107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.810565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576579001:6791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.814931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576579001:6791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.814940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576579001:6791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.814942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576579001:6791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.814946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.817659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.819193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.819210Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.819211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.819214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.819217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1880 [2:7556555136501022046:4819]
2025-10-02T09:33:16.819227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.819240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.819242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.819243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.819244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.819254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.819257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.819261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.819291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.819296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.819297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.819299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.819301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.819428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.819433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.819421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1880
2025-10-02T09:33:16.819440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.819424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1880
2025-10-02T09:33:16.819445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.819453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.819465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576579040:6791], now have 1 active actors on pipe
2025-10-02T09:33:16.819470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576578825:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.819479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.819484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.819497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.819501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.819502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.819510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.819518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.819523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.819525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.819527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.819529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.819531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.819538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.819545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.819547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.819548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.819553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.819561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.819577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.819585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.819590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.819594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.819682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.819687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.819695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.819739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1881 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0
2025-10-02T09:33:16.819998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2051b7b-43d5e31d-28be5a5f-211b5279_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.822571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Write session: try to update token
2025-10-02T09:33:16.822592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.828675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.828685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.828686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.828687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.828691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.828693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.828696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501022041:4819]
2025-10-02T09:33:16.828714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.828717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.828718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.828720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.828723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.828725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.828910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.835435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId: src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.837488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:16.898344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555136576579053:7474]
2025-10-02T09:33:16.898522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1880, pipe: [1:7556555136576579053:7474]
2025-10-02T09:33:16.938670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:16.939034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.939044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.939056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576579053:7474], now have 1 active actors on pipe
2025-10-02T09:33:16.939203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:16.939230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:16.939240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555136576579053:7474]
2025-10-02T09:33:16.939242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:16.939258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:16.939294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1881 reason: error at write: Disconnected sessionId: src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0
2025-10-02T09:33:16.939434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1881 sessionId: src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0 is DEAD
2025-10-02T09:33:16.939607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:16.939622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Write session will restart in 0.007701s
2025-10-02T09:33:16.939645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Write session: Do CDS request
2025-10-02T09:33:16.939650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:16.948183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.948344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:16.948354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1882
2025-10-02T09:33:16.948467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:16.948487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:16.948493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:16.948496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:16.948770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1882 sessionId:  describe result for acl check
2025-10-02T09:33:16.948796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:16.948811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:16.948816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:16.948818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555136576579233:6774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:16.949169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:16.949215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555136576579233:6774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:16.950529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555136576579233:6774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:16.950670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:16.950773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:16.950780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:16.950785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:16.950811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:16.950835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555136501022273:4814]
2025-10-02T09:33:16.951177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:16.951353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:16.951375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:16.951548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:16.951578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.951582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.951582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.951583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.951583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.951584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.951584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.951585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.951586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.951586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.951587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.951587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.951590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.951596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.951598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.951600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.951602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.951604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.951606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.951608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.951610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.951612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.951614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.951616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.951619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.951623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:16.951626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.951629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:16.951631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.951634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:16.951637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.951640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:16.951642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.951645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:16.951647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.951650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:16.951652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.951655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:16.951657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.951660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:16.951662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.951664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:16.951666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.951670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.951672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.951674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.951677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.951679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.951699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:16.955526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555136576579233:6774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:16.955535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555136576579233:6774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:16.955537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555136576579233:6774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:16.955540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:16.959199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:16.960752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:16.960762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:16.960763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:16.960765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:16.960769Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1881 [2:7556555136501022273:4814]
2025-10-02T09:33:16.960777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:16.960787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:16.960792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.960794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.960795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.960820Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:16.960823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:16.960826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:16.960858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.960862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.960864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.960866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:16.960867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:16.960902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:16.960907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.960913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:16.960918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:16.960926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:16.960937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576579274:6774], now have 1 active actors on pipe
2025-10-02T09:33:16.960941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555136576579057:2446], now have 1 active actors on pipe
2025-10-02T09:33:16.960945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.960950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.960951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.960959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:16.960966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:16.960973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:16.960974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:16.960976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:16.960977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:16.960978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:16.960992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.960980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1881
2025-10-02T09:33:16.960997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:16.960999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:16.961007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.961009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.960983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1881
2025-10-02T09:33:16.961032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1361cf6-611f4069-876228ee-d37b826d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:16.961040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:16.961042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:16.961046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:16.961051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:16.961057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:16.961068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.961147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:16.961151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:16.961159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:16.961217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1882 partition: 0 MaxSeqNo: 36 sessionId: src_id|1361cf6-611f4069-876228ee-d37b826d_0
2025-10-02T09:33:16.961509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9db62e1-65acbfbc-e7a00d26-16bef5e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1361cf6-611f4069-876228ee-d37b826d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:16.964120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Write session: try to update token
2025-10-02T09:33:16.964134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:16.970128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:16.970138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:16.970139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:16.970140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:16.970144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.970146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.970148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555136501022268:4814]
2025-10-02T09:33:16.970167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:16.970170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:16.970171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:16.970172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:16.970175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:16.970177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:16.970275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:16.977217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId: src_id|1361cf6-611f4069-876228ee-d37b826d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:16.979188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.039127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871546590:7474]
2025-10-02T09:33:17.039338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1881, pipe: [1:7556555140871546590:7474]
2025-10-02T09:33:17.080879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.081210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.081219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.081231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871546590:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.081371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.081399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:17.081408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:17.081425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.081459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871546590:7474]
2025-10-02T09:33:17.081462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1882 reason: error at write: Disconnected sessionId: src_id|1361cf6-611f4069-876228ee-d37b826d_0
2025-10-02T09:33:17.081616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1882 sessionId: src_id|1361cf6-611f4069-876228ee-d37b826d_0 is DEAD
2025-10-02T09:33:17.081763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:17.081775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Write session will restart in 0.005132s
2025-10-02T09:33:17.081796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Write session: Do CDS request
2025-10-02T09:33:17.081802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.088199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.088292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.088303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1883
2025-10-02T09:33:17.088428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.088457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.088465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.088468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.088840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1883 sessionId:  describe result for acl check
2025-10-02T09:33:17.088869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.088875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.088877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.088881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871546692:6772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.089348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871546692:6772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.091074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871546692:6772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.091509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.093137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.093257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.093264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.093270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.093298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.093322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795989789:4810]
2025-10-02T09:33:17.093340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871546692:6772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.093349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871546692:6772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.093351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871546692:6772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.093354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.093668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.093843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.093866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.094044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.094074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.094078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.094078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.094079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.094079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.094080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.094080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.094081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.094081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.094082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.094082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.094083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.094086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.094092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.094094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.094096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.094098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.094100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.094102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.094105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.094107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.094109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.094111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.094113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.094117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.094121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.094125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.094128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.094130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.094133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.094135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.094138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.094140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.094143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.094146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.094149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.094151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.094153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.094156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.094159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.094161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.094164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.094166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.094169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.094171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.094173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.094176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.094179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.094196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.101788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.103480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.103491Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.103492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.103494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.103497Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1882 [2:7556555140795989789:4810]
2025-10-02T09:33:17.103505Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.103514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.103519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.103521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.103522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.103531Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.103533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.103539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.103570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.103574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.103576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.103578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.103579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.103616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.103620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.103627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.103632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.103640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.103652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871546591:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.103657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871546804:6772], now have 1 active actors on pipe
2025-10-02T09:33:17.103661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.103662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.103664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.103672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.103683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.103686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.103688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.103689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.103693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.103695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.103709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.103714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.103715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.103696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1882
2025-10-02T09:33:17.103698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1882
2025-10-02T09:33:17.103725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.103730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.103758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.103765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.103767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.103769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.103774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.103781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.103794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.103887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.103892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.103899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.103958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1883 partition: 0 MaxSeqNo: 36 sessionId: src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0
2025-10-02T09:33:17.104211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1361cf6-611f4069-876228ee-d37b826d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.106835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Write session: try to update token
2025-10-02T09:33:17.106852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.113064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.113074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.113076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.113077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.113080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.113083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.113084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795989783:4810]
2025-10-02T09:33:17.113103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.113106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.113111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.113116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.113120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.113123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.113218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.119438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId: src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.121483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.181473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871546815:7474]
2025-10-02T09:33:17.181646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1882, pipe: [1:7556555140871546815:7474]
2025-10-02T09:33:17.223303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.223661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.223669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.223682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871546815:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.223823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.223857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871546815:7474]
2025-10-02T09:33:17.223864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.223886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:17.223950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1883 reason: status is not ok: tablet will be restarted right now sessionId: src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0
2025-10-02T09:33:17.224106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1883 sessionId: src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0 is DEAD
2025-10-02T09:33:17.224281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:17.224297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Write session will restart in 0.006932s
2025-10-02T09:33:17.224324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Write session: Do CDS request
2025-10-02T09:33:17.224330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.232180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.232322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.232333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1884
2025-10-02T09:33:17.232469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.232497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.232506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.232509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.232776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1884 sessionId:  describe result for acl check
2025-10-02T09:33:17.232810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.232815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.232816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.232819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871546985:6763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.233173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871546985:6763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.233819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.234727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871546985:6763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.235551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.235644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.235650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.235656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.235680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.235702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795990005:4799]
2025-10-02T09:33:17.236034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.236191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.236215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.236433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.236466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.236470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.236470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.236471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.236471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.236472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.236472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.236473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.236473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.236474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.236474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.236475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.236477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.236483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.236485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.236487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.236489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.236491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.236493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.236495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.236497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.236499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.236501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.236503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.236506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.236510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.236514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.236517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.236519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.236521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.236523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.236526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.236529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.236531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.236533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.236536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.236538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.236540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.236542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.236545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.236547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.236549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.236551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.236554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.236556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.236559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.236561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.236564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.236561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871546985:6763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.236568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871546985:6763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.236570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871546985:6763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.236573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.236579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.243954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.245462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.245472Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.245473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.245475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.245479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1883 [2:7556555140795990005:4799]
2025-10-02T09:33:17.245486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.245496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.245497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.245499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.245500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.245509Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.245515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.245521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.245549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.245553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.245554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.245556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.245558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.245659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1883
2025-10-02T09:33:17.245659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1883
2025-10-02T09:33:17.245682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.245687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.245693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.245698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.245708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.245723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871546817:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.245728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547033:6763], now have 1 active actors on pipe
2025-10-02T09:33:17.245739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.245743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.245755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.245759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.245761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.245769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.245781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.245781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.245783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.245784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.245791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.245793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.245801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56080f47-5ce38145-18a09fe0-7228f91a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.245808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.245810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.245811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.245816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.245823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.245839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.245846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.245852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.245852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.245942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.245947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.245955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.246004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1884 partition: 0 MaxSeqNo: 36 sessionId: src_id|56080f47-5ce38145-18a09fe0-7228f91a_0
2025-10-02T09:33:17.246240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654b5ca4-82386cc-a6e33e7f-fd0ac063_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56080f47-5ce38145-18a09fe0-7228f91a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.248934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Write session: try to update token
2025-10-02T09:33:17.248953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.259072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:17.259081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.259086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.259105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:17.259111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:17.259246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:17.259371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:17.259491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:17.259610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:17.259761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:17.259783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:17.261990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId: src_id|56080f47-5ce38145-18a09fe0-7228f91a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.263143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.263152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.263154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.263155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.263158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.263161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.263163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795990000:4799]
2025-10-02T09:33:17.263181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.263182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.263185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.263187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.263187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.263188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.263296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.264274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.323786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871547066:7474]
2025-10-02T09:33:17.323895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1883, pipe: [1:7556555140871547066:7474]
2025-10-02T09:33:17.372936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.373318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.373326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.373339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547066:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.373480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.373515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:17.373530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:17.373545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871547066:7474]
2025-10-02T09:33:17.373565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.373582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1884 reason: error at write: Disconnected sessionId: src_id|56080f47-5ce38145-18a09fe0-7228f91a_0
2025-10-02T09:33:17.373745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1884 sessionId: src_id|56080f47-5ce38145-18a09fe0-7228f91a_0 is DEAD
2025-10-02T09:33:17.373907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:17.373923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Write session will restart in 0.008840s
2025-10-02T09:33:17.373945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Write session: Do CDS request
2025-10-02T09:33:17.373951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.383434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.384161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.384256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.384266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1885
2025-10-02T09:33:17.384383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.384403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.384409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.384411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.384694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1885 sessionId:  describe result for acl check
2025-10-02T09:33:17.384720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.384725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.384726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.384729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871547248:6752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.384936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.385049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.385056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.385061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.385088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.385125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871547248:6752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.385200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795990261:4787]
2025-10-02T09:33:17.385538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.385706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.385730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.385901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.385929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.385934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.385934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.385935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.385935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.385936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.385937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.385937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.385938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.385938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.385939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.385939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.385942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.385948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.385950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.385953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.385955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.385957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.385959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.385960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.385962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.385964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.385966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.385968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.385972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.385976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.385980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.385982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.385985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.385987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.385990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.385992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.385994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.385997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.385999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.386001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.386003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.386006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.386008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.386010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.386012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.386015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.386017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.386019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.386022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.386026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.386029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.386031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.386049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.386919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871547248:6752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.391741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871547248:6752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.391750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871547248:6752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.391752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871547248:6752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.391756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.393451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.395016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.395025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.395026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.395028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.395031Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1884 [2:7556555140795990261:4787]
2025-10-02T09:33:17.395040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.395049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.395051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.395052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.395053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.395061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.395066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.395070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.395100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.395105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.395107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.395108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.395109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.395147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.395152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.395159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.395164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.395174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.395185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547287:6752], now have 1 active actors on pipe
2025-10-02T09:33:17.395189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547068:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.395192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.395193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.395195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.395202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.395209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.395218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.395218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.395221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.395221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.395223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.395233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.395221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1884
2025-10-02T09:33:17.395222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1884
2025-10-02T09:33:17.395234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.395248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.395251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.395252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.395268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.395275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.395277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.395278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.395283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.395291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.395298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.395392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.395397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.395405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.395452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1885 partition: 0 MaxSeqNo: 36 sessionId: src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0
2025-10-02T09:33:17.395702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56080f47-5ce38145-18a09fe0-7228f91a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.398263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Write session: try to update token
2025-10-02T09:33:17.398278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.404410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.404421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.404423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.404423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.404427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.404429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.404431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795990256:4787]
2025-10-02T09:33:17.404450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.404452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.404452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.404453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.404455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.404457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.404570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.410795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId: src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.412889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.473829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871547294:7474]
2025-10-02T09:33:17.474020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1884, pipe: [1:7556555140871547294:7474]
2025-10-02T09:33:17.515872Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.516139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.516148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.516159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547294:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.516275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.516294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:17.516303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:17.516335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871547294:7474]
2025-10-02T09:33:17.516351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1885 reason: error at write: Disconnected sessionId: src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0
2025-10-02T09:33:17.516357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.516482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1885 sessionId: src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0 is DEAD
2025-10-02T09:33:17.516643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:17.516659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Write session will restart in 0.005896s
2025-10-02T09:33:17.516685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Write session: Do CDS request
2025-10-02T09:33:17.516689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.523152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.523278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.523287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1886
2025-10-02T09:33:17.523407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.523427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.523433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.523435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.523718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1886 sessionId:  describe result for acl check
2025-10-02T09:33:17.523742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.523747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.523748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.523750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871547383:6747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.524106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871547383:6747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.525800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871547383:6747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.526595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.528384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.528486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.528493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.528499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.528533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.528560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795990480:4779]
2025-10-02T09:33:17.528755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871547383:6747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.528766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871547383:6747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.528769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871547383:6747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.528774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.528919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.529072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.529097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.529275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.529304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.529308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.529308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.529309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.529309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.529310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.529310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.529311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.529311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.529312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.529312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.529313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.529315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.529321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.529323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.529325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.529327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.529329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.529331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.529333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.529335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.529337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.529339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.529341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.529344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.529347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.529352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.529355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.529358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.529360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.529362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.529365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.529368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.529370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.529372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.529375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.529378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.529381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.529383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.529385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.529387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.529390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.529392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.529395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.529397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.529401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.529404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.529407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.529422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.536834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.538491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.538503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.538504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.538506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.538509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1885 [2:7556555140795990480:4779]
2025-10-02T09:33:17.538516Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.538526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.538528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.538529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.538530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.538539Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.538542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.538546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.538579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.538584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.538586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.538588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.538589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.538623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.538627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.538634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.538639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.538648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.538662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547512:6747], now have 1 active actors on pipe
2025-10-02T09:33:17.538668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547295:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.538671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.538673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.538674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.538682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.538702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.538703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.538709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.538710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.538711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.538711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.538708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1885
2025-10-02T09:33:17.538720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1885
2025-10-02T09:33:17.538725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.538730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.538737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.538744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.538749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.538770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.538777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.538779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.538781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.538786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.538794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.538808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.538913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.538918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.538925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.538976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1886 partition: 0 MaxSeqNo: 36 sessionId: src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0
2025-10-02T09:33:17.539214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5d329-8ed112e2-3f3adfdc-3308e7f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.541916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Write session: try to update token
2025-10-02T09:33:17.541932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.547768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.547780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.547781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.547782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.547786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.547788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.547791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795990474:4779]
2025-10-02T09:33:17.547810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.547813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.547818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.547817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.547820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.547822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.547934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.554941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId: src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.557087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.616674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871547523:7474]
2025-10-02T09:33:17.616865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1885, pipe: [1:7556555140871547523:7474]
2025-10-02T09:33:17.657412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.657763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.657771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.657784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547523:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.657912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.657934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.657966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:17.657984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871547523:7474]
2025-10-02T09:33:17.658030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0
2025-10-02T09:33:17.658181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1886 sessionId: src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0 is DEAD
2025-10-02T09:33:17.658342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:17.658357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Write session will restart in 0.005813s
2025-10-02T09:33:17.658382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Write session: Do CDS request
2025-10-02T09:33:17.658388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.665165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.665248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.665258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1887
2025-10-02T09:33:17.665386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.665409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.665415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.665418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.665743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1887 sessionId:  describe result for acl check
2025-10-02T09:33:17.665774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.665780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.665782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.665786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871547640:6739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.666241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871547640:6739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.667786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871547640:6739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.667858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.669523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.669619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.669625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.669631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.669656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.669680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795990699:4776]
2025-10-02T09:33:17.669763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871547640:6739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.669772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871547640:6739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.669774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871547640:6739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.669778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.670023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.670174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.670197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.670369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.670399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.670403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.670404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.670404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.670405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.670405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.670406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.670406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.670407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.670407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.670408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.670408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.670411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.670417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.670419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.670421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.670423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.670425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.670427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.670429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.670431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.670434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.670436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.670437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.670441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.670445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.670447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.670450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.670453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.670455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.670457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.670460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.670462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.670465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.670466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.670469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.670472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.670474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.670476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.670479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.670481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.670484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.670486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.670489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.670491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.670494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.670496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.670499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.670516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.677916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.679481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.679492Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.679493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.679496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.679499Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1886 [2:7556555140795990699:4776]
2025-10-02T09:33:17.679506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.679515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.679517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.679518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.679519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.679528Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.679532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.679536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.679567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.679573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.679573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.679575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.679576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.679615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.679619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.679625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.679631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.679640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.679656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547524:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.679661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547741:6739], now have 1 active actors on pipe
2025-10-02T09:33:17.679665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.679667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.679668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.679676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.679687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.679693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.679696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.679697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.679697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.679699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.679716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.679724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.679714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1886
2025-10-02T09:33:17.679728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1886
2025-10-02T09:33:17.679729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.679748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.679754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.679770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.679776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.679778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.679780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.679785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.679789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.679800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.679886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.679891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.679899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.679963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1887 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0
2025-10-02T09:33:17.680257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438dd4b4-ff859e62-a317af7e-a8ebd141_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.682961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Write session: try to update token
2025-10-02T09:33:17.682974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.688581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:17.688592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.688597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.688618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:17.688623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:17.688754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:17.688887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:17.689003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:17.689115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:17.689324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:17.689348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:17.695166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId: src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.697036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.697046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.697048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.697049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.697054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.697055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.697058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795990693:4776]
2025-10-02T09:33:17.697078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.697078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.697081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.697081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.697082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.697083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.697189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.697485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.757973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871547753:7474]
2025-10-02T09:33:17.758117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1886, pipe: [1:7556555140871547753:7474]
2025-10-02T09:33:17.807253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.807534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.807543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.807555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547753:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.807714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.807714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871547753:7474]
2025-10-02T09:33:17.807730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:17.807735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:17.807742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.807796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1887 reason: error at write: Disconnected sessionId: src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0
2025-10-02T09:33:17.807965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1887 sessionId: src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0 is DEAD
2025-10-02T09:33:17.808084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:17.808096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Write session will restart in 0.009068s
2025-10-02T09:33:17.808118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Write session: Do CDS request
2025-10-02T09:33:17.808123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.817769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.818111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.818234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.818242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1888
2025-10-02T09:33:17.818370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.818391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.818397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.818400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.818667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1888 sessionId:  describe result for acl check
2025-10-02T09:33:17.818702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.818706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.818708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.818710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871547936:6733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.819051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871547936:6733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.819270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.819370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.819377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.819383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.819409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.819432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795990919:4767]
2025-10-02T09:33:17.819765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.819919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.819939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.820105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.820135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.820139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.820139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.820140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.820140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.820141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.820141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.820142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.820142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.820143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.820143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.820144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.820147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.820153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.820155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.820157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.820159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.820161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.820163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.820165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.820167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.820169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.820171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.820173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.820176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.820181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.820184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.820187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.820189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.820191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.820193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.820196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.820198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.820201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.820203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.820205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.820207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.820210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.820214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.820220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.820222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.820225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.820227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.820229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.820231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.820234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.820236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.820238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.820255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.820284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871547936:6733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.825090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871547936:6733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.825098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871547936:6733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.825100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871547936:6733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.825103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.827702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.829354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.829363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.829364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.829366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.829369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1887 [2:7556555140795990919:4767]
2025-10-02T09:33:17.829376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.829385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.829390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.829391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.829393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.829401Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.829404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.829408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.829437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.829442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.829443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.829445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.829447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.829482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.829487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.829493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.829498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.829507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.829522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547975:6733], now have 1 active actors on pipe
2025-10-02T09:33:17.829527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547754:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.829531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.829532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.829533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.829541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.829549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.829555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.829558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.829559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.829547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1887
2025-10-02T09:33:17.829560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.829561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.829574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.829570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1887
2025-10-02T09:33:17.829579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.829581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.829588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.829593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.829618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.829624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.829626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.829627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.829633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.829639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.829649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.829782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.829787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.829794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.829850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1888 partition: 0 MaxSeqNo: 36 sessionId: src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0
2025-10-02T09:33:17.830098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f972ca-a3025e0f-3b5b71bb-69d78a92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.832699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Write session: try to update token
2025-10-02T09:33:17.832713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.838502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.838512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.838513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.838514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.838517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.838519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.838521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795990914:4767]
2025-10-02T09:33:17.838539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.838540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.838542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.838543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.838544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.838544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.838929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.846818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId: src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.848988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:17.907995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555140871547989:7474]
2025-10-02T09:33:17.908149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1887, pipe: [1:7556555140871547989:7474]
2025-10-02T09:33:17.947331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:17.947526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.947535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.947546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547989:7474], now have 1 active actors on pipe
2025-10-02T09:33:17.947652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555140871547989:7474]
2025-10-02T09:33:17.947670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:17.947674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:17.947676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:17.947721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1888 reason: error at write: Disconnected sessionId: src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0
2025-10-02T09:33:17.947740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:17.947883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1888 sessionId: src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0 is DEAD
2025-10-02T09:33:17.948049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:17.948064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Write session will restart in 0.009224s
2025-10-02T09:33:17.948090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Write session: Do CDS request
2025-10-02T09:33:17.948095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:17.957692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:17.958193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.958298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:17.958307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1889
2025-10-02T09:33:17.958439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:17.958458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:17.958464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:17.958467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:17.958723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1889 sessionId:  describe result for acl check
2025-10-02T09:33:17.958745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:17.958750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:17.958750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:17.958753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555140871548192:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:17.958980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555140871548192:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:17.959224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:17.959332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:17.959338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:17.959343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:17.959374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:17.959398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555140795991154:4762]
2025-10-02T09:33:17.959729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:17.959739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555140871548192:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:17.959879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:17.959901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:17.960094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:17.960127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.960131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.960132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.960132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.960133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.960133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.960134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.960134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.960135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.960135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.960136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.960136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.960139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.960145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.960147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.960149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.960151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.960153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.960155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.960157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.960159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.960162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.960164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.960166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.960169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.960175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:17.960178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.960181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:17.960183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.960195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:17.960197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.960201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:17.960204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.960206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:17.960208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.960211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:17.960213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.960215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:17.960217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.960220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:17.960222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.960224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:17.960226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.960229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.960231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.960234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.960236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.960238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.960255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:17.964056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555140871548192:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:17.964065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555140871548192:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:17.964066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555140871548192:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:17.964070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:17.967618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:17.969098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:17.969108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:17.969109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:17.969111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:17.969114Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1888 [2:7556555140795991154:4762]
2025-10-02T09:33:17.969121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:17.969131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:17.969132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.969134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.969135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.969142Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:17.969148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:17.969152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:17.969182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.969187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.969188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.969191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:17.969192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:17.969227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:17.969232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.969238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:17.969243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:17.969254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:17.969267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871548228:6725], now have 1 active actors on pipe
2025-10-02T09:33:17.969272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555140871547993:2446], now have 1 active actors on pipe
2025-10-02T09:33:17.969276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.969278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.969279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.969286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:17.969295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:17.969297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:17.969299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:17.969301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:17.969303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:17.969304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:17.969306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1888
2025-10-02T09:33:17.969308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1888
2025-10-02T09:33:17.969318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.969322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:17.969324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:17.969331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.969333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.969358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:17.969365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:17.969366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:17.969367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:17.969372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:17.969377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:17.969388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.969466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:17.969471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:17.969478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:17.969531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1889 partition: 0 MaxSeqNo: 36 sessionId: src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0
2025-10-02T09:33:17.969810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e6cf22-b5fc28-ee655e8e-23a64955_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:17.972370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Write session: try to update token
2025-10-02T09:33:17.972384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:17.978343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:17.978354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:17.978355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:17.978356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:17.978361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.978363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.978365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555140795991148:4762]
2025-10-02T09:33:17.978384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:17.978387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:17.978388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:17.978388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:17.978391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:17.978395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:17.978526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:17.985938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId: src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:17.988067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.047764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166515532:7474]
2025-10-02T09:33:18.047918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1888, pipe: [1:7556555145166515532:7474]
2025-10-02T09:33:18.086911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.087149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.087159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.087171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166515532:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.087290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.087337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:18.087347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:18.087359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166515532:7474]
2025-10-02T09:33:18.087370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.087417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1889 reason: error at write: Disconnected sessionId: src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0
2025-10-02T09:33:18.087543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1889 sessionId: src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0 is DEAD
2025-10-02T09:33:18.087717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:18.087732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Write session will restart in 0.008518s
2025-10-02T09:33:18.087756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Write session: Do CDS request
2025-10-02T09:33:18.087763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.097181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.097280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.097289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1890
2025-10-02T09:33:18.097418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.097438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.097444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.097447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.097535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.097705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1890 sessionId:  describe result for acl check
2025-10-02T09:33:18.097729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.097733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.097734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.097737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166515718:6712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.098090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166515718:6712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.099070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.099166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.099172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.099177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.099203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.099227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090958675:4745]
2025-10-02T09:33:18.099313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166515718:6712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.099824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.099972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.099993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.100264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.100292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.100296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.100296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.100297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.100297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.100298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.100299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.100299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.100300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.100300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.100301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.100301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.100304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.100310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.100312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.100314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.100316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.100318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.100320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.100322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.100324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.100327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.100329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.100331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.100334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.100339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.100342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.100345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.100349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.100351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.100354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.100357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.100360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.100363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.100365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.100368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.100370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.100373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.100375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.100378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.100381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.100383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.100389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.100392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.100394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.100397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.100399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.100402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.100419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.100822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166515718:6712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.100831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166515718:6712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.100833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166515718:6712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.100836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.107784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.109324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.109333Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.109334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.109336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.109340Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1889 [2:7556555145090958675:4745]
2025-10-02T09:33:18.109346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.109356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.109358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.109359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.109360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.109369Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.109372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.109376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.109404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.109408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.109409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.109411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.109412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.109448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.109454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.109459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.109465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.109473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.109487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166515757:6712], now have 1 active actors on pipe
2025-10-02T09:33:18.109492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166515533:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.109496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.109497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.109499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.109506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.109517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.109518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.109520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.109522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.109527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.109528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.109526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1889
2025-10-02T09:33:18.109526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1889
2025-10-02T09:33:18.109542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.109547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.109548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.109557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.109562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.109665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.109672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.109674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.109675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.109682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.109686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.109700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.109799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.109805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.109812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.109861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1890 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0
2025-10-02T09:33:18.110104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d105b87d-bf6a4ac7-9e5054ba-53325137_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.112766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Write session: try to update token
2025-10-02T09:33:18.112779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.118488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.118498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.118499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.118500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.118504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.118506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.118508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090958669:4745]
2025-10-02T09:33:18.118527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.118530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.118532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.118533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.118534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.118534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.118663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.125865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId: src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.127998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.187551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166515764:7474]
2025-10-02T09:33:18.187795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1889, pipe: [1:7556555145166515764:7474]
2025-10-02T09:33:18.226880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.227161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.227170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.227184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166515764:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.227550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:18.227562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:18.227581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166515764:7474]
2025-10-02T09:33:18.227600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.227605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1890 reason: error at write: Disconnected sessionId: src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0
2025-10-02T09:33:18.227758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1890 sessionId: src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0 is DEAD
2025-10-02T09:33:18.227890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.227938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:18.227951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Write session will restart in 0.005107s
2025-10-02T09:33:18.227978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Write session: Do CDS request
2025-10-02T09:33:18.227984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.234176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.234259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.234266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1891
2025-10-02T09:33:18.234369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.234389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.234395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.234398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.234716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1891 sessionId:  describe result for acl check
2025-10-02T09:33:18.234739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.234744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.234744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.234747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166515851:6708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.235088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166515851:6708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.236960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166515851:6708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.237825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.239348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.239480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.239487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.239493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.239522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.239547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090958899:4757]
2025-10-02T09:33:18.239565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166515851:6708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.239575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166515851:6708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.239579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166515851:6708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.239583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.239898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.240064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.240089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.240353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.240389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.240393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.240394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.240394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.240395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.240395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.240396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.240396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.240397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.240397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.240398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.240398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.240401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.240407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.240409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.240411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.240413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.240416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.240418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.240420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.240422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.240425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.240427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.240429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.240432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.240436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.240440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.240443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.240445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.240448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.240450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.240453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.240455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.240458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.240460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.240462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.240465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.240468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.240471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.240473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.240475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.240478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.240479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.240482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.240484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.240486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.240488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.240491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.240508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.247884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.249401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.249411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.249412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.249414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.249417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1890 [2:7556555145090958899:4757]
2025-10-02T09:33:18.249424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.249434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.249435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.249437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.249438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.249446Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.249449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.249453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.249480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.249486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.249487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.249489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.249490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.249526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.249531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.249537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.249542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.249549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.249564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166515766:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.249569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166515989:6708], now have 1 active actors on pipe
2025-10-02T09:33:18.249572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.249573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.249574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.249581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.249592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.249593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.249595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.249596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.249603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.249604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.249594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1890
2025-10-02T09:33:18.249600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1890
2025-10-02T09:33:18.249618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.249623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.249624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.249634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.249638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.249664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.249670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.249673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.249674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.249678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.249684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.249693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.249783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.249789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.249797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.249849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1891 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0
2025-10-02T09:33:18.250105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e4e-9461b14f-acbd5844-4ee81c5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.252710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Write session: try to update token
2025-10-02T09:33:18.252726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.258637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.258647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.258648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.258649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.258654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.258656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.258658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090958893:4757]
2025-10-02T09:33:18.258676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.258679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.258679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.258680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.258682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.258684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.258806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.265090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId: src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.267229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.327820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166516013:7474]
2025-10-02T09:33:18.327946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1890, pipe: [1:7556555145166516013:7474]
2025-10-02T09:33:18.367104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.367318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.367326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.367338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516013:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.367456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.367495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166516013:7474]
2025-10-02T09:33:18.367512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:18.367515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.367561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1891 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0
2025-10-02T09:33:18.367694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1891 sessionId: src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0 is DEAD
2025-10-02T09:33:18.367863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:18.367879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Write session will restart in 0.005259s
2025-10-02T09:33:18.367901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Write session: Do CDS request
2025-10-02T09:33:18.367906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.374153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.374270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.374277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1892
2025-10-02T09:33:18.374384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.374405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.374407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.374410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.374751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1892 sessionId:  describe result for acl check
2025-10-02T09:33:18.374777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.374783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.374784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.374787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166516117:6695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.375124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166516117:6695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.377348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166516117:6695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.377726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.379252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.379358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.379364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.379370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.379400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.379409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166516117:6695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.379418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166516117:6695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.379421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166516117:6695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.379425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.379426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090959161:4738]
2025-10-02T09:33:18.380027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.380188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.380211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.380383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.380411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.380414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.380415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.380416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.380416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.380417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.380417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.380418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.380418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.380419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.380420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.380420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.380423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.380428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.380431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.380433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.380435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.380437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.380438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.380440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.380442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.380445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.380447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.380448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.380453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.380457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.380460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.380463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.380465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.380468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.380470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.380473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.380475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.380478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.380480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.380482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.380485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.380487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.380489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.380493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.380495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.380498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.380499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.380502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.380508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.380510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.380512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.380514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.380530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.387944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.389508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.389519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.389520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.389522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.389525Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1891 [2:7556555145090959161:4738]
2025-10-02T09:33:18.389531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.389541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.389543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.389545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.389546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.389556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.389563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.389568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.389598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.389603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.389604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.389606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.389607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.389643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.389647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.389654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.389659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.389668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.389681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516024:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.389686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516246:6695], now have 1 active actors on pipe
2025-10-02T09:33:18.389690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.389691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.389692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.389698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.389709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.389711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.389713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.389714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.389717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.389719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.389735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.389740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.389741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.389723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1891
2025-10-02T09:33:18.389730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1891
2025-10-02T09:33:18.389755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.389760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.389780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.389786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.389789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.389790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.389795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.389800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.389812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.389908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.389913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.389920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.389980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1892 partition: 0 MaxSeqNo: 36 sessionId: src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0
2025-10-02T09:33:18.390246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca1f76b3-27bd7d49-2ae6ba4d-fbbee234_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.392782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Write session: try to update token
2025-10-02T09:33:18.392797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.398722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.398731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.398732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.398733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.398801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.398807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.398809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090959155:4738]
2025-10-02T09:33:18.398827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.398827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.398829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.398831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.398832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.398833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.398938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.405733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId: src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.407940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.467619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166516257:7474]
2025-10-02T09:33:18.467803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1891, pipe: [1:7556555145166516257:7474]
2025-10-02T09:33:18.507702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.507985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.507994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.508007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516257:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.508149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.508170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.508187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:18.508199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166516257:7474]
2025-10-02T09:33:18.508238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1892 reason: status is not ok: tablet will be restarted right now sessionId: src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0
2025-10-02T09:33:18.508376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1892 sessionId: src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0 is DEAD
2025-10-02T09:33:18.508531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:18.508545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Write session will restart in 0.007590s
2025-10-02T09:33:18.508566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Write session: Do CDS request
2025-10-02T09:33:18.508571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.517174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.517294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.517303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1893
2025-10-02T09:33:18.517417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.517437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.517443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.517445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.517731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1893 sessionId:  describe result for acl check
2025-10-02T09:33:18.517755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.517756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.517757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.517759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166516444:6684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.518106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166516444:6684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.519570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.519660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166516444:6684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.519809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.519945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.519952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.519958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.519988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.520010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090959385:4733]
2025-10-02T09:33:18.520343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.520489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.520511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.520703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.520739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.520744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.520745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.520745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.520746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.520747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.520747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.520748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.520748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.520749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.520749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.520750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.520752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.520758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.520760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.520762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.520764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.520766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.520768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.520770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.520772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.520774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.520776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.520778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.520781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.520785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.520789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.520792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.520795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.520798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.520812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.520815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.520817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.520820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.520822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.520825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.520827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.520830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.520833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.520836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.520838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.520841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.520843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.520845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.520847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.520850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.520852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.520854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.521214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166516444:6684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.521222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166516444:6684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.521224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166516444:6684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.521227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.528196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.529788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.529798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.529799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.529801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.529804Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1892 [2:7556555145090959385:4733]
2025-10-02T09:33:18.529811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.529821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.529826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.529827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.529828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.529838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.529842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.529849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.529881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.529885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.529886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.529888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.529889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.529925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.529930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.529937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.529942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.529950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.529964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516485:6684], now have 1 active actors on pipe
2025-10-02T09:33:18.529969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516258:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.529973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.529974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.529976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.529983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.529993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.530000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.530003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.530005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.530007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.530009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.530018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.530020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.530023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.530004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1892
2025-10-02T09:33:18.530034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.530009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1892
2025-10-02T09:33:18.530040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.530060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.530068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.530073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.530074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.530079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.530088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.530103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.530190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.530195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.530202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.530255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1893 partition: 0 MaxSeqNo: 36 sessionId: src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0
2025-10-02T09:33:18.530482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f90d0-c67db8d1-c47fbfa-880d4263_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.533119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Write session: try to update token
2025-10-02T09:33:18.533135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.539423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.539433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.539435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.539436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.539440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.539442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.539444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090959379:4733]
2025-10-02T09:33:18.539464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.539470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.539471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.539472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.539476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.539479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.539584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.545156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId: src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.547335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.608415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166516493:7474]
2025-10-02T09:33:18.608590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1892, pipe: [1:7556555145166516493:7474]
2025-10-02T09:33:18.648407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.648721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.648731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.648745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516493:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.648888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.648930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:18.648940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:18.648947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166516493:7474]
2025-10-02T09:33:18.648963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.648984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1893 reason: error at write: Disconnected sessionId: src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0
2025-10-02T09:33:18.649107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1893 sessionId: src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0 is DEAD
2025-10-02T09:33:18.649296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:18.649311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Write session will restart in 0.006554s
2025-10-02T09:33:18.649339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Write session: Do CDS request
2025-10-02T09:33:18.649345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.657169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.657264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.657273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1894
2025-10-02T09:33:18.657392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.657413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.657419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.657421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.657707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1894 sessionId:  describe result for acl check
2025-10-02T09:33:18.657731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.657737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.657738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.657741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166516652:6678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.658095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166516652:6678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.659140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.659408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166516652:6678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.660676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.660948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.660961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.660974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.660979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166516652:6678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.660987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166516652:6678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.660989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166516652:6678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.660992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.661036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.661074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090959611:4731]
2025-10-02T09:33:18.661661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.661871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.661916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.662149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.662192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.662196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.662197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.662197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.662198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.662198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.662199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.662200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.662200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.662201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.662201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.662202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.662205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.662211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.662213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.662215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.662217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.662219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.662221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.662223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.662225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.662227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.662229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.662231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.662235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.662239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.662243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.662246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.662249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.662252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.662254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.662257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.662259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.662262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.662264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.662266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.662268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.662271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.662273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.662275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.662277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.662280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.662283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.662286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.662291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.662294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.662296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.662298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.662316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.669746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.671659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.671674Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.671677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.671680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.671684Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1893 [2:7556555145090959611:4731]
2025-10-02T09:33:18.671695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.671714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.671717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.671719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.671720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.671733Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.671742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.671752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.671805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.671812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.671813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.671816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.671818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.671868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.671875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.671885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.671898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.671915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.671934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516718:6678], now have 1 active actors on pipe
2025-10-02T09:33:18.671941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516494:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.671948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.671923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1893
2025-10-02T09:33:18.671950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.671930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1893
2025-10-02T09:33:18.671952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.671958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.671965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.671969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.671971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.671972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.671981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.671987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.672001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.672006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.672027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.672035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.672044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.672050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdc4919b-72498516-c1dfb86b-abede54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.672053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.672058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.672060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.672065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.672071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.672092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.672183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.672188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.672196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.672238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1894 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdc4919b-72498516-c1dfb86b-abede54_0
2025-10-02T09:33:18.672503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70e4f18e-1df66342-23fc2f8f-183ec575_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdc4919b-72498516-c1dfb86b-abede54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.675104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Write session: try to update token
2025-10-02T09:33:18.675120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.681064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.681074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.681075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.681075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.681079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.681081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.681083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090959605:4731]
2025-10-02T09:33:18.681102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.681103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.681106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.681107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.681109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.681111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.681213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.688224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId: src_id|cdc4919b-72498516-c1dfb86b-abede54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.690372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.749210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166516730:7474]
2025-10-02T09:33:18.749387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1893, pipe: [1:7556555145166516730:7474]
2025-10-02T09:33:18.788682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.788929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.788938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.788950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516730:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.789088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.789091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166516730:7474]
2025-10-02T09:33:18.789108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.789118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:18.789121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:18.789165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1894 reason: error at write: Disconnected sessionId: src_id|cdc4919b-72498516-c1dfb86b-abede54_0
2025-10-02T09:33:18.789297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1894 sessionId: src_id|cdc4919b-72498516-c1dfb86b-abede54_0 is DEAD
2025-10-02T09:33:18.789467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:18.789481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Write session will restart in 0.006274s
2025-10-02T09:33:18.789504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Write session: Do CDS request
2025-10-02T09:33:18.789509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.797183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.797280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.797287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1895
2025-10-02T09:33:18.797405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.797425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.797429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.797432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.797771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1895 sessionId:  describe result for acl check
2025-10-02T09:33:18.797801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.797806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.797807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.797811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166516873:6674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.798276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166516873:6674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.799527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.799820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166516873:6674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.801206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.801303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.801309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.801315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.801342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.801364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090959838:4719]
2025-10-02T09:33:18.801697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.801782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166516873:6674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.801793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166516873:6674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.801795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166516873:6674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.801799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.801884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.801909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.802079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.802109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.802112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.802113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.802113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.802114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.802115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.802115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.802116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.802116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.802117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.802117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.802118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.802121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.802127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.802129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.802131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.802133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.802135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.802137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.802138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.802140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.802143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.802145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.802147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.802150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.802154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.802157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.802160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.802162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.802165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.802167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.802170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.802172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.802175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.802177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.802179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.802182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.802184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.802187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.802190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.802192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.802194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.802196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.802199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.802201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.802203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.802205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.802208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.802224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.809510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.811108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.811118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.811119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.811122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.811125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1894 [2:7556555145090959838:4719]
2025-10-02T09:33:18.811132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.811141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.811142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.811143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.811145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.811154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.811160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.811164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.811191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.811196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.811197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.811198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.811200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.811233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.811238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.811244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.811250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.811260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.811274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516958:6674], now have 1 active actors on pipe
2025-10-02T09:33:18.811279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516731:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.811283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.811284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.811286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.811292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.811302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.811309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.811311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.811312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.811316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.811318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.811325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.811327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.811306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1894
2025-10-02T09:33:18.811311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1894
2025-10-02T09:33:18.811334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.811336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.811338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.811361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.811368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.811372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.811373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.811378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.811385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.811398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.811489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.811493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.811500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.811564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1895 partition: 0 MaxSeqNo: 36 sessionId: src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0
2025-10-02T09:33:18.811792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdc4919b-72498516-c1dfb86b-abede54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.814358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Write session: try to update token
2025-10-02T09:33:18.814373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.820325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.820338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.820340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.820341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.820347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.820350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.820352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090959832:4719]
2025-10-02T09:33:18.820378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.820387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.820389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.820388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.820392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.820395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.820538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.827069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId: src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.829211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:18.888994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555145166516973:7474]
2025-10-02T09:33:18.889211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1894, pipe: [1:7556555145166516973:7474]
2025-10-02T09:33:18.929164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:18.929485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.929495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.929507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516973:7474], now have 1 active actors on pipe
2025-10-02T09:33:18.929623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:18.929646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555145166516973:7474]
2025-10-02T09:33:18.929663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:18.929669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:18.929729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1895 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0
2025-10-02T09:33:18.929892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1895 sessionId: src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0 is DEAD
2025-10-02T09:33:18.930053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:18.930065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Write session will restart in 0.008595s
2025-10-02T09:33:18.930091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Write session: Do CDS request
2025-10-02T09:33:18.930097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:18.939757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:18.940179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.940257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:18.940266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1896
2025-10-02T09:33:18.940378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:18.940398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:18.940405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:18.940407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:18.940673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1896 sessionId:  describe result for acl check
2025-10-02T09:33:18.940698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:18.940702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:18.940703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:18.940706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555145166517168:6672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:18.941093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555145166517168:6672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:18.941325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:18.941473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:18.941479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:18.941486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:18.941515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:18.941538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555145090960078:4727]
2025-10-02T09:33:18.941873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:18.942026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:18.942048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:18.942218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:18.942248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.942255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.942256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.942256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.942257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.942257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.942258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.942258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.942259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.942259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.942260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.942260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.942263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.942269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.942271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.942273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.942275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.942277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.942279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.942281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.942283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.942285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.942287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.942289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.942292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.942296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:18.942299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.942302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:18.942304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.942307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:18.942309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.942312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:18.942314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.942317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:18.942319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.942321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:18.942323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.942326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:18.942329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.942332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:18.942334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.942336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:18.942338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.942341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.942343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.942345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.942347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.942350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.942367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:18.942567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555145166517168:6672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:18.947070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555145166517168:6672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:18.947078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555145166517168:6672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:18.947079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555145166517168:6672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:18.947083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:18.949703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:18.951290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:18.951301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:18.951303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:18.951304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:18.951308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1895 [2:7556555145090960078:4727]
2025-10-02T09:33:18.951315Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:18.951324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:18.951326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.951327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.951328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.951338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:18.951342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:18.951346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:18.951378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.951383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.951386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.951387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:18.951389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:18.951422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:18.951427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.951433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:18.951439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:18.951450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:18.951462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166516977:2446], now have 1 active actors on pipe
2025-10-02T09:33:18.951468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555145166517207:6672], now have 1 active actors on pipe
2025-10-02T09:33:18.951471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.951473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.951474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.951480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:18.951490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:18.951491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:18.951494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:18.951495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:18.951500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:18.951501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:18.951514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.951519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:18.951521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:18.951507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1895
2025-10-02T09:33:18.951523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1895
2025-10-02T09:33:18.951547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.951552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.951566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:18.951572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:18.951574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:18.951575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:18.951580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:18.951588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:18.951597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.951680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:18.951684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:18.951692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:18.951742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1896 partition: 0 MaxSeqNo: 36 sessionId: src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0
2025-10-02T09:33:18.952001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a780bd9-527855b7-c1bc951b-d4e8f7d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:18.954637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Write session: try to update token
2025-10-02T09:33:18.954654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:18.964405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:18.964416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.964420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.964442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:18.964448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:18.964571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:18.964683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:18.964796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:18.964923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:18.965102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:18.965127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:18.967764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId: src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:18.968798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:18.968821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:18.968822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:18.968823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:18.968827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.968829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.968831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555145090960072:4727]
2025-10-02T09:33:18.968849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:18.968852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:18.968854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:18.968855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:18.968857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:18.968857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:18.968973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:18.969976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.029773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555149461484523:7474]
2025-10-02T09:33:19.029946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1895, pipe: [1:7556555149461484523:7474]
2025-10-02T09:33:19.076211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.076464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.076473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.076486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461484523:7474], now have 1 active actors on pipe
2025-10-02T09:33:19.076634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.076661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:19.076670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:19.076710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1896 reason: error at write: Disconnected sessionId: src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0
2025-10-02T09:33:19.076711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461484523:7474]
2025-10-02T09:33:19.076726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.076865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1896 sessionId: src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0 is DEAD
2025-10-02T09:33:19.077005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:19.077019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Write session will restart in 0.009479s
2025-10-02T09:33:19.077042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Write session: Do CDS request
2025-10-02T09:33:19.077047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.086673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.087190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.087288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.087298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1897
2025-10-02T09:33:19.087430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.087450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.087456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.087459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.087713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1897 sessionId:  describe result for acl check
2025-10-02T09:33:19.087737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.087741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.087743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.087745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461484716:6666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.088082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461484716:6666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.088226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.088388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.088395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.088401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.088434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.088456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385927605:4723]
2025-10-02T09:33:19.088788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.088957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.088979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.089150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.089178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.089182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.089182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.089183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.089183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.089184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.089184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.089185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.089185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.089186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.089187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.089187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.089190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.089195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.089197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.089200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.089202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.089204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.089206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.089207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.089209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.089211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.089213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.089215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.089219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.089222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.089225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.089228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.089230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.089233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.089235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.089238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.089241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.089243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.089245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.089248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.089250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.089252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.089254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.089257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.089259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.089261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.089264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.089266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.089268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.089271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.089273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.089275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.089292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.089556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461484716:6666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.094071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461484716:6666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.094082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461484716:6666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.094084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461484716:6666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.094088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.096711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.098233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.098243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.098245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.098247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.098251Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1896 [2:7556555149385927605:4723]
2025-10-02T09:33:19.098257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.098267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.098272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.098274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.098275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.098283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.098289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.098293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.098319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.098324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.098326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.098328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.098329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.098363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.098368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.098374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.098380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.098387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.098401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461484754:6666], now have 1 active actors on pipe
2025-10-02T09:33:19.098407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461484524:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.098411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.098416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.098417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.098424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.098435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.098437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.098439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.098440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.098444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.098446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.098445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1896
2025-10-02T09:33:19.098449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1896
2025-10-02T09:33:19.098459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.098464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.098465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.098476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.098481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.098505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.098512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.098515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.098518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.098523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.098527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.098539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.098622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.098626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.098634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.098674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1897 partition: 0 MaxSeqNo: 36 sessionId: src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0
2025-10-02T09:33:19.098926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f5b34e-e1706f2b-8a8e7a28-4826c592_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.101551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Write session: try to update token
2025-10-02T09:33:19.101569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.107443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.107453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.107456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.107457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.107460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.107462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.107464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385927599:4723]
2025-10-02T09:33:19.107482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.107484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.107486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.107487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.107490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.107494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.107601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.114289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId: src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.116399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.176731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555149461484762:7474]
2025-10-02T09:33:19.176904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1896, pipe: [1:7556555149461484762:7474]
2025-10-02T09:33:19.214670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.214947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.214956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.214968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461484762:7474], now have 1 active actors on pipe
2025-10-02T09:33:19.215114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.215144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.215185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:19.215237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1897 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0
2025-10-02T09:33:19.215370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461484762:7474]
2025-10-02T09:33:19.215375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1897 sessionId: src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0 is DEAD
2025-10-02T09:33:19.215516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:19.215530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Write session will restart in 0.007065s
2025-10-02T09:33:19.215551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Write session: Do CDS request
2025-10-02T09:33:19.215557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.223147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.223246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.223253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1898
2025-10-02T09:33:19.223371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.223392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.223398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.223400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.223673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1898 sessionId:  describe result for acl check
2025-10-02T09:33:19.223696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.223700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.223701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.223704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461484903:6661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.224069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461484903:6661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.225256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461484903:6661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.225525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.227028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.227125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.227132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.227137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.227164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.227185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385927835:4721]
2025-10-02T09:33:19.227183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461484903:6661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.227192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461484903:6661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.227195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461484903:6661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.227200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.227518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.227677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.227700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.227873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.227901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.227905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.227905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.227906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.227906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.227907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.227907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.227908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.227908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.227909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.227909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.227910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.227913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.227918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.227921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.227923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.227925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.227927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.227929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.227931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.227933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.227935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.227937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.227939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.227943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.227947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.227950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.227954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.227956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.227958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.227960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.227963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.227965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.227968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.227970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.227973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.227975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.227978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.227980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.227982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.227985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.227987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.227990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.227993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.227995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.227998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.228000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.228006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.235330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.236909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.236918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.236919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.236921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.236925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1897 [2:7556555149385927835:4721]
2025-10-02T09:33:19.236932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.236941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.236943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.236944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.236945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.236954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.236957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.236962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.236992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.236997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.236998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.237000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.237001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.237036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.237040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.237047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.237053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.237061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.237075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461484764:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.237080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461484991:6661], now have 1 active actors on pipe
2025-10-02T09:33:19.237083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.237085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.237086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.237092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.237106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1897
2025-10-02T09:33:19.237118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1897
2025-10-02T09:33:19.237102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.237112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.237115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.237116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.237116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.237118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.237132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.237133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.237136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.237144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.237146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.237169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1834288-1853f40a-36e16396-498f5943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.237173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.237175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.237176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.237181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.237189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.237198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.237296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.237301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.237308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.237368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1898 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1834288-1853f40a-36e16396-498f5943_0
2025-10-02T09:33:19.237620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d7bf1b-968aa071-e4993328-7ab5995f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1834288-1853f40a-36e16396-498f5943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.240365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Write session: try to update token
2025-10-02T09:33:19.240380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.246195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.246206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.246207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.246208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.246211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.246214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.246216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385927829:4721]
2025-10-02T09:33:19.246234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.246237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.246237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.246239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.246240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.246242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.246348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.252893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId: src_id|a1834288-1853f40a-36e16396-498f5943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.255027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.315482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555149461485005:7474]
2025-10-02T09:33:19.315638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1897, pipe: [1:7556555149461485005:7474]
2025-10-02T09:33:19.353693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.353953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.353963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.353975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485005:7474], now have 1 active actors on pipe
2025-10-02T09:33:19.354081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.354080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461485005:7474]
2025-10-02T09:33:19.354099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:19.354101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:19.354137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1898 reason: error at write: Disconnected sessionId: src_id|a1834288-1853f40a-36e16396-498f5943_0
2025-10-02T09:33:19.354271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1898 sessionId: src_id|a1834288-1853f40a-36e16396-498f5943_0 is DEAD
2025-10-02T09:33:19.354363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.354440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:19.354454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Write session will restart in 0.008473s
2025-10-02T09:33:19.354479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Write session: Do CDS request
2025-10-02T09:33:19.354484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.363976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.364207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.364314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.364321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1899
2025-10-02T09:33:19.364442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.364462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.364467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.364470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.364673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1899 sessionId:  describe result for acl check
2025-10-02T09:33:19.364690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.364691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.364692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.364695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461485214:6647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.365011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461485214:6647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.365487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.365601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.365609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.365615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.365645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.365667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385928080:4706]
2025-10-02T09:33:19.366001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.366146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.366169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.366342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.366369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.366372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.366373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.366373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.366374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.366374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.366375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.366375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.366376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.366376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.366377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.366377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.366380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.366386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.366388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.366391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.366393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.366395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.366397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.366399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.366401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.366403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.366405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.366406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.366411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.366415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.366419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.366422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.366424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.366427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.366429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.366431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.366411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461485214:6647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.366433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.366436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.366438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.366441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.366443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.366446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.366448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.366450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.366453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.366456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.366458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.366461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.366463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.366465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.366467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.366470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.366486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.371213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461485214:6647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.371221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461485214:6647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.371222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461485214:6647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.371226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.373833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.375358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.375367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.375369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.375371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.375374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1898 [2:7556555149385928080:4706]
2025-10-02T09:33:19.375380Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.375390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.375391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.375392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.375393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.375402Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.375404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.375412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.375442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.375447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.375448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.375449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.375451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.375485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.375489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.375495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.375500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.375508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.375522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485251:6647], now have 1 active actors on pipe
2025-10-02T09:33:19.375527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485019:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.375534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.375537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.375538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.375545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.375552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.375557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.375560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.375561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.375563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.375564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.375553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1898
2025-10-02T09:33:19.375570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1898
2025-10-02T09:33:19.375578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.375583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.375584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.375593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.375596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.375623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.375630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.375633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.375634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.375638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.375644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.375656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.375737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.375742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.375749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.375802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1899 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0
2025-10-02T09:33:19.376067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1834288-1853f40a-36e16396-498f5943_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.378711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Write session: try to update token
2025-10-02T09:33:19.378725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.384673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.384685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.384686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.384686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.384690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.384692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.384693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385928075:4706]
2025-10-02T09:33:19.384713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.384714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.384715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.384717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.384717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.384718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.384850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.390903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId: src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.393032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.454245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555149461485268:7474]
2025-10-02T09:33:19.454472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1898, pipe: [1:7556555149461485268:7474]
2025-10-02T09:33:19.494265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.494546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.494555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.494567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485268:7474], now have 1 active actors on pipe
2025-10-02T09:33:19.494695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.494775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:19.494802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461485268:7474]
2025-10-02T09:33:19.494822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.494835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1899 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0
2025-10-02T09:33:19.494969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1899 sessionId: src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0 is DEAD
2025-10-02T09:33:19.495144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:19.495159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Write session will restart in 0.007521s
2025-10-02T09:33:19.495180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Write session: Do CDS request
2025-10-02T09:33:19.495186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.504175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.504296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.504306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1900
2025-10-02T09:33:19.504414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.504434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.504441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.504443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.504874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1900 sessionId:  describe result for acl check
2025-10-02T09:33:19.504897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.504902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.504902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.504905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461485461:6639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.505261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461485461:6639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.505362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.506899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461485461:6639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.507048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.507164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.507171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.507177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.507208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.507240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385928336:4688]
2025-10-02T09:33:19.507627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.507794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.507822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.508067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.508097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.508101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.508102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.508102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.508103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.508103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.508104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.508104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.508105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.508105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.508106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.508106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.508109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.508115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.508117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.508119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.508121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.508123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.508125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.508127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.508129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.508132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.508134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.508136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.508140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.508144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.508148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.508151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.508153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.508155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.508157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.508160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.508162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.508165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.508167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.508169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.508172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.508175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.508176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.508179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.508181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.508183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.508185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.508187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.508190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.508192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.508194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.508197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.508217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.511977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461485461:6639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.511985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461485461:6639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.511987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461485461:6639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.511991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.515540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.517053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.517063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.517064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.517066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.517069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1899 [2:7556555149385928336:4688]
2025-10-02T09:33:19.517076Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.517086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.517091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.517092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.517093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.517102Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.517106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.517111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.517259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.517264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.517266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.517267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.517269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.517304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.517309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.517315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.517320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.517331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.517345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485269:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.517350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485503:6639], now have 1 active actors on pipe
2025-10-02T09:33:19.517353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.517354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.517355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.517362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.517373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.517375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.517377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.517378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.517383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.517384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.517384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1899
2025-10-02T09:33:19.517386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1899
2025-10-02T09:33:19.517399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.517404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.517405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.517413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.517418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.517445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aa06371-62a78a93-9e65d885-6e68087f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.517451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.517453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.517455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.517460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.517467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.517476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.517557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.517562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.517569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.517616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1900 partition: 0 MaxSeqNo: 36 sessionId: src_id|6aa06371-62a78a93-9e65d885-6e68087f_0
2025-10-02T09:33:19.517868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5d42c4-efd56539-b7180c1e-ab755526_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6aa06371-62a78a93-9e65d885-6e68087f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.520536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Write session: try to update token
2025-10-02T09:33:19.520550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.526405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.526416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.526417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.526418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.526422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.526424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.526426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385928330:4688]
2025-10-02T09:33:19.526444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.526446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.526447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.526448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.526451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.526452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.526555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.532700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId: src_id|6aa06371-62a78a93-9e65d885-6e68087f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.534865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.595035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555149461485511:7474]
2025-10-02T09:33:19.595192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1899, pipe: [1:7556555149461485511:7474]
2025-10-02T09:33:19.635288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.635503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.635512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.635524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485511:7474], now have 1 active actors on pipe
2025-10-02T09:33:19.635662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.635685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:19.635692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:19.635706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.635734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461485511:7474]
2025-10-02T09:33:19.635739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1900 reason: error at write: Disconnected sessionId: src_id|6aa06371-62a78a93-9e65d885-6e68087f_0
2025-10-02T09:33:19.635860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1900 sessionId: src_id|6aa06371-62a78a93-9e65d885-6e68087f_0 is DEAD
2025-10-02T09:33:19.636020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:19.636035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Write session will restart in 0.005629s
2025-10-02T09:33:19.636060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Write session: Do CDS request
2025-10-02T09:33:19.636066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.643159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.643228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.643236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1901
2025-10-02T09:33:19.643368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.643387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.643393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.643395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.643642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1901 sessionId:  describe result for acl check
2025-10-02T09:33:19.643659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.643664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.643665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.643668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461485661:6630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.644008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461485661:6630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.645406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.645570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461485661:6630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.646973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.647067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.647074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.647079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.647105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.647128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385928570:4685]
2025-10-02T09:33:19.647212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461485661:6630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.647222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461485661:6630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.647224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461485661:6630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.647228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.647725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.647875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.647897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.648069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.648097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.648101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.648101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.648102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.648103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.648103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.648104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.648104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.648105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.648105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.648106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.648106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.648109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.648114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.648117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.648119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.648121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.648123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.648125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.648127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.648129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.648131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.648133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.648135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.648139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.648143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.648147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.648149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.648151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.648154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.648156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.648159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.648161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.648164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.648166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.648169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.648171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.648174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.648180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.648182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.648185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.648187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.648190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.648193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.648195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.648197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.648199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.648202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.648220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.655546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.657107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.657117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.657118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.657121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.657124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1900 [2:7556555149385928570:4685]
2025-10-02T09:33:19.657132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.657142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.657147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.657148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.657150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.657159Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.657161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.657165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.657196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.657201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.657201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.657203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.657205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.657238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.657242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.657249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.657255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.657263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.657278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485512:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.657283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485751:6630], now have 1 active actors on pipe
2025-10-02T09:33:19.657288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.657289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.657290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.657297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.657307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.657311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.657313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.657314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.657316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.657317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.657332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.657336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.657338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.657322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1900
2025-10-02T09:33:19.657324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1900
2025-10-02T09:33:19.657346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.657351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.657377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.657384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.657386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.657387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.657392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.657400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.657409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.657507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.657512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.657519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.657577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1901 partition: 0 MaxSeqNo: 36 sessionId: src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0
2025-10-02T09:33:19.657831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa06371-62a78a93-9e65d885-6e68087f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.660429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Write session: try to update token
2025-10-02T09:33:19.660446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.666377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.666385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.666386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.666387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.666391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.666394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.666396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385928565:4685]
2025-10-02T09:33:19.666415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.666416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.666418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.666418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.666419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.666420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.666525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.672918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId: src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.675003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.735845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555149461485765:7474]
2025-10-02T09:33:19.736012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1900, pipe: [1:7556555149461485765:7474]
2025-10-02T09:33:19.776244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.776578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.776586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.776599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485765:7474], now have 1 active actors on pipe
2025-10-02T09:33:19.776736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.776744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461485765:7474]
2025-10-02T09:33:19.776767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.776767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:19.776771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:19.776786Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:33:19.776835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1901 reason: error at write: Disconnected sessionId: src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0
2025-10-02T09:33:19.776889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1901 sessionId: src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0 is DEAD
2025-10-02T09:33:19.776949Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 19 consumer shared/user session shared/user_1_19_4218884145141638320_v1 is DEAD
2025-10-02T09:33:19.777048Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555089331923570:7480] disconnected; active server actors: 1
2025-10-02T09:33:19.777054Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555089331923570:7480] client user disconnected session shared/user_1_19_4218884145141638320_v1
2025-10-02T09:33:19.777082Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:33:19.777142Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:19.777146Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:19.777154Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.005249s
2025-10-02T09:33:19.777211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:19.777221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Write session will restart in 0.006339s
2025-10-02T09:33:19.777241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Write session: Do CDS request
2025-10-02T09:33:19.777246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.783046Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:33:19.783222Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:33:19.783227Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 20
2025-10-02T09:33:19.783339Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 20 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:19.783369Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:19.783426Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 auth for : user
2025-10-02T09:33:19.783601Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 Handle describe topics response
2025-10-02T09:33:19.783618Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 auth is DEAD
2025-10-02T09:33:19.783619Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:33:19.783766Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:33:19.783814Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555149461485819:6626] connected; active server actors: 1
2025-10-02T09:33:19.783820Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555149461485819:6626] session shared/user_1_20_16953024233389448051_v1
2025-10-02T09:33:19.783825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:33:19.783830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:33:19.783833Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_20_16953024233389448051_v1" (Sender=[1:7556555149461485802:6626], Pipe=[1:7556555149461485819:6626], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:19.783835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:33:19.783841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:33:19.783848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_20_16953024233389448051_v1" (Sender=[1:7556555149461485802:6626], Pipe=[1:7556555149461485819:6626], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:19.783853Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_20_16953024233389448051_v1" sender [1:7556555149461485802:6626] lock partition 0 for ReadingSession "shared/user_1_20_16953024233389448051_v1" (Sender=[1:7556555149461485802:6626], Pipe=[1:7556555149461485819:6626], Partitions=[], ActiveFamilyCount=1) generation 1 step 20
2025-10-02T09:33:19.783860Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_20_16953024233389448051_v1
2025-10-02T09:33:19.783862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:33:19.783865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000019s
2025-10-02T09:33:19.784020Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 20 Session: "shared/user_1_20_16953024233389448051_v1" ClientId: "user" PipeClient { RawX1: 7556555149461485819 RawX2: 4503603922344418 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:33:19.784040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:33:19.784065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.784104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.784112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1902
2025-10-02T09:33:19.784165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.784180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.784185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.784187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.784388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1902 sessionId:  describe result for acl check
2025-10-02T09:33:19.784406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.784410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.784411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.784413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461485842:6618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.784760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461485842:6618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.786744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461485842:6618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.788442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461485842:6618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.788450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461485842:6618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.788451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461485842:6618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.788454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.788475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.790085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.790183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.790189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.790195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.790220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.790243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385928808:4683]
2025-10-02T09:33:19.790580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.790754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.790775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.791008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.791042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.791046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.791047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.791047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.791048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.791048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.791049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.791049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.791050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.791050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.791051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.791051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.791054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.791059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.791061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.791063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.791065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.791067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.791069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.791071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.791073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.791076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.791077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.791079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.791082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.791086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.791089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.791092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.791094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.791097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.791099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.791102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.791104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.791107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.791110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.791113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.791115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.791118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.791120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.791122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.791125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.791127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.791129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.791133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.791135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.791137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.791139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.791142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.791159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.798555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.800132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.800142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.800143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.800145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.800148Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1901 [2:7556555149385928808:4683]
2025-10-02T09:33:19.800156Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.800165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.800170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.800171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.800172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.800182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.800185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.800189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.800220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.800224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.800225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.800227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.800229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.800264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.800269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.800275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.800280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.800288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.800303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461486007:6618], now have 1 active actors on pipe
2025-10-02T09:33:19.800308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485769:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.800310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461485830:6623], now have 1 active actors on pipe
2025-10-02T09:33:19.800314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.800315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.800316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.800325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.800336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.800330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1901
2025-10-02T09:33:19.800342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.800343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.800343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1901
2025-10-02T09:33:19.800345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.800350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1901, pipe: [1:7556555149461485830:6623]
2025-10-02T09:33:19.800349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.800350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.800358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.800360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.800368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.800372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.800374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.800394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.800399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.800402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_20_16953024233389448051_v1 on pipe: [1:7556555149461485830:6623]
2025-10-02T09:33:19.800422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de935408-16666f37-351022-eb9233c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.800425Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_20_16953024233389448051_v1:1 with generation 1901
2025-10-02T09:33:19.800428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.800431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.800432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.800438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.800444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.800453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.800457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.800457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.800465Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_20_16953024233389448051_v1
2025-10-02T09:33:19.800467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.800486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.800495Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:33:19.800559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.800564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.800571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.800617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1902 partition: 0 MaxSeqNo: 36 sessionId: src_id|de935408-16666f37-351022-eb9233c5_0
2025-10-02T09:33:19.800867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84347183-ad13d3bf-a600bbe1-9aa60770_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de935408-16666f37-351022-eb9233c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.803405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Write session: try to update token
2025-10-02T09:33:19.803419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.803828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:33:19.803842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:33:19.803846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.803847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.803848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.803851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:33:19.803855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:33:19.803921Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397599800 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:33:19.803931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:33:19.803948Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 sending to client partition status
2025-10-02T09:33:19.809447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.809458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.809459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.809460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.809463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.809466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.809468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385928801:4683]
2025-10-02T09:33:19.809487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.809490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.809492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.809492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.809495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.809498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.809600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.815244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId: src_id|de935408-16666f37-351022-eb9233c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.817341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:19.919299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:19.919499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.919503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.919630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_20_16953024233389448051_v1
2025-10-02T09:33:19.919643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:19.919661Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_20_16953024233389448051_v1
2025-10-02T09:33:19.919666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:19.919685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555149461485830:6623]
2025-10-02T09:33:19.919699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:19.919750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1902 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de935408-16666f37-351022-eb9233c5_0
2025-10-02T09:33:19.919889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1902 sessionId: src_id|de935408-16666f37-351022-eb9233c5_0 is DEAD
2025-10-02T09:33:19.920037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:19.920053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Write session will restart in 0.008108s
2025-10-02T09:33:19.920077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Write session: Do CDS request
2025-10-02T09:33:19.920082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:19.929171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.929240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:19.929249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1903
2025-10-02T09:33:19.929379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:19.929401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:19.929407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:19.929410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:19.929678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1903 sessionId:  describe result for acl check
2025-10-02T09:33:19.929700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:19.929704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:19.929705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:19.929708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555149461486226:6616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:19.930061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555149461486226:6616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:19.930456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:19.931299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555149461486226:6616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:19.932240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:19.932345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:19.932352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:19.932358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:19.932386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:19.932409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555149385929057:4666]
2025-10-02T09:33:19.932744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:19.932758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555149461486226:6616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:19.932766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555149461486226:6616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:19.932768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555149461486226:6616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:19.932771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:19.932915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:19.932937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:19.933111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:19.933138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.933142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.933143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.933143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.933144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.933145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.933145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.933145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.933146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.933147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.933147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.933148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.933150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.933156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.933159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.933161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.933163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.933164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.933166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.933168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.933170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.933172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.933174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.933176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.933180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.933183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:19.933187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.933190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:19.933192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.933194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:19.933197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.933199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:19.933202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.933204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:19.933206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.933209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:19.933211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.933214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:19.933216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.933219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:19.933222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.933225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:19.933227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.933230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.933234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.933236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.933238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.933242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.933258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:19.940633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:19.942281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:19.942292Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:19.942294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:19.942295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:19.942299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1902 [2:7556555149385929057:4666]
2025-10-02T09:33:19.942305Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:19.942315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:19.942318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.942320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.942321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.942330Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:19.942334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:19.942338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:19.942368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.942372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.942374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.942375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:19.942377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:19.942415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:19.942419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.942426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:19.942431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:19.942439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:19.942453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461486031:2446], now have 1 active actors on pipe
2025-10-02T09:33:19.942459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555149461486266:6616], now have 1 active actors on pipe
2025-10-02T09:33:19.942463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.942464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.942465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.942472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:19.942482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:19.942484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:19.942486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:19.942487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:19.942491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:19.942492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:19.942478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1902
2025-10-02T09:33:19.942505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.942509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:19.942487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1902
2025-10-02T09:33:19.942510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:19.942522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.942527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.942550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1935140-b0df7149-ed422028-191a37e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:19.942557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:19.942560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:19.942561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:19.942566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:19.942575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:19.942584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.942671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:19.942675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:19.942689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:19.942751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1903 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1935140-b0df7149-ed422028-191a37e3_0
2025-10-02T09:33:19.943011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de935408-16666f37-351022-eb9233c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1935140-b0df7149-ed422028-191a37e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:19.945580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Write session: try to update token
2025-10-02T09:33:19.945597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:19.951490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:19.951501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:19.951502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:19.951503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:19.951507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.951510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.951512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555149385929051:4666]
2025-10-02T09:33:19.951531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:19.951534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:19.951535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:19.951538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:19.951541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:19.951544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:19.951655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:19.957661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId: src_id|e1935140-b0df7149-ed422028-191a37e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:19.959953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.019996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756453583:6623]
2025-10-02T09:33:20.020231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1902, pipe: [1:7556555153756453583:6623]
2025-10-02T09:33:20.062952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.063259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.063267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.063279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756453583:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.063400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.063426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:20.063436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:20.063480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1903 reason: error at write: Disconnected sessionId: src_id|e1935140-b0df7149-ed422028-191a37e3_0
2025-10-02T09:33:20.063567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756453583:6623]
2025-10-02T09:33:20.063595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.063609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1903 sessionId: src_id|e1935140-b0df7149-ed422028-191a37e3_0 is DEAD
2025-10-02T09:33:20.063788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:20.063802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Write session will restart in 0.006421s
2025-10-02T09:33:20.063829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Write session: Do CDS request
2025-10-02T09:33:20.063835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.071212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.071289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.071297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1904
2025-10-02T09:33:20.071410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.071429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.071435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.071438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.071770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1904 sessionId:  describe result for acl check
2025-10-02T09:33:20.071794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.071798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.071799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.071802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756453680:6612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.072158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756453680:6612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.073933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756453680:6612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.075219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.076718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.076826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.076832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.076839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.076867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.076895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756453680:6612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.076905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756453680:6612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.076906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756453680:6612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.076910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.076975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680896592:4667]
2025-10-02T09:33:20.077310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.077491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.077516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.077692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.077721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.077726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.077726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.077727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.077727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.077728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.077728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.077729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.077729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.077730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.077731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.077731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.077734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.077739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.077742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.077744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.077746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.077748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.077750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.077752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.077754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.077757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.077759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.077761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.077766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.077769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.077773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.077775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.077777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.077780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.077782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.077785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.077787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.077790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.077792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.077795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.077797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.077800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.077802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.077805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.077807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.077810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.077812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.077814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.077816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.077819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.077821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.077823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.077841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.085200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.086668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.086678Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.086679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.086681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.086691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1903 [2:7556555153680896592:4667]
2025-10-02T09:33:20.086698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.086708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.086713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.086714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.086716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.086724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.086729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.086733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.086763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.086768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.086769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.086771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.086772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.086805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.086810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.086817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.086822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.086832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.086847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756453585:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.086852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756453819:6612], now have 1 active actors on pipe
2025-10-02T09:33:20.086856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.086857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.086858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.086866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.086876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.086878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.086879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.086880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.086886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.086887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.086885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1903
2025-10-02T09:33:20.086889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1903
2025-10-02T09:33:20.086899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.086904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.086905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.086920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.086924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.086944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.086951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.086953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.086955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.086960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.086967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.086979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.087072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.087077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.087084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.087153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1904 partition: 0 MaxSeqNo: 36 sessionId: src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0
2025-10-02T09:33:20.087430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1935140-b0df7149-ed422028-191a37e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.090158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Write session: try to update token
2025-10-02T09:33:20.090172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.095830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.095841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.095842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.095843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.095846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.095851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.095853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680896586:4667]
2025-10-02T09:33:20.095871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.095873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.095876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.095877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.095877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.095878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.095989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.102512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId: src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.104677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.163871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756453830:6623]
2025-10-02T09:33:20.164042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1903, pipe: [1:7556555153756453830:6623]
2025-10-02T09:33:20.203248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.203509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.203518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.203529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756453830:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.203659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756453830:6623]
2025-10-02T09:33:20.203678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:20.203680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:20.203680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.203683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.203723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1904 reason: error at write: Disconnected sessionId: src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0
2025-10-02T09:33:20.203851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1904 sessionId: src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0 is DEAD
2025-10-02T09:33:20.204005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:20.204020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Write session will restart in 0.005471s
2025-10-02T09:33:20.204041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Write session: Do CDS request
2025-10-02T09:33:20.204046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.210144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.210236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.210244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1905
2025-10-02T09:33:20.210344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.210364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.210371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.210373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.210670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1905 sessionId:  describe result for acl check
2025-10-02T09:33:20.210702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.210706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.210707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.210710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756453899:6603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.211074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756453899:6603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.213374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756453899:6603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.214899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.216711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.216839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756453899:6603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.216847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756453899:6603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.216849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756453899:6603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.216853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.216880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.216887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.216894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.216927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.216952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680896830:4675]
2025-10-02T09:33:20.217284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.217439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.217461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.217637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.217667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.217671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.217671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.217672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.217673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.217673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.217674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.217674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.217675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.217675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.217676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.217676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.217679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.217684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.217687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.217689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.217691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.217693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.217695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.217697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.217699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.217701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.217703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.217704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.217709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.217712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.217716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.217718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.217720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.217723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.217726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.217729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.217732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.217734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.217736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.217739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.217741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.217744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.217746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.217752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.217754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.217756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.217758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.217761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.217763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.217766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.217770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.217773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.217790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.225216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.226654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.226665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.226666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.226668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.226672Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1904 [2:7556555153680896830:4675]
2025-10-02T09:33:20.226679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.226698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.226699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.226701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.226702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.226711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.226714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.226718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.226748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.226754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.226755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.226757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.226758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.226794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.226798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.226805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.226810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.226817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.226833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756453832:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.226839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454067:6603], now have 1 active actors on pipe
2025-10-02T09:33:20.226843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.226878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1904
2025-10-02T09:33:20.226884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1904
2025-10-02T09:33:20.226921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.226925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.226933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.226940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.226944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.226946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.226947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.226950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.226951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.226963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.226969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.226986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.226993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.227002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.227002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.227006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.227009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.227010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.227015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.227021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.227035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.227137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.227142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.227149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.227198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1905 partition: 0 MaxSeqNo: 36 sessionId: src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0
2025-10-02T09:33:20.227454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ccc8f7-e6879316-3e5bfe26-ec71627b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.230191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Write session: try to update token
2025-10-02T09:33:20.230208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.236001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.236012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.236014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.236015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.236018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.236022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.236024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680896824:4675]
2025-10-02T09:33:20.236042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.236046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.236047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.236048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.236049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.236051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.236154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.242828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId: src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.244986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.303647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756454080:6623]
2025-10-02T09:33:20.303844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1904, pipe: [1:7556555153756454080:6623]
2025-10-02T09:33:20.344654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.344943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.344952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.344963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454080:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.345077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.345076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.345109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756454080:6623]
2025-10-02T09:33:20.345113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:20.345115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:20.345164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1905 reason: error at write: Disconnected sessionId: src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0
2025-10-02T09:33:20.345296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1905 sessionId: src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0 is DEAD
2025-10-02T09:33:20.345437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:20.345449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Write session will restart in 0.005621s
2025-10-02T09:33:20.345471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Write session: Do CDS request
2025-10-02T09:33:20.345476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.352147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.352265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.352272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1906
2025-10-02T09:33:20.352375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.352394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.352400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.352402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.352672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1906 sessionId:  describe result for acl check
2025-10-02T09:33:20.352694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.352698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.352699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.352702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756454167:6593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.353059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756454167:6593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.355055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756454167:6593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.356603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.358290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.358390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756454167:6593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.358401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756454167:6593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.358404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756454167:6593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.358407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.358432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.358440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.358448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.358485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.358509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680897069:4668]
2025-10-02T09:33:20.358853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.359019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.359044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.359216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.359247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.359251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.359251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.359252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.359252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.359253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.359253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.359254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.359254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.359255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.359255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.359256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.359259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.359264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.359266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.359268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.359270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.359272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.359274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.359276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.359278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.359280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.359282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.359284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.359287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.359291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.359295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.359298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.359300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.359302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.359304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.359307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.359309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.359312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.359314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.359317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.359319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.359323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.359325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.359327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.359330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.359332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.359338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.359341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.359342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.359345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.359347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.359350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.359366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.366794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.368356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.368367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.368368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.368370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.368374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1905 [2:7556555153680897069:4668]
2025-10-02T09:33:20.368381Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.368391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.368396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.368398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.368399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.368409Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.368412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.368416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.368447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.368451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.368452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.368455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.368456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.368490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.368495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.368502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.368508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.368520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.368534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454320:6593], now have 1 active actors on pipe
2025-10-02T09:33:20.368540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454084:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.368544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.368545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.368546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.368554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.368563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.368567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.368569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.368571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.368574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.368576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.368576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1905
2025-10-02T09:33:20.368581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1905
2025-10-02T09:33:20.368591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.368596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.368598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.368612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.368617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.368634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.368642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.368644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.368645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.368650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.368657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.368665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.368752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.368758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.368766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.368842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1906 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0
2025-10-02T09:33:20.369117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13bb19d9-1dd5a837-4a319063-a216ae50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.371836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Write session: try to update token
2025-10-02T09:33:20.371856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.377626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.377637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.377639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.377639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.377643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.377645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.377647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680897063:4668]
2025-10-02T09:33:20.377666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.377669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.377670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.377672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.377674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.377676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.377780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.384343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId: src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.386571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.445459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756454353:6623]
2025-10-02T09:33:20.445641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1905, pipe: [1:7556555153756454353:6623]
2025-10-02T09:33:20.487077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.487412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.487421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.487434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454353:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.487571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.487585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:20.487594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:20.487624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756454353:6623]
2025-10-02T09:33:20.487640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1906 reason: error at write: Disconnected sessionId: src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0
2025-10-02T09:33:20.487645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.487777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1906 sessionId: src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0 is DEAD
2025-10-02T09:33:20.487950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:20.487965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Write session will restart in 0.005947s
2025-10-02T09:33:20.487992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Write session: Do CDS request
2025-10-02T09:33:20.487998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.495151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.495232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.495240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1907
2025-10-02T09:33:20.495379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.495399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.495405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.495407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.495753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1907 sessionId:  describe result for acl check
2025-10-02T09:33:20.495778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.495783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.495784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.495787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756454452:6578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.496130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756454452:6578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.498141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756454452:6578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.499185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.500717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.500823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.500829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.500835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.500861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.500884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680897345:4638]
2025-10-02T09:33:20.500916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756454452:6578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.500924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756454452:6578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.500926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756454452:6578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.500930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.501222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.501386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.501410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.501585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.501613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.501617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.501618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.501618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.501619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.501619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.501620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.501620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.501621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.501622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.501622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.501623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.501625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.501631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.501633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.501635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.501637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.501640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.501642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.501644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.501646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.501649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.501651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.501653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.501656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.501660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.501664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.501667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.501669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.501671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.501673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.501676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.501679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.501681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.501683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.501686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.501689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.501692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.501694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.501696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.501699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.501702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.501704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.501706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.501708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.501711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.501714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.501717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.501734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.509280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.510812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.510822Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.510823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.510825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.510828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1906 [2:7556555153680897345:4638]
2025-10-02T09:33:20.510835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.510845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.510848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.510849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.510850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.510859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.510862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.510866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.510896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.510901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.510902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.510904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.510905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.510940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.510945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.510951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.510957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.510965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.510979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454591:6578], now have 1 active actors on pipe
2025-10-02T09:33:20.510984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454354:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.510989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.510990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.510991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.510998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.511006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.511014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.511015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.511017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.511023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.511024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.511030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.511032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.511034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.511087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1906
2025-10-02T09:33:20.511131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1906
2025-10-02T09:33:20.511157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.511163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.511177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdcd9733-27d17e8a-b422497b-35569d13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.511184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.511186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.511187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.511192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.511199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.511208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.511317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.511322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.511328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.511386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1907 partition: 0 MaxSeqNo: 36 sessionId: src_id|cdcd9733-27d17e8a-b422497b-35569d13_0
2025-10-02T09:33:20.511635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6029c25-88c5274-6ed1bf90-7ef6ef25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cdcd9733-27d17e8a-b422497b-35569d13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.514298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Write session: try to update token
2025-10-02T09:33:20.514313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.520193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.520204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.520205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.520206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.520210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.520213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.520215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680897339:4638]
2025-10-02T09:33:20.520233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.520235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.520238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.520239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.520240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.520240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.520388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.527020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId: src_id|cdcd9733-27d17e8a-b422497b-35569d13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.529199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.587809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756454603:6623]
2025-10-02T09:33:20.587996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1906, pipe: [1:7556555153756454603:6623]
2025-10-02T09:33:20.630426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.630814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.630827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.630842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454603:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.630985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.631018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.631026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:20.631028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:20.631057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756454603:6623]
2025-10-02T09:33:20.631139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1907 reason: error at write: Disconnected sessionId: src_id|cdcd9733-27d17e8a-b422497b-35569d13_0
2025-10-02T09:33:20.631267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1907 sessionId: src_id|cdcd9733-27d17e8a-b422497b-35569d13_0 is DEAD
2025-10-02T09:33:20.631419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:20.631436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Write session will restart in 0.008783s
2025-10-02T09:33:20.631459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Write session: Do CDS request
2025-10-02T09:33:20.631464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.641221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.641410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.641419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1908
2025-10-02T09:33:20.641541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.641562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.641567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.641570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.641807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1908 sessionId:  describe result for acl check
2025-10-02T09:33:20.641820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.641830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.641836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.641837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.641841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756454806:6575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.642204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756454806:6575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.643312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.643444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.643451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.643458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.643470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756454806:6575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.643487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.643513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680897586:4646]
2025-10-02T09:33:20.643849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.643995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.644019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.644191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.644219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.644223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.644223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.644224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.644224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.644225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.644225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.644226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.644226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.644227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.644227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.644228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.644231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.644236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.644239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.644241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.644243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.644245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.644247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.644249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.644251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.644252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.644254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.644256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.644260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.644265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.644268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.644271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.644273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.644276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.644278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.644281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.644284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.644286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.644288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.644291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.644293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.644295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.644297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.644300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.644303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.644306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.644308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.644311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.644313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.644315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.644317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.644320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.644335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.648094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756454806:6575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.648103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756454806:6575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.648105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756454806:6575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.648108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.651654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.653085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.653094Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.653096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.653097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.653101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1907 [2:7556555153680897586:4646]
2025-10-02T09:33:20.653108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.653118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.653119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.653121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.653122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.653131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.653137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.653141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.653171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.653176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.653177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.653179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.653180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.653216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.653221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.653227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.653232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.653242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.653256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454846:6575], now have 1 active actors on pipe
2025-10-02T09:33:20.653261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454604:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.653265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.653266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.653267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.653275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.653285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.653287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.653289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.653290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.653295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.653297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.653290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1907
2025-10-02T09:33:20.653294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1907
2025-10-02T09:33:20.653311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.653316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.653317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.653326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.653331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.653442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70a947fc-ab445160-ef7e8687-3348a725_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.653449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.653452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.653453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.653458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.653463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.653477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.653583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.653588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.653595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.653648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1908 partition: 0 MaxSeqNo: 36 sessionId: src_id|70a947fc-ab445160-ef7e8687-3348a725_0
2025-10-02T09:33:20.653885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd9733-27d17e8a-b422497b-35569d13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|70a947fc-ab445160-ef7e8687-3348a725_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.656406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Write session: try to update token
2025-10-02T09:33:20.656420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.662407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.662419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.662420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.662420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.662425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.662428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.662430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680897580:4646]
2025-10-02T09:33:20.662449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.662451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.662453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.662453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.662459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.662462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.662574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.668666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId: src_id|70a947fc-ab445160-ef7e8687-3348a725_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.670993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.731170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756454854:6623]
2025-10-02T09:33:20.731338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1907, pipe: [1:7556555153756454854:6623]
2025-10-02T09:33:20.772611Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.772973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.772983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.772996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454854:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.773139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.773170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:20.773182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:20.773199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.773228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1908 reason: error at write: Disconnected sessionId: src_id|70a947fc-ab445160-ef7e8687-3348a725_0
2025-10-02T09:33:20.773234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756454854:6623]
2025-10-02T09:33:20.773375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1908 sessionId: src_id|70a947fc-ab445160-ef7e8687-3348a725_0 is DEAD
2025-10-02T09:33:20.773524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:20.773537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Write session will restart in 0.007863s
2025-10-02T09:33:20.773562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Write session: Do CDS request
2025-10-02T09:33:20.773567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.782197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.782294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.782303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1909
2025-10-02T09:33:20.782433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.782455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.782461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.782464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.782725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1909 sessionId:  describe result for acl check
2025-10-02T09:33:20.782749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.782753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.782754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.782757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756455010:6571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.783115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756455010:6571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.784313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756455010:6571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.784592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.786156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.786231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756455010:6571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.786240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756455010:6571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.786242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756455010:6571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.786246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.786265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.786271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.786277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.786306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.786330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680897828:4644]
2025-10-02T09:33:20.786665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.786841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.786863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.787036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.787065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.787068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.787069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.787069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.787070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.787070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.787071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.787071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.787072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.787072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.787073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.787074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.787076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.787082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.787084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.787086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.787088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.787090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.787092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.787093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.787095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.787097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.787099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.787101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.787105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.787109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.787112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.787115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.787117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.787119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.787121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.787124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.787126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.787129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.787131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.787133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.787135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.787138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.787140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.787143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.787145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.787148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.787150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.787153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.787155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.787158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.787160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.787162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.787179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.794594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.796239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.796250Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.796251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.796253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.796256Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1908 [2:7556555153680897828:4644]
2025-10-02T09:33:20.796263Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.796273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.796275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.796276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.796277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.796286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.796292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.796296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.796326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.796331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.796332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.796333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.796335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.796370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.796375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.796381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.796386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.796397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.796411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756454855:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.796416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756455094:6571], now have 1 active actors on pipe
2025-10-02T09:33:20.796420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.796421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.796422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.796430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.796440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.796446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.796448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.796450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.796450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.796452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.796466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.796474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.796458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1908
2025-10-02T09:33:20.796462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1908
2025-10-02T09:33:20.796477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.796500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.796505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.796519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.796525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.796528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.796529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.796534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.796543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.796554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.796636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.796642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.796651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.796707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1909 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0
2025-10-02T09:33:20.796966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a947fc-ab445160-ef7e8687-3348a725_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.799834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Write session: try to update token
2025-10-02T09:33:20.799853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.809620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:20.809631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.809635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.809658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:20.809658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:20.809793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:20.809909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:20.810026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:20.810140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:20.810372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:20.810397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:20.812623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId: src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.813831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.813842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.813843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.813844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.813848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.813851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.813853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680897822:4644]
2025-10-02T09:33:20.813870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.813870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.813873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.813875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.813877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.813878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.813984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.814934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:20.873499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555153756455113:6623]
2025-10-02T09:33:20.873623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1908, pipe: [1:7556555153756455113:6623]
2025-10-02T09:33:20.923805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:20.924139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.924148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.924161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756455113:6623], now have 1 active actors on pipe
2025-10-02T09:33:20.924283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:20.924311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:20.924327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:20.924345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555153756455113:6623]
2025-10-02T09:33:20.924376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1909 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0
2025-10-02T09:33:20.924514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1909 sessionId: src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0 is DEAD
2025-10-02T09:33:20.924679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:20.924695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Write session will restart in 0.008060s
2025-10-02T09:33:20.924717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Write session: Do CDS request
2025-10-02T09:33:20.924722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:20.934137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.934241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:20.934249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1910
2025-10-02T09:33:20.934357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:20.934377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:20.934383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:20.934386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:20.934632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1910 sessionId:  describe result for acl check
2025-10-02T09:33:20.934654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:20.934658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:20.934659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:20.934662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555153756455320:6559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:20.935020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:20.935034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555153756455320:6559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:20.936316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555153756455320:6559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:20.936533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:20.936623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:20.936629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:20.936635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:20.936661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:20.936683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555153680898084:4643]
2025-10-02T09:33:20.937027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:20.937194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:20.937215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:20.937388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:20.937416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.937420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.937420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.937421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.937421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.937422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.937422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.937423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.937424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.937424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.937425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.937425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.937428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.937434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.937436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.937438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.937440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.937442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.937444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.937446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.937448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.937450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.937452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.937454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.937457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.937461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:20.937464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.937467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:20.937469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.937472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:20.937474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.937477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:20.937479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.937482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:20.937484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.937487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:20.937489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.937495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:20.937498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.937500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:20.937502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.937505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:20.937507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.937510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.937512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.937518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.937520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.937522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.937540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:20.937806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555153756455320:6559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:20.937814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555153756455320:6559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:20.937816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555153756455320:6559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:20.937820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:20.944848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:20.946432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:20.946442Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:20.946443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:20.946444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:20.946448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1909 [2:7556555153680898084:4643]
2025-10-02T09:33:20.946455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:20.946463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:20.946465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.946467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.946468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.946476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:20.946483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:20.946487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:20.946515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.946520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.946521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.946522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:20.946523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:20.946557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:20.946562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.946568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:20.946573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:20.946581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:20.946591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756455360:6559], now have 1 active actors on pipe
2025-10-02T09:33:20.946597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555153756455117:2446], now have 1 active actors on pipe
2025-10-02T09:33:20.946600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.946601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.946602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.946609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:20.946619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:20.946621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:20.946627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:20.946628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:20.946628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:20.946629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:20.946624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1909
2025-10-02T09:33:20.946641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.946630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1909
2025-10-02T09:33:20.946646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:20.946648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:20.946661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.946666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.946693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:20.946701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:20.946703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:20.946704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:20.946708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:20.946716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:20.946727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.946834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:20.946839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:20.946847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:20.946900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1910 partition: 0 MaxSeqNo: 36 sessionId: src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0
2025-10-02T09:33:20.947136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4f7a9c-87de606d-b9ce594-e8a6558a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:20.949803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Write session: try to update token
2025-10-02T09:33:20.949818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:20.955622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:20.955633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:20.955634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:20.955635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:20.955638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.955640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.955642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555153680898077:4643]
2025-10-02T09:33:20.955660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:20.955664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:20.955665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:20.955667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:20.955670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:20.955672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:20.955770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:20.962323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId: src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:20.964498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.024542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051422676:6623]
2025-10-02T09:33:21.024735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1909, pipe: [1:7556555158051422676:6623]
2025-10-02T09:33:21.068165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.068404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.068414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.068427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051422676:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.068570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.068608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051422676:6623]
2025-10-02T09:33:21.068628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.068633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:21.068700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1910 reason: status is not ok: tablet will be restarted right now sessionId: src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0
2025-10-02T09:33:21.068887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1910 sessionId: src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0 is DEAD
2025-10-02T09:33:21.069045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:21.069061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Write session will restart in 0.008679s
2025-10-02T09:33:21.069089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Write session: Do CDS request
2025-10-02T09:33:21.069094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.079206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.079356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.079365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1911
2025-10-02T09:33:21.079482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.079503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.079511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.079514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.079692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.079826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1911 sessionId:  describe result for acl check
2025-10-02T09:33:21.079855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.079862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.079863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.079867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051422883:6555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.080319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051422883:6555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.081184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.081278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.081285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.081291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.081316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.081340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975865626:4631]
2025-10-02T09:33:21.081679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.081796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051422883:6555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.081834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.081857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.082047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.082077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.082081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.082081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.082082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.082082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.082083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.082083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.082084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.082084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.082085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.082085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.082086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.082089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.082095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.082097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.082099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.082101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.082103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.082105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.082107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.082108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.082111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.082113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.082114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.082118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.082122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.082125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.082128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.082130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.082132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.082134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.082137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.082139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.082142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.082145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.082147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.082150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.082152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.082154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.082157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.082160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.082162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.082164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.082167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.082169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.082171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.082173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.082176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.082194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.085987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051422883:6555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.085997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051422883:6555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.085999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051422883:6555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.086004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.089555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.091117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.091128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.091130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.091132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.091135Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1910 [2:7556555157975865626:4631]
2025-10-02T09:33:21.091145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.091157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.091162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.091163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.091164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.091172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.091175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.091179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.091210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.091215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.091216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.091218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.091219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.091323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1910
2025-10-02T09:33:21.091337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1910
2025-10-02T09:33:21.091368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.091374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.091380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.091386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.091396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.091410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051422677:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.091416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051422922:6555], now have 1 active actors on pipe
2025-10-02T09:33:21.091425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.091431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.091443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.091447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.091448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.091456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.091465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.091467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.091469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.091470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.091475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.091477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.091486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99190b3b-4657244f-128d7-8fad6139_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.091493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.091495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.091496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.091501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.091509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.091527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.091534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.091541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.091541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.091629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.091634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.091641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.091686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1911 partition: 0 MaxSeqNo: 36 sessionId: src_id|99190b3b-4657244f-128d7-8fad6139_0
2025-10-02T09:33:21.091953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132cd67e-a8b7d12a-cf2d1ac6-46d9fddc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99190b3b-4657244f-128d7-8fad6139_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.094566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Write session: try to update token
2025-10-02T09:33:21.094584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.100391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:21.100403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.100407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.100427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:21.100430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:21.100561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:21.100670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:21.100780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:21.100909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:21.101127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:21.101148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:21.108268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId: src_id|99190b3b-4657244f-128d7-8fad6139_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.108659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.108669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.108670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.108671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.108675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.108678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.108680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975865620:4631]
2025-10-02T09:33:21.108698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.108698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.108701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.108702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.108703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.108703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.108823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.110489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.168933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051422929:6623]
2025-10-02T09:33:21.169138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1910, pipe: [1:7556555158051422929:6623]
2025-10-02T09:33:21.220825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.221065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.221075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.221088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051422929:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.221233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.221244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.221281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051422929:6623]
2025-10-02T09:33:21.221286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:21.221356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1911 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99190b3b-4657244f-128d7-8fad6139_0
2025-10-02T09:33:21.221524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1911 sessionId: src_id|99190b3b-4657244f-128d7-8fad6139_0 is DEAD
2025-10-02T09:33:21.221700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:21.221713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Write session will restart in 0.008957s
2025-10-02T09:33:21.221735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Write session: Do CDS request
2025-10-02T09:33:21.221741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.232150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.232178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.232250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.232260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1912
2025-10-02T09:33:21.232370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.232392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.232398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.232402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.232704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1912 sessionId:  describe result for acl check
2025-10-02T09:33:21.232730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.232735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.232736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.232740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051423138:6551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.233237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051423138:6551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.233719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.233862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.233869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.233875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.233906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.233928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975865871:4629]
2025-10-02T09:33:21.234265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.234422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.234444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.234621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.234650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.234653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.234654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.234654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.234655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.234655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.234656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.234656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.234657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.234657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.234658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.234658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.234661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.234667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.234669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.234671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.234673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.234675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.234677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.234679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.234689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.234691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.234692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.234694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.234698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.234702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.234705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.234708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.234711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.234713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.234715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.234718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.234722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.234725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.234727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.234730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.234732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.234735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.234738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.234741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.234743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.234746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.234748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.234751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.234753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.234756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.234759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.234762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.234780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.234834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051423138:6551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.239545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051423138:6551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.239554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051423138:6551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.239558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051423138:6551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.239563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.242151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.243684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.243695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.243697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.243699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.243702Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1911 [2:7556555157975865871:4629]
2025-10-02T09:33:21.243709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.243718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.243722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.243723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.243724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.243732Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.243738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.243744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.243776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.243781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.243781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.243783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.243785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.243819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.243824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.243830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.243835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.243843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.243857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051422931:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.243863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423177:6551], now have 1 active actors on pipe
2025-10-02T09:33:21.243866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.243868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.243869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.243876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.243887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.243890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.243892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.243893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.243898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.243899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.243913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.243918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.243924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.243917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1911
2025-10-02T09:33:21.243919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1911
2025-10-02T09:33:21.243957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.243962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.243976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.243982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.243985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.243986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.243990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.243995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.244004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.244113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.244117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.244125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.244180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1912 partition: 0 MaxSeqNo: 36 sessionId: src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0
2025-10-02T09:33:21.244415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99190b3b-4657244f-128d7-8fad6139_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.246984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Write session: try to update token
2025-10-02T09:33:21.247001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.252955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.252966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.252967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.252968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.252972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.252974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.252976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975865865:4629]
2025-10-02T09:33:21.252996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.252999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.253000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.253001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.253004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.253006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.253109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.258967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId: src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.261189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.321503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051423186:6623]
2025-10-02T09:33:21.321672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1911, pipe: [1:7556555158051423186:6623]
2025-10-02T09:33:21.361102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.361428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.361437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.361449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423186:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.361566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.361575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.361604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:21.361604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051423186:6623]
2025-10-02T09:33:21.361650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1912 reason: status is not ok: tablet will be restarted right now sessionId: src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0
2025-10-02T09:33:21.361777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1912 sessionId: src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0 is DEAD
2025-10-02T09:33:21.361934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:21.361947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Write session will restart in 0.005779s
2025-10-02T09:33:21.361969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Write session: Do CDS request
2025-10-02T09:33:21.361975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.369216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.369286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.369295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1913
2025-10-02T09:33:21.369416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.369435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.369441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.369444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.369692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1913 sessionId:  describe result for acl check
2025-10-02T09:33:21.369715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.369720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.369721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.369724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051423301:6544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.370050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051423301:6544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.371782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051423301:6544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.372581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.374072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.374169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.374176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.374181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.374206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.374228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975866119:4613]
2025-10-02T09:33:21.374284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051423301:6544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.374294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051423301:6544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.374296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051423301:6544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.374299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.374662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.374823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.374847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.375014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.375044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.375047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.375048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.375048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.375049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.375050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.375050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.375051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.375051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.375051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.375052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.375052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.375055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.375061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.375063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.375065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.375067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.375069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.375071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.375073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.375075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.375077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.375079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.375081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.375085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.375088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.375092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.375095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.375097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.375100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.375102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.375104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.375107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.375109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.375111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.375114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.375116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.375119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.375121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.375123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.375126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.375129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.375131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.375133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.375135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.375138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.375140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.375142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.375159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.382474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.383888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.383899Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.383900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.383902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.383905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1912 [2:7556555157975866119:4613]
2025-10-02T09:33:21.383912Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.383921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.383923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.383924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.383925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.383934Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.383937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.383942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.383972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.383977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.383978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.383980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.383982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.384016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.384020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.384026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.384031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.384040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.384054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423188:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.384060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423431:6544], now have 1 active actors on pipe
2025-10-02T09:33:21.384063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.384064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.384065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.384072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.384080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.384085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.384087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.384088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.384091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.384089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1912
2025-10-02T09:33:21.384090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1912
2025-10-02T09:33:21.384092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.384103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.384104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.384106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.384120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.384122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.384138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.384146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.384147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.384149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.384153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.384158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.384171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.384268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.384273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.384280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.384331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1913 partition: 0 MaxSeqNo: 36 sessionId: src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0
2025-10-02T09:33:21.384599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b8f9e-184a3aba-70f2ed3e-5ab9745c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.387320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Write session: try to update token
2025-10-02T09:33:21.387335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.393163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.393174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.393176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.393177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.393181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.393183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.393185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975866112:4613]
2025-10-02T09:33:21.393205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.393208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.393209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.393209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.393212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.393214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.393314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.399368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId: src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.401554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.461777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051423464:6623]
2025-10-02T09:33:21.461975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1912, pipe: [1:7556555158051423464:6623]
2025-10-02T09:33:21.502436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.502849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.502858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.502871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423464:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.503022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051423464:6623]
2025-10-02T09:33:21.503034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:21.503043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:21.503052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.503099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1913 reason: error at write: Disconnected sessionId: src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0
2025-10-02T09:33:21.503194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.503247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1913 sessionId: src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0 is DEAD
2025-10-02T09:33:21.503399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:21.503414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Write session will restart in 0.005153s
2025-10-02T09:33:21.503440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Write session: Do CDS request
2025-10-02T09:33:21.503446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.509150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.509247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.509256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1914
2025-10-02T09:33:21.509394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.509415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.509421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.509424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.509695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1914 sessionId:  describe result for acl check
2025-10-02T09:33:21.509715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.509718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.509719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.509721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051423515:6528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.510064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051423515:6528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.511919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051423515:6528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.514520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051423515:6528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.514532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051423515:6528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.514534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051423515:6528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.514539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.515235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.516989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.517089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.517095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.517101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.517127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.517149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975866402:4604]
2025-10-02T09:33:21.517488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.517672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.517695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.517976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.518012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.518016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.518017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.518017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.518018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.518018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.518019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.518020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.518020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.518021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.518021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.518022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.518024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.518031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.518033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.518035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.518037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.518039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.518041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.518043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.518044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.518047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.518049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.518051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.518055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.518059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.518062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.518065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.518068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.518070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.518072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.518075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.518078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.518080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.518082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.518085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.518088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.518091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.518093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.518095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.518097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.518100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.518102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.518104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.518106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.518109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.518111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.518113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.518132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.525504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.526974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.526985Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.526986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.526988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.526992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1913 [2:7556555157975866402:4604]
2025-10-02T09:33:21.526998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.527008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.527013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.527015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.527016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.527025Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.527028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.527032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.527060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.527065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.527066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.527068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.527070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.527104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.527109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.527115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.527120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.527128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.527143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423465:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.527148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423708:6528], now have 1 active actors on pipe
2025-10-02T09:33:21.527152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.527153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.527154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.527161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.527172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.527174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.527176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.527177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.527181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.527183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.527197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.527185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1913
2025-10-02T09:33:21.527200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1913
2025-10-02T09:33:21.527201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.527203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.527220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.527225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.527241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.527247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.527249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.527251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.527255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.527261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.527269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.527367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.527372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.527380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.527433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1914 partition: 0 MaxSeqNo: 36 sessionId: src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0
2025-10-02T09:33:21.527725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cb63fb-32a5e274-ab029419-ce4723b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.530442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Write session: try to update token
2025-10-02T09:33:21.530463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.536252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.536264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.536265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.536266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.536270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.536272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.536277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975866397:4604]
2025-10-02T09:33:21.536296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.536298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.536299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.536299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.536302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.536303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.536413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.543244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId: src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.545467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.603110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051423724:6623]
2025-10-02T09:33:21.603279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1913, pipe: [1:7556555158051423724:6623]
2025-10-02T09:33:21.649368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.649668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.649678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.649690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423724:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.649829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.649837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:21.649848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:21.649871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051423724:6623]
2025-10-02T09:33:21.649889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.649893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1914 reason: error at write: Disconnected sessionId: src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0
2025-10-02T09:33:21.650023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1914 sessionId: src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0 is DEAD
2025-10-02T09:33:21.650173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:21.650187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Write session will restart in 0.005239s
2025-10-02T09:33:21.650208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Write session: Do CDS request
2025-10-02T09:33:21.650214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.656172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.656292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.656301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1915
2025-10-02T09:33:21.656429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.656448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.656454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.656456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.657028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1915 sessionId:  describe result for acl check
2025-10-02T09:33:21.657046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.657048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.657049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.657053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051423801:6520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.657383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051423801:6520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.659287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051423801:6520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.661056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.662752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.662844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051423801:6520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.662854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051423801:6520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.662856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051423801:6520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.662859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.662860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.662865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.662871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.662898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.662923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975866649:4602]
2025-10-02T09:33:21.663268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.663433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.663457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.663633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.663664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.663665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.663665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.663666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.663666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.663667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.663668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.663668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.663669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.663669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.663670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.663670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.663673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.663679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.663682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.663684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.663686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.663688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.663690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.663692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.663694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.663696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.663698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.663700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.663704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.663707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.663711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.663714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.663716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.663719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.663721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.663723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.663726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.663728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.663730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.663733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.663735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.663738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.663740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.663743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.663745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.663749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.663751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.663754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.663756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.663758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.663761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.663763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.663780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.671263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.672909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.672918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.672919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.672921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.672924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1914 [2:7556555157975866649:4602]
2025-10-02T09:33:21.672933Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.672943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.672944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.672946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.672947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.672955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.672958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.672962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.672992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.672997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.672998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.673000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.673001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.673099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1914
2025-10-02T09:33:21.673107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1914
2025-10-02T09:33:21.673161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.673167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.673173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.673180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.673190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.673204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423970:6520], now have 1 active actors on pipe
2025-10-02T09:33:21.673210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423725:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.673221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.673226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.673236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.673240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.673242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.673250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.673260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.673261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.673267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.673268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.673269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.673270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.673280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.673284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.673288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.673289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.673294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.673299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.673315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.673322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.673328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.673329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.673424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.673430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.673439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.673497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1915 partition: 0 MaxSeqNo: 36 sessionId: src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0
2025-10-02T09:33:21.673794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40f56a9-62c2f814-9a3ad013-e99e8c82_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.676452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Write session: try to update token
2025-10-02T09:33:21.676468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.682364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.682375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.682376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.682377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.682381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.682383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.682385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975866643:4602]
2025-10-02T09:33:21.682403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.682406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.682408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.682408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.682424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.682426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.682523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.688782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId: src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.690922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.750040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051423982:6623]
2025-10-02T09:33:21.750206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1914, pipe: [1:7556555158051423982:6623]
2025-10-02T09:33:21.790829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.791134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.791143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.791155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423982:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.791307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051423982:6623]
2025-10-02T09:33:21.791324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.791331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:21.791334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:21.791363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.791516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1915 reason: error at write: Disconnected sessionId: src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0
2025-10-02T09:33:21.791656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1915 sessionId: src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0 is DEAD
2025-10-02T09:33:21.791766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:21.791775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Write session will restart in 0.005947s
2025-10-02T09:33:21.791794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Write session: Do CDS request
2025-10-02T09:33:21.791798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.799285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.799347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.799356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1916
2025-10-02T09:33:21.799467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.799487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.799494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.799496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.799830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1916 sessionId:  describe result for acl check
2025-10-02T09:33:21.799848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.799853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.799854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.799857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051424099:6516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.800200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051424099:6516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.801888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051424099:6516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.802833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.804409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.804504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.804511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.804516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.804543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.804564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975866898:4599]
2025-10-02T09:33:21.804602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051424099:6516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.804611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051424099:6516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.804613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051424099:6516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.804616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.804911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.805062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.805084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.805259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.805288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.805292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.805293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.805293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.805294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.805294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.805295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.805295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.805296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.805296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.805297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.805297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.805300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.805305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.805307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.805309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.805311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.805314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.805315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.805317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.805319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.805322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.805323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.805326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.805330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.805334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.805337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.805340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.805342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.805345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.805347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.805350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.805353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.805356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.805362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.805364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.805366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.805369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.805371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.805374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.805376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.805379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.805382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.805384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.805389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.805392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.805394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.805396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.805413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.812737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.814227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.814238Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.814239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.814241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.814244Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1915 [2:7556555157975866898:4599]
2025-10-02T09:33:21.814252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.814261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.814262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.814263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.814264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.814274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.814277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.814281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.814308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.814314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.814315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.814316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.814318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.814354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.814359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.814365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.814370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.814380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.814394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051423983:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.814400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051424229:6516], now have 1 active actors on pipe
2025-10-02T09:33:21.814404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.814405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.814406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.814414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.814424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.814414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1915
2025-10-02T09:33:21.814426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.814428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.814429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.814434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.814436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.814439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1915
2025-10-02T09:33:21.814453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.814461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.814468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.814470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.814473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.814494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.814500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.814502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.814504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.814508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.814513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.814522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.814617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.814622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.814629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.814687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1916 partition: 0 MaxSeqNo: 36 sessionId: src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0
2025-10-02T09:33:21.814966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef27ad2-dbc3d8e-491b397f-4beb9d59_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.817713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Write session: try to update token
2025-10-02T09:33:21.817733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.823476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.823488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.823489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.823490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.823493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.823496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.823498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975866892:4599]
2025-10-02T09:33:21.823516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.823520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.823520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.823521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.823523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.823525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.823627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.830709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId: src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.832851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:21.891358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555158051424249:6623]
2025-10-02T09:33:21.891493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1915, pipe: [1:7556555158051424249:6623]
2025-10-02T09:33:21.932579Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:21.932784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.932792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.932814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051424249:6623], now have 1 active actors on pipe
2025-10-02T09:33:21.932916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555158051424249:6623]
2025-10-02T09:33:21.932933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:21.932937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:21.932952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:21.932964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:21.933007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1916 reason: error at write: Disconnected sessionId: src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0
2025-10-02T09:33:21.933149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1916 sessionId: src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0 is DEAD
2025-10-02T09:33:21.933315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:21.933329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Write session will restart in 0.008645s
2025-10-02T09:33:21.933353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Write session: Do CDS request
2025-10-02T09:33:21.933358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:21.943190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.943294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:21.943303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1917
2025-10-02T09:33:21.943422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:21.943441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:21.943448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:21.943450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:21.943704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1917 sessionId:  describe result for acl check
2025-10-02T09:33:21.943727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:21.943732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:21.943733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:21.943736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555158051424463:6497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:21.944079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555158051424463:6497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:21.944272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:21.945628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555158051424463:6497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:21.945918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:21.946018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:21.946025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:21.946031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:21.946058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:21.946081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555157975867160:4597]
2025-10-02T09:33:21.946410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:21.946567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:21.946589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:21.946861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:21.946905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.946909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.946910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.946910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.946911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.946911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.946912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.946912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.946913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.946913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.946914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.946914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.946917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.946923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.946925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.946927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.946929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.946931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.946933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.946935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.946937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.946939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.946941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.946943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.946947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.946951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:21.946954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.946957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:21.946959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.946962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:21.946964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.946966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:21.946969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.946972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:21.946974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.946976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:21.946978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.946981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:21.946983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.946986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:21.946988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.946992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:21.946994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.946996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.946999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.947001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.947003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.947009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.947025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:21.949819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555158051424463:6497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:21.949827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555158051424463:6497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:21.949828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555158051424463:6497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:21.949832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:21.954463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:21.955976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:21.955986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:21.955987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:21.955989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:21.955992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1916 [2:7556555157975867160:4597]
2025-10-02T09:33:21.955998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:21.956008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:21.956010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.956011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.956012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.956021Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:21.956023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:21.956028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:21.956055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.956061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.956062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.956063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:21.956065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:21.956104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:21.956108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.956115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:21.956120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:21.956128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:21.956139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051424253:2446], now have 1 active actors on pipe
2025-10-02T09:33:21.956143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555158051424504:6497], now have 1 active actors on pipe
2025-10-02T09:33:21.956146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.956148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.956149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.956157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:21.956163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:21.956170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:21.956172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:21.956173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:21.956173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:21.956175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:21.956188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.956193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:21.956194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:21.956173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1916
2025-10-02T09:33:21.956178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1916
2025-10-02T09:33:21.956209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.956214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.956232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:21.956239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:21.956241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:21.956242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:21.956247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:21.956255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:21.956267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.956349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:21.956354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:21.956361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:21.956409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1917 partition: 0 MaxSeqNo: 36 sessionId: src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0
2025-10-02T09:33:21.956648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9963a9ca-34be3c9d-f2699fd2-d2af449f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:21.959445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Write session: try to update token
2025-10-02T09:33:21.959460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:21.965140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:21.965151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:21.965152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:21.965153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:21.965156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.965159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.965163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555157975867154:4597]
2025-10-02T09:33:21.965182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:21.965188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:21.965190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:21.965199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:21.965203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:21.965205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:21.965297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:21.971472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId: src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:21.973624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.033172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346391820:6623]
2025-10-02T09:33:22.033322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1916, pipe: [1:7556555162346391820:6623]
2025-10-02T09:33:22.073814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.074170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.074180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.074192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346391820:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.074328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.074335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346391820:6623]
2025-10-02T09:33:22.074353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:22.074355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:22.074365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.074389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1917 reason: error at write: Disconnected sessionId: src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0
2025-10-02T09:33:22.074514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1917 sessionId: src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0 is DEAD
2025-10-02T09:33:22.074685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:22.074699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Write session will restart in 0.007578s
2025-10-02T09:33:22.074726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Write session: Do CDS request
2025-10-02T09:33:22.074731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.083178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.083278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.083286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1918
2025-10-02T09:33:22.083407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.083427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.083432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.083435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.083707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1918 sessionId:  describe result for acl check
2025-10-02T09:33:22.083732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.083738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.083739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.083742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346391979:6495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.084086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346391979:6495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.085340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346391979:6495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.085579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.087189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.087332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.087340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.087346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.087362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346391979:6495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.087369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346391979:6495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.087371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346391979:6495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.087374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.087377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.087402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270834709:4594]
2025-10-02T09:33:22.087737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.087892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.087917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.088096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.088124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.088128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.088129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.088130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.088130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.088131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.088131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.088132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.088133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.088133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.088134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.088134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.088137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.088143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.088145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.088147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.088149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.088151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.088153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.088156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.088158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.088160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.088162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.088163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.088167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.088171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.088178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.088181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.088184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.088186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.088189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.088191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.088194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.088196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.088199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.088202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.088204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.088206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.088209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.088211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.088215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.088217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.088220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.088221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.088224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.088226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.088229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.088245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.095801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.097218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.097229Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.097230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.097232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.097235Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1917 [2:7556555162270834709:4594]
2025-10-02T09:33:22.097242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.097252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.097254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.097256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.097256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.097266Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.097272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.097276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.097303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.097308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.097309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.097310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.097312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.097347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.097352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.097358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.097363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.097371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.097386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392069:6495], now have 1 active actors on pipe
2025-10-02T09:33:22.097391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346391821:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.097395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.097396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.097398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.097405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.097412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.097416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.097418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.097419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.097422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.097424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.097418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1917
2025-10-02T09:33:22.097419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1917
2025-10-02T09:33:22.097437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.097442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.097444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.097454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.097459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.097483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.097490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.097492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.097493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.097498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.097504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.097630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.097724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.097728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.097736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.097786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1918 partition: 0 MaxSeqNo: 36 sessionId: src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0
2025-10-02T09:33:22.098052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bd5e55-84542f35-de3ff9a9-235d76c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.100609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Write session: try to update token
2025-10-02T09:33:22.100624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.106427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.106438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.106439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.106440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.106443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.106445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.106449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270834703:4594]
2025-10-02T09:33:22.106466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.106469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.106471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.106474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.106474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.106475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.106622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:22.112948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId: src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.115077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.174490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346392080:6623]
2025-10-02T09:33:22.174632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1917, pipe: [1:7556555162346392080:6623]
2025-10-02T09:33:22.214269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.214632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.214641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.214652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392080:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.214766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.214780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.214784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:22.214787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:22.214809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346392080:6623]
2025-10-02T09:33:22.214831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1918 reason: error at write: Disconnected sessionId: src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0
2025-10-02T09:33:22.214958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1918 sessionId: src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0 is DEAD
2025-10-02T09:33:22.215116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:22.215130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Write session will restart in 0.005856s
2025-10-02T09:33:22.215156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Write session: Do CDS request
2025-10-02T09:33:22.215162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.222144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.222251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.222258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1919
2025-10-02T09:33:22.222375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.222394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.222400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.222402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.222690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1919 sessionId:  describe result for acl check
2025-10-02T09:33:22.222713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.222714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.222715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.222717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346392195:6491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.223063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346392195:6491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.224829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346392195:6491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.225707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.227333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.227439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.227444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.227450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.227464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346392195:6491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.227472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346392195:6491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.227474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346392195:6491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.227478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.227475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.227498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270834961:4592]
2025-10-02T09:33:22.227834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.227986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.228008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.228180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.228207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.228211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.228212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.228212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.228213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.228214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.228214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.228215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.228215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.228216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.228216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.228217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.228220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.228225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.228227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.228230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.228231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.228233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.228235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.228237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.228239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.228241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.228243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.228245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.228249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.228256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.228258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.228261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.228263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.228265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.228268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.228270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.228273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.228275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.228277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.228279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.228282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.228284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.228287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.228289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.228292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.228294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.228296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.228298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.228301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.228303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.228306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.228322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.235703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.237156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.237166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.237168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.237170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.237173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1918 [2:7556555162270834961:4592]
2025-10-02T09:33:22.237182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.237192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.237193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.237195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.237196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.237205Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.237209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.237215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.237246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.237250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.237252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.237253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.237255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.237350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1918
2025-10-02T09:33:22.237352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1918
2025-10-02T09:33:22.237460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.237467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.237474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.237480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.237490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.237505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392082:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.237510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392331:6491], now have 1 active actors on pipe
2025-10-02T09:33:22.237521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.237526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.237535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.237539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.237540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.237548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.237559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.237561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.237563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.237564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.237569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.237571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.237580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|595501f4-61b05e40-9d01e64f-d5580399_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.237587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.237590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.237591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.237596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.237605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.237621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.237629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.237636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.237637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.237719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.237724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.237732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.237775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1919 partition: 0 MaxSeqNo: 36 sessionId: src_id|595501f4-61b05e40-9d01e64f-d5580399_0
2025-10-02T09:33:22.238040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5976e3ca-61090a3f-672c65c-fe4fba63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|595501f4-61b05e40-9d01e64f-d5580399_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.240690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Write session: try to update token
2025-10-02T09:33:22.240706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.246655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.246666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.246668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.246669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.246672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.246675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.246677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270834955:4592]
2025-10-02T09:33:22.246705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.246706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.246709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.246709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.246710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.246711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.246823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:22.253121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId: src_id|595501f4-61b05e40-9d01e64f-d5580399_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.255236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.314768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346392344:6623]
2025-10-02T09:33:22.314901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1918, pipe: [1:7556555162346392344:6623]
2025-10-02T09:33:22.354071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.354275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.354284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.354296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392344:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.354410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.354423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:22.354431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:22.354448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346392344:6623]
2025-10-02T09:33:22.354459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.354467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1919 reason: error at write: Disconnected sessionId: src_id|595501f4-61b05e40-9d01e64f-d5580399_0
2025-10-02T09:33:22.354585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1919 sessionId: src_id|595501f4-61b05e40-9d01e64f-d5580399_0 is DEAD
2025-10-02T09:33:22.354732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:22.354745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Write session will restart in 0.006021s
2025-10-02T09:33:22.354767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Write session: Do CDS request
2025-10-02T09:33:22.354772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.362210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.362279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.362287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1920
2025-10-02T09:33:22.362408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.362426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.362432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.362434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.362810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1920 sessionId:  describe result for acl check
2025-10-02T09:33:22.362835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.362839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.362840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.362843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346392459:6481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.363182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346392459:6481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.365042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346392459:6481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.366021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.367532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.367629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.367635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.367641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.367666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.367689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270835214:4590]
2025-10-02T09:33:22.367684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346392459:6481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.367691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346392459:6481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.367693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346392459:6481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.367697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.368022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.368176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.368199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.368373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.368403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.368408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.368408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.368409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.368409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.368410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.368410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.368411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.368411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.368412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.368412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.368413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.368416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.368422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.368424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.368426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.368428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.368430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.368431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.368433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.368435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.368437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.368439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.368441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.368445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.368449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.368452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.368455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.368457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.368460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.368462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.368465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.368467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.368470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.368472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.368475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.368477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.368479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.368482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.368486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.368489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.368491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.368493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.368496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.368498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.368501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.368503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.368506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.368522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.375895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.377450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.377459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.377461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.377463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.377466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1919 [2:7556555162270835214:4590]
2025-10-02T09:33:22.377473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.377482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.377483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.377485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.377486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.377495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.377497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.377502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.377530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.377535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.377537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.377538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.377540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.377573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.377578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.377584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.377590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.377600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.377613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392346:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.377618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392596:6481], now have 1 active actors on pipe
2025-10-02T09:33:22.377622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.377623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.377624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.377631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.377641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.377643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.377645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.377646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.377652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.377653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.377642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1919
2025-10-02T09:33:22.377646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1919
2025-10-02T09:33:22.377667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.377671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.377672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.377683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.377688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.377712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1af3db9-954ba312-a9601a67-d26383a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.377718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.377720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.377721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.377726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.377731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.377739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.377833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.377838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.377845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.377893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1920 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1af3db9-954ba312-a9601a67-d26383a0_0
2025-10-02T09:33:22.378157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595501f4-61b05e40-9d01e64f-d5580399_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1af3db9-954ba312-a9601a67-d26383a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.380867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Write session: try to update token
2025-10-02T09:33:22.380884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.386696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.386706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.386707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.386708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.386711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.386714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.386716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270835208:4590]
2025-10-02T09:33:22.386735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.386738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.386739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.386739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.386742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.386744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.386841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:22.393210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId: src_id|e1af3db9-954ba312-a9601a67-d26383a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.395331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.454545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346392620:6623]
2025-10-02T09:33:22.454668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1919, pipe: [1:7556555162346392620:6623]
2025-10-02T09:33:22.496014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.496291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.496300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.496311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392620:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.496446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.496477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.496482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:22.496519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346392620:6623]
2025-10-02T09:33:22.496529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1920 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1af3db9-954ba312-a9601a67-d26383a0_0
2025-10-02T09:33:22.496675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1920 sessionId: src_id|e1af3db9-954ba312-a9601a67-d26383a0_0 is DEAD
2025-10-02T09:33:22.496863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:22.496880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Write session will restart in 0.008248s
2025-10-02T09:33:22.496910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Write session: Do CDS request
2025-10-02T09:33:22.496916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.506197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.506264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.506273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1921
2025-10-02T09:33:22.506399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.506420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.506425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.506428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.506696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1921 sessionId:  describe result for acl check
2025-10-02T09:33:22.506719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.506723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.506725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.506727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346392809:6466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.507062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346392809:6466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.508272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.508860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346392809:6466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.509958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.510060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.510066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.510072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.510098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.510120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270835504:4569]
2025-10-02T09:33:22.510464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.510643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.510665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.510755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346392809:6466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.510763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346392809:6466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.510765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346392809:6466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.510768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.510852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.510882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.510886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.510886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.510887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.510887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.510888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.510888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.510889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.510890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.510890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.510891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.510891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.510894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.510900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.510902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.510904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.510906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.510908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.510910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.510912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.510914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.510917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.510919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.510921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.510924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.510928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.510932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.510935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.510937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.510940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.510942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.510945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.510947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.510950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.510952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.510955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.510957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.510960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.510961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.510964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.510968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.510971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.510973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.510976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.510978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.510981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.510984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.510987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.511004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.518549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.520146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.520156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.520158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.520159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.520162Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1920 [2:7556555162270835504:4569]
2025-10-02T09:33:22.520169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.520177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.520178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.520180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.520181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.520190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.520193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.520198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.520227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.520232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.520233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.520235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.520236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.520270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.520275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.520282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.520287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.520297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.520309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392884:6466], now have 1 active actors on pipe
2025-10-02T09:33:22.520314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392630:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.520318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.520319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.520320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.520327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.520334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.520340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.520342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.520343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.520344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.520345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.520344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1920
2025-10-02T09:33:22.520351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1920
2025-10-02T09:33:22.520358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.520363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.520365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.520377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.520382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.520402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95eff780-184670bb-86640c6a-8f0c749d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.520409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.520413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.520414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.520419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.520427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.520441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.520527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.520533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.520540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.520588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1921 partition: 0 MaxSeqNo: 36 sessionId: src_id|95eff780-184670bb-86640c6a-8f0c749d_0
2025-10-02T09:33:22.520858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1af3db9-954ba312-a9601a67-d26383a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95eff780-184670bb-86640c6a-8f0c749d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.523451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Write session: try to update token
2025-10-02T09:33:22.523465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.529458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.529470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.529472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.529473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.529478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.529481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.529483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270835498:4569]
2025-10-02T09:33:22.529505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.529506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.529509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.529510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.529514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.529517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.529718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:22.535791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId: src_id|95eff780-184670bb-86640c6a-8f0c749d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.537922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.596881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346392893:6623]
2025-10-02T09:33:22.597020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1920, pipe: [1:7556555162346392893:6623]
2025-10-02T09:33:22.640008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.640211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.640220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.640232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392893:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.640359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.640378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:22.640389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:22.640407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346392893:6623]
2025-10-02T09:33:22.640421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.640430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1921 reason: error at write: Disconnected sessionId: src_id|95eff780-184670bb-86640c6a-8f0c749d_0
2025-10-02T09:33:22.640556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1921 sessionId: src_id|95eff780-184670bb-86640c6a-8f0c749d_0 is DEAD
2025-10-02T09:33:22.640713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:22.640726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Write session will restart in 0.005008s
2025-10-02T09:33:22.640750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Write session: Do CDS request
2025-10-02T09:33:22.640756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.647209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.647286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.647295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1922
2025-10-02T09:33:22.647428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.647447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.647454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.647456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.647797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1922 sessionId:  describe result for acl check
2025-10-02T09:33:22.647818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.647822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.647823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.647826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346392965:6457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.648165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346392965:6457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.649901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346392965:6457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.651973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346392965:6457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.651982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346392965:6457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.651984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346392965:6457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.651987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.652215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.653823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.653928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.653935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.653941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.653966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.653999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270835760:4563]
2025-10-02T09:33:22.654351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.654512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.654536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.654721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.654752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.654756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.654756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.654757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.654758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.654758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.654759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.654759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.654760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.654760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.654761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.654761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.654764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.654770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.654772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.654774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.654775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.654777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.654779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.654781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.654783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.654785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.654787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.654789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.654792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.654796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.654800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.654803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.654805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.654807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.654810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.654813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.654815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.654817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.654820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.654822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.654825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.654828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.654830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.654833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.654836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.654839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.654841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.654843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.654845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.654848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.654852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.654854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.654872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.662237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.663863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.663875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.663876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.663878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.663881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1921 [2:7556555162270835760:4563]
2025-10-02T09:33:22.663889Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.663900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.663901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.663903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.663903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.663913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.663918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.663923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.663953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.663958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.663959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.663962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.663963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.663999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.664004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.664009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.664014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.664022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.664034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393144:6457], now have 1 active actors on pipe
2025-10-02T09:33:22.664039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346392894:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.664042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.664044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.664045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.664052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.664061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.664064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.664066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.664067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.664069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.664071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.664085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.664090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.664091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.664074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1921
2025-10-02T09:33:22.664087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1921
2025-10-02T09:33:22.664099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.664104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.664129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.664136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.664138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.664139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.664144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.664152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.664161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.664245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.664250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.664257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.664308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1922 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0
2025-10-02T09:33:22.664571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95eff780-184670bb-86640c6a-8f0c749d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.667211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Write session: try to update token
2025-10-02T09:33:22.667227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.673225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.673237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.673239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.673240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.673243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.673246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.673248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270835754:4563]
2025-10-02T09:33:22.673267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.673270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.673271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.673273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.673276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.673278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.673384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:22.679306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId: src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.681465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.740791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346393158:6623]
2025-10-02T09:33:22.740963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1921, pipe: [1:7556555162346393158:6623]
2025-10-02T09:33:22.782277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.782653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.782663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.782675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393158:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.782817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.782815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:22.782823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:22.782855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346393158:6623]
2025-10-02T09:33:22.782864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1922 reason: error at write: Disconnected sessionId: src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0
2025-10-02T09:33:22.782875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.782989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1922 sessionId: src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0 is DEAD
2025-10-02T09:33:22.783117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:22.783127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Write session will restart in 0.006380s
2025-10-02T09:33:22.783142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Write session: Do CDS request
2025-10-02T09:33:22.783147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.790231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.790296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.790303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1923
2025-10-02T09:33:22.790424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.790444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.790450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.790452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.790742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1923 sessionId:  describe result for acl check
2025-10-02T09:33:22.790768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.790772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.790773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.790776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346393246:6451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.791156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346393246:6451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.792721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346393246:6451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.794741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.796296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.796386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346393246:6451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.796395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346393246:6451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.796396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346393246:6451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.796401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.796392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.796399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.796405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.796430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.796453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270836015:4559]
2025-10-02T09:33:22.796789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.796963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.796985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.797157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.797186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.797190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.797190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.797191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.797191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.797192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.797192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.797193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.797194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.797194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.797195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.797195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.797198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.797204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.797206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.797208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.797210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.797212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.797214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.797216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.797218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.797220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.797222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.797224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.797227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.797231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.797234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.797237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.797239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.797242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.797244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.797247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.797249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.797252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.797254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.797257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.797259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.797262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.797263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.797266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.797268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.797272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.797274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.797276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.797278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.797283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.797285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.797287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.797303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.804632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.806107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.806118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.806119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.806121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.806124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1922 [2:7556555162270836015:4559]
2025-10-02T09:33:22.806131Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.806141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.806146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.806147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.806148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.806156Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.806160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.806165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.806192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.806197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.806198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.806199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.806201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.806236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.806241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.806247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.806253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.806264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.806276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393412:6451], now have 1 active actors on pipe
2025-10-02T09:33:22.806281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393159:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.806285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.806286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.806287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.806295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.806304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.806307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.806309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.806310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.806315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.806316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.806309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1922
2025-10-02T09:33:22.806312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1922
2025-10-02T09:33:22.806329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.806334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.806335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.806343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.806348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.806374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dd8e865-4992c516-da960dcf-301f9d09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.806381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.806383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.806384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.806390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.806397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.806406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.806489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.806494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.806501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.806551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1923 partition: 0 MaxSeqNo: 36 sessionId: src_id|5dd8e865-4992c516-da960dcf-301f9d09_0
2025-10-02T09:33:22.806799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf6d10f-fe4f5677-9dc33aaf-a33abbe8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5dd8e865-4992c516-da960dcf-301f9d09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.809545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Write session: try to update token
2025-10-02T09:33:22.809561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.815354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.815366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.815367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.815367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.815371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.815373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.815376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270836010:4559]
2025-10-02T09:33:22.815395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.815397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.815399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.815399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.815402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.815403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.815512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:22.822261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId: src_id|5dd8e865-4992c516-da960dcf-301f9d09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.824412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.883086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555162346393429:6623]
2025-10-02T09:33:22.883214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1922, pipe: [1:7556555162346393429:6623]
2025-10-02T09:33:22.924360Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:22.924564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.924572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.924585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393429:6623], now have 1 active actors on pipe
2025-10-02T09:33:22.924711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:22.924713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:22.924740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555162346393429:6623]
2025-10-02T09:33:22.924747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:22.924751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:22.924814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1923 reason: error at write: Disconnected sessionId: src_id|5dd8e865-4992c516-da960dcf-301f9d09_0
2025-10-02T09:33:22.924976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1923 sessionId: src_id|5dd8e865-4992c516-da960dcf-301f9d09_0 is DEAD
2025-10-02T09:33:22.925146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:22.925162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Write session will restart in 0.006582s
2025-10-02T09:33:22.925192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Write session: Do CDS request
2025-10-02T09:33:22.925199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:22.933167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.933243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:22.933250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1924
2025-10-02T09:33:22.933402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:22.933421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:22.933427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:22.933430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:22.933689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1924 sessionId:  describe result for acl check
2025-10-02T09:33:22.933707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:22.933712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:22.933713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:22.933716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555162346393561:6437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:22.934056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555162346393561:6437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:22.935971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555162346393561:6437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:22.936599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:22.938137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:22.938233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:22.938240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:22.938246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:22.938271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:22.938293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555162270836284:4554]
2025-10-02T09:33:22.938326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555162346393561:6437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:22.938334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555162346393561:6437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:22.938336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555162346393561:6437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:22.938339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:22.938627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:22.938795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:22.938818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:22.938989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:22.939016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.939020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.939021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.939021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.939022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.939022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.939023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.939023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.939024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.939025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.939025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.939026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.939028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.939034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.939036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.939038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.939040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.939042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.939044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.939046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.939048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.939050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.939052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.939054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.939058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.939062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:22.939065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.939068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:22.939070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.939073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:22.939075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.939078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:22.939080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.939082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:22.939085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.939087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:22.939089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.939092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:22.939096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.939099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:22.939101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.939103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:22.939105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.939108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.939111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.939114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.939116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.939118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.939134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:22.946510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:22.948074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:22.948084Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:22.948085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:22.948087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:22.948091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1923 [2:7556555162270836284:4554]
2025-10-02T09:33:22.948098Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:22.948108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:22.948109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.948111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.948112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.948121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:22.948128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:22.948132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:22.948160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.948165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.948167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.948168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:22.948170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:22.948273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1923
2025-10-02T09:33:22.948281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1923
2025-10-02T09:33:22.948347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:22.948352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.948359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:22.948365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:22.948374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:22.948388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393433:2446], now have 1 active actors on pipe
2025-10-02T09:33:22.948393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555162346393687:6437], now have 1 active actors on pipe
2025-10-02T09:33:22.948404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.948407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.948416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.948421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.948422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.948430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:22.948441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:22.948443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:22.948445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:22.948446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:22.948452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:22.948454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:22.948463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b6c3b79-92bea358-27412577-650fe435_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:22.948470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:22.948472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:22.948473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:22.948478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:22.948484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:22.948498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.948505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:22.948512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.948513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:22.948597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:22.948602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:22.948610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:22.948679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1924 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b6c3b79-92bea358-27412577-650fe435_0
2025-10-02T09:33:22.948911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd8e865-4992c516-da960dcf-301f9d09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b6c3b79-92bea358-27412577-650fe435_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:22.951707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Write session: try to update token
2025-10-02T09:33:22.951718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:22.957503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:22.957516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.957520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.957545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:22.957548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:22.957676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:22.957795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:22.957913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:22.958030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:22.958194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:22.958218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:22.963865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId: src_id|3b6c3b79-92bea358-27412577-650fe435_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:22.965895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:22.965909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:22.965910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:22.965911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:22.965916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.965919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.965921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555162270836279:4554]
2025-10-02T09:33:22.965940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:22.965942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:22.965943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:22.965945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:22.965946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:22.965948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:22.966006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:22.966058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.024918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641361007:6623]
2025-10-02T09:33:23.025104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1923, pipe: [1:7556555166641361007:6623]
2025-10-02T09:33:23.075027Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.075386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.075396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.075409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361007:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.075571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.075581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:23.075590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:23.075609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641361007:6623]
2025-10-02T09:33:23.075629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.075633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1924 reason: error at write: Disconnected sessionId: src_id|3b6c3b79-92bea358-27412577-650fe435_0
2025-10-02T09:33:23.075765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1924 sessionId: src_id|3b6c3b79-92bea358-27412577-650fe435_0 is DEAD
2025-10-02T09:33:23.075914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:23.075929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Write session will restart in 0.005825s
2025-10-02T09:33:23.075950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Write session: Do CDS request
2025-10-02T09:33:23.075955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.083132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.083262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.083272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1925
2025-10-02T09:33:23.083398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.083419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.083425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.083428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.083718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1925 sessionId:  describe result for acl check
2025-10-02T09:33:23.083741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.083742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.083743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.083746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641361090:6436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.084089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641361090:6436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.086262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641361090:6436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.087885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.089368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.089459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641361090:6436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.089466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641361090:6436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.089468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641361090:6436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.089471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.089474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.089481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.089486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.089512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.089535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565803840:4549]
2025-10-02T09:33:23.089871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.090026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.090047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.090216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.090246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.090249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.090250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.090251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.090251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.090252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.090252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.090253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.090253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.090254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.090254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.090255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.090257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.090263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.090265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.090267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.090269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.090271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.090273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.090275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.090277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.090279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.090281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.090283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.090286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.090290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.090293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.090296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.090298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.090300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.090303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.090305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.090307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.090310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.090314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.090316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.090318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.090321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.090323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.090326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.090329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.090332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.090334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.090337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.090340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.090346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.090348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.090351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.090367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.097774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.099440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.099450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.099451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.099453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.099456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1924 [2:7556555166565803840:4549]
2025-10-02T09:33:23.099463Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.099474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.099479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.099481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.099482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.099490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.099493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.099497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.099525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.099530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.099531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.099533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.099534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.099570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.099575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.099581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.099586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.099595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.099608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.099612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.099613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.099618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.099625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361263:6436], now have 1 active actors on pipe
2025-10-02T09:33:23.099626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.099628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.099628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361008:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.099629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.099633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.099639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.099641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.099654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.099662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.099672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.099655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1924
2025-10-02T09:33:23.099697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.099673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1924
2025-10-02T09:33:23.099702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.099715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.099721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.099723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.099724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.099729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.099734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.099742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.099835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.099840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.099848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.099908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1925 partition: 0 MaxSeqNo: 36 sessionId: src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0
2025-10-02T09:33:23.100203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b6c3b79-92bea358-27412577-650fe435_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.102928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Write session: try to update token
2025-10-02T09:33:23.102944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.108722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.108733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.108734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.108735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.108738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.108740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.108742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565803835:4549]
2025-10-02T09:33:23.108761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.108764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.108765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.108766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.108769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.108771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.108895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.115305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId: src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.117422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:23.175975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641361274:6623]
2025-10-02T09:33:23.176133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1924, pipe: [1:7556555166641361274:6623]
2025-10-02T09:33:23.217529Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.217742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.217750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.217763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361274:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.217901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.217907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.217908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:23.217911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:23.217938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641361274:6623]
2025-10-02T09:33:23.218051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1925 reason: error at write: Disconnected sessionId: src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0
2025-10-02T09:33:23.218180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1925 sessionId: src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0 is DEAD
2025-10-02T09:33:23.218330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:23.218345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Write session will restart in 0.009420s
2025-10-02T09:33:23.218381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Write session: Do CDS request
2025-10-02T09:33:23.218387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.229239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.229306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.229315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1926
2025-10-02T09:33:23.229468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.229488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.229491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.229493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.229543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.229752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1926 sessionId:  describe result for acl check
2025-10-02T09:33:23.229770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.229771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.229772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.229775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641361498:6428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.230106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641361498:6428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.231162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.231256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.231262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.231268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.231294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.231316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565804099:4547]
2025-10-02T09:33:23.231615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641361498:6428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.231648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.231809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.231831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.232000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.232028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.232030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.232031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.232031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.232032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.232032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.232033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.232033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.232034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.232034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.232035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.232035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.232038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.232044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.232047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.232049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.232051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.232053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.232054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.232056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.232059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.232061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.232063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.232065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.232068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.232072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.232075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.232078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.232080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.232083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.232085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.232088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.232091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.232093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.232095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.232098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.232100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.232102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.232104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.232107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.232109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.232111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.232113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.232116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.232118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.232121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.232122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.232125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.232142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.235867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641361498:6428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.235876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641361498:6428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.235878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641361498:6428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.235881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.239514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.241152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.241164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.241165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.241167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.241170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1925 [2:7556555166565804099:4547]
2025-10-02T09:33:23.241177Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.241186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.241187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.241189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.241190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.241198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.241204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.241209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.241238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.241243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.241244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.241246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.241247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.241280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.241285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.241291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.241297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.241305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.241318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361536:6428], now have 1 active actors on pipe
2025-10-02T09:33:23.241323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361276:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.241326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.241328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.241328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.241336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.241344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.241347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.241349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.241350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.241355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.241343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1925
2025-10-02T09:33:23.241357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.241348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1925
2025-10-02T09:33:23.241371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.241376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.241377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.241385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.241387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.241412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.241419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.241422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.241423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.241428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.241433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.241444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.241537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.241542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.241549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.241603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1926 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0
2025-10-02T09:33:23.241845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712c711e-6194a85f-c904d3b0-e1f5b977_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.244391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Write session: try to update token
2025-10-02T09:33:23.244406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.250412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.250424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.250425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.250426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.250431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.250432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.250434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565804093:4547]
2025-10-02T09:33:23.250453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.250454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.250456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.250457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.250458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.250460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.250563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.256621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId: src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.258704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:23.318290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641361545:6623]
2025-10-02T09:33:23.318439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1925, pipe: [1:7556555166641361545:6623]
2025-10-02T09:33:23.358016Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.358222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.358230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.358242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361545:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.358359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.358387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:23.358396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641361545:6623]
2025-10-02T09:33:23.358397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:23.358409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.358435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1926 reason: error at write: Disconnected sessionId: src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0
2025-10-02T09:33:23.358546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1926 sessionId: src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0 is DEAD
2025-10-02T09:33:23.358712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:23.358726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Write session will restart in 0.005291s
2025-10-02T09:33:23.358748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Write session: Do CDS request
2025-10-02T09:33:23.358753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.365180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.365312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.365319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1927
2025-10-02T09:33:23.365432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.365450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.365455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.365457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.365709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1927 sessionId:  describe result for acl check
2025-10-02T09:33:23.365732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.365734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.365734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.365737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641361617:6423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.366080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641361617:6423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.367554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641361617:6423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.369499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641361617:6423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.369507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641361617:6423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.369508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641361617:6423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.369512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.370330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.371917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.372012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.372018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.372024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.372049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.372073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565804360:4545]
2025-10-02T09:33:23.372404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.372553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.372575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.372746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.372775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.372779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.372780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.372780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.372781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.372781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.372782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.372782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.372783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.372783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.372784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.372784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.372787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.372793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.372795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.372797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.372810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.372812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.372813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.372815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.372817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.372820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.372821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.372823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.372828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.372832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.372835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.372838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.372841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.372843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.372845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.372848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.372850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.372853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.372855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.372858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.372860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.372863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.372865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.372867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.372869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.372872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.372875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.372878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.372880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.372882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.372884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.372887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.372903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.380222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.381771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.381782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.381783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.381785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.381788Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1926 [2:7556555166565804360:4545]
2025-10-02T09:33:23.381795Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.381805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.381810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.381811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.381812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.381821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.381823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.381828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.381857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.381861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.381863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.381864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.381866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.381902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.381907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.381914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.381919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.381927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.381940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361800:6423], now have 1 active actors on pipe
2025-10-02T09:33:23.381946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361547:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.381949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.381950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.381952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.381960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.381966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.381970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.381972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.381973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.381977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.381979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.381969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1926
2025-10-02T09:33:23.381992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.381976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1926
2025-10-02T09:33:23.381997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.381998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.382008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.382010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.382032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.382038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.382040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.382042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.382046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.382053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.382064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.382154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.382159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.382167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.382223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1927 partition: 0 MaxSeqNo: 36 sessionId: src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0
2025-10-02T09:33:23.382494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a86f698-3daaf10e-cc61ec0-32c130fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.385060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Write session: try to update token
2025-10-02T09:33:23.385074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.390869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.390880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.390881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.390882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.390886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.390889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.390891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565804355:4545]
2025-10-02T09:33:23.390909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.390911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.390913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.390914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.390914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.390916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.391022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.397216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId: src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.399279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:23.458599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641361815:6623]
2025-10-02T09:33:23.458810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1926, pipe: [1:7556555166641361815:6623]
2025-10-02T09:33:23.501721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.502107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.502117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.502128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361815:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.502204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641361815:6623]
2025-10-02T09:33:23.502223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:23.502224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:23.502257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1927 reason: error at write: Disconnected sessionId: src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0
2025-10-02T09:33:23.502259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.502404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1927 sessionId: src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0 is DEAD
2025-10-02T09:33:23.502440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.502556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:23.502570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Write session will restart in 0.005922s
2025-10-02T09:33:23.502594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Write session: Do CDS request
2025-10-02T09:33:23.502599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.509165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.509257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.509264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1928
2025-10-02T09:33:23.509375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.509392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.509398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.509400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.509663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1928 sessionId:  describe result for acl check
2025-10-02T09:33:23.509686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.509690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.509691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.509694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641361924:6402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.509990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641361924:6402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.511738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641361924:6402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.513847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641361924:6402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.513855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641361924:6402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.513857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641361924:6402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.513860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.513870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.515521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.515625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.515631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.515637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.515664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.515684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565804657:4523]
2025-10-02T09:33:23.516016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.516179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.516201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.516375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.516402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.516406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.516407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.516407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.516408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.516408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.516409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.516409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.516410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.516410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.516411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.516411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.516414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.516420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.516422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.516424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.516426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.516428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.516430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.516432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.516434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.516436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.516437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.516439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.516443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.516447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.516450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.516453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.516455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.516457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.516459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.516462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.516464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.516467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.516469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.516472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.516474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.516477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.516479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.516481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.516483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.516486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.516488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.516490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.516493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.516496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.516500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.516502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.516518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.523888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.525516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.525528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.525529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.525531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.525535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1927 [2:7556555166565804657:4523]
2025-10-02T09:33:23.525541Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.525551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.525552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.525554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.525555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.525564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.525568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.525572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.525603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.525608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.525609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.525611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.525612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.525649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.525656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.525662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.525667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.525675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.525690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362096:6402], now have 1 active actors on pipe
2025-10-02T09:33:23.525695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641361841:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.525699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.525700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.525701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.525709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.525717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.525722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.525724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.525725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.525727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.525729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.525716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1927
2025-10-02T09:33:23.525742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.525743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.525724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1927
2025-10-02T09:33:23.525745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.525753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.525757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.525781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39295f4-871e049-8753dfdd-6e482ee4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.525788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.525790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.525791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.525796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.525802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.525812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.525908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.525913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.525921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.525979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1928 partition: 0 MaxSeqNo: 36 sessionId: src_id|39295f4-871e049-8753dfdd-6e482ee4_0
2025-10-02T09:33:23.526245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddb7ffc-5baa73d1-65019a20-3d5cf121_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|39295f4-871e049-8753dfdd-6e482ee4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.528754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Write session: try to update token
2025-10-02T09:33:23.528767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.534790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.534802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.534804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.534804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.534808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.534811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.534813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565804650:4523]
2025-10-02T09:33:23.534832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.534833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.534835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.534835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.534836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.534837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.534948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.540705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId: src_id|39295f4-871e049-8753dfdd-6e482ee4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.542814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:23.602481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641362108:6623]
2025-10-02T09:33:23.602637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1927, pipe: [1:7556555166641362108:6623]
2025-10-02T09:33:23.643905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.644122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.644131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.644144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362108:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.644275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.644286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641362108:6623]
2025-10-02T09:33:23.644291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:23.644293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:23.644310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.644337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1928 reason: error at write: Disconnected sessionId: src_id|39295f4-871e049-8753dfdd-6e482ee4_0
2025-10-02T09:33:23.644461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1928 sessionId: src_id|39295f4-871e049-8753dfdd-6e482ee4_0 is DEAD
2025-10-02T09:33:23.644619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:23.644633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Write session will restart in 0.006734s
2025-10-02T09:33:23.644653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Write session: Do CDS request
2025-10-02T09:33:23.644659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.652180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.652300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.652308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1929
2025-10-02T09:33:23.652427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.652449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.652454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.652456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.652883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1929 sessionId:  describe result for acl check
2025-10-02T09:33:23.652906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.652907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.652908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.652911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641362227:6397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.653247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641362227:6397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.654942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641362227:6397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.656062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.657689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.657787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.657793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.657799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.657825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.657848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565804918:4522]
2025-10-02T09:33:23.657867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641362227:6397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.657875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641362227:6397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.657876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641362227:6397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.657880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.658181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.658332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.658355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.658525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.658554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.658558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.658559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.658559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.658560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.658560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.658561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.658561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.658562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.658562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.658563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.658564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.658566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.658572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.658574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.658576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.658578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.658580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.658582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.658584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.658586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.658588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.658590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.658592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.658595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.658598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.658602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.658605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.658607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.658609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.658611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.658614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.658616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.658619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.658621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.658624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.658626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.658629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.658631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.658634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.658636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.658639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.658641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.658643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.658646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.658649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.658651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.658653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.658670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.666084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.667743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.667756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.667757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.667759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.667764Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1928 [2:7556555166565804918:4522]
2025-10-02T09:33:23.667773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.667782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.667785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.667786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.667787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.667797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.667800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.667804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.667836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.667840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.667841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.667844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.667845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.667882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.667886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.667893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.667898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.667906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.667921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362368:6397], now have 1 active actors on pipe
2025-10-02T09:33:23.667926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362109:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.667930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.667932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.667933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.667940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.667948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.667952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.667954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.667955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.667958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.667960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.667973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.667979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.667983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.667967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1928
2025-10-02T09:33:23.667974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1928
2025-10-02T09:33:23.668006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.668011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.668027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3534f877-185d86dc-e6703761-aac35ad2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.668035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.668037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.668042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.668047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.668052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.668063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.668168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.668172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.668180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.668240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1929 partition: 0 MaxSeqNo: 36 sessionId: src_id|3534f877-185d86dc-e6703761-aac35ad2_0
2025-10-02T09:33:23.668486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39295f4-871e049-8753dfdd-6e482ee4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3534f877-185d86dc-e6703761-aac35ad2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.671071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Write session: try to update token
2025-10-02T09:33:23.671086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.677088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.677100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.677101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.677102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.677106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.677109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.677111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565804913:4522]
2025-10-02T09:33:23.677129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.677131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.677132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.677132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.677134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.677135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.677272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.683244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId: src_id|3534f877-185d86dc-e6703761-aac35ad2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.685318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:23.744284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641362380:6623]
2025-10-02T09:33:23.744432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1928, pipe: [1:7556555166641362380:6623]
2025-10-02T09:33:23.784814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.785018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.785026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.785039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362380:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.785149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.785191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641362380:6623]
2025-10-02T09:33:23.785192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:23.785210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.785241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1929 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3534f877-185d86dc-e6703761-aac35ad2_0
2025-10-02T09:33:23.785367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1929 sessionId: src_id|3534f877-185d86dc-e6703761-aac35ad2_0 is DEAD
2025-10-02T09:33:23.785527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:23.785540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Write session will restart in 0.008988s
2025-10-02T09:33:23.785562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Write session: Do CDS request
2025-10-02T09:33:23.785568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.795163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.795281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.795288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1930
2025-10-02T09:33:23.795386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.795405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.795412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.795415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.795688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1930 sessionId:  describe result for acl check
2025-10-02T09:33:23.795709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.795710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.795711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.795713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641362572:6391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.796035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641362572:6391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.797170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.797347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641362572:6391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.798852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.798950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.798956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.798962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.798987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.799010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565805181:4520]
2025-10-02T09:33:23.799055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641362572:6391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.799063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641362572:6391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.799065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641362572:6391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.799069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.799353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.799502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.799524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.799696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.799725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.799728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.799729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.799730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.799730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.799731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.799731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.799732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.799732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.799733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.799733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.799734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.799736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.799742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.799744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.799746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.799748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.799750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.799752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.799754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.799756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.799759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.799760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.799762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.799766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.799769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.799772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.799775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.799777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.799780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.799782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.799785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.799787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.799790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.799791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.799794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.799796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.799799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.799801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.799804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.799806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.799809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.799811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.799813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.799815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.799818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.799820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.799822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.799840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.807247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.808765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.808776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.808778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.808780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.808783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1929 [2:7556555166565805181:4520]
2025-10-02T09:33:23.808791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.808815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.808818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.808819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.808820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.808829Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.808833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.808837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.808866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.808872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.808873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.808875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.808876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.808917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.808922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.808928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.808933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.808944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.808957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362381:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.808962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362641:6391], now have 1 active actors on pipe
2025-10-02T09:33:23.808965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.808966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.808967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.808975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.808982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.808988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.808990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.808991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.808991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.808992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.809005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.809007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.808992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1929
2025-10-02T09:33:23.809012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.809025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.808998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1929
2025-10-02T09:33:23.809027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.809043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.809050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.809053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.809054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.809059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.809066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.809073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.809184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.809189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.809196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.809256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1930 partition: 0 MaxSeqNo: 36 sessionId: src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0
2025-10-02T09:33:23.809518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3534f877-185d86dc-e6703761-aac35ad2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.812104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Write session: try to update token
2025-10-02T09:33:23.812117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.818053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.818065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.818066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.818067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.818071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.818074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.818076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565805176:4520]
2025-10-02T09:33:23.818095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.818097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.818098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.818099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.818100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.818102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.818202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.824011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId: src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.826021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:23.885086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555166641362658:6623]
2025-10-02T09:33:23.885209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1929, pipe: [1:7556555166641362658:6623]
2025-10-02T09:33:23.928542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:23.928774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.928782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.928796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362658:6623], now have 1 active actors on pipe
2025-10-02T09:33:23.928928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:23.928967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:23.928975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:23.929007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555166641362658:6623]
2025-10-02T09:33:23.929029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1930 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0
2025-10-02T09:33:23.929165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1930 sessionId: src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0 is DEAD
2025-10-02T09:33:23.929349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:23.929365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Write session will restart in 0.006413s
2025-10-02T09:33:23.929391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Write session: Do CDS request
2025-10-02T09:33:23.929398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:23.937306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.937337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:23.937345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1931
2025-10-02T09:33:23.937496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:23.937517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:23.937521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:23.937524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:23.937880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1931 sessionId:  describe result for acl check
2025-10-02T09:33:23.937902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:23.937903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:23.937904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:23.937907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555166641362768:6385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:23.938229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555166641362768:6385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:23.940118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555166641362768:6385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:23.941402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:23.943028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:23.943113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555166641362768:6385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:23.943121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555166641362768:6385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:23.943123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555166641362768:6385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:23.943126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:23.943144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:23.943151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:23.943157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:23.943186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:23.943209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555166565805457:4513]
2025-10-02T09:33:23.943544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:23.943699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:23.943721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:23.943896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:23.943925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.943929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.943929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.943930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.943930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.943931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.943931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.943932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.943932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.943933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.943933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.943934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.943936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.943942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.943944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.943946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.943948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.943950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.943952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.943954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.943956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.943958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.943960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.943962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.943967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.943970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:23.943974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.943976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:23.943978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.943981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:23.943983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.943986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:23.943988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.943991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:23.943993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.943995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:23.943997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.944000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:23.944002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.944004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:23.944006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.944009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:23.944011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.944013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.944016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.944018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.944020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.944023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.944040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:23.951521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:23.953128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:23.953139Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:23.953140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:23.953142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:23.953145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1930 [2:7556555166565805457:4513]
2025-10-02T09:33:23.953152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:23.953161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:23.953163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.953164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.953165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.953174Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:23.953177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:23.953182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:23.953213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.953218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.953219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.953221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:23.953222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:23.953258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:23.953263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.953269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:23.953275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:23.953284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:23.953298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362662:2446], now have 1 active actors on pipe
2025-10-02T09:33:23.953303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555166641362923:6385], now have 1 active actors on pipe
2025-10-02T09:33:23.953306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.953308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.953309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.953316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:23.953328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:23.953330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:23.953332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:23.953334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:23.953335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:23.953337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:23.953350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.953353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:23.953350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1930
2025-10-02T09:33:23.953357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1930
2025-10-02T09:33:23.953369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:23.953374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.953377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.953390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|427978b5-48078139-7602e3aa-ceb2652d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:23.953395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:23.953397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:23.953398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:23.953403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:23.953412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:23.953419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.953506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:23.953511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:23.953518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:23.953571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1931 partition: 0 MaxSeqNo: 36 sessionId: src_id|427978b5-48078139-7602e3aa-ceb2652d_0
2025-10-02T09:33:23.953841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f335e4d4-3acfd473-7ded9ede-d9ef7a08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|427978b5-48078139-7602e3aa-ceb2652d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:23.956453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Write session: try to update token
2025-10-02T09:33:23.956464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:23.962410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:23.962421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:23.962422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:23.962423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:23.962427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.962429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.962431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555166565805452:4513]
2025-10-02T09:33:23.962449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:23.962450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:23.962451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:23.962452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:23.962453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:23.962456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:23.962556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:23.968426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId: src_id|427978b5-48078139-7602e3aa-ceb2652d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:23.970478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.028947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936330243:6623]
2025-10-02T09:33:24.029124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1930, pipe: [1:7556555170936330243:6623]
2025-10-02T09:33:24.072044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.072427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.072436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.072449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330243:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.072564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.072586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936330243:6623]
2025-10-02T09:33:24.072612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.072614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:24.072663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1931 reason: status is not ok: tablet will be restarted right now sessionId: src_id|427978b5-48078139-7602e3aa-ceb2652d_0
2025-10-02T09:33:24.072784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1931 sessionId: src_id|427978b5-48078139-7602e3aa-ceb2652d_0 is DEAD
2025-10-02T09:33:24.072929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:24.072944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Write session will restart in 0.009905s
2025-10-02T09:33:24.072965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Write session: Do CDS request
2025-10-02T09:33:24.072971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.084319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.084491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.084491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.084497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1932
2025-10-02T09:33:24.084614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.084633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.084637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.084641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.084920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1932 sessionId:  describe result for acl check
2025-10-02T09:33:24.084943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.084947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.084949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.084952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936330472:6380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.085292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936330472:6380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.086111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.086215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.086222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.086227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.086254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.086276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860773020:4502]
2025-10-02T09:33:24.086612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.086635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936330472:6380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.086776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.086797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.086970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.086998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.087002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.087002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.087003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.087003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.087004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.087004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.087005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.087005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.087006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.087006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.087007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.087010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.087016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.087018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.087020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.087022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.087024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.087026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.087028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.087030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.087032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.087033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.087035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.087039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.087042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.087046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.087049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.087051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.087054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.087056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.087059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.087061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.087064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.087066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.087068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.087071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.087074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.087076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.087078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.087080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.087084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.087087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.087091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.087093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.087096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.087098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.087100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.087115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.090870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936330472:6380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.090877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936330472:6380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.090879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936330472:6380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.090883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.094490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.096079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.096090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.096091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.096093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.096096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1931 [2:7556555170860773020:4502]
2025-10-02T09:33:24.096106Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.096118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.096122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.096123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.096124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.096134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.096140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.096144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.096174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.096178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.096179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.096182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.096183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.096219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.096223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.096229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.096234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.096246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.096259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330244:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.096264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330510:6380], now have 1 active actors on pipe
2025-10-02T09:33:24.096268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.096269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.096270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.096277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.096288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.096290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.096292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.096293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.096298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.096300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.096302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1931
2025-10-02T09:33:24.096314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.096318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.096306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1931
2025-10-02T09:33:24.096327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.096338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.096342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.096355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.096362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.096364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.096365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.096370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.096377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.096384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.096471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.096475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.096482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.096540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1932 partition: 0 MaxSeqNo: 36 sessionId: src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0
2025-10-02T09:33:24.096815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427978b5-48078139-7602e3aa-ceb2652d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.099531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Write session: try to update token
2025-10-02T09:33:24.099545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.105259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.105271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.105272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.105273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.105277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.105279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.105281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860773015:4502]
2025-10-02T09:33:24.105300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.105303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.105306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.105307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.105308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.105308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.105417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.112177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId: src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.114327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.172828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936330517:6623]
2025-10-02T09:33:24.172980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1931, pipe: [1:7556555170936330517:6623]
2025-10-02T09:33:24.213203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.213572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.213580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.213593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330517:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.213723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.213729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:24.213740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:24.213746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936330517:6623]
2025-10-02T09:33:24.213759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.213781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1932 reason: error at write: Disconnected sessionId: src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0
2025-10-02T09:33:24.213908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1932 sessionId: src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0 is DEAD
2025-10-02T09:33:24.214038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:24.214052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Write session will restart in 0.008421s
2025-10-02T09:33:24.214083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Write session: Do CDS request
2025-10-02T09:33:24.214090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.223168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.223254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.223263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1933
2025-10-02T09:33:24.223396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.223416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.223418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.223422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.223778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1933 sessionId:  describe result for acl check
2025-10-02T09:33:24.223803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.223808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.223809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.223811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936330675:6370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.224154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936330675:6370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.225581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936330675:6370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.226141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.227743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.227842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.227849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.227855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.227882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.227903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860773286:4494]
2025-10-02T09:33:24.227974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936330675:6370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.227986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936330675:6370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.227989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936330675:6370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.227993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.228234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.228414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.228584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.228611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.228615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.228616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.228616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.228617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.228617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.228618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.228618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.228619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.228619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.228620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.228620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.228623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.228628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.228630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.228632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.228634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.228636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.228638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.228640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.228642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.228644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.228646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.228648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.228651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.228655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.228658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.228661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.228663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.228666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.228668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.228671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.228673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.228676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.228678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.228682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.228684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.228687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.228690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.228693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.228699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.228701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.228704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.228707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.228709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.228711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.228715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.228717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.228734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.236091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.237613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.237625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.237626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.237628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.237631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1932 [2:7556555170860773286:4494]
2025-10-02T09:33:24.237638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.237648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.237649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.237651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.237651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.237660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.237666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.237670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.237697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.237701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.237702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.237703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.237705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.237739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.237744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.237750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.237755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.237763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.237776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330782:6370], now have 1 active actors on pipe
2025-10-02T09:33:24.237781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330519:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.237785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.237787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.237788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.237795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.237803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.237806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.237808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.237809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.237813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.237814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.237805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1932
2025-10-02T09:33:24.237812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1932
2025-10-02T09:33:24.237828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.237833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.237834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.237842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.237847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.237873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.237879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.237881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.237882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.237887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.237894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.237905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.237985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.237990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.237997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.238054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1933 partition: 0 MaxSeqNo: 36 sessionId: src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0
2025-10-02T09:33:24.238321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db321a7-1ee7e070-6a2df4a4-d044c601_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.240930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Write session: try to update token
2025-10-02T09:33:24.240944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.246836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.246847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.246848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.246849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.246852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.246855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.246857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860773281:4494]
2025-10-02T09:33:24.246874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.246876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.246878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.246878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.246879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.246880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.246985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.253490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId: src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.255602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.314130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936330795:6623]
2025-10-02T09:33:24.314268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1932, pipe: [1:7556555170936330795:6623]
2025-10-02T09:33:24.354735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.354936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.354945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.354957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330795:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.355082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936330795:6623]
2025-10-02T09:33:24.355097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.355100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:24.355102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:24.355117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.355149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1933 reason: error at write: Disconnected sessionId: src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0
2025-10-02T09:33:24.355278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1933 sessionId: src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0 is DEAD
2025-10-02T09:33:24.355611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:24.355626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Write session will restart in 0.008239s
2025-10-02T09:33:24.355647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Write session: Do CDS request
2025-10-02T09:33:24.355652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.365167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.365272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.365280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1934
2025-10-02T09:33:24.365400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.365420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.365426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.365428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.365750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1934 sessionId:  describe result for acl check
2025-10-02T09:33:24.365775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.365779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.365780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.365782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936330996:6366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.366135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936330996:6366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.367214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.367753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936330996:6366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.368962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.369059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.369066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.369071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.369097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.369118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860773553:4495]
2025-10-02T09:33:24.369260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936330996:6366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.369267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936330996:6366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.369269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936330996:6366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.369272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.369454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.369605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.369628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.369799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.369828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.369832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.369832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.369833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.369833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.369834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.369834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.369835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.369835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.369836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.369837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.369837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.369840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.369846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.369848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.369850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.369852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.369854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.369856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.369858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.369860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.369863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.369864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.369866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.369870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.369873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.369877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.369879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.369881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.369884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.369886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.369889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.369891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.369894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.369896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.369899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.369901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.369904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.369906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.369909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.369911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.369914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.369916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.369919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.369921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.369923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.369926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.369929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.369946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.377236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.378731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.378741Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.378743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.378744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.378748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1933 [2:7556555170860773553:4495]
2025-10-02T09:33:24.378755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.378763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.378769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.378771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.378772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.378780Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.378783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.378787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.378816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.378821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.378822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.378824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.378825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.378867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.378874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.378884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.378893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.378910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.378927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936330797:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.378932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331061:6366], now have 1 active actors on pipe
2025-10-02T09:33:24.378923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1933
2025-10-02T09:33:24.378926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1933
2025-10-02T09:33:24.378936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.378937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.378938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.378943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.378948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.378950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.378951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.378951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.378959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.378960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.378975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.378979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.378997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.379005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.379012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.379014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61eb3a49-d79664f9-53ffb623-659df41e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.379018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.379020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.379021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.379027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.379032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.379049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.379143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.379148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.379156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.379206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1934 partition: 0 MaxSeqNo: 36 sessionId: src_id|61eb3a49-d79664f9-53ffb623-659df41e_0
2025-10-02T09:33:24.379450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65379c8-e7864311-c90ed52a-b3fb3458_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61eb3a49-d79664f9-53ffb623-659df41e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.382110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Write session: try to update token
2025-10-02T09:33:24.382129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.387995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.388007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.388009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.388010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.388014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.388016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.388018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860773548:4495]
2025-10-02T09:33:24.388037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.388038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.388040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.388040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.388041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.388041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.388155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.394396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId: src_id|61eb3a49-d79664f9-53ffb623-659df41e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.396504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.455449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936331072:6623]
2025-10-02T09:33:24.455610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1933, pipe: [1:7556555170936331072:6623]
2025-10-02T09:33:24.496083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.496307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.496317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.496330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331072:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.496475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.496486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.496506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:24.496508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:24.496516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936331072:6623]
2025-10-02T09:33:24.496550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1934 reason: error at write: Disconnected sessionId: src_id|61eb3a49-d79664f9-53ffb623-659df41e_0
2025-10-02T09:33:24.496683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1934 sessionId: src_id|61eb3a49-d79664f9-53ffb623-659df41e_0 is DEAD
2025-10-02T09:33:24.496841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:24.496855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Write session will restart in 0.007647s
2025-10-02T09:33:24.496876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Write session: Do CDS request
2025-10-02T09:33:24.496881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.505175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.505248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.505259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1935
2025-10-02T09:33:24.505412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.505431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.505437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.505439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.505674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1935 sessionId:  describe result for acl check
2025-10-02T09:33:24.505694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.505698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.505701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.505703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936331204:6352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.505941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936331204:6352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.507686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936331204:6352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.510925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.511021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936331204:6352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.511032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936331204:6352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.511033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936331204:6352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.511036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.511185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.511278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.511284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.511290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.511317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.511338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860773835:4493]
2025-10-02T09:33:24.511685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.511843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.511866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.512042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.512067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.512071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.512072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.512072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.512073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.512074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.512074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.512075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.512075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.512076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.512076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.512077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.512080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.512085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.512087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.512089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.512091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.512094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.512096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.512098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.512100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.512102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.512104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.512105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.512109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.512113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.512116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.512119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.512121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.512125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.512128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.512130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.512133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.512135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.512137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.512140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.512143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.512145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.512148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.512151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.512153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.512156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.512159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.512161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.512164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.512166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.512168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.512175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.512192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.519564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.521033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.521044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.521045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.521047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.521050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1934 [2:7556555170860773835:4493]
2025-10-02T09:33:24.521057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.521065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.521067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.521068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.521070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.521079Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.521082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.521086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.521115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.521120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.521121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.521123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.521124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.521169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.521175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.521182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.521187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.521197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.521210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331073:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.521216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331350:6352], now have 1 active actors on pipe
2025-10-02T09:33:24.521220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.521221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.521222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.521229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.521233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.521235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.521237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.521238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.521222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1934
2025-10-02T09:33:24.521244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1934
2025-10-02T09:33:24.521245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.521248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.521264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.521272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.521279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.521280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.521282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.521303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.521310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.521312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.521313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.521318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.521323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.521334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.521417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.521422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.521429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.521470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1935 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0
2025-10-02T09:33:24.521732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61eb3a49-d79664f9-53ffb623-659df41e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.524346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Write session: try to update token
2025-10-02T09:33:24.524358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.530358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.530373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.530374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.530375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.530378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.530380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.530382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860773829:4493]
2025-10-02T09:33:24.530402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.530404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.530406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.530408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.530408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.530409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.530521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.536502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId: src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.538623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.596766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936331372:6623]
2025-10-02T09:33:24.597277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1934, pipe: [1:7556555170936331372:6623]
2025-10-02T09:33:24.640016Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.640821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.640832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.640845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331372:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.640987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.641023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:24.641040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.641043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:24.641070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936331372:6623]
2025-10-02T09:33:24.641087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1935 reason: error at write: Disconnected sessionId: src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0
2025-10-02T09:33:24.641205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1935 sessionId: src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0 is DEAD
2025-10-02T09:33:24.641377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:24.641391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Write session will restart in 0.008448s
2025-10-02T09:33:24.641418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Write session: Do CDS request
2025-10-02T09:33:24.641423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.651158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.651256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.651264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1936
2025-10-02T09:33:24.651375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.651395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.651400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.651403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.651668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1936 sessionId:  describe result for acl check
2025-10-02T09:33:24.651686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.651690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.651692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.651695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936331573:6345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.652196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936331573:6345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.653057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.653422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936331573:6345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.654693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.654797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.654806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.654813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.654842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.654864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860774126:4469]
2025-10-02T09:33:24.655195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.655346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.655369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.655533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936331573:6345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.655542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936331573:6345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.655544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936331573:6345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.655547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.655543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.655572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.655576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.655577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.655577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.655578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.655578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.655579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.655579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.655580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.655580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.655581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.655582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.655584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.655590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.655592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.655594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.655596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.655597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.655600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.655602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.655603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.655605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.655607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.655609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.655613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.655616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.655619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.655622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.655624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.655627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.655629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.655632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.655635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.655638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.655640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.655643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.655645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.655648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.655650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.655653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.655655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.655657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.655660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.655662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.655664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.655667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.655669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.655672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.655689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.663033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.664529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.664541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.664542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.664544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.664547Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1935 [2:7556555170860774126:4469]
2025-10-02T09:33:24.664553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.664563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.664568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.664570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.664570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.664579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.664582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.664586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.664615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.664620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.664621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.664623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.664624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.664659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.664663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.664670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.664675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.664683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.664697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331373:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.664704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.664705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.664706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.664711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.664719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.664723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.664725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.664727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.664728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.664729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.664732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331641:6345], now have 1 active actors on pipe
2025-10-02T09:33:24.664732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1935
2025-10-02T09:33:24.664745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.664748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.664749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.664773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1935
2025-10-02T09:33:24.664822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.664828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.664842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86635aa8-c85aafeb-51581c25-294470ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.664849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.664852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.664853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.664858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.664865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.664873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.664974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.664978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.664986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.665041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1936 partition: 0 MaxSeqNo: 36 sessionId: src_id|86635aa8-c85aafeb-51581c25-294470ef_0
2025-10-02T09:33:24.665330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee1ba48-7516e37-a2164c2d-41968a36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86635aa8-c85aafeb-51581c25-294470ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.667862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Write session: try to update token
2025-10-02T09:33:24.667876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.673825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.673837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.673838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.673839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.673843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.673845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.673847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860774121:4469]
2025-10-02T09:33:24.673865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.673868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.673869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.673870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.673872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.673874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.674050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.679708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId: src_id|86635aa8-c85aafeb-51581c25-294470ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.681799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.741152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936331651:6623]
2025-10-02T09:33:24.741306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1935, pipe: [1:7556555170936331651:6623]
2025-10-02T09:33:24.781749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.782243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.782252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.782263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331651:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.782392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.782430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936331651:6623]
2025-10-02T09:33:24.782449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.782452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:24.782509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1936 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86635aa8-c85aafeb-51581c25-294470ef_0
2025-10-02T09:33:24.782639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1936 sessionId: src_id|86635aa8-c85aafeb-51581c25-294470ef_0 is DEAD
2025-10-02T09:33:24.782801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:24.782816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Write session will restart in 0.005634s
2025-10-02T09:33:24.782844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Write session: Do CDS request
2025-10-02T09:33:24.782851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.789141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.789272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.789280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1937
2025-10-02T09:33:24.789392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.789413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.789420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.789422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.789739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1937 sessionId:  describe result for acl check
2025-10-02T09:33:24.789762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.789763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.789764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.789767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936331731:6342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.790111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936331731:6342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.792142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936331731:6342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.794233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936331731:6342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.794241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936331731:6342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.794243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936331731:6342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.794246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.794519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.796061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.796164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.796172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.796177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.796203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.796224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860774397:4458]
2025-10-02T09:33:24.796561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.796713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.796737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.796926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.796957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.796961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.796962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.796962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.796963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.796963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.796964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.796964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.796965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.796965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.796966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.796966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.796969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.796975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.796977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.796979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.796981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.796983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.796985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.796986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.796988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.796990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.796992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.796994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.796998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.797001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.797004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.797007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.797009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.797012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.797014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.797017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.797019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.797022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.797024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.797026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.797028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.797032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.797034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.797038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.797040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.797044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.797046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.797048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.797052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.797054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.797056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.797059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.797076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.804694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.806247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.806259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.806260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.806262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.806266Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1936 [2:7556555170860774397:4458]
2025-10-02T09:33:24.806273Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.806283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.806284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.806286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.806287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.806295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.806298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.806304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.806335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.806340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.806341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.806342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.806344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.806378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.806383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.806389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.806394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.806404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.806418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331917:6342], now have 1 active actors on pipe
2025-10-02T09:33:24.806423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331652:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.806426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.806428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.806429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.806436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.806444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.806448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.806450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.806451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.806454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.806456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.806470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.806475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.806459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1936
2025-10-02T09:33:24.806466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1936
2025-10-02T09:33:24.806476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.806491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.806493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.806510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.806517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.806519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.806520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.806526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.806535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.806549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.806636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.806641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.806648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.806719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1937 partition: 0 MaxSeqNo: 36 sessionId: src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0
2025-10-02T09:33:24.806974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86635aa8-c85aafeb-51581c25-294470ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.809523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Write session: try to update token
2025-10-02T09:33:24.809540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.815877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.815888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.815890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.815890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.815894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.815896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.815898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860774392:4458]
2025-10-02T09:33:24.815917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.815919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.815920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.815921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.815923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.815925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.816021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.821549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId: src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.823622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:24.882459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555170936331936:6623]
2025-10-02T09:33:24.882604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1936, pipe: [1:7556555170936331936:6623]
2025-10-02T09:33:24.924523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:24.924725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.924734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.924746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331936:6623], now have 1 active actors on pipe
2025-10-02T09:33:24.924880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:24.924871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:24.924881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:24.924880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555170936331936:6623]
2025-10-02T09:33:24.924892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:24.924931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1937 reason: error at write: Disconnected sessionId: src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0
2025-10-02T09:33:24.925060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1937 sessionId: src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0 is DEAD
2025-10-02T09:33:24.925213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:24.925227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Write session will restart in 0.009279s
2025-10-02T09:33:24.925252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Write session: Do CDS request
2025-10-02T09:33:24.925257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:24.935184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.935277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:24.935284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1938
2025-10-02T09:33:24.935406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:24.935426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:24.935431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:24.935434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:24.935701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1938 sessionId:  describe result for acl check
2025-10-02T09:33:24.935724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:24.935727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:24.935728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:24.935731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555170936332135:6333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:24.936065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555170936332135:6333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:24.937251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:24.937560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555170936332135:6333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:24.939036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:24.939132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:24.939138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:24.939144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:24.939169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:24.939187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555170860774679:4465]
2025-10-02T09:33:24.939206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555170936332135:6333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:24.939213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555170936332135:6333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:24.939215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555170936332135:6333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:24.939218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:24.939524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:24.939677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:24.939699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:24.939871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:24.939899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.939903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.939904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.939905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.939905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.939906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.939906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.939907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.939907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.939908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.939908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.939909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.939911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.939917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.939919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.939921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.939923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.939925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.939926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.939928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.939930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.939932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.939934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.939936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.939940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.939943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:24.939946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.939949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:24.939951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.939954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:24.939956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.939959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:24.939961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.939963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:24.939965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.939968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:24.939972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.939974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:24.939977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.939979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:24.939981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.939984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:24.939986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.939990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.939992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.939994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.939996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.939999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.940013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:24.947425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:24.948991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:24.949001Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:24.949002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:24.949004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:24.949008Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1937 [2:7556555170860774679:4465]
2025-10-02T09:33:24.949015Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:24.949024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:24.949030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.949031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.949032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.949041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:24.949043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:24.949047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:24.949078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.949083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.949084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.949087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:24.949088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:24.949124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:24.949128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.949134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:24.949143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:24.949151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:24.949165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936332207:6333], now have 1 active actors on pipe
2025-10-02T09:33:24.949170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555170936331940:2446], now have 1 active actors on pipe
2025-10-02T09:33:24.949174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.949175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.949176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.949183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:24.949191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:24.949196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:24.949197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:24.949198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:24.949202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:24.949203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:24.949219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.949223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:24.949226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:24.949207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1937
2025-10-02T09:33:24.949208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1937
2025-10-02T09:33:24.949243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.949248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.949265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deebaba8-6c5d1444-726b62ec-a5663061_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:24.949271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:24.949273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:24.949275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:24.949279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:24.949286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:24.949294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.949382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:24.949387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:24.949394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:24.949455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1938 partition: 0 MaxSeqNo: 36 sessionId: src_id|deebaba8-6c5d1444-726b62ec-a5663061_0
2025-10-02T09:33:24.949704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8855cc0-b0ef663c-7d489aab-ed5b8680_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|deebaba8-6c5d1444-726b62ec-a5663061_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:24.952403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Write session: try to update token
2025-10-02T09:33:24.952420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:24.958193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:24.958205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:24.958206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:24.958207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:24.958211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.958213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.958216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555170860774674:4465]
2025-10-02T09:33:24.958235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:24.958236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:24.958238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:24.958238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:24.958239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:24.958240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:24.958343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:24.964814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId: src_id|deebaba8-6c5d1444-726b62ec-a5663061_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:24.966891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.024786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231299528:6623]
2025-10-02T09:33:25.024957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1937, pipe: [1:7556555175231299528:6623]
2025-10-02T09:33:25.067106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.067579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.067589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.067601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231299528:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.067705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.067747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231299528:6623]
2025-10-02T09:33:25.067755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.067759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.067768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.067806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1938 reason: error at write: Disconnected sessionId: src_id|deebaba8-6c5d1444-726b62ec-a5663061_0
2025-10-02T09:33:25.067938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1938 sessionId: src_id|deebaba8-6c5d1444-726b62ec-a5663061_0 is DEAD
2025-10-02T09:33:25.068113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.068128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Write session will restart in 0.005126s
2025-10-02T09:33:25.068148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Write session: Do CDS request
2025-10-02T09:33:25.068154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.074148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.074314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.074322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1939
2025-10-02T09:33:25.074475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.074495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.074501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.074504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.074801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1939 sessionId:  describe result for acl check
2025-10-02T09:33:25.074823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.074824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.074825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.074827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231299577:6324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.075175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231299577:6324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.077070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231299577:6324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.079240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231299577:6324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.079249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231299577:6324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.079250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231299577:6324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.079254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.080769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.082403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.082505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.082512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.082518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.082543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.082563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155742250:4462]
2025-10-02T09:33:25.082909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.083062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.083084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.083253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.083283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.083287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.083288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.083288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.083289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.083289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.083290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.083290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.083291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.083291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.083292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.083292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.083295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.083301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.083303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.083305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.083307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.083309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.083311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.083313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.083315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.083317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.083319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.083321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.083324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.083328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.083331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.083334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.083336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.083339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.083341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.083344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.083346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.083348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.083350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.083353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.083355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.083358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.083360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.083363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.083365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.083368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.083370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.083373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.083375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.083378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.083380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.083382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.083400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.090725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.092103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.092114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.092115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.092117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.092121Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1938 [2:7556555175155742250:4462]
2025-10-02T09:33:25.092127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.092136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.092138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.092139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.092140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.092149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.092155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.092160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.092189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.092193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.092194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.092196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.092197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.092232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.092237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.092243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.092248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.092256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.092270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231299760:6324], now have 1 active actors on pipe
2025-10-02T09:33:25.092275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231299529:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.092279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.092281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.092282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.092290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.092300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.092303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.092305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.092306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.092309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.092311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.092288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1938
2025-10-02T09:33:25.092293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1938
2025-10-02T09:33:25.092331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.092336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.092345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.092353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.092364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.092367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f85da571-f5bc55e1-306c725f-cd07780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.092370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.092373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.092374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.092378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.092383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.092394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.092473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.092477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.092484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.092535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1939 partition: 0 MaxSeqNo: 36 sessionId: src_id|f85da571-f5bc55e1-306c725f-cd07780_0
2025-10-02T09:33:25.092791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deebaba8-6c5d1444-726b62ec-a5663061_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f85da571-f5bc55e1-306c725f-cd07780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.095380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Write session: try to update token
2025-10-02T09:33:25.095396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.101316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.101328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.101329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.101331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.101334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.101336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.101339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155742245:4462]
2025-10-02T09:33:25.101358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.101359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.101360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.101361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.101361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.101363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.101474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.108796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId: src_id|f85da571-f5bc55e1-306c725f-cd07780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.110929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.167640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231299809:6623]
2025-10-02T09:33:25.167803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1938, pipe: [1:7556555175231299809:6623]
2025-10-02T09:33:25.209472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.209946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.209956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.209967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231299809:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.210082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.210068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231299809:6623]
2025-10-02T09:33:25.210085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.210100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.210103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.210146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1939 reason: error at write: Disconnected sessionId: src_id|f85da571-f5bc55e1-306c725f-cd07780_0
2025-10-02T09:33:25.210289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1939 sessionId: src_id|f85da571-f5bc55e1-306c725f-cd07780_0 is DEAD
2025-10-02T09:33:25.210421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.210435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Write session will restart in 0.007580s
2025-10-02T09:33:25.210462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Write session: Do CDS request
2025-10-02T09:33:25.210468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.219231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.219333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.219341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1940
2025-10-02T09:33:25.219460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.219479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.219483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.219486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.219770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1940 sessionId:  describe result for acl check
2025-10-02T09:33:25.219794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.219797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.219798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.219801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231299954:6312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.220152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231299954:6312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.222053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231299954:6312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.222640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.224247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.224390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.224397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.224404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.224433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.224457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155742522:4460]
2025-10-02T09:33:25.224472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231299954:6312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.224480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231299954:6312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.224482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231299954:6312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.224485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.224795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.224982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.225005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.225178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.225209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.225213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.225213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.225214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.225214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.225215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.225215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.225216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.225216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.225217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.225217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.225218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.225221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.225227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.225229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.225231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.225233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.225235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.225237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.225239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.225241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.225243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.225245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.225247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.225250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.225254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.225257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.225260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.225262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.225265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.225268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.225271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.225273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.225276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.225278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.225281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.225283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.225286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.225288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.225290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.225292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.225295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.225298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.225301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.225303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.225306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.225308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.225310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.225328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.232683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.234229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.234240Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.234242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.234244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.234247Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1939 [2:7556555175155742522:4460]
2025-10-02T09:33:25.234253Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.234263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.234265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.234266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.234267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.234276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.234284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.234288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.234320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.234325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.234326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.234328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.234329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.234364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.234369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.234375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.234380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.234388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.234402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231299811:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.234407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300081:6312], now have 1 active actors on pipe
2025-10-02T09:33:25.234411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.234412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.234413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.234419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.234428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.234433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.234436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.234437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.234441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.234442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.234451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.234453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.234461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.234448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1939
2025-10-02T09:33:25.234465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1939
2025-10-02T09:33:25.234479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.234485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.234497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.234504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.234506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.234507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.234512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.234517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.234528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.234612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.234617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.234624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.234683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1940 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0
2025-10-02T09:33:25.234960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85da571-f5bc55e1-306c725f-cd07780_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.237605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Write session: try to update token
2025-10-02T09:33:25.237619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.243419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.243430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.243432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.243432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.243436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.243438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.243440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155742517:4460]
2025-10-02T09:33:25.243459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.243463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.243463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.243464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.243465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.243467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.243571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.250592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId: src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.252679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.309969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231300094:6623]
2025-10-02T09:33:25.310135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1939, pipe: [1:7556555175231300094:6623]
2025-10-02T09:33:25.351098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.351414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.351423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.351435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300094:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.351554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.351559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.351568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.351586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231300094:6623]
2025-10-02T09:33:25.351599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.351608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1940 reason: error at write: Disconnected sessionId: src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0
2025-10-02T09:33:25.351735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1940 sessionId: src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0 is DEAD
2025-10-02T09:33:25.351841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.351861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Write session will restart in 0.007803s
2025-10-02T09:33:25.351880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Write session: Do CDS request
2025-10-02T09:33:25.351884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.360130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.360194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.360204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1941
2025-10-02T09:33:25.360283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.360302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.360308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.360310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.360572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1941 sessionId:  describe result for acl check
2025-10-02T09:33:25.360596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.360601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.360602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.360605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231300208:6300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.360970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231300208:6300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.362735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231300208:6300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.364494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.364656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231300208:6300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.364664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231300208:6300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.364666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231300208:6300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.364669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.366113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.366211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.366217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.366222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.366247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.366269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155742797:4454]
2025-10-02T09:33:25.366602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.366778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.366799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.366984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.367014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.367018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.367019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.367019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.367020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.367020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.367021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.367022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.367022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.367022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.367023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.367024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.367026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.367032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.367034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.367036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.367038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.367040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.367042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.367044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.367046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.367048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.367050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.367052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.367055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.367059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.367062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.367065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.367068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.367071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.367073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.367076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.367078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.367081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.367083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.367086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.367089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.367092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.367094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.367097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.367099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.367101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.367103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.367106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.367112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.367115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.367117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.367119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.367135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.374480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.376028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.376038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.376039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.376041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.376044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1940 [2:7556555175155742797:4454]
2025-10-02T09:33:25.376052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.376061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.376064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.376066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.376067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.376075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.376079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.376084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.376113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.376118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.376119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.376120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.376121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.376156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.376161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.376167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.376172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.376182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.376195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300096:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.376200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300367:6300], now have 1 active actors on pipe
2025-10-02T09:33:25.376203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.376204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.376206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.376215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.376225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.376235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.376235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.376222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1940
2025-10-02T09:33:25.376241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1940
2025-10-02T09:33:25.376237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.376239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.376239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.376253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.376255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.376256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.376263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.376265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.376288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.376295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.376297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.376299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.376304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.376310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.376319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.376409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.376414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.376421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.376475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1941 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0
2025-10-02T09:33:25.376720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe02c84c-8b910ebb-76b969ad-62f935fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.379351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Write session: try to update token
2025-10-02T09:33:25.379367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.385265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.385278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.385279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.385280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.385284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.385287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.385288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155742791:4454]
2025-10-02T09:33:25.385307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.385313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.385313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.385314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.385316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.385318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.385420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.391785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId: src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.393941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.451810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231300378:6623]
2025-10-02T09:33:25.452004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1940, pipe: [1:7556555175231300378:6623]
2025-10-02T09:33:25.494438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.494841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.494851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.494864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300378:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.495015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.495016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231300378:6623]
2025-10-02T09:33:25.495033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.495035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.495077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1941 reason: error at write: Disconnected sessionId: src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0
2025-10-02T09:33:25.495212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1941 sessionId: src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0 is DEAD
2025-10-02T09:33:25.495328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.495337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Write session will restart in 0.007130s
2025-10-02T09:33:25.495351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Write session: Do CDS request
2025-10-02T09:33:25.495355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.495460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.503175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.503282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.503292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1942
2025-10-02T09:33:25.503373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.503393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.503399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.503401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.503689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1942 sessionId:  describe result for acl check
2025-10-02T09:33:25.503716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.503720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.503723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.503726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231300487:6302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.504071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231300487:6302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.505827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231300487:6302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.507497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231300487:6302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.507509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231300487:6302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.507512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231300487:6302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.507517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.507621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.509382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.509475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.509481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.509487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.509510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.509540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155743072:4449]
2025-10-02T09:33:25.509881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.510043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.510065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.510235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.510265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.510269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.510270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.510271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.510271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.510272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.510272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.510273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.510273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.510274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.510274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.510275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.510278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.510284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.510286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.510288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.510290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.510292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.510294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.510296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.510299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.510301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.510302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.510304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.510308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.510312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.510316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.510318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.510321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.510323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.510329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.510332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.510335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.510337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.510339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.510342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.510344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.510347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.510349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.510353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.510356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.510359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.510361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.510363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.510367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.510370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.510372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.510374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.510391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.517707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.519220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.519231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.519232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.519234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.519237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1941 [2:7556555175155743072:4449]
2025-10-02T09:33:25.519244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.519254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.519255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.519257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.519258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.519267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.519269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.519273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.519303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.519308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.519309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.519311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.519312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.519346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.519351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.519357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.519363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.519371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.519386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300379:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.519391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300650:6302], now have 1 active actors on pipe
2025-10-02T09:33:25.519394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.519396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.519397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.519405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.519412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.519417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.519420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.519421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.519423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.519415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1941
2025-10-02T09:33:25.519424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.519422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1941
2025-10-02T09:33:25.519437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.519439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.519441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.519451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.519456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.519481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9839a331-9374d2b0-1ab78941-b7433d95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.519487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.519489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.519490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.519495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.519502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.519512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.519603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.519608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.519615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.519668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1942 partition: 0 MaxSeqNo: 36 sessionId: src_id|9839a331-9374d2b0-1ab78941-b7433d95_0
2025-10-02T09:33:25.519941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c25dd28-79020b6b-42b85166-a21bb95c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9839a331-9374d2b0-1ab78941-b7433d95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.522578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Write session: try to update token
2025-10-02T09:33:25.522595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.528477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.528490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.528491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.528492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.528496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.528499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.528501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155743066:4449]
2025-10-02T09:33:25.528521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.528525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.528525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.528526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.528528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.528532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.528646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.535106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId: src_id|9839a331-9374d2b0-1ab78941-b7433d95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.537240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.595163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231300685:6623]
2025-10-02T09:33:25.595327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1941, pipe: [1:7556555175231300685:6623]
2025-10-02T09:33:25.640499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.640911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.640922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.640934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300685:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.641075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231300685:6623]
2025-10-02T09:33:25.641084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.641092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.641104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.641114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.641157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1942 reason: error at write: Disconnected sessionId: src_id|9839a331-9374d2b0-1ab78941-b7433d95_0
2025-10-02T09:33:25.641299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1942 sessionId: src_id|9839a331-9374d2b0-1ab78941-b7433d95_0 is DEAD
2025-10-02T09:33:25.641467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.641481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Write session will restart in 0.005595s
2025-10-02T09:33:25.641506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Write session: Do CDS request
2025-10-02T09:33:25.641513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.648149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.648203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.648213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1943
2025-10-02T09:33:25.648292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.648312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.648318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.648320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.648631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1943 sessionId:  describe result for acl check
2025-10-02T09:33:25.648663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.648668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.648669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.648672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231300757:6292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.649027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231300757:6292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.651531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231300757:6292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.653405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231300757:6292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.653414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231300757:6292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.653416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231300757:6292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.653420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.654007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.655734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.655831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.655838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.655844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.655869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.655891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155743383:4427]
2025-10-02T09:33:25.656232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.656407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.656432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.656607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.656636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.656640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.656641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.656641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.656642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.656642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.656643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.656643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.656644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.656644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.656645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.656645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.656648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.656654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.656656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.656658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.656660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.656662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.656664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.656666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.656668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.656670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.656672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.656674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.656677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.656681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.656685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.656687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.656689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.656692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.656694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.656697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.656701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.656703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.656705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.656708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.656710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.656713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.656714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.656717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.656719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.656722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.656724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.656727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.656729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.656732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.656734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.656737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.656753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.664196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.665626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.665638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.665639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.665641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.665645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1942 [2:7556555175155743383:4427]
2025-10-02T09:33:25.665653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.665664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.665666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.665667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.665669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.665678Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.665685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.665689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.665722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.665727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.665728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.665730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.665731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.665767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.665772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.665779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.665784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.665795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.665808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.665812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.665814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.665819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.665826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.665827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.665830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.665832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.665838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.665839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.665845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300956:6292], now have 1 active actors on pipe
2025-10-02T09:33:25.665848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300686:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.665862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.665869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.665879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.665880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1942
2025-10-02T09:33:25.665884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1942
2025-10-02T09:33:25.665928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.665933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.665949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.665955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.665957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.665959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.665964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.665971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.666189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.666300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.666305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.666313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.666363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1943 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0
2025-10-02T09:33:25.666623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9839a331-9374d2b0-1ab78941-b7433d95_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.669305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Write session: try to update token
2025-10-02T09:33:25.669321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.678817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:25.678828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.678832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.678855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:25.678858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:25.678990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:25.679107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:25.679221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:25.679334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:25.679489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:25.679513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:25.682221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId: src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.683097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.683108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.683110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.683115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.683119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.683121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.683124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155743378:4427]
2025-10-02T09:33:25.683143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.683144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.683146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.683146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.683148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.683148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.683252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.684312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.741095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231300971:6623]
2025-10-02T09:33:25.741473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1942, pipe: [1:7556555175231300971:6623]
2025-10-02T09:33:25.791387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.791773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.791782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.791793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300971:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.791930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.791939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231300971:6623]
2025-10-02T09:33:25.791961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.791962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.791964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.792006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1943 reason: error at write: Disconnected sessionId: src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0
2025-10-02T09:33:25.792136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1943 sessionId: src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0 is DEAD
2025-10-02T09:33:25.792251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.792259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Write session will restart in 0.005603s
2025-10-02T09:33:25.792274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Write session: Do CDS request
2025-10-02T09:33:25.792278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.799203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.799253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.799260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1944
2025-10-02T09:33:25.799369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.799389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.799395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.799398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.799657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1944 sessionId:  describe result for acl check
2025-10-02T09:33:25.799681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.799686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.799687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.799690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231301047:6282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.800024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231301047:6282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.801665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231301047:6282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.804034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231301047:6282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.804044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231301047:6282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.804046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231301047:6282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.804050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.804893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.806598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.806702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.806709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.806714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.806740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.806760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155743659:4419]
2025-10-02T09:33:25.807095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.807264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.807286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.807454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.807484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.807488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.807488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.807489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.807490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.807490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.807491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.807491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.807492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.807492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.807493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.807493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.807496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.807503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.807505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.807507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.807509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.807511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.807513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.807514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.807516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.807519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.807521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.807523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.807526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.807530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.807533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.807536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.807538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.807541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.807542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.807546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.807548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.807551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.807556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.807559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.807561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.807564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.807566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.807569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.807571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.807573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.807577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.807579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.807582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.807586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.807587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.807590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.807606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.814984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.816415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.816427Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.816428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.816430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.816433Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1943 [2:7556555175155743659:4419]
2025-10-02T09:33:25.816440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.816450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.816454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.816455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.816456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.816465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.816472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.816476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.816506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.816511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.816512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.816514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.816516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.816553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.816557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.816563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.816568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.816576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.816591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231300972:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.816596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231301243:6282], now have 1 active actors on pipe
2025-10-02T09:33:25.816600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.816603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.816604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.816612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.816622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.816624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.816626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.816627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.816629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.816631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.816619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1943
2025-10-02T09:33:25.816645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.816628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1943
2025-10-02T09:33:25.816651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.816652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.816662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.816664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.816688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|570735e0-5a60cd53-61072b-15f11429_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.816695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.816697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.816698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.816703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.816711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.816722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.816828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.816833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.816840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.816904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1944 partition: 0 MaxSeqNo: 36 sessionId: src_id|570735e0-5a60cd53-61072b-15f11429_0
2025-10-02T09:33:25.817165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b51e49f-7d95aa44-2e86b831-194ac609_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|570735e0-5a60cd53-61072b-15f11429_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.819790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Write session: try to update token
2025-10-02T09:33:25.819806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.825760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.825773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.825774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.825775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.825778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.825780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.825782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155743654:4419]
2025-10-02T09:33:25.825802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.825804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.825804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.825805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.825806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.825808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.825916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.832005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId: src_id|570735e0-5a60cd53-61072b-15f11429_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.834098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:25.892121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555175231301265:6623]
2025-10-02T09:33:25.892251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1943, pipe: [1:7556555175231301265:6623]
2025-10-02T09:33:25.936277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:25.936761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.936771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.936784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231301265:6623], now have 1 active actors on pipe
2025-10-02T09:33:25.936926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:25.936922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555175231301265:6623]
2025-10-02T09:33:25.936943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:25.936946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:25.936948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:25.936995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1944 reason: error at write: Disconnected sessionId: src_id|570735e0-5a60cd53-61072b-15f11429_0
2025-10-02T09:33:25.937140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1944 sessionId: src_id|570735e0-5a60cd53-61072b-15f11429_0 is DEAD
2025-10-02T09:33:25.937255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:25.937264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Write session will restart in 0.008649s
2025-10-02T09:33:25.937283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Write session: Do CDS request
2025-10-02T09:33:25.937287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:25.947247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.947389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:25.947398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1945
2025-10-02T09:33:25.947519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:25.947540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:25.947544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:25.947547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:25.947837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1945 sessionId:  describe result for acl check
2025-10-02T09:33:25.947864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:25.947868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:25.947869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:25.947872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555175231301494:6268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:25.948212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555175231301494:6268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:25.948963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:25.949797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555175231301494:6268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:25.950702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:25.950797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:25.950805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:25.950810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:25.950835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:25.950859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555175155743947:4417]
2025-10-02T09:33:25.951197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:25.951370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:25.951392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:25.951382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555175231301494:6268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:25.951392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555175231301494:6268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:25.951394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555175231301494:6268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:25.951397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:25.951564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:25.951593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.951597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.951598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.951599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.951599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.951600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.951600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.951601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.951601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.951602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.951602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.951603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.951605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.951611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.951613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.951615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.951617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.951619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.951621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.951623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.951625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.951627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.951629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.951631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.951634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.951638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:25.951641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.951644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:25.951646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.951649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:25.951651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.951653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:25.951656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.951658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:25.951660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.951663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:25.951666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.951669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:25.951671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.951674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:25.951677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.951679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:25.951681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.951685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.951687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.951690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.951692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.951694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.951710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:25.959421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:25.961065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:25.961075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:25.961076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:25.961078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:25.961081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1944 [2:7556555175155743947:4417]
2025-10-02T09:33:25.961087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:25.961096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:25.961102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.961103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.961104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.961114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:25.961116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:25.961120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:25.961148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.961153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.961154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.961156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:25.961157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:25.961194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:25.961199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.961205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:25.961210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:25.961222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:25.961233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231301546:6268], now have 1 active actors on pipe
2025-10-02T09:33:25.961238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555175231301269:2446], now have 1 active actors on pipe
2025-10-02T09:33:25.961242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.961243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.961244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.961251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:25.961261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:25.961261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:25.961263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:25.961265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:25.961270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:25.961272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:25.961285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.961290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:25.961270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1944
2025-10-02T09:33:25.961291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:25.961270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1944
2025-10-02T09:33:25.961307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.961310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.961330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fba7876f-1ee7088e-766ac393-2abef87c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:25.961336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:25.961339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:25.961340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:25.961344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:25.961350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:25.961360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.961443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:25.961448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:25.961455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:25.961507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1945 partition: 0 MaxSeqNo: 36 sessionId: src_id|fba7876f-1ee7088e-766ac393-2abef87c_0
2025-10-02T09:33:25.961778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570735e0-5a60cd53-61072b-15f11429_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fba7876f-1ee7088e-766ac393-2abef87c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:25.964460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Write session: try to update token
2025-10-02T09:33:25.964475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:25.970666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:25.970688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:25.970689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:25.970690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:25.970694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.970696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.970699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555175155743942:4417]
2025-10-02T09:33:25.970718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:25.970721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:25.970723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:25.970724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:25.970724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:25.970726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:25.970843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:25.976851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId: src_id|fba7876f-1ee7088e-766ac393-2abef87c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:25.978970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.037017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526268864:6623]
2025-10-02T09:33:26.037185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1944, pipe: [1:7556555179526268864:6623]
2025-10-02T09:33:26.079092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.079287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.079295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.079307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526268864:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.079444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.079458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.079458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.079492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526268864:6623]
2025-10-02T09:33:26.079505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1945 reason: error at write: Disconnected sessionId: src_id|fba7876f-1ee7088e-766ac393-2abef87c_0
2025-10-02T09:33:26.079634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1945 sessionId: src_id|fba7876f-1ee7088e-766ac393-2abef87c_0 is DEAD
2025-10-02T09:33:26.079670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.079806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.079820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Write session will restart in 0.008787s
2025-10-02T09:33:26.079843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Write session: Do CDS request
2025-10-02T09:33:26.079849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.089126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.089229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.089237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1946
2025-10-02T09:33:26.089347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.089367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.089373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.089375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.089639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1946 sessionId:  describe result for acl check
2025-10-02T09:33:26.089663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.089669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.089670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.089674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526269011:6270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.090019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526269011:6270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.091985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526269011:6270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.092623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.094276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.094377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.094384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.094390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.094416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.094437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450711524:4415]
2025-10-02T09:33:26.094472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526269011:6270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.094480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526269011:6270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.094482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526269011:6270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.094486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.094779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.094929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.094952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.095128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.095158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.095162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.095162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.095163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.095163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.095164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.095164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.095165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.095165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.095165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.095166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.095166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.095169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.095175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.095177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.095179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.095181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.095183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.095185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.095187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.095189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.095191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.095193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.095195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.095198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.095202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.095205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.095208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.095211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.095214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.095216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.095218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.095220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.095223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.095225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.095228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.095230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.095232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.095234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.095237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.095238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.095241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.095246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.095248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.095250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.095253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.095255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.095257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.095273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.102955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.104362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.104374Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.104376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.104378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.104381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1945 [2:7556555179450711524:4415]
2025-10-02T09:33:26.104388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.104397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.104402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.104404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.104404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.104413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.104416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.104420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.104448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.104452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.104453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.104455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.104456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.104502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.104507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.104514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.104520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.104529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.104543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269141:6270], now have 1 active actors on pipe
2025-10-02T09:33:26.104548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526268865:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.104551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.104552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.104553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.104561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.104571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.104576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.104580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.104581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.104582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.104561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1945
2025-10-02T09:33:26.104583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.104568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1945
2025-10-02T09:33:26.104604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.104609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.104618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.104625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.104638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.104640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3227fd59-864770d3-524a6136-528a9b74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.104644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.104646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.104647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.104653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.104657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.104668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.104757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.104762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.104769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.104827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1946 partition: 0 MaxSeqNo: 36 sessionId: src_id|3227fd59-864770d3-524a6136-528a9b74_0
2025-10-02T09:33:26.105048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba7876f-1ee7088e-766ac393-2abef87c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3227fd59-864770d3-524a6136-528a9b74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.107678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Write session: try to update token
2025-10-02T09:33:26.107694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.114018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.114030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.114031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.114032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.114035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.114038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.114039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450711519:4415]
2025-10-02T09:33:26.114057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.114060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.114061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.114062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.114064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.114066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.114166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:26.120077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId: src_id|3227fd59-864770d3-524a6136-528a9b74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:26.122187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.179876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526269152:6623]
2025-10-02T09:33:26.180049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1945, pipe: [1:7556555179526269152:6623]
2025-10-02T09:33:26.221644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.222190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.222199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.222212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269152:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.222318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.222357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.222370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.222374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.222404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526269152:6623]
2025-10-02T09:33:26.222414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1946 reason: error at write: Disconnected sessionId: src_id|3227fd59-864770d3-524a6136-528a9b74_0
2025-10-02T09:33:26.222546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1946 sessionId: src_id|3227fd59-864770d3-524a6136-528a9b74_0 is DEAD
2025-10-02T09:33:26.222732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.222747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Write session will restart in 0.008646s
2025-10-02T09:33:26.222768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Write session: Do CDS request
2025-10-02T09:33:26.222773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.232142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.232257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.232267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1947
2025-10-02T09:33:26.232374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.232395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.232401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.232404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.232730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1947 sessionId:  describe result for acl check
2025-10-02T09:33:26.232761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.232766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.232767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.232770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526269316:6265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.233122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526269316:6265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.234654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526269316:6265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.235544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.237128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.237233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.237240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.237246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.237273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.237295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450711803:4413]
2025-10-02T09:33:26.237315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526269316:6265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.237322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526269316:6265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.237324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526269316:6265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.237327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.237630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.237788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.237812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.237988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.238019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.238023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.238024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.238024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.238025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.238025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.238026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.238026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.238027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.238027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.238028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.238028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.238031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.238037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.238039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.238041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.238043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.238045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.238047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.238049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.238051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.238054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.238056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.238058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.238062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.238066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.238069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.238072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.238074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.238077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.238079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.238082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.238084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.238087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.238089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.238092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.238094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.238097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.238099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.238102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.238104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.238107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.238109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.238112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.238114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.238116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.238118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.238121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.238138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.245792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.247371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.247382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.247383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.247385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.247389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1946 [2:7556555179450711803:4413]
2025-10-02T09:33:26.247396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.247405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.247406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.247408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.247408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.247417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.247421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.247425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.247457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.247462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.247463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.247465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.247466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.247499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.247504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.247511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.247516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.247524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.247539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269431:6265], now have 1 active actors on pipe
2025-10-02T09:33:26.247544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269154:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.247547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.247549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.247550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.247557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.247564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.247570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.247572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.247573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.247573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.247575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.247573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1946
2025-10-02T09:33:26.247576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1946
2025-10-02T09:33:26.247587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.247590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.247592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.247607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.247609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.247627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.247633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.247635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.247636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.247641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.247646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.247657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.247741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.247745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.247753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.247807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1947 partition: 0 MaxSeqNo: 36 sessionId: src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0
2025-10-02T09:33:26.248026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3227fd59-864770d3-524a6136-528a9b74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.250630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Write session: try to update token
2025-10-02T09:33:26.250645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.257002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.257014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.257015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.257016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.257020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.257022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.257023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450711798:4413]
2025-10-02T09:33:26.257042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.257046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.257046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.257048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.257048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.257052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.257156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:26.263300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId: src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:26.265431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.322724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526269444:6623]
2025-10-02T09:33:26.322867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1946, pipe: [1:7556555179526269444:6623]
2025-10-02T09:33:26.364600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.365100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.365112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.365124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269444:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.365250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.365259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.365274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.365297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1947 reason: error at write: Disconnected sessionId: src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0
2025-10-02T09:33:26.365339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526269444:6623]
2025-10-02T09:33:26.365433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1947 sessionId: src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0 is DEAD
2025-10-02T09:33:26.365474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.365606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.365621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Write session will restart in 0.006972s
2025-10-02T09:33:26.365646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Write session: Do CDS request
2025-10-02T09:33:26.365651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.373188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.373369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.373376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1948
2025-10-02T09:33:26.373494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.373514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.373519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.373523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.373830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1948 sessionId:  describe result for acl check
2025-10-02T09:33:26.373852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.373853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.373854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.373856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526269544:6259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.374201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526269544:6259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.376184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526269544:6259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.377845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526269544:6259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.377852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526269544:6259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.377854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526269544:6259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.377857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.378182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.379952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.380054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.380061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.380067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.380094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.380118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450712085:4410]
2025-10-02T09:33:26.380459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.380625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.380648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.380839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.380870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.380874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.380875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.380875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.380876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.380876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.380877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.380877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.380878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.380878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.380879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.380879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.380882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.380888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.380893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.380895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.380897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.380899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.380901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.380903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.380905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.380907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.380909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.380913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.380917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.380921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.380924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.380926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.380929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.380931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.380934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.380936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.380939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.380941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.380943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.380945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.380948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.380950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.380953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.380955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.380958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.380960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.380963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.380967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.380970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.380972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.380975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.380992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.388772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.390320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.390332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.390333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.390335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.390338Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1947 [2:7556555179450712085:4410]
2025-10-02T09:33:26.390346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.390356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.390361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.390362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.390364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.390372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.390375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.390379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.390409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.390414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.390415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.390417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.390419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.390453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.390457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.390463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.390469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.390478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.390492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269446:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.390497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269722:6259], now have 1 active actors on pipe
2025-10-02T09:33:26.390500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.390502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.390503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.390511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.390518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.390524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.390526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.390527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.390527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.390529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.390543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.390548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.390532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1947
2025-10-02T09:33:26.390533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1947
2025-10-02T09:33:26.390548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.390563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.390565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.390582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|713d1102-e8c201f0-9297758c-611f0f01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.390589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.390591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.390592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.390598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.390603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.390612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.390708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.390712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.390720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.390786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1948 partition: 0 MaxSeqNo: 36 sessionId: src_id|713d1102-e8c201f0-9297758c-611f0f01_0
2025-10-02T09:33:26.391043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484cf5d1-e0f03ec6-6740e0f8-2d7ff926_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|713d1102-e8c201f0-9297758c-611f0f01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.393626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Write session: try to update token
2025-10-02T09:33:26.393642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.399944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.399956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.399957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.399958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.399961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.399963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.399965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450712080:4410]
2025-10-02T09:33:26.399983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.399986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.399986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.399987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.399989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.399991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.400097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:26.406271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId: src_id|713d1102-e8c201f0-9297758c-611f0f01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:26.408473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.465573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526269735:6623]
2025-10-02T09:33:26.465789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1947, pipe: [1:7556555179526269735:6623]
2025-10-02T09:33:26.510547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.510781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.510789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.510802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269735:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.510952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.510984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526269735:6623]
2025-10-02T09:33:26.510986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.510988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.511021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.511041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1948 reason: error at write: Disconnected sessionId: src_id|713d1102-e8c201f0-9297758c-611f0f01_0
2025-10-02T09:33:26.511193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1948 sessionId: src_id|713d1102-e8c201f0-9297758c-611f0f01_0 is DEAD
2025-10-02T09:33:26.511335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.511348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Write session will restart in 0.007854s
2025-10-02T09:33:26.511368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Write session: Do CDS request
2025-10-02T09:33:26.511373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.520219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.520350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.520360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1949
2025-10-02T09:33:26.520505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.520530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.520533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.520536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.520841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1949 sessionId:  describe result for acl check
2025-10-02T09:33:26.520863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.520867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.520869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.520872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526269866:6254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.521197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526269866:6254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.523031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526269866:6254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.524508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.526226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.526308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526269866:6254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.526316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526269866:6254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.526318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526269866:6254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.526322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.526323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.526331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.526336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.526362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.526383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450712365:4408]
2025-10-02T09:33:26.526770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.526930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.526952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.527128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.527158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.527162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.527163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.527164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.527164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.527166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.527166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.527166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.527167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.527167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.527170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.527176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.527178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.527180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.527182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.527184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.527186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.527187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.527189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.527192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.527193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.527195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.527199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.527203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.527206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.527208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.527210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.527213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.527215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.527218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.527220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.527223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.527225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.527227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.527229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.527232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.527235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.527237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.527239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.527242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.527244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.527247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.527249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.527251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.527253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.527256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.527273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.534979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.536573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.536585Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.536586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.536589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.536592Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1948 [2:7556555179450712365:4408]
2025-10-02T09:33:26.536600Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.536610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.536615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.536616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.536617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.536627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.536632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.536638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.536669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.536674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.536675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.536677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.536678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.536717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.536722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.536728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.536733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.536745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.536760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270016:6254], now have 1 active actors on pipe
2025-10-02T09:33:26.536765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526269736:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.536770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.536771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.536772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.536779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.536788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.536791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.536794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.536795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.536814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.536816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.536832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.536840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.536836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1948
2025-10-02T09:33:26.536840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1948
2025-10-02T09:33:26.536854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.536882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.536888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.536901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.536908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.536910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.536911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.536916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.536921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.536932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.537015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.537020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.537027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.537088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1949 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0
2025-10-02T09:33:26.537388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713d1102-e8c201f0-9297758c-611f0f01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.540052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Write session: try to update token
2025-10-02T09:33:26.540066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.550310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:26.550322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.550328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.550352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:26.550360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:26.550493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:26.550614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:26.550742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:26.550863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:26.551014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:26.551039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:26.553193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId: src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:26.555177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.555190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.555192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.555193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.555198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.555200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.555201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450712360:4408]
2025-10-02T09:33:26.555219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.555220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.555222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.555225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.555227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.555228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.555341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:26.555571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.610981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526270053:6623]
2025-10-02T09:33:26.611164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1948, pipe: [1:7556555179526270053:6623]
2025-10-02T09:33:26.671786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.672187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.672196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.672210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270053:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.672346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526270053:6623]
2025-10-02T09:33:26.672376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.672378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.672387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.672411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.672418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1949 reason: error at write: Disconnected sessionId: src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0
2025-10-02T09:33:26.672573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1949 sessionId: src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0 is DEAD
2025-10-02T09:33:26.672726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.672740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Write session will restart in 0.008627s
2025-10-02T09:33:26.672766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Write session: Do CDS request
2025-10-02T09:33:26.672771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.682176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.682296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.682305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1950
2025-10-02T09:33:26.682425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.682447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.682452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.682455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.682865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1950 sessionId:  describe result for acl check
2025-10-02T09:33:26.682886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.682890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.682891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.682894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526270218:6230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.683227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526270218:6230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.684713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526270218:6230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.685517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.687259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.687354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.687360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.687365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.687392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.687414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450712684:4379]
2025-10-02T09:33:26.687538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526270218:6230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.687547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526270218:6230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.687549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526270218:6230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.687553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.687749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.687900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.687921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.688095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.688125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.688129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.688129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.688130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.688131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.688131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.688131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.688132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.688132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.688133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.688133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.688134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.688136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.688143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.688145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.688147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.688149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.688151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.688153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.688155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.688157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.688159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.688161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.688163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.688166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.688170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.688173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.688176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.688178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.688181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.688183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.688186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.688188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.688192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.688194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.688198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.688200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.688203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.688207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.688210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.688216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.688218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.688220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.688222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.688225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.688227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.688229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.688235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.688252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.695961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.697485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.697497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.697498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.697500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.697503Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1949 [2:7556555179450712684:4379]
2025-10-02T09:33:26.697511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.697521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.697522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.697524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.697525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.697534Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.697536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.697544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.697578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.697583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.697584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.697586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.697587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.697627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.697632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.697638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.697643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.697653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.697668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270334:6230], now have 1 active actors on pipe
2025-10-02T09:33:26.697673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270054:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.697677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.697678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.697679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.697686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.697698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.697699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.697701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.697702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.697709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.697711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.697705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1949
2025-10-02T09:33:26.697727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.697732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.697707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1949
2025-10-02T09:33:26.697733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.697742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.697747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.697775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.697782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.697784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.697786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.697791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.697796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.697808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.697886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.697890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.697897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.697944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1950 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0
2025-10-02T09:33:26.698219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1b27ad-76b1da42-d5b7767a-bf85fedd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.700902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Write session: try to update token
2025-10-02T09:33:26.700918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.707359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.707374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.707375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.707376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.707380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.707383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.707385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450712679:4379]
2025-10-02T09:33:26.707406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.707410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.707412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.707412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.707416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.707418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.707528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:26.713906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId: src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:26.716250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.772245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526270346:6623]
2025-10-02T09:33:26.772416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1949, pipe: [1:7556555179526270346:6623]
2025-10-02T09:33:26.820161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.820378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.820386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.820398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270346:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.820545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.820556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.820567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526270346:6623]
2025-10-02T09:33:26.820584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.820605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1950 reason: error at write: Disconnected sessionId: src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0
2025-10-02T09:33:26.820738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1950 sessionId: src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0 is DEAD
2025-10-02T09:33:26.820874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.820888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Write session will restart in 0.009950s
2025-10-02T09:33:26.820912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Write session: Do CDS request
2025-10-02T09:33:26.820918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.821098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.832219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.832283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.832292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1951
2025-10-02T09:33:26.832475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.832497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.832503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.832505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.832775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1951 sessionId:  describe result for acl check
2025-10-02T09:33:26.832794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.832809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.832810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.832813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526270591:6225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.833163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526270591:6225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.833651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.834664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526270591:6225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.835382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.835539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.835547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.835554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.835585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.835608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450712968:4383]
2025-10-02T09:33:26.835937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.836102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.836125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.836299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.836328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.836332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.836333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.836333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.836334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.836334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.836335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.836335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.836336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.836336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.836337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.836337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.836340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.836345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.836348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.836350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.836352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.836354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.836355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.836357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.836359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.836361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.836363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.836365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.836369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.836372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.836376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.836378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.836382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.836385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.836387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.836390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.836393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.836395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.836397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.836400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.836402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.836404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.836407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.836409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.836412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.836415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.836417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.836420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.836422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.836424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.836426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.836429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.836448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.836585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526270591:6225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.836593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526270591:6225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.836597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526270591:6225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.836600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.843841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.845473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.845483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.845484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.845486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.845488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1950 [2:7556555179450712968:4383]
2025-10-02T09:33:26.845497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.845505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.845507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.845508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.845509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.845517Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.845523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.845527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.845556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.845560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.845561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.845563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.845565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.845602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.845607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.845613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.845618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.845627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.845641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270347:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.845646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270635:6225], now have 1 active actors on pipe
2025-10-02T09:33:26.845649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.845650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.845651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.845659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.845666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.845672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.845674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.845674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.845675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.845676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.845671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1950
2025-10-02T09:33:26.845689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.845675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1950
2025-10-02T09:33:26.845694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.845695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.845709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.845710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.845726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.845733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.845735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.845736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.845741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.845749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.845758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.845842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.845847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.845854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.845909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1951 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0
2025-10-02T09:33:26.846146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ba001-8f8dc3c8-f13c44c6-2bd9d7b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.848816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Write session: try to update token
2025-10-02T09:33:26.848832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.854718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.854729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.854730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.854731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.854735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.854737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.854740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450712963:4383]
2025-10-02T09:33:26.854759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.854763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.854763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.854764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.854765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.854768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.854866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:26.861049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId: src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:26.863208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:26.920724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555179526270650:6623]
2025-10-02T09:33:26.920873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1950, pipe: [1:7556555179526270650:6623]
2025-10-02T09:33:26.962942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:26.963277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.963287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.963298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270650:6623], now have 1 active actors on pipe
2025-10-02T09:33:26.963437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:26.963447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:26.963451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555179526270650:6623]
2025-10-02T09:33:26.963465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:26.963486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1951 reason: error at write: Disconnected sessionId: src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0
2025-10-02T09:33:26.963619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1951 sessionId: src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0 is DEAD
2025-10-02T09:33:26.963787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:26.963802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Write session will restart in 0.006043s
2025-10-02T09:33:26.963824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Write session: Do CDS request
2025-10-02T09:33:26.963840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:26.963811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:26.971108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.971201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:26.971210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1952
2025-10-02T09:33:26.971327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:26.971348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:26.971354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:26.971356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:26.971623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1952 sessionId:  describe result for acl check
2025-10-02T09:33:26.971644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:26.971651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:26.971653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:26.971656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555179526270755:6223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:26.971934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555179526270755:6223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:26.973460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555179526270755:6223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:26.975496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555179526270755:6223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:26.975503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555179526270755:6223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:26.975505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555179526270755:6223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:26.975508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:26.976627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:26.978466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:26.978556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:26.978563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:26.978568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:26.978592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:26.978614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555179450713266:4375]
2025-10-02T09:33:26.978953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:26.979126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:26.979148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:26.979321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:26.979350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.979354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.979354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.979355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.979355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.979356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.979356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.979357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.979357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.979358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.979358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.979359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.979361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.979367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.979369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.979371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.979373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.979375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.979377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.979379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.979381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.979383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.979385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.979387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.979391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.979395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:26.979398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.979401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:26.979402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.979405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:26.979407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.979410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:26.979420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.979427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:26.979429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.979432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:26.979434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.979436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:26.979438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.979442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:26.979444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.979446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:26.979452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.979454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.979456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.979459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.979461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.979463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.979479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:26.986863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:26.988311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:26.988322Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:26.988323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:26.988325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:26.988328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1951 [2:7556555179450713266:4375]
2025-10-02T09:33:26.988335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:26.988344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:26.988347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.988348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.988349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.988358Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:26.988365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:26.988369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:26.988398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.988403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.988403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.988405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:26.988407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:26.988442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:26.988447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.988453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:26.988458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:26.988469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:26.988481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270651:2446], now have 1 active actors on pipe
2025-10-02T09:33:26.988487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555179526270937:6223], now have 1 active actors on pipe
2025-10-02T09:33:26.988491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.988492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.988493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.988500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:26.988512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:26.988514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:26.988516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:26.988517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:26.988521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:26.988522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:26.988536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.988541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:26.988542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:26.988528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1951
2025-10-02T09:33:26.988557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.988561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.988529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1951
2025-10-02T09:33:26.988580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2045038-63d6c274-33ac042c-820b4cc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:26.988586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:26.988588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:26.988589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:26.988593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:26.988598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:26.988612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.988708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:26.988712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:26.988719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:26.988773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1952 partition: 0 MaxSeqNo: 36 sessionId: src_id|2045038-63d6c274-33ac042c-820b4cc8_0
2025-10-02T09:33:26.989058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7e6f120-37c265db-e60a6cee-8c46a62f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2045038-63d6c274-33ac042c-820b4cc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:26.991649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Write session: try to update token
2025-10-02T09:33:26.991666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:26.997588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:26.997600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:26.997601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:26.997602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:26.997606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.997608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.997610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555179450713261:4375]
2025-10-02T09:33:26.997629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:26.997631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:26.997634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:26.997635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:26.997636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:26.997636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:26.997763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.004023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId: src_id|2045038-63d6c274-33ac042c-820b4cc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.006299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.063567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821238253:6623]
2025-10-02T09:33:27.063712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1951, pipe: [1:7556555183821238253:6623]
2025-10-02T09:33:27.105193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.105674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.105682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.105694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238253:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.105831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.105844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.105861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:27.105864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:27.105874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821238253:6623]
2025-10-02T09:33:27.105909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1952 reason: error at write: Disconnected sessionId: src_id|2045038-63d6c274-33ac042c-820b4cc8_0
2025-10-02T09:33:27.106042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1952 sessionId: src_id|2045038-63d6c274-33ac042c-820b4cc8_0 is DEAD
2025-10-02T09:33:27.106206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:27.106220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Write session will restart in 0.006638s
2025-10-02T09:33:27.106241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Write session: Do CDS request
2025-10-02T09:33:27.106246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.114178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.114266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.114274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1953
2025-10-02T09:33:27.114391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.114412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.114418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.114421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.114696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1953 sessionId:  describe result for acl check
2025-10-02T09:33:27.114720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.114721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.114722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.114725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821238357:6220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.115079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821238357:6220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.117257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821238357:6220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.119180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821238357:6220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.119188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821238357:6220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.119190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821238357:6220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.119193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.119285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.121115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.121210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.121216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.121222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.121248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.121271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745680850:4369]
2025-10-02T09:33:27.121612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.121780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.121802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.121979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.122012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.122015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.122016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.122017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.122017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.122018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.122018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.122019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.122019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.122020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.122020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.122021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.122024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.122029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.122032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.122034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.122036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.122038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.122040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.122042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.122044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.122047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.122048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.122050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.122054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.122058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.122061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.122064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.122066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.122068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.122071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.122073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.122075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.122078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.122080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.122083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.122085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.122088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.122090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.122092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.122095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.122097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.122099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.122102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.122106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.122109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.122111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.122126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.122148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:27.129713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:27.131344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:27.131355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:27.131356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:27.131358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:27.131361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1952 [2:7556555183745680850:4369]
2025-10-02T09:33:27.131368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:27.131377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:27.131380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.131382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.131383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.131392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:27.131395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:27.131399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:27.131429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.131434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.131435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.131437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:27.131438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:27.131477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:27.131482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.131489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.131494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.131503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:27.131517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238536:6220], now have 1 active actors on pipe
2025-10-02T09:33:27.131523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238254:2446], now have 1 active actors on pipe
2025-10-02T09:33:27.131526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.131527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.131529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.131536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:27.131546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:27.131549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:27.131551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:27.131553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:27.131555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:27.131557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:27.131549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1952
2025-10-02T09:33:27.131570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.131551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1952
2025-10-02T09:33:27.131574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:27.131576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:27.131585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.131587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.131610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:27.131616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.131618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.131620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:27.131625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.131631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:27.131640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.131723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.131727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.131735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.131788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1953 partition: 0 MaxSeqNo: 36 sessionId: src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0
2025-10-02T09:33:27.132017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2045038-63d6c274-33ac042c-820b4cc8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:27.134644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Write session: try to update token
2025-10-02T09:33:27.134659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:27.140740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:27.140752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:27.140754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:27.140755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:27.140758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.140760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.140762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745680844:4369]
2025-10-02T09:33:27.140782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:27.140784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:27.140787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:27.140788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.140789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:27.140790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:27.140908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.146617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId: src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.148875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.205909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821238549:6623]
2025-10-02T09:33:27.206075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1952, pipe: [1:7556555183821238549:6623]
2025-10-02T09:33:27.249878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.250261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.250270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.250282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238549:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.250393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.250416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:27.250425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:27.250425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.250451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821238549:6623]
2025-10-02T09:33:27.250465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1953 reason: error at write: Disconnected sessionId: src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0
2025-10-02T09:33:27.250594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1953 sessionId: src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0 is DEAD
2025-10-02T09:33:27.250747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:27.250760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Write session will restart in 0.007944s
2025-10-02T09:33:27.250786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Write session: Do CDS request
2025-10-02T09:33:27.250791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.260193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.260315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.260324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1954
2025-10-02T09:33:27.260443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.260464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.260470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.260473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.260749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1954 sessionId:  describe result for acl check
2025-10-02T09:33:27.260774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.260779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.260780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.260783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821238702:6205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.261156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821238702:6205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.262822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821238702:6205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.263840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.265751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.265843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.265850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.265855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.265880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.265902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745681136:4367]
2025-10-02T09:33:27.265960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821238702:6205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.265969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821238702:6205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.265970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821238702:6205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.265974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.266236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.266389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.266412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.266584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.266614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.266618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.266618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.266619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.266619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.266620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.266620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.266621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.266621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.266622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.266622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.266623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.266626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.266632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.266634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.266636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.266638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.266640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.266642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.266644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.266646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.266648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.266650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.266652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.266656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.266659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.266662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.266665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.266667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.266677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.266680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.266683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.266685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.266689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.266692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.266695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.266697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.266700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.266702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.266704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.266706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.266709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.266712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.266715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.266717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.266720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.266722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.266725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.266742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:27.274102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:27.275779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:27.275790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:27.275792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:27.275794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:27.275797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1953 [2:7556555183745681136:4367]
2025-10-02T09:33:27.275804Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:27.275813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:27.275816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.275817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.275818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.275827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:27.275832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:27.275836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:27.275865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.275870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.275871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.275873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:27.275874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:27.275908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:27.275914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.275920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.275925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.275935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:27.275949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238552:2446], now have 1 active actors on pipe
2025-10-02T09:33:27.275954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238836:6205], now have 1 active actors on pipe
2025-10-02T09:33:27.275957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.275958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.275959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.275967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:27.275977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:27.275980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:27.275982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:27.275983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:27.275987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:27.275989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:27.275970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1953
2025-10-02T09:33:27.275979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1953
2025-10-02T09:33:27.276011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.276016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.276023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.276027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:27.276039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:27.276047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:27.276050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.276052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.276053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:27.276058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.276064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:27.276074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.276157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.276162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.276169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.276218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1954 partition: 0 MaxSeqNo: 36 sessionId: src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0
2025-10-02T09:33:27.276485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998363e-b13ad9d6-1a32247c-8143a4e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:27.279129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Write session: try to update token
2025-10-02T09:33:27.279144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:27.285067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:27.285079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:27.285080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:27.285081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:27.285084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.285087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.285089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745681131:4367]
2025-10-02T09:33:27.285107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:27.285113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.285114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:27.285114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:27.285116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:27.285120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:27.285240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.291201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId: src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.293412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.350799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821238848:6623]
2025-10-02T09:33:27.350992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1953, pipe: [1:7556555183821238848:6623]
2025-10-02T09:33:27.392470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.392667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.392676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.392688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238848:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.392811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.392838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:27.392845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821238848:6623]
2025-10-02T09:33:27.392847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:27.392860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.392890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1954 reason: error at write: Disconnected sessionId: src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0
2025-10-02T09:33:27.393022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1954 sessionId: src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0 is DEAD
2025-10-02T09:33:27.393186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:27.393200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Write session will restart in 0.009662s
2025-10-02T09:33:27.393223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Write session: Do CDS request
2025-10-02T09:33:27.393228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.404166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.404287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.404295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1955
2025-10-02T09:33:27.404418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.404438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.404442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.404445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.404774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1955 sessionId:  describe result for acl check
2025-10-02T09:33:27.404811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.404812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.404812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.404816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821239095:6202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.405168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821239095:6202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.405922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.406548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821239095:6202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.407594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.407733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.407740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.407747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.407776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.407798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745681425:4364]
2025-10-02T09:33:27.408136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.408294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.408316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.408464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821239095:6202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.408472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821239095:6202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.408474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821239095:6202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.408477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.408490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.408519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.408523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.408523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.408524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.408524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.408525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.408525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.408526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.408526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.408527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.408527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.408528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.408530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.408536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.408538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.408540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.408542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.408544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.408546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.408548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.408550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.408552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.408554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.408556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.408559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.408563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.408566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.408569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.408571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.408574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.408576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.408579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.408582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.408585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.408587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.408589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.408592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.408595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.408597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.408599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.408601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.408605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.408608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.408610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.408612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.408615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.408617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.408620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.408636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:27.416276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:27.417809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:27.417820Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:27.417821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:27.417823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:27.417826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1954 [2:7556555183745681425:4364]
2025-10-02T09:33:27.417833Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:27.417842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:27.417845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.417846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.417848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.417856Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:27.417860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:27.417864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:27.417893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.417898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.417899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.417901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:27.417902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:27.417936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:27.417940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.417946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.417952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.417959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:27.417972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821238849:2446], now have 1 active actors on pipe
2025-10-02T09:33:27.417978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239136:6202], now have 1 active actors on pipe
2025-10-02T09:33:27.417981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.417982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.417983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.417992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:27.418002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:27.418005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:27.418007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:27.418008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:27.418011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:27.418012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:27.418004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1954
2025-10-02T09:33:27.418016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1954
2025-10-02T09:33:27.418024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.418029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:27.418035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:27.418045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.418047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.418064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d316983-f33c4514-49de671-ff045576_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:27.418071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.418073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.418074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:27.418078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.418083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:27.418098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.418201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.418206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.418213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.418264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1955 partition: 0 MaxSeqNo: 36 sessionId: src_id|d316983-f33c4514-49de671-ff045576_0
2025-10-02T09:33:27.418495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dea1437-c1a9df2a-289421-cc88d4fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d316983-f33c4514-49de671-ff045576_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:27.421217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Write session: try to update token
2025-10-02T09:33:27.421233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:27.427331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:27.427343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:27.427344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:27.427345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:27.427348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.427351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.427354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745681420:4364]
2025-10-02T09:33:27.427373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:27.427375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:27.427377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:27.427379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.427380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:27.427381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:27.427492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.433646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId: src_id|d316983-f33c4514-49de671-ff045576_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.435789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.493149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821239145:6623]
2025-10-02T09:33:27.493322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1954, pipe: [1:7556555183821239145:6623]
2025-10-02T09:33:27.535355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.535722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.535731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.535743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239145:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.535888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.535886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.535913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821239145:6623]
2025-10-02T09:33:27.535919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:27.535921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:27.535964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1955 reason: error at write: Disconnected sessionId: src_id|d316983-f33c4514-49de671-ff045576_0
2025-10-02T09:33:27.536113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1955 sessionId: src_id|d316983-f33c4514-49de671-ff045576_0 is DEAD
2025-10-02T09:33:27.536241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:27.536255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Write session will restart in 0.006544s
2025-10-02T09:33:27.536275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Write session: Do CDS request
2025-10-02T09:33:27.536281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.544159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.544231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.544241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1956
2025-10-02T09:33:27.544387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.544409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.544415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.544418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.544747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1956 sessionId:  describe result for acl check
2025-10-02T09:33:27.544772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.544776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.544777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.544781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821239236:6199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.545145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821239236:6199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.547318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821239236:6199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.549308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821239236:6199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.549317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821239236:6199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.549319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821239236:6199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.549322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.551592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.551856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.551952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.551959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.551965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.551990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.552016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745681714:4353]
2025-10-02T09:33:27.552478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.552615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.552638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.552822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.552850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.552853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.552854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.552855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.552855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.552856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.552856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.552857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.552857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.552858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.552858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.552859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.552861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.552867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.552869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.552871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.552873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.552875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.552877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.552879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.552881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.552883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.552885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.552887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.552890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.552895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.552897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.552900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.552902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.552905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.552907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.552910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.552912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.552915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.552917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.552920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.552922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.552924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.552926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.552929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.552932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.552935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.552937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.552939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.552941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.552944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.552946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.552948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.552966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:27.560421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:27.561914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:27.561925Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:27.561926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:27.561928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:27.561931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1955 [2:7556555183745681714:4353]
2025-10-02T09:33:27.561937Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:27.561947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:27.561952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.561953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.561954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.561963Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:27.561966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:27.561969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:27.561997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.562002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.562003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.562005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:27.562006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:27.562042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:27.562047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.562053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.562059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.562067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:27.562081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239431:6199], now have 1 active actors on pipe
2025-10-02T09:33:27.562086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239147:2446], now have 1 active actors on pipe
2025-10-02T09:33:27.562089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.562091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.562092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.562100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:27.562107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:27.562113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:27.562115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:27.562116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:27.562118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:27.562120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:27.562109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1955
2025-10-02T09:33:27.562118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1955
2025-10-02T09:33:27.562133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.562138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:27.562139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:27.562148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.562153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.562293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:27.562301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.562303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.562304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:27.562309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.562314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:27.562328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.562432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.562437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.562444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.562495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1956 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0
2025-10-02T09:33:27.562744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d316983-f33c4514-49de671-ff045576_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:27.565425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Write session: try to update token
2025-10-02T09:33:27.565442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:27.571498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:27.571510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:27.571511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:27.571512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:27.571517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.571519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.571521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745681709:4353]
2025-10-02T09:33:27.571539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:27.571542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.571542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:27.571543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:27.571545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:27.571547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:27.571649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.578417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId: src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.580659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.635993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821239466:6623]
2025-10-02T09:33:27.636136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1955, pipe: [1:7556555183821239466:6623]
2025-10-02T09:33:27.682315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.682659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.682667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.682687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239466:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.682836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.682883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821239466:6623]
2025-10-02T09:33:27.682882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.682907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:27.682963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1956 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0
2025-10-02T09:33:27.683100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1956 sessionId: src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0 is DEAD
2025-10-02T09:33:27.683263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:27.683277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Write session will restart in 0.008584s
2025-10-02T09:33:27.683303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Write session: Do CDS request
2025-10-02T09:33:27.683310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.693148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.693242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.693250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1957
2025-10-02T09:33:27.693346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.693366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.693371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.693374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.693664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1957 sessionId:  describe result for acl check
2025-10-02T09:33:27.693689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.693693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.693694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.693697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821239645:6189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.694029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821239645:6189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.695618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821239645:6189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.698060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.698239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821239645:6189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.698247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821239645:6189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.698248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821239645:6189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.698251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.698289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.698412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.698419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.698426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.698453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.698475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745682040:4342]
2025-10-02T09:33:27.698819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.698980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.699001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.699173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.699201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.699205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.699206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.699206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.699207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.699207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.699208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.699208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.699209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.699209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.699210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.699210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.699213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.699219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.699221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.699223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.699225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.699227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.699229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.699231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.699233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.699235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.699237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.699239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.699242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.699246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.699249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.699253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.699255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.699257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.699259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.699262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.699264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.699267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.699269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.699272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.699274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.699277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.699279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.699282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.699284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.699290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.699292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.699294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.699298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.699300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.699302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.699305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.699321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:27.706658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:27.708164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:27.708176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:27.708177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:27.708179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:27.708182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1956 [2:7556555183745682040:4342]
2025-10-02T09:33:27.708188Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:27.708197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:27.708202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.708203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.708204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.708214Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:27.708218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:27.708222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:27.708252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.708257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.708258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.708259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:27.708261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:27.708296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:27.708301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.708307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.708312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.708322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:27.708336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239754:6189], now have 1 active actors on pipe
2025-10-02T09:33:27.708342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239467:2446], now have 1 active actors on pipe
2025-10-02T09:33:27.708345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.708346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.708347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.708354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:27.708362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:27.708369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:27.708370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:27.708371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:27.708373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:27.708374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:27.708383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.708387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:27.708374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1956
2025-10-02T09:33:27.708395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:27.708374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1956
2025-10-02T09:33:27.708407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.708408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.708424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:27.708430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.708433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.708434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:27.708439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.708448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:27.708457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.708547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.708552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.708559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.708620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1957 partition: 0 MaxSeqNo: 36 sessionId: src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0
2025-10-02T09:33:27.708858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2496c8d-d9fea8fd-a091892-7c62b13a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:27.711487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Write session: try to update token
2025-10-02T09:33:27.711503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:27.717375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:27.717386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:27.717387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:27.717389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:27.717393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.717395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.717397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745682034:4342]
2025-10-02T09:33:27.717415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:27.717419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.717420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:27.717423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:27.717426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:27.717428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:27.717533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.723829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId: src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.726070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.782941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821239766:6623]
2025-10-02T09:33:27.783108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1956, pipe: [1:7556555183821239766:6623]
2025-10-02T09:33:27.827961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.828321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.828330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.828343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239766:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.828461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.828492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.828519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821239766:6623]
2025-10-02T09:33:27.828523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:27.828589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1957 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0
2025-10-02T09:33:27.828722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1957 sessionId: src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0 is DEAD
2025-10-02T09:33:27.828907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:27.828923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Write session will restart in 0.008816s
2025-10-02T09:33:27.828943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Write session: Do CDS request
2025-10-02T09:33:27.828949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.839136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.839261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.839270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1958
2025-10-02T09:33:27.839373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.839394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.839403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.839405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.839701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1958 sessionId:  describe result for acl check
2025-10-02T09:33:27.839725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.839729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.839730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.839733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821239935:6183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.840057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821239935:6183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.841851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821239935:6183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.842507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.844294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.844424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.844432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.844438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.844469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.844492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745682330:4333]
2025-10-02T09:33:27.844489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821239935:6183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.844497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821239935:6183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.844498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821239935:6183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.844502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.844848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.845013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.845036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.845210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.845240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.845244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.845245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.845245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.845246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.845246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.845247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.845247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.845248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.845248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.845249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.845250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.845253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.845258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.845261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.845263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.845265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.845267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.845269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.845271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.845273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.845275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.845277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.845279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.845282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.845286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.845289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.845292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.845294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.845297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.845299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.845302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.845304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.845307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.845309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.845312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.845315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.845317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.845320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.845322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.845325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.845328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.845330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.845332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.845338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.845341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.845343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.845345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.845362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:27.852782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:27.854507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:27.854518Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:27.854520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:27.854521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:27.854525Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1957 [2:7556555183745682330:4333]
2025-10-02T09:33:27.854531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:27.854540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:27.854541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.854543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.854545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.854554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:27.854557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:27.854560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:27.854589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.854594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.854595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.854597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:27.854598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:27.854633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:27.854638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.854644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.854649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.854658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:27.854681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821239767:2446], now have 1 active actors on pipe
2025-10-02T09:33:27.854686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821240058:6183], now have 1 active actors on pipe
2025-10-02T09:33:27.854690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.854691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.854693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.854701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:27.854708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:27.854714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:27.854716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:27.854717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:27.854717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:27.854719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:27.854732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.854735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:27.854720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1957
2025-10-02T09:33:27.854742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:27.854752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.854721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1957
2025-10-02T09:33:27.854754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.854863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:27.854871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:27.854873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:27.854875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:27.854879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:27.854885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:27.854897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.855012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.855017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.855025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:27.855077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1958 partition: 0 MaxSeqNo: 36 sessionId: src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0
2025-10-02T09:33:27.855456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49f54b8e-5d81c530-a06eaf4e-24b9a09e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:27.858076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Write session: try to update token
2025-10-02T09:33:27.858091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:27.863795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:27.863807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:27.863808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:27.863809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:27.863815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.863818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.863821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745682325:4333]
2025-10-02T09:33:27.863841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:27.863842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:27.863845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.863845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:27.863846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:27.863847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:27.863955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:27.870143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId: src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:27.872379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:27.928851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555183821240077:6623]
2025-10-02T09:33:27.928987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1957, pipe: [1:7556555183821240077:6623]
2025-10-02T09:33:27.975878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:27.976076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:27.976084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:27.976095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821240077:6623], now have 1 active actors on pipe
2025-10-02T09:33:27.976214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:27.976225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555183821240077:6623]
2025-10-02T09:33:27.976239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:27.976245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:27.976247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:27.976286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1958 reason: error at write: Disconnected sessionId: src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0
2025-10-02T09:33:27.976427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1958 sessionId: src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0 is DEAD
2025-10-02T09:33:27.976593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:27.976606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Write session will restart in 0.006433s
2025-10-02T09:33:27.976632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Write session: Do CDS request
2025-10-02T09:33:27.976637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:27.984168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.984329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:27.984342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1959
2025-10-02T09:33:27.984492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:27.984523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:27.984533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:27.984537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:27.984937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1959 sessionId:  describe result for acl check
2025-10-02T09:33:27.984973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:27.984979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:27.984980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:27.984984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555183821240192:6177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:27.985424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555183821240192:6177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:27.987545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555183821240192:6177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:27.989160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555183821240192:6177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:27.989169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555183821240192:6177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:27.989171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555183821240192:6177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:27.989175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:27.991516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:27.991779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:27.991872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:27.991879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:27.991884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:27.991909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:27.991930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555183745682635:4338]
2025-10-02T09:33:27.992266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:27.992426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:27.992449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:27.992667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:27.992700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.992704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.992704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.992705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.992705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.992706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.992706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.992707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.992707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.992708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.992708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.992709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.992711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.992717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.992719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.992721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.992723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.992725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.992727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.992729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.992731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.992733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.992735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.992737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.992741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.992744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:27.992747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.992750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:27.992752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.992755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:27.992757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.992760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:27.992762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.992765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:27.992767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.992770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:27.992772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.992774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:27.992776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.992779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:27.992781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.992784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:27.992786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.992788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:27.992791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.992793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:27.992795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.992798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:27.992826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.000267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.001841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.001852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.001853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.001855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.001858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1958 [2:7556555183745682635:4338]
2025-10-02T09:33:28.001864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.001873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.001875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.001876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.001877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.001886Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.001893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.001897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.001925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.001929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.001931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.001933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.001934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.001968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.001973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.001979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.001984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.001992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.002006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821240377:6177], now have 1 active actors on pipe
2025-10-02T09:33:28.002011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555183821240090:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.002015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.002016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.002017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.002024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.002033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.002040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.002042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.002043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.002044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.002045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.002036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1958
2025-10-02T09:33:28.002041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1958
2025-10-02T09:33:28.002059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.002065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.002066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.002081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.002086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.002165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a035e802-451b0cf1-301cd32-433172c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.002173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.002176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.002177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.002181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.002186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.002199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.002311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.002315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.002323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.002377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1959 partition: 0 MaxSeqNo: 36 sessionId: src_id|a035e802-451b0cf1-301cd32-433172c2_0
2025-10-02T09:33:28.002621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadbae4-8b1f314c-b818fd48-ce87ee09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a035e802-451b0cf1-301cd32-433172c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.005247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Write session: try to update token
2025-10-02T09:33:28.005261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.011096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.011108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.011109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.011110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.011114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.011116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.011119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555183745682630:4338]
2025-10-02T09:33:28.011137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.011137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.011139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.011141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.011143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.011144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.011268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.017337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId: src_id|a035e802-451b0cf1-301cd32-433172c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.019569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.076316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116207687:6623]
2025-10-02T09:33:28.076509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1958, pipe: [1:7556555188116207687:6623]
2025-10-02T09:33:28.120722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:28.120962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.120971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.120983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116207687:6623], now have 1 active actors on pipe
2025-10-02T09:33:28.121102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:28.121127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:28.121152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:28.121173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116207687:6623]
2025-10-02T09:33:28.121213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1959 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a035e802-451b0cf1-301cd32-433172c2_0
2025-10-02T09:33:28.121355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1959 sessionId: src_id|a035e802-451b0cf1-301cd32-433172c2_0 is DEAD
2025-10-02T09:33:28.121515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:28.121530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Write session will restart in 0.009125s
2025-10-02T09:33:28.121551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Write session: Do CDS request
2025-10-02T09:33:28.121557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:28.132151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.132266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:28.132279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1960
2025-10-02T09:33:28.132428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.132457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:28.132465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:28.132469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:28.132853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1960 sessionId:  describe result for acl check
2025-10-02T09:33:28.132881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:28.132886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:28.132888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:28.132892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555188116207895:6171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:28.133343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555188116207895:6171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:28.134839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:28.135164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555188116207895:6171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:28.136845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:28.136981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:28.136988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:28.136994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:28.137022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:28.137044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555188040650225:4335]
2025-10-02T09:33:28.137089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555188116207895:6171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:28.137098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555188116207895:6171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:28.137100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555188116207895:6171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:28.137104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:28.137384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:28.137545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:28.137568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:28.137742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:28.137771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.137776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.137776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.137777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.137777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.137778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.137778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.137779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.137779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.137780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.137780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.137781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.137783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.137789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.137791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.137793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.137795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.137797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.137799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.137801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.137803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.137806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.137808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.137810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.137813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.137817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.137820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.137823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.137825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.137828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.137830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.137833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.137835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.137838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.137840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.137843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.137845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.137848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.137850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.137852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.137854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.137857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.137859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.137864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.137866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.137869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.137871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.137873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.137889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.145235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.146702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.146713Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.146714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.146716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.146719Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1959 [2:7556555188040650225:4335]
2025-10-02T09:33:28.146726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.146736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.146738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.146739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.146740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.146749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.146758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.146763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.146793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.146797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.146798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.146800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.146801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.146903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1959
2025-10-02T09:33:28.146908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1959
2025-10-02T09:33:28.146972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.146978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.146984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.146990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.146999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.147011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116207688:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.147016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116207978:6171], now have 1 active actors on pipe
2025-10-02T09:33:28.147027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.147032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.147041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.147045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.147046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.147054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.147064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.147067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.147069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.147070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.147075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.147077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.147085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.147092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.147094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.147095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.147100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.147108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.147121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.147129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.147133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.147134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.147216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.147221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.147230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.147273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1960 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0
2025-10-02T09:33:28.147542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035e802-451b0cf1-301cd32-433172c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.150170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Write session: try to update token
2025-10-02T09:33:28.150185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.155993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:28.156006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.156010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.156030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:28.156030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:28.156169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:28.156290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:28.156409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:28.156529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:28.156696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:28.156718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:28.162501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId: src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.164358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.164371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.164372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.164372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.164377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.164379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.164381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555188040650220:4335]
2025-10-02T09:33:28.164399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.164402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.164404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.164404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.164405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.164406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.164511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.164784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.221212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116207990:6623]
2025-10-02T09:33:28.221398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1959, pipe: [1:7556555188116207990:6623]
2025-10-02T09:33:28.273669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:28.274092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.274100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.274114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116207990:6623], now have 1 active actors on pipe
2025-10-02T09:33:28.274251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:28.274249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:28.274267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:28.274270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:28.274283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116207990:6623]
2025-10-02T09:33:28.274312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1960 reason: error at write: Disconnected sessionId: src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0
2025-10-02T09:33:28.274452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1960 sessionId: src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0 is DEAD
2025-10-02T09:33:28.274607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:28.274621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Write session will restart in 0.008160s
2025-10-02T09:33:28.274648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Write session: Do CDS request
2025-10-02T09:33:28.274653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:28.284160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.284257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:28.284266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1961
2025-10-02T09:33:28.284386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.284408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:28.284414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:28.284417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:28.284700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1961 sessionId:  describe result for acl check
2025-10-02T09:33:28.284720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:28.284724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:28.284725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:28.284728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555188116208142:6163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:28.285131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555188116208142:6163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:28.286989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555188116208142:6163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:28.288189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:28.290094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:28.290181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555188116208142:6163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:28.290190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555188116208142:6163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:28.290187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:28.290192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555188116208142:6163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:28.290193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:28.290195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:28.290199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:28.290225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:28.290248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555188040650519:4328]
2025-10-02T09:33:28.290584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:28.290768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:28.290791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:28.290964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:28.290992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.290996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.290997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.290997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.290998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.290998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.290999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.290999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.291000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.291001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.291001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.291002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.291005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.291011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.291013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.291015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.291017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.291019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.291021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.291023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.291025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.291027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.291029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.291031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.291034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.291038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.291041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.291044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.291046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.291049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.291051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.291054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.291056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.291059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.291060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.291063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.291065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.291068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.291070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.291073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.291075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.291077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.291079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.291082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.291085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.291088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.291090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.291092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.291109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.298442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.300004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.300015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.300016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.300018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.300021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1960 [2:7556555188040650519:4328]
2025-10-02T09:33:28.300027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.300036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.300037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.300038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.300039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.300048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.300051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.300055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.300081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.300087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.300088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.300090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.300091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.300125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.300130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.300136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.300141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.300151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.300164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116207993:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.300170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208284:6163], now have 1 active actors on pipe
2025-10-02T09:33:28.300173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.300174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.300175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.300182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.300193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.300195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.300197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.300198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.300203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.300204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.300200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1960
2025-10-02T09:33:28.300207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1960
2025-10-02T09:33:28.300218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.300223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.300224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.300234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.300239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.300264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.300271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.300273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.300274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.300279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.300287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.300297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.300382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.300387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.300394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.300450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1961 partition: 0 MaxSeqNo: 36 sessionId: src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0
2025-10-02T09:33:28.300695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef64a36b-790f090a-a4d5bd2a-d8a8b79_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.303273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Write session: try to update token
2025-10-02T09:33:28.303290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.309218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.309230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.309231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.309232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.309235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.309237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.309240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555188040650514:4328]
2025-10-02T09:33:28.309258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.309261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.309262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.309263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.309266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.309269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.309391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.315619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId: src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.317732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.374290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116208296:6623]
2025-10-02T09:33:28.374439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1960, pipe: [1:7556555188116208296:6623]
2025-10-02T09:33:28.416627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:28.416956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.416966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.416978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208296:6623], now have 1 active actors on pipe
2025-10-02T09:33:28.417113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:28.417133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116208296:6623]
2025-10-02T09:33:28.417134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:28.417156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:28.417209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0
2025-10-02T09:33:28.417547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:28.417566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Write session will restart in 0.005716s
2025-10-02T09:33:28.417587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Write session: Do CDS request
2025-10-02T09:33:28.417593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:28.417383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1961 sessionId: src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0 is DEAD
2025-10-02T09:33:28.424161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.424258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:28.424271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1962
2025-10-02T09:33:28.424420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.424447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:28.424455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:28.424459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:28.424849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1962 sessionId:  describe result for acl check
2025-10-02T09:33:28.424871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:28.424876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:28.424877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:28.424879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555188116208371:6160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:28.425221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555188116208371:6160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:28.427619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555188116208371:6160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:28.429657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555188116208371:6160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:28.429665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555188116208371:6160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:28.429667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555188116208371:6160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:28.429670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:28.431201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:28.432825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:28.432921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:28.432928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:28.432933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:28.432958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:28.432980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555188040650817:4320]
2025-10-02T09:33:28.433310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:28.433476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:28.433499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:28.433671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:28.433700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.433704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.433704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.433705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.433706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.433706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.433707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.433707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.433708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.433708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.433712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.433718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.433720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.433722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.433724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.433726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.433728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.433730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.433732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.433734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.433736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.433738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.433741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.433747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.433749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.433752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.433754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.433757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.433759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.433762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.433764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.433766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.433768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.433771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.433773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.433776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.433777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.433780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.433782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.433787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.433789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.433792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.433795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.433799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.433801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.433804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.433819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.441152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.442585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.442596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.442597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.442599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.442603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1961 [2:7556555188040650817:4320]
2025-10-02T09:33:28.442609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.442618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.442619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.442621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.442622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.442630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.442637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.442641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.442678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.442682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.442684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.442685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.442687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.442723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.442728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.442734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.442739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.442747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.442761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208561:6160], now have 1 active actors on pipe
2025-10-02T09:33:28.442767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208297:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.442771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.442772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.442773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.442778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.442786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.442788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.442791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.442793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.442795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.442797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.442796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1961
2025-10-02T09:33:28.442810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.442808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1961
2025-10-02T09:33:28.442813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.442819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.442823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.442824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.442849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af66279e-13ff6602-fc359f71-c14de0bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.442855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.442857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.442858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.442863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.442868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.442880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.442976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.442981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.442988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.443052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1962 partition: 0 MaxSeqNo: 36 sessionId: src_id|af66279e-13ff6602-fc359f71-c14de0bf_0
2025-10-02T09:33:28.443349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5d345f-19b6685-1ec7f392-1ee20ce7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af66279e-13ff6602-fc359f71-c14de0bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.445918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Write session: try to update token
2025-10-02T09:33:28.445936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.451781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.451793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.451794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.451796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.451799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.451801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.451803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555188040650812:4320]
2025-10-02T09:33:28.451821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.451827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.451828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.451829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.451830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.451833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.451931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.457981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId: src_id|af66279e-13ff6602-fc359f71-c14de0bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.460096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.517147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116208600:6623]
2025-10-02T09:33:28.517332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1961, pipe: [1:7556555188116208600:6623]
2025-10-02T09:33:28.560532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:28.560747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.560756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.560768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208600:6623], now have 1 active actors on pipe
2025-10-02T09:33:28.560914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:28.560916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116208600:6623]
2025-10-02T09:33:28.560917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:28.560921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:28.560936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:28.560989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1962 reason: error at write: Disconnected sessionId: src_id|af66279e-13ff6602-fc359f71-c14de0bf_0
2025-10-02T09:33:28.561173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1962 sessionId: src_id|af66279e-13ff6602-fc359f71-c14de0bf_0 is DEAD
2025-10-02T09:33:28.561332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:28.561348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Write session will restart in 0.008434s
2025-10-02T09:33:28.561370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Write session: Do CDS request
2025-10-02T09:33:28.561376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:28.571209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.571305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:28.571316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1963
2025-10-02T09:33:28.571457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.571485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:28.571493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:28.571496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:28.571751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1963 sessionId:  describe result for acl check
2025-10-02T09:33:28.571774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:28.571780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:28.571781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:28.571783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555188116208758:6154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:28.572111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555188116208758:6154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:28.573821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555188116208758:6154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:28.575426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:28.577079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:28.577171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:28.577177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:28.577183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:28.577206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:28.577228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555188040651111:4312]
2025-10-02T09:33:28.577289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555188116208758:6154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:28.577296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555188116208758:6154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:28.577298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555188116208758:6154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:28.577301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:28.577563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:28.577759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:28.577799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:28.577994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:28.578025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.578029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.578029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.578030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.578030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.578031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.578031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.578032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.578032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.578033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.578033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.578034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.578037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.578042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.578044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.578046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.578048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.578050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.578052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.578054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.578056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.578058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.578060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.578062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.578066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.578069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.578073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.578075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.578078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.578080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.578082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.578085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.578087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.578090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.578092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.578095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.578097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.578099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.578102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.578104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.578106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.578109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.578111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.578114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.578116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.578118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.578120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.578123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.578139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.585609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.587124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.587136Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.587137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.587139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.587142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1962 [2:7556555188040651111:4312]
2025-10-02T09:33:28.587149Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.587159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.587164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.587165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.587166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.587176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.587178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.587182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.587210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.587215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.587216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.587218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.587219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.587254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.587259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.587266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.587271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.587279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.587292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.587297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.587298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.587302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.587309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.587310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208895:6154], now have 1 active actors on pipe
2025-10-02T09:33:28.587312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208602:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.587317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.587318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.587321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.587324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.587325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.587340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.587349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.587351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.587347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1962
2025-10-02T09:33:28.587361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1962
2025-10-02T09:33:28.587375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.587381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.587394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.587400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.587403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.587404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.587409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.587417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.587424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.587563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.587568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.587575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.587628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1963 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0
2025-10-02T09:33:28.587876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af66279e-13ff6602-fc359f71-c14de0bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.590444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Write session: try to update token
2025-10-02T09:33:28.590459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.596290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.596301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.596302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.596303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.596307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.596309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.596312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555188040651106:4312]
2025-10-02T09:33:28.596330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.596332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.596333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.596344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.596347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.596350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.596437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.602703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId: src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.604823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.661026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116208928:6623]
2025-10-02T09:33:28.661217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1962, pipe: [1:7556555188116208928:6623]
2025-10-02T09:33:28.710871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:28.711218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.711228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.711240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208928:6623], now have 1 active actors on pipe
2025-10-02T09:33:28.711376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:28.711394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116208928:6623]
2025-10-02T09:33:28.711401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:28.711424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:28.711426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:28.711486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1963 reason: error at write: Disconnected sessionId: src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0
2025-10-02T09:33:28.711641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1963 sessionId: src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0 is DEAD
2025-10-02T09:33:28.711797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:28.711812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Write session will restart in 0.008112s
2025-10-02T09:33:28.711838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Write session: Do CDS request
2025-10-02T09:33:28.711844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:28.721118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.721239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:28.721252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1964
2025-10-02T09:33:28.721399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.721428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:28.721436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:28.721439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:28.721764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1964 sessionId:  describe result for acl check
2025-10-02T09:33:28.721788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:28.721792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:28.721793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:28.721796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555188116209062:6138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:28.722140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555188116209062:6138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:28.724262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555188116209062:6138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:28.726135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:28.728009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:28.728137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555188116209062:6138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:28.728145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555188116209062:6138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:28.728148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555188116209062:6138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:28.728152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:28.728178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:28.728186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:28.728193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:28.728226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:28.728250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555188040651444:4303]
2025-10-02T09:33:28.728596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:28.728761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:28.728785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:28.728978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:28.729009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.729012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.729013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.729014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.729014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.729015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.729015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.729016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.729016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.729017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.729018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.729018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.729021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.729026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.729028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.729030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.729032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.729034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.729036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.729038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.729040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.729042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.729044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.729046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.729049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.729053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.729057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.729059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.729061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.729064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.729066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.729070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.729074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.729078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.729082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.729086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.729089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.729093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.729097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.729102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.729106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.729110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.729112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.729114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.729116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.729119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.729121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.729123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.729140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.736861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.738247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.738259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.738261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.738263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.738266Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1963 [2:7556555188040651444:4303]
2025-10-02T09:33:28.738274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.738285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.738288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.738292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.738294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.738305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.738314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.738319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.738349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.738354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.738355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.738357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.738358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.738394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.738399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.738405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.738410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.738418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.738433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116208930:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.738438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116209223:6138], now have 1 active actors on pipe
2025-10-02T09:33:28.738442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.738443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.738444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.738451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.738459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.738461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.738463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.738466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.738469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.738471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.738472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1963
2025-10-02T09:33:28.738475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1963
2025-10-02T09:33:28.738485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.738491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.738492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.738500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.738502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.738646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.738653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.738656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.738656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.738661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.738680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.738697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.738810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.738816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.738826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.738882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1964 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0
2025-10-02T09:33:28.739144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a45ad9-17f21027-acdd325a-7e17bec8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.741852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Write session: try to update token
2025-10-02T09:33:28.741864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.748343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.748357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.748359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.748360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.748366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.748369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.748372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555188040651439:4303]
2025-10-02T09:33:28.748394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.748397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.748398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.748398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.748403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.748405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.748498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.753969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId: src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.756124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.811542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116209235:6623]
2025-10-02T09:33:28.811711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1963, pipe: [1:7556555188116209235:6623]
2025-10-02T09:33:28.857450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:28.857757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.857766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.857778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116209235:6623], now have 1 active actors on pipe
2025-10-02T09:33:28.857917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:28.857923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116209235:6623]
2025-10-02T09:33:28.857923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:28.857927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:28.857945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:28.857970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1964 reason: error at write: Disconnected sessionId: src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0
2025-10-02T09:33:28.858102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1964 sessionId: src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0 is DEAD
2025-10-02T09:33:28.858217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:28.858225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Write session will restart in 0.006941s
2025-10-02T09:33:28.858240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Write session: Do CDS request
2025-10-02T09:33:28.858244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:28.866200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.866339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:28.866351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1965
2025-10-02T09:33:28.866471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:28.866498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:28.866505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:28.866508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:28.866836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1965 sessionId:  describe result for acl check
2025-10-02T09:33:28.866865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:28.866871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:28.866873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:28.866877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555188116209347:6132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:28.867323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555188116209347:6132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:28.869439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555188116209347:6132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:28.871328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555188116209347:6132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:28.871336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555188116209347:6132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:28.871338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555188116209347:6132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:28.871341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:28.872078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:28.873946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:28.874066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:28.874074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:28.874080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:28.874110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:28.874132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555188040651754:4298]
2025-10-02T09:33:28.874475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:28.874660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:28.874701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:28.874996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:28.875031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.875036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.875036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.875037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.875037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.875038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.875039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.875039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.875040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.875040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.875041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.875042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.875045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.875051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.875053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.875055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.875057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.875059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.875061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.875063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.875065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.875068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.875070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.875072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.875076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.875080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:28.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.875086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:28.875088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.875090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:28.875092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.875095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:28.875097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.875100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:28.875102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.875105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:28.875107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.875109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:28.875111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.875114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:28.875116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.875119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:28.875121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.875123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.875125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.875128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.875130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.875132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.875147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:28.882630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:28.884153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:28.884164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:28.884165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:28.884167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:28.884170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1964 [2:7556555188040651754:4298]
2025-10-02T09:33:28.884176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:28.884185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:28.884187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.884189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.884190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.884198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:28.884201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:28.884205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:28.884234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.884239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.884241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.884242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:28.884244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:28.884276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:28.884280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.884287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:28.884292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:28.884303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:28.884317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116209534:6132], now have 1 active actors on pipe
2025-10-02T09:33:28.884322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116209242:2446], now have 1 active actors on pipe
2025-10-02T09:33:28.884326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.884327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.884328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.884335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:28.884342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:28.884352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:28.884353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:28.884354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:28.884361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:28.884361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:28.884367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.884369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:28.884377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:28.884364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1964
2025-10-02T09:33:28.884366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1964
2025-10-02T09:33:28.884398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.884403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.884416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:28.884423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:28.884426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:28.884427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:28.884433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:28.884439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:28.884447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.884533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:28.884538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:28.884545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:28.884609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1965 partition: 0 MaxSeqNo: 36 sessionId: src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0
2025-10-02T09:33:28.884856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf4d035e-257dce29-ccd18ffe-b460ae34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:28.887538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Write session: try to update token
2025-10-02T09:33:28.887552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:28.893848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:28.893866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:28.893869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:28.893871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:28.893877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.893881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.893886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555188040651737:4298]
2025-10-02T09:33:28.893910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:28.893911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:28.893914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:28.893915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:28.893918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:28.893920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:28.894039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:28.899459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId: src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:28.901565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:28.957980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555188116209551:6623]
2025-10-02T09:33:28.958131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1964, pipe: [1:7556555188116209551:6623]
2025-10-02T09:33:29.003652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.003981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.003990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.004015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555188116209551:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.004173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.004196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.004204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555188116209551:6623]
2025-10-02T09:33:29.004220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:29.004272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1965 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0
2025-10-02T09:33:29.004404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1965 sessionId: src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0 is DEAD
2025-10-02T09:33:29.004556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:29.004569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Write session will restart in 0.006901s
2025-10-02T09:33:29.004596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Write session: Do CDS request
2025-10-02T09:33:29.004601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.012141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.012270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.012282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1966
2025-10-02T09:33:29.012426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.012463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.012468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.012471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.012791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1966 sessionId:  describe result for acl check
2025-10-02T09:33:29.012829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.012834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.012835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.012838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411176945:6126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.013166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411176945:6126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.015352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411176945:6126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.017931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411176945:6126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.017941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411176945:6126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.017944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411176945:6126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.017947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.018875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.020583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.020677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.020684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.020689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.020714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.020739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335619351:4290]
2025-10-02T09:33:29.021354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.021522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.021544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.021812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.021841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.021845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.021845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.021846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.021847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.021847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.021848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.021848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.021849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.021850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.021850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.021851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.021854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.021859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.021862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.021864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.021866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.021868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.021870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.021872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.021874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.021876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.021878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.021880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.021884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.021888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.021892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.021895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.021897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.021900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.021902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.021904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.021907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.021910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.021912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.021915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.021917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.021920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.021922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.021925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.021927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.021934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.021937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.021939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.021942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.021945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.021948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.021951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.021970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.029378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.030912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.030923Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.030924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.030925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.030929Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1965 [2:7556555192335619351:4290]
2025-10-02T09:33:29.030935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.030944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.030949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.030951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.030951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.030960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.030963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.030967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.030993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.030998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.030999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.031000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.031002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.031038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.031043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.031049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.031054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.031064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.031076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411176860:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.031081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177153:6126], now have 1 active actors on pipe
2025-10-02T09:33:29.031084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.031086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.031087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.031094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.031102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.031108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.031110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.031111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.031112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.031113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.031105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1965
2025-10-02T09:33:29.031108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1965
2025-10-02T09:33:29.031128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.031133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.031134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.031144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.031148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.031173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.031180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.031182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.031183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.031188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.031196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.031204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.031312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.031318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.031325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.031383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1966 partition: 0 MaxSeqNo: 36 sessionId: src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0
2025-10-02T09:33:29.031649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdb9b90-ab3b5c9b-fe936a72-4ad3d0f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.034311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Write session: try to update token
2025-10-02T09:33:29.034328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.040310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.040323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.040325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.040326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.040330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.040332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.040336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335619346:4290]
2025-10-02T09:33:29.040353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.040358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.040360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.040361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.040361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.040363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.040467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.046809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId: src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.048925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.104411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411177168:6623]
2025-10-02T09:33:29.104566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1965, pipe: [1:7556555192411177168:6623]
2025-10-02T09:33:29.149186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.149396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.149404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.149416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177168:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.149548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.149620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411177168:6623]
2025-10-02T09:33:29.149625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.149646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:29.149648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:29.149691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1966 reason: error at write: Disconnected sessionId: src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0
2025-10-02T09:33:29.149824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1966 sessionId: src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0 is DEAD
2025-10-02T09:33:29.149974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:29.149989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Write session will restart in 0.008056s
2025-10-02T09:33:29.150009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Write session: Do CDS request
2025-10-02T09:33:29.150015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.159154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.159271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.159281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1967
2025-10-02T09:33:29.159396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.159416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.159423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.159425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.159790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1967 sessionId:  describe result for acl check
2025-10-02T09:33:29.159816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.159822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.159823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.159826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411177298:6115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.160181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411177298:6115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.162075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411177298:6115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.163633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411177298:6115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.163641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411177298:6115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.163643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411177298:6115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.163647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.164051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.165816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.165952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.165959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.165965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.165995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.166017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335619651:4276]
2025-10-02T09:33:29.166352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.166515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.166538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.166721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.166751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.166755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.166756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.166757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.166757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.166758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.166758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.166759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.166759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.166760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.166760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.166761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.166764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.166769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.166772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.166774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.166775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.166777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.166779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.166781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.166783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.166785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.166787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.166789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.166792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.166796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.166800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.166803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.166805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.166807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.166810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.166812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.166815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.166817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.166819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.166822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.166824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.166826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.166829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.166832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.166834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.166837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.166839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.166841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.166843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.166846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.166848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.166851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.166867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.174638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.176171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.176183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.176184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.176186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.176189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1966 [2:7556555192335619651:4276]
2025-10-02T09:33:29.176196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.176205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.176210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.176212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.176213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.176222Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.176224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.176228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.176257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.176261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.176263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.176264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.176266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.176300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.176305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.176312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.176317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.176325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.176339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177464:6115], now have 1 active actors on pipe
2025-10-02T09:33:29.176345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177169:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.176348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.176349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.176351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.176358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.176369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.176372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.176373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.176375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.176379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.176381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.176395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.176401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.176380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1966
2025-10-02T09:33:29.176402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.176382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1966
2025-10-02T09:33:29.176414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.176417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.176440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.176447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.176448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.176450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.176454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.176459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.176467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.176544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.176548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.176555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.176607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1967 partition: 0 MaxSeqNo: 36 sessionId: src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0
2025-10-02T09:33:29.176905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806586a5-3864e9fa-af8f6c99-bb3e54c6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.179543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Write session: try to update token
2025-10-02T09:33:29.179560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.185444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.185456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.185457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.185458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.185463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.185465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.185467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335619646:4276]
2025-10-02T09:33:29.185486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.185490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.185492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.185493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.185493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.185495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.185598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.191479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId: src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.193734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.249810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411177480:6623]
2025-10-02T09:33:29.249974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1966, pipe: [1:7556555192411177480:6623]
2025-10-02T09:33:29.294515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.294865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.294873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.294886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177480:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.295005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.295051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:29.295061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:29.295074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411177480:6623]
2025-10-02T09:33:29.295088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.295105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1967 reason: error at write: Disconnected sessionId: src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0
2025-10-02T09:33:29.295240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1967 sessionId: src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0 is DEAD
2025-10-02T09:33:29.295395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:29.295410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Write session will restart in 0.006918s
2025-10-02T09:33:29.295437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Write session: Do CDS request
2025-10-02T09:33:29.295443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.303207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.303292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.303302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1968
2025-10-02T09:33:29.303419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.303439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.303445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.303448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.303877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1968 sessionId:  describe result for acl check
2025-10-02T09:33:29.303902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.303907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.303908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.303912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411177575:6109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.304258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411177575:6109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.306074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411177575:6109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.308097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411177575:6109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.308105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411177575:6109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.308107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411177575:6109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.308111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.309364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.311066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.311160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.311167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.311172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.311197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.311219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335619954:4284]
2025-10-02T09:33:29.311552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.311702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.311724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.311895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.311925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.311929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.311929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.311930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.311930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.311931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.311931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.311932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.311932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.311933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.311933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.311934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.311936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.311943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.311945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.311947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.311949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.311951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.311953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.311955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.311957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.311959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.311961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.311963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.311967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.311971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.311974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.311976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.311979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.311982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.311983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.311986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.311988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.311990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.311992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.311995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.311997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.311999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.312001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.312004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.312006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.312009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.312011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.312013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.312016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.312019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.312021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.312023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.312041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.319359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.320976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.320986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.320987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.320989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.320991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1967 [2:7556555192335619954:4284]
2025-10-02T09:33:29.320997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.321007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.321008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.321009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.321010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.321019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.321025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.321030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.321059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.321063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.321064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.321066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.321067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.321101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.321106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.321112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.321119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.321128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.321142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177766:6109], now have 1 active actors on pipe
2025-10-02T09:33:29.321147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177481:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.321150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.321151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.321153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.321161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.321171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.321174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.321175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.321177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.321181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.321183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.321183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1967
2025-10-02T09:33:29.321196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.321201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.321183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1967
2025-10-02T09:33:29.321203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.321211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.321216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.321241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.321247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.321249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.321250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.321256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.321264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.321273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.321349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.321354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.321361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.321412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1968 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0
2025-10-02T09:33:29.321685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faea9cad-f6f2a406-b99882e2-adc58e3d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.324300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Write session: try to update token
2025-10-02T09:33:29.324314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.330166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.330179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.330180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.330181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.330184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.330186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.330188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335619949:4284]
2025-10-02T09:33:29.330206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.330211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.330213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.330214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.330217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.330219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.330316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.336340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId: src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.338569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.395225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411177791:6623]
2025-10-02T09:33:29.395348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1967, pipe: [1:7556555192411177791:6623]
2025-10-02T09:33:29.438023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.438221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.438229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.438241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177791:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.438408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411177791:6623]
2025-10-02T09:33:29.438409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:29.438412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:29.438429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.438452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1968 reason: error at write: Disconnected sessionId: src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0
2025-10-02T09:33:29.438486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.438601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1968 sessionId: src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0 is DEAD
2025-10-02T09:33:29.438892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:29.438908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Write session will restart in 0.007819s
2025-10-02T09:33:29.438931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Write session: Do CDS request
2025-10-02T09:33:29.438936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.448235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.448336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.448347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1969
2025-10-02T09:33:29.448465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.448491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.448499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.448502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.448852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1969 sessionId:  describe result for acl check
2025-10-02T09:33:29.448874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.448877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.448878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.448881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411177937:6105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.449241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411177937:6105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.451380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411177937:6105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.452622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.454443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.454538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.454545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.454550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.454575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.454597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335620255:4277]
2025-10-02T09:33:29.454655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411177937:6105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.454662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411177937:6105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.454664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411177937:6105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.454675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.454941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.455093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.455114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.455289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.455406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.455411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.455412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.455412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.455413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.455413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.455414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.455414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.455415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.455415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.455416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.455416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.455420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.455426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.455428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.455431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.455433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.455435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.455437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.455439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.455441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.455443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.455445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.455447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.455451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.455455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.455458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.455461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.455463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.455466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.455468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.455471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.455473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.455476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.455478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.455481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.455483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.455486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.455487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.455490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.455492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.455495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.455496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.455499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.455501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.455503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.455505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.455508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.455525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.462879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.464312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.464325Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.464326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.464328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.464331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1968 [2:7556555192335620255:4277]
2025-10-02T09:33:29.464338Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.464349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.464350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.464351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.464353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.464362Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.464365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.464369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.464397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.464403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.464404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.464406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.464407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.464444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.464448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.464455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.464461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.464469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.464483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411177792:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.464489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178091:6105], now have 1 active actors on pipe
2025-10-02T09:33:29.464493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.464494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.464495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.464503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.464512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.464515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.464517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.464518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.464524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.464525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.464515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1968
2025-10-02T09:33:29.464521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1968
2025-10-02T09:33:29.464539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.464544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.464545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.464556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.464560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.464585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|151f426a-46f2609e-1ea59012-21fc3369_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.464592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.464594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.464595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.464600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.464608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.464620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.464718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.464722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.464730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.464783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1969 partition: 0 MaxSeqNo: 36 sessionId: src_id|151f426a-46f2609e-1ea59012-21fc3369_0
2025-10-02T09:33:29.465044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc55597-9fff7146-3aae38d0-f0f7d3a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|151f426a-46f2609e-1ea59012-21fc3369_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.467647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Write session: try to update token
2025-10-02T09:33:29.467663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.473543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.473555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.473556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.473557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.473562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.473564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.473566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335620250:4277]
2025-10-02T09:33:29.473584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.473590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.473591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.473594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.473598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.473599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.473700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.479831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId: src_id|151f426a-46f2609e-1ea59012-21fc3369_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.482035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.538588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411178103:6623]
2025-10-02T09:33:29.538794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1968, pipe: [1:7556555192411178103:6623]
2025-10-02T09:33:29.585366Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.585859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.585868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.585881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178103:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.586002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.586017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411178103:6623]
2025-10-02T09:33:29.586037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:29.586039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:29.586090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1969 reason: error at write: Disconnected sessionId: src_id|151f426a-46f2609e-1ea59012-21fc3369_0
2025-10-02T09:33:29.586238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1969 sessionId: src_id|151f426a-46f2609e-1ea59012-21fc3369_0 is DEAD
2025-10-02T09:33:29.586347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.586396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:29.586411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Write session will restart in 0.008497s
2025-10-02T09:33:29.586439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Write session: Do CDS request
2025-10-02T09:33:29.586445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.596227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.596319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.596331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1970
2025-10-02T09:33:29.596481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.596510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.596518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.596522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.596856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1970 sessionId:  describe result for acl check
2025-10-02T09:33:29.596882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.596888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.596889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.596894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411178264:6100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.597344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411178264:6100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.599348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411178264:6100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.600507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.602347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.602489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.602496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.602503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.602532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.602554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335620558:4281]
2025-10-02T09:33:29.602571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411178264:6100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.602582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411178264:6100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.602584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411178264:6100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.602587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.602903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.603068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.603092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.603266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.603298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.603298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.603299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.603299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.603300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.603301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.603301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.603302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.603302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.603303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.603303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.603306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.603312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.603314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.603316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.603319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.603321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.603322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.603324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.603326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.603328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.603330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.603332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.603336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.603340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.603343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.603346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.603349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.603351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.603356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.603359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.603361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.603364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.603366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.603372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.603375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.603377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.603380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.603382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.603386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.603388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.603392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.603395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.603397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.603399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.603402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.603404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.603421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.610911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.612609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.612620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.612621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.612623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.612626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1969 [2:7556555192335620558:4281]
2025-10-02T09:33:29.612633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.612641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.612643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.612645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.612646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.612654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.612657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.612661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.612689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.612695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.612696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.612698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.612699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.612734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.612739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.612745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.612750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.612760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.612775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178104:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.612781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178404:6100], now have 1 active actors on pipe
2025-10-02T09:33:29.612784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.612785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.612786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.612793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.612815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.612819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.612821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.612822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.612824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.612825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.612816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1969
2025-10-02T09:33:29.612819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1969
2025-10-02T09:33:29.612849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.612854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.612861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.612869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.612879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.612886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3adcec32-54094c60-5a8485b0-220bd83e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.612889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.612891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.612892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.612897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.612903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.612916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.613020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.613025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.613032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.613087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1970 partition: 0 MaxSeqNo: 36 sessionId: src_id|3adcec32-54094c60-5a8485b0-220bd83e_0
2025-10-02T09:33:29.613395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f426a-46f2609e-1ea59012-21fc3369_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3adcec32-54094c60-5a8485b0-220bd83e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.616090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Write session: try to update token
2025-10-02T09:33:29.616106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.622082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.622095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.622097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.622098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.622102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.622104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.622108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335620553:4281]
2025-10-02T09:33:29.622128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.622132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.622133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.622135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.622138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.622141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.622242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.629047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId: src_id|3adcec32-54094c60-5a8485b0-220bd83e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.631208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.686035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411178438:6623]
2025-10-02T09:33:29.686178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1969, pipe: [1:7556555192411178438:6623]
2025-10-02T09:33:29.734975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.735224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.735232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.735244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178438:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.735357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.735402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:29.735404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.735435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411178438:6623]
2025-10-02T09:33:29.735478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1970 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3adcec32-54094c60-5a8485b0-220bd83e_0
2025-10-02T09:33:29.735645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1970 sessionId: src_id|3adcec32-54094c60-5a8485b0-220bd83e_0 is DEAD
2025-10-02T09:33:29.735814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:29.735831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Write session will restart in 0.005816s
2025-10-02T09:33:29.735852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Write session: Do CDS request
2025-10-02T09:33:29.735858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.743245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.743302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.743314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1971
2025-10-02T09:33:29.743453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.743481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.743489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.743492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.743793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1971 sessionId:  describe result for acl check
2025-10-02T09:33:29.743819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.743824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.743825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.743828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411178525:6076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.744176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411178525:6076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.746468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411178525:6076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.748968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411178525:6076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.748976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411178525:6076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.748978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411178525:6076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.748982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.751982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.752249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.752340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.752346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.752352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.752380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.752402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335620899:4257]
2025-10-02T09:33:29.752747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.752912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.752934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.753109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.753139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.753143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.753144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.753145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.753145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.753146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.753146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.753147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.753147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.753148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.753149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.753149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.753152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.753159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.753161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.753163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.753165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.753167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.753169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.753171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.753173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.753175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.753177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.753179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.753182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.753186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.753189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.753192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.753194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.753197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.753199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.753202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.753205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.753207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.753209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.753212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.753214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.753217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.753219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.753222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.753225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.753227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.753229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.753232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.753234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.753237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.753240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.753243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.753260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.760747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.762343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.762355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.762356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.762358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.762361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1970 [2:7556555192335620899:4257]
2025-10-02T09:33:29.762368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.762377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.762379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.762380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.762381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.762390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.762392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.762397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.762426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.762431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.762433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.762434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.762436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.762471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.762476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.762482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.762487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.762496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.762510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178441:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.762516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178745:6076], now have 1 active actors on pipe
2025-10-02T09:33:29.762520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.762521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.762522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.762530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.762540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.762543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.762546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.762547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.762551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.762552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.762551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1970
2025-10-02T09:33:29.762559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1970
2025-10-02T09:33:29.762566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.762571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.762573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.762586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.762592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.762610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.762617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.762619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.762620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.762625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.762630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.762643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.762757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.762762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.762769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.762823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1971 partition: 0 MaxSeqNo: 36 sessionId: src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0
2025-10-02T09:33:29.763094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adcec32-54094c60-5a8485b0-220bd83e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.765740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Write session: try to update token
2025-10-02T09:33:29.765756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.771645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.771656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.771657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.771658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.771661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.771665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.771667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335620894:4257]
2025-10-02T09:33:29.771686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.771689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.771690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.771690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.771693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.771695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.771797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.777898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId: src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.780010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.835550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411178772:6623]
2025-10-02T09:33:29.835720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1970, pipe: [1:7556555192411178772:6623]
2025-10-02T09:33:29.880732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:29.880972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.880982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.880994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178772:6623], now have 1 active actors on pipe
2025-10-02T09:33:29.881111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:29.881140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411178772:6623]
2025-10-02T09:33:29.881145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:29.881163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:29.881212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1971 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0
2025-10-02T09:33:29.881349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1971 sessionId: src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0 is DEAD
2025-10-02T09:33:29.881517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:29.881532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Write session will restart in 0.006522s
2025-10-02T09:33:29.881554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Write session: Do CDS request
2025-10-02T09:33:29.881560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:29.889211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.889299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:29.889308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1972
2025-10-02T09:33:29.889442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:29.889462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:29.889468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:29.889471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:29.889731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1972 sessionId:  describe result for acl check
2025-10-02T09:33:29.889756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:29.889760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:29.889761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:29.889764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555192411178866:6067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:29.890088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555192411178866:6067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:29.891885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555192411178866:6067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:29.894425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555192411178866:6067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:29.894434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555192411178866:6067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:29.894436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555192411178866:6067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:29.894440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:29.895679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:29.897747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:29.897846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:29.897852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:29.897857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:29.897886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:29.897907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555192335621225:4256]
2025-10-02T09:33:29.898238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:29.898387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:29.898409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:29.898580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:29.898608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.898611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.898612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.898613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.898613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.898614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.898614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.898615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.898615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.898616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.898616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.898617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.898619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.898625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.898627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.898629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.898631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.898633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.898635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.898637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.898639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.898641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.898643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.898645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.898649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.898652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:29.898655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.898658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:29.898661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.898663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:29.898676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.898679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:29.898681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.898684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:29.898687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.898690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:29.898692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.898695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:29.898697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.898699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:29.898702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.898705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:29.898707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.898709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.898714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.898716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.898719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.898721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.898739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:29.906397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:29.908005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:29.908018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:29.908019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:29.908021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:29.908024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1971 [2:7556555192335621225:4256]
2025-10-02T09:33:29.908031Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:29.908040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:29.908042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.908043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.908044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.908052Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:29.908055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:29.908059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:29.908088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.908094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.908095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.908096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:29.908098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:29.908132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:29.908137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.908143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:29.908148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:29.908158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:29.908172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411178776:2446], now have 1 active actors on pipe
2025-10-02T09:33:29.908177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411179070:6067], now have 1 active actors on pipe
2025-10-02T09:33:29.908181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.908182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.908184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.908191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:29.908202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:29.908203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:29.908206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:29.908207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:29.908212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:29.908214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:29.908206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1971
2025-10-02T09:33:29.908227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.908220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1971
2025-10-02T09:33:29.908232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:29.908234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:29.908249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.908251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.908270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bf63889-3d530235-4257c357-59f2ab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:29.908277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:29.908279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:29.908280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:29.908285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:29.908292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:29.908301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.908391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:29.908396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:29.908403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:29.908454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1972 partition: 0 MaxSeqNo: 36 sessionId: src_id|5bf63889-3d530235-4257c357-59f2ab9_0
2025-10-02T09:33:29.908715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3b147-659ecc54-c6d48eb0-dc639766_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5bf63889-3d530235-4257c357-59f2ab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:29.911343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Write session: try to update token
2025-10-02T09:33:29.911358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:29.917645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:29.917659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:29.917660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:29.917661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:29.917664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.917667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.917669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555192335621215:4256]
2025-10-02T09:33:29.917686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:29.917689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:29.917691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:29.917693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:29.917696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:29.917698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:29.917805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:29.924584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId: src_id|5bf63889-3d530235-4257c357-59f2ab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:29.926717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:29.981455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555192411179108:6623]
2025-10-02T09:33:29.981586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1971, pipe: [1:7556555192411179108:6623]
2025-10-02T09:33:30.029213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.029670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.029679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.029692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555192411179108:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.029815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.029863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555192411179108:6623]
2025-10-02T09:33:30.029873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:30.029885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.029933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1972 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5bf63889-3d530235-4257c357-59f2ab9_0
2025-10-02T09:33:30.030080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1972 sessionId: src_id|5bf63889-3d530235-4257c357-59f2ab9_0 is DEAD
2025-10-02T09:33:30.030247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:30.030263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Write session will restart in 0.006662s
2025-10-02T09:33:30.030290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Write session: Do CDS request
2025-10-02T09:33:30.030296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.036016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.038222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.038322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.038331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1973
2025-10-02T09:33:30.038374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.038450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.038469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.038476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.038478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.038478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.038486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.038492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.038520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.038544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588578:4247]
2025-10-02T09:33:30.038773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1973 sessionId:  describe result for acl check
2025-10-02T09:33:30.038794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.038798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.038799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.038803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146426:6062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.038919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.039095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.039119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.039164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146426:6062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.039308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.039339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.039343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.039344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.039344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.039345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.039346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.039346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.039347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.039347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.039348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.039348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.039351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.039353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.039360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.039363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.039365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.039367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.039369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.039371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.039373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.039375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.039378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.039380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.039382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.039386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.039390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.039394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.039397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.039399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.039402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.039404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.039407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.039409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.039412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.039414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.039417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.039422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.039425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.039427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.039430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.039433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.039436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.039441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.039444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.039446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.039449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.039451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.039454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.039473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.040690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146426:6062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.044911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146426:6062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.044922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146426:6062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.044924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146426:6062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.044928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.047155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.048587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.048600Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.048601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.048604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.048608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1972 [2:7556555196630588578:4247]
2025-10-02T09:33:30.048615Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.048625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.048632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.048634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.048635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.048644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.048647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.048651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.048683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.048688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.048690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.048692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.048694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.048731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.048736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.048743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.048748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.048758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.048773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146470:6062], now have 1 active actors on pipe
2025-10-02T09:33:30.048778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146406:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.048782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.048783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.048784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.048792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.048817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.048816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.048818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.048819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.048828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.048830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.048823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1972
2025-10-02T09:33:30.048845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.048849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.048852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.048824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1972
2025-10-02T09:33:30.048860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.048864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.048893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.048899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.048901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.048903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.048908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.048913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.048925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.049023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.049028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.049035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.049078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1973 partition: 0 MaxSeqNo: 36 sessionId: src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0
2025-10-02T09:33:30.049351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf63889-3d530235-4257c357-59f2ab9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.051959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Write session: try to update token
2025-10-02T09:33:30.051974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.058445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.058457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.058459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.058460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.058465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.058467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.058469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588573:4247]
2025-10-02T09:33:30.058488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.058491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.058492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.058495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.058498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.058500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.058605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.064242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId: src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.066391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.129961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146484:6623]
2025-10-02T09:33:30.130160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1972, pipe: [1:7556555196706146484:6623]
2025-10-02T09:33:30.170916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.171137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.171147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.171160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146484:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.171315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.171315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:30.171328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:30.171342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146484:6623]
2025-10-02T09:33:30.171356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.171375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1973 reason: error at write: Disconnected sessionId: src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0
2025-10-02T09:33:30.171518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1973 sessionId: src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0 is DEAD
2025-10-02T09:33:30.171650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:30.171667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Write session will restart in 0.005823s
2025-10-02T09:33:30.171689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Write session: Do CDS request
2025-10-02T09:33:30.171695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.177327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.178137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.178232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.178240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1974
2025-10-02T09:33:30.178366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.178386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.178392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.178394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.178726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1974 sessionId:  describe result for acl check
2025-10-02T09:33:30.178749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.178753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.178754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.178757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146505:6051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.179101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146505:6051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.179525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.179618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.179624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.179630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.179654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.179679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588636:4245]
2025-10-02T09:33:30.180010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.180156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.180179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.180355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.180387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.180391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.180392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.180393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.180393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.180394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.180396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.180397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.180397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.180398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.180398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.180399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.180402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.180408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.180410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.180412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.180414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.180416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.180418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.180420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.180421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.180424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.180426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.180427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.180431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.180435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.180438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.180441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.180443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.180447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.180449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.180452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.180454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.180457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.180459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.180461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.180465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.180469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.180471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.180456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146505:6051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.180473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.180475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.180478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.180480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.180483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.180485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.180487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.180489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.180492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.180508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.184435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146505:6051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.184444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146505:6051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.184446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146505:6051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.184450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.188215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.189707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.189720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.189721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.189723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.189726Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1973 [2:7556555196630588636:4245]
2025-10-02T09:33:30.189734Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.189744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.189746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.189747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.189748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.189757Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.189763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.189768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.189801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.189806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.189807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.189809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.189810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.189847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.189851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.189858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.189863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.189871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.189886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146544:6051], now have 1 active actors on pipe
2025-10-02T09:33:30.189891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146485:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.189895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.189896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.189897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.189904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.189914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.189917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.189919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.189920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.189924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.189926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.189921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1973
2025-10-02T09:33:30.189921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1973
2025-10-02T09:33:30.189941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.189946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.189947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.189955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.189960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.189989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c644a8da-b479d15f-7ced81ea-30492e52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.189998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.190003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.190004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.190009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.190017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.190029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.190117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.190122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.190129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.190184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1974 partition: 0 MaxSeqNo: 36 sessionId: src_id|c644a8da-b479d15f-7ced81ea-30492e52_0
2025-10-02T09:33:30.190473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d875ad18-fbd61566-fb8e28f7-faf160ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c644a8da-b479d15f-7ced81ea-30492e52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.193116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Write session: try to update token
2025-10-02T09:33:30.193132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.199437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.199451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.199452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.199453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.199458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.199461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.199464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588631:4245]
2025-10-02T09:33:30.199483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.199486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.199489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.199489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.199490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.199491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.199597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.205544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId: src_id|c644a8da-b479d15f-7ced81ea-30492e52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.207690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.271274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146554:6623]
2025-10-02T09:33:30.271445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1973, pipe: [1:7556555196706146554:6623]
2025-10-02T09:33:30.313207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.313430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.313439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.313451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146554:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.313613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.313652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:30.313652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.313663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:30.313686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146554:6623]
2025-10-02T09:33:30.313711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1974 reason: error at write: Disconnected sessionId: src_id|c644a8da-b479d15f-7ced81ea-30492e52_0
2025-10-02T09:33:30.313848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1974 sessionId: src_id|c644a8da-b479d15f-7ced81ea-30492e52_0 is DEAD
2025-10-02T09:33:30.314019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:30.314034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Write session will restart in 0.005851s
2025-10-02T09:33:30.314060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Write session: Do CDS request
2025-10-02T09:33:30.314066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.319528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.321174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.321280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.321289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1975
2025-10-02T09:33:30.321414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.321435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.321442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.321446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.321706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1975 sessionId:  describe result for acl check
2025-10-02T09:33:30.321729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.321733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.321734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.321737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146576:6042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.321901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.322008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.322015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.322020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.322046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.322073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588697:4238]
2025-10-02T09:33:30.322077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146576:6042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.322414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.322584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.322606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.322793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.322824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.322827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.322828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.322829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.322829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.322830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.322830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.322831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.322831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.322832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.322832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.322833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.322836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.322842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.322844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.322846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.322848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.322850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.322852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.322854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.322856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.322858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.322860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.322862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.322867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.322871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.322874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.322877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.322879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.322882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.322883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.322886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.322888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.322891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.322893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.322896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.322898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.322900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.322903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.322905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.322907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.322910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.322912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.322915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.322917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.322920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.322922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.322925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.322942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.323326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146576:6042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.327781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146576:6042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.327790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146576:6042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.327792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146576:6042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.327801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.330578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.332097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.332109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.332110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.332113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.332117Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1974 [2:7556555196630588697:4238]
2025-10-02T09:33:30.332124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.332134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.332137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.332138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.332139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.332149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.332156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.332160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.332190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.332195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.332196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.332198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.332199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.332238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.332243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.332250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.332255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.332263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.332278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146615:6042], now have 1 active actors on pipe
2025-10-02T09:33:30.332283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146555:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.332287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.332289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.332290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.332297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.332308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.332309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.332312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.332313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.332319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.332320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.332313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1974
2025-10-02T09:33:30.332313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1974
2025-10-02T09:33:30.332335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.332342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.332343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.332351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.332356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.332383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.332390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.332395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.332397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.332404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.332410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.332420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.332509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.332515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.332522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.332570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1975 partition: 0 MaxSeqNo: 36 sessionId: src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0
2025-10-02T09:33:30.332865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c644a8da-b479d15f-7ced81ea-30492e52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.335470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Write session: try to update token
2025-10-02T09:33:30.335484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.341611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.341624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.341625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.341626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.341631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.341633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.341635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588692:4238]
2025-10-02T09:33:30.341653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.341659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.341660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.341661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.341661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.341663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.341776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.347824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId: src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.349956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.413606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146623:6623]
2025-10-02T09:33:30.413774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1974, pipe: [1:7556555196706146623:6623]
2025-10-02T09:33:30.454380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.454607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.454616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.454629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146623:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.454807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.454829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:30.454842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.454843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:30.454874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146623:6623]
2025-10-02T09:33:30.454893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1975 reason: error at write: Disconnected sessionId: src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0
2025-10-02T09:33:30.455039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1975 sessionId: src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0 is DEAD
2025-10-02T09:33:30.455203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:30.455219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Write session will restart in 0.008854s
2025-10-02T09:33:30.455242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Write session: Do CDS request
2025-10-02T09:33:30.455247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.460397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.462622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.462729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.462735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.462741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.462777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.462800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588757:4237]
2025-10-02T09:33:30.463142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.463302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.463325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.463500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.463530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.463534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.463534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.463535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.463535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.463536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.463536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.463537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.463537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.463538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.463538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.463539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.463542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.463549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.463551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.463553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.463555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.463559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.463561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.463563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.463565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.463567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.463569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.463571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.463575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.463579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.463582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.463585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.463587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.463593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.463596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.463598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.463600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.463603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.463605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.463607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.463610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.463613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.463615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.463617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.463619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.463622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.463626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.463628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.463630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.463633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.463635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.463638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.463656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.465138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.465254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.465261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1976
2025-10-02T09:33:30.465393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.465411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.465417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.465419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.465674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1976 sessionId:  describe result for acl check
2025-10-02T09:33:30.465697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.465701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.465702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.465705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146650:6033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.466053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146650:6033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.467142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146650:6033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.470661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146650:6033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.470675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146650:6033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.470677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146650:6033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.470681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.471293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.472723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.472736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.472737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.472739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.472742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1975 [2:7556555196630588757:4237]
2025-10-02T09:33:30.472750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.472760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.472763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.472765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.472766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.472775Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.472782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.472787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.472832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.472837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.472838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.472839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.472841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.472877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.472882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.472888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.472893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.472901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.472916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146624:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.472922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146684:6033], now have 1 active actors on pipe
2025-10-02T09:33:30.472925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.472926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.472927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.472934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.472933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1975
2025-10-02T09:33:30.472937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1975
2025-10-02T09:33:30.472946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.472950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.472952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.472954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.472956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.472958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.472982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.472986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.472994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.473000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.473016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.473017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.473020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.473024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.473025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.473030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.473035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.473048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.473140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.473144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.473153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.473200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1976 partition: 0 MaxSeqNo: 36 sessionId: src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0
2025-10-02T09:33:30.473441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c3e17a-9896b83b-7721ae79-5bb77fbf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.476065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Write session: try to update token
2025-10-02T09:33:30.476081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.482536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.482550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.482551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.482552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.482555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.482559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.482561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588752:4237]
2025-10-02T09:33:30.482581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.482586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.482588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.482589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.482589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.482591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.482706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.488167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId: src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.490445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.554902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146693:6623]
2025-10-02T09:33:30.555084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1975, pipe: [1:7556555196706146693:6623]
2025-10-02T09:33:30.597064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.597284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.597292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.597304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146693:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.597431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.597449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.597483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146693:6623]
2025-10-02T09:33:30.597493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:30.597560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1976 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0
2025-10-02T09:33:30.597707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1976 sessionId: src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0 is DEAD
2025-10-02T09:33:30.597920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:30.597935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Write session will restart in 0.009907s
2025-10-02T09:33:30.597961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Write session: Do CDS request
2025-10-02T09:33:30.597967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.603286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.605510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.605617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.605623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.605629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.605655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.605679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588818:4235]
2025-10-02T09:33:30.606020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.606182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.606205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.606382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.606412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.606416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.606417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.606418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.606418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.606419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.606419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.606420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.606421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.606421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.606422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.606422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.606425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.606432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.606436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.606438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.606440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.606442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.606444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.606446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.606448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.606450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.606452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.606454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.606458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.606462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.606465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.606468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.606470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.606472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.606474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.606477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.606479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.606482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.606484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.606486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.606488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.606491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.606493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.606495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.606498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.606502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.606504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.606506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.606508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.606511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.606513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.606516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.606534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.609128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.609245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.609253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1977
2025-10-02T09:33:30.609396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.609422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.609428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.609431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.609694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1977 sessionId:  describe result for acl check
2025-10-02T09:33:30.609713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.609718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.609720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.609723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146722:6027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.610068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146722:6027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.611622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146722:6027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.613651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146722:6027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.613659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146722:6027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.613661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146722:6027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.613664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.614217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.615651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.615664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.615665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.615667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.615670Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1976 [2:7556555196630588818:4235]
2025-10-02T09:33:30.615677Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.615687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.615692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.615694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.615695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.615704Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.615708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.615713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.615742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.615747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.615748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.615752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.615753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.615792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.615796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.615802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.615807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.615817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.615831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146756:6027], now have 1 active actors on pipe
2025-10-02T09:33:30.615836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146694:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.615840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.615841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.615842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.615850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.615861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.615862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.615864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.615865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.615871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.615872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.615871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1976
2025-10-02T09:33:30.615873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1976
2025-10-02T09:33:30.615886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.615891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.615893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.615902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.615907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.615931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.615938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.615940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.615941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.615946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.615951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.615961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.616060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.616064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.616072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.616126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1977 partition: 0 MaxSeqNo: 36 sessionId: src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0
2025-10-02T09:33:30.616368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a2606e-bb60c013-208825e2-9eb2ea7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.618942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Write session: try to update token
2025-10-02T09:33:30.618957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.625511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.625524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.625525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.625526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.625532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.625535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.625537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588813:4235]
2025-10-02T09:33:30.625556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.625559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.625560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.625566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.625569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.625571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.625689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.631110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId: src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.633408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.697740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146785:6623]
2025-10-02T09:33:30.697848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1976, pipe: [1:7556555196706146785:6623]
2025-10-02T09:33:30.740014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.740236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.740245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.740257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146785:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.740379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.740431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.740431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:30.740435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:30.740474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146785:6623]
2025-10-02T09:33:30.740497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1977 reason: error at write: Disconnected sessionId: src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0
2025-10-02T09:33:30.740675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1977 sessionId: src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0 is DEAD
2025-10-02T09:33:30.740847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:30.740862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Write session will restart in 0.007980s
2025-10-02T09:33:30.740886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Write session: Do CDS request
2025-10-02T09:33:30.740891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.745966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.748122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.748234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.748240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.748246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.748273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.748299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588915:4214]
2025-10-02T09:33:30.748640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.748817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.748840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.749043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.749047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.749048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.749048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.749049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.749051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.749052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.749054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.749054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.749055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.749057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.749065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.749067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.749069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.749071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.749073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.749077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.749079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.749081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.749083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.749085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.749089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.749093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.749096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.749099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.749101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.749104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.749106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.749109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.749115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.749118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.749120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.749123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.749126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.749128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.749130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.749133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.749138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.749141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.749143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.749145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.749148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.749151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.749153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.749155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.749173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.750160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.750269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.750278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1978
2025-10-02T09:33:30.750384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.750402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.750409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.750411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.750684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1978 sessionId:  describe result for acl check
2025-10-02T09:33:30.750703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.750707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.750708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.750710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146815:6005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.751229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146815:6005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.752422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146815:6005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.756118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146815:6005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.756126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146815:6005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.756128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146815:6005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.756141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.756626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.758112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.758125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.758126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.758128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.758132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1977 [2:7556555196630588915:4214]
2025-10-02T09:33:30.758139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.758149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.758154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.758156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.758157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.758166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.758169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.758172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.758204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.758210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.758210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.758212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.758214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.758249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.758254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.758260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.758265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.758273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.758287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146787:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.758293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146850:6005], now have 1 active actors on pipe
2025-10-02T09:33:30.758296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.758299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.758299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.758306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.758316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.758319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.758321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.758323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.758325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.758326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.758340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.758345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.758347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.758319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1977
2025-10-02T09:33:30.758320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1977
2025-10-02T09:33:30.758359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.758364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.758393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1f6e675-15a996d7-27d299-43fbca68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.758400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.758402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.758403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.758409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.758417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.758570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.758687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.758692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.758700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.758752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1978 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1f6e675-15a996d7-27d299-43fbca68_0
2025-10-02T09:33:30.759029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323d2fe-38c1fab8-3672fbdb-9e68a1e9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1f6e675-15a996d7-27d299-43fbca68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.761682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Write session: try to update token
2025-10-02T09:33:30.761696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.767678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.767692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.767693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.767694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.767698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.767700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.767702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588910:4214]
2025-10-02T09:33:30.767722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.767725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.767726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.767729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.767732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.767734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.767852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.775087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId: src_id|e1f6e675-15a996d7-27d299-43fbca68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.777393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.840598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146860:6623]
2025-10-02T09:33:30.840766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1977, pipe: [1:7556555196706146860:6623]
2025-10-02T09:33:30.881061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:30.881394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.881404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.881417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146860:6623], now have 1 active actors on pipe
2025-10-02T09:33:30.881538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:30.881563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146860:6623]
2025-10-02T09:33:30.881583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:30.881587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:30.881639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1978 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1f6e675-15a996d7-27d299-43fbca68_0
2025-10-02T09:33:30.881779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1978 sessionId: src_id|e1f6e675-15a996d7-27d299-43fbca68_0 is DEAD
2025-10-02T09:33:30.881936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:30.881949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Write session will restart in 0.007397s
2025-10-02T09:33:30.881969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Write session: Do CDS request
2025-10-02T09:33:30.881974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:30.887311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:30.889416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:30.889509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:30.889516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:30.889521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:30.889545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:30.889568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555196630588989:4210]
2025-10-02T09:33:30.889905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:30.890068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:30.890091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:30.890124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.890228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:30.890237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1979
2025-10-02T09:33:30.890262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:30.890294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.890298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.890298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.890299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.890299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.890300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.890301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.890301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.890302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.890302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.890303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.890303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.890306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.890312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.890314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.890316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.890318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.890320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.890322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.890323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.890325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.890328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.890330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.890331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.890335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.890339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:30.890342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.890345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:30.890355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:30.890347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.890350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:30.890352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.890355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:30.890358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.890372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:30.890378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:30.890381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:30.890360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:30.890362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.890365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:30.890367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.890370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:30.890372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.890374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:30.890376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.890379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:30.890382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.890385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.890387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.890389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.890391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.890394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.890410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:30.890636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1979 sessionId:  describe result for acl check
2025-10-02T09:33:30.890662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:30.890670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:30.890671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:30.890674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555196706146893:6001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:30.891010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555196706146893:6001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:30.892101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555196706146893:6001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:30.895655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555196706146893:6001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:30.895664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555196706146893:6001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:30.895666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555196706146893:6001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:30.895669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:30.897840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:30.899451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:30.899463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:30.899464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:30.899466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:30.899470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1978 [2:7556555196630588989:4210]
2025-10-02T09:33:30.899477Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:30.899488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:30.899492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.899494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.899495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.899504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:30.899506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:30.899510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:30.899541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.899546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.899547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.899548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:30.899550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:30.899585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:30.899590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.899597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:30.899602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:30.899609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:30.899621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146927:6001], now have 1 active actors on pipe
2025-10-02T09:33:30.899626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146864:2446], now have 1 active actors on pipe
2025-10-02T09:33:30.899630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.899632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.899633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.899641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:30.899651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:30.899652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:30.899655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:30.899656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:30.899658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:30.899660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:30.899653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1978
2025-10-02T09:33:30.899674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.899658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1978
2025-10-02T09:33:30.899676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:30.899678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:30.899686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.899688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.899715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:30.899722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:30.899725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:30.899726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:30.899732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:30.899737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:30.899748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.899838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:30.899844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:30.899851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:30.899902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1979 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0
2025-10-02T09:33:30.900131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1f6e675-15a996d7-27d299-43fbca68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:30.902708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Write session: try to update token
2025-10-02T09:33:30.902722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:30.908793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:30.908820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:30.908821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:30.908822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:30.908825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.908828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.908830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555196630588984:4210]
2025-10-02T09:33:30.908849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:30.908852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:30.908852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:30.908853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:30.908855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:30.908857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:30.908965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:30.914759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId: src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:30.916923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:30.981902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555196706146950:6623]
2025-10-02T09:33:30.982036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1978, pipe: [1:7556555196706146950:6623]
2025-10-02T09:33:31.022277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.022500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.022508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.022520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555196706146950:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.022641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.022697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555196706146950:6623]
2025-10-02T09:33:31.022706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:31.022720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.022764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1979 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0
2025-10-02T09:33:31.022923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1979 sessionId: src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0 is DEAD
2025-10-02T09:33:31.023075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:31.023091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Write session will restart in 0.007228s
2025-10-02T09:33:31.023118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Write session: Do CDS request
2025-10-02T09:33:31.023123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.030320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.030595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.030730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.030737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.030744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.030773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.030798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556351:4207]
2025-10-02T09:33:31.031144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.031182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.031287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.031293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1980
2025-10-02T09:33:31.031310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.031333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.031418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.031436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.031442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.031445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.031510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.031541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.031545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.031546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.031546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.031547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.031548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.031548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.031549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.031549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.031550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.031551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.031551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.031554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.031562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.031564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.031566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.031568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.031570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.031572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.031575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.031577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.031579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.031581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.031583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.031587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.031591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.031594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.031597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.031599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.031602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.031604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.031606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.031609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.031611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.031613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.031616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.031618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.031620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.031622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.031625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.031627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.031629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.031631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.031634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.031636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.031639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.031641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.031643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.031664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.031717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1980 sessionId:  describe result for acl check
2025-10-02T09:33:31.031741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.031745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.031747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.031750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114275:5994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.032080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114275:5994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.033414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114275:5994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.036876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114275:5994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.036885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114275:5994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.036887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114275:5994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.036890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.039092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.040522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.040536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.040537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.040539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.040542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1979 [2:7556555200925556351:4207]
2025-10-02T09:33:31.040549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.040560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.040563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.040564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.040565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.040574Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.040582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.040586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.040617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.040622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.040623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.040624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.040626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.040663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.040667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.040674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.040679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.040690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.040705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114247:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.040710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114312:5994], now have 1 active actors on pipe
2025-10-02T09:33:31.040714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.040715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.040716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.040724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.040733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.040743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.040744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.040747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.040733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1979
2025-10-02T09:33:31.040747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.040748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.040736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1979
2025-10-02T09:33:31.040774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.040779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.040787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.040794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.040818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.040833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42bcc479-859046c2-f36a5de8-6039d446_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.040838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.040840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.040841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.040845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.040851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.040866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.040964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.040970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.040977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.041019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1980 partition: 0 MaxSeqNo: 36 sessionId: src_id|42bcc479-859046c2-f36a5de8-6039d446_0
2025-10-02T09:33:31.041259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f171c05-48b2a6a2-debbc00f-5043f654_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42bcc479-859046c2-f36a5de8-6039d446_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.043795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Write session: try to update token
2025-10-02T09:33:31.043808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.050171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.050182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.050183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.050185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.050188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.050191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.050193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556346:4207]
2025-10-02T09:33:31.050214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.050217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.050220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.050220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.050221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.050224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.050323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.055877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId: src_id|42bcc479-859046c2-f36a5de8-6039d446_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.057987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.122728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114320:6623]
2025-10-02T09:33:31.122943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1979, pipe: [1:7556555201001114320:6623]
2025-10-02T09:33:31.163491Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.163827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.163836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.163849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114320:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.163987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.164034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:31.164046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114320:6623]
2025-10-02T09:33:31.164060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.164091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1980 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42bcc479-859046c2-f36a5de8-6039d446_0
2025-10-02T09:33:31.164221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1980 sessionId: src_id|42bcc479-859046c2-f36a5de8-6039d446_0 is DEAD
2025-10-02T09:33:31.164396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:31.164411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Write session will restart in 0.006892s
2025-10-02T09:33:31.164432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Write session: Do CDS request
2025-10-02T09:33:31.164437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.170112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.172148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.172234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.172241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1981
2025-10-02T09:33:31.172357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.172375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.172381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.172384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.172389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.172492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.172499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.172505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.172530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.172553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556417:4206]
2025-10-02T09:33:31.172665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1981 sessionId:  describe result for acl check
2025-10-02T09:33:31.172689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.172693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.172694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.172697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114348:5989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.172907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.173051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114348:5989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.173078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.173103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.173272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.173300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.173304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.173305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.173305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.173306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.173306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.173308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.173309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.173309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.173310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.173310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.173311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.173313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.173319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.173321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.173323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.173325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.173327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.173329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.173331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.173333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.173336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.173338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.173340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.173343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.173347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.173350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.173353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.173355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.173358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.173360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.173363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.173365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.173368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.173371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.173373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.173376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.173381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.173383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.173386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.173388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.173390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.173392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.173395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.173397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.173399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.173401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.173405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.173423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.174232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114348:5989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.178206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114348:5989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.178217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114348:5989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.178219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114348:5989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.178223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.180840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.182345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.182356Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.182357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.182359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.182363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1980 [2:7556555200925556417:4206]
2025-10-02T09:33:31.182370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.182381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.182386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.182388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.182389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.182399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.182402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.182407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.182442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.182447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.182448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.182450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.182451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.182484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.182489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.182495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.182501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.182509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.182519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114387:5989], now have 1 active actors on pipe
2025-10-02T09:33:31.182526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114321:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.182529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.182531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.182532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.182530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1980
2025-10-02T09:33:31.182540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.182549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.182551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1980
2025-10-02T09:33:31.182551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.182558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.182558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.182559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.182559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.182582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.182587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.182597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.182604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.182612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.182623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c5687-9036342d-1a081ee7-1c536596_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.182626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.182629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.182630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.182635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.182641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.182652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.182758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.182763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.182771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.182811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1981 partition: 0 MaxSeqNo: 36 sessionId: src_id|45c5687-9036342d-1a081ee7-1c536596_0
2025-10-02T09:33:31.183045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42bcc479-859046c2-f36a5de8-6039d446_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45c5687-9036342d-1a081ee7-1c536596_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.185560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Write session: try to update token
2025-10-02T09:33:31.185574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.191918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.191935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.191937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.191939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.191945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.191949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.191951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556411:4206]
2025-10-02T09:33:31.191973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.191980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.191981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.191993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.191996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.191999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.192112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.197455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId: src_id|45c5687-9036342d-1a081ee7-1c536596_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.199568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.264024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114397:6623]
2025-10-02T09:33:31.264180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1980, pipe: [1:7556555201001114397:6623]
2025-10-02T09:33:31.305037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.305421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.305431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.305443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114397:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.305582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.305603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.305616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:31.305619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:31.305644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114397:6623]
2025-10-02T09:33:31.305664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1981 reason: error at write: Disconnected sessionId: src_id|45c5687-9036342d-1a081ee7-1c536596_0
2025-10-02T09:33:31.305817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1981 sessionId: src_id|45c5687-9036342d-1a081ee7-1c536596_0 is DEAD
2025-10-02T09:33:31.305995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:31.306010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Write session will restart in 0.005769s
2025-10-02T09:33:31.306037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Write session: Do CDS request
2025-10-02T09:33:31.306042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.311150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.313165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.313271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.313277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1982
2025-10-02T09:33:31.313291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.313384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.313394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.313401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.313404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.313406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.313410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.313413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.313432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.313458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556485:4198]
2025-10-02T09:33:31.313679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1982 sessionId:  describe result for acl check
2025-10-02T09:33:31.313701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.313705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.313706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.313709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114426:5969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.313811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.313977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.314000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.314041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114426:5969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.314179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.314208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.314212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.314213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.314215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.314215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.314216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.314216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.314217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.314218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.314218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.314219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.314219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.314222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.314228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.314230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.314232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.314234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.314236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.314238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.314240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.314242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.314244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.314246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.314248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.314251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.314255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.314258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.314261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.314263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.314266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.314268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.314270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.314273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.314275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.314278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.314281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.314283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.314286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.314287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.314290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.314293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.314295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.314297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.314300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.314302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.314305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.314308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.314310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.314328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.315578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114426:5969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.319565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114426:5969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.319574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114426:5969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.319576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114426:5969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.319580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.321792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.323362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.323375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.323376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.323379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.323382Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1981 [2:7556555200925556485:4198]
2025-10-02T09:33:31.323389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.323399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.323400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.323403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.323404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.323413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.323416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.323421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.323451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.323456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.323458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.323459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.323461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.323499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.323503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.323509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.323514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.323522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.323536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114465:5969], now have 1 active actors on pipe
2025-10-02T09:33:31.323542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114398:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.323546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.323547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.323549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.323557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.323564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.323560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1981
2025-10-02T09:33:31.323561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1981
2025-10-02T09:33:31.323569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.323571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.323572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.323575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.323576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.323594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.323596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.323597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.323609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.323613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.323638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.323644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.323647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.323648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.323655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.323659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.323669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.323759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.323764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.323771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.323812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1982 partition: 0 MaxSeqNo: 36 sessionId: src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0
2025-10-02T09:33:31.324043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c5687-9036342d-1a081ee7-1c536596_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.326585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Write session: try to update token
2025-10-02T09:33:31.326601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.332789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.332814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.332815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.332816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.332820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.332822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.332824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556480:4198]
2025-10-02T09:33:31.332844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.332848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.332851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.332851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.332852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.332852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.332966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.338724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId: src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.340828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.345188Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:33:31.405849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114473:6623]
2025-10-02T09:33:31.406001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1981, pipe: [1:7556555201001114473:6623]
2025-10-02T09:33:31.444685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.445057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.445067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.445079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114473:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.445231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.445231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:31.445231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114473:6623]
2025-10-02T09:33:31.445242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:31.445248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.445301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1982 reason: error at write: Disconnected sessionId: src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0
2025-10-02T09:33:31.445450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1982 sessionId: src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0 is DEAD
2025-10-02T09:33:31.445806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:31.445822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Write session will restart in 0.009701s
2025-10-02T09:33:31.445849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Write session: Do CDS request
2025-10-02T09:33:31.445854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.453235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.453505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.453604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.453610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.453617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.453642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.453667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556552:4193]
2025-10-02T09:33:31.454010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.454158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.454180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.454370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.454406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.454410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.454411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.454411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.454412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.454412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.454413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.454415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.454415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.454416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.454419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.454426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.454428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.454430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.454432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.454434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.454436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.454438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.454440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.454442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.454444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.454447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.454451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.454455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.454458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.454461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.454463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.454466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.454468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.454470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.454472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.454475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.454477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.454479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.454481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.454484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.454486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.454488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.454492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.454495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.454496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.454500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.454502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.454504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.454506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.454509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.454526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.456174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.456272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.456283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1983
2025-10-02T09:33:31.456409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.456428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.456436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.456439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.456768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1983 sessionId:  describe result for acl check
2025-10-02T09:33:31.456792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.456796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.456797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.456813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114507:5971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.457192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114507:5971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.458462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114507:5971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.461396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114507:5971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.461405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114507:5971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.461408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114507:5971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.461411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.461977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.463373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.463386Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.463387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.463389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.463393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1982 [2:7556555200925556552:4193]
2025-10-02T09:33:31.463400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.463411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.463414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.463416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.463417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.463426Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.463428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.463436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.463468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.463472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.463473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.463475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.463476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.463514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.463519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.463525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.463530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.463538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.463553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114542:5971], now have 1 active actors on pipe
2025-10-02T09:33:31.463558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114474:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.463562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.463563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.463564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.463572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.463582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.463585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.463587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.463588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.463593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.463595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.463592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1982
2025-10-02T09:33:31.463595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1982
2025-10-02T09:33:31.463611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.463617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.463623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.463659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.463665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.463679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.463685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.463689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.463690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.463694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.463700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.463707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.463809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.463813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.463820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.463872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1983 partition: 0 MaxSeqNo: 36 sessionId: src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0
2025-10-02T09:33:31.464123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73c1afc-f3000daa-a6d1c48f-14154a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.466734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Write session: try to update token
2025-10-02T09:33:31.466749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.472680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.472690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.472691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.472692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.472696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.472698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.472700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556547:4193]
2025-10-02T09:33:31.472718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.472721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.472723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.472724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.472727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.472729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.472842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.478940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId: src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.481234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.545132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114550:6623]
2025-10-02T09:33:31.545321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1982, pipe: [1:7556555201001114550:6623]
2025-10-02T09:33:31.587439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.587657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.587665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.587677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114550:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.587822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.587876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114550:6623]
2025-10-02T09:33:31.587878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:31.587881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:31.587905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.587927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1983 reason: error at write: Disconnected sessionId: src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0
2025-10-02T09:33:31.588065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1983 sessionId: src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0 is DEAD
2025-10-02T09:33:31.588220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:31.588233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Write session will restart in 0.008618s
2025-10-02T09:33:31.588254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Write session: Do CDS request
2025-10-02T09:33:31.588260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.593382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.595551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.595651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.595657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.595663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.595688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.595719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556620:4176]
2025-10-02T09:33:31.596051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.596222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.596244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.596415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.596443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.596447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.596448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.596448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.596449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.596449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.596450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.596450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.596450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.596451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.596451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.596452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.596455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.596461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.596463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.596465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.596467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.596469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.596471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.596473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.596475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.596477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.596479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.596481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.596485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.596488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.596493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.596496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.596498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.596501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.596503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.596506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.596508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.596511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.596513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.596515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.596518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.596520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.596523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.596525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.596527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.596530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.596534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.596536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.596538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.596541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.596543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.596546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.596567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.598175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.598291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.598301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1984
2025-10-02T09:33:31.598427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.598447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.598453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.598455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.598742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1984 sessionId:  describe result for acl check
2025-10-02T09:33:31.598766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.598770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.598771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.598774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114589:5964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.599112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114589:5964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.600244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114589:5964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.603425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114589:5964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.603434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114589:5964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.603436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114589:5964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.603440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.604014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.605641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.605650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.605651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.605653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.605657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1983 [2:7556555200925556620:4176]
2025-10-02T09:33:31.605664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.605673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.605675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.605676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.605677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.605687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.605693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.605697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.605730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.605734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.605735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.605737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.605738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.605772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.605777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.605783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.605788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.605799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.605812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114624:5964], now have 1 active actors on pipe
2025-10-02T09:33:31.605818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114555:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.605821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.605822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.605823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.605831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.605840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.605839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1983
2025-10-02T09:33:31.605843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.605845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.605846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.605850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.605852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.605868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.605873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.605875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.605882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.605887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.605877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1983
2025-10-02T09:33:31.605913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19426646-7c48771f-df37027c-d0669f7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.605920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.605922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.605923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.605928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.605935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.605945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.606036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.606041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.606048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.606114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1984 partition: 0 MaxSeqNo: 36 sessionId: src_id|19426646-7c48771f-df37027c-d0669f7d_0
2025-10-02T09:33:31.606373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ae1a07-164e4a0b-2b2ba721-ed58e5ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19426646-7c48771f-df37027c-d0669f7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.608999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Write session: try to update token
2025-10-02T09:33:31.609014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.615025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.615034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.615036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.615037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.615041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.615043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.615045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556615:4176]
2025-10-02T09:33:31.615065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.615069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.615069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.615070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.615072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.615074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.615201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.621532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId: src_id|19426646-7c48771f-df37027c-d0669f7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.623885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.687986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114631:6623]
2025-10-02T09:33:31.688207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1983, pipe: [1:7556555201001114631:6623]
2025-10-02T09:33:31.731468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.731784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.731793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.731805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114631:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.731924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.731948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114631:6623]
2025-10-02T09:33:31.731951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:31.731954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:31.731970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.732004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1984 reason: error at write: Disconnected sessionId: src_id|19426646-7c48771f-df37027c-d0669f7d_0
2025-10-02T09:33:31.732156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1984 sessionId: src_id|19426646-7c48771f-df37027c-d0669f7d_0 is DEAD
2025-10-02T09:33:31.732327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:31.732343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Write session will restart in 0.005333s
2025-10-02T09:33:31.732370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Write session: Do CDS request
2025-10-02T09:33:31.732377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.738120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.739169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.739283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.739292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1985
2025-10-02T09:33:31.739647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.739669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.739675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.739677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.739962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1985 sessionId:  describe result for acl check
2025-10-02T09:33:31.739983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.739987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.739988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.739991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114689:5947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.740319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114689:5947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.740495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.740591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.740597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.740603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.740630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.740653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556724:4173]
2025-10-02T09:33:31.741006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.741178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.741201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.741373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.741402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.741406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.741406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.741407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.741408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.741408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.741409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.741409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.741410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.741410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.741411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.741411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.741414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.741420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.741422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.741424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.741426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.741428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.741430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.741432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.741434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.741436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.741438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.741440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.741445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.741448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.741452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.741454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.741456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.741459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.741462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.741465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.741467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.741470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.741472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.741475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.741477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.741480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.741482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.741484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.741486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.741489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.741491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.741494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.741496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.741498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.741501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.741503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.741521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.741702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114689:5947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.746403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114689:5947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.746412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114689:5947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.746414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114689:5947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.746418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.748994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.750567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.750578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.750578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.750582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.750585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1984 [2:7556555200925556724:4173]
2025-10-02T09:33:31.750592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.750606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.750610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.750611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.750612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.750620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.750626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.750631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.750660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.750673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.750674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.750675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.750677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.750712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.750716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.750722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.750727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.750737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.750751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114725:5947], now have 1 active actors on pipe
2025-10-02T09:33:31.750756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114658:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.750759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.750760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.750761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.750771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.750781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.750784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.750786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.750787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.750792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.750793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.750786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1984
2025-10-02T09:33:31.750788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1984
2025-10-02T09:33:31.750808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.750812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.750814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.750825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.750830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.750854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|829dc046-d0bf2d96-de480038-a008c6fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.750860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.750862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.750863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.750868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.750873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.750884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.750968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.750972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.750979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.751033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1985 partition: 0 MaxSeqNo: 36 sessionId: src_id|829dc046-d0bf2d96-de480038-a008c6fd_0
2025-10-02T09:33:31.751321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19426646-7c48771f-df37027c-d0669f7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|829dc046-d0bf2d96-de480038-a008c6fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.753855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Write session: try to update token
2025-10-02T09:33:31.753869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.759859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.759870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.759871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.759872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.759876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.759878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.759880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556719:4173]
2025-10-02T09:33:31.759900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.759903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.759904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.759904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.759907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.759909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.760016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.765689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId: src_id|829dc046-d0bf2d96-de480038-a008c6fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.768004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.832352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114732:6623]
2025-10-02T09:33:31.832553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1984, pipe: [1:7556555201001114732:6623]
2025-10-02T09:33:31.873613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:31.873820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.873828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.873841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114732:6623], now have 1 active actors on pipe
2025-10-02T09:33:31.873989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:31.873975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:31.873979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:31.873985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:31.874008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114732:6623]
2025-10-02T09:33:31.874028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1985 reason: error at write: Disconnected sessionId: src_id|829dc046-d0bf2d96-de480038-a008c6fd_0
2025-10-02T09:33:31.874181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1985 sessionId: src_id|829dc046-d0bf2d96-de480038-a008c6fd_0 is DEAD
2025-10-02T09:33:31.874486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:31.874502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Write session will restart in 0.008001s
2025-10-02T09:33:31.874524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Write session: Do CDS request
2025-10-02T09:33:31.874529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:31.879862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:31.882276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:31.882369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:31.882375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:31.882381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:31.882406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:31.882429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555200925556805:4169]
2025-10-02T09:33:31.882778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:31.882938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:31.882960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:31.883133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.883139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:31.883167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.883171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.883171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.883172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.883172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.883173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.883173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.883174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.883176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.883176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.883177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.883178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.883180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.883187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.883189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.883191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.883193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.883195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.883197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.883198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.883201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.883203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.883205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.883207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.883210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.883214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:31.883217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.883221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:31.883223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.883225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:31.883227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.883229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:31.883231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.883234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:31.883236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.883240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:31.883243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.883247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:31.883249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.883252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:31.883239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:31.883247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1986
2025-10-02T09:33:31.883254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.883257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:31.883259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.883261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.883263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.883265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.883267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.883270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.883285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:31.883374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:31.883392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:31.883397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:31.883400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:31.883670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1986 sessionId:  describe result for acl check
2025-10-02T09:33:31.883693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:31.883699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:31.883700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:31.883702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555201001114777:5941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:31.884014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555201001114777:5941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:31.885361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555201001114777:5941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:31.889577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555201001114777:5941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:31.889585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555201001114777:5941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:31.889587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555201001114777:5941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:31.889591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:31.890792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:31.892309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:31.892317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:31.892318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:31.892320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:31.892323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1985 [2:7556555200925556805:4169]
2025-10-02T09:33:31.892331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:31.892340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:31.892346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.892348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.892349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.892357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:31.892360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:31.892366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:31.892397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.892402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.892403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.892404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:31.892406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:31.892444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:31.892448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.892456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:31.892461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:31.892470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:31.892483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114740:2446], now have 1 active actors on pipe
2025-10-02T09:33:31.892488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114812:5941], now have 1 active actors on pipe
2025-10-02T09:33:31.892492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.892493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.892494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.892502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:31.892512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:31.892514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:31.892516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:31.892517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:31.892523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:31.892524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:31.892510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1985
2025-10-02T09:33:31.892523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1985
2025-10-02T09:33:31.892538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.892543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:31.892547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:31.892555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.892560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.892586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:31.892592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:31.892595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:31.892596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:31.892601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:31.892607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:31.892618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.892748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:31.892752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:31.892759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:31.892835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1986 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0
2025-10-02T09:33:31.893085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|829dc046-d0bf2d96-de480038-a008c6fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:31.895594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Write session: try to update token
2025-10-02T09:33:31.895607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:31.901760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:31.901771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:31.901772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:31.901773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:31.901777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.901779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.901781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555200925556800:4169]
2025-10-02T09:33:31.901799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:31.901802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:31.901805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:31.901805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:31.901809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:31.901812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:31.901918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:31.908075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId: src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:31.910216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:31.974172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555201001114826:6623]
2025-10-02T09:33:31.974365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1985, pipe: [1:7556555201001114826:6623]
2025-10-02T09:33:32.016057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.016268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.016276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.016289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555201001114826:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.016437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.016457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.016490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555201001114826:6623]
2025-10-02T09:33:32.016496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:32.016554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1986 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0
2025-10-02T09:33:32.016702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1986 sessionId: src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0 is DEAD
2025-10-02T09:33:32.016902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:32.016918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Write session will restart in 0.008661s
2025-10-02T09:33:32.016946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Write session: Do CDS request
2025-10-02T09:33:32.016952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.022737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.025120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.025224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.025231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.025237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.025263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.025287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524174:4163]
2025-10-02T09:33:32.025631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.025805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.025826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.026004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.026038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.026042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.026042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.026043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.026043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.026044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.026044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.026045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.026045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.026046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.026046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.026047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.026050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.026057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.026059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.026061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.026063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.026065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.026067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.026069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.026070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.026073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.026076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.026078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.026082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.026085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.026088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.026091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.026093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.026096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.026098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.026101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.026103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.026105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.026107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.026110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.026112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.026115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.026117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.026120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.026122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.026125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.026126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.026129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.026131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.026133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.026135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.026138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.026156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.026212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.026349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.026361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1987
2025-10-02T09:33:32.026482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.026502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.026509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.026511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.026777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1987 sessionId:  describe result for acl check
2025-10-02T09:33:32.026798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.026802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.026803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.026806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082173:5934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.027165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082173:5934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.028783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082173:5934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.032441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082173:5934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.032451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082173:5934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.032454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082173:5934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.032458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.033672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.035363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.035372Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.035373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.035375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.035381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1986 [2:7556555205220524174:4163]
2025-10-02T09:33:32.035392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.035403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.035406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.035407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.035409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.035418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.035425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.035429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.035460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.035464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.035466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.035467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.035469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.035508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.035513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.035519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.035524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.035532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.035546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082208:5934], now have 1 active actors on pipe
2025-10-02T09:33:32.035553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.035555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.035556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.035564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.035572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082135:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.035578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.035579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.035582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.035584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.035588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.035589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.035602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.035607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.035615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.035596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1986
2025-10-02T09:33:32.035607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1986
2025-10-02T09:33:32.035628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.035633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.035651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.035658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.035660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.035661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.035666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.035673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.035680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.035831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.035835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.035843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.035899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1987 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0
2025-10-02T09:33:32.036191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba48ad6-5dfb5c3f-9d600ce0-8fa253d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.038882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Write session: try to update token
2025-10-02T09:33:32.038898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.044700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.044711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.044712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.044713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.044718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.044721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.044723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524169:4163]
2025-10-02T09:33:32.044743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.044748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.044749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.044750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.044751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.044753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.044874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.051263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId: src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.053443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.116511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082216:6623]
2025-10-02T09:33:32.116687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1986, pipe: [1:7556555205296082216:6623]
2025-10-02T09:33:32.154828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.155200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.155209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.155222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082216:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.155364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.155396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082216:6623]
2025-10-02T09:33:32.155421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.155421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:32.155425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:32.155482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1987 reason: error at write: Disconnected sessionId: src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0
2025-10-02T09:33:32.155622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1987 sessionId: src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0 is DEAD
2025-10-02T09:33:32.155794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:32.155809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Write session will restart in 0.007616s
2025-10-02T09:33:32.155831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Write session: Do CDS request
2025-10-02T09:33:32.155837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.162017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.164148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.164272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.164281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1988
2025-10-02T09:33:32.164349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.164395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.164415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.164422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.164425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.164446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.164452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.164458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.164482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.164505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524246:4152]
2025-10-02T09:33:32.164700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1988 sessionId:  describe result for acl check
2025-10-02T09:33:32.164722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.164727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.164728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.164730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082262:5930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.164865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.165060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.165082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.165096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082262:5930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.165259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.165291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.165295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.165295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.165296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.165297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.165297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.165298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.165298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.165299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.165299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.165300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.165300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.165303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.165309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.165311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.165313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.165315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.165317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.165319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.165321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.165323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.165325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.165327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.165329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.165332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.165336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.165339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.165342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.165345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.165348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.165350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.165353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.165355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.165358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.165360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.165363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.165365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.165367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.165369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.165372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.165374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.165376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.165379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.165382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.165383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.165386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.165388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.165390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.165406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.166568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082262:5930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.170602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082262:5930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.170610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082262:5930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.170612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082262:5930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.170616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.172824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.174220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.174230Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.174231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.174233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.174236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1987 [2:7556555205220524246:4152]
2025-10-02T09:33:32.174244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.174252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.174257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.174259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.174260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.174269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.174273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.174277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.174308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.174312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.174313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.174315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.174316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.174352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.174357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.174363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.174368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.174376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.174386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082217:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.174393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.174395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.174396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.174403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.174411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082301:5930], now have 1 active actors on pipe
2025-10-02T09:33:32.174414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.174416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.174422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.174423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.174424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.174425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.174438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.174421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1987
2025-10-02T09:33:32.174434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1987
2025-10-02T09:33:32.174440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.174443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.174456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.174457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.174475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.174484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.174487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.174611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.174620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.174625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.174639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.174772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.174777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.174785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.174838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1988 partition: 0 MaxSeqNo: 36 sessionId: src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0
2025-10-02T09:33:32.175089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c8d10c-7b1cb7ee-874bcc7a-f1840c22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.177702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Write session: try to update token
2025-10-02T09:33:32.177719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.183419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.183430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.183431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.183432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.183436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.183438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.183442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524241:4152]
2025-10-02T09:33:32.183460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.183463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.183464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.183466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.183469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.183471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.183574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.190091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId: src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.192294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.255766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082311:6623]
2025-10-02T09:33:32.255945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1987, pipe: [1:7556555205296082311:6623]
2025-10-02T09:33:32.292935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.293139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.293148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.293159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082311:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.293303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.293299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.293330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082311:6623]
2025-10-02T09:33:32.293332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:32.293333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:32.293379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1988 reason: error at write: Disconnected sessionId: src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0
2025-10-02T09:33:32.293508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1988 sessionId: src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0 is DEAD
2025-10-02T09:33:32.293652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:32.293664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Write session will restart in 0.007571s
2025-10-02T09:33:32.293685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Write session: Do CDS request
2025-10-02T09:33:32.293691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.299806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.302173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.302229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.302255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.302265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1989
2025-10-02T09:33:32.302338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.302345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.302351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.302378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.302388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.302402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524321:4160]
2025-10-02T09:33:32.302408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.302414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.302417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.302677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1989 sessionId:  describe result for acl check
2025-10-02T09:33:32.302700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.302704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.302706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.302708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082347:5919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.302765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.302958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.302983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.303051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082347:5919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.303163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.303194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.303198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.303198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.303199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.303200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.303200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.303201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.303201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.303202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.303203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.303203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.303204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.303207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.303213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.303215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.303218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.303220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.303222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.303224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.303226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.303228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.303232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.303234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.303236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.303240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.303243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.303247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.303249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.303251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.303254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.303258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.303261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.303264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.303266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.303269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.303271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.303276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.303280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.303282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.303285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.303288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.303291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.303293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.303296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.303298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.303300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.303304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.303306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.303322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.304237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082347:5919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.308653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082347:5919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.308660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082347:5919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.308662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082347:5919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.308666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.310897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.312283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.312293Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.312294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.312297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.312301Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1988 [2:7556555205220524321:4160]
2025-10-02T09:33:32.312307Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.312316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.312321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.312323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.312324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.312332Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.312335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.312339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.312370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.312375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.312376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.312378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.312379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.312416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.312421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.312427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.312434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.312442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.312456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082386:5919], now have 1 active actors on pipe
2025-10-02T09:33:32.312461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082312:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.312465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.312466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.312467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.312476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.312486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.312494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.312496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.312498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.312502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.312504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.312513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.312515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.312498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1988
2025-10-02T09:33:32.312503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1988
2025-10-02T09:33:32.312524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.312621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.312627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.312647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.312654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.312656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.312657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.312662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.312669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.312684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.312781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.312786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.312794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.312853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1989 partition: 0 MaxSeqNo: 36 sessionId: src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0
2025-10-02T09:33:32.313072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5374cbee-441a9981-8c36045d-ae0c0cd5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.315554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Write session: try to update token
2025-10-02T09:33:32.315568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.321482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.321493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.321494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.321495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.321498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.321501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.321502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524314:4160]
2025-10-02T09:33:32.321525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.321531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.321531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.321532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.321536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.321539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.321656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.328013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId: src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.330213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.393490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082394:6623]
2025-10-02T09:33:32.393648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1988, pipe: [1:7556555205296082394:6623]
2025-10-02T09:33:32.430521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.430849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.430857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.430870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082394:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.431013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.431001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.431017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:32.431020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:32.431038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082394:6623]
2025-10-02T09:33:32.431067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1989 reason: error at write: Disconnected sessionId: src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0
2025-10-02T09:33:32.431221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1989 sessionId: src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0 is DEAD
2025-10-02T09:33:32.431533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:32.431549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Write session will restart in 0.007354s
2025-10-02T09:33:32.431576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Write session: Do CDS request
2025-10-02T09:33:32.431581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.437525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.439674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.439849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.439856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.439862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.439895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.439919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524395:4153]
2025-10-02T09:33:32.440154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.440255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.440315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.440324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1990
2025-10-02T09:33:32.440436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.440444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.440458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.440463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.440469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.440471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.440632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.440659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.440663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.440663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.440664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.440664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.440665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.440665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.440666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.440666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.440667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.440667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.440668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.440671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.440678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.440680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.440682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.440684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.440686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.440690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.440692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.440694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.440696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.440698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.440700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.440704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.440708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.440711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.440715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.440717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.440719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.440721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.440725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.440727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.440730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.440733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.440735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.440739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.440741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.440743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.440731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1990 sessionId:  describe result for acl check
2025-10-02T09:33:32.440746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.440748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.440750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.440753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.440756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.440755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.440758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.440760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.440757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.440758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.440762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082433:5917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.440762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.440765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.440780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.441113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082433:5917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.442468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082433:5917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.445924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082433:5917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.445933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082433:5917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.445935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082433:5917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.445938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.448115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.449560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.449571Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.449572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.449574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.449578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1989 [2:7556555205220524395:4153]
2025-10-02T09:33:32.449588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.449598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.449603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.449604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.449606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.449615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.449617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.449622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.449654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.449658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.449659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.449661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.449663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.449698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.449703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.449709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.449714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.449725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.449739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082395:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.449744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082469:5917], now have 1 active actors on pipe
2025-10-02T09:33:32.449748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.449751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.449753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.449760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.449769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.449774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1989
2025-10-02T09:33:32.449784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1989
2025-10-02T09:33:32.449778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.449779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.449781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.449786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.449787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.449794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.449796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.449805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.449814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.449815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.449832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0951623-d56ca2cd-8b616bff-65febd66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.449839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.449842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.449843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.449848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.449854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.449861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.449967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.449972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.449979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.450043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1990 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0951623-d56ca2cd-8b616bff-65febd66_0
2025-10-02T09:33:32.450288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d58898-f221f548-8ad7ac2b-9fdbbdc9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0951623-d56ca2cd-8b616bff-65febd66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.452928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Write session: try to update token
2025-10-02T09:33:32.452942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.458824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.458834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.458835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.458836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.458840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.458841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.458845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524390:4153]
2025-10-02T09:33:32.458863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.458868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.458870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.458870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.458873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.458875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.458979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.465477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId: src_id|c0951623-d56ca2cd-8b616bff-65febd66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.467663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.531245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082477:6623]
2025-10-02T09:33:32.531448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1989, pipe: [1:7556555205296082477:6623]
2025-10-02T09:33:32.568545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.568853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.568862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.568875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082477:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.568990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.569004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082477:6623]
2025-10-02T09:33:32.569025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.569027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:32.569088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1990 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0951623-d56ca2cd-8b616bff-65febd66_0
2025-10-02T09:33:32.569221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1990 sessionId: src_id|c0951623-d56ca2cd-8b616bff-65febd66_0 is DEAD
2025-10-02T09:33:32.569588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:32.569605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Write session will restart in 0.005846s
2025-10-02T09:33:32.569627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Write session: Do CDS request
2025-10-02T09:33:32.569632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.575118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.576193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.576282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.576291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1991
2025-10-02T09:33:32.576411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.576431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.576437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.576440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.576769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1991 sessionId:  describe result for acl check
2025-10-02T09:33:32.576795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.576813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.576814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.576817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082516:5912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.577213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082516:5912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.577496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.577589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.577597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.577603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.577630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.577654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524469:4155]
2025-10-02T09:33:32.578257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.578417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.578440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.578626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.578659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.578671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.578672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.578672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.578673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.578674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.578674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.578675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.578675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.578676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.578677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.578677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.578680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.578686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.578688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.578690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.578692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.578694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.578696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.578698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.578701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.578703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.578705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.578706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.578713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082516:5912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.578711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.578715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.578718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.578721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.578723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.578726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.578728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.578730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.578733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.578735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.578737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.578740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.578742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.578745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.578747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.578749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.578752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.578755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.578757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.578760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.578762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.578765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.578767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.578770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.578787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.583050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082516:5912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.583059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082516:5912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.583061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082516:5912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.583065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.586165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.587687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.587698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.587701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.587703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.587706Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1990 [2:7556555205220524469:4155]
2025-10-02T09:33:32.587714Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.587724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.587728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.587730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.587731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.587740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.587742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.587746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.587777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.587781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.587782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.587784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.587785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.587820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.587824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.587831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.587836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.587847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.587861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082479:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.587866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082554:5912], now have 1 active actors on pipe
2025-10-02T09:33:32.587870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.587871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.587872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.587880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.587890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.587892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.587894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.587895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.587900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.587901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.587891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1990
2025-10-02T09:33:32.587904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1990
2025-10-02T09:33:32.587918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.587922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.587924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.587933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.587936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.587959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99319593-a0f68408-69f99936-4aec5ef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.587966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.587969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.587970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.587975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.587983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.587994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.588082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.588087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.588094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.588142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1991 partition: 0 MaxSeqNo: 36 sessionId: src_id|99319593-a0f68408-69f99936-4aec5ef2_0
2025-10-02T09:33:32.588370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0951623-d56ca2cd-8b616bff-65febd66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99319593-a0f68408-69f99936-4aec5ef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.590925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Write session: try to update token
2025-10-02T09:33:32.590941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.597005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.597014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.597016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.597017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.597020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.597023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.597025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524464:4155]
2025-10-02T09:33:32.597044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.597047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.597049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.597050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.597051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.597053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.597159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.602949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId: src_id|99319593-a0f68408-69f99936-4aec5ef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.605143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.668964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082562:6623]
2025-10-02T09:33:32.669204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1990, pipe: [1:7556555205296082562:6623]
2025-10-02T09:33:32.709559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.709780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.709790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.709801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082562:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.709935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.709980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.709994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082562:6623]
2025-10-02T09:33:32.710013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:32.710079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1991 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99319593-a0f68408-69f99936-4aec5ef2_0
2025-10-02T09:33:32.710226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1991 sessionId: src_id|99319593-a0f68408-69f99936-4aec5ef2_0 is DEAD
2025-10-02T09:33:32.710362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:32.710376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Write session will restart in 0.007200s
2025-10-02T09:33:32.710397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Write session: Do CDS request
2025-10-02T09:33:32.710402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.716210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.718136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.718263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.718273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1992
2025-10-02T09:33:32.718402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.718423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.718429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.718432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.718510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.718613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.718619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.718624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.718654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.718700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1992 sessionId:  describe result for acl check
2025-10-02T09:33:32.718723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.718727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.718728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.718731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082602:5904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.718783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524544:4147]
2025-10-02T09:33:32.719074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082602:5904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.719125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.719305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.719329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.719502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.719529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.719533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.719533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.719534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.719534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.719535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.719535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.719535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.719536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.719536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.719537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.719538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.719541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.719546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.719549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.719551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.719553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.719555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.719557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.719559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.719561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.719563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.719565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.719568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.719572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.719576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.719579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.719582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.719585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.719588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.719590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.719592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.719595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.719598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.719600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.719603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.719605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.719607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.719610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.719612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.719614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.719617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.719619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.719621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.719624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.719626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.719628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.719631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.719646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.720519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082602:5904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.724945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082602:5904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.724956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082602:5904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.724959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082602:5904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.724963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.727129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.728625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.728638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.728639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.728641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.728645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1991 [2:7556555205220524544:4147]
2025-10-02T09:33:32.728652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.728662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.728664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.728666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.728667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.728676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.728680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.728684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.728716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.728721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.728722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.728724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.728725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.728767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.728774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.728784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.728794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.728819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.728835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082653:5904], now have 1 active actors on pipe
2025-10-02T09:33:32.728840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082563:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.728844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.728845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.728846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.728853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.728861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.728870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.728871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.728873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.728873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.728875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.728866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1991
2025-10-02T09:33:32.728887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1991
2025-10-02T09:33:32.728892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.728897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.728899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.728912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.728916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.728934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.728942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.728945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.728946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.728951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.728956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.728967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.729060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.729065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.729072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.729120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1992 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0
2025-10-02T09:33:32.729384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99319593-a0f68408-69f99936-4aec5ef2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.731922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Write session: try to update token
2025-10-02T09:33:32.731937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.738101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.738113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.738114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.738116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.738119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.738126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.738128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524539:4147]
2025-10-02T09:33:32.738148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.738151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.738154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.738154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.738155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.738156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.738270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.744611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId: src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.746823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.810263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082670:6623]
2025-10-02T09:33:32.810431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1991, pipe: [1:7556555205296082670:6623]
2025-10-02T09:33:32.849816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.850058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.850067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.850080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082670:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.850219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.850263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:32.850273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:32.850319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1992 reason: error at write: Disconnected sessionId: src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0
2025-10-02T09:33:32.850461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1992 sessionId: src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0 is DEAD
2025-10-02T09:33:32.850545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082670:6623]
2025-10-02T09:33:32.850577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.850622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:32.850639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Write session will restart in 0.005446s
2025-10-02T09:33:32.850678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Write session: Do CDS request
2025-10-02T09:33:32.850685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.856788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.857243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.857370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.857377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1993
2025-10-02T09:33:32.857468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.857486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.857492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.857495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.857757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1993 sessionId:  describe result for acl check
2025-10-02T09:33:32.857780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.857784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.857785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.857788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082717:5891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.858113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082717:5891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:32.858952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.859085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.859091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.859098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.859127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.859151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524657:4126]
2025-10-02T09:33:32.859387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082717:5891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:32.859482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:32.859665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:32.859687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:32.859857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:32.859887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.859891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.859892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.859893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.859893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.859894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.859894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.859896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.859896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.859897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.859898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.859898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.859901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.859907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.859909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.859911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.859913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.859915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.859917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.859919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.859921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.859924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.859926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.859928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.859931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.859935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:32.859938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.859941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:32.859945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.859951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:32.859954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.859956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:32.859959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.859961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:32.859963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.859966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:32.859970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.859973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:32.859975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.859978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:32.859980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.859983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:32.859985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.859987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.859989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.859992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.859994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.859996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.860012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:32.863821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082717:5891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:32.863829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082717:5891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:32.863830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082717:5891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:32.863834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:32.867336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:32.868794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:32.868814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:32.868819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:32.868821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:32.868824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1992 [2:7556555205220524657:4126]
2025-10-02T09:33:32.868831Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:32.868841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:32.868844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.868846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.868847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.868855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:32.868861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:32.868866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:32.868896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.868901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.868902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.868904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:32.868905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:32.868942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:32.868947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.868953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:32.868958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:32.868968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:32.868982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082755:5891], now have 1 active actors on pipe
2025-10-02T09:33:32.868988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082674:2446], now have 1 active actors on pipe
2025-10-02T09:33:32.868991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.868993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.868994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.869001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:32.869012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:32.869014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:32.869016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:32.869018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:32.869023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:32.869025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:32.869019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1992
2025-10-02T09:33:32.869019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1992
2025-10-02T09:33:32.869039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.869043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:32.869045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:32.869182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.869189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.869209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:32.869216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:32.869219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:32.869220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:32.869224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:32.869229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:32.869243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.869347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.869353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.869361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:32.869411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1993 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0
2025-10-02T09:33:32.869696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8a995d-dee34018-41e32e06-2e04d9a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:32.872447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Write session: try to update token
2025-10-02T09:33:32.872463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:32.878392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:32.878402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:32.878403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:32.878404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:32.878408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.878410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.878411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524652:4126]
2025-10-02T09:33:32.878430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:32.878432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:32.878434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:32.878434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:32.878436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:32.878438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:32.878537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:32.885415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId: src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:32.887604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:32.950557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555205296082767:6623]
2025-10-02T09:33:32.950732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1992, pipe: [1:7556555205296082767:6623]
2025-10-02T09:33:32.989863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:32.990205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:32.990214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:32.990227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082767:6623], now have 1 active actors on pipe
2025-10-02T09:33:32.990381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:32.990414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:32.990414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:32.990418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:32.990452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555205296082767:6623]
2025-10-02T09:33:32.990475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1993 reason: error at write: Disconnected sessionId: src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0
2025-10-02T09:33:32.990625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1993 sessionId: src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0 is DEAD
2025-10-02T09:33:32.990822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:32.990838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Write session will restart in 0.007489s
2025-10-02T09:33:32.990865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Write session: Do CDS request
2025-10-02T09:33:32.990872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:32.999181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.999213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:32.999267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:32.999278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1994
2025-10-02T09:33:32.999396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:32.999418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:32.999422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:32.999425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:32.999494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:32.999699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:32.999707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:32.999714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:32.999708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1994 sessionId:  describe result for acl check
2025-10-02T09:33:32.999733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:32.999737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:32.999738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:32.999740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555205296082820:5881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:32.999748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:32.999771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555205220524747:4127]
2025-10-02T09:33:33.000062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555205296082820:5881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.000106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.000288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.000310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.000480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.000514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.000519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.000519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.000520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.000521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.000522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.000523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.000523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.000524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.000525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.000526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.000526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.000532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.000542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.000545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.000547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.000549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.000551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.000553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.000555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.000557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.000559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.000561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.000563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.000567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.000572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.000578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.000581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.000583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.000588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.000590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.000592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.000595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.000597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.000601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.000604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.000609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.000611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.000616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.000618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.000621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.000623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.000625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.000629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.000632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.000635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.000637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.000639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.000655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.001582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555205296082820:5881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.005839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555205296082820:5881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.005846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555205296082820:5881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.005848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555205296082820:5881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.005852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.008023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.009536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.009549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.009550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.009553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.009557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1993 [2:7556555205220524747:4127]
2025-10-02T09:33:33.009570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.009584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.009586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.009589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.009590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.009602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.009607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.009612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.009650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.009656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.009658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.009661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.009665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.009709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.009715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.009725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.009736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.009755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.009773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050155:5881], now have 1 active actors on pipe
2025-10-02T09:33:33.009780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555205296082780:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.009785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.009786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.009788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.009774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1993
2025-10-02T09:33:33.009794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.009777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1993
2025-10-02T09:33:33.009805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.009805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.009807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.009808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.009817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.009820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.009850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.009856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.009865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.009875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.009885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.009899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.009906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.009909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.009911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.009917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.009927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.009945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.010051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.010056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.010066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.010128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1994 partition: 0 MaxSeqNo: 36 sessionId: src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0
2025-10-02T09:33:33.010385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7257224-3e2c19ad-1e579c1b-2315d75f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.013153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Write session: try to update token
2025-10-02T09:33:33.013169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.018959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.018972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.018973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.018975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.018982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.018984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.018987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555205220524742:4127]
2025-10-02T09:33:33.019012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.019012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.019015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.019016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.019017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.019017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.019129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.026444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId: src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.028667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.090860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050163:6623]
2025-10-02T09:33:33.090993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1993, pipe: [1:7556555209591050163:6623]
2025-10-02T09:33:33.128794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.129171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.129181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.129196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050163:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.129348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.129422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:33.129428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.129433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:33.129462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050163:6623]
2025-10-02T09:33:33.129485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1994 reason: error at write: Disconnected sessionId: src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0
2025-10-02T09:33:33.129629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1994 sessionId: src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0 is DEAD
2025-10-02T09:33:33.129793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:33.129810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Write session will restart in 0.005597s
2025-10-02T09:33:33.129836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Write session: Do CDS request
2025-10-02T09:33:33.129842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:33.136199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.136236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:33.136328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:33.136339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1995
2025-10-02T09:33:33.136472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.136492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:33.136498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:33.136501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:33.136777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1995 sessionId:  describe result for acl check
2025-10-02T09:33:33.136814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:33.136818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:33.136819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:33.136822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555209591050205:5880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:33.137176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555209591050205:5880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.138564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:33.138674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:33.138682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:33.138690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:33.138729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:33.138759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555209515492124:4122]
2025-10-02T09:33:33.138792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555209591050205:5880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.139105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.139277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.139309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.139497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.139540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.139545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.139546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.139547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.139548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.139549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.139550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.139551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.139552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.139554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.139555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.139556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.139560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.139570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.139574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.139578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.139581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.139587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.139591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.139595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.139599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.139607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.139613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.139616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.139621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.139627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.139633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.139637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.139640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.139645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.139649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.139655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.139660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.139665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.139669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.139674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.139681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.139685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.139689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.139694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.139699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.139704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.139708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.139712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.139719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.139723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.139727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.139732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.139766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.143739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555209591050205:5880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.143747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555209591050205:5880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.143749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555209591050205:5880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.143753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.147552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.149152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.149164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.149167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.149170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.149174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1994 [2:7556555209515492124:4122]
2025-10-02T09:33:33.149186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.149198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.149201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.149203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.149205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.149217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.149221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.149227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.149267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.149272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.149274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.149277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.149279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.149325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.149330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.149340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.149349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.149365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.149383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050244:5880], now have 1 active actors on pipe
2025-10-02T09:33:33.149390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050164:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.149395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.149396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.149398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.149392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1994
2025-10-02T09:33:33.149394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1994
2025-10-02T09:33:33.149406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.149417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.149430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.149432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.149436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.149437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.149439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.149462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.149469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.149481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.149491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.149504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.149517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|419eb000-79ca2538-e672c1ab-ec72420f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.149522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.149526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.149529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.149536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.149544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.149562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.149654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.149659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.149670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.149713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1995 partition: 0 MaxSeqNo: 36 sessionId: src_id|419eb000-79ca2538-e672c1ab-ec72420f_0
2025-10-02T09:33:33.149980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c12ae5-6ef2b440-f6d81347-e9ef7ab7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|419eb000-79ca2538-e672c1ab-ec72420f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.152730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Write session: try to update token
2025-10-02T09:33:33.152746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.158995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.159007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.159008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.159010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.159015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.159017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.159020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555209515492119:4122]
2025-10-02T09:33:33.159046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.159050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.159052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.159053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.159057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.159061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.159160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.165944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId: src_id|419eb000-79ca2538-e672c1ab-ec72420f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.168067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.229609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050252:6623]
2025-10-02T09:33:33.229833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1994, pipe: [1:7556555209591050252:6623]
2025-10-02T09:33:33.271863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.272111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.272121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.272137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050252:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.272266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.272323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.272331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050252:6623]
2025-10-02T09:33:33.272350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:33.272403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1995 reason: status is not ok: tablet will be restarted right now sessionId: src_id|419eb000-79ca2538-e672c1ab-ec72420f_0
2025-10-02T09:33:33.272526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1995 sessionId: src_id|419eb000-79ca2538-e672c1ab-ec72420f_0 is DEAD
2025-10-02T09:33:33.272703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:33.272718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Write session will restart in 0.008451s
2025-10-02T09:33:33.272747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Write session: Do CDS request
2025-10-02T09:33:33.272753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:33.278844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:33.281361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:33.281473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:33.281480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:33.281487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:33.281527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:33.281560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555209515492204:4118]
2025-10-02T09:33:33.281907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.282083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.282115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.282154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.282242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:33.282252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1996
2025-10-02T09:33:33.282302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.282346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.282350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.282351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.282352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.282353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.282354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.282355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.282356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.282357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.282358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.282359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.282360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.282382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.282365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.282375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.282378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.282383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.282386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.282390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.282400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:33.282393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.282397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.282401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.282405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.282407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:33.282409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.282413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.282410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:33.282418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.282425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.282430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.282438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.282442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.282447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.282455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.282460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.282464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.282469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.282476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.282480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.282484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.282488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.282492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.282497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.282501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.282507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.282511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.282516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.282522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.282527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.282531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.282535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.282570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.282673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1996 sessionId:  describe result for acl check
2025-10-02T09:33:33.282697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:33.282701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:33.282703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:33.282706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555209591050299:5872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:33.283051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555209591050299:5872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.284215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555209591050299:5872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.287797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555209591050299:5872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.287804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555209591050299:5872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.287806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555209591050299:5872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.287810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.290026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.291689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.291702Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.291704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.291708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.291713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1995 [2:7556555209515492204:4118]
2025-10-02T09:33:33.291723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.291736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.291739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.291741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.291743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.291754Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.291758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.291763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.291806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.291812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.291814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.291816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.291818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.291865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.291870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.291882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.291893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.291912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.291930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050336:5872], now have 1 active actors on pipe
2025-10-02T09:33:33.291937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050255:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.291942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.291932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1995
2025-10-02T09:33:33.291937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1995
2025-10-02T09:33:33.291945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.291946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.291953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.291962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.291964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.291965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.291966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.291978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.291983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.292014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.292021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.292030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.292040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.292047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.292060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.292068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.292073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.292076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.292084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.292091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.292108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.292189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.292194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.292204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.292263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1996 partition: 0 MaxSeqNo: 36 sessionId: src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0
2025-10-02T09:33:33.292522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419eb000-79ca2538-e672c1ab-ec72420f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.295314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Write session: try to update token
2025-10-02T09:33:33.295330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.301269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.301281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.301282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.301284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.301289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.301292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.301294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555209515492199:4118]
2025-10-02T09:33:33.301320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.301320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.301322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.301324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.301326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.301328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.301440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.308266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId: src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.310375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.372457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050343:6623]
2025-10-02T09:33:33.372668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1995, pipe: [1:7556555209591050343:6623]
2025-10-02T09:33:33.413772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.414029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.414039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.414056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050343:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.414188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.414271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050343:6623]
2025-10-02T09:33:33.414272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:33.414294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.414330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1996 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0
2025-10-02T09:33:33.414487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1996 sessionId: src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0 is DEAD
2025-10-02T09:33:33.414681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:33.414696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Write session will restart in 0.007177s
2025-10-02T09:33:33.414722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Write session: Do CDS request
2025-10-02T09:33:33.414728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:33.423203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.423306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:33.423317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1997
2025-10-02T09:33:33.423451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.423472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:33.423477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:33.423480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:33.423439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:33.423755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1997 sessionId:  describe result for acl check
2025-10-02T09:33:33.423783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:33.423783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:33.423784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:33.423787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555209591050388:5868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:33.423781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:33.423900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:33.423907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:33.423916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:33.423954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:33.423985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555209515492287:4105]
2025-10-02T09:33:33.424129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555209591050388:5868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.424336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.424503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.424535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.424720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.424764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.424769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.424769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.424770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.424771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.424772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.424773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.424774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.424775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.424776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.424777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.424778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.424783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.424793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.424796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.424811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.424815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.424819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.424823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.424826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.424829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.424833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.424837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.424841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.424846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.424853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.424859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.424863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.424867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.424874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.424878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.424883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.424887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.424892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.424895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.424903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.424907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.424912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.424916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.424920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.424926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.424931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.424935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.424939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.424944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.424949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.424953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.424958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.424990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.425530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555209591050388:5868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.429740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555209591050388:5868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.429750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555209591050388:5868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.429752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555209591050388:5868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.429755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.432412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.433982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.433996Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.433997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.434001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.434005Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1996 [2:7556555209515492287:4105]
2025-10-02T09:33:33.434017Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.434029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.434032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.434034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.434036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.434047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.434051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.434056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.434094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.434100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.434102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.434105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.434107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.434152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.434158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.434167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.434178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.434195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.434213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050345:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.434219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050426:5868], now have 1 active actors on pipe
2025-10-02T09:33:33.434225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.434227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.434228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.434239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.434250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.434254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.434241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1996
2025-10-02T09:33:33.434257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.434257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1996
2025-10-02T09:33:33.434258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.434265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.434268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.434288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.434293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.434294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.434308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.434314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.434346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.434354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.434359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.434361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.434369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.434376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.434395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.434481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.434486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.434497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.434560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1997 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0
2025-10-02T09:33:33.434860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd6bf0a-17284478-666d2f51-e7e967aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.437608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Write session: try to update token
2025-10-02T09:33:33.437626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.443435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.443448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.443450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.443451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.443456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.443460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.443463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555209515492282:4105]
2025-10-02T09:33:33.443488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.443488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.443491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.443492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.443493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.443495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.443604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.450824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId: src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.452983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.514271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050433:6623]
2025-10-02T09:33:33.514483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1996, pipe: [1:7556555209591050433:6623]
2025-10-02T09:33:33.560246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.560502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.560511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.560526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050433:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.560689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.560767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.560789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050433:6623]
2025-10-02T09:33:33.560819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:33.560878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1997 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0
2025-10-02T09:33:33.561006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1997 sessionId: src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0 is DEAD
2025-10-02T09:33:33.561179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:33.561193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Write session will restart in 0.007645s
2025-10-02T09:33:33.561225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Write session: Do CDS request
2025-10-02T09:33:33.561233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:33.567888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:33.570105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:33.570181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.570213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:33.570220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:33.570228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:33.570253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:33.570262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1998
2025-10-02T09:33:33.570266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:33.570299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555209515492368:4111]
2025-10-02T09:33:33.570356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.570374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:33.570380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:33.570383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:33.570641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1998 sessionId:  describe result for acl check
2025-10-02T09:33:33.570654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.570669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:33.570675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:33.570676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:33.570679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555209591050479:5855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:33.570852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.570885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.571036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555209591050479:5855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.571073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.571115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.571120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.571121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.571121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.571122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.571123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.571124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.571125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.571126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.571127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.571128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.571128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.571134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.571144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.571148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.571151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.571155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.571159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.571163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.571167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.571171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.571175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.571178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.571182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.571188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.571195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.571201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.571206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.571214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.571219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.571222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.571227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.571234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.571239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.571243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.571248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.571253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.571258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.571261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.571266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.571271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.571276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.571280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.571287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.571292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.571297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.571303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.571307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.571337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.572581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555209591050479:5855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.576619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555209591050479:5855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.576629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555209591050479:5855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.576631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555209591050479:5855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.576636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.578826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.580455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.580469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.580471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.580473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.580478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1997 [2:7556555209515492368:4111]
2025-10-02T09:33:33.580487Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.580501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.580504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.580506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.580508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.580521Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.580527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.580533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.580573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.580579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.580581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.580584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.580586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.580633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.580638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.580648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.580659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.580677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.580695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050435:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.580702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050518:5855], now have 1 active actors on pipe
2025-10-02T09:33:33.580707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.580709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.580711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.580724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.580717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1997
2025-10-02T09:33:33.580719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1997
2025-10-02T09:33:33.580738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.580745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.580752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.580755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.580758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.580760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.580786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.580792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.580816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.580826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.580844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.580849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.580855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.580858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.580859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.580867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.580873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.580891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.580986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.580991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.581001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.581046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1998 partition: 0 MaxSeqNo: 36 sessionId: src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0
2025-10-02T09:33:33.581340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1d177c-c8d497b4-99dede87-dc3098af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.584110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Write session: try to update token
2025-10-02T09:33:33.584125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.590075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.590088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.590090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.590092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.590098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.590101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.590104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555209515492363:4111]
2025-10-02T09:33:33.590130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.590131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.590133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.590135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.590136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.590137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.590252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.597558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId: src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.599807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.660721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050525:6623]
2025-10-02T09:33:33.660925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1997, pipe: [1:7556555209591050525:6623]
2025-10-02T09:33:33.706205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.706460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.706469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.706487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050525:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.706643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.706734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.706734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050525:6623]
2025-10-02T09:33:33.706754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:33.706808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1998 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0
2025-10-02T09:33:33.706947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1998 sessionId: src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0 is DEAD
2025-10-02T09:33:33.707128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:33.707144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Write session will restart in 0.006257s
2025-10-02T09:33:33.707169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Write session: Do CDS request
2025-10-02T09:33:33.707176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:33.713938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:33.714137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.714243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:33.714253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1999
2025-10-02T09:33:33.714388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.714408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:33.714415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:33.714418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:33.714708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1999 sessionId:  describe result for acl check
2025-10-02T09:33:33.714728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:33.714732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:33.714733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:33.714736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555209591050571:5853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:33.715108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555209591050571:5853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.716185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:33.716329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:33.716337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:33.716346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:33.716391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:33.716427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555209515492450:4108]
2025-10-02T09:33:33.716433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555209591050571:5853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.716818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.717032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.717069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.717275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.717321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.717326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.717327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.717328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.717330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.717331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.717332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.717333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.717334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.717335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.717336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.717338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.717346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.717356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.717361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.717365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.717369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.717373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.717377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.717381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.717385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.717390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.717394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.717398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.717408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.717415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.717421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.717426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.717430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.717435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.717440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.717447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.717451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.717457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.717462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.717467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.717472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.717480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.717484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.717489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.717494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.717500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.717506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.717511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.717516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.717522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.717526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.717534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.717568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.721750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555209591050571:5853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.721761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555209591050571:5853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.721764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555209591050571:5853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.721768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.725678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.727412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.727425Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.727427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.727430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.727433Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1998 [2:7556555209515492450:4108]
2025-10-02T09:33:33.727443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.727455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.727461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.727463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.727465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.727475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.727478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.727483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.727521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.727526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.727527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.727532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.727534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.727579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.727584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.727592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.727598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.727607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.727622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.727627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.727628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.727633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.727642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.727654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.727659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.727659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.727663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.727665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.727678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.727684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.727696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050611:5853], now have 1 active actors on pipe
2025-10-02T09:33:33.727696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.727710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050526:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.727786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1998
2025-10-02T09:33:33.727794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1998
2025-10-02T09:33:33.727853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.727860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.727878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.727885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.727888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.727890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.728021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.728031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.728041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.728157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.728162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.728171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.728226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1999 partition: 0 MaxSeqNo: 36 sessionId: src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0
2025-10-02T09:33:33.728579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db8a568-78ef57ce-8ed3d403-fa72cfd0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.731420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Write session: try to update token
2025-10-02T09:33:33.731438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.737557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.737571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.737573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.737576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.737582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.737585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.737587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555209515492445:4108]
2025-10-02T09:33:33.737613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.737613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.737615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.737617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.737617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.737619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.737742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.744979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId: src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.747278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.807129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050640:6623]
2025-10-02T09:33:33.807341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1998, pipe: [1:7556555209591050640:6623]
2025-10-02T09:33:33.852459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.852681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.852690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.852707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050640:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.852841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.852905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:33.852905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.852916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:33.852937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050640:6623]
2025-10-02T09:33:33.852964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1999 reason: error at write: Disconnected sessionId: src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0
2025-10-02T09:33:33.853104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1999 sessionId: src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0 is DEAD
2025-10-02T09:33:33.853268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:33.853281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Write session will restart in 0.005693s
2025-10-02T09:33:33.853311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Write session: Do CDS request
2025-10-02T09:33:33.853317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:33.859722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:33.860229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.860304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:33.860313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2000
2025-10-02T09:33:33.860437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:33.860458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:33.860463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:33.860466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:33.860725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2000 sessionId:  describe result for acl check
2025-10-02T09:33:33.860749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:33.860754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:33.860755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:33.860758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555209591050694:5837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:33.861099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555209591050694:5837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:33.862194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:33.862313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:33.862320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:33.862328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:33.862372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:33.862403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555209515492569:4083]
2025-10-02T09:33:33.862438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555209591050694:5837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:33.862757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:33.862939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:33.862972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:33.863161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:33.863205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.863210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.863211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.863212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.863213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.863213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.863215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.863216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.863217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.863218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.863219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.863220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.863224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.863233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.863237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.863241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.863244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.863248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.863253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.863257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.863260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.863264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.863268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.863271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.863277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.863284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:33.863294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.863298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:33.863302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.863307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:33.863312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.863317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:33.863322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.863327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:33.863331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.863335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:33.863340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.863345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:33.863349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.863353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:33.863357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.863361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:33.863365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.863370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.863374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.863379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.863383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.863388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.863422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:33.867264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555209591050694:5837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:33.867274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555209591050694:5837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:33.867276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555209591050694:5837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:33.867279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:33.870856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:33.872468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:33.872480Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:33.872482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:33.872485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:33.872489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1999 [2:7556555209515492569:4083]
2025-10-02T09:33:33.872500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:33.872513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:33.872516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.872517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.872519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.872531Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:33.872535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:33.872541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:33.872576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.872582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.872585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.872587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:33.872589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:33.872637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:33.872642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.872652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:33.872663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:33.872681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:33.872681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1999
2025-10-02T09:33:33.872702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1999
2025-10-02T09:33:33.872698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050644:2446], now have 1 active actors on pipe
2025-10-02T09:33:33.872704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050732:5837], now have 1 active actors on pipe
2025-10-02T09:33:33.872709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.872712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.872714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.872721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:33.872730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:33.872736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:33.872738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:33.872739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:33.872743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:33.872745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:33.872774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.872780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.872789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.872798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:33.872809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:33.872830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:33.872838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:33.872842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:33.872843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:33.872851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:33.872858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:33.872876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.872964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.872969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.872978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:33.873037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2000 partition: 0 MaxSeqNo: 36 sessionId: src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0
2025-10-02T09:33:33.873321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9e59e-2548b527-62723a6e-cf268c9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:33.876074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Write session: try to update token
2025-10-02T09:33:33.876089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:33.881777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:33.881790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:33.881792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:33.881793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:33.881798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.881800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.881802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555209515492564:4083]
2025-10-02T09:33:33.881827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:33.881830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:33.881831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:33.881833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:33.881834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:33.881837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:33.881940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:33.889476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId: src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:33.891748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:33.953037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555209591050744:6623]
2025-10-02T09:33:33.953229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1999, pipe: [1:7556555209591050744:6623]
2025-10-02T09:33:33.996644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:33.996969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:33.996979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:33.996994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050744:6623], now have 1 active actors on pipe
2025-10-02T09:33:33.997117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:33.997231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555209591050744:6623]
2025-10-02T09:33:33.997231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:33.997255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:33.997306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2000 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0
2025-10-02T09:33:33.997423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2000 sessionId: src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0 is DEAD
2025-10-02T09:33:33.997584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:33.997599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Write session will restart in 0.005673s
2025-10-02T09:33:33.997624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Write session: Do CDS request
2025-10-02T09:33:33.997630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.003934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.004290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.004362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.004372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2001
2025-10-02T09:33:34.004496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.004516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.004522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.004525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.004782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2001 sessionId:  describe result for acl check
2025-10-02T09:33:34.004824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.004830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.004831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.004834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018100:5832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.005170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018100:5832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.006140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.006244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.006251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.006259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.006296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.006329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810459961:4080]
2025-10-02T09:33:34.006678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.006732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018100:5832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.006840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.006871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.007062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.007103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.007107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.007108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.007109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.007110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.007111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.007112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.007114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.007115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.007116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.007117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.007118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.007123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.007132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.007136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.007140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.007144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.007148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.007151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.007154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.007158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.007162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.007165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.007169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.007174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.007181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.007188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.007192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.007197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.007203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.007207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.007212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.007217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.007221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.007226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.007231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.007235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.007241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.007248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.007252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.007257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.007262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.007268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.007272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.007276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.007281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.007285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.007289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.007321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.011137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018100:5832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.011146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018100:5832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.011148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018100:5832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.011151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.014723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.016345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.016358Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.016360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.016363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.016367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2000 [2:7556555213810459961:4080]
2025-10-02T09:33:34.016379Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.016392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.016395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.016397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.016399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.016412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.016417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.016422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.016458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.016465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.016467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.016469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.016471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.016519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.016524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.016533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.016544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.016563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.016581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555209591050757:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.016587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018139:5832], now have 1 active actors on pipe
2025-10-02T09:33:34.016592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.016593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.016595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.016605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.016606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2000
2025-10-02T09:33:34.016608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2000
2025-10-02T09:33:34.016615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.016618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.016623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.016624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.016630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.016632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.016651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.016655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.016656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.016670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.016676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.016713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.016722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.016725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.016727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.016733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.016740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.016753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.016875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.016880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.016890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.016951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2001 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0
2025-10-02T09:33:34.017213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68e5753-5f941cbc-766b177b-83b8ffa3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.020007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Write session: try to update token
2025-10-02T09:33:34.020024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.025965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.025979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.025981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.025983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.025989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.025992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.025995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810459956:4080]
2025-10-02T09:33:34.026021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.026024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.026025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.026027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.026028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.026031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.026163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.033261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId: src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.035493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.097455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555213886018147:6623]
2025-10-02T09:33:34.097648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2000, pipe: [1:7556555213886018147:6623]
2025-10-02T09:33:34.139278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:34.139636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.139647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.139663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018147:6623], now have 1 active actors on pipe
2025-10-02T09:33:34.139812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:34.139882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018147:6623]
2025-10-02T09:33:34.139889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:34.139909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:34.139926Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:33:34.139969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2001 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0
2025-10-02T09:33:34.140027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2001 sessionId: src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0 is DEAD
2025-10-02T09:33:34.140090Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 20 consumer shared/user session shared/user_1_20_16953024233389448051_v1 is DEAD
2025-10-02T09:33:34.140176Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:33:34.140201Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555149461485819:6626] disconnected; active server actors: 1
2025-10-02T09:33:34.140207Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555149461485819:6626] client user disconnected session shared/user_1_20_16953024233389448051_v1
2025-10-02T09:33:34.140276Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:34.140279Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:34.140284Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008367s
2025-10-02T09:33:34.140453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:34.140469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Write session will restart in 0.008480s
2025-10-02T09:33:34.140495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Write session: Do CDS request
2025-10-02T09:33:34.140502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.147067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.149081Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:33:34.149278Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:33:34.149285Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 21
2025-10-02T09:33:34.149428Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 21 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:34.149435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.149460Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:34.149523Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 auth for : user
2025-10-02T09:33:34.149554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.149562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.149569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.149609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.149640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810460048:4077]
2025-10-02T09:33:34.149640Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 Handle describe topics response
2025-10-02T09:33:34.149657Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 auth is DEAD
2025-10-02T09:33:34.149659Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:33:34.149815Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:33:34.149864Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555213886018197:5826] connected; active server actors: 1
2025-10-02T09:33:34.149872Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555213886018197:5826] session shared/user_1_21_13935209642462837001_v1
2025-10-02T09:33:34.149876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:33:34.149884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:33:34.149889Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_21_13935209642462837001_v1" (Sender=[1:7556555213886018194:5826], Pipe=[1:7556555213886018197:5826], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:34.149891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:33:34.149897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:33:34.149902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_21_13935209642462837001_v1" (Sender=[1:7556555213886018194:5826], Pipe=[1:7556555213886018197:5826], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:34.149906Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_21_13935209642462837001_v1
2025-10-02T09:33:34.149910Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_21_13935209642462837001_v1" sender [1:7556555213886018194:5826] lock partition 0 for ReadingSession "shared/user_1_21_13935209642462837001_v1" (Sender=[1:7556555213886018194:5826], Pipe=[1:7556555213886018197:5826], Partitions=[], ActiveFamilyCount=1) generation 1 step 21
2025-10-02T09:33:34.149920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:33:34.149925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-02T09:33:34.149984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.150044Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 21 Session: "shared/user_1_21_13935209642462837001_v1" ClientId: "user" PipeClient { RawX1: 7556555213886018197 RawX2: 4503603922343618 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:33:34.150055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:33:34.150148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.150153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2002
2025-10-02T09:33:34.150181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.150190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.150222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.150311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.150326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.150331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.150333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.150406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.150447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.150451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.150452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.150453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.150454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.150455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.150456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.150457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.150458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.150459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.150460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.150461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.150465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.150476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.150480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.150484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.150488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.150492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.150496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.150500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.150503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.150508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.150512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.150516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.150512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2002 sessionId:  describe result for acl check
2025-10-02T09:33:34.150521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.150527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.150527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.150531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.150532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.150534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018206:5816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.150534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.150542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.150545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.150550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.150553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.150559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.150563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.150568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.150572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.150577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.150581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.150587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.150591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.150596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.150601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.150606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.150610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.150616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.150620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.150625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.150629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.150634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.150672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.150872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018206:5816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.152077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018206:5816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.156056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018206:5816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.156065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018206:5816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.156067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018206:5816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.156070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.158333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.160044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.160055Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.160057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.160060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.160064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2001 [2:7556555213810460048:4077]
2025-10-02T09:33:34.160077Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.160089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.160092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.160095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.160096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.160107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.160112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.160117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.160153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.160159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.160160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.160163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.160165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.160214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.160219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.160229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.160241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.160259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.160277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018242:5816], now have 1 active actors on pipe
2025-10-02T09:33:34.160283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018200:5822], now have 1 active actors on pipe
2025-10-02T09:33:34.160286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018148:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.160291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.160293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.160295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.160291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2001
2025-10-02T09:33:34.160298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2001, pipe: [1:7556555213886018200:5822]
2025-10-02T09:33:34.160309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2001
2025-10-02T09:33:34.160309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.160312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.160314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.160315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.160322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.160335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.160340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.160367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.160373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.160381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_21_13935209642462837001_v1 on pipe: [1:7556555213886018200:5822]
2025-10-02T09:33:34.160396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.160401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.160403Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_21_13935209642462837001_v1:1 with generation 2001
2025-10-02T09:33:34.160409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.160416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.160424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.160434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.160439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.160441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.160452Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_21_13935209642462837001_v1
2025-10-02T09:33:34.160457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.160480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.160488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:33:34.160500Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:33:34.163911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:33:34.163927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:33:34.163931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.163934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.163936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.163942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.163948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.163951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:33:34.163959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:33:34.163975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.164037Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397614159 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:33:34.164047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:33:34.164063Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 sending to client partition status
2025-10-02T09:33:34.164091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.164097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.164107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.164155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2002 partition: 0 MaxSeqNo: 36 sessionId: src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0
2025-10-02T09:33:34.164389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5feca5-c3bff7d4-f70855dc-78ae3f64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.166916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Write session: try to update token
2025-10-02T09:33:34.166929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.169577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.169588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.169589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.169591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.169595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.169598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.169601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810460043:4077]
2025-10-02T09:33:34.169623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.169626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.169626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.169628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.169630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.169633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.169744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.178810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId: src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.180927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.282363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:34.282614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.282625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.282781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_21_13935209642462837001_v1
2025-10-02T09:33:34.282797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:34.282817Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_21_13935209642462837001_v1
2025-10-02T09:33:34.282812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:34.282825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:34.282828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:34.282860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018200:5822]
2025-10-02T09:33:34.282886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2002 reason: error at write: Disconnected sessionId: src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0
2025-10-02T09:33:34.283055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2002 sessionId: src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0 is DEAD
2025-10-02T09:33:34.283248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:34.283266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Write session will restart in 0.007130s
2025-10-02T09:33:34.283287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Write session: Do CDS request
2025-10-02T09:33:34.283291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.289855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.291316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.291310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.291320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2003
2025-10-02T09:33:34.291506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.291527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.291534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.291537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.291803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2003 sessionId:  describe result for acl check
2025-10-02T09:33:34.291827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.291831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.291832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.291835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018302:5810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.292093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.292196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.292204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.292211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.292220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018302:5810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.292250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.292278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810460137:4075]
2025-10-02T09:33:34.292619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.292819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.292851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.293047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.293093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.293097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.293098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.293099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.293100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.293101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.293102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.293103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.293104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.293105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.293106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.293108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.293113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.293122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.293126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.293130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.293133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.293137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.293141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.293144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.293148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.293152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.293156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.293159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.293164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.293171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.293176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.293182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.293185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.293190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.293194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.293201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.293207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.293212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.293216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.293224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.293228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.293233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.293237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.293242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.293248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.293253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.293261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.293266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.293270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.293276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.293280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.293284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.293317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.293372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018302:5810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.298113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018302:5810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.298121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018302:5810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.298123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018302:5810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.298126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.300759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.302157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.302171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.302173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.302176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.302180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2002 [2:7556555213810460137:4075]
2025-10-02T09:33:34.302189Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.302200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.302203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.302205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.302207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.302218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.302223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.302228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.302265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.302271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.302275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.302277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.302279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.302323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.302329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.302339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.302350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.302368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.302385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018253:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.302391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018341:5810], now have 1 active actors on pipe
2025-10-02T09:33:34.302396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.302398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.302385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2002
2025-10-02T09:33:34.302399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.302405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.302387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2002
2025-10-02T09:33:34.302415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.302427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.302430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.302432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.302441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.302443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.302445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.302448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.302473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.302484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.302496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d425a939-1dee024c-1be896f4-db1bcac5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.302497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.302504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.302507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.302508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.302515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.302523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.302547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.302643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.302648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.302666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.302720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2003 partition: 0 MaxSeqNo: 36 sessionId: src_id|d425a939-1dee024c-1be896f4-db1bcac5_0
2025-10-02T09:33:34.302999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338dc1a7-282d4346-96ca9fc5-87a307dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d425a939-1dee024c-1be896f4-db1bcac5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.305784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Write session: try to update token
2025-10-02T09:33:34.305799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.311552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.311565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.311566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.311570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.311574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.311577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.311580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810460132:4075]
2025-10-02T09:33:34.311603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.311603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.311607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.311607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.311609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.311609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.311716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.319018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId: src_id|d425a939-1dee024c-1be896f4-db1bcac5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.321185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.383138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555213886018348:5822]
2025-10-02T09:33:34.383370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2002, pipe: [1:7556555213886018348:5822]
2025-10-02T09:33:34.428285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:34.428554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.428564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.428580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018348:5822], now have 1 active actors on pipe
2025-10-02T09:33:34.428747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:34.428812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:34.428827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:34.428834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018348:5822]
2025-10-02T09:33:34.428852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:34.428879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2003 reason: error at write: Disconnected sessionId: src_id|d425a939-1dee024c-1be896f4-db1bcac5_0
2025-10-02T09:33:34.429029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2003 sessionId: src_id|d425a939-1dee024c-1be896f4-db1bcac5_0 is DEAD
2025-10-02T09:33:34.429231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:34.429248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Write session will restart in 0.006734s
2025-10-02T09:33:34.429274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Write session: Do CDS request
2025-10-02T09:33:34.429281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.435917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.437164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.437259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.437268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2004
2025-10-02T09:33:34.437388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.437408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.437414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.437416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.437688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2004 sessionId:  describe result for acl check
2025-10-02T09:33:34.437705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.437710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.437712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.437715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018400:5808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.438067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018400:5808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.438380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.438496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.438504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.438511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.438552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.438583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810460226:4070]
2025-10-02T09:33:34.438945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.439137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.439169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.439345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018400:5808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.439360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.439404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.439409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.439410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.439411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.439412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.439413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.439414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.439415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.439416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.439417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.439418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.439419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.439424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.439434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.439438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.439442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.439445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.439448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.439452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.439455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.439458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.439463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.439466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.439471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.439476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.439483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.439490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.439495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.439500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.439505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.439509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.439513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.439517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.439522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.439526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.439531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.439535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.439540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.439544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.439552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.439556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.439561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.439565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.439573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.439577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.439582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.439589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.439594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.439626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.443553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018400:5808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.443563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018400:5808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.443565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018400:5808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.443578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.447191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.448707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.448719Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.448721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.448724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.448728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2003 [2:7556555213810460226:4070]
2025-10-02T09:33:34.448745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.448758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.448760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.448763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.448764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.448776Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.448780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.448787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.448838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.448844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.448846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.448849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.448851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.448900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.448905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.448915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.448926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.448942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.448961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018350:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.448968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018439:5808], now have 1 active actors on pipe
2025-10-02T09:33:34.448972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.448974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.448976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.448974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2003
2025-10-02T09:33:34.448980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2003
2025-10-02T09:33:34.448989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.448998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.449004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.449006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.449007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.449017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.449019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.449049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.449056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.449066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.449073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.449082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.449097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9394414-ac85548f-e72c970a-2716b190_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.449106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.449109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.449111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.449118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.449128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.449151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.449246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.449252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.449263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.449316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2004 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9394414-ac85548f-e72c970a-2716b190_0
2025-10-02T09:33:34.449633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d425a939-1dee024c-1be896f4-db1bcac5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9394414-ac85548f-e72c970a-2716b190_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.452428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Write session: try to update token
2025-10-02T09:33:34.452446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.458452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.458466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.458468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.458470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.458476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.458480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.458482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810460221:4070]
2025-10-02T09:33:34.458507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.458509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.458511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.458513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.458513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.458515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.458624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.465781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId: src_id|a9394414-ac85548f-e72c970a-2716b190_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.467962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.529069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555213886018446:5822]
2025-10-02T09:33:34.529298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2003, pipe: [1:7556555213886018446:5822]
2025-10-02T09:33:34.576337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:34.576584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.576594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.576610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018446:5822], now have 1 active actors on pipe
2025-10-02T09:33:34.576734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:34.576793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:34.576793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018446:5822]
2025-10-02T09:33:34.576825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:34.576880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2004 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9394414-ac85548f-e72c970a-2716b190_0
2025-10-02T09:33:34.577019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2004 sessionId: src_id|a9394414-ac85548f-e72c970a-2716b190_0 is DEAD
2025-10-02T09:33:34.577187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:34.577201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Write session will restart in 0.006526s
2025-10-02T09:33:34.577226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Write session: Do CDS request
2025-10-02T09:33:34.577232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.583550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.585146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.585241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.585249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2005
2025-10-02T09:33:34.585374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.585394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.585400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.585402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.585727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2005 sessionId:  describe result for acl check
2025-10-02T09:33:34.585757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.585762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.585763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.585769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018499:5797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.585893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.585996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.586003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.586011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.586049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.586077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810460314:4061]
2025-10-02T09:33:34.586178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018499:5797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.586415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.586583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.586614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.586808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.586853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.586857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.586858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.586859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.586860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.586861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.586862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.586863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.586864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.586867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.586868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.586869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.586873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.586882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.586886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.586890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.586894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.586897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.586901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.586904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.586908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.586912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.586915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.586918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.586923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.586930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.586935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.586941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.586945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.586950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.586955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.586960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.586964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.586970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.586977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.586981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.586985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.586990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.586993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.586998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.587003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.587009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.587013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.587017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.587022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.587030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.587033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.587037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.587068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.587706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018499:5797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.591809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018499:5797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.591818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018499:5797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.591820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018499:5797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.591823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.594425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.596033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.596045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.596047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.596050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.596056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2004 [2:7556555213810460314:4061]
2025-10-02T09:33:34.596064Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.596076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.596078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.596081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.596083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.596095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.596100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.596110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.596147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.596154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.596156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.596158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.596160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.596203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.596208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.596218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.596229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.596245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.596262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018538:5797], now have 1 active actors on pipe
2025-10-02T09:33:34.596268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018448:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.596273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.596275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.596277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.596290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.596283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2004
2025-10-02T09:33:34.596289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2004
2025-10-02T09:33:34.596303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.596312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.596318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.596320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.596326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.596328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.596343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.596347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.596359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.596370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.596383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.596393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.596398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.596401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.596402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.596409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.596418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.596434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.596519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.596524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.596534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.596596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2005 partition: 0 MaxSeqNo: 36 sessionId: src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0
2025-10-02T09:33:34.596789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9394414-ac85548f-e72c970a-2716b190_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.599317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Write session: try to update token
2025-10-02T09:33:34.599332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.605466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.605478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.605480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.605481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.605486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.605488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.605491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810460309:4061]
2025-10-02T09:33:34.605514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.605518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.605517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.605519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.605522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.605523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.605630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.611781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId: src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.614004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.677050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555213886018545:5822]
2025-10-02T09:33:34.677259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2004, pipe: [1:7556555213886018545:5822]
2025-10-02T09:33:34.715762Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:34.716160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.716171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.716187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018545:5822], now have 1 active actors on pipe
2025-10-02T09:33:34.716320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:34.716372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018545:5822]
2025-10-02T09:33:34.716388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:34.716392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:34.716477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2005 reason: status is not ok: tablet will be restarted right now sessionId: src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0
2025-10-02T09:33:34.716638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2005 sessionId: src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0 is DEAD
2025-10-02T09:33:34.716790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:34.716820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Write session will restart in 0.005469s
2025-10-02T09:33:34.716841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Write session: Do CDS request
2025-10-02T09:33:34.716847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.723102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.723203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.723210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2006
2025-10-02T09:33:34.723343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.723365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.723373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.723375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.723475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.723640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2006 sessionId:  describe result for acl check
2025-10-02T09:33:34.723665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.723669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.723670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.723673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018598:5790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.724059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018598:5790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.725588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018598:5790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.725872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.725977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.725985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.725992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.726030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.726058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810460402:4047]
2025-10-02T09:33:34.726403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.726596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.726625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.726818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.726861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.726866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.726867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.726868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.726869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.726870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.726871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.726872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.726873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.726873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.726875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.726876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.726880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.726889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.726893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.726896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.726900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.726904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.726908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.726911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.726914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.726918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.726922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.726925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.726930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.726936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.726941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.726946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.726951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.726956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.726960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.726964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.726969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.726974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.726978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.726984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.726988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.726993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.726997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.727002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.727006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.727012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.727016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.727021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.727026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.727034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.727038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.727042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.727075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.728985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018598:5790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.728996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018598:5790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.728999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018598:5790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.729005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.734590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.736010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.736021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.736022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.736025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.736028Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2005 [2:7556555213810460402:4047]
2025-10-02T09:33:34.736035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.736046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.736049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.736051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.736052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.736061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.736068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.736072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.736116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.736122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.736123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.736125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.736127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.736166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.736170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.736177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.736182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.736191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.736205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018638:5790], now have 1 active actors on pipe
2025-10-02T09:33:34.736210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018546:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.736214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.736215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.736216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.736223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.736233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.736236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.736238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.736239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.736243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.736245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.736260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.736267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.736273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.736268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2005
2025-10-02T09:33:34.736268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2005
2025-10-02T09:33:34.736470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.736478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.736492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e94328ec-a90d0473-389509ca-22354a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.736499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.736502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.736503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.736508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.736517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.736527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.736630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.736635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.736642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.736692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2006 partition: 0 MaxSeqNo: 36 sessionId: src_id|e94328ec-a90d0473-389509ca-22354a2_0
2025-10-02T09:33:34.736980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713c97c7-a24c7440-b3eac1c5-aa1535df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e94328ec-a90d0473-389509ca-22354a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.739620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Write session: try to update token
2025-10-02T09:33:34.739636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.749322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:34.749332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.749336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.749356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:34.749360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:34.749492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:34.749607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:34.749715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:34.749825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:34.749979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:34.750001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:34.752127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId: src_id|e94328ec-a90d0473-389509ca-22354a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.753585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.753597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.753598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.753599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.753602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.753604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.753606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810460397:4047]
2025-10-02T09:33:34.753624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.753627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.753628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.753631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.753632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.753634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.753756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.754343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.816285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555213886018667:5822]
2025-10-02T09:33:34.816401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2005, pipe: [1:7556555213886018667:5822]
2025-10-02T09:33:34.863403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:34.863692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.863702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.863715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018667:5822], now have 1 active actors on pipe
2025-10-02T09:33:34.863877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:34.863914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:34.863926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:34.863946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:34.863976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2006 reason: error at write: Disconnected sessionId: src_id|e94328ec-a90d0473-389509ca-22354a2_0
2025-10-02T09:33:34.863976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018667:5822]
2025-10-02T09:33:34.864109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2006 sessionId: src_id|e94328ec-a90d0473-389509ca-22354a2_0 is DEAD
2025-10-02T09:33:34.864438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:34.864452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Write session will restart in 0.009429s
2025-10-02T09:33:34.864477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Write session: Do CDS request
2025-10-02T09:33:34.864482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:34.871139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:34.873323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:34.873424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:34.873430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:34.873436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:34.873464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:34.873487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555213810460530:4042]
2025-10-02T09:33:34.873827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:34.874000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:34.874023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:34.874200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:34.874230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.874234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.874236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.874237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.874237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.874238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.874238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.874239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.874239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.874240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.874241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.874241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.874244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.874251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.874253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.874255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.874257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.874259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.874262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.874264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.874266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.874268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.874270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.874271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.874275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.874279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:34.874283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.874287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:34.874289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.874292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:34.874294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.874297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:34.874300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.874305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:34.874307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.874309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:34.874311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.874314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:34.874316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.874320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:34.874322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.874324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:34.874327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.874329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.874335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.874338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.874341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.874344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.874360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:34.875351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.875480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:34.875489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2007
2025-10-02T09:33:34.875609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:34.875629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:34.875635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:34.875639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:34.875935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2007 sessionId:  describe result for acl check
2025-10-02T09:33:34.875965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:34.875971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:34.875973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:34.875977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555213886018731:5776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:34.876783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555213886018731:5776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:34.878123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555213886018731:5776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:34.881451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555213886018731:5776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:34.881460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555213886018731:5776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:34.881462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555213886018731:5776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:34.881466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:34.881844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:34.883526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:34.883536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:34.883538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:34.883540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:34.883543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2006 [2:7556555213810460530:4042]
2025-10-02T09:33:34.883551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:34.883560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:34.883563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.883565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.883567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.883575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:34.883581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:34.883585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:34.883614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.883619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.883620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.883622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:34.883623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:34.883658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:34.883663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.883669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:34.883675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:34.883682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:34.883696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018673:2446], now have 1 active actors on pipe
2025-10-02T09:33:34.883703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.883704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.883706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.883714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:34.883722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018765:5776], now have 1 active actors on pipe
2025-10-02T09:33:34.883726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:34.883727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:34.883728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:34.883729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:34.883736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:34.883738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:34.883737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2006
2025-10-02T09:33:34.883752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.883758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:34.883759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:34.883743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2006
2025-10-02T09:33:34.883770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.883772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.883794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:34.883803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:34.883805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:34.883807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:34.883812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:34.883817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:34.883827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.883937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:34.883942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:34.883950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:34.884038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2007 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0
2025-10-02T09:33:34.884261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e94328ec-a90d0473-389509ca-22354a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:34.886924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Write session: try to update token
2025-10-02T09:33:34.886938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:34.892749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:34.892761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:34.892762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:34.892763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:34.892767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.892769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.892771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555213810460525:4042]
2025-10-02T09:33:34.892789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:34.892793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:34.892795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:34.892795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:34.892796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:34.892797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:34.892934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:34.899180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId: src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:34.901279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:34.964257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555213886018776:5822]
2025-10-02T09:33:34.964428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2006, pipe: [1:7556555213886018776:5822]
2025-10-02T09:33:35.001505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.001711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.001719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.001731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555213886018776:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.001856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.001928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.001934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:35.001965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555213886018776:5822]
2025-10-02T09:33:35.001988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2007 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0
2025-10-02T09:33:35.002145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2007 sessionId: src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0 is DEAD
2025-10-02T09:33:35.002318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:35.002334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Write session will restart in 0.007037s
2025-10-02T09:33:35.002361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Write session: Do CDS request
2025-10-02T09:33:35.002368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.008905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.010153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.010267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.010277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2008
2025-10-02T09:33:35.010386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.010406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.010413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.010415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.010681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2008 sessionId:  describe result for acl check
2025-10-02T09:33:35.010705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.010709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.010710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.010713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986139:5768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.011040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986139:5768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.011203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.011295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.011302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.011308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.011335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.011357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105427932:4034]
2025-10-02T09:33:35.011692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.011879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.011903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.012074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.012104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.012108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.012108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.012109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.012110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.012110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.012111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.012112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.012112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.012113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.012114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.012114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.012117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.012123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.012125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.012127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.012129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.012131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.012133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.012135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.012137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.012140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.012143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.012145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.012151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.012155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.012158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.012162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.012165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.012167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.012169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.012172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.012174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.012176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.012178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.012181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.012184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.012187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.012193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.012196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.012198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.012200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.012202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.012205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.012211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.012201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986139:5768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.012213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.012216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.012219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.012235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.017033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986139:5768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.017045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986139:5768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.017048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986139:5768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.017053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.019665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.021178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.021189Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.021190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.021192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.021194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2007 [2:7556555218105427932:4034]
2025-10-02T09:33:35.021200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.021212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.021213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.021215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.021216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.021223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.021230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.021233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.021265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.021269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.021270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.021272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.021274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.021307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.021311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.021318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.021323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.021331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.021345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986178:5768], now have 1 active actors on pipe
2025-10-02T09:33:35.021352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.021353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.021354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.021359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.021367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986085:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.021369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.021371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.021372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.021374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.021378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.021380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.021376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2007
2025-10-02T09:33:35.021389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2007
2025-10-02T09:33:35.021395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.021400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.021402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.021417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.021421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.021440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.021447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.021449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.021450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.021455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.021460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.021471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.021565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.021570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.021577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.021637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2008 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0
2025-10-02T09:33:35.021883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f9e052-d1a6f903-865be5b8-607873f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.024397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Write session: try to update token
2025-10-02T09:33:35.024410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.030468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.030480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.030481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.030482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.030485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.030487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.030489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105427925:4034]
2025-10-02T09:33:35.030509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.030512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.030513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.030522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.030527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.030529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.030628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.036776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId: src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.038911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.101983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986186:5822]
2025-10-02T09:33:35.102167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2007, pipe: [1:7556555218180986186:5822]
2025-10-02T09:33:35.139572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.139955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.139964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.139976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986186:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.140076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.140082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.140100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986186:5822]
2025-10-02T09:33:35.140123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:35.140185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0
2025-10-02T09:33:35.140317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2008 sessionId: src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0 is DEAD
2025-10-02T09:33:35.140466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:35.140488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Write session will restart in 0.007246s
2025-10-02T09:33:35.140509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Write session: Do CDS request
2025-10-02T09:33:35.140514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.147393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.149130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.149243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.149254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2009
2025-10-02T09:33:35.149361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.149382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.149388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.149390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.149654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2009 sessionId:  describe result for acl check
2025-10-02T09:33:35.149676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.149681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.149682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.149684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986242:5759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.149741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.149910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.149918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.149924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.149956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.149980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428025:4032]
2025-10-02T09:33:35.150024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986242:5759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.150308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.150488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.150511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.150694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.150726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.150730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.150731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.150732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.150732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.150733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.150734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.150734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.150735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.150735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.150736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.150736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.150739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.150745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.150747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.150750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.150751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.150754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.150755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.150757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.150759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.150761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.150763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.150767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.150770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.150774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.150777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.150780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.150782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.150785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.150787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.150790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.150792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.150794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.150798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.150800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.150803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.150806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.150808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.150810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.150812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.150815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.150817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.150819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.150825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.150827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.150829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.150832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.150853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.151624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986242:5759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.156642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986242:5759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.156654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986242:5759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.156657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986242:5759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.156663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.158279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.159848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.159859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.159860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.159862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.159865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2008 [2:7556555218105428025:4032]
2025-10-02T09:33:35.159874Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.159883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.159885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.159887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.159888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.159896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.159903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.159907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.159936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.159941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.159942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.159944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.159945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.159982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.159987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.159993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.159999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.160008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.160021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.160025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.160026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.160031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.160039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.160040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986187:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.160042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986281:5759], now have 1 active actors on pipe
2025-10-02T09:33:35.160047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.160047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.160049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.160056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.160057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.160071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.160076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.160073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2008
2025-10-02T09:33:35.160077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2008
2025-10-02T09:33:35.160083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.160114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.160120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.160135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|436e771e-d541e0a5-622408a8-a69faf6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.160141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.160144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.160145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.160150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.160157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.160167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.160258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.160262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.160270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.160331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2009 partition: 0 MaxSeqNo: 36 sessionId: src_id|436e771e-d541e0a5-622408a8-a69faf6c_0
2025-10-02T09:33:35.160567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e88fa-2fa8fdcf-ea23144a-dc1e46cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|436e771e-d541e0a5-622408a8-a69faf6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.163098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Write session: try to update token
2025-10-02T09:33:35.163115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.173034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:35.173044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.173048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.173069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:35.173074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:35.173202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:35.173322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:35.173438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:35.173548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:35.173710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:35.173732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:35.175476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId: src_id|436e771e-d541e0a5-622408a8-a69faf6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.177234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.177246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.177248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.177249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.177256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.177257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.177259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428020:4032]
2025-10-02T09:33:35.177277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.177283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.177284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.177313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.177328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.177331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.177387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.177636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.240213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986289:5822]
2025-10-02T09:33:35.240402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2008, pipe: [1:7556555218180986289:5822]
2025-10-02T09:33:35.285031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.285301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.285310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.285322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986289:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.285516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.285511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.285536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:35.285542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:35.285555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986289:5822]
2025-10-02T09:33:35.285589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2009 reason: error at write: Disconnected sessionId: src_id|436e771e-d541e0a5-622408a8-a69faf6c_0
2025-10-02T09:33:35.285730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2009 sessionId: src_id|436e771e-d541e0a5-622408a8-a69faf6c_0 is DEAD
2025-10-02T09:33:35.285881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:35.285894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Write session will restart in 0.009953s
2025-10-02T09:33:35.285917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Write session: Do CDS request
2025-10-02T09:33:35.285923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.292207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.294745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.294844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.294850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.294856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.294880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.294902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428118:4030]
2025-10-02T09:33:35.295237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.295414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.295436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.295608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.295639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.295643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.295643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.295644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.295644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.295645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.295645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.295646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.295646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.295647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.295648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.295648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.295652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.295659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.295661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.295663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.295665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.295667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.295669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.295670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.295672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.295674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.295676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.295678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.295682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.295685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.295688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.295691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.295693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.295696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.295698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.295700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.295704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.295707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.295709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.295712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.295716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.295719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.295721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.295723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.295725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.295728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.295730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.295734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.295736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.295738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.295742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.295744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.295760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.297147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.297252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.297262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2010
2025-10-02T09:33:35.297395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.297415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.297421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.297424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.297729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2010 sessionId:  describe result for acl check
2025-10-02T09:33:35.297759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.297765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.297766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.297770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986353:5758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.298237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986353:5758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.299532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986353:5758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.302685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986353:5758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.302694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986353:5758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.302696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986353:5758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.302700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.303228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.304756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.304767Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.304768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.304770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.304774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2009 [2:7556555218105428118:4030]
2025-10-02T09:33:35.304782Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.304792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.304797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.304799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.304812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.304823Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.304828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.304833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.304867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.304872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.304873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.304874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.304878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.304916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.304921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.304927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.304932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.304942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.304956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986387:5758], now have 1 active actors on pipe
2025-10-02T09:33:35.304961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986292:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.304964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.304965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.304966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.304974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.304982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.304990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.304990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.304993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.304994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.304995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.305008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.305010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.305012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.305015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2009
2025-10-02T09:33:35.305018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2009
2025-10-02T09:33:35.305234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.305241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.305257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.305264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.305268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.305269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.305274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.305279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.305291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.305411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.305416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.305423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.305480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2010 partition: 0 MaxSeqNo: 36 sessionId: src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0
2025-10-02T09:33:35.305692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e771e-d541e0a5-622408a8-a69faf6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.308286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Write session: try to update token
2025-10-02T09:33:35.308305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.314008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.314022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.314024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.314026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.314034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.314037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.314041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428113:4030]
2025-10-02T09:33:35.314065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.314067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.314068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.314070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.314071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.314073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.314193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.320572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId: src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.322717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.353865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:33:35.353882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-02T09:33:35.385638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986397:5822]
2025-10-02T09:33:35.385859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2009, pipe: [1:7556555218180986397:5822]
2025-10-02T09:33:35.422933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.423187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.423196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.423230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986397:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.423455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986397:5822]
2025-10-02T09:33:35.423490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:35.423493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:35.423543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2010 reason: error at write: Disconnected sessionId: src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0
2025-10-02T09:33:35.423630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.423647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-02T09:33:35.423679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2010 sessionId: src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0 is DEAD
2025-10-02T09:33:35.423696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.423843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:35.423857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Write session will restart in 0.009994s
2025-10-02T09:33:35.423879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Write session: Do CDS request
2025-10-02T09:33:35.423885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.430875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.433281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.433403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.433411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.433418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.433457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.433486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428216:4022]
2025-10-02T09:33:35.433838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.434021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.434053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.434242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.434284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.434289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.434289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.434290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.434291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.434292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.434293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.434294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.434294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.434295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.434296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.434297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.434301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.434313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.434316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.434320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.434323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.434327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.434331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.434334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.434337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.434341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.434344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.434348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.434354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.434360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.434364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.434369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.434373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.434377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.434384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.434388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.434393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.434397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.434401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.434405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.434410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.434415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.434419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.434423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.434428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.434433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.434436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.434441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.434448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.434453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.434460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.434465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.434498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.435132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.435220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.435230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2011
2025-10-02T09:33:35.435362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.435387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.435394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.435397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.435720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2011 sessionId:  describe result for acl check
2025-10-02T09:33:35.435752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.435757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.435759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.435765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986460:5752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.436233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986460:5752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.437757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986460:5752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.441437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986460:5752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.441446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986460:5752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.441448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986460:5752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.441453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.441979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.443429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.443441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.443443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.443446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.443450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2010 [2:7556555218105428216:4022]
2025-10-02T09:33:35.443462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.443474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.443476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.443478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.443480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.443491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.443495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.443501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.443540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.443545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.443547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.443549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.443551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.443597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.443602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.443612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.443622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.443637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.443654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986398:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.443660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986493:5752], now have 1 active actors on pipe
2025-10-02T09:33:35.443665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.443667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.443658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2010
2025-10-02T09:33:35.443664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2010
2025-10-02T09:33:35.443669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.443676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.443686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.443692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.443695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.443696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.443700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.443702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.443744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.443750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.443759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.443763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.443768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.443798Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:33:35.443823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.443831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.443834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.443836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.443844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.443854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.443872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.443916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 16 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:33:35.443942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:33:35.443973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.443978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.443988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.444049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2011 partition: 0 MaxSeqNo: 36 sessionId: src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0
2025-10-02T09:33:35.444277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabfc64b-63a69e64-3c05bd30-cc3ecbeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.446823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Write session: try to update token
2025-10-02T09:33:35.446836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.452897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.452908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.452910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.452914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.452918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.452921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.452924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428211:4022]
2025-10-02T09:33:35.452948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.452949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.452952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.452953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.452954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.452954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.453078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.458701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId: src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.460744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.523350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986505:5822]
2025-10-02T09:33:35.523567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2010, pipe: [1:7556555218180986505:5822]
2025-10-02T09:33:35.563907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.564156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.564166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.564181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986505:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.564392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986505:5822]
2025-10-02T09:33:35.564422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.564453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:35.564458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:35.564504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.564508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2011 reason: error at write: Disconnected sessionId: src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0
2025-10-02T09:33:35.564665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2011 sessionId: src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0 is DEAD
2025-10-02T09:33:35.564967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:35.564984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Write session will restart in 0.006936s
2025-10-02T09:33:35.565006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Write session: Do CDS request
2025-10-02T09:33:35.565011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.571520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.573193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.573307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.573318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2012
2025-10-02T09:33:35.573451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.573473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.573479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.573482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.573762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2012 sessionId:  describe result for acl check
2025-10-02T09:33:35.573789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.573793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.573795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.573798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986567:5743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.573999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.574105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.574113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.574120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.574158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.574171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986567:5743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.574190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428313:4024]
2025-10-02T09:33:35.574552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.574796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.574829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.575033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.575078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.575083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.575084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.575085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.575086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.575087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.575088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.575089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.575090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.575091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.575092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.575093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.575097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.575107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.575111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.575115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.575119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.575123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.575127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.575131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.575135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.575140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.575144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.575147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.575153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.575160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.575166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.575173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.575176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.575182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.575191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.575196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.575200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.575208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.575211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.575216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.575220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.575225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.575230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.575235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.575239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.575246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.575249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.575254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.575260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.575264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.575271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.575276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.575308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.575431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986567:5743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.580249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986567:5743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.580259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986567:5743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.580262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986567:5743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.580266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.582946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.584738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.584750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.584752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.584755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.584759Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2011 [2:7556555218105428313:4024]
2025-10-02T09:33:35.584772Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.584787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.584789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.584792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.584793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.584817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.584821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.584826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.584864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.584870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.584872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.584874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.584876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.584922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.584929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.584939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.584950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.584966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.584984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986605:5743], now have 1 active actors on pipe
2025-10-02T09:33:35.584990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986509:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.584995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.584997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.584998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.585011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.585002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2011
2025-10-02T09:33:35.585007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2011
2025-10-02T09:33:35.585024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.585035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.585038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.585039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.585040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.585041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.585073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.585079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.585091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.585101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.585113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.585124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.585129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.585133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.585136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.585143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.585153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.585168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.585267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.585272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.585283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.585336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2012 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0
2025-10-02T09:33:35.585581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f36706-7f3290e0-fab6456c-efdab7a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.588196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Write session: try to update token
2025-10-02T09:33:35.588216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.594442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.594455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.594456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.594457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.594462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.594466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.594468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428308:4024]
2025-10-02T09:33:35.594493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.594492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.594495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.594496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.594497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.594498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.594610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.600467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId: src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.602598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.664696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986613:5822]
2025-10-02T09:33:35.664924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2011, pipe: [1:7556555218180986613:5822]
2025-10-02T09:33:35.705033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.705264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.705273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.705289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986613:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.705462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:35.705473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:35.705477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986613:5822]
2025-10-02T09:33:35.705501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.705534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2012 reason: error at write: Disconnected sessionId: src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0
2025-10-02T09:33:35.705627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.705669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2012 sessionId: src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0 is DEAD
2025-10-02T09:33:35.705811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:35.705824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Write session will restart in 0.008891s
2025-10-02T09:33:35.705847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Write session: Do CDS request
2025-10-02T09:33:35.705853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.712375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.714570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.714698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.714706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.714713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.714756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.714788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428409:4020]
2025-10-02T09:33:35.715140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.715310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.715344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.715537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.715575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.715580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.715581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.715582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.715583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.715584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.715585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.715586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.715586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.715587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.715588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.715590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.715594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.715605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.715609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.715612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.715616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.715619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.715623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.715627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.715630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.715633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.715637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.715640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.715646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.715653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.715658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.715663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.715668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.715674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.715678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.715683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.715690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.715694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.715697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.715702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.715707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.715712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.715716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.715721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.715725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.715730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.715734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.715739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.715744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.715749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.715753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.715758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.715789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.716162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.716269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.716279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2013
2025-10-02T09:33:35.716409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.716428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.716434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.716436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.716689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2013 sessionId:  describe result for acl check
2025-10-02T09:33:35.716707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.716711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.716712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.716715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986678:5745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.717094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986678:5745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.718304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986678:5745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.722169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986678:5745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.722185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986678:5745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.722188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986678:5745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.722194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.723446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.725127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.725141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.725143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.725146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.725151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2012 [2:7556555218105428409:4020]
2025-10-02T09:33:35.725161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.725175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.725178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.725180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.725182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.725196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.725201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.725207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.725251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.725259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.725260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.725263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.725265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.725314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.725321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.725332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.725345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.725365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.725384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986713:5745], now have 1 active actors on pipe
2025-10-02T09:33:35.725391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986615:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.725396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.725398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.725400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.725399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2012
2025-10-02T09:33:35.725412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.725409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2012
2025-10-02T09:33:35.725425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.725427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.725429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.725431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.725441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.725443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.725473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.725482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.725496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.725505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.725522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.725527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.725534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.725537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.725539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.725546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.725553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.725573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.725700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.725706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.725717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.725794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2013 partition: 0 MaxSeqNo: 36 sessionId: src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0
2025-10-02T09:33:35.726062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad479bd4-96bc852c-3a4b6bc3-97933602_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.728726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Write session: try to update token
2025-10-02T09:33:35.728743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.735891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.735906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.735908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.735909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.735915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.735918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.735921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428404:4020]
2025-10-02T09:33:35.735947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.735949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.735951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.735952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.735953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.735954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.736065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.741585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId: src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.743786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.805473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986720:5822]
2025-10-02T09:33:35.805644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2012, pipe: [1:7556555218180986720:5822]
2025-10-02T09:33:35.846784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.847073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.847083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.847097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986720:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.847235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.847274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:35.847283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.847288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:35.847318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986720:5822]
2025-10-02T09:33:35.847332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2013 reason: error at write: Disconnected sessionId: src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0
2025-10-02T09:33:35.847468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2013 sessionId: src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0 is DEAD
2025-10-02T09:33:35.847610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:35.847624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Write session will restart in 0.005532s
2025-10-02T09:33:35.847645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Write session: Do CDS request
2025-10-02T09:33:35.847651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.853521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.854143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.854271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.854280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2014
2025-10-02T09:33:35.854393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.854413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.854418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.854421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.854781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2014 sessionId:  describe result for acl check
2025-10-02T09:33:35.854813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.854820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.854821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.854828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986807:5728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.855272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986807:5728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.856026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.856131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.856139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.856146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.856184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.856217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428543:3990]
2025-10-02T09:33:35.856562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.856642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986807:5728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.856725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.856757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.856961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.857002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.857007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.857008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.857009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.857010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.857011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.857012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.857013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.857014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.857015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.857016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.857017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.857021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.857031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.857035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.857038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.857041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.857045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.857048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.857052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.857056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.857060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.857064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.857068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.857073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.857084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.857089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.857096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.857100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.857105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.857109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.857114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.857118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.857122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.857126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.857129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.857132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.857136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.857139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.857143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.857148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.857153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.857157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.857161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.857167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.857172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.857177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.857181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.857212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.861098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986807:5728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.861109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986807:5728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.861111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986807:5728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.861115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:35.864662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:35.866340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:35.866353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:35.866354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:35.866357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:35.866363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2013 [2:7556555218105428543:3990]
2025-10-02T09:33:35.866375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:35.866387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:35.866389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.866391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.866393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.866404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:35.866413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:35.866418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:35.866452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.866458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.866459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.866462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:35.866464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:35.866514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:35.866521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.866532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.866543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.866562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:35.866567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2013
2025-10-02T09:33:35.866580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986848:5728], now have 1 active actors on pipe
2025-10-02T09:33:35.866579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2013
2025-10-02T09:33:35.866587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986747:2446], now have 1 active actors on pipe
2025-10-02T09:33:35.866591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.866593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.866594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.866601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:35.866610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:35.866613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:35.866614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:35.866615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:35.866627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:35.866630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:35.866643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.866649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.866684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.866693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:35.866705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|538767de-dd962005-aa620df6-1e037a5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:35.866706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:35.866714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:35.866717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:35.866719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:35.866725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:35.866732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:35.866761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.866843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.866848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.866859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:35.866906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2014 partition: 0 MaxSeqNo: 36 sessionId: src_id|538767de-dd962005-aa620df6-1e037a5f_0
2025-10-02T09:33:35.867184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b7e3c2-ff6c6b72-f6eeecad-84e36ac5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|538767de-dd962005-aa620df6-1e037a5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:35.869833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Write session: try to update token
2025-10-02T09:33:35.869850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:35.875860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:35.875872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:35.875874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:35.875875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:35.875880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.875883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.875886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428538:3990]
2025-10-02T09:33:35.875909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:35.875910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:35.875912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:35.875914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:35.875915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.875917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:35.876058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:35.882087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId: src_id|538767de-dd962005-aa620df6-1e037a5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:35.884319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:35.947294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555218180986858:5822]
2025-10-02T09:33:35.947468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2013, pipe: [1:7556555218180986858:5822]
2025-10-02T09:33:35.983979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:35.984205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:35.984215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:35.984230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986858:5822], now have 1 active actors on pipe
2025-10-02T09:33:35.984364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:35.984380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:35.984427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:35.984439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:35.984490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2014 reason: error at write: Disconnected sessionId: src_id|538767de-dd962005-aa620df6-1e037a5f_0
2025-10-02T09:33:35.984548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555218180986858:5822]
2025-10-02T09:33:35.984659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2014 sessionId: src_id|538767de-dd962005-aa620df6-1e037a5f_0 is DEAD
2025-10-02T09:33:35.984839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:35.984853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Write session will restart in 0.006137s
2025-10-02T09:33:35.984878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Write session: Do CDS request
2025-10-02T09:33:35.984884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:35.990830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:35.992141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.992248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:35.992257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2015
2025-10-02T09:33:35.992385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:35.992405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:35.992411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:35.992413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:35.992680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2015 sessionId:  describe result for acl check
2025-10-02T09:33:35.992704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:35.992709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:35.992710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:35.992713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555218180986932:5719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:35.993031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555218180986932:5719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:35.993184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:35.993288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:35.993296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:35.993303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:35.993343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:35.993373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555218105428654:3982]
2025-10-02T09:33:35.993717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:35.993884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:35.993915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:35.994053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555218180986932:5719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:35.994101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:35.994144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.994148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.994149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.994150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.994151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.994152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.994153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.994154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.994155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.994156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.994157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.994158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.994162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.994171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.994175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.994178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.994182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.994185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.994189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.994193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.994196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.994201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.994205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.994208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.994213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.994220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:35.994225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.994229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:35.994234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.994238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:35.994244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.994249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:35.994253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.994262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:35.994267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.994271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:35.994276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.994282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:35.994286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.994291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:35.994296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.994301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:35.994305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.994310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:35.994314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.994320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:35.994324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.994331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:35.994363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:35.998181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555218180986932:5719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:35.998190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555218180986932:5719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:35.998192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555218180986932:5719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:35.998195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.001747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.003212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.003226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.003227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.003230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.003235Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2014 [2:7556555218105428654:3982]
2025-10-02T09:33:36.003244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.003256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.003258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.003260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.003262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.003273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.003277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.003283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.003315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.003321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.003323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.003325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.003327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.003371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.003377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.003387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.003398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.003416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.003435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986859:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.003441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555218180986971:5719], now have 1 active actors on pipe
2025-10-02T09:33:36.003446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.003448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.003449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.003459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.003466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.003444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2014
2025-10-02T09:33:36.003468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.003469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.003460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2014
2025-10-02T09:33:36.003471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.003483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.003485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.003513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.003519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.003529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.003537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.003544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.003557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.003565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.003568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.003570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.003576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.003583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.003601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.003688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.003693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.003703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.003756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2015 partition: 0 MaxSeqNo: 36 sessionId: src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0
2025-10-02T09:33:36.004006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538767de-dd962005-aa620df6-1e037a5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.006601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Write session: try to update token
2025-10-02T09:33:36.006614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.012580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.012594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.012596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.012597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.012601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.012604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.012607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555218105428649:3982]
2025-10-02T09:33:36.012630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.012631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.012633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.012634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.012635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.012635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.012743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.021113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId: src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.023354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.084511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954275:5822]
2025-10-02T09:33:36.084664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2014, pipe: [1:7556555222475954275:5822]
2025-10-02T09:33:36.121716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.122092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.122102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.122117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954275:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.122239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.122278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:36.122286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:36.122288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954275:5822]
2025-10-02T09:33:36.122301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.122330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2015 reason: error at write: Disconnected sessionId: src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0
2025-10-02T09:33:36.122464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2015 sessionId: src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0 is DEAD
2025-10-02T09:33:36.122644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:36.122670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Write session will restart in 0.009131s
2025-10-02T09:33:36.122692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Write session: Do CDS request
2025-10-02T09:33:36.122697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.129362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.131656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.131766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.131773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.131780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.131818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.131849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396051:3980]
2025-10-02T09:33:36.132190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.132354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.132385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.132571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.132613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.132618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.132618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.132619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.132620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.132621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.132622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.132623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.132624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.132625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.132626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.132627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.132630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.132641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.132645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.132648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.132652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.132656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.132660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.132663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.132667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.132671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.132675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.132679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.132685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.132693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.132697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.132702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.132706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.132711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.132717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.132722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.132726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.132732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.132736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.132741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.132749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.132754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.132757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.132762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.132767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.132772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.132776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.132783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.132787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.132791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.132795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.132811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.132843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.133133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.133249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.133258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2016
2025-10-02T09:33:36.133369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.133387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.133393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.133396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.133651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2016 sessionId:  describe result for acl check
2025-10-02T09:33:36.133682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.133690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.133691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.133696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475954343:5714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.134031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475954343:5714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.135539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475954343:5714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.139003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475954343:5714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.139014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475954343:5714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.139016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475954343:5714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.139019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.140222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.141774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.141787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.141788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.141790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.141797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2015 [2:7556555222400396051:3980]
2025-10-02T09:33:36.141808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.141820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.141822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.141824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.141826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.141839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.141842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.141847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.141884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.141890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.141892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.141894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.141896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.141939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.141944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.141955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.141965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.141984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.141984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2015
2025-10-02T09:33:36.141994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2015
2025-10-02T09:33:36.142000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954276:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.142006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954377:5714], now have 1 active actors on pipe
2025-10-02T09:33:36.142011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.142013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.142015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.142021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.142024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.142026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.142027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.142031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.142044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.142049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.142064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.142070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.142091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.142101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.142106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.142112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.142117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.142120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.142122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.142129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.142135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.142158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.142243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.142248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.142258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.142298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2016 partition: 0 MaxSeqNo: 36 sessionId: src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0
2025-10-02T09:33:36.142519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38f648d-d1bfdf4a-75b967fa-9bd12de1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.145164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Write session: try to update token
2025-10-02T09:33:36.145182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.151145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.151159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.151161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.151162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.151167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.151170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.151173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396046:3980]
2025-10-02T09:33:36.151196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.151198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.151198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.151200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.151202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.151204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.151313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.159724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId: src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.162010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.222244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954385:5822]
2025-10-02T09:33:36.222479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2015, pipe: [1:7556555222475954385:5822]
2025-10-02T09:33:36.263687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.264042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.264053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.264067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954385:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.264189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.264251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954385:5822]
2025-10-02T09:33:36.264281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.264283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:36.264344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2016 reason: status is not ok: tablet will be restarted right now sessionId: src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0
2025-10-02T09:33:36.264501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2016 sessionId: src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0 is DEAD
2025-10-02T09:33:36.264638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:36.264653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Write session will restart in 0.005440s
2025-10-02T09:33:36.264675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Write session: Do CDS request
2025-10-02T09:33:36.264681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.271143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.271252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.271260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2017
2025-10-02T09:33:36.271314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.271377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.271398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.271403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.271406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.271718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2017 sessionId:  describe result for acl check
2025-10-02T09:33:36.271747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.271752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.271753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.271757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475954451:5705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.272191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475954451:5705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.273692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.273798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.273806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.273813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.273824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475954451:5705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.273851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.273882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396152:3979]
2025-10-02T09:33:36.274349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.274524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.274555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.274757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.274799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.274804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.274805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.274806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.274807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.274808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.274809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.274810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.274811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.274812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.274813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.274813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.274818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.274827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.274831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.274835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.274839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.274842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.274846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.274850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.274853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.274857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.274861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.274865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.274870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.274876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.274884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.274893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.274897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.274902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.274906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.274912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.274917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.274922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.274925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.274930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.274936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.274940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.274945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.274953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.274957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.274961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.274965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.274973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.274977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.274982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.274986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.274992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.275024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.275317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475954451:5705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.275328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475954451:5705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.275329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475954451:5705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.275333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.282371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.283777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.283790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.283791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.283794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.283800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2016 [2:7556555222400396152:3979]
2025-10-02T09:33:36.283840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.283856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.283861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.283863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.283865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.283877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.283885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.283890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.283925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.283931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.283932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.283935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.283937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.283982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.283988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.283998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.284010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.284028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.284046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954388:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.284053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954489:5705], now have 1 active actors on pipe
2025-10-02T09:33:36.284058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.284063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.284065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.284076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.284072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2016
2025-10-02T09:33:36.284087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.284087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.284091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2016
2025-10-02T09:33:36.284088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.284090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.284102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.284105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.284132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.284139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.284147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.284157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.284164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.284177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d995604-6f180627-816acc1e-2e4c4a67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.284183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.284188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.284190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.284196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.284204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.284221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.284309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.284314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.284324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.284375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2017 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d995604-6f180627-816acc1e-2e4c4a67_0
2025-10-02T09:33:36.284603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|530ae581-93ed9dd9-81ca2619-9c0aacc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d995604-6f180627-816acc1e-2e4c4a67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.287211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Write session: try to update token
2025-10-02T09:33:36.287229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.293118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.293131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.293132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.293133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.293139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.293142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.293144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396147:3979]
2025-10-02T09:33:36.293169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.293169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.293172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.293176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.293187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.293189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.293287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.300046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId: src_id|4d995604-6f180627-816acc1e-2e4c4a67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.302283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.364571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954498:5822]
2025-10-02T09:33:36.364726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2016, pipe: [1:7556555222475954498:5822]
2025-10-02T09:33:36.400926Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.401151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.401160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.401176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954498:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.401317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.401334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.401364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954498:5822]
2025-10-02T09:33:36.401367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:36.401433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2017 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d995604-6f180627-816acc1e-2e4c4a67_0
2025-10-02T09:33:36.401594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2017 sessionId: src_id|4d995604-6f180627-816acc1e-2e4c4a67_0 is DEAD
2025-10-02T09:33:36.401691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:36.401699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Write session will restart in 0.005324s
2025-10-02T09:33:36.401718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Write session: Do CDS request
2025-10-02T09:33:36.401723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.408181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.408202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.408284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.408296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2018
2025-10-02T09:33:36.408422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.408443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.408448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.408451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.408712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2018 sessionId:  describe result for acl check
2025-10-02T09:33:36.408731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.408735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.408737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.408739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475954563:5695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.409094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475954563:5695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.410542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.410585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475954563:5695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.410666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.410674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.410683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.410726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.410757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396257:3976]
2025-10-02T09:33:36.411096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.411277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.411308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.411495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.411537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.411542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.411543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.411544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.411545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.411546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.411546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.411547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.411548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.411549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.411550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.411551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.411555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.411565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.411568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.411572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.411576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.411580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.411583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.411587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.411590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.411594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.411598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.411602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.411607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.411615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.411620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.411629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.411632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.411637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.411641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.411647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.411652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.411656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.411661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.411666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.411671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.411676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.411680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.411685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.411689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.411693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.411697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.411702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.411706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.411710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.411714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.411718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.411750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.415614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475954563:5695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.415625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475954563:5695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.415628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475954563:5695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.415633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.419140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.420686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.420699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.420700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.420703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.420707Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2017 [2:7556555222400396257:3976]
2025-10-02T09:33:36.420716Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.420727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.420730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.420732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.420734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.420745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.420749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.420754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.420793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.420799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.420813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.420815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.420817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.420859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.420865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.420875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.420885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.420904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.420921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954602:5695], now have 1 active actors on pipe
2025-10-02T09:33:36.420927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954499:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.420932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.420934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.420936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.420928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2017
2025-10-02T09:33:36.420942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.420940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2017
2025-10-02T09:33:36.420955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.420958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.420961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.420962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.420970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.420972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.420996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.421002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.421015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.421024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.421036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.421044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.421049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.421053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.421054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.421061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.421072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.421088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.421155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.421160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.421170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.421222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2018 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0
2025-10-02T09:33:36.421469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d995604-6f180627-816acc1e-2e4c4a67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.424134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Write session: try to update token
2025-10-02T09:33:36.424149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.429938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.429951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.429952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.429954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.429958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.429960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.429963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396252:3976]
2025-10-02T09:33:36.429986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.429987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.429989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.429990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.429991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.429992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.430100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.436511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId: src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.438829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.501275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954610:5822]
2025-10-02T09:33:36.501432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2017, pipe: [1:7556555222475954610:5822]
2025-10-02T09:33:36.538383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.538758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.538769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.538784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954610:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.538969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:36.538973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954610:5822]
2025-10-02T09:33:36.538984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:36.538989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.538985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.539036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2018 reason: error at write: Disconnected sessionId: src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0
2025-10-02T09:33:36.539173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2018 sessionId: src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0 is DEAD
2025-10-02T09:33:36.539292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:36.539301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Write session will restart in 0.006830s
2025-10-02T09:33:36.539317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Write session: Do CDS request
2025-10-02T09:33:36.539321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.545815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.547150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.547262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.547272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2019
2025-10-02T09:33:36.547378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.547398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.547404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.547406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.547670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2019 sessionId:  describe result for acl check
2025-10-02T09:33:36.547695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.547699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.547700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.547703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475954677:5692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.548049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475954677:5692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.548263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.548382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.548390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.548397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.548437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.548466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396359:3974]
2025-10-02T09:33:36.548821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.549016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.549048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.549235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.549241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475954677:5692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.549278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.549282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.549283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.549284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.549285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.549286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.549287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.549288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.549289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.549290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.549290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.549291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.549295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.549305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.549308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.549312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.549315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.549318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.549322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.549325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.549329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.549333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.549337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.549341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.549346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.549352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.549357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.549362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.549370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.549375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.549379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.549384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.549391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.549395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.549400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.549405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.549413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.549417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.549421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.549426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.549431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.549436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.549441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.549446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.549451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.549457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.549462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.549468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.549499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.553373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475954677:5692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.553385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475954677:5692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.553388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475954677:5692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.553393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.557047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.558595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.558609Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.558611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.558613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.558617Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2018 [2:7556555222400396359:3974]
2025-10-02T09:33:36.558628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.558642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.558644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.558647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.558648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.558670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.558676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.558683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.558719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.558725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.558727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.558729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.558731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.558774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.558780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.558790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.558801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.558820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.558836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954719:5692], now have 1 active actors on pipe
2025-10-02T09:33:36.558843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954612:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.558847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.558849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.558851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.558847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2018
2025-10-02T09:33:36.558851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2018
2025-10-02T09:33:36.558863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.558874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.558876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.558883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.558886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.558888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.558891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.558915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.558922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.558934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.558943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.558951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.558965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.558974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.558977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.558982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.558988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.558995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.559114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.559239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.559245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.559255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.559304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2019 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0
2025-10-02T09:33:36.559506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c82ce4c-496775c6-79b1f130-64c6d01b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.562097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Write session: try to update token
2025-10-02T09:33:36.562114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.568058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.568072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.568073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.568075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.568079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.568082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.568085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396354:3974]
2025-10-02T09:33:36.568108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.568109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.568111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.568113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.568118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.568120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.568226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.574440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId: src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.576653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.639003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954726:5822]
2025-10-02T09:33:36.639165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2018, pipe: [1:7556555222475954726:5822]
2025-10-02T09:33:36.679187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.679437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.679447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.679462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954726:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.679607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.679636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:36.679639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.679650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:36.679668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954726:5822]
2025-10-02T09:33:36.679704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2019 reason: error at write: Disconnected sessionId: src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0
2025-10-02T09:33:36.679874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2019 sessionId: src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0 is DEAD
2025-10-02T09:33:36.680202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:36.680219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Write session will restart in 0.008930s
2025-10-02T09:33:36.680240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Write session: Do CDS request
2025-10-02T09:33:36.680246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.686569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.689042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.689147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.689155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.689163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.689201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.689232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396463:3972]
2025-10-02T09:33:36.689576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.689738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.689768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.689955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.689996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.690001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.690002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.690002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.690003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.690004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.690005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.690006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.690007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.690008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.690009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.690010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.690015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.690025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.690029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.690034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.690038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.690042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.690046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.690048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.690052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.690056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.690058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.690062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.690067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.690078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.690082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.690087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.690091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.690096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.690103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.690107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.690111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.690116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.690120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.690126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.690130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.690134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.690139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.690143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.690147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.690151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.690155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.690163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.690168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.690166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.690171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.690175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.690180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.690211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.690264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.690276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2020
2025-10-02T09:33:36.690377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.690396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.690402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.690405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.690695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2020 sessionId:  describe result for acl check
2025-10-02T09:33:36.690720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.690724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.690725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.690729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475954798:5687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.691065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475954798:5687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.692588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475954798:5687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.696398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475954798:5687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.696407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475954798:5687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.696409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475954798:5687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.696412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.697600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.699224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.699238Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.699239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.699242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.699246Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2019 [2:7556555222400396463:3972]
2025-10-02T09:33:36.699255Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.699267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.699269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.699271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.699273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.699284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.699288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.699293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.699330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.699337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.699339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.699341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.699343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.699390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.699395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.699405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.699416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.699435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.699446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2019
2025-10-02T09:33:36.699453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954833:5687], now have 1 active actors on pipe
2025-10-02T09:33:36.699455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2019
2025-10-02T09:33:36.699460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954728:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.699464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.699466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.699468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.699474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.699480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.699484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.699489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.699490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.699496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.699498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.699510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.699513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.699540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.699549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.699557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.699560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.699565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.699568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.699569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.699576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.699582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.699611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.699704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.699709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.699718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.699765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2020 partition: 0 MaxSeqNo: 36 sessionId: src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0
2025-10-02T09:33:36.699985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3ac4b4-e895c1cf-f00de4fc-af20c2dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.702580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Write session: try to update token
2025-10-02T09:33:36.702593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.708649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.708662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.708664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.708665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.708672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.708676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.708678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396458:3972]
2025-10-02T09:33:36.708701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.708702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.708705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.708705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.708706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.708707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.708832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.714915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId: src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.717029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.779796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954840:5822]
2025-10-02T09:33:36.779967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2019, pipe: [1:7556555222475954840:5822]
2025-10-02T09:33:36.817554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.817941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.817952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.817966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954840:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.818088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.818109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.818125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:36.818128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:36.818155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954840:5822]
2025-10-02T09:33:36.818179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2020 reason: error at write: Disconnected sessionId: src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0
2025-10-02T09:33:36.818338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2020 sessionId: src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0 is DEAD
2025-10-02T09:33:36.818493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:36.818507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Write session will restart in 0.008581s
2025-10-02T09:33:36.818532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Write session: Do CDS request
2025-10-02T09:33:36.818537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.825287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.827884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.828072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.828081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.828090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.828135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.828164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.828166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396568:3970]
2025-10-02T09:33:36.828270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.828280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2021
2025-10-02T09:33:36.828400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.828419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.828424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.828427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.828509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.828692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.828725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.828737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2021 sessionId:  describe result for acl check
2025-10-02T09:33:36.828761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.828765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.828766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.828769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475954910:5684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.828925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.828967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.828971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.828972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.828973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.828974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.828975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.828976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.828977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.828978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.828979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.828980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.828981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.828985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.828995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.828999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.829003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.829007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.829012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.829016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.829019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.829022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.829026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.829029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.829033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.829038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.829046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.829051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.829056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.829060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.829065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.829069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.829073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.829079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.829084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.829087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.829092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.829096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.829101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.829106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.829110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.829114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.829119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.829122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.829130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.829135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.829139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.829143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.829132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475954910:5684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.829147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.829178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.830342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475954910:5684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.834471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475954910:5684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.834482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475954910:5684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.834485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475954910:5684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.834488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.836677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.838294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.838308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.838310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.838312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.838317Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2020 [2:7556555222400396568:3970]
2025-10-02T09:33:36.838326Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.838337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.838340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.838342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.838344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.838354Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.838358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.838364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.838399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.838407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.838409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.838411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.838413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.838459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.838465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.838475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.838486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.838504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.838505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2020
2025-10-02T09:33:36.838523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954947:5684], now have 1 active actors on pipe
2025-10-02T09:33:36.838529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954841:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.838527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2020
2025-10-02T09:33:36.838534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.838536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.838538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.838545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.838550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.838552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.838553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.838556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.838568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.838571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.838588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.838593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.838619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.838628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.838635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.838638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.838643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.838647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.838649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.838665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.838671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.838697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.838791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.838797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.838807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.838853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2021 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0
2025-10-02T09:33:36.839078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22b2b0b7-c19fb55-537b88f1-5c86698c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.841853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Write session: try to update token
2025-10-02T09:33:36.841867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.847932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.847949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.847951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.847953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.847958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.847962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.847965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396563:3970]
2025-10-02T09:33:36.847990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.847991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.847994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.847994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.847996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.847996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.848107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.854840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId: src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.856919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:36.918033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555222475954985:5822]
2025-10-02T09:33:36.918187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2020, pipe: [1:7556555222475954985:5822]
2025-10-02T09:33:36.959129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:36.959405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.959415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.959431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954985:5822], now have 1 active actors on pipe
2025-10-02T09:33:36.959550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:36.959591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:36.959604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555222475954985:5822]
2025-10-02T09:33:36.959622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:36.959658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2021 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0
2025-10-02T09:33:36.959802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2021 sessionId: src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0 is DEAD
2025-10-02T09:33:36.959903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:36.959912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Write session will restart in 0.007823s
2025-10-02T09:33:36.959925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Write session: Do CDS request
2025-10-02T09:33:36.959929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:36.966713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:36.969192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.969217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:36.969297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:36.969307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2022
2025-10-02T09:33:36.969328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:36.969335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:36.969342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:36.969385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:36.969401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:36.969419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:36.969425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:36.969428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:36.969482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555222400396721:3942]
2025-10-02T09:33:36.969683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2022 sessionId:  describe result for acl check
2025-10-02T09:33:36.969708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:36.969709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:36.969710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:36.969713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555222475955054:5666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:36.969834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:36.970030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:36.970061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:36.970073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555222475955054:5666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:36.970251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:36.970294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.970299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.970301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.970302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.970303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.970304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.970305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.970305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.970306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.970307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.970308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.970309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.970313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.970323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.970326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.970329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.970332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.970335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.970339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.970343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.970346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.970350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.970353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.970356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.970360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.970367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:36.970373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.970378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:36.970381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.970386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:36.970390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.970395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:36.970398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.970404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:36.970408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.970415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:36.970424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.970429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:36.970433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.970438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:36.970444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.970448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:36.970452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.970457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.970462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.970466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.970470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.970476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.970507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:36.971794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555222475955054:5666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:36.975948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555222475955054:5666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:36.975957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555222475955054:5666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:36.975959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555222475955054:5666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:36.975962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:36.977963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:36.979579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:36.979591Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:36.979593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:36.979595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:36.979600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2021 [2:7556555222400396721:3942]
2025-10-02T09:33:36.979608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:36.979620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:36.979623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.979626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.979627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.979638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:36.979642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:36.979647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:36.979681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.979687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.979689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.979691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:36.979693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:36.979736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:36.979741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.979751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:36.979762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:36.979780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:36.979797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475954986:2446], now have 1 active actors on pipe
2025-10-02T09:33:36.979803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555222475955092:5666], now have 1 active actors on pipe
2025-10-02T09:33:36.979807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.979810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.979811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.979799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2021
2025-10-02T09:33:36.979805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2021
2025-10-02T09:33:36.979817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:36.979831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:36.979832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:36.979834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:36.979836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:36.979848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:36.979850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:36.979878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.979885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.979894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.979903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:36.979914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:36.979923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:36.979928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:36.979931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:36.979932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:36.979939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:36.979946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:36.979964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.980033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:36.980038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:36.980047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:36.980099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2022 partition: 0 MaxSeqNo: 36 sessionId: src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0
2025-10-02T09:33:36.980312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ef1003-7b51f40c-4c2bca80-e26e5a61_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:36.983002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Write session: try to update token
2025-10-02T09:33:36.983017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:36.988972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:36.988984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:36.988986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:36.988987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:36.988992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.988995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.988998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555222400396716:3942]
2025-10-02T09:33:36.989020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:36.989022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:36.989024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:36.989026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:36.989026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:36.989027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:36.989142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:36.995061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId: src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:36.997112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.059868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770922409:5822]
2025-10-02T09:33:37.060075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2021, pipe: [1:7556555226770922409:5822]
2025-10-02T09:33:37.097565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.097797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.097807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.097822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922409:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.097963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:37.097971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.097990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770922409:5822]
2025-10-02T09:33:37.098005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:37.098064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2022 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0
2025-10-02T09:33:37.098202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2022 sessionId: src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0 is DEAD
2025-10-02T09:33:37.098361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:37.098374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Write session will restart in 0.008710s
2025-10-02T09:33:37.098398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Write session: Do CDS request
2025-10-02T09:33:37.098403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.105699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.108028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.108168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.108153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.108162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.108171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.108211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.108226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.108235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2023
2025-10-02T09:33:37.108242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364126:3943]
2025-10-02T09:33:37.108399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.108418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.108424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.108429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.108586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.108699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2023 sessionId:  describe result for acl check
2025-10-02T09:33:37.108722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.108726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.108727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.108730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770922481:5656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.108773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.108815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.109004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.109045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.109050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.109050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.109051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.109052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.109053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.109054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.109055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.109056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.109056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.109057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.109058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.109063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.109073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.109077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.109081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.109085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.109082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770922481:5656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.109089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.109092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.109096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.109099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.109104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.109107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.109111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.109116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.109122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.109130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.109135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.109139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.109143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.109147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.109154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.109158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.109162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.109169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.109174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.109178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.109183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.109187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.109195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.109198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.109204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.109208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.109215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.109219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.109224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.109228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.109233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.109264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.110372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770922481:5656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.114538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770922481:5656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.114547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770922481:5656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.114549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770922481:5656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.114552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.116756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.118433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.118447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.118449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.118451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.118455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2022 [2:7556555226695364126:3943]
2025-10-02T09:33:37.118466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.118478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.118480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.118483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.118484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.118496Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.118500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.118506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.118540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.118546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.118548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.118550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.118553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.118596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.118602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.118613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.118624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.118643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.118669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922518:5656], now have 1 active actors on pipe
2025-10-02T09:33:37.118677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922410:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.118682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.118684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.118685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.118675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2022
2025-10-02T09:33:37.118678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2022
2025-10-02T09:33:37.118696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.118707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.118709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.118711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.118712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.118720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.118723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.118749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.118755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.118768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.118777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.118788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.118797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5701906a-73578afa-f67875ef-70c183ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.118804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.118807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.118809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.118816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.118822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.118842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.118940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.118945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.118955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.119011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2023 partition: 0 MaxSeqNo: 36 sessionId: src_id|5701906a-73578afa-f67875ef-70c183ed_0
2025-10-02T09:33:37.119206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af06fda2-e7dfa314-44aacee5-9e6106ba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5701906a-73578afa-f67875ef-70c183ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.121791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Write session: try to update token
2025-10-02T09:33:37.121800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.128229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.128245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.128246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.128248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.128253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.128256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.128259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364121:3943]
2025-10-02T09:33:37.128283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.128284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.128287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.128287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.128289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.128289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.128405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.133293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId: src_id|5701906a-73578afa-f67875ef-70c183ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.135266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.198100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770922526:5822]
2025-10-02T09:33:37.198266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2022, pipe: [1:7556555226770922526:5822]
2025-10-02T09:33:37.236903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.237122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.237132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.237162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922526:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.237281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:37.237314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:37.237328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:37.237334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770922526:5822]
2025-10-02T09:33:37.237354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.237380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2023 reason: error at write: Disconnected sessionId: src_id|5701906a-73578afa-f67875ef-70c183ed_0
2025-10-02T09:33:37.237531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2023 sessionId: src_id|5701906a-73578afa-f67875ef-70c183ed_0 is DEAD
2025-10-02T09:33:37.237652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:37.237661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Write session will restart in 0.006019s
2025-10-02T09:33:37.237675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Write session: Do CDS request
2025-10-02T09:33:37.237680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.244061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.245214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.245307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.245317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2024
2025-10-02T09:33:37.245403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.245423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.245430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.245432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.245691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2024 sessionId:  describe result for acl check
2025-10-02T09:33:37.245710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.245714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.245715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.245718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770922597:5653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.246051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770922597:5653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.246453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.246576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.246584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.246592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.246634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.246673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364234:3938]
2025-10-02T09:33:37.247020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.247185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.247216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.247406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.247449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.247454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.247455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.247456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.247457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.247458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.247459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.247460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.247461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.247462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.247462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.247463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.247468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.247477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.247481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.247485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.247488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.247493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.247497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.247499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.247503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.247506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.247509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.247513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.247518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.247524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.247529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.247534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.247538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.247542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.247548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.247553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.247557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.247563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.247567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.247571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.247576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.247580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.247584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.247588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.247593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.247601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.247605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.247609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.247616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.247621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.247616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770922597:5653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.247624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.247630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.247660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.252418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770922597:5653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.252427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770922597:5653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.252429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770922597:5653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.252432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.255068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.256603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.256617Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.256619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.256621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.256625Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2023 [2:7556555226695364234:3938]
2025-10-02T09:33:37.256634Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.256647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.256649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.256652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.256653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.256664Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.256669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.256674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.256706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.256712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.256714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.256716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.256718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.256764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.256770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.256780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.256791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.256821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.256821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2023
2025-10-02T09:33:37.256823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2023
2025-10-02T09:33:37.256840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922638:5653], now have 1 active actors on pipe
2025-10-02T09:33:37.256847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922527:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.256852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.256857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.256859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.256865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.256869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.256871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.256872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.256875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.256888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.256893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.256905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.256911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.256936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.256945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.256952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.256958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.256963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.256966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.256968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.256974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.256981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.257005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.257095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.257101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.257112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.257151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2024 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0
2025-10-02T09:33:37.257379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5701906a-73578afa-f67875ef-70c183ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.260031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Write session: try to update token
2025-10-02T09:33:37.260043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.265970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.265981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.265982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.265984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.265988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.265993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.265996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364229:3938]
2025-10-02T09:33:37.266019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.266021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.266021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.266023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.266024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.266026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.266238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.271964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId: src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.273928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.337389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770922645:5822]
2025-10-02T09:33:37.337536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2023, pipe: [1:7556555226770922645:5822]
2025-10-02T09:33:37.373543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.373899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.373910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.373924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922645:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.374038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:37.374081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770922645:5822]
2025-10-02T09:33:37.374084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:37.374102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.374135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2024 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0
2025-10-02T09:33:37.374259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2024 sessionId: src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0 is DEAD
2025-10-02T09:33:37.374361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:37.374369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Write session will restart in 0.008516s
2025-10-02T09:33:37.374383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Write session: Do CDS request
2025-10-02T09:33:37.374388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.380526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.382986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.383105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.383113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.383120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.383161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.383191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364345:3933]
2025-10-02T09:33:37.383534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.383705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.383739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.383930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.383970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.383975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.383975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.383976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.383977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.383978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.383979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.383980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.383981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.383982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.383983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.383984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.383988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.383999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.384002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.384005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.384009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.384013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.384017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.384020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.384024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.384028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.384032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.384036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.384041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.384049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.384054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.384060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.384064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.384069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.384074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.384080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.384088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.384094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.384097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.384102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.384106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.384112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.384115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.384120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.384126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.384131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.384135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.384140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.384146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.384151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.384155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.384160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.384196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.384219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.384297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.384305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2025
2025-10-02T09:33:37.384385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.384402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.384408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.384411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.384656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2025 sessionId:  describe result for acl check
2025-10-02T09:33:37.384681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.384686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.384687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.384690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770922721:5642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.385037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770922721:5642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.386418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770922721:5642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.390474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770922721:5642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.390486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770922721:5642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.390491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770922721:5642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.390496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.391654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.393039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.393051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.393053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.393056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.393060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2024 [2:7556555226695364345:3933]
2025-10-02T09:33:37.393070Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.393083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.393085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.393087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.393089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.393101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.393105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.393110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.393151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.393156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.393158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.393160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.393162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.393207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.393212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.393223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.393231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.393242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.393256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922647:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.393262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922756:5642], now have 1 active actors on pipe
2025-10-02T09:33:37.393267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.393269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.393272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.393261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2024
2025-10-02T09:33:37.393278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.393269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2024
2025-10-02T09:33:37.393286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.393288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.393296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.393298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.393300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.393302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.393317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.393324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.393344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.393354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.393364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.393367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.393372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.393375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.393376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.393384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.393391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.393420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.393506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.393511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.393521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.393581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2025 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0
2025-10-02T09:33:37.393806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3bc0111-a56e0725-3de1efad-78e0f44d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.396405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Write session: try to update token
2025-10-02T09:33:37.396420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.402567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.402580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.402582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.402583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.402587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.402590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.402593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364339:3933]
2025-10-02T09:33:37.402615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.402616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.402619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.402619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.402621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.402621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.402750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.408580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId: src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.410842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.474078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770922763:5822]
2025-10-02T09:33:37.474247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2024, pipe: [1:7556555226770922763:5822]
2025-10-02T09:33:37.510260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.510483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.510492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.510506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922763:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.510631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:37.510665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.510684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770922763:5822]
2025-10-02T09:33:37.510700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:37.510764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2025 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0
2025-10-02T09:33:37.510929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2025 sessionId: src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0 is DEAD
2025-10-02T09:33:37.511080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:37.511094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Write session will restart in 0.006468s
2025-10-02T09:33:37.511119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Write session: Do CDS request
2025-10-02T09:33:37.511124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.518171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.518279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.518292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2026
2025-10-02T09:33:37.518419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.518440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.518449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.518452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.518402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.518802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2026 sessionId:  describe result for acl check
2025-10-02T09:33:37.518830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.518836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.518837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.518841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770922837:5638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.519312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770922837:5638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.520620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770922837:5638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.521101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.521213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.521222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.521230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.521270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.521301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364455:3930]
2025-10-02T09:33:37.521648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.521826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.521857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.522050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.522094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.522099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.522100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.522101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.522102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.522103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.522104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.522105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.522106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.522107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.522108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.522109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.522113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.522123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.522127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.522131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.522135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.522139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.522142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.522145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.522148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.522153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.522157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.522160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.522164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.522171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.522176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.522181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.522189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.522194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.522198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.522203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.522210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.522215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.522219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.522224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.522229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.522234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.522239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.522245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.522249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.522253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.522256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.522262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.522266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.522271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.522275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.522279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.522312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.522568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770922837:5638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.522575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770922837:5638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.522577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770922837:5638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.522580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.529883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.531342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.531353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.531354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.531357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.531361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2025 [2:7556555226695364455:3930]
2025-10-02T09:33:37.531371Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.531383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.531386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.531388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.531390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.531403Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.531407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.531412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.531447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.531453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.531455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.531458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.531460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.531568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2025
2025-10-02T09:33:37.531571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2025
2025-10-02T09:33:37.531643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.531649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.531659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.531671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.531689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.531707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922765:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.531713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922876:5638], now have 1 active actors on pipe
2025-10-02T09:33:37.531727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.531733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.531745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.531750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.531752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.531762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.531774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.531774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.531776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.531777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.531791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.531794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.531808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.531817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.531819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.531821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.531828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.531837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.531856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.531866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.531876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.531875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.531969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.531974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.531985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.532035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2026 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0
2025-10-02T09:33:37.532253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e3d273a-1161363c-e0e4190b-a7ccb4f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.535046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Write session: try to update token
2025-10-02T09:33:37.535056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.540952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:37.540964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.540971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.541000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:37.541004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:37.541140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:37.541262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:37.541383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:37.541498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:37.541664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:37.541694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:37.546698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId: src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.548864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.549452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.549465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.549489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.549491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.549493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.549495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.549501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.549503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.549507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364450:3930]
2025-10-02T09:33:37.549528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.549531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.549533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.549540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.549552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.549555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.549665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.610781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770922883:5822]
2025-10-02T09:33:37.610952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2025, pipe: [1:7556555226770922883:5822]
2025-10-02T09:33:37.657488Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.657934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:37.657961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922883:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.658028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:37.658063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770922883:5822]
2025-10-02T09:33:37.658085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.658105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:37.658112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:37.658169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2026 reason: error at write: Disconnected sessionId: src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0
2025-10-02T09:33:37.658295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2026 sessionId: src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0 is DEAD
2025-10-02T09:33:37.658422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:37.658431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Write session will restart in 0.008055s
2025-10-02T09:33:37.658446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Write session: Do CDS request
2025-10-02T09:33:37.658451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.665094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.667200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.667310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.667320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2027
2025-10-02T09:33:37.667418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.667439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.667445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.667448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.667538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.667669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.667677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.667685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.667726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.667749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2027 sessionId:  describe result for acl check
2025-10-02T09:33:37.667757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364566:3926]
2025-10-02T09:33:37.667775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.667779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.667780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.667784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770922957:5634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.668107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.668133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770922957:5634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.668284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.668315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.668505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.668549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.668554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.668555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.668556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.668557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.668558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.668558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.668560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.668560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.668561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.668563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.668564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.668568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.668578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.668582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.668586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.668590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.668594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.668597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.668601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.668605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.668610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.668614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.668618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.668627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.668634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.668639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.668644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.668651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.668656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.668660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.668665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.668671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.668676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.668680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.668685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.668690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.668696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.668700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.668704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.668710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.668715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.668719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.668725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.668730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.668735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.668739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.668744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.668774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.669463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770922957:5634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.673576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770922957:5634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.673585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770922957:5634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.673587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770922957:5634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.673590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.676196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.677771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.677783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.677784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.677787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.677792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2026 [2:7556555226695364566:3926]
2025-10-02T09:33:37.677801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.677813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.677816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.677818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.677819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.677830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.677834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.677839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.677879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.677885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.677886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.677888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.677890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.677936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.677941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.677952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.677962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.677980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.677997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922884:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.678003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770922996:5634], now have 1 active actors on pipe
2025-10-02T09:33:37.678008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.678010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.677998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2026
2025-10-02T09:33:37.678011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.678004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2026
2025-10-02T09:33:37.678018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.678029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.678031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.678031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.678034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.678043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.678046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.678062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.678068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.678088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.678097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.678109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.678109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.678114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.678117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.678118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.678125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.678131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.678154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.678252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.678257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.678267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.678314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2027 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0
2025-10-02T09:33:37.678522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f4657d-35c09805-d5a31973-4bc35e99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.681070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Write session: try to update token
2025-10-02T09:33:37.681081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.687313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.687327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.687328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.687329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.687335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.687340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.687343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364561:3926]
2025-10-02T09:33:37.687368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.687371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.687372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.687374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.687374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.687377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.687487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.692557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId: src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.694711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.758231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770923004:5822]
2025-10-02T09:33:37.758374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2026, pipe: [1:7556555226770923004:5822]
2025-10-02T09:33:37.799067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.799430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.799438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.799467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770923004:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.799592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:37.799596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.799601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770923004:5822]
2025-10-02T09:33:37.799623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:37.799625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:37.799674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2027 reason: error at write: Disconnected sessionId: src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0
2025-10-02T09:33:37.799833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2027 sessionId: src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0 is DEAD
2025-10-02T09:33:37.799984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:37.799997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Write session will restart in 0.006078s
2025-10-02T09:33:37.800022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Write session: Do CDS request
2025-10-02T09:33:37.800027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.807046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.807154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.807200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.807212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2028
2025-10-02T09:33:37.807341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.807366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.807374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.807377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.807653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2028 sessionId:  describe result for acl check
2025-10-02T09:33:37.807676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.807680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.807681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.807684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770923079:5627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.808014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770923079:5627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.809338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770923079:5627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.809557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.809658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.809665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.809672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.809710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.809740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364677:3925]
2025-10-02T09:33:37.810080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.810244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.810274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.810457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.810498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.810502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.810503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.810504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.810505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.810506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.810507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.810508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.810509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.810510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.810511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.810512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.810516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.810525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.810529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.810532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.810536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.810540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.810543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.810547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.810551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.810555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.810558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.810561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.810566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.810573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.810577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.810583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.810587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.810591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.810595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.810601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.810605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.810610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.810617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.810622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.810626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.810630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.810635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.810640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.810644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.810648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.810664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.810669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.810675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.810681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.810685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.810689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.810725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.814497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770923079:5627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.814505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770923079:5627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.814507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770923079:5627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.814510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.818173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.819620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.819632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.819634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.819637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.819641Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2027 [2:7556555226695364677:3925]
2025-10-02T09:33:37.819651Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.819666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.819668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.819671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.819673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.819685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.819690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.819696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.819735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.819742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.819744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.819746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.819748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.819872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2027
2025-10-02T09:33:37.819879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2027
2025-10-02T09:33:37.819950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.819957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.819968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.819981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.820001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.820021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770923118:5627], now have 1 active actors on pipe
2025-10-02T09:33:37.820028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770923005:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.820044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.820051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.820063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.820067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.820069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.820080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.820092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.820096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.820097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.820099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.820111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.820114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.820127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14c254d-c0334a27-89841c2a-bae68db8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.820136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.820139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.820141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.820148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.820159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.820177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.820188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.820195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.820197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.820304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.820311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.820322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.820373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2028 partition: 0 MaxSeqNo: 36 sessionId: src_id|14c254d-c0334a27-89841c2a-bae68db8_0
2025-10-02T09:33:37.820588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ed7dc3-6c653bad-cf79fbbc-33b3810_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14c254d-c0334a27-89841c2a-bae68db8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.823362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Write session: try to update token
2025-10-02T09:33:37.823374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.830081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:37.830094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.830101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.830128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:37.830128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:37.830371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:37.830496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:37.830616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:37.830746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:37.831030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:37.831061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:37.835394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId: src_id|14c254d-c0334a27-89841c2a-bae68db8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.837544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:37.837682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.837690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.837864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:37.837918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:37.838668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.838678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.838680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.838682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.838688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.838691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.838694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364672:3925]
2025-10-02T09:33:37.838715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.838718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.838718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.838720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.838725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.838727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.838840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.899547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555226770923155:5822]
2025-10-02T09:33:37.899660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2027, pipe: [1:7556555226770923155:5822]
2025-10-02T09:33:37.949053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:37.955098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.955118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.955241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.955296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.955351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.955408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.955451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.955459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.955513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.955568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.955628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.955685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.955724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.955729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.955786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.955836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.955890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.955943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.955980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.955985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.956041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.956096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.956154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.956227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.956267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.956272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.956327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.956395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.956452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.956511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.956548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.956553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.956609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.956660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.956714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.956770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.956823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.956829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.956882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.956931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.956988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.957042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.957132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.957137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.957189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.957240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.957290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.957339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.957377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.957382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.957433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.957478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.957529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.957576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.957636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.957642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.957694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:37.957741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:37.957794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:37.957850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:37.957888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:37.957892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:37.957929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770923155:5822], now have 1 active actors on pipe
2025-10-02T09:33:37.958091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555226770923155:5822]
2025-10-02T09:33:37.958097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:37.958100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:37.958117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:37.958118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2028 reason: error at write: Disconnected sessionId: src_id|14c254d-c0334a27-89841c2a-bae68db8_0
2025-10-02T09:33:37.958241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2028 sessionId: src_id|14c254d-c0334a27-89841c2a-bae68db8_0 is DEAD
2025-10-02T09:33:37.958362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:37.958371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Write session will restart in 0.005052s
2025-10-02T09:33:37.958387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Write session: Do CDS request
2025-10-02T09:33:37.958391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:37.958530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:37.964154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.964260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:37.964269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2029
2025-10-02T09:33:37.964356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:37.964377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:37.964385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:37.964388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:37.964673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2029 sessionId:  describe result for acl check
2025-10-02T09:33:37.964697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:37.964703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:37.964704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:37.964708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555226770923235:5605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:37.965042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:37.965265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555226770923235:5605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:37.966512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555226770923235:5605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:37.967264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:37.967366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:37.967373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:37.967380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:37.967417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:37.967444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555226695364838:3894]
2025-10-02T09:33:37.967779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:37.967950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:37.967980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:37.968162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:37.968202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.968206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.968207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.968208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.968209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.968210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.968211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.968211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.968212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.968213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.968214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.968215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.968219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.968229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.968233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.968237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.968240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.968244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.968247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.968250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.968254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.968258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.968262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.968265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.968270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.968277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:37.968284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.968289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:37.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.968298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:37.968302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.968306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:37.968312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.968316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:37.968320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.968325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:37.968328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.968333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:37.968338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.968342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:37.968346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.968351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:37.968355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.968360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.968365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.968370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.968374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.968377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.968406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:37.968534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555226770923235:5605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:37.968543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555226770923235:5605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:37.968546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555226770923235:5605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:37.968550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:37.975762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:37.977200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:37.977211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:37.977212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:37.977215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:37.977219Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2028 [2:7556555226695364838:3894]
2025-10-02T09:33:37.977228Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:37.977241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:37.977243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.977245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.977247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.977258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:37.977262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:37.977268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:37.977307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.977312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.977314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.977316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:37.977318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:37.977361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:37.977367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.977376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:37.977387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:37.977406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:37.977421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770923162:2446], now have 1 active actors on pipe
2025-10-02T09:33:37.977428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555226770923272:5605], now have 1 active actors on pipe
2025-10-02T09:33:37.977433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.977435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.977437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.977425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2028
2025-10-02T09:33:37.977428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2028
2025-10-02T09:33:37.977444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:37.977452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:37.977456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:37.977457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:37.977458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:37.977468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:37.977470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:37.977485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.977491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.977512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.977521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:37.977533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:37.977533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:37.977541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:37.977544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:37.977546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:37.977553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:37.977561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:37.977587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.977690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:37.977695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:37.977704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:37.977757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2029 partition: 0 MaxSeqNo: 36 sessionId: src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0
2025-10-02T09:33:37.977989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c254d-c0334a27-89841c2a-bae68db8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:37.980548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Write session: try to update token
2025-10-02T09:33:37.980558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:37.986827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:37.986841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:37.986843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:37.986844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:37.986851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.986854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.986857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555226695364833:3894]
2025-10-02T09:33:37.986883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:37.986887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:37.986888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:37.986889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:37.986891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:37.986893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:37.987004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:37.993286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId: src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:37.995517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.058283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065890589:5822]
2025-10-02T09:33:38.058446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2028, pipe: [1:7556555231065890589:5822]
2025-10-02T09:33:38.095746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.096242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.096251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.096265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890589:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.096385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.096433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:38.096438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065890589:5822]
2025-10-02T09:33:38.096452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.096504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2029 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0
2025-10-02T09:33:38.096652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2029 sessionId: src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0 is DEAD
2025-10-02T09:33:38.096770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:38.096778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Write session will restart in 0.006542s
2025-10-02T09:33:38.096793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Write session: Do CDS request
2025-10-02T09:33:38.096812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.103215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.104195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.104316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.104327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2030
2025-10-02T09:33:38.104430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.104454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.104462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.104466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.104742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2030 sessionId:  describe result for acl check
2025-10-02T09:33:38.104766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.104770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.104772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.104774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065890666:5598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.105149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065890666:5598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.105636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.105734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.105741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.105749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.105788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.105823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990332250:3887]
2025-10-02T09:33:38.106164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.106321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.106352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.106539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.106579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.106584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.106585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.106586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.106587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.106587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.106588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.106589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.106590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.106591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.106592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.106593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.106597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.106606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.106610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.106613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.106617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.106620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.106624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.106628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.106632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.106636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.106639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.106643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.106648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.106666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.106675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.106680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.106683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.106688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.106695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.106699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.106705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.106710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.106714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.106719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.106724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.106731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.106735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.106740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.106744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.106749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.106755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.106759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.106763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.106768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.106772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.106777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.106791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065890666:5598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.106809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.111644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065890666:5598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.111655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065890666:5598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.111658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065890666:5598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.111663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.114232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.115849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.115860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.115862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.115864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.115868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2029 [2:7556555230990332250:3887]
2025-10-02T09:33:38.115878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.115891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.115894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.115896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.115898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.115909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.115915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.115921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.115961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.115967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.115968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.115971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.115973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.116016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.116022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.116032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.116043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.116061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.116077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890590:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.116083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890705:5598], now have 1 active actors on pipe
2025-10-02T09:33:38.116087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.116089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.116091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.116088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2029
2025-10-02T09:33:38.116093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2029
2025-10-02T09:33:38.116102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.116109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.116111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.116112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.116113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.116125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.116131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.116154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.116160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.116174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.116182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.116191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.116202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.116208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.116212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.116214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.116221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.116228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.116245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.116333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.116338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.116348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.116403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2030 partition: 0 MaxSeqNo: 36 sessionId: src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0
2025-10-02T09:33:38.116595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3878fa-c0cbf06a-f7d393de-972332cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.119129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Write session: try to update token
2025-10-02T09:33:38.119140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.125326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.125338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.125340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.125342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.125347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.125351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.125354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332245:3887]
2025-10-02T09:33:38.125380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.125382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.125384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.125384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.125386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.125388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.125495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.130071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId: src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.132168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.196504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065890713:5822]
2025-10-02T09:33:38.196668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2029, pipe: [1:7556555231065890713:5822]
2025-10-02T09:33:38.233716Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.233934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.233943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.233974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890713:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.234102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.234141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.234158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:38.234161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:38.234183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065890713:5822]
2025-10-02T09:33:38.234209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2030 reason: error at write: Disconnected sessionId: src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0
2025-10-02T09:33:38.234356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2030 sessionId: src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0 is DEAD
2025-10-02T09:33:38.234486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:38.234495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Write session will restart in 0.008653s
2025-10-02T09:33:38.234513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Write session: Do CDS request
2025-10-02T09:33:38.234518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.240934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.243317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.243423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.243430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.243437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.243473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.243504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990332365:3897]
2025-10-02T09:33:38.243847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.244014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.244044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.244203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.244233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.244276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.244280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.244281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.244282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.244283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.244284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.244284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.244285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.244284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.244295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2031
2025-10-02T09:33:38.244286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.244287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.244288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.244289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.244293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.244303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.244307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.244310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.244314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.244317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.244320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.244324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.244327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.244330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.244334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.244338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.244343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.244349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.244354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.244359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.244362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.244366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.244370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.244375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.244379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.244384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.244382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.244388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.244394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.244398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.244402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.244399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.244405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.244408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.244406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.244414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.244418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.244423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.244428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.244433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.244438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.244443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.244449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.244454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.244486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.244667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2031 sessionId:  describe result for acl check
2025-10-02T09:33:38.244695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.244701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.244703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.244706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065890795:5592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.245190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065890795:5592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.246621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065890795:5592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.250795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065890795:5592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.250805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065890795:5592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.250808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065890795:5592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.250813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.251962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.253371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.253383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.253385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.253387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.253391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2030 [2:7556555230990332365:3897]
2025-10-02T09:33:38.253401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.253414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.253416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.253418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.253420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.253433Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.253438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.253443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.253478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.253484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.253486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.253489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.253490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.253536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.253541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.253551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.253562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.253580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.253597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890714:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.253603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890832:5592], now have 1 active actors on pipe
2025-10-02T09:33:38.253593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2030
2025-10-02T09:33:38.253609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.253600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2030
2025-10-02T09:33:38.253610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.253612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.253618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.253623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.253628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.253630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.253631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.253640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.253642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.253657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.253663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.253684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.253693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.253700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.253704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.253709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.253711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.253714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.253721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.253729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.253881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.253987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.253993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.254003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.254057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2031 partition: 0 MaxSeqNo: 36 sessionId: src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0
2025-10-02T09:33:38.254262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bf4edf-39531029-7eec36c0-6a2bca15_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.256795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Write session: try to update token
2025-10-02T09:33:38.256820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.262892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.262904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.262906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.262907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.262913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.262916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.262920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332360:3897]
2025-10-02T09:33:38.262946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.262949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.262951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.262987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.263003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.263008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.263068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.268225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId: src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.270360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.334233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065890839:5822]
2025-10-02T09:33:38.334392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2030, pipe: [1:7556555231065890839:5822]
2025-10-02T09:33:38.371152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.371357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.371367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.371399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890839:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.371523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.371549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:38.371560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:38.371566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.371594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065890839:5822]
2025-10-02T09:33:38.371615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2031 reason: error at write: Disconnected sessionId: src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0
2025-10-02T09:33:38.371775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2031 sessionId: src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0 is DEAD
2025-10-02T09:33:38.371908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:38.371917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Write session will restart in 0.009368s
2025-10-02T09:33:38.371933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Write session: Do CDS request
2025-10-02T09:33:38.371938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.378911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.381210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.381320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.381326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.381334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.381371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.381399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990332482:3883]
2025-10-02T09:33:38.381743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.381907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.381938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.382102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.382126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.382166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.382171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.382172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.382172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.382173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.382174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.382175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.382176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.382177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.382178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.382179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.382197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.382207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2032
2025-10-02T09:33:38.382179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.382184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.382193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.382197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.382201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.382204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.382207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.382211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.382215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.382218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.382222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.382225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.382228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.382235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.382241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.382247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.382252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.382256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.382260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.382264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.382269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.382273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.382277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.382281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.382286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.382284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.382290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.382299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.382302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.382302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.382307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.382311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.382307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.382310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.382316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.382321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.382326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.382330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.382335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.382339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.382343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.382376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.382672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2032 sessionId:  describe result for acl check
2025-10-02T09:33:38.382694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.382699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.382700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.382702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065890923:5574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.383087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065890923:5574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.384363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065890923:5574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.388713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065890923:5574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.388724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065890923:5574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.388726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065890923:5574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.388732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.389861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.391353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.391364Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.391366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.391369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.391373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2031 [2:7556555230990332482:3883]
2025-10-02T09:33:38.391383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.391396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.391398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.391400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.391401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.391412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.391417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.391423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.391457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.391463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.391464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.391467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.391469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.391512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.391517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.391526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.391536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.391551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.391569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890841:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.391575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890958:5574], now have 1 active actors on pipe
2025-10-02T09:33:38.391579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.391581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.391583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.391578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2031
2025-10-02T09:33:38.391579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2031
2025-10-02T09:33:38.391594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.391606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.391606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.391608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.391609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.391621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.391624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.391654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.391660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.391670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.391676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.391683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.391696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de86e06-672a76c7-a9d34532-53d15002_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.391704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.391706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.391708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.391715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.391723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.391741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.391833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.391838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.391847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.391899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2032 partition: 0 MaxSeqNo: 36 sessionId: src_id|de86e06-672a76c7-a9d34532-53d15002_0
2025-10-02T09:33:38.392102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dadc6a2-afdfdb19-5b8a81b3-d819825c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de86e06-672a76c7-a9d34532-53d15002_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.394811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Write session: try to update token
2025-10-02T09:33:38.394828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.400662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.400674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.400676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.400677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.400682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.400684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.400687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332477:3883]
2025-10-02T09:33:38.400709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.400710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.400712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.400714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.400714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.400715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.400843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.407089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId: src_id|de86e06-672a76c7-a9d34532-53d15002_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.409235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.471966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065890965:5822]
2025-10-02T09:33:38.472145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2031, pipe: [1:7556555231065890965:5822]
2025-10-02T09:33:38.509327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.509886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.509896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.509911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890965:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.510038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.510062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065890965:5822]
2025-10-02T09:33:38.510070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.510085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:38.510142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2032 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de86e06-672a76c7-a9d34532-53d15002_0
2025-10-02T09:33:38.510296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2032 sessionId: src_id|de86e06-672a76c7-a9d34532-53d15002_0 is DEAD
2025-10-02T09:33:38.510463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:38.510476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Write session will restart in 0.006392s
2025-10-02T09:33:38.510501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Write session: Do CDS request
2025-10-02T09:33:38.510506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.517342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.518105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.518253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.518266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2033
2025-10-02T09:33:38.518377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.518401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.518409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.518412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.518691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2033 sessionId:  describe result for acl check
2025-10-02T09:33:38.518718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.518722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.518723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.518726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065891046:5580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.519087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065891046:5580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.519802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.519917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.519924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.519932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.519973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.520001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990332599:3878]
2025-10-02T09:33:38.520348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.520509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.520520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065891046:5580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.520539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.520728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.520772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.520776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.520777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.520778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.520778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.520779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.520780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.520781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.520782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.520783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.520784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.520785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.520789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.520798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.520815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.520818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.520822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.520826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.520829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.520833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.520837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.520841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.520844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.520847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.520854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.520861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.520868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.520872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.520876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.520881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.520884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.520890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.520901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.520905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.520909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.520913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.520918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.520923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.520928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.520932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.520937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.520941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.520946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.520951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.520956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.520960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.520965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.520997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.525814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065891046:5580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.525825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065891046:5580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.525827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065891046:5580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.525832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.528394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.529838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.529849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.529851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.529854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.529859Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2032 [2:7556555230990332599:3878]
2025-10-02T09:33:38.530028Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.530044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.530046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.530048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.530049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.530061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.530065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.530071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.530112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.530116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.530118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.530121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.530123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.530167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.530171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.530181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.530192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.530208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.530226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065890967:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.530232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891085:5580], now have 1 active actors on pipe
2025-10-02T09:33:38.530237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.530238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.530240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.530251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.530244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2032
2025-10-02T09:33:38.530248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2032
2025-10-02T09:33:38.530264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.530263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.530265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.530266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.530278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.530281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.530310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.530315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.530325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.530333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.530350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.530353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.530358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.530361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.530362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.530368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.530375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.530389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.530491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.530497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.530507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.530559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2033 partition: 0 MaxSeqNo: 36 sessionId: src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0
2025-10-02T09:33:38.530834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de86e06-672a76c7-a9d34532-53d15002_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.533384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Write session: try to update token
2025-10-02T09:33:38.533398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.539612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.539624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.539626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.539627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.539632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.539635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.539638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332594:3878]
2025-10-02T09:33:38.539662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.539664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.539666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.539667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.539668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.539669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.539788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.545388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId: src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.547650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.610208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065891092:5822]
2025-10-02T09:33:38.610385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2032, pipe: [1:7556555231065891092:5822]
2025-10-02T09:33:38.647914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.648133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.648141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.648156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891092:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.648276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.648322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.648328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065891092:5822]
2025-10-02T09:33:38.648344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:38.648416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2033 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0
2025-10-02T09:33:38.648549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2033 sessionId: src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0 is DEAD
2025-10-02T09:33:38.648703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:38.648716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Write session will restart in 0.007563s
2025-10-02T09:33:38.648740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Write session: Do CDS request
2025-10-02T09:33:38.648745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.655488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.657183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.657219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.657231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2034
2025-10-02T09:33:38.657419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.657439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.657445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.657447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.657783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2034 sessionId:  describe result for acl check
2025-10-02T09:33:38.657806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.657810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.657811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.657814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065891173:5569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.657983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.658086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.658093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.658101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.658139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.658155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065891173:5569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.658170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990332717:3876]
2025-10-02T09:33:38.658515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.658698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.658729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.658914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.658955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.658959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.658960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.658961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.658961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.658962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.658963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.658964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.658965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.658966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.658967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.658968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.658971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.658980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.658984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.658988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.658992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.658996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.658999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.659003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.659007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.659011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.659015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.659018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.659023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.659029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.659034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.659039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.659044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.659049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.659053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.659057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.659063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.659068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.659071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.659079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.659083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.659088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.659092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.659100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.659105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.659109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.659113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.659118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.659125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.659129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.659133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.659138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.659172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.659875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065891173:5569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.664972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065891173:5569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.664986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065891173:5569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.664989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065891173:5569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.664995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.666594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.668062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.668076Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.668078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.668080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.668084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2033 [2:7556555230990332717:3876]
2025-10-02T09:33:38.668094Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.668107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.668109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.668111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.668113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.668125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.668129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.668135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.668174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.668372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.668379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.668382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.668384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.668437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.668442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.668452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.668463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.668483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.668500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891093:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.668506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891211:5569], now have 1 active actors on pipe
2025-10-02T09:33:38.668512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.668513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.668515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.668521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.668514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2033
2025-10-02T09:33:38.668517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2033
2025-10-02T09:33:38.668532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.668535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.668537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.668538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.668547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.668549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.668578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.668584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.668594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.668604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.668611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.668625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.668632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.668636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.668638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.668646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.668656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.668676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.668772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.668777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.668788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.668863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2034 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0
2025-10-02T09:33:38.669104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ef0f89-6647ada7-2fc5e4e-33c07741_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.671812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Write session: try to update token
2025-10-02T09:33:38.671824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.677837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.677851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.677853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.677854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.677859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.677862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.677865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332712:3876]
2025-10-02T09:33:38.677889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.677894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.677896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.677897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.677901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.677906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.678018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.683889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId: src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.686059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.748448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065891220:5822]
2025-10-02T09:33:38.748602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2033, pipe: [1:7556555231065891220:5822]
2025-10-02T09:33:38.788074Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.788310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.788319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.788333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891220:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.788469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.788477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.788508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:38.788515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065891220:5822]
2025-10-02T09:33:38.788566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2034 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0
2025-10-02T09:33:38.788693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2034 sessionId: src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0 is DEAD
2025-10-02T09:33:38.788833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:38.788844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Write session will restart in 0.006249s
2025-10-02T09:33:38.788859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Write session: Do CDS request
2025-10-02T09:33:38.788864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.795745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.796142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.796260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.796271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2035
2025-10-02T09:33:38.796350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.796370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.796376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.796378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.796663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2035 sessionId:  describe result for acl check
2025-10-02T09:33:38.796686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.796690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.796691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.796694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065891302:5568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.797042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065891302:5568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.798294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.798400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.798407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.798415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.798453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.798482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990332835:3858]
2025-10-02T09:33:38.798598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065891302:5568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.798830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.798992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.799022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.799207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.799247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.799251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.799252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.799253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.799254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.799255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.799255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.799256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.799257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.799258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.799259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.799260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.799264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.799273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.799277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.799281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.799285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.799289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.799292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.799295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.799298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.799301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.799304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.799306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.799312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.799318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.799323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.799328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.799332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.799336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.799340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.799345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.799349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.799354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.799357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.799362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.799369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.799374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.799377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.799384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.799388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.799392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.799397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.799401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.799405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.799410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.799414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.799419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.799449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.803313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065891302:5568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.803324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065891302:5568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.803326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065891302:5568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.803332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.806841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.808220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.808233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.808234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.808237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.808241Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2034 [2:7556555230990332835:3858]
2025-10-02T09:33:38.808249Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.808262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.808264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.808266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.808268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.808279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.808282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.808287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.808323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.808329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.808330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.808333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.808335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.808380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.808386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.808395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.808406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.808423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.808440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891341:5568], now have 1 active actors on pipe
2025-10-02T09:33:38.808446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891221:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.808451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.808453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.808454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.808453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2034
2025-10-02T09:33:38.808455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2034
2025-10-02T09:33:38.808464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.808477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.808477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.808479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.808481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.808491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.808493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.808520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.808526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.808536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.808545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.808556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.808564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.808569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.808571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.808573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.808580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.808589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.808605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.808702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.808707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.808717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.808771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2035 partition: 0 MaxSeqNo: 36 sessionId: src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0
2025-10-02T09:33:38.808984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2de3f2-958e7548-981efa1c-1fd16242_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.811697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Write session: try to update token
2025-10-02T09:33:38.811713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.817546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.817557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.817559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.817560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.817567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.817572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.817574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332830:3858]
2025-10-02T09:33:38.817597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.817597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.817600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.817600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.817602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.817602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.817753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.824582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId: src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.826742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:38.888729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555231065891356:5822]
2025-10-02T09:33:38.888937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2034, pipe: [1:7556555231065891356:5822]
2025-10-02T09:33:38.927849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:38.928033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.928042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.928057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891356:5822], now have 1 active actors on pipe
2025-10-02T09:33:38.928150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:38.928176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:38.928176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:38.928179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:38.928210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555231065891356:5822]
2025-10-02T09:33:38.928214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2035 reason: error at write: Disconnected sessionId: src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0
2025-10-02T09:33:38.928342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2035 sessionId: src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0 is DEAD
2025-10-02T09:33:38.928490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:38.928503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Write session will restart in 0.008760s
2025-10-02T09:33:38.928530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Write session: Do CDS request
2025-10-02T09:33:38.928535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:38.935928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:38.938145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.938254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:38.938266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2036
2025-10-02T09:33:38.938337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:38.938385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:38.938403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:38.938409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:38.938412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:38.938470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:38.938477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:38.938485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:38.938526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:38.938557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555230990333003:3839]
2025-10-02T09:33:38.938699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2036 sessionId:  describe result for acl check
2025-10-02T09:33:38.938724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:38.938729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:38.938729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:38.938732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555231065891467:5552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:38.938910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:38.939035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555231065891467:5552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:38.939085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:38.939117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:38.939418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:38.939469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.939473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.939474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.939475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.939476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.939477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.939478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.939479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.939480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.939481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.939482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.939483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.939489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.939498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.939502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.939505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.939509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.939513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.939517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.939520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.939524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.939528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.939531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.939534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.939540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.939546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:38.939550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.939554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:38.939558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.939562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:38.939570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.939574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:38.939578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.939583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:38.939588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.939593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:38.939597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.939602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:38.939606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.939612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:38.939617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.939622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:38.939626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.939632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.939636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.939640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.939646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.939651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.939682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:38.940405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555231065891467:5552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:38.945515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555231065891467:5552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:38.945525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555231065891467:5552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:38.945527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555231065891467:5552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:38.945530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:38.947210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:38.948663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:38.948676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:38.948678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:38.948681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:38.948685Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2035 [2:7556555230990333003:3839]
2025-10-02T09:33:38.948694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:38.948707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:38.948709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.948711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.948713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.948724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:38.948728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:38.948733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:38.948770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.948777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.948779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.948781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:38.948783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:38.948840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:38.948846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.948856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:38.948866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:38.948883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:38.948900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891385:2446], now have 1 active actors on pipe
2025-10-02T09:33:38.948906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555231065891503:5552], now have 1 active actors on pipe
2025-10-02T09:33:38.948911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.948913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.948915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.948905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2035
2025-10-02T09:33:38.948921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2035
2025-10-02T09:33:38.948928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:38.948934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:38.948936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:38.948937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:38.948941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:38.948954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:38.948959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:38.948985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.948991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.949003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.949012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:38.949021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:38.949031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:38.949036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:38.949039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:38.949041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:38.949048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:38.949058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:38.949073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.949153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:38.949158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:38.949168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:38.949225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2036 partition: 0 MaxSeqNo: 36 sessionId: src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0
2025-10-02T09:33:38.949447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90f1008-4bdcb673-b34758d2-aa336d34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:38.952097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Write session: try to update token
2025-10-02T09:33:38.952111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:38.958301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:38.958313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:38.958315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:38.958316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:38.958324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.958327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.958330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555230990332998:3839]
2025-10-02T09:33:38.958354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:38.958356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:38.958357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:38.958358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:38.958360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:38.958361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:38.958473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:38.964527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId: src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:38.966780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.028502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360858819:5822]
2025-10-02T09:33:39.028680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2035, pipe: [1:7556555235360858819:5822]
2025-10-02T09:33:39.067230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.067709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.067718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.067734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360858819:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.067849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.067884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:39.067895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:39.067911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360858819:5822]
2025-10-02T09:33:39.067924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.067948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2036 reason: error at write: Disconnected sessionId: src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0
2025-10-02T09:33:39.068114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2036 sessionId: src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0 is DEAD
2025-10-02T09:33:39.068255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:39.068269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Write session will restart in 0.005145s
2025-10-02T09:33:39.068290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Write session: Do CDS request
2025-10-02T09:33:39.068295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.074120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.074216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.074226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2037
2025-10-02T09:33:39.074338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.074359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.074365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.074367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.074658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2037 sessionId:  describe result for acl check
2025-10-02T09:33:39.074678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.074684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.074685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.074688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360858901:5543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.075093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360858901:5543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.075339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.076567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360858901:5543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.077704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.077806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.077812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.077821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.077859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.077891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285300421:3838]
2025-10-02T09:33:39.078229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.078385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.078415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.078546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360858901:5543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.078555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360858901:5543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.078557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360858901:5543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.078561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.078602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.078645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.078658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.078659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.078659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.078660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.078661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.078662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.078663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.078664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.078665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.078666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.078667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.078671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.078680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.078684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.078688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.078691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.078695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.078699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.078703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.078706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.078710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.078714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.078717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.078722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.078728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.078732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.078738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.078745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.078749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.078753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.078758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.078762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.078771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.078774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.078779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.078783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.078788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.078792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.078799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.078803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.078808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.078812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.078819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.078823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.078828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.078832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.078838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.078871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.086234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.087800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.087812Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.087813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.087816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.087820Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2036 [2:7556555235285300421:3838]
2025-10-02T09:33:39.087829Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.087841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.087843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.087845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.087847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.087858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.087863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.087869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.087907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.087913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.087914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.087917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.087920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.087962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.087968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.087979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.087989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.088008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.088026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360858939:5543], now have 1 active actors on pipe
2025-10-02T09:33:39.088031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360858820:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.088036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.088038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.088040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.088036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2036
2025-10-02T09:33:39.088037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2036
2025-10-02T09:33:39.088050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.088062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.088065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.088068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.088069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.088075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.088077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.088105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.088111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.088119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.088127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.088138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.088149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.088154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.088157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.088158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.088165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.088172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.088188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.088272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.088277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.088287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.088342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2037 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0
2025-10-02T09:33:39.088588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf9081c-b5d1b785-150b8368-f2d3a5c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.091215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Write session: try to update token
2025-10-02T09:33:39.091231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.097331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.097343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.097344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.097345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.097350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.097355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.097358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285300416:3838]
2025-10-02T09:33:39.097381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.097385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.097385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.097387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.097388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.097390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.097499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.103532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId: src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.105817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.168288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360858949:5822]
2025-10-02T09:33:39.168437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2036, pipe: [1:7556555235360858949:5822]
2025-10-02T09:33:39.206540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.206957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.206966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.206982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360858949:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.207127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.207159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:39.207171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360858949:5822]
2025-10-02T09:33:39.207173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:39.207188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.207232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2037 reason: error at write: Disconnected sessionId: src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0
2025-10-02T09:33:39.207384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2037 sessionId: src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0 is DEAD
2025-10-02T09:33:39.207523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:39.207535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Write session will restart in 0.005032s
2025-10-02T09:33:39.207557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Write session: Do CDS request
2025-10-02T09:33:39.207563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.213109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.213265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.213277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2038
2025-10-02T09:33:39.213551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.213574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.213580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.213583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.213875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2038 sessionId:  describe result for acl check
2025-10-02T09:33:39.213904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.213912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.213913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.213917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360859032:5536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.214335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360859032:5536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.214703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.215916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360859032:5536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.217512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.217622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.217629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.217637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.217677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.217707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285300543:3831]
2025-10-02T09:33:39.217800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360859032:5536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.217809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360859032:5536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.217811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360859032:5536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.217814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.218053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.218222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.218253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.218440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.218482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.218486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.218487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.218488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.218489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.218490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.218491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.218492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.218493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.218494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.218495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.218496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.218500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.218509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.218513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.218517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.218521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.218525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.218529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.218532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.218536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.218541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.218544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.218550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.218556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.218563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.218568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.218573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.218579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.218587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.218592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.218596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.218601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.218606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.218611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.218615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.218619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.218626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.218631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.218636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.218640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.218645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.218657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.218662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.218667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.218674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.218678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.218683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.218716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.226096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.227486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.227498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.227500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.227503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.227507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2037 [2:7556555235285300543:3831]
2025-10-02T09:33:39.227517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.227532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.227534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.227536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.227538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.227549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.227554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.227559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.227598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.227604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.227606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.227608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.227610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.227659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.227664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.227675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.227686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.227703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.227721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360858951:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.227727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859068:5536], now have 1 active actors on pipe
2025-10-02T09:33:39.227732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.227733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.227736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.227747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.227744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2037
2025-10-02T09:33:39.227755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2037
2025-10-02T09:33:39.227757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.227759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.227764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.227765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.227771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.227774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.227805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.227812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.227822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.227832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.227844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.227854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.227860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.227862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.227864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.227871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.227880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.227899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.228005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.228010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.228020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.228077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2038 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0
2025-10-02T09:33:39.228488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3d0235-be7beb15-4ded39e6-33e2494f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.231112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Write session: try to update token
2025-10-02T09:33:39.231125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.236879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.236888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.236889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.236890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.236895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.236898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.236900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285300538:3831]
2025-10-02T09:33:39.236925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.236926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.236928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.236929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.236930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.236931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.237048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.243242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId: src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.245517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.307549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360859083:5822]
2025-10-02T09:33:39.307729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2037, pipe: [1:7556555235360859083:5822]
2025-10-02T09:33:39.347180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.347563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.347573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.347588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859083:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.347736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.347755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360859083:5822]
2025-10-02T09:33:39.347773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.347782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:39.347842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2038 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0
2025-10-02T09:33:39.348015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2038 sessionId: src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0 is DEAD
2025-10-02T09:33:39.348350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:39.348366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Write session will restart in 0.005366s
2025-10-02T09:33:39.348390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Write session: Do CDS request
2025-10-02T09:33:39.348396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.354986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.355150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.355246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.355256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2039
2025-10-02T09:33:39.355389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.355415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.355423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.355426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.355708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2039 sessionId:  describe result for acl check
2025-10-02T09:33:39.355733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.355737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.355738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.355742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360859170:5528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.356076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360859170:5528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.357532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.357640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.357647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.357654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.357694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.357704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360859170:5528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.357726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285300668:3823]
2025-10-02T09:33:39.358069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.358235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.358267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.358455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.358495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.358500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.358500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.358501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.358502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.358503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.358504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.358505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.358506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.358506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.358507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.358508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.358513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.358522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.358526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.358530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.358534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.358538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.358541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.358544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.358548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.358551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.358555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.358558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.358564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.358569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.358574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.358579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.358587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.358591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.358595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.358600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.358605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.358612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.358615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.358620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.358625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.358630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.358634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.358639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.358643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.358647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.358660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.358667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.358671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.358676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.358680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.358686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.358719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.362536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360859170:5528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.362547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360859170:5528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.362549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360859170:5528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.362554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.366088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.367619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.367632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.367633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.367636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.367640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2038 [2:7556555235285300668:3823]
2025-10-02T09:33:39.367651Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.367664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.367666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.367668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.367669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.367680Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.367685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.367690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.367730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.367736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.367738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.367740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.367742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.367785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.367791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.367801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.367812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.367831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.367848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859209:5528], now have 1 active actors on pipe
2025-10-02T09:33:39.367854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859085:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.367850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2038
2025-10-02T09:33:39.367851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2038
2025-10-02T09:33:39.367859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.367861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.367863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.367868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.367878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.367883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.367889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.367890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.367891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.367892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.367916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.367922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.367935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.367944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.367951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.367963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|993c5240-615d1d25-21a7e175-23fa33d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.367970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.367973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.367974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.367980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.367989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.368009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.368097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.368102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.368112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.368170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2039 partition: 0 MaxSeqNo: 36 sessionId: src_id|993c5240-615d1d25-21a7e175-23fa33d9_0
2025-10-02T09:33:39.368594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b7f59-96de8e32-a7f53714-30391c63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|993c5240-615d1d25-21a7e175-23fa33d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.371223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Write session: try to update token
2025-10-02T09:33:39.371239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.376890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.376900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.376902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.376903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.376907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.376912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.376915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285300663:3823]
2025-10-02T09:33:39.376939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.376942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.376943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.376945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.376945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.376946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.377062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.383520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId: src_id|993c5240-615d1d25-21a7e175-23fa33d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.385659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.448057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360859216:5822]
2025-10-02T09:33:39.448236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2038, pipe: [1:7556555235360859216:5822]
2025-10-02T09:33:39.485429Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.485815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.485825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.485840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859216:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.485952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.485983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:39.485985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.485994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:39.486012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360859216:5822]
2025-10-02T09:33:39.486046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2039 reason: error at write: Disconnected sessionId: src_id|993c5240-615d1d25-21a7e175-23fa33d9_0
2025-10-02T09:33:39.486212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2039 sessionId: src_id|993c5240-615d1d25-21a7e175-23fa33d9_0 is DEAD
2025-10-02T09:33:39.486403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:39.486419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Write session will restart in 0.008476s
2025-10-02T09:33:39.486441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Write session: Do CDS request
2025-10-02T09:33:39.486446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.493280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.495738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.495845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.495852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.495859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.495897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.495925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285300792:3821]
2025-10-02T09:33:39.496133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.496245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.496255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2040
2025-10-02T09:33:39.496269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.496381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.496405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.496413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.496416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.496448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.496478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.496667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.496674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2040 sessionId:  describe result for acl check
2025-10-02T09:33:39.496697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.496701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.496707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.496711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.496712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.496714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.496702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.496714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.496705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360859305:5525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.496715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.496716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.496717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.496718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.496719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.496720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.496721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.496726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.496736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.496740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.496744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.496747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.496751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.496754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.496758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.496762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.496766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.496769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.496773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.496778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.496786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.496791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.496795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.496799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.496823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.496827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.496832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.496835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.496839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.496843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.496847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.496851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.496859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.496861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.496864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.496866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.496869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.496871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.496875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.496877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.496880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.496882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.496884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.496901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.497067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360859305:5525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.498305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360859305:5525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.502075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360859305:5525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.502082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360859305:5525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.502084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360859305:5525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.502088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.504236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.505776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.505787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.505788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.505790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.505793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2039 [2:7556555235285300792:3821]
2025-10-02T09:33:39.505800Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.505809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.505811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.505812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.505813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.505822Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.505827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.505831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.505862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.505867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.505868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.505869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.505870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.505907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.505912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.505919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.505924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.505932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.505945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859217:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.505951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859342:5525], now have 1 active actors on pipe
2025-10-02T09:33:39.505955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.505960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.505961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.505968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.505978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.505984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.505987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.505988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.505976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2039
2025-10-02T09:33:39.505988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.505990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.505978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2039
2025-10-02T09:33:39.506003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.506008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.506011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.506021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.506025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.506046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e671807a-977d6d52-e92c6038-99d6612f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.506053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.506055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.506056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.506061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.506066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.506078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.506194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.506201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.506210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.506267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2040 partition: 0 MaxSeqNo: 36 sessionId: src_id|e671807a-977d6d52-e92c6038-99d6612f_0
2025-10-02T09:33:39.506508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|993c5240-615d1d25-21a7e175-23fa33d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e671807a-977d6d52-e92c6038-99d6612f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.509084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Write session: try to update token
2025-10-02T09:33:39.509101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.515044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.515057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.515058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.515060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.515065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.515067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.515070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285300787:3821]
2025-10-02T09:33:39.515094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.515097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.515098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.515099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.515101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.515102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.515212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.521195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId: src_id|e671807a-977d6d52-e92c6038-99d6612f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.523323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.586080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360859350:5822]
2025-10-02T09:33:39.586272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2039, pipe: [1:7556555235360859350:5822]
2025-10-02T09:33:39.624078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.624313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.624321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.624337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859350:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.624455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.624515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360859350:5822]
2025-10-02T09:33:39.624527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.624540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:39.624599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2040 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e671807a-977d6d52-e92c6038-99d6612f_0
2025-10-02T09:33:39.624746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2040 sessionId: src_id|e671807a-977d6d52-e92c6038-99d6612f_0 is DEAD
2025-10-02T09:33:39.624870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:39.624879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Write session will restart in 0.009769s
2025-10-02T09:33:39.624895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Write session: Do CDS request
2025-10-02T09:33:39.624899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.632411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.634781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.634917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.634924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.634932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.634973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.635005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285300916:3819]
2025-10-02T09:33:39.635175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.635242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.635253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2041
2025-10-02T09:33:39.635354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.635447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.635468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.635475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.635478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.635536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.635567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.635752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.635758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2041 sessionId:  describe result for acl check
2025-10-02T09:33:39.635783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.635787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.635788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.635791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360859440:5519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.635793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.635798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.635799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.635799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.635800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.635801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.635802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.635803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.635804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.635804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.635805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.635806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.635811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.635821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.635825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.635828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.635832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.635836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.635839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.635843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.635846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.635850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.635854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.635857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.635863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.635869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.635873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.635878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.635886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.635890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.635894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.635899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.635904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.635910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.635914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.635918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.635922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.635927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.635932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.635936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.635940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.635948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.635951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.635956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.635960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.635965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.635970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.635975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.636004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.636123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360859440:5519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.637630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360859440:5519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.641236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360859440:5519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.641247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360859440:5519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.641249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360859440:5519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.641252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.643379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.645011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.645021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.645023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.645026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.645030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2040 [2:7556555235285300916:3819]
2025-10-02T09:33:39.645040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.645051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.645053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.645056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.645057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.645068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.645072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.645078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.645114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.645121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.645123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.645125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.645127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.645171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.645176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.645186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.645197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.645216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.645220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2040
2025-10-02T09:33:39.645234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859351:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.645240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859477:5519], now have 1 active actors on pipe
2025-10-02T09:33:39.645221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2040
2025-10-02T09:33:39.645244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.645246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.645248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.645254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.645259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.645261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.645262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.645266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.645279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.645281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.645297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.645303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.645324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.645333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.645340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.645346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.645351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.645354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.645355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.645362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.645369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.645394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.645494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.645499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.645508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.645560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2041 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0
2025-10-02T09:33:39.645794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e671807a-977d6d52-e92c6038-99d6612f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.648693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Write session: try to update token
2025-10-02T09:33:39.648704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.655846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.655860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.655862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.655867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.655873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.655876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.655879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285300911:3819]
2025-10-02T09:33:39.655904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.655908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.655910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.655914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.655918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.655921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.656022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.662394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId: src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.664540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.724847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360859487:5822]
2025-10-02T09:33:39.725041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2040, pipe: [1:7556555235360859487:5822]
2025-10-02T09:33:39.766937Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.767324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.767333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.767348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859487:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.767467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.767511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360859487:5822]
2025-10-02T09:33:39.767512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.767541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:39.767614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2041 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0
2025-10-02T09:33:39.767780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2041 sessionId: src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0 is DEAD
2025-10-02T09:33:39.767901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:39.767910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Write session will restart in 0.008529s
2025-10-02T09:33:39.767931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Write session: Do CDS request
2025-10-02T09:33:39.767936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.775124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.777134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.777277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.777287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2042
2025-10-02T09:33:39.777367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.777387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.777393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.777396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.777670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2042 sessionId:  describe result for acl check
2025-10-02T09:33:39.777694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.777698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.777699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.777703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360859579:5516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.777715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.777831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.777838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.777846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.777886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.777916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285301043:3818]
2025-10-02T09:33:39.778040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360859579:5516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.778260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.778436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.778467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.778665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.778709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.778713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.778714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.778715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.778716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.778717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.778718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.778719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.778719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.778720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.778721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.778722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.778727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.778736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.778740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.778744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.778748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.778751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.778755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.778759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.778762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.778766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.778770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.778773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.778778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.778789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.778794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.778799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.778806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.778811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.778817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.778822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.778826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.778831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.778838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.778842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.778846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.778851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.778858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.778862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.778866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.778871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.778875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.778880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.778886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.778891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.778895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.778900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.778930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.779439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360859579:5516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.783698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360859579:5516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.783707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360859579:5516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.783709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360859579:5516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.783712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.786363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.787928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.787940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.787942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.787945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.787950Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2041 [2:7556555235285301043:3818]
2025-10-02T09:33:39.787960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.787971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.787974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.787976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.787977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.787988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.787992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.787998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.788038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.788044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.788045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.788048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.788050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.788097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.788102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.788112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.788123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.788141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.788158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859490:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.788164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859618:5516], now have 1 active actors on pipe
2025-10-02T09:33:39.788168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.788157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2041
2025-10-02T09:33:39.788162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2041
2025-10-02T09:33:39.788170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.788172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.788183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.788193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.788198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.788201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.788203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.788208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.788211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.788227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.788233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.788238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.788250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.788255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.788288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7217582-7e12e901-11775422-bf49dd50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.788297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.788300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.788301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.788308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.788314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.788326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.788437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.788443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.788452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.788511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2042 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7217582-7e12e901-11775422-bf49dd50_0
2025-10-02T09:33:39.788724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb589ac7-d5b44b55-428c0a4b-a78d9900_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7217582-7e12e901-11775422-bf49dd50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.791315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Write session: try to update token
2025-10-02T09:33:39.791328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.797647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.797662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.797664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.797666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.797672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.797675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.797678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285301038:3818]
2025-10-02T09:33:39.797706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.797711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.797713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.797714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.797718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.797721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.797826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.803166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId: src_id|b7217582-7e12e901-11775422-bf49dd50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.805279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:39.867667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555235360859633:5822]
2025-10-02T09:33:39.867814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2041, pipe: [1:7556555235360859633:5822]
2025-10-02T09:33:39.910110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:39.910475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.910484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.910500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859633:5822], now have 1 active actors on pipe
2025-10-02T09:33:39.910643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:39.910639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:39.910646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555235360859633:5822]
2025-10-02T09:33:39.910670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:39.910671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:39.910714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2042 reason: error at write: Disconnected sessionId: src_id|b7217582-7e12e901-11775422-bf49dd50_0
2025-10-02T09:33:39.910844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2042 sessionId: src_id|b7217582-7e12e901-11775422-bf49dd50_0 is DEAD
2025-10-02T09:33:39.910971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:39.910979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Write session will restart in 0.006186s
2025-10-02T09:33:39.910993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Write session: Do CDS request
2025-10-02T09:33:39.910997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:39.918114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.918199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:39.918212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2043
2025-10-02T09:33:39.918302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:39.918325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:39.918333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:39.918336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:39.918563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:39.918639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2043 sessionId:  describe result for acl check
2025-10-02T09:33:39.918685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:39.918691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:39.918692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:39.918697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555235360859723:5503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:39.919052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555235360859723:5503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:39.920201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555235360859723:5503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:39.920951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:39.921081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:39.921088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:39.921096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:39.921137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:39.921170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555235285301181:3815]
2025-10-02T09:33:39.921509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:39.921709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:39.921741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:39.921772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555235360859723:5503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:39.921780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555235360859723:5503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:39.921782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555235360859723:5503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:39.921785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:39.921937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:39.921980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.921984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.921986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.921986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.921987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.921988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.921989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.921990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.921991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.921992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.921992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.921993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.921998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.922006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.922010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.922014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.922018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.922022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.922025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.922028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.922031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.922035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.922039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.922043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.922047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.922054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:39.922060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.922065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:39.922071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.922076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:39.922081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.922087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:39.922092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.922096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:39.922101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.922106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:39.922110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.922116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:39.922123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.922127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:39.922131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.922135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:39.922139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.922145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.922149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.922153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.922160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.922164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.922196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:39.929644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:39.931198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:39.931211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:39.931212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:39.931215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:39.931219Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2042 [2:7556555235285301181:3815]
2025-10-02T09:33:39.931228Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:39.931239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:39.931242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.931244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.931246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.931257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:39.931261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:39.931267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:39.931301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.931307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.931308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.931311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:39.931313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:39.931355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:39.931361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.931371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:39.931382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:39.931399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:39.931417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859762:5503], now have 1 active actors on pipe
2025-10-02T09:33:39.931423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555235360859634:2446], now have 1 active actors on pipe
2025-10-02T09:33:39.931428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.931430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.931432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.931443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:39.931436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2042
2025-10-02T09:33:39.931455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2042
2025-10-02T09:33:39.931454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:39.931455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:39.931459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:39.931460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:39.931467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:39.931469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:39.931495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.931502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.931514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.931523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:39.931541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:39.931542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:39.931547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:39.931550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:39.931552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:39.931559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:39.931565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:39.931585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.931660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:39.931665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:39.931675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:39.931730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2043 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0
2025-10-02T09:33:39.931937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7217582-7e12e901-11775422-bf49dd50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:39.934451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Write session: try to update token
2025-10-02T09:33:39.934461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:39.940919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:39.940932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:39.940934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:39.940935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:39.940941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.940944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.940946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555235285301176:3815]
2025-10-02T09:33:39.940975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:39.940979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:39.940981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:39.940999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:39.941014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:39.941018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:39.941102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:39.945792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId: src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:39.948019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.011030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827102:5822]
2025-10-02T09:33:40.011219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2042, pipe: [1:7556555239655827102:5822]
2025-10-02T09:33:40.051257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.051658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.051668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.051699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827102:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.051844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:40.051879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.051887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:40.051890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:40.051935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2043 reason: error at write: Disconnected sessionId: src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0
2025-10-02T09:33:40.052057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2043 sessionId: src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0 is DEAD
2025-10-02T09:33:40.052172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:40.052181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Write session will restart in 0.006151s
2025-10-02T09:33:40.052174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827102:5822]
2025-10-02T09:33:40.052196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Write session: Do CDS request
2025-10-02T09:33:40.052201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.059118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.059194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.059205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2044
2025-10-02T09:33:40.059291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.059317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.059324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.059328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.059698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2044 sessionId:  describe result for acl check
2025-10-02T09:33:40.059726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.059732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.059734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.059738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655827193:5483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.059891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.060184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655827193:5483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.061724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655827193:5483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.062548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.062661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.062668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.062675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.062716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.062751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580268643:3776]
2025-10-02T09:33:40.063091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.063260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.063292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.063492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.063536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.063541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.063542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.063543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.063544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.063545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.063545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.063546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.063547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.063548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.063549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.063550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.063554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.063563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.063567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.063571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.063575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.063579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.063582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.063586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.063588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.063592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.063596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.063599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.063605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.063612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.063618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.063622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.063625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.063630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.063634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.063639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.063644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.063649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.063653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.063661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.063666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.063671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.063677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.063682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.063686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.063691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.063695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.063691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655827193:5483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.063701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.063700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655827193:5483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.063705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.063702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655827193:5483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.063705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.063709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.063716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.063721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.063752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.071150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.072711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.072725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.072727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.072729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.072733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2043 [2:7556555239580268643:3776]
2025-10-02T09:33:40.072745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.072757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.072760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.072762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.072763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.072775Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.072779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.072784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.072837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.072842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.072844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.072847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.072849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.072900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.072906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.072916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.072925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.072944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.072962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827104:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.072969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827230:5483], now have 1 active actors on pipe
2025-10-02T09:33:40.072974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.072976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.072977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.072988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.072981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2043
2025-10-02T09:33:40.072982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2043
2025-10-02T09:33:40.072999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.073001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.073007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.073008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.073013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.073016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.073033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.073039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.073039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.073052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.073057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.073092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.073101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.073104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.073106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.073113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.073120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.073134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.073226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.073231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.073241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.073298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2044 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0
2025-10-02T09:33:40.073516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2c9015-5afce79e-41a8db83-f4c8ac63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.076309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Write session: try to update token
2025-10-02T09:33:40.076321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.083511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.083526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.083528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.083530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.083535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.083538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.083544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580268638:3776]
2025-10-02T09:33:40.083569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.083569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.083572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.083574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.083574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.083576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.083707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.089640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId: src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.091804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.152357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827240:5822]
2025-10-02T09:33:40.152500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2043, pipe: [1:7556555239655827240:5822]
2025-10-02T09:33:40.192274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.192663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.192672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.192687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827240:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.192816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:40.192858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827240:5822]
2025-10-02T09:33:40.192871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.192882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:40.192933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2044 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0
2025-10-02T09:33:40.193066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2044 sessionId: src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0 is DEAD
2025-10-02T09:33:40.193182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:40.193191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Write session will restart in 0.009712s
2025-10-02T09:33:40.193206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Write session: Do CDS request
2025-10-02T09:33:40.193211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.200476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.202846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.202954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.202961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.202968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.203006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.203036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580268772:3774]
2025-10-02T09:33:40.203386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.203544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.203575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.203762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.203804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.203809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.203810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.203811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.203812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.203812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.203813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.203814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.203815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.203816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.203817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.203818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.203822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.203833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.203836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.203839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.203843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.203847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.203850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.203853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.203856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.203860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.203864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.203867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.203873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.203879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.203884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.203889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.203895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.203900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.203904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.203909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.203914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.203919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.203923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.203927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.203931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.203936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.203944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.203948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.203952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.203957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.203962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.203966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.203971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.203975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.203979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.203984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.204016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.204151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.204201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.204211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2045
2025-10-02T09:33:40.204294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.204320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.204327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.204331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.204672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2045 sessionId:  describe result for acl check
2025-10-02T09:33:40.204696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.204702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.204703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.204709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655827338:5477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.205202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655827338:5477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.206516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655827338:5477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.210415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655827338:5477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.210424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655827338:5477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.210426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655827338:5477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.210429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.211658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.213070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.213082Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.213084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.213086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.213091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2044 [2:7556555239580268772:3774]
2025-10-02T09:33:40.213101Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.213114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.213116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.213119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.213120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.213131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.213137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.213142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.213184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.213190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.213192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.213194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.213196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.213309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2044
2025-10-02T09:33:40.213309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2044
2025-10-02T09:33:40.213385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.213392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.213401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.213412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.213429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.213448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827372:5477], now have 1 active actors on pipe
2025-10-02T09:33:40.213454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827242:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.213468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.213474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.213489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.213494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.213496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.213506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.213516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.213518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.213524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.213526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.213531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.213533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.213545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.213551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.213554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.213556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.213563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.213572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.213595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.213603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.213607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.213611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.213692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.213698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.213708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.213755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2045 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0
2025-10-02T09:33:40.213964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b377-c3115b9b-3c819b5f-869ef3d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.216645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Write session: try to update token
2025-10-02T09:33:40.216655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.223353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:40.223370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.223377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.223407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:40.223408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:40.223550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:40.223675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:40.223796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:40.223919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:40.224082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:40.224115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:40.229210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId: src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.231571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.232187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.232205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.232221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.232223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.232225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.232226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.232234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.232237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.232240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580268767:3774]
2025-10-02T09:33:40.232271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.232274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.232278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.232279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.232281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.232285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.232395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.293147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827381:5822]
2025-10-02T09:33:40.293304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2044, pipe: [1:7556555239655827381:5822]
2025-10-02T09:33:40.343066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.343445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:40.343470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827381:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.343529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:40.343656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827381:5822]
2025-10-02T09:33:40.343683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.351331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:40.351342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:40.351360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2045 reason: error at write: Disconnected sessionId: src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0
2025-10-02T09:33:40.351464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2045 sessionId: src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0 is DEAD
2025-10-02T09:33:40.351577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:40.351586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Write session will restart in 0.009436s
2025-10-02T09:33:40.351601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Write session: Do CDS request
2025-10-02T09:33:40.351608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.354157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.356932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.357129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.357138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.357146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.357191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.357223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580268905:3754]
2025-10-02T09:33:40.357573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.357744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.357774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.357965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.358008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.358012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.358013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.358014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.358015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.358016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.358017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.358018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.358018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.358019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.358020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.358021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.358025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.358034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.358038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.358042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.358046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.358049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.358053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.358057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.358060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.358063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.358067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.358071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.358076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.358082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.358088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.358094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.358098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.358102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.358110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.358114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.358118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.358123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.358130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.358135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.358139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.358143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.358148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.358153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.358157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.358161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.358165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.358169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.358172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.358177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.358181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.358186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.358215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.362090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.362164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.362176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2046
2025-10-02T09:33:40.362266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.362290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.362298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.362301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.362565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2046 sessionId:  describe result for acl check
2025-10-02T09:33:40.362588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.362592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.362593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.362596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655827480:5473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.362941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655827480:5473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.364503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655827480:5473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.365693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.366748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655827480:5473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.366756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655827480:5473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.366759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655827480:5473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.366763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.367317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.367330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.367331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.367334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.367338Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2045 [2:7556555239580268905:3754]
2025-10-02T09:33:40.367418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.367434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.367436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.367438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.367439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.367451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.367455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.367460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.367498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.367504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.367505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.367508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.367510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.367555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.367561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.367570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.367581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.367599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.367616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827382:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.367623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827514:5473], now have 1 active actors on pipe
2025-10-02T09:33:40.367627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.367629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.367614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2045
2025-10-02T09:33:40.367631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.367614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2045
2025-10-02T09:33:40.367637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.367645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.367649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.367650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.367650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.367662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.367666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.367681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.367687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.367709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.367719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.367726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.367731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.367736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.367738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.367740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.367747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.367753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.367780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.367866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.367871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.367881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.367929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2046 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0
2025-10-02T09:33:40.368099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd323b12-eda8c43a-db69d233-1f07cb91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.370662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Write session: try to update token
2025-10-02T09:33:40.370673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.377163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.377179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.377180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.377181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.377186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.377189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.377192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580268899:3754]
2025-10-02T09:33:40.377214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.377217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.377219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.377220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.377220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.377222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.377328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.382502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId: src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.384841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.443834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827521:5822]
2025-10-02T09:33:40.444011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2045, pipe: [1:7556555239655827521:5822]
2025-10-02T09:33:40.486941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.487175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.487186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.487199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827521:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.487359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:40.487346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.487429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827521:5822]
2025-10-02T09:33:40.487452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:40.487501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2046 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0
2025-10-02T09:33:40.487631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2046 sessionId: src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0 is DEAD
2025-10-02T09:33:40.487756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:40.487761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Write session will restart in 0.007624s
2025-10-02T09:33:40.487776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Write session: Do CDS request
2025-10-02T09:33:40.487780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.495143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.496201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.496247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.496258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2047
2025-10-02T09:33:40.496343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.496364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.496370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.496373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.496681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2047 sessionId:  describe result for acl check
2025-10-02T09:33:40.496707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.496712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.496712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.496716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655827615:5464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.497090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655827615:5464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.497677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.497800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.497808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.497816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.497854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.497884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580269035:3765]
2025-10-02T09:33:40.498247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.498299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655827615:5464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.498420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.498455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.498657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.498701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.498705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.498706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.498707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.498708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.498709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.498709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.498710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.498711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.498712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.498713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.498714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.498718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.498728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.498731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.498735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.498738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.498742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.498746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.498750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.498753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.498757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.498761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.498765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.498770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.498777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.498781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.498787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.498791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.498798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.498805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.498811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.498815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.498820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.498826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.498831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.498835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.498841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.498845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.498850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.498858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.498864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.498868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.498873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.498878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.498883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.498887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.498892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.498924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.502834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655827615:5464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.502842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655827615:5464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.502844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655827615:5464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.502847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.506444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.507974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.507987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.507988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.507991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.507995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2046 [2:7556555239580269035:3765]
2025-10-02T09:33:40.508006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.508018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.508020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.508022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.508024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.508035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.508040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.508045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.508078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.508085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.508087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.508089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.508091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.508134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.508139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.508150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.508160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.508178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.508195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827654:5464], now have 1 active actors on pipe
2025-10-02T09:33:40.508201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827522:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.508206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.508208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.508210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.508220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.508213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2046
2025-10-02T09:33:40.508216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2046
2025-10-02T09:33:40.508232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.508233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.508239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.508240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.508245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.508247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.508276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.508282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.508291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.508301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.508308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.508322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cde0617f-20182499-a211f9e3-fff78837_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.508330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.508333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.508334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.508340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.508348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.508365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.508454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.508459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.508469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.508524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2047 partition: 0 MaxSeqNo: 36 sessionId: src_id|cde0617f-20182499-a211f9e3-fff78837_0
2025-10-02T09:33:40.508728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7badec7-a5e74987-e6610f1f-e00a73ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cde0617f-20182499-a211f9e3-fff78837_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.511295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Write session: try to update token
2025-10-02T09:33:40.511308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.517701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.517717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.517719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.517720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.517725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.517727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.517731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580269030:3765]
2025-10-02T09:33:40.517755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.517757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.517762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.517762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.517763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.517765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.517883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.523131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId: src_id|cde0617f-20182499-a211f9e3-fff78837_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.525273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.587558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827662:5822]
2025-10-02T09:33:40.587781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2046, pipe: [1:7556555239655827662:5822]
2025-10-02T09:33:40.633725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.633955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.633967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.633981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827662:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.634127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:40.634156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827662:5822]
2025-10-02T09:33:40.634159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:40.634162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:40.634180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.634210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2047 reason: error at write: Disconnected sessionId: src_id|cde0617f-20182499-a211f9e3-fff78837_0
2025-10-02T09:33:40.634338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2047 sessionId: src_id|cde0617f-20182499-a211f9e3-fff78837_0 is DEAD
2025-10-02T09:33:40.634498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:40.634512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Write session will restart in 0.007858s
2025-10-02T09:33:40.634534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Write session: Do CDS request
2025-10-02T09:33:40.634540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.643212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.643235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.643246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2048
2025-10-02T09:33:40.643455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.643477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.643484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.643487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.643755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2048 sessionId:  describe result for acl check
2025-10-02T09:33:40.643774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.643779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.643780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.643783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655827756:5460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.644124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655827756:5460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.644505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.644816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.644907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.644914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.644920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.644944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.644970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580269166:3764]
2025-10-02T09:33:40.645310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.645468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.645491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.645661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.645689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.645693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.645694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.645694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.645695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.645695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.645695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.645696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.645696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.645697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.645697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.645698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.645701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.645706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.645709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.645711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.645713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.645715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.645717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.645719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.645721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.645723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.645725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.645727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.645730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.645734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.645738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.645741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.645745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.645748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.645749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.645752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.645754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.645757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.645759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.645762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.645764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.645766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.645769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.645771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.645775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.645778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.645780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.645783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.645785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.645788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.645791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.645794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.645788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655827756:5460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.645812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.650608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655827756:5460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.650616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655827756:5460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.650618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655827756:5460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.650622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.653341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.654955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.654965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.654966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.654968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.654972Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2047 [2:7556555239580269166:3764]
2025-10-02T09:33:40.654979Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.654989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.654994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.654995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.654996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.655006Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.655009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.655012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.655044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.655049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.655050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.655052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.655054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.655090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.655095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.655102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.655107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.655119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.655135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827663:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.655140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827796:5460], now have 1 active actors on pipe
2025-10-02T09:33:40.655144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.655146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.655148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.655155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.655164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.655171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.655173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.655174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.655175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.655177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.655164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2047
2025-10-02T09:33:40.655192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.655197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.655198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.655191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2047
2025-10-02T09:33:40.655212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.655217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.655235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.655242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.655244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.655245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.655250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.655255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.655270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.655353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.655358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.655366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.655427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2048 partition: 0 MaxSeqNo: 36 sessionId: src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0
2025-10-02T09:33:40.655672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde0617f-20182499-a211f9e3-fff78837_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.658420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Write session: try to update token
2025-10-02T09:33:40.658436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.664308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.664322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.664323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.664324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.664328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.664330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.664332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580269161:3764]
2025-10-02T09:33:40.664351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.664355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.664356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.664357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.664361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.664363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.664471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.670698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId: src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.673033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.734487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827804:5822]
2025-10-02T09:33:40.734697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2047, pipe: [1:7556555239655827804:5822]
2025-10-02T09:33:40.774992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.775357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.775368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.775383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827804:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.775527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:40.775527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827804:5822]
2025-10-02T09:33:40.775547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:40.775549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.775550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:40.775598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2048 reason: error at write: Disconnected sessionId: src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0
2025-10-02T09:33:40.775749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2048 sessionId: src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0 is DEAD
2025-10-02T09:33:40.775892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:40.775904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Write session will restart in 0.009419s
2025-10-02T09:33:40.775942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Write session: Do CDS request
2025-10-02T09:33:40.775947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.783507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.786101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.786215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.786223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.786231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.786263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.786262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.786286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580269299:3762]
2025-10-02T09:33:40.786321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.786333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2049
2025-10-02T09:33:40.786517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.786536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.786542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.786545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.786628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.786814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.786818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2049 sessionId:  describe result for acl check
2025-10-02T09:33:40.786837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.786836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.786841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.786844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.786847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655827902:5453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.787009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.787041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.787044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.787045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.787045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.787046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.787046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.787047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.787047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.787048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.787048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.787049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.787050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.787052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.787058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.787060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.787062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.787064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.787066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.787068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.787070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.787072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.787074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.787076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.787078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.787082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.787086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.787090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.787093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.787096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.787099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.787101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.787103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.787106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.787108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.787110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.787113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.787115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.787117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.787120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.787122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.787124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.787127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.787129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.787134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.787136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.787138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.787141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.787143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.787161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.787184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655827902:5453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.788680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655827902:5453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.792543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655827902:5453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.792552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655827902:5453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.792554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655827902:5453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.792557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.794730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.796353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.796363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.796365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.796367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.796370Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2048 [2:7556555239580269299:3762]
2025-10-02T09:33:40.796378Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.796388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.796393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.796395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.796396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.796405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.796409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.796413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.796450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.796454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.796455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.796457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.796458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.796495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.796500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.796506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.796514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.796522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.796536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827805:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.796541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827938:5453], now have 1 active actors on pipe
2025-10-02T09:33:40.796545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.796546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.796547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.796556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.796566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.796572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.796575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.796576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.796577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.796578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.796570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2048
2025-10-02T09:33:40.796575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2048
2025-10-02T09:33:40.796593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.796598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.796601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.796610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.796615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.796637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd3c1947-3280c189-9750e69f-e01e568d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.796643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.796645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.796646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.796651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.796657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.796666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.796772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.796776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.796784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.796837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2049 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd3c1947-3280c189-9750e69f-e01e568d_0
2025-10-02T09:33:40.797054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41230f2-a2d3a650-906b49a-8c32f1b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd3c1947-3280c189-9750e69f-e01e568d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.799679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Write session: try to update token
2025-10-02T09:33:40.799692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.805687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.805699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.805700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.805701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.805705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.805708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.805709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580269294:3762]
2025-10-02T09:33:40.805728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.805733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.805734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.805737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.805740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.805743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.805859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.811782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId: src_id|fd3c1947-3280c189-9750e69f-e01e568d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.814097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:40.875809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555239655827952:5822]
2025-10-02T09:33:40.875998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2048, pipe: [1:7556555239655827952:5822]
2025-10-02T09:33:40.915853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:40.916279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.916292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.916307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827952:5822], now have 1 active actors on pipe
2025-10-02T09:33:40.916459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:40.916476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:40.916477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:40.916480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:40.916519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555239655827952:5822]
2025-10-02T09:33:40.916529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2049 reason: error at write: Disconnected sessionId: src_id|fd3c1947-3280c189-9750e69f-e01e568d_0
2025-10-02T09:33:40.916683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2049 sessionId: src_id|fd3c1947-3280c189-9750e69f-e01e568d_0 is DEAD
2025-10-02T09:33:40.916880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:40.916899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Write session will restart in 0.006047s
2025-10-02T09:33:40.916922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Write session: Do CDS request
2025-10-02T09:33:40.916928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:40.924272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.924349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:40.924360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2050
2025-10-02T09:33:40.924509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:40.924530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:40.924535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:40.924538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:40.924672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:40.924842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2050 sessionId:  describe result for acl check
2025-10-02T09:33:40.924868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:40.924872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:40.924873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:40.924876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555239655828052:5445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:40.925244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555239655828052:5445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:40.926864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555239655828052:5445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:40.927291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:40.927390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:40.927396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:40.927401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:40.927428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:40.927453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555239580269445:3759]
2025-10-02T09:33:40.927802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:40.927966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:40.927990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:40.928165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:40.928194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.928198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.928199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.928199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.928200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.928201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.928201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.928202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.928202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.928203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.928203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.928204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.928206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.928212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.928214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.928216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.928218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.928220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.928221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.928223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.928225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.928228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.928230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.928232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.928235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.928239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:40.928242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.928245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:40.928247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.928250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:40.928252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.928256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:40.928259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.928261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:40.928263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.928266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:40.928269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.928273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:40.928275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.928277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:40.928280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.928282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:40.928284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.928286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.928290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.928292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.928294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.928297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.928314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:40.928382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555239655828052:5445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:40.928389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555239655828052:5445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:40.928391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555239655828052:5445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:40.928395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:40.935754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:40.937307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:40.937318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:40.937319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:40.937322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:40.937326Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2049 [2:7556555239580269445:3759]
2025-10-02T09:33:40.937332Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:40.937344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:40.937347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.937349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.937350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.937359Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:40.937365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:40.937370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:40.937400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.937405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.937406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.937408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:40.937409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:40.937447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:40.937452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.937458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:40.937463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:40.937471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:40.937483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.937488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.937489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.937494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:40.937500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:40.937501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655828090:5445], now have 1 active actors on pipe
2025-10-02T09:33:40.937504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555239655827953:2446], now have 1 active actors on pipe
2025-10-02T09:33:40.937508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:40.937509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:40.937510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:40.937517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:40.937520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:40.937533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.937541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:40.937548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2049
2025-10-02T09:33:40.937557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:40.937550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2049
2025-10-02T09:33:40.937621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.937627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.937644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7161c159-7302c63f-20d4a304-45974fa9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:40.937651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:40.937653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:40.937654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:40.937660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:40.937667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:40.937677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.937766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:40.937770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:40.937778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:40.937836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2050 partition: 0 MaxSeqNo: 36 sessionId: src_id|7161c159-7302c63f-20d4a304-45974fa9_0
2025-10-02T09:33:40.938123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd3c1947-3280c189-9750e69f-e01e568d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7161c159-7302c63f-20d4a304-45974fa9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:40.940731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Write session: try to update token
2025-10-02T09:33:40.940746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:40.946475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:40.946488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.946492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.946511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:40.946513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:40.946644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:40.946759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:40.946866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:40.946970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:40.947111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:40.947133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:40.953506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId: src_id|7161c159-7302c63f-20d4a304-45974fa9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:40.954975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:40.954989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:40.954990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:40.954991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:40.954995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.954999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.955001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555239580269439:3759]
2025-10-02T09:33:40.955020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:40.955021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:40.955023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:40.955025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:40.955139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:40.955209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:40.955219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:40.955833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.016598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950795429:5822]
2025-10-02T09:33:41.016764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2049, pipe: [1:7556555243950795429:5822]
2025-10-02T09:33:41.076170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.076369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.076379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.076396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795429:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.076565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:41.076576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:41.076592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950795429:5822]
2025-10-02T09:33:41.076590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.076608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.076618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2050 reason: error at write: Disconnected sessionId: src_id|7161c159-7302c63f-20d4a304-45974fa9_0
2025-10-02T09:33:41.076747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2050 sessionId: src_id|7161c159-7302c63f-20d4a304-45974fa9_0 is DEAD
2025-10-02T09:33:41.076887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:41.076897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Write session will restart in 0.009151s
2025-10-02T09:33:41.076914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Write session: Do CDS request
2025-10-02T09:33:41.076918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.084524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.087085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.087192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.087213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.087220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.087227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.087255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.087279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875236912:3737]
2025-10-02T09:33:41.087280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.087291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2051
2025-10-02T09:33:41.087414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.087433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.087439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.087442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.087623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.087700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2051 sessionId:  describe result for acl check
2025-10-02T09:33:41.087734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.087739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.087741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.087745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950795529:5426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.087803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.087834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.088008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.088036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.088040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.088040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.088041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.088042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.088042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.088043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.088043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.088044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.088044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.088045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.088045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.088048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.088054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.088056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.088058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.088060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.088062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.088064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.088066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.088068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.088070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.088072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.088074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.088078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.088081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.088084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.088087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.088089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.088092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.088094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.088096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.088099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.088101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.088103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.088106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.088108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.088111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.088113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.088115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.088117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.088120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.088122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.088126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.088129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.088132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.088134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.088137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.088155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.088092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950795529:5426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.089666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950795529:5426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.093429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950795529:5426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.093438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950795529:5426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.093440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950795529:5426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.093443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.095621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.097144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.097154Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.097155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.097157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.097160Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2050 [2:7556555243875236912:3737]
2025-10-02T09:33:41.097168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.097178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.097181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.097182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.097183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.097192Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.097197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.097202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.097229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.097233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.097234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.097236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.097238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.097273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.097278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.097284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.097289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.097299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.097312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795567:5426], now have 1 active actors on pipe
2025-10-02T09:33:41.097317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795431:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.097321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.097323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.097324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.097330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.097340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.097347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.097349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.097350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.097350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2050
2025-10-02T09:33:41.097355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.097353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2050
2025-10-02T09:33:41.097356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.097362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.097364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.097366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.097380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.097385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.097404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.097410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.097413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.097414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.097419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.097426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.097437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.097520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.097525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.097532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.097591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2051 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0
2025-10-02T09:33:41.097835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161c159-7302c63f-20d4a304-45974fa9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.100532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Write session: try to update token
2025-10-02T09:33:41.100545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.106569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.106583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.106584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.106585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.106590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.106592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.106594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875236907:3737]
2025-10-02T09:33:41.106613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.106616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.106618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.106621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.106631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.106633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.106733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.112577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId: src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.114953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.176865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950795574:5822]
2025-10-02T09:33:41.177044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2050, pipe: [1:7556555243950795574:5822]
2025-10-02T09:33:41.215846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.216230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.216241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.216257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795574:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.216400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.216481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950795574:5822]
2025-10-02T09:33:41.216504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.216519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:41.216529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:41.216590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2051 reason: error at write: Disconnected sessionId: src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0
2025-10-02T09:33:41.216758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2051 sessionId: src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0 is DEAD
2025-10-02T09:33:41.216887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:41.216897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Write session will restart in 0.007249s
2025-10-02T09:33:41.216912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Write session: Do CDS request
2025-10-02T09:33:41.216918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.225250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.225296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.225304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2052
2025-10-02T09:33:41.225391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.225457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.225483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.225491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.225494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.225838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2052 sessionId:  describe result for acl check
2025-10-02T09:33:41.225872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.225877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.225878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.225882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950795674:5418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.226331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950795674:5418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.227995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.228039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950795674:5418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.228089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.228095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.228100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.228126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.228149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875237048:3731]
2025-10-02T09:33:41.228487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.228661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.228684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.228863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.228892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.228897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.228897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.228898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.228898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.228899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.228899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.228900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.228900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.228900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.228901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.228901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.228904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.228909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.228911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.228913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.228915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.228918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.228919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.228921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.228923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.228926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.228927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.228929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.228933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.228936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.228940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.228942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.228944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.228947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.228949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.228951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.228954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.228956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.228958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.228961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.228963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.228968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.228970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.228972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.228974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.228977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.228979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.228984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.228986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.228989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.228991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.228994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.229012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.232837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950795674:5418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.232846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950795674:5418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.232848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950795674:5418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.232851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.236445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.237853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.237866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.237867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.237869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.237872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2051 [2:7556555243875237048:3731]
2025-10-02T09:33:41.237881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.237891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.237893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.237894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.237896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.237904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.237911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.237914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.237946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.237951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.237952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.237954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.237955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.237993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.237998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.238004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.238009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.238019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.238032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795576:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.238037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795712:5418], now have 1 active actors on pipe
2025-10-02T09:33:41.238040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.238042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.238043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.238050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.238058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.238065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.238067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.238068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.238068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.238070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.238084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.238089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.238081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2051
2025-10-02T09:33:41.238083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2051
2025-10-02T09:33:41.238105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.238119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.238124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.238137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.238144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.238146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.238147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.238154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.238162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.238170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.238254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.238259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.238266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.238333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2052 partition: 0 MaxSeqNo: 36 sessionId: src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0
2025-10-02T09:33:41.238613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bed17f3-70c0726-cf1f8f93-3c83535a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.241357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Write session: try to update token
2025-10-02T09:33:41.241372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.247189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.247201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.247202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.247203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.247206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.247208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.247210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875237043:3731]
2025-10-02T09:33:41.247228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.247233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.247234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.247235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.247236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.247238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.247336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.253610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId: src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.255899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.316646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950795722:5822]
2025-10-02T09:33:41.316839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2051, pipe: [1:7556555243950795722:5822]
2025-10-02T09:33:41.357391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.357698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.357711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.357724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795722:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.357892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.357908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.357933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950795722:5822]
2025-10-02T09:33:41.357940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:41.357995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2052 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0
2025-10-02T09:33:41.358136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2052 sessionId: src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0 is DEAD
2025-10-02T09:33:41.358298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:41.358311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Write session will restart in 0.005318s
2025-10-02T09:33:41.358336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Write session: Do CDS request
2025-10-02T09:33:41.358342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.365137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.365268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.365280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2053
2025-10-02T09:33:41.365405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.365426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.365446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.365452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.365758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2053 sessionId:  describe result for acl check
2025-10-02T09:33:41.365790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.365796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.365798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.365802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950795822:5411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.365862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.366234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950795822:5411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.367738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950795822:5411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.368521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.368623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.368630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.368636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.368663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.368687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875237186:3732]
2025-10-02T09:33:41.369041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.369193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950795822:5411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.369204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950795822:5411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.369216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.369206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950795822:5411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.369210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.369238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.369412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.369439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.369443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.369443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.369444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.369445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.369445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.369446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.369447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.369447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.369448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.369448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.369449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.369452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.369457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.369459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.369462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.369464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.369466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.369467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.369469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.369471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.369473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.369475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.369477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.369481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.369485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.369488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.369491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.369493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.369496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.369498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.369501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.369503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.369506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.369508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.369511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.369513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.369515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.369518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.369520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.369523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.369526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.369528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.369534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.369536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.369539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.369541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.369543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.369561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.376978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.378413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.378425Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.378427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.378429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.378433Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2052 [2:7556555243875237186:3732]
2025-10-02T09:33:41.378440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.378451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.378455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.378457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.378458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.378467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.378471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.378476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.378508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.378512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.378515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.378517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.378518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.378559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.378565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.378571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.378576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.378584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.378599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795861:5411], now have 1 active actors on pipe
2025-10-02T09:33:41.378605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795724:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.378608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.378610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.378611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.378618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.378628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.378631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.378633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.378635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.378638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.378640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.378665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.378674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.378679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.378662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2052
2025-10-02T09:33:41.378663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2052
2025-10-02T09:33:41.378698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.378703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.378719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.378726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.378728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.378729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.378734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.378740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.378750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.378847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.378851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.378858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.378923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2053 partition: 0 MaxSeqNo: 36 sessionId: src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0
2025-10-02T09:33:41.379242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1db6141f-165f315b-25ed9b5b-200c3e62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.381865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Write session: try to update token
2025-10-02T09:33:41.381881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.387793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.387806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.387808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.387811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.387816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.387818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.387820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875237181:3732]
2025-10-02T09:33:41.387838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.387844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.387845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.387845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.387848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.387850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.387952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.393842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId: src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.396211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.457952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950795873:5822]
2025-10-02T09:33:41.458133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2052, pipe: [1:7556555243950795873:5822]
2025-10-02T09:33:41.500273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.500498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.500509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.500523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795873:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.500666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.500706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:41.500717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:41.500738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950795873:5822]
2025-10-02T09:33:41.500756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.500767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2053 reason: error at write: Disconnected sessionId: src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0
2025-10-02T09:33:41.500906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2053 sessionId: src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0 is DEAD
2025-10-02T09:33:41.501023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:41.501031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Write session will restart in 0.006919s
2025-10-02T09:33:41.501046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Write session: Do CDS request
2025-10-02T09:33:41.501051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.508958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.509195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.509265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.509275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2054
2025-10-02T09:33:41.509406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.509427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.509433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.509435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.509747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2054 sessionId:  describe result for acl check
2025-10-02T09:33:41.509773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.509777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.509778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.509781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950795974:5402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.510125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950795974:5402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.511657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950795974:5402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.511667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.511766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.511772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.511777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.511803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.511825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875237323:3726]
2025-10-02T09:33:41.512155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.512322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.512347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.512521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.512550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.512554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.512554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.512555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.512555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.512556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.512556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.512557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.512557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.512558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.512558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.512559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.512561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.512567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.512569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.512571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.512573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.512575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.512577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.512579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.512581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.512583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.512585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.512587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.512591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.512594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.512597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.512600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.512602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.512605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.512607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.512610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.512612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.512615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.512617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.512620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.512622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.512625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.512627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.512630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.512632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.512635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.512637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.512639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.512643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.512646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.512648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.512650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.512668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.516521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950795974:5402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.516531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950795974:5402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.516533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950795974:5402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.516537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.520080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.521498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.521508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.521509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.521511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.521515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2053 [2:7556555243875237323:3726]
2025-10-02T09:33:41.521522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.521531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.521536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.521537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.521538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.521546Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.521549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.521553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.521582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.521587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.521588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.521589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.521591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.521629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.521634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.521640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.521645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.521653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.521667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950795874:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.521673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796014:5402], now have 1 active actors on pipe
2025-10-02T09:33:41.521676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.521678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.521679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.521687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.521698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.521699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.521701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.521702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.521705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.521706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.521700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2053
2025-10-02T09:33:41.521710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2053
2025-10-02T09:33:41.521720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.521725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.521736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.521741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.521767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.521767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.521773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.521776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.521777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.521782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.521787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.521799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.521893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.521898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.521905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.521959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2054 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0
2025-10-02T09:33:41.522218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e7f1e6-f666b10d-eb03c6b6-ccd82635_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.525008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Write session: try to update token
2025-10-02T09:33:41.525026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.530952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.530964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.530966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.530967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.530971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.530973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.530976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875237318:3726]
2025-10-02T09:33:41.530994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.530997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.530999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.531001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.531002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.531002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.531107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.538074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId: src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.540351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.600797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950796025:5822]
2025-10-02T09:33:41.600971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2053, pipe: [1:7556555243950796025:5822]
2025-10-02T09:33:41.643175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.643404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.643415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.643429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796025:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.643578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.643622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950796025:5822]
2025-10-02T09:33:41.643637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:41.643646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.643709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2054 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0
2025-10-02T09:33:41.643880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2054 sessionId: src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0 is DEAD
2025-10-02T09:33:41.643991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:41.644001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Write session will restart in 0.009928s
2025-10-02T09:33:41.644023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Write session: Do CDS request
2025-10-02T09:33:41.644028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.651327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.653966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.654066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.654072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.654078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.654102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.654125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875237461:3721]
2025-10-02T09:33:41.654470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.654634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.654664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.654835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.654863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.654867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.654868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.654868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.654869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.654870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.654870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.654871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.654871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.654872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.654872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.654873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.654875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.654882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.654884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.654886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.654888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.654890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.654892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.654894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.654896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.654898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.654900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.654902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.654906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.654910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.654913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.654916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.654918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.654921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.654923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.654926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.654928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.654931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.654933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.654935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.654938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.654940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.654943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.654945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.654947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.654951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.654953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.654956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.654958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.654963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.654965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.654967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.654983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.655252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.655341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.655352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2055
2025-10-02T09:33:41.655498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.655523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.655531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.655535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.655835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2055 sessionId:  describe result for acl check
2025-10-02T09:33:41.655861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.655866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.655867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.655870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950796132:5395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.656214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950796132:5395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.657588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950796132:5395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.661992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950796132:5395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.662003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950796132:5395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.662005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950796132:5395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.662009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.662498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.663974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.663985Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.663986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.663989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.663992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2054 [2:7556555243875237461:3721]
2025-10-02T09:33:41.663999Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.664008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.664013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.664016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.664017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.664026Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.664029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.664035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.664065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.664070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.664072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.664074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.664075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.664113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.664118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.664124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.664130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.664141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.664155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796026:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.664161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796165:5395], now have 1 active actors on pipe
2025-10-02T09:33:41.664164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.664165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.664166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.664174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.664185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.664190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.664192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.664193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.664195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.664197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.664184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2054
2025-10-02T09:33:41.664189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2054
2025-10-02T09:33:41.664211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.664216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.664217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.664225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.664227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.664252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.664259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.664261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.664262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.664268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.664277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.664286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.664374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.664379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.664387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.664429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2055 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0
2025-10-02T09:33:41.664675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f519b62-f81d9af7-8387f20c-20ec353b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.667352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Write session: try to update token
2025-10-02T09:33:41.667369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.673448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.673463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.673464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.673465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.673470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.673472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.673474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875237456:3721]
2025-10-02T09:33:41.673496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.673502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.673503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.673503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.673506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.673510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.673613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.679841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId: src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.682179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.743647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950796174:5822]
2025-10-02T09:33:41.743868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2054, pipe: [1:7556555243950796174:5822]
2025-10-02T09:33:41.790180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.790420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.790432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.790447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796174:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.790617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.790634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.790668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950796174:5822]
2025-10-02T09:33:41.790673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:41.790743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2055 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0
2025-10-02T09:33:41.790899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2055 sessionId: src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0 is DEAD
2025-10-02T09:33:41.791066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:41.791082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Write session will restart in 0.006548s
2025-10-02T09:33:41.791109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Write session: Do CDS request
2025-10-02T09:33:41.791115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.798735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.799190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.799274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.799285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2056
2025-10-02T09:33:41.799406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.799428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.799434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.799437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.799768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2056 sessionId:  describe result for acl check
2025-10-02T09:33:41.799801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.799806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.799808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.799813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950796277:5391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.800257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950796277:5391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.801482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.801596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.801603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.801608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.801636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.801657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875237600:3719]
2025-10-02T09:33:41.801953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950796277:5391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.801992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.802171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.802194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.802365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.802394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.802398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.802399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.802399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.802400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.802400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.802401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.802401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.802402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.802402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.802403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.802404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.802406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.802412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.802414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.802417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.802418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.802421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.802422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.802424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.802426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.802428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.802430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.802432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.802436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.802440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.802443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.802446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.802448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.802450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.802452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.802455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.802457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.802460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.802462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.802464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.802466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.802469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.802472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.802475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.802477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.802480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.802482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.802484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.802486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.802489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.802495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.802497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.802515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.806326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950796277:5391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.806336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950796277:5391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.806337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950796277:5391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.806341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.809914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.811296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.811308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.811309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.811311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.811315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2055 [2:7556555243875237600:3719]
2025-10-02T09:33:41.811323Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.811333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.811334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.811335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.811337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.811346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.811352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.811358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.811388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.811393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.811394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.811395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.811396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.811506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2055
2025-10-02T09:33:41.811509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2055
2025-10-02T09:33:41.811592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.811597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.811603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.811608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.811619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.811633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796315:5391], now have 1 active actors on pipe
2025-10-02T09:33:41.811639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796175:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.811651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.811656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.811665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.811669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.811670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.811678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.811686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.811692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.811694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.811695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.811696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.811698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.811707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72072e52-ce45c175-8226dcac-a2193ff5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.811713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.811719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.811720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.811727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.811733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.811754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.811763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.811771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.811776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.811862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.811867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.811875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.811921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2056 partition: 0 MaxSeqNo: 36 sessionId: src_id|72072e52-ce45c175-8226dcac-a2193ff5_0
2025-10-02T09:33:41.812152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f990caf-5056e2f4-663d4a77-c070fbad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72072e52-ce45c175-8226dcac-a2193ff5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.814943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Write session: try to update token
2025-10-02T09:33:41.814956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.820869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:41.820882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.820887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.820909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:41.820912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:41.821036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:41.821150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:41.821260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:41.821370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:41.821521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:41.821546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:41.827368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId: src_id|72072e52-ce45c175-8226dcac-a2193ff5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.829330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.829342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.829343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.829345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.829349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.829351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.829354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875237595:3719]
2025-10-02T09:33:41.829373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.829378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.829380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.829380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.829382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.829382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.829484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.829507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:41.890592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555243950796329:5822]
2025-10-02T09:33:41.890790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2055, pipe: [1:7556555243950796329:5822]
2025-10-02T09:33:41.940486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:41.940865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.940878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.940894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796329:5822], now have 1 active actors on pipe
2025-10-02T09:33:41.941036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:41.941070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555243950796329:5822]
2025-10-02T09:33:41.941092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:41.941100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:41.941143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2056 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72072e52-ce45c175-8226dcac-a2193ff5_0
2025-10-02T09:33:41.941278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2056 sessionId: src_id|72072e52-ce45c175-8226dcac-a2193ff5_0 is DEAD
2025-10-02T09:33:41.941396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:41.941405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Write session will restart in 0.006306s
2025-10-02T09:33:41.941420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Write session: Do CDS request
2025-10-02T09:33:41.941424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:41.949090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:41.949227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.949326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:41.949336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2057
2025-10-02T09:33:41.949448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:41.949469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:41.949475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:41.949478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:41.949730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2057 sessionId:  describe result for acl check
2025-10-02T09:33:41.949753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:41.949758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:41.949759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:41.949762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555243950796436:5385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:41.950099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555243950796436:5385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:41.951528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555243950796436:5385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:41.951927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:41.952040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:41.952046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:41.952052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:41.952079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:41.952103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555243875237752:3714]
2025-10-02T09:33:41.952441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:41.952625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:41.952649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:41.952853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:41.952886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.952890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.952891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.952891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.952892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.952893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.952893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.952894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.952894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.952895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.952895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.952896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.952899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.952904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.952907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.952909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.952911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.952913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.952915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.952917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.952919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.952921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.952923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.952925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.952929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.952933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:41.952937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.952940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:41.952942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.952945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:41.952947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.952950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:41.952953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.952955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:41.952957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.952959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:41.952962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.952964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:41.952968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.952970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:41.952972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.952975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:41.952977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.952980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.952982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.952985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.952987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.952990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.953008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:41.953617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555243950796436:5385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:41.953626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555243950796436:5385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:41.953628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555243950796436:5385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:41.953632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:41.960583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:41.961994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:41.962005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:41.962006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:41.962008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:41.962011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2056 [2:7556555243875237752:3714]
2025-10-02T09:33:41.962018Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:41.962027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:41.962032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.962033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.962034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.962043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:41.962047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:41.962051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:41.962080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.962084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.962085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.962087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:41.962088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:41.962127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:41.962131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.962138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:41.962143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:41.962150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:41.962164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796475:5385], now have 1 active actors on pipe
2025-10-02T09:33:41.962169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555243950796333:2446], now have 1 active actors on pipe
2025-10-02T09:33:41.962173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.962174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.962175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.962182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:41.962192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:41.962193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:41.962196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:41.962197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:41.962203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:41.962204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:41.962192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2056
2025-10-02T09:33:41.962217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.962222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:41.962224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:41.962204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2056
2025-10-02T09:33:41.962233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.962238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.962262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:41.962269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:41.962271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:41.962272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:41.962429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:41.962438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:41.962452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.962561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:41.962566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:41.962573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:41.962622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2057 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0
2025-10-02T09:33:41.962832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72072e52-ce45c175-8226dcac-a2193ff5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:41.965320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Write session: try to update token
2025-10-02T09:33:41.965331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:41.971380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:41.971394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:41.971395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:41.971397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:41.971402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.971404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.971406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555243875237747:3714]
2025-10-02T09:33:41.971427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:41.971427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:41.971430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:41.971430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:41.971431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:41.971441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:41.971593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:41.977148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId: src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:41.979257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.041108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245763813:5822]
2025-10-02T09:33:42.041223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2056, pipe: [1:7556555248245763813:5822]
2025-10-02T09:33:42.089979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.090407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.090419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.090434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245763813:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.090584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:42.090628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245763813:5822]
2025-10-02T09:33:42.090630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:42.090664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.090709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2057 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0
2025-10-02T09:33:42.090881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2057 sessionId: src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0 is DEAD
2025-10-02T09:33:42.091002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:42.091007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Write session will restart in 0.007624s
2025-10-02T09:33:42.091026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Write session: Do CDS request
2025-10-02T09:33:42.091030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.099230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.099320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.099326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.099338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2058
2025-10-02T09:33:42.099467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.099489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.099495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.099497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.099756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2058 sessionId:  describe result for acl check
2025-10-02T09:33:42.099777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.099781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.099782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.099785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245763918:5372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.100125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245763918:5372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.101692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245763918:5372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.101824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.101917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.101923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.101929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.101954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.101979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170205228:3675]
2025-10-02T09:33:42.102333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.102493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.102516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.102696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.102727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.102731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.102732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.102732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.102733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.102733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.102734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.102734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.102735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.102735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.102736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.102737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.102739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.102745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.102747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.102749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.102751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.102753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.102755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.102757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.102759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.102761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.102763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.102765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.102769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.102772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.102775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.102778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.102780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.102783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.102786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.102788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.102791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.102793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.102795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.102798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.102800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.102802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.102805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.102807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.102809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.102812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.102814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.102817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.102819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.102822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.102824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.102826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.102844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.106752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245763918:5372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.106761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245763918:5372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.106763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245763918:5372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.106767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.110259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.111815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.111828Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.111829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.111830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.111833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2057 [2:7556555248170205228:3675]
2025-10-02T09:33:42.111840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.111848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.111850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.111851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.111852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.111860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.111863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.111867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.111897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.111901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.111903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.111905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.111906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.111940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.111944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.111951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.111956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.111963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.111973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.111976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.111977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.111982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.111989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.111992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.111995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.111996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.111996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.111997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.112003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245763957:5372], now have 1 active actors on pipe
2025-10-02T09:33:42.112005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245763814:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.112017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.112023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.112033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.112030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2057
2025-10-02T09:33:42.112033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2057
2025-10-02T09:33:42.112076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.112082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.112094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|859f4b90-a7631983-eb5d9170-df7383ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.112098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.112100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.112101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.112107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.112112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.112120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.112218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.112223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.112229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.112297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2058 partition: 0 MaxSeqNo: 36 sessionId: src_id|859f4b90-a7631983-eb5d9170-df7383ac_0
2025-10-02T09:33:42.112506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce89f1-3182823e-50fb7eb4-eb7486ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|859f4b90-a7631983-eb5d9170-df7383ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.115003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Write session: try to update token
2025-10-02T09:33:42.115014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.121701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.121715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.121716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.121717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.121722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.121724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.121726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170205223:3675]
2025-10-02T09:33:42.121746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.121750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.121752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.121753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.121754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.121757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.121892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.127370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId: src_id|859f4b90-a7631983-eb5d9170-df7383ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:42.129499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.190621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245763964:5822]
2025-10-02T09:33:42.190806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2057, pipe: [1:7556555248245763964:5822]
2025-10-02T09:33:42.234256Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.234678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.234691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.234706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245763964:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.234868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:42.234882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:42.234883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.234894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:42.234918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245763964:5822]
2025-10-02T09:33:42.234942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2058 reason: error at write: Disconnected sessionId: src_id|859f4b90-a7631983-eb5d9170-df7383ac_0
2025-10-02T09:33:42.235074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2058 sessionId: src_id|859f4b90-a7631983-eb5d9170-df7383ac_0 is DEAD
2025-10-02T09:33:42.235205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:42.235214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Write session will restart in 0.005218s
2025-10-02T09:33:42.235228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Write session: Do CDS request
2025-10-02T09:33:42.235233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.241081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.241259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.241269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2059
2025-10-02T09:33:42.241356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.241378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.241384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.241387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.241648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2059 sessionId:  describe result for acl check
2025-10-02T09:33:42.241673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.241677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.241679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.241681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245764061:5366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.242015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245764061:5366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.242962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.243179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245764061:5366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.245490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.245582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.245589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.245594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.245618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.245640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170205370:3687]
2025-10-02T09:33:42.245758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245764061:5366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.245769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245764061:5366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.245773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245764061:5366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.245777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.245978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.246133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.246154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.246322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.246349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.246353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.246353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.246354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.246354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.246355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.246355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.246356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.246356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.246357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.246357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.246358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.246361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.246366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.246368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.246370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.246372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.246374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.246376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.246378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.246380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.246382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.246384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.246385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.246389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.246393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.246396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.246399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.246402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.246404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.246407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.246409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.246412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.246414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.246417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.246419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.246421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.246424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.246426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.246428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.246430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.246434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.246436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.246439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.246441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.246443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.246445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.246448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.246464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.253824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.255277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.255288Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.255289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.255291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.255294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2058 [2:7556555248170205370:3687]
2025-10-02T09:33:42.255301Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.255310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.255315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.255316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.255317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.255326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.255329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.255333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.255365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.255370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.255371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.255373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.255374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.255412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.255417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.255422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.255427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.255436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.255450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245763966:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.255455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764105:5366], now have 1 active actors on pipe
2025-10-02T09:33:42.255458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.255459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.255460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.255467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.255477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.255479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.255482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.255483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.255487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.255489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.255479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2058
2025-10-02T09:33:42.255502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.255507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.255482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2058
2025-10-02T09:33:42.255508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.255519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.255520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.255544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.255550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.255553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.255554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.255560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.255568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.255580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.255669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.255674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.255681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.255740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2059 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0
2025-10-02T09:33:42.255933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859f4b90-a7631983-eb5d9170-df7383ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.258480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Write session: try to update token
2025-10-02T09:33:42.258491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.264680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.264695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.264696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.264697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.264702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.264705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.264709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170205365:3687]
2025-10-02T09:33:42.264728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.264731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.264734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.264734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.264736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.264736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.264853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.270677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId: src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:42.272749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.335015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245764119:5822]
2025-10-02T09:33:42.335229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2058, pipe: [1:7556555248245764119:5822]
2025-10-02T09:33:42.378803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.379018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.379027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.379042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764119:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.379161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:42.379186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245764119:5822]
2025-10-02T09:33:42.379208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:42.379213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.379262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2059 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0
2025-10-02T09:33:42.379407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2059 sessionId: src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0 is DEAD
2025-10-02T09:33:42.379539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:42.379544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Write session will restart in 0.008366s
2025-10-02T09:33:42.379563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Write session: Do CDS request
2025-10-02T09:33:42.379567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.387098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.389129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.389243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.389253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2060
2025-10-02T09:33:42.389330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.389349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.389355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.389358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.389617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2060 sessionId:  describe result for acl check
2025-10-02T09:33:42.389636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.389640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.389641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.389644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245764227:5354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.389692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.389791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.389797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.389803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.389828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.389850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170205516:3684]
2025-10-02T09:33:42.389993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245764227:5354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.390191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.390363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.390385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.390557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.390714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.390720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.390721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.390721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.390722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.390722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.390723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.390723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.390723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.390724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.390724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.390725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.390728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.390733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.390736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.390738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.390740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.390741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.390743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.390745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.390747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.390749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.390751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.390753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.390757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.390761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.390764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.390767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.390770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.390772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.390774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.390778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.390782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.390786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.390789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.390793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.390797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.390800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.390804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.390807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.390810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.390814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.390817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.390821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.390827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.390831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.390834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.390838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.390855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.391188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245764227:5354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.395702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245764227:5354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.395712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245764227:5354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.395714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245764227:5354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.395718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.398317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.399798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.399810Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.399812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.399814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.399818Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2059 [2:7556555248170205516:3684]
2025-10-02T09:33:42.399825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.399835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.399838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.399840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.399841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.399850Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.399856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.399860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.399895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.399900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.399901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.399903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.399904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.399943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.399948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.399954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.399959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.399968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.399983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764121:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.399990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.399991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.399993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.400002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.400007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764266:5354], now have 1 active actors on pipe
2025-10-02T09:33:42.400014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.400014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.400016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.400018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.400022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.400023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.400030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2059
2025-10-02T09:33:42.400038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.400038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2059
2025-10-02T09:33:42.400043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.400047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.400065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.400070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.400087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.400094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.400097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.400098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.400103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.400110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.400118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.400212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.400217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.400224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.400282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2060 partition: 0 MaxSeqNo: 36 sessionId: src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0
2025-10-02T09:33:42.400508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8ffe04-95340080-3dc0e21f-aec67f1c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.402987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Write session: try to update token
2025-10-02T09:33:42.402998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.409413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.409429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.409430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.409431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.409436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.409439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.409440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170205511:3684]
2025-10-02T09:33:42.409462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.409468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.409470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.409470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.409474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.409476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.409574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.414469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId: src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:42.416538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.479401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245764273:5822]
2025-10-02T09:33:42.479567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2059, pipe: [1:7556555248245764273:5822]
2025-10-02T09:33:42.518629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.519150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.519160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.519186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764273:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.519350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:42.519389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245764273:5822]
2025-10-02T09:33:42.519400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.519412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:42.519463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2060 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0
2025-10-02T09:33:42.519595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2060 sessionId: src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0 is DEAD
2025-10-02T09:33:42.519712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:42.519717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Write session will restart in 0.006530s
2025-10-02T09:33:42.519732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Write session: Do CDS request
2025-10-02T09:33:42.519737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.527099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.527172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.527181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2061
2025-10-02T09:33:42.527256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.527281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.527289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.527292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.527592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2061 sessionId:  describe result for acl check
2025-10-02T09:33:42.527627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.527629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.527631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.527637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245764380:5349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.527974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.528137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245764380:5349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.529499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245764380:5349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.530487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.530588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.530594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.530600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.530626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.530657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170205660:3682]
2025-10-02T09:33:42.530991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.531200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.531224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.531399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.531427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.531431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.531432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.531432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.531433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.531433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.531434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.531435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.531435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.531436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.531436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.531437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.531439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.531445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.531447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.531450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.531451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.531453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.531455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.531457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.531459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.531461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.531463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.531465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.531469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.531472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.531476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.531479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.531481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.531484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.531486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.531489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.531491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.531494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.531496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.531502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.531505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.531483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245764380:5349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.531507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.531493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245764380:5349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.531510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.531495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245764380:5349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.531513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.531515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.531498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.531518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.531520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.531523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.531525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.531528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.531530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.531532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.531549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.539196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.540714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.540726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.540728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.540730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.540733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2060 [2:7556555248170205660:3682]
2025-10-02T09:33:42.540741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.540752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.540757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.540759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.540760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.540770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.540772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.540777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.540823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.540828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.540829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.540831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.540833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.540872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.540877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.540883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.540888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.540896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.540911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764418:5349], now have 1 active actors on pipe
2025-10-02T09:33:42.540916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764274:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.540921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.540922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.540923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.540931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.540942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.540944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.540946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.540947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.540953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.540955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.540970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.540975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.540977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.540958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2060
2025-10-02T09:33:42.540962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2060
2025-10-02T09:33:42.540990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.540995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.541015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3f7800c-ca30771-54d06050-bc5b9880_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.541022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.541024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.541025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.541032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.541040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.541052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.541132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.541136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.541144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.541201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2061 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3f7800c-ca30771-54d06050-bc5b9880_0
2025-10-02T09:33:42.541421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d851e-5b4d9ff3-17ce2b1e-ec71c1b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3f7800c-ca30771-54d06050-bc5b9880_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.543918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Write session: try to update token
2025-10-02T09:33:42.543927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.550256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.550270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.550272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.550273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.550278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.550280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.550285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170205655:3682]
2025-10-02T09:33:42.550305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.550305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.550308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.550308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.550310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.550310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.550443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.555699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId: src_id|f3f7800c-ca30771-54d06050-bc5b9880_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:42.557748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.619680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245764428:5822]
2025-10-02T09:33:42.619859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2060, pipe: [1:7556555248245764428:5822]
2025-10-02T09:33:42.660242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.660462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.660470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.660496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764428:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.660657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:42.660657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:42.660661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.660669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:42.660705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245764428:5822]
2025-10-02T09:33:42.660716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2061 reason: error at write: Disconnected sessionId: src_id|f3f7800c-ca30771-54d06050-bc5b9880_0
2025-10-02T09:33:42.660864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2061 sessionId: src_id|f3f7800c-ca30771-54d06050-bc5b9880_0 is DEAD
2025-10-02T09:33:42.661008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:42.661017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Write session will restart in 0.006766s
2025-10-02T09:33:42.661033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Write session: Do CDS request
2025-10-02T09:33:42.661038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.669136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.669221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.669242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.669256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2062
2025-10-02T09:33:42.669350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.669370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.669376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.669379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.669653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2062 sessionId:  describe result for acl check
2025-10-02T09:33:42.669680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.669683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.669684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.669687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245764537:5350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.670039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245764537:5350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.671283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245764537:5350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.671980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.672072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.672079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.672084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.672107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.672133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170205806:3680]
2025-10-02T09:33:42.672466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.672599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.672621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.672742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245764537:5350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.672749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245764537:5350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.672751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245764537:5350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.672754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.672791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.672836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.672840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.672841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.672842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.672842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.672843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.672843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.672844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.672844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.672845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.672845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.672846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.672849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.672854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.672857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.672859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.672861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.672863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.672865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.672867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.672869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.672871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.672873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.672875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.672878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.672882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.672885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.672889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.672891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.672893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.672895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.672898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.672900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.672902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.672905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.672907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.672909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.672912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.672914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.672916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.672918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.672921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.672923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.672926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.672928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.672930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.672932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.672935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.672954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.680362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.681749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.681761Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.681762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.681764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.681767Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2061 [2:7556555248170205806:3680]
2025-10-02T09:33:42.681775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.681784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.681790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.681791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.681792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.681801Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.681803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.681808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.681842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.681847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.681848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.681850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.681851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.681886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.681891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.681897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.681902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.681910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.681924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764429:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.681931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.681933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.681934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.681938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.681944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764574:5350], now have 1 active actors on pipe
2025-10-02T09:33:42.681944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.681946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.681948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.681951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.681959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.681960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.681973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.681981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.681976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2061
2025-10-02T09:33:42.681994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.681978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2061
2025-10-02T09:33:42.682017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.682024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.682040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7070631b-4ba78f62-c4723429-3488c946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.682049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.682054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.682055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.682060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.682066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.682075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.682341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.682348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.682357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.682422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2062 partition: 0 MaxSeqNo: 36 sessionId: src_id|7070631b-4ba78f62-c4723429-3488c946_0
2025-10-02T09:33:42.682628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f7800c-ca30771-54d06050-bc5b9880_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7070631b-4ba78f62-c4723429-3488c946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.685311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Write session: try to update token
2025-10-02T09:33:42.685322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.690993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:42.691006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.691011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.691032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:42.691038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:42.691163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:42.691279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:42.691389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:42.691500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:42.691654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:42.691677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:42.696777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId: src_id|7070631b-4ba78f62-c4723429-3488c946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:42.699041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.699729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.699743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.699754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.699755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.699756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.699757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.699762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.699764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.699767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170205801:3680]
2025-10-02T09:33:42.699784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.699790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.699793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.699794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.699794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.699796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.699897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.760993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245764584:5822]
2025-10-02T09:33:42.761204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2061, pipe: [1:7556555248245764584:5822]
2025-10-02T09:33:42.814464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.814961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:42.814989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764584:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.815070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:42.815110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.815143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:42.815149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:42.815154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245764584:5822]
2025-10-02T09:33:42.815198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2062 reason: error at write: Disconnected sessionId: src_id|7070631b-4ba78f62-c4723429-3488c946_0
2025-10-02T09:33:42.815297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2062 sessionId: src_id|7070631b-4ba78f62-c4723429-3488c946_0 is DEAD
2025-10-02T09:33:42.815435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:42.815443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Write session will restart in 0.007025s
2025-10-02T09:33:42.815459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Write session: Do CDS request
2025-10-02T09:33:42.815468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.823147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.823212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.823221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2063
2025-10-02T09:33:42.823318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.823337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.823342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.823345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.823682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2063 sessionId:  describe result for acl check
2025-10-02T09:33:42.823714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.823720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.823722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.823726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245764693:5346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.823892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.824176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245764693:5346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.825631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245764693:5346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.826792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.826971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.826978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.826985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.827020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.827059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170205955:3678]
2025-10-02T09:33:42.827612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.827804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.827831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.828115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.828118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245764693:5346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.828130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245764693:5346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.828132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245764693:5346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.828136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.828155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.828159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.828160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.828160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.828163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.828164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.828165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.828166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.828167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.828169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.828171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.828171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.828176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.828182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.828185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.828188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.828190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.828192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.828194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.828196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.828198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.828201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.828203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.828205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.828209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.828214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.828217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.828220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.828222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.828225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.828227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.828230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.828238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.828245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.828247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.828250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.828254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.828261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.828264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.828268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.828271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.828273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.828275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.828278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.828280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.828283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.828286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.828289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.828305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.835985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.838218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.838229Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.838230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.838232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.838236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2062 [2:7556555248170205955:3678]
2025-10-02T09:33:42.838243Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.838254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.838259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.838261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.838262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.838272Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.838277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.838282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.838318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.838323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.838324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.838326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.838327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.838437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2062
2025-10-02T09:33:42.838458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2062
2025-10-02T09:33:42.838717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.838723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.838732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.838738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.838750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.838766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764730:5346], now have 1 active actors on pipe
2025-10-02T09:33:42.838771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764585:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.838781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.838787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.838798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.838802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.838803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.838814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.838824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.838828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.838830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.838831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.838834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.838837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.838846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.838854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.838856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.838859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.838865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.838874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.838894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.838901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.838908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.838909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.838998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.839002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.839011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.839054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2063 partition: 0 MaxSeqNo: 36 sessionId: src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0
2025-10-02T09:33:42.839428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7070631b-4ba78f62-c4723429-3488c946_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.846393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Write session: try to update token
2025-10-02T09:33:42.846410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.848156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.848167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.848168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.848169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.848173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.848175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.848177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170205948:3678]
2025-10-02T09:33:42.848195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.848198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.848199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.848205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.848207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.848210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.848309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.861138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId: src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:42.863194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:42.915097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555248245764745:5822]
2025-10-02T09:33:42.915253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2062, pipe: [1:7556555248245764745:5822]
2025-10-02T09:33:42.959953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:42.960158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.960169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.960184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764745:5822], now have 1 active actors on pipe
2025-10-02T09:33:42.960329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:42.960347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:42.960350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:42.960359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:42.960383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555248245764745:5822]
2025-10-02T09:33:42.960403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2063 reason: error at write: Disconnected sessionId: src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0
2025-10-02T09:33:42.960556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2063 sessionId: src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0 is DEAD
2025-10-02T09:33:42.960726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:42.960743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Write session will restart in 0.007733s
2025-10-02T09:33:42.960769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Write session: Do CDS request
2025-10-02T09:33:42.960775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:42.968600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:42.969236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.969363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:42.969374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2064
2025-10-02T09:33:42.969505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:42.969526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:42.969532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:42.969536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:42.969834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2064 sessionId:  describe result for acl check
2025-10-02T09:33:42.969862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:42.969866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:42.969867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:42.969870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555248245764862:5336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:42.970223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555248245764862:5336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:42.971831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555248245764862:5336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:42.971978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:42.972103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:42.972110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:42.972115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:42.972145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:42.972167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555248170206115:3669]
2025-10-02T09:33:42.972504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:42.972667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:42.972690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:42.972876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:42.972912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.972917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.972917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.972918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.972918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.972919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.972919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.972920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.972920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.972921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.972921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.972922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.972924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.972930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.972932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.972934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.972936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.972938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.972940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.972942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.972944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.972946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.972948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.972950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.972953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.972957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:42.972962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.972964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:42.972966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.972969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:42.972972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.972974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:42.972976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.972979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:42.972981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.972984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:42.972986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.972989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:42.972991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.972994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:42.972996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.972998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:42.973000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.973006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.973008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.973011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.973013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.973015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.973032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:42.976913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555248245764862:5336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:42.976923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555248245764862:5336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:42.976925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555248245764862:5336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:42.976928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:42.980473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:42.981952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:42.981963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:42.981964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:42.981966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:42.981970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2063 [2:7556555248170206115:3669]
2025-10-02T09:33:42.981977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:42.981986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:42.981991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.981992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.981993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.982002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:42.982005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:42.982012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:42.982043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.982048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.982050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.982052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:42.982053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:42.982145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2063
2025-10-02T09:33:42.982159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2063
2025-10-02T09:33:42.982226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:42.982231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.982238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:42.982243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:42.982253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:42.982268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764752:2446], now have 1 active actors on pipe
2025-10-02T09:33:42.982273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555248245764898:5336], now have 1 active actors on pipe
2025-10-02T09:33:42.982286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.982291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.982300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.982304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.982307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.982314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:42.982324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:42.982327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:42.982329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:42.982330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:42.982332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:42.982334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:42.982343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:42.982349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:42.982351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:42.982352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:42.982357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:42.982362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:42.982379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.982387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:42.982392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.982394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:42.982561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:42.982565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:42.982573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:42.982624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2064 partition: 0 MaxSeqNo: 36 sessionId: src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0
2025-10-02T09:33:42.982893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe9107e-3ec9b864-3f868e41-d9d06deb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:42.985489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Write session: try to update token
2025-10-02T09:33:42.985501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:42.991449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:42.991461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:42.991462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:42.991463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:42.991466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.991468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.991470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555248170206109:3669]
2025-10-02T09:33:42.991488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:42.991491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:42.991494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:42.991516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:42.991530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:42.991535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:42.991602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:42.998403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId: src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.000540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.060499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540732227:5822]
2025-10-02T09:33:43.060655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2063, pipe: [1:7556555252540732227:5822]
2025-10-02T09:33:43.108083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.108300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.108311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.108325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732227:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.108453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.108504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.108552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540732227:5822]
2025-10-02T09:33:43.108956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:43.109008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2064 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0
2025-10-02T09:33:43.109134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2064 sessionId: src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0 is DEAD
2025-10-02T09:33:43.109291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:43.109306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Write session will restart in 0.006994s
2025-10-02T09:33:43.109344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Write session: Do CDS request
2025-10-02T09:33:43.109350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.117116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.117211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.117222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2065
2025-10-02T09:33:43.117259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.117367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.117418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.117426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.117430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.117782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2065 sessionId:  describe result for acl check
2025-10-02T09:33:43.117817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.117822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.117823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.117825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540732351:5318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.118165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540732351:5318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.120053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.120152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.120159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.120164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.120191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.120214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465173598:3640]
2025-10-02T09:33:43.120344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540732351:5318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.120550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.120710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.120734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.120922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.120953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.120957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.120958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.120958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.120959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.120959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.120960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.120960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.120961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.120961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.120962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.120962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.120965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.120971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.120973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.120975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.120977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.120979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.120981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.120983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.120985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.120987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.120989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.120990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.120994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.120998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.121001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.121004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.121007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.121009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.121012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.121014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.121017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.121019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.121021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.121024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.121026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.121030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.121033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.121036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.121038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.121040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.121042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.121045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.121049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.121051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.121053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.121056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.121073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.124887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540732351:5318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.124897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540732351:5318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.124899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540732351:5318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.124903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.128428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.130021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.130033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.130034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.130036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.130039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2064 [2:7556555252465173598:3640]
2025-10-02T09:33:43.130046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.130056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.130057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.130059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.130060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.130068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.130071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.130075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.130103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.130108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.130110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.130112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.130113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.130149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.130154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.130160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.130165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.130173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.130189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732240:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.130193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732387:5318], now have 1 active actors on pipe
2025-10-02T09:33:43.130196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.130197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.130198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.130206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.130215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.130218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.130220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.130221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.130225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.130227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.130240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.130230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2064
2025-10-02T09:33:43.130244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2064
2025-10-02T09:33:43.130245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.130247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.130271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.130275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.130290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.130297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.130299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.130300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.130305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.130310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.130316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.130412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.130416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.130423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.130481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2065 partition: 0 MaxSeqNo: 36 sessionId: src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0
2025-10-02T09:33:43.130716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14141fc5-8cfdae55-640dab93-59f56ce3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.133236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Write session: try to update token
2025-10-02T09:33:43.133250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.139225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.139236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.139237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.139238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.139242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.139244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.139246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465173592:3640]
2025-10-02T09:33:43.139264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.139267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.139270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.139270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.139271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.139272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.139373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:43.146121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId: src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.148296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.208481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540732395:5822]
2025-10-02T09:33:43.208639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2064, pipe: [1:7556555252540732395:5822]
2025-10-02T09:33:43.250769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.251011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.251024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.251038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732395:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.251203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.251187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:43.251201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:43.251205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.251251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540732395:5822]
2025-10-02T09:33:43.251270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2065 reason: error at write: Disconnected sessionId: src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0
2025-10-02T09:33:43.251425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2065 sessionId: src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0 is DEAD
2025-10-02T09:33:43.251721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:43.251732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Write session will restart in 0.008818s
2025-10-02T09:33:43.251753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Write session: Do CDS request
2025-10-02T09:33:43.251759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.261148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.261339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.261353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2066
2025-10-02T09:33:43.261458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.261483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.261492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.261495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.261793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2066 sessionId:  describe result for acl check
2025-10-02T09:33:43.261826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.261830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.261831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.261835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540732510:5302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.262014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.262190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540732510:5302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.262309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.262403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.262410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.262416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.262440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.262464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465173746:3622]
2025-10-02T09:33:43.262810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.262958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.262980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.263154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.263183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.263187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.263187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.263188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.263188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.263189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.263189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.263190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.263190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.263191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.263191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.263193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.263196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.263202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.263205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.263207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.263208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.263210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.263212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.263214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.263216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.263219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.263220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.263222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.263226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.263230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.263233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.263236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.263238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.263240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.263242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.263245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.263247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.263250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.263252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.263255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.263257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.263259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.263262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.263264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.263267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.263270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.263272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.263275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.263277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.263280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.263282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.263284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.263302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.263775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540732510:5302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.268145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540732510:5302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.268154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540732510:5302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.268156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540732510:5302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.268160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.270832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.272411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.272422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.272423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.272425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.272428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2065 [2:7556555252465173746:3622]
2025-10-02T09:33:43.272436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.272446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.272451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.272452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.272453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.272462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.272464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.272469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.272497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.272502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.272505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.272506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.272508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.272543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.272548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.272555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.272560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.272569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.272583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732399:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.272588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732550:5302], now have 1 active actors on pipe
2025-10-02T09:33:43.272592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.272593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.272595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.272602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.272613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.272612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.272614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.272608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2065
2025-10-02T09:33:43.272617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2065
2025-10-02T09:33:43.272616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.272622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.272623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.272639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.272643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.272645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.272654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.272659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.272688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.272694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.272697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.272698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.272703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.272709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.272720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.272832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.272837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.272844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.272917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2066 partition: 0 MaxSeqNo: 36 sessionId: src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0
2025-10-02T09:33:43.273128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32931fe9-cf834375-ba97aa33-d445b3cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.275685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Write session: try to update token
2025-10-02T09:33:43.275700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.281922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.281934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.281938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.281939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.281943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.281946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.281948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465173741:3622]
2025-10-02T09:33:43.281967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.281970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.281973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.281974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.281980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.281982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.282080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:43.288411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId: src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.290497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.351393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540732557:5822]
2025-10-02T09:33:43.351637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2065, pipe: [1:7556555252540732557:5822]
2025-10-02T09:33:43.395486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.395859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.395871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.395886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732557:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.396024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.396063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540732557:5822]
2025-10-02T09:33:43.396089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.396116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:43.396169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2066 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0
2025-10-02T09:33:43.396305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2066 sessionId: src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0 is DEAD
2025-10-02T09:33:43.396455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:43.396467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Write session will restart in 0.009782s
2025-10-02T09:33:43.396491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Write session: Do CDS request
2025-10-02T09:33:43.396497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.406680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.406936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.407113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.407120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.407126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.407161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.407184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465173899:3632]
2025-10-02T09:33:43.407190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.407504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.407523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2067
2025-10-02T09:33:43.407521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.407630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.407658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.407668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.407671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.407685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.407708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.407880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.407907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.407911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.407912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.407912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.407913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.407913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.407914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.407915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.407915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.407916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.407917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.407917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.407920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.407927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.407929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.407934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.407936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.407939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.407941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.407943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.407945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.407946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.407948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.407953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.407957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.407960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.407963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.407965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.407968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.407970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.407972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.407975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.407977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.407979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.407981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.407983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.407989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.407991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.407994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.407997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.407999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.408001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.407989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2067 sessionId:  describe result for acl check
2025-10-02T09:33:43.408004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.408007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.408010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.408012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.408014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.408019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.408026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.408031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.408028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.408032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540732675:5299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.408464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540732675:5299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.410170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540732675:5299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.414229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540732675:5299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.414239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540732675:5299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.414241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540732675:5299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.414245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.415420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.416836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.416845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.416847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.416849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.416852Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2066 [2:7556555252465173899:3632]
2025-10-02T09:33:43.416858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.416868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.416870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.416871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.416872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.416880Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.416886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.416891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.416918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.416922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.416923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.416925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.416927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.416961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.416966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.416972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.416978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.416985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.416999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732559:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.417005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732711:5299], now have 1 active actors on pipe
2025-10-02T09:33:43.417009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.417010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.417012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.417019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.417020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2066
2025-10-02T09:33:43.417030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.417028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2066
2025-10-02T09:33:43.417037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.417039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.417040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.417040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.417042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.417062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.417067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.417077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.417084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.417098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.417099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aef3be05-260cf036-d53c2366-a7f9d445_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.417103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.417105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.417106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.417111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.417115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.417251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.417400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.417405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.417413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.417480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2067 partition: 0 MaxSeqNo: 36 sessionId: src_id|aef3be05-260cf036-d53c2366-a7f9d445_0
2025-10-02T09:33:43.417713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc35ddd-a4a41c27-16b7bc40-41c2e99f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aef3be05-260cf036-d53c2366-a7f9d445_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.420259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Write session: try to update token
2025-10-02T09:33:43.420272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.426058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.426069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.426070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.426071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.426074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.426078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.426081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465173894:3632]
2025-10-02T09:33:43.426100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.426105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.426106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.426106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.426110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.426113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.426217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:43.433362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId: src_id|aef3be05-260cf036-d53c2366-a7f9d445_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.435464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.496244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540732718:5822]
2025-10-02T09:33:43.496426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2066, pipe: [1:7556555252540732718:5822]
2025-10-02T09:33:43.533431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.533777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.533788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.533802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732718:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.533939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.533975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540732718:5822]
2025-10-02T09:33:43.533999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.534001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:43.534090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aef3be05-260cf036-d53c2366-a7f9d445_0
2025-10-02T09:33:43.534258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2067 sessionId: src_id|aef3be05-260cf036-d53c2366-a7f9d445_0 is DEAD
2025-10-02T09:33:43.534407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:43.534419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Write session will restart in 0.008483s
2025-10-02T09:33:43.534438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Write session: Do CDS request
2025-10-02T09:33:43.534444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.541903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.544177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.544321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.544335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2068
2025-10-02T09:33:43.544446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.544471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.544480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.544483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.544551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.544660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.544666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.544672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.544698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.544722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465174051:3634]
2025-10-02T09:33:43.544784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2068 sessionId:  describe result for acl check
2025-10-02T09:33:43.544842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.544847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.544848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.544851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540732834:5296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.545071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.545209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540732834:5296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.545231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.545253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.545428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.545456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.545460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.545461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.545462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.545462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.545463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.545463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.545464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.545464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.545465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.545466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.545466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.545469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.545475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.545477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.545479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.545481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.545483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.545485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.545487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.545489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.545491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.545493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.545495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.545499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.545502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.545506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.545509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.545511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.545514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.545516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.545519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.545521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.545524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.545526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.545528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.545531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.545533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.545536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.545538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.545540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.545543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.545545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.545548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.545550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.545556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.545558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.545561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.545577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.546895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540732834:5296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.550908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540732834:5296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.550918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540732834:5296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.550920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540732834:5296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.550924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.552994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.554427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.554437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.554438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.554440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.554443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2067 [2:7556555252465174051:3634]
2025-10-02T09:33:43.554450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.554460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.554465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.554467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.554468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.554477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.554479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.554488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.554516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.554521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.554522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.554524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.554525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.554562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.554567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.554572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.554577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.554585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.554599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732719:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.554605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732873:5296], now have 1 active actors on pipe
2025-10-02T09:33:43.554608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.554610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.554611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.554618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.554628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.554631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.554633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.554633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2067
2025-10-02T09:33:43.554634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.554639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.554650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.554651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2067
2025-10-02T09:33:43.554664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.554669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.554670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.554689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.554694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.554721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.554728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.554730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.554731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.554737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.554741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.554754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.554854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.554859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.554866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.554933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2068 partition: 0 MaxSeqNo: 36 sessionId: src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0
2025-10-02T09:33:43.555130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef3be05-260cf036-d53c2366-a7f9d445_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.557686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Write session: try to update token
2025-10-02T09:33:43.557698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.563870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.563885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.563886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.563887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.563891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.563893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.563895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465174046:3634]
2025-10-02T09:33:43.563916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.563916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.563919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.563923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.563923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.563924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.564045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:43.570210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId: src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.572339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.633974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540732880:5822]
2025-10-02T09:33:43.634159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2067, pipe: [1:7556555252540732880:5822]
2025-10-02T09:33:43.673480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.674047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.674058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.674071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732880:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.674213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.674292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540732880:5822]
2025-10-02T09:33:43.674292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.674322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:43.674409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2068 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0
2025-10-02T09:33:43.674540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2068 sessionId: src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0 is DEAD
2025-10-02T09:33:43.674687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:43.674699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Write session will restart in 0.008943s
2025-10-02T09:33:43.674718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Write session: Do CDS request
2025-10-02T09:33:43.674724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.682951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.684225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.684327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.684344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2069
2025-10-02T09:33:43.684451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.684478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.684487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.684491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.684851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2069 sessionId:  describe result for acl check
2025-10-02T09:33:43.684879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.684885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.684887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.684891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540732996:5291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.685318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540732996:5291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.685510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.685619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.685626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.685632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.685659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.685682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465174203:3630]
2025-10-02T09:33:43.686113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.686253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.686276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.686449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.686477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.686481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.686482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.686482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.686483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.686483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.686484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.686484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.686485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.686485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.686486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.686486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.686489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.686495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.686497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.686500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.686502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.686504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.686506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.686508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.686510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.686512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.686514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.686516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.686520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.686524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.686527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.686530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.686536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.686539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.686541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.686544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.686546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.686549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.686550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.686553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.686555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.686558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.686561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.686564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.686566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.686569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.686571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.686573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.686577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.686579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.686581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.686583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.686601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.686638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540732996:5291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.691296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540732996:5291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.691304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540732996:5291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.691306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540732996:5291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.691311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.693906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.695522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.695535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.695536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.695538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.695541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2068 [2:7556555252465174203:3630]
2025-10-02T09:33:43.695550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.695559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.695564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.695566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.695567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.695575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.695578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.695583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.695612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.695616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.695617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.695619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.695620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.695656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.695660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.695666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.695672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.695695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.695705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540732881:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.695707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733035:5291], now have 1 active actors on pipe
2025-10-02T09:33:43.695711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.695712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.695713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.695720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.695728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.695734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.695735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.695736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.695736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.695737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.695752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.695754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.695755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2068
2025-10-02T09:33:43.695760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.695756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2068
2025-10-02T09:33:43.695770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.695772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.695789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.695796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.695798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.695799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.695803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.695811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.695821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.695943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.695948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.695955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.696023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2069 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0
2025-10-02T09:33:43.696263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e25e07-ea32d90a-e8fe02bc-cb179267_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.698885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Write session: try to update token
2025-10-02T09:33:43.698898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.704692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.704704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.704705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.704706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.704710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.704712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.704714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465174198:3630]
2025-10-02T09:33:43.704733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.704734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.704737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.704739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.704739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.704742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.704878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:43.710877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId: src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.712957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.774245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540733043:5822]
2025-10-02T09:33:43.774442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2068, pipe: [1:7556555252540733043:5822]
2025-10-02T09:33:43.815171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.815539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.815549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.815561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733043:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.815701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.815778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:43.815825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540733043:5822]
2025-10-02T09:33:43.815854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.815872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0
2025-10-02T09:33:43.816026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2069 sessionId: src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0 is DEAD
2025-10-02T09:33:43.816191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:43.816204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Write session will restart in 0.006549s
2025-10-02T09:33:43.816228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Write session: Do CDS request
2025-10-02T09:33:43.816234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.824021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.824167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.824257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.824270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2070
2025-10-02T09:33:43.824372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.824395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.824404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.824407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.824749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2070 sessionId:  describe result for acl check
2025-10-02T09:33:43.824781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.824786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.824787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.824790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540733160:5285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.825187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540733160:5285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.826623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.826727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.826733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.826739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.826765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.826901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465174357:3628]
2025-10-02T09:33:43.827084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540733160:5285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.827240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.827411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.827435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.827618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.827647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.827651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.827652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.827652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.827653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.827654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.827654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.827655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.827655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.827656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.827656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.827657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.827660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.827666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.827668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.827670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.827672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.827674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.827676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.827678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.827680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.827682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.827684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.827686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.827690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.827693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.827697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.827699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.827703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.827705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.827707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.827710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.827712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.827715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.827717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.827719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.827726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.827729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.827731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.827734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.827736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.827738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.827740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.827742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.827744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.827747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.827749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.827751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.827766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.831598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540733160:5285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.831608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540733160:5285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.831610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540733160:5285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.831614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.835137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.836774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.836784Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.836785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.836787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.836791Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2069 [2:7556555252465174357:3628]
2025-10-02T09:33:43.836797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.836820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.836824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.836826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.836827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.836836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.836842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.836847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.836878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.836882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.836884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.836886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.836888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.836922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.836926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.836933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.836939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.836950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.836964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733044:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.836971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.836973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.836974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.836980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.836984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733199:5285], now have 1 active actors on pipe
2025-10-02T09:33:43.836986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.836988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.836989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.836991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.836997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.836999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.837012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.837017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.837023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.837017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2069
2025-10-02T09:33:43.837051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2069
2025-10-02T09:33:43.837079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.837084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.837097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.837104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.837106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.837107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.837111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.837118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.837124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.837248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.837253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.837261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.837325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2070 partition: 0 MaxSeqNo: 36 sessionId: src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0
2025-10-02T09:33:43.837575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e14b989-fbfd11ec-aadf5e03-ed4b18f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.840199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Write session: try to update token
2025-10-02T09:33:43.840212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.845861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:43.845873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.845877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.845899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:43.845901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:43.846029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:43.846144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:43.846255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:43.846368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:43.846522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:43.846545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:43.853839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId: src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:43.854193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.854204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.854206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.854206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.854210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.854213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.854216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465174352:3628]
2025-10-02T09:33:43.854233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.854236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.854238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.854241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.854242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.854244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.854353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:43.855988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:43.916102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555252540733214:5822]
2025-10-02T09:33:43.916284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2069, pipe: [1:7556555252540733214:5822]
2025-10-02T09:33:43.963532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:43.963820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.963828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.963842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733214:5822], now have 1 active actors on pipe
2025-10-02T09:33:43.963993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:43.964072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:43.964078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:43.964148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555252540733214:5822]
2025-10-02T09:33:43.964155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2070 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0
2025-10-02T09:33:43.964309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2070 sessionId: src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0 is DEAD
2025-10-02T09:33:43.964466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:43.964479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Write session will restart in 0.005667s
2025-10-02T09:33:43.964499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Write session: Do CDS request
2025-10-02T09:33:43.964505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:43.971131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.971324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:43.971341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2071
2025-10-02T09:33:43.971463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:43.971496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:43.971507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:43.971511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:43.971864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2071 sessionId:  describe result for acl check
2025-10-02T09:33:43.971905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:43.971910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:43.971911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:43.971915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555252540733336:5282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:43.972321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:43.972389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555252540733336:5282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:43.974142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555252540733336:5282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:43.974893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:43.974991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:43.974998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:43.975004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:43.975030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:43.975153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555252465174525:3627]
2025-10-02T09:33:43.975489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:43.975662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:43.975687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:43.975862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:43.975893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.975897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.975898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.975898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.975899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.975899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.975900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.975900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.975901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.975901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.975902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.975902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.975905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.975911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.975913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.975915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.975917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.975919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.975921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.975923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.975925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.975927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.975929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.975931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.975935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.975939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:43.975943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.975946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:43.975948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.975950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:43.975952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.975955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:43.975957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.975960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:43.975962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.975964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:43.975966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.975969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:43.975971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.975973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:43.975976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.975979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:43.975981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.975984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.975986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.975988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.975990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.975993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.976008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:43.976394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555252540733336:5282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:43.976404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555252540733336:5282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:43.976406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555252540733336:5282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:43.976411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:43.983397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:43.984791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:43.984816Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:43.984821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:43.984823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:43.984826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2070 [2:7556555252465174525:3627]
2025-10-02T09:33:43.984836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:43.984849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:43.984853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.984855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.984856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.984865Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:43.984871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:43.984875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:43.984908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.984912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.984913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.984915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:43.984917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:43.984952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:43.984957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.984964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:43.984969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:43.984980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:43.984995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733372:5282], now have 1 active actors on pipe
2025-10-02T09:33:43.985001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555252540733221:2446], now have 1 active actors on pipe
2025-10-02T09:33:43.985005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.985009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.985010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.985018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:43.985028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:43.985029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:43.985032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:43.985034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:43.985038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:43.985040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:43.985053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.985057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:43.985046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2070
2025-10-02T09:33:43.985064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2070
2025-10-02T09:33:43.985071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:43.985086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.985088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.985101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:43.985108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:43.985110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:43.985111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:43.985116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:43.985125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:43.985134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.985265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:43.985270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:43.985277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:43.985375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2071 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0
2025-10-02T09:33:43.985622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60331373-f59eed5e-8b5d287c-b16f72d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:43.988217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Write session: try to update token
2025-10-02T09:33:43.988230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:43.994286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:43.994299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:43.994300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:43.994301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:43.994305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.994307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.994309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555252465174520:3627]
2025-10-02T09:33:43.994330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:43.994331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:43.994333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:43.994334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:43.994334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:43.994336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:43.994455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.000616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId: src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.002915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.064553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835700689:5822]
2025-10-02T09:33:44.064720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2070, pipe: [1:7556555256835700689:5822]
2025-10-02T09:33:44.103091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.103466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.103474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.103486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835700689:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.103587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.103813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:44.103877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2071 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0
2025-10-02T09:33:44.104011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2071 sessionId: src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0 is DEAD
2025-10-02T09:33:44.104127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.104160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835700689:5822]
2025-10-02T09:33:44.104187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:44.104201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Write session will restart in 0.006869s
2025-10-02T09:33:44.104223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Write session: Do CDS request
2025-10-02T09:33:44.104229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.112180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.112410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.112421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2072
2025-10-02T09:33:44.112531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.112556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.112563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.112566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.112967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2072 sessionId:  describe result for acl check
2025-10-02T09:33:44.112987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.112991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.112992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.112995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835700831:8768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.113475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835700831:8768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.114675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.114941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.115029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.115035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.115041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.115069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.115091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142015:3581]
2025-10-02T09:33:44.115426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.115471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835700831:8768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.115576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.115599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.115779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.115807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.115812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.115812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.115813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.115814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.115814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.115815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.115815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.115817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.115818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.115819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.115820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.115822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.115829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.115831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.115833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.115835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.115837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.115839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.115841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.115843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.115845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.115847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.115849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.115853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.115857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.115864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.115867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.115869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.115872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.115873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.115876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.115879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.115882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.115885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.115888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.115890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.115893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.115894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.115897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.115901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.115903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.115905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.115908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.115910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.115912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.115914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.115917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.115934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.120711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835700831:8768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.120720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835700831:8768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.120722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835700831:8768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.120726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:44.123328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:44.124752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:44.124764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:44.124765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:44.124767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:44.124771Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2071 [2:7556555256760142015:3581]
2025-10-02T09:33:44.124778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:44.124788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:44.124794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.124795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.124796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.124818Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:44.124824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:44.124828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:44.124860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.124865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.124866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.124868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:44.124869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:44.124908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:44.124915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.124924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.124937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.124954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:44.124973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835700868:8768], now have 1 active actors on pipe
2025-10-02T09:33:44.124979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835700703:2446], now have 1 active actors on pipe
2025-10-02T09:33:44.124983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.124984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.124986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.124983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2071
2025-10-02T09:33:44.124994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:44.124989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2071
2025-10-02T09:33:44.125005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:44.125006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:44.125007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:44.125008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:44.125012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:44.125013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:44.125038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.125043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.125050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.125057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:44.125064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:44.125073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:44.125077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.125079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.125082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:44.125087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.125092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:44.125211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.125337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.125342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.125351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.125416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2072 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0
2025-10-02T09:33:44.125681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c65d205-13a9385c-fcc4d7df-e4eb4bd3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:44.128301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Write session: try to update token
2025-10-02T09:33:44.128313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:44.134106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:44.134119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.134120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:44.134121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:44.134124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.134126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.134128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142010:3581]
2025-10-02T09:33:44.134147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:44.134150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:44.134152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:44.134153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.134154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:44.134155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:44.134264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.140661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId: src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.142855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.204351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835700875:5822]
2025-10-02T09:33:44.204555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2071, pipe: [1:7556555256835700875:5822]
2025-10-02T09:33:44.243326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.243645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.243654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.243667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835700875:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.243798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.243831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.243853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:44.243874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835700875:5822]
2025-10-02T09:33:44.243927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2072 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0
2025-10-02T09:33:44.244094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2072 sessionId: src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0 is DEAD
2025-10-02T09:33:44.244264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:44.244277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Write session will restart in 0.007989s
2025-10-02T09:33:44.244299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Write session: Do CDS request
2025-10-02T09:33:44.244305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.253161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.253232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.253244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2073
2025-10-02T09:33:44.253343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.253368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.253371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.253375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.253753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2073 sessionId:  describe result for acl check
2025-10-02T09:33:44.253783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.253788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.253789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.253792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835700997:8735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.254155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835700997:8735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.254874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.255099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.255195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.255203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.255209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.255235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.255256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142170:3560]
2025-10-02T09:33:44.255600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.255687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835700997:8735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.255756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.255779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.255953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.255983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.255987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.255988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.255989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.255989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.255990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.255990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.255991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.255991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.255992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.255992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.255993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.255995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.256002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.256004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.256006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.256008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.256010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.256012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.256014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.256016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.256018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.256020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.256022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.256026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.256030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.256033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.256036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.256038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.256041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.256043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.256045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.256048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.256050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.256053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.256056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.256058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.256061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.256063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.256066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.256072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.256075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.256077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.256079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.256081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.256084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.256086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.256088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.256107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.259933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835700997:8735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.259944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835700997:8735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.259946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835700997:8735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.259950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:44.263505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:44.265182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:44.265193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:44.265195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:44.265196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:44.265199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2072 [2:7556555256760142170:3560]
2025-10-02T09:33:44.265206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:44.265216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:44.265221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.265223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.265224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.265233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:44.265237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:44.265242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:44.265281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.265287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.265287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.265289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:44.265291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:44.265325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:44.265330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.265337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.265342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.265350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:44.265364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701036:8735], now have 1 active actors on pipe
2025-10-02T09:33:44.265370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835700877:2446], now have 1 active actors on pipe
2025-10-02T09:33:44.265374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.265375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.265376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.265384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:44.265395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:44.265394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:44.265396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:44.265397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:44.265405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:44.265407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:44.265421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.265427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:44.265419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2072
2025-10-02T09:33:44.265432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:44.265429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2072
2025-10-02T09:33:44.265465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.265471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.265485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:44.265493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.265496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.265497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:44.265505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.265515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:44.265532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.265652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.265657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.265664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.265727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2073 partition: 0 MaxSeqNo: 36 sessionId: src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0
2025-10-02T09:33:44.266005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac28b66-c1ad8d0-44d216ee-103789f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:44.268593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Write session: try to update token
2025-10-02T09:33:44.268608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:44.274348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:44.274360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.274362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:44.274362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:44.274366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.274370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.274372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142165:3560]
2025-10-02T09:33:44.274389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:44.274391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:44.274394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:44.274395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.274396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:44.274396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:44.274515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.280825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId: src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.283092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.344120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835701044:5822]
2025-10-02T09:33:44.344307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2072, pipe: [1:7556555256835701044:5822]
2025-10-02T09:33:44.383229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.383648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.383659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.383671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701044:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.383794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.383825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835701044:5822]
2025-10-02T09:33:44.383830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.383931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:44.383940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:44.384015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2073 reason: error at write: Disconnected sessionId: src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0
2025-10-02T09:33:44.384166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2073 sessionId: src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0 is DEAD
2025-10-02T09:33:44.384292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:44.384305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Write session will restart in 0.009808s
2025-10-02T09:33:44.384325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Write session: Do CDS request
2025-10-02T09:33:44.384330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.392047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.394695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.394810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.394818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.394824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.394854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.394878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142330:3545]
2025-10-02T09:33:44.395166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.395237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.395287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.395299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2074
2025-10-02T09:33:44.395417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.395449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.395464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.395477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.395482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.395476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.395665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.395698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.395702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.395703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.395703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.395704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.395704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.395705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.395705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.395706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.395706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.395707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.395707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.395710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.395716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.395718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.395720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.395722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.395724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.395726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.395728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.395730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.395732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.395734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.395736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.395740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.395744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.395747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.395750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.395751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.395754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.395756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.395759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.395761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.395763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.395765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.395768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.395770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.395773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.395775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.395777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.395779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.395782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.395784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.395788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.395793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.395799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.395806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.395811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.395829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.395883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2074 sessionId:  describe result for acl check
2025-10-02T09:33:44.395921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.395929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.395932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.395938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835701169:8732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.396482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835701169:8732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.398584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835701169:8732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.402797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835701169:8732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.402808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835701169:8732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.402810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835701169:8732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.402815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:44.403273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:44.404893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:44.404903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:44.404905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:44.404906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:44.404910Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2073 [2:7556555256760142330:3545]
2025-10-02T09:33:44.404918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:44.404927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:44.404932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.404933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.404934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.404943Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:44.404947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:44.404952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:44.404989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.404996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.404997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.405000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:44.405002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:44.405038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:44.405043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.405049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.405055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.405066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:44.405080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701204:8732], now have 1 active actors on pipe
2025-10-02T09:33:44.405085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701046:2446], now have 1 active actors on pipe
2025-10-02T09:33:44.405089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.405090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.405092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.405098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:44.405109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:44.405110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:44.405112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:44.405113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:44.405119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:44.405120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:44.405119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2073
2025-10-02T09:33:44.405134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.405139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:44.405141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:44.405149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.405154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.405159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2073
2025-10-02T09:33:44.405178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f9de83f-c421a73-80b9a621-cbbff924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:44.405186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.405188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.405189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:44.405193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.405202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:44.405214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.405323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.405330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.405339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.405417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2074 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f9de83f-c421a73-80b9a621-cbbff924_0
2025-10-02T09:33:44.405680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|152bcb80-287ec278-65d722ae-7dd39fcc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f9de83f-c421a73-80b9a621-cbbff924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:44.408207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Write session: try to update token
2025-10-02T09:33:44.408221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:44.414116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:44.414129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.414130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:44.414131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:44.414134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.414136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.414138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142325:3545]
2025-10-02T09:33:44.414156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:44.414157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:44.414159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:44.414161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:44.414163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.414164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:44.414275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.421709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId: src_id|8f9de83f-c421a73-80b9a621-cbbff924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.424206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.483938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835701212:5822]
2025-10-02T09:33:44.484142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2073, pipe: [1:7556555256835701212:5822]
2025-10-02T09:33:44.522799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.522992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.523001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.523014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701212:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.523134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.523215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835701212:5822]
2025-10-02T09:33:44.523239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:44.523242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.523347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2074 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f9de83f-c421a73-80b9a621-cbbff924_0
2025-10-02T09:33:44.523522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2074 sessionId: src_id|8f9de83f-c421a73-80b9a621-cbbff924_0 is DEAD
2025-10-02T09:33:44.523717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:44.523731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Write session will restart in 0.009042s
2025-10-02T09:33:44.523766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Write session: Do CDS request
2025-10-02T09:33:44.523772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.534243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.534366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.534377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2075
2025-10-02T09:33:44.534478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.534502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.534511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.534515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.534549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.534836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.534866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2075 sessionId:  describe result for acl check
2025-10-02T09:33:44.534891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.534898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.534899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.534904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835701334:8722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.534934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.534941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.534946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.534971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.534995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142488:3549]
2025-10-02T09:33:44.535331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835701334:8722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.535352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.535521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.535557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.535748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.535778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.535782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.535782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.535783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.535783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.535785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.535785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.535786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.535786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.535787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.535789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.535796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.535798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.535800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.535802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.535804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.535806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.535809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.535811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.535813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.535815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.535817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.535821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.535826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.535828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.535831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.535833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.535836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.535838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.535841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.535843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.535846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.535847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.535850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.535852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.535855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.535859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.535861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.535863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.535866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.535869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.535871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.535873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.535876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.535878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.535885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.535902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.537182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835701334:8722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.541224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835701334:8722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.541238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835701334:8722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.541241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835701334:8722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.541248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:44.543363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:44.544894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:44.544905Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:44.544907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:44.544909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:44.544912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2074 [2:7556555256760142488:3549]
2025-10-02T09:33:44.544919Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:44.544929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:44.544934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.544936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.544937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.544946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:44.544949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:44.544953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:44.544982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.544986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.544988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.544990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:44.544991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:44.545032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:44.545037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.545043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.545048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.545060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:44.545075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701374:8722], now have 1 active actors on pipe
2025-10-02T09:33:44.545080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701213:2446], now have 1 active actors on pipe
2025-10-02T09:33:44.545084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.545085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.545086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.545094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:44.545104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:44.545104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:44.545106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:44.545107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:44.545115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:44.545117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:44.545131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.545136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:44.545137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:44.545112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2074
2025-10-02T09:33:44.545120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2074
2025-10-02T09:33:44.545149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.545154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.545210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:44.545217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.545219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.545221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:44.545226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.545232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:44.545248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.545361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.545369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.545378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.545442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2075 partition: 0 MaxSeqNo: 36 sessionId: src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0
2025-10-02T09:33:44.545697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9de83f-c421a73-80b9a621-cbbff924_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:44.548265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Write session: try to update token
2025-10-02T09:33:44.548279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:44.554291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:44.554305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.554306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:44.554307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:44.554311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.554313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.554315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142483:3549]
2025-10-02T09:33:44.554334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:44.554335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:44.554338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.554339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:44.554342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:44.554344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:44.554454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.567460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId: src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.569842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.623176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835701381:5822]
2025-10-02T09:33:44.623363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2074, pipe: [1:7556555256835701381:5822]
2025-10-02T09:33:44.664347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.664954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.664966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.664980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701381:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.665153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.665171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:44.665183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:44.665187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.665221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835701381:5822]
2025-10-02T09:33:44.665260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2075 reason: error at write: Disconnected sessionId: src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0
2025-10-02T09:33:44.665448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2075 sessionId: src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0 is DEAD
2025-10-02T09:33:44.665645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:44.665675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Write session will restart in 0.005587s
2025-10-02T09:33:44.665698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Write session: Do CDS request
2025-10-02T09:33:44.665704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.672196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.672336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.672355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2076
2025-10-02T09:33:44.672501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.672535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.672546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.672550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.672946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2076 sessionId:  describe result for acl check
2025-10-02T09:33:44.672978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.672982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.672985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.672988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835701472:8709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.673424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835701472:8709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.674535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.675085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835701472:8709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.679195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.679301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.679308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.679314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.679341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.679363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142649:3547]
2025-10-02T09:33:44.679460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835701472:8709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.679467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835701472:8709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.679469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835701472:8709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.679473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:44.679719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.679908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.679942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.680140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.680173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.680177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.680178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.680179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.680179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.680180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.680180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.680181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.680181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.680182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.680182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.680183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.680186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.680192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.680194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.680196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.680198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.680199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.680201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.680204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.680208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.680211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.680214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.680217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.680223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.680229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.680236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.680239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.680241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.680244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.680246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.680252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.680255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.680258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.680260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.680263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.680267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.680269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.680271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.680274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.680276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.680279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.680283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.680285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.680288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.680290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.680292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.680295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.680313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.689590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:44.691591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:44.691603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:44.691604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:44.691606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:44.691609Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2075 [2:7556555256760142649:3547]
2025-10-02T09:33:44.691616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:44.691625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:44.691627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.691628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.691629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.691638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:44.691642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:44.691646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:44.691674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.691681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.691682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.691683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:44.691685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:44.691728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:44.691733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.691739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.691745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.691752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:44.691767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701538:8709], now have 1 active actors on pipe
2025-10-02T09:33:44.691772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701382:2446], now have 1 active actors on pipe
2025-10-02T09:33:44.691776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.691777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.691778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.691786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:44.691796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:44.691799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:44.691801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:44.691803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:44.691804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:44.691806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:44.691822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.691827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:44.691828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:44.691880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2075
2025-10-02T09:33:44.691921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2075
2025-10-02T09:33:44.691916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.691923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.691938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:44.691941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.691945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.691946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:44.691951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.691956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:44.691969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.692111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.692117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.692126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.692206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2076 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0
2025-10-02T09:33:44.692533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6abb245b-a15ae3bd-f342c409-6c6d70f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:44.695280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Write session: try to update token
2025-10-02T09:33:44.695298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:44.707121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:44.707132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.707137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.707158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:44.707162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:44.707292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:44.707409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:44.707518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:44.707642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:44.707813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:44.707837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:44.709564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId: src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.711953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.712072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.712081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.712093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:44.712159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:44.713885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:44.713898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.713900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:44.713901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:44.713905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.713907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.713909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142643:3547]
2025-10-02T09:33:44.713928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:44.713929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:44.713930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:44.713932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:44.713932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.713934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:44.714039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.765506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835701551:5822]
2025-10-02T09:33:44.765729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2075, pipe: [1:7556555256835701551:5822]
2025-10-02T09:33:44.824812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.831265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.831286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.831409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.831460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.831512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.831564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.831677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.831684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.831737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.831784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.831835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.832088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.832129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.832138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.832187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.832239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.832289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.832371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.832405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.832410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.832459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.832538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.832615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.832666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.832711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.832716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.832767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.832900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.832952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.833001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.833041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.833046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.833096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.833141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.833189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.833240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.833293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.833298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.833347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.833394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.833448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.833500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.833549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.833553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.833602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.833652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.833700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.833747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.833783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.833788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.833833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.833878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.833929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.833978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.834017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.834022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.834069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:33:44.834114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:33:44.834166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:33:44.834215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:33:44.834249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:33:44.834254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:33:44.834283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701551:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.834483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.834483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:44.834486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:44.834509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2076 reason: error at write: Disconnected sessionId: src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0
2025-10-02T09:33:44.834531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835701551:5822]
2025-10-02T09:33:44.834655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.834664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2076 sessionId: src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0 is DEAD
2025-10-02T09:33:44.834821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:44.834832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Write session will restart in 0.006139s
2025-10-02T09:33:44.834854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Write session: Do CDS request
2025-10-02T09:33:44.834859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.842182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.842362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.842372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2077
2025-10-02T09:33:44.842524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.842580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.842593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.842598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.843000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2077 sessionId:  describe result for acl check
2025-10-02T09:33:44.843033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.843039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.843041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.843046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835701678:8683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.843540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835701678:8683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.843778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.846090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835701678:8683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.846659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.846762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.846769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.846775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.846803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.846828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142810:3541]
2025-10-02T09:33:44.847173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.847367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.847393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.847582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.847613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.847617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.847617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.847618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.847618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.847619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.847619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.847620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.847620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.847621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.847622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.847622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.847625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.847632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.847634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.847636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.847638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.847640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.847642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.847644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.847645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.847647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.847649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.847651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.847655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.847659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.847662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.847665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.847667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.847670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.847672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.847675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.847677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.847680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.847682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.847685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.847689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.847691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.847694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.847696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.847698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.847701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.847704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.847706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.847709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.847712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.847718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.847721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.847738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.852966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835701678:8683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.852978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835701678:8683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.852981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835701678:8683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.852989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:44.857379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:44.859087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:44.859100Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:44.859101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:44.859103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:44.859107Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2076 [2:7556555256760142810:3541]
2025-10-02T09:33:44.859114Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:44.859124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:44.859127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.859129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.859130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.859139Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:44.859145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:44.859149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:44.859179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.859184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.859185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.859187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:44.859188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:44.859229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:44.859234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.859241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.859246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.859256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:44.859270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701554:2446], now have 1 active actors on pipe
2025-10-02T09:33:44.859275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701720:8683], now have 1 active actors on pipe
2025-10-02T09:33:44.859278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.859280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.859281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.859289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:44.859299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:44.859300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:44.859302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:44.859304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:44.859308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:44.859310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:44.859308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2076
2025-10-02T09:33:44.859325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.859330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:44.859331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:44.859334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2076
2025-10-02T09:33:44.859348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.859353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.859371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:44.859378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:44.859380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:44.859381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:44.859386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:44.859393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:44.859403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.859504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.859509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.859516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:44.859584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2077 partition: 0 MaxSeqNo: 36 sessionId: src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0
2025-10-02T09:33:44.859925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b7e13c3-fda573e4-8efb059a-a3bdb80e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:44.862702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Write session: try to update token
2025-10-02T09:33:44.862719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:44.870783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:44.870796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:44.870798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:44.870799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:44.870802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.870805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.870807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142804:3541]
2025-10-02T09:33:44.870825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:44.870827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:44.870830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:44.870831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.870832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:44.870833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:44.870953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:44.876108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId: src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:44.878362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:44.934460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555256835701735:5822]
2025-10-02T09:33:44.934652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2076, pipe: [1:7556555256835701735:5822]
2025-10-02T09:33:44.979539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:44.979921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:44.979931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:44.979956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701735:5822], now have 1 active actors on pipe
2025-10-02T09:33:44.980101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:44.980169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555256835701735:5822]
2025-10-02T09:33:44.980199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:44.980201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:44.980257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2077 reason: status is not ok: tablet will be restarted right now sessionId: src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0
2025-10-02T09:33:44.980402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2077 sessionId: src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0 is DEAD
2025-10-02T09:33:44.980556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:44.980572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Write session will restart in 0.007965s
2025-10-02T09:33:44.980595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Write session: Do CDS request
2025-10-02T09:33:44.980601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:44.989166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:44.989230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.989326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:44.989344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2078
2025-10-02T09:33:44.989441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:44.989468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:44.989477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:44.989481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:44.989804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2078 sessionId:  describe result for acl check
2025-10-02T09:33:44.989837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:44.989841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:44.989843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:44.989846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555256835701860:8687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:44.990197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555256835701860:8687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:44.991817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555256835701860:8687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:44.991907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:44.992082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:44.992089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:44.992095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:44.992124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:44.992150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555256760142984:3524]
2025-10-02T09:33:44.992495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:44.992660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:44.992683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:44.992877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:44.992911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.992915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.992916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.992916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.992917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.992918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.992918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.992918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.992919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.992920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.992920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.992921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.992924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.992930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.992932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.992934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.992936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.992938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.992940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.992943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.992945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.992947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.992949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.992951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.992954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.992958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:44.992962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.992965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:44.992967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.992970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:44.992972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.992975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:44.992977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.992980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:44.992982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.992985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:44.992987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.992990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:44.992992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.992995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:44.992999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.993006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:44.993008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.993011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:44.993013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.993016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:44.993021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.993024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:44.993042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:44.998071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555256835701860:8687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:44.998083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555256835701860:8687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:44.998086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555256835701860:8687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:44.998092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.002493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.004219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.004232Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.004233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.004235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.004239Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2077 [2:7556555256760142984:3524]
2025-10-02T09:33:45.004248Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.004258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.004263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.004265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.004266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.004276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.004280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.004285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.004316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.004321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.004322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.004324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.004326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.004368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.004373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.004380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.004385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.004393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.004405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701736:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.004411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555256835701899:8687], now have 1 active actors on pipe
2025-10-02T09:33:45.004415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.004417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.004418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.004426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.004434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.004437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.004442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.004444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.004445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.004447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.004466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.004473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.004444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2077
2025-10-02T09:33:45.004447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2077
2025-10-02T09:33:45.004479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.004482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.004484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.004633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d46e2c3-1565b434-1c110497-42c984ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.004642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.004644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.004645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.004650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.004656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.004670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.004987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.004993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.005002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.005073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2078 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d46e2c3-1565b434-1c110497-42c984ea_0
2025-10-02T09:33:45.005384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|756a5a78-7db280de-e5ea0a5b-739e3806_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d46e2c3-1565b434-1c110497-42c984ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.007999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Write session: try to update token
2025-10-02T09:33:45.008014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.016028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.016042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.016043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.016044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.016048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.016050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.016055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555256760142978:3524]
2025-10-02T09:33:45.016074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.016075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.016077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.016077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.016078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.016079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.016184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.021306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId: src_id|7d46e2c3-1565b434-1c110497-42c984ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.023565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.080387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130669215:5822]
2025-10-02T09:33:45.080624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2077, pipe: [1:7556555261130669215:5822]
2025-10-02T09:33:45.130512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.130706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.130715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.130740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669215:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.130856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.130872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130669215:5822]
2025-10-02T09:33:45.130895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.130915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:45.130965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2078 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d46e2c3-1565b434-1c110497-42c984ea_0
2025-10-02T09:33:45.131096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2078 sessionId: src_id|7d46e2c3-1565b434-1c110497-42c984ea_0 is DEAD
2025-10-02T09:33:45.131235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:45.131248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Write session will restart in 0.006461s
2025-10-02T09:33:45.131270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Write session: Do CDS request
2025-10-02T09:33:45.131275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:45.139183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.139324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:45.139335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2079
2025-10-02T09:33:45.139466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.139488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:45.139494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:45.139497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:45.139762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2079 sessionId:  describe result for acl check
2025-10-02T09:33:45.139787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:45.139792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:45.139794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:45.139798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555261130669356:8656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:45.140127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555261130669356:8656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:45.141369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555261130669356:8656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:45.142435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:45.142738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:45.142840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:45.142847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:45.142854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:45.142881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:45.142903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555261055110474:3506]
2025-10-02T09:33:45.143226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555261130669356:8656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:45.143235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555261130669356:8656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:45.143237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555261130669356:8656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:45.143240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.143246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:45.143405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:45.143435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:45.143619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:45.143648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.143652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.143653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.143653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.143654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.143655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.143655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.143656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.143656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.143657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.143657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.143658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.143661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.143666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.143669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.143670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.143672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.143674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.143676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.143678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.143680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.143682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.143684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.143685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.143689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.143693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.143697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.143699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.143701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.143704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.143706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.143709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.143712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.143714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.143716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.143719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.143721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.143724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.143726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.143729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.143731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.143734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.143736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.143739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.143741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.143743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.143745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.143748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.143764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:45.152942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.154397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.154411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.154412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.154414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.154418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2078 [2:7556555261055110474:3506]
2025-10-02T09:33:45.154424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.154434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.154439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.154440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.154441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.154450Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.154452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.154457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.154492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.154498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.154500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.154502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.154504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.154549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.154556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.154566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.154580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.154592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.154603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669229:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.154608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669396:8656], now have 1 active actors on pipe
2025-10-02T09:33:45.154612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.154613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.154614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.154621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.154632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.154635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.154645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.154647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.154651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.154652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.154630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2078
2025-10-02T09:33:45.154670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.154675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.154677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.154692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.154697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.154682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2078
2025-10-02T09:33:45.154713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.154720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.154723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.154727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.154731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.154737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.154747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.154885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.154893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.154902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.154977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2079 partition: 0 MaxSeqNo: 36 sessionId: src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0
2025-10-02T09:33:45.155267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d46e2c3-1565b434-1c110497-42c984ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.157903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Write session: try to update token
2025-10-02T09:33:45.157919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.165779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.165793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.165795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.165795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.165799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.165801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.165803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555261055110469:3506]
2025-10-02T09:33:45.165822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.165822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.165825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.165826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.165830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.165833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.165935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.170234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId: src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.172369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.230896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130669410:5822]
2025-10-02T09:33:45.231106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2078, pipe: [1:7556555261130669410:5822]
2025-10-02T09:33:45.278051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.278475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.278485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.278510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669410:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.278620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.278662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130669410:5822]
2025-10-02T09:33:45.278664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.278691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:45.278744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2079 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0
2025-10-02T09:33:45.278872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2079 sessionId: src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0 is DEAD
2025-10-02T09:33:45.279025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:45.279040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Write session will restart in 0.006620s
2025-10-02T09:33:45.279061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Write session: Do CDS request
2025-10-02T09:33:45.279065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:45.287195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.287777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:45.287856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:45.287874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2080
2025-10-02T09:33:45.287974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.287999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:45.288009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:45.288012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:45.288335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2080 sessionId:  describe result for acl check
2025-10-02T09:33:45.288364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:45.288370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:45.288372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:45.288376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555261130669539:8628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:45.288811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555261130669539:8628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:45.290553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555261130669539:8628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:45.290990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:45.291091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:45.291098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:45.291104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:45.291130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:45.291152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555261055110645:3498]
2025-10-02T09:33:45.291497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:45.291675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:45.291698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:45.292049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:45.292092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.292097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.292097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.292098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.292098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.292099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.292099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.292100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.292100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.292101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.292101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.292102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.292104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.292111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.292113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.292115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.292117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.292119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.292121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.292123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.292125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.292127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.292129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.292131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.292135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.292139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.292143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.292146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.292148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.292151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.292153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.292156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.292157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.292160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.292162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.292165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.292167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.292170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.292172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.292174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.292176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.292179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.292181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.292184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.292186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.292188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.292190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.292193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.292209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:45.293785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555261130669539:8628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:45.293801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555261130669539:8628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:45.293804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555261130669539:8628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:45.293809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.301005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.302475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.302489Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.302490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.302492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.302496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2079 [2:7556555261055110645:3498]
2025-10-02T09:33:45.302503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.302513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.302516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.302518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.302520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.302532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.302541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.302546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.302577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.302582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.302583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.302586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.302587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.302621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.302626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.302632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.302637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.302653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.302668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669413:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.302673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669577:8628], now have 1 active actors on pipe
2025-10-02T09:33:45.302678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.302682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.302683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.302693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.302703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.302704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.302706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.302707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.302715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.302716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.302730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.302738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.302740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.302727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2079
2025-10-02T09:33:45.302730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2079
2025-10-02T09:33:45.302763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.302768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.302784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|623e5e3e-95880a01-24928479-faf91090_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.302791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.302793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.302794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.302800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.302806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.302815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.302918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.302923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.302930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.303000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2080 partition: 0 MaxSeqNo: 36 sessionId: src_id|623e5e3e-95880a01-24928479-faf91090_0
2025-10-02T09:33:45.303322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6189e73d-5cc35395-4436367f-9bb09c5b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|623e5e3e-95880a01-24928479-faf91090_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.305983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Write session: try to update token
2025-10-02T09:33:45.305998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.311808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.311819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.311820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.311821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.311824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.311828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.311830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555261055110639:3498]
2025-10-02T09:33:45.311849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.311851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.311851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.311852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.311853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.311855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.311959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.318490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId: src_id|623e5e3e-95880a01-24928479-faf91090_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.320647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.378862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130669586:5822]
2025-10-02T09:33:45.379015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2079, pipe: [1:7556555261130669586:5822]
2025-10-02T09:33:45.421210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.421750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.421760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.421773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669586:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.421903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.421990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.422046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130669586:5822]
2025-10-02T09:33:45.422055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:45.422140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2080 reason: status is not ok: tablet will be restarted right now sessionId: src_id|623e5e3e-95880a01-24928479-faf91090_0
2025-10-02T09:33:45.422300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2080 sessionId: src_id|623e5e3e-95880a01-24928479-faf91090_0 is DEAD
2025-10-02T09:33:45.422462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:45.422477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Write session will restart in 0.009236s
2025-10-02T09:33:45.422504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Write session: Do CDS request
2025-10-02T09:33:45.422511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:45.430846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:45.433200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.433292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:45.433312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2081
2025-10-02T09:33:45.433409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.433435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:45.433444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:45.433448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:45.433603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:45.433711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:45.433717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:45.433723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:45.433750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:45.433773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555261055110811:3497]
2025-10-02T09:33:45.433772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2081 sessionId:  describe result for acl check
2025-10-02T09:33:45.433801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:45.433806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:45.433808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:45.433812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555261130669715:8616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:45.434117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:45.434223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555261130669715:8616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:45.434272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:45.434294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:45.434468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:45.434496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.434500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.434500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.434501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.434501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.434502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.434503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.434503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.434503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.434504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.434505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.434505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.434508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.434514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.434516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.434519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.434521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.434523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.434524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.434526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.434529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.434531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.434533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.434534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.434538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.434542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.434545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.434548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.434550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.434553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.434555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.434558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.434560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.434563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.434565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.434567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.434571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.434574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.434576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.434579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.434581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.434584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.434587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.434589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.434591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.434594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.434596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.434599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.434615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:45.435887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555261130669715:8616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:45.440903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555261130669715:8616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:45.440916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555261130669715:8616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:45.440918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555261130669715:8616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:45.440925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.443357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.445080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.445092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.445093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.445095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.445098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2080 [2:7556555261055110811:3497]
2025-10-02T09:33:45.445107Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.445116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.445119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.445121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.445122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.445130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.445133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.445137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.445169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.445175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.445176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.445178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.445179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.445214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.445219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.445226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.445231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.445241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.445252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669753:8616], now have 1 active actors on pipe
2025-10-02T09:33:45.445258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669587:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.445262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.445263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.445264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.445271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.445279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.445280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.445282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.445282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.445289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.445292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.445306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.445313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.445307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2080
2025-10-02T09:33:45.445317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.445318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2080
2025-10-02T09:33:45.445358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.445363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.445378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.445385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.445387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.445388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.445394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.445401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.445411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.445520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.445525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.445533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.445598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2081 partition: 0 MaxSeqNo: 36 sessionId: src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0
2025-10-02T09:33:45.445853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623e5e3e-95880a01-24928479-faf91090_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.448496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Write session: try to update token
2025-10-02T09:33:45.448510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.454782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.454794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.454795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.454796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.454799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.454801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.454803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555261055110805:3497]
2025-10-02T09:33:45.454824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.454830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.454832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.454834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.454838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.454840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.454951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.460835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId: src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.463007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.522234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130669760:5822]
2025-10-02T09:33:45.522436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2080, pipe: [1:7556555261130669760:5822]
2025-10-02T09:33:45.566513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.566949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.566960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.566973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669760:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.567121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.567179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130669760:5822]
2025-10-02T09:33:45.567204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.567209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:45.567298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2081 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0
2025-10-02T09:33:45.567463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2081 sessionId: src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0 is DEAD
2025-10-02T09:33:45.567613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:45.567628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Write session will restart in 0.008071s
2025-10-02T09:33:45.567648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Write session: Do CDS request
2025-10-02T09:33:45.567653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:45.577155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.577278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:45.577291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2082
2025-10-02T09:33:45.577381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.577406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:45.577415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:45.577418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:45.577769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2082 sessionId:  describe result for acl check
2025-10-02T09:33:45.577804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:45.577811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:45.577813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:45.577817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555261130669889:8614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:45.578232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555261130669889:8614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:45.579483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:45.579730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:45.579852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:45.579859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:45.579865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:45.579894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:45.579918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555261055110977:3495]
2025-10-02T09:33:45.580113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555261130669889:8614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:45.580295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:45.580464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:45.580492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:45.580698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:45.580732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.580736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.580737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.580738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.580738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.580739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.580739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.580740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.580740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.580741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.580742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.580742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.580745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.580752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.580754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.580756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.580758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.580760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.580764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.580766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.580768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.580770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.580772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.580776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.580780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.580783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.580786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.580788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.580791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.580793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.580796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.580798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.580814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.580820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.580823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.580826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.580829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.580831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.580834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.580838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.580847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.580854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.580859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.580865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.580868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.580870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.580873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.580894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:45.581407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555261130669889:8614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:45.581419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555261130669889:8614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:45.581423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555261130669889:8614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:45.581430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.589510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.591253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.591266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.591267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.591269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.591272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2081 [2:7556555261055110977:3495]
2025-10-02T09:33:45.591280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.591292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.591298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.591300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.591302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.591314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.591320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.591325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.591358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.591362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.591364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.591366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.591367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.591404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.591408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.591415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.591420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.591428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.591442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669933:8614], now have 1 active actors on pipe
2025-10-02T09:33:45.591448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669762:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.591451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.591453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.591454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.591461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.591470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.591472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.591475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.591478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.591480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.591482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.591494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.591503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.591493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2081
2025-10-02T09:33:45.591493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2081
2025-10-02T09:33:45.591514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.591528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.591533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.591550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.591557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.591558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.591559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.591564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.591569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.591579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.591703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.591711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.591720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.591788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2082 partition: 0 MaxSeqNo: 36 sessionId: src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0
2025-10-02T09:33:45.592032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18b4c2a-b7793953-f32aac15-37abe36d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.594697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Write session: try to update token
2025-10-02T09:33:45.594713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.600975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.600987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.600988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.600989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.600992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.600995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.600997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555261055110972:3495]
2025-10-02T09:33:45.601020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.601021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.601024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.601027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.601028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.601029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.601159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.607159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId: src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.609394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.667141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130669945:5822]
2025-10-02T09:33:45.667334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2081, pipe: [1:7556555261130669945:5822]
2025-10-02T09:33:45.713332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.713737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.713747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.713760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669945:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.713880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.713919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:45.713929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.713934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:45.713963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130669945:5822]
2025-10-02T09:33:45.714014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2082 reason: error at write: Disconnected sessionId: src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0
2025-10-02T09:33:45.714170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2082 sessionId: src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0 is DEAD
2025-10-02T09:33:45.714422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:45.714445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Write session will restart in 0.007689s
2025-10-02T09:33:45.714469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Write session: Do CDS request
2025-10-02T09:33:45.714474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:45.722864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:45.723175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.723288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:45.723303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2083
2025-10-02T09:33:45.723408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.723433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:45.723441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:45.723444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:45.723843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2083 sessionId:  describe result for acl check
2025-10-02T09:33:45.723868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:45.723874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:45.723875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:45.723879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555261130670075:8594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:45.724301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555261130670075:8594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:45.725809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:45.725914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:45.725921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:45.725927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:45.725955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:45.725977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555261055111144:3485]
2025-10-02T09:33:45.726154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555261130670075:8594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:45.726334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:45.726546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:45.726569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:45.726757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:45.726786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.726790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.726791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.726791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.726792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.726792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.726793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.726794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.726794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.726795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.726796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.726796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.726799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.726806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.726808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.726810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.726812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.726814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.726816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.726818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.726820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.726822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.726824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.726826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.726830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.726834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.726837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.726840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.726843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.726845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.726847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.726850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.726853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.726855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.726858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.726861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.726863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.726866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.726868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.726871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.726873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.726876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.726878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.726881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.726884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.726887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.726889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.726895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.726914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:45.731769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555261130670075:8594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:45.731780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555261130670075:8594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:45.731782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555261130670075:8594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:45.731788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.735925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.737659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.737672Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.737673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.737676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.737679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2082 [2:7556555261055111144:3485]
2025-10-02T09:33:45.737688Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.737699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.737704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.737706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.737707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.737717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.737721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.737725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.737757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.737762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.737763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.737765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.737767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.737806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.737811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.737817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.737822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.737830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.737847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130670113:8594], now have 1 active actors on pipe
2025-10-02T09:33:45.737853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130669946:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.737857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.737858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.737860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.737868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.737879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.737884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.737886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.737888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.737890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.737891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.737907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.737912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.737916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.737904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2082
2025-10-02T09:33:45.737935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.737940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.737930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2082
2025-10-02T09:33:45.737954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cab88a58-81a35ada-8155bd39-2127d5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.737962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.737964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.737965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.737970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.737979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.737988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.738093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.738098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.738105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.738170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2083 partition: 0 MaxSeqNo: 36 sessionId: src_id|cab88a58-81a35ada-8155bd39-2127d5c_0
2025-10-02T09:33:45.738481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e97e06-248e4912-9de0a566-f17b0ba1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cab88a58-81a35ada-8155bd39-2127d5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.741094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Write session: try to update token
2025-10-02T09:33:45.741108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.747569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.747584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.747585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.747586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.747590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.747592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.747596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555261055111138:3485]
2025-10-02T09:33:45.747615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.747621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.747622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.747623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.747624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.747628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.747737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.753457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId: src_id|cab88a58-81a35ada-8155bd39-2127d5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.755645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.814085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130670122:5822]
2025-10-02T09:33:45.814295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2082, pipe: [1:7556555261130670122:5822]
2025-10-02T09:33:45.857306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.857692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.857703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.857715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130670122:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.857850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.857897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130670122:5822]
2025-10-02T09:33:45.857903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:45.857922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.857970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2083 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cab88a58-81a35ada-8155bd39-2127d5c_0
2025-10-02T09:33:45.858142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2083 sessionId: src_id|cab88a58-81a35ada-8155bd39-2127d5c_0 is DEAD
2025-10-02T09:33:45.858302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:45.858314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Write session will restart in 0.008813s
2025-10-02T09:33:45.858337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Write session: Do CDS request
2025-10-02T09:33:45.858342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:45.866096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:45.868184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.868294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:45.868305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2084
2025-10-02T09:33:45.868434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:45.868457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:45.868463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:45.868466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:45.868744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2084 sessionId:  describe result for acl check
2025-10-02T09:33:45.868770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:45.868775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:45.868776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:45.868779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555261130670258:8586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:45.868826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:45.868929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:45.868936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:45.868942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:45.868970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:45.868992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555261055111311:3480]
2025-10-02T09:33:45.869167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555261130670258:8586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:45.869355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:45.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:45.869550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:45.869726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:45.869758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.869762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.869762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.869763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.869763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.869764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.869764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.869765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.869765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.869766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.869767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.869767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.869770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.869777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.869779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.869781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.869783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.869785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.869787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.869789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.869791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.869794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.869796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.869798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.869802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.869806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:45.869809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.869812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:45.869815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.869817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:45.869819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.869825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:45.869828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.869831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:45.869833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.869835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:45.869837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.869840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:45.869842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.869845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:45.869848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.869851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:45.869854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.869856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.869859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.869861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.869865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.869869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.869895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:45.870737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555261130670258:8586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:45.876073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555261130670258:8586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:45.876082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555261130670258:8586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:45.876084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555261130670258:8586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:45.876088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:45.878777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:45.880434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:45.880446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:45.880448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:45.880450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:45.880454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2083 [2:7556555261055111311:3480]
2025-10-02T09:33:45.880460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:45.880469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:45.880475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.880477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.880478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.880487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:45.880492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:45.880496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:45.880525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.880530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.880531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.880532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:45.880534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:45.880568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:45.880574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.880580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:45.880585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:45.880597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:45.880608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130670296:8586], now have 1 active actors on pipe
2025-10-02T09:33:45.880614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130670126:2446], now have 1 active actors on pipe
2025-10-02T09:33:45.880618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.880619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.880620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.880628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:45.880639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:45.880645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:45.880648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:45.880649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:45.880649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:45.880651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:45.880643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2083
2025-10-02T09:33:45.880644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2083
2025-10-02T09:33:45.880664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.880669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:45.880673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:45.880679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.880684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.880708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:45.880715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:45.880717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:45.880718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:45.880723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:45.880728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:45.880737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.880844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.880849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.880856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:45.880907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2084 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0
2025-10-02T09:33:45.881151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab88a58-81a35ada-8155bd39-2127d5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:45.883690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Write session: try to update token
2025-10-02T09:33:45.883704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:45.889775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:45.889788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:45.889789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:45.889790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:45.889794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.889796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.889798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555261055111306:3480]
2025-10-02T09:33:45.889816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:45.889822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:45.889822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:45.889823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:45.889825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:45.889827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:45.889934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:45.895620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId: src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:45.897911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:45.957913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555261130670307:5822]
2025-10-02T09:33:45.958054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2083, pipe: [1:7556555261130670307:5822]
2025-10-02T09:33:45.998887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:45.999308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:45.999319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:45.999332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130670307:5822], now have 1 active actors on pipe
2025-10-02T09:33:45.999477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:45.999546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:45.999553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:45.999587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555261130670307:5822]
2025-10-02T09:33:45.999638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2084 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0
2025-10-02T09:33:45.999808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2084 sessionId: src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0 is DEAD
2025-10-02T09:33:45.999954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:45.999967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Write session will restart in 0.009964s
2025-10-02T09:33:45.999987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Write session: Do CDS request
2025-10-02T09:33:45.999992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.008889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.011193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.011280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.011290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2085
2025-10-02T09:33:46.011402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.011420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.011426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.011429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.011635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.011664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2085 sessionId:  describe result for acl check
2025-10-02T09:33:46.011682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.011686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.011687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.011690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425637748:8576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.011789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.011797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.011804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.011836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.011859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350078788:3478]
2025-10-02T09:33:46.011933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425637748:8576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.012212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.012388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.012412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.012590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.012618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.012622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.012623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.012623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.012624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.012624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.012625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.012625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.012626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.012626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.012627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.012627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.012630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.012636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.012638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.012640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.012642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.012644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.012645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.012647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.012649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.012651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.012653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.012655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.012661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.012665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.012668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.012671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.012673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.012676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.012678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.012680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.012683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.012685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.012687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.012690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.012692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.012695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.012697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.012700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.012702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.012704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.012706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.012708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.012711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.012714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.012716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.012718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.012735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.012783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425637748:8576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.017667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425637748:8576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.017675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425637748:8576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.017677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425637748:8576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.017680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.020431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.022013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.022027Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.022028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.022030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.022034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2084 [2:7556555265350078788:3478]
2025-10-02T09:33:46.022040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.022051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.022055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.022057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.022058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.022067Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.022070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.022073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.022103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.022107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.022108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.022110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.022112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.022149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.022155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.022162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.022167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.022175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.022189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425637786:8576], now have 1 active actors on pipe
2025-10-02T09:33:46.022194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555261130670308:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.022198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.022199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.022201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.022208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.022219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.022218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.022220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.022221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.022229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.022232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.022245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.022250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.022238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2084
2025-10-02T09:33:46.022255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.022239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2084
2025-10-02T09:33:46.022273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.022279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.022293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.022300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.022302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.022303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.022308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.022316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.022326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.022407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.022412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.022419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.022469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2085 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0
2025-10-02T09:33:46.022731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb70d1-28889b94-facf8c9b-e570e347_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.025366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Write session: try to update token
2025-10-02T09:33:46.025381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.031770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:46.031782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.031786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.031807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:46.031809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:46.031938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:46.032056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:46.032169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:46.032364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:46.032534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:46.032559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:46.037883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId: src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.040051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.040708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.040726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.040736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.040738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.040739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.040740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.040744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.040745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.040748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350078782:3478]
2025-10-02T09:33:46.040767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.040772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.040775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.040777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.040777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.040779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.040902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.099727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425637794:5822]
2025-10-02T09:33:46.099895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2084, pipe: [1:7556555265425637794:5822]
2025-10-02T09:33:46.149535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:46.149732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:46.149754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425637794:5822], now have 1 active actors on pipe
2025-10-02T09:33:46.149807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:46.149907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:46.149913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:46.149923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2085 reason: error at write: Disconnected sessionId: src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0
2025-10-02T09:33:46.150024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2085 sessionId: src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0 is DEAD
2025-10-02T09:33:46.150148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425637794:5822]
2025-10-02T09:33:46.150161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:46.150169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:46.150182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Write session will restart in 0.006139s
2025-10-02T09:33:46.150203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Write session: Do CDS request
2025-10-02T09:33:46.150212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.157166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.157307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.157316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2086
2025-10-02T09:33:46.157431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.157450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.157456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.157458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.157733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2086 sessionId:  describe result for acl check
2025-10-02T09:33:46.157750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.157756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.157757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.157760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425637937:8539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.158123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425637937:8539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.159488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425637937:8539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.161762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.161922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425637937:8539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.161932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425637937:8539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.161934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425637937:8539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.161938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.161998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.162103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.162111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.162117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.162143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.162165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350078974:3469]
2025-10-02T09:33:46.162517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.162688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.162712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.162896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.162924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.162929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.162929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.162930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.162931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.162932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.162932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.162933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.162933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.162934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.162934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.162935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.162938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.162944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.162947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.162960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.162963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.162965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.162968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.162970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.162972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.162974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.162976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.162977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.162981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.162985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.162991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.162995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.162997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.162999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.163002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.163008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.163011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.163014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.163017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.163020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.163022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.163025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.163028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.163030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.163032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.163035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.163040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.163043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.163045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.163047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.163050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.163053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.163072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.170461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.171897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.171909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.171910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.171912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.171915Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2085 [2:7556555265350078974:3469]
2025-10-02T09:33:46.171922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.171931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.171934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.171936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.171936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.171945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.171947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.171951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.171983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.171988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.171989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.171990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.171992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.172027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.172032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.172038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.172044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.172053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.172069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425637974:8539], now have 1 active actors on pipe
2025-10-02T09:33:46.172074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425637808:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.172077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.172078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.172079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.172084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.172090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.172094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.172098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.172099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.172101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.172102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.172089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2085
2025-10-02T09:33:46.172113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.172107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2085
2025-10-02T09:33:46.172117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.172118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.172126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.172128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.172153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.172160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.172162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.172163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.172168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.172175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.172185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.172247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.172258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.172271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.172313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2086 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0
2025-10-02T09:33:46.172574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b66f71-27316a45-5df2c976-ab5e4e6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.175148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Write session: try to update token
2025-10-02T09:33:46.175163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.181305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.181315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.181316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.181317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.181320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.181322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.181324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350078967:3469]
2025-10-02T09:33:46.181344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.181346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.181347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.181347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.181358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.181360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.181467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.187548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId: src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.189883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.250308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425637995:5822]
2025-10-02T09:33:46.250522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2085, pipe: [1:7556555265425637995:5822]
2025-10-02T09:33:46.290450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:46.290860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.290869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.290882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425637995:5822], now have 1 active actors on pipe
2025-10-02T09:33:46.291002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:46.291040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:46.291050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425637995:5822]
2025-10-02T09:33:46.291070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:46.291110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2086 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0
2025-10-02T09:33:46.291247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2086 sessionId: src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0 is DEAD
2025-10-02T09:33:46.291410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:46.291426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Write session will restart in 0.005324s
2025-10-02T09:33:46.291446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Write session: Do CDS request
2025-10-02T09:33:46.291452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.298166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.298291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.298309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2087
2025-10-02T09:33:46.298400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.298425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.298435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.298439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.298817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2087 sessionId:  describe result for acl check
2025-10-02T09:33:46.298846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.298851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.298851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.298854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425638129:8523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.299257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425638129:8523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.301607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425638129:8523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.302587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.302839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.302941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.302947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.302953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.302978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.303002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350079167:3453]
2025-10-02T09:33:46.303342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.303494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.303519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.303881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.303890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425638129:8523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.303900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425638129:8523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.303901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425638129:8523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.303905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.303923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.303928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.303928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.303929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.303929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.303930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.303930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.303931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.303931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.303932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.303932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.303933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.303935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.303942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.303944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.303946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.303948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.303950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.303951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.303953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.303955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.303958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.303960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.303961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.303965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.303970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.303973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.303976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.303979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.303981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.303983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.303986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.303988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.303991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.303993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.303997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.303999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.304002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.304004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.304007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.304009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.304011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.304013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.304016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.304018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.304021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.304023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.304026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.304041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.311419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.313093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.313102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.313103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.313105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.313109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2086 [2:7556555265350079167:3453]
2025-10-02T09:33:46.313116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.313125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.313126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.313128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.313129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.313137Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.313140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.313144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.313174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.313179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.313180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.313182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.313184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.313220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.313225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.313232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.313238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.313247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.313260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425637999:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.313265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638169:8523], now have 1 active actors on pipe
2025-10-02T09:33:46.313269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.313271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.313272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.313279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.313289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.313290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.313292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.313293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.313290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2086
2025-10-02T09:33:46.313298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.313301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.313314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.313319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.313321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.313309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2086
2025-10-02T09:33:46.313329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.313333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.313358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.313366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.313368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.313369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.313374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.313381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.313390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.313493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.313499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.313506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.313571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2087 partition: 0 MaxSeqNo: 36 sessionId: src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0
2025-10-02T09:33:46.313839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f3cf5f-f1d1a56f-19bf0904-cbd57676_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.316485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Write session: try to update token
2025-10-02T09:33:46.316502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.322433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.322445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.322447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.322448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.322453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.322456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.322459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350079161:3453]
2025-10-02T09:33:46.322479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.322481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.322482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.322483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.322484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.322485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.322600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.328794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId: src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.331033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.391115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425638178:5822]
2025-10-02T09:33:46.391301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2086, pipe: [1:7556555265425638178:5822]
2025-10-02T09:33:46.430832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:46.431040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.431048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.431061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638178:5822], now have 1 active actors on pipe
2025-10-02T09:33:46.431212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:46.431252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425638178:5822]
2025-10-02T09:33:46.431255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:46.431281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:46.431338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2087 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0
2025-10-02T09:33:46.431474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2087 sessionId: src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0 is DEAD
2025-10-02T09:33:46.431660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:46.431674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Write session will restart in 0.007095s
2025-10-02T09:33:46.431702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Write session: Do CDS request
2025-10-02T09:33:46.431707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.439864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.440195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.440294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.440321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2088
2025-10-02T09:33:46.440409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.440435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.440444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.440448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.440743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2088 sessionId:  describe result for acl check
2025-10-02T09:33:46.440769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.440773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.440774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.440777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425638314:8500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.441150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425638314:8500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.442656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.442761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.442767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.442773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.442801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.442823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350079341:3450]
2025-10-02T09:33:46.442881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425638314:8500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.443177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.443349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.443375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.443550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.443578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.443582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.443582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.443583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.443583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.443584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.443584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.443585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.443585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.443586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.443586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.443587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.443589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.443595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.443598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.443600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.443601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.443603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.443606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.443607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.443609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.443612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.443613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.443615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.443620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.443624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.443629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.443634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.443638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.443642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.443649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.443654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.443660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.443663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.443667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.443669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.443672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.443674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.443676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.443679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.443683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.443685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.443687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.443690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.443692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.443695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.443698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.443702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.443718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.447558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425638314:8500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.447568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425638314:8500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.447569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425638314:8500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.447573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.451158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.452612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.452622Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.452623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.452625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.452628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2087 [2:7556555265350079341:3450]
2025-10-02T09:33:46.452823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.452836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.452837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.452839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.452840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.452849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.452854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.452858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.452889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.452893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.452895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.452897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.452898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.452934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.452939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.452945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.452951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.452960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.452974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638352:8500], now have 1 active actors on pipe
2025-10-02T09:33:46.452979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638180:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.452983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.452985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.452986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.452993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.453005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.453010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.453013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.453014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.453015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.453016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.453017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2087
2025-10-02T09:33:46.453031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.453036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.453043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.453050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.453052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.453053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2087
2025-10-02T09:33:46.453072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.453080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.453082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.453084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.453090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.453095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.453108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.453249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.453254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.453262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.453329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2088 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0
2025-10-02T09:33:46.453634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49c80c9-62647752-2f4cb019-c94f81a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.456314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Write session: try to update token
2025-10-02T09:33:46.456330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.462164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.462174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.462176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.462176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.462180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.462182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.462184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350079335:3450]
2025-10-02T09:33:46.462204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.462206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.462208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.462210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.462213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.462215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.462316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.468951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId: src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.471187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.531400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425638360:5822]
2025-10-02T09:33:46.531623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2087, pipe: [1:7556555265425638360:5822]
2025-10-02T09:33:46.572931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:46.573155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.573164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.573177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638360:5822], now have 1 active actors on pipe
2025-10-02T09:33:46.573337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:46.573364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:46.573413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:46.573413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425638360:5822]
2025-10-02T09:33:46.573469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2088 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0
2025-10-02T09:33:46.573590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2088 sessionId: src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0 is DEAD
2025-10-02T09:33:46.573732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:46.573748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Write session will restart in 0.009977s
2025-10-02T09:33:46.573773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Write session: Do CDS request
2025-10-02T09:33:46.573780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.582797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.585235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.585286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.585296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2089
2025-10-02T09:33:46.585466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.585494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.585501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.585504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.585568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.585665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.585671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.585677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.585701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.585722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350079514:3448]
2025-10-02T09:33:46.585776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2089 sessionId:  describe result for acl check
2025-10-02T09:33:46.585801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.585806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.585806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.585809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425638500:8485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.586059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.586141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425638500:8485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.586237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.586258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.586438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.586482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.586486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.586487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.586487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.586488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.586489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.586489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.586490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.586490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.586491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.586491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.586492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.586495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.586501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.586503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.586505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.586507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.586509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.586511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.586513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.586515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.586517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.586519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.586521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.586524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.586528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.586531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.586534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.586536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.586539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.586541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.586543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.586546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.586548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.586550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.586553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.586555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.586558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.586560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.586563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.586565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.586571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.586573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.586576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.586579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.586583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.586586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.586592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.586607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.587509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425638500:8485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.591835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425638500:8485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.591842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425638500:8485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.591844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425638500:8485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.591848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.594040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.595516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.595526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.595527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.595529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.595533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2088 [2:7556555265350079514:3448]
2025-10-02T09:33:46.595539Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.595549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.595554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.595555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.595556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.595564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.595567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.595572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.595604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.595608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.595609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.595611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.595612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.595653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.595659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.595670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.595683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.595701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.595715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638364:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.595721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638539:8485], now have 1 active actors on pipe
2025-10-02T09:33:46.595724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.595730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.595721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2088
2025-10-02T09:33:46.595731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.595730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2088
2025-10-02T09:33:46.595739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.595749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.595749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.595752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.595753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.595760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.595761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.595782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.595787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.595797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.595804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.595812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.595819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.595823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.595825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.595826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.595831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.595837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.595853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.595960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.595965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.595972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.596021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2089 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0
2025-10-02T09:33:46.596266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5cb3b40-5202cad6-d1f141e6-6ebaca7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.606545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Write session: try to update token
2025-10-02T09:33:46.606565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.607130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.607148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.607149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.607150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.607153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.607156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.607158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350079508:3448]
2025-10-02T09:33:46.607174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.607177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.607178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.607186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.607192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.607196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.607292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.620558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId: src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.630488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.673745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425638546:5822]
2025-10-02T09:33:46.673980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2088, pipe: [1:7556555265425638546:5822]
2025-10-02T09:33:46.717251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:46.717782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.717792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.717804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638546:5822], now have 1 active actors on pipe
2025-10-02T09:33:46.717984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:46.718028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425638546:5822]
2025-10-02T09:33:46.718028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:46.718034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:46.718104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2089 reason: error at write: Disconnected sessionId: src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0
2025-10-02T09:33:46.718121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:46.718275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2089 sessionId: src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0 is DEAD
2025-10-02T09:33:46.718415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:46.718428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Write session will restart in 0.009146s
2025-10-02T09:33:46.718449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Write session: Do CDS request
2025-10-02T09:33:46.718454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.727462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.728199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.728311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.728326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2090
2025-10-02T09:33:46.728434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.728461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.728470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.728473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.728822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2090 sessionId:  describe result for acl check
2025-10-02T09:33:46.728853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.728858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.728860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.728863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425638683:8471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.729270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425638683:8471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.730214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.730315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.730321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.730327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.730353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.730380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350079688:3446]
2025-10-02T09:33:46.730733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.730925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.730948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.731126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.731153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425638683:8471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.731162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.731166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.731167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.731167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.731168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.731168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.731169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.731169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.731170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.731170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.731171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.731171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.731174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.731181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.731183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.731185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.731187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.731189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.731191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.731193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.731195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.731198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.731200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.731202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.731206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.731209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.731212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.731215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.731217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.731220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.731223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.731225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.731228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.731230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.731232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.731236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.731238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.731240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.731242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.731245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.731252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.731255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.731257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.731260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.731262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.731266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.731271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.731273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.731290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.736123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425638683:8471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.736132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425638683:8471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.736135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425638683:8471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.736138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.738800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.740296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.740307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.740308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.740310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.740313Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2089 [2:7556555265350079688:3446]
2025-10-02T09:33:46.740320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.740330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.740331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.740333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.740334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.740343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.740349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.740355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.740384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.740388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.740389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.740391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.740392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.740510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2089
2025-10-02T09:33:46.740528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2089
2025-10-02T09:33:46.740621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.740626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.740633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.740638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.740647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.740661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638721:8471], now have 1 active actors on pipe
2025-10-02T09:33:46.740665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638547:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.740676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.740681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.740692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.740696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.740698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.740705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.740716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.740720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.740722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.740723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.740726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.740728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.740737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.740742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.740744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.740745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.740750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.740758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.740792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.740811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.740813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.740822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.740923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.740929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.740937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.741001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2090 partition: 0 MaxSeqNo: 36 sessionId: src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0
2025-10-02T09:33:46.741273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3956c3a-12394a69-5eaa3387-f475ee57_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.743953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Write session: try to update token
2025-10-02T09:33:46.743970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.749795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:46.749804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.749808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.749828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:46.749834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:46.749976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:46.750098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:46.750226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:46.750379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:46.750591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:46.750615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:46.756896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId: src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.758210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.758221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.758225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.758226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.758231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.758234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.758237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350079682:3446]
2025-10-02T09:33:46.758257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.758258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.758261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.758263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.758263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.758264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.758371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.762744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.818092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425638730:5822]
2025-10-02T09:33:46.818284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2089, pipe: [1:7556555265425638730:5822]
2025-10-02T09:33:46.869091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:46.869540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.869550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.869564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638730:5822], now have 1 active actors on pipe
2025-10-02T09:33:46.869721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:46.869818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:46.869823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:46.869864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425638730:5822]
2025-10-02T09:33:46.869908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2090 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0
2025-10-02T09:33:46.870067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2090 sessionId: src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0 is DEAD
2025-10-02T09:33:46.870222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:46.870239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Write session will restart in 0.005441s
2025-10-02T09:33:46.870268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Write session: Do CDS request
2025-10-02T09:33:46.870274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:46.877153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.877223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:46.877233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2091
2025-10-02T09:33:46.877367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:46.877394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:46.877406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:46.877410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:46.877787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2091 sessionId:  describe result for acl check
2025-10-02T09:33:46.877824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:46.877830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:46.877832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:46.877836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555265425638847:8466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:46.878284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555265425638847:8466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:46.880274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555265425638847:8466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:46.882174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:46.882427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:46.882523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:46.882529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:46.882535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:46.882523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555265425638847:8466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:46.882534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555265425638847:8466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:46.882536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555265425638847:8466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:46.882540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:46.882559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:46.882586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555265350079863:3444]
2025-10-02T09:33:46.882951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:46.883109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:46.883133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:46.883309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:46.883340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.883345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.883346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.883347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.883348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.883350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.883351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.883352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.883353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.883354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.883358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.883367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.883370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.883372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.883374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.883376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.883378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.883381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.883384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.883389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.883392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.883395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.883402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.883408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:46.883412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.883418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:46.883422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.883430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:46.883434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.883440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:46.883443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.883446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:46.883448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.883450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:46.883454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.883457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:46.883459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.883462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:46.883464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.883466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:46.883468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.883471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.883473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.883476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.883479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.883482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.883499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:46.890934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:46.892489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:46.892500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:46.892501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:46.892503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:46.892507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2090 [2:7556555265350079863:3444]
2025-10-02T09:33:46.892515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:46.892524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:46.892529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.892531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.892532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.892541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:46.892544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:46.892549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:46.892589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.892595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.892597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.892599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:46.892600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:46.892639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:46.892644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.892651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:46.892657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:46.892667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:46.892681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638736:2446], now have 1 active actors on pipe
2025-10-02T09:33:46.892686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638908:8466], now have 1 active actors on pipe
2025-10-02T09:33:46.892689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.892691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.892692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.892695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:46.892703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:46.892703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:46.892705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:46.892706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:46.892713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:46.892715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:46.892729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.892734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:46.892738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:46.892761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.892766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.892738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2090
2025-10-02T09:33:46.892779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|debf5708-f547850b-437977f8-4f8c4710_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:46.892787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:46.892789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:46.892751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2090
2025-10-02T09:33:46.892790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:46.892795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:46.892818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:46.892832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.892953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:46.892958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:46.892966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:46.893032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2091 partition: 0 MaxSeqNo: 36 sessionId: src_id|debf5708-f547850b-437977f8-4f8c4710_0
2025-10-02T09:33:46.893278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3667e87-8b50bb6c-cb6f3d35-7ba54b9f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|debf5708-f547850b-437977f8-4f8c4710_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:46.896177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Write session: try to update token
2025-10-02T09:33:46.896191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:46.901944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:46.901953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:46.901954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:46.901955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:46.901958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.901960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.901962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555265350079858:3444]
2025-10-02T09:33:46.901982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:46.901982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:46.901984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:46.901987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:46.901988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:46.901989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:46.902099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:46.909018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId: src_id|debf5708-f547850b-437977f8-4f8c4710_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:46.911117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:46.970179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555265425638924:5822]
2025-10-02T09:33:46.970411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2090, pipe: [1:7556555265425638924:5822]
2025-10-02T09:33:47.017521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.017705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.017714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.017728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555265425638924:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.017842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.017877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.017880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:47.017884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:47.017922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555265425638924:5822]
2025-10-02T09:33:47.017937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2091 reason: error at write: Disconnected sessionId: src_id|debf5708-f547850b-437977f8-4f8c4710_0
2025-10-02T09:33:47.018103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2091 sessionId: src_id|debf5708-f547850b-437977f8-4f8c4710_0 is DEAD
2025-10-02T09:33:47.018263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:47.018276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Write session will restart in 0.007896s
2025-10-02T09:33:47.018297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Write session: Do CDS request
2025-10-02T09:33:47.018302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.027169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.027281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.027294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2092
2025-10-02T09:33:47.027412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.027438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.027449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.027452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.027805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2092 sessionId:  describe result for acl check
2025-10-02T09:33:47.027846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.027852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.027854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.027858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720606370:8451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.028311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720606370:8451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.029871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.029983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720606370:8451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.030140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.030246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.030253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.030258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.030286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.030317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645047346:3438]
2025-10-02T09:33:47.030692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.030860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.030884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.031071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.031105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.031109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.031110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.031110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.031111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.031111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.031112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.031112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.031113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.031113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.031114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.031114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.031117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.031123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.031125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.031128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.031129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.031132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.031134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.031135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.031138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.031140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.031142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.031144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.031147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.031152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.031155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.031158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.031160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.031162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.031165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.031167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.031169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.031172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.031174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.031177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.031179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.031182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.031184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.031187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.031189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.031191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.031193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.031196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.031198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.031201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.031203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.031206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.031225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.035123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720606370:8451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.035135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720606370:8451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.035137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720606370:8451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.035141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.038813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.040291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.040303Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.040305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.040307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.040311Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2091 [2:7556555269645047346:3438]
2025-10-02T09:33:47.040319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.040328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.040332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.040334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.040335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.040344Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.040351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.040355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.040475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.040480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.040481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.040484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.040485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.040524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.040530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.040539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.040552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.040566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.040581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606410:8451], now have 1 active actors on pipe
2025-10-02T09:33:47.040586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606233:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.040590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.040591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.040592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.040603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.040596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2091
2025-10-02T09:33:47.040613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.040621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.040625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.040629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.040631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.040632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.040619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2091
2025-10-02T09:33:47.040648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.040653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.040661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.040668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.040674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.040684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2dbccd6-424e2cab-c3609957-315aac69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.040691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.040693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.040694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.040700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.040708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.040719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.040840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.040847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.040856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.040931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2092 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2dbccd6-424e2cab-c3609957-315aac69_0
2025-10-02T09:33:47.041194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|debf5708-f547850b-437977f8-4f8c4710_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2dbccd6-424e2cab-c3609957-315aac69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.043831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Write session: try to update token
2025-10-02T09:33:47.043848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.049769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.049779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.049780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.049780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.049784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.049786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.049788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645047341:3438]
2025-10-02T09:33:47.049808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.049809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.049812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.049814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.049814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.049816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.049940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.056268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId: src_id|e2dbccd6-424e2cab-c3609957-315aac69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.058406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.118129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720606418:5822]
2025-10-02T09:33:47.118303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2091, pipe: [1:7556555269720606418:5822]
2025-10-02T09:33:47.160631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.161144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.161156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.161169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606418:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.161364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720606418:5822]
2025-10-02T09:33:47.161375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:47.161379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:47.161391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.161448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2092 reason: error at write: Disconnected sessionId: src_id|e2dbccd6-424e2cab-c3609957-315aac69_0
2025-10-02T09:33:47.161600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2092 sessionId: src_id|e2dbccd6-424e2cab-c3609957-315aac69_0 is DEAD
2025-10-02T09:33:47.161713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.161731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:47.161743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Write session will restart in 0.006927s
2025-10-02T09:33:47.161767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Write session: Do CDS request
2025-10-02T09:33:47.161772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.170152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.170256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.170271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2093
2025-10-02T09:33:47.170371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.170396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.170406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.170409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.170751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2093 sessionId:  describe result for acl check
2025-10-02T09:33:47.170783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.170793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.170795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.170800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720606556:8424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.171237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720606556:8424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.172995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720606556:8424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.173482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.173730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.173926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.173933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.173939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.173970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.173995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645047538:3430]
2025-10-02T09:33:47.174336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.174492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.174515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.174726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.174765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.174768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.174769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.174770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.174770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.174771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.174772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.174772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.174773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.174773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.174774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.174774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.174777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.174783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.174785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.174787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.174789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.174791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.174794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.174796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.174798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.174800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.174802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.174804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.174809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.174813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.174816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.174819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.174821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.174824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.174826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.174829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.174831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.174835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.174837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.174840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.174845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.174848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.174851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.174857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.174839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720606556:8424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.174859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.174862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.174864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.174867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.174854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720606556:8424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.174869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.174856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720606556:8424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.174861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.174872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.174877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.174880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.174896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.182232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.183740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.183750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.183751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.183754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.183757Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2092 [2:7556555269645047538:3430]
2025-10-02T09:33:47.183764Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.183774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.183775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.183777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.183778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.183787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.183793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.183797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.183827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.183831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.183832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.183834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.183835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.183869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.183874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.183880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.183886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.183897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.183910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606419:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.183915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606598:8424], now have 1 active actors on pipe
2025-10-02T09:33:47.183919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.183920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.183922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.183929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.183940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.183941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.183943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.183946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.183950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.183936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2092
2025-10-02T09:33:47.183952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.183969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.183965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2092
2025-10-02T09:33:47.183976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.183977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.183993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.183998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.184013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.184019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.184021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.184022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.184027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.184035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.184046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.184152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.184157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.184164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.184235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2093 partition: 0 MaxSeqNo: 36 sessionId: src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0
2025-10-02T09:33:47.184502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dbccd6-424e2cab-c3609957-315aac69_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.187036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Write session: try to update token
2025-10-02T09:33:47.187050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.193169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.193178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.193179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.193180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.193183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.193185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.193187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645047533:3430]
2025-10-02T09:33:47.193205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.193208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.193209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.193215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.193219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.193220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.193328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.199206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId: src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.201357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.261472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720606629:5822]
2025-10-02T09:33:47.261669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2092, pipe: [1:7556555269720606629:5822]
2025-10-02T09:33:47.303615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.303907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.303915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.303928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606629:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.304079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.304089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720606629:5822]
2025-10-02T09:33:47.304130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:47.304211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2093 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0
2025-10-02T09:33:47.304379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2093 sessionId: src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0 is DEAD
2025-10-02T09:33:47.304405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.304526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:47.304541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Write session will restart in 0.008697s
2025-10-02T09:33:47.304561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Write session: Do CDS request
2025-10-02T09:33:47.304565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.313437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.314151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.314249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.314267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2094
2025-10-02T09:33:47.314362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.314387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.314397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.314401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.314705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2094 sessionId:  describe result for acl check
2025-10-02T09:33:47.314732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.314736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.314737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.314740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720606770:8398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.315081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720606770:8398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.316095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.316248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.316257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.316267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.316302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.316327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645047741:3410]
2025-10-02T09:33:47.316679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.316865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.316892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.317086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.317123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.317123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.317124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.317124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.317125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.317125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.317126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.317126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.317127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.317127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.317128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.317131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.317137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.317139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.317141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.317143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.317145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.317147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.317149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.317151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.317153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.317155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.317157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.317160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.317164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.317168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.317171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.317173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.317176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.317178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.317181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.317183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.317186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.317188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.317191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.317193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.317196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.317198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.317201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.317203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.317206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.317208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.317211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.317213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.317216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.317218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.317221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.317238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.317327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720606770:8398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.322914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720606770:8398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.322925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720606770:8398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.322927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720606770:8398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.322961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.324579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.326236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.326249Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.326251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.326253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.326257Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2093 [2:7556555269645047741:3410]
2025-10-02T09:33:47.326265Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.326274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.326279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.326281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.326282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.326290Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.326293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.326297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.326327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.326333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.326334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.326336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.326337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.326373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.326378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.326384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.326390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.326401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.326415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606630:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.326420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606808:8398], now have 1 active actors on pipe
2025-10-02T09:33:47.326424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.326425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.326426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.326434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.326443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.326445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.326448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.326450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.326454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.326456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.326457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2093
2025-10-02T09:33:47.326468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.326473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.326479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.326494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.326501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.326520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5203b71d-d5e44f42-269b055a-7a66b707_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.326526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.326528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.326530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.326535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.326543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.326553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.326564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2093
2025-10-02T09:33:47.326676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.326683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.326693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.326768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2094 partition: 0 MaxSeqNo: 36 sessionId: src_id|5203b71d-d5e44f42-269b055a-7a66b707_0
2025-10-02T09:33:47.327014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29af8601-9902ce13-a9057bef-c9c0cd33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5203b71d-d5e44f42-269b055a-7a66b707_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.329649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Write session: try to update token
2025-10-02T09:33:47.329662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.335370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.335381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.335382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.335388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.335392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.335394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.335396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645047736:3410]
2025-10-02T09:33:47.335418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.335419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.335422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.335422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.335424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.335424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.335536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.342703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId: src_id|5203b71d-d5e44f42-269b055a-7a66b707_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.344914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.404351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720606815:5822]
2025-10-02T09:33:47.404556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2093, pipe: [1:7556555269720606815:5822]
2025-10-02T09:33:47.446002Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.446428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.446437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.446450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606815:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.446567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.446617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.446630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720606815:5822]
2025-10-02T09:33:47.446665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:47.446767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2094 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5203b71d-d5e44f42-269b055a-7a66b707_0
2025-10-02T09:33:47.446919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2094 sessionId: src_id|5203b71d-d5e44f42-269b055a-7a66b707_0 is DEAD
2025-10-02T09:33:47.447085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:47.447098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Write session will restart in 0.006702s
2025-10-02T09:33:47.447122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Write session: Do CDS request
2025-10-02T09:33:47.447127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.455215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.455347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.455360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2095
2025-10-02T09:33:47.455478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.455510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.455524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.455529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.455600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.455847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2095 sessionId:  describe result for acl check
2025-10-02T09:33:47.455880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.455885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.455886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.455888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720606958:8390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.456235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720606958:8390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.458208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.458238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720606958:8390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.458311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.458318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.458325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.458365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.458391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645047920:3405]
2025-10-02T09:33:47.458753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.458931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.458960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.459152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.459186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.459190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.459190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.459191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.459192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.459192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.459193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.459193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.459194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.459194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.459195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.459195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.459198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.459204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.459206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.459208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.459210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.459212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.459214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.459216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.459218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.459220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.459222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.459224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.459228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.459232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.459235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.459238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.459240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.459243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.459246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.459249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.459251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.459254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.459256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.459259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.459263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.459266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.459268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.459272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.459274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.459277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.459280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.459283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.459286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.459292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.459294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.459297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.459313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.463115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720606958:8390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.463124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720606958:8390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.463125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720606958:8390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.463129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.466696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.468480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.468489Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.468491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.468493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.468496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2094 [2:7556555269645047920:3405]
2025-10-02T09:33:47.468504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.468513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.468518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.468519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.468520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.468529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.468532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.468537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.468575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.468581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.468583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.468586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.468587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.468626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.468631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.468638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.468643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.468651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.468665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606817:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.468670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720606996:8390], now have 1 active actors on pipe
2025-10-02T09:33:47.468675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.468676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.468677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.468684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.468694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.468697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.468698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.468699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.468704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.468705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.468702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2094
2025-10-02T09:33:47.468718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.468723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.468730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.468739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.468740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.468726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2094
2025-10-02T09:33:47.468759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.468766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.468768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.468769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.468775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.468783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.468795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.468939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.468946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.468956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.469024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2095 partition: 0 MaxSeqNo: 36 sessionId: src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0
2025-10-02T09:33:47.469298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5203b71d-d5e44f42-269b055a-7a66b707_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.471927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Write session: try to update token
2025-10-02T09:33:47.471943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.477804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.477816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.477817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.477818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.477821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.477824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.477826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645047914:3405]
2025-10-02T09:33:47.477846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.477847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.477850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.477852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.477852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.477853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.477959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.483995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId: src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.486190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.546703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720607004:5822]
2025-10-02T09:33:47.546952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2094, pipe: [1:7556555269720607004:5822]
2025-10-02T09:33:47.588987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.589197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.589207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.589222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607004:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.589352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.589418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.589424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720607004:5822]
2025-10-02T09:33:47.589448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:47.589528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2095 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0
2025-10-02T09:33:47.589697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2095 sessionId: src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0 is DEAD
2025-10-02T09:33:47.589846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:47.589861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Write session will restart in 0.006121s
2025-10-02T09:33:47.589882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Write session: Do CDS request
2025-10-02T09:33:47.589887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.597145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.597238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.597250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2096
2025-10-02T09:33:47.597348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.597372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.597380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.597383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.597736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2096 sessionId:  describe result for acl check
2025-10-02T09:33:47.597772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.597779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.597780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.597787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720607145:8378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.598203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720607145:8378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.598656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.599945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720607145:8378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.601673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.601853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720607145:8378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.601863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720607145:8378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.601866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720607145:8378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.601870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.601920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.601929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.601938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.601982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.602006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645048099:3400]
2025-10-02T09:33:47.602358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.602525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.602549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.602748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.602784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.602788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.602788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.602789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.602789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.602790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.602790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.602791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.602791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.602792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.602793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.602793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.602796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.602802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.602805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.602807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.602808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.602811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.602813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.602815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.602817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.602819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.602821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.602823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.602826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.602830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.602833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.602836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.602838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.602841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.602843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.602846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.602848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.602853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.602855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.602858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.602861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.602863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.602865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.602868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.602870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.602873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.602876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.602879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.602881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.602885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.602888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.602890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.602910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.610286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.611739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.611750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.611751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.611753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.611757Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2095 [2:7556555269645048099:3400]
2025-10-02T09:33:47.611764Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.611773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.611777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.611779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.611780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.611788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.611791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.611795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.611827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.611832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.611834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.611836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.611837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.611871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.611876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.611883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.611888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.611896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.611911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607006:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.611916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607183:8378], now have 1 active actors on pipe
2025-10-02T09:33:47.611921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.611927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.611928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.611938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.611949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.611953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.611955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.611956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.611961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.611963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.611975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.611980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.611964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2095
2025-10-02T09:33:47.611972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2095
2025-10-02T09:33:47.611993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.612001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.612003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.612017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.612024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.612027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.612028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.612032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.612037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.612047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.612167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.612173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.612184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.612252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2096 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0
2025-10-02T09:33:47.612503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32abee67-a6a8a6df-f6e36073-d3dcb123_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.615154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Write session: try to update token
2025-10-02T09:33:47.615168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.620883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:47.620893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.620898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.620921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:47.620924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:47.621055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:47.621180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:47.621296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:47.621414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:47.621567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:47.621595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:47.628067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId: src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.629427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.629437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.629439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.629440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.629444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.629446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.629448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645048093:3400]
2025-10-02T09:33:47.629467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.629469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.629473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.629472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.629477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.629479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.629590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.630404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.689533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720607194:5822]
2025-10-02T09:33:47.689758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2095, pipe: [1:7556555269720607194:5822]
2025-10-02T09:33:47.738148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.738477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.738487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.738500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607194:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.738675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.738844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.738848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:47.738918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720607194:5822]
2025-10-02T09:33:47.738947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2096 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0
2025-10-02T09:33:47.739102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2096 sessionId: src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0 is DEAD
2025-10-02T09:33:47.739244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:47.739253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Write session will restart in 0.009740s
2025-10-02T09:33:47.739273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Write session: Do CDS request
2025-10-02T09:33:47.739278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.748283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.750144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.750239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.750253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2097
2025-10-02T09:33:47.750360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.750392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.750401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.750404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.750761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2097 sessionId:  describe result for acl check
2025-10-02T09:33:47.750799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.750804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.750806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.750810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720607339:8365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.751137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.751244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720607339:8365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.751253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.751260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.751265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.751296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.751319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645048280:3397]
2025-10-02T09:33:47.751677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.751874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.751904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.752126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.752180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.752186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.752186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.752187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.752188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.752189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.752190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.752191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.752192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.752193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.752194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.752195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.752199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.752209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.752213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.752216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.752219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.752223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.752226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.752230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.752233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.752241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.752248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.752252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.752257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.752265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.752273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.752278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.752285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.752290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.752297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.752302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.752308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.752311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.752316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.752319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.752321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.752324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.752329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.752332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.752336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.752341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.752343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.752346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.752349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.752352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.752357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.752359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.752376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.752912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720607339:8365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.758040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720607339:8365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.758050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720607339:8365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.758053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720607339:8365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.758058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.759736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.761254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.761267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.761268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.761270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.761274Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2096 [2:7556555269645048280:3397]
2025-10-02T09:33:47.761280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.761290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.761291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.761292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.761294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.761303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.761309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.761313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.761341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.761346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.761347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.761349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.761350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.761454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2096
2025-10-02T09:33:47.761466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2096
2025-10-02T09:33:47.761501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.761507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.761514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.761519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.761530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.761545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607378:8365], now have 1 active actors on pipe
2025-10-02T09:33:47.761550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607195:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.761561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.761566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.761576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.761580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.761581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.761589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.761599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.761601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.761603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.761604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.761609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.761611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.761621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.761628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.761630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.761631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.761636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.761644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.761663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.761670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.761676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.761681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.761764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.761769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.761779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.761838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2097 partition: 0 MaxSeqNo: 36 sessionId: src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0
2025-10-02T09:33:47.762104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9f4fbd-23073805-d3be0fb7-40e198a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.764750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Write session: try to update token
2025-10-02T09:33:47.764765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.770674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.770684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.770685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.770688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.770691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.770695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.770696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645048274:3397]
2025-10-02T09:33:47.770714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.770717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.770719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.770720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.770721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.770721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.770826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.776642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId: src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.778682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.839001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720607385:5822]
2025-10-02T09:33:47.839174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2096, pipe: [1:7556555269720607385:5822]
2025-10-02T09:33:47.880482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:47.880871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.880881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.880894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607385:5822], now have 1 active actors on pipe
2025-10-02T09:33:47.881040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:47.881069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:47.881052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:47.881092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720607385:5822]
2025-10-02T09:33:47.881094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2097 reason: error at write: Disconnected sessionId: src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0
2025-10-02T09:33:47.881114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:47.881233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2097 sessionId: src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0 is DEAD
2025-10-02T09:33:47.881422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:47.881434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Write session will restart in 0.007721s
2025-10-02T09:33:47.881458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Write session: Do CDS request
2025-10-02T09:33:47.881464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:47.890175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.890248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:47.890257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2098
2025-10-02T09:33:47.890369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:47.890393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:47.890395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:47.890398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:47.890728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2098 sessionId:  describe result for acl check
2025-10-02T09:33:47.890768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:47.890773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:47.890775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:47.890779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555269720607534:8346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:47.890911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:47.891213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555269720607534:8346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:47.892784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555269720607534:8346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:47.893734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:47.893847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:47.893854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:47.893861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:47.893891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:47.893914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555269645048462:3396]
2025-10-02T09:33:47.894260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:47.894432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:47.894457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:47.894642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:47.894674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.894678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.894679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.894679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.894680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.894680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.894681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.894681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.894682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.894683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.894683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.894684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.894686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.894693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.894695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.894697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.894699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.894701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.894703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.894705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.894707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.894709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.894711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.894713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.894717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.894708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555269720607534:8346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:47.894721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555269720607534:8346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:47.894725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555269720607534:8346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:47.894721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:47.894725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.894727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:47.894730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.894735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:47.894737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.894731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:47.894740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:47.894742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.894745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:47.894746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.894749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:47.894751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.894754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:47.894756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.894759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:47.894761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.894764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:47.894766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.894769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.894771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.894774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.894776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.894779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.894796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:47.902285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:47.903932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:47.903943Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:47.903944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:47.903946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:47.903949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2097 [2:7556555269645048462:3396]
2025-10-02T09:33:47.903955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:47.903965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:47.903967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.903968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.903969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.903978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:47.903981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:47.903985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:47.904014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.904021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.904022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.904024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:47.904026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:47.904060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:47.904061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.904067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:47.904077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:47.904088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:47.904099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607391:2446], now have 1 active actors on pipe
2025-10-02T09:33:47.904105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607572:8346], now have 1 active actors on pipe
2025-10-02T09:33:47.904108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.904110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.904111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.904118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:47.904126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:47.904131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:47.904133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:47.904134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:47.904136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:47.904137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:47.904151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.904156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:47.904136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2097
2025-10-02T09:33:47.904163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:47.904160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2097
2025-10-02T09:33:47.904177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.904182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.904199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:47.904206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:47.904208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:47.904213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:47.904218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:47.904223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:47.904234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.904348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:47.904354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:47.904361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:47.904420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2098 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0
2025-10-02T09:33:47.904708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6651631a-8f9d306c-4f166cd4-c215f98c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:47.907251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Write session: try to update token
2025-10-02T09:33:47.907265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:47.913773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:47.913785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:47.913786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:47.913787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:47.913790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.913793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.913796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555269645048456:3396]
2025-10-02T09:33:47.913818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:47.913822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:47.913825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:47.913825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:47.913827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:47.913827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:47.913953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:47.919303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId: src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:47.921692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:47.981377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555269720607585:5822]
2025-10-02T09:33:47.981585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2097, pipe: [1:7556555269720607585:5822]
2025-10-02T09:33:48.023553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.023846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.023854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.023867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555269720607585:5822], now have 1 active actors on pipe
2025-10-02T09:33:48.023992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.024060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555269720607585:5822]
2025-10-02T09:33:48.024096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.024137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:48.024225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2098 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0
2025-10-02T09:33:48.024380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2098 sessionId: src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0 is DEAD
2025-10-02T09:33:48.024500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:48.024506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Write session will restart in 0.005322s
2025-10-02T09:33:48.024526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Write session: Do CDS request
2025-10-02T09:33:48.024533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.031183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.031331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.031346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2099
2025-10-02T09:33:48.031433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.031464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.031473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.031476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.031898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2099 sessionId:  describe result for acl check
2025-10-02T09:33:48.031933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.031938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.031940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.031944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015575026:8349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.032351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015575026:8349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.033289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.034249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015575026:8349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.036066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.036169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.036176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.036181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.036209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.036232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940015952:3393]
2025-10-02T09:33:48.036306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015575026:8349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.036316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015575026:8349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.036319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015575026:8349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.036323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.036576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.036735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.036757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.036946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.036976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.036980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.036980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.036981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.036981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.036982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.036982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.036983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.036983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.036984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.036985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.036985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.036988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.036994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.036996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.036998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.037000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.037002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.037004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.037006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.037008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.037010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.037012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.037014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.037018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.037022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.037025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.037028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.037030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.037033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.037035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.037038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.037040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.037043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.037045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.037047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.037049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.037052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.037055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.037058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.037060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.037063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.037065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.037069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.037073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.037075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.037077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.037081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.037101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.044469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.046145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.046155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.046157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.046159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.046162Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2098 [2:7556555273940015952:3393]
2025-10-02T09:33:48.046169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.046179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.046184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.046185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.046187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.046195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.046201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.046206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.046239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.046244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.046245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.046247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.046248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.046285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.046289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.046296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.046305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.046316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.046327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575074:8349], now have 1 active actors on pipe
2025-10-02T09:33:48.046331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015574894:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.046335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.046336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.046338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.046346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.046357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.046359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.046361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.046364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.046368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.046369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.046382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.046387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.046373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2098
2025-10-02T09:33:48.046396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.046377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2098
2025-10-02T09:33:48.046516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.046522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.046537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.046545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.046547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.046548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.046553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.046559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.046568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.046708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.046713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.046721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.046789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2099 partition: 0 MaxSeqNo: 36 sessionId: src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0
2025-10-02T09:33:48.047099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c2bc71-1b23c65-d4120ca7-a3303389_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.049878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Write session: try to update token
2025-10-02T09:33:48.049895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.055390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.055400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.055402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.055402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.055406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.055408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.055412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940015946:3393]
2025-10-02T09:33:48.055430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.055432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.055435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.055436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.055437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.055437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.055543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.062910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId: src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.065163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.124214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555274015575086:5822]
2025-10-02T09:33:48.124566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2098, pipe: [1:7556555274015575086:5822]
2025-10-02T09:33:48.164892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.165076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.165085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.165097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575086:5822], now have 1 active actors on pipe
2025-10-02T09:33:48.165264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.165275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:48.165288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:48.165298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015575086:5822]
2025-10-02T09:33:48.165319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.165363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2099 reason: error at write: Disconnected sessionId: src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0
2025-10-02T09:33:48.165515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2099 sessionId: src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0 is DEAD
2025-10-02T09:33:48.165675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:48.165688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Write session will restart in 0.006411s
2025-10-02T09:33:48.165716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Write session: Do CDS request
2025-10-02T09:33:48.165724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.173204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.173251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.173267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2100
2025-10-02T09:33:48.173358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.173381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.173389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.173393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.173780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2100 sessionId:  describe result for acl check
2025-10-02T09:33:48.173811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.173816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.173818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.173822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015575231:8335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.174256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015575231:8335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.176099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015575231:8335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.177134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.177395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.177491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.177498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.177503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.177527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.177551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940016138:3391]
2025-10-02T09:33:48.177821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015575231:8335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.177832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015575231:8335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.177835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015575231:8335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.177839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.177892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.178038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.178060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.178235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.178265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.178269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.178269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.178270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.178270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.178271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.178272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.178272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.178273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.178273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.178274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.178274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.178277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.178283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.178285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.178288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.178290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.178291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.178293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.178295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.178297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.178299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.178301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.178303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.178307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.178311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.178315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.178318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.178321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.178324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.178326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.178329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.178331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.178334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.178336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.178338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.178340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.178343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.178345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.178347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.178350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.178352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.178354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.178357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.178359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.178362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.178364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.178369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.178386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.185740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.187342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.187352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.187353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.187355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.187358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2099 [2:7556555273940016138:3391]
2025-10-02T09:33:48.187366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.187375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.187381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.187382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.187383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.187393Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.187398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.187402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.187429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.187433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.187434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.187436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.187437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.187472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.187476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.187482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.187489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.187497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.187511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575087:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.187516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575268:8335], now have 1 active actors on pipe
2025-10-02T09:33:48.187520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.187522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.187523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.187530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.187540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.187543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.187546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.187548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.187551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.187552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.187565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.187569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.187571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.187575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2099
2025-10-02T09:33:48.187576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2099
2025-10-02T09:33:48.187615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.187620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.187635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.187641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.187643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.187644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.187649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.187655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.187663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.187792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.187797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.187805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.187880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2100 partition: 0 MaxSeqNo: 36 sessionId: src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0
2025-10-02T09:33:48.188152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f2a8b9-792bcbda-2889ed63-b3393af7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.190936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Write session: try to update token
2025-10-02T09:33:48.190953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.196493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.196503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.196505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.196506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.196509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.196511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.196513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940016133:3391]
2025-10-02T09:33:48.196532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.196534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.196536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.196537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.196538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.196538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.196646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.204000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId: src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.206300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.265507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555274015575304:5822]
2025-10-02T09:33:48.265681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2099, pipe: [1:7556555274015575304:5822]
2025-10-02T09:33:48.305821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.306204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.306213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.306225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575304:5822], now have 1 active actors on pipe
2025-10-02T09:33:48.306370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.306393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.306397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:48.306401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:48.306439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015575304:5822]
2025-10-02T09:33:48.306457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2100 reason: error at write: Disconnected sessionId: src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0
2025-10-02T09:33:48.306588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2100 sessionId: src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0 is DEAD
2025-10-02T09:33:48.306759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:48.306772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Write session will restart in 0.007663s
2025-10-02T09:33:48.306796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Write session: Do CDS request
2025-10-02T09:33:48.306802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.315222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.315280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.315296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2101
2025-10-02T09:33:48.315410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.315435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.315439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.315443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.315749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2101 sessionId:  describe result for acl check
2025-10-02T09:33:48.315781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.315787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.315788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.315791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015575450:8311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.316136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015575450:8311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.316223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.318195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015575450:8311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.319040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.319148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.319154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.319160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.319187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.319210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940016360:3368]
2025-10-02T09:33:48.319548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.319723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.319746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.319925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.319957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.319961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.319962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.319962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.319963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.319963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.319964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.319964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.319965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.319965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.319969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.319975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.319977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.319979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.319981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.319983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.319985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.319987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.319989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.319991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.319993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.319995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.319999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.320002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.320006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.320009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.320011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.320014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.320016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.320018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.320021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.320024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.320026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.320028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.320031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.320034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.320036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.320038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.320046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.320048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.320051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.320053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.320055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.320059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.320063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.320065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.320083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.320329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015575450:8311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.320343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015575450:8311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.320345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015575450:8311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.320350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.327453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.329099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.329108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.329110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.329111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.329115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2100 [2:7556555273940016360:3368]
2025-10-02T09:33:48.329121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.329131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.329133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.329134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.329136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.329145Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.329148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.329151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.329182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.329187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.329188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.329190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.329191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.329227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.329231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.329238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.329247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.329258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.329271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575305:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.329277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575491:8311], now have 1 active actors on pipe
2025-10-02T09:33:48.329281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.329285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.329286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.329294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.329304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.329314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.329319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.329323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.329325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.329326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.329338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.329343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.329310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2100
2025-10-02T09:33:48.329350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.329352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.329318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2100
2025-10-02T09:33:48.329354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.329374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.329378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.329380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.329381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.329386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.329395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.329406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.329528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.329533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.329540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.329612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2101 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0
2025-10-02T09:33:48.329881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472a4dcc-c9d91cd9-601e7aef-8df69a0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.332547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Write session: try to update token
2025-10-02T09:33:48.332562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.338330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.338341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.338342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.338343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.338346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.338348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.338350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940016354:3368]
2025-10-02T09:33:48.338368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.338375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.338376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.338381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.338386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.338389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.338488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.344640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId: src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.346871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.406844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555274015575498:5822]
2025-10-02T09:33:48.407067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2100, pipe: [1:7556555274015575498:5822]
2025-10-02T09:33:48.447336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.447538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.447547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.447559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575498:5822], now have 1 active actors on pipe
2025-10-02T09:33:48.447735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.447737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:48.447740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:48.447792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015575498:5822]
2025-10-02T09:33:48.447808Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:33:48.447809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2101 reason: error at write: Disconnected sessionId: src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0
2025-10-02T09:33:48.447887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2101 sessionId: src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0 is DEAD
2025-10-02T09:33:48.447942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.447953Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 21 consumer shared/user session shared/user_1_21_13935209642462837001_v1 is DEAD
2025-10-02T09:33:48.448037Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555213886018197:5826] disconnected; active server actors: 1
2025-10-02T09:33:48.448044Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555213886018197:5826] client user disconnected session shared/user_1_21_13935209642462837001_v1
2025-10-02T09:33:48.448178Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:33:48.448237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:48.448249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Write session will restart in 0.006899s
2025-10-02T09:33:48.448275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Write session: Do CDS request
2025-10-02T09:33:48.448281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.448284Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:48.448288Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:33:48.448296Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006942s
2025-10-02T09:33:48.456095Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:33:48.456239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.456300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.456301Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:33:48.456307Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 22
2025-10-02T09:33:48.456314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2102
2025-10-02T09:33:48.456435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.456470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.456470Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 22 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:48.456478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.456482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.456512Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:33:48.456565Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 auth for : user
2025-10-02T09:33:48.456654Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 Handle describe topics response
2025-10-02T09:33:48.456674Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 auth is DEAD
2025-10-02T09:33:48.456692Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:33:48.456834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2102 sessionId:  describe result for acl check
2025-10-02T09:33:48.456869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.456876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.456878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.456882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015575648:8296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.456964Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:33:48.457042Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_22_16846683044609507210_v1
2025-10-02T09:33:48.457039Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555274015575649:8301] connected; active server actors: 1
2025-10-02T09:33:48.457052Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555274015575649:8301] session shared/user_1_22_16846683044609507210_v1
2025-10-02T09:33:48.457064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:33:48.457075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:33:48.457082Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_22_16846683044609507210_v1" (Sender=[1:7556555274015575612:8301], Pipe=[1:7556555274015575649:8301], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:48.457084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:33:48.457093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:33:48.457099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_22_16846683044609507210_v1" (Sender=[1:7556555274015575612:8301], Pipe=[1:7556555274015575649:8301], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:33:48.457112Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_22_16846683044609507210_v1" sender [1:7556555274015575612:8301] lock partition 0 for ReadingSession "shared/user_1_22_16846683044609507210_v1" (Sender=[1:7556555274015575612:8301], Pipe=[1:7556555274015575649:8301], Partitions=[], ActiveFamilyCount=1) generation 1 step 22
2025-10-02T09:33:48.457119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:33:48.457122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-02T09:33:48.457235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015575648:8296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.457303Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 22 Session: "shared/user_1_22_16846683044609507210_v1" ClientId: "user" PipeClient { RawX1: 7556555274015575649 RawX2: 4503603922346093 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:33:48.457342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:33:48.458093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.459173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015575648:8296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.460894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.461028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.461035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.461041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.461071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.461093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940016546:3366]
2025-10-02T09:33:48.461102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015575648:8296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.461110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015575648:8296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.461112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015575648:8296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.461115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.461433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.461600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.461623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.461794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.461824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.461827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.461828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.461829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.461829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.461830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.461830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.461831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.461831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.461832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.461832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.461833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.461836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.461841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.461843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.461846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.461847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.461850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.461852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.461853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.461855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.461857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.461859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.461861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.461864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.461868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.461871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.461874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.461877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.461879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.461883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.461888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.461891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.461894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.461896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.461898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.461901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.461907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.461909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.461911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.461916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.461920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.461925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.461927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.461929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.461932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.461937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.461939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.461955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.469342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.470954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.470964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.470966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.470967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.470971Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2101 [2:7556555273940016546:3366]
2025-10-02T09:33:48.470977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.470986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.470987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.470989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.470990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.470998Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.471001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.471005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.471039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.471044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.471045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.471047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.471048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.471085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.471090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.471096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.471101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.471112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.471127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575689:8296], now have 1 active actors on pipe
2025-10-02T09:33:48.471132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575500:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.471134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575654:8288], now have 1 active actors on pipe
2025-10-02T09:33:48.471137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.471138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.471140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.471147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.471158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.471163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.471165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.471166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.471168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.471169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.471174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2101
2025-10-02T09:33:48.471187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2101
2025-10-02T09:33:48.471183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.471196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2101, pipe: [1:7556555274015575654:8288]
2025-10-02T09:33:48.471191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.471192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.471209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.471211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.471225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.471226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.471230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_22_16846683044609507210_v1 on pipe: [1:7556555274015575654:8288]
2025-10-02T09:33:48.471248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.471255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.471256Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_22_16846683044609507210_v1:1 with generation 2101
2025-10-02T09:33:48.471258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.471259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.471264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.471269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.471275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.471280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.471280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.471289Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_22_16846683044609507210_v1
2025-10-02T09:33:48.471293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.471305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.471317Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:33:48.471441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.471448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.471459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.471522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2102 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0
2025-10-02T09:33:48.471780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec14638b-e6f1644e-c25a701f-664df9a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.474438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Write session: try to update token
2025-10-02T09:33:48.474454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.474554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:33:48.474571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:33:48.474578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.474583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.474583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.474587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:33:48.474592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:33:48.474703Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397628470 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:33:48.474724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:33:48.474752Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 sending to client partition status
2025-10-02T09:33:48.480117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.480127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.480128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.480131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.480134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.480136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.480138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940016540:3366]
2025-10-02T09:33:48.480156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.480162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.480163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.480166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.480170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.480173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.480274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.487457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId: src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.489708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.590143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.590539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.590549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.590732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_22_16846683044609507210_v1
2025-10-02T09:33:48.590745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.590766Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_22_16846683044609507210_v1
2025-10-02T09:33:48.590780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015575654:8288]
2025-10-02T09:33:48.590781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.590809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:48.590871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0
2025-10-02T09:33:48.591000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2102 sessionId: src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0 is DEAD
2025-10-02T09:33:48.591164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:48.591183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Write session will restart in 0.006563s
2025-10-02T09:33:48.591207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Write session: Do CDS request
2025-10-02T09:33:48.591214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.599237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.599325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.599338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2103
2025-10-02T09:33:48.599459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.599480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.599486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.599489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.599777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2103 sessionId:  describe result for acl check
2025-10-02T09:33:48.599801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.599806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.599807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.599810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015575850:8281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.600170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015575850:8281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.600378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.601956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015575850:8281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.603176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.603271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.603277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.603283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.603310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.603330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940016733:3360]
2025-10-02T09:33:48.603670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.603780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015575850:8281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.603789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015575850:8281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.603790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015575850:8281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.603794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.603822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.603847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.604026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.604056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.604060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.604060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.604061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.604061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.604062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.604062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.604063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.604063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.604064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.604064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.604065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.604068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.604074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.604076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.604078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.604080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.604082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.604084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.604086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.604088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.604091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.604093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.604094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.604099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.604104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.604107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.604109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.604112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.604114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.604117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.604119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.604122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.604124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.604127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.604129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.604132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.604135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.604137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.604139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.604141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.604144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.604146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.604149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.604152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.604154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.604156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.604159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.604175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.611527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.613112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.613123Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.613124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.613126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.613129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2102 [2:7556555273940016733:3360]
2025-10-02T09:33:48.613136Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.613145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.613147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.613149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.613150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.613158Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.613161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.613165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.613197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.613202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.613202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.613204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.613206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.613239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.613244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.613250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.613256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.613267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.613281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575888:8281], now have 1 active actors on pipe
2025-10-02T09:33:48.613287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575703:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.613290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.613292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.613293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.613302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.613312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.613314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.613318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.613319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.613322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.613323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.613337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.613342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.613343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.613354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2102
2025-10-02T09:33:48.613378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2102
2025-10-02T09:33:48.613411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.613417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.613433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.613441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.613446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.613447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.613452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.613457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.613466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.613601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.613606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.613614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.613683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2103 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0
2025-10-02T09:33:48.613973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4dbb0e-258e408f-660fc278-f4682bd5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.616721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Write session: try to update token
2025-10-02T09:33:48.616739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.623954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.623966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.623968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.623969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.623972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.623975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.623976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940016727:3360]
2025-10-02T09:33:48.623995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.623999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.624000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.624000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.624004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.624007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.624126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.637933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId: src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.640228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.691015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555274015575898:8288]
2025-10-02T09:33:48.691259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2102, pipe: [1:7556555274015575898:8288]
2025-10-02T09:33:48.732762Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.733240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.733250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.733263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575898:8288], now have 1 active actors on pipe
2025-10-02T09:33:48.733524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:48.733534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015575898:8288]
2025-10-02T09:33:48.733537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:48.733583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.733596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2103 reason: error at write: Disconnected sessionId: src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0
2025-10-02T09:33:48.733745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2103 sessionId: src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0 is DEAD
2025-10-02T09:33:48.733918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:48.733933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Write session will restart in 0.005386s
2025-10-02T09:33:48.733958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Write session: Do CDS request
2025-10-02T09:33:48.733964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.734246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.740328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.740378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.740395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2104
2025-10-02T09:33:48.740522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.740554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.740564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.740568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.740925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2104 sessionId:  describe result for acl check
2025-10-02T09:33:48.740952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.740957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.740958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.740961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015575926:8275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.741313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015575926:8275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.743119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015575926:8275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.745200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015575926:8275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.745210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015575926:8275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.745212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015575926:8275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.745216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.745208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.749228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.749479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.749487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.749494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.749531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.749558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940016921:3358]
2025-10-02T09:33:48.749894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.750063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.750088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.750265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.750297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.750300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.750301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.750301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.750302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.750302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.750303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.750304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.750304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.750305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.750305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.750306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.750309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.750315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.750317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.750320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.750321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.750324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.750326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.750328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.750329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.750332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.750334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.750336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.750340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.750344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.750347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.750350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.750352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.750355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.750357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.750360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.750362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.750365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.750367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.750369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.750372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.750375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.750380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.750383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.750386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.750389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.750391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.750393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.750395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.750398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.750400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.750402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.750418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.757789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.759466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.759478Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.759479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.759481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.759484Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2103 [2:7556555273940016921:3358]
2025-10-02T09:33:48.759491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.759500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.759502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.759503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.759504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.759514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.759520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.759525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.759553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.759558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.759559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.759561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.759563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.759599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.759605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.759611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.759616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.759625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.759636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015576082:8275], now have 1 active actors on pipe
2025-10-02T09:33:48.759638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015575899:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.759642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.759643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.759644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.759652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.759662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.759664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.759667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.759668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.759674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.759675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.759688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.759695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.759699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.759697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2103
2025-10-02T09:33:48.759699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2103
2025-10-02T09:33:48.759748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.759754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.759768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.759775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.759777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.759778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.759783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.759788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.759798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.759912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.759917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.759924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.759989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2104 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0
2025-10-02T09:33:48.760292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1882cc-ac220550-bdace485-4b7cdd85_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.763064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Write session: try to update token
2025-10-02T09:33:48.763082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.768694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:48.768704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.768708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.768727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:48.768728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:48.768875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:48.768985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:48.769092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:48.769201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:48.769363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:48.769387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:48.776584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId: src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.776969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.776979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.776980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.776980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.776984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.776986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.776988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940016914:3358]
2025-10-02T09:33:48.777004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.777006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.777007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.777008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.777010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.777012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.777122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.778773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.833852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555274015576096:8288]
2025-10-02T09:33:48.834056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2103, pipe: [1:7556555274015576096:8288]
2025-10-02T09:33:48.884898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:48.885300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.885309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.885322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015576096:8288], now have 1 active actors on pipe
2025-10-02T09:33:48.885521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:48.885531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015576096:8288]
2025-10-02T09:33:48.885535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:48.885557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:48.885558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:48.885583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2104 reason: error at write: Disconnected sessionId: src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0
2025-10-02T09:33:48.885712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2104 sessionId: src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0 is DEAD
2025-10-02T09:33:48.885903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:48.885917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Write session will restart in 0.008702s
2025-10-02T09:33:48.885945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Write session: Do CDS request
2025-10-02T09:33:48.885951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:48.895438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:48.896340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.896368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:48.896387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2105
2025-10-02T09:33:48.896537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:48.896564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:48.896573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:48.896580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:48.896939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2105 sessionId:  describe result for acl check
2025-10-02T09:33:48.896968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:48.896974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:48.896976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:48.896980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555274015576253:8263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:48.897425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555274015576253:8263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:48.898203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:48.898306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:48.898312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:48.898318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:48.898343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:48.898372Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555273940017108:3356]
2025-10-02T09:33:48.898723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:48.898874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:48.898882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555274015576253:8263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:48.898896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:48.899155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:48.899187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.899191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.899192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.899192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.899193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.899193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.899194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.899194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.899195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.899195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.899196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.899196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.899199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.899206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.899208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.899210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.899212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.899213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.899215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.899217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.899219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.899221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.899223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.899225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.899229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.899233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:48.899236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.899239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:48.899242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.899245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:48.899247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.899250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:48.899252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.899254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:48.899256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.899259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:48.899261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.899263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:48.899266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.899268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:48.899271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.899274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:48.899278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.899280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.899284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.899286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.899289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.899296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.899313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:48.903086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555274015576253:8263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:48.903095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555274015576253:8263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:48.903097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555274015576253:8263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:48.903102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:48.906674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:48.908068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:48.908077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:48.908079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:48.908081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:48.908084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2104 [2:7556555273940017108:3356]
2025-10-02T09:33:48.908094Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:48.908104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:48.908107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.908109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.908110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.908119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:48.908125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:48.908129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:48.908158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.908163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.908164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.908166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:48.908167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:48.908213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:48.908218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.908224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:48.908230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:48.908242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:48.908254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015576102:2446], now have 1 active actors on pipe
2025-10-02T09:33:48.908260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015576292:8263], now have 1 active actors on pipe
2025-10-02T09:33:48.908263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.908264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.908266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.908273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:48.908285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:48.908284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:48.908286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:48.908287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:48.908295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:48.908296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:48.908282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2104
2025-10-02T09:33:48.908304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2104
2025-10-02T09:33:48.908310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.908315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:48.908316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:48.908327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.908332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.908357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:48.908364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:48.908366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:48.908367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:48.908373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:48.908380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:48.908389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.908485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:48.908490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:48.908497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:48.908560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2105 partition: 0 MaxSeqNo: 36 sessionId: src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0
2025-10-02T09:33:48.908890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab1d00e-af5a3ae-24540a81-5c0a8712_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:48.911632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Write session: try to update token
2025-10-02T09:33:48.911648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:48.917416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:48.917427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:48.917428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:48.917429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:48.917432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.917434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.917436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555273940017102:3356]
2025-10-02T09:33:48.917455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:48.917457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:48.917460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:48.917460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:48.917461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:48.917463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:48.917565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:48.925741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId: src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:48.927918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:48.985889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555274015576303:8288]
2025-10-02T09:33:48.986105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2104, pipe: [1:7556555274015576303:8288]
2025-10-02T09:33:49.025933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.026287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.026296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.026308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555274015576303:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.026425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.026502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:49.026508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555274015576303:8288]
2025-10-02T09:33:49.026516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:49.026526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.026562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2105 reason: error at write: Disconnected sessionId: src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0
2025-10-02T09:33:49.026696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2105 sessionId: src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0 is DEAD
2025-10-02T09:33:49.026884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:49.026898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Write session will restart in 0.008363s
2025-10-02T09:33:49.026922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Write session: Do CDS request
2025-10-02T09:33:49.026928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.036196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.036329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.036349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2106
2025-10-02T09:33:49.036461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.036488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.036498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.036501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.036638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.036831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2106 sessionId:  describe result for acl check
2025-10-02T09:33:49.036862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.036867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.036868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.036871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310543764:8243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.037217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310543764:8243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.038658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310543764:8243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.039583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.039686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.039692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.039698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.039723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.039748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234984605:3338]
2025-10-02T09:33:49.040086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.040286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.040308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.040479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.040507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.040511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.040511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.040512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.040512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.040513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.040513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.040514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.040513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310543764:8243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.040514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.040523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310543764:8243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.040515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.040516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.040516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.040519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.040525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.040525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310543764:8243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.040527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.040530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.040529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.040531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.040533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.040535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.040537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.040539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.040541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.040543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.040545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.040549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.040553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.040557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.040560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.040563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.040566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.040568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.040571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.040573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.040576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.040582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.040585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.040587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.040589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.040591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.040596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.040598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.040601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.040604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.040607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.040609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.040612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.040617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.040619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.040636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.048132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.049713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.049723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.049724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.049726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.049730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2105 [2:7556555278234984605:3338]
2025-10-02T09:33:49.049736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.049746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.049747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.049749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.049750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.049758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.049765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.049769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.049795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.049799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.049800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.049803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.049804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.049838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.049842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.049848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.049853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.049862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.049876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310543612:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.049881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310543801:8243], now have 1 active actors on pipe
2025-10-02T09:33:49.049884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.049885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.049886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.049894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.049903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.049908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.049910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.049911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.049913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.049914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.049927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.049932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.049933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.049938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2105
2025-10-02T09:33:49.049973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2105
2025-10-02T09:33:49.049994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.049999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.050015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.050022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.050025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.050026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.050031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.050040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.050048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.050174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.050178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.050185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.050250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2106 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0
2025-10-02T09:33:49.050508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f8bcb4-6c9d96c3-cd53f449-f2731f80_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.053279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Write session: try to update token
2025-10-02T09:33:49.053295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.059080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.059091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.059092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.059093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.059096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.059098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.059101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234984599:3338]
2025-10-02T09:33:49.059119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.059121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.059122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.059122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.059124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.059128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.059227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.067520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId: src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.069656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.126728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310543811:8288]
2025-10-02T09:33:49.126912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2105, pipe: [1:7556555278310543811:8288]
2025-10-02T09:33:49.167605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.167992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.168002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.168013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310543811:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.168151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.168200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.168233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310543811:8288]
2025-10-02T09:33:49.168240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:49.168335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0
2025-10-02T09:33:49.168466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2106 sessionId: src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0 is DEAD
2025-10-02T09:33:49.168569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:49.168632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Write session will restart in 0.008912s
2025-10-02T09:33:49.168675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Write session: Do CDS request
2025-10-02T09:33:49.168682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.178207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.179216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.179316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.179333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2107
2025-10-02T09:33:49.179436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.179463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.179473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.179477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.179842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2107 sessionId:  describe result for acl check
2025-10-02T09:33:49.179870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.179878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.179879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.179884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310543965:8235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.180314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310543965:8235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.181059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.181160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.181166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.181171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.181199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.181223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234984797:3349]
2025-10-02T09:33:49.181563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.181717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.181739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.181916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.181945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.181949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.181950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.181951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.181951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.181952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.181952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.181953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.181953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.181954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.181954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.181955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.181958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.181964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.181967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.181969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.181971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.181973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.181974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.181976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.181979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.181981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.181983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.181985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.181986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310543965:8235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.181988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.181992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.181995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.181998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.182001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.182004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.182006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.182009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.182011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.182013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.182015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.182018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.182020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.182023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.182026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.182028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.182031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.182033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.182035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.182038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.182040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.182043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.182045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.182048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.182068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.186851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310543965:8235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.186861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310543965:8235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.186863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310543965:8235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.186867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.189454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.191092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.191102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.191104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.191105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.191109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2106 [2:7556555278234984797:3349]
2025-10-02T09:33:49.191116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.191126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.191131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.191133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.191134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.191143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.191149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.191153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.191183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.191189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.191190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.191191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.191193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.191232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.191236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.191243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.191248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.191260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.191273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544003:8235], now have 1 active actors on pipe
2025-10-02T09:33:49.191279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310543812:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.191283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.191284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.191285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.191294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.191304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.191306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.191309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.191310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.191315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.191317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.191309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2106
2025-10-02T09:33:49.191330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.191335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.191343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.191351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.191353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.191343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2106
2025-10-02T09:33:49.191372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.191379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.191381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.191382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.191388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.191393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.191403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.191517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.191522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.191530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.191598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2107 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0
2025-10-02T09:33:49.191848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d590314-aa43bf27-c5646fd1-e4b5e19e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.194528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Write session: try to update token
2025-10-02T09:33:49.194544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.200460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.200471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.200472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.200473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.200476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.200478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.200480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234984791:3349]
2025-10-02T09:33:49.200498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.200500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.200500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.200501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.200502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.200504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.200607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.206890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId: src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.209154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.268511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310544036:8288]
2025-10-02T09:33:49.268651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2106, pipe: [1:7556555278310544036:8288]
2025-10-02T09:33:49.309875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.310207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.310216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.310229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544036:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.310366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.310389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.310410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:49.310416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:49.310429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310544036:8288]
2025-10-02T09:33:49.310496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2107 reason: error at write: Disconnected sessionId: src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0
2025-10-02T09:33:49.310686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2107 sessionId: src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0 is DEAD
2025-10-02T09:33:49.310867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:49.310883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Write session will restart in 0.008354s
2025-10-02T09:33:49.310910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Write session: Do CDS request
2025-10-02T09:33:49.310916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.319981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.320201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.320284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.320306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2108
2025-10-02T09:33:49.320402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.320428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.320437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.320441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.321083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2108 sessionId:  describe result for acl check
2025-10-02T09:33:49.321118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.321126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.321127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.321132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310544191:8186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.321560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310544191:8186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.322869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.322973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.322979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.322985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.323012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.323036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234985027:3328]
2025-10-02T09:33:49.323374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.323535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.323557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.323685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310544191:8186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.323730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.323758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.323762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.323763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.323763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.323764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.323765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.323765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.323766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.323766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.323767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.323768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.323768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.323771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.323777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.323779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.323781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.323783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.323785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.323787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.323789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.323791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.323793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.323795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.323797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.323800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.323804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.323807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.323810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.323813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.323816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.323818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.323821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.323823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.323826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.323828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.323830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.323832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.323835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.323837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.323839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.323842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.323845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.323847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.323849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.323851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.323858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.323860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.323863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.323879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.328657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310544191:8186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.328667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310544191:8186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.328669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310544191:8186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.328674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.331301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.332825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.332834Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.332835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.332836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.332840Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2107 [2:7556555278234985027:3328]
2025-10-02T09:33:49.332847Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.332856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.332858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.332859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.332860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.332871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.332877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.332882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.332911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.332915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.332916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.332918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.332919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.332954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.332961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.332967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.332972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.332980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.332990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544230:8186], now have 1 active actors on pipe
2025-10-02T09:33:49.332992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544037:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.332996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.332997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.332998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.333006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.333014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.333019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.333021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.333022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.333026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.333027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.333035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.333040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.333041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.333036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2107
2025-10-02T09:33:49.333070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.333076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.333090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42a245b9-1836fa2e-355f4181-944e21ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.333093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.333095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.333065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2107
2025-10-02T09:33:49.333096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.333101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.333109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.333117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.333237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.333241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.333249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.333321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2108 partition: 0 MaxSeqNo: 36 sessionId: src_id|42a245b9-1836fa2e-355f4181-944e21ef_0
2025-10-02T09:33:49.333605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d81eb06-4667facb-cf09fb73-468bf0c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42a245b9-1836fa2e-355f4181-944e21ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.336277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Write session: try to update token
2025-10-02T09:33:49.336291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.342145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.342156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.342157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.342158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.342162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.342165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.342166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234985021:3328]
2025-10-02T09:33:49.342185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.342189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.342192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.342192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.342193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.342193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.342297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.349415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId: src_id|42a245b9-1836fa2e-355f4181-944e21ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.351671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.410378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310544237:8288]
2025-10-02T09:33:49.410565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2107, pipe: [1:7556555278310544237:8288]
2025-10-02T09:33:49.449289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.449609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.449617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.449629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544237:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.449763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.449803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310544237:8288]
2025-10-02T09:33:49.449820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:49.449825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:49.449829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.449897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2108 reason: error at write: Disconnected sessionId: src_id|42a245b9-1836fa2e-355f4181-944e21ef_0
2025-10-02T09:33:49.450069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2108 sessionId: src_id|42a245b9-1836fa2e-355f4181-944e21ef_0 is DEAD
2025-10-02T09:33:49.450235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:49.450250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Write session will restart in 0.007168s
2025-10-02T09:33:49.450276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Write session: Do CDS request
2025-10-02T09:33:49.450283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.458157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.458240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.458260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2109
2025-10-02T09:33:49.458356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.458383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.458392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.458395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.458884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2109 sessionId:  describe result for acl check
2025-10-02T09:33:49.458918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.458923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.458924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.458927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310544391:8175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.459289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310544391:8175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.461181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310544391:8175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.462545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.462822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.462916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.462922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.462927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.462941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310544391:8175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.462951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310544391:8175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.462953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310544391:8175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.462957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.462951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.462973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234985220:3318]
2025-10-02T09:33:49.463303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.463462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.463483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.463654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.463682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.463686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.463687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.463687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.463688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.463688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.463689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.463689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.463690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.463690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.463691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.463691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.463694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.463700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.463702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.463704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.463706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.463709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.463710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.463712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.463714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.463716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.463718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.463720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.463724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.463728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.463731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.463734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.463736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.463739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.463741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.463744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.463746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.463749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.463751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.463754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.463756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.463759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.463761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.463764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.463767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.463770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.463772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.463775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.463779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.463782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.463784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.463786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.463803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.471211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.472733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.472742Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.472743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.472745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.472749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2108 [2:7556555278234985220:3318]
2025-10-02T09:33:49.472755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.472766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.472771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.472772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.472773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.472782Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.472784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.472789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.472841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.472846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.472847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.472850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.472852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.472887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.472893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.472899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.472904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.472915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.472929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544429:8175], now have 1 active actors on pipe
2025-10-02T09:33:49.472934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544239:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.472937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.472938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.472940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.472947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.472957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.472962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.472965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.472967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.472967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.472968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.472963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2108
2025-10-02T09:33:49.472982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.472987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.472988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.472982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2108
2025-10-02T09:33:49.472996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.472999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.473023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.473029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.473031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.473032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.473037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.473045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.473057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.473179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.473184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.473191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.473260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2109 partition: 0 MaxSeqNo: 36 sessionId: src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0
2025-10-02T09:33:49.473515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a245b9-1836fa2e-355f4181-944e21ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.476162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Write session: try to update token
2025-10-02T09:33:49.476179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.482038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.482048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.482049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.482052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.482055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.482059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.482060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234985215:3318]
2025-10-02T09:33:49.482080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.482082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.482085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.482086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.482087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.482088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.482192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.489004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId: src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.491243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.550142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310544440:8288]
2025-10-02T09:33:49.550376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2108, pipe: [1:7556555278310544440:8288]
2025-10-02T09:33:49.591188Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.591379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.591387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.591399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544440:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.591511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.591560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.591564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310544440:8288]
2025-10-02T09:33:49.591593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:49.591678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0
2025-10-02T09:33:49.591837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2109 sessionId: src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0 is DEAD
2025-10-02T09:33:49.592025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:49.592041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Write session will restart in 0.005290s
2025-10-02T09:33:49.592063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Write session: Do CDS request
2025-10-02T09:33:49.592069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.598139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.598232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.598245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2110
2025-10-02T09:33:49.598355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.598381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.598390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.598393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.598787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2110 sessionId:  describe result for acl check
2025-10-02T09:33:49.598817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.598819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.598820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.598824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310544506:8165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.599260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310544506:8165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.601246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310544506:8165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.602375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.605210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.605314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.605320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.605326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.605354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.605377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234985413:3310]
2025-10-02T09:33:49.605392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310544506:8165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.605402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310544506:8165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.605404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310544506:8165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.605409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.605716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.605881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.605905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.606079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.606107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.606110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.606111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.606112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.606112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.606113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.606113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.606114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.606114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.606115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.606116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.606116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.606119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.606126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.606128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.606130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.606132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.606134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.606136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.606138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.606140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.606142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.606144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.606145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.606150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.606154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.606157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.606160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.606162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.606164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.606166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.606169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.606171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.606178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.606180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.606183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.606185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.606187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.606190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.606192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.606196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.606202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.606204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.606207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.606210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.606213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.606215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.606217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.606232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.613622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.615349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.615360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.615362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.615363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.615367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2109 [2:7556555278234985413:3310]
2025-10-02T09:33:49.615374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.615383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.615388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.615390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.615391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.615400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.615404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.615408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.615438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.615443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.615444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.615446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.615448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.615482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.615487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.615493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.615498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.615506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.615520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544441:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.615525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544633:8165], now have 1 active actors on pipe
2025-10-02T09:33:49.615529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.615530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.615531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.615535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.615542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.615543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.615545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.615547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.615552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.615553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.615566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.615571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.615573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.615555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2109
2025-10-02T09:33:49.615591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2109
2025-10-02T09:33:49.615635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.615640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.615653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.615661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.615663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.615666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.615671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.615676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.615687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.615821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.615826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.615833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.615894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2110 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0
2025-10-02T09:33:49.616157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|534246ae-c0ffb03-c1b88b4b-8e50ad47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.618890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Write session: try to update token
2025-10-02T09:33:49.618906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.624409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:49.624420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.624424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.624443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:49.624446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:49.624591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:49.624713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:49.624869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:49.625012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:49.625176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:49.625197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:49.631508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId: src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.632748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.632760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.632761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.632762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.632765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.632767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.632771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234985407:3310]
2025-10-02T09:33:49.632789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.632791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.632794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.632794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.632795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.632796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.632908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.633781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.691974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310544645:8288]
2025-10-02T09:33:49.692189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2109, pipe: [1:7556555278310544645:8288]
2025-10-02T09:33:49.741953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.742309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.742318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.742330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544645:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.742475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.742512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:49.742526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310544645:8288]
2025-10-02T09:33:49.742526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:49.742550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.742574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2110 reason: error at write: Disconnected sessionId: src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0
2025-10-02T09:33:49.742713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2110 sessionId: src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0 is DEAD
2025-10-02T09:33:49.742813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:49.742876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Write session will restart in 0.006162s
2025-10-02T09:33:49.742900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Write session: Do CDS request
2025-10-02T09:33:49.742905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.750195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.750277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.750295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2111
2025-10-02T09:33:49.750393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.750420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.750429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.750432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.750769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2111 sessionId:  describe result for acl check
2025-10-02T09:33:49.750796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.750801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.750802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.750805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310544789:8144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.751159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310544789:8144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.753027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310544789:8144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.755078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.755249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310544789:8144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.755258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310544789:8144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.755260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310544789:8144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.755264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.755312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.755480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.755488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.755494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.755527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.755559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234985610:3308]
2025-10-02T09:33:49.755911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.756078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.756102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.756292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.756327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.756331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.756332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.756332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.756333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.756333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.756334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.756335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.756335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.756336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.756336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.756337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.756340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.756345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.756348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.756350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.756352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.756354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.756356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.756358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.756360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.756363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.756364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.756366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.756372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.756376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.756379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.756382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.756383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.756387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.756389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.756391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.756394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.756396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.756399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.756401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.756404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.756406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.756408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.756411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.756413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.756416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.756419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.756422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.756424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.756427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.756428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.756431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.756447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.763918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.765331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.765341Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.765342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.765345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.765348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2110 [2:7556555278234985610:3308]
2025-10-02T09:33:49.765355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.765365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.765370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.765372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.765373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.765382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.765386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.765391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.765423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.765428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.765429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.765431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.765432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.765468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.765473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.765479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.765484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.765493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.765507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544649:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.765512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544840:8144], now have 1 active actors on pipe
2025-10-02T09:33:49.765516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.765518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.765519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.765527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.765537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.765541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.765545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.765546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.765548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.765549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.765563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.765568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.765571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.765572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2110
2025-10-02T09:33:49.765576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2110
2025-10-02T09:33:49.765601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.765607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.765625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.765634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.765637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.765642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.765648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.765653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.765662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.765792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.765797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.765805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.765869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2111 partition: 0 MaxSeqNo: 36 sessionId: src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0
2025-10-02T09:33:49.766125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2344af3-7c6d4815-7cfcdc73-f988fe5a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.768765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Write session: try to update token
2025-10-02T09:33:49.768780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.774497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.774507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.774508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.774509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.774513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.774515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.774517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234985604:3308]
2025-10-02T09:33:49.774536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.774538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.774540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.774543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.774543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.774544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.774666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.781574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId: src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.783758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.842500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310544853:8288]
2025-10-02T09:33:49.842702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2110, pipe: [1:7556555278310544853:8288]
2025-10-02T09:33:49.883600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:49.884174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.884187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.884201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544853:8288], now have 1 active actors on pipe
2025-10-02T09:33:49.884415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:49.884399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:49.884422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:49.884427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:49.884462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310544853:8288]
2025-10-02T09:33:49.884486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2111 reason: error at write: Disconnected sessionId: src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0
2025-10-02T09:33:49.884623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2111 sessionId: src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0 is DEAD
2025-10-02T09:33:49.884847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:49.884862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Write session will restart in 0.008558s
2025-10-02T09:33:49.884889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Write session: Do CDS request
2025-10-02T09:33:49.884895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:49.894216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.894324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:49.894342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2112
2025-10-02T09:33:49.894452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:49.894478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:49.894491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:49.894496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:49.894841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2112 sessionId:  describe result for acl check
2025-10-02T09:33:49.894877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:49.894884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:49.894886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:49.894890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555278310545018:8132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:49.894921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:49.895329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555278310545018:8132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:49.896791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555278310545018:8132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:49.897778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:49.897893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:49.897899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:49.897904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:49.897931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:49.897956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555278234985804:3303]
2025-10-02T09:33:49.898312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:49.898488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:49.898514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:49.898714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:49.898746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.898750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.898751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.898751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.898752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.898752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.898753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.898743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555278310545018:8132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:49.898753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.898754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.898758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555278310545018:8132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:49.898754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.898763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555278310545018:8132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:49.898769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:49.898755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.898756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.898758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.898765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.898767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.898769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.898771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.898773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.898775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.898777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.898779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.898781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.898783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.898785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.898789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.898793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:49.898797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.898800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:49.898802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.898805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:49.898807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.898809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:49.898811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.898814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:49.898816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.898818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:49.898821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.898824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:49.898826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.898829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:49.898831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.898834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:49.898836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.898839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.898841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.898844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.898846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.898849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.898868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:49.906225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:49.908821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:49.908829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:49.908830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:49.908832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:49.908836Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2111 [2:7556555278234985804:3303]
2025-10-02T09:33:49.908842Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:49.908851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:49.908853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.908854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.908855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.908863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:49.908868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:49.908871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:49.909024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.909029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.909030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.909032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:49.909033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:49.909070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:49.909074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.909082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:49.909088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:49.909097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:49.909111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310545056:8132], now have 1 active actors on pipe
2025-10-02T09:33:49.909116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310544861:2446], now have 1 active actors on pipe
2025-10-02T09:33:49.909119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.909121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.909122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.909130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:49.909141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:49.909143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:49.909145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:49.909146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:49.909151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:49.909153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:49.909168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.909172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:49.909174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:49.909153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2111
2025-10-02T09:33:49.909154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2111
2025-10-02T09:33:49.909185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.909189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.909214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:49.909222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:49.909223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:49.909224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:49.909229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:49.909235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:49.909245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.909346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:49.909352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:49.909359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:49.909421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2112 partition: 0 MaxSeqNo: 36 sessionId: src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0
2025-10-02T09:33:49.909633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e2a0f8-36cc3c50-67c9fce3-4465656b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:49.912314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Write session: try to update token
2025-10-02T09:33:49.912325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:49.918353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:49.918364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:49.918366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:49.918367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:49.918370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.918374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.918376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555278234985798:3303]
2025-10-02T09:33:49.918396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:49.918397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:49.918399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:49.918402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:49.918404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:49.918405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:49.918517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:49.925916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId: src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:49.928148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:49.984856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555278310545069:8288]
2025-10-02T09:33:49.985111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2111, pipe: [1:7556555278310545069:8288]
2025-10-02T09:33:50.028576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.028963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.028973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.028985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555278310545069:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.029141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.029161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.029164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:50.029168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:50.029204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555278310545069:8288]
2025-10-02T09:33:50.029233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2112 reason: error at write: Disconnected sessionId: src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0
2025-10-02T09:33:50.029395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2112 sessionId: src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0 is DEAD
2025-10-02T09:33:50.029559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:50.029571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Write session will restart in 0.008839s
2025-10-02T09:33:50.029595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Write session: Do CDS request
2025-10-02T09:33:50.029600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.038850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.039238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.039368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.039387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2113
2025-10-02T09:33:50.039497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.039524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.039535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.039539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.039933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2113 sessionId:  describe result for acl check
2025-10-02T09:33:50.039965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.039969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.039970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.039974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605512537:8109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.040325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605512537:8109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.041889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.041995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.042001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.042008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.042034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.042066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529953311:3285]
2025-10-02T09:33:50.042208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605512537:8109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.042404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.042577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.042601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.042800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.042832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.042836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.042837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.042837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.042838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.042838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.042839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.042840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.042840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.042841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.042841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.042842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.042845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.042851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.042853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.042856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.042858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.042860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.042861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.042863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.042865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.042867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.042869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.042871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.042875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.042878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.042882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.042885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.042887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.042890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.042892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.042895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.042897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.042900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.042902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.042904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.042909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.042912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.042914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.042916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.042920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.042923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.042925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.042927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.042929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.042932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.042934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.042936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.042952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.046774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605512537:8109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.046784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605512537:8109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.046786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605512537:8109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.046790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.050374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.052044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.052054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.052055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.052057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.052060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2112 [2:7556555282529953311:3285]
2025-10-02T09:33:50.052067Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.052077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.052078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.052080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.052081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.052089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.052095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.052099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.052130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.052135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.052136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.052138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.052140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.052178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.052184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.052194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.052205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.052222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.052241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512576:8109], now have 1 active actors on pipe
2025-10-02T09:33:50.052248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512378:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.052253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.052259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.052261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.052271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.052285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.052286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.052292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.052293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.052295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.052297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.052294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2112
2025-10-02T09:33:50.052311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.052317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.052318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.052314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2112
2025-10-02T09:33:50.052332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.052336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.052356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.052363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.052366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.052367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.052372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.052380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.052390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.052493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.052498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.052506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.052570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2113 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0
2025-10-02T09:33:50.052902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abdacab-bb604909-68c66364-ed8f4d0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.055557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Write session: try to update token
2025-10-02T09:33:50.055574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.061477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.061488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.061491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.061492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.061495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.061497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.061499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529953303:3285]
2025-10-02T09:33:50.061518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.061521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.061522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.061525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.061530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.061532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.061646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.068912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId: src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.071194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.129165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605512584:8288]
2025-10-02T09:33:50.129338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2112, pipe: [1:7556555282605512584:8288]
2025-10-02T09:33:50.170037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.170364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.170373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.170385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512584:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.170515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.170548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.170554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:50.170558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:50.170588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605512584:8288]
2025-10-02T09:33:50.170627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2113 reason: error at write: Disconnected sessionId: src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0
2025-10-02T09:33:50.170785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2113 sessionId: src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0 is DEAD
2025-10-02T09:33:50.170941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:50.170958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Write session will restart in 0.007203s
2025-10-02T09:33:50.170982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Write session: Do CDS request
2025-10-02T09:33:50.170989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.179133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.179228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.179243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2114
2025-10-02T09:33:50.179431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.179457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.179465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.179469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.179768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2114 sessionId:  describe result for acl check
2025-10-02T09:33:50.179797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.179801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.179804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.179807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605512743:8103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.180148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605512743:8103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.182096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605512743:8103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.183081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.183329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.183427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.183433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.183439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.183465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.183488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529953509:3297]
2025-10-02T09:33:50.183795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605512743:8103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.183804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605512743:8103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.183806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605512743:8103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.183809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.183826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.183980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.184006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.184180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.184210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.184214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.184215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.184215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.184216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.184216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.184217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.184217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.184218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.184218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.184219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.184219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.184222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.184228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.184230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.184232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.184234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.184236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.184238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.184240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.184242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.184245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.184246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.184248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.184252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.184255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.184259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.184261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.184264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.184267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.184269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.184272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.184274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.184277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.184279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.184282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.184285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.184287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.184290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.184292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.184294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.184297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.184299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.184302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.184306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.184310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.184312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.184314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.184333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.191648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.193326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.193336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.193338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.193340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.193343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2113 [2:7556555282529953509:3297]
2025-10-02T09:33:50.193350Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.193360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.193365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.193366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.193367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.193376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.193379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.193382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.193412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.193417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.193418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.193420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.193421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.193456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.193462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.193468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.193473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.193484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.193499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512779:8103], now have 1 active actors on pipe
2025-10-02T09:33:50.193504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512585:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.193507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.193508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.193509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.193518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.193528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.193530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.193531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.193532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.193539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.193540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.193532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2113
2025-10-02T09:33:50.193549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2113
2025-10-02T09:33:50.193553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.193558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.193559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.193567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.193572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.193598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cfaaee5-433777a0-ff1611cc-32940449_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.193605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.193607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.193609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.193613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.193621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.193633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.193738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.193743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.193751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.193816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2114 partition: 0 MaxSeqNo: 36 sessionId: src_id|9cfaaee5-433777a0-ff1611cc-32940449_0
2025-10-02T09:33:50.194053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c4f53-706e8e07-a555c129-8fca2e16_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9cfaaee5-433777a0-ff1611cc-32940449_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.196693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Write session: try to update token
2025-10-02T09:33:50.196707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.202480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.202491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.202492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.202494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.202497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.202500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.202501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529953504:3297]
2025-10-02T09:33:50.202520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.202522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.202524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.202527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.202527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.202528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.202693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.209215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId: src_id|9cfaaee5-433777a0-ff1611cc-32940449_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.211428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.270502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605512806:8288]
2025-10-02T09:33:50.270702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2113, pipe: [1:7556555282605512806:8288]
2025-10-02T09:33:50.313446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.313640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.313648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.313660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512806:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.313771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.313812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605512806:8288]
2025-10-02T09:33:50.313815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:50.313847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.313874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2114 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cfaaee5-433777a0-ff1611cc-32940449_0
2025-10-02T09:33:50.313996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2114 sessionId: src_id|9cfaaee5-433777a0-ff1611cc-32940449_0 is DEAD
2025-10-02T09:33:50.314128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:50.314142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Write session will restart in 0.009633s
2025-10-02T09:33:50.314165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Write session: Do CDS request
2025-10-02T09:33:50.314170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.325166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.325299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.325315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2115
2025-10-02T09:33:50.325724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.325749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.325755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.325759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.326051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2115 sessionId:  describe result for acl check
2025-10-02T09:33:50.326075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.326076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.326077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.326080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605512977:8069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.326407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605512977:8069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.326978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.327210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.327308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.327314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.327320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.327347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.327371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529953746:3261]
2025-10-02T09:33:50.327712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.327885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.327907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.327934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605512977:8069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.328086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.328115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.328119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.328120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.328120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.328121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.328121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.328122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.328123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.328123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.328124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.328125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.328125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.328128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.328134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.328136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.328138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.328140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.328142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.328144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.328146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.328148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.328150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.328153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.328157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.328161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.328167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.328174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.328178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.328182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.328191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.328197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.328200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.328203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.328206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.328208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.328211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.328214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.328217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.328222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.328225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.328228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.328230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.328235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.328238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.328240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.328243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.328247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.328250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.328267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.332233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605512977:8069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.332247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605512977:8069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.332250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605512977:8069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.332256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.335695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.337507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.337517Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.337519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.337521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.337524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2114 [2:7556555282529953746:3261]
2025-10-02T09:33:50.337531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.337541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.337542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.337544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.337545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.337554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.337557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.337561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.337592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.337598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.337599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.337600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.337602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.337635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.337640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.337647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.337652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.337663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.337675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.337680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.337681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.337686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.337694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.337694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.337698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.337699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.337704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.337705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.337711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513016:8069], now have 1 active actors on pipe
2025-10-02T09:33:50.337717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605512816:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.337730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.337736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.337742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.337742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2114
2025-10-02T09:33:50.337752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2114
2025-10-02T09:33:50.337789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.337794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.337807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c705f789-8414d870-58ed6483-6e33f571_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.337814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.337815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.337816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.337821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.337829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.337835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.337955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.337960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.337967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.338030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2115 partition: 0 MaxSeqNo: 36 sessionId: src_id|c705f789-8414d870-58ed6483-6e33f571_0
2025-10-02T09:33:50.338278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cfaaee5-433777a0-ff1611cc-32940449_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c705f789-8414d870-58ed6483-6e33f571_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.340930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Write session: try to update token
2025-10-02T09:33:50.340944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.346737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.346746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.346747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.346748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.346752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.346755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.346757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529953741:3261]
2025-10-02T09:33:50.346770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.346771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.346773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.346774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.346775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.346775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.346933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.353405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId: src_id|c705f789-8414d870-58ed6483-6e33f571_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.355620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.413896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605513027:8288]
2025-10-02T09:33:50.414108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2114, pipe: [1:7556555282605513027:8288]
2025-10-02T09:33:50.456159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.456547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.456557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.456570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513027:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.456696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.456732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605513027:8288]
2025-10-02T09:33:50.456737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:50.456741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:50.456755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.456838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2115 reason: error at write: Disconnected sessionId: src_id|c705f789-8414d870-58ed6483-6e33f571_0
2025-10-02T09:33:50.457023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2115 sessionId: src_id|c705f789-8414d870-58ed6483-6e33f571_0 is DEAD
2025-10-02T09:33:50.457195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:50.457210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Write session will restart in 0.007069s
2025-10-02T09:33:50.457237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Write session: Do CDS request
2025-10-02T09:33:50.457244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.465162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.465257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.465272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2116
2025-10-02T09:33:50.465369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.465394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.465403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.465406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.465747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2116 sessionId:  describe result for acl check
2025-10-02T09:33:50.465773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.465780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.465781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.465785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605513187:8062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.466223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605513187:8062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.466456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.467792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605513187:8062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.469628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.469749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.469755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.469761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.469782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605513187:8062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.469792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605513187:8062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.469787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.469794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605513187:8062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.469798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.469810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529953946:3259]
2025-10-02T09:33:50.470145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.470313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.470337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.470513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.470543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.470546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.470547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.470549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.470550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.470550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.470551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.470551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.470552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.470552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.470553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.470553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.470556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.470562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.470564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.470566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.470568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.470570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.470572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.470574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.470576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.470578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.470580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.470582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.470585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.470589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.470593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.470595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.470598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.470600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.470602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.470605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.470607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.470616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.470619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.470623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.470628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.470639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.470642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.470647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.470650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.470655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.470658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.470660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.470663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.470667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.470670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.470685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.478038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.479634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.479644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.479645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.479647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.479650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2115 [2:7556555282529953946:3259]
2025-10-02T09:33:50.479657Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.479666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.479668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.479669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.479671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.479680Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.479686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.479691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.479722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.479726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.479727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.479729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.479730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.479765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.479770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.479776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.479782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.479793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.479807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513224:8062], now have 1 active actors on pipe
2025-10-02T09:33:50.479812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513028:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.479816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.479817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.479818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.479825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.479835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.479839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.479842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.479843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.479846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.479847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.479860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.479859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2115
2025-10-02T09:33:50.479859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2115
2025-10-02T09:33:50.479868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.479871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.479891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.479895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.479912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.479918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.479920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.479921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.479926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.479933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.479941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.480075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.480079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.480087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.480152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2116 partition: 0 MaxSeqNo: 36 sessionId: src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0
2025-10-02T09:33:50.480381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c705f789-8414d870-58ed6483-6e33f571_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.483062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Write session: try to update token
2025-10-02T09:33:50.483075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.488794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.488816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.488817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.488818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.488821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.488823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.488825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529953941:3259]
2025-10-02T09:33:50.488844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.488846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.488849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.488851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.488852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.488854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.488983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.495748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId: src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.497958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.556734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605513236:8288]
2025-10-02T09:33:50.556967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2115, pipe: [1:7556555282605513236:8288]
2025-10-02T09:33:50.598553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.598930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.598942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.598956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513236:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.599085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.599140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:50.599152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605513236:8288]
2025-10-02T09:33:50.599179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.599208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2116 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0
2025-10-02T09:33:50.599340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2116 sessionId: src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0 is DEAD
2025-10-02T09:33:50.599514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:50.599527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Write session will restart in 0.006239s
2025-10-02T09:33:50.599564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Write session: Do CDS request
2025-10-02T09:33:50.599569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.607276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.607315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.607333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2117
2025-10-02T09:33:50.607478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.607505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.607514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.607517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.607830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2117 sessionId:  describe result for acl check
2025-10-02T09:33:50.607857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.607861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.607862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.607865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605513376:8059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.608215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605513376:8059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.609383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.609982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605513376:8059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.612453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.612560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.612567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.612573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.612602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.612602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605513376:8059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.612612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605513376:8059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.612614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605513376:8059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.612618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.612623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529954146:3253]
2025-10-02T09:33:50.612986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.613175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.613202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.613391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.613423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.613427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.613427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.613428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.613428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.613429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.613429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.613430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.613430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.613431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.613431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.613432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.613435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.613440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.613442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.613444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.613446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.613448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.613450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.613452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.613454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.613456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.613458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.613460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.613463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.613467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.613471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.613474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.613476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.613478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.613481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.613483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.613486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.613488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.613491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.613493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.613496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.613498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.613500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.613504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.613510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.613512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.613515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.613522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.613530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.613539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.613545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.613547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.613565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.620949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.622676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.622687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.622689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.622691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.622694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2116 [2:7556555282529954146:3253]
2025-10-02T09:33:50.622701Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.622711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.622712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.622713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.622714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.622722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.622729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.622732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.622761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.622766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.622767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.622769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.622770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.622804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.622810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.622817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.622822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.622834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.622847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513435:8059], now have 1 active actors on pipe
2025-10-02T09:33:50.622852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513237:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.622856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.622857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.622860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.622867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.622877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.622880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.622883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.622885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.622887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.622888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.622900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.622908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.622900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2116
2025-10-02T09:33:50.622906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2116
2025-10-02T09:33:50.622917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.622941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.622946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.622959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.622966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.622968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.622969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.622973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.622978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.622987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.623406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.623420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.623434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.623518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2117 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0
2025-10-02T09:33:50.623782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65ad56b-e42557ef-48e2982c-e9c77804_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.626481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Write session: try to update token
2025-10-02T09:33:50.626498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.635933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:50.635942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.635948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.635968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:50.635976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:50.636115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:50.636238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:50.636354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:50.636469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:50.636645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:50.636677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:50.640009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.640021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.640022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.640023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.640026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.640028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.640030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529954140:3253]
2025-10-02T09:33:50.640047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.640049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.640051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.640052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.640053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.640054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.640046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId: src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.640199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.642255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.699575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605513447:8288]
2025-10-02T09:33:50.699801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2116, pipe: [1:7556555282605513447:8288]
2025-10-02T09:33:50.751940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.752452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.752461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.752474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513447:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.752651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.752709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605513447:8288]
2025-10-02T09:33:50.752713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.752738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:50.752790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2117 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0
2025-10-02T09:33:50.752940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2117 sessionId: src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0 is DEAD
2025-10-02T09:33:50.753090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:50.753104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Write session will restart in 0.009703s
2025-10-02T09:33:50.753126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Write session: Do CDS request
2025-10-02T09:33:50.753132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.764255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.764414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.764433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2118
2025-10-02T09:33:50.764545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.764571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.764591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.764600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.765033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2118 sessionId:  describe result for acl check
2025-10-02T09:33:50.765071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.765078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.765080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.765084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605513612:8052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.765546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605513612:8052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.766415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.766654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.766753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.766760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.766765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.766792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.766817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529954348:3251]
2025-10-02T09:33:50.767179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605513612:8052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.767173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.767350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.767377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.767561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.767591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.767596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.767597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.767598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.767599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.767600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.767601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.767602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.767602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.767603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.767604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.767605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.767609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.767619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.767622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.767626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.767629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.767633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.767636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.767641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.767643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.767645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.767647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.767649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.767653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.767658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.767663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.767667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.767670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.767672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.767676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.767679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.767681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.767684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.767686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.767688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.767692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.767695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.767698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.767701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.767707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.767710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.767712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.767714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.767716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.767719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.767722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.767725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.767742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.771595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605513612:8052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.771607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605513612:8052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.771610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605513612:8052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.771616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.775175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.776777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.776790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.776791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.776794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.776797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2117 [2:7556555282529954348:3251]
2025-10-02T09:33:50.776822Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.776839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.776841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.776844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.776845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.776854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.776857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.776861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.776892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.776897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.776898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.776900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.776902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.776937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.776942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.776949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.776954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.776964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.776980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513448:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.776985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513651:8052], now have 1 active actors on pipe
2025-10-02T09:33:50.776989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.776991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.776992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.776999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.777010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.777013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.777015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.777016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.777021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.777022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.777036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.777042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.777046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.777029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2117
2025-10-02T09:33:50.777036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2117
2025-10-02T09:33:50.777062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.777067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.777086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.777092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.777094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.777095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.777100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.777105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.777115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.777227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.777234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.777243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.777326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2118 partition: 0 MaxSeqNo: 36 sessionId: src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0
2025-10-02T09:33:50.777633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c97ba05-1a8ac1c1-b08b69ab-5e2fac5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.780286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Write session: try to update token
2025-10-02T09:33:50.780302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.786349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.786360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.786361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.786362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.786366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.786368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.786370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529954343:3251]
2025-10-02T09:33:50.786389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.786392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.786393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.786394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.786397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.786399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.786530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.792783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId: src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.795074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.852664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605513662:8288]
2025-10-02T09:33:50.852904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2117, pipe: [1:7556555282605513662:8288]
2025-10-02T09:33:50.897129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:50.897512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.897524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.897536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513662:8288], now have 1 active actors on pipe
2025-10-02T09:33:50.897693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:50.897730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:50.897767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:50.897768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605513662:8288]
2025-10-02T09:33:50.897825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2118 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0
2025-10-02T09:33:50.897959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2118 sessionId: src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0 is DEAD
2025-10-02T09:33:50.898114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:50.898128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Write session will restart in 0.009695s
2025-10-02T09:33:50.898153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Write session: Do CDS request
2025-10-02T09:33:50.898159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:50.907939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:50.909190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.909305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:50.909325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2119
2025-10-02T09:33:50.909443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:50.909470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:50.909479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:50.909483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:50.909813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2119 sessionId:  describe result for acl check
2025-10-02T09:33:50.909843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:50.909850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:50.909852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:50.909856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555282605513833:8038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:50.910290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555282605513833:8038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:50.910868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:50.910977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:50.910984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:50.910990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:50.911017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:50.911043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555282529954550:3245]
2025-10-02T09:33:50.911381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:50.911545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:50.911567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:50.911740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:50.911769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.911773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.911773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.911774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.911774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.911775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.911776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.911776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.911776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.911777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.911778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.911778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.911781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.911787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.911789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.911791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.911794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.911796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.911798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.911800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.911802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.911805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.911807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.911809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.911812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.911817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:50.911820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.911823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:50.911825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.911828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:50.911830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.911832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:50.911835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.911837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:50.911839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.911842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:50.911844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.911847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:50.911850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.911852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:50.911856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.911858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:50.911860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.911863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.911865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.911867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.911873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.911875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.911892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:50.912039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555282605513833:8038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:50.917651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555282605513833:8038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:50.917663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555282605513833:8038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:50.917666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555282605513833:8038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:50.917672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:50.919283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:50.920822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:50.920831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:50.920832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:50.920834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:50.920838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2118 [2:7556555282529954550:3245]
2025-10-02T09:33:50.920845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:50.920855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:50.920856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.920858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.920859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.920868Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:50.920874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:50.920878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:50.920911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.920915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.920916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.920919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:50.920921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:50.920981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:50.920986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.920993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:50.920999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:50.921010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:50.921025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513871:8038], now have 1 active actors on pipe
2025-10-02T09:33:50.921030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513667:2446], now have 1 active actors on pipe
2025-10-02T09:33:50.921034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.921035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.921036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.921041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:50.921026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2118
2025-10-02T09:33:50.921048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:50.921055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:50.921057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:50.921049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2118
2025-10-02T09:33:50.921058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:50.921059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:50.921061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:50.921085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.921090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.921097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.921105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:50.921121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:50.921121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:50.921128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:50.921130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:50.921131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:50.921136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:50.921141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:50.921151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.921263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:50.921273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:50.921287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:50.921359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2119 partition: 0 MaxSeqNo: 36 sessionId: src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0
2025-10-02T09:33:50.921625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2d293-7f167e84-6ab10b61-59cea77b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:50.924262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Write session: try to update token
2025-10-02T09:33:50.924278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:50.930063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:50.930076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:50.930077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:50.930077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:50.930081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.930084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.930086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555282529954544:3245]
2025-10-02T09:33:50.930105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:50.930106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:50.930109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:50.930112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:50.930113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:50.930118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:50.930246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:50.936936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId: src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:50.939052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:50.998058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555282605513881:8288]
2025-10-02T09:33:50.998277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2118, pipe: [1:7556555282605513881:8288]
2025-10-02T09:33:51.039667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.040100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.040110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.040123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555282605513881:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.040267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.040332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555282605513881:8288]
2025-10-02T09:33:51.040360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.040363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:51.040442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2119 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0
2025-10-02T09:33:51.040590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2119 sessionId: src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0 is DEAD
2025-10-02T09:33:51.040733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:51.040747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Write session will restart in 0.007617s
2025-10-02T09:33:51.040768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Write session: Do CDS request
2025-10-02T09:33:51.040773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.049204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.049261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.049271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2120
2025-10-02T09:33:51.049392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.049415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.049424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.049427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.049758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2120 sessionId:  describe result for acl check
2025-10-02T09:33:51.049783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.049788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.049789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.049797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900481355:8017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.050190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900481355:8017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.050283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.051879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900481355:8017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.053306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.053511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.053519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.053525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.053557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.053581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824922064:3243]
2025-10-02T09:33:51.053755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900481355:8017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.053766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900481355:8017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.053768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900481355:8017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.053773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.053923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.054091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.054115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.054294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.054322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.054326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.054327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.054327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.054328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.054329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.054329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.054330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.054330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.054331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.054331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.054332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.054335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.054342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.054344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.054346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.054348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.054350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.054352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.054354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.054357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.054359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.054361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.054363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.054367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.054370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.054373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.054376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.054379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.054382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.054384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.054386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.054388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.054392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.054394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.054397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.054399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.054402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.054404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.054406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.054408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.054411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.054412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.054415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.054417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.054420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.054422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.054424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.054442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.061805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.063370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.063382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.063385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.063387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.063390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2119 [2:7556555286824922064:3243]
2025-10-02T09:33:51.063396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.063405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.063410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.063411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.063413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.063422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.063424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.063431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.063460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.063465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.063466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.063468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.063469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.063501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.063507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.063513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.063518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.063528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.063546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481392:8017], now have 1 active actors on pipe
2025-10-02T09:33:51.063553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481191:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.063558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.063564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.063565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.063578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.063589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.063600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.063605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.063588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2119
2025-10-02T09:33:51.063604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.063592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2119
2025-10-02T09:33:51.063608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.063609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.063626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.063631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.063641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.063648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.063652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.063663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b07b316-cba45709-11d71508-6222ab0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.063670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.063672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.063673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.063678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.063686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.063701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.063812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.063817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.063825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.063895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2120 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b07b316-cba45709-11d71508-6222ab0b_0
2025-10-02T09:33:51.064128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14ba43c-2a3a41ff-64ca1397-f925c9d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b07b316-cba45709-11d71508-6222ab0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.066737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Write session: try to update token
2025-10-02T09:33:51.066755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.072580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.072592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.072593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.072594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.072598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.072600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.072602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824922058:3243]
2025-10-02T09:33:51.072621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.072624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.072625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.072626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.072630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.072634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.072735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.079315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId: src_id|2b07b316-cba45709-11d71508-6222ab0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.081452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:51.140418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555286900481403:8288]
2025-10-02T09:33:51.140605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2119, pipe: [1:7556555286900481403:8288]
2025-10-02T09:33:51.181434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.181760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.181769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.181782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481403:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.181907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.181953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.181974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:51.182001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555286900481403:8288]
2025-10-02T09:33:51.182039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b07b316-cba45709-11d71508-6222ab0b_0
2025-10-02T09:33:51.182170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2120 sessionId: src_id|2b07b316-cba45709-11d71508-6222ab0b_0 is DEAD
2025-10-02T09:33:51.182309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:51.182324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Write session will restart in 0.007129s
2025-10-02T09:33:51.182344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Write session: Do CDS request
2025-10-02T09:33:51.182348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.190198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.190269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.190281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2121
2025-10-02T09:33:51.190384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.190409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.190417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.190420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.190807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2121 sessionId:  describe result for acl check
2025-10-02T09:33:51.190837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.190842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.190843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.190846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900481569:8007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.191203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900481569:8007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.192601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900481569:8007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.195050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.195175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900481569:8007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.195188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900481569:8007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.195190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900481569:8007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.195194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.195272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.195368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.195375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.195381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.195407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.195431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824922270:3240]
2025-10-02T09:33:51.195768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.195957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.195979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.196151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.196182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.196185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.196186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.196187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.196187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.196188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.196188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.196189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.196189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.196190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.196190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.196191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.196194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.196200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.196202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.196204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.196206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.196208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.196210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.196212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.196214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.196216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.196217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.196219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.196224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.196228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.196231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.196234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.196236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.196239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.196241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.196243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.196245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.196248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.196250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.196253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.196255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.196257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.196259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.196263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.196266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.196269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.196271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.196273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.196275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.196278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.196280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.196282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.196298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.203654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.205278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.205290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.205292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.205293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.205297Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2120 [2:7556555286824922270:3240]
2025-10-02T09:33:51.205303Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.205313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.205315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.205316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.205317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.205326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.205329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.205333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.205366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.205371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.205372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.205374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.205375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.205409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.205414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.205420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.205425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.205434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.205447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481607:8007], now have 1 active actors on pipe
2025-10-02T09:33:51.205453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481405:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.205457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.205460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.205462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.205469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.205480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.205483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.205485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.205486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.205491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.205492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.205505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.205513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.205510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2120
2025-10-02T09:33:51.205526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.205514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2120
2025-10-02T09:33:51.205561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.205566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.205579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f133b7b-f836c626-6fc25061-6144708_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.205586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.205588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.205589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.205594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.205601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.205609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.205726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.205731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.205738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.205799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2121 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f133b7b-f836c626-6fc25061-6144708_0
2025-10-02T09:33:51.206062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07b316-cba45709-11d71508-6222ab0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f133b7b-f836c626-6fc25061-6144708_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.208716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Write session: try to update token
2025-10-02T09:33:51.208730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.214314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:51.214326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.214331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.214352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:51.214353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:51.214481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:51.214589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:51.214711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:51.214822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:51.214986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:51.215010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:51.221573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId: src_id|1f133b7b-f836c626-6fc25061-6144708_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.222657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.222670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.222671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.222672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.222676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.222679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.222681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824922264:3240]
2025-10-02T09:33:51.222700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.222702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.222703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.222703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.222705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.222707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.222808Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.223637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:51.282222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555286900481620:8288]
2025-10-02T09:33:51.282392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2120, pipe: [1:7556555286900481620:8288]
2025-10-02T09:33:51.332860Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.333241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.333251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.333264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481620:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.333447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.333449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555286900481620:8288]
2025-10-02T09:33:51.333473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.333474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:51.333479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:51.333540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2121 reason: error at write: Disconnected sessionId: src_id|1f133b7b-f836c626-6fc25061-6144708_0
2025-10-02T09:33:51.333692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2121 sessionId: src_id|1f133b7b-f836c626-6fc25061-6144708_0 is DEAD
2025-10-02T09:33:51.333833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:51.333845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Write session will restart in 0.007249s
2025-10-02T09:33:51.333868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Write session: Do CDS request
2025-10-02T09:33:51.333874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.342204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.342261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.342274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2122
2025-10-02T09:33:51.342361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.342384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.342392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.342395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.342734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2122 sessionId:  describe result for acl check
2025-10-02T09:33:51.342759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.342766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.342767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.342771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900481813:7963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.343165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900481813:7963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.344970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900481813:7963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.346765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.346988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.347245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.347253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.347260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.347300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.347328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824922513:3216]
2025-10-02T09:33:51.347350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900481813:7963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.347360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900481813:7963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.347362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900481813:7963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.347366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.347666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.347836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.347858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.348047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.348089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.348093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.348093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.348094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.348095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.348096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.348096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.348097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.348097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.348098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.348098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.348099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.348101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.348107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.348110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.348112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.348113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.348115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.348117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.348121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.348123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.348125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.348127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.348129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.348132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.348136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.348139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.348142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.348144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.348147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.348149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.348152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.348155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.348157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.348159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.348162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.348164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.348167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.348169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.348171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.348174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.348176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.348178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.348181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.348187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.348190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.348192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.348198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.348216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.355590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.357151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.357164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.357165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.357167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.357170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2121 [2:7556555286824922513:3216]
2025-10-02T09:33:51.357177Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.357187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.357193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.357194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.357195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.357204Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.357207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.357213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.357240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.357245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.357246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.357248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.357249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.357285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.357290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.357297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.357302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.357314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.357328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481848:7963], now have 1 active actors on pipe
2025-10-02T09:33:51.357333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481647:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.357337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.357338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.357341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.357350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.357360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.357363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.357366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.357367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.357371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.357373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.357385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.357390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.357392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.357375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2121
2025-10-02T09:33:51.357390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2121
2025-10-02T09:33:51.357409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.357414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.357430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|921530c0-de867be6-d29bb29f-34f990ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.357437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.357439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.357440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.357445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.357449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.357456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.357550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.357555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.357562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.357622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2122 partition: 0 MaxSeqNo: 36 sessionId: src_id|921530c0-de867be6-d29bb29f-34f990ed_0
2025-10-02T09:33:51.357837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f133b7b-f836c626-6fc25061-6144708_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|921530c0-de867be6-d29bb29f-34f990ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.360530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Write session: try to update token
2025-10-02T09:33:51.360545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.366388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.366400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.366401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.366402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.366405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.366408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.366412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824922508:3216]
2025-10-02T09:33:51.366431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.366435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.366437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.366438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.366438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.366440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.366544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.373318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId: src_id|921530c0-de867be6-d29bb29f-34f990ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.375627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:51.433804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555286900481859:8288]
2025-10-02T09:33:51.434013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2121, pipe: [1:7556555286900481859:8288]
2025-10-02T09:33:51.475886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.476219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.476229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.476242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481859:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.476436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.476472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:51.476474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:51.476504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555286900481859:8288]
2025-10-02T09:33:51.476519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2122 reason: error at write: Disconnected sessionId: src_id|921530c0-de867be6-d29bb29f-34f990ed_0
2025-10-02T09:33:51.476548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.476639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2122 sessionId: src_id|921530c0-de867be6-d29bb29f-34f990ed_0 is DEAD
2025-10-02T09:33:51.476771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:51.476786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Write session will restart in 0.006598s
2025-10-02T09:33:51.476829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Write session: Do CDS request
2025-10-02T09:33:51.476838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.484183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.484312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.484329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2123
2025-10-02T09:33:51.484433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.484459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.484470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.484474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.484790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2123 sessionId:  describe result for acl check
2025-10-02T09:33:51.484826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.484830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.484831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.484834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900481980:7954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.485295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900481980:7954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.487112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900481980:7954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.489833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.489972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900481980:7954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.489980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900481980:7954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.489982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900481980:7954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.489986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.490090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.490190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.490196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.490202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.490228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.490251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824922721:3217]
2025-10-02T09:33:51.490588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.490777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.490800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.490979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.491011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.491015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.491015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.491016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.491016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.491017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.491017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.491018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.491019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.491019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.491020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.491021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.491023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.491029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.491032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.491034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.491036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.491038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.491040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.491042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.491044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.491046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.491048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.491050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.491054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.491058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.491062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.491065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.491067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.491069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.491072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.491074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.491076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.491079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.491081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.491084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.491086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.491088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.491090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.491094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.491096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.491098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.491100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.491103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.491105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.491107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.491109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.491112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.491129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.498523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.500138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.500150Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.500151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.500153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.500156Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2122 [2:7556555286824922721:3217]
2025-10-02T09:33:51.500163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.500176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.500181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.500182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.500183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.500192Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.500196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.500200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.500232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.500237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.500238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.500240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.500242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.500277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.500282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.500288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.500293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.500304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.500319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900481860:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.500324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482064:7954], now have 1 active actors on pipe
2025-10-02T09:33:51.500327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.500330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.500335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.500342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.500353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.500356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.500358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.500359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.500364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.500365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.500356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2122
2025-10-02T09:33:51.500378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.500383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.500384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.500400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2122
2025-10-02T09:33:51.500421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.500427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.500439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.500446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.500449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.500452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.500457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.500465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.500475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.500597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.500602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.500609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.500675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2123 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0
2025-10-02T09:33:51.500930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921530c0-de867be6-d29bb29f-34f990ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.503539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Write session: try to update token
2025-10-02T09:33:51.503553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.509410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.509422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.509423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.509424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.509428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.509431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.509435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824922715:3217]
2025-10-02T09:33:51.509453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.509458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.509458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.509459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.509461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.509464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.509566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.516299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId: src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.518456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:51.576608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555286900482080:8288]
2025-10-02T09:33:51.576844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2122, pipe: [1:7556555286900482080:8288]
2025-10-02T09:33:51.620392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.620796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.620814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.620827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482080:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.620975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.620988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.621000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555286900482080:8288]
2025-10-02T09:33:51.621016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:51.621018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:51.621065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2123 reason: error at write: Disconnected sessionId: src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0
2025-10-02T09:33:51.621199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2123 sessionId: src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0 is DEAD
2025-10-02T09:33:51.621346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:51.621361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Write session will restart in 0.009585s
2025-10-02T09:33:51.621388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Write session: Do CDS request
2025-10-02T09:33:51.621393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.631319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.632253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.632421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.632433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2124
2025-10-02T09:33:51.632535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.632562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.632568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.632571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.632916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2124 sessionId:  describe result for acl check
2025-10-02T09:33:51.632939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.632943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.632944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.632948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900482252:7945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.633292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900482252:7945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.634376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.634571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.634578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.634585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.634616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.634653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824922928:3213]
2025-10-02T09:33:51.634867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900482252:7945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.634991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.635162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.635184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.635360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.635390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.635394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.635394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.635395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.635395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.635396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.635396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.635397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.635397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.635398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.635399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.635399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.635402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.635408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.635410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.635412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.635414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.635416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.635418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.635420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.635422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.635424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.635425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.635427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.635431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.635435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.635438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.635440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.635443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.635445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.635447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.635450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.635453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.635456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.635458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.635461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.635463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.635466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.635467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.635470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.635473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.635476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.635478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.635480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.635482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.635485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.635487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.635489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.635506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.639363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900482252:7945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.639376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900482252:7945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.639379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900482252:7945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.639384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.642930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.644555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.644566Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.644567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.644569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.644572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2123 [2:7556555286824922928:3213]
2025-10-02T09:33:51.644580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.644590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.644592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.644594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.644595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.644604Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.644608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.644613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.644647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.644654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.644655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.644657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.644658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.644695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.644700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.644708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.644717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.644735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.644752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482081:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.644757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482289:7945], now have 1 active actors on pipe
2025-10-02T09:33:51.644761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.644762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.644763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.644770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.644778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.644783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.644785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.644787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.644789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.644785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2123
2025-10-02T09:33:51.644790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.644818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.644819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.644822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.644830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.644832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.644823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2123
2025-10-02T09:33:51.644865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19be6041-12641203-b77ba9e3-9d2be072_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.644872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.644874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.644876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.644881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.644886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.644897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.645009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.645015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.645022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.645092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2124 partition: 0 MaxSeqNo: 36 sessionId: src_id|19be6041-12641203-b77ba9e3-9d2be072_0
2025-10-02T09:33:51.645382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8be105b-d2c91161-b6606b7f-26dc74aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19be6041-12641203-b77ba9e3-9d2be072_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.648002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Write session: try to update token
2025-10-02T09:33:51.648016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.653963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.653976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.653977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.653978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.653983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.653987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.653989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824922922:3213]
2025-10-02T09:33:51.654008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.654012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.654014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.654016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.654019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.654021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.654126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.660183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId: src_id|19be6041-12641203-b77ba9e3-9d2be072_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.662486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:51.721026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555286900482298:8288]
2025-10-02T09:33:51.721250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2123, pipe: [1:7556555286900482298:8288]
2025-10-02T09:33:51.766225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.766571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.766578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.766591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482298:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.766741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.766750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555286900482298:8288]
2025-10-02T09:33:51.766754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.766776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:51.766777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:51.766822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2124 reason: error at write: Disconnected sessionId: src_id|19be6041-12641203-b77ba9e3-9d2be072_0
2025-10-02T09:33:51.766961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2124 sessionId: src_id|19be6041-12641203-b77ba9e3-9d2be072_0 is DEAD
2025-10-02T09:33:51.767124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:51.767138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Write session will restart in 0.007576s
2025-10-02T09:33:51.767161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Write session: Do CDS request
2025-10-02T09:33:51.767166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.776177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.776266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.776277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2125
2025-10-02T09:33:51.776409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.776433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.776439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.776442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.776711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2125 sessionId:  describe result for acl check
2025-10-02T09:33:51.776733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.776737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.776739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.776743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900482468:7929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.777090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.777114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900482468:7929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.778812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900482468:7929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.780000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.780102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.780108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.780114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.780141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.780163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824923136:3211]
2025-10-02T09:33:51.780499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.780677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.780700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.780747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900482468:7929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.780756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900482468:7929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.780757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900482468:7929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.780761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.780889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.780920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.780924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.780925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.780925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.780926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.780926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.780927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.780928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.780928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.780929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.780929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.780930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.780933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.780939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.780941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.780943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.780945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.780947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.780949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.780952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.780954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.780956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.780958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.780960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.780964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.780968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.780972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.780975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.780977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.780980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.780982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.780984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.780987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.780989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.780993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.780996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.780998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.781001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.781003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.781005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.781009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.781012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.781014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.781017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.781019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.781022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.781024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.781027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.781045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.788456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.790094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.790106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.790107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.790109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.790113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2124 [2:7556555286824923136:3211]
2025-10-02T09:33:51.790119Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.790128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.790130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.790131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.790132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.790141Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.790147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.790151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.790181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.790186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.790187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.790188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.790190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.790225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.790230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.790237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.790242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.790250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.790264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482507:7929], now have 1 active actors on pipe
2025-10-02T09:33:51.790269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482299:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.790272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.790274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.790275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.790282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.790292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.790295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.790297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.790298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.790303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.790304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.790303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2124
2025-10-02T09:33:51.790317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.790305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2124
2025-10-02T09:33:51.790322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.790324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.790337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.790343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.790360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.790367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.790369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.790370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.790375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.790381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.790394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.790472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.790476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.790483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.790542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2125 partition: 0 MaxSeqNo: 36 sessionId: src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0
2025-10-02T09:33:51.790792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19be6041-12641203-b77ba9e3-9d2be072_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.793494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Write session: try to update token
2025-10-02T09:33:51.793509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.799266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.799277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.799278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.799279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.799282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.799285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.799289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824923130:3211]
2025-10-02T09:33:51.799306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.799309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.799310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.799313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.799315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.799319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.799436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.806477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId: src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.808629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:51.866893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555286900482524:8288]
2025-10-02T09:33:51.867028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2124, pipe: [1:7556555286900482524:8288]
2025-10-02T09:33:51.909561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:51.909989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.910000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.910013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482524:8288], now have 1 active actors on pipe
2025-10-02T09:33:51.910141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:51.910170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555286900482524:8288]
2025-10-02T09:33:51.910194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:51.910190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:51.910255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2125 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0
2025-10-02T09:33:51.910391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2125 sessionId: src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0 is DEAD
2025-10-02T09:33:51.910548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:51.910571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Write session will restart in 0.006938s
2025-10-02T09:33:51.910602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Write session: Do CDS request
2025-10-02T09:33:51.910608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:51.918210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.918298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:51.918307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2126
2025-10-02T09:33:51.918433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:51.918455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:51.918461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:51.918463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:51.918751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2126 sessionId:  describe result for acl check
2025-10-02T09:33:51.918773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:51.918777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:51.918778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:51.918781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555286900482652:7912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:51.919116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555286900482652:7912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:51.920523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555286900482652:7912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:51.923642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:51.923761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555286900482652:7912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:51.923770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555286900482652:7912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:51.923772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555286900482652:7912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:51.923775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:51.923889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:51.923979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:51.923986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:51.923992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:51.924016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:51.924038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555286824923358:3210]
2025-10-02T09:33:51.924378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:51.924557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:51.924592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:51.924811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:51.924848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.924852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.924853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.924854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.924854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.924855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.924855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.924856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.924857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.924857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.924858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.924858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.924861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.924867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.924869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.924871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.924873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.924875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.924877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.924879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.924881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.924883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.924885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.924887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.924890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.924894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:51.924898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.924901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:51.924903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.924905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:51.924907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.924910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:51.924912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.924915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:51.924917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.924919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:51.924921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.924924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:51.924926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.924929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:51.924931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.924934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:51.924936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.924938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.924940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.924943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.924945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.924947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.924965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:51.932390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:51.933816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:51.933827Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:51.933828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:51.933830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:51.933834Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2125 [2:7556555286824923358:3210]
2025-10-02T09:33:51.933840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:51.933850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:51.933855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.933856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.933857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.933866Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:51.933872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:51.933876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:51.933905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.933910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.933911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.933912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:51.933914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:51.934020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2125
2025-10-02T09:33:51.934024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2125
2025-10-02T09:33:51.934133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:51.934139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.934145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:51.934151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:51.934163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:51.934177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482525:2446], now have 1 active actors on pipe
2025-10-02T09:33:51.934183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555286900482732:7912], now have 1 active actors on pipe
2025-10-02T09:33:51.934192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.934197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.934208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.934212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.934213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.934221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:51.934232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:51.934235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:51.934238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:51.934239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:51.934242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:51.934244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:51.934254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b47df687-a7c0b483-7961605f-e5d9d497_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:51.934257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:51.934259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:51.934260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:51.934265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:51.934273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:51.934287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.934295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:51.934301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.934305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:51.934402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:51.934407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:51.934415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:51.934466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2126 partition: 0 MaxSeqNo: 36 sessionId: src_id|b47df687-a7c0b483-7961605f-e5d9d497_0
2025-10-02T09:33:51.934761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0d8b01-accce7f1-f51a0dc8-3c197133_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b47df687-a7c0b483-7961605f-e5d9d497_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:51.937453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Write session: try to update token
2025-10-02T09:33:51.937472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:51.943342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:51.943355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:51.943356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:51.943358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:51.943361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.943364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.943366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555286824923352:3210]
2025-10-02T09:33:51.943385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:51.943389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:51.943391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:51.943392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:51.943392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:51.943394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:51.943506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:51.950016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId: src_id|b47df687-a7c0b483-7961605f-e5d9d497_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:51.952189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.010240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195450043:8288]
2025-10-02T09:33:52.010406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2125, pipe: [1:7556555291195450043:8288]
2025-10-02T09:33:52.054141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.054648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.054657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.054671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450043:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.054791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.054836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:52.054846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.054851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:52.054876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195450043:8288]
2025-10-02T09:33:52.054900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2126 reason: error at write: Disconnected sessionId: src_id|b47df687-a7c0b483-7961605f-e5d9d497_0
2025-10-02T09:33:52.055048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2126 sessionId: src_id|b47df687-a7c0b483-7961605f-e5d9d497_0 is DEAD
2025-10-02T09:33:52.055211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:52.055227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Write session will restart in 0.008526s
2025-10-02T09:33:52.055250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Write session: Do CDS request
2025-10-02T09:33:52.055256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.065154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.065307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.065319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2127
2025-10-02T09:33:52.065442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.065468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.065477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.065480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.065540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.065761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2127 sessionId:  describe result for acl check
2025-10-02T09:33:52.065781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.065786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.065787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.065789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195450229:7891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.066111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195450229:7891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.067512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195450229:7891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.068454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.068550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.068557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.068563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.068589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.068611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119890867:3198]
2025-10-02T09:33:52.068957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195450229:7891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.068966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195450229:7891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.068968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195450229:7891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.068961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.068971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.069115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.069137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.069308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.069337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.069343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.069343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.069344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.069345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.069345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.069346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.069346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.069348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.069351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.069356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.069359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.069361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.069363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.069365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.069367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.069368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.069370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.069372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.069374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.069376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.069380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.069384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.069387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.069390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.069392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.069395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.069397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.069400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.069402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.069404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.069406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.069409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.069411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.069414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.069416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.069419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.069421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.069424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.069426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.069428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.069431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.069433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.069436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.069438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.069455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.076842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.078272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.078285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.078286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.078288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.078291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2126 [2:7556555291119890867:3198]
2025-10-02T09:33:52.078298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.078308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.078311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.078313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.078314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.078323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.078329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.078334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.078365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.078370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.078371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.078373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.078374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.078410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.078415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.078421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.078426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.078436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.078447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.078451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.078452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.078457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.078464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.078465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450056:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.078468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450264:7891], now have 1 active actors on pipe
2025-10-02T09:33:52.078472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.078472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.078474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.078479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.078480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.078493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.078498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.078506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.078500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2126
2025-10-02T09:33:52.078502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2126
2025-10-02T09:33:52.078726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.078732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.078747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.078755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.078757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.078758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.078763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.078769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.078777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.078905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.078910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.078917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.078968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2127 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0
2025-10-02T09:33:52.079206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47df687-a7c0b483-7961605f-e5d9d497_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.081826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Write session: try to update token
2025-10-02T09:33:52.081840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.087473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.087484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.087486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.087487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.087490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.087492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.087494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119890861:3198]
2025-10-02T09:33:52.087513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.087515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.087517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.087518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.087519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.087520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.087671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.093945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId: src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.096089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.155158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195450275:8288]
2025-10-02T09:33:52.155308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2126, pipe: [1:7556555291195450275:8288]
2025-10-02T09:33:52.195851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.196053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.196062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.196074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450275:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.196246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.196256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.196267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195450275:8288]
2025-10-02T09:33:52.196285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:52.196331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2127 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0
2025-10-02T09:33:52.196465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2127 sessionId: src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0 is DEAD
2025-10-02T09:33:52.196612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:52.196625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Write session will restart in 0.009222s
2025-10-02T09:33:52.196647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Write session: Do CDS request
2025-10-02T09:33:52.196651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.206511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.207174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.207297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.207304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2128
2025-10-02T09:33:52.207424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.207444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.207450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.207452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.207757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2128 sessionId:  describe result for acl check
2025-10-02T09:33:52.207780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.207784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.207785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.207788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195450451:7882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.208134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195450451:7882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.209403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.209502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.209508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.209513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.209539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.209565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119891079:3196]
2025-10-02T09:33:52.209903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.209988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195450451:7882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.210066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.210088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.210261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.210291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.210295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.210296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.210296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.210297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.210297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.210298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.210299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.210299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.210300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.210300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.210301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.210303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.210309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.210312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.210314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.210316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.210318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.210320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.210321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.210323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.210325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.210327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.210329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.210333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.210337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.210340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.210343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.210345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.210347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.210349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.210354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.210356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.210359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.210361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.210364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.210366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.210368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.210370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.210373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.210375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.210377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.210379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.210382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.210384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.210387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.210389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.210391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.210408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.215160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195450451:7882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.215171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195450451:7882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.215173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195450451:7882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.215176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.217772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.219539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.219551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.219552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.219553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.219557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2127 [2:7556555291119891079:3196]
2025-10-02T09:33:52.219564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.219574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.219579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.219580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.219581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.219590Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.219596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.219600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.219654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.219659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.219660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.219663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.219664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.219698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.219703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.219709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.219715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.219726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.219739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450277:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.219745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450489:7882], now have 1 active actors on pipe
2025-10-02T09:33:52.219749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.219750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.219751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.219758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.219768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.219771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.219773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.219774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.219778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.219779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.219771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2127
2025-10-02T09:33:52.219783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2127
2025-10-02T09:33:52.219793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.219798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.219799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.219810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.219814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.219840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68473d92-3a9cd46c-8c35b91-900622c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.219846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.219848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.219849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.219855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.219863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.219876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.219982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.219987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.219995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.220064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2128 partition: 0 MaxSeqNo: 36 sessionId: src_id|68473d92-3a9cd46c-8c35b91-900622c2_0
2025-10-02T09:33:52.220308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4c7618d-fdd50f0f-d8f831d5-f25f56e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68473d92-3a9cd46c-8c35b91-900622c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.222940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Write session: try to update token
2025-10-02T09:33:52.222953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.229468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.229482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.229483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.229484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.229488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.229491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.229492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119891073:3196]
2025-10-02T09:33:52.229512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.229515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.229516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.229519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.229523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.229525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.229625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.235277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId: src_id|68473d92-3a9cd46c-8c35b91-900622c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.237478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.296483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195450499:8288]
2025-10-02T09:33:52.296670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2127, pipe: [1:7556555291195450499:8288]
2025-10-02T09:33:52.337812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.338003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.338012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.338024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450499:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.338209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.338200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195450499:8288]
2025-10-02T09:33:52.338222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:52.338224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:52.338264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2128 reason: error at write: Disconnected sessionId: src_id|68473d92-3a9cd46c-8c35b91-900622c2_0
2025-10-02T09:33:52.338404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2128 sessionId: src_id|68473d92-3a9cd46c-8c35b91-900622c2_0 is DEAD
2025-10-02T09:33:52.338528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:52.338536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Write session will restart in 0.007232s
2025-10-02T09:33:52.338550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Write session: Do CDS request
2025-10-02T09:33:52.338545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.338558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.347308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.347560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.347571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2129
2025-10-02T09:33:52.347673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.347692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.347699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.347702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.347936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2129 sessionId:  describe result for acl check
2025-10-02T09:33:52.347954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.347958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.347959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.347962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195450674:7843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.348383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195450674:7843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.349781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195450674:7843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.352885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195450674:7843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.352893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195450674:7843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.352895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195450674:7843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.352899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.352942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.353187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.353275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.353282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.353288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.353312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.353337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119891331:3184]
2025-10-02T09:33:52.353669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.353832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.353856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.354028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.354057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.354061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.354061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.354062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.354062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.354063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.354063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.354064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.354064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.354065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.354065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.354066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.354068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.354074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.354076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.354078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.354080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.354082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.354084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.354086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.354088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.354091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.354092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.354095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.354100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.354106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.354110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.354114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.354117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.354121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.354129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.354137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.354144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.354148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.354155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.354160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.354167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.354170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.354172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.354175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.354181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.354184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.354189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.354192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.354195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.354197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.354200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.354202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.354223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.361948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.363592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.363603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.363604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.363606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.363608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2128 [2:7556555291119891331:3184]
2025-10-02T09:33:52.363616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.363625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.363627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.363628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.363629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.363638Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.363641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.363645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.363825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.363830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.363832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.363833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.363835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.363873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.363877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.363884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.363889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.363900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.363914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.363918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.363919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.363923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.363931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.363931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.363932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.363934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.363941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.363942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.363950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450513:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.363955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450730:7843], now have 1 active actors on pipe
2025-10-02T09:33:52.363967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.363974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.363983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.363985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2128
2025-10-02T09:33:52.363997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2128
2025-10-02T09:33:52.364052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.364064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.364082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.364091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.364093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.364095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.364102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.364112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.364124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.364262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.364269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.364283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.364349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2129 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0
2025-10-02T09:33:52.364634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68473d92-3a9cd46c-8c35b91-900622c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.367293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Write session: try to update token
2025-10-02T09:33:52.367311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.377258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:52.377268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.377272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.377294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:52.377294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:52.377424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:52.377539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:52.377650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:52.377761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:52.377926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:52.377948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:52.380110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId: src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.382053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.382065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.382066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.382067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.382071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.382074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.382077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119891325:3184]
2025-10-02T09:33:52.382088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.382090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.382092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.382094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.382097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.382098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.382209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.382758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.438339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195450743:8288]
2025-10-02T09:33:52.438507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2128, pipe: [1:7556555291195450743:8288]
2025-10-02T09:33:52.491257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.491453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.491462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.491476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450743:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.491605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.491688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195450743:8288]
2025-10-02T09:33:52.491734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:52.491765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.491947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2129 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0
2025-10-02T09:33:52.492111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2129 sessionId: src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0 is DEAD
2025-10-02T09:33:52.492278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:52.492291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Write session will restart in 0.007556s
2025-10-02T09:33:52.492310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Write session: Do CDS request
2025-10-02T09:33:52.492315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.501121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.501224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.501238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2130
2025-10-02T09:33:52.501331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.501356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.501365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.501368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.501728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2130 sessionId:  describe result for acl check
2025-10-02T09:33:52.501754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.501766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.501767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.501771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195450883:7839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.502203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195450883:7839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.503550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.503829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195450883:7839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.506489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.506622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.506634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.506640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.506671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.506694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119891544:3173]
2025-10-02T09:33:52.506712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195450883:7839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.506722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195450883:7839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.506724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195450883:7839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.506728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.507035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.507191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.507213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.507388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.507417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.507422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.507422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.507423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.507423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.507424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.507424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.507425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.507425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.507426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.507426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.507427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.507430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.507436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.507438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.507440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.507442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.507444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.507446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.507448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.507450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.507453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.507454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.507456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.507460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.507464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.507467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.507470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.507473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.507475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.507478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.507481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.507484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.507486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.507488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.507491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.507493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.507496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.507498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.507501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.507504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.507506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.507508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.507511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.507512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.507515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.507517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.507520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.507536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.515217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.516841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.516851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.516852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.516854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.516858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2129 [2:7556555291119891544:3173]
2025-10-02T09:33:52.516864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.516874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.516875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.516876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.516877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.516885Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.516890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.516894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.516944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.516949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.516950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.516952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.516954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.516996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.517001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.517007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.517012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.517020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.517034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450962:7839], now have 1 active actors on pipe
2025-10-02T09:33:52.517039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450745:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.517043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.517044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.517045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.517052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.517064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.517064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.517065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.517067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.517073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.517074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.517089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.517094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.517077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2129
2025-10-02T09:33:52.517095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.517093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2129
2025-10-02T09:33:52.517114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.517118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.517134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92b58837-6db07baf-bb5936ab-665505e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.517141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.517143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.517144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.517149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.517157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.517168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.517287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.517292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.517300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.517366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2130 partition: 0 MaxSeqNo: 36 sessionId: src_id|92b58837-6db07baf-bb5936ab-665505e4_0
2025-10-02T09:33:52.517653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0efac2a-f3d2db9a-3c62a786-e4272b05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92b58837-6db07baf-bb5936ab-665505e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.520300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Write session: try to update token
2025-10-02T09:33:52.520316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.526321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.526334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.526335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.526336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.526340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.526344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.526346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119891539:3173]
2025-10-02T09:33:52.526365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.526371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.526372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.526374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.526374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.526376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.526483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.532751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId: src_id|92b58837-6db07baf-bb5936ab-665505e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.535032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.591933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195450974:8288]
2025-10-02T09:33:52.592142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2129, pipe: [1:7556555291195450974:8288]
2025-10-02T09:33:52.636655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.637098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.637108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.637120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450974:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.637239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.637306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.637362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:52.637371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195450974:8288]
2025-10-02T09:33:52.637423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2130 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92b58837-6db07baf-bb5936ab-665505e4_0
2025-10-02T09:33:52.637552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2130 sessionId: src_id|92b58837-6db07baf-bb5936ab-665505e4_0 is DEAD
2025-10-02T09:33:52.637695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:52.637710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Write session will restart in 0.008032s
2025-10-02T09:33:52.637746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Write session: Do CDS request
2025-10-02T09:33:52.637752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.647159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.647267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.647280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2131
2025-10-02T09:33:52.647401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.647430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.647449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.647456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.647551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.647737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2131 sessionId:  describe result for acl check
2025-10-02T09:33:52.647761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.647765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.647766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.647769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195451151:7827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.648107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195451151:7827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.649671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195451151:7827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.650780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.650891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.650897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.650903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.650932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.650954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119891759:3171]
2025-10-02T09:33:52.651323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.651521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.651557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.651713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195451151:7827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.651723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195451151:7827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.651725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195451151:7827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.651729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.651743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.651776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.651780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.651780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.651781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.651781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.651782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.651782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.651783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.651783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.651784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.651784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.651785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.651788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.651794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.651796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.651798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.651800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.651802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.651804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.651806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.651808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.651810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.651812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.651814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.651818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.651822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.651825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.651828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.651831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.651834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.651836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.651838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.651841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.651843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.651846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.651848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.651850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.651853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.651855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.651858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.651860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.651863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.651865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.651867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.651869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.651872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.651874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.651881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.651897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.659671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.661417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.661429Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.661430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.661433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.661436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2130 [2:7556555291119891759:3171]
2025-10-02T09:33:52.661443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.661451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.661453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.661455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.661456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.661465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.661469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.661473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.661505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.661510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.661511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.661513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.661514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.661551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.661555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.661562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.661568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.661577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.661592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451189:7827], now have 1 active actors on pipe
2025-10-02T09:33:52.661597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195450975:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.661601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.661602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.661603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.661611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.661619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.661625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.661628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.661629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.661629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.661631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.661627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2130
2025-10-02T09:33:52.661645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.661629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2130
2025-10-02T09:33:52.661650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.661652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.661666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.661672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.661691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.661697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.661699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.661700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.661705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.661710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.661721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.661811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.661816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.661823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.661877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2131 partition: 0 MaxSeqNo: 36 sessionId: src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0
2025-10-02T09:33:52.662164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b58837-6db07baf-bb5936ab-665505e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.664752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Write session: try to update token
2025-10-02T09:33:52.664766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.671171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.671184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.671186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.671187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.671191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.671193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.671195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119891753:3171]
2025-10-02T09:33:52.671215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.671216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.671218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.671219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.671220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.671222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.671335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.676714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId: src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.679179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.737345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195451199:8288]
2025-10-02T09:33:52.737595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2130, pipe: [1:7556555291195451199:8288]
2025-10-02T09:33:52.783097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.783316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.783326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.783338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451199:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.783486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.783516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195451199:8288]
2025-10-02T09:33:52.783522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:52.783524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:52.783571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2131 reason: error at write: Disconnected sessionId: src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0
2025-10-02T09:33:52.783712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2131 sessionId: src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0 is DEAD
2025-10-02T09:33:52.783768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.783886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:52.783899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Write session will restart in 0.007279s
2025-10-02T09:33:52.783922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Write session: Do CDS request
2025-10-02T09:33:52.783927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.792150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.792269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.792280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2132
2025-10-02T09:33:52.792413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.792441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.792449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.792453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.793086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2132 sessionId:  describe result for acl check
2025-10-02T09:33:52.793134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.793144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.793146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.793151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195451375:7817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.793621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195451375:7817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.794154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.795316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195451375:7817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.796905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.797020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.797026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.797033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.797060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.797085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119891975:3169]
2025-10-02T09:33:52.797177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195451375:7817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.797186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195451375:7817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.797188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195451375:7817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.797192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.797427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.797589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.797612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.797791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.797829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.797834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.797834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.797835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.797835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.797836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.797836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.797837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.797838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.797838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.797839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.797839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.797842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.797849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.797851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.797853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.797855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.797857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.797859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.797861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.797863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.797866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.797868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.797870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.797874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.797879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.797882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.797885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.797887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.797890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.797892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.797895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.797898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.797900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.797903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.797905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.797907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.797910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.797912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.797914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.797917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.797919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.797921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.797923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.797925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.797928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.797930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.797932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.797949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.805669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.807413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.807426Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.807427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.807429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.807432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2131 [2:7556555291119891975:3169]
2025-10-02T09:33:52.807440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.807450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.807452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.807453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.807454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.807463Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.807469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.807474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.807504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.807509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.807510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.807512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.807513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.807550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.807555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.807561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.807566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.807574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.807589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451413:7817], now have 1 active actors on pipe
2025-10-02T09:33:52.807594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451200:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.807598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.807599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.807601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.807609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.807616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.807622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.807623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.807625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.807627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.807628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.807643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.807648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.807639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2131
2025-10-02T09:33:52.807656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.807669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.807671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.807652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2131
2025-10-02T09:33:52.807688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.807694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.807696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.807697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.807702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.807710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.807720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.807838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.807843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.807850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.807917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2132 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0
2025-10-02T09:33:52.808188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dfeaf2-f28285ce-e76e6a16-125d4414_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.810869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Write session: try to update token
2025-10-02T09:33:52.810885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.817104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.817117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.817118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.817119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.817123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.817125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.817127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119891969:3169]
2025-10-02T09:33:52.817147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.817148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.817149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.817151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.817152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.817152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.817257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.823517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId: src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.825907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:52.883762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555291195451430:8288]
2025-10-02T09:33:52.884017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2131, pipe: [1:7556555291195451430:8288]
2025-10-02T09:33:52.930112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:52.930303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.930311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.930323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451430:8288], now have 1 active actors on pipe
2025-10-02T09:33:52.930469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:52.930482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:52.930484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:52.930541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2132 reason: error at write: Disconnected sessionId: src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0
2025-10-02T09:33:52.930543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555291195451430:8288]
2025-10-02T09:33:52.930672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2132 sessionId: src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0 is DEAD
2025-10-02T09:33:52.930827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:52.930840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Write session will restart in 0.007806s
2025-10-02T09:33:52.930861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Write session: Do CDS request
2025-10-02T09:33:52.930872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:52.931123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:52.940249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.940297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:52.940317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2133
2025-10-02T09:33:52.940606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:52.940633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:52.940643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:52.940647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:52.941050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2133 sessionId:  describe result for acl check
2025-10-02T09:33:52.941091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:52.941097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:52.941099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:52.941103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555291195451612:7792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:52.941134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:52.941498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555291195451612:7792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:52.943250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555291195451612:7792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:52.944096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:52.944198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:52.944204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:52.944210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:52.944238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:52.944262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555291119892203:3163]
2025-10-02T09:33:52.944606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:52.944812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:52.944835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:52.945013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:52.945041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.945045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.945046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.945046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.945047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.945048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.945048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.945049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.945049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.945050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.945050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.945051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.945054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.945060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.945062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.945064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.945066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.945068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.945073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555291195451612:7792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:52.945082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555291195451612:7792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:52.945070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.945084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555291195451612:7792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:52.945072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.945087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:52.945074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.945076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.945078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.945080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.945084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.945087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:52.945091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.945094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:52.945096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.945099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:52.945101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.945104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:52.945106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.945109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:52.945111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.945114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:52.945116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.945119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:52.945122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.945125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:52.945127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.945129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:52.945131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.945134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.945136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.945139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.945141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.945144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.945161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:52.952916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:52.954361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:52.954373Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:52.954374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:52.954376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:52.954380Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2132 [2:7556555291119892203:3163]
2025-10-02T09:33:52.954387Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:52.954397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:52.954400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.954401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.954402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.954412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:52.954418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:52.954422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:52.954453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.954458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.954459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.954461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:52.954463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:52.954583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2132
2025-10-02T09:33:52.954600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2132
2025-10-02T09:33:52.954707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:52.954713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.954720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:52.954725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:52.954737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:52.954751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451650:7792], now have 1 active actors on pipe
2025-10-02T09:33:52.954757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555291195451434:2446], now have 1 active actors on pipe
2025-10-02T09:33:52.954767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.954773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.954785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.954789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.954790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.954798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:52.954809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:52.954811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:52.954812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:52.954813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:52.954817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:52.954819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:52.954827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:52.954834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:52.954836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:52.954837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:52.954843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:52.954852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:52.954869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.954877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:52.954884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.954885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:52.954997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:52.955002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:52.955010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:52.955069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2133 partition: 0 MaxSeqNo: 36 sessionId: src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0
2025-10-02T09:33:52.955332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f30cb0a-66f042c2-7e97adc3-f89ba0d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:52.958168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Write session: try to update token
2025-10-02T09:33:52.958185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:52.965244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:52.965259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:52.965261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:52.965262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:52.965266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.965269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.965271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555291119892197:3163]
2025-10-02T09:33:52.965292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:52.965296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:52.965298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:52.965297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:52.965300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:52.965302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:52.965404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:52.971521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId: src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:52.974014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.030703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490418968:8288]
2025-10-02T09:33:53.030891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2132, pipe: [1:7556555295490418968:8288]
2025-10-02T09:33:53.077125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.077543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.077553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.077565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490418968:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.077708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.077730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:53.077742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:53.077745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.077789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2133 reason: error at write: Disconnected sessionId: src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0
2025-10-02T09:33:53.077798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490418968:8288]
2025-10-02T09:33:53.077924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2133 sessionId: src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0 is DEAD
2025-10-02T09:33:53.078044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:53.078063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Write session will restart in 0.006273s
2025-10-02T09:33:53.078078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Write session: Do CDS request
2025-10-02T09:33:53.078082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.085165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.085270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.085287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2134
2025-10-02T09:33:53.085425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.085452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.085462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.085466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.085875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2134 sessionId:  describe result for acl check
2025-10-02T09:33:53.085908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.085912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.085913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.085917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490419048:7788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.086264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490419048:7788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.088335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490419048:7788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.092407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.092595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490419048:7788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.092605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490419048:7788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.092606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490419048:7788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.092610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.092656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.092751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.092757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.092763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.092789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.092827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414859719:3158]
2025-10-02T09:33:53.093212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.093414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.093439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.093718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.093764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.093768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.093769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.093769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.093770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.093770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.093771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.093771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.093772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.093773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.093773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.093774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.093777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.093782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.093784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.093786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.093788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.093790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.093792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.093794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.093796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.093798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.093800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.093802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.093806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.093810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.093814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.093817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.093819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.093822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.093824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.093827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.093829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.093832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.093834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.093837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.093839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.093841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.093844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.093846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.093848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.093851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.093853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.093855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.093857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.093860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.093863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.093866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.093882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.101283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.102692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.102704Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.102705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.102707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.102711Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2133 [2:7556555295414859719:3158]
2025-10-02T09:33:53.102719Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.102729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.102734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.102735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.102736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.102744Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.102749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.102754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.102786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.102790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.102791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.102793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.102795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.102833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.102838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.102844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.102849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.102860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.102874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419184:7788], now have 1 active actors on pipe
2025-10-02T09:33:53.102880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490418969:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.102884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.102885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.102886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.102894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.102904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.102909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.102912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.102913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.102913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.102915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.102927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.102932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.102923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2133
2025-10-02T09:33:53.102940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2133
2025-10-02T09:33:53.102948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.102953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.102954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.102970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26653776-adb00d07-5a617dc6-5b627e4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.102977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.102979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.102980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.102985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.102993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.103000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.103142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.103149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.103160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.103234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2134 partition: 0 MaxSeqNo: 36 sessionId: src_id|26653776-adb00d07-5a617dc6-5b627e4c_0
2025-10-02T09:33:53.103525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc5dbb-40f45d8c-4363459b-8a464fe8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|26653776-adb00d07-5a617dc6-5b627e4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.106085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Write session: try to update token
2025-10-02T09:33:53.106095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.112494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.112512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.112514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.112516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.112526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.112530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.112533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414859713:3158]
2025-10-02T09:33:53.112561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.112565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.112570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.112571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.112572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.112573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.112719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.118836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId: src_id|26653776-adb00d07-5a617dc6-5b627e4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.121276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.178142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490419196:8288]
2025-10-02T09:33:53.178330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2133, pipe: [1:7556555295490419196:8288]
2025-10-02T09:33:53.221030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.221389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.221401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.221413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419196:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.221596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:53.221609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:53.221609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490419196:8288]
2025-10-02T09:33:53.221640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.221660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2134 reason: error at write: Disconnected sessionId: src_id|26653776-adb00d07-5a617dc6-5b627e4c_0
2025-10-02T09:33:53.221762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.221797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2134 sessionId: src_id|26653776-adb00d07-5a617dc6-5b627e4c_0 is DEAD
2025-10-02T09:33:53.221940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:53.221952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Write session will restart in 0.007686s
2025-10-02T09:33:53.221976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Write session: Do CDS request
2025-10-02T09:33:53.221982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.230166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.230227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.230241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2135
2025-10-02T09:33:53.230375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.230402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.230411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.230415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.230724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2135 sessionId:  describe result for acl check
2025-10-02T09:33:53.230749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.230753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.230754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.230757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490419328:7774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.231090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490419328:7774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.232795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.232998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490419328:7774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.235859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.236000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.236008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.236014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.236048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.236094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414859937:3149]
2025-10-02T09:33:53.236168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490419328:7774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.236179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490419328:7774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.236181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490419328:7774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.236186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.236434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.236597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.236621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.236814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.236852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.236857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.236857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.236858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.236858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.236859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.236859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.236860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.236860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.236861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.236861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.236862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.236865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.236871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.236873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.236875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.236877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.236879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.236881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.236883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.236885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.236887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.236889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.236891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.236895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.236900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.236903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.236906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.236908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.236912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.236914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.236917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.236919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.236922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.236924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.236926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.236929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.236931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.236933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.236936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.236938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.236944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.236946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.236949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.236951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.236954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.236956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.236960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.236988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.244335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.245938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.245951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.245952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.245954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.245957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2134 [2:7556555295414859937:3149]
2025-10-02T09:33:53.245964Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.245974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.245975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.245977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.245977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.245986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.245992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.245997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.246049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.246054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.246055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.246057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.246058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.246094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.246099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.246106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.246111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.246121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.246136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419197:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.246142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419413:7774], now have 1 active actors on pipe
2025-10-02T09:33:53.246145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.246147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.246148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.246155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.246162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.246166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.246168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.246169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.246173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.246174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.246166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2134
2025-10-02T09:33:53.246172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2134
2025-10-02T09:33:53.246187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.246192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.246193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.246204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.246209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.246235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48bc0896-984001ab-d2e3c25-863d8dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.246242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.246244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.246245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.246250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.246255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.246266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.246365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.246370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.246378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.246440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2135 partition: 0 MaxSeqNo: 36 sessionId: src_id|48bc0896-984001ab-d2e3c25-863d8dec_0
2025-10-02T09:33:53.246734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26653776-adb00d07-5a617dc6-5b627e4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48bc0896-984001ab-d2e3c25-863d8dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.249251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Write session: try to update token
2025-10-02T09:33:53.249262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.255667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.255686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.255688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.255690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.255698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.255702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.255706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414859931:3149]
2025-10-02T09:33:53.255729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.255738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.255739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.255740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.255744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.255747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.255893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.262282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId: src_id|48bc0896-984001ab-d2e3c25-863d8dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.264551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.321523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490419426:8288]
2025-10-02T09:33:53.321706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2134, pipe: [1:7556555295490419426:8288]
2025-10-02T09:33:53.364228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.364669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.364680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.364693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419426:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.364811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.364857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490419426:8288]
2025-10-02T09:33:53.364879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.364902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:53.364947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48bc0896-984001ab-d2e3c25-863d8dec_0
2025-10-02T09:33:53.365079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2135 sessionId: src_id|48bc0896-984001ab-d2e3c25-863d8dec_0 is DEAD
2025-10-02T09:33:53.365496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:53.365506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Write session will restart in 0.005028s
2025-10-02T09:33:53.365522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Write session: Do CDS request
2025-10-02T09:33:53.365527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.371183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.371209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.371219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2136
2025-10-02T09:33:53.371317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.371334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.371338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.371340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.371554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2136 sessionId:  describe result for acl check
2025-10-02T09:33:53.371570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.371574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.371575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.371577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490419471:7740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.371865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490419471:7740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.373251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490419471:7740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.375364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490419471:7740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.375375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490419471:7740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.375377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490419471:7740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.375381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.379710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.379982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.380086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.380093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.380099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.380124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.380148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414860196:3138]
2025-10-02T09:33:53.380495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.380665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.380690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.380913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.380953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.380957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.380957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.380958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.380959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.380959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.380960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.380960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.380961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.380961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.380962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.380962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.380965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.380970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.380973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.380975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.380976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.380979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.380980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.380982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.380984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.380986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.380988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.380990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.380994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.380998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.381002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.381004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.381006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.381009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.381011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.381014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.381016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.381019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.381021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.381023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.381025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.381028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.381030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.381032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.381035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.381038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.381040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.381043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.381045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.381048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.381050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.381053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.381069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.388424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.390002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.390014Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.390015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.390017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.390021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2135 [2:7556555295414860196:3138]
2025-10-02T09:33:53.390028Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.390037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.390042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.390043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.390044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.390053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.390056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.390065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.390104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.390109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.390110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.390111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.390112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.390149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.390153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.390160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.390165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.390176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.390189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419441:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.390194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419649:7740], now have 1 active actors on pipe
2025-10-02T09:33:53.390198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.390199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.390200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.390207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.390217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.390221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.390223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.390224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.390228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.390229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.390242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.390247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.390248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.390237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2135
2025-10-02T09:33:53.390309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2135
2025-10-02T09:33:53.390353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.390358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.390372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.390379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.390383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.390388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.390393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.390399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.390409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.390541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.390546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.390553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.390640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2136 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0
2025-10-02T09:33:53.390940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48bc0896-984001ab-d2e3c25-863d8dec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.393578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Write session: try to update token
2025-10-02T09:33:53.393589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.399496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:53.399514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.399520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.399554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:53.399556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:53.399759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:53.399930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:53.400081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:53.400276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:53.400495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:53.400538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:53.406255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId: src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.408121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.408137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.408141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.408142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.408147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.408149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.408151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414860191:3138]
2025-10-02T09:33:53.408173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.408173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.408178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.408180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.408181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.408182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.408297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.408872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.464888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490419678:8288]
2025-10-02T09:33:53.465120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2135, pipe: [1:7556555295490419678:8288]
2025-10-02T09:33:53.516627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.516916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.516926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.516939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419678:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.517084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.517124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490419678:8288]
2025-10-02T09:33:53.517129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.517149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:53.517205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2136 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0
2025-10-02T09:33:53.517331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2136 sessionId: src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0 is DEAD
2025-10-02T09:33:53.517472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:53.517482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Write session will restart in 0.008341s
2025-10-02T09:33:53.517496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Write session: Do CDS request
2025-10-02T09:33:53.517500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.527277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.527927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.527947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2137
2025-10-02T09:33:53.528114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.528144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.528153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.528157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.528435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2137 sessionId:  describe result for acl check
2025-10-02T09:33:53.528460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.528464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.528465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.528468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490419862:7727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.528505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.528818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490419862:7727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.531196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490419862:7727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.531622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.531729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.531736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.531742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.531770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.531797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414860416:3131]
2025-10-02T09:33:53.532141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.532329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.532355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.532539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.532574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.532579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.532579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.532580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.532581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.532582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.532582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.532583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.532583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.532584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.532585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.532585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.532588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.532595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.532597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.532599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.532602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.532604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.532606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.532608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.532610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.532613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.532615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.532617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.532622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.532626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.532630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.532633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.532635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.532639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.532641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.532644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.532646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.532649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.532651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.532654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.532660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.532662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.532665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.532668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.532670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.532673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.532679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.532681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.532684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.532687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.532689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.532695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.532713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.536849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490419862:7727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.536859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490419862:7727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.536861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490419862:7727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.536865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.540675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.542378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.542390Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.542391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.542394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.542397Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2136 [2:7556555295414860416:3131]
2025-10-02T09:33:53.542404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.542413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.542417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.542418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.542420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.542429Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.542435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.542439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.542470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.542475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.542476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.542478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.542479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.542516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.542520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.542527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.542532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.542544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.542557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419680:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.542564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419901:7727], now have 1 active actors on pipe
2025-10-02T09:33:53.542567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.542571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.542573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.542582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.542592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.542598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.542601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.542603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.542603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.542605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.542618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.542631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.542632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.542611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2136
2025-10-02T09:33:53.542622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2136
2025-10-02T09:33:53.542661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.542666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.542680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.542686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.542688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.542690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.542695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.542703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.542713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.542850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.542854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.542862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.542936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2137 partition: 0 MaxSeqNo: 36 sessionId: src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0
2025-10-02T09:33:53.543224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b557c8d-b4c4ab9d-8036f16a-c89da329_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.545720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Write session: try to update token
2025-10-02T09:33:53.545731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.552334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.552356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.552358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.552360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.552369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.552373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.552378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414860410:3131]
2025-10-02T09:33:53.552407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.552413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.552416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.552418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.552419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.552420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.552584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.559006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId: src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.561382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.617480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490419909:8288]
2025-10-02T09:33:53.617724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2136, pipe: [1:7556555295490419909:8288]
2025-10-02T09:33:53.663564Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.664021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.664032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.664045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419909:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.664427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.664463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.664497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490419909:8288]
2025-10-02T09:33:53.664519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:53.664587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2137 reason: status is not ok: tablet will be restarted right now sessionId: src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0
2025-10-02T09:33:53.664723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2137 sessionId: src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0 is DEAD
2025-10-02T09:33:53.664854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:53.664861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Write session will restart in 0.005390s
2025-10-02T09:33:53.664881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Write session: Do CDS request
2025-10-02T09:33:53.664886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.671120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.671256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.671273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2138
2025-10-02T09:33:53.671409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.671437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.671447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.671450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.671825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2138 sessionId:  describe result for acl check
2025-10-02T09:33:53.671856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.671862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.671864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.671868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490419962:7722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.672445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490419962:7722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.674765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490419962:7722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.676180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.679189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.679294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.679301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.679307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.679333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.679329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490419962:7722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.679341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490419962:7722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.679342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490419962:7722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.679347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.679364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414860638:3125]
2025-10-02T09:33:53.679731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.679935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.679964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.680159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.680187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.680192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.680192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.680193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.680194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.680194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.680195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.680195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.680196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.680196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.680197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.680197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.680200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.680207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.680209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.680211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.680213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.680215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.680217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.680219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.680221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.680223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.680225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.680227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.680231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.680235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.680239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.680241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.680244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.680246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.680249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.680255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.680258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.680261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.680263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.680265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.680268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.680270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.680276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.680278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.680281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.680283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.680285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.680288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.680290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.680293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.680298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.680300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.680317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.687930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.689601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.689615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.689617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.689620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.689623Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2137 [2:7556555295414860638:3125]
2025-10-02T09:33:53.689631Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.689643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.689645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.689646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.689647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.689655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.689658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.689662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.689692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.689697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.689698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.689700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.689701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.689738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.689743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.689749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.689755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.689766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.689780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420130:7722], now have 1 active actors on pipe
2025-10-02T09:33:53.689785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490419910:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.689789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.689790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.689791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.689798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.689810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.689816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.689819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.689820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.689820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.689822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.689816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2137
2025-10-02T09:33:53.689836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.689841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.689847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.689854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.689856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.689853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2137
2025-10-02T09:33:53.689875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.689882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.689884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.689885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.689891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.689899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.689911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.690034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.690041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.690049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.690128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2138 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0
2025-10-02T09:33:53.690415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515e8ffa-c391f677-1c03867d-b9015fd8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.692955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Write session: try to update token
2025-10-02T09:33:53.692966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.699665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.699689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.699692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.699694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.699702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.699708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.699714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414860632:3125]
2025-10-02T09:33:53.699746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.699752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.699758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.699758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.699760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.699761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.699951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.705605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId: src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.707895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.764387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490420141:8288]
2025-10-02T09:33:53.764574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2137, pipe: [1:7556555295490420141:8288]
2025-10-02T09:33:53.809708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.810147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.810157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.810170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420141:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.810289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.810340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:53.810346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.810391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490420141:8288]
2025-10-02T09:33:53.810412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0
2025-10-02T09:33:53.810541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2138 sessionId: src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0 is DEAD
2025-10-02T09:33:53.810671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:53.810682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Write session will restart in 0.009630s
2025-10-02T09:33:53.810703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Write session: Do CDS request
2025-10-02T09:33:53.810709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.821114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.821249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.821260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2139
2025-10-02T09:33:53.821394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.821421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.821430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.821434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.821771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2139 sessionId:  describe result for acl check
2025-10-02T09:33:53.821802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.821809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.821811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.821815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490420327:7709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.821885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.822256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490420327:7709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.823804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490420327:7709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.825029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.825134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.825141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.825147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.825173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.825196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414860861:3123]
2025-10-02T09:33:53.825536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.825698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490420327:7709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.825708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490420327:7709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.825709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490420327:7709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.825714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.825722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.825745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.825920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.825950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.825954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.825954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.825955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.825955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.825956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.825956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.825957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.825957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.825958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.825959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.825959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.825962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.825968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.825970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.825972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.825974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.825976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.825978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.825980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.825982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.825984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.825986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.825988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.825992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.825996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.825999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.826002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.826004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.826006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.826008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.826011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.826013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.826016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.826018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.826021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.826023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.826026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.826028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.826030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.826032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.826035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.826037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.826040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.826042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.826045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.826047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.826050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.826067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.833405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.834968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.834979Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.834981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.834983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.834986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2138 [2:7556555295414860861:3123]
2025-10-02T09:33:53.834992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.835002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.835007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.835008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.835009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.835018Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.835021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.835024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.835051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.835056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.835057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.835059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.835061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.835098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.835103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.835110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.835115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.835126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.835140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420142:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.835146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420364:7709], now have 1 active actors on pipe
2025-10-02T09:33:53.835149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.835151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.835152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.835159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.835168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.835173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.835176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.835177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.835179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.835180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.835181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2138
2025-10-02T09:33:53.835193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.835199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.835205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.835218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.835220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.835209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2138
2025-10-02T09:33:53.835234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.835241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.835243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.835244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.835248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.835254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.835264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.835371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.835376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.835383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.835458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2139 partition: 0 MaxSeqNo: 36 sessionId: src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0
2025-10-02T09:33:53.835802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a0f146-889f6ab6-91d42f85-134feabb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.838563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Write session: try to update token
2025-10-02T09:33:53.838575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.845563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.845578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.845579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.845580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.845584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.845587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.845589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414860856:3123]
2025-10-02T09:33:53.845610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.845613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.845615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.845615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.845620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.845623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.845722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.851571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId: src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.853994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:53.910343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555295490420379:8288]
2025-10-02T09:33:53.910740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2138, pipe: [1:7556555295490420379:8288]
2025-10-02T09:33:53.955320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:53.955723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.955731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.955744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420379:8288], now have 1 active actors on pipe
2025-10-02T09:33:53.955861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:53.955917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:53.955943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:53.955992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555295490420379:8288]
2025-10-02T09:33:53.955995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2139 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0
2025-10-02T09:33:53.956121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2139 sessionId: src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0 is DEAD
2025-10-02T09:33:53.956240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:53.956250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Write session will restart in 0.005836s
2025-10-02T09:33:53.956269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Write session: Do CDS request
2025-10-02T09:33:53.956273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:53.963087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.963219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:53.963229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2140
2025-10-02T09:33:53.963364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:53.963392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:53.963401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:53.963405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:53.963689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2140 sessionId:  describe result for acl check
2025-10-02T09:33:53.963714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:53.963718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:53.963719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:53.963722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555295490420452:7685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:53.964096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555295490420452:7685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:53.966157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555295490420452:7685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:53.968042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555295490420452:7685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:53.968050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555295490420452:7685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:53.968052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555295490420452:7685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:53.968056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:53.968095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:53.971008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:53.971111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:53.971117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:53.971123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:53.971150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:53.971320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555295414861098:3117]
2025-10-02T09:33:53.971658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:53.971857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:53.971885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:53.972063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:53.972093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.972097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.972097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.972098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.972098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.972099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.972099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.972100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.972100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.972101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.972101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.972102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.972105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.972110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.972112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.972115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.972117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.972119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.972121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.972123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.972125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.972127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.972129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.972131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.972134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.972138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:53.972143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.972145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:53.972147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.972150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:53.972152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.972155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:53.972157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.972159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:53.972161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.972164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:53.972166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.972169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:53.972171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.972173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:53.972175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.972178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:53.972180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.972183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.972187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.972189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.972191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.972194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.972210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:53.979560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:53.981019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:53.981031Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:53.981032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:53.981034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:53.981038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2139 [2:7556555295414861098:3117]
2025-10-02T09:33:53.981047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:53.981060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:53.981064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.981066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.981067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.981076Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:53.981082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:53.981086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:53.981126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.981131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.981132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.981134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:53.981135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:53.981178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:53.981185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.981195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:53.981208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:53.981222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:53.981239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420386:2446], now have 1 active actors on pipe
2025-10-02T09:33:53.981245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555295490420603:7685], now have 1 active actors on pipe
2025-10-02T09:33:53.981249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.981250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.981251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.981259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:53.981271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:53.981274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:53.981276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:53.981277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:53.981283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:53.981286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:53.981277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2139
2025-10-02T09:33:53.981287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2139
2025-10-02T09:33:53.981306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.981312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:53.981314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:53.981322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.981329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.981359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:53.981368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:53.981373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:53.981374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:53.981380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:53.981388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:53.981404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.981515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:53.981521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:53.981531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:53.981600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2140 partition: 0 MaxSeqNo: 36 sessionId: src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0
2025-10-02T09:33:53.981890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ff97df-db539dac-f716f4e0-7ace6e49_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:53.984420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Write session: try to update token
2025-10-02T09:33:53.984430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:53.990510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:53.990526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:53.990528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:53.990529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:53.990534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.990536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.990538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555295414861092:3117]
2025-10-02T09:33:53.990558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:53.990563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:53.990566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:53.990567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:53.990567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:53.990570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:53.990681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:53.996074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId: src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:53.998508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.056251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785387924:8288]
2025-10-02T09:33:54.056462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2139, pipe: [1:7556555299785387924:8288]
2025-10-02T09:33:54.099699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.100252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.100262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.100275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785387924:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.100429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.100452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:54.100467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:54.100492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.100524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2140 reason: error at write: Disconnected sessionId: src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0
2025-10-02T09:33:54.100542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785387924:8288]
2025-10-02T09:33:54.100649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2140 sessionId: src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0 is DEAD
2025-10-02T09:33:54.100796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:54.100817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Write session will restart in 0.008875s
2025-10-02T09:33:54.100832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Write session: Do CDS request
2025-10-02T09:33:54.100837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.111203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.111393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.111408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2141
2025-10-02T09:33:54.111571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.111598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.111607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.111611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.111939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2141 sessionId:  describe result for acl check
2025-10-02T09:33:54.111969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.111973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.111974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.111977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785388110:7678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.112256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.112337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785388110:7678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.114248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785388110:7678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.115579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.115685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.115691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.115697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.115725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.115752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709828619:3097]
2025-10-02T09:33:54.116090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.116272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.116300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.116484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.116503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785388110:7678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.116511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785388110:7678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.116513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785388110:7678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.116515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.116517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.116519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.116520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.116520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.116521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.116521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.116522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.116523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.116523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.116524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.116524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.116525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.116527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.116533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.116535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.116537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.116539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.116541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.116543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.116545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.116547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.116549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.116551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.116553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.116557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.116561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.116564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.116567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.116569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.116572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.116574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.116576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.116579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.116581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.116583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.116586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.116589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.116592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.116594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.116597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.116599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.116602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.116604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.116607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.116608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.116611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.116618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.116623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.116653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:54.124164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:54.125795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:54.125806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:54.125807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:54.125809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:54.125812Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2140 [2:7556555299709828619:3097]
2025-10-02T09:33:54.125819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:54.125829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:54.125830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.125831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.125832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.125841Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:54.125844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:54.125848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:54.125883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.125888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.125891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.125893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:54.125894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:54.125941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:54.125948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.125958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.125971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.125989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:54.126006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785387925:2446], now have 1 active actors on pipe
2025-10-02T09:33:54.126011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388148:7678], now have 1 active actors on pipe
2025-10-02T09:33:54.126015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.126018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.126019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.126018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2140
2025-10-02T09:33:54.126028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:54.126038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:54.126040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:54.126041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:54.126041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:54.126053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:54.126058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:54.126048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2140
2025-10-02T09:33:54.126085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.126093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.126101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.126109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:54.126118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:54.126130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:54.126139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.126145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.126147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:54.126153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.126164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:54.126183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.126279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.126286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.126297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.126369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2141 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0
2025-10-02T09:33:54.126635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53470ff-c5215eda-75c0839b-53c6a03a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:54.129318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Write session: try to update token
2025-10-02T09:33:54.129333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:54.135185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:54.135196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.135197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:54.135198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:54.135202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.135204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.135206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709828614:3097]
2025-10-02T09:33:54.135226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:54.135229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.135230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:54.135229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:54.135232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:54.135235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:54.135362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:54.141605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId: src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:54.143872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.200616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785388159:8288]
2025-10-02T09:33:54.200830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2140, pipe: [1:7556555299785388159:8288]
2025-10-02T09:33:54.244274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.244715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.244726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.244739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388159:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.244937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.244934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.244972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:54.244973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:54.244978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785388159:8288]
2025-10-02T09:33:54.245026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2141 reason: error at write: Disconnected sessionId: src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0
2025-10-02T09:33:54.245167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2141 sessionId: src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0 is DEAD
2025-10-02T09:33:54.245327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:54.245339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Write session will restart in 0.009332s
2025-10-02T09:33:54.245362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Write session: Do CDS request
2025-10-02T09:33:54.245366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.256140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.256245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.256263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2142
2025-10-02T09:33:54.256402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.256429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.256439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.256442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.256737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2142 sessionId:  describe result for acl check
2025-10-02T09:33:54.256764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.256768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.256769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.256772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785388350:7659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.257136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785388350:7659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.259055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785388350:7659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.259292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.259567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.259669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.259677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.259682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.259707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.259731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709828844:3094]
2025-10-02T09:33:54.260070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.260236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.260263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.260444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.260473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.260477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.260478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.260478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.260479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.260479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.260480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.260480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.260481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.260482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.260482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.260482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.260485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.260491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.260493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.260495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.260497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.260499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.260501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.260503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.260505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.260507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.260509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.260511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.260515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.260519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.260522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.260525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.260527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.260530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.260532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.260535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.260538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.260541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.260543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.260546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.260548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.260551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.260554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.260557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.260559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.260563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.260565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.260567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.260571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.260574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.260576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.260578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.260596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:54.260893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785388350:7659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.260901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785388350:7659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.260903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785388350:7659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.260906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.268027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:54.269565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:54.269577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:54.269578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:54.269580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:54.269583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2141 [2:7556555299709828844:3094]
2025-10-02T09:33:54.269590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:54.269600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:54.269605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.269607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.269608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.269617Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:54.269620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:54.269623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:54.269652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.269657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.269658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.269660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:54.269661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:54.269704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:54.269710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.269720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.269733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.269751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:54.269767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388388:7659], now have 1 active actors on pipe
2025-10-02T09:33:54.269772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388160:2446], now have 1 active actors on pipe
2025-10-02T09:33:54.269776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.269778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.269765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2141
2025-10-02T09:33:54.269779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.269786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:54.269796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:54.269800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:54.269802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:54.269804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:54.269790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2141
2025-10-02T09:33:54.269811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:54.269817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:54.269829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.269836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.269859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.269867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:54.269875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:54.269880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:54.269882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.269884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.269885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:54.269890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.269898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:54.269921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.270030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.270037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.270048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.270117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2142 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0
2025-10-02T09:33:54.270384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddea39-1feae9c4-111a10e8-4899d4ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:54.272886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Write session: try to update token
2025-10-02T09:33:54.272898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:54.278913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:54.278925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.278926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:54.278927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:54.278930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.278932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.278936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709828839:3094]
2025-10-02T09:33:54.278953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:54.278959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.278960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:54.278965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:54.278976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:54.278979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:54.279062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:54.285084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId: src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:54.287306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.344994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785388397:8288]
2025-10-02T09:33:54.345164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2141, pipe: [1:7556555299785388397:8288]
2025-10-02T09:33:54.387897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.388131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.388141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.388153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388397:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.388305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.388329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.388342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785388397:8288]
2025-10-02T09:33:54.388356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:54.388361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:54.388403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2142 reason: error at write: Disconnected sessionId: src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0
2025-10-02T09:33:54.388540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2142 sessionId: src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0 is DEAD
2025-10-02T09:33:54.388701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:54.388715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Write session will restart in 0.005098s
2025-10-02T09:33:54.388735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Write session: Do CDS request
2025-10-02T09:33:54.388740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.395116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.395207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.395215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2143
2025-10-02T09:33:54.395304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.395323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.395328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.395330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.395692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2143 sessionId:  describe result for acl check
2025-10-02T09:33:54.395712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.395716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.395717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.395720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785388474:7639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.396015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785388474:7639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.397663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785388474:7639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.399703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785388474:7639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.399714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785388474:7639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.399716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785388474:7639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.399720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.400100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.403233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.403331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.403338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.403343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.403371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.403398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709829103:3085]
2025-10-02T09:33:54.403733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.403891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.403920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.404097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.404125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.404129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.404130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.404130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.404131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.404131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.404132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.404132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.404133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.404133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.404134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.404134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.404137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.404143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.404145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.404147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.404149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.404151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.404153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.404155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.404157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.404159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.404161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.404163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.404166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.404171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.404175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.404178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.404180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.404183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.404185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.404188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.404191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.404194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.404196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.404199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.404201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.404203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.404206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.404208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.404210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.404213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.404219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.404221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.404223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.404229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.404231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.404234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.404250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:54.411706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:54.413265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:54.413278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:54.413279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:54.413281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:54.413285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2142 [2:7556555299709829103:3085]
2025-10-02T09:33:54.413291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:54.413300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:54.413301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.413303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.413304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.413313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:54.413317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:54.413321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:54.413352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.413357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.413358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.413360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:54.413362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:54.413403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:54.413409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.413419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.413429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.413446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:54.413464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388411:2446], now have 1 active actors on pipe
2025-10-02T09:33:54.413469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388631:7639], now have 1 active actors on pipe
2025-10-02T09:33:54.413473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.413475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.413476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.413483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:54.413493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:54.413498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:54.413500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:54.413502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:54.413502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:54.413503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:54.413517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.413524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:54.413525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:54.413507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2142
2025-10-02T09:33:54.413540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.413547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.413569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ab343c4-804e8ebf-140a928e-703ad941_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:54.413579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.413582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.413585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:54.413592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.413599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:54.413616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.413696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.413703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.413712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.413780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2143 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ab343c4-804e8ebf-140a928e-703ad941_0
2025-10-02T09:33:54.413805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2142
2025-10-02T09:33:54.414004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3614e5-ead3079d-ff3a5196-6a9450ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ab343c4-804e8ebf-140a928e-703ad941_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:54.416483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Write session: try to update token
2025-10-02T09:33:54.416497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:54.422753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:54.422765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.422766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:54.422767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:54.422770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.422773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.422775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709829098:3085]
2025-10-02T09:33:54.422793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:54.422800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.422801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:54.422805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:54.422809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:54.422813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:54.422906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:54.428865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId: src_id|2ab343c4-804e8ebf-140a928e-703ad941_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:54.431216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.488374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785388655:8288]
2025-10-02T09:33:54.488586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2142, pipe: [1:7556555299785388655:8288]
2025-10-02T09:33:54.530345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.530674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.530683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.530696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388655:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.530883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:54.530896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:54.530895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.530944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785388655:8288]
2025-10-02T09:33:54.530949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2143 reason: error at write: Disconnected sessionId: src_id|2ab343c4-804e8ebf-140a928e-703ad941_0
2025-10-02T09:33:54.531077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2143 sessionId: src_id|2ab343c4-804e8ebf-140a928e-703ad941_0 is DEAD
2025-10-02T09:33:54.531197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:54.531206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Write session will restart in 0.009916s
2025-10-02T09:33:54.531223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Write session: Do CDS request
2025-10-02T09:33:54.531227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.531482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.542208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.542356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.542375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2144
2025-10-02T09:33:54.542487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.542513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.542522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.542527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.542682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.542912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2144 sessionId:  describe result for acl check
2025-10-02T09:33:54.542946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.542955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.542956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.542961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785388847:7611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.543391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785388847:7611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.545858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785388847:7611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.545919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.546025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.546032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.546038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.546064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.546089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709829337:3079]
2025-10-02T09:33:54.546436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.546612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.546647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.546832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.546865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.546869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.546870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.546870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.546871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.546872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.546872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.546873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.546873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.546874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.546874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.546875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.546877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.546884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.546886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.546888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.546890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.546892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.546894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.546896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.546898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.546900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.546902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.546904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.546909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.546913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.546916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.546919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.546921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.546923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.546925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.546928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.546930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.546933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.546935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.546938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.546940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.546943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.546945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.546948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.546950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.546953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.546959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.546962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.546965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.546967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.546972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.546975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.546992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:54.550791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785388847:7611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.550799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785388847:7611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.550803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785388847:7611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.550807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.554436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:54.556161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:54.556173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:54.556175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:54.556178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:54.556182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2143 [2:7556555299709829337:3079]
2025-10-02T09:33:54.556192Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:54.556204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:54.556206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.556207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.556208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.556217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:54.556221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:54.556229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:54.556261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.556265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.556266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.556268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:54.556269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:54.556311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:54.556317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.556327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.556340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.556357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:54.556376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388886:7611], now have 1 active actors on pipe
2025-10-02T09:33:54.556381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388657:2446], now have 1 active actors on pipe
2025-10-02T09:33:54.556386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.556387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.556388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.556396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:54.556392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2143
2025-10-02T09:33:54.556410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:54.556411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:54.556413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:54.556415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:54.556427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:54.556409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2143
2025-10-02T09:33:54.556429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:54.556461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.556467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.556477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.556485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:54.556493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:54.556506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68a017d7-57abbf44-b9061118-2daef48c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:54.556515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.556522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.556523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:54.556532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.556543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:54.556563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.556669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.556676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.556686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.556756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2144 partition: 0 MaxSeqNo: 36 sessionId: src_id|68a017d7-57abbf44-b9061118-2daef48c_0
2025-10-02T09:33:54.557046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab343c4-804e8ebf-140a928e-703ad941_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68a017d7-57abbf44-b9061118-2daef48c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:54.559664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Write session: try to update token
2025-10-02T09:33:54.559678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:54.565568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:54.565584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.565585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:54.565586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:54.565590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.565592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.565594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709829331:3079]
2025-10-02T09:33:54.565613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:54.565615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.565617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:54.565620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:54.565623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:54.565625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:54.565760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:54.572469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId: src_id|68a017d7-57abbf44-b9061118-2daef48c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:54.574761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.631236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785388893:8288]
2025-10-02T09:33:54.631431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2143, pipe: [1:7556555299785388893:8288]
2025-10-02T09:33:54.675913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.676429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.676440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.676452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388893:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.676646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.676691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.676691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:54.676696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:54.676733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785388893:8288]
2025-10-02T09:33:54.676768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2144 reason: error at write: Disconnected sessionId: src_id|68a017d7-57abbf44-b9061118-2daef48c_0
2025-10-02T09:33:54.676991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2144 sessionId: src_id|68a017d7-57abbf44-b9061118-2daef48c_0 is DEAD
2025-10-02T09:33:54.677137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:54.677149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Write session will restart in 0.008734s
2025-10-02T09:33:54.677181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Write session: Do CDS request
2025-10-02T09:33:54.677188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.687208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.687289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.687307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2145
2025-10-02T09:33:54.687412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.687440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.687444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.687448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.687879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2145 sessionId:  describe result for acl check
2025-10-02T09:33:54.687918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.687924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.687932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.687938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785389084:7601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.688362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785389084:7601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.688785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.690128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785389084:7601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.691855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.691958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.691965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.691971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.691996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.692019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709829566:3073]
2025-10-02T09:33:54.692071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785389084:7601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.692080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785389084:7601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.692083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785389084:7601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.692087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.692387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.692556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.692588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.692768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.692798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.692811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.692813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.692814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.692814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.692815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.692815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.692816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.692816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.692817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.692817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.692818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.692821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.692827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.692829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.692831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.692833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.692835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.692837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.692839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.692841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.692843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.692845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.692847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.692851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.692855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.692858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.692861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.692863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.692866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.692868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.692871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.692874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.692876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.692878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.692881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.692883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.692886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.692888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.692891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.692893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.692896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.692902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.692905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.692907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.692909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.692911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.692914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.692933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:54.700269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:54.701741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:54.701754Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:54.701755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:54.701757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:54.701760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2144 [2:7556555299709829566:3073]
2025-10-02T09:33:54.701768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:54.701777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:54.701782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.701784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.701785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.701794Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:54.701798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:54.701802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:54.702001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.702007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.702008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.702010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:54.702011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:54.702053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:54.702059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.702068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.702081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.702098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:54.702115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389121:7601], now have 1 active actors on pipe
2025-10-02T09:33:54.702121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785388894:2446], now have 1 active actors on pipe
2025-10-02T09:33:54.702125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.702126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.702127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.702135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:54.702147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:54.702154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:54.702156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:54.702157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:54.702157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:54.702159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:54.702172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.702177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:54.702163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2144
2025-10-02T09:33:54.702188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:54.702171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2144
2025-10-02T09:33:54.702207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.702214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.702232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:54.702242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.702246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.702248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:54.702254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.702264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:54.702277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.702407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.702413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.702422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.702492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2145 partition: 0 MaxSeqNo: 36 sessionId: src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0
2025-10-02T09:33:54.702765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a017d7-57abbf44-b9061118-2daef48c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:54.705443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Write session: try to update token
2025-10-02T09:33:54.705458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:54.710977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:54.710989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.710993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.711013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:54.711023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:54.711141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:54.711249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:54.711361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:54.711468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:54.711624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:54.711645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:54.717723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId: src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:54.719252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:54.719264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.719265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:54.719266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:54.719270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.719272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.719274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709829561:3073]
2025-10-02T09:33:54.719292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:54.719295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.719296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:54.719298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:54.719299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:54.719301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:54.719407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:54.719873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.777166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785389132:8288]
2025-10-02T09:33:54.777386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2144, pipe: [1:7556555299785389132:8288]
2025-10-02T09:33:54.828594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.829040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.829049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.829062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389132:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.829239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.829287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.829298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:54.829353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785389132:8288]
2025-10-02T09:33:54.829399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0
2025-10-02T09:33:54.829539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2145 sessionId: src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0 is DEAD
2025-10-02T09:33:54.829672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:54.829681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Write session will restart in 0.005651s
2025-10-02T09:33:54.829702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Write session: Do CDS request
2025-10-02T09:33:54.829708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.836137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.836225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.836239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2146
2025-10-02T09:33:54.836325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.836348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.836356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.836359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.836670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2146 sessionId:  describe result for acl check
2025-10-02T09:33:54.836695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.836700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.836701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.836706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785389179:7577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.837177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785389179:7577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.838697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785389179:7577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.840981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785389179:7577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.840991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785389179:7577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.840993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785389179:7577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.840998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.844837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.845122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.845237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.845244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.845250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.845277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.845298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709829797:3070]
2025-10-02T09:33:54.845642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.845805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.845833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.846013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.846043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.846047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.846047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.846048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.846048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.846049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.846049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.846050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.846050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.846051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.846052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.846052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.846055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.846061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.846063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.846065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.846067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.846069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.846071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.846073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.846075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.846077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.846079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.846081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.846086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.846090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.846093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.846096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.846098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.846101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.846103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.846105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.846109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.846112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.846114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.846117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.846119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.846121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.846124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.846126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.846128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.846131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.846133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.846136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.846138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.846141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.846143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.846146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.846161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:54.853538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:54.855217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:54.855228Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:54.855230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:54.855232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:54.855236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2145 [2:7556555299709829797:3070]
2025-10-02T09:33:54.855244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:54.855254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:54.855259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.855261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.855262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.855271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:54.855274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:54.855280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:54.855309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.855313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.855314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.855316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:54.855317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:54.855361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:54.855367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.855378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.855391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.855408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:54.855426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389133:2446], now have 1 active actors on pipe
2025-10-02T09:33:54.855433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389356:7577], now have 1 active actors on pipe
2025-10-02T09:33:54.855436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.855438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.855439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.855447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:54.855458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:54.855460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:54.855462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:54.855463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:54.855468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:54.855470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:54.855466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2145
2025-10-02T09:33:54.855489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.855471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2145
2025-10-02T09:33:54.855495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:54.855496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:54.855507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.855514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.855543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8de8441-b564751c-f182d7b9-be498291_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:54.855552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:54.855557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:54.855558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:54.855564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:54.855572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:54.855589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.855706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.855713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.855723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:54.855795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2146 partition: 0 MaxSeqNo: 36 sessionId: src_id|c8de8441-b564751c-f182d7b9-be498291_0
2025-10-02T09:33:54.856052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a0b4f8-cff8804-a9cbc498-776a8bf8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c8de8441-b564751c-f182d7b9-be498291_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:54.858611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Write session: try to update token
2025-10-02T09:33:54.858637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:54.864750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:54.864763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:54.864765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:54.864766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:54.864769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.864772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.864773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709829792:3070]
2025-10-02T09:33:54.864793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:54.864812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.864816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:54.864820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:54.864824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:54.864828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:54.864925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:54.870726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId: src_id|c8de8441-b564751c-f182d7b9-be498291_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:54.872891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:54.929671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555299785389380:8288]
2025-10-02T09:33:54.929863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2145, pipe: [1:7556555299785389380:8288]
2025-10-02T09:33:54.977520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:54.977952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:54.977961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:54.977974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389380:8288], now have 1 active actors on pipe
2025-10-02T09:33:54.978129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:54.978208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:54.978214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555299785389380:8288]
2025-10-02T09:33:54.978239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:54.978313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2146 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8de8441-b564751c-f182d7b9-be498291_0
2025-10-02T09:33:54.978462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2146 sessionId: src_id|c8de8441-b564751c-f182d7b9-be498291_0 is DEAD
2025-10-02T09:33:54.978595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:54.978606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Write session will restart in 0.008701s
2025-10-02T09:33:54.978636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Write session: Do CDS request
2025-10-02T09:33:54.978642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:54.988237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.988335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:54.988353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2147
2025-10-02T09:33:54.988459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:54.988482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:54.988487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:54.988492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:54.988865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2147 sessionId:  describe result for acl check
2025-10-02T09:33:54.988898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:54.988903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:54.988904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:54.988909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555299785389556:7567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:54.989466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555299785389556:7567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:54.990823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:54.991283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555299785389556:7567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:54.994320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:54.994429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:54.994436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:54.994442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:54.994468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:54.994495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555299709830039:3051]
2025-10-02T09:33:54.994547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555299785389556:7567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:54.994557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555299785389556:7567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:54.994561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555299785389556:7567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:54.994566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:54.994873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:54.995090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:54.995123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:54.995303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:54.995341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.995346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.995346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.995347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.995348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.995348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.995349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.995349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.995350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.995350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.995351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.995351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.995354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.995360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.995363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.995365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.995367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.995369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.995370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.995372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.995374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.995376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.995378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.995380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.995384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.995388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:54.995391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.995394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:54.995397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.995400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:54.995402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.995405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:54.995407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.995410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:54.995412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.995414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:54.995416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.995419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:54.995421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.995424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:54.995426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.995429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:54.995431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.995434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:54.995436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.995438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:54.995440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.995443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:54.995461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.002921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.004589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.004601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.004602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.004605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.004608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2146 [2:7556555299709830039:3051]
2025-10-02T09:33:55.004617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.004627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.004632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.004633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.004634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.004643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.004647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.004651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.004686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.004691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.004692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.004694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.004696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.004737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.004744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.004754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.004767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.004784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.004815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389381:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.004820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555299785389609:7567], now have 1 active actors on pipe
2025-10-02T09:33:55.004824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.004825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.004826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.004834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.004820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2146
2025-10-02T09:33:55.004848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.004846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2146
2025-10-02T09:33:55.004849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.004851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.004853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.004863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.004865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.004877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.004885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.004908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.004917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.004926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.004931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.004933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.004935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.004937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.004942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.004951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.004974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.005113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.005120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.005131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.005201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2147 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0
2025-10-02T09:33:55.005438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8de8441-b564751c-f182d7b9-be498291_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.007994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Write session: try to update token
2025-10-02T09:33:55.008004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.014038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.014051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.014052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.014053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.014057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.014059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.014061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555299709830034:3051]
2025-10-02T09:33:55.014080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.014082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.014083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.014085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.014085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.014087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.014190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.019818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId: src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.021994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.078210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080356929:8288]
2025-10-02T09:33:55.078426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2146, pipe: [1:7556555304080356929:8288]
2025-10-02T09:33:55.124211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.124656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.124666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.124678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080356929:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.124837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.124871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.124912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:55.124929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080356929:8288]
2025-10-02T09:33:55.124974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2147 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0
2025-10-02T09:33:55.125122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2147 sessionId: src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0 is DEAD
2025-10-02T09:33:55.125274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:55.125286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Write session will restart in 0.008052s
2025-10-02T09:33:55.125308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Write session: Do CDS request
2025-10-02T09:33:55.125314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:55.134164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.134282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:55.134301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2148
2025-10-02T09:33:55.134388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.134411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:55.134419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:55.134422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:55.134806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2148 sessionId:  describe result for acl check
2025-10-02T09:33:55.134845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:55.134853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:55.134859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:55.134864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555304080357070:7539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:55.135323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555304080357070:7539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:55.137074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555304080357070:7539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:55.140574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:55.140698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555304080357070:7539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:55.140709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555304080357070:7539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:55.140713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555304080357070:7539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:55.140718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:55.140850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:55.140970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:55.140977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:55.140983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:55.141010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:55.141219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555304004797570:3060]
2025-10-02T09:33:55.141570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:55.141762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:55.141791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:55.141971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:55.142003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.142007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.142008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.142008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.142009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.142010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.142010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.142011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.142011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.142012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.142012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.142013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.142016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.142022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.142025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.142027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.142029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.142031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.142033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.142035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.142036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.142039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.142040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.142042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.142046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.142050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.142053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.142056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.142058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.142061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.142063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.142066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.142068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.142072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.142074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.142076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.142078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.142080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.142082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.142085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.142087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.142089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.142091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.142094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.142096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.142099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.142103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.142106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.142122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.149526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.151134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.151146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.151147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.151149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.151152Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2147 [2:7556555304004797570:3060]
2025-10-02T09:33:55.151159Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.151169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.151170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.151172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.151173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.151181Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.151187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.151191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.151222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.151227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.151228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.151230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.151231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.151274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.151281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.151290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.151304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.151321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.151335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357159:7539], now have 1 active actors on pipe
2025-10-02T09:33:55.151340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080356930:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.151344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.151346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.151347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.151354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.151365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.151369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.151371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.151372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.151375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.151377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.151390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.151395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.151396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.151405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2147
2025-10-02T09:33:55.151429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2147
2025-10-02T09:33:55.151474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.151481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.151500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63d0d36b-381a784e-1834cc58-26b0b287_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.151508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.151512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.151513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.151518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.151527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.151538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.151666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.151672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.151681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.151747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2148 partition: 0 MaxSeqNo: 36 sessionId: src_id|63d0d36b-381a784e-1834cc58-26b0b287_0
2025-10-02T09:33:55.152013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc8510-484ff4e-f0df7788-f4ec60a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63d0d36b-381a784e-1834cc58-26b0b287_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.154534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Write session: try to update token
2025-10-02T09:33:55.154549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.160727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.160740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.160741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.160742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.160746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.160748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.160752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555304004797564:3060]
2025-10-02T09:33:55.160770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.160773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.160774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.160775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.160777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.160779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.160910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.166925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId: src_id|63d0d36b-381a784e-1834cc58-26b0b287_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.169150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.225160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080357171:8288]
2025-10-02T09:33:55.225385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2147, pipe: [1:7556555304080357171:8288]
2025-10-02T09:33:55.269581Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.269800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.269810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.269822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357171:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.269986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.270021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080357171:8288]
2025-10-02T09:33:55.270023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.270071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:55.270156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2148 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63d0d36b-381a784e-1834cc58-26b0b287_0
2025-10-02T09:33:55.270306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2148 sessionId: src_id|63d0d36b-381a784e-1834cc58-26b0b287_0 is DEAD
2025-10-02T09:33:55.270438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:55.270450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Write session will restart in 0.008814s
2025-10-02T09:33:55.270472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Write session: Do CDS request
2025-10-02T09:33:55.270478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:55.280140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.280259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:55.280273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2149
2025-10-02T09:33:55.280355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.280377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:55.280385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:55.280389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:55.280740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2149 sessionId:  describe result for acl check
2025-10-02T09:33:55.280772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:55.280778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:55.280779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:55.280784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555304080357366:7530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:55.281235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555304080357366:7530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:55.283009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555304080357366:7530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:55.285139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:55.285236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555304080357366:7530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:55.285245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555304080357366:7530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:55.285247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555304080357366:7530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:55.285251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:55.285406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:55.285510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:55.285517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:55.285523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:55.285550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:55.285572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555304004797802:3058]
2025-10-02T09:33:55.285922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:55.286096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:55.286122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:55.286304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:55.286335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.286339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.286340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.286340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.286341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.286342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.286342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.286343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.286343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.286344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.286344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.286345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.286347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.286354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.286356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.286358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.286360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.286363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.286365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.286366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.286368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.286371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.286373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.286375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.286379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.286383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.286385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.286388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.286390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.286393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.286395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.286398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.286400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.286403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.286405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.286408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.286410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.286413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.286415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.286417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.286419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.286422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.286424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.286428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.286429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.286432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.286437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.286440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.286457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.293816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.295388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.295400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.295401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.295403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.295407Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2148 [2:7556555304004797802:3058]
2025-10-02T09:33:55.295413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.295422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.295425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.295426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.295427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.295437Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.295440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.295446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.295475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.295480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.295481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.295483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.295484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.295522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.295528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.295538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.295546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.295563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.295582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357404:7530], now have 1 active actors on pipe
2025-10-02T09:33:55.295589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357174:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.295593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.295594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.295595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.295604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.295614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.295617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.295620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.295621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.295624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.295627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.295617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2148
2025-10-02T09:33:55.295617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2148
2025-10-02T09:33:55.295643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.295650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.295650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.295660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.295667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.295699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1485783a-21ffdf0b-445949cc-642cf60f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.295708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.295711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.295712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.295718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.295728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.295741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.295892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.295899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.295909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.295980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2149 partition: 0 MaxSeqNo: 36 sessionId: src_id|1485783a-21ffdf0b-445949cc-642cf60f_0
2025-10-02T09:33:55.296212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d0d36b-381a784e-1834cc58-26b0b287_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1485783a-21ffdf0b-445949cc-642cf60f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.298842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Write session: try to update token
2025-10-02T09:33:55.298861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.304713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.304726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.304727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.304728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.304732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.304734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.304736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555304004797796:3058]
2025-10-02T09:33:55.304755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.304758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.304759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.304760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.304763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.304765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.304884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.311810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId: src_id|1485783a-21ffdf0b-445949cc-642cf60f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.314042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.370048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080357416:8288]
2025-10-02T09:33:55.370250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2148, pipe: [1:7556555304080357416:8288]
2025-10-02T09:33:55.413148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.413351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.413361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.413372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357416:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.413527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.413525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.413531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:55.413535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:55.413566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080357416:8288]
2025-10-02T09:33:55.413595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2149 reason: error at write: Disconnected sessionId: src_id|1485783a-21ffdf0b-445949cc-642cf60f_0
2025-10-02T09:33:55.413744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2149 sessionId: src_id|1485783a-21ffdf0b-445949cc-642cf60f_0 is DEAD
2025-10-02T09:33:55.413883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:55.413896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Write session will restart in 0.007434s
2025-10-02T09:33:55.413921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Write session: Do CDS request
2025-10-02T09:33:55.413927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:55.422158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.422218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:55.422234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2150
2025-10-02T09:33:55.422323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.422347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:55.422355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:55.422358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:55.422662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2150 sessionId:  describe result for acl check
2025-10-02T09:33:55.422686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:55.422691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:55.422693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:55.422697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555304080357543:7491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:55.423073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555304080357543:7491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:55.424965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555304080357543:7491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:55.425999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:55.429014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:55.429120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:55.429127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:55.429133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:55.429159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:55.429163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555304080357543:7491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:55.429177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555304080357543:7491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:55.429179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555304080357543:7491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:55.429183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:55.429179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555304004798065:3039]
2025-10-02T09:33:55.429541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:55.429737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:55.429766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:55.429946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:55.429973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.429977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.429978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.429978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.429979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.429980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.429980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.429980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.429981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.429981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.429982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.429982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.429985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.429991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.429993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.429995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.429997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.429999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.430001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.430003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.430005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.430007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.430009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.430010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.430014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.430018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.430022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.430025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.430027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.430029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.430031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.430034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.430037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.430040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.430042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.430044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.430046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.430049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.430055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.430058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.430060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.430063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.430068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.430070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.430072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.430075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.430077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.430080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.430095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.437604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.439298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.439311Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.439312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.439314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.439317Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2149 [2:7556555304004798065:3039]
2025-10-02T09:33:55.439323Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.439333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.439340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.439341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.439342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.439351Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.439354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.439358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.439389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.439394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.439395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.439397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.439399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.439440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.439445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.439452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.439457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.439466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.439480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357423:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.439485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357660:7491], now have 1 active actors on pipe
2025-10-02T09:33:55.439489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.439490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.439491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.439499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.439509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.439512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.439514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.439515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.439520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.439522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.439536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.439541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.439531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2149
2025-10-02T09:33:55.439551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.439565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.439568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.439586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88cc423f-27025f6-f890f41c-e1e21518_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.439594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.439596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.439597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.439603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.439612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.439623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.439710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2149
2025-10-02T09:33:55.439735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.439747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.439767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.439837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2150 partition: 0 MaxSeqNo: 36 sessionId: src_id|88cc423f-27025f6-f890f41c-e1e21518_0
2025-10-02T09:33:55.440078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1485783a-21ffdf0b-445949cc-642cf60f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88cc423f-27025f6-f890f41c-e1e21518_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.442712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Write session: try to update token
2025-10-02T09:33:55.442726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.448560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.448573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.448574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.448575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.448578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.448580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.448582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555304004798060:3039]
2025-10-02T09:33:55.448601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.448603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.448605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.448606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.448609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.448611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.448713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.455201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId: src_id|88cc423f-27025f6-f890f41c-e1e21518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.457590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.513892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080357682:8288]
2025-10-02T09:33:55.514083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2149, pipe: [1:7556555304080357682:8288]
2025-10-02T09:33:55.558237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.558868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.558879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.558892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357682:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.559073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.559056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:55.559071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:55.559078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080357682:8288]
2025-10-02T09:33:55.559099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.559121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2150 reason: error at write: Disconnected sessionId: src_id|88cc423f-27025f6-f890f41c-e1e21518_0
2025-10-02T09:33:55.559256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2150 sessionId: src_id|88cc423f-27025f6-f890f41c-e1e21518_0 is DEAD
2025-10-02T09:33:55.559402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:55.559414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Write session will restart in 0.005031s
2025-10-02T09:33:55.559441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Write session: Do CDS request
2025-10-02T09:33:55.559447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:55.565147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.565235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:55.565247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2151
2025-10-02T09:33:55.565352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.565373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:55.565379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:55.565381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:55.565641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2151 sessionId:  describe result for acl check
2025-10-02T09:33:55.565669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:55.565675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:55.565676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:55.565679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555304080357708:7476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:55.566016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555304080357708:7476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:55.568063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555304080357708:7476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:55.570494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555304080357708:7476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:55.570505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555304080357708:7476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:55.570507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555304080357708:7476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:55.570511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:55.574854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:55.575137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:55.575239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:55.575246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:55.575252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:55.575277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:55.575304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555304004798308:3026]
2025-10-02T09:33:55.575642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:55.575804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:55.575831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:55.576010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:55.576040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.576044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.576045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.576045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.576046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.576046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.576047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.576047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.576048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.576048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.576049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.576049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.576052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.576059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.576061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.576063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.576065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.576067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.576069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.576071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.576073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.576075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.576077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.576079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.576082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.576086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.576089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.576092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.576094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.576097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.576100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.576103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.576105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.576107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.576109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.576112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.576114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.576117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.576119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.576122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.576124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.576127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.576130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.576132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.576134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.576137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.576139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.576141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.576157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.583558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.585170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.585182Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.585183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.585185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.585188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2150 [2:7556555304004798308:3026]
2025-10-02T09:33:55.585195Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.585204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.585205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.585207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.585208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.585218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.585225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.585229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.585258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.585263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.585264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.585266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.585267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.585309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.585315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.585325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.585338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.585354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.585373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357910:7476], now have 1 active actors on pipe
2025-10-02T09:33:55.585378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357683:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.585382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.585383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.585385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.585393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.585405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.585407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.585409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.585411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.585421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.585426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.585451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.585458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.585465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.585473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.585485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.585494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.585499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.585506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.585508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.585514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.585524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.585389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2150
2025-10-02T09:33:55.585544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.585390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2150
2025-10-02T09:33:55.585717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.585725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.585735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.585818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2151 partition: 0 MaxSeqNo: 36 sessionId: src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0
2025-10-02T09:33:55.586091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc423f-27025f6-f890f41c-e1e21518_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.588717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Write session: try to update token
2025-10-02T09:33:55.588730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.594544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.594556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.594558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.594558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.594562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.594564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.594566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555304004798303:3026]
2025-10-02T09:33:55.594585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.594589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.594590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.594591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.594597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.594600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.594714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.601766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId: src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.603930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.659480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080357926:8288]
2025-10-02T09:33:55.659688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2150, pipe: [1:7556555304080357926:8288]
2025-10-02T09:33:55.705473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.705898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.705908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.705921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357926:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.706118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.706156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080357926:8288]
2025-10-02T09:33:55.706171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.706446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:55.706496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2151 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0
2025-10-02T09:33:55.706633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2151 sessionId: src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0 is DEAD
2025-10-02T09:33:55.706793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:55.706806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Write session will restart in 0.008289s
2025-10-02T09:33:55.706828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Write session: Do CDS request
2025-10-02T09:33:55.706834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:55.716229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.716283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:55.716299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2152
2025-10-02T09:33:55.716419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.716445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:55.716453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:55.716456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:55.716793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2152 sessionId:  describe result for acl check
2025-10-02T09:33:55.716834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:55.716839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:55.716843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:55.716847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555304080358123:7468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:55.717283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555304080358123:7468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:55.718303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:55.718745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555304080358123:7468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:55.721225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:55.721413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555304080358123:7468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:55.721423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555304080358123:7468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:55.721425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555304080358123:7468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:55.721428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:55.721430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:55.721436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:55.721443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:55.721478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:55.721512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555304004798543:3023]
2025-10-02T09:33:55.721874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:55.722049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:55.722077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:55.722262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:55.722290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.722294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.722295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.722295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.722296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.722296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.722297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.722297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.722298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.722300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.722303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.722310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.722312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.722315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.722317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.722319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.722321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.722323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.722325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.722327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.722329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.722331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.722335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.722340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.722343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.722345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.722348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.722351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.722353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.722355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.722359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.722362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.722364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.722367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.722369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.722371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.722374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.722376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.722379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.722382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.722384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.722387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.722392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.722395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.722397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.722400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.722420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.730034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.731466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.731479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.731480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.731482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.731486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2151 [2:7556555304004798543:3023]
2025-10-02T09:33:55.731493Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.731503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.731508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.731510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.731511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.731520Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.731526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.731530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.731564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.731568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.731569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.731571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.731573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.731636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.731642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.731651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.731665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.731682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.731699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080357928:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.731705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080358161:7468], now have 1 active actors on pipe
2025-10-02T09:33:55.731708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.731713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.731714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.731723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.731727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.731729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.731730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.731737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.731703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2151
2025-10-02T09:33:55.731753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.731759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.731744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2151
2025-10-02T09:33:55.731786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.731792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.731799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.731805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.731813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.731825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.731834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.731840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.731842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.731849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.731859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.732057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.732189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.732197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.732208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.732280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2152 partition: 0 MaxSeqNo: 36 sessionId: src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0
2025-10-02T09:33:55.732584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9138b64f-bd5238ee-a98b5c70-ff1700e8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.735209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Write session: try to update token
2025-10-02T09:33:55.735225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.741029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.741041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.741043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.741044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.741050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.741054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.741056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555304004798538:3023]
2025-10-02T09:33:55.741076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.741082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.741082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.741083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.741086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.741088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.741190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.747911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId: src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.750137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.806244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080358172:8288]
2025-10-02T09:33:55.806410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2151, pipe: [1:7556555304080358172:8288]
2025-10-02T09:33:55.849466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.849846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.849855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.849867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080358172:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.850037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.850054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:55.850059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080358172:8288]
2025-10-02T09:33:55.850070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:55.850083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.850123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2152 reason: error at write: Disconnected sessionId: src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0
2025-10-02T09:33:55.850253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2152 sessionId: src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0 is DEAD
2025-10-02T09:33:55.850389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:55.850397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Write session will restart in 0.006209s
2025-10-02T09:33:55.850418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Write session: Do CDS request
2025-10-02T09:33:55.850423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:55.857152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.857246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:55.857259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2153
2025-10-02T09:33:55.857353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:55.857376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:55.857384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:55.857387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:55.857747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2153 sessionId:  describe result for acl check
2025-10-02T09:33:55.857775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:55.857780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:55.857784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:55.857791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555304080358249:7461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:55.858217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555304080358249:7461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:55.860357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555304080358249:7461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:55.862386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555304080358249:7461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:55.862397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555304080358249:7461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:55.862399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555304080358249:7461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:55.862403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:55.865485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:55.865789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:55.865987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:55.865995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:55.866002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:55.866035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:55.866059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555304004798781:3017]
2025-10-02T09:33:55.866400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:55.866560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:55.866587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:55.866780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:55.866810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.866814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.866815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.866815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.866816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.866816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.866817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.866818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.866818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.866819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.866819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.866820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.866822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.866829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.866831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.866833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.866835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.866837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.866839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.866841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.866843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.866846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.866847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.866849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.866853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.866857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:55.866860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.866863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:55.866865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.866868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:55.866870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.866873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:55.866875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.866878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:55.866880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.866882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:55.866885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.866887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:55.866889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.866892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:55.866894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.866897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:55.866900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.866902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.866904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.866907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.866909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.866911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.866928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:55.874434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:55.876026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:55.876039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:55.876040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:55.876042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:55.876046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2152 [2:7556555304004798781:3017]
2025-10-02T09:33:55.876055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:55.876066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:55.876067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.876069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.876070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.876079Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:55.876082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:55.876086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:55.876116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.876122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.876123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.876125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:55.876127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:55.876167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:55.876172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.876180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:55.876187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:55.876196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:55.876212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080358409:7461], now have 1 active actors on pipe
2025-10-02T09:33:55.876218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080358177:2446], now have 1 active actors on pipe
2025-10-02T09:33:55.876221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.876222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.876223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.876231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:55.876245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:55.876245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:55.876247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:55.876249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:55.876260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:55.876262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:55.876283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.876294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:55.876306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:55.876321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.876329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.876284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2152
2025-10-02T09:33:55.876290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2152
2025-10-02T09:33:55.876348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb518f02-4635ab7-ace07249-45630fc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:55.876358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:55.876362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:55.876367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:55.876374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:55.876383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:55.876392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.876503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.876512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.876530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:55.876600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2153 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb518f02-4635ab7-ace07249-45630fc6_0
2025-10-02T09:33:55.876889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abde6d98-2454ecb6-c1b38292-7bd8d512_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb518f02-4635ab7-ace07249-45630fc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:55.879458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Write session: try to update token
2025-10-02T09:33:55.879473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:55.885432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:55.885445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:55.885446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:55.885447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:55.885451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.885453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.885456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555304004798776:3017]
2025-10-02T09:33:55.885476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:55.885480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:55.885481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:55.885497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:55.885501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:55.885503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:55.885592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:55.892050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId: src_id|bb518f02-4635ab7-ace07249-45630fc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:55.894264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:55.950148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555304080358429:8288]
2025-10-02T09:33:55.950308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2152, pipe: [1:7556555304080358429:8288]
2025-10-02T09:33:55.994864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:55.995401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:55.995411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:55.995425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080358429:8288], now have 1 active actors on pipe
2025-10-02T09:33:55.995627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:55.995660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:55.995672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555304080358429:8288]
2025-10-02T09:33:55.995677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:55.995695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:55.995728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2153 reason: error at write: Disconnected sessionId: src_id|bb518f02-4635ab7-ace07249-45630fc6_0
2025-10-02T09:33:55.995858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2153 sessionId: src_id|bb518f02-4635ab7-ace07249-45630fc6_0 is DEAD
2025-10-02T09:33:55.996025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:55.996038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Write session will restart in 0.009880s
2025-10-02T09:33:55.996063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Write session: Do CDS request
2025-10-02T09:33:55.996069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.007210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.007360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.007378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2154
2025-10-02T09:33:56.007466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.007489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.007497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.007501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.007794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2154 sessionId:  describe result for acl check
2025-10-02T09:33:56.007829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.007837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.007838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.007842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375325925:7442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.008190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375325925:7442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.010015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375325925:7442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.011286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.011597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.011709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.011716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.011722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.011750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.011774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299766326:2997]
2025-10-02T09:33:56.011892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375325925:7442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.011903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375325925:7442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.011905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375325925:7442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.011909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.012132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.012307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.012339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.012517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.012546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.012550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.012550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.012551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.012551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.012552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.012553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.012553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.012554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.012554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.012555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.012555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.012558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.012564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.012566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.012568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.012570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.012572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.012574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.012576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.012578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.012580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.012582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.012584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.012587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.012591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.012594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.012597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.012599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.012602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.012604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.012607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.012611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.012613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.012615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.012618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.012624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.012627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.012629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.012632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.012634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.012638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.012644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.012646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.012648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.012651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.012653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.012656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.012671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.020260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.021906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.021918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.021919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.021922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.021925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2153 [2:7556555308299766326:2997]
2025-10-02T09:33:56.021932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.021942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.021943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.021945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.021945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.021954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.021960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.021964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.021995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.022000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.022001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.022002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.022004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.022045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.022051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.022060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.022074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.022091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.022108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555304080358430:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.022113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375325961:7442], now have 1 active actors on pipe
2025-10-02T09:33:56.022117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.022118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.022119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.022127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.022125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2153
2025-10-02T09:33:56.022140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.022154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2153
2025-10-02T09:33:56.022142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.022143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.022145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.022155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.022157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.022184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.022191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.022199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.022207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.022220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.022224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.022229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.022232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.022233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.022239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.022250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.022267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.022385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.022390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.022400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.022473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2154 partition: 0 MaxSeqNo: 36 sessionId: src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0
2025-10-02T09:33:56.022759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb518f02-4635ab7-ace07249-45630fc6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.025443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Write session: try to update token
2025-10-02T09:33:56.025459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.031298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.031312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.031314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.031314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.031318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.031320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.031323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299766321:2997]
2025-10-02T09:33:56.031342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.031345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.031345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.031346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.031348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.031350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.031448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.038046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId: src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.040260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.096059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375325994:8288]
2025-10-02T09:33:56.096262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2153, pipe: [1:7556555308375325994:8288]
2025-10-02T09:33:56.140729Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:56.141197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.141207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.141220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375325994:8288], now have 1 active actors on pipe
2025-10-02T09:33:56.141375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:56.141373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:56.141386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375325994:8288]
2025-10-02T09:33:56.141408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:56.141411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:56.141461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2154 reason: error at write: Disconnected sessionId: src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0
2025-10-02T09:33:56.141598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2154 sessionId: src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0 is DEAD
2025-10-02T09:33:56.141744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:56.141757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Write session will restart in 0.009123s
2025-10-02T09:33:56.141779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Write session: Do CDS request
2025-10-02T09:33:56.141785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.152144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.152306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.152321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2155
2025-10-02T09:33:56.152411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.152445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.152451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.152457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.152788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2155 sessionId:  describe result for acl check
2025-10-02T09:33:56.152830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.152837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.152838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.152841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375326194:7430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.153294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375326194:7430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.153359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.155003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375326194:7430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.156323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.156425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.156432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.156438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.156464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.156488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299766567:3008]
2025-10-02T09:33:56.156812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375326194:7430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.156822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375326194:7430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.156823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375326194:7430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.156827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.156839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.157007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.157035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.157222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.157253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.157257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.157258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.157258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.157259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.157259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.157260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.157261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.157261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.157262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.157263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.157263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.157266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.157273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.157275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.157277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.157279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.157281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.157283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.157285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.157287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.157289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.157291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.157293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.157296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.157300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.157303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.157306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.157308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.157311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.157313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.157316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.157318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.157320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.157322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.157325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.157327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.157330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.157335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.157338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.157340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.157343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.157345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.157351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.157353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.157357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.157362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.157365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.157382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.164756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.166400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.166412Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.166413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.166415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.166419Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2154 [2:7556555308299766567:3008]
2025-10-02T09:33:56.166425Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.166438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.166443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.166444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.166445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.166454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.166457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.166464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.166496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.166501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.166502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.166504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.166505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.166544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.166550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.166560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.166573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.166589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.166607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375325995:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.166613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326231:7430], now have 1 active actors on pipe
2025-10-02T09:33:56.166616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.166618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.166625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.166634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.166645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.166647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.166649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.166650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.166652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.166654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.166666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.166672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.166649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2154
2025-10-02T09:33:56.166680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.166662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2154
2025-10-02T09:33:56.166694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.166701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.166725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.166736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.166742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.166744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.166750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.166761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.166775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.166907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.166913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.166923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.166994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2155 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0
2025-10-02T09:33:56.167235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8775dd82-1b6ca291-cd4583c-efdff2ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.170258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Write session: try to update token
2025-10-02T09:33:56.170275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.175829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.175843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.175844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.175845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.175850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.175853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.175855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299766562:3008]
2025-10-02T09:33:56.175873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.175877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.175879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.175881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.175881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.175883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.175994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.183111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId: src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.185442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.241439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375326243:8288]
2025-10-02T09:33:56.241659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2154, pipe: [1:7556555308375326243:8288]
2025-10-02T09:33:56.284396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:56.284605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.284614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.284626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326243:8288], now have 1 active actors on pipe
2025-10-02T09:33:56.284776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:56.284785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:56.284853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375326243:8288]
2025-10-02T09:33:56.284853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:56.284943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0
2025-10-02T09:33:56.285113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2155 sessionId: src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0 is DEAD
2025-10-02T09:33:56.285243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:56.285253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Write session will restart in 0.006419s
2025-10-02T09:33:56.285271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Write session: Do CDS request
2025-10-02T09:33:56.285275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.293053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.293180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.293200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2156
2025-10-02T09:33:56.293333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.293360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.293368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.293372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.293692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2156 sessionId:  describe result for acl check
2025-10-02T09:33:56.293724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.293732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.293733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.293736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375326354:7400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.294087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375326354:7400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.295858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375326354:7400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.300386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.300423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375326354:7400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.300435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375326354:7400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.300437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375326354:7400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.300441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.300652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.300752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.300759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.300765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.300790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.300827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299766808:3009]
2025-10-02T09:33:56.301167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.301330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.301357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.301537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.301565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.301569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.301570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.301570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.301571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.301571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.301572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.301572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.301573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.301573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.301574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.301574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.301577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.301583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.301585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.301587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.301589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.301592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.301593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.301595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.301597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.301599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.301601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.301603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.301607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.301611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.301614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.301617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.301619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.301622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.301624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.301627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.301629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.301631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.301633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.301636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.301638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.301641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.301643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.301646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.301648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.301651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.301653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.301655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.301657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.301660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.301662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.301665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.301681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.309048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.310484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.310495Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.310497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.310499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.310502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2155 [2:7556555308299766808:3009]
2025-10-02T09:33:56.310508Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.310518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.310524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.310525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.310526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.310535Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.310537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.310541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.310574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.310579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.310581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.310582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.310584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.310658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.310665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.310674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.310685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.310698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.310712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326483:7400], now have 1 active actors on pipe
2025-10-02T09:33:56.310717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326246:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.310721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.310722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.310723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.310731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.310716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2155
2025-10-02T09:33:56.310739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2155
2025-10-02T09:33:56.310743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.310746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.310751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.310752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.310758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.310759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.310783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.310789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.310801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.310809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.310816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.310826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.310836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.310838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.310841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.310849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.310860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.310879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.310982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.310988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.310998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.311075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2156 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0
2025-10-02T09:33:56.311375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee24993e-9ab5aab1-9785228-1b32d8f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.314033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Write session: try to update token
2025-10-02T09:33:56.314048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.319803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.319815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.319821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.319822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.319827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.319829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.319831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299766802:3009]
2025-10-02T09:33:56.319850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.319853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.319856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.319856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.319856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.319858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.319964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.326168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId: src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.328399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.384841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375326495:8288]
2025-10-02T09:33:56.385046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2155, pipe: [1:7556555308375326495:8288]
2025-10-02T09:33:56.428843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:56.429193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.429203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.429215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326495:8288], now have 1 active actors on pipe
2025-10-02T09:33:56.429363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:56.429414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375326495:8288]
2025-10-02T09:33:56.429418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:56.429456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:56.429511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2156 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0
2025-10-02T09:33:56.429661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2156 sessionId: src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0 is DEAD
2025-10-02T09:33:56.429804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:56.429818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Write session will restart in 0.007635s
2025-10-02T09:33:56.429840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Write session: Do CDS request
2025-10-02T09:33:56.429845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.438149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.438222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.438237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2157
2025-10-02T09:33:56.438324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.438350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.438358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.438361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.438716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2157 sessionId:  describe result for acl check
2025-10-02T09:33:56.438742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.438748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.438750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.438754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375326618:7397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.439185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375326618:7397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.440988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375326618:7397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.442179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.445010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.445112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.445119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.445125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.445150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.445173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299767062:2994]
2025-10-02T09:33:56.445278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375326618:7397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.445291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375326618:7397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.445294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375326618:7397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.445299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.445513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.445679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.445706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.445990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.446028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.446032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.446033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.446033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.446034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.446035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.446035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.446035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.446036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.446037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.446037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.446038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.446040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.446046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.446048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.446051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.446052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.446054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.446056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.446058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.446060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.446062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.446064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.446066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.446069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.446073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.446076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.446079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.446082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.446084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.446087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.446089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.446091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.446094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.446096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.446099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.446101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.446103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.446105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.446108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.446111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.446113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.446115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.446118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.446120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.446124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.446126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.446129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.446145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.453587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.455249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.455261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.455262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.455264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.455267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2156 [2:7556555308299767062:2994]
2025-10-02T09:33:56.455273Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.455282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.455283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.455285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.455286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.455295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.455299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.455303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.455332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.455337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.455338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.455340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.455341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.455378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.455385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.455394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.455402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.455419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.455436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326746:7397], now have 1 active actors on pipe
2025-10-02T09:33:56.455443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326496:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.455448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.455450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.455452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.455457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.455464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.455468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.455473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.455475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.455480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.455482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.455480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2156
2025-10-02T09:33:56.455501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2156
2025-10-02T09:33:56.455499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.455506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.455512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.455521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.455529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.455552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1131f585-71715c75-b51cd5b8-91396661_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.455561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.455564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.455566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.455573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.455584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.455605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.455709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.455716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.455726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.455780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2157 partition: 0 MaxSeqNo: 36 sessionId: src_id|1131f585-71715c75-b51cd5b8-91396661_0
2025-10-02T09:33:56.456054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf2dd2df-e3f1bfe0-9d514f3f-1aec90b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1131f585-71715c75-b51cd5b8-91396661_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.458849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Write session: try to update token
2025-10-02T09:33:56.458873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.464541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.464553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.464554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.464555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.464558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.464560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.464562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299767057:2994]
2025-10-02T09:33:56.464580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.464583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.464584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.464591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.464595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.464598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.464690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.472743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId: src_id|1131f585-71715c75-b51cd5b8-91396661_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.474903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.529855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375326768:8288]
2025-10-02T09:33:56.530058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2156, pipe: [1:7556555308375326768:8288]
2025-10-02T09:33:56.574422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:56.574764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.574773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.574785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326768:8288], now have 1 active actors on pipe
2025-10-02T09:33:56.574981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:56.575001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375326768:8288]
2025-10-02T09:33:56.575033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:56.575087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1131f585-71715c75-b51cd5b8-91396661_0
2025-10-02T09:33:56.575168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:56.575203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2157 sessionId: src_id|1131f585-71715c75-b51cd5b8-91396661_0 is DEAD
2025-10-02T09:33:56.575316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:56.575325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Write session will restart in 0.007495s
2025-10-02T09:33:56.575344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Write session: Do CDS request
2025-10-02T09:33:56.575349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.584181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.584369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.584381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2158
2025-10-02T09:33:56.584493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.584521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.584526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.584529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.584904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2158 sessionId:  describe result for acl check
2025-10-02T09:33:56.584932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.584936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.584937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.584941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375326926:7360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.585292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375326926:7360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.587072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375326926:7360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.590353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.590486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375326926:7360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.590497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375326926:7360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.590499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375326926:7360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.590503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.590592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.590700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.590706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.590712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.590740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.590764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299767327:2975]
2025-10-02T09:33:56.591100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.591270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.591296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.591476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.591505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.591508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.591509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.591509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.591510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.591510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.591511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.591511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.591512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.591512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.591513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.591514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.591516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.591523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.591525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.591527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.591529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.591531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.591533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.591535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.591536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.591539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.591540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.591542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.591546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.591550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.591553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.591556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.591558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.591561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.591563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.591565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.591567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.591570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.591572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.591574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.591577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.591579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.591581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.591585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.591587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.591590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.591592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.591594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.591596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.591599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.591601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.591604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.591619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.598994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.600608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.600621Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.600622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.600624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.600628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2157 [2:7556555308299767327:2975]
2025-10-02T09:33:56.600634Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.600644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.600650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.600651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.600652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.600661Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.600667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.600671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.600723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.600730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.600731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.600733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.600734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.600771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.600778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.600787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.600795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.600825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.600842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327009:7360], now have 1 active actors on pipe
2025-10-02T09:33:56.600848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375326772:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.600851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.600852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.600854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.600862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.600857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2157
2025-10-02T09:33:56.600872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.600874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2157
2025-10-02T09:33:56.600876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.600878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.600879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.600888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.600890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.600918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.600925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.600933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.600941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.600958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.600958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.600964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.600967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.600968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.600975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.600982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.600999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.601111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.601119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.601129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.601198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2158 partition: 0 MaxSeqNo: 36 sessionId: src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0
2025-10-02T09:33:56.601438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1131f585-71715c75-b51cd5b8-91396661_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.604004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Write session: try to update token
2025-10-02T09:33:56.604020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.609938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.609949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.609950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.609951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.609956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.609958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.609960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299767321:2975]
2025-10-02T09:33:56.609979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.609981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.609983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.609987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.609991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.609994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.610116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.616199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId: src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.618380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.675132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375327021:8288]
2025-10-02T09:33:56.675380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2157, pipe: [1:7556555308375327021:8288]
2025-10-02T09:33:56.719774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:56.719996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.720006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.720019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327021:8288], now have 1 active actors on pipe
2025-10-02T09:33:56.720160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:56.720223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375327021:8288]
2025-10-02T09:33:56.720233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:56.720250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:56.720293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0
2025-10-02T09:33:56.720426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2158 sessionId: src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0 is DEAD
2025-10-02T09:33:56.720580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:56.720594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Write session will restart in 0.009869s
2025-10-02T09:33:56.720615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Write session: Do CDS request
2025-10-02T09:33:56.720620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.731164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.731271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.731288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2159
2025-10-02T09:33:56.731392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.731418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.731427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.731430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.731741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2159 sessionId:  describe result for acl check
2025-10-02T09:33:56.731771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.731776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.731777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.731779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375327226:7350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.732135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375327226:7350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.733487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375327226:7350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.735650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.735763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375327226:7350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.735772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375327226:7350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.735774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375327226:7350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.735777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.735900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.735998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.736005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.736011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.736037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.736060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299767570:2967]
2025-10-02T09:33:56.736407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.736575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.736598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.736773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.736813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.736817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.736818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.736818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.736819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.736820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.736820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.736821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.736821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.736822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.736822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.736823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.736826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.736832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.736834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.736836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.736838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.736840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.736842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.736844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.736846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.736849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.736852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.736855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.736861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.736868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.736873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.736877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.736881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.736886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.736893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.736896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.736898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.736900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.736902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.736905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.736907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.736910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.736915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.736919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.736924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.736927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.736929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.736935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.736938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.736940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.736942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.736945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.736966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.744358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.746078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.746092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.746093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.746095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.746098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2158 [2:7556555308299767570:2967]
2025-10-02T09:33:56.746105Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.746115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.746120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.746122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.746123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.746132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.746135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.746139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.746172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.746176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.746178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.746180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.746181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.746218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.746223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.746230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.746235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.746243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.746256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.746260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.746262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.746267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.746276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327023:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.746275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.746277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.746278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327263:7350], now have 1 active actors on pipe
2025-10-02T09:33:56.746279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.746283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.746290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.746291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.746306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.746314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.746328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.746334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2158
2025-10-02T09:33:56.746357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2158
2025-10-02T09:33:56.746385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.746391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.746406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.746413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.746415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.746416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.746421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.746427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.746434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.746553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.746559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.746566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.746635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2159 partition: 0 MaxSeqNo: 36 sessionId: src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0
2025-10-02T09:33:56.746880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8fc52c-572f4229-1458f9ec-c3256127_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.749488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Write session: try to update token
2025-10-02T09:33:56.749503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.755428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.755440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.755441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.755442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.755448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.755450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.755452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299767564:2967]
2025-10-02T09:33:56.755471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.755473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.755474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.755484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.755488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.755491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.755597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.762241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId: src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.764471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.820510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375327275:8288]
2025-10-02T09:33:56.820671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2158, pipe: [1:7556555308375327275:8288]
2025-10-02T09:33:56.863566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:56.863917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.863927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.863939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327275:8288], now have 1 active actors on pipe
2025-10-02T09:33:56.864100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375327275:8288]
2025-10-02T09:33:56.864105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:56.864137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:56.864139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:56.864183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2159 reason: error at write: Disconnected sessionId: src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0
2025-10-02T09:33:56.864311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2159 sessionId: src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0 is DEAD
2025-10-02T09:33:56.864462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:56.864475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Write session will restart in 0.005528s
2025-10-02T09:33:56.864495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Write session: Do CDS request
2025-10-02T09:33:56.864500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:56.864550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:56.871162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.871250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:56.871266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2160
2025-10-02T09:33:56.871372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:56.871397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:56.871406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:56.871409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:56.871689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2160 sessionId:  describe result for acl check
2025-10-02T09:33:56.871714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:56.871718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:56.871719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:56.871721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555308375327353:7333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:56.872062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555308375327353:7333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:56.874253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555308375327353:7333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:56.876196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555308375327353:7333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:56.876206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555308375327353:7333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:56.876208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555308375327353:7333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:56.876212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:56.879686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:56.879965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:56.880063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:56.880070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:56.880075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:56.880101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:56.880123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555308299767814:2965]
2025-10-02T09:33:56.880460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:56.880625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:56.880652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:56.880846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:56.880877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.880881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.880882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.880883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.880883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.880884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.880884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.880886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.880886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.880887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.880890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.880896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.880898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.880900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.880902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.880904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.880905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.880907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.880909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.880911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.880913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.880915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.880919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.880922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:56.880926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.880929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:56.880931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.880933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:56.880935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.880938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:56.880940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.880943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:56.880945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.880948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:56.880950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.880953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:56.880955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.880957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:56.880960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.880963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:56.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.880968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.880970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.880972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.880974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.880976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.880993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:56.888379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:56.890013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:56.890025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:56.890026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:56.890028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:56.890032Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2159 [2:7556555308299767814:2965]
2025-10-02T09:33:56.890039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:56.890049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:56.890054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.890057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.890058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.890067Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:56.890070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:56.890075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:56.890105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.890110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.890111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.890112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:56.890114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:56.890150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:56.890156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.890165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:56.890173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:56.890190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:56.890208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327522:7333], now have 1 active actors on pipe
2025-10-02T09:33:56.890214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327282:2446], now have 1 active actors on pipe
2025-10-02T09:33:56.890220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.890224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.890225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.890233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:56.890240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:56.890247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:56.890250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:56.890251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:56.890255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:56.890258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:56.890246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2159
2025-10-02T09:33:56.890248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2159
2025-10-02T09:33:56.890273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.890280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:56.890281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:56.890298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.890304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.890330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40345041-264621b-73d3e770-1a72b8c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:56.890338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:56.890341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:56.890342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:56.890348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:56.890354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:56.890365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.890468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:56.890474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:56.890484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:56.890546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2160 partition: 0 MaxSeqNo: 36 sessionId: src_id|40345041-264621b-73d3e770-1a72b8c3_0
2025-10-02T09:33:56.890766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fafc873-9cb3c1a1-f266f34b-6d4c55d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40345041-264621b-73d3e770-1a72b8c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:56.893357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Write session: try to update token
2025-10-02T09:33:56.893373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:56.899293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:56.899305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:56.899306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:56.899308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:56.899311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.899314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.899316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555308299767809:2965]
2025-10-02T09:33:56.899334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:56.899336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:56.899337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:56.899343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:56.899346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:56.899350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:56.899460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:56.905373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId: src_id|40345041-264621b-73d3e770-1a72b8c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:56.907500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:56.964402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555308375327538:8288]
2025-10-02T09:33:56.964565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2159, pipe: [1:7556555308375327538:8288]
2025-10-02T09:33:57.008818Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.009280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.009291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.009304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555308375327538:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.009442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.009450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:57.009463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:57.009468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.009505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555308375327538:8288]
2025-10-02T09:33:57.009535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2160 reason: error at write: Disconnected sessionId: src_id|40345041-264621b-73d3e770-1a72b8c3_0
2025-10-02T09:33:57.009692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2160 sessionId: src_id|40345041-264621b-73d3e770-1a72b8c3_0 is DEAD
2025-10-02T09:33:57.009838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:57.009848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Write session will restart in 0.009758s
2025-10-02T09:33:57.009870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Write session: Do CDS request
2025-10-02T09:33:57.009875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.020193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.020265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.020275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2161
2025-10-02T09:33:57.020364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.020388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.020396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.020399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.020743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2161 sessionId:  describe result for acl check
2025-10-02T09:33:57.020766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.020771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.020773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.020777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670295040:7316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.021219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670295040:7316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.022798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670295040:7316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.025113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.025174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670295040:7316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.025185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670295040:7316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.025188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670295040:7316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.025192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.025382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.025494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.025501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.025507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.025532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.025555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594735368:2954]
2025-10-02T09:33:57.025892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.026066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.026094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.026273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.026301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.026305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.026306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.026307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.026307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.026308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.026308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.026309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.026309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.026310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.026311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.026311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.026314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.026321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.026323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.026325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.026327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.026329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.026331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.026333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.026335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.026337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.026341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.026343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.026347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.026351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.026355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.026358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.026360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.026362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.026366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.026369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.026371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.026374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.026379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.026382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.026384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.026386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.026388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.026391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.026393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.026396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.026398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.026404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.026406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.026408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.026413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.026416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.026432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.033787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.035375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.035387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.035389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.035391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.035394Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2160 [2:7556555312594735368:2954]
2025-10-02T09:33:57.035401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.035411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.035412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.035414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.035415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.035424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.035426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.035430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.035459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.035464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.035465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.035467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.035468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.035501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.035509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.035519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.035527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.035544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.035561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295078:7316], now have 1 active actors on pipe
2025-10-02T09:33:57.035567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670294835:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.035571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.035573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.035575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.035584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.035595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.035600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.035603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.035604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.035590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2160
2025-10-02T09:33:57.035598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2160
2025-10-02T09:33:57.035609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.035612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.035628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.035634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.035636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.035652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.035658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.035679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.035687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.035690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.035691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.035698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.035708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.035718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.035816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.035822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.035831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.035900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2161 partition: 0 MaxSeqNo: 36 sessionId: src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0
2025-10-02T09:33:57.036122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40345041-264621b-73d3e770-1a72b8c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.038660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Write session: try to update token
2025-10-02T09:33:57.038673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.044623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.044633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.044634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.044635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.044640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.044642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.044644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594735362:2954]
2025-10-02T09:33:57.044663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.044666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.044669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.044670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.044673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.044678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.044789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.050428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId: src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.052627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.109816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670295101:8288]
2025-10-02T09:33:57.109989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2160, pipe: [1:7556555312670295101:8288]
2025-10-02T09:33:57.152985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.153331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.153341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.153354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295101:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.153515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.153544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:57.153559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:57.153557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.153605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670295101:8288]
2025-10-02T09:33:57.153607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2161 reason: error at write: Disconnected sessionId: src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0
2025-10-02T09:33:57.153720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2161 sessionId: src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0 is DEAD
2025-10-02T09:33:57.153897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:57.153904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Write session will restart in 0.008419s
2025-10-02T09:33:57.153924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Write session: Do CDS request
2025-10-02T09:33:57.153929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.163181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.163286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.163301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2162
2025-10-02T09:33:57.163422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.163449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.163458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.163461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.163827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2162 sessionId:  describe result for acl check
2025-10-02T09:33:57.163860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.163867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.163869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.163872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670295269:7307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.164296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670295269:7307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.166097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670295269:7307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.169094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.169267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670295269:7307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.169277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670295269:7307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.169279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670295269:7307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.169283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.169379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.169619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.169627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.169635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.169668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.169691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594735616:2956]
2025-10-02T09:33:57.170036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.170210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.170238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.170418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.170448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.170452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.170452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.170453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.170453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.170454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.170454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.170454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.170455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.170455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.170456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.170456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.170459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.170466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.170468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.170470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.170472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.170474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.170476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.170477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.170479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.170481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.170483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.170485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.170489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.170493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.170497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.170500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.170503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.170506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.170508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.170510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.170512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.170515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.170517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.170519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.170521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.170523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.170525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.170528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.170530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.170532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.170535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.170537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.170543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.170545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.170548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.170551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.170566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.177908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.179437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.179447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.179448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.179451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.179454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2161 [2:7556555312594735616:2956]
2025-10-02T09:33:57.179461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.179470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.179475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.179477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.179478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.179488Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.179492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.179496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.179534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.179539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.179540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.179542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.179543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.179606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.179613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.179623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.179632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.179650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.179664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295345:7307], now have 1 active actors on pipe
2025-10-02T09:33:57.179669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295102:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.179672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.179673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.179675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.179683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.179692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.179698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.179701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.179687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2161
2025-10-02T09:33:57.179702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.179707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.179709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.179725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.179731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.179733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.179715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2161
2025-10-02T09:33:57.179755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.179762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.179783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.179792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.179795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.179796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.179803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.179811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.179827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.179962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.179969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.179979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.180048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2162 partition: 0 MaxSeqNo: 36 sessionId: src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0
2025-10-02T09:33:57.180265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b466e0-a5737114-f8dbd8aa-febefd20_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.182838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Write session: try to update token
2025-10-02T09:33:57.182853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.188666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.188674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.188675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.188676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.188679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.188682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.188684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594735610:2956]
2025-10-02T09:33:57.188702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.188704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.188706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.188714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.188718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.188721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.188821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.195196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId: src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.197367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.253674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670295357:8288]
2025-10-02T09:33:57.253885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2161, pipe: [1:7556555312670295357:8288]
2025-10-02T09:33:57.298349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.298708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.298718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.298731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295357:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.298859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.298908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:57.298921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670295357:8288]
2025-10-02T09:33:57.298942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.298988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2162 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0
2025-10-02T09:33:57.299113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2162 sessionId: src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0 is DEAD
2025-10-02T09:33:57.299223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:57.299229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Write session will restart in 0.008699s
2025-10-02T09:33:57.299251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Write session: Do CDS request
2025-10-02T09:33:57.299257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.309214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.309300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.309316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2163
2025-10-02T09:33:57.309411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.309436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.309445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.309449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.309752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2163 sessionId:  describe result for acl check
2025-10-02T09:33:57.309778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.309782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.309783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.309786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670295566:7288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.310125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670295566:7288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.311541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670295566:7288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.314005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.314221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670295566:7288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.314232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670295566:7288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.314234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670295566:7288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.314238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.314244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.314336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.314342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.314347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.314372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.314395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594735865:2953]
2025-10-02T09:33:57.314762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.314936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.314963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.315155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.315187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.315191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.315191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.315192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.315192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.315193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.315193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.315194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.315194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.315195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.315195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.315196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.315199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.315205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.315207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.315209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.315211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.315213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.315214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.315216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.315218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.315220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.315222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.315224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.315228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.315231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.315235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.315237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.315240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.315242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.315245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.315247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.315249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.315252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.315254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.315257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.315259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.315262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.315264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.315267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.315270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.315273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.315276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.315278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.315280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.315286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.315288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.315291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.315309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.322644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.324235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.324246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.324247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.324249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.324253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2162 [2:7556555312594735865:2953]
2025-10-02T09:33:57.324259Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.324270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.324272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.324274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.324275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.324287Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.324291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.324296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.324329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.324334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.324335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.324337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.324338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.324398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.324403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.324411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.324416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.324424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.324438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295360:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.324443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295604:7288], now have 1 active actors on pipe
2025-10-02T09:33:57.324447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.324448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.324449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.324457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.324465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.324473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.324467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2162
2025-10-02T09:33:57.324480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2162
2025-10-02T09:33:57.324473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.324476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.324477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.324477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.324491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.324492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.324495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.324502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.324504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.324526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.324533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.324536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.324537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.324542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.324547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.324556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.324669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.324676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.324684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.324754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2163 partition: 0 MaxSeqNo: 36 sessionId: src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0
2025-10-02T09:33:57.325031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38aa0bc-ef0046a8-102c320d-87a41232_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.327682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Write session: try to update token
2025-10-02T09:33:57.327692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.333698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.333712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.333713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.333714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.333719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.333722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.333724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594735859:2953]
2025-10-02T09:33:57.333743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.333748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.333749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.333785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.333802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.333808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.333862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.339526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId: src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.341733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.399088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670295616:8288]
2025-10-02T09:33:57.399279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2162, pipe: [1:7556555312670295616:8288]
2025-10-02T09:33:57.442171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.442589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.442598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.442611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295616:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.442735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.442790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.442805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:57.442854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670295616:8288]
2025-10-02T09:33:57.442875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2163 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0
2025-10-02T09:33:57.443007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2163 sessionId: src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0 is DEAD
2025-10-02T09:33:57.443147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:57.443157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Write session will restart in 0.007969s
2025-10-02T09:33:57.443171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Write session: Do CDS request
2025-10-02T09:33:57.443176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.452195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.452294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.452305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2164
2025-10-02T09:33:57.452404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.452430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.452439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.452443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.452826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2164 sessionId:  describe result for acl check
2025-10-02T09:33:57.452853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.452859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.452861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.452865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670295781:7271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.453307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670295781:7271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.454986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670295781:7271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.458311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.458452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670295781:7271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.458462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670295781:7271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.458464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670295781:7271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.458468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.458570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.458682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.458689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.458695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.458723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.458744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594736126:2950]
2025-10-02T09:33:57.459107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.459278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.459309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.459485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.459515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.459520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.459520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.459521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.459521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.459522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.459522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.459523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.459523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.459524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.459526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.459526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.459529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.459536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.459538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.459540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.459544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.459547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.459549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.459551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.459553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.459555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.459557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.459561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.459564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.459568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.459574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.459577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.459579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.459581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.459583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.459586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.459588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.459591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.459594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.459597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.459599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.459602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.459605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.459608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.459611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.459614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.459616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.459618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.459620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.459622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.459637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.467006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.468521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.468531Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.468532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.468534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.468536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2163 [2:7556555312594736126:2950]
2025-10-02T09:33:57.468544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.468553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.468555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.468556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.468557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.468565Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.468569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.468573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.468601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.468607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.468608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.468610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.468611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.468644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.468649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.468656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.468661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.468670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.468681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295862:7271], now have 1 active actors on pipe
2025-10-02T09:33:57.468687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295617:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.468691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.468694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.468696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.468705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.468716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.468718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.468722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.468723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.468730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.468732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.468749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.468742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2163
2025-10-02T09:33:57.468749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2163
2025-10-02T09:33:57.468760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.468764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.468783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.468790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.468822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.468831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.468834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.468836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.468841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.468850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.468858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.468962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.468969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.468978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.469046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2164 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0
2025-10-02T09:33:57.469306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5453ccc-5392f55c-516e61b0-afc7dab4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.471762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Write session: try to update token
2025-10-02T09:33:57.471772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.477773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.477784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.477785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.477786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.477789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.477792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.477794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594736120:2950]
2025-10-02T09:33:57.477813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.477815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.477815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.477817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.477817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.477819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.477930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.484418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId: src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.486824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.542941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670295896:8288]
2025-10-02T09:33:57.543165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2163, pipe: [1:7556555312670295896:8288]
2025-10-02T09:33:57.589539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.589790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.589802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.589817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295896:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.589972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.590008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.590048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:57.590056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670295896:8288]
2025-10-02T09:33:57.590140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2164 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0
2025-10-02T09:33:57.590310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2164 sessionId: src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0 is DEAD
2025-10-02T09:33:57.590466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:57.590480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Write session will restart in 0.006645s
2025-10-02T09:33:57.590506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Write session: Do CDS request
2025-10-02T09:33:57.590511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.598131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.598201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.598213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2165
2025-10-02T09:33:57.598345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.598367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.598374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.598376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.598710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2165 sessionId:  describe result for acl check
2025-10-02T09:33:57.598742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.598748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.598749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.598752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670295978:7244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.599091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670295978:7244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.601770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670295978:7244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.606333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.606383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670295978:7244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.606392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670295978:7244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.606394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670295978:7244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.606398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.606605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.606709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.606715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.606720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.606746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.606770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594736397:2930]
2025-10-02T09:33:57.607124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.607301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.607328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.607524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.607558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.607562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.607562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.607563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.607563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.607564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.607565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.607565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.607566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.607566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.607567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.607567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.607570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.607576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.607580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.607582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.607584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.607585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.607587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.607589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.607591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.607593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.607595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.607597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.607600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.607604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.607607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.607610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.607613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.607616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.607622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.607625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.607627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.607630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.607632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.607635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.607637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.607640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.607642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.607644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.607646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.607649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.607653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.607656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.607658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.607661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.607664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.607667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.607683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.615094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.616713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.616722Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.616723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.616725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.616729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2164 [2:7556555312594736397:2930]
2025-10-02T09:33:57.616735Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.616745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.616746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.616748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.616749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.616758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.616761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.616765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.616793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.616797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.616798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.616813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.616814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.616876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.616881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.616887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.616893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.616901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.616915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296143:7244], now have 1 active actors on pipe
2025-10-02T09:33:57.616921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670295897:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.616924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.616925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.616926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.616934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.616944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.616947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.616949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.616950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.616954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.616956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.616969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.616974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.616978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.616962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2164
2025-10-02T09:33:57.616994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.616998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.616975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2164
2025-10-02T09:33:57.617015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.617022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.617023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.617025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.617029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.617034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.617044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.617186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.617194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.617207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.617277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2165 partition: 0 MaxSeqNo: 36 sessionId: src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0
2025-10-02T09:33:57.617522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d0102-91a0107c-d6d060f0-6922e490_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.620303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Write session: try to update token
2025-10-02T09:33:57.620317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.625911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.625920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.625921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.625922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.625928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.625930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.625931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594736391:2930]
2025-10-02T09:33:57.625950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.625952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.625953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.625953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.625957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.625959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.626065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.632746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId: src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.634983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.690404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670296155:8288]
2025-10-02T09:33:57.690609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2164, pipe: [1:7556555312670296155:8288]
2025-10-02T09:33:57.736603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.736823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.736831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.736844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296155:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.737038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.737069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:57.737084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:57.737119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670296155:8288]
2025-10-02T09:33:57.737141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2165 reason: error at write: Disconnected sessionId: src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0
2025-10-02T09:33:57.737166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.737277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2165 sessionId: src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0 is DEAD
2025-10-02T09:33:57.737402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:57.737407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Write session will restart in 0.009533s
2025-10-02T09:33:57.737422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Write session: Do CDS request
2025-10-02T09:33:57.737427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.748219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.748324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.748339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2166
2025-10-02T09:33:57.748467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.748494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.748507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.748511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.748857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2166 sessionId:  describe result for acl check
2025-10-02T09:33:57.748889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.748894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.748895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.748898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670296366:7234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.749246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670296366:7234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.750843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670296366:7234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.752896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.753058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670296366:7234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.753066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670296366:7234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.753068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670296366:7234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.753072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.753157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.753432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.753440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.753448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.753485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.753508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594736646:2920]
2025-10-02T09:33:57.753868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.754040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.754067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.754251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.754280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.754284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.754284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.754285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.754286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.754286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.754287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.754288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.754288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.754289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.754289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.754290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.754293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.754299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.754301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.754303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.754305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.754307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.754310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.754312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.754314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.754316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.754318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.754320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.754324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.754328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.754331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.754336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.754338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.754341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.754343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.754348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.754356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.754360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.754367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.754372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.754379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.754384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.754387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.754389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.754394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.754397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.754399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.754402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.754407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.754410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.754412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.754415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.754432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.761929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.763360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.763371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.763372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.763374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.763378Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2165 [2:7556555312594736646:2920]
2025-10-02T09:33:57.763386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.763395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.763397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.763398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.763401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.763410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.763418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.763422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.763450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.763455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.763456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.763458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.763459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.763517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.763521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.763528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.763534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.763542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.763555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296156:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.763561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296403:7234], now have 1 active actors on pipe
2025-10-02T09:33:57.763565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.763568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.763572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.763581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.763584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2165
2025-10-02T09:33:57.763592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.763590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2165
2025-10-02T09:33:57.763596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.763598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.763600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.763607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.763609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.763625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.763632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.763633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.763644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.763651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.763679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a24612e1-c1dc3056-2368111e-2be019ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.763686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.763688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.763689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.763694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.763702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.763713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.763829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.763835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.763845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.763920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2166 partition: 0 MaxSeqNo: 36 sessionId: src_id|a24612e1-c1dc3056-2368111e-2be019ec_0
2025-10-02T09:33:57.764146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ff21ea-bdd3e08-badaf23c-3d4edc04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a24612e1-c1dc3056-2368111e-2be019ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.766790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Write session: try to update token
2025-10-02T09:33:57.766804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.772650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.772661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.772662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.772663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.772667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.772669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.772670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594736640:2920]
2025-10-02T09:33:57.772689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.772692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.772692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.772693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.772695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.772697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.772823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.779107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId: src_id|a24612e1-c1dc3056-2368111e-2be019ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.781231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.837385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670296414:8288]
2025-10-02T09:33:57.837593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2165, pipe: [1:7556555312670296414:8288]
2025-10-02T09:33:57.881958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:57.882443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.882452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.882464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296414:8288], now have 1 active actors on pipe
2025-10-02T09:33:57.882585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:57.882645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:57.882656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:57.882689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670296414:8288]
2025-10-02T09:33:57.882746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2166 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a24612e1-c1dc3056-2368111e-2be019ec_0
2025-10-02T09:33:57.882910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2166 sessionId: src_id|a24612e1-c1dc3056-2368111e-2be019ec_0 is DEAD
2025-10-02T09:33:57.883045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:57.883050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Write session will restart in 0.007463s
2025-10-02T09:33:57.883064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Write session: Do CDS request
2025-10-02T09:33:57.883068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:57.891138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.891258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:57.891274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2167
2025-10-02T09:33:57.891402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:57.891429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:57.891437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:57.891440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:57.891807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2167 sessionId:  describe result for acl check
2025-10-02T09:33:57.891835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:57.891841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:57.891842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:57.891847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555312670296541:7216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:57.892275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555312670296541:7216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:57.894319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555312670296541:7216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:57.898195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:57.898392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555312670296541:7216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:57.898402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555312670296541:7216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:57.898404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555312670296541:7216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:57.898409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:57.898437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:57.898529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:57.898535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:57.898541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:57.898565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:57.898587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555312594736897:2924]
2025-10-02T09:33:57.898950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:57.899111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:57.899134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:57.899321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:57.899355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.899359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.899359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.899360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.899361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.899361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.899362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.899362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.899363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.899363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.899364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.899364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.899367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.899374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.899376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.899378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.899379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.899382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.899383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.899385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.899387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.899389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.899391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.899393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.899397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.899402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:57.899405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.899408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:57.899410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.899413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:57.899415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.899417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:57.899420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.899422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:57.899424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.899427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:57.899429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.899435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:57.899438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.899441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:57.899443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.899445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:57.899449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.899451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.899453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.899455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.899459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.899461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.899478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:57.906826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:57.908504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:57.908516Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:57.908517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:57.908522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:57.908527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2166 [2:7556555312594736897:2924]
2025-10-02T09:33:57.908536Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:57.908546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:57.908549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.908551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.908552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.908563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:57.908571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:57.908575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:57.908605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.908610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.908611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.908613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:57.908614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:57.908647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:57.908652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.908659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:57.908664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:57.908675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:57.908688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296671:7216], now have 1 active actors on pipe
2025-10-02T09:33:57.908694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296423:2446], now have 1 active actors on pipe
2025-10-02T09:33:57.908697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.908698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.908700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.908708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:57.908715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:57.908721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:57.908723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:57.908723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:57.908723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:57.908724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:57.908736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.908740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:57.908733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2166
2025-10-02T09:33:57.908750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:57.908759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.908748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2166
2025-10-02T09:33:57.908761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.908782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af983152-2f99d644-f610f2b3-ac3e994a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:57.908788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:57.908790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:57.908791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:57.908796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:57.908815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:57.908822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.908955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:57.908961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:57.908971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:57.909041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2167 partition: 0 MaxSeqNo: 36 sessionId: src_id|af983152-2f99d644-f610f2b3-ac3e994a_0
2025-10-02T09:33:57.909366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24612e1-c1dc3056-2368111e-2be019ec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af983152-2f99d644-f610f2b3-ac3e994a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:57.911982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Write session: try to update token
2025-10-02T09:33:57.911996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:57.917660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:57.917671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:57.917673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:57.917673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:57.917678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.917681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.917683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555312594736891:2924]
2025-10-02T09:33:57.917705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:57.917707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:57.917709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:57.917709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:57.917712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:57.917713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:57.917814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:57.925062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId: src_id|af983152-2f99d644-f610f2b3-ac3e994a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:57.927205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:57.982774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555312670296685:8288]
2025-10-02T09:33:57.982973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2166, pipe: [1:7556555312670296685:8288]
2025-10-02T09:33:58.029916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.030269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.030280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.030291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555312670296685:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.030416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:58.030413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555312670296685:8288]
2025-10-02T09:33:58.030440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.030442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:58.030445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:58.030495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2167 reason: error at write: Disconnected sessionId: src_id|af983152-2f99d644-f610f2b3-ac3e994a_0
2025-10-02T09:33:58.030650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2167 sessionId: src_id|af983152-2f99d644-f610f2b3-ac3e994a_0 is DEAD
2025-10-02T09:33:58.030800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:58.030814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Write session will restart in 0.005934s
2025-10-02T09:33:58.030839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Write session: Do CDS request
2025-10-02T09:33:58.030845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.038147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.038256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.038267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2168
2025-10-02T09:33:58.038382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.038405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.038414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.038417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.038717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2168 sessionId:  describe result for acl check
2025-10-02T09:33:58.038741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.038745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.038746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.038749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965264070:7208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.039075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965264070:7208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.041101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965264070:7208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.043040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965264070:7208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.043047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965264070:7208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.043049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965264070:7208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.043053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.046530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.046803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.046900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.046906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.046912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.046938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.046960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889704459:2918]
2025-10-02T09:33:58.047320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.047486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.047516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.047695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.047724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.047728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.047728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.047729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.047729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.047730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.047730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.047731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.047731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.047732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.047732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.047733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.047735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.047742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.047744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.047746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.047748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.047750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.047752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.047755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.047758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.047762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.047765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.047768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.047773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.047779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.047787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.047790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.047792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.047795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.047797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.047799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.047801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.047804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.047806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.047811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.047813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.047816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.047818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.047820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.047823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.047825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.047828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.047832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.047835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.047837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.047839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.047842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.047859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.055253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.056913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.056922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.056923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.056926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.056929Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2167 [2:7556555316889704459:2918]
2025-10-02T09:33:58.056935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.056945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.056946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.056948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.056949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.056957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.056960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.056968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.057007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.057013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.057013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.057015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.057016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.057052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.057057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.057064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.057069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.057077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.057091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264241:7208], now have 1 active actors on pipe
2025-10-02T09:33:58.057096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965263995:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.057100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.057101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.057102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.057110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.057117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.057127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.057127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.057129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.057131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.057131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.057145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.057150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.057153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.057143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2167
2025-10-02T09:33:58.057172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.057176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.057171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2167
2025-10-02T09:33:58.057194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.057200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.057203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.057204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.057209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.057214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.057221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.057355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.057362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.057372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.057441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2168 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0
2025-10-02T09:33:58.057725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af983152-2f99d644-f610f2b3-ac3e994a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.060314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Write session: try to update token
2025-10-02T09:33:58.060328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.066152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.066163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.066164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.066165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.066169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.066171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.066172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889704454:2918]
2025-10-02T09:33:58.066193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.066198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.066199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.066200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.066205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.066208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.066312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.077512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId: src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.079647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:58.130743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555316965264255:8288]
2025-10-02T09:33:58.130917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2167, pipe: [1:7556555316965264255:8288]
2025-10-02T09:33:58.175207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.175609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.175618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.175630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264255:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.175804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:58.175847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555316965264255:8288]
2025-10-02T09:33:58.175854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:58.175857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:58.175883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.175914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2168 reason: error at write: Disconnected sessionId: src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0
2025-10-02T09:33:58.176041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2168 sessionId: src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0 is DEAD
2025-10-02T09:33:58.176151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:58.176160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Write session will restart in 0.009684s
2025-10-02T09:33:58.176176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Write session: Do CDS request
2025-10-02T09:33:58.176181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.187147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.187201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.187213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2169
2025-10-02T09:33:58.187337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.187364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.187377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.187380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.187704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2169 sessionId:  describe result for acl check
2025-10-02T09:33:58.187734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.187738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.187739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.187743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965264470:7202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.188081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965264470:7202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.189668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965264470:7202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.191731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.191919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965264470:7202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.191928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965264470:7202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.191929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965264470:7202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.191933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.192005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.192180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.192187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.192195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.192229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.192252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889704712:2910]
2025-10-02T09:33:58.192593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.192762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.192788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.192981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.193010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.193013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.193014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.193014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.193015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.193015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.193016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.193017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.193017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.193018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.193018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.193019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.193022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.193028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.193030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.193032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.193034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.193036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.193038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.193040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.193042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.193044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.193046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.193048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.193051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.193055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.193059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.193062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.193064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.193066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.193069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.193071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.193073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.193076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.193078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.193081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.193083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.193086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.193088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.193090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.193092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.193095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.193097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.193100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.193102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.193105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.193107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.193109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.193125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.200468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.202259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.202269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.202270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.202272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.202275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2168 [2:7556555316889704712:2910]
2025-10-02T09:33:58.202281Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.202290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.202292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.202293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.202294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.202302Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.202309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.202313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.202341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.202346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.202347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.202350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.202352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.202396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.202401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.202408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.202413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.202421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.202435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264507:7202], now have 1 active actors on pipe
2025-10-02T09:33:58.202440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264256:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.202444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.202445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.202446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.202454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.202464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.202470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.202472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.202474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.202474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.202476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.202488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.202480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2168
2025-10-02T09:33:58.202494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.202500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.202501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2168
2025-10-02T09:33:58.202515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.202520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.202535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee9cd60a-388a831c-44bcfa46-871990a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.202542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.202544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.202545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.202549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.202555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.202562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.202709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.202715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.202725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.202796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2169 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee9cd60a-388a831c-44bcfa46-871990a_0
2025-10-02T09:33:58.203067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d477fa7-91ddfb8-50ac6cd2-2d14b0cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee9cd60a-388a831c-44bcfa46-871990a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.205659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Write session: try to update token
2025-10-02T09:33:58.205668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.211632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.211643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.211644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.211645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.211650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.211653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.211655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889704706:2910]
2025-10-02T09:33:58.211676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.211681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.211682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.211683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.211686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.211690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.211787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.217656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId: src_id|ee9cd60a-388a831c-44bcfa46-871990a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.219926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:58.276306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555316965264520:8288]
2025-10-02T09:33:58.276483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2168, pipe: [1:7556555316965264520:8288]
2025-10-02T09:33:58.321259Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.321639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.321649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.321664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264520:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.321837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:58.321849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:58.321862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555316965264520:8288]
2025-10-02T09:33:58.321894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.321895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2169 reason: error at write: Disconnected sessionId: src_id|ee9cd60a-388a831c-44bcfa46-871990a_0
2025-10-02T09:33:58.321927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:58.322037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2169 sessionId: src_id|ee9cd60a-388a831c-44bcfa46-871990a_0 is DEAD
2025-10-02T09:33:58.322163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:58.322169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Write session will restart in 0.008204s
2025-10-02T09:33:58.322187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Write session: Do CDS request
2025-10-02T09:33:58.322192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.331122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.331243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.331254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2170
2025-10-02T09:33:58.331395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.331422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.331431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.331435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.331817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2170 sessionId:  describe result for acl check
2025-10-02T09:33:58.331846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.331852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.331854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.331858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965264665:7183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.332285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965264665:7183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.333993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965264665:7183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.337611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.337835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965264665:7183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.337846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965264665:7183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.337849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965264665:7183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.337854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.337864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.338009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.338014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.338020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.338052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.338078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889704968:2894]
2025-10-02T09:33:58.338419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.338584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.338607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.338791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.338823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.338827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.338827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.338828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.338828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.338829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.338829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.338830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.338831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.338831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.338831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.338832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.338834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.338841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.338843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.338845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.338847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.338849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.338851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.338853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.338855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.338857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.338859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.338861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.338864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.338868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.338872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.338875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.338877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.338880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.338882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.338885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.338887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.338890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.338894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.338897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.338899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.338902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.338904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.338907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.338909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.338912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.338919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.338921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.338924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.338926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.338928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.338931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.338949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.346322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.347939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.347948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.347950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.347955Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2169 [2:7556555316889704968:2894]
2025-10-02T09:33:58.347961Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.347970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.347975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.347976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.347977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.347986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.347989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.347993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.348024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.348030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.348032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.348033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.348035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.348071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.348075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.348083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.348088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.348100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.348110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264772:7183], now have 1 active actors on pipe
2025-10-02T09:33:58.348115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264521:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.348119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.348120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.348122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.348129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.348136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.348144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.348147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.348148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.348150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.348151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.348162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.348157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2169
2025-10-02T09:33:58.348163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.348166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2169
2025-10-02T09:33:58.348174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.348185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.348190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.348205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.348211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.348213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.348214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.348219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.348223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.348230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.348334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.348340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.348350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.348417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2170 partition: 0 MaxSeqNo: 36 sessionId: src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0
2025-10-02T09:33:58.348691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9cd60a-388a831c-44bcfa46-871990a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.351184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Write session: try to update token
2025-10-02T09:33:58.351194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.357319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.357331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.357333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.357334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.357337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.357339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.357341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889704962:2894]
2025-10-02T09:33:58.357361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.357365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.357366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.357373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.357378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.357381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.357485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.363861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId: src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.366125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:58.422076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555316965264784:8288]
2025-10-02T09:33:58.422259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2169, pipe: [1:7556555316965264784:8288]
2025-10-02T09:33:58.467536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.467928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.467937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.467949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264784:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.468082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555316965264784:8288]
2025-10-02T09:33:58.468093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:58.468096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:58.468112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.468143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2170 reason: error at write: Disconnected sessionId: src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0
2025-10-02T09:33:58.468272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2170 sessionId: src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0 is DEAD
2025-10-02T09:33:58.468381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:58.468385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Write session will restart in 0.008327s
2025-10-02T09:33:58.468400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Write session: Do CDS request
2025-10-02T09:33:58.468404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.468442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:58.478112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.478213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.478225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2171
2025-10-02T09:33:58.478368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.478395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.478408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.478418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.478767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2171 sessionId:  describe result for acl check
2025-10-02T09:33:58.478796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.478800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.478801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.478804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965264953:7172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.479142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965264953:7172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.480895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965264953:7172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.483902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.484139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965264953:7172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.484154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965264953:7172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.484157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965264953:7172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.484162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.484194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.484354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.484362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.484370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.484404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.484427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889705236:2904]
2025-10-02T09:33:58.484760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.484939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.484963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.485139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.485173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.485177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.485178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.485178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.485179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.485180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.485180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.485181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.485181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.485182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.485183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.485183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.485187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.485192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.485196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.485198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.485200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.485202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.485204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.485206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.485208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.485210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.485212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.485214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.485217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.485221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.485224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.485227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.485229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.485232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.485234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.485237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.485239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.485242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.485244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.485247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.485250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.485252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.485254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.485257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.485259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.485262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.485264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.485267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.485269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.485272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.485278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.485281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.485297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.492707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.494175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.494185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.494186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.494188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.494191Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2170 [2:7556555316889705236:2904]
2025-10-02T09:33:58.494198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.494208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.494213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.494215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.494215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.494224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.494227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.494231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.494266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.494271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.494272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.494274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.494275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.494311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.494316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.494322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.494327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.494336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.494349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.494353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.494354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.494358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.494366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.494368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265037:7172], now have 1 active actors on pipe
2025-10-02T09:33:58.494371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965264785:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.494373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.494375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.494376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.494389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.494392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.494408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.494402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2170
2025-10-02T09:33:58.494419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2170
2025-10-02T09:33:58.494420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.494433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.494456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.494463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.494479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96a72136-daaf8678-e314d016-61e967b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.494486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.494488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.494489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.494494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.494500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.494511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.494626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.494633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.494642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.494705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2171 partition: 0 MaxSeqNo: 36 sessionId: src_id|96a72136-daaf8678-e314d016-61e967b7_0
2025-10-02T09:33:58.494977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80c6480-f2c5b0ed-c92af9db-9ecf7935_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96a72136-daaf8678-e314d016-61e967b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.497691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Write session: try to update token
2025-10-02T09:33:58.497702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.503605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:58.503616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.503620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.503643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:58.503651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:58.503789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:58.503901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:58.504017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:58.504160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:58.504330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:58.504355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:58.509535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId: src_id|96a72136-daaf8678-e314d016-61e967b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.512166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:58.512303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.512317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.512328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.512329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.512331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.512331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.512335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.512337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.512340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889705221:2904]
2025-10-02T09:33:58.512364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.512368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.512369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.512370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.512373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.512376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.512526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.568610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555316965265071:8288]
2025-10-02T09:33:58.568818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2170, pipe: [1:7556555316965265071:8288]
2025-10-02T09:33:58.623451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.624281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:33:58.624305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265071:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.624419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:58.624455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.624495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:58.624501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:58.624508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555316965265071:8288]
2025-10-02T09:33:58.624550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2171 reason: error at write: Disconnected sessionId: src_id|96a72136-daaf8678-e314d016-61e967b7_0
2025-10-02T09:33:58.624659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2171 sessionId: src_id|96a72136-daaf8678-e314d016-61e967b7_0 is DEAD
2025-10-02T09:33:58.624820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:58.624829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Write session will restart in 0.005778s
2025-10-02T09:33:58.624846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Write session: Do CDS request
2025-10-02T09:33:58.624854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.631151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.631241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.631251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2172
2025-10-02T09:33:58.631409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.631437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.631447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.631450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.631795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2172 sessionId:  describe result for acl check
2025-10-02T09:33:58.631824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.631831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.631833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.631838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965265123:7149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.632793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965265123:7149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.635014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965265123:7149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.636986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965265123:7149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.636997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965265123:7149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.636999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965265123:7149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.637004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.637188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.640213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.640369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.640375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.640382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.640409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.640434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889705515:2883]
2025-10-02T09:33:58.640786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.640988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.641015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.641210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.641244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.641247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.641248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.641248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.641249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.641250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.641250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.641251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.641251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.641251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.641252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.641253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.641255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.641262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.641264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.641266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.641268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.641270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.641271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.641273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.641275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.641278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.641279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.641281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.641285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.641289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.641293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.641296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.641298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.641300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.641302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.641306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.641308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.641311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.641313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.641316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.641318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.641321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.641323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.641326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.641328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.641330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.641332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.641334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.641336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.641339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.641341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.641343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.641359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.648773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.650435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.650445Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.650446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.650448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.650451Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2171 [2:7556555316889705515:2883]
2025-10-02T09:33:58.650458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.650466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.650471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.650473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.650474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.650481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.650484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.650488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.650525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.650530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.650531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.650532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.650534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.650586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.650591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.650598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.650603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.650611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.650633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265324:7149], now have 1 active actors on pipe
2025-10-02T09:33:58.650639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265072:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.650642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.650644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.650646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.650654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.650662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.650672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.650673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.650675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.650675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.650679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.650687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.650689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.650676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2171
2025-10-02T09:33:58.650695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2171
2025-10-02T09:33:58.650699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.650741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.650746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.650759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58cb78de-8d8908ae-1110501-e4ed7155_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.650766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.650769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.650770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.650774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.650780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.650790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.650923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.650930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.650940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.651010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2172 partition: 0 MaxSeqNo: 36 sessionId: src_id|58cb78de-8d8908ae-1110501-e4ed7155_0
2025-10-02T09:33:58.651310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a72136-daaf8678-e314d016-61e967b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58cb78de-8d8908ae-1110501-e4ed7155_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.653839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Write session: try to update token
2025-10-02T09:33:58.653851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.659905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.659918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.659920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.659921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.659925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.659927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.659929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889705510:2883]
2025-10-02T09:33:58.659949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.659952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.659953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.659963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.659966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.659969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.660061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.666296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId: src_id|58cb78de-8d8908ae-1110501-e4ed7155_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.668454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:58.724652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555316965265337:8288]
2025-10-02T09:33:58.724877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2171, pipe: [1:7556555316965265337:8288]
2025-10-02T09:33:58.771230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.771650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.771659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.771672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265337:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.771801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:58.771840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.771861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:58.771883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555316965265337:8288]
2025-10-02T09:33:58.771948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2172 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58cb78de-8d8908ae-1110501-e4ed7155_0
2025-10-02T09:33:58.772116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2172 sessionId: src_id|58cb78de-8d8908ae-1110501-e4ed7155_0 is DEAD
2025-10-02T09:33:58.772265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:58.772275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Write session will restart in 0.009955s
2025-10-02T09:33:58.772290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Write session: Do CDS request
2025-10-02T09:33:58.772295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.783143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.783271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.783288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2173
2025-10-02T09:33:58.783426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.783453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.783462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.783466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.783778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2173 sessionId:  describe result for acl check
2025-10-02T09:33:58.783809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.783814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.783815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.783818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965265555:7134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.784177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965265555:7134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.785712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965265555:7134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.788036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.788130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965265555:7134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.788138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965265555:7134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.788139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965265555:7134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.788143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.788312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.788411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.788417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.788422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.788448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.788470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889705771:2868]
2025-10-02T09:33:58.788842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.789023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.789049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.789244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.789278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.789282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.789283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.789284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.789284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.789285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.789285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.789286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.789286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.789287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.789287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.789287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.789291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.789298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.789300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.789302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.789304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.789306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.789308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.789310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.789312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.789315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.789317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.789319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.789323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.789327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.789330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.789333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.789335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.789338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.789340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.789343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.789345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.789348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.789350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.789352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.789354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.789357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.789359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.789362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.789364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.789368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.789370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.789372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.789374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.789377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.789379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.789381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.789398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.796840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.798553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.798563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.798564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.798566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.798569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2172 [2:7556555316889705771:2868]
2025-10-02T09:33:58.798576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.798586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.798591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.798592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.798593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.798602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.798605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.798609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.798646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.798651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.798652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.798654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.798655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.798690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.798694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.798701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.798706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.798714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.798728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265591:7134], now have 1 active actors on pipe
2025-10-02T09:33:58.798734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.798735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.798736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.798744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.798749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265338:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.798757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.798757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.798759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.798761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.798764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.798765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.798778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.798783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.798778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2172
2025-10-02T09:33:58.798800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.798809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.798792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2172
2025-10-02T09:33:58.798811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.798826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.798835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.798838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.798840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.798846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.798856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.798869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.798977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.798984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.798994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.799066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2173 partition: 0 MaxSeqNo: 36 sessionId: src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0
2025-10-02T09:33:58.799344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cb78de-8d8908ae-1110501-e4ed7155_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.802033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Write session: try to update token
2025-10-02T09:33:58.802046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.807991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:58.808003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.808007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.808028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:58.808039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:58.808168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:58.808322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:58.808438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:58.808549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:58.808709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:58.808736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:58.814568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId: src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.816442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.816454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.816456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.816457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.816461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.816463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.816467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889705765:2868]
2025-10-02T09:33:58.816486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.816489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.816490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.816490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.816494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.816497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.816628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.817003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:58.872092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555316965265609:8288]
2025-10-02T09:33:58.872282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2172, pipe: [1:7556555316965265609:8288]
2025-10-02T09:33:58.926817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:58.927204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.927213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.927227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265609:8288], now have 1 active actors on pipe
2025-10-02T09:33:58.927405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:58.927431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555316965265609:8288]
2025-10-02T09:33:58.927457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:58.927516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0
2025-10-02T09:33:58.927646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2173 sessionId: src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0 is DEAD
2025-10-02T09:33:58.927679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:58.927807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:58.927819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Write session will restart in 0.005999s
2025-10-02T09:33:58.927844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Write session: Do CDS request
2025-10-02T09:33:58.927850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:58.935098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.935238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:58.935251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2174
2025-10-02T09:33:58.935385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:58.935416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:58.935420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:58.935424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:58.935736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2174 sessionId:  describe result for acl check
2025-10-02T09:33:58.935766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:58.935772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:58.935773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:58.935776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555316965265683:7124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:58.936104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555316965265683:7124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:58.937819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555316965265683:7124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:58.940063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555316965265683:7124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:58.940074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555316965265683:7124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:58.940075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555316965265683:7124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:58.940080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:58.943751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:58.944026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:58.944127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:58.944133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:58.944139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:58.944165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:58.944187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555316889706041:2879]
2025-10-02T09:33:58.944536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:58.944713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:58.944739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:58.944943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:58.944975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.944979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.944980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.944980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.944981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.944981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.944982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.944982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.944983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.944983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.944984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.944984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.944987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.944993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.944995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.944997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.944999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.945001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.945003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.945005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.945007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.945010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.945012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.945014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.945018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.945022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:58.945025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.945028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:58.945030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.945033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:58.945035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.945038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:58.945043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.945046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:58.945048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.945051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:58.945053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.945055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:58.945061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.945064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:58.945066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.945070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:58.945072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.945077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.945079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.945082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.945084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.945087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.945104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:58.952505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:58.954134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:58.954144Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:58.954145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:58.954147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:58.954150Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2173 [2:7556555316889706041:2879]
2025-10-02T09:33:58.954157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:58.954165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:58.954167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.954168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.954169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.954176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:58.954179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:58.954183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:58.954212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.954217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.954218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.954220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:58.954222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:58.954256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:58.954260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.954267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:58.954272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:58.954283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:58.954295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265866:7124], now have 1 active actors on pipe
2025-10-02T09:33:58.954300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555316965265610:2446], now have 1 active actors on pipe
2025-10-02T09:33:58.954304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.954305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.954306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.954314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:58.954324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:58.954326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:58.954328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:58.954329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:58.954332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:58.954334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:58.954346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.954351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:58.954353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:58.954359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2173
2025-10-02T09:33:58.954382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2173
2025-10-02T09:33:58.954404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.954409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.954423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:58.954429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:58.954431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:58.954432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:58.954437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:58.954442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:58.954453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.954586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:58.954593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:58.954602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:58.954682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2174 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0
2025-10-02T09:33:58.954951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8bb104e-4bf9b05c-150ec0eb-aa587434_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:58.957479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Write session: try to update token
2025-10-02T09:33:58.957490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:58.963509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:58.963521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:58.963522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:58.963523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:58.963528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.963530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.963534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555316889706036:2879]
2025-10-02T09:33:58.963555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:58.963557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:58.963559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:58.963559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:58.963561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:58.963563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:58.963664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:58.969486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId: src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:58.971669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.027748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260233176:8288]
2025-10-02T09:33:59.027963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2173, pipe: [1:7556555321260233176:8288]
2025-10-02T09:33:59.073518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.073934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.073943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.073955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233176:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.074148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:59.074165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:59.074186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260233176:8288]
2025-10-02T09:33:59.074224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.074234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2174 reason: error at write: Disconnected sessionId: src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0
2025-10-02T09:33:59.074373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2174 sessionId: src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0 is DEAD
2025-10-02T09:33:59.074498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:59.074492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.074510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Write session will restart in 0.007919s
2025-10-02T09:33:59.074527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Write session: Do CDS request
2025-10-02T09:33:59.074533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.083129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.083254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.083272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2175
2025-10-02T09:33:59.083405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.083431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.083439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.083442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.083835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2175 sessionId:  describe result for acl check
2025-10-02T09:33:59.083868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.083874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.083875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.083879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260233326:7105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.084245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260233326:7105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.086370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260233326:7105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.090255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.090440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260233326:7105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.090453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260233326:7105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.090455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260233326:7105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.090459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.090495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.090687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.090696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.090705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.090743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.090769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184673597:2869]
2025-10-02T09:33:59.091113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.091285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.091311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.091497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.091526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.091530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.091530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.091531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.091531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.091532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.091532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.091533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.091533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.091534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.091534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.091535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.091538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.091544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.091546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.091548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.091550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.091552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.091554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.091556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.091558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.091560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.091562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.091564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.091567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.091572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.091575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.091578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.091580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.091583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.091585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.091588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.091590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.091593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.091595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.091598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.091600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.091602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.091604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.091607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.091609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.091611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.091616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.091619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.091623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.091626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.091630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.091632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.091648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.099052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.100713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.100724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.100725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.100727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.100730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2174 [2:7556555321184673597:2869]
2025-10-02T09:33:59.100737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.100747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.100748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.100749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.100750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.100759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.100761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.100769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.100798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.100814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.100819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.100820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.100822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.100857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.100862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.100868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.100873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.100881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.100896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233445:7105], now have 1 active actors on pipe
2025-10-02T09:33:59.100901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233189:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.100904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.100906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.100908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.100918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.100927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.100934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.100939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.100941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.100941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.100942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.100956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.100940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2174
2025-10-02T09:33:59.100962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.100967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.100963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2174
2025-10-02T09:33:59.100980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.100985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.101002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.101008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.101010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.101011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.101016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.101022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.101030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.101145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.101153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.101165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.101246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2175 partition: 0 MaxSeqNo: 36 sessionId: src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0
2025-10-02T09:33:59.101507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f91c7a3-3ffc6df4-96ec042a-d66d0d64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.104271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Write session: try to update token
2025-10-02T09:33:59.104282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:59.110428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:59.110440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.110441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:59.110442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:59.110446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.110448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.110451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184673591:2869]
2025-10-02T09:33:59.110471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:59.110475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.110477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:59.110480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:59.110484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:59.110487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:59.110593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:59.116734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId: src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:59.119070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.174213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260233456:8288]
2025-10-02T09:33:59.174424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2174, pipe: [1:7556555321260233456:8288]
2025-10-02T09:33:59.221990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.222379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.222388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.222400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233456:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.222561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:59.222580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:59.222603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260233456:8288]
2025-10-02T09:33:59.222640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2175 reason: error at write: Disconnected sessionId: src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0
2025-10-02T09:33:59.222643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.222772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2175 sessionId: src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0 is DEAD
2025-10-02T09:33:59.222883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:59.222895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Write session will restart in 0.009241s
2025-10-02T09:33:59.222867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.222912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Write session: Do CDS request
2025-10-02T09:33:59.222918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.233059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.233160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.233177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2176
2025-10-02T09:33:59.233327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.233354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.233363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.233368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.233726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2176 sessionId:  describe result for acl check
2025-10-02T09:33:59.233756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.233763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.233765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.233769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260233663:7087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.234207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260233663:7087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.235606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260233663:7087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.238460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.238633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260233663:7087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.238643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260233663:7087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.238644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260233663:7087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.238648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.238723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.238829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.238835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.238841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.238866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.238892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184673857:2874]
2025-10-02T09:33:59.239243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.239413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.239565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.239766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.239798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.239802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.239802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.239803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.239803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.239804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.239804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.239805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.239805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.239806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.239806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.239807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.239810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.239816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.239818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.239820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.239822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.239824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.239826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.239828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.239830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.239834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.239835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.239837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.239841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.239845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.239848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.239851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.239854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.239857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.239859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.239862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.239864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.239867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.239869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.239871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.239873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.239876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.239878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.239881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.239883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.239885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.239888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.239892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.239894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.239897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.239902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.239905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.239922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.247324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.248962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.248970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.248971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.248973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.248976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2175 [2:7556555321184673857:2874]
2025-10-02T09:33:59.248983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.248993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.248994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.248995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.248996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.249005Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.249008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.249012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.249040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.249045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.249046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.249048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.249050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.249086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.249091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.249098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.249103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.249111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.249122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.249127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.249128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.249133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.249140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233715:7087], now have 1 active actors on pipe
2025-10-02T09:33:59.249141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.249144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.249145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.249146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233458:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.249151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.249157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.249159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.249172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.249179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.249189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.249189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2175
2025-10-02T09:33:59.249211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2175
2025-10-02T09:33:59.249267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.249273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.249288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.249295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.249297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.249298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.249303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.249311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.249323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.249448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.249454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.249462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.249530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2176 partition: 0 MaxSeqNo: 36 sessionId: src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0
2025-10-02T09:33:59.249841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f25968-6a14f5e5-ebe55a10-2611095d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.252565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Write session: try to update token
2025-10-02T09:33:59.252579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:59.258056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:33:59.258065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.258069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.258091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:33:59.258095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:33:59.258230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:33:59.258381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:59.258501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:59.258631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:33:59.258810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:33:59.258839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:33:59.264999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId: src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:59.266589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:59.266600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.266602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:59.266603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:59.266606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.266609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.266611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184673851:2874]
2025-10-02T09:33:59.266637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:59.266641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.266643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:59.266647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:59.266651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:59.266655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:59.266763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:59.267320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.322683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260233728:8288]
2025-10-02T09:33:59.322857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2175, pipe: [1:7556555321260233728:8288]
2025-10-02T09:33:59.376734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.377060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.377071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.377086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233728:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.377245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.377274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:59.377277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260233728:8288]
2025-10-02T09:33:59.377288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:59.377292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.377384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2176 reason: error at write: Disconnected sessionId: src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0
2025-10-02T09:33:59.377536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2176 sessionId: src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0 is DEAD
2025-10-02T09:33:59.377699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:59.377712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Write session will restart in 0.008475s
2025-10-02T09:33:59.377731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Write session: Do CDS request
2025-10-02T09:33:59.377737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.387173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.387272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.387285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2177
2025-10-02T09:33:59.387395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.387429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.387441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.387445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.387801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2177 sessionId:  describe result for acl check
2025-10-02T09:33:59.387831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.387836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.387838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.387841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260233899:7075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.388184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260233899:7075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.389697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260233899:7075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.393111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.393291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260233899:7075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.393300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260233899:7075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.393302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260233899:7075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.393306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.393371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.393475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.393482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.393488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.393516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.393541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184674120:2865]
2025-10-02T09:33:59.393897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.394066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.394092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.394287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.394318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.394321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.394322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.394323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.394323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.394324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.394324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.394325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.394325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.394326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.394326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.394327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.394329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.394335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.394337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.394339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.394341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.394343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.394345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.394347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.394349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.394351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.394353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.394355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.394358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.394363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.394366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.394369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.394371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.394374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.394377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.394380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.394382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.394385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.394386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.394389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.394391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.394394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.394396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.394399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.394401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.394404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.394407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.394409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.394411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.394413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.394415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.394418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.394435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.401814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.403532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.403541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.403542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.403544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.403547Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2176 [2:7556555321184674120:2865]
2025-10-02T09:33:59.403553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.403563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.403564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.403565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.403566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.403575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.403581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.403585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.403613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.403618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.403619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.403620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.403622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.403656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.403661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.403668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.403673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.403681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.403695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233986:7075], now have 1 active actors on pipe
2025-10-02T09:33:59.403702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233730:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.403707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.403713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.403714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.403725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.403734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.403738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.403741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.403742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.403745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.403747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.403729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2176
2025-10-02T09:33:59.403744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2176
2025-10-02T09:33:59.403761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.403767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.403769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.403777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.403779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.403804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.403811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.403813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.403813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.403818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.403825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.403836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.403942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.403949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.403960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.404031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2177 partition: 0 MaxSeqNo: 36 sessionId: src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0
2025-10-02T09:33:59.404303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9a6fe0a-85d95a0b-1155d4eb-c625d925_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.406832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Write session: try to update token
2025-10-02T09:33:59.406847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:59.412776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:59.412788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.412789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:59.412790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:59.412794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.412797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.412799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184674114:2865]
2025-10-02T09:33:59.412830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:59.412831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:59.412833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.412835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:59.412835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:59.412836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:59.412952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:59.419020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId: src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:59.421171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.477306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260233998:8288]
2025-10-02T09:33:59.477500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2176, pipe: [1:7556555321260233998:8288]
2025-10-02T09:33:59.522035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.522317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.522327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.522339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260233998:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.522456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.522509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:59.522516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260233998:8288]
2025-10-02T09:33:59.522536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.522595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2177 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0
2025-10-02T09:33:59.522774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2177 sessionId: src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0 is DEAD
2025-10-02T09:33:59.522987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:59.523000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Write session will restart in 0.005790s
2025-10-02T09:33:59.523023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Write session: Do CDS request
2025-10-02T09:33:59.523029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.530154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.530343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.530364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2178
2025-10-02T09:33:59.530509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.530540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.530554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.530559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.530939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2178 sessionId:  describe result for acl check
2025-10-02T09:33:59.530968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.530975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.530977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.530981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260234086:7066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.531443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260234086:7066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.533592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260234086:7066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.535593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260234086:7066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.535605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260234086:7066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.535608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260234086:7066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.535613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.539093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.539384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.539483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.539489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.539495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.539520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.539542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184674411:2854]
2025-10-02T09:33:59.539928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.540110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.540139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.540332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.540363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.540367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.540367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.540368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.540368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.540369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.540369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.540370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.540370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.540371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.540371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.540372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.540375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.540381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.540383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.540385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.540387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.540389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.540392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.540395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.540399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.540402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.540405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.540408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.540414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.540420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.540427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.540430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.540432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.540435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.540438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.540441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.540444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.540446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.540448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.540451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.540453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.540457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.540459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.540462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.540464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.540467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.540469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.540471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.540474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.540476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.540478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.540481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.540499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.547943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.549505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.549516Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.549517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.549520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.549523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2177 [2:7556555321184674411:2854]
2025-10-02T09:33:59.549530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.549540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.549542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.549543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.549544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.549553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.549560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.549564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.549595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.549600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.549601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.549603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.549604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.549652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.549658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.549667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.549674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.549682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.549698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234260:7066], now have 1 active actors on pipe
2025-10-02T09:33:59.549703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234000:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.549707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.549708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.549709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.549717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.549728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.549731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.549734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.549735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.549739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.549740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.549735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2177
2025-10-02T09:33:59.549756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.549761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2177
2025-10-02T09:33:59.549765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.549766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.549775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.549781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.549806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.549813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.549815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.549816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.549822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.549827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.549838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.550157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.550166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.550176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.550245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2178 partition: 0 MaxSeqNo: 36 sessionId: src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0
2025-10-02T09:33:59.550492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe9fa84-b4124d4b-54092d2b-a6e4b0d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.553047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Write session: try to update token
2025-10-02T09:33:59.553060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:59.558917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:59.558928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.558929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:59.558931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:59.558935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.558937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.558939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184674406:2854]
2025-10-02T09:33:59.558959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:59.558965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:59.558966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.558967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:59.558968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:59.558970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:59.559074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:59.565022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId: src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:59.567220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.622721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260234292:8288]
2025-10-02T09:33:59.622934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2177, pipe: [1:7556555321260234292:8288]
2025-10-02T09:33:59.670112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.670533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.670543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.670556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234292:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.670704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.670760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:59.670822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2178 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0
2025-10-02T09:33:59.670957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2178 sessionId: src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0 is DEAD
2025-10-02T09:33:59.671081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:59.671094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Write session will restart in 0.005115s
2025-10-02T09:33:59.671089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.671110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Write session: Do CDS request
2025-10-02T09:33:59.671115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.671253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260234292:8288]
2025-10-02T09:33:59.677193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.677268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.677279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2179
2025-10-02T09:33:59.677395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.677419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.677429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.677433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.677782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2179 sessionId:  describe result for acl check
2025-10-02T09:33:59.677812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.677817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.677818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.677821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260234327:7032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.678184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260234327:7032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.680654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260234327:7032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.683249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260234327:7032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.683259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260234327:7032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.683261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260234327:7032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.683264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.687680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.687945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.688041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.688047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.688053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.688079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.688103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184674681:2848]
2025-10-02T09:33:59.688442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.688598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.688620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.688794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.688836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.688840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.688840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.688841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.688841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.688842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.688842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.688843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.688843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.688844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.688844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.688845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.688848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.688854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.688856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.688858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.688860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.688862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.688864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.688866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.688868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.688870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.688872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.688874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.688878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.688882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.688885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.688888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.688890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.688893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.688895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.688898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.688900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.688903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.688905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.688908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.688910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.688912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.688914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.688917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.688921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.688924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.688926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.688932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.688934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.688937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.688939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.688942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.688958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.696441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.698044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.698055Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.698056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.698058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.698061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2178 [2:7556555321184674681:2848]
2025-10-02T09:33:59.698069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.698078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.698083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.698084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.698085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.698095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.698101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.698105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.698136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.698141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.698142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.698144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.698145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.698184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.698188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.698195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.698200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.698210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.698224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234293:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.698230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234550:7032], now have 1 active actors on pipe
2025-10-02T09:33:59.698233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.698234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.698235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.698243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.698252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.698258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.698260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.698261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.698261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.698262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.698277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.698282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.698283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.698290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2178
2025-10-02T09:33:59.698325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2178
2025-10-02T09:33:59.698325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.698330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.698344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d84db9-33596433-b91ec570-c1dbed46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.698351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.698353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.698354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.698359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.698364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.698374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.698492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.698497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.698504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.698575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2179 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d84db9-33596433-b91ec570-c1dbed46_0
2025-10-02T09:33:59.698847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fe6b20-577a89e8-5156d484-5dcccb70_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d84db9-33596433-b91ec570-c1dbed46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.701429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Write session: try to update token
2025-10-02T09:33:59.701445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:59.707418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:59.707429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.707431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:59.707431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:59.707435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.707437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.707439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184674676:2848]
2025-10-02T09:33:59.707459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:59.707462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:59.707464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.707465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:59.707465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:59.707467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:59.707566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:59.713846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId: src_id|5d84db9-33596433-b91ec570-c1dbed46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:59.715986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.771180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260234569:8288]
2025-10-02T09:33:59.771336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2178, pipe: [1:7556555321260234569:8288]
2025-10-02T09:33:59.818419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.818824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.818834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.818847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234569:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.818984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.819038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:33:59.819054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260234569:8288]
2025-10-02T09:33:59.819076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.819107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2179 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d84db9-33596433-b91ec570-c1dbed46_0
2025-10-02T09:33:59.819224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2179 sessionId: src_id|5d84db9-33596433-b91ec570-c1dbed46_0 is DEAD
2025-10-02T09:33:59.819360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:33:59.819374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Write session will restart in 0.008099s
2025-10-02T09:33:59.819399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Write session: Do CDS request
2025-10-02T09:33:59.819405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.828137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.828562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.828583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2180
2025-10-02T09:33:59.828723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.828749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.828757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.828762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.829151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2180 sessionId:  describe result for acl check
2025-10-02T09:33:59.829180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.829189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.829193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.829198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260234708:7023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.829638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260234708:7023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.831317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260234708:7023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.835434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.835624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260234708:7023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.835634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260234708:7023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.835635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260234708:7023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.835639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.835680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.835780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.835786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.835792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.835820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.835993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184674946:2846]
2025-10-02T09:33:59.836356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.836526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.836551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.836736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.836769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.836773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.836773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.836774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.836775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.836775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.836776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.836776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.836776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.836777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.836777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.836778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.836781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.836788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.836790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.836792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.836794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.836796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.836798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.836811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.836814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.836816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.836818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.836819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.836823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.836827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.836830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.836833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.836836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.836838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.836842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.836847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.836851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.836855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.836861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.836869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.836874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.836877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.836879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.836881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.836885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.836887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.836893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.836896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.836898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.836902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.836905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.836907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.836923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.844323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.845897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.845908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.845909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.845911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.845914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2179 [2:7556555321184674946:2846]
2025-10-02T09:33:59.845921Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.845930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.845935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.845937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.845938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.845947Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.845951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.845955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.845984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.845989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.845990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.845992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.845994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.846050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.846055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.846065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.846074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.846093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.846107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234833:7023], now have 1 active actors on pipe
2025-10-02T09:33:59.846113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234573:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.846116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.846118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.846119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.846114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2179
2025-10-02T09:33:59.846127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.846137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.846141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.846143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.846144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.846148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.846149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.846138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2179
2025-10-02T09:33:59.846170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.846176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.846185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.846193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.846206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.846208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.846211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.846213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.846214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.846219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.846225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.846236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.846352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.846357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.846365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.846437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2180 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0
2025-10-02T09:33:59.846746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d84db9-33596433-b91ec570-c1dbed46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.849341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Write session: try to update token
2025-10-02T09:33:59.849357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:33:59.855269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:33:59.855283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:33:59.855284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:33:59.855286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:33:59.855291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.855294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.855297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184674940:2846]
2025-10-02T09:33:59.855321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:33:59.855322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:33:59.855325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:33:59.855327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:33:59.855327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.855329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:33:59.855449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:33:59.862732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId: src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:33:59.864905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:33:59.919165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555321260234851:8288]
2025-10-02T09:33:59.919362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2179, pipe: [1:7556555321260234851:8288]
2025-10-02T09:33:59.964471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:33:59.965074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.965083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.965096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234851:8288], now have 1 active actors on pipe
2025-10-02T09:33:59.965205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:33:59.965250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:33:59.965257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555321260234851:8288]
2025-10-02T09:33:59.965264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:33:59.965277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:33:59.965308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2180 reason: error at write: Disconnected sessionId: src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0
2025-10-02T09:33:59.965439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2180 sessionId: src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0 is DEAD
2025-10-02T09:33:59.965595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:33:59.965608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Write session will restart in 0.005255s
2025-10-02T09:33:59.965628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Write session: Do CDS request
2025-10-02T09:33:59.965633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:33:59.972125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.972239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:33:59.972257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2181
2025-10-02T09:33:59.972375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:33:59.972402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:33:59.972411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:33:59.972414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:33:59.972732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2181 sessionId:  describe result for acl check
2025-10-02T09:33:59.972761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:33:59.972766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:33:59.972768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:33:59.972771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555321260234914:7012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:33:59.973147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555321260234914:7012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:33:59.975572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555321260234914:7012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:33:59.977915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555321260234914:7012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:33:59.977925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555321260234914:7012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:33:59.977927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555321260234914:7012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:33:59.977931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:33:59.981858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:33:59.982150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:33:59.982383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:33:59.982391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:33:59.982400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:33:59.982437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:33:59.982462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555321184675223:2835]
2025-10-02T09:33:59.982833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:33:59.983024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:33:59.983054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:33:59.983237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:33:59.983266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.983270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.983271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.983272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.983273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.983274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.983275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.983276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.983277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.983278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.983278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.983280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.983283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.983293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.983297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.983300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.983302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.983305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.983306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.983308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.983310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.983312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.983314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.983316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.983320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.983323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:33:59.983327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.983329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:33:59.983332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.983334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:33:59.983336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.983339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:33:59.983341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.983344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:33:59.983347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.983350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:33:59.983352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.983355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:33:59.983357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.983360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:33:59.983362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.983365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:33:59.983368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.983370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.983372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.983375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.983377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.983380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.983399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:33:59.990803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:33:59.992228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:33:59.992241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:33:59.992244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:33:59.992246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:33:59.992251Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2180 [2:7556555321184675223:2835]
2025-10-02T09:33:59.992262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:33:59.992274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:33:59.992279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.992281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.992282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.992292Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:33:59.992295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:33:59.992300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:33:59.992328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.992332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.992333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.992335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:33:59.992338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:33:59.992376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:33:59.992381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:33:59.992387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:33:59.992393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:33:59.992401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:33:59.992414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260234858:2446], now have 1 active actors on pipe
2025-10-02T09:33:59.992421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555321184675218:2835]
2025-10-02T09:33:59.992423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555321184675218:2835]
2025-10-02T09:33:59.992424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555321184675218:2835]
2025-10-02T09:33:59.992430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:33:59.992434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555321260235115:7012], now have 1 active actors on pipe
2025-10-02T09:33:59.992440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:33:59.992440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:33:59.992442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:33:59.992443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:33:59.992448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:33:59.992450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:33:59.992462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555321184675218:2835]
2025-10-02T09:33:59.992468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:33:59.992473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:33:59.992479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2180
2025-10-02T09:33:59.992501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2180
2025-10-02T09:33:59.992511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.992517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.992534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:33:59.992541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:33:59.992543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:33:59.992544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:33:59.992549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:33:59.992556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:33:59.992565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.992709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:33:59.992716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:33:59.992725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:33:59.992794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2181 partition: 0 MaxSeqNo: 36 sessionId: src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0
2025-10-02T09:33:59.993092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f522c96-7b97fb28-462f2098-9d4a5563_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:33:59.995652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Write session: try to update token
2025-10-02T09:33:59.995666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.001667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.001680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.001681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.001682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.001686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555321184675218:2835]
2025-10-02T09:34:00.001690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555321184675218:2835]
2025-10-02T09:34:00.001692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555321184675218:2835]
2025-10-02T09:34:00.001714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.001718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.001719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.001741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.001754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.001757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.001837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.008185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId: src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.010451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.065603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555202437:8288]
2025-10-02T09:34:00.065847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2180, pipe: [1:7556555325555202437:8288]
2025-10-02T09:34:00.116748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:00.117152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.117161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.117178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555202437:8288], now have 1 active actors on pipe
2025-10-02T09:34:00.117310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:00.117340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:00.117384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555202437:8288]
2025-10-02T09:34:00.117384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:00.117470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2181 reason: status is not ok: tablet will be restarted right now sessionId: src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0
2025-10-02T09:34:00.117639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2181 sessionId: src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0 is DEAD
2025-10-02T09:34:00.117773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:00.117782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Write session will restart in 0.009603s
2025-10-02T09:34:00.117801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Write session: Do CDS request
2025-10-02T09:34:00.117805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:00.128229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.128343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:00.128354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2182
2025-10-02T09:34:00.128470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.128495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:00.128504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:00.128508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:00.128856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2182 sessionId:  describe result for acl check
2025-10-02T09:34:00.128895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:00.128900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:00.128901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:00.128904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555325555202639:6992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:00.129263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555325555202639:6992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:00.130878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:00.131158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555325555202639:6992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:00.133951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:00.134052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:00.134060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:00.134068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:00.134101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:00.134125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555325479642791:2818]
2025-10-02T09:34:00.134134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555325555202639:6992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:00.134144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555325555202639:6992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:00.134146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555325555202639:6992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:00.134150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:00.134476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:00.134646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:00.134673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:00.134870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:00.134905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.134909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.134910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.134910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.134911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.134911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.134912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.134912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.134913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.134913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.134914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.134914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.134917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.134923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.134925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.134927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.134929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.134931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.134933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.134935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.134937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.134939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.134941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.134943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.134947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.134953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.134956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.134959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.134961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.134967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.134970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.134972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.134975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.134979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.134981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.134984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.134989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.134992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.134994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.134996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.134998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.135002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.135004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.135006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.135011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.135014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.135016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.135018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.135035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:00.142453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:00.144156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:00.144167Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:00.144168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:00.144170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:00.144173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2181 [2:7556555325479642791:2818]
2025-10-02T09:34:00.144180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:00.144190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:00.144191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.144193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.144194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.144202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:00.144205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:00.144209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:00.144239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.144244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.144245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.144247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:00.144248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:00.144284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:00.144289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.144295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.144304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.144321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:00.144337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555202704:6992], now have 1 active actors on pipe
2025-10-02T09:34:00.144343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555202441:2446], now have 1 active actors on pipe
2025-10-02T09:34:00.144346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.144348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.144349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.144356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:00.144364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:00.144371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:00.144372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:00.144374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:00.144376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:00.144378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:00.144376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2181
2025-10-02T09:34:00.144384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.144391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:00.144386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2181
2025-10-02T09:34:00.144396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:00.144410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.144411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.144427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83a914b4-8a274a21-732ba1a7-c942970c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:00.144434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.144436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.144437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:00.144443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.144448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:00.144460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.144598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.144604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.144613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.144693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2182 partition: 0 MaxSeqNo: 36 sessionId: src_id|83a914b4-8a274a21-732ba1a7-c942970c_0
2025-10-02T09:34:00.144982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d74be-a3a06bbc-157141f6-aeaefe81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83a914b4-8a274a21-732ba1a7-c942970c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:00.147830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Write session: try to update token
2025-10-02T09:34:00.147843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.155045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.155058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.155060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.155061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.155066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.155070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.155074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555325479642786:2818]
2025-10-02T09:34:00.155097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.155102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.155103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.155105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.155107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.155109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.155233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.160653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId: src_id|83a914b4-8a274a21-732ba1a7-c942970c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.167196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.217652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555202719:8288]
2025-10-02T09:34:00.217908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2181, pipe: [1:7556555325555202719:8288]
2025-10-02T09:34:00.270730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:00.271185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.271195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.271208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555202719:8288], now have 1 active actors on pipe
2025-10-02T09:34:00.271402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555202719:8288]
2025-10-02T09:34:00.271415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:00.271420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:00.271433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:00.271494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2182 reason: error at write: Disconnected sessionId: src_id|83a914b4-8a274a21-732ba1a7-c942970c_0
2025-10-02T09:34:00.271676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2182 sessionId: src_id|83a914b4-8a274a21-732ba1a7-c942970c_0 is DEAD
2025-10-02T09:34:00.271832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:00.271846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Write session will restart in 0.007433s
2025-10-02T09:34:00.271866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Write session: Do CDS request
2025-10-02T09:34:00.271871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:00.272149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:00.280207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.280281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:00.280296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2183
2025-10-02T09:34:00.280389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.280415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:00.280424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:00.280427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:00.280754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2183 sessionId:  describe result for acl check
2025-10-02T09:34:00.280779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:00.280785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:00.280786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:00.280791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555325555203115:6983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:00.281172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555325555203115:6983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:00.282699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555325555203115:6983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:00.283430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:00.283705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:00.283872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:00.283880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:00.283886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:00.283921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:00.283946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555325479643057:2824]
2025-10-02T09:34:00.284307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:00.284490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:00.284520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:00.284587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555325555203115:6983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:00.284599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555325555203115:6983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:00.284601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555325555203115:6983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:00.284605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:00.284742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:00.284778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.284782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.284783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.284783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.284784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.284784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.284785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.284785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.284786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.284786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.284787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.284787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.284791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.284796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.284798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.284811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.284813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.284815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.284817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.284819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.284820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.284822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.284824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.284826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.284830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.284835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.284838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.284843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.284847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.284851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.284854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.284859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.284863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.284867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.284870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.284875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.284883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.284888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.284893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.284895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.284898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.284900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.284905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.284910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.284913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.284916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.284918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.284920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.284936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:00.292374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:00.294183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:00.294193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:00.294194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:00.294196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:00.294199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2182 [2:7556555325479643057:2824]
2025-10-02T09:34:00.294206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:00.294215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:00.294216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.294218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.294219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.294227Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:00.294230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:00.294236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:00.294270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.294274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.294275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.294277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:00.294279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:00.294315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:00.294321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.294331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.294344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.294367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:00.294382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555202722:2446], now have 1 active actors on pipe
2025-10-02T09:34:00.294388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555203201:6983], now have 1 active actors on pipe
2025-10-02T09:34:00.294393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.294395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.294397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.294408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:00.294421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:00.294421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:00.294423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:00.294424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:00.294436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:00.294441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:00.294435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2182
2025-10-02T09:34:00.294460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.294449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2182
2025-10-02T09:34:00.294466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:00.294467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:00.294478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.294484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.294508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18b861f8-19092924-3ad917aa-6b346f54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:00.294515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.294517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.294518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:00.294523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.294532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:00.294544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.294670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.294678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.294687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.294763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2183 partition: 0 MaxSeqNo: 36 sessionId: src_id|18b861f8-19092924-3ad917aa-6b346f54_0
2025-10-02T09:34:00.295055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83a914b4-8a274a21-732ba1a7-c942970c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18b861f8-19092924-3ad917aa-6b346f54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:00.297645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Write session: try to update token
2025-10-02T09:34:00.297659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.303639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.303650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.303651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.303652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.303656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.303658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.303660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555325479643052:2824]
2025-10-02T09:34:00.303679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.303683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.303685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.303686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.303686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.303688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.303792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.309944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId: src_id|18b861f8-19092924-3ad917aa-6b346f54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.312139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.371759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555203211:8288]
2025-10-02T09:34:00.371988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2182, pipe: [1:7556555325555203211:8288]
2025-10-02T09:34:00.415593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:00.416157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.416166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.416181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555203211:8288], now have 1 active actors on pipe
2025-10-02T09:34:00.416392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555203211:8288]
2025-10-02T09:34:00.416395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:00.416398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:00.416419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:00.416455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2183 reason: error at write: Disconnected sessionId: src_id|18b861f8-19092924-3ad917aa-6b346f54_0
2025-10-02T09:34:00.416596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2183 sessionId: src_id|18b861f8-19092924-3ad917aa-6b346f54_0 is DEAD
2025-10-02T09:34:00.416730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:00.416745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Write session will restart in 0.007432s
2025-10-02T09:34:00.416766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Write session: Do CDS request
2025-10-02T09:34:00.416772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:00.417269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:00.425202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.425318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:00.425331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2184
2025-10-02T09:34:00.425470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.425498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:00.425507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:00.425510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:00.425823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2184 sessionId:  describe result for acl check
2025-10-02T09:34:00.425848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:00.425853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:00.425854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:00.425857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555325555203645:6960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:00.426216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555325555203645:6960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:00.427402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555325555203645:6960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:00.427992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:00.428242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:00.428343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:00.428350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:00.428355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:00.428380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:00.428401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555325479643326:2823]
2025-10-02T09:34:00.428774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:00.428913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555325555203645:6960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:00.428922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555325555203645:6960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:00.428924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555325555203645:6960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:00.428928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:00.428946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:00.428970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:00.429164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:00.429197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.429201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.429202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.429202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.429203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.429203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.429204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.429204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.429205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.429205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.429206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.429206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.429209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.429214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.429217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.429219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.429221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.429223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.429227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.429230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.429233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.429237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.429240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.429244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.429248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.429254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.429263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.429269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.429274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.429277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.429279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.429282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.429285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.429290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.429292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.429294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.429296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.429299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.429304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.429307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.429309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.429311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.429313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.429316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.429318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.429321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.429323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.429325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.429344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:00.436772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:00.438275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:00.438285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:00.438286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:00.438288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:00.438291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2183 [2:7556555325479643326:2823]
2025-10-02T09:34:00.438298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:00.438307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:00.438309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.438310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.438311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.438320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:00.438323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:00.438327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:00.438358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.438363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.438364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.438366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:00.438367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:00.438405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:00.438410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.438416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.438421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.438431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:00.438445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555203212:2446], now have 1 active actors on pipe
2025-10-02T09:34:00.438452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555203690:6960], now have 1 active actors on pipe
2025-10-02T09:34:00.438456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.438460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.438462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.438451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2183
2025-10-02T09:34:00.438458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2183
2025-10-02T09:34:00.438469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:00.438479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:00.438483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:00.438486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:00.438487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:00.438490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:00.438492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:00.438514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.438519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.438528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.438536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:00.438548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:00.438552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:00.438556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.438558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.438559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:00.438564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.438569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:00.438587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.438683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.438691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.438700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.438756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2184 partition: 0 MaxSeqNo: 36 sessionId: src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0
2025-10-02T09:34:00.439036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18b861f8-19092924-3ad917aa-6b346f54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:00.441624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Write session: try to update token
2025-10-02T09:34:00.441641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.447849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.447858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.447860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.447861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.447864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.447866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.447868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555325479643320:2823]
2025-10-02T09:34:00.447887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.447893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.447893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.447894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.447896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.447898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.448023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.453989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId: src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.456214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.516648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555203699:8288]
2025-10-02T09:34:00.516876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2183, pipe: [1:7556555325555203699:8288]
2025-10-02T09:34:00.562939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:00.563127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.563139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.563152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555203699:8288], now have 1 active actors on pipe
2025-10-02T09:34:00.563355Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:00.563366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555203699:8288]
2025-10-02T09:34:00.563367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:00.563393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:00.563440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0
2025-10-02T09:34:00.563568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2184 sessionId: src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0 is DEAD
2025-10-02T09:34:00.563732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:00.563747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Write session will restart in 0.007734s
2025-10-02T09:34:00.563769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Write session: Do CDS request
2025-10-02T09:34:00.563775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:00.572208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.572283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:00.572295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2185
2025-10-02T09:34:00.572414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.572433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:00.572439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:00.572441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:00.572641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2185 sessionId:  describe result for acl check
2025-10-02T09:34:00.572660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:00.572664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:00.572665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:00.572668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555325555204129:6935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:00.572933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555325555204129:6935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:00.574155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555325555204129:6935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:00.574935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:00.575224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:00.575321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:00.575328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:00.575334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:00.575362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:00.575384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555325479643624:2800]
2025-10-02T09:34:00.575768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:00.575844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555325555204129:6935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:00.575856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555325555204129:6935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:00.575858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555325555204129:6935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:00.575862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:00.575936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:00.575962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:00.576187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:00.576222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.576226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.576226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.576227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.576227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.576228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.576228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.576229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.576229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.576230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.576230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.576231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.576234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.576240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.576242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.576244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.576246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.576248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.576250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.576252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.576254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.576256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.576258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.576260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.576264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.576268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.576271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.576274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.576277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.576280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.576282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.576285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.576287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.576290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.576292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.576294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.576297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.576299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.576301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.576304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.576306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.576309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.576311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.576313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.576315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.576318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.576320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.576322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.576341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:00.583770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:00.585242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:00.585254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:00.585255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:00.585257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:00.585260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2184 [2:7556555325479643624:2800]
2025-10-02T09:34:00.585267Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:00.585277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:00.585282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.585283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.585284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.585293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:00.585296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:00.585300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:00.585329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.585334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.585335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.585337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:00.585338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:00.585374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:00.585473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2184
2025-10-02T09:34:00.585495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2184
2025-10-02T09:34:00.585634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.585646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.585651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.585663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:00.585676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555203701:2446], now have 1 active actors on pipe
2025-10-02T09:34:00.585681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555204192:6935], now have 1 active actors on pipe
2025-10-02T09:34:00.585690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.585695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.585707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.585711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.585712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.585721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:00.585728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:00.585732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:00.585735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:00.585736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:00.585737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:00.585739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:00.585748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:00.585755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.585757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.585758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:00.585764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.585772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:00.585791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.585798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:00.585805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.585806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:00.585889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.585894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.585902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.585952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2185 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0
2025-10-02T09:34:00.586207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645deb8-d4ed4ad3-886d6980-31cb43d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:00.588771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Write session: try to update token
2025-10-02T09:34:00.588785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.594912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.594923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.594924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.594924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.594928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.594931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.594933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555325479643618:2800]
2025-10-02T09:34:00.594951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.594954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.594955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.594956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.594959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.594961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.595065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.600690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId: src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.602908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.663627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555204211:8288]
2025-10-02T09:34:00.663834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2184, pipe: [1:7556555325555204211:8288]
2025-10-02T09:34:00.706593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:00.706817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.706826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.706838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555204211:8288], now have 1 active actors on pipe
2025-10-02T09:34:00.707046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:00.707088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:00.707090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:00.707089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555204211:8288]
2025-10-02T09:34:00.707137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2185 reason: error at write: Disconnected sessionId: src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0
2025-10-02T09:34:00.707158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:00.707274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2185 sessionId: src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0 is DEAD
2025-10-02T09:34:00.707429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:00.707443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Write session will restart in 0.005946s
2025-10-02T09:34:00.707464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Write session: Do CDS request
2025-10-02T09:34:00.707469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:00.714135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.714255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:00.714274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2186
2025-10-02T09:34:00.714387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.714413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:00.714423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:00.714428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:00.714745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2186 sessionId:  describe result for acl check
2025-10-02T09:34:00.714777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:00.714781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:00.714782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:00.714785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555325555204444:6930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:00.715169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555325555204444:6930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:00.717635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555325555204444:6930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:00.719702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:00.719983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:00.720090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:00.720097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:00.720103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:00.720130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:00.720256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555325555204444:6930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:00.720266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555325555204444:6930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:00.720270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555325555204444:6930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:00.720316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:00.720375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555325479643901:2792]
2025-10-02T09:34:00.720733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:00.720925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:00.720954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:00.721159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:00.721193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.721197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.721197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.721198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.721198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.721199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.721200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.721200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.721201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.721201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.721202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.721202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.721205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.721211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.721213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.721216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.721218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.721219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.721221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.721223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.721225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.721227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.721229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.721231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.721235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.721239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.721243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.721246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.721248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.721250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.721252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.721256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.721258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.721262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.721265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.721267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.721269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.721272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.721274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.721277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.721279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.721282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.721288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.721290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.721292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.721295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.721297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.721300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.721315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:00.728827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:00.730462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:00.730477Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:00.730479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:00.730483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:00.730488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2185 [2:7556555325479643901:2792]
2025-10-02T09:34:00.730501Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:00.730519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:00.730526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.730528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.730530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.730541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:00.730549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:00.730555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:00.730601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.730608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.730609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.730620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:00.730623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:00.730674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:00.730680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.730691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.730701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.730716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:00.730731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555204691:6930], now have 1 active actors on pipe
2025-10-02T09:34:00.730737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555204213:2446], now have 1 active actors on pipe
2025-10-02T09:34:00.730741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.730743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.730744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.730752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:00.730763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:00.730771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:00.730774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:00.730774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:00.730775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:00.730776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:00.730790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.730800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:00.730803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:00.730792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2185
2025-10-02T09:34:00.730803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2185
2025-10-02T09:34:00.730829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.730835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.730856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:00.730864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.730867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.730870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:00.730877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.730888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:00.730902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.731041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.731049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.731060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.731132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2186 partition: 0 MaxSeqNo: 36 sessionId: src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0
2025-10-02T09:34:00.731475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e627f38-f79dc960-4c94ab4c-eef78098_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:00.734048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Write session: try to update token
2025-10-02T09:34:00.734063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.740232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.740245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.740246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.740247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.740251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.740253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.740256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555325479643896:2792]
2025-10-02T09:34:00.740281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.740281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.740284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.740285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.740286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.740287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.740397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.746408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId: src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.748596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.807470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555204702:8288]
2025-10-02T09:34:00.807651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2185, pipe: [1:7556555325555204702:8288]
2025-10-02T09:34:00.853957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:00.854435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.854445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.854460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555204702:8288], now have 1 active actors on pipe
2025-10-02T09:34:00.854607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:00.854701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:00.854748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:00.854808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2186 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0
2025-10-02T09:34:00.854945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2186 sessionId: src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0 is DEAD
2025-10-02T09:34:00.855067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:00.855075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Write session will restart in 0.007108s
2025-10-02T09:34:00.855058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555204702:8288]
2025-10-02T09:34:00.855090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Write session: Do CDS request
2025-10-02T09:34:00.855094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:00.863200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.863293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:00.863303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2187
2025-10-02T09:34:00.863425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:00.863451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:00.863460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:00.863464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:00.863841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2187 sessionId:  describe result for acl check
2025-10-02T09:34:00.863873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:00.863880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:00.863882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:00.863889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555325555205051:6922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:00.864344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555325555205051:6922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:00.865836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555325555205051:6922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:00.866985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:00.867238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:00.867375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:00.867381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:00.867388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:00.867416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:00.867442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555325479644172:2795]
2025-10-02T09:34:00.867704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555325555205051:6922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:00.867714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555325555205051:6922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:00.867715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555325555205051:6922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:00.867720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:00.867806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:00.867953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:00.867976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:00.868166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:00.868203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.868207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.868207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.868208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.868208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.868209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.868209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.868210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.868210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.868211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.868211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.868212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.868215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.868221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.868223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.868225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.868227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.868229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.868231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.868233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.868235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.868237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.868239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.868241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.868245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.868250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:00.868253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.868256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:00.868258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.868260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:00.868262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.868267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:00.868271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.868279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:00.868284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.868288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:00.868296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.868303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:00.868306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.868310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:00.868312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.868315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:00.868320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.868325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.868330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.868333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.868335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.868337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.868354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:00.875767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:00.877645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:00.877655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:00.877657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:00.877659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:00.877662Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2186 [2:7556555325479644172:2795]
2025-10-02T09:34:00.877670Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:00.877679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:00.877684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.877685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.877686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.877694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:00.877699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:00.877703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:00.877733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.877738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.877740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.877743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:00.877745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:00.877786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:00.877791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.877798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:00.877804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:00.877815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:00.877827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555205186:6922], now have 1 active actors on pipe
2025-10-02T09:34:00.877833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555204707:2446], now have 1 active actors on pipe
2025-10-02T09:34:00.877836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.877838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.877839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.877848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:00.877857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:00.877860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:00.877862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:00.877863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:00.877867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:00.877869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:00.877871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2186
2025-10-02T09:34:00.877883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.877888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:00.877888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2186
2025-10-02T09:34:00.877890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:00.877908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.877913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.877928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde728a9-8ebaff49-1dda71b0-56376704_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:00.877935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:00.877937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:00.877938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:00.877942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:00.877947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:00.877955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.878111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:00.878117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:00.878126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:00.878201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2187 partition: 0 MaxSeqNo: 36 sessionId: src_id|bde728a9-8ebaff49-1dda71b0-56376704_0
2025-10-02T09:34:00.878481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e1cd3a-82568e-1fa9a77c-19daf989_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bde728a9-8ebaff49-1dda71b0-56376704_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:00.881094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Write session: try to update token
2025-10-02T09:34:00.881112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:00.886900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:00.886911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:00.886912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:00.886913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:00.886917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.886920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.886921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555325479644167:2795]
2025-10-02T09:34:00.886939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:00.886944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:00.886946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:00.886946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:00.886947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:00.886948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:00.887074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:00.893431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId: src_id|bde728a9-8ebaff49-1dda71b0-56376704_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:00.895678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:00.955432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555325555205202:8288]
2025-10-02T09:34:00.955595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2186, pipe: [1:7556555325555205202:8288]
2025-10-02T09:34:00.999941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.000437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.000450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.000468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555325555205202:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.000626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.000676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.000691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555325555205202:8288]
2025-10-02T09:34:01.000711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:01.000765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2187 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bde728a9-8ebaff49-1dda71b0-56376704_0
2025-10-02T09:34:01.000941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2187 sessionId: src_id|bde728a9-8ebaff49-1dda71b0-56376704_0 is DEAD
2025-10-02T09:34:01.001106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:01.001123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Write session will restart in 0.006455s
2025-10-02T09:34:01.001145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Write session: Do CDS request
2025-10-02T09:34:01.001151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.008174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.008289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.008300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2188
2025-10-02T09:34:01.008431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.008461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.008468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.008471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.008776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2188 sessionId:  describe result for acl check
2025-10-02T09:34:01.008819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.008823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.008824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.008827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850172795:6914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.009182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850172795:6914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.010789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850172795:6914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.012857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.013019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850172795:6914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.013028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850172795:6914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.013030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850172795:6914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.013034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.013119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.013264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.013272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.013279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.013310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.013332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774611753:2787]
2025-10-02T09:34:01.013688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.013868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.013894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.014081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.014112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.014116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.014117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.014117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.014118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.014118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.014119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.014119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.014120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.014120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.014121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.014121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.014124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.014130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.014132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.014134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.014136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.014138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.014140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.014142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.014144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.014146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.014148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.014150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.014153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.014157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.014161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.014163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.014167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.014169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.014171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.014174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.014176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.014179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.014181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.014184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.014188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.014193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.014200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.014205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.014212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.014214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.014216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.014219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.014221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.014223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.014227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.014229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.014247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.021654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.023408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.023420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.023422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.023425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.023430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2187 [2:7556555329774611753:2787]
2025-10-02T09:34:01.023437Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.023447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.023453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.023455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.023456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.023464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.023467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.023471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.023501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.023506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.023507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.023509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.023510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.023550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.023552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.023559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.023565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.023572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.023588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850172499:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.023593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850172979:6914], now have 1 active actors on pipe
2025-10-02T09:34:01.023597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.023598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.023599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.023608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.023616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.023624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.023626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.023612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2187
2025-10-02T09:34:01.023631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2187
2025-10-02T09:34:01.023634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.023639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.023641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.023641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.023643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.023646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.023663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.023670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.023690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec2062b-92f60430-37286ce3-51bcd01c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.023698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.023700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.023701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.023708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.023713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.023720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.023834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.023843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.023852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.023926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2188 partition: 0 MaxSeqNo: 36 sessionId: src_id|aec2062b-92f60430-37286ce3-51bcd01c_0
2025-10-02T09:34:01.024409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde728a9-8ebaff49-1dda71b0-56376704_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aec2062b-92f60430-37286ce3-51bcd01c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.027089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Write session: try to update token
2025-10-02T09:34:01.027106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.032844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.032853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.032854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.032855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.032859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.032861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.032863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774611747:2787]
2025-10-02T09:34:01.032885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.032888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.032889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.032891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.032892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.032893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.033002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.039731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId: src_id|aec2062b-92f60430-37286ce3-51bcd01c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.041937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.100846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850173003:8288]
2025-10-02T09:34:01.101040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2187, pipe: [1:7556555329850173003:8288]
2025-10-02T09:34:01.143871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.144354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.144364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.144376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173003:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.144526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.144562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.144597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:01.144605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850173003:8288]
2025-10-02T09:34:01.144708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aec2062b-92f60430-37286ce3-51bcd01c_0
2025-10-02T09:34:01.144881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2188 sessionId: src_id|aec2062b-92f60430-37286ce3-51bcd01c_0 is DEAD
2025-10-02T09:34:01.145013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:01.145027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Write session will restart in 0.008957s
2025-10-02T09:34:01.145051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Write session: Do CDS request
2025-10-02T09:34:01.145058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.155173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.155256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.155267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2189
2025-10-02T09:34:01.155346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.155370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.155378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.155381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.155680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2189 sessionId:  describe result for acl check
2025-10-02T09:34:01.155714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.155718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.155719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.155722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850173448:6907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.156095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850173448:6907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.156583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.156867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.156958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.156964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.156969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.156994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.157015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774612027:2783]
2025-10-02T09:34:01.157367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.157540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.157574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.157679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850173448:6907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.157763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.157794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.157795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.157795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.157796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.157796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.157797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.157797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.157798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.157798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.157799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.157799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.157800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.157804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.157814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.157817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.157821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.157824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.157828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.157830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.157832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.157834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.157836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.157838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.157840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.157843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.157847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.157850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.157853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.157855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.157858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.157864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.157867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.157872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.157874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.157877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.157879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.157882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.157885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.157887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.157890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.157892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.157895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.157901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.157904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.157906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.157908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.157911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.157928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.162705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850173448:6907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.162715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850173448:6907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.162716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850173448:6907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.162720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.165337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.166973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.166984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.166985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.166987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.166989Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2188 [2:7556555329774612027:2783]
2025-10-02T09:34:01.166996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.167006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.167011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.167013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.167014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.167023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.167027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.167032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.167069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.167074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.167075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.167077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.167079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.167115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.167120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.167126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.167131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.167139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.167153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173488:6907], now have 1 active actors on pipe
2025-10-02T09:34:01.167158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173004:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.167161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.167162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.167164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.167171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.167179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.167186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.167190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.167191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.167192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.167194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.167189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2188
2025-10-02T09:34:01.167205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.167198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2188
2025-10-02T09:34:01.167206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.167209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.167220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.167225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.167246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.167254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.167256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.167257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.167262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.167267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.167281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.167426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.167433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.167442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.167514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2189 partition: 0 MaxSeqNo: 36 sessionId: src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0
2025-10-02T09:34:01.167747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec2062b-92f60430-37286ce3-51bcd01c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.170353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Write session: try to update token
2025-10-02T09:34:01.170367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.176178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.176189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.176190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.176191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.176195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.176197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.176199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774612022:2783]
2025-10-02T09:34:01.176217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.176221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.176221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.176222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.176223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.176225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.176331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.182652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId: src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.184762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.244702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850173497:8288]
2025-10-02T09:34:01.244931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2188, pipe: [1:7556555329850173497:8288]
2025-10-02T09:34:01.286888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.287510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.287520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.287533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173497:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.287665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.287745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:01.287757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:01.287765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850173497:8288]
2025-10-02T09:34:01.287783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.287816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2189 reason: error at write: Disconnected sessionId: src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0
2025-10-02T09:34:01.287979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2189 sessionId: src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0 is DEAD
2025-10-02T09:34:01.288132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:01.288146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Write session will restart in 0.006137s
2025-10-02T09:34:01.288167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Write session: Do CDS request
2025-10-02T09:34:01.288173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.295150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.295265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.295276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2190
2025-10-02T09:34:01.295420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.295446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.295465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.295472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.295796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2190 sessionId:  describe result for acl check
2025-10-02T09:34:01.295825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.295830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.295831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.295836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850173769:6901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.296191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850173769:6901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.298083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850173769:6901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.300116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.300243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850173769:6901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.300252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850173769:6901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.300254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850173769:6901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.300258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.300358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.300456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.300463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.300468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.300496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.300519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774612303:2781]
2025-10-02T09:34:01.300886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.301056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.301291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.301501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.301535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.301540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.301540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.301541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.301541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.301542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.301543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.301543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.301544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.301544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.301545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.301545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.301548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.301554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.301556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.301558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.301560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.301562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.301564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.301566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.301568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.301570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.301572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.301574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.301577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.301581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.301584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.301587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.301589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.301592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.301594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.301596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.301599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.301601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.301603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.301606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.301608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.301611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.301613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.301616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.301618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.301620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.301622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.301625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.301627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.301629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.301631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.301634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.301650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.309103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.310641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.310655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.310657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.310660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.310664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2189 [2:7556555329774612303:2781]
2025-10-02T09:34:01.310673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.310682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.310683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.310685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.310686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.310694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.310697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.310701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.310729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.310734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.310735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.310737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.310739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.310775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.310780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.310786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.310791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.310803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.310818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173500:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.310823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173982:6901], now have 1 active actors on pipe
2025-10-02T09:34:01.310826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.310827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.310828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.310838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.310845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.310854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.310856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.310856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.310857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.310858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.310870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.310875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.310878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.310889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2189
2025-10-02T09:34:01.310890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2189
2025-10-02T09:34:01.310937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.310945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.310959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.310962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.310965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.310966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.310970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.310976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.310984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.311125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.311132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.311141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.311210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2190 partition: 0 MaxSeqNo: 36 sessionId: src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0
2025-10-02T09:34:01.311462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ce223a-e0dfc79e-b1732a1a-fee965d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.314041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Write session: try to update token
2025-10-02T09:34:01.314058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.319929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.319939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.319940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.319941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.319945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.319949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.319951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774612297:2781]
2025-10-02T09:34:01.319969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.319972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.319973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.319974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.319976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.319978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.320090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.326435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId: src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.328610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.388099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850173994:8288]
2025-10-02T09:34:01.388345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2189, pipe: [1:7556555329850173994:8288]
2025-10-02T09:34:01.432936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.433444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.433454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.433466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173994:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.433609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.433664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:01.433670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850173994:8288]
2025-10-02T09:34:01.433685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.433755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0
2025-10-02T09:34:01.433928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2190 sessionId: src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0 is DEAD
2025-10-02T09:34:01.434083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:01.434096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Write session will restart in 0.006994s
2025-10-02T09:34:01.434122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Write session: Do CDS request
2025-10-02T09:34:01.434127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.442176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.442275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.442287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2191
2025-10-02T09:34:01.442372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.442403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.442412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.442416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.442797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2191 sessionId:  describe result for acl check
2025-10-02T09:34:01.442840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.442842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.442843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.442848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850174383:6865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.443295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850174383:6865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.444702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.444986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850174383:6865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.445613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.445715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.445721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.445727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.445753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.445775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774612578:2763]
2025-10-02T09:34:01.446131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.446307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.446337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.446531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.446562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.446566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.446566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.446567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.446568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.446568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.446569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.446571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.446571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.446572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.446573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.446574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.446578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.446587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.446590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.446593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.446597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.446603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.446605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.446607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.446616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.446619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.446621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.446623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.446627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.446632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.446635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.446638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.446640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.446646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.446648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.446651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.446653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.446656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.446661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.446664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.446667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.446672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.446674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.446677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.446679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.446682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.446684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.446690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.446692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.446695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.446699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.446705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.446723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.446816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850174383:6865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.446828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850174383:6865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.446831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850174383:6865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.446835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.454148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.455737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.455749Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.455751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.455754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.455758Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2190 [2:7556555329774612578:2763]
2025-10-02T09:34:01.455767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.455780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.455782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.455784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.455786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.455797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.455803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.455809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.456098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.456106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.456107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.456109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.456111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.456149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.456154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.456161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.456166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.456175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.456188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.456193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.456194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.456199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.456208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850174482:6865], now have 1 active actors on pipe
2025-10-02T09:34:01.456208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.456210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.456212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.456214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850173995:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.456219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.456228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.456232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.456247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.456254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.456277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.456280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2190
2025-10-02T09:34:01.456282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2190
2025-10-02T09:34:01.456339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.456345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.456361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3e107a9-d260360d-309facab-be66b070_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.456369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.456371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.456373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.456378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.456387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.456398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.456527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.456531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.456539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.456603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2191 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3e107a9-d260360d-309facab-be66b070_0
2025-10-02T09:34:01.456888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40846f65-8ea91de7-c5619fb3-aee86c66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3e107a9-d260360d-309facab-be66b070_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.459426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Write session: try to update token
2025-10-02T09:34:01.459440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.467443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:01.467454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.467458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.467479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:01.467487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:01.467610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:01.467723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.467837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.467948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.468107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:01.468135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:01.471752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId: src_id|f3e107a9-d260360d-309facab-be66b070_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.473601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.473613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.473614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.473615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.473618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.473620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.473622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774612572:2763]
2025-10-02T09:34:01.473641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.473644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.473644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.473645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.473646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.473648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.473759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.473881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.533994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850174490:8288]
2025-10-02T09:34:01.534244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2190, pipe: [1:7556555329850174490:8288]
2025-10-02T09:34:01.586648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.587141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.587152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.587165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850174490:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.587294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.587364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:01.587383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.587437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850174490:8288]
2025-10-02T09:34:01.587462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2191 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3e107a9-d260360d-309facab-be66b070_0
2025-10-02T09:34:01.587595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2191 sessionId: src_id|f3e107a9-d260360d-309facab-be66b070_0 is DEAD
2025-10-02T09:34:01.587719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:01.587726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Write session will restart in 0.005975s
2025-10-02T09:34:01.587748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Write session: Do CDS request
2025-10-02T09:34:01.587754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.595142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.595263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.595272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2192
2025-10-02T09:34:01.595361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.595383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.595390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.595392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.595722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2192 sessionId:  describe result for acl check
2025-10-02T09:34:01.595756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.595761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.595763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.595767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850174786:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.596185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850174786:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.597892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850174786:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.600357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.600575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850174786:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.600587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850174786:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.600589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850174786:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.600596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.600605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.600711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.600718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.600725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.600753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.600777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774612882:2765]
2025-10-02T09:34:01.601145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.601299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.601323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.601512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.601544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.601548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.601549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.601550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.601550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.601551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.601551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.601551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.601552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.601553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.601553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.601554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.601556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.601562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.601564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.601566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.601568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.601570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.601571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.601573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.601575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.601577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.601579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.601581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.601584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.601588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.601592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.601594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.601596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.601599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.601601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.601603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.601605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.601608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.601610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.601612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.601614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.601617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.601619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.601621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.601623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.601626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.601627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.601630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.601632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.601634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.601636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.601639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.601655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.609051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.610797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.610808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.610809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.610811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.610814Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2191 [2:7556555329774612882:2765]
2025-10-02T09:34:01.610821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.610831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.610836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.610838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.610839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.610848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.610851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.610855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.610883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.610888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.610889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.610891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.610892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.610929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.610935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.610943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.610953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.610966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.610980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850174990:6842], now have 1 active actors on pipe
2025-10-02T09:34:01.610985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850174494:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.610988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.610990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.610991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.610998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.611010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.611011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.611013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.611014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.611019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.611021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.611034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.611040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.611042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.611031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2191
2025-10-02T09:34:01.611060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.611065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.611063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2191
2025-10-02T09:34:01.611083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6b54df0-23144c22-1a49f0cb-513af793_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.611090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.611092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.611093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.611098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.611103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.611111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.611231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.611236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.611244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.611311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2192 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6b54df0-23144c22-1a49f0cb-513af793_0
2025-10-02T09:34:01.611584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e107a9-d260360d-309facab-be66b070_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6b54df0-23144c22-1a49f0cb-513af793_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.614172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Write session: try to update token
2025-10-02T09:34:01.614187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.620069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.620081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.620082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.620083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.620086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.620089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.620091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774612877:2765]
2025-10-02T09:34:01.620109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.620115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.620116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.620117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.620118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.620120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.620238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.627098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId: src_id|f6b54df0-23144c22-1a49f0cb-513af793_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.629405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.687623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850175011:8288]
2025-10-02T09:34:01.687875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2191, pipe: [1:7556555329850175011:8288]
2025-10-02T09:34:01.734919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.735424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.735433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.735447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850175011:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.735583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.735649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:01.735679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850175011:8288]
2025-10-02T09:34:01.735701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.735758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2192 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6b54df0-23144c22-1a49f0cb-513af793_0
2025-10-02T09:34:01.735934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2192 sessionId: src_id|f6b54df0-23144c22-1a49f0cb-513af793_0 is DEAD
2025-10-02T09:34:01.736075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:01.736086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Write session will restart in 0.006027s
2025-10-02T09:34:01.736107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Write session: Do CDS request
2025-10-02T09:34:01.736113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.743192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.743620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.743635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2193
2025-10-02T09:34:01.743726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.743749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.743757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.743760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.744317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2193 sessionId:  describe result for acl check
2025-10-02T09:34:01.744351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.744356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.744357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.744363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850175353:6823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.744768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850175353:6823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.746426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850175353:6823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.748015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.748406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.748424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850175353:6823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.748434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850175353:6823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.748437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850175353:6823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.748442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.748515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.748522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.748527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.748555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.748577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774613166:2756]
2025-10-02T09:34:01.748959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.749155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.749190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.749374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.749405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.749409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.749410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.749411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.749411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.749412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.749412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.749413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.749413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.749414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.749415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.749416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.749420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.749429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.749432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.749436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.749439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.749443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.749446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.749448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.749450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.749452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.749453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.749455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.749459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.749465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.749468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.749471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.749474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.749477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.749479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.749482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.749484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.749487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.749489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.749492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.749494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.749496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.749500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.749502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.749506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.749508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.749510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.749513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.749516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.749519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.749521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.749523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.749540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.756964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.758482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.758493Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.758494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.758496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.758499Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2192 [2:7556555329774613166:2756]
2025-10-02T09:34:01.758507Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.758517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.758518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.758520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.758520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.758529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.758536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.758540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.758570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.758574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.758575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.758577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.758579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.758624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.758629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.758638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.758648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.758666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.758679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850175014:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.758685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850175499:6823], now have 1 active actors on pipe
2025-10-02T09:34:01.758688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.758689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.758691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.758698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.758707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.758714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.758715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.758716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.758717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.758719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.758728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.758731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.758733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.758728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2192
2025-10-02T09:34:01.758733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2192
2025-10-02T09:34:01.758767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.758772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.758786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9554aa62-3207d53d-1318403d-bef36481_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.758791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.758793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.758794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.758800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.758805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.758813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.758940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.758947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.758957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.759023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2193 partition: 0 MaxSeqNo: 36 sessionId: src_id|9554aa62-3207d53d-1318403d-bef36481_0
2025-10-02T09:34:01.759266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b54df0-23144c22-1a49f0cb-513af793_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9554aa62-3207d53d-1318403d-bef36481_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.761803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Write session: try to update token
2025-10-02T09:34:01.761818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.767630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:01.767640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.767644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.767664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:01.767671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:01.767812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:01.767933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.768048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.768168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.768325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:01.768347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:01.774688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId: src_id|9554aa62-3207d53d-1318403d-bef36481_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.776217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.776226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.776227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.776228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.776232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.776234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.776236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774613161:2756]
2025-10-02T09:34:01.776255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.776257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.776258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.776259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.776262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.776264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.776380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.776904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.836094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850175510:8288]
2025-10-02T09:34:01.836363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2192, pipe: [1:7556555329850175510:8288]
2025-10-02T09:34:01.887980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:01.888383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.888393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.888407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850175510:8288], now have 1 active actors on pipe
2025-10-02T09:34:01.888554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:01.888618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:01.888621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850175510:8288]
2025-10-02T09:34:01.888644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:01.888718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2193 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9554aa62-3207d53d-1318403d-bef36481_0
2025-10-02T09:34:01.888885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2193 sessionId: src_id|9554aa62-3207d53d-1318403d-bef36481_0 is DEAD
2025-10-02T09:34:01.889005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:01.889012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Write session will restart in 0.005583s
2025-10-02T09:34:01.889034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Write session: Do CDS request
2025-10-02T09:34:01.889040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:01.895168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.895254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:01.895267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2194
2025-10-02T09:34:01.895356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:01.895378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:01.895386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:01.895389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:01.895707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2194 sessionId:  describe result for acl check
2025-10-02T09:34:01.895732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:01.895737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:01.895739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:01.895743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555329850175739:6804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:01.896162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555329850175739:6804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:01.897503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555329850175739:6804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:01.899478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555329850175739:6804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:01.899488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555329850175739:6804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:01.899491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555329850175739:6804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:01.899496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:01.900839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:01.901120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:01.901258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:01.901266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:01.901272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:01.901303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:01.901330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555329774613445:2754]
2025-10-02T09:34:01.901682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:01.901855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:01.901883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:01.902078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:01.902111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.902115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.902115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.902116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.902116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.902117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.902117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.902118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.902118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.902119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.902119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.902120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.902123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.902130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.902132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.902134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.902136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.902138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.902140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.902142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.902144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.902146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.902148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.902150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.902154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.902158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:01.902161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.902164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:01.902166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.902168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:01.902170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.902173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:01.902175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.902178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:01.902180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.902183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:01.902185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.902187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:01.902189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.902192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:01.902194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.902198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:01.902199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.902202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.902204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.902207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.902209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.902211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.902229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:01.909623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:01.911160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:01.911171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:01.911172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:01.911174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:01.911177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2193 [2:7556555329774613445:2754]
2025-10-02T09:34:01.911184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:01.911193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:01.911197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.911199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.911200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.911209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:01.911215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:01.911221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:01.911263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.911269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.911270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.911271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:01.911273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:01.911308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:01.911312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.911319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:01.911324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:01.911334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:01.911348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850176002:6804], now have 1 active actors on pipe
2025-10-02T09:34:01.911352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850175519:2446], now have 1 active actors on pipe
2025-10-02T09:34:01.911355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.911356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.911357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.911366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:01.911373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:01.911380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:01.911383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:01.911385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:01.911385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:01.911386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:01.911399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.911401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:01.911403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:01.911419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2193
2025-10-02T09:34:01.911420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2193
2025-10-02T09:34:01.911481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.911491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.911514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:01.911523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:01.911525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:01.911529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:01.911534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:01.911540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:01.911550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.911682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:01.911687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:01.911696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:01.911758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2194 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0
2025-10-02T09:34:01.912000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9554aa62-3207d53d-1318403d-bef36481_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:01.914542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Write session: try to update token
2025-10-02T09:34:01.914559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:01.920464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:01.920474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.920479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.920501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:01.920505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:01.920635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:01.920761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.920910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.921027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:01.921195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:01.921220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:01.927750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId: src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:01.929016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:01.929028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:01.929030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:01.929031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:01.929035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.929038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.929042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555329774613440:2754]
2025-10-02T09:34:01.929064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:01.929069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:01.929070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:01.929071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:01.929073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:01.929077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:01.929185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:01.930081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:01.988672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555329850176019:8288]
2025-10-02T09:34:01.988888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2193, pipe: [1:7556555329850176019:8288]
2025-10-02T09:34:02.041629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.042072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.042081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.042095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555329850176019:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.042230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.042251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:02.042261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.042267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:02.042294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555329850176019:8288]
2025-10-02T09:34:02.042383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2194 reason: error at write: Disconnected sessionId: src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0
2025-10-02T09:34:02.042533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2194 sessionId: src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0 is DEAD
2025-10-02T09:34:02.042685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:02.042691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Write session will restart in 0.008048s
2025-10-02T09:34:02.042712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Write session: Do CDS request
2025-10-02T09:34:02.042718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.052144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.052286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.052297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2195
2025-10-02T09:34:02.052390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.052411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.052418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.052421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.052766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2195 sessionId:  describe result for acl check
2025-10-02T09:34:02.052812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.052819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.052820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.052825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145143779:6801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.053223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145143779:6801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.053940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.054183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.054285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.054291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.054297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.054324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.054348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069581034:2736]
2025-10-02T09:34:02.054700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.054730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145143779:6801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.054864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.054887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.055065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.055095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.055099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.055100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.055100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.055101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.055101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.055102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.055102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.055103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.055104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.055104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.055105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.055107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.055114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.055116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.055118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.055120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.055122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.055124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.055126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.055128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.055130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.055132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.055134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.055138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.055142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.055145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.055148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.055150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.055153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.055155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.055157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.055160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.055162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.055164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.055167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.055169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.055172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.055174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.055176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.055180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.055184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.055186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.055188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.055191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.055193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.055195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.055198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.055213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.059023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145143779:6801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.059032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145143779:6801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.059035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145143779:6801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.059040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.062641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.064464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.064474Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.064475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.064477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.064481Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2194 [2:7556555334069581034:2736]
2025-10-02T09:34:02.064487Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.064496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.064498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.064499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.064500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.064509Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.064512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.064517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.064546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.064552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.064553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.064554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.064556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.064591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.064596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.064602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.064607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.064616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.064628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145143819:6801], now have 1 active actors on pipe
2025-10-02T09:34:02.064634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145143329:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.064638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.064639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.064640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.064647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.064655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.064664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.064664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.064665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.064666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.064668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.064680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.064685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.064687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.064693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2194
2025-10-02T09:34:02.064695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2194
2025-10-02T09:34:02.064760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.064766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.064781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.064784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.064788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.064789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.064794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.064812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.064819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.064943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.064947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.064955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.065020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2195 partition: 0 MaxSeqNo: 36 sessionId: src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0
2025-10-02T09:34:02.065241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b577eb3-7cf87b92-1d5fd418-f5dbaff6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.067794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Write session: try to update token
2025-10-02T09:34:02.067808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.073588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:02.073603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.073608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.073631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:02.073637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:02.073762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:02.073872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.073983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.074094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.074265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:02.074285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:02.080329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId: src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.081898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.081908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.081910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.081913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.081916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.081918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.081920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069581028:2736]
2025-10-02T09:34:02.081937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.081940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.081940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.081941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.081943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.081945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.082049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.082630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:02.142258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555334145143826:8288]
2025-10-02T09:34:02.142452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2194, pipe: [1:7556555334145143826:8288]
2025-10-02T09:34:02.192974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.193177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.193187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.193200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145143826:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.193348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.193403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:02.193423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.193424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:02.193501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2195 reason: error at write: Disconnected sessionId: src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0
2025-10-02T09:34:02.193556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555334145143826:8288]
2025-10-02T09:34:02.193654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2195 sessionId: src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0 is DEAD
2025-10-02T09:34:02.193792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:02.193798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Write session will restart in 0.006847s
2025-10-02T09:34:02.193821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Write session: Do CDS request
2025-10-02T09:34:02.193827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.201182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.201289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.201311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2196
2025-10-02T09:34:02.201417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.201443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.201452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.201456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.201823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2196 sessionId:  describe result for acl check
2025-10-02T09:34:02.201859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.201864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.201866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.201871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145144143:6795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.202316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145144143:6795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.203909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145144143:6795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.205914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.206088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145144143:6795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.206100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145144143:6795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.206102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145144143:6795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.206107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.206184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.206280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.206286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.206292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.206317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.206338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069581315:2737]
2025-10-02T09:34:02.206695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.206868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.206891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.207072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.207100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.207103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.207104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.207104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.207105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.207105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.207106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.207107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.207107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.207108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.207108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.207109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.207112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.207118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.207120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.207122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.207124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.207126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.207128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.207130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.207132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.207134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.207136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.207138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.207142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.207146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.207149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.207152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.207154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.207157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.207159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.207162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.207164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.207167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.207169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.207171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.207173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.207176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.207178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.207182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.207186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.207189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.207191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.207194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.207196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.207198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.207200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.207203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.207219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.214547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.216046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.216057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.216059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.216061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.216065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2195 [2:7556555334069581315:2737]
2025-10-02T09:34:02.216072Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.216083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.216085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.216087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.216088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.216097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.216101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.216106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.216135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.216140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.216141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.216144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.216145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.216313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.216319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.216303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2195
2025-10-02T09:34:02.216326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.216333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.216341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.216304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2195
2025-10-02T09:34:02.216352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145143828:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.216354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145144316:6795], now have 1 active actors on pipe
2025-10-02T09:34:02.216366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.216368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.216378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.216380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.216381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.216390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.216398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.216402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.216405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.216406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.216409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.216411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.216416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.216419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.216421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.216422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.216427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.216432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.216447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.216455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.216461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.216462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.216566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.216571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.216579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.216636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2196 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0
2025-10-02T09:34:02.216922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741e251d-d85acdf7-6e5a90f1-c0782972_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.219572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Write session: try to update token
2025-10-02T09:34:02.219590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.225452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:02.225465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.225473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.225497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:02.225503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:02.225630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:02.225748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.225868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.225985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.226157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:02.226185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:02.233145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId: src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.233828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.233839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.233840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.233841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.233847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.233849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.233851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069581309:2737]
2025-10-02T09:34:02.233872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.233873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.233876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.233876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.233877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.233880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.233988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.235495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:02.293799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555334145144329:8288]
2025-10-02T09:34:02.293975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2195, pipe: [1:7556555334145144329:8288]
2025-10-02T09:34:02.343470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.343973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.343982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.343995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145144329:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.344117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.344175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.344183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:02.344259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555334145144329:8288]
2025-10-02T09:34:02.344284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0
2025-10-02T09:34:02.344454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2196 sessionId: src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0 is DEAD
2025-10-02T09:34:02.344567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:02.344572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Write session will restart in 0.005264s
2025-10-02T09:34:02.344591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Write session: Do CDS request
2025-10-02T09:34:02.344595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.351163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.351256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.351269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2197
2025-10-02T09:34:02.351359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.351383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.351392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.351396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.351729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2197 sessionId:  describe result for acl check
2025-10-02T09:34:02.351759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.351764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.351766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.351769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145144573:6783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.352240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145144573:6783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.353891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145144573:6783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.355559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145144573:6783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.355568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145144573:6783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.355571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145144573:6783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.355576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.356763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.357041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.357136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.357142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.357148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.357175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.357197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069581598:2744]
2025-10-02T09:34:02.357546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.357709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.357731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.357910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.357941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.357945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.357946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.357947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.357947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.357948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.357948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.357949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.357949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.357950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.357951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.357951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.357954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.357962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.357964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.357966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.357968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.357970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.357972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.357974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.357976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.357979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.357981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.357983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.357986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.357991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.357994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.357997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.357999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.358002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.358006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.358009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.358011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.358013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.358019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.358021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.358024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.358027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.358030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.358032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.358036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.358040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.358044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.358047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.358049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.358055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.358057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.358060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.358076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.365565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.367187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.367198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.367199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.367201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.367204Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2196 [2:7556555334069581598:2744]
2025-10-02T09:34:02.367211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.367220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.367225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.367226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.367227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.367236Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.367242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.367246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.367274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.367280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.367281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.367283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.367284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.367318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.367323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.367329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.367337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.367348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.367364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145144816:6783], now have 1 active actors on pipe
2025-10-02T09:34:02.367369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145144330:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.367372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.367373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.367374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.367382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.367392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.367396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.367397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.367398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.367402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.367403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.367416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.367422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.367423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.367431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2196
2025-10-02T09:34:02.367431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2196
2025-10-02T09:34:02.367465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.367470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.367485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48972394-c2f6da9b-f1068128-4031de86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.367492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.367494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.367495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.367500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.367508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.367517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.367638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.367643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.367650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.367712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2197 partition: 0 MaxSeqNo: 36 sessionId: src_id|48972394-c2f6da9b-f1068128-4031de86_0
2025-10-02T09:34:02.368004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebcbbde-b1dad6eb-4d04e9cf-22aa47b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48972394-c2f6da9b-f1068128-4031de86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.370535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Write session: try to update token
2025-10-02T09:34:02.370550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.376414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.376425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.376426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.376427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.376431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.376433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.376436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069581593:2744]
2025-10-02T09:34:02.376453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.376458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.376459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.376460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.376461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.376463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.376565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.382988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId: src_id|48972394-c2f6da9b-f1068128-4031de86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.385441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:02.444350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555334145144831:8288]
2025-10-02T09:34:02.444529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2196, pipe: [1:7556555334145144831:8288]
2025-10-02T09:34:02.486269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.486804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.486813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.486826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145144831:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.486940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.487036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:02.487041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555334145144831:8288]
2025-10-02T09:34:02.487071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.487140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2197 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48972394-c2f6da9b-f1068128-4031de86_0
2025-10-02T09:34:02.487297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2197 sessionId: src_id|48972394-c2f6da9b-f1068128-4031de86_0 is DEAD
2025-10-02T09:34:02.487431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:02.487438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Write session will restart in 0.006778s
2025-10-02T09:34:02.487459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Write session: Do CDS request
2025-10-02T09:34:02.487465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.495133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.495238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.495249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2198
2025-10-02T09:34:02.495352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.495375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.495383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.495386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.495719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2198 sessionId:  describe result for acl check
2025-10-02T09:34:02.495742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.495748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.495749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.495754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145145177:6769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.496203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145145177:6769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.498087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145145177:6769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.499429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.499675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.499796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.499803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.499809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.499838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.499862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069581879:2738]
2025-10-02T09:34:02.499924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145145177:6769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.499933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145145177:6769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.499939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145145177:6769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.499943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.500210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.500377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.500399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.500583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.500614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.500618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.500619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.500619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.500620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.500620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.500621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.500621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.500622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.500622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.500623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.500623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.500626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.500633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.500635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.500637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.500639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.500642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.500643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.500645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.500647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.500650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.500652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.500654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.500658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.500662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.500665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.500668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.500670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.500673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.500676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.500678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.500681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.500684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.500686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.500688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.500691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.500693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.500696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.500698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.500701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.500704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.500706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.500712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.500714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.500718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.500720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.500722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.500739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.508043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.509794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.509806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.509807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.509809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.509813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2197 [2:7556555334069581879:2738]
2025-10-02T09:34:02.509820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.509830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.509831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.509833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.509834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.509842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.509845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.509850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.509878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.509883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.509884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.509886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.509887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.509925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.509930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.509937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.509946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.509956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.509970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145144832:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.509976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145145322:6769], now have 1 active actors on pipe
2025-10-02T09:34:02.509979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.509981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.509982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.509989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.509996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.510002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.510004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.510005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.510007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.510009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.510022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.510027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.510028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.510023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2197
2025-10-02T09:34:02.510029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2197
2025-10-02T09:34:02.510057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.510062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.510080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.510087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.510090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.510091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.510096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.510104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.510115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.510242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.510247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.510255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.510318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2198 partition: 0 MaxSeqNo: 36 sessionId: src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0
2025-10-02T09:34:02.510523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48972394-c2f6da9b-f1068128-4031de86_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.513095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Write session: try to update token
2025-10-02T09:34:02.513109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.520838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:02.520848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.520855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.520881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:02.520881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:02.521021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:02.521138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.521260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.521389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:02.521559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:02.521583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:02.525768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId: src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.527531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.527545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.527546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.527547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.527552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.527554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.527556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069581874:2738]
2025-10-02T09:34:02.527576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.527580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.527581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.527581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.527585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.527588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.527722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.528185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:02.587205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555334145145334:8288]
2025-10-02T09:34:02.587420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2197, pipe: [1:7556555334145145334:8288]
2025-10-02T09:34:02.642075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.642593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.642602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.642625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145145334:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.642791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.642820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555334145145334:8288]
2025-10-02T09:34:02.642856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.642887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:02.642960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0
2025-10-02T09:34:02.643111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2198 sessionId: src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0 is DEAD
2025-10-02T09:34:02.643223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:02.643234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Write session will restart in 0.009300s
2025-10-02T09:34:02.643251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Write session: Do CDS request
2025-10-02T09:34:02.643256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.653172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.653274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.653293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2199
2025-10-02T09:34:02.653388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.653412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.653419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.653423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.653724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2199 sessionId:  describe result for acl check
2025-10-02T09:34:02.653749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.653754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.653755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.653759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145145806:6726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.654164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145145806:6726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.654597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.654887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.654992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.654998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.655004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.655030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.655052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069582191:2724]
2025-10-02T09:34:02.655395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.655557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.655580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.655702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145145806:6726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.655759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.655790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.655794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.655795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.655795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.655796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.655797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.655797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.655798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.655798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.655799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.655800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.655800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.655803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.655809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.655811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.655813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.655815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.655817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.655819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.655821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.655823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.655825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.655827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.655829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.655834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.655838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.655841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.655844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.655846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.655849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.655851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.655854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.655856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.655859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.655861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.655863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.655866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.655868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.655874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.655877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.655879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.655882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.655884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.655887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.655891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.655894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.655899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.655902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.655918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.660930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145145806:6726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.660947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145145806:6726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.660950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145145806:6726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.660956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.663302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.665053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.665062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.665063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.665065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.665069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2198 [2:7556555334069582191:2724]
2025-10-02T09:34:02.665076Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.665085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.665087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.665088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.665090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.665100Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.665102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.665108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.665136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.665141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.665142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.665144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.665146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.665179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.665183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.665191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.665196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.665208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.665219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145145852:6726], now have 1 active actors on pipe
2025-10-02T09:34:02.665224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145145351:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.665227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.665228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.665229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.665236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.665243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.665251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.665255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.665255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.665257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.665258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.665270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.665271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.665277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.665263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2198
2025-10-02T09:34:02.665282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2198
2025-10-02T09:34:02.665293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.665298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.665313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac01239d-633e63ef-6706561e-543d30ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.665321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.665322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.665323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.665328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.665333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.665341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.665456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.665465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.665474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.665544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2199 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac01239d-633e63ef-6706561e-543d30ff_0
2025-10-02T09:34:02.665760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a03318-dd4e0a68-673cd2b7-62ad2da5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac01239d-633e63ef-6706561e-543d30ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.668280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Write session: try to update token
2025-10-02T09:34:02.668294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.674326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.674339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.674340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.674341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.674346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.674348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.674350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069582186:2724]
2025-10-02T09:34:02.674369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.674372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.674373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.674374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.674377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.674379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.674492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.681173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId: src_id|ac01239d-633e63ef-6706561e-543d30ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.683374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:02.742851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555334145145860:8288]
2025-10-02T09:34:02.743081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2198, pipe: [1:7556555334145145860:8288]
2025-10-02T09:34:02.786794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.787010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.787018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.787031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145145860:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.787140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.787187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:02.787209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.787268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2199 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac01239d-633e63ef-6706561e-543d30ff_0
2025-10-02T09:34:02.787275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555334145145860:8288]
2025-10-02T09:34:02.787407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2199 sessionId: src_id|ac01239d-633e63ef-6706561e-543d30ff_0 is DEAD
2025-10-02T09:34:02.787551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:02.787557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Write session will restart in 0.008606s
2025-10-02T09:34:02.787581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Write session: Do CDS request
2025-10-02T09:34:02.787587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.797162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.797259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.797277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2200
2025-10-02T09:34:02.797373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.797397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.797405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.797407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.797740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2200 sessionId:  describe result for acl check
2025-10-02T09:34:02.797764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.797769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.797771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.797775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145146317:6719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.798201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145146317:6719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.799536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.799776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.799860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145146317:6719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.799877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.799883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.799889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.799916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.799938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069582482:2709]
2025-10-02T09:34:02.800282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.800436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.800458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.800646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.800682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.800687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.800687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.800688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.800689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.800689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.800690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.800690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.800691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.800691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.800692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.800692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.800695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.800701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.800703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.800705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.800707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.800709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.800711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.800713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.800715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.800718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.800720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.800721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.800725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.800730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.800733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.800736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.800738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.800741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.800743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.800746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.800748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.800751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.800753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.800756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.800758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.800760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.800762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.800765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.800767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.800771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.800773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.800776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.800778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.800781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.800783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.800785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.800816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.804581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145146317:6719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.804591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145146317:6719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.804594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145146317:6719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.804599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.808239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.809903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.809915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.809916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.809918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.809922Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2199 [2:7556555334069582482:2709]
2025-10-02T09:34:02.809930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.809940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.809945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.809947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.809948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.809957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.809961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.809971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.810010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.810015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.810016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.810019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.810020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.810057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.810061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.810068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.810076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.810095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.810113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145146358:6719], now have 1 active actors on pipe
2025-10-02T09:34:02.810119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145145861:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.810123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.810124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.810125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.810132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.810142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.810146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.810148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.810149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.810153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.810154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.810144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2199
2025-10-02T09:34:02.810159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2199
2025-10-02T09:34:02.810169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.810175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.810176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.810188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.810193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.810220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.810227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.810229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.810230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.810235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.810243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.810255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.810358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.810364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.810372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.810451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2200 partition: 0 MaxSeqNo: 36 sessionId: src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0
2025-10-02T09:34:02.810674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac01239d-633e63ef-6706561e-543d30ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.813245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Write session: try to update token
2025-10-02T09:34:02.813261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.819245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.819257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.819258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.819259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.819263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.819265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.819269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069582477:2709]
2025-10-02T09:34:02.819288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.819291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.819291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.819292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.819294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.819296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.819434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.825569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId: src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.827909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:02.887202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555334145146373:8288]
2025-10-02T09:34:02.887378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2199, pipe: [1:7556555334145146373:8288]
2025-10-02T09:34:02.933384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:02.933835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.933845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.933858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145146373:8288], now have 1 active actors on pipe
2025-10-02T09:34:02.933989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:02.934074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:02.934094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555334145146373:8288]
2025-10-02T09:34:02.934121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:02.934207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2200 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0
2025-10-02T09:34:02.934371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2200 sessionId: src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0 is DEAD
2025-10-02T09:34:02.934525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:02.934531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Write session will restart in 0.005959s
2025-10-02T09:34:02.934552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Write session: Do CDS request
2025-10-02T09:34:02.934557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:02.941131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.941227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:02.941240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2201
2025-10-02T09:34:02.941350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:02.941375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:02.941382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:02.941385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:02.941680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2201 sessionId:  describe result for acl check
2025-10-02T09:34:02.941711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:02.941717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:02.941718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:02.941721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555334145146660:6696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:02.942054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555334145146660:6696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:02.943578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555334145146660:6696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:02.945180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:02.946191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:02.946291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:02.946298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:02.946303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:02.946331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:02.946332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555334145146660:6696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:02.946344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555334145146660:6696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:02.946347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555334145146660:6696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:02.946351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555334069582777:2718]
2025-10-02T09:34:02.946351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:02.946832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:02.947002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:02.947026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:02.947268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:02.947300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.947304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.947305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.947305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.947306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.947306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.947307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.947307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.947308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.947308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.947309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.947309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.947312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.947318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.947320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.947322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.947324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.947326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.947328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.947329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.947331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.947333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.947335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.947337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.947341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.947345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:02.947349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.947351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:02.947353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.947356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:02.947358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.947360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:02.947364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.947366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:02.947368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.947371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:02.947373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.947376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:02.947377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.947380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:02.947382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.947384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:02.947387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.947389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.947391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.947394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.947396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.947399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.947415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:02.954824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:02.956405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:02.956416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:02.956418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:02.956420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:02.956424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2200 [2:7556555334069582777:2718]
2025-10-02T09:34:02.956430Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:02.956440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:02.956444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.956445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.956446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.956455Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:02.956458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:02.956462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:02.956492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.956496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.956497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.956499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:02.956501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:02.956538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:02.956542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.956548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:02.956553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:02.956561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:02.956576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145146377:2446], now have 1 active actors on pipe
2025-10-02T09:34:02.956582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555334145146869:6696], now have 1 active actors on pipe
2025-10-02T09:34:02.956585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.956587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.956588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.956595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:02.956603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:02.956607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:02.956609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:02.956610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:02.956611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:02.956613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:02.956626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.956633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:02.956636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:02.956628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2200
2025-10-02T09:34:02.956677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2200
2025-10-02T09:34:02.956868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.956874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.956888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b903dd6-7553487e-79094ecd-26682adc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:02.956892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:02.956898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:02.956899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:02.956904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:02.956909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:02.956916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.957045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:02.957050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:02.957057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:02.957133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2201 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b903dd6-7553487e-79094ecd-26682adc_0
2025-10-02T09:34:02.957424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e166d23-c96a5ba1-b4e4d1dd-ec69cd22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b903dd6-7553487e-79094ecd-26682adc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:02.959983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Write session: try to update token
2025-10-02T09:34:02.959996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:02.965574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:02.965585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:02.965586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:02.965587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:02.965591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.965593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.965595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555334069582771:2718]
2025-10-02T09:34:02.965612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:02.965614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:02.965615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:02.965616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:02.965617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:02.965619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:02.965733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:02.971989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId: src_id|3b903dd6-7553487e-79094ecd-26682adc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:02.974415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.034151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555338440114178:8288]
2025-10-02T09:34:03.034358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2200, pipe: [1:7556555338440114178:8288]
2025-10-02T09:34:03.077252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.077476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.077486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.077499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440114178:8288], now have 1 active actors on pipe
2025-10-02T09:34:03.077647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.077720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440114178:8288]
2025-10-02T09:34:03.077730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.077773Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:34:03.077794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.077856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2201 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b903dd6-7553487e-79094ecd-26682adc_0
2025-10-02T09:34:03.077928Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 22 consumer shared/user session shared/user_1_22_16846683044609507210_v1 is DEAD
2025-10-02T09:34:03.077991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2201 sessionId: src_id|3b903dd6-7553487e-79094ecd-26682adc_0 is DEAD
2025-10-02T09:34:03.078065Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:34:03.078079Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555274015575649:8301] disconnected; active server actors: 1
2025-10-02T09:34:03.078086Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555274015575649:8301] client user disconnected session shared/user_1_22_16846683044609507210_v1
2025-10-02T09:34:03.078144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.078154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Write session will restart in 0.007559s
2025-10-02T09:34:03.078175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Write session: Do CDS request
2025-10-02T09:34:03.078181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.078192Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:03.078196Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:03.078203Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006307s
2025-10-02T09:34:03.085014Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:34:03.085214Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:34:03.085224Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 23
2025-10-02T09:34:03.085364Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 23 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:03.085404Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:03.085472Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 auth for : user
2025-10-02T09:34:03.085646Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 Handle describe topics response
2025-10-02T09:34:03.085673Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 auth is DEAD
2025-10-02T09:34:03.085679Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:34:03.085865Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:34:03.085939Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555338440114442:6086] connected; active server actors: 1
2025-10-02T09:34:03.085962Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_23_2727249289602532895_v1
2025-10-02T09:34:03.085953Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555338440114442:6086] session shared/user_1_23_2727249289602532895_v1
2025-10-02T09:34:03.085959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:34:03.085965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:34:03.085969Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_23_2727249289602532895_v1" (Sender=[1:7556555338440114380:6086], Pipe=[1:7556555338440114442:6086], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:03.085971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:34:03.085980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:34:03.085985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_23_2727249289602532895_v1" (Sender=[1:7556555338440114380:6086], Pipe=[1:7556555338440114442:6086], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:03.085990Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_23_2727249289602532895_v1" sender [1:7556555338440114380:6086] lock partition 0 for ReadingSession "shared/user_1_23_2727249289602532895_v1" (Sender=[1:7556555338440114380:6086], Pipe=[1:7556555338440114442:6086], Partitions=[], ActiveFamilyCount=1) generation 1 step 23
2025-10-02T09:34:03.086000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:34:03.086002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000021s
2025-10-02T09:34:03.086139Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 23 Session: "shared/user_1_23_2727249289602532895_v1" ClientId: "user" PipeClient { RawX1: 7556555338440114442 RawX2: 4503603922343878 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:34:03.086154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:34:03.087078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.087224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.087230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2202
2025-10-02T09:34:03.087320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.087340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.087347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.087350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.087594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2202 sessionId:  describe result for acl check
2025-10-02T09:34:03.087618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.087623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.087624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.087628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440114600:6662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.088051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440114600:6662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.089493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440114600:6662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.090979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.091244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.091343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.091350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.091356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.091383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.091407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364550362:2704]
2025-10-02T09:34:03.091426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440114600:6662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.091441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440114600:6662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.091443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440114600:6662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.091448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.091752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.091912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.091935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.092111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.092141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.092145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.092146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.092146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.092147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.092147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.092148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.092148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.092149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.092149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.092150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.092150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.092153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.092159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.092161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.092163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.092165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.092167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.092169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.092171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.092173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.092175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.092177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.092179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.092184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.092187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.092191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.092194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.092196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.092199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.092201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.092203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.092206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.092208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.092210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.092213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.092215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.092218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.092220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.092223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.092228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.092232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.092234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.092236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.092241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.092244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.092246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.092249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.092265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.099682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.101449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.101459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.101460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.101462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.101465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2201 [2:7556555338364550362:2704]
2025-10-02T09:34:03.101471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.101481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.101486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.101487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.101488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.101497Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.101504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.101508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.101540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.101544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.101546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.101547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.101549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.101588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.101593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.101599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.101605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.101613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.101628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440114191:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.101633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440114692:6662], now have 1 active actors on pipe
2025-10-02T09:34:03.101635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440114467:6658], now have 1 active actors on pipe
2025-10-02T09:34:03.101638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.101640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.101641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.101648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.101655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.101661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.101663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.101663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.101664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.101665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.101679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.101680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.101691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.101676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2201
2025-10-02T09:34:03.101703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2201, pipe: [1:7556555338440114467:6658]
2025-10-02T09:34:03.101704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2201
2025-10-02T09:34:03.101741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.101747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.101754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_23_2727249289602532895_v1 on pipe: [1:7556555338440114467:6658]
2025-10-02T09:34:03.101765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.101766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.101773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.101777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.101778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.101784Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_23_2727249289602532895_v1:1 with generation 2201
2025-10-02T09:34:03.101786Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_23_2727249289602532895_v1
2025-10-02T09:34:03.101787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.101804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.101807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:34:03.101813Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:34:03.105257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:34:03.105273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:34:03.105277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.105280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.105281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.105287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.105292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.105298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:34:03.105304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:34:03.105314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.105406Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397643101 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:34:03.105432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.105428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:34:03.105437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.105445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.105458Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 sending to client partition status
2025-10-02T09:34:03.105497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2202 partition: 0 MaxSeqNo: 36 sessionId: src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0
2025-10-02T09:34:03.105806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b903dd6-7553487e-79094ecd-26682adc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.108450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Write session: try to update token
2025-10-02T09:34:03.108464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:03.110882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:03.110891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.110892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:03.110893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:03.110897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.110899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.110901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364550357:2704]
2025-10-02T09:34:03.110919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:03.110922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.110923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:03.110925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:03.110927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:03.110929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:03.111034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:03.121065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId: src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:03.123352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.222718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.222954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.222965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.223118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_23_2727249289602532895_v1
2025-10-02T09:34:03.223134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.223155Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_23_2727249289602532895_v1
2025-10-02T09:34:03.223217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.223251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.223287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2202 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0
2025-10-02T09:34:03.223326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440114467:6658]
2025-10-02T09:34:03.223420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2202 sessionId: src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0 is DEAD
2025-10-02T09:34:03.223578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.223590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Write session will restart in 0.007548s
2025-10-02T09:34:03.223615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Write session: Do CDS request
2025-10-02T09:34:03.223621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.232226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.232336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.232355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2203
2025-10-02T09:34:03.232479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.232504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.232513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.232516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.232846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2203 sessionId:  describe result for acl check
2025-10-02T09:34:03.232878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.232883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.232884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.232887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440115044:6650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.233236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440115044:6650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.235102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440115044:6650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.237492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.237612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440115044:6650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.237624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440115044:6650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.237626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440115044:6650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.237630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.237739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.237833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.237839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.237845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.237872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.237893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364550652:2700]
2025-10-02T09:34:03.238230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.241371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.241403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.241600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.241635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.241638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.241639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.241639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.241640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.241641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.241641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.241642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.241642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.241643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.241643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.241644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.241647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.241653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.241655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.241657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.241659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.241661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.241663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.241665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.241667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.241669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.241671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.241673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.241676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.241680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.241683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.241686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.241688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.241691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.241693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.241695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.241698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.241700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.241702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.241705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.241708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.241710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.241712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.241715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.241717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.241721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.241723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.241725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.241728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.241730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.241732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.241735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.241751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.262428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.264143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.264153Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.264154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.264157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.264161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2202 [2:7556555338364550652:2700]
2025-10-02T09:34:03.264168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.264180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.264183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.264184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.264185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.264195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.264199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.264203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.264234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.264239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.264240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.264242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.264244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.264283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.264288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.264295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.264300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.264308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.264323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440115201:6650], now have 1 active actors on pipe
2025-10-02T09:34:03.264329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440114705:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.264332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.264334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.264336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.264343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.264353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.264361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.264366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.264367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.264369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.264371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.264387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.264355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2202
2025-10-02T09:34:03.264391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.264398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.264400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.264402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.264380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2202
2025-10-02T09:34:03.264426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.264433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.264435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.264437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.264442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.264446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.264459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.264579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.264584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.264591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.264665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2203 partition: 0 MaxSeqNo: 36 sessionId: src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0
2025-10-02T09:34:03.264964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17a6a11c-c4b3eb56-9a88f5a0-b3b8f299_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.267680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Write session: try to update token
2025-10-02T09:34:03.267691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:03.273541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:03.273553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.273554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:03.273555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:03.273560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.273563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.273568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364550646:2700]
2025-10-02T09:34:03.273589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:03.273594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.273596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:03.273598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:03.273602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:03.273604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:03.273720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:03.280111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId: src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:03.282577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.323453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555338440115215:6658]
2025-10-02T09:34:03.323672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2202, pipe: [1:7556555338440115215:6658]
2025-10-02T09:34:03.384240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.384791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.384810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.384823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440115215:6658], now have 1 active actors on pipe
2025-10-02T09:34:03.384954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.384996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440115215:6658]
2025-10-02T09:34:03.385023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.385036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.385096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0
2025-10-02T09:34:03.385223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2203 sessionId: src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0 is DEAD
2025-10-02T09:34:03.385356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.385366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Write session will restart in 0.006930s
2025-10-02T09:34:03.385385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Write session: Do CDS request
2025-10-02T09:34:03.385390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.393219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.393318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.393337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2204
2025-10-02T09:34:03.393467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.393492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.393501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.393504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.393818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2204 sessionId:  describe result for acl check
2025-10-02T09:34:03.393848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.393849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.393851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.393854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440115526:6638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.394207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440115526:6638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.395796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440115526:6638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.398367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.398427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440115526:6638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.398440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440115526:6638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.398441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440115526:6638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.398445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.398647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.398770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.398778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.398786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.398826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.398858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364550942:2679]
2025-10-02T09:34:03.399389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.399580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.399616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.399890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.399937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.399942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.399943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.399945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.399946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.399947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.399948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.399949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.399950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.399951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.399951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.399955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.399965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.399968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.399971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.399975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.399982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.399986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.399993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.399996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.400003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.400010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.400013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.400023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.400032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.400037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.400046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.400053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.400058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.400065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.400070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.400077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.400081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.400089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.400096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.400101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.400106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.400114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.400118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.400122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.400130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.400136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.400141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.400148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.400154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.400161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.400165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.400197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.407645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.409254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.409265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.409266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.409268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.409271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2203 [2:7556555338364550942:2679]
2025-10-02T09:34:03.409277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.409287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.409291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.409293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.409294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.409303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.409306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.409311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.409338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.409343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.409344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.409346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.409347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.409389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.409394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.409400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.409408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.409420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.409434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440115713:6638], now have 1 active actors on pipe
2025-10-02T09:34:03.409440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440115217:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.409444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.409445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.409446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.409454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.409464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.409471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.409475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.409476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.409478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.409479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.409490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.409495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.409496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.409479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2203
2025-10-02T09:34:03.409491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2203
2025-10-02T09:34:03.409509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.409514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.409540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.409549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.409552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.409558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.409565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.409574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.409592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.409720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.409725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.409732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.409801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2204 partition: 0 MaxSeqNo: 36 sessionId: src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0
2025-10-02T09:34:03.410066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a727f361-ae49315e-18a3aea1-6a68ddcc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.412725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Write session: try to update token
2025-10-02T09:34:03.412738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:03.418494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:03.418507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.418508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:03.418509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:03.418513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.418517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.418519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364550936:2679]
2025-10-02T09:34:03.418538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:03.418542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:03.418543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.418544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:03.418545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:03.418547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:03.418671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:03.425642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId: src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:03.427989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.485251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555338440115724:6658]
2025-10-02T09:34:03.485439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2203, pipe: [1:7556555338440115724:6658]
2025-10-02T09:34:03.528758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.529321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.529331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.529343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440115724:6658], now have 1 active actors on pipe
2025-10-02T09:34:03.529468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.529543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.529553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440115724:6658]
2025-10-02T09:34:03.529575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.529611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0
2025-10-02T09:34:03.529750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2204 sessionId: src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0 is DEAD
2025-10-02T09:34:03.529911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.529926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Write session will restart in 0.005373s
2025-10-02T09:34:03.529948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Write session: Do CDS request
2025-10-02T09:34:03.529954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.536176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.536254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.536275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2205
2025-10-02T09:34:03.536374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.536400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.536409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.536412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.536746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2205 sessionId:  describe result for acl check
2025-10-02T09:34:03.536777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.536781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.536782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.536786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440115895:6615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.537164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440115895:6615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.539137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440115895:6615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.540879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440115895:6615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.540888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440115895:6615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.540890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440115895:6615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.540893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.542971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.543247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.543429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.543437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.543444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.543476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.543500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364551231:2677]
2025-10-02T09:34:03.543839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.543994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.544017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.544189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.544216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.544220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.544220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.544221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.544221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.544222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.544223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.544223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.544224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.544224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.544224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.544225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.544228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.544235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.544237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.544239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.544241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.544243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.544245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.544246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.544248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.544251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.544252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.544254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.544258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.544262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.544265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.544268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.544270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.544273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.544275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.544278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.544280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.544283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.544285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.544287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.544289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.544292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.544294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.544296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.544299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.544301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.544303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.544306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.544308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.544311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.544316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.544319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.544336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.551732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.553179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.553190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.553192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.553194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.553198Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2204 [2:7556555338364551231:2677]
2025-10-02T09:34:03.553206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.553215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.553217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.553218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.553219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.553229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.553235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.553240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.553274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.553279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.553280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.553282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.553284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.553319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.553324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.553330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.553335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.553343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.553358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440116218:6615], now have 1 active actors on pipe
2025-10-02T09:34:03.553363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440115726:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.553367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.553368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.553369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.553377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.553388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.553391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.553393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.553394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.553398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.553399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.553414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.553422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.553425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.553412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2204
2025-10-02T09:34:03.553429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2204
2025-10-02T09:34:03.553447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.553452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.553470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.553477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.553479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.553480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.553485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.553494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.553501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.553633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.553638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.553646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.553714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2205 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0
2025-10-02T09:34:03.553942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72411fee-a07e9eed-9bd69ce2-df8fc75d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.556497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Write session: try to update token
2025-10-02T09:34:03.556511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:03.562443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:03.562454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.562455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:03.562457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:03.562461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.562465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.562468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364551226:2677]
2025-10-02T09:34:03.562486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:03.562489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:03.562490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.562492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:03.562492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:03.562495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:03.562634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:03.569018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId: src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:03.571237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.629628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555338440116234:6658]
2025-10-02T09:34:03.629795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2204, pipe: [1:7556555338440116234:6658]
2025-10-02T09:34:03.673730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.674133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.674142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.674154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440116234:6658], now have 1 active actors on pipe
2025-10-02T09:34:03.674303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.674304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.674345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440116234:6658]
2025-10-02T09:34:03.674358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.674415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0
2025-10-02T09:34:03.674538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2205 sessionId: src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0 is DEAD
2025-10-02T09:34:03.674692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.674705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Write session will restart in 0.008039s
2025-10-02T09:34:03.674730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Write session: Do CDS request
2025-10-02T09:34:03.674735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.684160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.684246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.684255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2206
2025-10-02T09:34:03.684365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.684384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.684393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.684396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.684623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2206 sessionId:  describe result for acl check
2025-10-02T09:34:03.684642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.684646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.684647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.684650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440116692:6579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.685130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440116692:6579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.686224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440116692:6579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.687616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.687777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440116692:6579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.687788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440116692:6579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.687790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440116692:6579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.687794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.687941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.688069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.688079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.688089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.688136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.688230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364551557:2657]
2025-10-02T09:34:03.688615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.688785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.688829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.689016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.689043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.689045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.689046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.689046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.689046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.689047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.689048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.689048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.689049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.689049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.689049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.689050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.689053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.689058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.689060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.689062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.689064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.689066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.689068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.689070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.689072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.689074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.689076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.689078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.689081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.689085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.689088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.689091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.689093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.689096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.689098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.689100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.689103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.689105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.689107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.689110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.689112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.689115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.689117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.689120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.689122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.689125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.689127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.689130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.689132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.689134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.689138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.689141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.689157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.696594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.698168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.698179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.698180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.698183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.698186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2205 [2:7556555338364551557:2657]
2025-10-02T09:34:03.698193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.698201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.698202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.698203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.698204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.698215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.698217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.698222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.698252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.698257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.698258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.698260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.698261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.698295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.698299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.698305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.698310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.698318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.698332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440116248:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.698338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440116753:6579], now have 1 active actors on pipe
2025-10-02T09:34:03.698341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.698342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.698343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.698351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.698359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.698363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.698365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.698366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.698368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.698369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.698381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.698386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.698387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.698371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2205
2025-10-02T09:34:03.698386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2205
2025-10-02T09:34:03.698403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.698407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.698424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa636991-106da05f-bd5107f8-b944c301_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.698431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.698434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.698435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.698440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.698448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.698460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.698564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.698568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.698576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.698647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2206 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa636991-106da05f-bd5107f8-b944c301_0
2025-10-02T09:34:03.698893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c31ace2-f858fb17-21c0ad68-9926394d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa636991-106da05f-bd5107f8-b944c301_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.701456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Write session: try to update token
2025-10-02T09:34:03.701473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:03.707429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:03.707440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.707442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:03.707443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:03.707448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.707450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.707452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364551544:2657]
2025-10-02T09:34:03.707469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:03.707473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.707474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:03.707476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:03.707479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:03.707481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:03.707576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:03.714092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId: src_id|aa636991-106da05f-bd5107f8-b944c301_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:03.716314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.774513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555338440116767:6658]
2025-10-02T09:34:03.774723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2205, pipe: [1:7556555338440116767:6658]
2025-10-02T09:34:03.818407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.818773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.818784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.818798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440116767:6658], now have 1 active actors on pipe
2025-10-02T09:34:03.818920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.818968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440116767:6658]
2025-10-02T09:34:03.818979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.818998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.819060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa636991-106da05f-bd5107f8-b944c301_0
2025-10-02T09:34:03.819191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2206 sessionId: src_id|aa636991-106da05f-bd5107f8-b944c301_0 is DEAD
2025-10-02T09:34:03.819357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.819373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Write session will restart in 0.009293s
2025-10-02T09:34:03.819396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Write session: Do CDS request
2025-10-02T09:34:03.819401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.830126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.830301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.830323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2207
2025-10-02T09:34:03.831059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.831088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.831097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.831101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.831404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2207 sessionId:  describe result for acl check
2025-10-02T09:34:03.831412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.831435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.831439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.831440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.831443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440117232:6570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.831799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440117232:6570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.832813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.832978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.832985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.832991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.833022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.833043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364551847:2659]
2025-10-02T09:34:03.833380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.833552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.833574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.833746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.833774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.833778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.833778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.833779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.833780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.833780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.833781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.833781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.833782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.833782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.833783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.833783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.833786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.833792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.833794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.833796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.833798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.833800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.833802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.833804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.833806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.833808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.833810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.833812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.833816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.833820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.833823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.833826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.833828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.833831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.833833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.833836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.833838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.833841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.833843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.833846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.833848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.833851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.833853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.833855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.833858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.833860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.833862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.833865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.833867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.833870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.833873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.833875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.833892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.833899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440117232:6570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.839619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440117232:6570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.839629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440117232:6570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.839631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440117232:6570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.839636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.841236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.842792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.842802Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.842803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.842805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.842808Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2206 [2:7556555338364551847:2659]
2025-10-02T09:34:03.842815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.842825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.842826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.842828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.842828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.842836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.842839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.842843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.842871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.842876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.842877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.842879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.842880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.842915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.842919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.842926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.842934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.842944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.842959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440116768:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.842964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440117271:6570], now have 1 active actors on pipe
2025-10-02T09:34:03.842967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.842968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.842969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.842976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.842987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.842991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.842993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.842995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.842997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.842998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.843012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.843016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.843007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2206
2025-10-02T09:34:03.843012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2206
2025-10-02T09:34:03.843025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.843042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.843047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.843060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.843067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.843069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.843070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.843075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.843082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.843092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.843219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.843223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.843230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.843300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2207 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0
2025-10-02T09:34:03.843518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa636991-106da05f-bd5107f8-b944c301_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.846177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Write session: try to update token
2025-10-02T09:34:03.846190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:03.851870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:03.851880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.851884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.851903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:03.851905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:03.852034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:03.852145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:03.852249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:03.852369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:03.852550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:03.852573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:03.858889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId: src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:03.860199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:03.860211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:03.860213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:03.860216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:03.860220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.860222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.860223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364551842:2659]
2025-10-02T09:34:03.860243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:03.860244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:03.860246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:03.860248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:03.860250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.860251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:03.860363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:03.861131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:03.918920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555338440117286:6658]
2025-10-02T09:34:03.919203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2206, pipe: [1:7556555338440117286:6658]
2025-10-02T09:34:03.971538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:03.972110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.972120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.972134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440117286:6658], now have 1 active actors on pipe
2025-10-02T09:34:03.972267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:03.972314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:03.972387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2207 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0
2025-10-02T09:34:03.972509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2207 sessionId: src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0 is DEAD
2025-10-02T09:34:03.972564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:03.972638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:03.972632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555338440117286:6658]
2025-10-02T09:34:03.972652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Write session will restart in 0.007552s
2025-10-02T09:34:03.972676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Write session: Do CDS request
2025-10-02T09:34:03.972682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:03.981181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.981274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:03.981289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2208
2025-10-02T09:34:03.981396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:03.981423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:03.981434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:03.981437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:03.981760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2208 sessionId:  describe result for acl check
2025-10-02T09:34:03.981791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:03.981796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:03.981797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:03.981800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555338440117661:6549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:03.982158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555338440117661:6549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:03.983939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555338440117661:6549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:03.985677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:03.985842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555338440117661:6549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:03.985851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555338440117661:6549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:03.985853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555338440117661:6549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:03.985857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:03.985885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:03.985979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:03.985985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:03.985991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:03.986014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:03.986035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555338364552152:2648]
2025-10-02T09:34:03.986371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:03.986533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:03.986555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:03.986740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:03.986770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.986774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.986774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.986775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.986775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.986776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.986776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.986777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.986777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.986778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.986778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.986779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.986781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.986787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.986789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.986791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.986793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.986795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.986797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.986799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.986801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.986803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.986805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.986807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.986810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.986814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:03.986818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.986820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:03.986822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.986825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:03.986827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.986830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:03.986832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.986835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:03.986837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.986839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:03.986842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.986844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:03.986846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.986849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:03.986851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.986855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:03.986857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.986859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.986861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.986864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.986866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.986868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.986886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:03.994285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:03.995967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:03.995977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:03.995978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:03.995980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:03.995983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2207 [2:7556555338364552152:2648]
2025-10-02T09:34:03.995990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:03.995999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:03.996004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.996006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.996007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.996017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:03.996022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:03.996027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:03.996061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.996066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.996067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.996069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:03.996070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:03.996108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:03.996113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:03.996119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:03.996124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:03.996136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:03.996149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:03.996154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:03.996155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:03.996160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:03.996167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:03.996168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440117788:6549], now have 1 active actors on pipe
2025-10-02T09:34:03.996170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555338440117290:2446], now have 1 active actors on pipe
2025-10-02T09:34:03.996174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:03.996175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:03.996175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:03.996182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:03.996183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:03.996198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:03.996199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2207
2025-10-02T09:34:03.996206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:03.996216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:03.996240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.996245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.996225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2207
2025-10-02T09:34:03.996259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:03.996266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:03.996270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:03.996274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:03.996279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:03.996285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:03.996293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.996419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:03.996424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:03.996432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:03.996507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2208 partition: 0 MaxSeqNo: 36 sessionId: src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0
2025-10-02T09:34:03.996757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfbc94cf-c0d71463-730a135a-482e4d06_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:03.999333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Write session: try to update token
2025-10-02T09:34:03.999347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.005158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:04.005171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.005175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:04.005198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:04.005202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:04.005327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:04.005445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.005556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.005671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.005832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:04.005855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:04.012070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId: src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.013470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.013482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.013483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.013484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.013488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:04.013490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:04.013494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555338364552146:2648]
2025-10-02T09:34:04.013511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.013516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.013518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.013519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.013520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.013521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.013631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.014289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.073001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735085109:6658]
2025-10-02T09:34:04.073209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2207, pipe: [1:7556555342735085109:6658]
2025-10-02T09:34:04.124777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:04.125173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.125184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.125198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735085109:6658], now have 1 active actors on pipe
2025-10-02T09:34:04.125367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:04.125404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:04.125417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:04.125421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735085109:6658]
2025-10-02T09:34:04.125440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:04.125490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2208 reason: error at write: Disconnected sessionId: src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0
2025-10-02T09:34:04.125670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2208 sessionId: src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0 is DEAD
2025-10-02T09:34:04.125818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:04.125832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Write session will restart in 0.008111s
2025-10-02T09:34:04.125852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Write session: Do CDS request
2025-10-02T09:34:04.125858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:04.135185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.135275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:04.135288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2209
2025-10-02T09:34:04.135368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.135392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:04.135401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:04.135404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:04.135715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2209 sessionId:  describe result for acl check
2025-10-02T09:34:04.135747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:04.135751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:04.135752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:04.135756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555342735085532:6533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:04.136100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555342735085532:6533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:04.137503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555342735085532:6533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:04.139116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:04.139422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:04.139423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555342735085532:6533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:04.139433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555342735085532:6533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:04.139435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555342735085532:6533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:04.139438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:04.139537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:04.139545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:04.139551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:04.139582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:04.139605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555342659519742:2643]
2025-10-02T09:34:04.139942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:04.140101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:04.140123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:04.140298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:04.140327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.140332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.140332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.140333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.140334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.140334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.140335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.140335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.140336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.140336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.140337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.140337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.140340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.140346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.140348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.140350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.140352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.140354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.140356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.140358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.140360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.140362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.140364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.140366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.140369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.140373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.140377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.140380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.140382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.140385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.140387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.140390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.140392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.140395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.140397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.140399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.140402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.140404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.140406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.140409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.140417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.140419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.140424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.140427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.140429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.140432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.140434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.140436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.140453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:04.147843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:04.149491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:04.149502Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:04.149503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:04.149505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:04.149509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2208 [2:7556555342659519742:2643]
2025-10-02T09:34:04.149515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:04.149528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:04.149532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.149534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.149535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.149543Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:04.149546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:04.149551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:04.149580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.149585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.149586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.149588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:04.149589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:04.149625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:04.149629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.149636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.149641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.149652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:04.149666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735085610:6533], now have 1 active actors on pipe
2025-10-02T09:34:04.149672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735085110:2446], now have 1 active actors on pipe
2025-10-02T09:34:04.149675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.149676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.149678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.149685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:04.149694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:04.149697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:04.149699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:04.149701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:04.149704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:04.149705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:04.149699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2208
2025-10-02T09:34:04.149712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2208
2025-10-02T09:34:04.149719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.149724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:04.149725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:04.149736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.149743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.149767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:04.149771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.149773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.149774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:04.149779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.149783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:04.149792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.149895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.149903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.149911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.149980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2209 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0
2025-10-02T09:34:04.150282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a5af94-68f5c3a8-85696e4d-b7bbf91f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:04.152843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Write session: try to update token
2025-10-02T09:34:04.152855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.158971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.158983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.158984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.158985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.158989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.158992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.158994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555342659519736:2643]
2025-10-02T09:34:04.159013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.159016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.159016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.159018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.159019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.159021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.159132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.164529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId: src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.166639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.225587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735085623:6658]
2025-10-02T09:34:04.225788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2208, pipe: [1:7556555342735085623:6658]
2025-10-02T09:34:04.270304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:04.270522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.270531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.270544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735085623:6658], now have 1 active actors on pipe
2025-10-02T09:34:04.270681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:04.270692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:04.270703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:04.270707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:04.270743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735085623:6658]
2025-10-02T09:34:04.270789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2209 reason: error at write: Disconnected sessionId: src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0
2025-10-02T09:34:04.270950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2209 sessionId: src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0 is DEAD
2025-10-02T09:34:04.271123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:04.271136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Write session will restart in 0.009619s
2025-10-02T09:34:04.271159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Write session: Do CDS request
2025-10-02T09:34:04.271165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:04.282164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.282244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:04.282257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2210
2025-10-02T09:34:04.282404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.282442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:04.282448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:04.282452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:04.282782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2210 sessionId:  describe result for acl check
2025-10-02T09:34:04.282811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:04.282813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:04.282814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:04.282819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555342735086092:6502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:04.283175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:04.283284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555342735086092:6502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:04.284668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:04.284766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:04.284774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:04.284782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:04.284835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:04.284861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555342659520034:2640]
2025-10-02T09:34:04.285075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555342735086092:6502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:04.285285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:04.285458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:04.285483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:04.285662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:04.285692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.285695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.285696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.285697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.285697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.285698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.285698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.285699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.285699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.285700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.285700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.285701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.285704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.285711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.285713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.285715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.285717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.285719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.285721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.285723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.285725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.285727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.285729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.285731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.285735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.285739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.285742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.285745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.285747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.285750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.285754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.285756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.285758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.285761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.285763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.285766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.285768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.285772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.285774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.285776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.285780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.285783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.285786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.285788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.285791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.285793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.285795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.285798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.285814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:04.289629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555342735086092:6502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:04.289638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555342735086092:6502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:04.289639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555342735086092:6502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:04.289643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:04.293200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:04.294765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:04.294775Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:04.294777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:04.294778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:04.294782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2209 [2:7556555342659520034:2640]
2025-10-02T09:34:04.294788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:04.294797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:04.294799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.294800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.294801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.294810Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:04.294812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:04.294816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:04.294845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.294850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.294851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.294853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:04.294854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:04.294889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:04.294894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.294900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.294905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.294915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:04.294929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735085626:2446], now have 1 active actors on pipe
2025-10-02T09:34:04.294934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735086132:6502], now have 1 active actors on pipe
2025-10-02T09:34:04.294938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.294939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.294940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.294947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:04.294956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:04.294959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:04.294961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:04.294963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:04.294966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:04.294967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:04.294961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2209
2025-10-02T09:34:04.294972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2209
2025-10-02T09:34:04.294981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.294986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:04.294987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:04.294995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.294999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.295028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:04.295035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.295037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.295038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:04.295042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.295047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:04.295056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.295163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.295168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.295175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.295246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2210 partition: 0 MaxSeqNo: 36 sessionId: src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0
2025-10-02T09:34:04.295468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e16bdb-dbbe19dd-4cd857da-1b643f13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:04.298001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Write session: try to update token
2025-10-02T09:34:04.298014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.303928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.303937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.303938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.303939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.303943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.303946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.303948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555342659520029:2640]
2025-10-02T09:34:04.303967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.303968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.303971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.303972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.303973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.303975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.304078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.310046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId: src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.312240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.370976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735086140:6658]
2025-10-02T09:34:04.371155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2209, pipe: [1:7556555342735086140:6658]
2025-10-02T09:34:04.414374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:04.414583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.414592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.414612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735086140:6658], now have 1 active actors on pipe
2025-10-02T09:34:04.414741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:04.414801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:04.414813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:04.414845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735086140:6658]
2025-10-02T09:34:04.414897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0
2025-10-02T09:34:04.415073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2210 sessionId: src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0 is DEAD
2025-10-02T09:34:04.415220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:04.415234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Write session will restart in 0.008013s
2025-10-02T09:34:04.415258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Write session: Do CDS request
2025-10-02T09:34:04.415264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:04.424244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.424423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:04.424436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2211
2025-10-02T09:34:04.424538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.424563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:04.424569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:04.424572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:04.424916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2211 sessionId:  describe result for acl check
2025-10-02T09:34:04.424946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:04.424951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:04.424952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:04.424956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555342735086532:6509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:04.425338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555342735086532:6509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:04.427024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555342735086532:6509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:04.429132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:04.429306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555342735086532:6509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:04.429315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555342735086532:6509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:04.429317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555342735086532:6509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:04.429322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:04.429372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:04.429642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:04.429652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:04.429660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:04.429700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:04.429725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555342659520332:2628]
2025-10-02T09:34:04.430079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:04.430249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:04.430273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:04.430454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:04.430493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.430498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.430498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.430499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.430499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.430500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.430500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.430501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.430501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.430502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.430503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.430503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.430506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.430512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.430514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.430516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.430518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.430520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.430522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.430524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.430526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.430528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.430530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.430531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.430535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.430539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.430543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.430546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.430548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.430551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.430553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.430557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.430560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.430562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.430564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.430567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.430569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.430572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.430574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.430576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.430578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.430581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.430583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.430586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.430588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.430591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.430593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.430595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.430622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:04.438076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:04.439759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:04.439769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:04.439770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:04.439772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:04.439776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2210 [2:7556555342659520332:2628]
2025-10-02T09:34:04.439782Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:04.439792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:04.439794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.439795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.439797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.439806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:04.439809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:04.439813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:04.439844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.439849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.439850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.439852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:04.439853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:04.439889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:04.439894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.439900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.439905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.439913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:04.439927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735086141:2446], now have 1 active actors on pipe
2025-10-02T09:34:04.439933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735086643:6509], now have 1 active actors on pipe
2025-10-02T09:34:04.439936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.439938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.439939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.439946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:04.439956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:04.439959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:04.439961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:04.439962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:04.439965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:04.439966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:04.439959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2210
2025-10-02T09:34:04.439980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.439986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:04.439987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:04.440007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.439985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2210
2025-10-02T09:34:04.440014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.440034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:04.440041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.440043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.440044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:04.440048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.440054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:04.440070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.440195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.440200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.440207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.440274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2211 partition: 0 MaxSeqNo: 36 sessionId: src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0
2025-10-02T09:34:04.440583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|204fd68d-e19975e5-2687f1e7-5ff28316_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:04.443270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Write session: try to update token
2025-10-02T09:34:04.443284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.449053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.449063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.449064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.449065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.449069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.449071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.449073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555342659520326:2628]
2025-10-02T09:34:04.449091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.449094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.449096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.449097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.449097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.449099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.449209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.455846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId: src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.458115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.514879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735086655:6658]
2025-10-02T09:34:04.515125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2210, pipe: [1:7556555342735086655:6658]
2025-10-02T09:34:04.561635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:04.562038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.562049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.562061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735086655:6658], now have 1 active actors on pipe
2025-10-02T09:34:04.562193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:04.562275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:04.562298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735086655:6658]
2025-10-02T09:34:04.562331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:04.562348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0
2025-10-02T09:34:04.562482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2211 sessionId: src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0 is DEAD
2025-10-02T09:34:04.562618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:04.562633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Write session will restart in 0.006624s
2025-10-02T09:34:04.562654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Write session: Do CDS request
2025-10-02T09:34:04.562660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:04.570171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.570298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:04.570312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2212
2025-10-02T09:34:04.570395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.570420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:04.570428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:04.570431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:04.570785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2212 sessionId:  describe result for acl check
2025-10-02T09:34:04.570820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:04.570827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:04.570828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:04.570832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555342735086944:6492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:04.571299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555342735086944:6492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:04.572851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555342735086944:6492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:04.574613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555342735086944:6492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:04.574626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555342735086944:6492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:04.574629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555342735086944:6492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:04.574633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:04.576490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:04.576757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:04.576884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:04.576891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:04.576897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:04.576926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:04.576948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555342659520628:2632]
2025-10-02T09:34:04.577291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:04.577447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:04.577471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:04.577648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:04.577679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.577683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.577685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.577685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.577686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.577687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.577687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.577688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.577689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.577689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.577690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.577690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.577693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.577700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.577702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.577704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.577706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.577709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.577711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.577713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.577715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.577717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.577719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.577721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.577725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.577729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.577735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.577738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.577740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.577743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.577745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.577749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.577753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.577755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.577757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.577760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.577762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.577765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.577769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.577772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.577775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.577778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.577780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.577784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.577787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.577791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.577793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.577795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.577811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:04.585188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:04.586617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:04.586627Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:04.586628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:04.586630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:04.586634Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2211 [2:7556555342659520628:2632]
2025-10-02T09:34:04.586641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:04.586651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:04.586653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.586654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.586655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.586664Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:04.586670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:04.586675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:04.586705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.586709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.586710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.586713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:04.586714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:04.586756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:04.586761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.586768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.586773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.586784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:04.586802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735087158:6492], now have 1 active actors on pipe
2025-10-02T09:34:04.586807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735086657:2446], now have 1 active actors on pipe
2025-10-02T09:34:04.586811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.586815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.586816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.586823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:04.586833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:04.586837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:04.586839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:04.586840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:04.586843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:04.586845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:04.586858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.586863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:04.586864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:04.586861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2211
2025-10-02T09:34:04.586889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2211
2025-10-02T09:34:04.586892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.586897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.586911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:04.586918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.586920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.586921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:04.586926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.586932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:04.586946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.587063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.587070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.587077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.587340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2212 partition: 0 MaxSeqNo: 36 sessionId: src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0
2025-10-02T09:34:04.587581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11927f28-6fe6bd2d-da28ff2c-b468a8ae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:04.590199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Write session: try to update token
2025-10-02T09:34:04.590215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.595921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:04.595933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.595937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.595959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:04.595960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:04.596092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:04.596209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.596322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.596436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.596605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:04.596630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:04.602438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId: src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.604120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.604132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.604133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.604133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.604137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.604139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.604142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555342659520623:2632]
2025-10-02T09:34:04.604160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.604162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.604164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.604166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.604169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.604171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.604269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.604541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.662343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735087171:6658]
2025-10-02T09:34:04.662523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2211, pipe: [1:7556555342735087171:6658]
2025-10-02T09:34:04.716378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:04.716838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.716854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.716869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735087171:6658], now have 1 active actors on pipe
2025-10-02T09:34:04.717079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735087171:6658]
2025-10-02T09:34:04.717128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:04.717130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:04.717191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2212 reason: error at write: Disconnected sessionId: src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0
2025-10-02T09:34:04.717353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2212 sessionId: src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0 is DEAD
2025-10-02T09:34:04.717358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:04.717482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:04.717495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Write session will restart in 0.006118s
2025-10-02T09:34:04.717514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Write session: Do CDS request
2025-10-02T09:34:04.717523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:04.717716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:04.724184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.724298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:04.724314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2213
2025-10-02T09:34:04.724411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.724441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:04.724451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:04.724454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:04.724813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2213 sessionId:  describe result for acl check
2025-10-02T09:34:04.724848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:04.724855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:04.724856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:04.724860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555342735087372:6464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:04.725233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555342735087372:6464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:04.727136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555342735087372:6464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:04.729630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555342735087372:6464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:04.729643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555342735087372:6464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:04.729645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555342735087372:6464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:04.729650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:04.731550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:04.731831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:04.731998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:04.732005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:04.732012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:04.732040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:04.732061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555342659520961:2603]
2025-10-02T09:34:04.732413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:04.732570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:04.732592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:04.732773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:04.732816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.732819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.732820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.732821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.732821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.732822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.732822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.732823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.732823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.732824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.732824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.732825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.732827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.732834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.732836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.732838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.732840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.732842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.732844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.732846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.732848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.732850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.732852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.732854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.732857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.732862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.732865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.732868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.732870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.732873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.732875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.732878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.732881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.732884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.732886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.732889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.732891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.732893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.732895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.732898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.732900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.732903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.732905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.732907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.732909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.732912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.732914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.732917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.732932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:04.740391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:04.742009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:04.742021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:04.742022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:04.742024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:04.742027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2212 [2:7556555342659520961:2603]
2025-10-02T09:34:04.742035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:04.742044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:04.742049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.742051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.742052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.742062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:04.742066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:04.742070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:04.742100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.742104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.742105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.742107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:04.742108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:04.742144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:04.742149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.742155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.742160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.742168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:04.742179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735087186:2446], now have 1 active actors on pipe
2025-10-02T09:34:04.742184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735087697:6464], now have 1 active actors on pipe
2025-10-02T09:34:04.742188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.742189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.742190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.742197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:04.742204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:04.742211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:04.742212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:04.742214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:04.742216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:04.742217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:04.742230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.742233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:04.742235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:04.742313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.742319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.742288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2212
2025-10-02T09:34:04.742333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:04.742340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.742342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.742290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2212
2025-10-02T09:34:04.742343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:04.742348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.742357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:04.742365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.742501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.742505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.742513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.742581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2213 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0
2025-10-02T09:34:04.742955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e9b379-3ddceee2-bff7f930-5b63dd89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:04.745599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Write session: try to update token
2025-10-02T09:34:04.745616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.751142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:04.751154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.751158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.751179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:04.751179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:04.751314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:04.751433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.751540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.751652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:04.751811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:04.751832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:04.758206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId: src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.759425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.759438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.759439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.759440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.759444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.759446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.759448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555342659520956:2603]
2025-10-02T09:34:04.759468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.759470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.759471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.759472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.759472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.759474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.759579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.760437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.817461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735087710:6658]
2025-10-02T09:34:04.817662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2212, pipe: [1:7556555342735087710:6658]
2025-10-02T09:34:04.869752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:04.870122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.870135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.870150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735087710:6658], now have 1 active actors on pipe
2025-10-02T09:34:04.870277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:04.870292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:04.870341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735087710:6658]
2025-10-02T09:34:04.870353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:04.870439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0
2025-10-02T09:34:04.870601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2213 sessionId: src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0 is DEAD
2025-10-02T09:34:04.870742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:04.870756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Write session will restart in 0.007890s
2025-10-02T09:34:04.870775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Write session: Do CDS request
2025-10-02T09:34:04.870780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:04.879166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.879303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:04.879315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2214
2025-10-02T09:34:04.879636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:04.879663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:04.879672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:04.879676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:04.879981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2214 sessionId:  describe result for acl check
2025-10-02T09:34:04.880002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:04.880003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:04.880004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:04.880009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555342735088107:6445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:04.880367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555342735088107:6445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:04.881990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555342735088107:6445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:04.884109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:04.884244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555342735088107:6445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:04.884256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555342735088107:6445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:04.884258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555342735088107:6445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:04.884263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:04.884336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:04.884434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:04.884440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:04.884446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:04.884471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:04.884491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555342659521259:2596]
2025-10-02T09:34:04.884844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:04.885009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:04.885032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:04.885204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:04.885234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.885238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.885238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.885239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.885239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.885240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.885241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.885241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.885242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.885242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.885243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.885244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.885246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.885253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.885255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.885257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.885259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.885261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.885263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.885265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.885267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.885269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.885271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.885273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.885276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.885281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:04.885284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.885287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:04.885289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.885292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:04.885294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.885297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:04.885299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.885302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:04.885303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.885306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:04.885308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.885311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:04.885313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.885320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:04.885323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.885326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:04.885330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.885332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.885335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.885337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.885342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.885345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.885363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:04.892704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:04.894158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:04.894171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:04.894172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:04.894174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:04.894177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2213 [2:7556555342659521259:2596]
2025-10-02T09:34:04.894186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:04.894196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:04.894200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.894202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.894203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.894212Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:04.894215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:04.894219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:04.894246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.894251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.894252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.894253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:04.894255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:04.894375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2213
2025-10-02T09:34:04.894398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2213
2025-10-02T09:34:04.894483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:04.894489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.894496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:04.894501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:04.894510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:04.894526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735087717:2446], now have 1 active actors on pipe
2025-10-02T09:34:04.894531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735088223:6445], now have 1 active actors on pipe
2025-10-02T09:34:04.894543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.894548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.894557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.894561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.894563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.894571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:04.894582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:04.894584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:04.894586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:04.894587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:04.894592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:04.894594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:04.894615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:04.894621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:04.894623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:04.894624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:04.894630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:04.894636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:04.894653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.894660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:04.894666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.894669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:04.894762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:04.894766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:04.894774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:04.894825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2214 partition: 0 MaxSeqNo: 36 sessionId: src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0
2025-10-02T09:34:04.895087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5cc952-2cee9ab0-4e9ce710-9dd0ba48_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:04.897774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Write session: try to update token
2025-10-02T09:34:04.897788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:04.903641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:04.903651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:04.903653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:04.903654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:04.903657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.903661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.903663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555342659521253:2596]
2025-10-02T09:34:04.903682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:04.903684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:04.903687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:04.903687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:04.903689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:04.903690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:04.903804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:04.910196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId: src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:04.912548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:04.970520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555342735088237:6658]
2025-10-02T09:34:04.970680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2213, pipe: [1:7556555342735088237:6658]
2025-10-02T09:34:05.012543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.012990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.013000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.013013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555342735088237:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.013147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.013207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:05.013269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.013274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2214 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0
2025-10-02T09:34:05.013338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555342735088237:6658]
2025-10-02T09:34:05.013411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2214 sessionId: src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0 is DEAD
2025-10-02T09:34:05.013584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:05.013600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Write session will restart in 0.007511s
2025-10-02T09:34:05.013626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Write session: Do CDS request
2025-10-02T09:34:05.013632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.022203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.022289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.022301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2215
2025-10-02T09:34:05.022425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.022446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.022452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.022455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.022749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2215 sessionId:  describe result for acl check
2025-10-02T09:34:05.022771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.022777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.022779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.022783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030055841:6443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.023146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030055841:6443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.025125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030055841:6443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.028056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.028204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030055841:6443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.028217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030055841:6443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.028220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030055841:6443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.028225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.028322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.028419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.028426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.028432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.028456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.028483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954488866:2590]
2025-10-02T09:34:05.028839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.029003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.029026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.029204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.029233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.029237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.029238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.029238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.029239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.029239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.029240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.029240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.029241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.029242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.029242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.029243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.029245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.029251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.029254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.029256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.029258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.029260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.029262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.029264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.029266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.029268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.029270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.029272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.029275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.029279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.029283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.029286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.029288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.029291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.029293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.029296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.029298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.029301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.029303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.029306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.029308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.029310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.029313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.029315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.029318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.029320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.029323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.029326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.029328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.029331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.029334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.029336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.029354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.036746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.038399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.038410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.038411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.038415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.038419Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2214 [2:7556555346954488866:2590]
2025-10-02T09:34:05.038426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.038435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.038440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.038442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.038443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.038453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.038455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.038460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.038490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.038495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.038496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.038498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.038499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.038540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.038545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.038551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.038556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.038567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.038583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030055534:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.038587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030056042:6443], now have 1 active actors on pipe
2025-10-02T09:34:05.038590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.038592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.038593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.038602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.038622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.038623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.038625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.038626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.038630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.038632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.038646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.038651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.038652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.038636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2214
2025-10-02T09:34:05.038673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.038679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.038693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.038668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2214
2025-10-02T09:34:05.038700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.038702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.038703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.038709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.038717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.038727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.038839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.038843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.038851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.038912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2215 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0
2025-10-02T09:34:05.039182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea1824-e2674177-fa3bc3cb-94647a5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.041850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Write session: try to update token
2025-10-02T09:34:05.041867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.047656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.047671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.047672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.047673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.047677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.047679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.047681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954488860:2590]
2025-10-02T09:34:05.047700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.047704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.047704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.047706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.047707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.047709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.047813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.054306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId: src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.056645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:05.113392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555347030056065:6658]
2025-10-02T09:34:05.113624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2214, pipe: [1:7556555347030056065:6658]
2025-10-02T09:34:05.161477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.161899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.161908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.161920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030056065:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.162048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.162093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555347030056065:6658]
2025-10-02T09:34:05.162124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:05.162133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.162182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2215 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0
2025-10-02T09:34:05.162328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2215 sessionId: src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0 is DEAD
2025-10-02T09:34:05.162491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:05.162506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Write session will restart in 0.008912s
2025-10-02T09:34:05.162528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Write session: Do CDS request
2025-10-02T09:34:05.162534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.172168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.172267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.172283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2216
2025-10-02T09:34:05.172428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.172455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.172463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.172467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.172854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2216 sessionId:  describe result for acl check
2025-10-02T09:34:05.172894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.172901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.172902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.172907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030056509:6429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.173352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030056509:6429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.174909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030056509:6429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.176282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.176580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.176680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.176687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.176694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.176721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.176744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954489167:2573]
2025-10-02T09:34:05.176733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030056509:6429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.176745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030056509:6429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.176748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030056509:6429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.176753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.177105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.177266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.177290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.177488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.177525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.177529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.177529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.177530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.177530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.177531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.177531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.177532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.177532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.177533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.177533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.177534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.177537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.177543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.177545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.177547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.177549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.177551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.177553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.177555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.177557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.177559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.177561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.177563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.177567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.177571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.177575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.177577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.177579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.177582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.177584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.177587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.177590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.177593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.177595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.177597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.177599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.177602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.177604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.177607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.177610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.177613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.177615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.177617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.177620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.177622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.177626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.177629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.177656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.185140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.186818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.186829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.186831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.186833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.186836Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2215 [2:7556555346954489167:2573]
2025-10-02T09:34:05.186842Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.186852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.186853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.186855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.186856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.186867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.186871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.186877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.186909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.186915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.186916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.186918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.186919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.186955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.186960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.186966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.186971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.186979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.186994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030056574:6429], now have 1 active actors on pipe
2025-10-02T09:34:05.186999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030056066:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.187002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.187004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.187005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.187012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.187022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.187024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.187027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.187028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.187032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.187034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.187046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.187051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.187044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2215
2025-10-02T09:34:05.187056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.187053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2215
2025-10-02T09:34:05.187069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.187074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.187092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2064f038-ba174b8-8d66043a-e70e7962_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.187101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.187104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.187105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.187111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.187117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.187130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.187236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.187241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.187250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.187306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2216 partition: 0 MaxSeqNo: 36 sessionId: src_id|2064f038-ba174b8-8d66043a-e70e7962_0
2025-10-02T09:34:05.187558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c21a45-6d531f25-a8b6431b-4b09fba8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2064f038-ba174b8-8d66043a-e70e7962_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.190149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Write session: try to update token
2025-10-02T09:34:05.190165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.196159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.196171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.196172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.196173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.196176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.196180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.196182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954489162:2573]
2025-10-02T09:34:05.196200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.196203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.196206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.196206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.196207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.196207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.196321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.202803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId: src_id|2064f038-ba174b8-8d66043a-e70e7962_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.205065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:05.262355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555347030056588:6658]
2025-10-02T09:34:05.262515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2215, pipe: [1:7556555347030056588:6658]
2025-10-02T09:34:05.307974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.308441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.308450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.308466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030056588:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.308587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.308635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555347030056588:6658]
2025-10-02T09:34:05.308660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.308693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:05.308815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2216 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2064f038-ba174b8-8d66043a-e70e7962_0
2025-10-02T09:34:05.308980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2216 sessionId: src_id|2064f038-ba174b8-8d66043a-e70e7962_0 is DEAD
2025-10-02T09:34:05.309122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:05.309135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Write session will restart in 0.007126s
2025-10-02T09:34:05.309159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Write session: Do CDS request
2025-10-02T09:34:05.309165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.317190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.317252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.317269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2217
2025-10-02T09:34:05.317424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.317452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.317461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.317464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.317875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2217 sessionId:  describe result for acl check
2025-10-02T09:34:05.317916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.317923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.317924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.317929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030056909:6410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.318382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030056909:6410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.320500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030056909:6410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.323554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.323612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030056909:6410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.323625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030056909:6410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.323628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030056909:6410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.323634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.323818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.323922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.323928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.323935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.323960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.323983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954489471:2571]
2025-10-02T09:34:05.324349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.324529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.324557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.324747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.324779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.324784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.324785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.324785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.324786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.324787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.324787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.324788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.324788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.324789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.324789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.324790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.324793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.324812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.324814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.324816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.324818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.324820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.324822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.324824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.324826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.324828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.324830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.324832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.324835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.324841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.324846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.324850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.324854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.324859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.324862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.324867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.324869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.324872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.324874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.324876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.324878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.324881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.324887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.324890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.324892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.324895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.324898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.324904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.324906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.324908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.324910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.324913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.324934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.332412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.334125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.334137Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.334138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.334140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.334144Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2216 [2:7556555346954489471:2571]
2025-10-02T09:34:05.334151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.334160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.334161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.334163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.334164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.334173Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.334179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.334183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.334218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.334223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.334225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.334227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.334228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.334265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.334270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.334276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.334281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.334291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.334302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030056589:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.334308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030057098:6410], now have 1 active actors on pipe
2025-10-02T09:34:05.334312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.334314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.334316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.334325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.334337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.334339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.334344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.334345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.334348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.334349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.334363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.334368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.334369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.334371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2216
2025-10-02T09:34:05.334401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.334406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.334406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2216
2025-10-02T09:34:05.334423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|751a2c17-942e209f-852c1985-1ae908aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.334429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.334432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.334433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.334438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.334446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.334456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.334595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.334602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.334620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.334692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2217 partition: 0 MaxSeqNo: 36 sessionId: src_id|751a2c17-942e209f-852c1985-1ae908aa_0
2025-10-02T09:34:05.334966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2064f038-ba174b8-8d66043a-e70e7962_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|751a2c17-942e209f-852c1985-1ae908aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.337598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Write session: try to update token
2025-10-02T09:34:05.337613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.343665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.343676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.343680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.343681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.343684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.343686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.343688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954489465:2571]
2025-10-02T09:34:05.343707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.343711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.343712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.343713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.343714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.343715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.343829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.350894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId: src_id|751a2c17-942e209f-852c1985-1ae908aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.353191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:05.354006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:34:05.354020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-02T09:34:05.408846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555347030057112:6658]
2025-10-02T09:34:05.409067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2216, pipe: [1:7556555347030057112:6658]
2025-10-02T09:34:05.454287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.454689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.454704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.454734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030057112:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.454888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.454925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:05.454938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555347030057112:6658]
2025-10-02T09:34:05.454950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:05.454968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.454984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-02T09:34:05.455035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2217 reason: error at write: Disconnected sessionId: src_id|751a2c17-942e209f-852c1985-1ae908aa_0
2025-10-02T09:34:05.455184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2217 sessionId: src_id|751a2c17-942e209f-852c1985-1ae908aa_0 is DEAD
2025-10-02T09:34:05.455317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:05.455327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Write session will restart in 0.009944s
2025-10-02T09:34:05.455346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Write session: Do CDS request
2025-10-02T09:34:05.455352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.466176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.466292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.466310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2218
2025-10-02T09:34:05.466402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.466426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.466434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.466438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.466887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2218 sessionId:  describe result for acl check
2025-10-02T09:34:05.466915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.466920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.466925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.466929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030057586:6408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.467385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030057586:6408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.469281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030057586:6408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.469432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.469690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.469785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.469791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.469798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.469823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.469844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954489772:2563]
2025-10-02T09:34:05.470186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.470344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.470367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.470542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.470572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.470576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.470576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.470577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.470578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.470578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.470579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.470579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.470580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.470580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.470581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.470581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.470584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.470591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.470593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.470595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.470597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.470599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.470601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.470612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.470615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.470617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.470619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.470622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.470626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.470629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.470632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.470635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.470637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.470639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.470642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.470645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.470647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.470649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.470652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.470654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.470657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.470659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.470661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.470665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.470671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.470673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.470676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.470678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.470680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.470685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.470688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.470705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.471175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030057586:6408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.471185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030057586:6408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.471187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030057586:6408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.471191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.478091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.479639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.479650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.479652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.479654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.479658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2217 [2:7556555346954489772:2563]
2025-10-02T09:34:05.479667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.479680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.479684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.479685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.479687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.479696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.479702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.479706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.479738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.479743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.479744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.479746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.479747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.479780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.479785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.479791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.479800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.479810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.479823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030057113:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.479829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030057627:6408], now have 1 active actors on pipe
2025-10-02T09:34:05.479832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.479833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.479834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.479841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.479853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.479857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.479859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.479861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.479863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.479865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.479878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.479882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.479871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2217
2025-10-02T09:34:05.479881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2217
2025-10-02T09:34:05.479893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.479918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.479923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.479960Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:34:05.479980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.479987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.479989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.479990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.479994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.480000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.480011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.480122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.480126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.480133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.480126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 17 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:34:05.480160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:34:05.480191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2218 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0
2025-10-02T09:34:05.480403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751a2c17-942e209f-852c1985-1ae908aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.483067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Write session: try to update token
2025-10-02T09:34:05.483081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.488947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.488963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.488965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.488966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.488972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.488976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.488978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954489767:2563]
2025-10-02T09:34:05.489001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.489002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.489003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.489004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.489005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.489007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.489109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.496571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId: src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.498924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:05.555255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555347030057638:6658]
2025-10-02T09:34:05.555480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2217, pipe: [1:7556555347030057638:6658]
2025-10-02T09:34:05.598769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.599255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.599265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.599278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030057638:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.599426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.599501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.599503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555347030057638:6658]
2025-10-02T09:34:05.599532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:05.599618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2218 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0
2025-10-02T09:34:05.599777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2218 sessionId: src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0 is DEAD
2025-10-02T09:34:05.599950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:05.599962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Write session will restart in 0.009707s
2025-10-02T09:34:05.599992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Write session: Do CDS request
2025-10-02T09:34:05.600000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.611206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.611238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.611255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2219
2025-10-02T09:34:05.611381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.611406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.611414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.611418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.611769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2219 sessionId:  describe result for acl check
2025-10-02T09:34:05.611795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.611801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.611807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.611811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030058117:6392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.612252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030058117:6392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.613734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030058117:6392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.613939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.614195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.614297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.614304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.614310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.614337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.614361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954490075:2552]
2025-10-02T09:34:05.614718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.614885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.614908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.615088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.615118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.615123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.615123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.615124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.615124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.615125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.615125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.615126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.615126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.615127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.615127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.615128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.615130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.615137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.615139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.615141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.615143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.615145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.615147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.615149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.615151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.615153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.615155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.615157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.615160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.615165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.615168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.615171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.615173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.615177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.615179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.615182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.615186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.615189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.615191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.615193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.615195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.615198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.615201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.615206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.615208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.615210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.615213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.615215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.615217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.615220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.615222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.615228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.615245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.615498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030058117:6392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.615507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030058117:6392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.615510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030058117:6392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.615514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.622884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.624548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.624559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.624560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.624562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.624566Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2218 [2:7556555346954490075:2552]
2025-10-02T09:34:05.624573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.624582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.624587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.624589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.624590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.624601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.624607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.624611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.624644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.624648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.624650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.624651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.624653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.624686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.624690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.624697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.624705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.624717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.624731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030057642:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.624736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058157:6392], now have 1 active actors on pipe
2025-10-02T09:34:05.624740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.624742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.624743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.624751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.624761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.624768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.624772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.624773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.624776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.624777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.624786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.624791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.624797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.624775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2218
2025-10-02T09:34:05.624787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2218
2025-10-02T09:34:05.624827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.624832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.624850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.624857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.624859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.624860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.624866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.624872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.624880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.625000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.625005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.625012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.625080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2219 partition: 0 MaxSeqNo: 36 sessionId: src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0
2025-10-02T09:34:05.625304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7c71a01-434adc7b-820c7e77-be4bac6f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.628067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Write session: try to update token
2025-10-02T09:34:05.628083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.634168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.634181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.634183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.634185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.634190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.634194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.634197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954490070:2552]
2025-10-02T09:34:05.634224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.634225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.634229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.634232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.634232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.634234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.634356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.640072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId: src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.642397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:05.699625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555347030058165:6658]
2025-10-02T09:34:05.699798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2218, pipe: [1:7556555347030058165:6658]
2025-10-02T09:34:05.745897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.746231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.746240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.746252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058165:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.746407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.746479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.746551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555347030058165:6658]
2025-10-02T09:34:05.746575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:05.746671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2219 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0
2025-10-02T09:34:05.746820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2219 sessionId: src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0 is DEAD
2025-10-02T09:34:05.746966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:05.746978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Write session will restart in 0.009586s
2025-10-02T09:34:05.746993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Write session: Do CDS request
2025-10-02T09:34:05.746997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.757299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.757431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.757447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2220
2025-10-02T09:34:05.757585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.757608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.757615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.757618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.757953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2220 sessionId:  describe result for acl check
2025-10-02T09:34:05.757980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.757985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.757987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.757991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030058608:6348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.758392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030058608:6348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.760149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030058608:6348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.760515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.761908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.762008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.762016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.762024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.762135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030058608:6348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.762146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030058608:6348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.762148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030058608:6348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.762153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.762331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.762356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954490420:2542]
2025-10-02T09:34:05.762703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.762884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.762908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.763085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.763116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.763120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.763120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.763121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.763121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.763122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.763122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.763123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.763123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.763124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.763124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.763125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.763128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.763134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.763136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.763138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.763140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.763142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.763144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.763146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.763148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.763150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.763152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.763154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.763157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.763161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.763164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.763167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.763169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.763171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.763173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.763176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.763178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.763181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.763183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.763185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.763188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.763191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.763193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.763195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.763197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.763200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.763202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.763204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.763206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.763209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.763211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.763213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.763229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.770622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.772220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.772231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.772232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.772234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.772239Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2219 [2:7556555346954490420:2542]
2025-10-02T09:34:05.772246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.772255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.772257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.772258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.772259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.772268Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.772270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.772274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.772303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.772309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.772310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.772312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.772313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.772349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.772354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.772360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.772365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.772377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.772389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058701:6348], now have 1 active actors on pipe
2025-10-02T09:34:05.772395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058179:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.772398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.772400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.772401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.772409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.772417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.772424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.772426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.772427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.772429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.772430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.772442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.772450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.772432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2219
2025-10-02T09:34:05.772454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.772456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2219
2025-10-02T09:34:05.772473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.772478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.772493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f88a7002-bd83403a-615620b6-2b7296a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.772500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.772503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.772504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.772508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.772513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.772523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.772655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.772660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.772668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.772732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2220 partition: 0 MaxSeqNo: 36 sessionId: src_id|f88a7002-bd83403a-615620b6-2b7296a7_0
2025-10-02T09:34:05.773042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4daed0ca-5bedd98a-5d8beb46-16efc0ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f88a7002-bd83403a-615620b6-2b7296a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.775812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Write session: try to update token
2025-10-02T09:34:05.775825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.785540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:05.785551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.785555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.785577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:05.785579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:05.785709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:05.785829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:05.785946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:05.786058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:05.786214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:05.786238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:05.788353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId: src_id|f88a7002-bd83403a-615620b6-2b7296a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.789671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.789681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.789684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.789685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.789688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.789690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.789691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954490410:2542]
2025-10-02T09:34:05.789708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.789711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.789711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.789712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.789714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.789716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.789819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.790700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:05.846568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555347030058715:6658]
2025-10-02T09:34:05.846843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2219, pipe: [1:7556555347030058715:6658]
2025-10-02T09:34:05.899820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:05.900307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.900317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.900330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058715:6658], now have 1 active actors on pipe
2025-10-02T09:34:05.900533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:05.900510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555347030058715:6658]
2025-10-02T09:34:05.900535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:05.900541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:05.900549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:05.900613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2220 reason: error at write: Disconnected sessionId: src_id|f88a7002-bd83403a-615620b6-2b7296a7_0
2025-10-02T09:34:05.900764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2220 sessionId: src_id|f88a7002-bd83403a-615620b6-2b7296a7_0 is DEAD
2025-10-02T09:34:05.900954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:05.900965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Write session will restart in 0.007358s
2025-10-02T09:34:05.900983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Write session: Do CDS request
2025-10-02T09:34:05.900987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:05.905089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:05.905749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:05.905849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:05.905856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:05.905862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:05.905888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:05.905914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555346954490482:2537]
2025-10-02T09:34:05.906252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:05.906416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:05.906439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:05.906623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:05.906657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.906661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.906662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.906662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.906663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.906664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.906664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.906665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.906667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.906667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.906668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.906669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.906671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.906678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.906681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.906683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.906685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.906687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.906689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.906690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.906692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.906697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.906698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.906700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.906704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.906708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:05.906711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.906714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:05.906716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.906719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:05.906721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.906724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:05.906728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.906731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:05.906735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.906738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:05.906740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.906743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:05.906745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.906749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:05.906752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.906755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:05.906761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.906764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.906766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.906772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.906774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.906776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.906794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:05.909143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.909253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:05.909272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2221
2025-10-02T09:34:05.909403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:05.909426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:05.909434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:05.909438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:05.909806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2221 sessionId:  describe result for acl check
2025-10-02T09:34:05.909838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:05.909842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:05.909843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:05.909846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555347030058745:6334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:05.910214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555347030058745:6334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:05.911618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555347030058745:6334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:05.913633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555347030058745:6334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:05.913643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555347030058745:6334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:05.913645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555347030058745:6334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:05.913649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:05.914244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:05.915782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:05.915793Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:05.915794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:05.915798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:05.915801Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2220 [2:7556555346954490482:2537]
2025-10-02T09:34:05.915808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:05.915818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:05.915823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.915824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.915827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.915836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:05.915839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:05.915843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:05.915876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.915880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.915881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.915884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:05.915885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:05.915921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:05.915926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.915933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:05.915938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:05.915947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:05.915961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058779:6334], now have 1 active actors on pipe
2025-10-02T09:34:05.915966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555347030058721:2446], now have 1 active actors on pipe
2025-10-02T09:34:05.915970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.915971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.915972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.915980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:05.915990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:05.915993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:05.915995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:05.915996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:05.916000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:05.916003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:05.915997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2220
2025-10-02T09:34:05.916018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.916015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2220
2025-10-02T09:34:05.916023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:05.916024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:05.916036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.916041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.916066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0d024e5-380c92be-81100ed-a95d38b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:05.916073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:05.916075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:05.916076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:05.916081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:05.916087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:05.916098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.916211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:05.916217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:05.916228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:05.916315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2221 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0d024e5-380c92be-81100ed-a95d38b4_0
2025-10-02T09:34:05.916554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88a7002-bd83403a-615620b6-2b7296a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0d024e5-380c92be-81100ed-a95d38b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:05.919260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Write session: try to update token
2025-10-02T09:34:05.919277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:05.925190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:05.925203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:05.925205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:05.925206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:05.925210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.925212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.925214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555346954490477:2537]
2025-10-02T09:34:05.925236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:05.925237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:05.925240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:05.925242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:05.925244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:05.925245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:05.925354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:05.932396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId: src_id|c0d024e5-380c92be-81100ed-a95d38b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:05.934727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.000679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026086:6658]
2025-10-02T09:34:06.000926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2220, pipe: [1:7556555351325026086:6658]
2025-10-02T09:34:06.037781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.038074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.038087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.038102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026086:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.038285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.038451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026086:6658]
2025-10-02T09:34:06.038498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.038556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:06.038625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2221 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0d024e5-380c92be-81100ed-a95d38b4_0
2025-10-02T09:34:06.038762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2221 sessionId: src_id|c0d024e5-380c92be-81100ed-a95d38b4_0 is DEAD
2025-10-02T09:34:06.039200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:06.039211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Write session will restart in 0.005617s
2025-10-02T09:34:06.039232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Write session: Do CDS request
2025-10-02T09:34:06.039238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.042645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.043447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.043548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.043555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.043561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.043589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.043622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249457849:2532]
2025-10-02T09:34:06.043968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.044146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.044169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.044349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.044379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.044383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.044384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.044385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.044385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.044386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.044386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.044387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.044388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.044388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.044389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.044389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.044392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.044398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.044401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.044405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.044407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.044409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.044411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.044413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.044415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.044417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.044419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.044421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.044425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.044430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.044433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.044437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.044439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.044441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.044444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.044448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.044452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.044455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.044457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.044460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.044462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.044465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.044467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.044471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.044473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.044476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.044478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.044481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.044483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.044485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.044487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.044490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.044508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.046153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.046255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.046272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2222
2025-10-02T09:34:06.046383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.046405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.046413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.046416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.046717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2222 sessionId:  describe result for acl check
2025-10-02T09:34:06.046746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.046747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.046748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.046750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026124:6322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.047077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026124:6322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.048679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026124:6322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.051428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026124:6322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.051438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026124:6322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.051440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026124:6322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.051444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.052058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.053626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.053638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.053640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.053643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.053647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2221 [2:7556555351249457849:2532]
2025-10-02T09:34:06.053654Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.053665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.053666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.053668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.053669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.053679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.053687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.053691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.053724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.053729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.053730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.053733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.053735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.053774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.053779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.053786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.053791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.053803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.053817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026088:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.053822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026158:6322], now have 1 active actors on pipe
2025-10-02T09:34:06.053826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.053827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.053828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.053833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.053839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.053842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.053843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.053845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.053852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.053857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.053874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.053860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2221
2025-10-02T09:34:06.053870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2221
2025-10-02T09:34:06.053878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.053882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.053900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.053905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.053922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.053931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.053936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.053938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.053944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.053953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.053963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.054080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.054087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.054097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.054174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2222 partition: 0 MaxSeqNo: 36 sessionId: src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0
2025-10-02T09:34:06.054460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d024e5-380c92be-81100ed-a95d38b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.057114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Write session: try to update token
2025-10-02T09:34:06.057130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.063136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.063150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.063152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.063153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.063157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.063159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.063161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249457844:2532]
2025-10-02T09:34:06.063179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.063185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.063186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.063189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.063191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.063194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.063298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.069362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId: src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.071537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.138432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026165:6658]
2025-10-02T09:34:06.138683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2221, pipe: [1:7556555351325026165:6658]
2025-10-02T09:34:06.174541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.174813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.174827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.174841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026165:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.175037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:06.175040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026165:6658]
2025-10-02T09:34:06.175056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:06.175073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.175104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2222 reason: error at write: Disconnected sessionId: src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0
2025-10-02T09:34:06.175234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2222 sessionId: src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0 is DEAD
2025-10-02T09:34:06.175391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:06.175403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Write session will restart in 0.007204s
2025-10-02T09:34:06.175426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Write session: Do CDS request
2025-10-02T09:34:06.175432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.175684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.179135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.179805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.179905Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.179912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.179917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.179945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.179970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249457909:2528]
2025-10-02T09:34:06.180347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.180528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.180553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.180728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.180760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.180764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.180765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.180765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.180767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.180767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.180768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.180768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.180769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.180769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.180770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.180770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.180773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.180780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.180782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.180784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.180786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.180788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.180790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.180792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.180794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.180796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.180798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.180813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.180818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.180822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.180825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.180829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.180831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.180834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.180836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.180838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.180840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.180843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.180849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.180851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.180854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.180856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.180862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.180865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.180868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.180873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.180875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.180878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.180880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.180882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.180888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.180890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.180907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.183142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.183247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.183278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2223
2025-10-02T09:34:06.183401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.183427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.183431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.183434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.183803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2223 sessionId:  describe result for acl check
2025-10-02T09:34:06.183830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.183835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.183836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.183841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026192:6310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.184273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026192:6310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.186041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026192:6310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.188040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026192:6310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.188052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026192:6310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.188054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026192:6310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.188058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.188388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.189904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.189916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.189917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.189920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.189923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2222 [2:7556555351249457909:2528]
2025-10-02T09:34:06.189931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.189943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.189949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.189951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.189952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.189961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.189964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.189970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.190001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.190006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.190008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.190010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.190012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.190050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.190055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.190062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.190067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.190079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.190093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026227:6310], now have 1 active actors on pipe
2025-10-02T09:34:06.190098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026167:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.190101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.190102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.190103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.190110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.190122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.190123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.190125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.190126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.190131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.190134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.190148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.190153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.190155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.190125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2222
2025-10-02T09:34:06.190163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.190139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2222
2025-10-02T09:34:06.190168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.190198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f073aaf7-5df896c-f693e284-73db30a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.190205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.190207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.190212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.190216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.190222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.190269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.190391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.190396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.190404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.190471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2223 partition: 0 MaxSeqNo: 36 sessionId: src_id|f073aaf7-5df896c-f693e284-73db30a2_0
2025-10-02T09:34:06.190719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a40177-e6ea04ab-db928e7c-1c76d142_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f073aaf7-5df896c-f693e284-73db30a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.193381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Write session: try to update token
2025-10-02T09:34:06.193396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.199262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.199274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.199275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.199276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.199279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.199282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.199284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249457904:2528]
2025-10-02T09:34:06.199303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.199308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.199309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.199310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.199310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.199313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.199419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.206167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId: src_id|f073aaf7-5df896c-f693e284-73db30a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.208352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.275111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026236:6658]
2025-10-02T09:34:06.275319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2222, pipe: [1:7556555351325026236:6658]
2025-10-02T09:34:06.311108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.311350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.311359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.311372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026236:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.311501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.311568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:06.311579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:06.311598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026236:6658]
2025-10-02T09:34:06.311615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.311648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2223 reason: error at write: Disconnected sessionId: src_id|f073aaf7-5df896c-f693e284-73db30a2_0
2025-10-02T09:34:06.311786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2223 sessionId: src_id|f073aaf7-5df896c-f693e284-73db30a2_0 is DEAD
2025-10-02T09:34:06.311901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:06.311910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Write session will restart in 0.005661s
2025-10-02T09:34:06.311929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Write session: Do CDS request
2025-10-02T09:34:06.311934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.316037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.316707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.316822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.316829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.316834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.316869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.316909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249457968:2519]
2025-10-02T09:34:06.317255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.317436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.317461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.317639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.317669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.317673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.317673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.317674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.317675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.317675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.317676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.317676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.317677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.317677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.317678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.317679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.317681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.317688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.317691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.317693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.317695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.317697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.317699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.317701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.317703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.317705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.317707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.317709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.317713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.317717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.317720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.317723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.317726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.317728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.317730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.317734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.317736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.317740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.317742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.317748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.317750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.317753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.317755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.317757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.317764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.317766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.317771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.317774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.317775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.317778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.317783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.317785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.317803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.318195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.318270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.318280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2224
2025-10-02T09:34:06.318436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.318458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.318465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.318468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.318857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2224 sessionId:  describe result for acl check
2025-10-02T09:34:06.318881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.318887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.318888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.318893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026263:6281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.319370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026263:6281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.321209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026263:6281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.324651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026263:6281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.324661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026263:6281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.324663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026263:6281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.324668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.325212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.326795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.326807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.326808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.326812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.326816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2223 [2:7556555351249457968:2519]
2025-10-02T09:34:06.326823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.326838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.326842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.326844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.326845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.326854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.326860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.326864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.326895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.326899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.326900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.326903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.326904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.326941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.326946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.326952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.326957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.326968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.326982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026237:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.326988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026298:6281], now have 1 active actors on pipe
2025-10-02T09:34:06.326992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.326993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.326994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.327001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.327013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.327014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.327016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.327018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.327024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.327011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2223
2025-10-02T09:34:06.327028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.327053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.327058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.327048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2223
2025-10-02T09:34:06.327065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.327069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.327071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.327087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.327095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.327102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.327104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.327110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.327121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.327141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.327271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.327276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.327284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.327356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2224 partition: 0 MaxSeqNo: 36 sessionId: src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0
2025-10-02T09:34:06.327565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073aaf7-5df896c-f693e284-73db30a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.330235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Write session: try to update token
2025-10-02T09:34:06.330250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.336132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.336145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.336148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.336149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.336152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.336154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.336156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249457963:2519]
2025-10-02T09:34:06.336175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.336178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.336181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.336182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.336182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.336185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.336294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.342625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId: src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.344839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.411831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026306:6658]
2025-10-02T09:34:06.412050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2223, pipe: [1:7556555351325026306:6658]
2025-10-02T09:34:06.446997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.447228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.447238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.447251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026306:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.447397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.447457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026306:6658]
2025-10-02T09:34:06.447471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:06.447485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.447559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0
2025-10-02T09:34:06.447729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2224 sessionId: src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0 is DEAD
2025-10-02T09:34:06.447883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:06.447896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Write session will restart in 0.009697s
2025-10-02T09:34:06.447917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Write session: Do CDS request
2025-10-02T09:34:06.447922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.451534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.452200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.452302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.452309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.452314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.452339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.452364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249458030:2520]
2025-10-02T09:34:06.452704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.452891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.452913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.453089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.453121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.453124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.453125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.453126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.453126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.453127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.453127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.453128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.453129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.453129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.453129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.453130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.453133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.453143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.453146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.453150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.453153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.453156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.453159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.453162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.453164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.453168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.453170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.453174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.453179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.453186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.453191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.453195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.453198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.453202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.453206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.453210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.453214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.453222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.453226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.453231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.453234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.453238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.453241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.453244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.453248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.453256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.453259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.453266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.453270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.453277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.453284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.453288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.453318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.458228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.458343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.458361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2225
2025-10-02T09:34:06.458480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.458508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.458514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.458523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.458894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2225 sessionId:  describe result for acl check
2025-10-02T09:34:06.458919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.458921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.458922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.458926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026334:6272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.459382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026334:6272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.460826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.461004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026334:6272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.462407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.462421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.462423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.462427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.462433Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2224 [2:7556555351249458030:2520]
2025-10-02T09:34:06.462442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.462454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.462455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.462457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.462458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.462467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.462474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.462477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.462510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.462516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.462517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.462519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.462520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.462560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.462564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.462571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.462576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.462588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.462611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026307:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.462620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.462622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.462624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.462634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.462649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.462651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.462655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.462656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.462665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.462629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2224
2025-10-02T09:34:06.462669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.462692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.462700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.462713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.462979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026334:6272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.462990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026334:6272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.462993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026334:6272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.462999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.463145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026371:6272], now have 1 active actors on pipe
2025-10-02T09:34:06.463172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2224
2025-10-02T09:34:06.463206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.463211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.463225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.463233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.463235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.463236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.463241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.463250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.463258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.463378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.463383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.463391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.463440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2225 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0
2025-10-02T09:34:06.463651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f890b462-dde151a6-158c211d-f5eb8a7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.466425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Write session: try to update token
2025-10-02T09:34:06.466436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.472232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:06.472245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.472252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.472279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:06.472285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:06.472462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:06.472690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:06.472926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:06.473149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:06.473455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:06.473510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:06.478780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId: src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.480141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.480155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.480157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.480161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.480165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.480167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.480169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249458025:2520]
2025-10-02T09:34:06.480189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.480192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.480193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.480198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.480201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.480204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.480310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.481293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.547519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026377:6658]
2025-10-02T09:34:06.547758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2224, pipe: [1:7556555351325026377:6658]
2025-10-02T09:34:06.592882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.593109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.593118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.593132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026377:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.593298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.593342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.593349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026377:6658]
2025-10-02T09:34:06.593378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:06.593462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2225 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0
2025-10-02T09:34:06.593609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2225 sessionId: src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0 is DEAD
2025-10-02T09:34:06.593740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:06.593751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Write session will restart in 0.006471s
2025-10-02T09:34:06.593776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Write session: Do CDS request
2025-10-02T09:34:06.593783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.597642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.598332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.598428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.598435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.598441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.598469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.598494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249458093:2514]
2025-10-02T09:34:06.598843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.599007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.599029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.599206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.599238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.599242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.599242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.599243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.599243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.599244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.599245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.599245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.599246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.599246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.599247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.599247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.599252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.599259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.599261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.599264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.599266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.599268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.599270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.599271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.599274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.599277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.599279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.599281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.599286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.599290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.599293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.599296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.599298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.599301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.599303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.599306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.599308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.599311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.599314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.599317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.599320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.599323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.599328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.599330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.599332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.599336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.599339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.599343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.599345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.599348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.599350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.599356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.599374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.601114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.601218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.601233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2226
2025-10-02T09:34:06.601341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.601364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.601369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.601372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.601700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2226 sessionId:  describe result for acl check
2025-10-02T09:34:06.601726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.601730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.601733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.601737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026412:6245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.602167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026412:6245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.603784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026412:6245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.606195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026412:6245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.606204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026412:6245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.606207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026412:6245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.606212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.606821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.608355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.608367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.608369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.608371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.608375Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2225 [2:7556555351249458093:2514]
2025-10-02T09:34:06.608383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.608398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.608403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.608405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.608406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.608415Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.608418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.608424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.608459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.608464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.608465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.608467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.608470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.608508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.608513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.608520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.608525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.608533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.608548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026450:6245], now have 1 active actors on pipe
2025-10-02T09:34:06.608553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026384:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.608556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.608558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.608559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.608567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.608577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.608580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.608581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.608582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.608588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.608590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.608605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.608610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.608612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.608584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2225
2025-10-02T09:34:06.608621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.608594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2225
2025-10-02T09:34:06.608625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.608695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.608702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.608704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.608705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.608710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.608715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.608728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.608850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.608857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.608867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.608944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2226 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0
2025-10-02T09:34:06.609131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2f78794-82b85a51-bcbb0f49-7ff19876_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.611860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Write session: try to update token
2025-10-02T09:34:06.611872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.617817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.617830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.617831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.617832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.617837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.617839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.617841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249458088:2514]
2025-10-02T09:34:06.617860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.617863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.617863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.617864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.617866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.617868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.617974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.623676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId: src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.626051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.693420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026458:6658]
2025-10-02T09:34:06.693659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2225, pipe: [1:7556555351325026458:6658]
2025-10-02T09:34:06.727674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.727890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.727899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.727912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026458:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.728045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.728105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:06.728107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.728153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026458:6658]
2025-10-02T09:34:06.728208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0
2025-10-02T09:34:06.728380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2226 sessionId: src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0 is DEAD
2025-10-02T09:34:06.728510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:06.728521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Write session will restart in 0.007379s
2025-10-02T09:34:06.728544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Write session: Do CDS request
2025-10-02T09:34:06.728550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.732184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.733033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.733168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.733175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.733183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.733222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.733254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249458169:2502]
2025-10-02T09:34:06.733784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.733980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.734014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.734284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.734327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.734334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.734335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.734335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.734336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.734336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.734337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.734338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.734338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.734339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.734339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.734340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.734343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.734349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.734351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.734353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.734355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.734357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.734359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.734361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.734363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.734366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.734368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.734370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.734377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.734381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.734384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.734387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.734389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.734392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.734394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.734397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.734399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.734402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.734404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.734406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.734408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.734411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.734414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.734416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.734418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.734421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.734423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.734426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.734428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.734430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.734434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.734437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.734453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.737132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.737247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.737260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2227
2025-10-02T09:34:06.737379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.737403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.737408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.737411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.737750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2227 sessionId:  describe result for acl check
2025-10-02T09:34:06.737783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.737788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.737790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.737797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026491:6212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.738215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026491:6212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.739907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026491:6212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.741907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026491:6212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.741918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026491:6212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.741921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026491:6212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.741925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.741961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.743464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.743479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.743480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.743482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.743486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2226 [2:7556555351249458169:2502]
2025-10-02T09:34:06.743492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.743502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.743504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.743505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.743506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.743516Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.743518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.743523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.743555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.743561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.743562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.743563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.743565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.743602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.743607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.743614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.743620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.743630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.743642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026459:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.743647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026523:6212], now have 1 active actors on pipe
2025-10-02T09:34:06.743651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.743652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.743653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.743661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.743671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.743674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.743676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.743677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.743682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.743684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.743700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.743706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.743707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.743676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2226
2025-10-02T09:34:06.743682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2226
2025-10-02T09:34:06.743718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.743723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.743860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4011724-424486cd-2ea60701-ef546db2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.743870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.743872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.743873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.743879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.743884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.743896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.744023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.744028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.744035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.744107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2227 partition: 0 MaxSeqNo: 36 sessionId: src_id|f4011724-424486cd-2ea60701-ef546db2_0
2025-10-02T09:34:06.744314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6402f8b-1d9c7dab-96c1e1cb-47cb06ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f4011724-424486cd-2ea60701-ef546db2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.747009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Write session: try to update token
2025-10-02T09:34:06.747022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.752794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.752819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.752820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.752823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.752827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.752829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.752831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249458164:2502]
2025-10-02T09:34:06.752851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.752857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.752858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.752859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.752863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.752865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.752981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.759930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId: src_id|f4011724-424486cd-2ea60701-ef546db2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.762239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.828103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026552:6658]
2025-10-02T09:34:06.828328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2226, pipe: [1:7556555351325026552:6658]
2025-10-02T09:34:06.863413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.863780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.863789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.863801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026552:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.864013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.864058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:06.864062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:06.864078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026552:6658]
2025-10-02T09:34:06.864171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2227 reason: error at write: Disconnected sessionId: src_id|f4011724-424486cd-2ea60701-ef546db2_0
2025-10-02T09:34:06.864216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.864340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2227 sessionId: src_id|f4011724-424486cd-2ea60701-ef546db2_0 is DEAD
2025-10-02T09:34:06.864480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:06.864492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Write session will restart in 0.006306s
2025-10-02T09:34:06.864512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Write session: Do CDS request
2025-10-02T09:34:06.864517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:06.868493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:06.869209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:06.869304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:06.869311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:06.869316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:06.869342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:06.869364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555351249458256:2495]
2025-10-02T09:34:06.869703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:06.869880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:06.869905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:06.870087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:06.870115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.870121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.870121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.870122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.870122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.870123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.870123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.870124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.870124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.870125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.870125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.870125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.870128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.870135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.870138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.870148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.870150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.870152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.870154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.870156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.870158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.870160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.870162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.870164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.870168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.870172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:06.870176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.870178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:06.870180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.870183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:06.870186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.870188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:06.870193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.870195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:06.870197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.870200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:06.870202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.870208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:06.870210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.870212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:06.870214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.870217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:06.870219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.870221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.870226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.870229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.870231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.870233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.870249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:06.872176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.872268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:06.872289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2228
2025-10-02T09:34:06.872382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:06.872406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:06.872410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:06.872414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:06.872713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2228 sessionId:  describe result for acl check
2025-10-02T09:34:06.872741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:06.872744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:06.872745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:06.872750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555351325026589:6151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:06.873166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555351325026589:6151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:06.875139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555351325026589:6151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:06.877096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555351325026589:6151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:06.877105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555351325026589:6151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:06.877107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555351325026589:6151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:06.877113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:06.877694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:06.879172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:06.879184Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:06.879185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:06.879187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:06.879191Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2227 [2:7556555351249458256:2495]
2025-10-02T09:34:06.879200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:06.879211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:06.879216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.879218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.879219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.879229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:06.879235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:06.879241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:06.879277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.879282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.879283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.879284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:06.879286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:06.879321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:06.879326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.879332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:06.879337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:06.879345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:06.879359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026624:6151], now have 1 active actors on pipe
2025-10-02T09:34:06.879364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026557:2446], now have 1 active actors on pipe
2025-10-02T09:34:06.879368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.879372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.879373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.879381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:06.879390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:06.879395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:06.879396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:06.879397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:06.879401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:06.879402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:06.879417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.879425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:06.879434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:06.879422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2227
2025-10-02T09:34:06.879425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2227
2025-10-02T09:34:06.879470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.879475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.879489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:06.879497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:06.879501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:06.879503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:06.879509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:06.879516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:06.879522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.879639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.879644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.879651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:06.879741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2228 partition: 0 MaxSeqNo: 36 sessionId: src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0
2025-10-02T09:34:06.879985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4011724-424486cd-2ea60701-ef546db2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:06.882676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Write session: try to update token
2025-10-02T09:34:06.882690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:06.888535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:06.888548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:06.888549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:06.888550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:06.888554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.888556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.888559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555351249458251:2495]
2025-10-02T09:34:06.888578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:06.888583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:06.888584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:06.888585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:06.888586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:06.888589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:06.888771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:06.895012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId: src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:06.897417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:06.964279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555351325026635:6658]
2025-10-02T09:34:06.964451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2227, pipe: [1:7556555351325026635:6658]
2025-10-02T09:34:06.998543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:06.998793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:06.998803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:06.998816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026635:6658], now have 1 active actors on pipe
2025-10-02T09:34:06.998975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:06.998969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:06.998981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:06.999001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555351325026635:6658]
2025-10-02T09:34:06.999022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:06.999050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2228 reason: error at write: Disconnected sessionId: src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0
2025-10-02T09:34:06.999216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2228 sessionId: src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0 is DEAD
2025-10-02T09:34:06.999354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 119 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:34:06.999382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:06.999386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Write session will restart in 0.008549s
2025-10-02T09:34:06.999406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Write session: Do CDS request
2025-10-02T09:34:06.999410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.003463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.004146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.004243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.004250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.004255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.004281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.004305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544425629:2493]
2025-10-02T09:34:07.004643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.004813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.004837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.005014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.005044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.005048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.005049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.005049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.005050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.005050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.005051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.005052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.005053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.005054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.005054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.005055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.005058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.005064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.005067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.005069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.005071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.005073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.005075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.005076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.005078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.005081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.005082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.005084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.005088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.005092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.005095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.005099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.005102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.005104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.005106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.005109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.005112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.005114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.005120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.005123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.005125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.005129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.005131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.005133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.005140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.005142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.005144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.005147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.005150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.005153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.005155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.005160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.005176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.009194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.009236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.009248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2229
2025-10-02T09:34:07.009337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.009361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.009365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.009368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.010041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2229 sessionId:  describe result for acl check
2025-10-02T09:34:07.010073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.010076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.010077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.010081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619993964:6142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.010499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619993964:6142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.011861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619993964:6142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.012577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.013760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619993964:6142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.013770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619993964:6142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.013773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619993964:6142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.013777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.014099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.014114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.014115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.014117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.014120Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2228 [2:7556555355544425629:2493]
2025-10-02T09:34:07.014128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.014139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.014144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.014148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.014149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.014158Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.014164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.014169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.014203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.014208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.014209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.014211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.014212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.014249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.014254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.014261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.014266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.014278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.014293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555351325026636:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.014298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619993999:6142], now have 1 active actors on pipe
2025-10-02T09:34:07.014301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.014303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.014304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.014313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.014323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.014330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.014331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.014333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.014334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.014336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.014351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.014326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2228
2025-10-02T09:34:07.014356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.014358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.014369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.014332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2228
2025-10-02T09:34:07.014371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.014396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.014400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.014404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.014404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.014409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.014415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.014425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.014560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.014565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.014574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.014647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2229 partition: 0 MaxSeqNo: 36 sessionId: src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0
2025-10-02T09:34:07.014836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97afe4af-28baf6af-4807aabc-3fe7bd58_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.017424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Write session: try to update token
2025-10-02T09:34:07.017438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.023629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.023643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.023644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.023645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.023648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.023651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.023654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544425624:2493]
2025-10-02T09:34:07.023672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.023679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.023681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.023684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.023687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.023689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.023795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.030485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId: src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.032714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.098922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994018:6658]
2025-10-02T09:34:07.099152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2228, pipe: [1:7556555355619994018:6658]
2025-10-02T09:34:07.131931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.132169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.132178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.132190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994018:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.132313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.132343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.132371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:07.132388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994018:6658]
2025-10-02T09:34:07.132454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0
2025-10-02T09:34:07.132615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2229 sessionId: src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0 is DEAD
2025-10-02T09:34:07.132750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:07.132756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Write session will restart in 0.006711s
2025-10-02T09:34:07.132778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Write session: Do CDS request
2025-10-02T09:34:07.132783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.136896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.137668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.137780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.137788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.137794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.137822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.137845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544425696:2479]
2025-10-02T09:34:07.138316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.138480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.138503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.138690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.138725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.138729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.138730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.138731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.138731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.138732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.138733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.138733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.138734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.138734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.138735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.138735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.138738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.138745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.138747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.138750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.138752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.138754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.138756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.138758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.138760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.138762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.138764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.138766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.138771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.138775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.138779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.138782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.138784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.138787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.138789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.138791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.138793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.138796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.138799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.138801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.138804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.138810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.138812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.138815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.138817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.138820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.138826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.138829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.138831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.138833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.138835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.138838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.138857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.140157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.140232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.140243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2230
2025-10-02T09:34:07.140336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.140359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.140365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.140368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.140692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2230 sessionId:  describe result for acl check
2025-10-02T09:34:07.140720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.140725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.140726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.140730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994051:6120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.141156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994051:6120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.143026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994051:6120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.145738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994051:6120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.145748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994051:6120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.145751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994051:6120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.145755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.146335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.147964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.147977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.147978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.147980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.147987Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2229 [2:7556555355544425696:2479]
2025-10-02T09:34:07.147996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.148009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.148012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.148014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.148015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.148024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.148031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.148035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.148067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.148072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.148073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.148075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.148076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.148114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.148119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.148125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.148130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.148140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.148155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994086:6120], now have 1 active actors on pipe
2025-10-02T09:34:07.148160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994019:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.148166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.148167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.148168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.148177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.148188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.148190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.148192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.148192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.148198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.148200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.148215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.148220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.148202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2229
2025-10-02T09:34:07.148221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.148238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.148241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.148260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.148267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.148269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.148270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.148277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.148285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.148287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2229
2025-10-02T09:34:07.148297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.148396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.148401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.148408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.148472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2230 partition: 0 MaxSeqNo: 36 sessionId: src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0
2025-10-02T09:34:07.148667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7010b2ab-ae402a37-3d2aa568-44be93a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.151243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Write session: try to update token
2025-10-02T09:34:07.151256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.157274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.157287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.157289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.157290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.157294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.157297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.157299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544425691:2479]
2025-10-02T09:34:07.157318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.157321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.157324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.157326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.157326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.157327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.157439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.163903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId: src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.166167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.232553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994094:6658]
2025-10-02T09:34:07.232761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2229, pipe: [1:7556555355619994094:6658]
2025-10-02T09:34:07.266146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.266382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.266392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.266405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994094:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.266525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.266585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994094:6658]
2025-10-02T09:34:07.266597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:07.266624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.266685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0
2025-10-02T09:34:07.266845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2230 sessionId: src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0 is DEAD
2025-10-02T09:34:07.266966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:07.266977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Write session will restart in 0.008710s
2025-10-02T09:34:07.266997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Write session: Do CDS request
2025-10-02T09:34:07.267003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.270955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.271732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.271831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.271838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.271844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.271869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.271894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544425762:2465]
2025-10-02T09:34:07.272307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.272465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.272487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.272665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.272694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.272698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.272699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.272700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.272700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.272702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.272703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.272703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.272704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.272705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.272705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.272706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.272708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.272715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.272717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.272719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.272721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.272723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.272726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.272728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.272730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.272732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.272734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.272736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.272740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.272745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.272748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.272750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.272753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.272755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.272757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.272760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.272762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.272765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.272767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.272770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.272772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.272775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.272778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.272780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.272782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.272785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.272788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.272790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.272792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.272795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.272813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.272816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.272832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.277112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.277182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.277193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2231
2025-10-02T09:34:07.277276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.277299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.277305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.277309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.277614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2231 sessionId:  describe result for acl check
2025-10-02T09:34:07.277639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.277644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.277646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.277649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994130:6111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.278048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994130:6111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.279708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994130:6111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.280219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.281549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994130:6111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.281557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994130:6111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.281560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994130:6111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.281564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.281712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.281725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.281727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.281729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.281733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2230 [2:7556555355544425762:2465]
2025-10-02T09:34:07.281741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.281752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.281757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.281759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.281760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.281769Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.281773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.281777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.281813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.281817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.281818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.281820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.281822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.281859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.281864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.281871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.281876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.281884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.281896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994165:6111], now have 1 active actors on pipe
2025-10-02T09:34:07.281902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994097:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.281907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.281914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.281916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.281925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.281926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2230
2025-10-02T09:34:07.281925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2230
2025-10-02T09:34:07.281936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.281939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.281944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.281945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.281949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.281952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.281981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.281988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.282001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.282011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.282018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.282031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.282041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.282047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.282048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.282054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.282062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.282077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.282190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.282197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.282208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.282263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2231 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0
2025-10-02T09:34:07.282454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b278b6e9-8b441417-4703b1e2-8a69acba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.285009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Write session: try to update token
2025-10-02T09:34:07.285023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.291142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.291155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.291156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.291157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.291162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.291164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.291168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544425757:2465]
2025-10-02T09:34:07.291187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.291194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.291195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.291194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.291197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.291200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.291307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.297672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId: src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.299937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.366748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994173:6658]
2025-10-02T09:34:07.366956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2230, pipe: [1:7556555355619994173:6658]
2025-10-02T09:34:07.403327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.403574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.403591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.403605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994173:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.403798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.403823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994173:6658]
2025-10-02T09:34:07.403854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:07.403866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:07.403937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2231 reason: error at write: Disconnected sessionId: src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0
2025-10-02T09:34:07.404049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.404099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2231 sessionId: src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0 is DEAD
2025-10-02T09:34:07.404237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:07.404243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Write session will restart in 0.009585s
2025-10-02T09:34:07.404263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Write session: Do CDS request
2025-10-02T09:34:07.404268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.407957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.408678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.408771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.408778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.408783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.408823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.408849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544425832:2474]
2025-10-02T09:34:07.409187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.409351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.409373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.409549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.409582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.409585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.409586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.409586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.409587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.409588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.409588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.409589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.409589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.409590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.409590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.409591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.409594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.409601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.409603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.409605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.409607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.409609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.409611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.409613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.409615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.409619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.409621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.409623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.409626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.409630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.409633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.409638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.409641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.409643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.409646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.409649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.409651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.409653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.409655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.409658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.409661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.409663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.409665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.409668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.409673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.409675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.409681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.409683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.409685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.409688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.409693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.409695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.409712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.415212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.415298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.415310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2232
2025-10-02T09:34:07.415408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.415440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.415448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.415451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.415789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2232 sessionId:  describe result for acl check
2025-10-02T09:34:07.415812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.415817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.415819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.415823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994209:6094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.416250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994209:6094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.417161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.417933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994209:6094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.418771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.418783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.418784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.418786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.418790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2231 [2:7556555355544425832:2474]
2025-10-02T09:34:07.418797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.418809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.418810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.418811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.418812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.418821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.418828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.418834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.418865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.418870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.418871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.418873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.418874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.418910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.418915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.418921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.418927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.418934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.418945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994174:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.418953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.418954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.418955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.418964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.418974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.418976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.418978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.418978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.418984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.418986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.419001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.419005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.418997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2231
2025-10-02T09:34:07.419013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.422901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994209:6094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.422912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994209:6094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.422915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994209:6094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.422920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.423077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994247:6094], now have 1 active actors on pipe
2025-10-02T09:34:07.423096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2231
2025-10-02T09:34:07.423131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.423137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.423151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.423158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.423160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.423161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.423166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.423172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.423182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.423297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.423301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.423309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.423365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2232 partition: 0 MaxSeqNo: 36 sessionId: src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0
2025-10-02T09:34:07.423617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f696a34-e468a69f-56ca9bb4-6f195293_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.426259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Write session: try to update token
2025-10-02T09:34:07.426280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.427938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:07.427950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.427955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.427977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:07.427977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:07.428118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:07.428235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:07.428351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:07.428481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:07.428649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:07.428672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:07.436291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.436302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.436304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.436307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.436312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.436314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.436316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544425827:2474]
2025-10-02T09:34:07.436334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.436334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.436336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.436338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.436340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.436341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.436456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.438809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId: src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.441134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.503930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994250:6658]
2025-10-02T09:34:07.504114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2231, pipe: [1:7556555355619994250:6658]
2025-10-02T09:34:07.550307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.550531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.550540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.550553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994250:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.550786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.550790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.550799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994250:6658]
2025-10-02T09:34:07.550830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:07.550910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0
2025-10-02T09:34:07.551077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2232 sessionId: src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0 is DEAD
2025-10-02T09:34:07.551207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:07.551219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Write session will restart in 0.006887s
2025-10-02T09:34:07.551243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Write session: Do CDS request
2025-10-02T09:34:07.551248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.554943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.555677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.555790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.555797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.555803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.555830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.555854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544425901:2472]
2025-10-02T09:34:07.556194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.556355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.556379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.556557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.556588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.556592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.556593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.556593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.556594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.556596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.556597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.556597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.556598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.556599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.556600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.556600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.556603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.556610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.556612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.556614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.556616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.556618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.556620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.556622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.556624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.556628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.556630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.556632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.556635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.556639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.556643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.556645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.556649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.556653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.556657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.556659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.556662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.556664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.556666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.556669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.556672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.556676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.556678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.556681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.556683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.556686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.556689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.556692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.556695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.556701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.556703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.556705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.556723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.559148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.559279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.559290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2233
2025-10-02T09:34:07.559402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.559434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.559442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.559446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.559822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2233 sessionId:  describe result for acl check
2025-10-02T09:34:07.559851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.559856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.559858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.559862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994287:6081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.560278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994287:6081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.561757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994287:6081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.563613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994287:6081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.563621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994287:6081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.563624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994287:6081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.563628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.564110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.565624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.565638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.565639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.565641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.565644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2232 [2:7556555355544425901:2472]
2025-10-02T09:34:07.565652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.565665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.565669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.565671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.565674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.565682Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.565688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.565693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.565727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.565731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.565733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.565735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.565737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.565771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.565775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.565782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.565788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.565797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.565816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994252:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.565822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994322:6081], now have 1 active actors on pipe
2025-10-02T09:34:07.565825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.565827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.565828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.565835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.565845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.565848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.565850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.565840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2232
2025-10-02T09:34:07.565841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2232
2025-10-02T09:34:07.565851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.565856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.565857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.565886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.565892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.565900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.565907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.565916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.565925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c595a37c-206f69f-266d0114-7cae3252_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.565928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.565930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.565931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.565936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.565944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.565954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.566053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.566058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.566067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.566134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2233 partition: 0 MaxSeqNo: 36 sessionId: src_id|c595a37c-206f69f-266d0114-7cae3252_0
2025-10-02T09:34:07.566326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806aec4c-36571a2a-bccdf7e2-a35e3b3e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c595a37c-206f69f-266d0114-7cae3252_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.568917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Write session: try to update token
2025-10-02T09:34:07.568929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.574998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.575011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.575012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.575013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.575016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.575018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.575020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544425896:2472]
2025-10-02T09:34:07.575038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.575042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.575043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.575045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.575048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.575050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.575155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.581213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId: src_id|c595a37c-206f69f-266d0114-7cae3252_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.583473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.650891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994329:6658]
2025-10-02T09:34:07.651101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2232, pipe: [1:7556555355619994329:6658]
2025-10-02T09:34:07.686516Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.686783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.686793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.686806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994329:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.686945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.687007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994329:6658]
2025-10-02T09:34:07.687030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.687039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:07.687123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c595a37c-206f69f-266d0114-7cae3252_0
2025-10-02T09:34:07.687291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2233 sessionId: src_id|c595a37c-206f69f-266d0114-7cae3252_0 is DEAD
2025-10-02T09:34:07.687454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:07.687466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Write session will restart in 0.007463s
2025-10-02T09:34:07.687486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Write session: Do CDS request
2025-10-02T09:34:07.687493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.691241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.692009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.692116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.692123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.692129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.692157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.692184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544425971:2466]
2025-10-02T09:34:07.692819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.692991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.693016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.693233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.693267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.693271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.693272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.693272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.693273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.693273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.693274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.693275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.693276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.693276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.693277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.693277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.693280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.693287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.693289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.693291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.693293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.693295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.693297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.693299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.693301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.693305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.693307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.693309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.693313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.693317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.693321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.693324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.693326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.693329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.693331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.693334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.693336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.693339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.693341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.693344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.693346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.693349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.693351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.693354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.693356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.693358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.693360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.693364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.693365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.693368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.693374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.693376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.693394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.696169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.696278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.696288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2234
2025-10-02T09:34:07.696373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.696394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.696401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.696404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.696738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2234 sessionId:  describe result for acl check
2025-10-02T09:34:07.696763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.696768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.696769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.696773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994367:6080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.697243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994367:6080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.699026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994367:6080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.700793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.700933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994367:6080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.700942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994367:6080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.700945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994367:6080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.700950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.702290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.702303Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.702304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.702308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.702312Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2233 [2:7556555355544425971:2466]
2025-10-02T09:34:07.702319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.702330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.702335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.702337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.702338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.702347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.702353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.702357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.702403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.702408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.702409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.702411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.702413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.702450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.702455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.702461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.702467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.702478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.702493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994402:6080], now have 1 active actors on pipe
2025-10-02T09:34:07.702499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994331:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.702503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.702507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.702509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.702518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.702530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.702531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.702532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.702534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.702541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.702542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.702530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2233
2025-10-02T09:34:07.702535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2233
2025-10-02T09:34:07.702557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.702562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.702564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.702577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.702582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.702613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47120030-c4a61336-739b9ab-3542ad73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.702620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.702622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.702623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.702630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.702639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.702657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.702779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.702785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.702795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.702861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2234 partition: 0 MaxSeqNo: 36 sessionId: src_id|47120030-c4a61336-739b9ab-3542ad73_0
2025-10-02T09:34:07.703073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c595a37c-206f69f-266d0114-7cae3252_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47120030-c4a61336-739b9ab-3542ad73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.705764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Write session: try to update token
2025-10-02T09:34:07.705781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.711960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.711974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.711975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.711976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.711980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.711984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.711986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544425966:2466]
2025-10-02T09:34:07.712007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.712011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.712011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.712014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.712014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.712015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.712133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.717672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId: src_id|47120030-c4a61336-739b9ab-3542ad73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.720048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.787027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994422:6658]
2025-10-02T09:34:07.787162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2233, pipe: [1:7556555355619994422:6658]
2025-10-02T09:34:07.823238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.823454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.823463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.823475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994422:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.823592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:07.823602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:07.823622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.823646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2234 reason: error at write: Disconnected sessionId: src_id|47120030-c4a61336-739b9ab-3542ad73_0
2025-10-02T09:34:07.823677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994422:6658]
2025-10-02T09:34:07.823794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.823787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2234 sessionId: src_id|47120030-c4a61336-739b9ab-3542ad73_0 is DEAD
2025-10-02T09:34:07.823937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:07.823947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Write session will restart in 0.008101s
2025-10-02T09:34:07.823963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Write session: Do CDS request
2025-10-02T09:34:07.823967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.828007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.828866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.828965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.828972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.828978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.829005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.829029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544426078:2441]
2025-10-02T09:34:07.829402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.829568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.829619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.829797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.829828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.829832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.829833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.829834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.829834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.829835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.829835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.829836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.829836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.829837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.829838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.829838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.829841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.829848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.829850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.829852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.829854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.829856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.829859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.829861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.829863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.829866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.829868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.829871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.829875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.829882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.829886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.829891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.829894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.829903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.829906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.829913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.829921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.829929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.829937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.829945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.829952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.829955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.829961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.829964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.829966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.829969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.829973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.829976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.829978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.829981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.829984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.829987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.830004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.833154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.833274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.833285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2235
2025-10-02T09:34:07.833407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.833432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.833440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.833443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.833744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2235 sessionId:  describe result for acl check
2025-10-02T09:34:07.833770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.833776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.833777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.833779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994469:6055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.834111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994469:6055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.836341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994469:6055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.837418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.838668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994469:6055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.838679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994469:6055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.838680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994469:6055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.838684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.838950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.838963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.838964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.838967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.838970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2234 [2:7556555355544426078:2441]
2025-10-02T09:34:07.838985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.839004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.839011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.839012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.839013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.839021Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.839027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.839031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.839063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.839067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.839069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.839070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.839072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.839106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.839110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.839117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.839122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.839133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.839147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994504:6055], now have 1 active actors on pipe
2025-10-02T09:34:07.839153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994432:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.839157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.839158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.839160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.839167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.839169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2234
2025-10-02T09:34:07.839178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2234
2025-10-02T09:34:07.839178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.839179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.839181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.839182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.839189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.839190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.839203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.839206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.839208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.839216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.839221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.839250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.839256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.839258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.839260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.839264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.839272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.839282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.839380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.839385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.839394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.839458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2235 partition: 0 MaxSeqNo: 36 sessionId: src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0
2025-10-02T09:34:07.839674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47120030-c4a61336-739b9ab-3542ad73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.842313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Write session: try to update token
2025-10-02T09:34:07.842324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.848378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.848392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.848393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.848394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.848399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.848401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.848404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544426073:2441]
2025-10-02T09:34:07.848425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.848427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.848428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.848431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.848431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.848435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.848660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.853830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId: src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.856259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:07.865933Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 22 CurrentSessionLifetimeMs: 361391 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:34:07.923776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555355619994519:6658]
2025-10-02T09:34:07.924010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2234, pipe: [1:7556555355619994519:6658]
2025-10-02T09:34:07.958152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:07.958384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.958392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.958404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994519:6658], now have 1 active actors on pipe
2025-10-02T09:34:07.958558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:07.958568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:07.958611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555355619994519:6658]
2025-10-02T09:34:07.958718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:07.958799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2235 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0
2025-10-02T09:34:07.958950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2235 sessionId: src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0 is DEAD
2025-10-02T09:34:07.959096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:07.959106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Write session will restart in 0.009441s
2025-10-02T09:34:07.959130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Write session: Do CDS request
2025-10-02T09:34:07.959134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:07.963072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:07.963935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:07.964034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:07.964040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:07.964046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:07.964074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:07.964101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555355544426161:2439]
2025-10-02T09:34:07.964540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:07.964709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:07.964732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:07.964921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:07.964953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.964957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.964958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.964958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.964959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.964959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.964960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.964960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.964961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.964962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.964962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.964963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.964966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.964972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.964974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.964977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.964979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.964981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.964983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.964985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.964987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.964989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.964991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.964993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.964997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.965000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:07.965003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.965006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:07.965008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.965011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:07.965013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.965017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:07.965020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.965026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:07.965029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.965033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:07.965036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.965042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:07.965044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.965047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:07.965049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.965051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:07.965055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.965057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.965060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.965066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.965068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.965070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.965086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:07.969132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.969203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:07.969214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2236
2025-10-02T09:34:07.969326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:07.969349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:07.969356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:07.969360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:07.969698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2236 sessionId:  describe result for acl check
2025-10-02T09:34:07.969723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:07.969728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:07.969730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:07.969734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555355619994561:6038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:07.970177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555355619994561:6038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:07.971887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555355619994561:6038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:07.972504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:07.973803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555355619994561:6038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:07.973812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555355619994561:6038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:07.973814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555355619994561:6038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:07.973819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:07.974017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:07.974030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:07.974031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:07.974035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:07.974038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2235 [2:7556555355544426161:2439]
2025-10-02T09:34:07.974045Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:07.974055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:07.974060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.974062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.974063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.974072Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:07.974076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:07.974082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:07.974115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.974119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.974120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.974122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:07.974123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:07.974159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:07.974163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.974170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:07.974175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:07.974185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:07.974199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994523:2446], now have 1 active actors on pipe
2025-10-02T09:34:07.974204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555355619994596:6038], now have 1 active actors on pipe
2025-10-02T09:34:07.974208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.974209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.974210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.974220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:07.974230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:07.974232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:07.974234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:07.974226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2235
2025-10-02T09:34:07.974235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:07.974241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:07.974243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:07.974258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.974260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:07.974252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2235
2025-10-02T09:34:07.974262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:07.974273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.974275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.974296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:07.974305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:07.974311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:07.974312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:07.974316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:07.974321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:07.974333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.974443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:07.974449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:07.974458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:07.974526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2236 partition: 0 MaxSeqNo: 36 sessionId: src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0
2025-10-02T09:34:07.974745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aa03084-7eedd1a8-12cc8d70-24979cb7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:07.977233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Write session: try to update token
2025-10-02T09:34:07.977245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:07.983491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:07.983504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:07.983505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:07.983506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:07.983511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.983514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.983517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555355544426156:2439]
2025-10-02T09:34:07.983539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:07.983542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:07.983542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:07.983545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:07.983546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:07.983547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:07.983670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:07.988716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId: src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:07.991307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.058918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914961912:6658]
2025-10-02T09:34:08.059079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2235, pipe: [1:7556555359914961912:6658]
2025-10-02T09:34:08.094093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.094335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.094344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.094357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914961912:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.094496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.094553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914961912:6658]
2025-10-02T09:34:08.094553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:08.094582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.094630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2236 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0
2025-10-02T09:34:08.094760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2236 sessionId: src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0 is DEAD
2025-10-02T09:34:08.094890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:08.094901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Write session will restart in 0.008404s
2025-10-02T09:34:08.094917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Write session: Do CDS request
2025-10-02T09:34:08.094921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.099126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.099871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.099979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.099986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.099992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.100021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.100046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839393531:2430]
2025-10-02T09:34:08.100659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.100828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.101090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.101094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.101095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.101095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.101096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.101096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.101097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.101098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.101098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.101099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.101099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.101100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.101103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.101110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.101112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.101114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.101116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.101118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.101120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.101122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.101124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.101127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.101129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.101131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.101135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.101139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.101143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.101146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.101149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.101152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.101154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.101157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.101160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.101163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.101165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.101168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.101170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.101172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.101174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.101177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.101179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.101182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.101184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.101186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.101189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.101191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.101194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.101196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.101212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.104209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.104320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.104334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2237
2025-10-02T09:34:08.104469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.104494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.104500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.104503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.104835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2237 sessionId:  describe result for acl check
2025-10-02T09:34:08.104863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.104869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.104870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.104873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914961952:6029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.105221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914961952:6029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.107056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914961952:6029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.108842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.108987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914961952:6029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.108997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914961952:6029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.108999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914961952:6029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.109004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.110401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.110413Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.110415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.110417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.110423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2236 [2:7556555359839393531:2430]
2025-10-02T09:34:08.110468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.110482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.110485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.110487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.110489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.110498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.110505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.110509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.110540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.110546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.110547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.110549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.110550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.110589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.110593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.110614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.110623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.110632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.110646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914961986:6029], now have 1 active actors on pipe
2025-10-02T09:34:08.110652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914961913:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.110656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.110657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.110658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.110667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.110677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.110663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2236
2025-10-02T09:34:08.110683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.110679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2236
2025-10-02T09:34:08.110686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.110687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.110687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.110689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.110716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.110722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.110730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.110738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.110750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.110755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77844c75-3fd9a975-4964d3ef-b390e071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.110759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.110761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.110762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.110769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.110774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.110784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.110887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.110892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.110899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.110968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2237 partition: 0 MaxSeqNo: 36 sessionId: src_id|77844c75-3fd9a975-4964d3ef-b390e071_0
2025-10-02T09:34:08.111199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76e3631-4e5691c0-620098e7-a5c8747a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77844c75-3fd9a975-4964d3ef-b390e071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.113991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Write session: try to update token
2025-10-02T09:34:08.114008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.119750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.119763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.119764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.119765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.119768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.119770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.119772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839393526:2430]
2025-10-02T09:34:08.119793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.119794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.119798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.119800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.119801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.119802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.119913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.126051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId: src_id|77844c75-3fd9a975-4964d3ef-b390e071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.128231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.194615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914961995:6658]
2025-10-02T09:34:08.194812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2236, pipe: [1:7556555359914961995:6658]
2025-10-02T09:34:08.228739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.229060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.229070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.229083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914961995:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.229518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914961995:6658]
2025-10-02T09:34:08.229532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:08.229536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:08.229538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.229612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2237 reason: error at write: Disconnected sessionId: src_id|77844c75-3fd9a975-4964d3ef-b390e071_0
2025-10-02T09:34:08.229765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.229771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2237 sessionId: src_id|77844c75-3fd9a975-4964d3ef-b390e071_0 is DEAD
2025-10-02T09:34:08.229907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:08.229918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Write session will restart in 0.009206s
2025-10-02T09:34:08.229940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Write session: Do CDS request
2025-10-02T09:34:08.229946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.233985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.234889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.234987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.234997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.235003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.235029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.235055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839393605:2426]
2025-10-02T09:34:08.235395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.235554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.235576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.235772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.235818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.235822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.235823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.235823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.235824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.235824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.235825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.235825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.235826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.235826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.235827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.235827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.235830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.235836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.235839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.235841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.235843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.235845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.235846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.235848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.235850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.235852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.235854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.235856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.235860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.235864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.235868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.235870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.235873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.235875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.235878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.235882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.235884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.235887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.235889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.235892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.235896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.235901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.235903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.235906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.235910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.235912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.235915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.235916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.235919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.235921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.235923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.235941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.240190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.240284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.240295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2238
2025-10-02T09:34:08.240387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.240410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.240418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.240421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.240729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2238 sessionId:  describe result for acl check
2025-10-02T09:34:08.240757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.240763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.240764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.240769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914962036:6019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.241135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914962036:6019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.242762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914962036:6019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.243334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.244628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914962036:6019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.244638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914962036:6019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.244640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914962036:6019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.244644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.244901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.244911Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.244914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.244916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.244920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2237 [2:7556555359839393605:2426]
2025-10-02T09:34:08.244928Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.244938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.244943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.244944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.244946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.244955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.244958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.244964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.244996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.245001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.245002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.245004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.245005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.245077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.245082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.245089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.245094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.245102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.245106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2237
2025-10-02T09:34:08.245117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962071:6019], now have 1 active actors on pipe
2025-10-02T09:34:08.245122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914961996:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.245126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.245127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.245129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.245134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.245116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2237
2025-10-02T09:34:08.245141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.245142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.245143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.245145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.245150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.245152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.245164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.245166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.245186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.245194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.245202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.245207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.245210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.245212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.245214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.245219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.245227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.245246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.245357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.245362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.245369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.245437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2238 partition: 0 MaxSeqNo: 36 sessionId: src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0
2025-10-02T09:34:08.245635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77844c75-3fd9a975-4964d3ef-b390e071_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.248231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Write session: try to update token
2025-10-02T09:34:08.248245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.254301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.254313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.254314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.254315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.254319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.254321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.254323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839393600:2426]
2025-10-02T09:34:08.254342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.254345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.254346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.254348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.254351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.254353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.254528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.260504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId: src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.262772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.329782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914962080:6658]
2025-10-02T09:34:08.329954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2237, pipe: [1:7556555359914962080:6658]
2025-10-02T09:34:08.362616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.362851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.362860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.362872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962080:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.362992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.363064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:08.363068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914962080:6658]
2025-10-02T09:34:08.363093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.363130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2238 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0
2025-10-02T09:34:08.363268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2238 sessionId: src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0 is DEAD
2025-10-02T09:34:08.363431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:08.363444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Write session will restart in 0.008306s
2025-10-02T09:34:08.363469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Write session: Do CDS request
2025-10-02T09:34:08.363474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.367829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.368666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.368784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.368792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.368798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.368844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.368874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839393682:2414]
2025-10-02T09:34:08.369226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.369389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.369411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.369585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.369614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.369619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.369619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.369620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.369620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.369621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.369621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.369622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.369623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.369623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.369624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.369624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.369626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.369633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.369635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.369637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.369639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.369641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.369643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.369645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.369647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.369650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.369652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.369654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.369658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.369661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.369664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.369667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.369670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.369672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.369675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.369677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.369680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.369683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.369686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.369689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.369691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.369694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.369695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.369698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.369700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.369703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.369705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.369708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.369710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.369713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.369715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.369717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.369738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.373203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.373308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.373319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2239
2025-10-02T09:34:08.373414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.373439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.373447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.373450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.373758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2239 sessionId:  describe result for acl check
2025-10-02T09:34:08.373784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.373791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.373792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.373795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914962123:6004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.374160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914962123:6004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.375844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914962123:6004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.377129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.377781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914962123:6004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.377790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914962123:6004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.377792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914962123:6004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.377796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.378657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.378669Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.378670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.378675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.378678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2238 [2:7556555359839393682:2414]
2025-10-02T09:34:08.378687Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.378699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.378702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.378704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.378705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.378713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.378716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.378721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.378755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.378760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.378761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.378764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.378765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.378802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.378807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.378813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.378819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.378827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.378841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962157:6004], now have 1 active actors on pipe
2025-10-02T09:34:08.378846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962082:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.378850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.378851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.378852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.378860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.378869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.378872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.378874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.378875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.378879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.378882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.378877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2238
2025-10-02T09:34:08.378896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.378901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.378902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.378903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2238
2025-10-02T09:34:08.378917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.378922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.378972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.378979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.378981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.378982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.378987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.378992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.379007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.379133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.379139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.379150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.379219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2239 partition: 0 MaxSeqNo: 36 sessionId: src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0
2025-10-02T09:34:08.379439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4007d65d-ddab16a5-aeb1580d-2c26d2ba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.382079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Write session: try to update token
2025-10-02T09:34:08.382093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.387988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.388001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.388002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.388003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.388006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.388009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.388011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839393677:2414]
2025-10-02T09:34:08.388029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.388034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.388034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.388036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.388037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.388039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.388156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.394494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId: src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.396747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.463435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914962165:6658]
2025-10-02T09:34:08.463601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2238, pipe: [1:7556555359914962165:6658]
2025-10-02T09:34:08.496209Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.496449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.496458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.496470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962165:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.496626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914962165:6658]
2025-10-02T09:34:08.496635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.496660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:08.496663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:08.496755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2239 reason: error at write: Disconnected sessionId: src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0
2025-10-02T09:34:08.496954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2239 sessionId: src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0 is DEAD
2025-10-02T09:34:08.497030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.497092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:08.497105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Write session will restart in 0.006545s
2025-10-02T09:34:08.497126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Write session: Do CDS request
2025-10-02T09:34:08.497132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.501508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.502362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.502463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.502470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.502475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.502502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.502526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839393758:2419]
2025-10-02T09:34:08.502915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.503077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.503099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.503276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.503304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.503308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.503309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.503309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.503310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.503310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.503311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.503312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.503312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.503313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.503316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.503316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.503319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.503326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.503328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.503330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.503332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.503335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.503337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.503339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.503341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.503343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.503345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.503347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.503351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.503354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.503357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.503360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.503362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.503365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.503367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.503370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.503373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.503376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.503379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.503382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.503388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.503391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.503393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.503396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.503398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.503402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.503405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.503408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.503410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.503413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.503415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.503417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.503438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.504095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.504229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.504237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2240
2025-10-02T09:34:08.504368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.504389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.504393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.504400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.504703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2240 sessionId:  describe result for acl check
2025-10-02T09:34:08.504730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.504734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.504735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.504738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914962208:5996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.505128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914962208:5996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.506928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914962208:5996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.510278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914962208:5996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.510290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914962208:5996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.510292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914962208:5996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.510296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.510799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.512378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.512392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.512393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.512395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.512398Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2239 [2:7556555359839393758:2419]
2025-10-02T09:34:08.512405Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.512415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.512420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.512422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.512423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.512432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.512436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.512443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.512475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.512481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.512482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.512484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.512485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.512560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.512565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.512572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.512577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.512586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.512601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962242:5996], now have 1 active actors on pipe
2025-10-02T09:34:08.512608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962166:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.512611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.512591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2239
2025-10-02T09:34:08.512599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2239
2025-10-02T09:34:08.512612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.512613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.512619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.512623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.512626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.512627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.512627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.512634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.512635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.512646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.512652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.512673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.512680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.512688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.512689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.512693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.512695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.512696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.512702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.512707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.512722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.512833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.512838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.512846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.512907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2240 partition: 0 MaxSeqNo: 36 sessionId: src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0
2025-10-02T09:34:08.513097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded6a463-97d6cf02-f0b6ea6a-2f07cefc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.515780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Write session: try to update token
2025-10-02T09:34:08.515793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.521924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.521938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.521940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.521941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.521946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.521951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.521953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839393753:2419]
2025-10-02T09:34:08.521980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.521988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.521992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.522000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.522013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.522017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.522200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.528919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId: src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.531196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.597059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914962251:6658]
2025-10-02T09:34:08.597283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2239, pipe: [1:7556555359914962251:6658]
2025-10-02T09:34:08.633274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.633521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.633530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.633543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962251:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.633671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.633716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.633740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:08.633764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914962251:6658]
2025-10-02T09:34:08.633804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0
2025-10-02T09:34:08.633943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2240 sessionId: src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0 is DEAD
2025-10-02T09:34:08.634117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:08.634129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Write session will restart in 0.005754s
2025-10-02T09:34:08.634149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Write session: Do CDS request
2025-10-02T09:34:08.634156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.638090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.638870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.638969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.638976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.638982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.639008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.639035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839393834:2412]
2025-10-02T09:34:08.639386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.639552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.639574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.639758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.639786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.639790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.639791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.639791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.639792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.639792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.639793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.639793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.639794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.639795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.639795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.639796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.639799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.639806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.639808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.639810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.639812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.639815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.639817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.639819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.639821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.639823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.639826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.639828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.639831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.639835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.639839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.639842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.639847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.639849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.639852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.639854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.639857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.639860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.639862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.639864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.639867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.639870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.639872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.639875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.639877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.639880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.639882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.639885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.639887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.639890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.639895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.639898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.639915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.641165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.641259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.641269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2241
2025-10-02T09:34:08.641363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.641387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.641395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.641398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.641713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2241 sessionId:  describe result for acl check
2025-10-02T09:34:08.641739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.641745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.641746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.641749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914962295:5981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.642108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914962295:5981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.643647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914962295:5981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.647103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914962295:5981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.647116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914962295:5981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.647119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914962295:5981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.647124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.647528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.649062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.649074Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.649075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.649077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.649081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2240 [2:7556555359839393834:2412]
2025-10-02T09:34:08.649091Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.649104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.649109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.649111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.649112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.649121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.649124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.649128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.649162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.649166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.649167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.649169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.649170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.649208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.649213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.649220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.649225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.649233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.649248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962330:5981], now have 1 active actors on pipe
2025-10-02T09:34:08.649254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962252:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.649258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.649259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.649261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.649269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.649279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.649281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.649283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.649285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.649288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.649291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.649283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2240
2025-10-02T09:34:08.649307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.649312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.649313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.649346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2240
2025-10-02T09:34:08.649387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.649394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.649410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.649417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.649421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.649424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.649428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.649434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.649442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.649558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.649563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.649571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.649631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2241 partition: 0 MaxSeqNo: 36 sessionId: src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0
2025-10-02T09:34:08.649866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d61f4e-c897a202-d093b788-bcb8fb2d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.652493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Write session: try to update token
2025-10-02T09:34:08.652508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.658504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:08.658516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.658520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.658540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:08.658540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:08.658688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:08.658806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:08.658928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:08.659060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:08.659231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:08.659254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:08.665412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId: src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.666912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.666924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.666926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.666927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.666932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.666934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.666936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839393829:2412]
2025-10-02T09:34:08.666954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.666956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.666958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.666960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.666960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.666962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.667070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.667765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.733753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914962338:6658]
2025-10-02T09:34:08.733956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2240, pipe: [1:7556555359914962338:6658]
2025-10-02T09:34:08.778317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.778505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.778514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.778526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962338:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.778656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.778713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:08.778721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.778760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914962338:6658]
2025-10-02T09:34:08.778804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0
2025-10-02T09:34:08.778946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2241 sessionId: src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0 is DEAD
2025-10-02T09:34:08.779091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:08.779101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Write session will restart in 0.007777s
2025-10-02T09:34:08.779125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Write session: Do CDS request
2025-10-02T09:34:08.779131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.783809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.784726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.784833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.784840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.784846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.784872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.784898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839393924:2393]
2025-10-02T09:34:08.785278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.785446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.785473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.785651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.785680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.785684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.785684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.785685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.785685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.785686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.785686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.785687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.785687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.785688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.785688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.785689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.785692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.785698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.785700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.785702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.785704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.785706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.785708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.785710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.785712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.785714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.785716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.785718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.785722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.785726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.785729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.785731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.785733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.785737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.785739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.785742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.785744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.785746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.785749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.785754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.785756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.785760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.785762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.785764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.785768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.785770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.785772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.785774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.785777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.785781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.785782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.785785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.785803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.788142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.788253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.788262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2242
2025-10-02T09:34:08.788354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.788377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.788384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.788386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.788756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2242 sessionId:  describe result for acl check
2025-10-02T09:34:08.788783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.788788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.788789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.788793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914962383:5978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.789281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914962383:5978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.791213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914962383:5978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.793096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914962383:5978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.793108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914962383:5978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.793113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914962383:5978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.793119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.793340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.794864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.794879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.794880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.794883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.794887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2241 [2:7556555359839393924:2393]
2025-10-02T09:34:08.794895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.794906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.794911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.794913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.794915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.794924Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.794926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.794931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.794960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.794964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.794965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.794967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.794968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.795002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.795006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.795013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.795018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.795029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.795043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962339:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.795048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962417:5978], now have 1 active actors on pipe
2025-10-02T09:34:08.795051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.795053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.795053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.795061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.795070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.795070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.795071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.795072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.795078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.795080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.795095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.795102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.795109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.795110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2241
2025-10-02T09:34:08.795140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2241
2025-10-02T09:34:08.795160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.795172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.795190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.795200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.795202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.795203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.795209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.795217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.795225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.795368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.795376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.795389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.795453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2242 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0
2025-10-02T09:34:08.795675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bead734b-f03f3e77-2dfdf1b1-b59ceff6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.798339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Write session: try to update token
2025-10-02T09:34:08.798352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.804160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.804172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.804173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.804174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.804178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.804180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.804182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839393919:2393]
2025-10-02T09:34:08.804200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.804206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.804206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.804207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.804208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.804210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.804315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.810290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId: src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.812515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:08.879133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555359914962455:6658]
2025-10-02T09:34:08.879290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2241, pipe: [1:7556555359914962455:6658]
2025-10-02T09:34:08.913112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:08.913476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.913489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.913504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962455:6658], now have 1 active actors on pipe
2025-10-02T09:34:08.913683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:08.913719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:08.913718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555359914962455:6658]
2025-10-02T09:34:08.913721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:08.913742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:08.913765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2242 reason: error at write: Disconnected sessionId: src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0
2025-10-02T09:34:08.913918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2242 sessionId: src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0 is DEAD
2025-10-02T09:34:08.914094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:08.914106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Write session will restart in 0.008755s
2025-10-02T09:34:08.914126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Write session: Do CDS request
2025-10-02T09:34:08.914131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:08.918358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:08.919104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:08.919203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:08.919210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:08.919215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:08.919240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:08.919268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555359839394026:2380]
2025-10-02T09:34:08.919876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:08.920037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:08.920060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:08.920336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:08.920365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.920369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.920370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.920371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.920372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.920372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.920373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.920373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.920375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.920375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.920376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.920376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.920379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.920387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.920390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.920393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.920395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.920397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.920399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.920401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.920403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.920406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.920408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.920410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.920414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.920419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:08.920422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.920425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:08.920427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.920430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:08.920433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.920436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:08.920438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.920443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:08.920445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.920447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:08.920450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.920452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:08.920458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.920460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:08.920463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.920466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:08.920471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.920474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.920476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.920483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.920485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.920488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.920505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:08.924168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.924276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:08.924286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2243
2025-10-02T09:34:08.924407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:08.924431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:08.924436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:08.924442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:08.924821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2243 sessionId:  describe result for acl check
2025-10-02T09:34:08.924855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:08.924860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:08.924861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:08.924864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555359914962501:5943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:08.925209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555359914962501:5943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:08.927282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555359914962501:5943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:08.927872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:08.929389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:08.929401Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:08.929403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:08.929405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:08.929409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2242 [2:7556555359839394026:2380]
2025-10-02T09:34:08.929415Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:08.929426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:08.929429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.929431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.929432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.929442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:08.929446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:08.929458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:08.929490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.929494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.929495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.929497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:08.929498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:08.929536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:08.929540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.929547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:08.929552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:08.929560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:08.929574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962456:2446], now have 1 active actors on pipe
2025-10-02T09:34:08.929581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.929582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.929583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.929591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:08.929599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:08.929604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:08.929606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:08.929608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:08.929612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:08.929595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2242
2025-10-02T09:34:08.929613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:08.929628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.929629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:08.929631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:08.929973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555359914962501:5943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:08.929986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555359914962501:5943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:08.929989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555359914962501:5943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:08.929994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:08.930138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555359914962538:5943], now have 1 active actors on pipe
2025-10-02T09:34:08.930176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2242
2025-10-02T09:34:08.930217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.930223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.930238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:08.930246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:08.930248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:08.930249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:08.930255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:08.930262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:08.930269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.930380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:08.930385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:08.930392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:08.930443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2243 partition: 0 MaxSeqNo: 36 sessionId: src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0
2025-10-02T09:34:08.930670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c474117-9fc620c8-8d2ed3a1-cd53444_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:08.933298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Write session: try to update token
2025-10-02T09:34:08.933311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:08.938476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:08.938489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.938494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.938516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:08.938521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:08.938660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:08.938776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:08.938902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:08.939021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:08.939181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:08.939204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:08.945643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId: src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:08.946822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:08.946834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:08.946835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:08.946836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:08.946839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.946844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.946847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555359839394021:2380]
2025-10-02T09:34:08.946865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:08.946867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:08.946869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:08.946870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:08.946871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:08.946871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:08.947010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:08.947965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.013793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209929843:6658]
2025-10-02T09:34:09.013995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2242, pipe: [1:7556555364209929843:6658]
2025-10-02T09:34:09.055796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.056032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.056040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.056054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209929843:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.056183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.056209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.056248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:09.056261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209929843:6658]
2025-10-02T09:34:09.056327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0
2025-10-02T09:34:09.056482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2243 sessionId: src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0 is DEAD
2025-10-02T09:34:09.056606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:09.056617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Write session will restart in 0.006008s
2025-10-02T09:34:09.056642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Write session: Do CDS request
2025-10-02T09:34:09.056648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.061525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.062426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.062564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.062571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.062577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.062618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.062644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361416:2372]
2025-10-02T09:34:09.062984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.063128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.063159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.063182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.063237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.063247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2244
2025-10-02T09:34:09.063357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.063376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.063388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.063392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.063392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.063393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.063397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.063404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.063408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.063394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.063394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.063395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.063395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.063395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.063396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.063397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.063397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.063400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.063407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.063409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.063411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.063414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.063416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.063418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.063420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.063422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.063424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.063426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.063428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.063432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.063436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.063439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.063443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.063445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.063447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.063450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.063453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.063455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.063458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.063460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.063462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.063464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.063467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.063469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.063472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.063475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.063478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.063480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.063483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.063486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.063489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.063494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.063496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.063513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.063737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2244 sessionId:  describe result for acl check
2025-10-02T09:34:09.063760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.063765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.063767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.063770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209929902:5916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.064136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209929902:5916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.065593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209929902:5916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.070494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209929902:5916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.070506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209929902:5916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.070508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209929902:5916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.070514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.071014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.072457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.072470Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.072471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.072474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.072478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2243 [2:7556555364134361416:2372]
2025-10-02T09:34:09.072485Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.072496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.072502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.072503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.072505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.072514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.072517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.072524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.072554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.072559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.072560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.072562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.072563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.072601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.072606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.072613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.072619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.072627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.072642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209929856:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.072647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209929937:5916], now have 1 active actors on pipe
2025-10-02T09:34:09.072651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.072652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.072653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.072661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.072670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.072673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.072675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.072676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.072679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.072681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.072695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.072700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.072688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2243
2025-10-02T09:34:09.072693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2243
2025-10-02T09:34:09.072714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.072717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.072719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.072736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.072743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.072746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.072746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.072751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.072757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.072765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.072884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.072889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.072897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.072973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2244 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0
2025-10-02T09:34:09.073185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9614dae5-2d01d889-16c08dde-bf0c8676_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.075748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Write session: try to update token
2025-10-02T09:34:09.075761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.081988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.082000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.082002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.082003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.082007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.082011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.082013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361411:2372]
2025-10-02T09:34:09.082032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.082034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.082035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.082036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.082039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.082041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.082287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.088195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId: src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.090446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.156687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209929944:6658]
2025-10-02T09:34:09.156928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2243, pipe: [1:7556555364209929944:6658]
2025-10-02T09:34:09.191492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.191749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.191758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.191770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209929944:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.191904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.191949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.191958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209929944:6658]
2025-10-02T09:34:09.191983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:09.192065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0
2025-10-02T09:34:09.192221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2244 sessionId: src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0 is DEAD
2025-10-02T09:34:09.192367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:09.192380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Write session will restart in 0.008746s
2025-10-02T09:34:09.192399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Write session: Do CDS request
2025-10-02T09:34:09.192405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.196988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.197967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.198125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.198134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.198141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.198181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.198207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361497:2368]
2025-10-02T09:34:09.198565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.198754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.198779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.198957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.198988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.198992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.198992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.198993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.198994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.198994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.198995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.198995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.198996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.198996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.198997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.198998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.199000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.199008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.199010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.199012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.199014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.199016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.199019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.199021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.199023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.199025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.199027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.199029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.199033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.199037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.199041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.199044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.199046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.199049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.199051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.199054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.199056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.199059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.199061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.199064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.199067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.199070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.199072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.199074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.199077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.199079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.199081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.199084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.199086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.199089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.199091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.199093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.199111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.202146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.202225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.202233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2245
2025-10-02T09:34:09.202314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.202335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.202342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.202344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.202724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2245 sessionId:  describe result for acl check
2025-10-02T09:34:09.202753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.202762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.202763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.202766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209929993:5906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.203148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209929993:5906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.204757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209929993:5906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.206517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.206690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209929993:5906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.206700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209929993:5906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.206702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209929993:5906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.206706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.208000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.208013Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.208014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.208017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.208020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2244 [2:7556555364134361497:2368]
2025-10-02T09:34:09.208026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.208037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.208043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.208044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.208045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.208054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.208057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.208065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.208093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.208098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.208099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.208101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.208102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.208138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.208143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.208150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.208155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.208167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.208181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930028:5906], now have 1 active actors on pipe
2025-10-02T09:34:09.208186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209929946:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.208190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.208192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.208193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.208201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.208211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.208213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.208217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.208217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.208223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.208224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.208210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2244
2025-10-02T09:34:09.208225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2244
2025-10-02T09:34:09.208237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.208242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.208243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.208252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.208257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.208284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a035df34-14e73757-512bd442-3990fbdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.208291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.208292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.208294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.208299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.208307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.208319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.208425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.208429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.208437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.208507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2245 partition: 0 MaxSeqNo: 36 sessionId: src_id|a035df34-14e73757-512bd442-3990fbdd_0
2025-10-02T09:34:09.208676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c26bd0c-33120292-aeb4b698-6bbf8cd0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a035df34-14e73757-512bd442-3990fbdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.211270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Write session: try to update token
2025-10-02T09:34:09.211282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.217365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.217377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.217378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.217379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.217383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.217385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.217389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361492:2368]
2025-10-02T09:34:09.217406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.217413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.217414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.217414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.217416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.217419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.217526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.223148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId: src_id|a035df34-14e73757-512bd442-3990fbdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.225302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.292317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209930037:6658]
2025-10-02T09:34:09.292523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2244, pipe: [1:7556555364209930037:6658]
2025-10-02T09:34:09.326084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.326340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.326350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.326363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930037:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.326480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.326489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.326502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209930037:6658]
2025-10-02T09:34:09.326529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:09.326618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a035df34-14e73757-512bd442-3990fbdd_0
2025-10-02T09:34:09.326765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2245 sessionId: src_id|a035df34-14e73757-512bd442-3990fbdd_0 is DEAD
2025-10-02T09:34:09.326923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:09.326935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Write session will restart in 0.008915s
2025-10-02T09:34:09.326956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Write session: Do CDS request
2025-10-02T09:34:09.326962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.331446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.332403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.332510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.332517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.332523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.332552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.332576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361581:2365]
2025-10-02T09:34:09.332942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.333115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.333137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.333310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.333336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.333340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.333340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.333341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.333342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.333342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.333343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.333344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.333344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.333345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.333346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.333346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.333349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.333355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.333358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.333360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.333362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.333364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.333366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.333367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.333369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.333373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.333374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.333376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.333380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.333384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.333388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.333391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.333393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.333396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.333398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.333401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.333405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.333408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.333411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.333413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.333417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.333420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.333422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.333424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.333428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.333431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.333433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.333436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.333438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.333441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.333444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.333447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.333463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.337133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.337290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.337300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2246
2025-10-02T09:34:09.337373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.337395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.337399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.337401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.337724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2246 sessionId:  describe result for acl check
2025-10-02T09:34:09.337753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.337759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.337760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.337764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209930086:5873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.338114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209930086:5873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.339928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209930086:5873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.340869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.341891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209930086:5873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.341901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209930086:5873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.341903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209930086:5873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.341907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.342384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.342395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.342396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.342401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.342405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2245 [2:7556555364134361581:2365]
2025-10-02T09:34:09.342412Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.342421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.342426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.342428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.342429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.342439Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.342445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.342449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.342479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.342483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.342484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.342486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.342487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.342522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.342525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.342531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.342536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.342545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.342558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930121:5873], now have 1 active actors on pipe
2025-10-02T09:34:09.342563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930038:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.342566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.342567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.342568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.342577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.342586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.342589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.342591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.342592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.342606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.342608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.342587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2245
2025-10-02T09:34:09.342622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.342627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.342629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.342619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2245
2025-10-02T09:34:09.342640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.342643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.342694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.342701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.342703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.342704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.342709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.342714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.342727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.342825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.342831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.342841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.342905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2246 partition: 0 MaxSeqNo: 36 sessionId: src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0
2025-10-02T09:34:09.343115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a035df34-14e73757-512bd442-3990fbdd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.345748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Write session: try to update token
2025-10-02T09:34:09.345762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.351731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.351740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.351743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.351744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.351748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.351750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.351752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361576:2365]
2025-10-02T09:34:09.351772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.351774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.351777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.351777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.351779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.351780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.351893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.357917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId: src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.360162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.426493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209930129:6658]
2025-10-02T09:34:09.426713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2245, pipe: [1:7556555364209930129:6658]
2025-10-02T09:34:09.459494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.459759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.459768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.459780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930129:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.459945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.459965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:09.459975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:09.459975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209930129:6658]
2025-10-02T09:34:09.459998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.460024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2246 reason: error at write: Disconnected sessionId: src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0
2025-10-02T09:34:09.460150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2246 sessionId: src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0 is DEAD
2025-10-02T09:34:09.460302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:09.460314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Write session will restart in 0.006755s
2025-10-02T09:34:09.460338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Write session: Do CDS request
2025-10-02T09:34:09.460343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.464700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.465725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.465837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.465844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.465849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.465879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.465902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361663:2363]
2025-10-02T09:34:09.466243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.466405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.466427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.466612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.466641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.466645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.466646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.466646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.466647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.466647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.466648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.466649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.466649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.466650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.466650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.466651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.466654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.466660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.466662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.466664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.466668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.466670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.466672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.466674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.466676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.466678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.466680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.466682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.466686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.466690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.466693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.466696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.466698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.466701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.466703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.466706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.466708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.466711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.466713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.466715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.466720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.466722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.466725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.466728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.466729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.466732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.466734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.466737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.466741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.466744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.466747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.466750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.466767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.468165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.468256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.468266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2247
2025-10-02T09:34:09.468373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.468396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.468404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.468407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.468706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2247 sessionId:  describe result for acl check
2025-10-02T09:34:09.468733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.468739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.468740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.468743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209930179:5866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.469104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209930179:5866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.470498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209930179:5866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.473619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209930179:5866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.473629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209930179:5866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.473631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209930179:5866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.473635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.474208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.475689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.475699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.475701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.475703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.475707Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2246 [2:7556555364134361663:2363]
2025-10-02T09:34:09.475713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.475724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.475728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.475730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.475731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.475740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.475743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.475749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.475779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.475783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.475784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.475786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.475787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.475822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.475826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.475833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.475840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.475851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.475865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930213:5866], now have 1 active actors on pipe
2025-10-02T09:34:09.475870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930130:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.475874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.475875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.475876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.475884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.475894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.475897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.475899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.475900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.475902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.475904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.475918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.475923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.475913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2246
2025-10-02T09:34:09.475935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2246
2025-10-02T09:34:09.475937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.475943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.475945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.475962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.475969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.475972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.475973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.475978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.475986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.475993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.476107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.476113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.476123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.476203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2247 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0
2025-10-02T09:34:09.476385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa1aba5-971296e7-e03b749f-6c5d0042_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.478999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Write session: try to update token
2025-10-02T09:34:09.479013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.484969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.484978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.484979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.484982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.484986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.484990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.484992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361658:2363]
2025-10-02T09:34:09.485010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.485013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.485014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.485019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.485021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.485024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.485128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.490928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId: src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.493156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.560135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209930222:6658]
2025-10-02T09:34:09.560378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2246, pipe: [1:7556555364209930222:6658]
2025-10-02T09:34:09.597624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.597917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.597926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.597939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930222:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.598157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.598151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:09.598161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:09.598163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209930222:6658]
2025-10-02T09:34:09.598190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.598217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2247 reason: error at write: Disconnected sessionId: src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0
2025-10-02T09:34:09.598343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2247 sessionId: src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0 is DEAD
2025-10-02T09:34:09.598498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:09.598510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Write session will restart in 0.009644s
2025-10-02T09:34:09.598530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Write session: Do CDS request
2025-10-02T09:34:09.598536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.603326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.604182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.604279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.604286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.604292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.604318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.604342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361746:2359]
2025-10-02T09:34:09.604686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.604861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.604883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.605055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.605084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.605087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.605088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.605088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.605089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.605089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.605090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.605091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.605091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.605091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.605092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.605092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.605095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.605102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.605104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.605106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.605108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.605110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.605112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.605114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.605117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.605119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.605121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.605123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.605127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.605130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.605134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.605137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.605140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.605142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.605144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.605148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.605150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.605153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.605155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.605157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.605161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.605167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.605169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.605172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.605175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.605178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.605180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.605184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.605189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.605192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.605194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.605196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.605216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.609189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.609278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.609288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2248
2025-10-02T09:34:09.609400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.609423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.609431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.609434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.609797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2248 sessionId:  describe result for acl check
2025-10-02T09:34:09.609829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.609834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.609835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.609840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209930274:5851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.610288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209930274:5851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.611867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209930274:5851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.612645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.613773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209930274:5851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.613785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209930274:5851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.613788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209930274:5851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.613792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.614213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.614226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.614227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.614230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.614234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2247 [2:7556555364134361746:2359]
2025-10-02T09:34:09.614241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.614251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.614256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.614258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.614259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.614269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.614272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.614276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.614306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.614311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.614312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.614314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.614316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.614354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.614358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.614365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.614370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.614380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.614396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930223:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.614401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930308:5851], now have 1 active actors on pipe
2025-10-02T09:34:09.614405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.614406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.614408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.614415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.614426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.614429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.614430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.614432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.614435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.614436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.614429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2247
2025-10-02T09:34:09.614432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2247
2025-10-02T09:34:09.614452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.614456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.614458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.614469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.614474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.614499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e139e90c-b1485f70-a925ed8b-39d01133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.614505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.614507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.614508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.614513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.614519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.614527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.614645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.614651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.614661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.614726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2248 partition: 0 MaxSeqNo: 36 sessionId: src_id|e139e90c-b1485f70-a925ed8b-39d01133_0
2025-10-02T09:34:09.614915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebf8e7f-a08f6b42-2b05a225-20361713_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e139e90c-b1485f70-a925ed8b-39d01133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.617526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Write session: try to update token
2025-10-02T09:34:09.617540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.623680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.623691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.623692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.623693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.623696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.623699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.623703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361741:2359]
2025-10-02T09:34:09.623722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.623724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.623725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.623725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.623727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.623730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.623845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.629648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId: src_id|e139e90c-b1485f70-a925ed8b-39d01133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.631847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.698344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209930317:6658]
2025-10-02T09:34:09.698561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2247, pipe: [1:7556555364209930317:6658]
2025-10-02T09:34:09.733405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.733758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.733768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.733784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930317:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.733946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.734030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209930317:6658]
2025-10-02T09:34:09.734030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.734076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:09.734080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:09.734151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2248 reason: error at write: Disconnected sessionId: src_id|e139e90c-b1485f70-a925ed8b-39d01133_0
2025-10-02T09:34:09.734323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2248 sessionId: src_id|e139e90c-b1485f70-a925ed8b-39d01133_0 is DEAD
2025-10-02T09:34:09.734469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:09.734481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Write session will restart in 0.007689s
2025-10-02T09:34:09.734503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Write session: Do CDS request
2025-10-02T09:34:09.734510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.738774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.739642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.739747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.739758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.739764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.739790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.739816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361833:2354]
2025-10-02T09:34:09.740230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.740420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.740446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.740630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.740656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.740660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.740660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.740661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.740662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.740662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.740663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.740663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.740664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.740665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.740665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.740666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.740669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.740676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.740678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.740680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.740684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.740686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.740688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.740690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.740692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.740694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.740696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.740698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.740702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.740705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.740709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.740711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.740713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.740716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.740718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.740721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.740723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.740726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.740728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.740731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.740734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.740736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.740738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.740741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.740743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.740746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.740750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.740752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.740755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.740757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.740759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.740762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.740780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.743156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.743232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.743241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2249
2025-10-02T09:34:09.743326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.743347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.743355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.743358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.743707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2249 sessionId:  describe result for acl check
2025-10-02T09:34:09.743736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.743741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.743742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.743746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209930372:5841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.744167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209930372:5841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.745969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209930372:5841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.747947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209930372:5841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.747955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209930372:5841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.747958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209930372:5841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.747962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.748408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.749918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.749929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.749930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.749933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.749937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2248 [2:7556555364134361833:2354]
2025-10-02T09:34:09.749947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.749958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.749964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.749966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.749967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.749978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.749980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.749987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.750025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.750030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.750031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.750033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.750035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.750075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.750080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.750087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.750092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.750102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.750117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930406:5841], now have 1 active actors on pipe
2025-10-02T09:34:09.750122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930319:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.750126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.750127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.750128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.750135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.750146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.750153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.750155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.750157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.750153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2248
2025-10-02T09:34:09.750158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.750159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.750155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2248
2025-10-02T09:34:09.750176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.750179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.750181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.750190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.750193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.750221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b472439-2842aa10-1e91c90b-b6738b01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.750230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.750233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.750236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.750240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.750246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.750259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.750376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.750380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.750388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.750451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2249 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b472439-2842aa10-1e91c90b-b6738b01_0
2025-10-02T09:34:09.750643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e139e90c-b1485f70-a925ed8b-39d01133_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b472439-2842aa10-1e91c90b-b6738b01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.753163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Write session: try to update token
2025-10-02T09:34:09.753174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.759357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.759368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.759369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.759370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.759373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.759375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.759377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361828:2354]
2025-10-02T09:34:09.759397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.759400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.759401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.759406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.759414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.759416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.759523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.765379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId: src_id|4b472439-2842aa10-1e91c90b-b6738b01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.767575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.834039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209930414:6658]
2025-10-02T09:34:09.834200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2248, pipe: [1:7556555364209930414:6658]
2025-10-02T09:34:09.869689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:09.869882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.869891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.869903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930414:6658], now have 1 active actors on pipe
2025-10-02T09:34:09.870009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:09.870039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209930414:6658]
2025-10-02T09:34:09.870066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:09.870094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:09.870175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2249 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b472439-2842aa10-1e91c90b-b6738b01_0
2025-10-02T09:34:09.870319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2249 sessionId: src_id|4b472439-2842aa10-1e91c90b-b6738b01_0 is DEAD
2025-10-02T09:34:09.870455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:09.870467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Write session will restart in 0.006866s
2025-10-02T09:34:09.870489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Write session: Do CDS request
2025-10-02T09:34:09.870494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:09.874578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:09.875426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:09.875527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:09.875534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:09.875540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:09.875566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:09.875589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555364134361955:2327]
2025-10-02T09:34:09.875930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:09.876090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:09.876113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:09.876288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:09.876314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.876319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.876319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.876320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.876321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.876321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.876322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.876322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.876323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.876324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.876324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.876325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.876327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.876333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.876336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.876338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.876341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.876343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.876346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.876347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.876349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.876352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.876354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.876356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.876359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.876363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:09.876366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.876369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:09.876373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.876376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:09.876378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.876381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:09.876383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.876390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:09.876392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.876394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:09.876397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.876400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:09.876402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.876405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:09.876407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.876410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:09.876411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.876414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.876417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.876419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.876423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.876426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.876443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:09.878118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.878231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:09.878242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2250
2025-10-02T09:34:09.878329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:09.878350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:09.878358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:09.878361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:09.878705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2250 sessionId:  describe result for acl check
2025-10-02T09:34:09.878731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:09.878736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:09.878738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:09.878742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555364209930500:5804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:09.879133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555364209930500:5804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:09.880522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555364209930500:5804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:09.883740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555364209930500:5804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:09.883750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555364209930500:5804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:09.883752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555364209930500:5804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:09.883757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:09.883987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:09.885493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:09.885504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:09.885506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:09.885508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:09.885512Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2249 [2:7556555364134361955:2327]
2025-10-02T09:34:09.885519Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:09.885529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:09.885534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.885536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.885537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.885546Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:09.885549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:09.885553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:09.885581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.885585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.885586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.885588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:09.885589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:09.885623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:09.885628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.885635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:09.885640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:09.885651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:09.885663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930531:5804], now have 1 active actors on pipe
2025-10-02T09:34:09.885666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930438:2446], now have 1 active actors on pipe
2025-10-02T09:34:09.885670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.885671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.885672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.885680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:09.885687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:09.885695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:09.885697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:09.885698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:09.885699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:09.885700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:09.885713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.885718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:09.885724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:09.885706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2249
2025-10-02T09:34:09.885723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2249
2025-10-02T09:34:09.885735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.885740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.885757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:09.885764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:09.885766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:09.885767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:09.885772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:09.885779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:09.885787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.885903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:09.885911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:09.885921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:09.885987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2250 partition: 0 MaxSeqNo: 36 sessionId: src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0
2025-10-02T09:34:09.886185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b472439-2842aa10-1e91c90b-b6738b01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:09.888748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Write session: try to update token
2025-10-02T09:34:09.888760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:09.894832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:09.894842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:09.894843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:09.894844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:09.894848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.894852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.894854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555364134361950:2327]
2025-10-02T09:34:09.894872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:09.894878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:09.894878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:09.894879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:09.894880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:09.894883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:09.894992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:09.900946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId: src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:09.903240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:09.970243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555364209930541:6658]
2025-10-02T09:34:09.970398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2249, pipe: [1:7556555364209930541:6658]
2025-10-02T09:34:10.004935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.005183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.005192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.005205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555364209930541:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.005329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.005401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:10.005406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555364209930541:6658]
2025-10-02T09:34:10.005421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.005496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2250 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0
2025-10-02T09:34:10.005656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2250 sessionId: src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0 is DEAD
2025-10-02T09:34:10.005795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:10.005806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Write session will restart in 0.008679s
2025-10-02T09:34:10.005827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Write session: Do CDS request
2025-10-02T09:34:10.005833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.010119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.011180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.011278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.011284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.011290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.011315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.011341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329349:2321]
2025-10-02T09:34:10.011688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.011859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.011881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.012054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.012083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.012086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.012087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.012088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.012088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.012089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.012090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.012090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.012091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.012091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.012092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.012093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.012096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.012102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.012106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.012108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.012110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.012112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.012114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.012116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.012118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.012120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.012122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.012124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.012128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.012132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.012136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.012139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.012141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.012144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.012146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.012149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.012151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.012153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.012156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.012159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.012161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.012164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.012166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.012168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.012171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.012173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.012175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.012178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.012180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.012183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.012189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.012191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.012209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.015165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.015258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.015268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2251
2025-10-02T09:34:10.015374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.015398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.015406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.015409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.015753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2251 sessionId:  describe result for acl check
2025-10-02T09:34:10.015778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.015784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.015785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.015790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504897892:5789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.016233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504897892:5789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.017846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504897892:5789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.019693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.019723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504897892:5789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.019734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504897892:5789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.019735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504897892:5789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.019740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.021250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.021261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.021262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.021264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.021268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2250 [2:7556555368429329349:2321]
2025-10-02T09:34:10.021274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.021284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.021286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.021287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.021289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.021298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.021305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.021309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.021340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.021344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.021346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.021347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.021349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.021422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.021427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.021433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.021440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.021450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.021445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2250
2025-10-02T09:34:10.021465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2250
2025-10-02T09:34:10.021465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504897838:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.021470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504897927:5789], now have 1 active actors on pipe
2025-10-02T09:34:10.021475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.021477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.021478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.021483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.021488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.021490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.021491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.021492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.021500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.021504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.021518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.021523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.021540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.021548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.021557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.021558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.021562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.021564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.021565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.021570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.021575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.021590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.021693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.021698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.021707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.021766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2251 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0
2025-10-02T09:34:10.021977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad3888c9-ada441f8-92d415d4-e6d8dd83_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.024580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Write session: try to update token
2025-10-02T09:34:10.024593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.030785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.030796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.030797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.030799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.030806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.030808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.030810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329344:2321]
2025-10-02T09:34:10.030830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.030832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.030834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.030838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.030842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.030844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.030975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.035142Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:34:10.037253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId: src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.039521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.105398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504897946:6658]
2025-10-02T09:34:10.105633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2250, pipe: [1:7556555368504897946:6658]
2025-10-02T09:34:10.140336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.140579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.140588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.140599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504897946:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.140747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.140763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.140788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504897946:6658]
2025-10-02T09:34:10.140814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:10.140868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2251 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0
2025-10-02T09:34:10.140999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2251 sessionId: src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0 is DEAD
2025-10-02T09:34:10.141148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:10.141155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Write session will restart in 0.006183s
2025-10-02T09:34:10.141176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Write session: Do CDS request
2025-10-02T09:34:10.141181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.146194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.147216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.147317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.147323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.147329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.147356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.147379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329438:2303]
2025-10-02T09:34:10.147989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.148129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.148164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.148186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.148252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.148263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2252
2025-10-02T09:34:10.148358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.148383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.148390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.148397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.148458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.148486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.148490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.148491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.148491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.148492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.148493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.148493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.148494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.148494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.148495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.148495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.148496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.148499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.148506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.148508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.148510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.148512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.148514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.148516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.148518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.148520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.148522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.148526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.148528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.148532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.148536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.148539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.148542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.148545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.148547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.148550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.148552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.148555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.148558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.148560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.148563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.148565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.148568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.148571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.148574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.148576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.148579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.148581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.148584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.148586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.148589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.148593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.148596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.148614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.148755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2252 sessionId:  describe result for acl check
2025-10-02T09:34:10.148786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.148793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.148794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.148813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898001:5779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.149236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898001:5779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.150908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898001:5779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.154993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898001:5779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.155002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898001:5779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.155004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898001:5779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.155009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.156087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.157689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.157699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.157701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.157703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.157706Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2251 [2:7556555368429329438:2303]
2025-10-02T09:34:10.157713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.157722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.157723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.157725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.157725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.157735Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.157741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.157746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.157778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.157783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.157784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.157785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.157788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.157825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.157829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.157836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.157842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.157850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.157863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504897947:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.157868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898036:5779], now have 1 active actors on pipe
2025-10-02T09:34:10.157873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.157874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.157875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.157884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.157894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.157898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.157901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.157902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.157903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.157904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.157895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2251
2025-10-02T09:34:10.157901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2251
2025-10-02T09:34:10.157920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.157925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.157927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.157937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.157942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.157967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.157975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.157977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.157978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.157982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.157988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.158000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.158116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.158121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.158128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.158195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2252 partition: 0 MaxSeqNo: 36 sessionId: src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0
2025-10-02T09:34:10.158409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f5a322-8d5ed78c-3d146a3c-9281dcdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.161037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Write session: try to update token
2025-10-02T09:34:10.161051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.167034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.167043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.167045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.167045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.167049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.167052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.167054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329433:2303]
2025-10-02T09:34:10.167074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.167077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.167078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.167080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.167083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.167085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.167206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.173007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId: src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.175211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.241062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504898044:6658]
2025-10-02T09:34:10.241257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2251, pipe: [1:7556555368504898044:6658]
2025-10-02T09:34:10.275960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.276232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.276241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.276253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898044:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.276368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.276407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:10.276416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:10.276416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504898044:6658]
2025-10-02T09:34:10.276437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.276461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2252 reason: error at write: Disconnected sessionId: src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0
2025-10-02T09:34:10.276589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2252 sessionId: src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0 is DEAD
2025-10-02T09:34:10.276748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:10.276760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Write session will restart in 0.006515s
2025-10-02T09:34:10.276784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Write session: Do CDS request
2025-10-02T09:34:10.276790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.281411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.282448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.282548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.282555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.282560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.282586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.282619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329526:2294]
2025-10-02T09:34:10.282962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.283136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.283160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.283337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.283391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.283395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.283396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.283396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.283397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.283397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.283398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.283398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.283399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.283399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.283400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.283400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.283403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.283410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.283412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.283414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.283416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.283418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.283420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.283422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.283426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.283428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.283430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.283435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.283439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.283442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.283445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.283447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.283451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.283454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.283456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.283458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.283461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.283463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.283465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.283467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.283469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.283472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.283475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.283477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.283479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.283481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.283483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.283486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.283489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.283492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.283495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.283510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.284193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.284337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.284353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2253
2025-10-02T09:34:10.284454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.284481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.284490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.284499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.284875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2253 sessionId:  describe result for acl check
2025-10-02T09:34:10.284905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.284912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.284914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.284918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898102:5744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.285382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898102:5744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.287124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898102:5744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.290449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898102:5744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.290457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898102:5744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.290459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898102:5744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.290464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.290915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.292445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.292455Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.292457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.292459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.292462Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2252 [2:7556555368429329526:2294]
2025-10-02T09:34:10.292469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.292478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.292480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.292481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.292483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.292493Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.292499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.292503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.292534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.292539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.292540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.292543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.292544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.292579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.292584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.292590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.292595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.292603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.292616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898137:5744], now have 1 active actors on pipe
2025-10-02T09:34:10.292622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898047:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.292626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.292627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.292628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.292635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.292643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.292651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.292653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.292654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.292641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2252
2025-10-02T09:34:10.292653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2252
2025-10-02T09:34:10.292656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.292658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.292677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.292682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.292690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.292697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.292710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.292713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.292717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.292719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.292720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.292725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.292731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.292745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.292866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.292872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.292879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.292953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2253 partition: 0 MaxSeqNo: 36 sessionId: src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0
2025-10-02T09:34:10.293162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|138b6390-4b4c640f-1a9d8343-e844cbfc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.295802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Write session: try to update token
2025-10-02T09:34:10.295815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.301889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.301899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.301900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.301901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.301904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.301907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.301908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329521:2294]
2025-10-02T09:34:10.301928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.301931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.301932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.301935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.301939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.301942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.302036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.309252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId: src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.311574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.376771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504898145:6658]
2025-10-02T09:34:10.376959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2252, pipe: [1:7556555368504898145:6658]
2025-10-02T09:34:10.410130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.410361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.410371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.410385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898145:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.410508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.410545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.410572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:10.410584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504898145:6658]
2025-10-02T09:34:10.410586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:10.410673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2253 reason: error at write: Disconnected sessionId: src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0
2025-10-02T09:34:10.410854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2253 sessionId: src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0 is DEAD
2025-10-02T09:34:10.410983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:10.410992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Write session will restart in 0.009061s
2025-10-02T09:34:10.411006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Write session: Do CDS request
2025-10-02T09:34:10.411011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.415691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.416558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.416657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.416664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.416669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.416727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.416751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329618:2291]
2025-10-02T09:34:10.417126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.417299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.417322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.417497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.417527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.417532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.417533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.417533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.417534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.417534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.417535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.417535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.417536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.417536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.417539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.417546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.417548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.417550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.417552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.417554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.417556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.417558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.417560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.417562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.417564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.417566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.417571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.417575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.417579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.417581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.417583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.417586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.417588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.417591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.417594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.417597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.417598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.417601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.417603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.417606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.417608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.417610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.417612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.417615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.417617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.417619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.417621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.417624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.417627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.417630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.417647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.421231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.421403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.421416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2254
2025-10-02T09:34:10.421537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.421568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.421576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.421580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.421966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2254 sessionId:  describe result for acl check
2025-10-02T09:34:10.421998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.422004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.422005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.422008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898202:5736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.422375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898202:5736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.423909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898202:5736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.425056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.425781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898202:5736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.425791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898202:5736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.425793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898202:5736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.425798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.426540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.426550Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.426552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.426554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.426557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2253 [2:7556555368429329618:2291]
2025-10-02T09:34:10.426565Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.426575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.426580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.426582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.426583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.426592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.426605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.426613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.426642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.426647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.426648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.426650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.426651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.426687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.426692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.426698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.426704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.426712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.426726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898237:5736], now have 1 active actors on pipe
2025-10-02T09:34:10.426731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898146:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.426734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.426735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.426736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.426744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.426754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.426755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.426757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.426758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.426764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.426766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.426756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2253
2025-10-02T09:34:10.426765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2253
2025-10-02T09:34:10.426779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.426784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.426785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.426796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.426801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.426826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.426833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.426835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.426836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.426842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.426849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.426857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.426973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.426979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.426991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.427063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2254 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0
2025-10-02T09:34:10.427329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6675035-4d1ea956-9a10ad87-79afb8c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.429997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Write session: try to update token
2025-10-02T09:34:10.430009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.436410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.436427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.436432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.436435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.436444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.436448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.436450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329613:2291]
2025-10-02T09:34:10.436479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.436481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.436485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.436487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.436489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.436490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.436641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.442470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId: src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.444941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.510915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504898244:6658]
2025-10-02T09:34:10.511088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2253, pipe: [1:7556555368504898244:6658]
2025-10-02T09:34:10.546101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.546343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.546353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.546365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898244:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.546523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.546572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.546578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:10.546630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504898244:6658]
2025-10-02T09:34:10.546644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2254 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0
2025-10-02T09:34:10.546782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2254 sessionId: src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0 is DEAD
2025-10-02T09:34:10.547144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:10.547156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Write session will restart in 0.005653s
2025-10-02T09:34:10.547172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Write session: Do CDS request
2025-10-02T09:34:10.547177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.552295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.553207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.553301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.553308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.553313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.553337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.553362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329709:2297]
2025-10-02T09:34:10.553702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.553868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.553889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.554081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.554118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.554123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.554123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.554124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.554136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.554125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.554126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.554126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.554127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.554127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.554128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.554128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.554129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.554132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.554138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.554141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.554143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.554145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.554147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.554149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.554151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.554153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.554155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.554157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.554159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.554164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.554168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.554172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.554175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.554179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.554182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.554186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.554191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.554195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.554200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.554204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.554209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.554212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.554217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.554219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.554222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.554224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.554227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.554229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.554231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.554234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.554236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.554239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.554242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.554229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.554239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2255
2025-10-02T09:34:10.554258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.554367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.554391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.554399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.554403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.554769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2255 sessionId:  describe result for acl check
2025-10-02T09:34:10.554799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.554805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.554806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.554810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898303:5720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.555272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898303:5720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.556986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898303:5720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.561172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898303:5720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.561182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898303:5720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.561184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898303:5720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.561189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.561713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.563242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.563252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.563254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.563256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.563259Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2254 [2:7556555368429329709:2297]
2025-10-02T09:34:10.563269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.563278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.563283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.563285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.563286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.563296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.563299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.563304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.563335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.563340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.563342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.563344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.563345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.563379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.563385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.563391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.563397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.563409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.563421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898338:5720], now have 1 active actors on pipe
2025-10-02T09:34:10.563427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898246:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.563430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.563432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.563433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.563442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.563454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.563454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.563456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.563457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.563464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.563466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.563454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2254
2025-10-02T09:34:10.563471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2254
2025-10-02T09:34:10.563481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.563486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.563487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.563497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.563502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.563527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.563534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.563538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.563539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.563544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.563550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.563559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.563653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.563658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.563665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.563728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2255 partition: 0 MaxSeqNo: 36 sessionId: src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0
2025-10-02T09:34:10.564000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e5e8be-88891c57-dbae8bde-9255b08e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.566554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Write session: try to update token
2025-10-02T09:34:10.566565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.573112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.573129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.573133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.573135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.573142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.573146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.573151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329704:2297]
2025-10-02T09:34:10.573174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.573181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.573183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.573185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.573185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.573188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.573359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.578660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId: src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.581131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.646622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504898345:6658]
2025-10-02T09:34:10.646814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2254, pipe: [1:7556555368504898345:6658]
2025-10-02T09:34:10.684729Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.685037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.685047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.685059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898345:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.685180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.685254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:10.685259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504898345:6658]
2025-10-02T09:34:10.685282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.685321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2255 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0
2025-10-02T09:34:10.685475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2255 sessionId: src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0 is DEAD
2025-10-02T09:34:10.685610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:10.685621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Write session will restart in 0.008341s
2025-10-02T09:34:10.685641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Write session: Do CDS request
2025-10-02T09:34:10.685645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.690189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.691211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.691357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.691363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.691370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.691398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.691421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329801:8893]
2025-10-02T09:34:10.691777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.691959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.691987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.692183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.692215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.692219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.692220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.692220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.692221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.692221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.692222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.692222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.692223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.692223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.692224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.692225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.692227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.692234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.692236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.692238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.692240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.692242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.692244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.692246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.692248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.692250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.692252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.692254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.692258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.692262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.692265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.692268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.692271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.692274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.692276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.692278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.692280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.692283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.692285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.692288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.692291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.692294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.692296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.692298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.692302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.692304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.692307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.692309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.692313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.692316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.692318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.692321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.692337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.695154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.695261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.695271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2256
2025-10-02T09:34:10.695398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.695423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.695431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.695433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.695796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2256 sessionId:  describe result for acl check
2025-10-02T09:34:10.695825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.695830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.695833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.695836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898405:5713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.696279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898405:5713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.697821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898405:5713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.699734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898405:5713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.699746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898405:5713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.699749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898405:5713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.699778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.699849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.701391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.701403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.701406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.701408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.701412Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2255 [2:7556555368429329801:8893]
2025-10-02T09:34:10.701419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.701429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.701435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.701436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.701437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.701448Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.701453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.701457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.701491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.701495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.701498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.701499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.701501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.701539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.701544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.701551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.701557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.701565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.701577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898347:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.701583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898439:5713], now have 1 active actors on pipe
2025-10-02T09:34:10.701587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.701588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.701589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.701598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.701609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.701611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.701615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.701616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.701623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.701625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.701645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.701656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.701648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2255
2025-10-02T09:34:10.701650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2255
2025-10-02T09:34:10.701672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.701680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.701683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.701703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.701712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.701714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.701719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.701724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.701730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.701740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.701873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.701880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.701888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.701952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2256 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0
2025-10-02T09:34:10.702214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a82fb3e8-9630e608-417835d5-bc6bad13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.704671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Write session: try to update token
2025-10-02T09:34:10.704681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.710859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.710872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.710873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.710874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.710878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.710881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.710884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329796:8893]
2025-10-02T09:34:10.710905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.710909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.710912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.710913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.710914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.710914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.711025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.716480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId: src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.718911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.785333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504898447:6658]
2025-10-02T09:34:10.785559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2255, pipe: [1:7556555368504898447:6658]
2025-10-02T09:34:10.821255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.821528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.821536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.821549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898447:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.821704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.821723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.821743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504898447:6658]
2025-10-02T09:34:10.821766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:10.821829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2256 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0
2025-10-02T09:34:10.821995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2256 sessionId: src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0 is DEAD
2025-10-02T09:34:10.822138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:10.822149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Write session will restart in 0.007816s
2025-10-02T09:34:10.822164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Write session: Do CDS request
2025-10-02T09:34:10.822168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.827136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.827952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.828049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.828056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.828062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.828088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.828110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429329907:8891]
2025-10-02T09:34:10.828557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.828720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.828744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.828932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.828964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.828968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.828968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.828969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.828970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.828970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.828971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.828971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.828972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.828973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.828973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.828974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.828977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.828983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.828985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.828988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.828990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.828992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.828994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.828996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.828999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.829002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.829004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.829005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.829009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.829013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.829016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.829019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.829022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.829025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.829027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.829029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.829032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.829035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.829037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.829040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.829042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.829045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.829047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.829053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.829055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.829058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.829063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.829065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.829068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.829070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.829076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.829079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.829095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.831199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.831317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.831328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2257
2025-10-02T09:34:10.831456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.831480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.831488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.831491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.831871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2257 sessionId:  describe result for acl check
2025-10-02T09:34:10.831910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.831918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.831920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.831924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898507:5698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.832359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898507:5698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.834162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898507:5698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.835987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898507:5698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.836003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898507:5698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.836006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898507:5698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.836010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.836435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.837863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.837874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.837877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.837880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.837884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2256 [2:7556555368429329907:8891]
2025-10-02T09:34:10.837895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.837906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.837913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.837915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.837917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.837925Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.837929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.837933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.837971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.837975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.837976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.837978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.837979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.838016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.838021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.838027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.838033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.838044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.838059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898448:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.838064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898541:5698], now have 1 active actors on pipe
2025-10-02T09:34:10.838067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.838068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.838069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.838077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.838089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.838090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.838092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.838093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.838100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.838101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.838091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2256
2025-10-02T09:34:10.838101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2256
2025-10-02T09:34:10.838115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.838120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.838121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.838170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.838175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.838202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.838209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.838213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.838217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.838221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.838230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.838242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.838346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.838350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.838357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.838422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2257 partition: 0 MaxSeqNo: 36 sessionId: src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0
2025-10-02T09:34:10.838676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5fd9f8-fca1f2c2-d3fda58a-330ec1f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.841140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Write session: try to update token
2025-10-02T09:34:10.841151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.847380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.847392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.847393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.847394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.847399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.847401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.847404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429329901:8891]
2025-10-02T09:34:10.847431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.847435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.847437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.847467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.847481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.847484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.847546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.852494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId: src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.854931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:10.922049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555368504898577:6658]
2025-10-02T09:34:10.922222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2256, pipe: [1:7556555368504898577:6658]
2025-10-02T09:34:10.957527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:10.957780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.957788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.957799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898577:6658], now have 1 active actors on pipe
2025-10-02T09:34:10.957970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:10.957955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555368504898577:6658]
2025-10-02T09:34:10.957973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:10.957988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:10.957991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:10.958042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2257 reason: error at write: Disconnected sessionId: src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0
2025-10-02T09:34:10.958192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2257 sessionId: src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0 is DEAD
2025-10-02T09:34:10.958312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:10.958331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Write session will restart in 0.008458s
2025-10-02T09:34:10.958347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Write session: Do CDS request
2025-10-02T09:34:10.958351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:10.963053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:10.963904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:10.964000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:10.964007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:10.964013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:10.964038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:10.964063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555368429330034:8868]
2025-10-02T09:34:10.964432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:10.964590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:10.964613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:10.964788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:10.964830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.964834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.964835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.964836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.964836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.964837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.964837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.964838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.964840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.964841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.964841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.964842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.964845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.964851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.964853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.964855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.964857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.964859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.964861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.964863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.964865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.964867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.964869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.964871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.964875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.964879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:10.964882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.964885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:10.964887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.964890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:10.964892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.964895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:10.964897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.964900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:10.964902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.964904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:10.964907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.964910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:10.964912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.964915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:10.964932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.964939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:10.964942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.964944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.964946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.964949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.964953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.964955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.964973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:10.968115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.968230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:10.968242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2258
2025-10-02T09:34:10.968979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:10.969006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:10.969014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:10.969018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:10.969336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2258 sessionId:  describe result for acl check
2025-10-02T09:34:10.969364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:10.969370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:10.969371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:10.969374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555368504898641:5644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:10.969695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555368504898641:5644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:10.971170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555368504898641:5644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:10.972377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:10.973470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555368504898641:5644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:10.973484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555368504898641:5644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:10.973487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555368504898641:5644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:10.973493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:10.973956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:10.973969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:10.973970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:10.973972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:10.973975Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2257 [2:7556555368429330034:8868]
2025-10-02T09:34:10.973983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:10.973993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:10.973994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.973996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.973997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.974006Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:10.974012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:10.974018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:10.974050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.974055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.974057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.974059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:10.974060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:10.974095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:10.974099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.974106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:10.974111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:10.974119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:10.974134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898581:2446], now have 1 active actors on pipe
2025-10-02T09:34:10.974141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555368504898675:5644], now have 1 active actors on pipe
2025-10-02T09:34:10.974145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.974147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.974149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.974160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:10.974171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:10.974173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:10.974173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2257
2025-10-02T09:34:10.974178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:10.974180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:10.974184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:10.974186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:10.974188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2257
2025-10-02T09:34:10.974204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.974210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:10.974212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:10.974222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.974229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.974256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de607422-cd9de71c-27018296-e7060eea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:10.974264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:10.974267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:10.974268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:10.974273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:10.974279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:10.974291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.974395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:10.974400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:10.974408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:10.974476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2258 partition: 0 MaxSeqNo: 36 sessionId: src_id|de607422-cd9de71c-27018296-e7060eea_0
2025-10-02T09:34:10.974729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b4c60b-71a69c50-7768fd51-9b5c9bed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de607422-cd9de71c-27018296-e7060eea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:10.977214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Write session: try to update token
2025-10-02T09:34:10.977225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:10.983433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:10.983446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:10.983447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:10.983448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:10.983453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.983455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.983458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555368429330029:8868]
2025-10-02T09:34:10.983477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:10.983480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:10.983481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:10.983524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:10.983537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:10.983542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:10.983594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:10.988333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId: src_id|de607422-cd9de71c-27018296-e7060eea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:10.990820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.058199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799865992:6658]
2025-10-02T09:34:11.058347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2257, pipe: [1:7556555372799865992:6658]
2025-10-02T09:34:11.093257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.093507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.093517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.093530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799865992:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.093712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799865992:6658]
2025-10-02T09:34:11.093722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.093746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:11.093749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:11.093825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2258 reason: error at write: Disconnected sessionId: src_id|de607422-cd9de71c-27018296-e7060eea_0
2025-10-02T09:34:11.093956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.093993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2258 sessionId: src_id|de607422-cd9de71c-27018296-e7060eea_0 is DEAD
2025-10-02T09:34:11.094131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:11.094141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Write session will restart in 0.005922s
2025-10-02T09:34:11.094158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Write session: Do CDS request
2025-10-02T09:34:11.094163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.098888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.099865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.100006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.100013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.100020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.100052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.100074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724297428:8870]
2025-10-02T09:34:11.100418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.100594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.100616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.100792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.100835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.100839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.100840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.100840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.100841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.100842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.100843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.100844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.100845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.100845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.100846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.100846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.100849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.100855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.100858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.100860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.100862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.100863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.100865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.100867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.100869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.100871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.100873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.100875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.100878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.100882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.100885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.100888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.100890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.100892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.100894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.100897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.100900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.100902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.100904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.100907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.100909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.100913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.100916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.100919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.100921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.100923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.100925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.100932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.100934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.100936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.100939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.100941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.100958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.101084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.101201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.101210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2259
2025-10-02T09:34:11.101325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.101349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.101356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.101359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.101672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2259 sessionId:  describe result for acl check
2025-10-02T09:34:11.101702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.101710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.101711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.101715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866054:5631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.102065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866054:5631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.103861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866054:5631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.107813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866054:5631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.107830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866054:5631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.107832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866054:5631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.107836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.108397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.109979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.109992Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.109993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.109995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.109999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2258 [2:7556555372724297428:8870]
2025-10-02T09:34:11.110008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.110018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.110021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.110023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.110025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.110034Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.110041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.110046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.110078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.110083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.110084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.110086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.110087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.110122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.110127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.110133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.110138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.110148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.110160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799865993:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.110165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866088:5631], now have 1 active actors on pipe
2025-10-02T09:34:11.110168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.110169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.110170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.110177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.110185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.110190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.110192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.110193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.110197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.110198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.110208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.110209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.110213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.110198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2258
2025-10-02T09:34:11.110220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2258
2025-10-02T09:34:11.110229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.110236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.110253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.110262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.110264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.110265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.110269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.110278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.110285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.110412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.110417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.110424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.110494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2259 partition: 0 MaxSeqNo: 36 sessionId: src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0
2025-10-02T09:34:11.110836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de607422-cd9de71c-27018296-e7060eea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.113392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Write session: try to update token
2025-10-02T09:34:11.113404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.119786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.119805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.119808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.119810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.119815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.119820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.119823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724297423:8870]
2025-10-02T09:34:11.119855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.119858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.119858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.119860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.119863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.119866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.120054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.125605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId: src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.128078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.193894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799866097:6658]
2025-10-02T09:34:11.194069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2258, pipe: [1:7556555372799866097:6658]
2025-10-02T09:34:11.228775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.229021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.229030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.229044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866097:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.229166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.229210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.229217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799866097:6658]
2025-10-02T09:34:11.229249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:11.229349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2259 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0
2025-10-02T09:34:11.229521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2259 sessionId: src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0 is DEAD
2025-10-02T09:34:11.229775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:11.229787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Write session will restart in 0.007722s
2025-10-02T09:34:11.229803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Write session: Do CDS request
2025-10-02T09:34:11.229807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.234561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.235542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.235639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.235646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.235651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.235675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.235699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724297524:8863]
2025-10-02T09:34:11.236107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.236275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.236297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.236470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.236499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.236503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.236504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.236504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.236505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.236505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.236506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.236506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.236507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.236507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.236508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.236508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.236511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.236518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.236520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.236522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.236524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.236526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.236528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.236530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.236532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.236534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.236536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.236538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.236541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.236545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.236551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.236553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.236556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.236558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.236560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.236563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.236564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.236567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.236569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.236572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.236575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.236577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.236579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.236582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.236587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.236589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.236591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.236594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.236599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.236602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.236604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.236606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.236622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.238176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.238287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.238298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2260
2025-10-02T09:34:11.238433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.238463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.238472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.238475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.238787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2260 sessionId:  describe result for acl check
2025-10-02T09:34:11.238817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.238824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.238826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.238829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866160:5620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.239189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866160:5620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.241043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866160:5620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.243460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866160:5620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.243469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866160:5620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.243473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866160:5620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.243479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.244015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.245567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.245578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.245579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.245581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.245585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2259 [2:7556555372724297524:8863]
2025-10-02T09:34:11.245593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.245603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.245608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.245610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.245611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.245620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.245623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.245626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.245657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.245662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.245663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.245664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.245666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.245701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.245706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.245712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.245717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.245725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.245739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866195:5620], now have 1 active actors on pipe
2025-10-02T09:34:11.245745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866098:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.245749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.245750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.245751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.245759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.245770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.245771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.245774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.245775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.245780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.245782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.245768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2259
2025-10-02T09:34:11.245796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.245801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.245802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.245812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.245817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.245825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2259
2025-10-02T09:34:11.245842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.245849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.245850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.245851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.245858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.245865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.245877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.245982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.245988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.245996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.246054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2260 partition: 0 MaxSeqNo: 36 sessionId: src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0
2025-10-02T09:34:11.246314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed25aac-11cf94f1-518cbba4-340fe2e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.248876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Write session: try to update token
2025-10-02T09:34:11.248887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.255516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.255535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.255537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.255539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.255548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.255552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.255557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724297519:8863]
2025-10-02T09:34:11.255584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.255586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.255588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.255594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.255600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.255604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.255749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.261080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId: src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.263546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.329581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799866204:6658]
2025-10-02T09:34:11.329744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2259, pipe: [1:7556555372799866204:6658]
2025-10-02T09:34:11.363291Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.363563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.363572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.363586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866204:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.363709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.363763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:11.363762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799866204:6658]
2025-10-02T09:34:11.363783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.363828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2260 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0
2025-10-02T09:34:11.363934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2260 sessionId: src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0 is DEAD
2025-10-02T09:34:11.364018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:11.364026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Write session will restart in 0.006260s
2025-10-02T09:34:11.364041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Write session: Do CDS request
2025-10-02T09:34:11.364045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.369242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.370149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.370252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.370259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.370264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.370290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.370313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724297623:8859]
2025-10-02T09:34:11.370955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.371162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.371155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.371187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.371290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.371299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2261
2025-10-02T09:34:11.371430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.371454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.371463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.371466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.371483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.371517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.371521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.371521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.371522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.371523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.371524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.371524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.371525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.371526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.371526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.371527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.371527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.371530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.371537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.371540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.371542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.371544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.371546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.371548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.371550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.371552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.371555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.371557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.371559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.371563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.371569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.371572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.371575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.371577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.371580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.371582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.371585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.371587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.371590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.371592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.371595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.371598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.371601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.371603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.371606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.371608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.371611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.371614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.371616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.371623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.371625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.371628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.371631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.371649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.371815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2261 sessionId:  describe result for acl check
2025-10-02T09:34:11.371841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.371848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.371849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.371852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866269:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.372232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866269:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.373622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866269:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.377811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866269:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.377820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866269:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.377822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866269:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.377825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.379043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.380515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.380526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.380527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.380529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.380533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2260 [2:7556555372724297623:8859]
2025-10-02T09:34:11.380540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.380550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.380556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.380558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.380559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.380568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.380572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.380578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.380608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.380612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.380613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.380615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.380616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.380652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.380657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.380664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.380669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.380677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.380691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866304:5616], now have 1 active actors on pipe
2025-10-02T09:34:11.380696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866206:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.380700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.380701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.380702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.380710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.380721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.380722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.380724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.380725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.380732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.380734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.380747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.380753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.380756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.380737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2260
2025-10-02T09:34:11.380752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2260
2025-10-02T09:34:11.380796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.380814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.380834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f619236-709f8002-612c4d09-cdcd9b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.380841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.380843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.380844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.380849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.380858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.380865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.380995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.381000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.381008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.381079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2261 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f619236-709f8002-612c4d09-cdcd9b4_0
2025-10-02T09:34:11.381364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f6bc3b-85857648-3ed16c4f-68b63386_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f619236-709f8002-612c4d09-cdcd9b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.383895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Write session: try to update token
2025-10-02T09:34:11.383905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.390214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.390233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.390235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.390237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.390243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.390248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.390253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724297618:8859]
2025-10-02T09:34:11.390281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.390287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.390291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.390292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.390295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.390294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.390444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.396134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId: src_id|8f619236-709f8002-612c4d09-cdcd9b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.398610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.463744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799866311:6658]
2025-10-02T09:34:11.463938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2260, pipe: [1:7556555372799866311:6658]
2025-10-02T09:34:11.498106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.498355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.498364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.498377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866311:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.498492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.498522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799866311:6658]
2025-10-02T09:34:11.498524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:11.498529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:11.498547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.498616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2261 reason: error at write: Disconnected sessionId: src_id|8f619236-709f8002-612c4d09-cdcd9b4_0
2025-10-02T09:34:11.498750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2261 sessionId: src_id|8f619236-709f8002-612c4d09-cdcd9b4_0 is DEAD
2025-10-02T09:34:11.499087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:11.499098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Write session will restart in 0.007663s
2025-10-02T09:34:11.499117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Write session: Do CDS request
2025-10-02T09:34:11.499122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.503943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.504853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.504961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.504968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.504974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.505002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.505025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724297721:8853]
2025-10-02T09:34:11.505399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.505582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.505606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.505781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.505811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.505814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.505815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.505816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.505816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.505817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.505817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.505818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.505818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.505819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.505819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.505820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.505822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.505829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.505831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.505833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.505835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.505837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.505839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.505841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.505843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.505845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.505847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.505849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.505853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.505857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.505860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.505863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.505867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.505869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.505871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.505874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.505876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.505879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.505881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.505883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.505885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.505888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.505890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.505893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.505895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.505897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.505899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.505902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.505904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.505907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.505909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.505913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.505930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.508101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.508203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.508214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2262
2025-10-02T09:34:11.508330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.508353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.508361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.508364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.508667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2262 sessionId:  describe result for acl check
2025-10-02T09:34:11.508693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.508699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.508700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.508704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866376:5600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.509063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866376:5600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.510832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866376:5600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.512741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866376:5600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.512750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866376:5600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.512752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866376:5600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.512756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.513336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.514968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.514979Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.514980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.514982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.514986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2261 [2:7556555372724297721:8853]
2025-10-02T09:34:11.514994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.515004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.515008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.515010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.515011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.515020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.515026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.515031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.515062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.515066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.515067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.515069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.515071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.515107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.515112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.515120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.515125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.515137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.515150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866312:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.515156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866410:5600], now have 1 active actors on pipe
2025-10-02T09:34:11.515159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.515161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.515162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.515170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.515180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.515183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.515185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.515186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.515192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.515193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.515180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2261
2025-10-02T09:34:11.515192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2261
2025-10-02T09:34:11.515208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.515213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.515215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.515223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.515229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.515255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10bbe274-747e24ac-974edc3-bee2d895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.515262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.515265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.515269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.515275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.515280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.515294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.515408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.515413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.515420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.515487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2262 partition: 0 MaxSeqNo: 36 sessionId: src_id|10bbe274-747e24ac-974edc3-bee2d895_0
2025-10-02T09:34:11.515720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619236-709f8002-612c4d09-cdcd9b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10bbe274-747e24ac-974edc3-bee2d895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.518291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Write session: try to update token
2025-10-02T09:34:11.518303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.525011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.525030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.525032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.525034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.525042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.525046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.525051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724297716:8853]
2025-10-02T09:34:11.525086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.525086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.525090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.525092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.525092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.525094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.525257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.531079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId: src_id|10bbe274-747e24ac-974edc3-bee2d895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.533573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.598893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799866425:6658]
2025-10-02T09:34:11.599124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2261, pipe: [1:7556555372799866425:6658]
2025-10-02T09:34:11.634261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.634493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.634505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.634519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866425:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.634684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:11.634690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.634694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:11.634733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2262 reason: error at write: Disconnected sessionId: src_id|10bbe274-747e24ac-974edc3-bee2d895_0
2025-10-02T09:34:11.634746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799866425:6658]
2025-10-02T09:34:11.634849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2262 sessionId: src_id|10bbe274-747e24ac-974edc3-bee2d895_0 is DEAD
2025-10-02T09:34:11.634945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:11.634953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Write session will restart in 0.007913s
2025-10-02T09:34:11.634968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Write session: Do CDS request
2025-10-02T09:34:11.634972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.635098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.639989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.640873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.641007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.641015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.641021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.641049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.641073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724297819:8851]
2025-10-02T09:34:11.641463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.641633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.641655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.641829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.641856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.641860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.641861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.641861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.641862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.641862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.641864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.641865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.641866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.641866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.641867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.641867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.641870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.641877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.641879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.641881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.641883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.641885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.641887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.641889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.641891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.641893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.641895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.641896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.641900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.641904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.641907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.641910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.641912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.641915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.641917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.641919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.641922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.641925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.641927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.641929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.641933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.641936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.641939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.641942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.641944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.641947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.641950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.641953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.641955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.641958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.641960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.641962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.641979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.644088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.644240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.644251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2263
2025-10-02T09:34:11.644390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.644416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.644421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.644429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.644743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2263 sessionId:  describe result for acl check
2025-10-02T09:34:11.644767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.644771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.644772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.644776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866491:5581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.645119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866491:5581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.646481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866491:5581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.648833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866491:5581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.648840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866491:5581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.648842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866491:5581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.648846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.649429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.650942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.650954Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.650955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.650957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.650960Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2262 [2:7556555372724297819:8851]
2025-10-02T09:34:11.650967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.650977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.650982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.650983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.650984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.650993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.650996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.651002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.651031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.651036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.651037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.651040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.651041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.651075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.651079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.651086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.651091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.651102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.651116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866525:5581], now have 1 active actors on pipe
2025-10-02T09:34:11.651122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866426:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.651125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.651127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.651128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.651135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.651144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.651148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.651150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.651151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.651154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.651156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.651158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2262
2025-10-02T09:34:11.651164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2262
2025-10-02T09:34:11.651169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.651174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.651185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.651196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.651198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.651213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.651220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.651224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.651225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.651230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.651236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.651262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.651387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.651392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.651400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.651465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2263 partition: 0 MaxSeqNo: 36 sessionId: src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0
2025-10-02T09:34:11.651729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bbe274-747e24ac-974edc3-bee2d895_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.654390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Write session: try to update token
2025-10-02T09:34:11.654406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.660195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.660206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.660208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.660208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.660212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.660214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.660216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724297814:8851]
2025-10-02T09:34:11.660236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.660238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.660241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.660242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.660242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.660243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.660357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.666444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId: src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.668649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.735100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799866534:6658]
2025-10-02T09:34:11.735348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2262, pipe: [1:7556555372799866534:6658]
2025-10-02T09:34:11.769780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.770052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.770060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.770072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866534:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.770246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.770261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799866534:6658]
2025-10-02T09:34:11.770283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:11.770291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:11.770349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2263 reason: error at write: Disconnected sessionId: src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0
2025-10-02T09:34:11.770478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2263 sessionId: src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0 is DEAD
2025-10-02T09:34:11.770696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:11.770707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Write session will restart in 0.007963s
2025-10-02T09:34:11.770727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Write session: Do CDS request
2025-10-02T09:34:11.770732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.770736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.776003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.776908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.777018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.777024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.777030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.777058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.777081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724297918:8848]
2025-10-02T09:34:11.777463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.777633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.777656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.777827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.777856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.777860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.777861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.777861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.777862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.777863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.777863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.777864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.777865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.777865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.777866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.777866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.777869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.777876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.777878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.777880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.777882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.777884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.777886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.777888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.777890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.777893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.777896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.777898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.777901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.777906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.777909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.777912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.777914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.777917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.777919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.777921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.777923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.777926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.777928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.777930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.777932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.777938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.777940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.777943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.777945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.777948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.777953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.777955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.777957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.777960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.777964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.777966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.777982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.780177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.780284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.780299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2264
2025-10-02T09:34:11.780420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.780447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.780456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.780459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.780769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2264 sessionId:  describe result for acl check
2025-10-02T09:34:11.780795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.780813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.780814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.780817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866601:5561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.781156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866601:5561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.782658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866601:5561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.784764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866601:5561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.784772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866601:5561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.784774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866601:5561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.784778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.785351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.786870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.786880Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.786881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.786883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.786888Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2263 [2:7556555372724297918:8848]
2025-10-02T09:34:11.786895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.786908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.786909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.786911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.786911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.786920Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.786923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.786928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.786958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.786962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.786963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.786965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.786967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.787003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.787008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.787014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.787019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.787030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.787044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866535:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.787049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866635:5561], now have 1 active actors on pipe
2025-10-02T09:34:11.787052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.787053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.787054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.787063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.787074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.787076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.787078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.787079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.787085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.787086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.787077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2263
2025-10-02T09:34:11.787086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2263
2025-10-02T09:34:11.787100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.787105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.787107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.787115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.787120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.787147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.787154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.787156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.787157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.787162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.787167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.787179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.787285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.787290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.787298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.787362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2264 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0
2025-10-02T09:34:11.787580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144ebc5d-e8b0a43b-b3d3a42f-4ea3df45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.790190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Write session: try to update token
2025-10-02T09:34:11.790205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.796157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.796168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.796169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.796170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.796173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.796175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.796177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724297913:8848]
2025-10-02T09:34:11.796195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.796199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.796200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.796202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.796207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.796209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.796320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.802242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId: src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.804371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:11.870257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555372799866647:6658]
2025-10-02T09:34:11.870435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2263, pipe: [1:7556555372799866647:6658]
2025-10-02T09:34:11.905016Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:11.905254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.905262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.905274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866647:6658], now have 1 active actors on pipe
2025-10-02T09:34:11.905427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:11.905436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555372799866647:6658]
2025-10-02T09:34:11.905466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:11.905544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2264 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0
2025-10-02T09:34:11.905695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2264 sessionId: src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0 is DEAD
2025-10-02T09:34:11.905840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:11.905853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Write session will restart in 0.005541s
2025-10-02T09:34:11.905872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Write session: Do CDS request
2025-10-02T09:34:11.905877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:11.905888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:11.910354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:11.911226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:11.911333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:11.911340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:11.911345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:11.911375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:11.911397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555372724298049:8830]
2025-10-02T09:34:11.911761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:11.911969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:11.912001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:11.912156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.912179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:11.912208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.912211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.912212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.912213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.912213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.912214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.912214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.912215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.912215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.912216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.912216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.912217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.912220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.912226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.912228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.912230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.912232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.912234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.912236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.912238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.912240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.912242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.912244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.912246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.912251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.912255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:11.912237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:11.912258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.912247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2265
2025-10-02T09:34:11.912261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:11.912263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.912265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:11.912268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.912270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:11.912273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.912275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:11.912278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.912280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:11.912283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.912285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:11.912288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.912290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:11.912293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.912295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:11.912298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.912300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.912302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.912305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.912307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.912310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.912326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:11.912322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:11.912346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:11.912354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:11.912357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:11.912662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2265 sessionId:  describe result for acl check
2025-10-02T09:34:11.912685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:11.912687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:11.912688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:11.912693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555372799866730:5532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:11.913091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555372799866730:5532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:11.914683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555372799866730:5532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:11.919077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555372799866730:5532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:11.919088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555372799866730:5532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:11.919093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555372799866730:5532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:11.919098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:11.919804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:11.921436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:11.921448Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:11.921449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:11.921451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:11.921456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2264 [2:7556555372724298049:8830]
2025-10-02T09:34:11.921462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:11.921473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:11.921475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.921477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.921478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.921486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:11.921489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:11.921493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:11.921523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.921528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.921529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.921531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:11.921532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:11.921569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:11.921574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.921581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:11.921587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:11.921598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:11.921613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866763:5532], now have 1 active actors on pipe
2025-10-02T09:34:11.921619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555372799866654:2446], now have 1 active actors on pipe
2025-10-02T09:34:11.921622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.921623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.921624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.921632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:11.921642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:11.921646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:11.921648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:11.921650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:11.921652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:11.921654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:11.921670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.921674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:11.921663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2264
2025-10-02T09:34:11.921683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:11.921692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.921686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2264
2025-10-02T09:34:11.921694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.921710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:11.921716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:11.921718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:11.921719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:11.921724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:11.921733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:11.921745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.921845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:11.921850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:11.921857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:11.921919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2265 partition: 0 MaxSeqNo: 36 sessionId: src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0
2025-10-02T09:34:11.922153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f49b5d5-3a6640a7-ae23f5da-1971bc68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:11.924671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Write session: try to update token
2025-10-02T09:34:11.924683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:11.930881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:11.930893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:11.930894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:11.930895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:11.930898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.930900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.930901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555372724298044:8830]
2025-10-02T09:34:11.930920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:11.930926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:11.930926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:11.930927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:11.930929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:11.930932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:11.931042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:11.937384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId: src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:11.939677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.005416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834080:6658]
2025-10-02T09:34:12.005591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2264, pipe: [1:7556555377094834080:6658]
2025-10-02T09:34:12.039427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.039716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.039724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.039738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834080:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.039899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.040139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.040158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:12.040171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834080:6658]
2025-10-02T09:34:12.040241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2265 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0
2025-10-02T09:34:12.040396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2265 sessionId: src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0 is DEAD
2025-10-02T09:34:12.040884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:12.040896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Write session will restart in 0.008419s
2025-10-02T09:34:12.040914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Write session: Do CDS request
2025-10-02T09:34:12.040918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.045565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.046429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.046534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.046542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.046547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.046573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.046604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019265465:8821]
2025-10-02T09:34:12.046944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.047100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.047123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.047298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.047325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.047329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.047330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.047330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.047331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.047331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.047332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.047332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.047333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.047333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.047334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.047334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.047337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.047344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.047346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.047348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.047350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.047352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.047354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.047356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.047358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.047360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.047362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.047364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.047368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.047372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.047375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.047378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.047380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.047383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.047385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.047388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.047390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.047393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.047395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.047398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.047402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.047405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.047407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.047409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.047412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.047414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.047416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.047419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.047421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.047424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.047428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.047431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.047448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.050233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.050320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.050331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2266
2025-10-02T09:34:12.050435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.050460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.050469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.050473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.050839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2266 sessionId:  describe result for acl check
2025-10-02T09:34:12.050866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.050870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.050871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.050874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834150:5501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.051215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834150:5501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.053370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834150:5501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.054926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.055447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834150:5501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.055455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834150:5501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.055457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834150:5501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.055461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.056450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.056463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.056465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.056467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.056472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2265 [2:7556555377019265465:8821]
2025-10-02T09:34:12.056478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.056491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.056495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.056496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.056497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.056505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.056508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.056511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.056542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.056546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.056547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.056549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.056550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.056586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.056591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.056598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.056603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.056611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.056625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834082:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.056630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834185:5501], now have 1 active actors on pipe
2025-10-02T09:34:12.056633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.056635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.056636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.056644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.056656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.056658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.056660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.056662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.056645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2265
2025-10-02T09:34:12.056666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.056668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.056679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2265
2025-10-02T09:34:12.056692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.056697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.056703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.056711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.056713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.056731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d58f3827-5bbf3468-9e051881-f4679edd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.056738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.056740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.056741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.056745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.056753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.056762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.056874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.056885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.056900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.056993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2266 partition: 0 MaxSeqNo: 36 sessionId: src_id|d58f3827-5bbf3468-9e051881-f4679edd_0
2025-10-02T09:34:12.057256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09ba7b0-3d041c16-58098e6c-caadda86_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d58f3827-5bbf3468-9e051881-f4679edd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.059863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Write session: try to update token
2025-10-02T09:34:12.059876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.065669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.065680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.065681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.065682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.065685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.065688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.065690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019265460:8821]
2025-10-02T09:34:12.065709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.065711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.065713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.065714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.065714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.065716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.065823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.071779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId: src_id|d58f3827-5bbf3468-9e051881-f4679edd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.074071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.140093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834204:6658]
2025-10-02T09:34:12.140267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2265, pipe: [1:7556555377094834204:6658]
2025-10-02T09:34:12.174175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.174450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.174459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.174473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834204:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.174604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.174656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.174708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:12.174793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d58f3827-5bbf3468-9e051881-f4679edd_0
2025-10-02T09:34:12.174901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834204:6658]
2025-10-02T09:34:12.174934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2266 sessionId: src_id|d58f3827-5bbf3468-9e051881-f4679edd_0 is DEAD
2025-10-02T09:34:12.175076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:12.175090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Write session will restart in 0.008100s
2025-10-02T09:34:12.175110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Write session: Do CDS request
2025-10-02T09:34:12.175115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.179754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.180622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.180718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.180725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.180730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.180755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.180779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019265570:8814]
2025-10-02T09:34:12.181173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.181335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.181357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.181530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.181558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.181562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.181563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.181563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.181564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.181564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.181565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.181565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.181566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.181566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.181567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.181567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.181570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.181577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.181579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.181582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.181584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.181586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.181588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.181590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.181592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.181594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.181596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.181598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.181602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.181605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.181609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.181612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.181614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.181617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.181619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.181621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.181624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.181626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.181628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.181631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.181633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.181636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.181638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.181641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.181643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.181647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.181649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.181652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.181656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.181659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.181661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.181664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.181683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.184200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.184272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.184284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2267
2025-10-02T09:34:12.184405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.184428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.184437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.184441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.184773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2267 sessionId:  describe result for acl check
2025-10-02T09:34:12.184813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.184821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.184823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.184829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834275:5495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.185281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834275:5495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.186731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834275:5495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.188554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834275:5495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.188562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834275:5495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.188564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834275:5495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.188569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.189120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.190647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.190658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.190659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.190661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.190664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2266 [2:7556555377019265570:8814]
2025-10-02T09:34:12.190671Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.190682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.190683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.190685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.190686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.190695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.190698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.190703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.190735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.190740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.190741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.190742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.190744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.190777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.190782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.190788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.190794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.190801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.190816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834205:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.190821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834309:5495], now have 1 active actors on pipe
2025-10-02T09:34:12.190825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.190826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.190827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.190835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.190844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.190847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.190849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.190851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.190852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.190854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.190846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2266
2025-10-02T09:34:12.190868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.190873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.190865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2266
2025-10-02T09:34:12.190874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.190891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.190896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.190913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.190920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.190922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.190923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.190927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.190934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.190942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.191042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.191047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.191054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.191123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2267 partition: 0 MaxSeqNo: 36 sessionId: src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0
2025-10-02T09:34:12.191429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58f3827-5bbf3468-9e051881-f4679edd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.193997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Write session: try to update token
2025-10-02T09:34:12.194007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.199948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.199962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.199964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.199965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.199969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.199972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.199974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019265565:8814]
2025-10-02T09:34:12.199995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.199998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.199999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.200000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.200002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.200004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.200114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.205565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId: src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.207951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.275250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834319:6658]
2025-10-02T09:34:12.275536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2266, pipe: [1:7556555377094834319:6658]
2025-10-02T09:34:12.309457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.309670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.309679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.309691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834319:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.309812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.309849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.309878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:12.309895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834319:6658]
2025-10-02T09:34:12.309937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0
2025-10-02T09:34:12.310072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2267 sessionId: src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0 is DEAD
2025-10-02T09:34:12.310225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:12.310238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Write session will restart in 0.006835s
2025-10-02T09:34:12.310261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Write session: Do CDS request
2025-10-02T09:34:12.310267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.315009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.315872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.315969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.315975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.315981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.316008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.316030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019265673:8812]
2025-10-02T09:34:12.316433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.316603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.316635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.316833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.316863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.316867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.316867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.316868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.316868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.316869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.316869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.316870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.316870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.316871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.316871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.316872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.316875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.316882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.316884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.316886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.316888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.316890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.316892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.316894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.316897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.316899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.316901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.316903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.316907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.316911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.316915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.316918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.316920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.316923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.316925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.316927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.316930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.316933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.316935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.316937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.316940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.316943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.316945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.316947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.316950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.316952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.316954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.316957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.316959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.316962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.316964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.316966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.316982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.318164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.318287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.318299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2268
2025-10-02T09:34:12.318412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.318439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.318448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.318452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.318858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2268 sessionId:  describe result for acl check
2025-10-02T09:34:12.318892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.318900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.318901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.318905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834390:5491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.319351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834390:5491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.320878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834390:5491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.323913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834390:5491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.323922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834390:5491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.323924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834390:5491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.323928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.324394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.325848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.325860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.325861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.325863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.325867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2267 [2:7556555377019265673:8812]
2025-10-02T09:34:12.325873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.325882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.325884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.325885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.325887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.325896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.325903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.325909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.325937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.325942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.325943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.325944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.325946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.325979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.325985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.325991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.325996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.326004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.326019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834425:5491], now have 1 active actors on pipe
2025-10-02T09:34:12.326024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834320:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.326028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.326029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.326030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.326038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.326038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2267
2025-10-02T09:34:12.326048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.326049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.326051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.326053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2267
2025-10-02T09:34:12.326052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.326057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.326058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.326075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.326079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.326081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.326088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.326092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.326117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.326123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.326126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.326128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.326133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.326140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.326149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.326250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.326255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.326261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.326327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2268 partition: 0 MaxSeqNo: 36 sessionId: src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0
2025-10-02T09:34:12.326532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0eade6e-ef5c016d-961a4908-c5ab1e67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.329274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Write session: try to update token
2025-10-02T09:34:12.329288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.335282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.335293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.335294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.335295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.335298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.335301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.335303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019265668:8812]
2025-10-02T09:34:12.335321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.335324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.335325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.335326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.335326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.335328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.335435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.340993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId: src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.343160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.409924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834433:6658]
2025-10-02T09:34:12.410163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2267, pipe: [1:7556555377094834433:6658]
2025-10-02T09:34:12.442620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.442836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.442844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.442857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834433:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.442981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.443061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.443125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834433:6658]
2025-10-02T09:34:12.443161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:12.443222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0
2025-10-02T09:34:12.443352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2268 sessionId: src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0 is DEAD
2025-10-02T09:34:12.443511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:12.443526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Write session will restart in 0.008882s
2025-10-02T09:34:12.443547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Write session: Do CDS request
2025-10-02T09:34:12.443552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.448326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.449243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.449354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.449361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.449367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.449394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.449458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019265780:8803]
2025-10-02T09:34:12.449839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.450006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.450031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.450208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.450236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.450240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.450241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.450241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.450242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.450243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.450243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.450244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.450244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.450245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.450245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.450246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.450249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.450255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.450257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.450259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.450261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.450263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.450265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.450267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.450269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.450271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.450273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.450275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.450280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.450284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.450287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.450291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.450294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.450296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.450298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.450300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.450303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.450305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.450307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.450309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.450313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.450316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.450318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.450320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.450322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.450328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.450330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.450332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.450334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.450337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.450339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.450341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.450359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.453096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.453277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.453290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2269
2025-10-02T09:34:12.453407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.453432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.453443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.453446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.453750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2269 sessionId:  describe result for acl check
2025-10-02T09:34:12.453772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.453776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.453777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.453780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834505:5466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.454119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834505:5466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.456101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834505:5466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.457746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.457860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834505:5466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.457871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834505:5466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.457873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834505:5466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.457877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.459235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.459246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.459248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.459250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.459253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2268 [2:7556555377019265780:8803]
2025-10-02T09:34:12.459260Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.459269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.459274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.459275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.459277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.459285Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.459292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.459296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.459325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.459331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.459332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.459334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.459335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.459369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.459374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.459382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.459387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.459395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.459410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834538:5466], now have 1 active actors on pipe
2025-10-02T09:34:12.459415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834434:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.459419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.459420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.459421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.459429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.459439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.459441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.459443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.459444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.459447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.459449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.459443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2268
2025-10-02T09:34:12.459457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2268
2025-10-02T09:34:12.459462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.459467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.459469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.459484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.459489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.459507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.459514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.459515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.459516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.459522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.459528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.459540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.459652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.459656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.459664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.459733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2269 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0
2025-10-02T09:34:12.459935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40830a0e-bc1ae97a-a4a7a71e-6db67212_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.462556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Write session: try to update token
2025-10-02T09:34:12.462570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.468382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.468393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.468395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.468396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.468399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.468401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.468403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019265775:8803]
2025-10-02T09:34:12.468424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.468428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.468431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.468433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.468433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.468435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.468564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.474733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId: src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.476996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.543542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834547:6658]
2025-10-02T09:34:12.543738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2268, pipe: [1:7556555377094834547:6658]
2025-10-02T09:34:12.577862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.578104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.578113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.578126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834547:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.578267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.578314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.578332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834547:6658]
2025-10-02T09:34:12.578359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:12.578448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2269 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0
2025-10-02T09:34:12.578582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2269 sessionId: src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0 is DEAD
2025-10-02T09:34:12.578716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:12.578729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Write session will restart in 0.006007s
2025-10-02T09:34:12.578748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Write session: Do CDS request
2025-10-02T09:34:12.578754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.583880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.584875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.584978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.584985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.584991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.585017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.585040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019265885:8801]
2025-10-02T09:34:12.585401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.585606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.585658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.585921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.585962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.585966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.585967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.585968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.585968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.585969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.585969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.585970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.585970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.585971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.585971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.585972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.585975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.585982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.585984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.585986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.585988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.585990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.585992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.585994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.585996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.586000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.586002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.586004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.586008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.586012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.586016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.586019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.586021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.586024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.586026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.586028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.586031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.586033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.586035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.586038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.586040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.586043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.586045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.586048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.586050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.586053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.586056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.586059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.586061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.586064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.586066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.586068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.586089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.586245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.586340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.586352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2270
2025-10-02T09:34:12.586451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.586475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.586485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.586489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.586869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2270 sessionId:  describe result for acl check
2025-10-02T09:34:12.586903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.586909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.586911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.586916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834620:5470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.587363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834620:5470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.589127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834620:5470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.593078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834620:5470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.593091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834620:5470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.593093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834620:5470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.593103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.593507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.595078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.595089Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.595091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.595092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.595096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2269 [2:7556555377019265885:8801]
2025-10-02T09:34:12.595103Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.595114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.595115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.595117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.595118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.595128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.595135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.595138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.595168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.595172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.595173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.595175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.595176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.595210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.595215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.595222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.595227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.595238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.595253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834659:5470], now have 1 active actors on pipe
2025-10-02T09:34:12.595258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834548:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.595262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.595263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.595264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.595269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.595274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.595276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.595281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.595283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.595284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.595287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.595302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.595308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.595314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.595311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2269
2025-10-02T09:34:12.595315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2269
2025-10-02T09:34:12.595342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.595347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.595361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c98f9da8-76428ac0-7c937abb-4064b873_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.595367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.595370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.595371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.595376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.595383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.595393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.595510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.595515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.595522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.595584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2270 partition: 0 MaxSeqNo: 36 sessionId: src_id|c98f9da8-76428ac0-7c937abb-4064b873_0
2025-10-02T09:34:12.595837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd2ca236-5e7c4009-63b26fb9-a9c245f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c98f9da8-76428ac0-7c937abb-4064b873_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.598458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Write session: try to update token
2025-10-02T09:34:12.598471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.608229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:12.608239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.608244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.608264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:12.608268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:12.608400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:12.608510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:12.608625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:12.608739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:12.608922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:12.608945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:12.610672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId: src_id|c98f9da8-76428ac0-7c937abb-4064b873_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.612524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.612536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.612537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.612539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.612544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.612546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.612548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019265880:8801]
2025-10-02T09:34:12.612565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.612567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.612569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.612571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.612571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.612572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.612685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.612914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.678722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834666:6658]
2025-10-02T09:34:12.678931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2269, pipe: [1:7556555377094834666:6658]
2025-10-02T09:34:12.721699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.721972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.721982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.721995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834666:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.722135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.722219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834666:6658]
2025-10-02T09:34:12.722243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.722244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:12.722344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c98f9da8-76428ac0-7c937abb-4064b873_0
2025-10-02T09:34:12.722500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2270 sessionId: src_id|c98f9da8-76428ac0-7c937abb-4064b873_0 is DEAD
2025-10-02T09:34:12.722655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:12.722669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Write session will restart in 0.009084s
2025-10-02T09:34:12.722694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Write session: Do CDS request
2025-10-02T09:34:12.722700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.728112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.729049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.729146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.729153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.729158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.729184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.729209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019265992:8798]
2025-10-02T09:34:12.729576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.729737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.729759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.729958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.729988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.729992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.729993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.729993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.729994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.729994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.729995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.729996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.729996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.729997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.729997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.729998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.730000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.730007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.730009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.730011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.730013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.730015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.730017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.730019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.730021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.730023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.730025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.730027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.730032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.730036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.730039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.730041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.730043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.730046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.730048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.730051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.730053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.730056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.730057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.730060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.730062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.730065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.730067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.730069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.730071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.730074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.730076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.730080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.730082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.730085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.730087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.730090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.730106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.733154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.733255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.733267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2271
2025-10-02T09:34:12.733355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.733379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.733387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.733390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.733745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2271 sessionId:  describe result for acl check
2025-10-02T09:34:12.733772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.733778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.733780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.733784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834741:5448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.734207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834741:5448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.736135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834741:5448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.737508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.737973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834741:5448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.737988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834741:5448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.737996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834741:5448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.738002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.739119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.739130Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.739131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.739135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.739138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2270 [2:7556555377019265992:8798]
2025-10-02T09:34:12.739145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.739156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.739161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.739162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.739164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.739172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.739175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.739179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.739214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.739218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.739220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.739222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.739223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.739260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.739266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.739272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.739277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.739288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.739304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834668:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.739309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834777:5448], now have 1 active actors on pipe
2025-10-02T09:34:12.739314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.739316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.739317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.739325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.739336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.739338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.739340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.739342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.739346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.739347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.739339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2270
2025-10-02T09:34:12.739348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2270
2025-10-02T09:34:12.739366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.739371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.739372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.739389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.739393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.739411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.739418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.739422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.739426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.739431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.739438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.739453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.739564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.739568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.739576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.739638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2271 partition: 0 MaxSeqNo: 36 sessionId: src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0
2025-10-02T09:34:12.739859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c98f9da8-76428ac0-7c937abb-4064b873_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.742403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Write session: try to update token
2025-10-02T09:34:12.742419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.748455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.748468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.748469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.748470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.748474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.748477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.748479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019265987:8798]
2025-10-02T09:34:12.748500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.748501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.748503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.748504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.748504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.748505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.748619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.754394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId: src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.756623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.822580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834784:6658]
2025-10-02T09:34:12.822760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2270, pipe: [1:7556555377094834784:6658]
2025-10-02T09:34:12.856644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.856939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.856948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.856960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834784:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.857102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.857156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:12.857166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:12.857183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.857229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834784:6658]
2025-10-02T09:34:12.857236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2271 reason: error at write: Disconnected sessionId: src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0
2025-10-02T09:34:12.857389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2271 sessionId: src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0 is DEAD
2025-10-02T09:34:12.857560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:12.857571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Write session will restart in 0.005431s
2025-10-02T09:34:12.857592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Write session: Do CDS request
2025-10-02T09:34:12.857597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:12.862970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:12.863928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:12.864028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:12.864035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:12.864041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:12.864066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:12.864116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555377019266100:8787]
2025-10-02T09:34:12.864164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.864212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:12.864223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2272
2025-10-02T09:34:12.864391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:12.864412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:12.864416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:12.864419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:12.864457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:12.864623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:12.864646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:12.864764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2272 sessionId:  describe result for acl check
2025-10-02T09:34:12.864793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:12.864797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:12.864812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:12.864817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555377094834861:5437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:12.864835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:12.864866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.864870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.864871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.864871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.864872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.864872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.864873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.864873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.864874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.864874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.864875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.864876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.864878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.864885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.864887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.864889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.864891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.864893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.864895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.864897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.864899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.864901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.864903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.864905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.864909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.864913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:12.864917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.864920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:12.864922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.864925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:12.864927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.864929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:12.864933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.864936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:12.864938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.864941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:12.864943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.864949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:12.864951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.864953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:12.864956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.864958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:12.864962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.864964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.864966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.864972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.864974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.864977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.864993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:12.865249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555377094834861:5437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:12.867185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555377094834861:5437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:12.871262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555377094834861:5437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:12.871272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555377094834861:5437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:12.871275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555377094834861:5437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:12.871280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:12.872434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:12.873976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:12.873987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:12.873989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:12.873991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:12.873994Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2271 [2:7556555377019266100:8787]
2025-10-02T09:34:12.874002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:12.874011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:12.874013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.874014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.874015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.874023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:12.874029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:12.874033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:12.874065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.874069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.874070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.874072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:12.874073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:12.874106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:12.874110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.874117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:12.874122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:12.874133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:12.874147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834789:2446], now have 1 active actors on pipe
2025-10-02T09:34:12.874152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834898:5437], now have 1 active actors on pipe
2025-10-02T09:34:12.874156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.874157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.874159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.874168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:12.874179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:12.874180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:12.874182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:12.874183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:12.874189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:12.874191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:12.874193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2271
2025-10-02T09:34:12.874198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2271
2025-10-02T09:34:12.874204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.874209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:12.874217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:12.874234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.874239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.874253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:12.874259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:12.874261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:12.874263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:12.874268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:12.874274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:12.874285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.874411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.874416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.874423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:12.874485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2272 partition: 0 MaxSeqNo: 36 sessionId: src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0
2025-10-02T09:34:12.874721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c9b81-5b18c5c3-3cfd1b79-1a030861_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:12.877410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Write session: try to update token
2025-10-02T09:34:12.877421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:12.883491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:12.883506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:12.883507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:12.883509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:12.883515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.883519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.883522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555377019266095:8787]
2025-10-02T09:34:12.883550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:12.883553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:12.883555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:12.883556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:12.883561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:12.883563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:12.883706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:12.889421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId: src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:12.891807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:12.957234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555377094834923:6658]
2025-10-02T09:34:12.957426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2271, pipe: [1:7556555377094834923:6658]
2025-10-02T09:34:12.995368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:12.995771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:12.995781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:12.995794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834923:6658], now have 1 active actors on pipe
2025-10-02T09:34:12.995965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:12.995968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:12.995979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:12.996011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555377094834923:6658]
2025-10-02T09:34:12.996024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2272 reason: error at write: Disconnected sessionId: src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0
2025-10-02T09:34:12.996034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:12.996168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2272 sessionId: src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0 is DEAD
2025-10-02T09:34:12.996289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:12.996299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Write session will restart in 0.007593s
2025-10-02T09:34:12.996317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Write session: Do CDS request
2025-10-02T09:34:12.996323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.001416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.002546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.002729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.002740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.002747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.002782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.002808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314233554:8769]
2025-10-02T09:34:13.003146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.003332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.003354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.003525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.003553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.003557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.003558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.003558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.003559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.003559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.003560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.003560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.003561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.003561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.003562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.003562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.003565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.003572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.003574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.003576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.003578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.003580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.003582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.003584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.003586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.003588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.003590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.003592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.003596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.003601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.003604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.003607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.003609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.003612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.003613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.003616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.003618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.003621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.003623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.003626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.003628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.003631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.003633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.003636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.003638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.003640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.003642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.003645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.003647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.003650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.003652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.003655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.003672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.005150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.005205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.005216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2273
2025-10-02T09:34:13.005382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.005402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.005409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.005413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.005706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2273 sessionId:  describe result for acl check
2025-10-02T09:34:13.005728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.005734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.005736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.005739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389802304:5408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.006071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389802304:5408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.007363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389802304:5408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.010613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389802304:5408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.010626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389802304:5408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.010630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389802304:5408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.010637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.011116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.012575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.012587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.012588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.012590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.012593Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2272 [2:7556555381314233554:8769]
2025-10-02T09:34:13.012601Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.012609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.012611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.012612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.012613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.012621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.012625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.012629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.012658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.012663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.012664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.012666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.012667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.012704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.012709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.012716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.012721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.012729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.012741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555377094834933:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.012746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802338:5408], now have 1 active actors on pipe
2025-10-02T09:34:13.012750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.012751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.012752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.012760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.012769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.012773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.012775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.012776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.012779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.012781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.012775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2272
2025-10-02T09:34:13.012793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.012789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2272
2025-10-02T09:34:13.012798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.012810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.012826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.012831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.012847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.012854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.012856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.012857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.012861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.012868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.012877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.012969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.012975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.012983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.013035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2273 partition: 0 MaxSeqNo: 36 sessionId: src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0
2025-10-02T09:34:13.013226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8726e636-3ab76a19-5ad7f813-e3d54cd8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.015756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Write session: try to update token
2025-10-02T09:34:13.015766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.021939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.021954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.021956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.021957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.021961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.021963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.021965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314233549:8769]
2025-10-02T09:34:13.021986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.021989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.021991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.021992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.021994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.021996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.022101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.026915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId: src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.028938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.095954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389802358:6658]
2025-10-02T09:34:13.096126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2272, pipe: [1:7556555381389802358:6658]
2025-10-02T09:34:13.131654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.131945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.131954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.131978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802358:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.132104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.132156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:13.132168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:13.132207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389802358:6658]
2025-10-02T09:34:13.132213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2273 reason: error at write: Disconnected sessionId: src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0
2025-10-02T09:34:13.132234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.132339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2273 sessionId: src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0 is DEAD
2025-10-02T09:34:13.132484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:13.132494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Write session will restart in 0.009729s
2025-10-02T09:34:13.132514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Write session: Do CDS request
2025-10-02T09:34:13.132518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.138774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.139777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.139875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.139882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.139887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.139913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.139937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314233664:8757]
2025-10-02T09:34:13.140269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.140426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.140448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.140624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.140653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.140657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.140657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.140658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.140659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.140659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.140660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.140660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.140661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.140662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.140663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.140663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.140666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.140673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.140675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.140677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.140679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.140681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.140683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.140685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.140687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.140691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.140693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.140695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.140698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.140702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.140705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.140708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.140712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.140714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.140716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.140719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.140721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.140726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.140728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.140730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.140733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.140735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.140737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.140740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.140743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.140746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.140748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.140751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.140753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.140755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.140760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.140762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.140779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.143158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.143211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.143220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2274
2025-10-02T09:34:13.143294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.143313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.143316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.143318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.143694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2274 sessionId:  describe result for acl check
2025-10-02T09:34:13.143728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.143733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.143735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.143739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389802442:5394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.144186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389802442:5394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.145525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389802442:5394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.147640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389802442:5394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.147649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389802442:5394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.147652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389802442:5394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.147656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.148196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.149732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.149744Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.149745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.149748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.149751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2273 [2:7556555381314233664:8757]
2025-10-02T09:34:13.149758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.149767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.149769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.149770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.149771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.149780Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.149783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.149793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.149822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.149826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.149827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.149829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.149830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.149865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.149869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.149875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.149881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.149889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.149903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802477:5394], now have 1 active actors on pipe
2025-10-02T09:34:13.149908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802359:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.149912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.149913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.149914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.149921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.149930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.149935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.149937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.149938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.149939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.149941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.149954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.149959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.149960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.149942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2273
2025-10-02T09:34:13.149952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2273
2025-10-02T09:34:13.149973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.149978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.149997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.150004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.150009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.150012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.150017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.150023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.150037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.150132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.150136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.150143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.150193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2274 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0
2025-10-02T09:34:13.150359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|681b6ca9-4c6008d7-54c8b76a-fc4fb161_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.152995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Write session: try to update token
2025-10-02T09:34:13.153006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.159138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.159153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.159154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.159155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.159160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.159162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.159165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314233659:8757]
2025-10-02T09:34:13.159185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.159189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.159190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.159195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.159199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.159202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.159293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.164597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId: src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.166710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.232163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389802485:6658]
2025-10-02T09:34:13.232384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2273, pipe: [1:7556555381389802485:6658]
2025-10-02T09:34:13.268837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.269082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.269091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.269104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802485:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.269265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.269284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:13.269294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:13.269330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389802485:6658]
2025-10-02T09:34:13.269340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2274 reason: error at write: Disconnected sessionId: src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0
2025-10-02T09:34:13.269352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.269457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2274 sessionId: src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0 is DEAD
2025-10-02T09:34:13.269830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:13.269841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Write session will restart in 0.005332s
2025-10-02T09:34:13.269857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Write session: Do CDS request
2025-10-02T09:34:13.269861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.274956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.275934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.276032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.276039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.276045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.276063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.276069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.276093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314233774:8749]
2025-10-02T09:34:13.276156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.276167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2275
2025-10-02T09:34:13.276246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.276266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.276274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.276276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.276438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.276615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.276638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.276636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2275 sessionId:  describe result for acl check
2025-10-02T09:34:13.276669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.276673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.276675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.276678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389802563:5371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.276846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.276880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.276884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.276885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.276885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.276886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.276886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.276887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.276887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.276888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.276888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.276889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.276889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.276892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.276899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.276901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.276903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.276905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.276907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.276909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.276911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.276913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.276916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.276918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.276920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.276925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.276929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.276933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.276936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.276938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.276941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.276943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.276946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.276948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.276951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.276954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.276956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.276959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.276961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.276963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.276966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.276969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.276971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.276973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.276976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.276978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.276980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.276982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.276985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.277002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.277139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389802563:5371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.278657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389802563:5371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.283216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389802563:5371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.283225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389802563:5371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.283227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389802563:5371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.283231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.284437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.286074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.286085Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.286086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.286088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.286091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2274 [2:7556555381314233774:8749]
2025-10-02T09:34:13.286099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.286109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.286113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.286115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.286116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.286125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.286128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.286134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.286161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.286166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.286167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.286168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.286170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.286207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.286212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.286218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.286223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.286231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.286242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802600:5371], now have 1 active actors on pipe
2025-10-02T09:34:13.286248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802488:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.286251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.286252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.286253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.286259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.286268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.286270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.286273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.286274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.286279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.286280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.286294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.286299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.286309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.286316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.286318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.286296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2274
2025-10-02T09:34:13.286335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|632a1f3a-f5a2f857-69f4c670-7618170_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.286345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.286348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.286349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.286336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2274
2025-10-02T09:34:13.286356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.286366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.286382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.286515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.286520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.286528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.286581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2275 partition: 0 MaxSeqNo: 36 sessionId: src_id|632a1f3a-f5a2f857-69f4c670-7618170_0
2025-10-02T09:34:13.286766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d7082e-33d946ea-8da57c5a-27f76e09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|632a1f3a-f5a2f857-69f4c670-7618170_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.289213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Write session: try to update token
2025-10-02T09:34:13.289222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.295504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.295520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.295521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.295522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.295527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.295531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.295533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314233769:8749]
2025-10-02T09:34:13.295555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.295560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.295561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.295566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.295570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.295573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.295678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.300159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId: src_id|632a1f3a-f5a2f857-69f4c670-7618170_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.302203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.369365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389802608:6658]
2025-10-02T09:34:13.369549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2274, pipe: [1:7556555381389802608:6658]
2025-10-02T09:34:13.404676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.404916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.404926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.404952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802608:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.405084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:13.405106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.405094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:13.405138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2275 reason: error at write: Disconnected sessionId: src_id|632a1f3a-f5a2f857-69f4c670-7618170_0
2025-10-02T09:34:13.405170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389802608:6658]
2025-10-02T09:34:13.405199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.405267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2275 sessionId: src_id|632a1f3a-f5a2f857-69f4c670-7618170_0 is DEAD
2025-10-02T09:34:13.405393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:13.405404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Write session will restart in 0.005686s
2025-10-02T09:34:13.405420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Write session: Do CDS request
2025-10-02T09:34:13.405424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.411402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.412140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.412202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.412211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2276
2025-10-02T09:34:13.412339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.412361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.412363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.412366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.412372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.412469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.412475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.412481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.412506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.412531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314233888:8744]
2025-10-02T09:34:13.412739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2276 sessionId:  describe result for acl check
2025-10-02T09:34:13.412771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.412777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.412779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.412783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389802683:5344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.412894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.413083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.413106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.413257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389802683:5344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.413283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.413314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.413317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.413318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.413319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.413319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.413320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.413320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.413321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.413321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.413322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.413322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.413323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.413326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.413332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.413334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.413336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.413338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.413340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.413342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.413344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.413346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.413349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.413350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.413353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.413356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.413360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.413363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.413366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.413369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.413371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.413374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.413378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.413381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.413384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.413386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.413389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.413392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.413395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.413397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.413399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.413401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.413404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.413406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.413409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.413411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.413413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.413416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.413418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.413435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.414930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389802683:5344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.419665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389802683:5344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.419676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389802683:5344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.419678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389802683:5344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.419684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.420881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.422417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.422428Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.422430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.422432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.422436Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2275 [2:7556555381314233888:8744]
2025-10-02T09:34:13.422443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.422453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.422458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.422460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.422461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.422471Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.422475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.422481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.422513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.422518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.422519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.422520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.422522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.422560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.422566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.422572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.422577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.422585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.422607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802609:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.422612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802721:5344], now have 1 active actors on pipe
2025-10-02T09:34:13.422616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.422618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.422619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.422627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.422637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.422646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.422648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.422649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.422655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.422645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2275
2025-10-02T09:34:13.422657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.422664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.422666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.422668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.422677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2275
2025-10-02T09:34:13.422686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.422691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.422706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.422714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.422716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.422717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.422722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.422727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.422734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.422833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.422837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.422844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.422893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2276 partition: 0 MaxSeqNo: 36 sessionId: src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0
2025-10-02T09:34:13.423077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632a1f3a-f5a2f857-69f4c670-7618170_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.425526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Write session: try to update token
2025-10-02T09:34:13.425537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.431831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.431845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.431846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.431847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.431851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.431854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.431856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314233883:8744]
2025-10-02T09:34:13.431878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.431885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.431887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.431890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.431895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.431898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.432006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.436702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId: src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.438757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.505562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389802729:6658]
2025-10-02T09:34:13.505704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2275, pipe: [1:7556555381389802729:6658]
2025-10-02T09:34:13.542929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.543218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.543232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.543261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802729:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.543428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.543465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:13.543467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:13.543486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389802729:6658]
2025-10-02T09:34:13.543511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2276 reason: error at write: Disconnected sessionId: src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0
2025-10-02T09:34:13.543641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2276 sessionId: src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0 is DEAD
2025-10-02T09:34:13.543647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.543779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:13.543790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Write session will restart in 0.006195s
2025-10-02T09:34:13.543808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Write session: Do CDS request
2025-10-02T09:34:13.543813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.549420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.550384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.550488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.550494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.550501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.550525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.550548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314234001:8742]
2025-10-02T09:34:13.550900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.551136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.551255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.551267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2277
2025-10-02T09:34:13.551317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.551339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.551364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.551393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.551401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.551404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.551515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.551543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.551547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.551547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.551549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.551549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.551550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.551551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.551551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.551552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.551552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.551555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.551561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.551563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.551566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.551568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.551570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.551572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.551574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.551576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.551578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.551580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.551582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.551586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.551592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.551595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.551598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.551600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.551603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.551605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.551608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.551611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.551613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.551615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.551618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.551620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.551623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.551625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.551628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.551630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.551632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.551634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.551637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.551639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.551644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.551647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.551650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.551666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.551811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2277 sessionId:  describe result for acl check
2025-10-02T09:34:13.551861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.551867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.551869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.551875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389802810:5340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.552319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389802810:5340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.553715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389802810:5340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.558617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389802810:5340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.558631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389802810:5340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.558633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389802810:5340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.558639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.559126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.560646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.560658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.560660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.560662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.560666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2276 [2:7556555381314234001:8742]
2025-10-02T09:34:13.560673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.560683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.560688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.560689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.560691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.560700Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.560706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.560710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.560741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.560747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.560748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.560750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.560751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.560787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.560793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.560812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.560818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.560826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.560841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802731:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.560846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802845:5340], now have 1 active actors on pipe
2025-10-02T09:34:13.560850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.560852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.560853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.560860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.560869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.560876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.560878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.560878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.560863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2276
2025-10-02T09:34:13.560880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.560880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.560899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.560898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2276
2025-10-02T09:34:13.560906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.560913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.560924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.560928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.560945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f081ba69-eab508c4-a34376bc-4494880a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.560951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.560953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.560954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.560959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.560968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.560976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.561069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.561073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.561081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.561138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2277 partition: 0 MaxSeqNo: 36 sessionId: src_id|f081ba69-eab508c4-a34376bc-4494880a_0
2025-10-02T09:34:13.561344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73fbafa-a025f58c-ecb4818d-6c24916_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f081ba69-eab508c4-a34376bc-4494880a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.563906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Write session: try to update token
2025-10-02T09:34:13.563918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.570211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.570226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.570227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.570230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.570234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.570238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.570241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314233996:8742]
2025-10-02T09:34:13.570262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.570268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.570270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.570271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.570271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.570273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.570411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.575409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId: src_id|f081ba69-eab508c4-a34376bc-4494880a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.577438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.643810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389802852:6658]
2025-10-02T09:34:13.643959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2276, pipe: [1:7556555381389802852:6658]
2025-10-02T09:34:13.682547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.682831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.682845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.682874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802852:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.683051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.683036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:13.683048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:13.683082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.683092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2277 reason: error at write: Disconnected sessionId: src_id|f081ba69-eab508c4-a34376bc-4494880a_0
2025-10-02T09:34:13.683132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389802852:6658]
2025-10-02T09:34:13.683244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2277 sessionId: src_id|f081ba69-eab508c4-a34376bc-4494880a_0 is DEAD
2025-10-02T09:34:13.683367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:13.683376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Write session will restart in 0.005819s
2025-10-02T09:34:13.683392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Write session: Do CDS request
2025-10-02T09:34:13.683397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.688562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.689529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.689666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.689673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.689679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.689707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.689730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314234115:8740]
2025-10-02T09:34:13.690060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.690122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.690242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.690220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.690231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2278
2025-10-02T09:34:13.690264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.690304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.690322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.690325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.690328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.690435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.690463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.690466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.690467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.690469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.690470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.690470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.690471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.690471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.690472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.690472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.690473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.690474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.690477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.690484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.690486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.690488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.690490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.690492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.690493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.690495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.690497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.690499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.690501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.690503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.690507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.690511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.690514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.690517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.690519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.690521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.690523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.690527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.690529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.690531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.690533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.690536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.690538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.690540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.690542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.690545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.690548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.690550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.690552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.690559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.690561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.690563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.690566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.690568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.690583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.690619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2278 sessionId:  describe result for acl check
2025-10-02T09:34:13.690638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.690639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.690640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.690643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389802932:5320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.690980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389802932:5320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.692418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389802932:5320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.696777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389802932:5320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.696788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389802932:5320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.696791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389802932:5320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.696827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.697989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.699484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.699497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.699498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.699500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.699503Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2277 [2:7556555381314234115:8740]
2025-10-02T09:34:13.699510Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.699520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.699521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.699522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.699523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.699533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.699539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.699543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.699572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.699577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.699578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.699580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.699581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.699616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.699621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.699627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.699632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.699640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.699654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802969:5320], now have 1 active actors on pipe
2025-10-02T09:34:13.699659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802853:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.699663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.699686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.699690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.699696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.699676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2277
2025-10-02T09:34:13.699696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2277
2025-10-02T09:34:13.699703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.699704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.699706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.699707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.699714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.699716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.699739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.699744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.699751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.699757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.699765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.699774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.699777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.699779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.699780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.699786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.699792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.699803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.699888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.699893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.699900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.699939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2278 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0
2025-10-02T09:34:13.700112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f081ba69-eab508c4-a34376bc-4494880a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.702543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Write session: try to update token
2025-10-02T09:34:13.702554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.709043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.709057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.709058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.709061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.709065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.709068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.709071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314234110:8740]
2025-10-02T09:34:13.709092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.709095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.709097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.709097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.709100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.709102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.709208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.713491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId: src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.715453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.783077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389802976:6658]
2025-10-02T09:34:13.783235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2277, pipe: [1:7556555381389802976:6658]
2025-10-02T09:34:13.821476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.821744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.821754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.821779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802976:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.821897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.821948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389802976:6658]
2025-10-02T09:34:13.821971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.822004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:13.822090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2278 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0
2025-10-02T09:34:13.822256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2278 sessionId: src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0 is DEAD
2025-10-02T09:34:13.822406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:13.822417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Write session will restart in 0.005570s
2025-10-02T09:34:13.822436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Write session: Do CDS request
2025-10-02T09:34:13.822440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.827937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.828874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.829039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.829046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.829053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.829085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.829110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314234229:8723]
2025-10-02T09:34:13.829188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.829275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.829286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2279
2025-10-02T09:34:13.829369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.829394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.829403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.829406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.829451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.829639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.829661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.829697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2279 sessionId:  describe result for acl check
2025-10-02T09:34:13.829720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.829726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.829727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.829730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389803056:5308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.829837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.829864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.829868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.829868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.829869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.829870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.829870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.829871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.829871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.829872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.829872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.829873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.829873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.829876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.829882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.829884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.829886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.829888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.829890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.829893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.829895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.829897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.829899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.829903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.829905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.829909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.829914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.829917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.829919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.829922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.829924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.829926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.829929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.829931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.829934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.829936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.829939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.829941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.829945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.829947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.829950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.829952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.829955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.829957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.829959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.829962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.829964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.829966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.829969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.829986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.830105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389803056:5308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.831636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389803056:5308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.836201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389803056:5308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.836212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389803056:5308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.836214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389803056:5308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.836219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.837424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.838961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.838973Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.838974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.838976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.838982Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2278 [2:7556555381314234229:8723]
2025-10-02T09:34:13.838990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.839000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.839002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.839003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.839004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.839013Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.839016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.839025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.839056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.839060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.839061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.839063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.839064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.839100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.839104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.839111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.839116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.839124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.839137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389803093:5308], now have 1 active actors on pipe
2025-10-02T09:34:13.839141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389802977:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.839145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.839146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.839147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.839156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.839166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.839166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.839168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.839169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.839175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.839177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.839167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2278
2025-10-02T09:34:13.839192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.839197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.839198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.839185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2278
2025-10-02T09:34:13.839208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.839214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.839239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|935722d3-759c82ef-7607d436-cfce3477_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.839246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.839248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.839249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.839254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.839259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.839271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.839374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.839385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.839402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.839467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2279 partition: 0 MaxSeqNo: 36 sessionId: src_id|935722d3-759c82ef-7607d436-cfce3477_0
2025-10-02T09:34:13.839657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba00f7b5-52d594a8-2249b70b-44762ade_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|935722d3-759c82ef-7607d436-cfce3477_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.842120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Write session: try to update token
2025-10-02T09:34:13.842130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.848390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.848406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.848407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.848408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.848414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.848416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.848418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314234224:8723]
2025-10-02T09:34:13.848445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.848453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.848454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.848464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.848479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.848483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.848579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.853379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId: src_id|935722d3-759c82ef-7607d436-cfce3477_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.855380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:13.922332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555381389803108:6658]
2025-10-02T09:34:13.922509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2278, pipe: [1:7556555381389803108:6658]
2025-10-02T09:34:13.959720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:13.959933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.959942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.959966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389803108:6658], now have 1 active actors on pipe
2025-10-02T09:34:13.960144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:13.960130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555381389803108:6658]
2025-10-02T09:34:13.960155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:13.960179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:13.960183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:13.960262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2279 reason: error at write: Disconnected sessionId: src_id|935722d3-759c82ef-7607d436-cfce3477_0
2025-10-02T09:34:13.960431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2279 sessionId: src_id|935722d3-759c82ef-7607d436-cfce3477_0 is DEAD
2025-10-02T09:34:13.960576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:13.960587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Write session will restart in 0.008194s
2025-10-02T09:34:13.960601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Write session: Do CDS request
2025-10-02T09:34:13.960605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:13.966557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:13.967547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:13.967699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:13.967707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:13.967713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:13.967745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:13.967769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555381314234385:8692]
2025-10-02T09:34:13.968111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:13.968307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:13.968333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:13.968514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:13.968544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.968548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.968549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.968549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.968550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.968550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.968551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.968551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.968552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.968552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.968553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.968554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.968556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.968563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.968565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.968568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.968571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.968573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.968575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.968577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.968579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.968581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.968583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.968585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.968590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.968594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:13.968597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.968599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:13.968601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.968604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:13.968606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.968613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:13.968616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.968619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:13.968622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.968625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:13.968628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.968631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:13.968633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.968635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:13.968637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.968640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:13.968643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.968645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.968647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.968650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.968653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.968655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.968671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:13.970174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.970253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:13.970267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2280
2025-10-02T09:34:13.970414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:13.970440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:13.970447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:13.970450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:13.970677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2280 sessionId:  describe result for acl check
2025-10-02T09:34:13.970698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:13.970706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:13.970707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:13.970709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555381389803210:5272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:13.971087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555381389803210:5272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:13.972195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555381389803210:5272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:13.975483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555381389803210:5272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:13.975492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555381389803210:5272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:13.975496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555381389803210:5272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:13.975501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:13.976082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:13.977626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:13.977638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:13.977639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:13.977641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:13.977645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2279 [2:7556555381314234385:8692]
2025-10-02T09:34:13.977652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:13.977663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:13.977664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.977666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.977667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.977677Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:13.977680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:13.977684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:13.977714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.977719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.977720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.977723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:13.977724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:13.977799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:13.977807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.977816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:13.977825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:13.977844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:13.977859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389803115:2446], now have 1 active actors on pipe
2025-10-02T09:34:13.977865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555381389803241:5272], now have 1 active actors on pipe
2025-10-02T09:34:13.977869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.977870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.977871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.977879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:13.977893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:13.977881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2279
2025-10-02T09:34:13.977895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:13.977897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:13.977899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:13.977911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:13.977908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2279
2025-10-02T09:34:13.977915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:13.977943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.977950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.977959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.977967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:13.977977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:13.977989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27348307-11174988-dc83cb56-3e5e000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:13.977995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:13.977999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:13.978001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:13.978008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:13.978015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:13.978034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.978126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:13.978133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:13.978143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:13.978194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2280 partition: 0 MaxSeqNo: 36 sessionId: src_id|27348307-11174988-dc83cb56-3e5e000_0
2025-10-02T09:34:13.978410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935722d3-759c82ef-7607d436-cfce3477_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27348307-11174988-dc83cb56-3e5e000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:13.981132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Write session: try to update token
2025-10-02T09:34:13.981146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:13.987090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:13.987103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:13.987104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:13.987105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:13.987110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.987112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.987114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555381314234380:8692]
2025-10-02T09:34:13.987137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:13.987146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:13.987147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:13.987154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:13.987157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:13.987160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:13.987259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:13.993274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId: src_id|27348307-11174988-dc83cb56-3e5e000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:13.995280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.060052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684770555:6658]
2025-10-02T09:34:14.060251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2279, pipe: [1:7556555385684770555:6658]
2025-10-02T09:34:14.097094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.097340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.097349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.097362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770555:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.097550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.097556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684770555:6658]
2025-10-02T09:34:14.097571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.097578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.097580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.097625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2280 reason: error at write: Disconnected sessionId: src_id|27348307-11174988-dc83cb56-3e5e000_0
2025-10-02T09:34:14.097759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2280 sessionId: src_id|27348307-11174988-dc83cb56-3e5e000_0 is DEAD
2025-10-02T09:34:14.097940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.097952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Write session will restart in 0.006891s
2025-10-02T09:34:14.097972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Write session: Do CDS request
2025-10-02T09:34:14.097978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.103884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.104879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.105021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.105028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.105035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.105064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.105089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609201807:8699]
2025-10-02T09:34:14.105451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.105642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.105670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.105858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.105890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.105894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.105894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.105895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.105895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.105896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.105896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.105897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.105897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.105898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.105898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.105899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.105902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.105909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.105911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.105913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.105915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.105917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.105919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.105921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.105923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.105926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.105929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.105931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.105934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.105938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.105942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.105945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.105948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.105951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.105953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.105955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.105959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.105962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.105964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.105967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.105969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.105972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.105973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.105976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.105979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.105981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.105983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.105986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.105988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.105991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.105993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.105995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.106011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.106125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.106187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.106196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2281
2025-10-02T09:34:14.106290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.106310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.106313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.106316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.106613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2281 sessionId:  describe result for acl check
2025-10-02T09:34:14.106642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.106648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.106649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.106652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684770651:5248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.106984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684770651:5248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.108497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684770651:5248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.113095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684770651:5248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.113104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684770651:5248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.113106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684770651:5248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.113109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.113599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.115109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.115121Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.115123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.115125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.115128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2280 [2:7556555385609201807:8699]
2025-10-02T09:34:14.115135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.115145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.115148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.115150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.115151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.115162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.115168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.115173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.115203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.115208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.115209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.115211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.115213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.115256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.115263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.115274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.115283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.115300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.115319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770568:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.115327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770686:5248], now have 1 active actors on pipe
2025-10-02T09:34:14.115332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.115335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.115337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.115328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2280
2025-10-02T09:34:14.115332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2280
2025-10-02T09:34:14.115348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.115360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.115362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.115363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.115364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.115373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.115379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.115392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.115398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.115421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.115430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.115441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.115445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.115450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.115454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.115455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.115461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.115471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.115496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.115601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.115608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.115619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.115668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2281 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0
2025-10-02T09:34:14.115872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27348307-11174988-dc83cb56-3e5e000_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.118453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Write session: try to update token
2025-10-02T09:34:14.118470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.124672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.124685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.124686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.124687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.124691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.124694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.124696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609201802:8699]
2025-10-02T09:34:14.124721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.124728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.124730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.124734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.124738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.124749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.124855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.130490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId: src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.132464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.197790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684770694:6658]
2025-10-02T09:34:14.197980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2280, pipe: [1:7556555385684770694:6658]
2025-10-02T09:34:14.235120Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.235355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.235365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.235390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770694:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.235573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684770694:6658]
2025-10-02T09:34:14.235594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.235609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.235593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.235596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.235653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2281 reason: error at write: Disconnected sessionId: src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0
2025-10-02T09:34:14.235792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2281 sessionId: src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0 is DEAD
2025-10-02T09:34:14.235959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.235972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Write session will restart in 0.005688s
2025-10-02T09:34:14.235997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Write session: Do CDS request
2025-10-02T09:34:14.236002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.241987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.242980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.243090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.243097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.243102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.243130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.243162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609201925:8693]
2025-10-02T09:34:14.243179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.243238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.243247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2282
2025-10-02T09:34:14.243342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.243363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.243371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.243374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.243504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.243670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2282 sessionId:  describe result for acl check
2025-10-02T09:34:14.243694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.243700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.243701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.243704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684770777:5240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.243706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.243736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.243915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.243944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.243947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.243948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.243949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.243949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.243950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.243950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.243951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.243951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.243952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.243953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.243953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.243956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.243962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.243964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.243966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.243968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.243970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.243973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.243975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.243977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.243979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.243981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.243983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.243987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.243991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.243994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.243997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.244000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.244002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.244004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.244007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.244010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.244012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.244014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.244017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.244019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.244022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.244024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.244030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.244034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.244036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.244038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.244041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.244044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.244032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684770777:5240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.244047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.244051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.244053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.244070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.245223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684770777:5240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.249563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684770777:5240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.249572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684770777:5240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.249574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684770777:5240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.249578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.251836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.253406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.253416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.253417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.253419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.253423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2281 [2:7556555385609201925:8693]
2025-10-02T09:34:14.253429Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.253439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.253443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.253445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.253446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.253454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.253457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.253463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.253492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.253497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.253498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.253500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.253501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.253588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.253594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.253605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.253617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.253637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.253624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2281
2025-10-02T09:34:14.253630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2281
2025-10-02T09:34:14.253655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770695:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.253662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770814:5240], now have 1 active actors on pipe
2025-10-02T09:34:14.253666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.253668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.253670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.253676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.253681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.253683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.253684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.253690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.253702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.253708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.253722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.253728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.253747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.253755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.253766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.253768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.253773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.253776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.253778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.253784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.253791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.253813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.253914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.253920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.253930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.253985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2282 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0
2025-10-02T09:34:14.254234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c73d96-ec912643-9db9754a-c2baf5ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.256851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Write session: try to update token
2025-10-02T09:34:14.256864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.263213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:14.263226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.263230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.263258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:14.263271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:14.263395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:14.263509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:14.263622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:14.263735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:14.263896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:14.263922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:14.270099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId: src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.271916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.271931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.271932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.271933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.271937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.271940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.271942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609201920:8693]
2025-10-02T09:34:14.271966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.271973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.271975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.271981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.271993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.271997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.272106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.272179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.335510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684770823:6658]
2025-10-02T09:34:14.335679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2281, pipe: [1:7556555385684770823:6658]
2025-10-02T09:34:14.381433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.381642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.381651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.381663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770823:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.381848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684770823:6658]
2025-10-02T09:34:14.381867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.381883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.381879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.381885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.381931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2282 reason: error at write: Disconnected sessionId: src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0
2025-10-02T09:34:14.382063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2282 sessionId: src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0 is DEAD
2025-10-02T09:34:14.382220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.382231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Write session will restart in 0.005944s
2025-10-02T09:34:14.382253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Write session: Do CDS request
2025-10-02T09:34:14.382258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.388178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.389180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.389200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.389306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.389314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.389315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.389328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2283
2025-10-02T09:34:14.389321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.389349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.389370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609202046:8695]
2025-10-02T09:34:14.389465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.389494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.389503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.389507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.389716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.389795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2283 sessionId:  describe result for acl check
2025-10-02T09:34:14.389819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.389824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.389825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.389828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684770906:5211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.389908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.389935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.390123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.390154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.390158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.390159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.390159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.390160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.390160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.390161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.390167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684770906:5211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.390161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.390162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.390163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.390163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.390164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.390167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.390173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.390177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.390179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.390181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.390183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.390185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.390187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.390189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.390191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.390193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.390195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.390199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.390204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.390207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.390210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.390213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.390215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.390218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.390220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.390223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.390225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.390227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.390230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.390232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.390235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.390237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.390239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.390242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.390244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.390246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.390249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.390252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.390254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.390257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.390260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.390276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.391731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684770906:5211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.396539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684770906:5211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.396551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684770906:5211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.396553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684770906:5211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.396559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.397669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.399131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.399143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.399144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.399146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.399150Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2282 [2:7556555385609202046:8695]
2025-10-02T09:34:14.399157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.399167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.399172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.399174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.399175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.399184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.399187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.399190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.399223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.399227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.399228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.399230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.399231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.399278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.399285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.399295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.399306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.399323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.399341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770945:5211], now have 1 active actors on pipe
2025-10-02T09:34:14.399347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770825:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.399351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.399352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.399353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.399361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.399377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.399376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.399364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2282
2025-10-02T09:34:14.399378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.399380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.399392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.399394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.399388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2282
2025-10-02T09:34:14.399418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.399425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.399436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.399444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.399454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.399464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.399469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.399473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.399475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.399482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.399489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.399510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.399599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.399606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.399616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.399681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2283 partition: 0 MaxSeqNo: 36 sessionId: src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0
2025-10-02T09:34:14.399917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e01bbb-36ff85d-ca67577d-2e142be2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.402525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Write session: try to update token
2025-10-02T09:34:14.402539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.408412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.408425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.408426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.408427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.408433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.408435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.408436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609202041:8695]
2025-10-02T09:34:14.408459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.408467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.408469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.408474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.408477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.408481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.408581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.414477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId: src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.416695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.481945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684770952:6658]
2025-10-02T09:34:14.482125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2282, pipe: [1:7556555385684770952:6658]
2025-10-02T09:34:14.515806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.516147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.516156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.516168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770952:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.516360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.516345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684770952:6658]
2025-10-02T09:34:14.516365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.516402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.516407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.516485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2283 reason: error at write: Disconnected sessionId: src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0
2025-10-02T09:34:14.516668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2283 sessionId: src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0 is DEAD
2025-10-02T09:34:14.516828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.516838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Write session will restart in 0.008730s
2025-10-02T09:34:14.516866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Write session: Do CDS request
2025-10-02T09:34:14.516871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.522682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.523657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.523764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.523771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.523776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.523803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.523825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609202166:8688]
2025-10-02T09:34:14.524439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.524638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.524666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.524874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.524908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.524912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.524912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.524913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.524913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.524914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.524915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.524915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.524916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.524916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.524917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.524917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.524920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.524930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.524933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.524936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.524939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.524942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.524945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.524948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.524951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.524955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.524957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.524960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.524966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.524972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.524978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.524981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.524983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.524986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.524988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.524991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.524993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.524996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.524998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.525000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.525003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.525009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.525011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.525014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.525016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.525018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.525021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.525023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.525025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.525031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.525033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.525036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.525053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.526150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.526242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.526252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2284
2025-10-02T09:34:14.526372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.526393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.526400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.526403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.526742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2284 sessionId:  describe result for acl check
2025-10-02T09:34:14.526780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.526786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.526788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.526794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684771040:5190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.527251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684771040:5190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.529026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684771040:5190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.532001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684771040:5190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.532010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684771040:5190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.532012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684771040:5190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.532016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.532503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.534051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.534063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.534065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.534067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.534070Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2283 [2:7556555385609202166:8688]
2025-10-02T09:34:14.534080Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.534089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.534092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.534093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.534094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.534103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.534107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.534113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.534142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.534147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.534148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.534149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.534150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.534185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.534188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.534194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.534200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.534208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.534225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771075:5190], now have 1 active actors on pipe
2025-10-02T09:34:14.534227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684770953:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.534230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.534231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.534232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.534240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.534247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.534250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.534252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.534254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.534254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.534255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.534272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.534277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.534282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.534273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2283
2025-10-02T09:34:14.534295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.534301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.534284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2283
2025-10-02T09:34:14.534319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee402907-48c0029f-7e523aaf-920632ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.534327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.534329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.534330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.534335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.534340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.534351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.534442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.534452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.534468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.534533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2284 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee402907-48c0029f-7e523aaf-920632ce_0
2025-10-02T09:34:14.534809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c64d7c11-44512cca-21de24cf-c1bf194e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee402907-48c0029f-7e523aaf-920632ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.537459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Write session: try to update token
2025-10-02T09:34:14.537478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.543401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.543414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.543415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.543416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.543420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.543422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.543424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609202161:8688]
2025-10-02T09:34:14.543449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.543454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.543460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.543464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.543467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.543478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.543598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.549966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId: src_id|ee402907-48c0029f-7e523aaf-920632ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.552185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.616608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684771082:6658]
2025-10-02T09:34:14.616866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2283, pipe: [1:7556555385684771082:6658]
2025-10-02T09:34:14.653908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.654153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.654162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.654175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771082:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.654370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.654355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.654366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.654400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.654412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2284 reason: error at write: Disconnected sessionId: src_id|ee402907-48c0029f-7e523aaf-920632ce_0
2025-10-02T09:34:14.654450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684771082:6658]
2025-10-02T09:34:14.654551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2284 sessionId: src_id|ee402907-48c0029f-7e523aaf-920632ce_0 is DEAD
2025-10-02T09:34:14.654694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.654706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Write session will restart in 0.007294s
2025-10-02T09:34:14.654732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Write session: Do CDS request
2025-10-02T09:34:14.654738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.660484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.661473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.661578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.661585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.661590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.661616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.661641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609202287:8686]
2025-10-02T09:34:14.661984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.662181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.662209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.662402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.662433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.662437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.662438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.662438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.662439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.662439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.662440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.662440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.662441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.662441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.662442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.662442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.662445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.662452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.662454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.662456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.662458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.662460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.662462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.662464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.662466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.662468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.662470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.662472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.662476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.662480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.662483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.662486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.662488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.662491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.662493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.662496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.662498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.662501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.662506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.662509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.662515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.662518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.662520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.662523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.662526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.662532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.662534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.662536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.662538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.662544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.662547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.662549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.662570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.663181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.663280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.663291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2285
2025-10-02T09:34:14.663385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.663408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.663416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.663419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.663818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2285 sessionId:  describe result for acl check
2025-10-02T09:34:14.663854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.663859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.663860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.663864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684771170:5181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.664308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684771170:5181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.665820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684771170:5181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.669492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684771170:5181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.669508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684771170:5181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.669512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684771170:5181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.669519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.669968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.671565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.671577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.671578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.671580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.671584Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2284 [2:7556555385609202287:8686]
2025-10-02T09:34:14.671592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.671601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.671603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.671604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.671606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.671614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.671617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.671621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.671651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.671653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.671654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.671656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.671657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.671705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.671709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.671718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.671729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.671743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.671761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771204:5181], now have 1 active actors on pipe
2025-10-02T09:34:14.671769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771083:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.671774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.671775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.671776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.671784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.671795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.671799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.671801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.671803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.671810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.671812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.671819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2284
2025-10-02T09:34:14.671829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.671823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2284
2025-10-02T09:34:14.671835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.671854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.671861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.671864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.671884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.671893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.671895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.671897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.671903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.671910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.671918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.672007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.672013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.672024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.672079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2285 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0
2025-10-02T09:34:14.672356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee402907-48c0029f-7e523aaf-920632ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.674858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Write session: try to update token
2025-10-02T09:34:14.674871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.680681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:14.680696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.680700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.680728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:14.680743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:14.680875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:14.680988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:14.681099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:14.681211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:14.681440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:14.681467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:14.686915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId: src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.689102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.689125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.689138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.689139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.689140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.689144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.689147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.689150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609202282:8686]
2025-10-02T09:34:14.689174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.689179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.689181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.689183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.689187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.689191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.689294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.754871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684771212:6658]
2025-10-02T09:34:14.755077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2284, pipe: [1:7556555385684771212:6658]
2025-10-02T09:34:14.797751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.797980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.797989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.798001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771212:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.798169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.798177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.798194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.798221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2285 reason: error at write: Disconnected sessionId: src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0
2025-10-02T09:34:14.798221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.798272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684771212:6658]
2025-10-02T09:34:14.798345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2285 sessionId: src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0 is DEAD
2025-10-02T09:34:14.798720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.798734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Write session will restart in 0.009221s
2025-10-02T09:34:14.798757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Write session: Do CDS request
2025-10-02T09:34:14.798762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.804317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.805350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.805459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.805465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.805470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.805499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.805527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609202407:8680]
2025-10-02T09:34:14.805924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.806102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.806128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.806313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.806343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.806347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.806348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.806348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.806349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.806350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.806350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.806351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.806351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.806352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.806352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.806353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.806355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.806362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.806364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.806367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.806368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.806371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.806373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.806375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.806376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.806379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.806381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.806383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.806386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.806390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.806393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.806396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.806398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.806402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.806404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.806407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.806409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.806412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.806414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.806417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.806419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.806421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.806423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.806426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.806428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.806431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.806433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.806435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.806438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.806440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.806442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.806445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.806462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.809169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.809272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.809281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2286
2025-10-02T09:34:14.809402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.809421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.809427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.809430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.809799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2286 sessionId:  describe result for acl check
2025-10-02T09:34:14.809841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.809849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.809851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.809855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684771304:5170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.810321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684771304:5170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.811698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684771304:5170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.813597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684771304:5170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.813610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684771304:5170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.813616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684771304:5170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.813621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.813894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.815426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.815439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.815440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.815443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.815446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2285 [2:7556555385609202407:8680]
2025-10-02T09:34:14.815455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.815465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.815468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.815470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.815471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.815481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.815486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.815491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.815522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.815526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.815527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.815529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.815530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.815611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.815618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.815629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.815642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.815651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2285
2025-10-02T09:34:14.815660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.815660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2285
2025-10-02T09:34:14.815679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771215:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.815686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771338:5170], now have 1 active actors on pipe
2025-10-02T09:34:14.815690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.815692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.815693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.815699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.815705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.815707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.815708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.815711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.815722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.815728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.815743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.815749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.815769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.815777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.815786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.815789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.815794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.815797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.815799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.815805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.815814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.815839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.815935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.815942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.815954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.816011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2286 partition: 0 MaxSeqNo: 36 sessionId: src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0
2025-10-02T09:34:14.816243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c33df69-bc854920-e28eb6ef-7b4f780d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.818893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Write session: try to update token
2025-10-02T09:34:14.818907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.824858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.824868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.824869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.824870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.824873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.824877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.824879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609202402:8680]
2025-10-02T09:34:14.824901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.824908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.824910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.824912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.824912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.824915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.825018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.831423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId: src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.833575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:14.898204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555385684771353:6658]
2025-10-02T09:34:14.898392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2285, pipe: [1:7556555385684771353:6658]
2025-10-02T09:34:14.935265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:14.935566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.935576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.935589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771353:6658], now have 1 active actors on pipe
2025-10-02T09:34:14.935798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:14.935783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555385684771353:6658]
2025-10-02T09:34:14.935802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:14.935803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:14.935828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:14.935848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2286 reason: error at write: Disconnected sessionId: src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0
2025-10-02T09:34:14.935974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2286 sessionId: src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0 is DEAD
2025-10-02T09:34:14.936162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:14.936182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Write session will restart in 0.009990s
2025-10-02T09:34:14.936216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Write session: Do CDS request
2025-10-02T09:34:14.936224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:14.942294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:14.943352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:14.943531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:14.943540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:14.943547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:14.943584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:14.943607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555385609202543:8678]
2025-10-02T09:34:14.943954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:14.944156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:14.944185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:14.944374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:14.944407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.944411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.944411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.944412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.944413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.944413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.944414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.944415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.944415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.944416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.944416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.944417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.944420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.944426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.944428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.944430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.944432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.944435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.944437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.944438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.944440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.944443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.944445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.944447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.944450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.944454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:14.944457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.944461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:14.944463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.944466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:14.944468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.944472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:14.944474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.944477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:14.944479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.944482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:14.944484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.944486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:14.944488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.944491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:14.944493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.944496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:14.944498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.944501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.944503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.944505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.944507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.944510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.944526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:14.947226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.947309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:14.947319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2287
2025-10-02T09:34:14.947427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:14.947445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:14.947451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:14.947453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:14.947685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2287 sessionId:  describe result for acl check
2025-10-02T09:34:14.947705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:14.947709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:14.947710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:14.947712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555385684771447:5144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:14.948040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555385684771447:5144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:14.949350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555385684771447:5144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:14.951540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555385684771447:5144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:14.951548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555385684771447:5144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:14.951550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555385684771447:5144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:14.951553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:14.952083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:14.953605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:14.953618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:14.953619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:14.953621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:14.953624Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2286 [2:7556555385609202543:8678]
2025-10-02T09:34:14.953632Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:14.953642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:14.953643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.953645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.953648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.953657Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:14.953664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:14.953669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:14.953700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.953705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.953706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.953708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:14.953710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:14.953746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:14.953751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.953758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:14.953764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:14.953775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:14.953792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771481:5144], now have 1 active actors on pipe
2025-10-02T09:34:14.953800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555385684771354:2446], now have 1 active actors on pipe
2025-10-02T09:34:14.953805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.953807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.953808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.953818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:14.953830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:14.953832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:14.953838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:14.953830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2286
2025-10-02T09:34:14.953839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:14.953841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:14.953843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:14.953859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.953860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:14.953862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:14.953858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2286
2025-10-02T09:34:14.953871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.953876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.953902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|307c32cb-6d3d6c89-51de3c95-36743063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:14.953909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:14.953911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:14.953912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:14.953917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:14.953925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:14.953937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.954030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:14.954035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:14.954045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:14.954098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2287 partition: 0 MaxSeqNo: 36 sessionId: src_id|307c32cb-6d3d6c89-51de3c95-36743063_0
2025-10-02T09:34:14.954326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cb6758-80bbd09e-4716eb54-ffa4b9a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|307c32cb-6d3d6c89-51de3c95-36743063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:14.956925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Write session: try to update token
2025-10-02T09:34:14.956939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:14.963504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:14.963516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:14.963518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:14.963519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:14.963523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.963526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.963528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555385609202529:8678]
2025-10-02T09:34:14.963553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:14.963555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:14.963556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:14.963559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:14.963561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:14.963562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:14.963723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:14.969465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId: src_id|307c32cb-6d3d6c89-51de3c95-36743063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:14.971618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.035951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979738807:6658]
2025-10-02T09:34:15.036137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2286, pipe: [1:7556555389979738807:6658]
2025-10-02T09:34:15.078511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.078791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.078801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.078818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979738807:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.078951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:15.078992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.079001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979738807:6658]
2025-10-02T09:34:15.079113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:15.079170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2287 reason: status is not ok: tablet will be restarted right now sessionId: src_id|307c32cb-6d3d6c89-51de3c95-36743063_0
2025-10-02T09:34:15.079312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2287 sessionId: src_id|307c32cb-6d3d6c89-51de3c95-36743063_0 is DEAD
2025-10-02T09:34:15.079472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:15.079488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Write session will restart in 0.005863s
2025-10-02T09:34:15.079510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Write session: Do CDS request
2025-10-02T09:34:15.079516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.085389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.086148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.086275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.086281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2288
2025-10-02T09:34:15.086378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.086401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.086423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.086429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.086432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.086530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.086538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.086546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.086600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.086633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170000:8656]
2025-10-02T09:34:15.086698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2288 sessionId:  describe result for acl check
2025-10-02T09:34:15.086719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.086723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.086724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.086727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979738906:5116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.087010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.087068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979738906:5116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.087216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.087250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.087509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.087566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.087571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.087572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.087573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.087574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.087575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.087576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.087577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.087578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.087579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.087581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.087582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.087587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.087597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.087601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.087605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.087609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.087612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.087616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.087620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.087623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.087626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.087630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.087633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.087639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.087645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.087650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.087655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.087663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.087668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.087671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.087677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.087681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.087687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.087691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.087695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.087699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.087704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.087709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.087714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.087719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.087724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.087729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.087734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.087738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.087746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.087750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.087755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.087785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.088533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979738906:5116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.093782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979738906:5116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.093801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979738906:5116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.093809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979738906:5116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.093822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.095326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.096851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.096862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.096863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.096866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.096870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2287 [2:7556555389904170000:8656]
2025-10-02T09:34:15.096877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.096887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.096892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.096894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.096895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.096904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.096910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.096915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.096949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.096954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.096955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.096957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.096958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.096997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.097002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.097008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.097014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.097025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.097040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979738945:5116], now have 1 active actors on pipe
2025-10-02T09:34:15.097045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979738820:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.097048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.097051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.097052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.097059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.097069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.097073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.097075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.097076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.097078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.097080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.097094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.097099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.097086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2287
2025-10-02T09:34:15.097101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.097110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.097115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.097124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2287
2025-10-02T09:34:15.097144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb870aef-14963476-323127be-b79dec47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.097151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.097153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.097155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.097160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.097165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.097177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.097271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.097277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.097284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.097330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2288 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb870aef-14963476-323127be-b79dec47_0
2025-10-02T09:34:15.097589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307c32cb-6d3d6c89-51de3c95-36743063_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb870aef-14963476-323127be-b79dec47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.100299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Write session: try to update token
2025-10-02T09:34:15.100310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.106447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.106464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.106466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.106467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.106473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.106476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.106480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904169995:8656]
2025-10-02T09:34:15.106508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.106517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.106519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.106525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.106528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.106531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.106651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.112795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId: src_id|eb870aef-14963476-323127be-b79dec47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.115098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.179282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979738952:6658]
2025-10-02T09:34:15.179503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2287, pipe: [1:7556555389979738952:6658]
2025-10-02T09:34:15.220286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.220586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.220596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.220610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979738952:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.220786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979738952:6658]
2025-10-02T09:34:15.220822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:15.220826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.221051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:15.221142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb870aef-14963476-323127be-b79dec47_0
2025-10-02T09:34:15.221299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2288 sessionId: src_id|eb870aef-14963476-323127be-b79dec47_0 is DEAD
2025-10-02T09:34:15.221427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:15.221436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Write session will restart in 0.006069s
2025-10-02T09:34:15.221451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Write session: Do CDS request
2025-10-02T09:34:15.221455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.228165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.228360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.228370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2289
2025-10-02T09:34:15.228443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.228489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.228510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.228516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.228519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.228924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2289 sessionId:  describe result for acl check
2025-10-02T09:34:15.228969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.228981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.228982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.228988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979739041:5091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.229438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979739041:5091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.229437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.229568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.229575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.229581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.229668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.229694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170125:8654]
2025-10-02T09:34:15.230042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.230236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.230264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.230446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.230475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.230479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.230479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.230480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.230480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.230481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.230482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.230483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.230483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.230484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.230484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.230485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.230487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.230494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.230496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.230498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.230500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.230502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.230504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.230506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.230508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.230510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.230512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.230514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.230518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.230523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.230527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.230530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.230532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.230535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.230537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.230541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.230543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.230545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.230547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.230550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.230553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.230555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.230559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.230561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.230567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.230570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.230572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.230575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.230580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.230583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.230593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.230601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.230624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.230989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979739041:5091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.235472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979739041:5091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.235485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979739041:5091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.235488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979739041:5091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.235494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.238071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.239634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.239646Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.239647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.239649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.239654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2288 [2:7556555389904170125:8654]
2025-10-02T09:34:15.239661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.239672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.239674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.239675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.239676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.239686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.239691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.239698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.239727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.239732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.239733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.239735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.239737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.239784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.239791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.239800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.239810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.239827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.239844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979738954:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.239851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739080:5091], now have 1 active actors on pipe
2025-10-02T09:34:15.239857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.239858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.239860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.239872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.239885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.239886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.239889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.239891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.239901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.239903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.239891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2288
2025-10-02T09:34:15.239922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2288
2025-10-02T09:34:15.239921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.239927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.239928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.239938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.239944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.240026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.240038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.240042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.240044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.240050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.240062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.240082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.240180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.240187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.240198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.240256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2289 partition: 0 MaxSeqNo: 36 sessionId: src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0
2025-10-02T09:34:15.240544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb870aef-14963476-323127be-b79dec47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.243410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Write session: try to update token
2025-10-02T09:34:15.243430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.249393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.249406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.249407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.249408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.249411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.249414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.249416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904170120:8654]
2025-10-02T09:34:15.249440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.249446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.249447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.249459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.249472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.249479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.249575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.255918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId: src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.258065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.321128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979739089:6658]
2025-10-02T09:34:15.321286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2288, pipe: [1:7556555389979739089:6658]
2025-10-02T09:34:15.363689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.363938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.363947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.363959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739089:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.364134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.364162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979739089:6658]
2025-10-02T09:34:15.364165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:15.364202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:15.364217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:15.364294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2289 reason: error at write: Disconnected sessionId: src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0
2025-10-02T09:34:15.364440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2289 sessionId: src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0 is DEAD
2025-10-02T09:34:15.364591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:15.364605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Write session will restart in 0.008469s
2025-10-02T09:34:15.364628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Write session: Do CDS request
2025-10-02T09:34:15.364633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.370900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.371891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.371994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.372000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.372006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.372033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.372058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170254:8649]
2025-10-02T09:34:15.372400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.372599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.372625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.372823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.372857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.372863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.372864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.372864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.372865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.372865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.372866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.372866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.372867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.372867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.372868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.372868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.372871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.372878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.372880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.372882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.372884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.372887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.372889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.372890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.372892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.372895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.372896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.372898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.372903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.372907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.372910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.372913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.372915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.372918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.372920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.372922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.372924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.372927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.372929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.372931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.372934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.372936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.372938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.372941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.372944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.372947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.372949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.372952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.372954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.372956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.372960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.372963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.372980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.374239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.374344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.374353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2290
2025-10-02T09:34:15.374473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.374495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.374501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.374503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.374887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2290 sessionId:  describe result for acl check
2025-10-02T09:34:15.374929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.374935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.374937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.374941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979739182:5074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.375383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979739182:5074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.376927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979739182:5074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.380319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979739182:5074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.380332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979739182:5074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.380334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979739182:5074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.380341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.380731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.382241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.382258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.382260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.382263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.382267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2289 [2:7556555389904170254:8649]
2025-10-02T09:34:15.382277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.382290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.382292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.382294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.382296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.382309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.382314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.382323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.382359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.382364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.382366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.382369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.382371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.382415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.382420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.382431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.382442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.382460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.382478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739091:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.382484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739217:5074], now have 1 active actors on pipe
2025-10-02T09:34:15.382478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2289
2025-10-02T09:34:15.382489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.382495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2289
2025-10-02T09:34:15.382492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.382494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.382500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.382506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.382511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.382515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.382517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.382523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.382525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.382542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.382549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.382572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.382582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.382597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.382604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.382608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.382611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.382613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.382620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.382630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.382655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.382750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.382756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.382766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.382817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2290 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0
2025-10-02T09:34:15.383058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e454f3b7-716bf9-26f8d3b2-bf17d383_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.385775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Write session: try to update token
2025-10-02T09:34:15.385789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.391914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.391929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.391931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.391932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.391936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.391939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.391944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904170248:8649]
2025-10-02T09:34:15.391972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.391977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.391979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.391988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.392001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.392005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.392101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.397854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId: src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.399984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.464489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979739224:6658]
2025-10-02T09:34:15.464722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2289, pipe: [1:7556555389979739224:6658]
2025-10-02T09:34:15.500537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.500754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.500763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.500777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739224:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.500975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:15.500988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979739224:6658]
2025-10-02T09:34:15.501011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:15.501013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:15.501040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.501109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2290 reason: error at write: Disconnected sessionId: src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0
2025-10-02T09:34:15.501230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2290 sessionId: src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0 is DEAD
2025-10-02T09:34:15.501378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:15.501391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Write session will restart in 0.006624s
2025-10-02T09:34:15.501412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Write session: Do CDS request
2025-10-02T09:34:15.501417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.507299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.508280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.508383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.508390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.508395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.508421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.508445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170381:8632]
2025-10-02T09:34:15.508786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.508999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.509027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.509152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.509211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.509218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.509224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2291
2025-10-02T09:34:15.509241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.509245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.509246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.509247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.509247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.509248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.509248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.509249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.509249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.509249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.509250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.509251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.509253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.509260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.509262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.509264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.509266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.509268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.509270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.509272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.509274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.509276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.509278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.509280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.509284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.509289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.509292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.509295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.509297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.509300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.509302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.509305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.509307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.509310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.509312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.509315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.509317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.509320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.509322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.509325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.509327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.509330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.509332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.509335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.509337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.509340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.509343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.509346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.509364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.509400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.509416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.509421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.509424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.509793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2291 sessionId:  describe result for acl check
2025-10-02T09:34:15.509839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.509848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.509850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.509855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979739318:5068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.510315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979739318:5068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.512040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979739318:5068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.516691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979739318:5068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.516703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979739318:5068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.516707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979739318:5068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.516714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.517170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.518630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.518641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.518642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.518645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.518648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2290 [2:7556555389904170381:8632]
2025-10-02T09:34:15.518657Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.518667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.518668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.518670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.518671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.518681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.518688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.518692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.518724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.518729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.518730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.518731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.518733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.518849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2290
2025-10-02T09:34:15.518852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.518860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.518870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.518881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.518888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2290
2025-10-02T09:34:15.518900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.518920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739352:5068], now have 1 active actors on pipe
2025-10-02T09:34:15.518927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739225:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.518936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.518941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.518954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.518958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.518960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.518969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.518980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.518983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.518985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.518986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.518997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.518999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.519010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.519018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.519022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.519024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.519031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.519043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.519063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.519071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.519079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.519081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.519173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.519180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.519192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.519238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2291 partition: 0 MaxSeqNo: 36 sessionId: src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0
2025-10-02T09:34:15.519449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac13387e-7f03a6ee-826e7367-557b87a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.522150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Write session: try to update token
2025-10-02T09:34:15.522164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.528535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:15.528547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.528552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.528579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:15.528591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:15.528720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:15.528850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:15.528962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:15.529076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:15.529356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:15.529380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:15.534477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId: src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.536660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.537504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.537519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.537529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.537531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.537532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.537533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.537537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.537539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.537541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904170376:8632]
2025-10-02T09:34:15.537573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.537579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.537581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.537583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.537583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.537586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.537697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.601196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979739361:6658]
2025-10-02T09:34:15.601437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2290, pipe: [1:7556555389979739361:6658]
2025-10-02T09:34:15.649225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.649468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:15.649494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739361:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.649579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:15.649640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:15.649638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.649646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:15.649689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2291 reason: error at write: Disconnected sessionId: src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0
2025-10-02T09:34:15.649695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979739361:6658]
2025-10-02T09:34:15.649786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2291 sessionId: src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0 is DEAD
2025-10-02T09:34:15.649928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:15.649941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Write session will restart in 0.005089s
2025-10-02T09:34:15.649962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Write session: Do CDS request
2025-10-02T09:34:15.649971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.656195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.656290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.656297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2292
2025-10-02T09:34:15.656361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.656399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.656418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.656424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.656426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.656817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2292 sessionId:  describe result for acl check
2025-10-02T09:34:15.656858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.656865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.656866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.656871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979739451:5048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.657331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979739451:5048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.657387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.657510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.657517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.657524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.657564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.657586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170508:8644]
2025-10-02T09:34:15.657933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.658145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.658173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.658359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.658389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.658393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.658393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.658394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.658395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.658395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.658396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.658396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.658397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.658397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.658398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.658398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.658401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.658408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.658411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.658413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.658415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.658417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.658419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.658421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.658423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.658425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.658427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.658429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.658434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.658438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.658441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.658444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.658446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.658449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.658451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.658453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.658456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.658458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.658460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.658463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.658465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.658470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.658473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.658475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.658477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.658480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.658482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.658485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.658487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.658489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.658491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.658494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.658511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.659095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979739451:5048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.663633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979739451:5048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.663645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979739451:5048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.663647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979739451:5048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.663654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.666319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.668043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.668054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.668055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.668058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.668061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2291 [2:7556555389904170508:8644]
2025-10-02T09:34:15.668068Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.668078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.668079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.668081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.668082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.668091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.668098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.668102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.668134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.668139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.668140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.668142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.668143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.668189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.668196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.668206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.668219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.668237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.668253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739491:5048], now have 1 active actors on pipe
2025-10-02T09:34:15.668256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739362:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.668260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.668261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.668262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.668271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.668271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2291
2025-10-02T09:34:15.668285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.668291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2291
2025-10-02T09:34:15.668288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.668290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.668291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.668301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.668305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.668331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.668338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.668349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.668357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.668372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.668378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.668383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.668387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.668391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.668398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.668408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.668428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.668517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.668523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.668533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.668593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2292 partition: 0 MaxSeqNo: 36 sessionId: src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0
2025-10-02T09:34:15.668861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ef7e6d-20f39bcf-8b43f2a8-cdf9ccfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.671421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Write session: try to update token
2025-10-02T09:34:15.671436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.677914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.677928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.677929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.677930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.677934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.677939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.677941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904170503:8644]
2025-10-02T09:34:15.677965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.677968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.677970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.677983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.677998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.678001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.678115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.683605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId: src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.685791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.749690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979739499:6658]
2025-10-02T09:34:15.749961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2291, pipe: [1:7556555389979739499:6658]
2025-10-02T09:34:15.787976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.788216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.788225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.788250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739499:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.788443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979739499:6658]
2025-10-02T09:34:15.788461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.788472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:15.788514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:15.788529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:15.788605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2292 reason: error at write: Disconnected sessionId: src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0
2025-10-02T09:34:15.788762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2292 sessionId: src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0 is DEAD
2025-10-02T09:34:15.788929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:15.788940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Write session will restart in 0.005868s
2025-10-02T09:34:15.788960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Write session: Do CDS request
2025-10-02T09:34:15.788965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.795334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.796143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.796226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.796234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2293
2025-10-02T09:34:15.796349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.796354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.796374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.796380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.796383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.796452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.796459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.796465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.796493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.796515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170636:8643]
2025-10-02T09:34:15.796729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2293 sessionId:  describe result for acl check
2025-10-02T09:34:15.796764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.796771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.796772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.796776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979739591:5035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.796872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.797076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.797104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.797231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979739591:5035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.797289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.797318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.797322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.797323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.797323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.797324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.797324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.797325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.797325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.797326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.797327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.797327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.797327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.797331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.797337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.797339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.797342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.797344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.797346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.797348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.797350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.797352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.797354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.797356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.797358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.797363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.797367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.797370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.797373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.797375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.797377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.797379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.797382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.797385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.797392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.797394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.797396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.797399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.797401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.797403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.797406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.797408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.797411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.797415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.797417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.797419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.797422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.797424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.797427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.797445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.798765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979739591:5035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.803010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979739591:5035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.803021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979739591:5035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.803027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979739591:5035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.803032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.805233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.806741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.806753Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.806754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.806756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.806760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2292 [2:7556555389904170636:8643]
2025-10-02T09:34:15.806767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.806776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.806778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.806779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.806781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.806790Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.806797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.806801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.806830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.806835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.806836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.806838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.806839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.806883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.806889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.806898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.806908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.806925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.806944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739500:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.806951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739630:5035], now have 1 active actors on pipe
2025-10-02T09:34:15.806955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.806956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.806957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.806967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.806964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2292
2025-10-02T09:34:15.806977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2292
2025-10-02T09:34:15.806980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.806981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.806983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.806986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.806996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.806998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.807026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.807032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.807042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.807052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.807064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.807070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.807075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.807078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.807079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.807086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.807097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.807114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.807199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.807206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.807216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.807277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2293 partition: 0 MaxSeqNo: 36 sessionId: src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0
2025-10-02T09:34:15.807532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daec9ded-ab9cdfa2-6d5d2307-d1f41e5b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.810027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Write session: try to update token
2025-10-02T09:34:15.810041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.816818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.816829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.816831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.816831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.816835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.816837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.816839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904170631:8643]
2025-10-02T09:34:15.816863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.816871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.816873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.816884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.816895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.816898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.816984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.822102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId: src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.824258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:15.888407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555389979739645:6658]
2025-10-02T09:34:15.888575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2292, pipe: [1:7556555389979739645:6658]
2025-10-02T09:34:15.926352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:15.926660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.926669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.926696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739645:6658], now have 1 active actors on pipe
2025-10-02T09:34:15.926867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555389979739645:6658]
2025-10-02T09:34:15.926900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:15.926920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:15.926971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:15.926976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:15.927013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2293 reason: error at write: Disconnected sessionId: src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0
2025-10-02T09:34:15.927150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2293 sessionId: src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0 is DEAD
2025-10-02T09:34:15.927318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:15.927332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Write session will restart in 0.005244s
2025-10-02T09:34:15.927353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Write session: Do CDS request
2025-10-02T09:34:15.927359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:15.933215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.933304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:15.933310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2294
2025-10-02T09:34:15.933430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:15.933448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:15.933454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:15.933457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:15.933782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2294 sessionId:  describe result for acl check
2025-10-02T09:34:15.933807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:15.933811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:15.933812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:15.933815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555389979739736:4998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:15.934183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555389979739736:4998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:15.934172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:15.935212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:15.935333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555389979739736:4998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:15.935368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:15.935376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:15.935382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:15.935415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:15.935438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555389904170766:8641]
2025-10-02T09:34:15.935773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:15.935966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:15.935995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:15.936184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:15.936214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.936218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.936219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.936219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.936220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.936221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.936221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.936222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.936222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.936223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.936223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.936224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.936227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.936233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.936235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.936238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.936239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.936241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.936243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.936245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.936247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.936250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.936252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.936253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.936257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.936261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:15.936265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.936268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:15.936270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.936273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:15.936275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.936278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:15.936282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.936284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:15.936288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.936290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:15.936293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.936295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:15.936297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.936300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:15.936304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.936307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:15.936309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.936311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.936313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.936316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.936320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.936322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.936339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:15.940293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555389979739736:4998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:15.940300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555389979739736:4998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:15.940302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555389979739736:4998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:15.940306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:15.944104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:15.945642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:15.945654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:15.945655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:15.945657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:15.945661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2293 [2:7556555389904170766:8641]
2025-10-02T09:34:15.945667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:15.945678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:15.945683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.945684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.945686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.945694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:15.945700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:15.945705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:15.945735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.945740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.945741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.945743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:15.945744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:15.945787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:15.945793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.945802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:15.945812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:15.945829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:15.945847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739646:2446], now have 1 active actors on pipe
2025-10-02T09:34:15.945854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555389979739780:4998], now have 1 active actors on pipe
2025-10-02T09:34:15.945858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.945860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.945861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.945869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:15.945884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:15.945884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:15.945886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:15.945879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2293
2025-10-02T09:34:15.945888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:15.945878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2293
2025-10-02T09:34:15.945900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:15.945904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:15.945931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.945938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.945945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.945953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:15.945964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:15.945973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:15.945980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:15.945984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:15.945986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:15.945994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:15.946004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:15.946022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.946119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:15.946126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:15.946137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:15.946194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2294 partition: 0 MaxSeqNo: 36 sessionId: src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0
2025-10-02T09:34:15.946452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edf2d32-c8611dd1-9ebdda22-32d8a016_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:15.950291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Write session: try to update token
2025-10-02T09:34:15.950319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:15.955417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:15.955430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:15.955431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:15.955432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:15.955435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.955437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.955439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555389904170761:8641]
2025-10-02T09:34:15.955463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:15.955467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:15.955468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:15.955480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:15.955491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:15.955494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:15.955579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:15.967304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId: src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:15.969538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.027176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707097:6658]
2025-10-02T09:34:16.027368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2293, pipe: [1:7556555394274707097:6658]
2025-10-02T09:34:16.066752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.066979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.066988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.067000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707097:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.067132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.067136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:16.067138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:16.067164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707097:6658]
2025-10-02T09:34:16.067176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2294 reason: error at write: Disconnected sessionId: src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0
2025-10-02T09:34:16.067175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.067308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2294 sessionId: src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0 is DEAD
2025-10-02T09:34:16.067460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:16.067482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Write session will restart in 0.006909s
2025-10-02T09:34:16.067505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Write session: Do CDS request
2025-10-02T09:34:16.067510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.074003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.075014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.075122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.075128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.075134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.075155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.075161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.075185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199138243:8603]
2025-10-02T09:34:16.075251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.075260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2295
2025-10-02T09:34:16.075370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.075387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.075393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.075396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.075526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.075648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2295 sessionId:  describe result for acl check
2025-10-02T09:34:16.075668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.075672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.075673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.075676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274707214:4965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.075728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.075758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.075940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.075948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274707214:4965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.075969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.075975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.075976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.075976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.075977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.075977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.075978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.075978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.075979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.075979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.075980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.075981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.075984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.075990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.075992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.075994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.075996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.075998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.076000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.076002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.076004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.076006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.076008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.076010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.076014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.076018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.076021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.076024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.076026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.076029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.076032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.076035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.076037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.076039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.076042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.076045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.076047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.076050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.076052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.076054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.076056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.076059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.076061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.076063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.076065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.076068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.076070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.076073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.076090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.077157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274707214:4965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.081606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274707214:4965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.081614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274707214:4965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.081618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274707214:4965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.081681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.083914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.085406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.085417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.085418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.085421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.085425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2294 [2:7556555394199138243:8603]
2025-10-02T09:34:16.085431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.085441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.085442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.085444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.085445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.085453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.085456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.085460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.085490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.085495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.085497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.085498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.085500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.085550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.085556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.085566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.085579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.085597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.085614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707251:4965], now have 1 active actors on pipe
2025-10-02T09:34:16.085620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707119:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.085624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.085625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.085626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.085635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.085648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.085650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.085652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.085645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2294
2025-10-02T09:34:16.085654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.085664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.085662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2294
2025-10-02T09:34:16.085666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.085683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.085689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.085690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.085699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.085705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.085741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.085750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.085753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.085754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.085761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.085771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.085787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.085890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.085896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.085907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.085971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2295 partition: 0 MaxSeqNo: 36 sessionId: src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0
2025-10-02T09:34:16.086230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd1781-e593f8b9-d279d4f4-b7ef9c64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.088773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Write session: try to update token
2025-10-02T09:34:16.088785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.095253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.095266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.095267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.095268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.095271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.095274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.095275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199138238:8603]
2025-10-02T09:34:16.095299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.095310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.095311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.095317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.095330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.095333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.095432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.100677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId: src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.102815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.167445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707258:6658]
2025-10-02T09:34:16.167616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2294, pipe: [1:7556555394274707258:6658]
2025-10-02T09:34:16.203044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.203310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.203318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.203345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707258:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.203517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:16.203525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:16.203565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2295 reason: error at write: Disconnected sessionId: src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0
2025-10-02T09:34:16.203705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2295 sessionId: src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0 is DEAD
2025-10-02T09:34:16.203770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.203843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707258:6658]
2025-10-02T09:34:16.203873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:16.203886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Write session will restart in 0.006432s
2025-10-02T09:34:16.203907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Write session: Do CDS request
2025-10-02T09:34:16.203912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.204263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.210377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.211150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.211419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.211524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.211531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.211537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.211575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.211603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199138375:8615]
2025-10-02T09:34:16.211690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.211698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2296
2025-10-02T09:34:16.211812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.211830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.211835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.211838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.211944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.212145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.212172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.212203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2296 sessionId:  describe result for acl check
2025-10-02T09:34:16.212238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.212245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.212246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.212251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274707356:4952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.212354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.212383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.212387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.212388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.212388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.212389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.212389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.212390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.212390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.212391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.212391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.212392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.212392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.212395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.212402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.212404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.212406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.212408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.212410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.212412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.212414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.212415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.212418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.212419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.212421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.212426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.212430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.212433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.212436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.212438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.212440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.212442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.212445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.212447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.212450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.212452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.212455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.212457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.212460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.212462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.212465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.212467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.212471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.212473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.212476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.212478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.212480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.212482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.212485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.212501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.212727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274707356:4952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.214481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274707356:4952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.219113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274707356:4952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.219124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274707356:4952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.219126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274707356:4952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.219132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.220282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.221839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.221851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.221852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.221854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.221857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2295 [2:7556555394199138375:8615]
2025-10-02T09:34:16.221865Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.221874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.221879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.221881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.221882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.221891Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.221896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.221900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.221932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.221937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.221938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.221940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.221941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.221988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.221995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.222004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.222018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.222034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.222053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707393:4952], now have 1 active actors on pipe
2025-10-02T09:34:16.222060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707260:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.222064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.222070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.222071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.222067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2295
2025-10-02T09:34:16.222081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.222083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2295
2025-10-02T09:34:16.222094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.222096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.222099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.222100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.222109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.222115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.222137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.222144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.222153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.222161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.222177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.222185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1908b28-16768b16-dab88e3d-15786828_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.222190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.222193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.222198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.222205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.222216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.222236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.222315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.222321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.222332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.222392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2296 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1908b28-16768b16-dab88e3d-15786828_0
2025-10-02T09:34:16.222610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c722b331-b6e0b5e-2576e615-fdf5e7eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1908b28-16768b16-dab88e3d-15786828_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.225165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Write session: try to update token
2025-10-02T09:34:16.225181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.231748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.231761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.231763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.231764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.231768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.231770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.231772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199138370:8615]
2025-10-02T09:34:16.231796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.231800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.231806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.231812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.231816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.231819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.231916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.237087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId: src_id|d1908b28-16768b16-dab88e3d-15786828_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.239231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.304147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707402:6658]
2025-10-02T09:34:16.304340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2295, pipe: [1:7556555394274707402:6658]
2025-10-02T09:34:16.340111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.340311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.340320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.340345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707402:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.340505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:16.340514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:16.340558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2296 reason: error at write: Disconnected sessionId: src_id|d1908b28-16768b16-dab88e3d-15786828_0
2025-10-02T09:34:16.340560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.340571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707402:6658]
2025-10-02T09:34:16.340603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.340694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2296 sessionId: src_id|d1908b28-16768b16-dab88e3d-15786828_0 is DEAD
2025-10-02T09:34:16.340865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:16.340880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Write session will restart in 0.006464s
2025-10-02T09:34:16.340900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Write session: Do CDS request
2025-10-02T09:34:16.340905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.347645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.348167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.348267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.348275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2297
2025-10-02T09:34:16.348404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.348426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.348434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.348437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.348775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.348793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2297 sessionId:  describe result for acl check
2025-10-02T09:34:16.348850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.348861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.348863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.348869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274707499:4943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.348917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.348925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.348931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.348964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.348988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199138510:8613]
2025-10-02T09:34:16.349337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274707499:4943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.349339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.349535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.349568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.349795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.349841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.349846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.349847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.349848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.349849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.349850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.349851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.349852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.349853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.349853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.349854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.349855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.349860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.349870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.349872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.349874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.349876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.349878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.349880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.349882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.349884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.349887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.349889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.349891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.349896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.349900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.349905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.349908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.349911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.349914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.349916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.349919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.349921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.349924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.349926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.349929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.349932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.349934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.349937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.349939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.349943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.349946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.349948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.349951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.349953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.349956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.349959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.349964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.349981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.350693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274707499:4943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.356020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274707499:4943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.356032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274707499:4943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.356034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274707499:4943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.356039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.357757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.359283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.359294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.359295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.359297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.359302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2296 [2:7556555394199138510:8613]
2025-10-02T09:34:16.359308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.359318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.359323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.359325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.359326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.359336Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.359338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.359342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.359377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.359382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.359383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.359385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.359386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.359430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.359436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.359446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.359460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.359477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.359495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707539:4943], now have 1 active actors on pipe
2025-10-02T09:34:16.359501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707404:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.359505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.359507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.359508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.359516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.359529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.359520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2296
2025-10-02T09:34:16.359530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.359532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.359533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2296
2025-10-02T09:34:16.359534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.359546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.359548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.359576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.359583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.359593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.359601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.359611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.359627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.359636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.359638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.359640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.359648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.359659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.359675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.359770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.359777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.359787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.359851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2297 partition: 0 MaxSeqNo: 36 sessionId: src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0
2025-10-02T09:34:16.360102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1908b28-16768b16-dab88e3d-15786828_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.362642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Write session: try to update token
2025-10-02T09:34:16.362654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.369056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.369067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.369068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.369069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.369073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.369076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.369078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199138505:8613]
2025-10-02T09:34:16.369102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.369110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.369111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.369119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.369122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.369125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.369220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.374841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId: src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.377021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.440870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707546:6658]
2025-10-02T09:34:16.441073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2296, pipe: [1:7556555394274707546:6658]
2025-10-02T09:34:16.477682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.477925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.477933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.477946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707546:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.478162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.478160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:16.478168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:16.478211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2297 reason: error at write: Disconnected sessionId: src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0
2025-10-02T09:34:16.478217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.478266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707546:6658]
2025-10-02T09:34:16.478348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2297 sessionId: src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0 is DEAD
2025-10-02T09:34:16.478502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:16.478516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Write session will restart in 0.006313s
2025-10-02T09:34:16.478543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Write session: Do CDS request
2025-10-02T09:34:16.478548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.485758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.486173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.486277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.486284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2298
2025-10-02T09:34:16.486390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.486409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.486417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.486420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.486715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2298 sessionId:  describe result for acl check
2025-10-02T09:34:16.486734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.486739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.486740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.486743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274707643:4935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.486811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.486929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.486936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.486942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.486969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.486995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199138642:8611]
2025-10-02T09:34:16.487100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274707643:4935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.487338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.487566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.487597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.487782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.487812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.487816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.487817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.487817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.487818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.487818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.487819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.487819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.487820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.487820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.487821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.487821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.487824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.487830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.487833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.487835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.487837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.487839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.487841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.487843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.487845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.487848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.487849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.487851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.487855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.487859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.487862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.487865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.487867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.487870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.487872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.487875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.487877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.487881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.487883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.487886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.487889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.487892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.487894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.487896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.487899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.487902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.487904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.487906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.487909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.487911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.487913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.487916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.487934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.488465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274707643:4935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.492861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274707643:4935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.492876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274707643:4935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.492879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274707643:4935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.492887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.495603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.497231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.497243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.497244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.497247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.497250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2297 [2:7556555394199138642:8611]
2025-10-02T09:34:16.497257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.497267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.497272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.497274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.497275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.497284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.497290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.497294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.497329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.497333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.497334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.497336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.497338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.497385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.497392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.497401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.497414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.497430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.497449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707682:4935], now have 1 active actors on pipe
2025-10-02T09:34:16.497455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707547:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.497460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.497462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.497463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.497473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.497487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.497488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.497490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.497478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2297
2025-10-02T09:34:16.497491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.497503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.497486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2297
2025-10-02T09:34:16.497505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.497525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.497532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.497533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.497545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.497553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.497585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7672db6f-6a4a366-37cbc608-895efc3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.497595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.497598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.497600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.497607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.497618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.497637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.497745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.497752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.497762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.497823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2298 partition: 0 MaxSeqNo: 36 sessionId: src_id|7672db6f-6a4a366-37cbc608-895efc3b_0
2025-10-02T09:34:16.498023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a132f5a9-fdfd424-be362bae-f1789a3c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7672db6f-6a4a366-37cbc608-895efc3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.500909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Write session: try to update token
2025-10-02T09:34:16.500927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.507176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.507189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.507191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.507192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.507196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.507198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.507200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199138637:8611]
2025-10-02T09:34:16.507227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.507235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.507237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.507240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.507244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.507247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.507357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.513624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId: src_id|7672db6f-6a4a366-37cbc608-895efc3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.515814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.578600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707693:6658]
2025-10-02T09:34:16.578833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2297, pipe: [1:7556555394274707693:6658]
2025-10-02T09:34:16.621180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.621511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.621526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.621540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707693:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.621716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.621750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707693:6658]
2025-10-02T09:34:16.621760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.621776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:16.621790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:16.621865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2298 reason: error at write: Disconnected sessionId: src_id|7672db6f-6a4a366-37cbc608-895efc3b_0
2025-10-02T09:34:16.622027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2298 sessionId: src_id|7672db6f-6a4a366-37cbc608-895efc3b_0 is DEAD
2025-10-02T09:34:16.622171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:16.622185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Write session will restart in 0.008669s
2025-10-02T09:34:16.622206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Write session: Do CDS request
2025-10-02T09:34:16.622211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.629516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.630654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.630808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.630816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.630822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.630854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.630879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199138777:8605]
2025-10-02T09:34:16.631227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.631452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.631480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.631669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.631701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.631705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.631706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.631707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.631707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.631708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.631708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.631709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.631710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.631710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.631711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.631711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.631714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.631721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.631723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.631725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.631727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.631729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.631731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.631733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.631735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.631737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.631739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.631741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.631744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.631748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.631751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.631754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.631757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.631759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.631761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.631765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.631767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.631770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.631772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.631776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.631778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.631781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.631783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.631785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.631787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.631790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.631792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.631794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.631796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.631799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.631801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.631804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.631821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.632145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.632304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.632311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2299
2025-10-02T09:34:16.632410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.632429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.632436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.632438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.632718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2299 sessionId:  describe result for acl check
2025-10-02T09:34:16.632738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.632743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.632744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.632747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274707795:4909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.633129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274707795:4909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.634859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274707795:4909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.638990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274707795:4909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.639004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274707795:4909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.639008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274707795:4909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.639013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.639528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.641029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.641041Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.641042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.641044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.641048Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2298 [2:7556555394199138777:8605]
2025-10-02T09:34:16.641055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.641066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.641069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.641071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.641072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.641081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.641089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.641093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.641125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.641130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.641131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.641133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.641134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.641182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.641189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.641199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.641208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.641224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.641242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707694:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.641251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.641253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.641254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.641264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.641274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707830:4909], now have 1 active actors on pipe
2025-10-02T09:34:16.641279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.641281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.641283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.641285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.641285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2298
2025-10-02T09:34:16.641299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2298
2025-10-02T09:34:16.641299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.641305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.641327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.641333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.641341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.641343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.641345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.641372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9315dd6d-811114df-380b201-f61857fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.641381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.641385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.641391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.641397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.641407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.641423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.641528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.641534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.641544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.641610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2299 partition: 0 MaxSeqNo: 36 sessionId: src_id|9315dd6d-811114df-380b201-f61857fe_0
2025-10-02T09:34:16.641835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7672db6f-6a4a366-37cbc608-895efc3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9315dd6d-811114df-380b201-f61857fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.644344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Write session: try to update token
2025-10-02T09:34:16.644358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.650547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.650563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.650564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.650566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.650571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.650574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.650577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199138772:8605]
2025-10-02T09:34:16.650611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.650610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.650613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.650616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.650617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.650618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.650739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.656460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId: src_id|9315dd6d-811114df-380b201-f61857fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.658649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.721956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707838:6658]
2025-10-02T09:34:16.722145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2298, pipe: [1:7556555394274707838:6658]
2025-10-02T09:34:16.762422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.762733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.762743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.762759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707838:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.763174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707838:6658]
2025-10-02T09:34:16.763194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.763211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:16.763216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:16.763293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2299 reason: error at write: Disconnected sessionId: src_id|9315dd6d-811114df-380b201-f61857fe_0
2025-10-02T09:34:16.763342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.763454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2299 sessionId: src_id|9315dd6d-811114df-380b201-f61857fe_0 is DEAD
2025-10-02T09:34:16.763580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:16.763591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Write session will restart in 0.006286s
2025-10-02T09:34:16.763615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Write session: Do CDS request
2025-10-02T09:34:16.763620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.769872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.771017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.771155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.771155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.771162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.771168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.771199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.771226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199138913:8609]
2025-10-02T09:34:16.771212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.771221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2300
2025-10-02T09:34:16.771457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.771481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.771490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.771493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.771590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.771757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.771782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.771843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2300 sessionId:  describe result for acl check
2025-10-02T09:34:16.771874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.771881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.771882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.771887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274707939:4899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.772023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.772058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.772064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.772065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.772066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.772067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.772067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.772068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.772069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.772070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.772071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.772072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.772072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.772076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.772085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.772089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.772093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.772096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.772099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.772102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.772104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.772106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.772110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.772112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.772114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.772118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.772122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.772128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.772131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.772134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.772136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.772140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.772143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.772145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.772148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.772150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.772158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.772160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.772163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.772165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.772168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.772171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.772175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.772177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.772179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.772181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.772184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.772186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.772189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.772206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.772343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274707939:4899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.774093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274707939:4899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.778527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274707939:4899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.778538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274707939:4899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.778541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274707939:4899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.778546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.779771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.781261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.781274Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.781277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.781280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.781285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2299 [2:7556555394199138913:8609]
2025-10-02T09:34:16.781295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.781308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.781313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.781314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.781315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.781324Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.781327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.781333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.781365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.781369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.781370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.781373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.781375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.781412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.781417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.781424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.781429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.781440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.781453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707839:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.781458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707976:4899], now have 1 active actors on pipe
2025-10-02T09:34:16.781462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.781463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.781464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.781472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.781481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.781486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.781488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.781489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.781491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.781492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.781506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.781499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2299
2025-10-02T09:34:16.781506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2299
2025-10-02T09:34:16.781511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.781525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.781529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.781533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.781593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.781603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.781605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.781606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.781610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.781616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.781629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.781730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.781735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.781743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.781797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2300 partition: 0 MaxSeqNo: 36 sessionId: src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0
2025-10-02T09:34:16.782053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9315dd6d-811114df-380b201-f61857fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.784575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Write session: try to update token
2025-10-02T09:34:16.784586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.790612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.790623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.790625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.790626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.790631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.790633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.790636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199138908:8609]
2025-10-02T09:34:16.790654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.790659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.790660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.790667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.790670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.790673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.790771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.796747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId: src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.798926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:16.863258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555394274707987:6658]
2025-10-02T09:34:16.863622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2299, pipe: [1:7556555394274707987:6658]
2025-10-02T09:34:16.900361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:16.900624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.900634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.900645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707987:6658], now have 1 active actors on pipe
2025-10-02T09:34:16.900764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:16.900811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:16.900856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555394274707987:6658]
2025-10-02T09:34:16.900870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:16.900975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0
2025-10-02T09:34:16.901139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2300 sessionId: src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0 is DEAD
2025-10-02T09:34:16.901293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:16.901304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Write session will restart in 0.005204s
2025-10-02T09:34:16.901325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Write session: Do CDS request
2025-10-02T09:34:16.901330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:16.907085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.907193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:16.907203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2301
2025-10-02T09:34:16.907350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:16.907376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:16.907383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:16.907386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:16.907740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2301 sessionId:  describe result for acl check
2025-10-02T09:34:16.907772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:16.907780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:16.907781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:16.907785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555394274708088:4892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:16.907842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:16.908213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555394274708088:4892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:16.908982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:16.909073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:16.909080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:16.909086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:16.909110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:16.909138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555394199139051:8606]
2025-10-02T09:34:16.909476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:16.909631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:16.909652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:16.909827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:16.909857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.909861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.909862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.909862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.909863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.909863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.909864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.909864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.909865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.909865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.909866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.909866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.909869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.909875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.909877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.909876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555394274708088:4892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:16.909879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.909881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.909883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.909884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.909886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.909888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.909890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.909892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.909894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.909898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.909902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:16.909905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.909908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:16.909910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.909913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:16.909915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.909918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:16.909920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.909923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:16.909924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.909927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:16.909929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.909932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:16.909934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.909937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:16.909939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.909943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:16.909945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.909947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.909949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.909952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.909954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.909957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.909972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:16.914767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555394274708088:4892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:16.914777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555394274708088:4892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:16.914780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555394274708088:4892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:16.914784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:16.917404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:16.918966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:16.918977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:16.918978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:16.918980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:16.918983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2300 [2:7556555394199139051:8606]
2025-10-02T09:34:16.918991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:16.919000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:16.919002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.919003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.919004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.919014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:16.919016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:16.919021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:16.919051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.919056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.919057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.919059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:16.919061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:16.919098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:16.919103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.919109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:16.919114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:16.919122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:16.919134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274708128:4892], now have 1 active actors on pipe
2025-10-02T09:34:16.919142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.919144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.919145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.919150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:16.919156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555394274707990:2446], now have 1 active actors on pipe
2025-10-02T09:34:16.919157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:16.919159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:16.919160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:16.919164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:16.919171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:16.919173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:16.919186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.919196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:16.919190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2300
2025-10-02T09:34:16.919193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2300
2025-10-02T09:34:16.919217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:16.919259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.919265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.919278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:16.919285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:16.919287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:16.919288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:16.919294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:16.919299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:16.919306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.919417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:16.919422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:16.919429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:16.919494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2301 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0
2025-10-02T09:34:16.919762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4e1e84-a2ece144-212b1785-12d6bf6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:16.922304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Write session: try to update token
2025-10-02T09:34:16.922319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:16.928390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:16.928404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:16.928405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:16.928405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:16.928409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.928413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.928415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555394199139046:8606]
2025-10-02T09:34:16.928434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:16.928437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:16.928438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:16.928458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:16.928463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:16.928467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:16.928551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:16.934963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId: src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:16.937098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.000981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569675434:6658]
2025-10-02T09:34:17.001110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2300, pipe: [1:7556555398569675434:6658]
2025-10-02T09:34:17.039474Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.039716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.039726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.039738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675434:6658], now have 1 active actors on pipe
2025-10-02T09:34:17.039859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.039899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.039931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569675434:6658]
2025-10-02T09:34:17.039940Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:34:17.039940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:17.040035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2301 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0
2025-10-02T09:34:17.040075Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 23 consumer shared/user session shared/user_1_23_2727249289602532895_v1 is DEAD
2025-10-02T09:34:17.040148Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555338440114442:6086] disconnected; active server actors: 1
2025-10-02T09:34:17.040153Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555338440114442:6086] client user disconnected session shared/user_1_23_2727249289602532895_v1
2025-10-02T09:34:17.040199Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:34:17.040204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2301 sessionId: src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0 is DEAD
2025-10-02T09:34:17.040259Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:17.040263Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:17.040273Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.007518s
2025-10-02T09:34:17.040352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:17.040363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Write session will restart in 0.006826s
2025-10-02T09:34:17.040383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Write session: Do CDS request
2025-10-02T09:34:17.040388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.047403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.048204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.048276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.048286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2302
2025-10-02T09:34:17.048394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.048414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.048419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.048422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.048482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.048598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.048604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.048610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.048638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.048664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494106526:8575]
2025-10-02T09:34:17.048662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2302 sessionId:  describe result for acl check
2025-10-02T09:34:17.048681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.048685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.048686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.048689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569675542:4878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.048964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569675542:4878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.048999Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:34:17.049027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.049073Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:34:17.049077Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 24
2025-10-02T09:34:17.049187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.049211Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 24 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:17.049215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.049237Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:17.049278Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 auth for : user
2025-10-02T09:34:17.049328Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 Handle describe topics response
2025-10-02T09:34:17.049340Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 auth is DEAD
2025-10-02T09:34:17.049349Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:34:17.049406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.049439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.049443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.049444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.049444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.049445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.049445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.049446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.049446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.049447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.049447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.049448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.049448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.049451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.049458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.049460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.049462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.049464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.049466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.049468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.049470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.049472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.049474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.049476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.049478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.049482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.049485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.049489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.049492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.049494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.049496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.049502Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:34:17.049499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.049501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.049504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.049506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.049508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.049511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.049513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.049516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.049518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.049522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.049525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.049527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.049530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.049532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.049535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.049538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.049540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.049549Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555398569675560:4845] connected; active server actors: 1
2025-10-02T09:34:17.049556Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555398569675560:4845] session shared/user_1_24_12798954258424859339_v1
2025-10-02T09:34:17.049560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:34:17.049559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.049565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:34:17.049573Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_24_12798954258424859339_v1" (Sender=[1:7556555398569675553:4845], Pipe=[1:7556555398569675560:4845], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:17.049574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:34:17.049580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:34:17.049587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_24_12798954258424859339_v1" (Sender=[1:7556555398569675553:4845], Pipe=[1:7556555398569675560:4845], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:17.049593Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_24_12798954258424859339_v1" sender [1:7556555398569675553:4845] lock partition 0 for ReadingSession "shared/user_1_24_12798954258424859339_v1" (Sender=[1:7556555398569675553:4845], Pipe=[1:7556555398569675560:4845], Partitions=[], ActiveFamilyCount=1) generation 1 step 24
2025-10-02T09:34:17.049599Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_24_12798954258424859339_v1
2025-10-02T09:34:17.049600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:34:17.049602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000018s
2025-10-02T09:34:17.049701Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 24 Session: "shared/user_1_24_12798954258424859339_v1" ClientId: "user" PipeClient { RawX1: 7556555398569675560 RawX2: 4503603922342637 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:34:17.049712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:34:17.050489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569675542:4878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.054774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569675542:4878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.054782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569675542:4878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.054784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569675542:4878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.054788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.057000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.058531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.058547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.058549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.058551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.058554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2301 [2:7556555398494106526:8575]
2025-10-02T09:34:17.058562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.058572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.058578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.058580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.058581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.058597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.058600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.058604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.058634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.058639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.058640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.058642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.058643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.058681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.058686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.058692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.058698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.058706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.058719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675594:4878], now have 1 active actors on pipe
2025-10-02T09:34:17.058724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675436:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.058727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.058729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.058730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.058737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.058742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675565:4843], now have 1 active actors on pipe
2025-10-02T09:34:17.058750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.058750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.058752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.058753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.058757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.058759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.058746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2301
2025-10-02T09:34:17.058763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2301
2025-10-02T09:34:17.058773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.058779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.058776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2301, pipe: [1:7556555398569675565:4843]
2025-10-02T09:34:17.058790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.058799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.058802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.058813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.058814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.058818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_24_12798954258424859339_v1 on pipe: [1:7556555398569675565:4843]
2025-10-02T09:34:17.058842Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_24_12798954258424859339_v1:1 with generation 2301
2025-10-02T09:34:17.058887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.058895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.058897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.058899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.058904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.058911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.058917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.058923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.058924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.058934Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_24_12798954258424859339_v1
2025-10-02T09:34:17.058935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.058957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.058970Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:34:17.059041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.059048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.059058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.059102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2302 partition: 0 MaxSeqNo: 36 sessionId: src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0
2025-10-02T09:34:17.059301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7fc47c-5c9669c6-e16c7dd5-df133d62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.062008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Write session: try to update token
2025-10-02T09:34:17.062020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.062382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:34:17.062399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:34:17.062403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.062404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.062405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.062408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:34:17.062414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:34:17.062485Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397657058 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:34:17.062496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:34:17.062511Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 sending to client partition status
2025-10-02T09:34:17.068240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.068252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.068254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.068255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.068261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.068264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.068267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494106521:8575]
2025-10-02T09:34:17.068290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.068299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.068301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.068305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.068308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.068310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.068415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.073932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId: src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.076100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.178704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.179005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.179015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.179161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_24_12798954258424859339_v1
2025-10-02T09:34:17.179175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.179195Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_24_12798954258424859339_v1
2025-10-02T09:34:17.179229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569675565:4843]
2025-10-02T09:34:17.179250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:17.179310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2302 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0
2025-10-02T09:34:17.179414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.179441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2302 sessionId: src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0 is DEAD
2025-10-02T09:34:17.179572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:17.179584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Write session will restart in 0.005023s
2025-10-02T09:34:17.179599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Write session: Do CDS request
2025-10-02T09:34:17.179603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.185197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.185301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.185308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2303
2025-10-02T09:34:17.185414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.185434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.185439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.185441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.185782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2303 sessionId:  describe result for acl check
2025-10-02T09:34:17.185818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.185819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.185822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.185826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569675722:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.186255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569675722:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.186440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.187595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.187718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.187725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.187732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.187764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.187787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494106677:8576]
2025-10-02T09:34:17.188134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.188293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569675722:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.188302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.188341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.188538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.188572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.188577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.188578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.188579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.188579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.188580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.188581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.188582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.188582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.188583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.188584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.188585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.188589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.188599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.188602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.188604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.188608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.188610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.188611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.188613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.188615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.188618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.188619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.188621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.188626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.188630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.188634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.188637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.188639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.188642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.188644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.188647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.188649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.188652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.188655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.188657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.188660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.188663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.188665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.188668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.188670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.188674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.188677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.188680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.188682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.188684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.188686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.188689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.188709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.193493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569675722:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.193502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569675722:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.193504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569675722:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.193509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.196112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.197600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.197612Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.197613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.197615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.197618Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2302 [2:7556555398494106677:8576]
2025-10-02T09:34:17.197624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.197633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.197635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.197638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.197639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.197647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.197652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.197656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.197686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.197690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.197691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.197693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.197694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.197779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.197785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.197795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.197810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.197809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2302
2025-10-02T09:34:17.197823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.197833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2302
2025-10-02T09:34:17.197837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675624:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.197843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675765:4829], now have 1 active actors on pipe
2025-10-02T09:34:17.197847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.197848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.197849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.197855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.197863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.197866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.197867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.197869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.197871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.197880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.197891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.197893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.197919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.197926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.197928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.197929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.197933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.197940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.197943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.197949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.197957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.197965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.198071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.198079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.198087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.198149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2303 partition: 0 MaxSeqNo: 36 sessionId: src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0
2025-10-02T09:34:17.198405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb5a9ed-ae5633b0-79b671a1-cc0f51d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.201294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Write session: try to update token
2025-10-02T09:34:17.201312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.207057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.207068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.207069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.207070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.207073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.207075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.207077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494106671:8576]
2025-10-02T09:34:17.207097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.207099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.207100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.207107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.207111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.207114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.207210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.214787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId: src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.216939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.279523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569675774:4843]
2025-10-02T09:34:17.279743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2302, pipe: [1:7556555398569675774:4843]
2025-10-02T09:34:17.316753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.317014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.317024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.317037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675774:4843], now have 1 active actors on pipe
2025-10-02T09:34:17.317206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.317197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:17.317207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:17.317229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.317264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2303 reason: error at write: Disconnected sessionId: src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0
2025-10-02T09:34:17.317272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569675774:4843]
2025-10-02T09:34:17.317434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2303 sessionId: src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0 is DEAD
2025-10-02T09:34:17.317592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:17.317604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Write session will restart in 0.005842s
2025-10-02T09:34:17.317629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Write session: Do CDS request
2025-10-02T09:34:17.317635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.324252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.324321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.324332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2304
2025-10-02T09:34:17.324346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.324464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.324492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.324495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.324498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.324873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2304 sessionId:  describe result for acl check
2025-10-02T09:34:17.324906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.324910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.324912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.324915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569675877:4820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.325323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569675877:4820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.325441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.325534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.325540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.325546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.325572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.325594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494106818:8580]
2025-10-02T09:34:17.325929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.326123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.326166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.326376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.326412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.326417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.326417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.326418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.326419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.326420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.326421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.326422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.326423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.326424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.326424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.326425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.326428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.326435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.326437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.326439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.326441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.326445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.326447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.326449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.326451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.326453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.326455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.326457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.326462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.326466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.326470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.326474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.326480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.326483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.326485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.326492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.326494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.326497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.326502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.326504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.326506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.326511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.326518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.326521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.326526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.326529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.326531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.326533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.326535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.326538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.326540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.326543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.326558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.327149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569675877:4820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.332283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569675877:4820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.332292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569675877:4820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.332294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569675877:4820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.332300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.333938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.335471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.335483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.335484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.335486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.335489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2303 [2:7556555398494106818:8580]
2025-10-02T09:34:17.335500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.335509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.335514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.335515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.335516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.335526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.335531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.335536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.335572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.335577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.335578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.335579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.335581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.335616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.335621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.335628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.335633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.335644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.335658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675915:4820], now have 1 active actors on pipe
2025-10-02T09:34:17.335663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675775:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.335667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.335671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.335672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.335680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.335690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.335692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.335694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.335695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.335701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.335702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.335719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.335726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.335730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.335724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2303
2025-10-02T09:34:17.335728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2303
2025-10-02T09:34:17.335761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.335766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.335782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.335788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.335790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.335792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.335797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.335802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.335809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.335914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.335920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.335928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.336002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2304 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0
2025-10-02T09:34:17.336262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dcb7304-1f56bcb6-8f303246-3f2ce9b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.339053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Write session: try to update token
2025-10-02T09:34:17.339070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.344855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.344866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.344867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.344868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.344872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.344874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.344876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494106813:8580]
2025-10-02T09:34:17.344895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.344898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.344900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.344901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.344902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.344903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.345012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.352588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId: src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.354863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.417269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569675923:4843]
2025-10-02T09:34:17.417484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2303, pipe: [1:7556555398569675923:4843]
2025-10-02T09:34:17.457472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.457700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.457709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.457721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675923:4843], now have 1 active actors on pipe
2025-10-02T09:34:17.457845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.457924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.457971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:17.458074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0
2025-10-02T09:34:17.458213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2304 sessionId: src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0 is DEAD
2025-10-02T09:34:17.458268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569675923:4843]
2025-10-02T09:34:17.458388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:17.458402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Write session will restart in 0.005023s
2025-10-02T09:34:17.458428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Write session: Do CDS request
2025-10-02T09:34:17.458433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.464239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.464282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.464289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2305
2025-10-02T09:34:17.464433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.464454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.464460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.464462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.464747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2305 sessionId:  describe result for acl check
2025-10-02T09:34:17.464767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.464768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.464769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.464772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569676025:4809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.465156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569676025:4809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.465228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.466332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.466486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.466495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.466501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.466530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.466552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494106958:8572]
2025-10-02T09:34:17.466880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569676025:4809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.466922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.467094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.467124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.467302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.467333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.467337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.467337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.467338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.467339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.467339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.467340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.467340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.467341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.467341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.467342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.467343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.467346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.467354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.467358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.467361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.467365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.467368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.467372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.467376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.467378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.467380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.467382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.467384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.467387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.467391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.467395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.467398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.467400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.467403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.467405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.467407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.467411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.467413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.467415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.467418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.467420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.467423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.467427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.467430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.467432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.467434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.467436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.467439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.467441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.467444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.467446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.467448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.467465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.471268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569676025:4809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.471280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569676025:4809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.471282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569676025:4809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.471288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.474861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.476346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.476357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.476358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.476360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.476364Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2304 [2:7556555398494106958:8572]
2025-10-02T09:34:17.476372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.476382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.476387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.476389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.476390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.476400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.476402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.476406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.476434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.476438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.476439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.476441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.476442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.476480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.476484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.476491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.476496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.476507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.476522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569675924:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.476527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676066:4809], now have 1 active actors on pipe
2025-10-02T09:34:17.476531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.476532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.476534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.476541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.476551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.476555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.476558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.476559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.476562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.476563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.476553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2304
2025-10-02T09:34:17.476579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.476586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.476587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.476580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2304
2025-10-02T09:34:17.476605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.476610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.476628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.476635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.476637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.476638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.476642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.476651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.476660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.476742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.476749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.476758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.476829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2305 partition: 0 MaxSeqNo: 36 sessionId: src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0
2025-10-02T09:34:17.477077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ed3377-6ee8913e-f7ab9a33-d9af41d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.479606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Write session: try to update token
2025-10-02T09:34:17.479620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.485887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.485897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.485899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.485899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.485903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.485905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.485907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494106953:8572]
2025-10-02T09:34:17.485925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.485928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.485929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.485929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.485931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.485933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.486028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.491520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId: src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.493606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.558588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569676074:4843]
2025-10-02T09:34:17.558818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2304, pipe: [1:7556555398569676074:4843]
2025-10-02T09:34:17.599304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.599582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.599590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.599602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676074:4843], now have 1 active actors on pipe
2025-10-02T09:34:17.599731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.599802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.599844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:17.599911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2305 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0
2025-10-02T09:34:17.600029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569676074:4843]
2025-10-02T09:34:17.600072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2305 sessionId: src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0 is DEAD
2025-10-02T09:34:17.600244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:17.600260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Write session will restart in 0.008416s
2025-10-02T09:34:17.600289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Write session: Do CDS request
2025-10-02T09:34:17.600294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.607266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.608389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.608490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.608497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.608503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.608527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.608550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494107100:8567]
2025-10-02T09:34:17.608920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.609107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.609131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.609310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.609338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.609342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.609342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.609343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.609343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.609344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.609345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.609345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.609346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.609347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.609347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.609348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.609350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.609357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.609359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.609361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.609363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.609365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.609367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.609369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.609371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.609373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.609375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.609377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.609380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.609384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.609388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.609390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.609392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.609395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.609397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.609400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.609402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.609405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.609407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.609409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.609411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.609414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.609416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.609418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.609421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.609424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.609430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.609432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.609434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.609437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.609439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.609441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.609459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.610223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.610323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.610333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2306
2025-10-02T09:34:17.610453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.610477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.610484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.610487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.610837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2306 sessionId:  describe result for acl check
2025-10-02T09:34:17.610860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.610866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.610867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.610871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569676183:4792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.611308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569676183:4792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.612860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569676183:4792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.616473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569676183:4792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.616484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569676183:4792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.616487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569676183:4792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.616493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.616968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.618386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.618397Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.618398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.618400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.618404Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2305 [2:7556555398494107100:8567]
2025-10-02T09:34:17.618411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.618420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.618422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.618423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.618425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.618434Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.618437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.618445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.618475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.618479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.618480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.618482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.618483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.618519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.618524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.618530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.618536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.618545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.618559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676218:4792], now have 1 active actors on pipe
2025-10-02T09:34:17.618565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676075:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.618569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.618570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.618571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.618579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.618594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.618603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.618605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.618607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.618612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.618614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.618620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.618621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.618612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2305
2025-10-02T09:34:17.618623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.618619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2305
2025-10-02T09:34:17.618682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.618689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.618705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.618712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.618714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.618715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.618720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.618729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.618736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.618850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.618854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.618861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.618931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2306 partition: 0 MaxSeqNo: 36 sessionId: src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0
2025-10-02T09:34:17.619210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93ae3c5-88c9e1f2-ae7d7aac-fbd3d356_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.622060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Write session: try to update token
2025-10-02T09:34:17.622078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.628079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.628091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.628092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.628093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.628098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.628100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.628101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494107095:8567]
2025-10-02T09:34:17.628120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.628122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.628124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.628126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.628128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.628131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.628227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.636159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId: src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.638517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.700389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569676226:4843]
2025-10-02T09:34:17.700590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2305, pipe: [1:7556555398569676226:4843]
2025-10-02T09:34:17.741084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.741343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.741352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.741365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676226:4843], now have 1 active actors on pipe
2025-10-02T09:34:17.741584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569676226:4843]
2025-10-02T09:34:17.741633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:17.741640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:17.741647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.741692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2306 reason: error at write: Disconnected sessionId: src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0
2025-10-02T09:34:17.741697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.741852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2306 sessionId: src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0 is DEAD
2025-10-02T09:34:17.742025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:17.742041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Write session will restart in 0.006972s
2025-10-02T09:34:17.742067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Write session: Do CDS request
2025-10-02T09:34:17.742074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.749342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.750200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.750295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.750305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2307
2025-10-02T09:34:17.750429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.750455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.750463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.750466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.750471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.750567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.750575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.750589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.750615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.750646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494107243:8562]
2025-10-02T09:34:17.750819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2307 sessionId:  describe result for acl check
2025-10-02T09:34:17.750841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.750847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.750850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.750854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569676332:4761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.750992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.751176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.751199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.751304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569676332:4761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.751373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.751404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.751407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.751408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.751409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.751409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.751410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.751410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.751411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.751411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.751412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.751412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.751413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.751416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.751422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.751424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.751426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.751428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.751430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.751432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.751434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.751436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.751438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.751440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.751442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.751446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.751451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.751455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.751458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.751460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.751463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.751465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.751467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.751470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.751472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.751474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.751477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.751479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.751482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.751484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.751486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.751488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.751491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.751493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.751495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.751498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.751501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.751503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.751505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.751521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.753142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569676332:4761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.757989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569676332:4761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.758002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569676332:4761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.758005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569676332:4761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.758010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.759118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.760616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.760627Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.760629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.760631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.760634Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2306 [2:7556555398494107243:8562]
2025-10-02T09:34:17.760644Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.760654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.760659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.760661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.760662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.760670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.760673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.760678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.760710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.760716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.760717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.760718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.760720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.760773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.760778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.760785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.760790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.760798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.760823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676371:4761], now have 1 active actors on pipe
2025-10-02T09:34:17.760828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676227:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.760832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.760833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.760834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.760842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.760854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.760863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.760863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.760862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2306
2025-10-02T09:34:17.760876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2306
2025-10-02T09:34:17.760865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.760873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.760874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.760878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.760881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.760892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.760897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.760899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.760916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.760924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.760926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.760927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.760933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.760939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.760949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.761050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.761055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.761062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.761121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2307 partition: 0 MaxSeqNo: 36 sessionId: src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0
2025-10-02T09:34:17.761394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aae97ec-8f15d8c8-7ade3efc-945ac387_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.764197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Write session: try to update token
2025-10-02T09:34:17.764212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.770135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.770147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.770148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.770149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.770153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.770157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.770159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494107238:8562]
2025-10-02T09:34:17.770177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.770182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.770184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.770186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.770189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.770191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.770293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.777607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId: src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.779801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.841688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569676378:4843]
2025-10-02T09:34:17.841839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2306, pipe: [1:7556555398569676378:4843]
2025-10-02T09:34:17.879087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:17.879330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.879339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.879351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676378:4843], now have 1 active actors on pipe
2025-10-02T09:34:17.879479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:17.879498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:17.879506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:17.879542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569676378:4843]
2025-10-02T09:34:17.879549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2307 reason: error at write: Disconnected sessionId: src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0
2025-10-02T09:34:17.879571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:17.879674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2307 sessionId: src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0 is DEAD
2025-10-02T09:34:17.879799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:17.879811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Write session will restart in 0.008218s
2025-10-02T09:34:17.879834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Write session: Do CDS request
2025-10-02T09:34:17.879839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:17.886483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:17.887676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:17.887839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:17.887847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:17.887854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:17.887887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:17.887914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555398494107387:8560]
2025-10-02T09:34:17.888320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:17.888523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:17.888555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:17.888771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:17.888822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.888829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.888830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.888831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.888832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.888833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.888834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.888835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.888836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.888837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.888838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.888839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.888843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.888850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.888853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.888855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.888858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.888860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.888862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.888865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.888867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.888870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.888872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.888874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.888880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.888885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:17.888889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.888892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:17.888894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.888897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:17.888899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.888902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:17.888910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.888915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:17.888919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.888922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:17.888924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.888927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:17.888929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.888932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:17.888935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.888938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:17.888941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.888943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.888946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.888949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.888951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.888954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.888976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:17.889194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.889307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:17.889315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2308
2025-10-02T09:34:17.889438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:17.889460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:17.889466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:17.889468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:17.889805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2308 sessionId:  describe result for acl check
2025-10-02T09:34:17.889844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:17.889845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:17.889847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:17.889851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555398569676495:4747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:17.890329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555398569676495:4747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:17.891972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555398569676495:4747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:17.896111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555398569676495:4747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:17.896122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555398569676495:4747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:17.896124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555398569676495:4747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:17.896130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:17.897473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:17.899113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:17.899127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:17.899128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:17.899131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:17.899134Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2307 [2:7556555398494107387:8560]
2025-10-02T09:34:17.899143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:17.899153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:17.899155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.899156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.899157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.899167Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:17.899175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:17.899180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:17.899210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.899216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.899217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.899218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:17.899219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:17.899262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:17.899267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.899274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:17.899279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:17.899286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:17.899300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676385:2446], now have 1 active actors on pipe
2025-10-02T09:34:17.899306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676529:4747], now have 1 active actors on pipe
2025-10-02T09:34:17.899309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.899310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.899311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.899318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:17.899326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:17.899331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:17.899333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:17.899334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:17.899336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:17.899338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:17.899332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2307
2025-10-02T09:34:17.899350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.899355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:17.899356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:17.899369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2307
2025-10-02T09:34:17.899423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.899429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.899442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:17.899448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:17.899450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:17.899451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:17.899457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:17.899464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:17.899471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.899583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:17.899590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:17.899599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:17.899651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2308 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0
2025-10-02T09:34:17.899891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04bc4b9-f687b6ad-d2236466-376042cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:17.902507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Write session: try to update token
2025-10-02T09:34:17.902522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:17.908203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:17.908217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.908223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.908245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:17.908245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:17.908374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:17.908494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:17.908610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:17.908723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:17.908902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:17.908923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:17.914754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId: src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:17.916597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:17.916610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:17.916611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:17.916612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:17.916616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.916618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.916620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555398494107382:8560]
2025-10-02T09:34:17.916641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:17.916644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:17.916649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:17.916649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:17.916652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:17.916652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:17.916762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:17.916962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:17.979943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555398569676540:4843]
2025-10-02T09:34:17.980161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2307, pipe: [1:7556555398569676540:4843]
2025-10-02T09:34:18.027392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.027567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.027576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.027589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555398569676540:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.027658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.027689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555398569676540:4843]
2025-10-02T09:34:18.027696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.027729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:18.027743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:18.027822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2308 reason: error at write: Disconnected sessionId: src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0
2025-10-02T09:34:18.028002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2308 sessionId: src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0 is DEAD
2025-10-02T09:34:18.028186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:18.028199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Write session will restart in 0.007308s
2025-10-02T09:34:18.028220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Write session: Do CDS request
2025-10-02T09:34:18.028226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.034944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.036063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.036183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.036220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.036228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.036235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.036265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.036285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789074853:8550]
2025-10-02T09:34:18.036368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.036376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2309
2025-10-02T09:34:18.036497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.036521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.036527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.036530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.036699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.036793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2309 sessionId:  describe result for acl check
2025-10-02T09:34:18.036828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.036833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.036834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.036837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864643947:4738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.036865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.036888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.037062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.037090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.037094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.037095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.037095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.037096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.037096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.037096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.037097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.037098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.037098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.037099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.037099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.037102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.037108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.037110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.037112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.037114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.037116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.037118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.037120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.037122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.037124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.037126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.037128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.037131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.037135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.037138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.037141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.037143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.037146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.037148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.037151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.037154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.037156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.037158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.037161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.037163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.037166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.037168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.037171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.037173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.037176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.037178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.037181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.037183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.037186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.037192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.037196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.037184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864643947:4738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.037214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.038772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864643947:4738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.043421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864643947:4738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.043433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864643947:4738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.043436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864643947:4738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.043441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.044569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.046073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.046086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.046087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.046089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.046093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2308 [2:7556555402789074853:8550]
2025-10-02T09:34:18.046100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.046109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.046115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.046116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.046117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.046126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.046129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.046133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.046168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.046173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.046174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.046176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.046177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.046212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.046218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.046224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.046230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.046241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.046256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864643838:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.046262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864643984:4738], now have 1 active actors on pipe
2025-10-02T09:34:18.046265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.046268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.046270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.046276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.046287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.046289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.046291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.046284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2308
2025-10-02T09:34:18.046292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.046297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.046298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.046294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2308
2025-10-02T09:34:18.046323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.046328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.046335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.046342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.046351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.046364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.046371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.046373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.046374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.046379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.046387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.046402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.046485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.046489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.046497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.046548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2309 partition: 0 MaxSeqNo: 36 sessionId: src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0
2025-10-02T09:34:18.046839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcafcb1-489cda6a-b0c2dc8c-aef91fa3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.049621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Write session: try to update token
2025-10-02T09:34:18.049637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.055676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.055687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.055688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.055689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.055692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.055694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.055696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789074848:8550]
2025-10-02T09:34:18.055716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.055719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.055718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.055720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.055721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.055723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.055836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.062933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId: src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.065114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.127916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644025:4843]
2025-10-02T09:34:18.128099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2308, pipe: [1:7556555402864644025:4843]
2025-10-02T09:34:18.165824Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.166343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.166356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.166369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644025:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.166512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.166504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.166540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644025:4843]
2025-10-02T09:34:18.166550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:18.166555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:18.166630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2309 reason: error at write: Disconnected sessionId: src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0
2025-10-02T09:34:18.166793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2309 sessionId: src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0 is DEAD
2025-10-02T09:34:18.166940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:18.166955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Write session will restart in 0.005852s
2025-10-02T09:34:18.166979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Write session: Do CDS request
2025-10-02T09:34:18.166986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.173294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.174288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.174319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.174327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2310
2025-10-02T09:34:18.174450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.174464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.174486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.174492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.174494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.174552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.174558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.174564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.174598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.174622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789075023:8534]
2025-10-02T09:34:18.174848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2310 sessionId:  describe result for acl check
2025-10-02T09:34:18.174882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.174889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.174891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.174895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864644134:4689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.174987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.175166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.175196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.175314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864644134:4689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.175388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.175417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.175421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.175421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.175422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.175422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.175423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.175423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.175424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.175425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.175425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.175426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.175426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.175429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.175437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.175439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.175441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.175444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.175448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.175451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.175454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.175457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.175461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.175465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.175471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.175475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.175479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.175485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.175488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.175493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.175496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.175498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.175501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.175504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.175509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.175512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.175514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.175518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.175524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.175526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.175529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.175531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.175535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.175539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.175542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.175544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.175547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.175551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.175554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.175570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.177339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864644134:4689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.182328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864644134:4689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.182340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864644134:4689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.182342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864644134:4689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.182348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.182948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.184481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.184490Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.184491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.184493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.184496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2309 [2:7556555402789075023:8534]
2025-10-02T09:34:18.184504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.184513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.184516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.184517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.184518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.184527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.184530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.184535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.184564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.184569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.184570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.184571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.184573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.184608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.184613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.184619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.184624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.184635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.184650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644026:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.184656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644173:4689], now have 1 active actors on pipe
2025-10-02T09:34:18.184660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.184663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.184665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.184674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.184686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.184687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.184692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.184693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.184699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.184701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.184685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2309
2025-10-02T09:34:18.184718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.184698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2309
2025-10-02T09:34:18.184724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.184726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.184733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.184738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.184764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.184771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.184773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.184774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.184779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.184787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.184798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.184925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.184933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.184945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.185008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2310 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0
2025-10-02T09:34:18.185293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d3cf71-b4c540a9-31425205-b0a749d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.188072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Write session: try to update token
2025-10-02T09:34:18.188089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.193838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.193850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.193851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.193852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.193856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.193858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.193860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789075018:8534]
2025-10-02T09:34:18.193879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.193883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.193885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.193886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.193890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.193893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.193995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.200430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId: src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.202699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.266639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644183:4843]
2025-10-02T09:34:18.266819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2309, pipe: [1:7556555402864644183:4843]
2025-10-02T09:34:18.305455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.305706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.305714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.305726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644183:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.305874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.305869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.305896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644183:4843]
2025-10-02T09:34:18.305929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:18.305942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:18.306015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2310 reason: error at write: Disconnected sessionId: src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0
2025-10-02T09:34:18.306175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2310 sessionId: src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0 is DEAD
2025-10-02T09:34:18.306320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:18.306328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Write session will restart in 0.007819s
2025-10-02T09:34:18.306348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Write session: Do CDS request
2025-10-02T09:34:18.306352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.312978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.314071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.314219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.314227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.314235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.314272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.314296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789075169:8529]
2025-10-02T09:34:18.314662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.314833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.314857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.315046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.315079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.315082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.315083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.315084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.315084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.315085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.315085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.315086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.315086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.315087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.315087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.315088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.315090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.315097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.315099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.315101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.315103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.315105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.315107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.315109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.315111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.315113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.315115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.315117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.315121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.315125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.315128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.315131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.315133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.315135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.315138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.315140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.315143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.315145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.315148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.315151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.315154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.315156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.315158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.315161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.315171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.315163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.315166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.315168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.315171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.315173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.315176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.315179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.315182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.315198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.315256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.315264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2311
2025-10-02T09:34:18.315390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.315409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.315416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.315419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.315677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2311 sessionId:  describe result for acl check
2025-10-02T09:34:18.315697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.315702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.315703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.315706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864644297:4666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.316050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864644297:4666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.317770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864644297:4666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.322064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864644297:4666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.322074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864644297:4666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.322076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864644297:4666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.322081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.322572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.324217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.324229Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.324230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.324232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.324235Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2310 [2:7556555402789075169:8529]
2025-10-02T09:34:18.324243Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.324253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.324257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.324259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.324260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.324269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.324276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.324282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.324317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.324322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.324323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.324325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.324326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.324362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.324367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.324373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.324378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.324389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.324403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644332:4666], now have 1 active actors on pipe
2025-10-02T09:34:18.324408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644184:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.324412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.324413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.324414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.324422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.324432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.324434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.324436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.324437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.324443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.324444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.324437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2310
2025-10-02T09:34:18.324460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.324464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.324466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.324474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.324479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.324467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2310
2025-10-02T09:34:18.324504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0b0d008-b3115963-b127623-84509950_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.324511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.324513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.324514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.324518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.324527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.324540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.324632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.324640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.324649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.324711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2311 partition: 0 MaxSeqNo: 36 sessionId: src_id|f0b0d008-b3115963-b127623-84509950_0
2025-10-02T09:34:18.324954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c55d0c-b507e6ec-f58dba36-58c2ed00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f0b0d008-b3115963-b127623-84509950_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.327563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Write session: try to update token
2025-10-02T09:34:18.327577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.333539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.333551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.333554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.333555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.333560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.333562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.333564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789075164:8529]
2025-10-02T09:34:18.333587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.333589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.333590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.333592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.333593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.333595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.333714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.339712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId: src_id|f0b0d008-b3115963-b127623-84509950_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.341811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.405922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644340:4843]
2025-10-02T09:34:18.406084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2310, pipe: [1:7556555402864644340:4843]
2025-10-02T09:34:18.441352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.441590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.441598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.441612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644340:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.441915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644340:4843]
2025-10-02T09:34:18.441931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.441992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:18.442007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:18.442076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2311 reason: error at write: Disconnected sessionId: src_id|f0b0d008-b3115963-b127623-84509950_0
2025-10-02T09:34:18.442152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.442228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2311 sessionId: src_id|f0b0d008-b3115963-b127623-84509950_0 is DEAD
2025-10-02T09:34:18.442356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:18.442369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Write session will restart in 0.008729s
2025-10-02T09:34:18.442390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Write session: Do CDS request
2025-10-02T09:34:18.442395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.448933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.450230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.450336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.450343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.450350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.450386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.450416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789075319:8512]
2025-10-02T09:34:18.450773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.450958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.450991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.451184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.451225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.451229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.451230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.451231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.451232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.451233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.451234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.451234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.451235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.451236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.451237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.451238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.451242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.451253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.451257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.451260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.451264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.451268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.451272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.451275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.451279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.451283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.451287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.451291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.451296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.451303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.451309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.451314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.451318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.451323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.451327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.451333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.451337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.451342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.451347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.451355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.451359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.451364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.451368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.451373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.451377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.451385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.451389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.451393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.451397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.451402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.451406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.451411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.451442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.452213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.452278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.452285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2312
2025-10-02T09:34:18.452394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.452412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.452415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.452417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.452739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2312 sessionId:  describe result for acl check
2025-10-02T09:34:18.452770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.452778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.452779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.452783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864644455:4660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.453234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864644455:4660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.455082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864644455:4660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.458373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864644455:4660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.458384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864644455:4660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.458387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864644455:4660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.458393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.458954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.460449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.460462Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.460464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.460466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.460471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2311 [2:7556555402789075319:8512]
2025-10-02T09:34:18.460571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.460587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.460590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.460592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.460594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.460607Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.460614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.460620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.460655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.460660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.460662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.460664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.460666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.460712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.460718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.460728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.460738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.460757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.460774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644490:4660], now have 1 active actors on pipe
2025-10-02T09:34:18.460780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644341:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.460785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.460787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.460789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.460776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2311
2025-10-02T09:34:18.460792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2311
2025-10-02T09:34:18.460795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.460813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.460815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.460818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.460821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.460833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.460835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.460849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.460851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.460878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.460885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.460899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.460908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ced921db-339bd82-90b81d46-7efcd372_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.460914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.460917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.460922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.460928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.460935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.460960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.461057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.461062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.461072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.461115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2312 partition: 0 MaxSeqNo: 36 sessionId: src_id|ced921db-339bd82-90b81d46-7efcd372_0
2025-10-02T09:34:18.461310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0d008-b3115963-b127623-84509950_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ced921db-339bd82-90b81d46-7efcd372_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.463926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Write session: try to update token
2025-10-02T09:34:18.463941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.470022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.470034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.470035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.470036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.470041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.470046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.470049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789075314:8512]
2025-10-02T09:34:18.470070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.470072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.470073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.470074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.470077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.470079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.470208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.476766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId: src_id|ced921db-339bd82-90b81d46-7efcd372_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.478919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.542100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644498:4843]
2025-10-02T09:34:18.542270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2311, pipe: [1:7556555402864644498:4843]
2025-10-02T09:34:18.580839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.581078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.581087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.581103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644498:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.581241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.581305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644498:4843]
2025-10-02T09:34:18.581327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.581361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:18.581548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2312 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ced921db-339bd82-90b81d46-7efcd372_0
2025-10-02T09:34:18.581693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2312 sessionId: src_id|ced921db-339bd82-90b81d46-7efcd372_0 is DEAD
2025-10-02T09:34:18.581846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:18.581860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Write session will restart in 0.006710s
2025-10-02T09:34:18.581880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Write session: Do CDS request
2025-10-02T09:34:18.581886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.588402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.589112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.589257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.589265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2313
2025-10-02T09:34:18.589395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.589418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.589424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.589427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.589633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.589754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.589762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.589759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2313 sessionId:  describe result for acl check
2025-10-02T09:34:18.589769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.589793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.589800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.589801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.589809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.589805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864644610:4641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.589840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789075468:8523]
2025-10-02T09:34:18.590188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.590224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864644610:4641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.590395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.590429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.590628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.590666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.590670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.590672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.590672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.590673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.590674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.590675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.590676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.590678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.590678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.590680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.590681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.590685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.590696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.590700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.590704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.590707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.590712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.590715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.590719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.590722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.590727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.590731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.590734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.590740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.590747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.590755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.590760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.590764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.590772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.590776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.590781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.590785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.590790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.590796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.590801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.590805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.590810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.590816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.590821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.590825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.590830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.590834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.590841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.590845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.590852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.590855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.590860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.590893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.591614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864644610:4641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.595831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864644610:4641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.595848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864644610:4641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.595852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864644610:4641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.595858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.598330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.599926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.599939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.599941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.599944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.599949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2312 [2:7556555402789075468:8523]
2025-10-02T09:34:18.599958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.599971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.599973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.599976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.599977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.599989Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.599994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.599999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.600037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.600043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.600044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.600047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.600048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.600092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.600097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.600107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.600118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.600137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.600153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644649:4641], now have 1 active actors on pipe
2025-10-02T09:34:18.600159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644499:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.600164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.600167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.600169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.600179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.600192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.600194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.600197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.600189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2312
2025-10-02T09:34:18.600199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.600205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.600208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.600224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.600230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.600225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2312
2025-10-02T09:34:18.600245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.600244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.600251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.600287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.600296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.600300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.600301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.600308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.600315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.600328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.600435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.600440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.600449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.600504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2313 partition: 0 MaxSeqNo: 36 sessionId: src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0
2025-10-02T09:34:18.600732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced921db-339bd82-90b81d46-7efcd372_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.603348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Write session: try to update token
2025-10-02T09:34:18.603364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.609313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.609325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.609327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.609328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.609333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.609336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.609341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789075463:8523]
2025-10-02T09:34:18.609365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.609369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.609371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.609372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.609376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.609378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.609491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.615974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId: src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.618300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.681396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644656:4843]
2025-10-02T09:34:18.681617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2312, pipe: [1:7556555402864644656:4843]
2025-10-02T09:34:18.723472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.723769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.723779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.723794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644656:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.723958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.723995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:18.724005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:18.724023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.724052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2313 reason: error at write: Disconnected sessionId: src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0
2025-10-02T09:34:18.724072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644656:4843]
2025-10-02T09:34:18.724193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2313 sessionId: src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0 is DEAD
2025-10-02T09:34:18.724514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:18.724528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Write session will restart in 0.007458s
2025-10-02T09:34:18.724553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Write session: Do CDS request
2025-10-02T09:34:18.724558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.731665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.732854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.732965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.732972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.732980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.733017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.733049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789075618:8522]
2025-10-02T09:34:18.733149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.733256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.733265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2314
2025-10-02T09:34:18.733348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.733366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.733369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.733375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.733413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.733589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.733621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.733744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2314 sessionId:  describe result for acl check
2025-10-02T09:34:18.733783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.733790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.733792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.733797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864644772:4636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.733819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.733862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.733866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.733867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.733868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.733869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.733870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.733871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.733872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.733873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.733874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.733875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.733876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.733880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.733891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.733895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.733899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.733903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.733906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.733910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.733914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.733918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.733921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.733924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.733926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.733932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.733938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.733943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.733948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.733952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.733957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.733961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.733966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.733970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.733979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.733983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.733988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.733993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.733997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.734002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.734007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.734011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.734016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.734020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.734026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.734034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.734038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.734042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.734047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.734083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.734247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864644772:4636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.735635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864644772:4636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.740460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864644772:4636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.740472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864644772:4636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.740474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864644772:4636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.740479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.741638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.743377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.743389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.743391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.743394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.743399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2313 [2:7556555402789075618:8522]
2025-10-02T09:34:18.743414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.743429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.743431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.743434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.743435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.743449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.743456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.743463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.743506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.743512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.743513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.743516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.743518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.743566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.743571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.743582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.743593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.743611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.743630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644809:4636], now have 1 active actors on pipe
2025-10-02T09:34:18.743636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644658:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.743641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.743643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.743645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.743659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.743652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2313
2025-10-02T09:34:18.743653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2313
2025-10-02T09:34:18.743672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.743677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.743682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.743684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.743689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.743692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.743721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.743728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.743741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.743751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.743765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.743775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d92694a0-89dc2773-8ef82898-a26837f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.743780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.743784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.743789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.743797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.743804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.743825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.743923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.743928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.743939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.743986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2314 partition: 0 MaxSeqNo: 36 sessionId: src_id|d92694a0-89dc2773-8ef82898-a26837f6_0
2025-10-02T09:34:18.744234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8668df3d-2fc0b47e-595487e4-1a3742cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d92694a0-89dc2773-8ef82898-a26837f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.746854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Write session: try to update token
2025-10-02T09:34:18.746869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.753030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.753043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.753044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.753046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.753051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.753054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.753059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789075613:8522]
2025-10-02T09:34:18.753086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.753087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.753090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.753091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.753093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.753092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.753208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.759336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId: src_id|d92694a0-89dc2773-8ef82898-a26837f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.761531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.824233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644816:4843]
2025-10-02T09:34:18.824408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2313, pipe: [1:7556555402864644816:4843]
2025-10-02T09:34:18.866299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:18.866626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.866637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.866654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644816:4843], now have 1 active actors on pipe
2025-10-02T09:34:18.866790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:18.866854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:18.866864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:18.866912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2314 reason: error at write: Disconnected sessionId: src_id|d92694a0-89dc2773-8ef82898-a26837f6_0
2025-10-02T09:34:18.866913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:18.866966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644816:4843]
2025-10-02T09:34:18.867044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2314 sessionId: src_id|d92694a0-89dc2773-8ef82898-a26837f6_0 is DEAD
2025-10-02T09:34:18.867152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:18.867158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Write session will restart in 0.009352s
2025-10-02T09:34:18.867172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Write session: Do CDS request
2025-10-02T09:34:18.867176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:18.874649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:18.875910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:18.876039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:18.876047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:18.876055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:18.876096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:18.876130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555402789075769:8520]
2025-10-02T09:34:18.876489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:18.876656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:18.876688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:18.876893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:18.876936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.876940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.876941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.876942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.876943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.876944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.876945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.876946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.876947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.876947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.876948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.876949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.876953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.876964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.876968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.876971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.876975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.876979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.876983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.876986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.876990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.876994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.876998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.877001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.877008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.877014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:18.877020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.877025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:18.877032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.877038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:18.877043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.877047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:18.877052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.877057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:18.877061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.877066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:18.877070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.877075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:18.877079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.877084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:18.877088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.877095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:18.877099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.877103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.877107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.877112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.877116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.877122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.877154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:18.877219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.877305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:18.877313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2315
2025-10-02T09:34:18.877433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:18.877456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:18.877462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:18.877464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:18.877719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2315 sessionId:  describe result for acl check
2025-10-02T09:34:18.877737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:18.877742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:18.877743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:18.877746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555402864644940:4600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:18.878090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555402864644940:4600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:18.879352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555402864644940:4600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:18.883382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555402864644940:4600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:18.883390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555402864644940:4600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:18.883393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555402864644940:4600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:18.883396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:18.884577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:18.886224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:18.886233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:18.886236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:18.886239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:18.886243Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2314 [2:7556555402789075769:8520]
2025-10-02T09:34:18.886254Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:18.886266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:18.886268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.886270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.886272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.886284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:18.886294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:18.886300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:18.886340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.886346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.886347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.886350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:18.886352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:18.886401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:18.886406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.886417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:18.886428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:18.886446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:18.886464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644821:2446], now have 1 active actors on pipe
2025-10-02T09:34:18.886470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644975:4600], now have 1 active actors on pipe
2025-10-02T09:34:18.886463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2314
2025-10-02T09:34:18.886476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.886464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2314
2025-10-02T09:34:18.886478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.886480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.886486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:18.886497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:18.886498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:18.886503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:18.886504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:18.886509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:18.886512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:18.886529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.886535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.886557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.886567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:18.886575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:18.886587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|615e621a-e55fe61e-e719a844-a816c815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:18.886593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:18.886596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:18.886598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:18.886605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:18.886612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:18.886638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.886734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:18.886740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:18.886749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:18.886792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2315 partition: 0 MaxSeqNo: 36 sessionId: src_id|615e621a-e55fe61e-e719a844-a816c815_0
2025-10-02T09:34:18.887021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92694a0-89dc2773-8ef82898-a26837f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|615e621a-e55fe61e-e719a844-a816c815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:18.889611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Write session: try to update token
2025-10-02T09:34:18.889627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:18.895778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:18.895791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:18.895792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:18.895794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:18.895800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.895803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.895806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555402789075764:8520]
2025-10-02T09:34:18.895831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:18.895831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:18.895834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:18.895835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:18.895836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:18.895837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:18.895951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:18.902360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId: src_id|615e621a-e55fe61e-e719a844-a816c815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:18.904565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:18.967091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555402864644985:4843]
2025-10-02T09:34:18.967299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2314, pipe: [1:7556555402864644985:4843]
2025-10-02T09:34:19.009897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.010178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.010189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.010205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555402864644985:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.010357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.010396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555402864644985:4843]
2025-10-02T09:34:19.010418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:19.010422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.010541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|615e621a-e55fe61e-e719a844-a816c815_0
2025-10-02T09:34:19.010681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2315 sessionId: src_id|615e621a-e55fe61e-e719a844-a816c815_0 is DEAD
2025-10-02T09:34:19.010835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:19.010849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Write session will restart in 0.009003s
2025-10-02T09:34:19.010875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Write session: Do CDS request
2025-10-02T09:34:19.010880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.017866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.019175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.019311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.019320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.019328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.019373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.019399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084043228:8517]
2025-10-02T09:34:19.019739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.019915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.019939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.020179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.020213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.020217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.020217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.020218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.020219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.020219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.020219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.020220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.020221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.020221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.020222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.020222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.020225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.020231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.020233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.020236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.020237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.020239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.020241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.020243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.020245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.020248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.020250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.020252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.020256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.020260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.020264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.020267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.020269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.020272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.020274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.020277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.020279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.020283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.020285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.020288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.020290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.020292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.020295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.020297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.020299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.020302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.020304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.020306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.020308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.020311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.020313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.020316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.020333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.021181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.021267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.021275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2316
2025-10-02T09:34:19.021401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.021418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.021424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.021426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.021689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2316 sessionId:  describe result for acl check
2025-10-02T09:34:19.021712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.021716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.021717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.021720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159612400:4607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.022096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159612400:4607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.023239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159612400:4607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.027207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159612400:4607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.027217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159612400:4607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.027220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159612400:4607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.027223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.027816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.029340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.029350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.029351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.029353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.029357Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2315 [2:7556555407084043228:8517]
2025-10-02T09:34:19.029364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.029373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.029378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.029380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.029381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.029389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.029395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.029399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.029431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.029435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.029436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.029438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.029439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.029475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.029480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.029486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.029492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.029504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.029519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612436:4607], now have 1 active actors on pipe
2025-10-02T09:34:19.029526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.029528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.029529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.029536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.029544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612282:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.029550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.029550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.029552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.029553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.029560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.029561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.029557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2315
2025-10-02T09:34:19.029560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2315
2025-10-02T09:34:19.029577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.029583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.029585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.029595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.029598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.029635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.029669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.029674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.029675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.029680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.029686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.029703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.029783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.029788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.029795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.029855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2316 partition: 0 MaxSeqNo: 36 sessionId: src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0
2025-10-02T09:34:19.030058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615e621a-e55fe61e-e719a844-a816c815_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.032623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Write session: try to update token
2025-10-02T09:34:19.032636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.038738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.038749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.038750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.038751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.038754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.038758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.038760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084043223:8517]
2025-10-02T09:34:19.038778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.038784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.038785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.038785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.038787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.038791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.038925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.045064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId: src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.047180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.110414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159612468:4843]
2025-10-02T09:34:19.110615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2315, pipe: [1:7556555407159612468:4843]
2025-10-02T09:34:19.148829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.149039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.149048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.149060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612468:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.149190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.149248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:19.149303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0
2025-10-02T09:34:19.149310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159612468:4843]
2025-10-02T09:34:19.149326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.149436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2316 sessionId: src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0 is DEAD
2025-10-02T09:34:19.149588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:19.149603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Write session will restart in 0.008863s
2025-10-02T09:34:19.149625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Write session: Do CDS request
2025-10-02T09:34:19.149630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.157038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.158182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.158331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.158338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.158344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.158374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.158399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084043418:8494]
2025-10-02T09:34:19.158765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.158936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.158961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.159125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.159142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.159172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.159178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.159179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.159180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.159181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.159182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.159183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.159183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.159184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.159185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.159186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.159187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.159191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.159199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.159202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.159235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.159206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.159242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2317
2025-10-02T09:34:19.159208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.159211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.159215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.159218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.159221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.159225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.159229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.159232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.159238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.159244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.159249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.159254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.159258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.159263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.159267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.159272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.159277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.159282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.159286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.159290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.159295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.159299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.159303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.159308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.159313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.159318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.159322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.159330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.159334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.159342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.159346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.159351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.159351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.159369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.159372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.159374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.159378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.159627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2317 sessionId:  describe result for acl check
2025-10-02T09:34:19.159649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.159654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.159655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.159658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159612597:4570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.159969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159612597:4570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.161619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159612597:4570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.165581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159612597:4570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.165590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159612597:4570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.165592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159612597:4570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.165595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.166770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.168370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.168383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.168385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.168388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.168392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2316 [2:7556555407084043418:8494]
2025-10-02T09:34:19.168402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.168415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.168418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.168420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.168422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.168434Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.168438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.168443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.168478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.168484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.168485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.168488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.168490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.168535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.168540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.168549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.168560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.168576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.168593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612478:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.168600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612632:4570], now have 1 active actors on pipe
2025-10-02T09:34:19.168587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2316
2025-10-02T09:34:19.168605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.168607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.168609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.168593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2316
2025-10-02T09:34:19.168615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.168619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.168621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.168622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.168626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.168638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.168642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.168655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.168660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.168685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.168694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.168703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.168705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8847e69d-811923b2-b251e873-34c98bce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.168710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.168713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.168714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.168721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.168727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.168788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.168889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.168895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.168905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.168962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2317 partition: 0 MaxSeqNo: 36 sessionId: src_id|8847e69d-811923b2-b251e873-34c98bce_0
2025-10-02T09:34:19.169183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89f0f4ca-3c1a4f0e-e99b2c74-74532679_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8847e69d-811923b2-b251e873-34c98bce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.171772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Write session: try to update token
2025-10-02T09:34:19.171788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.177788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.177800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.177801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.177803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.177809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.177812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.177814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084043413:8494]
2025-10-02T09:34:19.177837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.177839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.177840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.177842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.177843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.177844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.177960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.185417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId: src_id|8847e69d-811923b2-b251e873-34c98bce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.187531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.249687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159612640:4843]
2025-10-02T09:34:19.249865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2316, pipe: [1:7556555407159612640:4843]
2025-10-02T09:34:19.286370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.286677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.286687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.286702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612640:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.286821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.286861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159612640:4843]
2025-10-02T09:34:19.286879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:19.286881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.286926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2317 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8847e69d-811923b2-b251e873-34c98bce_0
2025-10-02T09:34:19.287057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2317 sessionId: src_id|8847e69d-811923b2-b251e873-34c98bce_0 is DEAD
2025-10-02T09:34:19.287174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:19.287182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Write session will restart in 0.005649s
2025-10-02T09:34:19.287196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Write session: Do CDS request
2025-10-02T09:34:19.287200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.294162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.294260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.294267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2318
2025-10-02T09:34:19.294388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.294412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.294420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.294424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.294653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.294764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2318 sessionId:  describe result for acl check
2025-10-02T09:34:19.294794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.294800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.294803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.294807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159612759:4561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.295206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159612759:4561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.295815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.295918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.295925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.295930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.295958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.295990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084043572:8493]
2025-10-02T09:34:19.296378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.296556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.296582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.296660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159612759:4561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.296785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.296831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.296835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.296835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.296836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.296837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.296837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.296838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.296838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.296839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.296840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.296840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.296841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.296844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.296850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.296852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.296854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.296856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.296858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.296860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.296862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.296864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.296866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.296868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.296870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.296873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.296877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.296880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.296883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.296885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.296888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.296891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.296894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.296896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.296898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.296901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.296903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.296907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.296912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.296914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.296917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.296920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.296925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.296927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.296930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.296935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.296938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.296940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.296943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.296962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.300750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159612759:4561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.300758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159612759:4561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.300760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159612759:4561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.300764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.304359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.306054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.306063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.306064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.306066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.306069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2317 [2:7556555407084043572:8493]
2025-10-02T09:34:19.306075Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.306085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.306089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.306091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.306092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.306101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.306103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.306108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.306137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.306142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.306143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.306145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.306146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.306180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.306185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.306191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.306201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.306218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.306235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612643:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.306241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612798:4561], now have 1 active actors on pipe
2025-10-02T09:34:19.306244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.306245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.306246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.306255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.306265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.306268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.306269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.306269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2317
2025-10-02T09:34:19.306270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.306279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2317
2025-10-02T09:34:19.306275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.306277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.306292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.306296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.306298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.306307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.306312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.306336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.306343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.306345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.306350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.306355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.306362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.306375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.306463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.306468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.306478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.306550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2318 partition: 0 MaxSeqNo: 36 sessionId: src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0
2025-10-02T09:34:19.306805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8847e69d-811923b2-b251e873-34c98bce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.309404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Write session: try to update token
2025-10-02T09:34:19.309420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.315304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.315314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.315316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.315316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.315320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.315322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.315324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084043567:8493]
2025-10-02T09:34:19.315343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.315343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.315346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.315347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.315348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.315349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.315463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.324570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId: src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.326854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.386907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159612806:4843]
2025-10-02T09:34:19.387055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2317, pipe: [1:7556555407159612806:4843]
2025-10-02T09:34:19.426418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.426674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.426683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.426695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612806:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.426828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.426845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159612806:4843]
2025-10-02T09:34:19.426863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.426868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:19.426871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:19.426924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2318 reason: error at write: Disconnected sessionId: src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0
2025-10-02T09:34:19.427082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2318 sessionId: src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0 is DEAD
2025-10-02T09:34:19.427239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:19.427254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Write session will restart in 0.006365s
2025-10-02T09:34:19.427278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Write session: Do CDS request
2025-10-02T09:34:19.427283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.434116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.434215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.434221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2319
2025-10-02T09:34:19.434338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.434359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.434365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.434367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.434687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2319 sessionId:  describe result for acl check
2025-10-02T09:34:19.434715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.434721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.434722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.434726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159612923:4532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.434883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.435191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159612923:4532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.436233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.436375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.436382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.436388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.436425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.436449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084043729:8490]
2025-10-02T09:34:19.436577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159612923:4532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.436830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.437021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.437055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.437269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.437313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.437317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.437318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.437318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.437319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.437319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.437320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.437321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.437321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.437322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.437322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.437323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.437326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.437331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.437333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.437335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.437337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.437339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.437341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.437343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.437345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.437347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.437349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.437351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.437355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.437359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.437362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.437365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.437367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.437370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.437372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.437375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.437377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.437380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.437382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.437384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.437387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.437390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.437392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.437395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.437397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.437399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.437402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.437405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.437407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.437410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.437412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.437414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.437434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.441329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159612923:4532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.441338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159612923:4532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.441340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159612923:4532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.441344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.445046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.446606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.446615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.446616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.446618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.446621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2318 [2:7556555407084043729:8490]
2025-10-02T09:34:19.446629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.446639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.446640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.446641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.446642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.446651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.446654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.446661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.446689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.446694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.446695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.446697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.446698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.446734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.446738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.446747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.446757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.446775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.446789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612963:4532], now have 1 active actors on pipe
2025-10-02T09:34:19.446795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612807:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.446799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.446800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.446801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.446808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.446816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.446812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2318
2025-10-02T09:34:19.446826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.446831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.446831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2318
2025-10-02T09:34:19.446841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.446851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.446853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.446853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.446855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.446862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.446867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.446877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.446880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79b60f39-e4b074e9-663813d8-879acdaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.446885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.446887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.446888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.446893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.446899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.446910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.447001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.447009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.447020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.447078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2319 partition: 0 MaxSeqNo: 36 sessionId: src_id|79b60f39-e4b074e9-663813d8-879acdaf_0
2025-10-02T09:34:19.447318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f93c98-ab249cda-c7d6f22c-47c53570_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|79b60f39-e4b074e9-663813d8-879acdaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.449828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Write session: try to update token
2025-10-02T09:34:19.449843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.456148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.456159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.456160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.456161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.456165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.456167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.456169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084043724:8490]
2025-10-02T09:34:19.456188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.456192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.456193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.456196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.456199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.456201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.456306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.462407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId: src_id|79b60f39-e4b074e9-663813d8-879acdaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.464617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.527186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159612971:4843]
2025-10-02T09:34:19.527330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2318, pipe: [1:7556555407159612971:4843]
2025-10-02T09:34:19.567172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.567475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.567484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.567496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612971:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.567636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.567683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:19.567691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:19.567701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.567732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2319 reason: error at write: Disconnected sessionId: src_id|79b60f39-e4b074e9-663813d8-879acdaf_0
2025-10-02T09:34:19.567736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159612971:4843]
2025-10-02T09:34:19.567864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2319 sessionId: src_id|79b60f39-e4b074e9-663813d8-879acdaf_0 is DEAD
2025-10-02T09:34:19.568230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:19.568244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Write session will restart in 0.007423s
2025-10-02T09:34:19.568264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Write session: Do CDS request
2025-10-02T09:34:19.568269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.574925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.576043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.576201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.576208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.576214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.576244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.576267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084043886:8488]
2025-10-02T09:34:19.576624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.576814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.576847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.577030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.577060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.577064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.577065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.577066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.577067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.577068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.577069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.577070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.577071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.577072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.577073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.577074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.577078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.577088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.577090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.577092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.577094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.577096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.577098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.577100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.577102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.577104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.577106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.577108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.577113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.577117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.577120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.577123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.577125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.577128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.577130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.577133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.577135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.577138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.577141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.577141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.577147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.577149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.577152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.577154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.577157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.577159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.577162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.577164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.577166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.577168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.577175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.577177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.577179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.577196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.577238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.577245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2320
2025-10-02T09:34:19.577348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.577364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.577371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.577373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.577637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2320 sessionId:  describe result for acl check
2025-10-02T09:34:19.577662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.577663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.577665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.577668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159613103:4539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.578004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159613103:4539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.579267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159613103:4539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.583456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159613103:4539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.583475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159613103:4539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.583482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159613103:4539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.583492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.584622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.586195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.586206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.586207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.586209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.586212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2319 [2:7556555407084043886:8488]
2025-10-02T09:34:19.586219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.586228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.586232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.586234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.586235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.586243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.586249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.586253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.586289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.586296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.586297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.586299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.586301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.586340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.586344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.586352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.586357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.586368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.586381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613137:4539], now have 1 active actors on pipe
2025-10-02T09:34:19.586386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159612972:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.586390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.586391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.586392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.586399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.586409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.586413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.586415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.586417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.586419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.586420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.586412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2319
2025-10-02T09:34:19.586432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2319
2025-10-02T09:34:19.586434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.586439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.586440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.586454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.586459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.586475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.586481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.586483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.586484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.586489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.586496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.586508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.586621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.586627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.586636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.586732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2320 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0
2025-10-02T09:34:19.586970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b60f39-e4b074e9-663813d8-879acdaf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.589503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Write session: try to update token
2025-10-02T09:34:19.589517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.595610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.595621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.595622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.595623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.595626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.595628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.595629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084043881:8488]
2025-10-02T09:34:19.595649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.595650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.595653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.595655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.595655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.595656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.595763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.601501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId: src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.603657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.668004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159613144:4843]
2025-10-02T09:34:19.668137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2319, pipe: [1:7556555407159613144:4843]
2025-10-02T09:34:19.706754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.706984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.706993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.707005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613144:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.707122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.707159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:19.707167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:19.707209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2320 reason: error at write: Disconnected sessionId: src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0
2025-10-02T09:34:19.707217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.707266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159613144:4843]
2025-10-02T09:34:19.707339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2320 sessionId: src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0 is DEAD
2025-10-02T09:34:19.707474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:19.707487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Write session will restart in 0.005416s
2025-10-02T09:34:19.707511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Write session: Do CDS request
2025-10-02T09:34:19.707516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.714139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.714258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.714265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2321
2025-10-02T09:34:19.714334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.714366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.714385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.714391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.714394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.714762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2321 sessionId:  describe result for acl check
2025-10-02T09:34:19.714806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.714813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.714815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.714819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159613266:4522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.715266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159613266:4522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.715539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.715638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.715645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.715650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.715677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.715699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084044043:8487]
2025-10-02T09:34:19.716034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.716200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.716222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.716395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.716423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.716427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.716428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.716428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.716429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.716429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.716430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.716431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.716431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.716432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.716432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.716433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.716435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.716441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.716444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.716446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.716448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.716450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.716452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.716454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.716455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.716457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.716459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.716461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.716465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.716469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.716472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.716474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.716476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.716479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.716482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.716484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.716487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.716491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.716493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.716496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.716498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.716501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.716504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.716508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.716512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.716514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.716516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.716519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.716524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.716527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.716529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.716532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.716548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.716586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159613266:4522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.721330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159613266:4522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.721344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159613266:4522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.721346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159613266:4522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.721352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.723871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.725379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.725390Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.725391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.725393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.725396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2320 [2:7556555407084044043:8487]
2025-10-02T09:34:19.725403Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.725411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.725413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.725414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.725415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.725424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.725427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.725431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.725457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.725462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.725463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.725465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.725466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.725500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.725505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.725512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.725517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.725527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.725541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613306:4522], now have 1 active actors on pipe
2025-10-02T09:34:19.725546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613147:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.725550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.725551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.725552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.725560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.725570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.725572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.725574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.725575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.725580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.725581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.725583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2320
2025-10-02T09:34:19.725594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.725590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2320
2025-10-02T09:34:19.725599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.725609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.725616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.725619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.725635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|270e146a-ee11ce04-1917ad22-39a691ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.725642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.725644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.725645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.725650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.725656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.725667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.725753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.725758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.725765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.725819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2321 partition: 0 MaxSeqNo: 36 sessionId: src_id|270e146a-ee11ce04-1917ad22-39a691ef_0
2025-10-02T09:34:19.726068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce4a0e3b-4783bb31-d02613fd-1d8e4abb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|270e146a-ee11ce04-1917ad22-39a691ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.728615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Write session: try to update token
2025-10-02T09:34:19.728628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.734559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.734569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.734571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.734572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.734575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.734587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.734589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084044038:8487]
2025-10-02T09:34:19.734607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.734612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.734613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.734613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.734616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.734618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.734720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.740768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId: src_id|270e146a-ee11ce04-1917ad22-39a691ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.743005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.807251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159613316:4843]
2025-10-02T09:34:19.807434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2320, pipe: [1:7556555407159613316:4843]
2025-10-02T09:34:19.843911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.844214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.844223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.844235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613316:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.844370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.844390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.844425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:19.844469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159613316:4843]
2025-10-02T09:34:19.844475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2321 reason: status is not ok: tablet will be restarted right now sessionId: src_id|270e146a-ee11ce04-1917ad22-39a691ef_0
2025-10-02T09:34:19.844599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2321 sessionId: src_id|270e146a-ee11ce04-1917ad22-39a691ef_0 is DEAD
2025-10-02T09:34:19.844780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:19.844796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Write session will restart in 0.007140s
2025-10-02T09:34:19.844831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Write session: Do CDS request
2025-10-02T09:34:19.844838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.852136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.853152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.853179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.853247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.853255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2322
2025-10-02T09:34:19.853341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.853348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.853355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.853358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.853376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.853382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.853384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.853389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.853411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084044200:8480]
2025-10-02T09:34:19.853663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2322 sessionId:  describe result for acl check
2025-10-02T09:34:19.853682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.853687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.853688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.853690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159613437:4502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.853765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.853967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.853994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.854100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159613437:4502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.854205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.854241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.854246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.854247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.854247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.854248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.854249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.854250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.854251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.854252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.854252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.854253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.854254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.854258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.854267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.854271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.854274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.854278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.854281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.854284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.854286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.854288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.854290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.854292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.854294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.854299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.854303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.854306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.854309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.854311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.854314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.854316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.854318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.854320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.854324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.854326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.854329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.854331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.854334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.854336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.854338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.854340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.854343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.854345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.854348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.854350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.854353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.854355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.854357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.854375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.855880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159613437:4502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.859680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159613437:4502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.859692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159613437:4502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.859695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159613437:4502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.859700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.861852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:19.863508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:19.863521Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:19.863523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:19.863525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:19.863530Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2321 [2:7556555407084044200:8480]
2025-10-02T09:34:19.863540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:19.863551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:19.863552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.863554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.863555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.863564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:19.863567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:19.863571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:19.863604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.863608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.863609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.863611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:19.863612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:19.863649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:19.863653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.863660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.863666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.863677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:19.863691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613479:4502], now have 1 active actors on pipe
2025-10-02T09:34:19.863696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613317:2446], now have 1 active actors on pipe
2025-10-02T09:34:19.863700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.863701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.863702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.863710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:19.863721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:19.863722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:19.863723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:19.863724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:19.863731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:19.863733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:19.863727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2321
2025-10-02T09:34:19.863736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2321
2025-10-02T09:34:19.863751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.863756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:19.863758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:19.863766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.863772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.863807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:19.863813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:19.863815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:19.863817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:19.863822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:19.863830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:19.863840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.863933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.863938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.863945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:19.863994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2322 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0
2025-10-02T09:34:19.864227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270e146a-ee11ce04-1917ad22-39a691ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:19.866844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Write session: try to update token
2025-10-02T09:34:19.866858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:19.872752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:19.872761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:19.872763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:19.872763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:19.872767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.872769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.872771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084044195:8480]
2025-10-02T09:34:19.872788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:19.872791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.872792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:19.872796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:19.872799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:19.872810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:19.872915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:19.878762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId: src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:19.880850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:19.944485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555407159613494:4843]
2025-10-02T09:34:19.944681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2321, pipe: [1:7556555407159613494:4843]
2025-10-02T09:34:19.982129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:19.982387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:19.982396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:19.982407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613494:4843], now have 1 active actors on pipe
2025-10-02T09:34:19.982538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:19.982564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555407159613494:4843]
2025-10-02T09:34:19.982593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:19.982635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:19.982750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0
2025-10-02T09:34:19.982913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2322 sessionId: src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0 is DEAD
2025-10-02T09:34:19.983068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:19.983081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Write session will restart in 0.006862s
2025-10-02T09:34:19.983102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Write session: Do CDS request
2025-10-02T09:34:19.983107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:19.989867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:19.991122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.991147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:19.991207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:19.991216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2323
2025-10-02T09:34:19.991254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:19.991262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:19.991269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:19.991301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:19.991325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555407084044370:8475]
2025-10-02T09:34:19.991327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:19.991347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:19.991353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:19.991356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:19.991676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:19.991702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2323 sessionId:  describe result for acl check
2025-10-02T09:34:19.991738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:19.991745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:19.991746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:19.991750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555407159613616:4483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:19.991890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:19.991916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:19.992111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:19.992142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.992146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.992147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.992147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.992148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.992149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.992149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.992150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.992150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.992151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.992151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.992152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.992155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.992161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.992164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.992166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.992168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.992170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.992172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.992174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.992175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555407159613616:4483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:19.992176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.992178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.992180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.992182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.992186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.992190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:19.992193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.992196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:19.992199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.992202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:19.992204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.992207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:19.992209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.992212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:19.992214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.992217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:19.992220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.992222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:19.992224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.992227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:19.992230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.992232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:19.992234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.992237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:19.992239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.992241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:19.992247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.992249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:19.992265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:19.993527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555407159613616:4483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:19.997495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555407159613616:4483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:19.997509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555407159613616:4483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:19.997511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555407159613616:4483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:19.997516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:19.999619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.001136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.001146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.001147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.001150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.001153Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2322 [2:7556555407084044370:8475]
2025-10-02T09:34:20.001159Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.001169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.001170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.001172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.001173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.001182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.001188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.001192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.001221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.001226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.001227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.001230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.001231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.001278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.001285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.001292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.001297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.001309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.001322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613655:4483], now have 1 active actors on pipe
2025-10-02T09:34:20.001328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555407159613495:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.001332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.001333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.001334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.001341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.001352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.001359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.001362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.001352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2322
2025-10-02T09:34:20.001363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.001368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.001370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.001367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2322
2025-10-02T09:34:20.001377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.001379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.001381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.001389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.001390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.001416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.001422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.001425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.001426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.001431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.001439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.001452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.001546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.001553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.001562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.001618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2323 partition: 0 MaxSeqNo: 36 sessionId: src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0
2025-10-02T09:34:20.001885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef15d162-a079dfdb-a8a084dc-d91d5edf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.004505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Write session: try to update token
2025-10-02T09:34:20.004518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.010426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.010437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.010439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.010440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.010443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.010448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.010450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555407084044365:8475]
2025-10-02T09:34:20.010474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.010474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.010479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.010481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.010481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.010483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.010598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.016678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId: src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.018912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.082705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454580971:4843]
2025-10-02T09:34:20.082817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2322, pipe: [1:7556555411454580971:4843]
2025-10-02T09:34:20.121771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.122020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.122028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.122040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454580971:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.122180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.122247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454580971:4843]
2025-10-02T09:34:20.122270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.122289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:20.122385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2323 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0
2025-10-02T09:34:20.122543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2323 sessionId: src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0 is DEAD
2025-10-02T09:34:20.122747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:20.122762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Write session will restart in 0.005877s
2025-10-02T09:34:20.122785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Write session: Do CDS request
2025-10-02T09:34:20.122791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.129277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.129285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2324
2025-10-02T09:34:20.129301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.129464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.129485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.129491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.129494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.129600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.129769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2324 sessionId:  describe result for acl check
2025-10-02T09:34:20.129788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.129793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.129796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.129798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454581093:4474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.130153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454581093:4474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.130810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.130913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.130920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.130925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.130951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.130975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379011857:8461]
2025-10-02T09:34:20.131343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.131502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.131525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.131764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.131802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.131808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.131809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.131809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.131810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.131811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.131812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.131812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.131813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.131814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.131815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.131816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.131820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.131827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.131830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.131832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.131833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.131835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.131837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.131839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.131841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.131843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.131845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.131847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.131851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.131855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.131858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.131861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.131863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.131866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.131869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.131873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.131876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.131883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.131886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.131889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.131895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.131898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.131900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.131902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.131905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.131907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.131910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.131894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454581093:4474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.131912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.131917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.131920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.131922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.131925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.131942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.136959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454581093:4474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.136975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454581093:4474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.136978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454581093:4474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.136984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.139547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.141043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.141058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.141059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.141061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.141064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2323 [2:7556555411379011857:8461]
2025-10-02T09:34:20.141071Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.141082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.141086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.141088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.141089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.141097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.141100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.141104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.141133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.141138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.141139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.141141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.141142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.141178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.141183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.141190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.141195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.141206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.141220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454580972:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.141225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581145:4474], now have 1 active actors on pipe
2025-10-02T09:34:20.141229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.141230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.141233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.141240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.141249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.141253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.141255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.141256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.141261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.141263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.141279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.141265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2323
2025-10-02T09:34:20.141285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.141286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.141296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2323
2025-10-02T09:34:20.141354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.141360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.141373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.141379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.141382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.141384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.141388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.141396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.141406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.141529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.141537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.141548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.141612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2324 partition: 0 MaxSeqNo: 36 sessionId: src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0
2025-10-02T09:34:20.141838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42407c32-2e0e027f-7ae7a538-3c544d2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.144469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Write session: try to update token
2025-10-02T09:34:20.144484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.150405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.150416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.150417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.150418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.150421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.150423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.150426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379011852:8461]
2025-10-02T09:34:20.150444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.150450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.150451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.150460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.150471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.150477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.150563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.156785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId: src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.158915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.222509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454581163:4843]
2025-10-02T09:34:20.222677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2323, pipe: [1:7556555411454581163:4843]
2025-10-02T09:34:20.261956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.262174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.262182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.262195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581163:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.262337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.262341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454581163:4843]
2025-10-02T09:34:20.262361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.262395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:20.262410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:20.262486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2324 reason: error at write: Disconnected sessionId: src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0
2025-10-02T09:34:20.262653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2324 sessionId: src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0 is DEAD
2025-10-02T09:34:20.262810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:20.262825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Write session will restart in 0.007087s
2025-10-02T09:34:20.262855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Write session: Do CDS request
2025-10-02T09:34:20.262861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.269970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.271154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.271187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.271260Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.271266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.271272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.271296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.271322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379012025:8458]
2025-10-02T09:34:20.271645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.271654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2325
2025-10-02T09:34:20.271676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.271798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.271824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.271834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.271838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.271839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.271869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.272043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.272071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.272075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.272075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.272076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.272076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.272077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.272077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.272078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.272079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.272079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.272080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.272080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.272083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.272093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.272096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.272100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.272103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.272106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.272112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.272114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.272116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.272118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.272120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.272122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.272126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.272134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.272137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.272140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.272142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.272144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.272146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.272149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.272151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.272154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.272157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.272160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.272162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.272165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.272167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.272173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.272176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.272178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.272181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.272183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.272188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.272191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.272193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.272196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.272214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.272288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2325 sessionId:  describe result for acl check
2025-10-02T09:34:20.272324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.272331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.272333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.272337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454581291:4430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.272775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454581291:4430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.274528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454581291:4430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.279181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454581291:4430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.279195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454581291:4430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.279198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454581291:4430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.279203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.279594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.281180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.281191Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.281192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.281194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.281197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2324 [2:7556555411379012025:8458]
2025-10-02T09:34:20.281204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.281212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.281214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.281215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.281216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.281225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.281231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.281236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.281264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.281268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.281269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.281271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.281272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.281310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.281316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.281325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.281339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.281350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.281364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581164:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.281369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581328:4430], now have 1 active actors on pipe
2025-10-02T09:34:20.281372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.281373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.281374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.281381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.281391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.281398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.281401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.281402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.281405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.281408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.281415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.281417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.281419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.281408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2324
2025-10-02T09:34:20.281420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2324
2025-10-02T09:34:20.281438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.281443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.281458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c815f794-53696ed3-5c1650c-62feae24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.281464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.281466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.281467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.281472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.281480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.281487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.281602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.281610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.281619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.281682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2325 partition: 0 MaxSeqNo: 36 sessionId: src_id|c815f794-53696ed3-5c1650c-62feae24_0
2025-10-02T09:34:20.281932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2df5d881-a6d840c0-46943f79-ba1abcba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c815f794-53696ed3-5c1650c-62feae24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.284529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Write session: try to update token
2025-10-02T09:34:20.284543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.294305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:20.294315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.294318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.294338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:20.294342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:20.294480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:20.294605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:20.294724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:20.294840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:20.295008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:20.295029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:20.297491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId: src_id|c815f794-53696ed3-5c1650c-62feae24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.298621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.298630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.298631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.298632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.298636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.298637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.298639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379012020:8458]
2025-10-02T09:34:20.298655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.298658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.298659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.298659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.298662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.298664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.298767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.299703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.362256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454581338:4843]
2025-10-02T09:34:20.362393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2324, pipe: [1:7556555411454581338:4843]
2025-10-02T09:34:20.411190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.411457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.411467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.411480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581338:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.411626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.411628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.411663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454581338:4843]
2025-10-02T09:34:20.411686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:20.411790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2325 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c815f794-53696ed3-5c1650c-62feae24_0
2025-10-02T09:34:20.411959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2325 sessionId: src_id|c815f794-53696ed3-5c1650c-62feae24_0 is DEAD
2025-10-02T09:34:20.412136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:20.412150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Write session will restart in 0.006718s
2025-10-02T09:34:20.412174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Write session: Do CDS request
2025-10-02T09:34:20.412180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.418851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.419993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.420108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.420115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.420123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.420137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.420152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.420176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379012189:8452]
2025-10-02T09:34:20.420215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.420224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2326
2025-10-02T09:34:20.420352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.420372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.420379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.420381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.420538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.420715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.420717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2326 sessionId:  describe result for acl check
2025-10-02T09:34:20.420741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.420749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.420755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.420757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.420761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454581465:4419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.420952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.420984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.420988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.420989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.420990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.420990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.420991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.420991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.420992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.420992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.420993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.420993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.420994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.420997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.421003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.421006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.421008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.421010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.421012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.421014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.421016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.421018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.421020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.421022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.421024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.421028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.421032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.421035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.421038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.421041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.421044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.421046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.421049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.421051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.421054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.421056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.421059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.421061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.421064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.421066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.421069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.421071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.421074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.421077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.421082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.421089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.421094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.421101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.421105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.421126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.421219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454581465:4419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.422593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454581465:4419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.427493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454581465:4419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.427505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454581465:4419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.427507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454581465:4419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.427512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.428676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.430236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.430247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.430249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.430251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.430254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2325 [2:7556555411379012189:8452]
2025-10-02T09:34:20.430261Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.430269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.430274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.430276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.430277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.430285Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.430289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.430293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.430336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.430341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.430342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.430343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.430345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.430425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.430430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.430437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.430443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.430455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.430469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581502:4419], now have 1 active actors on pipe
2025-10-02T09:34:20.430474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581339:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.430463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2325
2025-10-02T09:34:20.430477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.430478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.430473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2325
2025-10-02T09:34:20.430479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.430484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.430492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.430492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.430493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.430494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.430502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.430504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.430513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.430518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.430538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.430546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.430554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.430555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.430560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.430563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.430565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.430571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.430587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.430611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.430722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.430729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.430738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.430792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2326 partition: 0 MaxSeqNo: 36 sessionId: src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0
2025-10-02T09:34:20.431043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815f794-53696ed3-5c1650c-62feae24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.433635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Write session: try to update token
2025-10-02T09:34:20.433649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.439574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.439584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.439585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.439586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.439591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.439593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.439595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379012184:8452]
2025-10-02T09:34:20.439612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.439617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.439617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.439618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.439619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.439621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.439727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.445805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId: src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.447989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.511766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454581510:4843]
2025-10-02T09:34:20.511907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2325, pipe: [1:7556555411454581510:4843]
2025-10-02T09:34:20.553344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.553591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.553600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.553612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581510:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.553767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.553795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:20.553807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:20.553855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2326 reason: error at write: Disconnected sessionId: src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0
2025-10-02T09:34:20.553859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454581510:4843]
2025-10-02T09:34:20.553890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.554008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2326 sessionId: src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0 is DEAD
2025-10-02T09:34:20.554163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:20.554177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Write session will restart in 0.008816s
2025-10-02T09:34:20.554198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Write session: Do CDS request
2025-10-02T09:34:20.554204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.561262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.562411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.562585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.562593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.562600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.562631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.562660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379012352:8446]
2025-10-02T09:34:20.563009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.563181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.563208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.563388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.563418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.563423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.563424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.563424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.563425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.563426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.563427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.563428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.563428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.563429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.563431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.563432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.563436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.563444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.563446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.563448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.563450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.563451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.563453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.563455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.563457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.563459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.563461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.563463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.563467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.563471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.563474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.563477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.563479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.563482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.563484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.563487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.563489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.563492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.563495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.563497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.563500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.563507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.563509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.563511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.563513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.563517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.563519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.563522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.563524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.563530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.563532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.563534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.563555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.564209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.564301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.564312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2327
2025-10-02T09:34:20.564424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.564442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.564448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.564451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.564831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2327 sessionId:  describe result for acl check
2025-10-02T09:34:20.564865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.564874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.564876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.564880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454581640:4403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.565298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454581640:4403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.566986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454581640:4403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.570374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454581640:4403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.570388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454581640:4403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.570391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454581640:4403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.570397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.570902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.572490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.572501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.572502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.572504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.572508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2326 [2:7556555411379012352:8446]
2025-10-02T09:34:20.572515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.572523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.572528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.572530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.572531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.572538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.572541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.572546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.572580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.572584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.572585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.572587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.572588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.572622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.572626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.572636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.572648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.572665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.572682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581675:4403], now have 1 active actors on pipe
2025-10-02T09:34:20.572687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581511:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.572690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.572692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.572692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.572701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.572695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2326
2025-10-02T09:34:20.572708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2326
2025-10-02T09:34:20.572710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.572711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.572718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.572720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.572723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.572724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.572750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.572755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.572763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.572770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.572778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.572790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e25806be-5b1db416-1889ff0b-4d531480_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.572796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.572799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.572811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.572816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.572824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.572837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.572937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.572943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.572952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.573010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2327 partition: 0 MaxSeqNo: 36 sessionId: src_id|e25806be-5b1db416-1889ff0b-4d531480_0
2025-10-02T09:34:20.573276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83ac2cf-7a3ab08c-e30b6377-a6fb05d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e25806be-5b1db416-1889ff0b-4d531480_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.575874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Write session: try to update token
2025-10-02T09:34:20.575888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.581782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.581793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.581794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.581795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.581799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.581801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.581803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379012347:8446]
2025-10-02T09:34:20.581820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.581825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.581826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.581827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.581828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.581830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.581964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.587925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId: src_id|e25806be-5b1db416-1889ff0b-4d531480_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.590032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.654131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454581682:4843]
2025-10-02T09:34:20.654341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2326, pipe: [1:7556555411454581682:4843]
2025-10-02T09:34:20.694987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.695211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.695219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.695231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581682:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.695358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.695365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454581682:4843]
2025-10-02T09:34:20.695386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.695422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:20.695524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2327 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e25806be-5b1db416-1889ff0b-4d531480_0
2025-10-02T09:34:20.695673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2327 sessionId: src_id|e25806be-5b1db416-1889ff0b-4d531480_0 is DEAD
2025-10-02T09:34:20.695832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:20.695846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Write session will restart in 0.006878s
2025-10-02T09:34:20.695867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Write session: Do CDS request
2025-10-02T09:34:20.695872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.702622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.703755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.703854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.703861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.703866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.703890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.703913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379012516:8444]
2025-10-02T09:34:20.704139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.704208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.704216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2328
2025-10-02T09:34:20.704299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.704334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.704352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.704358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.704361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.704482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.704513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.704630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2328 sessionId:  describe result for acl check
2025-10-02T09:34:20.704653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.704657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.704658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.704661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454581812:4397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.704692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.704719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.704723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.704724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.704725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.704726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.704727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.704728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.704729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.704730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.704731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.704732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.704733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.704737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.704747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.704751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.704753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.704755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.704757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.704759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.704761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.704763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.704765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.704767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.704769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.704772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.704776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.704779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.704782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.704784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.704786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.704789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.704791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.704793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.704796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.704798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.704811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.704813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.704816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.704818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.704820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.704822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.704826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.704828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.704830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.704832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.704835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.704836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.704839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.704859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.705027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454581812:4397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.706843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454581812:4397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.711748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454581812:4397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.711760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454581812:4397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.711763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454581812:4397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.711769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.712230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.713819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.713830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.713832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.713834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.713837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2327 [2:7556555411379012516:8444]
2025-10-02T09:34:20.713844Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.713853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.713854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.713856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.713857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.713864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.713867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.713871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.713899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.713904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.713905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.713907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.713909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.713946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.713953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.713962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.713972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.713984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.713999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581849:4397], now have 1 active actors on pipe
2025-10-02T09:34:20.714004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581684:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.714008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.714009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.714011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.714019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.714029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.714027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2327
2025-10-02T09:34:20.714036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.714042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2327
2025-10-02T09:34:20.714039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.714040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.714044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.714046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.714061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.714066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.714072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.714079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.714084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.714096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.714103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.714105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.714106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.714111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.714119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.714132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.714223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.714230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.714239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.714299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2328 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0
2025-10-02T09:34:20.714542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25806be-5b1db416-1889ff0b-4d531480_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.717132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Write session: try to update token
2025-10-02T09:34:20.717147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.723126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.723137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.723138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.723139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.723143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.723146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.723149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379012511:8444]
2025-10-02T09:34:20.723173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.723173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.723176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.723178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.723178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.723180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.723295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.729449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId: src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.731634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.795437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454581856:4843]
2025-10-02T09:34:20.795623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2327, pipe: [1:7556555411454581856:4843]
2025-10-02T09:34:20.836309Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.836609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.836618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.836631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581856:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.836791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:20.836813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:20.836846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.836872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2328 reason: error at write: Disconnected sessionId: src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0
2025-10-02T09:34:20.836992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454581856:4843]
2025-10-02T09:34:20.837001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2328 sessionId: src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0 is DEAD
2025-10-02T09:34:20.837134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:20.837142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Write session will restart in 0.005864s
2025-10-02T09:34:20.837158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Write session: Do CDS request
2025-10-02T09:34:20.837165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.837340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.844169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.844250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.844258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2329
2025-10-02T09:34:20.844371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.844390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.844395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.844397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.844662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2329 sessionId:  describe result for acl check
2025-10-02T09:34:20.844682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.844686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.844687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.844690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454581984:4391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.844713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.845070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454581984:4391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.845937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.846112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.846120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.846127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.846163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.846185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379012680:8439]
2025-10-02T09:34:20.846538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.846668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454581984:4391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.846730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.846759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.846950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.846981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.846985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.846986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.846987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.846987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.846988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.846988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.846989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.846989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.846990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.846991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.846991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.846994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.847000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.847003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.847005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.847007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.847009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.847011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.847013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.847015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.847017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.847019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.847021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.847025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.847029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.847032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.847035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.847037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.847040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.847042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.847045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.847049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.847055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.847058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.847062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.847071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.847080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.847087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.847089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.847091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.847094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.847096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.847102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.847104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.847107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.847109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.847112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.847129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.851102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454581984:4391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.851114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454581984:4391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.851116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454581984:4391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.851122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.854725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.856367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.856378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.856379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.856381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.856384Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2328 [2:7556555411379012680:8439]
2025-10-02T09:34:20.856391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.856402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.856404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.856405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.856406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.856414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.856420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.856425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.856455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.856460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.856461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.856463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.856464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.856502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.856507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.856513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.856519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.856527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.856540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454582024:4391], now have 1 active actors on pipe
2025-10-02T09:34:20.856547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454581857:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.856551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.856553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.856556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.856568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.856579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.856580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.856581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.856583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.856589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.856576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2328
2025-10-02T09:34:20.856591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.856611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.856616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.856605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2328
2025-10-02T09:34:20.856623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.856630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.856637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.856650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d534823e-27003535-7ff416fd-116ddd5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.856657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.856659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.856660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.856665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.856672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:20.856685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.856776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.856783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.856792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:20.856858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2329 partition: 0 MaxSeqNo: 36 sessionId: src_id|d534823e-27003535-7ff416fd-116ddd5e_0
2025-10-02T09:34:20.857091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c5fcfba-92a2bbf5-2075625c-a0c30cd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d534823e-27003535-7ff416fd-116ddd5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:20.859622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Write session: try to update token
2025-10-02T09:34:20.859637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:20.865949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:20.865961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:20.865962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:20.865963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:20.865967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.865969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.865971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379012675:8439]
2025-10-02T09:34:20.865989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:20.865992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.865993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:20.865993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:20.865996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:20.865998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:20.866171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:20.871938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId: src_id|d534823e-27003535-7ff416fd-116ddd5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:20.874170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:20.937278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555411454582038:4843]
2025-10-02T09:34:20.937503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2328, pipe: [1:7556555411454582038:4843]
2025-10-02T09:34:20.980295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:20.980555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.980564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.980576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454582038:4843], now have 1 active actors on pipe
2025-10-02T09:34:20.980723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:20.980775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:20.980825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:20.980850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2329 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d534823e-27003535-7ff416fd-116ddd5e_0
2025-10-02T09:34:20.980880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555411454582038:4843]
2025-10-02T09:34:20.980998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2329 sessionId: src_id|d534823e-27003535-7ff416fd-116ddd5e_0 is DEAD
2025-10-02T09:34:20.981166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:20.981179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Write session will restart in 0.008159s
2025-10-02T09:34:20.981200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Write session: Do CDS request
2025-10-02T09:34:20.981206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:20.988356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:20.989557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:20.989703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:20.989710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:20.989716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:20.989747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:20.989770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555411379012857:8437]
2025-10-02T09:34:20.990117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:20.990161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.990245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:20.990253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2330
2025-10-02T09:34:20.990283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:20.990306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:20.990363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:20.990380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:20.990386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:20.990388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:20.990498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:20.990530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.990533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.990534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.990534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.990535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.990536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.990536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.990537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.990537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.990538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.990538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.990539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.990541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.990548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.990550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.990552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.990554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.990556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.990558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.990560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.990562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.990564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.990566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.990568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.990571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.990583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:20.990587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.990590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:20.990592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.990595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:20.990597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.990600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:20.990603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.990606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:20.990608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.990611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:20.990616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.990619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:20.990621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.990625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:20.990630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.990632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:20.990634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.990637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.990642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.990645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.990647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.990649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.990666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:20.990666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2330 sessionId:  describe result for acl check
2025-10-02T09:34:20.990684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:20.990688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:20.990689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:20.990692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555411454582172:4367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:20.991025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555411454582172:4367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:20.992475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555411454582172:4367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:20.996904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555411454582172:4367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:20.996915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555411454582172:4367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:20.996918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555411454582172:4367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:20.996923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:20.998128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:20.999676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:20.999687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:20.999688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:20.999690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:20.999693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2329 [2:7556555411379012857:8437]
2025-10-02T09:34:20.999701Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:20.999710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:20.999712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.999713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.999714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:20.999723Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:20.999728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:20.999734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:20.999766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.999770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.999771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.999773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:20.999774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:20.999822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:20.999827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:20.999833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:20.999839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:20.999851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:20.999864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454582209:4367], now have 1 active actors on pipe
2025-10-02T09:34:20.999870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555411454582042:2446], now have 1 active actors on pipe
2025-10-02T09:34:20.999874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:20.999878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:20.999879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:20.999884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:20.999890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:20.999892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:20.999897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:20.999899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:20.999889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2329
2025-10-02T09:34:20.999903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:20.999905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:20.999909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2329
2025-10-02T09:34:20.999923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:20.999929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:20.999930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:20.999941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:20.999947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:20.999974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e139e27-7ecbba20-3d841573-d86a039f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:20.999981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:20.999985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:20.999988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:20.999993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.000002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.000014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.000104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.000110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.000119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.000179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2330 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e139e27-7ecbba20-3d841573-d86a039f_0
2025-10-02T09:34:21.000422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d534823e-27003535-7ff416fd-116ddd5e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e139e27-7ecbba20-3d841573-d86a039f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.003200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Write session: try to update token
2025-10-02T09:34:21.003213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.009280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.009293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.009294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.009295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.009301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:21.009303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:21.009305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555411379012852:8437]
2025-10-02T09:34:21.009325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.009328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.009329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.009332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.009336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.009338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.009485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.016835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId: src_id|8e139e27-7ecbba20-3d841573-d86a039f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.019037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.081107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749549525:4843]
2025-10-02T09:34:21.081230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2329, pipe: [1:7556555415749549525:4843]
2025-10-02T09:34:21.123032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.123353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.123362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.123375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549525:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.123533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.123535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.123573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749549525:4843]
2025-10-02T09:34:21.123589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:21.123695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2330 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e139e27-7ecbba20-3d841573-d86a039f_0
2025-10-02T09:34:21.123854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2330 sessionId: src_id|8e139e27-7ecbba20-3d841573-d86a039f_0 is DEAD
2025-10-02T09:34:21.123972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:21.123982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Write session will restart in 0.008941s
2025-10-02T09:34:21.124004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Write session: Do CDS request
2025-10-02T09:34:21.124009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.131226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.132422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.132567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.132573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.132580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.132617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.132640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673980341:8431]
2025-10-02T09:34:21.133003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.133205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.133252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.133465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.133497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.133501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.133502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.133502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.133503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.133503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.133504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.133505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.133505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.133506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.133506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.133507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.133510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.133516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.133518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.133520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.133522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.133524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.133527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.133529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.133530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.133533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.133535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.133537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.133540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.133544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.133548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.133551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.133554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.133557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.133559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.133562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.133564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.133567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.133569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.133571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.133573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.133576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.133578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.133581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.133583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.133585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.133587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.133590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.133592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.133594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.133596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.133599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.133616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.134149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.134286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.134294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2331
2025-10-02T09:34:21.134661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.134679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.134684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.134687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.134959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2331 sessionId:  describe result for acl check
2025-10-02T09:34:21.134977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.134978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.134979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.134982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749549662:4359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.135284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749549662:4359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.136703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749549662:4359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.140481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749549662:4359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.140493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749549662:4359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.140496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749549662:4359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.140506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.141000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.142555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.142566Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.142569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.142572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2330 [2:7556555415673980341:8431]
2025-10-02T09:34:21.142588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.142601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.142606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.142608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.142609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.142617Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.142620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.142624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.142652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.142657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.142658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.142660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.142661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.142696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.142701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.142708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.142716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.142730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.142746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549526:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.142752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549694:4359], now have 1 active actors on pipe
2025-10-02T09:34:21.142757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.142762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.142764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.142773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.142773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2330
2025-10-02T09:34:21.142785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.142785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.142787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.142788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.142795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.142797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.142799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2330
2025-10-02T09:34:21.142821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.142826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.142837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.142844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.142856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.142862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9f70450-97d684bc-243d47a0-1197908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.142866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.142868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.142869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.142873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.142881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.142936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.143033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.143040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.143049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.143113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2331 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9f70450-97d684bc-243d47a0-1197908_0
2025-10-02T09:34:21.143313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e139e27-7ecbba20-3d841573-d86a039f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9f70450-97d684bc-243d47a0-1197908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.146022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Write session: try to update token
2025-10-02T09:34:21.146035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.152017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.152025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.152026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.152027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.152031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.152033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.152035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673980330:8431]
2025-10-02T09:34:21.152053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.152057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.152061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.152062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.152066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.152068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.152162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.158086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId: src_id|d9f70450-97d684bc-243d47a0-1197908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.160265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.223983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749549724:4843]
2025-10-02T09:34:21.224159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2330, pipe: [1:7556555415749549724:4843]
2025-10-02T09:34:21.265400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.265651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.265661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.265674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549724:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.265817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.266019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:21.266030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:21.266077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2331 reason: error at write: Disconnected sessionId: src_id|d9f70450-97d684bc-243d47a0-1197908_0
2025-10-02T09:34:21.266075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.266135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749549724:4843]
2025-10-02T09:34:21.266207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2331 sessionId: src_id|d9f70450-97d684bc-243d47a0-1197908_0 is DEAD
2025-10-02T09:34:21.266341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:21.266355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Write session will restart in 0.009706s
2025-10-02T09:34:21.266374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Write session: Do CDS request
2025-10-02T09:34:21.266379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.273606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.274822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.274933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.274940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.274945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.274975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.274999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673980526:8415]
2025-10-02T09:34:21.275353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.275531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.275558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.275803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.275840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.275844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.275845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.275845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.275846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.275846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.275847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.275847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.275848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.275848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.275849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.275849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.275852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.275859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.275862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.275865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.275868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.275872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.275875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.275878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.275881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.275884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.275888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.275892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.275897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.275901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.275905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.275908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.275910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.275914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.275918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.275921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.275923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.275926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.275928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.275931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.275933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.275936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.275938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.275940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.275942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.275945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.275947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.275950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.275955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.275958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.275960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.275962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.275980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.277161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.277255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.277264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2332
2025-10-02T09:34:21.277869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.277907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.277918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.277922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.278251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2332 sessionId:  describe result for acl check
2025-10-02T09:34:21.278281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.278288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.278289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.278295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749549862:4311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.278712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749549862:4311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.280206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749549862:4311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.282882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749549862:4311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.282894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749549862:4311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.282896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749549862:4311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.282901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.283418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.284857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.284868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.284870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.284872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.284875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2331 [2:7556555415673980526:8415]
2025-10-02T09:34:21.284882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.284893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.284899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.284900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.284901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.284909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.284912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.284916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.284950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.284954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.284957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.284958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.284960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.285062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.285067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.285073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.285079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.285071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2331
2025-10-02T09:34:21.285082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2331
2025-10-02T09:34:21.285098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.285117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549725:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.285123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549896:4311], now have 1 active actors on pipe
2025-10-02T09:34:21.285136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.285140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.285150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.285154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.285155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.285164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.285175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.285176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.285178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.285179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.285185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.285187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.285196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b1290fa-8c1fc157-184b105-2a539470_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.285202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.285205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.285210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.285215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.285221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.285239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.285246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.285253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.285254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.285350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.285358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.285368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.285422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2332 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b1290fa-8c1fc157-184b105-2a539470_0
2025-10-02T09:34:21.285633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f70450-97d684bc-243d47a0-1197908_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b1290fa-8c1fc157-184b105-2a539470_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.288223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Write session: try to update token
2025-10-02T09:34:21.288233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.294651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.294663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.294664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.294665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.294671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.294673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.294676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673980521:8415]
2025-10-02T09:34:21.294695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.294699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.294699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.294700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.294702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.294704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.294808Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.299934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId: src_id|9b1290fa-8c1fc157-184b105-2a539470_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.302079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.366298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749549904:4843]
2025-10-02T09:34:21.366440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2331, pipe: [1:7556555415749549904:4843]
2025-10-02T09:34:21.407321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.407594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.407603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.407614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549904:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.407791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.407815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749549904:4843]
2025-10-02T09:34:21.407843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:21.407893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b1290fa-8c1fc157-184b105-2a539470_0
2025-10-02T09:34:21.408014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2332 sessionId: src_id|9b1290fa-8c1fc157-184b105-2a539470_0 is DEAD
2025-10-02T09:34:21.408194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:21.408208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Write session will restart in 0.006152s
2025-10-02T09:34:21.408229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Write session: Do CDS request
2025-10-02T09:34:21.408234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.408386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.415139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.415199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.415208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2333
2025-10-02T09:34:21.415355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.415376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.415382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.415385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.415597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.415644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2333 sessionId:  describe result for acl check
2025-10-02T09:34:21.415661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.415665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.415666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.415669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749550035:4305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.416009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749550035:4305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.416851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.417028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.417036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.417043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.417076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.417105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673980698:8411]
2025-10-02T09:34:21.417465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.417474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749550035:4305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.417636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.417663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.417849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.417880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.417884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.417885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.417885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.417886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.417886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.417887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.417887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.417888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.417889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.417890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.417890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.417893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.417898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.417901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.417903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.417905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.417907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.417909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.417911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.417913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.417915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.417917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.417919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.417922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.417926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.417929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.417932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.417934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.417937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.417939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.417944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.417948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.417956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.417960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.417968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.417972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.417975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.417978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.417984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.417986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.417988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.417990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.417993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.417998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.418001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.418006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.418009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.418024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.421855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749550035:4305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.421867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749550035:4305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.421870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749550035:4305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.421875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.425399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.427009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.427019Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.427021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.427022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.427025Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2332 [2:7556555415673980698:8411]
2025-10-02T09:34:21.427031Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.427040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.427044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.427046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.427047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.427056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.427062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.427065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.427096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.427101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.427102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.427103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.427104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.427139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.427144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.427151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.427157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.427174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.427191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749549905:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.427196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550074:4305], now have 1 active actors on pipe
2025-10-02T09:34:21.427200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.427201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.427202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.427210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.427222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.427223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.427225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.427227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.427229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.427230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.427219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2332
2025-10-02T09:34:21.427246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.427251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.427254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.427243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2332
2025-10-02T09:34:21.427264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.427269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.427287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.427294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.427296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.427297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.427302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.427310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.427321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.427429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.427437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.427446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.427510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2333 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0
2025-10-02T09:34:21.427703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1290fa-8c1fc157-184b105-2a539470_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.430129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Write session: try to update token
2025-10-02T09:34:21.430139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.436389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.436405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.436407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.436408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.436412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.436415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.436417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673980693:8411]
2025-10-02T09:34:21.436436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.436440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.436443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.436446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.436453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.436454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.436576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.441574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId: src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.443604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.508111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749550082:4843]
2025-10-02T09:34:21.508241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2332, pipe: [1:7556555415749550082:4843]
2025-10-02T09:34:21.546652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.546883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.546893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.546918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550082:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.547073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.547144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749550082:4843]
2025-10-02T09:34:21.547170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:21.547222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0
2025-10-02T09:34:21.547350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2333 sessionId: src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0 is DEAD
2025-10-02T09:34:21.547504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:21.547519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Write session will restart in 0.006594s
2025-10-02T09:34:21.547503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.547539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Write session: Do CDS request
2025-10-02T09:34:21.547546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.555157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.555170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.555296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.555306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2334
2025-10-02T09:34:21.555412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.555432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.555438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.555440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.555822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2334 sessionId:  describe result for acl check
2025-10-02T09:34:21.555863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.555869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.555871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.555875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749550215:4291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.556317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749550215:4291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.556390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.556496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.556503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.556509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.556537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.556564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673980869:8408]
2025-10-02T09:34:21.556941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.557118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.557144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.557337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.557370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.557374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.557374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.557375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.557375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.557376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.557376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.557377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.557377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.557378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.557378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.557379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.557382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.557388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.557390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.557392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.557394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.557396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.557398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.557400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.557402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.557404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.557406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.557408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.557411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.557415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.557418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.557421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.557423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.557426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.557428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.557431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.557433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.557436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.557438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.557441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.557443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.557446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.557448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.557451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.557453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.557456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.557459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.557467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.557471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.557476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.557484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.557487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.557505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.557788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749550215:4291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.562344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749550215:4291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.562356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749550215:4291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.562359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749550215:4291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.562366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.564924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.566608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.566618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.566619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.566621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.566625Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2333 [2:7556555415673980869:8408]
2025-10-02T09:34:21.566632Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.566641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.566643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.566644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.566645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.566654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.566657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.566662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.566699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.566705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.566707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.566709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.566711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.566749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.566753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.566760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.566765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.566777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.566790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550256:4291], now have 1 active actors on pipe
2025-10-02T09:34:21.566795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550083:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.566799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.566801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.566803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.566810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.566818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.566823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.566825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.566826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.566828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.566829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.566843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.566850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.566851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.566845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2333
2025-10-02T09:34:21.566859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2333
2025-10-02T09:34:21.566869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.566874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.566891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.566898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.566904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.566905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.566910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.566918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.566929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.567038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.567044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.567054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.567113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2334 partition: 0 MaxSeqNo: 36 sessionId: src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0
2025-10-02T09:34:21.567357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4331c0d-6c169013-5ada8c86-20c81c62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.570083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Write session: try to update token
2025-10-02T09:34:21.570099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.575987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.575998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.575999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.576000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.576003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.576006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.576008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673980864:8408]
2025-10-02T09:34:21.576026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.576029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.576030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.576030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.576033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.576037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.576140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.582021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId: src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.584086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.647400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749550264:4843]
2025-10-02T09:34:21.647585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2333, pipe: [1:7556555415749550264:4843]
2025-10-02T09:34:21.687428Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.687699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.687707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.687719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550264:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.687858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.687884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749550264:4843]
2025-10-02T09:34:21.687905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.687948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:21.688042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2334 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0
2025-10-02T09:34:21.688207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2334 sessionId: src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0 is DEAD
2025-10-02T09:34:21.688368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:21.688382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Write session will restart in 0.005600s
2025-10-02T09:34:21.688402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Write session: Do CDS request
2025-10-02T09:34:21.688408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.695139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.695251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.695259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2335
2025-10-02T09:34:21.695360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.695380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.695388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.695390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.695588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.695693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2335 sessionId:  describe result for acl check
2025-10-02T09:34:21.695724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.695731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.695732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.695736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749550399:4261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.696166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749550399:4261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.696720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.696848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.696855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.696861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.696888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.696986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673981039:8395]
2025-10-02T09:34:21.697342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.697517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.697512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749550399:4261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.697544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.697728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.697764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.697770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.697771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.697772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.697773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.697774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.697774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.697775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.697776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.697777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.697777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.697778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.697781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.697787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.697789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.697791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.697793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.697795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.697797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.697799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.697801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.697804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.697806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.697808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.697811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.697815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.697819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.697822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.697824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.697827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.697829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.697832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.697834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.697836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.697838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.697841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.697843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.697846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.697848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.697851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.697853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.697856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.697858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.697860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.697865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.697868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.697870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.697872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.697890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.702691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749550399:4261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.702703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749550399:4261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.702705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749550399:4261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.702711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.705295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.706728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.706742Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.706743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.706746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.706749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2334 [2:7556555415673981039:8395]
2025-10-02T09:34:21.706756Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.706766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.706771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.706773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.706774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.706783Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.706786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.706796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.706829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.706831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.706832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.706834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.706835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.706924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.706929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.706936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.706942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.706933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2334
2025-10-02T09:34:21.706947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2334
2025-10-02T09:34:21.706951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.706966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550438:4261], now have 1 active actors on pipe
2025-10-02T09:34:21.706973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550266:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.706977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.706979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.706981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.706991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.706998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.707000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.707002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.707007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.707009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.707022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.707033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.707035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.707054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.707061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.707063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.707065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.707069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.707075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.707081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.707086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.707094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.707101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.707196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.707203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.707212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.707267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2335 partition: 0 MaxSeqNo: 36 sessionId: src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0
2025-10-02T09:34:21.707526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15fd323-cffb0163-73d7efab-7b362e8f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.710115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Write session: try to update token
2025-10-02T09:34:21.710125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.716479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.716492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.716493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.716494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.716499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.716501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.716504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673981034:8395]
2025-10-02T09:34:21.716524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.716527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.716529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.716532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.716541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.716544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.716635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.721387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId: src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.723436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.788194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749550445:4843]
2025-10-02T09:34:21.788358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2334, pipe: [1:7556555415749550445:4843]
2025-10-02T09:34:21.829287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.829536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.829545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.829570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550445:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.829715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.829743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749550445:4843]
2025-10-02T09:34:21.829766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.829800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:21.829913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0
2025-10-02T09:34:21.830080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2335 sessionId: src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0 is DEAD
2025-10-02T09:34:21.830288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:21.830301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Write session will restart in 0.006032s
2025-10-02T09:34:21.830322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Write session: Do CDS request
2025-10-02T09:34:21.830327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.837145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.837241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.837251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2336
2025-10-02T09:34:21.837347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.837369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.837377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.837381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.837482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.837714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2336 sessionId:  describe result for acl check
2025-10-02T09:34:21.837735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.837739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.837741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.837744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749550580:4267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.838097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749550580:4267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.838798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.838910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.838916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.838922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.838951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.838975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673981210:8403]
2025-10-02T09:34:21.839346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.839507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.839533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.839718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.839751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.839755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.839756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.839757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.839757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.839758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.839759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.839759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.839760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.839760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.839761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.839761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.839764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.839770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.839772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.839774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.839776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.839778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.839780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.839782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.839784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.839787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.839789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.839790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.839795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.839799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.839802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.839805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.839807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.839809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.839812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.839815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.839817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.839820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.839822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.839825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.839828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.839833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.839836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.839841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.839845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.839849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.839852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.839857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.839860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.839865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.839869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.839872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.839890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.839919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749550580:4267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.844884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749550580:4267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.844899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749550580:4267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.844903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749550580:4267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.844912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.847426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.848983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.848993Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.848994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.848996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.848999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2335 [2:7556555415673981210:8403]
2025-10-02T09:34:21.849007Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.849016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.849017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.849018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.849020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.849028Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.849031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.849035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.849071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.849078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.849081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.849084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.849085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.849122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.849127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.849133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.849139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.849147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.849158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550446:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.849163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550620:4267], now have 1 active actors on pipe
2025-10-02T09:34:21.849166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.849167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.849169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.849177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.849184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.849190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.849191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.849193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.849197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.849199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2335
2025-10-02T09:34:21.849198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.849206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.849208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.849210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.849225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.849226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.849221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2335
2025-10-02T09:34:21.849243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.849250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.849252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.849253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.849258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.849263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.849270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.849353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.849360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.849369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.849423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2336 partition: 0 MaxSeqNo: 36 sessionId: src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0
2025-10-02T09:34:21.849613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6543c3aa-f3f5cab5-8715f52e-3e5bf36c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.852050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Write session: try to update token
2025-10-02T09:34:21.852059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.858510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.858524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.858526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.858528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.858534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.858538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.858544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673981205:8403]
2025-10-02T09:34:21.858567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.858569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.858572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.858572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.858581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.858583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.858689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:21.863461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId: src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:21.865513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:21.930034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555415749550634:4843]
2025-10-02T09:34:21.930194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2335, pipe: [1:7556555415749550634:4843]
2025-10-02T09:34:21.969177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:21.969407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.969415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.969437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550634:4843], now have 1 active actors on pipe
2025-10-02T09:34:21.969558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:21.969569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555415749550634:4843]
2025-10-02T09:34:21.969591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:21.969633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:21.969648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:21.969724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2336 reason: error at write: Disconnected sessionId: src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0
2025-10-02T09:34:21.969873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2336 sessionId: src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0 is DEAD
2025-10-02T09:34:21.970019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:21.970027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Write session will restart in 0.007687s
2025-10-02T09:34:21.970056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Write session: Do CDS request
2025-10-02T09:34:21.970060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:21.977127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:21.978319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:21.978447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:21.978453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:21.978459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:21.978485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:21.978510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555415673981394:8400]
2025-10-02T09:34:21.978875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:21.979065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:21.979091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:21.979165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.979253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:21.979262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2337
2025-10-02T09:34:21.979288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:21.979319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.979323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.979323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.979324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.979324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.979325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.979325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.979337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:21.979326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.979326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.979327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.979327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.979328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.979355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:21.979331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.979338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.979361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:21.979340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.979363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:21.979342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.979344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.979346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.979348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.979351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.979355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.979358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.979361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.979365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.979369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.979376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:21.979379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.979382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:21.979384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.979387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:21.979389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.979392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:21.979394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.979397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:21.979400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.979402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:21.979405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.979407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:21.979409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.979412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:21.979414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.979418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:21.979420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.979422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.979425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.979427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.979429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.979432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.979449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:21.979670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2337 sessionId:  describe result for acl check
2025-10-02T09:34:21.979690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:21.979695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:21.979696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:21.979699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555415749550777:4239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:21.980021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555415749550777:4239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:21.981649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555415749550777:4239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:21.985735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555415749550777:4239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:21.985749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555415749550777:4239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:21.985753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555415749550777:4239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:21.985760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:21.986898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:21.988374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:21.988384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:21.988385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:21.988387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:21.988391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2336 [2:7556555415673981394:8400]
2025-10-02T09:34:21.988398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:21.988407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:21.988408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.988410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.988412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.988419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:21.988422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:21.988426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:21.988455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.988458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.988459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.988461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:21.988462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:21.988497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:21.988502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.988509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:21.988514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:21.988521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:21.988533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550638:2446], now have 1 active actors on pipe
2025-10-02T09:34:21.988539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555415749550812:4239], now have 1 active actors on pipe
2025-10-02T09:34:21.988543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.988545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.988546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.988554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:21.988561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:21.988566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:21.988568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:21.988569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:21.988570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:21.988556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2336
2025-10-02T09:34:21.988582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2336
2025-10-02T09:34:21.988572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:21.988593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.988595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:21.988596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:21.988604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.988610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.988634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde7b263-8097f407-78db403e-6457371_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:21.988640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:21.988642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:21.988643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:21.988647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:21.988652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:21.988660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.988756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:21.988763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:21.988771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:21.988825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2337 partition: 0 MaxSeqNo: 36 sessionId: src_id|bde7b263-8097f407-78db403e-6457371_0
2025-10-02T09:34:21.989010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cfe166-afcf90b6-2a733e0d-a479b1a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bde7b263-8097f407-78db403e-6457371_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:21.991505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Write session: try to update token
2025-10-02T09:34:21.991514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:21.997992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:21.998006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:21.998008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:21.998009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:21.998013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.998015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.998020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555415673981389:8400]
2025-10-02T09:34:21.998039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:21.998045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:21.998047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:21.998080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:21.998091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:21.998096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:21.998701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.003080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId: src_id|bde7b263-8097f407-78db403e-6457371_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.005203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.069785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044518116:4843]
2025-10-02T09:34:22.069953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2336, pipe: [1:7556555420044518116:4843]
2025-10-02T09:34:22.110985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.111187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.111198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.111226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518116:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.111418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:22.111448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044518116:4843]
2025-10-02T09:34:22.111475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:22.111488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.111529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bde7b263-8097f407-78db403e-6457371_0
2025-10-02T09:34:22.111673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2337 sessionId: src_id|bde7b263-8097f407-78db403e-6457371_0 is DEAD
2025-10-02T09:34:22.111806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:22.111815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Write session will restart in 0.006904s
2025-10-02T09:34:22.111830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Write session: Do CDS request
2025-10-02T09:34:22.111834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.119358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.120157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.120236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.120244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2338
2025-10-02T09:34:22.120378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.120396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.120402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.120404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.120573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.120672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.120680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.120688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.120687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2338 sessionId:  describe result for acl check
2025-10-02T09:34:22.120704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.120705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.120705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.120710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044518265:4234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.120715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.120826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968948866:8394]
2025-10-02T09:34:22.121061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044518265:4234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.121185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.121368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.121396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.121584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.121616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.121619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.121620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.121621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.121621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.121622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.121622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.121623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.121623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.121624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.121624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.121625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.121628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.121633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.121636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.121638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.121640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.121642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.121644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.121646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.121648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.121651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.121653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.121655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.121658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.121662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.121665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.121668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.121671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.121674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.121676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.121679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.121681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.121684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.121689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.121694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.121698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.121702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.121706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.121710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.121712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.121715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.121717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.121719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.121722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.121724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.121726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.121729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.121745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.122490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044518265:4234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.127494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044518265:4234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.127504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044518265:4234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.127507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044518265:4234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.127511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.129168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.130661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.130675Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.130677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.130680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.130684Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2337 [2:7556555419968948866:8394]
2025-10-02T09:34:22.130693Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.130702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.130703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.130705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.130706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.130714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.130717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.130721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.130751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.130757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.130758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.130760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.130761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.130796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.130801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.130807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.130813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.130821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.130835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518129:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.130841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518303:4234], now have 1 active actors on pipe
2025-10-02T09:34:22.130845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.130846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.130847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.130855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.130862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.130869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.130871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.130872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.130874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.130875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.130888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.130880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2337
2025-10-02T09:34:22.130890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.130894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.130904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2337
2025-10-02T09:34:22.130966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.130971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.130984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77e45517-ca1447bb-9b148b67-f5752312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.130988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.130990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.130991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.130995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.131001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.131008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.131106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.131113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.131122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.131172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2338 partition: 0 MaxSeqNo: 36 sessionId: src_id|77e45517-ca1447bb-9b148b67-f5752312_0
2025-10-02T09:34:22.131372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde7b263-8097f407-78db403e-6457371_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77e45517-ca1447bb-9b148b67-f5752312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.133878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Write session: try to update token
2025-10-02T09:34:22.133890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:22.140282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:22.140298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.140301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:22.140302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:22.140307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.140310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.140312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968948861:8394]
2025-10-02T09:34:22.140334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:22.140338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.140339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:22.140342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:22.140347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:22.140349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:22.140454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.145262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId: src_id|77e45517-ca1447bb-9b148b67-f5752312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.147377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.211621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044518325:4843]
2025-10-02T09:34:22.211796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2337, pipe: [1:7556555420044518325:4843]
2025-10-02T09:34:22.253764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.254198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.254209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.254235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518325:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.254398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:22.254406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:22.254416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:22.254444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.254460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2338 reason: error at write: Disconnected sessionId: src_id|77e45517-ca1447bb-9b148b67-f5752312_0
2025-10-02T09:34:22.254499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044518325:4843]
2025-10-02T09:34:22.254598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2338 sessionId: src_id|77e45517-ca1447bb-9b148b67-f5752312_0 is DEAD
2025-10-02T09:34:22.254712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:22.254721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Write session will restart in 0.006061s
2025-10-02T09:34:22.254739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Write session: Do CDS request
2025-10-02T09:34:22.254743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.262022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.262106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.262176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.262184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2339
2025-10-02T09:34:22.262257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.262278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.262281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.262284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.262592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2339 sessionId:  describe result for acl check
2025-10-02T09:34:22.262616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.262622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.262623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.262627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044518472:4184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.262989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044518472:4184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.263454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.263560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.263567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.263573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.263600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.263625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968949077:8374]
2025-10-02T09:34:22.263965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.264127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.264151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.264349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.264383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.264387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.264388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.264388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.264389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.264389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.264390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.264390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.264391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.264391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.264392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.264393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.264396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.264401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.264403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.264405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.264407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.264409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.264411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.264413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.264415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.264417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.264419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.264421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.264425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.264429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.264432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.264435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.264437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.264440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.264442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.264445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.264447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.264449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.264451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.264455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.264457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.264459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.264461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.264464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.264466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.264469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.264471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.264473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.264477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.264479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.264481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.264483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.264500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.264586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044518472:4184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.269288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044518472:4184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.269299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044518472:4184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.269302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044518472:4184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.269307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.271880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.273380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.273393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.273395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.273397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.273402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2338 [2:7556555419968949077:8374]
2025-10-02T09:34:22.273412Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.273425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.273426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.273427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.273428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.273437Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.273440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.273445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.273478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.273484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.273485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.273487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.273488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.273601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2338
2025-10-02T09:34:22.273614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2338
2025-10-02T09:34:22.273651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.273656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.273663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.273668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.273677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.273689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518513:4184], now have 1 active actors on pipe
2025-10-02T09:34:22.273695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518335:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.273704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.273709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.273721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.273726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.273727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.273735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.273742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.273748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.273750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.273751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.273754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.273756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.273766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d78559f-4b8301a9-5296918d-59c79919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.273770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.273772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.273774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.273778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.273783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.273803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.273811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.273816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.273819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.273907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.273912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.273920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.273964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2339 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d78559f-4b8301a9-5296918d-59c79919_0
2025-10-02T09:34:22.274153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e45517-ca1447bb-9b148b67-f5752312_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d78559f-4b8301a9-5296918d-59c79919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.276725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Write session: try to update token
2025-10-02T09:34:22.276735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:22.282917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:22.282929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.282934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.282956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:22.282958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:22.283096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:22.283217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:22.283331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:22.283452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:22.283633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:22.283666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:22.288521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId: src_id|3d78559f-4b8301a9-5296918d-59c79919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.290610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.291338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.291356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.291366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:22.291368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.291369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:22.291371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:22.291375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.291377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.291380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968949072:8374]
2025-10-02T09:34:22.291400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:22.291403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:22.291405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:22.291406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:22.291409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.291411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:22.291524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.354457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044518521:4843]
2025-10-02T09:34:22.354612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2338, pipe: [1:7556555420044518521:4843]
2025-10-02T09:34:22.403712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.404012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:22.404044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518521:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.404132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:22.404272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.404340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044518521:4843]
2025-10-02T09:34:22.412612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.413819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.413925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.413931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.413937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.413963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.413987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968949255:8367]
2025-10-02T09:34:22.414352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.414496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:22.414505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:22.414518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2339 reason: error at write: Disconnected sessionId: src_id|3d78559f-4b8301a9-5296918d-59c79919_0
2025-10-02T09:34:22.414636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2339 sessionId: src_id|3d78559f-4b8301a9-5296918d-59c79919_0 is DEAD
2025-10-02T09:34:22.414777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:22.414786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Write session will restart in 0.007601s
2025-10-02T09:34:22.414800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Write session: Do CDS request
2025-10-02T09:34:22.414805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.417265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.417294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.417492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.417524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.417528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.417528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.417529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.417529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.417530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.417532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.417532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.417533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.417533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.417536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.417543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.417545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.417547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.417549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.417551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.417553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.417555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.417557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.417560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.417562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.417564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.417568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.417572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.417575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.417578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.417581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.417584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.417587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.417590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.417592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.417594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.417596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.417599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.417601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.417604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.417606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.417608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.417610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.417613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.417615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.417617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.417621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.417625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.417629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.417633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.417658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.423104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.423449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.423458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2340
2025-10-02T09:34:22.423588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.423607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.423618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.423623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.423887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2340 sessionId:  describe result for acl check
2025-10-02T09:34:22.423906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.423910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.423911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.423914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044518665:4170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.424262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044518665:4170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.425081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.425718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044518665:4170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.426544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.426555Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.426557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.426559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.426562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2339 [2:7556555419968949255:8367]
2025-10-02T09:34:22.426569Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.426590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.426592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.426594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.426596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.426607Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.426613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.426618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.426648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.426654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.426655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.426657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.426658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.426693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.426698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.426705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.426710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.426717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.426731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518522:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.426736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.426737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.426738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.426745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.426752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.426759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.426758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.426761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.426762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.426762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.426774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.426776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.426778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.426815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2339
2025-10-02T09:34:22.430297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044518665:4170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.430309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044518665:4170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.430311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044518665:4170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.430316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.430470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518703:4170], now have 1 active actors on pipe
2025-10-02T09:34:22.430505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2339
2025-10-02T09:34:22.430538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.430544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.430558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.430564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.430567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.430568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.430581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.430588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.430595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.430704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.430711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.430719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.430766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2340 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0
2025-10-02T09:34:22.430931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d78559f-4b8301a9-5296918d-59c79919_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.433433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Write session: try to update token
2025-10-02T09:34:22.433443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:22.436051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:22.436065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.436067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:22.436068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:22.436073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.436077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.436079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968949250:8367]
2025-10-02T09:34:22.436099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:22.436103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.436105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:22.436134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:22.436149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:22.436153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:22.436214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.444817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId: src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.446898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.504480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044518706:4843]
2025-10-02T09:34:22.504613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2339, pipe: [1:7556555420044518706:4843]
2025-10-02T09:34:22.548864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.549156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.549165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.549177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518706:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.549328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:22.549345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:22.549355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:22.549401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2340 reason: error at write: Disconnected sessionId: src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0
2025-10-02T09:34:22.549415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044518706:4843]
2025-10-02T09:34:22.549450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.549543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2340 sessionId: src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0 is DEAD
2025-10-02T09:34:22.549657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:22.549666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Write session will restart in 0.006445s
2025-10-02T09:34:22.549684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Write session: Do CDS request
2025-10-02T09:34:22.549690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.557152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.557244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.557264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.557271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2341
2025-10-02T09:34:22.557392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.557410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.557417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.557419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.557777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2341 sessionId:  describe result for acl check
2025-10-02T09:34:22.557813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.557822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.557824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.557828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044518846:4146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.558263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044518846:4146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.558493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.558613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.558620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.558626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.558653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.558683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968949433:8370]
2025-10-02T09:34:22.559035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.559222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.559249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.559426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.559460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.559465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.559466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.559467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.559467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.559468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.559469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.559470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.559471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.559472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.559473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.559473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.559476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.559483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.559486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.559488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.559490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.559492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.559494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.559496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.559497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.559500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.559502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.559504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.559507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.559511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.559515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.559518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.559520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.559522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.559525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.559527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.559530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.559532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.559534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.559537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.559539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.559542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.559544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.559547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.559549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.559552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.559554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.559557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.559559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.559562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.559565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.559567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.559584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.559719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044518846:4146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.564331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044518846:4146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.564345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044518846:4146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.564347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044518846:4146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.564352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.566957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.568522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.568534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.568536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.568538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.568541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2340 [2:7556555419968949433:8370]
2025-10-02T09:34:22.568548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.568557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.568558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.568560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.568561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.568569Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.568572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.568576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.568605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.568610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.568611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.568612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.568614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.568659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.568664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.568674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.568684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.568696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.568712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518885:4146], now have 1 active actors on pipe
2025-10-02T09:34:22.568717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518708:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.568722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.568723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.568725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.568733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.568740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.568726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2340
2025-10-02T09:34:22.568736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2340
2025-10-02T09:34:22.568747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.568747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.568749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.568750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.568752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.568773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.568778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.568788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.568795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.568817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.568820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.568827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.568830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.568831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.568836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.568841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.568852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.568942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.568950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.568959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.569013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2341 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0
2025-10-02T09:34:22.569192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8b0fc2-b9415a72-46a7f3d2-f4c87a9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.571689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Write session: try to update token
2025-10-02T09:34:22.571699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:22.578115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:22.578129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.578131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:22.578132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:22.578139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.578142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.578146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968949428:8370]
2025-10-02T09:34:22.578169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:22.578172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.578173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:22.578208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:22.578225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:22.578230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:22.578278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.583309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId: src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.585363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.649380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044518892:4843]
2025-10-02T09:34:22.649554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2340, pipe: [1:7556555420044518892:4843]
2025-10-02T09:34:22.691645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.691877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.691885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.691910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518892:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.692039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:22.692065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044518892:4843]
2025-10-02T09:34:22.692083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.692125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:22.692230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0
2025-10-02T09:34:22.692381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2341 sessionId: src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0 is DEAD
2025-10-02T09:34:22.692540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:22.692549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Write session will restart in 0.008000s
2025-10-02T09:34:22.692565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Write session: Do CDS request
2025-10-02T09:34:22.692569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.699863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.700994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.701100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.701107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.701113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.701141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.701161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.701164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968949610:8369]
2025-10-02T09:34:22.701219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.701226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2342
2025-10-02T09:34:22.701338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.701359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.701368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.701370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.701511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.701702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2342 sessionId:  describe result for acl check
2025-10-02T09:34:22.701705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.701728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.701733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.701740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.701741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.701745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044519036:4141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.701913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.701944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.701948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.701949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.701949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.701950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.701950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.701951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.701951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.701952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.701952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.701953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.701953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.701956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.701963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.701965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.701967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.701969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.701970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.701972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.701974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.701976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.701978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.701980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.701982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.701986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.701990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.701993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.701996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.701998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.702001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.702003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.702006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.702008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.702011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.702013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.702016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.702018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.702020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.702022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.702025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.702030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.702036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.702040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.702044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.702048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.702052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.702057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.702074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.702168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044519036:4141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.703534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044519036:4141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.708275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044519036:4141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.708285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044519036:4141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.708288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044519036:4141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.708292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.709479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.711051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.711061Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.711062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.711064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.711068Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2341 [2:7556555419968949610:8369]
2025-10-02T09:34:22.711074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.711083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.711084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.711086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.711087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.711095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.711098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.711101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.711133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.711138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.711139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.711141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.711142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.711216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.711221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.711227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.711232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.711241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.711239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2341
2025-10-02T09:34:22.711251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044518894:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.711257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519072:4141], now have 1 active actors on pipe
2025-10-02T09:34:22.711256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2341
2025-10-02T09:34:22.711262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.711264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.711266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.711272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.711277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.711279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.711280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.711286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.711293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.711298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.711309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.711313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.711331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.711339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.711346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.711347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.711353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.711355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.711356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.711361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.711366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.711387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.711488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.711494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.711503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.711554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2342 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0
2025-10-02T09:34:22.711746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3195afd-2ef6657a-e3dd70b1-64b2b4a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.714239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Write session: try to update token
2025-10-02T09:34:22.714249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:22.720686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:22.720700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.720701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:22.720702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:22.720708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.720710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.720712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968949605:8369]
2025-10-02T09:34:22.720734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:22.720738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.720740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:22.720765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:22.720783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:22.720788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:22.720867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.725593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId: src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.727660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.792223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044519080:4843]
2025-10-02T09:34:22.792401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2341, pipe: [1:7556555420044519080:4843]
2025-10-02T09:34:22.830090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.830361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.830375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.830402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519080:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.830549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:22.830542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044519080:4843]
2025-10-02T09:34:22.830558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.830621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:22.830723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0
2025-10-02T09:34:22.830899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2342 sessionId: src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0 is DEAD
2025-10-02T09:34:22.831026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:22.831036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Write session will restart in 0.006985s
2025-10-02T09:34:22.831051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Write session: Do CDS request
2025-10-02T09:34:22.831056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.838693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.839111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.839241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.839248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2343
2025-10-02T09:34:22.839327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.839344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.839350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.839352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.839682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2343 sessionId:  describe result for acl check
2025-10-02T09:34:22.839717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.839724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.839725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.839730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044519221:4137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.839936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.840035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.840044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.840051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.840078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.840100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968949788:8362]
2025-10-02T09:34:22.840188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044519221:4137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.840460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.840617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.840641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.840838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.840871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.840875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.840876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.840876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.840877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.840878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.840878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.840879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.840879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.840880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.840880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.840881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.840884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.840889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.840892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.840894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.840895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.840897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.840899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.840901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.840903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.840905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.840907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.840909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.840913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.840918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.840921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.840923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.840925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.840928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.840931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.840933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.840935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.840938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.840940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.840942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.840944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.840946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.840949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.840952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.840954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.840957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.840959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.840961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.840963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.840966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.840968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.840970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.840986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.841850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044519221:4137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.846694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044519221:4137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.846706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044519221:4137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.846708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044519221:4137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.846712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.848319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.849850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.849862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.849863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.849865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.849868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2342 [2:7556555419968949788:8362]
2025-10-02T09:34:22.849874Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.849882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.849884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.849885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.849887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.849895Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.849899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.849903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.849932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.849937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.849938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.849939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.849941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.849975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.849979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.849986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.849991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.849998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.850014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519262:4137], now have 1 active actors on pipe
2025-10-02T09:34:22.850021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519081:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.850025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.850027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.850029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.850039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.850050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.850042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2342
2025-10-02T09:34:22.850059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.850053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2342
2025-10-02T09:34:22.850058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.850061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.850062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.850063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.850082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.850085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.850094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.850102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.850115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.850117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.850120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.850122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.850123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.850128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.850133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.850143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.850230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.850237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.850246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.850293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2343 partition: 0 MaxSeqNo: 36 sessionId: src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0
2025-10-02T09:34:22.850477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c95155-515449f0-85b8dcc2-2202ef39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.852940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Write session: try to update token
2025-10-02T09:34:22.852950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:22.859322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:22.859335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:22.859337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:22.859338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:22.859342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.859344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.859347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968949783:8362]
2025-10-02T09:34:22.859367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:22.859370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.859371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:22.859372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:22.859375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:22.859377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:22.859476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:22.864435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId: src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:22.866533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:22.930470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555420044519274:4843]
2025-10-02T09:34:22.930651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2342, pipe: [1:7556555420044519274:4843]
2025-10-02T09:34:22.971109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:22.971320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.971328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.971353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519274:4843], now have 1 active actors on pipe
2025-10-02T09:34:22.971467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:22.971499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555420044519274:4843]
2025-10-02T09:34:22.971518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:22.971546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:22.971568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2343 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0
2025-10-02T09:34:22.971685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2343 sessionId: src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0 is DEAD
2025-10-02T09:34:22.971802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:22.971811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Write session will restart in 0.005732s
2025-10-02T09:34:22.971843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Write session: Do CDS request
2025-10-02T09:34:22.971847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:22.978115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.978220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:22.978226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2344
2025-10-02T09:34:22.978353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:22.978371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:22.978379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:22.978381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:22.978684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2344 sessionId:  describe result for acl check
2025-10-02T09:34:22.978701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:22.978707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:22.978708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:22.978712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555420044519417:4114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:22.979039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555420044519417:4114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:22.979572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:22.980680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555420044519417:4114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:22.980758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:22.980920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:22.980928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:22.980935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:22.980970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:22.980991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555419968949979:8357]
2025-10-02T09:34:22.981330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:22.981504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:22.981530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:22.981717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:22.981748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.981751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.981752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.981753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.981753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.981754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.981754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.981755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.981755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.981756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.981757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.981757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.981760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.981766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.981768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.981770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.981772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.981774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.981776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.981778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.981781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.981783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.981785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.981787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.981790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.981794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:22.981797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.981800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:22.981802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.981804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:22.981806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.981809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:22.981811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.981814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:22.981818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.981820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:22.981823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.981825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:22.981827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.981830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:22.981834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.981837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:22.981839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.981844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.981847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.981855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.981863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.981869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.981889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:22.985736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555420044519417:4114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:22.985749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555420044519417:4114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:22.985752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555420044519417:4114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:22.985758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:22.989246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:22.990846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:22.990858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:22.990859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:22.990861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:22.990863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2343 [2:7556555419968949979:8357]
2025-10-02T09:34:22.990869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:22.990879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:22.990880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.990882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.990883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.990890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:22.990893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:22.990897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:22.990927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.990932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.990934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.990936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:22.990937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:22.990972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:22.990976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:22.990983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:22.990988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:22.990998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:22.991011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519459:4114], now have 1 active actors on pipe
2025-10-02T09:34:22.991016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555420044519278:2446], now have 1 active actors on pipe
2025-10-02T09:34:22.991020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:22.991021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:22.991022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:22.991029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:22.991037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:22.991041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:22.991043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:22.991044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:22.991046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:22.991048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:22.991028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2343
2025-10-02T09:34:22.991052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2343
2025-10-02T09:34:22.991068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.991075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.991084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:22.991094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:22.991101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:22.991117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5731f293-f0c01649-63ad1f31-55a775f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:22.991124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:22.991126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:22.991127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:22.991131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:22.991137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:22.991186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.991277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:22.991284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:22.991292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:22.991348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2344 partition: 0 MaxSeqNo: 36 sessionId: src_id|5731f293-f0c01649-63ad1f31-55a775f6_0
2025-10-02T09:34:22.991544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdcf783-c3bcdb5c-69a901d7-342b5a68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5731f293-f0c01649-63ad1f31-55a775f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:22.994044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Write session: try to update token
2025-10-02T09:34:22.994055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.000375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.000389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.000392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.000394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.000399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:23.000401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:23.000403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555419968949974:8357]
2025-10-02T09:34:23.000422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.000425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.000427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.000454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.000472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.000480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.000541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.005461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId: src_id|5731f293-f0c01649-63ad1f31-55a775f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.007559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.071792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339486763:4843]
2025-10-02T09:34:23.071959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2343, pipe: [1:7556555424339486763:4843]
2025-10-02T09:34:23.110233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.110451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.110459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.110483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339486763:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.110610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.110625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339486763:4843]
2025-10-02T09:34:23.110648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:23.110691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.110695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2344 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5731f293-f0c01649-63ad1f31-55a775f6_0
2025-10-02T09:34:23.110816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2344 sessionId: src_id|5731f293-f0c01649-63ad1f31-55a775f6_0 is DEAD
2025-10-02T09:34:23.110957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:23.110966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Write session will restart in 0.008208s
2025-10-02T09:34:23.110983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Write session: Do CDS request
2025-10-02T09:34:23.110988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.118624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.119837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.119947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.119954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.119960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.119986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.120010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263917458:8350]
2025-10-02T09:34:23.120113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.120217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.120225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2345
2025-10-02T09:34:23.120351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.120368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.120374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.120376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.120380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.120571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.120599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.120649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2345 sessionId:  describe result for acl check
2025-10-02T09:34:23.120667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.120671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.120672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.120675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339486921:4104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.120794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.120839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.120843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.120843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.120844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.120844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.120845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.120846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.120846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.120847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.120847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.120848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.120848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.120852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.120861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.120864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.120868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.120871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.120875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.120878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.120881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.120883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.120886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.120887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.120889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.120893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.120897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.120901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.120904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.120906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.120908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.120911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.120913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.120916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.120919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.120921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.120923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.120926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.120928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.120930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.120933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.120935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.120938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.120940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.120943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.120945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.120948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.120950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.120953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.120969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.121020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339486921:4104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.122366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339486921:4104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.126332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339486921:4104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.126344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339486921:4104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.126347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339486921:4104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.126352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.128424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.130066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.130079Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.130081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.130084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.130088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2344 [2:7556555424263917458:8350]
2025-10-02T09:34:23.130098Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.130110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.130115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.130116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.130118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.130126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.130129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.130132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.130165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.130169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.130170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.130172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.130173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.130210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.130214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.130220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.130229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.130241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.130255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339486958:4104], now have 1 active actors on pipe
2025-10-02T09:34:23.130260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339486776:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.130263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.130265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.130266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.130272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.130282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.130292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.130292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.130294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.130279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2344
2025-10-02T09:34:23.130297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.130297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.130316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.130321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.130330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.130336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.130318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2344
2025-10-02T09:34:23.130341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.130352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.130360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.130362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.130363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.130369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.130377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.130395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.130482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.130487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.130495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.130550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2345 partition: 0 MaxSeqNo: 36 sessionId: src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0
2025-10-02T09:34:23.130742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731f293-f0c01649-63ad1f31-55a775f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.133176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Write session: try to update token
2025-10-02T09:34:23.133185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.139481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.139494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.139495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.139496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.139500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.139502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.139505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263917453:8350]
2025-10-02T09:34:23.139524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.139527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.139528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.139529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.139532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.139534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.139641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.143926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId: src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.145941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.210527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339486966:4843]
2025-10-02T09:34:23.210664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2344, pipe: [1:7556555424339486966:4843]
2025-10-02T09:34:23.249733Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.249946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.249955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.249978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339486966:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.250087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339486966:4843]
2025-10-02T09:34:23.250105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.250123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:23.250128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:23.250191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2345 reason: error at write: Disconnected sessionId: src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0
2025-10-02T09:34:23.250272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.250356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2345 sessionId: src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0 is DEAD
2025-10-02T09:34:23.250504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:23.250513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Write session will restart in 0.006567s
2025-10-02T09:34:23.250526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Write session: Do CDS request
2025-10-02T09:34:23.250532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.257851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.258154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.258439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.258446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2346
2025-10-02T09:34:23.258526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.258544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.258550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.258552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.258960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2346 sessionId:  describe result for acl check
2025-10-02T09:34:23.258994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.259001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.259003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.259008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339487133:4045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.259131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.259230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.259236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.259242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.259267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.259287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263917676:8338]
2025-10-02T09:34:23.259427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339487133:4045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.259698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.259912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.259941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.260122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.260155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.260160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.260160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.260161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.260161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.260162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.260163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.260163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.260163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.260164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.260164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.260165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.260167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.260173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.260175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.260178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.260180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.260182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.260184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.260185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.260187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.260189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.260191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.260193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.260196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.260201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.260204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.260206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.260208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.260211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.260214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.260217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.260220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.260222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.260224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.260227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.260229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.260236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.260238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.260242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.260244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.260246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.260249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.260251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.260253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.260256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.260259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.260262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.260278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.260838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339487133:4045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.265053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339487133:4045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.265067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339487133:4045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.265069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339487133:4045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.265081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.267648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.269256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.269266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.269267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.269269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.269272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2345 [2:7556555424263917676:8338]
2025-10-02T09:34:23.269280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.269288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.269290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.269291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.269292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.269301Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.269304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.269307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.269339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.269346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.269348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.269351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.269352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.269391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.269396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.269403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.269408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.269416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.269430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339486989:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.269435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487172:4045], now have 1 active actors on pipe
2025-10-02T09:34:23.269439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.269440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.269441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.269449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.269459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.269462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.269448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2345
2025-10-02T09:34:23.269464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.269465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.269469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.269470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.269488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.269493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.269479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2345
2025-10-02T09:34:23.269499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.269508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.269510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.269526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.269532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.269534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.269535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.269540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.269545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.269554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.269643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.269650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.269659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.269712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2346 partition: 0 MaxSeqNo: 36 sessionId: src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0
2025-10-02T09:34:23.269872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3837d5-950e7072-2e4d0281-41f8325b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.272276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Write session: try to update token
2025-10-02T09:34:23.272285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.278621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.278633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.278634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.278635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.278639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.278642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.278644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263917671:8338]
2025-10-02T09:34:23.278663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.278666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.278667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.278670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.278674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.278676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.278770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.283094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId: src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.285120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.350290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339487182:4843]
2025-10-02T09:34:23.350434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2345, pipe: [1:7556555424339487182:4843]
2025-10-02T09:34:23.388005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.388296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.388305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.388330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487182:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.388566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:23.388582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:23.388600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.388609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.388629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339487182:4843]
2025-10-02T09:34:23.388673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2346 reason: error at write: Disconnected sessionId: src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0
2025-10-02T09:34:23.388846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2346 sessionId: src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0 is DEAD
2025-10-02T09:34:23.388976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:23.388985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Write session will restart in 0.006321s
2025-10-02T09:34:23.389002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Write session: Do CDS request
2025-10-02T09:34:23.389006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.396163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.396311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.396320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2347
2025-10-02T09:34:23.396331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.396409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.396429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.396435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.396438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.396778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2347 sessionId:  describe result for acl check
2025-10-02T09:34:23.396826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.396834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.396836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.396840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339487327:4039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.397324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339487327:4039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.397592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.397697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.397703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.397709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.397734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.397759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263917862:8331]
2025-10-02T09:34:23.398112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.398300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.398325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.398505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.398538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.398542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.398542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.398543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.398543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.398544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.398544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.398545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.398545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.398546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.398547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.398547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.398550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.398556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.398558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.398560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.398562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.398564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.398566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.398568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.398570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.398580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.398583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.398586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.398589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.398594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.398597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.398600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.398602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.398604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.398606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.398609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.398613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.398618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.398621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.398625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.398629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.398636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.398639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.398641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.398645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.398647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.398650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.398653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.398655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.398658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.398660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.398664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.398682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.398945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339487327:4039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.403581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339487327:4039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.403591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339487327:4039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.403594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339487327:4039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.403598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.406267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.407869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.407880Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.407881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.407883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.407885Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2346 [2:7556555424263917862:8331]
2025-10-02T09:34:23.407892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.407900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.407902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.407903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.407904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.407912Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.407915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.407920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.407952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.407957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.407958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.407960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.407961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.407996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.408001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.408008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.408013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.408021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.408032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487183:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.408037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487366:4039], now have 1 active actors on pipe
2025-10-02T09:34:23.408042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.408043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.408044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.408053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.408063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.408073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.408075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.408076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.408077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.408079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.408064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2346
2025-10-02T09:34:23.408082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2346
2025-10-02T09:34:23.408097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.408103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.408112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.408116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.408119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.408141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.408149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.408151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.408152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.408156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.408163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.408174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.408295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.408301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.408310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.408364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2347 partition: 0 MaxSeqNo: 36 sessionId: src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0
2025-10-02T09:34:23.408550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb52daf-acd52e81-f56393c-b274e7f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.411035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Write session: try to update token
2025-10-02T09:34:23.411045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.417278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.417292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.417293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.417294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.417301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.417305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.417307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263917857:8331]
2025-10-02T09:34:23.417332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.417335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.417336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.417337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.417342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.417344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.417435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.422504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId: src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.424496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.488548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339487373:4843]
2025-10-02T09:34:23.488724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2346, pipe: [1:7556555424339487373:4843]
2025-10-02T09:34:23.527526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.527822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.527831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.527855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487373:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.527993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.527996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.528027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339487373:4843]
2025-10-02T09:34:23.528059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:23.528163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2347 reason: status is not ok: tablet will be restarted right now sessionId: src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0
2025-10-02T09:34:23.528327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2347 sessionId: src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0 is DEAD
2025-10-02T09:34:23.528484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:23.528494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Write session will restart in 0.009395s
2025-10-02T09:34:23.528509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Write session: Do CDS request
2025-10-02T09:34:23.528514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.537000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.538275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.538373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.538379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.538384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.538418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.538441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263918045:8326]
2025-10-02T09:34:23.538797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.538980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.539008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.539125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.539203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.539213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.539235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.539222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2348
2025-10-02T09:34:23.539239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.539239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.539240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.539240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.539241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.539241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.539242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.539242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.539243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.539243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.539244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.539247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.539254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.539256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.539258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.539260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.539262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.539264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.539266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.539268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.539270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.539272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.539274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.539278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.539283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.539286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.539289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.539291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.539294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.539296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.539298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.539301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.539303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.539305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.539308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.539310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.539313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.539315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.539317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.539308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.539319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.539322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.539328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.539326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.539331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.539334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.539332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.539337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.539340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.539342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.539344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.539361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.539692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2348 sessionId:  describe result for acl check
2025-10-02T09:34:23.539730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.539737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.539739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.539743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339487525:4017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.540212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339487525:4017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.541744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339487525:4017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.545595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339487525:4017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.545606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339487525:4017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.545609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339487525:4017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.545613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.546752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.548355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.548367Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.548369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.548371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.548375Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2347 [2:7556555424263918045:8326]
2025-10-02T09:34:23.548385Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.548396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.548399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.548401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.548402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.548413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.548415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.548420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.548450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.548456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.548457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.548459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.548460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.548495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.548499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.548505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.548510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.548518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.548530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487563:4017], now have 1 active actors on pipe
2025-10-02T09:34:23.548535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487375:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.548539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.548540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.548541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.548550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.548560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.548565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.548555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2347
2025-10-02T09:34:23.548567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.548568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.548571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2347
2025-10-02T09:34:23.548570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.548571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.548585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.548587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.548589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.548597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.548599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.548623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.548630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.548633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.548634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.548640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.548649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.548660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.548762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.548768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.548777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.548848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2348 partition: 0 MaxSeqNo: 36 sessionId: src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0
2025-10-02T09:34:23.549076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec92a5-ba60bbe0-ed5f0e2f-4d64b2f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.551603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Write session: try to update token
2025-10-02T09:34:23.551614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.557926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.557939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.557941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.557942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.557947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.557949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.557951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263918040:8326]
2025-10-02T09:34:23.557972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.557975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.557977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.557978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.557982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.557984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.558089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.562970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId: src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.564996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.628324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339487571:4843]
2025-10-02T09:34:23.628507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2347, pipe: [1:7556555424339487571:4843]
2025-10-02T09:34:23.667598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.667840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.667849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.667873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487571:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.668011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.668009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.668040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:23.668042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:23.668083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2348 reason: error at write: Disconnected sessionId: src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0
2025-10-02T09:34:23.668086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339487571:4843]
2025-10-02T09:34:23.668206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2348 sessionId: src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0 is DEAD
2025-10-02T09:34:23.668335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:23.668344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Write session will restart in 0.005389s
2025-10-02T09:34:23.668363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Write session: Do CDS request
2025-10-02T09:34:23.668367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.675101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.675176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.675185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2349
2025-10-02T09:34:23.675254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.675272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.675278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.675280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.675704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2349 sessionId:  describe result for acl check
2025-10-02T09:34:23.675747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.675757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.675759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.675762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339487711:4004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.676232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339487711:4004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.676909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.678075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.678097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339487711:4004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.678174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.678182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.678189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.678220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.678243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263918228:8321]
2025-10-02T09:34:23.678605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.678791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.678818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.679011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.679043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.679046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.679047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.679048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.679048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.679049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.679049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.679050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.679050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.679051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.679051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.679052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.679054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.679060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.679062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.679065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.679067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.679069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.679071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.679072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.679075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.679077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.679079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.679081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.679084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.679088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.679091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.679094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.679097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.679099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.679102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.679104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.679107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.679109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.679111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.679114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.679116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.679119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.679121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.679123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.679126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.679128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.679130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.679133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.679135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.679138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.679140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.679143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.679161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.683011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339487711:4004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.683026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339487711:4004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.683029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339487711:4004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.683036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.686536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.688048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.688061Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.688062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.688064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.688067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2348 [2:7556555424263918228:8321]
2025-10-02T09:34:23.688073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.688082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.688083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.688085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.688086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.688095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.688099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.688105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.688139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.688144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.688145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.688147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.688148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.688192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.688198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.688204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.688209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.688217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.688229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487759:4004], now have 1 active actors on pipe
2025-10-02T09:34:23.688234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487572:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.688238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.688239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.688240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.688247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.688256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.688264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.688266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.688267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.688272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.688274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.688281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.688283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.688265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2348
2025-10-02T09:34:23.688284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2348
2025-10-02T09:34:23.688287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.688296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.688301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.688436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.688446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.688448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.688449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.688454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.688460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.688473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.688616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.688622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.688632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.688691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2349 partition: 0 MaxSeqNo: 36 sessionId: src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0
2025-10-02T09:34:23.688897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95636b5-80ce10b6-196a1a6f-331efb83_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.691365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Write session: try to update token
2025-10-02T09:34:23.691375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.697448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.697461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.697463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.697464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.697469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.697471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.697473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263918223:8321]
2025-10-02T09:34:23.697493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.697497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.697498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.697498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.697504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.697505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.697600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.702667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId: src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.704728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.768081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339487767:4843]
2025-10-02T09:34:23.768222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2348, pipe: [1:7556555424339487767:4843]
2025-10-02T09:34:23.807189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.807380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.807389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.807412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487767:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.807556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.807570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339487767:4843]
2025-10-02T09:34:23.807591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:23.807637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.807645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2349 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0
2025-10-02T09:34:23.807759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2349 sessionId: src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0 is DEAD
2025-10-02T09:34:23.807875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:23.807884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Write session will restart in 0.009108s
2025-10-02T09:34:23.807899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Write session: Do CDS request
2025-10-02T09:34:23.807903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.816460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.817744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.817846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.817853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.817859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.817886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.817912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263918414:8319]
2025-10-02T09:34:23.818123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.818252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.818268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.818265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2350
2025-10-02T09:34:23.818408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.818435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.818445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.818449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.818442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.818471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.818657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.818688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.818692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.818692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.818693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.818693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.818694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.818694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.818695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.818696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.818696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.818696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.818697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.818700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.818707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.818711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.818714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.818717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.818721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.818724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.818728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.818731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.818736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.818737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.818739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.818743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.818747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.818750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.818753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.818756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.818758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.818760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.818763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.818765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.818767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.818769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.818772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.818774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.818777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.818781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.818783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.818786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.818788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.818790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.818793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.818796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.818800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.818803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.818805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.818792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2350 sessionId:  describe result for acl check
2025-10-02T09:34:23.818822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.818820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.818826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.818828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.818832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339487918:3999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.819279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339487918:3999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.820869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339487918:3999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.825718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339487918:3999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.825729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339487918:3999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.825731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339487918:3999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.825737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.826246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.827801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.827812Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.827814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.827816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.827819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2349 [2:7556555424263918414:8319]
2025-10-02T09:34:23.827825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.827835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.827836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.827838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.827839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.827848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.827852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.827856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.827884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.827889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.827890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.827892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.827894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.827929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.827935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.827944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.827955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.827968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.827982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487954:3999], now have 1 active actors on pipe
2025-10-02T09:34:23.827987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487768:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.827991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.827992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.827993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.828001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.828012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.828021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.828022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.828024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.828026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.828010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2349
2025-10-02T09:34:23.828033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.828027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2349
2025-10-02T09:34:23.828047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.828052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.828060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.828066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.828079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.828088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.828091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.828093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.828094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.828099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.828108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.828123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.828248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.828255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.828264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.828329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2350 partition: 0 MaxSeqNo: 36 sessionId: src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0
2025-10-02T09:34:23.828599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda7a837-6b61d73d-50dbfaab-99d58393_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.831078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Write session: try to update token
2025-10-02T09:34:23.831088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.837212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.837224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.837226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.837227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.837230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.837233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.837235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263918409:8319]
2025-10-02T09:34:23.837254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.837257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.837258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.837262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.837267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.837270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.837369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.842861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId: src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.845040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:23.907893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555424339487968:4843]
2025-10-02T09:34:23.908091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2349, pipe: [1:7556555424339487968:4843]
2025-10-02T09:34:23.948753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:23.948969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.948979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.948992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487968:4843], now have 1 active actors on pipe
2025-10-02T09:34:23.949120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:23.949192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:23.949198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:23.949245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555424339487968:4843]
2025-10-02T09:34:23.949287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2350 reason: status is not ok: tablet will be restarted right now sessionId: src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0
2025-10-02T09:34:23.949460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2350 sessionId: src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0 is DEAD
2025-10-02T09:34:23.949600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:23.949609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Write session will restart in 0.006490s
2025-10-02T09:34:23.949624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Write session: Do CDS request
2025-10-02T09:34:23.949629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:23.957119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.957255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:23.957268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2351
2025-10-02T09:34:23.957389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:23.957415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:23.957424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:23.957427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:23.957783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2351 sessionId:  describe result for acl check
2025-10-02T09:34:23.957814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:23.957821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:23.957823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:23.957827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555424339488123:3965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:23.958040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:23.958261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555424339488123:3965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:23.959258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:23.959373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:23.959379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:23.959385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:23.959412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:23.959437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555424263918601:8315]
2025-10-02T09:34:23.959804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:23.959999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:23.960027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:23.960095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555424339488123:3965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:23.960220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:23.960253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.960257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.960258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.960258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.960259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.960259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.960260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.960260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.960261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.960261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.960262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.960262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.960265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.960271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.960273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.960275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.960277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.960279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.960281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.960283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.960285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.960287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.960289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.960291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.960295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.960299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:23.960302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.960305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:23.960308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.960310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:23.960312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.960315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:23.960317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.960320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:23.960322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.960324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:23.960327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.960330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:23.960332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.960335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:23.960337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.960340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:23.960342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.960345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.960347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.960350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.960352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.960355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.960374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:23.965142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555424339488123:3965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:23.965157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555424339488123:3965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:23.965164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555424339488123:3965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:23.965170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:23.967720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:23.969404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:23.969416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:23.969418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:23.969420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:23.969423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2350 [2:7556555424263918601:8315]
2025-10-02T09:34:23.969432Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:23.969441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:23.969442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.969444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.969445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.969453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:23.969460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:23.969464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:23.969495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.969500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.969501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.969502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:23.969504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:23.969538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:23.969542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.969549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:23.969554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:23.969561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:23.969576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339488160:3965], now have 1 active actors on pipe
2025-10-02T09:34:23.969581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555424339487972:2446], now have 1 active actors on pipe
2025-10-02T09:34:23.969585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.969586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.969587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.969594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:23.969603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:23.969609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:23.969611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:23.969612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:23.969614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:23.969615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:23.969631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.969636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:23.969638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:23.969628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2350
2025-10-02T09:34:23.969632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2350
2025-10-02T09:34:23.969663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.969669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.969685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|201d25e9-dc564f01-984f1a26-38939311_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:23.969691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:23.969693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:23.969694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:23.969699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:23.969706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:23.969713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.969824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:23.969834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:23.969849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:23.969921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2351 partition: 0 MaxSeqNo: 36 sessionId: src_id|201d25e9-dc564f01-984f1a26-38939311_0
2025-10-02T09:34:23.970185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84903fa8-2ab0139c-d6b3dd34-34f08945_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|201d25e9-dc564f01-984f1a26-38939311_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:23.972688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Write session: try to update token
2025-10-02T09:34:23.972698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:23.978865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:23.978878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:23.978879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:23.978881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:23.978887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.978890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.978893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555424263918596:8315]
2025-10-02T09:34:23.978919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:23.978923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:23.978926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:23.978928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:23.978928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:23.978929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:23.979034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:23.984929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId: src_id|201d25e9-dc564f01-984f1a26-38939311_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:23.987107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.049188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634455464:4843]
2025-10-02T09:34:24.049368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2350, pipe: [1:7556555428634455464:4843]
2025-10-02T09:34:24.088402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.088815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.088827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.088843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455464:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.088962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.089018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634455464:4843]
2025-10-02T09:34:24.089020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.089045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:24.089115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|201d25e9-dc564f01-984f1a26-38939311_0
2025-10-02T09:34:24.089271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2351 sessionId: src_id|201d25e9-dc564f01-984f1a26-38939311_0 is DEAD
2025-10-02T09:34:24.089400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:24.089408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Write session will restart in 0.005544s
2025-10-02T09:34:24.089427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Write session: Do CDS request
2025-10-02T09:34:24.089431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.096120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.096215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.096225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2352
2025-10-02T09:34:24.096317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.096342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.096350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.096352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.096667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2352 sessionId:  describe result for acl check
2025-10-02T09:34:24.096700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.096707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.096709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.096713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634455608:3955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.097109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634455608:3955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.097963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.098789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634455608:3955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.099340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.099457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.099464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.099470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.099497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.099523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558886099:8310]
2025-10-02T09:34:24.099878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.100061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.100088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.100274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.100303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.100307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.100308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.100309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.100309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.100310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.100310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.100311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.100311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.100312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.100312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.100313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.100315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.100322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.100324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.100326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.100328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.100330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.100333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.100337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.100340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.100344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.100347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.100350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.100355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.100361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.100366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.100372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.100374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.100377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.100381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.100384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.100386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.100389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.100391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.100393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.100395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.100398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.100400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.100402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.100404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.100407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.100409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.100411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.100414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.100417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.100419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.100421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.100439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.100732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634455608:3955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.100744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634455608:3955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.100747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634455608:3955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.100751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.107817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.109270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.109282Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.109284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.109285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.109289Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2351 [2:7556555428558886099:8310]
2025-10-02T09:34:24.109296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.109305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.109306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.109307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.109308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.109317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.109320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.109326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.109356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.109362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.109363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.109365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.109366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.109400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.109405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.109411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.109416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.109424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.109438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455477:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.109443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455665:3955], now have 1 active actors on pipe
2025-10-02T09:34:24.109447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.109448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.109450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.109457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.109467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.109474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.109477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.109479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.109482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.109484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.109491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.109493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.109496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.109510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2351
2025-10-02T09:34:24.109520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2351
2025-10-02T09:34:24.109572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.109579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.109596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.109602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.109604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.109605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.109611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.109617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.109624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.109754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.109761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.109770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.109834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2352 partition: 0 MaxSeqNo: 36 sessionId: src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0
2025-10-02T09:34:24.110079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201d25e9-dc564f01-984f1a26-38939311_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.112548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Write session: try to update token
2025-10-02T09:34:24.112558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.118705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.118718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.118719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.118720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.118726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.118728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.118731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558886094:8310]
2025-10-02T09:34:24.118750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.118753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.118755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.118759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.118762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.118764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.118871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.123948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId: src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.126274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.188984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634455673:4843]
2025-10-02T09:34:24.189192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2351, pipe: [1:7556555428634455673:4843]
2025-10-02T09:34:24.227532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.227712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.227721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.227732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455673:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.227855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.227900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634455673:4843]
2025-10-02T09:34:24.227925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.227930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:24.228010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2352 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0
2025-10-02T09:34:24.228163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2352 sessionId: src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0 is DEAD
2025-10-02T09:34:24.228304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:24.228314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Write session will restart in 0.007498s
2025-10-02T09:34:24.228328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Write session: Do CDS request
2025-10-02T09:34:24.228332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.237027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.237166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.237300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.237313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2353
2025-10-02T09:34:24.237443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.237469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.237478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.237482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.237845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2353 sessionId:  describe result for acl check
2025-10-02T09:34:24.237880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.237887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.237888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.237893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634455826:3943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.238311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634455826:3943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.238352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.238454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.238463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.238469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.238494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.238518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558886317:8273]
2025-10-02T09:34:24.238895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.239087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.239120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.239318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.239346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.239350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.239350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.239351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.239351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.239352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.239352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.239353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.239353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.239354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.239354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.239355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.239357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.239363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.239365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.239367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.239369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.239371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.239373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.239375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.239377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.239379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.239381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.239383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.239386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.239390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.239393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.239396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.239398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.239401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.239403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.239405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.239407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.239410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.239412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.239415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.239419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.239423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.239427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.239430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.239433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.239437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.239441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.239445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.239448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.239452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.239460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.239465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.239483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.240103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634455826:3943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.245210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634455826:3943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.245221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634455826:3943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.245224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634455826:3943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.245230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.246878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.248515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.248526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.248528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.248530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.248533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2352 [2:7556555428558886317:8273]
2025-10-02T09:34:24.248540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.248549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.248550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.248552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.248553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.248562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.248569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.248573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.248608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.248612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.248613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.248615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.248616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.248652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.248657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.248663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.248668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.248676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.248690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455864:3943], now have 1 active actors on pipe
2025-10-02T09:34:24.248696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455675:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.248700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.248701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.248702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.248709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.248717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.248726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.248726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.248728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.248728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.248729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.248744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.248752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.248754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.248739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2352
2025-10-02T09:34:24.248762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2352
2025-10-02T09:34:24.248770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.248775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.248794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.248816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.248823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.248824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.248831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.248841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.248853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.248985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.248992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.249000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.249063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2353 partition: 0 MaxSeqNo: 36 sessionId: src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0
2025-10-02T09:34:24.249307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54ad3c3-fe21818a-d265dc0e-bd29a8db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.251798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Write session: try to update token
2025-10-02T09:34:24.251808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.257885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.257900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.257902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.257903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.257907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.257910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.257912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558886312:8273]
2025-10-02T09:34:24.257933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.257936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.257938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.257938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.257941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.257944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.258050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.263915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId: src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.266263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.328478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634455896:4843]
2025-10-02T09:34:24.328636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2352, pipe: [1:7556555428634455896:4843]
2025-10-02T09:34:24.366432Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.366794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.366804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.366816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455896:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.366934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.366964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634455896:4843]
2025-10-02T09:34:24.366985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.367009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:24.367103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2353 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0
2025-10-02T09:34:24.367260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2353 sessionId: src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0 is DEAD
2025-10-02T09:34:24.367391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:24.367403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Write session will restart in 0.005961s
2025-10-02T09:34:24.367425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Write session: Do CDS request
2025-10-02T09:34:24.367429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.374167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.374221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.374232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2354
2025-10-02T09:34:24.374378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.374401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.374404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.374407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.374792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2354 sessionId:  describe result for acl check
2025-10-02T09:34:24.374827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.374832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.374833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.374837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634456031:3907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.375296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634456031:3907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.376111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.377042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634456031:3907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.377474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.377579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.377585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.377591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.377616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.377640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558886515:8263]
2025-10-02T09:34:24.377992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.378177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.378200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.378388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.378428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.378433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.378433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.378434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.378434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.378435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.378436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.378436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.378437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.378437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.378438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.378438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.378441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.378447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.378449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.378452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.378453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.378456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.378458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.378460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.378462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.378464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.378466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.378468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.378472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.378476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.378479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.378483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.378484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.378487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.378489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.378492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.378494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.378497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.378499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.378501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.378505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.378507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.378509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.378512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.378514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.378516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.378518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.378521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.378523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.378526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.378528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.378530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.378548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.378818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634456031:3907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.378832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634456031:3907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.378836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634456031:3907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.378842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.386002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.387658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.387668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.387669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.387671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.387674Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2353 [2:7556555428558886515:8263]
2025-10-02T09:34:24.387681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.387690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.387693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.387694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.387695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.387704Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.387708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.387713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.387744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.387749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.387750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.387752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.387753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.387792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.387797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.387803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.387808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.387820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.387832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634455897:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.387837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456089:3907], now have 1 active actors on pipe
2025-10-02T09:34:24.387841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.387842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.387843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.387850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.387859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.387865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.387868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.387870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.387870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.387872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.387885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.387890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.387892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.387877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2353
2025-10-02T09:34:24.387924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2353
2025-10-02T09:34:24.387960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.387966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.387979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.387985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.387988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.387989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.387994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.388002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.388012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.388166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.388173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.388183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.388239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2354 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0
2025-10-02T09:34:24.388511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d084141e-1ae6ee83-fca08a26-5b031a04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.391297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Write session: try to update token
2025-10-02T09:34:24.391312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.400890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:24.400902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.400907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.400929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:24.400935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:24.401068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:24.401186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:24.401301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:24.401422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:24.401574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:24.401598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:24.403480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId: src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.405168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.405179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.405180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.405182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.405185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.405188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.405190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558886510:8263]
2025-10-02T09:34:24.405208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.405213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.405214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.405215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.405216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.405218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.405333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.405731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.466973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634456096:4843]
2025-10-02T09:34:24.467179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2353, pipe: [1:7556555428634456096:4843]
2025-10-02T09:34:24.513173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.513532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.513544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.513559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456096:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.513716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.513734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.513766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:24.513800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634456096:4843]
2025-10-02T09:34:24.513819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2354 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0
2025-10-02T09:34:24.513963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2354 sessionId: src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0 is DEAD
2025-10-02T09:34:24.514114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:24.514124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Write session will restart in 0.009945s
2025-10-02T09:34:24.514147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Write session: Do CDS request
2025-10-02T09:34:24.514152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.522638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.523949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.524050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.524057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.524063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.524087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.524110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558886705:8261]
2025-10-02T09:34:24.524459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.524627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.524650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.524854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.524888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.524894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.524894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.524895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.524895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.524896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.524896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.524897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.524898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.524898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.524899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.524899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.524902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.524908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.524910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.524913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.524914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.524917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.524919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.524921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.524923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.524925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.524927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.524929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.524933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.524937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.524941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.524944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.524946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.524949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.524951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.524954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.524956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.524958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.524961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.524964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.524966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.524969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.524971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.524974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.524976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.524978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.524982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.524984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.524987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.524989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.524991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.524994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.525013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.525265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.525278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.525289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2355
2025-10-02T09:34:24.525462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.525482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.525490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.525493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.525771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2355 sessionId:  describe result for acl check
2025-10-02T09:34:24.525794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.525795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.525796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.525799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634456255:3903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.526142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634456255:3903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.527864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634456255:3903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.532330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634456255:3903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.532342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634456255:3903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.532345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634456255:3903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.532351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.532763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.534341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.534354Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.534355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.534356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.534360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2354 [2:7556555428558886705:8261]
2025-10-02T09:34:24.534366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.534376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.534378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.534379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.534380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.534389Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.534392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.534397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.534432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.534437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.534438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.534440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.534441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.534478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.534483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.534490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.534495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.534506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.534521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456097:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.534526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456289:3903], now have 1 active actors on pipe
2025-10-02T09:34:24.534531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.534532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.534533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.534542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.534552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.534560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.534561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.534562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.534576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.534578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.534589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.534595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.534597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.534564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2354
2025-10-02T09:34:24.534604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2354
2025-10-02T09:34:24.534621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.534627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.534642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.534648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.534650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.534651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.534657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.534663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.534672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.534777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.534782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.534790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.534844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2355 partition: 0 MaxSeqNo: 36 sessionId: src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0
2025-10-02T09:34:24.535096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3a2129c-3660b1bd-37f6fbeb-f6470baf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.537686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Write session: try to update token
2025-10-02T09:34:24.537698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.543592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.543604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.543605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.543606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.543610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.543612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.543614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558886700:8261]
2025-10-02T09:34:24.543632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.543635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.543636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.543637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.543640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.543642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.543808Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.550226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId: src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.552383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.613914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634456297:4843]
2025-10-02T09:34:24.614102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2354, pipe: [1:7556555428634456297:4843]
2025-10-02T09:34:24.652700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.653106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.653115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.653128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456297:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.653280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.653329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.653363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:24.653400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634456297:4843]
2025-10-02T09:34:24.653416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0
2025-10-02T09:34:24.653539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2355 sessionId: src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0 is DEAD
2025-10-02T09:34:24.653697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:24.653709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Write session will restart in 0.007448s
2025-10-02T09:34:24.653731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Write session: Do CDS request
2025-10-02T09:34:24.653737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.662169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.662284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.662293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2356
2025-10-02T09:34:24.662407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.662429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.662436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.662439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.662658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.662732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2356 sessionId:  describe result for acl check
2025-10-02T09:34:24.662752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.662757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.662758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.662761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634456452:3892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.663105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634456452:3892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.663901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.664028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.664035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.664041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.664070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.664097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558886897:8259]
2025-10-02T09:34:24.664438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.664599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.664625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.664650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634456452:3892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.664798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.664839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.664843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.664844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.664844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.664845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.664845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.664846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.664847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.664847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.664848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.664848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.664849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.664852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.664858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.664860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.664862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.664864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.664866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.664868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.664870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.664872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.664874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.664876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.664878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.664881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.664885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.664888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.664892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.664894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.664896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.664898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.664901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.664905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.664907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.664909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.664912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.664914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.664917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.664919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.664921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.664923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.664926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.664928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.664930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.664932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.664935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.664937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.664939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.664958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.669790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634456452:3892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.669801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634456452:3892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.669804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634456452:3892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.669809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.672334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.673950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.673963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.673965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.673967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.673970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2355 [2:7556555428558886897:8259]
2025-10-02T09:34:24.673978Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.673989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.673990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.673992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.673993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.674003Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.674005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.674010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.674041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.674046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.674048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.674049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.674051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.674087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.674092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.674098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.674103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.674111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.674126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456298:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.674131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456491:3892], now have 1 active actors on pipe
2025-10-02T09:34:24.674134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.674136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.674138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.674147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.674157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.674164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.674166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.674167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.674172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.674174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.674181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.674183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.674185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.674166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2355
2025-10-02T09:34:24.674196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2355
2025-10-02T09:34:24.674213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.674218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.674232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.674237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.674241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.674243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.674248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.674254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.674264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.674359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.674365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.674373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.674429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2356 partition: 0 MaxSeqNo: 36 sessionId: src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0
2025-10-02T09:34:24.674695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8149e34-c73966b7-794b9a2e-7ed35211_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.677292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Write session: try to update token
2025-10-02T09:34:24.677306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.682990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:24.683002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.683006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.683026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:24.683030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:24.683157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:24.683269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:24.683379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:24.683491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:24.683649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:24.683671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:24.689572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId: src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.691292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.691305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.691306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.691307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.691311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.691313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.691315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558886892:8259]
2025-10-02T09:34:24.691333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.691336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.691337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.691339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.691342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.691344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.691452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.691785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.753704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634456499:4843]
2025-10-02T09:34:24.753896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2355, pipe: [1:7556555428634456499:4843]
2025-10-02T09:34:24.800050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.800416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.800425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.800438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456499:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.800588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.800656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:24.800666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:24.800713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2356 reason: error at write: Disconnected sessionId: src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0
2025-10-02T09:34:24.800719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634456499:4843]
2025-10-02T09:34:24.800826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.800852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2356 sessionId: src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0 is DEAD
2025-10-02T09:34:24.800996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:24.801004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Write session will restart in 0.009879s
2025-10-02T09:34:24.801026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Write session: Do CDS request
2025-10-02T09:34:24.801032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.809892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.811165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.811281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.811288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.811293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.811319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.811344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558887090:8258]
2025-10-02T09:34:24.811683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.811864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.811887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.812062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.812090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.812094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.812094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.812095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.812095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.812096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.812096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.812097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.812097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.812098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.812098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.812099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.812101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.812108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.812110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.812112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.812114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.812116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.812118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.812120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.812122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.812125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.812127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.812129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.812145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.812133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.812137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.812140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.812143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.812145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.812148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.812150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.812152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.812155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.812157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.812159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.812162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.812164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.812167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.812169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.812172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.812174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.812178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.812180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.812183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.812185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.812187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.812190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.812192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.812210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.812261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.812272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2357
2025-10-02T09:34:24.812389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.812408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.812415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.812418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.812788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2357 sessionId:  describe result for acl check
2025-10-02T09:34:24.812843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.812849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.812851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.812858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634456660:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.813383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634456660:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.815070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634456660:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.819153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634456660:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.819166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634456660:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.819170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634456660:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.819176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.819638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.821165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.821178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.821179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.821181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.821185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2356 [2:7556555428558887090:8258]
2025-10-02T09:34:24.821192Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.821202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.821204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.821205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.821206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.821215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.821218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.821222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.821254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.821259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.821260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.821262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.821263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.821309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.821314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.821321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.821326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.821335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.821348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456693:3874], now have 1 active actors on pipe
2025-10-02T09:34:24.821352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456500:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.821356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.821357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.821358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.821366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.821376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.821384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.821386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.821387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.821388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.821388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.821402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.821407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.821381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2356
2025-10-02T09:34:24.821417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2356
2025-10-02T09:34:24.821410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.821530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.821537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.821553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d395e093-ac19f66e-6d2036-507dcc9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.821561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.821563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.821564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.821569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.821575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.821584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.821704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.821709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.821717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.821772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2357 partition: 0 MaxSeqNo: 36 sessionId: src_id|d395e093-ac19f66e-6d2036-507dcc9d_0
2025-10-02T09:34:24.822011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c2ffd4-8b3233c6-494593ec-b5ee43a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d395e093-ac19f66e-6d2036-507dcc9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.824507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Write session: try to update token
2025-10-02T09:34:24.824519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.830413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.830425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.830426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.830427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.830431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.830435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.830437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558887085:8258]
2025-10-02T09:34:24.830456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.830462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.830463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.830540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.830550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.830553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.830602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.836852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId: src_id|d395e093-ac19f66e-6d2036-507dcc9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.838999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:24.900632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555428634456707:4843]
2025-10-02T09:34:24.900768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2356, pipe: [1:7556555428634456707:4843]
2025-10-02T09:34:24.939148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:24.939360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.939369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.939381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456707:4843], now have 1 active actors on pipe
2025-10-02T09:34:24.939505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:24.939529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:24.939562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:24.939598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555428634456707:4843]
2025-10-02T09:34:24.939614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2357 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d395e093-ac19f66e-6d2036-507dcc9d_0
2025-10-02T09:34:24.939761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2357 sessionId: src_id|d395e093-ac19f66e-6d2036-507dcc9d_0 is DEAD
2025-10-02T09:34:24.939916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:24.939927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Write session will restart in 0.005050s
2025-10-02T09:34:24.939947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Write session: Do CDS request
2025-10-02T09:34:24.939952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:24.946167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.946246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:24.946257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2358
2025-10-02T09:34:24.946370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:24.946391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:24.946399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:24.946402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:24.946879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2358 sessionId:  describe result for acl check
2025-10-02T09:34:24.946928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:24.946934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:24.946942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:24.946947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555428634456802:3846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:24.947407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555428634456802:3846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:24.949115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:24.949305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555428634456802:3846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:24.950388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:24.950485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:24.950492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:24.950497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:24.950522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:24.950546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555428558887284:8248]
2025-10-02T09:34:24.950953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:24.951159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:24.951188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:24.951318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555428634456802:3846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:24.951329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555428634456802:3846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:24.951332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555428634456802:3846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:24.951337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:24.951379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:24.951409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.951413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.951413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.951414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.951415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.951415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.951416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.951416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.951417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.951418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.951418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.951419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.951422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.951428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.951430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.951432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.951434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.951436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.951438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.951440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.951442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.951444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.951446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.951448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.951452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.951457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:24.951460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.951463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:24.951467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.951471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:24.951474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.951479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:24.951483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.951486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:24.951489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.951493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:24.951502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.951510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:24.951518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.951522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:24.951529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.951533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:24.951540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.951545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.951548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.951559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.951562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.951567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.951588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:24.959124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:24.960743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:24.960754Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:24.960755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:24.960758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:24.960761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2357 [2:7556555428558887284:8248]
2025-10-02T09:34:24.960768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:24.960778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:24.960783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.960785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.960786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.960796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:24.960798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:24.960815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:24.960850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.960854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.960856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.960857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:24.960859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:24.960894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:24.960899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.960906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:24.960911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:24.960919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:24.960934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456904:3846], now have 1 active actors on pipe
2025-10-02T09:34:24.960940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555428634456708:2446], now have 1 active actors on pipe
2025-10-02T09:34:24.960943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.960945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.960946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.960953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:24.960965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:24.960973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:24.960976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:24.960978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:24.960981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:24.960983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:24.960991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.960993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:24.960996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:24.960989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2357
2025-10-02T09:34:24.961015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.961018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2357
2025-10-02T09:34:24.961021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.961041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:24.961048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:24.961050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:24.961051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:24.961056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:24.961065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:24.961075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.961199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:24.961204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:24.961212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:24.961270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2358 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0
2025-10-02T09:34:24.961536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d395e093-ac19f66e-6d2036-507dcc9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:24.964103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Write session: try to update token
2025-10-02T09:34:24.964116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:24.970084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:24.970096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:24.970097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:24.970098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:24.970102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.970105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.970106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555428558887279:8248]
2025-10-02T09:34:24.970124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:24.970127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:24.970128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:24.970129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:24.970133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:24.970135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:24.970295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:24.976174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId: src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:24.978346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.039893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929424209:4843]
2025-10-02T09:34:25.040036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2357, pipe: [1:7556555432929424209:4843]
2025-10-02T09:34:25.078582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.078996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.079006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.079018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424209:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.079331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.079341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.079385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2358 reason: error at write: Disconnected sessionId: src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0
2025-10-02T09:34:25.079386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.079441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929424209:4843]
2025-10-02T09:34:25.079517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2358 sessionId: src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0 is DEAD
2025-10-02T09:34:25.079675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.079686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Write session will restart in 0.005003s
2025-10-02T09:34:25.079694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:25.079717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Write session: Do CDS request
2025-10-02T09:34:25.079724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.086154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.086258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.086271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2359
2025-10-02T09:34:25.086365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.086392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.086399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.086402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.086668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2359 sessionId:  describe result for acl check
2025-10-02T09:34:25.086692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.086697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.086698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.086701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929424325:3841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.086917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929424325:3841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.088360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929424325:3841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.088656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.090013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.090112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.090119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.090124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.090150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.090175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853854789:8249]
2025-10-02T09:34:25.090473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929424325:3841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.090485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929424325:3841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.090488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929424325:3841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.090492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.090512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.090721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.090744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.090918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.090947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.090950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.090951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.090951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.090952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.090952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.090953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.090954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.090954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.090955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.090955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.090956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.090959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.090965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.090967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.090969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.090971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.090974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.090976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.090978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.090979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.090982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.090984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.090986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.090989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.090992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.090996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.090999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.091001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.091004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.091006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.091009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.091011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.091013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.091015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.091018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.091020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.091023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.091025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.091028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.091031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.091033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.091036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.091038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.091041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.091043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.091048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.091051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.091066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.098495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.100002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.100015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.100016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.100018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.100021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2358 [2:7556555432853854789:8249]
2025-10-02T09:34:25.100030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.100041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.100042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.100044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.100044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.100053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.100060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.100064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.100100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.100105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.100106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.100107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.100109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.100144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.100149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.100155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.100160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.100168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.100184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424414:3841], now have 1 active actors on pipe
2025-10-02T09:34:25.100189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424211:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.100193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.100194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.100195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.100202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.100211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.100219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.100221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.100223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.100228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.100229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.100237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.100241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.100244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.100243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2358
2025-10-02T09:34:25.100272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2358
2025-10-02T09:34:25.100270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.100275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.100289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.100296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.100298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.100299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.100304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.100313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.100325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.100425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.100432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.100442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.100505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2359 partition: 0 MaxSeqNo: 36 sessionId: src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0
2025-10-02T09:34:25.100752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0adce6-8516024f-8bb07d21-4106eae4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.103375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Write session: try to update token
2025-10-02T09:34:25.103389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.109505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.109518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.109519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.109520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.109524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.109528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.109530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853854784:8249]
2025-10-02T09:34:25.109550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.109553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.109554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.109556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.109560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.109561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.109687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.117540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId: src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.119745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.179662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929424426:4843]
2025-10-02T09:34:25.179830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2358, pipe: [1:7556555432929424426:4843]
2025-10-02T09:34:25.219895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.220192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.220202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.220214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424426:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.220317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:25.220343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.220353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.220400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2359 reason: error at write: Disconnected sessionId: src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0
2025-10-02T09:34:25.220405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.220465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929424426:4843]
2025-10-02T09:34:25.220538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2359 sessionId: src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0 is DEAD
2025-10-02T09:34:25.220675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.220686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Write session will restart in 0.006675s
2025-10-02T09:34:25.220706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Write session: Do CDS request
2025-10-02T09:34:25.220712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.228154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.228277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.228287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2360
2025-10-02T09:34:25.228375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.228396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.228403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.228406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.228762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2360 sessionId:  describe result for acl check
2025-10-02T09:34:25.228813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.228819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.228821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.228826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929424583:3825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.229298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929424583:3825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.229710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.230883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929424583:3825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.231201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.231323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.231330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.231336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.231362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.231417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853854998:8236]
2025-10-02T09:34:25.231760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.231940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.231962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.232137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.232168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.232172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.232172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.232173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.232173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.232174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.232175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.232175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.232176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.232176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.232177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.232177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.232180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.232186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.232188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.232190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.232192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.232194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.232196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.232198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.232200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.232202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.232204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.232206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.232209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.232213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.232217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.232220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.232222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.232225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.232227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.232231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.232233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.232237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.232239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.232242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.232244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.232246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.232248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.232251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.232253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.232256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.232258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.232260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.232263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.232265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.232267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.232270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.232286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.234272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929424583:3825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.234283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929424583:3825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.234286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929424583:3825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.234292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.239752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.241243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.241255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.241256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.241258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.241262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2359 [2:7556555432853854998:8236]
2025-10-02T09:34:25.241268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.241278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.241280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.241282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.241283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.241291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.241296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.241300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.241336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.241341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.241342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.241344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.241345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.241383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.241388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.241395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.241400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.241409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.241423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424625:3825], now have 1 active actors on pipe
2025-10-02T09:34:25.241429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424428:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.241433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.241434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.241435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.241442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.241453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.241458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.241460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.241462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.241463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.241465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.241478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.241483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.241495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.241480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2359
2025-10-02T09:34:25.241514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.241519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.241487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2359
2025-10-02T09:34:25.241532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.241541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.241544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.241547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.241552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.241557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.241568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.241671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.241676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.241683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.241752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2360 partition: 0 MaxSeqNo: 36 sessionId: src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0
2025-10-02T09:34:25.242000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555a305e-43d64fd7-5df8fcdf-afb24c8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.244557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Write session: try to update token
2025-10-02T09:34:25.244571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.250460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:25.250475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.250479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.250499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:25.250502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:25.250640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:25.250751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:25.250859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:25.250966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:25.251130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:25.251152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:25.256644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId: src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.258672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.258921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.258936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.258947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.258949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.258950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.258951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.258955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.258957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.258959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853854993:8236]
2025-10-02T09:34:25.258979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.258983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.258986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.258989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.258996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.258998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.259089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.320469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929424656:4843]
2025-10-02T09:34:25.320623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2359, pipe: [1:7556555432929424656:4843]
2025-10-02T09:34:25.367670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.368028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:25.368048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424656:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.368111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:25.368177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.368180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.368184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.368230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929424656:4843]
2025-10-02T09:34:25.368233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2360 reason: error at write: Disconnected sessionId: src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0
2025-10-02T09:34:25.368334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2360 sessionId: src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0 is DEAD
2025-10-02T09:34:25.368491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.368502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Write session will restart in 0.005442s
2025-10-02T09:34:25.368523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Write session: Do CDS request
2025-10-02T09:34:25.368528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.375195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.375473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.375482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2361
2025-10-02T09:34:25.375585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.375605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.375613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.375616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.375988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2361 sessionId:  describe result for acl check
2025-10-02T09:34:25.376033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.376037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.376041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.376045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929424805:3794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.376481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929424805:3794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.377125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.377985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929424805:3794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.378468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.378608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.378615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.378622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.378649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.378675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853855219:8220]
2025-10-02T09:34:25.379017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.379192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.379215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.379388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.379419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.379423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.379423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.379424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.379425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.379425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.379426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.379426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.379426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.379427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.379428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.379428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.379431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.379437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.379440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.379442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.379443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.379446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.379447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.379449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.379451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.379454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.379456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.379458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.379461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.379465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.379469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.379472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.379475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.379478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.379480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.379482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.379485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.379487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.379489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.379492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.379494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.379497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.379499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.379502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.379504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.379507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.379510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.379513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.379515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.379517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.379519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.379522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.379539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.379844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929424805:3794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.379854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929424805:3794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.379857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929424805:3794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.379863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.386954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.388439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.388449Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.388450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.388451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.388454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2360 [2:7556555432853855219:8220]
2025-10-02T09:34:25.388462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.388471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.388476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.388477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.388478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.388487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.388490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.388494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.388524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.388528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.388529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.388531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.388532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.388569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.388573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.388579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.388584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.388592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.388607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424657:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.388612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424854:3794], now have 1 active actors on pipe
2025-10-02T09:34:25.388615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.388617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.388618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.388625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.388635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.388642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.388644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.388646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.388650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.388652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.388659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.388661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.388663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.388644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2360
2025-10-02T09:34:25.388698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2360
2025-10-02T09:34:25.388725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.388731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.388744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.388747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.388750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.388751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.388756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.388765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.388774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.388898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.388903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.388910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.388964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2361 partition: 0 MaxSeqNo: 36 sessionId: src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0
2025-10-02T09:34:25.389218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de79f4ef-a4e80ab3-5e3dcc0e-c4bef3ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.391767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Write session: try to update token
2025-10-02T09:34:25.391779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.397652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.397663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.397665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.397665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.397669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.397671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.397673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853855214:8220]
2025-10-02T09:34:25.397692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.397696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.397695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.397697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.397699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.397701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.397801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.404173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId: src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.406337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.468445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929424863:4843]
2025-10-02T09:34:25.468637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2360, pipe: [1:7556555432929424863:4843]
2025-10-02T09:34:25.506465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.506794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.506803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.506815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424863:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.506974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929424863:4843]
2025-10-02T09:34:25.507000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.507052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.507063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.507096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:25.507140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2361 reason: error at write: Disconnected sessionId: src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0
2025-10-02T09:34:25.507288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2361 sessionId: src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0 is DEAD
2025-10-02T09:34:25.507423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.507433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Write session will restart in 0.008714s
2025-10-02T09:34:25.507455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Write session: Do CDS request
2025-10-02T09:34:25.507460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.515661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.517076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.517130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.517250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.517257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.517263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.517264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.517274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2362
2025-10-02T09:34:25.517298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.517323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853855416:8216]
2025-10-02T09:34:25.517416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.517437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.517441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.517444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.517685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.517810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2362 sessionId:  describe result for acl check
2025-10-02T09:34:25.517846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.517851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.517853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.517858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929425026:3770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.517869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.517893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.518095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.518131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.518135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.518136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.518136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.518137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.518137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.518138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.518138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.518139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.518139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.518140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.518140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.518143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.518150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.518152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.518154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.518156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.518158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.518160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.518162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.518164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.518166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.518168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.518170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.518174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.518178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.518181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.518184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.518186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.518189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.518191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.518194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.518196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.518199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.518201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.518204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.518206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.518209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.518211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.518213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.518216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.518222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.518225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.518227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.518229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.518232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.518239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.518241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.518259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.518339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929425026:3770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.520145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929425026:3770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.524906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929425026:3770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.524920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929425026:3770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.524923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929425026:3770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.524933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.526087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.527629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.527641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.527642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.527644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.527648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2361 [2:7556555432853855416:8216]
2025-10-02T09:34:25.527786Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.527802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.527804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.527805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.527806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.527815Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.527819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.527823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.527855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.527860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.527861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.527863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.527864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.527903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.527908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.527915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.527920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.527928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.527943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425063:3770], now have 1 active actors on pipe
2025-10-02T09:34:25.527949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929424864:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.527953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.527954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.527955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.527962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.527972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.527975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.527978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.527979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.527982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.527983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.527979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2361
2025-10-02T09:34:25.527997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.528002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.528003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.528011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.528013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.528013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2361
2025-10-02T09:34:25.528041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|701ca74c-7311374c-8874a622-f03893b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.528052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.528056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.528058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.528064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.528071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.528086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.528190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.528196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.528206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.528265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2362 partition: 0 MaxSeqNo: 36 sessionId: src_id|701ca74c-7311374c-8874a622-f03893b6_0
2025-10-02T09:34:25.528547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb5b37b-33d42f22-d300e6a9-5516e52f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|701ca74c-7311374c-8874a622-f03893b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.531102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Write session: try to update token
2025-10-02T09:34:25.531116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.537431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.537442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.537444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.537444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.537448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.537450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.537452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853855411:8216]
2025-10-02T09:34:25.537470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.537473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.537474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.537478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.537481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.537484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.537594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.544168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId: src_id|701ca74c-7311374c-8874a622-f03893b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.546301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.607200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929425071:4843]
2025-10-02T09:34:25.607375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2361, pipe: [1:7556555432929425071:4843]
2025-10-02T09:34:25.647167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.647392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.647401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.647413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425071:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.647583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.647594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.647639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2362 reason: error at write: Disconnected sessionId: src_id|701ca74c-7311374c-8874a622-f03893b6_0
2025-10-02T09:34:25.647652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929425071:4843]
2025-10-02T09:34:25.647682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.647769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2362 sessionId: src_id|701ca74c-7311374c-8874a622-f03893b6_0 is DEAD
2025-10-02T09:34:25.647792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:25.647940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.647952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Write session will restart in 0.006314s
2025-10-02T09:34:25.647973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Write session: Do CDS request
2025-10-02T09:34:25.647979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.655192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.655293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.655302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2363
2025-10-02T09:34:25.655408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.655431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.655434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.655436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.655727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2363 sessionId:  describe result for acl check
2025-10-02T09:34:25.655751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.655759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.655761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.655766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929425230:3780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.656172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929425230:3780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.656463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.657834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.657878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929425230:3780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.657946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.657953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.657959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.657986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.658009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853855615:8212]
2025-10-02T09:34:25.658367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.658519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.658542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.658737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.658770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.658774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.658775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.658775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.658776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.658777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.658777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.658778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.658778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.658779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.658779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.658780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.658783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.658788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.658791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.658793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.658795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.658797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.658799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.658801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.658803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.658805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.658807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.658809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.658813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.658817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.658820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.658823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.658825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.658828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.658831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.658833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.658837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.658842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.658849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.658853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.658861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.658866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.658873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.658875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.658879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.658885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.658887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.658889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.658894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.658897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.658899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.658903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.658922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.662964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929425230:3780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.662977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929425230:3780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.662979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929425230:3780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.662986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.666675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.668227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.668239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.668240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.668242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.668245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2362 [2:7556555432853855615:8212]
2025-10-02T09:34:25.668252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.668261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.668263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.668264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.668266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.668274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.668281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.668285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.668322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.668328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.668330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.668333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.668335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.668375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.668380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.668386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.668391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.668402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.668417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425072:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.668422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425272:3780], now have 1 active actors on pipe
2025-10-02T09:34:25.668425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.668426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.668427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.668435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.668445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.668446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.668453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.668453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.668454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.668455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.668445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2362
2025-10-02T09:34:25.668468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.668474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.668476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.668479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2362
2025-10-02T09:34:25.668531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.668536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.668550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.668557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.668559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.668560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.668565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.668576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.668589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.668707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.668713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.668722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.668777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2363 partition: 0 MaxSeqNo: 36 sessionId: src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0
2025-10-02T09:34:25.669061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701ca74c-7311374c-8874a622-f03893b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.671643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Write session: try to update token
2025-10-02T09:34:25.671658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.677795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:25.677809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.677814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.677834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:25.677835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:25.677960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:25.678079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:25.678184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:25.678295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:25.678447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:25.678477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:25.683971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId: src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.686156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.686691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.686705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.686715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.686717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.686718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.686719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.686724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.686726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.686728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853855610:8212]
2025-10-02T09:34:25.686748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.686756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.686756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.686758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.686761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.686763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.686872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.748003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929425280:4843]
2025-10-02T09:34:25.748181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2362, pipe: [1:7556555432929425280:4843]
2025-10-02T09:34:25.798970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.799359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:25.799384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425280:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.799446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:25.799587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929425280:4843]
2025-10-02T09:34:25.799631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.807121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.807134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.807149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2363 reason: error at write: Disconnected sessionId: src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0
2025-10-02T09:34:25.807255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2363 sessionId: src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0 is DEAD
2025-10-02T09:34:25.807432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.807445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Write session will restart in 0.008145s
2025-10-02T09:34:25.807482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Write session: Do CDS request
2025-10-02T09:34:25.807506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.810769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.812234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.812336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.812342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.812348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.812372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.812396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853855816:8207]
2025-10-02T09:34:25.812766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.812965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.812994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.813181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.813213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.813218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.813219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.813220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.813221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.813222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.813223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.813224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.813225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.813226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.813227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.813227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.813232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.813238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.813241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.813243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.813245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.813247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.813249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.813251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.813253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.813255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.813257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.813259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.813263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.813268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.813271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.813274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.813276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.813279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.813281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.813284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.813287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.813290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.813293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.813295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.813297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.813300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.813302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.813305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.813307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.813310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.813313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.813318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.813320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.813323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.813325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.813327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.813344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.817172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.817274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.817281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2364
2025-10-02T09:34:25.817395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.817413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.817419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.817422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.817787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2364 sessionId:  describe result for acl check
2025-10-02T09:34:25.817830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.817839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.817840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.817845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929425447:3767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.818327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929425447:3767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.819979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929425447:3767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.820768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.822207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929425447:3767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.822219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929425447:3767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.822222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929425447:3767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.822227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.822456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.822468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.822469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.822471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.822473Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2363 [2:7556555432853855816:8207]
2025-10-02T09:34:25.822480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.822489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.822494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.822495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.822496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.822504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.822510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.822514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.822545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.822550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.822551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.822553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.822554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.822598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.822604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.822610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.822616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.822627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.822641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425481:3767], now have 1 active actors on pipe
2025-10-02T09:34:25.822646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425281:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.822649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.822650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.822651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.822661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.822653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2363
2025-10-02T09:34:25.822663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.822668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.822670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.822671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.822675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.822677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.822685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2363
2025-10-02T09:34:25.822703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.822710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.822718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.822726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.822735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.822746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83544047-68a91b91-67af9525-37b5a21d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.822753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.822755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.822756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.822761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.822768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.822782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.822875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.822882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.822891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.822951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2364 partition: 0 MaxSeqNo: 36 sessionId: src_id|83544047-68a91b91-67af9525-37b5a21d_0
2025-10-02T09:34:25.823174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f50e3582-462a01b5-e1e382a0-f6469cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83544047-68a91b91-67af9525-37b5a21d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.825748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Write session: try to update token
2025-10-02T09:34:25.825762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.832114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.832126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.832127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.832128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.832131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.832133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.832135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853855811:8207]
2025-10-02T09:34:25.832156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.832158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.832159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.832160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.832161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.832163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.832269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.838093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId: src_id|83544047-68a91b91-67af9525-37b5a21d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.840227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:25.899505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555432929425496:4843]
2025-10-02T09:34:25.899628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2363, pipe: [1:7556555432929425496:4843]
2025-10-02T09:34:25.942300Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:25.942591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.942605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.942618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425496:4843], now have 1 active actors on pipe
2025-10-02T09:34:25.942772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:25.942760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555432929425496:4843]
2025-10-02T09:34:25.942782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:25.942784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:25.942802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:25.942822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2364 reason: error at write: Disconnected sessionId: src_id|83544047-68a91b91-67af9525-37b5a21d_0
2025-10-02T09:34:25.942951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2364 sessionId: src_id|83544047-68a91b91-67af9525-37b5a21d_0 is DEAD
2025-10-02T09:34:25.943121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:25.943136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Write session will restart in 0.009435s
2025-10-02T09:34:25.943157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Write session: Do CDS request
2025-10-02T09:34:25.943163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:25.951999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:25.953174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.953280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:25.953290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2365
2025-10-02T09:34:25.953333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:25.953412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:25.953433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:25.953439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:25.953442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:25.953437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:25.953445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:25.953451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:25.953476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:25.953503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555432853856016:8205]
2025-10-02T09:34:25.953842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2365 sessionId:  describe result for acl check
2025-10-02T09:34:25.953863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:25.953881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:25.953888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:25.953889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:25.953895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555432929425666:3738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:25.954028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:25.954050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:25.954228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:25.954257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.954261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.954262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.954262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.954263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.954263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.954264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.954264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.954265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.954265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.954266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.954266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.954269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.954276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.954278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.954280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.954282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.954284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.954286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.954288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.954290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.954292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.954294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.954295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.954299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.954303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:25.954306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.954309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:25.954311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.954314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:25.954316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.954318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:25.954321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.954323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:25.954325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.954328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:25.954331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.954334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:25.954336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.954339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:25.954341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.954343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:25.954345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.954348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.954339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555432929425666:3738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:25.954350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.954353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.954355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.954358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.954373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:25.955806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555432929425666:3738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:25.961153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555432929425666:3738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:25.961164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555432929425666:3738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:25.961166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555432929425666:3738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:25.961174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:25.961836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:25.963359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:25.963370Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:25.963371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:25.963373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:25.963376Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2364 [2:7556555432853856016:8205]
2025-10-02T09:34:25.963386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:25.963396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:25.963401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.963403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.963403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.963413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:25.963419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:25.963423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:25.963454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.963459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.963459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.963461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:25.963462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:25.963500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:25.963505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.963511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:25.963516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:25.963524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:25.963538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425702:3738], now have 1 active actors on pipe
2025-10-02T09:34:25.963543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555432929425500:2446], now have 1 active actors on pipe
2025-10-02T09:34:25.963546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.963547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.963548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.963555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:25.963564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:25.963568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:25.963570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:25.963571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:25.963575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:25.963576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:25.963590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.963595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:25.963595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2364
2025-10-02T09:34:25.963596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2364
2025-10-02T09:34:25.963611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:25.963625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.963630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.963643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|438ce07c-cfc26471-7e26e339-47a6296e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:25.963650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:25.963652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:25.963653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:25.963658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:25.963666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:25.963675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.963782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:25.963787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:25.963795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:25.963871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2365 partition: 0 MaxSeqNo: 36 sessionId: src_id|438ce07c-cfc26471-7e26e339-47a6296e_0
2025-10-02T09:34:25.964094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83544047-68a91b91-67af9525-37b5a21d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|438ce07c-cfc26471-7e26e339-47a6296e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:25.966692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Write session: try to update token
2025-10-02T09:34:25.966704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:25.972685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:25.972697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:25.972698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:25.972699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:25.972702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.972704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.972706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555432853856011:8205]
2025-10-02T09:34:25.972718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:25.972721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:25.972723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:25.972725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:25.972728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:25.972729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:25.972849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:25.978865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId: src_id|438ce07c-cfc26471-7e26e339-47a6296e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:25.981035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.042916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224393005:4843]
2025-10-02T09:34:26.043131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2364, pipe: [1:7556555437224393005:4843]
2025-10-02T09:34:26.083221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.083608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.083616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.083628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393005:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.083775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.083831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:26.083841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:26.083865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.083887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2365 reason: error at write: Disconnected sessionId: src_id|438ce07c-cfc26471-7e26e339-47a6296e_0
2025-10-02T09:34:26.083907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224393005:4843]
2025-10-02T09:34:26.084025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2365 sessionId: src_id|438ce07c-cfc26471-7e26e339-47a6296e_0 is DEAD
2025-10-02T09:34:26.084157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:26.084171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Write session will restart in 0.008806s
2025-10-02T09:34:26.084192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Write session: Do CDS request
2025-10-02T09:34:26.084197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.094111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.094231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.094239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2366
2025-10-02T09:34:26.094352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.094371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.094378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.094381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.094701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2366 sessionId:  describe result for acl check
2025-10-02T09:34:26.094733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.094778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.094786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.094790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224393182:3739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.094924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.095158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224393182:3739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.096365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.096463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.096469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.096475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.096501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.096524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148823529:8189]
2025-10-02T09:34:26.096596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224393182:3739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.096878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.097051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.097074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.097342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.097379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.097383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.097384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.097384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.097385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.097386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.097386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.097387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.097387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.097388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.097389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.097389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.097392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.097398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.097400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.097402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.097404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.097406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.097408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.097410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.097412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.097414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.097416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.097418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.097422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.097425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.097430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.097433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.097435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.097438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.097440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.097443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.097445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.097448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.097450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.097453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.097455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.097458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.097460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.097462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.097466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.097472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.097474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.097477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.097479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.097482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.097484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.097487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.097503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.101342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224393182:3739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.101353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224393182:3739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.101356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224393182:3739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.101362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.104980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.106459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.106472Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.106473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.106475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.106478Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2365 [2:7556555437148823529:8189]
2025-10-02T09:34:26.106486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.106497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.106502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.106503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.106504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.106513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.106516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.106520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.106552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.106557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.106558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.106559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.106561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.106618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.106626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.106633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.106638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.106647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.106658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393223:3739], now have 1 active actors on pipe
2025-10-02T09:34:26.106660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393007:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.106664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.106665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.106666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.106674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.106682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.106689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.106682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2365
2025-10-02T09:34:26.106691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.106692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.106693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.106696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.106711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.106693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2365
2025-10-02T09:34:26.106712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.106714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.106724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.106727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.106754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.106761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.106763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.106764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.106769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.106775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.106786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.106881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.106890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.106905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.106984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2366 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0
2025-10-02T09:34:26.107243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|438ce07c-cfc26471-7e26e339-47a6296e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.109828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Write session: try to update token
2025-10-02T09:34:26.109845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.116015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.116029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.116030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.116031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.116034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.116036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.116039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148823523:8189]
2025-10-02T09:34:26.116064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.116064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.116066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.116067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.116069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.116069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.116194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.123463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId: src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.125694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.184220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224393230:4843]
2025-10-02T09:34:26.184404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2365, pipe: [1:7556555437224393230:4843]
2025-10-02T09:34:26.227801Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.228102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.228110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.228123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393230:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.228259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.228257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224393230:4843]
2025-10-02T09:34:26.228275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:26.228277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:26.228317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2366 reason: error at write: Disconnected sessionId: src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0
2025-10-02T09:34:26.228332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.228452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2366 sessionId: src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0 is DEAD
2025-10-02T09:34:26.228621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:26.228634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Write session will restart in 0.005846s
2025-10-02T09:34:26.228659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Write session: Do CDS request
2025-10-02T09:34:26.228665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.235266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.235285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.235292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2367
2025-10-02T09:34:26.235473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.235493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.235497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.235499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.235858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2367 sessionId:  describe result for acl check
2025-10-02T09:34:26.235898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.235905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.235907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.235911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224393352:3724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.236351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224393352:3724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.237551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.238024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224393352:3724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.238859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.238979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.238986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.238992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.239021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.239045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148823731:8197]
2025-10-02T09:34:26.239425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.239617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.239641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.239824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.239856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.239860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.239860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.239861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.239861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.239862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.239862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.239863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.239863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.239864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.239864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.239865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.239868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.239874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.239876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.239878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.239880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.239882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.239884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.239886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.239888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.239890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.239892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.239894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.239898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.239895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224393352:3724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.239902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.239905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.239908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.239910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.239907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224393352:3724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.239913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.239909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224393352:3724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.239915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.239918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.239914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.239920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.239922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.239924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.239927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.239931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.239934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.239936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.239939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.239941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.239944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.239946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.239948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.239950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.239955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.239958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.239963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.239989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.247463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.248961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.248972Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.248974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.248976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.248979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2366 [2:7556555437148823731:8197]
2025-10-02T09:34:26.248986Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.248994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.248996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.248997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.248998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.249006Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.249009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.249016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.249046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.249051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.249052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.249053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.249055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.249091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.249095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.249102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.249107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.249116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.249130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393232:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.249136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393433:3724], now have 1 active actors on pipe
2025-10-02T09:34:26.249139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.249140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.249141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.249148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.249157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.249162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.249164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.249165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.249167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.249169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.249161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2366
2025-10-02T09:34:26.249184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.249179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2366
2025-10-02T09:34:26.249191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.249192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.249210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.249215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.249235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.249241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.249243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.249244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.249249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.249256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.249265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.249352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.249359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.249368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.249429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2367 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0
2025-10-02T09:34:26.249706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d018d95-4e5d4a65-672e6c88-4268f730_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.252278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Write session: try to update token
2025-10-02T09:34:26.252295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.258485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.258497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.258498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.258501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.258505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.258507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.258509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148823726:8197]
2025-10-02T09:34:26.258526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.258532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.258533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.258606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.258615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.258617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.258645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.264649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId: src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.266809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.328690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224393466:4843]
2025-10-02T09:34:26.328830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2366, pipe: [1:7556555437224393466:4843]
2025-10-02T09:34:26.370673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.370961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.370970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.370982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393466:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.371121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.371143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224393466:4843]
2025-10-02T09:34:26.371167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:26.371182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.371217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2367 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0
2025-10-02T09:34:26.371332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2367 sessionId: src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0 is DEAD
2025-10-02T09:34:26.371494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:26.371507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Write session will restart in 0.005157s
2025-10-02T09:34:26.371527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Write session: Do CDS request
2025-10-02T09:34:26.371532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.378186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.378298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.378306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2368
2025-10-02T09:34:26.378437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.378458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.378461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.378463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.378856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2368 sessionId:  describe result for acl check
2025-10-02T09:34:26.378896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.378902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.378904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.378909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224393617:3681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.379340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224393617:3681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.380211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.381165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224393617:3681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.381736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.381848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.381856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.381862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.381890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.381912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148823972:8173]
2025-10-02T09:34:26.382272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.382456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.382480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.382677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.382710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.382714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.382715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.382715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.382716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.382716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.382717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.382718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.382718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.382719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.382719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.382720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.382723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.382729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.382731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.382734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.382736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.382738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.382740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.382738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224393617:3681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.382742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.382744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.382751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224393617:3681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.382746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.382748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.382750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.382753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.382758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.382753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224393617:3681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.382761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.382764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.382758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.382766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.382769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.382771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.382774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.382777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.382780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.382782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.382785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.382787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.382790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.382792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.382794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.382797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.382799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.382802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.382807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.382811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.382815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.382820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.382824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.382843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.390351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.391833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.391845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.391846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.391848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.391851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2367 [2:7556555437148823972:8173]
2025-10-02T09:34:26.391858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.391868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.391872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.391874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.391875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.391883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.391886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.391890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.391920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.391925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.391926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.391928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.391929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.391964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.391968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.391974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.391979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.391987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.392002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393671:3681], now have 1 active actors on pipe
2025-10-02T09:34:26.392006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393468:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.392009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.392010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.392011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.392019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.392027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.392032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.392034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.392036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.392042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.392046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.392060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.392067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.392073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.392133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2367
2025-10-02T09:34:26.392200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2367
2025-10-02T09:34:26.392234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.392240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.392254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.392257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.392259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.392261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.392266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.392271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.392281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.392385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.392391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.392399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.392452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2368 partition: 0 MaxSeqNo: 36 sessionId: src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0
2025-10-02T09:34:26.392701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5bd47db-ad0bf13-793f0db0-5140ab57_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.395320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Write session: try to update token
2025-10-02T09:34:26.395335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.401076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.401086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.401088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.401088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.401092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.401096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.401098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148823967:8173]
2025-10-02T09:34:26.401115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.401120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.401121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.401122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.401123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.401124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.401515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.408091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId: src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.410213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.471664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224393681:4843]
2025-10-02T09:34:26.471853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2367, pipe: [1:7556555437224393681:4843]
2025-10-02T09:34:26.510941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.511184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.511193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.511205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393681:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.511354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.511405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.511464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224393681:4843]
2025-10-02T09:34:26.511497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:26.511579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2368 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0
2025-10-02T09:34:26.511726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2368 sessionId: src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0 is DEAD
2025-10-02T09:34:26.511872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:26.511886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Write session will restart in 0.006891s
2025-10-02T09:34:26.511912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Write session: Do CDS request
2025-10-02T09:34:26.511917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.520179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.520267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.520278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2369
2025-10-02T09:34:26.520422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.520444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.520450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.520453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.520664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.520785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2369 sessionId:  describe result for acl check
2025-10-02T09:34:26.520836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.520843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.520844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.520849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224393849:3660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.521285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224393849:3660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.521950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.522114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.522120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.522127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.522160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.522186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148824176:8159]
2025-10-02T09:34:26.522538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.522694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.522717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.522705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224393849:3660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.522892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.522920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.522924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.522925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.522925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.522926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.522927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.522927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.522928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.522928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.522929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.522929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.522930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.522933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.522942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.522945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.522949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.522952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.522955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.522958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.522961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.522964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.522967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.522970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.522973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.522978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.522984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.522992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.522996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.523003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.523006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.523008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.523011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.523013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.523016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.523018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.523021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.523023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.523026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.523028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.523031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.523033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.523036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.523038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.523041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.523043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.523046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.523048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.523050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.523067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.526976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224393849:3660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.526989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224393849:3660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.526991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224393849:3660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.526998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.530451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.532066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.532077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.532078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.532080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.532084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2368 [2:7556555437148824176:8159]
2025-10-02T09:34:26.532090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.532100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.532102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.532103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.532104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.532115Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.532121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.532125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.532155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.532160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.532162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.532163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.532164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.532198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.532203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.532210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.532215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.532223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.532237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393888:3660], now have 1 active actors on pipe
2025-10-02T09:34:26.532243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393682:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.532247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.532248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.532249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.532257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.532266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.532269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.532271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.532272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.532275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.532276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.532269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2368
2025-10-02T09:34:26.532290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.532295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.532296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.532305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.532310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.532298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2368
2025-10-02T09:34:26.532339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.532346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.532348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.532349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.532354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.532361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.532370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.532451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.532456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.532463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.532509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2369 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0
2025-10-02T09:34:26.532830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60710e9c-bab04aab-6f3072ae-b5d305ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.535412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Write session: try to update token
2025-10-02T09:34:26.535427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.541351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.541363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.541364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.541365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.541369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.541371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.541373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148824171:8159]
2025-10-02T09:34:26.541392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.541398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.541399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.541400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.541402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.541404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.541509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.547770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId: src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.549963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.611745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224393899:4843]
2025-10-02T09:34:26.611900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2368, pipe: [1:7556555437224393899:4843]
2025-10-02T09:34:26.649980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.650216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.650225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.650236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393899:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.650382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.650416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:26.650423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:26.650469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224393899:4843]
2025-10-02T09:34:26.650475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2369 reason: error at write: Disconnected sessionId: src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0
2025-10-02T09:34:26.650503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.650614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2369 sessionId: src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0 is DEAD
2025-10-02T09:34:26.650950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:26.650966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Write session will restart in 0.009325s
2025-10-02T09:34:26.650987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Write session: Do CDS request
2025-10-02T09:34:26.650992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.659510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.660814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.660991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.660998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.661005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.661044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.661074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148824382:8171]
2025-10-02T09:34:26.661151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.661359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.661367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2370
2025-10-02T09:34:26.661435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.661482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.661501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.661505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.661508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.661644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.661683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.661854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2370 sessionId:  describe result for acl check
2025-10-02T09:34:26.661889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.661890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.661896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.661900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.661904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224394070:3647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.661918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.661922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.661922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.661923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.661923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.661924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.661924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.661925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.661925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.661926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.661926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.661926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.661930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.661937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.661939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.661941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.661943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.661945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.661947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.661949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.661951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.661953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.661955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.661957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.661960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.661965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.661968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.661971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.661973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.661976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.661978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.661981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.661983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.661986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.661988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.661991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.661993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.661996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.661998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.662000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.662003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.662005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.662007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.662012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.662014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.662018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.662020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.662023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.662040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.662261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224394070:3647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.663900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224394070:3647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.668238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224394070:3647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.668249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224394070:3647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.668252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224394070:3647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.668257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.669440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.670921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.670933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.670935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.670937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.670940Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2369 [2:7556555437148824382:8171]
2025-10-02T09:34:26.670948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.670958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.670964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.670965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.670966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.670975Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.670978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.670982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.671023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.671027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.671028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.671030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.671031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.671070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.671076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.671082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.671087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.671095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.671110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224393900:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.671115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394107:3647], now have 1 active actors on pipe
2025-10-02T09:34:26.671119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.671121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.671122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.671130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.671140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.671124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2369
2025-10-02T09:34:26.671143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.671145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.671147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.671149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.671151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.671170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.671177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.671183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.671182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2369
2025-10-02T09:34:26.671211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.671217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.671230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.671236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.671239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.671240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.671244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.671251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.671259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.671347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.671352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.671359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.671417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2370 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0
2025-10-02T09:34:26.671711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d1effe-ff2b35c9-71b221d5-aa43001d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.674271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Write session: try to update token
2025-10-02T09:34:26.674284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.684183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:26.684198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.684203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.684226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:26.684231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:26.684603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:26.684973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:26.685095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:26.685213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:26.685366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:26.685390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:26.686791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId: src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.688609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.688622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.688623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.688624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.688631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.688633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.688635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148824377:8171]
2025-10-02T09:34:26.688653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.688657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.688659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.688660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.688661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.688662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.688767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.688965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.750505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224394115:4843]
2025-10-02T09:34:26.750701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2369, pipe: [1:7556555437224394115:4843]
2025-10-02T09:34:26.797858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.798136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.798145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.798157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394115:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.798318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.798303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:26.798310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:26.798359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2370 reason: error at write: Disconnected sessionId: src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0
2025-10-02T09:34:26.798364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.798418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224394115:4843]
2025-10-02T09:34:26.798492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2370 sessionId: src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0 is DEAD
2025-10-02T09:34:26.798656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:26.798672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Write session will restart in 0.007138s
2025-10-02T09:34:26.798694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Write session: Do CDS request
2025-10-02T09:34:26.798699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.807062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.807151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.807236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.807243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2371
2025-10-02T09:34:26.807346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.807366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.807370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.807372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.807724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2371 sessionId:  describe result for acl check
2025-10-02T09:34:26.807761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.807768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.807769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.807773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224394285:3636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.808240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224394285:3636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.808426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.808533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.808540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.808546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.808574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.808675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148824589:8169]
2025-10-02T09:34:26.809027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.809209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.809235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.809410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.809438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.809442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.809442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.809443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.809443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.809444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.809445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.809445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.809446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.809446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.809447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.809447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.809450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.809456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.809458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.809461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.809462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.809464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.809467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.809468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.809470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.809472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.809474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.809476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.809480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.809483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.809487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.809490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.809492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.809495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.809497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.809499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.809502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.809504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.809506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.809509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.809512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.809515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.809517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.809520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.809522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.809525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.809527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.809529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.809532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.809535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.809537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.809540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.809557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.809775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224394285:3636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.814315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224394285:3636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.814328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224394285:3636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.814330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224394285:3636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.814335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.816970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.818589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.818599Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.818600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.818602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.818605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2370 [2:7556555437148824589:8169]
2025-10-02T09:34:26.818613Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.818622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.818627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.818629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.818630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.818639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.818642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.818647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.818677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.818682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.818683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.818684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.818685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.818757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.818762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.818769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.818775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.818787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.818801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394116:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.818807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394324:3636], now have 1 active actors on pipe
2025-10-02T09:34:26.818811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.818813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.818814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.818818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.818826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.818808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2370
2025-10-02T09:34:26.818834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.818820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2370
2025-10-02T09:34:26.818833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.818835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.818836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.818837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.818860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.818862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.818869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.818874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.818888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.818895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.818900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.818902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.818903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.818909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.818917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.818930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.819013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.819017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.819025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.819080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2371 partition: 0 MaxSeqNo: 36 sessionId: src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0
2025-10-02T09:34:26.819351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb8ed-ad4c18b7-41348f15-23edd263_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.821907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Write session: try to update token
2025-10-02T09:34:26.821923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.828072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.828084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.828085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.828086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.828090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.828092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.828095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148824584:8169]
2025-10-02T09:34:26.828114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.828118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.828120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.828121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.828121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.828123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.828234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.834030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId: src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.836154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:26.898451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555437224394339:4843]
2025-10-02T09:34:26.898581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2370, pipe: [1:7556555437224394339:4843]
2025-10-02T09:34:26.936536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:26.936747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.936756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.936769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394339:4843], now have 1 active actors on pipe
2025-10-02T09:34:26.936951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555437224394339:4843]
2025-10-02T09:34:26.936988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:26.936990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:26.937057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2371 reason: error at write: Disconnected sessionId: src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0
2025-10-02T09:34:26.937070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:26.937073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:26.937203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2371 sessionId: src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0 is DEAD
2025-10-02T09:34:26.937326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:26.937341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Write session will restart in 0.008109s
2025-10-02T09:34:26.937369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Write session: Do CDS request
2025-10-02T09:34:26.937375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:26.946005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:26.946132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.946205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:26.946214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2372
2025-10-02T09:34:26.946342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:26.946362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:26.946368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:26.946371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:26.946646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2372 sessionId:  describe result for acl check
2025-10-02T09:34:26.946665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:26.946669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:26.946670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:26.946673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555437224394513:3618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:26.947020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555437224394513:3618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:26.947313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:26.947420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:26.947427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:26.947433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:26.947460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:26.947482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555437148824798:8167]
2025-10-02T09:34:26.947817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:26.947991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:26.948012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:26.948181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:26.948210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.948211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.948212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.948212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.948213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.948213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.948214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.948214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.948215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.948215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.948216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.948217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.948220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.948225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.948227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.948229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.948231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.948233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.948235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.948237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.948240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.948242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.948244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.948246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.948250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.948254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:26.948257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.948260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:26.948262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.948264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:26.948267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.948269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:26.948271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.948274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:26.948276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.948279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:26.948281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.948284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:26.948286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.948288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:26.948290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.948293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:26.948295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.948298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.948300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.948303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.948305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.948308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.948323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:26.948634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555437224394513:3618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:26.953156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555437224394513:3618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:26.953167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555437224394513:3618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:26.953170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555437224394513:3618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:26.953175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:26.955766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:26.957330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:26.957342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:26.957343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:26.957345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:26.957348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2371 [2:7556555437148824798:8167]
2025-10-02T09:34:26.957357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:26.957367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:26.957369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.957370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.957371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.957381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:26.957384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:26.957390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:26.957423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.957428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.957429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.957431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:26.957432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:26.957470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:26.957474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.957481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:26.957486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:26.957494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:26.957508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394552:3618], now have 1 active actors on pipe
2025-10-02T09:34:26.957514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555437224394340:2446], now have 1 active actors on pipe
2025-10-02T09:34:26.957518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.957519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.957520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.957528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:26.957540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:26.957540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:26.957542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:26.957544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:26.957549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:26.957551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:26.957544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2371
2025-10-02T09:34:26.957563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.957568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:26.957546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2371
2025-10-02T09:34:26.957570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:26.957582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.957587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.957608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:26.957615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:26.957617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:26.957618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:26.957623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:26.957630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:26.957640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.957722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:26.957727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:26.957734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:26.957789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2372 partition: 0 MaxSeqNo: 36 sessionId: src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0
2025-10-02T09:34:26.958051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb038a5-1cc9b56d-f602b60c-e5ce36ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:26.960569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Write session: try to update token
2025-10-02T09:34:26.960581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:26.966627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:26.966638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:26.966639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:26.966640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:26.966644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.966646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.966648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555437148824793:8167]
2025-10-02T09:34:26.966666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:26.966670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:26.966672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:26.966673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:26.966674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:26.966675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:26.966848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:26.973063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId: src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:26.975194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.037206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519361855:4843]
2025-10-02T09:34:27.037344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2371, pipe: [1:7556555441519361855:4843]
2025-10-02T09:34:27.075014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.075369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.075378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.075390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519361855:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.075511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.075634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:27.075641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:27.075705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2372 reason: error at write: Disconnected sessionId: src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0
2025-10-02T09:34:27.075704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.075762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519361855:4843]
2025-10-02T09:34:27.075834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2372 sessionId: src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0 is DEAD
2025-10-02T09:34:27.075998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:27.076011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Write session will restart in 0.007066s
2025-10-02T09:34:27.076031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Write session: Do CDS request
2025-10-02T09:34:27.076037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.084134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.084242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.084248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2373
2025-10-02T09:34:27.084360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.084379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.084384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.084387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.084654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2373 sessionId:  describe result for acl check
2025-10-02T09:34:27.084672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.084673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.084675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.084677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519362027:3598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.084856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.085042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519362027:3598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.086132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.086228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.086235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.086241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.086266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.086290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443792317:8165]
2025-10-02T09:34:27.086377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519362027:3598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.086655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.086814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.086838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.087013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.087041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.087045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.087046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.087046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.087047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.087047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.087048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.087048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.087049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.087049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.087050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.087050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.087053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.087059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.087061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.087063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.087065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.087067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.087069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.087071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.087073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.087075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.087077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.087079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.087083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.087087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.087090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.087093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.087097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.087099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.087101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.087104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.087106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.087108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.087110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.087113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.087115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.087118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.087120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.087122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.087125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.087127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.087130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.087133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.087135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.087137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.087143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.087145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.087161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.091058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519362027:3598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.091069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519362027:3598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.091071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519362027:3598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.091076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.094563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.096099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.096109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.096110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.096112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.096115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2372 [2:7556555441443792317:8165]
2025-10-02T09:34:27.096122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.096131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.096132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.096134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.096135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.096143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.096150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.096154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.096185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.096190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.096191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.096193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.096194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.096230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.096235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.096241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.096246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.096254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.096265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362079:3598], now have 1 active actors on pipe
2025-10-02T09:34:27.096271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519361857:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.096275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.096276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.096278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.096284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.096292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.096297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.096299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.096300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.096302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.096298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2372
2025-10-02T09:34:27.096303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.096317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.096319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.096314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2372
2025-10-02T09:34:27.096321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.096335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.096340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.096358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.096364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.096366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.096367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.096372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.096377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.096385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.096465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.096470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.096477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.096535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2373 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0
2025-10-02T09:34:27.096784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d6ae55-ccdb69a-f8c8b0c5-bef7affe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.099348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Write session: try to update token
2025-10-02T09:34:27.099363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.105359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.105371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.105372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.105373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.105379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.105381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.105383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443792312:8165]
2025-10-02T09:34:27.105401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.105404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.105405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.105405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.105408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.105410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.105516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.111469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId: src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.113583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.175954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519362086:4843]
2025-10-02T09:34:27.176108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2372, pipe: [1:7556555441519362086:4843]
2025-10-02T09:34:27.214107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.214384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.214393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.214404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362086:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.214547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519362086:4843]
2025-10-02T09:34:27.214633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.214721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:27.214728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:27.214762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2373 reason: error at write: Disconnected sessionId: src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0
2025-10-02T09:34:27.214891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2373 sessionId: src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0 is DEAD
2025-10-02T09:34:27.214931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.215047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:27.215060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Write session will restart in 0.008190s
2025-10-02T09:34:27.215095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Write session: Do CDS request
2025-10-02T09:34:27.215100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.223849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.224157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.224261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.224269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2374
2025-10-02T09:34:27.224381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.224401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.224407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.224409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.224748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2374 sessionId:  describe result for acl check
2025-10-02T09:34:27.224785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.224792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.224793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.224798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519362259:3582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.225188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.225255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519362259:3582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.225361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.225369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.225374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.225407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.225438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443792527:8163]
2025-10-02T09:34:27.225785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.225955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.225978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.226154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.226181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.226185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.226186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.226186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.226187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.226187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.226188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.226188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.226189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.226189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.226190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.226190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.226193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.226199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.226202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.226204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.226206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.226208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.226210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.226212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.226214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.226216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.226218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.226220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.226223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.226227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.226230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.226233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.226237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.226240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.226243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.226245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.226248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.226251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.226253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.226255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.226258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.226260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.226262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.226266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.226268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.226271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.226273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.226276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.226278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.226281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.226283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.226285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.226302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.226541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519362259:3582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.231103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519362259:3582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.231115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519362259:3582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.231120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519362259:3582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.231125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.233742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.235269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.235279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.235280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.235282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.235286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2373 [2:7556555441443792527:8163]
2025-10-02T09:34:27.235292Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.235302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.235304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.235305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.235306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.235315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.235317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.235322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.235353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.235358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.235359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.235361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.235363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.235398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.235403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.235409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.235414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.235422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.235433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362087:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.235439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362299:3582], now have 1 active actors on pipe
2025-10-02T09:34:27.235443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.235444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.235446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.235453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.235461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.235465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.235467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.235468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.235471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.235472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.235485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.235467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2373
2025-10-02T09:34:27.235486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.235488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.235487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2373
2025-10-02T09:34:27.235507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.235512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.235527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.235533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.235535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.235536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.235542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.235546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.235554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.235639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.235643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.235651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.235700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2374 partition: 0 MaxSeqNo: 36 sessionId: src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0
2025-10-02T09:34:27.235937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c885ff4-6cd2807c-b5361d4b-6146a946_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.238435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Write session: try to update token
2025-10-02T09:34:27.238449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.244578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.244590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.244591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.244592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.244597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.244600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.244602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443792522:8163]
2025-10-02T09:34:27.244620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.244621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.244624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.244625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.244626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.244626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.244730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.250945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId: src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.253041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.314701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519362308:4843]
2025-10-02T09:34:27.314819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2373, pipe: [1:7556555441519362308:4843]
2025-10-02T09:34:27.353698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.353912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.353923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.353939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362308:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.354126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:27.354140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:27.354201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2374 reason: error at write: Disconnected sessionId: src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0
2025-10-02T09:34:27.354318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.354346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2374 sessionId: src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0 is DEAD
2025-10-02T09:34:27.354501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:27.354521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Write session will restart in 0.009849s
2025-10-02T09:34:27.354547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Write session: Do CDS request
2025-10-02T09:34:27.354534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.354553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.354597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519362308:4843]
2025-10-02T09:34:27.363104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.364387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.364484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.364490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.364496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.364522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.364544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443792775:8138]
2025-10-02T09:34:27.364894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.365061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.365083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.365138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.365179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.365188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2375
2025-10-02T09:34:27.365258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.365285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.365289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.365290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.365291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.365291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.365292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.365292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.365293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.365293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.365294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.365294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.365309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.365295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.365298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.365304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.365306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.365308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.365310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.365312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.365326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.365314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.365332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.365334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.365316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.365318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.365320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.365322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.365324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.365327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.365331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.365334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.365337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.365339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.365342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.365344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.365346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.365349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.365351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.365353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.365355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.365357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.365360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.365362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.365365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.365367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.365369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.365371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.365374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.365378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.365380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.365382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.365385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.365400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.365584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2375 sessionId:  describe result for acl check
2025-10-02T09:34:27.365603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.365607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.365608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.365611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519362511:3534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.366050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519362511:3534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.367303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519362511:3534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.372144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519362511:3534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.372154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519362511:3534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.372157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519362511:3534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.372162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.372904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.374445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.374457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.374458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.374460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.374463Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2374 [2:7556555441443792775:8138]
2025-10-02T09:34:27.374470Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.374480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.374483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.374485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.374486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.374494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.374499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.374502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.374534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.374539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.374540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.374542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.374543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.374588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.374592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.374599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.374604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.374611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.374622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362543:3534], now have 1 active actors on pipe
2025-10-02T09:34:27.374628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362322:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.374632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.374633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.374634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.374641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.374649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.374642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2374
2025-10-02T09:34:27.374657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2374
2025-10-02T09:34:27.374660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.374663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.374669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.374677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.374678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.374684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.374686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.374694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.374702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.374715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.374718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|373e3eaa-ce13d004-8a9b298-77174124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.374721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.374723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.374724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.374729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.374734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.374745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.374834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.374839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.374846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.374893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2375 partition: 0 MaxSeqNo: 36 sessionId: src_id|373e3eaa-ce13d004-8a9b298-77174124_0
2025-10-02T09:34:27.375151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42718f20-1ed4b958-4f937db-dcfa11f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|373e3eaa-ce13d004-8a9b298-77174124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.377769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Write session: try to update token
2025-10-02T09:34:27.377780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.384440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.384456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.384457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.384458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.384463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.384466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.384468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443792770:8138]
2025-10-02T09:34:27.384487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.384492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.384493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.384494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.384496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.384498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.384614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.390247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId: src_id|373e3eaa-ce13d004-8a9b298-77174124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.392388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.454500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519362551:4843]
2025-10-02T09:34:27.454648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2374, pipe: [1:7556555441519362551:4843]
2025-10-02T09:34:27.492182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.492445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.492454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.492466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362551:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.492639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519362551:4843]
2025-10-02T09:34:27.492659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.492881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:27.492894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:27.492929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.492951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2375 reason: error at write: Disconnected sessionId: src_id|373e3eaa-ce13d004-8a9b298-77174124_0
2025-10-02T09:34:27.493106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2375 sessionId: src_id|373e3eaa-ce13d004-8a9b298-77174124_0 is DEAD
2025-10-02T09:34:27.493248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:27.493256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Write session will restart in 0.006889s
2025-10-02T09:34:27.493272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Write session: Do CDS request
2025-10-02T09:34:27.493277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.501163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.501274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.501282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2376
2025-10-02T09:34:27.501384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.501404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.501410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.501412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.501816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2376 sessionId:  describe result for acl check
2025-10-02T09:34:27.501842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.501845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.501847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.501850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519362725:3523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.501960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.502190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519362725:3523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.503237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.503387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.503395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.503402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.503431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.503454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443792987:8132]
2025-10-02T09:34:27.503636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519362725:3523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.503795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.503965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.503988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.504164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.504193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.504196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.504197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.504197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.504198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.504199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.504199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.504200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.504200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.504201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.504201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.504202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.504204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.504210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.504212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.504214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.504216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.504218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.504220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.504222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.504224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.504226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.504228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.504230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.504233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.504237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.504240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.504243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.504245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.504248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.504250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.504252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.504255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.504257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.504259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.504262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.504264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.504266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.504269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.504272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.504274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.504276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.504280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.504282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.504284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.504287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.504289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.504291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.504307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.508211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519362725:3523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.508223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519362725:3523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.508226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519362725:3523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.508230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.511895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.513402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.513412Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.513413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.513415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.513419Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2375 [2:7556555441443792987:8132]
2025-10-02T09:34:27.513425Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.513434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.513435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.513437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.513438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.513446Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.513451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.513455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.513483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.513488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.513489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.513492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.513493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.513530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.513535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.513541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.513546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.513555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.513567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362764:3523], now have 1 active actors on pipe
2025-10-02T09:34:27.513571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362552:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.513574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.513576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.513577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.513581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.513588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.513591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.513594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.513595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.513596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.513596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.513609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.513598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2375
2025-10-02T09:34:27.513612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.513618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.513622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.513622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2375
2025-10-02T09:34:27.513624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.513648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.513655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.513657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.513658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.513663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.513669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.513679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.513763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.513769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.513777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.513836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2376 partition: 0 MaxSeqNo: 36 sessionId: src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0
2025-10-02T09:34:27.514043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373e3eaa-ce13d004-8a9b298-77174124_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.516599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Write session: try to update token
2025-10-02T09:34:27.516611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.523490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.523504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.523506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.523507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.523513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.523516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.523518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443792981:8132]
2025-10-02T09:34:27.523541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.523546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.523547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.523548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.523549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.523551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.523655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.528167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId: src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.530280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.592742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519362772:4843]
2025-10-02T09:34:27.592901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2375, pipe: [1:7556555441519362772:4843]
2025-10-02T09:34:27.633526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.633798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.633807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.633830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362772:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.634005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:27.634018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:27.634042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519362772:4843]
2025-10-02T09:34:27.634069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.634069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2376 reason: error at write: Disconnected sessionId: src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0
2025-10-02T09:34:27.634198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2376 sessionId: src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0 is DEAD
2025-10-02T09:34:27.634204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.634337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:27.634346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Write session will restart in 0.008888s
2025-10-02T09:34:27.634364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Write session: Do CDS request
2025-10-02T09:34:27.634369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.642720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.644183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.644209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.644300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.644306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.644312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.644328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.644339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.644336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2377
2025-10-02T09:34:27.644366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443793200:8136]
2025-10-02T09:34:27.644443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.644462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.644468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.644470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.644708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.644835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2377 sessionId:  describe result for acl check
2025-10-02T09:34:27.644872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.644881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.644879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.644881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.644885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519362950:3510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.644903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.645180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.645219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.645223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.645224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.645224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.645225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.645225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.645226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.645226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.645226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.645227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.645228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.645228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.645231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.645238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.645239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.645241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.645243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.645245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.645247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.645249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.645251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.645254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.645256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.645258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.645261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.645265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.645268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.645271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.645273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.645276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.645278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.645280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.645282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.645285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.645287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.645289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.645293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.645295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.645297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.645300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.645302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.645305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.645307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.645309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.645311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.645310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519362950:3510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.645314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.645316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.645318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.645334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.646911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519362950:3510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.651495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519362950:3510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.651506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519362950:3510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.651509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519362950:3510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.651514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.652690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.654207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.654220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.654221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.654223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.654227Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2376 [2:7556555441443793200:8136]
2025-10-02T09:34:27.654234Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.654244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.654246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.654247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.654248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.654257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.654264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.654268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.654300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.654304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.654305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.654307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.654308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.654343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.654347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.654353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.654359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.654370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.654384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362987:3510], now have 1 active actors on pipe
2025-10-02T09:34:27.654390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362773:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.654393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.654395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.654396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.654403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.654412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.654416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.654418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.654419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.654422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.654424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.654421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2376
2025-10-02T09:34:27.654437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.654442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.654451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.654452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.654454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.654451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2376
2025-10-02T09:34:27.654478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.654485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.654487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.654489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.654493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.654499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.654508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.654602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.654607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.654614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.654676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2377 partition: 0 MaxSeqNo: 36 sessionId: src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0
2025-10-02T09:34:27.654858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|561dc0f9-c90042f9-98e054f0-67e3e565_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.657319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Write session: try to update token
2025-10-02T09:34:27.657329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.664015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.664030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.664031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.664032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.664036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.664039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.664041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443793195:8136]
2025-10-02T09:34:27.664063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.664065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.664066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.664068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.664068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.664070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.664172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.669057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId: src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.671144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.734165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519362995:4843]
2025-10-02T09:34:27.734308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2376, pipe: [1:7556555441519362995:4843]
2025-10-02T09:34:27.774781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.775052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.775062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.775088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362995:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.775205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.775253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519362995:4843]
2025-10-02T09:34:27.775273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.775301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:27.775397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2377 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0
2025-10-02T09:34:27.775546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2377 sessionId: src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0 is DEAD
2025-10-02T09:34:27.775815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:27.775825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Write session will restart in 0.009590s
2025-10-02T09:34:27.775840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Write session: Do CDS request
2025-10-02T09:34:27.775844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.784627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.786027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.786118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.786222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.786229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.786237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.786211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.786222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2378
2025-10-02T09:34:27.786269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.786296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443793414:8133]
2025-10-02T09:34:27.786315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.786336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.786342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.786344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.786627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2378 sessionId:  describe result for acl check
2025-10-02T09:34:27.786649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.786653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.786654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.786657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519363172:3488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.786653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.786793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.786816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.786990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.787011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519363172:3488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.787019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.787023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.787024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.787024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.787025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.787026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.787026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.787027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.787027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.787028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.787028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.787029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.787032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.787038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.787040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.787042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.787044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.787046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.787048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.787050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.787052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.787055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.787057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.787059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.787062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.787066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.787069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.787072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.787074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.787077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.787079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.787082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.787084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.787087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.787090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.787092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.787095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.787097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.787099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.787102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.787104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.787106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.787113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.787115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.787118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.787121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.787123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.787126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.787144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.788716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519363172:3488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.793306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519363172:3488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.793319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519363172:3488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.793321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519363172:3488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.793326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.794479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.796004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.796015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.796016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.796018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.796021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2377 [2:7556555441443793414:8133]
2025-10-02T09:34:27.796027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.796036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.796037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.796039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.796040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.796049Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.796056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.796060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.796090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.796095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.796096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.796098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.796099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.796134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.796139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.796145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.796150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.796158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.796172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519363211:3488], now have 1 active actors on pipe
2025-10-02T09:34:27.796177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519362996:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.796181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.796182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.796183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.796191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.796198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.796203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.796205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.796206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.796210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.796211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.796224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.796213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2377
2025-10-02T09:34:27.796228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.796218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2377
2025-10-02T09:34:27.796240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.796246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.796248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.796264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.796271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.796273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.796274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.796278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.796283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.796290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.796377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.796382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.796390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.796461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2378 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0
2025-10-02T09:34:27.796634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b438ea-f3e74b1e-d96b1436-b57a86f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.799085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Write session: try to update token
2025-10-02T09:34:27.799095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.805357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.805371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.805373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.805374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.805379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.805381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.805384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443793409:8133]
2025-10-02T09:34:27.805405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.805408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.805409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.805413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.805415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.805418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.805522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.809925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId: src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.811913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:27.875363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555441519363221:4843]
2025-10-02T09:34:27.875503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2377, pipe: [1:7556555441519363221:4843]
2025-10-02T09:34:27.914489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:27.914762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.914771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.914795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519363221:4843], now have 1 active actors on pipe
2025-10-02T09:34:27.914921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:27.914940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555441519363221:4843]
2025-10-02T09:34:27.914962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:27.914979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:27.915164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2378 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0
2025-10-02T09:34:27.915309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2378 sessionId: src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0 is DEAD
2025-10-02T09:34:27.915453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:27.915464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Write session will restart in 0.009749s
2025-10-02T09:34:27.915490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Write session: Do CDS request
2025-10-02T09:34:27.915496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:27.924274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:27.925593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:27.925749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:27.925756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:27.925762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:27.925793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:27.925817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555441443793629:8127]
2025-10-02T09:34:27.926185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:27.926255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.926341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:27.926364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:27.926361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:27.926373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2379
2025-10-02T09:34:27.926492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:27.926513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:27.926520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:27.926523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:27.926546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:27.926583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.926587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.926587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.926588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.926588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.926589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.926589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.926590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.926590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.926591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.926592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.926592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.926595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.926601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.926603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.926605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.926607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.926609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.926611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.926613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.926615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.926617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.926619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.926621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.926625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.926629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:27.926632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.926635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:27.926637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.926641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:27.926643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.926646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:27.926648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.926651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:27.926654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.926656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:27.926660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.926663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:27.926665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.926667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:27.926669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.926672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:27.926674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.926677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.926679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.926681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.926683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.926686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.926703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:27.926807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2379 sessionId:  describe result for acl check
2025-10-02T09:34:27.926833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:27.926838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:27.926839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:27.926842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555441519363409:3482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:27.927182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555441519363409:3482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:27.928664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555441519363409:3482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:27.932953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555441519363409:3482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:27.932965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555441519363409:3482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:27.932968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555441519363409:3482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:27.932974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:27.934049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:27.935674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:27.935685Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:27.935686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:27.935688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:27.935692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2378 [2:7556555441443793629:8127]
2025-10-02T09:34:27.935698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:27.935708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:27.935713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.935714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.935715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.935724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:27.935728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:27.935733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:27.935762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.935767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.935768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.935770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:27.935771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:27.935807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:27.935812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.935818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:27.935823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:27.935831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:27.935844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519363443:3482], now have 1 active actors on pipe
2025-10-02T09:34:27.935850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555441519363227:2446], now have 1 active actors on pipe
2025-10-02T09:34:27.935854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.935855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.935856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.935863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:27.935870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:27.935876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:27.935877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:27.935879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:27.935881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:27.935882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:27.935896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.935899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:27.935900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:27.935909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.935911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.935885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2378
2025-10-02T09:34:27.935910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2378
2025-10-02T09:34:27.935935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37007255-8523ff81-3d65f23f-2d120f32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:27.935942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:27.935944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:27.935945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:27.935950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:27.935955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:27.935964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.936053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:27.936058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:27.936065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:27.936119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2379 partition: 0 MaxSeqNo: 36 sessionId: src_id|37007255-8523ff81-3d65f23f-2d120f32_0
2025-10-02T09:34:27.936326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f110dfe-380d82ca-f247f8f0-4dc2a55e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37007255-8523ff81-3d65f23f-2d120f32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:27.938839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Write session: try to update token
2025-10-02T09:34:27.938853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:27.944953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:27.944966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:27.944967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:27.944968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:27.944975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.944977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.944979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555441443793624:8127]
2025-10-02T09:34:27.945000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:27.945001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:27.945004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:27.945006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:27.945007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:27.945008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:27.945116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:27.950706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId: src_id|37007255-8523ff81-3d65f23f-2d120f32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:27.952956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.015126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814330749:4843]
2025-10-02T09:34:28.015300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2378, pipe: [1:7556555445814330749:4843]
2025-10-02T09:34:28.054194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.054483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.054492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.054504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814330749:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.054643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.054643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814330749:4843]
2025-10-02T09:34:28.054664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.054712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:28.054716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:28.054796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2379 reason: error at write: Disconnected sessionId: src_id|37007255-8523ff81-3d65f23f-2d120f32_0
2025-10-02T09:34:28.054958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2379 sessionId: src_id|37007255-8523ff81-3d65f23f-2d120f32_0 is DEAD
2025-10-02T09:34:28.055094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:28.055103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Write session will restart in 0.008357s
2025-10-02T09:34:28.055129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Write session: Do CDS request
2025-10-02T09:34:28.055134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.064086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.064247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.064297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.064307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2380
2025-10-02T09:34:28.064448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.064471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.064479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.064482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.064858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2380 sessionId:  describe result for acl check
2025-10-02T09:34:28.064892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.064897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.064898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.064907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814330929:3459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.065264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.065370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.065376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.065382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.065401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814330929:3459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.065409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.065433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738761155:8120]
2025-10-02T09:34:28.065778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.065946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.065968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.066152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.066279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.066285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.066285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.066286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.066286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.066287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.066288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.066288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.066288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.066289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.066290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.066290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.066293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.066300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.066302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.066306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.066308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.066310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.066312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.066314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.066317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.066319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.066321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.066325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.066329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.066332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.066335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.066337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.066340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.066342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.066345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.066347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.066349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.066351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.066354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.066356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.066359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.066361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.066363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.066366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.066370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.066373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.066376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.066378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.066380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.066382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.066385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.066403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.066805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814330929:3459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.071165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814330929:3459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.071175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814330929:3459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.071177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814330929:3459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.071183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.073751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.075257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.075269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.075271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.075273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.075277Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2379 [2:7556555445738761155:8120]
2025-10-02T09:34:28.075285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.075295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.075300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.075302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.075303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.075312Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.075315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.075319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.075350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.075355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.075356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.075358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.075360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.075395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.075400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.075406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.075412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.075420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.075431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814330968:3459], now have 1 active actors on pipe
2025-10-02T09:34:28.075436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814330751:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.075440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.075441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.075443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.075450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.075457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.075462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.075465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.075466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.075460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2379
2025-10-02T09:34:28.075482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2379
2025-10-02T09:34:28.075469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.075470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.075479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.075481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.075483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.075501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.075503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.075519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.075527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.075529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.075530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.075535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.075540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.075547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.075630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.075635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.075642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.075695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2380 partition: 0 MaxSeqNo: 36 sessionId: src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0
2025-10-02T09:34:28.075920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37007255-8523ff81-3d65f23f-2d120f32_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.078366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Write session: try to update token
2025-10-02T09:34:28.078377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.085180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.085191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.085193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.085194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.085198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.085203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.085212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738761150:8120]
2025-10-02T09:34:28.085233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.085239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.085240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.085241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.085244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.085247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.085357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.090206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId: src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.092403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.154916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814330987:4843]
2025-10-02T09:34:28.155078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2379, pipe: [1:7556555445814330987:4843]
2025-10-02T09:34:28.194044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.194456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.194465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.194490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814330987:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.194620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.194669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:28.194730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2380 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0
2025-10-02T09:34:28.194732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814330987:4843]
2025-10-02T09:34:28.194762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.194853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2380 sessionId: src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0 is DEAD
2025-10-02T09:34:28.195011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:28.195025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Write session will restart in 0.008044s
2025-10-02T09:34:28.195049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Write session: Do CDS request
2025-10-02T09:34:28.195054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.203927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.204188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.204252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.204265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2381
2025-10-02T09:34:28.204396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.204418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.204424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.204427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.204761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2381 sessionId:  describe result for acl check
2025-10-02T09:34:28.204796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.204814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.204819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.204823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814331167:3451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.205235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814331167:3451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.205279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.205373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.205380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.205386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.205411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.205433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738761372:8115]
2025-10-02T09:34:28.205776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.205941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.205963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.206136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.206163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.206167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.206168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.206168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.206169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.206169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.206170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.206170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.206171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.206171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.206172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.206172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.206175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.206181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.206183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.206186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.206187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.206189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.206191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.206193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.206195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.206197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.206199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.206201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.206204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.206208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.206211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.206214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.206216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.206219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.206221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.206224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.206226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.206229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.206231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.206233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.206236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.206238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.206240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.206243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.206246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.206248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.206250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.206253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.206256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.206258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.206260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.206262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.206279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.206577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814331167:3451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.211040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814331167:3451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.211050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814331167:3451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.211053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814331167:3451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.211058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.213599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.215189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.215200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.215201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.215203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.215206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2380 [2:7556555445738761372:8115]
2025-10-02T09:34:28.215216Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.215227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.215232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.215233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.215234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.215243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.215246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.215250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.215282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.215287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.215288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.215290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.215291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.215329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.215334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.215340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.215345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.215353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.215362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.215366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.215367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.215374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.215380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.215382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.215387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.215389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.215389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.215391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.215397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331205:3451], now have 1 active actors on pipe
2025-10-02T09:34:28.215399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814330988:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.215413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.215421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.215431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.215439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2380
2025-10-02T09:34:28.215450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2380
2025-10-02T09:34:28.215460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.215465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.215482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.215490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.215492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.215493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.215497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.215504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.215512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.215616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.215621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.215628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.215691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2381 partition: 0 MaxSeqNo: 36 sessionId: src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0
2025-10-02T09:34:28.215900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd2cbbb-7fc3a732-d49b0d27-ed5690e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.218477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Write session: try to update token
2025-10-02T09:34:28.218488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.224305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:28.224319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.224324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.224346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:28.224347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:28.224477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:28.224585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.224697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.224826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.224979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:28.225002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:28.229707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId: src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.231681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.231791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.231800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.231816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:28.231854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:28.232705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.232716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.232717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.232719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.232724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.232727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.232730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738761367:8115]
2025-10-02T09:34:28.232749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.232749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.232751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.232756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.232756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.232757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.232895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.294683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814331215:4843]
2025-10-02T09:34:28.294881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2380, pipe: [1:7556555445814331215:4843]
2025-10-02T09:34:28.342189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.347967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.347988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.348105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.348154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.348205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.348259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.348296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.348302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.348352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.348402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.348455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.348509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.348544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.348551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.348602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.348649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.348699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.348747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.348874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.348880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.348929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.348976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.349026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.349075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.349116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.349121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.349171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.349217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.349268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.349318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.349356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.349361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.349411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.349458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.349507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.349558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.349598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.349603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.349651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.349699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.349747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.349794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.349829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.349834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.349880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.349927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.349972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.350021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.350052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.350057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.350102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.350149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.350195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.350244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.350278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.350282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.350328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.350374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.350425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.350481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.350517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.350522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.350551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331215:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.350735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:28.350745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:28.350762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2381 reason: error at write: Disconnected sessionId: src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0
2025-10-02T09:34:28.350772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814331215:4843]
2025-10-02T09:34:28.350803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.350912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2381 sessionId: src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0 is DEAD
2025-10-02T09:34:28.351049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:28.351059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Write session will restart in 0.005116s
2025-10-02T09:34:28.351074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Write session: Do CDS request
2025-10-02T09:34:28.351078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.351102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.357145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.357236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.357244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2382
2025-10-02T09:34:28.357413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.357439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.357446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.357448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.357771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2382 sessionId:  describe result for acl check
2025-10-02T09:34:28.357796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.357801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.357802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.357806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814331319:3414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.358207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814331319:3414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.359890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814331319:3414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.360321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.361531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.361634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.361641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.361646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.361674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.361697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738761620:8084]
2025-10-02T09:34:28.362036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.362141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814331319:3414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.362151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814331319:3414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.362153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814331319:3414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.362157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.362184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.362208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.362386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.362416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.362420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.362420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.362421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.362421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.362422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.362422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.362423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.362423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.362424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.362424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.362425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.362427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.362433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.362435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.362437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.362439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.362441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.362443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.362446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.362448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.362450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.362452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.362453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.362458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.362462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.362466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.362469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.362471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.362473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.362476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.362478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.362481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.362483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.362485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.362488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.362490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.362493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.362495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.362497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.362501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.362504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.362506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.362512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.362515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.362517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.362521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.362523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.362541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.370081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.371698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.371709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.371710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.371712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.371715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2381 [2:7556555445738761620:8084]
2025-10-02T09:34:28.371723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.371732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.371737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.371739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.371740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.371749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.371752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.371756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.371787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.371792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.371793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.371795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.371796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.371830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.371834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.371841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.371846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.371858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.371871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331216:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.371877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331443:3414], now have 1 active actors on pipe
2025-10-02T09:34:28.371880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.371882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.371883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.371891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.371901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.371903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.371905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.371906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.371910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.371912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.371925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.371930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.371931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.371934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2381
2025-10-02T09:34:28.371965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2381
2025-10-02T09:34:28.371984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.371990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.372003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.372010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.372011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.372013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.372017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.372025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.372032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.372148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.372153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.372160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.372226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2382 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0
2025-10-02T09:34:28.372456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28430aa3-5e684684-e613a5b7-fe7a3736_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.375021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Write session: try to update token
2025-10-02T09:34:28.375030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.380922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:28.380935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.380941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.380964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:28.380968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:28.381097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:28.381215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.381328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.381444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.381599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:28.381623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:28.386385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId: src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.388499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.388624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.388636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.389461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.389473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.389474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.389476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.389480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.389482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.389485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738761614:8084]
2025-10-02T09:34:28.389506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:28.389509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.389512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.389515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.389518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.389520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.389522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.389553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:28.389641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.450852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814331464:4843]
2025-10-02T09:34:28.451008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2381, pipe: [1:7556555445814331464:4843]
2025-10-02T09:34:28.497139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.502704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.502724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.502851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.502900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.502956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.503005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.503046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.503052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.503105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.503153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.503204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.503259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.503295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.503300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.503350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.503401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.503454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.503503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.503542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.503547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.503595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.503648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.503701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.503751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.503791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.503799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.503852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.503900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.503947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.503996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.504030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.504035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.504085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.504132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.504181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.504227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.504264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.504269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.504317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.504362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.504415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.504462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.504514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.504519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.504569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.504615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.504665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.504715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.504748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.504753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.504810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.504856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.504902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.504952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.504987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.504991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.505038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:28.505092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:28.505146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:28.505199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:28.505300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:28.505306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:28.505335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331464:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.505685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.505743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:28.505746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:28.505773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2382 reason: error at write: Disconnected sessionId: src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0
2025-10-02T09:34:28.505781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814331464:4843]
2025-10-02T09:34:28.505917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.505933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2382 sessionId: src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0 is DEAD
2025-10-02T09:34:28.506083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:28.506095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Write session will restart in 0.008960s
2025-10-02T09:34:28.506116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Write session: Do CDS request
2025-10-02T09:34:28.506122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.515609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.516161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.516243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.516252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2383
2025-10-02T09:34:28.516335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.516357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.516360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.516364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.516671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2383 sessionId:  describe result for acl check
2025-10-02T09:34:28.516695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.516701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.516702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.516705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814331646:3371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.517036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.517075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814331646:3371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.517135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.517141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.517147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.517172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.517195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738761846:8081]
2025-10-02T09:34:28.517532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.517685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.517707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.517882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.517909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.517913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.517913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.517914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.517915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.517915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.517916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.517916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.517917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.517917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.517918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.517918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.517921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.517927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.517929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.517931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.517933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.517935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.517937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.517938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.517940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.517942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.517944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.517946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.517950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.517953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.517956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.517959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.517961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.517964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.517966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.517969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.517971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.517973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.517975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.517978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.517980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.517983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.517985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.517988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.517992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.517995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.517997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.518000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.518003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.518005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.518009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.518011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.518029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.518692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814331646:3371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.523841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814331646:3371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.523851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814331646:3371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.523853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814331646:3371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.523859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.525390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.526847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.526858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.526859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.526862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.526865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2382 [2:7556555445738761846:8081]
2025-10-02T09:34:28.526872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.526882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.526887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.526889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.526890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.526899Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.526902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.526906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.526939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.526943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.526944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.526946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.526948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.526986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.526991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.526997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.527002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.527010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.527021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331465:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.527027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331685:3371], now have 1 active actors on pipe
2025-10-02T09:34:28.527031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.527032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.527033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.527041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.527050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.527054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.527056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.527058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.527059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.527061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.527075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.527080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.527089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.527071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2382
2025-10-02T09:34:28.527081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2382
2025-10-02T09:34:28.527102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.527105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.527121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.527129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.527131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.527132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.527137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.527146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.527153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.527248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.527253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.527260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.527314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2383 partition: 0 MaxSeqNo: 36 sessionId: src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0
2025-10-02T09:34:28.527574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f0e9ab-1e73da9e-d6da090a-1020572e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.530427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Write session: try to update token
2025-10-02T09:34:28.530444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.536142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.536155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.536156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.536157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.536161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.536164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.536166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738761841:8081]
2025-10-02T09:34:28.536184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.536188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.536191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.536191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.536192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.536193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.536306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.543197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId: src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.545366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.605978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814331693:4843]
2025-10-02T09:34:28.606154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2382, pipe: [1:7556555445814331693:4843]
2025-10-02T09:34:28.646235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.646610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.646619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.646631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331693:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.646753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.646791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.646823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:28.646854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814331693:4843]
2025-10-02T09:34:28.646873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0
2025-10-02T09:34:28.647016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2383 sessionId: src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0 is DEAD
2025-10-02T09:34:28.647179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:28.647194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Write session will restart in 0.006356s
2025-10-02T09:34:28.647226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Write session: Do CDS request
2025-10-02T09:34:28.647233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.654222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.654309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.654319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2384
2025-10-02T09:34:28.654429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.654451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.654458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.654461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.654879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2384 sessionId:  describe result for acl check
2025-10-02T09:34:28.654918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.654919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.654921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.654925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814331825:3344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.655373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814331825:3344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.656563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.657284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814331825:3344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.657918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.658013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.658020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.658025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.658049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.658073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738762066:8079]
2025-10-02T09:34:28.658409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.658571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.658593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.658766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.658793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.658797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.658798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.658798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.658799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.658799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.658800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.658800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.658801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.658801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.658802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.658802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.658805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.658812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.658814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.658816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.658818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.658820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.658822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.658823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.658825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.658828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.658829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.658831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.658835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.658839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.658842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.658845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.658849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.658851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.658853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.658856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.658860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.658862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.658864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.658867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.658869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.658872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.658874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.658876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.658878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.658881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.658883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.658886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.658889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.658892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.658894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.658897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.658913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.659101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814331825:3344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.659110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814331825:3344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.659116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814331825:3344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.659122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.666266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.667831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.667842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.667843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.667845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.667849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2383 [2:7556555445738762066:8079]
2025-10-02T09:34:28.667856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.667865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.667866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.667868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.667869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.667878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.667884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.667888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.667917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.667922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.667923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.667925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.667927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.667963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.667968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.667974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.667979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.667990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.668005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331694:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.668010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331915:3344], now have 1 active actors on pipe
2025-10-02T09:34:28.668013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.668015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.668016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.668023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.668033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.668036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.668038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.668039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.668043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.668045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.668058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.668063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.668064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.668035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2383
2025-10-02T09:34:28.668085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2383
2025-10-02T09:34:28.668101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.668106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.668120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.668127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.668130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.668131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.668135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.668144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.668151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.668256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.668261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.668268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.668326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2384 partition: 0 MaxSeqNo: 36 sessionId: src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0
2025-10-02T09:34:28.668582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ac70a3-ab84bae8-45a7ce49-7a78d8b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.671394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Write session: try to update token
2025-10-02T09:34:28.671410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.677109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:28.677125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.677129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.677150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:28.677151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:28.677283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:28.677394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.677506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.677621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:28.677782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:28.677806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:28.684132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId: src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.685531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.685544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.685545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.685546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.685551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.685553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.685555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738762061:8079]
2025-10-02T09:34:28.685574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.685577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.685577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.685578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.685579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.685581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.685682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.686422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.746788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814331923:4843]
2025-10-02T09:34:28.746956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2383, pipe: [1:7556555445814331923:4843]
2025-10-02T09:34:28.794597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.794915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.794924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.794937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331923:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.795090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.795115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.795149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:28.795151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:28.795171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814331923:4843]
2025-10-02T09:34:28.795196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2384 reason: error at write: Disconnected sessionId: src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0
2025-10-02T09:34:28.795331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2384 sessionId: src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0 is DEAD
2025-10-02T09:34:28.795479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:28.795487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Write session will restart in 0.008462s
2025-10-02T09:34:28.795508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Write session: Do CDS request
2025-10-02T09:34:28.795513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.804730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.805109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.805231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.805241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2385
2025-10-02T09:34:28.805360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.805382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.805390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.805393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.805763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2385 sessionId:  describe result for acl check
2025-10-02T09:34:28.805798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.805803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.805804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.805809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814332107:3319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.806241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.806239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814332107:3319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.806336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.806343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.806348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.806373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.806397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738762287:8077]
2025-10-02T09:34:28.807042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.807216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.807241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.807560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.807591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.807595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.807596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.807596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.807597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.807598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.807598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.807599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.807599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.807600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.807600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.807601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.807603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.807610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.807612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.807614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.807629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814332107:3319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.807616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.807619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.807621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.807623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.807625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.807627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.807629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.807631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.807635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.807639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.807642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.807645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.807647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.807650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.807652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.807655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.807657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.807660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.807662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.807665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.807667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.807670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.807672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.807675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.807677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.807681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.807683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.807685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.807688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.807690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.807693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.807695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.807712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.812510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814332107:3319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.812520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814332107:3319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.812523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814332107:3319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.812528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.815080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.816694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.816705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.816706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.816708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.816711Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2384 [2:7556555445738762287:8077]
2025-10-02T09:34:28.816717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.816726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.816728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.816729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.816730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.816739Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.816742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.816747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.816781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.816786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.816787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.816789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.816790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.816839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.816843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.816850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.816855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.816866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.816878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814332146:3319], now have 1 active actors on pipe
2025-10-02T09:34:28.816883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814331924:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.816886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.816888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.816889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.816897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.816907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.816911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.816913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.816914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.816917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.816919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.816909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2384
2025-10-02T09:34:28.816932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.816937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.816939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2384
2025-10-02T09:34:28.816944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.816947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.816950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.816984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.816992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.816995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.816996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.817005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.817012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.817026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.817105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.817110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.817117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.817172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2385 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0
2025-10-02T09:34:28.817396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1968d4-f3eb9137-54fe6479-86faf339_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.820128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Write session: try to update token
2025-10-02T09:34:28.820143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.825998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.826010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.826011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.826012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.826016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.826018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.826022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738762282:8077]
2025-10-02T09:34:28.826041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.826043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.826046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.826047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.826048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.826048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.826161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.832577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId: src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.834741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:28.895251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555445814332159:4843]
2025-10-02T09:34:28.895392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2384, pipe: [1:7556555445814332159:4843]
2025-10-02T09:34:28.934655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:28.934951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.934959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.934971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814332159:4843], now have 1 active actors on pipe
2025-10-02T09:34:28.935142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:28.935174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555445814332159:4843]
2025-10-02T09:34:28.935203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:28.935207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:28.935272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2385 reason: error at write: Disconnected sessionId: src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0
2025-10-02T09:34:28.935411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:28.935430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2385 sessionId: src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0 is DEAD
2025-10-02T09:34:28.935541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:28.935551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Write session will restart in 0.006421s
2025-10-02T09:34:28.935575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Write session: Do CDS request
2025-10-02T09:34:28.935580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:28.943192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.943239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:28.943247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2386
2025-10-02T09:34:28.943410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:28.943433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:28.943440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:28.943443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:28.943744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2386 sessionId:  describe result for acl check
2025-10-02T09:34:28.943765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:28.943773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:28.943775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:28.943778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555445814332313:3316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:28.944116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555445814332313:3316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:28.945124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:28.945379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555445814332313:3316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:28.946489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:28.946597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:28.946604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:28.946610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:28.946639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:28.946664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555445738762509:8070]
2025-10-02T09:34:28.947000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:28.947151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:28.947173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:28.947344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:28.947372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.947376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.947377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.947377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.947378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.947378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.947379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.947379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.947380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.947380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.947381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.947381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.947384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.947390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.947392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.947394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.947396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.947398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.947400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.947402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.947404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.947406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.947408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.947410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.947415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.947409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555445814332313:3316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:28.947418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:28.947422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.947418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555445814332313:3316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:28.947424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:28.947420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555445814332313:3316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:28.947427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.947429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:28.947425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:28.947431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.947434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:28.947436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.947439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:28.947441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.947444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:28.947446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.947449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:28.947451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.947454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:28.947456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.947459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:28.947461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.947464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.947466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.947468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.947471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.947473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.947491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:28.954936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:28.956479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:28.956490Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:28.956491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:28.956493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:28.956496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2385 [2:7556555445738762509:8070]
2025-10-02T09:34:28.956505Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:28.956515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:28.956521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.956522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.956523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.956532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:28.956538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:28.956543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:28.956573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.956578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.956579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.956581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:28.956582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:28.956618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:28.956623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.956629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:28.956635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:28.956642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:28.956656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814332384:3316], now have 1 active actors on pipe
2025-10-02T09:34:28.956661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555445814332160:2446], now have 1 active actors on pipe
2025-10-02T09:34:28.956665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.956666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.956667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.956675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:28.956682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:28.956688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:28.956689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:28.956690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:28.956696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:28.956697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:28.956703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.956704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:28.956706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:28.956705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2385
2025-10-02T09:34:28.956740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.956729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2385
2025-10-02T09:34:28.956745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.956762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:28.956768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:28.956770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:28.956771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:28.956776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:28.956782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:28.956790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.956884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:28.956889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:28.956897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:28.956955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2386 partition: 0 MaxSeqNo: 36 sessionId: src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0
2025-10-02T09:34:28.957163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc244487-c6d24e13-10d5f80c-1aac936a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:28.959719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Write session: try to update token
2025-10-02T09:34:28.959729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:28.965934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:28.965950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:28.965952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:28.965953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:28.965957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.965960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.965962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555445738762504:8070]
2025-10-02T09:34:28.965984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:28.965986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:28.965988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:28.965989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:28.965990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:28.965991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:28.966095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:28.971600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId: src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:28.973745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.035554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109299689:4843]
2025-10-02T09:34:29.035688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2385, pipe: [1:7556555450109299689:4843]
2025-10-02T09:34:29.075308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.075501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.075510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.075522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109299689:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.075645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.075628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109299689:4843]
2025-10-02T09:34:29.075645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.075695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:29.075705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:29.075778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2386 reason: error at write: Disconnected sessionId: src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0
2025-10-02T09:34:29.075924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2386 sessionId: src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0 is DEAD
2025-10-02T09:34:29.076063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:29.076074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Write session will restart in 0.005315s
2025-10-02T09:34:29.076090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Write session: Do CDS request
2025-10-02T09:34:29.076095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.082155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.082238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.082250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2387
2025-10-02T09:34:29.082372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.082392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.082396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.082402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.082699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2387 sessionId:  describe result for acl check
2025-10-02T09:34:29.082719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.082723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.082724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.082727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109299811:3297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.083075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109299811:3297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.084823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109299811:3297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.085137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.086470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.086570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.086577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.086583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.086608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.086608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109299811:3297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.086619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109299811:3297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.086621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109299811:3297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.086626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.086630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033730043:8074]
2025-10-02T09:34:29.086981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.087138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.087161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.087339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.087368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.087372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.087372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.087374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.087374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.087375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.087375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.087376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.087376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.087377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.087377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.087380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.087386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.087388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.087390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.087392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.087394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.087396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.087398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.087400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.087403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.087404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.087406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.087410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.087413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.087417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.087420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.087422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.087425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.087427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.087430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.087432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.087435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.087437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.087439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.087445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.087448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.087450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.087453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.087456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.087458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.087461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.087463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.087466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.087468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.087470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.087488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.094945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.096435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.096447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.096448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.096450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.096453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2386 [2:7556555450033730043:8074]
2025-10-02T09:34:29.096460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.096469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.096471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.096472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.096473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.096481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.096488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.096491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.096524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.096529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.096530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.096532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.096533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.096641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2386
2025-10-02T09:34:29.096666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2386
2025-10-02T09:34:29.096666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.096672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.096678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.096684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.096693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.096708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109299919:3297], now have 1 active actors on pipe
2025-10-02T09:34:29.096714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109299691:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.096724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.096729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.096741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.096745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.096747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.096754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.096763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.096767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.096768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.096769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.096772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.096773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.096781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.096788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.096790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.096791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.096796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.096816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.096835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.096843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.096849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.096851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.096934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.096940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.096947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.096994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2387 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0
2025-10-02T09:34:29.097235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b78f7629-8ac5b8d1-f75e839a-fe8951eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.100083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Write session: try to update token
2025-10-02T09:34:29.100097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.105683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:29.105695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.105699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.105719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:29.105721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:29.105873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:29.105988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:29.106104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:29.106216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:29.106367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:29.106387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:29.112831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId: src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.114094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.114106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.114107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.114109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.114113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.114115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.114117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033730038:8074]
2025-10-02T09:34:29.114135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.114137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.114138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.114139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.114139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.114141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.114245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.115127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.175842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109299942:4843]
2025-10-02T09:34:29.176000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2386, pipe: [1:7556555450109299942:4843]
2025-10-02T09:34:29.223402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.223775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.223786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.223799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109299942:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.223923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.223940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:29.223948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:29.223993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2387 reason: error at write: Disconnected sessionId: src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0
2025-10-02T09:34:29.224012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109299942:4843]
2025-10-02T09:34:29.224047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.224131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2387 sessionId: src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0 is DEAD
2025-10-02T09:34:29.224298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:29.224312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Write session will restart in 0.006770s
2025-10-02T09:34:29.224334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Write session: Do CDS request
2025-10-02T09:34:29.224339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.232165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.232255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.232263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2388
2025-10-02T09:34:29.232402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.232425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.232429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.232431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.232784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2388 sessionId:  describe result for acl check
2025-10-02T09:34:29.232837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.232844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.232846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.232850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109300127:3290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.233292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109300127:3290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.233757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.234706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109300127:3290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.235181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.235278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.235284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.235290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.235317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.235341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033730266:8065]
2025-10-02T09:34:29.235679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.235845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.235869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.236041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.236069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.236073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.236074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.236074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.236075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.236075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.236076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.236077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.236077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.236077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.236078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.236079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.236081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.236088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.236090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.236092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.236094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.236096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.236098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.236099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.236101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.236103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.236105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.236107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.236111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.236115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.236118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.236121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.236124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.236127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.236129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.236131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.236134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.236136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.236139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.236141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.236143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.236146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.236148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.236150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.236155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.236157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.236159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.236162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.236164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.236167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.236168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.236171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.236189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.236617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109300127:3290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.236628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109300127:3290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.236630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109300127:3290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.236635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.243599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.245120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.245131Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.245132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.245134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.245137Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2387 [2:7556555450033730266:8065]
2025-10-02T09:34:29.245144Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.245153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.245158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.245160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.245161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.245169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.245173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.245177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.245206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.245211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.245212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.245213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.245215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.245249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.245254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.245261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.245266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.245276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.245290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300169:3290], now have 1 active actors on pipe
2025-10-02T09:34:29.245295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109299944:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.245298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.245300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.245301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.245308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.245318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.245319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.245322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.245322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.245328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.245330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.245316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2387
2025-10-02T09:34:29.245343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.245347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.245349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.245344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2387
2025-10-02T09:34:29.245357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.245362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.245387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.245394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.245396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.245397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.245401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.245406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.245419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.245514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.245519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.245526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.245582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2388 partition: 0 MaxSeqNo: 36 sessionId: src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0
2025-10-02T09:34:29.245784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b743386-ae08f39c-fb6ee9e2-399aad6e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.248392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Write session: try to update token
2025-10-02T09:34:29.248402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.254792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.254805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.254806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.254807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.254812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.254817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.254819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033730261:8065]
2025-10-02T09:34:29.254841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.254842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.254845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.254846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.254846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.254848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.254960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.259340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId: src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.261361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.324308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109300178:4843]
2025-10-02T09:34:29.324454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2387, pipe: [1:7556555450109300178:4843]
2025-10-02T09:34:29.364198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.364473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.364482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.364506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300178:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.364613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.364660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109300178:4843]
2025-10-02T09:34:29.364679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.364706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:29.364816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2388 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0
2025-10-02T09:34:29.364977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2388 sessionId: src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0 is DEAD
2025-10-02T09:34:29.365112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:29.365121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Write session will restart in 0.005916s
2025-10-02T09:34:29.365139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Write session: Do CDS request
2025-10-02T09:34:29.365144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.372177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.372269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.372276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2389
2025-10-02T09:34:29.372354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.372372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.372378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.372380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.372752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2389 sessionId:  describe result for acl check
2025-10-02T09:34:29.372795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.372816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.372818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.372825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109300325:3265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.373292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109300325:3265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.374369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.374949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109300325:3265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.375716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.375818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.375825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.375830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.375856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.375878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033730521:8009]
2025-10-02T09:34:29.376214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.376368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.376391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.376563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.376593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.376597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.376598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.376598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.376599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.376599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.376600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.376600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.376601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.376601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.376602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.376602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.376605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.376612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.376614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.376616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.376617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.376619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.376621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.376623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.376625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.376627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.376629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.376631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.376635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.376639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.376642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.376645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.376647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.376650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.376652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.376654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.376657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.376659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.376661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.376664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.376666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.376669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.376672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.376681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.376684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.376689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.376693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.376698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.376703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.376708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.376714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.376717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.376734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.376951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109300325:3265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.376962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109300325:3265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.376967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109300325:3265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.376973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.384166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.385690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.385702Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.385703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.385705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.385708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2388 [2:7556555450033730521:8009]
2025-10-02T09:34:29.385715Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.385723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.385728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.385730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.385731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.385740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.385743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.385747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.385775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.385780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.385781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.385782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.385784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.385819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.385824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.385830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.385836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.385847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.385861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300405:3265], now have 1 active actors on pipe
2025-10-02T09:34:29.385866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300179:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.385869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.385871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.385872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.385880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.385875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2388
2025-10-02T09:34:29.385898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2388
2025-10-02T09:34:29.385888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.385893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.385895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.385896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.385899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.385900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.385922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.385926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.385935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.385942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.385954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.385959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0c5a467-9cb1145f-21724153-344ee29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.385963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.385965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.385966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.385971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.385976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.385992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.386098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.386103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.386110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.386168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2389 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0c5a467-9cb1145f-21724153-344ee29_0
2025-10-02T09:34:29.386432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c0a337-bb9cddb5-e8efe112-9d66537e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0c5a467-9cb1145f-21724153-344ee29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.389251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Write session: try to update token
2025-10-02T09:34:29.389266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.395121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.395132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.395133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.395134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.395138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.395140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.395141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033730516:8009]
2025-10-02T09:34:29.395161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.395162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.395165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.395166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.395167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.395167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.395276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.401329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId: src_id|b0c5a467-9cb1145f-21724153-344ee29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.403529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.464607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109300435:4843]
2025-10-02T09:34:29.464758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2388, pipe: [1:7556555450109300435:4843]
2025-10-02T09:34:29.503946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.504141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.504149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.504161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300435:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.504315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.504330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109300435:4843]
2025-10-02T09:34:29.504348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.504384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:29.504478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0c5a467-9cb1145f-21724153-344ee29_0
2025-10-02T09:34:29.504631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2389 sessionId: src_id|b0c5a467-9cb1145f-21724153-344ee29_0 is DEAD
2025-10-02T09:34:29.504769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:29.504782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Write session will restart in 0.007187s
2025-10-02T09:34:29.504826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Write session: Do CDS request
2025-10-02T09:34:29.504834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.513186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.513238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.513247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2390
2025-10-02T09:34:29.513355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.513376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.513381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.513384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.513771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2390 sessionId:  describe result for acl check
2025-10-02T09:34:29.513803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.513810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.513811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.513815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109300622:3226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.514275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109300622:3226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.514300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.515764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109300622:3226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.515814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.515918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.515925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.515930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.515957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.515980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033730754:8002]
2025-10-02T09:34:29.516318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.516480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.516502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.516672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.516699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.516703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.516703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.516704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.516704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.516705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.516705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.516706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.516706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.516707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.516707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.516708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.516711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.516716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.516719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.516721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.516723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.516725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.516727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.516728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.516730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.516733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.516735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.516736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.516741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.516745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.516748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.516751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.516753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.516756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.516758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.516761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.516763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.516766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.516768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.516771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.516773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.516775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.516777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.516780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.516782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.516787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.516789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.516792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.516796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.516798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.516815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.516821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.516838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.520717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109300622:3226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.520729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109300622:3226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.520731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109300622:3226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.520736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.524321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.526063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.526073Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.526074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.526076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.526079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2389 [2:7556555450033730754:8002]
2025-10-02T09:34:29.526086Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.526095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.526097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.526098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.526099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.526109Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.526111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.526115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.526146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.526151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.526153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.526155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.526156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.526192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.526196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.526203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.526208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.526216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.526227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300663:3226], now have 1 active actors on pipe
2025-10-02T09:34:29.526233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300436:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.526237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.526239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.526240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.526245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.526252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.526252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.526254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.526256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.526263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.526264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.526278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.526283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.526275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2389
2025-10-02T09:34:29.526293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.526281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2389
2025-10-02T09:34:29.526302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.526304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.526321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.526328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.526331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.526332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.526337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.526342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.526353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.526448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.526453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.526461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.526522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2390 partition: 0 MaxSeqNo: 36 sessionId: src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0
2025-10-02T09:34:29.526752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c5a467-9cb1145f-21724153-344ee29_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.529340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Write session: try to update token
2025-10-02T09:34:29.529351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.535570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.535584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.535586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.535587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.535591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.535594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.535596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033730748:8002]
2025-10-02T09:34:29.535619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.535623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.535625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.535625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.535629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.535631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.535746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.540442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId: src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.542480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.604390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109300671:4843]
2025-10-02T09:34:29.604570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2389, pipe: [1:7556555450109300671:4843]
2025-10-02T09:34:29.645810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.646023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.646032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.646057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300671:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.646192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.646223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:29.646232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:29.646276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.646279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2390 reason: error at write: Disconnected sessionId: src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0
2025-10-02T09:34:29.646331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109300671:4843]
2025-10-02T09:34:29.646406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2390 sessionId: src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0 is DEAD
2025-10-02T09:34:29.646514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:29.646522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Write session will restart in 0.007728s
2025-10-02T09:34:29.646540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Write session: Do CDS request
2025-10-02T09:34:29.646544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.655189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.655312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.655321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2391
2025-10-02T09:34:29.655432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.655453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.655459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.655462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.655824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2391 sessionId:  describe result for acl check
2025-10-02T09:34:29.655861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.655870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.655872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.655876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109300858:3200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.656306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109300858:3200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.656687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.657638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109300858:3200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.658164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.658266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.658273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.658279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.658305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.658329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033730981:8000]
2025-10-02T09:34:29.658684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.658858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.658881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.659057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.659086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.659090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.659091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.659092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.659092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.659093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.659093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.659094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.659094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.659095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.659095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.659096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.659098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.659105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.659107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.659109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.659111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.659113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.659115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.659117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.659119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.659121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.659123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.659124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.659128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.659131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.659134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.659137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.659139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.659142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.659144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.659147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.659149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.659152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.659154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.659157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.659159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.659162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.659164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.659167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.659169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.659172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.659174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.659177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.659179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.659182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.659184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.659187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.659204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.659548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109300858:3200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.659559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109300858:3200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.659561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109300858:3200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.659566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.666871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.668629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.668641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.668642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.668644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.668647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2390 [2:7556555450033730981:8000]
2025-10-02T09:34:29.668655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.668665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.668666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.668668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.668669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.668679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.668682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.668687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.668719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.668724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.668726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.668727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.668729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.668767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.668773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.668780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.668785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.668794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.668818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300899:3200], now have 1 active actors on pipe
2025-10-02T09:34:29.668824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300672:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.668828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.668829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.668830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.668838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.668846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.668853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.668856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.668857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.668857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.668859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.668874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.668879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.668883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.668871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2390
2025-10-02T09:34:29.668895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.668900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.668900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2390
2025-10-02T09:34:29.668921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3e88058-ff27bb76-123324f0-7d3e105_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.668931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.668933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.668934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.668939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.668945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.668959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.669052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.669057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.669065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.669124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2391 partition: 0 MaxSeqNo: 36 sessionId: src_id|d3e88058-ff27bb76-123324f0-7d3e105_0
2025-10-02T09:34:29.669348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|516b152c-4783ed58-ea1e803c-c919e1e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d3e88058-ff27bb76-123324f0-7d3e105_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.671827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Write session: try to update token
2025-10-02T09:34:29.671836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.678234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.678248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.678250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.678251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.678257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.678260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.678263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033730975:8000]
2025-10-02T09:34:29.678287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.678290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.678291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.678292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.678293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.678295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.678408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.683453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId: src_id|d3e88058-ff27bb76-123324f0-7d3e105_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.685565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.746735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109300912:4843]
2025-10-02T09:34:29.746902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2390, pipe: [1:7556555450109300912:4843]
2025-10-02T09:34:29.789603Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.789932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.789943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.789969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300912:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.790110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.790143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109300912:4843]
2025-10-02T09:34:29.790166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.790202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:29.790296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3e88058-ff27bb76-123324f0-7d3e105_0
2025-10-02T09:34:29.790446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2391 sessionId: src_id|d3e88058-ff27bb76-123324f0-7d3e105_0 is DEAD
2025-10-02T09:34:29.790587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:29.790595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Write session will restart in 0.008528s
2025-10-02T09:34:29.790609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Write session: Do CDS request
2025-10-02T09:34:29.790614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.800154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.800266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.800276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2392
2025-10-02T09:34:29.800379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.800400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.800406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.800409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.800733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2392 sessionId:  describe result for acl check
2025-10-02T09:34:29.800767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.800773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.800775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.800779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109301105:3196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.801008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.801248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109301105:3196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.802582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.802683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.802690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.802696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.802725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.802748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033731210:7982]
2025-10-02T09:34:29.803057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109301105:3196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.803090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.803251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.803273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.803449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.803476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.803480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.803481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.803481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.803482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.803482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.803483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.803483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.803484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.803485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.803485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.803486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.803489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.803495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.803497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.803499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.803501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.803503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.803506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.803508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.803510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.803512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.803514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.803515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.803519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.803523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.803526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.803529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.803532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.803535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.803537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.803540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.803543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.803545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.803547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.803550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.803552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.803555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.803557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.803560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.803564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.803566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.803568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.803571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.803575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.803579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.803581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.803584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.803600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.807433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109301105:3196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.807445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109301105:3196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.807447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109301105:3196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.807452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.811000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.812564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.812575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.812576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.812579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.812582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2391 [2:7556555450033731210:7982]
2025-10-02T09:34:29.812589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.812598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.812603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.812605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.812606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.812614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.812617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.812621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.812655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.812659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.812662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.812663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.812665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.812702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.812706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.812713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.812718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.812726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.812741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109300914:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.812746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109301144:3196], now have 1 active actors on pipe
2025-10-02T09:34:29.812750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.812751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.812752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.812760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.812771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.812775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.812777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.812779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.812782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.812783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.812797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.812781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2391
2025-10-02T09:34:29.812794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2391
2025-10-02T09:34:29.812815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.812816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.812836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.812841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.812860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17ac119-84569e42-6ca4004d-4398d015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.812867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.812869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.812871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.812875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.812880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.812891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.812986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.812991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.812998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.813055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2392 partition: 0 MaxSeqNo: 36 sessionId: src_id|17ac119-84569e42-6ca4004d-4398d015_0
2025-10-02T09:34:29.813301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e88058-ff27bb76-123324f0-7d3e105_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17ac119-84569e42-6ca4004d-4398d015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.816162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Write session: try to update token
2025-10-02T09:34:29.816177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.821920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.821935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.821936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.821936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.821940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.821943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.821945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033731204:7982]
2025-10-02T09:34:29.821963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.821967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.821968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.821969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.821970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.821973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.822075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.829222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId: src_id|17ac119-84569e42-6ca4004d-4398d015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.831458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:29.890064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555450109301158:4843]
2025-10-02T09:34:29.890205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2391, pipe: [1:7556555450109301158:4843]
2025-10-02T09:34:29.936035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:29.936297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.936314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.936329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109301158:4843], now have 1 active actors on pipe
2025-10-02T09:34:29.936485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:29.936514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:29.936523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:29.936568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2392 reason: error at write: Disconnected sessionId: src_id|17ac119-84569e42-6ca4004d-4398d015_0
2025-10-02T09:34:29.936579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:29.936635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555450109301158:4843]
2025-10-02T09:34:29.936712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2392 sessionId: src_id|17ac119-84569e42-6ca4004d-4398d015_0 is DEAD
2025-10-02T09:34:29.936886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:29.936900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Write session will restart in 0.006079s
2025-10-02T09:34:29.936923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Write session: Do CDS request
2025-10-02T09:34:29.936929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:29.944191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.944316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:29.944325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2393
2025-10-02T09:34:29.944438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:29.944458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:29.944464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:29.944466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:29.944823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2393 sessionId:  describe result for acl check
2025-10-02T09:34:29.944860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:29.944868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:29.944869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:29.944874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555450109301299:3168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:29.945329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555450109301299:3168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:29.946526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:29.946775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555450109301299:3168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:29.947864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:29.947968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:29.947975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:29.947980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:29.948007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:29.948134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555450033731439:7994]
2025-10-02T09:34:29.948273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555450109301299:3168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:29.948281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555450109301299:3168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:29.948283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555450109301299:3168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:29.948287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:29.948474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:29.948647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:29.948674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:29.948864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:29.948892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.948896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.948896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.948897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.948897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.948898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.948898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.948899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.948900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.948900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.948901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.948901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.948904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.948911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.948913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.948915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.948917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.948919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.948921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.948923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.948925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.948928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.948930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.948932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.948935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.948940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:29.948943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.948946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:29.948948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.948951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:29.948954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.948957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:29.948959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.948969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:29.948976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.948978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:29.948980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.948983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:29.948985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.948988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:29.948991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.948993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:29.948996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.948998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.949004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.949006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.949008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.949011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.949027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:29.956467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:29.958108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:29.958119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:29.958120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:29.958122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:29.958126Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2392 [2:7556555450033731439:7994]
2025-10-02T09:34:29.958135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:29.958148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:29.958152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.958154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.958155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.958165Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:29.958167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:29.958172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:29.958203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.958208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.958209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.958211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:29.958212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:29.958245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:29.958250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.958256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:29.958263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:29.958271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:29.958285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109301386:3168], now have 1 active actors on pipe
2025-10-02T09:34:29.958291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555450109301159:2446], now have 1 active actors on pipe
2025-10-02T09:34:29.958294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.958296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.958297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.958304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:29.958314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:29.958318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:29.958321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:29.958322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:29.958325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:29.958327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:29.958339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.958348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:29.958342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2392
2025-10-02T09:34:29.958344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2392
2025-10-02T09:34:29.958362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:29.958371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.958374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.958387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:29.958394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:29.958398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:29.958402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:29.958406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:29.958411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:29.958420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.958510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:29.958516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:29.958524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:29.958593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2393 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0
2025-10-02T09:34:29.958857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ac119-84569e42-6ca4004d-4398d015_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:29.961576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Write session: try to update token
2025-10-02T09:34:29.961589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:29.967254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:29.967266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.967270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.967291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:29.967292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:29.967425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:29.967538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:29.967649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:29.967760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:29.967924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:29.967946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:29.974321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId: src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:29.975625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:29.975637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:29.975638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:29.975639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:29.975643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.975645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.975647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555450033731434:7994]
2025-10-02T09:34:29.975666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:29.975668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:29.975670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:29.975672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:29.975673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:29.975675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:29.975788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:29.976531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.037039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404268694:4843]
2025-10-02T09:34:30.037203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2392, pipe: [1:7556555454404268694:4843]
2025-10-02T09:34:30.087394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.087708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.087724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.087740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404268694:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.087903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:30.087905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404268694:4843]
2025-10-02T09:34:30.087912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:30.087917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.087957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2393 reason: error at write: Disconnected sessionId: src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0
2025-10-02T09:34:30.088100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2393 sessionId: src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0 is DEAD
2025-10-02T09:34:30.088238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.088253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:30.088268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Write session will restart in 0.009247s
2025-10-02T09:34:30.088294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Write session: Do CDS request
2025-10-02T09:34:30.088299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.098054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.098198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.098284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.098292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2394
2025-10-02T09:34:30.098417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.098436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.098442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.098445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.098692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2394 sessionId:  describe result for acl check
2025-10-02T09:34:30.098717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.098722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.098722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.098725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404268903:3145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.098985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404268903:3145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.099481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.099574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.099581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.099586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.099611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.099712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328698979:7990]
2025-10-02T09:34:30.100056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.100090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404268903:3145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.100220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.100245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.100423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.100452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.100456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.100456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.100457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.100457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.100458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.100458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.100459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.100460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.100460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.100461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.100462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.100465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.100471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.100473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.100475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.100477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.100479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.100481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.100483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.100485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.100489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.100490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.100492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.100496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.100500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.100503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.100506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.100508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.100511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.100513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.100516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.100518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.100521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.100522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.100525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.100529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.100531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.100533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.100538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.100542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.100544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.100546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.100549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.100551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.100554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.100556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.100559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.100581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.104379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404268903:3145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.104387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404268903:3145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.104388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404268903:3145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.104392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.108005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.109595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.109607Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.109608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.109610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.109614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2393 [2:7556555454328698979:7990]
2025-10-02T09:34:30.109623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.109636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.109638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.109639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.109640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.109650Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.109655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.109660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.109695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.109700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.109701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.109703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.109704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.109741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.109745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.109752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.109757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.109769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.109784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404268942:3145], now have 1 active actors on pipe
2025-10-02T09:34:30.109790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404268699:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.109793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.109794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.109796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.109803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.109814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.109816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.109818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.109820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.109824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.109826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.109839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.109844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.109846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.109820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2393
2025-10-02T09:34:30.109854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.109828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2393
2025-10-02T09:34:30.109859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.109885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1984c64d-a55942de-64b7dd08-ced64723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.109892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.109894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.109895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.109901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.109908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.109922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.110009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.110014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.110021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.110068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2394 partition: 0 MaxSeqNo: 36 sessionId: src_id|1984c64d-a55942de-64b7dd08-ced64723_0
2025-10-02T09:34:30.110355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9a39f4-a77446fe-bd912300-c0fd1cab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1984c64d-a55942de-64b7dd08-ced64723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.113135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Write session: try to update token
2025-10-02T09:34:30.113151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.119036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.119048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.119050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.119051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.119055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.119059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.119061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328698973:7990]
2025-10-02T09:34:30.119082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.119084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.119086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.119088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.119088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.119092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.119208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.126178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId: src_id|1984c64d-a55942de-64b7dd08-ced64723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.128476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.188055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404268949:4843]
2025-10-02T09:34:30.188203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2393, pipe: [1:7556555454404268949:4843]
2025-10-02T09:34:30.233698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.234010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.234020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.234032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404268949:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.234174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.234177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:30.234190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:30.234212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404268949:4843]
2025-10-02T09:34:30.234228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.234236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2394 reason: error at write: Disconnected sessionId: src_id|1984c64d-a55942de-64b7dd08-ced64723_0
2025-10-02T09:34:30.234382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2394 sessionId: src_id|1984c64d-a55942de-64b7dd08-ced64723_0 is DEAD
2025-10-02T09:34:30.234528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:30.234542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Write session will restart in 0.006287s
2025-10-02T09:34:30.234575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Write session: Do CDS request
2025-10-02T09:34:30.234582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.242184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.242273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.242282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2395
2025-10-02T09:34:30.242407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.242426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.242433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.242435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.242748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2395 sessionId:  describe result for acl check
2025-10-02T09:34:30.242768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.242772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.242773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.242776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404269098:3141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.243119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404269098:3141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.244363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.244727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404269098:3141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.245780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.245873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.245879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.245885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.245909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.245931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328699209:7984]
2025-10-02T09:34:30.246231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404269098:3141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.246238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404269098:3141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.246240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404269098:3141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.246243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.246268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.246419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.246441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.246626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.246655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.246659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.246659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.246660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.246660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.246661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.246662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.246662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.246663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.246663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.246664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.246664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.246667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.246673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.246675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.246677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.246679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.246681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.246683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.246685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.246687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.246689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.246691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.246693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.246697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.246700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.246703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.246706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.246708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.246711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.246713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.246716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.246718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.246721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.246723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.246726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.246728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.246731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.246733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.246735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.246737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.246740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.246742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.246745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.246747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.246749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.246751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.246755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.246771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.254148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.255913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.255927Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.255928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.255930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.255934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2394 [2:7556555454328699209:7984]
2025-10-02T09:34:30.255941Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.255950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.255955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.255957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.255958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.255968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.255973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.255977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.256008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.256012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.256013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.256015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.256016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.256052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.256057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.256064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.256069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.256077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.256092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269179:3141], now have 1 active actors on pipe
2025-10-02T09:34:30.256097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404268951:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.256101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.256102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.256104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.256111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.256119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.256124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.256127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.256128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.256130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.256132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.256136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2394
2025-10-02T09:34:30.256138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2394
2025-10-02T09:34:30.256145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.256152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.256159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.256169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.256171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.256188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba8710ba-6c894e26-505ff164-f8874159_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.256196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.256198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.256199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.256205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.256210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.256226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.256327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.256332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.256339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.256402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2395 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba8710ba-6c894e26-505ff164-f8874159_0
2025-10-02T09:34:30.256635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1984c64d-a55942de-64b7dd08-ced64723_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba8710ba-6c894e26-505ff164-f8874159_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.259197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Write session: try to update token
2025-10-02T09:34:30.259212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.265234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.265247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.265249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.265249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.265253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.265255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.265257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328699204:7984]
2025-10-02T09:34:30.265275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.265278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.265279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.265282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.265284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.265287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.265390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.271075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId: src_id|ba8710ba-6c894e26-505ff164-f8874159_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.273231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.334490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404269192:4843]
2025-10-02T09:34:30.334666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2394, pipe: [1:7556555454404269192:4843]
2025-10-02T09:34:30.375582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.375896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.375905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.375917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269192:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.376015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.376063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:30.376065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404269192:4843]
2025-10-02T09:34:30.376079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.376122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2395 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba8710ba-6c894e26-505ff164-f8874159_0
2025-10-02T09:34:30.376262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2395 sessionId: src_id|ba8710ba-6c894e26-505ff164-f8874159_0 is DEAD
2025-10-02T09:34:30.376417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:30.376432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Write session will restart in 0.008889s
2025-10-02T09:34:30.376456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Write session: Do CDS request
2025-10-02T09:34:30.376461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.386172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.386293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.386301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2396
2025-10-02T09:34:30.386420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.386437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.386443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.386446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.386533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.386735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2396 sessionId:  describe result for acl check
2025-10-02T09:34:30.386759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.386763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.386764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.386767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404269390:3130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.387072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404269390:3130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.387903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.388082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.388091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.388097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.388129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.388152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328699472:7970]
2025-10-02T09:34:30.388380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404269390:3130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.388483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.388655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.388677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.388861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.388888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.388892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.388893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.388894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.388894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.388895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.388895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.388896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.388897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.388897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.388898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.388898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.388901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.388907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.388909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.388911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.388913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.388915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.388917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.388919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.388921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.388924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.388925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.388927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.388930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.388934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.388938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.388941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.388943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.388945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.388947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.388951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.388953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.388956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.388958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.388960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.388963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.388965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.388968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.388970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.388973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.388975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.388977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.388980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.388982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.388984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.388986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.388989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.389005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.392786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404269390:3130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.392794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404269390:3130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.392796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404269390:3130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.392811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.396386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.397932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.397944Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.397946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.397948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.397951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2395 [2:7556555454328699472:7970]
2025-10-02T09:34:30.397958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.397967Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.397968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.397970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.397971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.397980Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.397987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.397991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.398022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.398026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.398028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.398030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.398031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.398067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.398072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.398078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.398084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.398095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.398110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269427:3130], now have 1 active actors on pipe
2025-10-02T09:34:30.398115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269193:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.398119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.398121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.398122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.398129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.398139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.398142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.398144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.398145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.398150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.398151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.398150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2395
2025-10-02T09:34:30.398165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.398150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2395
2025-10-02T09:34:30.398170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.398172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.398180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.398185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.398211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56472a28-e6513551-ee15cf86-74fd47e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.398218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.398221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.398224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.398229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.398237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.398248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.398328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.398333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.398340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.398397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2396 partition: 0 MaxSeqNo: 36 sessionId: src_id|56472a28-e6513551-ee15cf86-74fd47e1_0
2025-10-02T09:34:30.398659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8710ba-6c894e26-505ff164-f8874159_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56472a28-e6513551-ee15cf86-74fd47e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.401404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Write session: try to update token
2025-10-02T09:34:30.401419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.407221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.407234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.407235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.407236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.407240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.407242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.407244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328699466:7970]
2025-10-02T09:34:30.407264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.407265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.407266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.407267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.407267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.407269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.407374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.414133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId: src_id|56472a28-e6513551-ee15cf86-74fd47e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.416316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.476339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404269456:4843]
2025-10-02T09:34:30.476497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2395, pipe: [1:7556555454404269456:4843]
2025-10-02T09:34:30.518917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.519322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.519332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.519345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269456:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.519500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.519501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:30.519513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:30.519517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404269456:4843]
2025-10-02T09:34:30.519535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.519564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2396 reason: error at write: Disconnected sessionId: src_id|56472a28-e6513551-ee15cf86-74fd47e1_0
2025-10-02T09:34:30.519709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2396 sessionId: src_id|56472a28-e6513551-ee15cf86-74fd47e1_0 is DEAD
2025-10-02T09:34:30.519869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:30.519882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Write session will restart in 0.009650s
2025-10-02T09:34:30.519904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Write session: Do CDS request
2025-10-02T09:34:30.519910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.529883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.530203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.530307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.530315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2397
2025-10-02T09:34:30.530435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.530457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.530459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.530462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.530736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2397 sessionId:  describe result for acl check
2025-10-02T09:34:30.530754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.530759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.530760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.530763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404269652:3097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.531315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.531411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.531418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.531424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.531432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404269652:3097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.531450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.531471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328699711:7962]
2025-10-02T09:34:30.531813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.531973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.531995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.532169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.532200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.532204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.532205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.532205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.532206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.532207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.532207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.532208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.532208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.532208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.532209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.532210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.532213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.532219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.532221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.532223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.532225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.532227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.532229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.532231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.532233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.532235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.532237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.532238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.532242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.532246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.532249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.532252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.532254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.532257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.532259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.532262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.532264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.532266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.532268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.532271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.532273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.532275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.532277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.532280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.532284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.532287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.532289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.532291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.532295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.532298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.532300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.532302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.532319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.532967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404269652:3097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.537111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404269652:3097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.537119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404269652:3097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.537121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404269652:3097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.537125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.539668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.541325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.541337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.541339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.541340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.541344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2396 [2:7556555454328699711:7962]
2025-10-02T09:34:30.541352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.541362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.541367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.541368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.541369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.541379Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.541385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.541389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.541430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.541438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.541439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.541441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.541443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.541490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.541496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.541506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.541520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.541538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.541557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269457:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.541563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269690:3097], now have 1 active actors on pipe
2025-10-02T09:34:30.541557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2396
2025-10-02T09:34:30.541561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2396
2025-10-02T09:34:30.541569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.541575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.541576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.541582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.541596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.541597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.541604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.541606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.541610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.541613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.541628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.541635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.541656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.541664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.541676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.541678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.541683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.541685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.541686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.541691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.541701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.541721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.541813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.541818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.541826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.541865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2397 partition: 0 MaxSeqNo: 36 sessionId: src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0
2025-10-02T09:34:30.542136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56472a28-e6513551-ee15cf86-74fd47e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.544682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Write session: try to update token
2025-10-02T09:34:30.544694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.550761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.550773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.550775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.550775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.550779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.550783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.550785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328699705:7962]
2025-10-02T09:34:30.550803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.550806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.550807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.550807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.550810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.550812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.550917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.556552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId: src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.558746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.619693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404269699:4843]
2025-10-02T09:34:30.619929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2396, pipe: [1:7556555454404269699:4843]
2025-10-02T09:34:30.662792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.663000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.663009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.663021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269699:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.663162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.663208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.663234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404269699:4843]
2025-10-02T09:34:30.663243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:30.663296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2397 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0
2025-10-02T09:34:30.663449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2397 sessionId: src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0 is DEAD
2025-10-02T09:34:30.663607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:30.663622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Write session will restart in 0.007803s
2025-10-02T09:34:30.663649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Write session: Do CDS request
2025-10-02T09:34:30.663654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.672199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.672367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.672375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2398
2025-10-02T09:34:30.672502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.672522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.672528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.672531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.672795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2398 sessionId:  describe result for acl check
2025-10-02T09:34:30.672829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.672835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.672839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.672842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404269893:3094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.673185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404269893:3094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.673813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.674899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404269893:3094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.675288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.675420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.675427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.675433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.675462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.675485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328699945:7960]
2025-10-02T09:34:30.675835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.675993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.676015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.676193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.676225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.676229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.676230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.676230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.676231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.676231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.676232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.676232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.676233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.676233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.676234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.676235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.676237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.676243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.676245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.676247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.676249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.676251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.676253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.676255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.676257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.676259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.676261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.676263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.676267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.676271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.676274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.676277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.676279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.676282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.676284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.676287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.676289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.676291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.676295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.676297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.676299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.676302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.676304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.676306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.676309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.676312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.676313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.676316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.676318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.676321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.676325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.676327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.676344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.679702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404269893:3094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.679710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404269893:3094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.679713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404269893:3094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.679717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.683771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.685521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.685534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.685535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.685537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.685540Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2397 [2:7556555454328699945:7960]
2025-10-02T09:34:30.685547Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.685557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.685562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.685564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.685565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.685574Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.685580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.685584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.685619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.685624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.685625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.685628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.685629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.685669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.685674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.685680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.685686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.685694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.685707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.685712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.685713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.685719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.685724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.685726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.685733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.685734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.685735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.685735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.685742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269700:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.685745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269935:3094], now have 1 active actors on pipe
2025-10-02T09:34:30.685758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.685766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.685769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2397
2025-10-02T09:34:30.685770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2397
2025-10-02T09:34:30.685780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.685824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.685829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.685843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.685850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.685854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.685856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.685861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.685869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.685879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.685985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.685990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.685997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.686054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2398 partition: 0 MaxSeqNo: 36 sessionId: src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0
2025-10-02T09:34:30.686327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2007e402-51b6d55f-9a097a81-ecc37b58_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.688959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Write session: try to update token
2025-10-02T09:34:30.688973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.694721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:30.694733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.694737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.694757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:30.694762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:30.694891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:30.695003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:30.695112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:30.695224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:30.695384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:30.695407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:30.701668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId: src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.703115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.703129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.703130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.703131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.703135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.703138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.703140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328699939:7960]
2025-10-02T09:34:30.703158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.703161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.703161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.703162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.703166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.703168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.703278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.703928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.763569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404269943:4843]
2025-10-02T09:34:30.763742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2397, pipe: [1:7556555454404269943:4843]
2025-10-02T09:34:30.814362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.814850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.814861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.814874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269943:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.815036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.815035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.815063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404269943:4843]
2025-10-02T09:34:30.815067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:30.815069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:30.815114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2398 reason: error at write: Disconnected sessionId: src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0
2025-10-02T09:34:30.815252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2398 sessionId: src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0 is DEAD
2025-10-02T09:34:30.815408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:30.815423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Write session will restart in 0.005026s
2025-10-02T09:34:30.815446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Write session: Do CDS request
2025-10-02T09:34:30.815451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.821144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.821258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.821265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2399
2025-10-02T09:34:30.821393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.821420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.821426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.821431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.821741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2399 sessionId:  describe result for acl check
2025-10-02T09:34:30.821763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.821767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.821768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.821771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404270013:3071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.822162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404270013:3071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.824295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404270013:3071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.825624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.827005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.827113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.827120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.827126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.827153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.827182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328700180:7958]
2025-10-02T09:34:30.827191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404270013:3071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.827199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404270013:3071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.827200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404270013:3071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.827204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.827526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.827680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.827702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.827875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.827904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.827908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.827909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.827909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.827910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.827910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.827911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.827911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.827912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.827912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.827913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.827913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.827916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.827922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.827924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.827926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.827928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.827930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.827931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.827933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.827935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.827937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.827939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.827941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.827944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.827948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.827951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.827955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.827958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.827961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.827963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.827965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.827967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.827970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.827971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.827974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.827976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.827978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.827980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.827983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.827984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.827987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.827993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.827996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.827997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.828000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.828005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.828008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.828024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.835413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.837120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.837132Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.837133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.837135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.837138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2398 [2:7556555454328700180:7958]
2025-10-02T09:34:30.837146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.837157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.837159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.837160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.837161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.837171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.837177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.837181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.837214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.837219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.837220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.837222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.837223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.837258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.837263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.837270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.837275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.837287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.837302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404270176:3071], now have 1 active actors on pipe
2025-10-02T09:34:30.837307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404269944:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.837311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.837312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.837313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.837321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.837332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.837334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.837336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.837337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.837342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.837343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.837357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.837346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2398
2025-10-02T09:34:30.837362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.837364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.837350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2398
2025-10-02T09:34:30.837377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.837379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.837400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab450b76-2920950b-c2b48ede-329337b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.837407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.837409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.837410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.837415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.837423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.837534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.837641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.837646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.837653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.837704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2399 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab450b76-2920950b-c2b48ede-329337b7_0
2025-10-02T09:34:30.838003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124cbdb9-ebf6a946-60fc4c29-38e051d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab450b76-2920950b-c2b48ede-329337b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.840574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Write session: try to update token
2025-10-02T09:34:30.840593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.846392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.846406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.846407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.846408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.846412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.846414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.846416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328700174:7958]
2025-10-02T09:34:30.846435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.846436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.846438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.846439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.846439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.846441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.846553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.852600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId: src_id|ab450b76-2920950b-c2b48ede-329337b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.854826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:30.915103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555454404270193:4843]
2025-10-02T09:34:30.915268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2398, pipe: [1:7556555454404270193:4843]
2025-10-02T09:34:30.958509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:30.958819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.958828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.958841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404270193:4843], now have 1 active actors on pipe
2025-10-02T09:34:30.958999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:30.959011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:30.959000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555454404270193:4843]
2025-10-02T09:34:30.959010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:30.959013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:30.959051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2399 reason: error at write: Disconnected sessionId: src_id|ab450b76-2920950b-c2b48ede-329337b7_0
2025-10-02T09:34:30.959194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2399 sessionId: src_id|ab450b76-2920950b-c2b48ede-329337b7_0 is DEAD
2025-10-02T09:34:30.959357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:30.959370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Write session will restart in 0.008854s
2025-10-02T09:34:30.959391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Write session: Do CDS request
2025-10-02T09:34:30.959396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:30.969155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.969179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:30.969278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:30.969287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2400
2025-10-02T09:34:30.969405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:30.969432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:30.969439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:30.969442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:30.969708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2400 sessionId:  describe result for acl check
2025-10-02T09:34:30.969727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:30.969733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:30.969734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:30.969737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555454404270398:3062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:30.970080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555454404270398:3062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:30.970673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:30.970772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:30.970779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:30.970784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:30.970809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:30.970833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555454328700416:7956]
2025-10-02T09:34:30.971169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:30.971292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555454404270398:3062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:30.971332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:30.971354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:30.971537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:30.971566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.971570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.971571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.971571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.971572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.971572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.971573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.971574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.971574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.971575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.971575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.971576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.971579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.971584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.971586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.971588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.971590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.971592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.971594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.971596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.971598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.971600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.971602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.971604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.971608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.971611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:30.971615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.971618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:30.971620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.971623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:30.971625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.971628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:30.971638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.971641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:30.971644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.971647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:30.971650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.971653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:30.971654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.971657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:30.971660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.971663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:30.971665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.971667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.971669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.971672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.971674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.971676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.971692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:30.975510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555454404270398:3062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:30.975518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555454404270398:3062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:30.975520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555454404270398:3062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:30.975524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:30.979127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:30.980732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:30.980743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:30.980745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:30.980747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:30.980750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2399 [2:7556555454328700416:7956]
2025-10-02T09:34:30.980758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:30.980768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:30.980773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.980775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.980776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.980785Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:30.980790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:30.980794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:30.980844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.980849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.980850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.980852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:30.980853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:30.980889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:30.980894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.980900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:30.980906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:30.980917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:30.980932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404270200:2446], now have 1 active actors on pipe
2025-10-02T09:34:30.980938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555454404270433:3062], now have 1 active actors on pipe
2025-10-02T09:34:30.980941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.980942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.980943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.980949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:30.980958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:30.980960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:30.980966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:30.980968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:30.980967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:30.980969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:30.980967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2399
2025-10-02T09:34:30.980970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2399
2025-10-02T09:34:30.980984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.980989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:30.980990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:30.981001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.981005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.981031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:30.981038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:30.981044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:30.981045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:30.981050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:30.981055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:30.981067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.981149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:30.981154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:30.981161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:30.981203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2400 partition: 0 MaxSeqNo: 36 sessionId: src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0
2025-10-02T09:34:30.981423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab450b76-2920950b-c2b48ede-329337b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:30.983999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Write session: try to update token
2025-10-02T09:34:30.984013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:30.990092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:30.990103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:30.990104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:30.990105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:30.990109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.990112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.990114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555454328700411:7956]
2025-10-02T09:34:30.990132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:30.990135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:30.990136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:30.990136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:30.990139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:30.990141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:30.990237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:30.996387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId: src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:30.998600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.058970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555458699237737:4843]
2025-10-02T09:34:31.059147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2399, pipe: [1:7556555458699237737:4843]
2025-10-02T09:34:31.105248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.105577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.105586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.105598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699237737:4843], now have 1 active actors on pipe
2025-10-02T09:34:31.105737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.105721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.105736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:31.105740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:31.105754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699237737:4843]
2025-10-02T09:34:31.105800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2400 reason: error at write: Disconnected sessionId: src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0
2025-10-02T09:34:31.105984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2400 sessionId: src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0 is DEAD
2025-10-02T09:34:31.106173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:31.106187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Write session will restart in 0.009217s
2025-10-02T09:34:31.106213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Write session: Do CDS request
2025-10-02T09:34:31.106218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.116188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.116316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.116324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2401
2025-10-02T09:34:31.116387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.116456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.116478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.116480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.116483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.116767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2401 sessionId:  describe result for acl check
2025-10-02T09:34:31.116793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.116797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.116814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.116817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699237949:3048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.117144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699237949:3048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.117701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.117872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.117880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.117887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.117919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.117940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623667963:7949]
2025-10-02T09:34:31.118277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.118446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.118468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.118649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.118680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.118684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.118685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.118685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.118686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.118686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.118683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699237949:3048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.118687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.118687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.118688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.118688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.118689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.118689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.118692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.118698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.118700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.118702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.118704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.118706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.118707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.118709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.118711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.118713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.118715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.118717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.118721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.118725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.118729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.118732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.118734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.118736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.118738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.118741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.118743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.118746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.118748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.118751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.118753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.118756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.118758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.118760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.118762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.118765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.118768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.118770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.118776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.118779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.118781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.118783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.118804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.122618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699237949:3048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.122626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699237949:3048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.122628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699237949:3048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.122632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:31.126233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:31.127647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:31.127659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:31.127660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:31.127662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:31.127666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2400 [2:7556555458623667963:7949]
2025-10-02T09:34:31.127779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:31.127793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:31.127794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.127795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.127796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.127805Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:31.127807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:31.127815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:31.127846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.127850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.127851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.127853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:31.127855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:31.127893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:31.127898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.127904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.127909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.127919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:31.127932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.127936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.127937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.127944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:31.127951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:31.127952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699237750:2446], now have 1 active actors on pipe
2025-10-02T09:34:31.127954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699237989:3048], now have 1 active actors on pipe
2025-10-02T09:34:31.127959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:31.127960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:31.127962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:31.127966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:31.127968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:31.127981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.127987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:31.127979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2400
2025-10-02T09:34:31.127999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:31.127986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2400
2025-10-02T09:34:31.128007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.128009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.128024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d128a20e-21237727-cd08ed94-9027fdc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:31.128031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.128033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.128035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.128040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.128046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:31.128053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.128158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.128164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.128171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.128227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2401 partition: 0 MaxSeqNo: 36 sessionId: src_id|d128a20e-21237727-cd08ed94-9027fdc2_0
2025-10-02T09:34:31.128506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42c551aa-c721395-ee20bdf2-67e3cee7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d128a20e-21237727-cd08ed94-9027fdc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:31.131098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Write session: try to update token
2025-10-02T09:34:31.131114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:31.137098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:31.137111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.137112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:31.137113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:31.137117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.137120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.137122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623667957:7949]
2025-10-02T09:34:31.137140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:31.137144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.137146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:31.137151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:31.137160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:31.137162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:31.137260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:31.143384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId: src_id|d128a20e-21237727-cd08ed94-9027fdc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:31.145626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.205944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555458699237996:4843]
2025-10-02T09:34:31.206145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2400, pipe: [1:7556555458699237996:4843]
2025-10-02T09:34:31.249258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.249545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.249554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.249567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699237996:4843], now have 1 active actors on pipe
2025-10-02T09:34:31.249687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.249683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.249714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699237996:4843]
2025-10-02T09:34:31.249718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:31.249721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:31.249723Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:34:31.249779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2401 reason: error at write: Disconnected sessionId: src_id|d128a20e-21237727-cd08ed94-9027fdc2_0
2025-10-02T09:34:31.249837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2401 sessionId: src_id|d128a20e-21237727-cd08ed94-9027fdc2_0 is DEAD
2025-10-02T09:34:31.249865Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 24 consumer shared/user session shared/user_1_24_12798954258424859339_v1 is DEAD
2025-10-02T09:34:31.249992Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555398569675560:4845] disconnected; active server actors: 1
2025-10-02T09:34:31.249998Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555398569675560:4845] client user disconnected session shared/user_1_24_12798954258424859339_v1
2025-10-02T09:34:31.250006Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:34:31.250060Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:31.250064Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:31.250072Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006332s
2025-10-02T09:34:31.250143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:31.250155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Write session will restart in 0.007208s
2025-10-02T09:34:31.250175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Write session: Do CDS request
2025-10-02T09:34:31.250180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.257130Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:34:31.257234Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:34:31.257240Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 25
2025-10-02T09:34:31.257363Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 25 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:31.257400Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:31.257458Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 auth for : user
2025-10-02T09:34:31.257593Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 Handle describe topics response
2025-10-02T09:34:31.257617Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 auth is DEAD
2025-10-02T09:34:31.257624Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:34:31.257826Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:34:31.257879Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_25_14952652734850685567_v1
2025-10-02T09:34:31.257882Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555458699238134:3028] connected; active server actors: 1
2025-10-02T09:34:31.257892Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555458699238134:3028] session shared/user_1_25_14952652734850685567_v1
2025-10-02T09:34:31.257897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:34:31.257903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:34:31.257912Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_25_14952652734850685567_v1" (Sender=[1:7556555458699238109:3028], Pipe=[1:7556555458699238134:3028], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:31.257918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:34:31.257926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:34:31.257938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_25_14952652734850685567_v1" (Sender=[1:7556555458699238109:3028], Pipe=[1:7556555458699238134:3028], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:31.257950Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_25_14952652734850685567_v1" sender [1:7556555458699238109:3028] lock partition 0 for ReadingSession "shared/user_1_25_14952652734850685567_v1" (Sender=[1:7556555458699238109:3028], Pipe=[1:7556555458699238134:3028], Partitions=[], ActiveFamilyCount=1) generation 1 step 25
2025-10-02T09:34:31.257962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:34:31.257966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-02T09:34:31.258102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.258134Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 25 Session: "shared/user_1_25_14952652734850685567_v1" ClientId: "user" PipeClient { RawX1: 7556555458699238134 RawX2: 4503603922340820 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:34:31.258140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.258142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2402
2025-10-02T09:34:31.258151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:34:31.258239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.258256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.258261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.258263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.258467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2402 sessionId:  describe result for acl check
2025-10-02T09:34:31.258486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.258490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.258492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.258495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699238172:3011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.258849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699238172:3011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.260023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.260069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699238172:3011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.261353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.261504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.261512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.261518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.261549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.261574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623668203:7943]
2025-10-02T09:34:31.261585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699238172:3011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.261593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699238172:3011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.261596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699238172:3011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.261600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:31.261899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.262059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.262081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.262251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.262282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.262286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.262287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.262287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.262288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.262289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.262289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.262290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.262291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.262291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.262291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.262292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.262295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.262300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.262303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.262305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.262306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.262309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.262311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.262312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.262314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.262317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.262318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.262320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.262324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.262328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.262331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.262334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.262336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.262339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.262341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.262343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.262346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.262348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.262351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.262353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.262357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.262360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.262362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.262364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.262367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.262370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.262372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.262375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.262377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.262379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.262383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.262385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.262401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.269767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:31.271279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:31.271290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:31.271291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:31.271293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:31.271296Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2401 [2:7556555458623668203:7943]
2025-10-02T09:34:31.271302Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:31.271311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:31.271316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.271318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.271319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.271327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:31.271330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:31.271334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:31.271364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.271368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.271369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.271371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:31.271372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:31.271404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:31.271412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.271418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.271423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.271430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:31.271442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699237998:2446], now have 1 active actors on pipe
2025-10-02T09:34:31.271445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238152:3012], now have 1 active actors on pipe
2025-10-02T09:34:31.271447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238240:3011], now have 1 active actors on pipe
2025-10-02T09:34:31.271450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.271451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.271452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.271459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:31.271466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:31.271477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:31.271477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:31.271478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:31.271479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:31.271480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:31.271476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2401, pipe: [1:7556555458699238152:3012]
2025-10-02T09:34:31.271477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2401
2025-10-02T09:34:31.271492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.271494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:31.271501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:31.271504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.271491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2401
2025-10-02T09:34:31.271506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.271512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_25_14952652734850685567_v1 on pipe: [1:7556555458699238152:3012]
2025-10-02T09:34:31.271539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.271542Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_25_14952652734850685567_v1:1 with generation 2401
2025-10-02T09:34:31.271543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.271549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.271552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.271553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.271560Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_25_14952652734850685567_v1
2025-10-02T09:34:31.271563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.271583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6c3edfc-124a6807-a03af204-3985925d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:31.271589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:34:31.271591Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:34:31.274877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:34:31.274889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:34:31.274892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.274894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.274895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.274899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.274904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:31.274906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:34:31.274911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:34:31.274920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.274976Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397671270 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:34:31.274985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:34:31.275002Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 sending to client partition status
2025-10-02T09:34:31.275023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.275034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.275048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.275107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2402 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6c3edfc-124a6807-a03af204-3985925d_0
2025-10-02T09:34:31.275545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d128a20e-21237727-cd08ed94-9027fdc2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6c3edfc-124a6807-a03af204-3985925d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:31.278099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Write session: try to update token
2025-10-02T09:34:31.278112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:31.280434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:31.280446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.280447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:31.280449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:31.280453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.280455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.280457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623668197:7943]
2025-10-02T09:34:31.280473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:31.280476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.280477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:31.280478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:31.280480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:31.280482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:31.280579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:31.289946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId: src_id|e6c3edfc-124a6807-a03af204-3985925d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:31.292089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.392084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.392394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.392403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.392523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_25_14952652734850685567_v1
2025-10-02T09:34:31.392531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.392561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.392590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699238152:3012]
2025-10-02T09:34:31.392593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:31.392648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2402 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6c3edfc-124a6807-a03af204-3985925d_0
2025-10-02T09:34:31.392713Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_25_14952652734850685567_v1
2025-10-02T09:34:31.392794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2402 sessionId: src_id|e6c3edfc-124a6807-a03af204-3985925d_0 is DEAD
2025-10-02T09:34:31.392977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:31.392996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Write session will restart in 0.007609s
2025-10-02T09:34:31.393017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Write session: Do CDS request
2025-10-02T09:34:31.393023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.401168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.401259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.401266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2403
2025-10-02T09:34:31.401390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.401409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.401415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.401417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.401673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2403 sessionId:  describe result for acl check
2025-10-02T09:34:31.401703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.401708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.401709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.401713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699238448:3001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.402043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699238448:3001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.402929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.403383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699238448:3001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.404275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.404367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.404373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.404379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.404403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.404425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623668459:7919]
2025-10-02T09:34:31.404764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.404925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699238448:3001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.404933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699238448:3001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.404935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699238448:3001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.404938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:31.404935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.404958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.405155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.405192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.405196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.405197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.405197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.405198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.405198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.405199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.405199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.405200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.405200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.405201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.405201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.405204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.405211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.405213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.405215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.405217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.405219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.405221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.405223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.405225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.405228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.405229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.405231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.405235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.405240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.405243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.405246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.405248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.405251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.405253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.405256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.405259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.405261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.405263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.405266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.405268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.405270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.405273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.405275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.405277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.405280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.405282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.405284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.405286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.405289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.405291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.405293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.405310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.412761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:31.414314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:31.414325Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:31.414326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:31.414328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:31.414332Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2402 [2:7556555458623668459:7919]
2025-10-02T09:34:31.414339Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:31.414349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:31.414350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.414352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.414354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.414362Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:31.414366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:31.414371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:31.414399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.414404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.414405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.414407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:31.414408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:31.414444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:31.414448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.414455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.414460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.414470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:31.414482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238255:2446], now have 1 active actors on pipe
2025-10-02T09:34:31.414487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238493:3001], now have 1 active actors on pipe
2025-10-02T09:34:31.414490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.414491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.414492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.414501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:31.414509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:31.414513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:31.414515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:31.414517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:31.414519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:31.414521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:31.414535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.414526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2402
2025-10-02T09:34:31.414529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2402
2025-10-02T09:34:31.414540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:31.414542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:31.414567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.414572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.414590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df5a3483-10c2db99-64b745ca-a23fa234_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:31.414597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.414599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.414600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.414604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.414609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:31.414624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.414705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.414711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.414717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.414769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2403 partition: 0 MaxSeqNo: 36 sessionId: src_id|df5a3483-10c2db99-64b745ca-a23fa234_0
2025-10-02T09:34:31.415047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c3edfc-124a6807-a03af204-3985925d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df5a3483-10c2db99-64b745ca-a23fa234_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:31.417648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Write session: try to update token
2025-10-02T09:34:31.417662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:31.423816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:31.423830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.423832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:31.423833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:31.423837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.423840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.423842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623668453:7919]
2025-10-02T09:34:31.423861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:31.423866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.423866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:31.423867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:31.423869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:31.423871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:31.423973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:31.429798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId: src_id|df5a3483-10c2db99-64b745ca-a23fa234_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:31.431971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.492649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555458699238524:3012]
2025-10-02T09:34:31.492826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2402, pipe: [1:7556555458699238524:3012]
2025-10-02T09:34:31.537754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.538037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.538046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.538059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238524:3012], now have 1 active actors on pipe
2025-10-02T09:34:31.538195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.538235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.538253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:31.538270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699238524:3012]
2025-10-02T09:34:31.538315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df5a3483-10c2db99-64b745ca-a23fa234_0
2025-10-02T09:34:31.538452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2403 sessionId: src_id|df5a3483-10c2db99-64b745ca-a23fa234_0 is DEAD
2025-10-02T09:34:31.538611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:31.538627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Write session will restart in 0.005681s
2025-10-02T09:34:31.538648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Write session: Do CDS request
2025-10-02T09:34:31.538654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.545154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.545249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.545258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2404
2025-10-02T09:34:31.545369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.545390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.545396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.545399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.545678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2404 sessionId:  describe result for acl check
2025-10-02T09:34:31.545697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.545702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.545703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.545706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699238613:2966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.546036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699238613:2966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.547679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699238613:2966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.549261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.550697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.550889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.550898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.550905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.550937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.550959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623668721:7909]
2025-10-02T09:34:31.551023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699238613:2966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.551032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699238613:2966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.551034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699238613:2966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.551038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:31.551300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.551455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.551476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.551651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.551680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.551684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.551685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.551685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.551686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.551686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.551687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.551688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.551688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.551688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.551689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.551690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.551692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.551698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.551700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.551702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.551704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.551706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.551708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.551710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.551712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.551714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.551716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.551718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.551722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.551725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.551729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.551731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.551733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.551736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.551738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.551741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.551744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.551746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.551748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.551751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.551753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.551756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.551758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.551761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.551763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.551765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.551771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.551774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.551776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.551779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.551781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.551783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.551800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.559184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:31.560636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:31.560649Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:31.560650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:31.560652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:31.560656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2403 [2:7556555458623668721:7909]
2025-10-02T09:34:31.560663Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:31.560673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:31.560674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.560676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.560677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.560687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:31.560692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:31.560696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:31.560730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.560735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.560736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.560739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:31.560740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:31.560779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:31.560784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.560790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.560796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.560816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:31.560831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238762:2966], now have 1 active actors on pipe
2025-10-02T09:34:31.560837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238525:2446], now have 1 active actors on pipe
2025-10-02T09:34:31.560840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.560841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.560843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.560851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:31.560862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:31.560865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:31.560867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:31.560868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:31.560872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:31.560874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:31.560865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2403
2025-10-02T09:34:31.560872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2403
2025-10-02T09:34:31.560888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.560893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:31.560895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:31.560903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.560908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.560935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2954f6ef-4696aef4-e17706df-2d17c395_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:31.560942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.560944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.560945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.560950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.560956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:31.560968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.561057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.561062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.561070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.561115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2404 partition: 0 MaxSeqNo: 36 sessionId: src_id|2954f6ef-4696aef4-e17706df-2d17c395_0
2025-10-02T09:34:31.561332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a3483-10c2db99-64b745ca-a23fa234_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2954f6ef-4696aef4-e17706df-2d17c395_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:31.564115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Write session: try to update token
2025-10-02T09:34:31.564132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:31.570104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:31.570117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.570118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:31.570119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:31.570122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.570124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.570127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623668715:7909]
2025-10-02T09:34:31.570146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:31.570149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.570150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:31.570151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:31.570154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:31.570156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:31.570255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:31.577361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId: src_id|2954f6ef-4696aef4-e17706df-2d17c395_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:31.579520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.638582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555458699238778:3012]
2025-10-02T09:34:31.638768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2403, pipe: [1:7556555458699238778:3012]
2025-10-02T09:34:31.684071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.684395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.684404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.684416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238778:3012], now have 1 active actors on pipe
2025-10-02T09:34:31.684555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.684624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:31.684625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699238778:3012]
2025-10-02T09:34:31.684642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.684708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2404 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2954f6ef-4696aef4-e17706df-2d17c395_0
2025-10-02T09:34:31.684860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2404 sessionId: src_id|2954f6ef-4696aef4-e17706df-2d17c395_0 is DEAD
2025-10-02T09:34:31.685020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:31.685034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Write session will restart in 0.006735s
2025-10-02T09:34:31.685061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Write session: Do CDS request
2025-10-02T09:34:31.685067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.693125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.693249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.693258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2405
2025-10-02T09:34:31.693368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.693388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.693394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.693397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.693716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2405 sessionId:  describe result for acl check
2025-10-02T09:34:31.693745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.693749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.693751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.693754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699238923:2944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.694099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699238923:2944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.695668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.695735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699238923:2944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.696974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.697064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.697070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.697075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.697099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.697155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623668961:7898]
2025-10-02T09:34:31.697241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699238923:2944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.697249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699238923:2944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.697251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699238923:2944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.697254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:31.697491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.697650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.697672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.697843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.697871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.697875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.697876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.697876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.697877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.697877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.697878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.697878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.697879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.697879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.697880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.697881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.697883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.697889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.697891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.697893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.697895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.697897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.697899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.697901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.697903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.697905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.697907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.697908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.697912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.697916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.697919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.697922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.697924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.697926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.697929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.697931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.697934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.697936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.697938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.697941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.697943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.697946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.697949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.697951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.697954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.697957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.697958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.697961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.697963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.697965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.697967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.697970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.697985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.705316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:31.706854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:31.706866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:31.706867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:31.706869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:31.706872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2404 [2:7556555458623668961:7898]
2025-10-02T09:34:31.706878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:31.706888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:31.706893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.706895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.706895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.706904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:31.706907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:31.706911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:31.706941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.706946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.706947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.706948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:31.706950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:31.706984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:31.706989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.706995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.707001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.707009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:31.707022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699238779:2446], now have 1 active actors on pipe
2025-10-02T09:34:31.707028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239017:2944], now have 1 active actors on pipe
2025-10-02T09:34:31.707031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.707033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.707034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.707042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:31.707052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:31.707053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:31.707055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:31.707056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:31.707062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:31.707064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:31.707077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.707082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:31.707089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:31.707075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2404
2025-10-02T09:34:31.707151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2404
2025-10-02T09:34:31.707189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.707194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.707208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:31.707215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.707217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.707218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.707223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.707228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:31.707236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.707336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.707341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.707347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.707393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2405 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0
2025-10-02T09:34:31.707661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2954f6ef-4696aef4-e17706df-2d17c395_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:31.710411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Write session: try to update token
2025-10-02T09:34:31.710428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:31.715911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:31.715923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.715927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.715949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:31.715951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:31.716083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:31.716192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:31.716300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:31.716407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:31.716566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:31.716587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:31.723327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId: src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:31.724407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:31.724421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.724423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:31.724424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:31.724430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.724432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.724434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623668955:7898]
2025-10-02T09:34:31.724455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:31.724456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:31.724459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:31.724459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.724460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:31.724463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:31.724561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:31.725512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.784989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555458699239029:3012]
2025-10-02T09:34:31.785167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2404, pipe: [1:7556555458699239029:3012]
2025-10-02T09:34:31.837975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.838389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.838398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.838412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239029:3012], now have 1 active actors on pipe
2025-10-02T09:34:31.838569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.838603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.838700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:31.838706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:31.838736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699239029:3012]
2025-10-02T09:34:31.838750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2405 reason: error at write: Disconnected sessionId: src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0
2025-10-02T09:34:31.838918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2405 sessionId: src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0 is DEAD
2025-10-02T09:34:31.839083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:31.839096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Write session will restart in 0.006488s
2025-10-02T09:34:31.839119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Write session: Do CDS request
2025-10-02T09:34:31.839125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.846168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.846253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.846259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2406
2025-10-02T09:34:31.846356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.846376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.846381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.846384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.846702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2406 sessionId:  describe result for acl check
2025-10-02T09:34:31.846723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.846727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.846728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.846731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699239134:2926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.847072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699239134:2926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.848634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699239134:2926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.849756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.851214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.851392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.851388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699239134:2926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.851401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.851395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699239134:2926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.851408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.851397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699239134:2926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.851400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:31.851440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.851462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623669203:7906]
2025-10-02T09:34:31.851792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.851947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.851969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.852140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.852167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.852171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.852172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.852172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.852173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.852173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.852174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.852175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.852175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.852176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.852176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.852177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.852180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.852185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.852187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.852199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.852201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.852203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.852205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.852207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.852209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.852211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.852213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.852215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.852219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.852226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.852229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.852232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.852237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.852240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.852242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.852245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.852247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.852250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.852252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.852255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.852257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.852260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.852265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.852267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.852270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.852275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.852280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.852283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.852285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.852287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.852292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.852295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.852313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.859669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:31.861213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:31.861224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:31.861226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:31.861228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:31.861232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2405 [2:7556555458623669203:7906]
2025-10-02T09:34:31.861239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:31.861248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:31.861251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.861253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.861254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.861263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:31.861266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:31.861270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:31.861301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.861306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.861307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.861309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:31.861310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:31.861424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2405
2025-10-02T09:34:31.861436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2405
2025-10-02T09:34:31.861465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:31.861470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.861477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.861483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.861495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:31.861510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239030:2446], now have 1 active actors on pipe
2025-10-02T09:34:31.861515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239269:2926], now have 1 active actors on pipe
2025-10-02T09:34:31.861526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.861531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.861541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.861546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.861547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.861554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:31.861562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:31.861567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:31.861569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:31.861570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:31.861573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:31.861575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:31.861584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:31.861591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:31.861593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:31.861594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:31.861599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:31.861604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:31.861621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.861629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:31.861638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.861638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:31.861724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.861730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.861738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:31.861806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2406 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0
2025-10-02T09:34:31.862089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87b264-f06df82b-9d5c246d-7fa4999b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:31.864795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Write session: try to update token
2025-10-02T09:34:31.864831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:31.870848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:31.870861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:31.870862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:31.870863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:31.870867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.870869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.870873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623669197:7906]
2025-10-02T09:34:31.870893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:31.870895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:31.870898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:31.870899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.870900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:31.870901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:31.871029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:31.877883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId: src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:31.880012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:31.939114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555458699239288:3012]
2025-10-02T09:34:31.939308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2405, pipe: [1:7556555458699239288:3012]
2025-10-02T09:34:31.985401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:31.985693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:31.985703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:31.985715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239288:3012], now have 1 active actors on pipe
2025-10-02T09:34:31.985830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:31.985856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:31.985865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555458699239288:3012]
2025-10-02T09:34:31.985883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:31.985946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2406 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0
2025-10-02T09:34:31.986097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2406 sessionId: src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0 is DEAD
2025-10-02T09:34:31.986276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:31.986291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Write session will restart in 0.008367s
2025-10-02T09:34:31.986318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Write session: Do CDS request
2025-10-02T09:34:31.986325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:31.996149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.996291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:31.996300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2407
2025-10-02T09:34:31.996429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:31.996452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:31.996456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:31.996459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:31.996748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2407 sessionId:  describe result for acl check
2025-10-02T09:34:31.996771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:31.996772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:31.996773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:31.996776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555458699239496:2913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:31.996920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:31.997127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555458699239496:2913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:31.998372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555458699239496:2913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:31.998383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:31.998543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:31.998551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:31.998566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:31.998599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:31.998622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555458623669458:7899]
2025-10-02T09:34:31.998960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:31.999131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:31.999153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:31.999326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:31.999353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.999356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.999357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.999358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.999358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.999359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.999359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.999360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.999360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.999361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.999361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.999362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.999364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.999370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.999372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.999374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.999376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.999378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.999380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.999382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.999384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.999387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.999389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.999390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.999395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.999399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:31.999403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.999406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:31.999408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.999411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:31.999413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.999415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:31.999418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.999420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:31.999422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.999425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:31.999427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.999430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:31.999432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.999434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:31.999438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.999440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:31.999442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.999445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:31.999451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.999454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:31.999456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.999459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:31.999476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:31.999894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555458699239496:2913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:31.999901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555458699239496:2913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:31.999903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555458699239496:2913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:31.999906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.006988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.008552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.008564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.008565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.008568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.008571Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2406 [2:7556555458623669458:7899]
2025-10-02T09:34:32.008578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.008589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.008594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.008595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.008596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.008607Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.008609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.008615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.008649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.008653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.008655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.008656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.008658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.008698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.008703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.008710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.008715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.008727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.008742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239536:2913], now have 1 active actors on pipe
2025-10-02T09:34:32.008747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555458699239292:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.008751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.008752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.008753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.008761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.008768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.008774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.008777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.008779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.008778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.008780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.008797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.008773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2406
2025-10-02T09:34:32.008786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2406
2025-10-02T09:34:32.008816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.008819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.008834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.008839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.008861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.008868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.008870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.008871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.008877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.008882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.008891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.009017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.009022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.009032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.009087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2407 partition: 0 MaxSeqNo: 36 sessionId: src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0
2025-10-02T09:34:32.009353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9a5446-19e444c1-52b5c4a3-c82d9414_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.011861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Write session: try to update token
2025-10-02T09:34:32.011875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.018049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.018062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.018063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.018064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.018069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.018073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.018075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555458623669452:7899]
2025-10-02T09:34:32.018099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.018101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.018104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.018105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.018106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.018106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.018223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.023924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId: src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.026209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.086066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994206840:3012]
2025-10-02T09:34:32.086284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2406, pipe: [1:7556555462994206840:3012]
2025-10-02T09:34:32.130114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.130448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.130464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.130477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994206840:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.130654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.130653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:32.130653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.130665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:32.130689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994206840:3012]
2025-10-02T09:34:32.130715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2407 reason: error at write: Disconnected sessionId: src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0
2025-10-02T09:34:32.130876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2407 sessionId: src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0 is DEAD
2025-10-02T09:34:32.131071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:32.131086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Write session will restart in 0.008001s
2025-10-02T09:34:32.131108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Write session: Do CDS request
2025-10-02T09:34:32.131114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:32.140176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.140271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:32.140279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2408
2025-10-02T09:34:32.140402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.140423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:32.140428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:32.140430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:32.140689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2408 sessionId:  describe result for acl check
2025-10-02T09:34:32.140712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:32.140716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:32.140717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:32.140720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555462994207056:2888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:32.141073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555462994207056:2888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:32.141327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:32.142195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555462994207056:2888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:32.142863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:32.142965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:32.142971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:32.142977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:32.143005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:32.143028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555462918637000:7900]
2025-10-02T09:34:32.143357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:32.143522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:32.143546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:32.143730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:32.143720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555462994207056:2888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:32.143729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555462994207056:2888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:32.143731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555462994207056:2888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:32.143734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.143760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.143763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.143764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.143764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.143765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.143766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.143766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.143767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.143767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.143768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.143768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.143769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.143771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.143777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.143780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.143782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.143783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.143785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.143787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.143789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.143791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.143793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.143795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.143797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.143802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.143806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.143809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.143812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.143816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.143818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.143821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.143824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.143826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.143828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.143830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.143833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.143835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.143838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.143840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.143842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.143844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.143847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.143849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.143851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.143854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.143856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.143859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.143861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.143878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:32.151307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.152934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.152944Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.152945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.152947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.152951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2407 [2:7556555462918637000:7900]
2025-10-02T09:34:32.152958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.152968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.152973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.152975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.152976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.152984Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.152986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.152991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.153021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.153026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.153027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.153029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.153030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.153066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.153070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.153077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.153082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.153093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.153107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994206853:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.153112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207096:2888], now have 1 active actors on pipe
2025-10-02T09:34:32.153116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.153118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.153119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.153126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.153134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.153138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.153141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.153142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.153145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.153146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.153138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2407
2025-10-02T09:34:32.153141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2407
2025-10-02T09:34:32.153161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.153166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.153168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.153177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.153180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.153202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.153208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.153210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.153211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.153217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.153223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.153233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.153320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.153324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.153332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.153387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2408 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0
2025-10-02T09:34:32.153653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e965f7-333321bf-75b7d1f9-e8602f4b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.156357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Write session: try to update token
2025-10-02T09:34:32.156373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.162285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.162297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.162298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.162299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.162303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.162306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.162308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555462918636994:7900]
2025-10-02T09:34:32.162327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.162331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.162332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.162333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.162334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.162335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.162440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.169141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId: src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.171278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.230936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994207106:3012]
2025-10-02T09:34:32.231076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2407, pipe: [1:7556555462994207106:3012]
2025-10-02T09:34:32.272600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.272918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.272927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.272940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207106:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.273066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.273102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994207106:3012]
2025-10-02T09:34:32.273117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:32.273119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.273179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2408 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0
2025-10-02T09:34:32.273318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2408 sessionId: src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0 is DEAD
2025-10-02T09:34:32.273484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:32.273499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Write session will restart in 0.007542s
2025-10-02T09:34:32.273523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Write session: Do CDS request
2025-10-02T09:34:32.273528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:32.282186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.282290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:32.282297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2409
2025-10-02T09:34:32.282418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.282438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:32.282441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:32.282444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:32.282750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2409 sessionId:  describe result for acl check
2025-10-02T09:34:32.282771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:32.282772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:32.282773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:32.282776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555462994207303:2875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:32.283117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555462994207303:2875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:32.283814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:32.284557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555462994207303:2875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:32.285291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:32.285397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:32.285404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:32.285410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:32.285438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:32.285464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555462918637245:7895]
2025-10-02T09:34:32.285809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:32.285979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:32.286003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:32.286069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555462994207303:2875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:32.286076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555462994207303:2875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:32.286078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555462994207303:2875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:32.286082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.286184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:32.286213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.286217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.286218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.286218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.286219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.286220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.286220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.286221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.286221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.286222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.286223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.286224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.286227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.286233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.286235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.286237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.286239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.286241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.286243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.286245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.286247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.286249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.286251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.286253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.286257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.286261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.286265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.286268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.286270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.286273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.286275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.286278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.286281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.286284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.286286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.286288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.286292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.286295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.286297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.286300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.286306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.286310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.286312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.286314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.286316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.286321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.286323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.286325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.286342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:32.294040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.295675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.295688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.295689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.295691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.295695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2408 [2:7556555462918637245:7895]
2025-10-02T09:34:32.295701Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.295710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.295712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.295713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.295714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.295724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.295731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.295735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.295765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.295770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.295771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.295772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.295774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.295811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.295816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.295822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.295827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.295837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.295852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207109:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.295858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207353:2875], now have 1 active actors on pipe
2025-10-02T09:34:32.295861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.295862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.295863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.295871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.295881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.295888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.295890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.295892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.295875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2408
2025-10-02T09:34:32.295897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.295880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2408
2025-10-02T09:34:32.295898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.295906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.295908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.295915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.295919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.295921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.295942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|965f7ef-2b556306-c32edb15-99b1e10f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.295949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.295951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.295952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.295958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.295962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.295975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.296065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.296070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.296078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.296133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2409 partition: 0 MaxSeqNo: 36 sessionId: src_id|965f7ef-2b556306-c32edb15-99b1e10f_0
2025-10-02T09:34:32.296378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed780a6d-b63cddcd-374ee6cb-62611087_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|965f7ef-2b556306-c32edb15-99b1e10f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.299118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Write session: try to update token
2025-10-02T09:34:32.299135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.305196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.305207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.305208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.305209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.305212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.305215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.305218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555462918637239:7895]
2025-10-02T09:34:32.305236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.305242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.305242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.305243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.305245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.305247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.305350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.311710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId: src_id|965f7ef-2b556306-c32edb15-99b1e10f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.313875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.373294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994207362:3012]
2025-10-02T09:34:32.373475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2408, pipe: [1:7556555462994207362:3012]
2025-10-02T09:34:32.416009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.416435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.416445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.416457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207362:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.416568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.416592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:32.416602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:32.416606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.416640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994207362:3012]
2025-10-02T09:34:32.416640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2409 reason: error at write: Disconnected sessionId: src_id|965f7ef-2b556306-c32edb15-99b1e10f_0
2025-10-02T09:34:32.416781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2409 sessionId: src_id|965f7ef-2b556306-c32edb15-99b1e10f_0 is DEAD
2025-10-02T09:34:32.416967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:32.416982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Write session will restart in 0.009437s
2025-10-02T09:34:32.417009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Write session: Do CDS request
2025-10-02T09:34:32.417014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:32.427188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.427286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:32.427295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2410
2025-10-02T09:34:32.427334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:32.427411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.427430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:32.427436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:32.427439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:32.427718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2410 sessionId:  describe result for acl check
2025-10-02T09:34:32.427741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:32.427746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:32.427747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:32.427750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555462994207572:2854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:32.428079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555462994207572:2854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:32.428784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:32.428925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:32.428933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:32.428940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:32.428973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:32.428998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555462918637506:7869]
2025-10-02T09:34:32.429344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:32.429458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555462994207572:2854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:32.429506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:32.429529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:32.429812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:32.429851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.429855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.429856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.429856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.429857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.429857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.429858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.429859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.429859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.429860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.429860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.429861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.429863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.429869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.429871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.429873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.429875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.429877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.429879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.429881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.429883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.429886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.429888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.429890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.429893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.429897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.429900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.429903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.429905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.429908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.429910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.429913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.429915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.429918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.429920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.429922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.429924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.429927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.429929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.429932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.429934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.429936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.429938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.429941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.429943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.429946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.429948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.429951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.429968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:32.433777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555462994207572:2854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:32.433785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555462994207572:2854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:32.433787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555462994207572:2854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:32.433790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.437460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.438989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.439001Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.439002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.439004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.439008Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2409 [2:7556555462918637506:7869]
2025-10-02T09:34:32.439014Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.439023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.439024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.439026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.439026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.439036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.439042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.439047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.439074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.439079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.439080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.439082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.439083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.439120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.439125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.439131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.439137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.439146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.439160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207364:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.439165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207611:2854], now have 1 active actors on pipe
2025-10-02T09:34:32.439168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.439170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.439171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.439178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.439186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.439191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.439193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.439194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.439195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.439196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.439196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2409
2025-10-02T09:34:32.439198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2409
2025-10-02T09:34:32.439212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.439217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.439218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.439226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.439231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.439257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.439263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.439265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.439266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.439271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.439277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.439286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.439388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.439393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.439401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.439451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2410 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0
2025-10-02T09:34:32.439730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|965f7ef-2b556306-c32edb15-99b1e10f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.442447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Write session: try to update token
2025-10-02T09:34:32.442461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.448461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.448472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.448473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.448474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.448480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.448482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.448484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555462918637500:7869]
2025-10-02T09:34:32.448503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.448507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.448508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.448509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.448512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.448514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.448617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.455367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId: src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.457572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.516658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994207640:3012]
2025-10-02T09:34:32.516821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2409, pipe: [1:7556555462994207640:3012]
2025-10-02T09:34:32.559959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.560185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.560194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.560206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207640:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.560336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.560342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.560371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994207640:3012]
2025-10-02T09:34:32.560377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:32.560387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:32.560440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2410 reason: error at write: Disconnected sessionId: src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0
2025-10-02T09:34:32.560594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2410 sessionId: src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0 is DEAD
2025-10-02T09:34:32.560779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:32.560792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Write session will restart in 0.008935s
2025-10-02T09:34:32.560834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Write session: Do CDS request
2025-10-02T09:34:32.560841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:32.571092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:32.571162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.571505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:32.571513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2411
2025-10-02T09:34:32.571648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.571669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:32.571673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:32.571676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:32.571934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2411 sessionId:  describe result for acl check
2025-10-02T09:34:32.571954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:32.571958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:32.571959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:32.571962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555462994207852:2830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:32.572310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555462994207852:2830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:32.572553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:32.572644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:32.572651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:32.572656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:32.572681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:32.572703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555462918637776:7874]
2025-10-02T09:34:32.573061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:32.573213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:32.573247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:32.573495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:32.573525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.573529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.573530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.573530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.573531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.573532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.573532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.573533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.573533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.573534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.573535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.573535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.573538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.573544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.573546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.573548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.573551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.573553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.573555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.573557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.573559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.573562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.573564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.573566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.573570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.573574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.573577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.573580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.573582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.573585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.573588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.573591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.573594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.573597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.573599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.573602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.573604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.573607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.573610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.573613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.573615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.573618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.573621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.573623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.573626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.573629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.573635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.573639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.573658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:32.573840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555462994207852:2830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:32.578378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555462994207852:2830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:32.578386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555462994207852:2830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:32.578388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555462994207852:2830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:32.578391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.581122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.582751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.582762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.582763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.582765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.582768Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2410 [2:7556555462918637776:7874]
2025-10-02T09:34:32.582776Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.582786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.582788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.582789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.582790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.582799Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.582804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.582808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.582839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.582844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.582845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.582847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.582848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.582883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.582888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.582894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.582900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.582908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.582922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207890:2830], now have 1 active actors on pipe
2025-10-02T09:34:32.582928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207642:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.582931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.582932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.582933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.582941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.582952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.582954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.582956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.582957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.582963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.582964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.582966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2410
2025-10-02T09:34:32.582967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2410
2025-10-02T09:34:32.582980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.582985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.582987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.583000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.583005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.583146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.583154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.583156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.583157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.583162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.583167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.583184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.583295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.583299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.583307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.583357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2411 partition: 0 MaxSeqNo: 36 sessionId: src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0
2025-10-02T09:34:32.583604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc37c7cc-a6520f7e-d7fb9388-66a0dc93_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.586326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Write session: try to update token
2025-10-02T09:34:32.586342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.592068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.592079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.592080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.592081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.592084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.592087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.592089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555462918637770:7874]
2025-10-02T09:34:32.592109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.592112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.592115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.592116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.592117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.592117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.592237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.599014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId: src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.601139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.660522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994207897:3012]
2025-10-02T09:34:32.660706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2410, pipe: [1:7556555462994207897:3012]
2025-10-02T09:34:32.705288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.705515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.705525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.705537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207897:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.705698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.705759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:32.705827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2411 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0
2025-10-02T09:34:32.705865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.705900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994207897:3012]
2025-10-02T09:34:32.705964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2411 sessionId: src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0 is DEAD
2025-10-02T09:34:32.706120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:32.706133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Write session will restart in 0.006204s
2025-10-02T09:34:32.706158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Write session: Do CDS request
2025-10-02T09:34:32.706163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:32.713141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.713237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:32.713243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2412
2025-10-02T09:34:32.713360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.713380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:32.713385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:32.713388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:32.713696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2412 sessionId:  describe result for acl check
2025-10-02T09:34:32.713718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:32.713723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:32.713724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:32.713726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555462994208007:2810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:32.714068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555462994208007:2810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:32.716108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555462994208007:2810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:32.717032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:32.718737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:32.718843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:32.718851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:32.718857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:32.718885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:32.718910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555462918638023:7871]
2025-10-02T09:34:32.718957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555462994208007:2810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:32.718965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555462994208007:2810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:32.718967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555462994208007:2810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:32.718971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.719252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:32.719412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:32.719434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:32.719611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:32.719640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.719643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.719644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.719645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.719645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.719646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.719646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.719647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.719647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.719648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.719648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.719649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.719652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.719658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.719660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.719662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.719664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.719666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.719668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.719670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.719672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.719674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.719676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.719678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.719681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.719685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.719688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.719691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.719693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.719696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.719698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.719701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.719703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.719706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.719708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.719711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.719717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.719720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.719722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.719724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.719726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.719729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.719733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.719736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.719739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.719745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.719748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.719751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.719769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:32.727214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.728651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.728662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.728663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.728666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.728670Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2411 [2:7556555462918638023:7871]
2025-10-02T09:34:32.728679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.728689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.728695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.728696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.728697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.728707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.728711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.728715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.728747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.728752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.728753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.728755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.728756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.728792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.728797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.728816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.728825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.728836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.728849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994207898:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.728855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994208143:2810], now have 1 active actors on pipe
2025-10-02T09:34:32.728858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.728860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.728861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.728869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.728879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.728884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.728886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.728888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.728889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.728890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.728875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2411
2025-10-02T09:34:32.728877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2411
2025-10-02T09:34:32.728907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.728912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.728914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.728925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.728929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.728956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10d34d94-efdea2e5-59b18c08-be97796d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.728962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.728964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.728966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.728971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.728979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.728988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.729079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.729083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.729091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.729144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2412 partition: 0 MaxSeqNo: 36 sessionId: src_id|10d34d94-efdea2e5-59b18c08-be97796d_0
2025-10-02T09:34:32.729432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1487d3af-267b2aee-4e4f9ef6-adb8f9f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10d34d94-efdea2e5-59b18c08-be97796d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.732209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Write session: try to update token
2025-10-02T09:34:32.732225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.738050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.738064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.738066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.738067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.738070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.738072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.738075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555462918638017:7871]
2025-10-02T09:34:32.738094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.738097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.738098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.738098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.738102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.738104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.738218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.745878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId: src_id|10d34d94-efdea2e5-59b18c08-be97796d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.748057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.805907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994208155:3012]
2025-10-02T09:34:32.806070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2411, pipe: [1:7556555462994208155:3012]
2025-10-02T09:34:32.848124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.848348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.848358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.848370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994208155:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.848516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.848516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994208155:3012]
2025-10-02T09:34:32.848536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.848543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:32.848546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:32.848592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2412 reason: error at write: Disconnected sessionId: src_id|10d34d94-efdea2e5-59b18c08-be97796d_0
2025-10-02T09:34:32.848723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2412 sessionId: src_id|10d34d94-efdea2e5-59b18c08-be97796d_0 is DEAD
2025-10-02T09:34:32.848892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:32.848906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Write session will restart in 0.006161s
2025-10-02T09:34:32.848928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Write session: Do CDS request
2025-10-02T09:34:32.848934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:32.856128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.856254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:32.856262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2413
2025-10-02T09:34:32.856375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:32.856395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:32.856401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:32.856403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:32.856668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2413 sessionId:  describe result for acl check
2025-10-02T09:34:32.856692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:32.856696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:32.856698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:32.856701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555462994208273:2795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:32.857058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555462994208273:2795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:32.858900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555462994208273:2795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:32.859993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:32.861360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:32.861463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:32.861470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:32.861476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:32.861504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:32.861526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555462918638271:7866]
2025-10-02T09:34:32.861568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555462994208273:2795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:32.861576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555462994208273:2795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:32.861578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555462994208273:2795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:32.861581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:32.861870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:32.862030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:32.862052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:32.862226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:32.862256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.862260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.862261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.862261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.862262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.862262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.862263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.862264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.862264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.862265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.862265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.862266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.862269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.862274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.862277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.862279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.862280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.862283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.862285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.862287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.862289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.862292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.862294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.862295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.862299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.862303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:32.862306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.862309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:32.862311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.862314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:32.862316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.862319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:32.862321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.862324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:32.862326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.862329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:32.862331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.862334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:32.862336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.862339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:32.862341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.862343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:32.862347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.862350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.862352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.862355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.862357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.862361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.862378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:32.869860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:32.871434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:32.871447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:32.871448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:32.871450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:32.871454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2412 [2:7556555462918638271:7866]
2025-10-02T09:34:32.871461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:32.871471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:32.871473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.871474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.871475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.871484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:32.871487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:32.871491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:32.871520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.871526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.871528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.871529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:32.871531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:32.871567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:32.871572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.871578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:32.871583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:32.871591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:32.871605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994208402:2795], now have 1 active actors on pipe
2025-10-02T09:34:32.871610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994208156:2446], now have 1 active actors on pipe
2025-10-02T09:34:32.871613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.871614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.871615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.871623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:32.871630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:32.871636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:32.871638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:32.871639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:32.871641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:32.871642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:32.871629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2412
2025-10-02T09:34:32.871637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2412
2025-10-02T09:34:32.871656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.871660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:32.871661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:32.871669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.871671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.871696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:32.871704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:32.871706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:32.871707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:32.871713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:32.871718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:32.871729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.871819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.871824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.871832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:32.871888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2413 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0
2025-10-02T09:34:32.872134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d34d94-efdea2e5-59b18c08-be97796d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:32.874869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Write session: try to update token
2025-10-02T09:34:32.874883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:32.880775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:32.880786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:32.880787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:32.880788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:32.880791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.880794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.880796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555462918638265:7866]
2025-10-02T09:34:32.880824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:32.880826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:32.880827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:32.880829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:32.880829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:32.880831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:32.881253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:32.887395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId: src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:32.889497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:32.948759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555462994208424:3012]
2025-10-02T09:34:32.948931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2412, pipe: [1:7556555462994208424:3012]
2025-10-02T09:34:32.990793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:32.991182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:32.991191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:32.991203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994208424:3012], now have 1 active actors on pipe
2025-10-02T09:34:32.991312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:32.991332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:32.991349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555462994208424:3012]
2025-10-02T09:34:32.991368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:32.991418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2413 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0
2025-10-02T09:34:32.991547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2413 sessionId: src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0 is DEAD
2025-10-02T09:34:32.991663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:32.991672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Write session will restart in 0.009632s
2025-10-02T09:34:32.991686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Write session: Do CDS request
2025-10-02T09:34:32.991690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.002246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.002313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.002323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2414
2025-10-02T09:34:33.002449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.002468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.002474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.002477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.002582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.002746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2414 sessionId:  describe result for acl check
2025-10-02T09:34:33.002769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.002773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.002774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.002778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289175932:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.003124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289175932:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.004004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.004096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.004102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.004108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.004133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.004160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213605829:7861]
2025-10-02T09:34:33.004402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289175932:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.004492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.004647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.004669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.004853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.004883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.004886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.004887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.004887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.004888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.004889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.004889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.004890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.004890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.004890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.004891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.004892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.004894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.004900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.004902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.004904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.004906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.004908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.004910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.004912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.004914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.004916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.004918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.004920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.004923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.004927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.004931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.004934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.004936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.004938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.004940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.004943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.004945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.004948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.004950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.004953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.004955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.004958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.004960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.004963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.004965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.004967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.004969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.004972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.004974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.004977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.004979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.004982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.004999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.008754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289175932:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.008762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289175932:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.008763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289175932:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.008767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.012429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.013921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.013933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.013934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.013936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.013940Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2413 [2:7556555467213605829:7861]
2025-10-02T09:34:33.013947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.013960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.013964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.013966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.013967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.013975Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.013982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.013986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.014016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.014022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.014023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.014025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.014026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.014061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.014066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.014072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.014080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.014091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.014105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555462994208425:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.014110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289175972:2785], now have 1 active actors on pipe
2025-10-02T09:34:33.014114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.014115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.014116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.014124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.014131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.014136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.014138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.014140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.014141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.014143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.014134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2413
2025-10-02T09:34:33.014156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.014161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.014162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.014162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2413
2025-10-02T09:34:33.014171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.014176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.014203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|523c5212-69518169-d6cb4a49-bfa046e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.014210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.014212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.014213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.014218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.014227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.014319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.014441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.014446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.014453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.014508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2414 partition: 0 MaxSeqNo: 36 sessionId: src_id|523c5212-69518169-d6cb4a49-bfa046e5_0
2025-10-02T09:34:33.014778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2d1dff-9ad9fc2f-34288b51-137aa3c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|523c5212-69518169-d6cb4a49-bfa046e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.017514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Write session: try to update token
2025-10-02T09:34:33.017530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.023328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.023340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.023342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.023342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.023346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.023349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.023351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213605823:7861]
2025-10-02T09:34:33.023371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.023374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.023376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.023376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.023377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.023380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.023517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.030521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId: src_id|523c5212-69518169-d6cb4a49-bfa046e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.032679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.091618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289175980:3012]
2025-10-02T09:34:33.091805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2413, pipe: [1:7556555467289175980:3012]
2025-10-02T09:34:33.133136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:33.133632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.133647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.133661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289175980:3012], now have 1 active actors on pipe
2025-10-02T09:34:33.133843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:33.133854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289175980:3012]
2025-10-02T09:34:33.133870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:33.133872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:33.133916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2414 reason: error at write: Disconnected sessionId: src_id|523c5212-69518169-d6cb4a49-bfa046e5_0
2025-10-02T09:34:33.134052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2414 sessionId: src_id|523c5212-69518169-d6cb4a49-bfa046e5_0 is DEAD
2025-10-02T09:34:33.134218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:33.134231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Write session will restart in 0.007259s
2025-10-02T09:34:33.134253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Write session: Do CDS request
2025-10-02T09:34:33.134261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.134241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:33.142159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.142270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.142279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2415
2025-10-02T09:34:33.142403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.142423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.142429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.142432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.142811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2415 sessionId:  describe result for acl check
2025-10-02T09:34:33.142834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.142838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.142839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.142842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289176148:2759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.143167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289176148:2759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.144729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289176148:2759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.146054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.146215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289176148:2759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.146222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289176148:2759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.146224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289176148:2759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.146227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.146281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.146372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.146379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.146385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.146411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.146432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213606083:7856]
2025-10-02T09:34:33.146777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.146933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.146956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.147140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.147168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.147172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.147172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.147173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.147173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.147174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.147175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.147175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.147176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.147176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.147177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.147177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.147180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.147186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.147188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.147190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.147192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.147194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.147196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.147198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.147200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.147202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.147204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.147206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.147210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.147214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.147218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.147220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.147222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.147225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.147227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.147230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.147232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.147234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.147236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.147239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.147241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.147243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.147245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.147248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.147250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.147253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.147255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.147257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.147259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.147262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.147264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.147266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.147282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.154701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.156237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.156249Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.156250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.156252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.156256Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2414 [2:7556555467213606083:7856]
2025-10-02T09:34:33.156264Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.156273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.156275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.156276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.156277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.156286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.156289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.156293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.156322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.156328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.156330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.156332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.156333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.156369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.156374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.156380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.156385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.156396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.156409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289175993:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.156414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176241:2759], now have 1 active actors on pipe
2025-10-02T09:34:33.156418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.156419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.156420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.156427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.156434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.156431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2414
2025-10-02T09:34:33.156438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.156441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.156446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2414
2025-10-02T09:34:33.156442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.156446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.156447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.156462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.156463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.156467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.156473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.156475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.156497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.156504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.156506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.156507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.156513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.156518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.156527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.156620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.156625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.156633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.156690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2415 partition: 0 MaxSeqNo: 36 sessionId: src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0
2025-10-02T09:34:33.156950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|523c5212-69518169-d6cb4a49-bfa046e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.159663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Write session: try to update token
2025-10-02T09:34:33.159676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.165550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.165563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.165565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.165567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.165572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.165574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.165578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213606077:7856]
2025-10-02T09:34:33.165597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.165603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.165604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.165606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.165610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.165613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.165709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.171958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId: src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.174127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.233952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289176253:3012]
2025-10-02T09:34:33.234083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2414, pipe: [1:7556555467289176253:3012]
2025-10-02T09:34:33.275412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:33.275826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.275835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.275848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176253:3012], now have 1 active actors on pipe
2025-10-02T09:34:33.275985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:33.275999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289176253:3012]
2025-10-02T09:34:33.276005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:33.276016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:33.276018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:33.276066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2415 reason: error at write: Disconnected sessionId: src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0
2025-10-02T09:34:33.276196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2415 sessionId: src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0 is DEAD
2025-10-02T09:34:33.276361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:33.276378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Write session will restart in 0.007640s
2025-10-02T09:34:33.276404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Write session: Do CDS request
2025-10-02T09:34:33.276409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.285161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.285267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.285275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2416
2025-10-02T09:34:33.285420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.285448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.285450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.285453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.285844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2416 sessionId:  describe result for acl check
2025-10-02T09:34:33.285869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.285874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.285875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.285878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289176408:2753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.286233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289176408:2753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.287770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289176408:2753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.288298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.289644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.289744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.289751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.289757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.289784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.289808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213606334:7853]
2025-10-02T09:34:33.289829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289176408:2753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.289837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289176408:2753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.289838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289176408:2753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.289842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.290142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.290309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.290331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.290507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.290535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.290539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.290539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.290540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.290540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.290541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.290541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.290542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.290542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.290543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.290543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.290544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.290547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.290560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.290562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.290564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.290566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.290568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.290570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.290572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.290574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.290576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.290578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.290580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.290584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.290588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.290591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.290594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.290596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.290599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.290601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.290603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.290605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.290608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.290610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.290612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.290615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.290617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.290620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.290626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.290628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.290631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.290633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.290636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.290640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.290643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.290645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.290647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.290666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.298100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.299548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.299561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.299562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.299564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.299568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2415 [2:7556555467213606334:7853]
2025-10-02T09:34:33.299574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.299583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.299588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.299590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.299591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.299601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.299604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.299608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.299641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.299646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.299647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.299650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.299651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.299686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.299691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.299697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.299702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.299711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.299724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176511:2753], now have 1 active actors on pipe
2025-10-02T09:34:33.299729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176256:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.299732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.299734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.299735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.299742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.299750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.299754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.299756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.299757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.299760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.299762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.299757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2415
2025-10-02T09:34:33.299775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.299772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2415
2025-10-02T09:34:33.299780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.299781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.299792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.299796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.299828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.299835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.299837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.299838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.299843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.299850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.299859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.299954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.299959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.299966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.300022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2416 partition: 0 MaxSeqNo: 36 sessionId: src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0
2025-10-02T09:34:33.300278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee7b952-a9fa3ef7-ef6eca15-f6b2e186_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.303004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Write session: try to update token
2025-10-02T09:34:33.303020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.308887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.308899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.308900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.308901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.308905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.308907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.308909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213606329:7853]
2025-10-02T09:34:33.308929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.308930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.308935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.308936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.308985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.308994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.309056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.315563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId: src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.317692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.376292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289176523:3012]
2025-10-02T09:34:33.376458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2415, pipe: [1:7556555467289176523:3012]
2025-10-02T09:34:33.418874Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:33.419515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.419528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.419543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176523:3012], now have 1 active actors on pipe
2025-10-02T09:34:33.419726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:33.419732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289176523:3012]
2025-10-02T09:34:33.419748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:33.419750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:33.419812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2416 reason: error at write: Disconnected sessionId: src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0
2025-10-02T09:34:33.419939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:33.419948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2416 sessionId: src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0 is DEAD
2025-10-02T09:34:33.420106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:33.420119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Write session will restart in 0.007995s
2025-10-02T09:34:33.420144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Write session: Do CDS request
2025-10-02T09:34:33.420150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.429177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.429277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.429283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2417
2025-10-02T09:34:33.429560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.429579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.429585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.429587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.429876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2417 sessionId:  describe result for acl check
2025-10-02T09:34:33.429898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.429902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.429903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.429907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289176715:2737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.430271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289176715:2737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.431288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.431359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289176715:2737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.432622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.432719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.432726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.432732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.432766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.432791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213606589:7847]
2025-10-02T09:34:33.432913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289176715:2737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.432920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289176715:2737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.432922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289176715:2737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.432925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.433143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.433303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.433327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.433503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.433530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.433534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.433534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.433535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.433535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.433536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.433536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.433537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.433537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.433538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.433539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.433539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.433542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.433547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.433550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.433552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.433554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.433556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.433558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.433560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.433562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.433565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.433567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.433569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.433572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.433577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.433581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.433584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.433586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.433588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.433591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.433593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.433595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.433602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.433604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.433606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.433609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.433611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.433614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.433616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.433618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.433621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.433625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.433627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.433630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.433632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.433634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.433637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.433654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.441137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.442670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.442681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.442682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.442684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.442687Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2416 [2:7556555467213606589:7847]
2025-10-02T09:34:33.442694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.442703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.442705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.442706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.442707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.442716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.442718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.442722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.442753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.442759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.442759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.442761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.442763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.442799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.442803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.442809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.442815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.442826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.442839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176775:2737], now have 1 active actors on pipe
2025-10-02T09:34:33.442844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176525:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.442847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.442849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.442850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.442857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.442864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.442871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.442872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.442873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.442874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.442874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.442889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.442897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.442900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.442887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2416
2025-10-02T09:34:33.442888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2416
2025-10-02T09:34:33.442915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.442920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.442936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b675c34-2d53b68-8adcaa99-39800fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.442943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.442945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.442946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.442950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.442959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.442966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.443065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.443070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.443078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.443140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2417 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b675c34-2d53b68-8adcaa99-39800fe_0
2025-10-02T09:34:33.443403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f6fcf4-74f4f4f3-15230b5f-2f51ea2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b675c34-2d53b68-8adcaa99-39800fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.445983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Write session: try to update token
2025-10-02T09:34:33.445997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.452032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.452047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.452048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.452050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.452055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.452058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.452060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213606583:7847]
2025-10-02T09:34:33.452080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.452081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.452084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.452086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.452086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.452087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.452191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.458374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId: src_id|4b675c34-2d53b68-8adcaa99-39800fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.460537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.519650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289176799:3012]
2025-10-02T09:34:33.519834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2416, pipe: [1:7556555467289176799:3012]
2025-10-02T09:34:33.563908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:33.564324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.564334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.564346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176799:3012], now have 1 active actors on pipe
2025-10-02T09:34:33.564470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:33.564480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:33.564484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289176799:3012]
2025-10-02T09:34:33.564493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:33.564497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:33.564547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2417 reason: error at write: Disconnected sessionId: src_id|4b675c34-2d53b68-8adcaa99-39800fe_0
2025-10-02T09:34:33.564688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2417 sessionId: src_id|4b675c34-2d53b68-8adcaa99-39800fe_0 is DEAD
2025-10-02T09:34:33.564818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:33.564827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Write session will restart in 0.008084s
2025-10-02T09:34:33.564842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Write session: Do CDS request
2025-10-02T09:34:33.564846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.574216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.574322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.574332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2418
2025-10-02T09:34:33.574457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.574480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.574486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.574488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.574749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2418 sessionId:  describe result for acl check
2025-10-02T09:34:33.574767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.574771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.574772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.574775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289177023:2686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.575102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289177023:2686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.575494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.576720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289177023:2686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.577137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.577278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.577286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.577292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.577322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.577348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213606879:7810]
2025-10-02T09:34:33.577690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.577849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.577874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.578045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.578073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.578076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.578077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.578077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.578078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.578078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.578079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.578079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.578080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.578080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.578081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.578082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.578085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.578091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.578093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.578095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.578097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.578099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.578101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.578103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.578105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.578107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.578109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.578111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.578115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.578119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.578122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.578125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.578127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.578130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.578132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.578135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.578138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.578140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.578142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.578145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.578149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.578153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.578156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.578160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.578165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.578169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.578177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.578181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.578189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.578192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.578196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.578198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.578216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.578570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289177023:2686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.578579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289177023:2686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.578580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289177023:2686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.578584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.585636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.587341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.587354Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.587355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.587357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.587360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2417 [2:7556555467213606879:7810]
2025-10-02T09:34:33.587366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.587375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.587377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.587378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.587379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.587388Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.587392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.587395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.587423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.587428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.587429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.587431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.587433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.587468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.587473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.587479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.587484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.587496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.587509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289176810:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.587515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177065:2686], now have 1 active actors on pipe
2025-10-02T09:34:33.587518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.587519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.587520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.587527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.587534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.587541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.587543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.587545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.587550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.587551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.587558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.587548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2417
2025-10-02T09:34:33.587560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.587566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.587561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2417
2025-10-02T09:34:33.587581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.587586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.587600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.587607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.587609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.587610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.587614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.587622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.587632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.587735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.587739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.587747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.587806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2418 partition: 0 MaxSeqNo: 36 sessionId: src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0
2025-10-02T09:34:33.588057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b675c34-2d53b68-8adcaa99-39800fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.590695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Write session: try to update token
2025-10-02T09:34:33.590706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.596901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.596913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.596915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.596916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.596922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.596926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.596929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213606873:7810]
2025-10-02T09:34:33.596951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.596954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.596956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.596994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.597016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.597024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.597066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.602821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId: src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.604974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.664565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289177072:3012]
2025-10-02T09:34:33.664766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2417, pipe: [1:7556555467289177072:3012]
2025-10-02T09:34:33.710796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:33.711183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.711193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.711206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177072:3012], now have 1 active actors on pipe
2025-10-02T09:34:33.711346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:33.711400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:33.711414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289177072:3012]
2025-10-02T09:34:33.711428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:33.711472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2418 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0
2025-10-02T09:34:33.711593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2418 sessionId: src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0 is DEAD
2025-10-02T09:34:33.711744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:33.711756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Write session will restart in 0.009876s
2025-10-02T09:34:33.711781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Write session: Do CDS request
2025-10-02T09:34:33.711786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.722170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.722269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.722278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2419
2025-10-02T09:34:33.722620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.722640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.722644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.722646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.722903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2419 sessionId:  describe result for acl check
2025-10-02T09:34:33.722896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.722926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.722932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.722934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.722938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289177291:2662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.723301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289177291:2662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.724314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.724416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.724423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.724429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.724456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.724481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213607133:7820]
2025-10-02T09:34:33.724844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.724865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289177291:2662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.725003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.725026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.725209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.725237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.725241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.725242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.725242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.725242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.725243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.725243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.725244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.725245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.725245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.725246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.725246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.725249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.725255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.725257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.725259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.725261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.725266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.725268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.725269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.725272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.725274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.725276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.725285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.725288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.725292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.725294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.725296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.725299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.725301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.725303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.725306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.725308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.725311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.725313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.725316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.725318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.725320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.725323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.725326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.725328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.725332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.725334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.725337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.725339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.725342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.725357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.729256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289177291:2662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.729265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289177291:2662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.729267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289177291:2662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.729271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.732974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.734647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.734660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.734662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.734665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.734670Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2418 [2:7556555467213607133:7820]
2025-10-02T09:34:33.734880Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.734896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.734901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.734903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.734904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.734913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.734921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.734926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.734966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.734971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.734972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.734973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.734975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.735011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.735016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.735023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.735028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.735039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.735055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177073:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.735060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177331:2662], now have 1 active actors on pipe
2025-10-02T09:34:33.735063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.735065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.735066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.735073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.735080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.735085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.735087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.735089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.735094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.735095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.735095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2418
2025-10-02T09:34:33.735104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.735106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.735097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2418
2025-10-02T09:34:33.735108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.735125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.735126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.735143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.735151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.735153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.735156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.735161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.735169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.735181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.735292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.735297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.735304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.735365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2419 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0
2025-10-02T09:34:33.735643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6832462d-8c4b1328-5b6cf3fd-e2682683_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.738169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Write session: try to update token
2025-10-02T09:34:33.738183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.744386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.744400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.744402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.744403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.744408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.744412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.744414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213607127:7820]
2025-10-02T09:34:33.744437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.744437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.744440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.744442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.744443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.744443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.744559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.749257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId: src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.751350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.811479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289177338:3012]
2025-10-02T09:34:33.811661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2418, pipe: [1:7556555467289177338:3012]
2025-10-02T09:34:33.855470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:33.855699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.855711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.855739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177338:3012], now have 1 active actors on pipe
2025-10-02T09:34:33.855855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:33.855886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:33.855898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289177338:3012]
2025-10-02T09:34:33.855915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:33.855976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2419 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0
2025-10-02T09:34:33.856119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2419 sessionId: src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0 is DEAD
2025-10-02T09:34:33.856246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:33.856255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Write session will restart in 0.005029s
2025-10-02T09:34:33.856269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Write session: Do CDS request
2025-10-02T09:34:33.856274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:33.862203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.862292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:33.862300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2420
2025-10-02T09:34:33.862378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:33.862399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:33.862404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:33.862406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:33.862702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2420 sessionId:  describe result for acl check
2025-10-02T09:34:33.862720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:33.862724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:33.862727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:33.862729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555467289177396:2654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:33.863063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555467289177396:2654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:33.865047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555467289177396:2654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:33.867114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555467289177396:2654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:33.867122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555467289177396:2654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:33.867124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555467289177396:2654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:33.867127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:33.867762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:33.869203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:33.869295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:33.869302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:33.869307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:33.869332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:33.869355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555467213607389:7821]
2025-10-02T09:34:33.869695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:33.869864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:33.869885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:33.870060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:33.870087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.870091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.870091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.870092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.870092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.870093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.870093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.870094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.870094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.870095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.870096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.870096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.870099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.870105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.870107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.870109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.870111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.870113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.870115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.870117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.870119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.870121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.870122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.870124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.870128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.870131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:33.870134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.870137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:33.870140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.870143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:33.870145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.870147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:33.870149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.870152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:33.870155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.870157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:33.870160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.870162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:33.870164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.870167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:33.870169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.870172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:33.870174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.870180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.870184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.870187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.870189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.870191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.870207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:33.877646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:33.879210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:33.879222Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:33.879223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:33.879225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:33.879229Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2419 [2:7556555467213607389:7821]
2025-10-02T09:34:33.879237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:33.879246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:33.879251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.879253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.879254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.879263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:33.879266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:33.879272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:33.879301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.879306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.879307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.879309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:33.879310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:33.879347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:33.879351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.879358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:33.879363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:33.879373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:33.879387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177339:2446], now have 1 active actors on pipe
2025-10-02T09:34:33.879392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177591:2654], now have 1 active actors on pipe
2025-10-02T09:34:33.879395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.879396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.879397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.879405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:33.879415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:33.879418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:33.879420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:33.879421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:33.879424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:33.879425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:33.879440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.879445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:33.879447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:33.879429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2419
2025-10-02T09:34:33.879439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2419
2025-10-02T09:34:33.879460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.879465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.879483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:33.879490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:33.879492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:33.879493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:33.879499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:33.879505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:33.879514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.879614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:33.879618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:33.879626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:33.879670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2420 partition: 0 MaxSeqNo: 36 sessionId: src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0
2025-10-02T09:34:33.879874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bddb4f3-62e57a4e-6cac8687-6b6ad56f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:33.882439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Write session: try to update token
2025-10-02T09:34:33.882451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:33.888910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:33.888924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:33.888925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:33.888926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:33.888931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.888934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.888937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555467213607384:7821]
2025-10-02T09:34:33.888957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:33.888960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:33.888962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:33.888995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:33.889018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:33.889024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:33.889072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:33.893951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId: src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:33.896034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:33.955864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555467289177612:3012]
2025-10-02T09:34:33.956014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2419, pipe: [1:7556555467289177612:3012]
2025-10-02T09:34:34.000928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.001132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.001142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.001168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555467289177612:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.001294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.001360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.001363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:34.001398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555467289177612:3012]
2025-10-02T09:34:34.001421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2420 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0
2025-10-02T09:34:34.001552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2420 sessionId: src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0 is DEAD
2025-10-02T09:34:34.001700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:34.001709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Write session will restart in 0.007995s
2025-10-02T09:34:34.001725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Write session: Do CDS request
2025-10-02T09:34:34.001730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.011308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.011339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.011346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2421
2025-10-02T09:34:34.011478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.011497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.011503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.011505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.011796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2421 sessionId:  describe result for acl check
2025-10-02T09:34:34.011820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.011824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.011825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.011828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584145109:2645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.012159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584145109:2645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.013160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.013546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584145109:2645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.014471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.014604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.014610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.014619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.014668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.014692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508574953:7817]
2025-10-02T09:34:34.015080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.015083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584145109:2645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.015092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584145109:2645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.015094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584145109:2645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.015097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.015261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.015302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.015489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.015518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.015522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.015523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.015523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.015524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.015524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.015525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.015525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.015526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.015526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.015527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.015527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.015530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.015536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.015538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.015540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.015542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.015544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.015546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.015547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.015549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.015551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.015553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.015555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.015559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.015563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.015567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.015570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.015572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.015575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.015578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.015581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.015585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.015588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.015590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.015593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.015596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.015601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.015603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.015606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.015608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.015611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.015615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.015617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.015620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.015623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.015625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.015627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.015645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.023146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.024836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.024851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.024853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.024856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.024861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2420 [2:7556555471508574953:7817]
2025-10-02T09:34:34.024872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.024891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.024898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.024901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.024902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.024911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.024914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.024918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.024954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.024960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.024962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.024964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.024965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.025008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.025013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.025020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.025025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.025036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.025053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584144909:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.025058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145163:2645], now have 1 active actors on pipe
2025-10-02T09:34:34.025062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.025064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.025065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.025073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.025087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.025091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.025097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.025098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.025099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.025100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.025097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2420
2025-10-02T09:34:34.025115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.025097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2420
2025-10-02T09:34:34.025121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.025122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.025137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.025143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.025164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.025170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.025173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.025174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.025180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.025185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.025199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.025297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.025302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.025309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.025359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2421 partition: 0 MaxSeqNo: 36 sessionId: src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0
2025-10-02T09:34:34.025626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a3d224-841f6ebd-c9accac3-c6e6ad1c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.028187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Write session: try to update token
2025-10-02T09:34:34.028199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.034878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.034894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.034895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.034896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.034901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.034904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.034907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508574947:7817]
2025-10-02T09:34:34.034931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.034935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.034936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.034938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.034942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.034947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.035062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.040028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId: src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.042159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.101762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584145187:3012]
2025-10-02T09:34:34.101875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2420, pipe: [1:7556555471584145187:3012]
2025-10-02T09:34:34.147162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.147380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.147394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.147424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145187:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.147582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.147601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:34.147603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:34.147615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584145187:3012]
2025-10-02T09:34:34.147645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2421 reason: error at write: Disconnected sessionId: src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0
2025-10-02T09:34:34.147788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2421 sessionId: src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0 is DEAD
2025-10-02T09:34:34.147897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.147965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:34.147980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Write session will restart in 0.008540s
2025-10-02T09:34:34.148006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Write session: Do CDS request
2025-10-02T09:34:34.148012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.157162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.157246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.157253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2422
2025-10-02T09:34:34.157391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.157411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.157416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.157419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.157667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2422 sessionId:  describe result for acl check
2025-10-02T09:34:34.157688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.157693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.157694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.157696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584145370:2623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.158025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584145370:2623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.159131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.159386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584145370:2623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.160600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.160693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.160700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.160705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.160729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.160754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508575213:7816]
2025-10-02T09:34:34.160986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584145370:2623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.160994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584145370:2623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.160996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584145370:2623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.160999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.161102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.161248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.161270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.161452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.161494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.161499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.161500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.161501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.161502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.161503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.161503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.161504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.161505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.161506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.161507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.161508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.161512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.161520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.161522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.161524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.161526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.161528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.161530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.161532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.161534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.161536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.161538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.161540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.161544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.161548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.161552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.161554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.161558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.161560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.161562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.161564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.161567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.161569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.161571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.161574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.161576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.161579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.161585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.161588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.161591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.161593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.161595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.161598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.161600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.161606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.161608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.161611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.161626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.169058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.170750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.170761Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.170762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.170764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.170767Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2421 [2:7556555471508575213:7816]
2025-10-02T09:34:34.170774Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.170784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.170787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.170789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.170790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.170799Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.170806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.170810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.170841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.170846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.170848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.170850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.170851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.170885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.170890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.170897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.170902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.170913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.170930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145443:2623], now have 1 active actors on pipe
2025-10-02T09:34:34.170935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145188:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.170939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.170940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.170941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.170950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.170957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.170965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.170968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.170970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.170973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.170975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.170983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.170985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.170994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.170980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2421
2025-10-02T09:34:34.170981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2421
2025-10-02T09:34:34.171015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.171020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.171034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83461637-53c022ed-538fe081-daef53fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.171041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.171043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.171044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.171049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.171056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.171064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.171152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.171158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.171165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.171218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2422 partition: 0 MaxSeqNo: 36 sessionId: src_id|83461637-53c022ed-538fe081-daef53fa_0
2025-10-02T09:34:34.171475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cfa58b-8ea5bc27-765dafc5-3d2dced8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83461637-53c022ed-538fe081-daef53fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.174028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Write session: try to update token
2025-10-02T09:34:34.174040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.180797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.180827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.180829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.180830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.180835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.180841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.180844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508575207:7816]
2025-10-02T09:34:34.180865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.180869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.180871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.180905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.180913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.180932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.180981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.185702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId: src_id|83461637-53c022ed-538fe081-daef53fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.187846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.247711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584145455:3012]
2025-10-02T09:34:34.247859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2421, pipe: [1:7556555471584145455:3012]
2025-10-02T09:34:34.294839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.295235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.295244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.295270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145455:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.295403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.295448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584145455:3012]
2025-10-02T09:34:34.295464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:34.295466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.295519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2422 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83461637-53c022ed-538fe081-daef53fa_0
2025-10-02T09:34:34.295661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2422 sessionId: src_id|83461637-53c022ed-538fe081-daef53fa_0 is DEAD
2025-10-02T09:34:34.295781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:34.295791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Write session will restart in 0.008390s
2025-10-02T09:34:34.295807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Write session: Do CDS request
2025-10-02T09:34:34.295811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.305203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.305304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.305311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2423
2025-10-02T09:34:34.305420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.305440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.305446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.305448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.305745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2423 sessionId:  describe result for acl check
2025-10-02T09:34:34.305766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.305770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.305771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.305774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584145637:2619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.306100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584145637:2619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.307417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584145637:2619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.307491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.309047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.309144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.309151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.309157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.309183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.309205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508575472:7813]
2025-10-02T09:34:34.309220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584145637:2619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.309227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584145637:2619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.309229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584145637:2619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.309232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.309546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.309705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.309728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.309900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.309927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.309931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.309932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.309932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.309933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.309933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.309934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.309935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.309935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.309936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.309936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.309937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.309939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.309945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.309947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.309949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.309951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.309953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.309955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.309957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.309959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.309961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.309963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.309965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.309969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.309972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.309976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.309978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.309981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.309983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.309985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.309988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.309991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.309993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.309995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.309998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.310000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.310003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.310005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.310008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.310011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.310013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.310015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.310018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.310020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.310023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.310025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.310028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.310045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.317435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.319010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.319022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.319024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.319026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.319030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2422 [2:7556555471508575472:7813]
2025-10-02T09:34:34.319040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.319053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.319058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.319059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.319061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.319070Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.319075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.319080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.319117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.319122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.319123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.319125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.319126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.319163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.319170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.319176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.319181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.319189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.319202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145458:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.319205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145714:2619], now have 1 active actors on pipe
2025-10-02T09:34:34.319209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.319210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.319211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.319218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.319226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.319233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.319234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.319236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.319238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.319240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.319249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.319251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.319260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.319242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2422
2025-10-02T09:34:34.319288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2422
2025-10-02T09:34:34.319318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.319323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.319337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.319344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.319346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.319347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.319353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.319358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.319365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.319460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.319466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.319472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.319529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2423 partition: 0 MaxSeqNo: 36 sessionId: src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0
2025-10-02T09:34:34.319774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83461637-53c022ed-538fe081-daef53fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.322341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Write session: try to update token
2025-10-02T09:34:34.322353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.328691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.328709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.328710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.328711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.328716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.328719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.328721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508575467:7813]
2025-10-02T09:34:34.328742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.328746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.328747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.328783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.328816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.328827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.328883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.334293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId: src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.336403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.395673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584145726:3012]
2025-10-02T09:34:34.395829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2422, pipe: [1:7556555471584145726:3012]
2025-10-02T09:34:34.442336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.442548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.442567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.442580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145726:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.442891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.442920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:34.442929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:34.442931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.442958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584145726:3012]
2025-10-02T09:34:34.442981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2423 reason: error at write: Disconnected sessionId: src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0
2025-10-02T09:34:34.443139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2423 sessionId: src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0 is DEAD
2025-10-02T09:34:34.443271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:34.443283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Write session will restart in 0.009958s
2025-10-02T09:34:34.443309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Write session: Do CDS request
2025-10-02T09:34:34.443316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.454205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.454285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.454296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2424
2025-10-02T09:34:34.454420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.454441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.454447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.454449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.454669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.454714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2424 sessionId:  describe result for acl check
2025-10-02T09:34:34.454735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.454739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.454740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.454743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584145949:2613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.455124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584145949:2613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.456264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.456361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.456368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.456374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.456401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.456426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508575734:7802]
2025-10-02T09:34:34.456479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584145949:2613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.456758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.456936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.457045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.457233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.457261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.457265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.457266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.457267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.457267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.457267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.457268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.457268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.457269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.457269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.457270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.457270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.457273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.457279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.457281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.457283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.457285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.457287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.457289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.457290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.457292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.457294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.457296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.457298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.457303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.457306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.457310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.457313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.457315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.457317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.457319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.457322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.457324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.457327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.457329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.457331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.457333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.457336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.457340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.457342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.457344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.457347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.457349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.457352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.457354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.457356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.457358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.457361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.457379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.461159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584145949:2613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.461166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584145949:2613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.461167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584145949:2613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.461171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.464766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.466486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.466501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.466502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.466504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.466507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2423 [2:7556555471508575734:7802]
2025-10-02T09:34:34.466514Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.466524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.466525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.466528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.466529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.466538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.466541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.466545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.466587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.466593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.466594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.466596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.466598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.466635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.466640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.466646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.466651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.466661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.466674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145727:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.466680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584145988:2613], now have 1 active actors on pipe
2025-10-02T09:34:34.466683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.466685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.466686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.466694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.466702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.466707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.466709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.466711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.466716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.466717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.466725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.466731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.466733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.466723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2423
2025-10-02T09:34:34.466726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2423
2025-10-02T09:34:34.466750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.466756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.466774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.466781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.466783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.466785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.466789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.466796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.466805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.466907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.466912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.466919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.466977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2424 partition: 0 MaxSeqNo: 36 sessionId: src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0
2025-10-02T09:34:34.467217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aafd70d1-74ad5f78-22ef8908-c3a0552f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.469787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Write session: try to update token
2025-10-02T09:34:34.469799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.476919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.476940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.476943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.476944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.476953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.476958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.476962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508575729:7802]
2025-10-02T09:34:34.476995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.477018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.477020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.477026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.477043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.477047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.477137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.482359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId: src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.484501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.543129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584146008:3012]
2025-10-02T09:34:34.543312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2423, pipe: [1:7556555471584146008:3012]
2025-10-02T09:34:34.592560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.592939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.592951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.592963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146008:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.593106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.593169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:34.593172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584146008:3012]
2025-10-02T09:34:34.593186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.593239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2424 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0
2025-10-02T09:34:34.593389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2424 sessionId: src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0 is DEAD
2025-10-02T09:34:34.593511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:34.593520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Write session will restart in 0.006772s
2025-10-02T09:34:34.593547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Write session: Do CDS request
2025-10-02T09:34:34.593551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.601244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.601253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2425
2025-10-02T09:34:34.601283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.601531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.601551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.601557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.601559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.601895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2425 sessionId:  describe result for acl check
2025-10-02T09:34:34.601919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.601923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.601924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.601928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584146129:2554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.602258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584146129:2554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.604613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584146129:2554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.605847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.607462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.607559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.607566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.607571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.607597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.607622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508576032:7774]
2025-10-02T09:34:34.607793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584146129:2554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.607801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584146129:2554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.607803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584146129:2554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.607806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.607956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.608115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.608138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.608313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.608342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.608346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.608346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.608347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.608347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.608348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.608349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.608349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.608349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.608350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.608351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.608351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.608354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.608359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.608362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.608364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.608366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.608368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.608369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.608371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.608373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.608375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.608377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.608379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.608383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.608388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.608391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.608394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.608396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.608399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.608401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.608404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.608406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.608409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.608411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.608414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.608416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.608419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.608421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.608423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.608426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.608428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.608430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.608433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.608435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.608438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.608440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.608443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.608460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.615937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.617525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.617538Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.617539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.617541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.617544Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2424 [2:7556555471508576032:7774]
2025-10-02T09:34:34.617552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.617561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.617562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.617564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.617565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.617573Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.617581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.617585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.617616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.617621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.617622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.617624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.617625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.617663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.617668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.617675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.617680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.617688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.617699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146276:2554], now have 1 active actors on pipe
2025-10-02T09:34:34.617704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146019:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.617708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.617713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.617714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.617721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.617731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.617737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.617739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.617740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.617742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.617744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.617758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.617763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.617764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.617763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2424
2025-10-02T09:34:34.617768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2424
2025-10-02T09:34:34.617794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.617799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.617815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.617821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.617823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.617825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.617831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.617839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.617849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.617954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.617959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.617967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.618027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2425 partition: 0 MaxSeqNo: 36 sessionId: src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0
2025-10-02T09:34:34.618258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec0b8cf-fc3ab36a-11cd8afa-c5f77a33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.620843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Write session: try to update token
2025-10-02T09:34:34.620854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.627190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.627207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.627208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.627210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.627215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.627220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.627222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508576026:7774]
2025-10-02T09:34:34.627243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.627247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.627248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.627286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.627303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.627307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.627359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.632569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId: src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.634732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.693184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584146287:3012]
2025-10-02T09:34:34.693380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2424, pipe: [1:7556555471584146287:3012]
2025-10-02T09:34:34.746322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.746889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.746901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.746925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146287:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.747081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.747089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:34.747095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.747101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:34.747137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584146287:3012]
2025-10-02T09:34:34.747151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2425 reason: error at write: Disconnected sessionId: src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0
2025-10-02T09:34:34.747305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2425 sessionId: src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0 is DEAD
2025-10-02T09:34:34.747412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:34.747421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Write session will restart in 0.009133s
2025-10-02T09:34:34.747439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Write session: Do CDS request
2025-10-02T09:34:34.747443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.757215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.757329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.757338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2426
2025-10-02T09:34:34.757451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.757473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.757480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.757483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.757785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2426 sessionId:  describe result for acl check
2025-10-02T09:34:34.757820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.757825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.757826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.757829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584146510:2548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.758312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584146510:2548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.758663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.759567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584146510:2548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.760295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.760391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.760398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.760404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.760428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.760455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508576294:7768]
2025-10-02T09:34:34.760797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.760956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.760979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.761075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584146510:2548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.761083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584146510:2548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.761085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584146510:2548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.761088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.761157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.761187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.761191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.761191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.761192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.761192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.761193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.761193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.761194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.761194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.761195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.761195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.761196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.761198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.761204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.761206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.761208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.761210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.761212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.761214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.761216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.761218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.761220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.761222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.761224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.761228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.761232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.761235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.761238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.761240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.761243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.761245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.761248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.761251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.761253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.761255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.761258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.761260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.761263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.761265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.761267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.761269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.761272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.761274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.761277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.761279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.761282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.761284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.761287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.761304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.768843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.770398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.770410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.770415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.770417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.770420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2425 [2:7556555471508576294:7768]
2025-10-02T09:34:34.770427Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.770436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.770442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.770443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.770444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.770453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.770456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.770461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.770496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.770501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.770502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.770504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.770505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.770543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.770548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.770561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.770567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.770575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.770589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146550:2548], now have 1 active actors on pipe
2025-10-02T09:34:34.770594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146289:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.770597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.770599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.770600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.770609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.770619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.770624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.770626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.770627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.770629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.770630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.770644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.770649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.770635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2425
2025-10-02T09:34:34.770637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2425
2025-10-02T09:34:34.770657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.770663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.770665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.770684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35240385-b6bac309-23b131cd-a2fbedcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.770691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.770693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.770694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.770700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.770707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.770722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.770817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.770823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.770830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.770881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2426 partition: 0 MaxSeqNo: 36 sessionId: src_id|35240385-b6bac309-23b131cd-a2fbedcb_0
2025-10-02T09:34:34.771128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b80cb-c1665fac-7f8d4c63-79ae9d08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35240385-b6bac309-23b131cd-a2fbedcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.773722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Write session: try to update token
2025-10-02T09:34:34.773734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.780021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.780037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.780038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.780040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.780045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.780048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.780050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508576288:7768]
2025-10-02T09:34:34.780070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.780073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.780075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.780111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.780130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.780138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.780185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.785379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId: src_id|35240385-b6bac309-23b131cd-a2fbedcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.787476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.847279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584146559:3012]
2025-10-02T09:34:34.847491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2425, pipe: [1:7556555471584146559:3012]
2025-10-02T09:34:34.891148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:34.891580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.891589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.891614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146559:3012], now have 1 active actors on pipe
2025-10-02T09:34:34.891850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:34.891853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:34.891860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:34.891886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584146559:3012]
2025-10-02T09:34:34.891906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2426 reason: error at write: Disconnected sessionId: src_id|35240385-b6bac309-23b131cd-a2fbedcb_0
2025-10-02T09:34:34.892023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:34.892025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2426 sessionId: src_id|35240385-b6bac309-23b131cd-a2fbedcb_0 is DEAD
2025-10-02T09:34:34.892154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:34.892160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Write session will restart in 0.006130s
2025-10-02T09:34:34.892180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Write session: Do CDS request
2025-10-02T09:34:34.892186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:34.899169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.899251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:34.899259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2427
2025-10-02T09:34:34.899352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:34.899372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:34.899378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:34.899380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:34.899707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2427 sessionId:  describe result for acl check
2025-10-02T09:34:34.899728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:34.899734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:34.899736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:34.899741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555471584146652:2540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:34.900091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555471584146652:2540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:34.901972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555471584146652:2540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:34.903860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555471584146652:2540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:34.903867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555471584146652:2540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:34.903870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555471584146652:2540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:34.903873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:34.904096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:34.905767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:34.905923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:34.905936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:34.905946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:34.905998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:34.906032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555471508576558:7757]
2025-10-02T09:34:34.906527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:34.906731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:34.906759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:34.906941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:34.906970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.906973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.906974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.906974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.906975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.906976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.906976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.906977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.906977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.906978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.906978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.906979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.906981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.906987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.906989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.906991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.906993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.906995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.906997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.906999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.907001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.907003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.907005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.907007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.907010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.907014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:34.907018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.907021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:34.907023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.907025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:34.907027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.907030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:34.907033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.907035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:34.907037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.907040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:34.907042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.907045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:34.907047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.907050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:34.907052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.907055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:34.907057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.907060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.907063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.907065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.907067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.907070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.907087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:34.914477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:34.916004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:34.916015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:34.916016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:34.916018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:34.916021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2426 [2:7556555471508576558:7757]
2025-10-02T09:34:34.916027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:34.916035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:34.916037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.916038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.916039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.916048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:34.916051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:34.916055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:34.916083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.916090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.916091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.916092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:34.916094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:34.916130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:34.916135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.916141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:34.916147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:34.916155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:34.916166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146565:2446], now have 1 active actors on pipe
2025-10-02T09:34:34.916172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146825:2540], now have 1 active actors on pipe
2025-10-02T09:34:34.916176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.916177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.916178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.916185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:34.916196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:34.916199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:34.916201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:34.916202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:34.916206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:34.916207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:34.916220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.916225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:34.916228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:34.916214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2426
2025-10-02T09:34:34.916217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2426
2025-10-02T09:34:34.916392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.916399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.916420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:34.916427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:34.916429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:34.916430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:34.916436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:34.916444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:34.916456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.916564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:34.916568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:34.916576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:34.916633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2427 partition: 0 MaxSeqNo: 36 sessionId: src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0
2025-10-02T09:34:34.916863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35240385-b6bac309-23b131cd-a2fbedcb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:34.919384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Write session: try to update token
2025-10-02T09:34:34.919395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:34.925437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:34.925452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:34.925453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:34.925454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:34.925460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.925462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.925466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555471508576553:7757]
2025-10-02T09:34:34.925487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:34.925490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:34.925491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:34.925502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:34.925505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:34.925508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:34.925606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:34.931515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId: src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:34.933698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:34.992202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555471584146840:3012]
2025-10-02T09:34:34.992367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2426, pipe: [1:7556555471584146840:3012]
2025-10-02T09:34:35.041385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.041609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.041617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.041630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555471584146840:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.041828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.041848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555471584146840:3012]
2025-10-02T09:34:35.041864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:35.041866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:35.041911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2427 reason: error at write: Disconnected sessionId: src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0
2025-10-02T09:34:35.042048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2427 sessionId: src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0 is DEAD
2025-10-02T09:34:35.042052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:35.042168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:35.042175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Write session will restart in 0.008238s
2025-10-02T09:34:35.042197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Write session: Do CDS request
2025-10-02T09:34:35.042201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.051253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.051298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.051305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2428
2025-10-02T09:34:35.051489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.051510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.051513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.051515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.051832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2428 sessionId:  describe result for acl check
2025-10-02T09:34:35.051851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.051852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.051853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.051856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879114302:2511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.052191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879114302:2511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.053570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879114302:2511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.053825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.055375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.055469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.055475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.055480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.055485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879114302:2511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.055495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879114302:2511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.055497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879114302:2511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.055501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.055504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.055525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803544128:7746]
2025-10-02T09:34:35.055854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.056012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.056033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.056202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.056231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.056234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.056235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.056235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.056236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.056237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.056237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.056238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.056238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.056239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.056239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.056240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.056242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.056248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.056250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.056252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.056254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.056256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.056258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.056260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.056262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.056265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.056267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.056269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.056272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.056276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.056279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.056282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.056284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.056287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.056289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.056292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.056294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.056297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.056299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.056301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.056304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.056306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.056309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.056311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.056313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.056316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.056318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.056321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.056323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.056325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.056327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.056330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.056346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.063703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.065178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.065188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.065190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.065191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.065195Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2427 [2:7556555475803544128:7746]
2025-10-02T09:34:35.065202Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.065214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.065219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.065220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.065221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.065230Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.065235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.065239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.065266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.065271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.065272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.065274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.065275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.065381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.065386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.065392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.065385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2427
2025-10-02T09:34:35.065397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.065397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2427
2025-10-02T09:34:35.065410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.065422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114398:2511], now have 1 active actors on pipe
2025-10-02T09:34:35.065424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114137:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.065427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.065430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.065431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.065437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.065446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.065451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.065453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.065454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.065455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.065465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.065475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.065479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.065498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a28da325-28a287b9-bd04a963-b3190072_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.065505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.065507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.065508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.065513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.065520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.065528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.065536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.065545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.065550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.065627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.065632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.065640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.065689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2428 partition: 0 MaxSeqNo: 36 sessionId: src_id|a28da325-28a287b9-bd04a963-b3190072_0
2025-10-02T09:34:35.065885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|451139b1-b3cdb74-1ae317c9-6d0b62bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a28da325-28a287b9-bd04a963-b3190072_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.068367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Write session: try to update token
2025-10-02T09:34:35.068378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.075120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.075136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.075138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.075139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.075143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.075146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.075148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803544123:7746]
2025-10-02T09:34:35.075168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.075171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.075171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.075172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.075173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.075175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.075336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.079922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId: src_id|a28da325-28a287b9-bd04a963-b3190072_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.082018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:35.142184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555475879114422:3012]
2025-10-02T09:34:35.142368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2427, pipe: [1:7556555475879114422:3012]
2025-10-02T09:34:35.187113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.187597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.187608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.187633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114422:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.187766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:35.187796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.187801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555475879114422:3012]
2025-10-02T09:34:35.187816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:35.187868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a28da325-28a287b9-bd04a963-b3190072_0
2025-10-02T09:34:35.188008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2428 sessionId: src_id|a28da325-28a287b9-bd04a963-b3190072_0 is DEAD
2025-10-02T09:34:35.188180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:35.188198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Write session will restart in 0.009262s
2025-10-02T09:34:35.188221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Write session: Do CDS request
2025-10-02T09:34:35.188227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.198248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.198306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.198314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2429
2025-10-02T09:34:35.198470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.198489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.198492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.198495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.198791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2429 sessionId:  describe result for acl check
2025-10-02T09:34:35.198815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.198816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.198817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.198820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879114629:2506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.199155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879114629:2506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.200157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.200451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879114629:2506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.201566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.201658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.201665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.201670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.201695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.201717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803544394:7741]
2025-10-02T09:34:35.202054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.202218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.202241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.202412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.202441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.202426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879114629:2506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.202446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.202435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879114629:2506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.202437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879114629:2506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.202440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.202446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.202447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.202448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.202448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.202449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.202450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.202450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.202451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.202451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.202452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.202454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.202460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.202462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.202464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.202466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.202468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.202470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.202471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.202473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.202476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.202478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.202479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.202483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.202486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.202490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.202493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.202495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.202498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.202500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.202503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.202505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.202508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.202510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.202513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.202515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.202517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.202520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.202522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.202525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.202527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.202529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.202532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.202534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.202537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.202539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.202542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.202565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.209942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.211442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.211455Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.211456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.211458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.211461Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2428 [2:7556555475803544394:7741]
2025-10-02T09:34:35.211468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.211478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.211483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.211485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.211486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.211495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.211498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.211503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.211536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.211541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.211542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.211544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.211545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.211581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.211585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.211591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.211598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.211607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.211619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114423:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.211625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114687:2506], now have 1 active actors on pipe
2025-10-02T09:34:35.211628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.211630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.211631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.211638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.211647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.211652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.211655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.211656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.211657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.211659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.211672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.211675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.211661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2428
2025-10-02T09:34:35.211669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2428
2025-10-02T09:34:35.211682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.211695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.211697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.211711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.211718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.211720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.211721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.211727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.211731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.211739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.211828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.211833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.211840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.211898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2429 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0
2025-10-02T09:34:35.212106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28da325-28a287b9-bd04a963-b3190072_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.214616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Write session: try to update token
2025-10-02T09:34:35.214627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.220893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.220907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.220909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.220910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.220915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.220918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.220920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803544389:7741]
2025-10-02T09:34:35.220942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.220947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.220950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.220950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.220951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.220952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.221068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.225884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId: src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.228032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:35.288099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555475879114699:3012]
2025-10-02T09:34:35.288268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2428, pipe: [1:7556555475879114699:3012]
2025-10-02T09:34:35.331391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.331858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.331870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.331896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114699:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.332013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:35.332032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.332034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:35.332037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:35.332070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555475879114699:3012]
2025-10-02T09:34:35.332085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2429 reason: error at write: Disconnected sessionId: src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0
2025-10-02T09:34:35.332215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2429 sessionId: src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0 is DEAD
2025-10-02T09:34:35.332331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:35.332336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Write session will restart in 0.008950s
2025-10-02T09:34:35.332354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Write session: Do CDS request
2025-10-02T09:34:35.332359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.342311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.342285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.342295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2430
2025-10-02T09:34:35.342559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.342580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.342589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.342591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.342848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2430 sessionId:  describe result for acl check
2025-10-02T09:34:35.342870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.342876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.342877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.342880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879114897:2484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.343223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879114897:2484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.344331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.344768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879114897:2484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.345917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.346013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.346020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.346025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.346049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.346073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803544662:7725]
2025-10-02T09:34:35.346258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879114897:2484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.346265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879114897:2484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.346267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879114897:2484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.346271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.346413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.346577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.346598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.346772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.346800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.346804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.346805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.346805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.346806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.346807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.346807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.346808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.346808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.346809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.346809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.346810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.346813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.346819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.346821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.346823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.346825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.346827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.346829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.346831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.346833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.346835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.346837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.346839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.346843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.346847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.346850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.346853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.346855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.346858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.346860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.346862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.346864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.346867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.346869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.346872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.346874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.346876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.346879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.346881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.346884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.346886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.346888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.346891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.346893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.346896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.346902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.346904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.346922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.354137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:34:35.354150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-02T09:34:35.354406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.355933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.355948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.355950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.355952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.355956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2429 [2:7556555475803544662:7725]
2025-10-02T09:34:35.355965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.355977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.355982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.355983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.355984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.355995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.356001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.356005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.356105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.356110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.356112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.356114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.356115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.356154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.356159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.356165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.356174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.356185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.356201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114966:2484], now have 1 active actors on pipe
2025-10-02T09:34:35.356207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114700:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.356210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.356212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.356213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.356221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.356229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.356234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.356236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.356237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.356239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.356241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.356257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.356262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.356255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2429
2025-10-02T09:34:35.356271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.356256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2429
2025-10-02T09:34:35.356295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.356301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.356334Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:34:35.356354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.356362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.356365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.356366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.356371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.356376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.356386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.356471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 18 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:34:35.356493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:34:35.356484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.356488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.356496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.356547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2430 partition: 0 MaxSeqNo: 36 sessionId: src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0
2025-10-02T09:34:35.356859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1931e25-a4952c37-db6dc91d-6871cf18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.359456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Write session: try to update token
2025-10-02T09:34:35.359467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.365388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:35.365405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.365411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.365435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:35.365445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:35.365572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:35.365685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.365808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.365933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.366087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:35.366114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:35.370924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId: src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.372971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:35.373801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.373818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.373829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.373832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.373833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.373835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.373840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.373843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.373845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803544657:7725]
2025-10-02T09:34:35.373870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.373873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.373876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.373877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.373878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.373878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.373993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.431984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555475879114980:3012]
2025-10-02T09:34:35.432169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2429, pipe: [1:7556555475879114980:3012]
2025-10-02T09:34:35.490803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.491439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:35.491466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114980:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.491549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:35.491599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.491616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T09:34:35.491619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:35.491621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:35.491646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555475879114980:3012]
2025-10-02T09:34:35.491670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2430 reason: error at write: Disconnected sessionId: src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0
2025-10-02T09:34:35.491779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2430 sessionId: src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0 is DEAD
2025-10-02T09:34:35.491883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:35.491892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Write session will restart in 0.005030s
2025-10-02T09:34:35.491911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Write session: Do CDS request
2025-10-02T09:34:35.491916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.498168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.498259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.498267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2431
2025-10-02T09:34:35.498361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.498380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.498385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.498387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.498717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2431 sessionId:  describe result for acl check
2025-10-02T09:34:35.498749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.498753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.498755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.498759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879115045:2468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.499164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879115045:2468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.500966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879115045:2468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.503045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879115045:2468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.503057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879115045:2468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.503060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879115045:2468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.503065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.504528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.506021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.506127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.506134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.506140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.506168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.506200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803544944:7736]
2025-10-02T09:34:35.506571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.506743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.506769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.506964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.507000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.507005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.507005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.507006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.507006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.507007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.507007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.507008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.507008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.507009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.507010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.507010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.507013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.507019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.507022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.507024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.507026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.507028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.507031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.507033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.507035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.507038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.507040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.507042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.507047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.507052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.507055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.507058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.507060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.507063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.507066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.507068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.507071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.507074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.507076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.507079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.507083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.507086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.507089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.507093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.507096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.507099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.507102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.507108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.507110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.507113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.507119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.507122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.507141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.515042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.516649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.516662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.516663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.516665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.516669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2430 [2:7556555475803544944:7736]
2025-10-02T09:34:35.516676Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.516685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.516686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.516688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.516689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.516698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.516705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.516709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.516797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.516819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.516823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.516825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.516827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.516864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.516870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.516877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.516883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.516895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.516910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879114984:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.516918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115231:2468], now have 1 active actors on pipe
2025-10-02T09:34:35.516922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.516923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.516925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.516936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.516945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.516949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.516951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.516952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.516956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.516958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.516974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.516981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.516973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2430
2025-10-02T09:34:35.516997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.516981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2430
2025-10-02T09:34:35.517025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.517032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.517052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.517059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.517061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.517062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.517067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.517076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.517106Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:34:35.517122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.517231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.517236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.517245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.517242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 19 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:34:35.517261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:34:35.517287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2431 partition: 0 MaxSeqNo: 36 sessionId: src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0
2025-10-02T09:34:35.517495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d55e57a3-42436a8d-ff0aa6aa-66dffb4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.520144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Write session: try to update token
2025-10-02T09:34:35.520155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.526883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:35.526898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.526903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.526930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:35.526942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:35.527068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:35.527186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.527303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.527411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.527568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:35.527594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:35.531825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId: src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.533895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:35.534003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.534012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.534029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:35.534076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:35.534952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.534967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.534969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.534970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.534974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.534976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.534979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803544939:7736]
2025-10-02T09:34:35.535000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.535006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.535007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.535008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.535008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.535012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.535115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.591706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555475879115285:3012]
2025-10-02T09:34:35.591861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2430, pipe: [1:7556555475879115285:3012]
2025-10-02T09:34:35.646303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.652461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.652484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.652605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.652658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.652712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.652769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.652820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.652827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.652884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.652936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.652995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.653047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.653082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.653088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.653144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.653196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.653250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.653303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.653409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.653415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.653469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.653521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.653575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.653627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.653661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.653667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.653723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.653773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.653827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.653883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.653918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.653923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.653978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.654030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.654084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.654137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.654192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.654197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.654248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.654299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.654359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.654413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.654453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.654458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.654510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.654568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.654622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.654675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.654713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.654718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.654768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.654819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.654873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.654931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.654970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.654975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.655026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:34:35.655078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:34:35.655129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:34:35.655182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:34:35.655216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:34:35.655221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:34:35.655253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115285:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.655443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.655446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:35.655448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:35.655468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2431 reason: error at write: Disconnected sessionId: src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0
2025-10-02T09:34:35.655483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555475879115285:3012]
2025-10-02T09:34:35.655608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2431 sessionId: src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0 is DEAD
2025-10-02T09:34:35.655724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:35.655733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Write session will restart in 0.008306s
2025-10-02T09:34:35.655751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Write session: Do CDS request
2025-10-02T09:34:35.655755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.655828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:35.665133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.665256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.665266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2432
2025-10-02T09:34:35.665332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.665351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.665357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.665360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.665729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2432 sessionId:  describe result for acl check
2025-10-02T09:34:35.665753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.665757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.665758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.665762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879115466:2453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.666113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879115466:2453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.667513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879115466:2453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.669458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.669728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.669819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879115466:2453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.669823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.669827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879115466:2453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.669829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879115466:2453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.669832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.669831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.669836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.669863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.669885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803545235:7714]
2025-10-02T09:34:35.670224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.670371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.670393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.670573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.670601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.670605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.670606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.670606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.670607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.670607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.670608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.670608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.670609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.670609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.670610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.670610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.670613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.670619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.670621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.670623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.670625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.670627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.670629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.670631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.670633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.670635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.670637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.670639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.670643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.670647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.670650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.670653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.670655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.670658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.670661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.670663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.670665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.670668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.670670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.670673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.670676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.670679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.670681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.670684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.670686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.670689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.670693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.670695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.670697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.670700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.670702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.670704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.670720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.678147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.679780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.679796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.679797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.679800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.679803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2431 [2:7556555475803545235:7714]
2025-10-02T09:34:35.679811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.679822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.679824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.679825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.679826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.679837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.679840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.679844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.679877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.679882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.679884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.679886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.679887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.679924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.679929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.679935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.679940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.679951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.679966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115289:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.679972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115554:2453], now have 1 active actors on pipe
2025-10-02T09:34:35.679975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.679977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.679978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.679983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.679989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.679991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.679992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.679993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.680000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.680004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.680018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.680020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.680022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.680008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2431
2025-10-02T09:34:35.680008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2431
2025-10-02T09:34:35.680036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.680041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.680059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.680066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.680068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.680070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.680074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.680082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.680094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.680204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.680209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.680216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.680263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2432 partition: 0 MaxSeqNo: 36 sessionId: src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0
2025-10-02T09:34:35.680502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ece16e-cd7fd663-419d118c-8d8f5f7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.683045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Write session: try to update token
2025-10-02T09:34:35.683058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.689874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.689887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.689888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.689890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.689895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.689897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.689901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803545230:7714]
2025-10-02T09:34:35.689924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.689927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.689928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.689929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.689933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.689936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.690038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.694398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId: src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.696602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:35.755572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555475879115566:3012]
2025-10-02T09:34:35.755759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2431, pipe: [1:7556555475879115566:3012]
2025-10-02T09:34:35.804702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.805159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.805170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.805195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115566:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.805359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555475879115566:3012]
2025-10-02T09:34:35.805377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.805405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:35.805383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:35.805385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:35.805432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2432 reason: error at write: Disconnected sessionId: src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0
2025-10-02T09:34:35.805566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2432 sessionId: src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0 is DEAD
2025-10-02T09:34:35.805722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:35.805731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Write session will restart in 0.005563s
2025-10-02T09:34:35.805745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Write session: Do CDS request
2025-10-02T09:34:35.805750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.812179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.812270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.812279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2433
2025-10-02T09:34:35.812370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.812390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.812396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.812399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.812693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2433 sessionId:  describe result for acl check
2025-10-02T09:34:35.812711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.812716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.812717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.812720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879115640:2430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.813085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879115640:2430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.815031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879115640:2430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.816911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879115640:2430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.816919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879115640:2430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.816921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879115640:2430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.816924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.817804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.819364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.819461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.819467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.819472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.819496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.819516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803545505:7697]
2025-10-02T09:34:35.819858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.820028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.820049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.820233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.820264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.820268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.820269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.820269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.820270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.820270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.820271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.820271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.820272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.820272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.820273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.820274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.820277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.820283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.820286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.820288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.820290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.820292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.820294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.820296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.820298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.820301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.820303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.820305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.820308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.820312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.820315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.820318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.820320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.820323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.820325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.820328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.820330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.820333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.820335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.820338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.820340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.820342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.820345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.820347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.820349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.820352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.820354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.820357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.820359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.820363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.820365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.820367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.820387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.827817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.829301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.829303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.829305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.829309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2432 [2:7556555475803545505:7697]
2025-10-02T09:34:35.829317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.829329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.829335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.829336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.829337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.829347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.829350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.829356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.829391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.829396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.829397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.829399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.829400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.829439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.829444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.829451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.829456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.829468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.829480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115567:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.829486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115829:2430], now have 1 active actors on pipe
2025-10-02T09:34:35.829490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.829495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.829496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.829504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.829515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.829517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.829520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.829522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.829526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.829528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.829544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.829552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.829548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2432
2025-10-02T09:34:35.829569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.829551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2432
2025-10-02T09:34:35.829709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.829714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.829729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.829736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.829738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.829739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.829747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.829755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.829765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.829878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.829882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.829890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.829942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2433 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0
2025-10-02T09:34:35.830209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e0374a-3057dbb5-5400a11b-deec2d51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.832755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Write session: try to update token
2025-10-02T09:34:35.832768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.838873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.838884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.838885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.838887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.838891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.838893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.838895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803545500:7697]
2025-10-02T09:34:35.838917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.838920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.838921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.838922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.838923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.838925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.839041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.846105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId: src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.848299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:35.905566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555475879115850:3012]
2025-10-02T09:34:35.905969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2432, pipe: [1:7556555475879115850:3012]
2025-10-02T09:34:35.952137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:35.952614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.952623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.952635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115850:3012], now have 1 active actors on pipe
2025-10-02T09:34:35.952775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:35.952781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555475879115850:3012]
2025-10-02T09:34:35.952796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:35.952809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:35.952850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2433 reason: error at write: Disconnected sessionId: src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0
2025-10-02T09:34:35.952881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:35.952996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2433 sessionId: src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0 is DEAD
2025-10-02T09:34:35.953130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:35.953145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Write session will restart in 0.005919s
2025-10-02T09:34:35.953172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Write session: Do CDS request
2025-10-02T09:34:35.953177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:35.960129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.960250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:35.960258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2434
2025-10-02T09:34:35.960345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:35.960366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:35.960372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:35.960375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:35.960709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2434 sessionId:  describe result for acl check
2025-10-02T09:34:35.960728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:35.960733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:35.960734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:35.960737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555475879115948:2425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:35.961108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555475879115948:2425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:35.962737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555475879115948:2425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:35.964784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555475879115948:2425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:35.964791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555475879115948:2425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:35.964793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555475879115948:2425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:35.964796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:35.964933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:35.966351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:35.966528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:35.966536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:35.966543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:35.966587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:35.966610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555475803545775:7704]
2025-10-02T09:34:35.966945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:35.967113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:35.967135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:35.967336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:35.967366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.967370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.967370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.967371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.967371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.967372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.967372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.967373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.967373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.967374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.967374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.967375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.967378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.967384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.967386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.967388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.967390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.967392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.967394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.967396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.967398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.967401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.967402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.967404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.967408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.967411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:35.967415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.967418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:35.967420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.967423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:35.967425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.967428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:35.967430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.967432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:35.967435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.967437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:35.967439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.967442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:35.967448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.967450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:35.967455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.967457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:35.967463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.967465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.967467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.967470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.967475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.967478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.967495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:35.974863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:35.976348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:35.976359Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:35.976360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:35.976362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:35.976367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2433 [2:7556555475803545775:7704]
2025-10-02T09:34:35.976374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:35.976388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:35.976390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.976391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.976392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.976402Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:35.976406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:35.976410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:35.976441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.976445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.976446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.976448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:35.976449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:35.976483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:35.976488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.976494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:35.976499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:35.976507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:35.976520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.976524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.976525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.976530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:35.976536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:35.976537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:35.976543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:35.976544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:35.976544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:35.976546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:35.976552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879116120:2425], now have 1 active actors on pipe
2025-10-02T09:34:35.976554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555475879115857:2446], now have 1 active actors on pipe
2025-10-02T09:34:35.976566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.976575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:35.976582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:35.976569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2433
2025-10-02T09:34:35.976580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2433
2025-10-02T09:34:35.976599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.976604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.976620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:35.976626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:35.976629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:35.976630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:35.976634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:35.976639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:35.976650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.976764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:35.976768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:35.976775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:35.976840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2434 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0
2025-10-02T09:34:35.977092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e805fb7-c2b0d5c8-ee65a11f-9666b689_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:35.979921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Write session: try to update token
2025-10-02T09:34:35.979936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:35.989501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:35.989512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.989515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.989537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:35.989541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:35.989671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:35.989786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.989896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.990010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:35.990236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:35.990260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:35.992585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId: src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:35.993976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:35.993987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:35.993988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:35.993989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:35.993993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.993995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.993997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555475803545769:7704]
2025-10-02T09:34:35.994014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:35.994017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:35.994019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:35.994059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:35.994066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:35.994068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:35.994126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:35.994834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.053024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174083429:3012]
2025-10-02T09:34:36.053155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2433, pipe: [1:7556555480174083429:3012]
2025-10-02T09:34:36.107506Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.107806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.107815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.107827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174083429:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.107960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.107959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174083429:3012]
2025-10-02T09:34:36.107962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:36.107965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:36.107977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.108064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2434 reason: error at write: Disconnected sessionId: src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0
2025-10-02T09:34:36.108235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2434 sessionId: src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0 is DEAD
2025-10-02T09:34:36.108390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:36.108405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Write session will restart in 0.007130s
2025-10-02T09:34:36.108428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Write session: Do CDS request
2025-10-02T09:34:36.108437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:36.116157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.116264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:36.116272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2435
2025-10-02T09:34:36.116337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.116356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:36.116360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:36.116363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:36.116682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2435 sessionId:  describe result for acl check
2025-10-02T09:34:36.116709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:36.116713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:36.116714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:36.116718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555480174083560:2414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:36.117158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555480174083560:2414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:36.118653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555480174083560:2414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:36.120353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:36.120414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555480174083560:2414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:36.120423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555480174083560:2414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:36.120425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555480174083560:2414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:36.120429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:36.121797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:36.121964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:36.121971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:36.121978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:36.122008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:36.122033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555480098513356:7702]
2025-10-02T09:34:36.122379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:36.122554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:36.122578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:36.122756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:36.122784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.122788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.122789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.122789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.122790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.122790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.122791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.122792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.122792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.122793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.122793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.122794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.122796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.122802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.122805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.122807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.122809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.122811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.122813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.122815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.122817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.122819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.122821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.122823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.122827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.122832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.122835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.122838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.122840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.122843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.122845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.122848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.122850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.122853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.122855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.122858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.122860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.122863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.122865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.122867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.122870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.122873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.122875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.122879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.122881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.122883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.122889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.122892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.122908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:36.130474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:36.132105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:36.132115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:36.132116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:36.132118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:36.132122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2434 [2:7556555480098513356:7702]
2025-10-02T09:34:36.132128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:36.132137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:36.132142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.132144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.132145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.132154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:36.132156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:36.132162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:36.132192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.132197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.132198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.132200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:36.132201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:36.132235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:36.132240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.132246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.132251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.132259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:36.132272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174083711:2414], now have 1 active actors on pipe
2025-10-02T09:34:36.132278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174083442:2446], now have 1 active actors on pipe
2025-10-02T09:34:36.132281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.132283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.132284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.132288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:36.132298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:36.132299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:36.132301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:36.132303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:36.132308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:36.132310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:36.132323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.132331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:36.132316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2434
2025-10-02T09:34:36.132338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:36.132357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2434
2025-10-02T09:34:36.132414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.132420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.132433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:36.132440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.132442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.132443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:36.132448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.132455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:36.132462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.132570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.132574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.132581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.132632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2435 partition: 0 MaxSeqNo: 36 sessionId: src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0
2025-10-02T09:34:36.132905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf4a68c0-55fa6cd3-50be7ce0-eb829313_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:36.135584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Write session: try to update token
2025-10-02T09:34:36.135600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:36.141373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:36.141383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.141387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:36.141388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:36.141391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.141393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.141396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555480098513350:7702]
2025-10-02T09:34:36.141414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:36.141420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.141421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:36.141423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:36.141426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:36.141428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:36.141537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:36.148062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId: src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:36.150209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.208182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174083723:3012]
2025-10-02T09:34:36.208360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2434, pipe: [1:7556555480174083723:3012]
2025-10-02T09:34:36.255063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.255284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.255298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.255314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174083723:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.255475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:36.255484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:36.255489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.255523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174083723:3012]
2025-10-02T09:34:36.255536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2435 reason: error at write: Disconnected sessionId: src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0
2025-10-02T09:34:36.255687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2435 sessionId: src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0 is DEAD
2025-10-02T09:34:36.255828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.255840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:36.255855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Write session will restart in 0.008815s
2025-10-02T09:34:36.255882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Write session: Do CDS request
2025-10-02T09:34:36.255888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:36.266198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.266286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:36.266294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2436
2025-10-02T09:34:36.266383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.266404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:36.266410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:36.266413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:36.266695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2436 sessionId:  describe result for acl check
2025-10-02T09:34:36.266714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:36.266719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:36.266721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:36.266724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555480174083955:2404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:36.267078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555480174083955:2404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:36.267339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:36.268422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555480174083955:2404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:36.268835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:36.268989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:36.268996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:36.269002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:36.269033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:36.269055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555480098513627:7699]
2025-10-02T09:34:36.269401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:36.269563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:36.269586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:36.269763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:36.269790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.269794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.269794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.269795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.269795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.269796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.269796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.269797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.269797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.269798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.269799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.269799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.269802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.269808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.269810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.269812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.269814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.269816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.269818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.269820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.269822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.269824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.269826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.269828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.269832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.269836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.269839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.269842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.269844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.269847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.269853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.269856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.269858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.269861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.269864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.269866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.269869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.269874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.269876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.269879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.269882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.269885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.269889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.269891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.269893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.269896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.269898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.269901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.269916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:36.273793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555480174083955:2404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:36.273801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555480174083955:2404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:36.273803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555480174083955:2404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:36.273807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:36.277493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:36.279123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:36.279135Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:36.279136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:36.279138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:36.279140Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2435 [2:7556555480098513627:7699]
2025-10-02T09:34:36.279147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:36.279156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:36.279161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.279162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.279163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.279172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:36.279175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:36.279179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:36.279210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.279214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.279215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.279217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:36.279218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:36.279251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:36.279257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.279264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.279269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.279281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:36.279294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174083724:2446], now have 1 active actors on pipe
2025-10-02T09:34:36.279299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174083999:2404], now have 1 active actors on pipe
2025-10-02T09:34:36.279303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.279304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.279305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.279312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:36.279322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:36.279328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:36.279331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:36.279333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:36.279333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:36.279334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:36.279328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2435
2025-10-02T09:34:36.279347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.279342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2435
2025-10-02T09:34:36.279352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:36.279354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:36.279368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.279373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.279391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:36.279397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.279399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.279401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:36.279405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.279412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:36.279425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.279502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.279507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.279515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.279564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2436 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0
2025-10-02T09:34:36.279820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1505f4a2-e1951e7a-586b81fe-2577641b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:36.282526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Write session: try to update token
2025-10-02T09:34:36.282543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:36.288587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:36.288598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.288599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:36.288600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:36.288604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.288609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.288611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555480098513622:7699]
2025-10-02T09:34:36.288630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:36.288634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:36.288636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:36.288636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.288637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:36.288638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:36.288749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:36.296678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId: src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:36.298894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.355617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174084007:3012]
2025-10-02T09:34:36.355826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2435, pipe: [1:7556555480174084007:3012]
2025-10-02T09:34:36.401130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.401434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.401445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.401459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084007:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.401613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174084007:3012]
2025-10-02T09:34:36.401630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.401632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:36.401633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:36.401675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2436 reason: error at write: Disconnected sessionId: src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0
2025-10-02T09:34:36.401807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2436 sessionId: src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0 is DEAD
2025-10-02T09:34:36.401920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:36.401929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Write session will restart in 0.007952s
2025-10-02T09:34:36.401943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Write session: Do CDS request
2025-10-02T09:34:36.401948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:36.402051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.411244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.411258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:36.411267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2437
2025-10-02T09:34:36.411539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.411566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:36.411575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:36.411578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:36.411943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2437 sessionId:  describe result for acl check
2025-10-02T09:34:36.411973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:36.411981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:36.411982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:36.411987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555480174084168:2392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:36.412434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555480174084168:2392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:36.414053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555480174084168:2392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:36.414378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:36.415937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:36.416032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:36.416038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:36.416043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:36.416069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:36.416092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555480098513902:7688]
2025-10-02T09:34:36.416137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555480174084168:2392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:36.416145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555480174084168:2392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:36.416147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555480174084168:2392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:36.416151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:36.416425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:36.416578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:36.416599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:36.416771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:36.416798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.416815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.416816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.416816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.416817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.416817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.416818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.416818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.416819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.416819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.416820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.416820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.416823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.416829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.416831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.416833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.416835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.416837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.416839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.416841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.416843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.416846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.416848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.416850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.416853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.416857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.416860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.416863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.416865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.416868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.416870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.416873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.416875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.416877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.416879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.416882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.416884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.416887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.416888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.416891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.416893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.416896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.416898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.416901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.416904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.416909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.416911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.416914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.416931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:36.424336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:36.425954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:36.425965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:36.425966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:36.425968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:36.425971Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2436 [2:7556555480098513902:7688]
2025-10-02T09:34:36.425978Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:36.425988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:36.425991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.425992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.425993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.426002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:36.426005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:36.426009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:36.426041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.426046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.426047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.426049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:36.426050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:36.426084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:36.426089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.426096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.426101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.426111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:36.426123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.426127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.426128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.426133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:36.426140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:36.426141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084278:2392], now have 1 active actors on pipe
2025-10-02T09:34:36.426143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084008:2446], now have 1 active actors on pipe
2025-10-02T09:34:36.426147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:36.426148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:36.426149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:36.426155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:36.426157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:36.426172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.426177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:36.426156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2436
2025-10-02T09:34:36.426179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:36.426175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2436
2025-10-02T09:34:36.426198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.426203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.426215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:36.426223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.426225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.426227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:36.426232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.426237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:36.426247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.426334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.426338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.426345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.426396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2437 partition: 0 MaxSeqNo: 36 sessionId: src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0
2025-10-02T09:34:36.426638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc64ff88-cf7d500d-6eab7b7a-649f1d13_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:36.429650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Write session: try to update token
2025-10-02T09:34:36.429660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:36.435226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:36.435239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.435241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:36.435242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:36.435246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.435248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.435250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555480098513897:7688]
2025-10-02T09:34:36.435272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:36.435273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:36.435275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:36.435275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.435277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:36.435277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:36.435387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:36.442743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId: src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:36.444895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.501536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174084289:3012]
2025-10-02T09:34:36.501717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2436, pipe: [1:7556555480174084289:3012]
2025-10-02T09:34:36.545294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.545865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.545876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.545888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084289:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.545997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.546052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174084289:3012]
2025-10-02T09:34:36.546056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.546076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:36.546118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0
2025-10-02T09:34:36.546227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2437 sessionId: src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0 is DEAD
2025-10-02T09:34:36.546409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:36.546424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Write session will restart in 0.008817s
2025-10-02T09:34:36.546452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Write session: Do CDS request
2025-10-02T09:34:36.546457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:36.556146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.556257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:36.556264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2438
2025-10-02T09:34:36.556371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.556390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:36.556393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:36.556396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:36.556648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2438 sessionId:  describe result for acl check
2025-10-02T09:34:36.556666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:36.556667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:36.556668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:36.556672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555480174084419:2384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:36.557018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555480174084419:2384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:36.558228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555480174084419:2384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:36.560054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:36.561629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:36.561689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555480174084419:2384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:36.561696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555480174084419:2384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:36.561698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555480174084419:2384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:36.561701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:36.561744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:36.561751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:36.561757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:36.561785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:36.561809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555480098514205:7678]
2025-10-02T09:34:36.562161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:36.562323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:36.562347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:36.562520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:36.562558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.562562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.562562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.562563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.562563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.562564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.562564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.562565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.562565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.562566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.562566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.562567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.562569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.562575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.562577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.562579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.562581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.562583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.562585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.562587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.562589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.562591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.562593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.562595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.562599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.562602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.562605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.562608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.562610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.562613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.562615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.562617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.562619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.562622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.562624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.562627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.562629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.562631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.562633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.562640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.562642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.562645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.562651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.562654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.562656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.562661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.562663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.562665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.562681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:36.570022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:36.571564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:36.571577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:36.571578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:36.571580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:36.571584Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2437 [2:7556555480098514205:7678]
2025-10-02T09:34:36.571593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:36.571609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:36.571611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.571613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.571615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.571624Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:36.571630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:36.571634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:36.571663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.571667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.571668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.571670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:36.571671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:36.571704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:36.571708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.571714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.571722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.571730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:36.571744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084565:2384], now have 1 active actors on pipe
2025-10-02T09:34:36.571750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084291:2446], now have 1 active actors on pipe
2025-10-02T09:34:36.571753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.571755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.571756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.571762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:36.571770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:36.571775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:36.571778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:36.571779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:36.571781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:36.571782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:36.571791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.571793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:36.571794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:36.571794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2437
2025-10-02T09:34:36.571794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2437
2025-10-02T09:34:36.571834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.571840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.571853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec91e916-136182bc-5ea95c41-da712c3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:36.571859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.571861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.571862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:36.571866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.571872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:36.571879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.571984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.571989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.571996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.572051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2438 partition: 0 MaxSeqNo: 36 sessionId: src_id|ec91e916-136182bc-5ea95c41-da712c3c_0
2025-10-02T09:34:36.572257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a127d30e-68314d09-2eea3fc-3fc49b91_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ec91e916-136182bc-5ea95c41-da712c3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:36.575217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Write session: try to update token
2025-10-02T09:34:36.575230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:36.586075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:36.586087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.586091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.586116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:36.586117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:36.586244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:36.586357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:36.586465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:36.586589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:36.586739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:36.586763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:36.589225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId: src_id|ec91e916-136182bc-5ea95c41-da712c3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:36.590931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:36.590944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.590945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:36.590946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:36.590950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.590952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.590955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555480098514200:7678]
2025-10-02T09:34:36.590974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:36.590974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:36.590976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:36.590977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.590979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:36.590979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:36.591080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:36.591578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.646435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174084598:3012]
2025-10-02T09:34:36.646614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2437, pipe: [1:7556555480174084598:3012]
2025-10-02T09:34:36.703846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.704217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.704226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.704239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084598:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.704400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.704431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:36.704441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.704444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:36.704475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174084598:3012]
2025-10-02T09:34:36.704497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2438 reason: error at write: Disconnected sessionId: src_id|ec91e916-136182bc-5ea95c41-da712c3c_0
2025-10-02T09:34:36.704646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2438 sessionId: src_id|ec91e916-136182bc-5ea95c41-da712c3c_0 is DEAD
2025-10-02T09:34:36.704772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:36.704780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Write session will restart in 0.008228s
2025-10-02T09:34:36.704795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Write session: Do CDS request
2025-10-02T09:34:36.704810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:36.714230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.714322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:36.714330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2439
2025-10-02T09:34:36.714452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.714472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:36.714478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:36.714480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:36.714746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2439 sessionId:  describe result for acl check
2025-10-02T09:34:36.714769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:36.714770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:36.714771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:36.714775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555480174084779:2341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:36.715132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555480174084779:2341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:36.716641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:36.717207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555480174084779:2341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:36.718267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:36.718360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:36.718367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:36.718372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:36.718398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:36.718420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555480098514486:7666]
2025-10-02T09:34:36.718766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:36.718915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:36.718938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:36.718951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555480174084779:2341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:36.718960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555480174084779:2341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:36.718961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555480174084779:2341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:36.718965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:36.719115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:36.719141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.719145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.719146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.719146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.719147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.719147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.719148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.719148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.719149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.719149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.719150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.719151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.719153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.719159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.719161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.719163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.719165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.719167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.719169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.719172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.719173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.719176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.719178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.719180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.719183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.719187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.719190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.719193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.719195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.719198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.719200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.719203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.719205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.719207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.719209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.719212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.719214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.719217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.719219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.719222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.719224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.719226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.719229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.719232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.719236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.719238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.719240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.719243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.719258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:36.726838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:36.728449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:36.728459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:36.728461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:36.728463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:36.728466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2438 [2:7556555480098514486:7666]
2025-10-02T09:34:36.728473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:36.728482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:36.728486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.728488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.728489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.728498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:36.728504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:36.728508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:36.728537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.728541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.728542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.728544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:36.728545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:36.728578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:36.728583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.728589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.728594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.728606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:36.728619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084874:2341], now have 1 active actors on pipe
2025-10-02T09:34:36.728624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084600:2446], now have 1 active actors on pipe
2025-10-02T09:34:36.728628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.728629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.728630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.728638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:36.728646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:36.728649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:36.728652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:36.728653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:36.728656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:36.728657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:36.728670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.728675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:36.728656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2438
2025-10-02T09:34:36.728679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:36.728661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2438
2025-10-02T09:34:36.728694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.728698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.728714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:36.728721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.728724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.728728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:36.728733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.728741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:36.728749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.728866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.728871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.728879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.728941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2439 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0
2025-10-02T09:34:36.729212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec91e916-136182bc-5ea95c41-da712c3c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:36.731992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Write session: try to update token
2025-10-02T09:34:36.732007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:36.737711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:36.737723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.737724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:36.737725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:36.737729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.737731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.737734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555480098514481:7666]
2025-10-02T09:34:36.737752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:36.737752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:36.737755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:36.737755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.737756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:36.737757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:36.737878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:36.744757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId: src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:36.747006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.804625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174084883:3012]
2025-10-02T09:34:36.804792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2438, pipe: [1:7556555480174084883:3012]
2025-10-02T09:34:36.847785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.848166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.848175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.848187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084883:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.848309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:36.848318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:36.848325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.848357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174084883:3012]
2025-10-02T09:34:36.848362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2439 reason: error at write: Disconnected sessionId: src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0
2025-10-02T09:34:36.848491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2439 sessionId: src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0 is DEAD
2025-10-02T09:34:36.848603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.848650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:36.848664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Write session will restart in 0.005907s
2025-10-02T09:34:36.848692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Write session: Do CDS request
2025-10-02T09:34:36.848698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:36.855160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.855253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:36.855260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2440
2025-10-02T09:34:36.855383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:36.855403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:36.855409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:36.855411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:36.855686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2440 sessionId:  describe result for acl check
2025-10-02T09:34:36.855703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:36.855707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:36.855708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:36.855711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555480174084962:2336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:36.856045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555480174084962:2336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:36.857514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555480174084962:2336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:36.859677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555480174084962:2336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:36.859685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555480174084962:2336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:36.859688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555480174084962:2336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:36.859692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:36.861277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:36.867010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:36.867111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:36.867118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:36.867123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:36.867149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:36.867170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555480098514763:7664]
2025-10-02T09:34:36.867507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:36.867662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:36.867684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:36.867861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:36.867888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.867892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.867892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.867893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.867893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.867894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.867894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.867895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.867895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.867896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.867896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.867897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.867900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.867906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.867908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.867910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.867912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.867914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.867916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.867918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.867920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.867922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.867924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.867926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.867930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.867934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:36.867937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.867940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:36.867942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.867945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:36.867947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.867950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:36.867952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.867954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:36.867960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.867963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:36.867965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.867968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:36.867971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.867973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:36.867978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.867981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:36.867983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.867987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.867992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.867995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.867997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.868000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.868018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:36.875525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:36.877008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:36.877017Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:36.877018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:36.877021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:36.877024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2439 [2:7556555480098514763:7664]
2025-10-02T09:34:36.877030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:36.877039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:36.877041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.877042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.877043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.877051Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:36.877056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:36.877060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:36.877089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.877094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.877095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.877096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:36.877098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:36.877133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:36.877138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.877144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:36.877152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:36.877163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:36.877176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174085125:2336], now have 1 active actors on pipe
2025-10-02T09:34:36.877182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174084885:2446], now have 1 active actors on pipe
2025-10-02T09:34:36.877185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.877186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.877187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.877191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:36.877200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:36.877207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:36.877211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:36.877224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.877229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:36.877214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2439
2025-10-02T09:34:36.877219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2439
2025-10-02T09:34:36.877236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:36.877242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.877243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:36.877244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:36.877244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.877248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:36.877263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5854e09b-64c0290b-18834b9b-16777292_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:36.877270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:36.877273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:36.877274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:36.877279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:36.877283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:36.877296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.877409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.877414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.877421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:36.877486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2440 partition: 0 MaxSeqNo: 36 sessionId: src_id|5854e09b-64c0290b-18834b9b-16777292_0
2025-10-02T09:34:36.877757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd9915-3ba1699-e9aa4a8b-247c865f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5854e09b-64c0290b-18834b9b-16777292_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:36.880290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Write session: try to update token
2025-10-02T09:34:36.880305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:36.886094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:36.886105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:36.886106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:36.886107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:36.886110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.886113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.886115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555480098514758:7664]
2025-10-02T09:34:36.886133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:36.886136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:36.886136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:36.886137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:36.886139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:36.886141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:36.886267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:36.892955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId: src_id|5854e09b-64c0290b-18834b9b-16777292_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:36.895122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:36.948499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555480174085178:3012]
2025-10-02T09:34:36.948649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2439, pipe: [1:7556555480174085178:3012]
2025-10-02T09:34:36.995301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:36.995505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:36.995514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:36.995527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174085178:3012], now have 1 active actors on pipe
2025-10-02T09:34:36.995704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:36.995738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555480174085178:3012]
2025-10-02T09:34:36.995784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:36.995792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:36.995828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2440 reason: error at write: Disconnected sessionId: src_id|5854e09b-64c0290b-18834b9b-16777292_0
2025-10-02T09:34:36.995858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:36.995968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2440 sessionId: src_id|5854e09b-64c0290b-18834b9b-16777292_0 is DEAD
2025-10-02T09:34:36.996119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:36.996131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Write session will restart in 0.007496s
2025-10-02T09:34:36.996153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Write session: Do CDS request
2025-10-02T09:34:36.996158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.004155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.004252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.004260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2441
2025-10-02T09:34:37.004388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.004408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.004412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.004415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.004680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2441 sessionId:  describe result for acl check
2025-10-02T09:34:37.004704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.004709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.004710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.004713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469052588:2310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.005093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469052588:2310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.007043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469052588:2310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.008626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.010035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.010112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469052588:2310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.010122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469052588:2310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.010129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.010124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469052588:2310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.010127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.010135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.010141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.010165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.010188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393482347:7658]
2025-10-02T09:34:37.010521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.010684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.010706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.010878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.010929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.010935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.010936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.010936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.010937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.010937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.010938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.010938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.010939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.010939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.010940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.010941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.010943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.010949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.010951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.010953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.010955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.010957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.010959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.010961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.010963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.010966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.010968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.010970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.010973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.010977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.010980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.010983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.010986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.010988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.010990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.010993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.010996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.011000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.011003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.011007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.011011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.011015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.011018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.011021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.011027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.011031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.011034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.011039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.011043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.011047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.011049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.011052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.011068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.018500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.020169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.020179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.020180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.020182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.020186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2440 [2:7556555484393482347:7658]
2025-10-02T09:34:37.020196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.020205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.020210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.020211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.020212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.020220Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.020223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.020227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.020255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.020260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.020261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.020263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.020264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.020300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.020305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.020311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.020316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.020324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.020338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469052749:2310], now have 1 active actors on pipe
2025-10-02T09:34:37.020344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555480174085179:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.020348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.020349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.020350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.020356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.020363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.020368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.020370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.020371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.020374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.020375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.020376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2440
2025-10-02T09:34:37.020388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.020381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2440
2025-10-02T09:34:37.020393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.020394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.020402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.020404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.020431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a35ef75-f140ae9-3beca637-db78a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.020438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.020440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.020441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.020446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.020451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.020463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.020544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.020549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.020556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.020611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2441 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a35ef75-f140ae9-3beca637-db78a92_0
2025-10-02T09:34:37.020887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5854e09b-64c0290b-18834b9b-16777292_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a35ef75-f140ae9-3beca637-db78a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.023528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Write session: try to update token
2025-10-02T09:34:37.023543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.029291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.029302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.029304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.029305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.029309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.029311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.029313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393482342:7658]
2025-10-02T09:34:37.029331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.029332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.029335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.029336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.029340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.029342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.029445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.036267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId: src_id|5a35ef75-f140ae9-3beca637-db78a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.038323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.095974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469052761:3012]
2025-10-02T09:34:37.096135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2440, pipe: [1:7556555484469052761:3012]
2025-10-02T09:34:37.138200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.138575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.138584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.138597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469052761:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.138731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.138756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469052761:3012]
2025-10-02T09:34:37.138757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:37.138760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:37.138777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.138801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2441 reason: error at write: Disconnected sessionId: src_id|5a35ef75-f140ae9-3beca637-db78a92_0
2025-10-02T09:34:37.138950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2441 sessionId: src_id|5a35ef75-f140ae9-3beca637-db78a92_0 is DEAD
2025-10-02T09:34:37.139112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:37.139127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Write session will restart in 0.006699s
2025-10-02T09:34:37.139151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Write session: Do CDS request
2025-10-02T09:34:37.139156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.147199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.147289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.147296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2442
2025-10-02T09:34:37.147419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.147440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.147446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.147449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.147729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2442 sessionId:  describe result for acl check
2025-10-02T09:34:37.147754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.147758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.147759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.147762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469052890:2302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.148093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469052890:2302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.150129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469052890:2302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.151841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.153331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469052890:2302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.153339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469052890:2302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.153341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469052890:2302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.153345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.153382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.153564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.153571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.153577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.153615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.153638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393482628:7654]
2025-10-02T09:34:37.153985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.154155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.154181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.154361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.154389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.154393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.154393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.154394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.154394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.154395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.154396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.154396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.154397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.154397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.154398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.154399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.154402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.154407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.154409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.154411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.154413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.154415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.154417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.154419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.154421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.154424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.154426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.154428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.154432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.154436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.154440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.154443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.154445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.154448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.154450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.154453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.154456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.154458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.154460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.154463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.154465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.154469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.154471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.154473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.154479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.154482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.154484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.154487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.154492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.154495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.154497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.154500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.154519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.162017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.163649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.163659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.163660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.163661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.163665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2441 [2:7556555484393482628:7654]
2025-10-02T09:34:37.163673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.163683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.163687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.163689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.163690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.163699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.163702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.163707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.163738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.163743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.163745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.163747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.163748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.163782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.163787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.163793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.163798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.163810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.163823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053049:2302], now have 1 active actors on pipe
2025-10-02T09:34:37.163829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469052774:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.163833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.163834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.163835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.163844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.163854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.163843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2441
2025-10-02T09:34:37.163854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.163850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2441
2025-10-02T09:34:37.163856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.163856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.163865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.163866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.163887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.163892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.163900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.163907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.163913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.163924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.163931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.163933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.163934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.163938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.163946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.163960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.164042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.164046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.164053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.164106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2442 partition: 0 MaxSeqNo: 36 sessionId: src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0
2025-10-02T09:34:37.164354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a35ef75-f140ae9-3beca637-db78a92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.166894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Write session: try to update token
2025-10-02T09:34:37.166907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.172858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.172866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.172868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.172869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.172872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.172875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.172877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393482622:7654]
2025-10-02T09:34:37.172895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.172899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.172900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.172901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.172901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.172903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.173554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.179198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId: src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.181303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.238818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469053061:3012]
2025-10-02T09:34:37.238951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2441, pipe: [1:7556555484469053061:3012]
2025-10-02T09:34:37.282050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.282240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.282248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.282260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053061:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.282382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.282420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:37.282423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469053061:3012]
2025-10-02T09:34:37.282428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:37.282440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.282476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2442 reason: error at write: Disconnected sessionId: src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0
2025-10-02T09:34:37.282611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2442 sessionId: src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0 is DEAD
2025-10-02T09:34:37.282753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:37.282767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Write session will restart in 0.007656s
2025-10-02T09:34:37.282793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Write session: Do CDS request
2025-10-02T09:34:37.282798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.291178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.291286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.291295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2443
2025-10-02T09:34:37.291388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.291409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.291415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.291417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.291667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2443 sessionId:  describe result for acl check
2025-10-02T09:34:37.291686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.291691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.291694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.291696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469053195:3426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.292038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469053195:3426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.293925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469053195:3426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.294927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.296462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.296556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.296562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.296568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.296594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.296616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393482906:7641]
2025-10-02T09:34:37.296682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469053195:3426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.296690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469053195:3426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.296692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469053195:3426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.296695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.296968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.297129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.297152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.297325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.297351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.297355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.297356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.297356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.297357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.297357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.297358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.297358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.297359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.297359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.297360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.297361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.297363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.297369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.297371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.297374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.297375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.297377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.297379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.297381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.297383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.297385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.297387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.297389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.297393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.297397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.297399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.297402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.297404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.297407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.297410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.297412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.297415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.297417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.297419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.297422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.297424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.297427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.297429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.297432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.297434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.297438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.297440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.297442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.297444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.297447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.297450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.297456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.297474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.304874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.306471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.306481Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.306482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.306484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.306488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2442 [2:7556555484393482906:7641]
2025-10-02T09:34:37.306494Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.306503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.306504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.306506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.306507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.306515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.306521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.306525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.306565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.306569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.306570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.306572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.306573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.306607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.306612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.306618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.306623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.306634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.306647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053064:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.306653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053340:3426], now have 1 active actors on pipe
2025-10-02T09:34:37.306656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.306658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.306659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.306667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.306678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.306679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.306682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.306683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.306688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.306689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.306670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2442
2025-10-02T09:34:37.306688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2442
2025-10-02T09:34:37.306710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.306715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.306724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.306731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.306739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.306749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.306756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.306758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.306759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.306764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.306771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.306787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.306867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.306872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.306879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.306930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2443 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0
2025-10-02T09:34:37.307182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27363b28-770d40a3-c635b408-b4c9dfd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.309720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Write session: try to update token
2025-10-02T09:34:37.309737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.315658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.315669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.315670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.315671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.315674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.315676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.315679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393482901:7641]
2025-10-02T09:34:37.315698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.315699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.315701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.315703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.315704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.315705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.315815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.322308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId: src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.324458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.382687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469053352:3012]
2025-10-02T09:34:37.382862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2442, pipe: [1:7556555484469053352:3012]
2025-10-02T09:34:37.423253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.423708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.423717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.423730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053352:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.423846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.423868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.423883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469053352:3012]
2025-10-02T09:34:37.423897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:37.423949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2443 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0
2025-10-02T09:34:37.424085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2443 sessionId: src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0 is DEAD
2025-10-02T09:34:37.424242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:37.424258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Write session will restart in 0.005366s
2025-10-02T09:34:37.424279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Write session: Do CDS request
2025-10-02T09:34:37.424284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.430137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.430222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.430230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2444
2025-10-02T09:34:37.430341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.430361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.430367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.430371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.430667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2444 sessionId:  describe result for acl check
2025-10-02T09:34:37.430686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.430690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.430691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.430693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469053417:3428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.431050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469053417:3428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.433397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469053417:3428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.435360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469053417:3428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.435367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469053417:3428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.435369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469053417:3428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.435372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.437947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.438200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.438289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.438295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.438301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.438325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.438346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393483189:7650]
2025-10-02T09:34:37.438689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.438841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.438863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.439035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.439062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.439066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.439066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.439067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.439067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.439068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.439068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.439069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.439069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.439070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.439070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.439071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.439074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.439080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.439082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.439084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.439086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.439088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.439090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.439092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.439094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.439096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.439098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.439099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.439103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.439106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.439109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.439112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.439114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.439117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.439119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.439122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.439124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.439127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.439129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.439131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.439134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.439136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.439138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.439145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.439147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.439150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.439152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.439158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.439160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.439163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.439166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.439169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.439186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.446542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.448249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.448259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.448260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.448262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.448265Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2443 [2:7556555484393483189:7650]
2025-10-02T09:34:37.448274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.448283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.448286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.448287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.448289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.448298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.448302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.448306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.448336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.448342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.448343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.448345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.448346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.448382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.448387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.448393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.448398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.448406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.448421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053621:3428], now have 1 active actors on pipe
2025-10-02T09:34:37.448426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053353:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.448429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.448430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.448432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.448440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.448450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.448453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.448455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.448456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.448459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.448460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.448473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.448478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.448479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.448462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2443
2025-10-02T09:34:37.448487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.448466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2443
2025-10-02T09:34:37.448490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.448512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45a1a1af-86842702-48b35bed-c75d20d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.448518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.448522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.448523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.448529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.448536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.448546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.448625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.448630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.448637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.448696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2444 partition: 0 MaxSeqNo: 36 sessionId: src_id|45a1a1af-86842702-48b35bed-c75d20d7_0
2025-10-02T09:34:37.448970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7b56ff-f18d48b1-b0252bf6-f66ada3d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45a1a1af-86842702-48b35bed-c75d20d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.451498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Write session: try to update token
2025-10-02T09:34:37.451513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.457432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.457443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.457444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.457445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.457449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.457451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.457453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393483184:7650]
2025-10-02T09:34:37.457471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.457474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.457475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.457475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.457478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.457480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.457660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.464357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId: src_id|45a1a1af-86842702-48b35bed-c75d20d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.466571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.523989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469053642:3012]
2025-10-02T09:34:37.524143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2443, pipe: [1:7556555484469053642:3012]
2025-10-02T09:34:37.565968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.566269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.566278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.566291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053642:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.566491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.566482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469053642:3012]
2025-10-02T09:34:37.566487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:37.566489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:37.566502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.566526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2444 reason: error at write: Disconnected sessionId: src_id|45a1a1af-86842702-48b35bed-c75d20d7_0
2025-10-02T09:34:37.566678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2444 sessionId: src_id|45a1a1af-86842702-48b35bed-c75d20d7_0 is DEAD
2025-10-02T09:34:37.566843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:37.566854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Write session will restart in 0.006949s
2025-10-02T09:34:37.566879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Write session: Do CDS request
2025-10-02T09:34:37.566884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.575171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.575279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.575286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2445
2025-10-02T09:34:37.575393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.575413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.575419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.575421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.575754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2445 sessionId:  describe result for acl check
2025-10-02T09:34:37.575779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.575784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.575785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.575788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469053751:3429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.576113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469053751:3429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.578196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469053751:3429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.580077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469053751:3429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.580084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469053751:3429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.580085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469053751:3429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.580089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.580089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.581718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.581826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.581833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.581838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.581864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.581887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393483483:7644]
2025-10-02T09:34:37.582225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.582434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.582456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.582637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.582663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.582668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.582668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.582669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.582669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.582670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.582670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.582671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.582672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.582672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.582673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.582673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.582676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.582681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.582683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.582685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.582687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.582689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.582691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.582693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.582695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.582697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.582699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.582701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.582704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.582708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.582711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.582714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.582716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.582718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.582721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.582723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.582726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.582729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.582730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.582733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.582735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.582738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.582740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.582742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.582744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.582747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.582752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.582755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.582757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.582760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.582765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.582768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.582786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.590410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.592020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.592030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.592031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.592033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.592036Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2444 [2:7556555484393483483:7644]
2025-10-02T09:34:37.592043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.592052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.592054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.592055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.592056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.592065Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.592071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.592076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.592105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.592112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.592113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.592115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.592116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.592149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.592154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.592160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.592165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.592173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.592188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053920:3429], now have 1 active actors on pipe
2025-10-02T09:34:37.592195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.592196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.592197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.592205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.592209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053643:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.592213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.592219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.592220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.592222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.592222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.592223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.592236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.592241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.592247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.592237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2444
2025-10-02T09:34:37.592241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2444
2025-10-02T09:34:37.592299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.592304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.592316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|392176f6-c552642-5a219f66-a2cf4332_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.592325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.592327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.592328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.592332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.592337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.592348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.592455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.592460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.592467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.592523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2445 partition: 0 MaxSeqNo: 36 sessionId: src_id|392176f6-c552642-5a219f66-a2cf4332_0
2025-10-02T09:34:37.592769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a1a1af-86842702-48b35bed-c75d20d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|392176f6-c552642-5a219f66-a2cf4332_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.595320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Write session: try to update token
2025-10-02T09:34:37.595334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.601205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.601216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.601218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.601218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.601222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.601227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.601229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393483477:7644]
2025-10-02T09:34:37.601248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.601250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.601251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.601251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.601254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.601256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.601354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.607367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId: src_id|392176f6-c552642-5a219f66-a2cf4332_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.609531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.666857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469053954:3012]
2025-10-02T09:34:37.667022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2444, pipe: [1:7556555484469053954:3012]
2025-10-02T09:34:37.712109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.712347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.712356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.712369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053954:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.712506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.712591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:37.712597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469053954:3012]
2025-10-02T09:34:37.712615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.712657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|392176f6-c552642-5a219f66-a2cf4332_0
2025-10-02T09:34:37.712819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2445 sessionId: src_id|392176f6-c552642-5a219f66-a2cf4332_0 is DEAD
2025-10-02T09:34:37.712994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:37.713008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Write session will restart in 0.005621s
2025-10-02T09:34:37.713030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Write session: Do CDS request
2025-10-02T09:34:37.713035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.719155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.719233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.719239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2446
2025-10-02T09:34:37.719358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.719379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.719385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.719387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.719685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2446 sessionId:  describe result for acl check
2025-10-02T09:34:37.719709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.719714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.719715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.719718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469054020:3456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.720070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469054020:3456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.722639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469054020:3456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.724683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469054020:3456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.724691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469054020:3456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.724693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469054020:3456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.724696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.727067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.727339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.727429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.727435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.727441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.727465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.727488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393483787:7625]
2025-10-02T09:34:37.727828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.727987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.728009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.728181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.728212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.728216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.728217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.728217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.728218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.728218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.728219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.728219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.728220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.728221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.728221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.728222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.728225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.728230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.728232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.728234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.728236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.728238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.728240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.728242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.728244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.728246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.728248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.728250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.728254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.728257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.728260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.728263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.728267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.728269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.728271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.728274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.728276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.728279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.728281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.728284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.728286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.728288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.728290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.728293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.728295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.728298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.728300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.728302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.728304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.728307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.728309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.728313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.728328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.735766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.737429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.737440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.737441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.737443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.737446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2445 [2:7556555484393483787:7625]
2025-10-02T09:34:37.737453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.737463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.737464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.737466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.737467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.737476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.737482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.737487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.737516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.737520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.737521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.737523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.737524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.737557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.737561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.737568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.737574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.737581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.737595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469054232:3456], now have 1 active actors on pipe
2025-10-02T09:34:37.737601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469053956:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.737605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.737607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.737608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.737617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.737624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.737634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.737629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2445
2025-10-02T09:34:37.737635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.737636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.737642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.737643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.737634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2445
2025-10-02T09:34:37.737651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.737652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.737653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.737667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.737668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.737984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2446 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0
2025-10-02T09:34:37.737777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.737785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.737787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.737788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.737793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.737798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.737812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.737922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.737924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.737931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.738247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|392176f6-c552642-5a219f66-a2cf4332_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.740936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Write session: try to update token
2025-10-02T09:34:37.740953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.746925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.746936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.746938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.746939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.746943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.746945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.746947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393483782:7625]
2025-10-02T09:34:37.746966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.746969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.746969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.746970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.746973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.746975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.747098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.753349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId: src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.755586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.812756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469054246:3012]
2025-10-02T09:34:37.812933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2445, pipe: [1:7556555484469054246:3012]
2025-10-02T09:34:37.857122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.857340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.857349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.857362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469054246:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.857516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.857560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:37.857569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:37.857617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2446 reason: error at write: Disconnected sessionId: src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0
2025-10-02T09:34:37.857768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2446 sessionId: src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0 is DEAD
2025-10-02T09:34:37.857937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:37.857958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Write session will restart in 0.009344s
2025-10-02T09:34:37.857981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Write session: Do CDS request
2025-10-02T09:34:37.857969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.857987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:37.857977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469054246:3012]
2025-10-02T09:34:37.868166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.868268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:37.868277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2447
2025-10-02T09:34:37.868406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:37.868426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:37.868432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:37.868434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:37.868694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2447 sessionId:  describe result for acl check
2025-10-02T09:34:37.868711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:37.868716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:37.868717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:37.868719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555484469054464:3465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:37.869076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555484469054464:3465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:37.870137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:37.870495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555484469054464:3465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:37.871709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:37.871813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:37.871820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:37.871826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:37.871854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:37.871876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555484393484068:7612]
2025-10-02T09:34:37.872213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:37.872376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:37.872399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:37.872478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555484469054464:3465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:37.872486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555484469054464:3465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:37.872488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555484469054464:3465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:37.872491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:37.872580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:37.872698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.872703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.872704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.872704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.872705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.872705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.872706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.872707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.872707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.872708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.872708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.872708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.872712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.872717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.872719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.872721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.872723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.872725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.872727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.872729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.872731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.872734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.872736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.872738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.872742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.872746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:37.872749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.872752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:37.872754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.872756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:37.872758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.872761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:37.872763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.872766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:37.872768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.872770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:37.872774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.872776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:37.872778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.872781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:37.872783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.872785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:37.872787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.872790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.872792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.872795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.872797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.872799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.872832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:37.880199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:37.881919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:37.881929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:37.881930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:37.881932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:37.881935Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2446 [2:7556555484393484068:7612]
2025-10-02T09:34:37.881942Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:37.881952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:37.881956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.881958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.881959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.881967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:37.881970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:37.881973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:37.882001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.882006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.882007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.882009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:37.882010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:37.882046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:37.882050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.882056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:37.882061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:37.882069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:37.882083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469054248:2446], now have 1 active actors on pipe
2025-10-02T09:34:37.882089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469054532:3465], now have 1 active actors on pipe
2025-10-02T09:34:37.882093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.882094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.882095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.882103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:37.882113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2446
2025-10-02T09:34:37.882112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:37.882114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:37.882124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2446
2025-10-02T09:34:37.882114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:37.882115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:37.882121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:37.882123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:37.882136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.882138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:37.882139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:37.882149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.882151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.882173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:37.882181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:37.882183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:37.882184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:37.882188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:37.882193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:37.882202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.882299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.882304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.882311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:37.882365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2447 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0
2025-10-02T09:34:37.882611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c1558b2-7bb5e5d4-c94bdd5-26c46f8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:37.885191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Write session: try to update token
2025-10-02T09:34:37.885204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:37.891115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:37.891127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:37.891128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:37.891129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:37.891132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.891135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.891137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555484393484063:7612]
2025-10-02T09:34:37.891156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:37.891157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:37.891159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:37.891160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:37.891160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:37.891161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:37.891270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:37.896969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId: src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:37.899186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:37.958171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555484469054548:3012]
2025-10-02T09:34:37.958305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2446, pipe: [1:7556555484469054548:3012]
2025-10-02T09:34:37.999370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:37.999700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:37.999709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:37.999722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469054548:3012], now have 1 active actors on pipe
2025-10-02T09:34:37.999846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:37.999889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:37.999902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555484469054548:3012]
2025-10-02T09:34:37.999917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:37.999955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0
2025-10-02T09:34:38.000095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2447 sessionId: src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0 is DEAD
2025-10-02T09:34:38.000205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:38.000214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Write session will restart in 0.008351s
2025-10-02T09:34:38.000232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Write session: Do CDS request
2025-10-02T09:34:38.000236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.009225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.009299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.009307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2448
2025-10-02T09:34:38.009437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.009457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.009462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.009465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.009762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2448 sessionId:  describe result for acl check
2025-10-02T09:34:38.009786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.009790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.009791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.009794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764021989:3478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.010127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764021989:3478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.011723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764021989:3478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.014551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.014611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764021989:3478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.014618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764021989:3478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.014620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764021989:3478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.014624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.014791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.014952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.014960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.014966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.014996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.015019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688451661:7621]
2025-10-02T09:34:38.015358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.015524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.015545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.015722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.015749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.015753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.015754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.015754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.015755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.015756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.015756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.015756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.015757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.015758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.015758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.015759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.015761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.015767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.015769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.015771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.015773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.015775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.015777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.015779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.015781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.015783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.015785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.015787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.015790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.015794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.015797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.015800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.015802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.015805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.015807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.015810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.015812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.015815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.015817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.015820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.015822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.015824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.015826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.015829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.015832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.015835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.015837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.015839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.015841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.015845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.015847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.015849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.015868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.023223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.024891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.024901Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.024902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.024904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.024907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2447 [2:7556555488688451661:7621]
2025-10-02T09:34:38.024914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.024924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.024925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.024927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.024928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.024936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.024940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.024944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.024973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.024978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.024979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.024981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.024982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.025015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.025020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.025026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.025031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.025042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.025056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555484469054549:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.025062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022127:3478], now have 1 active actors on pipe
2025-10-02T09:34:38.025066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.025067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.025068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.025075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.025082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.025088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.025090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.025091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.025093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.025094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.025107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.025109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.025110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.025124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.025101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2447
2025-10-02T09:34:38.025129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.025102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2447
2025-10-02T09:34:38.025147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94fb334-684cca88-21b5222f-fb64efeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.025153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.025157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.025158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.025162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.025168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.025180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.025270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.025275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.025283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.025339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2448 partition: 0 MaxSeqNo: 36 sessionId: src_id|94fb334-684cca88-21b5222f-fb64efeb_0
2025-10-02T09:34:38.025605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4a5b0c-ed3b3c47-810b998c-5529660a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94fb334-684cca88-21b5222f-fb64efeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.028201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Write session: try to update token
2025-10-02T09:34:38.028216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.034060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.034071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.034072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.034073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.034077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.034079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.034080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688451655:7621]
2025-10-02T09:34:38.034101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.034102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.034104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.034106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.034107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.034108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.034233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.040900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId: src_id|94fb334-684cca88-21b5222f-fb64efeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.043040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.100011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764022138:3012]
2025-10-02T09:34:38.100159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2447, pipe: [1:7556555488764022138:3012]
2025-10-02T09:34:38.142654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:38.142867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.142874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.142887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022138:3012], now have 1 active actors on pipe
2025-10-02T09:34:38.143036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:38.143060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764022138:3012]
2025-10-02T09:34:38.143069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:38.143085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:38.143138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2448 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94fb334-684cca88-21b5222f-fb64efeb_0
2025-10-02T09:34:38.143277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2448 sessionId: src_id|94fb334-684cca88-21b5222f-fb64efeb_0 is DEAD
2025-10-02T09:34:38.143444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:38.143457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Write session will restart in 0.006762s
2025-10-02T09:34:38.143479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Write session: Do CDS request
2025-10-02T09:34:38.143486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.151127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.151215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.151223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2449
2025-10-02T09:34:38.151345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.151362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.151368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.151370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.151709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2449 sessionId:  describe result for acl check
2025-10-02T09:34:38.151733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.151738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.151739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.151742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764022253:3484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.152079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764022253:3484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.154012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764022253:3484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.155595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764022253:3484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.155602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764022253:3484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.155604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764022253:3484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.155608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.156128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.157554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.157652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.157658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.157664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.157691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.157712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688451948:7618]
2025-10-02T09:34:38.158047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.158196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.158219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.158392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.158420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.158423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.158424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.158426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.158426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.158427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.158427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.158428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.158428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.158429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.158432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.158438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.158440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.158442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.158444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.158446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.158448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.158450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.158452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.158454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.158456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.158458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.158461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.158465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.158468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.158471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.158473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.158476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.158478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.158481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.158483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.158485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.158487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.158490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.158493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.158496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.158498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.158500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.158502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.158509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.158512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.158514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.158517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.158519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.158521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.158524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.158543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.165909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.167586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.167596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.167597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.167599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.167603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2448 [2:7556555488688451948:7618]
2025-10-02T09:34:38.167609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.167617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.167619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.167620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.167622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.167630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.167636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.167640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.167670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.167674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.167675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.167678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.167679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.167716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.167721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.167727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.167732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.167740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.167755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022431:3484], now have 1 active actors on pipe
2025-10-02T09:34:38.167760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022151:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.167764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.167765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.167766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.167774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.167781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.167785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.167787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.167789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.167791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.167793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.167785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2448
2025-10-02T09:34:38.167806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.167811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.167812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.167820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.167794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2448
2025-10-02T09:34:38.167822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.167849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.167855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.167857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.167858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.167863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.167868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.167880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.167973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.167977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.167984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.168037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2449 partition: 0 MaxSeqNo: 36 sessionId: src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0
2025-10-02T09:34:38.168300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94fb334-684cca88-21b5222f-fb64efeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.170884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Write session: try to update token
2025-10-02T09:34:38.170901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.176789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.176813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.176814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.176815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.176819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.176821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.176823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688451943:7618]
2025-10-02T09:34:38.176842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.176844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.176845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.176846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.176846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.176848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.177018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.183044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId: src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.185176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.243363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764022445:3012]
2025-10-02T09:34:38.243499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2448, pipe: [1:7556555488764022445:3012]
2025-10-02T09:34:38.284897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:38.285102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.285110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.285123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022445:3012], now have 1 active actors on pipe
2025-10-02T09:34:38.285240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:38.285252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:38.285261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:38.285262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:38.285291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764022445:3012]
2025-10-02T09:34:38.285300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2449 reason: error at write: Disconnected sessionId: src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0
2025-10-02T09:34:38.285430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2449 sessionId: src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0 is DEAD
2025-10-02T09:34:38.285574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:38.285587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Write session will restart in 0.009015s
2025-10-02T09:34:38.285612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Write session: Do CDS request
2025-10-02T09:34:38.285618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.295172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.295252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.295259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2450
2025-10-02T09:34:38.295379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.295399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.295405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.295408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.295686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2450 sessionId:  describe result for acl check
2025-10-02T09:34:38.295712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.295717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.295718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.295721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764022613:3487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.296078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764022613:3487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.297713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764022613:3487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.298466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.299948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.300043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.300049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.300055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.300080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.300102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688452233:7616]
2025-10-02T09:34:38.300168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764022613:3487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.300177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764022613:3487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.300179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764022613:3487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.300182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.300434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.300592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.300613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.300788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.300826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.300830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.300831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.300831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.300832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.300832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.300833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.300833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.300834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.300835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.300835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.300836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.300838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.300844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.300846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.300848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.300850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.300852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.300854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.300856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.300858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.300860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.300862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.300864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.300867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.300872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.300875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.300878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.300881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.300884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.300886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.300888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.300891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.300893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.300895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.300898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.300900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.300903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.300905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.300908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.300911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.300913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.300915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.300918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.300921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.300923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.300925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.300928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.300948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.308276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.309756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.309767Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.309768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.309769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.309773Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2449 [2:7556555488688452233:7616]
2025-10-02T09:34:38.309780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.309789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.309791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.309792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.309793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.309802Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.309810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.309814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.309844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.309849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.309850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.309851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.309853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.309887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.309892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.309898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.309903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.309914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.309928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022448:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.309933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022731:3487], now have 1 active actors on pipe
2025-10-02T09:34:38.309937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.309938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.309939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.309947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.309955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.309958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.309960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.309961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.309965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.309966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.309964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2449
2025-10-02T09:34:38.309967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2449
2025-10-02T09:34:38.309981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.309985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.309987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.310001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.310003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.310020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.310027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.310029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.310030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.310035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.310043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.310058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.310165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.310170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.310177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.310234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2450 partition: 0 MaxSeqNo: 36 sessionId: src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0
2025-10-02T09:34:38.310473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f2b5-a6c87ea1-1d9e38ec-8e4b3d0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.313014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Write session: try to update token
2025-10-02T09:34:38.313029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.318869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.318880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.318881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.318882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.318885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.318888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.318889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688452228:7616]
2025-10-02T09:34:38.318908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.318909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.318911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.318911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.318912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.318914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.319039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.325116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId: src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.327283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.385179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764022743:3012]
2025-10-02T09:34:38.385312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2449, pipe: [1:7556555488764022743:3012]
2025-10-02T09:34:38.426980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:38.427183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.427192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.427205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022743:3012], now have 1 active actors on pipe
2025-10-02T09:34:38.427324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:38.427392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:38.427392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:38.427395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:38.427437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764022743:3012]
2025-10-02T09:34:38.427439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2450 reason: error at write: Disconnected sessionId: src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0
2025-10-02T09:34:38.427566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2450 sessionId: src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0 is DEAD
2025-10-02T09:34:38.427718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:38.427731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Write session will restart in 0.006211s
2025-10-02T09:34:38.427753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Write session: Do CDS request
2025-10-02T09:34:38.427759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.435163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.435287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.435296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2451
2025-10-02T09:34:38.435434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.435455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.435461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.435463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.435747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2451 sessionId:  describe result for acl check
2025-10-02T09:34:38.435770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.435775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.435776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.435779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764022839:3495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.436122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764022839:3495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.437940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764022839:3495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.439873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764022839:3495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.439880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764022839:3495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.439882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764022839:3495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.439885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.440596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.442179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.442422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.442431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.442439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.442477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.442504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688452523:7615]
2025-10-02T09:34:38.442844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.443005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.443030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.443205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.443232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.443236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.443237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.443237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.443238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.443238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.443239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.443239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.443240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.443240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.443241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.443242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.443244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.443251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.443253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.443255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.443257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.443259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.443261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.443263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.443265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.443267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.443269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.443271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.443274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.443278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.443281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.443284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.443288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.443290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.443293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.443296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.443298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.443301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.443303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.443305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.443308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.443310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.443312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.443315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.443317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.443320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.443322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.443325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.443327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.443330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.443334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.443336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.443351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.450763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.452311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.452322Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.452324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.452326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.452329Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2450 [2:7556555488688452523:7615]
2025-10-02T09:34:38.452337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.452347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.452352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.452354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.452355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.452364Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.452367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.452372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.452400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.452406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.452407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.452409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.452410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.452444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.452449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.452455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.452464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.452473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.452521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2450
2025-10-02T09:34:38.452528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2450
2025-10-02T09:34:38.452485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764022744:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.452491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023025:3495], now have 1 active actors on pipe
2025-10-02T09:34:38.452494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.452496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.452497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.452504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.452511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.452516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.452518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.452518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.452519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.452519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.452533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.452534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.452536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.452552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.452554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.452573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|319eb47c-70068df8-ece86368-8d9d0c44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.452576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.452578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.452579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.452585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.452590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.452598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.452686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.452691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.452698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.452750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2451 partition: 0 MaxSeqNo: 36 sessionId: src_id|319eb47c-70068df8-ece86368-8d9d0c44_0
2025-10-02T09:34:38.453059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1825d8a5-6d26f988-65bc6807-b4e683d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|319eb47c-70068df8-ece86368-8d9d0c44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.455673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Write session: try to update token
2025-10-02T09:34:38.455688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.461633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.461644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.461646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.461647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.461650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.461653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.461655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688452518:7615]
2025-10-02T09:34:38.461673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.461674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.461676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.461677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.461677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.461679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.461784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.467888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId: src_id|319eb47c-70068df8-ece86368-8d9d0c44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.470057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.527518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764023040:3012]
2025-10-02T09:34:38.527679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2450, pipe: [1:7556555488764023040:3012]
2025-10-02T09:34:38.570398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:38.570759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.570767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.570779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023040:3012], now have 1 active actors on pipe
2025-10-02T09:34:38.570895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:38.570926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:38.570932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764023040:3012]
2025-10-02T09:34:38.570950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:38.571002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|319eb47c-70068df8-ece86368-8d9d0c44_0
2025-10-02T09:34:38.571151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2451 sessionId: src_id|319eb47c-70068df8-ece86368-8d9d0c44_0 is DEAD
2025-10-02T09:34:38.571324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:38.571339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Write session will restart in 0.008561s
2025-10-02T09:34:38.571359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Write session: Do CDS request
2025-10-02T09:34:38.571365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.581128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.581267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.581276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2452
2025-10-02T09:34:38.581388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.581409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.581415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.581417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.581706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2452 sessionId:  describe result for acl check
2025-10-02T09:34:38.581731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.581735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.581738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.581741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764023216:3512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.582085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764023216:3512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.583824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764023216:3512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.584124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.585642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.585812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.585820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.585826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.585857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.585880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688452810:7608]
2025-10-02T09:34:38.586042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764023216:3512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.586057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764023216:3512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.586060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764023216:3512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.586065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.586214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.586364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.586385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.586564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.586592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.586596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.586597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.586597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.586598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.586598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.586599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.586599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.586600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.586601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.586601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.586602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.586605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.586610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.586612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.586614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.586616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.586618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.586620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.586622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.586624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.586626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.586628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.586630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.586633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.586637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.586640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.586643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.586645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.586647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.586649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.586652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.586654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.586657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.586658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.586661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.586663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.586666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.586668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.586671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.586673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.586676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.586678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.586681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.586687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.586689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.586691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.586694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.586709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.594112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.595634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.595644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.595645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.595647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.595652Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2451 [2:7556555488688452810:7608]
2025-10-02T09:34:38.595659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.595672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.595677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.595678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.595679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.595688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.595691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.595694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.595723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.595727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.595728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.595730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.595731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.595776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.595782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.595792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.595806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.595822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.595840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023041:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.595847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023326:3512], now have 1 active actors on pipe
2025-10-02T09:34:38.595850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.595851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.595852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.595860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.595871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.595874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.595877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.595878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.595873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2451
2025-10-02T09:34:38.595893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.595892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2451
2025-10-02T09:34:38.595899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.595929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.595936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.595944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.595951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.595963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.595976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.595984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.595988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.595993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.595999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.596009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.596027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.596115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.596121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.596131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.596195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2452 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0
2025-10-02T09:34:38.596464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|319eb47c-70068df8-ece86368-8d9d0c44_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.599038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Write session: try to update token
2025-10-02T09:34:38.599054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.604913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.604923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.604925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.604926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.604929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.604931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.604933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688452805:7608]
2025-10-02T09:34:38.604955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.604959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.604965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.604974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.604985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.604988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.605076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.610922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId: src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.613090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.670867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764023359:3012]
2025-10-02T09:34:38.671027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2451, pipe: [1:7556555488764023359:3012]
2025-10-02T09:34:38.715196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:38.715489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.715499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.715511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023359:3012], now have 1 active actors on pipe
2025-10-02T09:34:38.715685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:38.715705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:38.715742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:38.715746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764023359:3012]
2025-10-02T09:34:38.715799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0
2025-10-02T09:34:38.715946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2452 sessionId: src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0 is DEAD
2025-10-02T09:34:38.716053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:38.716060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Write session will restart in 0.005315s
2025-10-02T09:34:38.716078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Write session: Do CDS request
2025-10-02T09:34:38.716082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.722177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.722286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.722294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2453
2025-10-02T09:34:38.722406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.722425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.722431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.722433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.722753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2453 sessionId:  describe result for acl check
2025-10-02T09:34:38.722770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.722774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.722775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.722778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764023421:3540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.723117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764023421:3540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.725038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764023421:3540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.727661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764023421:3540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.727672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764023421:3540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.727674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764023421:3540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.727678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.729208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.730685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.730793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.730800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.730806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.730836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.730858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688453135:7590]
2025-10-02T09:34:38.731194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.731353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.731376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.731716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.731755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.731759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.731759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.731760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.731760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.731761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.731761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.731762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.731762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.731763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.731763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.731764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.731767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.731773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.731775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.731777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.731779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.731781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.731783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.731785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.731787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.731789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.731791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.731793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.731797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.731801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.731804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.731807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.731809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.731811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.731814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.731816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.731818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.731821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.731823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.731825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.731827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.731830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.731832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.731835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.731837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.731839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.731841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.731844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.731846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.731848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.731850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.731853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.731868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.739227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.740884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.740893Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.740894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.740896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.740899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2452 [2:7556555488688453135:7590]
2025-10-02T09:34:38.740906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.740916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.740920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.740921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.740922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.740930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.740933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.740938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.740968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.740972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.740973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.740975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.740977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.741014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.741019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.741025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.741030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.741038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.741051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023619:3540], now have 1 active actors on pipe
2025-10-02T09:34:38.741056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023361:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.741060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.741061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.741062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.741069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.741076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.741081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.741083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.741084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.741084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.741085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.741099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.741102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.741103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.741105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2452
2025-10-02T09:34:38.741125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2452
2025-10-02T09:34:38.741156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.741161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.741178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.741184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.741186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.741187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.741192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.741197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.741205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.741311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.741316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.741324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.741378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2453 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0
2025-10-02T09:34:38.741638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6fce933-2eed2324-b24e2c47-e8b301e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.744175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Write session: try to update token
2025-10-02T09:34:38.744189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.750137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.750149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.750150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.750151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.750155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.750158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.750160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688453130:7590]
2025-10-02T09:34:38.750180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.750181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.750183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.750183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.750184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.750185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.750308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.756418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId: src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.758616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.815772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764023658:3012]
2025-10-02T09:34:38.815960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2452, pipe: [1:7556555488764023658:3012]
2025-10-02T09:34:38.861260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:38.861559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.861568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.861581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023658:3012], now have 1 active actors on pipe
2025-10-02T09:34:38.861760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:38.861784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764023658:3012]
2025-10-02T09:34:38.861802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:38.861847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:38.861945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2453 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0
2025-10-02T09:34:38.862093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2453 sessionId: src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0 is DEAD
2025-10-02T09:34:38.862242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:38.862256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Write session will restart in 0.006491s
2025-10-02T09:34:38.862276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Write session: Do CDS request
2025-10-02T09:34:38.862282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:38.870095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.870194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:38.870204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2454
2025-10-02T09:34:38.870352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:38.870374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:38.870380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:38.870383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:38.870740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2454 sessionId:  describe result for acl check
2025-10-02T09:34:38.870769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:38.870776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:38.870777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:38.870781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555488764023773:3547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:38.871212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555488764023773:3547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:38.873101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555488764023773:3547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:38.874981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555488764023773:3547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:38.874991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555488764023773:3547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:38.874993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555488764023773:3547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:38.874997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:38.875248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:38.876706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:38.876855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:38.876861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:38.876868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:38.876899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:38.876921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555488688453424:7583]
2025-10-02T09:34:38.877262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:38.877422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:38.877445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:38.877621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:38.877648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.877652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.877653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.877653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.877654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.877654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.877655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.877655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.877656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.877656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.877657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.877658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.877660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.877667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.877669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.877671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.877673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.877675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.877677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.877679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.877680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.877683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.877685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.877687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.877691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.877695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:38.877698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.877701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:38.877703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.877706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:38.877708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.877711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:38.877713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.877716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:38.877718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.877721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:38.877723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.877726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:38.877728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.877730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:38.877732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.877735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:38.877737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.877739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.877742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.877745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.877747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.877750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.877768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:38.885131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:38.886857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:38.886868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:38.886869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:38.886871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:38.886874Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2453 [2:7556555488688453424:7583]
2025-10-02T09:34:38.886881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:38.886892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:38.886895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.886896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.886897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.886907Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:38.886910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:38.886914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:38.886943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.886947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.886948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.886950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:38.886952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:38.886987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:38.886992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.886998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:38.887003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:38.887015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:38.887029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023660:2446], now have 1 active actors on pipe
2025-10-02T09:34:38.887034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023949:3547], now have 1 active actors on pipe
2025-10-02T09:34:38.887038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.887039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.887040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.887047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:38.887056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:38.887059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:38.887061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:38.887063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:38.887064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:38.887066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:38.887079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.887081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:38.887064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2453
2025-10-02T09:34:38.887082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2453
2025-10-02T09:34:38.887090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:38.887104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.887108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.887125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:38.887132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:38.887134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:38.887135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:38.887141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:38.887146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:38.887153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.887246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:38.887251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:38.887259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:38.887313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2454 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0
2025-10-02T09:34:38.887567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7108172-d6144b1c-1aaa3f0a-bcde4dd7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:38.890101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Write session: try to update token
2025-10-02T09:34:38.890114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:38.896052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:38.896064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:38.896065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:38.896066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:38.896070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.896072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.896074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555488688453419:7583]
2025-10-02T09:34:38.896094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:38.896096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:38.896097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:38.896098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:38.896098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:38.896102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:38.896271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:38.902333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId: src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:38.904510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:38.961705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555488764023968:3012]
2025-10-02T09:34:38.961860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2453, pipe: [1:7556555488764023968:3012]
2025-10-02T09:34:39.007933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.008190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.008199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.008211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555488764023968:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.008360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.008369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555488764023968:3012]
2025-10-02T09:34:39.008392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:39.008414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.008446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2454 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0
2025-10-02T09:34:39.008576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2454 sessionId: src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0 is DEAD
2025-10-02T09:34:39.008716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:39.008729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Write session will restart in 0.006520s
2025-10-02T09:34:39.008751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Write session: Do CDS request
2025-10-02T09:34:39.008756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.016156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.016259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.016265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2455
2025-10-02T09:34:39.016373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.016393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.016398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.016401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.016681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2455 sessionId:  describe result for acl check
2025-10-02T09:34:39.016705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.016709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.016710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.016713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058991353:3558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.017066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058991353:3558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.018888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058991353:3558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.020967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058991353:3558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.020975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058991353:3558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.020977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058991353:3558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.020981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.021839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.023390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.023515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.023525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.023534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.023578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.023602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983421023:7584]
2025-10-02T09:34:39.023974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.024155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.024190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.024380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.024410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.024414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.024414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.024415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.024415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.024416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.024416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.024417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.024417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.024418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.024419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.024419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.024422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.024428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.024430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.024432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.024434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.024436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.024438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.024440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.024442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.024444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.024446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.024448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.024452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.024456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.024460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.024463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.024465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.024467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.024470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.024472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.024474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.024482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.024484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.024487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.024489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.024492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.024494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.024496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.024498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.024502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.024505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.024507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.024512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.024515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.024517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.024520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.024540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.031913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.033349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.033360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.033361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.033363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.033367Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2454 [2:7556555492983421023:7584]
2025-10-02T09:34:39.033375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.033384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.033389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.033391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.033392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.033401Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.033407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.033411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.033443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.033447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.033448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.033450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.033451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.033560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2454
2025-10-02T09:34:39.033562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2454
2025-10-02T09:34:39.033662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.033667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.033673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.033678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.033686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.033702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991265:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.033708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991551:3558], now have 1 active actors on pipe
2025-10-02T09:34:39.033719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.033724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.033733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.033737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.033738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.033746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.033757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.033758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.033760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.033761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.033768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.033770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.033780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.033783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.033785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.033790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.033795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.033800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.033818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.033825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.033831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.033833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.033917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.033921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.033929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.033974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2455 partition: 0 MaxSeqNo: 36 sessionId: src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0
2025-10-02T09:34:39.034239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f104035-9df949ce-cc49ae3-c2a2144a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.036766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Write session: try to update token
2025-10-02T09:34:39.036779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.042723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.042733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.042734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.042735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.042739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.042742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.042744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983421018:7584]
2025-10-02T09:34:39.042763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.042764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.042766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.042768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.042769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.042770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.042883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.048373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId: src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.050467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.108612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058991567:3012]
2025-10-02T09:34:39.108753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2454, pipe: [1:7556555493058991567:3012]
2025-10-02T09:34:39.151463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.151690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.151703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.151715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991567:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.151860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.151956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:39.151960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058991567:3012]
2025-10-02T09:34:39.151977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.152017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2455 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0
2025-10-02T09:34:39.152156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2455 sessionId: src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0 is DEAD
2025-10-02T09:34:39.152318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:39.152333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Write session will restart in 0.009891s
2025-10-02T09:34:39.152353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Write session: Do CDS request
2025-10-02T09:34:39.152359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.163175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.163273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.163281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2456
2025-10-02T09:34:39.163392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.163411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.163417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.163420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.163660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2456 sessionId:  describe result for acl check
2025-10-02T09:34:39.163681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.163685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.163687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.163689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058991816:3561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.164018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058991816:3561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.164840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.165356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058991816:3561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.166444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.166561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.166568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.166575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.166603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.166627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983421316:7576]
2025-10-02T09:34:39.166837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058991816:3561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.166845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058991816:3561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.166847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058991816:3561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.166850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.167007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.167169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.167193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.167378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.167406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.167410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.167411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.167411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.167412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.167412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.167413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.167414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.167414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.167415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.167415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.167415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.167418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.167424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.167427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.167429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.167431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.167433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.167435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.167437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.167439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.167441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.167443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.167445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.167449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.167453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.167456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.167459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.167461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.167464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.167466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.167469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.167471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.167474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.167476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.167478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.167480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.167483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.167485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.167487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.167490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.167492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.167496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.167500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.167504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.167508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.167510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.167512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.167531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.174947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.176585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.176596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.176597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.176599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.176603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2455 [2:7556555492983421316:7576]
2025-10-02T09:34:39.176611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.176620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.176623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.176624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.176625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.176633Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.176636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.176641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.176672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.176677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.176678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.176680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.176681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.176714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.176719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.176725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.176730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.176738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.176752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991578:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.176757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991867:3561], now have 1 active actors on pipe
2025-10-02T09:34:39.176761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.176762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.176763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.176770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.176782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.176783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.176785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.176786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.176792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.176794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.176789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2455
2025-10-02T09:34:39.176821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2455
2025-10-02T09:34:39.176822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.176830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.176833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.176854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.176859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.176874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.176881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.176884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.176885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.176890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.176895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.176905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.176998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.177003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.177010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.177064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2456 partition: 0 MaxSeqNo: 36 sessionId: src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0
2025-10-02T09:34:39.177319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c365e-91fe3f77-293fefbb-acd6c2b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.179976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Write session: try to update token
2025-10-02T09:34:39.179990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.185776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.185788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.185789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.185790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.185794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.185796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.185798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983421311:7576]
2025-10-02T09:34:39.185816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.185817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.185820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.185821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.185822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.185824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.186004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.192210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId: src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.194347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.252008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058991879:3012]
2025-10-02T09:34:39.252155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2455, pipe: [1:7556555493058991879:3012]
2025-10-02T09:34:39.294928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.295336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.295345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.295357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991879:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.295472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.295500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058991879:3012]
2025-10-02T09:34:39.295502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.295522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:39.295573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2456 reason: status is not ok: tablet will be restarted right now sessionId: src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0
2025-10-02T09:34:39.295713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2456 sessionId: src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0 is DEAD
2025-10-02T09:34:39.295883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:39.295898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Write session will restart in 0.005324s
2025-10-02T09:34:39.295924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Write session: Do CDS request
2025-10-02T09:34:39.295930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.302143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.302300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.302308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2457
2025-10-02T09:34:39.302418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.302437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.302444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.302446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.302783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2457 sessionId:  describe result for acl check
2025-10-02T09:34:39.302806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.302810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.302811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.302814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058991947:3573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.303164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058991947:3573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.305161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058991947:3573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.307475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058991947:3573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.307483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058991947:3573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.307485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058991947:3573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.307489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.309018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.310518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.310618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.310624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.310629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.310654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.310676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983421610:7573]
2025-10-02T09:34:39.311009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.311156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.311179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.311351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.311379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.311383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.311384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.311384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.311385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.311385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.311386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.311386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.311387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.311387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.311388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.311388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.311391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.311397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.311399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.311402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.311404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.311406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.311408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.311410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.311412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.311414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.311416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.311418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.311421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.311426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.311430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.311432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.311434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.311437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.311439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.311441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.311444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.311449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.311451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.311453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.311456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.311459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.311461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.311463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.311465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.311469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.311471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.311474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.311476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.311478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.311481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.311483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.311502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.318889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.320367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.320379Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.320380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.320382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.320385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2456 [2:7556555492983421610:7573]
2025-10-02T09:34:39.320392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.320401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.320406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.320408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.320409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.320418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.320422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.320426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.320457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.320461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.320462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.320463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.320465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.320498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.320502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.320508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.320515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.320523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.320537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992140:3573], now have 1 active actors on pipe
2025-10-02T09:34:39.320543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058991882:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.320546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.320547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.320548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.320556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.320566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.320567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.320569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.320570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.320576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.320578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.320591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.320599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.320590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2456
2025-10-02T09:34:39.320593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2456
2025-10-02T09:34:39.320614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.320642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.320646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.320659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57ccda01-505bc518-4b10986a-5120d5dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.320666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.320668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.320669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.320674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.320680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.320687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.320793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.320798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.320815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.320882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2457 partition: 0 MaxSeqNo: 36 sessionId: src_id|57ccda01-505bc518-4b10986a-5120d5dd_0
2025-10-02T09:34:39.321140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|740191a3-83bd47b6-f1baaf43-38668fc1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|57ccda01-505bc518-4b10986a-5120d5dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.323769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Write session: try to update token
2025-10-02T09:34:39.323782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.333444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:39.333455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.333459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.333481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:39.333491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:39.333618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:39.333732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:39.333843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:39.333956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:39.334119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:39.334141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:39.336114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId: src_id|57ccda01-505bc518-4b10986a-5120d5dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.337670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.337681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.337682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.337683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.337687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.337689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.337691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983421605:7573]
2025-10-02T09:34:39.337709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.337711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.337712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.337715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.337715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.337716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.337822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.338283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.395876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058992184:3012]
2025-10-02T09:34:39.396020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2456, pipe: [1:7556555493058992184:3012]
2025-10-02T09:34:39.445507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.446115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.446125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.446137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992184:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.446283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.446316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:39.446321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.446325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:39.446354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058992184:3012]
2025-10-02T09:34:39.446367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2457 reason: error at write: Disconnected sessionId: src_id|57ccda01-505bc518-4b10986a-5120d5dd_0
2025-10-02T09:34:39.446499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2457 sessionId: src_id|57ccda01-505bc518-4b10986a-5120d5dd_0 is DEAD
2025-10-02T09:34:39.446658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:39.446671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Write session will restart in 0.008030s
2025-10-02T09:34:39.446692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Write session: Do CDS request
2025-10-02T09:34:39.446698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.456147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.456239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.456249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2458
2025-10-02T09:34:39.456359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.456380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.456386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.456389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.456671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2458 sessionId:  describe result for acl check
2025-10-02T09:34:39.456695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.456699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.456702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.456704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058992339:3576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.457081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058992339:3576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.459086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058992339:3576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.460017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.461666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.461766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.461773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.461779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.461802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.461828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983421905:7560]
2025-10-02T09:34:39.461891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058992339:3576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.461899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058992339:3576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.461901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058992339:3576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.461905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.462175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.462329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.462351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.462527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.462563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.462567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.462568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.462568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.462569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.462569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.462570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.462570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.462571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.462571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.462572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.462572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.462575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.462581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.462583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.462585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.462587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.462589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.462591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.462593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.462595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.462597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.462599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.462601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.462605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.462609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.462612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.462615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.462617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.462620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.462622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.462625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.462627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.462630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.462633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.462635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.462638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.462640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.462642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.462645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.462648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.462650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.462652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.462654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.462656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.462659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.462661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.462663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.462680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.470067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.471885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.471895Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.471896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.471899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.471902Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2457 [2:7556555492983421905:7560]
2025-10-02T09:34:39.471911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.471920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.471926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.471928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.471928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.471938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.471941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.471945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.471979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.471983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.471984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.471986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.471987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.472021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.472026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.472032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.472038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.472046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.472060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992185:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.472065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992476:3576], now have 1 active actors on pipe
2025-10-02T09:34:39.472069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.472070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.472071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.472078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.472085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.472090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.472092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.472093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.472096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.472097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.472114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.472119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.472120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.472104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2457
2025-10-02T09:34:39.472109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2457
2025-10-02T09:34:39.472136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.472141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.472157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.472163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.472166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.472167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.472173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.472179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.472188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.472279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.472284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.472291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.472351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2458 partition: 0 MaxSeqNo: 36 sessionId: src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0
2025-10-02T09:34:39.472652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57ccda01-505bc518-4b10986a-5120d5dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.475283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Write session: try to update token
2025-10-02T09:34:39.475302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.481142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.481155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.481157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.481158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.481164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.481168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.481171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983421900:7560]
2025-10-02T09:34:39.481191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.481196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.481200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.481200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.481202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.481203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.481332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.487772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId: src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.490025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.546400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058992488:3012]
2025-10-02T09:34:39.546588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2457, pipe: [1:7556555493058992488:3012]
2025-10-02T09:34:39.591855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.592315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.592325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.592338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992488:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.592517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.592523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:39.592527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:39.592589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058992488:3012]
2025-10-02T09:34:39.592597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2458 reason: error at write: Disconnected sessionId: src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0
2025-10-02T09:34:39.592655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.592729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2458 sessionId: src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0 is DEAD
2025-10-02T09:34:39.593046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:39.593060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Write session will restart in 0.009476s
2025-10-02T09:34:39.593085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Write session: Do CDS request
2025-10-02T09:34:39.593091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.603161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.603254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.603263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2459
2025-10-02T09:34:39.603387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.603408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.603414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.603416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.603663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2459 sessionId:  describe result for acl check
2025-10-02T09:34:39.603682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.603686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.603687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.603691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058992666:3574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.604078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058992666:3574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.605954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058992666:3574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.606263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.607804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.607900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.607907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.607914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.607939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.607962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983422200:7566]
2025-10-02T09:34:39.608007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058992666:3574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.608015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058992666:3574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.608016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058992666:3574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.608020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.608306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.608464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.608490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.608676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.608705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.608709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.608710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.608710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.608711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.608711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.608712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.608712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.608713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.608713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.608714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.608714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.608717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.608723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.608725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.608727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.608730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.608732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.608734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.608736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.608738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.608740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.608742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.608744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.608747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.608751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.608755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.608758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.608760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.608762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.608765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.608767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.608770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.608772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.608774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.608777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.608779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.608782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.608784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.608787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.608789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.608792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.608796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.608799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.608812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.608815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.608817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.608820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.608837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.616435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.618093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.618104Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.618105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.618107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.618111Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2458 [2:7556555492983422200:7566]
2025-10-02T09:34:39.618117Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.618126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.618127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.618129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.618131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.618140Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.618143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.618146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.618178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.618183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.618184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.618186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.618187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.618224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.618228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.618235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.618240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.618248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.618263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992781:3574], now have 1 active actors on pipe
2025-10-02T09:34:39.618269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992489:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.618272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.618274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.618275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.618282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.618290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.618293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.618295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.618296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.618300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.618302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.618316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.618321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.618322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.618313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2458
2025-10-02T09:34:39.618347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2458
2025-10-02T09:34:39.618363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.618371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.618388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.618397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.618400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.618404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.618411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.618418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.618426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.618534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.618539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.618553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.618605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2459 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0
2025-10-02T09:34:39.618844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196b6bcd-6799bf76-b5f0ad8c-76bd3b82_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.621506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Write session: try to update token
2025-10-02T09:34:39.621521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.627428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:39.627439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.627443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.627463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:39.627468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:39.627601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:39.627712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:39.627827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:39.627942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:39.628103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:39.628129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:39.634103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId: src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.636240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.636252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.636253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.636254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.636258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.636260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.636263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983422195:7566]
2025-10-02T09:34:39.636281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.636284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.636286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.636285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.636288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.636290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.636308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.636425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.692829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058992816:3012]
2025-10-02T09:34:39.692950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2458, pipe: [1:7556555493058992816:3012]
2025-10-02T09:34:39.748996Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.749294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.749303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.749316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992816:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.749462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.749483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.749486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:39.749490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:39.749525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058992816:3012]
2025-10-02T09:34:39.749538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2459 reason: error at write: Disconnected sessionId: src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0
2025-10-02T09:34:39.749681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2459 sessionId: src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0 is DEAD
2025-10-02T09:34:39.749821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:39.749834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Write session will restart in 0.005485s
2025-10-02T09:34:39.749855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Write session: Do CDS request
2025-10-02T09:34:39.749861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.756166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.756294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.756300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2460
2025-10-02T09:34:39.756420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.756441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.756447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.756450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.756745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2460 sessionId:  describe result for acl check
2025-10-02T09:34:39.756767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.756771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.756773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.756776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058992890:3601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.757134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058992890:3601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.759089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058992890:3601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.761632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058992890:3601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.761641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058992890:3601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.761643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058992890:3601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.761646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.763348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.765006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.765096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.765103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.765108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.765133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.765154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983422534:7545]
2025-10-02T09:34:39.765487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.765661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.765683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.765874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.765908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.765911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.765912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.765913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.765913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.765914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.765915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.765915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.765916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.765916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.765917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.765917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.765920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.765926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.765928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.765930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.765932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.765934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.765936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.765938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.765940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.765942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.765944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.765946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.765949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.765953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.765956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.765959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.765962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.765965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.765967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.765970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.765972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.765975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.765977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.765979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.765981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.765984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.765986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.765989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.765991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.765994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.765996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.765999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.766001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.766004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.766006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.766009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.766030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.773449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.775056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.775066Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.775067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.775069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.775072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2459 [2:7556555492983422534:7545]
2025-10-02T09:34:39.775079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.775088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.775092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.775094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.775095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.775104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.775110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.775114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.775145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.775150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.775151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.775153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.775154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.775188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.775193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.775199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.775204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.775215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.775227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058992820:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.775232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058993074:3601], now have 1 active actors on pipe
2025-10-02T09:34:39.775236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.775238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.775239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.775247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.775254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.775261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.775263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.775265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.775266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.775268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.775279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.775281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.775282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.775265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2459
2025-10-02T09:34:39.775268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2459
2025-10-02T09:34:39.775300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.775305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.775320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.775326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.775329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.775330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.775335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.775340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.775347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.775447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.775452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.775460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.775516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2460 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0
2025-10-02T09:34:39.775769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9179bcb-bdf1dece-7adcba66-6fc831da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.778333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Write session: try to update token
2025-10-02T09:34:39.778348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.784172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.784184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.784185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.784186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.784189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.784192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.784196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983422529:7545]
2025-10-02T09:34:39.784215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.784218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.784218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.784219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.784221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.784223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.784325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.790119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId: src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.792216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.849499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058993126:3012]
2025-10-02T09:34:39.849677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2459, pipe: [1:7556555493058993126:3012]
2025-10-02T09:34:39.893252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:39.893623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.893632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.893644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058993126:3012], now have 1 active actors on pipe
2025-10-02T09:34:39.893756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:39.893835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:39.893836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058993126:3012]
2025-10-02T09:34:39.893848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:39.893891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2460 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0
2025-10-02T09:34:39.894024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2460 sessionId: src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0 is DEAD
2025-10-02T09:34:39.894191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:39.894205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Write session will restart in 0.009117s
2025-10-02T09:34:39.894231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Write session: Do CDS request
2025-10-02T09:34:39.894236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:39.904168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.904257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:39.904265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2461
2025-10-02T09:34:39.904395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:39.904416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:39.904422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:39.904424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:39.904793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2461 sessionId:  describe result for acl check
2025-10-02T09:34:39.904828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:39.904832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:39.904833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:39.904836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555493058993302:3607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:39.905172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555493058993302:3607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:39.907104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555493058993302:3607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:39.907867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:39.909585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:39.909682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:39.909688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:39.909694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:39.909719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:39.909742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555492983422830:7540]
2025-10-02T09:34:39.909771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555493058993302:3607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:39.909778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555493058993302:3607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:39.909780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555493058993302:3607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:39.909783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:39.910077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:39.910238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:39.910260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:39.910432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:39.910459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.910463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.910464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.910464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.910465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.910465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.910466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.910466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.910467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.910467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.910468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.910468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.910471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.910477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.910479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.910481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.910483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.910485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.910487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.910489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.910490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.910493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.910494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.910496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.910500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.910503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:39.910507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.910510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:39.910512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.910515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:39.910517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.910522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:39.910525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.910528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:39.910533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.910535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:39.910537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.910540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:39.910549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.910552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:39.910554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.910557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:39.910562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.910565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.910567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.910570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.910574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.910577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.910597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:39.918019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:39.919764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:39.919775Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:39.919776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:39.919778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:39.919781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2460 [2:7556555492983422830:7540]
2025-10-02T09:34:39.919789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:39.919799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:39.919803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.919805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.919806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.919815Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:39.919821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:39.919825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:39.919854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.919858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.919859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.919861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:39.919862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:39.919895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:39.919900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.919906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:39.919914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:39.919925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:39.919938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058993134:2446], now have 1 active actors on pipe
2025-10-02T09:34:39.919943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058993428:3607], now have 1 active actors on pipe
2025-10-02T09:34:39.919947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.919948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.919950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.919957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:39.919963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:39.919974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:39.919976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:39.919978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:39.919979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:39.919973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2460
2025-10-02T09:34:39.919976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2460
2025-10-02T09:34:39.919980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:39.919990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.919992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:39.919996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:39.920010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.920015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.920031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:39.920038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:39.920040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:39.920044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:39.920049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:39.920053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:39.920061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.920163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:39.920168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:39.920176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:39.920229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2461 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0
2025-10-02T09:34:39.920476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad15b01-7f73ae49-48ba7d52-d8e570b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:39.923051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Write session: try to update token
2025-10-02T09:34:39.923066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:39.928935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:39.928945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:39.928947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:39.928948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:39.928951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.928953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.928955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555492983422825:7540]
2025-10-02T09:34:39.928974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:39.928977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:39.928978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:39.928980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:39.928983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:39.928986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:39.929093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:39.935074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId: src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:39.937860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:39.993895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555493058993442:3012]
2025-10-02T09:34:39.994063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2460, pipe: [1:7556555493058993442:3012]
2025-10-02T09:34:40.038833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.039221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.039230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.039243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555493058993442:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.039380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.039433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:40.039438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.039470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555493058993442:3012]
2025-10-02T09:34:40.039497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2461 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0
2025-10-02T09:34:40.039642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2461 sessionId: src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0 is DEAD
2025-10-02T09:34:40.039819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:40.039833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Write session will restart in 0.007308s
2025-10-02T09:34:40.039854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Write session: Do CDS request
2025-10-02T09:34:40.039859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.048164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.048238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.048245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2462
2025-10-02T09:34:40.048372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.048391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.048397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.048399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.048673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2462 sessionId:  describe result for acl check
2025-10-02T09:34:40.048695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.048699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.048701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.048704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353960857:3625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.049063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353960857:3625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.050897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353960857:3625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.053090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353960857:3625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.053098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353960857:3625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.053100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353960857:3625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.053103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.053217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.054838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.054946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.054955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.054964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.055012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.055043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278390435:7529]
2025-10-02T09:34:40.055420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.055607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.055632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.055810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.055838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.055842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.055842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.055843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.055844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.055844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.055845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.055846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.055846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.055847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.055848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.055848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.055851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.055857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.055859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.055861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.055863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.055865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.055867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.055868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.055870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.055873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.055875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.055877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.055880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.055884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.055887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.055890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.055893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.055895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.055898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.055900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.055903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.055905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.055907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.055910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.055913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.055916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.055918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.055921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.055923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.055926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.055932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.055935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.055937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.055939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.055944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.055946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.055962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.063417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.065008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.065018Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.065019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.065021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.065024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2461 [2:7556555497278390435:7529]
2025-10-02T09:34:40.065146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.065159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.065164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.065165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.065167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.065175Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.065177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.065181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.065216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.065221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.065222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.065225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.065226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.065262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.065268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.065274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.065279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.065290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.065304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353960740:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.065309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961034:3625], now have 1 active actors on pipe
2025-10-02T09:34:40.065313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.065314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.065315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.065322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.065332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.065334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.065336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.065337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.065342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.065344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.065356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.065348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2461
2025-10-02T09:34:40.065350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2461
2025-10-02T09:34:40.065361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.065363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.065376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.065378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.065395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.065402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.065404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.065405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.065410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.065415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.065427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.065546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.065551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.065558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.065613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2462 partition: 0 MaxSeqNo: 36 sessionId: src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0
2025-10-02T09:34:40.065846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4154bc3-5301b81c-a665c174-9fb11ba4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.068418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Write session: try to update token
2025-10-02T09:34:40.068432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.074301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.074312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.074313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.074314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.074318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.074320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.074322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278390429:7529]
2025-10-02T09:34:40.074342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.074343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.074344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.074346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.074346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.074348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.074461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.080444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId: src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.082578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:40.139812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555497353961058:3012]
2025-10-02T09:34:40.140170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2461, pipe: [1:7556555497353961058:3012]
2025-10-02T09:34:40.183151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.183471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.183480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.183492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961058:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.183611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.183651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555497353961058:3012]
2025-10-02T09:34:40.183656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:40.183669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.183717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2462 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0
2025-10-02T09:34:40.183852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2462 sessionId: src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0 is DEAD
2025-10-02T09:34:40.183968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:40.183974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Write session will restart in 0.009402s
2025-10-02T09:34:40.183989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Write session: Do CDS request
2025-10-02T09:34:40.183992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.194184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.194257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.194265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2463
2025-10-02T09:34:40.194390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.194410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.194416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.194418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.194715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2463 sessionId:  describe result for acl check
2025-10-02T09:34:40.194734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.194738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.194739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.194742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353961265:3634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.195070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353961265:3634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.196576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353961265:3634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.196896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.198423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.198527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.198534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.198539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.198574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.198597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278390735:7521]
2025-10-02T09:34:40.198660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353961265:3634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.198668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353961265:3634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.198670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353961265:3634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.198674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.198938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.199105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.199129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.199297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.199325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.199329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.199330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.199330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.199331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.199331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.199332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.199332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.199333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.199333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.199334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.199334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.199337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.199343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.199345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.199347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.199349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.199351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.199353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.199355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.199357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.199359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.199361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.199363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.199367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.199370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.199374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.199376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.199378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.199381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.199383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.199387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.199389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.199391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.199393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.199396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.199398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.199401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.199403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.199405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.199407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.199410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.199412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.199415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.199417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.199420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.199422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.199425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.199442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.206903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.208493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.208504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.208505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.208507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.208510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2462 [2:7556555497278390735:7521]
2025-10-02T09:34:40.208517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.208525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.208527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.208528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.208530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.208540Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.208543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.208547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.208575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.208581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.208582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.208584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.208585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.208622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.208626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.208633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.208638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.208648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.208663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961356:3634], now have 1 active actors on pipe
2025-10-02T09:34:40.208668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961060:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.208672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.208673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.208674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.208681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.208691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.208694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.208696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.208697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.208700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.208701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.208715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.208720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.208710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2462
2025-10-02T09:34:40.208734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.208710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2462
2025-10-02T09:34:40.208739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.208741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.208758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce7326ca-a18412be-6e1767a3-33502b97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.208765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.208767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.208768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.208773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.208779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.208787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.208900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.208905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.208913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.208969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2463 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce7326ca-a18412be-6e1767a3-33502b97_0
2025-10-02T09:34:40.209196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faba919-c0c13f72-6aa856b5-8c9c64ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce7326ca-a18412be-6e1767a3-33502b97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.212094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Write session: try to update token
2025-10-02T09:34:40.212105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.218817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.218826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.218827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.218829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.218833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.218836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.218838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278390730:7521]
2025-10-02T09:34:40.218861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.218863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.218864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.218865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.218867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.218872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.219014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.225583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId: src_id|ce7326ca-a18412be-6e1767a3-33502b97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.227604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:40.283664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555497353961369:3012]
2025-10-02T09:34:40.283805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2462, pipe: [1:7556555497353961369:3012]
2025-10-02T09:34:40.327968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.328481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.328491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.328503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961369:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.328621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.328653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:40.328662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:40.328674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.328701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2463 reason: error at write: Disconnected sessionId: src_id|ce7326ca-a18412be-6e1767a3-33502b97_0
2025-10-02T09:34:40.328702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555497353961369:3012]
2025-10-02T09:34:40.328826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2463 sessionId: src_id|ce7326ca-a18412be-6e1767a3-33502b97_0 is DEAD
2025-10-02T09:34:40.328936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:40.328950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Write session will restart in 0.008097s
2025-10-02T09:34:40.328975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Write session: Do CDS request
2025-10-02T09:34:40.328981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.338163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.338164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.338172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2464
2025-10-02T09:34:40.338406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.338425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.338431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.338433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.338731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2464 sessionId:  describe result for acl check
2025-10-02T09:34:40.338755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.338760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.338761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.338763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353961503:3648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.339109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353961503:3648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.340854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353961503:3648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.342807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.344386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.344461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353961503:3648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.344469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353961503:3648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.344471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353961503:3648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.344474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.344562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.344570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.344577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.344610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.344633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278391037:7515]
2025-10-02T09:34:40.344985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.345152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.345174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.345347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.345377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.345380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.345381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.345382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.345382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.345383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.345383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.345384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.345384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.345385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.345385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.345386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.345388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.345394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.345396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.345398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.345400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.345402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.345405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.345406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.345409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.345411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.345412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.345414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.345418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.345422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.345426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.345428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.345431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.345433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.345435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.345438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.345440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.345443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.345445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.345448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.345450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.345453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.345455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.345458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.345460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.345463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.345467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.345472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.345474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.345477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.345479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.345482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.345500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.352916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.354475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.354486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.354487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.354489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.354492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2463 [2:7556555497278391037:7515]
2025-10-02T09:34:40.354499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.354508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.354509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.354511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.354512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.354521Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.354524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.354528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.354565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.354570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.354571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.354573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.354574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.354610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.354615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.354621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.354627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.354634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.354648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961667:3648], now have 1 active actors on pipe
2025-10-02T09:34:40.354654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961370:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.354657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.354659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.354660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.354667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.354676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.354677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.354679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.354680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.354685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.354686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.354683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2463
2025-10-02T09:34:40.354699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.354697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2463
2025-10-02T09:34:40.354704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.354705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.354714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.354716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.354739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.354747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.354749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.354750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.354755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.354762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.354772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.354850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.354855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.354863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.354917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2464 partition: 0 MaxSeqNo: 36 sessionId: src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0
2025-10-02T09:34:40.355138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce7326ca-a18412be-6e1767a3-33502b97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.357921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Write session: try to update token
2025-10-02T09:34:40.357934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.364876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.364891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.364893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.364894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.364901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.364904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.364907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278391032:7515]
2025-10-02T09:34:40.364934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.364934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.364936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.364937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.364938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.364938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.365051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.370705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId: src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.372726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:40.429096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555497353961679:3012]
2025-10-02T09:34:40.429242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2463, pipe: [1:7556555497353961679:3012]
2025-10-02T09:34:40.473964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.474184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.474193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.474205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961679:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.474369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.474384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555497353961679:3012]
2025-10-02T09:34:40.474403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:40.474404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:40.474446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2464 reason: error at write: Disconnected sessionId: src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0
2025-10-02T09:34:40.474537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.474590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2464 sessionId: src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0 is DEAD
2025-10-02T09:34:40.474722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:40.474731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Write session will restart in 0.006614s
2025-10-02T09:34:40.474748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Write session: Do CDS request
2025-10-02T09:34:40.474753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.482213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.482562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.482568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2465
2025-10-02T09:34:40.482647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.482666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.482672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.482675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.482925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2465 sessionId:  describe result for acl check
2025-10-02T09:34:40.482946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.482951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.482951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.482954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353961762:3651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.483307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353961762:3651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.485298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353961762:3651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.487473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353961762:3651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.487480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353961762:3651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.487482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353961762:3651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.487485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.488833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.490389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.490517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.490524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.490530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.490567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.490591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278391339:7511]
2025-10-02T09:34:40.490926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.491082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.491104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.491275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.491304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.491308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.491309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.491309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.491310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.491310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.491311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.491311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.491312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.491312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.491313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.491313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.491316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.491322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.491324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.491326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.491328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.491330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.491332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.491334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.491336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.491338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.491340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.491342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.491345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.491349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.491352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.491355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.491357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.491360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.491362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.491364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.491367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.491370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.491376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.491379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.491381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.491384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.491386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.491388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.491390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.491394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.491396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.491399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.491401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.491404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.491406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.491408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.491425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.498780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.500376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.500387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.500388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.500390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.500393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2464 [2:7556555497278391339:7511]
2025-10-02T09:34:40.500401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.500409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.500411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.500412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.500413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.500421Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.500429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.500433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.500465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.500469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.500470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.500472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.500473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.500508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.500513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.500519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.500524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.500532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.500544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961959:3651], now have 1 active actors on pipe
2025-10-02T09:34:40.500549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961680:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.500552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.500554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.500554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.500562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.500569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.500575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.500577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.500578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.500579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.500581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.500593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.500595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.500578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2464
2025-10-02T09:34:40.500595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2464
2025-10-02T09:34:40.500602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.500613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.500615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.500630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|640f587e-5e1f3ff6-b718e436-506247c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.500637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.500639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.500641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.500645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.500649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.500657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.500751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.500756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.500763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.500824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2465 partition: 0 MaxSeqNo: 36 sessionId: src_id|640f587e-5e1f3ff6-b718e436-506247c_0
2025-10-02T09:34:40.501028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcad658-194d159d-3f4d83ce-f4d54907_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|640f587e-5e1f3ff6-b718e436-506247c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.503784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Write session: try to update token
2025-10-02T09:34:40.503795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.510666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.510678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.510679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.510680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.510684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.510686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.510689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278391334:7511]
2025-10-02T09:34:40.510708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.510711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.510712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.510712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.510715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.510717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.510820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.517193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId: src_id|640f587e-5e1f3ff6-b718e436-506247c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.519221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:40.574507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555497353961990:3012]
2025-10-02T09:34:40.574685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2464, pipe: [1:7556555497353961990:3012]
2025-10-02T09:34:40.620435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.620839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.620849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.620861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961990:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.621067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555497353961990:3012]
2025-10-02T09:34:40.621095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:40.621102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:40.621122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.621146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2465 reason: error at write: Disconnected sessionId: src_id|640f587e-5e1f3ff6-b718e436-506247c_0
2025-10-02T09:34:40.621213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.621287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2465 sessionId: src_id|640f587e-5e1f3ff6-b718e436-506247c_0 is DEAD
2025-10-02T09:34:40.621398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:40.621408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Write session will restart in 0.009866s
2025-10-02T09:34:40.621429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Write session: Do CDS request
2025-10-02T09:34:40.621433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.632099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.632190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.632197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2466
2025-10-02T09:34:40.632278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.632296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.632300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.632307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.632628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2466 sessionId:  describe result for acl check
2025-10-02T09:34:40.632653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.632657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.632658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.632661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353962171:3666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.633011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353962171:3666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.634549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353962171:3666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.635385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.636909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.637002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.637008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.637014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.637040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.637064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278391640:7501]
2025-10-02T09:34:40.637140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353962171:3666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.637148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353962171:3666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.637150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353962171:3666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.637154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.637396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.637565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.637587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.637788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.637826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.637830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.637831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.637831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.637832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.637832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.637833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.637833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.637834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.637834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.637835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.637835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.637838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.637844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.637846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.637848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.637850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.637852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.637854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.637855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.637857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.637860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.637861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.637863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.637867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.637870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.637873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.637876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.637878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.637881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.637884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.637886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.637889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.637891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.637893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.637895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.637897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.637900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.637902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.637905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.637907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.637910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.637916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.637918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.637924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.637927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.637929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.637931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.637952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.645278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.646759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.646770Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.646771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.646773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.646776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2465 [2:7556555497278391640:7501]
2025-10-02T09:34:40.646786Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.646796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.646798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.646799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.646801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.646809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.646816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.646820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.646852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.646857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.646858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.646860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.646861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.646894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.646899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.646906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.646914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.646932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.646950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962290:3666], now have 1 active actors on pipe
2025-10-02T09:34:40.646957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353961991:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.646962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.646963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.646965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.646975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.646986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.646990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.646993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.646994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.647001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.647003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.647003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2465
2025-10-02T09:34:40.647021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.647011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2465
2025-10-02T09:34:40.647029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.647029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.647041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.647048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.647079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.647089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.647092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.647097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.647105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.647116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.647136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.647230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.647238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.647247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.647302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2466 partition: 0 MaxSeqNo: 36 sessionId: src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0
2025-10-02T09:34:40.647487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|640f587e-5e1f3ff6-b718e436-506247c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.650299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Write session: try to update token
2025-10-02T09:34:40.650311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.657405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.657425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.657428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.657431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.657438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.657444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.657449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278391635:7501]
2025-10-02T09:34:40.657483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.657487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.657492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.657493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.657494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.657496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.657625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.663638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId: src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.665826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:40.721548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555497353962324:3012]
2025-10-02T09:34:40.721740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2465, pipe: [1:7556555497353962324:3012]
2025-10-02T09:34:40.768263Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.768500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.768509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.768521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962324:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.768678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.769006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:40.769015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555497353962324:3012]
2025-10-02T09:34:40.769028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.769065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2466 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0
2025-10-02T09:34:40.769191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2466 sessionId: src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0 is DEAD
2025-10-02T09:34:40.769315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:40.769324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Write session will restart in 0.008705s
2025-10-02T09:34:40.769338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Write session: Do CDS request
2025-10-02T09:34:40.769342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.779129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.779190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.779198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2467
2025-10-02T09:34:40.779276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.779299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.779305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.779308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.779641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2467 sessionId:  describe result for acl check
2025-10-02T09:34:40.779664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.779668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.779670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.779673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353962480:3688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.780014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353962480:3688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.782506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353962480:3688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.784697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.784831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353962480:3688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.784839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353962480:3688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.784841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353962480:3688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.784844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.784932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.785022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.785028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.785033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.785058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.785081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278391980:7475]
2025-10-02T09:34:40.785413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.785567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.785588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.785757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.785787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.785791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.785791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.785792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.785792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.785793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.785793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.785794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.785794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.785795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.785796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.785796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.785799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.785805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.785807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.785809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.785811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.785813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.785814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.785816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.785818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.785821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.785823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.785825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.785828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.785832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.785836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.785839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.785841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.785844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.785846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.785849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.785851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.785855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.785857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.785859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.785861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.785864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.785866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.785868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.785870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.785873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.785875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.785877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.785879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.785882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.785883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.785886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.785905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.793213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.794765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.794776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.794777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.794779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.794781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2466 [2:7556555497278391980:7475]
2025-10-02T09:34:40.794788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.794797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.794801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.794803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.794804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.794813Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.794819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.794823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.794855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.794859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.794861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.794862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.794863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.794897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.794903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.794909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.794914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.794925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.794938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962325:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.794943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962625:3688], now have 1 active actors on pipe
2025-10-02T09:34:40.794947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.794948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.794950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.794957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.794966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.794970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.794971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.794973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.794976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.794978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.794990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.794976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2466
2025-10-02T09:34:40.794977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2466
2025-10-02T09:34:40.794991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.794993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.795007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.795009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.795025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.795032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.795034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.795035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.795040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.795045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.795057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.795145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.795150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.795157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.795209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2467 partition: 0 MaxSeqNo: 36 sessionId: src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0
2025-10-02T09:34:40.795404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d30403-5ee47ccc-e48aec8f-6c24ddc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.798162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Write session: try to update token
2025-10-02T09:34:40.798173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.805158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.805172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.805173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.805174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.805179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.805181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.805183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278391974:7475]
2025-10-02T09:34:40.805204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.805207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.805209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.805209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.805212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.805215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.805314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.811058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId: src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.813176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:40.869402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555497353962640:3012]
2025-10-02T09:34:40.869772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2466, pipe: [1:7556555497353962640:3012]
2025-10-02T09:34:40.914760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:40.915144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.915153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.915165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962640:3012], now have 1 active actors on pipe
2025-10-02T09:34:40.915308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:40.915354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555497353962640:3012]
2025-10-02T09:34:40.915368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:40.915371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:40.915414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2467 reason: error at write: Disconnected sessionId: src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0
2025-10-02T09:34:40.915507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:40.915550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2467 sessionId: src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0 is DEAD
2025-10-02T09:34:40.915915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:40.915925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Write session will restart in 0.007744s
2025-10-02T09:34:40.915943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Write session: Do CDS request
2025-10-02T09:34:40.915948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:40.924102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.924205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:40.924213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2468
2025-10-02T09:34:40.924289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:40.924308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:40.924314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:40.924316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:40.924666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2468 sessionId:  describe result for acl check
2025-10-02T09:34:40.924688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:40.924692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:40.924696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:40.924700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555497353962736:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:40.925102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555497353962736:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:40.927174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555497353962736:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:40.928767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555497353962736:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:40.928776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555497353962736:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:40.928778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555497353962736:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:40.928781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:40.930627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:40.932240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:40.932335Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:40.932342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:40.932348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:40.932460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:40.932485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555497278392284:7469]
2025-10-02T09:34:40.932833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:40.932995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:40.933017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:40.933193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:40.933223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.933227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.933227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.933228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.933228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.933229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.933229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.933230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.933231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.933231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.933232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.933233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.933235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.933242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.933244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.933246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.933248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.933250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.933252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.933254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.933256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.933258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.933260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.933262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.933265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.933270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:40.933273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.933276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:40.933278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.933281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:40.933283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.933286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:40.933288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.933290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:40.933293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.933295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:40.933297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.933300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:40.933304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.933306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:40.933311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.933317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:40.933319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.933322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.933324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.933327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.933329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.933335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.933351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:40.940890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:40.942394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:40.942405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:40.942406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:40.942408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:40.942411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2467 [2:7556555497278392284:7469]
2025-10-02T09:34:40.942419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:40.942428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:40.942431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.942433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.942434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.942443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:40.942446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:40.942450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:40.942482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.942487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.942488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.942491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:40.942492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:40.942530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:40.942535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.942551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:40.942559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:40.942567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:40.942581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962918:3707], now have 1 active actors on pipe
2025-10-02T09:34:40.942587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555497353962643:2446], now have 1 active actors on pipe
2025-10-02T09:34:40.942591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.942592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.942593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.942601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:40.942609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:40.942616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:40.942616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:40.942618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:40.942623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:40.942625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:40.942632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.942633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:40.942639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:40.942623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2467
2025-10-02T09:34:40.942637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2467
2025-10-02T09:34:40.942770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.942776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.942789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:40.942793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:40.942795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:40.942796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:40.942801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:40.942805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:40.942812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.942922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:40.942927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:40.942934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:40.942988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2468 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0
2025-10-02T09:34:40.943236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|557d27dc-d9f6ad72-9fb47c1e-472d9f8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:40.946017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Write session: try to update token
2025-10-02T09:34:40.946030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:40.952926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:40.952939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:40.952940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:40.952941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:40.952946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.952950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.952952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555497278392279:7469]
2025-10-02T09:34:40.952974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:40.952977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:40.952978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:40.952989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:40.952999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:40.953009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:40.953085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:40.958737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId: src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:40.960862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.015318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930263:3012]
2025-10-02T09:34:41.015486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2467, pipe: [1:7556555501648930263:3012]
2025-10-02T09:34:41.061947Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.062267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.062276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.062288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930263:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.062434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:41.062441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:41.062447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.062478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930263:3012]
2025-10-02T09:34:41.062488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2468 reason: error at write: Disconnected sessionId: src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0
2025-10-02T09:34:41.062630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2468 sessionId: src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0 is DEAD
2025-10-02T09:34:41.062630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.062761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:41.062770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Write session will restart in 0.007506s
2025-10-02T09:34:41.062785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Write session: Do CDS request
2025-10-02T09:34:41.062790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.071105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.071180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.071187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2469
2025-10-02T09:34:41.071271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.071288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.071293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.071295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.071641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2469 sessionId:  describe result for acl check
2025-10-02T09:34:41.071663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.071667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.071668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.071671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648930355:3706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.072007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648930355:3706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.073934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648930355:3706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.075832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648930355:3706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.075840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648930355:3706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.075842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648930355:3706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.075845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.079229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.079556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.079741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.079749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.079757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.079793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.079815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573359904:7471]
2025-10-02T09:34:41.080146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.080486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.080511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.080688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.080732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.080736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.080736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.080737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.080737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.080738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.080738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.080739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.080739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.080740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.080740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.080741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.080744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.080750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.080752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.080754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.080756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.080758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.080759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.080761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.080763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.080765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.080767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.080769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.080772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.080776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.080779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.080781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.080783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.080786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.080788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.080790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.080792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.080794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.080796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.080799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.080812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.080815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.080818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.080820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.080822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.080825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.080827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.080829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.080833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.080835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.080838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.080840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.080857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.088260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.089665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.089677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.089678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.089680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.089683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2468 [2:7556555501573359904:7471]
2025-10-02T09:34:41.089690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.089699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.089704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.089706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.089707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.089716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.089722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.089727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.089760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.089764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.089766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.089768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.089769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.089804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.089809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.089815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.089821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.089831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.089845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930523:3706], now have 1 active actors on pipe
2025-10-02T09:34:41.089851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930264:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.089856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.089857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.089859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.089868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.089876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.089878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.089879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.089881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.089892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.089898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.089916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.089900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2468
2025-10-02T09:34:41.089922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.089907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2468
2025-10-02T09:34:41.089933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.090061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.090068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.090091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.090098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.090101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.090102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.090107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.090113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.090121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.090238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.090244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.090251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.090307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2469 partition: 0 MaxSeqNo: 36 sessionId: src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0
2025-10-02T09:34:41.090506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c373974-ced2e97a-b472cd0e-7831d3d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.092978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Write session: try to update token
2025-10-02T09:34:41.092987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.098986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.098999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.099001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.099002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.099006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.099008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.099011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573359894:7471]
2025-10-02T09:34:41.099032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.099034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.099035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.099037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.099039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.099040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.099143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.103991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId: src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.106272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.162812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930592:3012]
2025-10-02T09:34:41.162998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2468, pipe: [1:7556555501648930592:3012]
2025-10-02T09:34:41.208715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.209090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.209100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.209126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930592:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.209303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.209316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:41.209319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:41.209340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930592:3012]
2025-10-02T09:34:41.209390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2469 reason: error at write: Disconnected sessionId: src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0
2025-10-02T09:34:41.209543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2469 sessionId: src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0 is DEAD
2025-10-02T09:34:41.209665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:41.209674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Write session will restart in 0.006886s
2025-10-02T09:34:41.209690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Write session: Do CDS request
2025-10-02T09:34:41.209706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.209910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.214198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.215182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.215280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.215287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.215292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.215318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.215344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573359963:7465]
2025-10-02T09:34:41.215729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.215886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.215908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.216085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.216113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.216117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.216118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.216119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.216119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.216120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.216121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.216122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.216122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.216123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.216124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.216124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.216127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.216134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.216137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.216139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.216141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.216143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.216145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.216147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.216149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.216152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.216154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.216156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.216161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.216165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.216168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.216171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.216173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.216175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.216178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.216181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.216184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.216187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.216189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.216191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.216194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.216200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.216202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.216205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.216207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.216210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.216212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.216218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.216220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.216223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.216228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.216230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.216247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.217114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.217212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.217221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2470
2025-10-02T09:34:41.217316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.217334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.217340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.217342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.217583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2470 sessionId:  describe result for acl check
2025-10-02T09:34:41.217600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.217604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.217605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.217608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648930617:3727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.217941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648930617:3727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.219457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648930617:3727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.223133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648930617:3727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.223144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648930617:3727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.223145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648930617:3727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.223149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.223686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.225134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.225146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.225147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.225149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.225154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2469 [2:7556555501573359963:7465]
2025-10-02T09:34:41.225161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.225170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.225171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.225173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.225174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.225182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.225189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.225192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.225223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.225228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.225229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.225231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.225232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.225262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.225268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.225274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.225282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.225296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.225317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930651:3727], now have 1 active actors on pipe
2025-10-02T09:34:41.225317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2469
2025-10-02T09:34:41.225320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930593:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.225324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.225326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.225327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.225336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.225344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.225345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.225346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2469
2025-10-02T09:34:41.225347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.225348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.225356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.225359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.225385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.225393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.225403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.225412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.225423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.225431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.225436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.225441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.225443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.225448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.225457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.225473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.225568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.225574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.225582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.225637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2470 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0
2025-10-02T09:34:41.225821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c40d470c-eda49c5d-22d4f3ab-6f5449e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.228598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Write session: try to update token
2025-10-02T09:34:41.228609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.235543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.235556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.235557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.235558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.235562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.235565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.235567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573359958:7465]
2025-10-02T09:34:41.235588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.235594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.235594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.235595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.235597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.235599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.235710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.241772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId: src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.244183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.309226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930662:3012]
2025-10-02T09:34:41.309421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2469, pipe: [1:7556555501648930662:3012]
2025-10-02T09:34:41.343786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.343992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.344001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.344013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930662:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.344139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.344164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.344169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930662:3012]
2025-10-02T09:34:41.344185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:41.344237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2470 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0
2025-10-02T09:34:41.344368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2470 sessionId: src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0 is DEAD
2025-10-02T09:34:41.344465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:41.344474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Write session will restart in 0.007155s
2025-10-02T09:34:41.344492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Write session: Do CDS request
2025-10-02T09:34:41.344495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.348675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.349759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.349854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.349860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.349865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.349891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.349921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573360023:7460]
2025-10-02T09:34:41.350388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.350549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.350571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.350747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.350776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.350780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.350780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.350781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.350781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.350782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.350782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.350783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.350783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.350784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.350784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.350785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.350788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.350795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.350797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.350800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.350802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.350804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.350806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.350807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.350809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.350811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.350813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.350815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.350819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.350823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.350827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.350830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.350833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.350835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.350837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.350840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.350842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.350845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.350847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.350849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.350851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.350854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.350856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.350859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.350861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.350864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.350866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.350868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.350870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.350875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.350878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.350883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.350900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.352163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.352289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.352297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2471
2025-10-02T09:34:41.352421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.352440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.352446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.352448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.352685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2471 sessionId:  describe result for acl check
2025-10-02T09:34:41.352704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.352708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.352709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.352712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648930687:3733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.353061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648930687:3733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.354589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648930687:3733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.357705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648930687:3733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.357714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648930687:3733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.357716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648930687:3733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.357720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.358322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.359816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.359829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.359830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.359833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.359837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2470 [2:7556555501573360023:7460]
2025-10-02T09:34:41.359845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.359854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.359855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.359857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.359858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.359868Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.359870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.359874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.359903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.359909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.359910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.359912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.359913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.359953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.359958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.359964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.359969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.359981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.360000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930734:3733], now have 1 active actors on pipe
2025-10-02T09:34:41.360007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930663:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.360012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.360015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.360016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.360026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.360026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2470
2025-10-02T09:34:41.360036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.360029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2470
2025-10-02T09:34:41.360038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.360039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.360041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.360052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.360059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.360084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.360089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.360095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.360102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.360109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.360119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.360123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.360127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.360128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.360132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.360138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.360154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.360246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.360253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.360260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.360316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2471 partition: 0 MaxSeqNo: 36 sessionId: src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0
2025-10-02T09:34:41.360520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b902f01-77ce5f3e-fcf8d35c-d9d9a263_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.362971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Write session: try to update token
2025-10-02T09:34:41.362982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.369217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.369229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.369231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.369232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.369237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.369240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.369242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573360018:7460]
2025-10-02T09:34:41.369266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.369271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.369273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.369284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.369296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.369298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.369381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.374308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId: src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.376581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.444398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930743:3012]
2025-10-02T09:34:41.444579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2470, pipe: [1:7556555501648930743:3012]
2025-10-02T09:34:41.477979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.478210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.478219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.478231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930743:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.478389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.478394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.478402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930743:3012]
2025-10-02T09:34:41.478419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:41.478421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:41.478474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2471 reason: error at write: Disconnected sessionId: src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0
2025-10-02T09:34:41.478609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2471 sessionId: src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0 is DEAD
2025-10-02T09:34:41.478709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:41.478718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Write session will restart in 0.006014s
2025-10-02T09:34:41.478733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Write session: Do CDS request
2025-10-02T09:34:41.478738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.483026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.484122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.484220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.484226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.484232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.484257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.484281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573360082:7455]
2025-10-02T09:34:41.484619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.484781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.484814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.484991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.485021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.485025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.485025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.485026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.485027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.485028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.485028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.485029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.485029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.485030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.485031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.485031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.485034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.485040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.485043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.485045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.485047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.485049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.485051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.485053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.485055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.485057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.485059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.485061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.485064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.485068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.485072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.485076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.485078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.485081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.485083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.485086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.485090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.485093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.485095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.485098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.485100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.485105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.485107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.485110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.485112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.485115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.485117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.485119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.485123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.485125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.485127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.485130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.485148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.486143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.486270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.486279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2472
2025-10-02T09:34:41.486389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.486409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.486415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.486417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.486689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2472 sessionId:  describe result for acl check
2025-10-02T09:34:41.486712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.486716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.486717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.486720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648930769:3742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.487062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648930769:3742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.488205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648930769:3742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.491949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648930769:3742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.491956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648930769:3742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.491958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648930769:3742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.491962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.492565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.494073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.494086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.494087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.494089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.494092Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2471 [2:7556555501573360082:7455]
2025-10-02T09:34:41.494104Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.494113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.494117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.494118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.494119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.494128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.494131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.494136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.494168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.494173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.494174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.494175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.494177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.494212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.494216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.494222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.494227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.494235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.494251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930804:3742], now have 1 active actors on pipe
2025-10-02T09:34:41.494258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930744:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.494262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.494266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.494267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.494276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.494284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2471
2025-10-02T09:34:41.494290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.494292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.494300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.494302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.494303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.494305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.494331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.494338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.494328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2471
2025-10-02T09:34:41.494346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.494352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.494356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.494373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.494381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.494383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.494386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.494391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.494396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.494413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.494494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.494501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.494510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.494583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2472 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0
2025-10-02T09:34:41.494771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84e9e203-8cf4682d-a6c5b1ce-d10ad31f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.497222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Write session: try to update token
2025-10-02T09:34:41.497232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.503503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.503516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.503518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.503519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.503525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.503527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.503529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573360077:7455]
2025-10-02T09:34:41.503550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.503556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.503556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.503559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.503559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.503561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.504152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.510096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId: src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.512384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.578560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930815:3012]
2025-10-02T09:34:41.578725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2471, pipe: [1:7556555501648930815:3012]
2025-10-02T09:34:41.613295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.613518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.613526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.613538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930815:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.613658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.613719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930815:3012]
2025-10-02T09:34:41.613727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:41.613738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.613780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2472 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0
2025-10-02T09:34:41.613907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2472 sessionId: src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0 is DEAD
2025-10-02T09:34:41.614005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:41.614014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Write session will restart in 0.008286s
2025-10-02T09:34:41.614030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Write session: Do CDS request
2025-10-02T09:34:41.614034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.618198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.619211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.619306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.619313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.619318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.619344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.619373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573360142:7453]
2025-10-02T09:34:41.619711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.619864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.619887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.620062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.620090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.620095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.620097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.620097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.620098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.620098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.620099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.620100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.620100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.620101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.620103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.620110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.620112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.620116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.620120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.620122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.620124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.620126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.620128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.620130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.620134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.620139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.620143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.620146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.620148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.620151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.620153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.620156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.620158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.620162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.620164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.620166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.620170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.620173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.620175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.620178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.620180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.620182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.620186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.620189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.620194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.620197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.620199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.620201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.620218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.623202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.623297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.623306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2473
2025-10-02T09:34:41.623389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.623408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.623414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.623416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.623689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2473 sessionId:  describe result for acl check
2025-10-02T09:34:41.623715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.623719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.623721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.623723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648930843:3756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.624076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648930843:3756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.625483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648930843:3756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.627018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648930843:3756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.627026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648930843:3756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.627028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648930843:3756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.627032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.627642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.629061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.629072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.629077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.629079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.629082Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2472 [2:7556555501573360142:7453]
2025-10-02T09:34:41.629089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.629099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.629106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.629108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.629109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.629119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.629121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.629125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.629158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.629162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.629163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.629165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.629166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.629203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.629207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.629214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.629219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.629228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.629243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930878:3756], now have 1 active actors on pipe
2025-10-02T09:34:41.629250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930817:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.629254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.629256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.629257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.629267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.629278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.629280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.629286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.629287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.629293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.629295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.629296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2472
2025-10-02T09:34:41.629298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2472
2025-10-02T09:34:41.629313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.629320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.629322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.629337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.629344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.629363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|244a2d7b-54d0228b-7746d360-31caf280_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.629370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.629372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.629376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.629382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.629390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.629405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.629511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.629518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.629525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.629581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2473 partition: 0 MaxSeqNo: 36 sessionId: src_id|244a2d7b-54d0228b-7746d360-31caf280_0
2025-10-02T09:34:41.629744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fc5e01-a2099253-cd95bc0-9bbcd15_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|244a2d7b-54d0228b-7746d360-31caf280_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.632180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Write session: try to update token
2025-10-02T09:34:41.632190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.638747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.638760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.638761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.638762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.638768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.638771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.638773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573360137:7453]
2025-10-02T09:34:41.638794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.638799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.638809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.638811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.638846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.638852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.638960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.647022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId: src_id|244a2d7b-54d0228b-7746d360-31caf280_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.649348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.713683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930886:3012]
2025-10-02T09:34:41.713861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2472, pipe: [1:7556555501648930886:3012]
2025-10-02T09:34:41.750880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.751078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.751092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.751103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930886:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.751476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:41.751484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:41.751542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2473 reason: error at write: Disconnected sessionId: src_id|244a2d7b-54d0228b-7746d360-31caf280_0
2025-10-02T09:34:41.751634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.751648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.751679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2473 sessionId: src_id|244a2d7b-54d0228b-7746d360-31caf280_0 is DEAD
2025-10-02T09:34:41.751688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930886:3012]
2025-10-02T09:34:41.751778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:41.751786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Write session will restart in 0.007280s
2025-10-02T09:34:41.751803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Write session: Do CDS request
2025-10-02T09:34:41.751807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.755828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.756813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.756911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.756918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.756924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.756950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.756974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573360241:7435]
2025-10-02T09:34:41.757309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.757477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.757499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.757675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.757702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.757706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.757706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.757707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.757707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.757708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.757708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.757709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.757710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.757710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.757711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.757711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.757714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.757720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.757722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.757724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.757726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.757728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.757730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.757732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.757735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.757737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.757739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.757741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.757745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.757749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.757753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.757756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.757758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.757760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.757763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.757765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.757767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.757770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.757772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.757774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.757776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.757779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.757782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.757784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.757786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.757789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.757791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.757793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.757795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.757798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.757800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.757802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.757818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.760121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.760210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.760219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2474
2025-10-02T09:34:41.760309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.760326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.760331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.760334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.760631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2474 sessionId:  describe result for acl check
2025-10-02T09:34:41.760657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.760662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.760664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.760668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648930935:3781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.761135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648930935:3781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.763059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648930935:3781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.764707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648930935:3781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.764716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648930935:3781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.764718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648930935:3781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.764721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.765324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.766809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.766821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.766822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.766824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.766830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2473 [2:7556555501573360241:7435]
2025-10-02T09:34:41.766837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.766847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.766852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.766856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.766858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.766867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.766873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.766879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.766907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.766912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.766913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.766915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.766916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.766951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.766955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.766961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.766969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.766981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.766995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930908:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.767002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930969:3781], now have 1 active actors on pipe
2025-10-02T09:34:41.767006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.767012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.767013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.767023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.767034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.767036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.767041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.767042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.767047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.767050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.767049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2473
2025-10-02T09:34:41.767068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.767075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.767076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.767069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2473
2025-10-02T09:34:41.767138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.767143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.767159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.767166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.767169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.767173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.767178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.767186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.767196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.767289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.767296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.767303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.767358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2474 partition: 0 MaxSeqNo: 36 sessionId: src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0
2025-10-02T09:34:41.767543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244a2d7b-54d0228b-7746d360-31caf280_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.770058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Write session: try to update token
2025-10-02T09:34:41.770070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.776196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.776211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.776212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.776213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.776217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.776220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.776223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573360236:7435]
2025-10-02T09:34:41.776243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.776245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.776247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.776248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.776248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.776250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.776369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.783037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId: src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.785349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.851959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648930977:3012]
2025-10-02T09:34:41.852182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2473, pipe: [1:7556555501648930977:3012]
2025-10-02T09:34:41.885209Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:41.885398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.885407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.885419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930977:3012], now have 1 active actors on pipe
2025-10-02T09:34:41.885543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:41.885569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:41.885610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648930977:3012]
2025-10-02T09:34:41.885981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:41.886030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2474 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0
2025-10-02T09:34:41.886157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2474 sessionId: src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0 is DEAD
2025-10-02T09:34:41.886283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:41.886292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Write session will restart in 0.007765s
2025-10-02T09:34:41.886308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Write session: Do CDS request
2025-10-02T09:34:41.886312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:41.889845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:41.890881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:41.890983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:41.890990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:41.890996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:41.891022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:41.891049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555501573360300:7433]
2025-10-02T09:34:41.891666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:41.891827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:41.891851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:41.892127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:41.892157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.892161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.892162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.892163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.892164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.892165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.892166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.892167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.892167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.892168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.892168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.892169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.892172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.892179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.892181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.892183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.892185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.892188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.892190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.892192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.892194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.892196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.892198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.892200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.892205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.892208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:41.892212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.892216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:41.892219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.892222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:41.892224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.892227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:41.892229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.892232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:41.892234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.892237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:41.892239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.892243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:41.892246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.892248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:41.892250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.892253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:41.892255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.892258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.892260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.892263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.892265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.892269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.892287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:41.895132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.895214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:41.895224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2475
2025-10-02T09:34:41.895317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:41.895335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:41.895341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:41.895343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:41.895651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2475 sessionId:  describe result for acl check
2025-10-02T09:34:41.895680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:41.895686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:41.895687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:41.895691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555501648931011:3795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:41.896146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555501648931011:3795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:41.897443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555501648931011:3795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:41.899430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555501648931011:3795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:41.899438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555501648931011:3795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:41.899441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555501648931011:3795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:41.899444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:41.899871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:41.901352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:41.901364Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:41.901365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:41.901368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:41.901371Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2474 [2:7556555501573360300:7433]
2025-10-02T09:34:41.901381Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:41.901391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:41.901392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.901394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.901396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.901405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:41.901412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:41.901417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:41.901448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.901452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.901453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.901455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:41.901456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:41.901496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:41.901501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.901507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:41.901512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:41.901522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:41.901538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648931045:3795], now have 1 active actors on pipe
2025-10-02T09:34:41.901545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648930981:2446], now have 1 active actors on pipe
2025-10-02T09:34:41.901550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.901555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.901557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.901567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:41.901564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2474
2025-10-02T09:34:41.901580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:41.901580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:41.901582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:41.901583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:41.901586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2474
2025-10-02T09:34:41.901596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:41.901602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:41.901629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.901636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.901645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.901651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:41.901664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:41.901672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:41.901676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:41.901678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:41.901679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:41.901685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:41.901693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:41.901707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.901807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:41.901812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:41.901821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:41.901882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2475 partition: 0 MaxSeqNo: 36 sessionId: src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0
2025-10-02T09:34:41.902057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99aeb85-1f5d96a5-b4ef7433-fd4c2e30_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:41.904526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Write session: try to update token
2025-10-02T09:34:41.904535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:41.910749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:41.910763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:41.910764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:41.910765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:41.910770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.910773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.910775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555501573360295:7433]
2025-10-02T09:34:41.910795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:41.910795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:41.910798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:41.910799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:41.910799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:41.910801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:41.910958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:41.915868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId: src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:41.918238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:41.985582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555501648931057:3012]
2025-10-02T09:34:41.985755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2474, pipe: [1:7556555501648931057:3012]
2025-10-02T09:34:42.020831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.021080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.021089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.021101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555501648931057:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.021310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.021335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555501648931057:3012]
2025-10-02T09:34:42.021355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.021362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.021414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2475 reason: error at write: Disconnected sessionId: src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0
2025-10-02T09:34:42.021555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2475 sessionId: src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0 is DEAD
2025-10-02T09:34:42.021684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.021689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Write session will restart in 0.006293s
2025-10-02T09:34:42.021704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Write session: Do CDS request
2025-10-02T09:34:42.021709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.021732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.026358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.027468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.027575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.027582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.027588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.027614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.027640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868327671:7425]
2025-10-02T09:34:42.027984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.028155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.028176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.028350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.028379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.028383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.028384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.028385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.028385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.028386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.028386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.028387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.028388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.028388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.028389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.028390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.028392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.028399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.028401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.028403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.028405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.028407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.028409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.028412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.028414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.028416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.028418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.028420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.028424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.028427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.028432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.028438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.028440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.028444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.028449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.028452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.028454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.028457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.028462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.028465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.028467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.028471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.028475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.028478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.028480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.028483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.028485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.028488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.028493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.028495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.028498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.028504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.028522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.029127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.029207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.029215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2476
2025-10-02T09:34:42.029493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.029511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.029514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.029516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.029832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2476 sessionId:  describe result for acl check
2025-10-02T09:34:42.029859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.029865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.029866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.029870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898384:3798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.030312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898384:3798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.031505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898384:3798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.035430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898384:3798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.035440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898384:3798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.035442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898384:3798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.035446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.036002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.037507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.037520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.037521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.037523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.037527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2475 [2:7556555505868327671:7425]
2025-10-02T09:34:42.037535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.037547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.037553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.037557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.037558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.037567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.037575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.037579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.037611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.037615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.037616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.037618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.037619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.037657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.037662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.037668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.037673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.037681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.037697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898418:3798], now have 1 active actors on pipe
2025-10-02T09:34:42.037703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898355:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.037707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.037712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.037714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.037723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.037725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2475
2025-10-02T09:34:42.037734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.037737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.037742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.037743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.037748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.037750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.037743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2475
2025-10-02T09:34:42.037776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.037784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.037795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.037804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.037811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.037823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8763367c-42cd7798-47b29e74-6519524b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.037830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.037832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.037836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.037841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.037849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.037894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.038009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.038015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.038023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.038080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2476 partition: 0 MaxSeqNo: 36 sessionId: src_id|8763367c-42cd7798-47b29e74-6519524b_0
2025-10-02T09:34:42.038265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688e105d-bdf6b9d4-ce0fdeda-34ca7d49_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8763367c-42cd7798-47b29e74-6519524b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.040757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Write session: try to update token
2025-10-02T09:34:42.040767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.047359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.047378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.047379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.047381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.047386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.047390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.047391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868327666:7425]
2025-10-02T09:34:42.047414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.047415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.047417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.047418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.047418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.047420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.047531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.052642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId: src_id|8763367c-42cd7798-47b29e74-6519524b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.054931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.121261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898439:3012]
2025-10-02T09:34:42.121423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2475, pipe: [1:7556555505943898439:3012]
2025-10-02T09:34:42.156791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.157045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.157057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.157069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898439:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.157243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.157253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.157260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898439:3012]
2025-10-02T09:34:42.157273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.157299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2476 reason: error at write: Disconnected sessionId: src_id|8763367c-42cd7798-47b29e74-6519524b_0
2025-10-02T09:34:42.157436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2476 sessionId: src_id|8763367c-42cd7798-47b29e74-6519524b_0 is DEAD
2025-10-02T09:34:42.157452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.157569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.157578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Write session will restart in 0.008109s
2025-10-02T09:34:42.157596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Write session: Do CDS request
2025-10-02T09:34:42.157600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.161995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.162983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.163079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.163086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.163091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.163117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.163145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868327737:7411]
2025-10-02T09:34:42.163769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.163934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.163958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.164139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.164169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.164173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.164174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.164174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.164175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.164175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.164177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.164178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.164178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.164179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.164180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.164180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.164183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.164190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.164192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.164194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.164196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.164199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.164201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.164203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.164205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.164207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.164209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.164211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.164215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.164220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.164224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.164227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.164229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.164232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.164234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.164237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.164240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.164243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.164248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.164251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.164254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.164257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.164263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.164266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.164268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.164271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.164276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.164278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.164281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.164283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.164288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.164291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.164309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.167122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.167250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.167260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2477
2025-10-02T09:34:42.167345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.167363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.167368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.167370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.167638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2477 sessionId:  describe result for acl check
2025-10-02T09:34:42.167655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.167659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.167660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.167663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898470:3820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.168007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898470:3820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.169210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898470:3820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.171445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898470:3820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.171454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898470:3820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.171455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898470:3820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.171459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.171988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.173408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.173420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.173422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.173424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.173428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2476 [2:7556555505868327737:7411]
2025-10-02T09:34:42.173436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.173446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.173453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.173455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.173456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.173466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.173473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.173477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.173507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.173512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.173513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.173515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.173516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.173552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.173556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.173562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.173568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.173579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.173592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898504:3820], now have 1 active actors on pipe
2025-10-02T09:34:42.173599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898440:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.173604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.173608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.173611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.173620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.173623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2476
2025-10-02T09:34:42.173633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.173634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.173636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.173637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.173647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.173649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.173646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2476
2025-10-02T09:34:42.173677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.173684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.173694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.173701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.173710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.173719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d428fd5-60449edc-4d684206-e8806531_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.173726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.173729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.173730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.173736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.173741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.173755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.173855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.173860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.173867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.173928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2477 partition: 0 MaxSeqNo: 36 sessionId: src_id|d428fd5-60449edc-4d684206-e8806531_0
2025-10-02T09:34:42.174092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8763367c-42cd7798-47b29e74-6519524b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d428fd5-60449edc-4d684206-e8806531_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.176593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Write session: try to update token
2025-10-02T09:34:42.176603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.182970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.182985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.182986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.182987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.182992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.182995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.182997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868327732:7411]
2025-10-02T09:34:42.183018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.183019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.183022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.183023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.183025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.183026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.183143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.187834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId: src_id|d428fd5-60449edc-4d684206-e8806531_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.190092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.257460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898512:3012]
2025-10-02T09:34:42.257645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2476, pipe: [1:7556555505943898512:3012]
2025-10-02T09:34:42.292434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.292716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.292725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.292749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898512:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.292969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.292981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.293046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2477 reason: error at write: Disconnected sessionId: src_id|d428fd5-60449edc-4d684206-e8806531_0
2025-10-02T09:34:42.293123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.293158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898512:3012]
2025-10-02T09:34:42.293184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.293217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2477 sessionId: src_id|d428fd5-60449edc-4d684206-e8806531_0 is DEAD
2025-10-02T09:34:42.293342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.293351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Write session will restart in 0.005253s
2025-10-02T09:34:42.293367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Write session: Do CDS request
2025-10-02T09:34:42.293371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.297600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.298570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.298669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.298676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.298682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.298708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.298730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868327802:7423]
2025-10-02T09:34:42.299073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.299242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.299239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.299261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.299372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.299382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2478
2025-10-02T09:34:42.299484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.299495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.299519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.299526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.299529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.299540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.299546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.299547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.299548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.299549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.299550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.299551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.299552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.299553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.299554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.299557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.299558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.299562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.299571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.299574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.299577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.299580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.299585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.299588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.299591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.299596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.299600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.299602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.299607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.299613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.299622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.299626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.299630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.299633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.299637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.299644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.299649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.299654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.299658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.299665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.299669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.299675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.299679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.299688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.299693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.299698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.299701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.299704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.299708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.299710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.299712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.299714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.299717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.299734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.299789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2478 sessionId:  describe result for acl check
2025-10-02T09:34:42.299813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.299817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.299818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.299821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898545:3817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.300163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898545:3817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.301278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898545:3817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.304986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898545:3817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.304995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898545:3817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.304997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898545:3817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.305000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.307161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.308661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.308673Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.308675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.308676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.308680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2477 [2:7556555505868327802:7423]
2025-10-02T09:34:42.308690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.308699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.308701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.308703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.308704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.308713Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.308715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.308719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.308751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.308757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.308758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.308759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.308761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.308795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.308814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.308824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.308834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.308851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.308871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898582:3817], now have 1 active actors on pipe
2025-10-02T09:34:42.308878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898516:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.308883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.308889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.308891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.308879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2477
2025-10-02T09:34:42.308892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2477
2025-10-02T09:34:42.308898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.308910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.308911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.308912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.308914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.308921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.308922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.308933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.308939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.308961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.308969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.308977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.308981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.308988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.308990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.308995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.309001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.309009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.309031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.309123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.309135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.309149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.309199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2478 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0
2025-10-02T09:34:42.309441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d428fd5-60449edc-4d684206-e8806531_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.312271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Write session: try to update token
2025-10-02T09:34:42.312285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.317938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.317950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.317951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.317953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.317956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.317959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.317963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868327797:7423]
2025-10-02T09:34:42.317981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.317981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.317984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.317985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.317990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.317992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.318095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.324988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId: src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.327102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.393247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898589:3012]
2025-10-02T09:34:42.393402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2477, pipe: [1:7556555505943898589:3012]
2025-10-02T09:34:42.424902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.425161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.425169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.425181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898589:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.425335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.425343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.425383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2478 reason: error at write: Disconnected sessionId: src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0
2025-10-02T09:34:42.425504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2478 sessionId: src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0 is DEAD
2025-10-02T09:34:42.425511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898589:3012]
2025-10-02T09:34:42.425526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.425649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.425664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Write session will restart in 0.007202s
2025-10-02T09:34:42.425657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.425686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Write session: Do CDS request
2025-10-02T09:34:42.425692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.430161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.431144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.431236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.431242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.431249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.431272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.431298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868327870:7418]
2025-10-02T09:34:42.431657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.431810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.431832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.432003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.432032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.432035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.432036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.432036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.432037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.432038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.432038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.432039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.432039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.432040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.432041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.432041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.432044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.432051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.432053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.432055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.432057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.432059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.432061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.432063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.432066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.432070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.432071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.432073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.432079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.432083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.432086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.432089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.432091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.432093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.432095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.432097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.432099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.432102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.432104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.432106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.432109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.432111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.432113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.432116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.432118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.432121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.432124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.432126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.432128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.432131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.432133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.432135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.432153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.434139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.434259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.434268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2479
2025-10-02T09:34:42.434379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.434397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.434403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.434406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.434745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2479 sessionId:  describe result for acl check
2025-10-02T09:34:42.434773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.434778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.434780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.434784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898623:3833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.435246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898623:3833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.436501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898623:3833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.439077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898623:3833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.439086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898623:3833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.439088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898623:3833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.439092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.439572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.441020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.441032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.441033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.441035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.441038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2478 [2:7556555505868327870:7418]
2025-10-02T09:34:42.441046Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.441055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.441062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.441064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.441065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.441072Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.441075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.441079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.441109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.441114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.441115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.441116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.441118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.441152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.441157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.441163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.441169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.441176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.441190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898658:3833], now have 1 active actors on pipe
2025-10-02T09:34:42.441195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898590:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.441199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.441200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.441202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.441210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.441220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.441221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.441223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.441224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.441231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.441232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.441225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2478
2025-10-02T09:34:42.441225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2478
2025-10-02T09:34:42.441245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.441250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.441261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.441262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.441263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.441317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.441324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.441326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.441327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.441332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.441338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.441352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.441432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.441436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.441444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.441493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2479 partition: 0 MaxSeqNo: 36 sessionId: src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0
2025-10-02T09:34:42.441717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ebf72d-6749acb1-8521fa47-e28eec8b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.444424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Write session: try to update token
2025-10-02T09:34:42.444438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.450178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.450191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.450192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.450193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.450197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.450200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.450202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868327865:7418]
2025-10-02T09:34:42.450220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.450220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.450222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.450222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.450223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.450226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.450329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.457046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId: src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.459161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.525723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898665:3012]
2025-10-02T09:34:42.525897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2478, pipe: [1:7556555505943898665:3012]
2025-10-02T09:34:42.558070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.558292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.558302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.558313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898665:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.558504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898665:3012]
2025-10-02T09:34:42.558518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.558520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.558524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.558580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2479 reason: error at write: Disconnected sessionId: src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0
2025-10-02T09:34:42.558583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.558718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2479 sessionId: src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0 is DEAD
2025-10-02T09:34:42.558873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.558885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Write session will restart in 0.009675s
2025-10-02T09:34:42.558911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Write session: Do CDS request
2025-10-02T09:34:42.558917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.563318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.564278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.564392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.564399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.564405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.564432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.564458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868327936:7414]
2025-10-02T09:34:42.564877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.565064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.565091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.565279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.565310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.565314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.565314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.565315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.565316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.565316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.565317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.565317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.565318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.565318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.565319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.565320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.565323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.565330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.565332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.565334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.565336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.565338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.565340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.565344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.565346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.565348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.565350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.565352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.565356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.565360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.565364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.565367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.565369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.565371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.565377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.565380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.565382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.565387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.565390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.565395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.565397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.565400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.565402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.565404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.565406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.565409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.565411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.565413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.565415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.565420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.565422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.565425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.565444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.569216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.569282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.569290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2480
2025-10-02T09:34:42.569420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.569438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.569442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.569446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.569769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2480 sessionId:  describe result for acl check
2025-10-02T09:34:42.569796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.569802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.569804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.569807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898699:3852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.570262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898699:3852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.571683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898699:3852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.572878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.573190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898699:3852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.573200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898699:3852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.573202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898699:3852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.573205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.574374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.574387Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.574388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.574393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2479 [2:7556555505868327936:7414]
2025-10-02T09:34:42.574401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.574411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.574413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.574414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.574416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.574424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.574431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.574436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.574465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.574470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.574471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.574473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.574474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.574509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.574514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.574520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.574525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.574533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.574555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898734:3852], now have 1 active actors on pipe
2025-10-02T09:34:42.574560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898666:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.574564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.574565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.574568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.574575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.574584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.574588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.574590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.574591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.574595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.574596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.574597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2479
2025-10-02T09:34:42.574604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2479
2025-10-02T09:34:42.574609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.574614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.574625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.574628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.574630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.574648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.574654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.574657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.574658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.574662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.574670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.574681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.574763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.574768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.574775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.574826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2480 partition: 0 MaxSeqNo: 36 sessionId: src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0
2025-10-02T09:34:42.575050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b71dbd-d681b8f9-374e0b39-e9d405b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.577790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Write session: try to update token
2025-10-02T09:34:42.577804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.583509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.583522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.583523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.583524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.583527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.583529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.583532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868327931:7414]
2025-10-02T09:34:42.583551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.583553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.583554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.583555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.583556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.583558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.583658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.590726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId: src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.592796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.658871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898742:3012]
2025-10-02T09:34:42.659074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2479, pipe: [1:7556555505943898742:3012]
2025-10-02T09:34:42.692313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.692571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.692579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.692590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898742:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.692750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898742:3012]
2025-10-02T09:34:42.692766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.692769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.692770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.692833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2480 reason: error at write: Disconnected sessionId: src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0
2025-10-02T09:34:42.692975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2480 sessionId: src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0 is DEAD
2025-10-02T09:34:42.693035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.693137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.693150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Write session will restart in 0.006770s
2025-10-02T09:34:42.693174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Write session: Do CDS request
2025-10-02T09:34:42.693179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.697958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.699166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.699277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.699284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.699290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.699318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.699338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868328007:7408]
2025-10-02T09:34:42.699680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.699867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.699890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.700065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.700095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.700099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.700100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.700101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.700102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.700102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.700104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.700105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.700105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.700106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.700106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.700107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.700110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.700115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.700118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.700120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.700122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.700124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.700126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.700128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.700129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.700132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.700134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.700136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.700139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.700143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.700147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.700149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.700151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.700154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.700156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.700158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.700160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.700163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.700165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.700168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.700170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.700173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.700175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.700177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.700179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.700182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.700187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.700190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.700192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.700194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.700200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.700202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.700222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.701187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.701291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.701300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2481
2025-10-02T09:34:42.701427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.701446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.701452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.701454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.701672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2481 sessionId:  describe result for acl check
2025-10-02T09:34:42.701691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.701695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.701696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.701699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898777:3853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.702007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898777:3853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.703226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898777:3853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.707194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898777:3853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.707202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898777:3853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.707204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898777:3853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.707208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.707795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.709250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.709262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.709264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.709266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.709270Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2480 [2:7556555505868328007:7408]
2025-10-02T09:34:42.709278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.709287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.709288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.709290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.709291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.709299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.709306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.709310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.709342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.709348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.709349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.709350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.709352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.709388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.709392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.709402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.709415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.709431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.709448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898812:3853], now have 1 active actors on pipe
2025-10-02T09:34:42.709455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898743:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.709460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.709466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.709468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.709480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.709476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2480
2025-10-02T09:34:42.709480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2480
2025-10-02T09:34:42.709494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.709501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.709504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.709505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.709512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.709515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.709540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.709548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.709559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.709569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.709580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.709592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.709599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.709601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.709605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.709611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.709620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.709637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.709771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.709779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.709788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.709850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2481 partition: 0 MaxSeqNo: 36 sessionId: src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0
2025-10-02T09:34:42.710092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75da3f95-65f7dec-ee0facc1-800b11a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.712741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Write session: try to update token
2025-10-02T09:34:42.712753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.718684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.718696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.718699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.718700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.718703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.718705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.718707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868327998:7408]
2025-10-02T09:34:42.718727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.718727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.718729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.718729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.718730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.718732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.718846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.725213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId: src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.727322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.792986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898842:3012]
2025-10-02T09:34:42.793141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2480, pipe: [1:7556555505943898842:3012]
2025-10-02T09:34:42.827316Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.827558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.827567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.827579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898842:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.827717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.827762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:42.827765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898842:3012]
2025-10-02T09:34:42.827778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.827823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0
2025-10-02T09:34:42.827969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2481 sessionId: src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0 is DEAD
2025-10-02T09:34:42.828123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:42.828137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Write session will restart in 0.007801s
2025-10-02T09:34:42.828158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Write session: Do CDS request
2025-10-02T09:34:42.828164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.832887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.833889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.834018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.834027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.834036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.834073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.834099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868328108:7384]
2025-10-02T09:34:42.834521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.834722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.834748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.834989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.835029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.835033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.835034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.835034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.835035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.835035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.835036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.835036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.835037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.835037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.835038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.835039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.835042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.835050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.835052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.835054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.835056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.835058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.835060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.835062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.835064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.835067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.835069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.835071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.835075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.835079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.835082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.835085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.835088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.835091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.835092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.835095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.835098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.835102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.835103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.835106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.835108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.835110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.835112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.835114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.835116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.835119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.835120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.835123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.835126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.835128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.835130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.835132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.835149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.837192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.837295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.837303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2482
2025-10-02T09:34:42.837550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.837570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.837575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.837578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.837824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2482 sessionId:  describe result for acl check
2025-10-02T09:34:42.837842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.837846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.837847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.837850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898878:3879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.838191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898878:3879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.839660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898878:3879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.842103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898878:3879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.842112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898878:3879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.842114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898878:3879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.842118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.842532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.844061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.844072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.844074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.844076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.844079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2481 [2:7556555505868328108:7384]
2025-10-02T09:34:42.844087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.844095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.844097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.844098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.844099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.844108Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.844113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.844117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.844147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.844152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.844153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.844155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.844158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.844191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.844196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.844202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.844207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.844217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.844230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898843:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.844235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898913:3879], now have 1 active actors on pipe
2025-10-02T09:34:42.844238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.844239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.844240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.844247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.844256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.844260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.844261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.844262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.844266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.844268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.844260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2481
2025-10-02T09:34:42.844262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2481
2025-10-02T09:34:42.844281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.844285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.844287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.844295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.844300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.844326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.844334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.844336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.844337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.844342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.844347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.844356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.844453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.844458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.844465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.844518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2482 partition: 0 MaxSeqNo: 36 sessionId: src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0
2025-10-02T09:34:42.844764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a4c0a7-6578c12d-5ad3be25-dc12a532_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.847561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Write session: try to update token
2025-10-02T09:34:42.847574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.853334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.853346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.853347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.853349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.853355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.853357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.853358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868328103:7384]
2025-10-02T09:34:42.853377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.853390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.853394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.853396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.853401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.853402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.853511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.860070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId: src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.862227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:42.928151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555505943898925:3012]
2025-10-02T09:34:42.928316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2481, pipe: [1:7556555505943898925:3012]
2025-10-02T09:34:42.961792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:42.962023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.962031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.962044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898925:3012], now have 1 active actors on pipe
2025-10-02T09:34:42.962231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555505943898925:3012]
2025-10-02T09:34:42.962239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:42.962243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:42.962252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:42.962312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2482 reason: error at write: Disconnected sessionId: src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0
2025-10-02T09:34:42.962384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:42.962448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2482 sessionId: src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0 is DEAD
2025-10-02T09:34:42.962603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:42.962617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Write session will restart in 0.009659s
2025-10-02T09:34:42.962644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Write session: Do CDS request
2025-10-02T09:34:42.962651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:42.967017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:42.967966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:42.968087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:42.968093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:42.968099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:42.968128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:42.968153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555505868328178:7388]
2025-10-02T09:34:42.968488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:42.968655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:42.968679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:42.968863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:42.968893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.968897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.968897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.968898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.968899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.968899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.968900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.968900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.968901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.968901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.968902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.968902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.968905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.968912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.968914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.968916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.968918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.968920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.968924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.968926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.968928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.968930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.968932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.968937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.968941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:42.968944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.968947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:42.968949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.968952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:42.968954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.968957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:42.968959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.968962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:42.968964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.968966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:42.968969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.968972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:42.968974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.968976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:42.968981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.968984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:42.968987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.968989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.968995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.968997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.968999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.969001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.969019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:42.973160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.973249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:42.973257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2483
2025-10-02T09:34:42.973389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:42.973408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:42.973415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:42.973417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:42.973747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2483 sessionId:  describe result for acl check
2025-10-02T09:34:42.973776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:42.973782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:42.973783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:42.973787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555505943898967:3884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:42.974126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555505943898967:3884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:42.975692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555505943898967:3884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:42.976438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:42.977688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555505943898967:3884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:42.977695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555505943898967:3884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:42.977697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555505943898967:3884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:42.977701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:42.977821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:42.977833Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:42.977835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:42.977837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:42.977840Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2482 [2:7556555505868328178:7388]
2025-10-02T09:34:42.977849Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:42.977861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:42.977866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.977868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.977869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.977880Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:42.977886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:42.977890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:42.977917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.977922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.977923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.977924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:42.977926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:42.977963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:42.977968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.977974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:42.977981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:42.977992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:42.978007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943899001:3884], now have 1 active actors on pipe
2025-10-02T09:34:42.978012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555505943898930:2446], now have 1 active actors on pipe
2025-10-02T09:34:42.978015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.978017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.978018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.978024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:42.978032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:42.978036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:42.978028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2482
2025-10-02T09:34:42.978038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:42.978039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:42.978042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:42.978043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:42.978029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2482
2025-10-02T09:34:42.978057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.978062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:42.978063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:42.978071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.978077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.978101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:42.978107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:42.978109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:42.978110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:42.978115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:42.978122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:42.978150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.978224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:42.978228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:42.978235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:42.978282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2483 partition: 0 MaxSeqNo: 36 sessionId: src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0
2025-10-02T09:34:42.978514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7db82b76-ccf5fa42-8c5b56f9-2ab3fbb9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:42.981285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Write session: try to update token
2025-10-02T09:34:42.981300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:42.987027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:42.987038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:42.987039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:42.987040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:42.987044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.987046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.987049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555505868328173:7388]
2025-10-02T09:34:42.987067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:42.987072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:42.987073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:42.987075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:42.987078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:42.987080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:42.987244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:42.994390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId: src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:42.996586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.062294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866304:3012]
2025-10-02T09:34:43.062440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2482, pipe: [1:7556555510238866304:3012]
2025-10-02T09:34:43.096994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.097226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.097236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.097259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866304:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.097406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.097443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:43.097451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:43.097461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866304:3012]
2025-10-02T09:34:43.097476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.097490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2483 reason: error at write: Disconnected sessionId: src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0
2025-10-02T09:34:43.097626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2483 sessionId: src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0 is DEAD
2025-10-02T09:34:43.097781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:43.097797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Write session will restart in 0.009399s
2025-10-02T09:34:43.097825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Write session: Do CDS request
2025-10-02T09:34:43.097831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.102074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.103131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.103241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.103247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.103253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.103280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.103306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163295559:7379]
2025-10-02T09:34:43.103665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.103826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.103849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.104026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.104054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.104058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.104058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.104059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.104060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.104060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.104061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.104061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.104061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.104062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.104062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.104063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.104066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.104073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.104075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.104077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.104079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.104081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.104085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.104087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.104089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.104091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.104093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.104095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.104099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.104103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.104106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.104109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.104112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.104114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.104117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.104120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.104122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.104125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.104127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.104129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.104132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.104134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.104136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.104139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.104141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.104144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.104146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.104148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.104150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.104152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.104154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.104157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.104175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.108197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.108279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.108287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2484
2025-10-02T09:34:43.108407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.108426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.108432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.108436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.108748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2484 sessionId:  describe result for acl check
2025-10-02T09:34:43.108777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.108783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.108785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.108791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866343:3881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.109343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866343:3881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.110805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866343:3881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.111623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.112275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866343:3881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.112282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866343:3881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.112284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866343:3881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.112288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.113113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.113125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.113126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.113128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.113131Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2483 [2:7556555510163295559:7379]
2025-10-02T09:34:43.113138Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.113147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.113152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.113154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.113155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.113162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.113169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.113173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.113203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.113208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.113209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.113210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.113213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.113248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.113252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.113258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.113263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.113272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.113282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866377:3881], now have 1 active actors on pipe
2025-10-02T09:34:43.113287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866305:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.113291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.113294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.113295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.113304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.113315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.113316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.113318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.113319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.113325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.113326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.113325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2483
2025-10-02T09:34:43.113328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2483
2025-10-02T09:34:43.113339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.113343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.113345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.113359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.113364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.113381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|184da45-508b656e-2c36b406-7b386eb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.113388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.113390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.113391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.113397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.113401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.113413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.113513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.113518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.113525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.113581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2484 partition: 0 MaxSeqNo: 36 sessionId: src_id|184da45-508b656e-2c36b406-7b386eb5_0
2025-10-02T09:34:43.113818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1673c38e-8e7ec567-c9de7970-35abb34e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|184da45-508b656e-2c36b406-7b386eb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.116434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Write session: try to update token
2025-10-02T09:34:43.116449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.122355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.122368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.122369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.122370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.122374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.122377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.122378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163295554:7379]
2025-10-02T09:34:43.122399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.122403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.122405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.122406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.122407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.122408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.122510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.129214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId: src_id|184da45-508b656e-2c36b406-7b386eb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.131390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.197475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866397:3012]
2025-10-02T09:34:43.197680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2483, pipe: [1:7556555510238866397:3012]
2025-10-02T09:34:43.232681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.232971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.232981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.232993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866397:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.233113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.233142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.233206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:43.233211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:43.233240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866397:3012]
2025-10-02T09:34:43.233252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2484 reason: error at write: Disconnected sessionId: src_id|184da45-508b656e-2c36b406-7b386eb5_0
2025-10-02T09:34:43.233384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2484 sessionId: src_id|184da45-508b656e-2c36b406-7b386eb5_0 is DEAD
2025-10-02T09:34:43.233557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:43.233572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Write session will restart in 0.007223s
2025-10-02T09:34:43.233592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Write session: Do CDS request
2025-10-02T09:34:43.233597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.238555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.239733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.239832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.239838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.239844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.239870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.239894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163295630:7377]
2025-10-02T09:34:43.240234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.240390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.240413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.240583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.240612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.240616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.240616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.240617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.240617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.240618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.240618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.240619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.240620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.240620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.240621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.240621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.240624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.240631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.240633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.240635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.240637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.240639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.240641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.240642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.240644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.240647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.240648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.240651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.240655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.240659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.240662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.240664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.240666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.240670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.240672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.240675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.240677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.240681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.240683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.240689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.240691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.240694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.240696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.240701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.240704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.240706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.240712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.240715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.240720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.240723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.240725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.240727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.240745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.242166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.242271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.242278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2485
2025-10-02T09:34:43.242391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.242409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.242415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.242418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.242732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2485 sessionId:  describe result for acl check
2025-10-02T09:34:43.242760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.242765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.242767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.242771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866436:3894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.243230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866436:3894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.244457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866436:3894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.247712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866436:3894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.247720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866436:3894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.247722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866436:3894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.247725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.248243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.249782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.249795Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.249798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.249800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.249803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2484 [2:7556555510163295630:7377]
2025-10-02T09:34:43.249814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.249828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.249831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.249832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.249834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.249842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.249848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.249852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.249885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.249890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.249891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.249893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.249894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.249927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.249933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.249939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.249944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.249955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.249968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866398:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.249974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866471:3894], now have 1 active actors on pipe
2025-10-02T09:34:43.249977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.249978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.249980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.249988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.249997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.250000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.250002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.250003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.250007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.250009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.250005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2484
2025-10-02T09:34:43.250007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2484
2025-10-02T09:34:43.250023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.250028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.250030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.250040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.250045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.250068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.250075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.250077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.250080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.250085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.250090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.250099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.250182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.250187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.250194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.250245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2485 partition: 0 MaxSeqNo: 36 sessionId: src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0
2025-10-02T09:34:43.250470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|184da45-508b656e-2c36b406-7b386eb5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.253119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Write session: try to update token
2025-10-02T09:34:43.253138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.259070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.259083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.259084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.259085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.259090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.259092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.259095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163295625:7377]
2025-10-02T09:34:43.259118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.259121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.259122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.259123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.259124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.259126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.259472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.266404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId: src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.268612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.333147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866481:3012]
2025-10-02T09:34:43.333353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2484, pipe: [1:7556555510238866481:3012]
2025-10-02T09:34:43.368487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.368813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.368824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.368839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866481:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.368980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.369015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.369038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:43.369042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866481:3012]
2025-10-02T09:34:43.369093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2485 reason: status is not ok: tablet will be restarted right now sessionId: src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0
2025-10-02T09:34:43.369249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2485 sessionId: src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0 is DEAD
2025-10-02T09:34:43.369387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:43.369400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Write session will restart in 0.006795s
2025-10-02T09:34:43.369440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Write session: Do CDS request
2025-10-02T09:34:43.369445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.374038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.375073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.375173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.375180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.375186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.375210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.375234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163295704:7369]
2025-10-02T09:34:43.375570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.375726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.375750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.375925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.375954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.375958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.375958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.375959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.375959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.375960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.375961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.375961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.375962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.375962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.375963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.375963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.375966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.375973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.375975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.375977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.375979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.375981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.375983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.375985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.375987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.375989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.375991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.375993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.375997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.376000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.376003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.376006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.376008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.376011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.376015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.376018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.376020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.376023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.376025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.376027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.376030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.376033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.376036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.376039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.376041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.376043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.376045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.376048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.376050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.376053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.376061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.376065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.376097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.377191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.377304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.377310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2486
2025-10-02T09:34:43.377429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.377447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.377452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.377455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.377720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2486 sessionId:  describe result for acl check
2025-10-02T09:34:43.377738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.377742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.377745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.377749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866521:3925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.378097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866521:3925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.379643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866521:3925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.383021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866521:3925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.383031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866521:3925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.383033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866521:3925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.383036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.383502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.384992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.385003Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.385005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.385006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.385010Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2485 [2:7556555510163295704:7369]
2025-10-02T09:34:43.385017Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.385027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.385032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.385034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.385035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.385047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.385053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.385057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.385088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.385092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.385093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.385095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.385096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.385166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.385171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.385178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.385184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.385196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.385193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2485
2025-10-02T09:34:43.385195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2485
2025-10-02T09:34:43.385211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866482:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.385216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866556:3925], now have 1 active actors on pipe
2025-10-02T09:34:43.385220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.385221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.385223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.385228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.385234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.385236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.385237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.385239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.385245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.385247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.385259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.385264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.385283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.385290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.385297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.385303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.385309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.385313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.385317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.385322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.385330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.385350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.385443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.385448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.385456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.385497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2486 partition: 0 MaxSeqNo: 36 sessionId: src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0
2025-10-02T09:34:43.385760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775364cc-5a9d68a0-aae51dd6-62fcc726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.388511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Write session: try to update token
2025-10-02T09:34:43.388527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.394321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.394334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.394335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.394335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.394339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.394341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.394345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163295699:7369]
2025-10-02T09:34:43.394362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.394366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.394367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.394367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.394369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.394371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.394484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.401151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId: src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.403351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.469352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866564:3012]
2025-10-02T09:34:43.469543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2485, pipe: [1:7556555510238866564:3012]
2025-10-02T09:34:43.503111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.503401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.503411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.503424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866564:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.503571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.503599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.503631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:43.503634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866564:3012]
2025-10-02T09:34:43.503685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2486 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0
2025-10-02T09:34:43.503816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2486 sessionId: src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0 is DEAD
2025-10-02T09:34:43.503973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:43.503989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Write session will restart in 0.005675s
2025-10-02T09:34:43.504009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Write session: Do CDS request
2025-10-02T09:34:43.504015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.508594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.509649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.509744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.509750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.509755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.509779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.509803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163295779:7360]
2025-10-02T09:34:43.510139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.510305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.510328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.510503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.510531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.510543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.510546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.510547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.510548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.510548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.510549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.510549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.510551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.510552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.510552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.510553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.510556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.510563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.510565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.510567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.510569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.510571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.510573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.510574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.510576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.510578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.510580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.510582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.510587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.510590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.510593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.510596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.510598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.510601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.510603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.510606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.510608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.510612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.510614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.510617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.510619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.510622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.510624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.510628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.510630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.510634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.510638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.510641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.510643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.510646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.510650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.510653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.510670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.511173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.511249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.511255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2487
2025-10-02T09:34:43.511374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.511392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.511398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.511401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.511712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2487 sessionId:  describe result for acl check
2025-10-02T09:34:43.511742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.511748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.511749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.511753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866614:3919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.512243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866614:3919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.513784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866614:3919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.517614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866614:3919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.517622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866614:3919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.517625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866614:3919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.517629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.518152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.519632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.519643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.519645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.519647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.519650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2486 [2:7556555510163295779:7360]
2025-10-02T09:34:43.519658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.519671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.519676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.519677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.519678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.519688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.519694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.519698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.519731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.519735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.519738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.519740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.519741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.519775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.519780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.519786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.519791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.519799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.519811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.519816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.519817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.519822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.519831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.519832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866565:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.519835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866648:3919], now have 1 active actors on pipe
2025-10-02T09:34:43.519839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.519840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.519842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.519846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.519847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.519862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.519868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.519875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.519874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2486
2025-10-02T09:34:43.519873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2486
2025-10-02T09:34:43.519917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.519922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.519936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.519943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.519945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.519946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.519951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.519959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.519969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.520087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.520092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.520098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.520161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2487 partition: 0 MaxSeqNo: 36 sessionId: src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0
2025-10-02T09:34:43.520413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbf95ff-1e8537e1-e1d56e36-2429661a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.523082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Write session: try to update token
2025-10-02T09:34:43.523099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.529394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.529407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.529408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.529411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.529414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.529417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.529419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163295774:7360]
2025-10-02T09:34:43.529437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.529443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.529444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.529446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.529450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.529452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.529568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.535538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId: src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.537769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.603986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866656:3012]
2025-10-02T09:34:43.604251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2486, pipe: [1:7556555510238866656:3012]
2025-10-02T09:34:43.639106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.639350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.639365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.639378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866656:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.639570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.639595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866656:3012]
2025-10-02T09:34:43.639606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:43.639612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:43.639656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2487 reason: error at write: Disconnected sessionId: src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0
2025-10-02T09:34:43.639790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2487 sessionId: src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0 is DEAD
2025-10-02T09:34:43.639933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.639968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:43.639982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Write session will restart in 0.006723s
2025-10-02T09:34:43.640004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Write session: Do CDS request
2025-10-02T09:34:43.640009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.644436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.645428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.645531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.645537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.645543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.645567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.645590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163295853:7352]
2025-10-02T09:34:43.645924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.646074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.646096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.646268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.646295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.646299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.646299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.646300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.646301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.646301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.646302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.646302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.646303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.646303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.646304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.646304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.646307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.646315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.646317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.646319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.646322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.646324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.646326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.646329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.646331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.646333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.646335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.646337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.646340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.646344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.646347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.646350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.646352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.646354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.646356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.646359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.646361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.646364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.646366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.646369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.646371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.646374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.646378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.646381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.646384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.646390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.646392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.646395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.646397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.646400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.646405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.646408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.646424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.648173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.648276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.648283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2488
2025-10-02T09:34:43.648372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.648389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.648391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.648394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.648727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2488 sessionId:  describe result for acl check
2025-10-02T09:34:43.648757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.648762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.648764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.648768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866698:3930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.649253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866698:3930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.650484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866698:3930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.653331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866698:3930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.653339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866698:3930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.653341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866698:3930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.653345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.653847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.655327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.655338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.655339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.655341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.655345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2487 [2:7556555510163295853:7352]
2025-10-02T09:34:43.655352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.655362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.655367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.655368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.655369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.655378Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.655382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.655390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.655421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.655425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.655426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.655428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.655429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.655467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.655472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.655478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.655483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.655492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.655505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866657:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.655511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866732:3930], now have 1 active actors on pipe
2025-10-02T09:34:43.655514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.655515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.655516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.655523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.655533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.655534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.655536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.655529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2487
2025-10-02T09:34:43.655537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.655543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.655530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2487
2025-10-02T09:34:43.655544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.655558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.655559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.655561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.655572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.655577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.655635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.655642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.655644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.655645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.655650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.655656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.655671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.655764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.655769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.655777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.655832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2488 partition: 0 MaxSeqNo: 36 sessionId: src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0
2025-10-02T09:34:43.656098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|868dfae8-84b743a1-27a7a7df-36fe5d94_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.658710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Write session: try to update token
2025-10-02T09:34:43.658730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.664642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.664657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.664659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.664660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.664666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.664670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.664676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163295848:7352]
2025-10-02T09:34:43.664702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.664710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.664711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.664710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.664714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.664717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.664859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.671825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId: src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.674017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.739687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866740:3012]
2025-10-02T09:34:43.739909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2487, pipe: [1:7556555510238866740:3012]
2025-10-02T09:34:43.776321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.776526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.776535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.776547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866740:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.776673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.776680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.776713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866740:3012]
2025-10-02T09:34:43.776725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:43.776783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2488 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0
2025-10-02T09:34:43.776936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2488 sessionId: src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0 is DEAD
2025-10-02T09:34:43.777072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:43.777081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Write session will restart in 0.008143s
2025-10-02T09:34:43.777099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Write session: Do CDS request
2025-10-02T09:34:43.777103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.781895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.782851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.782944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.782951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.782956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.782982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.783006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163295958:7336]
2025-10-02T09:34:43.783354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.783506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.783528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.783709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.783740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.783744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.783745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.783745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.783746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.783746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.783747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.783747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.783748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.783749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.783749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.783750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.783753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.783758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.783760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.783762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.783764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.783767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.783769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.783771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.783773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.783775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.783777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.783779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.783783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.783787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.783790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.783793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.783795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.783798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.783800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.783802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.783804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.783807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.783809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.783812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.783815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.783818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.783821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.783824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.783829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.783832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.783835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.783840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.783842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.783845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.783850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.783854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.783895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.786238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.786296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.786307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2489
2025-10-02T09:34:43.786469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.786494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.786501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.786504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.786813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2489 sessionId:  describe result for acl check
2025-10-02T09:34:43.786835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.786840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.786842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.786846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866797:3951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.787278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866797:3951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.788860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866797:3951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.790933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866797:3951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.790942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866797:3951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.790944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866797:3951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.790947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.791444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.792899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.792909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.792911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.792913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.792916Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2488 [2:7556555510163295958:7336]
2025-10-02T09:34:43.792924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.792934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.792939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.792940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.792941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.792949Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.792952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.792956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.792985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.792990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.792991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.792993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.792994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.793028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.793033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.793038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.793044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.793051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.793065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866835:3951], now have 1 active actors on pipe
2025-10-02T09:34:43.793071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866755:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.793074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.793075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.793075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.793083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.793093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.793094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.793093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2488
2025-10-02T09:34:43.793094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2488
2025-10-02T09:34:43.793096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.793097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.793103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.793104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.793116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.793118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.793119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.793128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.793134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.793157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.793164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.793166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.793166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.793172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.793178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.793187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.793283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.793288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.793295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.793350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2489 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0
2025-10-02T09:34:43.793612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bde7ff-1f279f75-9960ace8-3d9222e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.796204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Write session: try to update token
2025-10-02T09:34:43.796217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.802121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.802136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.802137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.802138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.802141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.802143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.802145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163295953:7336]
2025-10-02T09:34:43.802164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.802167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.802168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.802169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.802172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.802173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.802281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.811764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId: src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.814008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:43.876860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555510238866851:3012]
2025-10-02T09:34:43.877039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2488, pipe: [1:7556555510238866851:3012]
2025-10-02T09:34:43.912355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:43.912580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.912589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.912601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866851:3012], now have 1 active actors on pipe
2025-10-02T09:34:43.912725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:43.912757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:43.912759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:43.912767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:43.912786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555510238866851:3012]
2025-10-02T09:34:43.912820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2489 reason: error at write: Disconnected sessionId: src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0
2025-10-02T09:34:43.912962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2489 sessionId: src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0 is DEAD
2025-10-02T09:34:43.913133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:43.913146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Write session will restart in 0.008452s
2025-10-02T09:34:43.913167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Write session: Do CDS request
2025-10-02T09:34:43.913172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:43.917990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:43.919012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:43.919111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:43.919118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:43.919123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:43.919148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:43.919172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555510163296042:7332]
2025-10-02T09:34:43.919529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:43.919690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:43.919713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:43.919925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:43.919958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.919961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.919962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.919962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.919963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.919963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.919964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.919964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.919965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.919965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.919966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.919966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.919969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.919976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.919978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.919980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.919982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.919985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.919987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.919989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.919991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.919993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.919995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.919997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.920001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.920005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:43.920008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.920011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:43.920013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.920016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:43.920018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.920021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:43.920023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.920025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:43.920027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.920030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:43.920032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.920035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:43.920037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.920039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:43.920041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.920043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:43.920046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.920048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.920050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.920052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.920054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.920057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.920078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:43.922185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.922260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:43.922270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2490
2025-10-02T09:34:43.922392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:43.922411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:43.922419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:43.922422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:43.922766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2490 sessionId:  describe result for acl check
2025-10-02T09:34:43.922795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:43.922801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:43.922803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:43.922807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555510238866899:3967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:43.923295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555510238866899:3967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:43.925237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555510238866899:3967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:43.927046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555510238866899:3967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:43.927055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555510238866899:3967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:43.927058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555510238866899:3967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:43.927062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:43.927563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:43.929050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:43.929063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:43.929064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:43.929066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:43.929070Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2489 [2:7556555510163296042:7332]
2025-10-02T09:34:43.929078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:43.929087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:43.929092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.929094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.929096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.929104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:43.929111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:43.929115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:43.929145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.929150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.929151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.929153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:43.929154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:43.929191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:43.929196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.929201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:43.929207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:43.929218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:43.929232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866934:3967], now have 1 active actors on pipe
2025-10-02T09:34:43.929237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555510238866856:2446], now have 1 active actors on pipe
2025-10-02T09:34:43.929241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.929242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.929244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.929252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:43.929252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2489
2025-10-02T09:34:43.929255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2489
2025-10-02T09:34:43.929262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:43.929273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:43.929273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:43.929278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:43.929278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:43.929279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:43.929298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.929303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.929312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.929319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:43.929333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:43.929335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f465e83b-739ef848-904c106c-56e7a4bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:43.929338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:43.929340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:43.929341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:43.929346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:43.929351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:43.929362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.929443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:43.929447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:43.929455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:43.929495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2490 partition: 0 MaxSeqNo: 36 sessionId: src_id|f465e83b-739ef848-904c106c-56e7a4bc_0
2025-10-02T09:34:43.929772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d6fc08f-cd69dc5e-4b4284ff-179a2bfa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f465e83b-739ef848-904c106c-56e7a4bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:43.932425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Write session: try to update token
2025-10-02T09:34:43.932437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:43.938299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:43.938311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:43.938313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:43.938314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:43.938318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.938323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.938325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555510163296037:7332]
2025-10-02T09:34:43.938343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:43.938347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:43.938349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:43.938350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:43.938350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:43.938352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:43.938452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:43.945092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId: src_id|f465e83b-739ef848-904c106c-56e7a4bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:43.947293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.013082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834241:3012]
2025-10-02T09:34:44.013260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2489, pipe: [1:7556555514533834241:3012]
2025-10-02T09:34:44.050261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.050505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.050513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.050526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834241:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.050684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.050740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834241:3012]
2025-10-02T09:34:44.050761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.050818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:44.050878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f465e83b-739ef848-904c106c-56e7a4bc_0
2025-10-02T09:34:44.051036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2490 sessionId: src_id|f465e83b-739ef848-904c106c-56e7a4bc_0 is DEAD
2025-10-02T09:34:44.051192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:44.051207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Write session will restart in 0.006944s
2025-10-02T09:34:44.051233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Write session: Do CDS request
2025-10-02T09:34:44.051238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.055833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.056907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.057017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.057023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.057029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.057055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.057080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263426:7330]
2025-10-02T09:34:44.057422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.057584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.057605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.057793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.057825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.057829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.057830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.057831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.057831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.057832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.057833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.057833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.057834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.057834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.057835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.057835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.057838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.057845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.057847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.057849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.057851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.057853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.057856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.057858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.057860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.057862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.057864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.057866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.057870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.057874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.057877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.057880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.057882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.057884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.057886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.057890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.057892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.057895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.057897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.057899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.057901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.057904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.057906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.057909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.057911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.057914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.057916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.057919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.057921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.057924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.057925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.057928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.057944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.059142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.059260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.059268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2491
2025-10-02T09:34:44.059379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.059399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.059405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.059408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.059711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2491 sessionId:  describe result for acl check
2025-10-02T09:34:44.059738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.059744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.059745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.059749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834286:3966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.060217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834286:3966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.061605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834286:3966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.064830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834286:3966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.064839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834286:3966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.064841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834286:3966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.064844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.065344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.066756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.066768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.066769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.066771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.066774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2490 [2:7556555514458263426:7330]
2025-10-02T09:34:44.066780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.066791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.066793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.066794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.066796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.066804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.066808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.066812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.066842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.066847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.066849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.066851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.066852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.066891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.066896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.066903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.066908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.066918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.066932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834321:3966], now have 1 active actors on pipe
2025-10-02T09:34:44.066937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834242:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.066941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.066942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.066943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.066951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.066949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2490
2025-10-02T09:34:44.066958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.066966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.066968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.066968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.066969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.066969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.066968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2490
2025-10-02T09:34:44.066992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.066997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.067004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.067009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.067021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.067027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.067030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.067033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.067034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.067039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.067043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.067058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.067134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.067140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.067147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.067187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2491 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0
2025-10-02T09:34:44.067438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f465e83b-739ef848-904c106c-56e7a4bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.070018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Write session: try to update token
2025-10-02T09:34:44.070032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.076048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.076061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.076062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.076063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.076068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.076071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.076074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263421:7330]
2025-10-02T09:34:44.076093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.076097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.076098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.076100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.076103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.076105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.076200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.081802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId: src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.083886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.150806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834341:3012]
2025-10-02T09:34:44.150975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2490, pipe: [1:7556555514533834341:3012]
2025-10-02T09:34:44.187051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.187315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.187324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.187337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834341:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.187495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.187539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.187565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834341:3012]
2025-10-02T09:34:44.187567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:44.187619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2491 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0
2025-10-02T09:34:44.187761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2491 sessionId: src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0 is DEAD
2025-10-02T09:34:44.187913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:44.187925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Write session will restart in 0.005500s
2025-10-02T09:34:44.187951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Write session: Do CDS request
2025-10-02T09:34:44.187957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.192755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.193799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.193895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.193902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.193907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.193933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.193960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263507:7323]
2025-10-02T09:34:44.194180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.194227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.194234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2492
2025-10-02T09:34:44.194305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.194380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.194397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.194402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.194405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.194461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.194482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.194663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.194674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2492 sessionId:  describe result for acl check
2025-10-02T09:34:44.194694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.194697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.194698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.194698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.194703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.194699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.194699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.194700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.194705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.194708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834385:3984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.194700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.194701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.194702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.194702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.194703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.194703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.194706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.194712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.194716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.194718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.194720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.194722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.194724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.194726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.194728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.194731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.194733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.194735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.194739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.194743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.194747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.194749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.194752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.194754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.194757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.194760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.194762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.194765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.194767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.194769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.194772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.194775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.194777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.194779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.194782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.194784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.194786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.194788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.194791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.194794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.194796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.194799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.194817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.195041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834385:3984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.196140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834385:3984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.199983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834385:3984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.199991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834385:3984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.199993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834385:3984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.199997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.202153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.203751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.203765Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.203766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.203768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.203772Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2491 [2:7556555514458263507:7323]
2025-10-02T09:34:44.203780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.203790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.203795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.203797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.203798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.203807Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.203812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.203816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.203852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.203856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.203857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.203859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.203860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.203894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.203899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.203906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.203911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.203921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.203936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834421:3984], now have 1 active actors on pipe
2025-10-02T09:34:44.203940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834342:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.203945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.203946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.203947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.203956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.203966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.203968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.203961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2491
2025-10-02T09:34:44.203970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.203971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.203962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2491
2025-10-02T09:34:44.203976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.203978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.203995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.204003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.204009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.204012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.204014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.204037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.204044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.204047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.204051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.204056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.204061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.204072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.204151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.204156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.204163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.204215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2492 partition: 0 MaxSeqNo: 36 sessionId: src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0
2025-10-02T09:34:44.204435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5f71ee-da221b09-5ba5dd9-9e622d7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.207058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Write session: try to update token
2025-10-02T09:34:44.207074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.213000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.213013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.213014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.213015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.213019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.213022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.213025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263502:7323]
2025-10-02T09:34:44.213043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.213045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.213046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.213048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.213051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.213053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.213254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.219174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId: src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.221324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.287512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834432:3012]
2025-10-02T09:34:44.287678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2491, pipe: [1:7556555514533834432:3012]
2025-10-02T09:34:44.323517Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.323749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.323757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.323770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834432:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.323888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.323936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:44.323944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:44.323962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.323989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2492 reason: error at write: Disconnected sessionId: src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0
2025-10-02T09:34:44.323995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834432:3012]
2025-10-02T09:34:44.324128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2492 sessionId: src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0 is DEAD
2025-10-02T09:34:44.324303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:44.324319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Write session will restart in 0.007588s
2025-10-02T09:34:44.324341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Write session: Do CDS request
2025-10-02T09:34:44.324346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.329568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.330583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.330688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.330695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.330700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.330725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.330751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263587:7321]
2025-10-02T09:34:44.331089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.331247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.331271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.331442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.331470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.331474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.331475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.331475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.331476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.331476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.331477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.331477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.331478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.331478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.331479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.331479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.331482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.331489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.331491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.331494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.331496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.331498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.331500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.331502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.331504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.331506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.331508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.331510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.331514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.331518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.331521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.331524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.331526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.331528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.331530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.331533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.331535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.331538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.331541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.331543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.331545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.331548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.331550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.331553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.331555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.331557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.331560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.331562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.331564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.331571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.331574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.331578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.331598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.333133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.333219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.333226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2493
2025-10-02T09:34:44.333328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.333346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.333349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.333351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.333608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2493 sessionId:  describe result for acl check
2025-10-02T09:34:44.333629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.333633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.333634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.333637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834479:3993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.333975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834479:3993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.335425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834479:3993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.338358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834479:3993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.338366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834479:3993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.338371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834479:3993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.338374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.338943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.340330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.340342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.340343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.340346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.340349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2492 [2:7556555514458263587:7321]
2025-10-02T09:34:44.340356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.340366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.340371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.340373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.340374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.340383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.340388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.340392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.340423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.340428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.340429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.340431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.340432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.340471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.340475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.340482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.340487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.340498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.340512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834514:3993], now have 1 active actors on pipe
2025-10-02T09:34:44.340517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834433:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.340521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.340525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.340526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.340534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.340533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2492
2025-10-02T09:34:44.340546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.340535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2492
2025-10-02T09:34:44.340547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.340549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.340550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.340557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.340558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.340575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.340579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.340581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.340587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.340592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.340614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59b923db-17b3d09-e8762acd-4ed19c40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.340620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.340622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.340623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.340628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.340632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.340644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.340730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.340734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.340742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.340788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2493 partition: 0 MaxSeqNo: 36 sessionId: src_id|59b923db-17b3d09-e8762acd-4ed19c40_0
2025-10-02T09:34:44.341028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860d9429-a4e9a2d3-51f972db-ba28b1cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59b923db-17b3d09-e8762acd-4ed19c40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.343629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Write session: try to update token
2025-10-02T09:34:44.343643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.349566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.349580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.349581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.349582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.349587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.349589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.349592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263582:7321]
2025-10-02T09:34:44.349610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.349611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.349614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.349616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.349616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.349617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.349728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.355960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId: src_id|59b923db-17b3d09-e8762acd-4ed19c40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.358118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.424225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834521:3012]
2025-10-02T09:34:44.424360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2492, pipe: [1:7556555514533834521:3012]
2025-10-02T09:34:44.459136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.459422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.459431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.459442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834521:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.459592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.459627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:44.459635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:44.459642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.459671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834521:3012]
2025-10-02T09:34:44.459675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2493 reason: error at write: Disconnected sessionId: src_id|59b923db-17b3d09-e8762acd-4ed19c40_0
2025-10-02T09:34:44.459799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2493 sessionId: src_id|59b923db-17b3d09-e8762acd-4ed19c40_0 is DEAD
2025-10-02T09:34:44.459969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:44.459981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Write session will restart in 0.009497s
2025-10-02T09:34:44.460001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Write session: Do CDS request
2025-10-02T09:34:44.460007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.465135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.466255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.466352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.466358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.466363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.466389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.466416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263670:7313]
2025-10-02T09:34:44.466767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.466931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.466953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.467128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.467158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.467162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.467163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.467164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.467164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.467165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.467165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.467166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.467166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.467167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.467167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.467168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.467171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.467177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.467180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.467182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.467184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.467186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.467188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.467190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.467192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.467194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.467198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.467200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.467203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.467207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.467210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.467213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.467215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.467218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.467221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.467223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.467225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.467228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.467231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.467234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.467236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.467239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.467241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.467246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.467248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.467251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.467254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.467257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.467259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.467263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.467265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.467268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.467286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.470236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.470297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.470305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2494
2025-10-02T09:34:44.470488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.470507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.470513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.470515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.470780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2494 sessionId:  describe result for acl check
2025-10-02T09:34:44.470803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.470807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.470808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.470811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834570:3998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.471159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834570:3998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.472740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834570:3998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.474665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.474750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834570:3998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.474758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834570:3998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.474760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834570:3998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.474764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.476032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.476044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.476045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.476048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.476051Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2493 [2:7556555514458263670:7313]
2025-10-02T09:34:44.476059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.476073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.476078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.476079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.476081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.476089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.476091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.476096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.476126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.476131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.476132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.476133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.476135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.476174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.476179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.476184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.476189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.476197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.476212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834523:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.476218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834605:3998], now have 1 active actors on pipe
2025-10-02T09:34:44.476222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.476223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.476224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.476231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.476239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.476242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.476244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.476246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.476246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.476247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.476260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.476261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.476251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2493
2025-10-02T09:34:44.476263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.476264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2493
2025-10-02T09:34:44.476281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.476287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.476303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.476310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.476312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.476313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.476318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.476323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.476332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.476415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.476419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.476427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.476487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2494 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0
2025-10-02T09:34:44.476677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b923db-17b3d09-e8762acd-4ed19c40_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.479376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Write session: try to update token
2025-10-02T09:34:44.479387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.485724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.485741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.485742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.485743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.485747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.485749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.485751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263665:7313]
2025-10-02T09:34:44.485772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.485774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.485775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.485777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.485778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.485780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.485882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.491792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId: src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.493978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.559913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834612:3012]
2025-10-02T09:34:44.560109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2493, pipe: [1:7556555514533834612:3012]
2025-10-02T09:34:44.595863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.596084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.596093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.596105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834612:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.596234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.596235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.596252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:44.596256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:44.596266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834612:3012]
2025-10-02T09:34:44.596309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2494 reason: error at write: Disconnected sessionId: src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0
2025-10-02T09:34:44.596460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2494 sessionId: src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0 is DEAD
2025-10-02T09:34:44.596614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:44.596628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Write session will restart in 0.007177s
2025-10-02T09:34:44.596653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Write session: Do CDS request
2025-10-02T09:34:44.596658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.601609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.602641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.602754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.602761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.602767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.602793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.602818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263752:7311]
2025-10-02T09:34:44.603155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.603304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.603325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.603494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.603523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.603527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.603527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.603528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.603529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.603530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.603530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.603531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.603531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.603532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.603533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.603534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.603536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.603543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.603545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.603548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.603549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.603551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.603553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.603555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.603557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.603560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.603562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.603565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.603568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.603572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.603576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.603578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.603580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.603583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.603585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.603587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.603589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.603592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.603594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.603596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.603598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.603601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.603603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.603605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.603608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.603612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.603615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.603618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.603620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.603623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.603625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.603628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.603647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.605185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.605286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.605293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2495
2025-10-02T09:34:44.605437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.605456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.605462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.605465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.605708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2495 sessionId:  describe result for acl check
2025-10-02T09:34:44.605729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.605730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.605731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.605734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834662:4018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.606108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834662:4018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.607288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834662:4018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.610421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834662:4018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.610429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834662:4018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.610432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834662:4018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.610436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.610974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.612423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.612432Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.612433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.612435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.612438Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2494 [2:7556555514458263752:7311]
2025-10-02T09:34:44.612445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.612456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.612458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.612459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.612460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.612470Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.612476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.612480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.612508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.612513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.612514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.612516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.612517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.612550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.612555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.612561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.612567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.612576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.612588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834613:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.612593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834697:4018], now have 1 active actors on pipe
2025-10-02T09:34:44.612596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.612597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.612598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.612605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.612612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.612617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.612619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.612620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.612622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.612625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.612617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2494
2025-10-02T09:34:44.612616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2494
2025-10-02T09:34:44.612639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.612644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.612645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.612655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.612659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.612685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1846309-acc510b8-b76cd260-f8616ab3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.612691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.612693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.612694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.612698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.612703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.612714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.612798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.612814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.612821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.612869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2495 partition: 0 MaxSeqNo: 36 sessionId: src_id|1846309-acc510b8-b76cd260-f8616ab3_0
2025-10-02T09:34:44.613075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f8acc-6ca700b7-20989962-4d0ef574_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1846309-acc510b8-b76cd260-f8616ab3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.615607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Write session: try to update token
2025-10-02T09:34:44.615617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.621731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.621742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.621744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.621745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.621749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.621751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.621753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263747:7311]
2025-10-02T09:34:44.621772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.621773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.621775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.621776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.621777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.621778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.621884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.627497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId: src_id|1846309-acc510b8-b76cd260-f8616ab3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.629786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.696624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834704:3012]
2025-10-02T09:34:44.696797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2494, pipe: [1:7556555514533834704:3012]
2025-10-02T09:34:44.733292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.733495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.733503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.733515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834704:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.733662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.733744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834704:3012]
2025-10-02T09:34:44.733766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.733786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:44.733794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:44.733842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2495 reason: error at write: Disconnected sessionId: src_id|1846309-acc510b8-b76cd260-f8616ab3_0
2025-10-02T09:34:44.733971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2495 sessionId: src_id|1846309-acc510b8-b76cd260-f8616ab3_0 is DEAD
2025-10-02T09:34:44.734086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:44.734095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Write session will restart in 0.005628s
2025-10-02T09:34:44.734111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Write session: Do CDS request
2025-10-02T09:34:44.734115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.739175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.740294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.740428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.740436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.740444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.740481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.740513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263833:7309]
2025-10-02T09:34:44.741039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.741215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.741233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.741248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.741303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.741309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2496
2025-10-02T09:34:44.741390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.741405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.741412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.741414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.741510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.741554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.741559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.741560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.741561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.741562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.741563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.741566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.741567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.741568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.741568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.741569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.741570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.741574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.741584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.741587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.741591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.741594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.741598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.741601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.741606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.741609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.741613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.741616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.741621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.741627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.741634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.741637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.741642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.741644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.741646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.741648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.741651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.741654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.741656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.741660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.741663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.741665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.741669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.741670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2496 sessionId:  describe result for acl check
2025-10-02T09:34:44.741671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.741677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.741679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.741681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.741683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.741686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.741689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.741692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.741695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.741692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.741694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.741696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.741696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.741699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834752:4019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.741713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.742033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834752:4019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.743589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834752:4019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.748517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834752:4019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.748525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834752:4019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.748527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834752:4019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.748531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.749019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.750472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.750482Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.750483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.750485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.750488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2495 [2:7556555514458263833:7309]
2025-10-02T09:34:44.750495Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.750506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.750507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.750509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.750511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.750524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.750528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.750543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.750576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.750581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.750581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.750583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.750584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.750619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.750623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.750629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.750634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.750642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.750657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834789:4019], now have 1 active actors on pipe
2025-10-02T09:34:44.750662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834705:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.750665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.750666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.750667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.750674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.750682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.750685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.750687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.750688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.750680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2495
2025-10-02T09:34:44.750681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2495
2025-10-02T09:34:44.750691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.750692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.750706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.750707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.750709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.750719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.750724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.750748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.750756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.750759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.750760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.750765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.750773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.750781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.750865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.750869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.750877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.750932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2496 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0
2025-10-02T09:34:44.751140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1846309-acc510b8-b76cd260-f8616ab3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.753703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Write session: try to update token
2025-10-02T09:34:44.753714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.759769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.759782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.759784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.759785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.759789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.759791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.759793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263828:7309]
2025-10-02T09:34:44.759811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.759814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.759814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.759816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.759818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.759819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.759924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.765879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId: src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.768148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.833815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834821:3012]
2025-10-02T09:34:44.833997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2495, pipe: [1:7556555514533834821:3012]
2025-10-02T09:34:44.871731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:44.872068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.872077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.872089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834821:3012], now have 1 active actors on pipe
2025-10-02T09:34:44.872229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:44.872311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:44.872352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834821:3012]
2025-10-02T09:34:44.872607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:44.872659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0
2025-10-02T09:34:44.872795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2496 sessionId: src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0 is DEAD
2025-10-02T09:34:44.872951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:44.872959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Write session will restart in 0.009356s
2025-10-02T09:34:44.872977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Write session: Do CDS request
2025-10-02T09:34:44.872981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:44.877698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:44.878722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:44.878817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:44.878823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:44.878829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:44.878853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:44.878877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555514458263953:7294]
2025-10-02T09:34:44.879214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:44.879373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:44.879394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:44.879568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:44.879597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.879601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.879601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.879602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.879602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.879603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.879603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.879604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.879604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.879605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.879605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.879606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.879609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.879616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.879618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.879620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.879622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.879624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.879626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.879628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.879630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.879632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.879634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.879636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.879640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.879643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:44.879647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.879649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:44.879652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.879654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:44.879657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.879663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:44.879666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.879668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:44.879670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.879673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:44.879675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.879677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:44.879679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.879682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:44.879685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.879688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:44.879691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.879693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.879696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.879700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.879702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.879705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.879723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:44.883151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.883238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:44.883250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2497
2025-10-02T09:34:44.883350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:44.883377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:44.883383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:44.883386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:44.883651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2497 sessionId:  describe result for acl check
2025-10-02T09:34:44.883673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:44.883677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:44.883678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:44.883681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555514533834875:4047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:44.884026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555514533834875:4047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:44.885619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555514533834875:4047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:44.887031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:44.887371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555514533834875:4047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:44.887379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555514533834875:4047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:44.887381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555514533834875:4047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:44.887384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:44.888521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:44.888531Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:44.888532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:44.888534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:44.888578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2496 [2:7556555514458263953:7294]
2025-10-02T09:34:44.888590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:44.888599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:44.888604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.888607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.888608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.888616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:44.888618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:44.888624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:44.888653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.888658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.888658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.888660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:44.888662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:44.888696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:44.888700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.888707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:44.888712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:44.888723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:44.888737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834825:2446], now have 1 active actors on pipe
2025-10-02T09:34:44.888742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834910:4047], now have 1 active actors on pipe
2025-10-02T09:34:44.888745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.888746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.888747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.888754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:44.888749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2496
2025-10-02T09:34:44.888750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2496
2025-10-02T09:34:44.888764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:44.888768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:44.888771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:44.888772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:44.888774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:44.888775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:44.888795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.888813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.888825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.888831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:44.888836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:44.888843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:44.888846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:44.888850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:44.888851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:44.888856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:44.888863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:44.888873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.888954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:44.888959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:44.888966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:44.889014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2497 partition: 0 MaxSeqNo: 36 sessionId: src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0
2025-10-02T09:34:44.889228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2302d-1cf2cbcf-df552072-8c38bc7f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:44.891938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Write session: try to update token
2025-10-02T09:34:44.891955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:44.897740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:44.897749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:44.897750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:44.897751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:44.897754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.897756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.897759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555514458263948:7294]
2025-10-02T09:34:44.897777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:44.897778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:44.897779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:44.897780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:44.897782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:44.897785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:44.897952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:44.904946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId: src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:44.907070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:44.972600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555514533834925:3012]
2025-10-02T09:34:44.972768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2496, pipe: [1:7556555514533834925:3012]
2025-10-02T09:34:45.007180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.007451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.007463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.007476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555514533834925:3012], now have 1 active actors on pipe
2025-10-02T09:34:45.007596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.007611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555514533834925:3012]
2025-10-02T09:34:45.007621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.007637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.007639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.007686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2497 reason: error at write: Disconnected sessionId: src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0
2025-10-02T09:34:45.007838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2497 sessionId: src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0 is DEAD
2025-10-02T09:34:45.007981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.007990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Write session will restart in 0.007599s
2025-10-02T09:34:45.008007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Write session: Do CDS request
2025-10-02T09:34:45.008012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.013277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.014376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.014505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.014513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.014519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.014560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.014587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231346:7286]
2025-10-02T09:34:45.014950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.015126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.015149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.015333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.015361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.015365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.015366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.015366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.015367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.015368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.015368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.015368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.015369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.015370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.015370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.015371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.015374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.015381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.015383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.015385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.015387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.015389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.015391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.015393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.015395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.015397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.015399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.015401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.015406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.015410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.015413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.015415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.015418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.015420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.015422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.015425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.015427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.015429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.015432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.015434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.015436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.015439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.015445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.015447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.015450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.015452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.015458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.015460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.015464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.015470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.015472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.015475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.015495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.016171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.016290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.016298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2498
2025-10-02T09:34:45.016410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.016428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.016434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.016436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.016694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2498 sessionId:  describe result for acl check
2025-10-02T09:34:45.016717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.016721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.016722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.016726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802273:4048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.017081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802273:4048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.018521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802273:4048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.022378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802273:4048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.022387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802273:4048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.022391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802273:4048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.022395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.022920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.024425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.024435Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.024436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.024440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.024443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2497 [2:7556555518753231346:7286]
2025-10-02T09:34:45.024452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.024464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.024469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.024471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.024472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.024482Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.024484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.024488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.024518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.024523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.024523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.024525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.024526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.024583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.024587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.024593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.024599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.024611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.024626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802308:4048], now have 1 active actors on pipe
2025-10-02T09:34:45.024631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802222:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.024634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.024635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.024636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.024645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.024641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2497
2025-10-02T09:34:45.024642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2497
2025-10-02T09:34:45.024655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.024659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.024661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.024662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.024665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.024666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.024691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.024696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.024703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.024711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.024723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.024729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.024733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.024736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.024737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.024742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.024750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.024765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.024888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.024893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.024900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.024949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2498 partition: 0 MaxSeqNo: 36 sessionId: src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0
2025-10-02T09:34:45.025179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493cf5f3-ee096e8b-cafe7de1-ea307cfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.027777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Write session: try to update token
2025-10-02T09:34:45.027791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.033901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.033912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.033913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.033914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.033918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.033920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.033922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231341:7286]
2025-10-02T09:34:45.033940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.033944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.033945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.033946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.033949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.033951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.034061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.039883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId: src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.042106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:45.107730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555518828802316:3012]
2025-10-02T09:34:45.107899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2497, pipe: [1:7556555518828802316:3012]
2025-10-02T09:34:45.146013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.146280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.146291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.146307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802316:3012], now have 1 active actors on pipe
2025-10-02T09:34:45.146458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.146484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.146496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.146548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2498 reason: error at write: Disconnected sessionId: src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0
2025-10-02T09:34:45.146576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555518828802316:3012]
2025-10-02T09:34:45.146597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.146690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2498 sessionId: src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0 is DEAD
2025-10-02T09:34:45.146871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.146886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Write session will restart in 0.005677s
2025-10-02T09:34:45.146908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Write session: Do CDS request
2025-10-02T09:34:45.146914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.151671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.152737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.152862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.152868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.152874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.152902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.152959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231435:7282]
2025-10-02T09:34:45.153160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.153257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.153266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2499
2025-10-02T09:34:45.153299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.153379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.153396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.153402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.153404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.153461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.153483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.153660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2499 sessionId:  describe result for acl check
2025-10-02T09:34:45.153662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.153683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.153687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.153688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.153690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.153692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802379:4057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.153693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.153694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.153695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.153695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.153696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.153696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.153697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.153697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.153698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.153699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.153699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.153702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.153708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.153710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.153712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.153714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.153716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.153718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.153720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.153722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.153724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.153725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.153727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.153732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.153736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.153740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.153742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.153744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.153747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.153749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.153752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.153755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.153758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.153760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.153763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.153765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.153768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.153769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.153772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.153774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.153776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.153778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.153781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.153783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.153785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.153787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.153790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.153807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.154037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802379:4057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.155146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802379:4057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.158998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802379:4057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.159006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802379:4057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.159008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802379:4057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.159012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.161178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.162638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.162647Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.162648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.162650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.162654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2498 [2:7556555518753231435:7282]
2025-10-02T09:34:45.162664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.162673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.162676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.162678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.162679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.162688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.162690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.162694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.162724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.162729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.162730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.162732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.162733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.162769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.162774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.162780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.162785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.162793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.162807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802415:4057], now have 1 active actors on pipe
2025-10-02T09:34:45.162812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802329:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.162816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.162817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.162819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.162827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.162838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.162838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.162839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.162841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.162847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.162850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.162839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2498
2025-10-02T09:34:45.162843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2498
2025-10-02T09:34:45.162865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.162869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.162871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.162881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.162886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.162914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df7d363f-605c1328-748a6e4-c399fb1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.162920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.162922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.162923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.162928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.162934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.162945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.163045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.163050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.163057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.163105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2499 partition: 0 MaxSeqNo: 36 sessionId: src_id|df7d363f-605c1328-748a6e4-c399fb1a_0
2025-10-02T09:34:45.163335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471bedc-80deb77e-e9bde588-c0fc9d39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df7d363f-605c1328-748a6e4-c399fb1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.165937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Write session: try to update token
2025-10-02T09:34:45.165953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.171951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.171961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.171962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.171964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.171968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.171970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.171973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231430:7282]
2025-10-02T09:34:45.171991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.171994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.171995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.171997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.171998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.172001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.172172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.178888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId: src_id|df7d363f-605c1328-748a6e4-c399fb1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.181065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:45.246519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555518828802422:3012]
2025-10-02T09:34:45.246713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2498, pipe: [1:7556555518828802422:3012]
2025-10-02T09:34:45.297726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.298272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.298286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.298304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802422:3012], now have 1 active actors on pipe
2025-10-02T09:34:45.298449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.298456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.298468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555518828802422:3012]
2025-10-02T09:34:45.298482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.298516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.298521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2499 reason: error at write: Disconnected sessionId: src_id|df7d363f-605c1328-748a6e4-c399fb1a_0
2025-10-02T09:34:45.298652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2499 sessionId: src_id|df7d363f-605c1328-748a6e4-c399fb1a_0 is DEAD
2025-10-02T09:34:45.298819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.298833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Write session will restart in 0.006173s
2025-10-02T09:34:45.298857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Write session: Do CDS request
2025-10-02T09:34:45.298865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.304156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.305245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.305378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.305388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.305395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.305423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.305465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231521:7281]
2025-10-02T09:34:45.306138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.306146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.306246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.306256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2500
2025-10-02T09:34:45.306335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.306356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.306362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.306374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.306381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.306384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.306652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2500 sessionId:  describe result for acl check
2025-10-02T09:34:45.306675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.306674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.306679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.306680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.306683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802477:4083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.306759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.306765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.306766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.306767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.306767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.306768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.306769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.306770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.306770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.306772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.306773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.306773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.306776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.306784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.306786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.306788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.306790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.306793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.306795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.306797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.306799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.306802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.306804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.306806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.306810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.306815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.306820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.306823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.306825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.306828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.306830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.306833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.306839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.306842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.306844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.306848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.306850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.306853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.306856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.306859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.306862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.306866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.306870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.306873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.306875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.306878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.306880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.306884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.306905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.307060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802477:4083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.308284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802477:4083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.313093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802477:4083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.313101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802477:4083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.313103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802477:4083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.313107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.314376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.317178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.317190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.317192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.317195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.317199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2499 [2:7556555518753231521:7281]
2025-10-02T09:34:45.317210Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.317223Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.317230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.317233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.317234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.317248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.317252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.317257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.317299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.317307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.317308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.317310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.317312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.317359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.317367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.317375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.317380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.317392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.317411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802514:4083], now have 1 active actors on pipe
2025-10-02T09:34:45.317418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802426:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.317423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.317424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.317427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.317423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2499
2025-10-02T09:34:45.317424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2499
2025-10-02T09:34:45.317440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.317453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.317457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.317460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.317462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.317467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.317469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.317506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.317513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.317524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.317535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.317549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.317565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|190bbeff-959468b-191977d6-aef9519d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.317574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.317576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.317577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.317584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.317595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.317609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.317704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.317712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.317721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.317774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2500 partition: 0 MaxSeqNo: 36 sessionId: src_id|190bbeff-959468b-191977d6-aef9519d_0
2025-10-02T09:34:45.317996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7d363f-605c1328-748a6e4-c399fb1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|190bbeff-959468b-191977d6-aef9519d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.323776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Write session: try to update token
2025-10-02T09:34:45.323790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.326833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.326845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.326846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.326847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.326852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.326855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.326857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231516:7281]
2025-10-02T09:34:45.326884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.326887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.326890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.326890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.326891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.326893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.327005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.342228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId: src_id|190bbeff-959468b-191977d6-aef9519d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.344421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:45.398564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555518828802521:3012]
2025-10-02T09:34:45.398738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2499, pipe: [1:7556555518828802521:3012]
2025-10-02T09:34:45.458076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.458414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.458427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.458446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802521:3012], now have 1 active actors on pipe
2025-10-02T09:34:45.458636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.458686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555518828802521:3012]
2025-10-02T09:34:45.458705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.458708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.458711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.458762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2500 reason: error at write: Disconnected sessionId: src_id|190bbeff-959468b-191977d6-aef9519d_0
2025-10-02T09:34:45.458896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2500 sessionId: src_id|190bbeff-959468b-191977d6-aef9519d_0 is DEAD
2025-10-02T09:34:45.459002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.459009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Write session will restart in 0.007113s
2025-10-02T09:34:45.459023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Write session: Do CDS request
2025-10-02T09:34:45.459027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.464276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.465409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.465565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.465574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.465581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.465615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.465645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231611:7278]
2025-10-02T09:34:45.466084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.466262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.466288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.466505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.466552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.466559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.466559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.466560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.466568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.466569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.466570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.466571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.466572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.466572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.466573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.466574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.466577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.466585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.466587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.466590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.466592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.466594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.466596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.466598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.466601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.466603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.466606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.466608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.466612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.466617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.466621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.466626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.466630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.466635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.466638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.466643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.466647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.466658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.466663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.466670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.466679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.466683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.466685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.466691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.466698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.466702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.466705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.466711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.466721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.466726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.466736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.466740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.466761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.467215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.467288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.467296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2501
2025-10-02T09:34:45.467382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.467403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.467405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.467407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.467697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2501 sessionId:  describe result for acl check
2025-10-02T09:34:45.467720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.467724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.467724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.467727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802577:4080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.468072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802577:4080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.469578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802577:4080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.473373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802577:4080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.473381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802577:4080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.473383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802577:4080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.473387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.474242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.475850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.475861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.475863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.475866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.475870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2500 [2:7556555518753231611:7278]
2025-10-02T09:34:45.475879Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.475891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.475899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.475901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.475903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.475915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.475923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.475928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.475974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.475981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.475983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.475985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.475988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.476061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.476069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.476077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.476084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.476099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.476097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2500
2025-10-02T09:34:45.476099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2500
2025-10-02T09:34:45.476117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802612:4080], now have 1 active actors on pipe
2025-10-02T09:34:45.476125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802523:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.476130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.476131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.476133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.476139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.476146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.476150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.476153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.476154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.476158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.476159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.476175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.476182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.476211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.476222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.476232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.476233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.476241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.476244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.476245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.476252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.476260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.476288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.476395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.476403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.476413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.476482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2501 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0
2025-10-02T09:34:45.476681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190bbeff-959468b-191977d6-aef9519d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.479383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Write session: try to update token
2025-10-02T09:34:45.479394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.485861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.485873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.485875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.485876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.485880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.485883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.485886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231606:7278]
2025-10-02T09:34:45.485910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.485913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.485915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.485919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.485923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.485927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.486095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.492968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId: src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.495040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:45.558821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555518828802619:3012]
2025-10-02T09:34:45.559010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2500, pipe: [1:7556555518828802619:3012]
2025-10-02T09:34:45.616318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.616623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.616636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.616655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802619:3012], now have 1 active actors on pipe
2025-10-02T09:34:45.616839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555518828802619:3012]
2025-10-02T09:34:45.616860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.616864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.616866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.616880Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:34:45.616912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.616920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2501 reason: error at write: Disconnected sessionId: src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0
2025-10-02T09:34:45.616970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2501 sessionId: src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0 is DEAD
2025-10-02T09:34:45.617011Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 25 consumer shared/user session shared/user_1_25_14952652734850685567_v1 is DEAD
2025-10-02T09:34:45.617088Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555458699238134:3028] disconnected; active server actors: 1
2025-10-02T09:34:45.617093Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555458699238134:3028] client user disconnected session shared/user_1_25_14952652734850685567_v1
2025-10-02T09:34:45.617144Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:34:45.617186Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:45.617190Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:34:45.617200Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.008728s
2025-10-02T09:34:45.617226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.617234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Write session will restart in 0.005949s
2025-10-02T09:34:45.617249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Write session: Do CDS request
2025-10-02T09:34:45.617253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.622377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.623468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.623636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.623647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.623655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.623688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.623721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231700:7276]
2025-10-02T09:34:45.624147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.624137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.624187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.624194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2502
2025-10-02T09:34:45.624285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.624304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.624308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.624310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.624314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.624341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.624557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.624575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2502 sessionId:  describe result for acl check
2025-10-02T09:34:45.624596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.624593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.624600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.624600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.624601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.624602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.624602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.624601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.624603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.624604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802674:4090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.624604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.624604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.624605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.624606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.624606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.624607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.624610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.624617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.624620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.624622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.624624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.624626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.624629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.624631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.624635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.624637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.624639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.624642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.624648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.624652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.624656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.624659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.624664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.624667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.624670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.624673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.624676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.624679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.624681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.624684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.624687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.624690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.624692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.624695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.624698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.624701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.624704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.624707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.624709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.624713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.624715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.624718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.624737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.624968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802674:4090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.626220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802674:4090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.627046Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:34:45.627136Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:34:45.627142Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 26
2025-10-02T09:34:45.627235Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 26 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:45.627262Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:34:45.627312Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 auth for : user
2025-10-02T09:34:45.627392Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 Handle describe topics response
2025-10-02T09:34:45.627407Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 auth is DEAD
2025-10-02T09:34:45.627409Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:34:45.627560Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:34:45.627611Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_26_18136196603800885689_v1
2025-10-02T09:34:45.627610Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555518828802710:4093] connected; active server actors: 1
2025-10-02T09:34:45.627618Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555518828802710:4093] session shared/user_1_26_18136196603800885689_v1
2025-10-02T09:34:45.627624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:34:45.627629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:34:45.627636Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_26_18136196603800885689_v1" (Sender=[1:7556555518828802705:4093], Pipe=[1:7556555518828802710:4093], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:45.627639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:34:45.627644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:34:45.627648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_26_18136196603800885689_v1" (Sender=[1:7556555518828802705:4093], Pipe=[1:7556555518828802710:4093], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:34:45.627655Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_26_18136196603800885689_v1" sender [1:7556555518828802705:4093] lock partition 0 for ReadingSession "shared/user_1_26_18136196603800885689_v1" (Sender=[1:7556555518828802705:4093], Pipe=[1:7556555518828802710:4093], Partitions=[], ActiveFamilyCount=1) generation 1 step 26
2025-10-02T09:34:45.627664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:34:45.627670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000023s
2025-10-02T09:34:45.627782Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 26 Session: "shared/user_1_26_18136196603800885689_v1" ClientId: "user" PipeClient { RawX1: 7556555518828802710 RawX2: 4503603922341885 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:34:45.627798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:34:45.629961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802674:4090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.629967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802674:4090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.629969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802674:4090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.629978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.632241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.633961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.633973Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.633977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.633980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.633984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2501 [2:7556555518753231700:7276]
2025-10-02T09:34:45.633993Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.634005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.634012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.634014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.634015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.634027Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.634031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.634036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.634082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.634089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.634090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.634092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.634095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.634141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.634149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.634157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.634163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.634177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.634196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802621:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.634203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802718:4090], now have 1 active actors on pipe
2025-10-02T09:34:45.634205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802713:4103], now have 1 active actors on pipe
2025-10-02T09:34:45.634210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.634211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.634212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.634214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2501
2025-10-02T09:34:45.634214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2501
2025-10-02T09:34:45.634230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2501, pipe: [1:7556555518828802713:4103]
2025-10-02T09:34:45.634226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.634242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.634243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.634248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.634250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.634255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.634257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.634273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.634281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.634289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_26_18136196603800885689_v1 on pipe: [1:7556555518828802713:4103]
2025-10-02T09:34:45.634323Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_26_18136196603800885689_v1:1 with generation 2501
2025-10-02T09:34:45.634326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.634327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.634332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.634339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.634351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.634354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.634361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.634373Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_26_18136196603800885689_v1
2025-10-02T09:34:45.634378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.634379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.634408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.634416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:34:45.634426Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:34:45.636231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:34:45.636248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:34:45.636253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.636255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.636257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.636263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.636270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.636274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:34:45.636281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:34:45.636294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.636370Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397685634 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:34:45.636379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:34:45.636391Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 sending to client partition status
2025-10-02T09:34:45.636423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.636429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.636440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.636496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2502 partition: 0 MaxSeqNo: 36 sessionId: src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0
2025-10-02T09:34:45.636640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e70d61e-2687e551-d6972bee-e8bab24c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.639213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Write session: try to update token
2025-10-02T09:34:45.639224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.643723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.643735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.643736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.643737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.643742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.643744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.643747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231695:7276]
2025-10-02T09:34:45.643772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.643777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.643778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.643779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.643783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.643787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.643902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.653256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId: src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.655407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:45.759155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.759397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.759405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.759579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_26_18136196603800885689_v1
2025-10-02T09:34:45.759599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.759591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.759616Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_26_18136196603800885689_v1
2025-10-02T09:34:45.759597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.759602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.759627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555518828802713:4103]
2025-10-02T09:34:45.759707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2502 reason: error at write: Disconnected sessionId: src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0
2025-10-02T09:34:45.759851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2502 sessionId: src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0 is DEAD
2025-10-02T09:34:45.759960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.759971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Write session will restart in 0.005141s
2025-10-02T09:34:45.759986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Write session: Do CDS request
2025-10-02T09:34:45.759990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.765599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.766109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.766227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.766235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2503
2025-10-02T09:34:45.766346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.766367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.766374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.766376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.766669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2503 sessionId:  describe result for acl check
2025-10-02T09:34:45.766689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.766692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.766694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.766696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802778:4113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.766829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.766957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.766964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.766970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.766999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.767046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802778:4113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.767020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231793:7274]
2025-10-02T09:34:45.767383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.767556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.767584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.767782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.767820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.767826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.767826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.767829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.767830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.767831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.767831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.767832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.767833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.767834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.767835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.767836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.767840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.767849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.767851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.767853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.767855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.767857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.767859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.767861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.767863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.767866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.767868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.767870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.767873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.767877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.767881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.767884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.767886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.767889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.767891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.767894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.767896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.767899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.767902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.767906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.767909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.767912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.767914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.767917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.767919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.767922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.767924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.767926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.767928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.767931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.767933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.767935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.767952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.768589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802778:4113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.773783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802778:4113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.773795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802778:4113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.773797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802778:4113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.773803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.775475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.777022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.777032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.777033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.777035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.777039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2502 [2:7556555518753231793:7274]
2025-10-02T09:34:45.777090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.777104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.777106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.777108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.777109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.777119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.777122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.777126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.777159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.777164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.777165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.777167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.777168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.777206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.777212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.777222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.777234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.777251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.777269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802726:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.777276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802818:4113], now have 1 active actors on pipe
2025-10-02T09:34:45.777280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.777282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.777284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.777292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.777303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.777306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.777308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.777309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.777318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.777320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.777307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2502
2025-10-02T09:34:45.777310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2502
2025-10-02T09:34:45.777337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.777343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.777344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.777353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.777361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.777391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|370abda2-efb29843-610094c6-2da38b28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.777399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.777404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.777405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.777411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.777417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.777430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.777529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.777536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.777545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.777595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2503 partition: 0 MaxSeqNo: 36 sessionId: src_id|370abda2-efb29843-610094c6-2da38b28_0
2025-10-02T09:34:45.777780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935d8a9c-cb99dbbc-b3412e6a-3c7491a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|370abda2-efb29843-610094c6-2da38b28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.780363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Write session: try to update token
2025-10-02T09:34:45.780374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.786865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.786876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.786877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.786879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.786883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.786885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.786887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231788:7274]
2025-10-02T09:34:45.786910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.786913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.786914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.786915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.786917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.786919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.787101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.793445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId: src_id|370abda2-efb29843-610094c6-2da38b28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.795661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:45.859865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555518828802847:4103]
2025-10-02T09:34:45.860010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2502, pipe: [1:7556555518828802847:4103]
2025-10-02T09:34:45.913065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:45.913729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.913745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.913766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802847:4103], now have 1 active actors on pipe
2025-10-02T09:34:45.913928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:45.913951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:45.913954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:45.913983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555518828802847:4103]
2025-10-02T09:34:45.914024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2503 reason: error at write: Disconnected sessionId: src_id|370abda2-efb29843-610094c6-2da38b28_0
2025-10-02T09:34:45.914041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:45.914191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2503 sessionId: src_id|370abda2-efb29843-610094c6-2da38b28_0 is DEAD
2025-10-02T09:34:45.914330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:45.914336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Write session will restart in 0.009076s
2025-10-02T09:34:45.914367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Write session: Do CDS request
2025-10-02T09:34:45.914372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:45.919921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:45.921097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:45.921253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:45.921262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:45.921270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:45.921303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:45.921390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555518753231920:7241]
2025-10-02T09:34:45.921931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:45.922117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:45.922147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:45.922435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:45.922481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.922487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.922488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.922488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.922489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.922490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.922491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.922491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.922492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.922493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.922493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.922494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.922497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.922504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.922509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.922511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.922514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.922516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.922518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.922521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.922523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.922526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.922528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.922539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.922544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.922549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:45.922553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.922556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:45.922559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.922562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:45.922564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.922567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:45.922570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.922573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:45.922575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.922578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:45.922580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.922583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:45.922586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.922589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:45.922591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.922594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:45.922596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.922600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.922602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.922607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.922610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.922612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.922632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:45.924244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.924339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:45.924347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2504
2025-10-02T09:34:45.924646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:45.924666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:45.924672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:45.924674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:45.925042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2504 sessionId:  describe result for acl check
2025-10-02T09:34:45.925062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:45.925067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:45.925067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:45.925071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555518828802912:4132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:45.925407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555518828802912:4132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:45.926988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555518828802912:4132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:45.929633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555518828802912:4132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:45.929641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555518828802912:4132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:45.929643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555518828802912:4132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:45.929647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:45.930205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:45.932109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:45.932120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:45.932122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:45.932125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:45.932130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2503 [2:7556555518753231920:7241]
2025-10-02T09:34:45.932141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:45.932153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:45.932155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.932158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.932159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.932172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:45.932175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:45.932180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:45.932220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.932228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.932229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.932231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:45.932233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:45.932288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:45.932295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.932301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:45.932307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:45.932316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:45.932336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802855:2446], now have 1 active actors on pipe
2025-10-02T09:34:45.932344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555518828802946:4132], now have 1 active actors on pipe
2025-10-02T09:34:45.932349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.932350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.932352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.932350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2503
2025-10-02T09:34:45.932351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2503
2025-10-02T09:34:45.932368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:45.932380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:45.932382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:45.932383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:45.932383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:45.932391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:45.932393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:45.932429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.932436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.932447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.932454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:45.932465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:45.932478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:45.932490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:45.932493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:45.932494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:45.932501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:45.932512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:45.932573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.932684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:45.932691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:45.932702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:45.932757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2504 partition: 0 MaxSeqNo: 36 sessionId: src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0
2025-10-02T09:34:45.932957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370abda2-efb29843-610094c6-2da38b28_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:45.938661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Write session: try to update token
2025-10-02T09:34:45.938672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:45.942559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:45.942571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:45.942573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:45.942574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:45.942582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.942585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.942588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555518753231914:7241]
2025-10-02T09:34:45.942614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:45.942615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:45.942617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:45.942619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:45.942620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:45.942621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:45.942732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:45.956513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId: src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:45.958554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.013973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770254:4103]
2025-10-02T09:34:46.014131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2503, pipe: [1:7556555523123770254:4103]
2025-10-02T09:34:46.073616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:46.073911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.073927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.073939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770254:4103], now have 1 active actors on pipe
2025-10-02T09:34:46.074127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:46.074138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770254:4103]
2025-10-02T09:34:46.074158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:46.074159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:46.074202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2504 reason: error at write: Disconnected sessionId: src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0
2025-10-02T09:34:46.074335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:46.074327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2504 sessionId: src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0 is DEAD
2025-10-02T09:34:46.074489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:46.074502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Write session will restart in 0.007704s
2025-10-02T09:34:46.074529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Write session: Do CDS request
2025-10-02T09:34:46.074544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:46.080009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:46.081105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:46.081266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:46.081273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:46.081280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:46.081313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:46.081346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555523048199320:7248]
2025-10-02T09:34:46.081762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:46.081933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:46.081958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:46.082178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:46.082251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.082256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.082257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.082258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.082258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.082259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.082260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.082261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.082261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.082263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.082264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.082265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.082269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.082276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.082278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.082281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.082283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.082285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.082288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.082290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.082292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.082295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.082297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.082299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.082304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.082310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.082315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.082318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.082322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.082325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.082328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.082331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.082334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.082337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.082339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.082342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.082344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.082347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.082349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.082352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.082355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.082358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.082360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.082363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.082365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.082368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.082370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.082373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.082395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:46.083203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.083296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:46.083306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2505
2025-10-02T09:34:46.083387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.083406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:46.083412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:46.083415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:46.083705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2505 sessionId:  describe result for acl check
2025-10-02T09:34:46.083726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:46.083730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:46.083731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:46.083733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555523123770313:4145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:46.084089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555523123770313:4145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:46.085516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555523123770313:4145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:46.089174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555523123770313:4145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:46.089182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555523123770313:4145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:46.089184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555523123770313:4145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:46.089188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:46.089893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:46.091539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:46.091549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:46.091552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:46.091555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:46.091561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2504 [2:7556555523048199320:7248]
2025-10-02T09:34:46.091572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:46.091583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:46.091589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.091591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.091592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.091603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:46.091610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:46.091615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:46.091657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.091662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.091663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.091666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:46.091667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:46.091716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:46.091721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.091729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.091740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.091750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:46.091769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770348:4145], now have 1 active actors on pipe
2025-10-02T09:34:46.091775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770255:2446], now have 1 active actors on pipe
2025-10-02T09:34:46.091779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.091784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.091786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.091784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2504
2025-10-02T09:34:46.091800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:46.091805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2504
2025-10-02T09:34:46.091804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:46.091807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:46.091808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:46.091819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:46.091830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:46.091834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:46.091866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.091873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.091886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.091896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:46.091905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:46.091919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:46.091923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.091926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.091927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:46.091934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.091943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:46.091961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.092062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.092067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.092078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.092152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2505 partition: 0 MaxSeqNo: 36 sessionId: src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0
2025-10-02T09:34:46.092363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c587bfe1-58cafc44-9ff352af-6a4022ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:46.094887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Write session: try to update token
2025-10-02T09:34:46.094898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:46.101166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:46.101180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:46.101181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:46.101183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:46.101187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.101189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.101191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555523048199315:7248]
2025-10-02T09:34:46.101216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:46.101219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.101219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:46.101221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:46.101223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:46.101225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:46.101347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:46.108854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId: src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:46.111067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.174224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770368:4103]
2025-10-02T09:34:46.174404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2504, pipe: [1:7556555523123770368:4103]
2025-10-02T09:34:46.232123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:46.232443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.232455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.232474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770368:4103], now have 1 active actors on pipe
2025-10-02T09:34:46.232688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:46.232717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770368:4103]
2025-10-02T09:34:46.232728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:46.232731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:46.232743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:46.232791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2505 reason: error at write: Disconnected sessionId: src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0
2025-10-02T09:34:46.232954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2505 sessionId: src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0 is DEAD
2025-10-02T09:34:46.233085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:46.233090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Write session will restart in 0.008976s
2025-10-02T09:34:46.233110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Write session: Do CDS request
2025-10-02T09:34:46.233115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:46.239646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:46.240950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:46.241093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:46.241101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:46.241109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:46.241138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:46.241180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555523048199413:7247]
2025-10-02T09:34:46.241611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:46.241813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:46.241838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:46.242059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:46.242096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.242100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.242101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.242102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.242103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.242103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.242104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.242105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.242106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.242106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.242107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.242108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.242112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.242119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.242122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.242124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.242127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.242131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.242133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.242135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.242138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.242140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.242142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.242144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.242149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.242154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.242158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.242161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.242166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.242169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.242172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.242175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.242178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.242181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.242183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.242187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.242189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.242192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.242195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.242198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.242202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.242205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.242207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.242210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.242213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.242216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.242218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.242221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.242240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:46.243217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.243337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:46.243345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2506
2025-10-02T09:34:46.243442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.243466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:46.243471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:46.243474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:46.243762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2506 sessionId:  describe result for acl check
2025-10-02T09:34:46.243786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:46.243790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:46.243791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:46.243795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555523123770428:4153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:46.244152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555523123770428:4153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:46.245823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555523123770428:4153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:46.249126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555523123770428:4153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:46.249137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555523123770428:4153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:46.249139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555523123770428:4153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:46.249143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:46.249803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:46.251544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:46.251556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:46.251558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:46.251560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:46.251565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2505 [2:7556555523048199413:7247]
2025-10-02T09:34:46.251574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:46.251587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:46.251593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.251595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.251596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.251609Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:46.251616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:46.251621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:46.251663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.251668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.251670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.251673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:46.251675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:46.251725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:46.251731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.251739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.251749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.251757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:46.251774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770369:2446], now have 1 active actors on pipe
2025-10-02T09:34:46.251781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770463:4153], now have 1 active actors on pipe
2025-10-02T09:34:46.251786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.251788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.251790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.251801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:46.251813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:46.251799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2505
2025-10-02T09:34:46.251814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:46.251817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:46.251800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2505
2025-10-02T09:34:46.251818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:46.251823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:46.251825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:46.251860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.251866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.251877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.251886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:46.251899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:46.251910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|450ff60a-b946626d-15ea079-5c183a42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:46.251915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.251917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.251919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:46.251925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.251936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:46.251960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.252079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.252085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.252096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.252152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2506 partition: 0 MaxSeqNo: 36 sessionId: src_id|450ff60a-b946626d-15ea079-5c183a42_0
2025-10-02T09:34:46.252367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c6daf9-27e073b8-922e74c5-58fb7da8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|450ff60a-b946626d-15ea079-5c183a42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:46.254967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Write session: try to update token
2025-10-02T09:34:46.254980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:46.261336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:46.261351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:46.261353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:46.261355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:46.261362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.261365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.261370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555523048199408:7247]
2025-10-02T09:34:46.261397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:46.261402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.261402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:46.261403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:46.261405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:46.261408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:46.261514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:46.268129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId: src_id|450ff60a-b946626d-15ea079-5c183a42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:46.270399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.332978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770473:4103]
2025-10-02T09:34:46.333167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2505, pipe: [1:7556555523123770473:4103]
2025-10-02T09:34:46.392749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:46.393124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.393136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.393156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770473:4103], now have 1 active actors on pipe
2025-10-02T09:34:46.393347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:46.393344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:46.393356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770473:4103]
2025-10-02T09:34:46.393378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:46.393380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:46.393439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2506 reason: error at write: Disconnected sessionId: src_id|450ff60a-b946626d-15ea079-5c183a42_0
2025-10-02T09:34:46.393584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2506 sessionId: src_id|450ff60a-b946626d-15ea079-5c183a42_0 is DEAD
2025-10-02T09:34:46.393738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:46.393748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Write session will restart in 0.007338s
2025-10-02T09:34:46.393771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Write session: Do CDS request
2025-10-02T09:34:46.393776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:46.399450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:46.400563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:46.400704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:46.400713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:46.400722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:46.400756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:46.400787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555523048199509:7246]
2025-10-02T09:34:46.401408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:46.401603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:46.401628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:46.401832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:46.401867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.401871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.401871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.401872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.401873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.401873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.401874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.401874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.401875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.401875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.401876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.401877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.401880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.401887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.401889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.401891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.401894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.401896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.401898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.401900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.401904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.401906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.401909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.401911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.401915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.401920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.401924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.401927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.401930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.401933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.401935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.401938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.401940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.401943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.401945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.401948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.401950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.401953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.401956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.401958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.401961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.401964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.401966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.401969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.401972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.401974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.401977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.401980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.401999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:46.402166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.402271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:46.402279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2507
2025-10-02T09:34:46.402389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.402411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:46.402419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:46.402423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:46.402710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2507 sessionId:  describe result for acl check
2025-10-02T09:34:46.402734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:46.402740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:46.402742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:46.402745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555523123770534:4169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:46.403111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555523123770534:4169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:46.404571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555523123770534:4169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:46.408482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555523123770534:4169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:46.408490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555523123770534:4169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:46.408492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555523123770534:4169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:46.408497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:46.409928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:46.411560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:46.411573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:46.411575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:46.411578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:46.411585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2506 [2:7556555523048199509:7246]
2025-10-02T09:34:46.411595Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:46.411611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:46.411617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.411619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.411621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.411634Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:46.411643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:46.411649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:46.411690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.411695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.411696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.411699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:46.411700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:46.411752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:46.411758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.411765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.411770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.411780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:46.411794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770474:2446], now have 1 active actors on pipe
2025-10-02T09:34:46.411800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770569:4169], now have 1 active actors on pipe
2025-10-02T09:34:46.411806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.411807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.411809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.411823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:46.411819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2506
2025-10-02T09:34:46.411820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2506
2025-10-02T09:34:46.411836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:46.411839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:46.411842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:46.411843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:46.411846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:46.411847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:46.411883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.411889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.411899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.411909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:46.411926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:46.411930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:46.411935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.411937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.411938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:46.411945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.411952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:46.411969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.412075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.412081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.412091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.412138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2507 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0
2025-10-02T09:34:46.412354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450ff60a-b946626d-15ea079-5c183a42_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:46.414952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Write session: try to update token
2025-10-02T09:34:46.414965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:46.422031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:46.422050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:46.422052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:46.422053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:46.422059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.422063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.422065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555523048199504:7246]
2025-10-02T09:34:46.422095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:46.422097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:46.422102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:46.422104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:46.422105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.422107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:46.422297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:46.428148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId: src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:46.430294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.493741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770577:4103]
2025-10-02T09:34:46.493934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2506, pipe: [1:7556555523123770577:4103]
2025-10-02T09:34:46.554326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:46.554776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.554788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.554807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770577:4103], now have 1 active actors on pipe
2025-10-02T09:34:46.555012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:46.555045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770577:4103]
2025-10-02T09:34:46.555052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:46.555055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:46.555067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:46.555110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2507 reason: error at write: Disconnected sessionId: src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0
2025-10-02T09:34:46.555254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2507 sessionId: src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0 is DEAD
2025-10-02T09:34:46.555372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:46.555383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Write session will restart in 0.005140s
2025-10-02T09:34:46.555399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Write session: Do CDS request
2025-10-02T09:34:46.555404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:46.561290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.561502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:46.561512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2508
2025-10-02T09:34:46.561517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:46.561637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.561659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:46.561666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:46.561668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:46.561930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2508 sessionId:  describe result for acl check
2025-10-02T09:34:46.561953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:46.561957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:46.561958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:46.561961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555523123770634:4175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:46.562338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555523123770634:4175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:46.562558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:46.562689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:46.562697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:46.562705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:46.562735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:46.562769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555523048199604:7243]
2025-10-02T09:34:46.563432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:46.563622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:46.563652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:46.563725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555523123770634:4175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:46.563888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:46.563929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.563933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.563934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.563934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.563935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.563936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.563937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.563937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.563939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.563939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.563940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.563941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.563944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.563952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.563954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.563956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.563959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.563961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.563963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.563965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.563968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.563971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.563973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.563975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.563981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.563986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.563990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.563993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.563995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.563999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.564002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.564005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.564008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.564013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.564017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.564021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.564027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.564030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.564033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.564037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.564039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.564042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.564045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.564047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.564050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.564056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.564059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.564062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.564083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:46.567956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555523123770634:4175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:46.567966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555523123770634:4175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:46.567967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555523123770634:4175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:46.567972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:46.571684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:46.573444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:46.573456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:46.573458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:46.573461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:46.573465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2507 [2:7556555523048199604:7243]
2025-10-02T09:34:46.573476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:46.573488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:46.573490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.573492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.573493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.573505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:46.573512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:46.573518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:46.573564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.573571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.573572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.573575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:46.573577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:46.573631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:46.573638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.573646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.573652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.573665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:46.573685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770677:4175], now have 1 active actors on pipe
2025-10-02T09:34:46.573691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770578:2446], now have 1 active actors on pipe
2025-10-02T09:34:46.573697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.573701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.573703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.573715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:46.573712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2507
2025-10-02T09:34:46.573715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2507
2025-10-02T09:34:46.573728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:46.573733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:46.573737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:46.573739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:46.573739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:46.573740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:46.573777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.573783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.573794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.573805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:46.573822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:46.573830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:46.573838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.573840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.573841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:46.573849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.573855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:46.573869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.573971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.573976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.573987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.574035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2508 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0
2025-10-02T09:34:46.574249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4ce22c-14e97880-124f6af8-5a9bebfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:46.577152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Write session: try to update token
2025-10-02T09:34:46.577166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:46.583348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:46.583365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:46.583366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:46.583368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:46.583375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.583378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.583380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555523048199599:7243]
2025-10-02T09:34:46.583408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:46.583412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.583416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:46.583416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:46.583420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:46.583423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:46.583558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:46.590233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId: src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:46.592521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.655011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770685:4103]
2025-10-02T09:34:46.655204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2507, pipe: [1:7556555523123770685:4103]
2025-10-02T09:34:46.715217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:46.715614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.715625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.715643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770685:4103], now have 1 active actors on pipe
2025-10-02T09:34:46.715834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:46.715869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:46.715869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770685:4103]
2025-10-02T09:34:46.715884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:46.715894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:46.715953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2508 reason: error at write: Disconnected sessionId: src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0
2025-10-02T09:34:46.716104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2508 sessionId: src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0 is DEAD
2025-10-02T09:34:46.716240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:46.716251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Write session will restart in 0.008098s
2025-10-02T09:34:46.716274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Write session: Do CDS request
2025-10-02T09:34:46.716280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:46.722230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:46.723309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:46.723466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:46.723474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:46.723482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:46.723515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:46.723546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555523048199700:7238]
2025-10-02T09:34:46.723983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:46.724158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:46.724185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:46.724405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:46.724440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.724445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.724445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.724446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.724447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.724448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.724448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.724449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.724449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.724450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.724451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.724451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.724455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.724462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.724465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.724467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.724470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.724472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.724474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.724477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.724479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.724481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.724484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.724486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.724491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.724496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.724502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.724505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.724508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.724511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.724514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.724518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.724521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.724524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.724526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.724529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.724531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.724534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.724537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.724539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.724543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.724546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.724548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.724551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.724554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.724556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.724559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.724562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.724584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:46.725226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.725357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:46.725370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2509
2025-10-02T09:34:46.725497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.725527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:46.725536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:46.725542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:46.725926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2509 sessionId:  describe result for acl check
2025-10-02T09:34:46.725963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:46.725969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:46.725970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:46.725975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555523123770748:4185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:46.726518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555523123770748:4185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:46.728097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555523123770748:4185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:46.731518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555523123770748:4185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:46.731527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555523123770748:4185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:46.731529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555523123770748:4185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:46.731533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:46.732237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:46.734107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:46.734120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:46.734121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:46.734123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:46.734128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2508 [2:7556555523048199700:7238]
2025-10-02T09:34:46.734142Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:46.734155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:46.734160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.734163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.734164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.734176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:46.734179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:46.734186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:46.734229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.734234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.734235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.734239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:46.734241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:46.734289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:46.734295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.734302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.734308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.734319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:46.734337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770686:2446], now have 1 active actors on pipe
2025-10-02T09:34:46.734343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770783:4185], now have 1 active actors on pipe
2025-10-02T09:34:46.734348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.734349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.734350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.734361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:46.734374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:46.734367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2508
2025-10-02T09:34:46.734370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2508
2025-10-02T09:34:46.734377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:46.734380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:46.734381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:46.734385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:46.734387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:46.734413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.734421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:46.734427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:46.734433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.734436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.734465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:46.734473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.734476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.734477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:46.734484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.734494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:46.734509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.734622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.734628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.734640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.734710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2509 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0
2025-10-02T09:34:46.734966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3b3743-555f1388-7fcf49e4-5d392d8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:46.737733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Write session: try to update token
2025-10-02T09:34:46.737745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:46.744370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:46.744385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:46.744387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:46.744388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:46.744394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.744397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.744400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555523048199695:7238]
2025-10-02T09:34:46.744429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:46.744434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.744439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:46.744440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:46.744445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:46.744448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:46.744569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:46.750398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId: src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:46.752672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.815764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770792:4103]
2025-10-02T09:34:46.815885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2508, pipe: [1:7556555523123770792:4103]
2025-10-02T09:34:46.874131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:46.874430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.874441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.874460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770792:4103], now have 1 active actors on pipe
2025-10-02T09:34:46.874601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770792:4103]
2025-10-02T09:34:46.874629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:46.874607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:46.874628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:46.874631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:46.874678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2509 reason: error at write: Disconnected sessionId: src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0
2025-10-02T09:34:46.874828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2509 sessionId: src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0 is DEAD
2025-10-02T09:34:46.874959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:46.874964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Write session will restart in 0.009056s
2025-10-02T09:34:46.874981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Write session: Do CDS request
2025-10-02T09:34:46.874986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:46.880572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:46.881705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:46.881848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:46.881857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:46.881864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:46.881895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:46.881921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555523048199835:7217]
2025-10-02T09:34:46.882368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:46.882600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:46.882630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:46.882851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:46.882886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.882891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.882891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.882892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.882893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.882894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.882894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.882895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.882895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.882896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.882897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.882897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.882901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.882908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.882910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.882912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.882915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.882917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.882919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.882921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.882924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.882926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.882930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.882933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.882939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.882943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:46.882947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.882950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:46.882952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.882955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:46.882958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.882961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:46.882964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.882967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:46.882969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.882972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:46.882975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.882978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:46.882980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.882983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:46.882985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.882988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:46.882990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.882993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.882998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.883000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.883003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.883009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.883028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:46.885144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.885276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:46.885286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2510
2025-10-02T09:34:46.885395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:46.885418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:46.885427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:46.885431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:46.885784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2510 sessionId:  describe result for acl check
2025-10-02T09:34:46.885821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:46.885827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:46.885828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:46.885832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555523123770884:4209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:46.886326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555523123770884:4209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:46.888240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555523123770884:4209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:46.890712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555523123770884:4209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:46.890722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555523123770884:4209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:46.890724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555523123770884:4209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:46.890728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:46.891073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:46.892886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:46.892898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:46.892901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:46.892908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:46.892914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2509 [2:7556555523048199835:7217]
2025-10-02T09:34:46.892924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:46.892938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:46.892944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.892946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.892948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.892960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:46.892963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:46.892968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:46.893007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.893012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.893013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.893016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:46.893018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:46.893069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:46.893075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.893083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:46.893089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:46.893100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:46.893119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770821:2446], now have 1 active actors on pipe
2025-10-02T09:34:46.893125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770917:4209], now have 1 active actors on pipe
2025-10-02T09:34:46.893130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.893132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.893134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.893145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:46.893158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:46.893161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:46.893164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:46.893166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:46.893170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:46.893154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2509
2025-10-02T09:34:46.893172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:46.893154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2509
2025-10-02T09:34:46.893198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.893207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:46.893217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:46.893221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.893224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.893253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25654e2f-b052f304-934fdc4a-5752b9be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:46.893261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:46.893264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:46.893267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:46.893274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:46.893281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:46.893296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.893396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:46.893401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:46.893411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:46.893473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2510 partition: 0 MaxSeqNo: 36 sessionId: src_id|25654e2f-b052f304-934fdc4a-5752b9be_0
2025-10-02T09:34:46.893692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d75a53b-4e1a7947-e8790940-68470d7c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25654e2f-b052f304-934fdc4a-5752b9be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:46.896270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Write session: try to update token
2025-10-02T09:34:46.896282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:46.903464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:46.903478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:46.903479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:46.903480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:46.903485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.903489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.903491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555523048199830:7217]
2025-10-02T09:34:46.903521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:46.903524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:46.903526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:46.903529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:46.903535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:46.903537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:46.903813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:46.908656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId: src_id|25654e2f-b052f304-934fdc4a-5752b9be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:46.910922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:46.975020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555523123770928:4103]
2025-10-02T09:34:46.975200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2509, pipe: [1:7556555523123770928:4103]
2025-10-02T09:34:47.034311Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:47.034767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.034779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.034799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555523123770928:4103], now have 1 active actors on pipe
2025-10-02T09:34:47.035021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:47.035036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555523123770928:4103]
2025-10-02T09:34:47.035036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:47.035066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:47.035068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:47.035122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2510 reason: error at write: Disconnected sessionId: src_id|25654e2f-b052f304-934fdc4a-5752b9be_0
2025-10-02T09:34:47.035275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2510 sessionId: src_id|25654e2f-b052f304-934fdc4a-5752b9be_0 is DEAD
2025-10-02T09:34:47.035444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:47.035456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Write session will restart in 0.007034s
2025-10-02T09:34:47.035483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Write session: Do CDS request
2025-10-02T09:34:47.035489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:47.041721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:47.042925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:47.043097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:47.043108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:47.043115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:47.043130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.043151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:47.043180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555527343167240:7211]
2025-10-02T09:34:47.043296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:47.043303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2511
2025-10-02T09:34:47.043422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.043443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:47.043449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:47.043451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:47.043608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:47.043731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2511 sessionId:  describe result for acl check
2025-10-02T09:34:47.043757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:47.043761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:47.043762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:47.043765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555527418738288:4221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:47.043799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:47.043826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:47.044053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:47.044088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.044093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.044093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.044094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.044095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.044096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.044097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.044097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.044114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555527418738288:4221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:47.044098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.044099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.044099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.044100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.044105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.044112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.044114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.044117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.044119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.044121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.044123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.044126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.044128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.044132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.044134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.044136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.044142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.044147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.044151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.044155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.044157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.044160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.044162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.044165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.044168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.044170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.044172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.044176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.044178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.044181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.044183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.044186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.044188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.044192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.044194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.044199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.044201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.044205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.044207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.044211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.044233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:47.045577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555527418738288:4221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:47.049582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555527418738288:4221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:47.049593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555527418738288:4221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:47.049596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555527418738288:4221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:47.049602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:47.051849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:47.053517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:47.053528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:47.053530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:47.053532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:47.053537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2510 [2:7556555527343167240:7211]
2025-10-02T09:34:47.053546Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:47.053558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:47.053564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.053566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.053567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.053580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:47.053587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:47.053594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:47.053632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.053638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.053639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.053641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:47.053643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:47.053693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:47.053698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.053706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.053711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.053723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:47.053739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738225:2446], now have 1 active actors on pipe
2025-10-02T09:34:47.053746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738325:4221], now have 1 active actors on pipe
2025-10-02T09:34:47.053750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.053752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.053753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.053763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:47.053776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:47.053781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:47.053768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2510
2025-10-02T09:34:47.053784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:47.053776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2510
2025-10-02T09:34:47.053786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:47.053788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:47.053789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:47.053808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.053814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:47.053817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:47.053833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.053839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.053878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:47.053886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.053890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.053895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:47.053902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.053912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:47.053928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.054025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.054031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.054040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.054097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2511 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0
2025-10-02T09:34:47.054363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25654e2f-b052f304-934fdc4a-5752b9be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:47.057130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Write session: try to update token
2025-10-02T09:34:47.057145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:47.063344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:47.063358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:47.063360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:47.063361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:47.063367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.063371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.063374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555527343167235:7211]
2025-10-02T09:34:47.063403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:47.063408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.063409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:47.063412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:47.063415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:47.063419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:47.063539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:47.072749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId: src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:47.074949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:47.135262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555527418738345:4103]
2025-10-02T09:34:47.135428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2510, pipe: [1:7556555527418738345:4103]
2025-10-02T09:34:47.194865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:47.195252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.195263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.195283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738345:4103], now have 1 active actors on pipe
2025-10-02T09:34:47.195470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:47.195527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:47.195539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555527418738345:4103]
2025-10-02T09:34:47.195554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:47.195600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0
2025-10-02T09:34:47.195751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2511 sessionId: src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0 is DEAD
2025-10-02T09:34:47.195888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:47.195894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Write session will restart in 0.008068s
2025-10-02T09:34:47.195921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Write session: Do CDS request
2025-10-02T09:34:47.195926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:47.201486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:47.202617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:47.202805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:47.202814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:47.202821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:47.202863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:47.202895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555527343167341:7203]
2025-10-02T09:34:47.203336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:47.203530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:47.203557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:47.203777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:47.203829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.203833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.203834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.203835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.203835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.203836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.203837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.203838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.203839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.203839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.203841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.203842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.203846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.203853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.203855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.203858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.203860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.203862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.203865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.203867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.203869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.203872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.203874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.203876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.203881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.203885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.203889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.203892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.203895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.203897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.203900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.203903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.203905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.203908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.203911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.203913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.203917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.203920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.203924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.203926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.203929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.203933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.203936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.203939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.203942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.203944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.203947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.203950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.203970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:47.205264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.205376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:47.205388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2512
2025-10-02T09:34:47.205500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.205522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:47.205528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:47.205531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:47.205812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2512 sessionId:  describe result for acl check
2025-10-02T09:34:47.205841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:47.205846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:47.205847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:47.205850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555527418738411:4237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:47.206265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555527418738411:4237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:47.207888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555527418738411:4237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:47.210967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555527418738411:4237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:47.210976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555527418738411:4237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:47.210978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555527418738411:4237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:47.210983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:47.211616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:47.213311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:47.213324Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:47.213325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:47.213329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:47.213335Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2511 [2:7556555527343167341:7203]
2025-10-02T09:34:47.213343Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:47.213355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:47.213360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.213362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.213363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.213375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:47.213378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:47.213383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:47.213423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.213430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.213432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.213434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:47.213436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:47.213485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:47.213490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.213497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.213503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.213512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:47.213531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738346:2446], now have 1 active actors on pipe
2025-10-02T09:34:47.213538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738446:4237], now have 1 active actors on pipe
2025-10-02T09:34:47.213542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.213544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.213545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.213559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:47.213573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:47.213577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:47.213580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:47.213561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2511
2025-10-02T09:34:47.213581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:47.213586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:47.213562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2511
2025-10-02T09:34:47.213588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:47.213611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.213621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:47.213635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.213640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.213641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:47.213673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:47.213682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.213684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.213685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:47.213692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.213701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:47.213715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.213834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.213840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.213849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.213922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2512 partition: 0 MaxSeqNo: 36 sessionId: src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0
2025-10-02T09:34:47.214164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b122ca-32a55de-2c1336ab-b00ff884_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:47.217006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Write session: try to update token
2025-10-02T09:34:47.217020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:47.223336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:47.223354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:47.223356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:47.223357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:47.223363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.223367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.223370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555527343167336:7203]
2025-10-02T09:34:47.223396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:47.223403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.223405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:47.223410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:47.223415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:47.223418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:47.223529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:47.232737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId: src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:47.234944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:47.295520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555527418738456:4103]
2025-10-02T09:34:47.295695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2511, pipe: [1:7556555527418738456:4103]
2025-10-02T09:34:47.357440Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:47.357883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.357899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.357921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738456:4103], now have 1 active actors on pipe
2025-10-02T09:34:47.358182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:47.358159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:47.358159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:47.358179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:47.358196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555527418738456:4103]
2025-10-02T09:34:47.358243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2512 reason: error at write: Disconnected sessionId: src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0
2025-10-02T09:34:47.358383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2512 sessionId: src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0 is DEAD
2025-10-02T09:34:47.358541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:47.358550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Write session will restart in 0.009970s
2025-10-02T09:34:47.358568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Write session: Do CDS request
2025-10-02T09:34:47.358572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:47.364597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:47.365719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:47.365870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:47.365879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:47.365886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:47.365920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:47.365954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555527343167443:7198]
2025-10-02T09:34:47.366392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:47.366584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:47.366613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:47.366852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:47.366903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.366910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.366910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.366911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.366912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.366912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.366913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.366914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.366914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.366915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.366915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.366916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.366919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.366926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.366929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.366932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.366934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.366936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.366938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.366941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.366943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.366946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.366948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.366950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.366955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.366960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.366964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.366967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.366970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.366973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.366976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.366979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.366984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.366987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.366992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.366995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.366998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.367001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.367004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.367007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.367010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.367013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.367016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.367019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.367023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.367026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.367030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.367033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.367057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:47.369167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.369294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:47.369304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2513
2025-10-02T09:34:47.369421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.369442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:47.369448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:47.369450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:47.369840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2513 sessionId:  describe result for acl check
2025-10-02T09:34:47.369872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:47.369878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:47.369879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:47.369884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555527418738524:4244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:47.370446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555527418738524:4244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:47.371763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555527418738524:4244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:47.376192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555527418738524:4244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:47.376201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555527418738524:4244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:47.376203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555527418738524:4244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:47.376208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:47.376859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:47.378661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:47.378673Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:47.378676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:47.378679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:47.378684Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2512 [2:7556555527343167443:7198]
2025-10-02T09:34:47.378694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:47.378706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:47.378709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.378711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.378712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.378724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:47.378733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:47.378740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:47.378779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.378785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.378786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.378789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:47.378791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:47.378846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:47.378854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.378861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.378866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.378875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:47.378895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738457:2446], now have 1 active actors on pipe
2025-10-02T09:34:47.378902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738558:4244], now have 1 active actors on pipe
2025-10-02T09:34:47.378907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.378909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.378911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.378921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:47.378936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:47.378937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:47.378940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:47.378941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:47.378929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2512
2025-10-02T09:34:47.378931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2512
2025-10-02T09:34:47.378944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:47.378951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:47.378984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.378991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.379001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.379012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:47.379023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:47.379040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:47.379049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.379051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.379054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:47.379062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.379073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:47.379093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.379198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.379204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.379215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.379283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2513 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0
2025-10-02T09:34:47.379502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e757d1-546898e4-1f5b9ac8-e52977aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:47.382191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Write session: try to update token
2025-10-02T09:34:47.382203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:47.391325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:47.391341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:47.391342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:47.391344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:47.391349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.391354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.391357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555527343167438:7198]
2025-10-02T09:34:47.391384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:47.391391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:47.391393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.391394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:47.391395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:47.391398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:47.391541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:47.395864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId: src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:47.398134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:47.458340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555527418738566:4103]
2025-10-02T09:34:47.458538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2512, pipe: [1:7556555527418738566:4103]
2025-10-02T09:34:47.521183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:47.521493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.521507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.521545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738566:4103], now have 1 active actors on pipe
2025-10-02T09:34:47.521810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:47.521799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:47.521806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555527418738566:4103]
2025-10-02T09:34:47.521835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:47.521837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:47.521892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2513 reason: error at write: Disconnected sessionId: src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0
2025-10-02T09:34:47.522030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2513 sessionId: src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0 is DEAD
2025-10-02T09:34:47.522155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:47.522164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Write session will restart in 0.007712s
2025-10-02T09:34:47.522183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Write session: Do CDS request
2025-10-02T09:34:47.522187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:47.528794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:47.530078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:47.530215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:47.530224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:47.530231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:47.530263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:47.530293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555527343167544:7184]
2025-10-02T09:34:47.530721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:47.530938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:47.530965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:47.531150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.531177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:47.531217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.531222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.531223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.531224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.531224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.531225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.531225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.531226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.531226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.531227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.531228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.531228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.531232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.531239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.531241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.531243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.531245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.531248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.531250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.531252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.531254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.531256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.531258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.531261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.531266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.531271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.531275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.531278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.531280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.531275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:47.531284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.531285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2514
2025-10-02T09:34:47.531286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.531289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.531292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.531295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.531298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.531301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.531304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.531307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.531309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.531312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.531314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.531317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.531320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.531324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.531326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.531331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.531334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.531337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.531358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:47.531367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.531385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:47.531392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:47.531395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:47.531676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2514 sessionId:  describe result for acl check
2025-10-02T09:34:47.531697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:47.531702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:47.531703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:47.531706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555527418738634:4250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:47.532079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555527418738634:4250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:47.533556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555527418738634:4250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:47.538481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555527418738634:4250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:47.538492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555527418738634:4250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:47.538495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555527418738634:4250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:47.538502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:47.541259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:47.542943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:47.542956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:47.542957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:47.542960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:47.542964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2513 [2:7556555527343167544:7184]
2025-10-02T09:34:47.542974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:47.542986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:47.542994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.542997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.542998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.543008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:47.543012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:47.543017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:47.543056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.543062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.543065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.543069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:47.543070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:47.543121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:47.543128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.543135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.543141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.543149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:47.543169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738567:2446], now have 1 active actors on pipe
2025-10-02T09:34:47.543177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738669:4250], now have 1 active actors on pipe
2025-10-02T09:34:47.543182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.543183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.543185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.543195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:47.543208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:47.543215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:47.543205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2513
2025-10-02T09:34:47.543212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2513
2025-10-02T09:34:47.543218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:47.543220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:47.543221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:47.543223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:47.543261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.543268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.543279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.543289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:47.543305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:47.543317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:47.543322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.543330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.543331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:47.543339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.543350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:47.543416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.543550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.543556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.543566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.543630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2514 partition: 0 MaxSeqNo: 36 sessionId: src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0
2025-10-02T09:34:47.543879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b94d2e-a35fba8-a106cc69-e9a64137_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:47.546448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Write session: try to update token
2025-10-02T09:34:47.546460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:47.555363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:47.555382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:47.555388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:47.555389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:47.555394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.555397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.555399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555527343167539:7184]
2025-10-02T09:34:47.555425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:47.555431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.555434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:47.555438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:47.555443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:47.555445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:47.555555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:47.559561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId: src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:47.561759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:47.622183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555527418738677:4103]
2025-10-02T09:34:47.622382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2513, pipe: [1:7556555527418738677:4103]
2025-10-02T09:34:47.686912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:47.687245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.687258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.687296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738677:4103], now have 1 active actors on pipe
2025-10-02T09:34:47.687516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:47.687527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555527418738677:4103]
2025-10-02T09:34:47.687549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:47.687549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:47.687551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:47.687611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2514 reason: error at write: Disconnected sessionId: src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0
2025-10-02T09:34:47.687747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2514 sessionId: src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0 is DEAD
2025-10-02T09:34:47.687881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:47.687887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Write session will restart in 0.006228s
2025-10-02T09:34:47.687902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Write session: Do CDS request
2025-10-02T09:34:47.687907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:47.694230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:47.695217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.695325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:47.695332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2515
2025-10-02T09:34:47.695429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.695449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:47.695456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:47.695458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:47.695465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:47.695603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:47.695612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:47.695619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:47.695649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:47.695682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555527343167646:7196]
2025-10-02T09:34:47.695729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2515 sessionId:  describe result for acl check
2025-10-02T09:34:47.695751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:47.695756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:47.695757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:47.695760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555527418738742:4263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:47.696100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:47.696119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555527418738742:4263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:47.696290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:47.696325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:47.696562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:47.696602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.696607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.696608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.696609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.696609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.696610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.696611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.696611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.696612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.696613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.696613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.696614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.696617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.696625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.696627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.696629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.696632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.696634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.696636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.696638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.696641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.696643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.696646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.696648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.696652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.696657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.696662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.696665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.696667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.696671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.696673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.696676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.696679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.696682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.696685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.696690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.696693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.696696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.696699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.696702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.696704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.696707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.696709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.696712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.696714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.696718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.696720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.696723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.696743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:47.697340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555527418738742:4263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:47.702841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555527418738742:4263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:47.702852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555527418738742:4263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:47.702855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555527418738742:4263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:47.702860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:47.706157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:47.707822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:47.707836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:47.707837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:47.707839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:47.707844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2514 [2:7556555527343167646:7196]
2025-10-02T09:34:47.707853Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:47.707866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:47.707873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.707877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.707878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.707890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:47.707894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:47.707904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:47.707948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.707955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.707956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.707960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:47.707961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:47.708012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:47.708019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.708026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.708032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.708041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:47.708060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738781:4263], now have 1 active actors on pipe
2025-10-02T09:34:47.708068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738678:2446], now have 1 active actors on pipe
2025-10-02T09:34:47.708072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.708074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.708075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.708076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2514
2025-10-02T09:34:47.708092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2514
2025-10-02T09:34:47.708087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:47.708101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:47.708102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:47.708105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:47.708107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:47.708114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:47.708116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:47.708149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.708156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.708167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.708175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:47.708188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:47.708201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:47.708210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.708214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.708216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:47.708225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.708237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:47.708254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.708370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.708377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.708388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.708453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2515 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0
2025-10-02T09:34:47.708736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252fa46-1e74d2ac-626b9dd2-30786e8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:47.711380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Write session: try to update token
2025-10-02T09:34:47.711395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:47.719823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:47.719839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:47.719840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:47.719841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:47.719849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.719851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.719853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555527343167641:7196]
2025-10-02T09:34:47.719882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:47.719885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:47.719888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:47.719890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.719890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:47.719892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:47.720046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:47.724428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId: src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:47.726685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:47.787536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555527418738789:4103]
2025-10-02T09:34:47.787666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2514, pipe: [1:7556555527418738789:4103]
2025-10-02T09:34:47.848152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:47.848522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.848535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.848567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738789:4103], now have 1 active actors on pipe
2025-10-02T09:34:47.848699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555527418738789:4103]
2025-10-02T09:34:47.848711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:47.848714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:47.848718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:47.848720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:47.848764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2515 reason: error at write: Disconnected sessionId: src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0
2025-10-02T09:34:47.848894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2515 sessionId: src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0 is DEAD
2025-10-02T09:34:47.849034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:47.849048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Write session will restart in 0.008605s
2025-10-02T09:34:47.849070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Write session: Do CDS request
2025-10-02T09:34:47.849075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:47.854862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:47.856031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:47.856180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:47.856189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:47.856196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:47.856228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:47.856260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555527343167762:7190]
2025-10-02T09:34:47.856678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:47.856868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:47.856897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:47.857130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:47.857186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.857192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.857192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.857193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.857194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.857194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.857195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.857196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.857197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.857197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.857199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.857200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.857203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.857209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.857212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.857214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.857216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.857218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.857220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.857223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.857225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.857229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.857231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.857234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.857238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.857243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:47.857247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.857250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:47.857254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.857257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:47.857260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.857263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:47.857266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.857268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:47.857274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.857281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:47.857284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.857287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:47.857290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.857293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:47.857296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.857299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:47.857301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.857304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.857307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.857310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.857315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.857318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.857336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:47.859155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.859213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:47.859223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2516
2025-10-02T09:34:47.859333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:47.859352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:47.859360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:47.859366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:47.859674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2516 sessionId:  describe result for acl check
2025-10-02T09:34:47.859703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:47.859704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:47.859706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:47.859710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555527418738859:4266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:47.860176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555527418738859:4266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:47.861728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555527418738859:4266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:47.865981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555527418738859:4266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:47.866000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555527418738859:4266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:47.866002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555527418738859:4266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:47.866006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:47.866609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:47.868248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:47.868262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:47.868264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:47.868269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:47.868273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2515 [2:7556555527343167762:7190]
2025-10-02T09:34:47.868283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:47.868300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:47.868302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.868304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.868305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.868316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:47.868324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:47.868329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:47.868366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.868375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.868376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.868378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:47.868381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:47.868429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:47.868436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.868443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:47.868449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:47.868458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:47.868477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738790:2446], now have 1 active actors on pipe
2025-10-02T09:34:47.868484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738894:4266], now have 1 active actors on pipe
2025-10-02T09:34:47.868489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.868491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.868492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.868479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2515
2025-10-02T09:34:47.868484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2515
2025-10-02T09:34:47.868500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:47.868515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:47.868516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:47.868518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:47.868520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:47.868528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:47.868530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:47.868545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.868552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.868582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.868593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:47.868609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:47.868610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:47.868615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:47.868617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:47.868619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:47.868627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:47.868634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:47.868663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.868795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:47.868810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:47.868819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:47.868889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2516 partition: 0 MaxSeqNo: 36 sessionId: src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0
2025-10-02T09:34:47.869073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1ac2f5-d23f22f-29c70181-7ee75cea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:47.871702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Write session: try to update token
2025-10-02T09:34:47.871712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:47.880784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:47.880798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:47.880811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:47.880812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:47.880818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.880821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.880824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555527343167757:7190]
2025-10-02T09:34:47.880853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:47.880852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:47.880856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:47.880860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:47.880861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:47.880862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:47.880979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:47.883644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId: src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:47.885763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:47.948829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555527418738929:4103]
2025-10-02T09:34:47.948972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2515, pipe: [1:7556555527418738929:4103]
2025-10-02T09:34:48.007280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.007640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.007653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.007689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555527418738929:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.007827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555527418738929:4103]
2025-10-02T09:34:48.007837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.007853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.007854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.007855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.007914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2516 reason: error at write: Disconnected sessionId: src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0
2025-10-02T09:34:48.008064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2516 sessionId: src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0 is DEAD
2025-10-02T09:34:48.008192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.008202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Write session will restart in 0.007722s
2025-10-02T09:34:48.008218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Write session: Do CDS request
2025-10-02T09:34:48.008222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.013965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.015200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.015369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.015378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.015385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.015418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.015447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135197:7172]
2025-10-02T09:34:48.016077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.016256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.016282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.016502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.016540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.016545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.016546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.016546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.016547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.016548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.016548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.016549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.016549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.016550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.016551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.016552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.016555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.016562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.016565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.016567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.016569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.016572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.016574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.016578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.016581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.016583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.016586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.016588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.016593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.016598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.016602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.016605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.016607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.016610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.016613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.016616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.016618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.016621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.016624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.016627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.016629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.016635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.016639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.016642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.016645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.016648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.016650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.016653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.016659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.016663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.016665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.016669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.016688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.017088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.017202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.017211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2517
2025-10-02T09:34:48.017319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.017336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.017342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.017344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.017593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2517 sessionId:  describe result for acl check
2025-10-02T09:34:48.017617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.017618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.017619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.017622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713706299:4308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.017921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713706299:4308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.019529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713706299:4308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.024372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713706299:4308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.024381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713706299:4308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.024383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713706299:4308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.024386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.025468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.027156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.027169Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.027170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.027173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.027177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2516 [2:7556555531638135197:7172]
2025-10-02T09:34:48.027186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.027198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.027200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.027202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.027203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.027216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.027219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.027227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.027268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.027275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.027277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.027279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.027281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.027332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.027341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.027348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.027354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.027368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.027387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706229:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.027395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706334:4308], now have 1 active actors on pipe
2025-10-02T09:34:48.027399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.027402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.027404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.027403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2516
2025-10-02T09:34:48.027409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2516
2025-10-02T09:34:48.027415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.027426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.027430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.027434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.027435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.027438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.027440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.027475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.027482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.027493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.027504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.027514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.027526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61f4d552-9def2b9d-21106796-706c2ce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.027537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.027539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.027541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.027548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.027558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.027578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.027665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.027673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.027682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.027744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2517 partition: 0 MaxSeqNo: 36 sessionId: src_id|61f4d552-9def2b9d-21106796-706c2ce5_0
2025-10-02T09:34:48.027911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b1fc2-363600b5-73e45ec2-ace93ecf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61f4d552-9def2b9d-21106796-706c2ce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.030336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Write session: try to update token
2025-10-02T09:34:48.030345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.037523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.037538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.037540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.037541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.037545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.037548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.037550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135192:7172]
2025-10-02T09:34:48.037575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.037578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.037580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.037585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.037589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.037591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.037708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:48.042954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId: src_id|61f4d552-9def2b9d-21106796-706c2ce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:48.044999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:48.108043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555531713706342:4103]
2025-10-02T09:34:48.108169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2516, pipe: [1:7556555531713706342:4103]
2025-10-02T09:34:48.166418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.166788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.166802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.166819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706342:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.166994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.167022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555531713706342:4103]
2025-10-02T09:34:48.167029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.167031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.167021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.167076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2517 reason: error at write: Disconnected sessionId: src_id|61f4d552-9def2b9d-21106796-706c2ce5_0
2025-10-02T09:34:48.167210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2517 sessionId: src_id|61f4d552-9def2b9d-21106796-706c2ce5_0 is DEAD
2025-10-02T09:34:48.167299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.167304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Write session will restart in 0.009174s
2025-10-02T09:34:48.167321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Write session: Do CDS request
2025-10-02T09:34:48.167325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.174173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.175251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.175404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.175413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.175422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.175456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.175487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135304:7155]
2025-10-02T09:34:48.175914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.176107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.176133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.176350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.176387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.176393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.176394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.176395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.176395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.176396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.176397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.176397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.176400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.176400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.176401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.176402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.176405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.176413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.176415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.176418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.176420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.176422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.176425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.176427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.176429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.176432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.176434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.176436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.176441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.176446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.176450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.176453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.176455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.176458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.176461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.176464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.176467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.176470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.176472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.176475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.176477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.176480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.176482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.176486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.176489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.176493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.176497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.176505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.176508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.176511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.176514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.176517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.176534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.177127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.177205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.177213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2518
2025-10-02T09:34:48.177290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.177308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.177314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.177316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.177682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2518 sessionId:  describe result for acl check
2025-10-02T09:34:48.177701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.177705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.177706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.177709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713706426:4307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.178020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713706426:4307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.179578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713706426:4307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.183866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713706426:4307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.183874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713706426:4307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.183876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713706426:4307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.183880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.185214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.186905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.186918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.186920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.186922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.186927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2517 [2:7556555531638135304:7155]
2025-10-02T09:34:48.186936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.186948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.186955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.186958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.186959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.186970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.186973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.186978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.187017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.187023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.187024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.187027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.187028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.187076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.187083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.187091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.187097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.187111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.187129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706460:4307], now have 1 active actors on pipe
2025-10-02T09:34:48.187136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706355:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.187142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.187143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.187144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.187154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.187154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2517
2025-10-02T09:34:48.187155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2517
2025-10-02T09:34:48.187168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.187171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.187174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.187176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.187181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.187183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.187216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.187222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.187232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.187244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.187251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.187266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b46225-4ff0672-cb2e272c-598fc49a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.187275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.187278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.187280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.187287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.187298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.187317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.187434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.187441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.187452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.187522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2518 partition: 0 MaxSeqNo: 36 sessionId: src_id|54b46225-4ff0672-cb2e272c-598fc49a_0
2025-10-02T09:34:48.187678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f4d552-9def2b9d-21106796-706c2ce5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54b46225-4ff0672-cb2e272c-598fc49a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.190216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Write session: try to update token
2025-10-02T09:34:48.190226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.197418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.197432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.197433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.197434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.197440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.197443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.197445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135299:7155]
2025-10-02T09:34:48.197468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.197473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.197476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.197477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.197479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.197479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.197611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:48.202770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId: src_id|54b46225-4ff0672-cb2e272c-598fc49a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:48.204793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:48.267286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555531713706468:4103]
2025-10-02T09:34:48.267435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2517, pipe: [1:7556555531713706468:4103]
2025-10-02T09:34:48.327564Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.327935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.327949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.327966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706468:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.328135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.328165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555531713706468:4103]
2025-10-02T09:34:48.328165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.328168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.328186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.328214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2518 reason: error at write: Disconnected sessionId: src_id|54b46225-4ff0672-cb2e272c-598fc49a_0
2025-10-02T09:34:48.328336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2518 sessionId: src_id|54b46225-4ff0672-cb2e272c-598fc49a_0 is DEAD
2025-10-02T09:34:48.328697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.328706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Write session will restart in 0.008278s
2025-10-02T09:34:48.328736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Write session: Do CDS request
2025-10-02T09:34:48.328741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.335068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.336196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.336317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.336327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.336333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.336361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.336394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135410:7167]
2025-10-02T09:34:48.336820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.337017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.337044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.337255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.337291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.337297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.337297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.337298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.337299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.337299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.337300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.337300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.337301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.337301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.337302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.337303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.337306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.337313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.337316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.337318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.337320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.337322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.337324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.337326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.337328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.337330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.337332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.337335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.337341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.337346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.337350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.337353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.337357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.337360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.337363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.337366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.337368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.337371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.337374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.337376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.337379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.337382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.337384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.337387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.337392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.337395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.337397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.337400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.337402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.337405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.337407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.337409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.337429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.338087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.338197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.338209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2519
2025-10-02T09:34:48.338301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.338321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.338327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.338329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.338607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2519 sessionId:  describe result for acl check
2025-10-02T09:34:48.338630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.338636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.338638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.338646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713706544:4314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.339035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713706544:4314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.340444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713706544:4314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.344889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713706544:4314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.344898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713706544:4314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.344900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713706544:4314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.344903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.346208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.347917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.347929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.347930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.347934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.347939Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2518 [2:7556555531638135410:7167]
2025-10-02T09:34:48.347949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.347960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.347967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.347969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.347970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.347981Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.347989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.347994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.348033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.348039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.348040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.348043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.348045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.348093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.348099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.348106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.348112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.348126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.348144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706472:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.348152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706579:4314], now have 1 active actors on pipe
2025-10-02T09:34:48.348157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.348158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.348160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.348172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.348186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.348181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2518
2025-10-02T09:34:48.348187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.348184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2518
2025-10-02T09:34:48.348190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.348192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.348198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.348200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.348220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.348228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.348234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.348243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.348246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.348288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.348297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.348300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.348302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.348309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.348319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.348337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.348433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.348440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.348451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.348516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2519 partition: 0 MaxSeqNo: 36 sessionId: src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0
2025-10-02T09:34:48.348676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b46225-4ff0672-cb2e272c-598fc49a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.351255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Write session: try to update token
2025-10-02T09:34:48.351265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.358021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.358037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.358038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.358039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.358045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.358047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.358050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135405:7167]
2025-10-02T09:34:48.358077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.358077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.358081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.358082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.358086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.358088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.358202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:48.362992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId: src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:48.365281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:48.428063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555531713706586:4103]
2025-10-02T09:34:48.428218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2518, pipe: [1:7556555531713706586:4103]
2025-10-02T09:34:48.487713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.488087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.488101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.488127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706586:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.488299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.488323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555531713706586:4103]
2025-10-02T09:34:48.488330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.488333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.488373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2519 reason: error at write: Disconnected sessionId: src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0
2025-10-02T09:34:48.488491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2519 sessionId: src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0 is DEAD
2025-10-02T09:34:48.488495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.488609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.488619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Write session will restart in 0.006167s
2025-10-02T09:34:48.488634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Write session: Do CDS request
2025-10-02T09:34:48.488639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.494910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.496114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.496137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.496231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.496237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2520
2025-10-02T09:34:48.496316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.496326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.496334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.496333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.496357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.496366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.496368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.496366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.496400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135519:7164]
2025-10-02T09:34:48.496652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2520 sessionId:  describe result for acl check
2025-10-02T09:34:48.496675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.496681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.496682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.496685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713706657:4319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.496826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.497043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713706657:4319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.497038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.497075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.497291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.497329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.497335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.497336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.497336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.497337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.497337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.497338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.497339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.497339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.497340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.497340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.497341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.497345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.497352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.497355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.497357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.497359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.497362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.497364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.497366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.497370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.497373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.497375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.497377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.497381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.497386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.497392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.497395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.497398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.497401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.497403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.497406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.497411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.497414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.497417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.497420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.497422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.497425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.497428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.497431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.497434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.497437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.497439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.497442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.497444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.497448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.497450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.497453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.497473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.498511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713706657:4319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.503898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713706657:4319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.503907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713706657:4319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.503911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713706657:4319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.503914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.506188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.507848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.507860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.507864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.507867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.507872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2519 [2:7556555531638135519:7164]
2025-10-02T09:34:48.507881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.507894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.507896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.507898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.507899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.507913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.507916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.507921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.507963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.507970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.507972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.507974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.507976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.508032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.508039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.508047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.508052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.508062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.508082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706696:4319], now have 1 active actors on pipe
2025-10-02T09:34:48.508090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706588:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.508096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.508098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.508101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.508107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2519
2025-10-02T09:34:48.508117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2519
2025-10-02T09:34:48.508115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.508128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.508133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.508137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.508138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.508139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.508141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.508158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.508167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.508180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.508183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.508186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.508217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be24005e-99bdd38b-411884f0-954206d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.508227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.508230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.508231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.508238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.508248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.508263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.508383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.508391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.508401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.508465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2520 partition: 0 MaxSeqNo: 36 sessionId: src_id|be24005e-99bdd38b-411884f0-954206d0_0
2025-10-02T09:34:48.508656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88415ca1-63cdf578-4c342a8f-f8a68926_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be24005e-99bdd38b-411884f0-954206d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.511228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Write session: try to update token
2025-10-02T09:34:48.511239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.518055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.518069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.518071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.518073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.518077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.518080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.518082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135514:7164]
2025-10-02T09:34:48.518108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.518109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.518112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.518113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.518113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.518118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.518237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:48.522494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId: src_id|be24005e-99bdd38b-411884f0-954206d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:48.524548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:48.551180Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:34:48.588333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555531713706703:4103]
2025-10-02T09:34:48.588547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2519, pipe: [1:7556555531713706703:4103]
2025-10-02T09:34:48.644914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.645225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.645240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.645273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706703:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.645448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.645478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.645489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555531713706703:4103]
2025-10-02T09:34:48.645492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.645502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.645545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2520 reason: error at write: Disconnected sessionId: src_id|be24005e-99bdd38b-411884f0-954206d0_0
2025-10-02T09:34:48.645669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2520 sessionId: src_id|be24005e-99bdd38b-411884f0-954206d0_0 is DEAD
2025-10-02T09:34:48.645801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.645811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Write session will restart in 0.005562s
2025-10-02T09:34:48.645830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Write session: Do CDS request
2025-10-02T09:34:48.645835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.651884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.652172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.652282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.652289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2521
2025-10-02T09:34:48.652379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.652399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.652404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.652406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.652666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2521 sessionId:  describe result for acl check
2025-10-02T09:34:48.652689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.652693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.652694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.652697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713706775:4346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.653058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713706775:4346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.653063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.653203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.653212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.653219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.653315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.653346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135627:7162]
2025-10-02T09:34:48.653766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.654010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.654038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.654259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.654293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.654300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.654301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.654301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.654302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.654303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.654303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.654304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.654305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.654305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.654308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.654308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.654312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.654318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.654321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.654323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.654325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.654328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.654330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.654332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.654335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.654338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.654340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.654342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.654346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.654351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.654357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.654360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.654362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.654365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.654367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.654372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.654374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.654377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.654379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.654382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.654385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.654388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.654390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.654393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.654396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.654400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.654403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.654406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.654409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.654412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.654414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.654417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.654438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.654745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713706775:4346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.660412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713706775:4346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.660419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713706775:4346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.660421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713706775:4346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.660425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.663208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.664768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.664784Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.664785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.664789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.664793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2520 [2:7556555531638135627:7162]
2025-10-02T09:34:48.664818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.664831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.664836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.664839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.664840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.664853Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.664863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.664868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.664907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.664914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.664918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.664920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.664922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.664972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.664980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.664987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.664994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.665008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.665026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706813:4346], now have 1 active actors on pipe
2025-10-02T09:34:48.665034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706705:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.665039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.665042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.665043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.665054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.665059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2520
2025-10-02T09:34:48.665066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2520
2025-10-02T09:34:48.665069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.665070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.665073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.665075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.665083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.665085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.665115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.665121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.665132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.665143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.665152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.665169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.665181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.665183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.665189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.665196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.665207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.665225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.665332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.665338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.665348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.665416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2521 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0
2025-10-02T09:34:48.665661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be24005e-99bdd38b-411884f0-954206d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.668489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Write session: try to update token
2025-10-02T09:34:48.668502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.674735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.674750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.674755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.674757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.674763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.674766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.674768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135622:7162]
2025-10-02T09:34:48.674797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.674800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.674804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.674807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.674811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.674812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.674930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:48.681447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId: src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:48.683597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:48.745474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555531713706821:4103]
2025-10-02T09:34:48.745692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2520, pipe: [1:7556555531713706821:4103]
2025-10-02T09:34:48.803208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.803537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.803550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.803568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706821:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.803739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.803751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.803761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.803770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.803805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555531713706821:4103]
2025-10-02T09:34:48.803811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2521 reason: error at write: Disconnected sessionId: src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0
2025-10-02T09:34:48.803949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2521 sessionId: src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0 is DEAD
2025-10-02T09:34:48.804101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.804114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Write session will restart in 0.009634s
2025-10-02T09:34:48.804134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Write session: Do CDS request
2025-10-02T09:34:48.804139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.811361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.813084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.813251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.813261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.813268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.813302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.813332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135736:7160]
2025-10-02T09:34:48.813757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.813965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.813992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.814207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.814243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.814249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.814249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.814250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.814251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.814251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.814252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.814253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.814253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.814254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.814255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.814255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.814260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.814267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.814270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.814272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.814274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.814276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.814279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.814281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.814283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.814285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.814288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.814290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.814294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.814299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.814303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.814307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.814309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.814312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.814315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.814318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.814320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.814324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.814326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.814329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.814333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.814336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.814338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.814341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.814345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.814348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.814351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.814354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.814357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.814360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.814362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.814364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.814386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.815197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.815301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.815308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2522
2025-10-02T09:34:48.815409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.815429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.815435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.815438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.815733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2522 sessionId:  describe result for acl check
2025-10-02T09:34:48.815752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.815756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.815757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.815760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713706899:4344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.816107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713706899:4344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.817557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713706899:4344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.821277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713706899:4344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.821286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713706899:4344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.821288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713706899:4344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.821291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.821959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.823665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.823679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.823681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.823683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.823688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2521 [2:7556555531638135736:7160]
2025-10-02T09:34:48.823697Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.823709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.823716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.823718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.823719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.823730Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.823734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.823740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.823777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.823784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.823785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.823790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.823791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.823839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.823847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.823854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.823861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.823870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.823889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706933:4344], now have 1 active actors on pipe
2025-10-02T09:34:48.823896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706823:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.823901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.823903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.823904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.823914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.823921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2521
2025-10-02T09:34:48.823923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.823932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2521
2025-10-02T09:34:48.823930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.823932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.823934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.823937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.823939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.823957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.823964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.823966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.823981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.823988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.824042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.824052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.824054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.824056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.824063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.824070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.824091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.824220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.824227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.824237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.824301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2522 partition: 0 MaxSeqNo: 36 sessionId: src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0
2025-10-02T09:34:48.824498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d78bfa-f0824a3f-709fd701-ed0b69db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.827221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Write session: try to update token
2025-10-02T09:34:48.827234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.833331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.833345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.833346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.833351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.833360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.833363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.833366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135731:7160]
2025-10-02T09:34:48.833389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.833391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.833392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.833394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.833395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.833398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.833562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:48.840998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId: src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:48.843155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:48.903690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555531713706945:4103]
2025-10-02T09:34:48.903843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2521, pipe: [1:7556555531713706945:4103]
2025-10-02T09:34:48.964875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:48.965247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.965260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.965272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706945:4103], now have 1 active actors on pipe
2025-10-02T09:34:48.965452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:48.965455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:48.965459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:48.965492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555531713706945:4103]
2025-10-02T09:34:48.965496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2522 reason: error at write: Disconnected sessionId: src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0
2025-10-02T09:34:48.965629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2522 sessionId: src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0 is DEAD
2025-10-02T09:34:48.965723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:48.965800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:48.965812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Write session will restart in 0.009196s
2025-10-02T09:34:48.965840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Write session: Do CDS request
2025-10-02T09:34:48.965846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:48.971922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:48.973195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:48.973344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:48.973354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:48.973362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:48.973400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:48.973437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555531638135882:7136]
2025-10-02T09:34:48.974151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:48.974339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:48.974368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:48.974598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:48.974636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.974642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.974643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.974644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.974644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.974645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.974645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.974646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.974646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.974647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.974648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.974648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.974652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.974659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.974662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.974664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.974666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.974669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.974671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.974673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.974675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.974678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.974680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.974682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.974687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.974691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:48.974696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.974699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:48.974701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.974705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:48.974707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.974711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:48.974713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.974717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:48.974719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.974722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:48.974725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.974728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:48.974731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.974734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:48.974736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.974739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:48.974741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.974744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.974748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.974751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.974754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.974756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.974777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:48.976159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.976244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:48.976251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2523
2025-10-02T09:34:48.976346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:48.976365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:48.976372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:48.976375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:48.976672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2523 sessionId:  describe result for acl check
2025-10-02T09:34:48.976690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:48.976695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:48.976696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:48.976699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555531713707051:4365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:48.977110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555531713707051:4365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:48.978168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555531713707051:4365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:48.981713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555531713707051:4365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:48.981721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555531713707051:4365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:48.981722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555531713707051:4365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:48.981725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:48.984501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:48.986146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:48.986159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:48.986160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:48.986163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:48.986167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2522 [2:7556555531638135882:7136]
2025-10-02T09:34:48.986176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:48.986190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:48.986192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.986196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.986200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.986211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:48.986219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:48.986224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:48.986261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.986268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.986270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.986272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:48.986274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:48.986321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:48.986328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.986335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:48.986341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:48.986350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:48.986368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713706975:2446], now have 1 active actors on pipe
2025-10-02T09:34:48.986375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555531713707083:4365], now have 1 active actors on pipe
2025-10-02T09:34:48.986380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.986382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.986384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.986397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:48.986411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:48.986411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:48.986414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:48.986416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:48.986419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:48.986420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:48.986425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2522
2025-10-02T09:34:48.986437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.986445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:48.986446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:48.986488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2522
2025-10-02T09:34:48.986554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.986562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.986582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac877596-430dbb87-340721fd-899659ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:48.986592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:48.986594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:48.986596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:48.986603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:48.986616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:48.986628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.986760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:48.986767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:48.986777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:48.986841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2523 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac877596-430dbb87-340721fd-899659ea_0
2025-10-02T09:34:48.987174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db7ec64-1d05d806-3e722251-c8dc8988_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac877596-430dbb87-340721fd-899659ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:48.996719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Write session: try to update token
2025-10-02T09:34:48.996734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:48.998047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:48.998060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:48.998064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:48.998065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:48.998071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.998074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.998077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555531638135877:7136]
2025-10-02T09:34:48.998102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:48.998104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:48.998107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:48.998110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:48.998112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:48.998113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:48.998254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.010149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId: src_id|ac877596-430dbb87-340721fd-899659ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.016413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:49.065501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555536008674386:4103]
2025-10-02T09:34:49.065735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2522, pipe: [1:7556555536008674386:4103]
2025-10-02T09:34:49.128038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:49.128380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.128393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.128410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674386:4103], now have 1 active actors on pipe
2025-10-02T09:34:49.128582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:49.128615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:49.128649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555536008674386:4103]
2025-10-02T09:34:49.128667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:49.128744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2523 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac877596-430dbb87-340721fd-899659ea_0
2025-10-02T09:34:49.128926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2523 sessionId: src_id|ac877596-430dbb87-340721fd-899659ea_0 is DEAD
2025-10-02T09:34:49.129076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:49.129087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Write session will restart in 0.005547s
2025-10-02T09:34:49.129111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Write session: Do CDS request
2025-10-02T09:34:49.129115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:49.136190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.136200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:49.136305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:49.136312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2524
2025-10-02T09:34:49.136417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.136437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:49.136445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:49.136448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:49.136712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2524 sessionId:  describe result for acl check
2025-10-02T09:34:49.136729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:49.136734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:49.136735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:49.136739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555536008674474:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:49.137029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555536008674474:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:49.138061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:49.138202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:49.138212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:49.138219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:49.138251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:49.138282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555535933103303:7134]
2025-10-02T09:34:49.138578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555536008674474:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:49.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:49.138949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:49.138978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:49.139199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:49.139237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.139237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.139238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.139238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.139239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.139240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.139241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.139242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.139243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.139243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.139244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.139245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.139248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.139255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.139258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.139261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.139263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.139266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.139268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.139271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.139273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.139276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.139279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.139281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.139285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.139290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.139294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.139298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.139301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.139304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.139307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.139310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.139312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.139315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.139318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.139321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.139324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.139328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.139331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.139334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.139338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.139341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.139344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.139347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.139349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.139352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.139355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.139358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.139377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:49.143211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555536008674474:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:49.143220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555536008674474:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:49.143222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555536008674474:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:49.143225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:49.146885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:49.148564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:49.148579Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:49.148580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:49.148583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:49.148588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2523 [2:7556555535933103303:7134]
2025-10-02T09:34:49.148596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:49.148607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:49.148609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.148612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.148615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.148627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:49.148635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:49.148640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:49.148679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.148685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.148687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.148690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:49.148691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:49.148738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:49.148746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.148752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.148758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.148767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:49.148787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674401:2446], now have 1 active actors on pipe
2025-10-02T09:34:49.148794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674512:4381], now have 1 active actors on pipe
2025-10-02T09:34:49.148798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.148812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.148814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.148824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:49.148833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:49.148838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:49.148841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:49.148843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:49.148846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:49.148839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2523
2025-10-02T09:34:49.148848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:49.148865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.148867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:49.148870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:49.148894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2523
2025-10-02T09:34:49.148946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.148954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.148973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:49.148982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.148987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.148988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:49.148996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.149008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:49.149023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.149156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.149163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.149173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.149238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2524 partition: 0 MaxSeqNo: 36 sessionId: src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0
2025-10-02T09:34:49.149419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac877596-430dbb87-340721fd-899659ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:49.152129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Write session: try to update token
2025-10-02T09:34:49.152138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:49.158597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:49.158610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:49.158612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:49.158613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:49.158619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.158623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.158625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555535933103298:7134]
2025-10-02T09:34:49.158648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:49.158650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:49.158651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.158653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:49.158653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:49.158655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:49.158782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.163815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId: src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.165805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:49.228831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555536008674520:4103]
2025-10-02T09:34:49.229051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2523, pipe: [1:7556555536008674520:4103]
2025-10-02T09:34:49.287847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:49.288175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.288187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.288204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674520:4103], now have 1 active actors on pipe
2025-10-02T09:34:49.288367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:49.288407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:49.288409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:49.288418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555536008674520:4103]
2025-10-02T09:34:49.288534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2524 reason: error at write: Disconnected sessionId: src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0
2025-10-02T09:34:49.288658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2524 sessionId: src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0 is DEAD
2025-10-02T09:34:49.288772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:49.288782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Write session will restart in 0.008993s
2025-10-02T09:34:49.288797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Write session: Do CDS request
2025-10-02T09:34:49.288821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:49.288988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:49.295108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:49.296432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:49.296556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:49.296564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:49.296571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:49.296601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:49.296632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555535933103415:7128]
2025-10-02T09:34:49.297064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:49.297264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:49.297292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:49.297507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:49.297542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.297548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.297549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.297550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.297550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.297551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.297552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.297552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.297553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.297553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.297554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.297554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.297557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.297564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.297567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.297569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.297571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.297574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.297576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.297578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.297581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.297583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.297585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.297588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.297594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.297598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.297602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.297606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.297608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.297611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.297614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.297618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.297620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.297623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.297626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.297629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.297631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.297634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.297637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.297640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.297642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.297646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.297648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.297651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.297654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.297657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.297659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.297662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.297681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:49.299197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.299231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:49.299239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2525
2025-10-02T09:34:49.299449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.299470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:49.299473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:49.299475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:49.299755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2525 sessionId:  describe result for acl check
2025-10-02T09:34:49.299777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:49.299781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:49.299783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:49.299785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555536008674602:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:49.300129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555536008674602:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:49.301474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555536008674602:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:49.304502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555536008674602:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:49.304511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555536008674602:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:49.304513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555536008674602:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:49.304517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:49.305181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:49.306814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:49.306828Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:49.306830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:49.306833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:49.306838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2524 [2:7556555535933103415:7128]
2025-10-02T09:34:49.306851Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:49.306867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:49.306869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.306871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.306873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.306885Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:49.306893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:49.306898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:49.306941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.306947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.306948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.306951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:49.306953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:49.306999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:49.307006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.307013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.307019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.307028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:49.307046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674636:4379], now have 1 active actors on pipe
2025-10-02T09:34:49.307054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674524:2446], now have 1 active actors on pipe
2025-10-02T09:34:49.307058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.307060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.307061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.307069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:49.307079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:49.307085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:49.307087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:49.307089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:49.307093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:49.307103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2524
2025-10-02T09:34:49.307095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:49.307113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.307116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:49.307122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2524
2025-10-02T09:34:49.307131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:49.307179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.307190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.307209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:49.307219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.307224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.307226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:49.307232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.307246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:49.307258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.307403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.307412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.307430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.307499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2525 partition: 0 MaxSeqNo: 36 sessionId: src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0
2025-10-02T09:34:49.307676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be2f727-daea8b3e-ee4ee9cb-d1f9ed9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:49.310260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Write session: try to update token
2025-10-02T09:34:49.310270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:49.316617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:49.316632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:49.316634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:49.316636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:49.316641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.316644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.316647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555535933103410:7128]
2025-10-02T09:34:49.316672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:49.316676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.316676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:49.316678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:49.316679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:49.316681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:49.316839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.322644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId: src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.324655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:49.388573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555536008674644:4103]
2025-10-02T09:34:49.388827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2524, pipe: [1:7556555536008674644:4103]
2025-10-02T09:34:49.443047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:49.443446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.443459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.443477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674644:4103], now have 1 active actors on pipe
2025-10-02T09:34:49.443603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:49.443641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555536008674644:4103]
2025-10-02T09:34:49.443635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:49.443675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:49.443688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:49.443751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2525 reason: error at write: Disconnected sessionId: src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0
2025-10-02T09:34:49.443901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2525 sessionId: src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0 is DEAD
2025-10-02T09:34:49.444008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:49.444017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Write session will restart in 0.007046s
2025-10-02T09:34:49.444045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Write session: Do CDS request
2025-10-02T09:34:49.444050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:49.449982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:49.451240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:49.451361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:49.451370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:49.451377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:49.451406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:49.451437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555535933103530:7130]
2025-10-02T09:34:49.451841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:49.452032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:49.452059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:49.452107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.452181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:49.452188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2526
2025-10-02T09:34:49.452258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.452278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:49.452286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:49.452268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:49.452289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:49.452303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.452309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.452310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.452310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.452311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.452312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.452312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.452313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.452313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.452314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.452315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.452315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.452318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.452325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.452328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.452330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.452332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.452334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.452336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.452338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.452341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.452343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.452345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.452347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.452353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.452358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.452362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.452365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.452367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.452371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.452373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.452376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.452378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.452381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.452384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.452388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.452390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.452393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.452395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.452398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.452401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.452404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.452406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.452408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.452411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.452413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.452416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.452419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.452436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:49.452655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2526 sessionId:  describe result for acl check
2025-10-02T09:34:49.452693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:49.452699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:49.452701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:49.452706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555536008674725:4396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:49.453237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555536008674725:4396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:49.454544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555536008674725:4396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:49.458751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555536008674725:4396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:49.458760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555536008674725:4396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:49.458762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555536008674725:4396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:49.458766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:49.460019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:49.461707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:49.461721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:49.461722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:49.461725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:49.461729Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2525 [2:7556555535933103530:7130]
2025-10-02T09:34:49.461738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:49.461751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:49.461758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.461761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.461762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.461774Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:49.461781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:49.461785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:49.461826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.461832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.461833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.461836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:49.461838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:49.461884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:49.461892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.461900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.461905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.461917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:49.461936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674759:4396], now have 1 active actors on pipe
2025-10-02T09:34:49.461943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674646:2446], now have 1 active actors on pipe
2025-10-02T09:34:49.461948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.461949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.461951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.461962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:49.461970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:49.461976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:49.461979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:49.461980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:49.461976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2525
2025-10-02T09:34:49.461983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:49.461985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:49.462008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.462017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:49.462021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:49.462010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2525
2025-10-02T09:34:49.462041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.462048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.462071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bbde38a-19529f17-a31138ba-f36b486b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:49.462080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.462083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.462084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:49.462091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.462103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:49.462123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.462244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.462251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.462260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.462319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2526 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bbde38a-19529f17-a31138ba-f36b486b_0
2025-10-02T09:34:49.462536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af59f923-f9f1d749-e899fb9e-5de3733b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bbde38a-19529f17-a31138ba-f36b486b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:49.465350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Write session: try to update token
2025-10-02T09:34:49.465368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:49.471400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:49.471418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:49.471419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:49.471422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:49.471431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.471433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.471436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555535933103525:7130]
2025-10-02T09:34:49.471467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:49.471470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:49.471473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:49.471476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.471477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:49.471478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:49.471600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.478655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId: src_id|3bbde38a-19529f17-a31138ba-f36b486b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.480841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:49.543719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555536008674767:4103]
2025-10-02T09:34:49.543949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2525, pipe: [1:7556555536008674767:4103]
2025-10-02T09:34:49.597257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:49.597646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.597658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.597675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674767:4103], now have 1 active actors on pipe
2025-10-02T09:34:49.597839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:49.597865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:49.597867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555536008674767:4103]
2025-10-02T09:34:49.597889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:49.597951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3bbde38a-19529f17-a31138ba-f36b486b_0
2025-10-02T09:34:49.598083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2526 sessionId: src_id|3bbde38a-19529f17-a31138ba-f36b486b_0 is DEAD
2025-10-02T09:34:49.598207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:49.598214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Write session will restart in 0.009565s
2025-10-02T09:34:49.598230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Write session: Do CDS request
2025-10-02T09:34:49.598234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:49.605206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:49.606352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:49.606541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:49.606552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:49.606560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:49.606596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:49.606623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555535933103644:7126]
2025-10-02T09:34:49.607033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:49.607229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:49.607254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:49.607476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:49.607511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.607516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.607517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.607517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.607518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.607518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.607519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.607520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.607520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.607521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.607521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.607522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.607525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.607531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.607534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.607536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.607538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.607541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.607543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.607545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.607548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.607550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.607552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.607554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.607559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.607563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.607569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.607573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.607575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.607578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.607580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.607583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.607585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.607588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.607591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.607593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.607596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.607599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.607602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.607605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.607607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.607610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.607612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.607616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.607618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.607621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.607623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.607626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.607643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:49.609186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.609269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:49.609277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2527
2025-10-02T09:34:49.609396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.609416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:49.609423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:49.609425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:49.609690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2527 sessionId:  describe result for acl check
2025-10-02T09:34:49.609714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:49.609718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:49.609719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:49.609722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555536008674849:4405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:49.610094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555536008674849:4405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:49.611639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555536008674849:4405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:49.614587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555536008674849:4405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:49.614595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555536008674849:4405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:49.614597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555536008674849:4405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:49.614600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:49.615269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:49.616910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:49.616922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:49.616924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:49.616926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:49.616931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2526 [2:7556555535933103644:7126]
2025-10-02T09:34:49.616939Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:49.616950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:49.616957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.616959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.616961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.616972Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:49.616980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:49.616986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:49.617030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.617036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.617038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.617040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:49.617042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:49.617093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:49.617102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.617110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.617120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.617130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:49.617149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674768:2446], now have 1 active actors on pipe
2025-10-02T09:34:49.617156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674883:4405], now have 1 active actors on pipe
2025-10-02T09:34:49.617161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.617162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.617164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.617173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:49.617186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:49.617186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:49.617189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:49.617191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:49.617199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:49.617201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:49.617195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2526
2025-10-02T09:34:49.617203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2526
2025-10-02T09:34:49.617219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.617226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:49.617228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:49.617239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.617246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.617308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5ebba90-d04b868d-e55e3185-71baf188_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:49.617319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.617322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.617323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:49.617331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.617342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:49.617364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.617484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.617492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.617503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.617572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2527 partition: 0 MaxSeqNo: 36 sessionId: src_id|f5ebba90-d04b868d-e55e3185-71baf188_0
2025-10-02T09:34:49.617857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bbde38a-19529f17-a31138ba-f36b486b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f5ebba90-d04b868d-e55e3185-71baf188_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:49.620557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Write session: try to update token
2025-10-02T09:34:49.620570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:49.626596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:49.626609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:49.626610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:49.626611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:49.626617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.626620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.626623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555535933103639:7126]
2025-10-02T09:34:49.626645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:49.626647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:49.626651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:49.626653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.626653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:49.626655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:49.626774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.632195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId: src_id|f5ebba90-d04b868d-e55e3185-71baf188_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.634217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:49.697824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555536008674892:4103]
2025-10-02T09:34:49.698046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2526, pipe: [1:7556555536008674892:4103]
2025-10-02T09:34:49.755667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:49.755975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.755987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.756004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674892:4103], now have 1 active actors on pipe
2025-10-02T09:34:49.756138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:49.756146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:49.756151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:49.756179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555536008674892:4103]
2025-10-02T09:34:49.756187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2527 reason: error at write: Disconnected sessionId: src_id|f5ebba90-d04b868d-e55e3185-71baf188_0
2025-10-02T09:34:49.756189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:49.756312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2527 sessionId: src_id|f5ebba90-d04b868d-e55e3185-71baf188_0 is DEAD
2025-10-02T09:34:49.756442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:49.756451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Write session will restart in 0.005969s
2025-10-02T09:34:49.756469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Write session: Do CDS request
2025-10-02T09:34:49.756474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:49.762980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:49.763096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.763154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:49.763161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2528
2025-10-02T09:34:49.763244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.763264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:49.763270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:49.763272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:49.763528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2528 sessionId:  describe result for acl check
2025-10-02T09:34:49.763549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:49.763553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:49.763554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:49.763557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555536008674973:4417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:49.763909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555536008674973:4417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:49.764165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:49.764309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:49.764318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:49.764326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:49.764359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:49.764448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555535933103760:7121]
2025-10-02T09:34:49.764934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:49.765105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:49.765132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:49.765241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555536008674973:4417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:49.765342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:49.765379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.765385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.765385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.765386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.765387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.765387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.765388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.765389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.765389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.765390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.765390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.765391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.765394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.765401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.765403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.765405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.765407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.765410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.765412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.765414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.765416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.765418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.765421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.765423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.765428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.765433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.765437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.765440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.765443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.765446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.765448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.765451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.765455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.765457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.765460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.765463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.765465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.765468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.765470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.765474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.765477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.765480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.765482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.765485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.765488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.765490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.765492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.765495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.765514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:49.769328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555536008674973:4417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:49.769336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555536008674973:4417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:49.769338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555536008674973:4417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:49.769341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:49.773064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:49.774616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:49.774630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:49.774631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:49.774634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:49.774638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2527 [2:7556555535933103760:7121]
2025-10-02T09:34:49.774647Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:49.774660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:49.774664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.774666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.774667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.774678Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:49.774686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:49.774691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:49.774731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.774738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.774740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.774742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:49.774744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:49.774789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:49.774795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.774804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.774809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.774818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:49.774836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008675012:4417], now have 1 active actors on pipe
2025-10-02T09:34:49.774844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008674896:2446], now have 1 active actors on pipe
2025-10-02T09:34:49.774849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.774850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.774852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.774863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:49.774869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2527
2025-10-02T09:34:49.774876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2527
2025-10-02T09:34:49.774872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:49.774878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:49.774880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:49.774881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:49.774885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:49.774886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:49.774902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.774904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:49.774906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:49.774917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.774924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.774958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|956225a3-410e0273-cd43566a-b96ee526_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:49.774968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.774971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.774972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:49.774980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.774990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:49.775003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.775112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.775120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.775131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.775196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2528 partition: 0 MaxSeqNo: 36 sessionId: src_id|956225a3-410e0273-cd43566a-b96ee526_0
2025-10-02T09:34:49.775395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ebba90-d04b868d-e55e3185-71baf188_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|956225a3-410e0273-cd43566a-b96ee526_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:49.778175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Write session: try to update token
2025-10-02T09:34:49.778188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:49.784284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:49.784301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:49.784303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:49.784304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:49.784310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.784313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.784316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555535933103755:7121]
2025-10-02T09:34:49.784342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:49.784345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.784347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:49.784348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:49.784352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:49.784355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:49.784464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.790773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId: src_id|956225a3-410e0273-cd43566a-b96ee526_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.792865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:49.856537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555536008675021:4103]
2025-10-02T09:34:49.856703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2527, pipe: [1:7556555536008675021:4103]
2025-10-02T09:34:49.911247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:49.911710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.911723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.911740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008675021:4103], now have 1 active actors on pipe
2025-10-02T09:34:49.911869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:49.911889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:49.911872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555536008675021:4103]
2025-10-02T09:34:49.911889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:49.911890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:49.911929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2528 reason: error at write: Disconnected sessionId: src_id|956225a3-410e0273-cd43566a-b96ee526_0
2025-10-02T09:34:49.912051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2528 sessionId: src_id|956225a3-410e0273-cd43566a-b96ee526_0 is DEAD
2025-10-02T09:34:49.912160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:49.912168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Write session will restart in 0.006438s
2025-10-02T09:34:49.912181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Write session: Do CDS request
2025-10-02T09:34:49.912186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:49.918741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:49.919184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.919343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:49.919349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2529
2025-10-02T09:34:49.919428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:49.919446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:49.919451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:49.919454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:49.919695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2529 sessionId:  describe result for acl check
2025-10-02T09:34:49.919714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:49.919718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:49.919719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:49.919722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555536008675107:4429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:49.920004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555536008675107:4429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:49.920011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:49.920135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:49.920144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:49.920152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:49.920183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:49.920287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555535933103887:7110]
2025-10-02T09:34:49.920717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:49.921007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:49.921042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:49.921275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:49.921312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.921318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.921318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.921319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.921320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.921320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.921321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.921322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.921322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.921323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.921323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.921324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.921328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.921335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.921359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555536008675107:4429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:49.921337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.921339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.921342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.921344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.921346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.921348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.921351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.921353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.921355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.921358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.921362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.921366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:49.921371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.921374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:49.921376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.921379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:49.921382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.921385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:49.921388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.921391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:49.921394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.921397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:49.921399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.921403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:49.921405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.921410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:49.921412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.921415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:49.921418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.921421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.921423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.921426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.921430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.921433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.921453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:49.925198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555536008675107:4429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:49.925205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555536008675107:4429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:49.925209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555536008675107:4429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:49.925212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:49.928938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:49.930555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:49.930567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:49.930569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:49.930572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:49.930577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2528 [2:7556555535933103887:7110]
2025-10-02T09:34:49.930585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:49.930598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:49.930600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.930602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.930603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.930615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:49.930618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:49.930623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:49.930661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.930669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.930671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.930673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:49.930675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:49.930720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:49.930727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.930734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:49.930740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:49.930749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:49.930768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008675146:4429], now have 1 active actors on pipe
2025-10-02T09:34:49.930776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555536008675029:2446], now have 1 active actors on pipe
2025-10-02T09:34:49.930781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.930782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.930784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.930793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:49.930803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:49.930809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:49.930811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:49.930802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2528
2025-10-02T09:34:49.930812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:49.930816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:49.930818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:49.930821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2528
2025-10-02T09:34:49.930846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.930852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.930863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.930869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:49.930877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:49.930895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:49.930903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:49.930908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:49.930909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:49.930916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:49.930929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:49.930946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.931054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:49.931061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:49.931071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:49.931134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2529 partition: 0 MaxSeqNo: 36 sessionId: src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0
2025-10-02T09:34:49.931343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956225a3-410e0273-cd43566a-b96ee526_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:49.934226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Write session: try to update token
2025-10-02T09:34:49.934242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:49.940249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:49.940265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:49.940267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:49.940268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:49.940275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.940279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.940281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555535933103882:7110]
2025-10-02T09:34:49.940310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:49.940313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:49.940315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:49.940317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:49.940317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:49.940322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:49.940439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:49.947110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId: src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:49.949881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.012188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303642475:4103]
2025-10-02T09:34:50.012362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2528, pipe: [1:7556555540303642475:4103]
2025-10-02T09:34:50.069138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:50.069517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.069531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.069549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642475:4103], now have 1 active actors on pipe
2025-10-02T09:34:50.069717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:50.069722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303642475:4103]
2025-10-02T09:34:50.069729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:50.069732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:50.069745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:50.069780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2529 reason: error at write: Disconnected sessionId: src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0
2025-10-02T09:34:50.069885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2529 sessionId: src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0 is DEAD
2025-10-02T09:34:50.070009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:50.070022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Write session will restart in 0.005859s
2025-10-02T09:34:50.070047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Write session: Do CDS request
2025-10-02T09:34:50.070052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:50.077027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:50.077155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.077192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:50.077200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2530
2025-10-02T09:34:50.077273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.077292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:50.077298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:50.077301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:50.077568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2530 sessionId:  describe result for acl check
2025-10-02T09:34:50.077589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:50.077593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:50.077594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:50.077599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555540303642555:4456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:50.077919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555540303642555:4456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:50.078180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:50.078380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:50.078390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:50.078398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:50.078435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:50.078466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555540228071337:7092]
2025-10-02T09:34:50.078909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:50.079078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555540303642555:4456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:50.079093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:50.079126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:50.079375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:50.079423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.079429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.079430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.079430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.079431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.079432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.079433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.079434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.079434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.079435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.079436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.079437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.079440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.079447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.079449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.079452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.079454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.079457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.079460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.079462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.079464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.079467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.079469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.079472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.079477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.079482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.079487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.079490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.079493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.079496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.079500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.079505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.079508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.079512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.079514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.079517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.079520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.079523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.079526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.079529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.079532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.079535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.079538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.079540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.079544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.079547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.079550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.079553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.079576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:50.083521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555540303642555:4456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:50.083529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555540303642555:4456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:50.083531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555540303642555:4456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:50.083534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:50.087056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:50.088640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:50.088654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:50.088655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:50.088658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:50.088663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2529 [2:7556555540228071337:7092]
2025-10-02T09:34:50.088672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:50.088684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:50.088691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.088693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.088695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.088707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:50.088715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:50.088720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:50.088758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.088766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.088767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.088770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:50.088774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:50.088834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:50.088841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.088848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.088854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.088863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:50.088882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642594:4456], now have 1 active actors on pipe
2025-10-02T09:34:50.088890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642476:2446], now have 1 active actors on pipe
2025-10-02T09:34:50.088894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.088897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.088898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.088887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2529
2025-10-02T09:34:50.088891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2529
2025-10-02T09:34:50.088912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:50.088923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:50.088925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:50.088933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:50.088933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:50.088934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:50.088935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:50.088966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.088973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.088983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.088993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:50.089003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:50.089014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:50.089019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.089026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.089028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:50.089035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.089046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:50.089064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.089167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.089174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.089185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.089251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2530 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0
2025-10-02T09:34:50.089450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27aca3-9722405d-f4cb0dca-e77b650c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:50.092134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Write session: try to update token
2025-10-02T09:34:50.092146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:50.098276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:50.098294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.098296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:50.098297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:50.098306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.098309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.098312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555540228071332:7092]
2025-10-02T09:34:50.098336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:50.098340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:50.098344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.098345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:50.098348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:50.098350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:50.098479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:50.105012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId: src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:50.107170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.169881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303642614:4103]
2025-10-02T09:34:50.170097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2529, pipe: [1:7556555540303642614:4103]
2025-10-02T09:34:50.215718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:50.215985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.215995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.216007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642614:4103], now have 1 active actors on pipe
2025-10-02T09:34:50.216191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:50.216228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:50.216239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:50.216288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2530 reason: error at write: Disconnected sessionId: src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0
2025-10-02T09:34:50.216334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303642614:4103]
2025-10-02T09:34:50.216354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:50.216424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2530 sessionId: src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0 is DEAD
2025-10-02T09:34:50.216548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:50.216557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Write session will restart in 0.009436s
2025-10-02T09:34:50.216574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Write session: Do CDS request
2025-10-02T09:34:50.216578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:50.223500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:50.224690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:50.224862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:50.224873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:50.224881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:50.224917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:50.224950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555540228071455:7089]
2025-10-02T09:34:50.225407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:50.225604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:50.225645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:50.225872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:50.225917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.225925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.225925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.225926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.225927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.225927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.225928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.225929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.225930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.225930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.225931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.225931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.225934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.225941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.225944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.225946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.225948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.225951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.225953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.225956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.225958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.225960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.225962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.225965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.225969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.225975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.225979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.225982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.225985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.225988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.225990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.225993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.225996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.225999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.226002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.226005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.226008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.226011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.226014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.226017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.226019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.226024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.226026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.226029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.226031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.226034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.226038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.226041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.226061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:50.227140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.227222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:50.227233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2531
2025-10-02T09:34:50.227310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.227328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:50.227335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:50.227337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:50.227593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2531 sessionId:  describe result for acl check
2025-10-02T09:34:50.227615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:50.227620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:50.227621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:50.227624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555540303642699:4470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:50.227974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555540303642699:4470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:50.229076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555540303642699:4470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:50.232889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555540303642699:4470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:50.232897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555540303642699:4470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:50.232899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555540303642699:4470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:50.232902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:50.233684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:50.235563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:50.235580Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:50.235582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:50.235585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:50.235591Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2530 [2:7556555540228071455:7089]
2025-10-02T09:34:50.235605Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:50.235630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:50.235638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.235640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.235642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.235654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:50.235663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:50.235668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:50.235715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.235723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.235724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.235727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:50.235729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:50.235785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:50.235794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.235802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.235808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.235818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:50.235838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642615:2446], now have 1 active actors on pipe
2025-10-02T09:34:50.235847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642734:4470], now have 1 active actors on pipe
2025-10-02T09:34:50.235853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.235856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.235858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.235851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2530
2025-10-02T09:34:50.235852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2530
2025-10-02T09:34:50.235878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:50.235891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:50.235893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:50.235894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:50.235895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:50.235903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:50.235910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:50.235948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.235955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.235966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.235976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:50.235986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:50.236003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d24deda4-4df05e32-442d86a4-2756df1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:50.236013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.236016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.236018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:50.236026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.236039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:50.236062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.236188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.236198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.236212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.236291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2531 partition: 0 MaxSeqNo: 36 sessionId: src_id|d24deda4-4df05e32-442d86a4-2756df1b_0
2025-10-02T09:34:50.236518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb693916-8ff81aa0-d1598270-fdd4dd75_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d24deda4-4df05e32-442d86a4-2756df1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:50.239291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Write session: try to update token
2025-10-02T09:34:50.239309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:50.245613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:50.245632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.245634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:50.245636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:50.245643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.245647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.245650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555540228071450:7089]
2025-10-02T09:34:50.245691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:50.245705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.245707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:50.245708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:50.245710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:50.245718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:50.245882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:50.253105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId: src_id|d24deda4-4df05e32-442d86a4-2756df1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:50.255183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.316306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303642744:4103]
2025-10-02T09:34:50.316535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2530, pipe: [1:7556555540303642744:4103]
2025-10-02T09:34:50.374056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:50.374402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.374416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.374434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642744:4103], now have 1 active actors on pipe
2025-10-02T09:34:50.374611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:50.374619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:50.374622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:50.374641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303642744:4103]
2025-10-02T09:34:50.374667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2531 reason: error at write: Disconnected sessionId: src_id|d24deda4-4df05e32-442d86a4-2756df1b_0
2025-10-02T09:34:50.374718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:50.374789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2531 sessionId: src_id|d24deda4-4df05e32-442d86a4-2756df1b_0 is DEAD
2025-10-02T09:34:50.374948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:50.374961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Write session will restart in 0.005754s
2025-10-02T09:34:50.374993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Write session: Do CDS request
2025-10-02T09:34:50.374999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:50.382139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.382189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:50.382191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:50.382196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2532
2025-10-02T09:34:50.382278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.382298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:50.382304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:50.382307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:50.382566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2532 sessionId:  describe result for acl check
2025-10-02T09:34:50.382586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:50.382590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:50.382591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:50.382594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555540303642829:4487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:50.382922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555540303642829:4487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:50.383437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:50.383593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:50.383602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:50.383610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:50.383647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:50.383677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555540228071576:7069]
2025-10-02T09:34:50.384094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:50.384294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555540303642829:4487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:50.384311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:50.384342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:50.384561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:50.384601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.384607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.384608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.384608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.384609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.384610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.384610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.384611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.384612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.384612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.384613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.384614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.384617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.384624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.384626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.384629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.384631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.384634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.384636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.384639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.384641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.384643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.384646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.384648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.384653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.384657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.384662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.384665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.384668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.384671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.384673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.384676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.384679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.384682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.384685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.384688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.384691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.384694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.384697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.384700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.384703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.384706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.384708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.384711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.384714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.384717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.384721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.384725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.384745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:50.389690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555540303642829:4487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:50.389700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555540303642829:4487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:50.389702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555540303642829:4487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:50.389705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:50.392566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:50.396915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:50.396934Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:50.396938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:50.396941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:50.396946Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2531 [2:7556555540228071576:7069]
2025-10-02T09:34:50.396959Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:50.396990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:50.396993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.396997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.397000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.397012Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:50.397022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:50.397029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:50.397124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.397131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.397134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.397137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:50.397139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:50.397305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2531
2025-10-02T09:34:50.397310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2531
2025-10-02T09:34:50.397427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:50.397437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.397445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.397451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.397461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:50.397482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642748:2446], now have 1 active actors on pipe
2025-10-02T09:34:50.397491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642868:4487], now have 1 active actors on pipe
2025-10-02T09:34:50.397505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.397513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.397527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.397535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.397538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.397550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:50.397567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:50.397573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:50.397576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:50.397578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:50.397588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:50.397591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:50.397615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4688fda0-11f0b87f-a0673b6-34e24550_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:50.397631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.397637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.397643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:50.397651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.397665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:50.397710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.397722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:50.397733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.397738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:50.397871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.397882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.397898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.397973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2532 partition: 0 MaxSeqNo: 36 sessionId: src_id|4688fda0-11f0b87f-a0673b6-34e24550_0
2025-10-02T09:34:50.398281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24deda4-4df05e32-442d86a4-2756df1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4688fda0-11f0b87f-a0673b6-34e24550_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:50.400839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Write session: try to update token
2025-10-02T09:34:50.400852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:50.407228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:50.407242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.407249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.407286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:50.407298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:50.407634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:50.407768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:50.407895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:50.408025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:50.408290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:50.408321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:50.417178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:50.417194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.417196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:50.417198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:50.417205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.417208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.417211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555540228071571:7069]
2025-10-02T09:34:50.417249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:50.417261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:50.417263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.417265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:50.417266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:50.417269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:50.417549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:50.418892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId: src_id|4688fda0-11f0b87f-a0673b6-34e24550_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:50.421092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.475023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303642875:4103]
2025-10-02T09:34:50.475251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2531, pipe: [1:7556555540303642875:4103]
2025-10-02T09:34:50.547520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:50.547852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.547866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.547885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642875:4103], now have 1 active actors on pipe
2025-10-02T09:34:50.548087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:50.548100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:50.548122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303642875:4103]
2025-10-02T09:34:50.548140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2532 reason: error at write: Disconnected sessionId: src_id|4688fda0-11f0b87f-a0673b6-34e24550_0
2025-10-02T09:34:50.548141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:50.548189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:50.548261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2532 sessionId: src_id|4688fda0-11f0b87f-a0673b6-34e24550_0 is DEAD
2025-10-02T09:34:50.548383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:50.548389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Write session will restart in 0.005313s
2025-10-02T09:34:50.548411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Write session: Do CDS request
2025-10-02T09:34:50.548415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:50.555226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.555299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:50.555308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2533
2025-10-02T09:34:50.555417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.555436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:50.555442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:50.555444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:50.555714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2533 sessionId:  describe result for acl check
2025-10-02T09:34:50.555738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:50.555742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:50.555743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:50.555746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555540303642957:4490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:50.556103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555540303642957:4490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:50.556549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:50.557375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555540303642957:4490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:50.558704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:50.558843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:50.558853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:50.558860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:50.558893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:50.558927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555540228071696:7082]
2025-10-02T09:34:50.559328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555540303642957:4490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:50.559335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555540303642957:4490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:50.559337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555540303642957:4490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:50.559340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:50.559357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:50.559563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:50.559596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:50.559831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:50.559870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.559877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.559878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.559879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.559880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.559880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.559881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.559881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.559882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.559883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.559883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.559884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.559887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.559895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.559897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.559900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.559902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.559905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.559907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.559910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.559912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.559915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.559917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.559919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.559925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.559929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.559934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.559937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.559940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.559943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.559947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.559950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.559952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.559955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.559958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.559961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.559964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.559967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.559970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.559973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.559977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.559980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.559982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.559985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.559990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.559993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.559995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.559998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.560017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:50.567633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:50.569392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:50.569407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:50.569409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:50.569411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:50.569416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2532 [2:7556555540228071696:7082]
2025-10-02T09:34:50.569425Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:50.569437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:50.569444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.569446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.569448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.569460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:50.569463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:50.569468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:50.569508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.569515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.569516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.569519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:50.569520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:50.569581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:50.569591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.569602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.569612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.569632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:50.569656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642877:2446], now have 1 active actors on pipe
2025-10-02T09:34:50.569665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303642994:4490], now have 1 active actors on pipe
2025-10-02T09:34:50.569663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2532
2025-10-02T09:34:50.569671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.569672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2532
2025-10-02T09:34:50.569673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.569675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.569691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:50.569707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:50.569708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:50.569716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:50.569718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:50.569721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:50.569724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:50.569758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.569768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.569778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.569788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:50.569802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:50.569822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:50.569833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.569841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.569843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:50.569853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.569867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:50.569891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.569999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.570009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.570022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.570101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2533 partition: 0 MaxSeqNo: 36 sessionId: src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0
2025-10-02T09:34:50.570324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4688fda0-11f0b87f-a0673b6-34e24550_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:50.573011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Write session: try to update token
2025-10-02T09:34:50.573021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:50.579266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:50.579281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.579282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:50.579284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:50.579288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.579295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.579298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555540228071691:7082]
2025-10-02T09:34:50.579330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:50.579341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.579344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:50.579345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:50.579348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:50.579352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:50.579521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:50.586756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId: src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:50.588857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.648083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303643006:4103]
2025-10-02T09:34:50.648345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2532, pipe: [1:7556555540303643006:4103]
2025-10-02T09:34:50.710192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:50.710602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.710617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.710634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643006:4103], now have 1 active actors on pipe
2025-10-02T09:34:50.710817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:50.710828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:50.710873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2533 reason: error at write: Disconnected sessionId: src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0
2025-10-02T09:34:50.710901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:50.710900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:50.710933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303643006:4103]
2025-10-02T09:34:50.711003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2533 sessionId: src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0 is DEAD
2025-10-02T09:34:50.711150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:50.711164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Write session will restart in 0.005507s
2025-10-02T09:34:50.711180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Write session: Do CDS request
2025-10-02T09:34:50.711185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:50.717105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.717342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:50.717350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2534
2025-10-02T09:34:50.717455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.717478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:50.717484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:50.717486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:50.717784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2534 sessionId:  describe result for acl check
2025-10-02T09:34:50.717803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:50.717808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:50.717809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:50.717812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555540303643088:4495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:50.718156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555540303643088:4495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:50.718583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:50.719737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555540303643088:4495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:50.720088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:50.720228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:50.720237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:50.720245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:50.720277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:50.720309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555540228071817:7080]
2025-10-02T09:34:50.720741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:50.720982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:50.721015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:50.721247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:50.721285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.721292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.721292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.721293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.721294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.721294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.721295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.721296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.721296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.721297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.721297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.721298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.721301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.721308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.721310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.721313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.721315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.721317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.721319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.721322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.721324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.721326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.721329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.721331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.721336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.721341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.721345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.721349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.721351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.721354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.721356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.721359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.721362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.721365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.721367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.721370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.721373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.721376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.721379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.721382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.721386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.721389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.721392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.721395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.721399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.721402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.721404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.721407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.721427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:50.721607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555540303643088:4495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:50.721614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555540303643088:4495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:50.721616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555540303643088:4495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:50.721619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:50.728931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:50.730574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:50.730588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:50.730589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:50.730593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:50.730597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2533 [2:7556555540228071817:7080]
2025-10-02T09:34:50.730609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:50.730621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:50.730623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.730625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.730627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.730640Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:50.730649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:50.730654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:50.730698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.730706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.730707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.730710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:50.730712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:50.730770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:50.730780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.730791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.730801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.730822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:50.730847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643129:4495], now have 1 active actors on pipe
2025-10-02T09:34:50.730856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643008:2446], now have 1 active actors on pipe
2025-10-02T09:34:50.730860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.730864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.730866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.730860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2533
2025-10-02T09:34:50.730880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:50.730884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2533
2025-10-02T09:34:50.730897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:50.730897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:50.730900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:50.730901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:50.730914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:50.730917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:50.730951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.730961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.730973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.730986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:50.731005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:50.731017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:50.731024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.731034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.731035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:50.731047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.731061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:50.731085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.731206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.731216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.731230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.731314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2534 partition: 0 MaxSeqNo: 36 sessionId: src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0
2025-10-02T09:34:50.731502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40f8d5a-a519ae11-76e16fc0-bc63914d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:50.734065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Write session: try to update token
2025-10-02T09:34:50.734076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:50.740587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:50.740603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.740605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:50.740606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:50.740614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.740618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.740620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555540228071812:7080]
2025-10-02T09:34:50.740652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:50.740662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.740665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:50.740671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:50.740685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:50.740688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:50.740837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:50.746700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId: src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:50.748887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.810898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303643137:4103]
2025-10-02T09:34:50.811141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2533, pipe: [1:7556555540303643137:4103]
2025-10-02T09:34:50.871515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:50.871841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.871857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.871870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643137:4103], now have 1 active actors on pipe
2025-10-02T09:34:50.872242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:50.872251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:50.872291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2534 reason: error at write: Disconnected sessionId: src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0
2025-10-02T09:34:50.872327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:50.872432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2534 sessionId: src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0 is DEAD
2025-10-02T09:34:50.872545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:50.872550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Write session will restart in 0.006518s
2025-10-02T09:34:50.872566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Write session: Do CDS request
2025-10-02T09:34:50.872571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:50.872596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303643137:4103]
2025-10-02T09:34:50.872611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:50.879869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:50.880186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.880290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:50.880300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2535
2025-10-02T09:34:50.880414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:50.880434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:50.880440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:50.880443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:50.880756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2535 sessionId:  describe result for acl check
2025-10-02T09:34:50.880781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:50.880786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:50.880787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:50.880790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555540303643225:4504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:50.881067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:50.881153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555540303643225:4504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:50.881234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:50.881244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:50.881251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:50.881287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:50.881321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555540228071940:7076]
2025-10-02T09:34:50.881994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:50.882213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:50.882244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:50.882391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555540303643225:4504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:50.882471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:50.882506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.882512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.882513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.882513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.882514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.882515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.882516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.882517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.882517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.882518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.882519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.882520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.882535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.882542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.882545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.882547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.882549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.882552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.882554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.882556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.882559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.882561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.882563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.882566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.882571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.882575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:50.882580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.882583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:50.882586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.882589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:50.882591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.882595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:50.882597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.882601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:50.882603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.882606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:50.882610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.882613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:50.882615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.882618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:50.882621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.882624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:50.882627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.882630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.882632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.882636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.882643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.882646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.882668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:50.886498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555540303643225:4504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:50.886505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555540303643225:4504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:50.886507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555540303643225:4504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:50.886510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:50.890271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:50.892028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:50.892042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:50.892043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:50.892046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:50.892050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2534 [2:7556555540228071940:7076]
2025-10-02T09:34:50.892060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:50.892072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:50.892078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.892080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.892081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.892094Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:50.892102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:50.892108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:50.892146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.892154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.892155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.892158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:50.892159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:50.892218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:50.892227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.892238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:50.892247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:50.892267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:50.892290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2534
2025-10-02T09:34:50.892305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2534
2025-10-02T09:34:50.892294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643266:4504], now have 1 active actors on pipe
2025-10-02T09:34:50.892303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643142:2446], now have 1 active actors on pipe
2025-10-02T09:34:50.892310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.892312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.892316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.892324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:50.892335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:50.892340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:50.892344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:50.892349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:50.892353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:50.892355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:50.892370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.892379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.892409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.892419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:50.892433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:50.892433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4370a40d-7fdb95df-6028d43c-711c984e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:50.892440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:50.892443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:50.892445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:50.892453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:50.892461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:50.892499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.892624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:50.892634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:50.892648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:50.892703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2535 partition: 0 MaxSeqNo: 36 sessionId: src_id|4370a40d-7fdb95df-6028d43c-711c984e_0
2025-10-02T09:34:50.892890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff38c23-57a73139-6e6cb977-1c1704a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4370a40d-7fdb95df-6028d43c-711c984e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:50.895441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Write session: try to update token
2025-10-02T09:34:50.895451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:50.901956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:50.901970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:50.901971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:50.901973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:50.901978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.901980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.901986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555540228071935:7076]
2025-10-02T09:34:50.902018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:50.902030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:50.902031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:50.902032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:50.902036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:50.902040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:50.902242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:50.907986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId: src_id|4370a40d-7fdb95df-6028d43c-711c984e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:50.910047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:50.972171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555540303643291:4103]
2025-10-02T09:34:50.972394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2534, pipe: [1:7556555540303643291:4103]
2025-10-02T09:34:51.034308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:51.034724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.034738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.034756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555540303643291:4103], now have 1 active actors on pipe
2025-10-02T09:34:51.034931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:51.034937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:51.034940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:51.034968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555540303643291:4103]
2025-10-02T09:34:51.034980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2535 reason: error at write: Disconnected sessionId: src_id|4370a40d-7fdb95df-6028d43c-711c984e_0
2025-10-02T09:34:51.035020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:51.035109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2535 sessionId: src_id|4370a40d-7fdb95df-6028d43c-711c984e_0 is DEAD
2025-10-02T09:34:51.035236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:51.035242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Write session will restart in 0.005656s
2025-10-02T09:34:51.035257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Write session: Do CDS request
2025-10-02T09:34:51.035262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:51.042093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.042205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:51.042212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2536
2025-10-02T09:34:51.042312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.042332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:51.042337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:51.042339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:51.042386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:51.042600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2536 sessionId:  describe result for acl check
2025-10-02T09:34:51.042623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:51.042627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:51.042628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:51.042631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555544598610683:4527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:51.042948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555544598610683:4527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:51.043611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:51.043795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:51.043804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:51.043812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:51.043847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:51.043880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555544523039406:7055]
2025-10-02T09:34:51.044132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555544598610683:4527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:51.044311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:51.044551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:51.044582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:51.044826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:51.044863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.044869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.044870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.044871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.044871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.044872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.044873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.044873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.044874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.044875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.044875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.044876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.044879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.044886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.044891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.044894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.044896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.044898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.044901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.044903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.044905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.044908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.044910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.044912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.044917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.044922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.044926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.044930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.044933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.044936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.044938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.044942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.044944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.044947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.044949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.044952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.044956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.044959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.044962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.044965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.044967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.044970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.044973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.044976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.044978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.044984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.044989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.044993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.045012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:51.048905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555544598610683:4527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:51.048913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555544598610683:4527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:51.048915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555544598610683:4527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:51.048918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:51.052641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:51.054350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:51.054363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:51.054365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:51.054368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:51.054373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2535 [2:7556555544523039406:7055]
2025-10-02T09:34:51.054382Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:51.054396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:51.054404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.054406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.054407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.054420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:51.054424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:51.054434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:51.054473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.054480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.054481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.054484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:51.054486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:51.054556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:51.054567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.054578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.054589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.054605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:51.054630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610722:4527], now have 1 active actors on pipe
2025-10-02T09:34:51.054638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610598:2446], now have 1 active actors on pipe
2025-10-02T09:34:51.054644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.054646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.054648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.054662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:51.054642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2535
2025-10-02T09:34:51.054644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2535
2025-10-02T09:34:51.054676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:51.054680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:51.054685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:51.054686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:51.054694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:51.054697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:51.054729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.054738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.054752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.054763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:51.054783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:51.054794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:51.054801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.054810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.054812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:51.054822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.054837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:51.054867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.054974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.054984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.054997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.055083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2536 partition: 0 MaxSeqNo: 36 sessionId: src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0
2025-10-02T09:34:51.055253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4370a40d-7fdb95df-6028d43c-711c984e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:51.057869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Write session: try to update token
2025-10-02T09:34:51.057880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:51.064324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:51.064341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:51.064342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:51.064344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:51.064351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.064354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.064357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555544523039401:7055]
2025-10-02T09:34:51.064389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:51.064394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.064398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:51.064401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:51.064405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:51.064410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:51.064536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:51.070854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId: src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:51.073055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:51.134993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555544598610741:4103]
2025-10-02T09:34:51.135183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2535, pipe: [1:7556555544598610741:4103]
2025-10-02T09:34:51.195820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:51.196189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.196202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.196214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610741:4103], now have 1 active actors on pipe
2025-10-02T09:34:51.196406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:51.196410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:51.196414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:51.196436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555544598610741:4103]
2025-10-02T09:34:51.196449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2536 reason: error at write: Disconnected sessionId: src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0
2025-10-02T09:34:51.196513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:51.196536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2536 sessionId: src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0 is DEAD
2025-10-02T09:34:51.196644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:51.196650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Write session will restart in 0.008740s
2025-10-02T09:34:51.196673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Write session: Do CDS request
2025-10-02T09:34:51.196678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:51.204089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:51.205290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:51.205430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:51.205440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:51.205448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:51.205483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:51.205512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555544523039532:7041]
2025-10-02T09:34:51.205946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:51.206171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.206173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:51.206204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:51.206253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:51.206258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2537
2025-10-02T09:34:51.206375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.206395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:51.206400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:51.206402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:51.206434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:51.206470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.206477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.206478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.206478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.206479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.206479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.206480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.206480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.206481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.206482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.206483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.206483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.206487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.206495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.206497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.206499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.206502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.206504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.206506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.206509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.206511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.206513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.206516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.206518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.206533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.206538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.206542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.206546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.206549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.206552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.206554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.206558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.206560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.206564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.206566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.206570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.206573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.206576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.206578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.206582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.206584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.206588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.206590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.206593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.206597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.206600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.206603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.206606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.206629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:51.206660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2537 sessionId:  describe result for acl check
2025-10-02T09:34:51.206681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:51.206686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:51.206687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:51.206690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555544598610832:4544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:51.207001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555544598610832:4544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:51.208480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555544598610832:4544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:51.212815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555544598610832:4544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:51.212823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555544598610832:4544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:51.212825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555544598610832:4544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:51.212829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:51.214193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:51.215893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:51.215908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:51.215909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:51.215912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:51.215919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2536 [2:7556555544523039532:7041]
2025-10-02T09:34:51.215929Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:51.215946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:51.215953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.215955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.215956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.215968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:51.215976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:51.215982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:51.216027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.216033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.216035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.216037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:51.216039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:51.216098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:51.216108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.216119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.216133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.216153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:51.216176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610869:4544], now have 1 active actors on pipe
2025-10-02T09:34:51.216183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610744:2446], now have 1 active actors on pipe
2025-10-02T09:34:51.216190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.216192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.216194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.216185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2536
2025-10-02T09:34:51.216186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2536
2025-10-02T09:34:51.216210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:51.216226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:51.216228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:51.216235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:51.216236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:51.216242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:51.216244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:51.216260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.216269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.216298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.216309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:51.216324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9565407d-c29a2653-40775991-26ce78c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:51.216327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:51.216336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.216339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.216341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:51.216350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.216364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:51.216469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.216574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.216584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.216597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.216667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2537 partition: 0 MaxSeqNo: 36 sessionId: src_id|9565407d-c29a2653-40775991-26ce78c2_0
2025-10-02T09:34:51.216862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c18911-724c9f4e-92b5a462-5c56aa00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9565407d-c29a2653-40775991-26ce78c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:51.219412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Write session: try to update token
2025-10-02T09:34:51.219423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:51.225809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:51.225823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:51.225825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:51.225827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:51.225833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.225836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.225839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555544523039527:7041]
2025-10-02T09:34:51.225871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:51.225887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.225887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:51.225889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:51.225893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:51.225897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:51.226067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:51.232431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId: src_id|9565407d-c29a2653-40775991-26ce78c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:51.234626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:51.296783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555544598610878:4103]
2025-10-02T09:34:51.297020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2536, pipe: [1:7556555544598610878:4103]
2025-10-02T09:34:51.356456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:51.356793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.356814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.356834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610878:4103], now have 1 active actors on pipe
2025-10-02T09:34:51.357042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555544598610878:4103]
2025-10-02T09:34:51.357061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:51.357075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:51.357077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:51.357089Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:51.357123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2537 reason: error at write: Disconnected sessionId: src_id|9565407d-c29a2653-40775991-26ce78c2_0
2025-10-02T09:34:51.357250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2537 sessionId: src_id|9565407d-c29a2653-40775991-26ce78c2_0 is DEAD
2025-10-02T09:34:51.357400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:51.357411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Write session will restart in 0.009526s
2025-10-02T09:34:51.357432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Write session: Do CDS request
2025-10-02T09:34:51.357437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:51.364755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:51.366042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:51.366209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:51.366219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:51.366227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:51.366261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:51.366292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555544523039659:7048]
2025-10-02T09:34:51.366722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:51.366951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:51.366986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:51.367212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:51.367250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.367256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.367257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.367257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.367258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.367258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.367258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.367259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.367259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.367260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.367261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.367262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.367265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.367272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.367274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.367277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.367279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.367281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.367283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.367285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.367287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.367290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.367292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.367294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.367299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.367304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.367308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.367311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.367315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.367318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.367321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.367324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.367327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.367330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.367332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.367335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.367337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.367340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.367343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.367346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.367349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.367352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.367355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.367359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.367362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.367365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.367367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.367370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.367389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:51.368145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.368282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:51.368290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2538
2025-10-02T09:34:51.368381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.368401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:51.368409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:51.368412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:51.368669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2538 sessionId:  describe result for acl check
2025-10-02T09:34:51.368691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:51.368695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:51.368696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:51.368699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555544598610972:4555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:51.369077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555544598610972:4555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:51.370355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555544598610972:4555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:51.374331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555544598610972:4555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:51.374339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555544598610972:4555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:51.374342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555544598610972:4555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:51.374345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:51.375079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:51.376717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:51.376732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:51.376734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:51.376736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:51.376741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2537 [2:7556555544523039659:7048]
2025-10-02T09:34:51.376750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:51.376762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:51.376771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.376773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.376774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.376786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:51.376789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:51.376794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:51.376854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.376861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.376862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.376867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:51.376869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:51.376930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:51.376939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.376950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.376960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.376980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:51.377004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598610880:2446], now have 1 active actors on pipe
2025-10-02T09:34:51.377014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611006:4555], now have 1 active actors on pipe
2025-10-02T09:34:51.377011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2537
2025-10-02T09:34:51.377012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2537
2025-10-02T09:34:51.377020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.377028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.377031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.377040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:51.377058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:51.377060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:51.377062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:51.377064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:51.377078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:51.377080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:51.377121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.377128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.377138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.377149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:51.377163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:51.377176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:51.377183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.377192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.377194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:51.377204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.377218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:51.377246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.377363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.377373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.377387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.377466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2538 partition: 0 MaxSeqNo: 36 sessionId: src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0
2025-10-02T09:34:51.377656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9565407d-c29a2653-40775991-26ce78c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:51.380174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Write session: try to update token
2025-10-02T09:34:51.380184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:51.386577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:51.386591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:51.386592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:51.386596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:51.386602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.386605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.386607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555544523039654:7048]
2025-10-02T09:34:51.386641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:51.386656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.386658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:51.386659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:51.386663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:51.386668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:51.386831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:51.392979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId: src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:51.394991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:51.457047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555544598611013:4103]
2025-10-02T09:34:51.457265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2537, pipe: [1:7556555544598611013:4103]
2025-10-02T09:34:51.515066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:51.515308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.515318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.515330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611013:4103], now have 1 active actors on pipe
2025-10-02T09:34:51.515511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:51.515495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555544598611013:4103]
2025-10-02T09:34:51.515514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:51.515536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:51.515538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:51.515576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2538 reason: error at write: Disconnected sessionId: src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0
2025-10-02T09:34:51.515674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2538 sessionId: src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0 is DEAD
2025-10-02T09:34:51.515763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:51.515770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Write session will restart in 0.007972s
2025-10-02T09:34:51.515795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Write session: Do CDS request
2025-10-02T09:34:51.515800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:51.523515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:51.524666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:51.524831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:51.524843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:51.524851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:51.524890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:51.524937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555544523039785:7051]
2025-10-02T09:34:51.525146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.525236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:51.525244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2539
2025-10-02T09:34:51.525329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.525353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:51.525359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:51.525362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:51.525426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:51.525635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2539 sessionId:  describe result for acl check
2025-10-02T09:34:51.525640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:51.525659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:51.525663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:51.525664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:51.525667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555544598611105:4564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:51.525677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:51.525929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:51.525975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.525981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.525982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.525983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.525984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.525985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.525986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.525987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.525988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.525988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.525989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.525990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.525993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.526016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555544598611105:4564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:51.526000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.526003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.526006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.526008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.526011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.526013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.526016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.526018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.526021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.526023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.526025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.526031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.526036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.526040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.526044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.526046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.526049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.526052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.526056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.526059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.526063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.526066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.526070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.526073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.526076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.526079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.526082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.526085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.526088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.526091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.526097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.526102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.526110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.526115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.526120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.526141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:51.527524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555544598611105:4564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:51.531462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555544598611105:4564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:51.531469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555544598611105:4564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:51.531471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555544598611105:4564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:51.531474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:51.533873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:51.535554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:51.535572Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:51.535575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:51.535579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:51.535586Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2538 [2:7556555544523039785:7051]
2025-10-02T09:34:51.535599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:51.535621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:51.535628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.535631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.535633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.535645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:51.535653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:51.535659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:51.535703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.535711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.535713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.535716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:51.535718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:51.535771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:51.535779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.535786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.535793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.535802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:51.535822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611142:4564], now have 1 active actors on pipe
2025-10-02T09:34:51.535832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611015:2446], now have 1 active actors on pipe
2025-10-02T09:34:51.535839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.535847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.535850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.535846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2538
2025-10-02T09:34:51.535863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2538
2025-10-02T09:34:51.535867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:51.535878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:51.535880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:51.535882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:51.535885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:51.535894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:51.535901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:51.535932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.535940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.535955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.535965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:51.535975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:51.535988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f234c0-fc8150ef-28c63624-a31feffe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:51.535993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.536000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.536002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:51.536009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.536019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:51.536039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.536176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.536186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.536198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.536268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2539 partition: 0 MaxSeqNo: 36 sessionId: src_id|28f234c0-fc8150ef-28c63624-a31feffe_0
2025-10-02T09:34:51.536466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d785e65a-d61282dd-df5f4f6f-9f99fa21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28f234c0-fc8150ef-28c63624-a31feffe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:51.539169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Write session: try to update token
2025-10-02T09:34:51.539184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:51.545669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:51.545687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:51.545689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:51.545691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:51.545697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.545700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.545704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555544523039780:7051]
2025-10-02T09:34:51.545733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:51.545735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:51.545738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:51.545741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:51.545744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.545746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:51.545889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:51.551892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId: src_id|28f234c0-fc8150ef-28c63624-a31feffe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:51.554175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:51.615761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555544598611152:4103]
2025-10-02T09:34:51.615889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2538, pipe: [1:7556555544598611152:4103]
2025-10-02T09:34:51.679503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:51.679984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.679998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.680016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611152:4103], now have 1 active actors on pipe
2025-10-02T09:34:51.680187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555544598611152:4103]
2025-10-02T09:34:51.680202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:51.680213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:51.680185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:51.680217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:51.680262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2539 reason: error at write: Disconnected sessionId: src_id|28f234c0-fc8150ef-28c63624-a31feffe_0
2025-10-02T09:34:51.680370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2539 sessionId: src_id|28f234c0-fc8150ef-28c63624-a31feffe_0 is DEAD
2025-10-02T09:34:51.680506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:51.680521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Write session will restart in 0.009228s
2025-10-02T09:34:51.680546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Write session: Do CDS request
2025-10-02T09:34:51.680551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:51.687774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:51.689046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:51.689203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:51.689213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:51.689221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:51.689258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:51.689291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555544523039913:7042]
2025-10-02T09:34:51.689746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:51.689957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:51.689991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:51.690234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:51.690351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.690359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.690359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.690360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.690361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.690361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.690362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.690362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.690363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.690363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.690364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.690364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.690368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.690376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.690378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.690381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.690383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.690385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.690387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.690389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.690391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.690394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.690396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.690398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.690405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.690410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.690414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.690418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.690421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.690424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.690428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.690431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.690433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.690437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.690440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.690445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.690449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.690454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.690458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.690463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.690468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.690472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.690480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.690483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.690486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.690489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.690491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.690494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.690515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:51.691135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.691162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:51.691172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2540
2025-10-02T09:34:51.691361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.691381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:51.691387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:51.691390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:51.691662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2540 sessionId:  describe result for acl check
2025-10-02T09:34:51.691686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:51.691690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:51.691691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:51.691694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555544598611247:4566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:51.692037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555544598611247:4566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:51.693421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555544598611247:4566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:51.697402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555544598611247:4566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:51.697410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555544598611247:4566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:51.697412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555544598611247:4566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:51.697415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:51.698108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:51.699805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:51.699821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:51.699823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:51.699826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:51.699831Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2539 [2:7556555544523039913:7042]
2025-10-02T09:34:51.699840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:51.699852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:51.699859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.699861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.699863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.699873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:51.699877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:51.699885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:51.699938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.699947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.699950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.699953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:51.699955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:51.700004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:51.700011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.700018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.700024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.700033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:51.700053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611282:4566], now have 1 active actors on pipe
2025-10-02T09:34:51.700060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611154:2446], now have 1 active actors on pipe
2025-10-02T09:34:51.700066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.700068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.700069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.700080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:51.700095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:51.700094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2539
2025-10-02T09:34:51.700095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:51.700096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2539
2025-10-02T09:34:51.700098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:51.700099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:51.700107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:51.700109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:51.700126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.700133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:51.700135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:51.700149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.700156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.700197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31155122-2703e880-1be3f5a6-3def293f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:51.700209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.700214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.700219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:51.700227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.700238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:51.700256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.700370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.700380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.700392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.700457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2540 partition: 0 MaxSeqNo: 36 sessionId: src_id|31155122-2703e880-1be3f5a6-3def293f_0
2025-10-02T09:34:51.700626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f234c0-fc8150ef-28c63624-a31feffe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31155122-2703e880-1be3f5a6-3def293f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:51.703338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Write session: try to update token
2025-10-02T09:34:51.703349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:51.709623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:51.709638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:51.709640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:51.709642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:51.709648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.709653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.709656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555544523039908:7042]
2025-10-02T09:34:51.709685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:51.709687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:51.709690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.709694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:51.709697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:51.709700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:51.709825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:51.714974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId: src_id|31155122-2703e880-1be3f5a6-3def293f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:51.716989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:51.780117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555544598611289:4103]
2025-10-02T09:34:51.780295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2539, pipe: [1:7556555544598611289:4103]
2025-10-02T09:34:51.842274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:51.842693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.842707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.842725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611289:4103], now have 1 active actors on pipe
2025-10-02T09:34:51.842925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:51.842914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:51.842927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555544598611289:4103]
2025-10-02T09:34:51.842947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:51.842949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:51.843008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2540 reason: error at write: Disconnected sessionId: src_id|31155122-2703e880-1be3f5a6-3def293f_0
2025-10-02T09:34:51.843131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2540 sessionId: src_id|31155122-2703e880-1be3f5a6-3def293f_0 is DEAD
2025-10-02T09:34:51.843257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:51.843263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Write session will restart in 0.007852s
2025-10-02T09:34:51.843277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Write session: Do CDS request
2025-10-02T09:34:51.843282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:51.850045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:51.851257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:51.851392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:51.851402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:51.851408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:51.851440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:51.851471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555544523040041:7046]
2025-10-02T09:34:51.851913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:51.852131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:51.852165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:51.852184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.852303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:51.852312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2541
2025-10-02T09:34:51.852407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:51.852421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:51.852440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:51.852446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:51.852449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:51.852448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.852454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.852455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.852456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.852456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.852457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.852458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.852458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.852459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.852459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.852460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.852461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.852464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.852471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.852474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.852476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.852478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.852481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.852483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.852485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.852488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.852492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.852496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.852500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.852507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.852515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:51.852519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.852523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:51.852525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.852528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:51.852531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.852535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:51.852543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.852546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:51.852549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.852552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:51.852554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.852558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:51.852565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.852568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:51.852570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.852573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:51.852578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.852581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.852583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.852586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.852589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.852591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.852611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:51.852731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2541 sessionId:  describe result for acl check
2025-10-02T09:34:51.852755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:51.852760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:51.852761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:51.852764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555544598611384:4592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:51.853126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555544598611384:4592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:51.854707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555544598611384:4592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:51.858732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555544598611384:4592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:51.858740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555544598611384:4592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:51.858742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555544598611384:4592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:51.858746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:51.860132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:51.861937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:51.861953Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:51.861954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:51.861957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:51.861962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2540 [2:7556555544523040041:7046]
2025-10-02T09:34:51.861975Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:51.861991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:51.862001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.862003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.862005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.862017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:51.862025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:51.862030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:51.862070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.862081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.862082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.862085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:51.862087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:51.862134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:51.862142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.862150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:51.862156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:51.862172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:51.862191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611420:4592], now have 1 active actors on pipe
2025-10-02T09:34:51.862198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611291:2446], now have 1 active actors on pipe
2025-10-02T09:34:51.862204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.862205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.862207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.862217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2540
2025-10-02T09:34:51.862223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:51.862222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2540
2025-10-02T09:34:51.862241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:51.862240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:51.862243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:51.862244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:51.862257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:51.862260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:51.862290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.862298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.862312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.862322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:51.862338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:51.862345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:51.862349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:51.862352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:51.862353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:51.862362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:51.862369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:51.862389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.862489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:51.862501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:51.862513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:51.862593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2541 partition: 0 MaxSeqNo: 36 sessionId: src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0
2025-10-02T09:34:51.862779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31155122-2703e880-1be3f5a6-3def293f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:51.865340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Write session: try to update token
2025-10-02T09:34:51.865351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:51.872012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:51.872030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:51.872032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:51.872033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:51.872038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.872041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.872044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555544523040036:7046]
2025-10-02T09:34:51.872071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:51.872071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:51.872074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:51.872075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:51.872076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:51.872077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:51.872247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:51.877487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId: src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:51.879709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:51.942926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555544598611434:4103]
2025-10-02T09:34:51.943100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2540, pipe: [1:7556555544598611434:4103]
2025-10-02T09:34:52.004773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.005196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.005210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.005223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555544598611434:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.005328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.005585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555544598611434:4103]
2025-10-02T09:34:52.005602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.005662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:52.005711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0
2025-10-02T09:34:52.005833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2541 sessionId: src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0 is DEAD
2025-10-02T09:34:52.005950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:52.005955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Write session will restart in 0.009894s
2025-10-02T09:34:52.005974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Write session: Do CDS request
2025-10-02T09:34:52.005979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.012866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.014070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.014263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.014273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.014281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.014330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.014362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818007514:7019]
2025-10-02T09:34:52.014833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.015027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.015061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.015306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.015355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.015362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.015362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.015363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.015364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.015365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.015365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.015366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.015366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.015367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.015368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.015368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.015372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.015379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.015382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.015384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.015386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.015389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.015391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.015393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.015395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.015398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.015400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.015403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.015407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.015412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.015416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.015419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.015422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.015425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.015428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.015431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.015434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.015438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.015441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.015444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.015446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.015449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.015452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.015455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.015457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.015461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.015463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.015466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.015469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.015472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.015474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.015478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.015506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.017175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.017244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.017254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2542
2025-10-02T09:34:52.017377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.017401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.017406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.017409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.017647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2542 sessionId:  describe result for acl check
2025-10-02T09:34:52.017666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.017667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.017668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.017672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893578856:4631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.017925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893578856:4631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.018802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893578856:4631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.022693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893578856:4631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.022702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893578856:4631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.022704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893578856:4631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.022707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.023156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.025027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.025041Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.025043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.025047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.025053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2541 [2:7556555548818007514:7019]
2025-10-02T09:34:52.025067Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.025082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.025090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.025092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.025093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.025105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.025108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.025118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.025171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.025178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.025179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.025182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.025183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.025234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.025241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.025249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.025255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.025269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.025288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893578759:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.025302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893578887:4631], now have 1 active actors on pipe
2025-10-02T09:34:52.025309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.025311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.025309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2541
2025-10-02T09:34:52.025313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.025312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2541
2025-10-02T09:34:52.025331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.025345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.025344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.025346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.025347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.025360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.025363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.025397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.025405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.025415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.025422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.025432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.025445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.025454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.025457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.025459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.025466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.025478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.025493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.025608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.025618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.025629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.025700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2542 partition: 0 MaxSeqNo: 36 sessionId: src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0
2025-10-02T09:34:52.025904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e7dd1b-f5c36e4b-854a2d8c-62340fde_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.028630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Write session: try to update token
2025-10-02T09:34:52.028644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.034883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.034899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.034901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.034903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.034909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.034913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.034916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818007506:7019]
2025-10-02T09:34:52.034945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.034947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.034950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.034953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.034955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.034957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.035090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.041213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId: src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:52.043424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:52.105749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555548893578894:4103]
2025-10-02T09:34:52.105902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2541, pipe: [1:7556555548893578894:4103]
2025-10-02T09:34:52.169104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.169474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.169489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.169506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893578894:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.169660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.169880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.169895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555548893578894:4103]
2025-10-02T09:34:52.169910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:52.169960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2542 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0
2025-10-02T09:34:52.170090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2542 sessionId: src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0 is DEAD
2025-10-02T09:34:52.170230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:52.170242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Write session will restart in 0.007898s
2025-10-02T09:34:52.170267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Write session: Do CDS request
2025-10-02T09:34:52.170272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.177254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.178593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.178735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.178744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.178752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.178786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.178819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818007646:7014]
2025-10-02T09:34:52.179141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.179248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.179251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.179258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2543
2025-10-02T09:34:52.179368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.179387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.179393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.179395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.179443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.179469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.179689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2543 sessionId:  describe result for acl check
2025-10-02T09:34:52.179713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.179717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.179718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.179721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893579003:4649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.179769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.179835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.179842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.179842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.179843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.179843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.179844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.179845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.179845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.179846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.179847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.179847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.179847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.179851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.179859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.179861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.179863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.179866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.179868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.179870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.179873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.179875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.179877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.179880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.179882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.179887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.179892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.179896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.179899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.179901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.179904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.179907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.179910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.179913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.179916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.179920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.179923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.179925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.179928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.179931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.179934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.179937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.179940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.179943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.179946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.179949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.179952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.179955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.179958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.179977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.180033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893579003:4649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.181302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893579003:4649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.185223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893579003:4649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.185231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893579003:4649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.185233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893579003:4649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.185236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.187560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.189222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.189236Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.189237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.189240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.189245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2542 [2:7556555548818007646:7014]
2025-10-02T09:34:52.189256Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.189269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.189276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.189278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.189281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.189293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.189296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.189302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.189345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.189352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.189354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.189356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.189358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.189408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.189415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.189422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.189428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.189437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.189457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893578908:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.189465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579040:4649], now have 1 active actors on pipe
2025-10-02T09:34:52.189470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.189472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.189474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.189483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.189489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2542
2025-10-02T09:34:52.189497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.189494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2542
2025-10-02T09:34:52.189500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.189502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.189504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.189512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.189514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.189538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.189548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.189553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.189561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.189564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.189596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc99ba53-debac90d-35386c5a-9282a62e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.189607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.189610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.189616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.189624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.189631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.189648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.189739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.189746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.189756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.189824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2543 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc99ba53-debac90d-35386c5a-9282a62e_0
2025-10-02T09:34:52.190026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bb8bd-5cd7f47f-1282b85a-9a77a6d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc99ba53-debac90d-35386c5a-9282a62e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.192685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Write session: try to update token
2025-10-02T09:34:52.192695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.198959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.198973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.198975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.198976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.198981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.198984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.198989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818007641:7014]
2025-10-02T09:34:52.199013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.199014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.199017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.199017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.199019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.199020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.199149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.204203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId: src_id|cc99ba53-debac90d-35386c5a-9282a62e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:52.206203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:52.270091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555548893579047:4103]
2025-10-02T09:34:52.270255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2542, pipe: [1:7556555548893579047:4103]
2025-10-02T09:34:52.328831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.329144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.329157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.329173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579047:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.329326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.329301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.329321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:52.329324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:52.329325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555548893579047:4103]
2025-10-02T09:34:52.329357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2543 reason: error at write: Disconnected sessionId: src_id|cc99ba53-debac90d-35386c5a-9282a62e_0
2025-10-02T09:34:52.329462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2543 sessionId: src_id|cc99ba53-debac90d-35386c5a-9282a62e_0 is DEAD
2025-10-02T09:34:52.329599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:52.329608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Write session will restart in 0.007448s
2025-10-02T09:34:52.329623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Write session: Do CDS request
2025-10-02T09:34:52.329628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.336772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.337973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.338063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.338129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.338138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.338145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.338150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.338157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2544
2025-10-02T09:34:52.338179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.338213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818007777:3907]
2025-10-02T09:34:52.338228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.338246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.338252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.338255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.338489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2544 sessionId:  describe result for acl check
2025-10-02T09:34:52.338509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.338513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.338514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.338517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893579143:4650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.338644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.338836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.338854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893579143:4650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.338863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.339079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.339115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.339122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.339122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.339123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.339124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.339124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.339125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.339126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.339126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.339127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.339127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.339128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.339131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.339139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.339141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.339143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.339146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.339148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.339150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.339152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.339155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.339157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.339160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.339162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.339166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.339171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.339175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.339178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.339181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.339184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.339186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.339190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.339192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.339196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.339198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.339201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.339204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.339207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.339210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.339213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.339216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.339219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.339221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.339224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.339228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.339231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.339233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.339236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.339256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.340140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893579143:4650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.345014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893579143:4650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.345023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893579143:4650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.345024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893579143:4650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.345027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.346920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.348668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.348682Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.348683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.348686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.348690Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2543 [2:7556555548818007777:3907]
2025-10-02T09:34:52.348699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.348711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.348718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.348721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.348722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.348734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.348737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.348742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.348787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.348794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.348795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.348798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.348818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.348872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.348880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.348887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.348893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.348902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.348922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579050:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.348925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579183:4650], now have 1 active actors on pipe
2025-10-02T09:34:52.348935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.348938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.348939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.348927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2543
2025-10-02T09:34:52.348931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2543
2025-10-02T09:34:52.348952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.348962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.348965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.348965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.348966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.348974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.348976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.349007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.349014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.349025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.349035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.349044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.349056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.349061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.349063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.349069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.349076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.349087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.349107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.349221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.349228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.349238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.349306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2544 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0
2025-10-02T09:34:52.349500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc99ba53-debac90d-35386c5a-9282a62e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.352110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Write session: try to update token
2025-10-02T09:34:52.352123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.358532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.358548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.358550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.358551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.358558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.358561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.358564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818007772:3907]
2025-10-02T09:34:52.358593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.358597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.358602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.358604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.358606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.358606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.358775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.364392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId: src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:52.366615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:52.429329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555548893579190:4103]
2025-10-02T09:34:52.429498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2543, pipe: [1:7556555548893579190:4103]
2025-10-02T09:34:52.488789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.489127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.489140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.489156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579190:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.489314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.489323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.489348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:52.489348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555548893579190:4103]
2025-10-02T09:34:52.489354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:52.489387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2544 reason: error at write: Disconnected sessionId: src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0
2025-10-02T09:34:52.489481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2544 sessionId: src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0 is DEAD
2025-10-02T09:34:52.489605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:52.489618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Write session will restart in 0.009356s
2025-10-02T09:34:52.489641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Write session: Do CDS request
2025-10-02T09:34:52.489647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.496922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.498081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.498202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.498210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.498217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.498245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.498280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818007911:7003]
2025-10-02T09:34:52.498704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.498898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.498924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.499146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.499184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.499190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.499190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.499191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.499192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.499192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.499193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.499194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.499194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.499195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.499195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.499196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.499199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.499206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.499208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.499211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.499213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.499216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.499218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.499221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.499223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.499226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.499228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.499230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.499235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.499239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.499244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.499247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.499250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.499253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.499255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.499258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.499261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.499264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.499266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.499269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.499272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.499275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.499278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.499281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.499283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.499286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.499289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.499292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.499294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.499298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.499300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.499304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.499323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.500135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.500207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.500214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2545
2025-10-02T09:34:52.500299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.500317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.500322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.500324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.500577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2545 sessionId:  describe result for acl check
2025-10-02T09:34:52.500602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.500608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.500609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.500612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893579289:4656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.500976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893579289:4656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.502347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893579289:4656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.506446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893579289:4656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.506455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893579289:4656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.506457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893579289:4656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.506460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.507063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.508561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.508575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.508577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.508580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.508584Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2544 [2:7556555548818007911:7003]
2025-10-02T09:34:52.508592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.508603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.508606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.508608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.508609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.508621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.508630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.508635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.508673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.508680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.508681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.508684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.508685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.508740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.508747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.508755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.508761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.508772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.508790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579324:4656], now have 1 active actors on pipe
2025-10-02T09:34:52.508811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579191:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.508817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.508824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.508825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.508820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2544
2025-10-02T09:34:52.508835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.508839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2544
2025-10-02T09:34:52.508848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.508851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.508853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.508854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.508862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.508864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.508892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.508899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.508909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.508918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.508928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.508945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.508954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.508957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.508958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.508965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.508977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.509000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.509096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.509104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.509114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.509177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2545 partition: 0 MaxSeqNo: 36 sessionId: src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0
2025-10-02T09:34:52.509337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed350b0-d7c14d31-d9d29867-6aa0d262_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.511801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Write session: try to update token
2025-10-02T09:34:52.511812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.518639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.518655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.518657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.518658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.518664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.518668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.518671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818007906:7003]
2025-10-02T09:34:52.518698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.518707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.518707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.518708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.518711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.518714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.518843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.524264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId: src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:52.526479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:52.589588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555548893579332:4103]
2025-10-02T09:34:52.589766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2544, pipe: [1:7556555548893579332:4103]
2025-10-02T09:34:52.646548Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.646823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.646835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.646852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579332:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.647007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555548893579332:4103]
2025-10-02T09:34:52.647022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.647024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.647039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:52.647041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:52.647085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2545 reason: error at write: Disconnected sessionId: src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0
2025-10-02T09:34:52.647215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2545 sessionId: src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0 is DEAD
2025-10-02T09:34:52.647322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:52.647331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Write session will restart in 0.008157s
2025-10-02T09:34:52.647346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Write session: Do CDS request
2025-10-02T09:34:52.647350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.655229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.656066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.656177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.656184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2546
2025-10-02T09:34:52.656267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.656287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.656293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.656296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.656541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.656548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2546 sessionId:  describe result for acl check
2025-10-02T09:34:52.656569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.656571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.656573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.656576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893579428:4662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.656671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.656681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.656688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.656718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.656752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818008044:7001]
2025-10-02T09:34:52.656943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893579428:4662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.657187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.657385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.657415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.657636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.657673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.657679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.657679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.657680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.657681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.657681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.657682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.657683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.657683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.657684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.657685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.657685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.657689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.657696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.657699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.657701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.657703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.657706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.657708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.657710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.657712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.657715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.657717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.657719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.657724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.657728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.657734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.657737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.657740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.657743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.657745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.657748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.657751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.657754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.657756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.657759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.657762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.657765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.657768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.657771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.657774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.657777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.657780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.657783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.657786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.657789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.657792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.657800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.657819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.658531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893579428:4662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.662785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893579428:4662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.662794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893579428:4662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.662796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893579428:4662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.662799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.665629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.667328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.667342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.667343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.667346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.667351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2545 [2:7556555548818008044:7001]
2025-10-02T09:34:52.667360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.667372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.667380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.667382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.667384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.667395Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.667399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.667409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.667446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.667453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.667454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.667456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.667459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.667503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.667510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.667517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.667522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.667531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.667549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579467:4662], now have 1 active actors on pipe
2025-10-02T09:34:52.667556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579333:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.667561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.667563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.667564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.667574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.667587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.667588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.667591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.667592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.667600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.667602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.667598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2545
2025-10-02T09:34:52.667600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2545
2025-10-02T09:34:52.667617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.667624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.667626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.667647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.667653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.667677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.667686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.667688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.667690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.667697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.667707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.667722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.667818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.667824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.667834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.667905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2546 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0
2025-10-02T09:34:52.668084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d078559-3f22ea97-3422d1af-6c9c3c3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.670602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Write session: try to update token
2025-10-02T09:34:52.670615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.677537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.677554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.677556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.677557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.677563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.677567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.677569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818008039:7001]
2025-10-02T09:34:52.677596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.677602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.677605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.677606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.677607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.677610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.677730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.682936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId: src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:52.685131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:52.747288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555548893579475:4103]
2025-10-02T09:34:52.747465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2545, pipe: [1:7556555548893579475:4103]
2025-10-02T09:34:52.804871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.805183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.805201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.805213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579475:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.805359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555548893579475:4103]
2025-10-02T09:34:52.805376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:52.805377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.805379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:52.805422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2546 reason: error at write: Disconnected sessionId: src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0
2025-10-02T09:34:52.805537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2546 sessionId: src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0 is DEAD
2025-10-02T09:34:52.805665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:52.805680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Write session will restart in 0.009844s
2025-10-02T09:34:52.805676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.805705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Write session: Do CDS request
2025-10-02T09:34:52.805710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.813137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.814440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.814568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.814577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.814585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.814613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.814723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818008178:6999]
2025-10-02T09:34:52.815125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.815319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.815346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.815558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.815595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.815601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.815601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.815602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.815603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.815603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.815604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.815605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.815605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.815606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.815607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.815607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.815611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.815618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.815620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.815622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.815625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.815627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.815629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.815631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.815633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.815636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.815638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.815641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.815645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.815649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.815653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.815657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.815660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.815662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.815665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.815668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.815670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.815673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.815675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.815678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.815681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.815684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.815687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.815690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.815692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.815696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.815698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.815701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.815704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.815707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.815709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.815711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.815729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.816128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.816214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.816221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2547
2025-10-02T09:34:52.816323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.816343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.816348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.816351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.816610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2547 sessionId:  describe result for acl check
2025-10-02T09:34:52.816632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.816636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.816637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.816640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893579576:4679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.817016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893579576:4679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.818253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893579576:4679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.821877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893579576:4679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.821887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893579576:4679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.821888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893579576:4679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.821892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.823196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.824762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.824774Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.824775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.824778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.824783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2546 [2:7556555548818008178:6999]
2025-10-02T09:34:52.824792Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.824817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.824819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.824821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.824822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.824835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.824844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.824848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.824882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.824888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.824889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.824891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.824893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.824946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.824952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.824960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.824966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.824980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.824999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579611:4679], now have 1 active actors on pipe
2025-10-02T09:34:52.825007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579476:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.825011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.825012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.825013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.825009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2546
2025-10-02T09:34:52.825022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2546
2025-10-02T09:34:52.825024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.825037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.825047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.825050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.825051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.825051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.825052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.825081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.825089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.825098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.825104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.825119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.825130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f073e10b-c07de0b1-46baa438-e20de262_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.825134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.825137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.825138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.825145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.825157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.825174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.825282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.825289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.825298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.825355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2547 partition: 0 MaxSeqNo: 36 sessionId: src_id|f073e10b-c07de0b1-46baa438-e20de262_0
2025-10-02T09:34:52.825526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cee9395-40abb1fa-517d2b44-d1e4cc58_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f073e10b-c07de0b1-46baa438-e20de262_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.828034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Write session: try to update token
2025-10-02T09:34:52.828045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.835046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.835062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.835064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.835065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.835072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.835075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.835077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818008173:6999]
2025-10-02T09:34:52.835105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.835114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.835115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.835152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.835177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.835186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.835237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.840678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId: src_id|f073e10b-c07de0b1-46baa438-e20de262_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:52.842869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:52.905483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555548893579624:4103]
2025-10-02T09:34:52.905671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2546, pipe: [1:7556555548893579624:4103]
2025-10-02T09:34:52.963255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:52.963581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.963594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.963611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579624:4103], now have 1 active actors on pipe
2025-10-02T09:34:52.963774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:52.963797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555548893579624:4103]
2025-10-02T09:34:52.963812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:52.963817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:52.963867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2547 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f073e10b-c07de0b1-46baa438-e20de262_0
2025-10-02T09:34:52.963977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2547 sessionId: src_id|f073e10b-c07de0b1-46baa438-e20de262_0 is DEAD
2025-10-02T09:34:52.964123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:52.964136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Write session will restart in 0.008220s
2025-10-02T09:34:52.964160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Write session: Do CDS request
2025-10-02T09:34:52.964167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:52.971515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:52.972859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:52.973000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:52.973010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:52.973017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:52.973049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:52.973077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555548818008313:6983]
2025-10-02T09:34:52.973103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.973199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:52.973206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2548
2025-10-02T09:34:52.973315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:52.973334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:52.973339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:52.973341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:52.973498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:52.973691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:52.973687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2548 sessionId:  describe result for acl check
2025-10-02T09:34:52.973712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:52.973713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:52.973714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:52.973719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:52.973717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555548893579730:4687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:52.973937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:52.974006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.974012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.974013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.974014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.974015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.974016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.974016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.974017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.974018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.974018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.974019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.974020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.974023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.974030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.974033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.974035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.974037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.974039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.974041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.974044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.974046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.974048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.974050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.974052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.974059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.974064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:52.974068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.974072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555548893579730:4687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:52.974071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:52.974074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.974077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:52.974081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.974084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:52.974086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.974089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:52.974091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.974094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:52.974097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.974099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:52.974101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.974104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:52.974107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.974110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:52.974112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.974115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.974118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.974121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.974123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.974126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.974145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:52.975474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555548893579730:4687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:52.979987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555548893579730:4687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:52.979996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555548893579730:4687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:52.979999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555548893579730:4687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:52.980002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:52.981791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:52.983423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:52.983437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:52.983439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:52.983441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:52.983446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2547 [2:7556555548818008313:6983]
2025-10-02T09:34:52.983455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:52.983466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:52.983474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.983476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.983478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.983489Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:52.983492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:52.983498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:52.983545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.983553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.983554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.983557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:52.983560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:52.983605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:52.983612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.983620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:52.983626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:52.983640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:52.983660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579764:4687], now have 1 active actors on pipe
2025-10-02T09:34:52.983667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555548893579631:2446], now have 1 active actors on pipe
2025-10-02T09:34:52.983674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.983675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.983676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.983686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:52.983683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2547
2025-10-02T09:34:52.983688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2547
2025-10-02T09:34:52.983699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:52.983701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:52.983703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:52.983705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:52.983712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:52.983714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:52.983740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.983748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.983758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.983768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:52.983777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:52.983795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cefe041-dfe7c236-87b64a83-d5284077_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:52.983804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:52.983807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:52.983808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:52.983814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:52.983825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:52.983841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.983936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:52.983943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:52.983952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:52.984015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2548 partition: 0 MaxSeqNo: 36 sessionId: src_id|9cefe041-dfe7c236-87b64a83-d5284077_0
2025-10-02T09:34:52.984233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f073e10b-c07de0b1-46baa438-e20de262_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9cefe041-dfe7c236-87b64a83-d5284077_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:52.986787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Write session: try to update token
2025-10-02T09:34:52.986801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:52.993530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:52.993544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:52.993546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:52.993547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:52.993551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.993554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.993556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555548818008308:6983]
2025-10-02T09:34:52.993581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:52.993589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:52.993590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:52.993639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:52.993664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:52.993679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:52.993732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:52.999214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId: src_id|9cefe041-dfe7c236-87b64a83-d5284077_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.001484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:53.063709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555553188547090:4103]
2025-10-02T09:34:53.063909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2547, pipe: [1:7556555553188547090:4103]
2025-10-02T09:34:53.104989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:53.105335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.105345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.105358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547090:4103], now have 1 active actors on pipe
2025-10-02T09:34:53.105535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:53.105583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:53.105613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:53.105626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555553188547090:4103]
2025-10-02T09:34:53.105669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cefe041-dfe7c236-87b64a83-d5284077_0
2025-10-02T09:34:53.105801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2548 sessionId: src_id|9cefe041-dfe7c236-87b64a83-d5284077_0 is DEAD
2025-10-02T09:34:53.105932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:53.105944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Write session will restart in 0.008590s
2025-10-02T09:34:53.105967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Write session: Do CDS request
2025-10-02T09:34:53.105973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:53.113382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:53.114721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:53.114909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:53.114919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:53.114926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:53.114970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:53.115007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555553112975793:6966]
2025-10-02T09:34:53.115144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.115433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:53.115529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:53.115537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2549
2025-10-02T09:34:53.115658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.115669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:53.115680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:53.115686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:53.115689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:53.115698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:53.115921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:53.115954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2549 sessionId:  describe result for acl check
2025-10-02T09:34:53.115957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.115963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.115964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.115965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.115965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.115966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.115967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.115977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:53.115969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.115983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:53.115969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.115970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.115984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:53.115971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.115972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.115987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555553188547191:4713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:53.115975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.115982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.115985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.115987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.115989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.115992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.115994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.115996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.115999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.116001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.116003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.116006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.116013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.116020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.116026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.116031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.116037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.116042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.116047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.116051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.116054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.116057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.116060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.116063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.116066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.116069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.116071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.116074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.116077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.116080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.116083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.116086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.116089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.116092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.116094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.116097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.116118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:53.116343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555553188547191:4713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:53.117878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555553188547191:4713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:53.122547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555553188547191:4713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:53.122556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555553188547191:4713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:53.122558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555553188547191:4713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:53.122562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:53.123979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:53.125820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:53.125835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:53.125838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:53.125840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:53.125845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2548 [2:7556555553112975793:6966]
2025-10-02T09:34:53.125855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:53.125874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:53.125881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.125883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.125885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.125896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:53.125900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:53.125905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:53.125952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.125959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.125961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.125964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:53.125966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:53.126014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:53.126021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.126028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.126034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.126043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:53.126062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547091:2446], now have 1 active actors on pipe
2025-10-02T09:34:53.126070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547228:4713], now have 1 active actors on pipe
2025-10-02T09:34:53.126075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.126076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.126078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.126081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2548
2025-10-02T09:34:53.126088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:53.126084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2548
2025-10-02T09:34:53.126102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:53.126104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:53.126107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:53.126108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:53.126114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:53.126116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:53.126147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.126154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.126164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.126174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:53.126187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:53.126193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:53.126198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.126201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.126203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:53.126212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.126224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:53.126238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.126355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.126362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.126371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.126429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2549 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0
2025-10-02T09:34:53.126660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefe041-dfe7c236-87b64a83-d5284077_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:53.129279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Write session: try to update token
2025-10-02T09:34:53.129292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:53.135958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:53.135975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:53.135977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:53.135978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:53.135983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.135986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.135988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555553112975788:6966]
2025-10-02T09:34:53.136010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:53.136014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:53.136017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:53.136019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.136020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:53.136021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:53.136149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:53.141696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId: src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.144222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:53.205522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555553188547248:4103]
2025-10-02T09:34:53.205744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2548, pipe: [1:7556555553188547248:4103]
2025-10-02T09:34:53.265950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:53.266369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.266383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.266400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547248:4103], now have 1 active actors on pipe
2025-10-02T09:34:53.266578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:53.266602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555553188547248:4103]
2025-10-02T09:34:53.266618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:53.266657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:53.266714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0
2025-10-02T09:34:53.266834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2549 sessionId: src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0 is DEAD
2025-10-02T09:34:53.266959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:53.266972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Write session will restart in 0.009474s
2025-10-02T09:34:53.266992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Write session: Do CDS request
2025-10-02T09:34:53.266998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:53.274245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:53.275520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:53.275641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:53.275650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:53.275657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:53.275688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:53.275717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555553112975930:6952]
2025-10-02T09:34:53.276137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:53.276318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:53.276344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:53.276558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:53.276594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.276599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.276600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.276600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.276601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.276602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.276602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.276603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.276604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.276604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.276605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.276606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.276609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.276616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.276618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.276621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.276623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.276625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.276627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.276630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.276632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.276635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.276637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.276639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.276644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.276649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.276653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.276656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.276659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.276662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.276664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.276667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.276670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.276673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.276675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.276678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.276681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.276684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.276686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.276689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.276693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.276696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.276698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.276701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.276703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.276706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.276708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.276712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.276731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:53.277129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.277211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:53.277219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2550
2025-10-02T09:34:53.277308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.277329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:53.277334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:53.277337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:53.277595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2550 sessionId:  describe result for acl check
2025-10-02T09:34:53.277617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:53.277620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:53.277621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:53.277624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555553188547352:4716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:53.277962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555553188547352:4716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:53.279035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555553188547352:4716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:53.282900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555553188547352:4716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:53.282910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555553188547352:4716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:53.282912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555553188547352:4716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:53.282926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:53.284220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:53.285981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:53.285995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:53.285996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:53.285998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:53.286002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2549 [2:7556555553112975930:6952]
2025-10-02T09:34:53.286012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:53.286024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:53.286031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.286033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.286035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.286045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:53.286052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:53.286057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:53.286092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.286099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.286100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.286102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:53.286104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:53.286146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:53.286153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.286160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.286166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.286175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:53.286193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547389:4716], now have 1 active actors on pipe
2025-10-02T09:34:53.286202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547249:2446], now have 1 active actors on pipe
2025-10-02T09:34:53.286208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.286209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.286210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.286215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2549
2025-10-02T09:34:53.286220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:53.286216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2549
2025-10-02T09:34:53.286235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:53.286234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:53.286237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:53.286238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:53.286247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:53.286249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:53.286277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.286284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.286293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.286303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:53.286312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:53.286323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:53.286328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.286332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.286338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:53.286345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.286352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:53.286369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.286465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.286472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.286482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.286544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2550 partition: 0 MaxSeqNo: 36 sessionId: src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0
2025-10-02T09:34:53.286734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e101fe1-36f3ec42-34ed936f-20840eed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:53.289482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Write session: try to update token
2025-10-02T09:34:53.289496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:53.296586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:53.296605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:53.296607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:53.296609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:53.296615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.296620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.296624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555553112975925:6952]
2025-10-02T09:34:53.296650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:53.296650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:53.296654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:53.296659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:53.296659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.296665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:53.296817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:53.302238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId: src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.304472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:53.366798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555553188547397:4103]
2025-10-02T09:34:53.366990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2549, pipe: [1:7556555553188547397:4103]
2025-10-02T09:34:53.423567Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:53.423866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.423879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.423896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547397:4103], now have 1 active actors on pipe
2025-10-02T09:34:53.424067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:53.424080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555553188547397:4103]
2025-10-02T09:34:53.424092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:53.424095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:53.424099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:53.424135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2550 reason: error at write: Disconnected sessionId: src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0
2025-10-02T09:34:53.424245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2550 sessionId: src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0 is DEAD
2025-10-02T09:34:53.424366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:53.424376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Write session will restart in 0.008374s
2025-10-02T09:34:53.424393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Write session: Do CDS request
2025-10-02T09:34:53.424398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:53.431729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:53.433072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:53.433191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:53.433199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:53.433207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:53.433235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:53.433264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555553112976070:6953]
2025-10-02T09:34:53.433687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:53.433898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:53.433925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:53.434118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.434145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:53.434181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.434187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.434188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.434189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.434189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.434190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.434191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.434191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.434192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.434193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.434193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.434194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.434197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.434205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.434207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.434210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.434212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.434214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.434216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.434219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.434221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.434224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.434236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:53.434226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.434243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2551
2025-10-02T09:34:53.434228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.434233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.434238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.434242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.434246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.434248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.434251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.434254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.434257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.434260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.434263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.434265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.434268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.434271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.434274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.434277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.434280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.434282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.434286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.434288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.434291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.434294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.434297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.434301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.434304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.434323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:53.434342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.434362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:53.434368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:53.434370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:53.434609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2551 sessionId:  describe result for acl check
2025-10-02T09:34:53.434639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:53.434640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:53.434641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:53.434645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555553188547502:4733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:53.434972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555553188547502:4733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:53.436225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555553188547502:4733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:53.440723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555553188547502:4733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:53.440731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555553188547502:4733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:53.440733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555553188547502:4733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:53.440737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:53.442071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:53.443614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:53.443628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:53.443630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:53.443632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:53.443636Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2550 [2:7556555553112976070:6953]
2025-10-02T09:34:53.443648Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:53.443660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:53.443667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.443669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.443670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.443681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:53.443684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:53.443690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:53.443728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.443734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.443736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.443738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:53.443740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:53.443789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:53.443796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.443803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.443809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.443817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:53.443836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547398:2446], now have 1 active actors on pipe
2025-10-02T09:34:53.443843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547537:4733], now have 1 active actors on pipe
2025-10-02T09:34:53.443849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.443850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.443852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.443861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:53.443872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:53.443870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2550
2025-10-02T09:34:53.443878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:53.443871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2550
2025-10-02T09:34:53.443880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:53.443882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:53.443885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:53.443887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:53.443903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.443910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:53.443912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:53.443926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.443932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.443962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b421790e-206b5719-55a95cdb-6c93128_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:53.443971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.443973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.443974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:53.443982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.443989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:53.444004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.444116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.444123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.444132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.444196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2551 partition: 0 MaxSeqNo: 36 sessionId: src_id|b421790e-206b5719-55a95cdb-6c93128_0
2025-10-02T09:34:53.444400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95b9dd7-fe89d2ee-2ba3d0ed-644c1969_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b421790e-206b5719-55a95cdb-6c93128_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:53.446964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Write session: try to update token
2025-10-02T09:34:53.446979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:53.453670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:53.453687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:53.453689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:53.453690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:53.453696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.453700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.453703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555553112976065:6953]
2025-10-02T09:34:53.453728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:53.453731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:53.453733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.453735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:53.453735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:53.453737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:53.453873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:53.460245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId: src_id|b421790e-206b5719-55a95cdb-6c93128_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.462485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:53.523990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555553188547545:4103]
2025-10-02T09:34:53.524182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2550, pipe: [1:7556555553188547545:4103]
2025-10-02T09:34:53.582860Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:53.583296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.583309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.583326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547545:4103], now have 1 active actors on pipe
2025-10-02T09:34:53.583494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555553188547545:4103]
2025-10-02T09:34:53.583509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:53.583512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:53.583512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:53.583544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:53.583562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2551 reason: error at write: Disconnected sessionId: src_id|b421790e-206b5719-55a95cdb-6c93128_0
2025-10-02T09:34:53.583670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2551 sessionId: src_id|b421790e-206b5719-55a95cdb-6c93128_0 is DEAD
2025-10-02T09:34:53.583800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:53.583814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Write session will restart in 0.005933s
2025-10-02T09:34:53.583833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Write session: Do CDS request
2025-10-02T09:34:53.583838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:53.591151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.591251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:53.591259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2552
2025-10-02T09:34:53.591347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.591367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:53.591373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:53.591375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:53.591547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:53.591642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2552 sessionId:  describe result for acl check
2025-10-02T09:34:53.591665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:53.591669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:53.591670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:53.591673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555553188547646:4735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:53.592026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555553188547646:4735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:53.592771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:53.592900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:53.592910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:53.592918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:53.592948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:53.592976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555553112976209:6961]
2025-10-02T09:34:53.593396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:53.593422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555553188547646:4735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:53.593608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:53.593645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:53.593857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:53.593894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.593899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.593900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.593900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.593901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.593902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.593902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.593903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.593903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.593904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.593904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.593905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.593908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.593915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.593917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.593920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.593922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.593924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.593926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.593928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.593930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.593932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.593935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.593937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.593941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.593945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.593949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.593952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.593954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.593958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.593960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.593963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.593966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.593969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.593971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.593974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.593976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.593979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.593982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.593985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.593987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.593991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.593993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.593996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.594000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.594003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.594005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.594009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.594027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:53.597968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555553188547646:4735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:53.597976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555553188547646:4735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:53.597978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555553188547646:4735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:53.597981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:53.601844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:53.603456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:53.603471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:53.603472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:53.603475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:53.603479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2551 [2:7556555553112976209:6961]
2025-10-02T09:34:53.603490Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:53.603502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:53.603508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.603510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.603511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.603522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:53.603525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:53.603532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:53.603573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.603579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.603580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.603583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:53.603584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:53.603630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:53.603636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.603644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.603650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.603659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:53.603678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547686:4735], now have 1 active actors on pipe
2025-10-02T09:34:53.603685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547546:2446], now have 1 active actors on pipe
2025-10-02T09:34:53.603690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.603691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.603693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.603701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:53.603707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2551
2025-10-02T09:34:53.603718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:53.603711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2551
2025-10-02T09:34:53.603717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:53.603719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:53.603720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:53.603736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:53.603740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:53.603772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.603779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.603789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.603799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:53.603808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:53.603819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:53.603824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.603826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.603828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:53.603834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.603845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:53.603866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.603969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.603978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.603987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.604049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2552 partition: 0 MaxSeqNo: 36 sessionId: src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0
2025-10-02T09:34:53.604266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b421790e-206b5719-55a95cdb-6c93128_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:53.606812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Write session: try to update token
2025-10-02T09:34:53.606826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:53.613631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:53.613647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:53.613648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:53.613650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:53.613656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.613660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.613663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555553112976204:6961]
2025-10-02T09:34:53.613691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:53.613691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:53.613697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:53.613700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.613700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:53.613702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:53.613839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:53.618858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId: src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.620927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:53.683724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555553188547694:4103]
2025-10-02T09:34:53.683900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2551, pipe: [1:7556555553188547694:4103]
2025-10-02T09:34:53.744984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:53.745318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.745332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.745349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547694:4103], now have 1 active actors on pipe
2025-10-02T09:34:53.745543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:53.745578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:53.745578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555553188547694:4103]
2025-10-02T09:34:53.745586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:53.745591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:53.745637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2552 reason: error at write: Disconnected sessionId: src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0
2025-10-02T09:34:53.745773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2552 sessionId: src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0 is DEAD
2025-10-02T09:34:53.745932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:53.745946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Write session will restart in 0.006869s
2025-10-02T09:34:53.745970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Write session: Do CDS request
2025-10-02T09:34:53.745975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:53.753495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:53.754203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.754267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:53.754275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2553
2025-10-02T09:34:53.754407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.754427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:53.754433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:53.754436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:53.754705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2553 sessionId:  describe result for acl check
2025-10-02T09:34:53.754727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:53.754732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:53.754735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:53.754738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555553188547797:4737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:53.754766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:53.754907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:53.754917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:53.754924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:53.754956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:53.754988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555553112976349:6959]
2025-10-02T09:34:53.755097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555553188547797:4737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:53.755434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:53.755673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:53.755705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:53.755943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:53.755982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.755989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.755989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.755990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.755991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.755991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.755992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.755992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.755993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.755994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.755994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.755995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.755998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.756005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.756007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.756010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.756012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.756014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.756016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.756019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.756021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.756023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.756026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.756028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.756032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.756037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.756040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.756044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.756047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.756050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.756052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.756055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.756058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.756061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.756063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.756066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.756069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.756072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.756075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.756078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.756081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.756085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.756088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.756091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.756094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.756097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.756099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.756102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.756121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:53.756264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555553188547797:4737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:53.760880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555553188547797:4737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:53.760891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555553188547797:4737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:53.760893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555553188547797:4737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:53.760897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:53.763664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:53.765271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:53.765285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:53.765286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:53.765289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:53.765294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2552 [2:7556555553112976349:6959]
2025-10-02T09:34:53.765303Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:53.765313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:53.765320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.765322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.765323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.765335Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:53.765339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:53.765346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:53.765391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.765398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.765399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.765402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:53.765403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:53.765443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:53.765451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.765458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.765463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.765472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:53.765489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547836:4737], now have 1 active actors on pipe
2025-10-02T09:34:53.765495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547695:2446], now have 1 active actors on pipe
2025-10-02T09:34:53.765500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.765501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.765503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.765512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:53.765523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:53.765525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:53.765527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:53.765524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2552
2025-10-02T09:34:53.765528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:53.765535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:53.765535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2552
2025-10-02T09:34:53.765537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:53.765553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.765559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:53.765562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:53.765572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.765578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.765611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:53.765622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.765626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.765628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:53.765637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.765648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:53.765660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.765762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.765771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.765782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.765868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2553 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0
2025-10-02T09:34:53.766104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06ffefa-d83083df-531e8c7f-f32c6335_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:53.768592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Write session: try to update token
2025-10-02T09:34:53.768603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:53.775016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:53.775033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:53.775034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:53.775036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:53.775042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.775046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.775051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555553112976344:6959]
2025-10-02T09:34:53.775076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:53.775083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:53.775086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:53.775087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.775089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:53.775089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:53.775221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:53.780721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId: src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.782931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:53.845513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555553188547844:4103]
2025-10-02T09:34:53.845705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2552, pipe: [1:7556555553188547844:4103]
2025-10-02T09:34:53.904625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:53.905097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.905110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.905127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547844:4103], now have 1 active actors on pipe
2025-10-02T09:34:53.905289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:53.905311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:53.905318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:53.905330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555553188547844:4103]
2025-10-02T09:34:53.905341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:53.905357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2553 reason: error at write: Disconnected sessionId: src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0
2025-10-02T09:34:53.905469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2553 sessionId: src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0 is DEAD
2025-10-02T09:34:53.905603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:53.905617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Write session will restart in 0.007942s
2025-10-02T09:34:53.905661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Write session: Do CDS request
2025-10-02T09:34:53.905667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:53.913447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:53.914218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.914243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:53.914253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2554
2025-10-02T09:34:53.914389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:53.914412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:53.914418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:53.914420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:53.914654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:53.914671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2554 sessionId:  describe result for acl check
2025-10-02T09:34:53.914691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:53.914695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:53.914697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:53.914700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555553188547953:4754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:53.914787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:53.914797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:53.914804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:53.914832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:53.914866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555553112976490:6957]
2025-10-02T09:34:53.915034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555553188547953:4754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:53.915296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:53.915500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:53.915532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:53.915764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:53.915803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.915809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.915810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.915810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.915811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.915811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.915812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.915812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.915813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.915814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.915814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.915815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.915818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.915825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.915828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.915830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.915832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.915835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.915837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.915839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.915841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.915844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.915847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.915849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.915854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.915859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:53.915863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.915866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:53.915868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.915871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:53.915874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.915878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:53.915883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.915888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:53.915892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.915897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:53.915902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.915907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:53.915915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.915918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:53.915920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.915923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:53.915926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.915929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.915932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.915936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.915938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.915941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.915960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:53.916487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555553188547953:4754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:53.920891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555553188547953:4754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:53.920901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555553188547953:4754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:53.920903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555553188547953:4754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:53.920906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:53.923793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:53.925568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:53.925581Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:53.925582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:53.925585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:53.925590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2553 [2:7556555553112976490:6957]
2025-10-02T09:34:53.925598Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:53.925610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:53.925620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.925624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.925625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.925639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:53.925649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:53.925654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:53.925693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.925700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.925701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.925703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:53.925705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:53.925752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:53.925758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.925765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:53.925771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:53.925780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:53.925799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547850:2446], now have 1 active actors on pipe
2025-10-02T09:34:53.925806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555553188547992:4754], now have 1 active actors on pipe
2025-10-02T09:34:53.925810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.925812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.925813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.925822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:53.925835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:53.925837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:53.925831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2553
2025-10-02T09:34:53.925840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:53.925841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:53.925847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:53.925842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2553
2025-10-02T09:34:53.925849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:53.925867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.925871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:53.925872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:53.925888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.925897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.925934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:53.925943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:53.925946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:53.925947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:53.925954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:53.925965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:53.925983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.926104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:53.926113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:53.926126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:53.926196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2554 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0
2025-10-02T09:34:53.926403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d35a0a-a168897e-9acd5c13-31a88c5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:53.929126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Write session: try to update token
2025-10-02T09:34:53.929144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:53.935793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:53.935810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:53.935812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:53.935814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:53.935821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.935824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.935828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555553112976485:6957]
2025-10-02T09:34:53.935860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:53.935863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:53.935870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:53.935872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:53.935873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:53.935875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:53.936042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:53.941472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId: src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:53.943729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.005264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483515298:4103]
2025-10-02T09:34:54.005423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2553, pipe: [1:7556555557483515298:4103]
2025-10-02T09:34:54.065436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:54.065718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.065730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.065747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515298:4103], now have 1 active actors on pipe
2025-10-02T09:34:54.065906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:54.065910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483515298:4103]
2025-10-02T09:34:54.065924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:54.065925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:54.065964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2554 reason: error at write: Disconnected sessionId: src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0
2025-10-02T09:34:54.066089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2554 sessionId: src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0 is DEAD
2025-10-02T09:34:54.066146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:54.066217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:54.066229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Write session will restart in 0.005627s
2025-10-02T09:34:54.066248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Write session: Do CDS request
2025-10-02T09:34:54.066253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:54.073099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.073205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:54.073213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2555
2025-10-02T09:34:54.073310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.073331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:54.073336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:54.073339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:54.073581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2555 sessionId:  describe result for acl check
2025-10-02T09:34:54.073603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:54.073607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:54.073608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:54.073611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555557483515428:4772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:54.073654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:54.073885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555557483515428:4772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:54.075004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:54.075102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555557483515428:4772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:54.075151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:54.075162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:54.075171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:54.075203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:54.075235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555557407943978:6934]
2025-10-02T09:34:54.075669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:54.075901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:54.075937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:54.076173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:54.076213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.076219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.076220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.076221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.076221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.076222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.076223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.076223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.076224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.076225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.076225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.076226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.076229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.076236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.076238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.076241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.076244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.076246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.076248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.076250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.076253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.076255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.076258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.076260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.076265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.076270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.076274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.076277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.076279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.076283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.076285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.076289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.076291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.076294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.076297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.076300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.076302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.076305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.076309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.076312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.076315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.076318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.076321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.076324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.076326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.076329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.076331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.076334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.076355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:54.076814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555557483515428:4772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:54.076822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555557483515428:4772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:54.076825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555557483515428:4772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:54.076829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:54.083869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:54.085527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:54.085543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:54.085544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:54.085547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:54.085552Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2554 [2:7556555557407943978:6934]
2025-10-02T09:34:54.085561Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:54.085573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:54.085580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.085581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.085583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.085594Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:54.085597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:54.085603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:54.085653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.085661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.085663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.085665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:54.085667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:54.085800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2554
2025-10-02T09:34:54.085801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2554
2025-10-02T09:34:54.085861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:54.085871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.085883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.085896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.085913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:54.085932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515325:2446], now have 1 active actors on pipe
2025-10-02T09:34:54.085940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515464:4772], now have 1 active actors on pipe
2025-10-02T09:34:54.085957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.085964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.085978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.085984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.085987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.085997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:54.086012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:54.086012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:54.086015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:54.086016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:54.086025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:54.086027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:54.086039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:54.086048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.086050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.086051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:54.086058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.086068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:54.086090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.086100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:54.086107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.086109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:54.086236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.086245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.086256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.086315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2555 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0
2025-10-02T09:34:54.086506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b9ccb3-c03ea15-dd87c3f7-729a47c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:54.089090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Write session: try to update token
2025-10-02T09:34:54.089101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:54.095681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:54.095695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:54.095696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:54.095698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:54.095703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.095706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.095708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555557407943973:6934]
2025-10-02T09:34:54.095731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:54.095732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:54.095734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:54.095736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.095736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:54.095737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:54.095879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:54.101413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId: src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:54.103567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.166034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483515484:4103]
2025-10-02T09:34:54.166200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2554, pipe: [1:7556555557483515484:4103]
2025-10-02T09:34:54.213670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:54.213892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.213901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.213913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515484:4103], now have 1 active actors on pipe
2025-10-02T09:34:54.214108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:54.214149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:54.214168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483515484:4103]
2025-10-02T09:34:54.214185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:54.214240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0
2025-10-02T09:34:54.214372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2555 sessionId: src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0 is DEAD
2025-10-02T09:34:54.214552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:54.214566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Write session will restart in 0.005014s
2025-10-02T09:34:54.214590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Write session: Do CDS request
2025-10-02T09:34:54.214595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:54.220140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.220240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:54.220249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2556
2025-10-02T09:34:54.220343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.220362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:54.220367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:54.220369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:54.220714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2556 sessionId:  describe result for acl check
2025-10-02T09:34:54.220739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:54.220744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:54.220745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:54.220748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555557483515550:4793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:54.221096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555557483515550:4793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:54.222672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555557483515550:4793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:54.222788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:54.224047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:54.224198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:54.224207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:54.224216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:54.224220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555557483515550:4793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:54.224228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555557483515550:4793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:54.224230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555557483515550:4793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:54.224233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:54.224255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:54.224315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555557407944121:6927]
2025-10-02T09:34:54.224781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:54.224995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:54.225026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:54.225277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:54.225318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.225324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.225325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.225326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.225327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.225327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.225328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.225328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.225329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.225330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.225331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.225331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.225335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.225342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.225344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.225346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.225349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.225351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.225355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.225359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.225363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.225368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.225371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.225375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.225382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.225387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.225393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.225397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.225399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.225403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.225405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.225408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.225412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.225415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.225418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.225421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.225424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.225427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.225429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.225433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.225436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.225438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.225441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.225444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.225448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.225451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.225453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.225456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.225476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:54.233394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:54.235312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:54.235327Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:54.235329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:54.235332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:54.235338Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2555 [2:7556555557407944121:6927]
2025-10-02T09:34:54.235351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:54.235374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:54.235380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.235382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.235383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.235398Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:54.235406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:54.235411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:54.235612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2555
2025-10-02T09:34:54.235618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2555
2025-10-02T09:34:54.235457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.235464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.235465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.235468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:54.235470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:54.235527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:54.235529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.235537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.235543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.235552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:54.235569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515487:2446], now have 1 active actors on pipe
2025-10-02T09:34:54.235573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515626:4793], now have 1 active actors on pipe
2025-10-02T09:34:54.235578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.235581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.235582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.235594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:54.235609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:54.235609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:54.235612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:54.235614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:54.235624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:54.235627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:54.235651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.235654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:54.235656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:54.235672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.235674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.235714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83333b4f-ca7635c5-9a064d48-1570abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:54.235719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.235722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.235724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:54.235732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.235739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:54.235751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.235866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.235877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.235888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.235946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2556 partition: 0 MaxSeqNo: 36 sessionId: src_id|83333b4f-ca7635c5-9a064d48-1570abb_0
2025-10-02T09:34:54.236179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3fe7b0c-a6421773-12f5ae7a-b55e09d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83333b4f-ca7635c5-9a064d48-1570abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:54.238940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Write session: try to update token
2025-10-02T09:34:54.238958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:54.245616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:54.245632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:54.245634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:54.245635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:54.245643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.245646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.245649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555557407944116:6927]
2025-10-02T09:34:54.245684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:54.245687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:54.245693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:54.245694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.245696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:54.245696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:54.245822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:54.253498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId: src_id|83333b4f-ca7635c5-9a064d48-1570abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:54.255689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.314504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483515640:4103]
2025-10-02T09:34:54.314649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2555, pipe: [1:7556555557483515640:4103]
2025-10-02T09:34:54.375707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:54.376071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.376084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.376101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515640:4103], now have 1 active actors on pipe
2025-10-02T09:34:54.376264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:54.376263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:54.376290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:54.376293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:54.376294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483515640:4103]
2025-10-02T09:34:54.376338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2556 reason: error at write: Disconnected sessionId: src_id|83333b4f-ca7635c5-9a064d48-1570abb_0
2025-10-02T09:34:54.376450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2556 sessionId: src_id|83333b4f-ca7635c5-9a064d48-1570abb_0 is DEAD
2025-10-02T09:34:54.376597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:54.376611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Write session will restart in 0.005210s
2025-10-02T09:34:54.376630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Write session: Do CDS request
2025-10-02T09:34:54.376635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:54.383177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.383249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:54.383257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2557
2025-10-02T09:34:54.383347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.383366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:54.383372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:54.383374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:54.383638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2557 sessionId:  describe result for acl check
2025-10-02T09:34:54.383660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:54.383664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:54.383665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:54.383668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555557483515747:4795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:54.383989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:54.384010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555557483515747:4795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:54.385239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:54.385379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:54.385389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:54.385397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:54.385429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:54.385462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555557407944267:6929]
2025-10-02T09:34:54.385663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555557483515747:4795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:54.385900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:54.386080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:54.386107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:54.386328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:54.386370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.386375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.386376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.386377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.386378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.386380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.386381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.386382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.386383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.386384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.386385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.386386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.386390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.386401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.386405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.386407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.386409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.386412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.386414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.386416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.386418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.386421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.386423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.386425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.386430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.386435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.386440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.386443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.386446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.386449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.386451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.386454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.386458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.386461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.386464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.386466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.386469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.386472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.386474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.386477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.386479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.386482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.386484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.386490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.386493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.386495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.386504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.386531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:54.390470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555557483515747:4795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:54.390479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555557483515747:4795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:54.390480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555557483515747:4795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:54.390484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:54.394388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:54.396306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:54.396321Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:54.396323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:54.396325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:54.396330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2556 [2:7556555557407944267:6929]
2025-10-02T09:34:54.396339Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:54.396355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:54.396361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.396364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.396366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.396380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:54.396392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:54.396399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:54.396445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.396451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.396453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.396456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:54.396458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:54.396509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:54.396518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.396526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.396532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.396546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:54.396566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515642:2446], now have 1 active actors on pipe
2025-10-02T09:34:54.396574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515787:4795], now have 1 active actors on pipe
2025-10-02T09:34:54.396579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.396580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.396582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.396574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2556
2025-10-02T09:34:54.396590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2556
2025-10-02T09:34:54.396596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:54.396605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:54.396608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:54.396609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:54.396610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:54.396620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:54.396628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:54.396665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.396672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.396682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.396689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:54.396699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:54.396711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:54.396716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.396718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.396720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:54.396728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.396740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:54.396754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.396870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.396878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.396890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.396949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2557 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0
2025-10-02T09:34:54.397167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83333b4f-ca7635c5-9a064d48-1570abb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:54.399722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Write session: try to update token
2025-10-02T09:34:54.399734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:54.406549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:54.406567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:54.406569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:54.406571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:54.406578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.406582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.406585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555557407944262:6929]
2025-10-02T09:34:54.406613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:54.406621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:54.406625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:54.406628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:54.406631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.406634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:54.406764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:54.412442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId: src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:54.414632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.476301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483515794:4103]
2025-10-02T09:34:54.476438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2556, pipe: [1:7556555557483515794:4103]
2025-10-02T09:34:54.536855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:54.537346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.537361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.537379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515794:4103], now have 1 active actors on pipe
2025-10-02T09:34:54.537548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:54.537562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:54.537555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:54.537572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483515794:4103]
2025-10-02T09:34:54.537589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:54.537594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2557 reason: error at write: Disconnected sessionId: src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0
2025-10-02T09:34:54.537693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2557 sessionId: src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0 is DEAD
2025-10-02T09:34:54.537853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:54.537868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Write session will restart in 0.007997s
2025-10-02T09:34:54.537892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Write session: Do CDS request
2025-10-02T09:34:54.537898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:54.545218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:54.546429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:54.546572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:54.546582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:54.546589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:54.546620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:54.546660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555557407944412:6923]
2025-10-02T09:34:54.547104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:54.547154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.547276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:54.547284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2558
2025-10-02T09:34:54.547319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:54.547352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:54.547393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.547412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:54.547414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:54.547417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:54.547588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:54.547630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.547635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.547636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.547637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.547637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.547638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.547638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.547639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.547640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.547640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.547641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.547641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.547644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.547651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.547654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.547656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.547671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2558 sessionId:  describe result for acl check
2025-10-02T09:34:54.547658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.547663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.547666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.547670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.547688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:54.547674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.547692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:54.547678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.547694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:54.547682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.547696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555557483515905:4802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:54.547686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.547693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.547698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.547703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.547706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.547709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.547712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.547715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.547718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.547721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.547724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.547726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.547729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.547732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.547735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.547739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.547742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.547745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.547747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.547750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.547753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.547755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.547758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.547760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.547763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.547782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:54.548025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555557483515905:4802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:54.549340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555557483515905:4802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:54.553282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555557483515905:4802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:54.553292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555557483515905:4802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:54.553294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555557483515905:4802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:54.553298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:54.555652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:54.557359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:54.557376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:54.557377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:54.557380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:54.557385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2557 [2:7556555557407944412:6923]
2025-10-02T09:34:54.557399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:54.557420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:54.557427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.557429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.557430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.557442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:54.557451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:54.557456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:54.557496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.557503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.557504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.557507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:54.557509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:54.557554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:54.557561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.557569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.557575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.557584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:54.557603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515942:4802], now have 1 active actors on pipe
2025-10-02T09:34:54.557610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515796:2446], now have 1 active actors on pipe
2025-10-02T09:34:54.557615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.557617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.557619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.557629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:54.557643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:54.557645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:54.557648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:54.557650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:54.557638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2557
2025-10-02T09:34:54.557662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:54.557639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2557
2025-10-02T09:34:54.557665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:54.557698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.557706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.557719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.557730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:54.557739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:54.557754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:54.557763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.557766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.557767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:54.557775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.557786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:54.557911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.558037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.558044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.558054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.558114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2558 partition: 0 MaxSeqNo: 36 sessionId: src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0
2025-10-02T09:34:54.558322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a6bb43-9dcdd5fc-b45569a9-e4f0ea1a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:54.560857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Write session: try to update token
2025-10-02T09:34:54.560868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:54.567646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:54.567667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:54.567668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:54.567670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:54.567675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.567679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.567682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555557407944407:6923]
2025-10-02T09:34:54.567710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:54.567711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:54.567715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.567717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:54.567724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:54.567728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:54.567887Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:54.572578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId: src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:54.574632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.637581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483515949:4103]
2025-10-02T09:34:54.637800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2557, pipe: [1:7556555557483515949:4103]
2025-10-02T09:34:54.700738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:54.701105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.701119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.701145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515949:4103], now have 1 active actors on pipe
2025-10-02T09:34:54.701341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483515949:4103]
2025-10-02T09:34:54.701361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:54.701366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:54.701364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:54.701369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:54.701422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2558 reason: error at write: Disconnected sessionId: src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0
2025-10-02T09:34:54.701542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2558 sessionId: src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0 is DEAD
2025-10-02T09:34:54.701680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:54.701691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Write session will restart in 0.009805s
2025-10-02T09:34:54.701710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Write session: Do CDS request
2025-10-02T09:34:54.701716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:54.709526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:54.710817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:54.710954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:54.710963Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:54.710971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:54.711005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:54.711041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555557407944558:6921]
2025-10-02T09:34:54.711488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:54.711686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:54.711713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:54.711945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:54.711985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.711991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.711992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.711992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.711993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.711994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.711994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.711995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.711996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.711996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.711997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.711997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.712001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.712009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.712013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.712017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.712021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.712025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.712028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.712033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.712037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.712041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.712045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.712049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.712054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.712059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.712062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.712065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.712068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.712070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.712074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.712076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.712079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.712082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.712085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.712088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.712091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.712099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.712101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.712104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.712107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.712111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.712115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.712122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.712125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.712127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.712131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.712137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.712152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:54.712191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:54.712199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2559
2025-10-02T09:34:54.712270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.712294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:54.712301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:54.712304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:54.712619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2559 sessionId:  describe result for acl check
2025-10-02T09:34:54.712642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:54.712646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:54.712648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:54.712651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555557483516063:4814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:54.713007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555557483516063:4814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:54.714214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555557483516063:4814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:54.718684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555557483516063:4814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:54.718692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555557483516063:4814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:54.718694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555557483516063:4814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:54.718697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:54.720092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:54.721937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:54.721953Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:54.721955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:54.721957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:54.721961Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2558 [2:7556555557407944558:6921]
2025-10-02T09:34:54.721970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:54.721982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:54.721989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.721991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.721993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.722007Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:54.722018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:54.722025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:54.722072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.722079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.722081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.722083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:54.722085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:54.722130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:54.722137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.722144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.722150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.722164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:54.722183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483515951:2446], now have 1 active actors on pipe
2025-10-02T09:34:54.722190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483516098:4814], now have 1 active actors on pipe
2025-10-02T09:34:54.722196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.722198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.722199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.722208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:54.722212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2558
2025-10-02T09:34:54.722218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2558
2025-10-02T09:34:54.722223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:54.722224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:54.722227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:54.722229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:54.722235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:54.722237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:54.722272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.722282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.722295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.722305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:54.722315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:54.722328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:54.722333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.722335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.722337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:54.722344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.722359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:54.722374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.722493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.722503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.722526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.722619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2559 partition: 0 MaxSeqNo: 36 sessionId: src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0
2025-10-02T09:34:54.722801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4edb6b6f-fa08b7d8-ebeab42-3d61f0ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:54.725410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Write session: try to update token
2025-10-02T09:34:54.725424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:54.732239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:54.732255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:54.732257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:54.732258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:54.732264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.732267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.732273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555557407944553:6921]
2025-10-02T09:34:54.732303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:54.732303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:54.732307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:54.732310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:54.732312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.732314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:54.732443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:54.737538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId: src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:54.739817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.801435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483516105:4103]
2025-10-02T09:34:54.801614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2558, pipe: [1:7556555557483516105:4103]
2025-10-02T09:34:54.861971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:54.862419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.862432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.862450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483516105:4103], now have 1 active actors on pipe
2025-10-02T09:34:54.862660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:54.862669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483516105:4103]
2025-10-02T09:34:54.862673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:54.862694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:54.862696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:54.862743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2559 reason: error at write: Disconnected sessionId: src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0
2025-10-02T09:34:54.862876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2559 sessionId: src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0 is DEAD
2025-10-02T09:34:54.863021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:54.863036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Write session will restart in 0.008404s
2025-10-02T09:34:54.863062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Write session: Do CDS request
2025-10-02T09:34:54.863067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:54.872073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:54.872187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.872262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:54.872281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2560
2025-10-02T09:34:54.872393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:54.872419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:54.872428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:54.872432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:54.872795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2560 sessionId:  describe result for acl check
2025-10-02T09:34:54.872839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:54.872845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:54.872847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:54.872852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555557483516222:4832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:54.873292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555557483516222:4832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:54.873502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:54.873722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:54.873732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:54.873741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:54.873779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:54.873808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555557407944705:6915]
2025-10-02T09:34:54.874220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:54.874397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:54.874425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:54.874658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555557483516222:4832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:54.874690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:54.874730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.874736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.874737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.874738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.874739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.874739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.874740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.874740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.874741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.874742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.874743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.874743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.874746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.874753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.874756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.874758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.874760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.874762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.874765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.874767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.874769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.874772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.874774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.874776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.874781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.874785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:54.874790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.874793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:54.874798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.874802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:54.874804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.874807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:54.874810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.874813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:54.874815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.874818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:54.874821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.874824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:54.874828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.874831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:54.874833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.874836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:54.874839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.874841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.874844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.874847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.874850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.874853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.874874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:54.879710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555557483516222:4832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:54.879730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555557483516222:4832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:54.879732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555557483516222:4832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:54.879737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:54.882448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:54.884105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:54.884121Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:54.884122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:54.884124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:54.884128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2559 [2:7556555557407944705:6915]
2025-10-02T09:34:54.884138Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:54.884150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:54.884156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.884158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.884159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.884171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:54.884174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:54.884182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:54.884220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.884226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.884227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.884230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:54.884232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:54.884280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:54.884287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.884294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:54.884300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:54.884309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:54.884329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483516107:2446], now have 1 active actors on pipe
2025-10-02T09:34:54.884337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483516265:4832], now have 1 active actors on pipe
2025-10-02T09:34:54.884341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.884343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.884344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.884354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:54.884366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:54.884368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:54.884370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:54.884371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:54.884372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2559
2025-10-02T09:34:54.884379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:54.884381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:54.884378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2559
2025-10-02T09:34:54.884396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.884403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:54.884405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:54.884423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.884430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.884455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:54.884464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:54.884466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:54.884468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:54.884475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:54.884486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:54.884503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.884634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:54.884642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:54.884651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:54.884718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2560 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0
2025-10-02T09:34:54.884971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731ffe53-1f9eb7e2-a6659ee8-aec71dee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:54.887489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Write session: try to update token
2025-10-02T09:34:54.887502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:54.893794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:54.893808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:54.893809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:54.893811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:54.893818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.893822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.893826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555557407944700:6915]
2025-10-02T09:34:54.893860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:54.893862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:54.893865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:54.893868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:54.893871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:54.893873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:54.894061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:54.900641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId: src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:54.902754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:54.962709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555557483516277:4103]
2025-10-02T09:34:54.962869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2559, pipe: [1:7556555557483516277:4103]
2025-10-02T09:34:55.022576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.022914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.022926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.022944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555557483516277:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.023126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.023153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.023155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.023159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555557483516277:4103]
2025-10-02T09:34:55.023203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2560 reason: error at write: Disconnected sessionId: src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0
2025-10-02T09:34:55.023200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:55.023325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2560 sessionId: src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0 is DEAD
2025-10-02T09:34:55.023476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.023489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Write session will restart in 0.007237s
2025-10-02T09:34:55.023514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Write session: Do CDS request
2025-10-02T09:34:55.023519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.031470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.032164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.032247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.032254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2561
2025-10-02T09:34:55.032363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.032386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.032392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.032394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.032720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2561 sessionId:  describe result for acl check
2025-10-02T09:34:55.032751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.032756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.032757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.032762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778483685:4833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.032857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.033045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.033057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.033066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.033105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.033153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702912149:6913]
2025-10-02T09:34:55.033269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778483685:4833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.033589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.033796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.033828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.034050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.034090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.034096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.034097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.034098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.034098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.034099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.034100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.034100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.034101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.034101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.034102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.034103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.034106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.034113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.034116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.034118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.034121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.034123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.034125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.034128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.034130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.034132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.034135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.034137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.034141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.034146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.034150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.034154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.034156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.034159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.034162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.034165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.034167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.034170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.034173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.034176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.034178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.034181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.034184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.034187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.034190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.034195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.034197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.034200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.034203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.034206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.034208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.034212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.034233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.034717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778483685:4833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.038940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778483685:4833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.038950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778483685:4833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.038952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778483685:4833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.038955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.041681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.043216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.043229Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.043231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.043234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.043237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2560 [2:7556555561702912149:6913]
2025-10-02T09:34:55.043246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.043260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.043265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.043267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.043268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.043277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.043284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.043288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.043335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.043341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.043342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.043344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.043345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.043391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.043396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.043404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.043409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.043421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.043436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483724:4833], now have 1 active actors on pipe
2025-10-02T09:34:55.043443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.043445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.043446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.043455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.043465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483575:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.043473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.043474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.043476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.043464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2560
2025-10-02T09:34:55.043478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.043483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.043467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2560
2025-10-02T09:34:55.043485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.043515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.043521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.043528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.043534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.043547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.043556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.043562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.043565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.043566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.043574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.043585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.043604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.043699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.043714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.043737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.043808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2561 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0
2025-10-02T09:34:55.044009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c044ce-b152d9eb-79311eb8-5f57178c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.046558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Write session: try to update token
2025-10-02T09:34:55.046571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.052619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.052632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.052633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.052634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.052638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.052640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.052643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702912144:6913]
2025-10-02T09:34:55.052664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.052670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.052673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.052678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.052690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.052693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.052787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.059489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId: src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.061663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.123474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778483753:4103]
2025-10-02T09:34:55.123638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2560, pipe: [1:7556555561778483753:4103]
2025-10-02T09:34:55.164118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.164404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.164413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.164426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483753:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.164600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.164611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.164626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778483753:4103]
2025-10-02T09:34:55.164645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.164661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2561 reason: error at write: Disconnected sessionId: src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0
2025-10-02T09:34:55.164670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:55.164790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2561 sessionId: src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0 is DEAD
2025-10-02T09:34:55.164949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.164964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Write session will restart in 0.009511s
2025-10-02T09:34:55.164984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Write session: Do CDS request
2025-10-02T09:34:55.164990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.172886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.174115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.174247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.174256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.174264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.174294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.174327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702912348:6869]
2025-10-02T09:34:55.174762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.174954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.174981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.175204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.175197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.175239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.175246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.175246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.175247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.175247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.175248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.175249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.175250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.175250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.175251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.175251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.175252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.175255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.175262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.175265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.175268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.175270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.175272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.175274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.175276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.175279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.175281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.175283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.175286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.175295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.175291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.175303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2562
2025-10-02T09:34:55.175297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.175301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.175305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.175307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.175310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.175313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.175316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.175319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.175322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.175324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.175327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.175330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.175334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.175336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.175339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.175342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.175346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.175348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.175351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.175354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.175357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.175360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.175363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.175382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.175418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.175436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.175438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.175441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.175701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2562 sessionId:  describe result for acl check
2025-10-02T09:34:55.175720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.175725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.175726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.175729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778483881:4861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.176077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778483881:4861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.177647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778483881:4861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.181593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778483881:4861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.181601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778483881:4861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.181603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778483881:4861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.181606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.182874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.184590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.184605Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.184607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.184609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.184613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2561 [2:7556555561702912348:6869]
2025-10-02T09:34:55.184623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.184636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.184644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.184645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.184647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.184659Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.184662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.184667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.184707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.184714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.184716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.184718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.184720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.184770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.184777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.184785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.184791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.184815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.184834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483766:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.184841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483917:4861], now have 1 active actors on pipe
2025-10-02T09:34:55.184847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.184836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2561
2025-10-02T09:34:55.184848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.184850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.184857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.184853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2561
2025-10-02T09:34:55.184872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.184877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.184879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.184880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.184886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.184888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.184921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.184928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.184938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.184949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.184967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.184972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.184976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.184979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.184980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.184987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.184994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.185008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.185119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.185126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.185136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.185197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2562 partition: 0 MaxSeqNo: 36 sessionId: src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0
2025-10-02T09:34:55.185426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c91ebb-2cef03a4-cd8a3bff-c109aca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.187995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Write session: try to update token
2025-10-02T09:34:55.188009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.194409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.194428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.194430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.194431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.194437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.194441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.194444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702912343:6869]
2025-10-02T09:34:55.194475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.194482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.194486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.194486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.194487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.194489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.194628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.201015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId: src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.203313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.264787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778483924:4103]
2025-10-02T09:34:55.265027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2561, pipe: [1:7556555561778483924:4103]
2025-10-02T09:34:55.310352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.310773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.310783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.310795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483924:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.310940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.310965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778483924:4103]
2025-10-02T09:34:55.310969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.310971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.311018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2562 reason: error at write: Disconnected sessionId: src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0
2025-10-02T09:34:55.311030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:55.311147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2562 sessionId: src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0 is DEAD
2025-10-02T09:34:55.311291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.311304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Write session will restart in 0.006844s
2025-10-02T09:34:55.311328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Write session: Do CDS request
2025-10-02T09:34:55.311333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.319174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.319194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.319202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2563
2025-10-02T09:34:55.319411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.319432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.319438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.319441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.319609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.319727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2563 sessionId:  describe result for acl check
2025-10-02T09:34:55.319752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.319757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.319758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.319761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778484038:4876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.320102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778484038:4876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.321132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.321257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.321265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.321273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.321310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.321338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702912498:6880]
2025-10-02T09:34:55.321464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778484038:4876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.321734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.321933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.321967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.322158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.322188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.322192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.322193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.322193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.322194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.322194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.322195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.322195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.322196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.322196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.322197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.322197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.322200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.322206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.322208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.322210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.322212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.322214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.322216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.322218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.322220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.322222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.322224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.322226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.322230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.322234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.322237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.322240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.322242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.322245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.322247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.322249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.322252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.322255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.322257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.322259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.322262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.322267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.322269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.322271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.322276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.322279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.322285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.322287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.322290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.322292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.322297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.322300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.322317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.326112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778484038:4876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.326120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778484038:4876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.326122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778484038:4876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.326125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.329729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.331254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.331265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.331266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.331268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.331271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2562 [2:7556555561702912498:6880]
2025-10-02T09:34:55.331278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.331288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.331290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.331291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.331292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.331301Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.331307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.331311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.331341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.331346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.331347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.331349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.331350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.331390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.331395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.331402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.331407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.331419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.331434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778483927:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.331442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.331448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.331450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.331462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.331472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484078:4876], now have 1 active actors on pipe
2025-10-02T09:34:55.331482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.331483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.331486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.331488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.331479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2562
2025-10-02T09:34:55.331481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2562
2025-10-02T09:34:55.331498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.331504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.331530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.331535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.331542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.331551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.331564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.331571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b8e9631-f649b259-c22268f1-14219fa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.331575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.331577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.331578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.331584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.331589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.331601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.331712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.331719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.331729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.331797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2563 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b8e9631-f649b259-c22268f1-14219fa2_0
2025-10-02T09:34:55.331996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647cf464-b827bdbe-ea1b400d-66ee6c67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b8e9631-f649b259-c22268f1-14219fa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.334933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Write session: try to update token
2025-10-02T09:34:55.334946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.341871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.341884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.341885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.341886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.341892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.341894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.341896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702912493:6880]
2025-10-02T09:34:55.341918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.341921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.341927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.341928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.341932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.341936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.342044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.347927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId: src_id|6b8e9631-f649b259-c22268f1-14219fa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.350019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.411230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778484086:4103]
2025-10-02T09:34:55.411485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2562, pipe: [1:7556555561778484086:4103]
2025-10-02T09:34:55.450769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.451030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.451038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.451050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484086:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.451207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.451229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778484086:4103]
2025-10-02T09:34:55.451238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.451240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.451277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2563 reason: error at write: Disconnected sessionId: src_id|6b8e9631-f649b259-c22268f1-14219fa2_0
2025-10-02T09:34:55.451287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:55.451400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2563 sessionId: src_id|6b8e9631-f649b259-c22268f1-14219fa2_0 is DEAD
2025-10-02T09:34:55.451506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.451515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Write session will restart in 0.005420s
2025-10-02T09:34:55.451529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Write session: Do CDS request
2025-10-02T09:34:55.451534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.458110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.458200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.458208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2564
2025-10-02T09:34:55.458285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.458305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.458307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.458310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.458573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2564 sessionId:  describe result for acl check
2025-10-02T09:34:55.458599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.458603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.458604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.458607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778484179:4879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.458946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778484179:4879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.459982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.460202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778484179:4879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.461543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.461675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.461683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.461690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.461721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.461745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702912651:6879]
2025-10-02T09:34:55.461748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778484179:4879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.461755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778484179:4879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.461758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778484179:4879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.461761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.462149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.462334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.462359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.462550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.462582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.462587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.462587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.462588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.462588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.462589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.462589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.462590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.462591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.462591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.462592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.462592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.462595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.462601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.462603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.462605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.462607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.462609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.462611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.462613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.462615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.462617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.462619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.462621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.462624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.462628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.462631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.462634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.462636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.462638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.462640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.462643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.462646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.462648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.462650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.462653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.462657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.462660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.462663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.462666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.462669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.462671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.462673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.462676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.462680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.462683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.462685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.462688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.462704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.470120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.471647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.471658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.471659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.471661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.471664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2563 [2:7556555561702912651:6879]
2025-10-02T09:34:55.471672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.471682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.471686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.471688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.471689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.471698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.471702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.471706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.471734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.471739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.471740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.471742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.471743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.471784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.471789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.471795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.471800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.471808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.471824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484087:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.471833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.471835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.471836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.471847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.471858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484234:4879], now have 1 active actors on pipe
2025-10-02T09:34:55.471865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.471868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.471871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.471874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.471877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.471880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.471862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2563
2025-10-02T09:34:55.471870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2563
2025-10-02T09:34:55.471899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.471906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.471909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.471916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.471922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.471954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.471962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.471965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.471966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.471974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.471985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.471999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.472110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.472117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.472125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.472193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2564 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0
2025-10-02T09:34:55.472366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8e9631-f649b259-c22268f1-14219fa2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.474861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Write session: try to update token
2025-10-02T09:34:55.474871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.481135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.481149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.481150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.481151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.481156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.481159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.481161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702912646:6879]
2025-10-02T09:34:55.481185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.481188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.481189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.481194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.481201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.481204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.481311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.486636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId: src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.488772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.551515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778484247:4103]
2025-10-02T09:34:55.551770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2563, pipe: [1:7556555561778484247:4103]
2025-10-02T09:34:55.592502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.592722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.592731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.592743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484247:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.592924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.592933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.592944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.592980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778484247:4103]
2025-10-02T09:34:55.592988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2564 reason: error at write: Disconnected sessionId: src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0
2025-10-02T09:34:55.593112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2564 sessionId: src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0 is DEAD
2025-10-02T09:34:55.593238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.593247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Write session will restart in 0.008986s
2025-10-02T09:34:55.593263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Write session: Do CDS request
2025-10-02T09:34:55.593268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.593488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:55.601800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.603118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.603166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.603278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.603285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.603291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.603327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.603355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702912801:6876]
2025-10-02T09:34:55.603429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.603493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2565
2025-10-02T09:34:55.603580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.603604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.603612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.603615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.603716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.603911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2565 sessionId:  describe result for acl check
2025-10-02T09:34:55.603933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.603937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.603941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.603942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.603957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.603945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778484364:4900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.604139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.604168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.604172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.604172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.604173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.604173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.604174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.604174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.604175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.604176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.604176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.604176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.604177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.604180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.604186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.604188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.604190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.604192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.604194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.604196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.604198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.604200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.604202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.604204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.604206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.604209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.604213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.604216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.604219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.604222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.604225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.604227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.604230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.604232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.604235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.604237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.604240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.604242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.604246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.604248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.604251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.604253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.604256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.604258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.604261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.604263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.604265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.604269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.604272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.604290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.604302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778484364:4900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.605680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778484364:4900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.609566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778484364:4900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.609574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778484364:4900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.609576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778484364:4900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.609580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.611772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.613263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.613275Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.613276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.613278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.613281Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2564 [2:7556555561702912801:6876]
2025-10-02T09:34:55.613288Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.613298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.613303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.613305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.613306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.613315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.613318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.613322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.613351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.613356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.613357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.613358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.613360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.613396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.613401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.613407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.613412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.613420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.613435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.613440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.613441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.613448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.613458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.613463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484401:4900], now have 1 active actors on pipe
2025-10-02T09:34:55.613468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.613472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.613473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.613478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.613481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.613485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484248:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.613499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.613507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.613484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2564
2025-10-02T09:34:55.613509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.613490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2564
2025-10-02T09:34:55.613526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.613531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.613548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47b2f56c-959f0487-45887578-8c19f053_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.613555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.613557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.613558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.613563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.613573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.613595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.613735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.613741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.613750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.613820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2565 partition: 0 MaxSeqNo: 36 sessionId: src_id|47b2f56c-959f0487-45887578-8c19f053_0
2025-10-02T09:34:55.614019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0b521-1a5ddcd4-1e1b9496-dab04b64_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47b2f56c-959f0487-45887578-8c19f053_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.616840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Write session: try to update token
2025-10-02T09:34:55.616851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.623842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.623855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.623856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.623857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.623862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.623865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.623867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702912796:6876]
2025-10-02T09:34:55.623891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.623894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.623895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.623897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.623901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.623904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.624002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.629971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId: src_id|47b2f56c-959f0487-45887578-8c19f053_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.632040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.693345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778484409:4103]
2025-10-02T09:34:55.693560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2564, pipe: [1:7556555561778484409:4103]
2025-10-02T09:34:55.733564Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.733905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.733914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.733927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484409:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.734101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778484409:4103]
2025-10-02T09:34:55.734108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.734112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.734123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.734185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2565 reason: error at write: Disconnected sessionId: src_id|47b2f56c-959f0487-45887578-8c19f053_0
2025-10-02T09:34:55.734336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2565 sessionId: src_id|47b2f56c-959f0487-45887578-8c19f053_0 is DEAD
2025-10-02T09:34:55.734457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.734468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Write session will restart in 0.008563s
2025-10-02T09:34:55.734484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Write session: Do CDS request
2025-10-02T09:34:55.734492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.734504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:55.742819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.744172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.744271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.744284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2566
2025-10-02T09:34:55.744373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.744399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.744403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.744408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.744446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.744634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.744643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.744652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.744695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.744718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702912954:6874]
2025-10-02T09:34:55.744787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2566 sessionId:  describe result for acl check
2025-10-02T09:34:55.744826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.744831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.744832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.744835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778484525:4916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.745078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.745184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778484525:4916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.745284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.745309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.745501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.745546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.745551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.745551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.745552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.745553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.745554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.745555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.745556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.745557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.745557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.745558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.745559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.745563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.745572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.745575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.745578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.745581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.745583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.745590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.745593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.745597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.745600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.745606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.745609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.745616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.745626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.745634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.745638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.745645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.745650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.745657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.745661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.745668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.745673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.745680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.745689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.745698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.745706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.745713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.745717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.745726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.745734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.745742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.745746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.745754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.745760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.745767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.745771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.745807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.746384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778484525:4916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.750535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778484525:4916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.750545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778484525:4916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.750547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778484525:4916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.750551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.753212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.754780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.754792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.754793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.754795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.754803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2565 [2:7556555561702912954:6874]
2025-10-02T09:34:55.754815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.754830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.754834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.754836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.754837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.754847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.754854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.754858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.754895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.754899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.754900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.754902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.754904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.754944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.754949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.754955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.754960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.754971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.754984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.754987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.754989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.754994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.755001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.755005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.755009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.755010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.755018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484564:4916], now have 1 active actors on pipe
2025-10-02T09:34:55.755018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.755020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.755021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484410:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.755037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.755044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.755046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.755062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2565
2025-10-02T09:34:55.755065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2565
2025-10-02T09:34:55.755111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.755118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.755136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.755145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.755149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.755151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.755157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.755169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.755184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.755309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.755314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.755322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.755386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2566 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0
2025-10-02T09:34:55.755616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47b2f56c-959f0487-45887578-8c19f053_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.758236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Write session: try to update token
2025-10-02T09:34:55.758248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.764164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:55.764179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.764185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.764212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:55.764218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:55.764354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:55.764472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:55.764587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:55.764705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:55.764944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:55.764972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:55.769956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId: src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.772046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.773217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.773231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.773242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.773243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.773245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.773246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.773250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.773252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.773255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702912949:6874]
2025-10-02T09:34:55.773282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.773284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.773288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.773289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.773290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.773291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.773403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.834140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778484571:4103]
2025-10-02T09:34:55.834367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2565, pipe: [1:7556555561778484571:4103]
2025-10-02T09:34:55.882138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:55.882401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:55.882425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484571:4103], now have 1 active actors on pipe
2025-10-02T09:34:55.882541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:55.882602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778484571:4103]
2025-10-02T09:34:55.882622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:55.882625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:55.882628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:55.882680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2566 reason: error at write: Disconnected sessionId: src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0
2025-10-02T09:34:55.882801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2566 sessionId: src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0 is DEAD
2025-10-02T09:34:55.882934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:55.882943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Write session will restart in 0.009523s
2025-10-02T09:34:55.882958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Write session: Do CDS request
2025-10-02T09:34:55.882963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:55.891143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:55.892493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:55.892614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:55.892621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:55.892628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:55.892656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:55.892728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555561702913108:6872]
2025-10-02T09:34:55.893080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.893100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:55.893160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:55.893171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2567
2025-10-02T09:34:55.893262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:55.893281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:55.893288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:55.893291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:55.893301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:55.893326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:55.893525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:55.893558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.893562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.893554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2567 sessionId:  describe result for acl check
2025-10-02T09:34:55.893563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.893564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.893564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.893565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.893566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.893566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.893567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.893567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.893568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.893568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.893571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.893578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.893580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.893582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.893589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:55.893584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.893594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:55.893595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:55.893598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555561778484698:4919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:55.893586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.893588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.893590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.893592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.893594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.893596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.893598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.893602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.893606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:55.893609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.893612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:55.893614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.893617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:55.893619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.893622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:55.893624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.893627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:55.893630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.893632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:55.893635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.893637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:55.893639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.893642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:55.893645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.893648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:55.893650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.893653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.893655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.893658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.893661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.893664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.893683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:55.893927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555561778484698:4919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:55.895392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555561778484698:4919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:55.899045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555561778484698:4919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:55.899054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555561778484698:4919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:55.899055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555561778484698:4919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:55.899059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:55.901298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:55.902833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:55.902843Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:55.902845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:55.902846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:55.902849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2566 [2:7556555561702913108:6872]
2025-10-02T09:34:55.902858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:55.902867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:55.902873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.902875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.902876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.902884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:55.902888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:55.902892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:55.902923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.902928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.902929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.902931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:55.902932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:55.902967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:55.902971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.902978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:55.902984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:55.902993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:55.903006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.903010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.903011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.903016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:55.903025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484735:4919], now have 1 active actors on pipe
2025-10-02T09:34:55.903028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:55.903031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:55.903032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484576:2446], now have 1 active actors on pipe
2025-10-02T09:34:55.903032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:55.903038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:55.903048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:55.903054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:55.903071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.903066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2566
2025-10-02T09:34:55.903070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2566
2025-10-02T09:34:55.903081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:55.903096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:55.903116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.903122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.903135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72ceda37-52865ad9-f953ded6-22b733a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:55.903142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:55.903144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:55.903145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:55.903150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:55.903157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:55.903167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.903283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:55.903290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:55.903298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:55.903361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2567 partition: 0 MaxSeqNo: 36 sessionId: src_id|72ceda37-52865ad9-f953ded6-22b733a9_0
2025-10-02T09:34:55.903540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff3269a-5bd80da2-68fefe45-5e57b483_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72ceda37-52865ad9-f953ded6-22b733a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:55.906026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Write session: try to update token
2025-10-02T09:34:55.906037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:55.912184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:55.912199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:55.912200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:55.912201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:55.912208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.912210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.912212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555561702913103:6872]
2025-10-02T09:34:55.912235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:55.912241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:55.912243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:55.912245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:55.912248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:55.912251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:55.912375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:55.917421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId: src_id|72ceda37-52865ad9-f953ded6-22b733a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:55.919527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:55.982631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555561778484745:4103]
2025-10-02T09:34:55.982879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2566, pipe: [1:7556555561778484745:4103]
2025-10-02T09:34:56.022471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.022742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.022751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.022762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555561778484745:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.022964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.022975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.022977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555561778484745:4103]
2025-10-02T09:34:56.022991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.023021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2567 reason: error at write: Disconnected sessionId: src_id|72ceda37-52865ad9-f953ded6-22b733a9_0
2025-10-02T09:34:56.023164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2567 sessionId: src_id|72ceda37-52865ad9-f953ded6-22b733a9_0 is DEAD
2025-10-02T09:34:56.023299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.023307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Write session will restart in 0.006732s
2025-10-02T09:34:56.023323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Write session: Do CDS request
2025-10-02T09:34:56.023331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.023321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.031099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.031202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.031214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2568
2025-10-02T09:34:56.031299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.031320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.031327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.031330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.031581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2568 sessionId:  describe result for acl check
2025-10-02T09:34:56.031600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.031605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.031606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.031611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073452158:4936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.031843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.031946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073452158:4936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.033137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073452158:4936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.033273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.033409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.033417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.033424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.033459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.033491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997880559:6866]
2025-10-02T09:34:56.033855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.034055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.034080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.034266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.034303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.034307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.034307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.034308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.034308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.034309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.034309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.034310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.034310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.034311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.034311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.034312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.034315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.034321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.034323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.034325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.034327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.034329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.034332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.034335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.034338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.034343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.034346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.034349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.034354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.034364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.034372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.034380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.034388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.034392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.034399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.034407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.034411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.034419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.034423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.034431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.034435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.034441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.034446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.034451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.034455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.034460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.034466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.034469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.034474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.034477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.034479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.034482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.034505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.034663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073452158:4936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.034670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073452158:4936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.034672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073452158:4936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.034675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.041943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.043389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.043400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.043402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.043403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.043406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2567 [2:7556555565997880559:6866]
2025-10-02T09:34:56.043414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.043423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.043424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.043425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.043427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.043435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.043437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.043441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.043470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.043476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.043477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.043479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.043480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.043516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.043521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.043527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.043532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.043541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.043554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.043558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.043559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.043564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.043572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452043:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.043579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452198:4936], now have 1 active actors on pipe
2025-10-02T09:34:56.043581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.043585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.043585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.043588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.043595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.043599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.043611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2567
2025-10-02T09:34:56.043621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2567
2025-10-02T09:34:56.043614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.043626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.043639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.043650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.043658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.043677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a738e8-93dae837-60939f86-736928af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.043683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.043686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.043687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.043693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.043700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.043707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.043809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.043816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.043825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.043899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2568 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a738e8-93dae837-60939f86-736928af_0
2025-10-02T09:34:56.044113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ceda37-52865ad9-f953ded6-22b733a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a738e8-93dae837-60939f86-736928af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.046629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Write session: try to update token
2025-10-02T09:34:56.046639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.052911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.052925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.052926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.052927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.052932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.052934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.052936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997880554:6866]
2025-10-02T09:34:56.052960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.052963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.052964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.052970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.052977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.052994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.053083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.057923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId: src_id|8a738e8-93dae837-60939f86-736928af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.059952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.123065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073452228:4103]
2025-10-02T09:34:56.123208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2567, pipe: [1:7556555566073452228:4103]
2025-10-02T09:34:56.162505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.162700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.162709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.162734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452228:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.162875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.162914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.162926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.162926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.162957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073452228:4103]
2025-10-02T09:34:56.162969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2568 reason: error at write: Disconnected sessionId: src_id|8a738e8-93dae837-60939f86-736928af_0
2025-10-02T09:34:56.163110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2568 sessionId: src_id|8a738e8-93dae837-60939f86-736928af_0 is DEAD
2025-10-02T09:34:56.163240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.163248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Write session will restart in 0.007054s
2025-10-02T09:34:56.163262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Write session: Do CDS request
2025-10-02T09:34:56.163266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.171220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.171331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.171339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2569
2025-10-02T09:34:56.171429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.171449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.171455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.171458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.171716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.171739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2569 sessionId:  describe result for acl check
2025-10-02T09:34:56.171763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.171767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.171768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.171771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073452358:4964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.172108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073452358:4964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.173247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.173366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.173374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.173380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.173409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.173435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997880765:6847]
2025-10-02T09:34:56.173453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073452358:4964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.173805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.174006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.174039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.174226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.174258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.174262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.174263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.174263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.174264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.174264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.174265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.174265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.174266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.174266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.174267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.174267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.174270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.174275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.174278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.174280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.174282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.174284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.174286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.174288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.174290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.174292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.174294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.174296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.174300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.174305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.174308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.174311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.174313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.174316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.174318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.174321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.174323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.174326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.174329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.174331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.174337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.174340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.174342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.174348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.174351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.174353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.174355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.174358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.174360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.174363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.174367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.174369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.174386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.178236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073452358:4964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.178245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073452358:4964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.178246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073452358:4964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.178250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.181840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.183235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.183247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.183248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.183250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.183253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2568 [2:7556555565997880765:6847]
2025-10-02T09:34:56.183260Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.183271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.183272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.183274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.183275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.183283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.183290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.183294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.183324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.183330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.183331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.183333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.183334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.183374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.183378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.183384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.183389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.183401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.183414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.183418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.183420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.183426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.183437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452241:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.183439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.183444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.183444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452398:4964], now have 1 active actors on pipe
2025-10-02T09:34:56.183446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.183451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.183461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.183467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.183462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2568
2025-10-02T09:34:56.183464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2568
2025-10-02T09:34:56.183483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.183492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.183495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.183513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.183522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.183546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|308cdbe-52f1f728-582b572-a103331d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.183554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.183557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.183558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.183565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.183576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.183599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.183693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.183699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.183707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.183773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2569 partition: 0 MaxSeqNo: 36 sessionId: src_id|308cdbe-52f1f728-582b572-a103331d_0
2025-10-02T09:34:56.183997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a738e8-93dae837-60939f86-736928af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|308cdbe-52f1f728-582b572-a103331d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.186865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Write session: try to update token
2025-10-02T09:34:56.186881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.192613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.192626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.192627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.192628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.192633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.192635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.192637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997880760:6847]
2025-10-02T09:34:56.192658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.192661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.192662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.192673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.192677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.192680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.192767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.199357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId: src_id|308cdbe-52f1f728-582b572-a103331d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.201407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.263191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073452406:4103]
2025-10-02T09:34:56.263410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2568, pipe: [1:7556555566073452406:4103]
2025-10-02T09:34:56.302012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.302410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.302420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.302432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452406:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.302607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.302608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.302621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.302628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.302658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073452406:4103]
2025-10-02T09:34:56.302670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2569 reason: error at write: Disconnected sessionId: src_id|308cdbe-52f1f728-582b572-a103331d_0
2025-10-02T09:34:56.302805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2569 sessionId: src_id|308cdbe-52f1f728-582b572-a103331d_0 is DEAD
2025-10-02T09:34:56.302934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.302941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Write session will restart in 0.008473s
2025-10-02T09:34:56.302957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Write session: Do CDS request
2025-10-02T09:34:56.302961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.312084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.312217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.312289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.312297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2570
2025-10-02T09:34:56.312379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.312400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.312406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.312409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.312660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2570 sessionId:  describe result for acl check
2025-10-02T09:34:56.312680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.312681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.312682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.312685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073452527:4976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.313040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073452527:4976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.313522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.313673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.313683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.313692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.313733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.313767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997880922:6845]
2025-10-02T09:34:56.314187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.314211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073452527:4976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.314389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.314425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.314761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.314806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.314810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.314811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.314811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.314812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.314813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.314813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.314814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.314814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.314815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.314815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.314816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.314819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.314825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.314827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.314829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.314831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.314834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.314836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.314838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.314840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.314842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.314844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.314846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.314850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.314855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.314858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.314860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.314863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.314866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.314868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.314871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.314874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.314877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.314879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.314881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.314887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.314889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.314892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.314894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.314900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.314903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.314905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.314910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.314912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.314915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.314918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.314924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.314941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.318855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073452527:4976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.318863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073452527:4976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.318865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073452527:4976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.318869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.322576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.323987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.323998Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.324000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.324002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.324005Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2569 [2:7556555565997880922:6845]
2025-10-02T09:34:56.324013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.324023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.324025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.324026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.324028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.324036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.324041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.324045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.324074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.324080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.324081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.324083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.324084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.324122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.324127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.324133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.324138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.324148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.324161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.324165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.324166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.324172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.324180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452409:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.324182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.324186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.324188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.324190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.324202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.324208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.324213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452567:4976], now have 1 active actors on pipe
2025-10-02T09:34:56.324231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2569
2025-10-02T09:34:56.324234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2569
2025-10-02T09:34:56.324229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.324240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.324253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.324324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.324332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.324351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.324359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.324362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.324363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.324370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.324382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.324396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.324546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.324551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.324559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.324627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2570 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0
2025-10-02T09:34:56.324854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|308cdbe-52f1f728-582b572-a103331d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.327491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Write session: try to update token
2025-10-02T09:34:56.327501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.333583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.333597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.333598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.333599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.333604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.333608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.333610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997880917:6845]
2025-10-02T09:34:56.333632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.333635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.333638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.333643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.333659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.333662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.333772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.338705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId: src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.340744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.402965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073452575:4103]
2025-10-02T09:34:56.403169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2569, pipe: [1:7556555566073452575:4103]
2025-10-02T09:34:56.442072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.442337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.442346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.442370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452575:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.442523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.442535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.442541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073452575:4103]
2025-10-02T09:34:56.442558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.442560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.442601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2570 reason: error at write: Disconnected sessionId: src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0
2025-10-02T09:34:56.442731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2570 sessionId: src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0 is DEAD
2025-10-02T09:34:56.442884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.442899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Write session will restart in 0.005627s
2025-10-02T09:34:56.442923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Write session: Do CDS request
2025-10-02T09:34:56.442929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.449152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.449186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.449195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2571
2025-10-02T09:34:56.449277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.449302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.449309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.449312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.449588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2571 sessionId:  describe result for acl check
2025-10-02T09:34:56.449610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.449615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.449616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.449619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073452664:4993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.449959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073452664:4993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.451170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.451452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073452664:4993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.452543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.452689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.452698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.452707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.452756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.452785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997881080:6837]
2025-10-02T09:34:56.452977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073452664:4993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.452984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073452664:4993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.452986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073452664:4993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.452989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.453258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.453455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.453487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.453680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.453709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.453713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.453714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.453714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.453715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.453715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.453716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.453717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.453717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.453718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.453718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.453719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.453722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.453727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.453729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.453731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.453733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.453735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.453737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.453739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.453741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.453743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.453745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.453747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.453750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.453754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.453757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.453760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.453763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.453766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.453768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.453771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.453774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.453776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.453778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.453781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.453783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.453786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.453788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.453791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.453794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.453796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.453799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.453802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.453804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.453807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.453809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.453811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.453830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.461258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.462835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.462846Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.462847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.462849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.462853Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2570 [2:7556555565997881080:6837]
2025-10-02T09:34:56.462859Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.462868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.462870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.462872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.462873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.462882Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.462888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.462892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.462921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.462926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.462927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.462929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.462930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.462967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.462973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.462979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.462984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.462995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.463011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452730:4993], now have 1 active actors on pipe
2025-10-02T09:34:56.463016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452576:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.463021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.463023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.463024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.463036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.463049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.463053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.463057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.463058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.463064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.463066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.463062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2570
2025-10-02T09:34:56.463063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2570
2025-10-02T09:34:56.463081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.463088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.463090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.463109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.463114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.463133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71afe281-a8df869d-38691a6a-39a5b35a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.463140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.463147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.463149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.463154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.463164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.463185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.463295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.463301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.463309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.463373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2571 partition: 0 MaxSeqNo: 36 sessionId: src_id|71afe281-a8df869d-38691a6a-39a5b35a_0
2025-10-02T09:34:56.463558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d509b92-c0e6db54-df2eb9e5-aee49f80_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71afe281-a8df869d-38691a6a-39a5b35a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.466072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Write session: try to update token
2025-10-02T09:34:56.466083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.472272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.472287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.472289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.472290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.472297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.472299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.472301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997881075:6837]
2025-10-02T09:34:56.472324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.472329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.472330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.472341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.472364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.472367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.472435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.478130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId: src_id|71afe281-a8df869d-38691a6a-39a5b35a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.480299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.542746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073452743:4103]
2025-10-02T09:34:56.542980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2570, pipe: [1:7556555566073452743:4103]
2025-10-02T09:34:56.583248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.583501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.583511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.583523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452743:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.583682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.583715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.583724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.583731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073452743:4103]
2025-10-02T09:34:56.583744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.583781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2571 reason: error at write: Disconnected sessionId: src_id|71afe281-a8df869d-38691a6a-39a5b35a_0
2025-10-02T09:34:56.583898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2571 sessionId: src_id|71afe281-a8df869d-38691a6a-39a5b35a_0 is DEAD
2025-10-02T09:34:56.584011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.584021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Write session will restart in 0.007942s
2025-10-02T09:34:56.584036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Write session: Do CDS request
2025-10-02T09:34:56.584041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.592535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.593221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.593280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.593291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2572
2025-10-02T09:34:56.593394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.593414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.593420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.593423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.593697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2572 sessionId:  describe result for acl check
2025-10-02T09:34:56.593720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.593725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.593726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.593728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073452868:4997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.593862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.593986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.593991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.593997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.594024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.594051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997881239:6835]
2025-10-02T09:34:56.594081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073452868:4997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.594394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.594591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.594616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.594796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.594825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.594829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.594829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.594830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.594831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.594831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.594832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.594832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.594833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.594834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.594834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.594835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.594838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.594844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.594846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.594848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.594850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.594852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.594854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.594856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.594859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.594861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.594863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.594865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.594868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.594872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.594875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.594877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.594880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.594882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.594884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.594887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.594891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.594894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.594896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.594899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.594901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.594903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.594905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.594908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.594910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.594913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.594916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.594919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.594922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.594925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.594927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.594929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.594945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.595349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073452868:4997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.599773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073452868:4997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.599783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073452868:4997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.599785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073452868:4997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.599789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.602460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.604040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.604051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.604052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.604054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.604058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2571 [2:7556555565997881239:6835]
2025-10-02T09:34:56.604065Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.604074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.604076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.604078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.604079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.604088Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.604092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.604095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.604129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.604135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.604136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.604138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.604139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.604178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.604183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.604189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.604194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.604207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.604219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.604224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.604225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.604230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.604238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452747:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.604242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.604245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452907:4997], now have 1 active actors on pipe
2025-10-02T09:34:56.604246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.604248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.604248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.604255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.604257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.604271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.604281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.604294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2571
2025-10-02T09:34:56.604298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2571
2025-10-02T09:34:56.604294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.604376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.604383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.604399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.604406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.604408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.604409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.604414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.604422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.604433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.604567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.604571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.604579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.604646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2572 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0
2025-10-02T09:34:56.604896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71afe281-a8df869d-38691a6a-39a5b35a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.607732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Write session: try to update token
2025-10-02T09:34:56.607751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.613463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.613474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.613475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.613477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.613480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.613485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.613487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997881234:6835]
2025-10-02T09:34:56.613507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.613511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.613512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.613519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.613523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.613526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.613624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.619893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId: src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.622116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.684061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073452915:4103]
2025-10-02T09:34:56.684273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2571, pipe: [1:7556555566073452915:4103]
2025-10-02T09:34:56.726359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.726629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.726638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.726652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452915:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.726891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.726871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073452915:4103]
2025-10-02T09:34:56.726874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.726905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.726907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.726963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2572 reason: error at write: Disconnected sessionId: src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0
2025-10-02T09:34:56.727115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2572 sessionId: src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0 is DEAD
2025-10-02T09:34:56.727277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.727290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Write session will restart in 0.006829s
2025-10-02T09:34:56.727310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Write session: Do CDS request
2025-10-02T09:34:56.727315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.735173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.735210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.735281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.735292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2573
2025-10-02T09:34:56.735390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.735409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.735412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.735414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.735683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2573 sessionId:  describe result for acl check
2025-10-02T09:34:56.735703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.735707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.735709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.735711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073453038:5006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.736060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073453038:5006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.736539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.736638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.736645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.736651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.736676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.736700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997881400:6829]
2025-10-02T09:34:56.737056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.737247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.737270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.737446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.737476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.737480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.737481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.737482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.737482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.737483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.737483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.737484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.737484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.737485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.737485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.737486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.737489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.737494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.737496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.737499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.737501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.737503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.737505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.737507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.737509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.737511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.737513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.737515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.737519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.737523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.737526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.737529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.737532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.737535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.737537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.737540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.737543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.737546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.737548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.737551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.737553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.737556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.737558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.737561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.737564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.737566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.737569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.737572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.737575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.737577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.737579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.737582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.737600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.737706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073453038:5006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.742412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073453038:5006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.742421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073453038:5006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.742423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073453038:5006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.742428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.745155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.746855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.746867Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.746869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.746871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.746875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2572 [2:7556555565997881400:6829]
2025-10-02T09:34:56.746883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.746894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.746896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.746897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.746898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.746908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.746911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.746916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.746953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.746958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.746959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.746961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.746963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.747003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.747008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.747015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.747020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.747030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.747045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.747050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.747053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.747058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.747069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073453077:5006], now have 1 active actors on pipe
2025-10-02T09:34:56.747072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.747074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073452916:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.747075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.747077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.747079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.747087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.747088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.747105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.747115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.747126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2572
2025-10-02T09:34:56.747140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2572
2025-10-02T09:34:56.747126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.747195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.747201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.747218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.747225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.747227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.747228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.747234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.747240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.747252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.747374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.747379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.747386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.747453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2573 partition: 0 MaxSeqNo: 36 sessionId: src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0
2025-10-02T09:34:56.747731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8fdda4-41648597-ce33e37c-9d8bdc3a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.750351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Write session: try to update token
2025-10-02T09:34:56.750366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.760171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:56.760186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.760191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.760218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:56.760226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:56.760364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:56.760484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:56.760604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:56.760721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:56.760906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:56.760933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:56.763216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId: src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.764704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.764716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.764718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.764718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.764724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.764727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.764729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997881395:6829]
2025-10-02T09:34:56.764751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.764756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.764758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.764759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.764762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.764765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.764891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.765651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.826908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073453084:4103]
2025-10-02T09:34:56.827151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2572, pipe: [1:7556555566073453084:4103]
2025-10-02T09:34:56.874170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:56.874360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.874369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.874382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073453084:4103], now have 1 active actors on pipe
2025-10-02T09:34:56.874574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:56.874581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:56.874584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:56.874609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073453084:4103]
2025-10-02T09:34:56.874638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2573 reason: error at write: Disconnected sessionId: src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0
2025-10-02T09:34:56.874785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2573 sessionId: src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0 is DEAD
2025-10-02T09:34:56.874929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:56.874942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Write session will restart in 0.007463s
2025-10-02T09:34:56.874923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:56.874968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Write session: Do CDS request
2025-10-02T09:34:56.874975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:56.882851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:56.883160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.883420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:56.883429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2574
2025-10-02T09:34:56.883539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:56.883565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:56.883573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:56.883576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:56.883858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2574 sessionId:  describe result for acl check
2025-10-02T09:34:56.883883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:56.883888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:56.883889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:56.883892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555566073453213:5020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:56.884159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:56.884238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555566073453213:5020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:56.884266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:56.884273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:56.884278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:56.884305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:56.884329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555565997881561:6825]
2025-10-02T09:34:56.884663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:56.884880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:56.884902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:56.885073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:56.885104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.885108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.885109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.885109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.885110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.885110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.885111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.885112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.885112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.885113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.885114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.885114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.885117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.885123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.885125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.885127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.885129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.885131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.885133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.885135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.885137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.885139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.885141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.885143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.885147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.885150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:56.885154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.885157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:56.885159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.885161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:56.885163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.885166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:56.885169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.885173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:56.885175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.885177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:56.885180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.885183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:56.885186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.885190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:56.885192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.885199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:56.885202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.885205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.885207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.885211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.885213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.885216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.885232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:56.885573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555566073453213:5020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:56.889956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555566073453213:5020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:56.889966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555566073453213:5020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:56.889968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555566073453213:5020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:56.889972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:56.892653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:56.894215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:56.894227Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:56.894228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:56.894231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:56.894234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2573 [2:7556555565997881561:6825]
2025-10-02T09:34:56.894242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:56.894252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:56.894256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.894258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.894259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.894267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:56.894270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:56.894274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:56.894304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.894309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.894310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.894312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:56.894313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:56.894353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:56.894357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.894364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:56.894369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:56.894380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:56.894394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073453090:2446], now have 1 active actors on pipe
2025-10-02T09:34:56.894400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073453252:5020], now have 1 active actors on pipe
2025-10-02T09:34:56.894403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.894404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.894405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.894413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:56.894423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:56.894434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:56.894418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2573
2025-10-02T09:34:56.894432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:56.894437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:56.894438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:56.894438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:56.894419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2573
2025-10-02T09:34:56.894461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.894466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.894474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.894483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:56.894498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:56.894502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6064cf39-9d78db5a-df45dcec-cf967752_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:56.894505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:56.894508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:56.894509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:56.894522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:56.894528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:56.894539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.894645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:56.894650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:56.894657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:56.894715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2574 partition: 0 MaxSeqNo: 36 sessionId: src_id|6064cf39-9d78db5a-df45dcec-cf967752_0
2025-10-02T09:34:56.894918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda240f1-4d1ceb19-a3720e1a-347db52c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6064cf39-9d78db5a-df45dcec-cf967752_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:56.897560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Write session: try to update token
2025-10-02T09:34:56.897569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:56.903674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:56.903689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:56.903690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:56.903691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:56.903695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.903698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.903699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555565997881556:6825]
2025-10-02T09:34:56.903721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:56.903723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:56.903725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:56.903734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:56.903738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:56.903772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:56.903835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:56.909760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId: src_id|6064cf39-9d78db5a-df45dcec-cf967752_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:56.911853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:56.974870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555566073453266:4103]
2025-10-02T09:34:56.975048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2573, pipe: [1:7556555566073453266:4103]
2025-10-02T09:34:57.012246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.012552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.012561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.012573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555566073453266:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.012798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.012833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:57.012842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555566073453266:4103]
2025-10-02T09:34:57.012847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:57.012855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.012902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2574 reason: error at write: Disconnected sessionId: src_id|6064cf39-9d78db5a-df45dcec-cf967752_0
2025-10-02T09:34:57.013030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2574 sessionId: src_id|6064cf39-9d78db5a-df45dcec-cf967752_0 is DEAD
2025-10-02T09:34:57.013138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:57.013146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Write session will restart in 0.007263s
2025-10-02T09:34:57.013161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Write session: Do CDS request
2025-10-02T09:34:57.013165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.021097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.021182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.021191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2575
2025-10-02T09:34:57.021271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.021296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.021303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.021306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.021570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2575 sessionId:  describe result for acl check
2025-10-02T09:34:57.021593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.021598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.021599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.021601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368420686:5019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.021800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.021939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368420686:5019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.023377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368420686:5019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.023398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.023499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.023505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.023511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.023536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.023559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292849019:6814]
2025-10-02T09:34:57.023895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.024108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.024130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.024305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.024334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.024339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.024339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.024340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.024340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.024341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.024342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.024342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.024343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.024343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.024344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.024344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.024347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.024353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.024355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.024357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.024359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.024362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.024363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.024365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.024367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.024369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.024372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.024373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.024377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.024381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.024384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.024386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.024389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.024391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.024394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.024396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.024398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.024401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.024403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.024406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.024408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.024411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.024413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.024416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.024418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.024420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.024422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.024425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.024427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.024430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.024432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.024434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.024454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.024875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368420686:5019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.024883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368420686:5019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.024884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368420686:5019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.024889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.031884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.033408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.033419Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.033420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.033422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.033426Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2574 [2:7556555570292849019:6814]
2025-10-02T09:34:57.033433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.033442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.033443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.033445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.033446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.033456Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.033458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.033464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.033581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.033586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.033587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.033589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.033591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.033629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.033634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.033640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.033645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.033653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.033665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.033670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.033671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.033676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.033684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420563:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.033687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.033689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420726:5019], now have 1 active actors on pipe
2025-10-02T09:34:57.033690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.033691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.033694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.033701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.033703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.033717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.033727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.033732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2574
2025-10-02T09:34:57.033737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2574
2025-10-02T09:34:57.033745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.033825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.033831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.033846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|902990f7-641eb140-d16c2427-e6d02416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.033854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.033857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.033858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.033863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.033872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.033883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.034020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.034024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.034036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.034102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2575 partition: 0 MaxSeqNo: 36 sessionId: src_id|902990f7-641eb140-d16c2427-e6d02416_0
2025-10-02T09:34:57.034290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6064cf39-9d78db5a-df45dcec-cf967752_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|902990f7-641eb140-d16c2427-e6d02416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.036918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Write session: try to update token
2025-10-02T09:34:57.036926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.042539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:57.042553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.042558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.042582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:57.042594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:57.042745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:57.042866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:57.042980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:57.043095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:57.043359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:57.043386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:57.049280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId: src_id|902990f7-641eb140-d16c2427-e6d02416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.051025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.051039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.051041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.051042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.051046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.051048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.051051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292849014:6814]
2025-10-02T09:34:57.051073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.051076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.051078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.051086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.051098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.051102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.051193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.051381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.113103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368420738:4103]
2025-10-02T09:34:57.113281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2574, pipe: [1:7556555570368420738:4103]
2025-10-02T09:34:57.159639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.159908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.159916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.159928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420738:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.160122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.160140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368420738:4103]
2025-10-02T09:34:57.160160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:57.160162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:57.160200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2575 reason: error at write: Disconnected sessionId: src_id|902990f7-641eb140-d16c2427-e6d02416_0
2025-10-02T09:34:57.160335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2575 sessionId: src_id|902990f7-641eb140-d16c2427-e6d02416_0 is DEAD
2025-10-02T09:34:57.160465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:57.160470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Write session will restart in 0.006282s
2025-10-02T09:34:57.160485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Write session: Do CDS request
2025-10-02T09:34:57.160492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.160469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.168076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.168204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.168212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2576
2025-10-02T09:34:57.168319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.168337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.168342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.168345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.168592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2576 sessionId:  describe result for acl check
2025-10-02T09:34:57.168618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.168624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.168626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.168630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368420893:5041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.168860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.168983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368420893:5041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.170228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.170324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.170327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368420893:5041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.170331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.170336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.170360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.170384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292849231:6797]
2025-10-02T09:34:57.170725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.170916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.170939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.171106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.171136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.171140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.171140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.171141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.171141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.171142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.171143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.171143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.171144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.171144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.171145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.171145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.171148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.171153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.171155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.171158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.171160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.171162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.171163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.171165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.171167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.171169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.171171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.171173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.171177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.171180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.171184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.171187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.171189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.171192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.171194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.171197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.171199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.171202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.171204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.171207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.171210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.171212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.171214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.171217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.171219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.171222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.171224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.171226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.171228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.171231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.171233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.171236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.171254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.175075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368420893:5041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.175084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368420893:5041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.175086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368420893:5041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.175090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.178667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.180370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.180380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.180382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.180383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.180386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2575 [2:7556555570292849231:6797]
2025-10-02T09:34:57.180394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.180404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.180407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.180409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.180410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.180419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.180422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.180426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.180455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.180461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.180461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.180463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.180465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.180502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.180506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.180513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.180518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.180527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.180540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.180544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.180545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.180550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.180557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420933:5041], now have 1 active actors on pipe
2025-10-02T09:34:57.180560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.180564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.180564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.180565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.180571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.180572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.180575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420769:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.180588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.180594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.180600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.180607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2575
2025-10-02T09:34:57.180610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2575
2025-10-02T09:34:57.180636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.180641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.180657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.180665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.180668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.180669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.180673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.180681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.180689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.180831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.180836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.180843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.180911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2576 partition: 0 MaxSeqNo: 36 sessionId: src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0
2025-10-02T09:34:57.181074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902990f7-641eb140-d16c2427-e6d02416_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.183575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Write session: try to update token
2025-10-02T09:34:57.183585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.189764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.189776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.189778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.189779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.189783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.189785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.189787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292849226:6797]
2025-10-02T09:34:57.189808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.189811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.189812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.189826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.189831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.189837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.189936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.196731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId: src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.198973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.260071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368420941:4103]
2025-10-02T09:34:57.260289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2575, pipe: [1:7556555570368420941:4103]
2025-10-02T09:34:57.298153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.298363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.298371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.298384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420941:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.298548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.298551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:57.298563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:57.298571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368420941:4103]
2025-10-02T09:34:57.298585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.298616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2576 reason: error at write: Disconnected sessionId: src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0
2025-10-02T09:34:57.298743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2576 sessionId: src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0 is DEAD
2025-10-02T09:34:57.298868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:57.298873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Write session will restart in 0.007312s
2025-10-02T09:34:57.298888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Write session: Do CDS request
2025-10-02T09:34:57.298892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.307077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.307252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.307262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2577
2025-10-02T09:34:57.307368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.307388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.307394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.307398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.307388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.307699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2577 sessionId:  describe result for acl check
2025-10-02T09:34:57.307724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.307728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.307730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.307732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368421070:5051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.308079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368421070:5051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.308837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.308931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.308937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.308943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.308967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.308992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292849394:6796]
2025-10-02T09:34:57.309329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.309499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368421070:5051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.309506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.309529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.309708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.309738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.309742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.309742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.309743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.309744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.309744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.309745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.309745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.309746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.309746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.309747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.309748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.309750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.309756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.309758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.309760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.309762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.309764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.309766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.309768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.309770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.309772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.309774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.309776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.309779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.309783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.309786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.309789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.309791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.309794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.309796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.309799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.309801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.309804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.309806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.309808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.309811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.309814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.309816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.309819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.309821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.309824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.309828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.309831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.309837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.309839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.309841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.309844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.309866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.313635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368421070:5051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.313643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368421070:5051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.313645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368421070:5051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.313648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.317286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.318755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.318767Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.318768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.318770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.318774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2576 [2:7556555570292849394:6796]
2025-10-02T09:34:57.318781Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.318791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.318793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.318794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.318795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.318804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.318807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.318811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.318841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.318847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.318848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.318850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.318851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.318889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.318894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.318900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.318906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.318917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.318930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.318935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.318936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.318941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.318949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368420944:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.318955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421109:5051], now have 1 active actors on pipe
2025-10-02T09:34:57.318954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.318958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.318960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.318961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.318967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.318969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.318982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.318991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.318990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2576
2025-10-02T09:34:57.318993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2576
2025-10-02T09:34:57.319008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.319035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.319040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.319055Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.319062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.319064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.319066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.319071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.319079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.319090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.319213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.319218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.319226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.319290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2577 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0
2025-10-02T09:34:57.319470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62296b3-271acc5c-8220ff8-d70b2a00_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.321998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Write session: try to update token
2025-10-02T09:34:57.322009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.328103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.328121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.328122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.328123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.328127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.328129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.328132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292849389:6796]
2025-10-02T09:34:57.328154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.328158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.328163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.328163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.328171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.328175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.328270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.333885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId: src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.335983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.398810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368421117:4103]
2025-10-02T09:34:57.399046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2576, pipe: [1:7556555570368421117:4103]
2025-10-02T09:34:57.435697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.436081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.436091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.436104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421117:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.436257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.436292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.436311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368421117:4103]
2025-10-02T09:34:57.436328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:57.436376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0
2025-10-02T09:34:57.436515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2577 sessionId: src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0 is DEAD
2025-10-02T09:34:57.436630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:57.436635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Write session will restart in 0.006396s
2025-10-02T09:34:57.436651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Write session: Do CDS request
2025-10-02T09:34:57.436655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.444205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.444325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.444336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2578
2025-10-02T09:34:57.444451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.444472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.444479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.444481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.444750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2578 sessionId:  describe result for acl check
2025-10-02T09:34:57.444778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.444786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.444787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.444790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368421244:5079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.444955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.445152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368421244:5079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.446365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.446458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.446465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.446471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.446495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.446528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292849559:6793]
2025-10-02T09:34:57.446770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368421244:5079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.446864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.447012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.447034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.447211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.447241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.447245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.447246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.447247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.447247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.447248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.447248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.447249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.447249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.447250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.447250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.447251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.447254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.447259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.447261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.447263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.447265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.447268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.447269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.447271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.447273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.447275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.447277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.447279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.447283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.447287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.447289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.447292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.447294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.447297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.447299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.447301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.447303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.447306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.447308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.447311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.447313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.447316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.447318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.447320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.447323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.447325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.447327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.447331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.447335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.447337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.447339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.447342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.447359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.451134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368421244:5079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.451142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368421244:5079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.451144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368421244:5079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.451147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.454725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.456145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.456156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.456157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.456160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.456163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2577 [2:7556555570292849559:6793]
2025-10-02T09:34:57.456170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.456180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.456185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.456187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.456188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.456198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.456204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.456209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.456241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.456245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.456246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.456248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.456250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.456285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.456289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.456296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.456301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.456312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.456327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421118:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.456332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421284:5079], now have 1 active actors on pipe
2025-10-02T09:34:57.456336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.456341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.456342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.456347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.456355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.456363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.456353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2577
2025-10-02T09:34:57.456365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.456355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2577
2025-10-02T09:34:57.456367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.456371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.456372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.456381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.456383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.456384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.456393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.456398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.456423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.456430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.456432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.456437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.456445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.456451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.456461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.456536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.456542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.456550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.456602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2578 partition: 0 MaxSeqNo: 36 sessionId: src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0
2025-10-02T09:34:57.456832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8b408d0-f9bbcf71-eebdaeb9-b501478b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.459646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Write session: try to update token
2025-10-02T09:34:57.459662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.465391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.465404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.465405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.465406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.465410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.465412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.465415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292849554:6793]
2025-10-02T09:34:57.465433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.465435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.465436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.465437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.465438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.465440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.465547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.472044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId: src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.474294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.536547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368421292:4103]
2025-10-02T09:34:57.536743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2577, pipe: [1:7556555570368421292:4103]
2025-10-02T09:34:57.575251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.575480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.575488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.575501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421292:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.575639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.575670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:57.575679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:57.575699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368421292:4103]
2025-10-02T09:34:57.575714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.575727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2578 reason: error at write: Disconnected sessionId: src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0
2025-10-02T09:34:57.575863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2578 sessionId: src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0 is DEAD
2025-10-02T09:34:57.576040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:57.576054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Write session will restart in 0.009115s
2025-10-02T09:34:57.576080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Write session: Do CDS request
2025-10-02T09:34:57.576086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.583633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.584953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.585051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.585057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.585063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.585090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.585113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292849724:6791]
2025-10-02T09:34:57.585568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.585730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.585751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.585931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.585962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.585966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.585967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.585968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.585968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.585969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.585969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.585970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.585970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.585971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.585972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.585972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.585975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.585982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.585984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.585986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.585988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.585990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.585992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.585994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.585996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.585999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.586001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.586003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.586007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.586010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.586013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.586016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.586018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.586021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.586023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.586026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.586028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.586031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.586033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.586036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.586038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.586040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.586042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.586045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.586047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.586050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.586052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.586055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.586057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.586060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.586065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.586068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.586086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.586179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.586304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.586314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2579
2025-10-02T09:34:57.586439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.586458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.586464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.586467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.586738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2579 sessionId:  describe result for acl check
2025-10-02T09:34:57.586764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.586770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.586772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.586776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368421425:5077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.587115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368421425:5077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.588563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368421425:5077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.592207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368421425:5077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.592214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368421425:5077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.592216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368421425:5077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.592220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.593473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.595101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.595113Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.595115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.595117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.595121Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2578 [2:7556555570292849724:6791]
2025-10-02T09:34:57.595130Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.595140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.595142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.595144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.595144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.595153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.595160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.595164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.595195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.595200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.595201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.595202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.595204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.595238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.595242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.595248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.595253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.595265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.595278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421460:5077], now have 1 active actors on pipe
2025-10-02T09:34:57.595283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421293:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.595287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.595288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.595289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.595296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.595305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.595308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.595310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.595311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.595315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.595317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.595306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2578
2025-10-02T09:34:57.595308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2578
2025-10-02T09:34:57.595330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.595335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.595337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.595344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.595349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.595374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b97714b5-abf967e1-5c498eed-43952e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.595382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.595384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.595385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.595391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.595399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.595408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.595488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.595493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.595500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.595551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2579 partition: 0 MaxSeqNo: 36 sessionId: src_id|b97714b5-abf967e1-5c498eed-43952e6_0
2025-10-02T09:34:57.595779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fc8b8-7d9c1a84-99f27562-56ef20f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b97714b5-abf967e1-5c498eed-43952e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.598389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Write session: try to update token
2025-10-02T09:34:57.598404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.604333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.604346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.604347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.604348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.604352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.604354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.604356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292849719:6791]
2025-10-02T09:34:57.604373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.604375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.604376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.604377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.604377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.604380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.604484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.611301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId: src_id|b97714b5-abf967e1-5c498eed-43952e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.613457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.675819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368421467:4103]
2025-10-02T09:34:57.676038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2578, pipe: [1:7556555570368421467:4103]
2025-10-02T09:34:57.715735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.715967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.715976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.715988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421467:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.716118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.716151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368421467:4103]
2025-10-02T09:34:57.716168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:57.716174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.716261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2579 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b97714b5-abf967e1-5c498eed-43952e6_0
2025-10-02T09:34:57.716395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2579 sessionId: src_id|b97714b5-abf967e1-5c498eed-43952e6_0 is DEAD
2025-10-02T09:34:57.716540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:34:57.716556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Write session will restart in 0.005247s
2025-10-02T09:34:57.716578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Write session: Do CDS request
2025-10-02T09:34:57.716583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.723142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.723210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.723219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2580
2025-10-02T09:34:57.723296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.723321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.723331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.723337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.723585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2580 sessionId:  describe result for acl check
2025-10-02T09:34:57.723606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.723610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.723611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.723614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368421589:5090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.723972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368421589:5090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.724523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.725364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368421589:5090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.725883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.725976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.725982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.725987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.726011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.726033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292849890:6790]
2025-10-02T09:34:57.726368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.726534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.726556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.726732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.726762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.726769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.726770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.726788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368421589:5090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.726770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.726797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368421589:5090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.726771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.726799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368421589:5090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.726772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.726802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.726772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.726773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.726773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.726774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.726774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.726774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.726777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.726783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.726785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.726787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.726789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.726791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.726793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.726795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.726798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.726801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.726803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.726805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.726808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.726812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.726815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.726819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.726821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.726823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.726826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.726828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.726831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.726834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.726836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.726839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.726841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.726844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.726846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.726848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.726851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.726853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.726855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.726858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.726860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.726863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.726866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.726869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.726886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.734246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.735828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.735839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.735840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.735842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.735846Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2579 [2:7556555570292849890:6790]
2025-10-02T09:34:57.735853Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.735863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.735865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.735866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.735867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.735876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.735883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.735887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.735918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.735923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.735924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.735926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.735927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.735961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.735968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.735974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.735979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.735987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.735999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421634:5090], now have 1 active actors on pipe
2025-10-02T09:34:57.736004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421469:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.736008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.736009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.736010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.736018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.736025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.736029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.736031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.736032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.736032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.736034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.736033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2579
2025-10-02T09:34:57.736040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2579
2025-10-02T09:34:57.736048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.736053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.736054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.736062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.736065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.736090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.736097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.736099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.736100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.736104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.736109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.736118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.736196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.736202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.736209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.736262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2580 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0
2025-10-02T09:34:57.736474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97714b5-abf967e1-5c498eed-43952e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.739096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Write session: try to update token
2025-10-02T09:34:57.739113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.745150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.745164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.745165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.745166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.745171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.745173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.745175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292849885:6790]
2025-10-02T09:34:57.745194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.745195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.745197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.745198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.745198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.745199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.745321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.752135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId: src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.754326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.816095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368421644:4103]
2025-10-02T09:34:57.816258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2579, pipe: [1:7556555570368421644:4103]
2025-10-02T09:34:57.856829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.857228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.857236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.857249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421644:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.857367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.857428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:57.857437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.857441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:57.857471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368421644:4103]
2025-10-02T09:34:57.857489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2580 reason: error at write: Disconnected sessionId: src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0
2025-10-02T09:34:57.857628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2580 sessionId: src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0 is DEAD
2025-10-02T09:34:57.857785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:57.857800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Write session will restart in 0.005934s
2025-10-02T09:34:57.857825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Write session: Do CDS request
2025-10-02T09:34:57.857830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:57.865147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.865247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:57.865259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2581
2025-10-02T09:34:57.865361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:57.865383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:57.865391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:57.865394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:57.865483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:57.865688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2581 sessionId:  describe result for acl check
2025-10-02T09:34:57.865714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:57.865719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:57.865720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:57.865723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555570368421776:5092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:57.866096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555570368421776:5092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:57.866769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:57.866875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:57.866882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:57.866887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:57.866914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:57.866936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555570292850057:6783]
2025-10-02T09:34:57.867274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:57.867425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:57.867448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:57.867621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:57.867640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555570368421776:5092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:57.867649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.867653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.867654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.867654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.867655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.867656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.867656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.867657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.867657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.867658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.867658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.867659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.867661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.867667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.867669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.867671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.867673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.867675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.867677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.867679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.867681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.867683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.867685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.867687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.867690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.867695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:57.867698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.867701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:57.867703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.867705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:57.867707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.867710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:57.867712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.867715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:57.867717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.867720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:57.867722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.867725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:57.867727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.867730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:57.867733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.867737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:57.867740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.867742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.867748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.867751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.867753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.867755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.867771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:57.871544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555570368421776:5092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:57.871553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555570368421776:5092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:57.871555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555570368421776:5092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:57.871559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:57.875191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:57.876762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:57.876775Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:57.876776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:57.876779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:57.876782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2580 [2:7556555570292850057:6783]
2025-10-02T09:34:57.876789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:57.876798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:57.876815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.876820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.876821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.876830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:57.876832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:57.876836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:57.876865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.876870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.876871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.876873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:57.876874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:57.876908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:57.876913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.876919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:57.876926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:57.876934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:57.876949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421646:2446], now have 1 active actors on pipe
2025-10-02T09:34:57.876955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421815:5092], now have 1 active actors on pipe
2025-10-02T09:34:57.876959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.876960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.876961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.876967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:57.876975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:57.876977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:57.876979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:57.876980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:57.876986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:57.876987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:57.877000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.877005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:57.877001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2580
2025-10-02T09:34:57.877005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2580
2025-10-02T09:34:57.877017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:57.877024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.877026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.877041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7369acad-7415b254-5a5774e4-2245a008_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:57.877048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:57.877050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:57.877051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:57.877056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:57.877065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:57.877072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.877163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.877168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.877175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:57.877229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2581 partition: 0 MaxSeqNo: 36 sessionId: src_id|7369acad-7415b254-5a5774e4-2245a008_0
2025-10-02T09:34:57.877400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5008a7c-39bcd0ab-a8ddee7a-1cbce7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7369acad-7415b254-5a5774e4-2245a008_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:57.879970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Write session: try to update token
2025-10-02T09:34:57.879980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:57.886709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:57.886726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:57.886728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:57.886730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:57.886736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.886739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.886741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555570292850052:6783]
2025-10-02T09:34:57.886761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:57.886764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:57.886766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:57.886776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:57.886779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:57.886781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:57.886890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:57.892135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId: src_id|7369acad-7415b254-5a5774e4-2245a008_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:57.894396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:57.957397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555570368421832:4103]
2025-10-02T09:34:57.957605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2580, pipe: [1:7556555570368421832:4103]
2025-10-02T09:34:57.997402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:57.997714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:57.997723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:57.997735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421832:4103], now have 1 active actors on pipe
2025-10-02T09:34:57.997957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:57.997955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:57.997962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555570368421832:4103]
2025-10-02T09:34:57.997980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:57.997981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:57.998024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2581 reason: error at write: Disconnected sessionId: src_id|7369acad-7415b254-5a5774e4-2245a008_0
2025-10-02T09:34:57.998167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2581 sessionId: src_id|7369acad-7415b254-5a5774e4-2245a008_0 is DEAD
2025-10-02T09:34:57.998298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:57.998308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Write session will restart in 0.005093s
2025-10-02T09:34:57.998323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Write session: Do CDS request
2025-10-02T09:34:57.998328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.004055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.004173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.004183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2582
2025-10-02T09:34:58.004339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.004361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.004369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.004372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.004707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2582 sessionId:  describe result for acl check
2025-10-02T09:34:58.004732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.004738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.004739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.004742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663389171:5102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.005111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663389171:5102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.006679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663389171:5102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.007716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663389171:5102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.007725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663389171:5102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.007727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663389171:5102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.007730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.007757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.009339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.009438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.009444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.009451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.009474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.009500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587817522:6781]
2025-10-02T09:34:58.009843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.010038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.010061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.010242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.010272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.010276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.010277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.010277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.010278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.010278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.010279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.010279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.010280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.010280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.010281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.010281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.010284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.010290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.010292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.010295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.010297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.010299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.010301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.010303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.010305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.010307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.010309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.010311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.010314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.010318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.010322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.010325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.010327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.010330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.010332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.010335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.010337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.010339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.010341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.010344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.010346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.010349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.010351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.010353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.010358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.010361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.010367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.010370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.010372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.010375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.010377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.010379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.010399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.017889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.019332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.019345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.019346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.019348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.019351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2581 [2:7556555574587817522:6781]
2025-10-02T09:34:58.019360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.019370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.019375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.019376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.019378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.019387Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.019394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.019398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.019429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.019433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.019434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.019436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.019438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.019477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.019481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.019487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.019492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.019503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.019516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.019520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.019522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.019527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.019535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.019545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.019544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.019549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.019549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.019551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.019556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555570368421833:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.019559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389296:5102], now have 1 active actors on pipe
2025-10-02T09:34:58.019571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.019576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.019580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.019584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2581
2025-10-02T09:34:58.019593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2581
2025-10-02T09:34:58.019636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.019641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.019655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.019661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.019664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.019665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.019670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.019676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.019686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.019832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.019837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.019844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.019911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2582 partition: 0 MaxSeqNo: 36 sessionId: src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0
2025-10-02T09:34:58.020128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7369acad-7415b254-5a5774e4-2245a008_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.022918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Write session: try to update token
2025-10-02T09:34:58.022936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.028664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.028677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.028678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.028679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.028683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.028686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.028688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587817516:6781]
2025-10-02T09:34:58.028708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.028712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.028713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.028723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.028728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.028731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.028843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.035488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId: src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.037766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.098211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663389315:4103]
2025-10-02T09:34:58.098442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2581, pipe: [1:7556555574663389315:4103]
2025-10-02T09:34:58.137966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:58.138144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.138153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.138165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389315:4103], now have 1 active actors on pipe
2025-10-02T09:34:58.138284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:58.138299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:58.138311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:58.138333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2582 reason: error at write: Disconnected sessionId: src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0
2025-10-02T09:34:58.138468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2582 sessionId: src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0 is DEAD
2025-10-02T09:34:58.138590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:58.138601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Write session will restart in 0.007306s
2025-10-02T09:34:58.138616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Write session: Do CDS request
2025-10-02T09:34:58.138606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:58.138620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.138632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663389315:4103]
2025-10-02T09:34:58.146968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.147231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.147281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.147292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2583
2025-10-02T09:34:58.147426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.147446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.147452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.147454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.147675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2583 sessionId:  describe result for acl check
2025-10-02T09:34:58.147693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.147697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.147698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.147701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663389473:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.147941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663389473:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.148326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.148428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.148436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.148442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.148468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.148490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587817718:6754]
2025-10-02T09:34:58.148849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.149044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663389473:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.149071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.149093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.149289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.149321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.149326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.149326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.149327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.149327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.149328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.149329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.149329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.149330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.149330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.149331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.149331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.149334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.149340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.149342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.149344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.149347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.149349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.149351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.149352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.149354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.149357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.149359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.149360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.149364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.149368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.149371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.149374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.149376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.149378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.149381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.149383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.149386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.149389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.149391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.149394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.149396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.149399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.149401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.149403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.149405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.149408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.149411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.149413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.149417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.149421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.149423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.149426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.149443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.153267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663389473:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.153276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663389473:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.153277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663389473:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.153280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.156951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.158545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.158557Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.158558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.158560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.158564Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2582 [2:7556555574587817718:6754]
2025-10-02T09:34:58.158571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.158580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.158585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.158587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.158588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.158597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.158603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.158608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.158645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.158649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.158651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.158652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.158653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.158690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.158695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.158701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.158706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.158716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.158730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389510:5108], now have 1 active actors on pipe
2025-10-02T09:34:58.158738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.158739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.158740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.158749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.158757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389320:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.158763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.158770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.158773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.158775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.158785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.158778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2582
2025-10-02T09:34:58.158786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.158797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2582
2025-10-02T09:34:58.158789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.158790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.158792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.158807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.158809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.158826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.158833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.158835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.158836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.158841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.158850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.158858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.158958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.158963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.158970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.159037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2583 partition: 0 MaxSeqNo: 36 sessionId: src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0
2025-10-02T09:34:58.159286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcaec8d-444068dc-329c16c-a5652c0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.161840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Write session: try to update token
2025-10-02T09:34:58.161853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.167939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.167954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.167955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.167955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.167959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.167961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.167963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587817713:6754]
2025-10-02T09:34:58.167984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.167987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.167988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.168001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.168007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.168012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.168140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.173752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId: src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.176026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.239027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663389528:4103]
2025-10-02T09:34:58.239259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2582, pipe: [1:7556555574663389528:4103]
2025-10-02T09:34:58.277021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:58.277305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.277314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.277326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389528:4103], now have 1 active actors on pipe
2025-10-02T09:34:58.277502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:58.277511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:58.277515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:58.277551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:58.277545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663389528:4103]
2025-10-02T09:34:58.277553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2583 reason: error at write: Disconnected sessionId: src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0
2025-10-02T09:34:58.277692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2583 sessionId: src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0 is DEAD
2025-10-02T09:34:58.277843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:58.277857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Write session will restart in 0.009829s
2025-10-02T09:34:58.277884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Write session: Do CDS request
2025-10-02T09:34:58.277891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.286945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.288562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.288711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.288718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.288724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.288756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.288780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587817910:6736]
2025-10-02T09:34:58.289138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.289180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.289321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.289330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2584
2025-10-02T09:34:58.289334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.289359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.289456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.289476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.289482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.289485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.289547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.289589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.289594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.289595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.289595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.289596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.289596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.289597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.289597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.289598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.289598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.289599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.289600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.289602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.289609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.289611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.289613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.289615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.289617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.289619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.289621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.289623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.289626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.289628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.289630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.289634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.289638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.289643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.289645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.289648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.289650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.289652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.289655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.289657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.289660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.289662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.289664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.289667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.289669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.289671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.289674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.289677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.289680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.289682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.289685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.289687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.289690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.289692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.289695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.289717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.289729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2584 sessionId:  describe result for acl check
2025-10-02T09:34:58.289755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.289760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.289760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.289764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663389667:5135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.290118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663389667:5135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.291717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663389667:5135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.296643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663389667:5135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.296651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663389667:5135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.296653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663389667:5135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.296657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.297237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.298712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.298724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.298725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.298727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.298730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2583 [2:7556555574587817910:6736]
2025-10-02T09:34:58.298737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.298746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.298747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.298749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.298750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.298759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.298762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.298767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.298797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.298803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.298804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.298806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.298807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.298842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.298847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.298854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.298859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.298867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.298881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.298885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.298886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.298891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.298898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389529:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.298902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.298904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.298911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.298912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.298916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389702:5135], now have 1 active actors on pipe
2025-10-02T09:34:58.298918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.298920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.298928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.298934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.298934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2583
2025-10-02T09:34:58.298940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2583
2025-10-02T09:34:58.298949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.298973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.298978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.298991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.298998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.299000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.299001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.299006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.299013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.299021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.299166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.299171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.299178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.299249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2584 partition: 0 MaxSeqNo: 36 sessionId: src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0
2025-10-02T09:34:58.299479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e28d683-7c49eb24-b1809ab7-187c9d68_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.302079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Write session: try to update token
2025-10-02T09:34:58.302093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.307819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:58.307831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.307834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.307853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:58.307866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:58.307981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:58.308094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.308202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.308309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.308449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:58.308471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:58.314943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId: src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.316224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.316237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.316238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.316239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.316243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.316245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.316247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587817905:6736]
2025-10-02T09:34:58.316266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.316273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.316274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.316285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.316292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.316295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.316387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.317192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.377757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663389711:4103]
2025-10-02T09:34:58.378001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2583, pipe: [1:7556555574663389711:4103]
2025-10-02T09:34:58.424094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:58.424394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.424403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.424415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389711:4103], now have 1 active actors on pipe
2025-10-02T09:34:58.424622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:58.424623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:58.424632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:58.424659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663389711:4103]
2025-10-02T09:34:58.424672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2584 reason: error at write: Disconnected sessionId: src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0
2025-10-02T09:34:58.424680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:58.424793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2584 sessionId: src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0 is DEAD
2025-10-02T09:34:58.424967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:58.424982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Write session will restart in 0.005796s
2025-10-02T09:34:58.425003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Write session: Do CDS request
2025-10-02T09:34:58.425009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.432154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.432311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.432320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2585
2025-10-02T09:34:58.432442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.432465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.432473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.432476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.432741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2585 sessionId:  describe result for acl check
2025-10-02T09:34:58.432765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.432769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.432770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.432773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663389844:5143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.433150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663389844:5143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.433160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.434453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663389844:5143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.434546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.434641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.434648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.434654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.434679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.434703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587818084:6730]
2025-10-02T09:34:58.435036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.435233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.435254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.435426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.435454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.435458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.435459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.435460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.435460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.435461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.435461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.435462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.435462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.435463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.435463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.435464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.435467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.435473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.435475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.435477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.435480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.435482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.435484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.435486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.435488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.435490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.435492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.435494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.435498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.435503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.435506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.435512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.435514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.435516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.435518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.435523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.435525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.435528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.435533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.435537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.435539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.435542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.435544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.435546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.435548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.435554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.435557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.435559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.435565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.435567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.435569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.435572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.435590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.435908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663389844:5143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.435916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663389844:5143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.435918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663389844:5143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.435921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.442979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.444429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.444440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.444441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.444442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.444446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2584 [2:7556555574587818084:6730]
2025-10-02T09:34:58.444453Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.444463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.444464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.444466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.444467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.444476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.444479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.444483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.444517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.444522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.444523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.444525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.444526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.444560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.444565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.444571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.444576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.444584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.444596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.444600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.444601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.444606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.444614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.444618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.444622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.444623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.444624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.444625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.444631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389712:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.444633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389884:5143], now have 1 active actors on pipe
2025-10-02T09:34:58.444645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.444652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.444661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2584
2025-10-02T09:34:58.444660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.444662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2584
2025-10-02T09:34:58.444691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.444697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.444710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.444718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.444720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.444721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.444726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.444732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.444739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.444875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.444880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.444888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.444964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2585 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0
2025-10-02T09:34:58.445176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945ebf5-4f7eb14a-8c12ab03-550091d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.447706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Write session: try to update token
2025-10-02T09:34:58.447723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.453439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:58.453451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.453455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.453475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:58.453495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:58.453603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:58.453713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.453818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.453926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.454077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:58.454098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:58.460505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId: src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.461881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.461894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.461895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.461896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.461900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.461903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.461905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587818079:6730]
2025-10-02T09:34:58.461924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.461931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.461932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.461935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.461951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.461954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.462036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.462705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.524713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663389893:4103]
2025-10-02T09:34:58.524927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2584, pipe: [1:7556555574663389893:4103]
2025-10-02T09:34:58.569629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:58.569907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.569917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.569931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389893:4103], now have 1 active actors on pipe
2025-10-02T09:34:58.570121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:58.570116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:58.570133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:58.570136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:58.570153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663389893:4103]
2025-10-02T09:34:58.570186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2585 reason: error at write: Disconnected sessionId: src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0
2025-10-02T09:34:58.570349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2585 sessionId: src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0 is DEAD
2025-10-02T09:34:58.570550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:58.570563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Write session will restart in 0.007338s
2025-10-02T09:34:58.570587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Write session: Do CDS request
2025-10-02T09:34:58.570593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.579186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.579277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.579285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2586
2025-10-02T09:34:58.579378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.579402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.579408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.579411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.579556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.579661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2586 sessionId:  describe result for acl check
2025-10-02T09:34:58.579683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.579687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.579688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.579691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663390029:5154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.580057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663390029:5154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.580999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.581120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.581128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.581134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.581165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.581190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587818257:6724]
2025-10-02T09:34:58.581390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663390029:5154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.581529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.581700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.581724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.581901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.581930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.581934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.581934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.581935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.581936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.581936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.581937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.581937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.581938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.581938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.581939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.581939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.581942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.581948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.581950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.581952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.581954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.581956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.581958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.581960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.581962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.581964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.581967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.581969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.581972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.581976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.581979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.581982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.581985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.581988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.581990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.581994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.581996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.582001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.582003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.582005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.582008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.582011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.582015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.582018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.582020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.582023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.582025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.582027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.582029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.582032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.582034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.582036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.582058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.585908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663390029:5154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.585918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663390029:5154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.585920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663390029:5154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.585923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.589571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.591103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.591115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.591116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.591118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.591121Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2585 [2:7556555574587818257:6724]
2025-10-02T09:34:58.591128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.591137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.591140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.591141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.591142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.591151Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.591158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.591162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.591195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.591199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.591200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.591202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.591204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.591241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.591245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.591252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.591257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.591269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.591282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.591286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.591287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.591294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.591302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.591306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.591309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.591311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.591313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.591315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.591321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663389894:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.591323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390068:5154], now have 1 active actors on pipe
2025-10-02T09:34:58.591335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.591344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.591349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2585
2025-10-02T09:34:58.591367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2585
2025-10-02T09:34:58.591362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.591431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.591436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.591449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.591456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.591458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.591459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.591465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.591474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.591482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.591635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.591641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.591651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.591724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2586 partition: 0 MaxSeqNo: 36 sessionId: src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0
2025-10-02T09:34:58.591991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed38a6fa-803d606a-ebfab1c-53e0a86c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.594475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Write session: try to update token
2025-10-02T09:34:58.594488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.600289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:58.600302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.600306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.600334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:58.600345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:58.600482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:58.600609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.600734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.600880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.601065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:58.601098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:58.606714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId: src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.608871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.609117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.609136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.609146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.609148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.609149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.609150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.609154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.609157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.609159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587818252:6724]
2025-10-02T09:34:58.609187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.609194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.609194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.609195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.609198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.609201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.609301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.670120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663390075:4103]
2025-10-02T09:34:58.670334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2585, pipe: [1:7556555574663390075:4103]
2025-10-02T09:34:58.718447Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:58.718813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:34:58.718839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390075:4103], now have 1 active actors on pipe
2025-10-02T09:34:58.718944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:34:58.718975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:58.719012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:58.719015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663390075:4103]
2025-10-02T09:34:58.719018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:58.719062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2586 reason: error at write: Disconnected sessionId: src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0
2025-10-02T09:34:58.719179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2586 sessionId: src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0 is DEAD
2025-10-02T09:34:58.719355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:58.719370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Write session will restart in 0.006876s
2025-10-02T09:34:58.719392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Write session: Do CDS request
2025-10-02T09:34:58.719397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.727151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.727272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.727282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2587
2025-10-02T09:34:58.727371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.727390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.727398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.727404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.727692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2587 sessionId:  describe result for acl check
2025-10-02T09:34:58.727727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.727731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.727733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.727736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663390210:5164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.728087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663390210:5164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.728197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.729402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663390210:5164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.729651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.729742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.729748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.729754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.729778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.729800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587818431:6722]
2025-10-02T09:34:58.730136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.730348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.730370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.730555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.730585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.730589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.730590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.730590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.730591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.730591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.730592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.730592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.730593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.730593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.730594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.730594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.730598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.730603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.730605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.730607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.730609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.730611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.730613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.730615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.730617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.730620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.730621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.730623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.730627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.730631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.730634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.730637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.730639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.730641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.730643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.730646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.730648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.730651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.730653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.730655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.730657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.730660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.730662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.730665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.730668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.730672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.730674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.730676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.730678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.730681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.730683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.730685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.730702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.730803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663390210:5164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.730811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663390210:5164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.730814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663390210:5164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.730817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.738117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.739608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.739620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.739621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.739623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.739626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2586 [2:7556555574587818431:6722]
2025-10-02T09:34:58.739635Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.739645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.739646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.739648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.739649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.739657Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.739662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.739667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.739701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.739706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.739707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.739708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.739709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.739747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.739752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.739758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.739763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.739772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.739784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.739788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.739789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.739793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.739802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.739806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.739809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.739812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.739812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.739813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.739819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390252:5164], now have 1 active actors on pipe
2025-10-02T09:34:58.739822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390077:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.739834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.739843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.739853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.739859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2586
2025-10-02T09:34:58.739868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2586
2025-10-02T09:34:58.739928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.739935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.739951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d89de6d-c89fd216-21786a2e-72aca859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.739959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.739961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.739962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.739967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.739974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.739981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.740095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.740100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.740106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.740168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2587 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d89de6d-c89fd216-21786a2e-72aca859_0
2025-10-02T09:34:58.740417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381be080-b94269d4-ff41f9cb-5c0017e8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d89de6d-c89fd216-21786a2e-72aca859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.742995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Write session: try to update token
2025-10-02T09:34:58.743012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.748973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.748985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.748986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.748987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.748991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.748993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.748996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587818426:6722]
2025-10-02T09:34:58.749017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.749024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.749025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.749037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.749053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.749056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.749131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.755302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId: src_id|2d89de6d-c89fd216-21786a2e-72aca859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.757569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.819099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663390259:4103]
2025-10-02T09:34:58.819308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2586, pipe: [1:7556555574663390259:4103]
2025-10-02T09:34:58.858241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:58.858609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.858618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.858630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390259:4103], now have 1 active actors on pipe
2025-10-02T09:34:58.858793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663390259:4103]
2025-10-02T09:34:58.858800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:58.858803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:58.858814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:58.858838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:58.858848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2587 reason: error at write: Disconnected sessionId: src_id|2d89de6d-c89fd216-21786a2e-72aca859_0
2025-10-02T09:34:58.858985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2587 sessionId: src_id|2d89de6d-c89fd216-21786a2e-72aca859_0 is DEAD
2025-10-02T09:34:58.859139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:58.859153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Write session will restart in 0.008683s
2025-10-02T09:34:58.859174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Write session: Do CDS request
2025-10-02T09:34:58.859179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:58.867816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:58.869221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.869306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:58.869315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:58.869327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2588
2025-10-02T09:34:58.869424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:58.869431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:58.869437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:58.869450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:58.869463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:58.869469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:58.869475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:58.869478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:58.869489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555574587818606:6717]
2025-10-02T09:34:58.869734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2588 sessionId:  describe result for acl check
2025-10-02T09:34:58.869756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:58.869762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:58.869763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:58.869767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555574663390398:5172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:58.869834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:58.870027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:58.870049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:58.870105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555574663390398:5172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:58.870223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:58.870252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.870256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.870257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.870257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.870258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.870259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.870259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.870260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.870260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.870260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.870261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.870262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.870264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.870270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.870273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.870275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.870277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.870279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.870281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.870283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.870284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.870287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.870288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.870290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.870294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.870297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:58.870301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.870303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:58.870305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.870308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:58.870310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.870313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:58.870315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.870318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:58.870320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.870323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:58.870325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.870328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:58.870330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.870333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:58.870335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.870342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:58.870344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.870347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.870350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.870356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.870359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.870361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.870380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:58.871663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555574663390398:5172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:58.875615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555574663390398:5172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:58.875625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555574663390398:5172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:58.875626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555574663390398:5172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:58.875630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:58.877811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:58.879576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:58.879587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:58.879588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:58.879590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:58.879593Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2587 [2:7556555574587818606:6717]
2025-10-02T09:34:58.879602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:58.879611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:58.879613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.879615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.879615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.879624Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:58.879630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:58.879635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:58.879667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.879672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.879672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.879674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:58.879676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:58.879718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:58.879724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.879730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:58.879735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:58.879744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:58.879754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.879755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.879756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.879761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:58.879769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390440:5172], now have 1 active actors on pipe
2025-10-02T09:34:58.879775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:58.879778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:58.879779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:58.879781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:58.879785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:58.879786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:58.879789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390261:2446], now have 1 active actors on pipe
2025-10-02T09:34:58.879803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.879813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:58.879817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2587
2025-10-02T09:34:58.879828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2587
2025-10-02T09:34:58.879824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:58.879866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.879873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.879886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:58.879894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:58.879896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:58.879900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:58.879905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:58.879910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:58.879922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.880038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:58.880043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:58.880050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:58.880111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2588 partition: 0 MaxSeqNo: 36 sessionId: src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0
2025-10-02T09:34:58.880354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d89de6d-c89fd216-21786a2e-72aca859_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:58.883016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Write session: try to update token
2025-10-02T09:34:58.883030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:58.892549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:58.892562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.892569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.892590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:58.892618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:58.892729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:58.892858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.892976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.893093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:58.893247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:58.893270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:58.896697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId: src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:58.897014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:58.897028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:58.897029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:58.897030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:58.897034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.897036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.897038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555574587818601:6717]
2025-10-02T09:34:58.897058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:58.897065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:58.897067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:58.897068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:58.897072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:58.897075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:58.897223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:58.899092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:58.958872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555574663390452:4103]
2025-10-02T09:34:58.959109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2587, pipe: [1:7556555574663390452:4103]
2025-10-02T09:34:59.004862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.005074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.005082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.005094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555574663390452:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.005267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.005275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.005275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.005308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555574663390452:4103]
2025-10-02T09:34:59.005298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.005323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2588 reason: error at write: Disconnected sessionId: src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0
2025-10-02T09:34:59.005464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2588 sessionId: src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0 is DEAD
2025-10-02T09:34:59.005597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.005611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Write session will restart in 0.007882s
2025-10-02T09:34:59.005636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Write session: Do CDS request
2025-10-02T09:34:59.005642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.014146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.014201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.014241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.014249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2589
2025-10-02T09:34:59.014355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.014375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.014381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.014384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.014651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2589 sessionId:  describe result for acl check
2025-10-02T09:34:59.014676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.014681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.014683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.014687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958357888:5196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.015037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958357888:5196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.015799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.015893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.015900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.015906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.015931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.015955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882786078:6715]
2025-10-02T09:34:59.016289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.016468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.016491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.016566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958357888:5196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.016664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.016696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.016700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.016701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.016701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.016702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.016702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.016703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.016703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.016704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.016704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.016705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.016706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.016708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.016714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.016716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.016718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.016720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.016722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.016724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.016726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.016728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.016730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.016732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.016734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.016738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.016742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.016745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.016747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.016750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.016752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.016755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.016757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.016760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.016762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.016764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.016767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.016769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.016772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.016776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.016779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.016781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.016784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.016786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.016788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.016791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.016795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.016798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.016810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.016827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.020589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958357888:5196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.020600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958357888:5196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.020603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958357888:5196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.020608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.024218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.025794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.025807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.025808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.025810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.025813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2588 [2:7556555578882786078:6715]
2025-10-02T09:34:59.025820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.025829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.025831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.025833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.025834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.025843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.025845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.025850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.025884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.025888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.025889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.025891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.025892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.025931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.025936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.025943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.025948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.025960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.025973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.025977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.025978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.025984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.025992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958357927:5196], now have 1 active actors on pipe
2025-10-02T09:34:59.025997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958357749:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.025998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.026001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.026002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.026003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.026009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.026010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.026024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.026031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.026040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2588
2025-10-02T09:34:59.026040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.026044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2588
2025-10-02T09:34:59.026082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.026089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.026104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.026114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.026116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.026118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.026122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.026127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.026134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.026261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.026266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.026273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.026341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2589 partition: 0 MaxSeqNo: 36 sessionId: src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0
2025-10-02T09:34:59.026569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f953c11f-433f0a2-57ea3b00-3c43ce7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.029225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Write session: try to update token
2025-10-02T09:34:59.029243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.034887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:59.034899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.034904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.034926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:59.034938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:59.035073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:59.035188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.035300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.035415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.035574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:59.035597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:59.041943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId: src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.043362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.043374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.043376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.043377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.043381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.043383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.043385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882786073:6715]
2025-10-02T09:34:59.043405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.043408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.043411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.043415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.043418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.043421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.043517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.044393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.105326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958357934:4103]
2025-10-02T09:34:59.105570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2588, pipe: [1:7556555578958357934:4103]
2025-10-02T09:34:59.152223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.152432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.152440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.152453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958357934:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.152620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.152622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.152635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.152637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.152678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958357934:4103]
2025-10-02T09:34:59.152685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2589 reason: error at write: Disconnected sessionId: src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0
2025-10-02T09:34:59.152833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2589 sessionId: src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0 is DEAD
2025-10-02T09:34:59.152958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.152967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Write session will restart in 0.008343s
2025-10-02T09:34:59.152983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Write session: Do CDS request
2025-10-02T09:34:59.152986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.162080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.162213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.162224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2590
2025-10-02T09:34:59.162333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.162354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.162357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.162359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.162610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2590 sessionId:  describe result for acl check
2025-10-02T09:34:59.162636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.162642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.162643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.162648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958358085:5201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.162950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958358085:5201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.163835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.164183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.164351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.164358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.164365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.164395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.164421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882786282:6712]
2025-10-02T09:34:59.164425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958358085:5201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.164761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.164959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.164983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.165188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.165221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.165225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.165227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.165228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.165228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.165229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.165229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.165230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.165230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.165231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.165231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.165232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.165235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.165241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.165243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.165245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.165247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.165249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.165251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.165253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.165255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.165258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.165260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.165262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.165266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.165269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.165272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.165276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.165279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.165281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.165284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.165286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.165289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.165292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.165297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.165301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.165303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.165306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.165308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.165310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.165313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.165315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.165318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.165322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.165324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.165326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.165328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.165331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.165348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.169177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958358085:5201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.169186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958358085:5201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.169189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958358085:5201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.169193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.172748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.174167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.174180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.174181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.174183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.174186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2589 [2:7556555578882786282:6712]
2025-10-02T09:34:59.174193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.174202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.174207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.174209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.174210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.174218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.174222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.174226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.174257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.174262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.174263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.174264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.174265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.174318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.174326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.174334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.174339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.174347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.174358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958357947:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.174361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358137:5201], now have 1 active actors on pipe
2025-10-02T09:34:59.174364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.174366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.174366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.174377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.174390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.174399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.174403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.174400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2589
2025-10-02T09:34:59.174404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.174406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.174409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.174424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.174420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2589
2025-10-02T09:34:59.174426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.174436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.174447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.174454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.174471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|985aae6c-49825e95-bd50193-3a91449f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.174479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.174481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.174484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.174489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.174497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.174503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.174615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.174620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.174626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.174689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2590 partition: 0 MaxSeqNo: 36 sessionId: src_id|985aae6c-49825e95-bd50193-3a91449f_0
2025-10-02T09:34:59.174931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb6daae-cb9fa597-e72ea3d2-d98c8b90_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|985aae6c-49825e95-bd50193-3a91449f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.177564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Write session: try to update token
2025-10-02T09:34:59.177579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.183685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.183698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.183699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.183700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.183703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.183705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.183707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882786277:6712]
2025-10-02T09:34:59.183728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.183730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.183731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.183744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.183756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.183760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.183846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.190497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId: src_id|985aae6c-49825e95-bd50193-3a91449f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.192856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.252787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958358155:4103]
2025-10-02T09:34:59.253007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2589, pipe: [1:7556555578958358155:4103]
2025-10-02T09:34:59.292556Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.293244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.293254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.293266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358155:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.293419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958358155:4103]
2025-10-02T09:34:59.293430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.293435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.293437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.293486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2590 reason: error at write: Disconnected sessionId: src_id|985aae6c-49825e95-bd50193-3a91449f_0
2025-10-02T09:34:59.293631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2590 sessionId: src_id|985aae6c-49825e95-bd50193-3a91449f_0 is DEAD
2025-10-02T09:34:59.293674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.293786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.293800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Write session will restart in 0.007818s
2025-10-02T09:34:59.293825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Write session: Do CDS request
2025-10-02T09:34:59.293831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.302118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.302229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.302237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2591
2025-10-02T09:34:59.302335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.302355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.302361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.302364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.302479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.302618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2591 sessionId:  describe result for acl check
2025-10-02T09:34:59.302635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.302640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.302641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.302644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958358297:5220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.302976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958358297:5220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.303847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.303943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.303950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.303956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.303981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.304005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882786482:6690]
2025-10-02T09:34:59.304340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.304507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958358297:5220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.304515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.304537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.304709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.304739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.304743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.304743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.304744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.304745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.304745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.304746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.304746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.304747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.304748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.304748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.304749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.304752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.304757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.304759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.304762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.304763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.304766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.304767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.304770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.304772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.304774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.304776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.304777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.304781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.304785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.304788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.304791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.304793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.304797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.304799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.304816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.304818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.304821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.304823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.304825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.304827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.304833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.304835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.304838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.304840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.304843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.304845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.304847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.304849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.304852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.304854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.304857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.304875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.309567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958358297:5220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.309574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958358297:5220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.309576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958358297:5220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.309579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.312244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.313704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.313714Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.313715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.313717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.313720Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2590 [2:7556555578882786482:6690]
2025-10-02T09:34:59.313728Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.313738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.313743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.313745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.313746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.313754Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.313760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.313764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.313793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.313798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.313798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.313800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.313802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.313837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.313843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.313849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.313854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.313861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.313870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.313872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.313873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.313878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.313887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358158:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.313889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358337:5220], now have 1 active actors on pipe
2025-10-02T09:34:59.313888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.313891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.313893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.313894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.313901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.313903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.313916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.313924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.313924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2590
2025-10-02T09:34:59.313932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2590
2025-10-02T09:34:59.313938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.313958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.313963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.313978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.313985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.313987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.313988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.313992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.313998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.314006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.314105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.314110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.314118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.314185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2591 partition: 0 MaxSeqNo: 36 sessionId: src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0
2025-10-02T09:34:59.314389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985aae6c-49825e95-bd50193-3a91449f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.317032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Write session: try to update token
2025-10-02T09:34:59.317047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.322676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:59.322686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.322690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.322710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:59.322725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:59.322838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:59.322951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.323062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.323177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.323329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:59.323349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:59.329800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId: src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.331165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.331175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.331176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.331177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.331182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.331184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.331186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882786477:6690]
2025-10-02T09:34:59.331206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.331208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.331210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.331217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.331220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.331224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.331313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.332210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.393557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958358345:4103]
2025-10-02T09:34:59.393750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2590, pipe: [1:7556555578958358345:4103]
2025-10-02T09:34:59.437711Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.437949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.437958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.437970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358345:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.438129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958358345:4103]
2025-10-02T09:34:59.438147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.438149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.438150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.438180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2591 reason: error at write: Disconnected sessionId: src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0
2025-10-02T09:34:59.438184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.438305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2591 sessionId: src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0 is DEAD
2025-10-02T09:34:59.438479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.438494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Write session will restart in 0.007483s
2025-10-02T09:34:59.438523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Write session: Do CDS request
2025-10-02T09:34:59.438529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.447081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.447176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.447184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2592
2025-10-02T09:34:59.447271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.447295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.447301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.447305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.447347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.447558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2592 sessionId:  describe result for acl check
2025-10-02T09:34:59.447582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.447586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.447587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.447590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958358487:5236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.447925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958358487:5236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.448738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.448839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.448846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.448851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.448878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.448901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882786662:6684]
2025-10-02T09:34:59.449205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958358487:5236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.449233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.449408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.449432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.449603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.449632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.449636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.449637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.449637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.449638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.449639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.449639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.449640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.449641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.449641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.449642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.449642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.449645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.449651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.449653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.449655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.449657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.449659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.449661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.449663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.449665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.449668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.449670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.449671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.449675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.449679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.449682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.449685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.449687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.449690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.449692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.449695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.449697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.449700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.449702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.449705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.449707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.449709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.449711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.449715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.449718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.449721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.449723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.449726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.449728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.449732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.449734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.449738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.449756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.453548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958358487:5236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.453556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958358487:5236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.453558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958358487:5236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.453561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.457149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.458554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.458563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.458564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.458566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.458570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2591 [2:7556555578882786662:6684]
2025-10-02T09:34:59.458576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.458585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.458587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.458589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.458590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.458599Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.458604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.458608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.458638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.458643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.458644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.458645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.458647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.458688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.458692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.458698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.458707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.458717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.458731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358526:5236], now have 1 active actors on pipe
2025-10-02T09:34:59.458736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358346:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.458739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.458741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.458742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.458750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.458762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.458763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2591
2025-10-02T09:34:59.458764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2591
2025-10-02T09:34:59.458773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.458775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.458777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.458778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.458780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.458791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.458796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.458798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.458812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.458817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.458836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.458842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.458844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.458845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.458852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.458859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.458871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.458964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.458968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.458977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.459044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2592 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0
2025-10-02T09:34:59.459249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aaae6e-1b99cb16-cff263e0-44dd91ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.461808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Write session: try to update token
2025-10-02T09:34:59.461823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.467944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.467957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.467959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.467960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.468080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.468090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.468093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882786657:6684]
2025-10-02T09:34:59.468122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.468127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.468128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.468129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.468134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.468136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.468243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.474469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId: src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.476668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.538455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958358534:4103]
2025-10-02T09:34:59.538713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2591, pipe: [1:7556555578958358534:4103]
2025-10-02T09:34:59.578100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.578316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.578324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.578336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358534:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.578573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.578566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.578577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958358534:4103]
2025-10-02T09:34:59.578596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.578598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.578645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2592 reason: error at write: Disconnected sessionId: src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0
2025-10-02T09:34:59.578776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2592 sessionId: src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0 is DEAD
2025-10-02T09:34:59.578911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.578920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Write session will restart in 0.008485s
2025-10-02T09:34:59.578945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Write session: Do CDS request
2025-10-02T09:34:59.578949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.587627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.588185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.588311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.588320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2593
2025-10-02T09:34:59.588432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.588452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.588458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.588461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.588714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2593 sessionId:  describe result for acl check
2025-10-02T09:34:59.588738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.588743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.588744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.588747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958358677:5235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.589124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958358677:5235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.589167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.589263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.589269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.589275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.589302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.589326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882786842:6682]
2025-10-02T09:34:59.589671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.589875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.589898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.590090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.590126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.590130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.590131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.590131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.590132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.590132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.590133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.590134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.590134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.590135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.590136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.590136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.590139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.590145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.590147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.590149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.590151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.590154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.590156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.590158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.590160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.590162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.590164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.590166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.590169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.590173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.590176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.590179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.590181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.590184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.590186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.590189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.590192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.590198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.590201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.590203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.590206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.590208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.590211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.590213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.590218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.590220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.590223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.590226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.590228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.590231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.590236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.590238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.590258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.590485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958358677:5235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.595075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958358677:5235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.595083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958358677:5235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.595085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958358677:5235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.595089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.597826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.599270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.599279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.599280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.599282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.599285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2592 [2:7556555578882786842:6682]
2025-10-02T09:34:59.599293Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.599302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.599307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.599309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.599310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.599319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.599322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.599329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.599360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.599365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.599366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.599368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.599370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.599408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.599413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.599419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.599424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.599432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.599445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.599450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.599451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.599457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.599468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358716:5235], now have 1 active actors on pipe
2025-10-02T09:34:59.599471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.599475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358535:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.599475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.599476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.599478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.599485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.599487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.599501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.599510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.599530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2592
2025-10-02T09:34:59.599533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2592
2025-10-02T09:34:59.599538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.599634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.599639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.599654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.599661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.599663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.599666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.599671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.599680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.599693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.599825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.599832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.599841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.599906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2593 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0
2025-10-02T09:34:59.600158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5aa33b-faa17bce-69797dbf-72a2766b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.602815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Write session: try to update token
2025-10-02T09:34:59.602833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.609020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.609032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.609034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.609036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.609041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.609045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.609048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882786837:6682]
2025-10-02T09:34:59.609076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.609086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.609087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.609090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.609103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.609108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.609205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.616261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId: src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.618486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.678754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958358723:4103]
2025-10-02T09:34:59.678963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2592, pipe: [1:7556555578958358723:4103]
2025-10-02T09:34:59.720397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.720674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.720682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.720694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358723:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.720855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.720865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.720876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958358723:4103]
2025-10-02T09:34:59.720892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.720885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.720908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2593 reason: error at write: Disconnected sessionId: src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0
2025-10-02T09:34:59.721033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2593 sessionId: src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0 is DEAD
2025-10-02T09:34:59.721193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.721208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Write session will restart in 0.007963s
2025-10-02T09:34:59.721233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Write session: Do CDS request
2025-10-02T09:34:59.721239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.730102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.730135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.730290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.730299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2594
2025-10-02T09:34:59.730408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.730426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.730432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.730435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.730699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2594 sessionId:  describe result for acl check
2025-10-02T09:34:59.730724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.730729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.730730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.730733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958358870:5232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.731076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958358870:5232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.731505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.731626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.731633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.731639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.731668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.731693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882787024:6680]
2025-10-02T09:34:59.732050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.732235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.732260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.732292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958358870:5232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.732556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.732593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.732597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.732599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.732599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.732600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.732601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.732601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.732602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.732602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.732603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.732605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.732611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.732613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.732615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.732617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.732619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.732621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.732623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.732625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.732627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.732629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.732630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.732634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.732638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.732641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.732644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.732646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.732649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.732651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.732654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.732656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.732658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.732661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.732663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.732665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.732668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.732670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.732672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.732676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.732678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.732680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.732683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.732686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.732688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.732690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.732692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.732710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.736478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958358870:5232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.736486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958358870:5232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.736488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958358870:5232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.736491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.740139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.741647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.741657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.741659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.741661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.741665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2593 [2:7556555578882787024:6680]
2025-10-02T09:34:59.741672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.741682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.741683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.741685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.741686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.741696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.741701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.741705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.741736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.741742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.741743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.741745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.741747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.741788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.741793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.741799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.741804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.741812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.741825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.741830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.741831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.741836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.741845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.741847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.741851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.741853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.741854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.741855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.741862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358908:5232], now have 1 active actors on pipe
2025-10-02T09:34:59.741864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358727:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.741878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.741884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.741900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2593
2025-10-02T09:34:59.741900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2593
2025-10-02T09:34:59.741899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.741996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.742001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.742016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.742023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.742026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.742027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.742032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.742041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.742051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.742185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.742191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.742201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.742253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2594 partition: 0 MaxSeqNo: 36 sessionId: src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0
2025-10-02T09:34:59.742492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7dcc32-8a05aa93-bf69596-5d102cf2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.745174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Write session: try to update token
2025-10-02T09:34:59.745191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.751166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.751179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.751181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.751182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.751187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.751192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.751194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882787019:6680]
2025-10-02T09:34:59.751223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.751231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.751233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.751232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.751240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.751243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.751355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.758109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId: src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.760308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.821081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958358921:4103]
2025-10-02T09:34:59.821568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2593, pipe: [1:7556555578958358921:4103]
2025-10-02T09:34:59.861834Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:34:59.862094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.862103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.862115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358921:4103], now have 1 active actors on pipe
2025-10-02T09:34:59.862305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:34:59.862332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958358921:4103]
2025-10-02T09:34:59.862335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:34:59.862346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:34:59.862355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:34:59.862403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2594 reason: error at write: Disconnected sessionId: src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0
2025-10-02T09:34:59.862555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2594 sessionId: src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0 is DEAD
2025-10-02T09:34:59.862669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:34:59.862677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Write session will restart in 0.007904s
2025-10-02T09:34:59.862696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Write session: Do CDS request
2025-10-02T09:34:59.862700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:34:59.871177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.871283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:34:59.871289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2595
2025-10-02T09:34:59.871384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:34:59.871404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:34:59.871410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:34:59.871412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:34:59.871670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2595 sessionId:  describe result for acl check
2025-10-02T09:34:59.871684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:34:59.871693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:34:59.871697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:34:59.871698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:34:59.871700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555578958359066:5251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:34:59.871986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:34:59.872030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555578958359066:5251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:34:59.872080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:34:59.872087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:34:59.872093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:34:59.872125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:34:59.872157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555578882787206:6678]
2025-10-02T09:34:59.872500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:34:59.873422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:34:59.873448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:34:59.873630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:34:59.873660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.873664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.873665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.873665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.873666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.873666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.873667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.873668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.873668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.873669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.873670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.873670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.873673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.873679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.873681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.873684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.873686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.873688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.873690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.873686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555578958359066:5251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:34:59.873692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.873694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.873696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.873698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.873700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.873705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.873709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:34:59.873712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.873715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:34:59.873717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.873720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:34:59.873723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.873725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:34:59.873730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.873732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:34:59.873735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.873737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:34:59.873743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.873745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:34:59.873748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.873751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:34:59.873753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.873757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:34:59.873760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.873762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.873765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.873769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.873774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.873776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.873795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:34:59.877657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555578958359066:5251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:34:59.877665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555578958359066:5251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:34:59.877667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555578958359066:5251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:34:59.877671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:34:59.881425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:34:59.883081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:34:59.883091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:34:59.883092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:34:59.883095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:34:59.883098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2594 [2:7556555578882787206:6678]
2025-10-02T09:34:59.883106Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:34:59.883116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:34:59.883121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.883122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.883123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.883132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:34:59.883135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:34:59.883142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:34:59.883177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.883182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.883184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.883185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:34:59.883187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:34:59.883227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:34:59.883231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.883238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:34:59.883243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:34:59.883253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:34:59.883266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.883271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.883272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.883277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:34:59.883285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:34:59.883290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:34:59.883292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:34:59.883294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:34:59.883295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:34:59.883297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:34:59.883303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958358923:2446], now have 1 active actors on pipe
2025-10-02T09:34:59.883306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958359109:5251], now have 1 active actors on pipe
2025-10-02T09:34:59.883319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.883329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:34:59.883353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:34:59.883380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2594
2025-10-02T09:34:59.883392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2594
2025-10-02T09:34:59.883435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.883441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.883456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:34:59.883463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:34:59.883466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:34:59.883467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:34:59.883472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:34:59.883480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:34:59.883491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.883636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:34:59.883642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:34:59.883652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:34:59.883726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2595 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0
2025-10-02T09:34:59.883960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312229d7-6818bb4b-a920367b-bfc5ab50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:34:59.886656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Write session: try to update token
2025-10-02T09:34:59.886671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:34:59.896895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:34:59.896905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.896911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.896940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:34:59.896957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:34:59.897088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:34:59.897213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.897335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.897459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:34:59.897634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:34:59.897664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:34:59.899442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId: src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:34:59.901249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:34:59.901260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:34:59.901261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:34:59.901262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:34:59.901266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.901269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.901272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555578882787201:6678]
2025-10-02T09:34:59.901292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:34:59.901299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:34:59.901299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:34:59.901300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:34:59.901302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:34:59.901307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:34:59.901425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:34:59.901662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:34:59.962385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555578958359121:4103]
2025-10-02T09:34:59.962593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2594, pipe: [1:7556555578958359121:4103]
2025-10-02T09:35:00.011277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.011512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.011521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.011536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555578958359121:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.011756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.011737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555578958359121:4103]
2025-10-02T09:35:00.011750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.011761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:00.011763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:00.011805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2595 reason: error at write: Disconnected sessionId: src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0
2025-10-02T09:35:00.011943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2595 sessionId: src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0 is DEAD
2025-10-02T09:35:00.012265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:00.012280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Write session will restart in 0.007425s
2025-10-02T09:35:00.012305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Write session: Do CDS request
2025-10-02T09:35:00.012314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.021144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.021242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.021254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2596
2025-10-02T09:35:00.021367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.021367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.021394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.021403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.021410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.021679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2596 sessionId:  describe result for acl check
2025-10-02T09:35:00.021704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.021708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.021709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.021713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253326564:5261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.022066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253326564:5261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.022920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.023098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.023107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.023115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.023151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.023179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177754685:6677]
2025-10-02T09:35:00.023548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.023685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253326564:5261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.023738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.023764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.023951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.023982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.023986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.023987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.023988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.023988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.023989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.023989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.023990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.023991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.023991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.023992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.023993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.023995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.024001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.024004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.024006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.024008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.024010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.024012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.024015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.024017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.024019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.024021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.024023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.024026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.024032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.024036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.024039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.024041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.024044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.024046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.024049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.024052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.024054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.024057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.024059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.024062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.024065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.024067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.024070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.024076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.024079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.024081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.024084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.024087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.024093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.024095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.024098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.024120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.029259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253326564:5261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.029268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253326564:5261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.029270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253326564:5261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.029274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.032136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.033650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.033660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.033661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.033663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.033667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2595 [2:7556555583177754685:6677]
2025-10-02T09:35:00.033675Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.033686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.033691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.033693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.033694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.033703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.033709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.033713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.033748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.033752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.033754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.033755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.033756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.033877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.033881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.033888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.033893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.033905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.033906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2595
2025-10-02T09:35:00.033908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2595
2025-10-02T09:35:00.033920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326603:5261], now have 1 active actors on pipe
2025-10-02T09:35:00.033926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326418:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.033929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.033930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.033931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.033940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.033951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.033955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.033957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.033958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.033961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.033963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.033979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.033984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.033990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.034015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.034020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.034035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.034043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.034045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.034046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.034051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.034060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.034069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.034209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.034216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.034226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.034320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2596 partition: 0 MaxSeqNo: 36 sessionId: src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0
2025-10-02T09:35:00.034584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fa485e-808c94d1-906ddaa0-2a21797b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.037247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Write session: try to update token
2025-10-02T09:35:00.037264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.043162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:00.043173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.043179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.043208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:00.043221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:00.043362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:00.043489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:00.043620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:00.043746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:00.043940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:00.043976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:00.050615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId: src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.052225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.052238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.052239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.052240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.052245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.052248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.052250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177754680:6677]
2025-10-02T09:35:00.052273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.052277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.052279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.052282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.052287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.052289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.052389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.052890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:00.111904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555583253326610:4103]
2025-10-02T09:35:00.112159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2595, pipe: [1:7556555583253326610:4103]
2025-10-02T09:35:00.166239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.166521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.166530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.166542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326610:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.166717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.166738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253326610:4103]
2025-10-02T09:35:00.166753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:00.166755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:00.166744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.166798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2596 reason: error at write: Disconnected sessionId: src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0
2025-10-02T09:35:00.166929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2596 sessionId: src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0 is DEAD
2025-10-02T09:35:00.167067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:00.167083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Write session will restart in 0.008824s
2025-10-02T09:35:00.167104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Write session: Do CDS request
2025-10-02T09:35:00.167110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.176307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.177139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.177199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.177209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2597
2025-10-02T09:35:00.177285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.177304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.177311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.177313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.177581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2597 sessionId:  describe result for acl check
2025-10-02T09:35:00.177606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.177610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.177611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.177614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253326769:10239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.177901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.177946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253326769:10239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.178010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.178017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.178022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.178050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.178075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177754886:6666]
2025-10-02T09:35:00.178410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.178651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.178675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.178868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.178900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.178904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.178905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.178905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.178906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.178907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.178907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.178908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.178908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.178909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.178909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.178910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.178913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.178919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.178921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.178923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.178925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.178927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.178929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.178931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.178933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.178934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.178936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.178938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.178942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.178946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.178949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.178952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.178955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.178958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.178960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.178963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.178965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.178968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.178970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.178972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.178975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.178977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.178980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.178982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.178988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.178991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.178993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.178996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.179002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.179005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.179007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.179010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.179031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.179327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253326769:10239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.183801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253326769:10239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.183809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253326769:10239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.183811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253326769:10239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.183815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.186610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.188121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.188132Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.188133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.188135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.188138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2596 [2:7556555583177754886:6666]
2025-10-02T09:35:00.188145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.188154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.188159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.188161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.188162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.188171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.188174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.188178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.188213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.188217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.188218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.188219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.188221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.188259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.188264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.188270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.188276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.188284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.188297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.188300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.188302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.188307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.188315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.188318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.188322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.188324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.188326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.188327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.188334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326809:10239], now have 1 active actors on pipe
2025-10-02T09:35:00.188339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326623:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.188352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.188362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.188368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2596
2025-10-02T09:35:00.188372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2596
2025-10-02T09:35:00.188375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.188433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.188440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.188453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.188460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.188462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.188463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.188468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.188476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.188486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.188623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.188632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.188643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.188714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2597 partition: 0 MaxSeqNo: 36 sessionId: src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0
2025-10-02T09:35:00.188987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90710ebf-7ba1c04f-c0e14e2e-2421cc7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.191657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Write session: try to update token
2025-10-02T09:35:00.191674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.197522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:00.197537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.197542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.197571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:00.197578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:00.197725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:00.197854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:00.197979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:00.198101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:00.198275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:00.198302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:00.203902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId: src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.206002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.206014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.206017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.206018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.206022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.206025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.206027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177754881:6666]
2025-10-02T09:35:00.206051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.206058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.206058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.206043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:00.206059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.206062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.206065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.206165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.267038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555583253326838:4103]
2025-10-02T09:35:00.267284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2596, pipe: [1:7556555583253326838:4103]
2025-10-02T09:35:00.317694Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.318022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.318031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.318044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326838:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.318218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.318246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.318247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:00.318250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:00.318285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253326838:4103]
2025-10-02T09:35:00.318299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2597 reason: error at write: Disconnected sessionId: src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0
2025-10-02T09:35:00.318453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2597 sessionId: src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0 is DEAD
2025-10-02T09:35:00.318638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:00.318654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Write session will restart in 0.006553s
2025-10-02T09:35:00.318679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Write session: Do CDS request
2025-10-02T09:35:00.318686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.326145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.326602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.326615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2598
2025-10-02T09:35:00.326692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.326712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.326718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.326720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.327103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2598 sessionId:  describe result for acl check
2025-10-02T09:35:00.327127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.327131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.327132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.327135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253326983:10220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.327478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253326983:10220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.328067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.328889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253326983:10220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.329714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.329836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.329844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.329850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.329878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.329902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177755107:6652]
2025-10-02T09:35:00.330249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.330430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.330453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.330639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.330683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.330687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.330688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.330689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.330689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.330690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.330690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.330691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.330691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.330692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.330692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.330693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.330696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.330702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.330704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.330706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.330708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.330710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.330712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.330714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.330716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.330719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.330721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.330723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.330726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.330730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.330734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.330737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.330739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.330742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.330744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.330747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.330749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.330752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.330754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.330757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.330759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.330762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.330764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.330766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.330773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.330776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.330778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.330782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.330785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.330787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.330789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.330792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.330811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.330882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253326983:10220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.330890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253326983:10220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.330892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253326983:10220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.330896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.338375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.340009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.340020Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.340021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.340022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.340026Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2597 [2:7556555583177755107:6652]
2025-10-02T09:35:00.340033Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.340043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.340046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.340048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.340049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.340058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.340064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.340068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.340099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.340104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.340104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.340106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.340108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.340144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.340148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.340154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.340160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.340170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.340181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.340186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.340188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.340193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.340202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327026:10220], now have 1 active actors on pipe
2025-10-02T09:35:00.340205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.340209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.340209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.340211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.340216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.340217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.340221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253326841:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.340233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.340240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.340247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.340259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2597
2025-10-02T09:35:00.340266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2597
2025-10-02T09:35:00.340306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.340311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.340325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.340331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.340333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.340334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.340339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.340346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.340353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.340487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.340493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.340502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.340572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2598 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0
2025-10-02T09:35:00.340767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908ed38c-53c4d1cd-d9fed792-e0417c1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.343459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Write session: try to update token
2025-10-02T09:35:00.343476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.349368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.349380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.349381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.349383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.349387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.349390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.349393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177755102:6652]
2025-10-02T09:35:00.349420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.349422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.349426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.349429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.349429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.349430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.349553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.356086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId: src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.358347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:00.418605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555583253327036:4103]
2025-10-02T09:35:00.418860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2597, pipe: [1:7556555583253327036:4103]
2025-10-02T09:35:00.460228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.460436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.460445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.460457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327036:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.460638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.460638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253327036:4103]
2025-10-02T09:35:00.460645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:00.460648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:00.460659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.460701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2598 reason: error at write: Disconnected sessionId: src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0
2025-10-02T09:35:00.460866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2598 sessionId: src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0 is DEAD
2025-10-02T09:35:00.461037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:00.461053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Write session will restart in 0.008578s
2025-10-02T09:35:00.461073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Write session: Do CDS request
2025-10-02T09:35:00.461079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.470348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.471134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.471332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.471343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2599
2025-10-02T09:35:00.471760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.471794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.471802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.471805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.471957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.472057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.472063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.472069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.472068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2599 sessionId:  describe result for acl check
2025-10-02T09:35:00.472095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.472095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.472099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.472100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.472104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253327185:10214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.472127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177755294:6643]
2025-10-02T09:35:00.472445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253327185:10214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.472473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.472670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.472692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.472882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.472914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.472918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.472918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.472919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.472919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.472920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.472921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.472921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.472922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.472922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.472923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.472923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.472926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.472932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.472934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.472936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.472939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.472941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.472943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.472944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.472946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.472948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.472950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.472952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.472956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.472959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.472963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.472965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.472968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.472970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.472972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.472975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.472977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.472980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.472982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.472985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.472987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.472990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.472992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.472994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.472997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.472999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.473003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.473005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.473008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.473010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.473014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.473017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.473035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.473714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253327185:10214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.477750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253327185:10214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.477758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253327185:10214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.477759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253327185:10214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.477762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.480420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.481846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.481857Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.481858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.481860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.481863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2598 [2:7556555583177755294:6643]
2025-10-02T09:35:00.481985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.481998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.482001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.482003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.482004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.482013Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.482020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.482024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.482056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.482061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.482061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.482063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.482064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.482109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.482113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.482120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.482125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.482135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.482148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327037:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.482156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.482157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.482159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.482164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.482175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.482176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.482179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.482181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.482186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.482188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.482191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327224:10214], now have 1 active actors on pipe
2025-10-02T09:35:00.482187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2598
2025-10-02T09:35:00.482195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2598
2025-10-02T09:35:00.482204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.482209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.482218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.482226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.482228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.482246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.482253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.482256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.482257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.482262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.482271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.482281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.482385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.482389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.482398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.482466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2599 partition: 0 MaxSeqNo: 36 sessionId: src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0
2025-10-02T09:35:00.482699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe20ffa-98b2fa21-85ce0dbf-3fface8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.485371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Write session: try to update token
2025-10-02T09:35:00.485385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.491295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.491307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.491309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.491310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.491314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.491318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.491321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177755289:6643]
2025-10-02T09:35:00.491347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.491355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.491356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.491361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.491367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.491370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.491495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.497972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId: src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.500200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:00.560946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555583253327232:4103]
2025-10-02T09:35:00.561180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2598, pipe: [1:7556555583253327232:4103]
2025-10-02T09:35:00.604050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.604452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.604462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.604474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327232:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.604679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.604682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:00.604685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:00.604716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253327232:4103]
2025-10-02T09:35:00.604736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2599 reason: error at write: Disconnected sessionId: src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0
2025-10-02T09:35:00.604833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.604891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2599 sessionId: src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0 is DEAD
2025-10-02T09:35:00.605014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:00.605022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Write session will restart in 0.009980s
2025-10-02T09:35:00.605040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Write session: Do CDS request
2025-10-02T09:35:00.605044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.614491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.615979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.616097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.616092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.616099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.616105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.616132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.616159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177755480:6638]
2025-10-02T09:35:00.616225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.616234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2600
2025-10-02T09:35:00.616348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.616366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.616370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.616374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.616509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.616637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2600 sessionId:  describe result for acl check
2025-10-02T09:35:00.616663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.616667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.616668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.616671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253327385:10211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.616704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.616729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.616917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.616948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.616952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.616953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.616953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.616954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.616954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.616955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.616955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.616956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.616957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.616957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.616958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.616961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.616967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.616969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.616971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.616973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.616975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.616977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.616979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.616981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.616983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.616985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.616987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.616991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.616994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.616998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.617001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.617003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.617006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.617009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.617012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.617014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.617020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.617023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.617026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.617028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.617031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.617033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.617027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253327385:10211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.617036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.617039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.617044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.617046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.617049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.617051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.617053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.617055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.617058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.617078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.618685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253327385:10211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.623254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253327385:10211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.623263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253327385:10211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.623265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253327385:10211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.623268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.624511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.626056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.626065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.626067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.626069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.626073Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2599 [2:7556555583177755480:6638]
2025-10-02T09:35:00.626082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.626093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.626094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.626096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.626097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.626106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.626108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.626112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.626143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.626148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.626149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.626151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.626152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.626192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.626198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.626206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.626211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.626218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.626230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327421:10211], now have 1 active actors on pipe
2025-10-02T09:35:00.626234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.626235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.626237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.626241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.626249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.626255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.626258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.626259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.626260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.626262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.626265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327233:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.626278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2599
2025-10-02T09:35:00.626284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.626281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2599
2025-10-02T09:35:00.626289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.626296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.626429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.626435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.626449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.626456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.626458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.626459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.626465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.626471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.626479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.626612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.626618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.626628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.626700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2600 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0
2025-10-02T09:35:00.626932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd3e79c-bd144b98-70f2a0ab-7036acc6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.629628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Write session: try to update token
2025-10-02T09:35:00.629645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.635793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.635807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.635809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.635810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.635816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.635821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.635824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177755475:6638]
2025-10-02T09:35:00.635852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.635859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.635861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.635862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.635865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.635868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.635999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.642242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId: src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.644400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:00.704794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555583253327429:4103]
2025-10-02T09:35:00.705035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2599, pipe: [1:7556555583253327429:4103]
2025-10-02T09:35:00.747697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.747930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.747939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.747952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327429:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.748135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253327429:4103]
2025-10-02T09:35:00.748158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:00.748160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:00.748204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.748205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2600 reason: error at write: Disconnected sessionId: src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0
2025-10-02T09:35:00.748357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2600 sessionId: src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0 is DEAD
2025-10-02T09:35:00.748416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.748536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:00.748552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Write session will restart in 0.005391s
2025-10-02T09:35:00.748573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Write session: Do CDS request
2025-10-02T09:35:00.748579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.755145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.755232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.755240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2601
2025-10-02T09:35:00.755380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.755402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.755408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.755410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.755689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2601 sessionId:  describe result for acl check
2025-10-02T09:35:00.755714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.755718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.755719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.755723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253327510:10204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.756083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253327510:10204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.757671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253327510:10204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.758054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.758360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.758472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.758480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.758488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.758531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.758557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177755668:6634]
2025-10-02T09:35:00.758894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.759641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.759669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.759823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253327510:10204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.759832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253327510:10204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.759834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253327510:10204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.759837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.759959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.759992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.759996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.759996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.759997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.759998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.759998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.759999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.760000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.760000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.760001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.760002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.760002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.760005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.760011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.760014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.760016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.760018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.760020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.760022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.760024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.760027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.760029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.760031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.760033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.760037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.760041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.760045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.760048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.760050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.760052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.760055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.760057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.760060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.760062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.760064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.760067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.760070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.760073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.760076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.760078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.760081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.760084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.760086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.760088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.760090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.760093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.760095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.760098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.760117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.767513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.768937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.768946Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.768948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.768950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.768953Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2600 [2:7556555583177755668:6634]
2025-10-02T09:35:00.768961Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.768971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.768974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.768976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.768977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.768987Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.768993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.768997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.769026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.769030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.769031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.769033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.769034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.769109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.769114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.769120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.769125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.769134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.769148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327616:10204], now have 1 active actors on pipe
2025-10-02T09:35:00.769154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327430:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.769157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.769159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.769160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.769170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.769180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.769190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.769191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.769195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.769195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.769187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2600
2025-10-02T09:35:00.769196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.769200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2600
2025-10-02T09:35:00.769211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.769213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.769218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.769224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.769229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.769256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10091af9-edffe52d-177e872a-b0d23e14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.769263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.769266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.769267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.769272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.769280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.769291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.769402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.769406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.769415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.769485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2601 partition: 0 MaxSeqNo: 36 sessionId: src_id|10091af9-edffe52d-177e872a-b0d23e14_0
2025-10-02T09:35:00.769675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9c3a1f-9f59348d-e58398d9-d0011c78_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10091af9-edffe52d-177e872a-b0d23e14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.772371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Write session: try to update token
2025-10-02T09:35:00.772382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.778601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.778614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.778616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.778618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.778624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.778627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.778631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177755663:6634]
2025-10-02T09:35:00.778660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.778665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.778667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.778667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.778670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.778674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.778797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.784463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId: src_id|10091af9-edffe52d-177e872a-b0d23e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.786661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:00.848142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555583253327627:4103]
2025-10-02T09:35:00.848320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2600, pipe: [1:7556555583253327627:4103]
2025-10-02T09:35:00.890623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:00.891027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.891036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.891048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327627:4103], now have 1 active actors on pipe
2025-10-02T09:35:00.891199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:00.891226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:00.891248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253327627:4103]
2025-10-02T09:35:00.891257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:00.891263Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:35:00.891306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10091af9-edffe52d-177e872a-b0d23e14_0
2025-10-02T09:35:00.891350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2601 sessionId: src_id|10091af9-edffe52d-177e872a-b0d23e14_0 is DEAD
2025-10-02T09:35:00.891414Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 26 consumer shared/user session shared/user_1_26_18136196603800885689_v1 is DEAD
2025-10-02T09:35:00.891551Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555518828802710:4093] disconnected; active server actors: 1
2025-10-02T09:35:00.891558Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555518828802710:4093] client user disconnected session shared/user_1_26_18136196603800885689_v1
2025-10-02T09:35:00.891599Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:35:00.891609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:00.891618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Write session will restart in 0.007296s
2025-10-02T09:35:00.891633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Write session: Do CDS request
2025-10-02T09:35:00.891637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:00.891706Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:00.891712Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:00.891720Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.009624s
2025-10-02T09:35:00.900068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.900160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:00.900167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2602
2025-10-02T09:35:00.900266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:00.900285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:00.900292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:00.900295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:00.900541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2602 sessionId:  describe result for acl check
2025-10-02T09:35:00.900565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:00.900569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:00.900570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:00.900573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555583253327781:10193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:00.900931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555583253327781:10193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:00.901510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:00.902020Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:35:00.902179Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:35:00.902185Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 27
2025-10-02T09:35:00.902227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555583253327781:10193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:00.902284Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 27 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:00.902326Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:00.902383Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 auth for : user
2025-10-02T09:35:00.902440Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 Handle describe topics response
2025-10-02T09:35:00.902453Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 auth is DEAD
2025-10-02T09:35:00.902463Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:35:00.902631Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:35:00.902675Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_27_14426282335210093337_v1
2025-10-02T09:35:00.902680Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555583253327816:10182] connected; active server actors: 1
2025-10-02T09:35:00.902690Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555583253327816:10182] session shared/user_1_27_14426282335210093337_v1
2025-10-02T09:35:00.902695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:35:00.902703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:35:00.902707Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_27_14426282335210093337_v1" (Sender=[1:7556555583253327803:10182], Pipe=[1:7556555583253327816:10182], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:00.902713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:35:00.902720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:35:00.902725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_27_14426282335210093337_v1" (Sender=[1:7556555583253327803:10182], Pipe=[1:7556555583253327816:10182], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:00.902731Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_27_14426282335210093337_v1" sender [1:7556555583253327803:10182] lock partition 0 for ReadingSession "shared/user_1_27_14426282335210093337_v1" (Sender=[1:7556555583253327803:10182], Pipe=[1:7556555583253327816:10182], Partitions=[], ActiveFamilyCount=1) generation 1 step 27
2025-10-02T09:35:00.902737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:35:00.902744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T09:35:00.902887Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 27 Session: "shared/user_1_27_14426282335210093337_v1" ClientId: "user" PipeClient { RawX1: 7556555583253327816 RawX2: 4503603922347974 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:35:00.902902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:35:00.903109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:00.903206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:00.903212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:00.903217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:00.903247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:00.903271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555583177755859:6632]
2025-10-02T09:35:00.903667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:00.903822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555583253327781:10193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:00.903831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555583253327781:10193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:00.903833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555583253327781:10193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:00.903836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:00.903856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:00.903880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:00.904054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:00.904083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.904087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.904087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.904088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.904089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.904089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.904090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.904090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.904091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.904092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.904092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.904093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.904096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.904101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.904104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.904106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.904108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.904110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.904112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.904114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.904116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.904118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.904120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.904122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.904126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.904130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:00.904133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.904136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:00.904138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.904141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:00.904143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.904146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:00.904148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.904150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:00.904158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.904164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:00.904167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.904170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:00.904171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.904174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:00.904177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.904179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:00.904183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.904186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.904188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.904192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.904194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.904197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.904218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:00.911649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:00.913145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:00.913155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:00.913156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:00.913157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:00.913161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2601 [2:7556555583177755859:6632]
2025-10-02T09:35:00.913169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:00.913182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:00.913187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.913189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.913190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.913198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:00.913203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:00.913207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:00.913238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.913242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.913243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.913244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:00.913246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:00.913290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:00.913294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.913301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:00.913306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:00.913317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:00.913332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327828:10193], now have 1 active actors on pipe
2025-10-02T09:35:00.913337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327819:10189], now have 1 active actors on pipe
2025-10-02T09:35:00.913338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555583253327631:2446], now have 1 active actors on pipe
2025-10-02T09:35:00.913341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.913343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.913344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.913353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:00.913364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:00.913375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:00.913373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:00.913377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:00.913378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:00.913379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:00.913394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.913382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2601
2025-10-02T09:35:00.913399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:00.913402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:00.913402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2601
2025-10-02T09:35:00.913405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2601, pipe: [1:7556555583253327819:10189]
2025-10-02T09:35:00.913414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.913418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.913434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.913437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.913441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_27_14426282335210093337_v1 on pipe: [1:7556555583253327819:10189]
2025-10-02T09:35:00.913459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:00.913466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.913468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.913469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.913475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.913476Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_27_14426282335210093337_v1:1 with generation 2601
2025-10-02T09:35:00.913483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:00.913495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.913500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.913501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:00.913509Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_27_14426282335210093337_v1
2025-10-02T09:35:00.913512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.913526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.913536Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:35:00.913609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:00.913615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:00.913623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:00.913678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2602 partition: 0 MaxSeqNo: 36 sessionId: src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0
2025-10-02T09:35:00.913898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10091af9-edffe52d-177e872a-b0d23e14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:00.916661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Write session: try to update token
2025-10-02T09:35:00.916679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:00.916931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:35:00.916952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:35:00.916961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:00.916963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:00.916964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:00.916969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:35:00.916975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:35:00.917076Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397700913 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:35:00.917087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:35:00.917104Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 sending to client partition status
2025-10-02T09:35:00.922973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:00.922987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:00.922989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:00.922990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:00.922997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.923001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.923004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555583177755852:6632]
2025-10-02T09:35:00.923033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:00.923041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:00.923042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:00.923043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:00.923047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:00.923050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:00.923466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:00.929732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId: src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:00.932048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.035320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.035555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.035564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.035792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_27_14426282335210093337_v1
2025-10-02T09:35:01.035808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.035830Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_27_14426282335210093337_v1
2025-10-02T09:35:01.035814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555583253327819:10189]
2025-10-02T09:35:01.035823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:01.035827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:01.035836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.035872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2602 reason: error at write: Disconnected sessionId: src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0
2025-10-02T09:35:01.036016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2602 sessionId: src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0 is DEAD
2025-10-02T09:35:01.036183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:01.036203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Write session will restart in 0.005889s
2025-10-02T09:35:01.036228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Write session: Do CDS request
2025-10-02T09:35:01.036236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.043156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.043260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.043268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2603
2025-10-02T09:35:01.043386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.043405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.043411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.043414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.043720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2603 sessionId:  describe result for acl check
2025-10-02T09:35:01.043742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.043747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.043748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.043751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548295238:10184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.044106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548295238:10184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.045654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548295238:10184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.045873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.047366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.047546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548295238:10184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.047557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548295238:10184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.047559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548295238:10184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.047562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.047591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.047598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.047604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.047638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.047662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472723349:6619]
2025-10-02T09:35:01.048023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.048198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.048225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.048400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.048428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.048432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.048433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.048433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.048434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.048434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.048435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.048436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.048436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.048437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.048438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.048439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.048442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.048447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.048450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.048452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.048455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.048457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.048459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.048461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.048463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.048465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.048467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.048469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.048473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.048477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.048480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.048483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.048486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.048489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.048491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.048494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.048496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.048499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.048501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.048504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.048508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.048511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.048513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.048518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.048520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.048523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.048526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.048528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.048532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.048534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.048537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.048539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.048566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.056016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.057541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.057552Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.057553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.057555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.057559Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2602 [2:7556555587472723349:6619]
2025-10-02T09:35:01.057565Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.057574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.057579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.057581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.057582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.057590Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.057595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.057599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.057630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.057634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.057636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.057637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.057639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.057674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.057678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.057685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.057693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.057705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.057717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.057721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.057722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.057728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.057736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295324:10184], now have 1 active actors on pipe
2025-10-02T09:35:01.057738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.057741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.057742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295138:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.057743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.057745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.057754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.057757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.057771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.057780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.057779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2602
2025-10-02T09:35:01.057780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2602
2025-10-02T09:35:01.057790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.057824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.057829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.057842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.057849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.057851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.057853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.057859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.057867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.057875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.058005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.058012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.058021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.058087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2603 partition: 0 MaxSeqNo: 36 sessionId: src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0
2025-10-02T09:35:01.058300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|309d53f1-1c9e0aec-3b5cbe13-5696b420_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.060984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Write session: try to update token
2025-10-02T09:35:01.060998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.066894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.066907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.066909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.066910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.066915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.066918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.066921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472723341:6619]
2025-10-02T09:35:01.066948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.066951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.066954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.066955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.066957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.066957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.067076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.074117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId: src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.076303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.135913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555587548295336:10189]
2025-10-02T09:35:01.136108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2602, pipe: [1:7556555587548295336:10189]
2025-10-02T09:35:01.178355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.178681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.178690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.178703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295336:10189], now have 1 active actors on pipe
2025-10-02T09:35:01.178901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:01.178913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:01.178923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.178919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555587548295336:10189]
2025-10-02T09:35:01.178934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.178955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2603 reason: error at write: Disconnected sessionId: src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0
2025-10-02T09:35:01.179085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2603 sessionId: src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0 is DEAD
2025-10-02T09:35:01.179222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:01.179236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Write session will restart in 0.007487s
2025-10-02T09:35:01.179256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Write session: Do CDS request
2025-10-02T09:35:01.179262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.188128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.188193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.188200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2604
2025-10-02T09:35:01.188292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.188310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.188315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.188318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.188569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2604 sessionId:  describe result for acl check
2025-10-02T09:35:01.188597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.188603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.188604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.188608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548295500:10176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.188953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548295500:10176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.189437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.190472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548295500:10176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.191117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.191219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.191225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.191231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.191257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.191282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472723552:6621]
2025-10-02T09:35:01.191904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.192028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548295500:10176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.192037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548295500:10176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.192039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548295500:10176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.192042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.192092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.192116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.192389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.192418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.192422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.192423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.192423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.192424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.192425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.192425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.192426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.192427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.192427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.192428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.192429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.192431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.192438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.192440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.192442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.192444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.192447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.192449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.192451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.192453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.192455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.192457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.192459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.192463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.192467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.192470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.192473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.192479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.192482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.192484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.192487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.192489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.192494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.192496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.192500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.192503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.192507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.192510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.192514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.192517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.192520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.192522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.192528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.192531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.192543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.192549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.192551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.192569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.199965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.201526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.201536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.201537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.201539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.201543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2603 [2:7556555587472723552:6621]
2025-10-02T09:35:01.201551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.201561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.201564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.201565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.201566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.201575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.201578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.201582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.201615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.201623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.201624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.201626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.201627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.201666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.201670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.201677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.201682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.201690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.201703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.201707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.201708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.201713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.201722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295540:10176], now have 1 active actors on pipe
2025-10-02T09:35:01.201726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.201728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295349:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.201729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.201731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.201733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.201740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.201741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.201755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.201764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.201756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2603
2025-10-02T09:35:01.201756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2603
2025-10-02T09:35:01.201783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.201818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.201823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.201836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6728047-41eec818-d01208d9-9db90b2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.201843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.201845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.201846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.201851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.201855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.201866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.201978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.201984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.201994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.202061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2604 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6728047-41eec818-d01208d9-9db90b2e_0
2025-10-02T09:35:01.202272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a477b187-6f6ffc08-c4c42b56-72cd8195_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6728047-41eec818-d01208d9-9db90b2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.204992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Write session: try to update token
2025-10-02T09:35:01.205010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.215688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:01.215699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.215704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.215736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:01.215742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:01.215897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:01.216042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.216178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.216318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.216502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:01.216531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:01.217814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId: src_id|d6728047-41eec818-d01208d9-9db90b2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.219896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.219908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.219909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.219910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.219915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.219917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.219919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472723546:6621]
2025-10-02T09:35:01.219942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.219945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.219948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.219948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.219950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.219951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.220027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.220061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.279254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555587548295571:10189]
2025-10-02T09:35:01.279663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2603, pipe: [1:7556555587548295571:10189]
2025-10-02T09:35:01.329961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.330224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.330232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.330246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295571:10189], now have 1 active actors on pipe
2025-10-02T09:35:01.330406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.330427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555587548295571:10189]
2025-10-02T09:35:01.330434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.330452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:01.330513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2604 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6728047-41eec818-d01208d9-9db90b2e_0
2025-10-02T09:35:01.330657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2604 sessionId: src_id|d6728047-41eec818-d01208d9-9db90b2e_0 is DEAD
2025-10-02T09:35:01.330839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:01.330854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Write session will restart in 0.008209s
2025-10-02T09:35:01.330883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Write session: Do CDS request
2025-10-02T09:35:01.330889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.340146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.340459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.340469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2605
2025-10-02T09:35:01.340593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.340586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.340614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.340620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.340622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.340900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2605 sessionId:  describe result for acl check
2025-10-02T09:35:01.340925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.340930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.340931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.340934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548295728:10158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.341270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548295728:10158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.342063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.342165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.342171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.342177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.342202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.342263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472723779:6597]
2025-10-02T09:35:01.342654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548295728:10158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.342688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.342873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.342897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.343097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.343130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.343134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.343135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.343135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.343135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.343136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.343137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.343137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.343138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.343138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.343139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.343139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.343142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.343149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.343151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.343153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.343155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.343157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.343159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.343161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.343163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.343165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.343167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.343169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.343173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.343177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.343180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.343183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.343185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.343188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.343190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.343193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.343196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.343198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.343200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.343203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.343206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.343209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.343213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.343215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.343219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.343222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.343224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.343229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.343231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.343234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.343236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.343239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.343255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.347098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548295728:10158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.347107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548295728:10158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.347109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548295728:10158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.347113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.350678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.352189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.352199Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.352200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.352202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.352206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2604 [2:7556555587472723779:6597]
2025-10-02T09:35:01.352213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.352222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.352227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.352228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.352230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.352239Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.352242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.352246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.352281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.352285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.352286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.352288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.352289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.352329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.352334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.352340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.352346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.352355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.352369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.352373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.352374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.352379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.352388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295767:10158], now have 1 active actors on pipe
2025-10-02T09:35:01.352391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.352394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.352396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295574:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.352396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.352399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.352406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.352408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.352422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.352434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.352431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2604
2025-10-02T09:35:01.352435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2604
2025-10-02T09:35:01.352448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.352548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.352554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.352570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.352577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.352579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.352580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.352585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.352592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.352600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.352742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.352749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.352759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.352842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2605 partition: 0 MaxSeqNo: 36 sessionId: src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0
2025-10-02T09:35:01.353094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6728047-41eec818-d01208d9-9db90b2e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.355724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Write session: try to update token
2025-10-02T09:35:01.355738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.361383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:01.361394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.361399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.361426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:01.361439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:01.361582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:01.361714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.361840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.361968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.362131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:01.362157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:01.368707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId: src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.369907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.369918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.369919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.369920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.369924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.369926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.369928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472723774:6597]
2025-10-02T09:35:01.369951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.369954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.369955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.369974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.369992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.369995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.370063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.371169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.430813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555587548295776:10189]
2025-10-02T09:35:01.431075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2604, pipe: [1:7556555587548295776:10189]
2025-10-02T09:35:01.481924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.482266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.482274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.482287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295776:10189], now have 1 active actors on pipe
2025-10-02T09:35:01.482496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.482494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:01.482501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:01.482536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.482552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2605 reason: error at write: Disconnected sessionId: src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0
2025-10-02T09:35:01.482584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555587548295776:10189]
2025-10-02T09:35:01.482675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2605 sessionId: src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0 is DEAD
2025-10-02T09:35:01.482819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:01.482833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Write session will restart in 0.005684s
2025-10-02T09:35:01.482854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Write session: Do CDS request
2025-10-02T09:35:01.482859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.489144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.489272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.489280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2606
2025-10-02T09:35:01.489400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.489421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.489428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.489431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.489779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2606 sessionId:  describe result for acl check
2025-10-02T09:35:01.489804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.489809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.489810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.489813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548295835:10142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.490171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548295835:10142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.491895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548295835:10142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.493102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.494821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.494881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548295835:10142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.494889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548295835:10142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.494891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548295835:10142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.494895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.494985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.494992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.494998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.495028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.495053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472723976:6596]
2025-10-02T09:35:01.495391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.495579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.495603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.495782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.495812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.495815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.495816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.495817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.495817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.495818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.495818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.495819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.495819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.495820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.495821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.495821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.495824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.495830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.495832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.495835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.495837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.495839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.495841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.495842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.495844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.495847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.495849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.495850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.495854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.495858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.495861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.495864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.495867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.495870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.495872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.495875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.495878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.495880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.495882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.495889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.495891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.495894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.495896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.495899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.495901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.495904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.495907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.495910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.495912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.495915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.495917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.495920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.495940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.503336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.504905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.504914Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.504915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.504916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.504920Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2605 [2:7556555587472723976:6596]
2025-10-02T09:35:01.504928Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.504937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.504942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.504943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.504944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.504953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.504959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.504964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.504991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.504995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.504996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.504998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.505000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.505036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.505041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.505047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.505052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.505060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.505073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.505078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.505079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.505083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.505091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.505101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.505102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.505105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.505106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.505109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.505111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295777:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.505114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295967:10142], now have 1 active actors on pipe
2025-10-02T09:35:01.505127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.505133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.505136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.505140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2605
2025-10-02T09:35:01.505155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2605
2025-10-02T09:35:01.505234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.505239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.505254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.505261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.505263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.505264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.505268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.505277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.505286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.505409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.505415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.505424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.505490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2606 partition: 0 MaxSeqNo: 36 sessionId: src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0
2025-10-02T09:35:01.505682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5ef0ae-db97cd28-6176a522-2ebf273b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.508412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Write session: try to update token
2025-10-02T09:35:01.508423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.514460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.514474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.514476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.514477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.514485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.514488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.514491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472723969:6596]
2025-10-02T09:35:01.514531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.514537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.514539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.514541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.514542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.514548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.514671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.520690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId: src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.522958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.582882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555587548295982:10189]
2025-10-02T09:35:01.583112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2605, pipe: [1:7556555587548295982:10189]
2025-10-02T09:35:01.628894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.629145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.629158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.629170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295982:10189], now have 1 active actors on pipe
2025-10-02T09:35:01.629423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.629449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555587548295982:10189]
2025-10-02T09:35:01.629454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:01.629456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:01.629498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2606 reason: error at write: Disconnected sessionId: src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0
2025-10-02T09:35:01.629632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2606 sessionId: src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0 is DEAD
2025-10-02T09:35:01.629774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:01.629783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Write session will restart in 0.005246s
2025-10-02T09:35:01.629784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.629798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Write session: Do CDS request
2025-10-02T09:35:01.629817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.636181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.636281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.636289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2607
2025-10-02T09:35:01.636388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.636407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.636411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.636414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.636746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2607 sessionId:  describe result for acl check
2025-10-02T09:35:01.636773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.636778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.636781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.636784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548296054:10130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.637145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548296054:10130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.638803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548296054:10130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.639707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.641116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.641270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548296054:10130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.641278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548296054:10130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.641280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548296054:10130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.641280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.641284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.641288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.641295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.641328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.641353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472724168:6593]
2025-10-02T09:35:01.641694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.641873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.641896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.642073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.642102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.642106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.642106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.642107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.642107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.642108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.642109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.642109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.642110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.642110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.642111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.642111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.642114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.642120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.642122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.642125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.642127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.642129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.642131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.642133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.642135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.642138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.642140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.642142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.642146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.642150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.642153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.642155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.642157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.642160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.642162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.642164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.642167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.642169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.642171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.642174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.642176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.642178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.642181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.642183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.642187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.642189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.642191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.642194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.642196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.642199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.642201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.642204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.642222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.649727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.651151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.651161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.651163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.651165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.651168Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2606 [2:7556555587472724168:6593]
2025-10-02T09:35:01.651174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.651184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.651189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.651190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.651191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.651200Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.651207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.651212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.651241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.651246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.651248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.651249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.651251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.651287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.651291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.651297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.651302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.651310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.651324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.651328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.651329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.651334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.651341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296173:10130], now have 1 active actors on pipe
2025-10-02T09:35:01.651348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548295983:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.651347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.651351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.651351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.651353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.651358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.651360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.651373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.651378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.651366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2606
2025-10-02T09:35:01.651367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2606
2025-10-02T09:35:01.651399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.651402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.651404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.651417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93bc894f-453bc17-e03368c6-3b96deff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.651424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.651426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.651427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.651432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.651439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.651445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.651542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.651547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.651555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.651628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2607 partition: 0 MaxSeqNo: 36 sessionId: src_id|93bc894f-453bc17-e03368c6-3b96deff_0
2025-10-02T09:35:01.651874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbdb6be8-cf3c905-f37200f8-490f06be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|93bc894f-453bc17-e03368c6-3b96deff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.654708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Write session: try to update token
2025-10-02T09:35:01.654726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.660720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.660733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.660735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.660736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.660741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.660745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.660748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472724163:6593]
2025-10-02T09:35:01.660776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.660777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.660780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.660783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.660784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.660786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.660929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.668531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId: src_id|93bc894f-453bc17-e03368c6-3b96deff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.670775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.729828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555587548296186:10189]
2025-10-02T09:35:01.730061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2606, pipe: [1:7556555587548296186:10189]
2025-10-02T09:35:01.773788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.774091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.774099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.774112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296186:10189], now have 1 active actors on pipe
2025-10-02T09:35:01.774332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555587548296186:10189]
2025-10-02T09:35:01.774355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.774355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:01.774358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:01.774404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2607 reason: error at write: Disconnected sessionId: src_id|93bc894f-453bc17-e03368c6-3b96deff_0
2025-10-02T09:35:01.774562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2607 sessionId: src_id|93bc894f-453bc17-e03368c6-3b96deff_0 is DEAD
2025-10-02T09:35:01.774731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:01.774748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Write session will restart in 0.009272s
2025-10-02T09:35:01.774769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Write session: Do CDS request
2025-10-02T09:35:01.774775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.774852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.784440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.784744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.784866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.784873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.784880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.784909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.784934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472724362:6588]
2025-10-02T09:35:01.785132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.785250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.785260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2608
2025-10-02T09:35:01.785284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.785347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.785365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.785372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.785374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.785646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2608 sessionId:  describe result for acl check
2025-10-02T09:35:01.785670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.785675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.785676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.785679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548296344:10128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.786037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548296344:10128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.786091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.786115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.786390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.786420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.786423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.786424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.786425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.786426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.786426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.786427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.786428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.786428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.786429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.786430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.786430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.786433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.786439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.786441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.786443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.786445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.786447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.786449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.786451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.786453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.786455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.786457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.786459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.786462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.786467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.786469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.786473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.786475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.786478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.786480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.786482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.786484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.786487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.786490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.786492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.786495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.786497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.786500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.786513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.786518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.786521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.786523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.786526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.786528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.786530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.786534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.786536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.786553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.787480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548296344:10128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.791360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548296344:10128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.791370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548296344:10128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.791373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548296344:10128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.791377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.794064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.795582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.795593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.795594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.795596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.795599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2607 [2:7556555587472724362:6588]
2025-10-02T09:35:01.795608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.795618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.795623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.795624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.795625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.795634Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.795637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.795641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.795675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.795680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.795681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.795683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.795684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.795730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.795735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.795741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.795746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.795754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.795768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296187:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.795773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296383:10128], now have 1 active actors on pipe
2025-10-02T09:35:01.795777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.795778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.795780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.795789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.795799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.795810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.795810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.795813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.795814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.795810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2607
2025-10-02T09:35:01.795815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.795811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2607
2025-10-02T09:35:01.795828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.795831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.795833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.795847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.795852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.795970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.795979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.795981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.795982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.795988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.795994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.796012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.796132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.796138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.796148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.796206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2608 partition: 0 MaxSeqNo: 36 sessionId: src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0
2025-10-02T09:35:01.796406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bc894f-453bc17-e03368c6-3b96deff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.799035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Write session: try to update token
2025-10-02T09:35:01.799050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.805289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.805300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.805302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.805303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.805308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.805311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.805314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472724357:6588]
2025-10-02T09:35:01.805346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.805352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.805354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.805356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.805356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.805358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.805483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.811552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId: src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.813783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:01.874720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555587548296391:10189]
2025-10-02T09:35:01.875137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2607, pipe: [1:7556555587548296391:10189]
2025-10-02T09:35:01.918828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:01.919065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.919075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.919089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296391:10189], now have 1 active actors on pipe
2025-10-02T09:35:01.919297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:01.919357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:01.919387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555587548296391:10189]
2025-10-02T09:35:01.919393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:01.919456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2608 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0
2025-10-02T09:35:01.919607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2608 sessionId: src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0 is DEAD
2025-10-02T09:35:01.919784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:01.919800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Write session will restart in 0.007768s
2025-10-02T09:35:01.919826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Write session: Do CDS request
2025-10-02T09:35:01.919831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:01.928230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.928303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:01.928314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2609
2025-10-02T09:35:01.928432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:01.928452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:01.928458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:01.928460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:01.928770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2609 sessionId:  describe result for acl check
2025-10-02T09:35:01.928811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:01.928815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:01.928817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:01.928820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555587548296554:10121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:01.929178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555587548296554:10121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:01.929684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:01.930365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555587548296554:10121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:01.931263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:01.931364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:01.931370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:01.931376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:01.931401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:01.931425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555587472724559:6582]
2025-10-02T09:35:01.931823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:01.931874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555587548296554:10121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:01.931882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555587548296554:10121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:01.931884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555587548296554:10121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:01.931887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:01.932005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:01.932029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:01.932206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:01.932237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.932240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.932241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.932242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.932243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.932243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.932244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.932244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.932245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.932245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.932246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.932247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.932249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.932255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.932257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.932259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.932261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.932263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.932266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.932268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.932270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.932272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.932274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.932276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.932279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.932283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:01.932286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.932289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:01.932291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.932294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:01.932298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.932301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:01.932303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.932306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:01.932308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.932311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:01.932313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.932316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:01.932318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.932321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:01.932323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.932327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:01.932330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.932333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.932336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.932338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.932341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.932343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.932361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:01.939901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:01.941373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:01.941385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:01.941386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:01.941389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:01.941394Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2608 [2:7556555587472724559:6582]
2025-10-02T09:35:01.941402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:01.941414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:01.941415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.941417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.941418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.941427Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:01.941434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:01.941438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:01.941467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.941472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.941473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.941475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:01.941477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:01.941519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:01.941524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.941530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:01.941535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:01.941545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:01.941560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296399:2446], now have 1 active actors on pipe
2025-10-02T09:35:01.941567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.941569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.941570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.941575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:01.941580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555587548296594:10121], now have 1 active actors on pipe
2025-10-02T09:35:01.941586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:01.941591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:01.941593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:01.941595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:01.941604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:01.941606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:01.941609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.941611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:01.941612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2608
2025-10-02T09:35:01.941613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2608
2025-10-02T09:35:01.941629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:01.941667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.941673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.941687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deff0b8-e0ba6993-32728220-391838f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:01.941693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:01.941695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:01.941697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:01.941702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:01.941707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:01.941716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.941838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:01.941845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:01.941854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:01.941924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2609 partition: 0 MaxSeqNo: 36 sessionId: src_id|deff0b8-e0ba6993-32728220-391838f9_0
2025-10-02T09:35:01.942194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cb29f94-ff69c17-a4a6d9f-4ab079c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|deff0b8-e0ba6993-32728220-391838f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:01.944896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Write session: try to update token
2025-10-02T09:35:01.944913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:01.950799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:01.950812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.950817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.950853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:01.950875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:01.951013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:01.951145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.951275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.951405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:01.951585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:01.951616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:01.957857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId: src_id|deff0b8-e0ba6993-32728220-391838f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:01.959189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:01.959201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:01.959202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:01.959203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:01.959208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.959211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.959213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555587472724553:6582]
2025-10-02T09:35:01.959233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:01.959236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:01.959237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:01.959248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:01.959263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:01.959266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:01.959345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:01.960342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.019619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843263903:10189]
2025-10-02T09:35:02.019833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2608, pipe: [1:7556555591843263903:10189]
2025-10-02T09:35:02.075007Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.075295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.075304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.075317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843263903:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.075500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.075505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843263903:10189]
2025-10-02T09:35:02.075525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:02.075528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:02.075576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.075582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2609 reason: error at write: Disconnected sessionId: src_id|deff0b8-e0ba6993-32728220-391838f9_0
2025-10-02T09:35:02.075750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2609 sessionId: src_id|deff0b8-e0ba6993-32728220-391838f9_0 is DEAD
2025-10-02T09:35:02.075931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:02.075946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Write session will restart in 0.005399s
2025-10-02T09:35:02.075967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Write session: Do CDS request
2025-10-02T09:35:02.075972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.082128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.082242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.082254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2610
2025-10-02T09:35:02.082380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.082405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.082413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.082417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.082758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2610 sessionId:  describe result for acl check
2025-10-02T09:35:02.082786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.082792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.082794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.082798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843263974:10115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.083163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843263974:10115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.085000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843263974:10115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.086116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.087551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.087661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.087669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.087674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.087701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.087725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767692066:6578]
2025-10-02T09:35:02.087770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843263974:10115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.087779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843263974:10115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.087781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843263974:10115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.087785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:02.088070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.088260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.088283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.088477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.088511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.088515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.088515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.088516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.088517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.088517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.088518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.088518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.088519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.088520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.088520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.088521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.088524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.088529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.088531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.088533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.088535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.088537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.088539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.088542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.088544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.088546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.088548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.088550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.088554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.088558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.088561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.088564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.088566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.088572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.088574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.088577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.088580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.088582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.088584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.088587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.088592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.088595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.088597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.088600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.088602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.088607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.088610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.088612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.088614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.088620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.088622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.088625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.088642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.096202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:02.097864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:02.097877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:02.097878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:02.097881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:02.097885Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2609 [2:7556555591767692066:6578]
2025-10-02T09:35:02.097892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:02.097904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:02.097906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.097908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.097909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.097919Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:02.097923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:02.097928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:02.097963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.097968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.097970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.097972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:02.097974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:02.098015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:02.098020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.098027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.098032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.098040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:02.098056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.098060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.098061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.098067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:02.098077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264098:10115], now have 1 active actors on pipe
2025-10-02T09:35:02.098081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:02.098084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843263904:2446], now have 1 active actors on pipe
2025-10-02T09:35:02.098085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:02.098087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:02.098087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:02.098095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:02.098096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:02.098115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.098120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:02.098112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2609
2025-10-02T09:35:02.098116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2609
2025-10-02T09:35:02.098142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:02.098149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.098151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.098166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|243c09f6-66688753-8cf72217-a4e4752c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:02.098173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.098175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.098177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:02.098182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.098190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:02.098197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.098321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.098326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.098333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.098403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2610 partition: 0 MaxSeqNo: 36 sessionId: src_id|243c09f6-66688753-8cf72217-a4e4752c_0
2025-10-02T09:35:02.098697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deff0b8-e0ba6993-32728220-391838f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|243c09f6-66688753-8cf72217-a4e4752c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:02.101344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Write session: try to update token
2025-10-02T09:35:02.101361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:02.107130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:02.107143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.107148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.107178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:02.107186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:02.107331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:02.107462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:02.107590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:02.107714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:02.107989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:02.108020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:02.114310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId: src_id|243c09f6-66688753-8cf72217-a4e4752c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:02.115872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:02.115886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.115888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:02.115889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:02.115894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.115897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.115899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767692060:6578]
2025-10-02T09:35:02.115924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:02.115927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:02.115928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.115929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:02.115930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:02.115934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:02.116048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:02.116872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.175788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843264121:10189]
2025-10-02T09:35:02.175975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2609, pipe: [1:7556555591843264121:10189]
2025-10-02T09:35:02.230453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.230888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.230897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.230911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264121:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.231161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.231178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.231188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843264121:10189]
2025-10-02T09:35:02.231207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:02.231265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|243c09f6-66688753-8cf72217-a4e4752c_0
2025-10-02T09:35:02.231422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2610 sessionId: src_id|243c09f6-66688753-8cf72217-a4e4752c_0 is DEAD
2025-10-02T09:35:02.231576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:02.231594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Write session will restart in 0.005954s
2025-10-02T09:35:02.231626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Write session: Do CDS request
2025-10-02T09:35:02.231633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.238210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.238339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.238351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2611
2025-10-02T09:35:02.238466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.238491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.238497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.238509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.238803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2611 sessionId:  describe result for acl check
2025-10-02T09:35:02.238827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.238831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.238832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.238835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843264187:10111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.239193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843264187:10111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.241150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843264187:10111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.242123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.243606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.243785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.243793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.243800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.243824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843264187:10111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.243831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.243833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843264187:10111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.243835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843264187:10111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.243838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:02.243859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767692277:6561]
2025-10-02T09:35:02.244236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.244424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.244447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.244647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.244684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.244688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.244689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.244689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.244690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.244691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.244691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.244692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.244693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.244693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.244694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.244695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.244698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.244704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.244706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.244709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.244711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.244713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.244715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.244717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.244719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.244722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.244724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.244726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.244731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.244735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.244738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.244742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.244746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.244749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.244751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.244754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.244756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.244759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.244761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.244764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.244766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.244769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.244771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.244774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.244777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.244780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.244782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.244784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.244787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.244790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.244792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.244795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.244823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.252685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:02.254282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:02.254294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:02.254296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:02.254299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:02.254303Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2610 [2:7556555591767692277:6561]
2025-10-02T09:35:02.254311Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:02.254321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:02.254323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.254325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.254326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.254335Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:02.254337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:02.254342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:02.254371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.254377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.254378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.254380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:02.254381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:02.254421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:02.254425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.254432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.254437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.254449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:02.254461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264317:10111], now have 1 active actors on pipe
2025-10-02T09:35:02.254467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264123:2446], now have 1 active actors on pipe
2025-10-02T09:35:02.254470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.254472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.254473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.254479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:02.254486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:02.254490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:02.254494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:02.254495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:02.254507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:02.254509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:02.254523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.254526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:02.254512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2610
2025-10-02T09:35:02.254528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:02.254534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2610
2025-10-02T09:35:02.254590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.254598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.254626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3088a098-8b6643bf-44e49b5e-78230e87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:02.254636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.254639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.254641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:02.254648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.254658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:02.254670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.254843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.254848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.254856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.254921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2611 partition: 0 MaxSeqNo: 36 sessionId: src_id|3088a098-8b6643bf-44e49b5e-78230e87_0
2025-10-02T09:35:02.255224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|243c09f6-66688753-8cf72217-a4e4752c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3088a098-8b6643bf-44e49b5e-78230e87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:02.257906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Write session: try to update token
2025-10-02T09:35:02.257921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:02.264341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:02.264356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.264357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:02.264358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:02.264363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.264366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.264368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767692262:6561]
2025-10-02T09:35:02.264393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:02.264396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.264397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:02.264399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:02.264403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:02.264406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:02.264506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:02.270832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId: src_id|3088a098-8b6643bf-44e49b5e-78230e87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:02.273113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.331448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843264353:10189]
2025-10-02T09:35:02.331649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2610, pipe: [1:7556555591843264353:10189]
2025-10-02T09:35:02.379503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.379765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.379774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.379787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264353:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.380196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.380240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843264353:10189]
2025-10-02T09:35:02.380252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:02.380266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.380308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2611 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3088a098-8b6643bf-44e49b5e-78230e87_0
2025-10-02T09:35:02.380470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2611 sessionId: src_id|3088a098-8b6643bf-44e49b5e-78230e87_0 is DEAD
2025-10-02T09:35:02.380662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:02.380679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Write session will restart in 0.007567s
2025-10-02T09:35:02.380702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Write session: Do CDS request
2025-10-02T09:35:02.380707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.389087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.389551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.389560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2612
2025-10-02T09:35:02.389701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.389731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.389739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.389742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.390077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2612 sessionId:  describe result for acl check
2025-10-02T09:35:02.390093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.390103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.390107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.390109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.390112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843264515:10091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.390471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843264515:10091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.391698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.391832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.391838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.391844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.391873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.391911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767692500:6555]
2025-10-02T09:35:02.391913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843264515:10091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.392256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.392448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.392471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.392654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.392683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.392686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.392687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.392687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.392688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.392689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.392689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.392690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.392690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.392691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.392691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.392692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.392695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.392700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.392702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.392704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.392706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.392708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.392710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.392712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.392714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.392716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.392718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.392720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.392724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.392728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.392731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.392734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.392736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.392739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.392741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.392744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.392746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.392749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.392750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.392753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.392755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.392758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.392760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.392763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.392765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.392768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.392770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.392773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.392775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.392777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.392780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.392787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.392817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.396687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843264515:10091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.396696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843264515:10091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.396700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843264515:10091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.396704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:02.400280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:02.401949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:02.401961Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:02.401962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:02.401964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:02.401967Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2611 [2:7556555591767692500:6555]
2025-10-02T09:35:02.401976Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:02.401986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:02.401992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.401994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.401995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.402005Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:02.402008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:02.402012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:02.402042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.402047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.402048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.402050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:02.402052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:02.402090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:02.402095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.402101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.402107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.402118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:02.402134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264555:10091], now have 1 active actors on pipe
2025-10-02T09:35:02.402139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264355:2446], now have 1 active actors on pipe
2025-10-02T09:35:02.402143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.402144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.402145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.402155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:02.402166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:02.402177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:02.402176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:02.402180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:02.402180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:02.402182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:02.402196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.402201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:02.402187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2611
2025-10-02T09:35:02.402192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2611
2025-10-02T09:35:02.402212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:02.402226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.402231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.402247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:02.402254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.402256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.402257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:02.402263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.402271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:02.402282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.402415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.402422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.402433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.402522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2612 partition: 0 MaxSeqNo: 36 sessionId: src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0
2025-10-02T09:35:02.402799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3088a098-8b6643bf-44e49b5e-78230e87_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:02.405507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Write session: try to update token
2025-10-02T09:35:02.405524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:02.411452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:02.411468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.411470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:02.411472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:02.411478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.411481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.411484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767692495:6555]
2025-10-02T09:35:02.411513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:02.411515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:02.411518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:02.411521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:02.411522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.411523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:02.411649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:02.418404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId: src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:02.420920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.480431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843264562:10189]
2025-10-02T09:35:02.480710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2611, pipe: [1:7556555591843264562:10189]
2025-10-02T09:35:02.529134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.529694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.529706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.529719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264562:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.529965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843264562:10189]
2025-10-02T09:35:02.529974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:02.529977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:02.529997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.530040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.530028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2612 reason: error at write: Disconnected sessionId: src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0
2025-10-02T09:35:02.530196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2612 sessionId: src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0 is DEAD
2025-10-02T09:35:02.530374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:02.530389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Write session will restart in 0.009616s
2025-10-02T09:35:02.530418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Write session: Do CDS request
2025-10-02T09:35:02.530424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.540935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.541197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.541268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.541276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2613
2025-10-02T09:35:02.541363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.541383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.541389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.541393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.541670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2613 sessionId:  describe result for acl check
2025-10-02T09:35:02.541694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.541699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.541700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.541703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843264726:10083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.542054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843264726:10083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.542623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.542800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.542809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.542816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.542849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.542873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767692701:6551]
2025-10-02T09:35:02.543217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.543260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843264726:10083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.543410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.543435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.543625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.543659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.543662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.543663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.543664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.543664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.543665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.543666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.543666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.543667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.543667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.543668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.543668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.543671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.543677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.543679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.543681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.543683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.543685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.543687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.543689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.543691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.543693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.543695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.543697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.543701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.543704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.543708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.543711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.543716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.543718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.543720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.543723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.543725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.543728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.543730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.543733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.543739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.543742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.543744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.543747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.543749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.543752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.543754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.543756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.543760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.543763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.543765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.543768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.543790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.547570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843264726:10083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.547579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843264726:10083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.547581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843264726:10083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.547584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:02.551267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:02.554178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:02.554189Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:02.554190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:02.554191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:02.554194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2612 [2:7556555591767692701:6551]
2025-10-02T09:35:02.554208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:02.554221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:02.554226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.554227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.554229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.554237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:02.554243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:02.554247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:02.554277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.554281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.554282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.554284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:02.554286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:02.554327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:02.554331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.554338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.554347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.554358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:02.554371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264564:2446], now have 1 active actors on pipe
2025-10-02T09:35:02.554376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264765:10083], now have 1 active actors on pipe
2025-10-02T09:35:02.554380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.554381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.554382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.554387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:02.554398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:02.554401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:02.554404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:02.554406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:02.554408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:02.554410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:02.554403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2612
2025-10-02T09:35:02.554424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.554429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:02.554405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2612
2025-10-02T09:35:02.554432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:02.554446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.554451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.554468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:02.554475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.554478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.554479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:02.554484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.554489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:02.554498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.554614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.554619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.554626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.554697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2613 partition: 0 MaxSeqNo: 36 sessionId: src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0
2025-10-02T09:35:02.554913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43dd197-cf532a1a-1e4278ad-da9bc847_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:02.557675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Write session: try to update token
2025-10-02T09:35:02.557695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:02.563648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:02.563662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.563664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:02.563666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:02.563674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.563677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.563680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767692695:6551]
2025-10-02T09:35:02.563709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:02.563710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:02.563713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:02.563716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:02.563717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.563718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:02.563860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:02.572653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId: src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:02.574928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.629936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843264772:10189]
2025-10-02T09:35:02.630211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2612, pipe: [1:7556555591843264772:10189]
2025-10-02T09:35:02.677696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.677922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.677931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.677943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264772:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.678136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.678148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:02.678158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:02.678158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843264772:10189]
2025-10-02T09:35:02.678177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.678202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2613 reason: error at write: Disconnected sessionId: src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0
2025-10-02T09:35:02.678345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2613 sessionId: src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0 is DEAD
2025-10-02T09:35:02.678539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:02.678557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Write session will restart in 0.009636s
2025-10-02T09:35:02.678583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Write session: Do CDS request
2025-10-02T09:35:02.678590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.688368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.689180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.689249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.689258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2614
2025-10-02T09:35:02.689372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.689393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.689400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.689403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.689666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2614 sessionId:  describe result for acl check
2025-10-02T09:35:02.689692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.689696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.689697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.689700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843264937:10074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.690041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843264937:10074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.690102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.690210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.690217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.690223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.690250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.690276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767692902:6549]
2025-10-02T09:35:02.690646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.690840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.690865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.691051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.691083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.691086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.691087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.691088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.691088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.691089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.691090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.691090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.691091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.691091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.691092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.691093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.691095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.691101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.691103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.691105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.691107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.691109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.691111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.691113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.691115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.691118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.691120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.691121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.691125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.691130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.691133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.691136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.691138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.691141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.691143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.691146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.691149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.691152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.691154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.691156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.691160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.691163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.691166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.691168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.691171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.691166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843264937:10074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.691177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.691180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.691182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.691185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.691188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.691193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.691196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.691218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.695989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843264937:10074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.695998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843264937:10074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.696000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843264937:10074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.696004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:02.698662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:02.700263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:02.700272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:02.700273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:02.700276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:02.700280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2613 [2:7556555591767692902:6549]
2025-10-02T09:35:02.700287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:02.700298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:02.700303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.700305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.700306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.700315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:02.700322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:02.700327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:02.700359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.700364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.700365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.700367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:02.700368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:02.700409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:02.700413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.700420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.700425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.700433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:02.700445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.700449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.700450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.700456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:02.700466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264773:2446], now have 1 active actors on pipe
2025-10-02T09:35:02.700471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:02.700473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:02.700474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:02.700476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:02.700481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:02.700483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:02.700486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264976:10074], now have 1 active actors on pipe
2025-10-02T09:35:02.700499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.700509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2613
2025-10-02T09:35:02.700511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:02.700511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2613
2025-10-02T09:35:02.700526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:02.700600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.700605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.700618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24a0cb3b-117086dc-16591885-df91d93b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:02.700625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.700627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.700628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:02.700633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.700638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:02.700645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.700773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.700780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.700789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.700857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2614 partition: 0 MaxSeqNo: 36 sessionId: src_id|24a0cb3b-117086dc-16591885-df91d93b_0
2025-10-02T09:35:02.701132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29b2c34-b8f4bd01-5a1e787d-aacc10f5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24a0cb3b-117086dc-16591885-df91d93b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:02.703854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Write session: try to update token
2025-10-02T09:35:02.703872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:02.713454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:02.713465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.713470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.713494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:02.713515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:02.713635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:02.713753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:02.713867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:02.713982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:02.714312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:02.714351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:02.718114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:02.718298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId: src_id|24a0cb3b-117086dc-16591885-df91d93b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:02.718335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.718340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:02.718341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:02.718345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.718348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.718351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767692896:6549]
2025-10-02T09:35:02.718374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:02.718381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.718382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:02.718382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:02.718386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:02.718389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:02.718534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:02.720497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.778406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843264983:10189]
2025-10-02T09:35:02.778624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2613, pipe: [1:7556555591843264983:10189]
2025-10-02T09:35:02.830760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.830973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.830981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.830994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264983:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.831172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.831160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843264983:10189]
2025-10-02T09:35:02.831182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.831185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:02.831187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:02.831228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2614 reason: error at write: Disconnected sessionId: src_id|24a0cb3b-117086dc-16591885-df91d93b_0
2025-10-02T09:35:02.831388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2614 sessionId: src_id|24a0cb3b-117086dc-16591885-df91d93b_0 is DEAD
2025-10-02T09:35:02.831549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:02.831563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Write session will restart in 0.009487s
2025-10-02T09:35:02.831589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Write session: Do CDS request
2025-10-02T09:35:02.831595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.841839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.842229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.842320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.842331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2615
2025-10-02T09:35:02.842432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.842450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.842457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.842459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.842754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2615 sessionId:  describe result for acl check
2025-10-02T09:35:02.842781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.842782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.842783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.842786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843265148:10062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.843133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843265148:10062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.843518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.843640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.843648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.843655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.843686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.843714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767693104:6537]
2025-10-02T09:35:02.844059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.844216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843265148:10062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.844247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.844269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.844459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.844492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.844495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.844496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.844496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.844497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.844498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.844498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.844499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.844499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.844500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.844500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.844501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.844504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.844509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.844511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.844513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.844515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.844517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.844519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.844521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.844523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.844525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.844527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.844528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.844532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.844535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.844539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.844542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.844544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.844547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.844549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.844552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.844554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.844557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.844559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.844562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.844564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.844570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.844572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.844575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.844577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.844580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.844582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.844586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.844588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.844591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.844596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.844598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.844617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.848424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843265148:10062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.848433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843265148:10062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.848435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843265148:10062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.848439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:02.852122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:02.853753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:02.853764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:02.853765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:02.853767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:02.853770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2614 [2:7556555591767693104:6537]
2025-10-02T09:35:02.853779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:02.853791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:02.853796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.853798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.853799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.853808Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:02.853812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:02.853817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:02.853851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.853856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.853857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.853859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:02.853860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:02.853900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:02.853905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.853911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.853916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.853928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:02.853941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.853946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.853947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.853952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:02.853960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843265186:10062], now have 1 active actors on pipe
2025-10-02T09:35:02.853965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:02.853968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:02.853968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:02.853970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:02.853975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:02.853976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:02.853980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843264984:2446], now have 1 active actors on pipe
2025-10-02T09:35:02.853995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.854003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:02.854011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:02.854009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2614
2025-10-02T09:35:02.854012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2614
2025-10-02T09:35:02.854042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.854047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.854065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:02.854071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:02.854074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:02.854075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:02.854080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:02.854088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:02.854098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.854214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.854220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.854229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:02.854294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2615 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0
2025-10-02T09:35:02.854569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a0cb3b-117086dc-16591885-df91d93b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:02.857364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Write session: try to update token
2025-10-02T09:35:02.857379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:02.863871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:02.863889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:02.863892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:02.863894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:02.863901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.863905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.863909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767693098:6537]
2025-10-02T09:35:02.863941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:02.863942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:02.863948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.863950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:02.863954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:02.863957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:02.864084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:02.870462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId: src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:02.872776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:02.931497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555591843265202:10189]
2025-10-02T09:35:02.931740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2614, pipe: [1:7556555591843265202:10189]
2025-10-02T09:35:02.979902Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:02.980210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:02.980219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:02.980245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843265202:10189], now have 1 active actors on pipe
2025-10-02T09:35:02.980452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:02.980463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:02.980469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555591843265202:10189]
2025-10-02T09:35:02.980483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:02.980508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2615 reason: error at write: Disconnected sessionId: src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0
2025-10-02T09:35:02.980638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2615 sessionId: src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0 is DEAD
2025-10-02T09:35:02.980790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:02.980814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Write session will restart in 0.009324s
2025-10-02T09:35:02.980831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Write session: Do CDS request
2025-10-02T09:35:02.980835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:02.980865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:02.990433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:02.991064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.991224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:02.991233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2616
2025-10-02T09:35:02.991320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:02.991340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:02.991347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:02.991349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:02.991608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2616 sessionId:  describe result for acl check
2025-10-02T09:35:02.991631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:02.991635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:02.991636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:02.991639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555591843265371:10055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:02.991972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555591843265371:10055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:02.992128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:02.992239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:02.992246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:02.992252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:02.992280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:02.992305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555591767693306:6532]
2025-10-02T09:35:02.992935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:02.993113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:02.993137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:02.993229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555591843265371:10055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:02.993410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:02.993439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.993443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.993443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.993444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.993445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.993445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.993446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.993447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.993447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.993448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.993448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.993449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.993452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.993458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.993460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.993462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.993465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.993467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.993469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.993471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.993473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.993475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.993477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.993479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.993483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.993487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:02.993490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.993493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:02.993496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.993498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:02.993501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.993504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:02.993507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.993509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:02.993512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.993515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:02.993518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.993520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:02.993524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.993527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:02.993534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.993537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:02.993539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.993543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:02.993546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.993552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:02.993555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.993557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:02.993577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:02.997354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555591843265371:10055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:02.997362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555591843265371:10055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:02.997365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555591843265371:10055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:02.997368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.000972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.002453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.002463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.002464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.002466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.002470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2615 [2:7556555591767693306:6532]
2025-10-02T09:35:03.002476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.002487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.002492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.002493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.002495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.002512Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.002519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.002523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.002555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.002560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.002561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.002562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.002564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.002603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.002608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.002615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.002620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.002631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.002646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843265206:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.002651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555591843265410:10055], now have 1 active actors on pipe
2025-10-02T09:35:03.002655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.002656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.002657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.002666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.002688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2615
2025-10-02T09:35:03.002678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.002690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2615
2025-10-02T09:35:03.002686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.002689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.002691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.002691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.002693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.002706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.002708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.002719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.002724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.002726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.002773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.002781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.002783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.002784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.002789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.002794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.002809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.002920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.002927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.002937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.003008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2616 partition: 0 MaxSeqNo: 36 sessionId: src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0
2025-10-02T09:35:03.003232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d9f2fe5-6880c2bd-8e113052-23301a24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.005838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Write session: try to update token
2025-10-02T09:35:03.005854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.011919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.011933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.011935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.011937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.011942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.011947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.011950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555591767693300:6532]
2025-10-02T09:35:03.011978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.011985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.011986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.011987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.011991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.011994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.012104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.019012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId: src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.021329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.080472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138232714:10189]
2025-10-02T09:35:03.080662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2615, pipe: [1:7556555596138232714:10189]
2025-10-02T09:35:03.123701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:03.123905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.123913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.123925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138232714:10189], now have 1 active actors on pipe
2025-10-02T09:35:03.124170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138232714:10189]
2025-10-02T09:35:03.124191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:03.124193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:03.124195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:03.124235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2616 reason: error at write: Disconnected sessionId: src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0
2025-10-02T09:35:03.124379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2616 sessionId: src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0 is DEAD
2025-10-02T09:35:03.124545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:03.124561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Write session will restart in 0.005337s
2025-10-02T09:35:03.124583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Write session: Do CDS request
2025-10-02T09:35:03.124589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:03.124661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:03.131145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.131266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:03.131276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2617
2025-10-02T09:35:03.131381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.131401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:03.131407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:03.131409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:03.131715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2617 sessionId:  describe result for acl check
2025-10-02T09:35:03.131741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:03.131745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:03.131747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:03.131750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555596138232772:10048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:03.132131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555596138232772:10048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:03.133904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555596138232772:10048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:03.135176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:03.136686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:03.136794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:03.136810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:03.136816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:03.136813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555596138232772:10048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:03.136822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555596138232772:10048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:03.136824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555596138232772:10048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:03.136828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.136844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:03.136878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555596062660820:6524]
2025-10-02T09:35:03.137220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:03.137425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:03.137448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:03.137625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:03.137655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.137659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.137660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.137661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.137661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.137662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.137662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.137663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.137664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.137664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.137665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.137666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.137668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.137674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.137676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.137678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.137680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.137682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.137684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.137686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.137688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.137690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.137692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.137693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.137697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.137701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.137704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.137707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.137709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.137712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.137714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.137717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.137721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.137724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.137730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.137732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.137735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.137737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.137739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.137742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.137745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.137748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.137751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.137754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.137757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.137763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.137765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.137767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.137785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:03.145230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.146941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.146952Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.146953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.146955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.146958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2616 [2:7556555596062660820:6524]
2025-10-02T09:35:03.146965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.146975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.146980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.146981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.146982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.146992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.146995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.146999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.147031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.147036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.147037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.147039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.147040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.147076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.147081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.147088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.147095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.147104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.147117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.147122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.147123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.147128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.147136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138232916:10048], now have 1 active actors on pipe
2025-10-02T09:35:03.147142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138232715:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.147141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.147144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.147146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.147146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.147154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.147155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.147169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.147178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.147182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2616
2025-10-02T09:35:03.147190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.147183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2616
2025-10-02T09:35:03.147220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.147225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.147241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.147248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.147250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.147251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.147256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.147263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.147270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.147391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.147398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.147408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.147473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2617 partition: 0 MaxSeqNo: 36 sessionId: src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0
2025-10-02T09:35:03.147688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30b6c14-985d75b2-d321fdbb-a944dd3e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.150276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Write session: try to update token
2025-10-02T09:35:03.150291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.156090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:03.156103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.156109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.156135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:03.156145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:03.156309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:03.156437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.156559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.156688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.156878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:03.156907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:03.162793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId: src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.164620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.164632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.164633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.164634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.164638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.164640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.164644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555596062660814:6524]
2025-10-02T09:35:03.164664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.164671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.164671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.164672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.164674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.164677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.164776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.165058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.224353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138232940:10189]
2025-10-02T09:35:03.224611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2616, pipe: [1:7556555596138232940:10189]
2025-10-02T09:35:03.274226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:03.274462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.274470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.274483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138232940:10189], now have 1 active actors on pipe
2025-10-02T09:35:03.274706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:03.274716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:03.274721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:03.274752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138232940:10189]
2025-10-02T09:35:03.274754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2617 reason: error at write: Disconnected sessionId: src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0
2025-10-02T09:35:03.274875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2617 sessionId: src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0 is DEAD
2025-10-02T09:35:03.275037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:03.275052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Write session will restart in 0.009527s
2025-10-02T09:35:03.275074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Write session: Do CDS request
2025-10-02T09:35:03.275084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:03.275110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:03.285081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.285176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:03.285187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2618
2025-10-02T09:35:03.285297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.285316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:03.285322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:03.285324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:03.285491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:03.285535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2618 sessionId:  describe result for acl check
2025-10-02T09:35:03.285556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:03.285561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:03.285562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:03.285565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555596138233120:10031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:03.285831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555596138233120:10031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:03.287157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:03.287313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555596138233120:10031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:03.287357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:03.287365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:03.287372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:03.287410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:03.287435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555596062661037:6519]
2025-10-02T09:35:03.287771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:03.287953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:03.287978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:03.288160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:03.288190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.288194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.288195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.288195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.288196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.288196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.288197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.288198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.288198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.288199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.288199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.288200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.288203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.288208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.288211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.288213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.288215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.288217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.288219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.288221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.288224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.288226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.288228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.288230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.288234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.288238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.288241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.288244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.288247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.288250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.288252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.288256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.288258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.288261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.288263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.288266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.288272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.288274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.288277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.288283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.288285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.288287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.288290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.288292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.288295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.288297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.288300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.288308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.288337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:03.292313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555596138233120:10031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:03.292322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555596138233120:10031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:03.292323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555596138233120:10031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:03.292327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.296138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.297697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.297709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.297710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.297712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.297715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2617 [2:7556555596062661037:6519]
2025-10-02T09:35:03.297723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.297732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.297737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.297738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.297739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.297753Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.297759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.297763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.297795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.297800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.297801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.297803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.297804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.297844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.297849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.297854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.297860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.297871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.297883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.297887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.297888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.297893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.297901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.297905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.297908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.297910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.297912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.297913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.297919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233161:10031], now have 1 active actors on pipe
2025-10-02T09:35:03.297921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138232941:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.297935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.297944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.297955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.297945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2617
2025-10-02T09:35:03.297964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2617
2025-10-02T09:35:03.297982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.297988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.298003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.298010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.298012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.298016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.298021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.298026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.298037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.298146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.298151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.298158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.298215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2618 partition: 0 MaxSeqNo: 36 sessionId: src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0
2025-10-02T09:35:03.298425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47cdbdf6-b2d3ccd6-c07e3c35-e4bccbde_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.301052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Write session: try to update token
2025-10-02T09:35:03.301067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.307470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:03.307492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.307500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.307538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:03.307541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:03.307794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:03.307990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.308176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.308344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.308674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:03.308712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:03.314976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId: src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.316248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.316260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.316262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.316262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.316266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.316268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.316270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555596062661031:6519]
2025-10-02T09:35:03.316292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.316296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.316297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.316303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.316307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.316311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.316400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.317382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.374874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138233179:10189]
2025-10-02T09:35:03.375088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2617, pipe: [1:7556555596138233179:10189]
2025-10-02T09:35:03.425941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:03.426197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.426206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.426219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233179:10189], now have 1 active actors on pipe
2025-10-02T09:35:03.426403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:03.426425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138233179:10189]
2025-10-02T09:35:03.426446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:03.426448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:03.426510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2618 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0
2025-10-02T09:35:03.426655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2618 sessionId: src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0 is DEAD
2025-10-02T09:35:03.427196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:03.427206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Write session will restart in 0.006517s
2025-10-02T09:35:03.427220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Write session: Do CDS request
2025-10-02T09:35:03.427225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:03.435103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.435214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:03.435221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2619
2025-10-02T09:35:03.435330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.435350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:03.435356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:03.435359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:03.435631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2619 sessionId:  describe result for acl check
2025-10-02T09:35:03.435652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:03.435656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:03.435657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:03.435660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555596138233316:10018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:03.436005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555596138233316:10018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:03.437331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555596138233316:10018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:03.438670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:03.438969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:03.439071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:03.439078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:03.439084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:03.439110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:03.439134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555596062661268:6505]
2025-10-02T09:35:03.439183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555596138233316:10018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:03.439191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555596138233316:10018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:03.439194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555596138233316:10018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:03.439197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.439567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:03.439764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:03.439786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:03.439958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:03.439988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.439992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.439992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.439993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.439993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.439994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.439995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.439995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.439996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.439996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.439997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.439998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.440001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.440007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.440009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.440011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.440013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.440015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.440017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.440019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.440021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.440023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.440025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.440027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.440030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.440034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.440038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.440041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.440043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.440045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.440047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.440050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.440054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.440056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.440059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.440062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.440064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.440067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.440069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.440071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.440074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.440077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.440079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.440081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.440083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.440086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.440088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.440091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.440108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:03.447550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.449065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.449075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.449076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.449078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.449081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2618 [2:7556555596062661268:6505]
2025-10-02T09:35:03.449090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.449100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.449106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.449107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.449108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.449117Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.449120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.449124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.449156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.449160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.449161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.449163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.449165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.449201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.449205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.449211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.449216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.449226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.449238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.449242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.449243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.449248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.449256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233383:10018], now have 1 active actors on pipe
2025-10-02T09:35:03.449261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233180:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.449262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.449265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.449266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.449266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.449274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.449279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.449292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.449301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.449300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2618
2025-10-02T09:35:03.449306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2618
2025-10-02T09:35:03.449317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.449345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.449351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.449365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.449372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.449374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.449375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.449380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.449386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.449393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.449510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.449518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.449527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.449602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2619 partition: 0 MaxSeqNo: 36 sessionId: src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0
2025-10-02T09:35:03.449839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc83f3a-a5f571c9-c0bfaebd-b53165fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.452457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Write session: try to update token
2025-10-02T09:35:03.452472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.458413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.458426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.458427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.458429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.458434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.458437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.458440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555596062661263:6505]
2025-10-02T09:35:03.458467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.458474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.458475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.458476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.458479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.458482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.458609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.464986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId: src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.467189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.526443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138233395:10189]
2025-10-02T09:35:03.526676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2618, pipe: [1:7556555596138233395:10189]
2025-10-02T09:35:03.571295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:03.571665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.571674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.571686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233395:10189], now have 1 active actors on pipe
2025-10-02T09:35:03.571855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:03.571895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:03.571928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138233395:10189]
2025-10-02T09:35:03.571939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:03.571993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2619 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0
2025-10-02T09:35:03.572132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2619 sessionId: src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0 is DEAD
2025-10-02T09:35:03.572301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:03.572317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Write session will restart in 0.009403s
2025-10-02T09:35:03.572348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Write session: Do CDS request
2025-10-02T09:35:03.572354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:03.582352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:03.583135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.583238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:03.583249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2620
2025-10-02T09:35:03.583360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.583380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:03.583386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:03.583388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:03.583648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2620 sessionId:  describe result for acl check
2025-10-02T09:35:03.583672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:03.583677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:03.583678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:03.583681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555596138233565:10015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:03.583969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:03.584031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555596138233565:10015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:03.584081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:03.584088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:03.584094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:03.584123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:03.584148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555596062661475:6499]
2025-10-02T09:35:03.584487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:03.584672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:03.584694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:03.584875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:03.584906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.584910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.584911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.584911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.584912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.584912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.584913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.584913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.584914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.584914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.584915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.584915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.584919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.584925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.584927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.584929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.584931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.584933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.584935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.584937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.584939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.584941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.584943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.584945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.584948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.584952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.584955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.584959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.584961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.584964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.584966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.584969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.584972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.584974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.584977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.584982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.584984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.584987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.584992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.584995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.584997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.585001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.585006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.585008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.585011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.585015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.585022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.585026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.585059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:03.585643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555596138233565:10015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:03.589759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555596138233565:10015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:03.589768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555596138233565:10015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:03.589771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555596138233565:10015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:03.589774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.592433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.594043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.594054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.594055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.594056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.594060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2619 [2:7556555596062661475:6499]
2025-10-02T09:35:03.594069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.594079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.594084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.594085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.594087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.594096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.594099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.594103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.594133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.594138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.594139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.594141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.594142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.594180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.594185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.594191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.594196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.594208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.594220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.594224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.594225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.594230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.594238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.594242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.594245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.594246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.594249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.594250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.594256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233604:10015], now have 1 active actors on pipe
2025-10-02T09:35:03.594262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233396:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.594275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.594284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.594290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2619
2025-10-02T09:35:03.594291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2619
2025-10-02T09:35:03.594297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.594334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.594339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.594352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|805649ee-56da5f28-d20ff1a7-b627e026_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.594359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.594361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.594362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.594367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.594375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.594382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.594506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.594513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.594522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.594597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2620 partition: 0 MaxSeqNo: 36 sessionId: src_id|805649ee-56da5f28-d20ff1a7-b627e026_0
2025-10-02T09:35:03.594820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eaf1c42-2cff2592-a387a959-aa96bd96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|805649ee-56da5f28-d20ff1a7-b627e026_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.597407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Write session: try to update token
2025-10-02T09:35:03.597422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.603178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:03.603192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.603197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.603224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:03.603234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:03.603492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:03.603627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.603759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.603891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:03.604062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:03.604089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:03.610054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId: src_id|805649ee-56da5f28-d20ff1a7-b627e026_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.611756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.611768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.611769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.611770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.611775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.611777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.611781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555596062661469:6499]
2025-10-02T09:35:03.611803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.611809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.611808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.611810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.611811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.611814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.611932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.612309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.671853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138233611:10189]
2025-10-02T09:35:03.672010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2619, pipe: [1:7556555596138233611:10189]
2025-10-02T09:35:03.722696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:03.722961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.722969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.722981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233611:10189], now have 1 active actors on pipe
2025-10-02T09:35:03.723185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138233611:10189]
2025-10-02T09:35:03.723196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:03.723206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:03.723210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:03.723208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:03.723251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2620 reason: error at write: Disconnected sessionId: src_id|805649ee-56da5f28-d20ff1a7-b627e026_0
2025-10-02T09:35:03.723403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2620 sessionId: src_id|805649ee-56da5f28-d20ff1a7-b627e026_0 is DEAD
2025-10-02T09:35:03.723551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:03.723568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Write session will restart in 0.008065s
2025-10-02T09:35:03.723591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Write session: Do CDS request
2025-10-02T09:35:03.723596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:03.733152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.733235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:03.733243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2621
2025-10-02T09:35:03.733347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.733370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:03.733372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:03.733375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:03.733530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:03.733639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2621 sessionId:  describe result for acl check
2025-10-02T09:35:03.733665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:03.733670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:03.733671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:03.733675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555596138233782:10007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:03.734034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555596138233782:10007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:03.735156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555596138233782:10007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:03.735326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:03.735491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:03.735498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:03.735505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:03.735539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:03.735563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555596062661683:6497]
2025-10-02T09:35:03.735903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:03.736101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:03.736123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:03.736296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:03.736329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.736332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.736333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.736333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.736334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.736335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.736335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.736336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.736336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.736337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.736337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.736338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.736340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.736346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.736348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.736350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.736352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.736354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.736356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.736358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.736360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.736362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.736364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.736366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.736370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.736374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.736377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.736380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.736383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.736385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.736387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.736390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.736393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.736395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.736397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.736400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.736402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.736405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.736407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.736409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.736415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.736418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.736420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.736423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.736425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.736428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.736431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.736434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.736450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:03.736693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555596138233782:10007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:03.736701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555596138233782:10007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:03.736703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555596138233782:10007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:03.736706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.743885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.745330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.745342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.745343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.745346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.745350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2620 [2:7556555596062661683:6497]
2025-10-02T09:35:03.745358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.745368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.745374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.745375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.745376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.745386Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.745392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.745396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.745431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.745436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.745437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.745439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.745440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.745486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.745492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.745498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.745503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.745515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.745531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233822:10007], now have 1 active actors on pipe
2025-10-02T09:35:03.745538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.745540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.745541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.745548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.745554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233613:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.745558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.745568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.745568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.745572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.745574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.745574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.745592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.745597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.745577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2620
2025-10-02T09:35:03.745580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2620
2025-10-02T09:35:03.745606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.745613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.745615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.745633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.745641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.745643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.745648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.745652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.745658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.745670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.745779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.745783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.745791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.745858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2621 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0
2025-10-02T09:35:03.746123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805649ee-56da5f28-d20ff1a7-b627e026_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.748767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Write session: try to update token
2025-10-02T09:35:03.748785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.754861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.754875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.754876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.754878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.754883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.754887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.754890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555596062661677:6497]
2025-10-02T09:35:03.754916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.754918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.754923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.754926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.754926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.754928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.755092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.762198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId: src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.764467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.823386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138233829:10189]
2025-10-02T09:35:03.823595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2620, pipe: [1:7556555596138233829:10189]
2025-10-02T09:35:03.866508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:03.866803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.866813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.866825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233829:10189], now have 1 active actors on pipe
2025-10-02T09:35:03.866990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:03.866994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138233829:10189]
2025-10-02T09:35:03.867008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:03.867014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:03.867016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:03.867055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2621 reason: error at write: Disconnected sessionId: src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0
2025-10-02T09:35:03.867189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2621 sessionId: src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0 is DEAD
2025-10-02T09:35:03.867398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:03.867418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Write session will restart in 0.007205s
2025-10-02T09:35:03.867443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Write session: Do CDS request
2025-10-02T09:35:03.867449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:03.875175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.875259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:03.875266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2622
2025-10-02T09:35:03.875359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:03.875380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:03.875385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:03.875387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:03.875681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2622 sessionId:  describe result for acl check
2025-10-02T09:35:03.875709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:03.875714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:03.875715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:03.875718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555596138233968:10000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:03.876060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555596138233968:10000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:03.877116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:03.877513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555596138233968:10000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:03.878851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:03.878960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:03.878968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:03.878975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:03.879003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:03.879028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555596062661892:6492]
2025-10-02T09:35:03.879079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555596138233968:10000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:03.879089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555596138233968:10000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:03.879090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555596138233968:10000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:03.879094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:03.879366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:03.879549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:03.879576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:03.879752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:03.879781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.879785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.879785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.879786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.879786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.879787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.879788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.879788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.879789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.879789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.879790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.879790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.879793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.879799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.879801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.879804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.879806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.879808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.879810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.879812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.879813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.879816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.879818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.879820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.879823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.879827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:03.879831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.879833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:03.879836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.879839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:03.879840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.879843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:03.879846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.879848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:03.879850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.879853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:03.879859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.879862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:03.879864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.879867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:03.879870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.879872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:03.879878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.879881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.879883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.879887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.879892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.879894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.879912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:03.887296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:03.888867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:03.888875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:03.888876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:03.888878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:03.888881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2621 [2:7556555596062661892:6492]
2025-10-02T09:35:03.888888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:03.888898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:03.888899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.888901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.888901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.888910Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:03.888915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:03.888919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:03.888953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.888959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.888960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.888961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:03.888963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:03.889009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:03.889013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.889020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:03.889025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:03.889035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:03.889049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138233831:2446], now have 1 active actors on pipe
2025-10-02T09:35:03.889055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138234040:10000], now have 1 active actors on pipe
2025-10-02T09:35:03.889059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.889060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.889062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.889070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:03.889081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:03.889086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:03.889089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:03.889091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:03.889092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:03.889093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:03.889107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.889113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:03.889100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2621
2025-10-02T09:35:03.889102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2621
2025-10-02T09:35:03.889121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:03.889236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.889242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.889255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:03.889262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:03.889265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:03.889266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:03.889272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:03.889279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:03.889287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.889415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:03.889422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:03.889431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:03.889493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2622 partition: 0 MaxSeqNo: 36 sessionId: src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0
2025-10-02T09:35:03.889726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fce01b8-2083c85a-dd007f86-d54fce54_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:03.892348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Write session: try to update token
2025-10-02T09:35:03.892362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:03.898511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:03.898526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:03.898528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:03.898529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:03.898535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.898539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.898542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555596062661886:6492]
2025-10-02T09:35:03.898569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:03.898579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:03.898584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:03.898586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:03.898591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:03.898594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:03.898707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:03.904892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId: src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:03.907107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:03.967258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555596138234058:10189]
2025-10-02T09:35:03.967470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2621, pipe: [1:7556555596138234058:10189]
2025-10-02T09:35:04.009784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.010007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.010016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.010029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555596138234058:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.010190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.010226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.010252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555596138234058:10189]
2025-10-02T09:35:04.010256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:04.010339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2622 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0
2025-10-02T09:35:04.010457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2622 sessionId: src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0 is DEAD
2025-10-02T09:35:04.010561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:04.010571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Write session will restart in 0.007496s
2025-10-02T09:35:04.010587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Write session: Do CDS request
2025-10-02T09:35:04.010591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.019212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.019311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.019319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2623
2025-10-02T09:35:04.019422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.019441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.019448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.019450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.019721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2623 sessionId:  describe result for acl check
2025-10-02T09:35:04.019748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.019752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.019754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.019757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433201495:9996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.020106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433201495:9996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.021171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.021443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433201495:9996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.022802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.022903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.022909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.022915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.022941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.022965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357629398:6479]
2025-10-02T09:35:04.023326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.023391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433201495:9996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.023399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433201495:9996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.023401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433201495:9996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.023405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.023519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.023544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.023721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.023751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.023755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.023755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.023756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.023756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.023757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.023758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.023758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.023759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.023759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.023760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.023760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.023763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.023769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.023771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.023773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.023775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.023777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.023779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.023781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.023783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.023785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.023787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.023789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.023793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.023797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.023800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.023803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.023805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.023808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.023810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.023813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.023815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.023818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.023821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.023824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.023826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.023829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.023831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.023834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.023836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.023839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.023842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.023845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.023848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.023850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.023854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.023858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.023876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.031380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.033033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.033042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.033044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.033046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.033049Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2622 [2:7556555600357629398:6479]
2025-10-02T09:35:04.033059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.033068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.033074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.033075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.033076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.033085Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.033091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.033095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.033126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.033131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.033132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.033134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.033135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.033174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.033178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.033184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.033190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.033201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.033214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.033218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.033219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.033225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.033237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201355:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.033240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.033244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.033245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.033246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.033252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.033254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.033257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201565:9996], now have 1 active actors on pipe
2025-10-02T09:35:04.033272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.033282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.033279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2622
2025-10-02T09:35:04.033292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2622
2025-10-02T09:35:04.033308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.033332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.033340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.033355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.033358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.033360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.033361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.033367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.033372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.033379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.033502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.033508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.033518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.033587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2623 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0
2025-10-02T09:35:04.033867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ca3efd-5043a9f2-7e7aa03e-7824842e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.036538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Write session: try to update token
2025-10-02T09:35:04.036558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.042231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:04.042244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.042249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.042277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:04.042284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:04.042436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:04.042574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:04.042705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:04.042833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:04.043005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:04.043039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:04.049629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId: src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.050840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.050851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.050852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.050853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.050857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.050859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.050862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357629392:6479]
2025-10-02T09:35:04.050883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.050886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.050887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.050897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.050914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.050918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.050993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.052117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.110626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433201574:10189]
2025-10-02T09:35:04.110830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2622, pipe: [1:7556555600433201574:10189]
2025-10-02T09:35:04.161632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.161963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.161973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.161986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201574:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.162157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.162158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.162176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433201574:10189]
2025-10-02T09:35:04.162190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:04.162195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:04.162266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2623 reason: error at write: Disconnected sessionId: src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0
2025-10-02T09:35:04.162425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2623 sessionId: src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0 is DEAD
2025-10-02T09:35:04.162627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:04.162642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Write session will restart in 0.009273s
2025-10-02T09:35:04.162670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Write session: Do CDS request
2025-10-02T09:35:04.162678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.172532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.173195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.173293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.173302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2624
2025-10-02T09:35:04.173419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.173437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.173440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.173446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.173685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2624 sessionId:  describe result for acl check
2025-10-02T09:35:04.173702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.173706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.173707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.173710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433201761:9988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.174010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433201761:9988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.174102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.174204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.174211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.174217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.174243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.174267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357629623:6490]
2025-10-02T09:35:04.174615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.174829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.174854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.175046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.175080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.175084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.175085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.175085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.175086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.175087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.175087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.175088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.175088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.175089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.175089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.175090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.175093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.175098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.175100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.175102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.175104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.175106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.175108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.175110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.175112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.175115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.175117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.175119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.175122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.175126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.175129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.175132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.175134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.175138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.175140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.175143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.175145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.175148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.175150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.175152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.175155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.175157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.175159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.175162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.175164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.175167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.175169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.175172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.175174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.175177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.175179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.175182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.175199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.175445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433201761:9988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.179944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433201761:9988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.179952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433201761:9988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.179953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433201761:9988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.179957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.182621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.184231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.184241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.184242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.184244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.184247Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2623 [2:7556555600357629623:6490]
2025-10-02T09:35:04.184254Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.184264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.184269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.184270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.184271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.184280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.184283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.184289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.184338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.184343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.184344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.184345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.184347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.184386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.184390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.184397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.184402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.184410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.184424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201799:9988], now have 1 active actors on pipe
2025-10-02T09:35:04.184430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201587:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.184433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.184435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.184436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.184446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.184456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.184465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.184467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.184470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.184470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.184471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.184484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.184489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.184481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2623
2025-10-02T09:35:04.184483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2623
2025-10-02T09:35:04.184506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.184514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.184516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.184532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.184539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.184541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.184543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.184547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.184556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.184565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.184667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.184672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.184679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.184742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2624 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0
2025-10-02T09:35:04.184967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0caa431-d605492e-3ba8f9d2-c62914d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.187568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Write session: try to update token
2025-10-02T09:35:04.187582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.193592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.193605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.193607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.193608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.193613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.193616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.193620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357629617:6490]
2025-10-02T09:35:04.193648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.193656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.193656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.193658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.193660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.193663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.193778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.200190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId: src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.202422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.262177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433201807:10189]
2025-10-02T09:35:04.262390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2623, pipe: [1:7556555600433201807:10189]
2025-10-02T09:35:04.305286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.305492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.305500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.305512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201807:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.305669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.305661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433201807:10189]
2025-10-02T09:35:04.305680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.305682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:04.305684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:04.305727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2624 reason: error at write: Disconnected sessionId: src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0
2025-10-02T09:35:04.305864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2624 sessionId: src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0 is DEAD
2025-10-02T09:35:04.305995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:04.306009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Write session will restart in 0.007054s
2025-10-02T09:35:04.306029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Write session: Do CDS request
2025-10-02T09:35:04.306034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.314131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.314243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.314252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2625
2025-10-02T09:35:04.314376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.314400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.314406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.314408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.314680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2625 sessionId:  describe result for acl check
2025-10-02T09:35:04.314702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.314708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.314709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.314712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433201943:9970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.315012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433201943:9970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.316348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433201943:9970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.316679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.318464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.318637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.318645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.318653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.318689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.318726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357629847:6485]
2025-10-02T09:35:04.318731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433201943:9970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.318741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433201943:9970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.318743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433201943:9970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.318746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.319071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.319260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.319284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.319511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.319546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.319550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.319550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.319551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.319552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.319552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.319553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.319553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.319554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.319554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.319555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.319556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.319559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.319565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.319567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.319569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.319571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.319573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.319575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.319577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.319580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.319582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.319584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.319586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.319590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.319594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.319598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.319601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.319603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.319608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.319610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.319613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.319620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.319626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.319628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.319631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.319633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.319637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.319639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.319642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.319644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.319650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.319652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.319654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.319660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.319663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.319665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.319667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.319687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.327484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.329203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.329213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.329214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.329216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.329220Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2624 [2:7556555600357629847:6485]
2025-10-02T09:35:04.329227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.329236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.329241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.329242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.329243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.329254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.329260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.329264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.329299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.329304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.329305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.329307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.329308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.329345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.329351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.329358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.329363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.329374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.329390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202031:9970], now have 1 active actors on pipe
2025-10-02T09:35:04.329395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433201810:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.329398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.329399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.329400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.329408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.329419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.329426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.329429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.329430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.329439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.329440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.329445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.329447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.329426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2624
2025-10-02T09:35:04.329447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2624
2025-10-02T09:35:04.329455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.329463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.329465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.329493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.329527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.329534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.329536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.329541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.329549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.329562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.329659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.329664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.329672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.329748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2625 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0
2025-10-02T09:35:04.330054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c30beba-21bf04f9-c3a71d4a-336e28e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.332666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Write session: try to update token
2025-10-02T09:35:04.332679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.339062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.339075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.339077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.339077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.339081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.339083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.339086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357629832:6485]
2025-10-02T09:35:04.339108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.339114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.339115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.339121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.339128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.339140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.339219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.344864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId: src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.347031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.406045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433202053:10189]
2025-10-02T09:35:04.406259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2624, pipe: [1:7556555600433202053:10189]
2025-10-02T09:35:04.449995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.450206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.450214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.450227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202053:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.450391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.450417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:04.450425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:04.450437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.450464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2625 reason: error at write: Disconnected sessionId: src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0
2025-10-02T09:35:04.450468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433202053:10189]
2025-10-02T09:35:04.450627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2625 sessionId: src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0 is DEAD
2025-10-02T09:35:04.450773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:04.450789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Write session will restart in 0.006870s
2025-10-02T09:35:04.450810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Write session: Do CDS request
2025-10-02T09:35:04.450816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.459172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.459268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.459276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2626
2025-10-02T09:35:04.459381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.459400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.459406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.459409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.460037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2626 sessionId:  describe result for acl check
2025-10-02T09:35:04.460064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.460068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.460069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.460072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433202226:9965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.460460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433202226:9965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.460713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.461790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433202226:9965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.462252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.462351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.462358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.462364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.462392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.462419Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357630083:6452]
2025-10-02T09:35:04.462765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.462939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.462965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.463140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.463169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.463172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.463173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.463174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.463174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.463175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.463175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.463176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.463176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.463177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.463177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.463178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.463180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.463186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.463188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.463190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.463192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.463194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.463196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.463198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.463200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.463202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.463204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.463206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.463210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.463214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.463217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.463220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.463222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.463225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.463227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.463230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.463233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.463236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.463238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.463242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.463245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.463248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.463250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.463252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.463255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.463258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.463263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.463265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.463267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.463270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.463272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.463277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.463294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.463925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433202226:9965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.463934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433202226:9965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.463936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433202226:9965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.463939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.470742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.472269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.472280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.472281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.472283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.472286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2625 [2:7556555600357630083:6452]
2025-10-02T09:35:04.472294Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.472307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.472312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.472313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.472314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.472323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.472326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.472330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.472361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.472366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.472367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.472370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.472371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.472433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.472438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.472444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.472450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.472461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.472475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202267:9965], now have 1 active actors on pipe
2025-10-02T09:35:04.472480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202054:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.472484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.472489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.472490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.472499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.472492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2625
2025-10-02T09:35:04.472497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2625
2025-10-02T09:35:04.472509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.472513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.472516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.472518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.472520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.472521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.472543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.472548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.472557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.472566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.472579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.472587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.472591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.472593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.472594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.472599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.472605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.472617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.472728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.472733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.472741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.472809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2626 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0
2025-10-02T09:35:04.473049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e8dea19-83bb15d3-1cac5422-1b17d9e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.476097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Write session: try to update token
2025-10-02T09:35:04.476114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.481665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.481679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.481680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.481682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.481687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.481690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.481693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357630078:6452]
2025-10-02T09:35:04.481719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.481727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.481727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.481728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.481730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.481734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.481881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.488457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId: src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.490594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.550437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433202275:10189]
2025-10-02T09:35:04.550694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2625, pipe: [1:7556555600433202275:10189]
2025-10-02T09:35:04.596086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.596306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.596314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.596327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202275:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.596487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.596522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.596528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433202275:10189]
2025-10-02T09:35:04.596546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:04.596599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0
2025-10-02T09:35:04.596739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2626 sessionId: src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0 is DEAD
2025-10-02T09:35:04.596916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:04.596925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Write session will restart in 0.009421s
2025-10-02T09:35:04.596945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Write session: Do CDS request
2025-10-02T09:35:04.596949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.607253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.607350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.607360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2627
2025-10-02T09:35:04.607445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.607474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.607495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.607503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.607506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.607773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2627 sessionId:  describe result for acl check
2025-10-02T09:35:04.607798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.607804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.607805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.607808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433202452:9955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.608156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433202452:9955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.609224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.609323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.609330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.609335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.609361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.609385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357630296:6462]
2025-10-02T09:35:04.609726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.609736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433202452:9955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.609916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.609940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.610115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.610144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.610152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.610152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.610153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.610153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.610154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.610154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.610155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.610156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.610156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.610157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.610157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.610160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.610166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.610168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.610170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.610172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.610174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.610176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.610178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.610180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.610184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.610185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.610187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.610191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.610195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.610198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.610201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.610203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.610206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.610208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.610211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.610213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.610216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.610219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.610221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.610224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.610227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.610229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.610231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.610234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.610236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.610238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.610241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.610244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.610247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.610249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.610252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.610270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.614019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433202452:9955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.614027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433202452:9955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.614029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433202452:9955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.614033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.617692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.619223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.619234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.619236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.619238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.619241Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2626 [2:7556555600357630296:6462]
2025-10-02T09:35:04.619249Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.619260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.619264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.619265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.619266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.619275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.619279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.619284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.619316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.619321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.619322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.619324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.619325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.619364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.619369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.619375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.619380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.619390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.619404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.619409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.619410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.619416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.619424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202276:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.619429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202491:9955], now have 1 active actors on pipe
2025-10-02T09:35:04.619431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.619434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.619434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.619436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.619442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.619443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.619458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.619467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.619466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2626
2025-10-02T09:35:04.619481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.619468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2626
2025-10-02T09:35:04.619518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.619523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.619537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.619544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.619546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.619547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.619552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.619559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.619568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.619677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.619681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.619690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.619750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2627 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0
2025-10-02T09:35:04.620016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc08a2a6-adb4611c-593a3acb-e0b9df74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.622616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Write session: try to update token
2025-10-02T09:35:04.622633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.628882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.628897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.628899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.628900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.628908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.628911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.628914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357630290:6462]
2025-10-02T09:35:04.628945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.628948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.628953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.628956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.628955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.628958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.629093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.635972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId: src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.638290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.696861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433202499:10189]
2025-10-02T09:35:04.697078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2626, pipe: [1:7556555600433202499:10189]
2025-10-02T09:35:04.744896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.745184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.745193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.745205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202499:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.745376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.745417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.745444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433202499:10189]
2025-10-02T09:35:04.745445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:04.745490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2627 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0
2025-10-02T09:35:04.745634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2627 sessionId: src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0 is DEAD
2025-10-02T09:35:04.745785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:04.745802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Write session will restart in 0.006195s
2025-10-02T09:35:04.745823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Write session: Do CDS request
2025-10-02T09:35:04.745829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.753186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.753286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.753294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2628
2025-10-02T09:35:04.753397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.753417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.753427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.753434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.753692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2628 sessionId:  describe result for acl check
2025-10-02T09:35:04.753714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.753718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.753720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.753722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433202596:9945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.754053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433202596:9945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.755872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433202596:9945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.756483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.757972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.758074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.758081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.758087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.758114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.758130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433202596:9945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.758138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433202596:9945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.758140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433202596:9945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.758143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.758139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357630510:6460]
2025-10-02T09:35:04.758476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.758671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.758694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.758882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.758912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.758916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.758917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.758917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.758918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.758919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.758919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.758920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.758921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.758921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.758922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.758922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.758925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.758931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.758933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.758935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.758938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.758940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.758942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.758944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.758946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.758948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.758950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.758952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.758956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.758961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.758964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.758967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.758969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.758972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.758974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.758977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.758980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.758982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.758984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.758987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.758989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.758992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.758993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.758996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.758998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.759001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.759004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.759007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.759009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.759012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.759014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.759016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.759037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.766610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.768174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.768184Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.768185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.768187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.768190Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2627 [2:7556555600357630510:6460]
2025-10-02T09:35:04.768197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.768207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.768208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.768209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.768210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.768219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.768222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.768226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.768255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.768261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.768262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.768263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.768265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.768302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.768307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.768313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.768319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.768328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.768342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202500:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.768349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.768351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.768353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.768365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.768372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202712:9945], now have 1 active actors on pipe
2025-10-02T09:35:04.768377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.768387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.768387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.768390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.768391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.768393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.768406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.768415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.768408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2627
2025-10-02T09:35:04.768410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2627
2025-10-02T09:35:04.768424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.768440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.768442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.768455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.768462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.768464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.768466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.768471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.768477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.768486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.768586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.768592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.768599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.768663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2628 partition: 0 MaxSeqNo: 36 sessionId: src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0
2025-10-02T09:35:04.769129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b7f9083-b3d2282e-9155a990-717f27d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.771726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Write session: try to update token
2025-10-02T09:35:04.771739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.777584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.777597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.777599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.777600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.777605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.777609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.777612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357630504:6460]
2025-10-02T09:35:04.777639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.777644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.777647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.777647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.777649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.777650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.777787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.785085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId: src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.787381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.845344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433202723:10189]
2025-10-02T09:35:04.845555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2627, pipe: [1:7556555600433202723:10189]
2025-10-02T09:35:04.890164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:04.890507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.890517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.890529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202723:10189], now have 1 active actors on pipe
2025-10-02T09:35:04.890671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:04.890730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433202723:10189]
2025-10-02T09:35:04.890730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:04.890734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:04.890756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:04.890778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2628 reason: error at write: Disconnected sessionId: src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0
2025-10-02T09:35:04.890910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2628 sessionId: src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0 is DEAD
2025-10-02T09:35:04.891067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:04.891075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Write session will restart in 0.005610s
2025-10-02T09:35:04.891093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Write session: Do CDS request
2025-10-02T09:35:04.891098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:04.898099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.898171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:04.898179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2629
2025-10-02T09:35:04.898244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:04.898263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:04.898266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:04.898268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:04.898542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2629 sessionId:  describe result for acl check
2025-10-02T09:35:04.898568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:04.898574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:04.898575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:04.898580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555600433202821:9947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:04.898926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555600433202821:9947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:04.900746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555600433202821:9947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:04.901313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:04.902980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:04.903082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:04.903089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:04.903095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:04.903120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:04.903143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555600357630725:6458]
2025-10-02T09:35:04.903160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555600433202821:9947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:04.903169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555600433202821:9947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:04.903172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555600433202821:9947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:04.903175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:04.903482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:04.903676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:04.903699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:04.903872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:04.903901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.903905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.903906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.903907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.903907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.903908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.903908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.903909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.903909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.903910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.903910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.903911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.903914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.903919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.903922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.903924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.903926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.903928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.903929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.903931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.903933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.903936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.903937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.903939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.903943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.903947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:04.903950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.903953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:04.903955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.903958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:04.903960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.903963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:04.903966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.903968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:04.903970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.903973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:04.903975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.903978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:04.903980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.903983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:04.903985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.903992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:04.903994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.903997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.903999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.904002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.904006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.904009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.904028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:04.911426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:04.912867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:04.912877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:04.912879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:04.912881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:04.912884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2628 [2:7556555600357630725:6458]
2025-10-02T09:35:04.913030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:04.913043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:04.913045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.913047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.913047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.913057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:04.913063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:04.913067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:04.913099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.913103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.913105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.913107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:04.913108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:04.913173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:04.913179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.913186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:04.913191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:04.913203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:04.913217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202728:2446], now have 1 active actors on pipe
2025-10-02T09:35:04.913223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202942:9947], now have 1 active actors on pipe
2025-10-02T09:35:04.913226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.913228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.913230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.913239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:04.913250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:04.913252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:04.913239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2628
2025-10-02T09:35:04.913254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:04.913255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:04.913260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:04.913240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2628
2025-10-02T09:35:04.913262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:04.913280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.913288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:04.913297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.913302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.913303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:04.913325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:04.913332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:04.913335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:04.913336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:04.913341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:04.913348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:04.913359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.913462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:04.913467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:04.913474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:04.913533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2629 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0
2025-10-02T09:35:04.913705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533c3c4f-3a095ff8-cc8cc7fb-59a39b5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:04.916322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Write session: try to update token
2025-10-02T09:35:04.916331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:04.922619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:04.922634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:04.922636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:04.922638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:04.922644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.922647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.922651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555600357630719:6458]
2025-10-02T09:35:04.922681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:04.922685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:04.922688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:04.922691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:04.922692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:04.922693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:04.922815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:04.928059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId: src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:04.930378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:04.990750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555600433202957:10189]
2025-10-02T09:35:04.990936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2628, pipe: [1:7556555600433202957:10189]
2025-10-02T09:35:05.034982Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.035340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.035349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.035361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555600433202957:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.035544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.035549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.035573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555600433202957:10189]
2025-10-02T09:35:05.035581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:05.035640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2629 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0
2025-10-02T09:35:05.035774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2629 sessionId: src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0 is DEAD
2025-10-02T09:35:05.035892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:05.035901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Write session will restart in 0.009837s
2025-10-02T09:35:05.035916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Write session: Do CDS request
2025-10-02T09:35:05.035922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.046115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.047145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.047318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.047326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2630
2025-10-02T09:35:05.047414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.047432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.047437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.047439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.047700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2630 sessionId:  describe result for acl check
2025-10-02T09:35:05.047726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.047730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.047731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.047734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728170435:9934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.047729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.047873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.047880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.047886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.047916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.047943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652598237:6456]
2025-10-02T09:35:05.048068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728170435:9934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.048282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.048472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.048497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.048668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.048699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.048702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.048703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.048704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.048704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.048705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.048705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.048706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.048706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.048707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.048707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.048708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.048711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.048717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.048719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.048721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.048723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.048725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.048727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.048729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.048731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.048733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.048735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.048737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.048740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.048744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.048749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.048751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.048754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.048757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.048759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.048762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.048764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.048766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.048769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.048771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.048774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.048777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.048779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.048781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.048783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.048786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.048788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.048792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.048794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.048797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.048810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.048813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.048830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.049484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728170435:9934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.053518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728170435:9934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.053527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728170435:9934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.053530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728170435:9934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.053533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.056264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.057817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.057827Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.057828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.057830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.057833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2629 [2:7556555604652598237:6456]
2025-10-02T09:35:05.057840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.057849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.057850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.057852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.057853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.057862Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.057868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.057872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.057901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.057906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.057907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.057908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.057910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.057947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.057952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.057958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.057963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.057971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.057982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.057986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.057987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.057993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.058004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170473:9934], now have 1 active actors on pipe
2025-10-02T09:35:05.058006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.058009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.058010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.058011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.058018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.058019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.058022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170255:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.058035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.058045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.058048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2629
2025-10-02T09:35:05.058049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2629
2025-10-02T09:35:05.058060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.058128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.058133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.058146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.058150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.058152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.058153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.058158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.058167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.058174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.058274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.058281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.058291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.058352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2630 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0
2025-10-02T09:35:05.058552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae449e2-9d4b1d3b-b316fc50-f3015272_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.061359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Write session: try to update token
2025-10-02T09:35:05.061373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.067092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:05.067106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.067111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.067141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:05.067147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:05.067292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:05.067424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.067581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.067730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.067906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:05.067936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:05.073871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId: src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.075644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.075656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.075657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.075661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.075666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.075667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.075669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652598231:6456]
2025-10-02T09:35:05.075692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.075698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.075699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.075700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.075705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.075708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.075809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.075993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:05.135656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555604728170480:10189]
2025-10-02T09:35:05.135935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2629, pipe: [1:7556555604728170480:10189]
2025-10-02T09:35:05.185000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.185345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.185354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.185366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170480:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.185527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:05.185531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555604728170480:10189]
2025-10-02T09:35:05.185539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:05.185545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.185570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.185581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2630 reason: error at write: Disconnected sessionId: src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0
2025-10-02T09:35:05.185715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2630 sessionId: src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0 is DEAD
2025-10-02T09:35:05.185845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:05.185854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Write session will restart in 0.006489s
2025-10-02T09:35:05.185872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Write session: Do CDS request
2025-10-02T09:35:05.185877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.193060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.193128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.193135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2631
2025-10-02T09:35:05.193206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.193225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.193231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.193233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.193559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2631 sessionId:  describe result for acl check
2025-10-02T09:35:05.193585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.193589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.193590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.193593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728170586:9931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.193920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728170586:9931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.195606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728170586:9931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.196435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.197908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.198030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.198037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.198042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.198069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.198097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652598468:6451]
2025-10-02T09:35:05.198101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728170586:9931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.198109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728170586:9931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.198111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728170586:9931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.198115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.198432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.198627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.198651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.198826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.198854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.198858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.198859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.198859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.198860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.198860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.198861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.198861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.198862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.198862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.198863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.198864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.198867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.198873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.198875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.198877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.198879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.198881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.198883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.198885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.198887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.198889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.198891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.198893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.198896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.198900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.198904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.198907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.198910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.198913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.198915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.198918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.198921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.198923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.198925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.198928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.198931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.198933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.198936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.198938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.198940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.198943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.198945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.198948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.198950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.198953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.198955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.198958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.198977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.206354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.207974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.207984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.207985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.207987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.207990Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2630 [2:7556555604652598468:6451]
2025-10-02T09:35:05.207997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.208008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.208011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.208013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.208014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.208023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.208030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.208034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.208064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.208069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.208070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.208072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.208073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.208111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.208115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.208122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.208127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.208137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.208151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170708:9931], now have 1 active actors on pipe
2025-10-02T09:35:05.208156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170493:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.208160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.208161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.208162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.208171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.208181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.208178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2630
2025-10-02T09:35:05.208186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.208189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.208191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.208200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.208201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.208208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.208210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.208213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.208220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.208210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2630
2025-10-02T09:35:05.208222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.208256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.208262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.208265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.208266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.208272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.208277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.208290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.208414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.208419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.208425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.208503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2631 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0
2025-10-02T09:35:05.208728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd88beca-8ccbea33-5ca9bc95-3f1c867f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.211362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Write session: try to update token
2025-10-02T09:35:05.211374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.217536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.217552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.217554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.217555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.217562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.217566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.217569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652598462:6451]
2025-10-02T09:35:05.217600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.217603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.217606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.217608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.217609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.217611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.217743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.223351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId: src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.225507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:05.285656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555604728170720:10189]
2025-10-02T09:35:05.285873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2630, pipe: [1:7556555604728170720:10189]
2025-10-02T09:35:05.329827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.330189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.330199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.330211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170720:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.330360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.330396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:05.330407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:05.330407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555604728170720:10189]
2025-10-02T09:35:05.330423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.330448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2631 reason: error at write: Disconnected sessionId: src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0
2025-10-02T09:35:05.330582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2631 sessionId: src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0 is DEAD
2025-10-02T09:35:05.330699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:05.330704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Write session will restart in 0.009850s
2025-10-02T09:35:05.330719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Write session: Do CDS request
2025-10-02T09:35:05.330723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.341133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.341272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.341290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2632
2025-10-02T09:35:05.341426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.341451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.341457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.341465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.341734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2632 sessionId:  describe result for acl check
2025-10-02T09:35:05.341766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.341767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.341768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.341772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728170923:9903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.342290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.342421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728170923:9903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.343672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.343791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.343798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.343804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.343833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.343856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652598686:6445]
2025-10-02T09:35:05.344009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728170923:9903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.344205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.344419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.344451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.344667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.344704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.344708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.344709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.344709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.344710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.344710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.344711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.344711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.344712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.344712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.344713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.344714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.344716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.344723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.344725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.344727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.344729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.344731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.344732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.344734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.344736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.344738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.344740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.344742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.344746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.344752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.344755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.344758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.344760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.344763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.344765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.344768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.344770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.344773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.344775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.344778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.344780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.344783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.344785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.344789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.344793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.344797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.344815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.344823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.344828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.344834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.344840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.344843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.344859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.345025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728170923:9903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.345037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728170923:9903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.345039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728170923:9903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.345044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.352264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.353788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.353798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.353800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.353801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.353805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2631 [2:7556555604652598686:6445]
2025-10-02T09:35:05.353813Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.353823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.353826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.353828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.353829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.353838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.353844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.353849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.353985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.353990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.353991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.353993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.353994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.354046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.354051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.354057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.354062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.354070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.354085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170975:9903], now have 1 active actors on pipe
2025-10-02T09:35:05.354093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.354094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.354095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.354105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.354114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170723:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.354120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.354124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.354127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.354129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.354136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.354138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.354142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.354143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.354145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.354142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2631
2025-10-02T09:35:05.354165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2631
2025-10-02T09:35:05.354180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.354185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.354202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.354210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.354212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.354213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.354218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.354228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.354237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.354250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T09:35:05.354262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-02T09:35:05.354321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.354325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.354362Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 72307382 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T09:35:05.354381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.354462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2632 partition: 0 MaxSeqNo: 36 sessionId: src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0
2025-10-02T09:35:05.354675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 20 DataSize: 72307382 UsedReserveSize: 0
2025-10-02T09:35:05.354702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T09:35:05.354739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcefe35c-6686d14-b75f18e3-b3b67dff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.357461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Write session: try to update token
2025-10-02T09:35:05.357473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.363299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:05.363314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.363318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.363343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:05.363348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:05.363484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:05.363627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.363739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.363856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.364046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:05.364073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:05.370214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId: src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.372359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:05.372379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.372393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.372397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.372398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.372402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.372404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.372405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652598680:6445]
2025-10-02T09:35:05.372424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.372430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.372431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.372453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.372473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.372476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.372536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.430566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555604728170997:10189]
2025-10-02T09:35:05.430800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2631, pipe: [1:7556555604728170997:10189]
2025-10-02T09:35:05.481560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.481768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.481782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.481795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728170997:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.481939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.481971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555604728170997:10189]
2025-10-02T09:35:05.482037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:05.482042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:05.482082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2632 reason: error at write: Disconnected sessionId: src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0
2025-10-02T09:35:05.482088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.482210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2632 sessionId: src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0 is DEAD
2025-10-02T09:35:05.482385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:05.482398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Write session will restart in 0.007507s
2025-10-02T09:35:05.482426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Write session: Do CDS request
2025-10-02T09:35:05.482433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.491163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.491522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.491532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2633
2025-10-02T09:35:05.491643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.491664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.491671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.491674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.492056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2633 sessionId:  describe result for acl check
2025-10-02T09:35:05.492092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.492098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.492100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.492104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728171181:9894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.492439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.492511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728171181:9894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.494014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728171181:9894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.494170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.494280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.494287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.494292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.494318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.494342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652598945:6423]
2025-10-02T09:35:05.494692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.494884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.494907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.495077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.495107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.495111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.495111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.495112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.495112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.495113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.495114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.495114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.495115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.495115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.495116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.495116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.495119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.495125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.495127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.495129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.495131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.495133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.495135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.495137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.495139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.495141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.495143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.495145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.495148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.495152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.495156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.495158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.495161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.495164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.495166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.495168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.495171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.495174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.495176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.495178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.495181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.495184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.495185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.495188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.495190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.495193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.495197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.495199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.495201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.495208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.495210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.495212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.495231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.499080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728171181:9894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.499094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728171181:9894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.499096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728171181:9894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.499101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.502634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.504214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.504225Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.504226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.504228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.504231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2632 [2:7556555604652598945:6423]
2025-10-02T09:35:05.504238Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.504248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.504249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.504251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.504252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.504261Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.504264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.504268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.504299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.504304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.504305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.504307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.504309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.504345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.504350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.504355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.504360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.504369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.504384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171220:9894], now have 1 active actors on pipe
2025-10-02T09:35:05.504391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.504393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.504394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.504401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.504409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171001:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.504414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.504414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.504417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.504418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.504424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.504426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.504428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2632
2025-10-02T09:35:05.504440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.504432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2632
2025-10-02T09:35:05.504445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.504457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.504460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.504462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.504636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.504647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.504651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.504653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.504659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.504670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.504695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.504823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.504829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.504839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.504906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2633 partition: 0 MaxSeqNo: 36 sessionId: src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0
2025-10-02T09:35:05.505102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11117aa8-d12a44fa-86d81fbd-1043af2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.507857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Write session: try to update token
2025-10-02T09:35:05.507871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.513913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.513930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.513931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.513933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.513939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.513942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.513945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652598940:6423]
2025-10-02T09:35:05.513975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.513981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.513983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.513985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.513985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.513988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.514105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.520780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId: src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.522860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:05.582133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555604728171229:10189]
2025-10-02T09:35:05.582343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2632, pipe: [1:7556555604728171229:10189]
2025-10-02T09:35:05.625317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.625749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.625764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.625776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171229:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.625948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.625982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:05.625987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:05.626024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555604728171229:10189]
2025-10-02T09:35:05.626030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2633 reason: error at write: Disconnected sessionId: src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0
2025-10-02T09:35:05.626163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2633 sessionId: src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0 is DEAD
2025-10-02T09:35:05.626274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:05.626286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Write session will restart in 0.008612s
2025-10-02T09:35:05.626276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.626306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Write session: Do CDS request
2025-10-02T09:35:05.626312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.636173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.636248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.636257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2634
2025-10-02T09:35:05.636328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.636347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.636353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.636356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.636698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2634 sessionId:  describe result for acl check
2025-10-02T09:35:05.636734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.636740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.636742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.636746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728171412:9883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.636943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.637180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728171412:9883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.638552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.638663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.638671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.638676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.638705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.638731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652599166:6425]
2025-10-02T09:35:05.638955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728171412:9883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.639080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.639268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.639294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.639485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.639519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.639522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.639523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.639524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.639524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.639525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.639525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.639526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.639527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.639527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.639528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.639528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.639531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.639537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.639539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.639541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.639543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.639545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.639547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.639549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.639551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.639553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.639555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.639557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.639562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.639565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.639568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.639571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.639573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.639576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.639578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.639581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.639583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.639586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.639588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.639591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.639593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.639596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.639598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.639601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.639603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.639606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.639609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.639611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.639614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.639616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.639618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.639621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.639639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.643490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728171412:9883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.643502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728171412:9883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.643506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728171412:9883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.643510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.647053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.648581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.648592Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.648593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.648595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.648598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2633 [2:7556555604652599166:6425]
2025-10-02T09:35:05.648605Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.648615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.648618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.648620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.648621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.648630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.648632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.648637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.648666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.648672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.648673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.648675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.648676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.648714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.648719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.648726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.648731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.648739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.648753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.648757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.648758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.648763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.648771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171230:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.648774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.648777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171452:9883], now have 1 active actors on pipe
2025-10-02T09:35:05.648777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.648779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.648781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.648788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.648790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.648817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.648827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.648837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.648839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2633
2025-10-02T09:35:05.648859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2633
2025-10-02T09:35:05.648921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.648927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.648941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.648948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.648951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.648952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.648957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.648965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.648974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.649085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.649092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.649102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.649163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2634 partition: 0 MaxSeqNo: 36 sessionId: src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0
2025-10-02T09:35:05.649383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88fbf643-46f0b6dd-5a80d646-61aacd93_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.652217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Write session: try to update token
2025-10-02T09:35:05.652232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.658149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.658163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.658164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.658166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.658172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.658176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.658179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652599159:6425]
2025-10-02T09:35:05.658206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.658211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.658213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.658215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.658215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.658218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.658336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.664860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId: src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.667112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:05.725986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555604728171460:10189]
2025-10-02T09:35:05.726165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2633, pipe: [1:7556555604728171460:10189]
2025-10-02T09:35:05.772097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.772321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.772330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.772342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171460:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.772497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.772498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555604728171460:10189]
2025-10-02T09:35:05.772517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.772553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:05.772573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:05.772645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2634 reason: error at write: Disconnected sessionId: src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0
2025-10-02T09:35:05.772820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2634 sessionId: src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0 is DEAD
2025-10-02T09:35:05.772953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:05.772962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Write session will restart in 0.005655s
2025-10-02T09:35:05.772987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Write session: Do CDS request
2025-10-02T09:35:05.772992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.779217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.779297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.779305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2635
2025-10-02T09:35:05.779399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.779419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.779426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.779429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.779816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2635 sessionId:  describe result for acl check
2025-10-02T09:35:05.779849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.779856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.779858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.779862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728171516:9882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.780337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728171516:9882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.782195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728171516:9882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.784088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.785632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728171516:9882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.785643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728171516:9882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.785646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728171516:9882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.785650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.785665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.785774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.785781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.785787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.785813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.785838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652599387:6424]
2025-10-02T09:35:05.786182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.786368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.786390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.786579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.786610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.786614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.786614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.786615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.786616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.786616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.786617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.786617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.786618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.786618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.786619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.786619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.786622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.786628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.786631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.786633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.786635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.786637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.786639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.786640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.786642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.786645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.786646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.786648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.786653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.786657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.786660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.786663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.786666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.786670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.786672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.786675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.786677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.786680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.786682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.786684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.786687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.786689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.786691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.786694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.786696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.786699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.786701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.786703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.786705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.786708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.786710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.786714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.786731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.794218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.795926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.795937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.795938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.795940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.795944Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2634 [2:7556555604652599387:6424]
2025-10-02T09:35:05.795951Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.795961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.795962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.795963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.795965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.795974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.795981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.795985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.796017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.796022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.796023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.796025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.796026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.796065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.796070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.796076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.796081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.796089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.796101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.796103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.796104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.796109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.796118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.796121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.796125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.796127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.796127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.796129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.796136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171461:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.796138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171679:9882], now have 1 active actors on pipe
2025-10-02T09:35:05.796152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.796161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.796173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.796171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2634
2025-10-02T09:35:05.796200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2634
2025-10-02T09:35:05.796254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.796260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.796275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3f825b9-40be9986-90b6671e-5fcf022_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.796282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.796285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.796286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.796292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.796297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.796305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.796485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.796492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.796502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.796582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2635 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3f825b9-40be9986-90b6671e-5fcf022_0
2025-10-02T09:35:05.796812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc50fe8-2d530f7a-31a0d33c-4f48b5a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3f825b9-40be9986-90b6671e-5fcf022_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.799584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Write session: try to update token
2025-10-02T09:35:05.799595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.805259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:05.805273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.805281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.805314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:05.805327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:05.805465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:05.805599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.805728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.805857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:05.806037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:05.806069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:05.811936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId: src_id|f3f825b9-40be9986-90b6671e-5fcf022_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.813930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.813943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.813945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.813946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.813951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.813954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.813956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652599381:6424]
2025-10-02T09:35:05.813978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.813983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.813984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.814013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.814031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.814035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.814100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.814157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:05.872416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555604728171692:10189]
2025-10-02T09:35:05.872694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2634, pipe: [1:7556555604728171692:10189]
2025-10-02T09:35:05.924893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:05.925131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.925139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.925151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171692:10189], now have 1 active actors on pipe
2025-10-02T09:35:05.925351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:05.925369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:05.925362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:05.925365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555604728171692:10189]
2025-10-02T09:35:05.925378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:05.925407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2635 reason: error at write: Disconnected sessionId: src_id|f3f825b9-40be9986-90b6671e-5fcf022_0
2025-10-02T09:35:05.925538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2635 sessionId: src_id|f3f825b9-40be9986-90b6671e-5fcf022_0 is DEAD
2025-10-02T09:35:05.925665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:05.925684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Write session will restart in 0.005329s
2025-10-02T09:35:05.925699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Write session: Do CDS request
2025-10-02T09:35:05.925703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:05.932158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.932220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:05.932228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2636
2025-10-02T09:35:05.932398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:05.932418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:05.932424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:05.932426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:05.932687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2636 sessionId:  describe result for acl check
2025-10-02T09:35:05.932712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:05.932717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:05.932718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:05.932721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555604728171754:9874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:05.933101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555604728171754:9874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:05.934954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555604728171754:9874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:05.936536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555604728171754:9874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:05.936544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555604728171754:9874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:05.936546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555604728171754:9874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:05.936549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:05.939174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:05.939571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:05.939667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:05.939674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:05.939680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:05.939706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:05.939731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555604652599611:6414]
2025-10-02T09:35:05.940066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:05.940255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:05.940277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:05.940450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:05.940479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.940483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.940483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.940484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.940485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.940485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.940487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.940488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.940488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.940489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.940489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.940490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.940492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.940498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.940501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.940503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.940505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.940507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.940509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.940511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.940513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.940516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.940518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.940520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.940523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.940527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:05.940531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.940534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:05.940536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.940538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:05.940542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.940544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:05.940549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.940551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:05.940553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.940556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:05.940558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.940561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:05.940563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.940567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:05.940571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.940574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:05.940580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.940582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.940585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.940587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.940590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.940592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.940608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:05.948205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:05.949696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:05.949707Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:05.949708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:05.949711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:05.949714Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2635 [2:7556555604652599611:6414]
2025-10-02T09:35:05.949722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:05.949731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:05.949737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.949738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.949740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.949749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:05.949751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:05.949757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:05.949788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.949792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.949793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.949795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:05.949796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:05.949924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:05.949929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.949935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:05.949941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:05.949951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:05.949946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2635
2025-10-02T09:35:05.949948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2635
2025-10-02T09:35:05.949965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171917:9874], now have 1 active actors on pipe
2025-10-02T09:35:05.949971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555604728171698:2446], now have 1 active actors on pipe
2025-10-02T09:35:05.949975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.949976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.949977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.949983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:05.949993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:05.950003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:05.950004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:05.950008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:05.950008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:05.950013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:05.950020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.950026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.950045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.950054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:05.950062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:05.950065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:05.950069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:05.950071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:05.950072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:05.950078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:05.950083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:05.950107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.950213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:05.950218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:05.950226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:05.950296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2636 partition: 0 MaxSeqNo: 36 sessionId: src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0
2025-10-02T09:35:05.950535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3f825b9-40be9986-90b6671e-5fcf022_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:05.953025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Write session: try to update token
2025-10-02T09:35:05.953035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:05.959442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:05.959458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:05.959460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:05.959462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:05.959468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.959471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.959475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555604652599606:6414]
2025-10-02T09:35:05.959505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:05.959510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:05.959512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:05.959519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:05.959523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:05.959527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:05.959642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:05.964536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId: src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:05.966716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.025502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023139232:10189]
2025-10-02T09:35:06.025775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2635, pipe: [1:7556555609023139232:10189]
2025-10-02T09:35:06.072081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.072272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.072280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.072305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139232:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.072487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:06.072495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.072507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:06.072510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:06.072537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023139232:10189]
2025-10-02T09:35:06.072558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2636 reason: error at write: Disconnected sessionId: src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0
2025-10-02T09:35:06.072690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2636 sessionId: src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0 is DEAD
2025-10-02T09:35:06.072835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:06.072844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Write session will restart in 0.008271s
2025-10-02T09:35:06.072858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Write session: Do CDS request
2025-10-02T09:35:06.072862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.082154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.082240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.082250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2637
2025-10-02T09:35:06.082341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.082361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.082367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.082369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.082679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2637 sessionId:  describe result for acl check
2025-10-02T09:35:06.082700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.082704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.082706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.082709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023139403:9869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.083067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023139403:9869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.083912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.084131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023139403:9869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.085440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.085545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.085551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.085558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.085588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.085613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947567144:6409]
2025-10-02T09:35:06.085718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023139403:9869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.085727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023139403:9869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.085729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023139403:9869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.085732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.085967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.086155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.086178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.086357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.086474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.086479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.086480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.086480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.086481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.086482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.086482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.086483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.086483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.086484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.086484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.086485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.086488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.086501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.086503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.086505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.086508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.086510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.086512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.086514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.086516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.086519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.086521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.086522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.086527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.086530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.086534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.086537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.086539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.086542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.086544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.086546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.086549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.086551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.086553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.086556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.086559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.086562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.086564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.086567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.086570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.086573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.086575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.086581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.086585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.086587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.086590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.086592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.086614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:06.094012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:06.095595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:06.095606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:06.095607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:06.095609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:06.095612Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2636 [2:7556555608947567144:6409]
2025-10-02T09:35:06.095678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:06.095690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:06.095692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.095693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.095694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.095703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:06.095709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:06.095713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:06.095743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.095747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.095748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.095751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:06.095752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:06.095790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:06.095794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.095800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.095806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.095813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:06.095828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139233:2446], now have 1 active actors on pipe
2025-10-02T09:35:06.095833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139455:9869], now have 1 active actors on pipe
2025-10-02T09:35:06.095837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.095838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.095839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.095848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:06.095859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:06.095869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:06.095869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:06.095872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:06.095873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:06.095874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:06.095887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.095895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:06.095886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2636
2025-10-02T09:35:06.095886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2636
2025-10-02T09:35:06.095911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:06.095915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.095917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.095932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e542486-29e21116-1edf4a18-9670a78c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:06.095939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.095941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.095942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:06.095947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.095955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:06.095965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.096072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.096077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.096088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.096152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2637 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e542486-29e21116-1edf4a18-9670a78c_0
2025-10-02T09:35:06.096364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcba1c78-3b938ecc-184a3c9b-1c284ef4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e542486-29e21116-1edf4a18-9670a78c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:06.098840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Write session: try to update token
2025-10-02T09:35:06.098851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:06.105094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:06.105107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.105109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:06.105110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:06.105115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.105119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.105122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947567138:6409]
2025-10-02T09:35:06.105150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:06.105155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.105155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:06.105156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:06.105158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:06.105161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:06.105305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:06.111875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId: src_id|6e542486-29e21116-1edf4a18-9670a78c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:06.114102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.172446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023139479:10189]
2025-10-02T09:35:06.172622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2636, pipe: [1:7556555609023139479:10189]
2025-10-02T09:35:06.217255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.217481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.217489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.217501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139479:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.217671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:06.217681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.217697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023139479:10189]
2025-10-02T09:35:06.217717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:06.217770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e542486-29e21116-1edf4a18-9670a78c_0
2025-10-02T09:35:06.217903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2637 sessionId: src_id|6e542486-29e21116-1edf4a18-9670a78c_0 is DEAD
2025-10-02T09:35:06.218029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:06.218039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Write session will restart in 0.006204s
2025-10-02T09:35:06.218056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Write session: Do CDS request
2025-10-02T09:35:06.218060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.225206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.225289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.225298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2638
2025-10-02T09:35:06.225389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.225409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.225416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.225418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.225711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2638 sessionId:  describe result for acl check
2025-10-02T09:35:06.225735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.225740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.225741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.225744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023139565:9854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.226093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023139565:9854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.227842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023139565:9854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.228852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.230581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.230694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023139565:9854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.230702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023139565:9854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.230704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023139565:9854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.230707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.230720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.230727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.230734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.230765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.230789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947567369:6397]
2025-10-02T09:35:06.231126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.231311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.231335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.231515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.231545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.231549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.231550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.231551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.231552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.231552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.231553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.231553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.231554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.231554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.231555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.231555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.231558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.231565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.231567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.231569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.231571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.231573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.231575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.231577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.231579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.231581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.231583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.231585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.231590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.231593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.231596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.231600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.231602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.231604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.231606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.231609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.231611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.231614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.231616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.231619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.231621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.231623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.231625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.231628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.231634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.231636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.231638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.231641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.231647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.231650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.231652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.231655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.231676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:06.239146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:06.240761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:06.240770Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:06.240772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:06.240774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:06.240777Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2637 [2:7556555608947567369:6397]
2025-10-02T09:35:06.240784Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:06.240793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:06.240795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.240797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.240798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.240818Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:06.240822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:06.240826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:06.240854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.240859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.240860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.240862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:06.240863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:06.240904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:06.240909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.240915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.240920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.240930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:06.240944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.240948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.240950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.240955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:06.240962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:06.240971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:06.240973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:06.240974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:06.240981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139702:9854], now have 1 active actors on pipe
2025-10-02T09:35:06.240984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139480:2446], now have 1 active actors on pipe
2025-10-02T09:35:06.240986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:06.240988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:06.240996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.240998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:06.241002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:06.241011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2637
2025-10-02T09:35:06.241014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2637
2025-10-02T09:35:06.241084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.241090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.241104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:06.241111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.241113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.241115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:06.241120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.241128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:06.241135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.241273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.241279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.241289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.241354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2638 partition: 0 MaxSeqNo: 36 sessionId: src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0
2025-10-02T09:35:06.241577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e542486-29e21116-1edf4a18-9670a78c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:06.244182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Write session: try to update token
2025-10-02T09:35:06.244191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:06.249950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:06.249964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.249970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.250001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:06.250007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:06.250160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:06.250293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.250425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.250564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.250731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:06.250761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:06.255633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId: src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:06.257706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.258643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.258657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.258668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:06.258670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.258671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:06.258673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:06.258678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.258680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.258682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947567363:6397]
2025-10-02T09:35:06.258709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:06.258716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.258717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:06.258718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:06.258724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:06.258728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:06.258856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:06.317848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023139716:10189]
2025-10-02T09:35:06.318038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2637, pipe: [1:7556555609023139716:10189]
2025-10-02T09:35:06.367486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.367679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:06.367703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139716:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.367799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:06.367850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.367881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:06.367886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023139716:10189]
2025-10-02T09:35:06.367888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:06.367937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2638 reason: error at write: Disconnected sessionId: src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0
2025-10-02T09:35:06.368079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2638 sessionId: src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0 is DEAD
2025-10-02T09:35:06.368171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:06.368180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Write session will restart in 0.006110s
2025-10-02T09:35:06.368194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Write session: Do CDS request
2025-10-02T09:35:06.368198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.375194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.375281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.375289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2639
2025-10-02T09:35:06.375406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.375426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.375432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.375434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.375724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2639 sessionId:  describe result for acl check
2025-10-02T09:35:06.375748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.375753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.375754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.375757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023139803:9845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.376110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023139803:9845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.377796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023139803:9845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.378972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.380536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.380633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.380640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.380646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.380673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.380696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947567598:6390]
2025-10-02T09:35:06.380720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023139803:9845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.380728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023139803:9845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.380732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023139803:9845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.380736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.381047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.381231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.381253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.381434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.381463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.381467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.381467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.381468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.381468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.381469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.381469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.381470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.381470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.381471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.381471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.381472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.381475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.381481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.381483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.381485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.381487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.381489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.381491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.381493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.381495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.381497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.381499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.381501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.381504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.381508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.381511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.381514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.381516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.381519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.381521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.381524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.381527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.381530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.381532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.381534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.381536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.381539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.381541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.381543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.381546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.381548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.381550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.381553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.381555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.381557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.381559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.381562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.381579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:06.389121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:06.390720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:06.390731Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:06.390732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:06.390734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:06.390737Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2638 [2:7556555608947567598:6390]
2025-10-02T09:35:06.390745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:06.390755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:06.390758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.390760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.390760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.390770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:06.390776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:06.390781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:06.390813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.390818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.390819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.390821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:06.390822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:06.390861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:06.390866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.390872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.390877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.390885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:06.390899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.390904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.390904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.390909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:06.390918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139717:2446], now have 1 active actors on pipe
2025-10-02T09:35:06.390921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:06.390924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139940:9845], now have 1 active actors on pipe
2025-10-02T09:35:06.390925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:06.390926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:06.390929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:06.390937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:06.390942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:06.390933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2638
2025-10-02T09:35:06.390954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2638
2025-10-02T09:35:06.390958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.390963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:06.390966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:06.390983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.390988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.391005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:06.391012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.391014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.391015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:06.391021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.391029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:06.391043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.391269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.391276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.391287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.391360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2639 partition: 0 MaxSeqNo: 36 sessionId: src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0
2025-10-02T09:35:06.391610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a1f03c-ac2f7dc6-793b61dd-dc210cb9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:06.394224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Write session: try to update token
2025-10-02T09:35:06.394234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:06.404767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:06.404783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.404790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.404832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:06.404840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:06.404992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:06.405125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.405288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.405419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.405599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:06.405631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:06.406124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId: src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:06.408164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.408297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.408307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.409160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:06.409184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:06.409187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.409188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:06.409190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:06.409194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.409197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.409199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947567592:6390]
2025-10-02T09:35:06.409208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:06.409212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:06.409215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:06.409218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.409219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:06.409224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:06.409236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:06.409334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:06.467876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023139974:10189]
2025-10-02T09:35:06.468103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2638, pipe: [1:7556555609023139974:10189]
2025-10-02T09:35:06.520859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.527051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.527070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.527199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.527253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.527309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.527362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.527399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.527405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.527471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.527530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.527591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.527655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.527701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.527706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.527758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.527808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.527864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.527914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.527952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.527957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.528008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.528059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.528105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.528160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.528196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.528201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.528252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.528302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.528353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.528406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.528451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.528456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.528511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.528589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.528639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.528689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.528779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.528784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.528846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.528946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.529001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.529132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.529179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.529184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.529239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.529287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.529336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.529387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.529437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.529441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.529494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.529542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.529592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.529646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.529683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.529687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.529738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:06.529789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:06.529838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:06.529892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:06.529941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:06.529946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:06.529977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139974:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.530174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.530185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023139974:10189]
2025-10-02T09:35:06.530207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:06.530209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:06.530234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2639 reason: error at write: Disconnected sessionId: src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0
2025-10-02T09:35:06.530358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2639 sessionId: src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0 is DEAD
2025-10-02T09:35:06.530543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:06.530559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Write session will restart in 0.005213s
2025-10-02T09:35:06.530582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Write session: Do CDS request
2025-10-02T09:35:06.530588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.530582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:06.537202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.537247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.537255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2640
2025-10-02T09:35:06.537435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.537457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.537461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.537464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.537710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2640 sessionId:  describe result for acl check
2025-10-02T09:35:06.537730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.537734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.537735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.537738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023140026:9833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.538091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023140026:9833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.540240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023140026:9833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.542087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023140026:9833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.542096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023140026:9833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.542098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023140026:9833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.542101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.542141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.543803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.543899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.543906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.543912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.543936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.543960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947567862:6372]
2025-10-02T09:35:06.544303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.544509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.544532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.544708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.544735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.544739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.544739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.544740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.544740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.544741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.544741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.544742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.544743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.544743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.544744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.544744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.544747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.544753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.544756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.544758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.544760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.544762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.544764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.544766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.544768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.544770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.544772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.544774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.544777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.544781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.544784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.544787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.544789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.544792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.544794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.544797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.544799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.544814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.544818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.544821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.544823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.544825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.544827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.544832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.544834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.544837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.544839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.544842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.544845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.544849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.544851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.544853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.544871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:06.552297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:06.553858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:06.553869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:06.553870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:06.553872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:06.553875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2639 [2:7556555608947567862:6372]
2025-10-02T09:35:06.553883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:06.553893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:06.553898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.553900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.553901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.553911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:06.553914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:06.553918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:06.553948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.553953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.553954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.553956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:06.553958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:06.553997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:06.554002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.554009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.554014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.554025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:06.554039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.554043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.554044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.554051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:06.554059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:06.554062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:06.554066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:06.554067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:06.554070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:06.554072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:06.554079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023139975:2446], now have 1 active actors on pipe
2025-10-02T09:35:06.554085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140198:9833], now have 1 active actors on pipe
2025-10-02T09:35:06.554099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.554107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:06.554127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:06.554112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2639
2025-10-02T09:35:06.554112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2639
2025-10-02T09:35:06.554169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.554175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.554191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d25b408-93972c11-bc2be482-d6fec33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:06.554198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.554200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.554201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:06.554206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.554215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:06.554222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.554358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.554364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.554375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.554445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2640 partition: 0 MaxSeqNo: 36 sessionId: src_id|7d25b408-93972c11-bc2be482-d6fec33_0
2025-10-02T09:35:06.554729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86653c4-8b6fd6ab-949052a6-a708d99a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7d25b408-93972c11-bc2be482-d6fec33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:06.557640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Write session: try to update token
2025-10-02T09:35:06.557656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:06.563700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:06.563717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.563719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:06.563721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:06.563727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.563731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.563735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947567856:6372]
2025-10-02T09:35:06.563767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:06.563772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:06.563775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:06.563776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.563778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:06.563779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:06.563903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:06.570229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId: src_id|7d25b408-93972c11-bc2be482-d6fec33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:06.572409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.630179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023140220:10189]
2025-10-02T09:35:06.630409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2639, pipe: [1:7556555609023140220:10189]
2025-10-02T09:35:06.678443Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.678861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.678877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.678892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140220:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.679111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023140220:10189]
2025-10-02T09:35:06.679117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.679137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:06.679139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:06.679182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2640 reason: error at write: Disconnected sessionId: src_id|7d25b408-93972c11-bc2be482-d6fec33_0
2025-10-02T09:35:06.679311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2640 sessionId: src_id|7d25b408-93972c11-bc2be482-d6fec33_0 is DEAD
2025-10-02T09:35:06.679397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:06.679475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:06.679492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Write session will restart in 0.009588s
2025-10-02T09:35:06.679515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Write session: Do CDS request
2025-10-02T09:35:06.679521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.690155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.690215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.690225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2641
2025-10-02T09:35:06.690230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.690304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.690324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.690331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.690333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.690608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2641 sessionId:  describe result for acl check
2025-10-02T09:35:06.690634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.690639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.690642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.690645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023140411:9813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.691087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023140411:9813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.691992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.692094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.692101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.692107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.692133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.692160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947568088:6370]
2025-10-02T09:35:06.692572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023140411:9813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.692766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.692970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.692994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.693267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.693299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.693303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.693303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.693304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.693305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.693305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.693306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.693306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.693307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.693307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.693308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.693309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.693311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.693317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.693319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.693321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.693324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.693326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.693328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.693330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.693332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.693334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.693337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.693339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.693342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.693346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.693350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.693353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.693356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.693358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.693360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.693363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.693365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.693368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.693370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.693373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.693375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.693378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.693380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.693383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.693385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.693387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.693389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.693392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.693394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.693397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.693399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.693402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.693419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:06.697222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023140411:9813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.697231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023140411:9813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.697233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023140411:9813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.697237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.700842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:06.702337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:06.702348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:06.702350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:06.702352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:06.702355Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2640 [2:7556555608947568088:6370]
2025-10-02T09:35:06.702362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:06.702372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:06.702373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.702375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.702376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.702385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:06.702392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:06.702396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:06.702426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.702430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.702431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.702433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:06.702434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:06.702472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:06.702477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.702484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.702489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.702507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:06.702521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140450:9813], now have 1 active actors on pipe
2025-10-02T09:35:06.702527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140221:2446], now have 1 active actors on pipe
2025-10-02T09:35:06.702530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.702531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.702532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.702541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:06.702549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:06.702557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:06.702560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:06.702561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:06.702565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:06.702566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:06.702574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.702579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:06.702571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2640
2025-10-02T09:35:06.702578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2640
2025-10-02T09:35:06.702587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:06.702597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.702599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.702616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:06.702623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.702625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.702626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:06.702631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.702637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:06.702645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.702745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.702751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.702760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.702821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2641 partition: 0 MaxSeqNo: 36 sessionId: src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0
2025-10-02T09:35:06.703034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d25b408-93972c11-bc2be482-d6fec33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:06.705746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Write session: try to update token
2025-10-02T09:35:06.705762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:06.711442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:06.711452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.711458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.711484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:06.711486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:06.711645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:06.711773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.711898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.712026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:06.712195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:06.712222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:06.719318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId: src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:06.720087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:06.720099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.720100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:06.720101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:06.720106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.720108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.720110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947568082:6370]
2025-10-02T09:35:06.720131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:06.720134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.720135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:06.720144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:06.720159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:06.720162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:06.720241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:06.721788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.779155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023140458:10189]
2025-10-02T09:35:06.779339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2640, pipe: [1:7556555609023140458:10189]
2025-10-02T09:35:06.829515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.829726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.829734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.829747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140458:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.829960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:06.829953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:06.829966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:06.829972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023140458:10189]
2025-10-02T09:35:06.829985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.830012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2641 reason: error at write: Disconnected sessionId: src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0
2025-10-02T09:35:06.830135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2641 sessionId: src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0 is DEAD
2025-10-02T09:35:06.830297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:06.830313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Write session will restart in 0.007984s
2025-10-02T09:35:06.830338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Write session: Do CDS request
2025-10-02T09:35:06.830344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.839142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.839289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.839298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2642
2025-10-02T09:35:06.839403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.839421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.839427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.839430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.839696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2642 sessionId:  describe result for acl check
2025-10-02T09:35:06.839722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.839729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.839731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.839734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023140599:9801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.840083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023140599:9801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.841456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023140599:9801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.841667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.843277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.843388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.843395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.843401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.843430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.843453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947568317:6368]
2025-10-02T09:35:06.843490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023140599:9801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.843498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023140599:9801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.843500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023140599:9801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.843504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.843799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.843991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.844014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.844195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.844224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.844228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.844229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.844229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.844230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.844231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.844231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.844232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.844232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.844233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.844233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.844234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.844237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.844243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.844245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.844247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.844249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.844251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.844253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.844255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.844258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.844261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.844263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.844265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.844268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.844272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.844275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.844278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.844281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.844283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.844287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.844290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.844292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.844295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.844297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.844300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.844302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.844305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.844307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.844310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.844312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.844315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.844322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.844325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.844327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.844330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.844332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.844334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.844355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:06.851980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:06.853523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:06.853535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:06.853536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:06.853538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:06.853542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2641 [2:7556555608947568317:6368]
2025-10-02T09:35:06.853552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:06.853565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:06.853570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.853572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.853573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.853582Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:06.853586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:06.853591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:06.853627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.853632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.853633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.853635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:06.853636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:06.853771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2641
2025-10-02T09:35:06.853776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2641
2025-10-02T09:35:06.853816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:06.853821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.853827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.853833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.853845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:06.853862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140685:9801], now have 1 active actors on pipe
2025-10-02T09:35:06.853867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140459:2446], now have 1 active actors on pipe
2025-10-02T09:35:06.853879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.853884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.853893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.853897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.853898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.853908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:06.853919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:06.853927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:06.853930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:06.853930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:06.853934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:06.853935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:06.853940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:06.853944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:06.853946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:06.853947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:06.853952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:06.853958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:06.853979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.853988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:06.853997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.853999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:06.854110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.854115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.854123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:06.854186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2642 partition: 0 MaxSeqNo: 36 sessionId: src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0
2025-10-02T09:35:06.854457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cbc7d1-3740aa2d-ab140c35-c364eb8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:06.857182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Write session: try to update token
2025-10-02T09:35:06.857197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:06.863298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:06.863313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:06.863315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:06.863316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:06.863322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.863325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.863328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947568311:6368]
2025-10-02T09:35:06.863361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:06.863369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.863371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:06.863397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:06.863416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:06.863421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:06.863492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:06.870111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId: src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:06.872353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:06.930206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555609023140702:10189]
2025-10-02T09:35:06.930432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2641, pipe: [1:7556555609023140702:10189]
2025-10-02T09:35:06.977526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:06.977731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:06.977739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:06.977751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140702:10189], now have 1 active actors on pipe
2025-10-02T09:35:06.977906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:06.977916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:06.977922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555609023140702:10189]
2025-10-02T09:35:06.977929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:06.977936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:06.977979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2642 reason: error at write: Disconnected sessionId: src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0
2025-10-02T09:35:06.978132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2642 sessionId: src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0 is DEAD
2025-10-02T09:35:06.978276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:06.978290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Write session will restart in 0.005977s
2025-10-02T09:35:06.978312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Write session: Do CDS request
2025-10-02T09:35:06.978318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:06.985136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.985206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:06.985218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2643
2025-10-02T09:35:06.985342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:06.985371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:06.985379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:06.985382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:06.985782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2643 sessionId:  describe result for acl check
2025-10-02T09:35:06.985811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:06.985817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:06.985819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:06.985823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555609023140778:9800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:06.986282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555609023140778:9800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:06.988229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555609023140778:9800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:06.990000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:06.991773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:06.991871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:06.991877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:06.991883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:06.991909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:06.991908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555609023140778:9800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:06.991933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555608947568547:6363]
2025-10-02T09:35:06.991919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555609023140778:9800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:06.991921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555609023140778:9800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:06.991924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:06.992281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:06.992474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:06.992496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:06.992671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:06.992701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.992705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.992705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.992706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.992706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.992707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.992707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.992708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.992708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.992709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.992710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.992710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.992713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.992719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.992721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.992724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.992726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.992727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.992729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.992731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.992734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.992736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.992738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.992740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.992743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.992749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:06.992752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.992755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:06.992757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.992759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:06.992762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.992764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:06.992767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.992769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:06.992771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.992774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:06.992776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.992779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:06.992781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.992784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:06.992786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.992789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:06.992791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.992794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:06.992796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.992810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:06.992813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.992815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:06.992835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.000350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.001802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.001815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.001816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.001818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.001822Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2642 [2:7556555608947568547:6363]
2025-10-02T09:35:07.001830Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.001840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.001843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.001845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.001846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.001855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.001858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.001862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.001891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.001898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.001899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.001901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.001902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.001943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.001948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.001955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.001960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.001970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.001985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140934:9800], now have 1 active actors on pipe
2025-10-02T09:35:07.001990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555609023140707:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.001994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.001996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.001997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.002005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.002015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.002024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.002024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.002028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.002028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.002029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.002022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2642
2025-10-02T09:35:07.002025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2642
2025-10-02T09:35:07.002042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.002048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.002057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.002069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.002072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.002088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.002095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.002097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.002098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.002103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.002112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.002119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.002234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.002240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.002250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.002326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2643 partition: 0 MaxSeqNo: 36 sessionId: src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0
2025-10-02T09:35:07.002572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 148 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-02T09:35:07.002603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b068318d-237ab3c3-d8184ecc-1d68b3a9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.005198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Write session: try to update token
2025-10-02T09:35:07.005212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.011186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.011199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.011200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.011202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.011206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.011210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.011213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555608947568542:6363]
2025-10-02T09:35:07.011238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.011246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.011248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.011250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.011255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.011261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.011364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.017473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId: src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.019630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.078190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318108241:10189]
2025-10-02T09:35:07.078385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2642, pipe: [1:7556555613318108241:10189]
2025-10-02T09:35:07.121231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.121702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.121712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.121724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108241:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.122153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:07.122166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:07.122168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318108241:10189]
2025-10-02T09:35:07.122184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.122215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2643 reason: error at write: Disconnected sessionId: src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0
2025-10-02T09:35:07.122342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.122383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2643 sessionId: src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0 is DEAD
2025-10-02T09:35:07.122554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:07.122569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Write session will restart in 0.008535s
2025-10-02T09:35:07.122597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Write session: Do CDS request
2025-10-02T09:35:07.122603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.132180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.132313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.132324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2644
2025-10-02T09:35:07.132453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.132475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.132481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.132484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.132778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2644 sessionId:  describe result for acl check
2025-10-02T09:35:07.132813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.132818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.132819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.132824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318108433:9789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.133253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318108433:9789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.133314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.135013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318108433:9789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.135234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.135333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.135340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.135346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.135373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.135398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242536087:6356]
2025-10-02T09:35:07.135775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.135974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.135997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.136169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.136198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.136202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.136202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.136203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.136203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.136204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.136204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.136205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.136206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.136206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.136207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.136207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.136210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.136216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.136218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.136220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.136222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.136224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.136226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.136228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.136230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.136232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.136234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.136236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.136240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.136245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.136248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.136251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.136254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.136257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.136260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.136263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.136269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.136272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.136274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.136276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.136279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.136282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.136286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.136288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.136291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.136294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.136297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.136301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.136303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.136306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.136308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.136311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.136330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.140136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318108433:9789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.140146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318108433:9789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.140148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318108433:9789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.140152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.143745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.145361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.145372Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.145374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.145376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.145379Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2643 [2:7556555613242536087:6356]
2025-10-02T09:35:07.145386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.145394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.145396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.145398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.145399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.145408Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.145410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.145418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.145448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.145453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.145454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.145456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.145457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.145504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.145509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.145516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.145521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.145533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.145548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108475:9789], now have 1 active actors on pipe
2025-10-02T09:35:07.145554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108243:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.145557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.145559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.145560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.145569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.145580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.145590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.145589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.145593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.145576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2643
2025-10-02T09:35:07.145594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.145577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2643
2025-10-02T09:35:07.145595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.145616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.145621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.145628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.145637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.145649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.145658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e750aa71-fc32c085-8de35e02-50d42d02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.145663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.145665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.145666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.145671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.145676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.145693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.145819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.145825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.145832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.145901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2644 partition: 0 MaxSeqNo: 36 sessionId: src_id|e750aa71-fc32c085-8de35e02-50d42d02_0
2025-10-02T09:35:07.146133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974b3b2d-e527fd1c-f702f9a5-586d234d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e750aa71-fc32c085-8de35e02-50d42d02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.148788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Write session: try to update token
2025-10-02T09:35:07.148819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.154768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.154781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.154783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.154784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.154789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.154793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.154796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242536081:6356]
2025-10-02T09:35:07.154824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.154824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.154827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.154829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.154833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.154835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.154975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.161091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId: src_id|e750aa71-fc32c085-8de35e02-50d42d02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.163199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.222560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318108494:10189]
2025-10-02T09:35:07.222751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2643, pipe: [1:7556555613318108494:10189]
2025-10-02T09:35:07.266423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.266758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.266766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.266779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108494:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.266947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.266972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:07.266981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:07.266989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318108494:10189]
2025-10-02T09:35:07.267006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.267023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2644 reason: error at write: Disconnected sessionId: src_id|e750aa71-fc32c085-8de35e02-50d42d02_0
2025-10-02T09:35:07.267181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2644 sessionId: src_id|e750aa71-fc32c085-8de35e02-50d42d02_0 is DEAD
2025-10-02T09:35:07.267326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:07.267341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Write session will restart in 0.006852s
2025-10-02T09:35:07.267362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Write session: Do CDS request
2025-10-02T09:35:07.267369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.275228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.275293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.275305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2645
2025-10-02T09:35:07.275452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.275480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.275488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.275492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.275856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2645 sessionId:  describe result for acl check
2025-10-02T09:35:07.275882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.275886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.275887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.275890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318108587:9780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.276246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318108587:9780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.278223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318108587:9780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.279425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.281179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.281276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.281283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.281289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.281314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.281337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242536319:6351]
2025-10-02T09:35:07.281388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318108587:9780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.281397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318108587:9780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.281399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318108587:9780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.281402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.281679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.281873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.281896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.282070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.282099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.282103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.282104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.282105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.282105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.282106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.282106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.282107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.282107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.282108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.282109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.282109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.282112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.282118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.282120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.282122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.282124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.282125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.282127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.282129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.282131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.282133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.282135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.282137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.282140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.282144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.282147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.282150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.282153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.282155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.282157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.282160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.282162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.282165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.282167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.282170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.282172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.282175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.282177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.282179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.282183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.282186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.282188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.282191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.282193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.282196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.282199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.282203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.282220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.289635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.291180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.291192Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.291194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.291195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.291199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2644 [2:7556555613242536319:6351]
2025-10-02T09:35:07.291206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.291216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.291218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.291219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.291220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.291230Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.291236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.291241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.291271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.291276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.291277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.291279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.291280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.291379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.291384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.291391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.291396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.291405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.291419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108725:9780], now have 1 active actors on pipe
2025-10-02T09:35:07.291425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108495:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.291413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2644
2025-10-02T09:35:07.291429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.291415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2644
2025-10-02T09:35:07.291430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.291431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.291436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.291443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.291452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.291455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.291455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.291457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.291458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.291478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.291483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.291490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.291498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.291516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.291519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.291522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.291524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.291525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.291530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.291535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.291549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.291651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.291656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.291663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.291727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2645 partition: 0 MaxSeqNo: 36 sessionId: src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0
2025-10-02T09:35:07.292006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e750aa71-fc32c085-8de35e02-50d42d02_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.294608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Write session: try to update token
2025-10-02T09:35:07.294623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.300561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.300573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.300575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.300577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.300581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.300585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.300587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242536314:6351]
2025-10-02T09:35:07.300614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.300618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.300620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.300622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.300623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.300624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.300749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.307512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId: src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.309722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.366961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318108738:10189]
2025-10-02T09:35:07.367094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2644, pipe: [1:7556555613318108738:10189]
2025-10-02T09:35:07.410842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.411275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.411284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.411296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108738:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.411411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.411473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:07.411481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:07.411500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318108738:10189]
2025-10-02T09:35:07.411513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.411530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2645 reason: error at write: Disconnected sessionId: src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0
2025-10-02T09:35:07.411717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2645 sessionId: src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0 is DEAD
2025-10-02T09:35:07.411908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:07.411917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Write session will restart in 0.005543s
2025-10-02T09:35:07.411935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Write session: Do CDS request
2025-10-02T09:35:07.411939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.418255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.418255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.418266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2646
2025-10-02T09:35:07.418541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.418560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.418566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.418568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.418772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2646 sessionId:  describe result for acl check
2025-10-02T09:35:07.418791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.418795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.418796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.418799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318108815:9769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.419121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318108815:9769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.420992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318108815:9769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.422634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318108815:9769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.422644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318108815:9769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.422646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318108815:9769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.422649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.422741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.424331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.424430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.424436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.424442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.424467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.424492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242536568:6348]
2025-10-02T09:35:07.424841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.425003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.425024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.425200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.425229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.425233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.425234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.425235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.425235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.425236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.425236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.425237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.425237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.425238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.425239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.425239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.425242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.425248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.425250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.425252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.425254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.425256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.425258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.425259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.425261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.425263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.425265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.425267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.425270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.425274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.425278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.425281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.425283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.425286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.425288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.425291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.425293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.425295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.425297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.425300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.425302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.425305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.425307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.425310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.425312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.425315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.425317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.425320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.425322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.425325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.425327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.425330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.425346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.432721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.434438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.434450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.434451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.434453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.434457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2645 [2:7556555613242536568:6348]
2025-10-02T09:35:07.434464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.434473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.434475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.434476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.434477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.434486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.434489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.434502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.434531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.434537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.434539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.434540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.434542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.434579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.434584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.434591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.434596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.434605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.434620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108979:9769], now have 1 active actors on pipe
2025-10-02T09:35:07.434625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318108739:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.434629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.434630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.434631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.434638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.434646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.434654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.434656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.434658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.434662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.434663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.434671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.434672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.434666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2645
2025-10-02T09:35:07.434685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2645
2025-10-02T09:35:07.434684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.434691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.434693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.434708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.434717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.434721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.434722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.434728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.434733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.434742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.434820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.434825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.434832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.434888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2646 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0
2025-10-02T09:35:07.435162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f378e5-7acfeef3-45d7bda1-b4da75e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.437965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Write session: try to update token
2025-10-02T09:35:07.437981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.444206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.444223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.444225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.444226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.444232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.444235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.444238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242536561:6348]
2025-10-02T09:35:07.444266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.444265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.444269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.444271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.444275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.444278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.444405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.450577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId: src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.452693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.511837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318109003:10189]
2025-10-02T09:35:07.511997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2645, pipe: [1:7556555613318109003:10189]
2025-10-02T09:35:07.555683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.556161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.556171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.556183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109003:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.556309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.556356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318109003:10189]
2025-10-02T09:35:07.556381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:07.556403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.556433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2646 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0
2025-10-02T09:35:07.556595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2646 sessionId: src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0 is DEAD
2025-10-02T09:35:07.556717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:07.556726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Write session will restart in 0.009249s
2025-10-02T09:35:07.556740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Write session: Do CDS request
2025-10-02T09:35:07.556744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.567249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.567295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.567309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2647
2025-10-02T09:35:07.567423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.567424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.567451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.567460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.567463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.567784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2647 sessionId:  describe result for acl check
2025-10-02T09:35:07.567813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.567818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.567820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.567824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318109200:9761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.568173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318109200:9761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.569210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.569307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.569313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.569319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.569344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.569368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242536824:6329]
2025-10-02T09:35:07.569710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.569874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.569884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318109200:9761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.569897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.570072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.570099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.570102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.570103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.570104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.570104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.570105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.570105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.570106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.570106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.570107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.570107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.570108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.570111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.570116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.570118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.570120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.570122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.570124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.570126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.570128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.570130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.570132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.570134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.570136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.570139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.570143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.570146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.570149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.570151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.570154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.570156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.570159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.570161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.570164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.570166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.570170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.570172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.570174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.570176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.570179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.570181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.570183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.570186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.570188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.570190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.570192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.570194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.570197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.570214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.574047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318109200:9761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.574058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318109200:9761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.574060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318109200:9761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.574063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.577660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.579130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.579142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.579143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.579145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.579149Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2646 [2:7556555613242536824:6329]
2025-10-02T09:35:07.579157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.579167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.579172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.579174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.579175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.579185Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.579187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.579192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.579224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.579229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.579230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.579232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.579234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.579271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.579275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.579282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.579287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.579299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.579312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109238:9761], now have 1 active actors on pipe
2025-10-02T09:35:07.579317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109004:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.579321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.579322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.579323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.579330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.579341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.579347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.579350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.579344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2646
2025-10-02T09:35:07.579347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2646
2025-10-02T09:35:07.579351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.579356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.579358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.579365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.579367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.579374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.579383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.579385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.579403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.579411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.579413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.579414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.579420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.579425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.579440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.579544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.579549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.579557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.579619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2647 partition: 0 MaxSeqNo: 36 sessionId: src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0
2025-10-02T09:35:07.579833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a6dc8b-66f852c5-1808c162-3f4ea9bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.582319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Write session: try to update token
2025-10-02T09:35:07.582329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.588700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.588716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.588718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.588720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.588726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.588729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.588733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242536818:6329]
2025-10-02T09:35:07.588761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.588761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.588764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.588766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.588771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.588773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.588929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.593577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId: src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.595666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.656734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318109247:10189]
2025-10-02T09:35:07.656905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2646, pipe: [1:7556555613318109247:10189]
2025-10-02T09:35:07.699247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.699731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.699740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.699766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109247:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.699879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.699894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:07.699903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:07.699920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.699947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2647 reason: error at write: Disconnected sessionId: src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0
2025-10-02T09:35:07.699950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318109247:10189]
2025-10-02T09:35:07.700078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2647 sessionId: src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0 is DEAD
2025-10-02T09:35:07.700215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:07.700224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Write session will restart in 0.007837s
2025-10-02T09:35:07.700241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Write session: Do CDS request
2025-10-02T09:35:07.700246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.709113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.709226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.709238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2648
2025-10-02T09:35:07.709326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.709346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.709349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.709355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.709651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2648 sessionId:  describe result for acl check
2025-10-02T09:35:07.709681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.709685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.709687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.709690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318109435:9751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.710050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318109435:9751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.710849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.711360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318109435:9751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.712422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.712523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.712530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.712535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.712561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.712584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242537059:6327]
2025-10-02T09:35:07.712883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318109435:9751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.712893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318109435:9751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.712895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318109435:9751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.712899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.712957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.713107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.713132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.713306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.713332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.713336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.713337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.713337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.713338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.713338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.713339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.713340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.713340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.713341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.713341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.713342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.713344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.713350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.713352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.713354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.713356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.713358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.713360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.713362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.713364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.713367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.713369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.713371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.713375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.713378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.713381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.713384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.713386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.713389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.713391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.713393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.713396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.713399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.713401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.713403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.713406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.713409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.713411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.713413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.713415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.713418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.713422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.713425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.713427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.713430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.713432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.713434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.713450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.720821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.722217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.722228Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.722229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.722231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.722234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2647 [2:7556555613242537059:6327]
2025-10-02T09:35:07.722241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.722251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.722256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.722258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.722259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.722269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.722271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.722276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.722314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.722319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.722320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.722322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.722324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.722358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.722363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.722369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.722374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.722382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.722396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109480:9751], now have 1 active actors on pipe
2025-10-02T09:35:07.722402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109248:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.722405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.722406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.722407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.722414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.722422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.722427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.722429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.722431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.722431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.722433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.722434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2647
2025-10-02T09:35:07.722446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.722451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.722435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2647
2025-10-02T09:35:07.722459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.722466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.722468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.722485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e57699f-da1b5d0d-9876cf96-63621025_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.722498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.722501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.722502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.722507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.722515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.722527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.722619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.722625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.722635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.722689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2648 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e57699f-da1b5d0d-9876cf96-63621025_0
2025-10-02T09:35:07.722883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9e47ee-cb8c9e55-4ec35515-a37690bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e57699f-da1b5d0d-9876cf96-63621025_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.725344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Write session: try to update token
2025-10-02T09:35:07.725355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.731618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.731633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.731635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.731637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.731642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.731646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.731649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242537053:6327]
2025-10-02T09:35:07.731671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.731677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.731680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.731681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.731683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.731684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.731803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.736224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId: src_id|5e57699f-da1b5d0d-9876cf96-63621025_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.738288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.800088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318109492:10189]
2025-10-02T09:35:07.800255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2647, pipe: [1:7556555613318109492:10189]
2025-10-02T09:35:07.841978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.842345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.842353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.842377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109492:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.842533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.842555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:07.842565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:07.842579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318109492:10189]
2025-10-02T09:35:07.842595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.842607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2648 reason: error at write: Disconnected sessionId: src_id|5e57699f-da1b5d0d-9876cf96-63621025_0
2025-10-02T09:35:07.842725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2648 sessionId: src_id|5e57699f-da1b5d0d-9876cf96-63621025_0 is DEAD
2025-10-02T09:35:07.842857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:07.842867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Write session will restart in 0.007298s
2025-10-02T09:35:07.842885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Write session: Do CDS request
2025-10-02T09:35:07.842890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.851118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.851227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.851235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2649
2025-10-02T09:35:07.851299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.851321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.851327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.851329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.851657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2649 sessionId:  describe result for acl check
2025-10-02T09:35:07.851684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.851685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.851687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.851689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318109641:9748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.852058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318109641:9748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.853404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.853678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318109641:9748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.855187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.855285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.855292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.855297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.855323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.855347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242537294:6315]
2025-10-02T09:35:07.855361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318109641:9748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.855368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318109641:9748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.855372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318109641:9748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.855375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.855685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.855846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.855868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.856041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.856070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.856074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.856074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.856075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.856076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.856077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.856077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.856078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.856078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.856079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.856080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.856080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.856083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.856088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.856090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.856093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.856094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.856096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.856098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.856100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.856102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.856105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.856107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.856109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.856112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.856116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.856119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.856122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.856124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.856127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.856129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.856132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.856135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.856137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.856140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.856142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.856145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.856147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.856151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.856153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.856156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.856158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.856160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.856163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.856166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.856170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.856172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.856174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.856192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:07.863592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:07.865243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:07.865255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:07.865256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:07.865258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:07.865261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2648 [2:7556555613242537294:6315]
2025-10-02T09:35:07.865268Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:07.865278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:07.865281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.865283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.865284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.865292Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:07.865300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:07.865304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:07.865333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.865339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.865340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.865342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:07.865343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:07.865379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:07.865385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.865391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.865396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.865408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:07.865421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109493:2446], now have 1 active actors on pipe
2025-10-02T09:35:07.865426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109726:9748], now have 1 active actors on pipe
2025-10-02T09:35:07.865429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.865430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.865431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.865439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:07.865446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:07.865451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:07.865453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:07.865455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:07.865456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:07.865458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:07.865471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.865476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:07.865477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:07.865464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2648
2025-10-02T09:35:07.865468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2648
2025-10-02T09:35:07.865493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.865498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.865514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea91519d-ee68371d-6645b77-19457b44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:07.865520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:07.865522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:07.865523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:07.865529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:07.865536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:07.865547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.865629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.865634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.865641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:07.865706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2649 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea91519d-ee68371d-6645b77-19457b44_0
2025-10-02T09:35:07.865956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e57699f-da1b5d0d-9876cf96-63621025_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea91519d-ee68371d-6645b77-19457b44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:07.868739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Write session: try to update token
2025-10-02T09:35:07.868758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:07.874635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:07.874650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:07.874652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:07.874653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:07.874658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.874661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.874665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242537288:6315]
2025-10-02T09:35:07.874690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:07.874692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:07.874694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:07.874697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:07.874697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.874699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:07.874863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:07.882309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId: src_id|ea91519d-ee68371d-6645b77-19457b44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:07.884454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:07.927002Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] Counters: { Errors: 26 CurrentSessionLifetimeMs: 421452 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 9011208 BytesInflightTotal: 11264010 MessagesInflight: 5 }
2025-10-02T09:35:07.942933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555613318109745:10189]
2025-10-02T09:35:07.943094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2648, pipe: [1:7556555613318109745:10189]
2025-10-02T09:35:07.984759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:07.985101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:07.985110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:07.985121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109745:10189], now have 1 active actors on pipe
2025-10-02T09:35:07.985231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:07.985275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:07.985281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:07.985307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555613318109745:10189]
2025-10-02T09:35:07.985334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2649 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea91519d-ee68371d-6645b77-19457b44_0
2025-10-02T09:35:07.985455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2649 sessionId: src_id|ea91519d-ee68371d-6645b77-19457b44_0 is DEAD
2025-10-02T09:35:07.985602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:07.985617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Write session will restart in 0.007542s
2025-10-02T09:35:07.985641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Write session: Do CDS request
2025-10-02T09:35:07.985646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:07.994163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.994275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:07.994286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2650
2025-10-02T09:35:07.994365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:07.994384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:07.994389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:07.994391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:07.994692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2650 sessionId:  describe result for acl check
2025-10-02T09:35:07.994719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:07.994723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:07.994725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:07.994728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555613318109925:9738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:07.995073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555613318109925:9738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:07.996033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:07.996516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555613318109925:9738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:07.997488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:07.997582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:07.997589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:07.997595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:07.997620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:07.997642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555613242537531:6316]
2025-10-02T09:35:07.997996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:07.998041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555613318109925:9738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:07.998049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555613318109925:9738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:07.998051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555613318109925:9738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:07.998054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:07.998143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:07.998165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:07.998339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:07.998369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.998372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.998373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.998374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.998374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.998375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.998375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.998376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.998376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.998377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.998377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.998378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.998381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.998386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.998388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.998390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.998392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.998394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.998396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.998398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.998400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.998402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.998404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.998406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.998410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.998413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:07.998417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.998420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:07.998422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.998425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:07.998427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.998430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:07.998432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.998435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:07.998437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.998440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:07.998442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.998445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:07.998447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.998449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:07.998451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.998454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:07.998456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.998458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:07.998461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.998464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:07.998466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.998469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:07.998485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.005873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.007377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.007389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.007390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.007392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.007395Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2649 [2:7556555613242537531:6316]
2025-10-02T09:35:08.007402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.007412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.007413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.007415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.007415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.007425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.007427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.007432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.007462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.007464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.007465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.007467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.007468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.007505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.007509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.007516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.007521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.007529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.007540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109749:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.007542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555613318109985:9738], now have 1 active actors on pipe
2025-10-02T09:35:08.007546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.007547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.007548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.007556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.007563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.007569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.007570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.007571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.007571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.007573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.007586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2649
2025-10-02T09:35:08.007586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.007588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.007587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2649
2025-10-02T09:35:08.007602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.007724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.007731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.007752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.007756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.007758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.007759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.007764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.007769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.007777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.007881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.007888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.007898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.007952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2650 partition: 0 MaxSeqNo: 36 sessionId: src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0
2025-10-02T09:35:08.008220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea91519d-ee68371d-6645b77-19457b44_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.010853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Write session: try to update token
2025-10-02T09:35:08.010868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.016969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.016982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.016984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.016985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.016990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.016993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.016995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555613242537525:6316]
2025-10-02T09:35:08.017020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.017023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.017025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.017027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.017031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.017033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.017157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.022750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId: src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.024919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.085280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613077290:10189]
2025-10-02T09:35:08.085445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2649, pipe: [1:7556555617613077290:10189]
2025-10-02T09:35:08.126530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:08.126875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.126884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.126897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077290:10189], now have 1 active actors on pipe
2025-10-02T09:35:08.127056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:08.127053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613077290:10189]
2025-10-02T09:35:08.127059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:08.127073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:08.127075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:08.127112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2650 reason: error at write: Disconnected sessionId: src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0
2025-10-02T09:35:08.127238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2650 sessionId: src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0 is DEAD
2025-10-02T09:35:08.127372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:08.127380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Write session will restart in 0.008643s
2025-10-02T09:35:08.127400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Write session: Do CDS request
2025-10-02T09:35:08.127404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:08.137224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.137353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:08.137364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2651
2025-10-02T09:35:08.137453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.137474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:08.137480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:08.137483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:08.137526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:08.137789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2651 sessionId:  describe result for acl check
2025-10-02T09:35:08.137814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:08.137819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:08.137820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:08.137823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555617613077492:9736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:08.138196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555617613077492:9736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:08.139175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:08.139274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:08.139280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:08.139286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:08.139312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:08.139340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555617537505078:6302]
2025-10-02T09:35:08.139645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555617613077492:9736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:08.139681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:08.139857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:08.139879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:08.140053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:08.140081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.140085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.140086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.140086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.140087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.140087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.140088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.140088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.140089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.140089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.140090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.140090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.140093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.140098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.140100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.140102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.140104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.140106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.140108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.140110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.140112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.140114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.140116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.140118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.140121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.140125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.140128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.140131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.140134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.140136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.140138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.140141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.140143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.140146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.140148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.140151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.140153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.140156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.140158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.140161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.140163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.140165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.140167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.140170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.140172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.140175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.140177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.140180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.140196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.143990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555617613077492:9736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:08.143999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555617613077492:9736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:08.144001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555617613077492:9736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:08.144004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:08.147606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.149074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.149084Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.149085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.149087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.149091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2650 [2:7556555617537505078:6302]
2025-10-02T09:35:08.149099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.149109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.149114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.149116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.149117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.149125Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.149128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.149132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.149164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.149169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.149170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.149172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.149173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.149209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.149214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.149220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.149225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.149237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.149251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077292:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.149256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077531:9736], now have 1 active actors on pipe
2025-10-02T09:35:08.149260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.149261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.149262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.149269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.149279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.149280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.149282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.149283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.149289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.149276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2650
2025-10-02T09:35:08.149291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.149285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2650
2025-10-02T09:35:08.149305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.149309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.149311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.149319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.149324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.149349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.149356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.149358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.149359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.149364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.149372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.149383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.149476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.149481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.149488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.149542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2651 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0
2025-10-02T09:35:08.149764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13629d3-517a4b70-4bbb183e-40391dfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.152444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Write session: try to update token
2025-10-02T09:35:08.152452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.158594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.158609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.158611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.158612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.158618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.158621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.158625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555617537505072:6302]
2025-10-02T09:35:08.158640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.158643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.158645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.158653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.158658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.158660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.158789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.164380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId: src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.166580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.227112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613077550:10189]
2025-10-02T09:35:08.227297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2650, pipe: [1:7556555617613077550:10189]
2025-10-02T09:35:08.270262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:08.270649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.270658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.270672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077550:10189], now have 1 active actors on pipe
2025-10-02T09:35:08.270823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:08.270911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:08.270921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:08.270923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:08.270955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613077550:10189]
2025-10-02T09:35:08.270964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2651 reason: error at write: Disconnected sessionId: src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0
2025-10-02T09:35:08.271097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2651 sessionId: src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0 is DEAD
2025-10-02T09:35:08.271240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:08.271254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Write session will restart in 0.006493s
2025-10-02T09:35:08.271276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Write session: Do CDS request
2025-10-02T09:35:08.271282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:08.279184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.279237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:08.279245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2652
2025-10-02T09:35:08.279452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.279469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:08.279472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:08.279474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:08.279818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2652 sessionId:  describe result for acl check
2025-10-02T09:35:08.279842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:08.279847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:08.279849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:08.279852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555617613077694:9727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:08.280195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555617613077694:9727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:08.281616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:08.281702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555617613077694:9727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:08.283170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:08.283254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555617613077694:9727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:08.283262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555617613077694:9727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:08.283264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555617613077694:9727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:08.283270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:08.283272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:08.283279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:08.283284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:08.283312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:08.283335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555617537505317:6300]
2025-10-02T09:35:08.283668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:08.283829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:08.283853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:08.284026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:08.284052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.284056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.284056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.284057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.284057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.284058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.284058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.284059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.284059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.284060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.284060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.284061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.284063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.284069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.284072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.284074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.284076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.284078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.284080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.284082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.284084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.284086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.284088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.284090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.284098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.284101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.284104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.284106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.284109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.284111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.284114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.284116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.284119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.284121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.284124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.284126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.284128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.284131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.284133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.284138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.284140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.284143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.284145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.284148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.284150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.284153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.284169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.291508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.293031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.293042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.293043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.293044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.293048Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2651 [2:7556555617537505317:6300]
2025-10-02T09:35:08.293056Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.293065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.293070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.293072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.293073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.293082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.293084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.293089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.293119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.293123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.293124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.293126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.293128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.293163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.293169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.293175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.293180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.293188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.293201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077788:9727], now have 1 active actors on pipe
2025-10-02T09:35:08.293206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077551:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.293209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.293210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.293211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.293219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.293228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.293231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.293232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.293235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.293237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.293238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.293252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.293257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.293258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.293241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2651
2025-10-02T09:35:08.293252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2651
2025-10-02T09:35:08.293266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.293271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.293298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.293305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.293307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.293308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.293312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.293318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.293329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.293420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.293425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.293432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.293489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2652 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0
2025-10-02T09:35:08.293709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d8b2cee-f29369ea-6f9c0422-4c33d9f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.296418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Write session: try to update token
2025-10-02T09:35:08.296430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.302567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.302581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.302583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.302584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.302590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.302593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.302596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555617537505311:6300]
2025-10-02T09:35:08.302619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.302622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.302622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.302623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.302626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.302628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.302744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.307997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId: src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.310111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.370995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613077801:10189]
2025-10-02T09:35:08.371154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2651, pipe: [1:7556555617613077801:10189]
2025-10-02T09:35:08.416082Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:08.416393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.416404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.416429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077801:10189], now have 1 active actors on pipe
2025-10-02T09:35:08.416567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:08.416590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613077801:10189]
2025-10-02T09:35:08.416610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:08.416623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:08.416690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2652 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0
2025-10-02T09:35:08.416871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2652 sessionId: src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0 is DEAD
2025-10-02T09:35:08.417017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:08.417027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Write session will restart in 0.009683s
2025-10-02T09:35:08.417046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Write session: Do CDS request
2025-10-02T09:35:08.417050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:08.427102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:08.428214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:08.428221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2653
2025-10-02T09:35:08.428241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.428497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.428520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:08.428525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:08.428528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:08.428687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:08.428789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:08.428796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:08.428810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:08.428814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2653 sessionId:  describe result for acl check
2025-10-02T09:35:08.428837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:08.428840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:08.428844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:08.428845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:08.428848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555617613078015:9717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:08.428858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555617537505559:6295]
2025-10-02T09:35:08.429179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555617613078015:9717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:08.429201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:08.429389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:08.429411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:08.429584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:08.429612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.429615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.429616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.429616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.429617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.429618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.429618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.429619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.429619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.429620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.429620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.429621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.429623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.429629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.429631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.429634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.429635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.429638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.429640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.429641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.429644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.429646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.429648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.429650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.429653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.429657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.429660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.429663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.429665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.429668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.429670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.429673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.429675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.429677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.429679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.429682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.429684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.429686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.429688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.429691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.429693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.429696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.429699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.429702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.429706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.429708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.429710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.429713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.429729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.430698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555617613078015:9717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:08.434981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555617613078015:9717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:08.434990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555617613078015:9717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:08.434992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555617613078015:9717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:08.434996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:08.437164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.438647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.438658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.438659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.438660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.438664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2652 [2:7556555617537505559:6295]
2025-10-02T09:35:08.438672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.438681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.438687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.438688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.438689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.438699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.438703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.438708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.438736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.438740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.438741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.438744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.438746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.438861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2652
2025-10-02T09:35:08.438865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2652
2025-10-02T09:35:08.438914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.438919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.438926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.438931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.438940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.438955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613077802:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.438960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078053:9717], now have 1 active actors on pipe
2025-10-02T09:35:08.438971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.438976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.438985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.438989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.438990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.438999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.439009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.439009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.439011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.439012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.439019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.439020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.439030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.439037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.439039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.439040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.439045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.439051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.439068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.439074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.439079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.439080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.439176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.439180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.439188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.439257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2653 partition: 0 MaxSeqNo: 36 sessionId: src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0
2025-10-02T09:35:08.439456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0599bb0-850f2be6-1ff64da4-35c656ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.442108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Write session: try to update token
2025-10-02T09:35:08.442118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.448384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.448400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.448402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.448403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.448409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.448413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.448416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555617537505554:6295]
2025-10-02T09:35:08.448444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.448444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.448448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.448449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.448450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.448451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.448575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.453585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId: src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.455779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.516898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613078083:10189]
2025-10-02T09:35:08.517050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2652, pipe: [1:7556555617613078083:10189]
2025-10-02T09:35:08.563011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:08.563370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.563380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.563406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078083:10189], now have 1 active actors on pipe
2025-10-02T09:35:08.563552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:08.563606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:08.563619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613078083:10189]
2025-10-02T09:35:08.563644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:08.563723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2653 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0
2025-10-02T09:35:08.563917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2653 sessionId: src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0 is DEAD
2025-10-02T09:35:08.564032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:08.564041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Write session will restart in 0.007541s
2025-10-02T09:35:08.564055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Write session: Do CDS request
2025-10-02T09:35:08.564059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:08.572291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.572366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:08.572380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2654
2025-10-02T09:35:08.572480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.572500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:08.572506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:08.572509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:08.572835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2654 sessionId:  describe result for acl check
2025-10-02T09:35:08.572861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:08.572865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:08.572867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:08.572870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555617613078225:9696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:08.573232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555617613078225:9696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:08.574838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555617613078225:9696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:08.574851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:08.576614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:08.576814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:08.576821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:08.576828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:08.576875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:08.576903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555617537505836:6277]
2025-10-02T09:35:08.577257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:08.578244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555617613078225:9696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:08.578252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555617613078225:9696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:08.578254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555617613078225:9696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:08.578258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:08.580494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:08.580520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:08.580701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:08.580879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.580886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.580888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.580889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.580890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.580891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.580892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.580892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.580893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.580894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.580895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.580896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.580901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.580911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.580915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.580918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.580921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.580925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.580928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.580931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.580935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.580939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.580943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.580946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.580952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.580960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.580967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.580971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.580980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.580986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.580990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.580994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.580998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.581004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.581007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.581013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.581017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.581021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.581029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.581033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.581038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.581043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.581050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.581055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.581062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.581066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.581072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.581076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.581111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.602338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.603776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.603788Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.603789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.603791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.603796Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2653 [2:7556555617537505836:6277]
2025-10-02T09:35:08.603804Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.603816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.603822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.603824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.603825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.603835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.603838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.603842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.603877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.603882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.603884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.603886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.603888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.603929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.603934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.603940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.603946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.603958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.603973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078084:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.603980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.603981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.603983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.603990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.603997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078325:9696], now have 1 active actors on pipe
2025-10-02T09:35:08.604000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.604002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.604008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.604009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.604009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.604011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.604028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.604037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.604042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.604039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2653
2025-10-02T09:35:08.604041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2653
2025-10-02T09:35:08.604063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.604069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.604085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.604091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.604093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.604095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.604100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.604105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.604115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.604211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.604216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.604224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.604274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2654 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0
2025-10-02T09:35:08.604569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75129a79-652f3ac6-a07fb49c-fccc604b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.607457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Write session: try to update token
2025-10-02T09:35:08.607474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.613121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:08.613133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.613138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.613163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:08.613164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:08.613309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:08.613436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:08.613556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:08.613684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:08.613853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:08.613881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:08.620218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId: src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.621841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.621856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.621857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.621859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.621863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.621865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.621868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555617537505830:6277]
2025-10-02T09:35:08.621886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.621888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.621889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.621891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.621891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.621893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.621997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.622375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.663859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613078336:10189]
2025-10-02T09:35:08.664071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2653, pipe: [1:7556555617613078336:10189]
2025-10-02T09:35:08.733950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:08.734224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.734239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.734253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078336:10189], now have 1 active actors on pipe
2025-10-02T09:35:08.734429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613078336:10189]
2025-10-02T09:35:08.734430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:08.734453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:08.734454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:08.734510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2654 reason: error at write: Disconnected sessionId: src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0
2025-10-02T09:35:08.734562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:08.734635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2654 sessionId: src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0 is DEAD
2025-10-02T09:35:08.734805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:08.734819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Write session will restart in 0.009647s
2025-10-02T09:35:08.734845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Write session: Do CDS request
2025-10-02T09:35:08.734852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:08.745213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.745246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:08.745255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2655
2025-10-02T09:35:08.745497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.745519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:08.745522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:08.745524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:08.745819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2655 sessionId:  describe result for acl check
2025-10-02T09:35:08.745845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:08.745847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:08.745848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:08.745853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555617613078540:9695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:08.746197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555617613078540:9695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:08.746346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:08.747696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555617613078540:9695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:08.748005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:08.748173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:08.748181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:08.748187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:08.748222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:08.748244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555617537506078:6275]
2025-10-02T09:35:08.748573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:08.748742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:08.748764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:08.748955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:08.748984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.748988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.748988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.748989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.748989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.748990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.748990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.748991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.748992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.748993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.748993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.748994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.748997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.749002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.749005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.749007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.749009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.749011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.749013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.749016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.749019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.749021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.749023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.749027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.749031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.749034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.749037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.749039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.749042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.749044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.749046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.749050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.749055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.749060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.749063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.749065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.749067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.749070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.749072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.749078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.749080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.749082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.749085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.749090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.749092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.749107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.749176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555617613078540:9695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:08.749185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555617613078540:9695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:08.749187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555617613078540:9695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:08.749191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:08.756439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.757963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.757974Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.757974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.757976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.757979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2654 [2:7556555617537506078:6275]
2025-10-02T09:35:08.757986Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.757995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.758000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.758002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.758003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.758011Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.758014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.758019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.758048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.758052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.758053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.758056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.758057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.758090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.758095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.758102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.758107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.758119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.758133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078337:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.758138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078581:9695], now have 1 active actors on pipe
2025-10-02T09:35:08.758141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.758143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.758144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.758151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.758160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.758164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.758166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.758167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.758171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.758172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.758181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2654
2025-10-02T09:35:08.758184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.758183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2654
2025-10-02T09:35:08.758191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.758197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.758211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.758213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.758226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.758233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.758235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.758236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.758241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.758247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.758255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.758362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.758367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.758374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.758423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2655 partition: 0 MaxSeqNo: 36 sessionId: src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0
2025-10-02T09:35:08.758623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f79c0c-91e1f7b0-a2c3efc2-394fcc88_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.761306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Write session: try to update token
2025-10-02T09:35:08.761317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.767227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.767241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.767242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.767246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.767250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.767252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.767254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555617537506072:6275]
2025-10-02T09:35:08.767275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.767281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.767282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.767283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.767284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.767286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.767388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.774319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId: src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.776379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.834330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613078589:10189]
2025-10-02T09:35:08.834550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2654, pipe: [1:7556555617613078589:10189]
2025-10-02T09:35:08.877527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:08.877714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.877723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.877735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078589:10189], now have 1 active actors on pipe
2025-10-02T09:35:08.877849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:08.877878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613078589:10189]
2025-10-02T09:35:08.877897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:08.877906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:08.877958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0
2025-10-02T09:35:08.878093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2655 sessionId: src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0 is DEAD
2025-10-02T09:35:08.878243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:08.878257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Write session will restart in 0.008269s
2025-10-02T09:35:08.878278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Write session: Do CDS request
2025-10-02T09:35:08.878283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:08.887144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.887180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:08.887189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2656
2025-10-02T09:35:08.887396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:08.887415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:08.887421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:08.887424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:08.887735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2656 sessionId:  describe result for acl check
2025-10-02T09:35:08.887758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:08.887763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:08.887764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:08.887768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555617613078770:9685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:08.888112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555617613078770:9685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:08.889090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:08.889513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555617613078770:9685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:08.890806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:08.890977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:08.890985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:08.890991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:08.891024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:08.891044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555617537506321:6273]
2025-10-02T09:35:08.891379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:08.891525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555617613078770:9685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:08.891534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555617613078770:9685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:08.891536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555617613078770:9685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:08.891540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:08.891546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:08.891569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:08.891741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:08.891769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.891772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.891773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.891773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.891774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.891774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.891775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.891775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.891776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.891776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.891777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.891777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.891780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.891786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.891788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.891790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.891792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.891794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.891796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.891797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.891799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.891801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.891803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.891805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.891808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.891812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:08.891815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.891818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:08.891820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.891823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:08.891825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.891828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:08.891830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.891833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:08.891835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.891838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:08.891840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.891843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:08.891846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.891849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:08.891851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.891855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:08.891858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.891861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.891863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.891866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.891867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.891870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.891891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:08.899265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:08.900836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:08.900845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:08.900847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:08.900848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:08.900851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2655 [2:7556555617537506321:6273]
2025-10-02T09:35:08.900859Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:08.900870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:08.900875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.900877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.900878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.900887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:08.900891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:08.900896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:08.900926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.900930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.900932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.900934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:08.900935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:08.900968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:08.900973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.900979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:08.900984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:08.900992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:08.901003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078834:9685], now have 1 active actors on pipe
2025-10-02T09:35:08.901009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078590:2446], now have 1 active actors on pipe
2025-10-02T09:35:08.901012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.901013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.901014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.901022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:08.901032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:08.901033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:08.901035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:08.901037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:08.901042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:08.901044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:08.901057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.901061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:08.901063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:08.901046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2655
2025-10-02T09:35:08.901047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2655
2025-10-02T09:35:08.901075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.901080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.901100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|118d4273-557864c-7938ed1c-2cba3a67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:08.901107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:08.901111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:08.901112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:08.901117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:08.901124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:08.901137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.901222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:08.901227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:08.901235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:08.901286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2656 partition: 0 MaxSeqNo: 36 sessionId: src_id|118d4273-557864c-7938ed1c-2cba3a67_0
2025-10-02T09:35:08.901487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f69c7a96-9f89ddf9-b64793b1-17902097_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|118d4273-557864c-7938ed1c-2cba3a67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:08.904001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Write session: try to update token
2025-10-02T09:35:08.904011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:08.910104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:08.910118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:08.910119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:08.910120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:08.910124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.910127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.910129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555617537506315:6273]
2025-10-02T09:35:08.910149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:08.910155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:08.910157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:08.910161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:08.910165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:08.910168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:08.910265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:08.915222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId: src_id|118d4273-557864c-7938ed1c-2cba3a67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:08.917323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:08.978200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555617613078852:10189]
2025-10-02T09:35:08.978322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2655, pipe: [1:7556555617613078852:10189]
2025-10-02T09:35:09.019275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.019476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.019486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.019511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555617613078852:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.019629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.019674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:09.019679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.019681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:09.019706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555617613078852:10189]
2025-10-02T09:35:09.019722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2656 reason: error at write: Disconnected sessionId: src_id|118d4273-557864c-7938ed1c-2cba3a67_0
2025-10-02T09:35:09.019843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2656 sessionId: src_id|118d4273-557864c-7938ed1c-2cba3a67_0 is DEAD
2025-10-02T09:35:09.019970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:09.019979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Write session will restart in 0.007609s
2025-10-02T09:35:09.019998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Write session: Do CDS request
2025-10-02T09:35:09.020002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.028129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.028174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.028182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2657
2025-10-02T09:35:09.028243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.028260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.028266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.028269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.028648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2657 sessionId:  describe result for acl check
2025-10-02T09:35:09.028673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.028677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.028678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.028681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908046286:9671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.029026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908046286:9671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.030382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908046286:9671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.030887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.032436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.032530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.032536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.032542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.032567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.032591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832473860:6267]
2025-10-02T09:35:09.032618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908046286:9671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.032626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908046286:9671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.032628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908046286:9671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.032632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.032939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.033098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.033122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.033298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.033328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.033332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.033332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.033333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.033333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.033334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.033334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.033335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.033335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.033336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.033336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.033337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.033340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.033346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.033348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.033350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.033352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.033354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.033356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.033357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.033359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.033362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.033364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.033365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.033368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.033372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.033376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.033378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.033381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.033383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.033385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.033388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.033391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.033393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.033395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.033398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.033400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.033403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.033405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.033407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.033411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.033414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.033417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.033419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.033421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.033424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.033426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.033428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.033444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.040744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.042373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.042384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.042386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.042387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.042390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2656 [2:7556555621832473860:6267]
2025-10-02T09:35:09.042397Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.042406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.042408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.042409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.042410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.042419Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.042426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.042430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.042458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.042463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.042464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.042466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.042467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.042525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.042529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.042536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.042541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.042552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.042565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046149:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.042571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046390:9671], now have 1 active actors on pipe
2025-10-02T09:35:09.042574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.042576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.042577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.042584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.042594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.042598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.042600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.042601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.042603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.042605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.042583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2656
2025-10-02T09:35:09.042584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2656
2025-10-02T09:35:09.042627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.042632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.042640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.042647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.042660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.042664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.042668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.042670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.042671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.042676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.042681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.042691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.042786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.042790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.042798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.042845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2657 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0
2025-10-02T09:35:09.043039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118d4273-557864c-7938ed1c-2cba3a67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.045559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Write session: try to update token
2025-10-02T09:35:09.045569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.051757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.051771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.051772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.051774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.051778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.051781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.051784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832473854:6267]
2025-10-02T09:35:09.051806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.051812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.051814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.051819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.051823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.051826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.051930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.056982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId: src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.059122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:09.120021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555621908046402:10189]
2025-10-02T09:35:09.120188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2656, pipe: [1:7556555621908046402:10189]
2025-10-02T09:35:09.161218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.161548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.161556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.161567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046402:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.161670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.161674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555621908046402:10189]
2025-10-02T09:35:09.161687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.161693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:09.161695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:09.161728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2657 reason: error at write: Disconnected sessionId: src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0
2025-10-02T09:35:09.161848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2657 sessionId: src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0 is DEAD
2025-10-02T09:35:09.161971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:09.161980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Write session will restart in 0.006437s
2025-10-02T09:35:09.161995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Write session: Do CDS request
2025-10-02T09:35:09.162000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.169133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.169193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.169201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2658
2025-10-02T09:35:09.169291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.169309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.169314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.169317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.169595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2658 sessionId:  describe result for acl check
2025-10-02T09:35:09.169620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.169624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.169625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.169628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908046513:9662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.169927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908046513:9662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.171319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908046513:9662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.172813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.174431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.174484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908046513:9662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.174500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908046513:9662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.174505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908046513:9662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.174514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.174550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.174557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.174563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.174592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.174615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832474119:6256]
2025-10-02T09:35:09.174948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.175107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.175130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.175303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.175331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.175335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.175336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.175336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.175337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.175337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.175338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.175338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.175339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.175339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.175340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.175340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.175343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.175349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.175351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.175353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.175355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.175357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.175359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.175361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.175363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.175365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.175367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.175368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.175372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.175376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.175379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.175382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.175385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.175388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.175390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.175393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.175396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.175398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.175400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.175403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.175405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.175408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.175410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.175412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.175415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.175417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.175419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.175423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.175425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.175428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.175430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.175433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.175455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.182783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.184145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.184157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.184158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.184160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.184163Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2657 [2:7556555621832474119:6256]
2025-10-02T09:35:09.184170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.184180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.184181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.184183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.184184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.184193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.184195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.184201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.184231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.184236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.184237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.184239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.184240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.184352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2657
2025-10-02T09:35:09.184367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2657
2025-10-02T09:35:09.184401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.184406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.184412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.184418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.184426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.184441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046657:9662], now have 1 active actors on pipe
2025-10-02T09:35:09.184446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046415:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.184456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.184462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.184473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.184477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.184478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.184486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.184495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.184499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.184502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.184504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.184506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.184507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.184512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.184515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.184517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.184518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.184523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.184528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.184542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.184549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.184553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.184555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.184634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.184639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.184646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.184685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2658 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0
2025-10-02T09:35:09.184880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1266996-f5367f95-cd0b5bb3-77b67a73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.187462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Write session: try to update token
2025-10-02T09:35:09.187471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.193464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:09.193479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.193483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.193507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:09.193513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:09.193648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:09.193760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:09.193872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:09.193983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:09.194203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:09.194229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:09.198550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId: src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.200576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:09.200696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.200706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.200723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:09.200778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:09.201842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.201856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.201857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.201858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.201863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.201865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.201867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832474113:6256]
2025-10-02T09:35:09.201886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.201889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.201891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.201894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.201894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.201895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.202006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.261854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555621908046668:10189]
2025-10-02T09:35:09.262031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2657, pipe: [1:7556555621908046668:10189]
2025-10-02T09:35:09.310912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.316838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.316854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.316979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.317029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.317081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.317137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.317180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.317187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.317249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.317305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.317364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.317426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.317467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.317472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.317522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.317567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.317619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.317669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.317705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.317710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.317760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.317806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.317853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.317905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.317940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.317944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.317996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.318043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.318092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.318141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.318179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.318184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.318269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.318317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.318370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.318422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.318457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.318464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.318517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.318563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.318611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.318662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.318704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.318709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.318757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.318806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.318853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.318900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.318936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.318941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.318989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.319038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.319088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.319137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.319183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.319191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.319238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:09.319291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:09.319341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:09.319395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:09.319445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:09.319449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:09.319478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046668:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.319629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:09.319638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.319640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:09.319659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2658 reason: error at write: Disconnected sessionId: src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0
2025-10-02T09:35:09.319677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555621908046668:10189]
2025-10-02T09:35:09.319783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2658 sessionId: src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0 is DEAD
2025-10-02T09:35:09.319899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:09.319908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Write session will restart in 0.009087s
2025-10-02T09:35:09.319923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Write session: Do CDS request
2025-10-02T09:35:09.319926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.319957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.330229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.330297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.330304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2659
2025-10-02T09:35:09.330367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.330384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.330391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.330393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.330650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2659 sessionId:  describe result for acl check
2025-10-02T09:35:09.330679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.330684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.330685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.330688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908046879:9661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.330791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.331038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908046879:9661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.332256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.332347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.332354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.332359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.332385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.332408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832474365:6254]
2025-10-02T09:35:09.332726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908046879:9661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.332740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.332913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.332936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.333109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.333136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.333141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.333141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.333142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.333142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.333143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.333143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.333144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.333144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.333145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.333146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.333146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.333149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.333154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.333157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.333159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.333161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.333163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.333165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.333167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.333169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.333171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.333173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.333175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.333178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.333182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.333185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.333188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.333191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.333194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.333196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.333199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.333201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.333203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.333205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.333208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.333210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.333213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.333218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.333221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.333224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.333227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.333228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.333231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.333233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.333236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.333237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.333240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.333260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.337022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908046879:9661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.337031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908046879:9661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.337034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908046879:9661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.337038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.340626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.342275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.342285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.342286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.342288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.342291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2658 [2:7556555621832474365:6254]
2025-10-02T09:35:09.342300Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.342310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.342315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.342317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.342318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.342326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.342328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.342333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.342365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.342370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.342371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.342373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.342374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.342411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.342416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.342423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.342428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.342439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.342452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046919:9661], now have 1 active actors on pipe
2025-10-02T09:35:09.342457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046672:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.342461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.342462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.342464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.342471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.342481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.342482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.342484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.342486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.342499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.342483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2658
2025-10-02T09:35:09.342501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.342496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2658
2025-10-02T09:35:09.342515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.342521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.342522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.342531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.342533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.342553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f1ad332-607ed882-5fe597a6-781ad669_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.342560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.342563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.342564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.342568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.342575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.342585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.342678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.342683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.342690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.342738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2659 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f1ad332-607ed882-5fe597a6-781ad669_0
2025-10-02T09:35:09.342989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc002c5a-ea83100d-b5cda139-30ddf90d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f1ad332-607ed882-5fe597a6-781ad669_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.345753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Write session: try to update token
2025-10-02T09:35:09.345771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.351631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.351644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.351645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.351646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.351650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.351653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.351655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832474359:6254]
2025-10-02T09:35:09.351674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.351677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.351678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.351686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.351690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.351693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.351853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.358366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId: src_id|6f1ad332-607ed882-5fe597a6-781ad669_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.360459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:09.420055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555621908046926:10189]
2025-10-02T09:35:09.420222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2658, pipe: [1:7556555621908046926:10189]
2025-10-02T09:35:09.461675Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.461881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.461891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.461903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046926:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.462015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:09.462023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:09.462018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.462041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555621908046926:10189]
2025-10-02T09:35:09.462077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2659 reason: error at write: Disconnected sessionId: src_id|6f1ad332-607ed882-5fe597a6-781ad669_0
2025-10-02T09:35:09.462092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.462204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2659 sessionId: src_id|6f1ad332-607ed882-5fe597a6-781ad669_0 is DEAD
2025-10-02T09:35:09.462393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:09.462409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Write session will restart in 0.006881s
2025-10-02T09:35:09.462438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Write session: Do CDS request
2025-10-02T09:35:09.462445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.470177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.470210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.470217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2660
2025-10-02T09:35:09.470369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.470388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.470394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.470397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.470694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2660 sessionId:  describe result for acl check
2025-10-02T09:35:09.470718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.470722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.470724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.470727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908047049:9649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.471090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908047049:9649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.472973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908047049:9649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.473432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.475083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.475203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.475211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.475217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.475250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.475274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832474617:6248]
2025-10-02T09:35:09.475282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908047049:9649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.475291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908047049:9649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.475293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908047049:9649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.475297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.475631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.475809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.475833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.476011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.476042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.476047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.476048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.476048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.476049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.476050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.476050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.476051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.476052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.476052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.476053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.476053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.476056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.476062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.476065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.476067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.476069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.476071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.476073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.476075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.476078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.476080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.476082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.476084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.476087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.476091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.476095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.476098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.476100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.476103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.476105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.476108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.476111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.476114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.476116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.476119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.476122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.476125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.476127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.476130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.476133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.476136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.476138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.476141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.476144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.476146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.476149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.476151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.476168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.483588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.485168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.485179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.485181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.485183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.485186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2659 [2:7556555621832474617:6248]
2025-10-02T09:35:09.485194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.485203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.485204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.485206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.485207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.485215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.485218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.485223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.485253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.485258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.485259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.485261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.485262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.485300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.485307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.485313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.485319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.485327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.485337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.485341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.485342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.485348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.485355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.485355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.485357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.485359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.485363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.485365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.485372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908046928:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.485374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047175:9649], now have 1 active actors on pipe
2025-10-02T09:35:09.485387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.485392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.485394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2659
2025-10-02T09:35:09.485421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2659
2025-10-02T09:35:09.485409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.485451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.485457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.485470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.485477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.485480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.485481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.485485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.485491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.485498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.485595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.485600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.485607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.485658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2660 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0
2025-10-02T09:35:09.485887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f1ad332-607ed882-5fe597a6-781ad669_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.488519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Write session: try to update token
2025-10-02T09:35:09.488530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.494535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.494548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.494549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.494551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.494556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.494559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.494562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832474607:6248]
2025-10-02T09:35:09.494590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.494594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.494599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.494599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.494600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.494601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.494715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.499965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId: src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.502068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:09.562421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555621908047205:10189]
2025-10-02T09:35:09.562636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2659, pipe: [1:7556555621908047205:10189]
2025-10-02T09:35:09.606414Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.606705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.606714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.606727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047205:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.606885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.606942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.606944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:09.606983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555621908047205:10189]
2025-10-02T09:35:09.606999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2660 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0
2025-10-02T09:35:09.607149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2660 sessionId: src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0 is DEAD
2025-10-02T09:35:09.607262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:09.607272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Write session will restart in 0.008257s
2025-10-02T09:35:09.607287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Write session: Do CDS request
2025-10-02T09:35:09.607292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.616135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.616430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.616439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2661
2025-10-02T09:35:09.616530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.616551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.616558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.616561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.616903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2661 sessionId:  describe result for acl check
2025-10-02T09:35:09.616926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.616931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.616932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.616935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908047355:9633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.617276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908047355:9633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.618898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908047355:9633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.619126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.620918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.621082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.621090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.621096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.621125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.621149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832474897:6226]
2025-10-02T09:35:09.621160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908047355:9633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.621169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908047355:9633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.621170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908047355:9633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.621174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.621491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.621676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.621698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.621872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.621901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.621905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.621906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.621906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.621907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.621907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.621908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.621909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.621909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.621910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.621910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.621911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.621913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.621919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.621921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.621923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.621925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.621927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.621929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.621931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.621933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.621935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.621937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.621939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.621943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.621947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.621950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.621953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.621955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.621958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.621960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.621963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.621965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.621968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.621970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.621973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.621975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.621978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.621980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.621983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.621985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.621988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.621990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.621993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.621996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.622003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.622005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.622008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.622029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.629522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.631168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.631179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.631180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.631182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.631186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2660 [2:7556555621832474897:6226]
2025-10-02T09:35:09.631192Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.631201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.631202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.631204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.631205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.631213Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.631220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.631223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.631253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.631258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.631258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.631260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.631261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.631298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.631303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.631310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.631315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.631326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.631340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047452:9633], now have 1 active actors on pipe
2025-10-02T09:35:09.631345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047206:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.631349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.631350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.631351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.631358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.631369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.631379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.631381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.631383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.631384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.631386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.631396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.631401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.631408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.631391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2660
2025-10-02T09:35:09.631421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.631426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.631395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2660
2025-10-02T09:35:09.631442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.631448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.631450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.631451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.631455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.631463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.631474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.631573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.631578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.631585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.631653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2661 partition: 0 MaxSeqNo: 36 sessionId: src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0
2025-10-02T09:35:09.631860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b48ac5-69c99ec2-40b5d9a2-dd53ff04_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.634607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Write session: try to update token
2025-10-02T09:35:09.634629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.640268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:09.640280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.640285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.640305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:09.640314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:09.640435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:09.640549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:09.640659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:09.640770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:09.640938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:09.640962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:09.647014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId: src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.648636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.648648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.648649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.648650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.648654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.648656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.648659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832474892:6226]
2025-10-02T09:35:09.648677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.648683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.648684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.648685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.648686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.648688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.648811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.649393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:09.707280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555621908047464:10189]
2025-10-02T09:35:09.707427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2660, pipe: [1:7556555621908047464:10189]
2025-10-02T09:35:09.757965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.758153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.758162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.758174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047464:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.758325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.758372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555621908047464:10189]
2025-10-02T09:35:09.758377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:09.758395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.758440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2661 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0
2025-10-02T09:35:09.758588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2661 sessionId: src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0 is DEAD
2025-10-02T09:35:09.758819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:09.758834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Write session will restart in 0.008494s
2025-10-02T09:35:09.758860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Write session: Do CDS request
2025-10-02T09:35:09.758866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.768139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.768239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.768247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2662
2025-10-02T09:35:09.768350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.768371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.768373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.768377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.768673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2662 sessionId:  describe result for acl check
2025-10-02T09:35:09.768700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.768701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.768702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.768705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908047672:9631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.769066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908047672:9631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.769669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.770739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908047672:9631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.771441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.771538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.771544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.771550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.771576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.771599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832475147:6230]
2025-10-02T09:35:09.771936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.772113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.772134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.772306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.772333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.772337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.772338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.772338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.772339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.772339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.772340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.772340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.772341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.772342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.772342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.772343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.772345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.772351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.772353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.772355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.772357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.772359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.772361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.772363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.772365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.772367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.772369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.772371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.772374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.772378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.772382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.772385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.772387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.772389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.772391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.772394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.772396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.772399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.772401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.772403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.772405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.772409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.772411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.772415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.772417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.772420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.772422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.772428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.772430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.772434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.772439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.772441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.772459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.772621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908047672:9631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.772629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908047672:9631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.772631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908047672:9631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.772635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.780099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.781578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.781591Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.781592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.781594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.781597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2661 [2:7556555621832475147:6230]
2025-10-02T09:35:09.781603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.781612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.781614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.781615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.781616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.781625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.781630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.781634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.781664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.781669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.781671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.781672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.781674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.781711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.781716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.781722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.781727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.781738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.781752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047468:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.781757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047717:9631], now have 1 active actors on pipe
2025-10-02T09:35:09.781760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.781762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.781763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.781770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.781780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.781773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2661
2025-10-02T09:35:09.781786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.781792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2661
2025-10-02T09:35:09.781790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.781791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.781796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.781797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.781808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.781810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.781817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.781817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.781819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.781942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.781950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.781953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.781954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.781959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.781964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.781980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.782095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.782103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.782113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.782170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2662 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0
2025-10-02T09:35:09.782407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b6194c-eb2c47b9-c7c6db47-433933be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.784947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Write session: try to update token
2025-10-02T09:35:09.784961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.791101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.791113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.791114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.791115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.791118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.791120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.791123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832475142:6230]
2025-10-02T09:35:09.791142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.791148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.791149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.791150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.791151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.791155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.791254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.796391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId: src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.798499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:09.858326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555621908047726:10189]
2025-10-02T09:35:09.858527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2661, pipe: [1:7556555621908047726:10189]
2025-10-02T09:35:09.900861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:09.901040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.901049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.901073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047726:10189], now have 1 active actors on pipe
2025-10-02T09:35:09.901203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:09.901199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555621908047726:10189]
2025-10-02T09:35:09.901212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:09.901215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:09.901217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:09.901258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2662 reason: error at write: Disconnected sessionId: src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0
2025-10-02T09:35:09.901397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2662 sessionId: src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0 is DEAD
2025-10-02T09:35:09.901540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:09.901554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Write session will restart in 0.008739s
2025-10-02T09:35:09.901575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Write session: Do CDS request
2025-10-02T09:35:09.901581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:09.911149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.911237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:09.911245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2663
2025-10-02T09:35:09.911361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:09.911381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:09.911386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:09.911388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:09.911634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2663 sessionId:  describe result for acl check
2025-10-02T09:35:09.911655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:09.911660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:09.911661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:09.911664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555621908047941:9618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:09.911987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555621908047941:9618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:09.912530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:09.913554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555621908047941:9618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:09.914191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:09.914281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:09.914288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:09.914293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:09.914317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:09.914341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555621832475397:6227]
2025-10-02T09:35:09.914683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:09.914852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:09.914875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:09.915054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:09.915085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.915089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.915089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.915090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.915090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.915091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.915091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.915092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.915092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.915093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.915093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.915094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.915096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.915102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.915104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.915107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.915109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.915111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.915113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.915115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.915117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.915119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.915121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.915123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.915127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.915131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:09.915134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.915137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:09.915140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.915143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:09.915144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.915147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:09.915149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.915152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:09.915154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.915157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:09.915159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.915162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:09.915164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.915166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:09.915168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.915171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:09.915175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.915178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.915184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.915187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.915189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.915191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.915207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:09.915478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555621908047941:9618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:09.915485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555621908047941:9618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:09.915487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555621908047941:9618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:09.915491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:09.922867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:09.924340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:09.924350Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:09.924351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:09.924353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:09.924356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2662 [2:7556555621832475397:6227]
2025-10-02T09:35:09.924364Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:09.924374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:09.924379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.924381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.924382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.924391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:09.924395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:09.924399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:09.924430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.924434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.924435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.924437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:09.924438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:09.924470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:09.924475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.924481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:09.924486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:09.924493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:09.924505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047983:9618], now have 1 active actors on pipe
2025-10-02T09:35:09.924512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.924513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.924514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.924519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:09.924524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555621908047732:2446], now have 1 active actors on pipe
2025-10-02T09:35:09.924527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:09.924528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:09.924532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:09.924534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:09.924535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:09.924537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:09.924549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.924550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:09.924553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:09.924574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2662
2025-10-02T09:35:09.924574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2662
2025-10-02T09:35:09.924618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.924623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.924638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:09.924642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:09.924645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:09.924647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:09.924652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:09.924656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:09.924664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.924768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:09.924774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:09.924781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:09.924848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2663 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0
2025-10-02T09:35:09.925075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e4d776-fefe37f6-5932d9e5-9ae1cc0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:09.927734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Write session: try to update token
2025-10-02T09:35:09.927745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:09.933809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:09.933822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:09.933824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:09.933825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:09.933830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.933833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.933835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555621832475391:6227]
2025-10-02T09:35:09.933856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:09.933859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:09.933860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:09.933861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:09.933864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:09.933866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:09.933991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:09.939847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId: src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:09.942012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.001170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203015290:10189]
2025-10-02T09:35:10.001317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2662, pipe: [1:7556555626203015290:10189]
2025-10-02T09:35:10.044519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.044745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.044753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.044766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015290:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.044909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.044914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:10.044924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:10.044930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.044959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203015290:10189]
2025-10-02T09:35:10.044967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2663 reason: error at write: Disconnected sessionId: src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0
2025-10-02T09:35:10.045094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2663 sessionId: src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0 is DEAD
2025-10-02T09:35:10.045229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:10.045238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Write session will restart in 0.005389s
2025-10-02T09:35:10.045257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Write session: Do CDS request
2025-10-02T09:35:10.045262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.051175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.051289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.051298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2664
2025-10-02T09:35:10.051370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.051390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.051393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.051398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.051697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2664 sessionId:  describe result for acl check
2025-10-02T09:35:10.051724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.051728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.051730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.051733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203015350:9617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.052083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203015350:9617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.053997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203015350:9617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.055788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203015350:9617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.055797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203015350:9617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.055799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203015350:9617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.055802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.056339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.057982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.058078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.058084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.058090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.058116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.058136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127442945:6222]
2025-10-02T09:35:10.058474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.058666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.058689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.058876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.058910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.058914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.058915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.058915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.058916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.058916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.058917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.058918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.058918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.058918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.058919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.058919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.058922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.058928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.058930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.058932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.058934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.058936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.058938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.058940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.058942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.058944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.058946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.058948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.058952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.058956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.058959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.058962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.058964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.058967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.058969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.058972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.058978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.058981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.058983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.058986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.058988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.058990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.058994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.058998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.059001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.059003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.059007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.059010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.059012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.059014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.059017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.059019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.059036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.066637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.068327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.068339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.068340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.068342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.068346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2663 [2:7556555626127442945:6222]
2025-10-02T09:35:10.068353Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.068363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.068368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.068370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.068371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.068379Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.068382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.068386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.068423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.068427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.068428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.068430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.068431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.068467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.068471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.068478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.068483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.068491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.068505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015536:9617], now have 1 active actors on pipe
2025-10-02T09:35:10.068511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015291:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.068514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.068515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.068517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.068525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.068534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.068543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.068545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.068548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.068548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.068550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.068557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2663
2025-10-02T09:35:10.068564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2663
2025-10-02T09:35:10.068561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.068568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.068574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.068587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.068589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.068604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.068612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.068615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.068616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.068621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.068626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.068633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.068720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.068725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.068733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.068796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2664 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0
2025-10-02T09:35:10.069029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b8f0c04-9ada0c37-7ee3e8a-b5492ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:10.071621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Write session: try to update token
2025-10-02T09:35:10.071632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:10.081875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:10.081889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.081895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.081921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:10.081925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:10.082052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:10.082165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:10.082275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:10.082388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:10.082551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:10.082576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:10.083098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId: src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:10.085175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.085298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.085307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.085322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:10.085383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:10.087252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:10.087263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.087264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:10.087265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:10.087271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.087273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.087275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127442939:6222]
2025-10-02T09:35:10.087295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:10.087301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.087301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:10.087302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:10.087305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:10.087310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:10.087418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:10.145062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203015551:10189]
2025-10-02T09:35:10.145204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2663, pipe: [1:7556555626203015551:10189]
2025-10-02T09:35:10.198650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.204625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.204644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.204769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.204839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.204889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.204943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.204980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.204987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.205053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.205111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.205171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.205233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.205277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.205282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.205333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.205381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.205431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.205483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.205519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.205524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.205577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.205624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.205673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.205722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.205806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.205811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.205863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.205910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.205960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.206010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.206051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.206055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.206107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.206154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.206206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.206257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.206292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.206296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.206345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.206392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.206445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.206502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.206539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.206544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.206593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.206638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.206686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.206734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.206783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.206789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.206839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.206885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.206934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.206983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.207019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.207023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.207071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:10.207120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:10.207172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:10.207224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:10.207275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:10.207280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:10.207309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015551:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.207483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203015551:10189]
2025-10-02T09:35:10.207492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:10.207495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:10.207508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.207515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2664 reason: error at write: Disconnected sessionId: src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0
2025-10-02T09:35:10.207667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2664 sessionId: src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0 is DEAD
2025-10-02T09:35:10.207790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:10.207800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Write session will restart in 0.007287s
2025-10-02T09:35:10.207814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Write session: Do CDS request
2025-10-02T09:35:10.207818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.207991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.216454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.216486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.216502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2665
2025-10-02T09:35:10.216707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.216730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.216737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.216740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.217064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2665 sessionId:  describe result for acl check
2025-10-02T09:35:10.217094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.217097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.217100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.217104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203015612:9611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.217500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203015612:9611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.220234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203015612:9611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.222370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203015612:9611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.222380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203015612:9611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.222382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203015612:9611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.222387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.224721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.226343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.226479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.226496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.226502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.226540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.226568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127443211:6214]
2025-10-02T09:35:10.226923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.227119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.227143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.227322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.227351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.227354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.227355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.227356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.227356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.227357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.227357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.227358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.227359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.227359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.227360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.227360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.227363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.227369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.227371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.227373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.227375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.227377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.227379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.227381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.227383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.227385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.227387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.227389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.227393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.227397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.227400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.227403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.227405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.227416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.227418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.227422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.227424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.227426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.227429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.227431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.227433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.227439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.227442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.227445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.227447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.227450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.227455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.227457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.227460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.227464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.227469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.227472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.227488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.234972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.238104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.238114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.238115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.238118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.238121Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2664 [2:7556555626127443211:6214]
2025-10-02T09:35:10.238128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.238138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.238143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.238145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.238146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.238155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.238161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.238165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.238196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.238200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.238202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.238204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.238205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.238242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.238248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.238254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.238260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.238268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.238280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015764:9611], now have 1 active actors on pipe
2025-10-02T09:35:10.238284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.238285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.238286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.238291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.238296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015564:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.238298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.238300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.238300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.238301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.238307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.238309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.238322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.238323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.238325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.238339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2664
2025-10-02T09:35:10.238517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2664
2025-10-02T09:35:10.238561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.238567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.238582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13018bc3-248b962b-3e0ac652-eab9d787_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.238589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.238591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.238592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.238598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.238603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.238614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.238721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.238725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.238732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.238791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2665 partition: 0 MaxSeqNo: 36 sessionId: src_id|13018bc3-248b962b-3e0ac652-eab9d787_0
2025-10-02T09:35:10.239079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac59ab1f-fcfd072-f8396378-ae6cbd9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13018bc3-248b962b-3e0ac652-eab9d787_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:10.245002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Write session: try to update token
2025-10-02T09:35:10.245019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:10.247518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:10.247530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.247532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:10.247533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:10.247536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.247539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.247541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127443206:6214]
2025-10-02T09:35:10.247560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:10.247563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:10.247563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.247564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:10.247565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:10.247567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:10.247670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:10.262916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId: src_id|13018bc3-248b962b-3e0ac652-eab9d787_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:10.265064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.307875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203015827:10189]
2025-10-02T09:35:10.308048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2664, pipe: [1:7556555626203015827:10189]
2025-10-02T09:35:10.360184Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.360636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.360647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.360660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015827:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.360812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.360884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203015827:10189]
2025-10-02T09:35:10.360914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:10.360966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2665 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13018bc3-248b962b-3e0ac652-eab9d787_0
2025-10-02T09:35:10.361041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.361114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2665 sessionId: src_id|13018bc3-248b962b-3e0ac652-eab9d787_0 is DEAD
2025-10-02T09:35:10.361265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:10.361281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Write session will restart in 0.005026s
2025-10-02T09:35:10.361322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Write session: Do CDS request
2025-10-02T09:35:10.361328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.367146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.367266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.367276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2666
2025-10-02T09:35:10.367379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.367406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.367414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.367418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.367790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2666 sessionId:  describe result for acl check
2025-10-02T09:35:10.367815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.367816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.367819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.367823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203015861:9601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.368271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203015861:9601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.370457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203015861:9601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.373395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203015861:9601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.373405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203015861:9601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.373408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203015861:9601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.373413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.377182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.377556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.377649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.377655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.377661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.377685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.377710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127443466:6193]
2025-10-02T09:35:10.378062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.379336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.379359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.379642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.379672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.379676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.379677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.379677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.379678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.379678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.379679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.379680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.379680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.379681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.379682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.379682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.379685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.379692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.379694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.379697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.379698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.379701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.379703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.379705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.379707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.379709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.379711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.379713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.379717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.379721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.379725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.379728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.379731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.379733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.379736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.379739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.379741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.379745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.379749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.379751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.379754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.379757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.379759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.379762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.379764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.379767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.379769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.379776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.379778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.379781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.379783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.379789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.379807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.387424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.388868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.388879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.388880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.388882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.388886Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2665 [2:7556555626127443466:6193]
2025-10-02T09:35:10.388893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.388903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.388908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.388909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.388910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.388918Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.388925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.388930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.388963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.388967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.388968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.388970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.388972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.389008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.389013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.389019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.389024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.389033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.389047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015829:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.389055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.389057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.389058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.389065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.389071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203015992:9601], now have 1 active actors on pipe
2025-10-02T09:35:10.389077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.389083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.389085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.389087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.389087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.389088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.389102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.389110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.389115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.389137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.389142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.389108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2665
2025-10-02T09:35:10.389157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.389112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2665
2025-10-02T09:35:10.389165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.389167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.389168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.389174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.389179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.389191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.389325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.389330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.389338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.389424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2666 partition: 0 MaxSeqNo: 36 sessionId: src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0
2025-10-02T09:35:10.389734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13018bc3-248b962b-3e0ac652-eab9d787_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:10.392373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Write session: try to update token
2025-10-02T09:35:10.392387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:10.398649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:10.398661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.398663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:10.398663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:10.398667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.398670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.398672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127443461:6193]
2025-10-02T09:35:10.398691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:10.398694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.398695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:10.398701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:10.398705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:10.398709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:10.398826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:10.409005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId: src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:10.411405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.460966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203016090:10189]
2025-10-02T09:35:10.461166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2665, pipe: [1:7556555626203016090:10189]
2025-10-02T09:35:10.512124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.512580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.512590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.512601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016090:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.512716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.512785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:10.512849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2666 reason: status is not ok: tablet will be restarted right now sessionId: src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0
2025-10-02T09:35:10.512995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2666 sessionId: src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0 is DEAD
2025-10-02T09:35:10.513110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:10.513120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Write session will restart in 0.005749s
2025-10-02T09:35:10.513136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Write session: Do CDS request
2025-10-02T09:35:10.513140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.513201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203016090:10189]
2025-10-02T09:35:10.513218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.520216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.520278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.520286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2667
2025-10-02T09:35:10.520416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.520436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.520438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.520440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.520730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2667 sessionId:  describe result for acl check
2025-10-02T09:35:10.520748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.520749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.520752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.520754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203016149:9582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.521105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203016149:9582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.523380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203016149:9582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.526541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203016149:9582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.526554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203016149:9582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.526556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203016149:9582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.526559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.528864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.530734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.530934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.530943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.530949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.530981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.531002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127443748:6197]
2025-10-02T09:35:10.531340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.531527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.531548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.531722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.531749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.531753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.531753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.531754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.531755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.531755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.531756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.531756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.531757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.531758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.531758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.531759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.531762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.531768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.531770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.531772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.531774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.531776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.531778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.531780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.531782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.531784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.531786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.531788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.531792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.531796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.531799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.531801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.531803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.531806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.531808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.531811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.531813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.531816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.531818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.531820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.531822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.531825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.531826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.531829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.531831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.531834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.531836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.531839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.531841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.531844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.531846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.531848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.531866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.539829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.541545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.541558Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.541559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.541561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.541565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2666 [2:7556555626127443748:6197]
2025-10-02T09:35:10.541572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.541583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.541588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.541590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.541591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.541600Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.541607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.541611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.541645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.541649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.541650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.541652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.541653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.541691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.541695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.541702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.541707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.541715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.541728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.541732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.541733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.541738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.541746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016308:9582], now have 1 active actors on pipe
2025-10-02T09:35:10.541746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.541748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.541750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.541752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016104:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.541757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.541765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.541767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.541782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.541790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.541802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.541804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2666
2025-10-02T09:35:10.541825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2666
2025-10-02T09:35:10.541852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.541857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.541874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.541881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.541884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.541885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.541891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.541899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.541906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.542026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.542031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.542038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.542106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2667 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0
2025-10-02T09:35:10.542426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e3e9e-267a6f92-2112ce0-2fe0d4cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:10.545118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Write session: try to update token
2025-10-02T09:35:10.545135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:10.550882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:10.550895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.550896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:10.550897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:10.550901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.550904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.550906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127443743:6197]
2025-10-02T09:35:10.550925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:10.550928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.550929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:10.550935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:10.550939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:10.550941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:10.551034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:10.559536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId: src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:10.561955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.613530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203016375:10189]
2025-10-02T09:35:10.613735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2666, pipe: [1:7556555626203016375:10189]
2025-10-02T09:35:10.663245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.663544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.663552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.663566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016375:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.663712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.663742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.663742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:10.663746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:10.663784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203016375:10189]
2025-10-02T09:35:10.663797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2667 reason: error at write: Disconnected sessionId: src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0
2025-10-02T09:35:10.663973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2667 sessionId: src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0 is DEAD
2025-10-02T09:35:10.664113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:10.664127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Write session will restart in 0.008447s
2025-10-02T09:35:10.664152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Write session: Do CDS request
2025-10-02T09:35:10.664157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.673260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.673607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.673619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2668
2025-10-02T09:35:10.673741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.673767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.673771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.673774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.674098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2668 sessionId:  describe result for acl check
2025-10-02T09:35:10.674122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.674124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.674125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.674128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203016475:9573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.674465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203016475:9573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.676489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203016475:9573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.679039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203016475:9573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.679049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203016475:9573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.679061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.679051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203016475:9573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.679054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.680808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.680904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.680911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.680916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.680941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.680965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127444010:3151]
2025-10-02T09:35:10.681303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.681505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.681527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.681709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.681739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.681743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.681743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.681744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.681744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.681745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.681745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.681746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.681746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.681747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.681747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.681748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.681751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.681757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.681759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.681761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.681763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.681765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.681767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.681769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.681771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.681773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.681775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.681777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.681781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.681785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.681789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.681792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.681794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.681797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.681799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.681801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.681804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.681806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.681809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.681811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.681813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.681816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.681819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.681822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.681824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.681828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.681830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.681832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.681836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.681839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.681841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.681844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.681865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.689553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.691045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.691058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.691059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.691061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.691066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2667 [2:7556555626127444010:3151]
2025-10-02T09:35:10.691074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.691084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.691085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.691087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.691088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.691098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.691101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.691106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.691176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.691182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.691183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.691185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.691187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.691229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.691234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.691240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.691246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.691254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.691264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.691268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.691270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.691275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.691282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.691283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.691285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.691287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.691290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.691291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.691298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016376:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.691300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016627:9573], now have 1 active actors on pipe
2025-10-02T09:35:10.691314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.691322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.691331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.691362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2667
2025-10-02T09:35:10.691366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2667
2025-10-02T09:35:10.691399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.691405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.691419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.691425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.691427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.691428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.691434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.691439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.691446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.691564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.691569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.691576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.691646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2668 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0
2025-10-02T09:35:10.691951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e39757d-4c44a5aa-5a33dcb-ac907a21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:10.694670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Write session: try to update token
2025-10-02T09:35:10.694689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:10.700461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:10.700474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.700475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:10.700476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:10.700481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.700483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.700485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127444004:3151]
2025-10-02T09:35:10.700504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:10.700508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.700509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:10.700511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:10.700514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:10.700516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:10.700612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:10.707667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId: src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:10.710045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.764091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203016639:10189]
2025-10-02T09:35:10.764302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2667, pipe: [1:7556555626203016639:10189]
2025-10-02T09:35:10.811606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.812157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.812167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.812180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016639:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.812311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.812379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203016639:10189]
2025-10-02T09:35:10.812387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.812405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:10.812459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2668 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0
2025-10-02T09:35:10.812600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2668 sessionId: src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0 is DEAD
2025-10-02T09:35:10.812789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:10.812818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Write session will restart in 0.006976s
2025-10-02T09:35:10.812845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Write session: Do CDS request
2025-10-02T09:35:10.812852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.821251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.821321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.821330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2669
2025-10-02T09:35:10.821451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.821472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.821477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.821480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.821744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2669 sessionId:  describe result for acl check
2025-10-02T09:35:10.821770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.821771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.821772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.821775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203016704:9568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.822122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203016704:9568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.824358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203016704:9568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.826857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203016704:9568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.826866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203016704:9568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.826868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203016704:9568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.826872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.828325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.830069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.830181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.830189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.830195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.830222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.830247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127444266:6187]
2025-10-02T09:35:10.830599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.830787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.830809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.830984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.831013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.831017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.831018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.831019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.831019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.831020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.831020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.831021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.831022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.831022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.831023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.831023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.831026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.831032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.831034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.831036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.831038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.831040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.831042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.831043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.831046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.831048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.831050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.831052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.831055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.831060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.831063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.831066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.831068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.831072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.831074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.831076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.831079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.831081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.831083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.831086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.831088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.831090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.831092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.831095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.831097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.831100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.831102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.831105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.831107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.831109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.831112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.831114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.831131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.838529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.840177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.840187Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.840188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.840190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.840193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2668 [2:7556555626127444266:6187]
2025-10-02T09:35:10.840200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.840211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.840212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.840214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.840215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.840224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.840227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.840231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.840267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.840268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.840269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.840271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.840272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.840313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.840319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.840325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.840330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.840339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.840350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016873:9568], now have 1 active actors on pipe
2025-10-02T09:35:10.840354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016641:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.840358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.840360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.840361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.840369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.840377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.840382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.840384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.840385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.840390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.840391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.840399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.840404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.840397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2668
2025-10-02T09:35:10.840419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.840401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2668
2025-10-02T09:35:10.840538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.840546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.840559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.840563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.840565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.840566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.840571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.840576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.840583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.840694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.840699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.840706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.840762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2669 partition: 0 MaxSeqNo: 36 sessionId: src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0
2025-10-02T09:35:10.841042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b37f7d-a4f802db-a3f0a350-73541e1d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:10.843609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Write session: try to update token
2025-10-02T09:35:10.843622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:10.849193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:10.849207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.849211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.849231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:10.849234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:10.849366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:10.849483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:10.849593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:10.849700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:10.849849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:10.849873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:10.856066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId: src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:10.857645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:10.857658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:10.857659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:10.857660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:10.857665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.857668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.857670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127444261:6187]
2025-10-02T09:35:10.857689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:10.857693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:10.857695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.857696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:10.857696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:10.857698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:10.857802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:10.858554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:10.912547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555626203016910:10189]
2025-10-02T09:35:10.912744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2668, pipe: [1:7556555626203016910:10189]
2025-10-02T09:35:10.969757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:10.969962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.969971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.969983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016910:10189], now have 1 active actors on pipe
2025-10-02T09:35:10.970150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:10.970200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:10.970200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:10.970231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555626203016910:10189]
2025-10-02T09:35:10.970264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2669 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0
2025-10-02T09:35:10.970401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2669 sessionId: src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0 is DEAD
2025-10-02T09:35:10.970570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:10.970583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Write session will restart in 0.008686s
2025-10-02T09:35:10.970606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Write session: Do CDS request
2025-10-02T09:35:10.970612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:10.980162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.980255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:10.980266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2670
2025-10-02T09:35:10.980375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:10.980395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:10.980398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:10.980401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:10.980696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2670 sessionId:  describe result for acl check
2025-10-02T09:35:10.980716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:10.980717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:10.980718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:10.980721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555626203017019:9555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:10.981076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555626203017019:9555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:10.983363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555626203017019:9555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:10.985398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:10.987145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:10.987242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:10.987248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:10.987254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:10.987246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555626203017019:9555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:10.987280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:10.987255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555626203017019:9555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:10.987257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555626203017019:9555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:10.987261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:10.987309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555626127444522:6185]
2025-10-02T09:35:10.987642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:10.987829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:10.987850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:10.988025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:10.988053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.988057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.988058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.988059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.988059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.988060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.988060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.988061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.988061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.988062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.988062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.988063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.988066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.988072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.988074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.988076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.988078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.988080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.988082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.988084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.988086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.988088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.988090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.988092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.988096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.988100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:10.988103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.988106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:10.988109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.988112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:10.988114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.988117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:10.988119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.988122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:10.988124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.988126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:10.988129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.988132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:10.988134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.988137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:10.988140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.988142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:10.988144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.988147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.988149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.988151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.988153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.988156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.988172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:10.995646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:10.997243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:10.997258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:10.997259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:10.997261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:10.997265Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2669 [2:7556555626127444522:6185]
2025-10-02T09:35:10.997274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:10.997283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:10.997285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.997286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.997287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.997296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:10.997298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:10.997303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:10.997444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.997451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.997452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.997454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:10.997455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:10.997494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:10.997499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:10.997506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:10.997511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:10.997521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:10.997534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203017169:9555], now have 1 active actors on pipe
2025-10-02T09:35:10.997540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555626203016918:2446], now have 1 active actors on pipe
2025-10-02T09:35:10.997544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:10.997545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:10.997546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:10.997553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:10.997561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:10.997563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:10.997565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:10.997566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:10.997568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:10.997570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:10.997583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:10.997587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:10.997589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:10.997571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2669
2025-10-02T09:35:10.997597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.997602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.997600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2669
2025-10-02T09:35:10.997626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:10.997633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:10.997635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:10.997636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:10.997641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:10.997650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:10.997662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.997769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:10.997773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:10.997781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:10.997837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2670 partition: 0 MaxSeqNo: 36 sessionId: src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0
2025-10-02T09:35:10.998107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc4f7f3-d5ef8924-1c761d85-be1fbd0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.000690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Write session: try to update token
2025-10-02T09:35:11.000704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.006737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.006749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.006750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.006751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.006756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:11.006758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:11.006760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555626127444517:6185]
2025-10-02T09:35:11.006780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.006783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.006785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.006787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.006789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.006791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.006903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.012881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId: src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.015101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.070260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497984476:10189]
2025-10-02T09:35:11.070432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2669, pipe: [1:7556555630497984476:10189]
2025-10-02T09:35:11.118867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.119185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.119194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.119206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497984476:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.119383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.119388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497984476:10189]
2025-10-02T09:35:11.119405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:11.119406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:11.119448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.119450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2670 reason: error at write: Disconnected sessionId: src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0
2025-10-02T09:35:11.119589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2670 sessionId: src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0 is DEAD
2025-10-02T09:35:11.119750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:11.119763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Write session will restart in 0.007854s
2025-10-02T09:35:11.119784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Write session: Do CDS request
2025-10-02T09:35:11.119789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:11.128204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.128365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:11.128374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2671
2025-10-02T09:35:11.128493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.128514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:11.128520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:11.128523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:11.128872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2671 sessionId:  describe result for acl check
2025-10-02T09:35:11.128895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:11.128900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:11.128901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:11.128904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555630497984556:9546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:11.129271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555630497984556:9546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:11.131223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555630497984556:9546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:11.133428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555630497984556:9546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:11.133437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555630497984556:9546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:11.133439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555630497984556:9546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:11.133442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:11.134889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:11.136666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:11.136850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:11.136858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:11.136864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:11.136899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:11.136920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555630422412090:6171]
2025-10-02T09:35:11.137253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:11.137459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:11.137481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:11.137657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:11.137685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.137689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.137689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.137690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.137691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.137691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.137692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.137693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.137693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.137694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.137694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.137694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.137697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.137703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.137705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.137708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.137710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.137712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.137713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.137715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.137718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.137720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.137722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.137724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.137728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.137732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.137735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.137738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.137740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.137742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.137744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.137747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.137751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.137753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.137755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.137758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.137760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.137763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.137765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.137768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.137771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.137773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.137775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.137778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.137780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.137783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.137785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.137787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.137804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:11.145205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:11.146726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:11.146738Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:11.146740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:11.146742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:11.146745Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2670 [2:7556555630422412090:6171]
2025-10-02T09:35:11.146752Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:11.146761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:11.146764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.146766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.146767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.146776Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:11.146782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:11.146786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:11.146817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.146822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.146823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.146825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:11.146826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:11.146862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:11.146867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.146873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.146878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.146886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:11.146900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497984479:2446], now have 1 active actors on pipe
2025-10-02T09:35:11.146905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497984711:9546], now have 1 active actors on pipe
2025-10-02T09:35:11.146908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.146910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.146910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.146918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:11.146925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:11.146932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:11.146936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:11.146936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:11.146939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:11.146941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:11.146950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.146955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:11.146951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2670
2025-10-02T09:35:11.146957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2670
2025-10-02T09:35:11.146969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:11.147005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.147010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.147025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:11.147032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.147034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.147035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:11.147039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.147044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:11.147051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.147147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.147151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.147159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.147214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2671 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0
2025-10-02T09:35:11.147462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41b24ed-d8d04783-95b9b618-1e0c3ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.150109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Write session: try to update token
2025-10-02T09:35:11.150125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.155724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:11.155735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.155739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.155759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:11.155766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:11.155915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:11.156028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:11.156142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:11.156256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:11.156406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:11.156427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:11.163382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId: src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.164075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.164086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.164088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.164089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.164093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.164095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.164097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555630422412085:6171]
2025-10-02T09:35:11.164115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.164119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.164120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.164120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.164124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.164127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.164226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.165815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.219752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497984757:10189]
2025-10-02T09:35:11.219895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2670, pipe: [1:7556555630497984757:10189]
2025-10-02T09:35:11.272597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.272942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.272952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.272965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497984757:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.273131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.273137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497984757:10189]
2025-10-02T09:35:11.273157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:11.273159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:11.273162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.273197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2671 reason: error at write: Disconnected sessionId: src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0
2025-10-02T09:35:11.273329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2671 sessionId: src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0 is DEAD
2025-10-02T09:35:11.273479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:11.273492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Write session will restart in 0.007798s
2025-10-02T09:35:11.273517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Write session: Do CDS request
2025-10-02T09:35:11.273523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:11.282218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.282305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:11.282313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2672
2025-10-02T09:35:11.282420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.282440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:11.282447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:11.282449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:11.282710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2672 sessionId:  describe result for acl check
2025-10-02T09:35:11.282736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:11.282741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:11.282742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:11.282745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555630497984838:9545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:11.283085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555630497984838:9545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:11.285458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555630497984838:9545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:11.287809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555630497984838:9545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:11.287817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555630497984838:9545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:11.287818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555630497984838:9545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:11.287822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:11.288596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:11.290944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:11.291038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:11.291045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:11.291051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:11.291170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:11.291194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555630422412349:6177]
2025-10-02T09:35:11.291527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:11.291699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:11.291722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:11.291896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:11.291924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.291928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.291929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.291929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.291930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.291930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.291931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.291931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.291932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.291932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.291933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.291933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.291936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.291942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.291944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.291946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.291948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.291950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.291952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.291954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.291956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.291958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.291960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.291962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.291965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.291969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.291972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.291975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.291977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.291980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.291982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.291985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.291988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.291990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.291992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.291995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.291997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.292003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.292005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.292008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.292010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.292016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.292018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.292020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.292023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.292025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.292027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.292033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.292049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:11.299417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:11.300839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:11.300849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:11.300850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:11.300852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:11.300856Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2671 [2:7556555630422412349:6177]
2025-10-02T09:35:11.300863Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:11.300871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:11.300878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.300880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.300881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.300890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:11.300896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:11.300900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:11.300927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.300932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.300933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.300935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:11.300936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:11.300971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:11.300976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.300982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.300987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.300995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:11.301009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985012:9545], now have 1 active actors on pipe
2025-10-02T09:35:11.301014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497984758:2446], now have 1 active actors on pipe
2025-10-02T09:35:11.301018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.301020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.301021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.301027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:11.301035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:11.301045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:11.301045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:11.301047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:11.301049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:11.301049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:11.301061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.301063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:11.301048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2671
2025-10-02T09:35:11.301074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:11.301050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2671
2025-10-02T09:35:11.301080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.301083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.301100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:11.301107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.301109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.301110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:11.301115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.301119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:11.301127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.301238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.301243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.301250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.301309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2672 partition: 0 MaxSeqNo: 36 sessionId: src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0
2025-10-02T09:35:11.301563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5a5145-e32e6d2d-43961683-e7ba818_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.304162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Write session: try to update token
2025-10-02T09:35:11.304175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.310137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.310150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.310151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.310152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.310155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.310157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.310159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555630422412344:6177]
2025-10-02T09:35:11.310179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.310182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.310183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.310187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.310190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.310194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.310361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.316699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId: src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.318952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.373359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497985028:10189]
2025-10-02T09:35:11.373499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2671, pipe: [1:7556555630497985028:10189]
2025-10-02T09:35:11.417850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.418119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.418127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.418138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985028:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.418277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.418287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:11.418293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:11.418314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497985028:10189]
2025-10-02T09:35:11.418334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.418335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2672 reason: error at write: Disconnected sessionId: src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0
2025-10-02T09:35:11.418458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2672 sessionId: src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0 is DEAD
2025-10-02T09:35:11.418596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:11.418611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Write session will restart in 0.005112s
2025-10-02T09:35:11.418632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Write session: Do CDS request
2025-10-02T09:35:11.418637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:11.425147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.425266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:11.425273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2673
2025-10-02T09:35:11.425390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.425409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:11.425416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:11.425418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:11.425718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2673 sessionId:  describe result for acl check
2025-10-02T09:35:11.425742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:11.425747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:11.425748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:11.425751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555630497985066:9536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:11.426119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555630497985066:9536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:11.427807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555630497985066:9536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:11.430152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555630497985066:9536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:11.430163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555630497985066:9536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:11.430166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555630497985066:9536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:11.430171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:11.434140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:11.435992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:11.436175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:11.436183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:11.436189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:11.436221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:11.436243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555630422412611:6167]
2025-10-02T09:35:11.436579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:11.436770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:11.436794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:11.436983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:11.437011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.437015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.437015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.437016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.437016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.437017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.437018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.437018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.437019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.437019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.437020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.437020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.437023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.437029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.437031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.437033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.437035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.437037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.437039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.437041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.437043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.437045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.437047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.437049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.437054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.437058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.437061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.437064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.437066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.437068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.437070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.437073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.437076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.437078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.437080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.437083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.437085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.437088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.437090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.437093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.437096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.437100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.437102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.437105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.437109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.437112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.437114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.437120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.437138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:11.444532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:11.445996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:11.446007Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:11.446008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:11.446010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:11.446013Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2672 [2:7556555630422412611:6167]
2025-10-02T09:35:11.446021Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:11.446030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:11.446032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.446033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.446034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.446043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:11.446046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:11.446050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:11.446079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.446085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.446086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.446088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:11.446089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:11.446124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:11.446129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.446135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.446140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.446152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:11.446166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985183:9536], now have 1 active actors on pipe
2025-10-02T09:35:11.446171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985029:2446], now have 1 active actors on pipe
2025-10-02T09:35:11.446175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.446176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.446177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.446184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:11.446194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:11.446196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:11.446198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:11.446200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:11.446204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:11.446206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:11.446190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2672
2025-10-02T09:35:11.446197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2672
2025-10-02T09:35:11.446219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.446224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:11.446225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:11.446236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.446240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.446366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|932605a6-658e4d7c-7daf817e-b549ecea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:11.446373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.446375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.446377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:11.446381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.446387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:11.446405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.446518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.446523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.446531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.446583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2673 partition: 0 MaxSeqNo: 36 sessionId: src_id|932605a6-658e4d7c-7daf817e-b549ecea_0
2025-10-02T09:35:11.446853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10d832c-712a6141-a5ef6c55-c18ac2d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|932605a6-658e4d7c-7daf817e-b549ecea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.449485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Write session: try to update token
2025-10-02T09:35:11.449498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.455199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.455211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.455213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.455213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.455217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.455220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.455222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555630422412606:6167]
2025-10-02T09:35:11.455241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.455247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.455247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.455248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.455250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.455252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.455392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.462252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId: src_id|932605a6-658e4d7c-7daf817e-b549ecea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.464390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.518251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497985298:10189]
2025-10-02T09:35:11.518407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2672, pipe: [1:7556555630497985298:10189]
2025-10-02T09:35:11.564436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.564708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.564716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.564728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985298:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.564844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.564846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.564855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497985298:10189]
2025-10-02T09:35:11.564868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:11.564869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:11.564901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2673 reason: error at write: Disconnected sessionId: src_id|932605a6-658e4d7c-7daf817e-b549ecea_0
2025-10-02T09:35:11.565030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2673 sessionId: src_id|932605a6-658e4d7c-7daf817e-b549ecea_0 is DEAD
2025-10-02T09:35:11.565142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:11.565150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Write session will restart in 0.006999s
2025-10-02T09:35:11.565168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Write session: Do CDS request
2025-10-02T09:35:11.565172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:11.573081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.573129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:11.573137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2674
2025-10-02T09:35:11.573241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.573259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:11.573265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:11.573267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:11.573489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2674 sessionId:  describe result for acl check
2025-10-02T09:35:11.573511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:11.573516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:11.573517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:11.573521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555630497985390:9507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:11.573835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555630497985390:9507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:11.575680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555630497985390:9507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:11.577815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555630497985390:9507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:11.577824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555630497985390:9507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:11.577826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555630497985390:9507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:11.577829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:11.580323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:11.582039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:11.582180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:11.582187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:11.582193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:11.582221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:11.582242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555630422412907:6145]
2025-10-02T09:35:11.582583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:11.582778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:11.582797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:11.582978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:11.583008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.583009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.583009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.583010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.583011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.583011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.583012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.583012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.583013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.583013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.583014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.583014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.583017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.583022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.583025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.583027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.583029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.583031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.583032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.583034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.583036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.583039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.583040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.583042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.583045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.583050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.583052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.583055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.583057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.583060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.583062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.583065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.583067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.583070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.583072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.583074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.583076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.583079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.583081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.583083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.583086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.583089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.583092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.583095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.583097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.583099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.583101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.583104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.583119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:11.590459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:11.592214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:11.592224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:11.592225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:11.592227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:11.592230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2673 [2:7556555630422412907:6145]
2025-10-02T09:35:11.592237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:11.592246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:11.592247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.592249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.592249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.592258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:11.592261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:11.592265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:11.592294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.592299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.592300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.592301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:11.592303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:11.592337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:11.592342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.592348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.592354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.592364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:11.592379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985517:9507], now have 1 active actors on pipe
2025-10-02T09:35:11.592384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985324:2446], now have 1 active actors on pipe
2025-10-02T09:35:11.592389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.592390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.592391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.592398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:11.592408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:11.592410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:11.592413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:11.592414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:11.592417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:11.592419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:11.592406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2673
2025-10-02T09:35:11.592408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2673
2025-10-02T09:35:11.592433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.592440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:11.592441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:11.592455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.592456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.592474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8631592-8f40d103-82a16d16-853cbae6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:11.592477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.592479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.592480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:11.592485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.592489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:11.592497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.592595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.592600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.592607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.592669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2674 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8631592-8f40d103-82a16d16-853cbae6_0
2025-10-02T09:35:11.592887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|932605a6-658e4d7c-7daf817e-b549ecea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8631592-8f40d103-82a16d16-853cbae6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.595489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Write session: try to update token
2025-10-02T09:35:11.595499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.601556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.601571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.601572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.601575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.601579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.601581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.601583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555630422412902:6145]
2025-10-02T09:35:11.601602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.601605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.601606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.601608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.601611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.601613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.601739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.608931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId: src_id|e8631592-8f40d103-82a16d16-853cbae6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.611052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.665192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497985598:10189]
2025-10-02T09:35:11.665356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2673, pipe: [1:7556555630497985598:10189]
2025-10-02T09:35:11.710168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.710441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.710449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.710461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985598:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.710597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.710657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497985598:10189]
2025-10-02T09:35:11.710681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:11.710733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2674 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8631592-8f40d103-82a16d16-853cbae6_0
2025-10-02T09:35:11.710735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.710882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2674 sessionId: src_id|e8631592-8f40d103-82a16d16-853cbae6_0 is DEAD
2025-10-02T09:35:11.711016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:11.711030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Write session will restart in 0.009985s
2025-10-02T09:35:11.711050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Write session: Do CDS request
2025-10-02T09:35:11.711055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:11.722249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.722345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:11.722354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2675
2025-10-02T09:35:11.722448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.722472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:11.722480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:11.722483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:11.722878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2675 sessionId:  describe result for acl check
2025-10-02T09:35:11.722901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:11.722906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:11.722908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:11.722912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555630497985733:9495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:11.723350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555630497985733:9495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:11.725244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555630497985733:9495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:11.725895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:11.727472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:11.727593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:11.727600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:11.727606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:11.727634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:11.727656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555630422413167:6144]
2025-10-02T09:35:11.727686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555630497985733:9495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:11.727694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555630497985733:9495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:11.727696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555630497985733:9495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:11.727700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:11.727989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:11.728142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:11.728166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:11.728337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:11.728364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.728368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.728369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.728369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.728370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.728370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.728371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.728371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.728372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.728372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.728373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.728373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.728376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.728382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.728384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.728386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.728388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.728390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.728392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.728394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.728395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.728398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.728400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.728402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.728407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.728410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.728413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.728416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.728418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.728421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.728423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.728426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.728428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.728431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.728433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.728436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.728438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.728441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.728443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.728445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.728447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.728450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.728452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.728455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.728457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.728460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.728462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.728464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.728481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:11.735793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:11.737445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:11.737457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:11.737458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:11.737460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:11.737463Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2674 [2:7556555630422413167:6144]
2025-10-02T09:35:11.737469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:11.737478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:11.737480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.737481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.737482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.737490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:11.737493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:11.737497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:11.737524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.737529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.737530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.737532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:11.737534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:11.737568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:11.737573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.737579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.737584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.737592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:11.737605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985599:2446], now have 1 active actors on pipe
2025-10-02T09:35:11.737610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985858:9495], now have 1 active actors on pipe
2025-10-02T09:35:11.737615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.737616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.737617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.737624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:11.737634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:11.737637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:11.737639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:11.737640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:11.737643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:11.737644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:11.737659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.737652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2674
2025-10-02T09:35:11.737658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2674
2025-10-02T09:35:11.737663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:11.737665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:11.737679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.737683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.737700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:11.737707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.737709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.737710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:11.737715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.737720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:11.737735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.737850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.737855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.737863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.737929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2675 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0
2025-10-02T09:35:11.738177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8631592-8f40d103-82a16d16-853cbae6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.740950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Write session: try to update token
2025-10-02T09:35:11.740965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.746627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.746638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.746639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.746640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.746644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.746646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.746648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555630422413162:6144]
2025-10-02T09:35:11.746666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.746668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.746669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.746676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.746678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.746680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.746769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.753646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId: src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.755954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.810593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497985871:10189]
2025-10-02T09:35:11.810761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2674, pipe: [1:7556555630497985871:10189]
2025-10-02T09:35:11.854441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.854820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.854829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.854841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985871:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.854993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.855013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.855020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497985871:10189]
2025-10-02T09:35:11.855037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:11.855086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2675 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0
2025-10-02T09:35:11.855230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2675 sessionId: src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0 is DEAD
2025-10-02T09:35:11.855386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:11.855400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Write session will restart in 0.007786s
2025-10-02T09:35:11.855421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Write session: Do CDS request
2025-10-02T09:35:11.855426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:11.864186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.864277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:11.864286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2676
2025-10-02T09:35:11.864405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:11.864427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:11.864433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:11.864436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:11.864710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2676 sessionId:  describe result for acl check
2025-10-02T09:35:11.864734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:11.864739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:11.864740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:11.864743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555630497986014:9493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:11.865106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555630497986014:9493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:11.866460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555630497986014:9493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:11.867672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:11.869481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:11.869600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:11.869607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:11.869613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:11.869630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555630497986014:9493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:11.869639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555630497986014:9493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:11.869643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:11.869640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555630497986014:9493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:11.869644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:11.869665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555630422413429:6135]
2025-10-02T09:35:11.870002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:11.870240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:11.870264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:11.870437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:11.870465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.870469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.870469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.870470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.870470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.870471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.870472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.870472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.870473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.870473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.870474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.870474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.870477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.870483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.870493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.870495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.870497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.870499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.870501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.870503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.870505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.870507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.870509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.870511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.870515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.870519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:11.870522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.870524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:11.870526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.870529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:11.870531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.870534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:11.870537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.870544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:11.870546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.870548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:11.870551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.870557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:11.870559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.870561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:11.870563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.870566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:11.870568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.870571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.870573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.870576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.870582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.870584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.870602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:11.878519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:11.880033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:11.880045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:11.880046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:11.880048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:11.880052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2675 [2:7556555630422413429:6135]
2025-10-02T09:35:11.880059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:11.880069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:11.880074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.880075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.880076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.880085Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:11.880088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:11.880092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:11.880125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.880130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.880131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.880132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:11.880134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:11.880171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:11.880176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.880182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:11.880188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:11.880199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:11.880213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497985872:2446], now have 1 active actors on pipe
2025-10-02T09:35:11.880218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497986131:9493], now have 1 active actors on pipe
2025-10-02T09:35:11.880222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.880223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.880226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.880233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:11.880243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:11.880251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:11.880254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:11.880255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:11.880262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:11.880264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:11.880268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.880270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:11.880277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:11.880264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2675
2025-10-02T09:35:11.880266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2675
2025-10-02T09:35:11.880441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.880450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.880465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53171751-368032b6-9121906f-62ff352_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:11.880470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:11.880472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:11.880473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:11.880478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:11.880483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:11.880490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.880603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.880608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.880616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:11.880669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2676 partition: 0 MaxSeqNo: 36 sessionId: src_id|53171751-368032b6-9121906f-62ff352_0
2025-10-02T09:35:11.880929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd18977a-ce5147ad-47406af0-b6b9ebeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53171751-368032b6-9121906f-62ff352_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:11.883575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Write session: try to update token
2025-10-02T09:35:11.883595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:11.889761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:11.889774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:11.889775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:11.889776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:11.889780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.889782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.889785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555630422413424:6135]
2025-10-02T09:35:11.889804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:11.889809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:11.889810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:11.889811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:11.889812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:11.889814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:11.889938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:11.895692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId: src_id|53171751-368032b6-9121906f-62ff352_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:11.898029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:11.954975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555630497986148:10189]
2025-10-02T09:35:11.955131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2675, pipe: [1:7556555630497986148:10189]
2025-10-02T09:35:11.998167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:11.998373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:11.998382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:11.998394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497986148:10189], now have 1 active actors on pipe
2025-10-02T09:35:11.998512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:11.998549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:11.998558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:11.998566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555630497986148:10189]
2025-10-02T09:35:11.998580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:11.998597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2676 reason: error at write: Disconnected sessionId: src_id|53171751-368032b6-9121906f-62ff352_0
2025-10-02T09:35:11.998732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2676 sessionId: src_id|53171751-368032b6-9121906f-62ff352_0 is DEAD
2025-10-02T09:35:11.998885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:11.998897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Write session will restart in 0.006908s
2025-10-02T09:35:11.998921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Write session: Do CDS request
2025-10-02T09:35:11.998926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.007150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.007267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.007278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2677
2025-10-02T09:35:12.007406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.007432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.007440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.007443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.007866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2677 sessionId:  describe result for acl check
2025-10-02T09:35:12.007892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.007896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.007897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.007900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792953513:9479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.008241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792953513:9479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.010945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792953513:9479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.013743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792953513:9479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.013752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792953513:9479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.013754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792953513:9479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.013757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.015835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.018209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.018303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.018309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.018315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.018340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.018362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717380990:6139]
2025-10-02T09:35:12.018713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.019138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.019160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.019346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.019376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.019380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.019381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.019381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.019382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.019382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.019383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.019383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.019384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.019384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.019385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.019385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.019388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.019394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.019396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.019398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.019400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.019402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.019404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.019406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.019408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.019410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.019412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.019414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.019418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.019422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.019425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.019428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.019430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.019433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.019435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.019437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.019440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.019442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.019445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.019447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.019449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.019452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.019454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.019457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.019460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.019466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.019468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.019472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.019474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.019477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.019479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.019484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.019501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.027322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.028772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.028784Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.028785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.028787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.028790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2676 [2:7556555634717380990:6139]
2025-10-02T09:35:12.028797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.028818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.028820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.028821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.028822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.028831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.028837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.028842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.028872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.028877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.028878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.028880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.028881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.028917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.028921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.028928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.028933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.028944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.028959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555630497986152:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.028964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792953676:9479], now have 1 active actors on pipe
2025-10-02T09:35:12.028967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.028968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.028969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.028977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.028987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.028994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.028997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.028998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.028999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.029000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.029013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.028996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2676
2025-10-02T09:35:12.029018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.029000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2676
2025-10-02T09:35:12.029025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.029037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.029042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.029058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.029064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.029066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.029068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.029072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.029079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.029086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.029198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.029203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.029210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.029274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2677 partition: 0 MaxSeqNo: 36 sessionId: src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0
2025-10-02T09:35:12.029526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53171751-368032b6-9121906f-62ff352_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.032041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Write session: try to update token
2025-10-02T09:35:12.032055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.038463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.038475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.038477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.038477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.038481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.038493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.038496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717380985:6139]
2025-10-02T09:35:12.038515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.038519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.038521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.038522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.038522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.038524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.038640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.044318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId: src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.046673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:12.098866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555634792953720:10189]
2025-10-02T09:35:12.099046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2676, pipe: [1:7556555634792953720:10189]
2025-10-02T09:35:12.148055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:12.148243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.148252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.148263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792953720:10189], now have 1 active actors on pipe
2025-10-02T09:35:12.148371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:12.148404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555634792953720:10189]
2025-10-02T09:35:12.148419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:12.148430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:12.148486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2677 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0
2025-10-02T09:35:12.148634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2677 sessionId: src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0 is DEAD
2025-10-02T09:35:12.148790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:12.148821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Write session will restart in 0.009620s
2025-10-02T09:35:12.148842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Write session: Do CDS request
2025-10-02T09:35:12.148848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.159197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.159329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.159338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2678
2025-10-02T09:35:12.159481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.159507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.159515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.159519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.159879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2678 sessionId:  describe result for acl check
2025-10-02T09:35:12.159904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.159909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.159909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.159912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792953827:9477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.160254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792953827:9477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.162408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792953827:9477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.164859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792953827:9477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.164871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792953827:9477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.164874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792953827:9477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.164878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.165373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.167650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.167778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.167785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.167791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.167820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.167842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717381268:6128]
2025-10-02T09:35:12.168172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.168419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.168441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.168614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.168644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.168648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.168648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.168649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.168650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.168650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.168651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.168651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.168652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.168652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.168653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.168653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.168656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.168662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.168664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.168666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.168668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.168670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.168672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.168674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.168676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.168678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.168680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.168682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.168685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.168689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.168693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.168695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.168698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.168700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.168702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.168705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.168707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.168710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.168712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.168714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.168716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.168719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.168721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.168723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.168725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.168728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.168734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.168736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.168739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.168741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.168743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.168746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.168763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.176278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.177857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.177869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.177870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.177871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.177875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2677 [2:7556555634717381268:6128]
2025-10-02T09:35:12.177882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.177890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.177891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.177893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.177894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.177902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.177909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.177913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.177940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.177944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.177946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.177947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.177949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.177987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.177991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.177997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.178003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.178014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.178027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792953722:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.178032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792953992:9477], now have 1 active actors on pipe
2025-10-02T09:35:12.178036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.178037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.178038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.178045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.178055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.178062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.178066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.178067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.178073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.178074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.178079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.178081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.178092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.178078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2677
2025-10-02T09:35:12.178079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2677
2025-10-02T09:35:12.178107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.178113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.178126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.178133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.178138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.178139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.178144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.178149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.178159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.178271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.178276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.178283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.178341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2678 partition: 0 MaxSeqNo: 36 sessionId: src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0
2025-10-02T09:35:12.178618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262f9d6-12bb1215-fd86182a-7ad65023_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.181169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Write session: try to update token
2025-10-02T09:35:12.181180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.187342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:12.187355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.187359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.187378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:12.187384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:12.187514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:12.187626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:12.187736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:12.187847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:12.187992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:12.188012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:12.193210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId: src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.195527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:12.195605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.195614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.196709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.196720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.196722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.196723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.196728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.196730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.196732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717381263:6128]
2025-10-02T09:35:12.196750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:12.196752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.196754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.196756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.196762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.196764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.196766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.196819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:12.196892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.248359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555634792954007:10189]
2025-10-02T09:35:12.248585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2677, pipe: [1:7556555634792954007:10189]
2025-10-02T09:35:12.304813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:12.310510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.310531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.310650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.310698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.310750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.310799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.310839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.310845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.310908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.310965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.311020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.311079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.311121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.311126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.311174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.311223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.311273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.311351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.311385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.311390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.311450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.311500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.311546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.311595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.311630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.311635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.311684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.311732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.311781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.311831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.311867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.311872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.311922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.311970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.312020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.312124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.312161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.312165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.312215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.312262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.312315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.312367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.312406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.312411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.312459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.312507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.312555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.312601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.312636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.312641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.312686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.312733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.312782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.312849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.312885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.312890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.312936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-02T09:35:12.312987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-02T09:35:12.313041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-02T09:35:12.313090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-02T09:35:12.313144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-02T09:35:12.313149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T09:35:12.313178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954007:10189], now have 1 active actors on pipe
2025-10-02T09:35:12.313339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:12.313348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:12.313351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:12.313369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2678 reason: error at write: Disconnected sessionId: src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0
2025-10-02T09:35:12.313379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555634792954007:10189]
2025-10-02T09:35:12.313503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2678 sessionId: src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0 is DEAD
2025-10-02T09:35:12.313638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:12.313638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:12.313652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Write session will restart in 0.006553s
2025-10-02T09:35:12.313672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Write session: Do CDS request
2025-10-02T09:35:12.313677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.321176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.321249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.321259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2679
2025-10-02T09:35:12.321395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.321423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.321430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.321434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.321781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2679 sessionId:  describe result for acl check
2025-10-02T09:35:12.321804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.321808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.321809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.321812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792954052:9465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.322150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792954052:9465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.324972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792954052:9465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.327598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792954052:9465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.327607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792954052:9465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.327608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792954052:9465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.327612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.331076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.332781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.332891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.332898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.332904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.332930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.332952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717381533:6126]
2025-10-02T09:35:12.333290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.333507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.333529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.333710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.333739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.333743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.333743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.333744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.333744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.333745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.333745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.333746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.333746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.333747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.333747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.333748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.333751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.333757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.333759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.333761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.333763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.333765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.333767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.333769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.333771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.333773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.333775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.333777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.333781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.333784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.333787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.333790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.333792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.333795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.333797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.333800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.333802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.333804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.333806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.333809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.333812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.333814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.333816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.333819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.333821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.333824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.333826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.333832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.333834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.333837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.333839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.333841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.333860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.341436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.343058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.343069Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.343070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.343072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.343075Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2678 [2:7556555634717381533:6126]
2025-10-02T09:35:12.343083Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.343093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.343098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.343099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.343100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.343109Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.343116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.343120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.343147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.343152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.343153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.343154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.343156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.343191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.343195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.343201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.343207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.343216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.343230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954011:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.343236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954195:9465], now have 1 active actors on pipe
2025-10-02T09:35:12.343240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.343243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.343245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.343252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.343263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.343270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.343273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.343274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.343280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.343281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.343287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.343288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.343291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.343288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2678
2025-10-02T09:35:12.343293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2678
2025-10-02T09:35:12.343319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.343324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.343338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.343344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.343347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.343348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.343352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.343360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.343370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.343494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.343499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.343506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.343571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2679 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0
2025-10-02T09:35:12.343836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a8228b-f0e08b55-fb9d9bd0-c6724f28_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.346386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Write session: try to update token
2025-10-02T09:35:12.346400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.352522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.352535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.352536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.352537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.352540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.352544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.352546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717381528:6126]
2025-10-02T09:35:12.352566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.352568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.352570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.352573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.352573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.352577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.352678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.358696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId: src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.361046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:12.413728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555634792954285:10189]
2025-10-02T09:35:12.414108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2678, pipe: [1:7556555634792954285:10189]
2025-10-02T09:35:12.459942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:12.460355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.460369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.460381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954285:10189], now have 1 active actors on pipe
2025-10-02T09:35:12.460523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:12.460546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:12.460548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:12.460553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555634792954285:10189]
2025-10-02T09:35:12.460589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2679 reason: error at write: Disconnected sessionId: src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0
2025-10-02T09:35:12.460715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2679 sessionId: src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0 is DEAD
2025-10-02T09:35:12.460845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:12.460873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:12.460888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Write session will restart in 0.007725s
2025-10-02T09:35:12.460908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Write session: Do CDS request
2025-10-02T09:35:12.460913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.469154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.469260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.469272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2680
2025-10-02T09:35:12.469376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.469400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.469408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.469412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.469864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2680 sessionId:  describe result for acl check
2025-10-02T09:35:12.469889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.469894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.469895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.469899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792954361:9462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.470245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792954361:9462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.473190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792954361:9462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.475971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792954361:9462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.475980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792954361:9462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.475982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792954361:9462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.475985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.477336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.479295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.479388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.479395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.479400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.479424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.479447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717381800:6121]
2025-10-02T09:35:12.479779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.479997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.480020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.480191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.480219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.480223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.480223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.480224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.480225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.480225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.480226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.480226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.480227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.480227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.480227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.480228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.480230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.480236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.480239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.480241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.480243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.480245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.480247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.480249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.480251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.480253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.480255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.480256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.480260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.480264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.480266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.480269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.480271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.480274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.480276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.480278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.480280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.480283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.480285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.480287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.480289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.480292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.480294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.480296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.480298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.480300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.480302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.480305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.480307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.480309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.480311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.480314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.480332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.487784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.489305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.489315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.489316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.489318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.489322Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2679 [2:7556555634717381800:6121]
2025-10-02T09:35:12.489328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.489337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.489339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.489340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.489341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.489350Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.489356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.489362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.489392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.489396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.489397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.489399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.489400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.489433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.489438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.489444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.489449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.489460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.489473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954287:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.489478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954538:9462], now have 1 active actors on pipe
2025-10-02T09:35:12.489482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.489485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.489486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.489493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.489504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.489511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.489514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.489515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.489520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.489505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2679
2025-10-02T09:35:12.489522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.489510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2679
2025-10-02T09:35:12.489527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.489529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.489538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.489545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.489550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.489565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.489571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.489574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.489575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.489580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.489588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.489598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.489726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.489731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.489738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.489802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2680 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0
2025-10-02T09:35:12.490055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b8e32fe-3e6e885e-2665a811-a4d5a36e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.492621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Write session: try to update token
2025-10-02T09:35:12.492636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.498508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.498519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.498520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.498521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.498524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.498527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.498529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717381795:6121]
2025-10-02T09:35:12.498548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.498552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.498554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.498554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.498555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.498556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.498662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.504496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId: src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.506839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:12.560678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555634792954562:10189]
2025-10-02T09:35:12.560863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2679, pipe: [1:7556555634792954562:10189]
2025-10-02T09:35:12.608776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:12.609268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.609278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.609289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954562:10189], now have 1 active actors on pipe
2025-10-02T09:35:12.609397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:12.609436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:12.609478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555634792954562:10189]
2025-10-02T09:35:12.609518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:12.609573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2680 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0
2025-10-02T09:35:12.609705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2680 sessionId: src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0 is DEAD
2025-10-02T09:35:12.609834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:12.609843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Write session will restart in 0.008931s
2025-10-02T09:35:12.609860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Write session: Do CDS request
2025-10-02T09:35:12.609864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.620162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.620234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.620242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2681
2025-10-02T09:35:12.620365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.620385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.620391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.620394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.620683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2681 sessionId:  describe result for acl check
2025-10-02T09:35:12.620705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.620710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.620711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.620714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792954699:9439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.621048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792954699:9439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.623096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792954699:9439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.625390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792954699:9439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.625398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792954699:9439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.625401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792954699:9439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.625405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.625530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.627375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.627485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.627492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.627498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.627527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.627550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717382104:6088]
2025-10-02T09:35:12.628011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.628202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.628225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.628406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.628446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.628451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.628452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.628452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.628453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.628454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.628454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.628455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.628455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.628456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.628456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.628457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.628460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.628465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.628467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.628470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.628472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.628474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.628476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.628478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.628480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.628482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.628484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.628486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.628489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.628493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.628497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.628500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.628502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.628504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.628507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.628509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.628512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.628514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.628516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.628519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.628522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.628524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.628526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.628529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.628531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.628533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.628535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.628538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.628540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.628543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.628545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.628547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.628565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.636008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.637660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.637672Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.637674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.637676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.637679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2680 [2:7556555634717382104:6088]
2025-10-02T09:35:12.637685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.637694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.637699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.637701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.637702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.637710Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.637716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.637721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.637750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.637755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.637756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.637758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.637759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.637797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.637803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.637810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.637818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.637829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.637843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954850:9439], now have 1 active actors on pipe
2025-10-02T09:35:12.637849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954588:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.637853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.637854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.637855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.637862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.637872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.637875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.637877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.637879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.637883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.637885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.637875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2680
2025-10-02T09:35:12.637886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2680
2025-10-02T09:35:12.637898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.637903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.637904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.637915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.637919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.637945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.637952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.637954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.637958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.637964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.637969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.637981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.638106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.638111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.638119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.638183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2681 partition: 0 MaxSeqNo: 36 sessionId: src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0
2025-10-02T09:35:12.638421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc35a59-59303c06-d6c133b4-cf52c5a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.641091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Write session: try to update token
2025-10-02T09:35:12.641101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.647081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.647096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.647097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.647099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.647103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.647106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.647108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717382098:6088]
2025-10-02T09:35:12.647130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.647133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.647135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.647138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.647143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.647146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.647238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.653180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId: src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.655523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:12.709670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555634792954862:10189]
2025-10-02T09:35:12.709829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2680, pipe: [1:7556555634792954862:10189]
2025-10-02T09:35:12.756416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:12.756625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.756635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.756647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954862:10189], now have 1 active actors on pipe
2025-10-02T09:35:12.756764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:12.756795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:12.756824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:12.756836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555634792954862:10189]
2025-10-02T09:35:12.756882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2681 reason: status is not ok: tablet will be restarted right now sessionId: src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0
2025-10-02T09:35:12.757008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2681 sessionId: src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0 is DEAD
2025-10-02T09:35:12.757166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:12.757181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Write session will restart in 0.009801s
2025-10-02T09:35:12.757200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Write session: Do CDS request
2025-10-02T09:35:12.757206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.768117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.768241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.768251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2682
2025-10-02T09:35:12.768369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.768390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.768396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.768399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.768735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2682 sessionId:  describe result for acl check
2025-10-02T09:35:12.768758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.768762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.768764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.768766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792954979:9437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.769157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792954979:9437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.770641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792954979:9437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.773174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792954979:9437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.773183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792954979:9437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.773184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792954979:9437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.773188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.774115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.774421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.774533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.774540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.774545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.774571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.774599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717382373:6086]
2025-10-02T09:35:12.774941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.776325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.776350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.776656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.776694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.776699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.776699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.776700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.776700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.776701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.776702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.776702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.776703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.776704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.776704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.776705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.776708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.776714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.776716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.776718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.776720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.776722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.776724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.776726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.776728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.776731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.776733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.776735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.776740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.776744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.776748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.776751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.776753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.776756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.776758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.776760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.776763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.776765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.776768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.776770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.776772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.776775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.776778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.776781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.776783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.776787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.776789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.776791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.776793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.776796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.776798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.776816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.776836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.784233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.785899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.785912Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.785913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.785915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.785918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2681 [2:7556555634717382373:6086]
2025-10-02T09:35:12.785927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.785939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.785943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.785945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.785946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.785954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.785957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.785961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.785990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.785994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.785995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.785997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.785998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.786033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.786038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.786044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.786052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.786064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.786077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792955127:9437], now have 1 active actors on pipe
2025-10-02T09:35:12.786083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792954863:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.786087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.786091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.786092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.786100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.786109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.786118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.786119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.786120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.786128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.786129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.786132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.786134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.786136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.786125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2681
2025-10-02T09:35:12.786130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2681
2025-10-02T09:35:12.786155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.786161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.786174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.786182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.786186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.786187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.786192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.786200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.786210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.786323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.786328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.786334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.786400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2682 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0
2025-10-02T09:35:12.786660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741220ff-c92a8a5c-2d6a8fb1-126d813d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.789320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Write session: try to update token
2025-10-02T09:35:12.789331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.794965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:12.794980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.794984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.795005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:12.795009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:12.795143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:12.795262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:12.795369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:12.795491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:12.795646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:12.795671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:12.801444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId: src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.803398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.803411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.803413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.803414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.803418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.803421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.803423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717382367:6086]
2025-10-02T09:35:12.803442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.803444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.803444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.803446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.803446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.803448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.803561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.803615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:12.857133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555634792955142:10189]
2025-10-02T09:35:12.857366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2681, pipe: [1:7556555634792955142:10189]
2025-10-02T09:35:12.912899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:12.913249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.913259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.913271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792955142:10189], now have 1 active actors on pipe
2025-10-02T09:35:12.913399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:12.913503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555634792955142:10189]
2025-10-02T09:35:12.913506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:12.913527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:12.913584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2682 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0
2025-10-02T09:35:12.913739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2682 sessionId: src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0 is DEAD
2025-10-02T09:35:12.913868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:12.913877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Write session will restart in 0.008225s
2025-10-02T09:35:12.913896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Write session: Do CDS request
2025-10-02T09:35:12.913901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:12.923162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.923286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:12.923296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2683
2025-10-02T09:35:12.923419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:12.923446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:12.923454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:12.923457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:12.923828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2683 sessionId:  describe result for acl check
2025-10-02T09:35:12.923854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:12.923859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:12.923860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:12.923863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555634792955238:9428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:12.924205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555634792955238:9428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:12.926517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555634792955238:9428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:12.929049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555634792955238:9428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:12.929058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555634792955238:9428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:12.929060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555634792955238:9428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:12.929063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:12.930522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:12.932467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:12.932608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:12.932616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:12.932624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:12.932653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:12.932677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555634717382643:6084]
2025-10-02T09:35:12.933029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:12.933240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:12.933262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:12.933434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:12.933463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.933467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.933467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.933468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.933468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.933469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.933469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.933470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.933470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.933471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.933471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.933472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.933475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.933480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.933483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.933485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.933487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.933489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.933490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.933492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.933494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.933497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.933498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.933500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.933504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.933508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:12.933511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.933513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:12.933515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.933518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:12.933520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.933523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:12.933525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.933528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:12.933530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.933532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:12.933535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.933538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:12.933540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.933543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:12.933545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.933552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:12.933554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.933557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.933559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.933562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.933564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.933570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.933588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:12.941261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:12.942762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:12.942776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:12.942777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:12.942779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:12.942782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2682 [2:7556555634717382643:6084]
2025-10-02T09:35:12.942789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:12.942800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:12.942802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.942803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.942804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.942813Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:12.942817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:12.942822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:12.942852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.942859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.942860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.942862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:12.942863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:12.942901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:12.942906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.942913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:12.942918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:12.942930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:12.942944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792955148:2446], now have 1 active actors on pipe
2025-10-02T09:35:12.942949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555634792955407:9428], now have 1 active actors on pipe
2025-10-02T09:35:12.942952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.942954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.942955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.942961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:12.942972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:12.942980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:12.942983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:12.942983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:12.942984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:12.942984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:12.942998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.943003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:12.943005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:12.942994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2682
2025-10-02T09:35:12.943019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.943024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.942994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2682
2025-10-02T09:35:12.943205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:12.943213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:12.943216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:12.943217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:12.943222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:12.943228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:12.943244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.943388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:12.943397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:12.943411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:12.943480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2683 partition: 0 MaxSeqNo: 36 sessionId: src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0
2025-10-02T09:35:12.943712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9feeec4-1a630132-9a5e8bdc-bcf226f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:12.946259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Write session: try to update token
2025-10-02T09:35:12.946270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:12.952139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:12.952154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:12.952155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:12.952156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:12.952162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.952165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.952166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555634717382638:6084]
2025-10-02T09:35:12.952188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:12.952193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:12.952194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:12.952196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:12.952197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:12.952199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:12.952307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:12.958125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId: src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:12.960437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.013798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087922726:10189]
2025-10-02T09:35:13.013963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2682, pipe: [1:7556555639087922726:10189]
2025-10-02T09:35:13.060726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.060955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.060964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.060975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087922726:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.061133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:13.061193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:13.061196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.061228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087922726:10189]
2025-10-02T09:35:13.061254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2683 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0
2025-10-02T09:35:13.061389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2683 sessionId: src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0 is DEAD
2025-10-02T09:35:13.061512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:13.061521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Write session will restart in 0.005639s
2025-10-02T09:35:13.061536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Write session: Do CDS request
2025-10-02T09:35:13.061541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.068236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.068304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.068313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2684
2025-10-02T09:35:13.068427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.068449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.068455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.068457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.068897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2684 sessionId:  describe result for acl check
2025-10-02T09:35:13.068921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.068927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.068928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.068930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087922764:9416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.069211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087922764:9416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.071090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087922764:9416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.074076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087922764:9416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.074083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087922764:9416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.074086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087922764:9416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.074089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.078704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.080753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.080877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.080884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.080890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.080919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.080942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012350221:6082]
2025-10-02T09:35:13.081279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.081472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.081494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.081668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.081698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.081702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.081703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.081703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.081704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.081704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.081705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.081705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.081706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.081706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.081707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.081707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.081710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.081715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.081718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.081720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.081722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.081724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.081726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.081727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.081729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.081731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.081733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.081735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.081739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.081742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.081745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.081748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.081750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.081753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.081755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.081758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.081760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.081762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.081764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.081767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.081769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.081772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.081774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.081777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.081780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.081784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.081792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.081796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.081803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.081808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.081815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.081819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.081842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:13.089469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:13.091045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:13.091057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:13.091058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:13.091060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:13.091064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2683 [2:7556555639012350221:6082]
2025-10-02T09:35:13.091071Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:13.091080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:13.091085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.091086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.091087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.091096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:13.091099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:13.091103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:13.091131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.091136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.091137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.091138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:13.091140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:13.091176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:13.091181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.091188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.091193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.091204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:13.091218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087922888:9416], now have 1 active actors on pipe
2025-10-02T09:35:13.091223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087922727:2446], now have 1 active actors on pipe
2025-10-02T09:35:13.091226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.091227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.091228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.091235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:13.091245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:13.091252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:13.091254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:13.091255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:13.091256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:13.091257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:13.091270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.091272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:13.091264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2683
2025-10-02T09:35:13.091269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2683
2025-10-02T09:35:13.091286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:13.091292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.091294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.091307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:13.091314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.091316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.091318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:13.091322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.091330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:13.091340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.091465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.091470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.091477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.091549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2684 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0
2025-10-02T09:35:13.091810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfeca8a6-758bdea2-88298e4a-74174fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:13.094508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Write session: try to update token
2025-10-02T09:35:13.094519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:13.100171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:13.100186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.100190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.100215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:13.100218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:13.100349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:13.100474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:13.100586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:13.100704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:13.100887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:13.100910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:13.106035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId: src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:13.108227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.108935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.108950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.108962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:13.108964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.108965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:13.108967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:13.108971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.108974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.108976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012350216:6082]
2025-10-02T09:35:13.109000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:13.109001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:13.109005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.109006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:13.109011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:13.109014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:13.109115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:13.161257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087923007:10189]
2025-10-02T09:35:13.161410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2683, pipe: [1:7556555639087923007:10189]
2025-10-02T09:35:13.218139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.218737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T09:35:13.218761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923007:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.218848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:13.218878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087923007:10189]
2025-10-02T09:35:13.218891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.218923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:13.218929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:13.218983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2684 reason: error at write: Disconnected sessionId: src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0
2025-10-02T09:35:13.219123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2684 sessionId: src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0 is DEAD
2025-10-02T09:35:13.219275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:13.219289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Write session will restart in 0.007500s
2025-10-02T09:35:13.219310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Write session: Do CDS request
2025-10-02T09:35:13.219318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.228175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.228331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.228342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2685
2025-10-02T09:35:13.228459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.228483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.228491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.228494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.228755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2685 sessionId:  describe result for acl check
2025-10-02T09:35:13.228780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.228784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.228786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.228788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087923116:9406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.229123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087923116:9406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.231403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087923116:9406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.233590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087923116:9406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.233598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087923116:9406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.233600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087923116:9406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.233604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.234744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.236385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.236485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.236491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.236497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.236523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.236546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012350495:6075]
2025-10-02T09:35:13.236905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.237142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.237165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.237342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.237370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.237374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.237374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.237375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.237375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.237376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.237376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.237377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.237378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.237378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.237379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.237379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.237382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.237388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.237390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.237392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.237394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.237396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.237398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.237400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.237402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.237404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.237406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.237408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.237411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.237415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.237418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.237421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.237423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.237426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.237428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.237431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.237433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.237436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.237438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.237440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.237444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.237447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.237449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.237452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.237454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.237457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.237459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.237461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.237465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.237467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.237469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.237472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.237488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:13.245139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:13.246583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:13.246595Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:13.246596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:13.246599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:13.246602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2684 [2:7556555639012350495:6075]
2025-10-02T09:35:13.246609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:13.246619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:13.246623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.246625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.246626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.246635Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:13.246637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:13.246645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:13.246673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.246677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.246678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.246680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:13.246682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:13.246716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:13.246721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.246727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.246732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.246743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:13.246757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923020:2446], now have 1 active actors on pipe
2025-10-02T09:35:13.246762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923285:9406], now have 1 active actors on pipe
2025-10-02T09:35:13.246766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.246768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.246769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.246776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:13.246786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:13.246788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:13.246790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:13.246791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:13.246796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:13.246798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:13.246785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2684
2025-10-02T09:35:13.246801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2684
2025-10-02T09:35:13.246811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.246816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:13.246817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:13.246827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.246832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.246922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb2ea61-95351417-2f9e868b-a544bf48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:13.246929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.246931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.246933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:13.246938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.246942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:13.246958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.247054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.247059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.247066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.247132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2685 partition: 0 MaxSeqNo: 36 sessionId: src_id|bb2ea61-95351417-2f9e868b-a544bf48_0
2025-10-02T09:35:13.247413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9d6fdc-e33e439c-777a7c73-e9d8db0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bb2ea61-95351417-2f9e868b-a544bf48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:13.250020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Write session: try to update token
2025-10-02T09:35:13.250034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:13.255813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:13.255825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.255826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:13.255827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:13.255833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.255835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.255837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012350490:6075]
2025-10-02T09:35:13.255857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:13.255857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:13.255859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:13.255860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.255861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:13.255861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:13.255977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:13.261602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId: src_id|bb2ea61-95351417-2f9e868b-a544bf48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:13.263815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.318941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087923303:10189]
2025-10-02T09:35:13.319089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2684, pipe: [1:7556555639087923303:10189]
2025-10-02T09:35:13.364617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.365114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.365124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.365136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923303:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.365254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:13.365281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.365288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087923303:10189]
2025-10-02T09:35:13.365357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:13.365407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2685 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb2ea61-95351417-2f9e868b-a544bf48_0
2025-10-02T09:35:13.365540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2685 sessionId: src_id|bb2ea61-95351417-2f9e868b-a544bf48_0 is DEAD
2025-10-02T09:35:13.365703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:13.365715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Write session will restart in 0.005272s
2025-10-02T09:35:13.365734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Write session: Do CDS request
2025-10-02T09:35:13.365740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.372159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.372295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.372304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2686
2025-10-02T09:35:13.372445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.372472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.372481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.372484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.372744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2686 sessionId:  describe result for acl check
2025-10-02T09:35:13.372764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.372770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.372771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.372774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087923347:9398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.373120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087923347:9398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.375588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087923347:9398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.378368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087923347:9398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.378375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087923347:9398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.378377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087923347:9398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.378380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.381523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.383563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.383672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.383679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.383685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.383712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.383734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012350770:6070]
2025-10-02T09:35:13.384079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.384281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.384303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.384480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.384509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.384513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.384513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.384514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.384515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.384515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.384516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.384516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.384517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.384517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.384518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.384518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.384521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.384527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.384529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.384531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.384533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.384535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.384537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.384539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.384541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.384543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.384545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.384547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.384550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.384554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.384558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.384561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.384563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.384565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.384568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.384570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.384572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.384575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.384577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.384579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.384581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.384584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.384586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.384588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.384590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.384593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.384595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.384598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.384600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.384603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.384605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.384608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.384625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:13.392079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:13.393667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:13.393679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:13.393680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:13.393682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:13.393685Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2685 [2:7556555639012350770:6070]
2025-10-02T09:35:13.393693Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:13.393703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:13.393708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.393710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.393711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.393720Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:13.393727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:13.393731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:13.393765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.393770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.393771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.393773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:13.393774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:13.393812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:13.393817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.393822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.393827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.393839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:13.393855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923304:2446], now have 1 active actors on pipe
2025-10-02T09:35:13.393860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923492:9398], now have 1 active actors on pipe
2025-10-02T09:35:13.393863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.393865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.393866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.393874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:13.393884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:13.393886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:13.393888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:13.393889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:13.393894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:13.393895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:13.393908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.393892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2685
2025-10-02T09:35:13.393913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:13.393924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2685
2025-10-02T09:35:13.393915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:13.393947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.393952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.393965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:13.393972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.393974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.393977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:13.393983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.393991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:13.394001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.394130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.394135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.394142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.394208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2686 partition: 0 MaxSeqNo: 36 sessionId: src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0
2025-10-02T09:35:13.394607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2ea61-95351417-2f9e868b-a544bf48_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:13.397175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Write session: try to update token
2025-10-02T09:35:13.397189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:13.406922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:13.406936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.406941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.406965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:13.406967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:13.407100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:13.407220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:13.407336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:13.407452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:13.407612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:13.407636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:13.409921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId: src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:13.411577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:13.411590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.411592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:13.411593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:13.411597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.411599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.411602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012350765:6070]
2025-10-02T09:35:13.411621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:13.411622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:13.411624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:13.411624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.411626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:13.411626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:13.411735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:13.412453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.465383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087923586:10189]
2025-10-02T09:35:13.465596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2685, pipe: [1:7556555639087923586:10189]
2025-10-02T09:35:13.522562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.523081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.523096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.523110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923586:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.523261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:13.523285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.523298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:13.523301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:13.523328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087923586:10189]
2025-10-02T09:35:13.523353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2686 reason: error at write: Disconnected sessionId: src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0
2025-10-02T09:35:13.523496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2686 sessionId: src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0 is DEAD
2025-10-02T09:35:13.523640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:13.523654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Write session will restart in 0.005116s
2025-10-02T09:35:13.523679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Write session: Do CDS request
2025-10-02T09:35:13.523685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.530141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.530251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.530262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2687
2025-10-02T09:35:13.530416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.530444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.530453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.530456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.530721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2687 sessionId:  describe result for acl check
2025-10-02T09:35:13.530742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.530746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.530747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.530750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087923628:9394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.531099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087923628:9394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.532842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087923628:9394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.535606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087923628:9394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.535615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087923628:9394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.535617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087923628:9394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.535621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.540131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.540421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.540515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.540522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.540527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.540553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.540576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012351044:6068]
2025-10-02T09:35:13.540931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.542213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.542237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.542438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.542466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.542470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.542470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.542471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.542471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.542472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.542472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.542473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.542473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.542474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.542474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.542475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.542478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.542492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.542494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.542496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.542498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.542500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.542502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.542504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.542506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.542508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.542510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.542512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.542516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.542520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.542523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.542526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.542528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.542531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.542534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.542537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.542539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.542542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.542544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.542546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.542548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.542551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.542552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.542555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.542558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.542561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.542565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.542568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.542570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.542572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.542574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.542577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.542593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:13.550071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:13.551561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:13.551573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:13.551574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:13.551577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:13.551581Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2686 [2:7556555639012351044:6068]
2025-10-02T09:35:13.551588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:13.551598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:13.551603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.551605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.551606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.551615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:13.551618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:13.551623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:13.551655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.551660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.551662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.551664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:13.551666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:13.551707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:13.551712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.551718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.551723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.551735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:13.551750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923744:9394], now have 1 active actors on pipe
2025-10-02T09:35:13.551756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923587:2446], now have 1 active actors on pipe
2025-10-02T09:35:13.551760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.551761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.551762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.551770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:13.551782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:13.551782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:13.551784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:13.551785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:13.551793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:13.551794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:13.551808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.551813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:13.551817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:13.551800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2686
2025-10-02T09:35:13.551803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2686
2025-10-02T09:35:13.552014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.552022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.552042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96475665-9cac9158-c97cdf17-ad20a357_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:13.552049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.552051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.552052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:13.552058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.552067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:13.552078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.552199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.552204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.552212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.552273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2687 partition: 0 MaxSeqNo: 36 sessionId: src_id|96475665-9cac9158-c97cdf17-ad20a357_0
2025-10-02T09:35:13.552576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57f5d26-e92cfb8c-f33aa90-d41610bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96475665-9cac9158-c97cdf17-ad20a357_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:13.555118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Write session: try to update token
2025-10-02T09:35:13.555134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:13.560941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:13.560954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.560956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:13.560957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:13.560962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.560964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.560966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012351039:6068]
2025-10-02T09:35:13.560985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:13.560986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:13.560989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:13.560991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:13.560992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.560994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:13.561106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:13.566999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId: src_id|96475665-9cac9158-c97cdf17-ad20a357_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:13.569470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.623573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087923883:10189]
2025-10-02T09:35:13.623732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2686, pipe: [1:7556555639087923883:10189]
2025-10-02T09:35:13.672416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.672831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.672842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.672855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923883:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.673007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:13.673081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.673082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:13.673124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087923883:10189]
2025-10-02T09:35:13.673138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2687 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96475665-9cac9158-c97cdf17-ad20a357_0
2025-10-02T09:35:13.673284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2687 sessionId: src_id|96475665-9cac9158-c97cdf17-ad20a357_0 is DEAD
2025-10-02T09:35:13.673437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:13.673452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Write session will restart in 0.005280s
2025-10-02T09:35:13.673473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Write session: Do CDS request
2025-10-02T09:35:13.673478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.680193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.680296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.680307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2688
2025-10-02T09:35:13.680425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.680446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.680452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.680454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.680820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2688 sessionId:  describe result for acl check
2025-10-02T09:35:13.680843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.680847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.680848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.680851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087923929:9380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.681211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087923929:9380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.683795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087923929:9380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.686603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087923929:9380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.686612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087923929:9380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.686614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087923929:9380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.686618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.690261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.692101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.692197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.692203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.692209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.692235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.692259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012351355:6054]
2025-10-02T09:35:13.692606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.692798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.692829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.693011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.693041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.693045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.693046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.693046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.693047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.693047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.693048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.693048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.693049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.693050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.693050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.693051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.693054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.693060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.693062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.693064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.693066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.693068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.693070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.693072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.693074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.693076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.693078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.693080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.693084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.693088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.693092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.693094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.693097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.693099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.693101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.693104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.693106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.693109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.693111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.693114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.693116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.693118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.693121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.693124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.693126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.693129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.693131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.693133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.693137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.693140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.693142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.693146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.693164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:13.700583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:13.702099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:13.702112Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:13.702113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:13.702115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:13.702119Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2687 [2:7556555639012351355:6054]
2025-10-02T09:35:13.702127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:13.702136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:13.702142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.702143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.702144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.702153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:13.702156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:13.702160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:13.702188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.702193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.702194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.702196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:13.702197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:13.702234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:13.702239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.702246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.702251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.702263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:13.702276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924070:9380], now have 1 active actors on pipe
2025-10-02T09:35:13.702282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087923893:2446], now have 1 active actors on pipe
2025-10-02T09:35:13.702286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.702287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.702288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.702295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:13.702305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:13.702308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:13.702310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:13.702311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:13.702315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:13.702316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:13.702311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2687
2025-10-02T09:35:13.702319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2687
2025-10-02T09:35:13.702330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.702335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:13.702337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:13.702347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.702352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.702376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76871146-20d13827-1e38f165-52f00f66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:13.702383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.702386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.702387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:13.702392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.702398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:13.702407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.702514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.702519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.702526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.702579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2688 partition: 0 MaxSeqNo: 36 sessionId: src_id|76871146-20d13827-1e38f165-52f00f66_0
2025-10-02T09:35:13.702852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96475665-9cac9158-c97cdf17-ad20a357_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76871146-20d13827-1e38f165-52f00f66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:13.705394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Write session: try to update token
2025-10-02T09:35:13.705409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:13.711469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:13.711481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.711482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:13.711483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:13.711487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.711489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.711491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012351350:6054]
2025-10-02T09:35:13.711510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:13.711513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:13.711516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:13.711517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.711518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:13.711518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:13.711626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:13.717474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId: src_id|76871146-20d13827-1e38f165-52f00f66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:13.719856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.773107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087924176:10189]
2025-10-02T09:35:13.773282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2687, pipe: [1:7556555639087924176:10189]
2025-10-02T09:35:13.825970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.826401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.826411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.826424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924176:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.826545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:13.826605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.826612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:13.826652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087924176:10189]
2025-10-02T09:35:13.826669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2688 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76871146-20d13827-1e38f165-52f00f66_0
2025-10-02T09:35:13.826804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2688 sessionId: src_id|76871146-20d13827-1e38f165-52f00f66_0 is DEAD
2025-10-02T09:35:13.826943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:13.826957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Write session will restart in 0.005502s
2025-10-02T09:35:13.826982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Write session: Do CDS request
2025-10-02T09:35:13.826988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.833176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.833227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.833234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2689
2025-10-02T09:35:13.833376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.833398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.833404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.833407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.833682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2689 sessionId:  describe result for acl check
2025-10-02T09:35:13.833706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.833710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.833711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.833714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087924214:9367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.834069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087924214:9367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.835791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087924214:9367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.838833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087924214:9367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.838843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087924214:9367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.838845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087924214:9367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.838848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.843157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.845825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.845963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.845970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.845977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.846005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.846029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012351631:6052]
2025-10-02T09:35:13.846372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.846549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.846573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.846748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.846777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.846781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.846781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.846782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.846782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.846783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.846784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.846784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.846785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.846785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.846786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.846786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.846789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.846795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.846797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.846799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.846801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.846803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.846805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.846807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.846809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.846811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.846813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.846815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.846818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.846822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.846826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.846829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.846831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.846833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.846835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.846838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.846842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.846845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.846847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.846850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.846852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.846855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.846857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.846860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.846862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.846869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.846872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.846874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.846876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.846879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.846881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.846886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.846902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:13.854286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:13.855948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:13.855958Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:13.855959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:13.855961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:13.855964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2688 [2:7556555639012351631:6052]
2025-10-02T09:35:13.855971Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:13.855981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:13.855982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.855984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.855985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.855995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:13.856001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:13.856006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:13.856038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.856043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.856044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.856045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:13.856047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:13.856081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:13.856086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.856092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.856098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.856107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:13.856123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924344:9367], now have 1 active actors on pipe
2025-10-02T09:35:13.856128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924178:2446], now have 1 active actors on pipe
2025-10-02T09:35:13.856131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.856133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.856134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.856142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:13.856152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:13.856154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:13.856156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:13.856157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:13.856161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:13.856162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:13.856176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.856181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:13.856183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:13.856166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2688
2025-10-02T09:35:13.856181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2688
2025-10-02T09:35:13.856195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.856200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.856221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:13.856227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:13.856229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:13.856230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:13.856235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:13.856241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:13.856255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.856373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.856378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.856384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:13.856449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2689 partition: 0 MaxSeqNo: 36 sessionId: src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0
2025-10-02T09:35:13.856713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76871146-20d13827-1e38f165-52f00f66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:13.859249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Write session: try to update token
2025-10-02T09:35:13.859264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:13.865211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:13.865221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:13.865223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:13.865223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:13.865227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.865230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.865234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012351626:6052]
2025-10-02T09:35:13.865254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:13.865256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:13.865258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:13.865260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:13.865260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.865261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:13.865371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:13.871208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId: src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:13.873451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:13.926675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555639087924469:10189]
2025-10-02T09:35:13.926818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2688, pipe: [1:7556555639087924469:10189]
2025-10-02T09:35:13.976318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:13.976699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:13.976707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:13.976719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924469:10189], now have 1 active actors on pipe
2025-10-02T09:35:13.976871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555639087924469:10189]
2025-10-02T09:35:13.976884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:13.976888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:13.976892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:13.976932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:13.976933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2689 reason: error at write: Disconnected sessionId: src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0
2025-10-02T09:35:13.977071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2689 sessionId: src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0 is DEAD
2025-10-02T09:35:13.977232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:13.977246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Write session will restart in 0.007686s
2025-10-02T09:35:13.977269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Write session: Do CDS request
2025-10-02T09:35:13.977274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:13.986201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.986286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:13.986293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2690
2025-10-02T09:35:13.986412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:13.986432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:13.986439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:13.986441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:13.986714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2690 sessionId:  describe result for acl check
2025-10-02T09:35:13.986738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:13.986742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:13.986743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:13.986746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555639087924545:9358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:13.987113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555639087924545:9358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:13.989090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555639087924545:9358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:13.991548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555639087924545:9358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:13.991556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555639087924545:9358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:13.991557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555639087924545:9358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:13.991560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:13.994171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:13.995968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:13.996139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:13.996145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:13.996152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:13.996184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:13.996208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555639012351908:6041]
2025-10-02T09:35:13.996544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:13.996738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:13.996760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:13.996947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:13.996977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.996980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.996981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.996982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.996982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.996983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.996983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.996984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.996984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.996985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.996985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.996986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.996988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.996994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.996997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.996999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.997001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.997003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.997005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.997007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.997008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.997011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.997012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.997014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.997018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.997022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:13.997025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.997027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:13.997030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.997032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:13.997034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.997037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:13.997039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.997042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:13.997044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.997046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:13.997048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.997051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:13.997053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.997056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:13.997059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.997062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:13.997066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.997069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:13.997071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.997073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:13.997075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.997078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:13.997094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.004474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.006059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.006070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.006071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.006073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.006076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2689 [2:7556555639012351908:6041]
2025-10-02T09:35:14.006083Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.006092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.006094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.006096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.006097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.006106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.006112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.006116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.006144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.006149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.006150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.006151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.006153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.006190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.006194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.006201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.006206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.006214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.006228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924684:9358], now have 1 active actors on pipe
2025-10-02T09:35:14.006233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555639087924474:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.006237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.006239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.006240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.006247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.006256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.006260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.006262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.006263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.006265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.006266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.006279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.006267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2689
2025-10-02T09:35:14.006273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2689
2025-10-02T09:35:14.006283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.006286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.006298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.006300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.006319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.006326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.006328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.006329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.006335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.006343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.006356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.006468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.006472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.006487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.006542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2690 partition: 0 MaxSeqNo: 36 sessionId: src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0
2025-10-02T09:35:14.006809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16ea30a-da76ccf4-452698e8-7f8bb1e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.009343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Write session: try to update token
2025-10-02T09:35:14.009357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.015318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.015329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.015330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.015332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.015337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.015339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.015343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555639012351903:6041]
2025-10-02T09:35:14.015362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.015365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.015368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.015368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.015369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.015370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.015481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.021975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId: src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.024320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.077217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382892055:10189]
2025-10-02T09:35:14.077388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2689, pipe: [1:7556555643382892055:10189]
2025-10-02T09:35:14.129709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:14.129929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.129938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.129950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892055:10189], now have 1 active actors on pipe
2025-10-02T09:35:14.130141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:14.130127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382892055:10189]
2025-10-02T09:35:14.130145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:14.130165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:14.130169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:14.130220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2690 reason: error at write: Disconnected sessionId: src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0
2025-10-02T09:35:14.130348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2690 sessionId: src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0 is DEAD
2025-10-02T09:35:14.130494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:14.130508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Write session will restart in 0.007536s
2025-10-02T09:35:14.130533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Write session: Do CDS request
2025-10-02T09:35:14.130539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:14.139170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.139264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:14.139272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2691
2025-10-02T09:35:14.139395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.139415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:14.139421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:14.139423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:14.139685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2691 sessionId:  describe result for acl check
2025-10-02T09:35:14.139710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:14.139715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:14.139716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:14.139719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555643382892136:9355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:14.140063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555643382892136:9355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:14.142151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555643382892136:9355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:14.144542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555643382892136:9355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:14.144552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555643382892136:9355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:14.144554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555643382892136:9355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:14.144557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:14.146408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:14.148180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:14.148325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:14.148332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:14.148339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:14.148369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:14.148392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555643307319495:6036]
2025-10-02T09:35:14.148782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:14.148965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:14.148989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:14.149164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:14.149192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.149196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.149196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.149197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.149197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.149198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.149199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.149199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.149200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.149200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.149201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.149201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.149204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.149210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.149212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.149214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.149217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.149219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.149220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.149222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.149224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.149228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.149230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.149232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.149235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.149239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.149242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.149245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.149247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.149250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.149252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.149255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.149257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.149260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.149262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.149265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.149267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.149270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.149272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.149274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.149277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.149282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.149284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.149287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.149289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.149292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.149295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.149298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.149314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.156637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.158257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.158269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.158270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.158272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.158275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2690 [2:7556555643307319495:6036]
2025-10-02T09:35:14.158281Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.158291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.158296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.158298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.158299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.158308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.158312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.158316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.158344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.158348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.158349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.158351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.158352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.158387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.158392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.158398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.158403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.158411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.158426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892057:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.158431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892291:9355], now have 1 active actors on pipe
2025-10-02T09:35:14.158434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.158436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.158437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.158444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.158451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.158456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.158458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.158459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.158462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.158464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.158457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2690
2025-10-02T09:35:14.158476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.158469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2690
2025-10-02T09:35:14.158490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.158492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.158506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.158511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.158529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1396b76e-94e014fc-4038127c-e148e462_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.158536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.158538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.158539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.158545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.158550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.158558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.158692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.158697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.158704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.158765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2691 partition: 0 MaxSeqNo: 36 sessionId: src_id|1396b76e-94e014fc-4038127c-e148e462_0
2025-10-02T09:35:14.159029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af96d27-d4bf6f96-c0af9988-1eee066c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1396b76e-94e014fc-4038127c-e148e462_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.161616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Write session: try to update token
2025-10-02T09:35:14.161631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.167507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.167520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.167522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.167523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.167529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.167532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.167536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555643307319490:6036]
2025-10-02T09:35:14.167557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.167558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.167561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.167562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.167565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.167567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.167672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.174465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId: src_id|1396b76e-94e014fc-4038127c-e148e462_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.176636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.230306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382892355:10189]
2025-10-02T09:35:14.230502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2690, pipe: [1:7556555643382892355:10189]
2025-10-02T09:35:14.279642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:14.279998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.280011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.280023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892355:10189], now have 1 active actors on pipe
2025-10-02T09:35:14.280180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:14.280209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:14.280211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:14.280214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382892355:10189]
2025-10-02T09:35:14.280248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2691 reason: error at write: Disconnected sessionId: src_id|1396b76e-94e014fc-4038127c-e148e462_0
2025-10-02T09:35:14.280380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2691 sessionId: src_id|1396b76e-94e014fc-4038127c-e148e462_0 is DEAD
2025-10-02T09:35:14.280511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:14.280526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Write session will restart in 0.005798s
2025-10-02T09:35:14.280546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Write session: Do CDS request
2025-10-02T09:35:14.280552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:14.280571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:14.287179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.287287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:14.287293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2692
2025-10-02T09:35:14.287412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.287431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:14.287438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:14.287441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:14.287719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2692 sessionId:  describe result for acl check
2025-10-02T09:35:14.287743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:14.287748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:14.287749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:14.287752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555643382892403:9348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:14.288089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555643382892403:9348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:14.290195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555643382892403:9348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:14.293241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555643382892403:9348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:14.293249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555643382892403:9348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:14.293252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555643382892403:9348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:14.293256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:14.296180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:14.298018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:14.298203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:14.298211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:14.298219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:14.298261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:14.298282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555643307319774:6033]
2025-10-02T09:35:14.298628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:14.298820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:14.298842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:14.299012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:14.299050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.299054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.299055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.299056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.299056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.299057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.299057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.299058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.299058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.299058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.299059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.299060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.299063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.299068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.299070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.299073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.299074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.299077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.299078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.299080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.299083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.299085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.299087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.299088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.299093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.299097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.299101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.299104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.299106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.299109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.299111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.299113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.299116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.299118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.299120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.299123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.299125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.299128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.299130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.299133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.299134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.299138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.299140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.299142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.299144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.299147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.299149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.299151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.299167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.306584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.308023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.308033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.308034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.308037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.308040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2691 [2:7556555643307319774:6033]
2025-10-02T09:35:14.308047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.308056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.308061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.308063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.308064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.308073Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.308076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.308081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.308110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.308114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.308115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.308117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.308119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.308155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.308160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.308166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.308171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.308179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.308191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892356:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.308197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892558:9348], now have 1 active actors on pipe
2025-10-02T09:35:14.308200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.308201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.308203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.308209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.308218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.308221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.308223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.308225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.308227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.308229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.308241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.308246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.308239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2691
2025-10-02T09:35:14.308243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2691
2025-10-02T09:35:14.308254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.308265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.308267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.308283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.308290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.308292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.308293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.308298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.308304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.308312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.308522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.308528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.308536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.308598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2692 partition: 0 MaxSeqNo: 36 sessionId: src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0
2025-10-02T09:35:14.308866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1396b76e-94e014fc-4038127c-e148e462_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.311395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Write session: try to update token
2025-10-02T09:35:14.311408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.317229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.317239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.317240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.317241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.317245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.317249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.317252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555643307319769:6033]
2025-10-02T09:35:14.317272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.317277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.317278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.317279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.317282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.317285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.317391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.323681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId: src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.325824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.380335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382892646:10189]
2025-10-02T09:35:14.380498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2691, pipe: [1:7556555643382892646:10189]
2025-10-02T09:35:14.425763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:14.426074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.426082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.426094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892646:10189], now have 1 active actors on pipe
2025-10-02T09:35:14.426208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:14.426248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:14.426256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382892646:10189]
2025-10-02T09:35:14.426260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:14.426270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:14.426305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2692 reason: error at write: Disconnected sessionId: src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0
2025-10-02T09:35:14.426446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2692 sessionId: src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0 is DEAD
2025-10-02T09:35:14.426610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:14.426625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Write session will restart in 0.006923s
2025-10-02T09:35:14.426651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Write session: Do CDS request
2025-10-02T09:35:14.426656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:14.434144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.434251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:14.434259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2693
2025-10-02T09:35:14.434374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.434394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:14.434400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:14.434402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:14.434709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2693 sessionId:  describe result for acl check
2025-10-02T09:35:14.434734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:14.434740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:14.434741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:14.434743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555643382892746:9342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:14.435088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555643382892746:9342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:14.436755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555643382892746:9342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:14.438499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555643382892746:9342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:14.438507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555643382892746:9342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:14.438509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555643382892746:9342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:14.438512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:14.442080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:14.442373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:14.442464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:14.442471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:14.442476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:14.442510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:14.442532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555643307320056:6020]
2025-10-02T09:35:14.442862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:14.443050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:14.443071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:14.443312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:14.443345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.443349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.443350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.443350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.443351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.443351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.443352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.443352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.443353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.443353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.443354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.443354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.443357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.443363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.443365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.443367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.443369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.443371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.443373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.443375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.443377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.443379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.443380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.443382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.443387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.443391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.443394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.443397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.443399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.443401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.443403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.443406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.443408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.443411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.443413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.443415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.443417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.443420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.443422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.443424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.443427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.443429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.443433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.443436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.443438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.443440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.443442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.443445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.443461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.450856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.452366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.452375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.452376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.452378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.452381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2692 [2:7556555643307320056:6020]
2025-10-02T09:35:14.452388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.452396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.452399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.452401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.452402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.452410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.452412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.452416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.452445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.452450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.452451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.452453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.452454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.452488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.452493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.452499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.452504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.452514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.452528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892647:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.452533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892921:9342], now have 1 active actors on pipe
2025-10-02T09:35:14.452537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.452538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.452539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.452546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.452557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.452559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.452561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.452562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.452566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.452568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.452571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2692
2025-10-02T09:35:14.452580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.452581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2692
2025-10-02T09:35:14.452584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.452596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.452606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.452608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.452622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a50c496f-68073797-85b39e0-93fe6d99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.452629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.452631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.452632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.452637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.452645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.452652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.452777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.452781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.452789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.452850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2693 partition: 0 MaxSeqNo: 36 sessionId: src_id|a50c496f-68073797-85b39e0-93fe6d99_0
2025-10-02T09:35:14.453121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d91769-71582dc4-5f9ef7b-66615fcc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a50c496f-68073797-85b39e0-93fe6d99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.455678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Write session: try to update token
2025-10-02T09:35:14.455691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.461526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.461537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.461538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.461539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.461543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.461546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.461547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555643307320051:6020]
2025-10-02T09:35:14.461566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.461567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.461570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.461572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.461572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.461573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.461680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.468190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId: src_id|a50c496f-68073797-85b39e0-93fe6d99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.470388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.526261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382892935:10189]
2025-10-02T09:35:14.526424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2692, pipe: [1:7556555643382892935:10189]
2025-10-02T09:35:14.570939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:14.571357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.571367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.571380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892935:10189], now have 1 active actors on pipe
2025-10-02T09:35:14.571603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:14.571613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:14.571620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382892935:10189]
2025-10-02T09:35:14.571640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:14.571642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:14.571688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2693 reason: error at write: Disconnected sessionId: src_id|a50c496f-68073797-85b39e0-93fe6d99_0
2025-10-02T09:35:14.571830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2693 sessionId: src_id|a50c496f-68073797-85b39e0-93fe6d99_0 is DEAD
2025-10-02T09:35:14.572011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:14.572024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Write session will restart in 0.006758s
2025-10-02T09:35:14.572045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Write session: Do CDS request
2025-10-02T09:35:14.572051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:14.580247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.580315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:14.580323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2694
2025-10-02T09:35:14.580441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.580462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:14.580469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:14.580471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:14.580754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2694 sessionId:  describe result for acl check
2025-10-02T09:35:14.580782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:14.580787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:14.580788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:14.580791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555643382892995:9337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:14.581141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555643382892995:9337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:14.583087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555643382892995:9337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:14.585546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555643382892995:9337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:14.585554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555643382892995:9337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:14.585556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555643382892995:9337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:14.585559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:14.588834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:14.591137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:14.591281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:14.591288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:14.591295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:14.591325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:14.591348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555643307320337:6030]
2025-10-02T09:35:14.591692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:14.591892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:14.591914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:14.592089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:14.592117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.592121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.592121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.592122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.592122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.592123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.592124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.592124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.592125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.592125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.592126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.592127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.592129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.592135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.592138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.592140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.592141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.592143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.592146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.592147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.592149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.592151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.592153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.592155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.592158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.592162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.592167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.592170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.592174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.592176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.592179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.592181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.592184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.592187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.592189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.592192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.592194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.592196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.592199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.592201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.592204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.592207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.592209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.592211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.592215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.592217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.592219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.592222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.592239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.599728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.601542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.601553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.601554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.601556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.601560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2693 [2:7556555643307320337:6030]
2025-10-02T09:35:14.601567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.601576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.601577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.601579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.601580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.601589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.601592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.601596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.601629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.601635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.601636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.601637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.601639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.601673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.601678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.601685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.601690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.601698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.601713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893128:9337], now have 1 active actors on pipe
2025-10-02T09:35:14.601719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382892936:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.601723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.601724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.601725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.601732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.601743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.601745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.601747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.601748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.601752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.601754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.601767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.601772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.601759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2693
2025-10-02T09:35:14.601777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.601767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2693
2025-10-02T09:35:14.601793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.601794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.601811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9195a487-5d462e68-5a4a755d-a6af2206_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.601818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.601820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.601821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.601826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.601833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.601844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.601955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.601960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.601967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.602031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2694 partition: 0 MaxSeqNo: 36 sessionId: src_id|9195a487-5d462e68-5a4a755d-a6af2206_0
2025-10-02T09:35:14.602312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a50c496f-68073797-85b39e0-93fe6d99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9195a487-5d462e68-5a4a755d-a6af2206_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.604874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Write session: try to update token
2025-10-02T09:35:14.604888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.610874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.610884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.610885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.610886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.610891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.610893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.610895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555643307320332:6030]
2025-10-02T09:35:14.610915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.610917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.610918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.610920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.610922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.610925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.611041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.617998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId: src_id|9195a487-5d462e68-5a4a755d-a6af2206_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.620258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.671651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382893248:10189]
2025-10-02T09:35:14.671773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2693, pipe: [1:7556555643382893248:10189]
2025-10-02T09:35:14.721108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:14.721380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.721389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.721401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893248:10189], now have 1 active actors on pipe
2025-10-02T09:35:14.721517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:14.721528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:14.721541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:14.721552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382893248:10189]
2025-10-02T09:35:14.721569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:14.721599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2694 reason: error at write: Disconnected sessionId: src_id|9195a487-5d462e68-5a4a755d-a6af2206_0
2025-10-02T09:35:14.721740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2694 sessionId: src_id|9195a487-5d462e68-5a4a755d-a6af2206_0 is DEAD
2025-10-02T09:35:14.721886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:14.721900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Write session will restart in 0.006940s
2025-10-02T09:35:14.721924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Write session: Do CDS request
2025-10-02T09:35:14.721930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:14.730179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.730274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:14.730282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2695
2025-10-02T09:35:14.730421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.730444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:14.730450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:14.730452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:14.730735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2695 sessionId:  describe result for acl check
2025-10-02T09:35:14.730759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:14.730764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:14.730765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:14.730769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555643382893328:9318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:14.731131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555643382893328:9318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:14.733500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555643382893328:9318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:14.735937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555643382893328:9318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:14.735946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555643382893328:9318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:14.735948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555643382893328:9318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:14.735951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:14.737945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:14.740047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:14.740162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:14.740168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:14.740174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:14.740204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:14.740226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555643307320654:6009]
2025-10-02T09:35:14.740564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:14.740755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:14.740781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:14.740972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:14.741002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.741006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.741006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.741007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.741007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.741008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.741009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.741009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.741011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.741011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.741015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.741020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.741022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.741024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.741026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.741028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.741030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.741032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.741034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.741036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.741038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.741040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.741044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.741048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.741052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.741055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.741057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.741060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.741062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.741065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.741067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.741070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.741072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.741075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.741077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.741079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.741082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.741085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.741087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.741089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.741091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.741093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.741095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.741098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.741102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.741104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.741122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.748545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.750191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.750202Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.750203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.750205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.750208Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2694 [2:7556555643307320654:6009]
2025-10-02T09:35:14.750214Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.750224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.750229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.750231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.750232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.750240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.750243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.750247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.750277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.750281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.750283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.750284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.750285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.750327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.750333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.750343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.750353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.750368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.750382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893490:9318], now have 1 active actors on pipe
2025-10-02T09:35:14.750388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893249:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.750391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.750392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.750393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.750400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.750408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.750414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.750416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.750417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.750404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2694
2025-10-02T09:35:14.750407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2694
2025-10-02T09:35:14.750418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.750420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.750435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.750436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.750443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.750451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.750453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.750472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.750487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.750492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.750493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.750498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.750504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.750516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.750626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.750630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.750637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.750693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2695 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0
2025-10-02T09:35:14.750942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195a487-5d462e68-5a4a755d-a6af2206_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.753517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Write session: try to update token
2025-10-02T09:35:14.753533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.759438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.759449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.759450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.759450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.759454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.759457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.759459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555643307320649:6009]
2025-10-02T09:35:14.759477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.759479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.759481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.759483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.759483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.759484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.759591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.766562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId: src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.768736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.821647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382893542:10189]
2025-10-02T09:35:14.821772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2694, pipe: [1:7556555643382893542:10189]
2025-10-02T09:35:14.869041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:14.869342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.869351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.869364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893542:10189], now have 1 active actors on pipe
2025-10-02T09:35:14.869507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:14.869559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382893542:10189]
2025-10-02T09:35:14.869565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:14.869581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:14.869614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2695 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0
2025-10-02T09:35:14.869745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2695 sessionId: src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0 is DEAD
2025-10-02T09:35:14.869911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:14.869926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Write session will restart in 0.006243s
2025-10-02T09:35:14.869948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Write session: Do CDS request
2025-10-02T09:35:14.869953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:14.877108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.877216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:14.877224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2696
2025-10-02T09:35:14.877328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:14.877348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:14.877353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:14.877356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:14.877873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2696 sessionId:  describe result for acl check
2025-10-02T09:35:14.877895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:14.877900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:14.877901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:14.877904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555643382893604:9310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:14.878261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555643382893604:9310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:14.880613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555643382893604:9310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:14.882990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555643382893604:9310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:14.882999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555643382893604:9310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:14.883001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555643382893604:9310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:14.883004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:14.886381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:14.888484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:14.888588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:14.888595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:14.888600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:14.888626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:14.888649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555643307320937:6007]
2025-10-02T09:35:14.889007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:14.889200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:14.889223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:14.889477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:14.889511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.889514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.889515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.889516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.889516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.889517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.889518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.889518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.889519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.889519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.889520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.889520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.889523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.889530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.889532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.889534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.889536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.889538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.889540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.889542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.889544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.889546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.889548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.889550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.889553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.889558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:14.889561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.889564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:14.889566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.889569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:14.889571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.889574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:14.889577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.889579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:14.889582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.889584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:14.889587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.889590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:14.889592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.889594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:14.889596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.889599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:14.889605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.889607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.889610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.889612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.889614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.889617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.889637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:14.897243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:14.898689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:14.898700Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:14.898701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:14.898704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:14.898707Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2695 [2:7556555643307320937:6007]
2025-10-02T09:35:14.898714Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:14.898727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:14.898728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.898730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.898731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.898740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:14.898747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:14.898751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:14.898780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.898785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.898786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.898787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:14.898789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:14.898824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:14.898829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.898836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:14.898841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:14.898851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:14.898862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893543:2446], now have 1 active actors on pipe
2025-10-02T09:35:14.898864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893746:9310], now have 1 active actors on pipe
2025-10-02T09:35:14.898868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.898870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.898872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.898879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:14.898890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:14.898893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:14.898895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:14.898896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:14.898899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:14.898901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:14.898913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.898902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2695
2025-10-02T09:35:14.898918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:14.898920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:14.898905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2695
2025-10-02T09:35:14.898928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.898930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.898952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:14.898959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:14.898961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:14.898962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:14.898967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:14.898972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:14.898986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.899089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:14.899093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:14.899101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:14.899153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2696 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0
2025-10-02T09:35:14.899402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5145ee-aaf5d3e6-347090db-6fd72e0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:14.901928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Write session: try to update token
2025-10-02T09:35:14.901942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:14.908361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:14.908374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:14.908375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:14.908376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:14.908381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.908383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.908385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555643307320932:6007]
2025-10-02T09:35:14.908405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:14.908410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:14.908411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:14.908410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:14.908413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:14.908415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:14.908521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:14.914308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId: src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:14.916529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:14.969625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555643382893845:10189]
2025-10-02T09:35:14.969780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2695, pipe: [1:7556555643382893845:10189]
2025-10-02T09:35:15.020316Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.020639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.020648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.020660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555643382893845:10189], now have 1 active actors on pipe
2025-10-02T09:35:15.020810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.020866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.020875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555643382893845:10189]
2025-10-02T09:35:15.020893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:15.020966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2696 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0
2025-10-02T09:35:15.021110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2696 sessionId: src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0 is DEAD
2025-10-02T09:35:15.021261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:15.021271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Write session will restart in 0.009237s
2025-10-02T09:35:15.021290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Write session: Do CDS request
2025-10-02T09:35:15.021295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.031124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.031279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.031287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2697
2025-10-02T09:35:15.031394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.031415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.031421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.031423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.031713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2697 sessionId:  describe result for acl check
2025-10-02T09:35:15.031735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.031740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.031741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.031744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677861224:9304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.032085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677861224:9304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.034270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677861224:9304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.036531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677861224:9304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.036540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677861224:9304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.036542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677861224:9304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.036545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.039330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.039640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.039743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.039751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.039758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.039789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.039812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602288517:6005]
2025-10-02T09:35:15.040151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.042332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.042358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.042650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.042679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.042683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.042683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.042684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.042684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.042685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.042685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.042686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.042686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.042687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.042688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.042688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.042691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.042697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.042699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.042701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.042703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.042705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.042707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.042709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.042711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.042713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.042715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.042717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.042720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.042725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.042728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.042731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.042733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.042736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.042738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.042740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.042743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.042745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.042747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.042750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.042752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.042754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.042758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.042761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.042763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.042765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.042767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.042770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.042772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.042774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.042776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.042778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.042796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.050276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.051926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.051936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.051937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.051938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.051941Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2696 [2:7556555647602288517:6005]
2025-10-02T09:35:15.051948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.051957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.051958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.051960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.051961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.051970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.051977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.051981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.052009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.052014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.052015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.052017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.052018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.052052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.052058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.052064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.052069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.052080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.052094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861142:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.052099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861360:9304], now have 1 active actors on pipe
2025-10-02T09:35:15.052103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.052104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.052105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.052113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.052123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.052126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.052128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.052129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.052133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.052135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.052148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.052156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.052160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.052148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2696
2025-10-02T09:35:15.052177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.052182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.052197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.052204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.052206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.052207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.052198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2696
2025-10-02T09:35:15.052211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.052219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.052230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.052337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.052342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.052349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.052404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2697 partition: 0 MaxSeqNo: 36 sessionId: src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0
2025-10-02T09:35:15.052644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2bb8ff-3ecf1a97-97e94413-6401842b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.055343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Write session: try to update token
2025-10-02T09:35:15.055360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.061215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.061227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.061228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.061229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.061232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.061235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.061237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602288512:6005]
2025-10-02T09:35:15.061257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.061259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.061260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.061263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.061266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.061268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.061371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.067957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId: src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:15.070174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:15.121173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555647677861435:10189]
2025-10-02T09:35:15.121345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2696, pipe: [1:7556555647677861435:10189]
2025-10-02T09:35:15.175767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.176055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.176064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.176076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861435:10189], now have 1 active actors on pipe
2025-10-02T09:35:15.176189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.176209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555647677861435:10189]
2025-10-02T09:35:15.176219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:15.176221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:15.176233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.176266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2697 reason: error at write: Disconnected sessionId: src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0
2025-10-02T09:35:15.176390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2697 sessionId: src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0 is DEAD
2025-10-02T09:35:15.176551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:15.176567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Write session will restart in 0.005643s
2025-10-02T09:35:15.176588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Write session: Do CDS request
2025-10-02T09:35:15.176593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.183157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.183246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.183258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2698
2025-10-02T09:35:15.183365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.183385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.183391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.183394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.183677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2698 sessionId:  describe result for acl check
2025-10-02T09:35:15.183701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.183705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.183707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.183710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677861484:9292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.184062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677861484:9292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.186248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677861484:9292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.188956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677861484:9292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.188965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677861484:9292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.188967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677861484:9292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.188970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.193991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.196369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.196485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.196491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.196498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.196526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.196549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602288816:5991]
2025-10-02T09:35:15.196908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.197151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.197175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.197351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.197381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.197385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.197386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.197386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.197387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.197388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.197388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.197389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.197389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.197390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.197391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.197391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.197394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.197401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.197403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.197405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.197407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.197409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.197411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.197413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.197415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.197417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.197419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.197421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.197424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.197428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.197432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.197435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.197437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.197439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.197442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.197449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.197451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.197454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.197456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.197459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.197461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.197463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.197465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.197471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.197473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.197476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.197478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.197481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.197483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.197486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.197489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.197492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.197508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.204927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.206589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.206598Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.206599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.206601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.206604Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2697 [2:7556555647602288816:5991]
2025-10-02T09:35:15.206612Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.206621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.206623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.206624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.206625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.206634Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.206636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.206640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.206669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.206674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.206675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.206678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.206679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.206717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.206721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.206728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.206733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.206742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.206755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861602:9292], now have 1 active actors on pipe
2025-10-02T09:35:15.206761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861448:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.206765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.206766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.206767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.206775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.206785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.206787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.206792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.206793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.206794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.206795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.206806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.206810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.206811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.206832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2697
2025-10-02T09:35:15.206833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2697
2025-10-02T09:35:15.206885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.206891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.206907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.206914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.206916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.206917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.206922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.206929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.206939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.207066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.207071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.207077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.207133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2698 partition: 0 MaxSeqNo: 36 sessionId: src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0
2025-10-02T09:35:15.207391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|506a937d-1830f6b8-a36de24d-5a3f52fe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.209991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Write session: try to update token
2025-10-02T09:35:15.210006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.215993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.216006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.216007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.216008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.216012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.216014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.216016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602288811:5991]
2025-10-02T09:35:15.216036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.216039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.216040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.216041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.216043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.216048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.216150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.222202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId: src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:15.224466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:15.276312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555647677861741:10189]
2025-10-02T09:35:15.276482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2697, pipe: [1:7556555647677861741:10189]
2025-10-02T09:35:15.330265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.330698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.330706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.330719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861741:10189], now have 1 active actors on pipe
2025-10-02T09:35:15.330854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.330891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555647677861741:10189]
2025-10-02T09:35:15.330899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:15.330915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.331008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2698 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0
2025-10-02T09:35:15.331136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2698 sessionId: src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0 is DEAD
2025-10-02T09:35:15.331277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:15.331292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Write session will restart in 0.008804s
2025-10-02T09:35:15.331318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Write session: Do CDS request
2025-10-02T09:35:15.331324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.341222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.341328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.341338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2699
2025-10-02T09:35:15.341444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.341464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.341471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.341473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.341733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2699 sessionId:  describe result for acl check
2025-10-02T09:35:15.341754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.341758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.341759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.341762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677861835:9285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.342109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677861835:9285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.344339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677861835:9285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.346880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677861835:9285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.346887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677861835:9285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.346889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677861835:9285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.346895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.348739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.349095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.349190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.349197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.349202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.349226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.349251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602289102:5999]
2025-10-02T09:35:15.349595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.351107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.351135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.351416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.351444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.351448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.351449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.351450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.351450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.351451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.351452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.351452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.351453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.351453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.351454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.351454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.351457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.351464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.351466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.351468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.351470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.351472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.351474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.351476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.351478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.351481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.351483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.351485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.351489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.351493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.351496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.351499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.351502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.351505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.351507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.351510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.351512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.351515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.351517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.351520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.351522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.351525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.351527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.351530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.351532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.351535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.351538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.351541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.351543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.351547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.351549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.351552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.351567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.359029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.360649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.360659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.360660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.360662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.360666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2698 [2:7556555647602289102:5999]
2025-10-02T09:35:15.360673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.360683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.360684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.360685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.360686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.360695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.360702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.360706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.360737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.360741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.360742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.360744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.360745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.360785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.360789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.360796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.360813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.360821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.360836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861745:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.360843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.360845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.360846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.360854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.360860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677861994:9285], now have 1 active actors on pipe
2025-10-02T09:35:15.360865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.360867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.360872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.360873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.360874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.360876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.360886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.360891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.360892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.360890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2698
2025-10-02T09:35:15.360914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2698
2025-10-02T09:35:15.360927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.360932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.361018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b813cb35-6283a0d1-75e91106-f06819cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.361025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.361027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.361028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.361033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.361038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.361047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.361165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.361169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.361176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.361231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2699 partition: 0 MaxSeqNo: 36 sessionId: src_id|b813cb35-6283a0d1-75e91106-f06819cb_0
2025-10-02T09:35:15.361498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8bc71-c7952f2c-c0c4a38c-39c3c5fc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b813cb35-6283a0d1-75e91106-f06819cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.364088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Write session: try to update token
2025-10-02T09:35:15.364103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.369808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:15.369822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.369826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.369850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:15.369859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:15.369986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:15.370096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:15.370212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:15.370321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:15.370475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:15.370510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:15.376399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId: src_id|b813cb35-6283a0d1-75e91106-f06819cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:15.378358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.378370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.378371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.378372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.378376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.378378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.378381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602289097:5999]
2025-10-02T09:35:15.378400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.378402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.378405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.378406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.378407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.378408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.378548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.378636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:15.430956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555647677862039:10189]
2025-10-02T09:35:15.431129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2698, pipe: [1:7556555647677862039:10189]
2025-10-02T09:35:15.491940Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.492146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.492155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.492167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862039:10189], now have 1 active actors on pipe
2025-10-02T09:35:15.492308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.492336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:15.492349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:15.492349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555647677862039:10189]
2025-10-02T09:35:15.492363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.492400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2699 reason: error at write: Disconnected sessionId: src_id|b813cb35-6283a0d1-75e91106-f06819cb_0
2025-10-02T09:35:15.492532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2699 sessionId: src_id|b813cb35-6283a0d1-75e91106-f06819cb_0 is DEAD
2025-10-02T09:35:15.492700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:15.492715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Write session will restart in 0.005763s
2025-10-02T09:35:15.492737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Write session: Do CDS request
2025-10-02T09:35:15.492742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.499130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.499246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.499254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2700
2025-10-02T09:35:15.499352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.499372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.499378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.499380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.499678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2700 sessionId:  describe result for acl check
2025-10-02T09:35:15.499703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.499708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.499709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.499712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677862089:9271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.500060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677862089:9271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.501949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677862089:9271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.504325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677862089:9271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.504333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677862089:9271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.504335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677862089:9271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.504338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.506325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.508115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.508207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.508214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.508219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.508244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.508266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602289391:5992]
2025-10-02T09:35:15.508599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.508787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.508821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.508993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.509021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.509025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.509025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.509026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.509026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.509027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.509027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.509028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.509029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.509029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.509030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.509030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.509033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.509039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.509041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.509043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.509045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.509047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.509049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.509051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.509053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.509055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.509057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.509059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.509062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.509066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.509069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.509072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.509074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.509076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.509078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.509081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.509083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.509085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.509087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.509090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.509093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.509095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.509097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.509100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.509102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.509105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.509108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.509110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.509116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.509119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.509121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.509123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.509141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.516557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.518267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.518278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.518279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.518281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.518285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2699 [2:7556555647602289391:5992]
2025-10-02T09:35:15.518291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.518301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.518306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.518308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.518309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.518317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.518320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.518324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.518351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.518356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.518357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.518358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.518361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.518396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.518401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.518407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.518412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.518420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.518434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862267:9271], now have 1 active actors on pipe
2025-10-02T09:35:15.518439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862041:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.518443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.518444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.518445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.518452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.518460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.518468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.518469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.518471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.518472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.518473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.518494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.518495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.518498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.518491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2699
2025-10-02T09:35:15.518499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2699
2025-10-02T09:35:15.518525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.518530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.518546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.518554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.518556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.518557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.518563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.518571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.518578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.518677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.518682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.518689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.518742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2700 partition: 0 MaxSeqNo: 36 sessionId: src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0
2025-10-02T09:35:15.518965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b813cb35-6283a0d1-75e91106-f06819cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.521596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Write session: try to update token
2025-10-02T09:35:15.521613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.527353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:15.527364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.527368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.527389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:15.527393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:15.527526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:15.527652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:15.527770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:15.527890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:15.528043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:15.528064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:15.533920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId: src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:15.535936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.535947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.535949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.535950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.535956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.535959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.535961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602289386:5992]
2025-10-02T09:35:15.535980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.535981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.535983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.535983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.535984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.535986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.536102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.536129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:15.592733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555647677862336:10189]
2025-10-02T09:35:15.592890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2699, pipe: [1:7556555647677862336:10189]
2025-10-02T09:35:15.645635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.645803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.645811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.645823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862336:10189], now have 1 active actors on pipe
2025-10-02T09:35:15.645952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.645952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555647677862336:10189]
2025-10-02T09:35:15.645967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:15.645969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:15.645974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.646011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2700 reason: error at write: Disconnected sessionId: src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0
2025-10-02T09:35:15.646128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2700 sessionId: src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0 is DEAD
2025-10-02T09:35:15.646228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:15.646233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Write session will restart in 0.005117s
2025-10-02T09:35:15.646252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Write session: Do CDS request
2025-10-02T09:35:15.646256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.652140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.652230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.652239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2701
2025-10-02T09:35:15.652337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.652357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.652363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.652365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.652594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2701 sessionId:  describe result for acl check
2025-10-02T09:35:15.652616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.652621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.652622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.652625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677862361:9272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.652962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677862361:9272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.655051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677862361:9272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.657961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677862361:9272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.657969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677862361:9272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.657972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677862361:9272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.657975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.664321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.666879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.666981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.666987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.666993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.667020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.667042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602289708:5983]
2025-10-02T09:35:15.667383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.667583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.667606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.667782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.667812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.667816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.667817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.667817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.667818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.667819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.667819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.667820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.667821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.667821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.667822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.667822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.667825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.667831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.667834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.667836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.667838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.667840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.667842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.667844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.667846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.667848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.667850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.667852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.667856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.667860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.667863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.667865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.667867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.667870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.667872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.667875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.667877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.667880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.667882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.667885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.667887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.667890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.667892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.667895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.667898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.667901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.667903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.667906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.667908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.667910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.667916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.667919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.667936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.675521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.677061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.677072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.677073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.677075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.677078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2700 [2:7556555647602289708:5983]
2025-10-02T09:35:15.677084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.677093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.677095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.677096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.677097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.677105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.677112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.677117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.677145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.677149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.677151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.677153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.677154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.677188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.677193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.677200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.677205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.677215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.677229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862475:9272], now have 1 active actors on pipe
2025-10-02T09:35:15.677234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862338:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.677238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.677240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.677241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.677248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.677257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.677266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.677268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.677269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.677274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.677276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.677282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.677283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.677292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.677284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2700
2025-10-02T09:35:15.677308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2700
2025-10-02T09:35:15.677313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.677319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.677333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.677340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.677342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.677343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.677348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.677357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.677368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.677489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.677493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.677501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.677568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2701 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0
2025-10-02T09:35:15.677838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fd7ef2-b747f714-e878536e-18e6e04b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.680522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Write session: try to update token
2025-10-02T09:35:15.680535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.686936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.686949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.686950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.686952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.686957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.686959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.686961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602289687:5983]
2025-10-02T09:35:15.686982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.686986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.686987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.686987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.686990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.686992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.687588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.693967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId: src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:15.696123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:15.746333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555647677862657:10189]
2025-10-02T09:35:15.746536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2700, pipe: [1:7556555647677862657:10189]
2025-10-02T09:35:15.799083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.799294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.799302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.799314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862657:10189], now have 1 active actors on pipe
2025-10-02T09:35:15.799466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.799474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.799494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:15.799497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:15.799519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555647677862657:10189]
2025-10-02T09:35:15.799529Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:35:15.799543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2701 reason: error at write: Disconnected sessionId: src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0
2025-10-02T09:35:15.799594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2701 sessionId: src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0 is DEAD
2025-10-02T09:35:15.799604Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 27 consumer shared/user session shared/user_1_27_14426282335210093337_v1 is DEAD
2025-10-02T09:35:15.799691Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555583253327816:10182] disconnected; active server actors: 1
2025-10-02T09:35:15.799699Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555583253327816:10182] client user disconnected session shared/user_1_27_14426282335210093337_v1
2025-10-02T09:35:15.799824Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:35:15.799825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:15.799838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Write session will restart in 0.005948s
2025-10-02T09:35:15.799852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Write session: Do CDS request
2025-10-02T09:35:15.799857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.799890Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:15.799894Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:15.799951Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006532s
2025-10-02T09:35:15.807095Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:35:15.807211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.807221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2702
2025-10-02T09:35:15.807228Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:35:15.807229Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 28
2025-10-02T09:35:15.807338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.807342Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 28 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:15.807379Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:15.807443Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 auth for : user
2025-10-02T09:35:15.807569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.807586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.807591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.807594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.807602Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 Handle describe topics response
2025-10-02T09:35:15.807617Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 auth is DEAD
2025-10-02T09:35:15.807619Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:35:15.807771Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:35:15.807776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2702 sessionId:  describe result for acl check
2025-10-02T09:35:15.807791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.807796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.807798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.807801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677862709:9253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.807822Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_28_3412319194304025370_v1
2025-10-02T09:35:15.807864Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555647677862708:9245] connected; active server actors: 1
2025-10-02T09:35:15.807903Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555647677862708:9245] session shared/user_1_28_3412319194304025370_v1
2025-10-02T09:35:15.807911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:35:15.807916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:35:15.807919Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_28_3412319194304025370_v1" (Sender=[1:7556555647677862697:9245], Pipe=[1:7556555647677862708:9245], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:15.807921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:35:15.807927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:35:15.807932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_28_3412319194304025370_v1" (Sender=[1:7556555647677862697:9245], Pipe=[1:7556555647677862708:9245], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:15.807939Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_28_3412319194304025370_v1" sender [1:7556555647677862697:9245] lock partition 0 for ReadingSession "shared/user_1_28_3412319194304025370_v1" (Sender=[1:7556555647677862697:9245], Pipe=[1:7556555647677862708:9245], Partitions=[], ActiveFamilyCount=1) generation 1 step 28
2025-10-02T09:35:15.807943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:35:15.807947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000017s
2025-10-02T09:35:15.808058Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 28 Session: "shared/user_1_28_3412319194304025370_v1" ClientId: "user" PipeClient { RawX1: 7556555647677862708 RawX2: 4503603922347037 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:35:15.808070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:35:15.808127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677862709:9253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.810491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677862709:9253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.813012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677862709:9253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.813021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677862709:9253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.813023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677862709:9253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.813026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.817490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.819894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.820007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.820013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.820019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.820047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.820222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602290005:5962]
2025-10-02T09:35:15.820562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.820752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.820776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.820964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.820995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.820999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.820999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.821000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.821000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.821001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.821001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.821002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.821003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.821003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.821004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.821004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.821007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.821014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.821016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.821018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.821020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.821022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.821024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.821026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.821028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.821030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.821032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.821034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.821038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.821041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.821044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.821047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.821050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.821053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.821055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.821057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.821059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.821062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.821064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.821066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.821070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.821073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.821075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.821077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.821079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.821082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.821084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.821086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.821088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.821091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.821093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.821095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.821111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.828571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.830084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.830095Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.830096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.830099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.830102Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2701 [2:7556555647602290005:5962]
2025-10-02T09:35:15.830109Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.830119Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.830124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.830126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.830127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.830136Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.830139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.830143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.830174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.830178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.830180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.830181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.830183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.830223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.830228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.830237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.830250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.830267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.830282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862716:9243], now have 1 active actors on pipe
2025-10-02T09:35:15.830287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862837:9253], now have 1 active actors on pipe
2025-10-02T09:35:15.830289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862659:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.830292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.830293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.830294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.830301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.830312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.830315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.830316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.830318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.830322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.830323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.830317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2701, pipe: [1:7556555647677862716:9243]
2025-10-02T09:35:15.830338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.830317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2701
2025-10-02T09:35:15.830343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.830331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2701
2025-10-02T09:35:15.830344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.830353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.830356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.830363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_28_3412319194304025370_v1 on pipe: [1:7556555647677862716:9243]
2025-10-02T09:35:15.830374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.830378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.830390Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_28_3412319194304025370_v1:1 with generation 2701
2025-10-02T09:35:15.830399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.830402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.830403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.830411Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_28_3412319194304025370_v1
2025-10-02T09:35:15.830414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.830431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.830437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:35:15.830442Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:35:15.832404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:35:15.832419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:35:15.832422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.832426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.832427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.832432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.832437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.832440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:35:15.832445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:35:15.832455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.832527Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397715829 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:35:15.832540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:35:15.832558Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 sending to client partition status
2025-10-02T09:35:15.832557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.832562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.832570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.832620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2702 partition: 0 MaxSeqNo: 36 sessionId: src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0
2025-10-02T09:35:15.832856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8152e5b-53b600a9-3e7a040f-176f850a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.835564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Write session: try to update token
2025-10-02T09:35:15.835576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.839799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.839809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.839810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.839811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.839816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.839818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.839821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602289999:5962]
2025-10-02T09:35:15.839841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.839844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.839844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.839846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.839847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.839849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.839951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.847970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId: src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:15.850123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:15.953214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:15.953525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.953533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.953684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_28_3412319194304025370_v1
2025-10-02T09:35:15.953697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:15.953719Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_28_3412319194304025370_v1
2025-10-02T09:35:15.953697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555647677862716:9243]
2025-10-02T09:35:15.953711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:15.953721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:15.953723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:15.953770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2702 reason: error at write: Disconnected sessionId: src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0
2025-10-02T09:35:15.953886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2702 sessionId: src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0 is DEAD
2025-10-02T09:35:15.954009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:15.954021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Write session will restart in 0.009094s
2025-10-02T09:35:15.954035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Write session: Do CDS request
2025-10-02T09:35:15.954039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:15.964084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.964210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:15.964220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2703
2025-10-02T09:35:15.964297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:15.964317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:15.964323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:15.964325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:15.964599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2703 sessionId:  describe result for acl check
2025-10-02T09:35:15.964624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:15.964628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:15.964630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:15.964632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555647677863071:9239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:15.964999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555647677863071:9239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:15.966865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555647677863071:9239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:15.969355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555647677863071:9239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:15.969363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555647677863071:9239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:15.969365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555647677863071:9239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:15.969368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:15.971896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:15.973652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:15.973817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:15.973824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:15.973831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:15.973871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:15.973896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555647602290296:5970]
2025-10-02T09:35:15.974243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:15.974439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:15.974462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:15.974660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:15.974692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.974695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.974696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.974696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.974697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.974697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.974698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.974698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.974699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.974699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.974700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.974700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.974703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.974709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.974711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.974713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.974715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.974717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.974719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.974721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.974723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.974725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.974727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.974728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.974732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.974735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:15.974738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.974741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:15.974743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.974746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:15.974749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.974752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:15.974754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.974757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:15.974759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.974761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:15.974763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.974766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:15.974768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.974770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:15.974772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.974775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:15.974777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.974779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.974781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.974784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.974786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.974788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.974807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:15.982287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:15.983868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:15.983878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:15.983879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:15.983881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:15.983884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2702 [2:7556555647602290296:5970]
2025-10-02T09:35:15.983891Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:15.983900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:15.983903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.983905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.983906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.983914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:15.983917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:15.983920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:15.983950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.983955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.983956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.983957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:15.983959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:15.983994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:15.983999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.984005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:15.984010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:15.984022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:15.984034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677863213:9239], now have 1 active actors on pipe
2025-10-02T09:35:15.984040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555647677862979:2446], now have 1 active actors on pipe
2025-10-02T09:35:15.984045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.984046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.984047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.984054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:15.984065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:15.984067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:15.984070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:15.984072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:15.984073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:15.984074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:15.984072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2702
2025-10-02T09:35:15.984087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.984093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:15.984074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2702
2025-10-02T09:35:15.984102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:15.984111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.984114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.984134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:15.984141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:15.984143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:15.984144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:15.984150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:15.984156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:15.984168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.984266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:15.984273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:15.984282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:15.984340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2703 partition: 0 MaxSeqNo: 36 sessionId: src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0
2025-10-02T09:35:15.984589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35797-d31b792a-87e19b8a-4d7cbec8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:15.987310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Write session: try to update token
2025-10-02T09:35:15.987327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:15.993372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:15.993383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:15.993384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:15.993385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:15.993388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.993390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.993392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555647602290291:5970]
2025-10-02T09:35:15.993409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:15.993412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:15.993413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:15.993416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:15.993419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:15.993421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:15.993521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:15.999699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId: src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.001820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.054051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972830574:9243]
2025-10-02T09:35:16.054247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2702, pipe: [1:7556555651972830574:9243]
2025-10-02T09:35:16.107800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:16.108087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.108097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.108109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972830574:9243], now have 1 active actors on pipe
2025-10-02T09:35:16.108251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:16.108296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:16.108307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:16.108313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972830574:9243]
2025-10-02T09:35:16.108328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:16.108354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2703 reason: error at write: Disconnected sessionId: src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0
2025-10-02T09:35:16.108509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2703 sessionId: src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0 is DEAD
2025-10-02T09:35:16.108659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:16.108673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Write session will restart in 0.009028s
2025-10-02T09:35:16.108695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Write session: Do CDS request
2025-10-02T09:35:16.108701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:16.119148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.119237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:16.119244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2704
2025-10-02T09:35:16.119334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.119354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:16.119360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:16.119363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:16.119675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2704 sessionId:  describe result for acl check
2025-10-02T09:35:16.119693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:16.119697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:16.119698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:16.119701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555651972830682:9233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:16.120043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555651972830682:9233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:16.121934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555651972830682:9233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:16.124617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555651972830682:9233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:16.124628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555651972830682:9233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:16.124631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555651972830682:9233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:16.124635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:16.125960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:16.128037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:16.128134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:16.128141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:16.128146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:16.128170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:16.128192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555651897257897:5966]
2025-10-02T09:35:16.128545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:16.128752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:16.128780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:16.128972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:16.129011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.129016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.129016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.129017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.129017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.129018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.129018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.129019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.129019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.129020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.129020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.129021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.129024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.129029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.129031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.129033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.129035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.129038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.129039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.129041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.129043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.129046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.129048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.129050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.129054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.129058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.129061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.129064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.129066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.129068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.129071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.129074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.129077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.129079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.129081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.129084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.129086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.129089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.129091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.129093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.129096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.129102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.129104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.129107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.129109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.129112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.129115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.129118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.129135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:16.136520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:16.138131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:16.138142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:16.138143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:16.138145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:16.138148Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2703 [2:7556555651897257897:5966]
2025-10-02T09:35:16.138155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:16.138164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:16.138165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.138167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.138167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.138176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:16.138179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:16.138187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:16.138223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.138229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.138231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.138233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:16.138235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:16.138273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:16.138279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.138286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.138291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.138299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:16.138311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972830854:9233], now have 1 active actors on pipe
2025-10-02T09:35:16.138314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972830575:2446], now have 1 active actors on pipe
2025-10-02T09:35:16.138317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.138318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.138319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.138327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:16.138334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:16.138341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:16.138341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:16.138343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:16.138344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:16.138347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:16.138359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.138364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:16.138369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:16.138352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2703
2025-10-02T09:35:16.138358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2703
2025-10-02T09:35:16.138382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.138387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.138403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4be0e77a-3340b1a0-11093475-620c88ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:16.138410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.138412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.138413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:16.138417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.138422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:16.138430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.138656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.138663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.138672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.138733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2704 partition: 0 MaxSeqNo: 36 sessionId: src_id|4be0e77a-3340b1a0-11093475-620c88ab_0
2025-10-02T09:35:16.138959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c97821d-44b6d97d-e3797830-c3cdac36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4be0e77a-3340b1a0-11093475-620c88ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:16.141651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Write session: try to update token
2025-10-02T09:35:16.141662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:16.147566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:16.147579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:16.147581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:16.147582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:16.147588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.147590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.147592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555651897257892:5966]
2025-10-02T09:35:16.147610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:16.147615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.147617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:16.147649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:16.147665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:16.147668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:16.147726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:16.153051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId: src_id|4be0e77a-3340b1a0-11093475-620c88ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.155150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.208679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972830889:9243]
2025-10-02T09:35:16.208875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2703, pipe: [1:7556555651972830889:9243]
2025-10-02T09:35:16.262364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:16.262685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.262695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.262707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972830889:9243], now have 1 active actors on pipe
2025-10-02T09:35:16.262823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:16.262877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:16.262893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972830889:9243]
2025-10-02T09:35:16.262908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:16.262945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2704 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4be0e77a-3340b1a0-11093475-620c88ab_0
2025-10-02T09:35:16.263078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2704 sessionId: src_id|4be0e77a-3340b1a0-11093475-620c88ab_0 is DEAD
2025-10-02T09:35:16.263199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:16.263208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Write session will restart in 0.006479s
2025-10-02T09:35:16.263228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Write session: Do CDS request
2025-10-02T09:35:16.263233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:16.271122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.271200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:16.271209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2705
2025-10-02T09:35:16.271287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.271306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:16.271313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:16.271315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:16.271606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2705 sessionId:  describe result for acl check
2025-10-02T09:35:16.271630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:16.271634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:16.271635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:16.271638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555651972830941:9230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:16.271975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555651972830941:9230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:16.274030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555651972830941:9230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:16.276844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555651972830941:9230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:16.276852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555651972830941:9230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:16.276854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555651972830941:9230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:16.276858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:16.281284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:16.283137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:16.283324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:16.283332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:16.283338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:16.283375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:16.283401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555651897258189:5965]
2025-10-02T09:35:16.283751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:16.283953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:16.283980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:16.284171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:16.284203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.284207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.284207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.284208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.284209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.284209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.284211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.284211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.284212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.284212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.284215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.284221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.284223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.284225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.284227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.284229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.284231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.284233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.284235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.284237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.284238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.284240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.284244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.284249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.284252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.284255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.284257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.284260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.284262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.284265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.284267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.284269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.284271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.284274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.284276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.284279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.284281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.284283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.284286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.284288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.284291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.284293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.284296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.284299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.284301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.284303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.284319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:16.291707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:16.293275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:16.293285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:16.293286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:16.293288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:16.293291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2704 [2:7556555651897258189:5965]
2025-10-02T09:35:16.293298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:16.293308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:16.293309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.293311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.293311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.293320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:16.293324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:16.293328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:16.293364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.293369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.293370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.293371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:16.293373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:16.293409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:16.293414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.293420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.293425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.293433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:16.293447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972830890:2446], now have 1 active actors on pipe
2025-10-02T09:35:16.293452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831071:9230], now have 1 active actors on pipe
2025-10-02T09:35:16.293456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.293457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.293458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.293466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:16.293473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:16.293478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:16.293480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:16.293482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:16.293484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:16.293485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:16.293498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.293503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:16.293482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2704
2025-10-02T09:35:16.293488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2704
2025-10-02T09:35:16.293504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:16.293518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.293520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.293538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:16.293545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.293547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.293548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:16.293552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.293558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:16.293569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.293656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.293663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.293670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.293727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2705 partition: 0 MaxSeqNo: 36 sessionId: src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0
2025-10-02T09:35:16.293931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be0e77a-3340b1a0-11093475-620c88ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:16.296523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Write session: try to update token
2025-10-02T09:35:16.296534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:16.303148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:16.303162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:16.303163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:16.303164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:16.303169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.303173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.303175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555651897258184:5965]
2025-10-02T09:35:16.303195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:16.303197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:16.303200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:16.303201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.303202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:16.303202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:16.303308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:16.308405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId: src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.310525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.362780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972831193:9243]
2025-10-02T09:35:16.362957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2704, pipe: [1:7556555651972831193:9243]
2025-10-02T09:35:16.416199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:16.416534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.416544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.416569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831193:9243], now have 1 active actors on pipe
2025-10-02T09:35:16.416711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:16.416738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:16.416753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972831193:9243]
2025-10-02T09:35:16.416770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:16.416834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2705 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0
2025-10-02T09:35:16.416967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2705 sessionId: src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0 is DEAD
2025-10-02T09:35:16.417101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:16.417110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Write session will restart in 0.005258s
2025-10-02T09:35:16.417125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Write session: Do CDS request
2025-10-02T09:35:16.417129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:16.423327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.423350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:16.423359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2706
2025-10-02T09:35:16.423522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.423542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:16.423547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:16.423550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:16.423853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2706 sessionId:  describe result for acl check
2025-10-02T09:35:16.423882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:16.423888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:16.423889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:16.423894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555651972831225:9222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:16.424332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555651972831225:9222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:16.426347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555651972831225:9222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:16.429476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555651972831225:9222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:16.429487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555651972831225:9222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:16.429490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555651972831225:9222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:16.429494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:16.435352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:16.437223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:16.437322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:16.437329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:16.437335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:16.437360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:16.437385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555651897258485:5959]
2025-10-02T09:35:16.437756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:16.437944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:16.437966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:16.438157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:16.438189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.438193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.438193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.438194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.438194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.438195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.438196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.438196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.438197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.438197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.438198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.438199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.438201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.438207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.438209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.438211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.438213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.438215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.438217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.438218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.438220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.438222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.438224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.438226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.438231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.438237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.438243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.438247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.438255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.438263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.438267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.438270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.438272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.438276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.438278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.438281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.438283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.438286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.438291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.438294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.438296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.438298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.438304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.438306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.438309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.438311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.438317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.438320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.438339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:16.445756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:16.447452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:16.447465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:16.447467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:16.447470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:16.447474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2705 [2:7556555651897258485:5959]
2025-10-02T09:35:16.447484Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:16.447498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:16.447502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.447504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.447505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.447514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:16.447519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:16.447524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:16.447558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.447563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.447564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.447566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:16.447567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:16.447602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:16.447608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.447614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.447619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.447630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:16.447644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831354:9222], now have 1 active actors on pipe
2025-10-02T09:35:16.447649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831194:2446], now have 1 active actors on pipe
2025-10-02T09:35:16.447653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.447654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.447655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.447661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:16.447672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:16.447674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:16.447676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:16.447677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:16.447682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:16.447683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:16.447695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.447700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:16.447695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2705
2025-10-02T09:35:16.447699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2705
2025-10-02T09:35:16.447718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:16.447723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.447726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.447743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:16.447750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.447753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.447754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:16.447759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.447766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:16.447773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.447865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.447871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.447880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.447940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2706 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0
2025-10-02T09:35:16.448210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e6426c-62b4caac-29a085ed-245c9bfa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:16.450908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Write session: try to update token
2025-10-02T09:35:16.450923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:16.456787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:16.456798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:16.456799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:16.456813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:16.456816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.456818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.456820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555651897258480:5959]
2025-10-02T09:35:16.456838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:16.456844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.456845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:16.456847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:16.456850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:16.456852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:16.456957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:16.463267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId: src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.465484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.516907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972831496:9243]
2025-10-02T09:35:16.517107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2705, pipe: [1:7556555651972831496:9243]
2025-10-02T09:35:16.577143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:16.577586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.577596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.577610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831496:9243], now have 1 active actors on pipe
2025-10-02T09:35:16.577787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:16.577803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:16.577838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:16.577839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972831496:9243]
2025-10-02T09:35:16.577901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2706 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0
2025-10-02T09:35:16.577998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2706 sessionId: src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0 is DEAD
2025-10-02T09:35:16.578170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:16.578183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Write session will restart in 0.007757s
2025-10-02T09:35:16.578207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Write session: Do CDS request
2025-10-02T09:35:16.578212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:16.587154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.587231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:16.587240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2707
2025-10-02T09:35:16.587356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.587377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:16.587383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:16.587386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:16.587725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2707 sessionId:  describe result for acl check
2025-10-02T09:35:16.587754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:16.587758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:16.587759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:16.587762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555651972831569:9214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:16.588119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555651972831569:9214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:16.590171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555651972831569:9214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:16.592567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555651972831569:9214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:16.592574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555651972831569:9214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:16.592576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555651972831569:9214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:16.592580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:16.596754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:16.598902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:16.599133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:16.599141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:16.599149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:16.599183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:16.599207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555651897258779:5953]
2025-10-02T09:35:16.599572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:16.599980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:16.600007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:16.600203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:16.600237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.600241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.600242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.600243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.600243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.600244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.600244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.600245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.600246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.600246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.600247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.600247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.600250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.600256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.600258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.600260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.600262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.600265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.600267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.600269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.600271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.600274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.600278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.600281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.600286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.600293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.600298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.600303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.600305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.600308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.600310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.600313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.600316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.600319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.600321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.600324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.600326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.600329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.600332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.600334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.600338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.600341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.600343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.600346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.600348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.600351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.600356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.600359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.600376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:16.608061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:16.609809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:16.609819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:16.609820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:16.609822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:16.609826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2706 [2:7556555651897258779:5953]
2025-10-02T09:35:16.609834Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:16.609847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:16.609852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.609854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.609855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.609863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:16.609867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:16.609872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:16.609904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.609909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.609910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.609912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:16.609913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:16.609954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:16.609959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.609965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.609970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.609978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:16.609994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831500:2446], now have 1 active actors on pipe
2025-10-02T09:35:16.609999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831690:9214], now have 1 active actors on pipe
2025-10-02T09:35:16.610003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.610004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.610005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.610015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:16.610028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:16.610028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:16.610030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:16.610031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:16.610041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:16.610043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:16.610041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2706
2025-10-02T09:35:16.610042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2706
2025-10-02T09:35:16.610058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.610063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:16.610065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:16.610081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.610086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.610104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:16.610111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.610113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.610115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:16.610120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.610127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:16.610136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.610227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.610232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.610240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.610285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2707 partition: 0 MaxSeqNo: 36 sessionId: src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0
2025-10-02T09:35:16.610593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5b9c79-d09074a9-965f8964-74084f7b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:16.613130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Write session: try to update token
2025-10-02T09:35:16.613145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:16.619496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:16.619509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:16.619511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:16.619512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:16.619516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.619518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.619520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555651897258774:5953]
2025-10-02T09:35:16.619540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:16.619544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:16.619546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.619547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:16.619548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:16.619549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:16.619661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:16.625638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId: src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.627842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.678184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972831803:9243]
2025-10-02T09:35:16.678361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2706, pipe: [1:7556555651972831803:9243]
2025-10-02T09:35:16.739987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:16.740277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.740286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.740299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831803:9243], now have 1 active actors on pipe
2025-10-02T09:35:16.740450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:16.740480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:16.740484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:16.740525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972831803:9243]
2025-10-02T09:35:16.740555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0
2025-10-02T09:35:16.740701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2707 sessionId: src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0 is DEAD
2025-10-02T09:35:16.740885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:16.740901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Write session will restart in 0.007335s
2025-10-02T09:35:16.740929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Write session: Do CDS request
2025-10-02T09:35:16.740934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:16.749205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.749323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:16.749331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2708
2025-10-02T09:35:16.749456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.749477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:16.749484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:16.749487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:16.749802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2708 sessionId:  describe result for acl check
2025-10-02T09:35:16.749827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:16.749832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:16.749833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:16.749836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555651972831886:9198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:16.750160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555651972831886:9198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:16.752054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555651972831886:9198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:16.754680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555651972831886:9198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:16.754688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555651972831886:9198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:16.754690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555651972831886:9198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:16.754694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:16.760135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:16.760430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:16.760526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:16.760534Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:16.760542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:16.760575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:16.760597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555651897259110:5926]
2025-10-02T09:35:16.760966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:16.762407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:16.762438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:16.762737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:16.762770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.762775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.762776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.762776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.762777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.762777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.762778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.762778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.762779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.762780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.762780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.762781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.762784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.762791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.762793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.762795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.762797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.762800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.762802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.762804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.762806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.762809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.762811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.762813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.762817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.762821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.762825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.762828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.762830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.762833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.762836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.762841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.762846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.762850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.762858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.762863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.762865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.762868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.762870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.762876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.762878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.762881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.762883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.762886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.762889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.762893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.762896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.762900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.762917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:16.770409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:16.772095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:16.772105Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:16.772106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:16.772108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:16.772111Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2707 [2:7556555651897259110:5926]
2025-10-02T09:35:16.772119Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:16.772128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:16.772129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.772131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.772132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.772140Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:16.772144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:16.772149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:16.772178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.772183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.772184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.772186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:16.772187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:16.772225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:16.772230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.772240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.772250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.772258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:16.772273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972831829:2446], now have 1 active actors on pipe
2025-10-02T09:35:16.772275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972832001:9198], now have 1 active actors on pipe
2025-10-02T09:35:16.772279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.772280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.772282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.772289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:16.772296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:16.772303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:16.772305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:16.772306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:16.772306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:16.772307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:16.772321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.772327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:16.772323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2707
2025-10-02T09:35:16.772327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2707
2025-10-02T09:35:16.772343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:16.772423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.772428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.772442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:16.772448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.772452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.772456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:16.772461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.772466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:16.772476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.772597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.772604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.772612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.772674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2708 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0
2025-10-02T09:35:16.772967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cff2ac-5acb446d-67dbdb9f-8cce5077_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:16.775477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Write session: try to update token
2025-10-02T09:35:16.775490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:16.781444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:16.781455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:16.781456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:16.781458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:16.781463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.781465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.781466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555651897259104:5926]
2025-10-02T09:35:16.781485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:16.781490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.781491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:16.781493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:16.781497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:16.781504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:16.781602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:16.787516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId: src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.789691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.840489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972832130:9243]
2025-10-02T09:35:16.840700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2707, pipe: [1:7556555651972832130:9243]
2025-10-02T09:35:16.898407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:16.898667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.898676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.898688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972832130:9243], now have 1 active actors on pipe
2025-10-02T09:35:16.898846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:16.898847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:16.898854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972832130:9243]
2025-10-02T09:35:16.899130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:16.899179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2708 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0
2025-10-02T09:35:16.899318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2708 sessionId: src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0 is DEAD
2025-10-02T09:35:16.899479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:16.899493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Write session will restart in 0.005461s
2025-10-02T09:35:16.899515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Write session: Do CDS request
2025-10-02T09:35:16.899520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:16.906195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.906278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:16.906286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2709
2025-10-02T09:35:16.906406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:16.906426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:16.906431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:16.906434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:16.906703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2709 sessionId:  describe result for acl check
2025-10-02T09:35:16.906725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:16.906731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:16.906733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:16.906735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555651972832179:9192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:16.907070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555651972832179:9192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:16.909094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555651972832179:9192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:16.911580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555651972832179:9192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:16.911589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555651972832179:9192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:16.911591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555651972832179:9192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:16.911594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:16.917267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:16.919190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:16.919297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:16.919303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:16.919310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:16.919341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:16.919362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555651897259405:5924]
2025-10-02T09:35:16.919711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:16.919916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:16.919943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:16.920135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:16.920166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.920170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.920170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.920171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.920172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.920172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.920173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.920173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.920174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.920174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.920175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.920175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.920178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.920184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.920186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.920188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.920190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.920192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.920194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.920196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.920198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.920200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.920202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.920204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.920207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.920211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:16.920214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.920217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:16.920219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.920221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:16.920223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.920226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:16.920228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.920230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:16.920232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.920235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:16.920237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.920239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:16.920241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.920244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:16.920246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.920248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:16.920250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.920253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.920255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.920258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.920261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.920263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.920287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:16.927759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:16.929454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:16.929465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:16.929466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:16.929468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:16.929471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2708 [2:7556555651897259405:5924]
2025-10-02T09:35:16.929479Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:16.929488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:16.929493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.929495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.929497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.929507Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:16.929516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:16.929522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:16.929556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.929561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.929562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.929564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:16.929566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:16.929603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:16.929607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.929614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:16.929619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:16.929630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:16.929644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972832135:2446], now have 1 active actors on pipe
2025-10-02T09:35:16.929651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.929652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.929654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.929661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:16.929669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972832296:9192], now have 1 active actors on pipe
2025-10-02T09:35:16.929676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:16.929675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:16.929677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:16.929679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:16.929682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:16.929684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:16.929698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.929705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:16.929715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:16.929714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2708
2025-10-02T09:35:16.929744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.929750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.929768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:16.929778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:16.929782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:16.929784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:16.929791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:16.929799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:16.929814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.929813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2708
2025-10-02T09:35:16.929910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:16.929916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:16.929926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:16.929996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2709 partition: 0 MaxSeqNo: 36 sessionId: src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0
2025-10-02T09:35:16.930293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1da9250-b6042e29-b629d8a9-1e211caa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:16.932906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Write session: try to update token
2025-10-02T09:35:16.932922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:16.938905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:16.938918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:16.938919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:16.938920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:16.938925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.938927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.938929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555651897259400:5924]
2025-10-02T09:35:16.938949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:16.938954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:16.938955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:16.938956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:16.938957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:16.938958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:16.939078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:16.945786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId: src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:16.948032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:16.999199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555651972832445:9243]
2025-10-02T09:35:16.999356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2708, pipe: [1:7556555651972832445:9243]
2025-10-02T09:35:17.056467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.056692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.056700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.056713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555651972832445:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.056860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.056920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.056921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555651972832445:9243]
2025-10-02T09:35:17.056939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:17.056993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2709 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0
2025-10-02T09:35:17.057143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2709 sessionId: src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0 is DEAD
2025-10-02T09:35:17.057287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:17.057299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Write session will restart in 0.006935s
2025-10-02T09:35:17.057330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Write session: Do CDS request
2025-10-02T09:35:17.057335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.065165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.065245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.065254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2710
2025-10-02T09:35:17.065384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.065405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.065411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.065414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.065709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2710 sessionId:  describe result for acl check
2025-10-02T09:35:17.065734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.065739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.065740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.065743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267799797:9187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.066091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267799797:9187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.068215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267799797:9187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.071013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267799797:9187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.071022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267799797:9187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.071023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267799797:9187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.071026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.075853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.077605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.077749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.077757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.077764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.077796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.077818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192227010:5922]
2025-10-02T09:35:17.078167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.078361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.078384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.078575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.078606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.078609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.078610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.078611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.078611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.078612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.078612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.078613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.078613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.078614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.078614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.078615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.078618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.078623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.078625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.078627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.078629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.078631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.078633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.078635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.078637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.078639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.078641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.078643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.078646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.078650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.078653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.078656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.078658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.078661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.078662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.078665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.078667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.078670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.078672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.078675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.078677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.078680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.078682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.078684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.078686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.078689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.078691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.078694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.078696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.078699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.078701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.078704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.078722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:17.086147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:17.087806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:17.087817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:17.087818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:17.087820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:17.087823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2709 [2:7556555656192227010:5922]
2025-10-02T09:35:17.087830Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:17.087840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:17.087844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.087846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.087847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.087856Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:17.087860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:17.087868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:17.087898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.087903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.087904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.087906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:17.087907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:17.087942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:17.087948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.087955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.087964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.087981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:17.087997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267799742:2446], now have 1 active actors on pipe
2025-10-02T09:35:17.088002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267799922:9187], now have 1 active actors on pipe
2025-10-02T09:35:17.088006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.088007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.088008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.088015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:17.088025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:17.088027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:17.088008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2709
2025-10-02T09:35:17.088036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2709
2025-10-02T09:35:17.088029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:17.088030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:17.088036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:17.088037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:17.088054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.088059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:17.088060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:17.088067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.088072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.088093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48f4a5fb-f959f622-1715ec27-c4379329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:17.088099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.088101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.088102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:17.088106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.088111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:17.088121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.088230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.088238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.088247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.088304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2710 partition: 0 MaxSeqNo: 36 sessionId: src_id|48f4a5fb-f959f622-1715ec27-c4379329_0
2025-10-02T09:35:17.088561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10102bcc-fdccbc24-ecd5e63-e9ea84f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48f4a5fb-f959f622-1715ec27-c4379329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:17.091184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Write session: try to update token
2025-10-02T09:35:17.091203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:17.097267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:17.097278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:17.097280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:17.097280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:17.097284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.097286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.097288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192227005:5922]
2025-10-02T09:35:17.097307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:17.097310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.097312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:17.097313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:17.097315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:17.097316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:17.097415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:17.103309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId: src_id|48f4a5fb-f959f622-1715ec27-c4379329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:17.105567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:17.156898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555656267800048:9243]
2025-10-02T09:35:17.157047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2709, pipe: [1:7556555656267800048:9243]
2025-10-02T09:35:17.211163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.211524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.211533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.211546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800048:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.211690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.211694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.211710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:17.211713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:17.211742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555656267800048:9243]
2025-10-02T09:35:17.211758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2710 reason: error at write: Disconnected sessionId: src_id|48f4a5fb-f959f622-1715ec27-c4379329_0
2025-10-02T09:35:17.211888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2710 sessionId: src_id|48f4a5fb-f959f622-1715ec27-c4379329_0 is DEAD
2025-10-02T09:35:17.212030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:17.212043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Write session will restart in 0.007035s
2025-10-02T09:35:17.212063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Write session: Do CDS request
2025-10-02T09:35:17.212069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.220135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.220256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.220268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2711
2025-10-02T09:35:17.220367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.220387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.220390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.220393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.220688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2711 sessionId:  describe result for acl check
2025-10-02T09:35:17.220715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.220719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.220720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.220723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267800126:9177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.221077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267800126:9177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.222969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267800126:9177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.225083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267800126:9177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.225093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267800126:9177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.225096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267800126:9177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.225099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.228949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.229221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.229408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.229416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.229423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.229454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.229483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192227310:5917]
2025-10-02T09:35:17.229827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.230003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.230026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.230202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.230231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.230235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.230235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.230236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.230236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.230237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.230237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.230238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.230239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.230239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.230240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.230240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.230243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.230249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.230251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.230253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.230255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.230257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.230258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.230260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.230262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.230264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.230266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.230268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.230272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.230276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.230279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.230282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.230284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.230287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.230289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.230292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.230294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.230297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.230299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.230302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.230304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.230307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.230309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.230312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.230314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.230318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.230320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.230323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.230325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.230328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.230331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.230334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.230350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:17.237812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:17.239408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:17.239419Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:17.239421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:17.239423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:17.239426Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2710 [2:7556555656192227310:5917]
2025-10-02T09:35:17.239433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:17.239443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:17.239448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.239450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.239451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.239460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:17.239463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:17.239468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:17.239499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.239504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.239505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.239506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:17.239508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:17.239544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:17.239549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.239556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.239561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.239571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:17.239585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800296:9177], now have 1 active actors on pipe
2025-10-02T09:35:17.239591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800061:2446], now have 1 active actors on pipe
2025-10-02T09:35:17.239594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.239596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.239597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.239604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:17.239615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:17.239618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:17.239621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:17.239622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:17.239625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:17.239627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:17.239641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.239646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:17.239634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2710
2025-10-02T09:35:17.239639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2710
2025-10-02T09:35:17.239661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:17.239665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.239667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.239684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:17.239691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.239694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.239695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:17.239699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.239707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:17.239717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.239842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.239847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.239866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.239937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2711 partition: 0 MaxSeqNo: 36 sessionId: src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0
2025-10-02T09:35:17.240198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f4a5fb-f959f622-1715ec27-c4379329_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:17.242776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Write session: try to update token
2025-10-02T09:35:17.242792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:17.248989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:17.249000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:17.249001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:17.249002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:17.249006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.249008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.249012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192227305:5917]
2025-10-02T09:35:17.249031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:17.249037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.249038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:17.249053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:17.249063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:17.249066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:17.249162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:17.254914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId: src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:17.257148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:17.312002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555656267800370:9243]
2025-10-02T09:35:17.312194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2710, pipe: [1:7556555656267800370:9243]
2025-10-02T09:35:17.360192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.360415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.360425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.360438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800370:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.360560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.360606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:17.360617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.360620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:17.360649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555656267800370:9243]
2025-10-02T09:35:17.360670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2711 reason: error at write: Disconnected sessionId: src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0
2025-10-02T09:35:17.360809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2711 sessionId: src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0 is DEAD
2025-10-02T09:35:17.360969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:17.360983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Write session will restart in 0.009263s
2025-10-02T09:35:17.361010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Write session: Do CDS request
2025-10-02T09:35:17.361015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.371180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.371270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.371280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2712
2025-10-02T09:35:17.371380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.371401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.371405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.371408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.371835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2712 sessionId:  describe result for acl check
2025-10-02T09:35:17.371856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.371860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.371861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.371864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267800462:9171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.372241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267800462:9171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.374711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267800462:9171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.376890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267800462:9171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.376899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267800462:9171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.376902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267800462:9171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.376905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.379435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.381659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.381753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.381759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.381765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.381790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.381813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192227611:5914]
2025-10-02T09:35:17.382169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.382368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.382395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.382579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.382611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.382616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.382617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.382618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.382619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.382620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.382621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.382622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.382623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.382624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.382625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.382625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.382629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.382639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.382642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.382644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.382646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.382648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.382650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.382652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.382654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.382656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.382658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.382660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.382663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.382668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.382674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.382677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.382679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.382682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.382688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.382690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.382693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.382695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.382697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.382700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.382702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.382705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.382706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.382709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.382711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.382714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.382716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.382719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.382721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.382723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.382725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.382728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.382744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:17.390390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:17.392010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:17.392021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:17.392022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:17.392024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:17.392027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2711 [2:7556555656192227611:5914]
2025-10-02T09:35:17.392034Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:17.392044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:17.392050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.392051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.392052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.392061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:17.392065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:17.392069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:17.392105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.392111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.392113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.392115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:17.392116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:17.392155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:17.392160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.392166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.392171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.392183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:17.392198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800371:2446], now have 1 active actors on pipe
2025-10-02T09:35:17.392202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800615:9171], now have 1 active actors on pipe
2025-10-02T09:35:17.392205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.392206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.392207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.392216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:17.392226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:17.392230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:17.392232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:17.392233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:17.392234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:17.392236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:17.392249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.392254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:17.392241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2711
2025-10-02T09:35:17.392247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2711
2025-10-02T09:35:17.392265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:17.392273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.392275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.392290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:17.392297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.392299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.392300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:17.392305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.392310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:17.392319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.392426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.392432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.392442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.392500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2712 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0
2025-10-02T09:35:17.392775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4854bb9b-5415b6cb-45508cd1-1f6e8541_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:17.395348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Write session: try to update token
2025-10-02T09:35:17.395364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:17.401575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:17.401586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:17.401588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:17.401589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:17.401592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.401595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.401597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192227606:5914]
2025-10-02T09:35:17.401617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:17.401623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.401624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:17.401637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:17.401646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:17.401648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:17.401732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:17.407432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId: src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:17.409658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:17.461025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555656267800679:9243]
2025-10-02T09:35:17.461227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2711, pipe: [1:7556555656267800679:9243]
2025-10-02T09:35:17.513620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.514009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.514019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.514031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800679:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.514189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.514193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.514203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:17.514206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:17.514235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555656267800679:9243]
2025-10-02T09:35:17.514252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2712 reason: error at write: Disconnected sessionId: src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0
2025-10-02T09:35:17.514393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2712 sessionId: src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0 is DEAD
2025-10-02T09:35:17.514539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:17.514553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Write session will restart in 0.007451s
2025-10-02T09:35:17.514573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Write session: Do CDS request
2025-10-02T09:35:17.514578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.523203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.523292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.523303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2713
2025-10-02T09:35:17.523414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.523434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.523440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.523443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.523692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2713 sessionId:  describe result for acl check
2025-10-02T09:35:17.523714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.523718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.523719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.523722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267800747:9168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.524076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267800747:9168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.526048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267800747:9168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.528787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267800747:9168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.528798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267800747:9168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.528827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267800747:9168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.528833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.532809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.535061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.535160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.535166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.535172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.535200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.535234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192227911:5912]
2025-10-02T09:35:17.535586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.535792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.535815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.536003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.536116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.536122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.536123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.536123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.536124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.536125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.536125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.536126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.536126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.536127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.536127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.536128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.536131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.536137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.536139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.536141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.536143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.536145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.536147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.536149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.536151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.536153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.536155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.536157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.536161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.536165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.536169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.536172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.536174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.536177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.536180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.536182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.536184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.536187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.536189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.536192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.536194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.536197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.536199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.536201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.536203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.536206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.536208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.536211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.536215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.536219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.536222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.536229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.536249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:17.543669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:17.545098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:17.545109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:17.545110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:17.545112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:17.545115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2712 [2:7556555656192227911:5912]
2025-10-02T09:35:17.545122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:17.545132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:17.545135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.545137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.545138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.545146Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:17.545149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:17.545153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:17.545186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.545192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.545193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.545197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:17.545198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:17.545237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:17.545242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.545249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.545254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.545262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:17.545275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800878:9168], now have 1 active actors on pipe
2025-10-02T09:35:17.545281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800680:2446], now have 1 active actors on pipe
2025-10-02T09:35:17.545285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.545286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.545287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.545295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:17.545305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:17.545308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:17.545310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:17.545311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:17.545315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:17.545316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:17.545328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.545333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:17.545324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2712
2025-10-02T09:35:17.545331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2712
2025-10-02T09:35:17.545349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:17.545364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.545368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.545382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f81fe687-64b2396f-1708bab0-772b2279_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:17.545385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.545387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.545389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:17.545394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.545401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:17.545407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.545510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.545517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.545526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.545590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2713 partition: 0 MaxSeqNo: 36 sessionId: src_id|f81fe687-64b2396f-1708bab0-772b2279_0
2025-10-02T09:35:17.545861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2e29dd-b548542a-fabe9144-9b21deb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f81fe687-64b2396f-1708bab0-772b2279_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:17.548376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Write session: try to update token
2025-10-02T09:35:17.548389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:17.554401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:17.554414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:17.554416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:17.554417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:17.554422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.554425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.554428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192227906:5912]
2025-10-02T09:35:17.554449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:17.554453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:17.554455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.554456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:17.554456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:17.554458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:17.554584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:17.560559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId: src_id|f81fe687-64b2396f-1708bab0-772b2279_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:17.562883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:17.614652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555656267800988:9243]
2025-10-02T09:35:17.614873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2712, pipe: [1:7556555656267800988:9243]
2025-10-02T09:35:17.669969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.670306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.670315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.670328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800988:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.670484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.670520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:17.670521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555656267800988:9243]
2025-10-02T09:35:17.670534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:17.670536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.670581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2713 reason: error at write: Disconnected sessionId: src_id|f81fe687-64b2396f-1708bab0-772b2279_0
2025-10-02T09:35:17.670727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2713 sessionId: src_id|f81fe687-64b2396f-1708bab0-772b2279_0 is DEAD
2025-10-02T09:35:17.670883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:17.670897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Write session will restart in 0.006378s
2025-10-02T09:35:17.670921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Write session: Do CDS request
2025-10-02T09:35:17.670927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.678137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.678228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.678241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2714
2025-10-02T09:35:17.678343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.678369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.678375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.678378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.678707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2714 sessionId:  describe result for acl check
2025-10-02T09:35:17.678731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.678736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.678737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.678740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267801037:9157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.679120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267801037:9157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.681561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267801037:9157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.684350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267801037:9157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.684358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267801037:9157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.684360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267801037:9157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.684364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.689370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.691541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.691735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.691743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.691750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.691785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.691808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192228212:5910]
2025-10-02T09:35:17.692427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.692634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.692665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.692862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.692896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.692901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.692902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.692903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.692904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.692905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.692906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.692907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.692908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.692909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.692910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.692911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.692915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.692922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.692924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.692926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.692928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.692930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.692932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.692934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.692936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.692938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.692940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.692942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.692947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.692951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.692954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.692957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.692959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.692962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.692977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.692980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.692983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.692986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.692988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.692990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.692993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.692995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.692997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.693000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.693002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.693005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.693007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.693010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.693013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.693016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.693019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.693021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.693038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:17.700510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:17.702120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:17.702132Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:17.702133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:17.702136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:17.702139Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2713 [2:7556555656192228212:5910]
2025-10-02T09:35:17.702146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:17.702156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:17.702161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.702162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.702163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.702172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:17.702175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:17.702179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:17.702212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.702216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.702217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.702219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:17.702221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:17.702258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:17.702262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.702269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.702274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.702285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:17.702299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801170:9157], now have 1 active actors on pipe
2025-10-02T09:35:17.702305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267800990:2446], now have 1 active actors on pipe
2025-10-02T09:35:17.702308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.702309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.702310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.702317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:17.702328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:17.702330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:17.702333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:17.702333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:17.702338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:17.702340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:17.702353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.702359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:17.702361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:17.702338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2713
2025-10-02T09:35:17.702342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2713
2025-10-02T09:35:17.702372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.702379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.702410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55ac78d2-c708c8a2-8b891209-c87480c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:17.702417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.702419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.702421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:17.702426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.702431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:17.702444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.702551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.702558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.702567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.702623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2714 partition: 0 MaxSeqNo: 36 sessionId: src_id|55ac78d2-c708c8a2-8b891209-c87480c_0
2025-10-02T09:35:17.702919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81fe687-64b2396f-1708bab0-772b2279_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|55ac78d2-c708c8a2-8b891209-c87480c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:17.705564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Write session: try to update token
2025-10-02T09:35:17.705583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:17.711573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:17.711586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:17.711588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:17.711590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:17.711595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.711598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.711601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192228207:5910]
2025-10-02T09:35:17.711620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:17.711623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:17.711626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:17.711626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.711627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:17.711628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:17.711736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:17.717922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId: src_id|55ac78d2-c708c8a2-8b891209-c87480c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:17.720225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:17.770781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555656267801321:9243]
2025-10-02T09:35:17.770927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2713, pipe: [1:7556555656267801321:9243]
2025-10-02T09:35:17.823976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.824240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.824250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.824262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801321:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.824379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.824388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555656267801321:9243]
2025-10-02T09:35:17.824401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.824414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:17.824468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2714 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55ac78d2-c708c8a2-8b891209-c87480c_0
2025-10-02T09:35:17.824598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2714 sessionId: src_id|55ac78d2-c708c8a2-8b891209-c87480c_0 is DEAD
2025-10-02T09:35:17.824720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:17.824733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Write session will restart in 0.006304s
2025-10-02T09:35:17.824755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Write session: Do CDS request
2025-10-02T09:35:17.824760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.832187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.832299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.832312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2715
2025-10-02T09:35:17.832442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.832463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.832469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.832473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.832769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2715 sessionId:  describe result for acl check
2025-10-02T09:35:17.832794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.832809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.832810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.832814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267801366:9143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.833159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267801366:9143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.835876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267801366:9143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.839114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267801366:9143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.839123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267801366:9143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.839125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267801366:9143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.839128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.843321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.843623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.843717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.843723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.843729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.843757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.843777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192228550:5872]
2025-10-02T09:35:17.844120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.845469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.845507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.845689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.845718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.845723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.845724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.845725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.845725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.845726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.845727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.845728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.845729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.845729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.845730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.845731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.845735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.845744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.845746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.845748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.845750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.845752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.845754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.845756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.845757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.845759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.845761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.845763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.845767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.845771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.845774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.845777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.845780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.845783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.845785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.845787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.845790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.845793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.845794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.845797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.845799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.845802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.845804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.845807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.845811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.845814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.845816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.845818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.845820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.845823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.845825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.845827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.845846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:17.853269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:17.854855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:17.854865Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:17.854866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:17.854868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:17.854871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2714 [2:7556555656192228550:5872]
2025-10-02T09:35:17.854876Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:17.854885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:17.854886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.854887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.854888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.854896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:17.854899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:17.854903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:17.854929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.854935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.854937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.854940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:17.854941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:17.854978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:17.854983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.854990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.854995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.855005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:17.855018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801323:2446], now have 1 active actors on pipe
2025-10-02T09:35:17.855023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801517:9143], now have 1 active actors on pipe
2025-10-02T09:35:17.855027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.855028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.855029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.855037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:17.855047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:17.855055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:17.855055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:17.855058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:17.855059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:17.855060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:17.855074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.855077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:17.855080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:17.855079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2714
2025-10-02T09:35:17.855108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.855114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.855126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:17.855132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:17.855135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:17.855136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:17.855140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:17.855145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:17.855139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2714
2025-10-02T09:35:17.855155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.855240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.855247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.855256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:17.855328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2715 partition: 0 MaxSeqNo: 36 sessionId: src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0
2025-10-02T09:35:17.855582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ac78d2-c708c8a2-8b891209-c87480c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:17.858230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Write session: try to update token
2025-10-02T09:35:17.858246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:17.864126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:17.864139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:17.864140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:17.864140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:17.864144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.864146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.864149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192228545:5872]
2025-10-02T09:35:17.864172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:17.864174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:17.864177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.864178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:17.864179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:17.864183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:17.864280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:17.870224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId: src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:17.872514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:17.924377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555656267801638:9243]
2025-10-02T09:35:17.924504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2714, pipe: [1:7556555656267801638:9243]
2025-10-02T09:35:17.973506Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:17.973782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:17.973791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:17.973803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801638:9243], now have 1 active actors on pipe
2025-10-02T09:35:17.973967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:17.973964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:17.973975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:17.973978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:17.974004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555656267801638:9243]
2025-10-02T09:35:17.974025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2715 reason: error at write: Disconnected sessionId: src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0
2025-10-02T09:35:17.974160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2715 sessionId: src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0 is DEAD
2025-10-02T09:35:17.974308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:17.974323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Write session will restart in 0.008760s
2025-10-02T09:35:17.974348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Write session: Do CDS request
2025-10-02T09:35:17.974353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:17.984200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.984266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:17.984277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2716
2025-10-02T09:35:17.984403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:17.984424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:17.984430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:17.984433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:17.984728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2716 sessionId:  describe result for acl check
2025-10-02T09:35:17.984749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:17.984752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:17.984753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:17.984756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555656267801720:9133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:17.985112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555656267801720:9133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:17.987324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555656267801720:9133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:17.989846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555656267801720:9133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:17.989853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555656267801720:9133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:17.989855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555656267801720:9133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:17.989859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:17.993603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:17.995669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:17.995767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:17.995773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:17.995779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:17.995804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:17.995826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555656192228853:5867]
2025-10-02T09:35:17.996170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:17.996358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:17.996381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:17.996561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:17.996593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.996597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.996597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.996598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.996599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.996599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.996600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.996601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.996601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.996602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.996602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.996603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.996606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.996612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.996614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.996617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.996619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.996621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.996623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.996625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.996627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.996629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.996631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.996633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.996637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.996640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:17.996644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.996646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:17.996650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.996653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:17.996655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.996658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:17.996660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.996663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:17.996665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.996668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:17.996670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.996673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:17.996675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.996678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:17.996680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.996687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:17.996690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.996692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:17.996697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.996700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:17.996702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.996705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:17.996726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.004196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.005915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.005927Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.005928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.005930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.005933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2715 [2:7556555656192228853:5867]
2025-10-02T09:35:18.005941Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.005950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.005955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.005957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.005958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.005967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.005973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.005978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.006013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.006017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.006019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.006021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.006022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.006067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.006073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.006083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.006096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.006113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.006131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801849:9133], now have 1 active actors on pipe
2025-10-02T09:35:18.006139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555656267801643:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.006144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.006148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.006149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.006158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.006171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.006172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.006173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.006175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.006187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.006192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.006171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2715
2025-10-02T09:35:18.006172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2715
2025-10-02T09:35:18.006219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.006226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.006235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.006240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.006252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.006266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b72605bd-7490425c-58da4688-c4eccaa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.006274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.006280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.006281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.006288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.006299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.006317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.006440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.006447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.006457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.006526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2716 partition: 0 MaxSeqNo: 36 sessionId: src_id|b72605bd-7490425c-58da4688-c4eccaa2_0
2025-10-02T09:35:18.006799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc5b74-7504bff7-74c641cd-af64ce18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b72605bd-7490425c-58da4688-c4eccaa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.009372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Write session: try to update token
2025-10-02T09:35:18.009386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.016009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.016022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.016023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.016024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.016028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.016030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.016032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555656192228848:5867]
2025-10-02T09:35:18.016056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.016060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.016062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.016073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.016084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.016087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.016197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.021301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId: src_id|b72605bd-7490425c-58da4688-c4eccaa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.023647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.074397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562769250:9243]
2025-10-02T09:35:18.074617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2715, pipe: [1:7556555660562769250:9243]
2025-10-02T09:35:18.128480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.128856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.128870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.128885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769250:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.129076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562769250:9243]
2025-10-02T09:35:18.129078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.129081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.129101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.129116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.129128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2716 reason: error at write: Disconnected sessionId: src_id|b72605bd-7490425c-58da4688-c4eccaa2_0
2025-10-02T09:35:18.129260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2716 sessionId: src_id|b72605bd-7490425c-58da4688-c4eccaa2_0 is DEAD
2025-10-02T09:35:18.129400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.129414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Write session will restart in 0.007265s
2025-10-02T09:35:18.129434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Write session: Do CDS request
2025-10-02T09:35:18.129439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.138180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.138262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.138273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2717
2025-10-02T09:35:18.138396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.138419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.138425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.138428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.138752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2717 sessionId:  describe result for acl check
2025-10-02T09:35:18.138775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.138779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.138780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.138783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562769310:9127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.139139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562769310:9127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.141509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562769310:9127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.144006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562769310:9127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.144013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562769310:9127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.144015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562769310:9127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.144018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.148911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.150810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.151001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.151009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.151016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.151047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.151070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487196466:5850]
2025-10-02T09:35:18.151414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.151644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.151672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.151857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.151886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.151890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.151891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.151891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.151892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.151892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.151893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.151893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.151894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.151894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.151895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.151896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.151898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.151905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.151907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.151909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.151911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.151913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.151915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.151917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.151919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.151921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.151923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.151925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.151929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.151933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.151936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.151939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.151941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.151944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.151946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.151949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.151951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.151954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.151956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.151958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.151961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.151963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.151967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.151971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.151973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.151976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.151978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.151980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.151982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.151985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.151987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.151989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.152005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.159479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.160993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.161004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.161005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.161008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.161011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2716 [2:7556555660487196466:5850]
2025-10-02T09:35:18.161018Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.161028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.161029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.161030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.161031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.161040Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.161043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.161047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.161077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.161081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.161082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.161084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.161086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.161128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.161133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.161142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.161153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.161170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.161187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769252:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.161194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769435:9127], now have 1 active actors on pipe
2025-10-02T09:35:18.161199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.161202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.161203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.161211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.161222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.161225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.161227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.161229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.161237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.161224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2716
2025-10-02T09:35:18.161240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.161230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2716
2025-10-02T09:35:18.161256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.161262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.161263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.161275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.161281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.161310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.161320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.161322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.161324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.161333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.161343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.161359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.161449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.161456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.161465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.161526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2717 partition: 0 MaxSeqNo: 36 sessionId: src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0
2025-10-02T09:35:18.161799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b72605bd-7490425c-58da4688-c4eccaa2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.164288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Write session: try to update token
2025-10-02T09:35:18.164302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.170299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.170311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.170312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.170313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.170318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.170320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.170322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487196461:5850]
2025-10-02T09:35:18.170345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.170350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.170351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.170360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.170373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.170376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.170467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.176459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId: src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.178449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.229025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562769576:9243]
2025-10-02T09:35:18.229286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2716, pipe: [1:7556555660562769576:9243]
2025-10-02T09:35:18.281524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.281841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.281851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.281863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769576:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.282032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562769576:9243]
2025-10-02T09:35:18.282045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.282065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.282055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.282057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.282098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2717 reason: error at write: Disconnected sessionId: src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0
2025-10-02T09:35:18.282228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2717 sessionId: src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0 is DEAD
2025-10-02T09:35:18.282358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.282371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Write session will restart in 0.005649s
2025-10-02T09:35:18.282395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Write session: Do CDS request
2025-10-02T09:35:18.282400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.289106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.289182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.289191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2718
2025-10-02T09:35:18.289292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.289311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.289314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.289316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.289618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2718 sessionId:  describe result for acl check
2025-10-02T09:35:18.289642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.289647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.289648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.289651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562769609:9120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.289992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562769609:9120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.292050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562769609:9120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.294803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562769609:9120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.294812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562769609:9120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.294814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562769609:9120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.294818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.304111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.304235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.304350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.304359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.304392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.304427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.304453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487196780:5859]
2025-10-02T09:35:18.304855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.305064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.305091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.305275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.305305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.305309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.305309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.305310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.305310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.305311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.305311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.305312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.305312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.305313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.305313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.305314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.305317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.305323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.305325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.305327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.305329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.305331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.305333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.305335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.305337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.305339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.305341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.305343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.305347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.305351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.305354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.305357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.305359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.305362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.305364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.305367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.305369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.305372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.305374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.305377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.305379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.305382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.305387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.305390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.305393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.305395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.305402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.305404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.305407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.305413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.305416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.305418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.305436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.312976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.314742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.314751Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.314752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.314755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.314758Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2717 [2:7556555660487196780:5859]
2025-10-02T09:35:18.314765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.314774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.314775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.314777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.314778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.314787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.314790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.314794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.314826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.314831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.314832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.314833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.314835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.314880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.314886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.314895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.314906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.314923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.314938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.314943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.314946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.314954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.314964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.314965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769577:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.314969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769720:9120], now have 1 active actors on pipe
2025-10-02T09:35:18.314971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.314973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.314975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.314985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.314991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.315008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.315014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.315016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.314997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2717
2025-10-02T09:35:18.314998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2717
2025-10-02T09:35:18.315033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.315039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.315062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99fd3e67-c128f085-74295a30-7f07ec18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.315071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.315075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.315077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.315083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.315095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.315112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.315226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.315233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.315243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.315301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2718 partition: 0 MaxSeqNo: 36 sessionId: src_id|99fd3e67-c128f085-74295a30-7f07ec18_0
2025-10-02T09:35:18.315560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492f3f9-7fd87482-2f6d7aaa-c0955d9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99fd3e67-c128f085-74295a30-7f07ec18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.318131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Write session: try to update token
2025-10-02T09:35:18.318147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.324028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.324040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.324041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.324042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.324045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.324047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.324049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487196771:5859]
2025-10-02T09:35:18.324075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.324078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.324080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.324091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.324104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.324107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.324198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.330068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId: src_id|99fd3e67-c128f085-74295a30-7f07ec18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.332071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.382109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562769895:9243]
2025-10-02T09:35:18.382341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2717, pipe: [1:7556555660562769895:9243]
2025-10-02T09:35:18.433644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.433861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.433870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.433882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769895:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.434078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.434065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.434069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.434072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.434109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562769895:9243]
2025-10-02T09:35:18.434121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2718 reason: error at write: Disconnected sessionId: src_id|99fd3e67-c128f085-74295a30-7f07ec18_0
2025-10-02T09:35:18.434256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2718 sessionId: src_id|99fd3e67-c128f085-74295a30-7f07ec18_0 is DEAD
2025-10-02T09:35:18.434481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.434494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Write session will restart in 0.009317s
2025-10-02T09:35:18.434515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Write session: Do CDS request
2025-10-02T09:35:18.434521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.439959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.441020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.441146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.441153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.441159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.441191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.441230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487196838:5855]
2025-10-02T09:35:18.441597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.441805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.441838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.442055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.442088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.442092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.442093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.442093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.442094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.442095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.442096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.442096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.442097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.442098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.442099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.442099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.442103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.442111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.442113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.442116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.442118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.442120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.442123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.442125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.442127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.442129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.442131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.442133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.442138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.442142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.442145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.442149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.442151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.442154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.442156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.442158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.442161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.442164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.442166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.442169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.442171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.442176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.442178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.442181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.442186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.442189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.442191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.442194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.442198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.442201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.442203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.442206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.442228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.445121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.445217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.445224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2719
2025-10-02T09:35:18.445315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.445332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.445337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.445340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.445605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2719 sessionId:  describe result for acl check
2025-10-02T09:35:18.445622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.445627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.445629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.445632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562769921:9106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.445971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562769921:9106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.447496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562769921:9106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.449140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562769921:9106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.449148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562769921:9106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.449150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562769921:9106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.449154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.449759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.451239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.451249Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.451251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.451253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.451257Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2718 [2:7556555660487196838:5855]
2025-10-02T09:35:18.451265Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.451276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.451281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.451283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.451284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.451293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.451299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.451304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.451338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.451343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.451345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.451346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.451348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.451394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.451401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.451410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.451419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.451436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.451453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769955:9106], now have 1 active actors on pipe
2025-10-02T09:35:18.451460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769896:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.451463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.451467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.451469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.451477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.451480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2718
2025-10-02T09:35:18.451487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2718
2025-10-02T09:35:18.451492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.451491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.451494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.451495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.451506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.451509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.451536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.451543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.451553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.451560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.451571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.451584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4460460c-9de99585-20bd9366-cb115d5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.451593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.451599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.451601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.451608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.451619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.451638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.451744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.451751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.451761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.451822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2719 partition: 0 MaxSeqNo: 36 sessionId: src_id|4460460c-9de99585-20bd9366-cb115d5b_0
2025-10-02T09:35:18.452047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fd3e67-c128f085-74295a30-7f07ec18_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4460460c-9de99585-20bd9366-cb115d5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.454545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Write session: try to update token
2025-10-02T09:35:18.454559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.460645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.460657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.460658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.460659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.460665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.460667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.460669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487196833:5855]
2025-10-02T09:35:18.460694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.460698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.460700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.460710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.460721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.460724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.460839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.466869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId: src_id|4460460c-9de99585-20bd9366-cb115d5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.469031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.534184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562769963:9243]
2025-10-02T09:35:18.534409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2718, pipe: [1:7556555660562769963:9243]
2025-10-02T09:35:18.570673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.570975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.570985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.570996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769963:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.571216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.571199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.571202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.571204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.571240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562769963:9243]
2025-10-02T09:35:18.571255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2719 reason: error at write: Disconnected sessionId: src_id|4460460c-9de99585-20bd9366-cb115d5b_0
2025-10-02T09:35:18.571393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2719 sessionId: src_id|4460460c-9de99585-20bd9366-cb115d5b_0 is DEAD
2025-10-02T09:35:18.571559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.571571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Write session will restart in 0.008981s
2025-10-02T09:35:18.571595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Write session: Do CDS request
2025-10-02T09:35:18.571601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.577066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.578648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.578757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.578764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.578770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.578799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.578822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487196895:5853]
2025-10-02T09:35:18.579167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.579401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.579429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.579620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.579650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.579655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.579655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.579656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.579656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.579657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.579658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.579658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.579659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.579661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.579662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.579662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.579666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.579672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.579674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.579677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.579679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.579681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.579683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.579685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.579687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.579689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.579691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.579693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.579697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.579701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.579704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.579707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.579710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.579712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.579714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.579718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.579720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.579722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.579724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.579727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.579730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.579733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.579736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.579739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.579742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.579745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.579747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.579749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.579751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.579754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.579756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.579758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.579775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.581147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.581240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.581249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2720
2025-10-02T09:35:18.581349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.581370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.581376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.581378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.581649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2720 sessionId:  describe result for acl check
2025-10-02T09:35:18.581674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.581678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.581679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.581682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562769988:9105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.582022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562769988:9105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.583161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562769988:9105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.586633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562769988:9105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.586642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562769988:9105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.586644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562769988:9105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.586648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.587218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.588838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.588847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.588849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.588850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.588854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2719 [2:7556555660487196895:5853]
2025-10-02T09:35:18.588861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.588870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.588872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.588873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.588876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.588885Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.588888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.588891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.588921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.588926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.588929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.588931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.588933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.588981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.588988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.588998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.589011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.589028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.589046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770023:9105], now have 1 active actors on pipe
2025-10-02T09:35:18.589051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562769964:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.589055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.589056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.589057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.589065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.589074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.589079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.589081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.589083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.589071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2719
2025-10-02T09:35:18.589072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2719
2025-10-02T09:35:18.589089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.589095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.589111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.589117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.589118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.589128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.589134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.589167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.589178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.589181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.589186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.589193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.589203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.589218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.589328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.589336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.589346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.589412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2720 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0
2025-10-02T09:35:18.589641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4460460c-9de99585-20bd9366-cb115d5b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.592173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Write session: try to update token
2025-10-02T09:35:18.592186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.598195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.598205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.598209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.598210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.598213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.598215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.598217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487196890:5853]
2025-10-02T09:35:18.598241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.598244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.598246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.598257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.598268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.598271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.598367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.604276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId: src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.606374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.671391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562770031:9243]
2025-10-02T09:35:18.671607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2719, pipe: [1:7556555660562770031:9243]
2025-10-02T09:35:18.707563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.707863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.707873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.707885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770031:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.708095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.708088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562770031:9243]
2025-10-02T09:35:18.708109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.708110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.708111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.708155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2720 reason: error at write: Disconnected sessionId: src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0
2025-10-02T09:35:18.708295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2720 sessionId: src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0 is DEAD
2025-10-02T09:35:18.708448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.708462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Write session will restart in 0.006587s
2025-10-02T09:35:18.708483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Write session: Do CDS request
2025-10-02T09:35:18.708488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.714097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.715249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.715357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.715364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.715370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.715398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.715422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487196955:5846]
2025-10-02T09:35:18.715763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.715984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.716013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.716179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.716198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.716231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.716235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.716236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.716237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.716237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.716240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.716240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.716241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.716242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.716242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.716243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.716243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.716246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.716254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.716256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.716258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.716260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.716262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.716264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.716265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.716266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.716274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2721
2025-10-02T09:35:18.716268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.716270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.716272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.716274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.716280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.716284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.716287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.716290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.716292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.716294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.716296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.716299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.716302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.716304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.716306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.716309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.716312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.716315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.716318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.716320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.716322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.716325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.716327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.716330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.716334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.716337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.716339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.716341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.716359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.716374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.716393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.716399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.716401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.716675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2721 sessionId:  describe result for acl check
2025-10-02T09:35:18.716697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.716702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.716703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.716706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562770057:9100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.717093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562770057:9100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.718302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562770057:9100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.722608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562770057:9100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.722616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562770057:9100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.722618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562770057:9100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.722621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.723874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.725419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.725431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.725432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.725434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.725437Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2720 [2:7556555660487196955:5846]
2025-10-02T09:35:18.725446Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.725455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.725460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.725462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.725462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.725472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.725474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.725479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.725517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.725522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.725523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.725525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.725526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.725570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.725576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.725587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.725600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.725616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.725634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770091:9100], now have 1 active actors on pipe
2025-10-02T09:35:18.725639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770032:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.725643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.725646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.725647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.725657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.725656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2720
2025-10-02T09:35:18.725670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.725671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2720
2025-10-02T09:35:18.725671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.725673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.725675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.725685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.725687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.725709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.725717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.725729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.725738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.725748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.725764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.725772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.725775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.725776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.725787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.725798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.725821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.725908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.725914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.725924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.725979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2721 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0
2025-10-02T09:35:18.726195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0c6a4a-ed53f936-f8df1f25-7e805a05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.728884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Write session: try to update token
2025-10-02T09:35:18.728893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.734896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.734909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.734912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.734913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.734918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.734920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.734922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487196950:5846]
2025-10-02T09:35:18.734945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.734949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.734951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.734968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.734981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.734985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.735057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.740756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId: src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.742918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.808091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562770121:9243]
2025-10-02T09:35:18.808237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2720, pipe: [1:7556555660562770121:9243]
2025-10-02T09:35:18.845091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.845496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.845506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.845519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770121:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.845709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.845738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562770121:9243]
2025-10-02T09:35:18.845754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.845756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.845819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2721 reason: error at write: Disconnected sessionId: src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0
2025-10-02T09:35:18.845958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2721 sessionId: src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0 is DEAD
2025-10-02T09:35:18.846020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.846119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.846127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Write session will restart in 0.008557s
2025-10-02T09:35:18.846143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Write session: Do CDS request
2025-10-02T09:35:18.846147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.851388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.852500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.852605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.852612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.852618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.852645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.852669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487197050:5808]
2025-10-02T09:35:18.853025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.853245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.853273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.853457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.853489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.853493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.853494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.853494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.853495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.853496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.853496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.853497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.853497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.853498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.853499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.853499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.853502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.853509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.853511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.853514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.853515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.853518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.853520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.853522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.853524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.853526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.853528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.853530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.853535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.853539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.853542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.853547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.853549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.853552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.853554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.853557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.853560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.853562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.853564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.853567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.853571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.853574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.853576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.853579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.853581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.853584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.853586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.853589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.853591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.853593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.853596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.853598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.853615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.856115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.856231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.856239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2722
2025-10-02T09:35:18.856352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.856371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.856378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.856380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.856686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2722 sessionId:  describe result for acl check
2025-10-02T09:35:18.856717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.856726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.856727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.856731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562770148:9079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.857224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562770148:9079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.858802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562770148:9079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.860744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562770148:9079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.860753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562770148:9079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.860755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562770148:9079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.860759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.861199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.862775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.862786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.862788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.862790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.862794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2721 [2:7556555660487197050:5808]
2025-10-02T09:35:18.862801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.862812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.862816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.862818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.862819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.862827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.862830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.862835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.862867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.862871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.862874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.862876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.862877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.862921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.862928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.862938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.862951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.862967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.862985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770122:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.862991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770182:9079], now have 1 active actors on pipe
2025-10-02T09:35:18.862994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.862995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.862996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.863003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.863006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2721
2025-10-02T09:35:18.863016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.863009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2721
2025-10-02T09:35:18.863018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.863020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.863022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.863030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.863034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.863053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.863059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.863060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.863067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.863073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.863102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4976dd64-651baf06-a6037b42-75fe93ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.863111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.863118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.863120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.863129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.863139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.863152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.863251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.863258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.863269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.863328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2722 partition: 0 MaxSeqNo: 36 sessionId: src_id|4976dd64-651baf06-a6037b42-75fe93ee_0
2025-10-02T09:35:18.863501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2261ea1-5f2c2084-27c9746a-75ac06e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4976dd64-651baf06-a6037b42-75fe93ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:18.866024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Write session: try to update token
2025-10-02T09:35:18.866034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:18.872233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:18.872248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:18.872251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:18.872253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:18.872262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.872264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.872266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487197045:5808]
2025-10-02T09:35:18.872291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:18.872295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.872297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:18.872310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:18.872323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:18.872327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:18.872411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:18.877982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId: src_id|4976dd64-651baf06-a6037b42-75fe93ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:18.880102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:18.945814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555660562770195:9243]
2025-10-02T09:35:18.946007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2721, pipe: [1:7556555660562770195:9243]
2025-10-02T09:35:18.980579Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:18.980781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.980790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.980810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770195:9243], now have 1 active actors on pipe
2025-10-02T09:35:18.980994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:18.981016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555660562770195:9243]
2025-10-02T09:35:18.981032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:18.981034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:18.981093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2722 reason: error at write: Disconnected sessionId: src_id|4976dd64-651baf06-a6037b42-75fe93ee_0
2025-10-02T09:35:18.981123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:18.981221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2722 sessionId: src_id|4976dd64-651baf06-a6037b42-75fe93ee_0 is DEAD
2025-10-02T09:35:18.981354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:18.981362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Write session will restart in 0.005592s
2025-10-02T09:35:18.981381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Write session: Do CDS request
2025-10-02T09:35:18.981386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:18.987264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:18.988077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.988193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:18.988202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2723
2025-10-02T09:35:18.988306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:18.988310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:18.988331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:18.988336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:18.988339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:18.988406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:18.988413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:18.988419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:18.988445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:18.988471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555660487197110:5797]
2025-10-02T09:35:18.988624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2723 sessionId:  describe result for acl check
2025-10-02T09:35:18.988648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:18.988652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:18.988653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:18.988656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555660562770223:9066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:18.988830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:18.989007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555660562770223:9066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:18.989061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:18.989087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:18.989268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:18.989299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.989305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.989306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.989306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.989307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.989307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.989308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.989309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.989310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.989310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.989311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.989311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.989315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.989321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.989323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.989326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.989327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.989330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.989332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.989333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.989335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.989338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.989340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.989342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.989346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.989350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:18.989353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.989356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:18.989358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.989361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:18.989363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.989366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:18.989369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.989372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:18.989374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.989377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:18.989379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.989381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:18.989384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.989386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:18.989389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.989391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:18.989393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.989397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.989400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.989402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.989404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.989408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.989424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:18.990260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555660562770223:9066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:18.995236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555660562770223:9066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:18.995247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555660562770223:9066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:18.995250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555660562770223:9066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:18.995255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:18.996940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:18.998487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:18.998497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:18.998498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:18.998500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:18.998503Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2722 [2:7556555660487197110:5797]
2025-10-02T09:35:18.998511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:18.998520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:18.998522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.998523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.998524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.998533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:18.998536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:18.998544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:18.998575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.998580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.998581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.998583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:18.998584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:18.998629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:18.998635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:18.998645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:18.998655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:18.998672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:18.998689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770262:9066], now have 1 active actors on pipe
2025-10-02T09:35:18.998696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555660562770200:2446], now have 1 active actors on pipe
2025-10-02T09:35:18.998699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:18.998701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:18.998702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:18.998709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:18.998724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:18.998725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:18.998727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:18.998728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:18.998722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2722
2025-10-02T09:35:18.998738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:18.998727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2722
2025-10-02T09:35:18.998743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:18.998759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:18.998765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:18.998766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:18.998775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.998781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.998814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:18.998824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:18.998827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:18.998829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:18.998835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:18.998842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:18.998861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.998948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:18.998954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:18.998965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:18.999042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2723 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0
2025-10-02T09:35:18.999225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4976dd64-651baf06-a6037b42-75fe93ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.001734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Write session: try to update token
2025-10-02T09:35:19.001744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.008013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.008027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.008029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.008031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.008036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:19.008039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:19.008041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555660487197105:5797]
2025-10-02T09:35:19.008063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.008067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.008068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.008071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.008075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.008078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.008230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.013840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId: src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.016026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.080989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857737565:9243]
2025-10-02T09:35:19.081152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2722, pipe: [1:7556555664857737565:9243]
2025-10-02T09:35:19.116374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.116591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.116600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.116612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737565:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.116736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.116763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857737565:9243]
2025-10-02T09:35:19.116856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:19.116862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:19.116881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.116903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2723 reason: error at write: Disconnected sessionId: src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0
2025-10-02T09:35:19.117027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2723 sessionId: src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0 is DEAD
2025-10-02T09:35:19.117148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:19.117156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Write session will restart in 0.005469s
2025-10-02T09:35:19.117170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Write session: Do CDS request
2025-10-02T09:35:19.117175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.122588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.123136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.123234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.123243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2724
2025-10-02T09:35:19.123348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.123368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.123375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.123377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.123634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.123655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2724 sessionId:  describe result for acl check
2025-10-02T09:35:19.123680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.123684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.123685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.123688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857737591:9065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.123730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.123736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.123742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.123769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.123793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164482:5803]
2025-10-02T09:35:19.124040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857737591:9065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.124135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.124300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.124323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.124494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.124522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.124529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.124530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.124530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.124531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.124531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.124532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.124533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.124533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.124534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.124535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.124536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.124539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.124545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.124547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.124549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.124551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.124553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.124555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.124557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.124559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.124561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.124563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.124566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.124569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.124573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.124576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.124579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.124582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.124584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.124586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.124589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.124592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.124596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.124598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.124600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.124603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.124605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.124607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.124610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.124612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.124614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.124616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.124619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.124621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.124625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.124627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.124629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.124648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.125465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857737591:9065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.130386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857737591:9065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.130397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857737591:9065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.130400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857737591:9065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.130405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.132028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.133419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.133431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.133433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.133435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.133438Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2723 [2:7556555664782164482:5803]
2025-10-02T09:35:19.133445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.133454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.133459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.133460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.133461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.133472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.133478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.133484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.133515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.133519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.133520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.133521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.133523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.133557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.133561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.133567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.133574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.133585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.133599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737630:9065], now have 1 active actors on pipe
2025-10-02T09:35:19.133604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737566:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.133607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.133608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.133609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.133616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.133628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.133630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.133632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.133634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.133637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.133639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.133634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2723
2025-10-02T09:35:19.133635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2723
2025-10-02T09:35:19.133651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.133656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.133658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.133668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.133673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.133696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.133702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.133704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.133706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.133712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.133721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.133733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.133805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.133809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.133817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.133857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2724 partition: 0 MaxSeqNo: 36 sessionId: src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0
2025-10-02T09:35:19.134037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae8c9fa3-5373b82f-efbf7e85-a3a0f5b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.136447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Write session: try to update token
2025-10-02T09:35:19.136457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.142876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.142890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.142892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.142893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.142897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.142900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.142902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164477:5803]
2025-10-02T09:35:19.142923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.142927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.142929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.142966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.142987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.142994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.143039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.148211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId: src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.150275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.216850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857737649:9243]
2025-10-02T09:35:19.217034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2723, pipe: [1:7556555664857737649:9243]
2025-10-02T09:35:19.251279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.251559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.251568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.251581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737649:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.251927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857737649:9243]
2025-10-02T09:35:19.251944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:19.251947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:19.251949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.251991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2724 reason: error at write: Disconnected sessionId: src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0
2025-10-02T09:35:19.252134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.252123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2724 sessionId: src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0 is DEAD
2025-10-02T09:35:19.252255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:19.252264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Write session will restart in 0.006944s
2025-10-02T09:35:19.252279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Write session: Do CDS request
2025-10-02T09:35:19.252284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.257787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.258943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.259038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.259045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.259051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.259075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.259100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164544:5801]
2025-10-02T09:35:19.259433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.259655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.259678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.259853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.259882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.259885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.259886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.259886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.259887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.259888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.259888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.259889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.259889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.259890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.259890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.259891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.259893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.259900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.259902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.259904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.259906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.259908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.259910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.259912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.259914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.259917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.259919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.259921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.259924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.259928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.259931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.259934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.259937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.259940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.259942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.259944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.259946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.259949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.259951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.259953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.259957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.259960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.259962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.259965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.259968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.259970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.259972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.259975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.259977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.259979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.259981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.259984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.260001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.260131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.260334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.260344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2725
2025-10-02T09:35:19.260435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.260453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.260459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.260463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.260777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2725 sessionId:  describe result for acl check
2025-10-02T09:35:19.260821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.260827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.260828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.260832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857737679:9052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.261288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857737679:9052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.262718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857737679:9052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.267074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857737679:9052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.267083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857737679:9052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.267086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857737679:9052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.267090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.267518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.268946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.268956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.268957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.268959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.268964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2724 [2:7556555664782164544:5801]
2025-10-02T09:35:19.268970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.268979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.268984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.268985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.268986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.268996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.269003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.269007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.269034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.269039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.269040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.269042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.269043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.269078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.269082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.269088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.269093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.269102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.269115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737650:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.269120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737714:9052], now have 1 active actors on pipe
2025-10-02T09:35:19.269124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.269125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.269126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.269134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.269143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.269147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.269149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.269150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.269155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.269156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.269169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.269174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.269177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.269168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2724
2025-10-02T09:35:19.269172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2724
2025-10-02T09:35:19.269196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.269201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.269260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.269268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.269271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.269272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.269277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.269285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.269301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.269403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.269407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.269414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.269469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2725 partition: 0 MaxSeqNo: 36 sessionId: src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0
2025-10-02T09:35:19.269643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96874d5a-3a3c000c-7aa052bb-c2d58a98_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.272213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Write session: try to update token
2025-10-02T09:35:19.272223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.278369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.278382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.278384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.278385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.278391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.278394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.278396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164539:5801]
2025-10-02T09:35:19.278416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.278423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.278424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.278457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.278484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.278497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.278545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.283977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId: src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.285986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.351828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857737724:9243]
2025-10-02T09:35:19.351964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2724, pipe: [1:7556555664857737724:9243]
2025-10-02T09:35:19.386148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.386351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.386359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.386371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737724:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.386502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.386546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.386558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857737724:9243]
2025-10-02T09:35:19.386574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:19.386622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0
2025-10-02T09:35:19.386752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2725 sessionId: src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0 is DEAD
2025-10-02T09:35:19.386886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:19.386895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Write session will restart in 0.005359s
2025-10-02T09:35:19.386914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Write session: Do CDS request
2025-10-02T09:35:19.386918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.392536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.393078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.393171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.393182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2726
2025-10-02T09:35:19.393244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.393263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.393269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.393272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.393562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2726 sessionId:  describe result for acl check
2025-10-02T09:35:19.393581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.393582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.393583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.393586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857737751:9049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.393690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.393795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.393801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.393807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.393834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.393859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164610:5800]
2025-10-02T09:35:19.393932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857737751:9049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.394192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.394371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.394392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.394572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.394601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.394605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.394605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.394606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.394607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.394607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.394608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.394608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.394609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.394610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.394610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.394611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.394614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.394621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.394623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.394625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.394627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.394629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.394632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.394633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.394636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.394638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.394640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.394642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.394646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.394650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.394653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.394656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.394658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.394661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.394663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.394666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.394668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.394671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.394674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.394677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.394679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.394685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.394687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.394689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.394692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.394697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.394701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.394703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.394706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.394712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.394714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.394717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.394734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.395250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857737751:9049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.400515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857737751:9049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.400526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857737751:9049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.400529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857737751:9049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.400534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.402139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.403577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.403587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.403588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.403592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.403595Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2725 [2:7556555664782164610:5800]
2025-10-02T09:35:19.403602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.403615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.403619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.403621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.403622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.403630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.403635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.403640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.403669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.403674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.403675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.403677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.403680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.403746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.403751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.403757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.403763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.403774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.403787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737725:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.403793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737790:9049], now have 1 active actors on pipe
2025-10-02T09:35:19.403796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.403797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.403786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2725
2025-10-02T09:35:19.403799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.403804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.403812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.403787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2725
2025-10-02T09:35:19.403820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.403820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.403822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.403823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.403825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.403847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.403851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.403859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.403866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.403878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.403883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.403887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.403889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.403890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.403896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.403904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.403917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.404000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.404005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.404013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.404069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2726 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0
2025-10-02T09:35:19.404287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae81dd5-c51c66ee-162c9114-197ddf4e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.407048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Write session: try to update token
2025-10-02T09:35:19.407064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.412887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.412896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.412899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.412899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.412904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.412906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.412908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164605:5800]
2025-10-02T09:35:19.412926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.412929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.412931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.412932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.412933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.412934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.413053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.419375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId: src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.421659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.486498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857737798:9243]
2025-10-02T09:35:19.486944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2725, pipe: [1:7556555664857737798:9243]
2025-10-02T09:35:19.520165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.520373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.520382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.520394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737798:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.520552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.520564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:19.520574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:19.520575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.520610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857737798:9243]
2025-10-02T09:35:19.520619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2726 reason: error at write: Disconnected sessionId: src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0
2025-10-02T09:35:19.520753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2726 sessionId: src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0 is DEAD
2025-10-02T09:35:19.520935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:19.520951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Write session will restart in 0.006638s
2025-10-02T09:35:19.520971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Write session: Do CDS request
2025-10-02T09:35:19.520977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.526455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.527843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.527935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.527941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.527946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.527970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.527992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164675:5794]
2025-10-02T09:35:19.528143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.528255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.528266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2727
2025-10-02T09:35:19.528338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.528353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.528371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.528377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.528380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.528622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2727 sessionId:  describe result for acl check
2025-10-02T09:35:19.528643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.528645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.528646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.528648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857737828:9046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.528704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.528744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.528962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.528992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.528996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.528997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.528998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.528998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.528999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.529000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.529000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.529001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.529001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.529003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.529005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857737828:9046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.529004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.529007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.529013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.529015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.529017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.529019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.529021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.529023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.529025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.529027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.529029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.529031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.529033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.529036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.529040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.529043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.529046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.529048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.529051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.529054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.529056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.529059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.529062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.529067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.529070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.529072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.529075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.529077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.529081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.529084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.529090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.529092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.529095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.529099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.529102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.529105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.529107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.529124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.530412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857737828:9046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.534435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857737828:9046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.534445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857737828:9046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.534447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857737828:9046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.534451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.536581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.537966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.537977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.537979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.537981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.537987Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2726 [2:7556555664782164675:5794]
2025-10-02T09:35:19.537994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.538006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.538011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.538013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.538014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.538023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.538029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.538032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.538061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.538067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.538068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.538070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.538071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.538108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.538113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.538120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.538125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.538136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.538150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737865:9046], now have 1 active actors on pipe
2025-10-02T09:35:19.538155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737799:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.538159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.538160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.538161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.538168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.538175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.538186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.538185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.538188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.538190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.538187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2726
2025-10-02T09:35:19.538188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2726
2025-10-02T09:35:19.538190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.538202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.538204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.538207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.538221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.538223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.538240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.538249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.538253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.538254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.538259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.538265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.538275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.538388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.538392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.538399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.538462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2727 partition: 0 MaxSeqNo: 36 sessionId: src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0
2025-10-02T09:35:19.538708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8159b8-f83faa98-8385ae5e-1e2d7e14_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.541376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Write session: try to update token
2025-10-02T09:35:19.541391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.547211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.547222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.547223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.547223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.547227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.547229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.547231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164670:5794]
2025-10-02T09:35:19.547249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.547251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.547254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.547255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.547256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.547257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.547362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.553633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId: src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.555879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.620642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857737872:9243]
2025-10-02T09:35:19.620812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2726, pipe: [1:7556555664857737872:9243]
2025-10-02T09:35:19.655561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.655832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.655840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.655853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737872:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.655981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.655988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:19.656009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:19.656012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857737872:9243]
2025-10-02T09:35:19.656056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2727 reason: error at write: Disconnected sessionId: src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0
2025-10-02T09:35:19.656062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.656197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2727 sessionId: src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0 is DEAD
2025-10-02T09:35:19.656356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:19.656369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Write session will restart in 0.007355s
2025-10-02T09:35:19.656391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Write session: Do CDS request
2025-10-02T09:35:19.656397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.661926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.663004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.663102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.663109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.663115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.663140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.663165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164741:5788]
2025-10-02T09:35:19.663509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.663703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.663725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.663905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.663934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.663938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.663939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.663940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.663940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.663941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.663941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.663942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.663942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.663943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.663944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.663944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.663947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.663954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.663956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.663958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.663960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.663962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.663964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.663966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.663968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.663970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.663972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.663974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.663978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.663982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.663985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.663988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.663990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.663997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.664001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.664004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.664006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.664009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.664011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.664015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.664017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.664020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.664023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.664026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.664028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.664030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.664032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.664035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.664037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.664040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.664043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.664046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.664065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.665194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.665275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.665287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2728
2025-10-02T09:35:19.665402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.665421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.665423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.665426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.665710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2728 sessionId:  describe result for acl check
2025-10-02T09:35:19.665736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.665741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.665742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.665745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857737906:9042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.666095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857737906:9042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.667588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857737906:9042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.670860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857737906:9042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.670869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857737906:9042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.670871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857737906:9042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.670875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.671379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.672867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.672877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.672878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.672880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.672883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2727 [2:7556555664782164741:5788]
2025-10-02T09:35:19.672890Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.672899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.672901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.672902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.672904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.672914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.672921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.672925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.672951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.672956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.672957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.672958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.672960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.672996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.673001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.673007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.673013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.673024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.673037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737941:9042], now have 1 active actors on pipe
2025-10-02T09:35:19.673043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737874:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.673047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.673048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.673049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.673057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.673067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.673070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.673072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.673073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.673078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.673079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.673069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2727
2025-10-02T09:35:19.673072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2727
2025-10-02T09:35:19.673092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.673098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.673099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.673107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.673111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.673166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bff144d3-27ef55f5-71cb4685-21a54646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.673173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.673177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.673178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.673182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.673188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.673200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.673315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.673320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.673328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.673392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2728 partition: 0 MaxSeqNo: 36 sessionId: src_id|bff144d3-27ef55f5-71cb4685-21a54646_0
2025-10-02T09:35:19.673637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c870025c-38ceb6e9-cefe3d56-ea6e0d9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bff144d3-27ef55f5-71cb4685-21a54646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.676201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Write session: try to update token
2025-10-02T09:35:19.676213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.682067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.682079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.682080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.682081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.682084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.682086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.682088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164736:5788]
2025-10-02T09:35:19.682107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.682110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.682110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.682111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.682113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.682115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.682222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.688307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId: src_id|bff144d3-27ef55f5-71cb4685-21a54646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.690613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.756318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857737952:9243]
2025-10-02T09:35:19.756488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2727, pipe: [1:7556555664857737952:9243]
2025-10-02T09:35:19.791626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.791828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.791836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.791847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737952:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.791956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.791993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857737952:9243]
2025-10-02T09:35:19.792019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:19.792066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2728 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bff144d3-27ef55f5-71cb4685-21a54646_0
2025-10-02T09:35:19.792198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2728 sessionId: src_id|bff144d3-27ef55f5-71cb4685-21a54646_0 is DEAD
2025-10-02T09:35:19.792313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.792363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:19.792375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Write session will restart in 0.005400s
2025-10-02T09:35:19.792398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Write session: Do CDS request
2025-10-02T09:35:19.792403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.797792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.799156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.799221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.799230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2729
2025-10-02T09:35:19.798936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.799032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.799034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.799040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.799063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.799081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164838:5773]
2025-10-02T09:35:19.799368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.799385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.799391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.799393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.799425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.799603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.799625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.799752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2729 sessionId:  describe result for acl check
2025-10-02T09:35:19.799775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.799777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.799778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.799781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857738010:9018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.799796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.799824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.799828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.799829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.799829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.799830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.799830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.799831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.799832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.799832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.799834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.799835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.799835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.799838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.799844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.799846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.799848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.799850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.799852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.799854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.799856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.799858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.799860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.799862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.799864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.799867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.799870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.799874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.799877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.799879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.799881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.799884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.799887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.799889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.799891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.799893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.799895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.799897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.799904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.799906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.799908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.799910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.799913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.799915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.799917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.799919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.799921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.799923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.799926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.799944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.800289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857738010:9018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.801738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857738010:9018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.806696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857738010:9018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.806706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857738010:9018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.806707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857738010:9018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.806711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.807409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.808938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.808949Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.808950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.808952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.808955Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2728 [2:7556555664782164838:5773]
2025-10-02T09:35:19.808963Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.808972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.808975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.808977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.808978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.808986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.808990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.808994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.809022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.809027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.809028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.809030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.809031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.809066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.809070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.809077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.809082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.809091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.809105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857738044:9018], now have 1 active actors on pipe
2025-10-02T09:35:19.809110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857737968:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.809113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.809114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.809115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.809123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.809132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.809136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.809138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.809139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.809141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.809142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.809155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.809160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.809161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.809170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2728
2025-10-02T09:35:19.809171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2728
2025-10-02T09:35:19.809192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.809197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.809210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49af9ad9-6392b0a3-a840767e-5187429a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.809217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.809219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.809220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.809226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.809232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.809239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.809350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.809354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.809362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.809423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2729 partition: 0 MaxSeqNo: 36 sessionId: src_id|49af9ad9-6392b0a3-a840767e-5187429a_0
2025-10-02T09:35:19.809617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff144d3-27ef55f5-71cb4685-21a54646_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49af9ad9-6392b0a3-a840767e-5187429a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.812319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Write session: try to update token
2025-10-02T09:35:19.812328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.818076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:19.818091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.818095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.818117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:19.818119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:19.818247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:19.818360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:19.818477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:19.818590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:19.818749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:19.818773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:19.824658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId: src_id|49af9ad9-6392b0a3-a840767e-5187429a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.826574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.826586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.826587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.826588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.826593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.826596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.826599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164833:5773]
2025-10-02T09:35:19.826618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.826620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.826622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.826625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.826625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.826626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.826742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.826858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:19.892004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555664857738054:9243]
2025-10-02T09:35:19.892194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2728, pipe: [1:7556555664857738054:9243]
2025-10-02T09:35:19.939308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:19.939704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.939725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.939743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857738054:9243], now have 1 active actors on pipe
2025-10-02T09:35:19.939946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555664857738054:9243]
2025-10-02T09:35:19.939952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:19.939958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:19.939983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:19.940017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2729 reason: error at write: Disconnected sessionId: src_id|49af9ad9-6392b0a3-a840767e-5187429a_0
2025-10-02T09:35:19.940181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2729 sessionId: src_id|49af9ad9-6392b0a3-a840767e-5187429a_0 is DEAD
2025-10-02T09:35:19.940232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:19.940414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:19.940430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Write session will restart in 0.007201s
2025-10-02T09:35:19.940462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Write session: Do CDS request
2025-10-02T09:35:19.940468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:19.946491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:19.948143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:19.948276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:19.948284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:19.948290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:19.948316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:19.948344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555664782164912:5775]
2025-10-02T09:35:19.948784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:19.948989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:19.949012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:19.949254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.949261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:19.949293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.949297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.949298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.949298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.949299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.949300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.949300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.949301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.949302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.949302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.949303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.949304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.949307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.949314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.949316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.949318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.949320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.949322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.949339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.949344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.949346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.949349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.949351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.949353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.949358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.949365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:19.949368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.949371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:19.949373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.949376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:19.949378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.949381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:19.949358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:19.949370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2730
2025-10-02T09:35:19.949385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.949388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:19.949390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.949393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:19.949395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.949397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:19.949400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.949403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:19.949405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.949408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:19.949410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.949412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.949415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.949418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.949422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.949425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.949441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:19.949494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:19.949513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:19.949520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:19.949522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:19.949886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2730 sessionId:  describe result for acl check
2025-10-02T09:35:19.949907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:19.949912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:19.949913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:19.949916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555664857738093:9005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:19.950261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555664857738093:9005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:19.951977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555664857738093:9005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:19.956549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555664857738093:9005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:19.956559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555664857738093:9005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:19.956562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555664857738093:9005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:19.956566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:19.957080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:19.958925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:19.958936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:19.958938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:19.958940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:19.958944Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2729 [2:7556555664782164912:5775]
2025-10-02T09:35:19.958952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:19.958962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:19.958967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.958970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.958971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.958980Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:19.958986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:19.958990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:19.959022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.959027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.959028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.959030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:19.959031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:19.959070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:19.959075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.959082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:19.959088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:19.959100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:19.959112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.959118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.959119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.959124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:19.959135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857738059:2446], now have 1 active actors on pipe
2025-10-02T09:35:19.959135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:19.959138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:19.959140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:19.959141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555664857738128:9005], now have 1 active actors on pipe
2025-10-02T09:35:19.959145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:19.959152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:19.959157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:19.959172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.959180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:19.959178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2729
2025-10-02T09:35:19.959197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:19.959188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2729
2025-10-02T09:35:19.959225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.959230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.959246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:19.959276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:19.959281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:19.959282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:19.959287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:19.959293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:19.959303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.959440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:19.959444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:19.959452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:19.959513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2730 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0
2025-10-02T09:35:19.959789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49af9ad9-6392b0a3-a840767e-5187429a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:19.968224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:19.968239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.968243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.968263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:19.968266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:19.968600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:19.968724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:19.968859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:19.968982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:19.969139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:19.969163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:19.974970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Write session: try to update token
2025-10-02T09:35:19.974988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:19.976828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:19.976838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:19.976839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:19.976840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:19.976845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.976847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.976849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555664782164907:5775]
2025-10-02T09:35:19.976867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:19.976870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:19.976872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:19.976872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:19.976875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:19.976881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:19.976972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:19.992046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId: src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:19.994216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.039972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705435:9243]
2025-10-02T09:35:20.040177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2729, pipe: [1:7556555669152705435:9243]
2025-10-02T09:35:20.088698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.088908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.088916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.088928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705435:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.089073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.089081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705435:9243]
2025-10-02T09:35:20.089085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:20.089088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:20.089105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.089142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2730 reason: error at write: Disconnected sessionId: src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0
2025-10-02T09:35:20.089272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2730 sessionId: src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0 is DEAD
2025-10-02T09:35:20.089463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:20.089477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Write session will restart in 0.009579s
2025-10-02T09:35:20.089503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Write session: Do CDS request
2025-10-02T09:35:20.089509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.094912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.095973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.096081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.096087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.096092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.096119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.096148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132290:5763]
2025-10-02T09:35:20.096759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.096950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.096973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.097265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.097299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.097303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.097304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.097304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.097305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.097306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.097306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.097307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.097308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.097308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.097309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.097310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.097313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.097320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.097323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.097325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.097327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.097330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.097332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.097334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.097336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.097340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.097343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.097345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.097349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.097353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.097356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.097358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.097361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.097363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.097365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.097368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.097370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.097373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.097376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.097378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.097380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.097383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.097385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.097388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.097391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.097394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.097396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.097398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.097400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.097403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.097405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.097408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.097426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.100200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.100342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.100352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2731
2025-10-02T09:35:20.100445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.100463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.100471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.100474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.100752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2731 sessionId:  describe result for acl check
2025-10-02T09:35:20.100777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.100782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.100783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.100786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152705471:9004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.101146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152705471:9004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.102223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152705471:9004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.104309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152705471:9004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.104318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152705471:9004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.104320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152705471:9004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.104323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.104834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.106485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.106496Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.106499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.106501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.106504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2730 [2:7556555669077132290:5763]
2025-10-02T09:35:20.106511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.106521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.106522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.106524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.106525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.106533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.106536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.106540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.106569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.106575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.106576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.106577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.106579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.106612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.106617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.106624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.106630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.106641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.106655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705436:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.106662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.106663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.106665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.106674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.106681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705506:9004], now have 1 active actors on pipe
2025-10-02T09:35:20.106686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.106686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.106688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.106689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.106694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.106696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.106714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.106706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2730
2025-10-02T09:35:20.106719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.106720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.106714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2730
2025-10-02T09:35:20.106736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.106740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.106760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.106767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.106769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.106771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.106776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.106781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.106790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.106873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.106878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.106886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.106931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2731 partition: 0 MaxSeqNo: 36 sessionId: src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0
2025-10-02T09:35:20.107152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b24004e-1b00eab9-4d3f0f07-37e8e42f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.109429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Write session: try to update token
2025-10-02T09:35:20.109442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.115675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.115687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.115688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.115689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.115692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.115694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.115697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132285:5763]
2025-10-02T09:35:20.115717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.115723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.115722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.115724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.115729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.115732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.115856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.123495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId: src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.125714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.189460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705526:9243]
2025-10-02T09:35:20.189609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2730, pipe: [1:7556555669152705526:9243]
2025-10-02T09:35:20.227067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.227296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.227305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.227316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705526:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.227441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.227492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705526:9243]
2025-10-02T09:35:20.227495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.227523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:20.227588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2731 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0
2025-10-02T09:35:20.227761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2731 sessionId: src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0 is DEAD
2025-10-02T09:35:20.227974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:20.228005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Write session will restart in 0.008165s
2025-10-02T09:35:20.228026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Write session: Do CDS request
2025-10-02T09:35:20.228031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.233281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.234775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.234879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.234886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.234892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.234918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.234944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132360:5761]
2025-10-02T09:35:20.235291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.235467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.235490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.235684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.235714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.235718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.235719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.235719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.235720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.235720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.235721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.235722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.235722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.235723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.235723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.235724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.235728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.235734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.235736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.235738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.235740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.235742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.235744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.235747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.235749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.235751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.235753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.235755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.235759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.235763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.235766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.235769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.235772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.235774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.235777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.235780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.235782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.235785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.235787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.235790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.235792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.235794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.235800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.235803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.235805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.235808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.235811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.235814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.235817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.235819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.235821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.235825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.235842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.237165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.237360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.237373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2732
2025-10-02T09:35:20.237488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.237508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.237515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.237518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.237791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2732 sessionId:  describe result for acl check
2025-10-02T09:35:20.237810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.237816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.237817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.237820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152705563:8985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.238176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152705563:8985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.239581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152705563:8985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.242901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152705563:8985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.242911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152705563:8985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.242913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152705563:8985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.242918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.243383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.244865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.244877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.244879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.244881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.244885Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2731 [2:7556555669077132360:5761]
2025-10-02T09:35:20.244892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.244903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.244907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.244909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.244910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.244920Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.244926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.244930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.244964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.244969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.244970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.244971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.244973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.245012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.245016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.245023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.245028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.245036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.245050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705598:8985], now have 1 active actors on pipe
2025-10-02T09:35:20.245056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705527:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.245060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.245061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.245063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.245072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.245082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.245090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.245093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.245095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.245100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.245085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2731
2025-10-02T09:35:20.245101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.245109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.245110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.245112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.245119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.245121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.245137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2731
2025-10-02T09:35:20.245148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.245155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.245157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.245158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.245165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.245170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.245181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.245287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.245292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.245299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.245348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2732 partition: 0 MaxSeqNo: 36 sessionId: src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0
2025-10-02T09:35:20.245599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8699f1a1-fe7addfe-bc5bf01d-d26a3e71_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.247862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Write session: try to update token
2025-10-02T09:35:20.247876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.254334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.254347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.254348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.254350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.254354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.254356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.254359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132355:5761]
2025-10-02T09:35:20.254379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.254383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.254384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.254383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.254387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.254389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.254508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.260529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId: src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.262858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.327697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705608:9243]
2025-10-02T09:35:20.327870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2731, pipe: [1:7556555669152705608:9243]
2025-10-02T09:35:20.364485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.364707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.364715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.364726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705608:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.364861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.364868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.364897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705608:9243]
2025-10-02T09:35:20.364909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:20.364911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:20.364965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2732 reason: error at write: Disconnected sessionId: src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0
2025-10-02T09:35:20.365136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2732 sessionId: src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0 is DEAD
2025-10-02T09:35:20.365276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:20.365292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Write session will restart in 0.005289s
2025-10-02T09:35:20.365314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Write session: Do CDS request
2025-10-02T09:35:20.365320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.370316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.371213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.371367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.371379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2733
2025-10-02T09:35:20.371500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.371527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.371537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.371539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.371539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.371642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.371649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.371655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.371682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.371704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132433:5757]
2025-10-02T09:35:20.371818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2733 sessionId:  describe result for acl check
2025-10-02T09:35:20.371844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.371848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.371849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.371852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152705645:8980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.372045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.372231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.372234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152705645:8980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.372252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.372428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.372457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.372461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.372461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.372462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.372463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.372463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.372463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.372464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.372465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.372465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.372465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.372466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.372468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.372475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.372477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.372479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.372481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.372483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.372485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.372487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.372489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.372491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.372494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.372496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.372500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.372503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.372506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.372509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.372511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.372514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.372516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.372519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.372521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.372523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.372526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.372529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.372531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.372534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.372536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.372539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.372541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.372543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.372545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.372548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.372551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.372553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.372555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.372558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.372574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.373675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152705645:8980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.377901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152705645:8980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.377910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152705645:8980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.377912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152705645:8980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.377916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.380120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.381676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.381689Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.381691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.381693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.381698Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2732 [2:7556555669077132433:5757]
2025-10-02T09:35:20.381705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.381715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.381720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.381722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.381723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.381731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.381734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.381738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.381768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.381773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.381774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.381776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.381778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.381815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.381821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.381828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.381833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.381841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.381853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705612:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.381859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705684:8980], now have 1 active actors on pipe
2025-10-02T09:35:20.381862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.381864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.381865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.381875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.381873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2732
2025-10-02T09:35:20.381886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.381875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2732
2025-10-02T09:35:20.381892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.381895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.381895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.381896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.381897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.381920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.381924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.381932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.381940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.381951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.381955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.381959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.381961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.381962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.381967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.381973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.381986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.382106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.382111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.382118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.382166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2733 partition: 0 MaxSeqNo: 36 sessionId: src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0
2025-10-02T09:35:20.382409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5ba26f-1f3e3814-8c416c06-7203d0ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.384796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Write session: try to update token
2025-10-02T09:35:20.384831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.391476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.391488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.391489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.391490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.391493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.391496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.391498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132428:5757]
2025-10-02T09:35:20.391516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.391521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.391521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.391522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.391523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.391526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.391673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.397818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId: src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.400048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.464918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705691:9243]
2025-10-02T09:35:20.465117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2732, pipe: [1:7556555669152705691:9243]
2025-10-02T09:35:20.502858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.503067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.503076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.503088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705691:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.503208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.503244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.503257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:20.503287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705691:9243]
2025-10-02T09:35:20.503320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2733 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0
2025-10-02T09:35:20.503472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2733 sessionId: src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0 is DEAD
2025-10-02T09:35:20.503617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:20.503630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Write session will restart in 0.008105s
2025-10-02T09:35:20.503672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Write session: Do CDS request
2025-10-02T09:35:20.503678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.509333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.510404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.510514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.510521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.510527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.510553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.510580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132505:5756]
2025-10-02T09:35:20.510924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.511113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.511136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.511313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.511342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.511346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.511346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.511347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.511347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.511348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.511349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.511349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.511350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.511350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.511351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.511351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.511354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.511362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.511364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.511367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.511369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.511371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.511373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.511375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.511377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.511379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.511381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.511383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.511387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.511391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.511394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.511397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.511400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.511403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.511405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.511407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.511410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.511412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.511414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.511418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.511422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.511425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.511426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.511429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.511431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.511433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.511436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.511438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.511440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.511443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.511447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.511449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.511466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.513180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.513319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.513330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2734
2025-10-02T09:35:20.513433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.513453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.513458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.513461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.513741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2734 sessionId:  describe result for acl check
2025-10-02T09:35:20.513768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.513774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.513775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.513778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152705731:8974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.514135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152705731:8974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.515482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152705731:8974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.518535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152705731:8974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.518544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152705731:8974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.518545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152705731:8974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.518549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.519079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.520653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.520663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.520665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.520667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.520671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2733 [2:7556555669077132505:5756]
2025-10-02T09:35:20.520680Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.520689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.520691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.520692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.520693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.520702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.520710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.520714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.520745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.520750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.520751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.520753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.520754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.520789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.520794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.520812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.520820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.520828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.520842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705766:8974], now have 1 active actors on pipe
2025-10-02T09:35:20.520847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705692:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.520851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.520852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.520853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.520862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.520873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.520879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.520880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.520882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.520888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.520878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2733
2025-10-02T09:35:20.520889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.520879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2733
2025-10-02T09:35:20.520897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.520898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.520901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.520916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.520921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.520937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.520946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.520948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.520952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.520957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.520962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.520972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.521068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.521072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.521079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.521128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2734 partition: 0 MaxSeqNo: 36 sessionId: src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0
2025-10-02T09:35:20.521388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f7f175-57a20e85-8c9f4ec7-791ab73a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.523795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Write session: try to update token
2025-10-02T09:35:20.523810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.530159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.530175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.530177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.530178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.530182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.530184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.530186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132500:5756]
2025-10-02T09:35:20.530206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.530209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.530209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.530210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.530212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.530214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.530384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.536747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId: src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.539065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.603171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705773:9243]
2025-10-02T09:35:20.603383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2733, pipe: [1:7556555669152705773:9243]
2025-10-02T09:35:20.641833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.642060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.642069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.642081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705773:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.642206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.642268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705773:9243]
2025-10-02T09:35:20.642274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:20.642293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.642342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2734 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0
2025-10-02T09:35:20.642518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2734 sessionId: src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0 is DEAD
2025-10-02T09:35:20.642668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:20.642684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Write session will restart in 0.009582s
2025-10-02T09:35:20.642707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Write session: Do CDS request
2025-10-02T09:35:20.642712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.648425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.649710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.649808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.649814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.649820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.649845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.649871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132577:5750]
2025-10-02T09:35:20.650219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.650418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.650441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.650634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.650665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.650669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.650669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.650670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.650671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.650671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.650673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.650674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.650674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.650675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.650675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.650676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.650679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.650686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.650688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.650690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.650692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.650694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.650696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.650698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.650700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.650703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.650705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.650707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.650710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.650714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.650719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.650722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.650724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.650727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.650729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.650732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.650734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.650738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.650742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.650746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.650748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.650751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.650753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.650757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.650759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.650762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.650764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.650768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.650773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.650776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.650778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.650780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.650797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.653290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.653368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.653379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2735
2025-10-02T09:35:20.653494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.653513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.653516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.653519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.653822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2735 sessionId:  describe result for acl check
2025-10-02T09:35:20.653846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.653850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.653852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.653855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152705813:8404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.654223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152705813:8404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.655832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152705813:8404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.657958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152705813:8404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.657968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152705813:8404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.657970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152705813:8404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.657974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.658526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.660025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.660037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.660038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.660040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.660044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2734 [2:7556555669077132577:5750]
2025-10-02T09:35:20.660052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.660062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.660066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.660067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.660069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.660080Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.660084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.660088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.660121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.660126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.660127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.660129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.660131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.660164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.660169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.660175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.660180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.660188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.660202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705848:8404], now have 1 active actors on pipe
2025-10-02T09:35:20.660208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705774:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.660212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.660215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.660216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.660226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.660236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.660242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.660245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.660247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.660233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2734
2025-10-02T09:35:20.660247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.660249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.660237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2734
2025-10-02T09:35:20.660264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.660269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.660277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.660291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.660296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.660313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.660320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.660322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.660323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.660328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.660337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.660350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.660451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.660456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.660464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.660521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2735 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0
2025-10-02T09:35:20.660793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10df9e1-2e6ebe68-d56e797d-c9fa4aeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.663193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Write session: try to update token
2025-10-02T09:35:20.663208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.669446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.669459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.669460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.669463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.669466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.669469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.669471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132572:5750]
2025-10-02T09:35:20.669490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.669496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.669496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.669498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.669499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.669501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.669603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.675977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId: src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.678282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.742447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705856:9243]
2025-10-02T09:35:20.742659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2734, pipe: [1:7556555669152705856:9243]
2025-10-02T09:35:20.779842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.780060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.780069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.780081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705856:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.780244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.780310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.780317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705856:9243]
2025-10-02T09:35:20.780345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:20.780404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0
2025-10-02T09:35:20.780558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2735 sessionId: src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0 is DEAD
2025-10-02T09:35:20.780705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:20.780720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Write session will restart in 0.005030s
2025-10-02T09:35:20.780741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Write session: Do CDS request
2025-10-02T09:35:20.780747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.786396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.787176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.787389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.787400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2736
2025-10-02T09:35:20.787503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.787529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.787538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.787541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.787716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.787809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.787816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.787822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.787814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2736 sessionId:  describe result for acl check
2025-10-02T09:35:20.787840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.787844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.787848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.787845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.787848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152705893:8958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.787873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132664:5747]
2025-10-02T09:35:20.788141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152705893:8958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.788207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.788421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.788442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.788616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.788645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.788649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.788649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.788650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.788650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.788651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.788652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.788659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.788660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.788661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.788661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.788662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.788664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.788670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.788672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.788674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.788676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.788678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.788680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.788682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.788684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.788686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.788688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.788689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.788693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.788697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.788700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.788702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.788704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.788707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.788709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.788712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.788714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.788721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.788723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.788726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.788728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.788732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.788734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.788738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.788741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.788743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.788745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.788748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.788751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.788754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.788756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.788759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.788777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.789444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152705893:8958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.794526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152705893:8958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.794535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152705893:8958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.794539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152705893:8958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.794543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.796196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.797667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.797679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.797680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.797682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.797685Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2735 [2:7556555669077132664:5747]
2025-10-02T09:35:20.797692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.797702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.797708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.797710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.797711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.797721Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.797724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.797732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.797763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.797767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.797768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.797770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.797771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.797804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.797809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.797815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.797820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.797828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.797843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705932:8958], now have 1 active actors on pipe
2025-10-02T09:35:20.797848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705857:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.797851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.797852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.797853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.797860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.797870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.797880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.797883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.797885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.797886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.797888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.797882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2735
2025-10-02T09:35:20.797899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.797888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2735
2025-10-02T09:35:20.797904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.797906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.797920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.797924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.797952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c335deb-ca755e1e-174c78cd-e1818842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.797958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.797960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.797961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.797966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.797974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.797990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.798134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.798138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.798146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.798208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2736 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c335deb-ca755e1e-174c78cd-e1818842_0
2025-10-02T09:35:20.798457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3d7094-979c2ba5-8bdeeb52-ddee38a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c335deb-ca755e1e-174c78cd-e1818842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.800775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Write session: try to update token
2025-10-02T09:35:20.800787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.807038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.807051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.807052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.807053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.807057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.807064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.807066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132659:5747]
2025-10-02T09:35:20.807085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.807088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.807089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.807118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.807133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.807137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.807206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.813705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId: src_id|1c335deb-ca755e1e-174c78cd-e1818842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.815938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:20.880670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555669152705962:9243]
2025-10-02T09:35:20.880894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2735, pipe: [1:7556555669152705962:9243]
2025-10-02T09:35:20.919021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:20.919302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.919311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.919323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705962:9243], now have 1 active actors on pipe
2025-10-02T09:35:20.919445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:20.919470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:20.919492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:20.919506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555669152705962:9243]
2025-10-02T09:35:20.919563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2736 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c335deb-ca755e1e-174c78cd-e1818842_0
2025-10-02T09:35:20.919732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2736 sessionId: src_id|1c335deb-ca755e1e-174c78cd-e1818842_0 is DEAD
2025-10-02T09:35:20.919897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:20.919913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Write session will restart in 0.008737s
2025-10-02T09:35:20.919944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Write session: Do CDS request
2025-10-02T09:35:20.919951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:20.925493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:20.926585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:20.926724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:20.926730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:20.926736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:20.926766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:20.926792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555669077132761:5725]
2025-10-02T09:35:20.927139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:20.927330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:20.927351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:20.927526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:20.927557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.927561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.927561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.927562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.927563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.927563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.927564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.927564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.927565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.927565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.927566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.927567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.927569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.927576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.927579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.927581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.927583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.927585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.927587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.927589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.927591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.927593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.927595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.927597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.927601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.927606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:20.927609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.927612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:20.927614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.927618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:20.927620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.927622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:20.927626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.927628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:20.927631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.927633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:20.927635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.927637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:20.927639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.927642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:20.927644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.927646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:20.927648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.927650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.927652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.927655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.927657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.927660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.927677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:20.930224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.930339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:20.930350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2737
2025-10-02T09:35:20.930484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:20.930504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:20.930510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:20.930513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:20.930794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2737 sessionId:  describe result for acl check
2025-10-02T09:35:20.930819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:20.930824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:20.930825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:20.930827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555669152706011:8938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:20.931172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555669152706011:8938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:20.933057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555669152706011:8938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:20.934851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555669152706011:8938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:20.934860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555669152706011:8938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:20.934861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555669152706011:8938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:20.934865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:20.935279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:20.936785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:20.936817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:20.936824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:20.936826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:20.936830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2736 [2:7556555669077132761:5725]
2025-10-02T09:35:20.936839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:20.936849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:20.936850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.936852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.936853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.936864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:20.936871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:20.936875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:20.936908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.936913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.936914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.936916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:20.936918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:20.936962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:20.936968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.936979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:20.936992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:20.937009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:20.937026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152706045:8938], now have 1 active actors on pipe
2025-10-02T09:35:20.937033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555669152705970:2446], now have 1 active actors on pipe
2025-10-02T09:35:20.937038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.937043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.937044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.937052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:20.937065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:20.937066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:20.937055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2736
2025-10-02T09:35:20.937069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:20.937070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:20.937066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2736
2025-10-02T09:35:20.937080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:20.937083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:20.937111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.937119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.937132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.937141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:20.937154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:20.937166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:20.937175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:20.937181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:20.937183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:20.937189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:20.937200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:20.937220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.937306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:20.937313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:20.937324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:20.937371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2737 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0
2025-10-02T09:35:20.937656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c335deb-ca755e1e-174c78cd-e1818842_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:20.940217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Write session: try to update token
2025-10-02T09:35:20.940234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:20.946306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:20.946320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:20.946321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:20.946323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:20.946328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.946331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.946333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555669077132756:5725]
2025-10-02T09:35:20.946356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:20.946364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:20.946367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:20.946369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:20.946372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:20.946376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:20.946492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:20.954116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId: src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:20.956311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.019417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673353:9243]
2025-10-02T09:35:21.019649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2736, pipe: [1:7556555673447673353:9243]
2025-10-02T09:35:21.060318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.060596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.060605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.060619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673353:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.060849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673353:9243]
2025-10-02T09:35:21.060860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:21.060863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:21.060875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.060911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2737 reason: error at write: Disconnected sessionId: src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0
2025-10-02T09:35:21.061049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2737 sessionId: src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0 is DEAD
2025-10-02T09:35:21.061072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.061246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:21.061262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Write session will restart in 0.009251s
2025-10-02T09:35:21.061289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Write session: Do CDS request
2025-10-02T09:35:21.061296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.067012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.068019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.068123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.068129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.068135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.068162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.068188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100134:5722]
2025-10-02T09:35:21.068534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.068773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.068816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.069003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.069033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.069037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.069038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.069038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.069039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.069039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.069040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.069041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.069041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.069042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.069042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.069043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.069046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.069053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.069055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.069057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.069059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.069061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.069063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.069065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.069067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.069069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.069071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.069075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.069079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.069083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.069087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.069090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.069092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.069095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.069098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.069101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.069103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.069106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.069108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.069111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.069116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.069119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.069122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.069126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.069131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.069135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.069137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.069139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.069141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.069144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.069146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.069152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.069168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.071288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.071335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.071346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2738
2025-10-02T09:35:21.071480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.071498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.071504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.071507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.071773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2738 sessionId:  describe result for acl check
2025-10-02T09:35:21.071790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.071795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.071796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.071798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673395:8932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.072141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673395:8932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.073499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673395:8932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.076081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673395:8932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.076091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673395:8932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.076093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673395:8932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.076096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.076677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.078342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.078356Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.078357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.078361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.078364Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2737 [2:7556555673372100134:5722]
2025-10-02T09:35:21.078372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.078382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.078388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.078389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.078391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.078400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.078402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.078408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.078438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.078443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.078444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.078446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.078447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.078501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.078508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.078517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.078530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.078548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.078565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673430:8932], now have 1 active actors on pipe
2025-10-02T09:35:21.078573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673354:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.078577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.078583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.078584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.078577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2737
2025-10-02T09:35:21.078579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2737
2025-10-02T09:35:21.078596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.078601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.078603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.078605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.078609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.078621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.078626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.078658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.078666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.078677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.078686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.078693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.078705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.078716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.078722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.078724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.078733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.078743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.078761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.078837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.078844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.078854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.078899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2738 partition: 0 MaxSeqNo: 36 sessionId: src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0
2025-10-02T09:35:21.079143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bcab995-d362ee82-965d2e0d-94b4ff2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.081698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Write session: try to update token
2025-10-02T09:35:21.081714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.087863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.087876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.087877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.087878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.087881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.087885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.087887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100128:5722]
2025-10-02T09:35:21.087910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.087916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.087921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.087923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.087927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.087931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.088033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.095228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId: src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.097357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.161250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673437:9243]
2025-10-02T09:35:21.161424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2737, pipe: [1:7556555673447673437:9243]
2025-10-02T09:35:21.199746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.199958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.199966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.199979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673437:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.200265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:21.200269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673437:9243]
2025-10-02T09:35:21.200278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:21.200288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.200319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2738 reason: error at write: Disconnected sessionId: src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0
2025-10-02T09:35:21.200418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.200452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2738 sessionId: src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0 is DEAD
2025-10-02T09:35:21.200634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:21.200649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Write session will restart in 0.009775s
2025-10-02T09:35:21.200691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Write session: Do CDS request
2025-10-02T09:35:21.200697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.207009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.208501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.208614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.208621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.208626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.208652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.208677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100225:5714]
2025-10-02T09:35:21.209040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.209277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.209303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.209496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.209525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.209530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.209531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.209531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.209532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.209532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.209533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.209535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.209536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.209536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.209537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.209537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.209540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.209546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.209549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.209551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.209553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.209555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.209557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.209559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.209561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.209564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.209566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.209568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.209572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.209575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.209579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.209581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.209584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.209586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.209589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.209592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.209594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.209597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.209598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.209601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.209603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.209606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.209609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.209611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.209613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.209616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.209619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.209621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.209623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.209626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.209629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.209634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.209652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.211152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.211387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.211398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2739
2025-10-02T09:35:21.211514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.211534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.211540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.211543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.211893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2739 sessionId:  describe result for acl check
2025-10-02T09:35:21.211918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.211924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.211925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.211928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673494:8922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.212308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673494:8922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.213816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673494:8922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.216529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673494:8922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.216538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673494:8922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.216540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673494:8922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.216544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.217114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.218647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.218659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.218661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.218663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.218666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2738 [2:7556555673372100225:5714]
2025-10-02T09:35:21.218674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.218683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.218685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.218687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.218688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.218698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.218705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.218709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.218746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.218752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.218753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.218755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.218756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.218794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.218799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.218806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.218812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.218820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.218833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673529:8922], now have 1 active actors on pipe
2025-10-02T09:35:21.218838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673451:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.218843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.218844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.218845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.218854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.218848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2738
2025-10-02T09:35:21.218855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2738
2025-10-02T09:35:21.218865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.218871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.218874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.218876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.218882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.218884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.218899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.218904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.218912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.218920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.218932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.218939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33728942-e0cb740a-cfe01649-6d42a624_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.218943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.218946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.218947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.218954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.218959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.218977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.219057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.219062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.219070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.219116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2739 partition: 0 MaxSeqNo: 36 sessionId: src_id|33728942-e0cb740a-cfe01649-6d42a624_0
2025-10-02T09:35:21.219389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b1c3e00-5c3cb80-57729771-648bcd39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33728942-e0cb740a-cfe01649-6d42a624_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.221948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Write session: try to update token
2025-10-02T09:35:21.221966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.228318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.228329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.228330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.228332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.228335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.228338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.228340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100220:5714]
2025-10-02T09:35:21.228361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.228364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.228365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.228365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.228368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.228370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.228470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.235614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId: src_id|33728942-e0cb740a-cfe01649-6d42a624_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.237793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.300502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673538:9243]
2025-10-02T09:35:21.300670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2738, pipe: [1:7556555673447673538:9243]
2025-10-02T09:35:21.340043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.340263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.340271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.340283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673538:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.340408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.340433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673538:9243]
2025-10-02T09:35:21.340451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.340458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:21.340511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2739 reason: status is not ok: tablet will be restarted right now sessionId: src_id|33728942-e0cb740a-cfe01649-6d42a624_0
2025-10-02T09:35:21.340648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2739 sessionId: src_id|33728942-e0cb740a-cfe01649-6d42a624_0 is DEAD
2025-10-02T09:35:21.340864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:21.340906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Write session will restart in 0.005849s
2025-10-02T09:35:21.340932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Write session: Do CDS request
2025-10-02T09:35:21.340939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.346630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.347870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.347989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.347996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.348002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.348031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.348056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100303:5702]
2025-10-02T09:35:21.348260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.348321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.348330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2740
2025-10-02T09:35:21.348397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.348450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.348467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.348471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.348474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.348585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.348608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.348709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2740 sessionId:  describe result for acl check
2025-10-02T09:35:21.348726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.348731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.348734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.348737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673582:8918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.348834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.348867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.348872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.348873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.348873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.348874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.348874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.348875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.348877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.348878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.348878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.348879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.348880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.348883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.348889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.348891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.348893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.348895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.348897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.348899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.348901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.348903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.348905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.348907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.348909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.348913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.348917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.348920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.348923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.348925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.348927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.348929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.348932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.348934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.348937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.348941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.348944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.348946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.348949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.348952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.348958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.348961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.348963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.348965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.348971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.348973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.348975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.348980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.348983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.349000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.349101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673582:8918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.350541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673582:8918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.354262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673582:8918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.354270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673582:8918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.354272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673582:8918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.354275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.356443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.357922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.357934Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.357936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.357938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.357942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2739 [2:7556555673372100303:5702]
2025-10-02T09:35:21.357949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.357958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.357963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.357965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.357966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.357974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.357981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.357985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.358019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.358024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.358025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.358027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.358028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.358062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.358067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.358073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.358079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.358090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.358105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673539:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.358111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673619:8918], now have 1 active actors on pipe
2025-10-02T09:35:21.358115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.358119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.358120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.358128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.358116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2739
2025-10-02T09:35:21.358140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.358141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.358124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2739
2025-10-02T09:35:21.358143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.358146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.358150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.358152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.358174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.358179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.358187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.358195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.358209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.358216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.358219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.358221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.358222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.358227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.358231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.358246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.358342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.358347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.358355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.358396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2740 partition: 0 MaxSeqNo: 36 sessionId: src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0
2025-10-02T09:35:21.358664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33728942-e0cb740a-cfe01649-6d42a624_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.361213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Write session: try to update token
2025-10-02T09:35:21.361229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.367282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.367293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.367295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.367295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.367299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.367301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.367302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100298:5702]
2025-10-02T09:35:21.367320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.367323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.367325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.367326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.367328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.367330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.367431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.374025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId: src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.376144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.440796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673626:9243]
2025-10-02T09:35:21.440981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2739, pipe: [1:7556555673447673626:9243]
2025-10-02T09:35:21.476272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.476514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.476523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.476535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673626:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.476695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673626:9243]
2025-10-02T09:35:21.476706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:21.476710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:21.476714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.476757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2740 reason: error at write: Disconnected sessionId: src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0
2025-10-02T09:35:21.476817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.476908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2740 sessionId: src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0 is DEAD
2025-10-02T09:35:21.477096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:21.477110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Write session will restart in 0.007565s
2025-10-02T09:35:21.477135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Write session: Do CDS request
2025-10-02T09:35:21.477142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.482766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.483973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.484069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.484076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.484081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.484108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.484131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100383:5695]
2025-10-02T09:35:21.484470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.484658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.484681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.484866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.484898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.484901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.484902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.484903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.484903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.484903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.484905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.484906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.484906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.484907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.484907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.484908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.484911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.484918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.484920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.484922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.484923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.484926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.484928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.484929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.484931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.484933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.484935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.484937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.484941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.484945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.484948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.484951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.484953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.484955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.484957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.484960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.484962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.484964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.484968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.484970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.484973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.484976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.484979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.484981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.484983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.484987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.484988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.484991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.484993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.484995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.485000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.485003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.485021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.486281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.486384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.486392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2741
2025-10-02T09:35:21.486521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.486540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.486542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.486545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.486799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2741 sessionId:  describe result for acl check
2025-10-02T09:35:21.486823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.486828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.486829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.486832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673672:8907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.487174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673672:8907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.488740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673672:8907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.491914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673672:8907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.491924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673672:8907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.491927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673672:8907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.491931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.492416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.493868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.493880Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.493882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.493884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.493887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2740 [2:7556555673372100383:5695]
2025-10-02T09:35:21.493895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.493907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.493912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.493914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.493916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.493924Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.493927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.493932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.493962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.493967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.493968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.493970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.493971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.494007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.494012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.494018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.494023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.494031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.494045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673707:8907], now have 1 active actors on pipe
2025-10-02T09:35:21.494050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673627:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.494054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.494055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.494056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.494063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.494073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.494075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.494077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.494078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.494084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.494085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.494083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2740
2025-10-02T09:35:21.494099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.494104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.494105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.494084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2740
2025-10-02T09:35:21.494155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.494161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.494179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f77f183-33d157a7-1caba522-42588f7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.494186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.494188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.494189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.494194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.494200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.494208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.494291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.494296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.494303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.494352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2741 partition: 0 MaxSeqNo: 36 sessionId: src_id|8f77f183-33d157a7-1caba522-42588f7e_0
2025-10-02T09:35:21.494626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aac5f1e-f6d2459-159ba3af-1f079ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8f77f183-33d157a7-1caba522-42588f7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.497090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Write session: try to update token
2025-10-02T09:35:21.497107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.503171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.503183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.503184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.503185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.503189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.503192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.503195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100378:5695]
2025-10-02T09:35:21.503213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.503217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.503217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.503219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.503221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.503224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.503331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.510290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId: src_id|8f77f183-33d157a7-1caba522-42588f7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.512447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.576990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673718:9243]
2025-10-02T09:35:21.577171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2740, pipe: [1:7556555673447673718:9243]
2025-10-02T09:35:21.615753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.616007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.616016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.616028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673718:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.616142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.616147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673718:9243]
2025-10-02T09:35:21.616154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:21.616157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:21.616181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.616207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2741 reason: error at write: Disconnected sessionId: src_id|8f77f183-33d157a7-1caba522-42588f7e_0
2025-10-02T09:35:21.616349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2741 sessionId: src_id|8f77f183-33d157a7-1caba522-42588f7e_0 is DEAD
2025-10-02T09:35:21.616511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:21.616527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Write session will restart in 0.005741s
2025-10-02T09:35:21.616557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Write session: Do CDS request
2025-10-02T09:35:21.616564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.622819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.623256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.623354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.623366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2742
2025-10-02T09:35:21.623477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.623498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.623504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.623508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.623782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2742 sessionId:  describe result for acl check
2025-10-02T09:35:21.623804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.623809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.623810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.623815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673760:8900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.624057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.624162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673760:8900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.624176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.624185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.624191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.624223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.624248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100463:5696]
2025-10-02T09:35:21.624591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.624834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.624865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.625049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.625080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.625084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.625085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.625085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.625086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.625086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.625087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.625087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.625088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.625088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.625089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.625089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.625092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.625098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.625100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.625103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.625104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.625106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.625108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.625110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.625114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.625116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.625118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.625120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.625125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.625129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.625132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.625135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.625137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.625139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.625141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.625144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.625146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.625149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.625151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.625154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.625157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.625159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.625162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.625164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.625166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.625169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.625171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.625174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.625176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.625178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.625180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.625183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.625201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.625568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673760:8900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.630009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673760:8900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.630018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673760:8900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.630020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673760:8900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.630024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.632696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.634270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.634283Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.634286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.634288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.634292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2741 [2:7556555673372100463:5696]
2025-10-02T09:35:21.634301Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.634312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.634318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.634320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.634322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.634332Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.634335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.634340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.634375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.634380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.634381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.634382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.634383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.634465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.634480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.634489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.634500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.634518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.634515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2741
2025-10-02T09:35:21.634529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2741
2025-10-02T09:35:21.634538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673800:8900], now have 1 active actors on pipe
2025-10-02T09:35:21.634544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673719:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.634549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.634551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.634553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.634562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.634570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.634572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.634578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.634580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.634583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.634586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.634600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.634607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.634626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.634635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.634650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.634651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.634661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.634663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.634665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.634671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.634682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.634709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.634814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.634821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.634834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.634889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2742 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0
2025-10-02T09:35:21.635207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f77f183-33d157a7-1caba522-42588f7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.637777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Write session: try to update token
2025-10-02T09:35:21.637792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.644048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.644061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.644062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.644063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.644068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.644070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.644072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100458:5696]
2025-10-02T09:35:21.644098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.644103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.644104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.644118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.644130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.644134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.644220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.651359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId: src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.653448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.716263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673809:9243]
2025-10-02T09:35:21.716489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2741, pipe: [1:7556555673447673809:9243]
2025-10-02T09:35:21.753957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.754203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.754213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.754225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673809:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.754396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.754418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:21.754421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:21.754435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673809:9243]
2025-10-02T09:35:21.754439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.754483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2742 reason: error at write: Disconnected sessionId: src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0
2025-10-02T09:35:21.754635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2742 sessionId: src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0 is DEAD
2025-10-02T09:35:21.754809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:21.754824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Write session will restart in 0.009355s
2025-10-02T09:35:21.754848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Write session: Do CDS request
2025-10-02T09:35:21.754856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.760579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.761757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.761858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.761865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.761870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.761894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.761916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100543:5700]
2025-10-02T09:35:21.762257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.762443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.762465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.762649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.762678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.762683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.762683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.762684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.762684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.762685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.762685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.762686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.762687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.762687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.762688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.762688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.762691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.762698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.762700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.762702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.762704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.762705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.762707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.762709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.762711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.762713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.762715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.762717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.762722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.762725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.762728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.762731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.762733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.762735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.762737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.762740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.762743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.762746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.762748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.762750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.762753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.762756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.762758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.762761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.762763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.762766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.762768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.762770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.762772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.762774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.762776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.762779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.762795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.765373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.765386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2743
2025-10-02T09:35:21.765499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.765696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.765717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.765723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.765726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.765981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2743 sessionId:  describe result for acl check
2025-10-02T09:35:21.766003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.766007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.766008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.766011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673858:8896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.766347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673858:8896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.767792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673858:8896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.769641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673858:8896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.769649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673858:8896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.769650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673858:8896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.769654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.770201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.771629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.771641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.771642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.771644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.771647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2742 [2:7556555673372100543:5700]
2025-10-02T09:35:21.771655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.771666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.771671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.771674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.771675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.771684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.771690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.771694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.771724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.771729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.771730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.771732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.771733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.771767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.771772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.771779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.771785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.771793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.771806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673810:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.771810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673892:8896], now have 1 active actors on pipe
2025-10-02T09:35:21.771813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.771814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.771815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.771822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.771830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.771835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.771837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.771838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.771840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.771841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.771836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2742
2025-10-02T09:35:21.771837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2742
2025-10-02T09:35:21.771859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.771864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.771866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.771875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.771879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.771901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fcd6980-7ef779d8-b35db16-994049e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.771908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.771914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.771918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.771923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.771928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.771939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.772036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.772041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.772049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.772097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2743 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fcd6980-7ef779d8-b35db16-994049e1_0
2025-10-02T09:35:21.772380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e7cb9-c068d174-7805aa7e-c4279726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fcd6980-7ef779d8-b35db16-994049e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.774897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Write session: try to update token
2025-10-02T09:35:21.774912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.780909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.780920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.780922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.780922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.780926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.780929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.780931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100538:5700]
2025-10-02T09:35:21.780949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.780952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.780952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.780954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.780954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.780957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.781080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.788087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId: src_id|7fcd6980-7ef779d8-b35db16-994049e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.790264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.854490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447673922:9243]
2025-10-02T09:35:21.854600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2742, pipe: [1:7556555673447673922:9243]
2025-10-02T09:35:21.890030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:21.890284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.890291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.890303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673922:9243], now have 1 active actors on pipe
2025-10-02T09:35:21.890446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:21.890487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:21.890493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:21.890522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447673922:9243]
2025-10-02T09:35:21.890551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2743 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fcd6980-7ef779d8-b35db16-994049e1_0
2025-10-02T09:35:21.890682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2743 sessionId: src_id|7fcd6980-7ef779d8-b35db16-994049e1_0 is DEAD
2025-10-02T09:35:21.890857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:21.890872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Write session will restart in 0.008233s
2025-10-02T09:35:21.890892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Write session: Do CDS request
2025-10-02T09:35:21.890898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:21.896552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:21.897660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:21.897754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:21.897761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:21.897766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:21.897791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:21.897816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555673372100662:5679]
2025-10-02T09:35:21.898154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:21.898333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:21.898354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:21.898535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:21.898563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.898567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.898567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.898568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.898568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.898569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.898569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.898570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.898571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.898571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.898572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.898572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.898575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.898581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.898583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.898585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.898587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.898589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.898593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.898595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.898597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.898599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.898602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.898605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.898609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:21.898612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.898615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:21.898617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.898620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:21.898622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.898624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:21.898627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.898629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:21.898631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.898634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:21.898636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.898639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:21.898641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.898644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:21.898647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.898650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:21.898656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.898658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.898660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.898663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.898667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.898670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.898689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:21.900245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.900339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:21.900347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2744
2025-10-02T09:35:21.900466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:21.900487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:21.900489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:21.900492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:21.900786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2744 sessionId:  describe result for acl check
2025-10-02T09:35:21.900822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:21.900826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:21.900827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:21.900830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555673447673974:8874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:21.901154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555673447673974:8874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:21.902617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555673447673974:8874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:21.905539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555673447673974:8874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:21.905549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555673447673974:8874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:21.905551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555673447673974:8874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:21.905555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:21.906111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:21.907620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:21.907633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:21.907634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:21.907637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:21.907640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2743 [2:7556555673372100662:5679]
2025-10-02T09:35:21.907647Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:21.907657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:21.907658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.907659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.907661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.907669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:21.907672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:21.907676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:21.907705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.907711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.907712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.907714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:21.907715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:21.907747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:21.907751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.907758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:21.907762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:21.907771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:21.907784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447674012:8874], now have 1 active actors on pipe
2025-10-02T09:35:21.907789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447673926:2446], now have 1 active actors on pipe
2025-10-02T09:35:21.907792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.907793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.907794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.907802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:21.907809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:21.907815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:21.907817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:21.907818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:21.907818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2743
2025-10-02T09:35:21.907819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:21.907823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2743
2025-10-02T09:35:21.907821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:21.907834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.907836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:21.907838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:21.907850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.907856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.907874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:21.907882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:21.907884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:21.907885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:21.907891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:21.907898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:21.907909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.908019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:21.908024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:21.908032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:21.908091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2744 partition: 0 MaxSeqNo: 36 sessionId: src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0
2025-10-02T09:35:21.908312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcd6980-7ef779d8-b35db16-994049e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:21.911109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Write session: try to update token
2025-10-02T09:35:21.911121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:21.917129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:21.917143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:21.917144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:21.917145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:21.917150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.917152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.917155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555673372100657:5679]
2025-10-02T09:35:21.917177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:21.917177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:21.917179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:21.917179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:21.917180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:21.917182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:21.917290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:21.924297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId: src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:21.926311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:21.990682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555673447674023:9243]
2025-10-02T09:35:21.990847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2743, pipe: [1:7556555673447674023:9243]
2025-10-02T09:35:22.025998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.026276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.026284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.026297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555673447674023:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.026417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.026463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555673447674023:9243]
2025-10-02T09:35:22.026479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:22.026495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.026534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2744 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0
2025-10-02T09:35:22.026663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2744 sessionId: src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0 is DEAD
2025-10-02T09:35:22.026812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:22.026825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Write session will restart in 0.008472s
2025-10-02T09:35:22.026849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Write session: Do CDS request
2025-10-02T09:35:22.026854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.033024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.034479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.034590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.034597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.034603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.034629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.034654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068041:5677]
2025-10-02T09:35:22.034994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.035169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.035191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.035366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.035395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.035399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.035400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.035400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.035401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.035402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.035402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.035403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.035403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.035404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.035405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.035405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.035408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.035415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.035417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.035419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.035423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.035425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.035427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.035428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.035430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.035433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.035435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.035437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.035441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.035445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.035448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.035451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.035454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.035456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.035458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.035461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.035463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.035466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.035468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.035470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.035473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.035476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.035478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.035480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.035483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.035485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.035488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.035490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.035493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.035496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.035498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.035500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.035517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.036164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.036245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.036257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2745
2025-10-02T09:35:22.036346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.036368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.036377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.036380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.036691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2745 sessionId:  describe result for acl check
2025-10-02T09:35:22.036714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.036718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.036719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.036722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641370:8870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.037088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641370:8870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.038788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641370:8870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.042475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641370:8870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.042486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641370:8870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.042489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641370:8870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.042493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.043018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.044444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.044456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.044458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.044460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.044463Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2744 [2:7556555677667068041:5677]
2025-10-02T09:35:22.044502Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.044515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.044517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.044519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.044520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.044530Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.044537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.044541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.044577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.044582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.044583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.044585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.044586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.044623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.044628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.044634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.044639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.044647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.044660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641405:8870], now have 1 active actors on pipe
2025-10-02T09:35:22.044665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641321:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.044669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.044670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.044671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.044679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.044690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.044685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2744
2025-10-02T09:35:22.044686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2744
2025-10-02T09:35:22.044691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.044693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.044694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.044700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.044702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.044723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.044728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.044735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.044742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.044751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.044760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.044764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.044766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.044769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.044775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.044781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.044793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.044875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.044880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.044888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.044935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2745 partition: 0 MaxSeqNo: 36 sessionId: src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0
2025-10-02T09:35:22.045234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66a8d583-c4673e23-516af3e8-dffc6bd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.047771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Write session: try to update token
2025-10-02T09:35:22.047785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.053760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.053773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.053774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.053776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.053779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.053782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.053783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068036:5677]
2025-10-02T09:35:22.053802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.053804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.053804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.053805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.053806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.053808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.053910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.061250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId: src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.063425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.126339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742641412:9243]
2025-10-02T09:35:22.126504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2744, pipe: [1:7556555677742641412:9243]
2025-10-02T09:35:22.162866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.163129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.163138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.163152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641412:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.163311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:22.163324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:22.163333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.163362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742641412:9243]
2025-10-02T09:35:22.163372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2745 reason: error at write: Disconnected sessionId: src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0
2025-10-02T09:35:22.163502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2745 sessionId: src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0 is DEAD
2025-10-02T09:35:22.163496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.163658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:22.163672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Write session will restart in 0.006400s
2025-10-02T09:35:22.163695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Write session: Do CDS request
2025-10-02T09:35:22.163700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.169753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.171113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.171229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.171240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2746
2025-10-02T09:35:22.171335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.171355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.171360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.171363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.171357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.171468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.171474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.171480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.171509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.171532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068139:5675]
2025-10-02T09:35:22.171618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2746 sessionId:  describe result for acl check
2025-10-02T09:35:22.171640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.171644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.171646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.171648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641459:8867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.171870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.171982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641459:8867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.172057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.172080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.172251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.172279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.172283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.172283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.172284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.172284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.172285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.172286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.172286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.172286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.172287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.172287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.172288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.172291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.172296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.172299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.172301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.172303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.172306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.172308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.172310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.172312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.172314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.172316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.172318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.172322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.172326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.172329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.172332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.172333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.172336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.172338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.172341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.172344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.172347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.172349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.172351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.172353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.172356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.172359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.172362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.172364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.172366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.172368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.172372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.172375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.172377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.172379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.172381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.172399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.173345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641459:8867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.177664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641459:8867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.177673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641459:8867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.177675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641459:8867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.177678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.179821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.181293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.181304Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.181305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.181307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.181311Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2745 [2:7556555677667068139:5675]
2025-10-02T09:35:22.181318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.181327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.181333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.181334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.181335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.181344Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.181346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.181351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.181379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.181384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.181385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.181386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.181387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.181423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.181428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.181433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.181439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.181446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.181461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641413:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.181466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641499:8867], now have 1 active actors on pipe
2025-10-02T09:35:22.181469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.181470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.181471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.181478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.181485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.181491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.181493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.181494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.181494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.181495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.181509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.181512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.181499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2745
2025-10-02T09:35:22.181503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2745
2025-10-02T09:35:22.181521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.181531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.181533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.181549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.181555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.181557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.181558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.181563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.181568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.181579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.181691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.181697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.181704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.181760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2746 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0
2025-10-02T09:35:22.181994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b89a9fec-35f28a3f-2f60fde9-1af7fd7f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.184334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Write session: try to update token
2025-10-02T09:35:22.184349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.190545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.190556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.190557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.190558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.190563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.190565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.190568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068133:5675]
2025-10-02T09:35:22.190587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.190590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.190591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.190591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.190593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.190595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.190702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.196593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId: src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.198759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.263594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742641518:9243]
2025-10-02T09:35:22.263773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2745, pipe: [1:7556555677742641518:9243]
2025-10-02T09:35:22.299275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.299500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.299509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.299522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641518:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.299639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.299650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:22.299654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.299663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:22.299684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742641518:9243]
2025-10-02T09:35:22.299715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2746 reason: error at write: Disconnected sessionId: src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0
2025-10-02T09:35:22.299850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2746 sessionId: src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0 is DEAD
2025-10-02T09:35:22.300063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:22.300078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Write session will restart in 0.007236s
2025-10-02T09:35:22.300099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Write session: Do CDS request
2025-10-02T09:35:22.300114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.305890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.307152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.307245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.307252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.307258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.307282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.307306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068223:5672]
2025-10-02T09:35:22.307644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.307827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.307849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.308023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.308052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.308056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.308057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.308057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.308058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.308058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.308059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.308059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.308060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.308060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.308061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.308061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.308064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.308071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.308073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.308075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.308077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.308079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.308081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.308083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.308085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.308087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.308089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.308091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.308096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.308100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.308105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.308108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.308110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.308112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.308114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.308117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.308119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.308122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.308124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.308127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.308129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.308132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.308153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.308134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.308136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.308138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.308141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.308143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.308145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.308148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.308150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.308152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.308156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.308173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.308255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.308265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2747
2025-10-02T09:35:22.308368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.308387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.308393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.308395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.308654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2747 sessionId:  describe result for acl check
2025-10-02T09:35:22.308678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.308682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.308683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.308686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641572:8856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.309038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641572:8856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.310536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641572:8856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.314328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641572:8856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.314338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641572:8856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.314340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641572:8856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.314344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.315533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.317010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.317021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.317023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.317025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.317028Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2746 [2:7556555677667068223:5672]
2025-10-02T09:35:22.317036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.317045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.317050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.317052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.317053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.317062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.317068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.317073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.317104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.317109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.317110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.317111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.317113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.317147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.317151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.317158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.317166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.317177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.317192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641606:8856], now have 1 active actors on pipe
2025-10-02T09:35:22.317199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641521:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.317202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.317203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.317204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.317211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.317218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.317224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.317226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.317227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.317229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.317231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.317227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2746
2025-10-02T09:35:22.317229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2746
2025-10-02T09:35:22.317244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.317249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.317252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.317268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.317273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.317288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.317295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.317297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.317298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.317303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.317308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.317318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.317415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.317421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.317429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.317482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2747 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0
2025-10-02T09:35:22.317730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e616937-eeea972f-8f3f84d2-60a1eecd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.320232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Write session: try to update token
2025-10-02T09:35:22.320250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.326247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.326260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.326261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.326262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.326265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.326267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.326269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068218:5672]
2025-10-02T09:35:22.326287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.326290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.326291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.326292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.326294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.326296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.326453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.333581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId: src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.335707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.399779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742641615:9243]
2025-10-02T09:35:22.399991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2746, pipe: [1:7556555677742641615:9243]
2025-10-02T09:35:22.436191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.436438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.436447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.436459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641615:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.436586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.436639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742641615:9243]
2025-10-02T09:35:22.436643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.436666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:22.436721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2747 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0
2025-10-02T09:35:22.436866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2747 sessionId: src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0 is DEAD
2025-10-02T09:35:22.436988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:22.437011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Write session will restart in 0.008751s
2025-10-02T09:35:22.437034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Write session: Do CDS request
2025-10-02T09:35:22.437040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.443142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.444250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.444361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.444367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.444373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.444398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.444424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068311:5664]
2025-10-02T09:35:22.444762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.444958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.444981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.445159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.445188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.445192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.445192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.445193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.445193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.445194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.445194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.445200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.445200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.445201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.445202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.445202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.445205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.445212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.445214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.445216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.445218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.445220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.445222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.445224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.445225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.445228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.445229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.445231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.445235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.445239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.445243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.445246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.445248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.445251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.445254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.445257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.445259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.445262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.445264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.445267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.445269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.445272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.445274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.445277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.445282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.445285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.445287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.445289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.445295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.445298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.445300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.445306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.445323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.447289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.447374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.447385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2748
2025-10-02T09:35:22.447488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.447507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.447513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.447515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.447799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2748 sessionId:  describe result for acl check
2025-10-02T09:35:22.447824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.447828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.447829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.447833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641667:8845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.448161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641667:8845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.449780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641667:8845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.452100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641667:8845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.452109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641667:8845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.452111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641667:8845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.452114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.452639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.454182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.454195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.454198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.454201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2747 [2:7556555677667068311:5664]
2025-10-02T09:35:22.454209Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.454220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.454225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.454226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.454227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.454237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.454240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.454247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.454278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.454282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.454283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.454285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.454286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.454320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.454325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.454332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.454337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.454348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.454360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.454364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.454365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.454371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.454378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.454380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641701:8845], now have 1 active actors on pipe
2025-10-02T09:35:22.454382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641616:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.454386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.454386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.454387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.454393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.454394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.454410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.454407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2747
2025-10-02T09:35:22.454419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.454414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2747
2025-10-02T09:35:22.454430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.454440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.454442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.454456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.454462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.454475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.454479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.454484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.454489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.454499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.454594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.454599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.454606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.454662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2748 partition: 0 MaxSeqNo: 36 sessionId: src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0
2025-10-02T09:35:22.454861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d2c72b9-85cfc01e-7c6b5c44-ffc4f2c2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.457848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Write session: try to update token
2025-10-02T09:35:22.457858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.463294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:22.463308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.463312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.463332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:22.463340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:22.463460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:22.463573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:22.463684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:22.463795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:22.463961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:22.463983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:22.471426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId: src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.471625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.471639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.471640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.471640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.471647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.471649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.471651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068305:5664]
2025-10-02T09:35:22.471669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.471670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.471672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.471673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.471674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.471676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.471790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.473831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.537007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742641710:9243]
2025-10-02T09:35:22.537235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2747, pipe: [1:7556555677742641710:9243]
2025-10-02T09:35:22.580405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.580633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.580641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.580654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641710:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.581019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:22.581033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:22.581035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742641710:9243]
2025-10-02T09:35:22.581050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.581075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2748 reason: error at write: Disconnected sessionId: src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0
2025-10-02T09:35:22.581162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.581227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2748 sessionId: src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0 is DEAD
2025-10-02T09:35:22.581412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:22.581426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Write session will restart in 0.006136s
2025-10-02T09:35:22.581446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Write session: Do CDS request
2025-10-02T09:35:22.581451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.587278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.588157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.588248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.588257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2749
2025-10-02T09:35:22.588357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.588377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.588383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.588385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.588571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.588666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.588673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.588678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.588691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2749 sessionId:  describe result for acl check
2025-10-02T09:35:22.588702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.588719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.588723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.588724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.588727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641760:8840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.588727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068398:5659]
2025-10-02T09:35:22.589078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.589093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641760:8840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.589275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.589298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.589474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.589503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.589507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.589507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.589508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.589508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.589509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.589510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.589510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.589511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.589511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.589512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.589512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.589515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.589521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.589523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.589525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.589527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.589530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.589532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.589535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.589537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.589539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.589541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.589543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.589546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.589550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.589553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.589555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.589557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.589560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.589562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.589565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.589567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.589570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.589572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.589575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.589577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.589580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.589582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.589584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.589586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.589589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.589590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.589593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.589597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.589600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.589604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.589606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.589624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.590607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641760:8840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.594861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641760:8840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.594871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641760:8840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.594873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641760:8840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.594877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.597027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.598477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.598488Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.598490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.598493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.598496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2748 [2:7556555677667068398:5659]
2025-10-02T09:35:22.598504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.598513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.598516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.598518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.598519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.598528Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.598531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.598536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.598566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.598571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.598572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.598574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.598575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.598612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.598617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.598624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.598629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.598637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.598650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641711:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.598655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641799:8840], now have 1 active actors on pipe
2025-10-02T09:35:22.598658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.598660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.598660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.598668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.598674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.598686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2748
2025-10-02T09:35:22.598689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2748
2025-10-02T09:35:22.598681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.598682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.598683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.598689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.598691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.598697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.598698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.598708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.598718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.598720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.598735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8048adc0-b2bf257d-caea698f-17de8187_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.598739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.598741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.598742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.598747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.598752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.598762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.598876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.598881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.598888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.598950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2749 partition: 0 MaxSeqNo: 36 sessionId: src_id|8048adc0-b2bf257d-caea698f-17de8187_0
2025-10-02T09:35:22.599131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158eb13f-c78b58db-22a01a3b-7c74fbbc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8048adc0-b2bf257d-caea698f-17de8187_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.602074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Write session: try to update token
2025-10-02T09:35:22.602084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.611583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:22.611594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.611598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.611623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:22.611631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:22.611756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:22.611868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:22.611981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:22.612091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:22.612248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:22.612272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:22.614705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId: src_id|8048adc0-b2bf257d-caea698f-17de8187_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.616166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.616178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.616179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.616180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.616184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.616187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.616189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068393:5659]
2025-10-02T09:35:22.616208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.616209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.616211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.616211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.616213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.616213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.616319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.616769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.681365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742641807:9243]
2025-10-02T09:35:22.681560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2748, pipe: [1:7556555677742641807:9243]
2025-10-02T09:35:22.724705Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.724943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.724951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.724964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641807:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.725083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.725142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742641807:9243]
2025-10-02T09:35:22.725149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:22.725170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.725216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2749 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8048adc0-b2bf257d-caea698f-17de8187_0
2025-10-02T09:35:22.725385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2749 sessionId: src_id|8048adc0-b2bf257d-caea698f-17de8187_0 is DEAD
2025-10-02T09:35:22.725498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:22.725505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Write session will restart in 0.008064s
2025-10-02T09:35:22.725524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Write session: Do CDS request
2025-10-02T09:35:22.725528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.731492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.733025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.733125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.733131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.733137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.733162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.733184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068486:10241]
2025-10-02T09:35:22.733530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.733707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.733729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.733903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.733931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.733934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.733935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.733935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.733936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.733937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.733937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.733938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.733938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.733939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.733939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.733940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.733943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.733950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.733952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.733954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.733956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.733958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.733960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.733962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.733963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.733966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.733968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.733969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.733973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.733977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.733980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.733983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.733986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.733989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.733991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.733994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.733996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.733998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.734000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.734003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.734005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.734008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.734010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.734012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.734015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.734018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.734020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.734024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.734026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.734029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.734032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.734034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.734051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.734233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.734564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.734574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2750
2025-10-02T09:35:22.734658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.734676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.734682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.734685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.734970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2750 sessionId:  describe result for acl check
2025-10-02T09:35:22.734995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.734999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.735000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.735003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641862:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.735348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641862:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.736505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641862:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.740428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641862:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.740438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641862:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.740440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641862:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.740443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.741703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.743159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.743170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.743171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.743173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.743176Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2749 [2:7556555677667068486:10241]
2025-10-02T09:35:22.743183Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.743193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.743196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.743198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.743201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.743211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.743217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.743221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.743252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.743256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.743257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.743259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.743260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.743300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.743305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.743311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.743317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.743326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.743340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641897:8830], now have 1 active actors on pipe
2025-10-02T09:35:22.743345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641808:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.743349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.743351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.743352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.743360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.743368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.743373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.743375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.743377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.743377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.743371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2749
2025-10-02T09:35:22.743379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.743378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2749
2025-10-02T09:35:22.743391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.743395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.743402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.743459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.743465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.743483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.743490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.743493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.743494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.743499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.743508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.743518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.743631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.743636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.743644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.743704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2750 partition: 0 MaxSeqNo: 36 sessionId: src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0
2025-10-02T09:35:22.743896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048adc0-b2bf257d-caea698f-17de8187_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.746699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Write session: try to update token
2025-10-02T09:35:22.746710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.752908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.752917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.752919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.752920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.752925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.752927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.752931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068481:10241]
2025-10-02T09:35:22.752951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.752954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.752955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.752994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.753002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.753006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.753068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.758342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId: src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.760365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.825239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742641904:9243]
2025-10-02T09:35:22.825389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2749, pipe: [1:7556555677742641904:9243]
2025-10-02T09:35:22.861789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.862306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.862317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.862329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641904:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.862504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:22.862518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:22.862561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2750 reason: error at write: Disconnected sessionId: src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0
2025-10-02T09:35:22.862675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.862686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2750 sessionId: src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0 is DEAD
2025-10-02T09:35:22.862833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:22.862854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Write session will restart in 0.005883s
2025-10-02T09:35:22.862824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.862848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742641904:9243]
2025-10-02T09:35:22.862874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Write session: Do CDS request
2025-10-02T09:35:22.862880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:22.868785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:22.870049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:22.870130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.870147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:22.870153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:22.870160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:22.870186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:22.870196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:22.870208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2751
2025-10-02T09:35:22.870255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555677667068605:10249]
2025-10-02T09:35:22.870283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:22.870301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:22.870307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:22.870310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:22.870548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2751 sessionId:  describe result for acl check
2025-10-02T09:35:22.870567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:22.870571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:22.870572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:22.870575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555677742641973:8819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:22.870607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:22.870798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:22.870820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:22.870864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555677742641973:8819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:22.870990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:22.871017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.871020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.871021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.871021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.871022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.871023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.871023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.871024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.871024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.871025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.871025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.871027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.871030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.871035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.871037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.871039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.871041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.871043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.871045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.871047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.871049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.871051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.871053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.871054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.871057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.871061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:22.871064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.871066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:22.871069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.871071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:22.871073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.871076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:22.871078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.871080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:22.871082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.871084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:22.871086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.871089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:22.871091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.871093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:22.871095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.871097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:22.871099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.871102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.871104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.871106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.871108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.871111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.871129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:22.872028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555677742641973:8819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:22.877001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555677742641973:8819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:22.877014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555677742641973:8819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:22.877016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555677742641973:8819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:22.877022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:22.878616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:22.880005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:22.880016Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:22.880017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:22.880019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:22.880022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2750 [2:7556555677667068605:10249]
2025-10-02T09:35:22.880029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:22.880038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:22.880043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.880045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.880046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.880055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:22.880061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:22.880066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:22.880097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.880102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.880104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.880106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:22.880107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:22.880137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:22.880142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.880148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:22.880156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:22.880163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:22.880177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742642007:8819], now have 1 active actors on pipe
2025-10-02T09:35:22.880182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742641919:2446], now have 1 active actors on pipe
2025-10-02T09:35:22.880186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.880187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.880188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.880195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:22.880205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:22.880204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:22.880206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:22.880207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:22.880215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:22.880217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:22.880229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.880212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2750
2025-10-02T09:35:22.880234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:22.880243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.880244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:22.880245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.880230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2750
2025-10-02T09:35:22.880270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:22.880276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:22.880279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:22.880280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:22.880285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:22.880293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:22.880305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.880407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.880416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.880431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:22.880489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2751 partition: 0 MaxSeqNo: 36 sessionId: src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0
2025-10-02T09:35:22.880691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3581b385-83e5b986-d67d3e0a-ac6b281e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:22.883221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Write session: try to update token
2025-10-02T09:35:22.883237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:22.889293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:22.889303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:22.889304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:22.889305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:22.889308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.889310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.889314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555677667068600:10249]
2025-10-02T09:35:22.889332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:22.889334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:22.889336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:22.889336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:22.889338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:22.889340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:22.889440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:22.895209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId: src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:22.897562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:22.962975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555677742642029:9243]
2025-10-02T09:35:22.963125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2750, pipe: [1:7556555677742642029:9243]
2025-10-02T09:35:22.997066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:22.997286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:22.997295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:22.997308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742642029:9243], now have 1 active actors on pipe
2025-10-02T09:35:22.997595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:22.997640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555677742642029:9243]
2025-10-02T09:35:22.997680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:22.997926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:22.997981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2751 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0
2025-10-02T09:35:22.998112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2751 sessionId: src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0 is DEAD
2025-10-02T09:35:22.998254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:22.998268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Write session will restart in 0.008721s
2025-10-02T09:35:22.998290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Write session: Do CDS request
2025-10-02T09:35:22.998295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.003666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.004836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.004946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.004954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.004960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.004988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.005014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962035996:10257]
2025-10-02T09:35:23.005364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.005538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.005560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.005738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.005767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.005771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.005771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.005772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.005772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.005773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.005773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.005774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.005774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.005775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.005775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.005777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.005780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.005787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.005789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.005791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.005793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.005795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.005797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.005799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.005801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.005803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.005805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.005807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.005811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.005814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.005818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.005821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.005823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.005826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.005828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.005831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.005833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.005836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.005838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.005841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.005843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.005846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.005848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.005851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.005854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.005856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.005863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.005865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.005867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.005871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.005873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.005876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.005895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.008195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.008303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.008313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2752
2025-10-02T09:35:23.008452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.008478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.008486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.008488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.008767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2752 sessionId:  describe result for acl check
2025-10-02T09:35:23.008796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.008798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.008811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.008813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037609385:8810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.009149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037609385:8810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.010600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037609385:8810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.013211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037609385:8810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.013220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037609385:8810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.013222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037609385:8810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.013225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.013511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.015030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.015038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.015040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.015042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.015045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2751 [2:7556555681962035996:10257]
2025-10-02T09:35:23.015052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.015064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.015069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.015071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.015072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.015082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.015084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.015090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.015121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.015126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.015127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.015130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.015132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.015168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.015172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.015179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.015184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.015191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.015205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609421:8810], now have 1 active actors on pipe
2025-10-02T09:35:23.015210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555677742642033:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.015214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.015215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.015216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.015224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.015235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.015237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.015239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.015240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.015234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2751
2025-10-02T09:35:23.015235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2751
2025-10-02T09:35:23.015243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.015244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.015259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.015262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.015264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.015278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.015284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.015302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e182c152-170b4369-f2de27e4-bc14468c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.015309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.015311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.015312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.015318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.015325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.015334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.015420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.015424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.015432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.015491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2752 partition: 0 MaxSeqNo: 36 sessionId: src_id|e182c152-170b4369-f2de27e4-bc14468c_0
2025-10-02T09:35:23.015696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c1eb4-4307539c-fbd913d1-9afee99e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e182c152-170b4369-f2de27e4-bc14468c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.018004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Write session: try to update token
2025-10-02T09:35:23.018018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.024351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.024362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.024363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.024366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.024369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.024371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.024373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962035991:10257]
2025-10-02T09:35:23.024391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.024394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.024395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.024395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.024397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.024399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.024514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.030200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId: src_id|e182c152-170b4369-f2de27e4-bc14468c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.032553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.097629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037609428:9243]
2025-10-02T09:35:23.097797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2751, pipe: [1:7556555682037609428:9243]
2025-10-02T09:35:23.133871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.134119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.134127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.134140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609428:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.134261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.134289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.134299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.134340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2752 reason: error at write: Disconnected sessionId: src_id|e182c152-170b4369-f2de27e4-bc14468c_0
2025-10-02T09:35:23.134493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2752 sessionId: src_id|e182c152-170b4369-f2de27e4-bc14468c_0 is DEAD
2025-10-02T09:35:23.134542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037609428:9243]
2025-10-02T09:35:23.134570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.134651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.134676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Write session will restart in 0.006920s
2025-10-02T09:35:23.134700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Write session: Do CDS request
2025-10-02T09:35:23.134706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.140566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.141804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.141894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.141900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.141906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.141929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.141951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036102:10261]
2025-10-02T09:35:23.142142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.142236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.142246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2753
2025-10-02T09:35:23.142293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.142348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.142367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.142373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.142376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.142533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.142554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.142648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2753 sessionId:  describe result for acl check
2025-10-02T09:35:23.142674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.142678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.142679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.142682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037609484:8798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.142731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.142759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.142763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.142763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.142764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.142764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.142765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.142765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.142766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.142767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.142767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.142768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.142768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.142771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.142778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.142780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.142782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.142784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.142786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.142788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.142790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.142792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.142795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.142797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.142799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.142803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.142807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.142810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.142813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.142816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.142819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.142821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.142824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.142826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.142828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.142831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.142837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.142839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.142842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.142844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.142846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.142848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.142851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.142853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.142856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.142858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.142861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.142863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.142866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.142881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.143030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037609484:8798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.144661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037609484:8798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.149199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037609484:8798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.149206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037609484:8798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.149208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037609484:8798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.149212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.150447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.151828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.151839Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.151840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.151842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.151845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2752 [2:7556555681962036102:10261]
2025-10-02T09:35:23.151855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.151865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.151869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.151871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.151872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.151883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.151888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.151893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.151925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.151929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.151930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.151932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.151933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.151967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.151972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.151978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.151983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.151994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.152007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609429:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.152012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609519:8798], now have 1 active actors on pipe
2025-10-02T09:35:23.152015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.152016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.152017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.152024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.152031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.152037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.152039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.152040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.152041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.152043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.152057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.152047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2752
2025-10-02T09:35:23.152062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.152063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.152047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2752
2025-10-02T09:35:23.152076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.152082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.152100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.152106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.152108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.152109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.152114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.152120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.152131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.152234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.152239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.152247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.152315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2753 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0
2025-10-02T09:35:23.152538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e182c152-170b4369-f2de27e4-bc14468c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.154868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Write session: try to update token
2025-10-02T09:35:23.154882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.161183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.161194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.161195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.161196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.161200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.161202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.161204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036097:10261]
2025-10-02T09:35:23.161229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.161237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.161238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.161248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.161259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.161262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.161495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.168845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId: src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.171001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.234832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037609540:9243]
2025-10-02T09:35:23.235082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2752, pipe: [1:7556555682037609540:9243]
2025-10-02T09:35:23.271306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.271548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.271557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.271570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609540:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.271735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.271768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.271826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037609540:9243]
2025-10-02T09:35:23.271842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.271844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.271889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2753 reason: error at write: Disconnected sessionId: src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0
2025-10-02T09:35:23.272009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2753 sessionId: src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0 is DEAD
2025-10-02T09:35:23.272137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.272151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Write session will restart in 0.007606s
2025-10-02T09:35:23.272172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Write session: Do CDS request
2025-10-02T09:35:23.272179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.278948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.280082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.280188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.280194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.280199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.280226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.280252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036192:10263]
2025-10-02T09:35:23.280601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.280823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.280851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.281044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.281091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.281074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.281078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.281079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.281080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.281080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.281081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.281081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.281082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.281083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.281083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.281084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.281084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.281087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.281094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.281096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.281099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.281101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.281103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.281105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.281107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.281109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.281111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.281113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.281115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.281119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.281123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.281126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.281129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.281131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.281134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.281137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.281140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.281143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.281171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.281145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.281147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.281179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2754
2025-10-02T09:35:23.281149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.281153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.281155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.281157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.281160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.281162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.281164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.281166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.281169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.281171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.281174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.281176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.281178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.281195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.281285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.281302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.281305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.281307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.281554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2754 sessionId:  describe result for acl check
2025-10-02T09:35:23.281579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.281583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.281584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.281587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037609599:8791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.281913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037609599:8791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.283437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037609599:8791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.287527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037609599:8791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.287536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037609599:8791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.287538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037609599:8791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.287541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.288796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.290352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.290362Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.290363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.290365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.290369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2753 [2:7556555681962036192:10263]
2025-10-02T09:35:23.290376Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.290386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.290391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.290392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.290394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.290405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.290411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.290415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.290445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.290449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.290450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.290452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.290453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.290508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.290515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.290525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.290534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.290551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.290570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609633:8791], now have 1 active actors on pipe
2025-10-02T09:35:23.290576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609541:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.290580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.290581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.290582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.290591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.290604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.290605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.290607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.290609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.290598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2753
2025-10-02T09:35:23.290601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2753
2025-10-02T09:35:23.290622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.290628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.290644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.290650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.290652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.290663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.290669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.290752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97df9151-37192b5f-b01040fe-58e06d29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.290763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.290766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.290767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.290775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.290785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.290804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.290932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.290939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.290949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.291016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2754 partition: 0 MaxSeqNo: 36 sessionId: src_id|97df9151-37192b5f-b01040fe-58e06d29_0
2025-10-02T09:35:23.291225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3aafb6-ec66c38c-f41a7e43-3646eaee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97df9151-37192b5f-b01040fe-58e06d29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.293533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Write session: try to update token
2025-10-02T09:35:23.293544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.299705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.299716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.299717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.299719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.299723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.299725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.299727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036187:10263]
2025-10-02T09:35:23.299763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.299766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.299770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.299773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.299773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.299774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.299886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.309630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId: src_id|97df9151-37192b5f-b01040fe-58e06d29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.311811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.372064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037609644:9243]
2025-10-02T09:35:23.372267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2753, pipe: [1:7556555682037609644:9243]
2025-10-02T09:35:23.408855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.409078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.409083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.409096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609644:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.409276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037609644:9243]
2025-10-02T09:35:23.409293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.409293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.409313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.409316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.409368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2754 reason: error at write: Disconnected sessionId: src_id|97df9151-37192b5f-b01040fe-58e06d29_0
2025-10-02T09:35:23.409541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2754 sessionId: src_id|97df9151-37192b5f-b01040fe-58e06d29_0 is DEAD
2025-10-02T09:35:23.409652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.409660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Write session will restart in 0.006032s
2025-10-02T09:35:23.409675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Write session: Do CDS request
2025-10-02T09:35:23.409679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.417039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.417098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.417209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.417221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2755
2025-10-02T09:35:23.417319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.417339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.417345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.417348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.417635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2755 sessionId:  describe result for acl check
2025-10-02T09:35:23.417658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.417663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.417664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.417667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037609700:8781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.418004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037609700:8781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.418266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.418373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.418379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.418384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.418413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.418436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036287:10266]
2025-10-02T09:35:23.418792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.418985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.419014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.419195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.419224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.419228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.419228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.419229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.419230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.419230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.419231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.419231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.419232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.419232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.419233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.419233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.419236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.419242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.419244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.419246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.419248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.419250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.419252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.419255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.419257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.419259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.419261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.419263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.419268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.419271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.419274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.419277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.419279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.419283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.419285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.419288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.419290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.419292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.419294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.419297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.419299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.419301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.419304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.419306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.419309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.419311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.419315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.419318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.419321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.419327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.419329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.419331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.419350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.419605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037609700:8781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.424179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037609700:8781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.424188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037609700:8781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.424189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037609700:8781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.424192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.426866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.428336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.428348Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.428349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.428351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.428354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2754 [2:7556555681962036287:10266]
2025-10-02T09:35:23.428361Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.428371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.428376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.428378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.428379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.428390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.428392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.428396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.428425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.428429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.428430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.428432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.428433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.428491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.428497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.428507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.428520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.428539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.428555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609645:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.428561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609738:8781], now have 1 active actors on pipe
2025-10-02T09:35:23.428566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.428568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.428554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2754
2025-10-02T09:35:23.428557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2754
2025-10-02T09:35:23.428570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.428579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.428588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.428590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.428593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.428594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.428602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.428605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.428632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.428639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.428647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.428655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.428666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.428677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.428685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.428688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.428689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.428696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.428703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.428723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.428833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.428840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.428851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.428899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2755 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0
2025-10-02T09:35:23.429146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97df9151-37192b5f-b01040fe-58e06d29_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.431501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Write session: try to update token
2025-10-02T09:35:23.431519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.437767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.437778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.437779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.437781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.437784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.437786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.437788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036282:10266]
2025-10-02T09:35:23.437812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.437820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.437821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.437828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.437839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.437842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.437947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.444083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId: src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.446338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.509285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037609746:9243]
2025-10-02T09:35:23.509469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2754, pipe: [1:7556555682037609746:9243]
2025-10-02T09:35:23.547366Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.547662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.547672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.547683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609746:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.547861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.547861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037609746:9243]
2025-10-02T09:35:23.547881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.547884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.547905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.547948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2755 reason: error at write: Disconnected sessionId: src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0
2025-10-02T09:35:23.548098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2755 sessionId: src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0 is DEAD
2025-10-02T09:35:23.548218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.548233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Write session will restart in 0.007217s
2025-10-02T09:35:23.548259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Write session: Do CDS request
2025-10-02T09:35:23.548264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.554809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.556003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.556108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.556115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.556127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.556121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.556147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.556171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036381:10268]
2025-10-02T09:35:23.556230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.556237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2756
2025-10-02T09:35:23.556440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.556461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.556467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.556470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.556516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.556745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.556763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2756 sessionId:  describe result for acl check
2025-10-02T09:35:23.556773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.556789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.556793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.556794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.556810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037609806:8776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.556974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.557002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.557006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.557006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.557007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.557007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.557008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.557009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.557009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.557010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.557010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.557011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.557012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.557014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.557021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.557025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.557027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.557030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.557032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.557034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.557035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.557038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.557040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.557041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.557043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.557047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.557051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.557054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.557057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.557060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.557063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.557065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.557067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.557070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.557072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.557075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.557077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.557079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.557084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.557086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.557088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.557092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.557095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.557097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.557099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.557102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.557105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.557108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.557111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.557126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.557149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037609806:8776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.558865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037609806:8776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.563669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037609806:8776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.563680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037609806:8776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.563682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037609806:8776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.563686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.564923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.566577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.566587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.566588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.566590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.566594Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2755 [2:7556555681962036381:10268]
2025-10-02T09:35:23.566600Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.566610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.566615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.566617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.566618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.566627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.566633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.566637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.566671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.566675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.566676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.566678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.566680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.566727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.566733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.566742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.566752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.566770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.566788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609843:8776], now have 1 active actors on pipe
2025-10-02T09:35:23.566795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609748:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.566800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.566803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.566804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.566812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.566810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2755
2025-10-02T09:35:23.566814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2755
2025-10-02T09:35:23.566827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.566828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.566830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.566832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.566842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.566848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.566879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.566886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.566894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.566902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.566913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.566928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.566937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.566940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.566943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.566949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.566958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.566975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.567082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.567088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.567099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.567147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2756 partition: 0 MaxSeqNo: 36 sessionId: src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0
2025-10-02T09:35:23.567375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d637fd5-e3bb73e-20eac7a8-f024c44c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.570125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Write session: try to update token
2025-10-02T09:35:23.570136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.576508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.576522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.576523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.576525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.576529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.576532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.576536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036376:10268]
2025-10-02T09:35:23.576561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.576570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.576571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.576579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.576591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.576594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.576772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.582883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId: src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.585012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.648036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037609850:9243]
2025-10-02T09:35:23.648228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2755, pipe: [1:7556555682037609850:9243]
2025-10-02T09:35:23.684909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.685142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.685151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.685164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609850:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.685393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.685381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037609850:9243]
2025-10-02T09:35:23.685391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.685394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.685404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.685440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2756 reason: error at write: Disconnected sessionId: src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0
2025-10-02T09:35:23.685586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2756 sessionId: src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0 is DEAD
2025-10-02T09:35:23.685742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.685757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Write session will restart in 0.008323s
2025-10-02T09:35:23.685779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Write session: Do CDS request
2025-10-02T09:35:23.685783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.692713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.693838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.693945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.693952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.693958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.693984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.694008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036476:10270]
2025-10-02T09:35:23.694352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.694586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.694613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.694796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.694828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.694832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.694833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.694833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.694834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.694835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.694835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.694836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.694836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.694837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.694838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.694838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.694841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.694848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.694851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.694853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.694855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.694857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.694859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.694861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.694863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.694865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.694867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.694869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.694873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.694877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.694880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.694883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.694885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.694888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.694890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.694893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.694896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.694899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.694901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.694903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.694906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.694908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.694913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.694916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.694919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.694925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.694927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.694929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.694931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.694934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.694940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.694942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.694959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.695174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.695317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.695330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2757
2025-10-02T09:35:23.695435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.695454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.695456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.695459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.695720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2757 sessionId:  describe result for acl check
2025-10-02T09:35:23.695746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.695751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.695752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.695755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037609913:8771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.696109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037609913:8771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.697591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037609913:8771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.701916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037609913:8771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.701926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037609913:8771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.701928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037609913:8771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.701932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.702503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.704120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.704131Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.704132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.704134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.704137Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2756 [2:7556555681962036476:10270]
2025-10-02T09:35:23.704146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.704156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.704160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.704162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.704163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.704172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.704177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.704181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.704213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.704218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.704219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.704220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.704222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.704269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.704275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.704285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.704298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.704315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.704332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609852:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.704338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609948:8771], now have 1 active actors on pipe
2025-10-02T09:35:23.704341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.704343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.704344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.704355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.704354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2756
2025-10-02T09:35:23.704360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2756
2025-10-02T09:35:23.704369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.704369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.704371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.704373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.704384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.704388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.704416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.704422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.704431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.704439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.704449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.704460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.704465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.704473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.704474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.704483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.704493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.704512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.704591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.704597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.704608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.704665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2757 partition: 0 MaxSeqNo: 36 sessionId: src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0
2025-10-02T09:35:23.704877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e68f08-fec37b9-5f3e3af9-7f45a307_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.707600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Write session: try to update token
2025-10-02T09:35:23.707610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.713640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.713656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.713657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.713658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.713664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.713666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.713668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036471:10270]
2025-10-02T09:35:23.713688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.713692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.713693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.713737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.713745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.713750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.713803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.720070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId: src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.722195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.785753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037609955:9243]
2025-10-02T09:35:23.785903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2756, pipe: [1:7556555682037609955:9243]
2025-10-02T09:35:23.821513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.821736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.821744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.821756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609955:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.822119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.822130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.822135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037609955:9243]
2025-10-02T09:35:23.822151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.822171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2757 reason: error at write: Disconnected sessionId: src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0
2025-10-02T09:35:23.822294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2757 sessionId: src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0 is DEAD
2025-10-02T09:35:23.822397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.822431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.822449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Write session will restart in 0.008320s
2025-10-02T09:35:23.822465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Write session: Do CDS request
2025-10-02T09:35:23.822476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.828646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.830440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.830541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.830547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.830552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.830578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.830602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036571:10272]
2025-10-02T09:35:23.830944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.831137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.831159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.831341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.831370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.831374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.831375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.831375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.831376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.831377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.831377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.831378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.831379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.831379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.831379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.831380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.831383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.831389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.831392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.831394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.831396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.831398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.831400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.831401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.831404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.831406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.831408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.831409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.831415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.831419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.831422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.831425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.831427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.831430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.831432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.831435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.831437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.831440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.831442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.831444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.831446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.831448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.831451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.831453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.831455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.831458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.831460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.831462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.831468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.831471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.831473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.831476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.831493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.832197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.832283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.832295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2758
2025-10-02T09:35:23.832398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.832417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.832423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.832426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.832676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2758 sessionId:  describe result for acl check
2025-10-02T09:35:23.832701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.832706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.832707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.832709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037610018:8763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.833071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037610018:8763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.834372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037610018:8763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.838416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037610018:8763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.838424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037610018:8763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.838426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037610018:8763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.838429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.838959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.840533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.840543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.840544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.840546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.840549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2757 [2:7556555681962036571:10272]
2025-10-02T09:35:23.840556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.840566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.840568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.840569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.840570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.840579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.840581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.840585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.840613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.840618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.840619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.840621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.840622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.840656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.840660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.840667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.840672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.840680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.840693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037609956:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.840699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037610053:8763], now have 1 active actors on pipe
2025-10-02T09:35:23.840703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.840704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.840705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.840712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.840722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.840730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.840731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.840727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2757
2025-10-02T09:35:23.840734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.840737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.840739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.840746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.840748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.840756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.840763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.840764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.840753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2757
2025-10-02T09:35:23.840826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.840834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.840836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.840837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.840841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.840847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.840859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.840989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.840993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.841001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.841054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2758 partition: 0 MaxSeqNo: 36 sessionId: src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0
2025-10-02T09:35:23.841264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66420b6-742408bf-40d1b6ca-8dd01955_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.844007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Write session: try to update token
2025-10-02T09:35:23.844016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.850031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.850047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.850050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.850051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.850056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.850058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.850060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036566:10272]
2025-10-02T09:35:23.850088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.850094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.850096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.850109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.850113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.850116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.850222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.855708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId: src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.857994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:23.922643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555682037610088:9243]
2025-10-02T09:35:23.922815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2757, pipe: [1:7556555682037610088:9243]
2025-10-02T09:35:23.960757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:23.961026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.961035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.961047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037610088:9243], now have 1 active actors on pipe
2025-10-02T09:35:23.961211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:23.961216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555682037610088:9243]
2025-10-02T09:35:23.961235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:23.961237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:23.961281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2758 reason: error at write: Disconnected sessionId: src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0
2025-10-02T09:35:23.961270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:23.961401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2758 sessionId: src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0 is DEAD
2025-10-02T09:35:23.961501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:23.961507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Write session will restart in 0.008028s
2025-10-02T09:35:23.961524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Write session: Do CDS request
2025-10-02T09:35:23.961528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:23.968311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:23.969564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:23.969685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:23.969692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:23.969697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:23.969727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:23.969752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555681962036705:10286]
2025-10-02T09:35:23.970095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:23.970187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.970322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:23.970349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:23.970501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:23.970509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2759
2025-10-02T09:35:23.970543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:23.970574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.970578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.970579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.970579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.970580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.970581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.970581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.970582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.970582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.970583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.970584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.970585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.970588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.970595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.970597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.970599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.970601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.970599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:23.970603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.970605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.970607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.970609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.970612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.970618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:23.970620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:23.970622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:23.970613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.970615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.970619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.970623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:23.970626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.970629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:23.970632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.970634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:23.970637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.970640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:23.970643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.970645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:23.970648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.970650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:23.970653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.970655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:23.970657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.970660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:23.970662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.970665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:23.970667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.970670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.970673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.970675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.970677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.970680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.970698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:23.970885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2759 sessionId:  describe result for acl check
2025-10-02T09:35:23.970910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:23.970915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:23.970916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:23.970919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555682037610155:8744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:23.971238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555682037610155:8744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:23.972534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555682037610155:8744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:23.977071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555682037610155:8744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:23.977080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555682037610155:8744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:23.977082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555682037610155:8744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:23.977085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:23.978279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:23.979806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:23.979817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:23.979818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:23.979820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:23.979824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2758 [2:7556555681962036705:10286]
2025-10-02T09:35:23.979832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:23.979843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:23.979848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.979850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.979851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.979860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:23.979863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:23.979867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:23.979901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.979907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.979908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.979910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:23.979911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:23.979958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:23.979964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.979974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:23.979985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:23.980002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:23.980020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037610188:8744], now have 1 active actors on pipe
2025-10-02T09:35:23.980025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555682037610089:2446], now have 1 active actors on pipe
2025-10-02T09:35:23.980029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.980030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.980032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.980041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:23.980055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:23.980047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2758
2025-10-02T09:35:23.980047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2758
2025-10-02T09:35:23.980055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:23.980057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:23.980058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:23.980071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:23.980073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:23.980099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.980106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.980115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.980122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:23.980133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:23.980143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:23.980148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:23.980154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:23.980156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:23.980162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:23.980173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:23.980222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.980312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:23.980319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:23.980330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:23.980397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2759 partition: 0 MaxSeqNo: 36 sessionId: src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0
2025-10-02T09:35:23.980655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751cd3a9-58bc88e8-e7c7fb7c-28e7e3a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:23.983402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Write session: try to update token
2025-10-02T09:35:23.983415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:23.989306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:23.989320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:23.989321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:23.989322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:23.989326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.989329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.989331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555681962036700:10286]
2025-10-02T09:35:23.989357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:23.989363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:23.989365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:23.989378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:23.989381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:23.989385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:23.989493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:23.995160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId: src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:23.997506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.061212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332577493:9243]
2025-10-02T09:35:24.061463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2758, pipe: [1:7556555686332577493:9243]
2025-10-02T09:35:24.103134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.103434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.103443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.103455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577493:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.103648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332577493:9243]
2025-10-02T09:35:24.103674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.103658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:24.103661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:24.103676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.103717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2759 reason: error at write: Disconnected sessionId: src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0
2025-10-02T09:35:24.103865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2759 sessionId: src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0 is DEAD
2025-10-02T09:35:24.103998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:24.104005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Write session will restart in 0.007366s
2025-10-02T09:35:24.104020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Write session: Do CDS request
2025-10-02T09:35:24.104024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.111232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.112205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.112303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.112313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2760
2025-10-02T09:35:24.112401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.112422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.112429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.112432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.112702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.112754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2760 sessionId:  describe result for acl check
2025-10-02T09:35:24.112784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.112788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.112790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.112793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332577554:8739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.112832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.112840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.112845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.112876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.112900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004111:10290]
2025-10-02T09:35:24.113149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332577554:8739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.113247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.113466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.113495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.113702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.113740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.113744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.113744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.113745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.113745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.113746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.113747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.113747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.113748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.113748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.113749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.113749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.113753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.113759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.113761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.113763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.113765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.113767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.113769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.113771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.113772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.113775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.113777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.113778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.113782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.113787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.113790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.113793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.113796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.113799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.113802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.113804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.113807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.113809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.113811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.113814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.113817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.113820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.113822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.113825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.113828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.113830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.113833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.113835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.113839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.113841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.113843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.113846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.113864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.114294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332577554:8739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.118827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332577554:8739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.118836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332577554:8739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.118838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332577554:8739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.118842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.121547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.123261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.123272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.123274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.123276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.123280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2759 [2:7556555686257004111:10290]
2025-10-02T09:35:24.123287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.123298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.123300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.123301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.123302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.123313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.123321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.123325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.123359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.123364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.123365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.123367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.123368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.123419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.123425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.123435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.123444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.123461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.123480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577592:8739], now have 1 active actors on pipe
2025-10-02T09:35:24.123486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577494:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.123491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.123492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.123493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.123501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.123515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.123517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.123512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2759
2025-10-02T09:35:24.123519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.123517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2759
2025-10-02T09:35:24.123521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.123531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.123534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.123555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.123561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.123562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.123575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.123581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.123617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a52083-a423ff99-9d8235da-f5289aaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.123627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.123630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.123632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.123638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.123647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.123660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.123782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.123788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.123799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.123855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2760 partition: 0 MaxSeqNo: 36 sessionId: src_id|88a52083-a423ff99-9d8235da-f5289aaa_0
2025-10-02T09:35:24.124164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4856608-9d137cf0-d91cdaa0-4b234dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88a52083-a423ff99-9d8235da-f5289aaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.126807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Write session: try to update token
2025-10-02T09:35:24.126825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.132929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.132940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.132941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.132942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.132946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.132948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.132950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004106:10290]
2025-10-02T09:35:24.132975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.132983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.132984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.132995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.133008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.133018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.133154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.139045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId: src_id|88a52083-a423ff99-9d8235da-f5289aaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:24.141411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.203548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332577613:9243]
2025-10-02T09:35:24.203764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2759, pipe: [1:7556555686332577613:9243]
2025-10-02T09:35:24.246806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.247067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.247075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.247087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577613:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.247281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:24.247292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:24.247293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332577613:9243]
2025-10-02T09:35:24.247306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.247338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2760 reason: error at write: Disconnected sessionId: src_id|88a52083-a423ff99-9d8235da-f5289aaa_0
2025-10-02T09:35:24.247488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2760 sessionId: src_id|88a52083-a423ff99-9d8235da-f5289aaa_0 is DEAD
2025-10-02T09:35:24.247517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.247663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:24.247677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Write session will restart in 0.006157s
2025-10-02T09:35:24.247700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Write session: Do CDS request
2025-10-02T09:35:24.247706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.254229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.255154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.255226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.255235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2761
2025-10-02T09:35:24.255360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.255380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.255385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.255388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.255426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.255574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.255582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.255588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.255620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.255643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004210:10292]
2025-10-02T09:35:24.255710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2761 sessionId:  describe result for acl check
2025-10-02T09:35:24.255735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.255739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.255740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.255744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332577675:8738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.256008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.256076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332577675:8738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.256247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.256275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.256460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.256491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.256495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.256495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.256496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.256496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.256497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.256498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.256498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.256499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.256499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.256500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.256500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.256504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.256511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.256513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.256515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.256517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.256519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.256521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.256523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.256524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.256527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.256528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.256530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.256534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.256538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.256541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.256544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.256546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.256549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.256551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.256554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.256556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.256558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.256560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.256563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.256565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.256568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.256570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.256574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.256577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.256580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.256582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.256585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.256587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.256590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.256592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.256594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.256610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.257764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332577675:8738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.262012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332577675:8738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.262020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332577675:8738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.262022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332577675:8738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.262025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.264231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.265715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.265726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.265727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.265729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.265733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2760 [2:7556555686257004210:10292]
2025-10-02T09:35:24.265740Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.265750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.265751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.265753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.265754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.265763Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.265771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.265775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.265807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.265812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.265813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.265817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.265818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.265896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.265903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.265912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.265927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.265941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.265957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577614:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.265963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577714:8738], now have 1 active actors on pipe
2025-10-02T09:35:24.265967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.265968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.265971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.265966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2760
2025-10-02T09:35:24.265981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.265969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2760
2025-10-02T09:35:24.265994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.265996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.266002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.266003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.266008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.266010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.266036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.266043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.266052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.266060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.266075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.266084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7101a86e-f5348a61-9d6df062-86e126f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.266095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.266104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.266109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.266117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.266127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.266147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.266233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.266239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.266250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.266322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2761 partition: 0 MaxSeqNo: 36 sessionId: src_id|7101a86e-f5348a61-9d6df062-86e126f8_0
2025-10-02T09:35:24.266595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a52083-a423ff99-9d8235da-f5289aaa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7101a86e-f5348a61-9d6df062-86e126f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.268915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Write session: try to update token
2025-10-02T09:35:24.268928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.275246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.275258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.275259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.275260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.275266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.275268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.275270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004205:10292]
2025-10-02T09:35:24.275293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.275298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.275301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.275314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.275323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.275326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.275531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.281092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId: src_id|7101a86e-f5348a61-9d6df062-86e126f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:24.283453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.347414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332577724:9243]
2025-10-02T09:35:24.347610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2760, pipe: [1:7556555686332577724:9243]
2025-10-02T09:35:24.388043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.388341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.388351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.388365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577724:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.388548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.388586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.388594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332577724:9243]
2025-10-02T09:35:24.388612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:24.388616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:24.388666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2761 reason: error at write: Disconnected sessionId: src_id|7101a86e-f5348a61-9d6df062-86e126f8_0
2025-10-02T09:35:24.388826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2761 sessionId: src_id|7101a86e-f5348a61-9d6df062-86e126f8_0 is DEAD
2025-10-02T09:35:24.389001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:24.389015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Write session will restart in 0.006320s
2025-10-02T09:35:24.389038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Write session: Do CDS request
2025-10-02T09:35:24.389044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.396074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.396186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.396251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.396265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2762
2025-10-02T09:35:24.396394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.396415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.396421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.396424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.396698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2762 sessionId:  describe result for acl check
2025-10-02T09:35:24.396719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.396720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.396721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.396724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332577786:8726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.397085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332577786:8726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.397409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.397507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.397514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.397519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.397546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.397568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004312:10295]
2025-10-02T09:35:24.397932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.398167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.398196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.398380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.398411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.398415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.398416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.398416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.398417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.398417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.398418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.398418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.398419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.398419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.398420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.398421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.398423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.398429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.398431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.398433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.398435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.398437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.398439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.398441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.398443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.398445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.398447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.398449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.398453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.398457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.398460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.398463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.398467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.398469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.398471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.398483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.398490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.398493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.398495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.398497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.398501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.398504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.398506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.398509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.398511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.398514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.398493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332577786:8726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.398516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.398522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.398524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.398527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.398529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.398531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.398549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.403385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332577786:8726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.403394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332577786:8726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.403396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332577786:8726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.403400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.406089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.407692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.407703Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.407704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.407706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.407709Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2761 [2:7556555686257004312:10295]
2025-10-02T09:35:24.407717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.407728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.407733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.407735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.407735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.407744Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.407747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.407751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.407785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.407790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.407791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.407793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.407795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.407841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.407847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.407856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.407867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.407882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.407900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577725:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.407907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577825:8726], now have 1 active actors on pipe
2025-10-02T09:35:24.407911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.407917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.407919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.407930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.407943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.407934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2761
2025-10-02T09:35:24.407945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.407947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.407940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2761
2025-10-02T09:35:24.407949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.407959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.407962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.407983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.407992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.407999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.408006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.408012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.408043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.408053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.408061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.408063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.408070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.408081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.408096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.408210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.408216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.408226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.408279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2762 partition: 0 MaxSeqNo: 36 sessionId: src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0
2025-10-02T09:35:24.408573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7101a86e-f5348a61-9d6df062-86e126f8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.410936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Write session: try to update token
2025-10-02T09:35:24.410951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.417225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.417237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.417238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.417239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.417243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.417245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.417247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004307:10295]
2025-10-02T09:35:24.417272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.417280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.417282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.417291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.417302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.417306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.417403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.423500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId: src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:24.425831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.460101Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:13253 } ]
2025-10-02T09:35:24.488934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332577833:9243]
2025-10-02T09:35:24.489192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2761, pipe: [1:7556555686332577833:9243]
2025-10-02T09:35:24.529849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.530101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.530110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.530122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577833:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.530405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.530453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.530500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:24.530604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0
2025-10-02T09:35:24.530668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332577833:9243]
2025-10-02T09:35:24.530727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2762 sessionId: src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0 is DEAD
2025-10-02T09:35:24.530868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:24.530883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Write session will restart in 0.008080s
2025-10-02T09:35:24.530904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Write session: Do CDS request
2025-10-02T09:35:24.530909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.538224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.539429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.539547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.539553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.539558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.539585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.539609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004413:10297]
2025-10-02T09:35:24.539958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.540195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.540223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.540248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.540295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.540303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2763
2025-10-02T09:35:24.540408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.540437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.540441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.540442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.540442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.540443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.540444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.540444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.540445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.540445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.540446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.540446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.540447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.540450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.540457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.540458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.540459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.540461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.540463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.540465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.540467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.540469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.540471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.540479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.540473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.540475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.540477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.540485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.540481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.540488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.540485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.540488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.540491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.540494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.540496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.540499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.540502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.540504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.540507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.540509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.540512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.540514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.540517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.540519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.540522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.540524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.540529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.540531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.540534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.540537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.540539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.540542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.540544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.540563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.540757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2763 sessionId:  describe result for acl check
2025-10-02T09:35:24.540783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.540786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.540788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.540791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332577902:8721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.541250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332577902:8721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.542979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332577902:8721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.546929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332577902:8721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.546939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332577902:8721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.546941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332577902:8721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.546945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.548150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.549632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.549643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.549644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.549646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.549650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2762 [2:7556555686257004413:10297]
2025-10-02T09:35:24.549657Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.549667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.549672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.549674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.549675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.549684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.549688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.549693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.549724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.549728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.549730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.549732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.549733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.549782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.549788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.549797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.549808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.549825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.549845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577835:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.549852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577936:8721], now have 1 active actors on pipe
2025-10-02T09:35:24.549856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.549858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.549860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.549870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.549884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.549876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2762
2025-10-02T09:35:24.549889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.549891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.549883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2762
2025-10-02T09:35:24.549892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.549901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.549905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.549932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.549939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.549949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.549958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.549974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.549981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.549987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.549991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.549993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.549999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.550008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.550029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.550126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.550132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.550142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.550189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2763 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0
2025-10-02T09:35:24.550447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66addd3-5b242f3e-6d95ab94-b0b09c66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.552766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Write session: try to update token
2025-10-02T09:35:24.552780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.559098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.559108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.559110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.559110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.559115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.559120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.559123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004408:10297]
2025-10-02T09:35:24.559149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.559157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.559158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.559169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.559181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.559185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.559281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.564863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId: src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:24.567352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.631235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332577944:9243]
2025-10-02T09:35:24.631495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2762, pipe: [1:7556555686332577944:9243]
2025-10-02T09:35:24.674589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.674929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.674940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.674953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577944:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.675114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.675108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332577944:9243]
2025-10-02T09:35:24.675137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:24.675138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:24.675190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2763 reason: error at write: Disconnected sessionId: src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0
2025-10-02T09:35:24.675296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.675341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2763 sessionId: src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0 is DEAD
2025-10-02T09:35:24.675490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:24.675506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Write session will restart in 0.007003s
2025-10-02T09:35:24.675533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Write session: Do CDS request
2025-10-02T09:35:24.675538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.682931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.683217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.683341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.683349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2764
2025-10-02T09:35:24.683476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.683497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.683504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.683506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.683771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2764 sessionId:  describe result for acl check
2025-10-02T09:35:24.683799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.683804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.683805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.683808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332578010:8708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.684174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332578010:8708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.684376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.684476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.684483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.684489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.684516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.684539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004515:10299]
2025-10-02T09:35:24.684896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.685171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.685200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.685400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.685431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.685435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.685435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.685436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.685437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.685437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.685438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.685439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.685439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.685440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.685440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.685441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.685444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.685450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.685452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.685454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.685456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.685458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.685459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.685461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.685463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.685466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.685468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.685469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.685474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.685478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.685481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.685484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.685486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.685489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.685491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.685495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.685500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.685503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.685506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.685509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.685515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.685518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.685520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.685524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.685527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.685529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.685535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.685538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.685540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.685544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.685549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.685552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.685571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.685769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332578010:8708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.690407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332578010:8708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.690416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332578010:8708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.690418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332578010:8708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.690422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.693127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.694758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.694769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.694770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.694772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.694778Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2763 [2:7556555686257004515:10299]
2025-10-02T09:35:24.694788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.694801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.694804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.694806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.694807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.694816Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.694820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.694824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.694859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.694863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.694865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.694866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.694868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.694916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.694922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.694932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.694944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.694962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.694980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332577945:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.694988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578048:8708], now have 1 active actors on pipe
2025-10-02T09:35:24.694992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.694993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.694994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.695002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.695016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.695017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.695019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.695020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.695017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2763
2025-10-02T09:35:24.695031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.695037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.695020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2763
2025-10-02T09:35:24.695069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.695076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.695084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.695093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.695104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.695117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.695126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.695131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.695132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.695139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.695150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.695170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.695269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.695276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.695286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.695345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2764 partition: 0 MaxSeqNo: 36 sessionId: src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0
2025-10-02T09:35:24.695635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4c63fb-f46b947d-240d12af-7b7d47b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.698161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Write session: try to update token
2025-10-02T09:35:24.698177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.704169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.704181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.704182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.704183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.704187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.704189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.704191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004510:10299]
2025-10-02T09:35:24.704215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.704225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.704228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.704230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.704234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.704237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.704357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.711182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId: src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:24.713423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.775627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332578056:9243]
2025-10-02T09:35:24.775875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2763, pipe: [1:7556555686332578056:9243]
2025-10-02T09:35:24.817467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.817706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.817715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.817727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578056:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.817928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332578056:9243]
2025-10-02T09:35:24.817951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.817950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.817957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:24.817959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:24.818007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2764 reason: error at write: Disconnected sessionId: src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0
2025-10-02T09:35:24.818159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2764 sessionId: src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0 is DEAD
2025-10-02T09:35:24.818331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:24.818345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Write session will restart in 0.006751s
2025-10-02T09:35:24.818368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Write session: Do CDS request
2025-10-02T09:35:24.818373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.825604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.826195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.826270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.826278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2765
2025-10-02T09:35:24.826406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.826427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.826433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.826435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.826712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2765 sessionId:  describe result for acl check
2025-10-02T09:35:24.826738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.826743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.826745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.826748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332578122:8704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.827103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332578122:8704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.827313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.827423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.827430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.827435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.827465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.827488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004617:10301]
2025-10-02T09:35:24.827858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.828049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.828080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.828267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.828296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.828300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.828301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.828301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.828302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.828302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.828303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.828303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.828304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.828304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.828305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.828305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.828308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.828314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.828316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.828318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.828320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.828322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.828324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.828326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.828328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.828330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.828332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.828334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.828338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.828342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.828345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.828348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.828350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.828353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.828355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.828357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.828359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.828362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.828364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.828367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.828369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.828372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.828374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.828377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.828380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.828383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.828385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.828387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.828390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.828393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.828395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.828398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.828416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.828570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332578122:8704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.833284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332578122:8704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.833294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332578122:8704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.833296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332578122:8704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.833300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.835990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.837582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.837594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.837595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.837598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.837601Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2764 [2:7556555686257004617:10301]
2025-10-02T09:35:24.837608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.837619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.837624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.837626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.837627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.837637Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.837641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.837650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.837683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.837688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.837689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.837690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.837692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.837739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.837745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.837755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.837768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.837786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.837805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578057:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.837812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578161:8704], now have 1 active actors on pipe
2025-10-02T09:35:24.837815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.837817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.837818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.837827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.837843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.837844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.837833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2764
2025-10-02T09:35:24.837846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.837837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2764
2025-10-02T09:35:24.837848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.837859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.837861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.837879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.837886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.837887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.837899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.837905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.837937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.837946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.837955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.837960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.837968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.837978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.837994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.838131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.838140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.838151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.838217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2765 partition: 0 MaxSeqNo: 36 sessionId: src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0
2025-10-02T09:35:24.838514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e9cf2a-78d93224-f1ca003f-220d91d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.841013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Write session: try to update token
2025-10-02T09:35:24.841028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.847415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.847429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.847431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.847432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.847436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.847441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.847443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004612:10301]
2025-10-02T09:35:24.847470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.847475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.847477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.847488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.847502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.847506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.847605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.853749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId: src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:24.856186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:24.918292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555686332578187:9243]
2025-10-02T09:35:24.918541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2764, pipe: [1:7556555686332578187:9243]
2025-10-02T09:35:24.963326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:24.963644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.963654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.963667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578187:9243], now have 1 active actors on pipe
2025-10-02T09:35:24.963878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:24.963895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:24.963885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555686332578187:9243]
2025-10-02T09:35:24.963905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:24.963907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:24.963960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2765 reason: error at write: Disconnected sessionId: src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0
2025-10-02T09:35:24.964119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2765 sessionId: src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0 is DEAD
2025-10-02T09:35:24.964274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:24.964286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Write session will restart in 0.006459s
2025-10-02T09:35:24.964314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Write session: Do CDS request
2025-10-02T09:35:24.964321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:24.971836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:24.972151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.972339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:24.972349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2766
2025-10-02T09:35:24.972482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:24.972503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:24.972508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:24.972511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:24.972830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2766 sessionId:  describe result for acl check
2025-10-02T09:35:24.972856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:24.972861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:24.972862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:24.972865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555686332578268:8691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:24.973202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555686332578268:8691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:24.973206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:24.973352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:24.973360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:24.973366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:24.973398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:24.973421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555686257004757:10315]
2025-10-02T09:35:24.973794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:24.973989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:24.974018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:24.974204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:24.974232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.974236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.974237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.974237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.974238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.974238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.974241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.974242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.974242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.974243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.974243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.974244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.974247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.974253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.974255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.974257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.974259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.974261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.974263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.974265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.974267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.974269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.974271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.974273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.974276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.974280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:24.974283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.974286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:24.974288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.974290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:24.974293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.974295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:24.974298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.974300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:24.974303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.974310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:24.974313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.974317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:24.974320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.974322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:24.974324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.974327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:24.974329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.974332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.974334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.974337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.974341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.974343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.974360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:24.974753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555686332578268:8691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:24.980209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555686332578268:8691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:24.980217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555686332578268:8691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:24.980219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555686332578268:8691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:24.980223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:24.981902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:24.983458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:24.983469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:24.983470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:24.983472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:24.983475Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2765 [2:7556555686257004757:10315]
2025-10-02T09:35:24.983482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:24.983492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:24.983493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.983495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.983496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.983505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:24.983508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:24.983513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:24.983545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.983551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.983553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.983554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:24.983556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:24.983601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:24.983607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.983617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:24.983626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:24.983643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:24.983661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578304:8691], now have 1 active actors on pipe
2025-10-02T09:35:24.983668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555686332578200:2446], now have 1 active actors on pipe
2025-10-02T09:35:24.983673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.983675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.983676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.983684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:24.983697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:24.983698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:24.983700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:24.983702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:24.983693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2765
2025-10-02T09:35:24.983713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:24.983717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:24.983698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2765
2025-10-02T09:35:24.983736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.983741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:24.983743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:24.983751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.983757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.983789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d2f50-5afaedbf-fde63fda-692909cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:24.983799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:24.983804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:24.983805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:24.983813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:24.983824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:24.983841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.983931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:24.983938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:24.983949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:24.984005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2766 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d2f50-5afaedbf-fde63fda-692909cc_0
2025-10-02T09:35:24.984286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88fcdf-c5f268c9-41bce737-65536cc3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d2f50-5afaedbf-fde63fda-692909cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:24.986643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Write session: try to update token
2025-10-02T09:35:24.986658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:24.992935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:24.992946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:24.992947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:24.992948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:24.992952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.992954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.992956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555686257004752:10315]
2025-10-02T09:35:24.992979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:24.992983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:24.992984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:24.993001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:24.993013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:24.993016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:24.993101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:24.999830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId: src_id|6d2f50-5afaedbf-fde63fda-692909cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.002079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.064231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627545609:9243]
2025-10-02T09:35:25.064466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2765, pipe: [1:7556555690627545609:9243]
2025-10-02T09:35:25.107065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.107339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.107348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.107360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545609:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.107567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.107576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.107587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.107604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.107632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2766 reason: error at write: Disconnected sessionId: src_id|6d2f50-5afaedbf-fde63fda-692909cc_0
2025-10-02T09:35:25.107642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627545609:9243]
2025-10-02T09:35:25.107779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2766 sessionId: src_id|6d2f50-5afaedbf-fde63fda-692909cc_0 is DEAD
2025-10-02T09:35:25.107952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.107968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Write session will restart in 0.008834s
2025-10-02T09:35:25.107989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Write session: Do CDS request
2025-10-02T09:35:25.107994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.115151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.116292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.116398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.116404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.116410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.116435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.116459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972171:10319]
2025-10-02T09:35:25.116816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.117042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.117069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.117255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.117287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.117291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.117291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.117292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.117292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.117293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.117293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.117294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.117294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.117295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.117295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.117296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.117299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.117306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.117308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.117310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.117312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.117314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.117316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.117318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.117320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.117322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.117324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.117326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.117330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.117334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.117337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.117340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.117343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.117345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.117347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.117350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.117352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.117355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.117357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.117360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.117362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.117365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.117369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.117377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.117381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.117386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.117389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.117391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.117394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.117411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.118228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.118403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.118416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2767
2025-10-02T09:35:25.118555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.118579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.118588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.118591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.118873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2767 sessionId:  describe result for acl check
2025-10-02T09:35:25.118897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.118902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.118903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.118906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627545682:8680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.119265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627545682:8680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.121013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627545682:8680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.124404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627545682:8680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.124413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627545682:8680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.124415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627545682:8680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.124419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.125031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.126567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.126578Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.126580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.126583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.126586Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2766 [2:7556555690551972171:10319]
2025-10-02T09:35:25.126593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.126604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.126607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.126608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.126610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.126618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.126625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.126629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.126672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.126677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.126678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.126680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.126681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.126730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.126736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.126747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.126760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.126777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.126796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545717:8680], now have 1 active actors on pipe
2025-10-02T09:35:25.126802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545610:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.126806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.126811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.126811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.126821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.126821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2766
2025-10-02T09:35:25.126835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.126836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.126838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.126825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2766
2025-10-02T09:35:25.126839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.126851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.126853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.126887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.126894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.126902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.126910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.126921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.126935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.126944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.126949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.126950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.126957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.126968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.126987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.127078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.127085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.127096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.127146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2767 partition: 0 MaxSeqNo: 36 sessionId: src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0
2025-10-02T09:35:25.127435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2f50-5afaedbf-fde63fda-692909cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.129784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Write session: try to update token
2025-10-02T09:35:25.129798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.136391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.136405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.136407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.136407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.136412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.136415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.136419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972166:10319]
2025-10-02T09:35:25.136445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.136449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.136450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.136462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.136474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.136478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.136588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:25.142435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId: src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.144715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.207605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627545737:9243]
2025-10-02T09:35:25.207849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2766, pipe: [1:7556555690627545737:9243]
2025-10-02T09:35:25.251531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.251791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.251806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.251821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545737:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.252219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627545737:9243]
2025-10-02T09:35:25.252223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.252226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.252252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.252245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.252280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2767 reason: error at write: Disconnected sessionId: src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0
2025-10-02T09:35:25.252418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2767 sessionId: src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0 is DEAD
2025-10-02T09:35:25.252560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.252575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Write session will restart in 0.006997s
2025-10-02T09:35:25.252595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Write session: Do CDS request
2025-10-02T09:35:25.252600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.259506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.260208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.260263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.260274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2768
2025-10-02T09:35:25.260427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.260448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.260454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.260457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.260754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2768 sessionId:  describe result for acl check
2025-10-02T09:35:25.260779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.260784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.260785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.260787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627545806:8670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.261009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.261109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.261116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.261122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.261139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627545806:8670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.261147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.261170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972277:10321]
2025-10-02T09:35:25.261507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.261734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.261762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.261945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.261984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.261990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.261991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.261991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.261992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.261993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.261994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.261995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.261996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.261996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.261997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.261998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.262002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.262010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.262014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.262017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.262021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.262024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.262027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.262029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.262031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.262033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.262035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.262037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.262041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.262045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.262049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.262052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.262054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.262057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.262059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.262062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.262065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.262067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.262069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.262072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.262074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.262077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.262079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.262082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.262084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.262087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.262089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.262091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.262093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.262096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.262098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.262103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.262121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.262798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627545806:8670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.267971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627545806:8670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.267981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627545806:8670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.267983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627545806:8670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.267987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.269654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.271194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.271205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.271206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.271209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.271212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2767 [2:7556555690551972277:10321]
2025-10-02T09:35:25.271219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.271229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.271230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.271232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.271233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.271243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.271249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.271253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.271294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.271299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.271300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.271302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.271303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.271421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.271428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.271435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.271442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.271444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2767
2025-10-02T09:35:25.271460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.271448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2767
2025-10-02T09:35:25.271478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545845:8670], now have 1 active actors on pipe
2025-10-02T09:35:25.271481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545738:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.271486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.271492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.271494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.271500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.271506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.271507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.271509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.271514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.271529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.271536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.271550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.271557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.271576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.271585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.271597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.271600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.271605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.271608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.271609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.271615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.271626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.271654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.271743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.271750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.271761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.271820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2768 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0
2025-10-02T09:35:25.272036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b7d895-60f1a6d4-c35b1a16-15b8fd2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.274970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Write session: try to update token
2025-10-02T09:35:25.274981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.280771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:25.280788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.280792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.280837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:25.280840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:25.281472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:25.281598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:25.281716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:25.281837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:25.282000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:25.282027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:25.289098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId: src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.289198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.289210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.289212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.289213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.289218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.289223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.289225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972272:10321]
2025-10-02T09:35:25.289250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.289259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.289265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.289267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.289270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.289274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.289395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:25.291535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.352473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627545855:9243]
2025-10-02T09:35:25.352666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2767, pipe: [1:7556555690627545855:9243]
2025-10-02T09:35:25.404418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.404668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.404683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.404698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545855:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.405077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.405088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.405091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627545855:9243]
2025-10-02T09:35:25.405105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.405133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2768 reason: error at write: Disconnected sessionId: src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0
2025-10-02T09:35:25.405124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.405266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2768 sessionId: src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0 is DEAD
2025-10-02T09:35:25.405398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.405407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Write session will restart in 0.005155s
2025-10-02T09:35:25.405427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Write session: Do CDS request
2025-10-02T09:35:25.405432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.411183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.411276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.411283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2769
2025-10-02T09:35:25.411395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.411415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.411421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.411424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.411730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2769 sessionId:  describe result for acl check
2025-10-02T09:35:25.411754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.411755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.411756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.411759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627545922:8667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.412115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627545922:8667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.412814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.413918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627545922:8667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.414455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.414573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.414581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.414587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.414615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.414639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972386:10324]
2025-10-02T09:35:25.414976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.415202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.415230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.415411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.415441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.415445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.415445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.415446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.415446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.415447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.415448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.415449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.415449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.415450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.415450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.415451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.415454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.415461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.415463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.415465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.415467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.415469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.415471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.415473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.415475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.415477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.415479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.415481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.415485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.415489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.415492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.415495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.415498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.415501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.415503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.415506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.415508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.415511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.415513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.415516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.415518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.415520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.415522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.415526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.415529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.415531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.415533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.415536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.415541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.415544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.415546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.415549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.415569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.415832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627545922:8667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.415838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627545922:8667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.415840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627545922:8667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.415843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.423045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.424526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.424537Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.424538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.424540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.424543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2768 [2:7556555690551972386:10324]
2025-10-02T09:35:25.424550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.424559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.424560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.424563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.424564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.424572Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.424575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.424579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.424609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.424614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.424615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.424617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.424618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.424666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.424672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.424681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.424692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.424709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.424727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545962:8667], now have 1 active actors on pipe
2025-10-02T09:35:25.424733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545856:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.424737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.424738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.424739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.424747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.424761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.424761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.424763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.424765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.424777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.424783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.424765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2768
2025-10-02T09:35:25.424765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2768
2025-10-02T09:35:25.424814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.424824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.424830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.424836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.424838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.424907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.424917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.424919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.424920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.424927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.424936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.424956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.425055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.425062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.425072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.425141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2769 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0
2025-10-02T09:35:25.425413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8155f0a-38cc69bb-b16c515c-1f14af3b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.427940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Write session: try to update token
2025-10-02T09:35:25.427953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.433988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.434000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.434002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.434003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.434006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.434008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.434012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972381:10324]
2025-10-02T09:35:25.434037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.434045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.434047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.434055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.434066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.434070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.434174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:25.440163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId: src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.442618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.505077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627545971:9243]
2025-10-02T09:35:25.505312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2768, pipe: [1:7556555690627545971:9243]
2025-10-02T09:35:25.548839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.549069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.549078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.549091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545971:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.549280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.549288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.549307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.549306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.549337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627545971:9243]
2025-10-02T09:35:25.549339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2769 reason: error at write: Disconnected sessionId: src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0
2025-10-02T09:35:25.549480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2769 sessionId: src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0 is DEAD
2025-10-02T09:35:25.549626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.549640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Write session will restart in 0.009349s
2025-10-02T09:35:25.549661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Write session: Do CDS request
2025-10-02T09:35:25.549666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.557214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.558684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.558791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.558798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.558804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.558829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.558855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972494:10326]
2025-10-02T09:35:25.559206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.559432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.559460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.559649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.559678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.559682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.559683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.559683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.559684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.559684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.559685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.559685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.559686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.559686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.559687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.559687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.559690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.559698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.559700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.559702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.559704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.559706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.559708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.559719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.559721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.559724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.559726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.559727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.559731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.559735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.559742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.559745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.559747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.559753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.559756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.559758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.559764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.559767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.559769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.559771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.559773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.559776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.559778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.559781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.559783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.559787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.559789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.559792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.559796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.559798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.559800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.559803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.559822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.560184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.560260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.560272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2770
2025-10-02T09:35:25.560428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.560456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.560465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.560468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.560952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2770 sessionId:  describe result for acl check
2025-10-02T09:35:25.560979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.560985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.560987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.560991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627546048:8664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.561588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627546048:8664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.563609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627546048:8664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.567769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627546048:8664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.567796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627546048:8664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.567798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627546048:8664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.567804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.568421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.570027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.570040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.570042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.570045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.570049Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2769 [2:7556555690551972494:10326]
2025-10-02T09:35:25.570057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.570069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.570075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.570077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.570078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.570089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.570096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.570100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.570141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.570146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.570147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.570149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.570153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.570211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.570219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.570230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.570246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.570266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.570286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546086:8664], now have 1 active actors on pipe
2025-10-02T09:35:25.570292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627545973:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.570298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.570303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.570305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.570315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.570315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2769
2025-10-02T09:35:25.570330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.570331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.570334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.570335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.570348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.570351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.570320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2769
2025-10-02T09:35:25.570377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.570386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.570393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.570401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.570408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.570444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.570454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.570462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.570464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.570472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.570493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.570513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.570639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.570646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.570658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.570716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2770 partition: 0 MaxSeqNo: 36 sessionId: src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0
2025-10-02T09:35:25.570974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a3181-e02dc428-625c4f60-8b1eebb7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.573898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Write session: try to update token
2025-10-02T09:35:25.573911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.580952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.580965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.580966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.580967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.580974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.580976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.580978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972489:10326]
2025-10-02T09:35:25.581004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.581008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.581010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.581022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.581026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.581029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.581227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:25.585733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId: src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.588089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.649612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627546093:9243]
2025-10-02T09:35:25.649845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2769, pipe: [1:7556555690627546093:9243]
2025-10-02T09:35:25.689933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.690132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.690141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.690165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546093:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.690334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.690361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627546093:9243]
2025-10-02T09:35:25.690368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.690370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.690376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.690415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2770 reason: error at write: Disconnected sessionId: src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0
2025-10-02T09:35:25.690561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2770 sessionId: src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0 is DEAD
2025-10-02T09:35:25.690705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.690711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Write session will restart in 0.006995s
2025-10-02T09:35:25.690729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Write session: Do CDS request
2025-10-02T09:35:25.690734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.698708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.699175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.699273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.699282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2771
2025-10-02T09:35:25.699353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.699373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.699379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.699381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.699670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2771 sessionId:  describe result for acl check
2025-10-02T09:35:25.699695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.699700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.699701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.699704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627546165:8657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.700069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627546165:8657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.700101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.700198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.700205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.700211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.700237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.700258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972603:10328]
2025-10-02T09:35:25.700597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.700829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.700855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.701042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.701071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.701075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.701076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.701076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.701077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.701078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.701078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.701079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.701080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.701080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.701081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.701081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.701084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.701090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.701092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.701094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.701096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.701098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.701099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.701101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.701103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.701105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.701107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.701109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.701113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.701116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.701120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.701123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.701125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.701127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.701130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.701132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.701135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.701138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.701140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.701143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.701145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.701147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.701149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.701152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.701154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.701156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.701158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.701161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.701164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.701167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.701169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.701172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.701187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.701558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627546165:8657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.706037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627546165:8657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.706046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627546165:8657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.706048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627546165:8657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.706051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.708793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.710359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.710371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.710372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.710374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.710378Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2770 [2:7556555690551972603:10328]
2025-10-02T09:35:25.710385Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.710395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.710399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.710401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.710402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.710411Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.710413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.710422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.710454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.710459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.710460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.710461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.710463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.710516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.710524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.710533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.710547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.710564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.710584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546205:8657], now have 1 active actors on pipe
2025-10-02T09:35:25.710591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546095:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.710594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.710595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.710597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.710593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2770
2025-10-02T09:35:25.710606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.710594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2770
2025-10-02T09:35:25.710619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.710622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.710624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.710626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.710632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.710634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.710653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.710660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.710666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.710681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.710688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.710712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.710722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.710728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.710731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.710737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.710748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.710763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.710892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.710900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.710911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.710981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2771 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0
2025-10-02T09:35:25.711196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d0dbc7-89bd93fd-c8ff1394-1ca3f625_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.713981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Write session: try to update token
2025-10-02T09:35:25.713993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.720058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.720072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.720073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.720074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.720080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.720083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.720085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972598:10328]
2025-10-02T09:35:25.720107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.720110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.720110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.720112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.720112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.720114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.720222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:25.726025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId: src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.728317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.790742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627546213:9243]
2025-10-02T09:35:25.790887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2770, pipe: [1:7556555690627546213:9243]
2025-10-02T09:35:25.829480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.829694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.829703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.829715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546213:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.829869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.829882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627546213:9243]
2025-10-02T09:35:25.829906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.829906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.829908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.829961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2771 reason: error at write: Disconnected sessionId: src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0
2025-10-02T09:35:25.830103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2771 sessionId: src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0 is DEAD
2025-10-02T09:35:25.830216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.830224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Write session will restart in 0.005464s
2025-10-02T09:35:25.830238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Write session: Do CDS request
2025-10-02T09:35:25.830243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.836653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.837192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.837314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.837322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2772
2025-10-02T09:35:25.837405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.837425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.837429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.837432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.837711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2772 sessionId:  describe result for acl check
2025-10-02T09:35:25.837733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.837736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.837737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.837739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627546286:8650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.838078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627546286:8650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.838104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.838197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.838203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.838209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.838232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.838253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972712:10330]
2025-10-02T09:35:25.838596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.838795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.838816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.838989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.839017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.839021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.839021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.839022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.839022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.839023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.839023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.839023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.839024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.839024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.839025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.839025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.839028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.839034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.839036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.839038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.839040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.839042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.839044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.839046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.839048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.839050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.839052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.839054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.839058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.839061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.839064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.839067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.839069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.839072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.839074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.839076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.839079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.839081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.839083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.839086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.839088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.839091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.839094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.839097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.839099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.839102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.839106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.839108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.839112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.839118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.839121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.839123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.839143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.839247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627546286:8650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.844006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627546286:8650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.844016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627546286:8650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.844018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627546286:8650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.844022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.846650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.848152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.848163Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.848164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.848166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.848170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2771 [2:7556555690551972712:10330]
2025-10-02T09:35:25.848176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.848186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.848190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.848192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.848193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.848203Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.848207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.848211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.848242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.848247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.848248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.848250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.848251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.848296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.848301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.848307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.848312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.848321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.848335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546214:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.848341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546324:8650], now have 1 active actors on pipe
2025-10-02T09:35:25.848344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.848345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.848348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.848355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.848366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.848367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.848369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.848370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.848376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.848378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.848391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.848396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.848398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.848375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2771
2025-10-02T09:35:25.848384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2771
2025-10-02T09:35:25.848414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.848418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.848443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.848450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.848452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.848454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.848459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.848468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.848477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.848590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.848595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.848603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.848662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2772 partition: 0 MaxSeqNo: 36 sessionId: src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0
2025-10-02T09:35:25.848947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2ddda1-7acc3671-1651ad62-b274c0e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.851482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Write session: try to update token
2025-10-02T09:35:25.851498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.857597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.857609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.857610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.857611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.857616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.857618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.857622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972707:10330]
2025-10-02T09:35:25.857642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.857644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.857647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.857648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.857649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.857649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.857760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:25.863774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId: src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:25.866069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:25.930029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555690627546340:9243]
2025-10-02T09:35:25.930191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2771, pipe: [1:7556555690627546340:9243]
2025-10-02T09:35:25.967580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:25.967783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.967791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.967802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546340:9243], now have 1 active actors on pipe
2025-10-02T09:35:25.967945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:25.967958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:25.967961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:25.967985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555690627546340:9243]
2025-10-02T09:35:25.968000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2772 reason: error at write: Disconnected sessionId: src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0
2025-10-02T09:35:25.968142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2772 sessionId: src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0 is DEAD
2025-10-02T09:35:25.968287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:25.968298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Write session will restart in 0.007736s
2025-10-02T09:35:25.968319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Write session: Do CDS request
2025-10-02T09:35:25.968329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:25.968325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:25.975057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:25.976290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:25.976385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:25.976391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:25.976397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:25.976421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:25.976443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555690551972859:10344]
2025-10-02T09:35:25.976792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:25.977006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:25.977029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:25.977067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.977208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:25.977237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.977241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.977241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.977242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.977242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.977243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.977234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:25.977244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.977246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2773
2025-10-02T09:35:25.977244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.977244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.977245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.977245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.977246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.977249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.977255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.977257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.977259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.977261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.977263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.977265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.977267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.977269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.977271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.977273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.977275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.977279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.977282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:25.977285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.977288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:25.977292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.977294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:25.977297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.977299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:25.977302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.977304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:25.977306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.977309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:25.977311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.977314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:25.977316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.977319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:25.977321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.977324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:25.977326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.977329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.977331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.977334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.977336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.977339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.977333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:25.977353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:25.977356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:25.977360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:25.977363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:25.977617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2773 sessionId:  describe result for acl check
2025-10-02T09:35:25.977640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:25.977646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:25.977647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:25.977650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555690627546443:8635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:25.977963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555690627546443:8635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:25.979579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555690627546443:8635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:25.983864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555690627546443:8635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:25.983874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555690627546443:8635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:25.983876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555690627546443:8635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:25.983879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:25.984906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:25.986375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:25.986386Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:25.986387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:25.986389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:25.986392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2772 [2:7556555690551972859:10344]
2025-10-02T09:35:25.986401Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:25.986410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:25.986412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.986414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.986415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.986423Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:25.986426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:25.986430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:25.986457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.986462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.986463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.986465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:25.986466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:25.986511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:25.986516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.986522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:25.986527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:25.986536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:25.986547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546363:2446], now have 1 active actors on pipe
2025-10-02T09:35:25.986553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555690627546478:8635], now have 1 active actors on pipe
2025-10-02T09:35:25.986556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.986558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.986559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.986566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:25.986577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:25.986579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:25.986581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:25.986582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:25.986584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:25.986586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:25.986600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.986586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2772
2025-10-02T09:35:25.986592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2772
2025-10-02T09:35:25.986605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:25.986607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:25.986617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.986618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.986639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:25.986646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:25.986648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:25.986649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:25.986654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:25.986662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:25.986671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.986769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:25.986773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:25.986780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:25.986847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2773 partition: 0 MaxSeqNo: 36 sessionId: src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0
2025-10-02T09:35:25.987114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39fad68-dcb63e8e-f1095589-ff1def25_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:25.989416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Write session: try to update token
2025-10-02T09:35:25.989429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:25.995840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:25.995852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:25.995854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:25.995855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:25.995858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.995861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.995863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555690551972854:10344]
2025-10-02T09:35:25.995881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:25.995885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:25.995887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:25.995887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:25.995888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:25.995889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:25.995994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.001699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId: src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.003999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.068253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922513782:9243]
2025-10-02T09:35:26.068430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2772, pipe: [1:7556555694922513782:9243]
2025-10-02T09:35:26.105287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.105486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.105497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.105508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922513782:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.105629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.105667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922513782:9243]
2025-10-02T09:35:26.105688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:26.105688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.105742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2773 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0
2025-10-02T09:35:26.105881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2773 sessionId: src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0 is DEAD
2025-10-02T09:35:26.106043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:26.106055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Write session will restart in 0.008548s
2025-10-02T09:35:26.106090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Write session: Do CDS request
2025-10-02T09:35:26.106097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.113276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.114539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.114661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.114668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.114674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.114702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.114724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940280:10348]
2025-10-02T09:35:26.115061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.115140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.115238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.115260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.115250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2774
2025-10-02T09:35:26.115282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.115366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.115387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.115389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.115392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.115463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.115495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.115499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.115499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.115500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.115500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.115501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.115501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.115502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.115502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.115503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.115503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.115504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.115507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.115513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.115515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.115517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.115519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.115521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.115523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.115525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.115527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.115529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.115531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.115533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.115536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.115540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.115543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.115546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.115548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.115550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.115552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.115556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.115559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.115561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.115563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.115566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.115568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.115571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.115573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.115575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.115577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.115580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.115582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.115585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.115587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.115590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.115592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.115594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.115612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.115648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2774 sessionId:  describe result for acl check
2025-10-02T09:35:26.115674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.115675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.115677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.115680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922513859:8630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.115998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922513859:8630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.117300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922513859:8630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.121930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922513859:8630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.121940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922513859:8630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.121942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922513859:8630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.121946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.123125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.124641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.124651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.124652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.124654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.124657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2773 [2:7556555694846940280:10348]
2025-10-02T09:35:26.124664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.124673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.124674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.124676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.124677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.124687Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.124694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.124697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.124729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.124733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.124734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.124736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.124737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.124773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.124778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.124784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.124789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.124797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.124823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922513895:8630], now have 1 active actors on pipe
2025-10-02T09:35:26.124829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922513783:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.124832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.124835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.124836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.124843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.124852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.124856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.124858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.124859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.124860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.124862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.124858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2773
2025-10-02T09:35:26.124860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2773
2025-10-02T09:35:26.124875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.124880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.124886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.124894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.124898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.124919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.124925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.124927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.124928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.124933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.124939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.124951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.125042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.125047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.125054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.125117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2774 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0
2025-10-02T09:35:26.125391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8bd08f-61b0548b-c7f39743-b4d75b52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.127814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Write session: try to update token
2025-10-02T09:35:26.127832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.133889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.133901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.133902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.133903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.133906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.133908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.133910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940275:10348]
2025-10-02T09:35:26.133928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.133931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.133931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.133932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.133933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.133935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.134036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.140640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId: src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.142907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.206149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922513916:9243]
2025-10-02T09:35:26.206300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2773, pipe: [1:7556555694922513916:9243]
2025-10-02T09:35:26.243728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.243980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.243990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.244002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922513916:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.244131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.244165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922513916:9243]
2025-10-02T09:35:26.244187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:26.244192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.244240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2774 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0
2025-10-02T09:35:26.244388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2774 sessionId: src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0 is DEAD
2025-10-02T09:35:26.244538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:26.244550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Write session will restart in 0.006379s
2025-10-02T09:35:26.244570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Write session: Do CDS request
2025-10-02T09:35:26.244575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.251665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.252137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.252232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.252242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2775
2025-10-02T09:35:26.252339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.252360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.252366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.252368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.252643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2775 sessionId:  describe result for acl check
2025-10-02T09:35:26.252667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.252671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.252672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.252675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922513992:8619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.252934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.253026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.253032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.253037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.253035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922513992:8619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.253062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.253083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940393:10350]
2025-10-02T09:35:26.253415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.253603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.253624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.253793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.253821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.253825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.253826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.253826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.253827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.253828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.253828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.253829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.253829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.253830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.253830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.253831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.253833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.253839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.253841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.253843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.253845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.253847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.253849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.253851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.253853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.253855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.253857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.253859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.253863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.253866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.253871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.253874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.253876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.253879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.253881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.253884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.253886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.253889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.253891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.253893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.253897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.253899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.253901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.253904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.253906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.253909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.253911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.253913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.253915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.253918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.253920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.253922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.253939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.254541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922513992:8619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.259737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922513992:8619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.259746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922513992:8619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.259748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922513992:8619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.259752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.261391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.262878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.262889Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.262890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.262892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.262895Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2774 [2:7556555694846940393:10350]
2025-10-02T09:35:26.262903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.262913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.262916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.262917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.262918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.262927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.262934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.262938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.262966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.262971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.262972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.262974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.262975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.263012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.263017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.263024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.263029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.263038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.263052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514031:8619], now have 1 active actors on pipe
2025-10-02T09:35:26.263057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922513917:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.263061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.263062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.263063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.263070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.263079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.263082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.263084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.263085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.263089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.263091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.263083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2774
2025-10-02T09:35:26.263086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2774
2025-10-02T09:35:26.263103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.263108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.263110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.263122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.263127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.263146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd28cec3-31f6248a-7caf636-542c368_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.263152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.263155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.263156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.263161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.263166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.263181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.263276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.263281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.263288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.263351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2775 partition: 0 MaxSeqNo: 36 sessionId: src_id|cd28cec3-31f6248a-7caf636-542c368_0
2025-10-02T09:35:26.263641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a6fb29-ba7d0584-15712a65-c09c55eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cd28cec3-31f6248a-7caf636-542c368_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.266167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Write session: try to update token
2025-10-02T09:35:26.266184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.272137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.272150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.272151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.272152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.272157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.272159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.272161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940388:10350]
2025-10-02T09:35:26.272179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.272182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.272183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.272186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.272186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.272188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.272299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.279398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId: src_id|cd28cec3-31f6248a-7caf636-542c368_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.281611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.344209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922514040:9243]
2025-10-02T09:35:26.344346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2774, pipe: [1:7556555694922514040:9243]
2025-10-02T09:35:26.379850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.380070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.380082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.380095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514040:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.380237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922514040:9243]
2025-10-02T09:35:26.380255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:26.380257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:26.380258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.380297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2775 reason: error at write: Disconnected sessionId: src_id|cd28cec3-31f6248a-7caf636-542c368_0
2025-10-02T09:35:26.380428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2775 sessionId: src_id|cd28cec3-31f6248a-7caf636-542c368_0 is DEAD
2025-10-02T09:35:26.380580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:26.380598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Write session will restart in 0.006867s
2025-10-02T09:35:26.380569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.380619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Write session: Do CDS request
2025-10-02T09:35:26.380625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.387161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.388188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.388297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.388306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2776
2025-10-02T09:35:26.388414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.388434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.388440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.388442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.388691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2776 sessionId:  describe result for acl check
2025-10-02T09:35:26.388715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.388719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.388720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.388723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922514118:8608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.389051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.389062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922514118:8608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.389139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.389146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.389151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.389177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.389200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940510:10353]
2025-10-02T09:35:26.389532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.389723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.389745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.389944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.389975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.389979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.389979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.389980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.389980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.389981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.389982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.389982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.389983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.389983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.389984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.389984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.389987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.389993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.389995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.389997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.389999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.390001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.390003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.390005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.390007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.390009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.390011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.390013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.390017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.390020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.390023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.390026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.390029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.390031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.390033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.390036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.390038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.390041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.390043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.390046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.390048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.390051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.390053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.390055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.390058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.390062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.390064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.390068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.390072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.390074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.390076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.390080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.390097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.390677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922514118:8608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.395887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922514118:8608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.395895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922514118:8608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.395897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922514118:8608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.395901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.397547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.399031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.399041Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.399042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.399044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.399047Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2775 [2:7556555694846940510:10353]
2025-10-02T09:35:26.399054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.399063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.399068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.399069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.399070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.399079Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.399084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.399088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.399119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.399123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.399125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.399127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.399128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.399163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.399167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.399174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.399179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.399189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.399202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514156:8608], now have 1 active actors on pipe
2025-10-02T09:35:26.399207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514042:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.399210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.399212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.399213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.399221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.399227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.399238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.399238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.399240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.399242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.399242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.399256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.399248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2775
2025-10-02T09:35:26.399257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.399247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2775
2025-10-02T09:35:26.399278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.399280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.399282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.399297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.399300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.399306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.399307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.399312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.399316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.399324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.399409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.399413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.399420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.399483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2776 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0
2025-10-02T09:35:26.399741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd28cec3-31f6248a-7caf636-542c368_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.402102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Write session: try to update token
2025-10-02T09:35:26.402118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.408102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:26.408113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.408118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.408137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:26.408144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:26.408277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:26.408397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:26.408517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:26.408639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:26.408929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:26.408952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:26.414431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId: src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.416677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.416689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.416690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.416691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.416695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.416697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.416697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.416699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940505:10353]
2025-10-02T09:35:26.416717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.416720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.416721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.416724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.416729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.416732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.416847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.480419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922514164:9243]
2025-10-02T09:35:26.480573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2775, pipe: [1:7556555694922514164:9243]
2025-10-02T09:35:26.523690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.523934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.523946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.523959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514164:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.524114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:26.524120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:26.524160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922514164:9243]
2025-10-02T09:35:26.524163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2776 reason: error at write: Disconnected sessionId: src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0
2025-10-02T09:35:26.524193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.524280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2776 sessionId: src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0 is DEAD
2025-10-02T09:35:26.524404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:26.524418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Write session will restart in 0.005430s
2025-10-02T09:35:26.524438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Write session: Do CDS request
2025-10-02T09:35:26.524444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.524528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.531180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.531269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.531278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2777
2025-10-02T09:35:26.531372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.531393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.531402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.531404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.531588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.531672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2777 sessionId:  describe result for acl check
2025-10-02T09:35:26.531699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.531704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.531705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.531708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922514242:8605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.532076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922514242:8605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.533240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.533341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.533347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.533353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.533377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.533401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940625:10355]
2025-10-02T09:35:26.533662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922514242:8605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.533738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.533913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.533938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.534119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.534150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.534153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.534154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.534155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.534155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.534156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.534156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.534157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.534157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.534158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.534158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.534159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.534162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.534168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.534170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.534172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.534174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.534176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.534178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.534180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.534182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.534186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.534188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.534190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.534193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.534197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.534200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.534203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.534205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.534208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.534210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.534214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.534216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.534219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.534221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.534224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.534226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.534228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.534230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.534233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.534235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.534238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.534240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.534243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.534245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.534247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.534251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.534254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.534271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.538579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922514242:8605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.538589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922514242:8605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.538590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922514242:8605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.538594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.543169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.543179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.543180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.543182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.543185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2776 [2:7556555694846940625:10355]
2025-10-02T09:35:26.543194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.543204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.543209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.543211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.543212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.543221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.543223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.543228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.543258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.543263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.543264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.543266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.543267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.543304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.543309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.543316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.543321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.543330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.543345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514166:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.543350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514282:8605], now have 1 active actors on pipe
2025-10-02T09:35:26.543353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.543355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.543356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.543364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.543373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.543376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.543378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.543379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.543383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.543385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.543384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2776
2025-10-02T09:35:26.543387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2776
2025-10-02T09:35:26.543398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.543404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.543405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.543420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.543422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.543439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.543445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.543447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.543448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.543453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.543458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.543473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.543568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.543574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.543581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.543638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2777 partition: 0 MaxSeqNo: 36 sessionId: src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0
2025-10-02T09:35:26.543902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5f68a0-329221ea-9c5b7e65-9e58d03c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.546388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Write session: try to update token
2025-10-02T09:35:26.546406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.552500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.552509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.552511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.552512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.552516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.552518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.552520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940620:10355]
2025-10-02T09:35:26.552540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.552542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.552544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.552544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.552545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.552546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.552678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.559125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId: src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.561431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.624424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922514292:9243]
2025-10-02T09:35:26.624573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2776, pipe: [1:7556555694922514292:9243]
2025-10-02T09:35:26.666280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.666558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.666567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.666579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514292:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.666717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.666808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922514292:9243]
2025-10-02T09:35:26.666825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:26.666877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2777 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0
2025-10-02T09:35:26.666887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.667020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2777 sessionId: src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0 is DEAD
2025-10-02T09:35:26.667138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:26.667147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Write session will restart in 0.009176s
2025-10-02T09:35:26.667162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Write session: Do CDS request
2025-10-02T09:35:26.667166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.674483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.676258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.676353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.676360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.676366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.676391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.676414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940740:10357]
2025-10-02T09:35:26.676754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.676950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.676973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.677101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.677149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.677178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.677182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.677183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.677183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.677184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.677184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.677185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.677186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.677186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.677187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.677187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.677188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.677191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.677198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.677200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.677202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.677204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.677206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.677208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.677210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.677212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.677215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.677218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.677228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2778
2025-10-02T09:35:26.677217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.677219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.677224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.677227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.677230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.677233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.677237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.677240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.677242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.677244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.677246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.677249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.677251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.677254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.677256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.677258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.677260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.677263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.677266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.677269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.677271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.677273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.677275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.677278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.677280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.677282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.677299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.677336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.677355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.677360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.677363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.677666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2778 sessionId:  describe result for acl check
2025-10-02T09:35:26.677694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.677699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.677701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.677705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922514375:8597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.678071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922514375:8597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.679529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922514375:8597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.683605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922514375:8597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.683616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922514375:8597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.683618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922514375:8597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.683622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.684861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.686437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.686449Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.686450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.686452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.686456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2777 [2:7556555694846940740:10357]
2025-10-02T09:35:26.686463Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.686474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.686476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.686477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.686478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.686499Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.686506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.686510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.686540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.686544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.686545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.686547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.686548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.686585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.686590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.686596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.686601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.686613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.686627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514293:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.686633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514410:8597], now have 1 active actors on pipe
2025-10-02T09:35:26.686637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.686638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.686639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.686647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.686657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.686660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.686662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.686663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.686666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.686667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.686664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2777
2025-10-02T09:35:26.686678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2777
2025-10-02T09:35:26.686683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.686688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.686690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.686705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.686710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.686727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4618edab-65fa124a-22a8a91-96e6ef22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.686734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.686740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.686741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.686745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.686753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.686765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.686857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.686861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.686868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.686929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2778 partition: 0 MaxSeqNo: 36 sessionId: src_id|4618edab-65fa124a-22a8a91-96e6ef22_0
2025-10-02T09:35:26.687158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21922d4-b05f26fd-b90ed01a-1b06c0da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4618edab-65fa124a-22a8a91-96e6ef22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.689962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Write session: try to update token
2025-10-02T09:35:26.689973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.695958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.695977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.695979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.695980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.695985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.695990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.695992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940735:10357]
2025-10-02T09:35:26.696014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.696019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.696021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.696022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.696023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.696026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.696137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.702116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId: src_id|4618edab-65fa124a-22a8a91-96e6ef22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.704498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.767147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922514418:9243]
2025-10-02T09:35:26.767398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2777, pipe: [1:7556555694922514418:9243]
2025-10-02T09:35:26.809014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.809265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.809274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.809285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514418:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.809417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.809428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.809447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922514418:9243]
2025-10-02T09:35:26.809463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:26.809524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2778 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4618edab-65fa124a-22a8a91-96e6ef22_0
2025-10-02T09:35:26.809658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2778 sessionId: src_id|4618edab-65fa124a-22a8a91-96e6ef22_0 is DEAD
2025-10-02T09:35:26.809789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:26.809799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Write session will restart in 0.008395s
2025-10-02T09:35:26.809824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Write session: Do CDS request
2025-10-02T09:35:26.809829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.816315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.818153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.818252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.818258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.818265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.818289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.818314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940858:10359]
2025-10-02T09:35:26.818668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.818857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.818883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.819059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.819089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.819093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.819094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.819094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.819106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.819095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.819095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.819096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.819096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.819097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.819098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.819098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.819099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.819101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.819108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.819110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.819112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.819115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.819117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.819119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.819121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.819123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.819125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.819127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.819129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.819133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.819137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.819141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.819143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.819146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.819148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.819150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.819153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.819155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.819157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.819160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.819162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.819165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.819168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.819170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.819173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.819175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.819177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.819179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.819182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.819187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.819190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.819192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.819194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.819212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.819256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.819268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2779
2025-10-02T09:35:26.819377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.819398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.819404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.819407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.819686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2779 sessionId:  describe result for acl check
2025-10-02T09:35:26.819712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.819717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.819719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.819721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922514502:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.820062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922514502:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.821345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922514502:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.825609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922514502:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.825619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922514502:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.825621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922514502:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.825625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.826850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.828269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.828280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.828281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.828284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.828287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2778 [2:7556555694846940858:10359]
2025-10-02T09:35:26.828384Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.828397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.828399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.828401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.828402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.828411Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.828414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.828420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.828452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.828457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.828458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.828460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.828461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.828501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.828506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.828512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.828518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.828528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.828542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514419:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.828547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514536:8592], now have 1 active actors on pipe
2025-10-02T09:35:26.828551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.828553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.828554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.828562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.828569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.828575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.828577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.828578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.828580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.828581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.828578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2778
2025-10-02T09:35:26.828589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2778
2025-10-02T09:35:26.828596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.828599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.828601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.828616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.828621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.828641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.828648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.828650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.828651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.828656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.828661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.828675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.828773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.828778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.828785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.828840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2779 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0
2025-10-02T09:35:26.829066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4618edab-65fa124a-22a8a91-96e6ef22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.831807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Write session: try to update token
2025-10-02T09:35:26.831817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.837842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.837858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.837859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.837860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.837867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.837869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.837872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940853:10359]
2025-10-02T09:35:26.837893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.837894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.837896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.837897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.837897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.837899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.838003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.843789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId: src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.846097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:26.909474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555694922514551:9243]
2025-10-02T09:35:26.909605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2778, pipe: [1:7556555694922514551:9243]
2025-10-02T09:35:26.950070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:26.950310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.950319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.950331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514551:9243], now have 1 active actors on pipe
2025-10-02T09:35:26.950449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:26.950477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:26.950504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555694922514551:9243]
2025-10-02T09:35:26.950518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:26.950573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0
2025-10-02T09:35:26.950723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2779 sessionId: src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0 is DEAD
2025-10-02T09:35:26.950850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:26.950857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Write session will restart in 0.008357s
2025-10-02T09:35:26.950874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Write session: Do CDS request
2025-10-02T09:35:26.950879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:26.956894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:26.958262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:26.958371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:26.958377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:26.958384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:26.958410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:26.958431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555694846940989:10363]
2025-10-02T09:35:26.958798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:26.958967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:26.958990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:26.959172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:26.959202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.959205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.959206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.959207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.959207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.959208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.959208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.959209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.959209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.959210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.959210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.959211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.959214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.959220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.959222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.959224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.959226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.959228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.959230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.959232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.959234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.959236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.959238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.959240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.959243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.959247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:26.959250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.959252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:26.959255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.959257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:26.959259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.959262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:26.959265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.959268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:26.959270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.959273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:26.959275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.959278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:26.959284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.959286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:26.959288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.959292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:26.959297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.959300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.959302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.959305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.959308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.959311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.959328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:26.960123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.960177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:26.960188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2780
2025-10-02T09:35:26.960268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:26.960285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:26.960291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:26.960293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:26.960496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2780 sessionId:  describe result for acl check
2025-10-02T09:35:26.960514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:26.960518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:26.960519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:26.960522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555694922514644:8574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:26.960762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555694922514644:8574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:26.962135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555694922514644:8574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:26.966195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555694922514644:8574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:26.966204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555694922514644:8574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:26.966206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555694922514644:8574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:26.966209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:26.966783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:26.968344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:26.968355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:26.968356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:26.968358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:26.968362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2779 [2:7556555694846940989:10363]
2025-10-02T09:35:26.968369Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:26.968379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:26.968381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.968382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.968383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.968392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:26.968398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:26.968404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:26.968437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.968442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.968442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.968444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:26.968446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:26.968483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:26.968488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.968495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:26.968500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:26.968509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:26.968523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514683:8574], now have 1 active actors on pipe
2025-10-02T09:35:26.968528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555694922514553:2446], now have 1 active actors on pipe
2025-10-02T09:35:26.968531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.968532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.968534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.968540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:26.968548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:26.968557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:26.968559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:26.968559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:26.968561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:26.968561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:26.968576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.968584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:26.968573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2779
2025-10-02T09:35:26.968587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:26.968593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2779
2025-10-02T09:35:26.968604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.968609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.968625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:26.968632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:26.968636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:26.968637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:26.968642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:26.968648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:26.968657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.968787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:26.968793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:26.968813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:26.968878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2780 partition: 0 MaxSeqNo: 36 sessionId: src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0
2025-10-02T09:35:26.969071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac5ca30-3ed0b101-c295fa4d-37ca62ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:26.971780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Write session: try to update token
2025-10-02T09:35:26.971790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:26.977835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:26.977849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:26.977850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:26.977851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:26.977856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.977858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.977860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555694846940983:10363]
2025-10-02T09:35:26.977883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:26.977887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:26.977888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:26.977888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:26.977891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:26.977894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:26.977989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:26.983428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId: src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:26.985457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.050778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482000:9243]
2025-10-02T09:35:27.050964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2779, pipe: [1:7556555699217482000:9243]
2025-10-02T09:35:27.087457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.087677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.087687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.087698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482000:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.087859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.087859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:27.087874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:27.087919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2780 reason: error at write: Disconnected sessionId: src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0
2025-10-02T09:35:27.088046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2780 sessionId: src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0 is DEAD
2025-10-02T09:35:27.088152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:27.088157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Write session will restart in 0.007043s
2025-10-02T09:35:27.088172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Write session: Do CDS request
2025-10-02T09:35:27.088176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.088119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482000:9243]
2025-10-02T09:35:27.088143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.094440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.095788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.095903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.095910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.095916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.095944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.095967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141908440:10377]
2025-10-02T09:35:27.096103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.096324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.096475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.096482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2781
2025-10-02T09:35:27.096502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.096528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.096564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.096582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.096588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.096591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.096707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.096736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.096740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.096740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.096741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.096742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.096742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.096743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.096743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.096744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.096744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.096745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.096745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.096748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.096755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.096757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.096759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.096761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.096763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.096764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.096767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.096769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.096771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.096773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.096775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.096779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.096782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.096785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.096788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.096790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.096792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.096795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.096797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.096813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.096816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.096818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.096820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.096823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.096826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.096828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.096831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.096833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.096835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.096837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.096840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.096842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.096845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.096847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.096850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.096866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.096887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2781 sessionId:  describe result for acl check
2025-10-02T09:35:27.096914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.096920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.096921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.096925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482084:8567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.097271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482084:8567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.098944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482084:8567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.103000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482084:8567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.103009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482084:8567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.103011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482084:8567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.103015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.104318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.105838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.105851Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.105852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.105854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.105857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2780 [2:7556555699141908440:10377]
2025-10-02T09:35:27.105866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.105876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.105877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.105879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.105880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.105889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.105895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.105899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.105928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.105933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.105934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.105936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.105937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.105972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.105977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.105983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.105988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.105996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.106010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482120:8567], now have 1 active actors on pipe
2025-10-02T09:35:27.106016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482001:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.106019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.106020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.106022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.106029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.106037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.106044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.106047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.106047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.106042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2780
2025-10-02T09:35:27.106049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.106056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2780
2025-10-02T09:35:27.106049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.106062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.106064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.106068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.106082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.106087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.106103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.106110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.106112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.106113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.106118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.106126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.106135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.106220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.106225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.106232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.106287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2781 partition: 0 MaxSeqNo: 36 sessionId: src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0
2025-10-02T09:35:27.106469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3679c10-9a3eb0f8-5f478b4e-833eac8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.109194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Write session: try to update token
2025-10-02T09:35:27.109203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.115186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.115200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.115201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.115202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.115207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.115211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.115213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141908435:10377]
2025-10-02T09:35:27.115235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.115235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.115237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.115238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.115239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.115240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.115365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.120783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId: src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.122799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.188501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482128:9243]
2025-10-02T09:35:27.188642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2780, pipe: [1:7556555699217482128:9243]
2025-10-02T09:35:27.225230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.225472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.225481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.225493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482128:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.225620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.225629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482128:9243]
2025-10-02T09:35:27.225635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:27.225639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:27.225654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.225690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2781 reason: error at write: Disconnected sessionId: src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0
2025-10-02T09:35:27.225823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2781 sessionId: src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0 is DEAD
2025-10-02T09:35:27.225950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:27.225960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Write session will restart in 0.008779s
2025-10-02T09:35:27.225975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Write session: Do CDS request
2025-10-02T09:35:27.225979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.232333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.233583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.233681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.233688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.233694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.233718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.233744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141908559:10379]
2025-10-02T09:35:27.234086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.234242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.234264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.234440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.234469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.234473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.234473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.234474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.234474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.234475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.234475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.234476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.234477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.234477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.234478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.234478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.234481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.234488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.234490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.234492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.234503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.234505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.234507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.234509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.234511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.234513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.234515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.234517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.234521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.234525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.234528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.234530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.234533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.234535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.234537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.234540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.234542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.234545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.234547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.234550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.234552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.234554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.234556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.234559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.234565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.234568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.234571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.234574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.234576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.234579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.234582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.234585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.234602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.236145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.236224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.236235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2782
2025-10-02T09:35:27.236316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.236338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.236344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.236347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.236620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2782 sessionId:  describe result for acl check
2025-10-02T09:35:27.236646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.236650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.236652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.236655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482227:8557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.237006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482227:8557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.238491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482227:8557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.241437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482227:8557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.241445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482227:8557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.241447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482227:8557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.241450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.241985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.243406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.243418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.243419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.243421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.243424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2781 [2:7556555699141908559:10379]
2025-10-02T09:35:27.243431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.243441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.243446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.243447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.243448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.243458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.243464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.243468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.243495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.243499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.243501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.243503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.243504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.243599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.243604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.243610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.243616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.243609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2781
2025-10-02T09:35:27.243612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2781
2025-10-02T09:35:27.243624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.243637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482262:8557], now have 1 active actors on pipe
2025-10-02T09:35:27.243642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482141:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.243646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.243648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.243649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.243654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.243660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.243667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.243668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.243669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.243670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.243679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.243687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.243692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.243713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.243720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.243723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.243725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.243732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.243740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.243745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.243753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.243764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.243770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.243857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.243862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.243870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.243921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2782 partition: 0 MaxSeqNo: 36 sessionId: src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0
2025-10-02T09:35:27.244098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fad37a-588c3ad9-9cd30640-2d5eed0b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.246887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Write session: try to update token
2025-10-02T09:35:27.246899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.252908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.252919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.252920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.252922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.252927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.252929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.252931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141908554:10379]
2025-10-02T09:35:27.252951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.252954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.252957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.252958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.252958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.252960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.253072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.259461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId: src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.261598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.325726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482271:9243]
2025-10-02T09:35:27.325892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2781, pipe: [1:7556555699217482271:9243]
2025-10-02T09:35:27.363588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.363791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.363800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.363812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482271:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.363934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.363954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482271:9243]
2025-10-02T09:35:27.363962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:27.363965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:27.363973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.364007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2782 reason: error at write: Disconnected sessionId: src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0
2025-10-02T09:35:27.364149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2782 sessionId: src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0 is DEAD
2025-10-02T09:35:27.364262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:27.364272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Write session will restart in 0.007850s
2025-10-02T09:35:27.364287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Write session: Do CDS request
2025-10-02T09:35:27.364292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.370525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.371739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.371841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.371848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.371853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.371879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.371902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141908682:10382]
2025-10-02T09:35:27.372241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.372410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.372432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.372602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.372631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.372635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.372635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.372636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.372636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.372637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.372637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.372638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.372639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.372639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.372640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.372640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.372643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.372651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.372653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.372655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.372657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.372659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.372661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.372663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.372665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.372667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.372669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.372671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.372675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.372678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.372682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.372684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.372686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.372689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.372692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.372695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.372697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.372700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.372702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.372705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.372707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.372710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.372712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.372714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.372718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.372721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.372723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.372726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.372728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.372731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.372733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.372737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.372753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.373124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.373223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.373232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2783
2025-10-02T09:35:27.373305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.373322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.373328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.373331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.373562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2783 sessionId:  describe result for acl check
2025-10-02T09:35:27.373586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.373590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.373591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.373594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482360:8554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.373928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482360:8554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.375195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482360:8554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.378938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482360:8554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.378952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482360:8554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.378954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482360:8554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.378957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.380134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.381644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.381656Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.381657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.381659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.381663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2782 [2:7556555699141908682:10382]
2025-10-02T09:35:27.381669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.381680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.381684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.381686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.381687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.381696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.381702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.381706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.381735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.381739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.381742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.381744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.381745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.381779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.381784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.381790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.381795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.381803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.381817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482395:8554], now have 1 active actors on pipe
2025-10-02T09:35:27.381822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482273:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.381826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.381827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.381828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.381836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.381835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2782
2025-10-02T09:35:27.381844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.381849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2782
2025-10-02T09:35:27.381850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.381852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.381853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.381854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.381856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.381876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.381881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.381890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.381898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.381911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.381916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.381920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.381922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.381923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.381928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.381933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.381949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.382032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.382037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.382044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.382093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2783 partition: 0 MaxSeqNo: 36 sessionId: src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0
2025-10-02T09:35:27.382261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ae2d3e-833ceddd-1dea3cac-6ca8b062_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.385005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Write session: try to update token
2025-10-02T09:35:27.385015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.391036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.391048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.391049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.391050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.391054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.391056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.391059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141908677:10382]
2025-10-02T09:35:27.391080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.391081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.391083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.391083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.391085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.391085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.391199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.396128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId: src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.398083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.463959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482402:9243]
2025-10-02T09:35:27.464083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2782, pipe: [1:7556555699217482402:9243]
2025-10-02T09:35:27.499881Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.500160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.500168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.500192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482402:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.500326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.500381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482402:9243]
2025-10-02T09:35:27.500394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.500405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:27.500452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2783 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0
2025-10-02T09:35:27.500575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2783 sessionId: src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0 is DEAD
2025-10-02T09:35:27.500690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:27.500699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Write session will restart in 0.006252s
2025-10-02T09:35:27.500718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Write session: Do CDS request
2025-10-02T09:35:27.500723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.507491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.508111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.508200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.508211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2784
2025-10-02T09:35:27.508301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.508321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.508327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.508330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.508635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2784 sessionId:  describe result for acl check
2025-10-02T09:35:27.508662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.508667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.508668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.508671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482487:8547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.508728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.508834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.508841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.508846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.508873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.508898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141908803:10384]
2025-10-02T09:35:27.509064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482487:8547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.509241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.509401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.509423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.509599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.509628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.509632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.509632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.509633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.509633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.509634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.509634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.509635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.509635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.509636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.509637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.509637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.509640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.509645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.509648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.509650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.509652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.509654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.509656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.509658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.509660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.509662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.509664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.509666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.509670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.509673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.509678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.509680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.509683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.509686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.509688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.509691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.509693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.509696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.509698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.509701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.509703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.509706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.509709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.509711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.509713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.509716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.509718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.509722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.509724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.509727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.509729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.509736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.509753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.510367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482487:8547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.514607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482487:8547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.514617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482487:8547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.514619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482487:8547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.514622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.517332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.518806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.518817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.518818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.518820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.518824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2783 [2:7556555699141908803:10384]
2025-10-02T09:35:27.518832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.518841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.518843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.518844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.518845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.518854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.518857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.518861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.518893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.518898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.518900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.518901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.518903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.518940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.518945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.518952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.518957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.518967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.518981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482403:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.518986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482526:8547], now have 1 active actors on pipe
2025-10-02T09:35:27.518991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.518992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.518993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.519000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.519009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.519013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.519015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.519009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2783
2025-10-02T09:35:27.519016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.519019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.519020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.519034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.519037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.519038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.519046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.519048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.519067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.519075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.519067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2783
2025-10-02T09:35:27.519078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.519079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.519084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.519089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.519102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.519190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.519195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.519202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.519260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2784 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0
2025-10-02T09:35:27.519438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc3f602-6fadbff7-fb7aa622-dc886aec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.522195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Write session: try to update token
2025-10-02T09:35:27.522205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.528347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.528360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.528361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.528362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.528370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.528372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.528375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141908798:10384]
2025-10-02T09:35:27.528397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.528401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.528403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.528403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.528409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.528412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.528512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.533864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId: src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.535960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.600671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482534:9243]
2025-10-02T09:35:27.600874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2783, pipe: [1:7556555699217482534:9243]
2025-10-02T09:35:27.640137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.640365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.640374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.640397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482534:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.640520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.640567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482534:9243]
2025-10-02T09:35:27.640589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.640606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:27.640671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2784 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0
2025-10-02T09:35:27.640818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2784 sessionId: src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0 is DEAD
2025-10-02T09:35:27.640938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:27.640946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Write session will restart in 0.006774s
2025-10-02T09:35:27.640961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Write session: Do CDS request
2025-10-02T09:35:27.640965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.647608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.648876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.648993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.649001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.649009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.649043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.649068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141908926:10386]
2025-10-02T09:35:27.649116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.649196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.649207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2785
2025-10-02T09:35:27.649285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.649303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.649308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.649311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.649405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.649562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.649565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2785 sessionId:  describe result for acl check
2025-10-02T09:35:27.649584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.649590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.649597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.649599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.649603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482622:8536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.649758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.649786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.649790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.649791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.649792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.649792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.649793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.649793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.649794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.649794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.649795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.649795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.649796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.649799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.649805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.649807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.649809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.649811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.649813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.649816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.649817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.649819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.649822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.649824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.649826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.649829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.649833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.649836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.649839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.649841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.649844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.649847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.649850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.649852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.649855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.649857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.649860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.649862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.649864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.649866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.649869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.649871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.649874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.649877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.649879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.649882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.649884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.649886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.649889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.649906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.649997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482622:8536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.651194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482622:8536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.655276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482622:8536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.655286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482622:8536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.655287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482622:8536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.655291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.657566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.659008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.659021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.659023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.659025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.659030Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2784 [2:7556555699141908926:10386]
2025-10-02T09:35:27.659041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.659057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.659064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.659066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.659068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.659081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.659091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.659099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.659128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.659133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.659134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.659136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.659138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.659172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.659177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.659184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.659193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.659212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.659229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482659:8536], now have 1 active actors on pipe
2025-10-02T09:35:27.659236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482535:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.659240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.659246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.659247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.659258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.659272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.659275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.659278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.659279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.659288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.659277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2784
2025-10-02T09:35:27.659290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.659284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2784
2025-10-02T09:35:27.659311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.659318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.659320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.659330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.659336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.659418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.659426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.659429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.659430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.659435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.659441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.659457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.659548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.659553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.659562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.659617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2785 partition: 0 MaxSeqNo: 36 sessionId: src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0
2025-10-02T09:35:27.659808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8b02c2-5f4644a9-6716bae5-41cd248b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.662554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Write session: try to update token
2025-10-02T09:35:27.662564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.668578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.668590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.668592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.668593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.668598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.668601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.668603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141908921:10386]
2025-10-02T09:35:27.668624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.668625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.668628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.668630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.668631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.668632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.668740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.673772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId: src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.675798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.740972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482667:9243]
2025-10-02T09:35:27.741168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2784, pipe: [1:7556555699217482667:9243]
2025-10-02T09:35:27.779993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.780211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.780220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.780231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482667:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.780349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.780380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:27.780396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:27.780412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482667:9243]
2025-10-02T09:35:27.780446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2785 reason: error at write: Disconnected sessionId: src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0
2025-10-02T09:35:27.780460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.780589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2785 sessionId: src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0 is DEAD
2025-10-02T09:35:27.780726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:27.780731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Write session will restart in 0.005608s
2025-10-02T09:35:27.780747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Write session: Do CDS request
2025-10-02T09:35:27.780752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.787120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.787206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.787215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2786
2025-10-02T09:35:27.787304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.787324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.787329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.787332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.787551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.787626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2786 sessionId:  describe result for acl check
2025-10-02T09:35:27.787657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.787663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.787664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.787668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482754:8526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.788052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482754:8526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.788821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.788917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.788929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.788937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.788966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.788992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141909049:10388]
2025-10-02T09:35:27.789329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.789488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.789502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482754:8526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.789514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.789701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.789732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.789736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.789737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.789737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.789738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.789739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.789739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.789740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.789740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.789741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.789741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.789742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.789744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.789750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.789752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.789754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.789756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.789758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.789760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.789762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.789764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.789767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.789769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.789771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.789774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.789778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.789781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.789784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.789786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.789789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.789791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.789793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.789796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.789798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.789802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.789804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.789806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.789809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.789811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.789813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.789816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.789818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.789820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.789823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.789825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.789827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.789829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.789832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.789847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.794589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482754:8526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.794599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482754:8526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.794601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482754:8526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.794605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.797270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.798719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.798730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.798731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.798734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.798738Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2785 [2:7556555699141909049:10388]
2025-10-02T09:35:27.798745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.798755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.798759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.798761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.798762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.798770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.798773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.798777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.798807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.798812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.798813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.798816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.798817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.798857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.798862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.798868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.798873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.798881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.798895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482793:8526], now have 1 active actors on pipe
2025-10-02T09:35:27.798900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482668:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.798903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.798905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.798906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.798914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.798916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2785
2025-10-02T09:35:27.798924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.798926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2785
2025-10-02T09:35:27.798926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.798928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.798929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.798933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.798934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.798956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.798960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.798968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.798975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.798983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.798994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.799001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.799003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.799004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.799009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.799014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.799028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.799114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.799119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.799126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.799185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2786 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0
2025-10-02T09:35:27.799358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f7a7c8-4f91203a-6f2d6d49-9d16a492_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.802126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Write session: try to update token
2025-10-02T09:35:27.802140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.808119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.808131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.808135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.808136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.808141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.808143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.808145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141909044:10388]
2025-10-02T09:35:27.808167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.808170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.808169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.808171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.808173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.808175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.808287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.813602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId: src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.815601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:27.880738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555699217482801:9243]
2025-10-02T09:35:27.880914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2785, pipe: [1:7556555699217482801:9243]
2025-10-02T09:35:27.917633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:27.917946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.917955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.917968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482801:9243], now have 1 active actors on pipe
2025-10-02T09:35:27.918087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:27.918096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:27.918108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:27.918120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:27.918148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2786 reason: error at write: Disconnected sessionId: src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0
2025-10-02T09:35:27.918154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555699217482801:9243]
2025-10-02T09:35:27.918273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2786 sessionId: src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0 is DEAD
2025-10-02T09:35:27.918380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:27.918388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Write session will restart in 0.009192s
2025-10-02T09:35:27.918412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Write session: Do CDS request
2025-10-02T09:35:27.918417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:27.924772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:27.925988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:27.926085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:27.926092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:27.926097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:27.926121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:27.926145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555699141909175:10390]
2025-10-02T09:35:27.926485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:27.926662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:27.926685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:27.926859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:27.926888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.926892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.926892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.926893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.926894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.926894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.926894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.926895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.926895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.926896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.926897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.926897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.926900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.926906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.926908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.926910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.926912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.926914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.926916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.926918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.926920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.926922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.926924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.926926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.926930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.926934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:27.926937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.926940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:27.926943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.926946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:27.926948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.926951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:27.926953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.926956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:27.926958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.926960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:27.926963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.926965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:27.926967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.926971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:27.926973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.926975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:27.926978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.926980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.926982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.926985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.926987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.926989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.927009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:27.928090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.928164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:27.928172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2787
2025-10-02T09:35:27.928257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:27.928274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:27.928280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:27.928282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:27.928533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2787 sessionId:  describe result for acl check
2025-10-02T09:35:27.928558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:27.928563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:27.928565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:27.928568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555699217482900:8525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:27.928920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555699217482900:8525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:27.930212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555699217482900:8525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:27.933799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555699217482900:8525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:27.933808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555699217482900:8525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:27.933810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555699217482900:8525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:27.933814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:27.934406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:27.935879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:27.935890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:27.935892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:27.935893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:27.935897Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2786 [2:7556555699141909175:10390]
2025-10-02T09:35:27.935905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:27.935917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:27.935922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.935924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.935924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.935933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:27.935939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:27.935944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:27.935975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.935980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.935981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.935982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:27.935984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:27.936019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:27.936023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.936030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:27.936035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:27.936047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:27.936062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482934:8525], now have 1 active actors on pipe
2025-10-02T09:35:27.936069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555699217482809:2446], now have 1 active actors on pipe
2025-10-02T09:35:27.936073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.936075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.936076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.936086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:27.936093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2786
2025-10-02T09:35:27.936094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2786
2025-10-02T09:35:27.936100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:27.936101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:27.936103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:27.936105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:27.936111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:27.936112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:27.936135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.936140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.936150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.936157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:27.936168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:27.936173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:27.936177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:27.936179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:27.936180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:27.936186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:27.936192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:27.936204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.936291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:27.936296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:27.936303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:27.936356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2787 partition: 0 MaxSeqNo: 36 sessionId: src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0
2025-10-02T09:35:27.936541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3aca6-353a135d-228822b3-9d6dcdb6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:27.939228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Write session: try to update token
2025-10-02T09:35:27.939238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:27.945385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:27.945399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:27.945401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:27.945403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:27.945411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.945415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.945418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555699141909170:10390]
2025-10-02T09:35:27.945442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:27.945449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:27.945450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:27.945450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:27.945455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:27.945458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:27.945567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:27.950713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId: src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:27.952916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.018443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512450263:9243]
2025-10-02T09:35:28.018578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2786, pipe: [1:7556555703512450263:9243]
2025-10-02T09:35:28.056532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.056739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.056747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.056759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450263:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.056900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.056961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:28.056974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:28.056982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.057016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512450263:9243]
2025-10-02T09:35:28.057016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2787 reason: error at write: Disconnected sessionId: src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0
2025-10-02T09:35:28.057146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2787 sessionId: src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0 is DEAD
2025-10-02T09:35:28.057255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:28.057262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Write session will restart in 0.009245s
2025-10-02T09:35:28.057276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Write session: Do CDS request
2025-10-02T09:35:28.057281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.063889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.065137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.065237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.065244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.065250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.065274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.065301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436876632:10404]
2025-10-02T09:35:28.065763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.065935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.065958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.066130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.066159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.066163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.066164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.066165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.066165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.066166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.066166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.066167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.066167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.066168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.066168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.066169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.066171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.066178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.066180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.066182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.066184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.066186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.066188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.066190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.066192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.066195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.066197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.066199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.066203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.066206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.066209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.066212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.066216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.066218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.066221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.066223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.066225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.066228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.066230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.066233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.066235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.066237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.066240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.066242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.066245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.066248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.066252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.066255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.066258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.066261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.066263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.066266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.066281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.067109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.067199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.067208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2788
2025-10-02T09:35:28.067277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.067295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.067301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.067303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.067553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2788 sessionId:  describe result for acl check
2025-10-02T09:35:28.067578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.067583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.067584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.067587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512450356:8496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.067915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512450356:8496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.069862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512450356:8496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.073114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512450356:8496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.073123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512450356:8496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.073125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512450356:8496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.073130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.073687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.075341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.075352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.075353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.075355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.075358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2787 [2:7556555703436876632:10404]
2025-10-02T09:35:28.075365Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.075375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.075379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.075381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.075382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.075391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.075396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.075401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.075429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.075433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.075435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.075436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.075438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.075479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.075483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.075490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.075495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.075503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.075517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450391:8496], now have 1 active actors on pipe
2025-10-02T09:35:28.075523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450264:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.075526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.075527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.075528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.075535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.075542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.075553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.075550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2787
2025-10-02T09:35:28.075553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.075554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2787
2025-10-02T09:35:28.075555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.075557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.075557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.075571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.075573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.075575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.075588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.075593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.075609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efd65e69-3b21c601-498b7829-13529186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.075615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.075619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.075620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.075625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.075630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.075647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.075740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.075745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.075751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.075813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2788 partition: 0 MaxSeqNo: 36 sessionId: src_id|efd65e69-3b21c601-498b7829-13529186_0
2025-10-02T09:35:28.075989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330e44a3-aa53f2b9-682665d0-da6aca33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|efd65e69-3b21c601-498b7829-13529186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.078817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Write session: try to update token
2025-10-02T09:35:28.078830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.084769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.084781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.084782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.084783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.084787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.084789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.084791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436876627:10404]
2025-10-02T09:35:28.084822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.084825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.084827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.084829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.084830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.084831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.084957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.090395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId: src_id|efd65e69-3b21c601-498b7829-13529186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.092461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.157202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512450398:9243]
2025-10-02T09:35:28.157355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2787, pipe: [1:7556555703512450398:9243]
2025-10-02T09:35:28.194389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.194641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.194650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.194662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450398:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.194812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.194812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512450398:9243]
2025-10-02T09:35:28.194823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:28.194835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.194825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:28.194863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2788 reason: error at write: Disconnected sessionId: src_id|efd65e69-3b21c601-498b7829-13529186_0
2025-10-02T09:35:28.195014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2788 sessionId: src_id|efd65e69-3b21c601-498b7829-13529186_0 is DEAD
2025-10-02T09:35:28.195132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:28.195140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Write session will restart in 0.006988s
2025-10-02T09:35:28.195155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Write session: Do CDS request
2025-10-02T09:35:28.195159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.201835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.203066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.203100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.203155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.203165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2789
2025-10-02T09:35:28.203200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.203206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.203211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.203236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.203251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.203260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436876773:10408]
2025-10-02T09:35:28.203269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.203275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.203277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.203522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2789 sessionId:  describe result for acl check
2025-10-02T09:35:28.203545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.203549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.203551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.203553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512450501:8503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.203601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.203786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.203808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.203879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512450501:8503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.203983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.204012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.204016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.204017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.204017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.204018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.204018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.204019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.204019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.204020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.204020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.204021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.204021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.204024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.204030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.204032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.204034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.204036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.204038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.204040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.204042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.204044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.204046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.204048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.204050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.204054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.204058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.204061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.204064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.204066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.204069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.204071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.204073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.204076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.204078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.204080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.204083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.204086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.204088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.204090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.204093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.204095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.204098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.204104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.204107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.204109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.204111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.204113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.204116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.204136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.205082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512450501:8503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.209427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512450501:8503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.209436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512450501:8503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.209438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512450501:8503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.209443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.211659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.213180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.213193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.213194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.213197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.213201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2788 [2:7556555703436876773:10408]
2025-10-02T09:35:28.213209Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.213219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.213224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.213225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.213227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.213237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.213243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.213246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.213278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.213283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.213284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.213286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.213287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.213323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.213328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.213334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.213339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.213347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.213363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450540:8503], now have 1 active actors on pipe
2025-10-02T09:35:28.213368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450412:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.213372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.213373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.213374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.213383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.213391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.213401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.213404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.213406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.213406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.213415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2788
2025-10-02T09:35:28.213418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2788
2025-10-02T09:35:28.213408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.213422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.213424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.213434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.213439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.213441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.213460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c6736f-468dafd5-e30c2a3-bc275668_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.213467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.213469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.213471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.213477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.213482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.213493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.213580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.213585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.213592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.213642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2789 partition: 0 MaxSeqNo: 36 sessionId: src_id|58c6736f-468dafd5-e30c2a3-bc275668_0
2025-10-02T09:35:28.213955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efd65e69-3b21c601-498b7829-13529186_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|58c6736f-468dafd5-e30c2a3-bc275668_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.216744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Write session: try to update token
2025-10-02T09:35:28.216755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.222829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.222846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.222848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.222849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.222853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.222856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.222859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436876768:10408]
2025-10-02T09:35:28.222883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.222891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.222891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.222892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.222895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.222898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.222999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.228999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId: src_id|58c6736f-468dafd5-e30c2a3-bc275668_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.231111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.294928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512450547:9243]
2025-10-02T09:35:28.295055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2788, pipe: [1:7556555703512450547:9243]
2025-10-02T09:35:28.332159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.332373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.332382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.332393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450547:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.332519Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.332537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:28.332548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:28.332562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512450547:9243]
2025-10-02T09:35:28.332574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.332590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2789 reason: error at write: Disconnected sessionId: src_id|58c6736f-468dafd5-e30c2a3-bc275668_0
2025-10-02T09:35:28.332720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2789 sessionId: src_id|58c6736f-468dafd5-e30c2a3-bc275668_0 is DEAD
2025-10-02T09:35:28.332842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:28.332850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Write session will restart in 0.005126s
2025-10-02T09:35:28.332868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Write session: Do CDS request
2025-10-02T09:35:28.332872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.339098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.339154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.339161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2790
2025-10-02T09:35:28.339247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.339272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.339278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.339280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.339455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.339531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2790 sessionId:  describe result for acl check
2025-10-02T09:35:28.339550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.339555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.339556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.339558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512450640:8495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.339891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512450640:8495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.340820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.340918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.340924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.340929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.340954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.340977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436876900:10410]
2025-10-02T09:35:28.341313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.341418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512450640:8495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.341489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.341510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.341683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.341712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.341716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.341717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.341717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.341718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.341718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.341719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.341719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.341720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.341720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.341721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.341722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.341724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.341730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.341732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.341734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.341736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.341738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.341740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.341742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.341744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.341746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.341748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.341750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.341753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.341757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.341761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.341764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.341766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.341769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.341771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.341773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.341776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.341778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.341780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.341783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.341785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.341788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.341790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.341792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.341796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.341811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.341816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.341819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.341821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.341824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.341829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.341832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.341848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.345629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512450640:8495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.345639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512450640:8495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.345640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512450640:8495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.345644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.349306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.350880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.350892Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.350893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.350895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.350898Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2789 [2:7556555703436876900:10410]
2025-10-02T09:35:28.350905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.350916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.350921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.350923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.350924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.350933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.350940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.350944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.350975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.350980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.350981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.350983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.350984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.351020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.351025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.351031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.351036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.351046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.351060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450550:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.351065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450679:8495], now have 1 active actors on pipe
2025-10-02T09:35:28.351069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.351070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.351071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.351079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.351087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.351097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.351097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.351099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.351100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.351101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.351102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2789
2025-10-02T09:35:28.351115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.351111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2789
2025-10-02T09:35:28.351121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.351129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.351141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.351143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.351160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.351166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.351168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.351169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.351174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.351179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.351185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.351265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.351270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.351276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.351353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2790 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0
2025-10-02T09:35:28.351523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c6736f-468dafd5-e30c2a3-bc275668_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.354330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Write session: try to update token
2025-10-02T09:35:28.354340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.360276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.360293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.360294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.360295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.360301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.360304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.360306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436876895:10410]
2025-10-02T09:35:28.360330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.360333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.360335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.360340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.360344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.360347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.360454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.366142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId: src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.368222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.432669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512450687:9243]
2025-10-02T09:35:28.432845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2789, pipe: [1:7556555703512450687:9243]
2025-10-02T09:35:28.468347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.468721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.468731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.468743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450687:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.468881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512450687:9243]
2025-10-02T09:35:28.468898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.468903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.468911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:28.468913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:28.468953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2790 reason: error at write: Disconnected sessionId: src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0
2025-10-02T09:35:28.469093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2790 sessionId: src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0 is DEAD
2025-10-02T09:35:28.469211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:28.469216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Write session will restart in 0.006376s
2025-10-02T09:35:28.469232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Write session: Do CDS request
2025-10-02T09:35:28.469236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.475952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.476117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.476190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.476201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2791
2025-10-02T09:35:28.476279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.476301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.476304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.476306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.476573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2791 sessionId:  describe result for acl check
2025-10-02T09:35:28.476595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.476600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.476601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.476604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512450779:8489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.476968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512450779:8489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.477206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.477324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.477332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.477337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.477365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.477388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436877031:10413]
2025-10-02T09:35:28.477721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.477932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.477963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.478183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.478215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.478218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.478219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.478219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.478220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.478221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.478221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.478222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.478222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.478223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.478223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.478224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.478226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.478232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.478234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.478236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.478239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.478241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.478242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.478244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.478246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.478248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.478250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.478252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.478255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.478260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.478263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.478265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.478268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.478270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.478273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.478275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.478277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.478280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.478282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.478285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.478289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.478293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.478295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.478298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.478301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.478306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.478308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.478311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.478313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.478316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.478321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.478324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.478340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.478569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512450779:8489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.483069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512450779:8489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.483077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512450779:8489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.483079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512450779:8489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.483083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.485756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.487213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.487224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.487225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.487227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.487230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2790 [2:7556555703436877031:10413]
2025-10-02T09:35:28.487237Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.487248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.487253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.487254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.487256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.487265Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.487271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.487275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.487303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.487308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.487309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.487311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.487312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.487347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.487352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.487358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.487363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.487371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.487385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450818:8489], now have 1 active actors on pipe
2025-10-02T09:35:28.487391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450688:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.487394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.487395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.487396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.487404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.487412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.487420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.487422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.487423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.487423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.487424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.487421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2790
2025-10-02T09:35:28.487426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2790
2025-10-02T09:35:28.487439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.487444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.487446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.487457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.487462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.487479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.487486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.487488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.487489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.487493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.487498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.487511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.487594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.487600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.487609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.487661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2791 partition: 0 MaxSeqNo: 36 sessionId: src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0
2025-10-02T09:35:28.487819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b11880f-8343878f-4edf012d-1d47d3ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.490568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Write session: try to update token
2025-10-02T09:35:28.490579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.496520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.496533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.496534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.496535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.496540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.496542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.496546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436877026:10413]
2025-10-02T09:35:28.496566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.496569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.496570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.496572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.496577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.496582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.496699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.501880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId: src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.503905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.568868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512450826:9243]
2025-10-02T09:35:28.569096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2790, pipe: [1:7556555703512450826:9243]
2025-10-02T09:35:28.608551Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.608832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.608842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.608854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450826:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.609000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.609000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:28.609012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:28.609019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512450826:9243]
2025-10-02T09:35:28.609034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.609060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2791 reason: error at write: Disconnected sessionId: src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0
2025-10-02T09:35:28.609182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2791 sessionId: src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0 is DEAD
2025-10-02T09:35:28.609293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:28.609298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Write session will restart in 0.005638s
2025-10-02T09:35:28.609317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Write session: Do CDS request
2025-10-02T09:35:28.609322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.616120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.616183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.616191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2792
2025-10-02T09:35:28.616270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.616290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.616295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.616297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.616557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2792 sessionId:  describe result for acl check
2025-10-02T09:35:28.616583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.616587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.616588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.616591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512450918:8479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.616974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512450918:8479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.617660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.617992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.618084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.618092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.618097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.618124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.618147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436877160:10415]
2025-10-02T09:35:28.618319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512450918:8479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.618490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.618665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.618689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.618868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.618897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.618901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.618901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.618902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.618902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.618903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.618903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.618904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.618905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.618905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.618906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.618906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.618909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.618915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.618917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.618920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.618922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.618924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.618926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.618928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.618930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.618932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.618934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.618936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.618941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.618945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.618948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.618951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.618954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.618956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.618959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.618961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.618964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.618967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.618969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.618971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.618974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.618976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.618978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.618981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.618984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.618987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.618989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.618992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.618998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.619001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.619003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.619005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.619026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.622940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512450918:8479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.622948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512450918:8479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.622950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512450918:8479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.622954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.626637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.628084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.628095Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.628097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.628099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.628102Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2791 [2:7556555703436877160:10415]
2025-10-02T09:35:28.628108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.628118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.628123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.628124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.628125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.628135Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.628137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.628142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.628175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.628180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.628181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.628183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.628185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.628221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.628226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.628232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.628238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.628246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.628260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450958:8479], now have 1 active actors on pipe
2025-10-02T09:35:28.628265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450827:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.628269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.628270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.628271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.628286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2791
2025-10-02T09:35:28.628298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.628287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2791
2025-10-02T09:35:28.628305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.628308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.628310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.628313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.628324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.628328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.628355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.628361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.628369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.628377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.628392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.628396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|116ab488-57286ec1-1057d27c-a0cee665_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.628400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.628402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.628403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.628407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.628413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.628487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.628577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.628583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.628594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.628654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2792 partition: 0 MaxSeqNo: 36 sessionId: src_id|116ab488-57286ec1-1057d27c-a0cee665_0
2025-10-02T09:35:28.628875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390e7bed-79edaccc-b4d390f0-f5722eaa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|116ab488-57286ec1-1057d27c-a0cee665_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.631660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Write session: try to update token
2025-10-02T09:35:28.631671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.637576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.637591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.637593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.637596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.637601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.637603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.637607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436877155:10415]
2025-10-02T09:35:28.637630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.637633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.637634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.637639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.637643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.637647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.637745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.643587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId: src_id|116ab488-57286ec1-1057d27c-a0cee665_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.645716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.709145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512450966:9243]
2025-10-02T09:35:28.709331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2791, pipe: [1:7556555703512450966:9243]
2025-10-02T09:35:28.749666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.749941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.749950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.749963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450966:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.750109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.750142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512450966:9243]
2025-10-02T09:35:28.750151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:28.750171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.750208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|116ab488-57286ec1-1057d27c-a0cee665_0
2025-10-02T09:35:28.750346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2792 sessionId: src_id|116ab488-57286ec1-1057d27c-a0cee665_0 is DEAD
2025-10-02T09:35:28.750465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:28.750471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Write session will restart in 0.009976s
2025-10-02T09:35:28.750486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Write session: Do CDS request
2025-10-02T09:35:28.750490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.758023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.759387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.759488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.759494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.759499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.759526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.759548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436877291:10417]
2025-10-02T09:35:28.759897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.760064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.760086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.760274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.760309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.760313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.760313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.760314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.760314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.760315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.760315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.760316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.760316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.760317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.760317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.760318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.760321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.760328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.760330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.760332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.760334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.760336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.760338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.760340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.760342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.760344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.760346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.760348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.760352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.760356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.760359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.760362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.760364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.760367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.760369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.760371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.760374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.760376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.760379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.760381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.760383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.760386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.760388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.760391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.760393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.760398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.760400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.760403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.760405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.760408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.760410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.760413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.760432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.761164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.761171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2793
2025-10-02T09:35:28.761204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.761469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.761487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.761493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.761496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.761730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2793 sessionId:  describe result for acl check
2025-10-02T09:35:28.761755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.761759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.761760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.761763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512451064:8477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.762089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512451064:8477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.763228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512451064:8477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.767107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512451064:8477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.767115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512451064:8477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.767117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512451064:8477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.767121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.767885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.769299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.769310Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.769311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.769313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.769317Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2792 [2:7556555703436877291:10417]
2025-10-02T09:35:28.769324Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.769333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.769335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.769336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.769338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.769347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.769350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.769354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.769386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.769391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.769393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.769395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.769396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.769438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.769443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.769449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.769454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.769461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.769475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512451099:8477], now have 1 active actors on pipe
2025-10-02T09:35:28.769480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512450967:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.769484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.769485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.769486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.769493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.769500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.769506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.769508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.769510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.769511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.769512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.769512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2792
2025-10-02T09:35:28.769520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2792
2025-10-02T09:35:28.769526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.769531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.769532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.769539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.769542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.769564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|337a10c1-51909c1b-2fc83dfe-491a532_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.769571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.769573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.769575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.769580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.769588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.769600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.769694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.769699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.769707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.769765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2793 partition: 0 MaxSeqNo: 36 sessionId: src_id|337a10c1-51909c1b-2fc83dfe-491a532_0
2025-10-02T09:35:28.769944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116ab488-57286ec1-1057d27c-a0cee665_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|337a10c1-51909c1b-2fc83dfe-491a532_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.772686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Write session: try to update token
2025-10-02T09:35:28.772697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.778684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.778699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.778700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.778701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.778707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.778709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.778711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436877286:10417]
2025-10-02T09:35:28.778730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.778733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.778734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.778742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.778746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.778749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.778837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.784695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId: src_id|337a10c1-51909c1b-2fc83dfe-491a532_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.786802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.850472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512451106:9243]
2025-10-02T09:35:28.850656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2792, pipe: [1:7556555703512451106:9243]
2025-10-02T09:35:28.890732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:28.891056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.891066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.891077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512451106:9243], now have 1 active actors on pipe
2025-10-02T09:35:28.891194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:28.891242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:28.891275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:28.891281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512451106:9243]
2025-10-02T09:35:28.891330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2793 reason: status is not ok: tablet will be restarted right now sessionId: src_id|337a10c1-51909c1b-2fc83dfe-491a532_0
2025-10-02T09:35:28.891476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2793 sessionId: src_id|337a10c1-51909c1b-2fc83dfe-491a532_0 is DEAD
2025-10-02T09:35:28.891608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:28.891618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Write session will restart in 0.005264s
2025-10-02T09:35:28.891632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Write session: Do CDS request
2025-10-02T09:35:28.891637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:28.898164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.898275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:28.898283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2794
2025-10-02T09:35:28.898351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:28.898369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:28.898375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:28.898377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:28.898667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2794 sessionId:  describe result for acl check
2025-10-02T09:35:28.898695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:28.898699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:28.898700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:28.898703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555703512451204:8472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:28.898811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:28.899038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555703512451204:8472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:28.900228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:28.900332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:28.900340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:28.900345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:28.900372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:28.900393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555703436877423:10419]
2025-10-02T09:35:28.900511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555703512451204:8472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:28.901029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:28.901213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:28.901254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:28.901555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:28.901587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.901591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.901591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.901592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.901593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.901593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.901594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.901595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.901596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.901597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.901598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.901599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.901602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.901607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.901610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.901612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.901614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.901617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.901619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.901621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.901623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.901625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.901628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.901630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.901634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.901638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:28.901641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.901645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:28.901647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.901650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:28.901652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.901655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:28.901658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.901661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:28.901665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.901668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:28.901671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.901674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:28.901676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.901679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:28.901682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.901684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:28.901687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.901689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.901692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.901695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.901698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.901700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.901718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:28.905483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555703512451204:8472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:28.905494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555703512451204:8472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:28.905495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555703512451204:8472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:28.905499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:28.909117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:28.910597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:28.910608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:28.910609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:28.910611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:28.910614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2793 [2:7556555703436877423:10419]
2025-10-02T09:35:28.910621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:28.910630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:28.910632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.910633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.910634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.910644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:28.910648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:28.910652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:28.910681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.910686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.910688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.910690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:28.910691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:28.910728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:28.910733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.910739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:28.910745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:28.910755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:28.910769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512451244:8472], now have 1 active actors on pipe
2025-10-02T09:35:28.910776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512451111:2446], now have 1 active actors on pipe
2025-10-02T09:35:28.910781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.910784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.910786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.910796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:28.910801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2793
2025-10-02T09:35:28.910801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2793
2025-10-02T09:35:28.910810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:28.910817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:28.910818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:28.910833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:28.910843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:28.910844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:28.910869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.910874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.910881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.910883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:28.910906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|233f97cd-7233a82-5d341af7-a3104019_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:28.910906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:28.910913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:28.910915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:28.910917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:28.910922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:28.910929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:28.910939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.911011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:28.911016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:28.911024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:28.911075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2794 partition: 0 MaxSeqNo: 36 sessionId: src_id|233f97cd-7233a82-5d341af7-a3104019_0
2025-10-02T09:35:28.911257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337a10c1-51909c1b-2fc83dfe-491a532_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|233f97cd-7233a82-5d341af7-a3104019_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:28.914001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Write session: try to update token
2025-10-02T09:35:28.914012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:28.919992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:28.920007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:28.920008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:28.920009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:28.920015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.920018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.920021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555703436877418:10419]
2025-10-02T09:35:28.920041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:28.920046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:28.920047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:28.920052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:28.920064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:28.920070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:28.920155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:28.925548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId: src_id|233f97cd-7233a82-5d341af7-a3104019_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:28.927633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:28.991283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555703512451256:9243]
2025-10-02T09:35:28.991789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2793, pipe: [1:7556555703512451256:9243]
2025-10-02T09:35:29.033217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.033401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.033409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.033421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555703512451256:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.033527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.033546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555703512451256:9243]
2025-10-02T09:35:29.033562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:29.033565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:29.033569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.033605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2794 reason: error at write: Disconnected sessionId: src_id|233f97cd-7233a82-5d341af7-a3104019_0
2025-10-02T09:35:29.033752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2794 sessionId: src_id|233f97cd-7233a82-5d341af7-a3104019_0 is DEAD
2025-10-02T09:35:29.033905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:29.033917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Write session will restart in 0.005212s
2025-10-02T09:35:29.033940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Write session: Do CDS request
2025-10-02T09:35:29.033945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.040116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.040281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.040285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.040297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2795
2025-10-02T09:35:29.040408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.040427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.040432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.040434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.040669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2795 sessionId:  describe result for acl check
2025-10-02T09:35:29.040695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.040700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.040700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.040703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807418674:8445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.041006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807418674:8445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.041514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.041617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.041624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.041630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.041656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.041684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731844889:10433]
2025-10-02T09:35:29.042032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.042034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807418674:8445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.042200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.042223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.042398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.042426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.042430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.042431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.042431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.042432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.042432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.042433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.042433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.042434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.042434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.042435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.042436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.042438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.042444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.042446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.042448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.042450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.042452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.042454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.042456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.042458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.042460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.042462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.042463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.042467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.042471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.042474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.042477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.042479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.042482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.042484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.042486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.042488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.042491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.042493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.042495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.042497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.042500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.042502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.042513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.042516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.042519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.042521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.042523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.042525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.042528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.042531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.042533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.042549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.046325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807418674:8445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.046338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807418674:8445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.046341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807418674:8445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.046345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.049901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.051392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.051404Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.051405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.051407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.051410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2794 [2:7556555707731844889:10433]
2025-10-02T09:35:29.051416Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.051425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.051426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.051428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.051429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.051438Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.051441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.051445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.051473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.051478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.051479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.051481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.051482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.051515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.051520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.051527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.051532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.051540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.051554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418578:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.051559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418709:8445], now have 1 active actors on pipe
2025-10-02T09:35:29.051562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.051563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.051564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.051571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.051579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.051588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.051588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.051589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.051590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.051592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.051590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2794
2025-10-02T09:35:29.051605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.051595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2794
2025-10-02T09:35:29.051610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.051612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.051626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.051631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.051650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d628d2-38774cda-3166744f-a72cf804_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.051657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.051659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.051660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.051665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.051671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.051685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.051766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.051771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.051777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.051830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2795 partition: 0 MaxSeqNo: 36 sessionId: src_id|87d628d2-38774cda-3166744f-a72cf804_0
2025-10-02T09:35:29.052051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|233f97cd-7233a82-5d341af7-a3104019_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87d628d2-38774cda-3166744f-a72cf804_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.054563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Write session: try to update token
2025-10-02T09:35:29.054582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.060674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.060685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.060686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.060687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.060690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.060693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.060694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731844884:10433]
2025-10-02T09:35:29.060712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.060715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.060716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.060723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.060735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.060739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.060852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.067072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId: src_id|87d628d2-38774cda-3166744f-a72cf804_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.069218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.133729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807418716:9243]
2025-10-02T09:35:29.133881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2794, pipe: [1:7556555707807418716:9243]
2025-10-02T09:35:29.173197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.173466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.173475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.173487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418716:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.173630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.173648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.173670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807418716:9243]
2025-10-02T09:35:29.173683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:29.173737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87d628d2-38774cda-3166744f-a72cf804_0
2025-10-02T09:35:29.173880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2795 sessionId: src_id|87d628d2-38774cda-3166744f-a72cf804_0 is DEAD
2025-10-02T09:35:29.174063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:29.174078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Write session will restart in 0.006955s
2025-10-02T09:35:29.174099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Write session: Do CDS request
2025-10-02T09:35:29.174104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.180747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.182087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.182208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.182191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.182199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.182205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.182230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.182254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731845035:10437]
2025-10-02T09:35:29.182310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.182317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2796
2025-10-02T09:35:29.182413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.182431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.182437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.182440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.182609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.182708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2796 sessionId:  describe result for acl check
2025-10-02T09:35:29.182724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.182728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.182729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.182732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807418815:8441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.182774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.182799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.182978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.183005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.183008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.183009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.183009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.183010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.183010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.183011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.183012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.183012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.183013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.183013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.183014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.183017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.183023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.183025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.183027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.183029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.183031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.183033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.183035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.183037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.183039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.183041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.183043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.183046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.183063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807418815:8441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.183050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.183053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.183056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.183058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.183061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.183063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.183066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.183068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.183071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.183073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.183075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.183078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.183080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.183083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.183085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.183087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.183090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.183092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.183095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.183097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.183100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.183102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.183104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.183122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.184593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807418815:8441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.188312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807418815:8441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.188321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807418815:8441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.188323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807418815:8441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.188331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.190491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.192014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.192026Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.192027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.192030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.192033Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2795 [2:7556555707731845035:10437]
2025-10-02T09:35:29.192041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.192050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.192052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.192053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.192054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.192063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.192069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.192073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.192101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.192106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.192107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.192109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.192110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.192144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.192149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.192155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.192160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.192168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.192178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418853:8441], now have 1 active actors on pipe
2025-10-02T09:35:29.192184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418717:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.192187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.192189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.192190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.192197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.192205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.192210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.192201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2795
2025-10-02T09:35:29.192213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.192214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.192215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.192221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2795
2025-10-02T09:35:29.192217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.192236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.192241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.192248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.192256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.192260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.192271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.192277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.192280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.192281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.192286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.192294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.192309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.192396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.192402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.192411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.192490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2796 partition: 0 MaxSeqNo: 36 sessionId: src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0
2025-10-02T09:35:29.192752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d628d2-38774cda-3166744f-a72cf804_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.195080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Write session: try to update token
2025-10-02T09:35:29.195097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.201223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.201235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.201236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.201236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.201241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.201243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.201245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731845030:10437]
2025-10-02T09:35:29.201263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.201267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.201268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.201278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.201289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.201293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.201372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.206972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId: src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.209157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.273898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807418872:9243]
2025-10-02T09:35:29.274097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2795, pipe: [1:7556555707807418872:9243]
2025-10-02T09:35:29.309866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.310081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.310090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.310103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418872:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.310263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.310258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:29.310262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.310267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:29.310295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807418872:9243]
2025-10-02T09:35:29.310315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2796 reason: error at write: Disconnected sessionId: src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0
2025-10-02T09:35:29.310461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2796 sessionId: src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0 is DEAD
2025-10-02T09:35:29.310626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:29.310640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Write session will restart in 0.008081s
2025-10-02T09:35:29.310661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Write session: Do CDS request
2025-10-02T09:35:29.310667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.317454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.318786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.318897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.318904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.318911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.318939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.318964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731845170:10439]
2025-10-02T09:35:29.319310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.319468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.319490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.319694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.319746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.319752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.319753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.319754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.319755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.319756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.319756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.319757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.319758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.319759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.319759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.319760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.319763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.319770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.319772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.319774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.319776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.319778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.319780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.319782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.319784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.319787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.319789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.319791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.319795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.319799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.319803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.319805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.319808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.319810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.319812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.319815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.319817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.319820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.319822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.319824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.319827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.319829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.319831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.319834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.319838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.319840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.319844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.319847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.319849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.319855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.319858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.319860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.319879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.320203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.320297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.320305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2797
2025-10-02T09:35:29.320424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.320442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.320448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.320450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.320706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2797 sessionId:  describe result for acl check
2025-10-02T09:35:29.320731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.320735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.320736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.320738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807418976:8438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.321181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807418976:8438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.322288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807418976:8438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.326028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807418976:8438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.326037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807418976:8438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.326039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807418976:8438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.326042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.327281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.328794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.328816Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.328821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.328823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.328826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2796 [2:7556555707731845170:10439]
2025-10-02T09:35:29.328836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.328847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.328852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.328854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.328855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.328864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.328869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.328874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.328903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.328908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.328909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.328911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.328912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.328946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.328951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.328957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.328962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.328970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.328985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419011:8438], now have 1 active actors on pipe
2025-10-02T09:35:29.328990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807418875:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.328994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.328995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.328996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.329003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.329010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.329016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.329018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.329020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.329020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.329022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.329018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2796
2025-10-02T09:35:29.329031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2796
2025-10-02T09:35:29.329037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.329041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.329043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.329051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.329053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.329076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.329082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.329084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.329085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.329091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.329098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.329113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.329187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.329192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.329200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.329258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2797 partition: 0 MaxSeqNo: 36 sessionId: src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0
2025-10-02T09:35:29.329524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c68838-4cdce2ac-cba40c41-ca3ba75_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.331858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Write session: try to update token
2025-10-02T09:35:29.331872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.338000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.338013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.338014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.338015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.338018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.338020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.338022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731845165:10439]
2025-10-02T09:35:29.338041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.338048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.338049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.338051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.338055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.338065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.338159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.344227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId: src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.346288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.410593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807419019:9243]
2025-10-02T09:35:29.410984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2796, pipe: [1:7556555707807419019:9243]
2025-10-02T09:35:29.446354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.446599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.446607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.446620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419019:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.446759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.446768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:29.446779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:29.446790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807419019:9243]
2025-10-02T09:35:29.446805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.446875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2797 reason: error at write: Disconnected sessionId: src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0
2025-10-02T09:35:29.447167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:29.447180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Write session will restart in 0.009050s
2025-10-02T09:35:29.447200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Write session: Do CDS request
2025-10-02T09:35:29.447209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.447008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2797 sessionId: src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0 is DEAD
2025-10-02T09:35:29.453845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.455096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.455191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.455198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.455203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.455228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.455252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731845307:10442]
2025-10-02T09:35:29.455594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.455760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.455783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.455957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.455985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.455988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.455989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.455989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.455990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.455991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.455991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.455992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.455992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.455993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.455993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.455994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.455997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.456003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.456006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.456008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.456010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.456012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.456014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.456016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.456018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.456020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.456022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.456024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.456027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.456037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.456041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.456044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.456046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.456049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.456051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.456057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.456060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.456062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.456064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.456067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.456069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.456072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.456074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.456077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.456080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.456083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.456087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.456089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.456092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.456094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.456096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.456099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.456117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.457195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.457299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.457309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2798
2025-10-02T09:35:29.457424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.457442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.457449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.457451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.457767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2798 sessionId:  describe result for acl check
2025-10-02T09:35:29.457789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.457793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.457794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.457797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807419122:8433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.458174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807419122:8433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.459564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807419122:8433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.462923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807419122:8433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.462934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807419122:8433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.462936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807419122:8433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.462939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.463506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.465005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.465016Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.465017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.465019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.465022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2797 [2:7556555707731845307:10442]
2025-10-02T09:35:29.465029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.465039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.465040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.465041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.465042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.465052Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.465058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.465062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.465091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.465095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.465097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.465099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.465101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.465137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.465141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.465147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.465152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.465160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.465175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419157:8433], now have 1 active actors on pipe
2025-10-02T09:35:29.465180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419020:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.465183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.465184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.465186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.465193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.465200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.465206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.465207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.465208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2797
2025-10-02T09:35:29.465209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.465214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.465215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2797
2025-10-02T09:35:29.465215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.465222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.465224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.465226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.465237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.465239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.465257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b506e94-b3203f24-25ca720d-7600480d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.465264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.465266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.465267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.465272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.465278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.465290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.465371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.465376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.465384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.465439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2798 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b506e94-b3203f24-25ca720d-7600480d_0
2025-10-02T09:35:29.465722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eb46285-6021af34-883b3ffb-ae3e3afa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b506e94-b3203f24-25ca720d-7600480d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.468062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Write session: try to update token
2025-10-02T09:35:29.468077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.474203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.474216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.474217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.474218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.474221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.474223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.474225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731845302:10442]
2025-10-02T09:35:29.474243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.474249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.474250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.474255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.474266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.474270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.474361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.479987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId: src_id|7b506e94-b3203f24-25ca720d-7600480d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.482146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.546787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807419165:9243]
2025-10-02T09:35:29.547129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2797, pipe: [1:7556555707807419165:9243]
2025-10-02T09:35:29.585168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.585402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.585412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.585425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419165:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.585810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807419165:9243]
2025-10-02T09:35:29.585838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:29.585841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:29.585882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2798 reason: error at write: Disconnected sessionId: src_id|7b506e94-b3203f24-25ca720d-7600480d_0
2025-10-02T09:35:29.585976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.586025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2798 sessionId: src_id|7b506e94-b3203f24-25ca720d-7600480d_0 is DEAD
2025-10-02T09:35:29.586155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.586184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:29.586198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Write session will restart in 0.005655s
2025-10-02T09:35:29.586220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Write session: Do CDS request
2025-10-02T09:35:29.586226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.593160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.593146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.593277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.593289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2799
2025-10-02T09:35:29.593401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.593422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.593428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.593431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.593687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2799 sessionId:  describe result for acl check
2025-10-02T09:35:29.593709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.593713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.593714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.593717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807419265:8426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.594054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807419265:8426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.594461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.594570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.594579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.594587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.594626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.594652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731845445:10444]
2025-10-02T09:35:29.594981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.595138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.595160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.595228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807419265:8426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.595331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.595361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.595365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.595365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.595366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.595366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.595367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.595367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.595368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.595368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.595369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.595370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.595370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.595373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.595379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.595381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.595383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.595385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.595387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.595389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.595391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.595393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.595395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.595397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.595399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.595402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.595406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.595410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.595412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.595414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.595417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.595419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.595422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.595424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.595427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.595429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.595431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.595434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.595436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.595439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.595442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.595444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.595447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.595449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.595452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.595454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.595457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.595459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.595461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.595478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.599219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807419265:8426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.599229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807419265:8426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.599231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807419265:8426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.599235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.602846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.604467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.604479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.604480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.604483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.604486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2798 [2:7556555707731845445:10444]
2025-10-02T09:35:29.604493Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.604502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.604507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.604509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.604510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.604518Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.604525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.604529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.604558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.604562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.604564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.604565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.604567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.604601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.604606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.604612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.604619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.604627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.604641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419166:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.604646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419303:8426], now have 1 active actors on pipe
2025-10-02T09:35:29.604650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.604651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.604652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.604659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.604666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.604675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.604676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.604668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2798
2025-10-02T09:35:29.604682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.604691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.604687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2798
2025-10-02T09:35:29.604692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.604696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.604698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.604705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.604705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.604707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.604729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da491124-5675c2d6-23781aeb-1a872fe4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.604736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.604738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.604739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.604744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.604749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.604756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.604858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.604864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.604872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.604929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2799 partition: 0 MaxSeqNo: 36 sessionId: src_id|da491124-5675c2d6-23781aeb-1a872fe4_0
2025-10-02T09:35:29.605192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b506e94-b3203f24-25ca720d-7600480d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da491124-5675c2d6-23781aeb-1a872fe4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.607551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Write session: try to update token
2025-10-02T09:35:29.607567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.613750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.613762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.613763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.613764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.613767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.613769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.613771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731845440:10444]
2025-10-02T09:35:29.613789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.613796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.613797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.613800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.613806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.613809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.613912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.620109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId: src_id|da491124-5675c2d6-23781aeb-1a872fe4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.622282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.686068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807419310:9243]
2025-10-02T09:35:29.686568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2798, pipe: [1:7556555707807419310:9243]
2025-10-02T09:35:29.727527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.727797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.727807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.727820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419310:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.727935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.727979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.728010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:29.728068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2799 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da491124-5675c2d6-23781aeb-1a872fe4_0
2025-10-02T09:35:29.728161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807419310:9243]
2025-10-02T09:35:29.728217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2799 sessionId: src_id|da491124-5675c2d6-23781aeb-1a872fe4_0 is DEAD
2025-10-02T09:35:29.728371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:29.728384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Write session will restart in 0.007590s
2025-10-02T09:35:29.728409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Write session: Do CDS request
2025-10-02T09:35:29.728415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.735528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.736811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.736929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.736936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.736942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.736975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.737000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731845583:10446]
2025-10-02T09:35:29.737130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.737259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.737265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2800
2025-10-02T09:35:29.737342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.737379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.737399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.737404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.737407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.737493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.737516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.737663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2800 sessionId:  describe result for acl check
2025-10-02T09:35:29.737682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.737687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.737688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.737690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.737690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807419416:8419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.737718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.737718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.737719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.737720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.737720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.737720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.737721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.737721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.737722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.737722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.737723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.737723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.737726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.737734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.737736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.737738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.737740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.737742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.737744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.737746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.737748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.737750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.737752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.737754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.737758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.737762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.737765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.737768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.737770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.737773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.737775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.737777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.737780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.737782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.737784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.737787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.737789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.737792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.737794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.737797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.737799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.737802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.737804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.737808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.737810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.737812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.737814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.737817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.737835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.738071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807419416:8419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.739597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807419416:8419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.743125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807419416:8419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.743133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807419416:8419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.743135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807419416:8419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.743139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.745395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.746927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.746940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.746941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.746943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.746947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2799 [2:7556555707731845583:10446]
2025-10-02T09:35:29.746955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.746966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.746971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.746973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.746974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.746983Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.746990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.746994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.747035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.747041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.747042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.747044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.747045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.747082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.747087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.747094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.747099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.747113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.747128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419314:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.747133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419453:8419], now have 1 active actors on pipe
2025-10-02T09:35:29.747137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.747138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.747139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.747147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.747155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.747151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2799
2025-10-02T09:35:29.747159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.747162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.747163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.747167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.747169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.747173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2799
2025-10-02T09:35:29.747178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.747180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.747181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.747194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.747196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.747222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1f3d755-2366dda7-716025d0-d6fda464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.747229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.747232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.747233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.747239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.747243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.747252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.747359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.747364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.747371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.747422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2800 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1f3d755-2366dda7-716025d0-d6fda464_0
2025-10-02T09:35:29.747683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da491124-5675c2d6-23781aeb-1a872fe4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1f3d755-2366dda7-716025d0-d6fda464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.750074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Write session: try to update token
2025-10-02T09:35:29.750090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.756507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.756520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.756524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.756524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.756528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.756531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.756533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731845578:10446]
2025-10-02T09:35:29.756552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.756558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.756559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.756562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.756566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.756569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.756666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.762163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId: src_id|b1f3d755-2366dda7-716025d0-d6fda464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.764368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.828369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807419465:9243]
2025-10-02T09:35:29.828522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2799, pipe: [1:7556555707807419465:9243]
2025-10-02T09:35:29.867340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:29.867587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.867597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.867610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419465:9243], now have 1 active actors on pipe
2025-10-02T09:35:29.867729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:29.867729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:29.867763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807419465:9243]
2025-10-02T09:35:29.867763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:29.867766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:29.867817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2800 reason: error at write: Disconnected sessionId: src_id|b1f3d755-2366dda7-716025d0-d6fda464_0
2025-10-02T09:35:29.867960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2800 sessionId: src_id|b1f3d755-2366dda7-716025d0-d6fda464_0 is DEAD
2025-10-02T09:35:29.868131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:29.868146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Write session will restart in 0.008889s
2025-10-02T09:35:29.868166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Write session: Do CDS request
2025-10-02T09:35:29.868171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:29.875200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:29.876485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:29.876634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:29.876642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:29.876649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:29.876680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:29.876704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555707731845722:10448]
2025-10-02T09:35:29.877053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:29.877222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:29.877245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:29.877421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:29.877448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.877453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.877454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.877454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.877455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.877455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.877456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.877456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.877457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.877457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.877458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.877458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.877461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.877468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.877470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.877472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.877474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.877476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.877478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.877480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.877482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.877484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.877486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.877488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.877492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.877496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:29.877500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.877503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:29.877505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.877509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:29.877511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.877514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:29.877516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.877518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:29.877521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.877524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:29.877526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.877528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:29.877530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.877533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:29.877535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.877537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:29.877539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.877542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.877544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.877547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.877549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.877551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.877568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:29.878163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.878338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:29.878345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2801
2025-10-02T09:35:29.878458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:29.878478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:29.878485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:29.878488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:29.878746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2801 sessionId:  describe result for acl check
2025-10-02T09:35:29.878768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:29.878772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:29.878773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:29.878776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555707807419572:8411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:29.879105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555707807419572:8411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:29.880395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555707807419572:8411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:29.884353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555707807419572:8411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:29.884360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555707807419572:8411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:29.884363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555707807419572:8411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:29.884367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:29.884913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:29.886470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:29.886482Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:29.886483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:29.886485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:29.886488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2800 [2:7556555707731845722:10448]
2025-10-02T09:35:29.886495Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:29.886504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:29.886506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.886507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.886508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.886529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:29.886536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:29.886540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:29.886569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.886573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.886574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.886576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:29.886578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:29.886614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:29.886619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.886626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:29.886631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:29.886639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:29.886653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419467:2446], now have 1 active actors on pipe
2025-10-02T09:35:29.886658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419606:8411], now have 1 active actors on pipe
2025-10-02T09:35:29.886661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.886663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.886664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.886672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:29.886682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:29.886684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:29.886686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:29.886687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:29.886693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:29.886684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2800
2025-10-02T09:35:29.886694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2800
2025-10-02T09:35:29.886695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:29.886708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.886711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:29.886712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:29.886723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.886727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.886752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d62343f-8083250-11951346-39f118f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:29.886759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:29.886761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:29.886762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:29.886768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:29.886772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:29.886781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.886873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:29.886878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:29.886885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:29.886925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2801 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d62343f-8083250-11951346-39f118f3_0
2025-10-02T09:35:29.887131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f3d755-2366dda7-716025d0-d6fda464_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d62343f-8083250-11951346-39f118f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:29.889441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Write session: try to update token
2025-10-02T09:35:29.889455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:29.895734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:29.895746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:29.895747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:29.895749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:29.895753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.895755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.895757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555707731845717:10448]
2025-10-02T09:35:29.895775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:29.895781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:29.895782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:29.895786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:29.895790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:29.895794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:29.895889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:29.901583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId: src_id|4d62343f-8083250-11951346-39f118f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:29.903770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:29.968164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555707807419619:9243]
2025-10-02T09:35:29.968297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2800, pipe: [1:7556555707807419619:9243]
2025-10-02T09:35:30.007348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.007656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.007666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.007678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555707807419619:9243], now have 1 active actors on pipe
2025-10-02T09:35:30.007832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.007858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555707807419619:9243]
2025-10-02T09:35:30.007873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.007881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:30.007883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:30.007903Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T09:35:30.007943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2801 reason: error at write: Disconnected sessionId: src_id|4d62343f-8083250-11951346-39f118f3_0
2025-10-02T09:35:30.007994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2801 sessionId: src_id|4d62343f-8083250-11951346-39f118f3_0 is DEAD
2025-10-02T09:35:30.008068Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 28 consumer shared/user session shared/user_1_28_3412319194304025370_v1 is DEAD
2025-10-02T09:35:30.008181Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555647677862708:9245] disconnected; active server actors: 1
2025-10-02T09:35:30.008187Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555647677862708:9245] client user disconnected session shared/user_1_28_3412319194304025370_v1
2025-10-02T09:35:30.008361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:30.008380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Write session will restart in 0.005719s
2025-10-02T09:35:30.008362Z :ERROR: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T09:35:30.008401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Write session: Do CDS request
2025-10-02T09:35:30.008419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.008489Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:30.008493Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T09:35:30.008508Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Reconnecting session to cluster  in 0.006155s
2025-10-02T09:35:30.015135Z :DEBUG: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Successfully connected. Initializing session
2025-10-02T09:35:30.015283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.015462Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T09:35:30.015469Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 29
2025-10-02T09:35:30.015489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.015494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2802
2025-10-02T09:35:30.015613Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 29 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:30.015630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.015648Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 read init: from# ipv6:[::1]:40444, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T09:35:30.015661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.015669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.015674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.015703Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 auth for : user
2025-10-02T09:35:30.015783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.015840Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 Handle describe topics response
2025-10-02T09:35:30.015855Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 auth is DEAD
2025-10-02T09:35:30.015868Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 auth ok: topics# 1, initDone# 0
2025-10-02T09:35:30.016029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2802 sessionId:  describe result for acl check
2025-10-02T09:35:30.016045Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T09:35:30.016056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.016061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.016063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.016067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387024:8401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.016101Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556555712102387025:8406] connected; active server actors: 1
2025-10-02T09:35:30.016112Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556555712102387025:8406] session shared/user_1_29_11005836875355772221_v1
2025-10-02T09:35:30.016125Z :INFO: [/Root] [/Root] [aa3043d0-2b2e162a-c028d207-3b93cf8] [] Got InitResponse. ReadSessionId: shared/user_1_29_11005836875355772221_v1
2025-10-02T09:35:30.016122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T09:35:30.016132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T09:35:30.016138Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_29_11005836875355772221_v1" (Sender=[1:7556555712102387018:8406], Pipe=[1:7556555712102387025:8406], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:30.016142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T09:35:30.016151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T09:35:30.016161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_29_11005836875355772221_v1" (Sender=[1:7556555712102387018:8406], Pipe=[1:7556555712102387025:8406], Partitions=[], ActiveFamilyCount=0)
2025-10-02T09:35:30.016174Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_29_11005836875355772221_v1" sender [1:7556555712102387018:8406] lock partition 0 for ReadingSession "shared/user_1_29_11005836875355772221_v1" (Sender=[1:7556555712102387018:8406], Pipe=[1:7556555712102387025:8406], Partitions=[], ActiveFamilyCount=1) generation 1 step 29
2025-10-02T09:35:30.016186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T09:35:30.016193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-02T09:35:30.016385Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 29 Session: "shared/user_1_29_11005836875355772221_v1" ClientId: "user" PipeClient { RawX1: 7556555712102387025 RawX2: 4503603922346198 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T09:35:30.016404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T09:35:30.016417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387024:8401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.017194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.017300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.017307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.017313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.017340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.017365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026813158:10450]
2025-10-02T09:35:30.017739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.017838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387024:8401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.017919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.017943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.018125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.018156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.018160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.018160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.018161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.018161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.018162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.018162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.018163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.018164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.018164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.018165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.018165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.018168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.018175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.018177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.018179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.018181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.018183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.018185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.018187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.018189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.018191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.018193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.018195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.018199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.018203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.018206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.018209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.018212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.018215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.018219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.018222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.018224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.018226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.018231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.018233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.018236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.018239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.018241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.018244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.018250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.018252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.018255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.018257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.018260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.018263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.018269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.018271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.018288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.022131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387024:8401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.022141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387024:8401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.022143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387024:8401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.022147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.025795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.027386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.027398Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.027399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.027402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.027405Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2801 [2:7556555712026813158:10450]
2025-10-02T09:35:30.027413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.027424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.027429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.027432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.027433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.027443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.027450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.027455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.027485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.027490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.027491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.027493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.027494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.027540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.027545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.027552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.027557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.027565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.027580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387029:7823], now have 1 active actors on pipe
2025-10-02T09:35:30.027586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102386919:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.027587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387068:8401], now have 1 active actors on pipe
2025-10-02T09:35:30.027591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.027595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.027596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.027604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.027615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.027617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.027620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.027621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.027625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.027627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.027643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.027649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.027649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.027625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2801
2025-10-02T09:35:30.027625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2801, pipe: [1:7556555712102387029:7823]
2025-10-02T09:35:30.027660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.027665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.027636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2801
2025-10-02T09:35:30.027672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_29_11005836875355772221_v1 on pipe: [1:7556555712102387029:7823]
2025-10-02T09:35:30.027698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.027702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.027706Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_29_11005836875355772221_v1:1 with generation 2801
2025-10-02T09:35:30.027713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.027720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.027722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.027730Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_29_11005836875355772221_v1
2025-10-02T09:35:30.027734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.027752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.027757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T09:35:30.027762Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T09:35:30.030081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T09:35:30.030101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T09:35:30.030106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.030111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.030112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.030117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.030123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.030130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T09:35:30.030136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T09:35:30.030146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.030248Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1759397286000 SizeLag: 7988796 WriteTimestampEstimateMS: 1759397730026 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T09:35:30.030258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-02T09:35:30.030277Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 sending to client partition status
2025-10-02T09:35:30.030305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.030310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.030318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.030373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2802 partition: 0 MaxSeqNo: 36 sessionId: src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0
2025-10-02T09:35:30.030656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d62343f-8083250-11951346-39f118f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.033081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Write session: try to update token
2025-10-02T09:35:30.033099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.037048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.037060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.037061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.037062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.037066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.037068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.037071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026813152:10450]
2025-10-02T09:35:30.037091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.037097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.037098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.037105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.037109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.037113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.037217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.045571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId: src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.047837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.154576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.154911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.154920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.155065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_29_11005836875355772221_v1
2025-10-02T09:35:30.155078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.155097Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_29_11005836875355772221_v1
2025-10-02T09:35:30.155087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.155087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102387029:7823]
2025-10-02T09:35:30.155106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:30.155107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:30.155153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2802 reason: error at write: Disconnected sessionId: src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0
2025-10-02T09:35:30.155297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2802 sessionId: src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0 is DEAD
2025-10-02T09:35:30.155452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:30.155467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Write session will restart in 0.008596s
2025-10-02T09:35:30.155488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Write session: Do CDS request
2025-10-02T09:35:30.155493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.162695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.164042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.164176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.164183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.164189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.164218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.164241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026813351:10466]
2025-10-02T09:35:30.164576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.164740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.164763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.164949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.164977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.164981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.164982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.164982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.164984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.164985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.164985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.164986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.164986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.164987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.164987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.164988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.164991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.164997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.164999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.165002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.165004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.165006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.165007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.165009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.165011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.165013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.165015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.165017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.165023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.165026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.165029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.165032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.165036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.165039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.165041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.165044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.165046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.165049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.165051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.165054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.165056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.165059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.165062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.165064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.165067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.165069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.165074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.165077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.165079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.165082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.165087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.165089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.165106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.165153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.165231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.165239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2803
2025-10-02T09:35:30.165376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.165395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.165398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.165401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.165647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2803 sessionId:  describe result for acl check
2025-10-02T09:35:30.165669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.165675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.165676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.165679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387208:8377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.166018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387208:8377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.167149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387208:8377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.171291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387208:8377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.171299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387208:8377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.171301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387208:8377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.171305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.172479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.173979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.173993Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.173994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.173996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.173999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2802 [2:7556555712026813351:10466]
2025-10-02T09:35:30.174007Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.174016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.174018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.174019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.174021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.174030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.174036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.174041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.174073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.174079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.174081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.174083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.174085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.174132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.174139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.174149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.174158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.174171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.174188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387101:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.174196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387243:8377], now have 1 active actors on pipe
2025-10-02T09:35:30.174201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.174203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.174204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.174214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.174200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2802
2025-10-02T09:35:30.174201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2802
2025-10-02T09:35:30.174229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.174230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.174237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.174237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.174238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.174239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.174253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.174257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.174259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.174269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.174274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.174301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.174309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.174311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.174315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.174321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.174327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.174338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.174468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.174474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.174482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.174535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2803 partition: 0 MaxSeqNo: 36 sessionId: src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0
2025-10-02T09:35:30.174769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b261dc23-e1dcb117-be1fa614-ecc77a63_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.177488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Write session: try to update token
2025-10-02T09:35:30.177500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.183522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.183537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.183538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.183539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.183543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.183545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.183547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026813346:10466]
2025-10-02T09:35:30.183567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.183570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.183572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.183576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.183580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.183592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.183686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.190037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId: src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.192134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.255406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555712102387263:7823]
2025-10-02T09:35:30.255624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2802, pipe: [1:7556555712102387263:7823]
2025-10-02T09:35:30.299746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.299981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.299990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.300003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387263:7823], now have 1 active actors on pipe
2025-10-02T09:35:30.300115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.300133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102387263:7823]
2025-10-02T09:35:30.300154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:30.300161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.300206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2803 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0
2025-10-02T09:35:30.300336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2803 sessionId: src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0 is DEAD
2025-10-02T09:35:30.300462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:30.300470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Write session will restart in 0.006213s
2025-10-02T09:35:30.300490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Write session: Do CDS request
2025-10-02T09:35:30.300494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.307652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.308106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.308195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.308204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2804
2025-10-02T09:35:30.308295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.308316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.308322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.308325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.308576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2804 sessionId:  describe result for acl check
2025-10-02T09:35:30.308594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.308599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.308600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.308603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387370:8367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.308964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387370:8367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.308991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.309084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.309091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.309097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.309122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.309146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026813493:10468]
2025-10-02T09:35:30.309493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.309656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.309681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.309935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.309939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.309940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.309940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.309941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.309941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.309942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.309943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.309943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.309943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.309944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.309944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.309947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.309953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.309955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.309957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.309959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.309961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.309963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.309965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.309967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.309969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.309971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.309973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.309976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.309981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.309984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.309987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.309990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.309993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.309995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.309998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.310000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.310003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.310005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.310008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.310013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.310016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.310018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.310021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.310023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.310027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.310032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.310035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.310037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.310039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.310041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.310044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.310060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.310459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387370:8367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.314793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387370:8367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.314801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387370:8367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.314803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387370:8367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.314807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.317465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.319006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.319019Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.319021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.319023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.319026Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2803 [2:7556555712026813493:10468]
2025-10-02T09:35:30.319033Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.319043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.319045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.319046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.319048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.319056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.319063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.319067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.319097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.319102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.319103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.319106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.319107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.319152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.319159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.319166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.319171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.319178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.319190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387409:8367], now have 1 active actors on pipe
2025-10-02T09:35:30.319193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387266:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.319196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.319197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.319198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.319205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.319212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.319220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.319220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.319221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.319222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.319223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.319235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.319236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.319238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.319232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2803
2025-10-02T09:35:30.319238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2803
2025-10-02T09:35:30.319284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.319292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.319310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.319318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.319320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.319321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.319327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.319334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.319344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.319431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.319438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.319447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.319505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2804 partition: 0 MaxSeqNo: 36 sessionId: src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0
2025-10-02T09:35:30.319757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a80872-65539d4d-2c2988b7-aefbe67e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.322368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Write session: try to update token
2025-10-02T09:35:30.322385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.328116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:30.328128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.328132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.328153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:30.328162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:30.328295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:30.328415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:30.328534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:30.328660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:30.328829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:30.328857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:30.334667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId: src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.336527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.336541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.336542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.336544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.336548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.336551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.336555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026813488:10468]
2025-10-02T09:35:30.336574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.336578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.336579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.336581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.336584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.336586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.336684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.336916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.400282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555712102387417:7823]
2025-10-02T09:35:30.400464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2803, pipe: [1:7556555712102387417:7823]
2025-10-02T09:35:30.447340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.447652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.447661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.447674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387417:7823], now have 1 active actors on pipe
2025-10-02T09:35:30.448000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.448049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.448086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102387417:7823]
2025-10-02T09:35:30.448107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:30.448110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:30.448146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2804 reason: error at write: Disconnected sessionId: src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0
2025-10-02T09:35:30.448280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2804 sessionId: src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0 is DEAD
2025-10-02T09:35:30.448398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:30.448406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Write session will restart in 0.006434s
2025-10-02T09:35:30.448439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Write session: Do CDS request
2025-10-02T09:35:30.448444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.455748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.456121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.456243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.456251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2805
2025-10-02T09:35:30.456360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.456380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.456386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.456388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.456658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2805 sessionId:  describe result for acl check
2025-10-02T09:35:30.456681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.456685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.456686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.456689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387523:8364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.457079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387523:8364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.457110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.457243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.457253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.457260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.457326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.457359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026813637:10471]
2025-10-02T09:35:30.457733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.457919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.457946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.458129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.458158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.458162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.458163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.458163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.458164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.458165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.458165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.458166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.458166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.458167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.458167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.458168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.458171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.458177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.458179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.458181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.458183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.458185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.458187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.458189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.458191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.458193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.458195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.458197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.458200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.458204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.458209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.458212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.458214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.458217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.458219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.458222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.458224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.458227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.458232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.458235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.458237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.458240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.458242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.458248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.458251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.458253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.458255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.458261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.458263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.458266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.458271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.458274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.458291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.458459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387523:8364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.463023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387523:8364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.463033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387523:8364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.463035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387523:8364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.463038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.465693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.467201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.467213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.467214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.467216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.467221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2804 [2:7556555712026813637:10471]
2025-10-02T09:35:30.467227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.467236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.467238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.467239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.467240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.467250Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.467257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.467261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.467298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.467302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.467303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.467305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.467306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.467343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.467348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.467354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.467359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.467371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.467384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387418:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.467389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387562:8364], now have 1 active actors on pipe
2025-10-02T09:35:30.467393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.467394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.467396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.467403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.467410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.467408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2804
2025-10-02T09:35:30.467424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2804
2025-10-02T09:35:30.467417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.467419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.467421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.467425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.467426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.467434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.467436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.467437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.467447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.467453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.467478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|313d749a-77217c43-692da064-6b168a7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.467485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.467487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.467488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.467492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.467497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.467510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.467611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.467615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.467623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.467670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2805 partition: 0 MaxSeqNo: 36 sessionId: src_id|313d749a-77217c43-692da064-6b168a7e_0
2025-10-02T09:35:30.467900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632d350c-d5f74a31-96d9ce45-db78fff8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|313d749a-77217c43-692da064-6b168a7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.470212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Write session: try to update token
2025-10-02T09:35:30.470228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.476751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.476763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.476764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.476765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.476768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.476770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.476772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026813632:10471]
2025-10-02T09:35:30.476792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.476796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.476797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.476815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.476828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.476831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.476938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.482392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId: src_id|313d749a-77217c43-692da064-6b168a7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.484451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.548249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555712102387570:7823]
2025-10-02T09:35:30.548686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2804, pipe: [1:7556555712102387570:7823]
2025-10-02T09:35:30.589480Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.589768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.589784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.589798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387570:7823], now have 1 active actors on pipe
2025-10-02T09:35:30.589946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.589978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102387570:7823]
2025-10-02T09:35:30.589983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:30.589990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:30.590032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2805 reason: error at write: Disconnected sessionId: src_id|313d749a-77217c43-692da064-6b168a7e_0
2025-10-02T09:35:30.590166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2805 sessionId: src_id|313d749a-77217c43-692da064-6b168a7e_0 is DEAD
2025-10-02T09:35:30.590269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.590384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:30.590400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Write session will restart in 0.009242s
2025-10-02T09:35:30.590422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Write session: Do CDS request
2025-10-02T09:35:30.590428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.597383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.598722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.598839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.598846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.598852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.598879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.598904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026813781:10473]
2025-10-02T09:35:30.599244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.599405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.599428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.599603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.599632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.599637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.599637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.599638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.599639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.599639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.599640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.599640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.599641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.599642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.599642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.599643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.599646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.599652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.599655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.599657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.599659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.599661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.599662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.599664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.599666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.599668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.599670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.599672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.599676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.599680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.599684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.599686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.599688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.599691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.599693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.599696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.599698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.599701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.599703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.599705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.599709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.599711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.599713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.599716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.599718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.599721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.599723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.599725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.599727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.599730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.599732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.599734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.599751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.601174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.601214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.601220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2806
2025-10-02T09:35:30.601409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.601427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.601432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.601435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.601677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2806 sessionId:  describe result for acl check
2025-10-02T09:35:30.601698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.601702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.601703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.601705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387682:8358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.602033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387682:8358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.603351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387682:8358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.606545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387682:8358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.606553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387682:8358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.606555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387682:8358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.606559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.607123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.608609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.608620Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.608621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.608623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.608627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2805 [2:7556555712026813781:10473]
2025-10-02T09:35:30.608633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.608643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.608645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.608646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.608647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.608656Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.608664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.608668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.608697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.608702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.608703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.608705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.608706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.608740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.608747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.608752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.608758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.608765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.608777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387571:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.608779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387716:8358], now have 1 active actors on pipe
2025-10-02T09:35:30.608782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.608783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.608784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.608791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.608798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.608817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.608817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.608818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.608819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.608829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2805
2025-10-02T09:35:30.608820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.608831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.608833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2805
2025-10-02T09:35:30.608836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.608840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.608858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.608866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.608879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.608885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.608887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.608888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.608892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.608901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.608908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.609013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.609019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.609029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.609086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2806 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0
2025-10-02T09:35:30.609269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|313d749a-77217c43-692da064-6b168a7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.611668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Write session: try to update token
2025-10-02T09:35:30.611680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.617670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:30.617680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.617684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.617703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:30.617711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:30.617843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:30.617960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:30.618077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:30.618199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:30.618353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:30.618375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:30.624622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId: src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.626123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.626135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.626137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.626138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.626145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.626147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.626149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026813776:10473]
2025-10-02T09:35:30.626168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.626173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.626174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.626175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.626176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.626177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.626286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.626981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.690073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555712102387724:7823]
2025-10-02T09:35:30.690243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2805, pipe: [1:7556555712102387724:7823]
2025-10-02T09:35:30.736735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.737078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.737088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.737102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387724:7823], now have 1 active actors on pipe
2025-10-02T09:35:30.737247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.737298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102387724:7823]
2025-10-02T09:35:30.737317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.737320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:30.737377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2806 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0
2025-10-02T09:35:30.737520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2806 sessionId: src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0 is DEAD
2025-10-02T09:35:30.737672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:30.737686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Write session will restart in 0.009358s
2025-10-02T09:35:30.737707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Write session: Do CDS request
2025-10-02T09:35:30.737713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.744781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.746090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.746188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.746194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.746200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.746224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.746248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026813926:10475]
2025-10-02T09:35:30.746597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.746769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.746791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.746966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.746993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.746997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.746997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.746998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.746998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.746999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.747000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.747000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.747001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.747001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.747002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.747002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.747005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.747012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.747015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.747017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.747019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.747021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.747023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.747025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.747027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.747030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.747032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.747034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.747038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.747043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.747046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.747049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.747051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.747054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.747056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.747059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.747061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.747063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.747067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.747069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.747071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.747074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.747076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.747078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.747080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.747083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.747085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.747088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.747090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.747092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.747094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.747099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.747115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.748167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.748281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.748289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2807
2025-10-02T09:35:30.748396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.748414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.748418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.748421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.748680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2807 sessionId:  describe result for acl check
2025-10-02T09:35:30.748702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.748707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.748708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.748711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387836:8350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.749074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387836:8350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.750272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387836:8350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.753936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387836:8350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.753945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387836:8350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.753947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387836:8350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.753951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.754502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.756064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.756077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.756078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.756080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.756084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2806 [2:7556555712026813926:10475]
2025-10-02T09:35:30.756091Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.756101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.756103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.756104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.756106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.756115Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.756120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.756124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.756154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.756159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.756161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.756163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.756164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.756199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.756204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.756211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.756216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.756225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.756239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387725:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.756245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387870:8350], now have 1 active actors on pipe
2025-10-02T09:35:30.756248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.756250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.756251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.756258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.756266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.756262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2806
2025-10-02T09:35:30.756271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.756273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.756283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2806
2025-10-02T09:35:30.756274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.756280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.756281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.756293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.756294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.756296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.756302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.756304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.756325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.756333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.756336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.756337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.756341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.756348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.756356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.756451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.756456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.756464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.756514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2807 partition: 0 MaxSeqNo: 36 sessionId: src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0
2025-10-02T09:35:30.756744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4a8966-e6e9793e-ea3e2e79-563bc1e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.759455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Write session: try to update token
2025-10-02T09:35:30.759470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.765315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.765328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.765329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.765330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.765333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.765337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.765339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026813921:10475]
2025-10-02T09:35:30.765358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.765364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.765365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.765368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.765372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.765375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.765474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.772345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId: src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.774582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.837527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555712102387878:7823]
2025-10-02T09:35:30.837719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2806, pipe: [1:7556555712102387878:7823]
2025-10-02T09:35:30.879241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:30.879584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.879600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.879613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387878:7823], now have 1 active actors on pipe
2025-10-02T09:35:30.879768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:30.879792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102387878:7823]
2025-10-02T09:35:30.879799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:30.879801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:30.879856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2807 reason: error at write: Disconnected sessionId: src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0
2025-10-02T09:35:30.879990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2807 sessionId: src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0 is DEAD
2025-10-02T09:35:30.880111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:30.880149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:30.880162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Write session will restart in 0.008089s
2025-10-02T09:35:30.880188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Write session: Do CDS request
2025-10-02T09:35:30.880194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:30.887357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:30.888606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:30.888719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:30.888725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:30.888731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:30.888763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:30.888787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555712026814072:10477]
2025-10-02T09:35:30.889166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.889161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:30.889309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:30.889325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2808
2025-10-02T09:35:30.889380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:30.889405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:30.889450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:30.889479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:30.889489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:30.889493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:30.889590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:30.889629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.889634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.889635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.889635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.889636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.889636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.889637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.889638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.889638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.889639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.889639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.889640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.889643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.889649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.889652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.889654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.889656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.889658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.889660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.889662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.889664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.889667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.889669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.889671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.889675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.889680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:30.889683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.889686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:30.889689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.889692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:30.889694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.889698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:30.889700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.889702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:30.889705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.889707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:30.889710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.889712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:30.889715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.889719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:30.889721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.889724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:30.889726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.889728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.889731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.889733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.889735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.889738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.889755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:30.889854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2808 sessionId:  describe result for acl check
2025-10-02T09:35:30.889884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:30.889891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:30.889893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:30.889898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555712102387994:8341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:30.890337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555712102387994:8341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:30.891785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555712102387994:8341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:30.895956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555712102387994:8341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:30.895964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555712102387994:8341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:30.895965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555712102387994:8341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:30.895970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:30.897148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:30.898641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:30.898653Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:30.898654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:30.898656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:30.898659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2807 [2:7556555712026814072:10477]
2025-10-02T09:35:30.898666Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:30.898677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:30.898679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.898680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.898681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.898690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:30.898697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:30.898701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:30.898732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.898737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.898738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.898740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:30.898741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:30.898775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:30.898780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.898786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:30.898791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:30.898802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:30.898816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102388030:8341], now have 1 active actors on pipe
2025-10-02T09:35:30.898821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102387880:2446], now have 1 active actors on pipe
2025-10-02T09:35:30.898825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.898828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.898829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.898836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:30.898847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:30.898854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:30.898856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:30.898856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:30.898857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:30.898857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:30.898841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2807
2025-10-02T09:35:30.898860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2807
2025-10-02T09:35:30.898886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.898893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.898902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.898912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:30.898924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:30.898936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:30.898940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:30.898942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:30.898943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:30.898949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:30.898956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:30.898976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.899074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:30.899080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:30.899090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:30.899163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2808 partition: 0 MaxSeqNo: 36 sessionId: src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0
2025-10-02T09:35:30.899430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894dd-ede86f2e-4fb9e4dc-ca13c46c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:30.901904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Write session: try to update token
2025-10-02T09:35:30.901930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:30.908002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:30.908014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:30.908015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:30.908016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:30.908020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.908022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.908026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555712026814067:10477]
2025-10-02T09:35:30.908044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:30.908050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:30.908052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:30.908055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:30.908060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:30.908063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:30.908172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:30.914413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId: src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:30.916618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:30.979881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555712102388042:7823]
2025-10-02T09:35:30.980073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2807, pipe: [1:7556555712102388042:7823]
2025-10-02T09:35:31.018562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.018829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.018839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.018852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555712102388042:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.018975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.019034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.019060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555712102388042:7823]
2025-10-02T09:35:31.019083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:31.019169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2808 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0
2025-10-02T09:35:31.019324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2808 sessionId: src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0 is DEAD
2025-10-02T09:35:31.019478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:31.019494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Write session will restart in 0.007588s
2025-10-02T09:35:31.019516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Write session: Do CDS request
2025-10-02T09:35:31.019523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.026806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.028196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.028230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.028336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.028343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.028331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.028349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.028345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2809
2025-10-02T09:35:31.028376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.028399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321781514:10479]
2025-10-02T09:35:31.028470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.028497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.028507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.028510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.028751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.028879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2809 sessionId:  describe result for acl check
2025-10-02T09:35:31.028907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.028915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.028917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.028920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397355451:8333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.028922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.028946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.029130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.029161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.029165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.029166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.029166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.029167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.029168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.029168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.029169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.029170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.029170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.029171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.029171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.029174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.029181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.029184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.029186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.029188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.029190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.029192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.029194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.029196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.029198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.029200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.029202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.029205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.029209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.029213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.029215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.029217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.029220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.029222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.029224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.029226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.029229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.029231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.029233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.029235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.029238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.029240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.029244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.029246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.029248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.029250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.029253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.029256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.029259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.029261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.029264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.029280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.029347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397355451:8333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.031117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397355451:8333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.035494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397355451:8333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.035502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397355451:8333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.035504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397355451:8333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.035508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.036708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.038252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.038265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.038266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.038269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.038272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2808 [2:7556555716321781514:10479]
2025-10-02T09:35:31.038278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.038288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.038293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.038295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.038296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.038304Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.038309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.038313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.038340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.038345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.038346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.038348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.038349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.038398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.038405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.038413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.038418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.038429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.038444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355488:8333], now have 1 active actors on pipe
2025-10-02T09:35:31.038449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355339:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.038453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.038454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.038455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.038463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.038452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2808
2025-10-02T09:35:31.038473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.038456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2808
2025-10-02T09:35:31.038475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.038477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.038478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.038483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.038484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.038507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.038512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.038533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.038540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.038555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.038557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.038561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.038563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.038564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.038569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.038574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.038585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.038688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.038694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.038702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.038767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2809 partition: 0 MaxSeqNo: 36 sessionId: src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0
2025-10-02T09:35:31.039070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee90cf88-63f357a1-3fa985d4-8dfe7609_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.041526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Write session: try to update token
2025-10-02T09:35:31.041540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.047536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.047549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.047551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.047552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.047555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.047558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.047560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321781509:10479]
2025-10-02T09:35:31.047578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.047583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.047585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.047591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.047595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.047598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.047685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.053909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId: src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.056131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.119135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397355517:7823]
2025-10-02T09:35:31.119521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2808, pipe: [1:7556555716397355517:7823]
2025-10-02T09:35:31.158308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.158603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.158612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.158626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355517:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.158802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397355517:7823]
2025-10-02T09:35:31.158819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.158825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:31.158827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:31.158840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.158880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2809 reason: error at write: Disconnected sessionId: src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0
2025-10-02T09:35:31.159016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2809 sessionId: src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0 is DEAD
2025-10-02T09:35:31.159138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:31.159146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Write session will restart in 0.009820s
2025-10-02T09:35:31.159164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Write session: Do CDS request
2025-10-02T09:35:31.159169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.166625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.167917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.168019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.168026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.168031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.168057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.168080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321781712:10495]
2025-10-02T09:35:31.168428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.168589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.168613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.168788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.168831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.168835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.168835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.168836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.168836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.168837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.168838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.168838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.168839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.168839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.168840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.168840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.168843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.168850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.168852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.168854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.168856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.168858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.168860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.168862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.168864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.168866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.168868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.168870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.168874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.168878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.168882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.168884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.168886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.168889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.168891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.168893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.168896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.168898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.168900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.168903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.168905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.168912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.168914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.168917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.168919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.168922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.168927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.168930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.168932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.168935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.168940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.168944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.168964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.170096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.170404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.170412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2810
2025-10-02T09:35:31.170553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.170574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.170579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.170582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.170844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2810 sessionId:  describe result for acl check
2025-10-02T09:35:31.170866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.170871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.170872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.170875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397355633:8304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.171210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397355633:8304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.172756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397355633:8304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.175765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397355633:8304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.175773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397355633:8304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.175775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397355633:8304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.175779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.176291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.177780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.177792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.177793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.177795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.177799Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2809 [2:7556555716321781712:10495]
2025-10-02T09:35:31.177806Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.177815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.177821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.177822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.177824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.177834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.177838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.177842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.177873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.177878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.177879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.177881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.177882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.177916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.177921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.177928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.177935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.177943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.177957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355666:8304], now have 1 active actors on pipe
2025-10-02T09:35:31.177963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355518:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.177967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.177968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.177969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.177976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.177987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.177990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.177994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.177995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.177993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2809
2025-10-02T09:35:31.177999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.177997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2809
2025-10-02T09:35:31.178000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.178009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.178010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.178013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.178027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.178033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.178050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.178057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.178059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.178060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.178065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.178070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.178082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.178172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.178177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.178184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.178237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2810 partition: 0 MaxSeqNo: 36 sessionId: src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0
2025-10-02T09:35:31.178432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57d4ce-3457686-e9f5598e-2f3e7d8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.181157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Write session: try to update token
2025-10-02T09:35:31.181166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.187094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.187109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.187111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.187112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.187116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.187118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.187120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321781707:10495]
2025-10-02T09:35:31.187139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.187145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.187146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.187154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.187167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.187170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.187251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.192908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId: src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.195074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.258905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397355687:7823]
2025-10-02T09:35:31.259125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2809, pipe: [1:7556555716397355687:7823]
2025-10-02T09:35:31.298433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.298713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.298722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.298734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355687:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.298854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.298883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:31.298894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:31.298941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2810 reason: error at write: Disconnected sessionId: src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0
2025-10-02T09:35:31.299072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397355687:7823]
2025-10-02T09:35:31.299086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2810 sessionId: src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0 is DEAD
2025-10-02T09:35:31.299098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.299208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:31.299216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Write session will restart in 0.006460s
2025-10-02T09:35:31.299230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Write session: Do CDS request
2025-10-02T09:35:31.299235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.306879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.307126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.307214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.307222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2811
2025-10-02T09:35:31.307295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.307320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.307328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.307330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.307578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2811 sessionId:  describe result for acl check
2025-10-02T09:35:31.307600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.307605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.307605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.307610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397355801:7268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.307937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397355801:7268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.308260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.308355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.308363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.308368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.308394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.308416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321781862:10497]
2025-10-02T09:35:31.308782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.308973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.308998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.309178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.309207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.309211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.309211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.309212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.309212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.309213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.309214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.309214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.309214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.309215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.309215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.309216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.309219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.309225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.309227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.309229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.309231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.309233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.309235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.309237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.309239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.309241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.309243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.309245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.309249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.309253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.309256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.309259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.309261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.309264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.309266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.309269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.309271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.309274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.309276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.309279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.309281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.309284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.309286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.309289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.309291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.309294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.309296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.309299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.309301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.309304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.309306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.309308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.309324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.309454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397355801:7268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.314123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397355801:7268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.314131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397355801:7268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.314132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397355801:7268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.314135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.316760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.318319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.318331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.318332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.318334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.318337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2810 [2:7556555716321781862:10497]
2025-10-02T09:35:31.318344Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.318354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.318360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.318362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.318363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.318372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.318375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.318379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.318409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.318414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.318415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.318417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.318418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.318456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.318461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.318467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.318473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.318481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.318496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355690:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.318501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355840:7268], now have 1 active actors on pipe
2025-10-02T09:35:31.318506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.318507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.318508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.318515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.318534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.318534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.318536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.318537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.318545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.318546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.318543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2810
2025-10-02T09:35:31.318544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2810
2025-10-02T09:35:31.318561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.318566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.318567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.318578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.318584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.318607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.318614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.318616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.318617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.318622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.318631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.318640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.318745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.318750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.318759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.318822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2811 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0
2025-10-02T09:35:31.319035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15495d2-77d7f06e-55055423-cc6cbf60_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.321763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Write session: try to update token
2025-10-02T09:35:31.321782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.327986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.328001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.328002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.328003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.328007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.328009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.328011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321781857:10497]
2025-10-02T09:35:31.328029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.328036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.328037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.328044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.328049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.328052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.328146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.333779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId: src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.335988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.399196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397355848:7823]
2025-10-02T09:35:31.399384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2810, pipe: [1:7556555716397355848:7823]
2025-10-02T09:35:31.438022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.438364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.438373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.438385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355848:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.438546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.438578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.438606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397355848:7823]
2025-10-02T09:35:31.438612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:31.438670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0
2025-10-02T09:35:31.438814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2811 sessionId: src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0 is DEAD
2025-10-02T09:35:31.438988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:31.439007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Write session will restart in 0.009782s
2025-10-02T09:35:31.439030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Write session: Do CDS request
2025-10-02T09:35:31.439036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.446680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.448082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.448194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.448201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.448207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.448239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.448264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321782013:10500]
2025-10-02T09:35:31.448625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.448789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.448823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.449004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.449042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.449047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.449047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.449048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.449048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.449049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.449049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.449050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.449050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.449051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.449051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.449052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.449055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.449061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.449064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.449066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.449068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.449070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.449072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.449074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.449076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.449078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.449080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.449082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.449086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.449090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.449093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.449096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.449099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.449101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.449103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.449106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.449109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.449112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.449114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.449117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.449119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.449121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.449123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.449126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.449128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.449131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.449133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.449135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.449140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.449143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.449145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.449147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.449165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.450292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.450343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.450354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2812
2025-10-02T09:35:31.450466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.450487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.450493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.450495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.450742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2812 sessionId:  describe result for acl check
2025-10-02T09:35:31.450763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.450767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.450769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.450771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397355966:7278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.451105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397355966:7278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.452320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397355966:7278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.456101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397355966:7278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.456109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397355966:7278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.456111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397355966:7278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.456114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.456568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.458139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.458151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.458152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.458154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.458157Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2811 [2:7556555716321782013:10500]
2025-10-02T09:35:31.458163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.458172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.458174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.458175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.458176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.458185Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.458192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.458196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.458223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.458228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.458230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.458231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.458233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.458267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.458273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.458279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.458284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.458295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.458309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356000:7278], now have 1 active actors on pipe
2025-10-02T09:35:31.458315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397355849:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.458318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.458319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.458320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.458330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.458338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.458342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.458345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.458346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.458344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2811
2025-10-02T09:35:31.458361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2811
2025-10-02T09:35:31.458350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.458352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.458360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.458361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.458363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.458375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.458377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.458396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.458403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.458405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.458406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.458411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.458418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.458430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.458507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.458513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.458530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.458593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2812 partition: 0 MaxSeqNo: 36 sessionId: src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0
2025-10-02T09:35:31.458830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1ab037-e901f93a-34b5ad23-f932d294_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.461224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Write session: try to update token
2025-10-02T09:35:31.461238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.467315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.467327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.467328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.467331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.467334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.467336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.467338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321782008:10500]
2025-10-02T09:35:31.467355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.467361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.467362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.467368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.467372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.467375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.467475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.473519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId: src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.475810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.538979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397356008:7823]
2025-10-02T09:35:31.539115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2811, pipe: [1:7556555716397356008:7823]
2025-10-02T09:35:31.578010Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.578251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.578260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.578272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356008:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.578416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397356008:7823]
2025-10-02T09:35:31.578421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.578441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:31.578445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:31.578487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2812 reason: error at write: Disconnected sessionId: src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0
2025-10-02T09:35:31.578594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2812 sessionId: src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0 is DEAD
2025-10-02T09:35:31.578693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:31.578705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Write session will restart in 0.008121s
2025-10-02T09:35:31.578725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Write session: Do CDS request
2025-10-02T09:35:31.578747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.578944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.586692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.588096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.588200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.588211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.588218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.588224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.588251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.588273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321782164:10502]
2025-10-02T09:35:31.588267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.588275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2813
2025-10-02T09:35:31.588384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.588413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.588421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.588423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.588622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.588669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2813 sessionId:  describe result for acl check
2025-10-02T09:35:31.588692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.588696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.588697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.588700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397356126:7315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.588778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.588814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.588997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.589026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.589030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.589031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.589031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.589032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.589032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.589033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.589033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.589034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.589034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.589035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.589036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.589043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397356126:7315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.589039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.589045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.589047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.589049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.589052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.589054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.589056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.589058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.589060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.589062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.589064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.589066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.589069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.589073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.589076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.589079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.589081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.589084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.589086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.589089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.589091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.589093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.589096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.589099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.589105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.589108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.589110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.589113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.589118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.589121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.589123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.589126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.589129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.589136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.589138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.589141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.589160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.590535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397356126:7315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.594509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397356126:7315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.594517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397356126:7315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.594519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397356126:7315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.594530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.596743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.598322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.598335Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.598336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.598338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.598342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2812 [2:7556555716321782164:10502]
2025-10-02T09:35:31.598349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.598359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.598360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.598362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.598363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.598371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.598378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.598382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.598414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.598418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.598420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.598422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.598423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.598460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.598465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.598472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.598477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.598488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.598502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356165:7315], now have 1 active actors on pipe
2025-10-02T09:35:31.598508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356013:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.598512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.598513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.598515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.598531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.598541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.598542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.598543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.598544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.598549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.598551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.598552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2812
2025-10-02T09:35:31.598565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.598553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2812
2025-10-02T09:35:31.598570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.598577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.598591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.598596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.598609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.598618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.598623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.598624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.598629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.598634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.598642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.598742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.598748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.598759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.598825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2813 partition: 0 MaxSeqNo: 36 sessionId: src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0
2025-10-02T09:35:31.599075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e72069-fbe4241f-a4151d88-3adaa3b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.601509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Write session: try to update token
2025-10-02T09:35:31.601525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.611603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T09:35:31.611615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.611619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.611639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T09:35:31.611661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T09:35:31.611768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T09:35:31.611883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:31.611994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:31.612103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T09:35:31.612280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T09:35:31.612306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759397286554 queuesize 0 startOffset 0
2025-10-02T09:35:31.614447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId: src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.616244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.616258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.616262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.616263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.616267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.616269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.616271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321782159:10502]
2025-10-02T09:35:31.616290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.616293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.616294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.616294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.616297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.616299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.616408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.616898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.678753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397356172:7823]
2025-10-02T09:35:31.678954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2812, pipe: [1:7556555716397356172:7823]
2025-10-02T09:35:31.727466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.727704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.727714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.727730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356172:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.727908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:31.727919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:31.727937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.727921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.727957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397356172:7823]
2025-10-02T09:35:31.727966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2813 reason: error at write: Disconnected sessionId: src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0
2025-10-02T09:35:31.728114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2813 sessionId: src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0 is DEAD
2025-10-02T09:35:31.728286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:31.728303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Write session will restart in 0.005669s
2025-10-02T09:35:31.728354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Write session: Do CDS request
2025-10-02T09:35:31.728362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.735192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.735255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.735264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2814
2025-10-02T09:35:31.735387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.735410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.735416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.735419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.735682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2814 sessionId:  describe result for acl check
2025-10-02T09:35:31.735704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.735709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.735709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.735712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397356287:7324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.735944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.736077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397356287:7324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.737250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.737370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.737377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.737383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.737411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.737434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321782316:10504]
2025-10-02T09:35:31.737515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397356287:7324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.737762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.737919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.737940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.738111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.738139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.738143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.738144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.738144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.738145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.738145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.738146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.738147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.738147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.738148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.738148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.738149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.738151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.738157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.738160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.738162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.738164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.738166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.738168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.738170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.738172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.738174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.738176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.738178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.738181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.738184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.738187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.738190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.738193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.738196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.738198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.738201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.738203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.738205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.738207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.738210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.738213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.738216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.738221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.738224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.738226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.738229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.738234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.738237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.738239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.738243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.738248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.738250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.738268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.742019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397356287:7324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.742027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397356287:7324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.742030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397356287:7324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.742033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.745639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.747253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.747269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.747270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.747273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.747278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2813 [2:7556555716321782316:10504]
2025-10-02T09:35:31.747286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.747299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.747307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.747309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.747310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.747319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.747324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.747329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.747359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.747363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.747364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.747366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.747368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.747411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.747416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.747422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.747428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.747439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.747454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356174:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.747459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356327:7324], now have 1 active actors on pipe
2025-10-02T09:35:31.747464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.747466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.747467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.747474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.747483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.747487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.747491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.747492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.747493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.747485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2813
2025-10-02T09:35:31.747495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.747493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2813
2025-10-02T09:35:31.747509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.747514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.747515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.747527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.747530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.747556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|827ff716-685562cd-dfe74b8a-f63edbce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.747563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.747565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.747566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.747571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.747580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.747596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.747697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.747703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.747712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.747776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2814 partition: 0 MaxSeqNo: 36 sessionId: src_id|827ff716-685562cd-dfe74b8a-f63edbce_0
2025-10-02T09:35:31.748052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bbdf71d-f0294e9a-90396541-9d2a3e4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|827ff716-685562cd-dfe74b8a-f63edbce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.750381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Write session: try to update token
2025-10-02T09:35:31.750395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.756612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.756624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.756626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.756627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.756631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.756633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.756636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321782311:10504]
2025-10-02T09:35:31.756655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.756662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.756663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.756665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.756669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.756672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.756777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.762509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId: src_id|827ff716-685562cd-dfe74b8a-f63edbce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.764781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.828245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397356334:7823]
2025-10-02T09:35:31.828415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2813, pipe: [1:7556555716397356334:7823]
2025-10-02T09:35:31.867799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:31.868037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.868046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.868058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356334:7823], now have 1 active actors on pipe
2025-10-02T09:35:31.868173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:31.868215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397356334:7823]
2025-10-02T09:35:31.868238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:31.868244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:31.868301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2814 reason: status is not ok: tablet will be restarted right now sessionId: src_id|827ff716-685562cd-dfe74b8a-f63edbce_0
2025-10-02T09:35:31.868438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2814 sessionId: src_id|827ff716-685562cd-dfe74b8a-f63edbce_0 is DEAD
2025-10-02T09:35:31.868582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:31.868595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Write session will restart in 0.005584s
2025-10-02T09:35:31.868620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Write session: Do CDS request
2025-10-02T09:35:31.868625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:31.875154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.875267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:31.875275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2815
2025-10-02T09:35:31.875395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:31.875418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:31.875424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:31.875426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:31.875706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2815 sessionId:  describe result for acl check
2025-10-02T09:35:31.875725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:31.875730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:31.875731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:31.875734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555716397356448:7357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:31.876086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555716397356448:7357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:31.876140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:31.877365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555716397356448:7357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:31.877550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:31.877654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:31.877661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:31.877667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:31.877693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:31.877717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555716321782469:10506]
2025-10-02T09:35:31.878055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:31.878215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:31.878236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:31.878431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:31.878464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.878469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.878470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.878471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.878472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.878473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.878474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.878474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.878475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.878476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.878477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.878478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.878481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.878491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.878494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.878497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.878502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.878506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.878513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.878517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.878519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.878523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.878536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.878538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.878542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.878546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:31.878549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.878555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:31.878557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.878560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:31.878563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.878569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:31.878571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.878574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:31.878576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.878579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:31.878581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.878585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:31.878588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.878590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:31.878595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.878598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:31.878600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.878604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.878609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.878611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.878613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.878616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.878636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:31.882399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555716397356448:7357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:31.882407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555716397356448:7357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:31.882409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555716397356448:7357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:31.882413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:31.886012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:31.887733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:31.887744Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:31.887745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:31.887747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:31.887750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2814 [2:7556555716321782469:10506]
2025-10-02T09:35:31.887757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:31.887768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:31.887773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.887774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.887776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.887785Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:31.887788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:31.887792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:31.887823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.887828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.887829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.887832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:31.887833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:31.887869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:31.887874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.887881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:31.887886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:31.887898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:31.887912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356489:7357], now have 1 active actors on pipe
2025-10-02T09:35:31.887918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356336:2446], now have 1 active actors on pipe
2025-10-02T09:35:31.887921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.887923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.887924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.887931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:31.887938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:31.887944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:31.887947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:31.887949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:31.887937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2814
2025-10-02T09:35:31.887950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:31.887941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2814
2025-10-02T09:35:31.887952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:31.887963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.887965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:31.887966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:31.887974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.887976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.887999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:31.888005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:31.888007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:31.888008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:31.888013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:31.888021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:31.888030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.888109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:31.888114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:31.888121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:31.888182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2815 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0
2025-10-02T09:35:31.888454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff716-685562cd-dfe74b8a-f63edbce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:31.890780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Write session: try to update token
2025-10-02T09:35:31.890796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:31.896969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:31.896979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:31.896980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:31.896983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:31.896986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.896988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.896990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555716321782464:10506]
2025-10-02T09:35:31.897008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:31.897012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:31.897014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:31.897015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:31.897015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:31.897016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:31.897128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:31.902866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId: src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:31.905109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:31.968545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555716397356504:7823]
2025-10-02T09:35:31.968677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2814, pipe: [1:7556555716397356504:7823]
2025-10-02T09:35:32.007236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.007527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.007536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.007548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555716397356504:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.007669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.007700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555716397356504:7823]
2025-10-02T09:35:32.007706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:32.007708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:32.007721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.007752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2815 reason: error at write: Disconnected sessionId: src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0
2025-10-02T09:35:32.007895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2815 sessionId: src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0 is DEAD
2025-10-02T09:35:32.008044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:32.008059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Write session will restart in 0.007310s
2025-10-02T09:35:32.008080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Write session: Do CDS request
2025-10-02T09:35:32.008085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.015776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.016186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.016379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.016387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2816
2025-10-02T09:35:32.016513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.016535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.016541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.016544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.016836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2816 sessionId:  describe result for acl check
2025-10-02T09:35:32.016859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.016863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.016864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.016867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692323920:7361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.017167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.017235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692323920:7361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.017267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.017273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.017280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.017307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.017344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616749918:10508]
2025-10-02T09:35:32.017952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.018104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.018127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.018402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.018429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.018433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.018433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.018434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.018435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.018436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.018436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.018437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.018438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.018438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.018439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.018440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.018442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.018449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.018451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.018453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.018455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.018458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.018460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.018462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.018464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.018466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.018468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.018470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.018474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.018479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.018482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.018485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.018487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.018490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.018492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.018495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.018497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.018500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.018502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.018504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.018506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.018509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.018511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.018513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.018515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.018519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.018521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.018524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.018536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.018539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.018541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.018544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.018561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.018627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692323920:7361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.023321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692323920:7361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.023329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692323920:7361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.023331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692323920:7361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.023335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.026002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.027574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.027586Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.027587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.027590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.027594Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2815 [2:7556555720616749918:10508]
2025-10-02T09:35:32.027603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.027613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.027620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.027622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.027624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.027633Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.027636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.027640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.027675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.027679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.027680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.027682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.027683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.027731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.027736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.027742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.027748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.027758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.027774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692323804:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.027780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692323959:7361], now have 1 active actors on pipe
2025-10-02T09:35:32.027784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.027785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.027786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.027794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.027804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.027808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.027810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.027811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.027815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.027816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.027806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2815
2025-10-02T09:35:32.027809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2815
2025-10-02T09:35:32.027831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.027837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.027838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.027849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.027853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.027879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.027886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.027888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.027889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.027894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.027903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.027915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.028023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.028028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.028035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.028089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2816 partition: 0 MaxSeqNo: 36 sessionId: src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0
2025-10-02T09:35:32.028420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9dae4d-f2ad427c-462d87e0-6dfea80a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.030786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Write session: try to update token
2025-10-02T09:35:32.030804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.037007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.037017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.037018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.037019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.037024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.037026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.037030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616749913:10508]
2025-10-02T09:35:32.037049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.037056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.037057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.037063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.037068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.037071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.037184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.042925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId: src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.044984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.107800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692323980:7823]
2025-10-02T09:35:32.108142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2815, pipe: [1:7556555720692323980:7823]
2025-10-02T09:35:32.150466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.150733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.150742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.150755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692323980:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.150896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.150928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692323980:7823]
2025-10-02T09:35:32.150932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:32.150935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:32.150954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.150985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2816 reason: error at write: Disconnected sessionId: src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0
2025-10-02T09:35:32.151139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2816 sessionId: src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0 is DEAD
2025-10-02T09:35:32.151291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:32.151305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Write session will restart in 0.008497s
2025-10-02T09:35:32.151325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Write session: Do CDS request
2025-10-02T09:35:32.151331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.159403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.160709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.160861Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.160868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.160875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.160915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.160938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616750123:10524]
2025-10-02T09:35:32.161200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.161282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.161291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.161299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2817
2025-10-02T09:35:32.161394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.161416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.161424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.161427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.161454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.161480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.161661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.161680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2817 sessionId:  describe result for acl check
2025-10-02T09:35:32.161691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.161695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.161695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.161696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.161704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.161696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.161709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.161697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.161711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.161697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.161715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692324109:7426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.161698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.161698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.161699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.161699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.161700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.161703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.161710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.161712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.161714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.161716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.161718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.161720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.161722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.161724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.161726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.161728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.161730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.161736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.161740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.161743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.161746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.161748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.161751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.161753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.161756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.161758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.161760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.161762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.161765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.161767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.161770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.161773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.161776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.161778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.161780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.161782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.161785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.161787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.161790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.161791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.161794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.161811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.162092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692324109:7426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.163536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692324109:7426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.167910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692324109:7426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.167918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692324109:7426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.167919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692324109:7426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.167923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.169152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.170623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.170632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.170633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.170635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.170639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2816 [2:7556555720616750123:10524]
2025-10-02T09:35:32.170646Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.170657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.170659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.170660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.170661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.170670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.170676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.170680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.170708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.170713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.170714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.170716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.170717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.170753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.170758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.170764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.170769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.170780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.170794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692323990:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.170799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324146:7426], now have 1 active actors on pipe
2025-10-02T09:35:32.170803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.170804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.170805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.170812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.170819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.170825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.170827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.170828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.170830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.170832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.170830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2816
2025-10-02T09:35:32.170846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2816
2025-10-02T09:35:32.170846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.170851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.170852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.170866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.170871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.170888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77a7a785-bad9471b-84073c8b-554a54cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.170895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.170897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.170898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.170902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.170907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.170923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.171019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.171024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.171032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.171088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2817 partition: 0 MaxSeqNo: 36 sessionId: src_id|77a7a785-bad9471b-84073c8b-554a54cc_0
2025-10-02T09:35:32.171317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d43b4d21-e8dfe950-7d08fed1-671079d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|77a7a785-bad9471b-84073c8b-554a54cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.173632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Write session: try to update token
2025-10-02T09:35:32.173645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.179824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.179834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.179835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.179836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.179840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.179842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.179843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616750118:10524]
2025-10-02T09:35:32.179862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.179865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.179866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.179874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.179881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.179884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.179976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.185608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId: src_id|77a7a785-bad9471b-84073c8b-554a54cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.187725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.251170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692324166:7823]
2025-10-02T09:35:32.251344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2816, pipe: [1:7556555720692324166:7823]
2025-10-02T09:35:32.290081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.290336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.290344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.290357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324166:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.290675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.290672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:32.290681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:32.290702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692324166:7823]
2025-10-02T09:35:32.290722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2817 reason: error at write: Disconnected sessionId: src_id|77a7a785-bad9471b-84073c8b-554a54cc_0
2025-10-02T09:35:32.290723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.290863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2817 sessionId: src_id|77a7a785-bad9471b-84073c8b-554a54cc_0 is DEAD
2025-10-02T09:35:32.290974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:32.290982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Write session will restart in 0.009427s
2025-10-02T09:35:32.291000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Write session: Do CDS request
2025-10-02T09:35:32.291004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.298967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.300270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.300368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.300374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.300380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.300405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.300428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616750279:10526]
2025-10-02T09:35:32.300771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.300950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.300976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.301124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.301158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.301187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.301191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.301192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.301193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.301193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.301194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.301195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.301195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.301196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.301196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.301197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.301197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.301200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.301207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.301209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.301211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.301213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.301215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.301217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.301219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.301221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.301224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.301226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.301228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.301232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.301236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.301239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.301242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.301244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.301247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.301249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.301252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.301254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.301257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.301236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.301259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.301244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2818
2025-10-02T09:35:32.301263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.301265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.301268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.301270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.301273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.301276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.301279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.301281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.301284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.301286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.301289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.301291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.301294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.301310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.301350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.301367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.301371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.301373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.301649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2818 sessionId:  describe result for acl check
2025-10-02T09:35:32.301676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.301683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.301684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.301688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692324291:7470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.302018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692324291:7470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.303173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692324291:7470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.307429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692324291:7470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.307437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692324291:7470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.307439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692324291:7470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.307443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.308666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.310141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.310152Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.310153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.310155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.310158Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2817 [2:7556555720616750279:10526]
2025-10-02T09:35:32.310166Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.310174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.310176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.310177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.310178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.310187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.310190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.310195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.310225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.310230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.310231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.310233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.310234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.310271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.310276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.310282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.310287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.310298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.310312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324326:7470], now have 1 active actors on pipe
2025-10-02T09:35:32.310317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324167:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.310321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.310322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.310324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.310331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.310339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.310344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.310346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.310347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.310350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.310352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.310351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2817
2025-10-02T09:35:32.310352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2817
2025-10-02T09:35:32.310364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.310369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.310377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.310383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.310385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.310404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|826b1bc8-3f96f945-a3988f36-b00de769_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.310412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.310414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.310416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.310421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.310426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.310441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.310534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.310540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.310547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.310607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2818 partition: 0 MaxSeqNo: 36 sessionId: src_id|826b1bc8-3f96f945-a3988f36-b00de769_0
2025-10-02T09:35:32.310810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a7a785-bad9471b-84073c8b-554a54cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|826b1bc8-3f96f945-a3988f36-b00de769_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.313599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Write session: try to update token
2025-10-02T09:35:32.313608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.319499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.319511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.319512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.319513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.319518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.319521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.319523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616750274:10526]
2025-10-02T09:35:32.319543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.319546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.319547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.319556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.319565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.319571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.319658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.325738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId: src_id|826b1bc8-3f96f945-a3988f36-b00de769_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.327819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.390944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692324334:7823]
2025-10-02T09:35:32.391100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2817, pipe: [1:7556555720692324334:7823]
2025-10-02T09:35:32.433592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.433908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.433917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.433929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324334:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.434255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:32.434263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:32.434268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.434296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692324334:7823]
2025-10-02T09:35:32.434305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2818 reason: error at write: Disconnected sessionId: src_id|826b1bc8-3f96f945-a3988f36-b00de769_0
2025-10-02T09:35:32.434440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2818 sessionId: src_id|826b1bc8-3f96f945-a3988f36-b00de769_0 is DEAD
2025-10-02T09:35:32.434449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.434576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:32.434585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Write session will restart in 0.006841s
2025-10-02T09:35:32.434599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Write session: Do CDS request
2025-10-02T09:35:32.434603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.442000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.442114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.442310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.442318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2819
2025-10-02T09:35:32.442394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.442414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.442420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.442422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.442686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2819 sessionId:  describe result for acl check
2025-10-02T09:35:32.442706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.442707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.442708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.442713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692324454:7491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.443044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692324454:7491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.443416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.443514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.443521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.443526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.443552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.443573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616750437:10529]
2025-10-02T09:35:32.443911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.444073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.444096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.444272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.444301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.444305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.444306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.444306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.444307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.444307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.444308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.444308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.444309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.444309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.444310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.444311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.444313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.444319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.444321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.444324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.444326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.444327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.444329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.444331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.444333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.444336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.444338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.444340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.444343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.444347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.444350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.444353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.444355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.444357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.444360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.444362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.444365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.444367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.444370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.444372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.444375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.444377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.444379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.444382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.444384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.444387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.444389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.444392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.444395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.444397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.444399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.444402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.444419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.444548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692324454:7491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.449170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692324454:7491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.449178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692324454:7491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.449180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692324454:7491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.449184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.451810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.453404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.453415Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.453416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.453418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.453422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2818 [2:7556555720616750437:10529]
2025-10-02T09:35:32.453430Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.453441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.453442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.453444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.453445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.453454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.453457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.453462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.453492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.453498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.453499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.453500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.453502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.453539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.453543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.453550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.453555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.453563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.453579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324493:7491], now have 1 active actors on pipe
2025-10-02T09:35:32.453584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324335:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.453588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.453590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.453591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.453598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.453609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.453612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.453614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.453616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.453619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.453621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.453636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.453641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.453626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2818
2025-10-02T09:35:32.453648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2818
2025-10-02T09:35:32.453651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.453652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.453655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.453683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.453690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.453694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.453698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.453703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.453711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.453724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.453848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.453854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.453865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.453942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2819 partition: 0 MaxSeqNo: 36 sessionId: src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0
2025-10-02T09:35:32.454154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826b1bc8-3f96f945-a3988f36-b00de769_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.456982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Write session: try to update token
2025-10-02T09:35:32.456992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.462919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.462932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.462933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.462934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.462940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.462943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.462945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616750432:10529]
2025-10-02T09:35:32.462964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.462968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.462969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.462977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.462988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.462991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.463107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.468322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId: src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.470389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.534294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692324510:7823]
2025-10-02T09:35:32.534458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2818, pipe: [1:7556555720692324510:7823]
2025-10-02T09:35:32.573127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.573388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.573397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.573409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324510:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.573560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.573620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T09:35:32.573629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T09:35:32.573642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692324510:7823]
2025-10-02T09:35:32.573658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.573686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2819 reason: error at write: Disconnected sessionId: src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0
2025-10-02T09:35:32.573856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2819 sessionId: src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0 is DEAD
2025-10-02T09:35:32.573959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T09:35:32.573967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Write session will restart in 0.007034s
2025-10-02T09:35:32.573986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Write session: Do CDS request
2025-10-02T09:35:32.573991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.581766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.582068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.582175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.582185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2820
2025-10-02T09:35:32.582267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.582291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.582299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.582302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.582599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2820 sessionId:  describe result for acl check
2025-10-02T09:35:32.582622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.582626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.582627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.582630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692324631:7484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.582982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692324631:7484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.583167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.583294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.583301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.583307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.583336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.583366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616750595:10531]
2025-10-02T09:35:32.583704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.583871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.583894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.584067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.584095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.584099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.584099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.584100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.584100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.584101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.584102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.584102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.584103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.584103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.584104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.584104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.584107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.584113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.584115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.584117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.584119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.584121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.584123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.584125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.584127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.584129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.584131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.584133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.584137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.584141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.584144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.584147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.584150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.584153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.584155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.584158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.584163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.584166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.584168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.584170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.584174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.584177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.584179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.584181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.584184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.584186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.584188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.584191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.584197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.584199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.584201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.584204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.584220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.584355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692324631:7484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.588934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692324631:7484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.588943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692324631:7484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.588945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692324631:7484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.588948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.591520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.593005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.593016Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.593017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.593019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.593022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2819 [2:7556555720616750595:10531]
2025-10-02T09:35:32.593031Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.593040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.593042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.593043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.593044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.593053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.593056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.593061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.593098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.593103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.593104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.593105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.593107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.593145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.593150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.593156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.593164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.593174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.593188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324670:7484], now have 1 active actors on pipe
2025-10-02T09:35:32.593193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324511:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.593196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.593197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.593199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.593206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.593217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.593219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.593221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.593222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.593227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.593228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.593227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2819
2025-10-02T09:35:32.593241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.593246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.593227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2819
2025-10-02T09:35:32.593255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.593260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.593262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.593279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.593286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.593288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.593289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.593294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.593302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.593316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.593415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.593419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.593426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.593492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2820 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0
2025-10-02T09:35:32.593697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8236130a-9f9302e9-ac1d06bc-3aac3f5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.596432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Write session: try to update token
2025-10-02T09:35:32.596443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.602488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.602500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.602502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.602503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.602510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.602513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.602517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616750590:10531]
2025-10-02T09:35:32.602551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.602551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.602554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.602557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.602558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.602559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.602673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.607783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId: src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.610039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.673575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692324677:7823]
2025-10-02T09:35:32.673777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2819, pipe: [1:7556555720692324677:7823]
2025-10-02T09:35:32.714470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.714695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.714704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.714716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324677:7823], now have 1 active actors on pipe
2025-10-02T09:35:32.714836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T09:35:32.714875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556555720692324677:7823]
2025-10-02T09:35:32.714887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T09:35:32.714896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T09:35:32.714944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2820 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0
2025-10-02T09:35:32.715088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2820 sessionId: src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0 is DEAD
2025-10-02T09:35:32.715226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T09:35:32.715236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Write session will restart in 0.006700s
2025-10-02T09:35:32.715257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Write session: Do CDS request
2025-10-02T09:35:32.715263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Start write session. Will connect to endpoint: localhost:28926
2025-10-02T09:35:32.722747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T09:35:32.723130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.723226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T09:35:32.723235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2821
2025-10-02T09:35:32.723315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T09:35:32.723335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40444
2025-10-02T09:35:32.723341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40444 proto=v1  topic=test-topic durationSec=0
2025-10-02T09:35:32.723344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T09:35:32.723613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2821 sessionId:  describe result for acl check
2025-10-02T09:35:32.723635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T09:35:32.723640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T09:35:32.723641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T09:35:32.723643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556555720692324800:7522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T09:35:32.723983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556555720692324800:7522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T09:35:32.724122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T09:35:32.724238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T09:35:32.724245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T09:35:32.724251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T09:35:32.724279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T09:35:32.724301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556555720616750754:10533]
2025-10-02T09:35:32.724642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T09:35:32.724794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T09:35:32.724828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T09:35:32.725001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T09:35:32.725029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.725033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.725034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.725034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.725035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.725035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.725036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.725036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.725037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.725037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.725038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.725038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.725041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.725046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.725048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.725050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.725052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.725054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.725056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.725058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.725060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.725062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.725064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.725066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.725070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.725073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T09:35:32.725077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.725079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T09:35:32.725075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556555720692324800:7522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T09:35:32.725082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.725084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-02T09:35:32.725086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.725089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-02T09:35:32.725091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.725094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-02T09:35:32.725096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.725098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-02T09:35:32.725101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.725103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-02T09:35:32.725105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.725108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-02T09:35:32.725115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.725118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 6964702 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00012|
2025-10-02T09:35:32.725120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.725122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1741189 so 0 eo 33 d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.725127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.725130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.725132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.725135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.725152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T09:35:32.729847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556555720692324800:7522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T09:35:32.729857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556555720692324800:7522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T09:35:32.729862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556555720692324800:7522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T09:35:32.729867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T09:35:32.732505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 36 key 28,4 valuesize 6964702 expected 6964702
2025-10-02T09:35:32.733951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T09:35:32.733961Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T09:35:32.733962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T09:35:32.733964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T09:35:32.733968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2820 [2:7556555720616750754:10533]
2025-10-02T09:35:32.733975Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
2025-10-02T09:35:32.733985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T09:35:32.733990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.733991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.733992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.734001Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-02T09:35:32.734006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T09:35:32.734013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T09:35:32.734041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.734046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.734047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.734049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-10-02T09:35:32.734050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T09:35:32.734087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T09:35:32.734092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.734098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-02T09:35:32.734103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-10-02T09:35:32.734111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T09:35:32.734125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324679:2446], now have 1 active actors on pipe
2025-10-02T09:35:32.734130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556555720692324839:7522], now have 1 active actors on pipe
2025-10-02T09:35:32.734133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 1 count 1 parts_count 3 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.734134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.734135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.734143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-02T09:35:32.734153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-02T09:35:32.734145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2820
2025-10-02T09:35:32.734147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2820
2025-10-02T09:35:32.734156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 1 count 1 parts_count 3
2025-10-02T09:35:32.734158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-02T09:35:32.734159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-10-02T09:35:32.734161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-02T09:35:32.734163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T09:35:32.734180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.734185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T09:35:32.734186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T09:35:32.734193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.734197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.734220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T09:35:32.734227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T09:35:32.734229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T09:35:32.734230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T09:35:32.734237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T09:35:32.734245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T09:35:32.734255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.734337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T09:35:32.734341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T09:35:32.734349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T09:35:32.734401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2821 partition: 0 MaxSeqNo: 36 sessionId: src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0
2025-10-02T09:35:32.734600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5548b1a-6359f8bd-6f30155e-2fad6235_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T09:35:32.737349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Write session: try to update token
2025-10-02T09:35:32.737360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-02T09:35:32.743351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-02T09:35:32.743364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T09:35:32.743365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T09:35:32.743367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-02T09:35:32.743372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 1 size 1741189 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.743374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.743376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7556555720616750749:10533]
2025-10-02T09:35:32.743397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T09:35:32.743399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-02T09:35:32.743402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-02T09:35:32.743403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000032_00001_0000000001_00003?
2025-10-02T09:35:32.743404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-02T09:35:32.743404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T09:35:32.743514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-10-02T09:35:32.748375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId: src_id|dfc168c5-4bb7c05f-d96c5c0b-55b5374e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T09:35:32.750517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T09:35:32.814884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7556555720692324846:7823]
2025-10-02T09:35:32.815038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_11005836875355772221_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2820, pipe: [1:7556555720692324846:7823]
2025-10-02T09:35:32.852631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=32;Head.PackedSize=6964702;NewHead.Offset=32;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T09:35:32.853002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topi